2024-08-18T22:03:54.609 INFO:root:teuthology version: 1.2.0 2024-08-18T22:03:54.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-18T22:03:54.953 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub} email: ceph-qa@ceph.com first_in_suite: false job_id: '7859915' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 kclient: syntax: v1 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1664 sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 sleep_before_teardown: 0 subset: 36/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD0b0saleYItaILWLjq1KzkQ+CNi7whRI4dS93Rao0Xh0VpFUA7HuBXiYV6rB8MqcBuFNNcDNlCF0RXRpTFzmBg= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNnw/k1GdJVGwyUJOYw1ayi6+u2cBEMyVvvY4gmAAD0SHvZXPJtvymUOFGQJvmkKxMkDLcAW5zALlJaif3x4Fbc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-18_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-18T22:03:54.953 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa; will attempt to use it 2024-08-18T22:03:54.954 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks 2024-08-18T22:03:54.954 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-18T22:03:54.956 INFO:teuthology.task.internal:Checking packages... 2024-08-18T22:03:54.977 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'de09dd018de4baddfa6ca4d43bc8fb784cf75833' 2024-08-18T22:03:54.977 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T22:03:54.977 INFO:teuthology.packaging:ref: None 2024-08-18T22:03:54.977 INFO:teuthology.packaging:tag: None 2024-08-18T22:03:54.977 INFO:teuthology.packaging:branch: squid 2024-08-18T22:03:54.977 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:03:54.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-08-18T22:03:55.206 INFO:teuthology.task.internal:Found packages for ceph version 19.1.0-1386-g78215f5a-1jammy 2024-08-18T22:03:55.208 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-18T22:03:55.214 INFO:teuthology.task.internal:no buildpackages task found 2024-08-18T22:03:55.214 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-18T22:03:55.220 INFO:teuthology.task.internal:Saving configuration 2024-08-18T22:03:55.237 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-18T22:03:55.243 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-18T22:03:55.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 21:58:28.527185', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAqKIppdOgjofawdaMpCmOh9LPLgYL9cxjX6UJHGoHDd'} 2024-08-18T22:03:55.286 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 21:58:28.525422', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE3SqtEAzbfVFIICuUX3OsYTVIyKVG04YwcvTxnrhEdP'} 2024-08-18T22:03:55.286 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-18T22:03:55.292 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-18T22:03:55.293 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-18T22:03:55.293 INFO:teuthology.run_tasks:Running task console_log... 2024-08-18T22:03:55.338 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8c71ca0700>, signals=[15]) 2024-08-18T22:03:55.339 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-18T22:03:55.344 INFO:teuthology.task.internal:Opening connections... 2024-08-18T22:03:55.344 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:03:55.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:03:55.427 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:03:55.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:03:55.504 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-18T22:03:55.510 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-08-18T22:03:55.515 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-08-18T22:03:55.515 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-08-18T22:03:55.562 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-18T22:03:55.562 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Ubuntu" 2024-08-18T22:03:55.562 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="22.04" 2024-08-18T22:03:55.562 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-18T22:03:55.562 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_CODENAME=jammy 2024-08-18T22:03:55.562 INFO:teuthology.orchestra.run.smithi005.stdout:ID=ubuntu 2024-08-18T22:03:55.562 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE=debian 2024-08-18T22:03:55.562 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-18T22:03:55.563 INFO:teuthology.orchestra.run.smithi005.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-18T22:03:55.563 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-18T22:03:55.563 INFO:teuthology.orchestra.run.smithi005.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-18T22:03:55.563 INFO:teuthology.orchestra.run.smithi005.stdout:UBUNTU_CODENAME=jammy 2024-08-18T22:03:55.563 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-08-18T22:03:55.592 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-08-18T22:03:55.597 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-08-18T22:03:55.597 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-08-18T22:03:55.643 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-18T22:03:55.643 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2024-08-18T22:03:55.643 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="22.04" 2024-08-18T22:03:55.644 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-18T22:03:55.644 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=jammy 2024-08-18T22:03:55.644 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2024-08-18T22:03:55.644 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2024-08-18T22:03:55.644 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-18T22:03:55.644 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-18T22:03:55.644 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-18T22:03:55.644 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-18T22:03:55.644 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=jammy 2024-08-18T22:03:55.644 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-08-18T22:03:55.667 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-18T22:03:55.674 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-18T22:03:55.682 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-18T22:03:55.682 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-08-18T22:03:55.685 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-08-18T22:03:55.689 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-18T22:03:55.693 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-18T22:03:55.694 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-08-18T22:03:55.732 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-08-18T22:03:55.738 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-18T22:03:55.778 INFO:teuthology.run_tasks:Running task kernel... 2024-08-18T22:03:55.791 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-18T22:03:55.792 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-18T22:03:55.792 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-18T22:03:55.792 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T22:03:55.793 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T22:03:55.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:03:55.797 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-08-18T22:03:55.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:03:55.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-08-18T22:03:55.951 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-18T22:03:55.951 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-18T22:03:55.952 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-08-18T22:03:55.957 INFO:teuthology.orchestra.run.smithi117.stdout:5.15.0-56-generic 2024-08-18T22:03:55.957 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-18T22:03:55.958 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-18T22:03:55.958 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-08-18T22:03:55.958 DEBUG:teuthology.orchestra.run.smithi117:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-08-18T22:03:55.978 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-18T22:03:55.978 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-18T22:03:55.978 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-08-18T22:03:55.984 INFO:teuthology.orchestra.run.smithi005.stdout:5.15.0-56-generic 2024-08-18T22:03:55.984 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-18T22:03:55.984 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-18T22:03:55.984 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-08-18T22:03:55.985 DEBUG:teuthology.orchestra.run.smithi005:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-08-18T22:03:56.014 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-08-18T22:03:56.037 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-08-18T22:03:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-18T22:03:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-08-18T22:03:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-08-18T22:03:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:hint: 2024-08-18T22:03:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:hint: git config --global init.defaultBranch 2024-08-18T22:03:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:hint: 2024-08-18T22:03:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-18T22:03:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-08-18T22:03:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:hint: 2024-08-18T22:03:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:hint: git branch -m 2024-08-18T22:03:56.130 INFO:teuthology.orchestra.run.smithi117.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-08-18T22:03:56.131 DEBUG:teuthology.orchestra.run.smithi117:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-08-18T22:03:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-18T22:03:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-08-18T22:03:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-08-18T22:03:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 2024-08-18T22:03:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:hint: git config --global init.defaultBranch 2024-08-18T22:03:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 2024-08-18T22:03:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-18T22:03:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-08-18T22:03:56.157 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 2024-08-18T22:03:56.157 INFO:teuthology.orchestra.run.smithi005.stderr:hint: git branch -m 2024-08-18T22:03:56.157 INFO:teuthology.orchestra.run.smithi005.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-08-18T22:03:56.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-08-18T22:03:56.203 DEBUG:teuthology.orchestra.run.smithi117:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-08-18T22:03:56.226 DEBUG:teuthology.orchestra.run.smithi005:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-08-18T22:03:56.265 DEBUG:teuthology.orchestra.run.smithi117:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-08-18T22:03:56.284 DEBUG:teuthology.orchestra.run.smithi005:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-08-18T22:04:26.536 INFO:teuthology.orchestra.run.smithi117.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-08-18T22:04:26.536 INFO:teuthology.orchestra.run.smithi117.stderr: * [new branch] main -> origin/main 2024-08-18T22:04:26.572 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20190312 -> 20190312 2024-08-18T22:04:26.573 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20190416 -> 20190416 2024-08-18T22:04:26.573 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20190514 -> 20190514 2024-08-18T22:04:26.573 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20190618 -> 20190618 2024-08-18T22:04:26.573 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20190717 -> 20190717 2024-08-18T22:04:26.573 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20190815 -> 20190815 2024-08-18T22:04:26.573 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20190923 -> 20190923 2024-08-18T22:04:26.576 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20191022 -> 20191022 2024-08-18T22:04:26.576 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20191215 -> 20191215 2024-08-18T22:04:26.576 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20200122 -> 20200122 2024-08-18T22:04:26.576 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20200316 -> 20200316 2024-08-18T22:04:26.576 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20200421 -> 20200421 2024-08-18T22:04:26.576 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20200519 -> 20200519 2024-08-18T22:04:26.576 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20200619 -> 20200619 2024-08-18T22:04:26.576 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20200721 -> 20200721 2024-08-18T22:04:26.576 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20200817 -> 20200817 2024-08-18T22:04:26.576 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20200918 -> 20200918 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20201022 -> 20201022 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20201118 -> 20201118 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20201218 -> 20201218 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20210208 -> 20210208 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20210315 -> 20210315 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20210511 -> 20210511 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20210716 -> 20210716 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20210818 -> 20210818 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20210919 -> 20210919 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20211027 -> 20211027 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20211216 -> 20211216 2024-08-18T22:04:26.577 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20220209 -> 20220209 2024-08-18T22:04:26.580 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20220310 -> 20220310 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20220411 -> 20220411 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20220509 -> 20220509 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20220610 -> 20220610 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20220708 -> 20220708 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20220815 -> 20220815 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20220913 -> 20220913 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20221012 -> 20221012 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20221109 -> 20221109 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20221214 -> 20221214 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20230117 -> 20230117 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20230210 -> 20230210 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20230310 -> 20230310 2024-08-18T22:04:26.581 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20230404 -> 20230404 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20230515 -> 20230515 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20230625 -> 20230625 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20230804 -> 20230804 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20230919 -> 20230919 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20231030 -> 20231030 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20231111 -> 20231111 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20231211 -> 20231211 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20240115 -> 20240115 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20240220 -> 20240220 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20240312 -> 20240312 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20240410 -> 20240410 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20240513 -> 20240513 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20240610 -> 20240610 2024-08-18T22:04:26.582 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20240709 -> 20240709 2024-08-18T22:04:26.583 INFO:teuthology.orchestra.run.smithi117.stderr: * [new tag] 20240811 -> 20240811 2024-08-18T22:04:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-08-18T22:04:26.846 INFO:teuthology.orchestra.run.smithi005.stderr: * [new branch] main -> origin/main 2024-08-18T22:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190312 -> 20190312 2024-08-18T22:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190416 -> 20190416 2024-08-18T22:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190514 -> 20190514 2024-08-18T22:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190618 -> 20190618 2024-08-18T22:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190717 -> 20190717 2024-08-18T22:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190815 -> 20190815 2024-08-18T22:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190923 -> 20190923 2024-08-18T22:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20191022 -> 20191022 2024-08-18T22:04:26.886 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20191215 -> 20191215 2024-08-18T22:04:26.887 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200122 -> 20200122 2024-08-18T22:04:26.887 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200316 -> 20200316 2024-08-18T22:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200421 -> 20200421 2024-08-18T22:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200519 -> 20200519 2024-08-18T22:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200619 -> 20200619 2024-08-18T22:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200721 -> 20200721 2024-08-18T22:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200817 -> 20200817 2024-08-18T22:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200918 -> 20200918 2024-08-18T22:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20201022 -> 20201022 2024-08-18T22:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20201118 -> 20201118 2024-08-18T22:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20201218 -> 20201218 2024-08-18T22:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210208 -> 20210208 2024-08-18T22:04:26.893 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210315 -> 20210315 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210511 -> 20210511 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210716 -> 20210716 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210818 -> 20210818 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210919 -> 20210919 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20211027 -> 20211027 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20211216 -> 20211216 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220209 -> 20220209 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220310 -> 20220310 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220411 -> 20220411 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220509 -> 20220509 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220610 -> 20220610 2024-08-18T22:04:26.894 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220708 -> 20220708 2024-08-18T22:04:26.895 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220815 -> 20220815 2024-08-18T22:04:26.895 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220913 -> 20220913 2024-08-18T22:04:26.895 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20221012 -> 20221012 2024-08-18T22:04:26.895 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20221109 -> 20221109 2024-08-18T22:04:26.895 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20221214 -> 20221214 2024-08-18T22:04:26.895 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230117 -> 20230117 2024-08-18T22:04:26.895 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230210 -> 20230210 2024-08-18T22:04:26.895 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230310 -> 20230310 2024-08-18T22:04:26.895 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230404 -> 20230404 2024-08-18T22:04:26.895 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230515 -> 20230515 2024-08-18T22:04:26.895 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230625 -> 20230625 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230804 -> 20230804 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230919 -> 20230919 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20231030 -> 20231030 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20231111 -> 20231111 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20231211 -> 20231211 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20240115 -> 20240115 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20240220 -> 20240220 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20240312 -> 20240312 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20240410 -> 20240410 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20240513 -> 20240513 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20240610 -> 20240610 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20240709 -> 20240709 2024-08-18T22:04:26.896 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20240811 -> 20240811 2024-08-18T22:04:31.009 INFO:teuthology.orchestra.run.smithi117.stderr:Updating files: 39% (1384/3494) Updating files: 40% (1398/3494) Updating files: 41% (1433/3494) Updating files: 42% (1468/3494) Updating files: 43% (1503/3494) Updating files: 44% (1538/3494) Updating files: 45% (1573/3494) Updating files: 46% (1608/3494) Updating files: 47% (1643/3494) Updating files: 48% (1678/3494) Updating files: 49% (1713/3494) Updating files: 50% (1747/3494) Updating files: 51% (1782/3494) Updating files: 52% (1817/3494) Updating files: 53% (1852/3494) Updating files: 54% (1887/3494) Updating files: 55% (1922/3494) Updating files: 56% (1957/3494) Updating files: 57% (1992/3494) Updating files: 58% (2027/3494) Updating files: 59% (2062/3494) Updating files: 59% (2071/3494) Updating files: 60% (2097/3494) Updating files: 61% (2132/3494) Updating files: 62% (2167/3494) Updating files: 63% (2202/3494) Updating files: 64% (2237/3494) Updating files: 65% (2272/3494) Updating files: 66% (2307/3494) Updating files: 67% (2341/3494) Updating files: 68% (2376/3494) Updating files: 69% (2411/3494) Updating files: 69% (2438/3494) Updating files: 70% (2446/3494) Updating files: 71% (2481/3494) Updating files: 72% (2516/3494) Updating files: 73% (2551/3494) Updating files: 74% (2586/3494) Updating files: 75% (2621/3494) Updating files: 76% (2656/3494) Updating files: 77% (2691/3494) Updating files: 78% (2726/3494) Updating files: 79% (2761/3494) Updating files: 80% (2796/3494) Updating files: 81% (2831/3494) Updating files: 82% (2866/3494) Updating files: 82% (2887/3494) Updating files: 83% (2901/3494) Updating files: 84% (2935/3494) Updating files: 85% (2970/3494) Updating files: 86% (3005/3494) Updating files: 87% (3040/3494) Updating files: 88% (3075/3494) Updating files: 89% (3110/3494) Updating files: 90% (3145/3494) Updating files: 91% (3180/3494) Updating files: 92% (3215/3494) Updating files: 93% (3250/3494) Updating files: 94% (3285/3494) Updating files: 95% (3320/3494) Updating files: 96% (3355/3494) Updating files: 97% (3390/3494) Updating files: 98% (3425/3494) Updating files: 99% (3460/3494) Updating files: 100% (3494/3494) Updating files: 100% (3494/3494), done. 2024-08-18T22:04:31.014 INFO:teuthology.orchestra.run.smithi117.stdout:HEAD is now at 5649ca75 Merge branch 'intel-revert' into 'main' 2024-08-18T22:04:31.036 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-18T22:04:31.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-18T22:04:31.183 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc3-g7503b862ff5b/ 2024-08-18T22:04:31.184 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc3-g7503b862ff5b_6.11.0-rc3-g7503b862ff5b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc3-g7503b862ff5b/ --input-file=- 2024-08-18T22:04:31.186 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi117.front.sepia.ceph.com to complete... 2024-08-18T22:04:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:Updating files: 29% (1018/3494) Updating files: 30% (1049/3494) Updating files: 31% (1084/3494) Updating files: 32% (1119/3494) Updating files: 33% (1154/3494) Updating files: 34% (1188/3494) Updating files: 35% (1223/3494) Updating files: 36% (1258/3494) Updating files: 37% (1293/3494) Updating files: 38% (1328/3494) Updating files: 39% (1363/3494) Updating files: 40% (1398/3494) Updating files: 41% (1433/3494) Updating files: 42% (1468/3494) Updating files: 43% (1503/3494) Updating files: 44% (1538/3494) Updating files: 45% (1573/3494) Updating files: 46% (1608/3494) Updating files: 47% (1643/3494) Updating files: 48% (1678/3494) Updating files: 49% (1713/3494) Updating files: 50% (1747/3494) Updating files: 51% (1782/3494) Updating files: 52% (1817/3494) Updating files: 53% (1852/3494) Updating files: 54% (1887/3494) Updating files: 55% (1922/3494) Updating files: 56% (1957/3494) Updating files: 57% (1992/3494) Updating files: 58% (2027/3494) Updating files: 58% (2050/3494) Updating files: 59% (2062/3494) Updating files: 60% (2097/3494) Updating files: 61% (2132/3494) Updating files: 62% (2167/3494) Updating files: 63% (2202/3494) Updating files: 64% (2237/3494) Updating files: 65% (2272/3494) Updating files: 66% (2307/3494) Updating files: 67% (2341/3494) Updating files: 68% (2376/3494) Updating files: 69% (2411/3494) Updating files: 69% (2412/3494) Updating files: 70% (2446/3494) Updating files: 71% (2481/3494) Updating files: 72% (2516/3494) Updating files: 73% (2551/3494) Updating files: 74% (2586/3494) Updating files: 75% (2621/3494) Updating files: 76% (2656/3494) Updating files: 77% (2691/3494) Updating files: 78% (2726/3494) Updating files: 79% (2761/3494) Updating files: 80% (2796/3494) Updating files: 81% (2831/3494) Updating files: 82% (2866/3494) Updating files: 82% (2875/3494) Updating files: 83% (2901/3494) Updating files: 84% (2935/3494) Updating files: 85% (2970/3494) Updating files: 86% (3005/3494) Updating files: 87% (3040/3494) Updating files: 88% (3075/3494) Updating files: 89% (3110/3494) Updating files: 90% (3145/3494) Updating files: 91% (3180/3494) Updating files: 92% (3215/3494) Updating files: 93% (3250/3494) Updating files: 94% (3285/3494) Updating files: 95% (3320/3494) Updating files: 96% (3355/3494) Updating files: 97% (3390/3494) Updating files: 98% (3425/3494) Updating files: 99% (3460/3494) Updating files: 100% (3494/3494) Updating files: 100% (3494/3494), done. 2024-08-18T22:04:31.545 INFO:teuthology.orchestra.run.smithi005.stdout:HEAD is now at 5649ca75 Merge branch 'intel-revert' into 'main' 2024-08-18T22:04:31.569 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-18T22:04:31.569 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-18T22:04:31.711 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc3-g7503b862ff5b/ 2024-08-18T22:04:31.711 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc3-g7503b862ff5b_6.11.0-rc3-g7503b862ff5b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc3-g7503b862ff5b/ --input-file=- 2024-08-18T22:04:31.714 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi005.front.sepia.ceph.com to complete... 2024-08-18T22:04:32.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18 22:04:31 URL:https://1.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc3-g7503b862ff5b/linux-image-6.11.0-rc3-g7503b862ff5b_6.11.0-rc3-g7503b862ff5b-1_amd64.deb [45257264/45257264] -> "/tmp/linux-image.deb" [1] 2024-08-18T22:04:32.166 INFO:teuthology.orchestra.run.smithi117.stderr:FINISHED --2024-08-18 22:04:31-- 2024-08-18T22:04:32.166 INFO:teuthology.orchestra.run.smithi117.stderr:Total wall clock time: 1.0s 2024-08-18T22:04:32.166 INFO:teuthology.orchestra.run.smithi117.stderr:Downloaded: 1 files, 43M in 0.8s (51.7 MB/s) 2024-08-18T22:04:32.173 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-18T22:04:32.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo dpkg -i /tmp/linux-image.deb 2024-08-18T22:04:32.419 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-image-6.11.0-rc3-g7503b862ff5b. 2024-08-18T22:04:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18 22:04:34 URL:https://1.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc3-g7503b862ff5b/linux-image-6.11.0-rc3-g7503b862ff5b_6.11.0-rc3-g7503b862ff5b-1_amd64.deb [45257264/45257264] -> "/tmp/linux-image.deb" [1] 2024-08-18T22:04:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:FINISHED --2024-08-18 22:04:34-- 2024-08-18T22:04:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:Total wall clock time: 1.8s 2024-08-18T22:04:33.615 INFO:teuthology.orchestra.run.smithi005.stderr:Downloaded: 1 files, 43M in 1.6s (27.2 MB/s) 2024-08-18T22:04:33.619 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-18T22:04:33.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo dpkg -i /tmp/linux-image.deb 2024-08-18T22:04:33.872 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-image-6.11.0-rc3-g7503b862ff5b. 2024-08-18T22:04:34.391 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-08-18T22:04:34.395 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-08-18T22:04:34.520 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-6.11.0-rc3-g7503b862ff5b (6.11.0-rc3-g7503b862ff5b-1) ... 2024-08-18T22:04:35.827 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-08-18T22:04:35.832 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-08-18T22:04:35.956 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-image-6.11.0-rc3-g7503b862ff5b (6.11.0-rc3-g7503b862ff5b-1) ... 2024-08-18T22:04:38.636 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-6.11.0-rc3-g7503b862ff5b (6.11.0-rc3-g7503b862ff5b-1) ... 2024-08-18T22:04:38.733 INFO:teuthology.orchestra.run.smithi117.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:04:39.666 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-image-6.11.0-rc3-g7503b862ff5b (6.11.0-rc3-g7503b862ff5b-1) ... 2024-08-18T22:04:39.769 INFO:teuthology.orchestra.run.smithi005.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:02.313 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub' 2024-08-18T22:05:02.326 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-18T22:05:02.342 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-08-18T22:05:02.608 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:02.622 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub' 2024-08-18T22:05:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-18T22:05:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-08-18T22:05:02.929 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-18T22:05:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-18T22:05:02.981 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:02.996 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-18T22:05:03.001 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-18T22:05:03.156 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-18T22:05:03.156 INFO:teuthology.orchestra.run.smithi117.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-18T22:05:03.157 INFO:teuthology.orchestra.run.smithi117.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-18T22:05:03.205 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-08-18T22:05:03.287 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-18T22:05:03.298 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-18T22:05:03.357 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-18T22:05:03.363 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-18T22:05:03.392 DEBUG:teuthology.orchestra.run.smithi117:> dpkg-deb -c /tmp/linux-image.deb 2024-08-18T22:05:03.400 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./ 2024-08-18T22:05:03.400 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./boot/ 2024-08-18T22:05:03.400 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7098540 2024-08-16 09:30 ./boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:03.418 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 174115 2024-08-16 09:30 ./boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:03.418 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13288448 2024-08-16 09:30 ./boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:03.440 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/ 2024-08-18T22:05:03.440 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/kernel/ 2024-08-18T22:05:03.440 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/kernel/postinst.d/ 2024-08-18T22:05:03.440 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/kernel/postrm.d/ 2024-08-18T22:05:03.440 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/kernel/preinst.d/ 2024-08-18T22:05:03.440 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/kernel/prerm.d/ 2024-08-18T22:05:03.440 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/ 2024-08-18T22:05:03.440 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/ 2024-08-18T22:05:03.440 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/ 2024-08-18T22:05:03.440 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/ 2024-08-18T22:05:03.440 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/ 2024-08-18T22:05:03.441 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/ 2024-08-18T22:05:03.441 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ 2024-08-18T22:05:03.441 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 189801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/aesni-intel.ko 2024-08-18T22:05:03.441 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-18T22:05:03.441 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-18T22:05:03.441 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-18T22:05:03.441 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 97313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-18T22:05:03.441 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 109977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-18T22:05:03.441 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 155329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-18T22:05:03.443 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-18T22:05:03.443 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-18T22:05:03.443 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 87089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 50449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 54585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 48065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 62953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/ 2024-08-18T22:05:03.444 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/ 2024-08-18T22:05:03.445 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/ 2024-08-18T22:05:03.445 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-18T22:05:03.445 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpuid.ko 2024-08-18T22:05:03.445 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/msr.ko 2024-08-18T22:05:03.445 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/ 2024-08-18T22:05:03.445 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 505129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-18T22:05:03.445 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1060537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-18T22:05:03.445 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 2858897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-18T22:05:03.467 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ 2024-08-18T22:05:03.467 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 62105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/af_alg.ko 2024-08-18T22:05:03.467 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/algif_hash.ko 2024-08-18T22:05:03.467 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/algif_skcipher.ko 2024-08-18T22:05:03.467 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-18T22:05:03.467 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-18T22:05:03.469 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-18T22:05:03.469 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/asymmetric_keys/ 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/ 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-18T22:05:03.470 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 57793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cryptd.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_simd.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-18T22:05:03.471 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lrw.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-18T22:05:03.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 169513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-18T22:05:03.473 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xts.ko 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_extlog.ko 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/apei/ 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/apei/einj.ko 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-18T22:05:03.474 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 119449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 100449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 105097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-18T22:05:03.475 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 60657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_legacy.ko 2024-08-18T22:05:03.476 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-18T22:05:03.477 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_radisys.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rz1000.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 102265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-18T22:05:03.478 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 85377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-18T22:05:03.479 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/ 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 161153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/ 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/ 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 140993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/ 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1240881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 203649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/ 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 115049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 143329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/ 2024-08-18T22:05:03.480 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 133337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 119921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 312809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/ 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 117737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/ 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 70185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/applicom.ko 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/ 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-18T22:05:03.481 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 37345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 183673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 179409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 85457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 65417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/ 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 103497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-18T22:05:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/nvram.ko 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/ 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/xillybus/ 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/xillybus/xillybus_class.ko 2024-08-18T22:05:03.483 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 62193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/xillybus/xillybus_core.ko 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/clk/ 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/clk/clk-palmas.ko 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 57305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/clk/clk-si5351.ko 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/clk/clk-twl6040.ko 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/clk/clk-wm831x.ko 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/ 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ 2024-08-18T22:05:03.484 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ 2024-08-18T22:05:03.485 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 89313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-18T22:05:03.485 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 334409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-18T22:05:03.485 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/ 2024-08-18T22:05:03.485 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/ 2024-08-18T22:05:03.485 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/ 2024-08-18T22:05:03.485 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 832809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-18T22:05:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-18T22:05:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-18T22:05:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-18T22:05:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-08-18T22:05:03.538 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-08-18T22:05:03.538 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-18T22:05:03.538 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/ 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 90185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/ 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/ 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 147321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ 2024-08-18T22:05:03.539 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 90193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 50721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 64257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 68793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/ 2024-08-18T22:05:03.540 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-gpio.ko 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-max14577.ko 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-max77693.ko 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-max8997.ko 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-palmas.ko 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-rt8973a.ko 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-sm5502.ko 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/ 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/dmi-sysfs.ko 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/efi/ 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/efi/efi-pstore.ko 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/ 2024-08-18T22:05:03.541 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-adp5520.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-amd8111.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-arizona.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-da9052.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-da9055.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-dln2.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 81145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-f7188x.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-generic.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-kempld.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-lp3943.ko 2024-08-18T22:05:03.542 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-max7300.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-max730x.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-max732x.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 55993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-pca953x.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-pcf857x.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-rdc321x.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-sch.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-sch311x.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-tps65912.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-twl4030.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-twl6040.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-vx855.ko 2024-08-18T22:05:03.543 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-wm831x.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-wm8350.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-wm8994.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/ 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-a4tech.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-apple.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-belkin.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-cherry.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-chicony.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 74489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-cp2112.ko 2024-08-18T22:05:03.544 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-cypress.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ezkey.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-generic.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-18T22:05:03.545 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kensington.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 54329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 37745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lg-g15.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 67833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 122137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 98153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-magicmouse.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-microsoft.ko 2024-08-18T22:05:03.546 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-monterey.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ntrig.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 91193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-18T22:05:03.547 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-18T22:05:03.548 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 62337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 81657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 184849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-18T22:05:03.549 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 462825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid.ko 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/usbhid/ 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 153937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/usbhid/usbhid.ko 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/usbhid/usbkbd.ko 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/usbhid/usbmouse.ko 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 261113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/ 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 76433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 96049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 378297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ 2024-08-18T22:05:03.550 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 77209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 67089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 115193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 55217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-18T22:05:03.551 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 89105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 81657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 68945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 60273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 69089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 48137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/da9052-hwmon.ko 2024-08-18T22:05:03.552 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/da9055-hwmon.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 57673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 113257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc2103.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 79001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 109041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 50761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 65841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-18T22:05:03.553 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 56385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hih6130.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 150673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/jc42.ko 2024-08-18T22:05:03.554 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 57761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 37121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 86553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 55713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 73641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-18T22:05:03.555 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 131577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-18T22:05:03.556 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mc13783-adc.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 56817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 140649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 72753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 67857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 97857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 62001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-18T22:05:03.557 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 98953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-18T22:05:03.558 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 48785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 46553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-18T22:05:03.559 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 50289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 62809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 71185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 96657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 85969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 75209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 83497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 116865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 134505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-18T22:05:03.560 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/ 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/ 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/ 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-18T22:05:03.561 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 63521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 78569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 52937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-18T22:05:03.562 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 57129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-18T22:05:03.563 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/muxes/ 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 327969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1107089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 84401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-18T22:05:03.564 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 404785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 120089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 343737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 85049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/ 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/ 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 591033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/ 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 515521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/ 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 919817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 375665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-18T22:05:03.565 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/ocrdma/ 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 203217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/usnic/ 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 212297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 334617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 120761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 132449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 158249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ 2024-08-18T22:05:03.566 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 156881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/ 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/evbug.ko 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/ff-memless.ko 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/ 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/ 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-08-18T22:05:03.567 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/lkkbd.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/lm8323.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/lm8333.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/newtonkbd.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/qt1070.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/qt2160.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-08-18T22:05:03.568 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/stowaway.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/sunkbd.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/xtkbd.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/matrix-keymap.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/ 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 160545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 114785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/gpio_mouse.ko 2024-08-18T22:05:03.569 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 429945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/psmouse.ko 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/ 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 139449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/ 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/ct82c710.ko 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/parkbd.ko 2024-08-18T22:05:03.570 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/pcips2.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/ps2mult.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serport.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/ 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-88pm860x.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-adp5520.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 77337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-bd2802.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-da903x.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-da9052.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-gpio.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3533.ko 2024-08-18T22:05:03.571 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm355x.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3642.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp8788.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-max8997.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-mc13783.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-menf21bmc.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-pca9532.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-pca955x.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-pca963x.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-tca6507.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-wm831x-status.ko 2024-08-18T22:05:03.572 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-wm8350.ko 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/ 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/ 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 776689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-18T22:05:03.573 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 46345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 113969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bufio.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 58385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 197097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 137833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 67145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-era.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 50649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 61065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-mirror.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 96921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-18T22:05:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 86929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-region-hash.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 139233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-snapshot.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 234337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 64937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-zero.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/ 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 256817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 124697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-18T22:05:03.575 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 157393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 443369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/ 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/ 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 211265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 78073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 54881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 150969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 94393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 64025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/ 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/88pm800.ko 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/88pm805.ko 2024-08-18T22:05:03.576 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/88pm80x.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/arizona-i2c.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 146545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/arizona.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/bcm590xx.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/cros_ec_dev.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/dln2.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/janz-cmodio.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 54465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/kempld-core.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lm3533-core.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lp3943.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 60569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/max8907.ko 2024-08-18T22:05:03.577 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mc13xxx-core.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/menf21bmc.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/pcf50633-adc.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/pcf50633-gpio.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/pcf50633.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/retu-mfd.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 95609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/si476x-core.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 57465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/tps65010.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/tps6507x.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-18T22:05:03.578 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 51185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wm8994.ko 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 63985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ad525x_dpot.ko 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/ 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 57369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 47777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 58777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/c2port/ 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 47305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/c2port/core.ko 2024-08-18T22:05:03.579 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/ 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ds1682.ko 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/dummy-irq.ko 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/echo/ 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/echo/echo.ko 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/ 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/genwqe/ 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 191729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hmc6352.ko 2024-08-18T22:05:03.580 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 37849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ibmasm/ 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 92409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ics932s401.ko 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/ 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/ 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 153761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 69881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 381873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/phantom.ko 2024-08-18T22:05:03.581 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ti-st/ 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 90865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ti-st/st_drv.ko 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 56801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/ 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 232201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/ 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 623265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/ 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/ 2024-08-18T22:05:03.582 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 133153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/ 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 592737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/ 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 158529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 86225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-18T22:05:03.583 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 73945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 109665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/ 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 64809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/ 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 84425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/ 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 70889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/ 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 52689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-18T22:05:03.584 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/ 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 65937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 56137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 116097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/ 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/ 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 124705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 128609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 110481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/ 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 102009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 89113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-18T22:05:03.585 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/ 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 106585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 229401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1734209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 166905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/ 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 164649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 439625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/ 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/ 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 432361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/ 2024-08-18T22:05:03.586 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 257377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 444665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1309313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 207057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/ 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/ 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 269713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/ 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/ 2024-08-18T22:05:03.587 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 85601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-18T22:05:03.588 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 77593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-18T22:05:03.588 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 169265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-18T22:05:03.621 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 66057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-18T22:05:03.621 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 76353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-18T22:05:03.621 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-18T22:05:03.621 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/ 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 76153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 78921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 52393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ec_bhf.ko 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/ 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/ 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 356129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 61873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 63337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fujitsu/ 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 51649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ 2024-08-18T22:05:03.622 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 115689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/ 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 366441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/ 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 755369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/ 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 324657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/ 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1193609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/ 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 356561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/ 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 672753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-18T22:05:03.623 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/ 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 121585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 966153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 193769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/ 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/ 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 5961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 109345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/ 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 127049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-18T22:05:03.624 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 151041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/ 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 888841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 346921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1408241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 66089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 117577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-18T22:05:03.625 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/ 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 131593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 91681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 56769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/ 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 181529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/ 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 171641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/ 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 58521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-18T22:05:03.626 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 50401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/ 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 300993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 105849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 885417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/ 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 52473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/ 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 81777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 100825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 264377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-18T22:05:03.627 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/samsung/ 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 142433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/ 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1345833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/ 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 58089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/ 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 66729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 80225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/ 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 74521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 79593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 100929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-18T22:05:03.628 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 83585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/ 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 47185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 644777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/ 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 129081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 208169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 82025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 91633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/ 2024-08-18T22:05:03.629 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 60105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/ 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 110873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/ 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 98985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 102737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/ 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 61113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/ 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 70049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/fddi/ 2024-08-18T22:05:03.630 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/fddi/defxx.ko 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/fddi/skfp/ 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 275801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/fddi/skfp/skfp.ko 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 91777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/ 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 290673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/ 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 107833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 77577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/ 2024-08-18T22:05:03.631 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-gpio.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 62849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/ 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 72945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 61793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-18T22:05:03.632 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 52937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 58721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 113673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 108249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 118497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 76169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-18T22:05:03.633 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/plip/ 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 55369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/plip/plip.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/ 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 52169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-18T22:05:03.634 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 79249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/ 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 136713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 108401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/ 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 179313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/ 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 384169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-18T22:05:03.635 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/ 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 175833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/ 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/ 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 337625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 128345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/ 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 164121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 103649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/ 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/ 2024-08-18T22:05:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pci-stub.ko 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 55417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/ 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 177793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pcmcia.ko 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 76769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pcmcia_core.ko 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 133961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/phy/ 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/phy/broadcom/ 2024-08-18T22:05:03.637 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/phy/samsung/ 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/ 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/ 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 78273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/ 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/ 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 60873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_ec.ko 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-08-18T22:05:03.638 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/ 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 88009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 48345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 74025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 171233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 46497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 62097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 52657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-18T22:05:03.639 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/ibm_rtl.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/ 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 51849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-18T22:05:03.640 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/ 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/ 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/88pm860x_battery.ko 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/88pm860x_charger.ko 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 68913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/bq2415x_charger.ko 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 73153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/bq24190_charger.ko 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/bq24735-charger.ko 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/cros_charge-control.ko 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/da9030_battery.ko 2024-08-18T22:05:03.641 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/da9052-battery.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/ds2760_battery.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/ds2780_battery.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/ds2781_battery.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/ds2782_battery.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/gpio-charger.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/isp1704_charger.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/lp8727_charger.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/max14577_charger.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 37921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/max17042_battery.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/max8903_charger.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/max8925_power.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/pcf50633-charger.ko 2024-08-18T22:05:03.642 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/sbs-battery.ko 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/test_power.ko 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/tps65090-charger.ko 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/wm831x_backup.ko 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/wm831x_power.ko 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/wm8350_power.ko 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/ 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 98729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/ 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/ 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-18T22:05:03.643 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 90593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/ 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/ 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/ 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 89729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 47361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/ 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-88pm80x.ko 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-88pm860x.ko 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-da9052.ko 2024-08-18T22:05:03.644 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-da9055.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-da9063.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 82577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-18T22:05:03.645 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-lp8788.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 46993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t86.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max8907.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max8925.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max8997.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max8998.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-08-18T22:05:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-palmas.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 56865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf50633.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rc5t583.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-18T22:05:03.647 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-s35390a.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-tps6586x.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-tps65910.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-wm831x.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-wm8350.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 90529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 69681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 66025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 164657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-18T22:05:03.648 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/ 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 341073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 120889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/ 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 468273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 380817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic94xx/ 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 243993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/ 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 135785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/ 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 305137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-18T22:05:03.649 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/ 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1526193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/ 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 298033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/ 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 144529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 47665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/ 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 390849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/ 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 89033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-08-18T22:05:03.650 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 117553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 168289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 91769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/ 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 267681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 78433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/ 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 95545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 191113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fdomain.ko 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/ 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 366665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-18T22:05:03.651 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 251633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 65521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 57193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/imm.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 55233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 327857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 129873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/ 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 398169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 62777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/ 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 380649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 172825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 63089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-18T22:05:03.652 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/ 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 274833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/ 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 2737393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/ 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 88617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 388713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 105169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/ 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 833833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/ 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 158833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 96689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pcmcia/ 2024-08-18T22:05:03.653 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 102097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/ 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 444241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 152089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ppa.ko 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 67121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/ 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 2323625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 103785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/ 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 697401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-18T22:05:03.654 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qlogicfas408.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 331569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 219489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 349585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 121769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 92377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 54089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 138257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 57481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/ 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 205113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 55001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-18T22:05:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 48857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-18T22:05:03.656 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/xen-scsifront.ko 2024-08-18T22:05:03.656 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ 2024-08-18T22:05:03.656 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 172649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-18T22:05:03.656 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/ 2024-08-18T22:05:03.656 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/ 2024-08-18T22:05:03.656 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 915025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-18T22:05:03.656 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/ 2024-08-18T22:05:03.656 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 60489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-18T22:05:03.656 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 48273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-18T22:05:03.656 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-18T22:05:03.656 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1161433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-18T22:05:03.690 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 51977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-18T22:05:03.690 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 149769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-18T22:05:03.690 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/ 2024-08-18T22:05:03.690 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 90193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-18T22:05:03.690 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/ 2024-08-18T22:05:03.690 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/ 2024-08-18T22:05:03.690 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/ 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 46281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-18T22:05:03.691 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 99393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 69817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/moxa.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 61729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/mxser.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 134625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 37985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 79049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-18T22:05:03.692 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/ 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/ 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 65265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/altera_uart.ko 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 90689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/ 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 121225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/rp2.ko 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 68001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/sc16is7xx.ko 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/ 2024-08-18T22:05:03.693 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 689265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/ 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 55033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_dmem_genirq.ko 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_mf624.ko 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_netx.ko 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-08-18T22:05:03.694 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/ 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/c67x00/ 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 90393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/c67x00/c67x00.ko 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 187649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/ 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 101649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 63537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-18T22:05:03.695 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 56833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 107625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/common/ 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/common/ulpi.ko 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc2/ 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc3/ 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 576289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc3/dwc3.ko 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/ 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/ 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 70073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/u_ether.ko 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 61145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/u_serial.ko 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-08-18T22:05:03.696 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 132889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 62465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 142785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 70777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 37793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 70233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 99897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-08-18T22:05:03.697 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 71561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 85081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/ 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-08-18T22:05:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 78177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 200097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/libcomposite.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/ 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/bdc/ 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 182641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 66537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 85385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 69401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 90401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/net2272.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 90449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/net2280.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 94921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-08-18T22:05:03.699 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 80609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 87553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 94377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 191265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/ 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/bcma-hcd.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 108409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/isp116x-hcd.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 104529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 102353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811_cs.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/ssb-hcd.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/ 2024-08-18T22:05:03.700 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 47585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/cytherm.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ehset.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-18T22:05:03.701 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/lvstest.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/ 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 85409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 84361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbtest.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 52393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-18T22:05:03.702 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/mon/ 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 91441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/mon/usbmon.ko 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/musb/ 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 391169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/musb/musb_hdrc.ko 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/ 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-isp1301.ko 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-tahvo.ko 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-18T22:05:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 79761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 66953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 58417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/f81232.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 188721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 61593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 152401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 142929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 69289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-18T22:05:03.704 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 66441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 122417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/metro-usb.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 79769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 91617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 65273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mxuport.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 201249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-18T22:05:03.705 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 61849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 70593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-18T22:05:03.706 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 148713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usbserial.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/wishbone-serial.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 63353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-18T22:05:03.707 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 201009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/ 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 74433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 85489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 122513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/ 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/ 2024-08-18T22:05:03.708 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 196953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-18T22:05:03.709 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-18T22:05:03.709 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 134377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-18T22:05:03.709 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 93513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-18T22:05:03.709 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/ 2024-08-18T22:05:03.709 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 135233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-18T22:05:03.709 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-18T22:05:03.709 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 71545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-18T22:05:03.709 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 110201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-18T22:05:03.709 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/ 2024-08-18T22:05:03.709 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/ 2024-08-18T22:05:03.709 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/aat2870_bl.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/adp5520_bl.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/adp8860_bl.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 51817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/adp8870_bl.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/as3711_bl.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/bd6107.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/da903x_bl.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/da9052_bl.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/gpio_backlight.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/kb3886_bl.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-18T22:05:03.710 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lm3533_bl.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lm3639_bl.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lv5207lp.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/max8925_bl.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/pandora_bl.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/wm831x_bl.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/ 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 46905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/matrox_w1.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/w1-gpio.ko 2024-08-18T22:05:03.711 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/ 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 70465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 127577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-18T22:05:03.712 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/acquirewdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/advantechwdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/cpu5wdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/da9052_wdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/da9055_wdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/da9063_wdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/dw_wdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/eurotechwdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-18T22:05:03.713 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/kempld_wdt.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/mena21_wdt.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pc87413_wdt.ko 2024-08-18T22:05:03.714 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 47025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 37281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/retu_wdt.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sc1200wdt.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/twl4030_wdt.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-18T22:05:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wafer5823wdt.ko 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wm831x_wdt.ko 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wm8350_wdt.ko 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/ 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 55417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/ 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 214017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 46689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-18T22:05:03.716 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 85897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-scsiback.ko 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/ 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/ 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 195097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/adfs/ 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 78329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/adfs/adfs.ko 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/ 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 197801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/afs/ 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1259401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/afs/kafs.ko 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/autofs/ 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 127625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/autofs/autofs4.ko 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/ 2024-08-18T22:05:03.717 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 80521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/bfs/ 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 50561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/bfs/bfs.ko 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/ 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 4568017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/ 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 384321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1589889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/ 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 130537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/configfs/ 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 137305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/configfs/configfs.ko 2024-08-18T22:05:03.718 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/ 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/ 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 841457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/efs/ 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/efs/efs.ko 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/ 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1901529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/ 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/freevxfs/ 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/freevxfs/freevxfs.ko 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/ 2024-08-18T22:05:03.719 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/ 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1488201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/ 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 183465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/ 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 282073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hpfs/ 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 248561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hpfs/hpfs.ko 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/ 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 93465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/ 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 529713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/ 2024-08-18T22:05:03.720 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 360321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/ 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 113225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/ 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 627609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/ 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/ 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 111585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/ 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 74329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/ 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 147537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1291161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 82985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv2.ko 2024-08-18T22:05:03.721 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 152489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 2527305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/ 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/ 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 2119793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/ 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 734265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/ 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-18T22:05:03.722 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ascii.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-18T22:05:03.723 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 95753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-18T22:05:03.724 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 144401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 167265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 119641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-18T22:05:03.725 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-18T22:05:03.726 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-18T22:05:03.726 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-18T22:05:03.726 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-18T22:05:03.726 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-18T22:05:03.726 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ntfs3/ 2024-08-18T22:05:03.726 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 632121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ntfs3/ntfs3.ko 2024-08-18T22:05:03.728 DEBUG:teuthology.orchestra.run.smithi005:> dpkg-deb -c /tmp/linux-image.deb 2024-08-18T22:05:03.744 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./ 2024-08-18T22:05:03.744 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./boot/ 2024-08-18T22:05:03.745 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7098540 2024-08-16 09:30 ./boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:03.762 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ 2024-08-18T22:05:03.762 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ 2024-08-18T22:05:03.762 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 299721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-18T22:05:03.762 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ 2024-08-18T22:05:03.762 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 547185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-18T22:05:03.762 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ 2024-08-18T22:05:03.762 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 66449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-18T22:05:03.762 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 3255137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-18T22:05:03.762 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-18T22:05:03.762 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-18T22:05:03.762 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/omfs/ 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 67609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/omfs/omfs.ko 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/ 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 468105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 69417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/qnx4/ 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/qnx4/qnx4.ko 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/qnx6/ 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 58153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/qnx6/qnx6.ko 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/quota/ 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/quota/quota_tree.ko 2024-08-18T22:05:03.763 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/quota/quota_v1.ko 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/quota/quota_v2.ko 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/ 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 684361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/ 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/ 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/ 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 3333945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/ 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/ 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 162841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-18T22:05:03.764 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/ 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 116017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/ 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 309433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 198081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/ 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 5454353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/ 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/locking/ 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 97937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/locking/locktorture.ko 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/time/ 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/time/test_udelay.ko 2024-08-18T22:05:03.765 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 70433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 6785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc7.ko 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/ 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/interval_tree_test.ko 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/ 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/ 2024-08-18T22:05:03.766 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/memory-notifier-error-inject.ko 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/notifier-error-inject.ko 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/percpu_test.ko 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/pm-notifier-error-inject.ko 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/ 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 150993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/rbtree_test.ko 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/ 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/test-kstrtox.ko 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 4912665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/test_bpf.ko 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 61241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/test_firmware.ko 2024-08-18T22:05:03.767 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/test_module.ko 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/xz/ 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/xz/xz_dec_test.ko 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/ 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/ 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 66049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-18T22:05:03.768 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/ 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/ 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 106809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-18T22:05:03.769 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/ 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 234721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/ 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 880081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/ 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 88057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1026721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-18T22:05:03.770 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-18T22:05:03.771 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 69841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/ 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1229481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/ 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 154113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/ 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 239305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 69865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-18T22:05:03.772 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 74425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/ 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 498033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/hsr/ 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 137905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/hsr/hsr.ko 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 55385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 356329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-18T22:05:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 46121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 59777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 64705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 77769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 78473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ 2024-08-18T22:05:03.774 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ip_tables.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-18T22:05:03.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-18T22:05:03.776 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-18T22:05:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 47161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 102881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_gre.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 117641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 69873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/mip6.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 50129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-08-18T22:05:03.778 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-18T22:05:03.779 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 29009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 94425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 30057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/ 2024-08-18T22:05:03.780 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 106441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/ 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 155585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 66361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/lapb/ 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 62513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/lapb/lapb.ko 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/ 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-18T22:05:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 333569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc2.ko 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/ 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 388521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/ 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 144865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 124129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-18T22:05:03.782 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 124441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 126769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 126569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 137929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 72449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 133777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 139169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 138361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 136273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 139985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 532265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-18T22:05:03.783 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 54457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-18T22:05:03.784 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 485729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 37721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 134161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 140977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 79073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-18T22:05:03.785 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 119497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 46185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 115785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 51945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 808497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 52905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-18T22:05:03.786 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 37233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 66425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 50633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-18T22:05:03.787 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_osf.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_synproxy.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tproxy.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 104249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/x_tables.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-18T22:05:03.788 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 21945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-18T22:05:03.789 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-18T22:05:03.790 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 52921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-18T22:05:03.791 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-18T22:05:03.792 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 14977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 19857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpudp.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/ 2024-08-18T22:05:03.793 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 17313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/ 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/ 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 485897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/ 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 16001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/phonet/ 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 141489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/phonet/phonet.ko 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 68985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/phonet/pn_pep.ko 2024-08-18T22:05:03.794 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/ 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 314513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 202105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 85233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rxrpc/ 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1023993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rxrpc/rxrpc.ko 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/ 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 28809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 27681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 53569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 24049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-18T22:05:03.795 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 45761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 41553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_cgroup.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 37401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 49409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 79249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 15473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 48881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 9329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-18T22:05:03.796 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 8449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 43857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 39265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq_codel.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 42977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 60905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 26681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 81057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 36705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-18T22:05:03.797 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 11897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 44881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 32417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 13585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 31881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 60329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 40969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 33513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 38449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 35849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 34233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/ 2024-08-18T22:05:03.798 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1184529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-18T22:05:03.799 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-18T22:05:03.799 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/ 2024-08-18T22:05:03.799 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/ 2024-08-18T22:05:03.799 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 426929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-18T22:05:03.799 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 70241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-18T22:05:03.799 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1895353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-18T22:05:03.799 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/ 2024-08-18T22:05:03.799 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 914153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-18T22:05:03.805 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/ 2024-08-18T22:05:03.805 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 1122425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-18T22:05:03.805 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-18T22:05:03.805 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/ 2024-08-18T22:05:03.805 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 18265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/ 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 101273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 90353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 120297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 12977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 20481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/x25/ 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 165905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/x25/x25.ko 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/ 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 25441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_algo.ko 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 22921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 135865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_user.ko 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 649598 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-18T22:05:03.806 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 633763 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 7850 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 23959 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 10056 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 73936 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 147543 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 233297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 210 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 72756 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 879 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 261535 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 316586 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./usr/ 2024-08-18T22:05:03.807 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./usr/share/ 2024-08-18T22:05:03.808 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./usr/share/doc/ 2024-08-18T22:05:03.808 INFO:teuthology.orchestra.run.smithi117.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./usr/share/doc/linux-image-6.11.0-rc3-g7503b862ff5b/ 2024-08-18T22:05:03.808 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 174 2024-08-16 09:30 ./usr/share/doc/linux-image-6.11.0-rc3-g7503b862ff5b/changelog.Debian.gz 2024-08-18T22:05:03.808 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r-- root/root 691 2024-08-16 09:30 ./usr/share/doc/linux-image-6.11.0-rc3-g7503b862ff5b/copyright 2024-08-18T22:05:03.813 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:03.813 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:03.813 DEBUG:teuthology.orchestra.run.smithi117:> egrep '(submenu|menuentry.*6.11.0-rc3-g7503b862ff5b).*{' /boot/grub/grub.cfg 2024-08-18T22:05:03.859 INFO:teuthology.orchestra.run.smithi117.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-18T22:05:03.859 INFO:teuthology.orchestra.run.smithi117.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc3-g7503b862ff5b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc3-g7503b862ff5b-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-18T22:05:03.859 INFO:teuthology.orchestra.run.smithi117.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc3-g7503b862ff5b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc3-g7503b862ff5b-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-18T22:05:03.859 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-08-18T22:05:03.859 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:03.860 DEBUG:teuthology.orchestra.run.smithi117:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-08-18T22:05:03.873 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 174115 2024-08-16 09:30 ./boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:03.873 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13288448 2024-08-16 09:30 ./boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:03.873 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/ 2024-08-18T22:05:03.873 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/kernel/ 2024-08-18T22:05:03.873 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/kernel/postinst.d/ 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/kernel/postrm.d/ 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/kernel/preinst.d/ 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./etc/kernel/prerm.d/ 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/ 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/ 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/ 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/ 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/ 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/ 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 189801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/aesni-intel.ko 2024-08-18T22:05:03.874 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 109977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 155329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-18T22:05:03.875 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/ 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/ 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/ 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpuid.ko 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/msr.ko 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/ 2024-08-18T22:05:03.876 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 505129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1060537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2858897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/af_alg.ko 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/algif_hash.ko 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/algif_skcipher.ko 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/asymmetric_keys/ 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/ 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-18T22:05:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-18T22:05:03.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-18T22:05:03.879 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-18T22:05:03.879 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-18T22:05:03.879 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cryptd.ko 2024-08-18T22:05:03.879 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-18T22:05:03.879 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_simd.ko 2024-08-18T22:05:03.879 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-18T22:05:03.879 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-18T22:05:03.879 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-18T22:05:03.879 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-18T22:05:03.881 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lrw.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-18T22:05:03.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 169513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xts.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_extlog.ko 2024-08-18T22:05:03.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/apei/ 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/apei/einj.ko 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci.ko 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-18T22:05:03.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 105097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-18T22:05:03.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_legacy.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-18T22:05:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_radisys.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rz1000.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-18T22:05:03.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-18T22:05:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/ 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 161153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/ 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/ 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 140993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/ 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1240881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 203649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/ 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 115049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-18T22:05:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 143329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/ 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 133337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 312809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/ 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 117737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/ 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/applicom.ko 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/ 2024-08-18T22:05:03.890 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 183673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 179409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 65417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-18T22:05:03.891 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/ 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 103497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/nvram.ko 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/ 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-08-18T22:05:03.892 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/xillybus/ 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/xillybus/xillybus_class.ko 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/xillybus/xillybus_core.ko 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/clk/ 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/clk/clk-palmas.ko 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/clk/clk-si5351.ko 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/clk/clk-twl6040.ko 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/clk/clk-wm831x.ko 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/ 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ 2024-08-18T22:05:03.893 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 334409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/ 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/ 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/ 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 832809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/ 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/ 2024-08-18T22:05:03.894 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/ 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 147321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-18T22:05:03.895 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/ 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-gpio.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-max14577.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-max77693.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-max8997.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-palmas.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-rt8973a.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/extcon/extcon-sm5502.ko 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/ 2024-08-18T22:05:03.896 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/dmi-sysfs.ko 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/efi/ 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/efi/efi-pstore.ko 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/ 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-adp5520.ko 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-amd8111.ko 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-arizona.ko 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-da9052.ko 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-da9055.ko 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-dln2.ko 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-f7188x.ko 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-generic.ko 2024-08-18T22:05:03.897 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-kempld.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-lp3943.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-max7300.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-max730x.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-max732x.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-pca953x.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-pcf857x.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-rdc321x.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-sch.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-sch311x.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-tps65912.ko 2024-08-18T22:05:03.898 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-twl4030.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-twl6040.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-vx855.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-wm831x.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-wm8350.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-wm8994.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/ 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-a4tech.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-apple.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-belkin.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-cherry.ko 2024-08-18T22:05:03.899 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-chicony.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-cp2112.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-cypress.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ezkey.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-generic.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-18T22:05:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kensington.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lg-g15.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 122137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 98153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-magicmouse.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-microsoft.ko 2024-08-18T22:05:03.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-monterey.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ntrig.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 91193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-18T22:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-18T22:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 184849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-18T22:05:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 462825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/usbhid/ 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 153937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/usbhid/usbhid.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/usbhid/usbkbd.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/usbhid/usbmouse.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 261113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/ 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 76433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 96049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 378297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-18T22:05:03.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 115193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-18T22:05:03.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/da9052-hwmon.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/da9055-hwmon.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-18T22:05:03.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 113257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc2103.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 79001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 109041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 65841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-18T22:05:03.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hih6130.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 150673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/jc42.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-18T22:05:03.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 86553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 131577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-18T22:05:03.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-18T22:05:03.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mc13783-adc.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 140649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-18T22:05:03.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 98953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-18T22:05:03.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-18T22:05:03.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 96657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 75209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 116865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 134505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/ 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/ 2024-08-18T22:05:03.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/ 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-18T22:05:03.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-18T22:05:03.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-18T22:05:03.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/muxes/ 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 327969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1107089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 84401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 404785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 120089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 343737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-18T22:05:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/ 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/ 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 591033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/ 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 515521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/ 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 919817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 375665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/ocrdma/ 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 203217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/usnic/ 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 212297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ 2024-08-18T22:05:03.920 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 334617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 120761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 132449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 158249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 156881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/ 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/evbug.ko 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/ff-memless.ko 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/ 2024-08-18T22:05:03.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/ 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/lkkbd.ko 2024-08-18T22:05:03.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/lm8323.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/lm8333.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/newtonkbd.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/qt1070.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/qt2160.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/stowaway.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/sunkbd.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-08-18T22:05:03.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/xtkbd.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/matrix-keymap.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/ 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 160545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 114785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/gpio_mouse.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 429945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/psmouse.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-18T22:05:03.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/ 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 139449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/ 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/ct82c710.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/parkbd.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/pcips2.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/ps2mult.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serport.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-18T22:05:03.925 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/ 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-88pm860x.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-adp5520.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-bd2802.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-da903x.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-da9052.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-gpio.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3533.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm355x.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3642.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-18T22:05:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp8788.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-max8997.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-mc13783.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-menf21bmc.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-pca9532.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-pca955x.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-pca963x.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-tca6507.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-wm831x-status.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-wm8350.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-18T22:05:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/ 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/ 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 776689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 113969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bufio.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 197097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 137833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-18T22:05:03.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-era.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-mirror.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 96921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 86929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-region-hash.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 139233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-snapshot.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 234337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-18T22:05:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-zero.ko 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/ 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 256817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 124697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 157393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 443369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/ 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/ 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 211265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-18T22:05:03.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 150969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 94393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/ 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/88pm800.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/88pm805.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/88pm80x.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/arizona-i2c.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 146545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/arizona.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/bcm590xx.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/cros_ec_dev.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/dln2.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/janz-cmodio.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/kempld-core.ko 2024-08-18T22:05:03.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lm3533-core.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lp3943.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/max8907.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mc13xxx-core.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/menf21bmc.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/pcf50633-adc.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/pcf50633-gpio.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/pcf50633.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-08-18T22:05:03.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/retu-mfd.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 95609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/si476x-core.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/tps65010.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/tps6507x.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wm8994.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ad525x_dpot.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/ 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-18T22:05:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/c2port/ 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/c2port/core.ko 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/ 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ds1682.ko 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/dummy-irq.ko 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/echo/ 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/echo/echo.ko 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/ 2024-08-18T22:05:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/genwqe/ 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 191729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hmc6352.ko 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ibmasm/ 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 92409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ics932s401.ko 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/ 2024-08-18T22:05:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/ 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 153761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 381873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/phantom.ko 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ti-st/ 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/ti-st/st_drv.ko 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/ 2024-08-18T22:05:03.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 232201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-18T22:05:03.937 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ 2024-08-18T22:05:03.937 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/ 2024-08-18T22:05:03.937 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 623265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-18T22:05:03.944 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi117.front.sepia.ceph.com to complete... 2024-08-18T22:05:03.972 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/ 2024-08-18T22:05:03.972 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/ 2024-08-18T22:05:03.972 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 133153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/ 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 592737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/ 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 158529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 86225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-18T22:05:03.973 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 109665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/ 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/ 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 84425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/ 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/ 2024-08-18T22:05:03.974 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/ 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 65937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 116097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/ 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/ 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 124705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 128609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 110481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/ 2024-08-18T22:05:03.975 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/ 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 229401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1734209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 166905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/ 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 164649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 439625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/ 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/ 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 432361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-18T22:05:03.976 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/ 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 257377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 444665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1309313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 207057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/ 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/ 2024-08-18T22:05:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 269713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/ 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/ 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 169265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 76353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/ 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 76153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ec_bhf.ko 2024-08-18T22:05:03.978 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/ 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/ 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 356129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fujitsu/ 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 115689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/ 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 366441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/ 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 755369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/ 2024-08-18T22:05:03.979 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 324657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/ 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1193609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/ 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 356561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/ 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 672753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/ 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 121585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 966153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 193769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-18T22:05:03.980 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/ 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/ 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 5961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 109345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/ 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 127049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 151041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/ 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 888841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 346921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-08-18T22:05:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1408241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 117577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/ 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 131593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 91681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-18T22:05:03.982 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/ 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 181529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/ 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 171641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/ 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/ 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 300993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 105849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 885417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/ 2024-08-18T22:05:03.983 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/ 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 264377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/samsung/ 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 142433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/ 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1345833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/ 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-18T22:05:03.984 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/ 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/ 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 79593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/ 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-18T22:05:03.985 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 644777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/ 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 129081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 208169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 82025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 91633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/ 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/ 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 110873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/ 2024-08-18T22:05:03.986 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 98985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/ 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/ 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/fddi/ 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/fddi/defxx.ko 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/fddi/skfp/ 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 275801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/fddi/skfp/skfp.ko 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 91777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/ 2024-08-18T22:05:03.987 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 290673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/ 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 107833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/ 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-gpio.ko 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-18T22:05:03.988 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/ 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-18T22:05:03.989 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 113673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 118497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 76169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-18T22:05:03.990 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/plip/ 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/plip/plip.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/ 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-18T22:05:03.991 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 79249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/ 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 136713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/ 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 179313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/ 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 384169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-18T22:05:03.992 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/ 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 175833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/ 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/ 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 337625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 128345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/ 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 164121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 103649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-18T22:05:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/ 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/ 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pci-stub.ko 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/ 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 177793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pcmcia.ko 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 76769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pcmcia_core.ko 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-08-18T22:05:03.994 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 133961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/phy/ 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/phy/broadcom/ 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/phy/samsung/ 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/ 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/ 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/ 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/ 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_ec.ko 2024-08-18T22:05:03.995 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/ 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 88009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 171233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-18T22:05:03.996 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/ibm_rtl.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/ 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-18T22:05:03.997 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/ 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/ 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/88pm860x_battery.ko 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/88pm860x_charger.ko 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/bq2415x_charger.ko 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/bq24190_charger.ko 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/bq24735-charger.ko 2024-08-18T22:05:03.998 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/cros_charge-control.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/da9030_battery.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/da9052-battery.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/ds2760_battery.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/ds2780_battery.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/ds2781_battery.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/ds2782_battery.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/gpio-charger.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/isp1704_charger.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/lp8727_charger.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/max14577_charger.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/max17042_battery.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/max8903_charger.ko 2024-08-18T22:05:03.999 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/max8925_power.ko 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/pcf50633-charger.ko 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/sbs-battery.ko 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/test_power.ko 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/tps65090-charger.ko 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/wm831x_backup.ko 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/wm831x_power.ko 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/power/supply/wm8350_power.ko 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/ 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 98729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/ 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/ 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-18T22:05:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/ 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/ 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/ 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/ 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-88pm80x.ko 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-88pm860x.ko 2024-08-18T22:05:04.001 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-da9052.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-da9055.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-da9063.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 82577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-18T22:05:04.002 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-lp8788.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t86.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max8907.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max8925.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max8997.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max8998.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-08-18T22:05:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-palmas.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf50633.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rc5t583.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-s35390a.ko 2024-08-18T22:05:04.004 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-tps6586x.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-tps65910.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-wm831x.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-wm8350.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 164657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/ 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 341073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 120889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-18T22:05:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/ 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 468273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 380817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic94xx/ 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 243993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/ 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 135785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/ 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 305137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/ 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1526193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-18T22:05:04.006 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/ 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 298033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/ 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 144529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/ 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 390849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/ 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 117553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 168289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 91769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-18T22:05:04.007 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/ 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 267681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/ 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 95545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 191113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fdomain.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/ 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 366665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 251633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 65521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/imm.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 327857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 129873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-18T22:05:04.008 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/ 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 398169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/ 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 380649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 172825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/ 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 274833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/ 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2737393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/ 2024-08-18T22:05:04.009 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 88617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 388713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 105169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/ 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 833833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/ 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 158833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 96689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pcmcia/ 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-08-18T22:05:04.010 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-08-18T22:05:04.011 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/ 2024-08-18T22:05:04.011 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 444241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-18T22:05:04.011 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 152089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-18T22:05:04.011 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ppa.ko 2024-08-18T22:05:04.011 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-18T22:05:04.011 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/ 2024-08-18T22:05:04.011 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2323625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-18T22:05:04.011 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 103785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-18T22:05:04.011 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/ 2024-08-18T22:05:04.011 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 697401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-18T22:05:04.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qlogicfas408.ko 2024-08-18T22:05:04.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-18T22:05:04.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 331569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-18T22:05:04.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 219489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-18T22:05:04.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 349585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-18T22:05:04.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 121769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 92377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 138257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/ 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 205113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/xen-scsifront.ko 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ 2024-08-18T22:05:04.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 172649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/ 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/ 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 915025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/ 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1161433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 149769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/ 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-18T22:05:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/ 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/ 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/ 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-18T22:05:04.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 99393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/moxa.ko 2024-08-18T22:05:04.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/mxser.ko 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 134625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 79049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/ 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/ 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 65265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/altera_uart.ko 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/ 2024-08-18T22:05:04.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 121225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/rp2.ko 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/sc16is7xx.ko 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/ 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 689265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16209 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/ 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-18T22:05:04.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_dmem_genirq.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_mf624.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_netx.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/ 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/c67x00/ 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/c67x00/c67x00.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 187649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-08-18T22:05:04.049 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/ 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 107625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/common/ 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/common/ulpi.ko 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc2/ 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc3/ 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 576289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/dwc3/dwc3.ko 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/ 2024-08-18T22:05:04.050 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/ 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/u_ether.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/u_serial.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 132889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 142785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 99897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-08-18T22:05:04.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/ 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-08-18T22:05:04.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 200097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/libcomposite.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/ 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/bdc/ 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 182641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/net2272.ko 2024-08-18T22:05:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/net2280.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 94921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 94377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 191265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/ 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/bcma-hcd.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/isp116x-hcd.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 104529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811_cs.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/ssb-hcd.ko 2024-08-18T22:05:04.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/ 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/cytherm.ko 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ehset.ko 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-18T22:05:04.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/lvstest.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/ 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 84361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbtest.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52393 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-18T22:05:04.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/mon/ 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 91441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/mon/usbmon.ko 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/musb/ 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 391169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/musb/musb_hdrc.ko 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/ 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-isp1301.ko 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-tahvo.ko 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-18T22:05:04.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 79761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/f81232.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 188721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 152401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 142929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-18T22:05:04.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 122417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/metro-usb.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 79769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 91617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 65273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mxuport.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 201249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-18T22:05:04.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 148713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usbserial.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-18T22:05:04.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/wishbone-serial.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-18T22:05:04.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22673 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 201009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/ 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 122513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/ 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/ 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 196953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-18T22:05:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 134377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 93513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/ 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 135233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19065 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 110201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/ 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/ 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/aat2870_bl.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/adp5520_bl.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/adp8860_bl.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/adp8870_bl.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-18T22:05:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/as3711_bl.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/bd6107.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/da903x_bl.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/da9052_bl.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/gpio_backlight.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/kb3886_bl.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lm3533_bl.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lm3639_bl.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lv5207lp.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/max8925_bl.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/pandora_bl.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-18T22:05:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/wm831x_bl.ko 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/ 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/matrox_w1.ko 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/w1-gpio.ko 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/ 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-18T22:05:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 127577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/acquirewdt.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/advantechwdt.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/cpu5wdt.ko 2024-08-18T22:05:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/da9052_wdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/da9055_wdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/da9063_wdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/dw_wdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/eurotechwdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/kempld_wdt.ko 2024-08-18T22:05:04.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/mena21_wdt.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29833 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pc87413_wdt.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/retu_wdt.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sc1200wdt.ko 2024-08-18T22:05:04.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/twl4030_wdt.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wafer5823wdt.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wm831x_wdt.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wm8350_wdt.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/ 2024-08-18T22:05:04.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/ 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 214017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-scsiback.ko 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/ 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/ 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 195097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/adfs/ 2024-08-18T22:05:04.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/adfs/adfs.ko 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/ 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 197801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/afs/ 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1259401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/afs/kafs.ko 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/autofs/ 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 127625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/autofs/autofs4.ko 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/ 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/bfs/ 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/bfs/bfs.ko 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/ 2024-08-18T22:05:04.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 4568017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/ 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 384321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1589889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/ 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 130537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/configfs/ 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 137305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/configfs/configfs.ko 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/ 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/ 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 841457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/efs/ 2024-08-18T22:05:04.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/efs/efs.ko 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/ 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1901529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/ 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/freevxfs/ 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/freevxfs/freevxfs.ko 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/ 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/ 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1488201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/ 2024-08-18T22:05:04.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 183465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/ 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 282073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hpfs/ 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 248561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hpfs/hpfs.ko 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/ 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 93465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/ 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 529713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/ 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 360321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/ 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 113225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-18T22:05:04.074 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/ 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 627609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/ 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/ 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 111585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/ 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/ 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 147537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1291161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 82985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv2.ko 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 152489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2527305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/ 2024-08-18T22:05:04.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-18T22:05:04.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-18T22:05:04.076 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/ 2024-08-18T22:05:04.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2119793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-18T22:05:04.096 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/ 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 734265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/ 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-18T22:05:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ascii.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-18T22:05:04.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 95753 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 144401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 167265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-18T22:05:04.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ntfs3/ 2024-08-18T22:05:04.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 632121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ntfs3/ntfs3.ko 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 299721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 547185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 3255137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/omfs/ 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/omfs/omfs.ko 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/ 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 468105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-18T22:05:04.101 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/qnx4/ 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/qnx4/qnx4.ko 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/qnx6/ 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/qnx6/qnx6.ko 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/quota/ 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/quota/quota_tree.ko 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/quota/quota_v1.ko 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/quota/quota_v2.ko 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/ 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 684361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-18T22:05:04.102 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/ 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/ 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/ 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 3333945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/ 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/ 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 162841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/ 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 116017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/ 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 309433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-18T22:05:04.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 198081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/ 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 5454353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/ 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/locking/ 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/locking/locktorture.ko 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/time/ 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/time/test_udelay.ko 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc7.ko 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/ 2024-08-18T22:05:04.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/interval_tree_test.ko 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/ 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/ 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/memory-notifier-error-inject.ko 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/notifier-error-inject.ko 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/percpu_test.ko 2024-08-18T22:05:04.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/pm-notifier-error-inject.ko 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/ 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 150993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/rbtree_test.ko 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/ 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20889 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/test-kstrtox.ko 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 4912665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/test_bpf.ko 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/test_firmware.ko 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/test_module.ko 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/xz/ 2024-08-18T22:05:04.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/xz/xz_dec_test.ko 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/ 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/ 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/ 2024-08-18T22:05:04.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/ 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/ 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 234721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/ 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 880081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/ 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 88057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-18T22:05:04.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1026721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11225 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-18T22:05:04.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9649 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-18T22:05:04.110 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/ 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1229481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/ 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 154113 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/ 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 239305 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10345 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/ 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 498033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-18T22:05:04.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/hsr/ 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 137905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/hsr/hsr.ko 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 356329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-18T22:05:04.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ip_tables.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16433 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-08-18T22:05:04.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14257 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-18T22:05:04.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11745 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11817 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-18T22:05:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53385 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17193 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_gre.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 117641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69873 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/mip6.ko 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ 2024-08-18T22:05:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-18T22:05:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10609 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11177 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 94425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/ 2024-08-18T22:05:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/ 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 155585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43545 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/lapb/ 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/lapb/lapb.ko 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/ 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26465 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 333569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc2.ko 2024-08-18T22:05:04.119 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/ 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 388521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/ 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 144865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 124129 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 124441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 126769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 126569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-18T22:05:04.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 137929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-18T22:05:04.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-18T22:05:04.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 133777 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-18T22:05:04.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 139169 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-18T22:05:04.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 138361 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-18T22:05:04.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 136273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-18T22:05:04.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 139985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-18T22:05:04.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-18T22:05:04.121 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ 2024-08-18T22:05:04.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 532265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-18T22:05:04.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-18T22:05:04.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-18T22:05:04.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-18T22:05:04.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-18T22:05:04.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24617 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-18T22:05:04.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-18T22:05:04.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-18T22:05:04.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-18T22:05:04.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-18T22:05:04.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-18T22:05:04.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 485729 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37721 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 134161 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 140977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19017 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 79073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-18T22:05:04.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46185 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 115785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 808497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-18T22:05:04.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36041 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26121 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17321 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25377 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-18T22:05:04.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18009 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_osf.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15137 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25073 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_synproxy.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17713 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tproxy.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 104249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/x_tables.ko 2024-08-18T22:05:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16025 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-18T22:05:04.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22801 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12625 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16769 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11841 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15369 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16657 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12945 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-18T22:05:04.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12033 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10697 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14289 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12577 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9081 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10337 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9593 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-18T22:05:04.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9217 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11601 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11641 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-18T22:05:04.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11537 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13633 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43561 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10825 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10937 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10097 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9665 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpudp.ko 2024-08-18T22:05:04.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12521 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/ 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17313 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/ 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13961 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/ 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 485897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10953 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/ 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16001 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/phonet/ 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 141489 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/phonet/phonet.ko 2024-08-18T22:05:04.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68985 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/phonet/pn_pep.ko 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/ 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 314513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 202105 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rxrpc/ 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1023993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rxrpc/rxrpc.ko 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/ 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39089 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28809 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45497 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38793 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-18T22:05:04.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24049 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43505 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45761 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32281 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41553 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_cgroup.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37401 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39689 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49409 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 79249 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8785 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15473 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-18T22:05:04.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13457 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25913 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25201 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43569 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43857 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq_codel.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26681 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81057 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33737 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-18T22:05:04.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36705 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11897 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33145 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32417 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13585 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31881 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60329 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40969 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33513 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38449 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35849 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/ 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1184529 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-18T22:05:04.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23993 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/ 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/ 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 426929 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70241 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1895353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/ 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 914153 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/ 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1122425 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12233 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/ 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18265 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/ 2024-08-18T22:05:04.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101273 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90353 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 120297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12977 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20481 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/x25/ 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 165905 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/x25/x25.ko 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/ 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25441 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_algo.ko 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22921 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 135865 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_user.ko 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 649598 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 633763 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-18T22:05:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7850 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23959 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10056 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73936 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 147543 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 233297 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 210 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72756 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 879 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 261535 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 316586 2024-08-16 09:30 ./lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./usr/ 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./usr/share/ 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./usr/share/doc/ 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2024-08-16 09:30 ./usr/share/doc/linux-image-6.11.0-rc3-g7503b862ff5b/ 2024-08-18T22:05:04.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 174 2024-08-16 09:30 ./usr/share/doc/linux-image-6.11.0-rc3-g7503b862ff5b/changelog.Debian.gz 2024-08-18T22:05:04.156 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 691 2024-08-16 09:30 ./usr/share/doc/linux-image-6.11.0-rc3-g7503b862ff5b/copyright 2024-08-18T22:05:04.160 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:04.160 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:04.160 DEBUG:teuthology.orchestra.run.smithi005:> egrep '(submenu|menuentry.*6.11.0-rc3-g7503b862ff5b).*{' /boot/grub/grub.cfg 2024-08-18T22:05:04.187 INFO:teuthology.orchestra.run.smithi005.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-18T22:05:04.188 INFO:teuthology.orchestra.run.smithi005.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc3-g7503b862ff5b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc3-g7503b862ff5b-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-18T22:05:04.188 INFO:teuthology.orchestra.run.smithi005.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc3-g7503b862ff5b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc3-g7503b862ff5b-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-08-18T22:05:04.188 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-08-18T22:05:04.188 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:04.188 DEBUG:teuthology.orchestra.run.smithi005:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-08-18T22:05:04.231 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi005.front.sepia.ceph.com to complete... 2024-08-18T22:05:04.399 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub' 2024-08-18T22:05:04.400 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-18T22:05:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-08-18T22:05:04.602 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:04.608 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:04.638 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub' 2024-08-18T22:05:04.638 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-18T22:05:04.666 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-08-18T22:05:04.866 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-18T22:05:04.871 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-18T22:05:04.875 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc3-g7503b862ff5b 2024-08-18T22:05:04.914 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-18T22:05:04.920 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-18T22:05:05.058 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-18T22:05:05.058 INFO:teuthology.orchestra.run.smithi117.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-18T22:05:05.058 INFO:teuthology.orchestra.run.smithi117.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-18T22:05:05.072 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-08-18T22:05:05.106 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-18T22:05:05.112 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-18T22:05:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-18T22:05:05.162 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-18T22:05:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-18T22:05:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-18T22:05:05.276 INFO:teuthology.orchestra.run.smithi005.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-18T22:05:05.291 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-08-18T22:05:36.170 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-18T22:05:36.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-18T22:05:36.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:05:36.396 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-18T22:05:36.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T22:05:36.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:05:54.526 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-08-18T22:05:54.782 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-08-18T22:06:03.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-18T22:06:03.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:06:03.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T22:06:03.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:06:06.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-08-18T22:06:18.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-18T22:06:18.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:06:37.023 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-08-18T22:06:52.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-18T22:06:52.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:06:52.468 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-08-18T22:06:53.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-18T22:06:53.259 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-18T22:06:53.260 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-08-18T22:06:53.309 INFO:teuthology.orchestra.run.smithi117.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-18T22:06:53.309 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-18T22:06:53.309 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-18T22:06:53.310 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-18T22:06:54.310 DEBUG:teuthology.parallel:result is None 2024-08-18T22:07:03.786 DEBUG:teuthology.orchestra.remote:timed out 2024-08-18T22:07:15.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T22:07:15.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:07:16.115 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-08-18T22:07:16.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T22:07:16.805 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-18T22:07:16.805 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-08-18T22:07:16.855 INFO:teuthology.orchestra.run.smithi005.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-18T22:07:16.856 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-18T22:07:16.856 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-18T22:07:16.856 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-18T22:07:17.858 DEBUG:teuthology.parallel:result is None 2024-08-18T22:07:17.859 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-18T22:07:17.866 INFO:teuthology.task.internal:Creating test directory... 2024-08-18T22:07:17.866 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T22:07:17.870 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T22:07:17.879 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-18T22:07:17.885 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-18T22:07:17.891 INFO:teuthology.task.internal:Creating archive directory... 2024-08-18T22:07:17.891 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T22:07:17.923 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T22:07:17.946 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-18T22:07:17.952 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-18T22:07:17.952 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T22:07:17.987 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T22:07:18.066 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T22:07:18.089 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T22:07:18.112 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T22:07:18.147 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T22:07:18.149 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-18T22:07:18.156 INFO:teuthology.task.internal:Configuring sudo... 2024-08-18T22:07:18.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T22:07:18.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T22:07:18.180 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-18T22:07:18.190 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-18T22:07:18.190 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T22:07:18.223 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T22:07:18.232 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T22:07:18.283 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T22:07:18.339 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:07:18.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T22:07:18.415 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T22:07:18.424 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T22:07:18.473 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:07:18.474 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T22:07:18.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-08-18T22:07:18.554 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-08-18T22:07:18.678 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-18T22:07:18.849 INFO:teuthology.task.internal:Starting timer... 2024-08-18T22:07:18.849 INFO:teuthology.run_tasks:Running task pcp... 2024-08-18T22:07:18.940 INFO:teuthology.run_tasks:Running task selinux... 2024-08-18T22:07:18.978 DEBUG:teuthology.task.selinux:Excluding smithi005: OS 'ubuntu' does not support SELinux 2024-08-18T22:07:18.978 DEBUG:teuthology.task.selinux:Excluding smithi117: OS 'ubuntu' does not support SELinux 2024-08-18T22:07:18.978 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-18T22:07:18.978 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-18T22:07:18.978 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-18T22:07:18.978 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-18T22:07:19.013 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-18T22:07:19.017 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-18T22:07:19.128 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-18T22:07:19.141 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-18T22:07:19.141 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-18T22:15:31.526 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-08-18T22:15:31.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T22:15:31.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:15:31.610 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-08-18T22:15:31.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-18T22:15:31.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-18T22:15:31.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:15:31.838 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-08-18T22:15:31.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-08-18T22:15:31.973 INFO:teuthology.run_tasks:Running task clock... 2024-08-18T22:15:31.984 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-18T22:15:31.984 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-18T22:15:31.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T22:15:31.987 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-18T22:15:31.988 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T22:15:32.024 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-18T22:15:32.024 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: Command line: ntpd -gq 2024-08-18T22:15:32.024 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: ---------------------------------------------------- 2024-08-18T22:15:32.024 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: ntp-4 is maintained by Network Time Foundation, 2024-08-18T22:15:32.025 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-18T22:15:32.025 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: corporation. Support and training for ntp-4 are 2024-08-18T22:15:32.025 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: available at https://www.nwtime.org/support 2024-08-18T22:15:32.025 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: ---------------------------------------------------- 2024-08-18T22:15:32.025 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: proto: precision = 0.045 usec (-24) 2024-08-18T22:15:32.025 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: basedate set to 2022-02-04 2024-08-18T22:15:32.025 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: gps base set to 2022-02-06 (week 2196) 2024-08-18T22:15:32.026 INFO:teuthology.orchestra.run.smithi005.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-18T22:15:32.026 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-18T22:15:32.026 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: restrict ::: KOD does nothing without LIMITED. 2024-08-18T22:15:32.026 INFO:teuthology.orchestra.run.smithi005.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-18T22:15:32.027 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: Listen and drop on 0 v6wildcard [::]:123 2024-08-18T22:15:32.027 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-18T22:15:32.028 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: Listen normally on 2 lo 127.0.0.1:123 2024-08-18T22:15:32.028 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: Listen normally on 3 ens1f0 172.21.15.5:123 2024-08-18T22:15:32.028 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: Listen normally on 4 lo [::1]:123 2024-08-18T22:15:32.028 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1442%4]:123 2024-08-18T22:15:32.028 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:32 ntpd[18271]: Listening on routing socket on fd #22 for interface updates 2024-08-18T22:15:32.052 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-18T22:15:32.053 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: Command line: ntpd -gq 2024-08-18T22:15:32.053 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: ---------------------------------------------------- 2024-08-18T22:15:32.053 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: ntp-4 is maintained by Network Time Foundation, 2024-08-18T22:15:32.053 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-18T22:15:32.053 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: corporation. Support and training for ntp-4 are 2024-08-18T22:15:32.053 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: available at https://www.nwtime.org/support 2024-08-18T22:15:32.053 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: ---------------------------------------------------- 2024-08-18T22:15:32.054 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: proto: precision = 0.040 usec (-24) 2024-08-18T22:15:32.054 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: basedate set to 2022-02-04 2024-08-18T22:15:32.054 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: gps base set to 2022-02-06 (week 2196) 2024-08-18T22:15:32.054 INFO:teuthology.orchestra.run.smithi117.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-18T22:15:32.054 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-18T22:15:32.055 INFO:teuthology.orchestra.run.smithi117.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-18T22:15:32.055 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: restrict ::: KOD does nothing without LIMITED. 2024-08-18T22:15:32.055 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: Listen and drop on 0 v6wildcard [::]:123 2024-08-18T22:15:32.055 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-18T22:15:32.056 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: Listen normally on 2 lo 127.0.0.1:123 2024-08-18T22:15:32.056 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: Listen normally on 3 enp3s0f1 172.21.15.117:123 2024-08-18T22:15:32.056 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: Listen normally on 4 lo [::1]:123 2024-08-18T22:15:32.056 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4463%5]:123 2024-08-18T22:15:32.056 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:32 ntpd[18372]: Listening on routing socket on fd #22 for interface updates 2024-08-18T22:15:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:33.025 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:33.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:33.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:33 ntpd[18271]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:33.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:33.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:33.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:33.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:33.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:33.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:33.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:33.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:33 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:35.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:35.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:35.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:35.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:35 ntpd[18271]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:35.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:35.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:35.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:35.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:35.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:35.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:35.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:35.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:35.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:35.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:35.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:35.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:35 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:36.053 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:36 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:36.053 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:36 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:36.053 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:36 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:36.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:36 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:36.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:36 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:36.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:36 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:37 ntpd[18271]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:37.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:37.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:37.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:37.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:37.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:37.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:37.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:37.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:37.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:37.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:37.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:37.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:37 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:38.053 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:38 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:38.053 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:38 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:38.053 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:38 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:38.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:38 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:38.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:38 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:38.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:38 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:39.026 INFO:teuthology.orchestra.run.smithi005.stdout:18 Aug 22:15:39 ntpd[18271]: ntpd: time slew -0.001197 s 2024-08-18T22:15:39.026 INFO:teuthology.orchestra.run.smithi005.stdout:ntpd: time slew -0.001197s 2024-08-18T22:15:39.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-18T22:15:39.027 INFO:teuthology.orchestra.run.smithi005.stderr:18 Aug 22:15:39 ntpd[18271]: can't open /var/log/ntpstats/loopstats.20240818: Permission denied 2024-08-18T22:15:39.053 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:39 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:39.053 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:39 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:39.053 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:39 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:39.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:39 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:39.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:39 ntpd[18372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-18T22:15:39.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:39 ntpd[18372]: can't open /var/log/ntpstats/rawstats.20240818: Permission denied 2024-08-18T22:15:39.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:39 ntpd[18372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-18T22:15:39.054 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:39 ntpd[18372]: can't open /var/log/ntpstats/peerstats.20240818: Permission denied 2024-08-18T22:15:39.054 INFO:teuthology.orchestra.run.smithi117.stdout:18 Aug 22:15:39 ntpd[18372]: ntpd: time slew -0.000879 s 2024-08-18T22:15:39.054 INFO:teuthology.orchestra.run.smithi117.stdout:ntpd: time slew -0.000879s 2024-08-18T22:15:39.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:39 ntpd[18372]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-18T22:15:39.055 INFO:teuthology.orchestra.run.smithi117.stderr:18 Aug 22:15:39 ntpd[18372]: can't open /var/log/ntpstats/loopstats.20240818: Permission denied 2024-08-18T22:15:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: remote refid st t when poll reach delay offset jitter 2024-08-18T22:15:39.120 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================== 2024-08-18T22:15:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T22:15:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T22:15:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T22:15:39.120 INFO:teuthology.orchestra.run.smithi005.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T22:15:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2024-08-18T22:15:39.150 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2024-08-18T22:15:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T22:15:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T22:15:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T22:15:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-18T22:15:39.152 INFO:teuthology.run_tasks:Running task install... 2024-08-18T22:15:39.160 DEBUG:teuthology.task.install:project ceph 2024-08-18T22:15:39.160 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}} 2024-08-18T22:15:39.160 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'} 2024-08-18T22:15:39.160 INFO:teuthology.task.install:Using flavor: default 2024-08-18T22:15:39.166 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-18T22:15:39.166 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-18T22:15:39.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-key list | grep Ceph 2024-08-18T22:15:39.167 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-key list | grep Ceph 2024-08-18T22:15:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-18T22:15:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-18T22:15:39.326 INFO:teuthology.orchestra.run.smithi005.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-18T22:15:39.326 INFO:teuthology.orchestra.run.smithi005.stdout:uid [ unknown] Ceph.com (release key) 2024-08-18T22:15:39.328 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-18T22:15:39.328 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-08-18T22:15:39.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:15:39.348 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-18T22:15:39.348 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph.com (release key) 2024-08-18T22:15:39.349 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-18T22:15:39.349 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-08-18T22:15:39.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:15:39.470 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default/ 2024-08-18T22:15:39.471 INFO:teuthology.task.install.deb:Package version is 19.1.0-1382-gde09dd01-1jammy 2024-08-18T22:15:39.489 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default/ 2024-08-18T22:15:39.489 INFO:teuthology.task.install.deb:Package version is 19.1.0-1382-gde09dd01-1jammy 2024-08-18T22:15:39.582 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:15:39.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-18T22:15:39.595 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:15:39.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-18T22:15:39.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get update 2024-08-18T22:15:39.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-08-18T22:15:39.844 INFO:teuthology.orchestra.run.smithi005.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy InRelease 2024-08-18T22:15:39.848 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy InRelease 2024-08-18T22:15:39.865 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-08-18T22:15:39.869 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-08-18T22:15:39.887 INFO:teuthology.orchestra.run.smithi005.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-18T22:15:39.891 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-18T22:15:39.909 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-08-18T22:15:39.912 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-08-18T22:15:39.931 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-18T22:15:39.933 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-18T22:15:39.952 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,424 B] 2024-08-18T22:15:39.954 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,424 B] 2024-08-18T22:15:39.992 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-18T22:15:39.994 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:7 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-18T22:15:39.994 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-18T22:15:39.998 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-18T22:15:40.074 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-18T22:15:40.079 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-18T22:15:40.525 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 28.3 kB in 1s (41.4 kB/s) 2024-08-18T22:15:40.547 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 28.3 kB in 1s (40.0 kB/s) 2024-08-18T22:15:41.556 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-08-18T22:15:41.570 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.0-1382-gde09dd01-1jammy cephadm=19.1.0-1382-gde09dd01-1jammy ceph-mds=19.1.0-1382-gde09dd01-1jammy ceph-mgr=19.1.0-1382-gde09dd01-1jammy ceph-common=19.1.0-1382-gde09dd01-1jammy ceph-fuse=19.1.0-1382-gde09dd01-1jammy ceph-test=19.1.0-1382-gde09dd01-1jammy ceph-volume=19.1.0-1382-gde09dd01-1jammy radosgw=19.1.0-1382-gde09dd01-1jammy python3-rados=19.1.0-1382-gde09dd01-1jammy python3-rgw=19.1.0-1382-gde09dd01-1jammy python3-cephfs=19.1.0-1382-gde09dd01-1jammy python3-rbd=19.1.0-1382-gde09dd01-1jammy libcephfs2=19.1.0-1382-gde09dd01-1jammy libcephfs-dev=19.1.0-1382-gde09dd01-1jammy librados2=19.1.0-1382-gde09dd01-1jammy librbd1=19.1.0-1382-gde09dd01-1jammy rbd-fuse=19.1.0-1382-gde09dd01-1jammy python3-cephfs=19.1.0-1382-gde09dd01-1jammy cephfs-shell=19.1.0-1382-gde09dd01-1jammy cephfs-top=19.1.0-1382-gde09dd01-1jammy cephfs-mirror=19.1.0-1382-gde09dd01-1jammy 2024-08-18T22:15:41.624 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-08-18T22:15:41.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.0-1382-gde09dd01-1jammy cephadm=19.1.0-1382-gde09dd01-1jammy ceph-mds=19.1.0-1382-gde09dd01-1jammy ceph-mgr=19.1.0-1382-gde09dd01-1jammy ceph-common=19.1.0-1382-gde09dd01-1jammy ceph-fuse=19.1.0-1382-gde09dd01-1jammy ceph-test=19.1.0-1382-gde09dd01-1jammy ceph-volume=19.1.0-1382-gde09dd01-1jammy radosgw=19.1.0-1382-gde09dd01-1jammy python3-rados=19.1.0-1382-gde09dd01-1jammy python3-rgw=19.1.0-1382-gde09dd01-1jammy python3-cephfs=19.1.0-1382-gde09dd01-1jammy python3-rbd=19.1.0-1382-gde09dd01-1jammy libcephfs2=19.1.0-1382-gde09dd01-1jammy libcephfs-dev=19.1.0-1382-gde09dd01-1jammy librados2=19.1.0-1382-gde09dd01-1jammy librbd1=19.1.0-1382-gde09dd01-1jammy rbd-fuse=19.1.0-1382-gde09dd01-1jammy python3-cephfs=19.1.0-1382-gde09dd01-1jammy cephfs-shell=19.1.0-1382-gde09dd01-1jammy cephfs-top=19.1.0-1382-gde09dd01-1jammy cephfs-mirror=19.1.0-1382-gde09dd01-1jammy 2024-08-18T22:15:41.646 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-08-18T22:15:41.718 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-08-18T22:15:41.828 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-08-18T22:15:41.829 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-08-18T22:15:41.904 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree... 2024-08-18T22:15:41.905 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information... 2024-08-18T22:15:42.017 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-08-18T22:15:42.017 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-18T22:15:42.017 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-18T22:15:42.017 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-18T22:15:42.018 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-18T22:15:42.018 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-18T22:15:42.018 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-18T22:15:42.019 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-08-18T22:15:42.019 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-18T22:15:42.019 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-18T22:15:42.019 INFO:teuthology.orchestra.run.smithi117.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-18T22:15:42.020 INFO:teuthology.orchestra.run.smithi117.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-18T22:15:42.020 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-18T22:15:42.021 INFO:teuthology.orchestra.run.smithi117.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-18T22:15:42.021 INFO:teuthology.orchestra.run.smithi117.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-18T22:15:42.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-18T22:15:42.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-18T22:15:42.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-08-18T22:15:42.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-08-18T22:15:42.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-08-18T22:15:42.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-08-18T22:15:42.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-08-18T22:15:42.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-08-18T22:15:42.021 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-08-18T22:15:42.022 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-08-18T22:15:42.022 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-08-18T22:15:42.022 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-08-18T22:15:42.022 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-08-18T22:15:42.022 INFO:teuthology.orchestra.run.smithi117.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-08-18T22:15:42.022 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-08-18T22:15:42.022 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-08-18T22:15:42.022 INFO:teuthology.orchestra.run.smithi117.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-08-18T22:15:42.022 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-08-18T22:15:42.022 INFO:teuthology.orchestra.run.smithi117.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-18T22:15:42.023 INFO:teuthology.orchestra.run.smithi117.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-18T22:15:42.023 INFO:teuthology.orchestra.run.smithi117.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-18T22:15:42.023 INFO:teuthology.orchestra.run.smithi117.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-18T22:15:42.023 INFO:teuthology.orchestra.run.smithi117.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-18T22:15:42.023 INFO:teuthology.orchestra.run.smithi117.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-18T22:15:42.023 INFO:teuthology.orchestra.run.smithi117.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-18T22:15:42.023 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2024-08-18T22:15:42.023 INFO:teuthology.orchestra.run.smithi117.stdout: btrfs-tools 2024-08-18T22:15:42.099 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages were automatically installed and are no longer required: 2024-08-18T22:15:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-18T22:15:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-18T22:15:42.099 INFO:teuthology.orchestra.run.smithi005.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-18T22:15:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-18T22:15:42.100 INFO:teuthology.orchestra.run.smithi005.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-18T22:15:42.100 INFO:teuthology.orchestra.run.smithi005.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-18T22:15:42.100 INFO:teuthology.orchestra.run.smithi005.stdout:The following additional packages will be installed: 2024-08-18T22:15:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-18T22:15:42.101 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-18T22:15:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-18T22:15:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-18T22:15:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-18T22:15:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-18T22:15:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-18T22:15:42.102 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-08-18T22:15:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-08-18T22:15:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-08-18T22:15:42.104 INFO:teuthology.orchestra.run.smithi005.stdout:Suggested packages: 2024-08-18T22:15:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-18T22:15:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-18T22:15:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-18T22:15:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-18T22:15:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-18T22:15:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-18T22:15:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-18T22:15:42.105 INFO:teuthology.orchestra.run.smithi005.stdout:Recommended packages: 2024-08-18T22:15:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: btrfs-tools 2024-08-18T22:15:42.174 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-08-18T22:15:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-18T22:15:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-18T22:15:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-18T22:15:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-08-18T22:15:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-18T22:15:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-08-18T22:15:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-08-18T22:15:42.178 INFO:teuthology.orchestra.run.smithi117.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-08-18T22:15:42.178 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-18T22:15:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-18T22:15:42.180 INFO:teuthology.orchestra.run.smithi117.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-18T22:15:42.180 INFO:teuthology.orchestra.run.smithi117.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-18T22:15:42.180 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-18T22:15:42.180 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-08-18T22:15:42.180 INFO:teuthology.orchestra.run.smithi117.stdout: socat unzip xmlstarlet zip 2024-08-18T22:15:42.263 INFO:teuthology.orchestra.run.smithi005.stdout:The following NEW packages will be installed: 2024-08-18T22:15:42.263 INFO:teuthology.orchestra.run.smithi005.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-18T22:15:42.263 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-18T22:15:42.263 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-18T22:15:42.263 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-08-18T22:15:42.263 INFO:teuthology.orchestra.run.smithi005.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-18T22:15:42.263 INFO:teuthology.orchestra.run.smithi005.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-08-18T22:15:42.263 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-18T22:15:42.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-18T22:15:42.266 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-08-18T22:15:42.266 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-08-18T22:15:42.266 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-18T22:15:42.266 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-18T22:15:42.266 INFO:teuthology.orchestra.run.smithi005.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-18T22:15:42.266 INFO:teuthology.orchestra.run.smithi005.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-18T22:15:42.266 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-18T22:15:42.266 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-08-18T22:15:42.266 INFO:teuthology.orchestra.run.smithi005.stdout: socat unzip xmlstarlet zip 2024-08-18T22:15:42.324 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 124 newly installed, 0 to remove and 323 not upgraded. 2024-08-18T22:15:42.325 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 181 MB of archives. 2024-08-18T22:15:42.325 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 829 MB of additional disk space will be used. 2024-08-18T22:15:42.325 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.0-1382-gde09dd01-1jammy [3,587 kB] 2024-08-18T22:15:42.371 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-08-18T22:15:42.415 INFO:teuthology.orchestra.run.smithi005.stdout:0 upgraded, 124 newly installed, 0 to remove and 323 not upgraded. 2024-08-18T22:15:42.415 INFO:teuthology.orchestra.run.smithi005.stdout:Need to get 181 MB of archives. 2024-08-18T22:15:42.415 INFO:teuthology.orchestra.run.smithi005.stdout:After this operation, 829 MB of additional disk space will be used. 2024-08-18T22:15:42.415 INFO:teuthology.orchestra.run.smithi005.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.0-1382-gde09dd01-1jammy [3,587 kB] 2024-08-18T22:15:42.453 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-18T22:15:42.462 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-08-18T22:15:42.498 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.0-1382-gde09dd01-1jammy [3,242 kB] 2024-08-18T22:15:42.498 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-08-18T22:15:42.544 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-18T22:15:42.547 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.0-1382-gde09dd01-1jammy [719 kB] 2024-08-18T22:15:42.559 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.0-1382-gde09dd01-1jammy [356 kB] 2024-08-18T22:15:42.565 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.0-1382-gde09dd01-1jammy [32.8 kB] 2024-08-18T22:15:42.565 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.0-1382-gde09dd01-1jammy [180 kB] 2024-08-18T22:15:42.568 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.0-1382-gde09dd01-1jammy [67.5 kB] 2024-08-18T22:15:42.569 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.0-1382-gde09dd01-1jammy [333 kB] 2024-08-18T22:15:42.575 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.0-1382-gde09dd01-1jammy [6,834 kB] 2024-08-18T22:15:42.590 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-08-18T22:15:42.693 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-18T22:15:42.701 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.0-1382-gde09dd01-1jammy [112 kB] 2024-08-18T22:15:42.702 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.0-1382-gde09dd01-1jammy [472 kB] 2024-08-18T22:15:42.708 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.0-1382-gde09dd01-1jammy [25.9 MB] 2024-08-18T22:15:42.785 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-18T22:15:42.785 INFO:teuthology.orchestra.run.smithi005.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-18T22:15:42.797 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-18T22:15:42.847 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-18T22:15:42.877 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-18T22:15:42.889 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-18T22:15:42.939 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-18T22:15:43.019 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-18T22:15:43.028 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-18T22:15:43.055 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-18T22:15:43.063 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-18T22:15:43.064 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-18T22:15:43.082 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-18T22:15:43.086 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-18T22:15:43.091 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-18T22:15:43.094 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-18T22:15:43.100 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-18T22:15:43.112 INFO:teuthology.orchestra.run.smithi005.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-18T22:15:43.121 INFO:teuthology.orchestra.run.smithi005.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-18T22:15:43.146 INFO:teuthology.orchestra.run.smithi005.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.0-1382-gde09dd01-1jammy [3,242 kB] 2024-08-18T22:15:43.148 INFO:teuthology.orchestra.run.smithi005.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-18T22:15:43.156 INFO:teuthology.orchestra.run.smithi005.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-18T22:15:43.157 INFO:teuthology.orchestra.run.smithi005.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-18T22:15:43.175 INFO:teuthology.orchestra.run.smithi005.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-18T22:15:43.176 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-18T22:15:43.177 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-18T22:15:43.179 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-18T22:15:43.179 INFO:teuthology.orchestra.run.smithi005.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-18T22:15:43.180 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-18T22:15:43.180 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-18T22:15:43.182 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-18T22:15:43.182 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-18T22:15:43.182 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.0-1382-gde09dd01-1jammy [5,137 kB] 2024-08-18T22:15:43.182 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-18T22:15:43.183 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-18T22:15:43.184 INFO:teuthology.orchestra.run.smithi005.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-18T22:15:43.187 INFO:teuthology.orchestra.run.smithi005.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-18T22:15:43.194 INFO:teuthology.orchestra.run.smithi005.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-18T22:15:43.263 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-18T22:15:43.263 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-18T22:15:43.263 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-18T22:15:43.265 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-18T22:15:43.266 INFO:teuthology.orchestra.run.smithi117.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-18T22:15:43.269 INFO:teuthology.orchestra.run.smithi005.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-18T22:15:43.271 INFO:teuthology.orchestra.run.smithi005.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-18T22:15:43.272 INFO:teuthology.orchestra.run.smithi117.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.0-1382-gde09dd01-1jammy [245 kB] 2024-08-18T22:15:43.272 INFO:teuthology.orchestra.run.smithi005.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-18T22:15:43.273 INFO:teuthology.orchestra.run.smithi005.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-18T22:15:43.274 INFO:teuthology.orchestra.run.smithi005.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-18T22:15:43.274 INFO:teuthology.orchestra.run.smithi117.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.0-1382-gde09dd01-1jammy [124 kB] 2024-08-18T22:15:43.275 INFO:teuthology.orchestra.run.smithi117.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.0-1382-gde09dd01-1jammy [1,555 kB] 2024-08-18T22:15:43.276 INFO:teuthology.orchestra.run.smithi005.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-18T22:15:43.277 INFO:teuthology.orchestra.run.smithi005.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-18T22:15:43.277 INFO:teuthology.orchestra.run.smithi005.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-18T22:15:43.277 INFO:teuthology.orchestra.run.smithi005.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-18T22:15:43.301 INFO:teuthology.orchestra.run.smithi117.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.0-1382-gde09dd01-1jammy [6,124 kB] 2024-08-18T22:15:43.344 INFO:teuthology.orchestra.run.smithi117.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-18T22:15:43.344 INFO:teuthology.orchestra.run.smithi117.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-18T22:15:43.345 INFO:teuthology.orchestra.run.smithi117.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-18T22:15:43.345 INFO:teuthology.orchestra.run.smithi117.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-18T22:15:43.346 INFO:teuthology.orchestra.run.smithi117.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-18T22:15:43.357 INFO:teuthology.orchestra.run.smithi005.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-18T22:15:43.357 INFO:teuthology.orchestra.run.smithi005.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-18T22:15:43.358 INFO:teuthology.orchestra.run.smithi005.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-18T22:15:43.360 INFO:teuthology.orchestra.run.smithi005.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-18T22:15:43.360 INFO:teuthology.orchestra.run.smithi005.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-18T22:15:43.423 INFO:teuthology.orchestra.run.smithi117.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.0-1382-gde09dd01-1jammy [22.7 MB] 2024-08-18T22:15:43.425 INFO:teuthology.orchestra.run.smithi117.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-18T22:15:43.426 INFO:teuthology.orchestra.run.smithi117.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-18T22:15:43.426 INFO:teuthology.orchestra.run.smithi117.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-18T22:15:43.431 INFO:teuthology.orchestra.run.smithi117.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-18T22:15:43.431 INFO:teuthology.orchestra.run.smithi117.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-18T22:15:43.438 INFO:teuthology.orchestra.run.smithi005.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-18T22:15:43.439 INFO:teuthology.orchestra.run.smithi005.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-18T22:15:43.439 INFO:teuthology.orchestra.run.smithi005.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-18T22:15:43.440 INFO:teuthology.orchestra.run.smithi005.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-18T22:15:43.440 INFO:teuthology.orchestra.run.smithi005.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-18T22:15:43.506 INFO:teuthology.orchestra.run.smithi117.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-18T22:15:43.507 INFO:teuthology.orchestra.run.smithi117.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-18T22:15:43.508 INFO:teuthology.orchestra.run.smithi117.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-18T22:15:43.509 INFO:teuthology.orchestra.run.smithi117.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-18T22:15:43.510 INFO:teuthology.orchestra.run.smithi117.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-18T22:15:43.520 INFO:teuthology.orchestra.run.smithi005.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-18T22:15:43.520 INFO:teuthology.orchestra.run.smithi005.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-18T22:15:43.521 INFO:teuthology.orchestra.run.smithi005.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-18T22:15:43.526 INFO:teuthology.orchestra.run.smithi005.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-18T22:15:43.526 INFO:teuthology.orchestra.run.smithi005.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-18T22:15:43.575 INFO:teuthology.orchestra.run.smithi005.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.0-1382-gde09dd01-1jammy [719 kB] 2024-08-18T22:15:43.587 INFO:teuthology.orchestra.run.smithi117.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-18T22:15:43.588 INFO:teuthology.orchestra.run.smithi117.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-18T22:15:43.590 INFO:teuthology.orchestra.run.smithi117.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-18T22:15:43.590 INFO:teuthology.orchestra.run.smithi117.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-18T22:15:43.591 INFO:teuthology.orchestra.run.smithi117.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-18T22:15:43.601 INFO:teuthology.orchestra.run.smithi005.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-18T22:15:43.601 INFO:teuthology.orchestra.run.smithi005.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-18T22:15:43.603 INFO:teuthology.orchestra.run.smithi005.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-18T22:15:43.604 INFO:teuthology.orchestra.run.smithi005.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-18T22:15:43.605 INFO:teuthology.orchestra.run.smithi005.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-18T22:15:43.668 INFO:teuthology.orchestra.run.smithi117.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-18T22:15:43.678 INFO:teuthology.orchestra.run.smithi005.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.0-1382-gde09dd01-1jammy [356 kB] 2024-08-18T22:15:43.682 INFO:teuthology.orchestra.run.smithi005.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-18T22:15:43.683 INFO:teuthology.orchestra.run.smithi005.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-18T22:15:43.684 INFO:teuthology.orchestra.run.smithi005.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.0-1382-gde09dd01-1jammy [32.8 kB] 2024-08-18T22:15:43.685 INFO:teuthology.orchestra.run.smithi005.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.0-1382-gde09dd01-1jammy [180 kB] 2024-08-18T22:15:43.685 INFO:teuthology.orchestra.run.smithi005.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-18T22:15:43.686 INFO:teuthology.orchestra.run.smithi005.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-18T22:15:43.686 INFO:teuthology.orchestra.run.smithi005.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-18T22:15:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.0-1382-gde09dd01-1jammy [67.5 kB] 2024-08-18T22:15:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.0-1382-gde09dd01-1jammy [333 kB] 2024-08-18T22:15:43.742 INFO:teuthology.orchestra.run.smithi005.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.0-1382-gde09dd01-1jammy [6,834 kB] 2024-08-18T22:15:43.764 INFO:teuthology.orchestra.run.smithi005.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-18T22:15:43.776 INFO:teuthology.orchestra.run.smithi117.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-18T22:15:43.777 INFO:teuthology.orchestra.run.smithi117.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-18T22:15:43.779 INFO:teuthology.orchestra.run.smithi117.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-18T22:15:43.779 INFO:teuthology.orchestra.run.smithi117.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-18T22:15:43.781 INFO:teuthology.orchestra.run.smithi117.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-18T22:15:43.851 INFO:teuthology.orchestra.run.smithi117.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-18T22:15:43.853 INFO:teuthology.orchestra.run.smithi117.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-18T22:15:43.853 INFO:teuthology.orchestra.run.smithi117.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-18T22:15:43.867 INFO:teuthology.orchestra.run.smithi117.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.0-1382-gde09dd01-1jammy [14.1 kB] 2024-08-18T22:15:43.867 INFO:teuthology.orchestra.run.smithi117.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.0-1382-gde09dd01-1jammy [877 kB] 2024-08-18T22:15:43.872 INFO:teuthology.orchestra.run.smithi005.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-18T22:15:43.873 INFO:teuthology.orchestra.run.smithi005.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-18T22:15:43.874 INFO:teuthology.orchestra.run.smithi117.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.0-1382-gde09dd01-1jammy [2,461 kB] 2024-08-18T22:15:43.875 INFO:teuthology.orchestra.run.smithi005.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-18T22:15:43.875 INFO:teuthology.orchestra.run.smithi005.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-18T22:15:43.876 INFO:teuthology.orchestra.run.smithi005.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-18T22:15:43.924 INFO:teuthology.orchestra.run.smithi117.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-18T22:15:43.924 INFO:teuthology.orchestra.run.smithi117.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-18T22:15:43.925 INFO:teuthology.orchestra.run.smithi117.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.0-1382-gde09dd01-1jammy [794 kB] 2024-08-18T22:15:43.938 INFO:teuthology.orchestra.run.smithi117.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.0-1382-gde09dd01-1jammy [152 kB] 2024-08-18T22:15:43.940 INFO:teuthology.orchestra.run.smithi117.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.0-1382-gde09dd01-1jammy [2,327 kB] 2024-08-18T22:15:43.941 INFO:teuthology.orchestra.run.smithi117.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-18T22:15:43.941 INFO:teuthology.orchestra.run.smithi117.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-18T22:15:43.942 INFO:teuthology.orchestra.run.smithi117.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-18T22:15:43.943 INFO:teuthology.orchestra.run.smithi117.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-18T22:15:43.943 INFO:teuthology.orchestra.run.smithi117.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-18T22:15:43.944 INFO:teuthology.orchestra.run.smithi117.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-18T22:15:43.947 INFO:teuthology.orchestra.run.smithi005.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-18T22:15:43.948 INFO:teuthology.orchestra.run.smithi117.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-18T22:15:43.949 INFO:teuthology.orchestra.run.smithi005.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-18T22:15:43.950 INFO:teuthology.orchestra.run.smithi005.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-18T22:15:43.990 INFO:teuthology.orchestra.run.smithi117.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.0-1382-gde09dd01-1jammy [8,625 kB] 2024-08-18T22:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-18T22:15:44.020 INFO:teuthology.orchestra.run.smithi005.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-18T22:15:44.022 INFO:teuthology.orchestra.run.smithi117.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-18T22:15:44.024 INFO:teuthology.orchestra.run.smithi117.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-18T22:15:44.024 INFO:teuthology.orchestra.run.smithi117.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-18T22:15:44.038 INFO:teuthology.orchestra.run.smithi005.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-18T22:15:44.038 INFO:teuthology.orchestra.run.smithi005.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-18T22:15:44.039 INFO:teuthology.orchestra.run.smithi005.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-18T22:15:44.039 INFO:teuthology.orchestra.run.smithi005.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-18T22:15:44.040 INFO:teuthology.orchestra.run.smithi005.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-18T22:15:44.040 INFO:teuthology.orchestra.run.smithi005.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-18T22:15:44.044 INFO:teuthology.orchestra.run.smithi005.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-18T22:15:44.103 INFO:teuthology.orchestra.run.smithi117.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-18T22:15:44.106 INFO:teuthology.orchestra.run.smithi117.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-08-18T22:15:44.107 INFO:teuthology.orchestra.run.smithi117.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-18T22:15:44.108 INFO:teuthology.orchestra.run.smithi117.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-18T22:15:44.108 INFO:teuthology.orchestra.run.smithi117.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-18T22:15:44.113 INFO:teuthology.orchestra.run.smithi117.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-18T22:15:44.114 INFO:teuthology.orchestra.run.smithi117.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-18T22:15:44.119 INFO:teuthology.orchestra.run.smithi005.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-18T22:15:44.120 INFO:teuthology.orchestra.run.smithi005.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-18T22:15:44.121 INFO:teuthology.orchestra.run.smithi005.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-18T22:15:44.169 INFO:teuthology.orchestra.run.smithi117.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.0-1382-gde09dd01-1jammy [14.2 kB] 2024-08-18T22:15:44.170 INFO:teuthology.orchestra.run.smithi117.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.0-1382-gde09dd01-1jammy [51.2 MB] 2024-08-18T22:15:44.185 INFO:teuthology.orchestra.run.smithi117.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-18T22:15:44.185 INFO:teuthology.orchestra.run.smithi117.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-18T22:15:44.185 INFO:teuthology.orchestra.run.smithi117.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-18T22:15:44.200 INFO:teuthology.orchestra.run.smithi005.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-18T22:15:44.203 INFO:teuthology.orchestra.run.smithi005.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-08-18T22:15:44.204 INFO:teuthology.orchestra.run.smithi005.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-18T22:15:44.205 INFO:teuthology.orchestra.run.smithi005.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-18T22:15:44.206 INFO:teuthology.orchestra.run.smithi005.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-18T22:15:44.210 INFO:teuthology.orchestra.run.smithi005.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-18T22:15:44.211 INFO:teuthology.orchestra.run.smithi005.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-18T22:15:44.266 INFO:teuthology.orchestra.run.smithi117.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-18T22:15:44.267 INFO:teuthology.orchestra.run.smithi117.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-18T22:15:44.268 INFO:teuthology.orchestra.run.smithi117.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-18T22:15:44.275 INFO:teuthology.orchestra.run.smithi117.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-18T22:15:44.276 INFO:teuthology.orchestra.run.smithi117.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-18T22:15:44.276 INFO:teuthology.orchestra.run.smithi117.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-18T22:15:44.280 INFO:teuthology.orchestra.run.smithi117.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-18T22:15:44.282 INFO:teuthology.orchestra.run.smithi005.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-18T22:15:44.282 INFO:teuthology.orchestra.run.smithi005.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-18T22:15:44.283 INFO:teuthology.orchestra.run.smithi005.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-18T22:15:44.325 INFO:teuthology.orchestra.run.smithi005.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.0-1382-gde09dd01-1jammy [112 kB] 2024-08-18T22:15:44.326 INFO:teuthology.orchestra.run.smithi005.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.0-1382-gde09dd01-1jammy [472 kB] 2024-08-18T22:15:44.347 INFO:teuthology.orchestra.run.smithi117.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-18T22:15:44.363 INFO:teuthology.orchestra.run.smithi005.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-18T22:15:44.365 INFO:teuthology.orchestra.run.smithi005.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-18T22:15:44.365 INFO:teuthology.orchestra.run.smithi005.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-18T22:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-18T22:15:44.373 INFO:teuthology.orchestra.run.smithi005.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-18T22:15:44.374 INFO:teuthology.orchestra.run.smithi005.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-18T22:15:44.376 INFO:teuthology.orchestra.run.smithi005.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-18T22:15:44.379 INFO:teuthology.orchestra.run.smithi005.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.0-1382-gde09dd01-1jammy [25.9 MB] 2024-08-18T22:15:44.444 INFO:teuthology.orchestra.run.smithi005.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-18T22:15:45.390 INFO:teuthology.orchestra.run.smithi117.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.0-1382-gde09dd01-1jammy [130 kB] 2024-08-18T22:15:45.391 INFO:teuthology.orchestra.run.smithi117.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.0-1382-gde09dd01-1jammy [233 kB] 2024-08-18T22:15:45.393 INFO:teuthology.orchestra.run.smithi117.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.0-1382-gde09dd01-1jammy [34.0 kB] 2024-08-18T22:15:45.394 INFO:teuthology.orchestra.run.smithi117.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.0-1382-gde09dd01-1jammy [23.4 kB] 2024-08-18T22:15:45.394 INFO:teuthology.orchestra.run.smithi117.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.0-1382-gde09dd01-1jammy [39.0 kB] 2024-08-18T22:15:45.395 INFO:teuthology.orchestra.run.smithi117.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.0-1382-gde09dd01-1jammy [13.6 MB] 2024-08-18T22:15:45.608 INFO:teuthology.orchestra.run.smithi005.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.0-1382-gde09dd01-1jammy [5,137 kB] 2024-08-18T22:15:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.0-1382-gde09dd01-1jammy [245 kB] 2024-08-18T22:15:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.0-1382-gde09dd01-1jammy [124 kB] 2024-08-18T22:15:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.0-1382-gde09dd01-1jammy [1,555 kB] 2024-08-18T22:15:45.775 INFO:teuthology.orchestra.run.smithi005.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.0-1382-gde09dd01-1jammy [6,124 kB] 2024-08-18T22:15:45.907 INFO:teuthology.orchestra.run.smithi117.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.0-1382-gde09dd01-1jammy [91.2 kB] 2024-08-18T22:15:45.925 INFO:teuthology.orchestra.run.smithi005.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.0-1382-gde09dd01-1jammy [22.7 MB] 2024-08-18T22:15:46.302 INFO:teuthology.orchestra.run.smithi005.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.0-1382-gde09dd01-1jammy [14.1 kB] 2024-08-18T22:15:46.302 INFO:teuthology.orchestra.run.smithi005.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.0-1382-gde09dd01-1jammy [877 kB] 2024-08-18T22:15:46.310 INFO:teuthology.orchestra.run.smithi005.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.0-1382-gde09dd01-1jammy [2,461 kB] 2024-08-18T22:15:46.351 INFO:teuthology.orchestra.run.smithi005.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.0-1382-gde09dd01-1jammy [794 kB] 2024-08-18T22:15:46.366 INFO:teuthology.orchestra.run.smithi005.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.0-1382-gde09dd01-1jammy [152 kB] 2024-08-18T22:15:46.366 INFO:teuthology.orchestra.run.smithi005.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.0-1382-gde09dd01-1jammy [2,327 kB] 2024-08-18T22:15:46.405 INFO:teuthology.orchestra.run.smithi005.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.0-1382-gde09dd01-1jammy [8,625 kB] 2024-08-18T22:15:46.548 INFO:teuthology.orchestra.run.smithi005.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.0-1382-gde09dd01-1jammy [14.2 kB] 2024-08-18T22:15:46.548 INFO:teuthology.orchestra.run.smithi005.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.0-1382-gde09dd01-1jammy [51.2 MB] 2024-08-18T22:15:46.553 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 181 MB in 4s (48.7 MB/s) 2024-08-18T22:15:46.706 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-18T22:15:46.774 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-08-18T22:15:46.774 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-08-18T22:15:46.829 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-08-18T22:15:47.124 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-18T22:15:47.137 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-18T22:15:47.174 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-18T22:15:47.401 INFO:teuthology.orchestra.run.smithi005.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.0-1382-gde09dd01-1jammy [130 kB] 2024-08-18T22:15:47.402 INFO:teuthology.orchestra.run.smithi005.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.0-1382-gde09dd01-1jammy [233 kB] 2024-08-18T22:15:47.404 INFO:teuthology.orchestra.run.smithi005.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.0-1382-gde09dd01-1jammy [34.0 kB] 2024-08-18T22:15:47.405 INFO:teuthology.orchestra.run.smithi005.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.0-1382-gde09dd01-1jammy [23.4 kB] 2024-08-18T22:15:47.405 INFO:teuthology.orchestra.run.smithi005.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.0-1382-gde09dd01-1jammy [39.0 kB] 2024-08-18T22:15:47.406 INFO:teuthology.orchestra.run.smithi005.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.0-1382-gde09dd01-1jammy [13.6 MB] 2024-08-18T22:15:47.535 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cmd2. 2024-08-18T22:15:47.549 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-08-18T22:15:47.593 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-08-18T22:15:47.619 INFO:teuthology.orchestra.run.smithi005.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.0-1382-gde09dd01-1jammy [91.2 kB] 2024-08-18T22:15:47.929 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-18T22:15:47.943 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-18T22:15:48.038 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-18T22:15:48.296 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 181 MB in 5s (33.9 MB/s) 2024-08-18T22:15:48.342 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-18T22:15:48.357 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-18T22:15:48.445 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-18T22:15:48.512 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-08-18T22:15:48.515 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-08-18T22:15:48.548 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-08-18T22:15:48.575 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-18T22:15:48.850 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-18T22:15:48.864 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-18T22:15:48.909 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-18T22:15:48.911 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-18T22:15:48.926 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-18T22:15:48.969 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-18T22:15:49.236 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cmd2. 2024-08-18T22:15:49.251 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-08-18T22:15:49.295 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-08-18T22:15:49.415 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-18T22:15:49.429 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T22:15:49.480 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:15:49.681 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-18T22:15:49.696 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-18T22:15:49.781 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-18T22:15:49.909 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-18T22:15:49.924 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T22:15:49.976 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:15:50.101 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-18T22:15:50.116 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-18T22:15:50.159 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-18T22:15:50.412 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-18T22:15:50.426 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T22:15:50.479 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:15:50.529 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-18T22:15:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-18T22:15:50.587 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-18T22:15:50.915 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-18T22:15:50.930 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-18T22:15:50.973 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-18T22:15:51.058 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-18T22:15:51.074 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T22:15:51.124 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:15:51.368 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librados2. 2024-08-18T22:15:51.383 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../010-librados2_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:51.434 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librados2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:51.544 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-18T22:15:51.559 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T22:15:51.610 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:15:51.939 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-18T22:15:51.954 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-18T22:15:51.962 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librbd1. 2024-08-18T22:15:51.977 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../011-librbd1_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:51.997 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:15:52.029 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librbd1 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:52.358 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-18T22:15:52.374 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-18T22:15:52.416 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-18T22:15:52.515 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs2. 2024-08-18T22:15:52.530 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../012-libcephfs2_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:52.581 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:52.703 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librados2. 2024-08-18T22:15:52.718 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../010-librados2_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:52.753 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librados2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rados. 2024-08-18T22:15:52.924 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../013-python3-rados_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:52.967 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rados (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:53.123 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librbd1. 2024-08-18T22:15:53.137 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../011-librbd1_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:53.180 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librbd1 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:53.537 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-18T22:15:53.551 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:15:53.603 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-argparse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:53.608 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libcephfs2. 2024-08-18T22:15:53.624 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../012-libcephfs2_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:53.666 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libcephfs2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:53.930 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cephfs. 2024-08-18T22:15:53.946 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../015-python3-cephfs_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:53.952 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rados. 2024-08-18T22:15:53.967 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../013-python3-rados_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:53.997 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cephfs (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:54.010 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rados (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:54.271 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-18T22:15:54.286 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:15:54.321 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-ceph-argparse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:54.359 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-18T22:15:54.373 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:15:54.417 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-common (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:54.557 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cephfs. 2024-08-18T22:15:54.572 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../015-python3-cephfs_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:54.786 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-prettytable. 2024-08-18T22:15:54.801 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-08-18T22:15:54.844 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-18T22:15:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cephfs (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:55.106 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rbd. 2024-08-18T22:15:55.120 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../018-python3-rbd_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:55.163 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rbd (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:55.227 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-18T22:15:55.242 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:15:55.285 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-ceph-common (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:55.542 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-18T22:15:55.557 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-18T22:15:55.600 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-18T22:15:55.646 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-prettytable. 2024-08-18T22:15:55.661 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-08-18T22:15:55.696 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-18T22:15:55.869 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-18T22:15:55.884 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-18T22:15:55.927 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-18T22:15:55.932 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rbd. 2024-08-18T22:15:55.947 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../018-python3-rbd_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:55.990 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rbd (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:56.197 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-18T22:15:56.206 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-18T22:15:56.280 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-18T22:15:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-18T22:15:56.300 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-18T22:15:56.343 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-18T22:15:56.609 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua5.1. 2024-08-18T22:15:56.618 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-18T22:15:56.653 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-18T22:15:56.658 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-18T22:15:56.669 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-18T22:15:56.712 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-18T22:15:57.003 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua-any. 2024-08-18T22:15:57.012 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-08-18T22:15:57.023 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-18T22:15:57.039 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-18T22:15:57.044 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-18T22:15:57.081 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-18T22:15:57.305 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package zip. 2024-08-18T22:15:57.314 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-08-18T22:15:57.355 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking zip (3.0-12build2) ... 2024-08-18T22:15:57.384 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package lua5.1. 2024-08-18T22:15:57.399 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-18T22:15:57.442 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-18T22:15:57.667 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package unzip. 2024-08-18T22:15:57.676 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-18T22:15:57.717 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-18T22:15:57.787 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package lua-any. 2024-08-18T22:15:57.803 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-08-18T22:15:57.846 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-18T22:15:58.073 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package zip. 2024-08-18T22:15:58.089 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-08-18T22:15:58.112 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package luarocks. 2024-08-18T22:15:58.121 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-18T22:15:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking zip (3.0-12build2) ... 2024-08-18T22:15:58.162 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-18T22:15:58.418 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package unzip. 2024-08-18T22:15:58.434 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-18T22:15:58.476 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-18T22:15:58.561 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librgw2. 2024-08-18T22:15:58.570 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../027-librgw2_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:58.603 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librgw2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:58.897 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package luarocks. 2024-08-18T22:15:58.913 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-18T22:15:58.955 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-18T22:15:59.105 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rgw. 2024-08-18T22:15:59.114 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../028-python3-rgw_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:59.155 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rgw (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:59.354 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librgw2. 2024-08-18T22:15:59.369 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../027-librgw2_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:59.412 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librgw2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:59.542 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-18T22:15:59.551 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-18T22:15:59.591 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-18T22:15:59.915 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rgw. 2024-08-18T22:15:59.928 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libradosstriper1. 2024-08-18T22:15:59.930 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../028-python3-rgw_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:59.937 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../030-libradosstriper1_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:15:59.965 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rgw (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:15:59.977 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libradosstriper1 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:00.279 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-18T22:16:00.292 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-18T22:16:00.334 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-18T22:16:00.397 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-common. 2024-08-18T22:16:00.409 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../031-ceph-common_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:00.447 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-common (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:00.671 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libradosstriper1. 2024-08-18T22:16:00.686 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../030-libradosstriper1_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:00.754 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libradosstriper1 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:01.191 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-common. 2024-08-18T22:16:01.206 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../031-ceph-common_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:01.249 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-common (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:01.560 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-base. 2024-08-18T22:16:01.574 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../032-ceph-base_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:01.619 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-base (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:02.190 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-18T22:16:02.200 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-18T22:16:02.239 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-18T22:16:02.387 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-base. 2024-08-18T22:16:02.403 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../032-ceph-base_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:02.455 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-base (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:02.576 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cheroot. 2024-08-18T22:16:02.590 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-18T22:16:02.634 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-18T22:16:02.987 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-18T22:16:03.000 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-18T22:16:03.037 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-18T22:16:03.108 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-18T22:16:03.123 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-18T22:16:03.175 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-18T22:16:03.340 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-18T22:16:03.352 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-18T22:16:03.390 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-18T22:16:03.494 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cheroot. 2024-08-18T22:16:03.510 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-18T22:16:03.552 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-18T22:16:03.889 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-18T22:16:03.904 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-18T22:16:03.926 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-18T22:16:03.938 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-18T22:16:03.947 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-18T22:16:04.001 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-18T22:16:04.250 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-18T22:16:04.265 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-18T22:16:04.279 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempora. 2024-08-18T22:16:04.291 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-08-18T22:16:04.300 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-18T22:16:04.320 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-18T22:16:04.536 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-18T22:16:04.551 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-18T22:16:04.586 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-18T22:16:04.640 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-portend. 2024-08-18T22:16:04.652 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-08-18T22:16:04.690 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-18T22:16:05.011 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-18T22:16:05.023 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-18T22:16:05.038 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-tempora. 2024-08-18T22:16:05.054 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-08-18T22:16:05.067 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-18T22:16:05.096 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-18T22:16:05.370 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-18T22:16:05.383 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-18T22:16:05.391 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-portend. 2024-08-18T22:16:05.407 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-08-18T22:16:05.420 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-18T22:16:05.449 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-18T22:16:05.710 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-18T22:16:05.726 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-18T22:16:05.748 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-natsort. 2024-08-18T22:16:05.760 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-18T22:16:05.761 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-08-18T22:16:05.790 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-18T22:16:06.021 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-18T22:16:06.037 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-18T22:16:06.071 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-18T22:16:06.127 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-logutils. 2024-08-18T22:16:06.139 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-08-18T22:16:06.176 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-18T22:16:06.450 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-natsort. 2024-08-18T22:16:06.462 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-18T22:16:06.465 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-08-18T22:16:06.471 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-18T22:16:06.512 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-18T22:16:06.625 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-18T22:16:06.823 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-mako. 2024-08-18T22:16:06.834 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-18T22:16:06.873 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-18T22:16:06.961 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-logutils. 2024-08-18T22:16:06.978 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-08-18T22:16:07.019 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-18T22:16:07.210 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-18T22:16:07.222 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-18T22:16:07.260 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-18T22:16:07.322 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-18T22:16:07.337 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-18T22:16:07.380 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-18T22:16:07.575 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-18T22:16:07.586 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-18T22:16:07.629 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-18T22:16:07.658 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-mako. 2024-08-18T22:16:07.674 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-18T22:16:07.716 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-18T22:16:07.932 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webob. 2024-08-18T22:16:07.945 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-18T22:16:07.990 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-18T22:16:08.078 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-18T22:16:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-18T22:16:08.136 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-18T22:16:08.360 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-waitress. 2024-08-18T22:16:08.371 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-18T22:16:08.389 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-18T22:16:08.404 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-18T22:16:08.412 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-18T22:16:08.439 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-18T22:16:08.743 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-webob. 2024-08-18T22:16:08.746 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempita. 2024-08-18T22:16:08.757 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-18T22:16:08.759 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-18T22:16:08.796 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-18T22:16:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-18T22:16:09.065 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-paste. 2024-08-18T22:16:09.309 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-18T22:16:09.309 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-18T22:16:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-waitress. 2024-08-18T22:16:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-18T22:16:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-18T22:16:09.468 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-18T22:16:09.479 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-18T22:16:09.518 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-18T22:16:09.524 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-tempita. 2024-08-18T22:16:09.539 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-18T22:16:09.574 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-18T22:16:09.813 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-18T22:16:09.824 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-18T22:16:09.852 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-paste. 2024-08-18T22:16:09.854 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-18T22:16:09.867 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-18T22:16:09.910 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-18T22:16:10.190 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webtest. 2024-08-18T22:16:10.202 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-08-18T22:16:10.240 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-18T22:16:10.282 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-18T22:16:10.295 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-18T22:16:10.338 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-18T22:16:10.552 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pecan. 2024-08-18T22:16:10.563 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-18T22:16:10.601 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-18T22:16:10.641 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-18T22:16:10.656 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-18T22:16:10.699 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-18T22:16:10.973 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-certifi. 2024-08-18T22:16:10.984 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-08-18T22:16:11.002 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-webtest. 2024-08-18T22:16:11.018 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-08-18T22:16:11.022 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-18T22:16:11.060 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-18T22:16:11.347 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pecan. 2024-08-18T22:16:11.362 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-18T22:16:11.376 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-idna. 2024-08-18T22:16:11.387 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-18T22:16:11.396 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-18T22:16:11.425 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-18T22:16:11.736 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-urllib3. 2024-08-18T22:16:11.743 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-certifi. 2024-08-18T22:16:11.748 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-18T22:16:11.758 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-08-18T22:16:11.786 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-18T22:16:11.793 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-18T22:16:12.081 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests. 2024-08-18T22:16:12.093 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-18T22:16:12.095 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-idna. 2024-08-18T22:16:12.111 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-18T22:16:12.131 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-18T22:16:12.162 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-18T22:16:12.473 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-urllib3. 2024-08-18T22:16:12.476 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-18T22:16:12.487 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-18T22:16:12.489 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-18T22:16:12.525 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-18T22:16:12.531 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-18T22:16:12.852 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-requests. 2024-08-18T22:16:12.853 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-18T22:16:12.865 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:12.867 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-18T22:16:12.903 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-modules-core (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:12.909 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-18T22:16:13.221 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-18T22:16:13.236 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-18T22:16:13.270 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-18T22:16:13.325 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-18T22:16:13.336 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:13.375 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libsqlite3-mod-ceph (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:13.573 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-18T22:16:13.589 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:13.632 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-modules-core (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:13.644 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-18T22:16:13.656 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-18T22:16:13.718 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-18T22:16:13.970 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-18T22:16:13.985 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:14.020 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libsqlite3-mod-ceph (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:14.172 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-openssl. 2024-08-18T22:16:14.184 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-08-18T22:16:14.255 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-18T22:16:14.372 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-18T22:16:14.388 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-18T22:16:14.431 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-18T22:16:14.583 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr. 2024-08-18T22:16:14.595 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../065-ceph-mgr_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:14.633 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:14.733 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-openssl. 2024-08-18T22:16:14.749 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-08-18T22:16:14.791 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-18T22:16:15.745 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mon. 2024-08-18T22:16:15.757 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../066-ceph-mon_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:15.786 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mon (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:15.904 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr. 2024-08-18T22:16:15.920 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../065-ceph-mgr_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:15.953 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:16.331 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mon. 2024-08-18T22:16:16.347 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../066-ceph-mon_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:16.364 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-osd. 2024-08-18T22:16:16.375 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../067-ceph-osd_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:16.389 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mon (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:16.414 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-osd (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-osd. 2024-08-18T22:16:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../067-ceph-osd_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-osd (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:17.176 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph. 2024-08-18T22:16:17.187 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../068-ceph_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:17.226 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:17.536 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-fuse. 2024-08-18T22:16:17.548 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../069-ceph-fuse_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:17.586 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-fuse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph. 2024-08-18T22:16:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../068-ceph_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:17.896 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:17.956 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mds. 2024-08-18T22:16:17.967 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../070-ceph-mds_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:18.006 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mds (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:18.215 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-fuse. 2024-08-18T22:16:18.230 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../069-ceph-fuse_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:18.273 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-fuse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:18.402 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephadm. 2024-08-18T22:16:18.414 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../071-cephadm_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:18.452 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephadm (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:18.651 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mds. 2024-08-18T22:16:18.667 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../070-ceph-mds_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:18.718 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mds (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:18.738 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-18T22:16:18.749 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-18T22:16:18.788 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-18T22:16:19.079 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephadm. 2024-08-18T22:16:19.095 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../071-cephadm_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:19.115 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-18T22:16:19.127 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-18T22:16:19.137 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephadm (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:19.165 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-18T22:16:19.448 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-18T22:16:19.464 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-18T22:16:19.498 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-18T22:16:19.809 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-18T22:16:19.824 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-18T22:16:19.867 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-18T22:16:20.145 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-babel. 2024-08-18T22:16:20.155 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-18T22:16:20.195 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-18T22:16:20.548 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jinja2. 2024-08-18T22:16:20.558 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-18T22:16:20.597 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-18T22:16:20.967 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-18T22:16:20.978 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:21.017 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-cephadm (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:21.030 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-babel. 2024-08-18T22:16:21.045 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-18T22:16:21.089 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-18T22:16:21.354 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-18T22:16:21.364 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-08-18T22:16:21.403 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-18T22:16:21.442 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jinja2. 2024-08-18T22:16:21.456 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-18T22:16:21.500 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-18T22:16:21.706 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-routes. 2024-08-18T22:16:21.717 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-18T22:16:21.756 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-18T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-18T22:16:21.852 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:21.894 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-cephadm (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:22.117 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-18T22:16:22.129 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:22.167 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-dashboard (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:22.231 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-18T22:16:22.247 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-08-18T22:16:22.289 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-18T22:16:22.617 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-routes. 2024-08-18T22:16:22.633 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-18T22:16:22.675 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-18T22:16:22.995 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-18T22:16:23.011 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-dashboard (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:23.414 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-18T22:16:23.425 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-18T22:16:23.463 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-18T22:16:23.959 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-joblib. 2024-08-18T22:16:23.973 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-18T22:16:24.017 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-18T22:16:24.266 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-18T22:16:24.282 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-18T22:16:24.324 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-18T22:16:24.603 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-18T22:16:24.616 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-18T22:16:24.764 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-18T22:16:24.828 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-joblib. 2024-08-18T22:16:24.843 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-18T22:16:24.886 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-18T22:16:25.050 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn. 2024-08-18T22:16:25.063 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-18T22:16:25.091 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-18T22:16:25.198 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-18T22:16:25.212 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-18T22:16:25.325 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-18T22:16:25.645 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-sklearn. 2024-08-18T22:16:25.660 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-18T22:16:25.703 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-18T22:16:25.775 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-18T22:16:25.786 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:25.824 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:26.328 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-18T22:16:26.343 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:26.386 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:26.778 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cachetools. 2024-08-18T22:16:26.791 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-08-18T22:16:26.861 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-18T22:16:27.164 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-18T22:16:27.176 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-18T22:16:27.213 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-18T22:16:27.331 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cachetools. 2024-08-18T22:16:27.347 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-08-18T22:16:27.389 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-18T22:16:27.550 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-18T22:16:27.563 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-18T22:16:27.608 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-18T22:16:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-18T22:16:27.717 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-18T22:16:27.758 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-18T22:16:27.945 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rsa. 2024-08-18T22:16:27.957 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-08-18T22:16:27.986 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-18T22:16:28.079 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-18T22:16:28.095 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-18T22:16:28.137 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-18T22:16:28.298 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-google-auth. 2024-08-18T22:16:28.311 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-08-18T22:16:28.376 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-18T22:16:28.390 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rsa. 2024-08-18T22:16:28.406 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-08-18T22:16:28.439 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-18T22:16:28.701 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-18T22:16:28.714 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-18T22:16:28.750 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-18T22:16:28.760 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-google-auth. 2024-08-18T22:16:28.776 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-08-18T22:16:28.818 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-18T22:16:29.095 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-websocket. 2024-08-18T22:16:29.108 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-08-18T22:16:29.138 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-18T22:16:29.145 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-18T22:16:29.154 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-18T22:16:29.196 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-18T22:16:29.482 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-18T22:16:29.495 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-18T22:16:29.508 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-websocket. 2024-08-18T22:16:29.523 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-18T22:16:29.524 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-08-18T22:16:29.566 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-18T22:16:29.877 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-18T22:16:29.894 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-18T22:16:29.927 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-18T22:16:30.178 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-18T22:16:30.190 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:30.228 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-k8sevents (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:30.581 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-18T22:16:30.590 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-18T22:16:30.593 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-18T22:16:30.605 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:30.631 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-18T22:16:30.648 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-k8sevents (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:30.992 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-18T22:16:31.005 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-18T22:16:31.042 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-18T22:16:31.210 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-18T22:16:31.225 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-18T22:16:31.268 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-18T22:16:31.320 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package jq. 2024-08-18T22:16:31.333 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-18T22:16:31.369 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-18T22:16:31.613 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-18T22:16:31.614 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package socat. 2024-08-18T22:16:31.626 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-18T22:16:31.629 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-18T22:16:31.663 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-18T22:16:31.671 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-18T22:16:31.932 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package jq. 2024-08-18T22:16:31.947 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-18T22:16:31.982 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-18T22:16:31.992 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package xmlstarlet. 2024-08-18T22:16:32.004 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-18T22:16:32.041 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-18T22:16:32.201 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package socat. 2024-08-18T22:16:32.217 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-18T22:16:32.362 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-18T22:16:32.362 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-test. 2024-08-18T22:16:32.373 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../099-ceph-test_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:32.412 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-test (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:32.663 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package xmlstarlet. 2024-08-18T22:16:32.679 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-18T22:16:32.721 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-18T22:16:33.092 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-test. 2024-08-18T22:16:33.107 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../099-ceph-test_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:33.141 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-test (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:34.349 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-volume. 2024-08-18T22:16:34.362 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../100-ceph-volume_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:34.399 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-volume (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:34.795 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-18T22:16:34.808 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:34.853 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-mirror (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:35.021 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-volume. 2024-08-18T22:16:35.037 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../100-ceph-volume_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:35.079 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-volume (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:35.181 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-colorama. 2024-08-18T22:16:35.194 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-08-18T22:16:35.231 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-08-18T22:16:35.433 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-18T22:16:35.449 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:35.483 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephfs-mirror (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-shell. 2024-08-18T22:16:35.504 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../103-cephfs-shell_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:35.541 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-shell (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:35.803 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-colorama. 2024-08-18T22:16:35.819 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-top. 2024-08-18T22:16:35.819 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-08-18T22:16:35.833 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../104-cephfs-top_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:35.861 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-08-18T22:16:35.869 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-top (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:36.096 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-18T22:16:36.109 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:36.130 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephfs-shell. 2024-08-18T22:16:36.146 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../103-cephfs-shell_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:36.179 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs-dev (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:36.188 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephfs-shell (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:36.449 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephfs-top. 2024-08-18T22:16:36.465 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../104-cephfs-top_19.1.0-1382-gde09dd01-1jammy_all.deb ... 2024-08-18T22:16:36.507 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephfs-top (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:36.624 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-18T22:16:36.636 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-18T22:16:36.698 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-18T22:16:36.735 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-18T22:16:36.751 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:36.784 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libcephfs-dev (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:37.036 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-18T22:16:37.049 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-08-18T22:16:37.079 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-18T22:16:37.086 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-18T22:16:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-18T22:16:37.137 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-18T22:16:37.431 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package nvme-cli. 2024-08-18T22:16:37.447 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-18T22:16:37.481 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-18T22:16:37.483 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-18T22:16:37.499 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-08-18T22:16:37.541 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-18T22:16:37.878 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package pkg-config. 2024-08-18T22:16:37.891 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-18T22:16:37.929 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package nvme-cli. 2024-08-18T22:16:37.936 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-18T22:16:37.945 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-18T22:16:37.987 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-18T22:16:38.230 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-18T22:16:38.244 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-18T22:16:38.288 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-18T22:16:38.400 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package pkg-config. 2024-08-18T22:16:38.416 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-18T22:16:38.458 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-18T22:16:38.683 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-18T22:16:38.697 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-18T22:16:38.728 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-18T22:16:38.744 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-18T22:16:38.774 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-18T22:16:38.786 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-18T22:16:39.086 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastescript. 2024-08-18T22:16:39.102 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-08-18T22:16:39.144 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-18T22:16:39.223 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-18T22:16:39.238 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-18T22:16:39.306 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-18T22:16:39.497 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pluggy. 2024-08-18T22:16:39.511 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-18T22:16:39.541 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pastescript. 2024-08-18T22:16:39.555 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-18T22:16:39.557 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-08-18T22:16:39.591 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-18T22:16:39.883 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-psutil. 2024-08-18T22:16:39.897 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-18T22:16:39.912 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pluggy. 2024-08-18T22:16:40.037 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-18T22:16:40.037 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-18T22:16:40.037 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-18T22:16:40.281 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-psutil. 2024-08-18T22:16:40.297 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-18T22:16:40.336 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-py. 2024-08-18T22:16:40.350 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-08-18T22:16:40.355 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-18T22:16:40.394 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-18T22:16:40.675 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-py. 2024-08-18T22:16:40.692 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-08-18T22:16:40.697 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pygments. 2024-08-18T22:16:40.711 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-18T22:16:40.733 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-18T22:16:40.772 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-18T22:16:41.062 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pygments. 2024-08-18T22:16:41.078 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-18T22:16:41.119 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-18T22:16:41.201 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-18T22:16:41.214 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-18T22:16:41.275 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-18T22:16:41.587 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-toml. 2024-08-18T22:16:41.599 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-08-18T22:16:41.636 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-18T22:16:41.724 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-18T22:16:41.739 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-18T22:16:41.773 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-18T22:16:41.981 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pytest. 2024-08-18T22:16:41.994 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-18T22:16:42.039 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-18T22:16:42.101 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-toml. 2024-08-18T22:16:42.117 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-08-18T22:16:42.159 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-18T22:16:42.418 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplejson. 2024-08-18T22:16:42.431 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-18T22:16:42.476 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-18T22:16:42.501 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pytest. 2024-08-18T22:16:42.518 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-18T22:16:42.554 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-18T22:16:42.745 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-18T22:16:42.759 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-18T22:16:42.836 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-18T22:16:42.891 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-simplejson. 2024-08-18T22:16:42.907 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-18T22:16:42.949 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-18T22:16:43.226 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-18T22:16:43.242 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-18T22:16:43.276 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-18T22:16:43.548 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package radosgw. 2024-08-18T22:16:43.561 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../122-radosgw_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:43.598 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking radosgw (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:43.988 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package radosgw. 2024-08-18T22:16:44.003 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../122-radosgw_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:44.047 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking radosgw (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:44.226 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package rbd-fuse. 2024-08-18T22:16:44.240 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../123-rbd-fuse_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:44.284 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking rbd-fuse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:44.576 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-18T22:16:44.683 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package rbd-fuse. 2024-08-18T22:16:44.698 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../123-rbd-fuse_19.1.0-1382-gde09dd01-1jammy_amd64.deb ... 2024-08-18T22:16:44.741 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking rbd-fuse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:44.856 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-18T22:16:45.045 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-18T22:16:45.274 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-18T22:16:45.313 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-18T22:16:45.439 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-18T22:16:45.564 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-18T22:16:45.706 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-18T22:16:45.971 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-18T22:16:46.129 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-18T22:16:46.562 INFO:teuthology.orchestra.run.smithi117.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-18T22:16:46.609 INFO:teuthology.orchestra.run.smithi117.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-08-18T22:16:46.659 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephadm (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:46.747 INFO:teuthology.orchestra.run.smithi005.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-18T22:16:46.795 INFO:teuthology.orchestra.run.smithi005.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-08-18T22:16:46.949 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephadm (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:47.227 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user cephadm....done 2024-08-18T22:16:47.381 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-18T22:16:47.509 INFO:teuthology.orchestra.run.smithi005.stdout:Adding system user cephadm....done 2024-08-18T22:16:47.672 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-18T22:16:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-18T22:16:47.986 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-18T22:16:47.989 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-18T22:16:48.135 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-18T22:16:48.349 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-18T22:16:48.419 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-18T22:16:48.475 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-18T22:16:48.722 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-18T22:16:48.751 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-18T22:16:48.871 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-18T22:16:49.004 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-18T22:16:49.130 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-18T22:16:49.231 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-18T22:16:49.449 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-18T22:16:49.608 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-18T22:16:49.834 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-18T22:16:49.893 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-08-18T22:16:50.085 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-08-18T22:16:50.177 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-18T22:16:50.345 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-18T22:16:50.478 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-18T22:16:50.621 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-18T22:16:50.779 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-18T22:16:50.889 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-18T22:16:51.064 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-18T22:16:51.157 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-18T22:16:51.340 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-18T22:16:51.433 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-18T22:16:51.617 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-argparse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:51.909 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-18T22:16:51.956 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-ceph-argparse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:52.085 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-18T22:16:52.218 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-18T22:16:52.236 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-08-18T22:16:52.319 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-18T22:16:52.445 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-08-18T22:16:52.512 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-18T22:16:52.646 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-18T22:16:52.731 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-18T22:16:52.856 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-18T22:16:52.914 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-18T22:16:53.174 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-18T22:16:53.286 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-18T22:16:53.336 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-18T22:16:53.417 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-18T22:16:53.543 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-18T22:16:53.544 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-18T22:16:53.579 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-18T22:16:53.635 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-18T22:16:53.736 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-18T22:16:53.936 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-18T22:16:54.112 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-18T22:16:54.112 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-18T22:16:54.239 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-18T22:16:54.405 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-18T22:16:54.523 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-18T22:16:54.697 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-18T22:16:54.799 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-18T22:16:55.015 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up zip (3.0-12build2) ... 2024-08-18T22:16:55.125 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up zip (3.0-12build2) ... 2024-08-18T22:16:55.208 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-18T22:16:55.234 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-18T22:16:55.935 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-18T22:16:55.945 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-18T22:16:56.211 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-18T22:16:56.255 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-18T22:16:56.320 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-18T22:16:56.381 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-18T22:16:56.429 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-18T22:16:56.506 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-18T22:16:56.747 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-18T22:16:56.833 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-18T22:16:57.173 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-18T22:16:57.251 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-18T22:16:57.441 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-18T22:16:57.493 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-18T22:16:57.851 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-18T22:16:57.870 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-18T22:16:58.160 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-08-18T22:16:58.180 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-08-18T22:16:58.506 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-18T22:16:58.520 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-18T22:16:58.854 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-18T22:16:58.866 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-18T22:16:59.114 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-18T22:16:59.133 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-18T22:16:59.234 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-ceph-common (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:59.273 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-common (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:16:59.528 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-18T22:16:59.583 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-18T22:16:59.862 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-18T22:16:59.950 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-18T22:17:01.176 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-18T22:17:01.181 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-18T22:17:01.386 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:17:01.491 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:17:01.520 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-18T22:17:01.651 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-18T22:17:01.814 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-18T22:17:01.952 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-18T22:17:02.031 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-18T22:17:02.103 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-18T22:17:02.254 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-18T22:17:02.272 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-18T22:17:02.588 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-18T22:17:02.742 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-18T22:17:02.856 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-18T22:17:03.002 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-18T22:17:03.149 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:17:03.253 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:17:03.325 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-18T22:17:03.379 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-18T22:17:03.660 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-18T22:17:03.697 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-18T22:17:03.944 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-18T22:17:03.965 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-18T22:17:04.245 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-18T22:17:04.266 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-18T22:17:04.534 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-18T22:17:04.538 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-18T22:17:04.776 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-18T22:17:04.805 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-18T22:17:05.044 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-18T22:17:05.123 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-18T22:17:05.170 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-18T22:17:05.276 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-18T22:17:05.497 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-18T22:17:05.594 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-18T22:17:05.623 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-18T22:17:05.745 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-18T22:17:05.924 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-18T22:17:06.054 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-18T22:17:06.242 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-18T22:17:06.407 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-18T22:17:06.526 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-18T22:17:06.627 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-18T22:17:06.682 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-18T22:17:06.736 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-18T22:17:06.807 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-18T22:17:06.825 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-18T22:17:06.967 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-18T22:17:07.056 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-18T22:17:07.063 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-18T22:17:07.189 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-18T22:17:07.319 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-18T22:17:07.487 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-18T22:17:07.633 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-18T22:17:07.900 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-18T22:17:07.923 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-18T22:17:08.001 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-18T22:17:08.206 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-18T22:17:08.252 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:17:08.357 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-18T22:17:08.395 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-18T22:17:08.658 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-18T22:17:08.729 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-18T22:17:08.784 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-18T22:17:09.047 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-18T22:17:09.118 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-18T22:17:09.357 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-18T22:17:09.478 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-18T22:17:09.585 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-18T22:17:09.779 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-18T22:17:09.844 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-18T22:17:10.023 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-18T22:17:10.121 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-18T22:17:10.308 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-18T22:17:10.406 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-18T22:17:10.610 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-18T22:17:10.799 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-18T22:17:10.869 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-18T22:17:11.100 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-18T22:17:11.254 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-18T22:17:11.444 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-18T22:17:11.556 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-18T22:17:11.570 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librados2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:11.696 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libsqlite3-mod-ceph (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:11.823 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-18T22:17:11.908 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-18T22:17:12.059 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librados2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:12.159 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libcephfs2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:12.160 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libsqlite3-mod-ceph (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:12.260 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libradosstriper1 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:12.278 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-18T22:17:12.361 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-18T22:17:12.639 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:12.765 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libradosstriper1 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:12.821 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librbd1 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:12.891 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-18T22:17:12.955 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-modules-core (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:13.081 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-fuse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:13.193 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librbd1 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:13.294 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-modules-core (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:13.301 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-18T22:17:13.301 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-18T22:17:13.411 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-fuse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:13.621 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-18T22:17:13.621 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-18T22:17:14.008 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libcephfs-dev (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:14.134 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rados (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:14.254 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs-dev (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:14.389 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rados (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:14.539 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librgw2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:14.652 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librgw2 (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:14.715 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-top (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:14.778 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephfs-top (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:14.866 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-18T22:17:14.904 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-18T22:17:16.162 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rbd (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:16.233 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rbd (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:16.287 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up rbd-fuse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:16.359 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up rbd-fuse (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:16.449 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rgw (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:16.493 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rgw (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:16.644 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cephfs (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:16.790 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephfs-shell (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:16.831 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cephfs (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:16.913 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-common (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:16.957 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-shell (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:17.091 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-common (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:17.441 INFO:teuthology.orchestra.run.smithi005.stdout:Adding group ceph....done 2024-08-18T22:17:17.628 INFO:teuthology.orchestra.run.smithi117.stdout:Adding group ceph....done 2024-08-18T22:17:18.037 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user ceph....done 2024-08-18T22:17:18.198 INFO:teuthology.orchestra.run.smithi117.stdout:Setting system user ceph properties....done 2024-08-18T22:17:18.218 INFO:teuthology.orchestra.run.smithi117.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-18T22:17:18.230 INFO:teuthology.orchestra.run.smithi005.stdout:Adding system user ceph....done 2024-08-18T22:17:18.359 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-18T22:17:18.399 INFO:teuthology.orchestra.run.smithi005.stdout:Setting system user ceph properties....done 2024-08-18T22:17:18.418 INFO:teuthology.orchestra.run.smithi005.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-18T22:17:18.569 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-18T22:17:18.756 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-18T22:17:18.981 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-18T22:17:19.409 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-mirror (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:19.634 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-18T22:17:19.634 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-18T22:17:19.669 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephfs-mirror (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:19.868 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-18T22:17:19.868 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-18T22:17:20.285 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-test (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:20.461 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up radosgw (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:20.478 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-test (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:20.604 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up radosgw (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:21.035 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-18T22:17:21.035 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-18T22:17:21.159 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-18T22:17:21.160 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-18T22:17:21.655 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-base (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:21.773 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-base (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:22.035 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-18T22:17:22.151 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-18T22:17:22.699 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mds (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:22.808 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mds (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:22.946 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-18T22:17:22.946 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-18T22:17:23.189 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-18T22:17:23.190 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-18T22:17:23.559 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:23.763 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-18T22:17:23.763 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-18T22:17:23.819 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:24.022 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-18T22:17:24.022 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-18T22:17:24.377 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-osd (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:24.663 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-osd (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:24.719 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-18T22:17:24.719 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-18T22:17:24.976 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-18T22:17:24.976 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-18T22:17:25.353 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-k8sevents (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:25.529 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-diskprediction-local (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:25.614 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-k8sevents (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:25.697 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mon (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:25.723 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-diskprediction-local (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:25.866 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mon (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:25.923 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-18T22:17:25.923 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-18T22:17:26.082 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-18T22:17:26.082 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-18T22:17:26.557 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-cephadm (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:26.709 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-cephadm (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:26.750 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:26.852 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:26.867 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-dashboard (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:26.977 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-dashboard (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:27.035 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-volume (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:27.120 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-volume (19.1.0-1382-gde09dd01-1jammy) ... 2024-08-18T22:17:27.396 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-18T22:17:27.473 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-18T22:17:27.538 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-18T22:17:27.566 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-18T22:17:27.691 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-18T22:17:27.717 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-18T22:17:28.816 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-18T22:17:29.010 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-18T22:17:29.634 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-18T22:17:29.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-08-18T22:17:29.714 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-08-18T22:17:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-18T22:17:29.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-08-18T22:17:29.876 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-08-18T22:17:29.896 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-08-18T22:17:29.897 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-08-18T22:17:30.064 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree... 2024-08-18T22:17:30.065 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information... 2024-08-18T22:17:30.084 INFO:teuthology.orchestra.run.smithi117.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-08-18T22:17:30.084 INFO:teuthology.orchestra.run.smithi117.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-08-18T22:17:30.084 INFO:teuthology.orchestra.run.smithi117.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-08-18T22:17:30.084 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-08-18T22:17:30.084 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-18T22:17:30.084 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-18T22:17:30.084 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-18T22:17:30.085 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-18T22:17:30.085 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-18T22:17:30.085 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-18T22:17:30.085 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-08-18T22:17:30.086 INFO:teuthology.orchestra.run.smithi117.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-08-18T22:17:30.086 INFO:teuthology.orchestra.run.smithi117.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-08-18T22:17:30.086 INFO:teuthology.orchestra.run.smithi117.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-08-18T22:17:30.086 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-08-18T22:17:30.086 INFO:teuthology.orchestra.run.smithi117.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-18T22:17:30.087 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-08-18T22:17:30.088 INFO:teuthology.orchestra.run.smithi117.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-08-18T22:17:30.088 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-08-18T22:17:30.088 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-18T22:17:30.143 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-08-18T22:17:30.144 INFO:teuthology.orchestra.run.smithi117.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-08-18T22:17:30.144 INFO:teuthology.orchestra.run.smithi117.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-08-18T22:17:30.144 INFO:teuthology.orchestra.run.smithi117.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-08-18T22:17:30.145 INFO:teuthology.orchestra.run.smithi117.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-08-18T22:17:30.145 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-08-18T22:17:30.145 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-08-18T22:17:30.145 INFO:teuthology.orchestra.run.smithi117.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-18T22:17:30.146 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2024-08-18T22:17:30.146 INFO:teuthology.orchestra.run.smithi117.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-08-18T22:17:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-08-18T22:17:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-08-18T22:17:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-08-18T22:17:30.257 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages were automatically installed and are no longer required: 2024-08-18T22:17:30.257 INFO:teuthology.orchestra.run.smithi005.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-18T22:17:30.257 INFO:teuthology.orchestra.run.smithi005.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-18T22:17:30.257 INFO:teuthology.orchestra.run.smithi005.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-18T22:17:30.258 INFO:teuthology.orchestra.run.smithi005.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-18T22:17:30.258 INFO:teuthology.orchestra.run.smithi005.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-18T22:17:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-18T22:17:30.258 INFO:teuthology.orchestra.run.smithi005.stdout:The following additional packages will be installed: 2024-08-18T22:17:30.259 INFO:teuthology.orchestra.run.smithi005.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-08-18T22:17:30.259 INFO:teuthology.orchestra.run.smithi005.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-08-18T22:17:30.259 INFO:teuthology.orchestra.run.smithi005.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-08-18T22:17:30.259 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-08-18T22:17:30.259 INFO:teuthology.orchestra.run.smithi005.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-18T22:17:30.260 INFO:teuthology.orchestra.run.smithi005.stdout:Suggested packages: 2024-08-18T22:17:30.261 INFO:teuthology.orchestra.run.smithi005.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-08-18T22:17:30.261 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-08-18T22:17:30.261 INFO:teuthology.orchestra.run.smithi005.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-18T22:17:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:The following NEW packages will be installed: 2024-08-18T22:17:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-08-18T22:17:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-08-18T22:17:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-08-18T22:17:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-08-18T22:17:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-08-18T22:17:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-08-18T22:17:30.321 INFO:teuthology.orchestra.run.smithi005.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-18T22:17:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages will be upgraded: 2024-08-18T22:17:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-08-18T22:17:30.331 INFO:teuthology.orchestra.run.smithi117.stdout:4 upgraded, 39 newly installed, 0 to remove and 319 not upgraded. 2024-08-18T22:17:30.331 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 55.7 MB of archives. 2024-08-18T22:17:30.331 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 203 MB of additional disk space will be used. 2024-08-18T22:17:30.331 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-08-18T22:17:30.380 INFO:teuthology.orchestra.run.smithi005.stdout:4 upgraded, 39 newly installed, 0 to remove and 319 not upgraded. 2024-08-18T22:17:30.380 INFO:teuthology.orchestra.run.smithi005.stdout:Need to get 55.7 MB of archives. 2024-08-18T22:17:30.380 INFO:teuthology.orchestra.run.smithi005.stdout:After this operation, 203 MB of additional disk space will be used. 2024-08-18T22:17:30.380 INFO:teuthology.orchestra.run.smithi005.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-08-18T22:17:30.521 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-08-18T22:17:30.524 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.17 [1,905 kB] 2024-08-18T22:17:30.550 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-08-18T22:17:30.551 INFO:teuthology.orchestra.run.smithi005.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-08-18T22:17:30.551 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-08-18T22:17:30.559 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-08-18T22:17:30.560 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-08-18T22:17:30.561 INFO:teuthology.orchestra.run.smithi005.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-08-18T22:17:30.562 INFO:teuthology.orchestra.run.smithi005.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-08-18T22:17:30.563 INFO:teuthology.orchestra.run.smithi005.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-08-18T22:17:30.564 INFO:teuthology.orchestra.run.smithi005.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-08-18T22:17:30.572 INFO:teuthology.orchestra.run.smithi005.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-08-18T22:17:30.572 INFO:teuthology.orchestra.run.smithi005.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-08-18T22:17:30.573 INFO:teuthology.orchestra.run.smithi005.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-08-18T22:17:30.589 INFO:teuthology.orchestra.run.smithi005.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-08-18T22:17:30.803 INFO:teuthology.orchestra.run.smithi005.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-08-18T22:17:30.805 INFO:teuthology.orchestra.run.smithi005.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-08-18T22:17:30.806 INFO:teuthology.orchestra.run.smithi005.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-08-18T22:17:30.808 INFO:teuthology.orchestra.run.smithi005.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-08-18T22:17:30.809 INFO:teuthology.orchestra.run.smithi005.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-08-18T22:17:30.813 INFO:teuthology.orchestra.run.smithi005.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.12-0ubuntu0.22.04.1 [149 kB] 2024-08-18T22:17:30.815 INFO:teuthology.orchestra.run.smithi005.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-08-18T22:17:30.823 INFO:teuthology.orchestra.run.smithi005.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-08-18T22:17:30.823 INFO:teuthology.orchestra.run.smithi005.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.17 [2,375 kB] 2024-08-18T22:17:30.845 INFO:teuthology.orchestra.run.smithi005.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-08-18T22:17:30.845 INFO:teuthology.orchestra.run.smithi005.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-08-18T22:17:30.857 INFO:teuthology.orchestra.run.smithi005.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-08-18T22:17:30.877 INFO:teuthology.orchestra.run.smithi005.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-08-18T22:17:30.880 INFO:teuthology.orchestra.run.smithi005.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-08-18T22:17:30.881 INFO:teuthology.orchestra.run.smithi005.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-08-18T22:17:30.882 INFO:teuthology.orchestra.run.smithi005.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-08-18T22:17:30.882 INFO:teuthology.orchestra.run.smithi005.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.12-0ubuntu0.22.04.1 [1,223 kB] 2024-08-18T22:17:30.893 INFO:teuthology.orchestra.run.smithi005.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-08-18T22:17:30.895 INFO:teuthology.orchestra.run.smithi005.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.12-0ubuntu0.22.04.1 [16.2 MB] 2024-08-18T22:17:30.952 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-08-18T22:17:30.968 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.17 [1,905 kB] 2024-08-18T22:17:31.043 INFO:teuthology.orchestra.run.smithi005.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-08-18T22:17:31.043 INFO:teuthology.orchestra.run.smithi005.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-08-18T22:17:31.043 INFO:teuthology.orchestra.run.smithi005.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-08-18T22:17:31.043 INFO:teuthology.orchestra.run.smithi005.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-08-18T22:17:31.043 INFO:teuthology.orchestra.run.smithi005.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-08-18T22:17:31.044 INFO:teuthology.orchestra.run.smithi005.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-08-18T22:17:31.056 INFO:teuthology.orchestra.run.smithi005.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-08-18T22:17:31.057 INFO:teuthology.orchestra.run.smithi005.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-08-18T22:17:31.092 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-08-18T22:17:31.093 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-08-18T22:17:31.094 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-08-18T22:17:31.122 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-08-18T22:17:31.124 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-08-18T22:17:31.127 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-08-18T22:17:31.129 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-08-18T22:17:31.130 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-08-18T22:17:31.132 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-08-18T22:17:31.196 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-08-18T22:17:31.196 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-08-18T22:17:31.196 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-08-18T22:17:31.277 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-08-18T22:17:31.460 INFO:teuthology.orchestra.run.smithi005.stdout:Preconfiguring packages ... 2024-08-18T22:17:31.612 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 55.7 MB in 1s (76.8 MB/s) 2024-08-18T22:17:31.898 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-08-18T22:17:31.902 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-18T22:17:31.957 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-08-18T22:17:31.959 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-08-18T22:17:31.959 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-08-18T22:17:31.962 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-08-18T22:17:31.962 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-08-18T22:17:31.966 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.12-0ubuntu0.22.04.1 [149 kB] 2024-08-18T22:17:31.968 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-08-18T22:17:32.016 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-08-18T22:17:32.016 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.17 [2,375 kB] 2024-08-18T22:17:32.042 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-18T22:17:32.093 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-08-18T22:17:32.099 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-08-18T22:17:32.110 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-08-18T22:17:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-08-18T22:17:32.189 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-08-18T22:17:32.190 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-08-18T22:17:32.191 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-08-18T22:17:32.191 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.12-0ubuntu0.22.04.1 [1,223 kB] 2024-08-18T22:17:32.208 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-08-18T22:17:32.210 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.12-0ubuntu0.22.04.1 [16.2 MB] 2024-08-18T22:17:32.669 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-08-18T22:17:32.690 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-08-18T22:17:32.690 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-08-18T22:17:32.690 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-08-18T22:17:32.691 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-08-18T22:17:32.691 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-08-18T22:17:32.691 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-08-18T22:17:32.747 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-08-18T22:17:32.748 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-08-18T22:17:33.134 INFO:teuthology.orchestra.run.smithi117.stdout:Preconfiguring packages ... 2024-08-18T22:17:33.291 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 55.7 MB in 3s (21.4 MB/s) 2024-08-18T22:17:33.526 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-08-18T22:17:33.530 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-18T22:17:33.706 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-18T22:17:33.812 INFO:teuthology.orchestra.run.smithi005.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-08-18T22:17:34.080 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package flex. 2024-08-18T22:17:34.155 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-08-18T22:17:34.159 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-08-18T22:17:34.228 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking flex (2.6.4-8build2) ... 2024-08-18T22:17:34.322 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-08-18T22:17:34.666 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-18T22:17:34.834 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.17) over (3.0.2-0ubuntu1.7) ... 2024-08-18T22:17:35.269 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-18T22:17:35.456 INFO:teuthology.orchestra.run.smithi117.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-08-18T22:17:35.736 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package flex. 2024-08-18T22:17:35.805 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-08-18T22:17:35.809 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-08-18T22:17:35.832 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-08-18T22:17:35.835 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-18T22:17:35.851 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking flex (2.6.4-8build2) ... 2024-08-18T22:17:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-18T22:17:36.371 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-18T22:17:36.464 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-18T22:17:36.541 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.17) over (3.0.2-0ubuntu1.7) ... 2024-08-18T22:17:36.599 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-18T22:17:36.932 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-18T22:17:37.016 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-18T22:17:37.333 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package bison. 2024-08-18T22:17:37.410 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-08-18T22:17:37.414 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-08-18T22:17:37.461 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-08-18T22:17:37.552 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-08-18T22:17:37.555 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-18T22:17:37.665 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-18T22:17:37.844 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-18T22:17:37.860 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-08-18T22:17:37.903 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-08-18T22:17:38.094 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-08-18T22:17:38.204 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-08-18T22:17:38.206 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package dump. 2024-08-18T22:17:38.222 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-08-18T22:17:38.264 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking dump (0.4b47-3) ... 2024-08-18T22:17:38.527 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-18T22:17:38.627 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package indent. 2024-08-18T22:17:38.643 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:38.693 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-18T22:17:38.913 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package bison. 2024-08-18T22:17:38.987 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-18T22:17:38.988 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-08-18T22:17:38.992 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-08-18T22:17:39.004 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-08-18T22:17:39.045 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-18T22:17:39.057 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-08-18T22:17:39.392 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-18T22:17:39.408 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-08-18T22:17:39.450 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-18T22:17:39.466 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-18T22:17:39.481 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-08-18T22:17:39.525 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-08-18T22:17:39.752 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-18T22:17:39.769 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-08-18T22:17:39.819 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-08-18T22:17:39.827 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package dump. 2024-08-18T22:17:39.843 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-08-18T22:17:39.877 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking dump (0.4b47-3) ... 2024-08-18T22:17:40.181 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libfl2:amd64. 2024-08-18T22:17:40.197 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-08-18T22:17:40.239 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-08-18T22:17:40.248 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package indent. 2024-08-18T22:17:40.263 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:40.339 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-18T22:17:40.525 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-08-18T22:17:40.542 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-08-18T22:17:40.584 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-18T22:17:40.617 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-18T22:17:40.633 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-08-18T22:17:40.675 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-18T22:17:40.819 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libjson-perl. 2024-08-18T22:17:40.836 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-08-18T22:17:40.877 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-08-18T22:17:40.996 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-18T22:17:41.011 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-08-18T22:17:41.046 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-18T22:17:41.200 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libllvm14:amd64. 2024-08-18T22:17:41.216 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-08-18T22:17:41.258 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-18T22:17:41.274 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-18T22:17:41.289 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-08-18T22:17:41.365 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-08-18T22:17:41.702 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libfl2:amd64. 2024-08-18T22:17:41.717 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-08-18T22:17:41.760 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-08-18T22:17:42.098 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-08-18T22:17:42.113 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-08-18T22:17:42.148 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-18T22:17:42.426 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjson-perl. 2024-08-18T22:17:42.442 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-08-18T22:17:42.484 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-08-18T22:17:42.661 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-18T22:17:42.678 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-18T22:17:42.719 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-18T22:17:42.795 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libllvm14:amd64. 2024-08-18T22:17:42.811 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-08-18T22:17:42.887 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-18T22:17:42.972 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-18T22:17:42.988 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-18T22:17:43.030 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-18T22:17:43.683 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-18T22:17:43.699 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-18T22:17:43.741 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-18T22:17:44.086 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-18T22:17:44.102 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-08-18T22:17:44.144 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-18T22:17:44.232 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-18T22:17:44.247 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-18T22:17:44.290 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-18T22:17:44.526 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-18T22:17:44.541 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-08-18T22:17:44.584 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-18T22:17:44.622 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-18T22:17:44.639 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-08-18T22:17:44.680 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-18T22:17:44.878 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-18T22:17:44.894 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-18T22:17:44.953 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-18T22:17:45.025 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libpq5:amd64. 2024-08-18T22:17:45.042 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../16-libpq5_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:45.084 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libpq5:amd64 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:17:45.289 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-18T22:17:45.306 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-08-18T22:17:45.356 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-18T22:17:45.436 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-18T22:17:45.453 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:45.520 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-18T22:17:45.718 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-18T22:17:45.734 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-08-18T22:17:45.776 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-18T22:17:45.822 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-18T22:17:45.838 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:45.881 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-18T22:17:46.100 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-18T22:17:46.116 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-18T22:17:46.137 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libpq5:amd64. 2024-08-18T22:17:46.150 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-18T22:17:46.152 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../16-libpq5_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:46.195 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libpq5:amd64 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:17:46.556 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-18T22:17:46.572 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:46.615 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-18T22:17:46.670 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-18T22:17:46.686 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-08-18T22:17:46.728 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-08-18T22:17:46.901 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-18T22:17:46.917 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:46.975 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-18T22:17:47.032 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package modemmanager. 2024-08-18T22:17:47.048 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-18T22:17:47.090 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-18T22:17:47.696 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-18T22:17:47.713 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.17_amd64.deb ... 2024-08-18T22:17:47.754 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-18T22:17:47.772 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package network-manager. 2024-08-18T22:17:47.788 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-08-18T22:17:47.839 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-08-18T22:17:48.242 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-18T22:17:48.256 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-08-18T22:17:48.292 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-08-18T22:17:48.396 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ppp. 2024-08-18T22:17:48.412 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-08-18T22:17:48.578 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package modemmanager. 2024-08-18T22:17:48.593 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-08-18T22:17:48.656 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-18T22:17:48.763 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-08-18T22:17:49.117 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package pptp-linux. 2024-08-18T22:17:49.133 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-08-18T22:17:49.176 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-08-18T22:17:49.326 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package network-manager. 2024-08-18T22:17:49.342 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-08-18T22:17:49.392 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-08-18T22:17:49.412 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-18T22:17:49.427 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-08-18T22:17:49.462 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-08-18T22:17:49.790 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-client-common. 2024-08-18T22:17:49.806 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-08-18T22:17:49.848 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-client-common (238) ... 2024-08-18T22:17:50.017 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ppp. 2024-08-18T22:17:50.033 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-08-18T22:17:50.152 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-client-14. 2024-08-18T22:17:50.168 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../27-postgresql-client-14_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:50.210 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-client-14 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:17:50.345 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-08-18T22:17:50.654 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package pptp-linux. 2024-08-18T22:17:50.669 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-08-18T22:17:50.746 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-08-18T22:17:50.782 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-common. 2024-08-18T22:17:50.797 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-08-18T22:17:50.859 INFO:teuthology.orchestra.run.smithi005.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-08-18T22:17:50.897 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-common (238) ... 2024-08-18T22:17:51.009 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-18T22:17:51.024 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-08-18T22:17:51.068 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-08-18T22:17:51.354 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-client-common. 2024-08-18T22:17:51.356 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-14. 2024-08-18T22:17:51.369 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-08-18T22:17:51.371 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../29-postgresql-14_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:51.403 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-client-common (238) ... 2024-08-18T22:17:51.417 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-14 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:17:51.707 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-client-14. 2024-08-18T22:17:51.723 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../27-postgresql-client-14_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:51.774 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-client-14 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:17:52.395 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-common. 2024-08-18T22:17:52.411 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-08-18T22:17:52.472 INFO:teuthology.orchestra.run.smithi117.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-08-18T22:17:52.502 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-common (238) ... 2024-08-18T22:17:52.517 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql. 2024-08-18T22:17:52.530 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-08-18T22:17:52.567 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql (14+238) ... 2024-08-18T22:17:52.803 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-client. 2024-08-18T22:17:52.817 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-08-18T22:17:52.853 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-client (14+238) ... 2024-08-18T22:17:52.995 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-14. 2024-08-18T22:17:53.010 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../29-postgresql-14_14.12-0ubuntu0.22.04.1_amd64.deb ... 2024-08-18T22:17:53.055 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-14 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:17:53.080 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-contrib. 2024-08-18T22:17:53.093 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-08-18T22:17:53.130 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-contrib (14+238) ... 2024-08-18T22:17:53.449 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package tcl8.6. 2024-08-18T22:17:53.466 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-08-18T22:17:53.507 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-18T22:17:53.811 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package tcl. 2024-08-18T22:17:53.829 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-08-18T22:17:53.874 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-08-18T22:17:54.188 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package wpasupplicant. 2024-08-18T22:17:54.204 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-08-18T22:17:54.246 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-18T22:17:54.255 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql. 2024-08-18T22:17:54.270 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-08-18T22:17:54.339 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql (14+238) ... 2024-08-18T22:17:54.582 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-client. 2024-08-18T22:17:54.597 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-08-18T22:17:54.609 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-18T22:17:54.625 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-08-18T22:17:54.640 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-client (14+238) ... 2024-08-18T22:17:54.668 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-08-18T22:17:54.910 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-contrib. 2024-08-18T22:17:54.925 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-08-18T22:17:54.959 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-contrib (14+238) ... 2024-08-18T22:17:55.071 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-18T22:17:55.087 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-08-18T22:17:55.138 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-18T22:17:55.246 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package tcl8.6. 2024-08-18T22:17:55.261 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-08-18T22:17:55.348 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-18T22:17:55.431 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-client-common (238) ... 2024-08-18T22:17:55.631 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package tcl. 2024-08-18T22:17:55.635 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up flex (2.6.4-8build2) ... 2024-08-18T22:17:55.646 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-08-18T22:17:55.694 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-08-18T22:17:55.786 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-18T22:17:55.912 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libpq5:amd64 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:17:56.038 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-08-18T22:17:56.051 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package wpasupplicant. 2024-08-18T22:17:56.067 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-08-18T22:17:56.109 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-18T22:17:56.164 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-18T22:17:56.290 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-client-14 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:17:56.446 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-18T22:17:56.462 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-08-18T22:17:56.496 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-08-18T22:17:56.916 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-18T22:17:56.932 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-08-18T22:17:56.983 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-18T22:17:57.250 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-08-18T22:17:57.259 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-client-common (238) ... 2024-08-18T22:17:57.346 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-18T22:17:57.505 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up flex (2.6.4-8build2) ... 2024-08-18T22:17:57.623 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-08-18T22:17:57.731 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-18T22:17:57.731 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-18T22:17:57.740 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libpq5:amd64 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:17:57.892 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-08-18T22:17:58.018 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-08-18T22:17:58.144 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-client-14 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:17:58.457 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-18T22:17:58.567 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-08-18T22:17:58.668 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-18T22:17:58.819 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-08-18T22:17:58.945 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-08-18T22:17:59.088 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-08-18T22:17:59.095 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-08-18T22:17:59.182 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-08-18T22:17:59.222 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-18T22:17:59.348 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-08-18T22:17:59.593 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-18T22:17:59.593 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-18T22:17:59.987 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-18T22:18:00.113 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up dump (0.4b47-3) ... 2024-08-18T22:18:00.208 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-18T22:18:00.264 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-18T22:18:00.294 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-08-18T22:18:00.390 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-18T22:18:00.518 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up tcl (8.6.11+1build2) ... 2024-08-18T22:18:00.643 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libjson-perl (4.04000-1) ... 2024-08-18T22:18:00.653 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-08-18T22:18:00.744 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-08-18T22:18:00.825 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-08-18T22:18:00.888 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.17) ... 2024-08-18T22:18:00.920 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-18T22:18:01.039 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-08-18T22:18:01.046 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-18T22:18:01.148 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-08-18T22:18:01.222 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-18T22:18:01.348 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-18T22:18:01.374 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-08-18T22:18:01.474 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-08-18T22:18:01.542 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-08-18T22:18:01.643 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-client (14+238) ... 2024-08-18T22:18:01.668 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-08-18T22:18:01.769 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-08-18T22:18:02.348 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-08-18T22:18:02.379 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:02.380 INFO:teuthology.orchestra.run.smithi005.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-18T22:18:02.380 INFO:teuthology.orchestra.run.smithi005.stdout:which means they are currently configured by ifupdown: 2024-08-18T22:18:02.380 INFO:teuthology.orchestra.run.smithi005.stdout:- ens1f0 2024-08-18T22:18:02.380 INFO:teuthology.orchestra.run.smithi005.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-18T22:18:02.380 INFO:teuthology.orchestra.run.smithi005.stdout:remove their configuration from /etc/network/interfaces. 2024-08-18T22:18:02.380 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:02.507 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up dump (0.4b47-3) ... 2024-08-18T22:18:02.519 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-18T22:18:02.602 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-18T22:18:02.667 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-08-18T22:18:02.928 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-18T22:18:03.160 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-08-18T22:18:03.286 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up tcl (8.6.11+1build2) ... 2024-08-18T22:18:03.356 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-18T22:18:03.412 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjson-perl (4.04000-1) ... 2024-08-18T22:18:03.529 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-08-18T22:18:03.636 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-08-18T22:18:03.698 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-08-18T22:18:03.823 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-08-18T22:18:04.008 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-08-18T22:18:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-18T22:18:04.159 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-08-18T22:18:04.285 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-08-18T22:18:04.453 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-client (14+238) ... 2024-08-18T22:18:04.564 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-18T22:18:04.579 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-08-18T22:18:04.723 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-08-18T22:18:04.849 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-common (238) ... 2024-08-18T22:18:05.168 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:05.168 INFO:teuthology.orchestra.run.smithi117.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-18T22:18:05.168 INFO:teuthology.orchestra.run.smithi117.stdout:which means they are currently configured by ifupdown: 2024-08-18T22:18:05.169 INFO:teuthology.orchestra.run.smithi117.stdout:- enp3s0f1 2024-08-18T22:18:05.169 INFO:teuthology.orchestra.run.smithi117.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-18T22:18:05.169 INFO:teuthology.orchestra.run.smithi117.stdout:remove their configuration from /etc/network/interfaces. 2024-08-18T22:18:05.169 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:05.301 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-18T22:18:05.707 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-18T22:18:05.802 INFO:teuthology.orchestra.run.smithi005.stdout:Adding user postgres to group ssl-cert 2024-08-18T22:18:06.064 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:06.064 INFO:teuthology.orchestra.run.smithi005.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-08-18T22:18:06.108 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-18T22:18:06.322 INFO:teuthology.orchestra.run.smithi005.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-08-18T22:18:06.322 INFO:teuthology.orchestra.run.smithi005.stdout:Removing obsolete dictionary files: 2024-08-18T22:18:06.790 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-08-18T22:18:06.950 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-08-18T22:18:07.060 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-08-18T22:18:07.076 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-08-18T22:18:07.226 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-common (238) ... 2024-08-18T22:18:07.543 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-14 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:18:07.900 INFO:teuthology.orchestra.run.smithi005.stdout:Creating new PostgreSQL cluster 14/main ... 2024-08-18T22:18:07.919 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-08-18T22:18:07.961 INFO:teuthology.orchestra.run.smithi005.stdout:The files belonging to this database system will be owned by user "postgres". 2024-08-18T22:18:07.961 INFO:teuthology.orchestra.run.smithi005.stdout:This user must also own the server process. 2024-08-18T22:18:07.961 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:07.961 INFO:teuthology.orchestra.run.smithi005.stdout:The database cluster will be initialized with locale "en_US". 2024-08-18T22:18:07.961 INFO:teuthology.orchestra.run.smithi005.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-08-18T22:18:07.962 INFO:teuthology.orchestra.run.smithi005.stdout:The default text search configuration will be set to "english". 2024-08-18T22:18:07.962 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:07.962 INFO:teuthology.orchestra.run.smithi005.stdout:Data page checksums are disabled. 2024-08-18T22:18:07.962 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:07.962 INFO:teuthology.orchestra.run.smithi005.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-08-18T22:18:07.962 INFO:teuthology.orchestra.run.smithi005.stdout:creating subdirectories ... ok 2024-08-18T22:18:07.962 INFO:teuthology.orchestra.run.smithi005.stdout:selecting dynamic shared memory implementation ... posix 2024-08-18T22:18:07.987 INFO:teuthology.orchestra.run.smithi005.stdout:selecting default max_connections ... 100 2024-08-18T22:18:08.022 INFO:teuthology.orchestra.run.smithi005.stdout:selecting default shared_buffers ... 128MB 2024-08-18T22:18:08.037 INFO:teuthology.orchestra.run.smithi005.stdout:selecting default time zone ... Etc/UTC 2024-08-18T22:18:08.038 INFO:teuthology.orchestra.run.smithi005.stdout:creating configuration files ... ok 2024-08-18T22:18:08.213 INFO:teuthology.orchestra.run.smithi005.stdout:running bootstrap script ... ok 2024-08-18T22:18:08.214 INFO:teuthology.orchestra.run.smithi117.stdout:Adding user postgres to group ssl-cert 2024-08-18T22:18:08.457 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:08.457 INFO:teuthology.orchestra.run.smithi117.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-08-18T22:18:08.699 INFO:teuthology.orchestra.run.smithi117.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-08-18T22:18:08.699 INFO:teuthology.orchestra.run.smithi117.stdout:Removing obsolete dictionary files: 2024-08-18T22:18:08.853 INFO:teuthology.orchestra.run.smithi005.stdout:performing post-bootstrap initialization ... ok 2024-08-18T22:18:09.420 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-08-18T22:18:09.436 INFO:teuthology.orchestra.run.smithi005.stdout:syncing data to disk ... ok 2024-08-18T22:18:09.902 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-14 (14.12-0ubuntu0.22.04.1) ... 2024-08-18T22:18:09.966 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-08-18T22:18:10.402 INFO:teuthology.orchestra.run.smithi117.stdout:Creating new PostgreSQL cluster 14/main ... 2024-08-18T22:18:10.419 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-08-18T22:18:10.468 INFO:teuthology.orchestra.run.smithi117.stdout:The files belonging to this database system will be owned by user "postgres". 2024-08-18T22:18:10.468 INFO:teuthology.orchestra.run.smithi117.stdout:This user must also own the server process. 2024-08-18T22:18:10.469 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:10.469 INFO:teuthology.orchestra.run.smithi117.stdout:The database cluster will be initialized with locale "en_US". 2024-08-18T22:18:10.469 INFO:teuthology.orchestra.run.smithi117.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-08-18T22:18:10.469 INFO:teuthology.orchestra.run.smithi117.stdout:The default text search configuration will be set to "english". 2024-08-18T22:18:10.469 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:10.469 INFO:teuthology.orchestra.run.smithi117.stdout:Data page checksums are disabled. 2024-08-18T22:18:10.469 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:10.469 INFO:teuthology.orchestra.run.smithi117.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-08-18T22:18:10.470 INFO:teuthology.orchestra.run.smithi117.stdout:creating subdirectories ... ok 2024-08-18T22:18:10.470 INFO:teuthology.orchestra.run.smithi117.stdout:selecting dynamic shared memory implementation ... posix 2024-08-18T22:18:10.494 INFO:teuthology.orchestra.run.smithi117.stdout:selecting default max_connections ... 100 2024-08-18T22:18:10.527 INFO:teuthology.orchestra.run.smithi117.stdout:selecting default shared_buffers ... 128MB 2024-08-18T22:18:10.541 INFO:teuthology.orchestra.run.smithi117.stdout:selecting default time zone ... Etc/UTC 2024-08-18T22:18:10.541 INFO:teuthology.orchestra.run.smithi117.stdout:creating configuration files ... ok 2024-08-18T22:18:10.704 INFO:teuthology.orchestra.run.smithi117.stdout:running bootstrap script ... ok 2024-08-18T22:18:11.319 INFO:teuthology.orchestra.run.smithi117.stdout:performing post-bootstrap initialization ... ok 2024-08-18T22:18:11.878 INFO:teuthology.orchestra.run.smithi117.stdout:syncing data to disk ... ok 2024-08-18T22:18:12.376 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-08-18T22:18:13.018 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-18T22:18:13.118 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-contrib (14+238) ... 2024-08-18T22:18:13.244 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql (14+238) ... 2024-08-18T22:18:13.404 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-18T22:18:13.530 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-18T22:18:13.798 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-18T22:18:13.799 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-18T22:18:14.757 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-18T22:18:14.849 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-18T22:18:15.235 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-18T22:18:15.394 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-08-18T22:18:15.412 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-18T22:18:15.527 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-contrib (14+238) ... 2024-08-18T22:18:15.653 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql (14+238) ... 2024-08-18T22:18:15.754 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-08-18T22:18:15.896 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-08-18T22:18:16.157 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-18T22:18:16.157 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-18T22:18:16.890 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-08-18T22:18:16.941 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-18T22:18:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-18T22:18:17.033 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-18T22:18:17.344 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-18T22:18:17.529 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-18T22:18:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-18T22:18:17.579 DEBUG:teuthology.parallel:result is None 2024-08-18T22:18:19.231 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-08-18T22:18:19.331 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-18T22:18:19.928 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-18T22:18:19.934 DEBUG:teuthology.parallel:result is None 2024-08-18T22:18:19.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:18:20.084 DEBUG:teuthology.orchestra.run.smithi005:> dpkg-query -W -f '${Version}' ceph 2024-08-18T22:18:20.109 INFO:teuthology.orchestra.run.smithi005.stdout:19.1.0-1382-gde09dd01-1jammy 2024-08-18T22:18:20.109 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382-gde09dd01-1jammy 2024-08-18T22:18:20.110 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382-gde09dd01-1jammy is installed. 2024-08-18T22:18:20.112 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:18:20.254 DEBUG:teuthology.orchestra.run.smithi117:> dpkg-query -W -f '${Version}' ceph 2024-08-18T22:18:20.276 INFO:teuthology.orchestra.run.smithi117.stdout:19.1.0-1382-gde09dd01-1jammy 2024-08-18T22:18:20.276 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382-gde09dd01-1jammy 2024-08-18T22:18:20.276 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382-gde09dd01-1jammy is installed. 2024-08-18T22:18:20.279 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-18T22:18:20.280 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:20.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-18T22:18:20.303 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:20.303 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-18T22:18:20.342 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-18T22:18:20.342 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:20.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-08-18T22:18:20.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-18T22:18:20.429 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:20.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-08-18T22:18:20.448 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-18T22:18:20.512 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-18T22:18:20.513 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:20.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-18T22:18:20.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-18T22:18:20.602 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:20.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-18T22:18:20.621 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-18T22:18:20.680 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-18T22:18:20.680 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:20.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-08-18T22:18:20.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-18T22:18:20.765 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:20.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-08-18T22:18:20.784 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-18T22:18:20.845 INFO:teuthology.run_tasks:Running task ceph... 2024-08-18T22:18:20.936 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-18T22:18:20.937 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2024-08-18T22:18:20.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-08-18T22:18:20.961 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-18T22:18:20.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-18T22:18:21.003 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-18T22:18:21.023 INFO:tasks.ceph:Creating extra log directories... 2024-08-18T22:18:21.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-18T22:18:21.067 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-18T22:18:21.092 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-18T22:18:21.093 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-18T22:18:21.093 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-18T22:18:21.093 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:21.093 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-18T22:18:21.137 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-18T22:18:21.231 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:21.231 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-18T22:18:21.240 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-18T22:18:21.332 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-18T22:18:21.332 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-18T22:18:21.333 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7859915', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '78215f5a1cf5eaf321d506a66539942e12851f34'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1664, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'sleep_before_teardown': 0, 'subset': '36/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '78215f5a1cf5eaf321d506a66539942e12851f34', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD0b0saleYItaILWLjq1KzkQ+CNi7whRI4dS93Rao0Xh0VpFUA7HuBXiYV6rB8MqcBuFNNcDNlCF0RXRpTFzmBg=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNnw/k1GdJVGwyUJOYw1ayi6+u2cBEMyVvvY4gmAAD0SHvZXPJtvymUOFGQJvmkKxMkDLcAW5zALlJaif3x4Fbc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-18_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-18T22:18:21.333 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-18T22:18:21.336 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-18T22:18:21.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2024-08-18T22:18:21.391 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-08-18T22:18:21.411 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:21.411 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-08-18T22:18:21.465 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-18T22:18:21.465 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-08-18T22:18:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-18T22:18:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:18:21.521 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-08-18T22:18:21.521 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:18:21.521 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-18 22:11:43.516348628 +0000 2024-08-18T22:18:21.521 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-18 22:11:43.248351019 +0000 2024-08-18T22:18:21.521 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-18 22:11:43.248351019 +0000 2024-08-18T22:18:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-18 22:11:43.248351019 +0000 2024-08-18T22:18:21.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-18T22:18:21.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:18:21.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:18:21.583 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000278753 s, 1.8 MB/s 2024-08-18T22:18:21.585 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-18T22:18:21.639 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-08-18T22:18:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-18T22:18:21.689 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:18:21.690 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-08-18T22:18:21.690 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:18:21.690 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-18 22:11:44.072343668 +0000 2024-08-18T22:18:21.690 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-18 22:11:43.796346130 +0000 2024-08-18T22:18:21.690 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-18 22:11:43.796346130 +0000 2024-08-18T22:18:21.690 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-18 22:11:43.796346130 +0000 2024-08-18T22:18:21.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-18T22:18:21.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:18:21.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:18:21.756 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000269365 s, 1.9 MB/s 2024-08-18T22:18:21.758 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-18T22:18:21.816 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-08-18T22:18:21.869 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-18T22:18:21.870 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:18:21.870 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 933 Links: 1 2024-08-18T22:18:21.870 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:18:21.870 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-18 22:11:44.672338315 +0000 2024-08-18T22:18:21.870 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-18 22:11:44.388340849 +0000 2024-08-18T22:18:21.870 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-18 22:11:44.388340849 +0000 2024-08-18T22:18:21.870 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-18 22:11:44.388340849 +0000 2024-08-18T22:18:21.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-18T22:18:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:18:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:18:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000265964 s, 1.9 MB/s 2024-08-18T22:18:21.933 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-18T22:18:21.987 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-08-18T22:18:22.037 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-18T22:18:22.037 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:18:22.037 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 949 Links: 1 2024-08-18T22:18:22.038 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:18:22.038 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-18 22:11:45.264333033 +0000 2024-08-18T22:18:22.038 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-18 22:11:44.988335496 +0000 2024-08-18T22:18:22.038 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-18 22:11:44.988335496 +0000 2024-08-18T22:18:22.038 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-18 22:11:44.988335496 +0000 2024-08-18T22:18:22.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-18T22:18:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:18:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:18:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000260273 s, 2.0 MB/s 2024-08-18T22:18:22.101 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-18T22:18:22.159 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-18T22:18:22.159 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:22.159 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-08-18T22:18:22.168 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-18T22:18:22.168 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-08-18T22:18:22.218 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-18T22:18:22.219 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:18:22.219 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 884 Links: 1 2024-08-18T22:18:22.219 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:18:22.219 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-08-18 22:11:42.308334614 +0000 2024-08-18T22:18:22.219 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-08-18 22:11:42.044336973 +0000 2024-08-18T22:18:22.219 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-08-18 22:11:42.044336973 +0000 2024-08-18T22:18:22.219 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-08-18 22:11:42.044336973 +0000 2024-08-18T22:18:22.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-18T22:18:22.280 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-08-18T22:18:22.280 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-08-18T22:18:22.281 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000661837 s, 774 kB/s 2024-08-18T22:18:22.282 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-18T22:18:22.336 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-08-18T22:18:22.386 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-18T22:18:22.386 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:18:22.386 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 903 Links: 1 2024-08-18T22:18:22.387 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:18:22.387 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-08-18 22:11:42.868329612 +0000 2024-08-18T22:18:22.387 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-08-18 22:11:42.612331899 +0000 2024-08-18T22:18:22.387 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-08-18 22:11:42.612331899 +0000 2024-08-18T22:18:22.387 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-08-18 22:11:42.612331899 +0000 2024-08-18T22:18:22.387 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-18T22:18:22.448 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-08-18T22:18:22.449 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-08-18T22:18:22.449 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000383887 s, 1.3 MB/s 2024-08-18T22:18:22.450 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-18T22:18:22.504 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-08-18T22:18:22.555 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-18T22:18:22.555 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:18:22.555 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 917 Links: 1 2024-08-18T22:18:22.555 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:18:22.555 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-08-18 22:11:43.424324646 +0000 2024-08-18T22:18:22.556 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-08-18 22:11:43.172326897 +0000 2024-08-18T22:18:22.556 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-08-18 22:11:43.172326897 +0000 2024-08-18T22:18:22.556 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-08-18 22:11:43.172326897 +0000 2024-08-18T22:18:22.556 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-18T22:18:22.616 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-08-18T22:18:22.616 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-08-18T22:18:22.617 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000376571 s, 1.4 MB/s 2024-08-18T22:18:22.618 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-18T22:18:22.673 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-08-18T22:18:22.726 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-18T22:18:22.727 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:18:22.727 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 936 Links: 1 2024-08-18T22:18:22.727 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:18:22.727 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-08-18 22:11:43.740321824 +0000 2024-08-18T22:18:22.727 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-08-18 22:11:43.736321860 +0000 2024-08-18T22:18:22.727 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-08-18 22:11:43.736321860 +0000 2024-08-18T22:18:22.727 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-08-18 22:11:43.736321860 +0000 2024-08-18T22:18:22.727 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-18T22:18:22.788 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-08-18T22:18:22.788 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-08-18T22:18:22.789 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000392506 s, 1.3 MB/s 2024-08-18T22:18:22.790 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-18T22:18:22.844 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-18T22:18:22.845 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-18T22:18:22.845 INFO:tasks.ceph:Generating config... 2024-08-18T22:18:22.846 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-18T22:18:22.846 INFO:tasks.ceph:[client] debug client = 20 2024-08-18T22:18:22.846 INFO:tasks.ceph:[client] debug ms = 1 2024-08-18T22:18:22.847 INFO:tasks.ceph:[client] pid file = 2024-08-18T22:18:22.847 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-18T22:18:22.847 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-18T22:18:22.847 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-18T22:18:22.847 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-18T22:18:22.847 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-18T22:18:22.847 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-18T22:18:22.847 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-08-18T22:18:22.847 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-18T22:18:22.847 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-18T22:18:22.847 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-08-18T22:18:22.847 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-18T22:18:22.847 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-18T22:18:22.848 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-08-18T22:18:22.848 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-18T22:18:22.848 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-18T22:18:22.848 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-08-18T22:18:22.849 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-08-18T22:18:22.849 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-18T22:18:22.849 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-18T22:18:22.849 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-08-18T22:18:22.849 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-18T22:18:22.849 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-18T22:18:22.849 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-18T22:18:22.849 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-18T22:18:22.849 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-18T22:18:22.850 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-18T22:18:22.850 INFO:tasks.ceph:Setting up mon.a... 2024-08-18T22:18:22.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-18T22:18:22.896 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2024-08-18T22:18:22.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-18T22:18:23.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-18T22:18:23.026 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.117'), ('mon.c', '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]')] 2024-08-18T22:18:23.027 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-18T22:18:23.027 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:23.028 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-18T22:18:23.080 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.117 --addv c '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:23.176 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:23.176 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid f2affb9c-c71f-418c-b271-e1d1f0126ce6 2024-08-18T22:18:23.176 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = quincy 2024-08-18T22:18:23.176 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2024-08-18T22:18:23.176 INFO:teuthology.orchestra.run.smithi005.stdout:fsid f2affb9c-c71f-418c-b271-e1d1f0126ce6 2024-08-18T22:18:23.176 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2024-08-18T22:18:23.177664+0000 2024-08-18T22:18:23.176 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-08-18T22:18:23.177664+0000 2024-08-18T22:18:23.176 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 17 (quincy) 2024-08-18T22:18:23.177 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2024-08-18T22:18:23.177 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-18T22:18:23.177 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-08-18T22:18:23.177 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] mon.c 2024-08-18T22:18:23.177 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-18T22:18:23.179 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-18T22:18:23.187 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f2affb9c-c71f-418c-b271-e1d1f0126ce6... 2024-08-18T22:18:23.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-18T22:18:23.235 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-18T22:18:23.275 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-08-18T22:18:23.275 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-08-18T22:18:23.275 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-18T22:18:23.275 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-08-18T22:18:23.275 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.275 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-08-18T22:18:23.275 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.275 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.276 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.277 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = f2affb9c-c71f-418c-b271-e1d1f0126ce6 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-08-18T22:18:23.278 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug trim objects = true 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-08-18T22:18:23.279 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-08-18T22:18:23.280 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:18:23.281 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-08-18T22:18:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-18T22:18:23.283 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: mon down mkfs grace = 300 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-08-18T22:18:23.284 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-08-18T22:18:23.285 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: mds cache max size = 1000 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: mds log max segments = 1 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-08-18T22:18:23.286 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-08-18T22:18:23.287 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-08-18T22:18:23.287 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-08-18T22:18:23.287 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-18T22:18:23.287 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-08-18T22:18:23.287 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.287 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-08-18T22:18:23.287 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.287 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-08-18T22:18:23.287 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-08-18T22:18:23.288 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.289 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.5,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on skipped message = False 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = f2affb9c-c71f-418c-b271-e1d1f0126ce6 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.290 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.291 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-08-18T22:18:23.292 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:18:23.293 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-08-18T22:18:23.294 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-08-18T22:18:23.294 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-08-18T22:18:23.294 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:18:23.294 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:18:23.294 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-08-18T22:18:23.294 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-08-18T22:18:23.294 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.294 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-08-18T22:18:23.294 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:18:23.294 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.295 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout: mon down mkfs grace = 300 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on pool no app = False 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:18:23.296 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-08-18T22:18:23.297 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-08-18T22:18:23.297 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-08-18T22:18:23.297 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-08-18T22:18:23.297 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-18T22:18:23.297 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-18T22:18:23.297 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-08-18T22:18:23.297 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-08-18T22:18:23.297 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-08-18T22:18:23.298 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:18:23.299 INFO:teuthology.orchestra.run.smithi117.stdout: mds cache max size = 1000 2024-08-18T22:18:23.299 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-08-18T22:18:23.299 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2024-08-18T22:18:23.299 INFO:teuthology.orchestra.run.smithi117.stdout: mds log max segments = 1 2024-08-18T22:18:23.299 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-08-18T22:18:23.299 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2024-08-18T22:18:23.299 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-08-18T22:18:23.299 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-08-18T22:18:23.299 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-08-18T22:18:23.300 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-18T22:18:23.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-18T22:18:23.401 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-18T22:18:23.401 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:23.401 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-18T22:18:23.410 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:23.410 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-18T22:18:23.460 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:18:23.460 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:23.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-18T22:18:23.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-18T22:18:23.531 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:23.532 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:23.580 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:18:23.580 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:23.581 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-18T22:18:23.581 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-18T22:18:23.615 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:23.615 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:23.666 INFO:tasks.ceph:Setting up mon nodes... 2024-08-18T22:18:23.666 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-18T22:18:23.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-18T22:18:23.721 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-18T22:18:23.726 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-18T22:18:23.785 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-18T22:18:23.804 INFO:tasks.ceph:Setting up mds nodes... 2024-08-18T22:18:23.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-18T22:18:23.859 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-18T22:18:23.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-18T22:18:23.883 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-18T22:18:23.983 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-18T22:18:23.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-18T22:18:24.007 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-18T22:18:24.066 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-18T22:18:24.068 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-18T22:18:24.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-18T22:18:24.184 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-18T22:18:24.189 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-18T22:18:24.207 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-18T22:18:24.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-18T22:18:24.251 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-18T22:18:24.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-18T22:18:24.350 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-18T22:18:24.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-18T22:18:24.407 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-18T22:18:24.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-18T22:18:24.506 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-18T22:18:24.522 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-18T22:18:24.522 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-18T22:18:24.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-18T22:18:24.542 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-18T22:18:24.542 INFO:tasks.ceph:role: osd.0 2024-08-18T22:18:24.542 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:18:24.542 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-18T22:18:24.603 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T22:18:24.603 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T22:18:24.603 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T22:18:24.604 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T22:18:24.604 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T22:18:24.604 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-18T22:18:24.604 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T22:18:24.604 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T22:18:24.604 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T22:18:24.604 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T22:18:24.629 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-18T22:18:24.631 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-18T22:18:24.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-18T22:18:24.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-18T22:18:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T22:18:24.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:18:24.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-18T22:18:24.819 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-18T22:18:24.819 INFO:tasks.ceph:role: osd.1 2024-08-18T22:18:24.819 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:18:24.819 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-18T22:18:24.878 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T22:18:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T22:18:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T22:18:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T22:18:24.879 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T22:18:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-18T22:18:24.879 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T22:18:24.879 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T22:18:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T22:18:24.879 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T22:18:24.903 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-18T22:18:24.906 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-18T22:18:24.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-18T22:18:24.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-18T22:18:25.027 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T22:18:25.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:18:25.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-18T22:18:25.091 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-18T22:18:25.091 INFO:tasks.ceph:role: osd.2 2024-08-18T22:18:25.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:18:25.091 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-18T22:18:25.150 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T22:18:25.151 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T22:18:25.151 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T22:18:25.151 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T22:18:25.151 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T22:18:25.151 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-18T22:18:25.151 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T22:18:25.151 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T22:18:25.151 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T22:18:25.151 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T22:18:25.175 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-18T22:18:25.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-18T22:18:25.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-18T22:18:25.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-18T22:18:25.303 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T22:18:25.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:18:25.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-18T22:18:25.367 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-18T22:18:25.367 INFO:tasks.ceph:role: osd.3 2024-08-18T22:18:25.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:18:25.367 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-18T22:18:25.427 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T22:18:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T22:18:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T22:18:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T22:18:25.428 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T22:18:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-08-18T22:18:25.428 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T22:18:25.428 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T22:18:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T22:18:25.428 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T22:18:25.452 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-08-18T22:18:25.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-08-18T22:18:25.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-18T22:18:25.524 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-18T22:18:25.584 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T22:18:25.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:18:25.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:25.713+0000 7ffb627637c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-18T22:18:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:25.713+0000 7ffb627637c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-18T22:18:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:25.713+0000 7ffb627637c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-18T22:18:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:25.713+0000 7ffb627637c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-18T22:18:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:25.713+0000 7ffb627637c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-18T22:18:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:25.717+0000 7ffb627637c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-18T22:18:28.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-18T22:18:28.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:28.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:28.900+0000 7fbd8e7ef7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-18T22:18:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:28.900+0000 7fbd8e7ef7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-18T22:18:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:28.900+0000 7fbd8e7ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-18T22:18:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:28.900+0000 7fbd8e7ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-18T22:18:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:28.900+0000 7fbd8e7ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-18T22:18:28.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:28.904+0000 7fbd8e7ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-18T22:18:31.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-18T22:18:31.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:32.056+0000 7f10e648a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-18T22:18:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:32.056+0000 7f10e648a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-18T22:18:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:32.056+0000 7f10e648a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-18T22:18:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:32.056+0000 7f10e648a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-18T22:18:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:32.056+0000 7f10e648a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-18T22:18:32.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:32.060+0000 7f10e648a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-18T22:18:35.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-18T22:18:35.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:35.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:35.208+0000 7fdef31fd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-18T22:18:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:35.212+0000 7fdef31fd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-18T22:18:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:35.212+0000 7fdef31fd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-18T22:18:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:35.212+0000 7fdef31fd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-18T22:18:35.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:35.212+0000 7fdef31fd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-18T22:18:35.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:35.212+0000 7fdef31fd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-18T22:18:38.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-18T22:18:38.304 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-18T22:18:38.326 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-18T22:18:38.327 INFO:tasks.ceph:role: osd.4 2024-08-18T22:18:38.327 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:18:38.327 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-18T22:18:38.403 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T22:18:38.403 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T22:18:38.403 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T22:18:38.403 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T22:18:38.403 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T22:18:38.404 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-08-18T22:18:38.404 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T22:18:38.404 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T22:18:38.404 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T22:18:38.404 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T22:18:38.804 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-08-18T22:18:38.806 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-08-18T22:18:38.807 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-18T22:18:38.907 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-18T22:18:38.923 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T22:18:38.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:18:38.925 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-18T22:18:38.989 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-18T22:18:38.989 INFO:tasks.ceph:role: osd.5 2024-08-18T22:18:38.989 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:18:38.989 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-18T22:18:39.061 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T22:18:39.062 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T22:18:39.062 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T22:18:39.062 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T22:18:39.062 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T22:18:39.062 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-08-18T22:18:39.062 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T22:18:39.062 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T22:18:39.062 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T22:18:39.062 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T22:18:39.470 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-08-18T22:18:39.473 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-08-18T22:18:39.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-18T22:18:39.610 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-18T22:18:39.627 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T22:18:39.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:18:39.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-18T22:18:39.690 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-18T22:18:39.691 INFO:tasks.ceph:role: osd.6 2024-08-18T22:18:39.691 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:18:39.691 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-18T22:18:39.762 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T22:18:39.762 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T22:18:39.762 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T22:18:39.762 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T22:18:39.762 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T22:18:39.762 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-08-18T22:18:39.762 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T22:18:39.762 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T22:18:39.763 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T22:18:39.763 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T22:18:40.185 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-08-18T22:18:40.188 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-08-18T22:18:40.189 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-18T22:18:40.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-18T22:18:40.351 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T22:18:40.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:18:40.352 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-18T22:18:40.414 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-18T22:18:40.414 INFO:tasks.ceph:role: osd.7 2024-08-18T22:18:40.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:18:40.415 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-18T22:18:40.486 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T22:18:40.486 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T22:18:40.486 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T22:18:40.487 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-08-18T22:18:40.487 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T22:18:40.487 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-08-18T22:18:40.487 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T22:18:40.487 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-18T22:18:40.487 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T22:18:40.487 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T22:18:40.852 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-08-18T22:18:40.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-08-18T22:18:40.855 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-18T22:18:40.943 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-18T22:18:40.959 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-08-18T22:18:40.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:18:40.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:41.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:41.083+0000 7f36e3b867c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-18T22:18:41.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:41.087+0000 7f36e3b867c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-18T22:18:41.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:41.087+0000 7f36e3b867c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-18T22:18:41.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:41.087+0000 7f36e3b867c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-18T22:18:41.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:41.087+0000 7f36e3b867c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-18T22:18:41.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:41.091+0000 7f36e3b867c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-18T22:18:44.121 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-18T22:18:44.141 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:44.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:44.235+0000 7f9970bc27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-18T22:18:44.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:44.235+0000 7f9970bc27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-18T22:18:44.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:44.235+0000 7f9970bc27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-18T22:18:44.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:44.235+0000 7f9970bc27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-18T22:18:44.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:44.235+0000 7f9970bc27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-18T22:18:44.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:44.239+0000 7f9970bc27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-18T22:18:47.276 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-18T22:18:47.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:47.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:47.387+0000 7f7354fa97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-18T22:18:47.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:47.387+0000 7f7354fa97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-18T22:18:47.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:47.387+0000 7f7354fa97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-18T22:18:47.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:47.387+0000 7f7354fa97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-18T22:18:47.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:47.387+0000 7f7354fa97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-18T22:18:47.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:47.387+0000 7f7354fa97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-18T22:18:50.411 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-18T22:18:50.431 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:50.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:50.523+0000 7f0b625ad7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-18T22:18:50.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:50.523+0000 7f0b625ad7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-18T22:18:50.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:50.523+0000 7f0b625ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-18T22:18:50.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:50.523+0000 7f0b625ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-18T22:18:50.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:50.523+0000 7f0b625ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-18T22:18:50.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:50.523+0000 7f0b625ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-18T22:18:51.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:18:51.338 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:18:53.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-18T22:18:53.582 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-18T22:18:53.583 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:53.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-18T22:18:53.605 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:53.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-18T22:18:53.673 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:53.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-18T22:18:53.741 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:53.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-18T22:18:53.809 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:53.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-18T22:18:53.877 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:53.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-18T22:18:53.945 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:53.945 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-18T22:18:54.009 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:54.009 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-18T22:18:54.030 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:54.030 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-18T22:18:54.095 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:54.095 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-18T22:18:54.158 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:54.158 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-18T22:18:54.226 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:54.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-18T22:18:54.285 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:54.285 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-18T22:18:54.345 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:54.345 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-18T22:18:54.405 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:54.406 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-18T22:18:54.414 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:54.415 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-18T22:18:54.468 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:54.468 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-18T22:18:54.476 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:54.477 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-18T22:18:54.530 INFO:tasks.ceph:Adding keys to all mons... 2024-08-18T22:18:54.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-18T22:18:54.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-18T22:18:54.577 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2024-08-18T22:18:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w== 2024-08-18T22:18:54.577 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-08-18T22:18:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw== 2024-08-18T22:18:54.577 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw== 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw== 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA== 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA== 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A== 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g== 2024-08-18T22:18:54.578 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow== 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg== 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA== 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg== 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg== 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A== 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:18:54.579 INFO:teuthology.orchestra.run.smithi005.stdout:[client.2] 2024-08-18T22:18:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug== 2024-08-18T22:18:54.580 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2024-08-18T22:18:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg== 2024-08-18T22:18:54.580 INFO:teuthology.orchestra.run.smithi005.stdout:[client.3] 2024-08-18T22:18:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ== 2024-08-18T22:18:54.592 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2024-08-18T22:18:54.592 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w== 2024-08-18T22:18:54.592 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-08-18T22:18:54.592 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw== 2024-08-18T22:18:54.592 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-08-18T22:18:54.592 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw== 2024-08-18T22:18:54.592 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2024-08-18T22:18:54.592 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw== 2024-08-18T22:18:54.592 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2024-08-18T22:18:54.592 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA== 2024-08-18T22:18:54.592 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA== 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A== 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g== 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow== 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg== 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA== 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg== 2024-08-18T22:18:54.593 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2024-08-18T22:18:54.594 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg== 2024-08-18T22:18:54.594 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2024-08-18T22:18:54.594 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A== 2024-08-18T22:18:54.594 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-08-18T22:18:54.594 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:18:54.594 INFO:teuthology.orchestra.run.smithi117.stdout:[client.2] 2024-08-18T22:18:54.594 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug== 2024-08-18T22:18:54.594 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2024-08-18T22:18:54.594 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg== 2024-08-18T22:18:54.594 INFO:teuthology.orchestra.run.smithi117.stdout:[client.3] 2024-08-18T22:18:54.594 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ== 2024-08-18T22:18:54.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-18T22:18:54.631 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-18T22:18:54.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T22:18:54.699 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T22:18:54.756 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T22:18:54.760 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T22:18:54.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:54.821 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:54.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:54.876 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:54.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:54.932 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:54.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:54.990 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:55.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-18T22:18:55.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-18T22:18:55.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T22:18:55.101 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T22:18:55.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T22:18:55.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T22:18:55.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:55.218 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:55.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:55.274 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:55.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:55.330 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:55.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:55.386 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T22:18:55.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T22:18:55.442 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T22:18:55.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T22:18:55.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T22:18:55.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T22:18:55.558 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T22:18:55.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T22:18:55.617 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T22:18:55.673 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-18T22:18:55.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-18T22:18:55.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T22:18:55.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-18T22:18:55.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-18T22:18:55.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T22:18:55.953 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-18T22:18:55.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-18T22:18:56.032 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T22:18:56.137 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-18T22:18:56.156 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:56.159 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-18T22:18:56.205 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-18T22:18:56.205 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-18T22:18:56.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-18T22:18:56.212 INFO:tasks.ceph.mon.a:Started 2024-08-18T22:18:56.213 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-18T22:18:56.213 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-18T22:18:56.248 INFO:tasks.ceph.mon.b:Started 2024-08-18T22:18:56.249 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-18T22:18:56.249 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-18T22:18:56.251 INFO:tasks.ceph.mon.c:Started 2024-08-18T22:18:56.252 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-18T22:18:56.252 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-18T22:18:56.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-18T22:18:56.255 INFO:tasks.ceph.mgr.y:Started 2024-08-18T22:18:56.255 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-18T22:18:56.255 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-18T22:18:56.258 INFO:tasks.ceph.mgr.x:Started 2024-08-18T22:18:56.258 INFO:tasks.ceph:Setting crush tunables to default 2024-08-18T22:18:56.259 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2024-08-18T22:18:56.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.400+0000 7f6d22600640 1 Processor -- start 2024-08-18T22:18:56.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.400+0000 7f6d22600640 1 -- start start 2024-08-18T22:18:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d22600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d1c09aca0 0x7f6d1c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d22600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d1c09b080 0x7f6d1c0b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d22600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d1c06e8a0 con 0x7f6d1c0b1300 2024-08-18T22:18:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d22600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6d1c09bb80 con 0x7f6d1c09b080 2024-08-18T22:18:56.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d22600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6d1c0d2e40 con 0x7f6d1c09aca0 2024-08-18T22:18:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1b400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d1c09aca0 0x7f6d1c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1b400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d1c09aca0 0x7f6d1c0afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40642/0 (socket says 172.21.15.5:40642) 2024-08-18T22:18:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1b400640 1 -- 172.21.15.5:0/3438686164 learned_addr learned my addr 172.21.15.5:0/3438686164 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:18:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1be00640 1 --2- 172.21.15.5:0/3438686164 >> v2:172.21.15.5:3300/0 conn(0x7f6d1c09b080 0x7f6d1c0b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:56.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1b400640 1 -- 172.21.15.5:0/3438686164 >> v2:172.21.15.117:3300/0 conn(0x7f6d1c09aca0 msgr2=0x7f6d1c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T22:18:56.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1b400640 1 -- 172.21.15.5:0/3438686164 >> v2:172.21.15.117:3300/0 conn(0x7f6d1c09aca0 msgr2=0x7f6d1c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T22:18:56.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1b400640 1 --2- 172.21.15.5:0/3438686164 >> v2:172.21.15.117:3300/0 conn(0x7f6d1c09aca0 0x7f6d1c0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T22:18:56.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1b400640 1 --2- 172.21.15.5:0/3438686164 >> v2:172.21.15.117:3300/0 conn(0x7f6d1c09aca0 0x7f6d1c0afa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:18:56.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1be00640 1 -- 172.21.15.5:0/3438686164 >> v2:172.21.15.5:3300/0 conn(0x7f6d1c09b080 msgr2=0x7f6d1c0b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T22:18:56.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1be00640 1 -- 172.21.15.5:0/3438686164 >> v2:172.21.15.5:3300/0 conn(0x7f6d1c09b080 msgr2=0x7f6d1c0b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T22:18:56.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1be00640 1 --2- 172.21.15.5:0/3438686164 >> v2:172.21.15.5:3300/0 conn(0x7f6d1c09b080 0x7f6d1c0b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T22:18:56.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.404+0000 7f6d1be00640 1 --2- 172.21.15.5:0/3438686164 >> v2:172.21.15.5:3300/0 conn(0x7f6d1c09b080 0x7f6d1c0b06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:18:56.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465607903 0 0) 0x7f6d1c06e8a0 con 0x7f6d1c0b1300 2024-08-18T22:18:56.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d00003530 con 0x7f6d1c0b1300 2024-08-18T22:18:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3482817859 0 0) 0x7f6d00003530 con 0x7f6d1c0b1300 2024-08-18T22:18:56.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 >> v2:172.21.15.117:3300/0 conn(0x7f6d1c09aca0 msgr2=0x7f6d1c0afa90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 --2- 172.21.15.5:0/3438686164 >> v2:172.21.15.117:3300/0 conn(0x7f6d1c09aca0 0x7f6d1c0afa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 >> v2:172.21.15.5:3300/0 conn(0x7f6d1c09b080 msgr2=0x7f6d1c0b06e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 --2- 172.21.15.5:0/3438686164 >> v2:172.21.15.5:3300/0 conn(0x7f6d1c09b080 0x7f6d1c0b06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c06cbd0 con 0x7f6d1c0b1300 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f6d04001680 con 0x7f6d1c0b1300 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 >> v1:172.21.15.5:6789/0 conn(0x7f6d1c0b1300 legacy=0x7f6d1c0affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 --2- 172.21.15.5:0/3438686164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d00003a10 0x7f6d00003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 --2- 172.21.15.5:0/3438686164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00004810 0x7f6d00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 --2- 172.21.15.5:0/3438686164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d000051d0 0x7f6d0000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c09bb80 con 0x7f6d000051d0 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c0d2e40 con 0x7f6d00003a10 2024-08-18T22:18:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0000c120 con 0x7f6d00004810 2024-08-18T22:18:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1be00640 1 --2- 172.21.15.5:0/3438686164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d000051d0 0x7f6d0000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d1b400640 1 --2- 172.21.15.5:0/3438686164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d00003a10 0x7f6d00003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.548+0000 7f6d13e00640 1 --2- 172.21.15.5:0/3438686164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00004810 0x7f6d00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.552+0000 7f6d1be00640 1 -- 172.21.15.5:0/3438686164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00004810 msgr2=0x7f6d00004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:18:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.552+0000 7f6d1be00640 1 --2- 172.21.15.5:0/3438686164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00004810 0x7f6d00004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.552+0000 7f6d1be00640 1 -- 172.21.15.5:0/3438686164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d00003a10 msgr2=0x7f6d00003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:18:56.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.552+0000 7f6d1be00640 1 --2- 172.21.15.5:0/3438686164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d00003a10 0x7f6d00003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:56.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.552+0000 7f6d1be00640 1 -- 172.21.15.5:0/3438686164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d00003530 con 0x7f6d000051d0 2024-08-18T22:18:56.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.552+0000 7f6d1be00640 1 -- 172.21.15.5:0/3438686164 reap_dead start 2024-08-18T22:18:56.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.552+0000 7f6d1be00640 1 --2- 172.21.15.5:0/3438686164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d000051d0 0x7f6d0000b9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009fd0 tx=0x7f6d1401ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d45c9be0c69e0c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.552+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14009bd0 con 0x7f6d000051d0 2024-08-18T22:18:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.552+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d140a5d60 con 0x7f6d000051d0 2024-08-18T22:18:56.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.552+0000 7f6d1aa00640 1 -- 172.21.15.5:0/3438686164 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d140ad630 con 0x7f6d000051d0 2024-08-18T22:18:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.556+0000 7f6d22600640 1 -- 172.21.15.5:0/3438686164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d000051d0 msgr2=0x7f6d0000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.556+0000 7f6d22600640 1 --2- 172.21.15.5:0/3438686164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d000051d0 0x7f6d0000b9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009fd0 tx=0x7f6d1401ce40 comp rx=0 tx=0).stop 2024-08-18T22:18:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.556+0000 7f6d22600640 1 -- 172.21.15.5:0/3438686164 shutdown_connections 2024-08-18T22:18:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.556+0000 7f6d22600640 1 --2- 172.21.15.5:0/3438686164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d000051d0 0x7f6d0000b9d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.556+0000 7f6d22600640 1 -- 172.21.15.5:0/3438686164 >> 172.21.15.5:0/3438686164 conn(0x7f6d1c0d2180 msgr2=0x7f6d1c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.556+0000 7f6d22600640 1 -- 172.21.15.5:0/3438686164 shutdown_connections 2024-08-18T22:18:56.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.556+0000 7f6d22600640 1 -- 172.21.15.5:0/3438686164 wait complete. 2024-08-18T22:18:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.556+0000 7f6d22600640 1 Processor -- start 2024-08-18T22:18:56.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.556+0000 7f6d22600640 1 -- start start 2024-08-18T22:18:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d22600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d000051d0 0x7f6d1c155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d22600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1c155c50 0x7f6d1c159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d22600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d1c0cda00 0x7f6d1c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d22600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c0b17e0 con 0x7f6d1c155c50 2024-08-18T22:18:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d22600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c06e6e0 con 0x7f6d1c0cda00 2024-08-18T22:18:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d22600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1c0b1960 con 0x7f6d000051d0 2024-08-18T22:18:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d1be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d1c0cda00 0x7f6d1c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d1be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d1c0cda00 0x7f6d1c0cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40674/0 (socket says 172.21.15.5:40674) 2024-08-18T22:18:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d1be00640 1 -- 172.21.15.5:0/3982297078 learned_addr learned my addr 172.21.15.5:0/3982297078 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:18:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d13e00640 1 --2- 172.21.15.5:0/3982297078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1c155c50 0x7f6d1c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d1b400640 1 --2- 172.21.15.5:0/3982297078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d000051d0 0x7f6d1c155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d1be00640 1 -- 172.21.15.5:0/3982297078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d000051d0 msgr2=0x7f6d1c155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d1be00640 1 --2- 172.21.15.5:0/3982297078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d000051d0 0x7f6d1c155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d1be00640 1 -- 172.21.15.5:0/3982297078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1c155c50 msgr2=0x7f6d1c159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d1be00640 1 --2- 172.21.15.5:0/3982297078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1c155c50 0x7f6d1c159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:56.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d1be00640 1 -- 172.21.15.5:0/3982297078 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c155a60 con 0x7f6d1c0cda00 2024-08-18T22:18:56.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d1be00640 1 --2- 172.21.15.5:0/3982297078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d1c0cda00 0x7f6d1c0cdeb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d1401d6e0 tx=0x7f6d00005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d13400640 1 -- 172.21.15.5:0/3982297078 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14009bd0 con 0x7f6d1c0cda00 2024-08-18T22:18:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d13400640 1 -- 172.21.15.5:0/3982297078 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d140b8610 con 0x7f6d1c0cda00 2024-08-18T22:18:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d22600640 1 -- 172.21.15.5:0/3982297078 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1c0cd1a0 con 0x7f6d1c0cda00 2024-08-18T22:18:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d13400640 1 -- 172.21.15.5:0/3982297078 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d140b8a00 con 0x7f6d1c0cda00 2024-08-18T22:18:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d22600640 1 -- 172.21.15.5:0/3982297078 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1c0cd720 con 0x7f6d1c0cda00 2024-08-18T22:18:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.560+0000 7f6d13400640 1 -- 172.21.15.5:0/3982297078 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6d140c0720 con 0x7f6d1c0cda00 2024-08-18T22:18:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.564+0000 7f6d22600640 1 -- 172.21.15.5:0/3982297078 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d1c06e860 con 0x7f6d1c0cda00 2024-08-18T22:18:56.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.564+0000 7f6d13400640 1 -- 172.21.15.5:0/3982297078 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6d140ac750 con 0x7f6d1c0cda00 2024-08-18T22:18:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.580+0000 7f6d13400640 1 -- 172.21.15.5:0/3982297078 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f6d140b5070 con 0x7f6d1c0cda00 2024-08-18T22:18:56.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.644+0000 7f6d22600640 1 -- 172.21.15.5:0/3982297078 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f6d1c06ff50 con 0x7f6d1c0cda00 2024-08-18T22:18:56.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.652+0000 7f6d13400640 1 -- 172.21.15.5:0/3982297078 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f6d14016b50 con 0x7f6d1c0cda00 2024-08-18T22:18:56.653 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-08-18T22:18:56.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.652+0000 7f6d22600640 1 -- 172.21.15.5:0/3982297078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d1c0cda00 msgr2=0x7f6d1c0cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:56.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.652+0000 7f6d22600640 1 --2- 172.21.15.5:0/3982297078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d1c0cda00 0x7f6d1c0cdeb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d1401d6e0 tx=0x7f6d00005840 comp rx=0 tx=0).stop 2024-08-18T22:18:56.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.652+0000 7f6d22600640 1 -- 172.21.15.5:0/3982297078 shutdown_connections 2024-08-18T22:18:56.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.652+0000 7f6d22600640 1 --2- 172.21.15.5:0/3982297078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d1c0cda00 0x7f6d1c0cdeb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:56.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.652+0000 7f6d22600640 1 --2- 172.21.15.5:0/3982297078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d1c155c50 0x7f6d1c159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:56.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.652+0000 7f6d22600640 1 --2- 172.21.15.5:0/3982297078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d000051d0 0x7f6d1c155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:56.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.652+0000 7f6d22600640 1 -- 172.21.15.5:0/3982297078 >> 172.21.15.5:0/3982297078 conn(0x7f6d1c0d2180 msgr2=0x7f6d1c0b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.652+0000 7f6d22600640 1 -- 172.21.15.5:0/3982297078 shutdown_connections 2024-08-18T22:18:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:56.652+0000 7f6d22600640 1 -- 172.21.15.5:0/3982297078 wait complete. 2024-08-18T22:18:56.673 INFO:tasks.ceph:check_enable_crimson: False 2024-08-18T22:18:56.673 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-18T22:18:56.673 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:56.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-18T22:18:56.693 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:56.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-18T22:18:56.752 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:56.748+0000 7fc285744180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-18T22:18:56.755 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:56.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-18T22:18:56.769 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:56.767+0000 7efe0e8d6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-18T22:18:56.815 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:18:56.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-18T22:18:56.875 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:56.875 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-18T22:18:56.896 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:56.896 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-18T22:18:56.958 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:56.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-18T22:18:57.026 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:18:57.026 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-18T22:18:57.093 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 708d328f-f3eb-496e-a877-30f10b8329cb 0 2024-08-18T22:18:57.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.267+0000 7f47c1400640 1 Processor -- start 2024-08-18T22:18:57.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.267+0000 7f47c1400640 1 -- start start 2024-08-18T22:18:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47c1400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47bc147dd0 0x7f47bc0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47c1400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47bc15f000 0x7f47bc0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47c1400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47bc06c850 con 0x7f47bc06c3c0 2024-08-18T22:18:57.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47c1400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f47bc15f7c0 con 0x7f47bc15f000 2024-08-18T22:18:57.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47c1400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f47bc0b6410 con 0x7f47bc147dd0 2024-08-18T22:18:57.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47ba800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47bc147dd0 0x7f47bc0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47ba800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47bc147dd0 0x7f47bc0b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52260/0 (socket says 172.21.15.117:52260) 2024-08-18T22:18:57.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47ba800640 1 -- 172.21.15.117:0/3599470305 learned_addr learned my addr 172.21.15.117:0/3599470305 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:57.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47bb200640 1 --2- 172.21.15.117:0/3599470305 >> v2:172.21.15.5:3300/0 conn(0x7f47bc15f000 0x7f47bc0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47ba800640 1 -- 172.21.15.117:0/3599470305 >> v2:172.21.15.5:3300/0 conn(0x7f47bc15f000 msgr2=0x7f47bc0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:18:57.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47ba800640 1 --2- 172.21.15.117:0/3599470305 >> v2:172.21.15.5:3300/0 conn(0x7f47bc15f000 0x7f47bc0d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47ba800640 1 -- 172.21.15.117:0/3599470305 >> v1:172.21.15.5:6789/0 conn(0x7f47bc06c3c0 legacy=0x7f47bc15e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47ba800640 1 -- 172.21.15.117:0/3599470305 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc0b46b0 con 0x7f47bc147dd0 2024-08-18T22:18:57.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47ba800640 1 --2- 172.21.15.117:0/3599470305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc147dd0 0x7f47bc0b40d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0d20a0 tx=0x7f47ac01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efdfa8a349f631f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:57.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.271+0000 7f47b9e00640 1 -- 172.21.15.117:0/3599470305 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0ab660 con 0x7f47bc147dd0 2024-08-18T22:18:57.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47b9e00640 1 -- 172.21.15.117:0/3599470305 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac0b0070 con 0x7f47bc147dd0 2024-08-18T22:18:57.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47b9e00640 1 -- 172.21.15.117:0/3599470305 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0aba20 con 0x7f47bc147dd0 2024-08-18T22:18:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 -- 172.21.15.117:0/3599470305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc147dd0 msgr2=0x7f47bc0b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 --2- 172.21.15.117:0/3599470305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc147dd0 0x7f47bc0b40d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0d20a0 tx=0x7f47ac01c460 comp rx=0 tx=0).stop 2024-08-18T22:18:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 -- 172.21.15.117:0/3599470305 shutdown_connections 2024-08-18T22:18:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 --2- 172.21.15.117:0/3599470305 >> v2:172.21.15.5:3300/0 conn(0x7f47bc15f000 0x7f47bc0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 --2- 172.21.15.117:0/3599470305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc147dd0 0x7f47bc0b40d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 -- 172.21.15.117:0/3599470305 >> 172.21.15.117:0/3599470305 conn(0x7f47bc0b65f0 msgr2=0x7f47bc0b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:57.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 -- 172.21.15.117:0/3599470305 shutdown_connections 2024-08-18T22:18:57.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 -- 172.21.15.117:0/3599470305 wait complete. 2024-08-18T22:18:57.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 Processor -- start 2024-08-18T22:18:57.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 -- start start 2024-08-18T22:18:57.277 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:57.275+0000 7efe0e8d6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-18T22:18:57.278 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:57.276+0000 7fc285744180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc06c3c0 0x7f47bc09ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47bc147dd0 0x7f47bc0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc15f000 0x7f47bc1432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc0b5b30 con 0x7f47bc147dd0 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc15f9e0 con 0x7f47bc15f000 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47c1400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f47bc0b5cb0 con 0x7f47bc06c3c0 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.275+0000 7f47ba800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc06c3c0 0x7f47bc09ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47bb200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc15f000 0x7f47bc1432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47ba800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc06c3c0 0x7f47bc09ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:60354/0 (socket says 172.21.15.117:60354) 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47ba800640 1 -- 172.21.15.117:0/2066963773 learned_addr learned my addr 172.21.15.117:0/2066963773 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47b3e00640 1 --2- 172.21.15.117:0/2066963773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47bc147dd0 0x7f47bc0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47ba800640 1 -- 172.21.15.117:0/2066963773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc15f000 msgr2=0x7f47bc1432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47ba800640 1 --2- 172.21.15.117:0/2066963773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc15f000 0x7f47bc1432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47ba800640 1 -- 172.21.15.117:0/2066963773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47bc147dd0 msgr2=0x7f47bc0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47ba800640 1 --2- 172.21.15.117:0/2066963773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47bc147dd0 0x7f47bc0ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47ba800640 1 -- 172.21.15.117:0/2066963773 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc1fa760 con 0x7f47bc06c3c0 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47b3e00640 1 --2- 172.21.15.117:0/2066963773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47bc147dd0 0x7f47bc0ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47ba800640 1 --2- 172.21.15.117:0/2066963773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc06c3c0 0x7f47bc09ec70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f47ac019070 tx=0x7f47ac01aca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47b2a00640 1 -- 172.21.15.117:0/2066963773 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0abd00 con 0x7f47bc06c3c0 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47b2a00640 1 -- 172.21.15.117:0/2066963773 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac0be3f0 con 0x7f47bc06c3c0 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47b2a00640 1 -- 172.21.15.117:0/2066963773 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0be7e0 con 0x7f47bc06c3c0 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47c1400640 1 -- 172.21.15.117:0/2066963773 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47bc145330 con 0x7f47bc06c3c0 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47c1400640 1 -- 172.21.15.117:0/2066963773 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47bc1faa00 con 0x7f47bc06c3c0 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47b2a00640 1 -- 172.21.15.117:0/2066963773 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f47ac0bed10 con 0x7f47bc06c3c0 2024-08-18T22:18:57.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47b2a00640 1 -- 172.21.15.117:0/2066963773 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f47ac0b43f0 con 0x7f47bc06c3c0 2024-08-18T22:18:57.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.279+0000 7f47c1400640 1 -- 172.21.15.117:0/2066963773 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47bc0b40d0 con 0x7f47bc06c3c0 2024-08-18T22:18:57.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.283+0000 7f47b2a00640 1 -- 172.21.15.117:0/2066963773 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f47ac0ddf20 con 0x7f47bc06c3c0 2024-08-18T22:18:57.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.347+0000 7f47c1400640 1 -- 172.21.15.117:0/2066963773 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "708d328f-f3eb-496e-a877-30f10b8329cb", "id": 0} v 0) -- 0x7f47bc160d60 con 0x7f47bc06c3c0 2024-08-18T22:18:57.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.351+0000 7f47b2a00640 1 -- 172.21.15.117:0/2066963773 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "708d328f-f3eb-496e-a877-30f10b8329cb", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f47ac0cc020 con 0x7f47bc06c3c0 2024-08-18T22:18:57.354 INFO:teuthology.orchestra.run.smithi117.stdout:0 2024-08-18T22:18:57.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.355+0000 7f47c1400640 1 -- 172.21.15.117:0/2066963773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc06c3c0 msgr2=0x7f47bc09ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.355+0000 7f47c1400640 1 --2- 172.21.15.117:0/2066963773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc06c3c0 0x7f47bc09ec70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f47ac019070 tx=0x7f47ac01aca0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.355+0000 7f47c1400640 1 -- 172.21.15.117:0/2066963773 shutdown_connections 2024-08-18T22:18:57.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.355+0000 7f47c1400640 1 --2- 172.21.15.117:0/2066963773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc15f000 0x7f47bc1432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.355+0000 7f47c1400640 1 --2- 172.21.15.117:0/2066963773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47bc147dd0 0x7f47bc0ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.355+0000 7f47c1400640 1 --2- 172.21.15.117:0/2066963773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc06c3c0 0x7f47bc09ec70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.355+0000 7f47c1400640 1 -- 172.21.15.117:0/2066963773 >> 172.21.15.117:0/2066963773 conn(0x7f47bc0b65f0 msgr2=0x7f47bc15fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:57.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.355+0000 7f47c1400640 1 -- 172.21.15.117:0/2066963773 shutdown_connections 2024-08-18T22:18:57.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.355+0000 7f47c1400640 1 -- 172.21.15.117:0/2066963773 wait complete. 2024-08-18T22:18:57.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 20e893d5-0c8f-4279-b071-ecbbfbc29fc3 1 2024-08-18T22:18:57.501 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:57.499+0000 7efe0e8d6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-18T22:18:57.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.507+0000 7f4b5d600640 1 Processor -- start 2024-08-18T22:18:57.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.507+0000 7f4b5d600640 1 -- start start 2024-08-18T22:18:57.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.507+0000 7f4b5d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b580b1300 0x7f4b58162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.507+0000 7f4b5d600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b5809b080 0x7f4b580b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.507+0000 7f4b5d600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b5806e8a0 con 0x7f4b5809aca0 2024-08-18T22:18:57.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.507+0000 7f4b5d600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4b5809bb80 con 0x7f4b5809b080 2024-08-18T22:18:57.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.507+0000 7f4b5d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4b580d2e40 con 0x7f4b580b1300 2024-08-18T22:18:57.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.507+0000 7f4b57400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b5809b080 0x7f4b580b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.507+0000 7f4b4fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b580b1300 0x7f4b58162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.507+0000 7f4b57400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b5809b080 0x7f4b580b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52280/0 (socket says 172.21.15.117:52280) 2024-08-18T22:18:57.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.507+0000 7f4b57400640 1 -- 172.21.15.117:0/577298852 learned_addr learned my addr 172.21.15.117:0/577298852 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:57.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.511+0000 7f4b57400640 1 -- 172.21.15.117:0/577298852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b580b1300 msgr2=0x7f4b58162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:18:57.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.511+0000 7f4b57400640 1 --2- 172.21.15.117:0/577298852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b580b1300 0x7f4b58162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.511+0000 7f4b57400640 1 -- 172.21.15.117:0/577298852 >> v1:172.21.15.117:6789/0 conn(0x7f4b5809aca0 legacy=0x7f4b580afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.511+0000 7f4b57400640 1 -- 172.21.15.117:0/577298852 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5806cbd0 con 0x7f4b5809b080 2024-08-18T22:18:57.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.511+0000 7f4b4fe00640 1 --2- 172.21.15.117:0/577298852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b580b1300 0x7f4b58162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:18:57.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.511+0000 7f4b57400640 1 --2- 172.21.15.117:0/577298852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5809b080 0x7f4b580b01a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009e50 tx=0x7f4b5001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=446da87564e7dd9b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:57.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.511+0000 7f4b56000640 1 -- 172.21.15.117:0/577298852 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b500a5810 con 0x7f4b5809b080 2024-08-18T22:18:57.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.511+0000 7f4b56000640 1 -- 172.21.15.117:0/577298852 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b500a59b0 con 0x7f4b5809b080 2024-08-18T22:18:57.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.511+0000 7f4b56000640 1 -- 172.21.15.117:0/577298852 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b500a5d80 con 0x7f4b5809b080 2024-08-18T22:18:57.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.511+0000 7f4b5d600640 1 -- 172.21.15.117:0/577298852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5809b080 msgr2=0x7f4b580b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.511+0000 7f4b5d600640 1 --2- 172.21.15.117:0/577298852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5809b080 0x7f4b580b01a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009e50 tx=0x7f4b5001ca30 comp rx=0 tx=0).stop 2024-08-18T22:18:57.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 -- 172.21.15.117:0/577298852 shutdown_connections 2024-08-18T22:18:57.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 --2- 172.21.15.117:0/577298852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5809b080 0x7f4b580b01a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 --2- 172.21.15.117:0/577298852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b580b1300 0x7f4b58162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 -- 172.21.15.117:0/577298852 >> 172.21.15.117:0/577298852 conn(0x7f4b580d2180 msgr2=0x7f4b580d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:57.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 -- 172.21.15.117:0/577298852 shutdown_connections 2024-08-18T22:18:57.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 -- 172.21.15.117:0/577298852 wait complete. 2024-08-18T22:18:57.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 Processor -- start 2024-08-18T22:18:57.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 -- start start 2024-08-18T22:18:57.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5809aca0 0x7f4b5815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5809b080 0x7f4b58150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b580b1300 0x7f4b58150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5816bcb0 con 0x7f4b580b1300 2024-08-18T22:18:57.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5816bb30 con 0x7f4b5809aca0 2024-08-18T22:18:57.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4b5816be30 con 0x7f4b5809b080 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5809b080 0x7f4b58150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b56a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5809aca0 0x7f4b5815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5809b080 0x7f4b58150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:60382/0 (socket says 172.21.15.117:60382) 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4fe00640 1 -- 172.21.15.117:0/527021736 learned_addr learned my addr 172.21.15.117:0/527021736 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b57400640 1 --2- 172.21.15.117:0/527021736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b580b1300 0x7f4b58150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4fe00640 1 -- 172.21.15.117:0/527021736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5809aca0 msgr2=0x7f4b5815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4fe00640 1 --2- 172.21.15.117:0/527021736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5809aca0 0x7f4b5815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4fe00640 1 -- 172.21.15.117:0/527021736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b580b1300 msgr2=0x7f4b58150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4fe00640 1 --2- 172.21.15.117:0/527021736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b580b1300 0x7f4b58150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4fe00640 1 -- 172.21.15.117:0/527021736 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b580b6cb0 con 0x7f4b5809b080 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b56a00640 1 --2- 172.21.15.117:0/527021736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5809aca0 0x7f4b5815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:18:57.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b57400640 1 --2- 172.21.15.117:0/527021736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b580b1300 0x7f4b58150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:18:57.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4fe00640 1 --2- 172.21.15.117:0/527021736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5809b080 0x7f4b58150590 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000e980 tx=0x7f4b4000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:57.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4ea00640 1 -- 172.21.15.117:0/527021736 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40017070 con 0x7f4b5809b080 2024-08-18T22:18:57.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4ea00640 1 -- 172.21.15.117:0/527021736 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4000ca00 con 0x7f4b5809b080 2024-08-18T22:18:57.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b5d600640 1 -- 172.21.15.117:0/527021736 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b580b6f90 con 0x7f4b5809b080 2024-08-18T22:18:57.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.515+0000 7f4b4ea00640 1 -- 172.21.15.117:0/527021736 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4000cdd0 con 0x7f4b5809b080 2024-08-18T22:18:57.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.519+0000 7f4b5d600640 1 -- 172.21.15.117:0/527021736 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b580b2810 con 0x7f4b5809b080 2024-08-18T22:18:57.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.519+0000 7f4b4ea00640 1 -- 172.21.15.117:0/527021736 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4b4001a070 con 0x7f4b5809b080 2024-08-18T22:18:57.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.519+0000 7f4b4ea00640 1 -- 172.21.15.117:0/527021736 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f4b4001c840 con 0x7f4b5809b080 2024-08-18T22:18:57.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.519+0000 7f4b5d600640 1 -- 172.21.15.117:0/527021736 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b580afa90 con 0x7f4b5809b080 2024-08-18T22:18:57.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.519+0000 7f4b4ea00640 1 -- 172.21.15.117:0/527021736 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f4b4001ca40 con 0x7f4b5809b080 2024-08-18T22:18:57.521 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:57.520+0000 7fc285744180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-18T22:18:57.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.591+0000 7f4b5d600640 1 -- 172.21.15.117:0/527021736 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "20e893d5-0c8f-4279-b071-ecbbfbc29fc3", "id": 1} v 0) -- 0x7f4b58161250 con 0x7f4b5809b080 2024-08-18T22:18:57.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.595+0000 7f4b4ea00640 1 -- 172.21.15.117:0/527021736 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "20e893d5-0c8f-4279-b071-ecbbfbc29fc3", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f4b4001cc20 con 0x7f4b5809b080 2024-08-18T22:18:57.594 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-08-18T22:18:57.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.595+0000 7f4b5d600640 1 -- 172.21.15.117:0/527021736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5809b080 msgr2=0x7f4b58150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.595+0000 7f4b5d600640 1 --2- 172.21.15.117:0/527021736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5809b080 0x7f4b58150590 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000e980 tx=0x7f4b4000ee40 comp rx=0 tx=0).stop 2024-08-18T22:18:57.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.595+0000 7f4b5d600640 1 -- 172.21.15.117:0/527021736 shutdown_connections 2024-08-18T22:18:57.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.595+0000 7f4b5d600640 1 --2- 172.21.15.117:0/527021736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b580b1300 0x7f4b58150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.595+0000 7f4b5d600640 1 --2- 172.21.15.117:0/527021736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5809b080 0x7f4b58150590 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.595+0000 7f4b5d600640 1 --2- 172.21.15.117:0/527021736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5809aca0 0x7f4b5815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.595+0000 7f4b5d600640 1 -- 172.21.15.117:0/527021736 >> 172.21.15.117:0/527021736 conn(0x7f4b580d2180 msgr2=0x7f4b58168b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:57.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.595+0000 7f4b5d600640 1 -- 172.21.15.117:0/527021736 shutdown_connections 2024-08-18T22:18:57.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.595+0000 7f4b5d600640 1 -- 172.21.15.117:0/527021736 wait complete. 2024-08-18T22:18:57.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new cba182a0-c800-42a4-bd59-4bc2ce934664 2 2024-08-18T22:18:57.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bec00640 1 Processor -- start 2024-08-18T22:18:57.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bec00640 1 -- start start 2024-08-18T22:18:57.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bec00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8b80d0270 0x7fc8b815d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b806eeb0 0x7fc8b806f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bec00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b80afee0 con 0x7fc8b8156840 2024-08-18T22:18:57.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bec00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b806c0c0 con 0x7fc8b80d0270 2024-08-18T22:18:57.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b80d06b0 con 0x7fc8b806eeb0 2024-08-18T22:18:57.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8b7e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fc8b8156840 0x7fc8b806b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:57920/0 (socket says 172.21.15.117:57920) 2024-08-18T22:18:57.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8b7e00640 1 -- 172.21.15.117:0/3514217795 learned_addr learned my addr 172.21.15.117:0/3514217795 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-08-18T22:18:57.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bcc00640 1 --2- 172.21.15.117:0/3514217795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b806eeb0 0x7fc8b806f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8af400640 1 --2- 172.21.15.117:0/3514217795 >> v2:172.21.15.5:3300/0 conn(0x7fc8b80d0270 0x7fc8b815d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8b7400640 1 -- 172.21.15.117:0/3514217795 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79670440 0 0) 0x7fc8b80afee0 con 0x7fc8b8156840 2024-08-18T22:18:57.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8b7400640 1 -- 172.21.15.117:0/3514217795 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc89c003530 con 0x7fc8b8156840 2024-08-18T22:18:57.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bcc00640 1 -- 172.21.15.117:0/3514217795 >> v2:172.21.15.5:3300/0 conn(0x7fc8b80d0270 msgr2=0x7fc8b815d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:18:57.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bcc00640 1 --2- 172.21.15.117:0/3514217795 >> v2:172.21.15.5:3300/0 conn(0x7fc8b80d0270 0x7fc8b815d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bcc00640 1 -- 172.21.15.117:0/3514217795 >> v1:172.21.15.117:6789/0 conn(0x7fc8b8156840 legacy=0x7fc8b806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8bcc00640 1 -- 172.21.15.117:0/3514217795 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b80b01c0 con 0x7fc8b806eeb0 2024-08-18T22:18:57.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.747+0000 7fc8af400640 1 --2- 172.21.15.117:0/3514217795 >> v2:172.21.15.5:3300/0 conn(0x7fc8b80d0270 0x7fc8b815d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:18:57.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8bcc00640 1 --2- 172.21.15.117:0/3514217795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b806eeb0 0x7fc8b806f340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009d90 tx=0x7fc8b001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=139644f80ebb2d6e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:57.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8b7400640 1 -- 172.21.15.117:0/3514217795 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00b2070 con 0x7fc8b806eeb0 2024-08-18T22:18:57.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8b7400640 1 -- 172.21.15.117:0/3514217795 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b00a5940 con 0x7fc8b806eeb0 2024-08-18T22:18:57.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8b7400640 1 -- 172.21.15.117:0/3514217795 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00a5cf0 con 0x7fc8b806eeb0 2024-08-18T22:18:57.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8bec00640 1 -- 172.21.15.117:0/3514217795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b806eeb0 msgr2=0x7fc8b806f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8bec00640 1 --2- 172.21.15.117:0/3514217795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b806eeb0 0x7fc8b806f340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009d90 tx=0x7fc8b001c970 comp rx=0 tx=0).stop 2024-08-18T22:18:57.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8bec00640 1 -- 172.21.15.117:0/3514217795 shutdown_connections 2024-08-18T22:18:57.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8bec00640 1 --2- 172.21.15.117:0/3514217795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b806eeb0 0x7fc8b806f340 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8bec00640 1 --2- 172.21.15.117:0/3514217795 >> v2:172.21.15.5:3300/0 conn(0x7fc8b80d0270 0x7fc8b815d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8bec00640 1 -- 172.21.15.117:0/3514217795 >> 172.21.15.117:0/3514217795 conn(0x7fc8b80cd690 msgr2=0x7fc8b80cdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:57.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8bec00640 1 -- 172.21.15.117:0/3514217795 shutdown_connections 2024-08-18T22:18:57.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.751+0000 7fc8bec00640 1 -- 172.21.15.117:0/3514217795 wait complete. 2024-08-18T22:18:57.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bec00640 1 Processor -- start 2024-08-18T22:18:57.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bec00640 1 -- start start 2024-08-18T22:18:57.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bec00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b806eeb0 0x7fc8b8150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bec00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b80d0270 0x7fc8b814eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b8156840 0x7fc8b80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bec00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b80cef90 con 0x7fc8b806eeb0 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bec00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b80cfea0 con 0x7fc8b80d0270 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b8168ea0 con 0x7fc8b8156840 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8af400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b80d0270 0x7fc8b814eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bcc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b8156840 0x7fc8b80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8af400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b80d0270 0x7fc8b814eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52298/0 (socket says 172.21.15.117:52298) 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8af400640 1 -- 172.21.15.117:0/2645856503 learned_addr learned my addr 172.21.15.117:0/2645856503 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bcc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b8156840 0x7fc8b80b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:60406/0 (socket says 172.21.15.117:60406) 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8b7e00640 1 --2- 172.21.15.117:0/2645856503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b806eeb0 0x7fc8b8150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8af400640 1 -- 172.21.15.117:0/2645856503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b8156840 msgr2=0x7fc8b80b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8af400640 1 --2- 172.21.15.117:0/2645856503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b8156840 0x7fc8b80b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8af400640 1 -- 172.21.15.117:0/2645856503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b806eeb0 msgr2=0x7fc8b8150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8af400640 1 --2- 172.21.15.117:0/2645856503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b806eeb0 0x7fc8b8150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8af400640 1 -- 172.21.15.117:0/2645856503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b8151340 con 0x7fc8b80d0270 2024-08-18T22:18:57.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bcc00640 1 --2- 172.21.15.117:0/2645856503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b8156840 0x7fc8b80b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:18:57.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8af400640 1 --2- 172.21.15.117:0/2645856503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b80d0270 0x7fc8b814eae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000ebe0 tx=0x7fc8a000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:57.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8b4c00640 1 -- 172.21.15.117:0/2645856503 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0017070 con 0x7fc8b80d0270 2024-08-18T22:18:57.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8b4c00640 1 -- 172.21.15.117:0/2645856503 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a000cc30 con 0x7fc8b80d0270 2024-08-18T22:18:57.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8b4c00640 1 -- 172.21.15.117:0/2645856503 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0013470 con 0x7fc8b80d0270 2024-08-18T22:18:57.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bec00640 1 -- 172.21.15.117:0/2645856503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b814daf0 con 0x7fc8b80d0270 2024-08-18T22:18:57.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8bec00640 1 -- 172.21.15.117:0/2645856503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b814e0b0 con 0x7fc8b80d0270 2024-08-18T22:18:57.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8b4c00640 1 -- 172.21.15.117:0/2645856503 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc8a001a070 con 0x7fc8b80d0270 2024-08-18T22:18:57.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.755+0000 7fc8b4c00640 1 -- 172.21.15.117:0/2645856503 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc8a0013a30 con 0x7fc8b80d0270 2024-08-18T22:18:57.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.759+0000 7fc8bec00640 1 -- 172.21.15.117:0/2645856503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b806f340 con 0x7fc8b80d0270 2024-08-18T22:18:57.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.759+0000 7fc8b4c00640 1 -- 172.21.15.117:0/2645856503 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fc8a0013610 con 0x7fc8b80d0270 2024-08-18T22:18:57.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.827+0000 7fc8bec00640 1 -- 172.21.15.117:0/2645856503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cba182a0-c800-42a4-bd59-4bc2ce934664", "id": 2} v 0) -- 0x7fc8b8152130 con 0x7fc8b80d0270 2024-08-18T22:18:57.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.831+0000 7fc8b4c00640 1 -- 172.21.15.117:0/2645856503 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cba182a0-c800-42a4-bd59-4bc2ce934664", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc8a00059a0 con 0x7fc8b80d0270 2024-08-18T22:18:57.833 INFO:teuthology.orchestra.run.smithi117.stdout:2 2024-08-18T22:18:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.831+0000 7fc8bec00640 1 -- 172.21.15.117:0/2645856503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b80d0270 msgr2=0x7fc8b814eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.831+0000 7fc8bec00640 1 --2- 172.21.15.117:0/2645856503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b80d0270 0x7fc8b814eae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000ebe0 tx=0x7fc8a000c520 comp rx=0 tx=0).stop 2024-08-18T22:18:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.831+0000 7fc8bec00640 1 -- 172.21.15.117:0/2645856503 shutdown_connections 2024-08-18T22:18:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.831+0000 7fc8bec00640 1 --2- 172.21.15.117:0/2645856503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b8156840 0x7fc8b80b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.831+0000 7fc8bec00640 1 --2- 172.21.15.117:0/2645856503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b80d0270 0x7fc8b814eae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.831+0000 7fc8bec00640 1 --2- 172.21.15.117:0/2645856503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b806eeb0 0x7fc8b8150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.831+0000 7fc8bec00640 1 -- 172.21.15.117:0/2645856503 >> 172.21.15.117:0/2645856503 conn(0x7fc8b80cd690 msgr2=0x7fc8b80b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.831+0000 7fc8bec00640 1 -- 172.21.15.117:0/2645856503 shutdown_connections 2024-08-18T22:18:57.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.831+0000 7fc8bec00640 1 -- 172.21.15.117:0/2645856503 wait complete. 2024-08-18T22:18:57.852 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 1f50a6c9-c25c-4aeb-8223-99d3e72109e3 3 2024-08-18T22:18:57.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.983+0000 7fa861e00640 1 Processor -- start 2024-08-18T22:18:57.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa861e00640 1 -- start start 2024-08-18T22:18:57.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa861e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa85c06b9b0 0x7fa85c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa861e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa85c15c410 0x7fa85c06bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa861e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85c0cd820 con 0x7fa85c0d0df0 2024-08-18T22:18:57.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa861e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa85c0ce430 con 0x7fa85c15c410 2024-08-18T22:18:57.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa861e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa85c0cdb00 con 0x7fa85c06b9b0 2024-08-18T22:18:57.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa85aa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa85c06b9b0 0x7fa85c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa85aa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa85c06b9b0 0x7fa85c0ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52312/0 (socket says 172.21.15.117:52312) 2024-08-18T22:18:57.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa85aa00640 1 -- 172.21.15.117:0/1444682785 learned_addr learned my addr 172.21.15.117:0/1444682785 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:57.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa85a000640 1 --2- 172.21.15.117:0/1444682785 >> v2:172.21.15.5:3300/0 conn(0x7fa85c15c410 0x7fa85c06bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa85aa00640 1 -- 172.21.15.117:0/1444682785 >> v2:172.21.15.5:3300/0 conn(0x7fa85c15c410 msgr2=0x7fa85c06bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:18:57.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa85aa00640 1 --2- 172.21.15.117:0/1444682785 >> v2:172.21.15.5:3300/0 conn(0x7fa85c15c410 0x7fa85c06bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa85aa00640 1 -- 172.21.15.117:0/1444682785 >> v1:172.21.15.117:6789/0 conn(0x7fa85c0d0df0 legacy=0x7fa85c0cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.987+0000 7fa85aa00640 1 -- 172.21.15.117:0/1444682785 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c0cdde0 con 0x7fa85c06b9b0 2024-08-18T22:18:57.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa85aa00640 1 --2- 172.21.15.117:0/1444682785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa85c06b9b0 0x7fa85c0ce8c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0d2120 tx=0x7fa84c01c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ab662aead38810d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:57.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa859600640 1 -- 172.21.15.117:0/1444682785 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0ab600 con 0x7fa85c06b9b0 2024-08-18T22:18:57.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa859600640 1 -- 172.21.15.117:0/1444682785 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84c0b0070 con 0x7fa85c06b9b0 2024-08-18T22:18:57.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa859600640 1 -- 172.21.15.117:0/1444682785 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0ab9c0 con 0x7fa85c06b9b0 2024-08-18T22:18:57.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa861e00640 1 -- 172.21.15.117:0/1444682785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa85c06b9b0 msgr2=0x7fa85c0ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa861e00640 1 --2- 172.21.15.117:0/1444682785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa85c06b9b0 0x7fa85c0ce8c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0d2120 tx=0x7fa84c01c4f0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa861e00640 1 -- 172.21.15.117:0/1444682785 shutdown_connections 2024-08-18T22:18:57.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa861e00640 1 --2- 172.21.15.117:0/1444682785 >> v2:172.21.15.5:3300/0 conn(0x7fa85c15c410 0x7fa85c06bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa861e00640 1 --2- 172.21.15.117:0/1444682785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa85c06b9b0 0x7fa85c0ce8c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa861e00640 1 -- 172.21.15.117:0/1444682785 >> 172.21.15.117:0/1444682785 conn(0x7fa85c0b65f0 msgr2=0x7fa85c0b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:57.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa861e00640 1 -- 172.21.15.117:0/1444682785 shutdown_connections 2024-08-18T22:18:57.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa861e00640 1 -- 172.21.15.117:0/1444682785 wait complete. 2024-08-18T22:18:57.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa861e00640 1 Processor -- start 2024-08-18T22:18:57.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.991+0000 7fa861e00640 1 -- start start 2024-08-18T22:18:57.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa861e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa85c06b9b0 0x7fa85c14fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa861e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa85c0d0df0 0x7fa85c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa861e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa85c15c410 0x7fa85c15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:57.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa861e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c169130 con 0x7fa85c06b9b0 2024-08-18T22:18:57.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa861e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c168fb0 con 0x7fa85c15c410 2024-08-18T22:18:57.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa861e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa85c1692b0 con 0x7fa85c0d0df0 2024-08-18T22:18:57.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa85c15c410 0x7fa85c15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa85c0d0df0 0x7fa85c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa85c15c410 0x7fa85c15a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52326/0 (socket says 172.21.15.117:52326) 2024-08-18T22:18:57.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85b400640 1 -- 172.21.15.117:0/921474531 learned_addr learned my addr 172.21.15.117:0/921474531 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:57.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85aa00640 1 --2- 172.21.15.117:0/921474531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa85c06b9b0 0x7fa85c14fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:57.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85b400640 1 -- 172.21.15.117:0/921474531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa85c0d0df0 msgr2=0x7fa85c14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85b400640 1 --2- 172.21.15.117:0/921474531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa85c0d0df0 0x7fa85c14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85b400640 1 -- 172.21.15.117:0/921474531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa85c06b9b0 msgr2=0x7fa85c14fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:57.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85b400640 1 --2- 172.21.15.117:0/921474531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa85c06b9b0 0x7fa85c14fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:57.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85b400640 1 -- 172.21.15.117:0/921474531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c0affc0 con 0x7fa85c15c410 2024-08-18T22:18:57.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85a000640 1 --2- 172.21.15.117:0/921474531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa85c0d0df0 0x7fa85c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:18:57.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa85b400640 1 --2- 172.21.15.117:0/921474531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa85c15c410 0x7fa85c15a780 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa85400c770 tx=0x7fa85400cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:57.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa853400640 1 -- 172.21.15.117:0/921474531 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854003b80 con 0x7fa85c15c410 2024-08-18T22:18:57.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa853400640 1 -- 172.21.15.117:0/921474531 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa854003d20 con 0x7fa85c15c410 2024-08-18T22:18:57.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa853400640 1 -- 172.21.15.117:0/921474531 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85400aa90 con 0x7fa85c15c410 2024-08-18T22:18:57.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa861e00640 1 -- 172.21.15.117:0/921474531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa85c0afce0 con 0x7fa85c15c410 2024-08-18T22:18:57.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa861e00640 1 -- 172.21.15.117:0/921474531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa85c150a50 con 0x7fa85c15c410 2024-08-18T22:18:57.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa853400640 1 -- 172.21.15.117:0/921474531 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa85400ac30 con 0x7fa85c15c410 2024-08-18T22:18:57.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa853400640 1 -- 172.21.15.117:0/921474531 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa854005560 con 0x7fa85c15c410 2024-08-18T22:18:57.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.995+0000 7fa861e00640 1 -- 172.21.15.117:0/921474531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa85c156130 con 0x7fa85c15c410 2024-08-18T22:18:57.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:57.999+0000 7fa853400640 1 -- 172.21.15.117:0/921474531 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fa8540050d0 con 0x7fa85c15c410 2024-08-18T22:18:58.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.063+0000 7fa861e00640 1 -- 172.21.15.117:0/921474531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1f50a6c9-c25c-4aeb-8223-99d3e72109e3", "id": 3} v 0) -- 0x7fa85c0ce8a0 con 0x7fa85c15c410 2024-08-18T22:18:58.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.071+0000 7fa853400640 1 -- 172.21.15.117:0/921474531 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f50a6c9-c25c-4aeb-8223-99d3e72109e3", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa854005370 con 0x7fa85c15c410 2024-08-18T22:18:58.071 INFO:teuthology.orchestra.run.smithi117.stdout:3 2024-08-18T22:18:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.071+0000 7fa861e00640 1 -- 172.21.15.117:0/921474531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa85c15c410 msgr2=0x7fa85c15a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.071+0000 7fa861e00640 1 --2- 172.21.15.117:0/921474531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa85c15c410 0x7fa85c15a780 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa85400c770 tx=0x7fa85400cc30 comp rx=0 tx=0).stop 2024-08-18T22:18:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.071+0000 7fa861e00640 1 -- 172.21.15.117:0/921474531 shutdown_connections 2024-08-18T22:18:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.071+0000 7fa861e00640 1 --2- 172.21.15.117:0/921474531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa85c15c410 0x7fa85c15a780 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.071+0000 7fa861e00640 1 --2- 172.21.15.117:0/921474531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa85c0d0df0 0x7fa85c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.071+0000 7fa861e00640 1 --2- 172.21.15.117:0/921474531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa85c06b9b0 0x7fa85c14fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.071+0000 7fa861e00640 1 -- 172.21.15.117:0/921474531 >> 172.21.15.117:0/921474531 conn(0x7fa85c0b65f0 msgr2=0x7fa85c15def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:58.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.071+0000 7fa861e00640 1 -- 172.21.15.117:0/921474531 shutdown_connections 2024-08-18T22:18:58.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.071+0000 7fa861e00640 1 -- 172.21.15.117:0/921474531 wait complete. 2024-08-18T22:18:58.090 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 4ec5efef-c389-4ce1-b35b-5eb1f849b2f5 4 2024-08-18T22:18:58.145 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:58.143+0000 7efe0e8d6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-18T22:18:58.176 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:58.176+0000 7fc285744180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-18T22:18:58.209 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:58.207+0000 7efe0e8d6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-18T22:18:58.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.223+0000 7f4bacc00640 1 Processor -- start 2024-08-18T22:18:58.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.223+0000 7f4bacc00640 1 -- start start 2024-08-18T22:18:58.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4bacc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4ba809aca0 0x7f4ba80afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4bacc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ba809b080 0x7f4ba80b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4bacc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba806e8a0 con 0x7f4ba80b1300 2024-08-18T22:18:58.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4bacc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba809bb80 con 0x7f4ba809b080 2024-08-18T22:18:58.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4bacc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba80d2e40 con 0x7f4ba809aca0 2024-08-18T22:18:58.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4ba5e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4ba809aca0 0x7f4ba80afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4ba5e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4ba809aca0 0x7f4ba80afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52340/0 (socket says 172.21.15.117:52340) 2024-08-18T22:18:58.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4ba5e00640 1 -- 172.21.15.117:0/4097173285 learned_addr learned my addr 172.21.15.117:0/4097173285 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:58.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4ba6800640 1 --2- 172.21.15.117:0/4097173285 >> v2:172.21.15.5:3300/0 conn(0x7f4ba809b080 0x7f4ba80b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4ba5e00640 1 -- 172.21.15.117:0/4097173285 >> v2:172.21.15.5:3300/0 conn(0x7f4ba809b080 msgr2=0x7f4ba80b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:18:58.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4ba5e00640 1 --2- 172.21.15.117:0/4097173285 >> v2:172.21.15.5:3300/0 conn(0x7f4ba809b080 0x7f4ba80b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4ba5e00640 1 -- 172.21.15.117:0/4097173285 >> v1:172.21.15.5:6789/0 conn(0x7f4ba80b1300 legacy=0x7f4ba80affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4ba5e00640 1 -- 172.21.15.117:0/4097173285 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba806cbd0 con 0x7f4ba809aca0 2024-08-18T22:18:58.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.227+0000 7f4ba5400640 1 -- 172.21.15.117:0/4097173285 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2330405667 0 0) 0x7f4ba806e8a0 con 0x7f4ba80b1300 2024-08-18T22:18:58.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4ba5e00640 1 --2- 172.21.15.117:0/4097173285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba809aca0 0x7f4ba80afa90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4ba806f260 tx=0x7f4b9801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a138b8c9a0f7394f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:58.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4ba5400640 1 -- 172.21.15.117:0/4097173285 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b980b1070 con 0x7f4ba809aca0 2024-08-18T22:18:58.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4ba5400640 1 -- 172.21.15.117:0/4097173285 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b980ac630 con 0x7f4ba809aca0 2024-08-18T22:18:58.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4ba5400640 1 -- 172.21.15.117:0/4097173285 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b980a8050 con 0x7f4ba809aca0 2024-08-18T22:18:58.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4bacc00640 1 -- 172.21.15.117:0/4097173285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba809aca0 msgr2=0x7f4ba80afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4bacc00640 1 --2- 172.21.15.117:0/4097173285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba809aca0 0x7f4ba80afa90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4ba806f260 tx=0x7f4b9801c520 comp rx=0 tx=0).stop 2024-08-18T22:18:58.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4bacc00640 1 -- 172.21.15.117:0/4097173285 shutdown_connections 2024-08-18T22:18:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4bacc00640 1 --2- 172.21.15.117:0/4097173285 >> v2:172.21.15.5:3300/0 conn(0x7f4ba809b080 0x7f4ba80b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4bacc00640 1 --2- 172.21.15.117:0/4097173285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba809aca0 0x7f4ba80afa90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4bacc00640 1 -- 172.21.15.117:0/4097173285 >> 172.21.15.117:0/4097173285 conn(0x7f4ba80d2180 msgr2=0x7f4ba80d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4bacc00640 1 -- 172.21.15.117:0/4097173285 shutdown_connections 2024-08-18T22:18:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4bacc00640 1 -- 172.21.15.117:0/4097173285 wait complete. 2024-08-18T22:18:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4bacc00640 1 Processor -- start 2024-08-18T22:18:58.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.231+0000 7f4bacc00640 1 -- start start 2024-08-18T22:18:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4bacc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba809aca0 0x7f4ba8140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4bacc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba809b080 0x7f4ba8156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4bacc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba80b1300 0x7f4ba80b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4bacc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba816b6b0 con 0x7f4ba809b080 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4bacc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba816b530 con 0x7f4ba80b1300 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4bacc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba816b830 con 0x7f4ba809aca0 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4ba5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba809aca0 0x7f4ba8140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4ba6800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba80b1300 0x7f4ba80b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4ba5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba809aca0 0x7f4ba8140ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:60416/0 (socket says 172.21.15.117:60416) 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4ba5e00640 1 -- 172.21.15.117:0/3795092947 learned_addr learned my addr 172.21.15.117:0/3795092947 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4b9d400640 1 --2- 172.21.15.117:0/3795092947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba809b080 0x7f4ba8156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4ba5e00640 1 -- 172.21.15.117:0/3795092947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba80b1300 msgr2=0x7f4ba80b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4ba5e00640 1 --2- 172.21.15.117:0/3795092947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba80b1300 0x7f4ba80b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4ba5e00640 1 -- 172.21.15.117:0/3795092947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba809b080 msgr2=0x7f4ba8156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4ba5e00640 1 --2- 172.21.15.117:0/3795092947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba809b080 0x7f4ba8156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4ba5e00640 1 -- 172.21.15.117:0/3795092947 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba8154120 con 0x7f4ba809aca0 2024-08-18T22:18:58.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4ba6800640 1 --2- 172.21.15.117:0/3795092947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba80b1300 0x7f4ba80b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:18:58.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4ba5e00640 1 --2- 172.21.15.117:0/3795092947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba809aca0 0x7f4ba8140ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4b980af040 tx=0x7f4b9801ad60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:58.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4b9ea00640 1 -- 172.21.15.117:0/3795092947 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b980bb020 con 0x7f4ba809aca0 2024-08-18T22:18:58.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4b9ea00640 1 -- 172.21.15.117:0/3795092947 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b980b7640 con 0x7f4ba809aca0 2024-08-18T22:18:58.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4b9ea00640 1 -- 172.21.15.117:0/3795092947 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b980b1040 con 0x7f4ba809aca0 2024-08-18T22:18:58.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4bacc00640 1 -- 172.21.15.117:0/3795092947 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba8141220 con 0x7f4ba809aca0 2024-08-18T22:18:58.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4bacc00640 1 -- 172.21.15.117:0/3795092947 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba8157220 con 0x7f4ba809aca0 2024-08-18T22:18:58.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4b9ea00640 1 -- 172.21.15.117:0/3795092947 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4b980be020 con 0x7f4ba809aca0 2024-08-18T22:18:58.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4b9ea00640 1 -- 172.21.15.117:0/3795092947 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4b980c0c30 con 0x7f4ba809aca0 2024-08-18T22:18:58.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.235+0000 7f4bacc00640 1 -- 172.21.15.117:0/3795092947 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba8161940 con 0x7f4ba809aca0 2024-08-18T22:18:58.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.239+0000 7f4b9ea00640 1 -- 172.21.15.117:0/3795092947 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f4ba8154120 con 0x7f4ba809aca0 2024-08-18T22:18:58.242 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:58.240+0000 7fc285744180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-18T22:18:58.274 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:58.275+0000 7efe0e8d6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-18T22:18:58.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.307+0000 7f4bacc00640 1 -- 172.21.15.117:0/3795092947 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4ec5efef-c389-4ce1-b35b-5eb1f849b2f5", "id": 4} v 0) -- 0x7f4ba8070a80 con 0x7f4ba809aca0 2024-08-18T22:18:58.307 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:58.304+0000 7fc285744180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-18T22:18:58.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.311+0000 7f4b9ea00640 1 -- 172.21.15.117:0/3795092947 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ec5efef-c389-4ce1-b35b-5eb1f849b2f5", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f4b98016110 con 0x7f4ba809aca0 2024-08-18T22:18:58.311 INFO:teuthology.orchestra.run.smithi117.stdout:4 2024-08-18T22:18:58.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.311+0000 7f4bacc00640 1 -- 172.21.15.117:0/3795092947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba809aca0 msgr2=0x7f4ba8140ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.311+0000 7f4bacc00640 1 --2- 172.21.15.117:0/3795092947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba809aca0 0x7f4ba8140ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4b980af040 tx=0x7f4b9801ad60 comp rx=0 tx=0).stop 2024-08-18T22:18:58.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.311+0000 7f4bacc00640 1 -- 172.21.15.117:0/3795092947 shutdown_connections 2024-08-18T22:18:58.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.311+0000 7f4bacc00640 1 --2- 172.21.15.117:0/3795092947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ba80b1300 0x7f4ba80b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.311+0000 7f4bacc00640 1 --2- 172.21.15.117:0/3795092947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ba809b080 0x7f4ba8156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.311+0000 7f4bacc00640 1 --2- 172.21.15.117:0/3795092947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ba809aca0 0x7f4ba8140ce0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.311+0000 7f4bacc00640 1 -- 172.21.15.117:0/3795092947 >> 172.21.15.117:0/3795092947 conn(0x7f4ba80d2180 msgr2=0x7f4ba80711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:58.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.311+0000 7f4bacc00640 1 -- 172.21.15.117:0/3795092947 shutdown_connections 2024-08-18T22:18:58.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.311+0000 7f4bacc00640 1 -- 172.21.15.117:0/3795092947 wait complete. 2024-08-18T22:18:58.331 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 968481cc-7b86-4f1d-b75b-d26d7a16f6d3 5 2024-08-18T22:18:58.368 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:58.367+0000 7efe0e8d6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-18T22:18:58.400 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:58.396+0000 7fc285744180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-18T22:18:58.430 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:58.431+0000 7efe0e8d6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-18T22:18:58.463 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:58.460+0000 7fc285744180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-18T22:18:58.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.463+0000 7f431fc00640 1 Processor -- start 2024-08-18T22:18:58.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.463+0000 7f431fc00640 1 -- start start 2024-08-18T22:18:58.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431fc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f43180b1300 0x7f4318162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431fc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f431809b080 0x7f43180b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431fc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431806e8a0 con 0x7f431809aca0 2024-08-18T22:18:58.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431fc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f431809bb80 con 0x7f43180b1300 2024-08-18T22:18:58.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431fc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f43180d2e40 con 0x7f431809b080 2024-08-18T22:18:58.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431dc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f431809b080 0x7f43180b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431dc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f431809b080 0x7f43180b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52354/0 (socket says 172.21.15.117:52354) 2024-08-18T22:18:58.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431dc00640 1 -- 172.21.15.117:0/4089728579 learned_addr learned my addr 172.21.15.117:0/4089728579 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:58.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f430fe00640 1 --2- 172.21.15.117:0/4089728579 >> v2:172.21.15.5:3300/0 conn(0x7f43180b1300 0x7f4318162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431dc00640 1 -- 172.21.15.117:0/4089728579 >> v2:172.21.15.5:3300/0 conn(0x7f43180b1300 msgr2=0x7f4318162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:18:58.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431dc00640 1 --2- 172.21.15.117:0/4089728579 >> v2:172.21.15.5:3300/0 conn(0x7f43180b1300 0x7f4318162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431dc00640 1 -- 172.21.15.117:0/4089728579 >> v1:172.21.15.117:6789/0 conn(0x7f431809aca0 legacy=0x7f43180afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f431dc00640 1 -- 172.21.15.117:0/4089728579 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431806cbd0 con 0x7f431809b080 2024-08-18T22:18:58.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.467+0000 7f430fe00640 1 --2- 172.21.15.117:0/4089728579 >> v2:172.21.15.5:3300/0 conn(0x7f43180b1300 0x7f4318162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:18:58.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f431dc00640 1 --2- 172.21.15.117:0/4089728579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f431809b080 0x7f43180b01a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4318073460 tx=0x7f431001c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfdcd61e176aa460 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:58.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f4317e00640 1 -- 172.21.15.117:0/4089728579 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43100a57d0 con 0x7f431809b080 2024-08-18T22:18:58.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f4317e00640 1 -- 172.21.15.117:0/4089728579 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43100a5970 con 0x7f431809b080 2024-08-18T22:18:58.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f4317e00640 1 -- 172.21.15.117:0/4089728579 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43100a5d40 con 0x7f431809b080 2024-08-18T22:18:58.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f431fc00640 1 -- 172.21.15.117:0/4089728579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f431809b080 msgr2=0x7f43180b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f431fc00640 1 --2- 172.21.15.117:0/4089728579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f431809b080 0x7f43180b01a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4318073460 tx=0x7f431001c9f0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f431fc00640 1 -- 172.21.15.117:0/4089728579 shutdown_connections 2024-08-18T22:18:58.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f431fc00640 1 --2- 172.21.15.117:0/4089728579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f431809b080 0x7f43180b01a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f431fc00640 1 --2- 172.21.15.117:0/4089728579 >> v2:172.21.15.5:3300/0 conn(0x7f43180b1300 0x7f4318162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f431fc00640 1 -- 172.21.15.117:0/4089728579 >> 172.21.15.117:0/4089728579 conn(0x7f43180d2180 msgr2=0x7f43180d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f431fc00640 1 -- 172.21.15.117:0/4089728579 shutdown_connections 2024-08-18T22:18:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f431fc00640 1 -- 172.21.15.117:0/4089728579 wait complete. 2024-08-18T22:18:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f431fc00640 1 Processor -- start 2024-08-18T22:18:58.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.471+0000 7f431fc00640 1 -- start start 2024-08-18T22:18:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431fc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f431809aca0 0x7f4318150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431fc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f431809b080 0x7f43180cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431fc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43180b1300 0x7f431814eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431fc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f431816bcb0 con 0x7f431809b080 2024-08-18T22:18:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431fc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f431816bb30 con 0x7f431809aca0 2024-08-18T22:18:58.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431fc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f431816be30 con 0x7f43180b1300 2024-08-18T22:18:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431d200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f431809aca0 0x7f4318150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431d200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f431809aca0 0x7f4318150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52360/0 (socket says 172.21.15.117:52360) 2024-08-18T22:18:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43180b1300 0x7f431814eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431d200640 1 -- 172.21.15.117:0/2773368992 learned_addr learned my addr 172.21.15.117:0/2773368992 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f430fe00640 1 --2- 172.21.15.117:0/2773368992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f431809b080 0x7f43180cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431d200640 1 -- 172.21.15.117:0/2773368992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43180b1300 msgr2=0x7f431814eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431d200640 1 --2- 172.21.15.117:0/2773368992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43180b1300 0x7f431814eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431d200640 1 -- 172.21.15.117:0/2773368992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f431809b080 msgr2=0x7f43180cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431d200640 1 --2- 172.21.15.117:0/2773368992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f431809b080 0x7f43180cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431d200640 1 -- 172.21.15.117:0/2773368992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43180b6760 con 0x7f431809aca0 2024-08-18T22:18:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431dc00640 1 --2- 172.21.15.117:0/2773368992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43180b1300 0x7f431814eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:18:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431d200640 1 --2- 172.21.15.117:0/2773368992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f431809aca0 0x7f4318150850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f430800c420 tx=0x7f430800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f4315600640 1 -- 172.21.15.117:0/2773368992 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43080052d0 con 0x7f431809aca0 2024-08-18T22:18:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f4315600640 1 -- 172.21.15.117:0/2773368992 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4308005470 con 0x7f431809aca0 2024-08-18T22:18:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f4315600640 1 -- 172.21.15.117:0/2773368992 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308007260 con 0x7f431809aca0 2024-08-18T22:18:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431fc00640 1 -- 172.21.15.117:0/2773368992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43180b6a40 con 0x7f431809aca0 2024-08-18T22:18:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431fc00640 1 -- 172.21.15.117:0/2773368992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43180b7000 con 0x7f431809aca0 2024-08-18T22:18:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f4315600640 1 -- 172.21.15.117:0/2773368992 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4308007400 con 0x7f431809aca0 2024-08-18T22:18:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f4315600640 1 -- 172.21.15.117:0/2773368992 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f4308006d60 con 0x7f431809aca0 2024-08-18T22:18:58.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.475+0000 7f431fc00640 1 -- 172.21.15.117:0/2773368992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43180afa90 con 0x7f431809aca0 2024-08-18T22:18:58.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.479+0000 7f4315600640 1 -- 172.21.15.117:0/2773368992 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f4308003600 con 0x7f431809aca0 2024-08-18T22:18:58.523 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:58.523+0000 7efe0e8d6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-18T22:18:58.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.547+0000 7f431fc00640 1 -- 172.21.15.117:0/2773368992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "968481cc-7b86-4f1d-b75b-d26d7a16f6d3", "id": 5} v 0) -- 0x7f431815dde0 con 0x7f431809aca0 2024-08-18T22:18:58.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.551+0000 7f4315600640 1 -- 172.21.15.117:0/2773368992 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "968481cc-7b86-4f1d-b75b-d26d7a16f6d3", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f4308003b00 con 0x7f431809aca0 2024-08-18T22:18:58.551 INFO:teuthology.orchestra.run.smithi117.stdout:5 2024-08-18T22:18:58.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.551+0000 7f431fc00640 1 -- 172.21.15.117:0/2773368992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f431809aca0 msgr2=0x7f4318150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.551+0000 7f431fc00640 1 --2- 172.21.15.117:0/2773368992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f431809aca0 0x7f4318150850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f430800c420 tx=0x7f430800c8e0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.551+0000 7f431fc00640 1 -- 172.21.15.117:0/2773368992 shutdown_connections 2024-08-18T22:18:58.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.551+0000 7f431fc00640 1 --2- 172.21.15.117:0/2773368992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43180b1300 0x7f431814eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.551+0000 7f431fc00640 1 --2- 172.21.15.117:0/2773368992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f431809b080 0x7f43180cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.551+0000 7f431fc00640 1 --2- 172.21.15.117:0/2773368992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f431809aca0 0x7f4318150850 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.551+0000 7f431fc00640 1 -- 172.21.15.117:0/2773368992 >> 172.21.15.117:0/2773368992 conn(0x7f43180d2180 msgr2=0x7f43180d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:58.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.551+0000 7f431fc00640 1 -- 172.21.15.117:0/2773368992 shutdown_connections 2024-08-18T22:18:58.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.551+0000 7f431fc00640 1 -- 172.21.15.117:0/2773368992 wait complete. 2024-08-18T22:18:58.558 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:58.556+0000 7fc285744180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-18T22:18:58.570 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new cbe8d5b9-094d-4440-9ad0-c91f3bdb191a 6 2024-08-18T22:18:58.590 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:58.591+0000 7efe0e8d6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-18T22:18:58.624 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:58.624+0000 7fc285744180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-18T22:18:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.723+0000 7f3b4c600640 1 Processor -- start 2024-08-18T22:18:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.723+0000 7f3b4c600640 1 -- start start 2024-08-18T22:18:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b4c600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b4409aca0 0x7f3b4409b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b4c600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b440b1410 0x7f3b440d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b4c600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b4409b6a0 con 0x7f3b440b1960 2024-08-18T22:18:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b4c600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3b4406e670 con 0x7f3b440b1410 2024-08-18T22:18:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b4c600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4406e8a0 con 0x7f3b4409aca0 2024-08-18T22:18:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b49c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b4409aca0 0x7f3b4409b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b49c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b4409aca0 0x7f3b4409b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:60444/0 (socket says 172.21.15.117:60444) 2024-08-18T22:18:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b49c00640 1 -- 172.21.15.117:0/1277194132 learned_addr learned my addr 172.21.15.117:0/1277194132 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b4a600640 1 --2- 172.21.15.117:0/1277194132 >> v2:172.21.15.117:3300/0 conn(0x7f3b440b1410 0x7f3b440d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b49c00640 1 -- 172.21.15.117:0/1277194132 >> v2:172.21.15.117:3300/0 conn(0x7f3b440b1410 msgr2=0x7f3b440d1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:18:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b49c00640 1 --2- 172.21.15.117:0/1277194132 >> v2:172.21.15.117:3300/0 conn(0x7f3b440b1410 0x7f3b440d1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b49c00640 1 -- 172.21.15.117:0/1277194132 >> v1:172.21.15.117:6789/0 conn(0x7f3b440b1960 legacy=0x7f3b4406ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b49c00640 1 -- 172.21.15.117:0/1277194132 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b440d2e40 con 0x7f3b4409aca0 2024-08-18T22:18:58.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.727+0000 7f3b49c00640 1 --2- 172.21.15.117:0/1277194132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b4409aca0 0x7f3b4409b080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009870 tx=0x7f3b3801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbe76643ba3c302f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:58.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b43e00640 1 -- 172.21.15.117:0/1277194132 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b380b5070 con 0x7f3b4409aca0 2024-08-18T22:18:58.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b43e00640 1 -- 172.21.15.117:0/1277194132 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b380a8a50 con 0x7f3b4409aca0 2024-08-18T22:18:58.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b43e00640 1 -- 172.21.15.117:0/1277194132 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b380a8e20 con 0x7f3b4409aca0 2024-08-18T22:18:58.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 -- 172.21.15.117:0/1277194132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b4409aca0 msgr2=0x7f3b4409b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 --2- 172.21.15.117:0/1277194132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b4409aca0 0x7f3b4409b080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009870 tx=0x7f3b3801ed50 comp rx=0 tx=0).stop 2024-08-18T22:18:58.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 -- 172.21.15.117:0/1277194132 shutdown_connections 2024-08-18T22:18:58.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 --2- 172.21.15.117:0/1277194132 >> v2:172.21.15.117:3300/0 conn(0x7f3b440b1410 0x7f3b440d1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 --2- 172.21.15.117:0/1277194132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b4409aca0 0x7f3b4409b080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 -- 172.21.15.117:0/1277194132 >> 172.21.15.117:0/1277194132 conn(0x7f3b440d2180 msgr2=0x7f3b440d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:58.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 -- 172.21.15.117:0/1277194132 shutdown_connections 2024-08-18T22:18:58.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 -- 172.21.15.117:0/1277194132 wait complete. 2024-08-18T22:18:58.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 Processor -- start 2024-08-18T22:18:58.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 -- start start 2024-08-18T22:18:58.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4409aca0 0x7f3b44154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b440b1410 0x7f3b4415df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b440b1960 0x7f3b441fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4406fc50 con 0x7f3b4409aca0 2024-08-18T22:18:58.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4406fad0 con 0x7f3b440b1410 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4c600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4406fdd0 con 0x7f3b440b1960 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b49200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b440b1410 0x7f3b4415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.731+0000 7f3b4a600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b440b1960 0x7f3b441fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b4a600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b440b1960 0x7f3b441fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:60456/0 (socket says 172.21.15.117:60456) 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b4a600640 1 -- 172.21.15.117:0/748719820 learned_addr learned my addr 172.21.15.117:0/748719820 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b49200640 1 --2- 172.21.15.117:0/748719820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b440b1410 0x7f3b4415df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52376/0 (socket says 172.21.15.117:52376) 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b49c00640 1 --2- 172.21.15.117:0/748719820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4409aca0 0x7f3b44154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b4a600640 1 -- 172.21.15.117:0/748719820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b440b1410 msgr2=0x7f3b4415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b4a600640 1 --2- 172.21.15.117:0/748719820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b440b1410 0x7f3b4415df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b4a600640 1 -- 172.21.15.117:0/748719820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4409aca0 msgr2=0x7f3b44154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b4a600640 1 --2- 172.21.15.117:0/748719820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4409aca0 0x7f3b44154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b4a600640 1 -- 172.21.15.117:0/748719820 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4415e960 con 0x7f3b440b1960 2024-08-18T22:18:58.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b4a600640 1 --2- 172.21.15.117:0/748719820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b440b1960 0x7f3b441fbea0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00efc0 tx=0x7f3b3c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b41600640 1 -- 172.21.15.117:0/748719820 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c018020 con 0x7f3b440b1960 2024-08-18T22:18:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b41600640 1 -- 172.21.15.117:0/748719820 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c014480 con 0x7f3b440b1960 2024-08-18T22:18:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b41600640 1 -- 172.21.15.117:0/748719820 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c014870 con 0x7f3b440b1960 2024-08-18T22:18:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b4c600640 1 -- 172.21.15.117:0/748719820 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4415ec40 con 0x7f3b440b1960 2024-08-18T22:18:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b4c600640 1 -- 172.21.15.117:0/748719820 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b4415f200 con 0x7f3b440b1960 2024-08-18T22:18:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b41600640 1 -- 172.21.15.117:0/748719820 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3b3c01b020 con 0x7f3b440b1960 2024-08-18T22:18:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b41600640 1 -- 172.21.15.117:0/748719820 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f3b3c0139d0 con 0x7f3b440b1960 2024-08-18T22:18:58.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.735+0000 7f3b4c600640 1 -- 172.21.15.117:0/748719820 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b4409b080 con 0x7f3b440b1960 2024-08-18T22:18:58.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.739+0000 7f3b41600640 1 -- 172.21.15.117:0/748719820 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f3b3c022070 con 0x7f3b440b1960 2024-08-18T22:18:58.765 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:58.763+0000 7efe0e8d6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-18T22:18:58.800 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:58.800+0000 7fc285744180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-18T22:18:58.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.803+0000 7f3b4c600640 1 -- 172.21.15.117:0/748719820 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cbe8d5b9-094d-4440-9ad0-c91f3bdb191a", "id": 6} v 0) -- 0x7f3b440d1f40 con 0x7f3b440b1960 2024-08-18T22:18:58.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.807+0000 7f3b41600640 1 -- 172.21.15.117:0/748719820 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cbe8d5b9-094d-4440-9ad0-c91f3bdb191a", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f3b3c010040 con 0x7f3b440b1960 2024-08-18T22:18:58.811 INFO:teuthology.orchestra.run.smithi117.stdout:6 2024-08-18T22:18:58.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.811+0000 7f3b4c600640 1 -- 172.21.15.117:0/748719820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b440b1960 msgr2=0x7f3b441fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.811+0000 7f3b4c600640 1 --2- 172.21.15.117:0/748719820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b440b1960 0x7f3b441fbea0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00efc0 tx=0x7f3b3c00c490 comp rx=0 tx=0).stop 2024-08-18T22:18:58.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.811+0000 7f3b4c600640 1 -- 172.21.15.117:0/748719820 shutdown_connections 2024-08-18T22:18:58.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.811+0000 7f3b4c600640 1 --2- 172.21.15.117:0/748719820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b440b1960 0x7f3b441fbea0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.811+0000 7f3b4c600640 1 --2- 172.21.15.117:0/748719820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b440b1410 0x7f3b4415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.811+0000 7f3b4c600640 1 --2- 172.21.15.117:0/748719820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b4409aca0 0x7f3b44154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.811+0000 7f3b4c600640 1 -- 172.21.15.117:0/748719820 >> 172.21.15.117:0/748719820 conn(0x7f3b440d2180 msgr2=0x7f3b44070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:58.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.811+0000 7f3b4c600640 1 -- 172.21.15.117:0/748719820 shutdown_connections 2024-08-18T22:18:58.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.811+0000 7f3b4c600640 1 -- 172.21.15.117:0/748719820 wait complete. 2024-08-18T22:18:58.828 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new bb964935-4b9c-4fdf-a348-0ccd0de5abd7 7 2024-08-18T22:18:58.840 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:58.839+0000 7efe0e8d6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-18T22:18:58.876 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:58.872+0000 7fc285744180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-18T22:18:58.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fcefa000640 1 Processor -- start 2024-08-18T22:18:58.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fcefa000640 1 -- start start 2024-08-18T22:18:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fcefa000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcef415fb80 0x7fcef40d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fcefa000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef40b5ad0 0x7fcef406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fcefa000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcef40d30b0 con 0x7fcef4071550 2024-08-18T22:18:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fcefa000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcef40d1eb0 con 0x7fcef415fb80 2024-08-18T22:18:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fcefa000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcef40d1bd0 con 0x7fcef40b5ad0 2024-08-18T22:18:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fceebe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef40b5ad0 0x7fcef406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fcef3e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcef4071550 0x7fcef409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:57980/0 (socket says 172.21.15.117:57980) 2024-08-18T22:18:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fcef3e00640 1 -- 172.21.15.117:0/3988206698 learned_addr learned my addr 172.21.15.117:0/3988206698 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-08-18T22:18:58.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fcef3400640 1 --2- 172.21.15.117:0/3988206698 >> v2:172.21.15.5:3300/0 conn(0x7fcef415fb80 0x7fcef40d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fceebe00640 1 -- 172.21.15.117:0/3988206698 >> v2:172.21.15.5:3300/0 conn(0x7fcef415fb80 msgr2=0x7fcef40d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:18:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fceebe00640 1 --2- 172.21.15.117:0/3988206698 >> v2:172.21.15.5:3300/0 conn(0x7fcef415fb80 0x7fcef40d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fceebe00640 1 -- 172.21.15.117:0/3988206698 >> v1:172.21.15.117:6789/0 conn(0x7fcef4071550 legacy=0x7fcef409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fceebe00640 1 -- 172.21.15.117:0/3988206698 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef40d2dd0 con 0x7fcef40b5ad0 2024-08-18T22:18:58.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.963+0000 7fcef2a00640 1 -- 172.21.15.117:0/3988206698 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424718805 0 0) 0x7fcef40d30b0 con 0x7fcef4071550 2024-08-18T22:18:58.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fceebe00640 1 --2- 172.21.15.117:0/3988206698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef40b5ad0 0x7fcef406fad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0097c0 tx=0x7fcedc01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6981732c3d5c832f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:58.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fcef2a00640 1 -- 172.21.15.117:0/3988206698 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0b0070 con 0x7fcef40b5ad0 2024-08-18T22:18:58.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fcef2a00640 1 -- 172.21.15.117:0/3988206698 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcedc0ab600 con 0x7fcef40b5ad0 2024-08-18T22:18:58.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fcef2a00640 1 -- 172.21.15.117:0/3988206698 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0ab9d0 con 0x7fcef40b5ad0 2024-08-18T22:18:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fcefa000640 1 -- 172.21.15.117:0/3988206698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef40b5ad0 msgr2=0x7fcef406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fcefa000640 1 --2- 172.21.15.117:0/3988206698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef40b5ad0 0x7fcef406fad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0097c0 tx=0x7fcedc01c380 comp rx=0 tx=0).stop 2024-08-18T22:18:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fcefa000640 1 -- 172.21.15.117:0/3988206698 shutdown_connections 2024-08-18T22:18:58.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fcefa000640 1 --2- 172.21.15.117:0/3988206698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef40b5ad0 0x7fcef406fad0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fcefa000640 1 --2- 172.21.15.117:0/3988206698 >> v2:172.21.15.5:3300/0 conn(0x7fcef415fb80 0x7fcef40d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fcefa000640 1 -- 172.21.15.117:0/3988206698 >> 172.21.15.117:0/3988206698 conn(0x7fcef40d2180 msgr2=0x7fcef40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fcefa000640 1 -- 172.21.15.117:0/3988206698 shutdown_connections 2024-08-18T22:18:58.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.967+0000 7fcefa000640 1 -- 172.21.15.117:0/3988206698 wait complete. 2024-08-18T22:18:58.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcefa000640 1 Processor -- start 2024-08-18T22:18:58.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcefa000640 1 -- start start 2024-08-18T22:18:58.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcefa000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef4071550 0x7fcef40af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcefa000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef40b5ad0 0x7fcef414a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcefa000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef415fb80 0x7fcef4146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:58.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcefa000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcef4071b40 con 0x7fcef40b5ad0 2024-08-18T22:18:58.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcefa000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcef40719c0 con 0x7fcef415fb80 2024-08-18T22:18:58.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcefa000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcef409b150 con 0x7fcef4071550 2024-08-18T22:18:58.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcef3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef4071550 0x7fcef40af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcef3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef415fb80 0x7fcef4146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcef3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef4071550 0x7fcef40af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:60466/0 (socket says 172.21.15.117:60466) 2024-08-18T22:18:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcef3400640 1 -- 172.21.15.117:0/2099888981 learned_addr learned my addr 172.21.15.117:0/2099888981 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-08-18T22:18:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fceebe00640 1 --2- 172.21.15.117:0/2099888981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef40b5ad0 0x7fcef414a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcef3e00640 1 -- 172.21.15.117:0/2099888981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef4071550 msgr2=0x7fcef40af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcef3e00640 1 --2- 172.21.15.117:0/2099888981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef4071550 0x7fcef40af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcef3e00640 1 -- 172.21.15.117:0/2099888981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef40b5ad0 msgr2=0x7fcef414a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcef3e00640 1 --2- 172.21.15.117:0/2099888981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef40b5ad0 0x7fcef414a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcef3e00640 1 -- 172.21.15.117:0/2099888981 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef414a820 con 0x7fcef415fb80 2024-08-18T22:18:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcef3400640 1 --2- 172.21.15.117:0/2099888981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef4071550 0x7fcef40af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:18:58.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcef3e00640 1 --2- 172.21.15.117:0/2099888981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef415fb80 0x7fcef4146950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fceec00c6e0 tx=0x7fceec00cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:58.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fceeb400640 1 -- 172.21.15.117:0/2099888981 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec018070 con 0x7fcef415fb80 2024-08-18T22:18:58.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fceeb400640 1 -- 172.21.15.117:0/2099888981 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceec004d90 con 0x7fcef415fb80 2024-08-18T22:18:58.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fceeb400640 1 -- 172.21.15.117:0/2099888981 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec00a880 con 0x7fcef415fb80 2024-08-18T22:18:58.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcefa000640 1 -- 172.21.15.117:0/2099888981 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef40afda0 con 0x7fcef415fb80 2024-08-18T22:18:58.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fcefa000640 1 -- 172.21.15.117:0/2099888981 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef4149a50 con 0x7fcef415fb80 2024-08-18T22:18:58.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fceeb400640 1 -- 172.21.15.117:0/2099888981 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fceec00aa20 con 0x7fcef415fb80 2024-08-18T22:18:58.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.971+0000 7fceeb400640 1 -- 172.21.15.117:0/2099888981 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fceec00ad10 con 0x7fcef415fb80 2024-08-18T22:18:58.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.975+0000 7fcefa000640 1 -- 172.21.15.117:0/2099888981 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef406fad0 con 0x7fcef415fb80 2024-08-18T22:18:58.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:58.979+0000 7fceeb400640 1 -- 172.21.15.117:0/2099888981 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fceec0070d0 con 0x7fcef415fb80 2024-08-18T22:18:59.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:59.043+0000 7fcefa000640 1 -- 172.21.15.117:0/2099888981 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bb964935-4b9c-4fdf-a348-0ccd0de5abd7", "id": 7} v 0) -- 0x7fcef404fd80 con 0x7fcef415fb80 2024-08-18T22:18:59.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:59.051+0000 7fceeb400640 1 -- 172.21.15.117:0/2099888981 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb964935-4b9c-4fdf-a348-0ccd0de5abd7", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fceec0072b0 con 0x7fcef415fb80 2024-08-18T22:18:59.052 INFO:teuthology.orchestra.run.smithi117.stdout:7 2024-08-18T22:18:59.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:59.051+0000 7fcefa000640 1 -- 172.21.15.117:0/2099888981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef415fb80 msgr2=0x7fcef4146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:59.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:59.051+0000 7fcefa000640 1 --2- 172.21.15.117:0/2099888981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef415fb80 0x7fcef4146950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fceec00c6e0 tx=0x7fceec00cba0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:59.051+0000 7fcefa000640 1 -- 172.21.15.117:0/2099888981 shutdown_connections 2024-08-18T22:18:59.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:59.051+0000 7fcefa000640 1 --2- 172.21.15.117:0/2099888981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef415fb80 0x7fcef4146950 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:59.051+0000 7fcefa000640 1 --2- 172.21.15.117:0/2099888981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcef40b5ad0 0x7fcef414a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:59.051+0000 7fcefa000640 1 --2- 172.21.15.117:0/2099888981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef4071550 0x7fcef40af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:59.051+0000 7fcefa000640 1 -- 172.21.15.117:0/2099888981 >> 172.21.15.117:0/2099888981 conn(0x7fcef40d2180 msgr2=0x7fcef415eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:59.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:59.051+0000 7fcefa000640 1 -- 172.21.15.117:0/2099888981 shutdown_connections 2024-08-18T22:18:59.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:18:59.051+0000 7fcefa000640 1 -- 172.21.15.117:0/2099888981 wait complete. 2024-08-18T22:18:59.071 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-18T22:18:59.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-18T22:18:59.074 INFO:tasks.ceph.osd.0:Started 2024-08-18T22:18:59.074 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-18T22:18:59.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-18T22:18:59.077 INFO:tasks.ceph.osd.1:Started 2024-08-18T22:18:59.077 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-18T22:18:59.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-18T22:18:59.080 INFO:tasks.ceph.osd.2:Started 2024-08-18T22:18:59.080 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-18T22:18:59.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-18T22:18:59.083 INFO:tasks.ceph.osd.3:Started 2024-08-18T22:18:59.084 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-18T22:18:59.084 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-18T22:18:59.116 INFO:tasks.ceph.osd.4:Started 2024-08-18T22:18:59.117 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-18T22:18:59.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-18T22:18:59.120 INFO:tasks.ceph.osd.5:Started 2024-08-18T22:18:59.120 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-18T22:18:59.120 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-18T22:18:59.123 INFO:tasks.ceph.osd.6:Started 2024-08-18T22:18:59.123 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-18T22:18:59.123 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-18T22:18:59.126 INFO:tasks.ceph.osd.7:Started 2024-08-18T22:18:59.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:18:59.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f6a00640 1 Processor -- start 2024-08-18T22:18:59.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f6a00640 1 -- start start 2024-08-18T22:18:59.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f6a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 0x7fd4f006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:59.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4f00ca3e0 0x7fd4f00ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:59.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f6a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f015e840 con 0x7fd4f015e460 2024-08-18T22:18:59.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f6a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f00ae750 con 0x7fd4f00ca3e0 2024-08-18T22:18:59.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f6a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f006c900 con 0x7fd4f00cee40 2024-08-18T22:18:59.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f4a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd4f00ca3e0 0x7fd4f00ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:59.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4e7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 0x7fd4f006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:59.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4efe00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd4f015e460 0x7fd4f00ae040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:36914/0 (socket says 172.21.15.5:36914) 2024-08-18T22:18:59.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4efe00640 1 -- 172.21.15.5:0/646835199 learned_addr learned my addr 172.21.15.5:0/646835199 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:18:59.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4ef400640 1 -- 172.21.15.5:0/646835199 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937416961 0 0) 0x7fd4f015e840 con 0x7fd4f015e460 2024-08-18T22:18:59.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f4a00640 1 -- 172.21.15.5:0/646835199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 msgr2=0x7fd4f006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:18:59.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f4a00640 1 --2- 172.21.15.5:0/646835199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 0x7fd4f006c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f4a00640 1 -- 172.21.15.5:0/646835199 >> v1:172.21.15.117:6789/0 conn(0x7fd4f015e460 legacy=0x7fd4f00ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:59.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.284+0000 7fd4f4a00640 1 -- 172.21.15.5:0/646835199 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f00cf320 con 0x7fd4f00ca3e0 2024-08-18T22:18:59.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4e7400640 1 --2- 172.21.15.5:0/646835199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 0x7fd4f006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:18:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4f4a00640 1 --2- 172.21.15.5:0/646835199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f00ca3e0 0x7fd4f00ca890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009d90 tx=0x7fd4e801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65690d2492192a51 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4ef400640 1 -- 172.21.15.5:0/646835199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e80b4070 con 0x7fd4f00ca3e0 2024-08-18T22:18:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4ef400640 1 -- 172.21.15.5:0/646835199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e80af600 con 0x7fd4f00ca3e0 2024-08-18T22:18:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4ef400640 1 -- 172.21.15.5:0/646835199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e80af9d0 con 0x7fd4f00ca3e0 2024-08-18T22:18:59.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4f6a00640 1 -- 172.21.15.5:0/646835199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f00ca3e0 msgr2=0x7fd4f00ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:59.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4f6a00640 1 --2- 172.21.15.5:0/646835199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f00ca3e0 0x7fd4f00ca890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009d90 tx=0x7fd4e801f150 comp rx=0 tx=0).stop 2024-08-18T22:18:59.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4f6a00640 1 -- 172.21.15.5:0/646835199 shutdown_connections 2024-08-18T22:18:59.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4f6a00640 1 --2- 172.21.15.5:0/646835199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f00ca3e0 0x7fd4f00ca890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4f6a00640 1 --2- 172.21.15.5:0/646835199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 0x7fd4f006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4f6a00640 1 -- 172.21.15.5:0/646835199 >> 172.21.15.5:0/646835199 conn(0x7fd4f009aa40 msgr2=0x7fd4f00b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:59.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4f6a00640 1 -- 172.21.15.5:0/646835199 shutdown_connections 2024-08-18T22:18:59.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.288+0000 7fd4f6a00640 1 -- 172.21.15.5:0/646835199 wait complete. 2024-08-18T22:18:59.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f6a00640 1 Processor -- start 2024-08-18T22:18:59.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f6a00640 1 -- start start 2024-08-18T22:18:59.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f6a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f00ca3e0 0x7fd4f00cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:59.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f6a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 0x7fd4f00cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:59.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f015e460 0x7fd4f0150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:18:59.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f6a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f00cfbc0 con 0x7fd4f015e460 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f6a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f00cf8e0 con 0x7fd4f00ca3e0 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f6a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f00cfea0 con 0x7fd4f00cee40 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f015e460 0x7fd4f0150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f015e460 0x7fd4f0150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35686/0 (socket says 172.21.15.5:35686) 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f4a00640 1 -- 172.21.15.5:0/3219965951 learned_addr learned my addr 172.21.15.5:0/3219965951 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4e7400640 1 --2- 172.21.15.5:0/3219965951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 0x7fd4f00cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f4a00640 1 -- 172.21.15.5:0/3219965951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 msgr2=0x7fd4f00cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4efe00640 1 --2- 172.21.15.5:0/3219965951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f00ca3e0 0x7fd4f00cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f4a00640 1 --2- 172.21.15.5:0/3219965951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 0x7fd4f00cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f4a00640 1 -- 172.21.15.5:0/3219965951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f00ca3e0 msgr2=0x7fd4f00cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f4a00640 1 --2- 172.21.15.5:0/3219965951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f00ca3e0 0x7fd4f00cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f4a00640 1 -- 172.21.15.5:0/3219965951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f00b5320 con 0x7fd4f015e460 2024-08-18T22:18:59.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4e7400640 1 --2- 172.21.15.5:0/3219965951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 0x7fd4f00cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:18:59.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4efe00640 1 --2- 172.21.15.5:0/3219965951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f00ca3e0 0x7fd4f00cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:18:59.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f4a00640 1 --2- 172.21.15.5:0/3219965951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f015e460 0x7fd4f0150380 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80b2040 tx=0x7fd4e801bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:18:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4ecc00640 1 -- 172.21.15.5:0/3219965951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e80b4040 con 0x7fd4f015e460 2024-08-18T22:18:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4ecc00640 1 -- 172.21.15.5:0/3219965951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e80039a0 con 0x7fd4f015e460 2024-08-18T22:18:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4ecc00640 1 -- 172.21.15.5:0/3219965951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8009450 con 0x7fd4f015e460 2024-08-18T22:18:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f6a00640 1 -- 172.21.15.5:0/3219965951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f00cbda0 con 0x7fd4f015e460 2024-08-18T22:18:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.292+0000 7fd4f6a00640 1 -- 172.21.15.5:0/3219965951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f00cc360 con 0x7fd4f015e460 2024-08-18T22:18:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.296+0000 7fd4ecc00640 1 -- 172.21.15.5:0/3219965951 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd4e80c4060 con 0x7fd4f015e460 2024-08-18T22:18:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.296+0000 7fd4ecc00640 1 -- 172.21.15.5:0/3219965951 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd4e80babe0 con 0x7fd4f015e460 2024-08-18T22:18:59.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.296+0000 7fd4f6a00640 1 -- 172.21.15.5:0/3219965951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f00b3620 con 0x7fd4f015e460 2024-08-18T22:18:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.300+0000 7fd4ecc00640 1 -- 172.21.15.5:0/3219965951 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fd4e8018cb0 con 0x7fd4f015e460 2024-08-18T22:18:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.412+0000 7fd4f6a00640 1 -- 172.21.15.5:0/3219965951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4f015c0c0 con 0x7fd4f015e460 2024-08-18T22:18:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.412+0000 7fd4ecc00640 1 -- 172.21.15.5:0/3219965951 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd4e80cb020 con 0x7fd4f015e460 2024-08-18T22:18:59.414 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:18:59.415 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:18:59.047526+0000","last_up_change":"0.000000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:18:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.412+0000 7fd4f6a00640 1 -- 172.21.15.5:0/3219965951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f015e460 msgr2=0x7fd4f0150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:18:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.412+0000 7fd4f6a00640 1 --2- 172.21.15.5:0/3219965951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f015e460 0x7fd4f0150380 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80b2040 tx=0x7fd4e801bef0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.412+0000 7fd4f6a00640 1 -- 172.21.15.5:0/3219965951 shutdown_connections 2024-08-18T22:18:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.412+0000 7fd4f6a00640 1 --2- 172.21.15.5:0/3219965951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f015e460 0x7fd4f0150380 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.412+0000 7fd4f6a00640 1 --2- 172.21.15.5:0/3219965951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f00cee40 0x7fd4f00cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.412+0000 7fd4f6a00640 1 --2- 172.21.15.5:0/3219965951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f00ca3e0 0x7fd4f00cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:18:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.412+0000 7fd4f6a00640 1 -- 172.21.15.5:0/3219965951 >> 172.21.15.5:0/3219965951 conn(0x7fd4f009aa40 msgr2=0x7fd4f00affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:18:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.412+0000 7fd4f6a00640 1 -- 172.21.15.5:0/3219965951 shutdown_connections 2024-08-18T22:18:59.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:18:59.412+0000 7fd4f6a00640 1 -- 172.21.15.5:0/3219965951 wait complete. 2024-08-18T22:18:59.435 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-18T22:18:59.435 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-18T22:18:59.534 INFO:tasks.ceph.mgr.x.smithi117.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-08-18T22:18:59.534 INFO:tasks.ceph.mgr.x.smithi117.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-08-18T22:18:59.534 INFO:tasks.ceph.mgr.x.smithi117.stderr: from numpy import show_config as show_numpy_config 2024-08-18T22:18:59.579 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:59.579+0000 7efe0e8d6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-18T22:18:59.642 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-08-18T22:18:59.643 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-08-18T22:18:59.643 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2024-08-18T22:18:59.678 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:59.672+0000 7fc285744180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-18T22:18:59.727 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:59.727+0000 7efe0e8d6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-18T22:18:59.729 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-18T22:18:59.728+0000 7ff806f437c0 -1 Falling back to public interface 2024-08-18T22:18:59.745 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-18T22:18:59.744+0000 7fd5f382b7c0 -1 Falling back to public interface 2024-08-18T22:18:59.761 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-18T22:18:59.760+0000 7f181f5c07c0 -1 Falling back to public interface 2024-08-18T22:18:59.769 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-18T22:18:59.768+0000 7f62259a47c0 -1 Falling back to public interface 2024-08-18T22:18:59.803 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-08-18T22:18:59.803+0000 7fc56b7cf7c0 -1 Falling back to public interface 2024-08-18T22:18:59.819 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-08-18T22:18:59.819+0000 7f14061867c0 -1 Falling back to public interface 2024-08-18T22:18:59.819 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-08-18T22:18:59.819+0000 7fcdb01e87c0 -1 Falling back to public interface 2024-08-18T22:18:59.834 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:18:59.832+0000 7fc285744180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-18T22:18:59.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-08-18T22:18:59.835+0000 7fc70450b7c0 -1 Falling back to public interface 2024-08-18T22:18:59.908 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:59.907+0000 7efe0e8d6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-18T22:18:59.981 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:18:59.979+0000 7efe0e8d6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-18T22:19:00.132 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:19:00.131+0000 7efe0e8d6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-18T22:19:00.143 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:19:00.140+0000 7fc285744180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-18T22:19:00.220 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:19:00.220+0000 7fc285744180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-18T22:19:00.241 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:00.373 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eb1e00640 1 Processor -- start 2024-08-18T22:19:00.373 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eb1e00640 1 -- start start 2024-08-18T22:19:00.374 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eb1e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac15f390 0x7f4eac06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:00.374 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eb1e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4eac06cf40 0x7f4eac06f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:00.374 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eb1e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eac0b4100 con 0x7f4eac1585c0 2024-08-18T22:19:00.374 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eb1e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4eac06d3b0 con 0x7f4eac06cf40 2024-08-18T22:19:00.374 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eb1e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4eac0b43e0 con 0x7f4eac15f390 2024-08-18T22:19:00.374 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eb0a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4eac1585c0 0x7f4eac0b3800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53046/0 (socket says 172.21.15.5:53046) 2024-08-18T22:19:00.374 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eb0a00640 1 -- 172.21.15.5:0/2702524367 learned_addr learned my addr 172.21.15.5:0/2702524367 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:00.375 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eb1400640 1 --2- 172.21.15.5:0/2702524367 >> v2:172.21.15.117:3300/0 conn(0x7f4eac06cf40 0x7f4eac06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:00.375 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eabe00640 1 --2- 172.21.15.5:0/2702524367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac15f390 0x7f4eac06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:00.375 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eab400640 1 -- 172.21.15.5:0/2702524367 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 582647341 0 0) 0x7f4eac0b4100 con 0x7f4eac1585c0 2024-08-18T22:19:00.376 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eab400640 1 -- 172.21.15.5:0/2702524367 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e94003530 con 0x7f4eac1585c0 2024-08-18T22:19:00.376 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eabe00640 1 -- 172.21.15.5:0/2702524367 >> v2:172.21.15.117:3300/0 conn(0x7f4eac06cf40 msgr2=0x7f4eac06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:00.376 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eabe00640 1 --2- 172.21.15.5:0/2702524367 >> v2:172.21.15.117:3300/0 conn(0x7f4eac06cf40 0x7f4eac06f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:00.376 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eabe00640 1 -- 172.21.15.5:0/2702524367 >> v1:172.21.15.5:6789/0 conn(0x7f4eac1585c0 legacy=0x7f4eac0b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:00.376 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eabe00640 1 -- 172.21.15.5:0/2702524367 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac0b46c0 con 0x7f4eac15f390 2024-08-18T22:19:00.376 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.372+0000 7f4eb1400640 1 --2- 172.21.15.5:0/2702524367 >> v2:172.21.15.117:3300/0 conn(0x7f4eac06cf40 0x7f4eac06f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:00.377 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eabe00640 1 --2- 172.21.15.5:0/2702524367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac15f390 0x7f4eac06ca00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4e980097c0 tx=0x7f4e9801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34f4d2b61698c43a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:00.378 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eab400640 1 -- 172.21.15.5:0/2702524367 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980b0070 con 0x7f4eac15f390 2024-08-18T22:19:00.378 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eab400640 1 -- 172.21.15.5:0/2702524367 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e980ab600 con 0x7f4eac15f390 2024-08-18T22:19:00.378 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eab400640 1 -- 172.21.15.5:0/2702524367 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980ab9b0 con 0x7f4eac15f390 2024-08-18T22:19:00.379 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2702524367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac15f390 msgr2=0x7f4eac06ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:00.379 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eb1e00640 1 --2- 172.21.15.5:0/2702524367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac15f390 0x7f4eac06ca00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4e980097c0 tx=0x7f4e9801c410 comp rx=0 tx=0).stop 2024-08-18T22:19:00.379 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2702524367 shutdown_connections 2024-08-18T22:19:00.379 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eb1e00640 1 --2- 172.21.15.5:0/2702524367 >> v2:172.21.15.117:3300/0 conn(0x7f4eac06cf40 0x7f4eac06f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:00.379 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eb1e00640 1 --2- 172.21.15.5:0/2702524367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac15f390 0x7f4eac06ca00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:00.379 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2702524367 >> 172.21.15.5:0/2702524367 conn(0x7f4eac0721e0 msgr2=0x7f4eac0725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:00.379 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2702524367 shutdown_connections 2024-08-18T22:19:00.379 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.376+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2702524367 wait complete. 2024-08-18T22:19:00.380 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1e00640 1 Processor -- start 2024-08-18T22:19:00.380 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1e00640 1 -- start start 2024-08-18T22:19:00.383 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac06cf40 0x7f4eac1633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:00.383 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eac1585c0 0x7f4eac153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:00.383 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4eac15f390 0x7f4eac153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:00.383 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac070590 con 0x7f4eac15f390 2024-08-18T22:19:00.383 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac158bb0 con 0x7f4eac1585c0 2024-08-18T22:19:00.383 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4eac070710 con 0x7f4eac06cf40 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb0a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac06cf40 0x7f4eac1633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4eac15f390 0x7f4eac153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb0a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac06cf40 0x7f4eac1633c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:37278/0 (socket says 172.21.15.5:37278) 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb0a00640 1 -- 172.21.15.5:0/2848636514 learned_addr learned my addr 172.21.15.5:0/2848636514 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eabe00640 1 --2- 172.21.15.5:0/2848636514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eac1585c0 0x7f4eac153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1400640 1 -- 172.21.15.5:0/2848636514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac06cf40 msgr2=0x7f4eac1633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1400640 1 --2- 172.21.15.5:0/2848636514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac06cf40 0x7f4eac1633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1400640 1 -- 172.21.15.5:0/2848636514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eac1585c0 msgr2=0x7f4eac153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1400640 1 --2- 172.21.15.5:0/2848636514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eac1585c0 0x7f4eac153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1400640 1 -- 172.21.15.5:0/2848636514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac157c10 con 0x7f4eac15f390 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb0a00640 1 --2- 172.21.15.5:0/2848636514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac06cf40 0x7f4eac1633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:00.384 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eabe00640 1 --2- 172.21.15.5:0/2848636514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eac1585c0 0x7f4eac153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:00.385 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1400640 1 --2- 172.21.15.5:0/2848636514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4eac15f390 0x7f4eac153d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400efc0 tx=0x7f4ea400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:00.385 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4ea8c00640 1 -- 172.21.15.5:0/2848636514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4018030 con 0x7f4eac15f390 2024-08-18T22:19:00.385 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4ea8c00640 1 -- 172.21.15.5:0/2848636514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea400ccd0 con 0x7f4eac15f390 2024-08-18T22:19:00.385 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2848636514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac156f80 con 0x7f4eac15f390 2024-08-18T22:19:00.385 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4ea8c00640 1 -- 172.21.15.5:0/2848636514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4003bc0 con 0x7f4eac15f390 2024-08-18T22:19:00.385 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2848636514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac159870 con 0x7f4eac15f390 2024-08-18T22:19:00.385 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4ea8c00640 1 -- 172.21.15.5:0/2848636514 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ea401b070 con 0x7f4eac15f390 2024-08-18T22:19:00.385 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4ea8c00640 1 -- 172.21.15.5:0/2848636514 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4ea4014b50 con 0x7f4eac15f390 2024-08-18T22:19:00.385 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.380+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2848636514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eac070ad0 con 0x7f4eac15f390 2024-08-18T22:19:00.386 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:19:00.384+0000 7fc285744180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-18T22:19:00.386 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.384+0000 7f4ea8c00640 1 -- 172.21.15.5:0/2848636514 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f4ea4022070 con 0x7f4eac15f390 2024-08-18T22:19:00.448 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.444+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2848636514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4eac072760 con 0x7f4eac15f390 2024-08-18T22:19:00.449 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.448+0000 7f4ea8c00640 1 -- 172.21.15.5:0/2848636514 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4ea4010040 con 0x7f4eac15f390 2024-08-18T22:19:00.449 INFO:teuthology.misc.health.smithi005.stdout: 2024-08-18T22:19:00.449 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:18:59.047526+0000","last_up_change":"0.000000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:00.450 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.448+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2848636514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4eac15f390 msgr2=0x7f4eac153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:00.450 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.448+0000 7f4eb1e00640 1 --2- 172.21.15.5:0/2848636514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4eac15f390 0x7f4eac153d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400efc0 tx=0x7f4ea400c490 comp rx=0 tx=0).stop 2024-08-18T22:19:00.450 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.448+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2848636514 shutdown_connections 2024-08-18T22:19:00.450 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.448+0000 7f4eb1e00640 1 --2- 172.21.15.5:0/2848636514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4eac15f390 0x7f4eac153d90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:00.451 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.448+0000 7f4eb1e00640 1 --2- 172.21.15.5:0/2848636514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4eac1585c0 0x7f4eac153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:00.451 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.448+0000 7f4eb1e00640 1 --2- 172.21.15.5:0/2848636514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4eac06cf40 0x7f4eac1633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:00.451 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.448+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2848636514 >> 172.21.15.5:0/2848636514 conn(0x7f4eac0721e0 msgr2=0x7f4eac0b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:00.451 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.448+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2848636514 shutdown_connections 2024-08-18T22:19:00.451 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:00.448+0000 7f4eb1e00640 1 -- 172.21.15.5:0/2848636514 wait complete. 2024-08-18T22:19:00.466 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-18T22:19:00.820 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:19:00.819+0000 7efe0e8d6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-18T22:19:00.906 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:19:00.907+0000 7efe0e8d6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-18T22:19:01.094 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:19:01.092+0000 7fc285744180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-18T22:19:01.110 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:19:01.111+0000 7efe0e8d6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-18T22:19:01.185 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:19:01.184+0000 7fc285744180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-18T22:19:01.194 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:19:01.195+0000 7efe0e8d6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-18T22:19:01.400 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:19:01.396+0000 7fc285744180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-18T22:19:01.491 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:19:01.488+0000 7fc285744180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-18T22:19:01.527 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:19:01.527+0000 7efe0e8d6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-18T22:19:01.599 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:19:01.599+0000 7efe0e8d6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-18T22:19:01.848 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:19:01.844+0000 7fc285744180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-18T22:19:01.923 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-08-18T22:19:01.920+0000 7fc285744180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-18T22:19:02.624 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:19:02.623+0000 7efdb3e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-18T22:19:02.624 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-08-18T22:19:02.623+0000 7efdb3e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-18T22:19:03.585 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-18T22:19:03.584+0000 7ff806f437c0 -1 osd.2 0 log_to_monitors true 2024-08-18T22:19:03.594 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-08-18T22:19:03.595+0000 7fc56b7cf7c0 -1 osd.4 0 log_to_monitors true 2024-08-18T22:19:03.729 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-18T22:19:03.728+0000 7f62259a47c0 -1 osd.3 0 log_to_monitors true 2024-08-18T22:19:03.765 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-18T22:19:03.764+0000 7fd5f382b7c0 -1 osd.1 0 log_to_monitors true 2024-08-18T22:19:03.775 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-08-18T22:19:03.775+0000 7fc70450b7c0 -1 osd.6 0 log_to_monitors true 2024-08-18T22:19:03.791 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-18T22:19:03.788+0000 7f181f5c07c0 -1 osd.0 0 log_to_monitors true 2024-08-18T22:19:03.918 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-08-18T22:19:03.915+0000 7fcdb01e87c0 -1 osd.7 0 log_to_monitors true 2024-08-18T22:19:03.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-08-18T22:19:03.923+0000 7f14061867c0 -1 osd.5 0 log_to_monitors true 2024-08-18T22:19:05.438 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-18T22:19:05.436+0000 7ff801e00640 -1 osd.2 0 waiting for initial osdmap 2024-08-18T22:19:05.466 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-08-18T22:19:05.464+0000 7ff7f7e00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:19:05.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-08-18T22:19:05.587+0000 7fc566600640 -1 osd.4 0 waiting for initial osdmap 2024-08-18T22:19:05.603 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-08-18T22:19:05.603+0000 7fc55c600640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:19:07.022 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-18T22:19:07.020+0000 7f181a400640 -1 osd.0 0 waiting for initial osdmap 2024-08-18T22:19:07.025 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-18T22:19:07.024+0000 7fd5edc00640 -1 osd.1 0 waiting for initial osdmap 2024-08-18T22:19:07.050 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-08-18T22:19:07.048+0000 7f1810400640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:19:07.058 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-08-18T22:19:07.056+0000 7fd5e3c00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:19:07.058 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-18T22:19:07.056+0000 7f6220800640 -1 osd.3 0 waiting for initial osdmap 2024-08-18T22:19:07.102 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-08-18T22:19:07.100+0000 7f6216800640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:19:07.273 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:07.404 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.400+0000 7f90b1a00640 1 Processor -- start 2024-08-18T22:19:07.405 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90b1a00640 1 -- start start 2024-08-18T22:19:07.407 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90b1a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90ac15bec0 0x7f90ac1604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:07.407 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90b1a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90ac073a50 0x7f90ac06b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:07.407 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90b1a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90ac0ceb10 0x7f90ac0cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:07.407 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90b1a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f90ac06c900 con 0x7f90ac073a50 2024-08-18T22:19:07.407 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90b1a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f90ac0cf490 con 0x7f90ac0ceb10 2024-08-18T22:19:07.407 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90b1a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f90ac15fd00 con 0x7f90ac15bec0 2024-08-18T22:19:07.407 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90a3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90ac073a50 0x7f90ac06b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:07.407 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90a3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90ac073a50 0x7f90ac06b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39352/0 (socket says 172.21.15.5:39352) 2024-08-18T22:19:07.407 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90a3400640 1 -- 172.21.15.5:0/2256434920 learned_addr learned my addr 172.21.15.5:0/2256434920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:07.407 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90b1000640 1 --2- 172.21.15.5:0/2256434920 >> v2:172.21.15.117:3300/0 conn(0x7f90ac0ceb10 0x7f90ac0cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:07.407 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90abe00640 1 --2- 172.21.15.5:0/2256434920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90ac15bec0 0x7f90ac1604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:07.408 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90a3400640 1 -- 172.21.15.5:0/2256434920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90ac15bec0 msgr2=0x7f90ac1604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:07.408 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90a3400640 1 --2- 172.21.15.5:0/2256434920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90ac15bec0 0x7f90ac1604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.408 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90a3400640 1 -- 172.21.15.5:0/2256434920 >> v2:172.21.15.117:3300/0 conn(0x7f90ac0ceb10 msgr2=0x7f90ac0cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:07.408 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90a3400640 1 --2- 172.21.15.5:0/2256434920 >> v2:172.21.15.117:3300/0 conn(0x7f90ac0ceb10 0x7f90ac0cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.408 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90a3400640 1 -- 172.21.15.5:0/2256434920 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac160a00 con 0x7f90ac073a50 2024-08-18T22:19:07.408 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.404+0000 7f90abe00640 1 --2- 172.21.15.5:0/2256434920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90ac15bec0 0x7f90ac1604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:07.409 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90a3400640 1 --2- 172.21.15.5:0/2256434920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac073a50 0x7f90ac06b9f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0ce0c0 tx=0x7f909401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274d23b95594aa16 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:07.410 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90ab400640 1 -- 172.21.15.5:0/2256434920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90940aa610 con 0x7f90ac073a50 2024-08-18T22:19:07.410 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90ab400640 1 -- 172.21.15.5:0/2256434920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90940af070 con 0x7f90ac073a50 2024-08-18T22:19:07.410 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90ab400640 1 -- 172.21.15.5:0/2256434920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90940aa9d0 con 0x7f90ac073a50 2024-08-18T22:19:07.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90b1a00640 1 -- 172.21.15.5:0/2256434920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac073a50 msgr2=0x7f90ac06b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:07.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90b1a00640 1 --2- 172.21.15.5:0/2256434920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac073a50 0x7f90ac06b9f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0ce0c0 tx=0x7f909401c4f0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90b1a00640 1 -- 172.21.15.5:0/2256434920 shutdown_connections 2024-08-18T22:19:07.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90b1a00640 1 --2- 172.21.15.5:0/2256434920 >> v2:172.21.15.117:3300/0 conn(0x7f90ac0ceb10 0x7f90ac0cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90b1a00640 1 --2- 172.21.15.5:0/2256434920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac073a50 0x7f90ac06b9f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90b1a00640 1 --2- 172.21.15.5:0/2256434920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90ac15bec0 0x7f90ac1604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90b1a00640 1 -- 172.21.15.5:0/2256434920 >> 172.21.15.5:0/2256434920 conn(0x7f90ac06cb00 msgr2=0x7f90ac06cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:07.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90b1a00640 1 -- 172.21.15.5:0/2256434920 shutdown_connections 2024-08-18T22:19:07.411 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90b1a00640 1 -- 172.21.15.5:0/2256434920 wait complete. 2024-08-18T22:19:07.412 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90b1a00640 1 Processor -- start 2024-08-18T22:19:07.412 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.408+0000 7f90b1a00640 1 -- start start 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90b1a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac073a50 0x7f90ac150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90b1a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90ac0ceb10 0x7f90ac1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90b1a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90ac15bec0 0x7f90ac15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90b1a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac06c0b0 con 0x7f90ac073a50 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90b1a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac06bf30 con 0x7f90ac0ceb10 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90b1a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f90ac06f270 con 0x7f90ac15bec0 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90abe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac073a50 0x7f90ac150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90abe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac073a50 0x7f90ac150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39368/0 (socket says 172.21.15.5:39368) 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90abe00640 1 -- 172.21.15.5:0/917116141 learned_addr learned my addr 172.21.15.5:0/917116141 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90a3400640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90ac0ceb10 0x7f90ac1597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90abe00640 1 -- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90ac15bec0 msgr2=0x7f90ac15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:07.415 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90abe00640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90ac15bec0 0x7f90ac15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90abe00640 1 -- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90ac0ceb10 msgr2=0x7f90ac1597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:07.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90abe00640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90ac0ceb10 0x7f90ac1597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90abe00640 1 -- 172.21.15.5:0/917116141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac15a020 con 0x7f90ac073a50 2024-08-18T22:19:07.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90abe00640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac073a50 0x7f90ac150150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f909c00ce00 tx=0x7f909c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:07.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90a8c00640 1 -- 172.21.15.5:0/917116141 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c00f890 con 0x7f90ac073a50 2024-08-18T22:19:07.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90a8c00640 1 -- 172.21.15.5:0/917116141 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f909c00fa30 con 0x7f90ac073a50 2024-08-18T22:19:07.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90a8c00640 1 -- 172.21.15.5:0/917116141 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c00fe40 con 0x7f90ac073a50 2024-08-18T22:19:07.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90b1a00640 1 -- 172.21.15.5:0/917116141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac15a300 con 0x7f90ac073a50 2024-08-18T22:19:07.416 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90b1a00640 1 -- 172.21.15.5:0/917116141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac15a8c0 con 0x7f90ac073a50 2024-08-18T22:19:07.417 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90b1a00640 1 -- 172.21.15.5:0/917116141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ac0cef50 con 0x7f90ac073a50 2024-08-18T22:19:07.417 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.412+0000 7f90a8c00640 1 -- 172.21.15.5:0/917116141 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f909c018400 con 0x7f90ac073a50 2024-08-18T22:19:07.417 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.416+0000 7f90a8c00640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9088067830 0x7f9088069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:07.418 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.416+0000 7f90a8c00640 1 -- 172.21.15.5:0/917116141 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2791+0+0 (secure 0 0 0) 0x7f909c085e70 con 0x7f90ac073a50 2024-08-18T22:19:07.418 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.416+0000 7f90a3400640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9088067830 0x7f9088069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:07.418 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.416+0000 7f90a3400640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9088067830 0x7f9088069cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90940ae000 tx=0x7f90940a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:07.422 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.420+0000 7f90a8c00640 1 -- 172.21.15.5:0/917116141 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f909c014030 con 0x7f90ac073a50 2024-08-18T22:19:07.475 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-08-18T22:19:07.475+0000 7fcdab000640 -1 osd.7 0 waiting for initial osdmap 2024-08-18T22:19:07.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-08-18T22:19:07.499+0000 7fc6ff400640 -1 osd.6 0 waiting for initial osdmap 2024-08-18T22:19:07.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-08-18T22:19:07.503+0000 7fcda1000640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:19:07.510 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-08-18T22:19:07.507+0000 7f1401000640 -1 osd.5 0 waiting for initial osdmap 2024-08-18T22:19:07.531 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-08-18T22:19:07.531+0000 7fc6f5400640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:19:07.539 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-08-18T22:19:07.539+0000 7f13f7000640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:19:07.592 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.588+0000 7f90b1a00640 1 -- 172.21.15.5:0/917116141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90ac06baf0 con 0x7f90ac073a50 2024-08-18T22:19:07.593 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90a8c00640 1 -- 172.21.15.5:0/917116141 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8051 (secure 0 0 0) 0x7f909c00ae20 con 0x7f90ac073a50 2024-08-18T22:19:07.593 INFO:teuthology.misc.health.smithi005.stdout: 2024-08-18T22:19:07.593 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":14,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:06.731459+0000","last_up_change":"2024-08-18T22:19:05.666494+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:07.595 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 -- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9088067830 msgr2=0x7f9088069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:07.595 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9088067830 0x7f9088069cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90940ae000 tx=0x7f90940a7000 comp rx=0 tx=0).stop 2024-08-18T22:19:07.595 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 -- 172.21.15.5:0/917116141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac073a50 msgr2=0x7f90ac150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:07.595 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac073a50 0x7f90ac150150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f909c00ce00 tx=0x7f909c00a650 comp rx=0 tx=0).stop 2024-08-18T22:19:07.595 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 -- 172.21.15.5:0/917116141 shutdown_connections 2024-08-18T22:19:07.595 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9088067830 0x7f9088069cf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.595 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90ac15bec0 0x7f90ac15b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.595 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90ac0ceb10 0x7f90ac1597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.595 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 --2- 172.21.15.5:0/917116141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90ac073a50 0x7f90ac150150 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:07.596 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 -- 172.21.15.5:0/917116141 >> 172.21.15.5:0/917116141 conn(0x7f90ac06cb00 msgr2=0x7f90ac15d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:07.596 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 -- 172.21.15.5:0/917116141 shutdown_connections 2024-08-18T22:19:07.596 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:07.592+0000 7f90b1a00640 1 -- 172.21.15.5:0/917116141 wait complete. 2024-08-18T22:19:07.612 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-08-18T22:19:14.420 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:14.563 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdf600640 1 Processor -- start 2024-08-18T22:19:14.563 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdf600640 1 -- start start 2024-08-18T22:19:14.565 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdf600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4cd815be70 0x7f4cd8072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.565 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdf600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd815c250 0x7f4cd80ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.565 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdf600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4cd80b7420 0x7f4cd80ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.565 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdf600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd80719f0 con 0x7f4cd815be70 2024-08-18T22:19:14.565 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdf600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd8072640 con 0x7f4cd80b7420 2024-08-18T22:19:14.565 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdf600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd80d04a0 con 0x7f4cd815c250 2024-08-18T22:19:14.565 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4cd815be70 0x7f4cd8072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.566 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4cd815be70 0x7f4cd8072100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46702/0 (socket says 172.21.15.5:46702) 2024-08-18T22:19:14.566 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdd600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4cd80b7420 0x7f4cd80ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.566 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4cdcc00640 1 -- 172.21.15.5:0/360667349 learned_addr learned my addr 172.21.15.5:0/360667349 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:14.566 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.559+0000 7f4ccfe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd815c250 0x7f4cd80ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.566 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.563+0000 7f4cdcc00640 1 -- 172.21.15.5:0/360667349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd815c250 msgr2=0x7f4cd80ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:14.566 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.563+0000 7f4cdcc00640 1 --2- 172.21.15.5:0/360667349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd815c250 0x7f4cd80ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.566 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.563+0000 7f4cdcc00640 1 -- 172.21.15.5:0/360667349 >> v2:172.21.15.117:3300/0 conn(0x7f4cd80b7420 msgr2=0x7f4cd80ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:14.566 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.563+0000 7f4cdcc00640 1 --2- 172.21.15.5:0/360667349 >> v2:172.21.15.117:3300/0 conn(0x7f4cd80b7420 0x7f4cd80ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.566 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.563+0000 7f4cdcc00640 1 -- 172.21.15.5:0/360667349 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd80b7920 con 0x7f4cd815be70 2024-08-18T22:19:14.568 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.563+0000 7f4cdcc00640 1 --2- 172.21.15.5:0/360667349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd815be70 0x7f4cd8072100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80d0410 tx=0x7f4cc801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337c9f8da7ac3f83 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:14.569 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.563+0000 7f4cd7e00640 1 -- 172.21.15.5:0/360667349 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80aa610 con 0x7f4cd815be70 2024-08-18T22:19:14.569 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.563+0000 7f4cd7e00640 1 -- 172.21.15.5:0/360667349 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc80af070 con 0x7f4cd815be70 2024-08-18T22:19:14.569 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.563+0000 7f4cd7e00640 1 -- 172.21.15.5:0/360667349 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80aa9d0 con 0x7f4cd815be70 2024-08-18T22:19:14.569 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 -- 172.21.15.5:0/360667349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd815be70 msgr2=0x7f4cd8072100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:14.569 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 --2- 172.21.15.5:0/360667349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd815be70 0x7f4cd8072100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80d0410 tx=0x7f4cc801c4f0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.569 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 -- 172.21.15.5:0/360667349 shutdown_connections 2024-08-18T22:19:14.569 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 --2- 172.21.15.5:0/360667349 >> v2:172.21.15.117:3300/0 conn(0x7f4cd80b7420 0x7f4cd80ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.569 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 --2- 172.21.15.5:0/360667349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd815c250 0x7f4cd80ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.570 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 --2- 172.21.15.5:0/360667349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd815be70 0x7f4cd8072100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.570 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 -- 172.21.15.5:0/360667349 >> 172.21.15.5:0/360667349 conn(0x7f4cd806c100 msgr2=0x7f4cd806fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:14.570 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 -- 172.21.15.5:0/360667349 shutdown_connections 2024-08-18T22:19:14.570 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 -- 172.21.15.5:0/360667349 wait complete. 2024-08-18T22:19:14.570 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 Processor -- start 2024-08-18T22:19:14.571 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 -- start start 2024-08-18T22:19:14.572 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd80b7420 0x7f4cd8150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd815be70 0x7f4cd8150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cd815c250 0x7f4cd806db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd8160570 con 0x7f4cd80b7420 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd81603f0 con 0x7f4cd815c250 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdf600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd81606f0 con 0x7f4cd815be70 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd80b7420 0x7f4cd8150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd80b7420 0x7f4cd8150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46718/0 (socket says 172.21.15.5:46718) 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdcc00640 1 -- 172.21.15.5:0/1387114655 learned_addr learned my addr 172.21.15.5:0/1387114655 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4ccfe00640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd815be70 0x7f4cd8150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdd600640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cd815c250 0x7f4cd806db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdcc00640 1 -- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd815be70 msgr2=0x7f4cd8150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:14.573 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdcc00640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd815be70 0x7f4cd8150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.574 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdcc00640 1 -- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cd815c250 msgr2=0x7f4cd806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:14.574 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdcc00640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cd815c250 0x7f4cd806db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.574 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdcc00640 1 -- 172.21.15.5:0/1387114655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd81f7da0 con 0x7f4cd80b7420 2024-08-18T22:19:14.574 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4ccfe00640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd815be70 0x7f4cd8150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:14.574 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.567+0000 7f4cdd600640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cd815c250 0x7f4cd806db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:14.574 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.571+0000 7f4cdcc00640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd80b7420 0x7f4cd8150700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4cc801cd90 tx=0x7f4cc801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:14.575 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.571+0000 7f4cd5600640 1 -- 172.21.15.5:0/1387114655 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80bd3f0 con 0x7f4cd80b7420 2024-08-18T22:19:14.575 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.571+0000 7f4cd5600640 1 -- 172.21.15.5:0/1387114655 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc80bd590 con 0x7f4cd80b7420 2024-08-18T22:19:14.575 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.571+0000 7f4cd5600640 1 -- 172.21.15.5:0/1387114655 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80bd960 con 0x7f4cd80b7420 2024-08-18T22:19:14.575 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.571+0000 7f4cdf600640 1 -- 172.21.15.5:0/1387114655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd81f8080 con 0x7f4cd80b7420 2024-08-18T22:19:14.575 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.571+0000 7f4cdf600640 1 -- 172.21.15.5:0/1387114655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd815e680 con 0x7f4cd80b7420 2024-08-18T22:19:14.575 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.571+0000 7f4cdf600640 1 -- 172.21.15.5:0/1387114655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd8072100 con 0x7f4cd80b7420 2024-08-18T22:19:14.575 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.571+0000 7f4cd5600640 1 -- 172.21.15.5:0/1387114655 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4cc80b33f0 con 0x7f4cd80b7420 2024-08-18T22:19:14.576 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.571+0000 7f4cd5600640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4cb40678c0 0x7f4cb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.576 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.571+0000 7f4cd5600640 1 -- 172.21.15.5:0/1387114655 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4cc811fde0 con 0x7f4cd80b7420 2024-08-18T22:19:14.576 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.571+0000 7f4ccfe00640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4cb40678c0 0x7f4cb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.577 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.575+0000 7f4ccfe00640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4cb40678c0 0x7f4cb4069d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4cd81592e0 tx=0x7f4cc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:14.581 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.579+0000 7f4cd5600640 1 -- 172.21.15.5:0/1387114655 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4cc80c3060 con 0x7f4cd80b7420 2024-08-18T22:19:14.749 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cdf600640 1 -- 172.21.15.5:0/1387114655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cd8159970 con 0x7f4cd80b7420 2024-08-18T22:19:14.750 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cd5600640 1 -- 172.21.15.5:0/1387114655 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12812 (secure 0 0 0) 0x7f4cc80a7070 con 0x7f4cd80b7420 2024-08-18T22:19:14.751 INFO:teuthology.misc.health.smithi005.stdout: 2024-08-18T22:19:14.751 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":17,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:10.046183+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:14.753 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cdf600640 1 -- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4cb40678c0 msgr2=0x7f4cb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:14.753 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cdf600640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4cb40678c0 0x7f4cb4069d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4cd81592e0 tx=0x7f4cc0008040 comp rx=0 tx=0).stop 2024-08-18T22:19:14.753 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cdf600640 1 -- 172.21.15.5:0/1387114655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd80b7420 msgr2=0x7f4cd8150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:14.753 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cdf600640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd80b7420 0x7f4cd8150700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4cc801cd90 tx=0x7f4cc801ad30 comp rx=0 tx=0).stop 2024-08-18T22:19:14.753 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cdf600640 1 -- 172.21.15.5:0/1387114655 shutdown_connections 2024-08-18T22:19:14.753 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cdf600640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4cb40678c0 0x7f4cb4069d80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.753 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cdf600640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cd815c250 0x7f4cd806db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.754 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cdf600640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cd815be70 0x7f4cd8150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.754 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cdf600640 1 --2- 172.21.15.5:0/1387114655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cd80b7420 0x7f4cd8150700 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.754 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.747+0000 7f4cdf600640 1 -- 172.21.15.5:0/1387114655 >> 172.21.15.5:0/1387114655 conn(0x7f4cd806c100 msgr2=0x7f4cd815a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:14.754 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.751+0000 7f4cdf600640 1 -- 172.21.15.5:0/1387114655 shutdown_connections 2024-08-18T22:19:14.754 INFO:teuthology.misc.health.smithi005.stderr:2024-08-18T22:19:14.751+0000 7f4cdf600640 1 -- 172.21.15.5:0/1387114655 wait complete. 2024-08-18T22:19:14.769 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-18T22:19:14.770 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-18T22:19:14.770 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:19:14.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:19:14.773 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:19:14.773 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:19:14.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:19:14.776 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:19:14.776 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:19:14.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:19:14.780 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:19:14.780 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:19:14.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:19:14.783 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:19:14.783 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-18T22:19:14.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:19:14.868 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:19:14.869 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:19:14.894 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:19:14.895 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:19:14.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.927+0000 7fbaa8a00640 1 Processor -- start 2024-08-18T22:19:14.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.927+0000 7fbaa8a00640 1 -- start start 2024-08-18T22:19:14.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.927+0000 7fbaa8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa415e140 0x7fbaa40b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.927+0000 7fbaa8a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbaa40b5e60 0x7fbaa40af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.927+0000 7fbaa8a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa40b65d0 con 0x7fbaa40afc80 2024-08-18T22:19:14.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.927+0000 7fbaa8a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa406e560 con 0x7fbaa40b5e60 2024-08-18T22:19:14.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.927+0000 7fbaa8a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa40b68b0 con 0x7fbaa415e140 2024-08-18T22:19:14.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.927+0000 7fbaa2800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbaa40afc80 0x7fbaa40ad8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33006/0 (socket says 172.21.15.5:33006) 2024-08-18T22:19:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.927+0000 7fbaa2800640 1 -- 172.21.15.5:0/1831187323 learned_addr learned my addr 172.21.15.5:0/1831187323 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.927+0000 7fbaa1e00640 1 --2- 172.21.15.5:0/1831187323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa415e140 0x7fbaa40b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.927+0000 7fba99400640 1 --2- 172.21.15.5:0/1831187323 >> v2:172.21.15.117:3300/0 conn(0x7fbaa40b5e60 0x7fbaa40af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.931+0000 7fbaa1400640 1 -- 172.21.15.5:0/1831187323 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568864932 0 0) 0x7fbaa40b65d0 con 0x7fbaa40afc80 2024-08-18T22:19:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.931+0000 7fbaa1400640 1 -- 172.21.15.5:0/1831187323 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba88003530 con 0x7fbaa40afc80 2024-08-18T22:19:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.931+0000 7fbaa1e00640 1 -- 172.21.15.5:0/1831187323 >> v2:172.21.15.117:3300/0 conn(0x7fbaa40b5e60 msgr2=0x7fbaa40af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.931+0000 7fbaa1e00640 1 --2- 172.21.15.5:0/1831187323 >> v2:172.21.15.117:3300/0 conn(0x7fbaa40b5e60 0x7fbaa40af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.931+0000 7fbaa1e00640 1 -- 172.21.15.5:0/1831187323 >> v1:172.21.15.5:6789/0 conn(0x7fbaa40afc80 legacy=0x7fbaa40ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.931+0000 7fbaa1e00640 1 -- 172.21.15.5:0/1831187323 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa406e7b0 con 0x7fbaa415e140 2024-08-18T22:19:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.931+0000 7fbaa1e00640 1 --2- 172.21.15.5:0/1831187323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa415e140 0x7fbaa40b4e40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fba940097c0 tx=0x7fba9401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e0060bd7d9da1c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.931+0000 7fbaa1400640 1 -- 172.21.15.5:0/1831187323 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940b0070 con 0x7fbaa415e140 2024-08-18T22:19:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.931+0000 7fbaa1400640 1 -- 172.21.15.5:0/1831187323 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba940ab600 con 0x7fbaa415e140 2024-08-18T22:19:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.931+0000 7fbaa1400640 1 -- 172.21.15.5:0/1831187323 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940ab9d0 con 0x7fbaa415e140 2024-08-18T22:19:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1831187323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa415e140 msgr2=0x7fbaa40b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 --2- 172.21.15.5:0/1831187323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa415e140 0x7fbaa40b4e40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fba940097c0 tx=0x7fba9401c410 comp rx=0 tx=0).stop 2024-08-18T22:19:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1831187323 shutdown_connections 2024-08-18T22:19:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 --2- 172.21.15.5:0/1831187323 >> v2:172.21.15.117:3300/0 conn(0x7fbaa40b5e60 0x7fbaa40af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 --2- 172.21.15.5:0/1831187323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa415e140 0x7fbaa40b4e40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1831187323 >> 172.21.15.5:0/1831187323 conn(0x7fbaa406b9b0 msgr2=0x7fbaa406bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1831187323 shutdown_connections 2024-08-18T22:19:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1831187323 wait complete. 2024-08-18T22:19:14.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 Processor -- start 2024-08-18T22:19:14.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 -- start start 2024-08-18T22:19:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa40afc80 0x7fbaa40cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa40b5e60 0x7fbaa4147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa415e140 0x7fbaa40cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4070140 con 0x7fbaa40b5e60 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa406ffc0 con 0x7fbaa415e140 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa8a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa416ad60 con 0x7fbaa40afc80 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fba99400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa40b5e60 0x7fbaa4147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fba99400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa40b5e60 0x7fbaa4147bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46790/0 (socket says 172.21.15.5:46790) 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fba99400640 1 -- 172.21.15.5:0/1992992425 learned_addr learned my addr 172.21.15.5:0/1992992425 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa1e00640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa40afc80 0x7fbaa40cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fbaa2800640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa415e140 0x7fbaa40cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fba99400640 1 -- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa40afc80 msgr2=0x7fbaa40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fba99400640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa40afc80 0x7fbaa40cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fba99400640 1 -- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa415e140 msgr2=0x7fbaa40cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:14.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fba99400640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa415e140 0x7fbaa40cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:14.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.935+0000 7fba99400640 1 -- 172.21.15.5:0/1992992425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa40ce810 con 0x7fbaa40b5e60 2024-08-18T22:19:14.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.939+0000 7fba99400640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa40b5e60 0x7fbaa4147bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00e870 tx=0x7fba8c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:14.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.939+0000 7fba9aa00640 1 -- 172.21.15.5:0/1992992425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c017070 con 0x7fbaa40b5e60 2024-08-18T22:19:14.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.939+0000 7fba9aa00640 1 -- 172.21.15.5:0/1992992425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8c00c940 con 0x7fbaa40b5e60 2024-08-18T22:19:14.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.939+0000 7fba9aa00640 1 -- 172.21.15.5:0/1992992425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00cd10 con 0x7fbaa40b5e60 2024-08-18T22:19:14.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.939+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1992992425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa40cf990 con 0x7fbaa40b5e60 2024-08-18T22:19:14.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.939+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1992992425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa40cff50 con 0x7fbaa40b5e60 2024-08-18T22:19:14.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.939+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1992992425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa40af740 con 0x7fbaa40b5e60 2024-08-18T22:19:14.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.939+0000 7fba9aa00640 1 -- 172.21.15.5:0/1992992425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba8c01a070 con 0x7fbaa40b5e60 2024-08-18T22:19:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.939+0000 7fba9aa00640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba800678c0 0x7fba80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.939+0000 7fba9aa00640 1 -- 172.21.15.5:0/1992992425 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fba8c085af0 con 0x7fbaa40b5e60 2024-08-18T22:19:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.939+0000 7fbaa1e00640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba800678c0 0x7fba80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:14.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.943+0000 7fbaa1e00640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba800678c0 0x7fba80069d80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba940ad000 tx=0x7fba940a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:14.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:14.943+0000 7fba9aa00640 1 -- 172.21.15.5:0/1992992425 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fba8c056320 con 0x7fbaa40b5e60 2024-08-18T22:19:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.143+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1992992425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbaa406ce40 con 0x7fbaa40b5e60 2024-08-18T22:19:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.143+0000 7fba9aa00640 1 -- 172.21.15.5:0/1992992425 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1428 (secure 0 0 0) 0x7fba8c05a620 con 0x7fbaa40b5e60 2024-08-18T22:19:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:15.148 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"btime":"2024-08-18T22:19:14:878618+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-18T22:19:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2024-08-18T22:19:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba800678c0 msgr2=0x7fba80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba800678c0 0x7fba80069d80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba940ad000 tx=0x7fba940a6000 comp rx=0 tx=0).stop 2024-08-18T22:19:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1992992425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa40b5e60 msgr2=0x7fbaa4147bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa40b5e60 0x7fbaa4147bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00e870 tx=0x7fba8c00ec70 comp rx=0 tx=0).stop 2024-08-18T22:19:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1992992425 shutdown_connections 2024-08-18T22:19:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba800678c0 0x7fba80069d80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa415e140 0x7fbaa40cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa40b5e60 0x7fbaa4147bb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 --2- 172.21.15.5:0/1992992425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa40afc80 0x7fbaa40cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1992992425 >> 172.21.15.5:0/1992992425 conn(0x7fbaa406b9b0 msgr2=0x7fbaa415b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1992992425 shutdown_connections 2024-08-18T22:19:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:15.147+0000 7fbaa8a00640 1 -- 172.21.15.5:0/1992992425 wait complete. 2024-08-18T22:19:17.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:19:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e7c00640 1 Processor -- start 2024-08-18T22:19:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e7c00640 1 -- start start 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e7c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9e00cb390 0x7fa9e00735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e7c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9e006da70 0x7fa9e006df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e7c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9e0073c80 con 0x7fa9e015bed0 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e7c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa9e00ca5d0 con 0x7fa9e006da70 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e7c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa9e00ca8b0 con 0x7fa9e00cb390 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e5c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9e006da70 0x7fa9e006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e5c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9e006da70 0x7fa9e006df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46800/0 (socket says 172.21.15.5:46800) 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e5c00640 1 -- 172.21.15.5:0/1272362868 learned_addr learned my addr 172.21.15.5:0/1272362868 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9d7e00640 1 --2- 172.21.15.5:0/1272362868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9e00cb390 0x7fa9e00735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e5c00640 1 -- 172.21.15.5:0/1272362868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9e00cb390 msgr2=0x7fa9e00735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e5c00640 1 --2- 172.21.15.5:0/1272362868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9e00cb390 0x7fa9e00735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e5c00640 1 -- 172.21.15.5:0/1272362868 >> v1:172.21.15.117:6789/0 conn(0x7fa9e015bed0 legacy=0x7fa9e0071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.319+0000 7fa9e5c00640 1 -- 172.21.15.5:0/1272362868 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e00cab90 con 0x7fa9e006da70 2024-08-18T22:19:17.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9e5c00640 1 --2- 172.21.15.5:0/1272362868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9e006da70 0x7fa9e006df00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009e50 tx=0x7fa9d801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebb66dbe7d0096c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9dfe00640 1 -- 172.21.15.5:0/1272362868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80a5810 con 0x7fa9e006da70 2024-08-18T22:19:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9dfe00640 1 -- 172.21.15.5:0/1272362868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d80a59b0 con 0x7fa9e006da70 2024-08-18T22:19:17.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9dfe00640 1 -- 172.21.15.5:0/1272362868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80a5d80 con 0x7fa9e006da70 2024-08-18T22:19:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9e7c00640 1 -- 172.21.15.5:0/1272362868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9e006da70 msgr2=0x7fa9e006df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9e7c00640 1 --2- 172.21.15.5:0/1272362868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9e006da70 0x7fa9e006df00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009e50 tx=0x7fa9d801ca30 comp rx=0 tx=0).stop 2024-08-18T22:19:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9e7c00640 1 -- 172.21.15.5:0/1272362868 shutdown_connections 2024-08-18T22:19:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9e7c00640 1 --2- 172.21.15.5:0/1272362868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9e006da70 0x7fa9e006df00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9e7c00640 1 --2- 172.21.15.5:0/1272362868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9e00cb390 0x7fa9e00735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9e7c00640 1 -- 172.21.15.5:0/1272362868 >> 172.21.15.5:0/1272362868 conn(0x7fa9e00b1c50 msgr2=0x7fa9e00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9e7c00640 1 -- 172.21.15.5:0/1272362868 shutdown_connections 2024-08-18T22:19:17.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.323+0000 7fa9e7c00640 1 -- 172.21.15.5:0/1272362868 wait complete. 2024-08-18T22:19:17.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e7c00640 1 Processor -- start 2024-08-18T22:19:17.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e7c00640 1 -- start start 2024-08-18T22:19:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e7c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9e006da70 0x7fa9e0154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e7c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9e00cb390 0x7fa9e015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e7c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9e015bed0 0x7fa9e01584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e7c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0168730 con 0x7fa9e00cb390 2024-08-18T22:19:17.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e7c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e01685b0 con 0x7fa9e006da70 2024-08-18T22:19:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e7c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa9e01688b0 con 0x7fa9e015bed0 2024-08-18T22:19:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9d7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9e00cb390 0x7fa9e015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9d7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9e00cb390 0x7fa9e015d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46816/0 (socket says 172.21.15.5:46816) 2024-08-18T22:19:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9d7e00640 1 -- 172.21.15.5:0/383703722 learned_addr learned my addr 172.21.15.5:0/383703722 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e5200640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9e006da70 0x7fa9e0154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e5c00640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9e015bed0 0x7fa9e01584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9d7e00640 1 -- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9e015bed0 msgr2=0x7fa9e01584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9d7e00640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9e015bed0 0x7fa9e01584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9d7e00640 1 -- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9e006da70 msgr2=0x7fa9e0154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9d7e00640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9e006da70 0x7fa9e0154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9d7e00640 1 -- 172.21.15.5:0/383703722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e015dd00 con 0x7fa9e00cb390 2024-08-18T22:19:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9d7e00640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9e00cb390 0x7fa9e015d2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800e8a0 tx=0x7fa9c800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9dd600640 1 -- 172.21.15.5:0/383703722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8017070 con 0x7fa9e00cb390 2024-08-18T22:19:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9dd600640 1 -- 172.21.15.5:0/383703722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c800c940 con 0x7fa9e00cb390 2024-08-18T22:19:17.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e7c00640 1 -- 172.21.15.5:0/383703722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e015a8a0 con 0x7fa9e00cb390 2024-08-18T22:19:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9dd600640 1 -- 172.21.15.5:0/383703722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800ccf0 con 0x7fa9e00cb390 2024-08-18T22:19:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.327+0000 7fa9e7c00640 1 -- 172.21.15.5:0/383703722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e015ae60 con 0x7fa9e00cb390 2024-08-18T22:19:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.331+0000 7fa9e7c00640 1 -- 172.21.15.5:0/383703722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e006df00 con 0x7fa9e00cb390 2024-08-18T22:19:17.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.331+0000 7fa9dd600640 1 -- 172.21.15.5:0/383703722 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa9c801a070 con 0x7fa9e00cb390 2024-08-18T22:19:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.331+0000 7fa9dd600640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9bc0678c0 0x7fa9bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.331+0000 7fa9dd600640 1 -- 172.21.15.5:0/383703722 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa9c8085b30 con 0x7fa9e00cb390 2024-08-18T22:19:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.331+0000 7fa9e5200640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9bc0678c0 0x7fa9bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.331+0000 7fa9e5200640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9bc0678c0 0x7fa9bc069d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0157520 tx=0x7fa9d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:17.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.335+0000 7fa9dd600640 1 -- 172.21.15.5:0/383703722 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa9c8056360 con 0x7fa9e00cb390 2024-08-18T22:19:17.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 -- 172.21.15.5:0/383703722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9e0157cd0 con 0x7fa9e00cb390 2024-08-18T22:19:17.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9dd600640 1 -- 172.21.15.5:0/383703722 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3903 (secure 0 0 0) 0x7fa9c805a660 con 0x7fa9e00cb390 2024-08-18T22:19:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:17.542 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"btime":"2024-08-18T22:19:15:879969+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4007066150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4007066150},{"type":"v1","addr":"172.21.15.117:6836","nonce":4007066150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1179279001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1179279001},{"type":"v1","addr":"172.21.15.117:6837","nonce":1179279001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3727670717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3727670717},{"type":"v1","addr":"172.21.15.5:6835","nonce":3727670717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-18T22:19:17.542 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2024-08-18T22:19:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 -- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9bc0678c0 msgr2=0x7fa9bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9bc0678c0 0x7fa9bc069d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0157520 tx=0x7fa9d0009040 comp rx=0 tx=0).stop 2024-08-18T22:19:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 -- 172.21.15.5:0/383703722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9e00cb390 msgr2=0x7fa9e015d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9e00cb390 0x7fa9e015d2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800e8a0 tx=0x7fa9c800eca0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 -- 172.21.15.5:0/383703722 shutdown_connections 2024-08-18T22:19:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9bc0678c0 0x7fa9bc069d80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9e015bed0 0x7fa9e01584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9e00cb390 0x7fa9e015d2d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 --2- 172.21.15.5:0/383703722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9e006da70 0x7fa9e0154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 -- 172.21.15.5:0/383703722 >> 172.21.15.5:0/383703722 conn(0x7fa9e00b1c50 msgr2=0x7fa9e00b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 -- 172.21.15.5:0/383703722 shutdown_connections 2024-08-18T22:19:17.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.539+0000 7fa9e7c00640 1 -- 172.21.15.5:0/383703722 wait complete. 2024-08-18T22:19:17.562 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:19:17.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4bca00640 1 Processor -- start 2024-08-18T22:19:17.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4bca00640 1 -- start start 2024-08-18T22:19:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4bca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4b815e6f0 0x7fa4b8073220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4bca00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa4b80c6530 0x7fa4b806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4bca00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b80cfb40 con 0x7fa4b815e310 2024-08-18T22:19:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4bca00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b80cfe20 con 0x7fa4b80c6530 2024-08-18T22:19:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4bca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b80d0100 con 0x7fa4b815e6f0 2024-08-18T22:19:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b5e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa4b815e310 0x7fa4b8072b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33012/0 (socket says 172.21.15.5:33012) 2024-08-18T22:19:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b5e00640 1 -- 172.21.15.5:0/1691372816 learned_addr learned my addr 172.21.15.5:0/1691372816 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b5400640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4b815e6f0 0x7fa4b8073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b6800640 1 --2- 172.21.15.5:0/1691372816 >> v2:172.21.15.117:3300/0 conn(0x7fa4b80c6530 0x7fa4b806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356275940 0 0) 0x7fa4b80cfb40 con 0x7fa4b815e310 2024-08-18T22:19:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa49c003530 con 0x7fa4b815e310 2024-08-18T22:19:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1762698797 0 0) 0x7fa49c003530 con 0x7fa4b815e310 2024-08-18T22:19:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4b815e6f0 msgr2=0x7fa4b8073220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4b815e6f0 0x7fa4b8073220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 >> v2:172.21.15.117:3300/0 conn(0x7fa4b80c6530 msgr2=0x7fa4b806ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 --2- 172.21.15.5:0/1691372816 >> v2:172.21.15.117:3300/0 conn(0x7fa4b80c6530 0x7fa4b806ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b80d03e0 con 0x7fa4b815e310 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fa4a8001680 con 0x7fa4b815e310 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 >> v1:172.21.15.5:6789/0 conn(0x7fa4b815e310 legacy=0x7fa4b8072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c0039c0 0x7fa49c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49c004810 0x7fa49c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c0051d0 0x7fa49c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b80cfe20 con 0x7fa49c0051d0 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b80d0100 con 0x7fa49c004810 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c00bf90 con 0x7fa49c0039c0 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.699+0000 7fa4b5400640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4b815e6f0 0x7fa4b8073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b6800640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c0051d0 0x7fa49c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b5e00640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c0039c0 0x7fa49c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b5400640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49c004810 0x7fa49c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b6800640 1 -- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c0039c0 msgr2=0x7fa49c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b6800640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c0039c0 0x7fa49c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b6800640 1 -- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49c004810 msgr2=0x7fa49c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b6800640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49c004810 0x7fa49c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b6800640 1 -- 172.21.15.5:0/1691372816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c003530 con 0x7fa49c0051d0 2024-08-18T22:19:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b6800640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c0051d0 0x7fa49c00b9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009fc0 tx=0x7fa4b001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebd1a9e474c9457 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:17.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00b2070 con 0x7fa49c0051d0 2024-08-18T22:19:17.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b00a5cd0 con 0x7fa49c0051d0 2024-08-18T22:19:17.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.703+0000 7fa4b4a00640 1 -- 172.21.15.5:0/1691372816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0009c10 con 0x7fa49c0051d0 2024-08-18T22:19:17.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 -- 172.21.15.5:0/1691372816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c0051d0 msgr2=0x7fa49c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 --2- 172.21.15.5:0/1691372816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c0051d0 0x7fa49c00b9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009fc0 tx=0x7fa4b001ccc0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b6800640 1 -- 172.21.15.5:0/1691372816 reap_dead start 2024-08-18T22:19:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 -- 172.21.15.5:0/1691372816 shutdown_connections 2024-08-18T22:19:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 -- 172.21.15.5:0/1691372816 >> 172.21.15.5:0/1691372816 conn(0x7fa4b80d1010 msgr2=0x7fa4b80d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 -- 172.21.15.5:0/1691372816 shutdown_connections 2024-08-18T22:19:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 -- 172.21.15.5:0/1691372816 wait complete. 2024-08-18T22:19:17.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 Processor -- start 2024-08-18T22:19:17.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 -- start start 2024-08-18T22:19:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c0051d0 0x7fa4b815d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b8151380 0x7fa4b8155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4b815af00 0x7fa4b815b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b80cf850 con 0x7fa4b815af00 2024-08-18T22:19:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b80cf6d0 con 0x7fa4b8151380 2024-08-18T22:19:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4bca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b8073220 con 0x7fa49c0051d0 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4b815af00 0x7fa4b815b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4b815af00 0x7fa4b815b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46834/0 (socket says 172.21.15.5:46834) 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b6800640 1 -- 172.21.15.5:0/2889890298 learned_addr learned my addr 172.21.15.5:0/2889890298 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b5400640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b8151380 0x7fa4b8155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b5e00640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c0051d0 0x7fa4b815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b6800640 1 -- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c0051d0 msgr2=0x7fa4b815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b6800640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c0051d0 0x7fa4b815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b6800640 1 -- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b8151380 msgr2=0x7fa4b8155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b6800640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b8151380 0x7fa4b8155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b6800640 1 -- 172.21.15.5:0/2889890298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b8155060 con 0x7fa4b815af00 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.707+0000 7fa4b5400640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b8151380 0x7fa4b8155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.711+0000 7fa4b6800640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4b815af00 0x7fa4b815b380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0002240 tx=0x7fa49c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.711+0000 7fa4ae000640 1 -- 172.21.15.5:0/2889890298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00be070 con 0x7fa4b815af00 2024-08-18T22:19:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.711+0000 7fa4ae000640 1 -- 172.21.15.5:0/2889890298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b00b3040 con 0x7fa4b815af00 2024-08-18T22:19:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.711+0000 7fa4ae000640 1 -- 172.21.15.5:0/2889890298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00b2050 con 0x7fa4b815af00 2024-08-18T22:19:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.711+0000 7fa4bca00640 1 -- 172.21.15.5:0/2889890298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b8155340 con 0x7fa4b815af00 2024-08-18T22:19:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.711+0000 7fa4bca00640 1 -- 172.21.15.5:0/2889890298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b8155900 con 0x7fa4b815af00 2024-08-18T22:19:17.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.711+0000 7fa4bca00640 1 -- 172.21.15.5:0/2889890298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b8073ad0 con 0x7fa4b815af00 2024-08-18T22:19:17.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.711+0000 7fa4ae000640 1 -- 172.21.15.5:0/2889890298 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4b00aead0 con 0x7fa4b815af00 2024-08-18T22:19:17.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.711+0000 7fa4ae000640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4980678f0 0x7fa498069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:17.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.711+0000 7fa4ae000640 1 -- 172.21.15.5:0/2889890298 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa4b011fc40 con 0x7fa4b815af00 2024-08-18T22:19:17.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.711+0000 7fa4b5e00640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4980678f0 0x7fa498069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:17.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.715+0000 7fa4b5e00640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4980678f0 0x7fa498069db0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8001060 tx=0x7fa4a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:17.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.715+0000 7fa4ae000640 1 -- 172.21.15.5:0/2889890298 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa4b00169d0 con 0x7fa4b815af00 2024-08-18T22:19:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.883+0000 7fa4bca00640 1 -- 172.21.15.5:0/2889890298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa4b8073630 con 0x7fa4b815af00 2024-08-18T22:19:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.883+0000 7fa4ae000640 1 -- 172.21.15.5:0/2889890298 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fa4b00f04a0 con 0x7fa4b815af00 2024-08-18T22:19:17.887 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:19:17.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:19:17.888 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:19:17.888 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:19:17.888 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:19:17.888 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:19:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 -- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4980678f0 msgr2=0x7fa498069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4980678f0 0x7fa498069db0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8001060 tx=0x7fa4a8009040 comp rx=0 tx=0).stop 2024-08-18T22:19:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 -- 172.21.15.5:0/2889890298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4b815af00 msgr2=0x7fa4b815b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4b815af00 0x7fa4b815b380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0002240 tx=0x7fa49c005840 comp rx=0 tx=0).stop 2024-08-18T22:19:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 -- 172.21.15.5:0/2889890298 shutdown_connections 2024-08-18T22:19:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4980678f0 0x7fa498069db0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4b815af00 0x7fa4b815b380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b8151380 0x7fa4b8155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 --2- 172.21.15.5:0/2889890298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c0051d0 0x7fa4b815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 -- 172.21.15.5:0/2889890298 >> 172.21.15.5:0/2889890298 conn(0x7fa4b80d1010 msgr2=0x7fa4b80b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:17.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 -- 172.21.15.5:0/2889890298 shutdown_connections 2024-08-18T22:19:17.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:17.887+0000 7fa4bca00640 1 -- 172.21.15.5:0/2889890298 wait complete. 2024-08-18T22:19:17.908 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:19:17.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:19:18.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.047+0000 7fb534800640 1 Processor -- start 2024-08-18T22:19:18.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.047+0000 7fb534800640 1 -- start start 2024-08-18T22:19:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.047+0000 7fb534800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb52c0cf020 0x7fb52c0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.047+0000 7fb534800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb52c072e80 0x7fb52c06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.047+0000 7fb534800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52c0cf940 con 0x7fb52c072a20 2024-08-18T22:19:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.047+0000 7fb534800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb52c0b4c30 con 0x7fb52c072e80 2024-08-18T22:19:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.047+0000 7fb534800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb52c0735e0 con 0x7fb52c0cf020 2024-08-18T22:19:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.047+0000 7fb532800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb52c072e80 0x7fb52c06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.047+0000 7fb531400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb52c072a20 0x7fb52c06ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33028/0 (socket says 172.21.15.5:33028) 2024-08-18T22:19:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.047+0000 7fb531400640 1 -- 172.21.15.5:0/1082383642 learned_addr learned my addr 172.21.15.5:0/1082383642 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.047+0000 7fb532800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb52c072e80 0x7fb52c06f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46840/0 (socket says 172.21.15.5:46840) 2024-08-18T22:19:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.051+0000 7fb531e00640 1 --2- 172.21.15.5:0/1082383642 >> v2:172.21.15.117:3300/0 conn(0x7fb52c0cf020 0x7fb52c0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.051+0000 7fb532800640 1 -- 172.21.15.5:0/1082383642 >> v2:172.21.15.117:3300/0 conn(0x7fb52c0cf020 msgr2=0x7fb52c0cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.051+0000 7fb532800640 1 --2- 172.21.15.5:0/1082383642 >> v2:172.21.15.117:3300/0 conn(0x7fb52c0cf020 0x7fb52c0cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.051+0000 7fb532800640 1 -- 172.21.15.5:0/1082383642 >> v1:172.21.15.5:6789/0 conn(0x7fb52c072a20 legacy=0x7fb52c06ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.051+0000 7fb532800640 1 -- 172.21.15.5:0/1082383642 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c0738c0 con 0x7fb52c072e80 2024-08-18T22:19:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.051+0000 7fb532800640 1 --2- 172.21.15.5:0/1082383642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb52c072e80 0x7fb52c06f160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb52c0cdbe0 tx=0x7fb52801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebaa41003e7d8dde server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.051+0000 7fb530a00640 1 -- 172.21.15.5:0/1082383642 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5280b2070 con 0x7fb52c072e80 2024-08-18T22:19:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.051+0000 7fb530a00640 1 -- 172.21.15.5:0/1082383642 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5280a59c0 con 0x7fb52c072e80 2024-08-18T22:19:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.051+0000 7fb530a00640 1 -- 172.21.15.5:0/1082383642 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5280a5d90 con 0x7fb52c072e80 2024-08-18T22:19:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.051+0000 7fb534800640 1 -- 172.21.15.5:0/1082383642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb52c072e80 msgr2=0x7fb52c06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.051+0000 7fb534800640 1 --2- 172.21.15.5:0/1082383642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb52c072e80 0x7fb52c06f160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb52c0cdbe0 tx=0x7fb52801c900 comp rx=0 tx=0).stop 2024-08-18T22:19:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 -- 172.21.15.5:0/1082383642 shutdown_connections 2024-08-18T22:19:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 --2- 172.21.15.5:0/1082383642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb52c072e80 0x7fb52c06f160 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 --2- 172.21.15.5:0/1082383642 >> v2:172.21.15.117:3300/0 conn(0x7fb52c0cf020 0x7fb52c0cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 -- 172.21.15.5:0/1082383642 >> 172.21.15.5:0/1082383642 conn(0x7fb52c06b9b0 msgr2=0x7fb52c06bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 -- 172.21.15.5:0/1082383642 shutdown_connections 2024-08-18T22:19:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 -- 172.21.15.5:0/1082383642 wait complete. 2024-08-18T22:19:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 Processor -- start 2024-08-18T22:19:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 -- start start 2024-08-18T22:19:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52c072a20 0x7fb52c145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb52c072e80 0x7fb52c14ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb52c0cf020 0x7fb52c1f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c06e3e0 con 0x7fb52c072e80 2024-08-18T22:19:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c073e80 con 0x7fb52c0cf020 2024-08-18T22:19:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb534800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb52c1558e0 con 0x7fb52c072a20 2024-08-18T22:19:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb531400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb52c072e80 0x7fb52c14ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb531400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb52c072e80 0x7fb52c14ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46856/0 (socket says 172.21.15.5:46856) 2024-08-18T22:19:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb531400640 1 -- 172.21.15.5:0/1614039260 learned_addr learned my addr 172.21.15.5:0/1614039260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb532800640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb52c0cf020 0x7fb52c1f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb531e00640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52c072a20 0x7fb52c145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb531400640 1 -- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52c072a20 msgr2=0x7fb52c145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb531400640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52c072a20 0x7fb52c145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb531400640 1 -- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb52c0cf020 msgr2=0x7fb52c1f63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb531400640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb52c0cf020 0x7fb52c1f63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb531400640 1 -- 172.21.15.5:0/1614039260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c071fc0 con 0x7fb52c072e80 2024-08-18T22:19:18.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.055+0000 7fb531400640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb52c072e80 0x7fb52c14ed50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00c370 tx=0x7fb51c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:18.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.059+0000 7fb526000640 1 -- 172.21.15.5:0/1614039260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c017070 con 0x7fb52c072e80 2024-08-18T22:19:18.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.059+0000 7fb526000640 1 -- 172.21.15.5:0/1614039260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c005cf0 con 0x7fb52c072e80 2024-08-18T22:19:18.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.059+0000 7fb534800640 1 -- 172.21.15.5:0/1614039260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb52c145e30 con 0x7fb52c072e80 2024-08-18T22:19:18.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.059+0000 7fb526000640 1 -- 172.21.15.5:0/1614039260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0072f0 con 0x7fb52c072e80 2024-08-18T22:19:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.059+0000 7fb534800640 1 -- 172.21.15.5:0/1614039260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb52c1463f0 con 0x7fb52c072e80 2024-08-18T22:19:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.059+0000 7fb534800640 1 -- 172.21.15.5:0/1614039260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb52c15c760 con 0x7fb52c072e80 2024-08-18T22:19:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.059+0000 7fb526000640 1 -- 172.21.15.5:0/1614039260 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb51c01a070 con 0x7fb52c072e80 2024-08-18T22:19:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.059+0000 7fb526000640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5100678c0 0x7fb510069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.059+0000 7fb526000640 1 -- 172.21.15.5:0/1614039260 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fb51c084db0 con 0x7fb52c072e80 2024-08-18T22:19:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.059+0000 7fb531e00640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5100678c0 0x7fb510069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.059+0000 7fb531e00640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5100678c0 0x7fb510069d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb52000b9d0 tx=0x7fb520008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.063+0000 7fb526000640 1 -- 172.21.15.5:0/1614039260 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb51c089070 con 0x7fb52c072e80 2024-08-18T22:19:18.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:18.231+0000 7fb534800640 1 -- 172.21.15.5:0/1614039260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb52c0ce320 con 0x7fb52c072e80 2024-08-18T22:19:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.079+0000 7fb526000640 1 -- 172.21.15.5:0/1614039260 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fb51c055ba0 con 0x7fb52c072e80 2024-08-18T22:19:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:19:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 -- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5100678c0 msgr2=0x7fb510069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5100678c0 0x7fb510069d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb52000b9d0 tx=0x7fb520008040 comp rx=0 tx=0).stop 2024-08-18T22:19:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 -- 172.21.15.5:0/1614039260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb52c072e80 msgr2=0x7fb52c14ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb52c072e80 0x7fb52c14ed50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00c370 tx=0x7fb51c00c830 comp rx=0 tx=0).stop 2024-08-18T22:19:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 -- 172.21.15.5:0/1614039260 shutdown_connections 2024-08-18T22:19:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5100678c0 0x7fb510069d80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb52c0cf020 0x7fb52c1f63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb52c072e80 0x7fb52c14ed50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 --2- 172.21.15.5:0/1614039260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb52c072a20 0x7fb52c145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:19.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 -- 172.21.15.5:0/1614039260 >> 172.21.15.5:0/1614039260 conn(0x7fb52c06b9b0 msgr2=0x7fb52c151450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:19.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 -- 172.21.15.5:0/1614039260 shutdown_connections 2024-08-18T22:19:19.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.083+0000 7fb534800640 1 -- 172.21.15.5:0/1614039260 wait complete. 2024-08-18T22:19:19.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-08-18T22:19:19.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.263+0000 7f82fec00640 1 Processor -- start 2024-08-18T22:19:19.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fec00640 1 -- start start 2024-08-18T22:19:19.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fec00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82f80b55f0 0x7f82f80b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:19.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fec00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f806eae0 con 0x7f82f815e060 2024-08-18T22:19:19.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fec00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f8071440 con 0x7f82f80b3fe0 2024-08-18T22:19:19.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fec00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f82f80b4990 con 0x7f82f80b55f0 2024-08-18T22:19:19.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fe200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82f80b55f0 0x7f82f80b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:19.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fe200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82f80b55f0 0x7f82f80b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46870/0 (socket says 172.21.15.5:46870) 2024-08-18T22:19:19.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fe200640 1 -- 172.21.15.5:0/1954905011 learned_addr learned my addr 172.21.15.5:0/1954905011 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:19.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fd800640 1 --1- 172.21.15.5:0/1954905011 >> v1:172.21.15.5:6789/0 conn(0x7f82f815e060 0x7f82f8071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33044/0 (socket says 172.21.15.5:33044) 2024-08-18T22:19:19.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fe200640 1 -- 172.21.15.5:0/1954905011 >> v1:172.21.15.117:6789/0 conn(0x7f82f80b3fe0 legacy=0x7f82f80b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:19.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fe200640 1 -- 172.21.15.5:0/1954905011 >> v1:172.21.15.5:6789/0 conn(0x7f82f815e060 legacy=0x7f82f8071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:19.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82fe200640 1 -- 172.21.15.5:0/1954905011 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f806e800 con 0x7f82f80b55f0 2024-08-18T22:19:19.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.267+0000 7f82f7e00640 1 -- 172.21.15.5:0/1954905011 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3513666449 0 0) 0x7f82f806eae0 con 0x7f82f815e060 2024-08-18T22:19:19.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82fe200640 1 --2- 172.21.15.5:0/1954905011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f80b55f0 0x7f82f80b4450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009870 tx=0x7f82f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f397a892051d3c34 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:19.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82f7e00640 1 -- 172.21.15.5:0/1954905011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f00aa650 con 0x7f82f80b55f0 2024-08-18T22:19:19.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82f7e00640 1 -- 172.21.15.5:0/1954905011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f00af070 con 0x7f82f80b55f0 2024-08-18T22:19:19.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82f7e00640 1 -- 172.21.15.5:0/1954905011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f00aaa10 con 0x7f82f80b55f0 2024-08-18T22:19:19.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82fec00640 1 -- 172.21.15.5:0/1954905011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f80b55f0 msgr2=0x7f82f80b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:19.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82fec00640 1 --2- 172.21.15.5:0/1954905011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f80b55f0 0x7f82f80b4450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009870 tx=0x7f82f001c4d0 comp rx=0 tx=0).stop 2024-08-18T22:19:19.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82fec00640 1 -- 172.21.15.5:0/1954905011 shutdown_connections 2024-08-18T22:19:19.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82fec00640 1 --2- 172.21.15.5:0/1954905011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f80b55f0 0x7f82f80b4450 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:19.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82fec00640 1 -- 172.21.15.5:0/1954905011 >> 172.21.15.5:0/1954905011 conn(0x7f82f8067a70 msgr2=0x7f82f8067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:19.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82fec00640 1 -- 172.21.15.5:0/1954905011 shutdown_connections 2024-08-18T22:19:19.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82fec00640 1 -- 172.21.15.5:0/1954905011 wait complete. 2024-08-18T22:19:19.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82fec00640 1 Processor -- start 2024-08-18T22:19:19.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.271+0000 7f82fec00640 1 -- start start 2024-08-18T22:19:19.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fec00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82f80b3fe0 0x7f82f814dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:19.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82f80b55f0 0x7f82f8150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:19.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fec00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f815e060 0x7f82f80b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:19.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fec00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f82f806e3f0 con 0x7f82f815e060 2024-08-18T22:19:19.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fec00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f82f806e270 con 0x7f82f80b3fe0 2024-08-18T22:19:19.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f82f806e570 con 0x7f82f80b55f0 2024-08-18T22:19:19.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fe200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f815e060 0x7f82f80b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:19.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fe200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f815e060 0x7f82f80b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46876/0 (socket says 172.21.15.5:46876) 2024-08-18T22:19:19.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fe200640 1 -- 172.21.15.5:0/255261647 learned_addr learned my addr 172.21.15.5:0/255261647 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:19.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fd800640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82f80b3fe0 0x7f82f814dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:19.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fce00640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82f80b55f0 0x7f82f8150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:19.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fe200640 1 -- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82f80b55f0 msgr2=0x7f82f8150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:19.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fe200640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82f80b55f0 0x7f82f8150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:19.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fe200640 1 -- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82f80b3fe0 msgr2=0x7f82f814dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:19.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fe200640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82f80b3fe0 0x7f82f814dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:19.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fe200640 1 -- 172.21.15.5:0/255261647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f8150c80 con 0x7f82f815e060 2024-08-18T22:19:19.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fe200640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f815e060 0x7f82f80b2cd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f82f00ac040 tx=0x7f82f001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:19.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82f5600640 1 -- 172.21.15.5:0/255261647 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f00b9070 con 0x7f82f815e060 2024-08-18T22:19:19.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82f5600640 1 -- 172.21.15.5:0/255261647 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f00a6040 con 0x7f82f815e060 2024-08-18T22:19:19.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fec00640 1 -- 172.21.15.5:0/255261647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f8150f60 con 0x7f82f815e060 2024-08-18T22:19:19.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82f5600640 1 -- 172.21.15.5:0/255261647 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0004030 con 0x7f82f815e060 2024-08-18T22:19:19.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fec00640 1 -- 172.21.15.5:0/255261647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f8151520 con 0x7f82f815e060 2024-08-18T22:19:19.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82fec00640 1 -- 172.21.15.5:0/255261647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f80b4450 con 0x7f82f815e060 2024-08-18T22:19:19.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.275+0000 7f82f5600640 1 -- 172.21.15.5:0/255261647 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f82f00041d0 con 0x7f82f815e060 2024-08-18T22:19:19.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.279+0000 7f82f5600640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82d80678f0 0x7f82d8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:19.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.279+0000 7f82f5600640 1 -- 172.21.15.5:0/255261647 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f82f011fdf0 con 0x7f82f815e060 2024-08-18T22:19:19.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.279+0000 7f82fd800640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82d80678f0 0x7f82d8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:19.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.279+0000 7f82fd800640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82d80678f0 0x7f82d8069db0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f82ec001950 tx=0x7f82ec0018e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:19.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.283+0000 7f82f5600640 1 -- 172.21.15.5:0/255261647 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f82f0016150 con 0x7f82f815e060 2024-08-18T22:19:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:19.447+0000 7f82fec00640 1 -- 172.21.15.5:0/255261647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f82f80b51f0 con 0x7f82f815e060 2024-08-18T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.087+0000 7f82f5600640 1 -- 172.21.15.5:0/255261647 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f82f00f0c20 con 0x7f82f815e060 2024-08-18T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 -- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82d80678f0 msgr2=0x7f82d8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82d80678f0 0x7f82d8069db0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f82ec001950 tx=0x7f82ec0018e0 comp rx=0 tx=0).stop 2024-08-18T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 -- 172.21.15.5:0/255261647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f815e060 msgr2=0x7f82f80b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f815e060 0x7f82f80b2cd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f82f00ac040 tx=0x7f82f001ad10 comp rx=0 tx=0).stop 2024-08-18T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 -- 172.21.15.5:0/255261647 shutdown_connections 2024-08-18T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82d80678f0 0x7f82d8069db0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82f815e060 0x7f82f80b2cd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82f80b55f0 0x7f82f8150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 --2- 172.21.15.5:0/255261647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82f80b3fe0 0x7f82f814dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 -- 172.21.15.5:0/255261647 >> 172.21.15.5:0/255261647 conn(0x7f82f8067a70 msgr2=0x7f82f8067e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 -- 172.21.15.5:0/255261647 shutdown_connections 2024-08-18T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.091+0000 7f82fec00640 1 -- 172.21.15.5:0/255261647 wait complete. 2024-08-18T22:19:20.139 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.279+0000 7f7034a00640 1 Processor -- start 2024-08-18T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.279+0000 7f7034a00640 1 -- start start 2024-08-18T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.283+0000 7f7034a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70300b1300 0x7f7030162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.283+0000 7f7034a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f703006e8a0 con 0x7f703009b080 2024-08-18T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.283+0000 7f7034a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f703009bb80 con 0x7f703009aca0 2024-08-18T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.283+0000 7f7034a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f70300d2e40 con 0x7f70300b1300 2024-08-18T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.283+0000 7f702d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70300b1300 0x7f7030162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.283+0000 7f702d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70300b1300 0x7f7030162950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46882/0 (socket says 172.21.15.5:46882) 2024-08-18T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.283+0000 7f702d400640 1 -- 172.21.15.5:0/216444079 learned_addr learned my addr 172.21.15.5:0/216444079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.283+0000 7f702d400640 1 -- 172.21.15.5:0/216444079 >> v1:172.21.15.117:6789/0 conn(0x7f703009aca0 legacy=0x7f70300afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.283+0000 7f702d400640 1 -- 172.21.15.5:0/216444079 >> v1:172.21.15.5:6789/0 conn(0x7f703009b080 legacy=0x7f70300b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.283+0000 7f702d400640 1 -- 172.21.15.5:0/216444079 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703006cbd0 con 0x7f70300b1300 2024-08-18T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.283+0000 7f702ca00640 1 -- 172.21.15.5:0/216444079 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928477307 0 0) 0x7f703006e8a0 con 0x7f703009b080 2024-08-18T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f702d400640 1 --2- 172.21.15.5:0/216444079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70300b1300 0x7f7030162950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f701c009870 tx=0x7f701c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae7167a4750c0d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f702ca00640 1 -- 172.21.15.5:0/216444079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c0ab430 con 0x7f70300b1300 2024-08-18T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f702ca00640 1 -- 172.21.15.5:0/216444079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701c0b0070 con 0x7f70300b1300 2024-08-18T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f702ca00640 1 -- 172.21.15.5:0/216444079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c0ab7f0 con 0x7f70300b1300 2024-08-18T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f7034a00640 1 -- 172.21.15.5:0/216444079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70300b1300 msgr2=0x7f7030162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f7034a00640 1 --2- 172.21.15.5:0/216444079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70300b1300 0x7f7030162950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f701c009870 tx=0x7f701c01c520 comp rx=0 tx=0).stop 2024-08-18T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f7034a00640 1 -- 172.21.15.5:0/216444079 shutdown_connections 2024-08-18T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f7034a00640 1 --2- 172.21.15.5:0/216444079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70300b1300 0x7f7030162950 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f7034a00640 1 -- 172.21.15.5:0/216444079 >> 172.21.15.5:0/216444079 conn(0x7f70300d2180 msgr2=0x7f70300d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f7034a00640 1 -- 172.21.15.5:0/216444079 shutdown_connections 2024-08-18T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f7034a00640 1 -- 172.21.15.5:0/216444079 wait complete. 2024-08-18T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f7034a00640 1 Processor -- start 2024-08-18T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.287+0000 7f7034a00640 1 -- start start 2024-08-18T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7034a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703009aca0 0x7f70300b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7034a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f703009b080 0x7f703015dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7034a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70300b1300 0x7f703014cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7034a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f703016ced0 con 0x7f703009aca0 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7034a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f703016cd50 con 0x7f70300b1300 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7034a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f703016d050 con 0x7f703009b080 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f702de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703009aca0 0x7f70300b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f702de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703009aca0 0x7f70300b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46890/0 (socket says 172.21.15.5:46890) 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f702de00640 1 -- 172.21.15.5:0/584063189 learned_addr learned my addr 172.21.15.5:0/584063189 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f702de00640 1 -- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f703009b080 msgr2=0x7f703015dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f702de00640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f703009b080 0x7f703015dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f702de00640 1 -- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70300b1300 msgr2=0x7f703014cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f702de00640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70300b1300 0x7f703014cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f702de00640 1 -- 172.21.15.5:0/584063189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703015bcc0 con 0x7f703009aca0 2024-08-18T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f702de00640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703009aca0 0x7f70300b6ef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f702000b410 tx=0x7f702000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7026000640 1 -- 172.21.15.5:0/584063189 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020015030 con 0x7f703009aca0 2024-08-18T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7026000640 1 -- 172.21.15.5:0/584063189 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7020004020 con 0x7f703009aca0 2024-08-18T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7026000640 1 -- 172.21.15.5:0/584063189 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020004450 con 0x7f703009aca0 2024-08-18T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7034a00640 1 -- 172.21.15.5:0/584063189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7030161090 con 0x7f703009aca0 2024-08-18T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7034a00640 1 -- 172.21.15.5:0/584063189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7030161370 con 0x7f703009aca0 2024-08-18T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7034a00640 1 -- 172.21.15.5:0/584063189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70300af590 con 0x7f703009aca0 2024-08-18T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.291+0000 7f7026000640 1 -- 172.21.15.5:0/584063189 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7020018070 con 0x7f703009aca0 2024-08-18T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.295+0000 7f7026000640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70100678c0 0x7f7010069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.295+0000 7f7026000640 1 -- 172.21.15.5:0/584063189 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f7020085900 con 0x7f703009aca0 2024-08-18T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.295+0000 7f702d400640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70100678c0 0x7f7010069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.295+0000 7f702d400640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70100678c0 0x7f7010069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f701c0af000 tx=0x7f701c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.299+0000 7f7026000640 1 -- 172.21.15.5:0/584063189 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7020056400 con 0x7f703009aca0 2024-08-18T22:19:20.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:20.499+0000 7f7034a00640 1 -- 172.21.15.5:0/584063189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f703016a0e0 con 0x7f703009aca0 2024-08-18T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.087+0000 7f7026000640 1 -- 172.21.15.5:0/584063189 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f7020055d00 con 0x7f703009aca0 2024-08-18T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2024-08-18T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.095+0000 7f7034a00640 1 -- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70100678c0 msgr2=0x7f7010069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.095+0000 7f7034a00640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70100678c0 0x7f7010069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f701c0af000 tx=0x7f701c008040 comp rx=0 tx=0).stop 2024-08-18T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.095+0000 7f7034a00640 1 -- 172.21.15.5:0/584063189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703009aca0 msgr2=0x7f70300b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.095+0000 7f7034a00640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703009aca0 0x7f70300b6ef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f702000b410 tx=0x7f702000b8d0 comp rx=0 tx=0).stop 2024-08-18T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.099+0000 7f7034a00640 1 -- 172.21.15.5:0/584063189 shutdown_connections 2024-08-18T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.099+0000 7f7034a00640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70100678c0 0x7f7010069d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.099+0000 7f7034a00640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70300b1300 0x7f703014cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.099+0000 7f7034a00640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f703009b080 0x7f703015dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.099+0000 7f7034a00640 1 --2- 172.21.15.5:0/584063189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f703009aca0 0x7f70300b6ef0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.099+0000 7f7034a00640 1 -- 172.21.15.5:0/584063189 >> 172.21.15.5:0/584063189 conn(0x7f70300d2180 msgr2=0x7f7030161ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:21.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.107+0000 7f7034a00640 1 -- 172.21.15.5:0/584063189 shutdown_connections 2024-08-18T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.107+0000 7f7034a00640 1 -- 172.21.15.5:0/584063189 wait complete. 2024-08-18T22:19:21.149 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-08-18T22:19:21.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-08-18T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8de200640 1 Processor -- start 2024-08-18T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8de200640 1 -- start start 2024-08-18T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8de200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8d815e1f0 0x7ff8d80d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8de200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8d80b6850 0x7ff8d8162810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8de200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8d80d2ac0 con 0x7ff8d80d25c0 2024-08-18T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8de200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff8d8162d50 con 0x7ff8d80b6850 2024-08-18T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8de200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff8d80d2da0 con 0x7ff8d815e1f0 2024-08-18T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8dd800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8d80b6850 0x7ff8d8162810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8dd800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8d80b6850 0x7ff8d8162810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46892/0 (socket says 172.21.15.5:46892) 2024-08-18T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8dd800640 1 -- 172.21.15.5:0/2176255736 learned_addr learned my addr 172.21.15.5:0/2176255736 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8d7e00640 1 --1- 172.21.15.5:0/2176255736 >> v1:172.21.15.5:6789/0 conn(0x7ff8d80d25c0 0x7ff8d80b6140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33058/0 (socket says 172.21.15.5:33058) 2024-08-18T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8dce00640 1 --2- 172.21.15.5:0/2176255736 >> v2:172.21.15.117:3300/0 conn(0x7ff8d815e1f0 0x7ff8d80d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8dd800640 1 -- 172.21.15.5:0/2176255736 >> v2:172.21.15.117:3300/0 conn(0x7ff8d815e1f0 msgr2=0x7ff8d80d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8dd800640 1 --2- 172.21.15.5:0/2176255736 >> v2:172.21.15.117:3300/0 conn(0x7ff8d815e1f0 0x7ff8d80d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8dd800640 1 -- 172.21.15.5:0/2176255736 >> v1:172.21.15.5:6789/0 conn(0x7ff8d80d25c0 legacy=0x7ff8d80b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.295+0000 7ff8dd800640 1 -- 172.21.15.5:0/2176255736 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d80d3080 con 0x7ff8d80b6850 2024-08-18T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8dd800640 1 --2- 172.21.15.5:0/2176255736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8d80b6850 0x7ff8d8162810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8d806bdc0 tx=0x7ff8d001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d96205d9ff6bb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8d7400640 1 -- 172.21.15.5:0/2176255736 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00a57a0 con 0x7ff8d80b6850 2024-08-18T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8d7400640 1 -- 172.21.15.5:0/2176255736 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d00a5940 con 0x7ff8d80b6850 2024-08-18T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8d7400640 1 -- 172.21.15.5:0/2176255736 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00a5d10 con 0x7ff8d80b6850 2024-08-18T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8de200640 1 -- 172.21.15.5:0/2176255736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8d80b6850 msgr2=0x7ff8d8162810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8de200640 1 --2- 172.21.15.5:0/2176255736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8d80b6850 0x7ff8d8162810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8d806bdc0 tx=0x7ff8d001c9f0 comp rx=0 tx=0).stop 2024-08-18T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8de200640 1 -- 172.21.15.5:0/2176255736 shutdown_connections 2024-08-18T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8de200640 1 --2- 172.21.15.5:0/2176255736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8d80b6850 0x7ff8d8162810 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8de200640 1 --2- 172.21.15.5:0/2176255736 >> v2:172.21.15.117:3300/0 conn(0x7ff8d815e1f0 0x7ff8d80d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8de200640 1 -- 172.21.15.5:0/2176255736 >> 172.21.15.5:0/2176255736 conn(0x7ff8d80d45a0 msgr2=0x7ff8d80d49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8de200640 1 -- 172.21.15.5:0/2176255736 shutdown_connections 2024-08-18T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8de200640 1 -- 172.21.15.5:0/2176255736 wait complete. 2024-08-18T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8de200640 1 Processor -- start 2024-08-18T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.299+0000 7ff8de200640 1 -- start start 2024-08-18T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8de200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8d80b6850 0x7ff8d8155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8de200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8d80d25c0 0x7ff8d80c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8de200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8d815e1f0 0x7ff8d81f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8de200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d806d370 con 0x7ff8d815e1f0 2024-08-18T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8de200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d806d1f0 con 0x7ff8d80b6850 2024-08-18T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8de200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d806d4f0 con 0x7ff8d80d25c0 2024-08-18T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8dd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8d815e1f0 0x7ff8d81f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8dce00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8d80b6850 0x7ff8d8155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8dce00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8d80b6850 0x7ff8d8155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:55892/0 (socket says 172.21.15.5:55892) 2024-08-18T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8d7e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8d80d25c0 0x7ff8d80c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8dd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8d815e1f0 0x7ff8d81f74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46900/0 (socket says 172.21.15.5:46900) 2024-08-18T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8dce00640 1 -- 172.21.15.5:0/49426377 learned_addr learned my addr 172.21.15.5:0/49426377 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8dd800640 1 -- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8d80d25c0 msgr2=0x7ff8d80c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8dd800640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8d80d25c0 0x7ff8d80c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8dd800640 1 -- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8d80b6850 msgr2=0x7ff8d8155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8dd800640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8d80b6850 0x7ff8d8155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8dd800640 1 -- 172.21.15.5:0/49426377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d81f7d50 con 0x7ff8d815e1f0 2024-08-18T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8dd800640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8d815e1f0 0x7ff8d81f74a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00ab000 tx=0x7ff8d0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8d4c00640 1 -- 172.21.15.5:0/49426377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00b8470 con 0x7ff8d815e1f0 2024-08-18T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8d4c00640 1 -- 172.21.15.5:0/49426377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d00b8630 con 0x7ff8d815e1f0 2024-08-18T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8d4c00640 1 -- 172.21.15.5:0/49426377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00b8a20 con 0x7ff8d815e1f0 2024-08-18T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8de200640 1 -- 172.21.15.5:0/49426377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d81f8030 con 0x7ff8d815e1f0 2024-08-18T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8de200640 1 -- 172.21.15.5:0/49426377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d81f85f0 con 0x7ff8d815e1f0 2024-08-18T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8de200640 1 -- 172.21.15.5:0/49426377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d8162810 con 0x7ff8d815e1f0 2024-08-18T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.303+0000 7ff8d4c00640 1 -- 172.21.15.5:0/49426377 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8d00c0020 con 0x7ff8d815e1f0 2024-08-18T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.307+0000 7ff8d4c00640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8b80678f0 0x7ff8b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.307+0000 7ff8d4c00640 1 -- 172.21.15.5:0/49426377 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff8d0120450 con 0x7ff8d815e1f0 2024-08-18T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.307+0000 7ff8dce00640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8b80678f0 0x7ff8b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.307+0000 7ff8dce00640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8b80678f0 0x7ff8b8069db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc007a70 tx=0x7ff8cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.311+0000 7ff8d4c00640 1 -- 172.21.15.5:0/49426377 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff8d00c7020 con 0x7ff8d815e1f0 2024-08-18T22:19:21.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:19:21.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:21.487+0000 7ff8de200640 1 -- 172.21.15.5:0/49426377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7ff8d80caf80 con 0x7ff8d815e1f0 2024-08-18T22:19:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.091+0000 7ff8d4c00640 1 -- 172.21.15.5:0/49426377 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7ff8d00165e0 con 0x7ff8d815e1f0 2024-08-18T22:19:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 -- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8b80678f0 msgr2=0x7ff8b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8b80678f0 0x7ff8b8069db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc007a70 tx=0x7ff8cc008040 comp rx=0 tx=0).stop 2024-08-18T22:19:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 -- 172.21.15.5:0/49426377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8d815e1f0 msgr2=0x7ff8d81f74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8d815e1f0 0x7ff8d81f74a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00ab000 tx=0x7ff8d0019790 comp rx=0 tx=0).stop 2024-08-18T22:19:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 -- 172.21.15.5:0/49426377 shutdown_connections 2024-08-18T22:19:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8b80678f0 0x7ff8b8069db0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8d815e1f0 0x7ff8d81f74a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8d80d25c0 0x7ff8d80c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 --2- 172.21.15.5:0/49426377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8d80b6850 0x7ff8d8155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 -- 172.21.15.5:0/49426377 >> 172.21.15.5:0/49426377 conn(0x7ff8d80d45a0 msgr2=0x7ff8d80b91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 -- 172.21.15.5:0/49426377 shutdown_connections 2024-08-18T22:19:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.095+0000 7ff8de200640 1 -- 172.21.15.5:0/49426377 wait complete. 2024-08-18T22:19:22.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.311+0000 7fe187200640 1 Processor -- start 2024-08-18T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.311+0000 7fe187200640 1 -- start start 2024-08-18T22:19:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.311+0000 7fe187200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe18015f690 0x7fe1800ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.311+0000 7fe187200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1800caab0 con 0x7fe180072130 2024-08-18T22:19:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.311+0000 7fe187200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1800cad90 con 0x7fe1800ca5e0 2024-08-18T22:19:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.311+0000 7fe187200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe1800cb070 con 0x7fe18015f690 2024-08-18T22:19:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.311+0000 7fe17fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe18015f690 0x7fe1800ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.311+0000 7fe185200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe180072130 0x7fe1800acec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33062/0 (socket says 172.21.15.5:33062) 2024-08-18T22:19:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.311+0000 7fe185200640 1 -- 172.21.15.5:0/3575520029 learned_addr learned my addr 172.21.15.5:0/3575520029 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.315+0000 7fe17fe00640 1 -- 172.21.15.5:0/3575520029 >> v1:172.21.15.117:6789/0 conn(0x7fe1800ca5e0 legacy=0x7fe180071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.315+0000 7fe17fe00640 1 -- 172.21.15.5:0/3575520029 >> v1:172.21.15.5:6789/0 conn(0x7fe180072130 legacy=0x7fe1800acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.315+0000 7fe17fe00640 1 -- 172.21.15.5:0/3575520029 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1800cb350 con 0x7fe18015f690 2024-08-18T22:19:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.315+0000 7fe17fe00640 1 --2- 172.21.15.5:0/3575520029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe18015f690 0x7fe1800ccfd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1700097c0 tx=0x7fe17001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1d91cf4c2b1d10 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.315+0000 7fe17f400640 1 -- 172.21.15.5:0/3575520029 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1700b1070 con 0x7fe18015f690 2024-08-18T22:19:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.315+0000 7fe17f400640 1 -- 172.21.15.5:0/3575520029 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1700ac410 con 0x7fe18015f690 2024-08-18T22:19:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.315+0000 7fe17f400640 1 -- 172.21.15.5:0/3575520029 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1700ac7e0 con 0x7fe18015f690 2024-08-18T22:19:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 -- 172.21.15.5:0/3575520029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe18015f690 msgr2=0x7fe1800ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 --2- 172.21.15.5:0/3575520029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe18015f690 0x7fe1800ccfd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1700097c0 tx=0x7fe17001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:19:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 -- 172.21.15.5:0/3575520029 shutdown_connections 2024-08-18T22:19:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 --2- 172.21.15.5:0/3575520029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe18015f690 0x7fe1800ccfd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 -- 172.21.15.5:0/3575520029 >> 172.21.15.5:0/3575520029 conn(0x7fe1800b1db0 msgr2=0x7fe1800b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 -- 172.21.15.5:0/3575520029 shutdown_connections 2024-08-18T22:19:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 -- 172.21.15.5:0/3575520029 wait complete. 2024-08-18T22:19:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 Processor -- start 2024-08-18T22:19:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 -- start start 2024-08-18T22:19:22.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe180072130 0x7fe180154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1800ca5e0 0x7fe180166a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe18015f690 0x7fe1800b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe180169e30 con 0x7fe18015f690 2024-08-18T22:19:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe180169cb0 con 0x7fe1800ca5e0 2024-08-18T22:19:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe187200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe180169fb0 con 0x7fe180072130 2024-08-18T22:19:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe185200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe18015f690 0x7fe1800b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe185200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe18015f690 0x7fe1800b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46912/0 (socket says 172.21.15.5:46912) 2024-08-18T22:19:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe185200640 1 -- 172.21.15.5:0/559470134 learned_addr learned my addr 172.21.15.5:0/559470134 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe177400640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1800ca5e0 0x7fe180166a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe17fe00640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe180072130 0x7fe180154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe185200640 1 -- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe180072130 msgr2=0x7fe180154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe185200640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe180072130 0x7fe180154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe185200640 1 -- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1800ca5e0 msgr2=0x7fe180166a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe185200640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1800ca5e0 0x7fe180166a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.319+0000 7fe185200640 1 -- 172.21.15.5:0/559470134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18015ae20 con 0x7fe18015f690 2024-08-18T22:19:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.323+0000 7fe185200640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe18015f690 0x7fe1800b2ee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe17800caa0 tx=0x7fe17800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.323+0000 7fe17cc00640 1 -- 172.21.15.5:0/559470134 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178017070 con 0x7fe18015f690 2024-08-18T22:19:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.323+0000 7fe17cc00640 1 -- 172.21.15.5:0/559470134 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17800ac00 con 0x7fe18015f690 2024-08-18T22:19:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.323+0000 7fe17cc00640 1 -- 172.21.15.5:0/559470134 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178012400 con 0x7fe18015f690 2024-08-18T22:19:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.323+0000 7fe187200640 1 -- 172.21.15.5:0/559470134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18015b100 con 0x7fe18015f690 2024-08-18T22:19:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.323+0000 7fe187200640 1 -- 172.21.15.5:0/559470134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18015b6c0 con 0x7fe18015f690 2024-08-18T22:19:22.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.323+0000 7fe187200640 1 -- 172.21.15.5:0/559470134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1800ccfd0 con 0x7fe18015f690 2024-08-18T22:19:22.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.323+0000 7fe17cc00640 1 -- 172.21.15.5:0/559470134 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe17801a070 con 0x7fe18015f690 2024-08-18T22:19:22.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.323+0000 7fe17cc00640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe15c0678c0 0x7fe15c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:22.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.323+0000 7fe17cc00640 1 -- 172.21.15.5:0/559470134 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fe1780859a0 con 0x7fe18015f690 2024-08-18T22:19:22.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.323+0000 7fe17fe00640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe15c0678c0 0x7fe15c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:22.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.327+0000 7fe17fe00640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe15c0678c0 0x7fe15c069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1700ae000 tx=0x7fe170008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:22.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.327+0000 7fe17cc00640 1 -- 172.21.15.5:0/559470134 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe178055d50 con 0x7fe18015f690 2024-08-18T22:19:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:22.495+0000 7fe187200640 1 -- 172.21.15.5:0/559470134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe18015bb60 con 0x7fe18015f690 2024-08-18T22:19:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.323+0000 7fe17cc00640 1 -- 172.21.15.5:0/559470134 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fe17805a050 con 0x7fe18015f690 2024-08-18T22:19:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' created 2024-08-18T22:19:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.323+0000 7fe187200640 1 -- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe15c0678c0 msgr2=0x7fe15c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.323+0000 7fe187200640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe15c0678c0 0x7fe15c069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1700ae000 tx=0x7fe170008040 comp rx=0 tx=0).stop 2024-08-18T22:19:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.323+0000 7fe187200640 1 -- 172.21.15.5:0/559470134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe18015f690 msgr2=0x7fe1800b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.323+0000 7fe187200640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe18015f690 0x7fe1800b2ee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe17800caa0 tx=0x7fe17800cf60 comp rx=0 tx=0).stop 2024-08-18T22:19:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.327+0000 7fe187200640 1 -- 172.21.15.5:0/559470134 shutdown_connections 2024-08-18T22:19:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.327+0000 7fe187200640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe15c0678c0 0x7fe15c069d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.327+0000 7fe187200640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe18015f690 0x7fe1800b2ee0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.327+0000 7fe187200640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1800ca5e0 0x7fe180166a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.327+0000 7fe187200640 1 --2- 172.21.15.5:0/559470134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe180072130 0x7fe180154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.327+0000 7fe187200640 1 -- 172.21.15.5:0/559470134 >> 172.21.15.5:0/559470134 conn(0x7fe1800b1db0 msgr2=0x7fe180167140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.327+0000 7fe187200640 1 -- 172.21.15.5:0/559470134 shutdown_connections 2024-08-18T22:19:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.327+0000 7fe187200640 1 -- 172.21.15.5:0/559470134 wait complete. 2024-08-18T22:19:24.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-08-18T22:19:24.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae8e200640 1 Processor -- start 2024-08-18T22:19:24.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae8e200640 1 -- start start 2024-08-18T22:19:24.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae8e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae880ccaa0 0x7fae880cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:24.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae8e200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae880b3260 con 0x7fae8815d1d0 2024-08-18T22:19:24.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae8e200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8815d630 con 0x7fae8806dc60 2024-08-18T22:19:24.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae8e200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fae880cfe90 con 0x7fae880ccaa0 2024-08-18T22:19:24.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae87400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae880ccaa0 0x7fae880cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae87400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae880ccaa0 0x7fae880cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53278/0 (socket says 172.21.15.5:53278) 2024-08-18T22:19:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae87400640 1 -- 172.21.15.5:0/3953558349 learned_addr learned my addr 172.21.15.5:0/3953558349 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae7ea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fae8815d1d0 0x7fae880cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38270/0 (socket says 172.21.15.5:38270) 2024-08-18T22:19:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae87400640 1 -- 172.21.15.5:0/3953558349 >> v1:172.21.15.117:6789/0 conn(0x7fae8806dc60 legacy=0x7fae8806e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae87400640 1 -- 172.21.15.5:0/3953558349 >> v1:172.21.15.5:6789/0 conn(0x7fae8815d1d0 legacy=0x7fae880cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.507+0000 7fae87400640 1 -- 172.21.15.5:0/3953558349 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae880b3500 con 0x7fae880ccaa0 2024-08-18T22:19:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae87400640 1 --2- 172.21.15.5:0/3953558349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae880ccaa0 0x7fae880cf760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae78009870 tx=0x7fae7801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ba9b95398f883e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae86a00640 1 -- 172.21.15.5:0/3953558349 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780b0070 con 0x7fae880ccaa0 2024-08-18T22:19:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae86a00640 1 -- 172.21.15.5:0/3953558349 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae780ab600 con 0x7fae880ccaa0 2024-08-18T22:19:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae86a00640 1 -- 172.21.15.5:0/3953558349 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780ab9d0 con 0x7fae880ccaa0 2024-08-18T22:19:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae8e200640 1 -- 172.21.15.5:0/3953558349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae880ccaa0 msgr2=0x7fae880cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:24.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae8e200640 1 --2- 172.21.15.5:0/3953558349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae880ccaa0 0x7fae880cf760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae78009870 tx=0x7fae7801c490 comp rx=0 tx=0).stop 2024-08-18T22:19:24.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae8e200640 1 -- 172.21.15.5:0/3953558349 shutdown_connections 2024-08-18T22:19:24.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae8e200640 1 --2- 172.21.15.5:0/3953558349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae880ccaa0 0x7fae880cf760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:24.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae8e200640 1 -- 172.21.15.5:0/3953558349 >> 172.21.15.5:0/3953558349 conn(0x7fae8806b9b0 msgr2=0x7fae8806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:24.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae8e200640 1 -- 172.21.15.5:0/3953558349 shutdown_connections 2024-08-18T22:19:24.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae8e200640 1 -- 172.21.15.5:0/3953558349 wait complete. 2024-08-18T22:19:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.511+0000 7fae8e200640 1 Processor -- start 2024-08-18T22:19:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae8e200640 1 -- start start 2024-08-18T22:19:24.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae8e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae8806dc60 0x7fae8815f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:24.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae8e200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae880ccaa0 0x7fae8814faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae8e200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8815d1d0 0x7fae8815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae8e200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fae8816a520 con 0x7fae8806dc60 2024-08-18T22:19:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae8e200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fae880af5c0 con 0x7fae8815d1d0 2024-08-18T22:19:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae8e200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fae8816a6a0 con 0x7fae880ccaa0 2024-08-18T22:19:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae87400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae8806dc60 0x7fae8815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae87400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae8806dc60 0x7fae8815f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53290/0 (socket says 172.21.15.5:53290) 2024-08-18T22:19:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae87400640 1 -- 172.21.15.5:0/2032045815 learned_addr learned my addr 172.21.15.5:0/2032045815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae7ea00640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae880ccaa0 0x7fae8814faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:24.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae87e00640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8815d1d0 0x7fae8815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae87400640 1 -- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae880ccaa0 msgr2=0x7fae8814faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae87400640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae880ccaa0 0x7fae8814faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae87400640 1 -- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8815d1d0 msgr2=0x7fae8815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae87400640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8815d1d0 0x7fae8815e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae87400640 1 -- 172.21.15.5:0/2032045815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae88150030 con 0x7fae8806dc60 2024-08-18T22:19:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae87400640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae8806dc60 0x7fae8815f610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fae780ae040 tx=0x7fae7801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae7fe00640 1 -- 172.21.15.5:0/2032045815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780ba020 con 0x7fae8806dc60 2024-08-18T22:19:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae7fe00640 1 -- 172.21.15.5:0/2032045815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae780b6620 con 0x7fae8806dc60 2024-08-18T22:19:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae7fe00640 1 -- 172.21.15.5:0/2032045815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780b0040 con 0x7fae8806dc60 2024-08-18T22:19:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae8e200640 1 -- 172.21.15.5:0/2032045815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae880aeb80 con 0x7fae8806dc60 2024-08-18T22:19:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae8e200640 1 -- 172.21.15.5:0/2032045815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae88157880 con 0x7fae8806dc60 2024-08-18T22:19:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.515+0000 7fae8e200640 1 -- 172.21.15.5:0/2032045815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae880cf760 con 0x7fae8806dc60 2024-08-18T22:19:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.519+0000 7fae7fe00640 1 -- 172.21.15.5:0/2032045815 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae780bd020 con 0x7fae8806dc60 2024-08-18T22:19:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.519+0000 7fae7fe00640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae640678c0 0x7fae64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.519+0000 7fae7fe00640 1 -- 172.21.15.5:0/2032045815 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fae781201b0 con 0x7fae8806dc60 2024-08-18T22:19:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.519+0000 7fae7ea00640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae640678c0 0x7fae64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.519+0000 7fae7ea00640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae640678c0 0x7fae64069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae8809e2c0 tx=0x7fae70007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:24.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.523+0000 7fae7fe00640 1 -- 172.21.15.5:0/2032045815 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fae780c4030 con 0x7fae8806dc60 2024-08-18T22:19:24.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:24.691+0000 7fae8e200640 1 -- 172.21.15.5:0/2032045815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fae880cd090 con 0x7fae8806dc60 2024-08-18T22:19:25.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.331+0000 7fae7fe00640 1 -- 172.21.15.5:0/2032045815 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7fae78016110 con 0x7fae8806dc60 2024-08-18T22:19:25.334 INFO:teuthology.orchestra.run.smithi005.stderr:set pool 4 allow_ec_overwrites to true 2024-08-18T22:19:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 -- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae640678c0 msgr2=0x7fae64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae640678c0 0x7fae64069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae8809e2c0 tx=0x7fae70007cd0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 -- 172.21.15.5:0/2032045815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae8806dc60 msgr2=0x7fae8815f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:25.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae8806dc60 0x7fae8815f610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fae780ae040 tx=0x7fae7801acd0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 -- 172.21.15.5:0/2032045815 shutdown_connections 2024-08-18T22:19:25.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae640678c0 0x7fae64069d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8815d1d0 0x7fae8815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae880ccaa0 0x7fae8814faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 --2- 172.21.15.5:0/2032045815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae8806dc60 0x7fae8815f610 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 -- 172.21.15.5:0/2032045815 >> 172.21.15.5:0/2032045815 conn(0x7fae8806b9b0 msgr2=0x7fae880cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:25.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 -- 172.21.15.5:0/2032045815 shutdown_connections 2024-08-18T22:19:25.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.335+0000 7fae8e200640 1 -- 172.21.15.5:0/2032045815 wait complete. 2024-08-18T22:19:25.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-08-18T22:19:25.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.531+0000 7fc9c0000640 1 Processor -- start 2024-08-18T22:19:25.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.531+0000 7fc9c0000640 1 -- start start 2024-08-18T22:19:25.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.531+0000 7fc9c0000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9b815b0c0 0x7fc9b806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.531+0000 7fc9c0000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9b80b40c0 0x7fc9b80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.531+0000 7fc9c0000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9b80b31f0 con 0x7fc9b8072a30 2024-08-18T22:19:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.531+0000 7fc9c0000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc9b80b4a70 con 0x7fc9b80b40c0 2024-08-18T22:19:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.531+0000 7fc9c0000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc9b80b3d70 con 0x7fc9b815b0c0 2024-08-18T22:19:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9bcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9b80b40c0 0x7fc9b80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9bcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9b80b40c0 0x7fc9b80b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53298/0 (socket says 172.21.15.5:53298) 2024-08-18T22:19:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9bcc00640 1 -- 172.21.15.5:0/2989101331 learned_addr learned my addr 172.21.15.5:0/2989101331 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9bd600640 1 --2- 172.21.15.5:0/2989101331 >> v2:172.21.15.117:3300/0 conn(0x7fc9b815b0c0 0x7fc9b806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9bcc00640 1 -- 172.21.15.5:0/2989101331 >> v2:172.21.15.117:3300/0 conn(0x7fc9b815b0c0 msgr2=0x7fc9b806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9bcc00640 1 --2- 172.21.15.5:0/2989101331 >> v2:172.21.15.117:3300/0 conn(0x7fc9b815b0c0 0x7fc9b806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9bcc00640 1 -- 172.21.15.5:0/2989101331 >> v1:172.21.15.117:6789/0 conn(0x7fc9b8072a30 legacy=0x7fc9b8072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:25.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9bcc00640 1 -- 172.21.15.5:0/2989101331 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b80b34d0 con 0x7fc9b80b40c0 2024-08-18T22:19:25.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9bcc00640 1 --2- 172.21.15.5:0/2989101331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80b40c0 0x7fc9b80b4530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8070ba0 tx=0x7fc9a401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802c4279b2d1b2a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:25.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9b7e00640 1 -- 172.21.15.5:0/2989101331 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40b1070 con 0x7fc9b80b40c0 2024-08-18T22:19:25.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9b7e00640 1 -- 172.21.15.5:0/2989101331 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a40ac630 con 0x7fc9b80b40c0 2024-08-18T22:19:25.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.535+0000 7fc9b7e00640 1 -- 172.21.15.5:0/2989101331 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40a8050 con 0x7fc9b80b40c0 2024-08-18T22:19:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 -- 172.21.15.5:0/2989101331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80b40c0 msgr2=0x7fc9b80b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 --2- 172.21.15.5:0/2989101331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80b40c0 0x7fc9b80b4530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8070ba0 tx=0x7fc9a401c3d0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 -- 172.21.15.5:0/2989101331 shutdown_connections 2024-08-18T22:19:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 --2- 172.21.15.5:0/2989101331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80b40c0 0x7fc9b80b4530 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 --2- 172.21.15.5:0/2989101331 >> v2:172.21.15.117:3300/0 conn(0x7fc9b815b0c0 0x7fc9b806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 -- 172.21.15.5:0/2989101331 >> 172.21.15.5:0/2989101331 conn(0x7fc9b80b1dc0 msgr2=0x7fc9b80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 -- 172.21.15.5:0/2989101331 shutdown_connections 2024-08-18T22:19:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 -- 172.21.15.5:0/2989101331 wait complete. 2024-08-18T22:19:25.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 Processor -- start 2024-08-18T22:19:25.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 -- start start 2024-08-18T22:19:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9b8072a30 0x7fc9b8146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80b40c0 0x7fc9b80ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9b815b0c0 0x7fc9b80ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b815b4a0 con 0x7fc9b80b40c0 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b80739a0 con 0x7fc9b8072a30 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9c0000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b815b620 con 0x7fc9b815b0c0 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9bcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80b40c0 0x7fc9b80ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9bcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80b40c0 0x7fc9b80ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53310/0 (socket says 172.21.15.5:53310) 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9bcc00640 1 -- 172.21.15.5:0/513280993 learned_addr learned my addr 172.21.15.5:0/513280993 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9bd600640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9b8072a30 0x7fc9b8146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9be000640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9b815b0c0 0x7fc9b80ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9bcc00640 1 -- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9b815b0c0 msgr2=0x7fc9b80ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9bcc00640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9b815b0c0 0x7fc9b80ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9bcc00640 1 -- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9b8072a30 msgr2=0x7fc9b8146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9bcc00640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9b8072a30 0x7fc9b8146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:25.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.539+0000 7fc9bcc00640 1 -- 172.21.15.5:0/513280993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b8157520 con 0x7fc9b80b40c0 2024-08-18T22:19:25.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.543+0000 7fc9bcc00640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80b40c0 0x7fc9b80ccaa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4018fe0 tx=0x7fc9a4019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:25.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.543+0000 7fc9b5600640 1 -- 172.21.15.5:0/513280993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40b1040 con 0x7fc9b80b40c0 2024-08-18T22:19:25.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.543+0000 7fc9b5600640 1 -- 172.21.15.5:0/513280993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a40ba070 con 0x7fc9b80b40c0 2024-08-18T22:19:25.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.543+0000 7fc9b5600640 1 -- 172.21.15.5:0/513280993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40b5660 con 0x7fc9b80b40c0 2024-08-18T22:19:25.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.543+0000 7fc9c0000640 1 -- 172.21.15.5:0/513280993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b8157800 con 0x7fc9b80b40c0 2024-08-18T22:19:25.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.543+0000 7fc9c0000640 1 -- 172.21.15.5:0/513280993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b8157dc0 con 0x7fc9b80b40c0 2024-08-18T22:19:25.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.543+0000 7fc9c0000640 1 -- 172.21.15.5:0/513280993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b806f700 con 0x7fc9b80b40c0 2024-08-18T22:19:25.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.543+0000 7fc9b5600640 1 -- 172.21.15.5:0/513280993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc9a40b5800 con 0x7fc9b80b40c0 2024-08-18T22:19:25.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.543+0000 7fc9b5600640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9980678f0 0x7fc998069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:25.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.543+0000 7fc9b5600640 1 -- 172.21.15.5:0/513280993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fc9a411f8b0 con 0x7fc9b80b40c0 2024-08-18T22:19:25.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.543+0000 7fc9bd600640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9980678f0 0x7fc998069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:25.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.547+0000 7fc9bd600640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9980678f0 0x7fc998069db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009ac0 tx=0x7fc9ac009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:25.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.547+0000 7fc9b5600640 1 -- 172.21.15.5:0/513280993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc9a4016110 con 0x7fc9b80b40c0 2024-08-18T22:19:25.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:25.751+0000 7fc9c0000640 1 -- 172.21.15.5:0/513280993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fc9b80b18c0 con 0x7fc9b80b40c0 2024-08-18T22:19:25.889 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-08-18T22:19:25.883+0000 7fa9cf600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:19:26.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9b5600640 1 -- 172.21.15.5:0/513280993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7fc9a40effa0 con 0x7fc9b80b40c0 2024-08-18T22:19:26.345 INFO:teuthology.orchestra.run.smithi005.stderr:added data pool 4 to fsmap 2024-08-18T22:19:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 -- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9980678f0 msgr2=0x7fc998069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9980678f0 0x7fc998069db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009ac0 tx=0x7fc9ac009190 comp rx=0 tx=0).stop 2024-08-18T22:19:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 -- 172.21.15.5:0/513280993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80b40c0 msgr2=0x7fc9b80ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80b40c0 0x7fc9b80ccaa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4018fe0 tx=0x7fc9a4019170 comp rx=0 tx=0).stop 2024-08-18T22:19:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 -- 172.21.15.5:0/513280993 shutdown_connections 2024-08-18T22:19:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9980678f0 0x7fc998069db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9b815b0c0 0x7fc9b80ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80b40c0 0x7fc9b80ccaa0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 --2- 172.21.15.5:0/513280993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9b8072a30 0x7fc9b8146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 -- 172.21.15.5:0/513280993 >> 172.21.15.5:0/513280993 conn(0x7fc9b80b1dc0 msgr2=0x7fc9b80ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 -- 172.21.15.5:0/513280993 shutdown_connections 2024-08-18T22:19:26.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.343+0000 7fc9c0000640 1 -- 172.21.15.5:0/513280993 wait complete. 2024-08-18T22:19:26.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:19:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.507+0000 7fae09200640 1 Processor -- start 2024-08-18T22:19:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.507+0000 7fae09200640 1 -- start start 2024-08-18T22:19:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae09200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0406f290 0x7fae040ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae09200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae040cd3a0 0x7fae04072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae09200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae040cee20 con 0x7fae0415b010 2024-08-18T22:19:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae09200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fae040cfa30 con 0x7fae040cd3a0 2024-08-18T22:19:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae09200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fae040cf100 con 0x7fae0406f290 2024-08-18T22:19:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae02800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae040cd3a0 0x7fae04072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae02800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae040cd3a0 0x7fae04072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53318/0 (socket says 172.21.15.5:53318) 2024-08-18T22:19:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae02800640 1 -- 172.21.15.5:0/1271199445 learned_addr learned my addr 172.21.15.5:0/1271199445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fadf9400640 1 --2- 172.21.15.5:0/1271199445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0406f290 0x7fae040ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae02800640 1 -- 172.21.15.5:0/1271199445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0406f290 msgr2=0x7fae040ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae02800640 1 --2- 172.21.15.5:0/1271199445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0406f290 0x7fae040ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae02800640 1 -- 172.21.15.5:0/1271199445 >> v1:172.21.15.117:6789/0 conn(0x7fae0415b010 legacy=0x7fae0406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:26.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.511+0000 7fae02800640 1 -- 172.21.15.5:0/1271199445 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae040cf3e0 con 0x7fae040cd3a0 2024-08-18T22:19:26.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae02800640 1 --2- 172.21.15.5:0/1271199445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae040cd3a0 0x7fae04072620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009e50 tx=0x7fadfc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9af5cdce94cfcd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:26.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae01400640 1 -- 172.21.15.5:0/1271199445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0a58b0 con 0x7fae040cd3a0 2024-08-18T22:19:26.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae01400640 1 -- 172.21.15.5:0/1271199445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadfc0a5a50 con 0x7fae040cd3a0 2024-08-18T22:19:26.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae01400640 1 -- 172.21.15.5:0/1271199445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0a5e20 con 0x7fae040cd3a0 2024-08-18T22:19:26.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae09200640 1 -- 172.21.15.5:0/1271199445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae040cd3a0 msgr2=0x7fae04072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:26.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae09200640 1 --2- 172.21.15.5:0/1271199445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae040cd3a0 0x7fae04072620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009e50 tx=0x7fadfc01ca00 comp rx=0 tx=0).stop 2024-08-18T22:19:26.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae09200640 1 -- 172.21.15.5:0/1271199445 shutdown_connections 2024-08-18T22:19:26.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae09200640 1 --2- 172.21.15.5:0/1271199445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae040cd3a0 0x7fae04072620 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae09200640 1 --2- 172.21.15.5:0/1271199445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0406f290 0x7fae040ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae09200640 1 -- 172.21.15.5:0/1271199445 >> 172.21.15.5:0/1271199445 conn(0x7fae040b1c50 msgr2=0x7fae040b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:26.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae09200640 1 -- 172.21.15.5:0/1271199445 shutdown_connections 2024-08-18T22:19:26.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae09200640 1 -- 172.21.15.5:0/1271199445 wait complete. 2024-08-18T22:19:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae09200640 1 Processor -- start 2024-08-18T22:19:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.515+0000 7fae09200640 1 -- start start 2024-08-18T22:19:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae09200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0406f290 0x7fae04143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae09200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae040cd3a0 0x7fae040b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae09200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae0415b010 0x7fae040c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae09200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fae040734f0 con 0x7fae040cd3a0 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae09200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fae04073370 con 0x7fae0415b010 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae09200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fae04073670 con 0x7fae0406f290 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadf9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae040cd3a0 0x7fae040b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadf9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae040cd3a0 0x7fae040b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53326/0 (socket says 172.21.15.5:53326) 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadf9400640 1 -- 172.21.15.5:0/1459731590 learned_addr learned my addr 172.21.15.5:0/1459731590 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae01e00640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0406f290 0x7fae04143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae02800640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae0415b010 0x7fae040c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadf9400640 1 -- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0406f290 msgr2=0x7fae04143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadf9400640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0406f290 0x7fae04143a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadf9400640 1 -- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae0415b010 msgr2=0x7fae040c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadf9400640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae0415b010 0x7fae040c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadf9400640 1 -- 172.21.15.5:0/1459731590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae04152170 con 0x7fae040cd3a0 2024-08-18T22:19:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae02800640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae0415b010 0x7fae040c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadf9400640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae040cd3a0 0x7fae040b14a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d5f0 tx=0x7fadec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadfaa00640 1 -- 172.21.15.5:0/1459731590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec0125f0 con 0x7fae040cd3a0 2024-08-18T22:19:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadfaa00640 1 -- 172.21.15.5:0/1459731590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadec019070 con 0x7fae040cd3a0 2024-08-18T22:19:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae09200640 1 -- 172.21.15.5:0/1459731590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae04152450 con 0x7fae040cd3a0 2024-08-18T22:19:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadfaa00640 1 -- 172.21.15.5:0/1459731590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec0129f0 con 0x7fae040cd3a0 2024-08-18T22:19:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae09200640 1 -- 172.21.15.5:0/1459731590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae0414fde0 con 0x7fae040cd3a0 2024-08-18T22:19:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fae09200640 1 -- 172.21.15.5:0/1459731590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae040ce840 con 0x7fae040cd3a0 2024-08-18T22:19:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.519+0000 7fadfaa00640 1 -- 172.21.15.5:0/1459731590 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fadec012b90 con 0x7fae040cd3a0 2024-08-18T22:19:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.523+0000 7fadfaa00640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fade00678c0 0x7fade0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.523+0000 7fadfaa00640 1 -- 172.21.15.5:0/1459731590 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fadec0864a0 con 0x7fae040cd3a0 2024-08-18T22:19:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.523+0000 7fae01e00640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fade00678c0 0x7fade0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.523+0000 7fae01e00640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fade00678c0 0x7fade0069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fadf40015b0 tx=0x7fadf4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.527+0000 7fadfaa00640 1 -- 172.21.15.5:0/1459731590 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fadec056c00 con 0x7fae040cd3a0 2024-08-18T22:19:26.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.723+0000 7fae09200640 1 -- 172.21.15.5:0/1459731590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae04152620 con 0x7fae040cd3a0 2024-08-18T22:19:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.723+0000 7fadfaa00640 1 -- 172.21.15.5:0/1459731590 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5216 (secure 0 0 0) 0x7fadec056500 con 0x7fae040cd3a0 2024-08-18T22:19:26.729 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:26.729 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"btime":"2024-08-18T22:19:26:335864+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4007066150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4007066150},{"type":"v1","addr":"172.21.15.117:6836","nonce":4007066150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1179279001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1179279001},{"type":"v1","addr":"172.21.15.117:6837","nonce":1179279001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:19:20.503823+0000","modified":"2024-08-18T22:19:25.756791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3727670717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3727670717},{"type":"v1","addr":"172.21.15.5:6835","nonce":3727670717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-08-18T22:19:26.729 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-08-18T22:19:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 -- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fade00678c0 msgr2=0x7fade0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fade00678c0 0x7fade0069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fadf40015b0 tx=0x7fadf4009040 comp rx=0 tx=0).stop 2024-08-18T22:19:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 -- 172.21.15.5:0/1459731590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae040cd3a0 msgr2=0x7fae040b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae040cd3a0 0x7fae040b14a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d5f0 tx=0x7fadec00dab0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 -- 172.21.15.5:0/1459731590 shutdown_connections 2024-08-18T22:19:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fade00678c0 0x7fade0069d80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae0415b010 0x7fae040c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae040cd3a0 0x7fae040b14a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 --2- 172.21.15.5:0/1459731590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae0406f290 0x7fae04143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 -- 172.21.15.5:0/1459731590 >> 172.21.15.5:0/1459731590 conn(0x7fae040b1c50 msgr2=0x7fae040ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:26.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 -- 172.21.15.5:0/1459731590 shutdown_connections 2024-08-18T22:19:26.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.727+0000 7fae09200640 1 -- 172.21.15.5:0/1459731590 wait complete. 2024-08-18T22:19:26.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:26.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3313e00640 1 Processor -- start 2024-08-18T22:19:26.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3313e00640 1 -- start start 2024-08-18T22:19:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3313e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f330c161960 0x7f330c06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3313e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f330c070730 0x7f330c070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3313e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c15dda0 0x7f330c15e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3313e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f330c0710e0 con 0x7f330c161960 2024-08-18T22:19:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3313e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f330c15fcc0 con 0x7f330c070730 2024-08-18T22:19:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3313e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f330c15eb60 con 0x7f330c15dda0 2024-08-18T22:19:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3311400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f330c161960 0x7f330c06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3311400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f330c161960 0x7f330c06fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53334/0 (socket says 172.21.15.5:53334) 2024-08-18T22:19:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3311400640 1 -- 172.21.15.5:0/3030457065 learned_addr learned my addr 172.21.15.5:0/3030457065 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3310a00640 1 --2- 172.21.15.5:0/3030457065 >> v2:172.21.15.117:3300/0 conn(0x7f330c070730 0x7f330c070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3311e00640 1 --2- 172.21.15.5:0/3030457065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c15dda0 0x7f330c15e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3311400640 1 -- 172.21.15.5:0/3030457065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c15dda0 msgr2=0x7f330c15e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3311400640 1 --2- 172.21.15.5:0/3030457065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c15dda0 0x7f330c15e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3311400640 1 -- 172.21.15.5:0/3030457065 >> v2:172.21.15.117:3300/0 conn(0x7f330c070730 msgr2=0x7f330c070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3311400640 1 --2- 172.21.15.5:0/3030457065 >> v2:172.21.15.117:3300/0 conn(0x7f330c070730 0x7f330c070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.887+0000 7f3311400640 1 -- 172.21.15.5:0/3030457065 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c15ee40 con 0x7f330c161960 2024-08-18T22:19:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.891+0000 7f3311400640 1 --2- 172.21.15.5:0/3030457065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c161960 0x7f330c06fd20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f330c071d80 tx=0x7f330001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27620f1590110869 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.891+0000 7f330be00640 1 -- 172.21.15.5:0/3030457065 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33000b1070 con 0x7f330c161960 2024-08-18T22:19:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.891+0000 7f330be00640 1 -- 172.21.15.5:0/3030457065 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33000ac630 con 0x7f330c161960 2024-08-18T22:19:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.891+0000 7f330be00640 1 -- 172.21.15.5:0/3030457065 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33000a8050 con 0x7f330c161960 2024-08-18T22:19:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.891+0000 7f3313e00640 1 -- 172.21.15.5:0/3030457065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c161960 msgr2=0x7f330c06fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.891+0000 7f3313e00640 1 --2- 172.21.15.5:0/3030457065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c161960 0x7f330c06fd20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f330c071d80 tx=0x7f330001c520 comp rx=0 tx=0).stop 2024-08-18T22:19:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.891+0000 7f3313e00640 1 -- 172.21.15.5:0/3030457065 shutdown_connections 2024-08-18T22:19:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.891+0000 7f3313e00640 1 --2- 172.21.15.5:0/3030457065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c15dda0 0x7f330c15e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.891+0000 7f3313e00640 1 --2- 172.21.15.5:0/3030457065 >> v2:172.21.15.117:3300/0 conn(0x7f330c070730 0x7f330c070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.891+0000 7f3313e00640 1 --2- 172.21.15.5:0/3030457065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c161960 0x7f330c06fd20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.891+0000 7f3313e00640 1 -- 172.21.15.5:0/3030457065 >> 172.21.15.5:0/3030457065 conn(0x7f330c0d2130 msgr2=0x7f330c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3313e00640 1 -- 172.21.15.5:0/3030457065 shutdown_connections 2024-08-18T22:19:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3313e00640 1 -- 172.21.15.5:0/3030457065 wait complete. 2024-08-18T22:19:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3313e00640 1 Processor -- start 2024-08-18T22:19:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3313e00640 1 -- start start 2024-08-18T22:19:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3313e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c070730 0x7f330c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3313e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c15dda0 0x7f330c15a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3313e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c161960 0x7f330c06de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3313e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f330c09ba30 con 0x7f330c161960 2024-08-18T22:19:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3313e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f330c15e770 con 0x7f330c070730 2024-08-18T22:19:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3313e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f330c0cc830 con 0x7f330c15dda0 2024-08-18T22:19:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3311e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c161960 0x7f330c06de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3310a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c15dda0 0x7f330c15a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3311e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c161960 0x7f330c06de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53338/0 (socket says 172.21.15.5:53338) 2024-08-18T22:19:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3311e00640 1 -- 172.21.15.5:0/760429623 learned_addr learned my addr 172.21.15.5:0/760429623 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3311400640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c070730 0x7f330c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3311e00640 1 -- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c15dda0 msgr2=0x7f330c15a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3311e00640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c15dda0 0x7f330c15a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3311e00640 1 -- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c070730 msgr2=0x7f330c15d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3311e00640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c070730 0x7f330c15d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3311e00640 1 -- 172.21.15.5:0/760429623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c0ccf70 con 0x7f330c161960 2024-08-18T22:19:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3311e00640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c161960 0x7f330c06de20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f330400efc0 tx=0x7f330400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3309600640 1 -- 172.21.15.5:0/760429623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304018020 con 0x7f330c161960 2024-08-18T22:19:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3309600640 1 -- 172.21.15.5:0/760429623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3304014480 con 0x7f330c161960 2024-08-18T22:19:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3309600640 1 -- 172.21.15.5:0/760429623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304014870 con 0x7f330c161960 2024-08-18T22:19:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.895+0000 7f3313e00640 1 -- 172.21.15.5:0/760429623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330c0cd250 con 0x7f330c161960 2024-08-18T22:19:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.899+0000 7f3313e00640 1 -- 172.21.15.5:0/760429623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330c0cc4c0 con 0x7f330c161960 2024-08-18T22:19:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.899+0000 7f3313e00640 1 -- 172.21.15.5:0/760429623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f330c0ccd60 con 0x7f330c161960 2024-08-18T22:19:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.899+0000 7f3309600640 1 -- 172.21.15.5:0/760429623 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f330401b020 con 0x7f330c161960 2024-08-18T22:19:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.899+0000 7f3309600640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678c0 0x7f32ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.899+0000 7f3309600640 1 -- 172.21.15.5:0/760429623 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3304086cc0 con 0x7f330c161960 2024-08-18T22:19:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.899+0000 7f3311400640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678c0 0x7f32ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.899+0000 7f3311400640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678c0 0x7f32ec069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f33000ae000 tx=0x7f3300009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:26.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:26.903+0000 7f3309600640 1 -- 172.21.15.5:0/760429623 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f330408d080 con 0x7f330c161960 2024-08-18T22:19:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.071+0000 7f3313e00640 1 -- 172.21.15.5:0/760429623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f330c070ba0 con 0x7f330c161960 2024-08-18T22:19:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.071+0000 7f3309600640 1 -- 172.21.15.5:0/760429623 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18442 (secure 0 0 0) 0x7f3304022030 con 0x7f330c161960 2024-08-18T22:19:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:27.076 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:25.756631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 -- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678c0 msgr2=0x7f32ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678c0 0x7f32ec069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f33000ae000 tx=0x7f3300009040 comp rx=0 tx=0).stop 2024-08-18T22:19:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 -- 172.21.15.5:0/760429623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c161960 msgr2=0x7f330c06de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c161960 0x7f330c06de20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f330400efc0 tx=0x7f330400c490 comp rx=0 tx=0).stop 2024-08-18T22:19:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 -- 172.21.15.5:0/760429623 shutdown_connections 2024-08-18T22:19:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678c0 0x7f32ec069d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c161960 0x7f330c06de20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c15dda0 0x7f330c15a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 --2- 172.21.15.5:0/760429623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c070730 0x7f330c15d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 -- 172.21.15.5:0/760429623 >> 172.21.15.5:0/760429623 conn(0x7f330c0d2130 msgr2=0x7f330c09afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 -- 172.21.15.5:0/760429623 shutdown_connections 2024-08-18T22:19:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.075+0000 7f3313e00640 1 -- 172.21.15.5:0/760429623 wait complete. 2024-08-18T22:19:27.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:27.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff635600640 1 Processor -- start 2024-08-18T22:19:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff635600640 1 -- start start 2024-08-18T22:19:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff635600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63015c180 0x7ff6300b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff635600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff63006fad0 0x7ff63015c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff635600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6300b5e30 con 0x7ff630071580 2024-08-18T22:19:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff635600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff63015caa0 con 0x7ff63006fad0 2024-08-18T22:19:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff635600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff6300b6110 con 0x7ff63015c180 2024-08-18T22:19:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff62ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63015c180 0x7ff6300b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff62ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63015c180 0x7ff6300b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:52212/0 (socket says 172.21.15.5:52212) 2024-08-18T22:19:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff62ea00640 1 -- 172.21.15.5:0/513915354 learned_addr learned my addr 172.21.15.5:0/513915354 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff627e00640 1 --2- 172.21.15.5:0/513915354 >> v2:172.21.15.117:3300/0 conn(0x7ff63006fad0 0x7ff63015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff62ea00640 1 -- 172.21.15.5:0/513915354 >> v2:172.21.15.117:3300/0 conn(0x7ff63006fad0 msgr2=0x7ff63015c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff62ea00640 1 --2- 172.21.15.5:0/513915354 >> v2:172.21.15.117:3300/0 conn(0x7ff63006fad0 0x7ff63015c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff62ea00640 1 -- 172.21.15.5:0/513915354 >> v1:172.21.15.117:6789/0 conn(0x7ff630071580 legacy=0x7ff6300d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.235+0000 7ff62ea00640 1 -- 172.21.15.5:0/513915354 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6300b63f0 con 0x7ff63015c180 2024-08-18T22:19:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff62ea00640 1 --2- 172.21.15.5:0/513915354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63015c180 0x7ff6300b57c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff620009870 tx=0x7ff62001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8017cdcb3532ac9d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff62e000640 1 -- 172.21.15.5:0/513915354 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6200b1070 con 0x7ff63015c180 2024-08-18T22:19:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff62e000640 1 -- 172.21.15.5:0/513915354 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6200ac600 con 0x7ff63015c180 2024-08-18T22:19:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff62e000640 1 -- 172.21.15.5:0/513915354 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6200ac9d0 con 0x7ff63015c180 2024-08-18T22:19:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff635600640 1 -- 172.21.15.5:0/513915354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63015c180 msgr2=0x7ff6300b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff635600640 1 --2- 172.21.15.5:0/513915354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63015c180 0x7ff6300b57c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff620009870 tx=0x7ff62001c410 comp rx=0 tx=0).stop 2024-08-18T22:19:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff635600640 1 -- 172.21.15.5:0/513915354 shutdown_connections 2024-08-18T22:19:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff635600640 1 --2- 172.21.15.5:0/513915354 >> v2:172.21.15.117:3300/0 conn(0x7ff63006fad0 0x7ff63015c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff635600640 1 --2- 172.21.15.5:0/513915354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63015c180 0x7ff6300b57c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff635600640 1 -- 172.21.15.5:0/513915354 >> 172.21.15.5:0/513915354 conn(0x7ff6300b3eb0 msgr2=0x7ff6300b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff635600640 1 -- 172.21.15.5:0/513915354 shutdown_connections 2024-08-18T22:19:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.239+0000 7ff635600640 1 -- 172.21.15.5:0/513915354 wait complete. 2024-08-18T22:19:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff635600640 1 Processor -- start 2024-08-18T22:19:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff635600640 1 -- start start 2024-08-18T22:19:27.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff635600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63006fad0 0x7ff630148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff635600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff630071580 0x7ff630148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff635600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63015c180 0x7ff63015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff635600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff630168fd0 con 0x7ff630071580 2024-08-18T22:19:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff635600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff630071dc0 con 0x7ff63015c180 2024-08-18T22:19:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff635600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff630169150 con 0x7ff63006fad0 2024-08-18T22:19:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff627e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff630071580 0x7ff630148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff627e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff630071580 0x7ff630148ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53350/0 (socket says 172.21.15.5:53350) 2024-08-18T22:19:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff627e00640 1 -- 172.21.15.5:0/228734126 learned_addr learned my addr 172.21.15.5:0/228734126 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff62f400640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63015c180 0x7ff63015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff62ea00640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63006fad0 0x7ff630148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff627e00640 1 -- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63006fad0 msgr2=0x7ff630148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff627e00640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63006fad0 0x7ff630148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff627e00640 1 -- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63015c180 msgr2=0x7ff63015aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff627e00640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63015c180 0x7ff63015aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff627e00640 1 -- 172.21.15.5:0/228734126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63014c010 con 0x7ff630071580 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff627e00640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff630071580 0x7ff630148ff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff61800e870 tx=0x7ff61800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff626a00640 1 -- 172.21.15.5:0/228734126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618017070 con 0x7ff630071580 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff626a00640 1 -- 172.21.15.5:0/228734126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61800c940 con 0x7ff630071580 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff626a00640 1 -- 172.21.15.5:0/228734126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61800cd10 con 0x7ff630071580 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff635600640 1 -- 172.21.15.5:0/228734126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6301531a0 con 0x7ff630071580 2024-08-18T22:19:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff635600640 1 -- 172.21.15.5:0/228734126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff63014bd30 con 0x7ff630071580 2024-08-18T22:19:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.243+0000 7ff635600640 1 -- 172.21.15.5:0/228734126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff63015c560 con 0x7ff630071580 2024-08-18T22:19:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.247+0000 7ff626a00640 1 -- 172.21.15.5:0/228734126 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff61801a070 con 0x7ff630071580 2024-08-18T22:19:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.247+0000 7ff626a00640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff60c0678c0 0x7ff60c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.247+0000 7ff626a00640 1 -- 172.21.15.5:0/228734126 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff618085e20 con 0x7ff630071580 2024-08-18T22:19:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.247+0000 7ff62ea00640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff60c0678c0 0x7ff60c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.247+0000 7ff62ea00640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff60c0678c0 0x7ff60c069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff6200ae000 tx=0x7ff6200a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:27.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.251+0000 7ff626a00640 1 -- 172.21.15.5:0/228734126 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff618055fc0 con 0x7ff630071580 2024-08-18T22:19:27.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.419+0000 7ff635600640 1 -- 172.21.15.5:0/228734126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6300cf7d0 con 0x7ff630071580 2024-08-18T22:19:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.419+0000 7ff626a00640 1 -- 172.21.15.5:0/228734126 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18442 (secure 0 0 0) 0x7ff61805a2c0 con 0x7ff630071580 2024-08-18T22:19:27.425 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:27.425 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:25.756631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:27.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 -- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff60c0678c0 msgr2=0x7ff60c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff60c0678c0 0x7ff60c069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff6200ae000 tx=0x7ff6200a7000 comp rx=0 tx=0).stop 2024-08-18T22:19:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 -- 172.21.15.5:0/228734126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff630071580 msgr2=0x7ff630148ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff630071580 0x7ff630148ff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff61800e870 tx=0x7ff61800ec70 comp rx=0 tx=0).stop 2024-08-18T22:19:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 -- 172.21.15.5:0/228734126 shutdown_connections 2024-08-18T22:19:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff60c0678c0 0x7ff60c069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63015c180 0x7ff63015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff630071580 0x7ff630148ff0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 --2- 172.21.15.5:0/228734126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63006fad0 0x7ff630148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 -- 172.21.15.5:0/228734126 >> 172.21.15.5:0/228734126 conn(0x7ff6300b3eb0 msgr2=0x7ff6300b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 -- 172.21.15.5:0/228734126 shutdown_connections 2024-08-18T22:19:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.423+0000 7ff635600640 1 -- 172.21.15.5:0/228734126 wait complete. 2024-08-18T22:19:27.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:19:27.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.599+0000 7fb96a400640 1 Processor -- start 2024-08-18T22:19:27.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.599+0000 7fb96a400640 1 -- start start 2024-08-18T22:19:27.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.599+0000 7fb96a400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964161960 0x7fb96406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb96a400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb96415e4b0 0x7fb964070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb96a400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb96415eb60 con 0x7fb964070730 2024-08-18T22:19:27.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb96a400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb96415fcc0 con 0x7fb96415e4b0 2024-08-18T22:19:27.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb96a400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb9640710b0 con 0x7fb964161960 2024-08-18T22:19:27.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb95aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb964070730 0x7fb96415dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38286/0 (socket says 172.21.15.5:38286) 2024-08-18T22:19:27.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb95aa00640 1 -- 172.21.15.5:0/2385384310 learned_addr learned my addr 172.21.15.5:0/2385384310 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:27.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb963e00640 1 --2- 172.21.15.5:0/2385384310 >> v2:172.21.15.117:3300/0 conn(0x7fb96415e4b0 0x7fb964070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb963400640 1 --2- 172.21.15.5:0/2385384310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964161960 0x7fb96406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb962a00640 1 -- 172.21.15.5:0/2385384310 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180267680 0 0) 0x7fb96415eb60 con 0x7fb964070730 2024-08-18T22:19:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb962a00640 1 -- 172.21.15.5:0/2385384310 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb948003530 con 0x7fb964070730 2024-08-18T22:19:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb963e00640 1 -- 172.21.15.5:0/2385384310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964161960 msgr2=0x7fb96406fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb963e00640 1 --2- 172.21.15.5:0/2385384310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964161960 0x7fb96406fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb963e00640 1 -- 172.21.15.5:0/2385384310 >> v1:172.21.15.5:6789/0 conn(0x7fb964070730 legacy=0x7fb96415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb963e00640 1 -- 172.21.15.5:0/2385384310 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96415ee40 con 0x7fb96415e4b0 2024-08-18T22:19:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.603+0000 7fb963e00640 1 --2- 172.21.15.5:0/2385384310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb96415e4b0 0x7fb964070b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009d90 tx=0x7fb95c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d6a3e1f7e80c57d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb962a00640 1 -- 172.21.15.5:0/2385384310 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0b2070 con 0x7fb96415e4b0 2024-08-18T22:19:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb962a00640 1 -- 172.21.15.5:0/2385384310 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95c0a5830 con 0x7fb96415e4b0 2024-08-18T22:19:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb962a00640 1 -- 172.21.15.5:0/2385384310 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0a5be0 con 0x7fb96415e4b0 2024-08-18T22:19:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 -- 172.21.15.5:0/2385384310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb96415e4b0 msgr2=0x7fb964070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 --2- 172.21.15.5:0/2385384310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb96415e4b0 0x7fb964070b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009d90 tx=0x7fb95c01c970 comp rx=0 tx=0).stop 2024-08-18T22:19:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 -- 172.21.15.5:0/2385384310 shutdown_connections 2024-08-18T22:19:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 --2- 172.21.15.5:0/2385384310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb96415e4b0 0x7fb964070b70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 --2- 172.21.15.5:0/2385384310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964161960 0x7fb96406fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 -- 172.21.15.5:0/2385384310 >> 172.21.15.5:0/2385384310 conn(0x7fb9640d2130 msgr2=0x7fb9640d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 -- 172.21.15.5:0/2385384310 shutdown_connections 2024-08-18T22:19:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 -- 172.21.15.5:0/2385384310 wait complete. 2024-08-18T22:19:27.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 Processor -- start 2024-08-18T22:19:27.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 -- start start 2024-08-18T22:19:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964070730 0x7fb9640b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96415e4b0 0x7fb96415a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb964161960 0x7fb96415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb96409ba30 con 0x7fb96415e4b0 2024-08-18T22:19:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb964070260 con 0x7fb964161960 2024-08-18T22:19:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb96a400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb9640cc4c0 con 0x7fb964070730 2024-08-18T22:19:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb95aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96415e4b0 0x7fb96415a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb95aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96415e4b0 0x7fb96415a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53356/0 (socket says 172.21.15.5:53356) 2024-08-18T22:19:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb95aa00640 1 -- 172.21.15.5:0/2349574169 learned_addr learned my addr 172.21.15.5:0/2349574169 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb963400640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964070730 0x7fb9640b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.607+0000 7fb963e00640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb964161960 0x7fb96415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95aa00640 1 -- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964070730 msgr2=0x7fb9640b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95aa00640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964070730 0x7fb9640b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95aa00640 1 -- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb964161960 msgr2=0x7fb96415a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95aa00640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb964161960 0x7fb96415a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95aa00640 1 -- 172.21.15.5:0/2349574169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9640cc760 con 0x7fb96415e4b0 2024-08-18T22:19:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95aa00640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96415e4b0 0x7fb96415a230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00c420 tx=0x7fb94c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95be00640 1 -- 172.21.15.5:0/2349574169 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c017070 con 0x7fb96415e4b0 2024-08-18T22:19:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95be00640 1 -- 172.21.15.5:0/2349574169 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c005d10 con 0x7fb96415e4b0 2024-08-18T22:19:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb96a400640 1 -- 172.21.15.5:0/2349574169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9640cca40 con 0x7fb96415e4b0 2024-08-18T22:19:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95be00640 1 -- 172.21.15.5:0/2349574169 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c007310 con 0x7fb96415e4b0 2024-08-18T22:19:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb96a400640 1 -- 172.21.15.5:0/2349574169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9640cd000 con 0x7fb96415e4b0 2024-08-18T22:19:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb96a400640 1 -- 172.21.15.5:0/2349574169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb96415eb60 con 0x7fb96415e4b0 2024-08-18T22:19:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95be00640 1 -- 172.21.15.5:0/2349574169 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb94c01a070 con 0x7fb96415e4b0 2024-08-18T22:19:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95be00640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9400678f0 0x7fb940069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.611+0000 7fb95be00640 1 -- 172.21.15.5:0/2349574169 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb94c0853c0 con 0x7fb96415e4b0 2024-08-18T22:19:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.615+0000 7fb963400640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9400678f0 0x7fb940069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.615+0000 7fb963400640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9400678f0 0x7fb940069db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb954009ac0 tx=0x7fb954009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.615+0000 7fb95be00640 1 -- 172.21.15.5:0/2349574169 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb94c055590 con 0x7fb96415e4b0 2024-08-18T22:19:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.815+0000 7fb96a400640 1 -- 172.21.15.5:0/2349574169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb96409bbb0 con 0x7fb96415e4b0 2024-08-18T22:19:27.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.815+0000 7fb95be00640 1 -- 172.21.15.5:0/2349574169 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5216 (secure 0 0 0) 0x7fb94c059890 con 0x7fb96415e4b0 2024-08-18T22:19:27.820 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:27.820 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"btime":"2024-08-18T22:19:26:335864+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4007066150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4007066150},{"type":"v1","addr":"172.21.15.117:6836","nonce":4007066150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1179279001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1179279001},{"type":"v1","addr":"172.21.15.117:6837","nonce":1179279001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:19:20.503823+0000","modified":"2024-08-18T22:19:25.756791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3727670717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3727670717},{"type":"v1","addr":"172.21.15.5:6835","nonce":3727670717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-08-18T22:19:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-08-18T22:19:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 -- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9400678f0 msgr2=0x7fb940069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9400678f0 0x7fb940069db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb954009ac0 tx=0x7fb954009190 comp rx=0 tx=0).stop 2024-08-18T22:19:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 -- 172.21.15.5:0/2349574169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96415e4b0 msgr2=0x7fb96415a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96415e4b0 0x7fb96415a230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00c420 tx=0x7fb94c00c8e0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 -- 172.21.15.5:0/2349574169 shutdown_connections 2024-08-18T22:19:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9400678f0 0x7fb940069db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb964161960 0x7fb96415a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb96415e4b0 0x7fb96415a230 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 --2- 172.21.15.5:0/2349574169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb964070730 0x7fb9640b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 -- 172.21.15.5:0/2349574169 >> 172.21.15.5:0/2349574169 conn(0x7fb9640d2130 msgr2=0x7fb96406d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 -- 172.21.15.5:0/2349574169 shutdown_connections 2024-08-18T22:19:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.819+0000 7fb96a400640 1 -- 172.21.15.5:0/2349574169 wait complete. 2024-08-18T22:19:27.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69d5e00640 1 Processor -- start 2024-08-18T22:19:27.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69d5e00640 1 -- start start 2024-08-18T22:19:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69d5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d006fad0 0x7f69d00b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69d5e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69d00b5e30 con 0x7f69d0071c90 2024-08-18T22:19:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69d5e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69d00b6110 con 0x7f69d015c180 2024-08-18T22:19:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69d5e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f69d00b63f0 con 0x7f69d006fad0 2024-08-18T22:19:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69ce000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f69d0071c90 0x7f69d00d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38296/0 (socket says 172.21.15.5:38296) 2024-08-18T22:19:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69ce000640 1 -- 172.21.15.5:0/1741944022 learned_addr learned my addr 172.21.15.5:0/1741944022 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cf400640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d006fad0 0x7f69d00b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344847397 0 0) 0x7f69d00b5e30 con 0x7f69d0071c90 2024-08-18T22:19:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69b4003530 con 0x7f69d0071c90 2024-08-18T22:19:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3963583195 0 0) 0x7f69d00b6110 con 0x7f69d015c180 2024-08-18T22:19:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69d00b5e30 con 0x7f69d015c180 2024-08-18T22:19:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1578143738 0 0) 0x7f69b4003530 con 0x7f69d0071c90 2024-08-18T22:19:27.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d006fad0 msgr2=0x7f69d00b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:27.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d006fad0 0x7f69d00b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 >> v1:172.21.15.117:6789/0 conn(0x7f69d015c180 legacy=0x7f69d0071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d00b66d0 con 0x7f69d0071c90 2024-08-18T22:19:27.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f69bc001680 con 0x7f69d0071c90 2024-08-18T22:19:27.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 >> v1:172.21.15.5:6789/0 conn(0x7f69d0071c90 legacy=0x7f69d00d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69b4003b80 0x7f69b4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69b4004810 0x7f69b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d006fad0 0x7f69b40052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f69d00b63f0 con 0x7f69b4003b80 2024-08-18T22:19:27.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f69b400bc00 con 0x7f69b4004810 2024-08-18T22:19:27.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.979+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f69b400be00 con 0x7f69d006fad0 2024-08-18T22:19:27.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cea00640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69b4003b80 0x7f69b4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69ce000640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69b4004810 0x7f69b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cf400640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d006fad0 0x7f69b40052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cea00640 1 -- 172.21.15.5:0/1741944022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d006fad0 msgr2=0x7f69b40052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:27.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cea00640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d006fad0 0x7f69b40052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cea00640 1 -- 172.21.15.5:0/1741944022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69b4004810 msgr2=0x7f69b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cea00640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69b4004810 0x7f69b4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cea00640 1 -- 172.21.15.5:0/1741944022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b4003530 con 0x7f69b4003b80 2024-08-18T22:19:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cea00640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69b4003b80 0x7f69b4003f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69c00018d0 tx=0x7f69c001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f1f55bd47fb92d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c0001520 con 0x7f69b4003b80 2024-08-18T22:19:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c00052d0 con 0x7f69b4003b80 2024-08-18T22:19:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cd600640 1 -- 172.21.15.5:0/1741944022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c0003840 con 0x7f69b4003b80 2024-08-18T22:19:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69d5e00640 1 -- 172.21.15.5:0/1741944022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69b4003b80 msgr2=0x7f69b4003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69d5e00640 1 --2- 172.21.15.5:0/1741944022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69b4003b80 0x7f69b4003f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69c00018d0 tx=0x7f69c001c520 comp rx=0 tx=0).stop 2024-08-18T22:19:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.983+0000 7f69cf400640 1 -- 172.21.15.5:0/1741944022 reap_dead start 2024-08-18T22:19:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 -- 172.21.15.5:0/1741944022 shutdown_connections 2024-08-18T22:19:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 -- 172.21.15.5:0/1741944022 >> 172.21.15.5:0/1741944022 conn(0x7f69d00b3eb0 msgr2=0x7f69d00b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 -- 172.21.15.5:0/1741944022 shutdown_connections 2024-08-18T22:19:27.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 -- 172.21.15.5:0/1741944022 wait complete. 2024-08-18T22:19:27.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 Processor -- start 2024-08-18T22:19:27.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 -- start start 2024-08-18T22:19:27.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69b4003b80 0x7f69d015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69d0159ce0 0x7f69d0150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d014bd60 0x7f69d015fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f69d0168150 con 0x7f69d014bd60 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f69d0167fd0 con 0x7f69d0159ce0 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f69d01682d0 con 0x7f69b4003b80 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69cf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d014bd60 0x7f69d015fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69cf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d014bd60 0x7f69d015fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53368/0 (socket says 172.21.15.5:53368) 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69cf400640 1 -- 172.21.15.5:0/881644133 learned_addr learned my addr 172.21.15.5:0/881644133 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69ce000640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69d0159ce0 0x7f69d0150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69cea00640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69b4003b80 0x7f69d015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69cf400640 1 -- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69b4003b80 msgr2=0x7f69d015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69cf400640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69b4003b80 0x7f69d015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69cf400640 1 -- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69d0159ce0 msgr2=0x7f69d0150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69cf400640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69d0159ce0 0x7f69d0150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69cf400640 1 -- 172.21.15.5:0/881644133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d015a160 con 0x7f69d014bd60 2024-08-18T22:19:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69cf400640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d014bd60 0x7f69d015fbc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69d00b6c90 tx=0x7f69c800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69c7400640 1 -- 172.21.15.5:0/881644133 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c80039a0 con 0x7f69d014bd60 2024-08-18T22:19:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69c7400640 1 -- 172.21.15.5:0/881644133 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c801c070 con 0x7f69d014bd60 2024-08-18T22:19:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69d5e00640 1 -- 172.21.15.5:0/881644133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d015a3e0 con 0x7f69d014bd60 2024-08-18T22:19:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.987+0000 7f69c7400640 1 -- 172.21.15.5:0/881644133 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c8003d80 con 0x7f69d014bd60 2024-08-18T22:19:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.991+0000 7f69d5e00640 1 -- 172.21.15.5:0/881644133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d015a9a0 con 0x7f69d014bd60 2024-08-18T22:19:27.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.991+0000 7f69d5e00640 1 -- 172.21.15.5:0/881644133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d00d12a0 con 0x7f69d014bd60 2024-08-18T22:19:27.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.991+0000 7f69c7400640 1 -- 172.21.15.5:0/881644133 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f69c8004030 con 0x7f69d014bd60 2024-08-18T22:19:27.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.991+0000 7f69c7400640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678c0 0x7f69b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:27.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.991+0000 7f69c7400640 1 -- 172.21.15.5:0/881644133 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f69c80869b0 con 0x7f69d014bd60 2024-08-18T22:19:27.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.991+0000 7f69cea00640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678c0 0x7f69b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:27.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.991+0000 7f69cea00640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678c0 0x7f69b0069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69c00ac000 tx=0x7f69c00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:27.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:27.995+0000 7f69c7400640 1 -- 172.21.15.5:0/881644133 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f69d015a160 con 0x7f69d014bd60 2024-08-18T22:19:28.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.163+0000 7f69d5e00640 1 -- 172.21.15.5:0/881644133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69d00725e0 con 0x7f69d014bd60 2024-08-18T22:19:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.163+0000 7f69c7400640 1 -- 172.21.15.5:0/881644133 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18442 (secure 0 0 0) 0x7f69c8010040 con 0x7f69d014bd60 2024-08-18T22:19:28.169 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:28.169 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:25.756631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 -- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678c0 msgr2=0x7f69b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678c0 0x7f69b0069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69c00ac000 tx=0x7f69c00a6000 comp rx=0 tx=0).stop 2024-08-18T22:19:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 -- 172.21.15.5:0/881644133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d014bd60 msgr2=0x7f69d015fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d014bd60 0x7f69d015fbc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69d00b6c90 tx=0x7f69c800f580 comp rx=0 tx=0).stop 2024-08-18T22:19:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 -- 172.21.15.5:0/881644133 shutdown_connections 2024-08-18T22:19:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678c0 0x7f69b0069d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d014bd60 0x7f69d015fbc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69d0159ce0 0x7f69d0150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 --2- 172.21.15.5:0/881644133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69b4003b80 0x7f69d015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 -- 172.21.15.5:0/881644133 >> 172.21.15.5:0/881644133 conn(0x7f69d00b3eb0 msgr2=0x7f69d006ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 -- 172.21.15.5:0/881644133 shutdown_connections 2024-08-18T22:19:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.167+0000 7f69d5e00640 1 -- 172.21.15.5:0/881644133 wait complete. 2024-08-18T22:19:28.594 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:19:20.503823+0000', 'modified': '2024-08-18T22:19:25.756791+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/3727670717', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 3727670717}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 3727670717}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4269, 'qdb_cluster': [4269]} 2024-08-18T22:19:28.594 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:19:28.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-18T22:19:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.735+0000 7fb765c00640 1 Processor -- start 2024-08-18T22:19:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.735+0000 7fb765c00640 1 -- start start 2024-08-18T22:19:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb765c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7600d15e0 0x7fb7600b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb765c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7600d30b0 con 0x7fb7600d1090 2024-08-18T22:19:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb765c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7600d1bd0 con 0x7fb76015fb80 2024-08-18T22:19:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb765c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb760071c60 con 0x7fb7600d15e0 2024-08-18T22:19:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb756000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb7600d1090 0x7fb760071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38300/0 (socket says 172.21.15.5:38300) 2024-08-18T22:19:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb756000640 1 -- 172.21.15.5:0/836860499 learned_addr learned my addr 172.21.15.5:0/836860499 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb75f400640 1 --2- 172.21.15.5:0/836860499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7600d15e0 0x7fb7600b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb75e000640 1 -- 172.21.15.5:0/836860499 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558272151 0 0) 0x7fb7600d30b0 con 0x7fb7600d1090 2024-08-18T22:19:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb75e000640 1 -- 172.21.15.5:0/836860499 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb744003530 con 0x7fb7600d1090 2024-08-18T22:19:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb75e000640 1 -- 172.21.15.5:0/836860499 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3624832941 0 0) 0x7fb7600d1bd0 con 0x7fb76015fb80 2024-08-18T22:19:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb75e000640 1 -- 172.21.15.5:0/836860499 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7600d30b0 con 0x7fb76015fb80 2024-08-18T22:19:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb75f400640 1 -- 172.21.15.5:0/836860499 >> v1:172.21.15.117:6789/0 conn(0x7fb76015fb80 legacy=0x7fb76006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb75f400640 1 -- 172.21.15.5:0/836860499 >> v1:172.21.15.5:6789/0 conn(0x7fb7600d1090 legacy=0x7fb760071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.739+0000 7fb75f400640 1 -- 172.21.15.5:0/836860499 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7600d2dd0 con 0x7fb7600d15e0 2024-08-18T22:19:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb75f400640 1 --2- 172.21.15.5:0/836860499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7600d15e0 0x7fb7600b5ad0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb758009dc0 tx=0x7fb75801c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49a267ec642161fe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb75e000640 1 -- 172.21.15.5:0/836860499 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7580b2070 con 0x7fb7600d15e0 2024-08-18T22:19:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb75e000640 1 -- 172.21.15.5:0/836860499 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7580a5730 con 0x7fb7600d15e0 2024-08-18T22:19:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb75e000640 1 -- 172.21.15.5:0/836860499 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7580a5b00 con 0x7fb7600d15e0 2024-08-18T22:19:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb765c00640 1 -- 172.21.15.5:0/836860499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7600d15e0 msgr2=0x7fb7600b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb765c00640 1 --2- 172.21.15.5:0/836860499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7600d15e0 0x7fb7600b5ad0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb758009dc0 tx=0x7fb75801c870 comp rx=0 tx=0).stop 2024-08-18T22:19:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb765c00640 1 -- 172.21.15.5:0/836860499 shutdown_connections 2024-08-18T22:19:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb765c00640 1 --2- 172.21.15.5:0/836860499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7600d15e0 0x7fb7600b5ad0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb765c00640 1 -- 172.21.15.5:0/836860499 >> 172.21.15.5:0/836860499 conn(0x7fb7600d2180 msgr2=0x7fb7600d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:28.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb765c00640 1 -- 172.21.15.5:0/836860499 shutdown_connections 2024-08-18T22:19:28.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb765c00640 1 -- 172.21.15.5:0/836860499 wait complete. 2024-08-18T22:19:28.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb765c00640 1 Processor -- start 2024-08-18T22:19:28.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.743+0000 7fb765c00640 1 -- start start 2024-08-18T22:19:28.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb765c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7600d1090 0x7fb76006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb765c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7600d15e0 0x7fb7601faa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb765c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76015fb80 0x7fb7601fafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb765c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb76016a310 con 0x7fb7600d1090 2024-08-18T22:19:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb765c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7600d1eb0 con 0x7fb76015fb80 2024-08-18T22:19:28.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb765c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb76016a490 con 0x7fb7600d15e0 2024-08-18T22:19:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb75ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7600d1090 0x7fb76006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb75ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7600d1090 0x7fb76006d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53376/0 (socket says 172.21.15.5:53376) 2024-08-18T22:19:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb756000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7600d15e0 0x7fb7601faa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb75ea00640 1 -- 172.21.15.5:0/3790942726 learned_addr learned my addr 172.21.15.5:0/3790942726 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb75f400640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76015fb80 0x7fb7601fafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb75ea00640 1 -- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7600d15e0 msgr2=0x7fb7601faa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb75ea00640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7600d15e0 0x7fb7601faa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb75ea00640 1 -- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76015fb80 msgr2=0x7fb7601fafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb75ea00640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76015fb80 0x7fb7601fafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb75ea00640 1 -- 172.21.15.5:0/3790942726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7600afcf0 con 0x7fb7600d1090 2024-08-18T22:19:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb75ea00640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7600d1090 0x7fb76006d7b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c430 tx=0x7fb75000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb757400640 1 -- 172.21.15.5:0/3790942726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750017070 con 0x7fb7600d1090 2024-08-18T22:19:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb757400640 1 -- 172.21.15.5:0/3790942726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7500052f0 con 0x7fb7600d1090 2024-08-18T22:19:28.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb757400640 1 -- 172.21.15.5:0/3790942726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750003840 con 0x7fb7600d1090 2024-08-18T22:19:28.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb765c00640 1 -- 172.21.15.5:0/3790942726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7600affd0 con 0x7fb7600d1090 2024-08-18T22:19:28.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb765c00640 1 -- 172.21.15.5:0/3790942726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7600b0590 con 0x7fb7600d1090 2024-08-18T22:19:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.747+0000 7fb757400640 1 -- 172.21.15.5:0/3790942726 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb75001a070 con 0x7fb7600d1090 2024-08-18T22:19:28.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb757400640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb73c0678c0 0x7fb73c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb757400640 1 -- 172.21.15.5:0/3790942726 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb7500853f0 con 0x7fb7600d1090 2024-08-18T22:19:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb769088000 1 Processor -- start 2024-08-18T22:19:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb756000640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb73c0678c0 0x7fb73c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb769088000 1 -- start start 2024-08-18T22:19:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb756000640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb73c0678c0 0x7fb73c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7601fa790 tx=0x7fb748009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb769088000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 0x55dd9e3ac130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb769088000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3ac670 0x55dd9e362450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb769088000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e362990 0x55dd9e362d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb769088000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dd9e248fd0 con 0x55dd9e3ac670 2024-08-18T22:19:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb769088000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dd9e1af3c0 con 0x55dd9e3abd50 2024-08-18T22:19:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb769088000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dd9e154f70 con 0x55dd9e362990 2024-08-18T22:19:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb756000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3ac670 0x55dd9e362450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb756000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3ac670 0x55dd9e362450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53388/0 (socket says 172.21.15.5:53388) 2024-08-18T22:19:28.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb756000640 1 -- 172.21.15.5:0/2479684841 learned_addr learned my addr 172.21.15.5:0/2479684841 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:28.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb75f400640 1 --2- 172.21.15.5:0/2479684841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e362990 0x55dd9e362d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb75ea00640 1 --2- 172.21.15.5:0/2479684841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 0x55dd9e3ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb756000640 1 -- 172.21.15.5:0/2479684841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e362990 msgr2=0x55dd9e362d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:28.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb756000640 1 --2- 172.21.15.5:0/2479684841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e362990 0x55dd9e362d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb756000640 1 -- 172.21.15.5:0/2479684841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 msgr2=0x55dd9e3ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:28.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb756000640 1 --2- 172.21.15.5:0/2479684841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 0x55dd9e3ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb756000640 1 -- 172.21.15.5:0/2479684841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd9e1492e0 con 0x55dd9e3ac670 2024-08-18T22:19:28.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb75ea00640 1 --2- 172.21.15.5:0/2479684841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 0x55dd9e3ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:28.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb756000640 1 --2- 172.21.15.5:0/2479684841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3ac670 0x55dd9e362450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb74800fae0 tx=0x7fb748000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e1949e7045887a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb74f400640 1 -- 172.21.15.5:0/2479684841 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748025070 con 0x55dd9e3ac670 2024-08-18T22:19:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb74f400640 1 -- 172.21.15.5:0/2479684841 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb748015cb0 con 0x55dd9e3ac670 2024-08-18T22:19:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.751+0000 7fb74f400640 1 -- 172.21.15.5:0/2479684841 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748015e60 con 0x55dd9e3ac670 2024-08-18T22:19:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 -- 172.21.15.5:0/2479684841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3ac670 msgr2=0x55dd9e362450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 --2- 172.21.15.5:0/2479684841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3ac670 0x55dd9e362450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb74800fae0 tx=0x7fb748000ee0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 -- 172.21.15.5:0/2479684841 shutdown_connections 2024-08-18T22:19:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 --2- 172.21.15.5:0/2479684841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e362990 0x55dd9e362d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 --2- 172.21.15.5:0/2479684841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3ac670 0x55dd9e362450 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 --2- 172.21.15.5:0/2479684841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 0x55dd9e3ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 -- 172.21.15.5:0/2479684841 >> 172.21.15.5:0/2479684841 conn(0x55dd9e35e910 msgr2=0x55dd9e360d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:28.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 -- 172.21.15.5:0/2479684841 shutdown_connections 2024-08-18T22:19:28.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 -- 172.21.15.5:0/2479684841 wait complete. 2024-08-18T22:19:28.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 -- start start 2024-08-18T22:19:28.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 Processor -- start 2024-08-18T22:19:28.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e399640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 0x55dd9e367be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e3ac670 0x55dd9e368120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dd9e156e40 con 0x55dd9e362990 2024-08-18T22:19:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dd9e26caf0 con 0x55dd9e3abd50 2024-08-18T22:19:28.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dd9e211450 con 0x55dd9e3ac670 2024-08-18T22:19:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 10 client.0 _ll_register_callbacks cb 0x55dd9e34d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:19:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb75ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e399640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb75ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e399640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53402/0 (socket says 172.21.15.5:53402) 2024-08-18T22:19:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb75ea00640 1 -- 172.21.15.5:0/3537915389 learned_addr learned my addr 172.21.15.5:0/3537915389 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb75f400640 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e3ac670 0x55dd9e368120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb756000640 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 0x55dd9e367be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb75ea00640 1 -- 172.21.15.5:0/3537915389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e3ac670 msgr2=0x55dd9e368120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:28.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb75ea00640 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e3ac670 0x55dd9e368120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb75ea00640 1 -- 172.21.15.5:0/3537915389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 msgr2=0x55dd9e367be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:28.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb75ea00640 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 0x55dd9e367be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb75ea00640 1 -- 172.21.15.5:0/3537915389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd9e136fd0 con 0x55dd9e362990 2024-08-18T22:19:28.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb756000640 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 0x55dd9e367be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:28.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb75ea00640 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e399640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7500011f0 tx=0x7fb7500555c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebcbef6b847afb94 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:28.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb743e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:19:28.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb743e00640 1 -- 172.21.15.5:0/3537915389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750051b70 con 0x55dd9e362990 2024-08-18T22:19:28.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb743e00640 1 -- 172.21.15.5:0/3537915389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb750054950 con 0x55dd9e362990 2024-08-18T22:19:28.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 -- 172.21.15.5:0/3537915389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb748015cb0 con 0x55dd9e362990 2024-08-18T22:19:28.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb743e00640 1 -- 172.21.15.5:0/3537915389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fb750083050 con 0x55dd9e362990 2024-08-18T22:19:28.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 10 client.4401 fetch_fsmap learned FSMap version 6 2024-08-18T22:19:28.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 1 -- 172.21.15.5:0/3537915389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55dd9e2324d0 con 0x55dd9e362990 2024-08-18T22:19:28.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb743e00640 1 -- 172.21.15.5:0/3537915389 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb748015cb0 con 0x55dd9e362990 2024-08-18T22:19:28.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb743e00640 1 -- 172.21.15.5:0/3537915389 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7fb75006d170 con 0x55dd9e362990 2024-08-18T22:19:28.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.755+0000 7fb769088000 10 client.4401 fetch_fsmap finished waiting for FSMap version 6 2024-08-18T22:19:28.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 10 client.4401 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:19:28.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 20 client.4401 populate_metadata read hostname 'smithi005' 2024-08-18T22:19:28.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55dd9e39a4f0 0x55dd9e39a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 4 client.4401 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:19:28.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 -- 172.21.15.5:0/3537915389 --> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd9e149c00 con 0x55dd9e39a4f0 2024-08-18T22:19:28.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb756000640 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55dd9e39a4f0 0x55dd9e39a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb756000640 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55dd9e39a4f0 0x55dd9e39a8d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9e13a3cdbeac814 server_cookie=623fefff9e4ccb61 in_seq=0 out_seq=0 2024-08-18T22:19:28.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb743e00640 10 client.4401 ms_handle_connect on v2:172.21.15.5:6833/3727670717 2024-08-18T22:19:28.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb743e00640 1 -- 172.21.15.5:0/3537915389 <== mds.0 v2:172.21.15.5:6833/3727670717 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd9e149c00 con 0x55dd9e39a4f0 2024-08-18T22:19:28.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb743e00640 10 client.4401 handle_command_reply: tid=0 2024-08-18T22:19:28.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 client.4401 shutdown 2024-08-18T22:19:28.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 -- 172.21.15.5:0/3537915389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 msgr2=0x55dd9e399640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e399640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7500011f0 tx=0x7fb7500555c0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 -- 172.21.15.5:0/3537915389 shutdown_connections 2024-08-18T22:19:28.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55dd9e39a4f0 0x55dd9e39a8d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e3ac670 0x55dd9e368120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e3abd50 0x55dd9e367be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb743e00640 0 client.4401 ms_handle_reset on v2:172.21.15.5:6833/3727670717 2024-08-18T22:19:28.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 --2- 172.21.15.5:0/3537915389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e399640 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 -- 172.21.15.5:0/3537915389 >> 172.21.15.5:0/3537915389 conn(0x55dd9e35e910 msgr2=0x55dd9e361520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:28.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 -- 172.21.15.5:0/3537915389 shutdown_connections 2024-08-18T22:19:28.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 1 -- 172.21.15.5:0/3537915389 wait complete. 2024-08-18T22:19:28.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.759+0000 7fb769088000 20 client.4401 trim_cache size 0 max 16384 2024-08-18T22:19:28.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 Processor -- start 2024-08-18T22:19:28.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 -- start start 2024-08-18T22:19:28.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e35e910 0x55dd9e360d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e362990 0x55dd9e361240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3abd50 0x55dd9e361c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb760203db0 con 0x55dd9e3abd50 2024-08-18T22:19:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb760156bc0 con 0x55dd9e35e910 2024-08-18T22:19:28.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb760203760 con 0x55dd9e362990 2024-08-18T22:19:28.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb75f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3abd50 0x55dd9e361c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb75f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3abd50 0x55dd9e361c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53410/0 (socket says 172.21.15.5:53410) 2024-08-18T22:19:28.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb75f400640 1 -- 172.21.15.5:0/2156119681 learned_addr learned my addr 172.21.15.5:0/2156119681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:28.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb75ea00640 1 --2- 172.21.15.5:0/2156119681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e35e910 0x55dd9e360d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb756000640 1 --2- 172.21.15.5:0/2156119681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e362990 0x55dd9e361240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb75f400640 1 -- 172.21.15.5:0/2156119681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e362990 msgr2=0x55dd9e361240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:28.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb75f400640 1 --2- 172.21.15.5:0/2156119681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e362990 0x55dd9e361240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb75f400640 1 -- 172.21.15.5:0/2156119681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e35e910 msgr2=0x55dd9e360d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:28.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb75f400640 1 --2- 172.21.15.5:0/2156119681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e35e910 0x55dd9e360d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb75f400640 1 -- 172.21.15.5:0/2156119681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd9e1a8b30 con 0x55dd9e3abd50 2024-08-18T22:19:28.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb756000640 1 --2- 172.21.15.5:0/2156119681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e362990 0x55dd9e361240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:28.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb75f400640 1 --2- 172.21.15.5:0/2156119681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3abd50 0x55dd9e361c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb758019480 tx=0x7fb758004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0d9dcde7b1d117 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:28.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb74ea00640 1 -- 172.21.15.5:0/2156119681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7580b2040 con 0x55dd9e3abd50 2024-08-18T22:19:28.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb74ea00640 1 -- 172.21.15.5:0/2156119681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7580a58d0 con 0x55dd9e3abd50 2024-08-18T22:19:28.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb74ea00640 1 -- 172.21.15.5:0/2156119681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7580a5c80 con 0x55dd9e3abd50 2024-08-18T22:19:28.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 -- 172.21.15.5:0/2156119681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3abd50 msgr2=0x55dd9e361c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 --2- 172.21.15.5:0/2156119681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3abd50 0x55dd9e361c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb758019480 tx=0x7fb758004ac0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 -- 172.21.15.5:0/2156119681 shutdown_connections 2024-08-18T22:19:28.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 --2- 172.21.15.5:0/2156119681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e3abd50 0x55dd9e361c50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 --2- 172.21.15.5:0/2156119681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e362990 0x55dd9e361240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 --2- 172.21.15.5:0/2156119681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e35e910 0x55dd9e360d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 -- 172.21.15.5:0/2156119681 >> 172.21.15.5:0/2156119681 conn(0x55dd9e3997a0 msgr2=0x55dd9e3b94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:28.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 -- 172.21.15.5:0/2156119681 shutdown_connections 2024-08-18T22:19:28.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.779+0000 7fb769088000 1 -- 172.21.15.5:0/2156119681 wait complete. 2024-08-18T22:19:28.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 -- start start 2024-08-18T22:19:28.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 Processor -- start 2024-08-18T22:19:28.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e35e910 0x55dd9e41f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e41f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e3abd50 0x55dd9e41fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dd9e1681d0 con 0x55dd9e362990 2024-08-18T22:19:28.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dd9e146900 con 0x55dd9e35e910 2024-08-18T22:19:28.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dd9e1ae6d0 con 0x55dd9e3abd50 2024-08-18T22:19:28.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 10 client.0 _ll_register_callbacks cb 0x7fb748007bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb756000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e41f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb756000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e41f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53420/0 (socket says 172.21.15.5:53420) 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb756000640 1 -- 172.21.15.5:0/3259099014 learned_addr learned my addr 172.21.15.5:0/3259099014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb75ea00640 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e35e910 0x55dd9e41f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb75f400640 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e3abd50 0x55dd9e41fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb756000640 1 -- 172.21.15.5:0/3259099014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e3abd50 msgr2=0x55dd9e41fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb756000640 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e3abd50 0x55dd9e41fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb756000640 1 -- 172.21.15.5:0/3259099014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e35e910 msgr2=0x55dd9e41f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb756000640 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e35e910 0x55dd9e41f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb756000640 1 -- 172.21.15.5:0/3259099014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd9e160810 con 0x55dd9e362990 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb756000640 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e41f930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb748020000 tx=0x7fb748000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22493a7162135e21 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb743e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb743e00640 1 -- 172.21.15.5:0/3259099014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74803a060 con 0x55dd9e362990 2024-08-18T22:19:28.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb743e00640 1 -- 172.21.15.5:0/3259099014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb748020900 con 0x55dd9e362990 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 -- 172.21.15.5:0/3259099014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7580a58d0 con 0x55dd9e362990 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb743e00640 1 -- 172.21.15.5:0/3259099014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fb748040050 con 0x55dd9e362990 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 10 client.4407 fetch_fsmap learned FSMap version 6 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 -- 172.21.15.5:0/3259099014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55dd9e145d30 con 0x55dd9e362990 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb743e00640 1 -- 172.21.15.5:0/3259099014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7580a58d0 con 0x55dd9e362990 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb743e00640 1 -- 172.21.15.5:0/3259099014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7fb748043020 con 0x55dd9e362990 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 10 client.4407 fetch_fsmap finished waiting for FSMap version 6 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 10 client.4407 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 20 client.4407 populate_metadata read hostname 'smithi005' 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55dd9e3ac670 0x55dd9e3c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 4 client.4407 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:19:28.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb769088000 1 -- 172.21.15.5:0/3259099014 --> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] -- command(tid 0: {"prefix": "status"}) -- 0x55dd9e1bcaf0 con 0x55dd9e3ac670 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb75ea00640 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55dd9e3ac670 0x55dd9e3c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb75ea00640 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55dd9e3ac670 0x55dd9e3c07d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20b032581cb23a44 server_cookie=191eb9c8fbf3ea85 in_seq=0 out_seq=0 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.783+0000 7fb743e00640 10 client.4407 ms_handle_connect on v2:172.21.15.5:6833/3727670717 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb743e00640 1 -- 172.21.15.5:0/3259099014 <== mds.0 v2:172.21.15.5:6833/3727670717 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55dd9e1bcaf0 con 0x55dd9e3ac670 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb743e00640 10 client.4407 handle_command_reply: tid=0 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 1 client.4407 shutdown 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 1 -- 172.21.15.5:0/3259099014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 msgr2=0x55dd9e41f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e41f930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb748020000 tx=0x7fb748000bd0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 1 -- 172.21.15.5:0/3259099014 shutdown_connections 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55dd9e3ac670 0x55dd9e3c07d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd9e3abd50 0x55dd9e41fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd9e362990 0x55dd9e41f930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 1 --2- 172.21.15.5:0/3259099014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd9e35e910 0x55dd9e41f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb743e00640 0 client.4407 ms_handle_reset on v2:172.21.15.5:6833/3727670717 2024-08-18T22:19:28.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 1 -- 172.21.15.5:0/3259099014 >> 172.21.15.5:0/3259099014 conn(0x55dd9e3997a0 msgr2=0x55dd9e3aa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:28.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 1 -- 172.21.15.5:0/3259099014 shutdown_connections 2024-08-18T22:19:28.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 1 -- 172.21.15.5:0/3259099014 wait complete. 2024-08-18T22:19:28.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb769088000 20 client.4407 trim_cache size 0 max 16384 2024-08-18T22:19:28.806 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:19:28.806 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:19:28.806 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:19:28.806 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4269, 2024-08-18T22:19:28.806 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:19:28.807 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:19:28.807 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:19:28.807 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 7.6950975850000001, 2024-08-18T22:19:28.807 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 6, 2024-08-18T22:19:28.807 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 25, 2024-08-18T22:19:28.807 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 25, 2024-08-18T22:19:28.807 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.915927711 2024-08-18T22:19:28.807 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:19:28.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 -- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb73c0678c0 msgr2=0x7fb73c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb73c0678c0 0x7fb73c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7601fa790 tx=0x7fb748009040 comp rx=0 tx=0).stop 2024-08-18T22:19:28.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 -- 172.21.15.5:0/3790942726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7600d1090 msgr2=0x7fb76006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7600d1090 0x7fb76006d7b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c430 tx=0x7fb75000c8f0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 -- 172.21.15.5:0/3790942726 shutdown_connections 2024-08-18T22:19:28.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb73c0678c0 0x7fb73c069d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb76015fb80 0x7fb7601fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7600d15e0 0x7fb7601faa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 --2- 172.21.15.5:0/3790942726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7600d1090 0x7fb76006d7b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 -- 172.21.15.5:0/3790942726 >> 172.21.15.5:0/3790942726 conn(0x7fb7600d2180 msgr2=0x7fb7600b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:28.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 -- 172.21.15.5:0/3790942726 shutdown_connections 2024-08-18T22:19:28.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.787+0000 7fb765c00640 1 -- 172.21.15.5:0/3790942726 wait complete. 2024-08-18T22:19:28.809 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T22:19:28.810 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:19:28.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:19:28.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4487c00640 1 Processor -- start 2024-08-18T22:19:28.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4487c00640 1 -- start start 2024-08-18T22:19:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4487c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4480071580 0x7f448006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4487c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4480071c80 con 0x7f44800b54c0 2024-08-18T22:19:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4487c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4480071f60 con 0x7f44800cbed0 2024-08-18T22:19:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4487c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f44800cba40 con 0x7f4480071580 2024-08-18T22:19:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4485200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f44800b54c0 0x7f44800b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38316/0 (socket says 172.21.15.5:38316) 2024-08-18T22:19:28.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4485200640 1 -- 172.21.15.5:0/3272112626 learned_addr learned my addr 172.21.15.5:0/3272112626 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4477e00640 1 --2- 172.21.15.5:0/3272112626 >> v2:172.21.15.117:3300/0 conn(0x7f4480071580 0x7f448006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1130625415 0 0) 0x7f4480071c80 con 0x7f44800b54c0 2024-08-18T22:19:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4464003530 con 0x7f44800b54c0 2024-08-18T22:19:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2488658958 0 0) 0x7f4464003530 con 0x7f44800b54c0 2024-08-18T22:19:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 >> v2:172.21.15.117:3300/0 conn(0x7f4480071580 msgr2=0x7f448006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 --2- 172.21.15.5:0/3272112626 >> v2:172.21.15.117:3300/0 conn(0x7f4480071580 0x7f448006dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 >> v1:172.21.15.117:6789/0 conn(0x7f44800cbed0 legacy=0x7f44800cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44800cb6d0 con 0x7f44800b54c0 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f4470001680 con 0x7f44800b54c0 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 >> v1:172.21.15.5:6789/0 conn(0x7f44800b54c0 legacy=0x7f44800b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 --2- 172.21.15.5:0/3272112626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44640039c0 0x7f4464003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 --2- 172.21.15.5:0/3272112626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44640043c0 0x7f4464004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 --2- 172.21.15.5:0/3272112626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4464005090 0x7f446400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f44800cba40 con 0x7f4464005090 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f446400bf40 con 0x7f44640039c0 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f446400c140 con 0x7f44640043c0 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4485c00640 1 --2- 172.21.15.5:0/3272112626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4464005090 0x7f446400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4477e00640 1 --2- 172.21.15.5:0/3272112626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44640043c0 0x7f4464004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4485200640 1 --2- 172.21.15.5:0/3272112626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44640039c0 0x7f4464003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4485c00640 1 -- 172.21.15.5:0/3272112626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44640043c0 msgr2=0x7f4464004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4485c00640 1 --2- 172.21.15.5:0/3272112626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44640043c0 0x7f4464004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4485c00640 1 -- 172.21.15.5:0/3272112626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44640039c0 msgr2=0x7f4464003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4485c00640 1 --2- 172.21.15.5:0/3272112626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44640039c0 0x7f4464003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.947+0000 7f4485c00640 1 -- 172.21.15.5:0/3272112626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4464003530 con 0x7f4464005090 2024-08-18T22:19:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f4485c00640 1 -- 172.21.15.5:0/3272112626 reap_dead start 2024-08-18T22:19:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f4485c00640 1 --2- 172.21.15.5:0/3272112626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4464005090 0x7f446400b9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4478001f60 tx=0x7f447801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e784f00bf59559 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478001b60 con 0x7f4464005090 2024-08-18T22:19:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44780a5770 con 0x7f4464005090 2024-08-18T22:19:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f447fe00640 1 -- 172.21.15.5:0/3272112626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44780a5b40 con 0x7f4464005090 2024-08-18T22:19:28.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f4487c00640 1 -- 172.21.15.5:0/3272112626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4464005090 msgr2=0x7f446400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f4487c00640 1 --2- 172.21.15.5:0/3272112626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4464005090 0x7f446400b9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4478001f60 tx=0x7f447801c880 comp rx=0 tx=0).stop 2024-08-18T22:19:28.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f4487c00640 1 -- 172.21.15.5:0/3272112626 shutdown_connections 2024-08-18T22:19:28.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f4487c00640 1 --2- 172.21.15.5:0/3272112626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4464005090 0x7f446400b9d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f4487c00640 1 -- 172.21.15.5:0/3272112626 >> 172.21.15.5:0/3272112626 conn(0x7f44800b3eb0 msgr2=0x7f44800b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:28.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f4487c00640 1 -- 172.21.15.5:0/3272112626 shutdown_connections 2024-08-18T22:19:28.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.951+0000 7f4487c00640 1 -- 172.21.15.5:0/3272112626 wait complete. 2024-08-18T22:19:28.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4487c00640 1 Processor -- start 2024-08-18T22:19:28.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4487c00640 1 -- start start 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4487c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4464005090 0x7f448015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4487c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4480146950 0x7f4480146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4487c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44801f7190 0x7f44801f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4487c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f44801481a0 con 0x7f44801f7190 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4487c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4480148020 con 0x7f4464005090 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4487c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f448006dd80 con 0x7f4480146950 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4485c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44801f7190 0x7f44801f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4485c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44801f7190 0x7f44801f7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53442/0 (socket says 172.21.15.5:53442) 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4485c00640 1 -- 172.21.15.5:0/2157673403 learned_addr learned my addr 172.21.15.5:0/2157673403 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4485200640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4464005090 0x7f448015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4477e00640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4480146950 0x7f4480146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4485c00640 1 -- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4480146950 msgr2=0x7f4480146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4485c00640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4480146950 0x7f4480146dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4485c00640 1 -- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4464005090 msgr2=0x7f448015dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4485c00640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4464005090 0x7f448015dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4485c00640 1 -- 172.21.15.5:0/2157673403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44801f4cf0 con 0x7f44801f7190 2024-08-18T22:19:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4477e00640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4480146950 0x7f4480146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4485c00640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44801f7190 0x7f44801f7610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f447801c6b0 tx=0x7f4464005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f447d600640 1 -- 172.21.15.5:0/2157673403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478003e60 con 0x7f44801f7190 2024-08-18T22:19:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f447d600640 1 -- 172.21.15.5:0/2157673403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4478001b40 con 0x7f44801f7190 2024-08-18T22:19:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f447d600640 1 -- 172.21.15.5:0/2157673403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478006d60 con 0x7f44801f7190 2024-08-18T22:19:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4487c00640 1 -- 172.21.15.5:0/2157673403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44801f4fd0 con 0x7f44801f7190 2024-08-18T22:19:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.955+0000 7f4487c00640 1 -- 172.21.15.5:0/2157673403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44801f5590 con 0x7f44801f7190 2024-08-18T22:19:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.959+0000 7f4487c00640 1 -- 172.21.15.5:0/2157673403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4480071f60 con 0x7f44801f7190 2024-08-18T22:19:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.959+0000 7f447d600640 1 -- 172.21.15.5:0/2157673403 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f44780050e0 con 0x7f44801f7190 2024-08-18T22:19:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.959+0000 7f447d600640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f445c0678f0 0x7f445c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.959+0000 7f447d600640 1 -- 172.21.15.5:0/2157673403 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f447811fc60 con 0x7f44801f7190 2024-08-18T22:19:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.959+0000 7f4485200640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f445c0678f0 0x7f445c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.959+0000 7f4485200640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f445c0678f0 0x7f445c069db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4470000c10 tx=0x7f4470009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:28.963+0000 7f447d600640 1 -- 172.21.15.5:0/2157673403 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4478016590 con 0x7f44801f7190 2024-08-18T22:19:29.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 -- 172.21.15.5:0/2157673403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f44800b4410 con 0x7f44801f7190 2024-08-18T22:19:29.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f447d600640 1 -- 172.21.15.5:0/2157673403 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f44780f03c0 con 0x7f44801f7190 2024-08-18T22:19:29.175 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T22:19:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 -- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f445c0678f0 msgr2=0x7f445c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f445c0678f0 0x7f445c069db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4470000c10 tx=0x7f4470009040 comp rx=0 tx=0).stop 2024-08-18T22:19:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 -- 172.21.15.5:0/2157673403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44801f7190 msgr2=0x7f44801f7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44801f7190 0x7f44801f7610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f447801c6b0 tx=0x7f4464005840 comp rx=0 tx=0).stop 2024-08-18T22:19:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 -- 172.21.15.5:0/2157673403 shutdown_connections 2024-08-18T22:19:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f445c0678f0 0x7f445c069db0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44801f7190 0x7f44801f7610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4480146950 0x7f4480146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:29.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 --2- 172.21.15.5:0/2157673403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4464005090 0x7f448015dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:29.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 -- 172.21.15.5:0/2157673403 >> 172.21.15.5:0/2157673403 conn(0x7f44800b3eb0 msgr2=0x7f448006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:29.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.171+0000 7f4487c00640 1 -- 172.21.15.5:0/2157673403 shutdown_connections 2024-08-18T22:19:29.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29.175+0000 7f4487c00640 1 -- 172.21.15.5:0/2157673403 wait complete. 2024-08-18T22:19:29.196 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:19:29.196 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:19:29.196 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:19:29.196 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-08-18T22:19:29.196 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:19:29.196 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:19:29.196 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T22:19:29.197 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:19:29.197 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-08-18T22:19:29.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:29.197 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:19:29.205 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:19:29.205 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:29.206 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:19:29.207 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:19:29.207 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42432sec preferred_lft 42432sec 2024-08-18T22:19:29.207 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:19:29.207 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:29.207 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:29.207 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:29.207 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:19:29.207 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:19:29.207 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:29.207 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:19:29.207 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:29.208 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-18T22:19:29.208 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:29.209 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:29.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-08-18T22:19:29.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-08-18T22:19:29.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-08-18T22:19:29.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-18T22:19:29.209 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:29.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:29.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:29.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:29.363 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:19:29.423 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:19:29.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:29.425 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:19:29.493 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:19:29.493 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:19:29.494 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:19:29.494 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:19:29.494 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:19:29.494 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:19:29.494 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:29.494 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:29.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:19:29.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:19:29.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:19:29.495 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:29.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:29.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:29.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:29.636 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:19:29.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:29.646 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-08-18T22:19:29.702 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:29.702 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:29.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:19:29.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-08-18T22:19:29.702 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:29.834 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-08-18T22:19:29.834 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:29.834 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:29.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-08-18T22:19:29.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-18T22:19:29.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-08-18T22:19:29.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-08-18T22:19:29.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-08-18T22:19:29.835 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:29.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:29.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:29.998 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:29.998 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:29.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:19:29.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-08-18T22:19:29.999 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:30.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:30.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:30.085 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-08-18T22:19:30.085 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:19:30.085 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:19:30.094 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-08-18T22:19:30.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:19:30.094 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:19:30.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-08-18T22:19:30.213 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T22:19:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-08-18T22:19:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-08-18T22:19:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-08-18T22:19:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-08-18T22:19:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-08-18T22:19:30.266 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/run/lock 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/fs/nfsd 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-08-18T22:19:30.267 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-08-18T22:19:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T22:19:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/run/rpc_pipefs 2024-08-18T22:19:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-08-18T22:19:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-08-18T22:19:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-0 2024-08-18T22:19:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-1 2024-08-18T22:19:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-2 2024-08-18T22:19:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-3 2024-08-18T22:19:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-08-18T22:19:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:19:30.268 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:19:30.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:30.269 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-08-18T22:19:30.325 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-18T22:19:30.325 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-08-18T22:19:30.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-08-18T22:19:30.392 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T22:19:30.442 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/run/lock 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-08-18T22:19:30.443 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/fs/nfsd 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/run/rpc_pipefs 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-0 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-1 2024-08-18T22:19:30.444 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-2 2024-08-18T22:19:30.445 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-3 2024-08-18T22:19:30.445 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-08-18T22:19:30.445 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:19:30.445 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:19:30.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:30.446 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-08-18T22:19:30.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:2024-08-18T22:19:30.463+0000 7f924042a580 -1 init, newargv = 0x557a03218c00 newargc=15 2024-08-18T22:19:30.470 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[33365]: starting ceph client 2024-08-18T22:19:30.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[33365]: starting fuse 2024-08-18T22:19:31.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-08-18T22:19:31.603 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T22:19:31.655 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-08-18T22:19:31.655 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-08-18T22:19:31.655 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-08-18T22:19:31.655 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-08-18T22:19:31.655 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-08-18T22:19:31.655 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/run/lock 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/fs/nfsd 2024-08-18T22:19:31.656 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/run/rpc_pipefs 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-0 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-1 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-2 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph/osd/ceph-3 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:19:31.657 INFO:teuthology.orchestra.run.smithi005.stdout:/home/ubuntu/cephtest/mnt.admin 2024-08-18T22:19:31.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:31.658 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-08-18T22:19:31.709 INFO:teuthology.orchestra.run.smithi005.stdout:44 2024-08-18T22:19:31.710 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-08-18T22:19:31.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo stdin-killer -- python3 -c ' 2024-08-18T22:19:31.710 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-08-18T22:19:31.710 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-08-18T22:19:31.710 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:19:31.710 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-08-18T22:19:31.710 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:19:31.710 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-08-18T22:19:31.710 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-08-18T22:19:31.710 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-08-18T22:19:31.711 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-18T22:19:31.712 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:19:31.712 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.admin")) 2024-08-18T22:19:31.712 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:19:31.843 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.admin.33365.asok 2024-08-18T22:19:31.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:31.855 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33365.asok 2024-08-18T22:19:31.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:31.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33365.asok status 2024-08-18T22:19:32.030 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "de09dd018de4baddfa6ca4d43bc8fb784cf75833", 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "admin", 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "33365", 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-08-18T22:19:32.031 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4419, 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4419 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 4001001690 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-18T22:19:32.032 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-08-18T22:19:32.033 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 4001001690 2024-08-18T22:19:32.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:19:32.033 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.4419 192.168.0.1:0/4001001690", 2024-08-18T22:19:32.033 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/4001001690", 2024-08-18T22:19:32.033 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-08-18T22:19:32.033 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 6, 2024-08-18T22:19:32.033 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 25, 2024-08-18T22:19:32.033 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-08-18T22:19:32.033 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-08-18T22:19:32.033 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-08-18T22:19:32.033 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:19:32.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:32.047 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-08-18T22:19:32.047 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:19:32.056 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-08-18T22:19:32.057 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:19:32.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:32.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:19:32.120 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-08-18T22:19:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:32.239 INFO:teuthology.orchestra.run.smithi005.stdout:# file: . 2024-08-18T22:19:32.239 INFO:teuthology.orchestra.run.smithi005.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-18T22:19:32.239 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:32.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:32.246 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:19:32.246 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:19:32.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:19:32.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.435+0000 7faacd200640 1 Processor -- start 2024-08-18T22:19:32.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.435+0000 7faacd200640 1 -- start start 2024-08-18T22:19:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faacd200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faac815b1c0 0x7faac80ae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faacd200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faac80d1d20 0x7faac815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faacd200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac80aec70 con 0x7faac815bae0 2024-08-18T22:19:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faacd200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7faac80aef50 con 0x7faac815b1c0 2024-08-18T22:19:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faacd200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faac80af230 con 0x7faac80d1d20 2024-08-18T22:19:32.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faac5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faac815b1c0 0x7faac80ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faac5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faac815b1c0 0x7faac80ae670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53444/0 (socket says 172.21.15.5:53444) 2024-08-18T22:19:32.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faac5e00640 1 -- 172.21.15.5:0/3258172894 learned_addr learned my addr 172.21.15.5:0/3258172894 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:32.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faac6800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faac815bae0 0x7faac80b1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38328/0 (socket says 172.21.15.5:38328) 2024-08-18T22:19:32.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faac5400640 1 --2- 172.21.15.5:0/3258172894 >> v2:172.21.15.117:3300/0 conn(0x7faac80d1d20 0x7faac815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faac5e00640 1 -- 172.21.15.5:0/3258172894 >> v2:172.21.15.117:3300/0 conn(0x7faac80d1d20 msgr2=0x7faac815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:32.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faac5e00640 1 --2- 172.21.15.5:0/3258172894 >> v2:172.21.15.117:3300/0 conn(0x7faac80d1d20 0x7faac815b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faac5e00640 1 -- 172.21.15.5:0/3258172894 >> v1:172.21.15.5:6789/0 conn(0x7faac815bae0 legacy=0x7faac80b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:32.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faac4a00640 1 -- 172.21.15.5:0/3258172894 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4126238721 0 0) 0x7faac80aec70 con 0x7faac815bae0 2024-08-18T22:19:32.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faac5e00640 1 -- 172.21.15.5:0/3258172894 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac80af510 con 0x7faac815b1c0 2024-08-18T22:19:32.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.439+0000 7faac5400640 1 --2- 172.21.15.5:0/3258172894 >> v2:172.21.15.117:3300/0 conn(0x7faac80d1d20 0x7faac815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:32.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faac5e00640 1 --2- 172.21.15.5:0/3258172894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac815b1c0 0x7faac80ae670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faac80cd910 tx=0x7faab801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0a8010f09484f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:32.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faac4a00640 1 -- 172.21.15.5:0/3258172894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80aa670 con 0x7faac815b1c0 2024-08-18T22:19:32.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faac4a00640 1 -- 172.21.15.5:0/3258172894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab80af070 con 0x7faac815b1c0 2024-08-18T22:19:32.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faac4a00640 1 -- 172.21.15.5:0/3258172894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80aaa30 con 0x7faac815b1c0 2024-08-18T22:19:32.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faacd200640 1 -- 172.21.15.5:0/3258172894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac815b1c0 msgr2=0x7faac80ae670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:32.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faacd200640 1 --2- 172.21.15.5:0/3258172894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac815b1c0 0x7faac80ae670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faac80cd910 tx=0x7faab801c4f0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faacd200640 1 -- 172.21.15.5:0/3258172894 shutdown_connections 2024-08-18T22:19:32.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faacd200640 1 --2- 172.21.15.5:0/3258172894 >> v2:172.21.15.117:3300/0 conn(0x7faac80d1d20 0x7faac815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faacd200640 1 --2- 172.21.15.5:0/3258172894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac815b1c0 0x7faac80ae670 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faacd200640 1 -- 172.21.15.5:0/3258172894 >> 172.21.15.5:0/3258172894 conn(0x7faac80b65f0 msgr2=0x7faac80b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:32.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faacd200640 1 -- 172.21.15.5:0/3258172894 shutdown_connections 2024-08-18T22:19:32.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faacd200640 1 -- 172.21.15.5:0/3258172894 wait complete. 2024-08-18T22:19:32.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faacd200640 1 Processor -- start 2024-08-18T22:19:32.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.443+0000 7faacd200640 1 -- start start 2024-08-18T22:19:32.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faacd200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faac815b1c0 0x7faac8163640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faacd200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac815bae0 0x7faac809c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faacd200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac809e5d0 0x7faac80b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faacd200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faac80b08b0 con 0x7faac815bae0 2024-08-18T22:19:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faacd200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faac80b0730 con 0x7faac809e5d0 2024-08-18T22:19:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faacd200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faac8165500 con 0x7faac815b1c0 2024-08-18T22:19:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faac5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac815bae0 0x7faac809c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faac5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac815bae0 0x7faac809c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53460/0 (socket says 172.21.15.5:53460) 2024-08-18T22:19:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faac5400640 1 -- 172.21.15.5:0/2311559763 learned_addr learned my addr 172.21.15.5:0/2311559763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faac6800640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac809e5d0 0x7faac80b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faac5e00640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faac815b1c0 0x7faac8163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faac5400640 1 -- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faac815b1c0 msgr2=0x7faac8163640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faac5400640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faac815b1c0 0x7faac8163640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faac5400640 1 -- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac809e5d0 msgr2=0x7faac80b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faac5400640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac809e5d0 0x7faac80b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faac5400640 1 -- 172.21.15.5:0/2311559763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac8163b80 con 0x7faac815bae0 2024-08-18T22:19:32.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faac5400640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac815bae0 0x7faac809c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faab400c7c0 tx=0x7faab400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:32.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faabe000640 1 -- 172.21.15.5:0/2311559763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4007a30 con 0x7faac815bae0 2024-08-18T22:19:32.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faabe000640 1 -- 172.21.15.5:0/2311559763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab4007bd0 con 0x7faac815bae0 2024-08-18T22:19:32.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faabe000640 1 -- 172.21.15.5:0/2311559763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab40113f0 con 0x7faac815bae0 2024-08-18T22:19:32.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faacd200640 1 -- 172.21.15.5:0/2311559763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac81648f0 con 0x7faac815bae0 2024-08-18T22:19:32.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faacd200640 1 -- 172.21.15.5:0/2311559763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac8164eb0 con 0x7faac815bae0 2024-08-18T22:19:32.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faacd200640 1 -- 172.21.15.5:0/2311559763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac815b5a0 con 0x7faac815bae0 2024-08-18T22:19:32.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.447+0000 7faabe000640 1 -- 172.21.15.5:0/2311559763 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faab4011590 con 0x7faac815bae0 2024-08-18T22:19:32.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.451+0000 7faabe000640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa80678f0 0x7faaa8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.451+0000 7faabe000640 1 -- 172.21.15.5:0/2311559763 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faab4086200 con 0x7faac815bae0 2024-08-18T22:19:32.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.451+0000 7faac5e00640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa80678f0 0x7faaa8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.451+0000 7faac5e00640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa80678f0 0x7faaa8069db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faab80ae000 tx=0x7faab80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:32.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.455+0000 7faabe000640 1 -- 172.21.15.5:0/2311559763 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7faab4015020 con 0x7faac815bae0 2024-08-18T22:19:32.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.631+0000 7faacd200640 1 -- 172.21.15.5:0/2311559763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faac80b2420 con 0x7faac815bae0 2024-08-18T22:19:32.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.631+0000 7faabe000640 1 -- 172.21.15.5:0/2311559763 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7faab4056960 con 0x7faac815bae0 2024-08-18T22:19:32.637 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:19:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 -- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa80678f0 msgr2=0x7faaa8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa80678f0 0x7faaa8069db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faab80ae000 tx=0x7faab80a7000 comp rx=0 tx=0).stop 2024-08-18T22:19:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 -- 172.21.15.5:0/2311559763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac815bae0 msgr2=0x7faac809c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac815bae0 0x7faac809c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faab400c7c0 tx=0x7faab400cc80 comp rx=0 tx=0).stop 2024-08-18T22:19:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 -- 172.21.15.5:0/2311559763 shutdown_connections 2024-08-18T22:19:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa80678f0 0x7faaa8069db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac809e5d0 0x7faac80b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac815bae0 0x7faac809c8f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 --2- 172.21.15.5:0/2311559763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faac815b1c0 0x7faac8163640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 -- 172.21.15.5:0/2311559763 >> 172.21.15.5:0/2311559763 conn(0x7faac80b65f0 msgr2=0x7faac806c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:32.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 -- 172.21.15.5:0/2311559763 shutdown_connections 2024-08-18T22:19:32.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.635+0000 7faacd200640 1 -- 172.21.15.5:0/2311559763 wait complete. 2024-08-18T22:19:32.658 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:19:32.658 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:19:32.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:19:32.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.843+0000 7f8325200640 1 Processor -- start 2024-08-18T22:19:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.843+0000 7f8325200640 1 -- start start 2024-08-18T22:19:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f8325200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f832015b0c0 0x7f832006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f8325200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83200b40c0 0x7f83200b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f8325200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83200b31f0 con 0x7f8320072a30 2024-08-18T22:19:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f8325200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f83200b3d70 con 0x7f832015b0c0 2024-08-18T22:19:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f8325200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f83200b4a40 con 0x7f83200b40c0 2024-08-18T22:19:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f831e800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8320072a30 0x7f8320072e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38340/0 (socket says 172.21.15.5:38340) 2024-08-18T22:19:32.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f831e800640 1 -- 172.21.15.5:0/1891926138 learned_addr learned my addr 172.21.15.5:0/1891926138 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f831de00640 1 --2- 172.21.15.5:0/1891926138 >> v2:172.21.15.117:3300/0 conn(0x7f832015b0c0 0x7f832006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f8315400640 1 --2- 172.21.15.5:0/1891926138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83200b40c0 0x7f83200b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f831d400640 1 -- 172.21.15.5:0/1891926138 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592654604 0 0) 0x7f83200b31f0 con 0x7f8320072a30 2024-08-18T22:19:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f831d400640 1 -- 172.21.15.5:0/1891926138 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8304003530 con 0x7f8320072a30 2024-08-18T22:19:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f831d400640 1 -- 172.21.15.5:0/1891926138 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1997435599 0 0) 0x7f8304003530 con 0x7f8320072a30 2024-08-18T22:19:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f831de00640 1 -- 172.21.15.5:0/1891926138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83200b40c0 msgr2=0x7f83200b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f831de00640 1 --2- 172.21.15.5:0/1891926138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83200b40c0 0x7f83200b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f831de00640 1 -- 172.21.15.5:0/1891926138 >> v1:172.21.15.5:6789/0 conn(0x7f8320072a30 legacy=0x7f8320072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:32.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.847+0000 7f831de00640 1 -- 172.21.15.5:0/1891926138 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83200b34d0 con 0x7f832015b0c0 2024-08-18T22:19:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f831de00640 1 --2- 172.21.15.5:0/1891926138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f832015b0c0 0x7f832006db80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83100097c0 tx=0x7f831001c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f0540f6a7df819 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f831d400640 1 -- 172.21.15.5:0/1891926138 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83100b0070 con 0x7f832015b0c0 2024-08-18T22:19:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f831d400640 1 -- 172.21.15.5:0/1891926138 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83100ab400 con 0x7f832015b0c0 2024-08-18T22:19:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f831d400640 1 -- 172.21.15.5:0/1891926138 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8318001a00 con 0x7f832015b0c0 2024-08-18T22:19:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 -- 172.21.15.5:0/1891926138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f832015b0c0 msgr2=0x7f832006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 --2- 172.21.15.5:0/1891926138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f832015b0c0 0x7f832006db80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83100097c0 tx=0x7f831001c270 comp rx=0 tx=0).stop 2024-08-18T22:19:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 -- 172.21.15.5:0/1891926138 shutdown_connections 2024-08-18T22:19:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 --2- 172.21.15.5:0/1891926138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83200b40c0 0x7f83200b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 --2- 172.21.15.5:0/1891926138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f832015b0c0 0x7f832006db80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 -- 172.21.15.5:0/1891926138 >> 172.21.15.5:0/1891926138 conn(0x7f83200b1dc0 msgr2=0x7f83200b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 -- 172.21.15.5:0/1891926138 shutdown_connections 2024-08-18T22:19:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 -- 172.21.15.5:0/1891926138 wait complete. 2024-08-18T22:19:32.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 Processor -- start 2024-08-18T22:19:32.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 -- start start 2024-08-18T22:19:32.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320072a30 0x7f832014df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83200b40c0 0x7f83201534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832015b0c0 0x7f832014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f832015b4a0 con 0x7f832015b0c0 2024-08-18T22:19:32.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f83200739a0 con 0x7f8320072a30 2024-08-18T22:19:32.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.851+0000 7f8325200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f832015b620 con 0x7f83200b40c0 2024-08-18T22:19:32.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f831e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832015b0c0 0x7f832014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f831e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832015b0c0 0x7f832014d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53474/0 (socket says 172.21.15.5:53474) 2024-08-18T22:19:32.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f831e800640 1 -- 172.21.15.5:0/1682462478 learned_addr learned my addr 172.21.15.5:0/1682462478 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:32.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f8315400640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83200b40c0 0x7f83201534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f831de00640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320072a30 0x7f832014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f831e800640 1 -- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83200b40c0 msgr2=0x7f83201534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:32.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f831e800640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83200b40c0 0x7f83201534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f831e800640 1 -- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320072a30 msgr2=0x7f832014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f831e800640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320072a30 0x7f832014df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f831e800640 1 -- 172.21.15.5:0/1682462478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8320153a20 con 0x7f832015b0c0 2024-08-18T22:19:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f831e800640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832015b0c0 0x7f832014d7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f83180018d0 tx=0x7f831800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f8316a00640 1 -- 172.21.15.5:0/1682462478 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8318012400 con 0x7f832015b0c0 2024-08-18T22:19:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f8316a00640 1 -- 172.21.15.5:0/1682462478 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83180125c0 con 0x7f832015b0c0 2024-08-18T22:19:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f8316a00640 1 -- 172.21.15.5:0/1682462478 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83180129b0 con 0x7f832015b0c0 2024-08-18T22:19:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f8325200640 1 -- 172.21.15.5:0/1682462478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832014dd10 con 0x7f832015b0c0 2024-08-18T22:19:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f8325200640 1 -- 172.21.15.5:0/1682462478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f832014e870 con 0x7f832015b0c0 2024-08-18T22:19:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f8325200640 1 -- 172.21.15.5:0/1682462478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f832006f670 con 0x7f832015b0c0 2024-08-18T22:19:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f8316a00640 1 -- 172.21.15.5:0/1682462478 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8318012b50 con 0x7f832015b0c0 2024-08-18T22:19:32.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.855+0000 7f8316a00640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82fc0678c0 0x7f82fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:32.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.859+0000 7f8316a00640 1 -- 172.21.15.5:0/1682462478 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8318086730 con 0x7f832015b0c0 2024-08-18T22:19:32.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.859+0000 7f831de00640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82fc0678c0 0x7f82fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:32.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.859+0000 7f831de00640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82fc0678c0 0x7f82fc069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83100ad000 tx=0x7f8310008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:32.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:32.863+0000 7f8316a00640 1 -- 172.21.15.5:0/1682462478 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8318056990 con 0x7f832015b0c0 2024-08-18T22:19:33.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.035+0000 7f8325200640 1 -- 172.21.15.5:0/1682462478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f832015a730 con 0x7f832015b0c0 2024-08-18T22:19:33.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.035+0000 7f8316a00640 1 -- 172.21.15.5:0/1682462478 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f831805be20 con 0x7f832015b0c0 2024-08-18T22:19:33.040 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:19:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 -- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82fc0678c0 msgr2=0x7f82fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82fc0678c0 0x7f82fc069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83100ad000 tx=0x7f8310008040 comp rx=0 tx=0).stop 2024-08-18T22:19:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 -- 172.21.15.5:0/1682462478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832015b0c0 msgr2=0x7f832014d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832015b0c0 0x7f832014d7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f83180018d0 tx=0x7f831800a430 comp rx=0 tx=0).stop 2024-08-18T22:19:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 -- 172.21.15.5:0/1682462478 shutdown_connections 2024-08-18T22:19:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f82fc0678c0 0x7f82fc069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f832015b0c0 0x7f832014d7d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83200b40c0 0x7f83201534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 --2- 172.21.15.5:0/1682462478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8320072a30 0x7f832014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 -- 172.21.15.5:0/1682462478 >> 172.21.15.5:0/1682462478 conn(0x7f83200b1dc0 msgr2=0x7f83200b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 -- 172.21.15.5:0/1682462478 shutdown_connections 2024-08-18T22:19:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:33.039+0000 7f8325200640 1 -- 172.21.15.5:0/1682462478 wait complete. 2024-08-18T22:19:33.062 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-08-18T22:19:33.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:33.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-08-18T22:19:33.093 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[33365]: fuse finished with error 0 and tester_r 0 2024-08-18T22:19:33.095 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:19:39.197 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:19:39.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:39.197 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-08-18T22:19:39.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:39.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.410+0000 7f93e3000640 1 Processor -- start 2024-08-18T22:19:39.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93e3000640 1 -- start start 2024-08-18T22:19:39.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93e3000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc071580 0x7f93dc06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93e3000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f93dc0cbed0 0x7f93dc0cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93e3000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93dc071c80 con 0x7f93dc0b54c0 2024-08-18T22:19:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93e3000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f93dc0cba40 con 0x7f93dc0cbed0 2024-08-18T22:19:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93e3000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93dc071f60 con 0x7f93dc071580 2024-08-18T22:19:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93d3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc071580 0x7f93dc06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93e1000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f93dc0cbed0 0x7f93dc0cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93d3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc071580 0x7f93dc06dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:60118/0 (socket says 172.21.15.5:60118) 2024-08-18T22:19:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93d3400640 1 -- 172.21.15.5:0/4010417229 learned_addr learned my addr 172.21.15.5:0/4010417229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93e1000640 1 -- 172.21.15.5:0/4010417229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc071580 msgr2=0x7f93dc06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93e1000640 1 --2- 172.21.15.5:0/4010417229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc071580 0x7f93dc06dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93db400640 1 -- 172.21.15.5:0/4010417229 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 348143820 0 0) 0x7f93dc071c80 con 0x7f93dc0b54c0 2024-08-18T22:19:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93e1000640 1 -- 172.21.15.5:0/4010417229 >> v1:172.21.15.117:6789/0 conn(0x7f93dc0b54c0 legacy=0x7f93dc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93e1000640 1 -- 172.21.15.5:0/4010417229 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93dc0cb6d0 con 0x7f93dc0cbed0 2024-08-18T22:19:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.414+0000 7f93d3400640 1 --2- 172.21.15.5:0/4010417229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc071580 0x7f93dc06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93e1000640 1 --2- 172.21.15.5:0/4010417229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93dc0cbed0 0x7f93dc0cc380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009d90 tx=0x7f93d401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d41ef8f32a60da5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93db400640 1 -- 172.21.15.5:0/4010417229 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40b4070 con 0x7f93dc0cbed0 2024-08-18T22:19:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93db400640 1 -- 172.21.15.5:0/4010417229 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d40af600 con 0x7f93dc0cbed0 2024-08-18T22:19:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93db400640 1 -- 172.21.15.5:0/4010417229 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40af9d0 con 0x7f93dc0cbed0 2024-08-18T22:19:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93e3000640 1 -- 172.21.15.5:0/4010417229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93dc0cbed0 msgr2=0x7f93dc0cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93e3000640 1 --2- 172.21.15.5:0/4010417229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93dc0cbed0 0x7f93dc0cc380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009d90 tx=0x7f93d401f150 comp rx=0 tx=0).stop 2024-08-18T22:19:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93e3000640 1 -- 172.21.15.5:0/4010417229 shutdown_connections 2024-08-18T22:19:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93e3000640 1 --2- 172.21.15.5:0/4010417229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93dc0cbed0 0x7f93dc0cc380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93e3000640 1 --2- 172.21.15.5:0/4010417229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc071580 0x7f93dc06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93e3000640 1 -- 172.21.15.5:0/4010417229 >> 172.21.15.5:0/4010417229 conn(0x7f93dc0b3eb0 msgr2=0x7f93dc0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93e3000640 1 -- 172.21.15.5:0/4010417229 shutdown_connections 2024-08-18T22:19:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93e3000640 1 -- 172.21.15.5:0/4010417229 wait complete. 2024-08-18T22:19:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.418+0000 7f93e3000640 1 Processor -- start 2024-08-18T22:19:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93e3000640 1 -- start start 2024-08-18T22:19:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93e3000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93dc071580 0x7f93dc13e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93e3000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93dc0b54c0 0x7f93dc13bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93e3000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc0cbed0 0x7f93dc13c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93e3000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1481a0 con 0x7f93dc0b54c0 2024-08-18T22:19:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93e3000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc148020 con 0x7f93dc071580 2024-08-18T22:19:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93e3000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93dc0cc8c0 con 0x7f93dc0cbed0 2024-08-18T22:19:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93dc0b54c0 0x7f93dc13bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93dc0b54c0 0x7f93dc13bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45266/0 (socket says 172.21.15.5:45266) 2024-08-18T22:19:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d3400640 1 -- 172.21.15.5:0/259797258 learned_addr learned my addr 172.21.15.5:0/259797258 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93e1000640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc0cbed0 0x7f93dc13c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93dbe00640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93dc071580 0x7f93dc13e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d3400640 1 -- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc0cbed0 msgr2=0x7f93dc13c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d3400640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc0cbed0 0x7f93dc13c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d3400640 1 -- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93dc071580 msgr2=0x7f93dc13e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d3400640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93dc071580 0x7f93dc13e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d3400640 1 -- 172.21.15.5:0/259797258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93dc13f490 con 0x7f93dc0b54c0 2024-08-18T22:19:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d3400640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93dc0b54c0 0x7f93dc13bd00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f93c400e9b0 tx=0x7f93c400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d8c00640 1 -- 172.21.15.5:0/259797258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c4017070 con 0x7f93dc0b54c0 2024-08-18T22:19:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d8c00640 1 -- 172.21.15.5:0/259797258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c400ca00 con 0x7f93dc0b54c0 2024-08-18T22:19:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93d8c00640 1 -- 172.21.15.5:0/259797258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c400cdf0 con 0x7f93dc0b54c0 2024-08-18T22:19:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93e3000640 1 -- 172.21.15.5:0/259797258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93dc13f770 con 0x7f93dc0b54c0 2024-08-18T22:19:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93e3000640 1 -- 172.21.15.5:0/259797258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93dc13fd30 con 0x7f93dc0b54c0 2024-08-18T22:19:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.422+0000 7f93e3000640 1 -- 172.21.15.5:0/259797258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93dc0cc380 con 0x7f93dc0b54c0 2024-08-18T22:19:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.426+0000 7f93d8c00640 1 -- 172.21.15.5:0/259797258 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93c401a070 con 0x7f93dc0b54c0 2024-08-18T22:19:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.426+0000 7f93d8c00640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f93b80678f0 0x7f93b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.426+0000 7f93d8c00640 1 -- 172.21.15.5:0/259797258 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f93c4086280 con 0x7f93dc0b54c0 2024-08-18T22:19:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.426+0000 7f93dbe00640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f93b80678f0 0x7f93b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.426+0000 7f93dbe00640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f93b80678f0 0x7f93b8069db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93cc000f70 tx=0x7f93cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.430+0000 7f93d8c00640 1 -- 172.21.15.5:0/259797258 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f93c4056390 con 0x7f93dc0b54c0 2024-08-18T22:19:39.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.598+0000 7f93e3000640 1 -- 172.21.15.5:0/259797258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93dc146e10 con 0x7f93dc0b54c0 2024-08-18T22:19:39.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.598+0000 7f93d8c00640 1 -- 172.21.15.5:0/259797258 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18442 (secure 0 0 0) 0x7f93c405a690 con 0x7f93dc0b54c0 2024-08-18T22:19:39.605 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:39.605 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:25.756631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 -- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f93b80678f0 msgr2=0x7f93b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f93b80678f0 0x7f93b8069db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93cc000f70 tx=0x7f93cc009040 comp rx=0 tx=0).stop 2024-08-18T22:19:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 -- 172.21.15.5:0/259797258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93dc0b54c0 msgr2=0x7f93dc13bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93dc0b54c0 0x7f93dc13bd00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f93c400e9b0 tx=0x7f93c400ee70 comp rx=0 tx=0).stop 2024-08-18T22:19:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 -- 172.21.15.5:0/259797258 shutdown_connections 2024-08-18T22:19:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f93b80678f0 0x7f93b8069db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93dc0cbed0 0x7f93dc13c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93dc0b54c0 0x7f93dc13bd00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 --2- 172.21.15.5:0/259797258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93dc071580 0x7f93dc13e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 -- 172.21.15.5:0/259797258 >> 172.21.15.5:0/259797258 conn(0x7f93dc0b3eb0 msgr2=0x7f93dc06cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 -- 172.21.15.5:0/259797258 shutdown_connections 2024-08-18T22:19:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.602+0000 7f93e3000640 1 -- 172.21.15.5:0/259797258 wait complete. 2024-08-18T22:19:39.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:39.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.762+0000 7f10d0800640 1 Processor -- start 2024-08-18T22:19:39.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.762+0000 7f10d0800640 1 -- start start 2024-08-18T22:19:39.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.762+0000 7f10d0800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f10c815b010 0x7f10c80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.762+0000 7f10d0800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10c806f290 0x7f10c8072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.762+0000 7f10d0800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c80cee20 con 0x7f10c80cd3a0 2024-08-18T22:19:39.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.762+0000 7f10d0800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f10c80cfa30 con 0x7f10c806f290 2024-08-18T22:19:39.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.762+0000 7f10d0800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f10c80cf100 con 0x7f10c815b010 2024-08-18T22:19:39.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10ce800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10c806f290 0x7f10c8072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10cd400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f10c80cd3a0 0x7f10c806eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37730/0 (socket says 172.21.15.5:37730) 2024-08-18T22:19:39.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10cd400640 1 -- 172.21.15.5:0/2335802879 learned_addr learned my addr 172.21.15.5:0/2335802879 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:39.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10cde00640 1 --2- 172.21.15.5:0/2335802879 >> v2:172.21.15.117:3300/0 conn(0x7f10c815b010 0x7f10c80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10ce800640 1 -- 172.21.15.5:0/2335802879 >> v2:172.21.15.117:3300/0 conn(0x7f10c815b010 msgr2=0x7f10c80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:39.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10ce800640 1 --2- 172.21.15.5:0/2335802879 >> v2:172.21.15.117:3300/0 conn(0x7f10c815b010 0x7f10c80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10ce800640 1 -- 172.21.15.5:0/2335802879 >> v1:172.21.15.5:6789/0 conn(0x7f10c80cd3a0 legacy=0x7f10c806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10ce800640 1 -- 172.21.15.5:0/2335802879 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c80cf3e0 con 0x7f10c806f290 2024-08-18T22:19:39.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10ce800640 1 --2- 172.21.15.5:0/2335802879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c806f290 0x7f10c8072620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10c80cfbb0 tx=0x7f10c401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee2f6b011da0f0b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:39.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10cca00640 1 -- 172.21.15.5:0/2335802879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c40b2070 con 0x7f10c806f290 2024-08-18T22:19:39.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10cca00640 1 -- 172.21.15.5:0/2335802879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c40a58f0 con 0x7f10c806f290 2024-08-18T22:19:39.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.766+0000 7f10cca00640 1 -- 172.21.15.5:0/2335802879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c40a5cc0 con 0x7f10c806f290 2024-08-18T22:19:39.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 -- 172.21.15.5:0/2335802879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c806f290 msgr2=0x7f10c8072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 --2- 172.21.15.5:0/2335802879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c806f290 0x7f10c8072620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10c80cfbb0 tx=0x7f10c401c900 comp rx=0 tx=0).stop 2024-08-18T22:19:39.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 -- 172.21.15.5:0/2335802879 shutdown_connections 2024-08-18T22:19:39.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 --2- 172.21.15.5:0/2335802879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c806f290 0x7f10c8072620 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 --2- 172.21.15.5:0/2335802879 >> v2:172.21.15.117:3300/0 conn(0x7f10c815b010 0x7f10c80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 -- 172.21.15.5:0/2335802879 >> 172.21.15.5:0/2335802879 conn(0x7f10c80b1c50 msgr2=0x7f10c80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:39.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 -- 172.21.15.5:0/2335802879 shutdown_connections 2024-08-18T22:19:39.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 -- 172.21.15.5:0/2335802879 wait complete. 2024-08-18T22:19:39.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 Processor -- start 2024-08-18T22:19:39.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 -- start start 2024-08-18T22:19:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c806f290 0x7f10c815df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c80cd3a0 0x7f10c809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c815b010 0x7f10c80b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f10c80734f0 con 0x7f10c806f290 2024-08-18T22:19:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8073370 con 0x7f10c815b010 2024-08-18T22:19:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10d0800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10c8073670 con 0x7f10c80cd3a0 2024-08-18T22:19:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10cde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c806f290 0x7f10c815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10cde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c806f290 0x7f10c815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45284/0 (socket says 172.21.15.5:45284) 2024-08-18T22:19:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10cde00640 1 -- 172.21.15.5:0/3611302899 learned_addr learned my addr 172.21.15.5:0/3611302899 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10cd400640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c80cd3a0 0x7f10c809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10cde00640 1 -- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c80cd3a0 msgr2=0x7f10c809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10ce800640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c815b010 0x7f10c80b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.770+0000 7f10cde00640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c80cd3a0 0x7f10c809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10cde00640 1 -- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c815b010 msgr2=0x7f10c80b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10cde00640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c815b010 0x7f10c80b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10cde00640 1 -- 172.21.15.5:0/3611302899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c809b500 con 0x7f10c806f290 2024-08-18T22:19:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10cd400640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c80cd3a0 0x7f10c809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10ce800640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c815b010 0x7f10c80b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10cde00640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c806f290 0x7f10c815df90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00e870 tx=0x7f10bc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10c2000640 1 -- 172.21.15.5:0/3611302899 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc017070 con 0x7f10c806f290 2024-08-18T22:19:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10c2000640 1 -- 172.21.15.5:0/3611302899 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10bc00c940 con 0x7f10c806f290 2024-08-18T22:19:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10c2000640 1 -- 172.21.15.5:0/3611302899 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00ccf0 con 0x7f10c806f290 2024-08-18T22:19:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10d0800640 1 -- 172.21.15.5:0/3611302899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c809b7e0 con 0x7f10c806f290 2024-08-18T22:19:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10d0800640 1 -- 172.21.15.5:0/3611302899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c809bda0 con 0x7f10c806f290 2024-08-18T22:19:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10d0800640 1 -- 172.21.15.5:0/3611302899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c8072620 con 0x7f10c806f290 2024-08-18T22:19:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10c2000640 1 -- 172.21.15.5:0/3611302899 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10bc01a070 con 0x7f10c806f290 2024-08-18T22:19:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.774+0000 7f10c2000640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10ac0678c0 0x7f10ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.778+0000 7f10c2000640 1 -- 172.21.15.5:0/3611302899 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f10bc0862e0 con 0x7f10c806f290 2024-08-18T22:19:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.778+0000 7f10cd400640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10ac0678c0 0x7f10ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.778+0000 7f10cd400640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10ac0678c0 0x7f10ac069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f10b8007fd0 tx=0x7f10b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.782+0000 7f10c2000640 1 -- 172.21.15.5:0/3611302899 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f10bc056a40 con 0x7f10c806f290 2024-08-18T22:19:39.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 -- 172.21.15.5:0/3611302899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10c80cc320 con 0x7f10c806f290 2024-08-18T22:19:39.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10c2000640 1 -- 172.21.15.5:0/3611302899 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18442 (secure 0 0 0) 0x7f10bc056340 con 0x7f10c806f290 2024-08-18T22:19:39.955 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:39.955 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:25.756631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 -- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10ac0678c0 msgr2=0x7f10ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10ac0678c0 0x7f10ac069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f10b8007fd0 tx=0x7f10b8009040 comp rx=0 tx=0).stop 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 -- 172.21.15.5:0/3611302899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c806f290 msgr2=0x7f10c815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c806f290 0x7f10c815df90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00e870 tx=0x7f10bc00ec70 comp rx=0 tx=0).stop 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 -- 172.21.15.5:0/3611302899 shutdown_connections 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10ac0678c0 0x7f10ac069d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c815b010 0x7f10c80b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c80cd3a0 0x7f10c809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 --2- 172.21.15.5:0/3611302899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c806f290 0x7f10c815df90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 -- 172.21.15.5:0/3611302899 >> 172.21.15.5:0/3611302899 conn(0x7f10c80b1c50 msgr2=0x7f10c80cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 -- 172.21.15.5:0/3611302899 shutdown_connections 2024-08-18T22:19:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:39.950+0000 7f10d0800640 1 -- 172.21.15.5:0/3611302899 wait complete. 2024-08-18T22:19:39.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:19:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.114+0000 7faf85000640 1 Processor -- start 2024-08-18T22:19:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.114+0000 7faf85000640 1 -- start start 2024-08-18T22:19:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf85000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf8015e380 0x7faf800d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf85000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf800d12a0 0x7faf800d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf85000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf800d2110 con 0x7faf800b32b0 2024-08-18T22:19:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf85000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7faf8015e760 con 0x7faf800d12a0 2024-08-18T22:19:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf85000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf800d23f0 con 0x7faf8015e380 2024-08-18T22:19:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf7ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf800d12a0 0x7faf800d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf7fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faf800b32b0 0x7faf800ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37732/0 (socket says 172.21.15.5:37732) 2024-08-18T22:19:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf7ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf800d12a0 0x7faf800d2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45300/0 (socket says 172.21.15.5:45300) 2024-08-18T22:19:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf7fe00640 1 -- 172.21.15.5:0/2736178248 learned_addr learned my addr 172.21.15.5:0/2736178248 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf7f400640 1 --2- 172.21.15.5:0/2736178248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf8015e380 0x7faf800d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf7ea00640 1 -- 172.21.15.5:0/2736178248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf8015e380 msgr2=0x7faf800d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf7ea00640 1 --2- 172.21.15.5:0/2736178248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf8015e380 0x7faf800d27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf7ea00640 1 -- 172.21.15.5:0/2736178248 >> v1:172.21.15.5:6789/0 conn(0x7faf800b32b0 legacy=0x7faf800ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf7ea00640 1 -- 172.21.15.5:0/2736178248 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf800d4920 con 0x7faf800d12a0 2024-08-18T22:19:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.118+0000 7faf7e000640 1 -- 172.21.15.5:0/2736178248 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999303261 0 0) 0x7faf800d2110 con 0x7faf800b32b0 2024-08-18T22:19:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf7ea00640 1 --2- 172.21.15.5:0/2736178248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf800d12a0 0x7faf800d2d30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0097c0 tx=0x7faf6c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152ff835abe1b8ff server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:40.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf7e000640 1 -- 172.21.15.5:0/2736178248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0a7070 con 0x7faf800d12a0 2024-08-18T22:19:40.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf7e000640 1 -- 172.21.15.5:0/2736178248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6c0b0070 con 0x7faf800d12a0 2024-08-18T22:19:40.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf7e000640 1 -- 172.21.15.5:0/2736178248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0ab890 con 0x7faf800d12a0 2024-08-18T22:19:40.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 -- 172.21.15.5:0/2736178248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf800d12a0 msgr2=0x7faf800d2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:40.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 --2- 172.21.15.5:0/2736178248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf800d12a0 0x7faf800d2d30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0097c0 tx=0x7faf6c01c470 comp rx=0 tx=0).stop 2024-08-18T22:19:40.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 -- 172.21.15.5:0/2736178248 shutdown_connections 2024-08-18T22:19:40.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 --2- 172.21.15.5:0/2736178248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf800d12a0 0x7faf800d2d30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 --2- 172.21.15.5:0/2736178248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf8015e380 0x7faf800d27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 -- 172.21.15.5:0/2736178248 >> 172.21.15.5:0/2736178248 conn(0x7faf8009d4e0 msgr2=0x7faf800d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 -- 172.21.15.5:0/2736178248 shutdown_connections 2024-08-18T22:19:40.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 -- 172.21.15.5:0/2736178248 wait complete. 2024-08-18T22:19:40.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 Processor -- start 2024-08-18T22:19:40.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 -- start start 2024-08-18T22:19:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf800b32b0 0x7faf80154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.122+0000 7faf85000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf800d12a0 0x7faf800b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf85000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf8015e380 0x7faf800cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf85000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faf8016afb0 con 0x7faf800b32b0 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf85000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faf8016ae30 con 0x7faf8015e380 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf85000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf8016b130 con 0x7faf800d12a0 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf7f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf800b32b0 0x7faf80154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf7f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf800b32b0 0x7faf80154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45306/0 (socket says 172.21.15.5:45306) 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf7f400640 1 -- 172.21.15.5:0/1327658053 learned_addr learned my addr 172.21.15.5:0/1327658053 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf7f400640 1 -- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf800d12a0 msgr2=0x7faf800b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf7f400640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf800d12a0 0x7faf800b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf7f400640 1 -- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf8015e380 msgr2=0x7faf800cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf7f400640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf8015e380 0x7faf800cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf7f400640 1 -- 172.21.15.5:0/1327658053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf800b49a0 con 0x7faf800b32b0 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf7f400640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf800b32b0 0x7faf80154760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf7000e870 tx=0x7faf7000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf77400640 1 -- 172.21.15.5:0/1327658053 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf70017070 con 0x7faf800b32b0 2024-08-18T22:19:40.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf77400640 1 -- 172.21.15.5:0/1327658053 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7000c8e0 con 0x7faf800b32b0 2024-08-18T22:19:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf77400640 1 -- 172.21.15.5:0/1327658053 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7000cc90 con 0x7faf800b32b0 2024-08-18T22:19:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf85000640 1 -- 172.21.15.5:0/1327658053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf800b4c20 con 0x7faf800b32b0 2024-08-18T22:19:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf85000640 1 -- 172.21.15.5:0/1327658053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf800b51e0 con 0x7faf800b32b0 2024-08-18T22:19:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf85000640 1 -- 172.21.15.5:0/1327658053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf800ced20 con 0x7faf800b32b0 2024-08-18T22:19:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf77400640 1 -- 172.21.15.5:0/1327658053 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf7001a070 con 0x7faf800b32b0 2024-08-18T22:19:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.126+0000 7faf77400640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf600678c0 0x7faf60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.130+0000 7faf77400640 1 -- 172.21.15.5:0/1327658053 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faf70085fb0 con 0x7faf800b32b0 2024-08-18T22:19:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.130+0000 7faf7ea00640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf600678c0 0x7faf60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:40.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.130+0000 7faf7ea00640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf600678c0 0x7faf60069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0af000 tx=0x7faf6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:40.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.134+0000 7faf77400640 1 -- 172.21.15.5:0/1327658053 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7faf800b49a0 con 0x7faf800b32b0 2024-08-18T22:19:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.338+0000 7faf85000640 1 -- 172.21.15.5:0/1327658053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7faf800cde20 con 0x7faf800b32b0 2024-08-18T22:19:40.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.370+0000 7faf77400640 1 -- 172.21.15.5:0/1327658053 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7faf70056680 con 0x7faf800b32b0 2024-08-18T22:19:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 -- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf600678c0 msgr2=0x7faf60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf600678c0 0x7faf60069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0af000 tx=0x7faf6c008040 comp rx=0 tx=0).stop 2024-08-18T22:19:40.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 -- 172.21.15.5:0/1327658053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf800b32b0 msgr2=0x7faf80154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf800b32b0 0x7faf80154760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf7000e870 tx=0x7faf7000ec70 comp rx=0 tx=0).stop 2024-08-18T22:19:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 -- 172.21.15.5:0/1327658053 shutdown_connections 2024-08-18T22:19:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf600678c0 0x7faf60069d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf8015e380 0x7faf800cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf800d12a0 0x7faf800b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 --2- 172.21.15.5:0/1327658053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf800b32b0 0x7faf80154760 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 -- 172.21.15.5:0/1327658053 >> 172.21.15.5:0/1327658053 conn(0x7faf8009d4e0 msgr2=0x7faf8015fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 -- 172.21.15.5:0/1327658053 shutdown_connections 2024-08-18T22:19:40.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.374+0000 7faf85000640 1 -- 172.21.15.5:0/1327658053 wait complete. 2024-08-18T22:19:40.398 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-08-18T22:19:40.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:19:40.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.534+0000 7fdfd6600640 1 Processor -- start 2024-08-18T22:19:40.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd6600640 1 -- start start 2024-08-18T22:19:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd6600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd015d120 0x7fdfd00b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd6600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdfd00b4650 0x7fdfd00d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd6600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfd015d5b0 con 0x7fdfd0156770 2024-08-18T22:19:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd6600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdfd0156b50 con 0x7fdfd00b4650 2024-08-18T22:19:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd6600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd00b4a90 con 0x7fdfd015d120 2024-08-18T22:19:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd5200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdfd0156770 0x7fdfd00b6020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37736/0 (socket says 172.21.15.5:37736) 2024-08-18T22:19:40.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd5200640 1 -- 172.21.15.5:0/3413683130 learned_addr learned my addr 172.21.15.5:0/3413683130 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd5c00640 1 --2- 172.21.15.5:0/3413683130 >> v2:172.21.15.5:3300/0 conn(0x7fdfd00b4650 0x7fdfd00d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfc7e00640 1 --2- 172.21.15.5:0/3413683130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd015d120 0x7fdfd00b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfcfe00640 1 -- 172.21.15.5:0/3413683130 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811956159 0 0) 0x7fdfd015d5b0 con 0x7fdfd0156770 2024-08-18T22:19:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfcfe00640 1 -- 172.21.15.5:0/3413683130 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfb4003530 con 0x7fdfd0156770 2024-08-18T22:19:40.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd5c00640 1 -- 172.21.15.5:0/3413683130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd015d120 msgr2=0x7fdfd00b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd5c00640 1 --2- 172.21.15.5:0/3413683130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd015d120 0x7fdfd00b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd5c00640 1 -- 172.21.15.5:0/3413683130 >> v1:172.21.15.5:6789/0 conn(0x7fdfd0156770 legacy=0x7fdfd00b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.538+0000 7fdfd5c00640 1 -- 172.21.15.5:0/3413683130 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd00b67e0 con 0x7fdfd00b4650 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfd5c00640 1 --2- 172.21.15.5:0/3413683130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd00b4650 0x7fdfd00d01b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009d90 tx=0x7fdfc801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8618fda10d0508a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfcfe00640 1 -- 172.21.15.5:0/3413683130 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80b2070 con 0x7fdfd00b4650 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfcfe00640 1 -- 172.21.15.5:0/3413683130 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc80a5970 con 0x7fdfd00b4650 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfcfe00640 1 -- 172.21.15.5:0/3413683130 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80a5d20 con 0x7fdfd00b4650 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfd6600640 1 -- 172.21.15.5:0/3413683130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd00b4650 msgr2=0x7fdfd00d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfd6600640 1 --2- 172.21.15.5:0/3413683130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd00b4650 0x7fdfd00d01b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009d90 tx=0x7fdfc801c8b0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfd6600640 1 -- 172.21.15.5:0/3413683130 shutdown_connections 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfd6600640 1 --2- 172.21.15.5:0/3413683130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd00b4650 0x7fdfd00d01b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfd6600640 1 --2- 172.21.15.5:0/3413683130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd015d120 0x7fdfd00b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfd6600640 1 -- 172.21.15.5:0/3413683130 >> 172.21.15.5:0/3413683130 conn(0x7fdfd0067a70 msgr2=0x7fdfd0067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:40.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfd6600640 1 -- 172.21.15.5:0/3413683130 shutdown_connections 2024-08-18T22:19:40.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfd6600640 1 -- 172.21.15.5:0/3413683130 wait complete. 2024-08-18T22:19:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfd6600640 1 Processor -- start 2024-08-18T22:19:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.542+0000 7fdfd6600640 1 -- start start 2024-08-18T22:19:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd6600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd00b4650 0x7fdfd01f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd6600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd0156770 0x7fdfd01f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd6600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd015d120 0x7fdfd0150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd6600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd00d0f00 con 0x7fdfd0156770 2024-08-18T22:19:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd6600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd00b7360 con 0x7fdfd015d120 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd6600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd00d1080 con 0x7fdfd00b4650 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfc7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd0156770 0x7fdfd01f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfc7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd0156770 0x7fdfd01f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45332/0 (socket says 172.21.15.5:45332) 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfc7e00640 1 -- 172.21.15.5:0/2251815992 learned_addr learned my addr 172.21.15.5:0/2251815992 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd5200640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd00b4650 0x7fdfd01f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd5c00640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd015d120 0x7fdfd0150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfc7e00640 1 -- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd00b4650 msgr2=0x7fdfd01f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfc7e00640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd00b4650 0x7fdfd01f6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfc7e00640 1 -- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd015d120 msgr2=0x7fdfd0150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfc7e00640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd015d120 0x7fdfd0150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfc7e00640 1 -- 172.21.15.5:0/2251815992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd01549f0 con 0x7fdfd0156770 2024-08-18T22:19:40.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd5c00640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd015d120 0x7fdfd0150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfc7e00640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd0156770 0x7fdfd01f7420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800e870 tx=0x7fdfb800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfcd600640 1 -- 172.21.15.5:0/2251815992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8017070 con 0x7fdfd0156770 2024-08-18T22:19:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfcd600640 1 -- 172.21.15.5:0/2251815992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb800c940 con 0x7fdfd0156770 2024-08-18T22:19:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfcd600640 1 -- 172.21.15.5:0/2251815992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800ccf0 con 0x7fdfd0156770 2024-08-18T22:19:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd6600640 1 -- 172.21.15.5:0/2251815992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd0154cd0 con 0x7fdfd0156770 2024-08-18T22:19:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd6600640 1 -- 172.21.15.5:0/2251815992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd0155290 con 0x7fdfd0156770 2024-08-18T22:19:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.546+0000 7fdfd6600640 1 -- 172.21.15.5:0/2251815992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd0068680 con 0x7fdfd0156770 2024-08-18T22:19:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.550+0000 7fdfcd600640 1 -- 172.21.15.5:0/2251815992 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdfb801a070 con 0x7fdfd0156770 2024-08-18T22:19:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.550+0000 7fdfcd600640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdfac0678c0 0x7fdfac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.550+0000 7fdfcd600640 1 -- 172.21.15.5:0/2251815992 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdfb8085eb0 con 0x7fdfd0156770 2024-08-18T22:19:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.550+0000 7fdfd5200640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdfac0678c0 0x7fdfac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.550+0000 7fdfd5200640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdfac0678c0 0x7fdfac069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0007fd0 tx=0x7fdfc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.554+0000 7fdfcd600640 1 -- 172.21.15.5:0/2251815992 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdfb8055fc0 con 0x7fdfd0156770 2024-08-18T22:19:40.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:40.754+0000 7fdfd6600640 1 -- 172.21.15.5:0/2251815992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fdfd00d1460 con 0x7fdfd0156770 2024-08-18T22:19:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfcd600640 1 -- 172.21.15.5:0/2251815992 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fdfb805a2c0 con 0x7fdfd0156770 2024-08-18T22:19:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 -- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdfac0678c0 msgr2=0x7fdfac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdfac0678c0 0x7fdfac069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0007fd0 tx=0x7fdfc0009040 comp rx=0 tx=0).stop 2024-08-18T22:19:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 -- 172.21.15.5:0/2251815992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd0156770 msgr2=0x7fdfd01f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd0156770 0x7fdfd01f7420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800e870 tx=0x7fdfb800ec70 comp rx=0 tx=0).stop 2024-08-18T22:19:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 -- 172.21.15.5:0/2251815992 shutdown_connections 2024-08-18T22:19:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdfac0678c0 0x7fdfac069d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd015d120 0x7fdfd0150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfd0156770 0x7fdfd01f7420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 --2- 172.21.15.5:0/2251815992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd00b4650 0x7fdfd01f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 -- 172.21.15.5:0/2251815992 >> 172.21.15.5:0/2251815992 conn(0x7fdfd0067a70 msgr2=0x7fdfd0166410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 -- 172.21.15.5:0/2251815992 shutdown_connections 2024-08-18T22:19:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.374+0000 7fdfd6600640 1 -- 172.21.15.5:0/2251815992 wait complete. 2024-08-18T22:19:41.403 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:19:41.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:19:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f09a00640 1 Processor -- start 2024-08-18T22:19:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f09a00640 1 -- start start 2024-08-18T22:19:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f09a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f0415c180 0x7f5f040b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f09a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f0406fad0 0x7f5f0415c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f09a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f04071580 0x7f5f04071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f09a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5f0415caa0 con 0x7f5f04071580 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f09a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5f040b5e30 con 0x7f5f0406fad0 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f09a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5f040b6110 con 0x7f5f0415c180 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f03400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f04071580 0x7f5f04071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f03400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f04071580 0x7f5f04071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45342/0 (socket says 172.21.15.5:45342) 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f03400640 1 -- 172.21.15.5:0/1826828295 learned_addr learned my addr 172.21.15.5:0/1826828295 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f02000640 1 --2- 172.21.15.5:0/1826828295 >> v2:172.21.15.117:3300/0 conn(0x7f5f0406fad0 0x7f5f0415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f02a00640 1 --2- 172.21.15.5:0/1826828295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f0415c180 0x7f5f040b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f03400640 1 -- 172.21.15.5:0/1826828295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f0415c180 msgr2=0x7f5f040b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f03400640 1 --2- 172.21.15.5:0/1826828295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f0415c180 0x7f5f040b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f03400640 1 -- 172.21.15.5:0/1826828295 >> v2:172.21.15.117:3300/0 conn(0x7f5f0406fad0 msgr2=0x7f5f0415c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f03400640 1 --2- 172.21.15.5:0/1826828295 >> v2:172.21.15.117:3300/0 conn(0x7f5f0406fad0 0x7f5f0415c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f03400640 1 -- 172.21.15.5:0/1826828295 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f040b63f0 con 0x7f5f04071580 2024-08-18T22:19:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.542+0000 7f5f02000640 1 --2- 172.21.15.5:0/1826828295 >> v2:172.21.15.117:3300/0 conn(0x7f5f0406fad0 0x7f5f0415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f03400640 1 --2- 172.21.15.5:0/1826828295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f04071580 0x7f5f04071a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5f040711d0 tx=0x7f5efc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcd3eba6470614a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f01600640 1 -- 172.21.15.5:0/1826828295 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc0b0070 con 0x7f5f04071580 2024-08-18T22:19:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f01600640 1 -- 172.21.15.5:0/1826828295 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc0ab600 con 0x7f5f04071580 2024-08-18T22:19:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f01600640 1 -- 172.21.15.5:0/1826828295 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc0ab9d0 con 0x7f5f04071580 2024-08-18T22:19:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f09a00640 1 -- 172.21.15.5:0/1826828295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f04071580 msgr2=0x7f5f04071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f09a00640 1 --2- 172.21.15.5:0/1826828295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f04071580 0x7f5f04071a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5f040711d0 tx=0x7f5efc01c400 comp rx=0 tx=0).stop 2024-08-18T22:19:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f09a00640 1 -- 172.21.15.5:0/1826828295 shutdown_connections 2024-08-18T22:19:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f09a00640 1 --2- 172.21.15.5:0/1826828295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f04071580 0x7f5f04071a30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f09a00640 1 --2- 172.21.15.5:0/1826828295 >> v2:172.21.15.117:3300/0 conn(0x7f5f0406fad0 0x7f5f0415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f09a00640 1 --2- 172.21.15.5:0/1826828295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f0415c180 0x7f5f040b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f09a00640 1 -- 172.21.15.5:0/1826828295 >> 172.21.15.5:0/1826828295 conn(0x7f5f040b3eb0 msgr2=0x7f5f040b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f09a00640 1 -- 172.21.15.5:0/1826828295 shutdown_connections 2024-08-18T22:19:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.546+0000 7f5f09a00640 1 -- 172.21.15.5:0/1826828295 wait complete. 2024-08-18T22:19:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f09a00640 1 Processor -- start 2024-08-18T22:19:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f09a00640 1 -- start start 2024-08-18T22:19:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f09a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0406fad0 0x7f5f04166a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f09a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f04071580 0x7f5f04156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f09a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f0415c180 0x7f5f04150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f09a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5f040d1c30 con 0x7f5f0406fad0 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f09a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5f040d1ab0 con 0x7f5f04071580 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f09a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5f040d1db0 con 0x7f5f0415c180 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f02a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0406fad0 0x7f5f04166a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f02a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0406fad0 0x7f5f04166a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45358/0 (socket says 172.21.15.5:45358) 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f02a00640 1 -- 172.21.15.5:0/4090626241 learned_addr learned my addr 172.21.15.5:0/4090626241 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f03400640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f0415c180 0x7f5f04150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f02000640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f04071580 0x7f5f04156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f02a00640 1 -- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f0415c180 msgr2=0x7f5f04150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f02a00640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f0415c180 0x7f5f04150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f02a00640 1 -- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f04071580 msgr2=0x7f5f04156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f02a00640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f04071580 0x7f5f04156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f02a00640 1 -- 172.21.15.5:0/4090626241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0415e280 con 0x7f5f0406fad0 2024-08-18T22:19:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f03400640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f0415c180 0x7f5f04150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f02000640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f04071580 0x7f5f04156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f02a00640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0406fad0 0x7f5f04166a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4007e40 tx=0x7f5ef400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5efaa00640 1 -- 172.21.15.5:0/4090626241 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4014620 con 0x7f5f0406fad0 2024-08-18T22:19:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5efaa00640 1 -- 172.21.15.5:0/4090626241 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef4019070 con 0x7f5f0406fad0 2024-08-18T22:19:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5efaa00640 1 -- 172.21.15.5:0/4090626241 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4014a00 con 0x7f5f0406fad0 2024-08-18T22:19:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f09a00640 1 -- 172.21.15.5:0/4090626241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f04156180 con 0x7f5f0406fad0 2024-08-18T22:19:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.550+0000 7f5f09a00640 1 -- 172.21.15.5:0/4090626241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f04156740 con 0x7f5f0406fad0 2024-08-18T22:19:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.554+0000 7f5f09a00640 1 -- 172.21.15.5:0/4090626241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f04071a30 con 0x7f5f0406fad0 2024-08-18T22:19:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.554+0000 7f5efaa00640 1 -- 172.21.15.5:0/4090626241 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ef4014ba0 con 0x7f5f0406fad0 2024-08-18T22:19:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.554+0000 7f5efaa00640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ee40678c0 0x7f5ee4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.554+0000 7f5efaa00640 1 -- 172.21.15.5:0/4090626241 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5ef4086830 con 0x7f5f0406fad0 2024-08-18T22:19:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.554+0000 7f5f02000640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ee40678c0 0x7f5ee4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.554+0000 7f5f02000640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ee40678c0 0x7f5ee4069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f041585c0 tx=0x7f5ef0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.558+0000 7f5efaa00640 1 -- 172.21.15.5:0/4090626241 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5ef4057020 con 0x7f5f0406fad0 2024-08-18T22:19:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.758+0000 7f5f09a00640 1 -- 172.21.15.5:0/4090626241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f040cf7d0 con 0x7f5f0406fad0 2024-08-18T22:19:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.758+0000 7f5efaa00640 1 -- 172.21.15.5:0/4090626241 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7f5ef4056920 con 0x7f5f0406fad0 2024-08-18T22:19:41.764 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:41.764 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"btime":"2024-08-18T22:19:41:376873+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4007066150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4007066150},{"type":"v1","addr":"172.21.15.117:6836","nonce":4007066150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1179279001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1179279001},{"type":"v1","addr":"172.21.15.117:6837","nonce":1179279001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:19:20.503823+0000","modified":"2024-08-18T22:19:40.761749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3727670717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3727670717},{"type":"v1","addr":"172.21.15.5:6835","nonce":3727670717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-08-18T22:19:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 -- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ee40678c0 msgr2=0x7f5ee4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ee40678c0 0x7f5ee4069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f041585c0 tx=0x7f5ef0008040 comp rx=0 tx=0).stop 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 -- 172.21.15.5:0/4090626241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0406fad0 msgr2=0x7f5f04166a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0406fad0 0x7f5f04166a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4007e40 tx=0x7f5ef400e4b0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 -- 172.21.15.5:0/4090626241 shutdown_connections 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ee40678c0 0x7f5ee4069d80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f0415c180 0x7f5f04150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f04071580 0x7f5f04156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 --2- 172.21.15.5:0/4090626241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f0406fad0 0x7f5f04166a00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 -- 172.21.15.5:0/4090626241 >> 172.21.15.5:0/4090626241 conn(0x7f5f040b3eb0 msgr2=0x7f5f040b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 -- 172.21.15.5:0/4090626241 shutdown_connections 2024-08-18T22:19:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.762+0000 7f5f09a00640 1 -- 172.21.15.5:0/4090626241 wait complete. 2024-08-18T22:19:41.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.918+0000 7f1ef5200640 1 Processor -- start 2024-08-18T22:19:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1ef5200640 1 -- start start 2024-08-18T22:19:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1ef5200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef0070730 0x7f1ef0070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1ef5200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ef015dda0 0x7f1ef015e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1ef5200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef0070430 con 0x7f1ef0161960 2024-08-18T22:19:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1ef5200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef015fcc0 con 0x7f1ef015dda0 2024-08-18T22:19:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1ef5200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef00710b0 con 0x7f1ef0070730 2024-08-18T22:19:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1eee800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ef015dda0 0x7f1ef015e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1eee800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ef015dda0 0x7f1ef015e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45368/0 (socket says 172.21.15.5:45368) 2024-08-18T22:19:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1eee800640 1 -- 172.21.15.5:0/3654113857 learned_addr learned my addr 172.21.15.5:0/3654113857 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1eed400640 1 --2- 172.21.15.5:0/3654113857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef0070730 0x7f1ef0070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1eee800640 1 -- 172.21.15.5:0/3654113857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef0070730 msgr2=0x7f1ef0070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1eee800640 1 --2- 172.21.15.5:0/3654113857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef0070730 0x7f1ef0070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1eee800640 1 -- 172.21.15.5:0/3654113857 >> v1:172.21.15.117:6789/0 conn(0x7f1ef0161960 legacy=0x7f1ef006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.922+0000 7f1eee800640 1 -- 172.21.15.5:0/3654113857 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef015eb60 con 0x7f1ef015dda0 2024-08-18T22:19:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1eee800640 1 --2- 172.21.15.5:0/3654113857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef015dda0 0x7f1ef015e250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009e50 tx=0x7f1ee801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1fc1ca8b5c48a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1eeca00640 1 -- 172.21.15.5:0/3654113857 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80a57f0 con 0x7f1ef015dda0 2024-08-18T22:19:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1eeca00640 1 -- 172.21.15.5:0/3654113857 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee80a5990 con 0x7f1ef015dda0 2024-08-18T22:19:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1eeca00640 1 -- 172.21.15.5:0/3654113857 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80a5d60 con 0x7f1ef015dda0 2024-08-18T22:19:41.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1ef5200640 1 -- 172.21.15.5:0/3654113857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef015dda0 msgr2=0x7f1ef015e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:41.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1ef5200640 1 --2- 172.21.15.5:0/3654113857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef015dda0 0x7f1ef015e250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009e50 tx=0x7f1ee801ca30 comp rx=0 tx=0).stop 2024-08-18T22:19:41.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1ef5200640 1 -- 172.21.15.5:0/3654113857 shutdown_connections 2024-08-18T22:19:41.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1ef5200640 1 --2- 172.21.15.5:0/3654113857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef015dda0 0x7f1ef015e250 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1ef5200640 1 --2- 172.21.15.5:0/3654113857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef0070730 0x7f1ef0070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1ef5200640 1 -- 172.21.15.5:0/3654113857 >> 172.21.15.5:0/3654113857 conn(0x7f1ef00d2130 msgr2=0x7f1ef00d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:41.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1ef5200640 1 -- 172.21.15.5:0/3654113857 shutdown_connections 2024-08-18T22:19:41.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1ef5200640 1 -- 172.21.15.5:0/3654113857 wait complete. 2024-08-18T22:19:41.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1ef5200640 1 Processor -- start 2024-08-18T22:19:41.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.926+0000 7f1ef5200640 1 -- start start 2024-08-18T22:19:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ef5200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef0070730 0x7f1ef015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ef5200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef015dda0 0x7f1ef00c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ef5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef0161960 0x7f1ef00b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ef5200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef009ba30 con 0x7f1ef0161960 2024-08-18T22:19:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ef5200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef015f6e0 con 0x7f1ef015dda0 2024-08-18T22:19:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ef5200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef00b5740 con 0x7f1ef0070730 2024-08-18T22:19:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1eee800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef0161960 0x7f1ef00b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1eee800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef0161960 0x7f1ef00b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45384/0 (socket says 172.21.15.5:45384) 2024-08-18T22:19:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1eee800640 1 -- 172.21.15.5:0/2027572526 learned_addr learned my addr 172.21.15.5:0/2027572526 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1eede00640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef0070730 0x7f1ef015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1eed400640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef015dda0 0x7f1ef00c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1eee800640 1 -- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef0070730 msgr2=0x7f1ef015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1eee800640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef0070730 0x7f1ef015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1eee800640 1 -- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef015dda0 msgr2=0x7f1ef00c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1eee800640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef015dda0 0x7f1ef00c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1eee800640 1 -- 172.21.15.5:0/2027572526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef00b5460 con 0x7f1ef0161960 2024-08-18T22:19:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1eee800640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef0161960 0x7f1ef00b5970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80af040 tx=0x7f1ee80197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ee6000640 1 -- 172.21.15.5:0/2027572526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80bc020 con 0x7f1ef0161960 2024-08-18T22:19:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ee6000640 1 -- 172.21.15.5:0/2027572526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee80b8670 con 0x7f1ef0161960 2024-08-18T22:19:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ee6000640 1 -- 172.21.15.5:0/2027572526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8009510 con 0x7f1ef0161960 2024-08-18T22:19:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ef5200640 1 -- 172.21.15.5:0/2027572526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef00c6da0 con 0x7f1ef0161960 2024-08-18T22:19:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ef5200640 1 -- 172.21.15.5:0/2027572526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef00c7360 con 0x7f1ef0161960 2024-08-18T22:19:41.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ef5200640 1 -- 172.21.15.5:0/2027572526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef0070b70 con 0x7f1ef0161960 2024-08-18T22:19:41.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.930+0000 7f1ee6000640 1 -- 172.21.15.5:0/2027572526 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ee80bf020 con 0x7f1ef0161960 2024-08-18T22:19:41.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.934+0000 7f1ee6000640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ed00678f0 0x7f1ed0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:41.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.934+0000 7f1ee6000640 1 -- 172.21.15.5:0/2027572526 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1ee81209d0 con 0x7f1ef0161960 2024-08-18T22:19:41.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.934+0000 7f1eede00640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ed00678f0 0x7f1ed0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.934+0000 7f1eede00640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ed00678f0 0x7f1ed0069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0007fd0 tx=0x7f1ee0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:41.938+0000 7f1ee6000640 1 -- 172.21.15.5:0/2027572526 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1ee8016620 con 0x7f1ef0161960 2024-08-18T22:19:42.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.102+0000 7f1ef5200640 1 -- 172.21.15.5:0/2027572526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ef009bbb0 con 0x7f1ef0161960 2024-08-18T22:19:42.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.102+0000 7f1ee6000640 1 -- 172.21.15.5:0/2027572526 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18442 (secure 0 0 0) 0x7f1ee80f0b70 con 0x7f1ef0161960 2024-08-18T22:19:42.107 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:42.108 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:25.756631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 -- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ed00678f0 msgr2=0x7f1ed0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ed00678f0 0x7f1ed0069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0007fd0 tx=0x7f1ee0009040 comp rx=0 tx=0).stop 2024-08-18T22:19:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 -- 172.21.15.5:0/2027572526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef0161960 msgr2=0x7f1ef00b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef0161960 0x7f1ef00b5970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80af040 tx=0x7f1ee80197d0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 -- 172.21.15.5:0/2027572526 shutdown_connections 2024-08-18T22:19:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ed00678f0 0x7f1ed0069db0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ef0161960 0x7f1ef00b5970 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ef015dda0 0x7f1ef00c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 --2- 172.21.15.5:0/2027572526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ef0070730 0x7f1ef015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 -- 172.21.15.5:0/2027572526 >> 172.21.15.5:0/2027572526 conn(0x7f1ef00d2130 msgr2=0x7f1ef015d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:42.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 -- 172.21.15.5:0/2027572526 shutdown_connections 2024-08-18T22:19:42.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.106+0000 7f1ef5200640 1 -- 172.21.15.5:0/2027572526 wait complete. 2024-08-18T22:19:42.130 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:19:42.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:19:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2f800640 1 Processor -- start 2024-08-18T22:19:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2f800640 1 -- start start 2024-08-18T22:19:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2f800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7f280b3990 0x7f7f280ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2f800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f280b5fc0 0x7f7f280b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2f800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f2806e600 con 0x7f7f2815a700 2024-08-18T22:19:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2f800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7f280b6930 con 0x7f7f280b5fc0 2024-08-18T22:19:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2f800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2815aae0 con 0x7f7f280b3990 2024-08-18T22:19:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2d800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f280b5fc0 0x7f7f280b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2d800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f280b5fc0 0x7f7f280b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45386/0 (socket says 172.21.15.5:45386) 2024-08-18T22:19:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2d800640 1 -- 172.21.15.5:0/1146795508 learned_addr learned my addr 172.21.15.5:0/1146795508 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f27e00640 1 --2- 172.21.15.5:0/1146795508 >> v2:172.21.15.117:3300/0 conn(0x7f7f280b3990 0x7f7f280ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2d800640 1 -- 172.21.15.5:0/1146795508 >> v2:172.21.15.117:3300/0 conn(0x7f7f280b3990 msgr2=0x7f7f280ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2d800640 1 --2- 172.21.15.5:0/1146795508 >> v2:172.21.15.117:3300/0 conn(0x7f7f280b3990 0x7f7f280ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2d800640 1 -- 172.21.15.5:0/1146795508 >> v1:172.21.15.117:6789/0 conn(0x7f7f2815a700 legacy=0x7f7f280b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f2d800640 1 -- 172.21.15.5:0/1146795508 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2806e870 con 0x7f7f280b5fc0 2024-08-18T22:19:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.266+0000 7f7f27e00640 1 --2- 172.21.15.5:0/1146795508 >> v2:172.21.15.117:3300/0 conn(0x7f7f280b3990 0x7f7f280ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:42.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f2d800640 1 --2- 172.21.15.5:0/1146795508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f280b5fc0 0x7f7f280b63f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7f28070e00 tx=0x7f7f2001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc8705e6d72a015 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f27400640 1 -- 172.21.15.5:0/1146795508 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f200a5750 con 0x7f7f280b5fc0 2024-08-18T22:19:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f27400640 1 -- 172.21.15.5:0/1146795508 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f200a58f0 con 0x7f7f280b5fc0 2024-08-18T22:19:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f27400640 1 -- 172.21.15.5:0/1146795508 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f200a5cc0 con 0x7f7f280b5fc0 2024-08-18T22:19:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f2f800640 1 -- 172.21.15.5:0/1146795508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f280b5fc0 msgr2=0x7f7f280b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f2f800640 1 --2- 172.21.15.5:0/1146795508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f280b5fc0 0x7f7f280b63f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7f28070e00 tx=0x7f7f2001c980 comp rx=0 tx=0).stop 2024-08-18T22:19:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f2f800640 1 -- 172.21.15.5:0/1146795508 shutdown_connections 2024-08-18T22:19:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f2f800640 1 --2- 172.21.15.5:0/1146795508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f280b5fc0 0x7f7f280b63f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f2f800640 1 --2- 172.21.15.5:0/1146795508 >> v2:172.21.15.117:3300/0 conn(0x7f7f280b3990 0x7f7f280ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f2f800640 1 -- 172.21.15.5:0/1146795508 >> 172.21.15.5:0/1146795508 conn(0x7f7f2806b9b0 msgr2=0x7f7f2806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f2f800640 1 -- 172.21.15.5:0/1146795508 shutdown_connections 2024-08-18T22:19:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.270+0000 7f7f2f800640 1 -- 172.21.15.5:0/1146795508 wait complete. 2024-08-18T22:19:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2f800640 1 Processor -- start 2024-08-18T22:19:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2f800640 1 -- start start 2024-08-18T22:19:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2f800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280b3990 0x7f7f2813cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2f800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f280b5fc0 0x7f7f28156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2f800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f2815a700 0x7f7f28155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2f800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7f280cf160 con 0x7f7f280b5fc0 2024-08-18T22:19:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2f800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7f280cefe0 con 0x7f7f2815a700 2024-08-18T22:19:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2f800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2806fb60 con 0x7f7f280b3990 2024-08-18T22:19:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f27e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f280b5fc0 0x7f7f28156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f27e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f280b5fc0 0x7f7f28156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45402/0 (socket says 172.21.15.5:45402) 2024-08-18T22:19:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f27e00640 1 -- 172.21.15.5:0/5364983 learned_addr learned my addr 172.21.15.5:0/5364983 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2ce00640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280b3990 0x7f7f2813cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2d800640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f2815a700 0x7f7f28155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f27e00640 1 -- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280b3990 msgr2=0x7f7f2813cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f27e00640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280b3990 0x7f7f2813cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f27e00640 1 -- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f2815a700 msgr2=0x7f7f28155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f27e00640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f2815a700 0x7f7f28155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f27e00640 1 -- 172.21.15.5:0/5364983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f28155a50 con 0x7f7f280b5fc0 2024-08-18T22:19:42.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f27e00640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f280b5fc0 0x7f7f28156af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400c7f0 tx=0x7f7f1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:42.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f24c00640 1 -- 172.21.15.5:0/5364983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14007a30 con 0x7f7f280b5fc0 2024-08-18T22:19:42.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f24c00640 1 -- 172.21.15.5:0/5364983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f14007bd0 con 0x7f7f280b5fc0 2024-08-18T22:19:42.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2f800640 1 -- 172.21.15.5:0/5364983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f28155d30 con 0x7f7f280b5fc0 2024-08-18T22:19:42.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f24c00640 1 -- 172.21.15.5:0/5364983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f140113f0 con 0x7f7f280b5fc0 2024-08-18T22:19:42.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.274+0000 7f7f2f800640 1 -- 172.21.15.5:0/5364983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f281562f0 con 0x7f7f280b5fc0 2024-08-18T22:19:42.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.278+0000 7f7f2f800640 1 -- 172.21.15.5:0/5364983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f280ceaa0 con 0x7f7f280b5fc0 2024-08-18T22:19:42.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.278+0000 7f7f24c00640 1 -- 172.21.15.5:0/5364983 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f14011590 con 0x7f7f280b5fc0 2024-08-18T22:19:42.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.278+0000 7f7f24c00640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f080678f0 0x7f7f08069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.278+0000 7f7f24c00640 1 -- 172.21.15.5:0/5364983 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7f14086230 con 0x7f7f280b5fc0 2024-08-18T22:19:42.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.278+0000 7f7f2ce00640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f080678f0 0x7f7f08069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.278+0000 7f7f2ce00640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f080678f0 0x7f7f08069db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800b810 tx=0x7f7f18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:42.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.282+0000 7f7f24c00640 1 -- 172.21.15.5:0/5364983 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7f14015020 con 0x7f7f280b5fc0 2024-08-18T22:19:42.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.446+0000 7f7f2f800640 1 -- 172.21.15.5:0/5364983 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f280b66f0 con 0x7f7f080678f0 2024-08-18T22:19:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.458+0000 7f7f24c00640 1 -- 172.21.15.5:0/5364983 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f7f280b66f0 con 0x7f7f080678f0 2024-08-18T22:19:42.465 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:42.467 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:19:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 -- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f080678f0 msgr2=0x7f7f08069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f080678f0 0x7f7f08069db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800b810 tx=0x7f7f18008040 comp rx=0 tx=0).stop 2024-08-18T22:19:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 -- 172.21.15.5:0/5364983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f280b5fc0 msgr2=0x7f7f28156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f280b5fc0 0x7f7f28156af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400c7f0 tx=0x7f7f1400ccb0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 -- 172.21.15.5:0/5364983 shutdown_connections 2024-08-18T22:19:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f080678f0 0x7f7f08069db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f2815a700 0x7f7f28155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f280b5fc0 0x7f7f28156af0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 --2- 172.21.15.5:0/5364983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280b3990 0x7f7f2813cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 -- 172.21.15.5:0/5364983 >> 172.21.15.5:0/5364983 conn(0x7f7f2806b9b0 msgr2=0x7f7f2806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 -- 172.21.15.5:0/5364983 shutdown_connections 2024-08-18T22:19:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.462+0000 7f7f2f800640 1 -- 172.21.15.5:0/5364983 wait complete. 2024-08-18T22:19:42.486 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-08-18T22:19:41.622479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231896,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742824,"statfs":{"total":773094113280,"available":772856651776,"internally_reserved":0,"allocated":3317760,"data_stored":2006566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003327"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409284+0000","last_change":"2024-08-18T22:19:20.123479+0000","last_active":"2024-08-18T22:19:27.409284+0000","last_peered":"2024-08-18T22:19:27.409284+0000","last_clean":"2024-08-18T22:19:27.409284+0000","last_became_active":"2024-08-18T22:19:20.122186+0000","last_became_peered":"2024-08-18T22:19:20.122186+0000","last_unstale":"2024-08-18T22:19:27.409284+0000","last_undegraded":"2024-08-18T22:19:27.409284+0000","last_fullsized":"2024-08-18T22:19:27.409284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:43.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040942+0000","last_change":"2024-08-18T22:19:21.129646+0000","last_active":"2024-08-18T22:19:27.040942+0000","last_peered":"2024-08-18T22:19:27.040942+0000","last_clean":"2024-08-18T22:19:27.040942+0000","last_became_active":"2024-08-18T22:19:21.129335+0000","last_became_peered":"2024-08-18T22:19:21.129335+0000","last_unstale":"2024-08-18T22:19:27.040942+0000","last_undegraded":"2024-08-18T22:19:27.040942+0000","last_fullsized":"2024-08-18T22:19:27.040942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:43.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040525+0000","last_change":"2024-08-18T22:19:25.367940+0000","last_active":"2024-08-18T22:19:27.040525+0000","last_peered":"2024-08-18T22:19:27.040525+0000","last_clean":"2024-08-18T22:19:27.040525+0000","last_became_active":"2024-08-18T22:19:25.367535+0000","last_became_peered":"2024-08-18T22:19:25.367535+0000","last_unstale":"2024-08-18T22:19:27.040525+0000","last_undegraded":"2024-08-18T22:19:27.040525+0000","last_fullsized":"2024-08-18T22:19:27.040525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:01.102831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041348+0000","last_change":"2024-08-18T22:19:20.124507+0000","last_active":"2024-08-18T22:19:27.041348+0000","last_peered":"2024-08-18T22:19:27.041348+0000","last_clean":"2024-08-18T22:19:27.041348+0000","last_became_active":"2024-08-18T22:19:20.124250+0000","last_became_peered":"2024-08-18T22:19:20.124250+0000","last_unstale":"2024-08-18T22:19:27.041348+0000","last_undegraded":"2024-08-18T22:19:27.041348+0000","last_fullsized":"2024-08-18T22:19:27.041348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:31.028689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409181+0000","last_change":"2024-08-18T22:19:21.137616+0000","last_active":"2024-08-18T22:19:27.409181+0000","last_peered":"2024-08-18T22:19:27.409181+0000","last_clean":"2024-08-18T22:19:27.409181+0000","last_became_active":"2024-08-18T22:19:21.134380+0000","last_became_peered":"2024-08-18T22:19:21.134380+0000","last_unstale":"2024-08-18T22:19:27.409181+0000","last_undegraded":"2024-08-18T22:19:27.409181+0000","last_fullsized":"2024-08-18T22:19:27.409181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343730+0000","last_change":"2024-08-18T22:19:25.363335+0000","last_active":"2024-08-18T22:19:26.343730+0000","last_peered":"2024-08-18T22:19:26.343730+0000","last_clean":"2024-08-18T22:19:26.343730+0000","last_became_active":"2024-08-18T22:19:25.362888+0000","last_became_peered":"2024-08-18T22:19:25.362888+0000","last_unstale":"2024-08-18T22:19:26.343730+0000","last_undegraded":"2024-08-18T22:19:26.343730+0000","last_fullsized":"2024-08-18T22:19:26.343730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:16.915639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345479+0000","last_change":"2024-08-18T22:19:20.129678+0000","last_active":"2024-08-18T22:19:26.345479+0000","last_peered":"2024-08-18T22:19:26.345479+0000","last_clean":"2024-08-18T22:19:26.345479+0000","last_became_active":"2024-08-18T22:19:20.129372+0000","last_became_peered":"2024-08-18T22:19:20.129372+0000","last_unstale":"2024-08-18T22:19:26.345479+0000","last_undegraded":"2024-08-18T22:19:26.345479+0000","last_fullsized":"2024-08-18T22:19:26.345479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:03.344308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335731+0000","last_change":"2024-08-18T22:19:21.130152+0000","last_active":"2024-08-18T22:19:27.335731+0000","last_peered":"2024-08-18T22:19:27.335731+0000","last_clean":"2024-08-18T22:19:27.335731+0000","last_became_active":"2024-08-18T22:19:21.127248+0000","last_became_peered":"2024-08-18T22:19:21.127248+0000","last_unstale":"2024-08-18T22:19:27.335731+0000","last_undegraded":"2024-08-18T22:19:27.335731+0000","last_fullsized":"2024-08-18T22:19:27.335731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:12.798866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344771+0000","last_change":"2024-08-18T22:19:25.375154+0000","last_active":"2024-08-18T22:19:26.344771+0000","last_peered":"2024-08-18T22:19:26.344771+0000","last_clean":"2024-08-18T22:19:26.344771+0000","last_became_active":"2024-08-18T22:19:25.374828+0000","last_became_peered":"2024-08-18T22:19:25.374828+0000","last_unstale":"2024-08-18T22:19:26.344771+0000","last_undegraded":"2024-08-18T22:19:26.344771+0000","last_fullsized":"2024-08-18T22:19:26.344771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:01.678786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345295+0000","last_change":"2024-08-18T22:19:20.127647+0000","last_active":"2024-08-18T22:19:26.345295+0000","last_peered":"2024-08-18T22:19:26.345295+0000","last_clean":"2024-08-18T22:19:26.345295+0000","last_became_active":"2024-08-18T22:19:20.126923+0000","last_became_peered":"2024-08-18T22:19:20.126923+0000","last_unstale":"2024-08-18T22:19:26.345295+0000","last_undegraded":"2024-08-18T22:19:26.345295+0000","last_fullsized":"2024-08-18T22:19:26.345295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:59:29.190977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335932+0000","last_change":"2024-08-18T22:19:21.115653+0000","last_active":"2024-08-18T22:19:27.335932+0000","last_peered":"2024-08-18T22:19:27.335932+0000","last_clean":"2024-08-18T22:19:27.335932+0000","last_became_active":"2024-08-18T22:19:21.115314+0000","last_became_peered":"2024-08-18T22:19:21.115314+0000","last_unstale":"2024-08-18T22:19:27.335932+0000","last_undegraded":"2024-08-18T22:19:27.335932+0000","last_fullsized":"2024-08-18T22:19:27.335932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:38.186074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344183+0000","last_change":"2024-08-18T22:19:25.371279+0000","last_active":"2024-08-18T22:19:26.344183+0000","last_peered":"2024-08-18T22:19:26.344183+0000","last_clean":"2024-08-18T22:19:26.344183+0000","last_became_active":"2024-08-18T22:19:25.370845+0000","last_became_peered":"2024-08-18T22:19:25.370845+0000","last_unstale":"2024-08-18T22:19:26.344183+0000","last_undegraded":"2024-08-18T22:19:26.344183+0000","last_fullsized":"2024-08-18T22:19:26.344183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:47.906445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342492+0000","last_change":"2024-08-18T22:19:21.117843+0000","last_active":"2024-08-18T22:19:26.342492+0000","last_peered":"2024-08-18T22:19:26.342492+0000","last_clean":"2024-08-18T22:19:26.342492+0000","last_became_active":"2024-08-18T22:19:21.117591+0000","last_became_peered":"2024-08-18T22:19:21.117591+0000","last_unstale":"2024-08-18T22:19:26.342492+0000","last_undegraded":"2024-08-18T22:19:26.342492+0000","last_fullsized":"2024-08-18T22:19:26.342492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345999+0000","last_change":"2024-08-18T22:19:20.130667+0000","last_active":"2024-08-18T22:19:26.345999+0000","last_peered":"2024-08-18T22:19:26.345999+0000","last_clean":"2024-08-18T22:19:26.345999+0000","last_became_active":"2024-08-18T22:19:20.130389+0000","last_became_peered":"2024-08-18T22:19:20.130389+0000","last_unstale":"2024-08-18T22:19:26.345999+0000","last_undegraded":"2024-08-18T22:19:26.345999+0000","last_fullsized":"2024-08-18T22:19:26.345999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:43.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344745+0000","last_change":"2024-08-18T22:19:25.362818+0000","last_active":"2024-08-18T22:19:26.344745+0000","last_peered":"2024-08-18T22:19:26.344745+0000","last_clean":"2024-08-18T22:19:26.344745+0000","last_became_active":"2024-08-18T22:19:25.360791+0000","last_became_peered":"2024-08-18T22:19:25.360791+0000","last_unstale":"2024-08-18T22:19:26.344745+0000","last_undegraded":"2024-08-18T22:19:26.344745+0000","last_fullsized":"2024-08-18T22:19:26.344745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:00.035629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040971+0000","last_change":"2024-08-18T22:19:21.140980+0000","last_active":"2024-08-18T22:19:27.040971+0000","last_peered":"2024-08-18T22:19:27.040971+0000","last_clean":"2024-08-18T22:19:27.040971+0000","last_became_active":"2024-08-18T22:19:21.139771+0000","last_became_peered":"2024-08-18T22:19:21.139771+0000","last_unstale":"2024-08-18T22:19:27.040971+0000","last_undegraded":"2024-08-18T22:19:27.040971+0000","last_fullsized":"2024-08-18T22:19:27.040971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407586+0000","last_change":"2024-08-18T22:19:20.119605+0000","last_active":"2024-08-18T22:19:27.407586+0000","last_peered":"2024-08-18T22:19:27.407586+0000","last_clean":"2024-08-18T22:19:27.407586+0000","last_became_active":"2024-08-18T22:19:20.118664+0000","last_became_peered":"2024-08-18T22:19:20.118664+0000","last_unstale":"2024-08-18T22:19:27.407586+0000","last_undegraded":"2024-08-18T22:19:27.407586+0000","last_fullsized":"2024-08-18T22:19:27.407586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344947+0000","last_change":"2024-08-18T22:19:25.376804+0000","last_active":"2024-08-18T22:19:26.344947+0000","last_peered":"2024-08-18T22:19:26.344947+0000","last_clean":"2024-08-18T22:19:26.344947+0000","last_became_active":"2024-08-18T22:19:25.376401+0000","last_became_peered":"2024-08-18T22:19:25.376401+0000","last_unstale":"2024-08-18T22:19:26.344947+0000","last_undegraded":"2024-08-18T22:19:26.344947+0000","last_fullsized":"2024-08-18T22:19:26.344947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:13.678679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041189+0000","last_change":"2024-08-18T22:19:21.115033+0000","last_active":"2024-08-18T22:19:27.041189+0000","last_peered":"2024-08-18T22:19:27.041189+0000","last_clean":"2024-08-18T22:19:27.041189+0000","last_became_active":"2024-08-18T22:19:21.114665+0000","last_became_peered":"2024-08-18T22:19:21.114665+0000","last_unstale":"2024-08-18T22:19:27.041189+0000","last_undegraded":"2024-08-18T22:19:27.041189+0000","last_fullsized":"2024-08-18T22:19:27.041189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406868+0000","last_change":"2024-08-18T22:19:20.118245+0000","last_active":"2024-08-18T22:19:27.406868+0000","last_peered":"2024-08-18T22:19:27.406868+0000","last_clean":"2024-08-18T22:19:27.406868+0000","last_became_active":"2024-08-18T22:19:20.117739+0000","last_became_peered":"2024-08-18T22:19:20.117739+0000","last_unstale":"2024-08-18T22:19:27.406868+0000","last_undegraded":"2024-08-18T22:19:27.406868+0000","last_fullsized":"2024-08-18T22:19:27.406868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408292+0000","last_change":"2024-08-18T22:19:25.369695+0000","last_active":"2024-08-18T22:19:27.408292+0000","last_peered":"2024-08-18T22:19:27.408292+0000","last_clean":"2024-08-18T22:19:27.408292+0000","last_became_active":"2024-08-18T22:19:25.368337+0000","last_became_peered":"2024-08-18T22:19:25.368337+0000","last_unstale":"2024-08-18T22:19:27.408292+0000","last_undegraded":"2024-08-18T22:19:27.408292+0000","last_fullsized":"2024-08-18T22:19:27.408292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:30.299592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343932+0000","last_change":"2024-08-18T22:19:21.123087+0000","last_active":"2024-08-18T22:19:26.343932+0000","last_peered":"2024-08-18T22:19:26.343932+0000","last_clean":"2024-08-18T22:19:26.343932+0000","last_became_active":"2024-08-18T22:19:21.121880+0000","last_became_peered":"2024-08-18T22:19:21.121880+0000","last_unstale":"2024-08-18T22:19:26.343932+0000","last_undegraded":"2024-08-18T22:19:26.343932+0000","last_fullsized":"2024-08-18T22:19:26.343932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:30.321238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343775+0000","last_change":"2024-08-18T22:19:20.127132+0000","last_active":"2024-08-18T22:19:26.343775+0000","last_peered":"2024-08-18T22:19:26.343775+0000","last_clean":"2024-08-18T22:19:26.343775+0000","last_became_active":"2024-08-18T22:19:20.126546+0000","last_became_peered":"2024-08-18T22:19:20.126546+0000","last_unstale":"2024-08-18T22:19:26.343775+0000","last_undegraded":"2024-08-18T22:19:26.343775+0000","last_fullsized":"2024-08-18T22:19:26.343775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:02.877029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345036+0000","last_change":"2024-08-18T22:19:25.372155+0000","last_active":"2024-08-18T22:19:26.345036+0000","last_peered":"2024-08-18T22:19:26.345036+0000","last_clean":"2024-08-18T22:19:26.345036+0000","last_became_active":"2024-08-18T22:19:25.370185+0000","last_became_peered":"2024-08-18T22:19:25.370185+0000","last_unstale":"2024-08-18T22:19:26.345036+0000","last_undegraded":"2024-08-18T22:19:26.345036+0000","last_fullsized":"2024-08-18T22:19:26.345036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:29:15.122631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409166+0000","last_change":"2024-08-18T22:19:21.132057+0000","last_active":"2024-08-18T22:19:27.409166+0000","last_peered":"2024-08-18T22:19:27.409166+0000","last_clean":"2024-08-18T22:19:27.409166+0000","last_became_active":"2024-08-18T22:19:21.131730+0000","last_became_peered":"2024-08-18T22:19:21.131730+0000","last_unstale":"2024-08-18T22:19:27.409166+0000","last_undegraded":"2024-08-18T22:19:27.409166+0000","last_fullsized":"2024-08-18T22:19:27.409166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344759+0000","last_change":"2024-08-18T22:19:20.124994+0000","last_active":"2024-08-18T22:19:26.344759+0000","last_peered":"2024-08-18T22:19:26.344759+0000","last_clean":"2024-08-18T22:19:26.344759+0000","last_became_active":"2024-08-18T22:19:20.124797+0000","last_became_peered":"2024-08-18T22:19:20.124797+0000","last_unstale":"2024-08-18T22:19:26.344759+0000","last_undegraded":"2024-08-18T22:19:26.344759+0000","last_fullsized":"2024-08-18T22:19:26.344759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343600+0000","last_change":"2024-08-18T22:19:25.359580+0000","last_active":"2024-08-18T22:19:26.343600+0000","last_peered":"2024-08-18T22:19:26.343600+0000","last_clean":"2024-08-18T22:19:26.343600+0000","last_became_active":"2024-08-18T22:19:25.359219+0000","last_became_peered":"2024-08-18T22:19:25.359219+0000","last_unstale":"2024-08-18T22:19:26.343600+0000","last_undegraded":"2024-08-18T22:19:26.343600+0000","last_fullsized":"2024-08-18T22:19:26.343600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:29.463841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041318+0000","last_change":"2024-08-18T22:19:21.121965+0000","last_active":"2024-08-18T22:19:27.041318+0000","last_peered":"2024-08-18T22:19:27.041318+0000","last_clean":"2024-08-18T22:19:27.041318+0000","last_became_active":"2024-08-18T22:19:21.118981+0000","last_became_peered":"2024-08-18T22:19:21.118981+0000","last_unstale":"2024-08-18T22:19:27.041318+0000","last_undegraded":"2024-08-18T22:19:27.041318+0000","last_fullsized":"2024-08-18T22:19:27.041318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408573+0000","last_change":"2024-08-18T22:19:20.127044+0000","last_active":"2024-08-18T22:19:27.408573+0000","last_peered":"2024-08-18T22:19:27.408573+0000","last_clean":"2024-08-18T22:19:27.408573+0000","last_became_active":"2024-08-18T22:19:20.126773+0000","last_became_peered":"2024-08-18T22:19:20.126773+0000","last_unstale":"2024-08-18T22:19:27.408573+0000","last_undegraded":"2024-08-18T22:19:27.408573+0000","last_fullsized":"2024-08-18T22:19:27.408573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040518+0000","last_change":"2024-08-18T22:19:25.365151+0000","last_active":"2024-08-18T22:19:27.040518+0000","last_peered":"2024-08-18T22:19:27.040518+0000","last_clean":"2024-08-18T22:19:27.040518+0000","last_became_active":"2024-08-18T22:19:25.364683+0000","last_became_peered":"2024-08-18T22:19:25.364683+0000","last_unstale":"2024-08-18T22:19:27.040518+0000","last_undegraded":"2024-08-18T22:19:27.040518+0000","last_fullsized":"2024-08-18T22:19:27.040518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:28.640280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407867+0000","last_change":"2024-08-18T22:19:21.113379+0000","last_active":"2024-08-18T22:19:27.407867+0000","last_peered":"2024-08-18T22:19:27.407867+0000","last_clean":"2024-08-18T22:19:27.407867+0000","last_became_active":"2024-08-18T22:19:21.113086+0000","last_became_peered":"2024-08-18T22:19:21.113086+0000","last_unstale":"2024-08-18T22:19:27.407867+0000","last_undegraded":"2024-08-18T22:19:27.407867+0000","last_fullsized":"2024-08-18T22:19:27.407867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345595+0000","last_change":"2024-08-18T22:19:20.130493+0000","last_active":"2024-08-18T22:19:26.345595+0000","last_peered":"2024-08-18T22:19:26.345595+0000","last_clean":"2024-08-18T22:19:26.345595+0000","last_became_active":"2024-08-18T22:19:20.130161+0000","last_became_peered":"2024-08-18T22:19:20.130161+0000","last_unstale":"2024-08-18T22:19:26.345595+0000","last_undegraded":"2024-08-18T22:19:26.345595+0000","last_fullsized":"2024-08-18T22:19:26.345595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:13.130477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408499+0000","last_change":"2024-08-18T22:19:25.375977+0000","last_active":"2024-08-18T22:19:27.408499+0000","last_peered":"2024-08-18T22:19:27.408499+0000","last_clean":"2024-08-18T22:19:27.408499+0000","last_became_active":"2024-08-18T22:19:25.366619+0000","last_became_peered":"2024-08-18T22:19:25.366619+0000","last_unstale":"2024-08-18T22:19:27.408499+0000","last_undegraded":"2024-08-18T22:19:27.408499+0000","last_fullsized":"2024-08-18T22:19:27.408499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:25.001121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336042+0000","last_change":"2024-08-18T22:19:21.126649+0000","last_active":"2024-08-18T22:19:27.336042+0000","last_peered":"2024-08-18T22:19:27.336042+0000","last_clean":"2024-08-18T22:19:27.336042+0000","last_became_active":"2024-08-18T22:19:21.125045+0000","last_became_peered":"2024-08-18T22:19:21.125045+0000","last_unstale":"2024-08-18T22:19:27.336042+0000","last_undegraded":"2024-08-18T22:19:27.336042+0000","last_fullsized":"2024-08-18T22:19:27.336042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:10.870419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407965+0000","last_change":"2024-08-18T22:19:20.113605+0000","last_active":"2024-08-18T22:19:27.407965+0000","last_peered":"2024-08-18T22:19:27.407965+0000","last_clean":"2024-08-18T22:19:27.407965+0000","last_became_active":"2024-08-18T22:19:20.113312+0000","last_became_peered":"2024-08-18T22:19:20.113312+0000","last_unstale":"2024-08-18T22:19:27.407965+0000","last_undegraded":"2024-08-18T22:19:27.407965+0000","last_fullsized":"2024-08-18T22:19:27.407965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407154+0000","last_change":"2024-08-18T22:19:25.379602+0000","last_active":"2024-08-18T22:19:27.407154+0000","last_peered":"2024-08-18T22:19:27.407154+0000","last_clean":"2024-08-18T22:19:27.407154+0000","last_became_active":"2024-08-18T22:19:25.379233+0000","last_became_peered":"2024-08-18T22:19:25.379233+0000","last_unstale":"2024-08-18T22:19:27.407154+0000","last_undegraded":"2024-08-18T22:19:27.407154+0000","last_fullsized":"2024-08-18T22:19:27.407154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:49.056286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344921+0000","last_change":"2024-08-18T22:19:21.137261+0000","last_active":"2024-08-18T22:19:26.344921+0000","last_peered":"2024-08-18T22:19:26.344921+0000","last_clean":"2024-08-18T22:19:26.344921+0000","last_became_active":"2024-08-18T22:19:21.137007+0000","last_became_peered":"2024-08-18T22:19:21.137007+0000","last_unstale":"2024-08-18T22:19:26.344921+0000","last_undegraded":"2024-08-18T22:19:26.344921+0000","last_fullsized":"2024-08-18T22:19:26.344921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:14.978071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335848+0000","last_change":"2024-08-18T22:19:20.118663+0000","last_active":"2024-08-18T22:19:27.335848+0000","last_peered":"2024-08-18T22:19:27.335848+0000","last_clean":"2024-08-18T22:19:27.335848+0000","last_became_active":"2024-08-18T22:19:20.118041+0000","last_became_peered":"2024-08-18T22:19:20.118041+0000","last_unstale":"2024-08-18T22:19:27.335848+0000","last_undegraded":"2024-08-18T22:19:27.335848+0000","last_fullsized":"2024-08-18T22:19:27.335848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407962+0000","last_change":"2024-08-18T22:19:25.375614+0000","last_active":"2024-08-18T22:19:27.407962+0000","last_peered":"2024-08-18T22:19:27.407962+0000","last_clean":"2024-08-18T22:19:27.407962+0000","last_became_active":"2024-08-18T22:19:25.374263+0000","last_became_peered":"2024-08-18T22:19:25.374263+0000","last_unstale":"2024-08-18T22:19:27.407962+0000","last_undegraded":"2024-08-18T22:19:27.407962+0000","last_fullsized":"2024-08-18T22:19:27.407962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:42.422194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406686+0000","last_change":"2024-08-18T22:19:21.110718+0000","last_active":"2024-08-18T22:19:27.406686+0000","last_peered":"2024-08-18T22:19:27.406686+0000","last_clean":"2024-08-18T22:19:27.406686+0000","last_became_active":"2024-08-18T22:19:21.110328+0000","last_became_peered":"2024-08-18T22:19:21.110328+0000","last_unstale":"2024-08-18T22:19:27.406686+0000","last_undegraded":"2024-08-18T22:19:27.406686+0000","last_fullsized":"2024-08-18T22:19:27.406686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406673+0000","last_change":"2024-08-18T22:19:20.110735+0000","last_active":"2024-08-18T22:19:27.406673+0000","last_peered":"2024-08-18T22:19:27.406673+0000","last_clean":"2024-08-18T22:19:27.406673+0000","last_became_active":"2024-08-18T22:19:20.110382+0000","last_became_peered":"2024-08-18T22:19:20.110382+0000","last_unstale":"2024-08-18T22:19:27.406673+0000","last_undegraded":"2024-08-18T22:19:27.406673+0000","last_fullsized":"2024-08-18T22:19:27.406673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:54.714769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408376+0000","last_change":"2024-08-18T22:19:25.374139+0000","last_active":"2024-08-18T22:19:27.408376+0000","last_peered":"2024-08-18T22:19:27.408376+0000","last_clean":"2024-08-18T22:19:27.408376+0000","last_became_active":"2024-08-18T22:19:25.373712+0000","last_became_peered":"2024-08-18T22:19:25.373712+0000","last_unstale":"2024-08-18T22:19:27.408376+0000","last_undegraded":"2024-08-18T22:19:27.408376+0000","last_fullsized":"2024-08-18T22:19:27.408376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:15.106539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407992+0000","last_change":"2024-08-18T22:19:21.134091+0000","last_active":"2024-08-18T22:19:27.407992+0000","last_peered":"2024-08-18T22:19:27.407992+0000","last_clean":"2024-08-18T22:19:27.407992+0000","last_became_active":"2024-08-18T22:19:21.133674+0000","last_became_peered":"2024-08-18T22:19:21.133674+0000","last_unstale":"2024-08-18T22:19:27.407992+0000","last_undegraded":"2024-08-18T22:19:27.407992+0000","last_fullsized":"2024-08-18T22:19:27.407992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:42:36.740493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343883+0000","last_change":"2024-08-18T22:19:20.125876+0000","last_active":"2024-08-18T22:19:26.343883+0000","last_peered":"2024-08-18T22:19:26.343883+0000","last_clean":"2024-08-18T22:19:26.343883+0000","last_became_active":"2024-08-18T22:19:20.125594+0000","last_became_peered":"2024-08-18T22:19:20.125594+0000","last_unstale":"2024-08-18T22:19:26.343883+0000","last_undegraded":"2024-08-18T22:19:26.343883+0000","last_fullsized":"2024-08-18T22:19:26.343883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:35:24.581822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409117+0000","last_change":"2024-08-18T22:19:25.366073+0000","last_active":"2024-08-18T22:19:27.409117+0000","last_peered":"2024-08-18T22:19:27.409117+0000","last_clean":"2024-08-18T22:19:27.409117+0000","last_became_active":"2024-08-18T22:19:25.364486+0000","last_became_peered":"2024-08-18T22:19:25.364486+0000","last_unstale":"2024-08-18T22:19:27.409117+0000","last_undegraded":"2024-08-18T22:19:27.409117+0000","last_fullsized":"2024-08-18T22:19:27.409117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:54.372527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040730+0000","last_change":"2024-08-18T22:19:21.126426+0000","last_active":"2024-08-18T22:19:27.040730+0000","last_peered":"2024-08-18T22:19:27.040730+0000","last_clean":"2024-08-18T22:19:27.040730+0000","last_became_active":"2024-08-18T22:19:21.126155+0000","last_became_peered":"2024-08-18T22:19:21.126155+0000","last_unstale":"2024-08-18T22:19:27.040730+0000","last_undegraded":"2024-08-18T22:19:27.040730+0000","last_fullsized":"2024-08-18T22:19:27.040730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:12.798866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335635+0000","last_change":"2024-08-18T22:19:20.120813+0000","last_active":"2024-08-18T22:19:27.335635+0000","last_peered":"2024-08-18T22:19:27.335635+0000","last_clean":"2024-08-18T22:19:27.335635+0000","last_became_active":"2024-08-18T22:19:20.120520+0000","last_became_peered":"2024-08-18T22:19:20.120520+0000","last_unstale":"2024-08-18T22:19:27.335635+0000","last_undegraded":"2024-08-18T22:19:27.335635+0000","last_fullsized":"2024-08-18T22:19:27.335635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343987+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:19:26.343987+0000","last_peered":"2024-08-18T22:19:26.343987+0000","last_clean":"2024-08-18T22:19:26.343987+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:19:26.343987+0000","last_undegraded":"2024-08-18T22:19:26.343987+0000","last_fullsized":"2024-08-18T22:19:26.343987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343553+0000","last_change":"2024-08-18T22:19:25.358088+0000","last_active":"2024-08-18T22:19:26.343553+0000","last_peered":"2024-08-18T22:19:26.343553+0000","last_clean":"2024-08-18T22:19:26.343553+0000","last_became_active":"2024-08-18T22:19:25.357741+0000","last_became_peered":"2024-08-18T22:19:25.357741+0000","last_unstale":"2024-08-18T22:19:26.343553+0000","last_undegraded":"2024-08-18T22:19:26.343553+0000","last_fullsized":"2024-08-18T22:19:26.343553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:12.001219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345357+0000","last_change":"2024-08-18T22:19:21.115625+0000","last_active":"2024-08-18T22:19:26.345357+0000","last_peered":"2024-08-18T22:19:26.345357+0000","last_clean":"2024-08-18T22:19:26.345357+0000","last_became_active":"2024-08-18T22:19:21.113832+0000","last_became_peered":"2024-08-18T22:19:21.113832+0000","last_unstale":"2024-08-18T22:19:26.345357+0000","last_undegraded":"2024-08-18T22:19:26.345357+0000","last_fullsized":"2024-08-18T22:19:26.345357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:07.765099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407470+0000","last_change":"2024-08-18T22:19:20.114087+0000","last_active":"2024-08-18T22:19:27.407470+0000","last_peered":"2024-08-18T22:19:27.407470+0000","last_clean":"2024-08-18T22:19:27.407470+0000","last_became_active":"2024-08-18T22:19:20.113655+0000","last_became_peered":"2024-08-18T22:19:20.113655+0000","last_unstale":"2024-08-18T22:19:27.407470+0000","last_undegraded":"2024-08-18T22:19:27.407470+0000","last_fullsized":"2024-08-18T22:19:27.407470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:31:21.374246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342469+0000","last_change":"2024-08-18T22:19:25.362833+0000","last_active":"2024-08-18T22:19:26.342469+0000","last_peered":"2024-08-18T22:19:26.342469+0000","last_clean":"2024-08-18T22:19:26.342469+0000","last_became_active":"2024-08-18T22:19:25.362232+0000","last_became_peered":"2024-08-18T22:19:25.362232+0000","last_unstale":"2024-08-18T22:19:26.342469+0000","last_undegraded":"2024-08-18T22:19:26.342469+0000","last_fullsized":"2024-08-18T22:19:26.342469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:10.830493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335872+0000","last_change":"2024-08-18T22:19:21.127671+0000","last_active":"2024-08-18T22:19:27.335872+0000","last_peered":"2024-08-18T22:19:27.335872+0000","last_clean":"2024-08-18T22:19:27.335872+0000","last_became_active":"2024-08-18T22:19:21.124718+0000","last_became_peered":"2024-08-18T22:19:21.124718+0000","last_unstale":"2024-08-18T22:19:27.335872+0000","last_undegraded":"2024-08-18T22:19:27.335872+0000","last_fullsized":"2024-08-18T22:19:27.335872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:07.765099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408089+0000","last_change":"2024-08-18T22:19:20.109318+0000","last_active":"2024-08-18T22:19:27.408089+0000","last_peered":"2024-08-18T22:19:27.408089+0000","last_clean":"2024-08-18T22:19:27.408089+0000","last_became_active":"2024-08-18T22:19:20.108894+0000","last_became_peered":"2024-08-18T22:19:20.108894+0000","last_unstale":"2024-08-18T22:19:27.408089+0000","last_undegraded":"2024-08-18T22:19:27.408089+0000","last_fullsized":"2024-08-18T22:19:27.408089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408668+0000","last_change":"2024-08-18T22:19:25.372355+0000","last_active":"2024-08-18T22:19:27.408668+0000","last_peered":"2024-08-18T22:19:27.408668+0000","last_clean":"2024-08-18T22:19:27.408668+0000","last_became_active":"2024-08-18T22:19:25.365235+0000","last_became_peered":"2024-08-18T22:19:25.365235+0000","last_unstale":"2024-08-18T22:19:27.408668+0000","last_undegraded":"2024-08-18T22:19:27.408668+0000","last_fullsized":"2024-08-18T22:19:27.408668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:42.422194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345949+0000","last_change":"2024-08-18T22:19:21.114675+0000","last_active":"2024-08-18T22:19:26.345949+0000","last_peered":"2024-08-18T22:19:26.345949+0000","last_clean":"2024-08-18T22:19:26.345949+0000","last_became_active":"2024-08-18T22:19:21.114251+0000","last_became_peered":"2024-08-18T22:19:21.114251+0000","last_unstale":"2024-08-18T22:19:26.345949+0000","last_undegraded":"2024-08-18T22:19:26.345949+0000","last_fullsized":"2024-08-18T22:19:26.345949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:24.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408143+0000","last_change":"2024-08-18T22:19:20.112330+0000","last_active":"2024-08-18T22:19:27.408143+0000","last_peered":"2024-08-18T22:19:27.408143+0000","last_clean":"2024-08-18T22:19:27.408143+0000","last_became_active":"2024-08-18T22:19:20.110530+0000","last_became_peered":"2024-08-18T22:19:20.110530+0000","last_unstale":"2024-08-18T22:19:27.408143+0000","last_undegraded":"2024-08-18T22:19:27.408143+0000","last_fullsized":"2024-08-18T22:19:27.408143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:18.857333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335519+0000","last_change":"2024-08-18T22:19:25.363810+0000","last_active":"2024-08-18T22:19:27.335519+0000","last_peered":"2024-08-18T22:19:27.335519+0000","last_clean":"2024-08-18T22:19:27.335519+0000","last_became_active":"2024-08-18T22:19:25.363407+0000","last_became_peered":"2024-08-18T22:19:25.363407+0000","last_unstale":"2024-08-18T22:19:27.335519+0000","last_undegraded":"2024-08-18T22:19:27.335519+0000","last_fullsized":"2024-08-18T22:19:27.335519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:28.640280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345615+0000","last_change":"2024-08-18T22:19:21.114404+0000","last_active":"2024-08-18T22:19:26.345615+0000","last_peered":"2024-08-18T22:19:26.345615+0000","last_clean":"2024-08-18T22:19:26.345615+0000","last_became_active":"2024-08-18T22:19:21.114109+0000","last_became_peered":"2024-08-18T22:19:21.114109+0000","last_unstale":"2024-08-18T22:19:26.345615+0000","last_undegraded":"2024-08-18T22:19:26.345615+0000","last_fullsized":"2024-08-18T22:19:26.345615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:50.136407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345199+0000","last_change":"2024-08-18T22:19:20.122497+0000","last_active":"2024-08-18T22:19:26.345199+0000","last_peered":"2024-08-18T22:19:26.345199+0000","last_clean":"2024-08-18T22:19:26.345199+0000","last_became_active":"2024-08-18T22:19:20.120755+0000","last_became_peered":"2024-08-18T22:19:20.120755+0000","last_unstale":"2024-08-18T22:19:26.345199+0000","last_undegraded":"2024-08-18T22:19:26.345199+0000","last_fullsized":"2024-08-18T22:19:26.345199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:29.746429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343340+0000","last_change":"2024-08-18T22:19:25.365173+0000","last_active":"2024-08-18T22:19:26.343340+0000","last_peered":"2024-08-18T22:19:26.343340+0000","last_clean":"2024-08-18T22:19:26.343340+0000","last_became_active":"2024-08-18T22:19:25.364765+0000","last_became_peered":"2024-08-18T22:19:25.364765+0000","last_unstale":"2024-08-18T22:19:26.343340+0000","last_undegraded":"2024-08-18T22:19:26.343340+0000","last_fullsized":"2024-08-18T22:19:26.343340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:28:02.302944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344594+0000","last_change":"2024-08-18T22:19:21.114669+0000","last_active":"2024-08-18T22:19:26.344594+0000","last_peered":"2024-08-18T22:19:26.344594+0000","last_clean":"2024-08-18T22:19:26.344594+0000","last_became_active":"2024-08-18T22:19:21.114275+0000","last_became_peered":"2024-08-18T22:19:21.114275+0000","last_unstale":"2024-08-18T22:19:26.344594+0000","last_undegraded":"2024-08-18T22:19:26.344594+0000","last_fullsized":"2024-08-18T22:19:26.344594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:26.063472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406470+0000","last_change":"2024-08-18T22:19:20.109986+0000","last_active":"2024-08-18T22:19:27.406470+0000","last_peered":"2024-08-18T22:19:27.406470+0000","last_clean":"2024-08-18T22:19:27.406470+0000","last_became_active":"2024-08-18T22:19:20.109629+0000","last_became_peered":"2024-08-18T22:19:20.109629+0000","last_unstale":"2024-08-18T22:19:27.406470+0000","last_undegraded":"2024-08-18T22:19:27.406470+0000","last_fullsized":"2024-08-18T22:19:27.406470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:41.309073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408961+0000","last_change":"2024-08-18T22:19:25.369993+0000","last_active":"2024-08-18T22:19:27.408961+0000","last_peered":"2024-08-18T22:19:27.408961+0000","last_clean":"2024-08-18T22:19:27.408961+0000","last_became_active":"2024-08-18T22:19:25.369546+0000","last_became_peered":"2024-08-18T22:19:25.369546+0000","last_unstale":"2024-08-18T22:19:27.408961+0000","last_undegraded":"2024-08-18T22:19:27.408961+0000","last_fullsized":"2024-08-18T22:19:27.408961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:15.106539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342013+0000","last_change":"2024-08-18T22:19:21.136153+0000","last_active":"2024-08-18T22:19:26.342013+0000","last_peered":"2024-08-18T22:19:26.342013+0000","last_clean":"2024-08-18T22:19:26.342013+0000","last_became_active":"2024-08-18T22:19:21.135862+0000","last_became_peered":"2024-08-18T22:19:21.135862+0000","last_unstale":"2024-08-18T22:19:26.342013+0000","last_undegraded":"2024-08-18T22:19:26.342013+0000","last_fullsized":"2024-08-18T22:19:26.342013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342398+0000","last_change":"2024-08-18T22:19:20.119295+0000","last_active":"2024-08-18T22:19:26.342398+0000","last_peered":"2024-08-18T22:19:26.342398+0000","last_clean":"2024-08-18T22:19:26.342398+0000","last_became_active":"2024-08-18T22:19:20.118960+0000","last_became_peered":"2024-08-18T22:19:20.118960+0000","last_unstale":"2024-08-18T22:19:26.342398+0000","last_undegraded":"2024-08-18T22:19:26.342398+0000","last_fullsized":"2024-08-18T22:19:26.342398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041372+0000","last_change":"2024-08-18T22:19:25.384579+0000","last_active":"2024-08-18T22:19:27.041372+0000","last_peered":"2024-08-18T22:19:27.041372+0000","last_clean":"2024-08-18T22:19:27.041372+0000","last_became_active":"2024-08-18T22:19:25.384216+0000","last_became_peered":"2024-08-18T22:19:25.384216+0000","last_unstale":"2024-08-18T22:19:27.041372+0000","last_undegraded":"2024-08-18T22:19:27.041372+0000","last_fullsized":"2024-08-18T22:19:27.041372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:56.704905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345875+0000","last_change":"2024-08-18T22:19:21.115242+0000","last_active":"2024-08-18T22:19:26.345875+0000","last_peered":"2024-08-18T22:19:26.345875+0000","last_clean":"2024-08-18T22:19:26.345875+0000","last_became_active":"2024-08-18T22:19:21.114992+0000","last_became_peered":"2024-08-18T22:19:21.114992+0000","last_unstale":"2024-08-18T22:19:26.345875+0000","last_undegraded":"2024-08-18T22:19:26.345875+0000","last_fullsized":"2024-08-18T22:19:26.345875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:20.765001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335813+0000","last_change":"2024-08-18T22:19:20.122264+0000","last_active":"2024-08-18T22:19:27.335813+0000","last_peered":"2024-08-18T22:19:27.335813+0000","last_clean":"2024-08-18T22:19:27.335813+0000","last_became_active":"2024-08-18T22:19:20.121940+0000","last_became_peered":"2024-08-18T22:19:20.121940+0000","last_unstale":"2024-08-18T22:19:27.335813+0000","last_undegraded":"2024-08-18T22:19:27.335813+0000","last_fullsized":"2024-08-18T22:19:27.335813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041119+0000","last_change":"2024-08-18T22:19:25.382796+0000","last_active":"2024-08-18T22:19:27.041119+0000","last_peered":"2024-08-18T22:19:27.041119+0000","last_clean":"2024-08-18T22:19:27.041119+0000","last_became_active":"2024-08-18T22:19:25.382015+0000","last_became_peered":"2024-08-18T22:19:25.382015+0000","last_unstale":"2024-08-18T22:19:27.041119+0000","last_undegraded":"2024-08-18T22:19:27.041119+0000","last_fullsized":"2024-08-18T22:19:27.041119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:13:06.606276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408452+0000","last_change":"2024-08-18T22:19:21.124994+0000","last_active":"2024-08-18T22:19:27.408452+0000","last_peered":"2024-08-18T22:19:27.408452+0000","last_clean":"2024-08-18T22:19:27.408452+0000","last_became_active":"2024-08-18T22:19:21.124714+0000","last_became_peered":"2024-08-18T22:19:21.124714+0000","last_unstale":"2024-08-18T22:19:27.408452+0000","last_undegraded":"2024-08-18T22:19:27.408452+0000","last_fullsized":"2024-08-18T22:19:27.408452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408670+0000","last_change":"2024-08-18T22:19:20.117524+0000","last_active":"2024-08-18T22:19:27.408670+0000","last_peered":"2024-08-18T22:19:27.408670+0000","last_clean":"2024-08-18T22:19:27.408670+0000","last_became_active":"2024-08-18T22:19:20.117271+0000","last_became_peered":"2024-08-18T22:19:20.117271+0000","last_unstale":"2024-08-18T22:19:27.408670+0000","last_undegraded":"2024-08-18T22:19:27.408670+0000","last_fullsized":"2024-08-18T22:19:27.408670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336048+0000","last_change":"2024-08-18T22:19:25.364903+0000","last_active":"2024-08-18T22:19:27.336048+0000","last_peered":"2024-08-18T22:19:27.336048+0000","last_clean":"2024-08-18T22:19:27.336048+0000","last_became_active":"2024-08-18T22:19:25.364491+0000","last_became_peered":"2024-08-18T22:19:25.364491+0000","last_unstale":"2024-08-18T22:19:27.336048+0000","last_undegraded":"2024-08-18T22:19:27.336048+0000","last_fullsized":"2024-08-18T22:19:27.336048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:01.102831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345257+0000","last_change":"2024-08-18T22:19:21.122735+0000","last_active":"2024-08-18T22:19:26.345257+0000","last_peered":"2024-08-18T22:19:26.345257+0000","last_clean":"2024-08-18T22:19:26.345257+0000","last_became_active":"2024-08-18T22:19:21.122489+0000","last_became_peered":"2024-08-18T22:19:21.122489+0000","last_unstale":"2024-08-18T22:19:26.345257+0000","last_undegraded":"2024-08-18T22:19:26.345257+0000","last_fullsized":"2024-08-18T22:19:26.345257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:44.820166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:32.234207+0000","last_change":"2024-08-18T22:19:20.121780+0000","last_active":"2024-08-18T22:19:32.234207+0000","last_peered":"2024-08-18T22:19:32.234207+0000","last_clean":"2024-08-18T22:19:32.234207+0000","last_became_active":"2024-08-18T22:19:20.121504+0000","last_became_peered":"2024-08-18T22:19:20.121504+0000","last_unstale":"2024-08-18T22:19:32.234207+0000","last_undegraded":"2024-08-18T22:19:32.234207+0000","last_fullsized":"2024-08-18T22:19:32.234207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407423+0000","last_change":"2024-08-18T22:19:25.380704+0000","last_active":"2024-08-18T22:19:27.407423+0000","last_peered":"2024-08-18T22:19:27.407423+0000","last_clean":"2024-08-18T22:19:27.407423+0000","last_became_active":"2024-08-18T22:19:25.380338+0000","last_became_peered":"2024-08-18T22:19:25.380338+0000","last_unstale":"2024-08-18T22:19:27.407423+0000","last_undegraded":"2024-08-18T22:19:27.407423+0000","last_fullsized":"2024-08-18T22:19:27.407423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:25.001121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345049+0000","last_change":"2024-08-18T22:19:21.105768+0000","last_active":"2024-08-18T22:19:26.345049+0000","last_peered":"2024-08-18T22:19:26.345049+0000","last_clean":"2024-08-18T22:19:26.345049+0000","last_became_active":"2024-08-18T22:19:21.105461+0000","last_became_peered":"2024-08-18T22:19:21.105461+0000","last_unstale":"2024-08-18T22:19:26.345049+0000","last_undegraded":"2024-08-18T22:19:26.345049+0000","last_fullsized":"2024-08-18T22:19:26.345049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:32.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407990+0000","last_change":"2024-08-18T22:19:20.122400+0000","last_active":"2024-08-18T22:19:27.407990+0000","last_peered":"2024-08-18T22:19:27.407990+0000","last_clean":"2024-08-18T22:19:27.407990+0000","last_became_active":"2024-08-18T22:19:20.121947+0000","last_became_peered":"2024-08-18T22:19:20.121947+0000","last_unstale":"2024-08-18T22:19:27.407990+0000","last_undegraded":"2024-08-18T22:19:27.407990+0000","last_fullsized":"2024-08-18T22:19:27.407990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:02.877029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344547+0000","last_change":"2024-08-18T22:19:25.372065+0000","last_active":"2024-08-18T22:19:26.344547+0000","last_peered":"2024-08-18T22:19:26.344547+0000","last_clean":"2024-08-18T22:19:26.344547+0000","last_became_active":"2024-08-18T22:19:25.371835+0000","last_became_peered":"2024-08-18T22:19:25.371835+0000","last_unstale":"2024-08-18T22:19:26.344547+0000","last_undegraded":"2024-08-18T22:19:26.344547+0000","last_fullsized":"2024-08-18T22:19:26.344547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:04:21.012114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409247+0000","last_change":"2024-08-18T22:19:21.138068+0000","last_active":"2024-08-18T22:19:27.409247+0000","last_peered":"2024-08-18T22:19:27.409247+0000","last_clean":"2024-08-18T22:19:27.409247+0000","last_became_active":"2024-08-18T22:19:21.132915+0000","last_became_peered":"2024-08-18T22:19:21.132915+0000","last_unstale":"2024-08-18T22:19:27.409247+0000","last_undegraded":"2024-08-18T22:19:27.409247+0000","last_fullsized":"2024-08-18T22:19:27.409247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336025+0000","last_change":"2024-08-18T22:19:20.127698+0000","last_active":"2024-08-18T22:19:27.336025+0000","last_peered":"2024-08-18T22:19:27.336025+0000","last_clean":"2024-08-18T22:19:27.336025+0000","last_became_active":"2024-08-18T22:19:20.127488+0000","last_became_peered":"2024-08-18T22:19:20.127488+0000","last_unstale":"2024-08-18T22:19:27.336025+0000","last_undegraded":"2024-08-18T22:19:27.336025+0000","last_fullsized":"2024-08-18T22:19:27.336025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041133+0000","last_change":"2024-08-18T22:19:25.365048+0000","last_active":"2024-08-18T22:19:27.041133+0000","last_peered":"2024-08-18T22:19:27.041133+0000","last_clean":"2024-08-18T22:19:27.041133+0000","last_became_active":"2024-08-18T22:19:25.364597+0000","last_became_peered":"2024-08-18T22:19:25.364597+0000","last_unstale":"2024-08-18T22:19:27.041133+0000","last_undegraded":"2024-08-18T22:19:27.041133+0000","last_fullsized":"2024-08-18T22:19:27.041133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:37.692476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336018+0000","last_change":"2024-08-18T22:19:21.130941+0000","last_active":"2024-08-18T22:19:27.336018+0000","last_peered":"2024-08-18T22:19:27.336018+0000","last_clean":"2024-08-18T22:19:27.336018+0000","last_became_active":"2024-08-18T22:19:21.130617+0000","last_became_peered":"2024-08-18T22:19:21.130617+0000","last_unstale":"2024-08-18T22:19:27.336018+0000","last_undegraded":"2024-08-18T22:19:27.336018+0000","last_fullsized":"2024-08-18T22:19:27.336018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:06.594373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344569+0000","last_change":"2024-08-18T22:19:20.124348+0000","last_active":"2024-08-18T22:19:26.344569+0000","last_peered":"2024-08-18T22:19:26.344569+0000","last_clean":"2024-08-18T22:19:26.344569+0000","last_became_active":"2024-08-18T22:19:20.123971+0000","last_became_peered":"2024-08-18T22:19:20.123971+0000","last_unstale":"2024-08-18T22:19:26.344569+0000","last_undegraded":"2024-08-18T22:19:26.344569+0000","last_fullsized":"2024-08-18T22:19:26.344569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041200+0000","last_change":"2024-08-18T22:19:25.364746+0000","last_active":"2024-08-18T22:19:27.041200+0000","last_peered":"2024-08-18T22:19:27.041200+0000","last_clean":"2024-08-18T22:19:27.041200+0000","last_became_active":"2024-08-18T22:19:25.364332+0000","last_became_peered":"2024-08-18T22:19:25.364332+0000","last_unstale":"2024-08-18T22:19:27.041200+0000","last_undegraded":"2024-08-18T22:19:27.041200+0000","last_fullsized":"2024-08-18T22:19:27.041200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:13.150322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408896+0000","last_change":"2024-08-18T22:19:25.380247+0000","last_active":"2024-08-18T22:19:27.408896+0000","last_peered":"2024-08-18T22:19:27.408896+0000","last_clean":"2024-08-18T22:19:27.408896+0000","last_became_active":"2024-08-18T22:19:25.376751+0000","last_became_peered":"2024-08-18T22:19:25.376751+0000","last_unstale":"2024-08-18T22:19:27.408896+0000","last_undegraded":"2024-08-18T22:19:27.408896+0000","last_fullsized":"2024-08-18T22:19:27.408896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:30.299592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406771+0000","last_change":"2024-08-18T22:19:21.118219+0000","last_active":"2024-08-18T22:19:27.406771+0000","last_peered":"2024-08-18T22:19:27.406771+0000","last_clean":"2024-08-18T22:19:27.406771+0000","last_became_active":"2024-08-18T22:19:21.117904+0000","last_became_peered":"2024-08-18T22:19:21.117904+0000","last_unstale":"2024-08-18T22:19:27.406771+0000","last_undegraded":"2024-08-18T22:19:27.406771+0000","last_fullsized":"2024-08-18T22:19:27.406771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335657+0000","last_change":"2024-08-18T22:19:20.113456+0000","last_active":"2024-08-18T22:19:27.335657+0000","last_peered":"2024-08-18T22:19:27.335657+0000","last_clean":"2024-08-18T22:19:27.335657+0000","last_became_active":"2024-08-18T22:19:20.113170+0000","last_became_peered":"2024-08-18T22:19:20.113170+0000","last_unstale":"2024-08-18T22:19:27.335657+0000","last_undegraded":"2024-08-18T22:19:27.335657+0000","last_fullsized":"2024-08-18T22:19:27.335657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344445+0000","last_change":"2024-08-18T22:19:25.362236+0000","last_active":"2024-08-18T22:19:26.344445+0000","last_peered":"2024-08-18T22:19:26.344445+0000","last_clean":"2024-08-18T22:19:26.344445+0000","last_became_active":"2024-08-18T22:19:25.361968+0000","last_became_peered":"2024-08-18T22:19:25.361968+0000","last_unstale":"2024-08-18T22:19:26.344445+0000","last_undegraded":"2024-08-18T22:19:26.344445+0000","last_fullsized":"2024-08-18T22:19:26.344445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:49.056286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040927+0000","last_change":"2024-08-18T22:19:21.142319+0000","last_active":"2024-08-18T22:19:27.040927+0000","last_peered":"2024-08-18T22:19:27.040927+0000","last_clean":"2024-08-18T22:19:27.040927+0000","last_became_active":"2024-08-18T22:19:21.142023+0000","last_became_peered":"2024-08-18T22:19:21.142023+0000","last_unstale":"2024-08-18T22:19:27.040927+0000","last_undegraded":"2024-08-18T22:19:27.040927+0000","last_fullsized":"2024-08-18T22:19:27.040927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040827+0000","last_change":"2024-08-18T22:19:20.126010+0000","last_active":"2024-08-18T22:19:27.040827+0000","last_peered":"2024-08-18T22:19:27.040827+0000","last_clean":"2024-08-18T22:19:27.040827+0000","last_became_active":"2024-08-18T22:19:20.125768+0000","last_became_peered":"2024-08-18T22:19:20.125768+0000","last_unstale":"2024-08-18T22:19:27.040827+0000","last_undegraded":"2024-08-18T22:19:27.040827+0000","last_fullsized":"2024-08-18T22:19:27.040827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:09.183754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342628+0000","last_change":"2024-08-18T22:19:20.118969+0000","last_active":"2024-08-18T22:19:26.342628+0000","last_peered":"2024-08-18T22:19:26.342628+0000","last_clean":"2024-08-18T22:19:26.342628+0000","last_became_active":"2024-08-18T22:19:20.118686+0000","last_became_peered":"2024-08-18T22:19:20.118686+0000","last_unstale":"2024-08-18T22:19:26.342628+0000","last_undegraded":"2024-08-18T22:19:26.342628+0000","last_fullsized":"2024-08-18T22:19:26.342628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408624+0000","last_change":"2024-08-18T22:19:21.138371+0000","last_active":"2024-08-18T22:19:27.408624+0000","last_peered":"2024-08-18T22:19:27.408624+0000","last_clean":"2024-08-18T22:19:27.408624+0000","last_became_active":"2024-08-18T22:19:21.138042+0000","last_became_peered":"2024-08-18T22:19:21.138042+0000","last_unstale":"2024-08-18T22:19:27.408624+0000","last_undegraded":"2024-08-18T22:19:27.408624+0000","last_fullsized":"2024-08-18T22:19:27.408624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406977+0000","last_change":"2024-08-18T22:19:25.377063+0000","last_active":"2024-08-18T22:19:27.406977+0000","last_peered":"2024-08-18T22:19:27.406977+0000","last_clean":"2024-08-18T22:19:27.406977+0000","last_became_active":"2024-08-18T22:19:25.376639+0000","last_became_peered":"2024-08-18T22:19:25.376639+0000","last_unstale":"2024-08-18T22:19:27.406977+0000","last_undegraded":"2024-08-18T22:19:27.406977+0000","last_fullsized":"2024-08-18T22:19:27.406977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:43.985709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041089+0000","last_change":"2024-08-18T22:19:20.129285+0000","last_active":"2024-08-18T22:19:27.041089+0000","last_peered":"2024-08-18T22:19:27.041089+0000","last_clean":"2024-08-18T22:19:27.041089+0000","last_became_active":"2024-08-18T22:19:20.129024+0000","last_became_peered":"2024-08-18T22:19:20.129024+0000","last_unstale":"2024-08-18T22:19:27.041089+0000","last_undegraded":"2024-08-18T22:19:27.041089+0000","last_fullsized":"2024-08-18T22:19:27.041089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344339+0000","last_change":"2024-08-18T22:19:21.102815+0000","last_active":"2024-08-18T22:19:26.344339+0000","last_peered":"2024-08-18T22:19:26.344339+0000","last_clean":"2024-08-18T22:19:26.344339+0000","last_became_active":"2024-08-18T22:19:21.102382+0000","last_became_peered":"2024-08-18T22:19:21.102382+0000","last_unstale":"2024-08-18T22:19:26.344339+0000","last_undegraded":"2024-08-18T22:19:26.344339+0000","last_fullsized":"2024-08-18T22:19:26.344339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:41.157892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041004+0000","last_change":"2024-08-18T22:19:25.365329+0000","last_active":"2024-08-18T22:19:27.041004+0000","last_peered":"2024-08-18T22:19:27.041004+0000","last_clean":"2024-08-18T22:19:27.041004+0000","last_became_active":"2024-08-18T22:19:25.364915+0000","last_became_peered":"2024-08-18T22:19:25.364915+0000","last_unstale":"2024-08-18T22:19:27.041004+0000","last_undegraded":"2024-08-18T22:19:27.041004+0000","last_fullsized":"2024-08-18T22:19:27.041004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:19:12.438973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342040+0000","last_change":"2024-08-18T22:19:21.137071+0000","last_active":"2024-08-18T22:19:26.342040+0000","last_peered":"2024-08-18T22:19:26.342040+0000","last_clean":"2024-08-18T22:19:26.342040+0000","last_became_active":"2024-08-18T22:19:21.136814+0000","last_became_peered":"2024-08-18T22:19:21.136814+0000","last_unstale":"2024-08-18T22:19:26.342040+0000","last_undegraded":"2024-08-18T22:19:26.342040+0000","last_fullsized":"2024-08-18T22:19:26.342040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406646+0000","last_change":"2024-08-18T22:19:21.118314+0000","last_active":"2024-08-18T22:19:27.406646+0000","last_peered":"2024-08-18T22:19:27.406646+0000","last_clean":"2024-08-18T22:19:27.406646+0000","last_became_active":"2024-08-18T22:19:21.117946+0000","last_became_peered":"2024-08-18T22:19:21.117946+0000","last_unstale":"2024-08-18T22:19:27.406646+0000","last_undegraded":"2024-08-18T22:19:27.406646+0000","last_fullsized":"2024-08-18T22:19:27.406646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:32.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335679+0000","last_change":"2024-08-18T22:19:21.126438+0000","last_active":"2024-08-18T22:19:27.335679+0000","last_peered":"2024-08-18T22:19:27.335679+0000","last_clean":"2024-08-18T22:19:27.335679+0000","last_became_active":"2024-08-18T22:19:21.125111+0000","last_became_peered":"2024-08-18T22:19:21.125111+0000","last_unstale":"2024-08-18T22:19:27.335679+0000","last_undegraded":"2024-08-18T22:19:27.335679+0000","last_fullsized":"2024-08-18T22:19:27.335679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:25:04.876293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408577+0000","last_change":"2024-08-18T22:19:21.127359+0000","last_active":"2024-08-18T22:19:27.408577+0000","last_peered":"2024-08-18T22:19:27.408577+0000","last_clean":"2024-08-18T22:19:27.408577+0000","last_became_active":"2024-08-18T22:19:21.126860+0000","last_became_peered":"2024-08-18T22:19:21.126860+0000","last_unstale":"2024-08-18T22:19:27.408577+0000","last_undegraded":"2024-08-18T22:19:27.408577+0000","last_fullsized":"2024-08-18T22:19:27.408577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041266+0000","last_change":"2024-08-18T22:19:21.132232+0000","last_active":"2024-08-18T22:19:27.041266+0000","last_peered":"2024-08-18T22:19:27.041266+0000","last_clean":"2024-08-18T22:19:27.041266+0000","last_became_active":"2024-08-18T22:19:21.131969+0000","last_became_peered":"2024-08-18T22:19:21.131969+0000","last_unstale":"2024-08-18T22:19:27.041266+0000","last_undegraded":"2024-08-18T22:19:27.041266+0000","last_fullsized":"2024-08-18T22:19:27.041266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:25:04.876293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407601+0000","last_change":"2024-08-18T22:19:21.116405+0000","last_active":"2024-08-18T22:19:27.407601+0000","last_peered":"2024-08-18T22:19:27.407601+0000","last_clean":"2024-08-18T22:19:27.407601+0000","last_became_active":"2024-08-18T22:19:21.116134+0000","last_became_peered":"2024-08-18T22:19:21.116134+0000","last_unstale":"2024-08-18T22:19:27.407601+0000","last_undegraded":"2024-08-18T22:19:27.407601+0000","last_fullsized":"2024-08-18T22:19:27.407601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344310+0000","last_change":"2024-08-18T22:19:21.119475+0000","last_active":"2024-08-18T22:19:26.344310+0000","last_peered":"2024-08-18T22:19:26.344310+0000","last_clean":"2024-08-18T22:19:26.344310+0000","last_became_active":"2024-08-18T22:19:21.118733+0000","last_became_peered":"2024-08-18T22:19:21.118733+0000","last_unstale":"2024-08-18T22:19:26.344310+0000","last_undegraded":"2024-08-18T22:19:26.344310+0000","last_fullsized":"2024-08-18T22:19:26.344310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041220+0000","last_change":"2024-08-18T22:19:21.130398+0000","last_active":"2024-08-18T22:19:27.041220+0000","last_peered":"2024-08-18T22:19:27.041220+0000","last_clean":"2024-08-18T22:19:27.041220+0000","last_became_active":"2024-08-18T22:19:21.130131+0000","last_became_peered":"2024-08-18T22:19:21.130131+0000","last_unstale":"2024-08-18T22:19:27.041220+0000","last_undegraded":"2024-08-18T22:19:27.041220+0000","last_fullsized":"2024-08-18T22:19:27.041220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335536+0000","last_change":"2024-08-18T22:19:21.127403+0000","last_active":"2024-08-18T22:19:27.335536+0000","last_peered":"2024-08-18T22:19:27.335536+0000","last_clean":"2024-08-18T22:19:27.335536+0000","last_became_active":"2024-08-18T22:19:21.125489+0000","last_became_peered":"2024-08-18T22:19:21.125489+0000","last_unstale":"2024-08-18T22:19:27.335536+0000","last_undegraded":"2024-08-18T22:19:27.335536+0000","last_fullsized":"2024-08-18T22:19:27.335536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:44.820166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040656+0000","last_change":"2024-08-18T22:19:21.119217+0000","last_active":"2024-08-18T22:19:27.040656+0000","last_peered":"2024-08-18T22:19:27.040656+0000","last_clean":"2024-08-18T22:19:27.040656+0000","last_became_active":"2024-08-18T22:19:21.118867+0000","last_became_peered":"2024-08-18T22:19:21.118867+0000","last_unstale":"2024-08-18T22:19:27.040656+0000","last_undegraded":"2024-08-18T22:19:27.040656+0000","last_fullsized":"2024-08-18T22:19:27.040656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335670+0000","last_change":"2024-08-18T22:19:21.131453+0000","last_active":"2024-08-18T22:19:27.335670+0000","last_peered":"2024-08-18T22:19:27.335670+0000","last_clean":"2024-08-18T22:19:27.335670+0000","last_became_active":"2024-08-18T22:19:21.131186+0000","last_became_peered":"2024-08-18T22:19:21.131186+0000","last_unstale":"2024-08-18T22:19:27.335670+0000","last_undegraded":"2024-08-18T22:19:27.335670+0000","last_fullsized":"2024-08-18T22:19:27.335670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:43.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408516+0000","last_change":"2024-08-18T22:19:21.133703+0000","last_active":"2024-08-18T22:19:27.408516+0000","last_peered":"2024-08-18T22:19:27.408516+0000","last_clean":"2024-08-18T22:19:27.408516+0000","last_became_active":"2024-08-18T22:19:21.129639+0000","last_became_peered":"2024-08-18T22:19:21.129639+0000","last_unstale":"2024-08-18T22:19:27.408516+0000","last_undegraded":"2024-08-18T22:19:27.408516+0000","last_fullsized":"2024-08-18T22:19:27.408516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342954+0000","last_change":"2024-08-18T22:19:21.119313+0000","last_active":"2024-08-18T22:19:26.342954+0000","last_peered":"2024-08-18T22:19:26.342954+0000","last_clean":"2024-08-18T22:19:26.342954+0000","last_became_active":"2024-08-18T22:19:21.119038+0000","last_became_peered":"2024-08-18T22:19:21.119038+0000","last_unstale":"2024-08-18T22:19:26.342954+0000","last_undegraded":"2024-08-18T22:19:26.342954+0000","last_fullsized":"2024-08-18T22:19:26.342954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345508+0000","last_change":"2024-08-18T22:19:21.123284+0000","last_active":"2024-08-18T22:19:26.345508+0000","last_peered":"2024-08-18T22:19:26.345508+0000","last_clean":"2024-08-18T22:19:26.345508+0000","last_became_active":"2024-08-18T22:19:21.123041+0000","last_became_peered":"2024-08-18T22:19:21.123041+0000","last_unstale":"2024-08-18T22:19:26.345508+0000","last_undegraded":"2024-08-18T22:19:26.345508+0000","last_fullsized":"2024-08-18T22:19:26.345508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:10.870419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408041+0000","last_change":"2024-08-18T22:19:21.120385+0000","last_active":"2024-08-18T22:19:27.408041+0000","last_peered":"2024-08-18T22:19:27.408041+0000","last_clean":"2024-08-18T22:19:27.408041+0000","last_became_active":"2024-08-18T22:19:21.119998+0000","last_became_peered":"2024-08-18T22:19:21.119998+0000","last_unstale":"2024-08-18T22:19:27.408041+0000","last_undegraded":"2024-08-18T22:19:27.408041+0000","last_fullsized":"2024-08-18T22:19:27.408041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:30.321238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336261+0000","last_change":"2024-08-18T22:19:21.131891+0000","last_active":"2024-08-18T22:19:27.336261+0000","last_peered":"2024-08-18T22:19:27.336261+0000","last_clean":"2024-08-18T22:19:27.336261+0000","last_became_active":"2024-08-18T22:19:21.131589+0000","last_became_peered":"2024-08-18T22:19:21.131589+0000","last_unstale":"2024-08-18T22:19:27.336261+0000","last_undegraded":"2024-08-18T22:19:27.336261+0000","last_fullsized":"2024-08-18T22:19:27.336261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:26.063472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335381+0000","last_change":"2024-08-18T22:19:21.126883+0000","last_active":"2024-08-18T22:19:27.335381+0000","last_peered":"2024-08-18T22:19:27.335381+0000","last_clean":"2024-08-18T22:19:27.335381+0000","last_became_active":"2024-08-18T22:19:21.126532+0000","last_became_peered":"2024-08-18T22:19:21.126532+0000","last_unstale":"2024-08-18T22:19:27.335381+0000","last_undegraded":"2024-08-18T22:19:27.335381+0000","last_fullsized":"2024-08-18T22:19:27.335381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406798+0000","last_change":"2024-08-18T22:19:21.105560+0000","last_active":"2024-08-18T22:19:27.406798+0000","last_peered":"2024-08-18T22:19:27.406798+0000","last_clean":"2024-08-18T22:19:27.406798+0000","last_became_active":"2024-08-18T22:19:21.105275+0000","last_became_peered":"2024-08-18T22:19:21.105275+0000","last_unstale":"2024-08-18T22:19:27.406798+0000","last_undegraded":"2024-08-18T22:19:27.406798+0000","last_fullsized":"2024-08-18T22:19:27.406798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408404+0000","last_change":"2024-08-18T22:19:21.131750+0000","last_active":"2024-08-18T22:19:27.408404+0000","last_peered":"2024-08-18T22:19:27.408404+0000","last_clean":"2024-08-18T22:19:27.408404+0000","last_became_active":"2024-08-18T22:19:21.131476+0000","last_became_peered":"2024-08-18T22:19:21.131476+0000","last_unstale":"2024-08-18T22:19:27.408404+0000","last_undegraded":"2024-08-18T22:19:27.408404+0000","last_fullsized":"2024-08-18T22:19:27.408404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:14.137945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040778+0000","last_change":"2024-08-18T22:19:21.137226+0000","last_active":"2024-08-18T22:19:27.040778+0000","last_peered":"2024-08-18T22:19:27.040778+0000","last_clean":"2024-08-18T22:19:27.040778+0000","last_became_active":"2024-08-18T22:19:21.136916+0000","last_became_peered":"2024-08-18T22:19:21.136916+0000","last_unstale":"2024-08-18T22:19:27.040778+0000","last_undegraded":"2024-08-18T22:19:27.040778+0000","last_fullsized":"2024-08-18T22:19:27.040778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344977+0000","last_change":"2024-08-18T22:19:21.122084+0000","last_active":"2024-08-18T22:19:26.344977+0000","last_peered":"2024-08-18T22:19:26.344977+0000","last_clean":"2024-08-18T22:19:26.344977+0000","last_became_active":"2024-08-18T22:19:21.121814+0000","last_became_peered":"2024-08-18T22:19:21.121814+0000","last_unstale":"2024-08-18T22:19:26.344977+0000","last_undegraded":"2024-08-18T22:19:26.344977+0000","last_fullsized":"2024-08-18T22:19:26.344977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:03.691264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343684+0000","last_change":"2024-08-18T22:19:21.118724+0000","last_active":"2024-08-18T22:19:26.343684+0000","last_peered":"2024-08-18T22:19:26.343684+0000","last_clean":"2024-08-18T22:19:26.343684+0000","last_became_active":"2024-08-18T22:19:21.118432+0000","last_became_peered":"2024-08-18T22:19:21.118432+0000","last_unstale":"2024-08-18T22:19:26.343684+0000","last_undegraded":"2024-08-18T22:19:26.343684+0000","last_fullsized":"2024-08-18T22:19:26.343684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344215+0000","last_change":"2024-08-18T22:19:21.119771+0000","last_active":"2024-08-18T22:19:26.344215+0000","last_peered":"2024-08-18T22:19:26.344215+0000","last_clean":"2024-08-18T22:19:26.344215+0000","last_became_active":"2024-08-18T22:19:21.119089+0000","last_became_peered":"2024-08-18T22:19:21.119089+0000","last_unstale":"2024-08-18T22:19:26.344215+0000","last_undegraded":"2024-08-18T22:19:26.344215+0000","last_fullsized":"2024-08-18T22:19:26.344215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345907+0000","last_change":"2024-08-18T22:19:21.116013+0000","last_active":"2024-08-18T22:19:26.345907+0000","last_peered":"2024-08-18T22:19:26.345907+0000","last_clean":"2024-08-18T22:19:26.345907+0000","last_became_active":"2024-08-18T22:19:21.115692+0000","last_became_peered":"2024-08-18T22:19:21.115692+0000","last_unstale":"2024-08-18T22:19:26.345907+0000","last_undegraded":"2024-08-18T22:19:26.345907+0000","last_fullsized":"2024-08-18T22:19:26.345907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:17.605306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040584+0000","last_change":"2024-08-18T22:19:21.121713+0000","last_active":"2024-08-18T22:19:27.040584+0000","last_peered":"2024-08-18T22:19:27.040584+0000","last_clean":"2024-08-18T22:19:27.040584+0000","last_became_active":"2024-08-18T22:19:21.121200+0000","last_became_peered":"2024-08-18T22:19:21.121200+0000","last_unstale":"2024-08-18T22:19:27.040584+0000","last_undegraded":"2024-08-18T22:19:27.040584+0000","last_fullsized":"2024-08-18T22:19:27.040584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344491+0000","last_change":"2024-08-18T22:19:21.129242+0000","last_active":"2024-08-18T22:19:26.344491+0000","last_peered":"2024-08-18T22:19:26.344491+0000","last_clean":"2024-08-18T22:19:26.344491+0000","last_became_active":"2024-08-18T22:19:21.128914+0000","last_became_peered":"2024-08-18T22:19:21.128914+0000","last_unstale":"2024-08-18T22:19:26.344491+0000","last_undegraded":"2024-08-18T22:19:26.344491+0000","last_fullsized":"2024-08-18T22:19:26.344491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:06.594373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335443+0000","last_change":"2024-08-18T22:19:21.136266+0000","last_active":"2024-08-18T22:19:27.335443+0000","last_peered":"2024-08-18T22:19:27.335443+0000","last_clean":"2024-08-18T22:19:27.335443+0000","last_became_active":"2024-08-18T22:19:21.135968+0000","last_became_peered":"2024-08-18T22:19:21.135968+0000","last_unstale":"2024-08-18T22:19:27.335443+0000","last_undegraded":"2024-08-18T22:19:27.335443+0000","last_fullsized":"2024-08-18T22:19:27.335443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345760+0000","last_change":"2024-08-18T22:19:21.115212+0000","last_active":"2024-08-18T22:19:26.345760+0000","last_peered":"2024-08-18T22:19:26.345760+0000","last_clean":"2024-08-18T22:19:26.345760+0000","last_became_active":"2024-08-18T22:19:21.114910+0000","last_became_peered":"2024-08-18T22:19:21.114910+0000","last_unstale":"2024-08-18T22:19:26.345760+0000","last_undegraded":"2024-08-18T22:19:26.345760+0000","last_fullsized":"2024-08-18T22:19:26.345760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:38.186074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335755+0000","last_change":"2024-08-18T22:19:21.127871+0000","last_active":"2024-08-18T22:19:27.335755+0000","last_peered":"2024-08-18T22:19:27.335755+0000","last_clean":"2024-08-18T22:19:27.335755+0000","last_became_active":"2024-08-18T22:19:21.126869+0000","last_became_peered":"2024-08-18T22:19:21.126869+0000","last_unstale":"2024-08-18T22:19:27.335755+0000","last_undegraded":"2024-08-18T22:19:27.335755+0000","last_fullsized":"2024-08-18T22:19:27.335755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:20.765001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408844+0000","last_change":"2024-08-18T22:19:21.131385+0000","last_active":"2024-08-18T22:19:27.408844+0000","last_peered":"2024-08-18T22:19:27.408844+0000","last_clean":"2024-08-18T22:19:27.408844+0000","last_became_active":"2024-08-18T22:19:21.131082+0000","last_became_peered":"2024-08-18T22:19:21.131082+0000","last_unstale":"2024-08-18T22:19:27.408844+0000","last_undegraded":"2024-08-18T22:19:27.408844+0000","last_fullsized":"2024-08-18T22:19:27.408844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408484+0000","last_change":"2024-08-18T22:19:21.136779+0000","last_active":"2024-08-18T22:19:27.408484+0000","last_peered":"2024-08-18T22:19:27.408484+0000","last_clean":"2024-08-18T22:19:27.408484+0000","last_became_active":"2024-08-18T22:19:21.136340+0000","last_became_peered":"2024-08-18T22:19:21.136340+0000","last_unstale":"2024-08-18T22:19:27.408484+0000","last_undegraded":"2024-08-18T22:19:27.408484+0000","last_fullsized":"2024-08-18T22:19:27.408484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345776+0000","last_change":"2024-08-18T22:19:21.122413+0000","last_active":"2024-08-18T22:19:26.345776+0000","last_peered":"2024-08-18T22:19:26.345776+0000","last_clean":"2024-08-18T22:19:26.345776+0000","last_became_active":"2024-08-18T22:19:21.122038+0000","last_became_peered":"2024-08-18T22:19:21.122038+0000","last_unstale":"2024-08-18T22:19:26.345776+0000","last_undegraded":"2024-08-18T22:19:26.345776+0000","last_fullsized":"2024-08-18T22:19:26.345776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:30:09.265589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":102159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":102229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":693075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:19:42.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:19:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.666+0000 7ff970e00640 1 Processor -- start 2024-08-18T22:19:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff970e00640 1 -- start start 2024-08-18T22:19:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff970e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff96c15bed0 0x7ff96c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff970e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff96c06da70 0x7ff96c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff970e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff96c073c80 con 0x7ff96c0cb390 2024-08-18T22:19:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff970e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff96c06e420 con 0x7ff96c15bed0 2024-08-18T22:19:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff970e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff96c0ca5d0 con 0x7ff96c06da70 2024-08-18T22:19:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff969400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff96c0cb390 0x7ff96c071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37746/0 (socket says 172.21.15.5:37746) 2024-08-18T22:19:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff969400640 1 -- 172.21.15.5:0/685252011 learned_addr learned my addr 172.21.15.5:0/685252011 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff96a800640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff96c06da70 0x7ff96c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff969e00640 1 --2- 172.21.15.5:0/685252011 >> v2:172.21.15.117:3300/0 conn(0x7ff96c15bed0 0x7ff96c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1905013582 0 0) 0x7ff96c073c80 con 0x7ff96c0cb390 2024-08-18T22:19:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff950003530 con 0x7ff96c0cb390 2024-08-18T22:19:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1773755241 0 0) 0x7ff950003530 con 0x7ff96c0cb390 2024-08-18T22:19:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff96c06da70 msgr2=0x7ff96c06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff96c06da70 0x7ff96c06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 >> v2:172.21.15.117:3300/0 conn(0x7ff96c15bed0 msgr2=0x7ff96c0735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 --2- 172.21.15.5:0/685252011 >> v2:172.21.15.117:3300/0 conn(0x7ff96c15bed0 0x7ff96c0735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c0ca8b0 con 0x7ff96c0cb390 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7ff958001680 con 0x7ff96c0cb390 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 >> v1:172.21.15.5:6789/0 conn(0x7ff96c0cb390 legacy=0x7ff96c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9500039c0 0x7ff950003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff950004810 0x7ff950004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9500051d0 0x7ff95000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c06e420 con 0x7ff9500039c0 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c0ca5d0 con 0x7ff950004810 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff95000bf10 con 0x7ff9500051d0 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff96a800640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff96c06da70 0x7ff96c06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff969e00640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9500039c0 0x7ff950003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff969400640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff950004810 0x7ff950004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff96a800640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9500051d0 0x7ff95000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff969e00640 1 -- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9500051d0 msgr2=0x7ff95000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff969e00640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9500051d0 0x7ff95000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff969e00640 1 -- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff950004810 msgr2=0x7ff950004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff969e00640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff950004810 0x7ff950004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.670+0000 7ff969e00640 1 -- 172.21.15.5:0/685252011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff950003530 con 0x7ff9500039c0 2024-08-18T22:19:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.674+0000 7ff969e00640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9500039c0 0x7ff950003de0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009b10 tx=0x7ff95c01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b860b115c6943cad server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.674+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0b2070 con 0x7ff9500039c0 2024-08-18T22:19:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.674+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff95c0a5560 con 0x7ff9500039c0 2024-08-18T22:19:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.674+0000 7ff968a00640 1 -- 172.21.15.5:0/685252011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0096b0 con 0x7ff9500039c0 2024-08-18T22:19:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.674+0000 7ff970e00640 1 -- 172.21.15.5:0/685252011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9500039c0 msgr2=0x7ff950003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.674+0000 7ff970e00640 1 --2- 172.21.15.5:0/685252011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9500039c0 0x7ff950003de0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009b10 tx=0x7ff95c01ca80 comp rx=0 tx=0).stop 2024-08-18T22:19:42.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.674+0000 7ff96a800640 1 -- 172.21.15.5:0/685252011 reap_dead start 2024-08-18T22:19:42.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.674+0000 7ff970e00640 1 -- 172.21.15.5:0/685252011 shutdown_connections 2024-08-18T22:19:42.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.674+0000 7ff970e00640 1 -- 172.21.15.5:0/685252011 >> 172.21.15.5:0/685252011 conn(0x7ff96c0b1c50 msgr2=0x7ff96c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:42.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.674+0000 7ff970e00640 1 -- 172.21.15.5:0/685252011 shutdown_connections 2024-08-18T22:19:42.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.674+0000 7ff970e00640 1 -- 172.21.15.5:0/685252011 wait complete. 2024-08-18T22:19:42.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff970e00640 1 Processor -- start 2024-08-18T22:19:42.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff970e00640 1 -- start start 2024-08-18T22:19:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff970e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9500039c0 0x7ff96c14b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff970e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96c151320 0x7ff96c09b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff970e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0b4ff0 0x7ff96c156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff970e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c166510 con 0x7ff96c0b4ff0 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff970e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c166390 con 0x7ff96c151320 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff970e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff96c166690 con 0x7ff9500039c0 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff96a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0b4ff0 0x7ff96c156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff96a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0b4ff0 0x7ff96c156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45430/0 (socket says 172.21.15.5:45430) 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff96a800640 1 -- 172.21.15.5:0/2148334553 learned_addr learned my addr 172.21.15.5:0/2148334553 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff969400640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96c151320 0x7ff96c09b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff969e00640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9500039c0 0x7ff96c14b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff96a800640 1 -- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9500039c0 msgr2=0x7ff96c14b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff96a800640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9500039c0 0x7ff96c14b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff96a800640 1 -- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96c151320 msgr2=0x7ff96c09b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff96a800640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96c151320 0x7ff96c09b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff96a800640 1 -- 172.21.15.5:0/2148334553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c0b5960 con 0x7ff96c0b4ff0 2024-08-18T22:19:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff969400640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96c151320 0x7ff96c09b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff96a800640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0b4ff0 0x7ff96c156800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0afb70 tx=0x7ff964011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff962000640 1 -- 172.21.15.5:0/2148334553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9640039a0 con 0x7ff96c0b4ff0 2024-08-18T22:19:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff962000640 1 -- 172.21.15.5:0/2148334553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff96401b070 con 0x7ff96c0b4ff0 2024-08-18T22:19:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff962000640 1 -- 172.21.15.5:0/2148334553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff964003b80 con 0x7ff96c0b4ff0 2024-08-18T22:19:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff970e00640 1 -- 172.21.15.5:0/2148334553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96c0b5c40 con 0x7ff96c0b4ff0 2024-08-18T22:19:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff970e00640 1 -- 172.21.15.5:0/2148334553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96c09af70 con 0x7ff96c0b4ff0 2024-08-18T22:19:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.678+0000 7ff970e00640 1 -- 172.21.15.5:0/2148334553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff96c09b170 con 0x7ff96c0b4ff0 2024-08-18T22:19:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.682+0000 7ff962000640 1 -- 172.21.15.5:0/2148334553 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff964004030 con 0x7ff96c0b4ff0 2024-08-18T22:19:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.682+0000 7ff962000640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff94c0678c0 0x7ff94c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.682+0000 7ff962000640 1 -- 172.21.15.5:0/2148334553 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff964086b70 con 0x7ff96c0b4ff0 2024-08-18T22:19:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.682+0000 7ff969e00640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff94c0678c0 0x7ff94c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:42.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.682+0000 7ff969e00640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff94c0678c0 0x7ff94c069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0af000 tx=0x7ff95c0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.686+0000 7ff962000640 1 -- 172.21.15.5:0/2148334553 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff964025020 con 0x7ff96c0b4ff0 2024-08-18T22:19:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.846+0000 7ff970e00640 1 -- 172.21.15.5:0/2148334553 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff96c0735a0 con 0x7ff94c0678c0 2024-08-18T22:19:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.858+0000 7ff962000640 1 -- 172.21.15.5:0/2148334553 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7ff96c0735a0 con 0x7ff94c0678c0 2024-08-18T22:19:42.865 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:19:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.858+0000 7ff970e00640 1 -- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff94c0678c0 msgr2=0x7ff94c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.858+0000 7ff970e00640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff94c0678c0 0x7ff94c069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0af000 tx=0x7ff95c0046d0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.858+0000 7ff970e00640 1 -- 172.21.15.5:0/2148334553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0b4ff0 msgr2=0x7ff96c156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.858+0000 7ff970e00640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0b4ff0 0x7ff96c156800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0afb70 tx=0x7ff964011890 comp rx=0 tx=0).stop 2024-08-18T22:19:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.862+0000 7ff970e00640 1 -- 172.21.15.5:0/2148334553 shutdown_connections 2024-08-18T22:19:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.862+0000 7ff970e00640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff94c0678c0 0x7ff94c069d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.862+0000 7ff970e00640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff96c0b4ff0 0x7ff96c156800 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.862+0000 7ff970e00640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96c151320 0x7ff96c09b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.862+0000 7ff970e00640 1 --2- 172.21.15.5:0/2148334553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9500039c0 0x7ff96c14b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.862+0000 7ff970e00640 1 -- 172.21.15.5:0/2148334553 >> 172.21.15.5:0/2148334553 conn(0x7ff96c0b1c50 msgr2=0x7ff96c0ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.862+0000 7ff970e00640 1 -- 172.21.15.5:0/2148334553 shutdown_connections 2024-08-18T22:19:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:42.862+0000 7ff970e00640 1 -- 172.21.15.5:0/2148334553 wait complete. 2024-08-18T22:19:42.884 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-08-18T22:19:41.622479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231896,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742824,"statfs":{"total":773094113280,"available":772856651776,"internally_reserved":0,"allocated":3317760,"data_stored":2006566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003327"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409284+0000","last_change":"2024-08-18T22:19:20.123479+0000","last_active":"2024-08-18T22:19:27.409284+0000","last_peered":"2024-08-18T22:19:27.409284+0000","last_clean":"2024-08-18T22:19:27.409284+0000","last_became_active":"2024-08-18T22:19:20.122186+0000","last_became_peered":"2024-08-18T22:19:20.122186+0000","last_unstale":"2024-08-18T22:19:27.409284+0000","last_undegraded":"2024-08-18T22:19:27.409284+0000","last_fullsized":"2024-08-18T22:19:27.409284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:43.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040942+0000","last_change":"2024-08-18T22:19:21.129646+0000","last_active":"2024-08-18T22:19:27.040942+0000","last_peered":"2024-08-18T22:19:27.040942+0000","last_clean":"2024-08-18T22:19:27.040942+0000","last_became_active":"2024-08-18T22:19:21.129335+0000","last_became_peered":"2024-08-18T22:19:21.129335+0000","last_unstale":"2024-08-18T22:19:27.040942+0000","last_undegraded":"2024-08-18T22:19:27.040942+0000","last_fullsized":"2024-08-18T22:19:27.040942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:43.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040525+0000","last_change":"2024-08-18T22:19:25.367940+0000","last_active":"2024-08-18T22:19:27.040525+0000","last_peered":"2024-08-18T22:19:27.040525+0000","last_clean":"2024-08-18T22:19:27.040525+0000","last_became_active":"2024-08-18T22:19:25.367535+0000","last_became_peered":"2024-08-18T22:19:25.367535+0000","last_unstale":"2024-08-18T22:19:27.040525+0000","last_undegraded":"2024-08-18T22:19:27.040525+0000","last_fullsized":"2024-08-18T22:19:27.040525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:01.102831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041348+0000","last_change":"2024-08-18T22:19:20.124507+0000","last_active":"2024-08-18T22:19:27.041348+0000","last_peered":"2024-08-18T22:19:27.041348+0000","last_clean":"2024-08-18T22:19:27.041348+0000","last_became_active":"2024-08-18T22:19:20.124250+0000","last_became_peered":"2024-08-18T22:19:20.124250+0000","last_unstale":"2024-08-18T22:19:27.041348+0000","last_undegraded":"2024-08-18T22:19:27.041348+0000","last_fullsized":"2024-08-18T22:19:27.041348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:31.028689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409181+0000","last_change":"2024-08-18T22:19:21.137616+0000","last_active":"2024-08-18T22:19:27.409181+0000","last_peered":"2024-08-18T22:19:27.409181+0000","last_clean":"2024-08-18T22:19:27.409181+0000","last_became_active":"2024-08-18T22:19:21.134380+0000","last_became_peered":"2024-08-18T22:19:21.134380+0000","last_unstale":"2024-08-18T22:19:27.409181+0000","last_undegraded":"2024-08-18T22:19:27.409181+0000","last_fullsized":"2024-08-18T22:19:27.409181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343730+0000","last_change":"2024-08-18T22:19:25.363335+0000","last_active":"2024-08-18T22:19:26.343730+0000","last_peered":"2024-08-18T22:19:26.343730+0000","last_clean":"2024-08-18T22:19:26.343730+0000","last_became_active":"2024-08-18T22:19:25.362888+0000","last_became_peered":"2024-08-18T22:19:25.362888+0000","last_unstale":"2024-08-18T22:19:26.343730+0000","last_undegraded":"2024-08-18T22:19:26.343730+0000","last_fullsized":"2024-08-18T22:19:26.343730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:16.915639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345479+0000","last_change":"2024-08-18T22:19:20.129678+0000","last_active":"2024-08-18T22:19:26.345479+0000","last_peered":"2024-08-18T22:19:26.345479+0000","last_clean":"2024-08-18T22:19:26.345479+0000","last_became_active":"2024-08-18T22:19:20.129372+0000","last_became_peered":"2024-08-18T22:19:20.129372+0000","last_unstale":"2024-08-18T22:19:26.345479+0000","last_undegraded":"2024-08-18T22:19:26.345479+0000","last_fullsized":"2024-08-18T22:19:26.345479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:03.344308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335731+0000","last_change":"2024-08-18T22:19:21.130152+0000","last_active":"2024-08-18T22:19:27.335731+0000","last_peered":"2024-08-18T22:19:27.335731+0000","last_clean":"2024-08-18T22:19:27.335731+0000","last_became_active":"2024-08-18T22:19:21.127248+0000","last_became_peered":"2024-08-18T22:19:21.127248+0000","last_unstale":"2024-08-18T22:19:27.335731+0000","last_undegraded":"2024-08-18T22:19:27.335731+0000","last_fullsized":"2024-08-18T22:19:27.335731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:12.798866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344771+0000","last_change":"2024-08-18T22:19:25.375154+0000","last_active":"2024-08-18T22:19:26.344771+0000","last_peered":"2024-08-18T22:19:26.344771+0000","last_clean":"2024-08-18T22:19:26.344771+0000","last_became_active":"2024-08-18T22:19:25.374828+0000","last_became_peered":"2024-08-18T22:19:25.374828+0000","last_unstale":"2024-08-18T22:19:26.344771+0000","last_undegraded":"2024-08-18T22:19:26.344771+0000","last_fullsized":"2024-08-18T22:19:26.344771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:01.678786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345295+0000","last_change":"2024-08-18T22:19:20.127647+0000","last_active":"2024-08-18T22:19:26.345295+0000","last_peered":"2024-08-18T22:19:26.345295+0000","last_clean":"2024-08-18T22:19:26.345295+0000","last_became_active":"2024-08-18T22:19:20.126923+0000","last_became_peered":"2024-08-18T22:19:20.126923+0000","last_unstale":"2024-08-18T22:19:26.345295+0000","last_undegraded":"2024-08-18T22:19:26.345295+0000","last_fullsized":"2024-08-18T22:19:26.345295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:59:29.190977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335932+0000","last_change":"2024-08-18T22:19:21.115653+0000","last_active":"2024-08-18T22:19:27.335932+0000","last_peered":"2024-08-18T22:19:27.335932+0000","last_clean":"2024-08-18T22:19:27.335932+0000","last_became_active":"2024-08-18T22:19:21.115314+0000","last_became_peered":"2024-08-18T22:19:21.115314+0000","last_unstale":"2024-08-18T22:19:27.335932+0000","last_undegraded":"2024-08-18T22:19:27.335932+0000","last_fullsized":"2024-08-18T22:19:27.335932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:38.186074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344183+0000","last_change":"2024-08-18T22:19:25.371279+0000","last_active":"2024-08-18T22:19:26.344183+0000","last_peered":"2024-08-18T22:19:26.344183+0000","last_clean":"2024-08-18T22:19:26.344183+0000","last_became_active":"2024-08-18T22:19:25.370845+0000","last_became_peered":"2024-08-18T22:19:25.370845+0000","last_unstale":"2024-08-18T22:19:26.344183+0000","last_undegraded":"2024-08-18T22:19:26.344183+0000","last_fullsized":"2024-08-18T22:19:26.344183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:47.906445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342492+0000","last_change":"2024-08-18T22:19:21.117843+0000","last_active":"2024-08-18T22:19:26.342492+0000","last_peered":"2024-08-18T22:19:26.342492+0000","last_clean":"2024-08-18T22:19:26.342492+0000","last_became_active":"2024-08-18T22:19:21.117591+0000","last_became_peered":"2024-08-18T22:19:21.117591+0000","last_unstale":"2024-08-18T22:19:26.342492+0000","last_undegraded":"2024-08-18T22:19:26.342492+0000","last_fullsized":"2024-08-18T22:19:26.342492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345999+0000","last_change":"2024-08-18T22:19:20.130667+0000","last_active":"2024-08-18T22:19:26.345999+0000","last_peered":"2024-08-18T22:19:26.345999+0000","last_clean":"2024-08-18T22:19:26.345999+0000","last_became_active":"2024-08-18T22:19:20.130389+0000","last_became_peered":"2024-08-18T22:19:20.130389+0000","last_unstale":"2024-08-18T22:19:26.345999+0000","last_undegraded":"2024-08-18T22:19:26.345999+0000","last_fullsized":"2024-08-18T22:19:26.345999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:43.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344745+0000","last_change":"2024-08-18T22:19:25.362818+0000","last_active":"2024-08-18T22:19:26.344745+0000","last_peered":"2024-08-18T22:19:26.344745+0000","last_clean":"2024-08-18T22:19:26.344745+0000","last_became_active":"2024-08-18T22:19:25.360791+0000","last_became_peered":"2024-08-18T22:19:25.360791+0000","last_unstale":"2024-08-18T22:19:26.344745+0000","last_undegraded":"2024-08-18T22:19:26.344745+0000","last_fullsized":"2024-08-18T22:19:26.344745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:00.035629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040971+0000","last_change":"2024-08-18T22:19:21.140980+0000","last_active":"2024-08-18T22:19:27.040971+0000","last_peered":"2024-08-18T22:19:27.040971+0000","last_clean":"2024-08-18T22:19:27.040971+0000","last_became_active":"2024-08-18T22:19:21.139771+0000","last_became_peered":"2024-08-18T22:19:21.139771+0000","last_unstale":"2024-08-18T22:19:27.040971+0000","last_undegraded":"2024-08-18T22:19:27.040971+0000","last_fullsized":"2024-08-18T22:19:27.040971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407586+0000","last_change":"2024-08-18T22:19:20.119605+0000","last_active":"2024-08-18T22:19:27.407586+0000","last_peered":"2024-08-18T22:19:27.407586+0000","last_clean":"2024-08-18T22:19:27.407586+0000","last_became_active":"2024-08-18T22:19:20.118664+0000","last_became_peered":"2024-08-18T22:19:20.118664+0000","last_unstale":"2024-08-18T22:19:27.407586+0000","last_undegraded":"2024-08-18T22:19:27.407586+0000","last_fullsized":"2024-08-18T22:19:27.407586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344947+0000","last_change":"2024-08-18T22:19:25.376804+0000","last_active":"2024-08-18T22:19:26.344947+0000","last_peered":"2024-08-18T22:19:26.344947+0000","last_clean":"2024-08-18T22:19:26.344947+0000","last_became_active":"2024-08-18T22:19:25.376401+0000","last_became_peered":"2024-08-18T22:19:25.376401+0000","last_unstale":"2024-08-18T22:19:26.344947+0000","last_undegraded":"2024-08-18T22:19:26.344947+0000","last_fullsized":"2024-08-18T22:19:26.344947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:13.678679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041189+0000","last_change":"2024-08-18T22:19:21.115033+0000","last_active":"2024-08-18T22:19:27.041189+0000","last_peered":"2024-08-18T22:19:27.041189+0000","last_clean":"2024-08-18T22:19:27.041189+0000","last_became_active":"2024-08-18T22:19:21.114665+0000","last_became_peered":"2024-08-18T22:19:21.114665+0000","last_unstale":"2024-08-18T22:19:27.041189+0000","last_undegraded":"2024-08-18T22:19:27.041189+0000","last_fullsized":"2024-08-18T22:19:27.041189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406868+0000","last_change":"2024-08-18T22:19:20.118245+0000","last_active":"2024-08-18T22:19:27.406868+0000","last_peered":"2024-08-18T22:19:27.406868+0000","last_clean":"2024-08-18T22:19:27.406868+0000","last_became_active":"2024-08-18T22:19:20.117739+0000","last_became_peered":"2024-08-18T22:19:20.117739+0000","last_unstale":"2024-08-18T22:19:27.406868+0000","last_undegraded":"2024-08-18T22:19:27.406868+0000","last_fullsized":"2024-08-18T22:19:27.406868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408292+0000","last_change":"2024-08-18T22:19:25.369695+0000","last_active":"2024-08-18T22:19:27.408292+0000","last_peered":"2024-08-18T22:19:27.408292+0000","last_clean":"2024-08-18T22:19:27.408292+0000","last_became_active":"2024-08-18T22:19:25.368337+0000","last_became_peered":"2024-08-18T22:19:25.368337+0000","last_unstale":"2024-08-18T22:19:27.408292+0000","last_undegraded":"2024-08-18T22:19:27.408292+0000","last_fullsized":"2024-08-18T22:19:27.408292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:30.299592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343932+0000","last_change":"2024-08-18T22:19:21.123087+0000","last_active":"2024-08-18T22:19:26.343932+0000","last_peered":"2024-08-18T22:19:26.343932+0000","last_clean":"2024-08-18T22:19:26.343932+0000","last_became_active":"2024-08-18T22:19:21.121880+0000","last_became_peered":"2024-08-18T22:19:21.121880+0000","last_unstale":"2024-08-18T22:19:26.343932+0000","last_undegraded":"2024-08-18T22:19:26.343932+0000","last_fullsized":"2024-08-18T22:19:26.343932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:30.321238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343775+0000","last_change":"2024-08-18T22:19:20.127132+0000","last_active":"2024-08-18T22:19:26.343775+0000","last_peered":"2024-08-18T22:19:26.343775+0000","last_clean":"2024-08-18T22:19:26.343775+0000","last_became_active":"2024-08-18T22:19:20.126546+0000","last_became_peered":"2024-08-18T22:19:20.126546+0000","last_unstale":"2024-08-18T22:19:26.343775+0000","last_undegraded":"2024-08-18T22:19:26.343775+0000","last_fullsized":"2024-08-18T22:19:26.343775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:02.877029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345036+0000","last_change":"2024-08-18T22:19:25.372155+0000","last_active":"2024-08-18T22:19:26.345036+0000","last_peered":"2024-08-18T22:19:26.345036+0000","last_clean":"2024-08-18T22:19:26.345036+0000","last_became_active":"2024-08-18T22:19:25.370185+0000","last_became_peered":"2024-08-18T22:19:25.370185+0000","last_unstale":"2024-08-18T22:19:26.345036+0000","last_undegraded":"2024-08-18T22:19:26.345036+0000","last_fullsized":"2024-08-18T22:19:26.345036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:29:15.122631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409166+0000","last_change":"2024-08-18T22:19:21.132057+0000","last_active":"2024-08-18T22:19:27.409166+0000","last_peered":"2024-08-18T22:19:27.409166+0000","last_clean":"2024-08-18T22:19:27.409166+0000","last_became_active":"2024-08-18T22:19:21.131730+0000","last_became_peered":"2024-08-18T22:19:21.131730+0000","last_unstale":"2024-08-18T22:19:27.409166+0000","last_undegraded":"2024-08-18T22:19:27.409166+0000","last_fullsized":"2024-08-18T22:19:27.409166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344759+0000","last_change":"2024-08-18T22:19:20.124994+0000","last_active":"2024-08-18T22:19:26.344759+0000","last_peered":"2024-08-18T22:19:26.344759+0000","last_clean":"2024-08-18T22:19:26.344759+0000","last_became_active":"2024-08-18T22:19:20.124797+0000","last_became_peered":"2024-08-18T22:19:20.124797+0000","last_unstale":"2024-08-18T22:19:26.344759+0000","last_undegraded":"2024-08-18T22:19:26.344759+0000","last_fullsized":"2024-08-18T22:19:26.344759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343600+0000","last_change":"2024-08-18T22:19:25.359580+0000","last_active":"2024-08-18T22:19:26.343600+0000","last_peered":"2024-08-18T22:19:26.343600+0000","last_clean":"2024-08-18T22:19:26.343600+0000","last_became_active":"2024-08-18T22:19:25.359219+0000","last_became_peered":"2024-08-18T22:19:25.359219+0000","last_unstale":"2024-08-18T22:19:26.343600+0000","last_undegraded":"2024-08-18T22:19:26.343600+0000","last_fullsized":"2024-08-18T22:19:26.343600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:29.463841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041318+0000","last_change":"2024-08-18T22:19:21.121965+0000","last_active":"2024-08-18T22:19:27.041318+0000","last_peered":"2024-08-18T22:19:27.041318+0000","last_clean":"2024-08-18T22:19:27.041318+0000","last_became_active":"2024-08-18T22:19:21.118981+0000","last_became_peered":"2024-08-18T22:19:21.118981+0000","last_unstale":"2024-08-18T22:19:27.041318+0000","last_undegraded":"2024-08-18T22:19:27.041318+0000","last_fullsized":"2024-08-18T22:19:27.041318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408573+0000","last_change":"2024-08-18T22:19:20.127044+0000","last_active":"2024-08-18T22:19:27.408573+0000","last_peered":"2024-08-18T22:19:27.408573+0000","last_clean":"2024-08-18T22:19:27.408573+0000","last_became_active":"2024-08-18T22:19:20.126773+0000","last_became_peered":"2024-08-18T22:19:20.126773+0000","last_unstale":"2024-08-18T22:19:27.408573+0000","last_undegraded":"2024-08-18T22:19:27.408573+0000","last_fullsized":"2024-08-18T22:19:27.408573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040518+0000","last_change":"2024-08-18T22:19:25.365151+0000","last_active":"2024-08-18T22:19:27.040518+0000","last_peered":"2024-08-18T22:19:27.040518+0000","last_clean":"2024-08-18T22:19:27.040518+0000","last_became_active":"2024-08-18T22:19:25.364683+0000","last_became_peered":"2024-08-18T22:19:25.364683+0000","last_unstale":"2024-08-18T22:19:27.040518+0000","last_undegraded":"2024-08-18T22:19:27.040518+0000","last_fullsized":"2024-08-18T22:19:27.040518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:28.640280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407867+0000","last_change":"2024-08-18T22:19:21.113379+0000","last_active":"2024-08-18T22:19:27.407867+0000","last_peered":"2024-08-18T22:19:27.407867+0000","last_clean":"2024-08-18T22:19:27.407867+0000","last_became_active":"2024-08-18T22:19:21.113086+0000","last_became_peered":"2024-08-18T22:19:21.113086+0000","last_unstale":"2024-08-18T22:19:27.407867+0000","last_undegraded":"2024-08-18T22:19:27.407867+0000","last_fullsized":"2024-08-18T22:19:27.407867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345595+0000","last_change":"2024-08-18T22:19:20.130493+0000","last_active":"2024-08-18T22:19:26.345595+0000","last_peered":"2024-08-18T22:19:26.345595+0000","last_clean":"2024-08-18T22:19:26.345595+0000","last_became_active":"2024-08-18T22:19:20.130161+0000","last_became_peered":"2024-08-18T22:19:20.130161+0000","last_unstale":"2024-08-18T22:19:26.345595+0000","last_undegraded":"2024-08-18T22:19:26.345595+0000","last_fullsized":"2024-08-18T22:19:26.345595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:13.130477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408499+0000","last_change":"2024-08-18T22:19:25.375977+0000","last_active":"2024-08-18T22:19:27.408499+0000","last_peered":"2024-08-18T22:19:27.408499+0000","last_clean":"2024-08-18T22:19:27.408499+0000","last_became_active":"2024-08-18T22:19:25.366619+0000","last_became_peered":"2024-08-18T22:19:25.366619+0000","last_unstale":"2024-08-18T22:19:27.408499+0000","last_undegraded":"2024-08-18T22:19:27.408499+0000","last_fullsized":"2024-08-18T22:19:27.408499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:25.001121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336042+0000","last_change":"2024-08-18T22:19:21.126649+0000","last_active":"2024-08-18T22:19:27.336042+0000","last_peered":"2024-08-18T22:19:27.336042+0000","last_clean":"2024-08-18T22:19:27.336042+0000","last_became_active":"2024-08-18T22:19:21.125045+0000","last_became_peered":"2024-08-18T22:19:21.125045+0000","last_unstale":"2024-08-18T22:19:27.336042+0000","last_undegraded":"2024-08-18T22:19:27.336042+0000","last_fullsized":"2024-08-18T22:19:27.336042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:10.870419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407965+0000","last_change":"2024-08-18T22:19:20.113605+0000","last_active":"2024-08-18T22:19:27.407965+0000","last_peered":"2024-08-18T22:19:27.407965+0000","last_clean":"2024-08-18T22:19:27.407965+0000","last_became_active":"2024-08-18T22:19:20.113312+0000","last_became_peered":"2024-08-18T22:19:20.113312+0000","last_unstale":"2024-08-18T22:19:27.407965+0000","last_undegraded":"2024-08-18T22:19:27.407965+0000","last_fullsized":"2024-08-18T22:19:27.407965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407154+0000","last_change":"2024-08-18T22:19:25.379602+0000","last_active":"2024-08-18T22:19:27.407154+0000","last_peered":"2024-08-18T22:19:27.407154+0000","last_clean":"2024-08-18T22:19:27.407154+0000","last_became_active":"2024-08-18T22:19:25.379233+0000","last_became_peered":"2024-08-18T22:19:25.379233+0000","last_unstale":"2024-08-18T22:19:27.407154+0000","last_undegraded":"2024-08-18T22:19:27.407154+0000","last_fullsized":"2024-08-18T22:19:27.407154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:49.056286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344921+0000","last_change":"2024-08-18T22:19:21.137261+0000","last_active":"2024-08-18T22:19:26.344921+0000","last_peered":"2024-08-18T22:19:26.344921+0000","last_clean":"2024-08-18T22:19:26.344921+0000","last_became_active":"2024-08-18T22:19:21.137007+0000","last_became_peered":"2024-08-18T22:19:21.137007+0000","last_unstale":"2024-08-18T22:19:26.344921+0000","last_undegraded":"2024-08-18T22:19:26.344921+0000","last_fullsized":"2024-08-18T22:19:26.344921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:14.978071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335848+0000","last_change":"2024-08-18T22:19:20.118663+0000","last_active":"2024-08-18T22:19:27.335848+0000","last_peered":"2024-08-18T22:19:27.335848+0000","last_clean":"2024-08-18T22:19:27.335848+0000","last_became_active":"2024-08-18T22:19:20.118041+0000","last_became_peered":"2024-08-18T22:19:20.118041+0000","last_unstale":"2024-08-18T22:19:27.335848+0000","last_undegraded":"2024-08-18T22:19:27.335848+0000","last_fullsized":"2024-08-18T22:19:27.335848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407962+0000","last_change":"2024-08-18T22:19:25.375614+0000","last_active":"2024-08-18T22:19:27.407962+0000","last_peered":"2024-08-18T22:19:27.407962+0000","last_clean":"2024-08-18T22:19:27.407962+0000","last_became_active":"2024-08-18T22:19:25.374263+0000","last_became_peered":"2024-08-18T22:19:25.374263+0000","last_unstale":"2024-08-18T22:19:27.407962+0000","last_undegraded":"2024-08-18T22:19:27.407962+0000","last_fullsized":"2024-08-18T22:19:27.407962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:42.422194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406686+0000","last_change":"2024-08-18T22:19:21.110718+0000","last_active":"2024-08-18T22:19:27.406686+0000","last_peered":"2024-08-18T22:19:27.406686+0000","last_clean":"2024-08-18T22:19:27.406686+0000","last_became_active":"2024-08-18T22:19:21.110328+0000","last_became_peered":"2024-08-18T22:19:21.110328+0000","last_unstale":"2024-08-18T22:19:27.406686+0000","last_undegraded":"2024-08-18T22:19:27.406686+0000","last_fullsized":"2024-08-18T22:19:27.406686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406673+0000","last_change":"2024-08-18T22:19:20.110735+0000","last_active":"2024-08-18T22:19:27.406673+0000","last_peered":"2024-08-18T22:19:27.406673+0000","last_clean":"2024-08-18T22:19:27.406673+0000","last_became_active":"2024-08-18T22:19:20.110382+0000","last_became_peered":"2024-08-18T22:19:20.110382+0000","last_unstale":"2024-08-18T22:19:27.406673+0000","last_undegraded":"2024-08-18T22:19:27.406673+0000","last_fullsized":"2024-08-18T22:19:27.406673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:54.714769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408376+0000","last_change":"2024-08-18T22:19:25.374139+0000","last_active":"2024-08-18T22:19:27.408376+0000","last_peered":"2024-08-18T22:19:27.408376+0000","last_clean":"2024-08-18T22:19:27.408376+0000","last_became_active":"2024-08-18T22:19:25.373712+0000","last_became_peered":"2024-08-18T22:19:25.373712+0000","last_unstale":"2024-08-18T22:19:27.408376+0000","last_undegraded":"2024-08-18T22:19:27.408376+0000","last_fullsized":"2024-08-18T22:19:27.408376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:15.106539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407992+0000","last_change":"2024-08-18T22:19:21.134091+0000","last_active":"2024-08-18T22:19:27.407992+0000","last_peered":"2024-08-18T22:19:27.407992+0000","last_clean":"2024-08-18T22:19:27.407992+0000","last_became_active":"2024-08-18T22:19:21.133674+0000","last_became_peered":"2024-08-18T22:19:21.133674+0000","last_unstale":"2024-08-18T22:19:27.407992+0000","last_undegraded":"2024-08-18T22:19:27.407992+0000","last_fullsized":"2024-08-18T22:19:27.407992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:42:36.740493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343883+0000","last_change":"2024-08-18T22:19:20.125876+0000","last_active":"2024-08-18T22:19:26.343883+0000","last_peered":"2024-08-18T22:19:26.343883+0000","last_clean":"2024-08-18T22:19:26.343883+0000","last_became_active":"2024-08-18T22:19:20.125594+0000","last_became_peered":"2024-08-18T22:19:20.125594+0000","last_unstale":"2024-08-18T22:19:26.343883+0000","last_undegraded":"2024-08-18T22:19:26.343883+0000","last_fullsized":"2024-08-18T22:19:26.343883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:35:24.581822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409117+0000","last_change":"2024-08-18T22:19:25.366073+0000","last_active":"2024-08-18T22:19:27.409117+0000","last_peered":"2024-08-18T22:19:27.409117+0000","last_clean":"2024-08-18T22:19:27.409117+0000","last_became_active":"2024-08-18T22:19:25.364486+0000","last_became_peered":"2024-08-18T22:19:25.364486+0000","last_unstale":"2024-08-18T22:19:27.409117+0000","last_undegraded":"2024-08-18T22:19:27.409117+0000","last_fullsized":"2024-08-18T22:19:27.409117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:54.372527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040730+0000","last_change":"2024-08-18T22:19:21.126426+0000","last_active":"2024-08-18T22:19:27.040730+0000","last_peered":"2024-08-18T22:19:27.040730+0000","last_clean":"2024-08-18T22:19:27.040730+0000","last_became_active":"2024-08-18T22:19:21.126155+0000","last_became_peered":"2024-08-18T22:19:21.126155+0000","last_unstale":"2024-08-18T22:19:27.040730+0000","last_undegraded":"2024-08-18T22:19:27.040730+0000","last_fullsized":"2024-08-18T22:19:27.040730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:12.798866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335635+0000","last_change":"2024-08-18T22:19:20.120813+0000","last_active":"2024-08-18T22:19:27.335635+0000","last_peered":"2024-08-18T22:19:27.335635+0000","last_clean":"2024-08-18T22:19:27.335635+0000","last_became_active":"2024-08-18T22:19:20.120520+0000","last_became_peered":"2024-08-18T22:19:20.120520+0000","last_unstale":"2024-08-18T22:19:27.335635+0000","last_undegraded":"2024-08-18T22:19:27.335635+0000","last_fullsized":"2024-08-18T22:19:27.335635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343987+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:19:26.343987+0000","last_peered":"2024-08-18T22:19:26.343987+0000","last_clean":"2024-08-18T22:19:26.343987+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:19:26.343987+0000","last_undegraded":"2024-08-18T22:19:26.343987+0000","last_fullsized":"2024-08-18T22:19:26.343987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343553+0000","last_change":"2024-08-18T22:19:25.358088+0000","last_active":"2024-08-18T22:19:26.343553+0000","last_peered":"2024-08-18T22:19:26.343553+0000","last_clean":"2024-08-18T22:19:26.343553+0000","last_became_active":"2024-08-18T22:19:25.357741+0000","last_became_peered":"2024-08-18T22:19:25.357741+0000","last_unstale":"2024-08-18T22:19:26.343553+0000","last_undegraded":"2024-08-18T22:19:26.343553+0000","last_fullsized":"2024-08-18T22:19:26.343553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:12.001219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345357+0000","last_change":"2024-08-18T22:19:21.115625+0000","last_active":"2024-08-18T22:19:26.345357+0000","last_peered":"2024-08-18T22:19:26.345357+0000","last_clean":"2024-08-18T22:19:26.345357+0000","last_became_active":"2024-08-18T22:19:21.113832+0000","last_became_peered":"2024-08-18T22:19:21.113832+0000","last_unstale":"2024-08-18T22:19:26.345357+0000","last_undegraded":"2024-08-18T22:19:26.345357+0000","last_fullsized":"2024-08-18T22:19:26.345357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:07.765099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407470+0000","last_change":"2024-08-18T22:19:20.114087+0000","last_active":"2024-08-18T22:19:27.407470+0000","last_peered":"2024-08-18T22:19:27.407470+0000","last_clean":"2024-08-18T22:19:27.407470+0000","last_became_active":"2024-08-18T22:19:20.113655+0000","last_became_peered":"2024-08-18T22:19:20.113655+0000","last_unstale":"2024-08-18T22:19:27.407470+0000","last_undegraded":"2024-08-18T22:19:27.407470+0000","last_fullsized":"2024-08-18T22:19:27.407470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:31:21.374246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342469+0000","last_change":"2024-08-18T22:19:25.362833+0000","last_active":"2024-08-18T22:19:26.342469+0000","last_peered":"2024-08-18T22:19:26.342469+0000","last_clean":"2024-08-18T22:19:26.342469+0000","last_became_active":"2024-08-18T22:19:25.362232+0000","last_became_peered":"2024-08-18T22:19:25.362232+0000","last_unstale":"2024-08-18T22:19:26.342469+0000","last_undegraded":"2024-08-18T22:19:26.342469+0000","last_fullsized":"2024-08-18T22:19:26.342469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:10.830493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335872+0000","last_change":"2024-08-18T22:19:21.127671+0000","last_active":"2024-08-18T22:19:27.335872+0000","last_peered":"2024-08-18T22:19:27.335872+0000","last_clean":"2024-08-18T22:19:27.335872+0000","last_became_active":"2024-08-18T22:19:21.124718+0000","last_became_peered":"2024-08-18T22:19:21.124718+0000","last_unstale":"2024-08-18T22:19:27.335872+0000","last_undegraded":"2024-08-18T22:19:27.335872+0000","last_fullsized":"2024-08-18T22:19:27.335872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:07.765099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408089+0000","last_change":"2024-08-18T22:19:20.109318+0000","last_active":"2024-08-18T22:19:27.408089+0000","last_peered":"2024-08-18T22:19:27.408089+0000","last_clean":"2024-08-18T22:19:27.408089+0000","last_became_active":"2024-08-18T22:19:20.108894+0000","last_became_peered":"2024-08-18T22:19:20.108894+0000","last_unstale":"2024-08-18T22:19:27.408089+0000","last_undegraded":"2024-08-18T22:19:27.408089+0000","last_fullsized":"2024-08-18T22:19:27.408089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408668+0000","last_change":"2024-08-18T22:19:25.372355+0000","last_active":"2024-08-18T22:19:27.408668+0000","last_peered":"2024-08-18T22:19:27.408668+0000","last_clean":"2024-08-18T22:19:27.408668+0000","last_became_active":"2024-08-18T22:19:25.365235+0000","last_became_peered":"2024-08-18T22:19:25.365235+0000","last_unstale":"2024-08-18T22:19:27.408668+0000","last_undegraded":"2024-08-18T22:19:27.408668+0000","last_fullsized":"2024-08-18T22:19:27.408668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:42.422194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345949+0000","last_change":"2024-08-18T22:19:21.114675+0000","last_active":"2024-08-18T22:19:26.345949+0000","last_peered":"2024-08-18T22:19:26.345949+0000","last_clean":"2024-08-18T22:19:26.345949+0000","last_became_active":"2024-08-18T22:19:21.114251+0000","last_became_peered":"2024-08-18T22:19:21.114251+0000","last_unstale":"2024-08-18T22:19:26.345949+0000","last_undegraded":"2024-08-18T22:19:26.345949+0000","last_fullsized":"2024-08-18T22:19:26.345949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:24.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408143+0000","last_change":"2024-08-18T22:19:20.112330+0000","last_active":"2024-08-18T22:19:27.408143+0000","last_peered":"2024-08-18T22:19:27.408143+0000","last_clean":"2024-08-18T22:19:27.408143+0000","last_became_active":"2024-08-18T22:19:20.110530+0000","last_became_peered":"2024-08-18T22:19:20.110530+0000","last_unstale":"2024-08-18T22:19:27.408143+0000","last_undegraded":"2024-08-18T22:19:27.408143+0000","last_fullsized":"2024-08-18T22:19:27.408143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:18.857333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335519+0000","last_change":"2024-08-18T22:19:25.363810+0000","last_active":"2024-08-18T22:19:27.335519+0000","last_peered":"2024-08-18T22:19:27.335519+0000","last_clean":"2024-08-18T22:19:27.335519+0000","last_became_active":"2024-08-18T22:19:25.363407+0000","last_became_peered":"2024-08-18T22:19:25.363407+0000","last_unstale":"2024-08-18T22:19:27.335519+0000","last_undegraded":"2024-08-18T22:19:27.335519+0000","last_fullsized":"2024-08-18T22:19:27.335519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:28.640280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345615+0000","last_change":"2024-08-18T22:19:21.114404+0000","last_active":"2024-08-18T22:19:26.345615+0000","last_peered":"2024-08-18T22:19:26.345615+0000","last_clean":"2024-08-18T22:19:26.345615+0000","last_became_active":"2024-08-18T22:19:21.114109+0000","last_became_peered":"2024-08-18T22:19:21.114109+0000","last_unstale":"2024-08-18T22:19:26.345615+0000","last_undegraded":"2024-08-18T22:19:26.345615+0000","last_fullsized":"2024-08-18T22:19:26.345615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:50.136407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345199+0000","last_change":"2024-08-18T22:19:20.122497+0000","last_active":"2024-08-18T22:19:26.345199+0000","last_peered":"2024-08-18T22:19:26.345199+0000","last_clean":"2024-08-18T22:19:26.345199+0000","last_became_active":"2024-08-18T22:19:20.120755+0000","last_became_peered":"2024-08-18T22:19:20.120755+0000","last_unstale":"2024-08-18T22:19:26.345199+0000","last_undegraded":"2024-08-18T22:19:26.345199+0000","last_fullsized":"2024-08-18T22:19:26.345199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:29.746429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343340+0000","last_change":"2024-08-18T22:19:25.365173+0000","last_active":"2024-08-18T22:19:26.343340+0000","last_peered":"2024-08-18T22:19:26.343340+0000","last_clean":"2024-08-18T22:19:26.343340+0000","last_became_active":"2024-08-18T22:19:25.364765+0000","last_became_peered":"2024-08-18T22:19:25.364765+0000","last_unstale":"2024-08-18T22:19:26.343340+0000","last_undegraded":"2024-08-18T22:19:26.343340+0000","last_fullsized":"2024-08-18T22:19:26.343340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:28:02.302944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344594+0000","last_change":"2024-08-18T22:19:21.114669+0000","last_active":"2024-08-18T22:19:26.344594+0000","last_peered":"2024-08-18T22:19:26.344594+0000","last_clean":"2024-08-18T22:19:26.344594+0000","last_became_active":"2024-08-18T22:19:21.114275+0000","last_became_peered":"2024-08-18T22:19:21.114275+0000","last_unstale":"2024-08-18T22:19:26.344594+0000","last_undegraded":"2024-08-18T22:19:26.344594+0000","last_fullsized":"2024-08-18T22:19:26.344594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:26.063472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406470+0000","last_change":"2024-08-18T22:19:20.109986+0000","last_active":"2024-08-18T22:19:27.406470+0000","last_peered":"2024-08-18T22:19:27.406470+0000","last_clean":"2024-08-18T22:19:27.406470+0000","last_became_active":"2024-08-18T22:19:20.109629+0000","last_became_peered":"2024-08-18T22:19:20.109629+0000","last_unstale":"2024-08-18T22:19:27.406470+0000","last_undegraded":"2024-08-18T22:19:27.406470+0000","last_fullsized":"2024-08-18T22:19:27.406470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:41.309073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408961+0000","last_change":"2024-08-18T22:19:25.369993+0000","last_active":"2024-08-18T22:19:27.408961+0000","last_peered":"2024-08-18T22:19:27.408961+0000","last_clean":"2024-08-18T22:19:27.408961+0000","last_became_active":"2024-08-18T22:19:25.369546+0000","last_became_peered":"2024-08-18T22:19:25.369546+0000","last_unstale":"2024-08-18T22:19:27.408961+0000","last_undegraded":"2024-08-18T22:19:27.408961+0000","last_fullsized":"2024-08-18T22:19:27.408961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:15.106539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342013+0000","last_change":"2024-08-18T22:19:21.136153+0000","last_active":"2024-08-18T22:19:26.342013+0000","last_peered":"2024-08-18T22:19:26.342013+0000","last_clean":"2024-08-18T22:19:26.342013+0000","last_became_active":"2024-08-18T22:19:21.135862+0000","last_became_peered":"2024-08-18T22:19:21.135862+0000","last_unstale":"2024-08-18T22:19:26.342013+0000","last_undegraded":"2024-08-18T22:19:26.342013+0000","last_fullsized":"2024-08-18T22:19:26.342013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342398+0000","last_change":"2024-08-18T22:19:20.119295+0000","last_active":"2024-08-18T22:19:26.342398+0000","last_peered":"2024-08-18T22:19:26.342398+0000","last_clean":"2024-08-18T22:19:26.342398+0000","last_became_active":"2024-08-18T22:19:20.118960+0000","last_became_peered":"2024-08-18T22:19:20.118960+0000","last_unstale":"2024-08-18T22:19:26.342398+0000","last_undegraded":"2024-08-18T22:19:26.342398+0000","last_fullsized":"2024-08-18T22:19:26.342398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041372+0000","last_change":"2024-08-18T22:19:25.384579+0000","last_active":"2024-08-18T22:19:27.041372+0000","last_peered":"2024-08-18T22:19:27.041372+0000","last_clean":"2024-08-18T22:19:27.041372+0000","last_became_active":"2024-08-18T22:19:25.384216+0000","last_became_peered":"2024-08-18T22:19:25.384216+0000","last_unstale":"2024-08-18T22:19:27.041372+0000","last_undegraded":"2024-08-18T22:19:27.041372+0000","last_fullsized":"2024-08-18T22:19:27.041372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:56.704905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345875+0000","last_change":"2024-08-18T22:19:21.115242+0000","last_active":"2024-08-18T22:19:26.345875+0000","last_peered":"2024-08-18T22:19:26.345875+0000","last_clean":"2024-08-18T22:19:26.345875+0000","last_became_active":"2024-08-18T22:19:21.114992+0000","last_became_peered":"2024-08-18T22:19:21.114992+0000","last_unstale":"2024-08-18T22:19:26.345875+0000","last_undegraded":"2024-08-18T22:19:26.345875+0000","last_fullsized":"2024-08-18T22:19:26.345875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:20.765001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335813+0000","last_change":"2024-08-18T22:19:20.122264+0000","last_active":"2024-08-18T22:19:27.335813+0000","last_peered":"2024-08-18T22:19:27.335813+0000","last_clean":"2024-08-18T22:19:27.335813+0000","last_became_active":"2024-08-18T22:19:20.121940+0000","last_became_peered":"2024-08-18T22:19:20.121940+0000","last_unstale":"2024-08-18T22:19:27.335813+0000","last_undegraded":"2024-08-18T22:19:27.335813+0000","last_fullsized":"2024-08-18T22:19:27.335813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041119+0000","last_change":"2024-08-18T22:19:25.382796+0000","last_active":"2024-08-18T22:19:27.041119+0000","last_peered":"2024-08-18T22:19:27.041119+0000","last_clean":"2024-08-18T22:19:27.041119+0000","last_became_active":"2024-08-18T22:19:25.382015+0000","last_became_peered":"2024-08-18T22:19:25.382015+0000","last_unstale":"2024-08-18T22:19:27.041119+0000","last_undegraded":"2024-08-18T22:19:27.041119+0000","last_fullsized":"2024-08-18T22:19:27.041119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:13:06.606276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408452+0000","last_change":"2024-08-18T22:19:21.124994+0000","last_active":"2024-08-18T22:19:27.408452+0000","last_peered":"2024-08-18T22:19:27.408452+0000","last_clean":"2024-08-18T22:19:27.408452+0000","last_became_active":"2024-08-18T22:19:21.124714+0000","last_became_peered":"2024-08-18T22:19:21.124714+0000","last_unstale":"2024-08-18T22:19:27.408452+0000","last_undegraded":"2024-08-18T22:19:27.408452+0000","last_fullsized":"2024-08-18T22:19:27.408452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408670+0000","last_change":"2024-08-18T22:19:20.117524+0000","last_active":"2024-08-18T22:19:27.408670+0000","last_peered":"2024-08-18T22:19:27.408670+0000","last_clean":"2024-08-18T22:19:27.408670+0000","last_became_active":"2024-08-18T22:19:20.117271+0000","last_became_peered":"2024-08-18T22:19:20.117271+0000","last_unstale":"2024-08-18T22:19:27.408670+0000","last_undegraded":"2024-08-18T22:19:27.408670+0000","last_fullsized":"2024-08-18T22:19:27.408670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336048+0000","last_change":"2024-08-18T22:19:25.364903+0000","last_active":"2024-08-18T22:19:27.336048+0000","last_peered":"2024-08-18T22:19:27.336048+0000","last_clean":"2024-08-18T22:19:27.336048+0000","last_became_active":"2024-08-18T22:19:25.364491+0000","last_became_peered":"2024-08-18T22:19:25.364491+0000","last_unstale":"2024-08-18T22:19:27.336048+0000","last_undegraded":"2024-08-18T22:19:27.336048+0000","last_fullsized":"2024-08-18T22:19:27.336048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:01.102831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345257+0000","last_change":"2024-08-18T22:19:21.122735+0000","last_active":"2024-08-18T22:19:26.345257+0000","last_peered":"2024-08-18T22:19:26.345257+0000","last_clean":"2024-08-18T22:19:26.345257+0000","last_became_active":"2024-08-18T22:19:21.122489+0000","last_became_peered":"2024-08-18T22:19:21.122489+0000","last_unstale":"2024-08-18T22:19:26.345257+0000","last_undegraded":"2024-08-18T22:19:26.345257+0000","last_fullsized":"2024-08-18T22:19:26.345257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:44.820166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:32.234207+0000","last_change":"2024-08-18T22:19:20.121780+0000","last_active":"2024-08-18T22:19:32.234207+0000","last_peered":"2024-08-18T22:19:32.234207+0000","last_clean":"2024-08-18T22:19:32.234207+0000","last_became_active":"2024-08-18T22:19:20.121504+0000","last_became_peered":"2024-08-18T22:19:20.121504+0000","last_unstale":"2024-08-18T22:19:32.234207+0000","last_undegraded":"2024-08-18T22:19:32.234207+0000","last_fullsized":"2024-08-18T22:19:32.234207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407423+0000","last_change":"2024-08-18T22:19:25.380704+0000","last_active":"2024-08-18T22:19:27.407423+0000","last_peered":"2024-08-18T22:19:27.407423+0000","last_clean":"2024-08-18T22:19:27.407423+0000","last_became_active":"2024-08-18T22:19:25.380338+0000","last_became_peered":"2024-08-18T22:19:25.380338+0000","last_unstale":"2024-08-18T22:19:27.407423+0000","last_undegraded":"2024-08-18T22:19:27.407423+0000","last_fullsized":"2024-08-18T22:19:27.407423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:25.001121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345049+0000","last_change":"2024-08-18T22:19:21.105768+0000","last_active":"2024-08-18T22:19:26.345049+0000","last_peered":"2024-08-18T22:19:26.345049+0000","last_clean":"2024-08-18T22:19:26.345049+0000","last_became_active":"2024-08-18T22:19:21.105461+0000","last_became_peered":"2024-08-18T22:19:21.105461+0000","last_unstale":"2024-08-18T22:19:26.345049+0000","last_undegraded":"2024-08-18T22:19:26.345049+0000","last_fullsized":"2024-08-18T22:19:26.345049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:32.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407990+0000","last_change":"2024-08-18T22:19:20.122400+0000","last_active":"2024-08-18T22:19:27.407990+0000","last_peered":"2024-08-18T22:19:27.407990+0000","last_clean":"2024-08-18T22:19:27.407990+0000","last_became_active":"2024-08-18T22:19:20.121947+0000","last_became_peered":"2024-08-18T22:19:20.121947+0000","last_unstale":"2024-08-18T22:19:27.407990+0000","last_undegraded":"2024-08-18T22:19:27.407990+0000","last_fullsized":"2024-08-18T22:19:27.407990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:02.877029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344547+0000","last_change":"2024-08-18T22:19:25.372065+0000","last_active":"2024-08-18T22:19:26.344547+0000","last_peered":"2024-08-18T22:19:26.344547+0000","last_clean":"2024-08-18T22:19:26.344547+0000","last_became_active":"2024-08-18T22:19:25.371835+0000","last_became_peered":"2024-08-18T22:19:25.371835+0000","last_unstale":"2024-08-18T22:19:26.344547+0000","last_undegraded":"2024-08-18T22:19:26.344547+0000","last_fullsized":"2024-08-18T22:19:26.344547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:04:21.012114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409247+0000","last_change":"2024-08-18T22:19:21.138068+0000","last_active":"2024-08-18T22:19:27.409247+0000","last_peered":"2024-08-18T22:19:27.409247+0000","last_clean":"2024-08-18T22:19:27.409247+0000","last_became_active":"2024-08-18T22:19:21.132915+0000","last_became_peered":"2024-08-18T22:19:21.132915+0000","last_unstale":"2024-08-18T22:19:27.409247+0000","last_undegraded":"2024-08-18T22:19:27.409247+0000","last_fullsized":"2024-08-18T22:19:27.409247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336025+0000","last_change":"2024-08-18T22:19:20.127698+0000","last_active":"2024-08-18T22:19:27.336025+0000","last_peered":"2024-08-18T22:19:27.336025+0000","last_clean":"2024-08-18T22:19:27.336025+0000","last_became_active":"2024-08-18T22:19:20.127488+0000","last_became_peered":"2024-08-18T22:19:20.127488+0000","last_unstale":"2024-08-18T22:19:27.336025+0000","last_undegraded":"2024-08-18T22:19:27.336025+0000","last_fullsized":"2024-08-18T22:19:27.336025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041133+0000","last_change":"2024-08-18T22:19:25.365048+0000","last_active":"2024-08-18T22:19:27.041133+0000","last_peered":"2024-08-18T22:19:27.041133+0000","last_clean":"2024-08-18T22:19:27.041133+0000","last_became_active":"2024-08-18T22:19:25.364597+0000","last_became_peered":"2024-08-18T22:19:25.364597+0000","last_unstale":"2024-08-18T22:19:27.041133+0000","last_undegraded":"2024-08-18T22:19:27.041133+0000","last_fullsized":"2024-08-18T22:19:27.041133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:37.692476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336018+0000","last_change":"2024-08-18T22:19:21.130941+0000","last_active":"2024-08-18T22:19:27.336018+0000","last_peered":"2024-08-18T22:19:27.336018+0000","last_clean":"2024-08-18T22:19:27.336018+0000","last_became_active":"2024-08-18T22:19:21.130617+0000","last_became_peered":"2024-08-18T22:19:21.130617+0000","last_unstale":"2024-08-18T22:19:27.336018+0000","last_undegraded":"2024-08-18T22:19:27.336018+0000","last_fullsized":"2024-08-18T22:19:27.336018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:06.594373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344569+0000","last_change":"2024-08-18T22:19:20.124348+0000","last_active":"2024-08-18T22:19:26.344569+0000","last_peered":"2024-08-18T22:19:26.344569+0000","last_clean":"2024-08-18T22:19:26.344569+0000","last_became_active":"2024-08-18T22:19:20.123971+0000","last_became_peered":"2024-08-18T22:19:20.123971+0000","last_unstale":"2024-08-18T22:19:26.344569+0000","last_undegraded":"2024-08-18T22:19:26.344569+0000","last_fullsized":"2024-08-18T22:19:26.344569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041200+0000","last_change":"2024-08-18T22:19:25.364746+0000","last_active":"2024-08-18T22:19:27.041200+0000","last_peered":"2024-08-18T22:19:27.041200+0000","last_clean":"2024-08-18T22:19:27.041200+0000","last_became_active":"2024-08-18T22:19:25.364332+0000","last_became_peered":"2024-08-18T22:19:25.364332+0000","last_unstale":"2024-08-18T22:19:27.041200+0000","last_undegraded":"2024-08-18T22:19:27.041200+0000","last_fullsized":"2024-08-18T22:19:27.041200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:13.150322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408896+0000","last_change":"2024-08-18T22:19:25.380247+0000","last_active":"2024-08-18T22:19:27.408896+0000","last_peered":"2024-08-18T22:19:27.408896+0000","last_clean":"2024-08-18T22:19:27.408896+0000","last_became_active":"2024-08-18T22:19:25.376751+0000","last_became_peered":"2024-08-18T22:19:25.376751+0000","last_unstale":"2024-08-18T22:19:27.408896+0000","last_undegraded":"2024-08-18T22:19:27.408896+0000","last_fullsized":"2024-08-18T22:19:27.408896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:30.299592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406771+0000","last_change":"2024-08-18T22:19:21.118219+0000","last_active":"2024-08-18T22:19:27.406771+0000","last_peered":"2024-08-18T22:19:27.406771+0000","last_clean":"2024-08-18T22:19:27.406771+0000","last_became_active":"2024-08-18T22:19:21.117904+0000","last_became_peered":"2024-08-18T22:19:21.117904+0000","last_unstale":"2024-08-18T22:19:27.406771+0000","last_undegraded":"2024-08-18T22:19:27.406771+0000","last_fullsized":"2024-08-18T22:19:27.406771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335657+0000","last_change":"2024-08-18T22:19:20.113456+0000","last_active":"2024-08-18T22:19:27.335657+0000","last_peered":"2024-08-18T22:19:27.335657+0000","last_clean":"2024-08-18T22:19:27.335657+0000","last_became_active":"2024-08-18T22:19:20.113170+0000","last_became_peered":"2024-08-18T22:19:20.113170+0000","last_unstale":"2024-08-18T22:19:27.335657+0000","last_undegraded":"2024-08-18T22:19:27.335657+0000","last_fullsized":"2024-08-18T22:19:27.335657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344445+0000","last_change":"2024-08-18T22:19:25.362236+0000","last_active":"2024-08-18T22:19:26.344445+0000","last_peered":"2024-08-18T22:19:26.344445+0000","last_clean":"2024-08-18T22:19:26.344445+0000","last_became_active":"2024-08-18T22:19:25.361968+0000","last_became_peered":"2024-08-18T22:19:25.361968+0000","last_unstale":"2024-08-18T22:19:26.344445+0000","last_undegraded":"2024-08-18T22:19:26.344445+0000","last_fullsized":"2024-08-18T22:19:26.344445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:49.056286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040927+0000","last_change":"2024-08-18T22:19:21.142319+0000","last_active":"2024-08-18T22:19:27.040927+0000","last_peered":"2024-08-18T22:19:27.040927+0000","last_clean":"2024-08-18T22:19:27.040927+0000","last_became_active":"2024-08-18T22:19:21.142023+0000","last_became_peered":"2024-08-18T22:19:21.142023+0000","last_unstale":"2024-08-18T22:19:27.040927+0000","last_undegraded":"2024-08-18T22:19:27.040927+0000","last_fullsized":"2024-08-18T22:19:27.040927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040827+0000","last_change":"2024-08-18T22:19:20.126010+0000","last_active":"2024-08-18T22:19:27.040827+0000","last_peered":"2024-08-18T22:19:27.040827+0000","last_clean":"2024-08-18T22:19:27.040827+0000","last_became_active":"2024-08-18T22:19:20.125768+0000","last_became_peered":"2024-08-18T22:19:20.125768+0000","last_unstale":"2024-08-18T22:19:27.040827+0000","last_undegraded":"2024-08-18T22:19:27.040827+0000","last_fullsized":"2024-08-18T22:19:27.040827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:09.183754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342628+0000","last_change":"2024-08-18T22:19:20.118969+0000","last_active":"2024-08-18T22:19:26.342628+0000","last_peered":"2024-08-18T22:19:26.342628+0000","last_clean":"2024-08-18T22:19:26.342628+0000","last_became_active":"2024-08-18T22:19:20.118686+0000","last_became_peered":"2024-08-18T22:19:20.118686+0000","last_unstale":"2024-08-18T22:19:26.342628+0000","last_undegraded":"2024-08-18T22:19:26.342628+0000","last_fullsized":"2024-08-18T22:19:26.342628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408624+0000","last_change":"2024-08-18T22:19:21.138371+0000","last_active":"2024-08-18T22:19:27.408624+0000","last_peered":"2024-08-18T22:19:27.408624+0000","last_clean":"2024-08-18T22:19:27.408624+0000","last_became_active":"2024-08-18T22:19:21.138042+0000","last_became_peered":"2024-08-18T22:19:21.138042+0000","last_unstale":"2024-08-18T22:19:27.408624+0000","last_undegraded":"2024-08-18T22:19:27.408624+0000","last_fullsized":"2024-08-18T22:19:27.408624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406977+0000","last_change":"2024-08-18T22:19:25.377063+0000","last_active":"2024-08-18T22:19:27.406977+0000","last_peered":"2024-08-18T22:19:27.406977+0000","last_clean":"2024-08-18T22:19:27.406977+0000","last_became_active":"2024-08-18T22:19:25.376639+0000","last_became_peered":"2024-08-18T22:19:25.376639+0000","last_unstale":"2024-08-18T22:19:27.406977+0000","last_undegraded":"2024-08-18T22:19:27.406977+0000","last_fullsized":"2024-08-18T22:19:27.406977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:43.985709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041089+0000","last_change":"2024-08-18T22:19:20.129285+0000","last_active":"2024-08-18T22:19:27.041089+0000","last_peered":"2024-08-18T22:19:27.041089+0000","last_clean":"2024-08-18T22:19:27.041089+0000","last_became_active":"2024-08-18T22:19:20.129024+0000","last_became_peered":"2024-08-18T22:19:20.129024+0000","last_unstale":"2024-08-18T22:19:27.041089+0000","last_undegraded":"2024-08-18T22:19:27.041089+0000","last_fullsized":"2024-08-18T22:19:27.041089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344339+0000","last_change":"2024-08-18T22:19:21.102815+0000","last_active":"2024-08-18T22:19:26.344339+0000","last_peered":"2024-08-18T22:19:26.344339+0000","last_clean":"2024-08-18T22:19:26.344339+0000","last_became_active":"2024-08-18T22:19:21.102382+0000","last_became_peered":"2024-08-18T22:19:21.102382+0000","last_unstale":"2024-08-18T22:19:26.344339+0000","last_undegraded":"2024-08-18T22:19:26.344339+0000","last_fullsized":"2024-08-18T22:19:26.344339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:41.157892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041004+0000","last_change":"2024-08-18T22:19:25.365329+0000","last_active":"2024-08-18T22:19:27.041004+0000","last_peered":"2024-08-18T22:19:27.041004+0000","last_clean":"2024-08-18T22:19:27.041004+0000","last_became_active":"2024-08-18T22:19:25.364915+0000","last_became_peered":"2024-08-18T22:19:25.364915+0000","last_unstale":"2024-08-18T22:19:27.041004+0000","last_undegraded":"2024-08-18T22:19:27.041004+0000","last_fullsized":"2024-08-18T22:19:27.041004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:19:12.438973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342040+0000","last_change":"2024-08-18T22:19:21.137071+0000","last_active":"2024-08-18T22:19:26.342040+0000","last_peered":"2024-08-18T22:19:26.342040+0000","last_clean":"2024-08-18T22:19:26.342040+0000","last_became_active":"2024-08-18T22:19:21.136814+0000","last_became_peered":"2024-08-18T22:19:21.136814+0000","last_unstale":"2024-08-18T22:19:26.342040+0000","last_undegraded":"2024-08-18T22:19:26.342040+0000","last_fullsized":"2024-08-18T22:19:26.342040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406646+0000","last_change":"2024-08-18T22:19:21.118314+0000","last_active":"2024-08-18T22:19:27.406646+0000","last_peered":"2024-08-18T22:19:27.406646+0000","last_clean":"2024-08-18T22:19:27.406646+0000","last_became_active":"2024-08-18T22:19:21.117946+0000","last_became_peered":"2024-08-18T22:19:21.117946+0000","last_unstale":"2024-08-18T22:19:27.406646+0000","last_undegraded":"2024-08-18T22:19:27.406646+0000","last_fullsized":"2024-08-18T22:19:27.406646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:32.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335679+0000","last_change":"2024-08-18T22:19:21.126438+0000","last_active":"2024-08-18T22:19:27.335679+0000","last_peered":"2024-08-18T22:19:27.335679+0000","last_clean":"2024-08-18T22:19:27.335679+0000","last_became_active":"2024-08-18T22:19:21.125111+0000","last_became_peered":"2024-08-18T22:19:21.125111+0000","last_unstale":"2024-08-18T22:19:27.335679+0000","last_undegraded":"2024-08-18T22:19:27.335679+0000","last_fullsized":"2024-08-18T22:19:27.335679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:25:04.876293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408577+0000","last_change":"2024-08-18T22:19:21.127359+0000","last_active":"2024-08-18T22:19:27.408577+0000","last_peered":"2024-08-18T22:19:27.408577+0000","last_clean":"2024-08-18T22:19:27.408577+0000","last_became_active":"2024-08-18T22:19:21.126860+0000","last_became_peered":"2024-08-18T22:19:21.126860+0000","last_unstale":"2024-08-18T22:19:27.408577+0000","last_undegraded":"2024-08-18T22:19:27.408577+0000","last_fullsized":"2024-08-18T22:19:27.408577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041266+0000","last_change":"2024-08-18T22:19:21.132232+0000","last_active":"2024-08-18T22:19:27.041266+0000","last_peered":"2024-08-18T22:19:27.041266+0000","last_clean":"2024-08-18T22:19:27.041266+0000","last_became_active":"2024-08-18T22:19:21.131969+0000","last_became_peered":"2024-08-18T22:19:21.131969+0000","last_unstale":"2024-08-18T22:19:27.041266+0000","last_undegraded":"2024-08-18T22:19:27.041266+0000","last_fullsized":"2024-08-18T22:19:27.041266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:25:04.876293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407601+0000","last_change":"2024-08-18T22:19:21.116405+0000","last_active":"2024-08-18T22:19:27.407601+0000","last_peered":"2024-08-18T22:19:27.407601+0000","last_clean":"2024-08-18T22:19:27.407601+0000","last_became_active":"2024-08-18T22:19:21.116134+0000","last_became_peered":"2024-08-18T22:19:21.116134+0000","last_unstale":"2024-08-18T22:19:27.407601+0000","last_undegraded":"2024-08-18T22:19:27.407601+0000","last_fullsized":"2024-08-18T22:19:27.407601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344310+0000","last_change":"2024-08-18T22:19:21.119475+0000","last_active":"2024-08-18T22:19:26.344310+0000","last_peered":"2024-08-18T22:19:26.344310+0000","last_clean":"2024-08-18T22:19:26.344310+0000","last_became_active":"2024-08-18T22:19:21.118733+0000","last_became_peered":"2024-08-18T22:19:21.118733+0000","last_unstale":"2024-08-18T22:19:26.344310+0000","last_undegraded":"2024-08-18T22:19:26.344310+0000","last_fullsized":"2024-08-18T22:19:26.344310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041220+0000","last_change":"2024-08-18T22:19:21.130398+0000","last_active":"2024-08-18T22:19:27.041220+0000","last_peered":"2024-08-18T22:19:27.041220+0000","last_clean":"2024-08-18T22:19:27.041220+0000","last_became_active":"2024-08-18T22:19:21.130131+0000","last_became_peered":"2024-08-18T22:19:21.130131+0000","last_unstale":"2024-08-18T22:19:27.041220+0000","last_undegraded":"2024-08-18T22:19:27.041220+0000","last_fullsized":"2024-08-18T22:19:27.041220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335536+0000","last_change":"2024-08-18T22:19:21.127403+0000","last_active":"2024-08-18T22:19:27.335536+0000","last_peered":"2024-08-18T22:19:27.335536+0000","last_clean":"2024-08-18T22:19:27.335536+0000","last_became_active":"2024-08-18T22:19:21.125489+0000","last_became_peered":"2024-08-18T22:19:21.125489+0000","last_unstale":"2024-08-18T22:19:27.335536+0000","last_undegraded":"2024-08-18T22:19:27.335536+0000","last_fullsized":"2024-08-18T22:19:27.335536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:44.820166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040656+0000","last_change":"2024-08-18T22:19:21.119217+0000","last_active":"2024-08-18T22:19:27.040656+0000","last_peered":"2024-08-18T22:19:27.040656+0000","last_clean":"2024-08-18T22:19:27.040656+0000","last_became_active":"2024-08-18T22:19:21.118867+0000","last_became_peered":"2024-08-18T22:19:21.118867+0000","last_unstale":"2024-08-18T22:19:27.040656+0000","last_undegraded":"2024-08-18T22:19:27.040656+0000","last_fullsized":"2024-08-18T22:19:27.040656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335670+0000","last_change":"2024-08-18T22:19:21.131453+0000","last_active":"2024-08-18T22:19:27.335670+0000","last_peered":"2024-08-18T22:19:27.335670+0000","last_clean":"2024-08-18T22:19:27.335670+0000","last_became_active":"2024-08-18T22:19:21.131186+0000","last_became_peered":"2024-08-18T22:19:21.131186+0000","last_unstale":"2024-08-18T22:19:27.335670+0000","last_undegraded":"2024-08-18T22:19:27.335670+0000","last_fullsized":"2024-08-18T22:19:27.335670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:43.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408516+0000","last_change":"2024-08-18T22:19:21.133703+0000","last_active":"2024-08-18T22:19:27.408516+0000","last_peered":"2024-08-18T22:19:27.408516+0000","last_clean":"2024-08-18T22:19:27.408516+0000","last_became_active":"2024-08-18T22:19:21.129639+0000","last_became_peered":"2024-08-18T22:19:21.129639+0000","last_unstale":"2024-08-18T22:19:27.408516+0000","last_undegraded":"2024-08-18T22:19:27.408516+0000","last_fullsized":"2024-08-18T22:19:27.408516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342954+0000","last_change":"2024-08-18T22:19:21.119313+0000","last_active":"2024-08-18T22:19:26.342954+0000","last_peered":"2024-08-18T22:19:26.342954+0000","last_clean":"2024-08-18T22:19:26.342954+0000","last_became_active":"2024-08-18T22:19:21.119038+0000","last_became_peered":"2024-08-18T22:19:21.119038+0000","last_unstale":"2024-08-18T22:19:26.342954+0000","last_undegraded":"2024-08-18T22:19:26.342954+0000","last_fullsized":"2024-08-18T22:19:26.342954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345508+0000","last_change":"2024-08-18T22:19:21.123284+0000","last_active":"2024-08-18T22:19:26.345508+0000","last_peered":"2024-08-18T22:19:26.345508+0000","last_clean":"2024-08-18T22:19:26.345508+0000","last_became_active":"2024-08-18T22:19:21.123041+0000","last_became_peered":"2024-08-18T22:19:21.123041+0000","last_unstale":"2024-08-18T22:19:26.345508+0000","last_undegraded":"2024-08-18T22:19:26.345508+0000","last_fullsized":"2024-08-18T22:19:26.345508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:10.870419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408041+0000","last_change":"2024-08-18T22:19:21.120385+0000","last_active":"2024-08-18T22:19:27.408041+0000","last_peered":"2024-08-18T22:19:27.408041+0000","last_clean":"2024-08-18T22:19:27.408041+0000","last_became_active":"2024-08-18T22:19:21.119998+0000","last_became_peered":"2024-08-18T22:19:21.119998+0000","last_unstale":"2024-08-18T22:19:27.408041+0000","last_undegraded":"2024-08-18T22:19:27.408041+0000","last_fullsized":"2024-08-18T22:19:27.408041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:30.321238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336261+0000","last_change":"2024-08-18T22:19:21.131891+0000","last_active":"2024-08-18T22:19:27.336261+0000","last_peered":"2024-08-18T22:19:27.336261+0000","last_clean":"2024-08-18T22:19:27.336261+0000","last_became_active":"2024-08-18T22:19:21.131589+0000","last_became_peered":"2024-08-18T22:19:21.131589+0000","last_unstale":"2024-08-18T22:19:27.336261+0000","last_undegraded":"2024-08-18T22:19:27.336261+0000","last_fullsized":"2024-08-18T22:19:27.336261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:26.063472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335381+0000","last_change":"2024-08-18T22:19:21.126883+0000","last_active":"2024-08-18T22:19:27.335381+0000","last_peered":"2024-08-18T22:19:27.335381+0000","last_clean":"2024-08-18T22:19:27.335381+0000","last_became_active":"2024-08-18T22:19:21.126532+0000","last_became_peered":"2024-08-18T22:19:21.126532+0000","last_unstale":"2024-08-18T22:19:27.335381+0000","last_undegraded":"2024-08-18T22:19:27.335381+0000","last_fullsized":"2024-08-18T22:19:27.335381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406798+0000","last_change":"2024-08-18T22:19:21.105560+0000","last_active":"2024-08-18T22:19:27.406798+0000","last_peered":"2024-08-18T22:19:27.406798+0000","last_clean":"2024-08-18T22:19:27.406798+0000","last_became_active":"2024-08-18T22:19:21.105275+0000","last_became_peered":"2024-08-18T22:19:21.105275+0000","last_unstale":"2024-08-18T22:19:27.406798+0000","last_undegraded":"2024-08-18T22:19:27.406798+0000","last_fullsized":"2024-08-18T22:19:27.406798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408404+0000","last_change":"2024-08-18T22:19:21.131750+0000","last_active":"2024-08-18T22:19:27.408404+0000","last_peered":"2024-08-18T22:19:27.408404+0000","last_clean":"2024-08-18T22:19:27.408404+0000","last_became_active":"2024-08-18T22:19:21.131476+0000","last_became_peered":"2024-08-18T22:19:21.131476+0000","last_unstale":"2024-08-18T22:19:27.408404+0000","last_undegraded":"2024-08-18T22:19:27.408404+0000","last_fullsized":"2024-08-18T22:19:27.408404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:14.137945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040778+0000","last_change":"2024-08-18T22:19:21.137226+0000","last_active":"2024-08-18T22:19:27.040778+0000","last_peered":"2024-08-18T22:19:27.040778+0000","last_clean":"2024-08-18T22:19:27.040778+0000","last_became_active":"2024-08-18T22:19:21.136916+0000","last_became_peered":"2024-08-18T22:19:21.136916+0000","last_unstale":"2024-08-18T22:19:27.040778+0000","last_undegraded":"2024-08-18T22:19:27.040778+0000","last_fullsized":"2024-08-18T22:19:27.040778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344977+0000","last_change":"2024-08-18T22:19:21.122084+0000","last_active":"2024-08-18T22:19:26.344977+0000","last_peered":"2024-08-18T22:19:26.344977+0000","last_clean":"2024-08-18T22:19:26.344977+0000","last_became_active":"2024-08-18T22:19:21.121814+0000","last_became_peered":"2024-08-18T22:19:21.121814+0000","last_unstale":"2024-08-18T22:19:26.344977+0000","last_undegraded":"2024-08-18T22:19:26.344977+0000","last_fullsized":"2024-08-18T22:19:26.344977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:03.691264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343684+0000","last_change":"2024-08-18T22:19:21.118724+0000","last_active":"2024-08-18T22:19:26.343684+0000","last_peered":"2024-08-18T22:19:26.343684+0000","last_clean":"2024-08-18T22:19:26.343684+0000","last_became_active":"2024-08-18T22:19:21.118432+0000","last_became_peered":"2024-08-18T22:19:21.118432+0000","last_unstale":"2024-08-18T22:19:26.343684+0000","last_undegraded":"2024-08-18T22:19:26.343684+0000","last_fullsized":"2024-08-18T22:19:26.343684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344215+0000","last_change":"2024-08-18T22:19:21.119771+0000","last_active":"2024-08-18T22:19:26.344215+0000","last_peered":"2024-08-18T22:19:26.344215+0000","last_clean":"2024-08-18T22:19:26.344215+0000","last_became_active":"2024-08-18T22:19:21.119089+0000","last_became_peered":"2024-08-18T22:19:21.119089+0000","last_unstale":"2024-08-18T22:19:26.344215+0000","last_undegraded":"2024-08-18T22:19:26.344215+0000","last_fullsized":"2024-08-18T22:19:26.344215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345907+0000","last_change":"2024-08-18T22:19:21.116013+0000","last_active":"2024-08-18T22:19:26.345907+0000","last_peered":"2024-08-18T22:19:26.345907+0000","last_clean":"2024-08-18T22:19:26.345907+0000","last_became_active":"2024-08-18T22:19:21.115692+0000","last_became_peered":"2024-08-18T22:19:21.115692+0000","last_unstale":"2024-08-18T22:19:26.345907+0000","last_undegraded":"2024-08-18T22:19:26.345907+0000","last_fullsized":"2024-08-18T22:19:26.345907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:17.605306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040584+0000","last_change":"2024-08-18T22:19:21.121713+0000","last_active":"2024-08-18T22:19:27.040584+0000","last_peered":"2024-08-18T22:19:27.040584+0000","last_clean":"2024-08-18T22:19:27.040584+0000","last_became_active":"2024-08-18T22:19:21.121200+0000","last_became_peered":"2024-08-18T22:19:21.121200+0000","last_unstale":"2024-08-18T22:19:27.040584+0000","last_undegraded":"2024-08-18T22:19:27.040584+0000","last_fullsized":"2024-08-18T22:19:27.040584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344491+0000","last_change":"2024-08-18T22:19:21.129242+0000","last_active":"2024-08-18T22:19:26.344491+0000","last_peered":"2024-08-18T22:19:26.344491+0000","last_clean":"2024-08-18T22:19:26.344491+0000","last_became_active":"2024-08-18T22:19:21.128914+0000","last_became_peered":"2024-08-18T22:19:21.128914+0000","last_unstale":"2024-08-18T22:19:26.344491+0000","last_undegraded":"2024-08-18T22:19:26.344491+0000","last_fullsized":"2024-08-18T22:19:26.344491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:06.594373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335443+0000","last_change":"2024-08-18T22:19:21.136266+0000","last_active":"2024-08-18T22:19:27.335443+0000","last_peered":"2024-08-18T22:19:27.335443+0000","last_clean":"2024-08-18T22:19:27.335443+0000","last_became_active":"2024-08-18T22:19:21.135968+0000","last_became_peered":"2024-08-18T22:19:21.135968+0000","last_unstale":"2024-08-18T22:19:27.335443+0000","last_undegraded":"2024-08-18T22:19:27.335443+0000","last_fullsized":"2024-08-18T22:19:27.335443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345760+0000","last_change":"2024-08-18T22:19:21.115212+0000","last_active":"2024-08-18T22:19:26.345760+0000","last_peered":"2024-08-18T22:19:26.345760+0000","last_clean":"2024-08-18T22:19:26.345760+0000","last_became_active":"2024-08-18T22:19:21.114910+0000","last_became_peered":"2024-08-18T22:19:21.114910+0000","last_unstale":"2024-08-18T22:19:26.345760+0000","last_undegraded":"2024-08-18T22:19:26.345760+0000","last_fullsized":"2024-08-18T22:19:26.345760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:38.186074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335755+0000","last_change":"2024-08-18T22:19:21.127871+0000","last_active":"2024-08-18T22:19:27.335755+0000","last_peered":"2024-08-18T22:19:27.335755+0000","last_clean":"2024-08-18T22:19:27.335755+0000","last_became_active":"2024-08-18T22:19:21.126869+0000","last_became_peered":"2024-08-18T22:19:21.126869+0000","last_unstale":"2024-08-18T22:19:27.335755+0000","last_undegraded":"2024-08-18T22:19:27.335755+0000","last_fullsized":"2024-08-18T22:19:27.335755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:20.765001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408844+0000","last_change":"2024-08-18T22:19:21.131385+0000","last_active":"2024-08-18T22:19:27.408844+0000","last_peered":"2024-08-18T22:19:27.408844+0000","last_clean":"2024-08-18T22:19:27.408844+0000","last_became_active":"2024-08-18T22:19:21.131082+0000","last_became_peered":"2024-08-18T22:19:21.131082+0000","last_unstale":"2024-08-18T22:19:27.408844+0000","last_undegraded":"2024-08-18T22:19:27.408844+0000","last_fullsized":"2024-08-18T22:19:27.408844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408484+0000","last_change":"2024-08-18T22:19:21.136779+0000","last_active":"2024-08-18T22:19:27.408484+0000","last_peered":"2024-08-18T22:19:27.408484+0000","last_clean":"2024-08-18T22:19:27.408484+0000","last_became_active":"2024-08-18T22:19:21.136340+0000","last_became_peered":"2024-08-18T22:19:21.136340+0000","last_unstale":"2024-08-18T22:19:27.408484+0000","last_undegraded":"2024-08-18T22:19:27.408484+0000","last_fullsized":"2024-08-18T22:19:27.408484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345776+0000","last_change":"2024-08-18T22:19:21.122413+0000","last_active":"2024-08-18T22:19:26.345776+0000","last_peered":"2024-08-18T22:19:26.345776+0000","last_clean":"2024-08-18T22:19:26.345776+0000","last_became_active":"2024-08-18T22:19:21.122038+0000","last_became_peered":"2024-08-18T22:19:21.122038+0000","last_unstale":"2024-08-18T22:19:26.345776+0000","last_undegraded":"2024-08-18T22:19:26.345776+0000","last_fullsized":"2024-08-18T22:19:26.345776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:30:09.265589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":102159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":102229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":693075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:19:42.890 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:19:42.890 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-18T22:19:42.890 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-18T22:19:42.891 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-18T22:19:42.891 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-18T22:19:43.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5ad5600640 1 Processor -- start 2024-08-18T22:19:43.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5ad5600640 1 -- start start 2024-08-18T22:19:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5ad5600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ad00ce1a0 0x7f5ad00d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5ad5600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad0070260 con 0x7f5ad015ae70 2024-08-18T22:19:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5ad5600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad00704d0 con 0x7f5ad006fdd0 2024-08-18T22:19:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5ad5600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad00707b0 con 0x7f5ad00ce1a0 2024-08-18T22:19:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5ac7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ad00ce1a0 0x7f5ad00d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5acfe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5ad015ae70 0x7f5ad00cda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37756/0 (socket says 172.21.15.5:37756) 2024-08-18T22:19:43.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5acfe00640 1 -- 172.21.15.5:0/961412445 learned_addr learned my addr 172.21.15.5:0/961412445 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:43.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5ac7400640 1 -- 172.21.15.5:0/961412445 >> v1:172.21.15.117:6789/0 conn(0x7f5ad006fdd0 legacy=0x7f5ad00b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:43.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5ac7400640 1 -- 172.21.15.5:0/961412445 >> v1:172.21.15.5:6789/0 conn(0x7f5ad015ae70 legacy=0x7f5ad00cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.066+0000 7f5ac7400640 1 -- 172.21.15.5:0/961412445 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad0070a90 con 0x7f5ad00ce1a0 2024-08-18T22:19:43.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5ac7400640 1 --2- 172.21.15.5:0/961412445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00ce1a0 0x7f5ad00d09c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80097c0 tx=0x7f5ab801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b3db64bb447d3f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:43.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5acf400640 1 -- 172.21.15.5:0/961412445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80ab430 con 0x7f5ad00ce1a0 2024-08-18T22:19:43.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5acf400640 1 -- 172.21.15.5:0/961412445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab80b0070 con 0x7f5ad00ce1a0 2024-08-18T22:19:43.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5acf400640 1 -- 172.21.15.5:0/961412445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80ab7f0 con 0x7f5ad00ce1a0 2024-08-18T22:19:43.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5ad5600640 1 -- 172.21.15.5:0/961412445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00ce1a0 msgr2=0x7f5ad00d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5ad5600640 1 --2- 172.21.15.5:0/961412445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00ce1a0 0x7f5ad00d09c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80097c0 tx=0x7f5ab801c430 comp rx=0 tx=0).stop 2024-08-18T22:19:43.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5ad5600640 1 -- 172.21.15.5:0/961412445 shutdown_connections 2024-08-18T22:19:43.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5ad5600640 1 --2- 172.21.15.5:0/961412445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00ce1a0 0x7f5ad00d09c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5ad5600640 1 -- 172.21.15.5:0/961412445 >> 172.21.15.5:0/961412445 conn(0x7f5ad006e890 msgr2=0x7f5ad006eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:43.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5ad5600640 1 -- 172.21.15.5:0/961412445 shutdown_connections 2024-08-18T22:19:43.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5ad5600640 1 -- 172.21.15.5:0/961412445 wait complete. 2024-08-18T22:19:43.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5ad5600640 1 Processor -- start 2024-08-18T22:19:43.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.070+0000 7f5ad5600640 1 -- start start 2024-08-18T22:19:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ad5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad006fdd0 0x7f5ad01444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ad5600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ad00ce1a0 0x7f5ad015b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ad5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ad015ae70 0x7f5ad015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ad5600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad00b51c0 con 0x7f5ad006fdd0 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ad5600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad00b5040 con 0x7f5ad00ce1a0 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ad5600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad00b5340 con 0x7f5ad015ae70 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5acfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad006fdd0 0x7f5ad01444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5acfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad006fdd0 0x7f5ad01444c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45458/0 (socket says 172.21.15.5:45458) 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5acfe00640 1 -- 172.21.15.5:0/3721391020 learned_addr learned my addr 172.21.15.5:0/3721391020 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ad4c00640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ad015ae70 0x7f5ad015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ac7400640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ad00ce1a0 0x7f5ad015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5acfe00640 1 -- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ad015ae70 msgr2=0x7f5ad015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5acfe00640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ad015ae70 0x7f5ad015b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5acfe00640 1 -- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ad00ce1a0 msgr2=0x7f5ad015b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5acfe00640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ad00ce1a0 0x7f5ad015b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5acfe00640 1 -- 172.21.15.5:0/3721391020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad0144d50 con 0x7f5ad006fdd0 2024-08-18T22:19:43.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ad4c00640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ad015ae70 0x7f5ad015b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5acfe00640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad006fdd0 0x7f5ad01444c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000c370 tx=0x7f5ac000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5accc00640 1 -- 172.21.15.5:0/3721391020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0017070 con 0x7f5ad006fdd0 2024-08-18T22:19:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5accc00640 1 -- 172.21.15.5:0/3721391020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac0005cf0 con 0x7f5ad006fdd0 2024-08-18T22:19:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5accc00640 1 -- 172.21.15.5:0/3721391020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00072f0 con 0x7f5ad006fdd0 2024-08-18T22:19:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ad5600640 1 -- 172.21.15.5:0/3721391020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad014a070 con 0x7f5ad006fdd0 2024-08-18T22:19:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ad5600640 1 -- 172.21.15.5:0/3721391020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad0151bc0 con 0x7f5ad006fdd0 2024-08-18T22:19:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5ad5600640 1 -- 172.21.15.5:0/3721391020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad0068120 con 0x7f5ad006fdd0 2024-08-18T22:19:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.074+0000 7f5accc00640 1 -- 172.21.15.5:0/3721391020 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ac001a070 con 0x7f5ad006fdd0 2024-08-18T22:19:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.078+0000 7f5accc00640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5aac0678c0 0x7f5aac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.078+0000 7f5accc00640 1 -- 172.21.15.5:0/3721391020 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5ac0085320 con 0x7f5ad006fdd0 2024-08-18T22:19:43.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.078+0000 7f5ac7400640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5aac0678c0 0x7f5aac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.078+0000 7f5ac7400640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5aac0678c0 0x7f5aac069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80af000 tx=0x7f5ab80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:43.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.082+0000 7f5accc00640 1 -- 172.21.15.5:0/3721391020 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5ad0144d50 con 0x7f5ad006fdd0 2024-08-18T22:19:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.286+0000 7f5ad5600640 1 -- 172.21.15.5:0/3721391020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5ad00d09c0 con 0x7f5ad006fdd0 2024-08-18T22:19:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.290+0000 7f5accc00640 1 -- 172.21.15.5:0/3721391020 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166893 (secure 0 0 0) 0x7f5ac00850e0 con 0x7f5ad006fdd0 2024-08-18T22:19:43.297 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 -- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5aac0678c0 msgr2=0x7f5aac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5aac0678c0 0x7f5aac069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80af000 tx=0x7f5ab80a7000 comp rx=0 tx=0).stop 2024-08-18T22:19:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 -- 172.21.15.5:0/3721391020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad006fdd0 msgr2=0x7f5ad01444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad006fdd0 0x7f5ad01444c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000c370 tx=0x7f5ac000c830 comp rx=0 tx=0).stop 2024-08-18T22:19:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 -- 172.21.15.5:0/3721391020 shutdown_connections 2024-08-18T22:19:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5aac0678c0 0x7f5aac069d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ad015ae70 0x7f5ad015b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ad00ce1a0 0x7f5ad015b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 --2- 172.21.15.5:0/3721391020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad006fdd0 0x7f5ad01444c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 -- 172.21.15.5:0/3721391020 >> 172.21.15.5:0/3721391020 conn(0x7f5ad006e890 msgr2=0x7f5ad0072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 -- 172.21.15.5:0/3721391020 shutdown_connections 2024-08-18T22:19:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.294+0000 7f5ad5600640 1 -- 172.21.15.5:0/3721391020 wait complete. 2024-08-18T22:19:43.318 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2733333912},{"type":"v1","addr":"172.21.15.117:6833","nonce":2733333912}]},"active_addr":"172.21.15.117:6833/2733333912","active_change":"2024-08-18T22:19:01.603662+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3182391603}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1455174755}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3571481489}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":877731365}]}]} 2024-08-18T22:19:43.322 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-18T22:19:43.322 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-18T22:19:43.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1c2c00640 1 Processor -- start 2024-08-18T22:19:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1c2c00640 1 -- start start 2024-08-18T22:19:43.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1c2c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1bc071580 0x7fb1bc06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1c2c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1bc0cbed0 0x7fb1bc0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1c2c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1bc071c80 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1c2c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb1bc0cba40 con 0x7fb1bc071580 2024-08-18T22:19:43.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1c2c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb1bc071f60 con 0x7fb1bc0cbed0 2024-08-18T22:19:43.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1b3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1bc071580 0x7fb1bc06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1b3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1bc071580 0x7fb1bc06dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45474/0 (socket says 172.21.15.5:45474) 2024-08-18T22:19:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1b3400640 1 -- 172.21.15.5:0/1764993465 learned_addr learned my addr 172.21.15.5:0/1764993465 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1c0c00640 1 --2- 172.21.15.5:0/1764993465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1bc0cbed0 0x7fb1bc0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1b3400640 1 -- 172.21.15.5:0/1764993465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1bc0cbed0 msgr2=0x7fb1bc0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1b3400640 1 --2- 172.21.15.5:0/1764993465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1bc0cbed0 0x7fb1bc0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1b3400640 1 -- 172.21.15.5:0/1764993465 >> v1:172.21.15.117:6789/0 conn(0x7fb1bc0b54c0 legacy=0x7fb1bc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1bb400640 1 -- 172.21.15.5:0/1764993465 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1608660712 0 0) 0x7fb1bc071c80 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.458+0000 7fb1b3400640 1 -- 172.21.15.5:0/1764993465 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc0cb6d0 con 0x7fb1bc071580 2024-08-18T22:19:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1b3400640 1 --2- 172.21.15.5:0/1764993465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc071580 0x7fb1bc06dd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009870 tx=0x7fb1a401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5571bacfe579ce5e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1bb400640 1 -- 172.21.15.5:0/1764993465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40b5070 con 0x7fb1bc071580 2024-08-18T22:19:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1bb400640 1 -- 172.21.15.5:0/1764993465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a40a8a50 con 0x7fb1bc071580 2024-08-18T22:19:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1bb400640 1 -- 172.21.15.5:0/1764993465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40a8e20 con 0x7fb1bc071580 2024-08-18T22:19:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1c2c00640 1 -- 172.21.15.5:0/1764993465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc071580 msgr2=0x7fb1bc06dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1c2c00640 1 --2- 172.21.15.5:0/1764993465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc071580 0x7fb1bc06dd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009870 tx=0x7fb1a401ed50 comp rx=0 tx=0).stop 2024-08-18T22:19:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1c2c00640 1 -- 172.21.15.5:0/1764993465 shutdown_connections 2024-08-18T22:19:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1c2c00640 1 --2- 172.21.15.5:0/1764993465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1bc0cbed0 0x7fb1bc0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1c2c00640 1 --2- 172.21.15.5:0/1764993465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc071580 0x7fb1bc06dd80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1c2c00640 1 -- 172.21.15.5:0/1764993465 >> 172.21.15.5:0/1764993465 conn(0x7fb1bc0b3eb0 msgr2=0x7fb1bc0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1c2c00640 1 -- 172.21.15.5:0/1764993465 shutdown_connections 2024-08-18T22:19:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.462+0000 7fb1c2c00640 1 -- 172.21.15.5:0/1764993465 wait complete. 2024-08-18T22:19:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1c2c00640 1 Processor -- start 2024-08-18T22:19:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1c2c00640 1 -- start start 2024-08-18T22:19:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1c2c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc071580 0x7fb1bc1e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1c2c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc0b54c0 0x7fb1bc1e7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1c2c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1bc0cbed0 0x7fb1bc0d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1c2c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc1481a0 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1c2c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc148020 con 0x7fb1bc071580 2024-08-18T22:19:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1c2c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb1bc0cc8a0 con 0x7fb1bc0cbed0 2024-08-18T22:19:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc0b54c0 0x7fb1bc1e7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc0b54c0 0x7fb1bc1e7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45482/0 (socket says 172.21.15.5:45482) 2024-08-18T22:19:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b3400640 1 -- 172.21.15.5:0/461663021 learned_addr learned my addr 172.21.15.5:0/461663021 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1bbe00640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc071580 0x7fb1bc1e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1c0c00640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1bc0cbed0 0x7fb1bc0d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b3400640 1 -- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1bc0cbed0 msgr2=0x7fb1bc0d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b3400640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1bc0cbed0 0x7fb1bc0d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b3400640 1 -- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc071580 msgr2=0x7fb1bc1e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b3400640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc071580 0x7fb1bc1e77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b3400640 1 -- 172.21.15.5:0/461663021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc1f70f0 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b3400640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc0b54c0 0x7fb1bc1e7ce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40097c0 tx=0x7fb1a401baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b8c00640 1 -- 172.21.15.5:0/461663021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40c0070 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b8c00640 1 -- 172.21.15.5:0/461663021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a40ae550 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1c2c00640 1 -- 172.21.15.5:0/461663021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1bc1e83d0 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1b8c00640 1 -- 172.21.15.5:0/461663021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40b5070 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.466+0000 7fb1c2c00640 1 -- 172.21.15.5:0/461663021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1bc0cebe0 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.470+0000 7fb1c2c00640 1 -- 172.21.15.5:0/461663021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1bc0cc360 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.470+0000 7fb1b8c00640 1 -- 172.21.15.5:0/461663021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1a40c3070 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.470+0000 7fb1b8c00640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1980678c0 0x7fb198069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.470+0000 7fb1b8c00640 1 -- 172.21.15.5:0/461663021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb1a4123a20 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.470+0000 7fb1bbe00640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1980678c0 0x7fb198069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.470+0000 7fb1bbe00640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1980678c0 0x7fb198069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0b47d0 tx=0x7fb1ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.474+0000 7fb1b8c00640 1 -- 172.21.15.5:0/461663021 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb1a40188b0 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.642+0000 7fb1c2c00640 1 -- 172.21.15.5:0/461663021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1bc15e510 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.642+0000 7fb1b8c00640 1 -- 172.21.15.5:0/461663021 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18442 (secure 0 0 0) 0x7fb1a40f3bc0 con 0x7fb1bc0b54c0 2024-08-18T22:19:43.648 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:43.649 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:25.756631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 -- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1980678c0 msgr2=0x7fb198069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1980678c0 0x7fb198069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0b47d0 tx=0x7fb1ac009040 comp rx=0 tx=0).stop 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 -- 172.21.15.5:0/461663021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc0b54c0 msgr2=0x7fb1bc1e7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc0b54c0 0x7fb1bc1e7ce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40097c0 tx=0x7fb1a401baf0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 -- 172.21.15.5:0/461663021 shutdown_connections 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1980678c0 0x7fb198069d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1bc0cbed0 0x7fb1bc0d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc0b54c0 0x7fb1bc1e7ce0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 --2- 172.21.15.5:0/461663021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc071580 0x7fb1bc1e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 -- 172.21.15.5:0/461663021 >> 172.21.15.5:0/461663021 conn(0x7fb1bc0b3eb0 msgr2=0x7fb1bc0b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 -- 172.21.15.5:0/461663021 shutdown_connections 2024-08-18T22:19:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.646+0000 7fb1c2c00640 1 -- 172.21.15.5:0/461663021 wait complete. 2024-08-18T22:19:43.670 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-18T22:19:43.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1ca7000640 1 Processor -- start 2024-08-18T22:19:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1ca7000640 1 -- start start 2024-08-18T22:19:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1ca7000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00afe50 0x7f1ca00b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1ca7000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca00b6310 con 0x7f1ca015e140 2024-08-18T22:19:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1ca7000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca00b65d0 con 0x7f1ca00b5e60 2024-08-18T22:19:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1ca7000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca006e560 con 0x7f1ca00afe50 2024-08-18T22:19:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1c9fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1ca015e140 0x7f1ca00af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38582/0 (socket says 172.21.15.5:38582) 2024-08-18T22:19:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1c9fe00640 1 -- 172.21.15.5:0/2244063107 learned_addr learned my addr 172.21.15.5:0/2244063107 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1c97400640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00afe50 0x7f1ca00b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395694435 0 0) 0x7f1ca00b6310 con 0x7f1ca015e140 2024-08-18T22:19:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c84003530 con 0x7f1ca015e140 2024-08-18T22:19:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 899431054 0 0) 0x7f1c84003530 con 0x7f1ca015e140 2024-08-18T22:19:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00afe50 msgr2=0x7f1ca00b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1c9f400640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00afe50 0x7f1ca00b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 >> v1:172.21.15.117:6789/0 conn(0x7f1ca00b5e60 legacy=0x7f1ca006efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca00b68b0 con 0x7f1ca015e140 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.806+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f1c90001680 con 0x7f1ca015e140 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 >> v1:172.21.15.5:6789/0 conn(0x7f1ca015e140 legacy=0x7f1ca00af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1c9f400640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00afe50 0x7f1c840039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1c9f400640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c84003f70 0x7f1c84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1c9f400640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c84004d50 0x7f1c840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca006e560 con 0x7f1c84004d50 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8400bb60 con 0x7f1c84003f70 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c8400bd60 con 0x7f1ca00afe50 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1ca5000640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c84004d50 0x7f1c840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1c9fe00640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00afe50 0x7f1c840039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1c97400640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c84003f70 0x7f1c84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1ca5000640 1 -- 172.21.15.5:0/2244063107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00afe50 msgr2=0x7f1c840039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1ca5000640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00afe50 0x7f1c840039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1ca5000640 1 -- 172.21.15.5:0/2244063107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c84003f70 msgr2=0x7f1c84004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1ca5000640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c84003f70 0x7f1c84004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1ca5000640 1 -- 172.21.15.5:0/2244063107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c84003530 con 0x7f1c84004d50 2024-08-18T22:19:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1ca5000640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c84004d50 0x7f1c840051d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c98001780 tx=0x7f1c9801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bc5ab838e0c131 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c980013a0 con 0x7f1c84004d50 2024-08-18T22:19:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.810+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c980a9070 con 0x7f1c84004d50 2024-08-18T22:19:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1c9f400640 1 -- 172.21.15.5:0/2244063107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98003600 con 0x7f1c84004d50 2024-08-18T22:19:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 -- 172.21.15.5:0/2244063107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c84004d50 msgr2=0x7f1c840051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 --2- 172.21.15.5:0/2244063107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c84004d50 0x7f1c840051d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c98001780 tx=0x7f1c9801c420 comp rx=0 tx=0).stop 2024-08-18T22:19:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca5000640 1 -- 172.21.15.5:0/2244063107 reap_dead start 2024-08-18T22:19:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 -- 172.21.15.5:0/2244063107 shutdown_connections 2024-08-18T22:19:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 -- 172.21.15.5:0/2244063107 >> 172.21.15.5:0/2244063107 conn(0x7f1ca006b9b0 msgr2=0x7f1ca006bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 -- 172.21.15.5:0/2244063107 shutdown_connections 2024-08-18T22:19:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 -- 172.21.15.5:0/2244063107 wait complete. 2024-08-18T22:19:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 Processor -- start 2024-08-18T22:19:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 -- start start 2024-08-18T22:19:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca01600c0 0x7f1ca0151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca01604a0 0x7f1ca01f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0152bd0 0x7f1ca00cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca015e520 con 0x7f1ca01604a0 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca006ea90 con 0x7f1ca0152bd0 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca7000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca015e6a0 con 0x7f1ca01600c0 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1c97400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca01604a0 0x7f1ca01f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1c97400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca01604a0 0x7f1ca01f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40334/0 (socket says 172.21.15.5:40334) 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1c97400640 1 -- 172.21.15.5:0/3605762024 learned_addr learned my addr 172.21.15.5:0/3605762024 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1c9fe00640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca01600c0 0x7f1ca0151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.814+0000 7f1ca5000640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0152bd0 0x7f1ca00cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c97400640 1 -- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca01600c0 msgr2=0x7f1ca0151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c97400640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca01600c0 0x7f1ca0151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c97400640 1 -- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0152bd0 msgr2=0x7f1ca00cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c97400640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0152bd0 0x7f1ca00cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c97400640 1 -- 172.21.15.5:0/3605762024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca01f56e0 con 0x7f1ca01604a0 2024-08-18T22:19:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c9fe00640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca01600c0 0x7f1ca0151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1ca5000640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0152bd0 0x7f1ca00cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c97400640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca01604a0 0x7f1ca01f51a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1c88011e60 tx=0x7f1c8800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c9cc00640 1 -- 172.21.15.5:0/3605762024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c88015630 con 0x7f1ca01604a0 2024-08-18T22:19:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c9cc00640 1 -- 172.21.15.5:0/3605762024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c880157d0 con 0x7f1ca01604a0 2024-08-18T22:19:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c9cc00640 1 -- 172.21.15.5:0/3605762024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c88015ba0 con 0x7f1ca01604a0 2024-08-18T22:19:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1ca7000640 1 -- 172.21.15.5:0/3605762024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca0151b30 con 0x7f1ca01604a0 2024-08-18T22:19:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1ca7000640 1 -- 172.21.15.5:0/3605762024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca01520f0 con 0x7f1ca01604a0 2024-08-18T22:19:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1ca7000640 1 -- 172.21.15.5:0/3605762024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca00b4e40 con 0x7f1ca01604a0 2024-08-18T22:19:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c9cc00640 1 -- 172.21.15.5:0/3605762024 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c8801d400 con 0x7f1ca01604a0 2024-08-18T22:19:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c9cc00640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c7c0678c0 0x7f1c7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c9cc00640 1 -- 172.21.15.5:0/3605762024 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1c88087240 con 0x7f1ca01604a0 2024-08-18T22:19:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.818+0000 7f1c9fe00640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c7c0678c0 0x7f1c7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.822+0000 7f1c9fe00640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c7c0678c0 0x7f1c7c069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1c90004850 tx=0x7f1c90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.822+0000 7f1c9cc00640 1 -- 172.21.15.5:0/3605762024 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1ca01f56e0 con 0x7f1ca01604a0 2024-08-18T22:19:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.990+0000 7f1ca7000640 1 -- 172.21.15.5:0/3605762024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ca006cd20 con 0x7f1ca01604a0 2024-08-18T22:19:43.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1c9cc00640 1 -- 172.21.15.5:0/3605762024 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18442 (secure 0 0 0) 0x7f1c88019030 con 0x7f1ca01604a0 2024-08-18T22:19:43.998 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:43.998 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:25.756631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 -- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c7c0678c0 msgr2=0x7f1c7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c7c0678c0 0x7f1c7c069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1c90004850 tx=0x7f1c90009040 comp rx=0 tx=0).stop 2024-08-18T22:19:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 -- 172.21.15.5:0/3605762024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca01604a0 msgr2=0x7f1ca01f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca01604a0 0x7f1ca01f51a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1c88011e60 tx=0x7f1c8800f580 comp rx=0 tx=0).stop 2024-08-18T22:19:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 -- 172.21.15.5:0/3605762024 shutdown_connections 2024-08-18T22:19:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c7c0678c0 0x7f1c7c069d80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca0152bd0 0x7f1ca00cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ca01604a0 0x7f1ca01f51a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 --2- 172.21.15.5:0/3605762024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca01600c0 0x7f1ca0151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 -- 172.21.15.5:0/3605762024 >> 172.21.15.5:0/3605762024 conn(0x7f1ca006b9b0 msgr2=0x7f1ca00ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 -- 172.21.15.5:0/3605762024 shutdown_connections 2024-08-18T22:19:44.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:43.994+0000 7f1ca7000640 1 -- 172.21.15.5:0/3605762024 wait complete. 2024-08-18T22:19:44.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-18T22:19:44.021 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-18T22:19:44.021 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-18T22:19:44.021 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-18T22:19:44.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-18T22:19:44.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-18T22:19:44.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-18T22:19:44.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-18T22:19:44.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.262+0000 7f5b22200640 1 Processor -- start 2024-08-18T22:19:44.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.262+0000 7f5b22200640 1 -- start start 2024-08-18T22:19:44.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b22200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b1c165ae0 0x7f5b1c071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b22200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b1c0b3c30 0x7f5b1c0b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b21800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5b1c06e050 0x7f5b1c0aee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38584/0 (socket says 172.21.15.5:38584) 2024-08-18T22:19:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b21800640 1 -- 172.21.15.5:0/3049114559 learned_addr learned my addr 172.21.15.5:0/3049114559 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f2aefc00640 1 Processor -- start 2024-08-18T22:19:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b1be00640 1 --2- 172.21.15.5:0/3049114559 >> v2:172.21.15.117:3300/0 conn(0x7f5b1c0b3c30 0x7f5b1c0b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f2aefc00640 1 -- start start 2024-08-18T22:19:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b20e00640 1 --2- 172.21.15.5:0/3049114559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b1c165ae0 0x7f5b1c071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b22200640 1 -- 172.21.15.5:0/3049114559 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b1c0adaf0 con 0x7f5b1c06e050 2024-08-18T22:19:44.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b22200640 1 -- 172.21.15.5:0/3049114559 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5b1c165ec0 con 0x7f5b1c0b3c30 2024-08-18T22:19:44.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b22200640 1 -- 172.21.15.5:0/3049114559 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1c0ae980 con 0x7f5b1c165ae0 2024-08-18T22:19:44.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b1be00640 1 -- 172.21.15.5:0/3049114559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b1c165ae0 msgr2=0x7f5b1c071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b1be00640 1 --2- 172.21.15.5:0/3049114559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b1c165ae0 0x7f5b1c071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b1b400640 1 -- 172.21.15.5:0/3049114559 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056462492 0 0) 0x7f5b140014a0 con 0x7f5b1c06e050 2024-08-18T22:19:44.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.266+0000 7f5b1be00640 1 -- 172.21.15.5:0/3049114559 >> v1:172.21.15.5:6789/0 conn(0x7f5b1c06e050 legacy=0x7f5b1c0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f5b1be00640 1 -- 172.21.15.5:0/3049114559 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c0add70 con 0x7f5b1c0b3c30 2024-08-18T22:19:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2aefc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ae00eb420 0x7f2ae004eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2aefc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae00475b0 0x7f2ae004f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2aefc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ae001c600 con 0x7f2ae0033ad0 2024-08-18T22:19:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2aefc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2ae0033eb0 con 0x7f2ae00eb420 2024-08-18T22:19:44.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2aefc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae001c8e0 con 0x7f2ae00475b0 2024-08-18T22:19:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2aed200640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2ae0033ad0 0x7f2ae0009b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:44734/0 (socket says 172.21.15.5:44734) 2024-08-18T22:19:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2aed200640 1 -- 172.21.15.5:0/1806513476 learned_addr learned my addr 172.21.15.5:0/1806513476 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2aedc00640 1 --2- 172.21.15.5:0/1806513476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae00475b0 0x7f2ae004f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2ae7e00640 1 --2- 172.21.15.5:0/1806513476 >> v2:172.21.15.5:3300/0 conn(0x7f2ae00eb420 0x7f2ae004eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2ae7400640 1 -- 172.21.15.5:0/1806513476 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112878406 0 0) 0x7f2ae001c600 con 0x7f2ae0033ad0 2024-08-18T22:19:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2ae7400640 1 -- 172.21.15.5:0/1806513476 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ad0003530 con 0x7f2ae0033ad0 2024-08-18T22:19:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2ae7e00640 1 -- 172.21.15.5:0/1806513476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae00475b0 msgr2=0x7f2ae004f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2ae7e00640 1 --2- 172.21.15.5:0/1806513476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae00475b0 0x7f2ae004f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2ae7e00640 1 -- 172.21.15.5:0/1806513476 >> v1:172.21.15.117:6789/0 conn(0x7f2ae0033ad0 legacy=0x7f2ae0009b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.270+0000 7f2ae7e00640 1 -- 172.21.15.5:0/1806513476 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae001cbc0 con 0x7f2ae00eb420 2024-08-18T22:19:44.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0597e00640 1 Processor -- start 2024-08-18T22:19:44.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0597e00640 1 -- start start 2024-08-18T22:19:44.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b1be00640 1 --2- 172.21.15.5:0/3049114559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c0b3c30 0x7f5b1c0b4680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b100097c0 tx=0x7f5b1001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78dcf85402f48880 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b1b400640 1 -- 172.21.15.5:0/3049114559 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b100b0070 con 0x7f5b1c0b3c30 2024-08-18T22:19:44.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b1b400640 1 -- 172.21.15.5:0/3049114559 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b100ab600 con 0x7f5b1c0b3c30 2024-08-18T22:19:44.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f1274000640 1 Processor -- start 2024-08-18T22:19:44.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f1274000640 1 -- start start 2024-08-18T22:19:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b22200640 1 -- 172.21.15.5:0/3049114559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c0b3c30 msgr2=0x7f5b1c0b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b1b400640 1 -- 172.21.15.5:0/3049114559 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b100b0070 con 0x7f5b1c0b3c30 2024-08-18T22:19:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b22200640 1 --2- 172.21.15.5:0/3049114559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c0b3c30 0x7f5b1c0b4680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b100097c0 tx=0x7f5b1001c410 comp rx=0 tx=0).stop 2024-08-18T22:19:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0597e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f05900e5f90 0x7f0590053a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0597e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0590053f40 0x7f0590056d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b22200640 1 -- 172.21.15.5:0/3049114559 shutdown_connections 2024-08-18T22:19:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b22200640 1 --2- 172.21.15.5:0/3049114559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c0b3c30 0x7f5b1c0b4680 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b22200640 1 --2- 172.21.15.5:0/3049114559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b1c165ae0 0x7f5b1c071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b22200640 1 -- 172.21.15.5:0/3049114559 >> 172.21.15.5:0/3049114559 conn(0x7f5b1c06bb80 msgr2=0x7f5b1c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b22200640 1 -- 172.21.15.5:0/3049114559 shutdown_connections 2024-08-18T22:19:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f5b22200640 1 -- 172.21.15.5:0/3049114559 wait complete. 2024-08-18T22:19:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f2ae7e00640 1 --2- 172.21.15.5:0/1806513476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ae00eb420 0x7f2ae004eba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40097c0 tx=0x7f2ad401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fc0a150a04003f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f2ae7400640 1 -- 172.21.15.5:0/1806513476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40b0070 con 0x7f2ae00eb420 2024-08-18T22:19:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0597e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0590057280 0x7f0590005d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0597e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f059003bb60 con 0x7f0590057280 2024-08-18T22:19:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0597e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0590057ce0 con 0x7f05900e5f90 2024-08-18T22:19:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0597e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0590057fc0 con 0x7f0590053f40 2024-08-18T22:19:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7fa2d0c00640 1 Processor -- start 2024-08-18T22:19:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f2ae7400640 1 -- 172.21.15.5:0/1806513476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad40ab600 con 0x7f2ae00eb420 2024-08-18T22:19:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f2ae7400640 1 -- 172.21.15.5:0/1806513476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40ab9b0 con 0x7f2ae00eb420 2024-08-18T22:19:44.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0596a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f05900e5f90 0x7f0590053a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0596a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f05900e5f90 0x7f0590053a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40004/0 (socket says 172.21.15.5:40004) 2024-08-18T22:19:44.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0596a00640 1 -- 172.21.15.5:0/2238496040 learned_addr learned my addr 172.21.15.5:0/2238496040 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0596000640 1 --2- 172.21.15.5:0/2238496040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0590053f40 0x7f0590056d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f0597400640 1 --2- 172.21.15.5:0/2238496040 >> v2:172.21.15.5:3300/0 conn(0x7f0590057280 0x7f0590005d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f0596000640 1 -- 172.21.15.5:0/2238496040 >> v2:172.21.15.117:3300/0 conn(0x7f05900e5f90 msgr2=0x7f0590053a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f0596000640 1 --2- 172.21.15.5:0/2238496040 >> v2:172.21.15.117:3300/0 conn(0x7f05900e5f90 0x7f0590053a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f0596000640 1 -- 172.21.15.5:0/2238496040 >> v2:172.21.15.5:3300/0 conn(0x7f0590057280 msgr2=0x7f0590005d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f0596000640 1 --2- 172.21.15.5:0/2238496040 >> v2:172.21.15.5:3300/0 conn(0x7f0590057280 0x7f0590005d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f0596000640 1 -- 172.21.15.5:0/2238496040 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059003be00 con 0x7f0590053f40 2024-08-18T22:19:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f1274000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f126c072060 0x7f126c0b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.274+0000 7f1274000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 0x7f126c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f1274000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126c1612a0 con 0x7f126c15a970 2024-08-18T22:19:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f1274000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f126c073e00 con 0x7f126c072060 2024-08-18T22:19:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f1274000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f126c0b33d0 con 0x7f126c073620 2024-08-18T22:19:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f1270c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 0x7f126c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f1270c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 0x7f126c15a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47412/0 (socket says 172.21.15.5:47412) 2024-08-18T22:19:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f1270c00640 1 -- 172.21.15.5:0/2970932404 learned_addr learned my addr 172.21.15.5:0/2970932404 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f2aefc00640 1 -- 172.21.15.5:0/1806513476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ae00eb420 msgr2=0x7f2ae004eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f2aefc00640 1 --2- 172.21.15.5:0/1806513476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ae00eb420 0x7f2ae004eba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40097c0 tx=0x7f2ad401c3e0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f5b22200640 1 Processor -- start 2024-08-18T22:19:44.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f2aefc00640 1 -- 172.21.15.5:0/1806513476 shutdown_connections 2024-08-18T22:19:44.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f2aefc00640 1 --2- 172.21.15.5:0/1806513476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae00475b0 0x7f2ae004f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f2aefc00640 1 --2- 172.21.15.5:0/1806513476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ae00eb420 0x7f2ae004eba0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f2aefc00640 1 -- 172.21.15.5:0/1806513476 >> 172.21.15.5:0/1806513476 conn(0x7f2ae00360d0 msgr2=0x7f2ae00364b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f1270c00640 1 -- 172.21.15.5:0/2970932404 >> v2:172.21.15.117:3300/0 conn(0x7f126c072060 msgr2=0x7f126c0b52a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:19:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f1270c00640 1 --2- 172.21.15.5:0/2970932404 >> v2:172.21.15.117:3300/0 conn(0x7f126c072060 0x7f126c0b52a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f1270c00640 1 -- 172.21.15.5:0/2970932404 >> v1:172.21.15.117:6789/0 conn(0x7f126c15a970 legacy=0x7f126c0cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f1270c00640 1 -- 172.21.15.5:0/2970932404 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c0b43b0 con 0x7f126c073620 2024-08-18T22:19:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f2aefc00640 1 -- 172.21.15.5:0/1806513476 shutdown_connections 2024-08-18T22:19:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7fa2d0c00640 1 -- start start 2024-08-18T22:19:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f2aefc00640 1 -- 172.21.15.5:0/1806513476 wait complete. 2024-08-18T22:19:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f5b22200640 1 -- start start 2024-08-18T22:19:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7fdf23200640 1 Processor -- start 2024-08-18T22:19:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f5b22200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b1c06e050 0x7f5b1c155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.278+0000 7f5b22200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c0b3c30 0x7f5b1c156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b22200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b1c165ae0 0x7f5b1c15d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b20e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b1c06e050 0x7f5b1c155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b1be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c0b3c30 0x7f5b1c156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b1be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c0b3c30 0x7f5b1c156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40018/0 (socket says 172.21.15.5:40018) 2024-08-18T22:19:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b20e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b1c06e050 0x7f5b1c155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47428/0 (socket says 172.21.15.5:47428) 2024-08-18T22:19:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b1be00640 1 -- 172.21.15.5:0/443902975 learned_addr learned my addr 172.21.15.5:0/443902975 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b21800640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b1c165ae0 0x7f5b1c15d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2aefc00640 1 Processor -- start 2024-08-18T22:19:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2aefc00640 1 -- start start 2024-08-18T22:19:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f0596000640 1 --2- 172.21.15.5:0/2238496040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0590053f40 0x7f0590056d40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f059004fa40 tx=0x7f058401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b6be9d705dbf11c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2d0c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2c400a010 0x7fa2c400a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2caa00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa2c403a260 0x7fa2c4039260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:44760/0 (socket says 172.21.15.5:44760) 2024-08-18T22:19:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2caa00640 1 -- 172.21.15.5:0/2203104488 learned_addr learned my addr 172.21.15.5:0/2203104488 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2203104488 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c40540d0 con 0x7fa2c4005a60 2024-08-18T22:19:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2203104488 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c4036ed0 con 0x7fa2c403a260 2024-08-18T22:19:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2cb400640 1 --2- 172.21.15.5:0/2203104488 >> v2:172.21.15.5:3300/0 conn(0x7fa2c400a010 0x7fa2c400a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf23200640 1 -- start start 2024-08-18T22:19:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2203104488 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa2c4054d60 con 0x7fa2c400a010 2024-08-18T22:19:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f549d200640 1 Processor -- start 2024-08-18T22:19:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c071f60 con 0x7f5b1c165ae0 2024-08-18T22:19:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fda6ea00640 1 Processor -- start 2024-08-18T22:19:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c0ae610 con 0x7f5b1c0b3c30 2024-08-18T22:19:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1c06e8b0 con 0x7f5b1c06e050 2024-08-18T22:19:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2ca000640 1 -- 172.21.15.5:0/2203104488 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2888696877 0 0) 0x7fa2c40540d0 con 0x7fa2c4005a60 2024-08-18T22:19:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2ca000640 1 -- 172.21.15.5:0/2203104488 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2b4003530 con 0x7fa2c4005a60 2024-08-18T22:19:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2ca000640 1 -- 172.21.15.5:0/2203104488 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2389219173 0 0) 0x7fa2c4036ed0 con 0x7fa2c403a260 2024-08-18T22:19:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2ca000640 1 -- 172.21.15.5:0/2203104488 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c40540d0 con 0x7fa2c403a260 2024-08-18T22:19:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f0595600640 1 -- 172.21.15.5:0/2238496040 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05840b0070 con 0x7f0590053f40 2024-08-18T22:19:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f549d200640 1 -- start start 2024-08-18T22:19:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2aefc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae0033ad0 0x7f2ae0048080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf23200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf1c06e110 0x7fdf1c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2cb400640 1 -- 172.21.15.5:0/2203104488 >> v1:172.21.15.117:6789/0 conn(0x7fa2c403a260 legacy=0x7fa2c4039260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f0595600640 1 -- 172.21.15.5:0/2238496040 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05840ab600 con 0x7f0590053f40 2024-08-18T22:19:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f0595600640 1 -- 172.21.15.5:0/2238496040 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05840ab9d0 con 0x7f0590053f40 2024-08-18T22:19:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2cb400640 1 -- 172.21.15.5:0/2203104488 >> v1:172.21.15.5:6789/0 conn(0x7fa2c4005a60 legacy=0x7fa2c4039970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fda6ea00640 1 -- start start 2024-08-18T22:19:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2aefc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ae00475b0 0x7f2ae00de150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b20e00640 1 -- 172.21.15.5:0/443902975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c0b3c30 msgr2=0x7f5b1c156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b20e00640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c0b3c30 0x7f5b1c156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b20e00640 1 -- 172.21.15.5:0/443902975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b1c165ae0 msgr2=0x7f5b1c15d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b20e00640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b1c165ae0 0x7f5b1c15d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f5b20e00640 1 -- 172.21.15.5:0/443902975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c15bea0 con 0x7f5b1c06e050 2024-08-18T22:19:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2aed200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae0033ad0 0x7f2ae0048080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2aed200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae0033ad0 0x7f2ae0048080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47444/0 (socket says 172.21.15.5:47444) 2024-08-18T22:19:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2aed200640 1 -- 172.21.15.5:0/2916440327 learned_addr learned my addr 172.21.15.5:0/2916440327 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2aefc00640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ae00eb420 0x7f2ae0032500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2aefc00640 1 -- 172.21.15.5:0/2916440327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae001dd50 con 0x7f2ae00475b0 2024-08-18T22:19:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2aefc00640 1 -- 172.21.15.5:0/2916440327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae001dbd0 con 0x7f2ae00eb420 2024-08-18T22:19:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2aefc00640 1 -- 172.21.15.5:0/2916440327 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae001ded0 con 0x7f2ae0033ad0 2024-08-18T22:19:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f2ae7e00640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ae00475b0 0x7f2ae00de150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f0597e00640 1 -- 172.21.15.5:0/2238496040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0590053f40 msgr2=0x7f0590056d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f0597e00640 1 --2- 172.21.15.5:0/2238496040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0590053f40 0x7f0590056d40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f059004fa40 tx=0x7f058401c450 comp rx=0 tx=0).stop 2024-08-18T22:19:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fa2cb400640 1 -- 172.21.15.5:0/2203104488 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c4055040 con 0x7fa2c400a010 2024-08-18T22:19:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f1270c00640 1 --2- 172.21.15.5:0/2970932404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 0x7f126c15a430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1258009870 tx=0x7f125801c550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d2755330df85af2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f126be00640 1 -- 172.21.15.5:0/2970932404 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12580a9610 con 0x7f126c073620 2024-08-18T22:19:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f126be00640 1 -- 172.21.15.5:0/2970932404 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12580a97b0 con 0x7f126c073620 2024-08-18T22:19:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7f126be00640 1 -- 172.21.15.5:0/2970932404 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12580a9610 con 0x7f126c073620 2024-08-18T22:19:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf23200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdf1c0b37d0 0x7fdf1c0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf23200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf1c14c760 con 0x7fdf1c14bef0 2024-08-18T22:19:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf23200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdf1c06ea30 con 0x7fdf1c06e110 2024-08-18T22:19:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf23200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdf1c06ec90 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf1b400640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fdf1c14bef0 0x7fdf1c0b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:44770/0 (socket says 172.21.15.5:44770) 2024-08-18T22:19:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf1b400640 1 -- 172.21.15.5:0/1833964233 learned_addr learned my addr 172.21.15.5:0/1833964233 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf1be00640 1 --2- 172.21.15.5:0/1833964233 >> v2:172.21.15.5:3300/0 conn(0x7fdf1c06e110 0x7fdf1c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf21200640 1 --2- 172.21.15.5:0/1833964233 >> v2:172.21.15.117:3300/0 conn(0x7fdf1c0b37d0 0x7fdf1c0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf1be00640 1 -- 172.21.15.5:0/1833964233 >> v2:172.21.15.117:3300/0 conn(0x7fdf1c0b37d0 msgr2=0x7fdf1c0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf1be00640 1 --2- 172.21.15.5:0/1833964233 >> v2:172.21.15.117:3300/0 conn(0x7fdf1c0b37d0 0x7fdf1c0ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf1be00640 1 -- 172.21.15.5:0/1833964233 >> v1:172.21.15.117:6789/0 conn(0x7fdf1c14bef0 legacy=0x7fdf1c0b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.282+0000 7fdf1be00640 1 -- 172.21.15.5:0/1833964233 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1c06ef70 con 0x7fdf1c06e110 2024-08-18T22:19:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f0597e00640 1 -- 172.21.15.5:0/2238496040 shutdown_connections 2024-08-18T22:19:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f0597e00640 1 --2- 172.21.15.5:0/2238496040 >> v2:172.21.15.5:3300/0 conn(0x7f0590057280 0x7f0590005d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f0597e00640 1 --2- 172.21.15.5:0/2238496040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0590053f40 0x7f0590056d40 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f059004fa40 tx=0x7f058401c450 comp rx=0 tx=0).stop 2024-08-18T22:19:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f0597e00640 1 --2- 172.21.15.5:0/2238496040 >> v2:172.21.15.117:3300/0 conn(0x7f05900e5f90 0x7f0590053a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f0597e00640 1 -- 172.21.15.5:0/2238496040 >> 172.21.15.5:0/2238496040 conn(0x7f059003a4b0 msgr2=0x7f059003a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5b20e00640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b1c06e050 0x7f5b1c155dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00e870 tx=0x7f5b0c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f2aedc00640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ae00eb420 0x7f2ae0032500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f2ae7e00640 1 -- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae0033ad0 msgr2=0x7f2ae0048080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f0597e00640 1 -- 172.21.15.5:0/2238496040 shutdown_connections 2024-08-18T22:19:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f1274000640 1 -- 172.21.15.5:0/2970932404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 msgr2=0x7f126c15a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f1274000640 1 --2- 172.21.15.5:0/2970932404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 0x7f126c15a430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1258009870 tx=0x7f125801c550 comp rx=0 tx=0).stop 2024-08-18T22:19:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f2ae7e00640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae0033ad0 0x7f2ae0048080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f2ae7e00640 1 -- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ae00eb420 msgr2=0x7f2ae0032500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f2ae7e00640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ae00eb420 0x7f2ae0032500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f2ae7e00640 1 -- 172.21.15.5:0/2916440327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae00df5b0 con 0x7f2ae00475b0 2024-08-18T22:19:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f2aedc00640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ae00eb420 0x7f2ae0032500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f2aed200640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae0033ad0 0x7f2ae0048080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7fda6ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815b1c0 0x7fda680ae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5b18c00640 1 -- 172.21.15.5:0/443902975 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c017070 con 0x7f5b1c06e050 2024-08-18T22:19:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5b18c00640 1 -- 172.21.15.5:0/443902975 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c00c940 con 0x7f5b1c06e050 2024-08-18T22:19:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5b18c00640 1 -- 172.21.15.5:0/443902975 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00ccf0 con 0x7f5b1c06e050 2024-08-18T22:19:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7fda6ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda680b4850 0x7fda680b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7fda67e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815b1c0 0x7fda680ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7fda6ea00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda680aec70 con 0x7fda680d1d20 2024-08-18T22:19:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7fda6ea00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fda680aef50 con 0x7fda680b4850 2024-08-18T22:19:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7fda67e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815b1c0 0x7fda680ae670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47450/0 (socket says 172.21.15.5:47450) 2024-08-18T22:19:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7fda6ea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fda680af230 con 0x7fda6815b1c0 2024-08-18T22:19:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7fda67e00640 1 -- 172.21.15.5:0/2353603904 learned_addr learned my addr 172.21.15.5:0/2353603904 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f549d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f549815fb10 0x7f54980d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f549d200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54980ce750 con 0x7f54980d2ca0 2024-08-18T22:19:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f549d200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f549806fc70 con 0x7f549809b150 2024-08-18T22:19:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f549d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f54980ce500 con 0x7f549815fb10 2024-08-18T22:19:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1c15c180 con 0x7f5b1c06e050 2024-08-18T22:19:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1c15c740 con 0x7f5b1c06e050 2024-08-18T22:19:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5495e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f549815fb10 0x7f54980d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5495e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f549815fb10 0x7f54980d1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47458/0 (socket says 172.21.15.5:47458) 2024-08-18T22:19:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5496800640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f549809b150 0x7f54980b50f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:44776/0 (socket says 172.21.15.5:44776) 2024-08-18T22:19:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5495e00640 1 -- 172.21.15.5:0/940105036 learned_addr learned my addr 172.21.15.5:0/940105036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5495e00640 1 -- 172.21.15.5:0/940105036 >> v1:172.21.15.117:6789/0 conn(0x7f549809b150 legacy=0x7f54980b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5495e00640 1 -- 172.21.15.5:0/940105036 >> v1:172.21.15.5:6789/0 conn(0x7f54980d2ca0 legacy=0x7f549809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5495e00640 1 -- 172.21.15.5:0/940105036 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549806ff50 con 0x7f549815fb10 2024-08-18T22:19:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f2ae7e00640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ae00475b0 0x7f2ae00de150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40ab000 tx=0x7f2ad40191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b1c06d620 con 0x7f5b1c06e050 2024-08-18T22:19:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f1274000640 1 -- 172.21.15.5:0/2970932404 shutdown_connections 2024-08-18T22:19:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f1274000640 1 --2- 172.21.15.5:0/2970932404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 0x7f126c15a430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f1274000640 1 --2- 172.21.15.5:0/2970932404 >> v2:172.21.15.117:3300/0 conn(0x7f126c072060 0x7f126c0b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f1274000640 1 -- 172.21.15.5:0/2970932404 >> 172.21.15.5:0/2970932404 conn(0x7f126c0b5800 msgr2=0x7f126c072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f0597e00640 1 -- 172.21.15.5:0/2238496040 wait complete. 2024-08-18T22:19:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f0597e00640 1 Processor -- start 2024-08-18T22:19:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f0597e00640 1 -- start start 2024-08-18T22:19:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.286+0000 7f1274000640 1 -- 172.21.15.5:0/2970932404 shutdown_connections 2024-08-18T22:19:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f1274000640 1 -- 172.21.15.5:0/2970932404 wait complete. 2024-08-18T22:19:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fda6ca00640 1 --2- 172.21.15.5:0/2353603904 >> v2:172.21.15.5:3300/0 conn(0x7fda680b4850 0x7fda680b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fda66a00640 1 -- 172.21.15.5:0/2353603904 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2133121965 0 0) 0x7fda680aec70 con 0x7fda680d1d20 2024-08-18T22:19:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fda66a00640 1 -- 172.21.15.5:0/2353603904 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda4c003530 con 0x7fda680d1d20 2024-08-18T22:19:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fda6ca00640 1 -- 172.21.15.5:0/2353603904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815b1c0 msgr2=0x7fda680ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fda6ca00640 1 --2- 172.21.15.5:0/2353603904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815b1c0 0x7fda680ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fda6ca00640 1 -- 172.21.15.5:0/2353603904 >> v1:172.21.15.5:6789/0 conn(0x7fda680d1d20 legacy=0x7fda6815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fa2cb400640 1 --2- 172.21.15.5:0/2203104488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c400a010 0x7fa2c400a3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00097d0 tx=0x7fa2c001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a1026feeceb95 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fda6ca00640 1 -- 172.21.15.5:0/2353603904 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda680af510 con 0x7fda680b4850 2024-08-18T22:19:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fa2ca000640 1 -- 172.21.15.5:0/2203104488 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00b0070 con 0x7fa2c400a010 2024-08-18T22:19:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f1274000640 1 Processor -- start 2024-08-18T22:19:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fa2ca000640 1 -- 172.21.15.5:0/2203104488 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c00ab600 con 0x7fa2c400a010 2024-08-18T22:19:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f5b18c00640 1 -- 172.21.15.5:0/443902975 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b0c01a070 con 0x7f5b1c06e050 2024-08-18T22:19:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f0597e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0590057280 0x7f05901889c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f0597e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05900e5f90 0x7f059004c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f0596a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0590057280 0x7f05901889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f0596a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0590057280 0x7f05901889c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40040/0 (socket says 172.21.15.5:40040) 2024-08-18T22:19:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f0596a00640 1 -- 172.21.15.5:0/2582190509 learned_addr learned my addr 172.21.15.5:0/2582190509 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fdf1be00640 1 --2- 172.21.15.5:0/1833964233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c06e110 0x7fdf1c06e4f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c06c9d0 tx=0x7fdf0801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8dd7150c1048fc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fdf1aa00640 1 -- 172.21.15.5:0/1833964233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf080b0070 con 0x7fdf1c06e110 2024-08-18T22:19:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2203104488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c400a010 msgr2=0x7fa2c400a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fa2ca000640 1 -- 172.21.15.5:0/2203104488 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00b0070 con 0x7fa2c400a010 2024-08-18T22:19:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f2ae4c00640 1 -- 172.21.15.5:0/2916440327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40b0040 con 0x7f2ae00475b0 2024-08-18T22:19:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f2ae4c00640 1 -- 172.21.15.5:0/2916440327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad40ab9b0 con 0x7f2ae00475b0 2024-08-18T22:19:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f2ae4c00640 1 -- 172.21.15.5:0/2916440327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40abd80 con 0x7f2ae00475b0 2024-08-18T22:19:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f2aefc00640 1 -- 172.21.15.5:0/2916440327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae00df890 con 0x7f2ae00475b0 2024-08-18T22:19:44.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fa2d0c00640 1 --2- 172.21.15.5:0/2203104488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c400a010 0x7fa2c400a3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00097d0 tx=0x7fa2c001c480 comp rx=0 tx=0).stop 2024-08-18T22:19:44.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7fdf1aa00640 1 -- 172.21.15.5:0/1833964233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf080ab600 con 0x7fdf1c06e110 2024-08-18T22:19:44.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f2aefc00640 1 -- 172.21.15.5:0/2916440327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae0038650 con 0x7f2ae00475b0 2024-08-18T22:19:44.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f1274000640 1 -- start start 2024-08-18T22:19:44.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f1274000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f126c072060 0x7f126c148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f5495e00640 1 --2- 172.21.15.5:0/940105036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f549815fb10 0x7f54980d1b30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f54880098a0 tx=0x7f548801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=609bd4962ad5e0b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f0597e00640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05900378b0 0x7f059004c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f1274000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 0x7f126c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f1271600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f126c072060 0x7f126c148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1271600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f126c072060 0x7f126c148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40044/0 (socket says 172.21.15.5:40044) 2024-08-18T22:19:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f5b18c00640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b00067990 0x7f5b00069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f059003c990 con 0x7f05900e5f90 2024-08-18T22:19:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f5494a00640 1 -- 172.21.15.5:0/940105036 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54880b1070 con 0x7f549815fb10 2024-08-18T22:19:44.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f5494a00640 1 -- 172.21.15.5:0/940105036 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54880ac640 con 0x7f549815fb10 2024-08-18T22:19:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.290+0000 7f5494a00640 1 -- 172.21.15.5:0/940105036 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54880aca10 con 0x7f549815fb10 2024-08-18T22:19:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0597400640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05900378b0 0x7f059004c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1271600640 1 -- 172.21.15.5:0/1740433899 learned_addr learned my addr 172.21.15.5:0/1740433899 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fdf1aa00640 1 -- 172.21.15.5:0/1833964233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf080ab9d0 con 0x7fdf1c06e110 2024-08-18T22:19:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fdf23200640 1 -- 172.21.15.5:0/1833964233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c06e110 msgr2=0x7fdf1c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fdf23200640 1 --2- 172.21.15.5:0/1833964233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c06e110 0x7fdf1c06e4f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c06c9d0 tx=0x7fdf0801c310 comp rx=0 tx=0).stop 2024-08-18T22:19:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2203104488 shutdown_connections 2024-08-18T22:19:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fa2d0c00640 1 --2- 172.21.15.5:0/2203104488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c400a010 0x7fa2c400a3f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2203104488 >> 172.21.15.5:0/2203104488 conn(0x7fa2c401d940 msgr2=0x7fa2c40545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f2aefc00640 1 -- 172.21.15.5:0/2916440327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ac4001040 con 0x7f2ae00475b0 2024-08-18T22:19:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f5b18c00640 1 -- 172.21.15.5:0/443902975 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5b0c086250 con 0x7f5b1c06e050 2024-08-18T22:19:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fdf23200640 1 -- 172.21.15.5:0/1833964233 shutdown_connections 2024-08-18T22:19:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fdf23200640 1 --2- 172.21.15.5:0/1833964233 >> v2:172.21.15.117:3300/0 conn(0x7fdf1c0b37d0 0x7fdf1c0ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fdf23200640 1 --2- 172.21.15.5:0/1833964233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c06e110 0x7fdf1c06e4f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fdf23200640 1 -- 172.21.15.5:0/1833964233 >> 172.21.15.5:0/1833964233 conn(0x7fdf1c0b1dc0 msgr2=0x7fdf1c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f5b18c00640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x7f5b00071090 0x7f5b000734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f5b18c00640 1 -- 172.21.15.5:0/443902975 --> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b0c014e50 con 0x7f5b00071090 2024-08-18T22:19:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2203104488 shutdown_connections 2024-08-18T22:19:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2203104488 wait complete. 2024-08-18T22:19:44.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f549d200640 1 -- 172.21.15.5:0/940105036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f549815fb10 msgr2=0x7f54980d1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1270c00640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 0x7f126c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1274000640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f126c15a970 0x7f126c1614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1274000640 1 -- 172.21.15.5:0/1740433899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f126c0cd240 con 0x7f126c15a970 2024-08-18T22:19:44.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1274000640 1 -- 172.21.15.5:0/1740433899 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f126c0cd0c0 con 0x7f126c072060 2024-08-18T22:19:44.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1274000640 1 -- 172.21.15.5:0/1740433899 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f126c0ad9f0 con 0x7f126c073620 2024-08-18T22:19:44.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f549d200640 1 --2- 172.21.15.5:0/940105036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f549815fb10 0x7f54980d1b30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f54880098a0 tx=0x7f548801c540 comp rx=0 tx=0).stop 2024-08-18T22:19:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0596000640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05900e5f90 0x7f059004c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f059003c810 con 0x7f0590057280 2024-08-18T22:19:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f059003cb10 con 0x7f05900378b0 2024-08-18T22:19:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f5b18c00640 1 -- 172.21.15.5:0/443902975 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5b0c08d050 con 0x7f5b1c06e050 2024-08-18T22:19:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f5b1be00640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b00067990 0x7f5b00069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f5b21800640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x7f5b00071090 0x7f5b000734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f549d200640 1 -- 172.21.15.5:0/940105036 shutdown_connections 2024-08-18T22:19:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f549d200640 1 --2- 172.21.15.5:0/940105036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f549815fb10 0x7f54980d1b30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f549d200640 1 -- 172.21.15.5:0/940105036 >> 172.21.15.5:0/940105036 conn(0x7f54980d2180 msgr2=0x7f54980d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1272000640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f126c15a970 0x7f126c1614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fdf23200640 1 -- 172.21.15.5:0/1833964233 shutdown_connections 2024-08-18T22:19:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fdf23200640 1 -- 172.21.15.5:0/1833964233 wait complete. 2024-08-18T22:19:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0597400640 1 -- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0590057280 msgr2=0x7f05901889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1270c00640 1 -- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f126c072060 msgr2=0x7f126c148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1270c00640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f126c072060 0x7f126c148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1270c00640 1 -- 172.21.15.5:0/1740433899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f126c15a970 msgr2=0x7f126c1614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1270c00640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f126c15a970 0x7f126c1614a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1270c00640 1 -- 172.21.15.5:0/1740433899 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c15d030 con 0x7f126c073620 2024-08-18T22:19:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1271600640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f126c072060 0x7f126c148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f549d200640 1 -- 172.21.15.5:0/940105036 shutdown_connections 2024-08-18T22:19:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f549d200640 1 -- 172.21.15.5:0/940105036 wait complete. 2024-08-18T22:19:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f5b1be00640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b00067990 0x7f5b00069e50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5b1001aac0 tx=0x7f5b100a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0597400640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0590057280 0x7f05901889c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0597400640 1 -- 172.21.15.5:0/2582190509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05900e5f90 msgr2=0x7f059004c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0597400640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05900e5f90 0x7f059004c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0597400640 1 -- 172.21.15.5:0/2582190509 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05900e2570 con 0x7f05900378b0 2024-08-18T22:19:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0597400640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05900378b0 0x7f059004c840 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0598050b40 tx=0x7f0598068e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f058ea00640 1 -- 172.21.15.5:0/2582190509 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598099070 con 0x7f05900378b0 2024-08-18T22:19:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f058ea00640 1 -- 172.21.15.5:0/2582190509 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0598069cb0 con 0x7f05900378b0 2024-08-18T22:19:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f058ea00640 1 -- 172.21.15.5:0/2582190509 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059806ce20 con 0x7f05900378b0 2024-08-18T22:19:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05900e2830 con 0x7f05900378b0 2024-08-18T22:19:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1270c00640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 0x7f126c160b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f12580aa000 tx=0x7f12580192f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1269600640 1 -- 172.21.15.5:0/1740433899 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12580a9c20 con 0x7f126c073620 2024-08-18T22:19:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1269600640 1 -- 172.21.15.5:0/1740433899 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12580a9dc0 con 0x7f126c073620 2024-08-18T22:19:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1269600640 1 -- 172.21.15.5:0/1740433899 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258003840 con 0x7f126c073620 2024-08-18T22:19:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fda6ca00640 1 --2- 172.21.15.5:0/2353603904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda680b4850 0x7fda680b1f60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda60009d90 tx=0x7fda6001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19f49f97ae965b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fda66a00640 1 -- 172.21.15.5:0/2353603904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda600b2070 con 0x7fda680b4850 2024-08-18T22:19:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fda66a00640 1 -- 172.21.15.5:0/2353603904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda600a5910 con 0x7fda680b4850 2024-08-18T22:19:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7fda66a00640 1 -- 172.21.15.5:0/2353603904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda600a5ce0 con 0x7fda680b4850 2024-08-18T22:19:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1274000640 1 -- 172.21.15.5:0/1740433899 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126c15ed50 con 0x7f126c073620 2024-08-18T22:19:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f1274000640 1 -- 172.21.15.5:0/1740433899 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f126c15f830 con 0x7f126c073620 2024-08-18T22:19:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f5b21800640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x7f5b00071090 0x7f5b000734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f2ae4c00640 1 -- 172.21.15.5:0/2916440327 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ad4003620 con 0x7f2ae00475b0 2024-08-18T22:19:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.294+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f059018d3c0 con 0x7f05900378b0 2024-08-18T22:19:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fa2d0c00640 1 Processor -- start 2024-08-18T22:19:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f125ea00640 1 -- 172.21.15.5:0/1740433899 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1240001040 con 0x7f126c073620 2024-08-18T22:19:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fda6ea00640 1 -- 172.21.15.5:0/2353603904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda680b4850 msgr2=0x7fda680b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fda6ea00640 1 --2- 172.21.15.5:0/2353603904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda680b4850 0x7fda680b1f60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda60009d90 tx=0x7fda6001c960 comp rx=0 tx=0).stop 2024-08-18T22:19:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf23200640 1 Processor -- start 2024-08-18T22:19:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f549d200640 1 Processor -- start 2024-08-18T22:19:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f5b18c00640 1 -- 172.21.15.5:0/443902975 <== osd.0 v2:172.21.15.5:6816/1731152634 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b0c014e50 con 0x7f5b00071090 2024-08-18T22:19:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f2ae4c00640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2ac8067990 0x7f2ac8069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f2ae4c00640 1 -- 172.21.15.5:0/2916440327 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2ad4120240 con 0x7f2ae00475b0 2024-08-18T22:19:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f2ae4c00640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] conn(0x7f2ac8071110 0x7f2ac8073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f2ae4c00640 1 -- 172.21.15.5:0/2916440327 --> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ad400af30 con 0x7f2ac8071110 2024-08-18T22:19:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f2ae4c00640 1 -- 172.21.15.5:0/2916440327 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2ad4120630 con 0x7f2ae00475b0 2024-08-18T22:19:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f2aed200640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2ac8067990 0x7f2ac8069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f2aedc00640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] conn(0x7f2ac8071110 0x7f2ac8073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0590188f00 con 0x7f05900378b0 2024-08-18T22:19:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f058ea00640 1 -- 172.21.15.5:0/2582190509 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0598063020 con 0x7f05900378b0 2024-08-18T22:19:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f058ea00640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05780679c0 0x7f0578069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fa2d0c00640 1 -- start start 2024-08-18T22:19:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fa2d0c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2c4005a60 0x7fa2c40d5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fa2d0c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c400a010 0x7fa2c40d4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fa2d0c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2c403a260 0x7fa2c40d7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fa2d0c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c400ab40 con 0x7fa2c400a010 2024-08-18T22:19:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fa2d0c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c4033790 con 0x7fa2c4005a60 2024-08-18T22:19:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fa2d0c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c40ea450 con 0x7fa2c403a260 2024-08-18T22:19:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2caa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c400a010 0x7fa2c40d4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2caa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c400a010 0x7fa2c40d4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40440/0 (socket says 172.21.15.5:40440) 2024-08-18T22:19:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2caa00640 1 -- 172.21.15.5:0/2615093376 learned_addr learned my addr 172.21.15.5:0/2615093376 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fda6ea00640 1 -- 172.21.15.5:0/2353603904 shutdown_connections 2024-08-18T22:19:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fda6ea00640 1 --2- 172.21.15.5:0/2353603904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda680b4850 0x7fda680b1f60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fda6ea00640 1 --2- 172.21.15.5:0/2353603904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda6815b1c0 0x7fda680ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fda6ea00640 1 -- 172.21.15.5:0/2353603904 >> 172.21.15.5:0/2353603904 conn(0x7fda680b65f0 msgr2=0x7fda680b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fda6ea00640 1 -- 172.21.15.5:0/2353603904 shutdown_connections 2024-08-18T22:19:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fda6ea00640 1 -- 172.21.15.5:0/2353603904 wait complete. 2024-08-18T22:19:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf23200640 1 -- start start 2024-08-18T22:19:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf23200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c06e110 0x7fdf1c09dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf23200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf1c0b37d0 0x7fdf1c166720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf23200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf1c14bef0 0x7fdf1c0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf23200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c06f530 con 0x7fdf1c06e110 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf23200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c0cdfb0 con 0x7fdf1c14bef0 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf23200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdf1c0cea10 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf1b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf1c0b37d0 0x7fdf1c166720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf1b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf1c0b37d0 0x7fdf1c166720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47496/0 (socket says 172.21.15.5:47496) 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf1b400640 1 -- 172.21.15.5:0/2989523536 learned_addr learned my addr 172.21.15.5:0/2989523536 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf21200640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf1c14bef0 0x7fdf1c0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf1be00640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c06e110 0x7fdf1c09dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf1b400640 1 -- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf1c14bef0 msgr2=0x7fdf1c0b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf1b400640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf1c14bef0 0x7fdf1c0b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7fdf1b400640 1 -- 172.21.15.5:0/2989523536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c06e110 msgr2=0x7fdf1c09dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fdf1b400640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c06e110 0x7fdf1c09dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fdf1b400640 1 -- 172.21.15.5:0/2989523536 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1c166c60 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fdf21200640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf1c14bef0 0x7fdf1c0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fdf1be00640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf1c06e110 0x7fdf1c09dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fdf1b400640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf1c0b37d0 0x7fdf1c166720 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009e80 tx=0x7fdf0c00c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f549d200640 1 -- start start 2024-08-18T22:19:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f549d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f549809b150 0x7f549814a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f549d200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54980d2ca0 0x7f5498149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f549d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f549815fb10 0x7f5498151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f549d200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f549806ce90 con 0x7f549809b150 2024-08-18T22:19:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f549d200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f549806cd10 con 0x7f54980d2ca0 2024-08-18T22:19:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f549d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f549806d010 con 0x7f549815fb10 2024-08-18T22:19:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f5495400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54980d2ca0 0x7f5498149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f5495400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54980d2ca0 0x7f5498149ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40048/0 (socket says 172.21.15.5:40048) 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f5495400640 1 -- 172.21.15.5:0/2769982203 learned_addr learned my addr 172.21.15.5:0/2769982203 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f5495e00640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f549809b150 0x7f549814a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.298+0000 7f5496800640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f549815fb10 0x7f5498151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f5495400640 1 -- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f549815fb10 msgr2=0x7f5498151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f5495400640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f549815fb10 0x7f5498151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f5495400640 1 -- 172.21.15.5:0/2769982203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f549809b150 msgr2=0x7f549814a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f5495400640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f549809b150 0x7f549814a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f5495400640 1 -- 172.21.15.5:0/2769982203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5498149ff0 con 0x7f54980d2ca0 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f5495400640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54980d2ca0 0x7f5498149ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f548400c410 tx=0x7f548400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f548e000640 1 -- 172.21.15.5:0/2769982203 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484017070 con 0x7f54980d2ca0 2024-08-18T22:19:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f548e000640 1 -- 172.21.15.5:0/2769982203 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5484003600 con 0x7f54980d2ca0 2024-08-18T22:19:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f548e000640 1 -- 172.21.15.5:0/2769982203 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54840039f0 con 0x7f54980d2ca0 2024-08-18T22:19:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f549d200640 1 -- 172.21.15.5:0/2769982203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54981fb890 con 0x7f54980d2ca0 2024-08-18T22:19:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2caa00640 1 -- 172.21.15.5:0/2615093376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2c403a260 msgr2=0x7fa2c40d7b40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-18T22:19:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2caa00640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2c403a260 0x7fa2c40d7b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2caa00640 1 -- 172.21.15.5:0/2615093376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2c4005a60 msgr2=0x7fa2c40d5200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-18T22:19:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2caa00640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2c4005a60 0x7fa2c40d5200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2caa00640 1 -- 172.21.15.5:0/2615093376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c40d63f0 con 0x7fa2c400a010 2024-08-18T22:19:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f058ea00640 1 -- 172.21.15.5:0/2582190509 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0598100db0 con 0x7f05900378b0 2024-08-18T22:19:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f0596a00640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05780679c0 0x7f0578069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f058ea00640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x7f05780710b0 0x7f05780734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f058ea00640 1 -- 172.21.15.5:0/2582190509 --> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0598070e50 con 0x7f05780710b0 2024-08-18T22:19:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fdf13e00640 1 -- 172.21.15.5:0/2989523536 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c019070 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fdf13e00640 1 -- 172.21.15.5:0/2989523536 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf0c0078f0 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fdf13e00640 1 -- 172.21.15.5:0/2989523536 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c007ce0 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f549d200640 1 -- 172.21.15.5:0/2769982203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54981fbe50 con 0x7f54980d2ca0 2024-08-18T22:19:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f549d200640 1 -- 172.21.15.5:0/2769982203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54980d1b30 con 0x7f54980d2ca0 2024-08-18T22:19:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f058ea00640 1 -- 172.21.15.5:0/2582190509 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f05980cd270 con 0x7f05900378b0 2024-08-18T22:19:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2caa00640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c400a010 0x7fa2c40d4a40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800c3f0 tx=0x7fa2b800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f0596a00640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05780679c0 0x7f0578069e80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0588006f50 tx=0x7f0588009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2bf400640 1 -- 172.21.15.5:0/2615093376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8017070 con 0x7fa2c400a010 2024-08-18T22:19:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f1269600640 1 -- 172.21.15.5:0/1740433899 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f12580039e0 con 0x7f126c073620 2024-08-18T22:19:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f0596000640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x7f05780710b0 0x7f05780734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f548e000640 1 -- 172.21.15.5:0/2769982203 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f548401a070 con 0x7f54980d2ca0 2024-08-18T22:19:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f1269600640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f124c0678c0 0x7f124c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f2aed200640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2ac8067990 0x7f2ac8069e50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2adc007fd0 tx=0x7f2adc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f2aedc00640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] conn(0x7f2ac8071110 0x7f2ac8073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7f2ae4c00640 1 -- 172.21.15.5:0/2916440327 <== osd.1 v2:172.21.15.5:6808/1222447850 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ad400af30 con 0x7f2ac8071110 2024-08-18T22:19:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f1269600640 1 -- 172.21.15.5:0/1740433899 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1258120700 con 0x7f126c073620 2024-08-18T22:19:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2bf400640 1 -- 172.21.15.5:0/2615093376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b8005cf0 con 0x7fa2c400a010 2024-08-18T22:19:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2bf400640 1 -- 172.21.15.5:0/2615093376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b80072f0 con 0x7fa2c400a010 2024-08-18T22:19:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.302+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2615093376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c40d8080 con 0x7fa2c400a010 2024-08-18T22:19:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2615093376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c40d5ac0 con 0x7fa2c400a010 2024-08-18T22:19:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7fda6ea00640 1 Processor -- start 2024-08-18T22:19:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f1271600640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f124c0678c0 0x7f124c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f1269600640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] conn(0x7f124c070fb0 0x7f124c0733f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f1269600640 1 -- 172.21.15.5:0/1740433899 --> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12580a8e50 con 0x7f124c070fb0 2024-08-18T22:19:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f0596000640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x7f05780710b0 0x7f05780734f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f548e000640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5478067910 0x7f5478069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2615093376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2c4008870 con 0x7fa2c400a010 2024-08-18T22:19:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f1272000640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] conn(0x7f124c070fb0 0x7f124c0733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f1269600640 1 -- 172.21.15.5:0/1740433899 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1258127050 con 0x7f126c073620 2024-08-18T22:19:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f5495e00640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5478067910 0x7f5478069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f548e000640 1 -- 172.21.15.5:0/2769982203 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f54840533b0 con 0x7f54980d2ca0 2024-08-18T22:19:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f548e000640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] conn(0x7f5478071090 0x7f54780734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f548e000640 1 -- 172.21.15.5:0/2769982203 --> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f548401ae50 con 0x7f5478071090 2024-08-18T22:19:44.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f548e000640 1 -- 172.21.15.5:0/2769982203 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f548408a060 con 0x7f54980d2ca0 2024-08-18T22:19:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7fdf23200640 1 -- 172.21.15.5:0/2989523536 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1c1ecd80 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7fdf23200640 1 -- 172.21.15.5:0/2989523536 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf1c1ed340 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f1272000640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] conn(0x7f124c070fb0 0x7f124c0733f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f058ea00640 1 -- 172.21.15.5:0/2582190509 <== osd.2 v2:172.21.15.5:6800/3144131686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0598070e50 con 0x7f05780710b0 2024-08-18T22:19:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7f5495e00640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5478067910 0x7f5478069dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54880ae000 tx=0x7f54880a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7fdf23200640 1 -- 172.21.15.5:0/2989523536 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf1c06e4f0 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.306+0000 7fa2bf400640 1 -- 172.21.15.5:0/2615093376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa2b801a070 con 0x7fa2c400a010 2024-08-18T22:19:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7f5496800640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] conn(0x7f5478071090 0x7f54780734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7f1269600640 1 -- 172.21.15.5:0/1740433899 <== osd.4 v2:172.21.15.117:6800/79447292 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f12580a8e50 con 0x7f124c070fb0 2024-08-18T22:19:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fa2bf400640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2ac067910 0x7fa2ac069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7f5496800640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] conn(0x7f5478071090 0x7f54780734d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fa2bf400640 1 -- 172.21.15.5:0/2615093376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa2b8085a70 con 0x7fa2c400a010 2024-08-18T22:19:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fdf13e00640 1 -- 172.21.15.5:0/2989523536 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdf0c01c070 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fa2bf400640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] conn(0x7fa2ac071090 0x7fa2ac0734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fa2cb400640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2ac067910 0x7fa2ac069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fa2bf400640 1 -- 172.21.15.5:0/2615093376 --> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2ac073ba0 con 0x7fa2ac071090 2024-08-18T22:19:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fa2bf400640 1 -- 172.21.15.5:0/2615093376 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa2b8085f50 con 0x7fa2c400a010 2024-08-18T22:19:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fa2cbe00640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] conn(0x7fa2ac071090 0x7fa2ac0734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7f548e000640 1 -- 172.21.15.5:0/2769982203 <== osd.7 v2:172.21.15.117:6810/2024227284 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f548401ae50 con 0x7f5478071090 2024-08-18T22:19:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fa2cb400640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2ac067910 0x7fa2ac069dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00ad000 tx=0x7fa2c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fa2cbe00640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] conn(0x7fa2ac071090 0x7fa2ac0734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fdf13e00640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdefc067990 0x7fdefc069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fdf13e00640 1 -- 172.21.15.5:0/2989523536 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdf0c087e60 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fa2bf400640 1 -- 172.21.15.5:0/2615093376 <== osd.3 v2:172.21.15.5:6824/493498667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2ac073ba0 con 0x7fa2ac071090 2024-08-18T22:19:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fdf13e00640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x7fdefc071110 0x7fdefc073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fdf13e00640 1 -- 172.21.15.5:0/2989523536 --> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdefc073c20 con 0x7fdefc071110 2024-08-18T22:19:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fdf13e00640 1 -- 172.21.15.5:0/2989523536 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdf0c088250 con 0x7fdf1c0b37d0 2024-08-18T22:19:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fdf1be00640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdefc067990 0x7fdefc069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fdf21200640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x7fdefc071110 0x7fdefc073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fdf1be00640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdefc067990 0x7fdefc069e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf080ad000 tx=0x7fdf08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fdf21200640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x7fdefc071110 0x7fdefc073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.310+0000 7fda6ea00640 1 -- start start 2024-08-18T22:19:44.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fda6ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda680b4850 0x7fda6814d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fda6ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda6815b1c0 0x7fda681546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fda6ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda68150990 0x7fda68150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fda6ea00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda680b08b0 con 0x7fda6815b1c0 2024-08-18T22:19:44.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fda6ea00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda680b0730 con 0x7fda680b4850 2024-08-18T22:19:44.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fda6ea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fda681fb560 con 0x7fda68150990 2024-08-18T22:19:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7f1271600640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f124c0678c0 0x7f124c069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1260009d70 tx=0x7f12600090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fdf13e00640 1 -- 172.21.15.5:0/2989523536 <== osd.6 v2:172.21.15.117:6824/3026847861 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdefc073c20 con 0x7fdefc071110 2024-08-18T22:19:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fda67400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda6815b1c0 0x7fda681546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fda67400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda6815b1c0 0x7fda681546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40444/0 (socket says 172.21.15.5:40444) 2024-08-18T22:19:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fda67400640 1 -- 172.21.15.5:0/2007021224 learned_addr learned my addr 172.21.15.5:0/2007021224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fda6ca00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda68150990 0x7fda68150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.314+0000 7fda67e00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda680b4850 0x7fda6814d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.318+0000 7fda67400640 1 -- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda68150990 msgr2=0x7fda68150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.318+0000 7fda67400640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda68150990 0x7fda68150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.318+0000 7fda67400640 1 -- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda680b4850 msgr2=0x7fda6814d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.318+0000 7fda67400640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda680b4850 0x7fda6814d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.318+0000 7fda67400640 1 -- 172.21.15.5:0/2007021224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda681fb820 con 0x7fda6815b1c0 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.318+0000 7fda67e00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda680b4850 0x7fda6814d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.318+0000 7fda67400640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda6815b1c0 0x7fda681546d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda5400c3e0 tx=0x7fda5400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.322+0000 7fda5fe00640 1 -- 172.21.15.5:0/2007021224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54017070 con 0x7fda6815b1c0 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.326+0000 7fda5fe00640 1 -- 172.21.15.5:0/2007021224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda540052d0 con 0x7fda6815b1c0 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.326+0000 7fda5fe00640 1 -- 172.21.15.5:0/2007021224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54003820 con 0x7fda6815b1c0 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.326+0000 7fda6ea00640 1 -- 172.21.15.5:0/2007021224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda681fbb00 con 0x7fda6815b1c0 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.326+0000 7fda6ea00640 1 -- 172.21.15.5:0/2007021224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda681fc0c0 con 0x7fda6815b1c0 2024-08-18T22:19:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7fda6ea00640 1 -- 172.21.15.5:0/2007021224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda40001040 con 0x7fda6815b1c0 2024-08-18T22:19:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7f2aefc00640 1 -- 172.21.15.5:0/2916440327 --> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ac4002de0 con 0x7f2ac8071110 2024-08-18T22:19:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7fda5fe00640 1 -- 172.21.15.5:0/2007021224 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda5401a070 con 0x7fda6815b1c0 2024-08-18T22:19:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7f2ae4c00640 1 -- 172.21.15.5:0/2916440327 <== osd.1 v2:172.21.15.5:6808/1222447850 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2ac4002de0 con 0x7f2ac8071110 2024-08-18T22:19:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7fda5fe00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda48067910 0x7fda48069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7fda5fe00640 1 -- 172.21.15.5:0/2007021224 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fda540851d0 con 0x7fda6815b1c0 2024-08-18T22:19:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7f2ada000640 1 -- 172.21.15.5:0/2916440327 >> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] conn(0x7f2ac8071110 msgr2=0x7f2ac8073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7f2ada000640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] conn(0x7f2ac8071110 0x7f2ac8073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7fda5fe00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] conn(0x7fda48071090 0x7fda480734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7f2ada000640 1 -- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2ac8067990 msgr2=0x7f2ac8069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7f2ada000640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2ac8067990 0x7f2ac8069e50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2adc007fd0 tx=0x7f2adc009040 comp rx=0 tx=0).stop 2024-08-18T22:19:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7f2ada000640 1 -- 172.21.15.5:0/2916440327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ae00475b0 msgr2=0x7f2ae00de150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7f2ada000640 1 --2- 172.21.15.5:0/2916440327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ae00475b0 0x7f2ae00de150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40ab000 tx=0x7f2ad40191a0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7f2aedc00640 1 -- 172.21.15.5:0/2916440327 reap_dead start 2024-08-18T22:19:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7fda5fe00640 1 -- 172.21.15.5:0/2007021224 --> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda48073ba0 con 0x7fda48071090 2024-08-18T22:19:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7fda5fe00640 1 -- 172.21.15.5:0/2007021224 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fda5408c050 con 0x7fda6815b1c0 2024-08-18T22:19:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.330+0000 7fda67e00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda48067910 0x7fda48069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7fda6ca00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] conn(0x7fda48071090 0x7fda480734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7f2ada000640 1 -- 172.21.15.5:0/2916440327 shutdown_connections 2024-08-18T22:19:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7f2ada000640 1 -- 172.21.15.5:0/2916440327 >> 172.21.15.5:0/2916440327 conn(0x7f2ae00360d0 msgr2=0x7f2ae0006390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7f2ada000640 1 -- 172.21.15.5:0/2916440327 shutdown_connections 2024-08-18T22:19:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7f2ada000640 1 -- 172.21.15.5:0/2916440327 wait complete. 2024-08-18T22:19:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7fda67e00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda48067910 0x7fda48069dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda680cf170 tx=0x7fda58008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7fda6ca00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] conn(0x7fda48071090 0x7fda480734d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 --> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b1c0cc6a0 con 0x7f5b00071090 2024-08-18T22:19:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.334+0000 7fda5fe00640 1 -- 172.21.15.5:0/2007021224 <== osd.5 v2:172.21.15.117:6808/3793560082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda48073ba0 con 0x7fda48071090 2024-08-18T22:19:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2615093376 --> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2c40d5f40 con 0x7fa2ac071090 2024-08-18T22:19:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 --> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0590052b60 con 0x7f05780710b0 2024-08-18T22:19:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7f5b18c00640 1 -- 172.21.15.5:0/443902975 <== osd.0 v2:172.21.15.5:6816/1731152634 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5b1c0cc6a0 con 0x7f5b00071090 2024-08-18T22:19:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7fa2bf400640 1 -- 172.21.15.5:0/2615093376 <== osd.3 v2:172.21.15.5:6824/493498667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa2c40d5f40 con 0x7fa2ac071090 2024-08-18T22:19:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7f058ea00640 1 -- 172.21.15.5:0/2582190509 <== osd.2 v2:172.21.15.5:6800/3144131686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0590052b60 con 0x7f05780710b0 2024-08-18T22:19:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2615093376 >> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] conn(0x7fa2ac071090 msgr2=0x7fa2ac0734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7fa2d0c00640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] conn(0x7fa2ac071090 0x7fa2ac0734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x7f5b00071090 msgr2=0x7f5b000734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7f5b22200640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x7f5b00071090 0x7f5b000734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b00067990 msgr2=0x7f5b00069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f5b22200640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b00067990 0x7f5b00069e50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5b1001aac0 tx=0x7f5b100a6000 comp rx=0 tx=0).stop 2024-08-18T22:19:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b1c06e050 msgr2=0x7f5b1c155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f5b22200640 1 --2- 172.21.15.5:0/443902975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b1c06e050 0x7f5b1c155dd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00e870 tx=0x7f5b0c00ed30 comp rx=0 tx=0).stop 2024-08-18T22:19:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f5b21800640 1 -- 172.21.15.5:0/443902975 reap_dead start 2024-08-18T22:19:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2615093376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2ac067910 msgr2=0x7fa2ac069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7fa2d0c00640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2ac067910 0x7fa2ac069dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00ad000 tx=0x7fa2c0008040 comp rx=0 tx=0).stop 2024-08-18T22:19:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2615093376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c400a010 msgr2=0x7fa2c40d4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7fa2d0c00640 1 --2- 172.21.15.5:0/2615093376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2c400a010 0x7fa2c40d4a40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800c3f0 tx=0x7fa2b800c8b0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7fa2cbe00640 1 -- 172.21.15.5:0/2615093376 reap_dead start 2024-08-18T22:19:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2615093376 shutdown_connections 2024-08-18T22:19:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2615093376 >> 172.21.15.5:0/2615093376 conn(0x7fa2c401d940 msgr2=0x7fa2c4039960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.338+0000 7f125ea00640 1 -- 172.21.15.5:0/1740433899 --> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1240002de0 con 0x7f124c070fb0 2024-08-18T22:19:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x7f05780710b0 msgr2=0x7f05780734f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f0597e00640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x7f05780710b0 0x7f05780734f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 shutdown_connections 2024-08-18T22:19:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 >> 172.21.15.5:0/443902975 conn(0x7f5b1c06bb80 msgr2=0x7f5b1c0cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05780679c0 msgr2=0x7f0578069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f0597e00640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05780679c0 0x7f0578069e80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0588006f50 tx=0x7f0588009240 comp rx=0 tx=0).stop 2024-08-18T22:19:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05900378b0 msgr2=0x7f059004c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f0597e00640 1 --2- 172.21.15.5:0/2582190509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05900378b0 0x7f059004c840 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0598050b40 tx=0x7f0598068e40 comp rx=0 tx=0).stop 2024-08-18T22:19:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f0597400640 1 -- 172.21.15.5:0/2582190509 reap_dead start 2024-08-18T22:19:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 shutdown_connections 2024-08-18T22:19:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 >> 172.21.15.5:0/2582190509 conn(0x7f059003a4b0 msgr2=0x7f0590053230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2615093376 shutdown_connections 2024-08-18T22:19:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f1269600640 1 -- 172.21.15.5:0/1740433899 <== osd.4 v2:172.21.15.117:6800/79447292 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1240002de0 con 0x7f124c070fb0 2024-08-18T22:19:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7fa2d0c00640 1 -- 172.21.15.5:0/2615093376 wait complete. 2024-08-18T22:19:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 shutdown_connections 2024-08-18T22:19:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7fdf23200640 1 -- 172.21.15.5:0/2989523536 --> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf1c0af7d0 con 0x7fdefc071110 2024-08-18T22:19:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f5b22200640 1 -- 172.21.15.5:0/443902975 wait complete. 2024-08-18T22:19:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 shutdown_connections 2024-08-18T22:19:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7fdf13e00640 1 -- 172.21.15.5:0/2989523536 <== osd.6 v2:172.21.15.117:6824/3026847861 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdf1c0af7d0 con 0x7fdefc071110 2024-08-18T22:19:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.342+0000 7f0597e00640 1 -- 172.21.15.5:0/2582190509 wait complete. 2024-08-18T22:19:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f125ea00640 1 -- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] conn(0x7f124c070fb0 msgr2=0x7f124c0733f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f125ea00640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] conn(0x7f124c070fb0 0x7f124c0733f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f549d200640 1 -- 172.21.15.5:0/2769982203 --> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f54980b53b0 con 0x7f5478071090 2024-08-18T22:19:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f125ea00640 1 -- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f124c0678c0 msgr2=0x7f124c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f125ea00640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f124c0678c0 0x7f124c069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1260009d70 tx=0x7f12600090e0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f125ea00640 1 -- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 msgr2=0x7f126c160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f125ea00640 1 --2- 172.21.15.5:0/1740433899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f126c073620 0x7f126c160b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f12580aa000 tx=0x7f12580192f0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f1272000640 1 -- 172.21.15.5:0/1740433899 reap_dead start 2024-08-18T22:19:44.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7fdf23200640 1 -- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x7fdefc071110 msgr2=0x7fdefc073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7fdf23200640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x7fdefc071110 0x7fdefc073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f125ea00640 1 -- 172.21.15.5:0/1740433899 shutdown_connections 2024-08-18T22:19:44.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f125ea00640 1 -- 172.21.15.5:0/1740433899 >> 172.21.15.5:0/1740433899 conn(0x7f126c0b5800 msgr2=0x7f126c0ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f548e000640 1 -- 172.21.15.5:0/2769982203 <== osd.7 v2:172.21.15.117:6810/2024227284 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f54980b53b0 con 0x7f5478071090 2024-08-18T22:19:44.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7fdf23200640 1 -- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdefc067990 msgr2=0x7fdefc069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7fdf23200640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdefc067990 0x7fdefc069e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf080ad000 tx=0x7fdf08008040 comp rx=0 tx=0).stop 2024-08-18T22:19:44.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7fdf23200640 1 -- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf1c0b37d0 msgr2=0x7fdf1c166720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7fdf23200640 1 --2- 172.21.15.5:0/2989523536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf1c0b37d0 0x7fdf1c166720 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009e80 tx=0x7fdf0c00c430 comp rx=0 tx=0).stop 2024-08-18T22:19:44.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f125ea00640 1 -- 172.21.15.5:0/1740433899 shutdown_connections 2024-08-18T22:19:44.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f549d200640 1 -- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] conn(0x7f5478071090 msgr2=0x7f54780734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f125ea00640 1 -- 172.21.15.5:0/1740433899 wait complete. 2024-08-18T22:19:44.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f549d200640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] conn(0x7f5478071090 0x7f54780734d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7fdf21200640 1 -- 172.21.15.5:0/2989523536 reap_dead start 2024-08-18T22:19:44.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7fdf23200640 1 -- 172.21.15.5:0/2989523536 shutdown_connections 2024-08-18T22:19:44.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7fdf23200640 1 -- 172.21.15.5:0/2989523536 >> 172.21.15.5:0/2989523536 conn(0x7fdf1c0b1dc0 msgr2=0x7fdf1c0b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f549d200640 1 -- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5478067910 msgr2=0x7f5478069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7fdf23200640 1 -- 172.21.15.5:0/2989523536 shutdown_connections 2024-08-18T22:19:44.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f549d200640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5478067910 0x7f5478069dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54880ae000 tx=0x7f54880a6070 comp rx=0 tx=0).stop 2024-08-18T22:19:44.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7fdf23200640 1 -- 172.21.15.5:0/2989523536 wait complete. 2024-08-18T22:19:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f549d200640 1 -- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54980d2ca0 msgr2=0x7f5498149ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f549d200640 1 --2- 172.21.15.5:0/2769982203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54980d2ca0 0x7f5498149ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f548400c410 tx=0x7f548400c8d0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f5496800640 1 -- 172.21.15.5:0/2769982203 reap_dead start 2024-08-18T22:19:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f549d200640 1 -- 172.21.15.5:0/2769982203 shutdown_connections 2024-08-18T22:19:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.346+0000 7f549d200640 1 -- 172.21.15.5:0/2769982203 >> 172.21.15.5:0/2769982203 conn(0x7f54980d2180 msgr2=0x7f549815e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.350+0000 7f549d200640 1 -- 172.21.15.5:0/2769982203 shutdown_connections 2024-08-18T22:19:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.350+0000 7f549d200640 1 -- 172.21.15.5:0/2769982203 wait complete. 2024-08-18T22:19:44.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.366+0000 7fda6ea00640 1 -- 172.21.15.5:0/2007021224 --> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fda40002de0 con 0x7fda48071090 2024-08-18T22:19:44.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.366+0000 7fda5fe00640 1 -- 172.21.15.5:0/2007021224 <== osd.5 v2:172.21.15.117:6808/3793560082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fda40002de0 con 0x7fda48071090 2024-08-18T22:19:44.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.366+0000 7fda6ea00640 1 -- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] conn(0x7fda48071090 msgr2=0x7fda480734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.366+0000 7fda6ea00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] conn(0x7fda48071090 0x7fda480734d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.366+0000 7fda6ea00640 1 -- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda48067910 msgr2=0x7fda48069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.366+0000 7fda6ea00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda48067910 0x7fda48069dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda680cf170 tx=0x7fda58008040 comp rx=0 tx=0).stop 2024-08-18T22:19:44.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.366+0000 7fda6ea00640 1 -- 172.21.15.5:0/2007021224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda6815b1c0 msgr2=0x7fda681546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.366+0000 7fda6ea00640 1 --2- 172.21.15.5:0/2007021224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda6815b1c0 0x7fda681546d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda5400c3e0 tx=0x7fda5400c8a0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.366+0000 7fda6ca00640 1 -- 172.21.15.5:0/2007021224 reap_dead start 2024-08-18T22:19:44.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.366+0000 7fda6ea00640 1 -- 172.21.15.5:0/2007021224 shutdown_connections 2024-08-18T22:19:44.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.366+0000 7fda6ea00640 1 -- 172.21.15.5:0/2007021224 >> 172.21.15.5:0/2007021224 conn(0x7fda680b65f0 msgr2=0x7fda680b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.383 INFO:teuthology.orchestra.run.smithi005.stdout:64424509450 2024-08-18T22:19:44.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-18T22:19:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.374+0000 7fda6ea00640 1 -- 172.21.15.5:0/2007021224 shutdown_connections 2024-08-18T22:19:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.374+0000 7fda6ea00640 1 -- 172.21.15.5:0/2007021224 wait complete. 2024-08-18T22:19:44.393 INFO:teuthology.orchestra.run.smithi005.stdout:64424509451 2024-08-18T22:19:44.394 INFO:teuthology.orchestra.run.smithi005.stdout:64424509451 2024-08-18T22:19:44.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-18T22:19:44.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-18T22:19:44.396 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-08-18T22:19:44.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-18T22:19:44.400 INFO:teuthology.orchestra.run.smithi005.stdout:64424509452 2024-08-18T22:19:44.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-18T22:19:44.402 INFO:teuthology.orchestra.run.smithi005.stdout:55834574858 2024-08-18T22:19:44.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-18T22:19:44.403 INFO:teuthology.orchestra.run.smithi005.stdout:64424509450 2024-08-18T22:19:44.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-18T22:19:44.408 INFO:teuthology.orchestra.run.smithi005.stdout:64424509450 2024-08-18T22:19:44.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-18T22:19:44.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.622+0000 7fccaa400640 1 Processor -- start 2024-08-18T22:19:44.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.622+0000 7fccaa400640 1 -- start start 2024-08-18T22:19:44.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.622+0000 7fccaa400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159fe0 0x7fcca4071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.622+0000 7fccaa400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcca40b2fc0 0x7fcca40b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.622+0000 7fccaa400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca40addd0 con 0x7fcca406e190 2024-08-18T22:19:44.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.626+0000 7fccaa400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcca40b3cd0 con 0x7fcca40b2fc0 2024-08-18T22:19:44.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.626+0000 7fccaa400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcca40ae070 con 0x7fcca4159fe0 2024-08-18T22:19:44.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.626+0000 7fcca3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159fe0 0x7fcca4071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.626+0000 7fcca3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159fe0 0x7fcca4071a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47520/0 (socket says 172.21.15.5:47520) 2024-08-18T22:19:44.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.626+0000 7fcca3400640 1 -- 172.21.15.5:0/3710899958 learned_addr learned my addr 172.21.15.5:0/3710899958 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.626+0000 7fcca3e00640 1 --2- 172.21.15.5:0/3710899958 >> v2:172.21.15.5:3300/0 conn(0x7fcca40b2fc0 0x7fcca40b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.626+0000 7fcca3400640 1 -- 172.21.15.5:0/3710899958 >> v2:172.21.15.5:3300/0 conn(0x7fcca40b2fc0 msgr2=0x7fcca40b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.626+0000 7fcca3400640 1 --2- 172.21.15.5:0/3710899958 >> v2:172.21.15.5:3300/0 conn(0x7fcca40b2fc0 0x7fcca40b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.626+0000 7fcca3400640 1 -- 172.21.15.5:0/3710899958 >> v1:172.21.15.5:6789/0 conn(0x7fcca406e190 legacy=0x7fcca406e5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T22:19:44.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.626+0000 7fcca3400640 1 -- 172.21.15.5:0/3710899958 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca40ae350 con 0x7fcca4159fe0 2024-08-18T22:19:44.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.626+0000 7fcca3e00640 1 --2- 172.21.15.5:0/3710899958 >> v2:172.21.15.5:3300/0 conn(0x7fcca40b2fc0 0x7fcca40b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:44.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.634+0000 7fcca3400640 1 --2- 172.21.15.5:0/3710899958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159fe0 0x7fcca4071a20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcca415ecc0 tx=0x7fcc94020ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6ecd805f338ce2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.634+0000 7fcca2a00640 1 -- 172.21.15.5:0/3710899958 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc940af070 con 0x7fcca4159fe0 2024-08-18T22:19:44.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.634+0000 7fcca2a00640 1 -- 172.21.15.5:0/3710899958 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc940a9b40 con 0x7fcca4159fe0 2024-08-18T22:19:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.634+0000 7fccaa400640 1 -- 172.21.15.5:0/3710899958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159fe0 msgr2=0x7fcca4071a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.634+0000 7fcca2a00640 1 -- 172.21.15.5:0/3710899958 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc940af070 con 0x7fcca4159fe0 2024-08-18T22:19:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.634+0000 7fccaa400640 1 --2- 172.21.15.5:0/3710899958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159fe0 0x7fcca4071a20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcca415ecc0 tx=0x7fcc94020ba0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.634+0000 7fccaa400640 1 -- 172.21.15.5:0/3710899958 shutdown_connections 2024-08-18T22:19:44.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.634+0000 7fccaa400640 1 --2- 172.21.15.5:0/3710899958 >> v2:172.21.15.5:3300/0 conn(0x7fcca40b2fc0 0x7fcca40b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.634+0000 7fccaa400640 1 --2- 172.21.15.5:0/3710899958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159fe0 0x7fcca4071a20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.634+0000 7fccaa400640 1 -- 172.21.15.5:0/3710899958 >> 172.21.15.5:0/3710899958 conn(0x7fcca406bb80 msgr2=0x7fcca406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.634+0000 7fccaa400640 1 -- 172.21.15.5:0/3710899958 shutdown_connections 2024-08-18T22:19:44.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.638+0000 7fccaa400640 1 -- 172.21.15.5:0/3710899958 wait complete. 2024-08-18T22:19:44.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.638+0000 7fccaa400640 1 Processor -- start 2024-08-18T22:19:44.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.638+0000 7fccaa400640 1 -- start start 2024-08-18T22:19:44.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fccaa400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca406e190 0x7fcca4147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fccaa400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40b2fc0 0x7fcca409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fccaa400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcca4159fe0 0x7fcca415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fccaa400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcca40af4e0 con 0x7fcca4159fe0 2024-08-18T22:19:44.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fccaa400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcca40af360 con 0x7fcca406e190 2024-08-18T22:19:44.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fccaa400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcca40af660 con 0x7fcca40b2fc0 2024-08-18T22:19:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fcc9be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40b2fc0 0x7fcca409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fcca3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcca4159fe0 0x7fcca415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fcca3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcca4159fe0 0x7fcca415cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40456/0 (socket says 172.21.15.5:40456) 2024-08-18T22:19:44.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fcca3e00640 1 -- 172.21.15.5:0/2333169530 learned_addr learned my addr 172.21.15.5:0/2333169530 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fcc9be00640 1 -- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca406e190 msgr2=0x7fcca4147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fcc9be00640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca406e190 0x7fcca4147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fcc9be00640 1 -- 172.21.15.5:0/2333169530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcca4159fe0 msgr2=0x7fcca415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fcc9be00640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcca4159fe0 0x7fcca415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fcc9be00640 1 -- 172.21.15.5:0/2333169530 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca41476e0 con 0x7fcca40b2fc0 2024-08-18T22:19:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fcc9be00640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40b2fc0 0x7fcca409aa40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcca40cc5e0 tx=0x7fcc8c00c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fcc9b400640 1 -- 172.21.15.5:0/2333169530 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c017070 con 0x7fcca40b2fc0 2024-08-18T22:19:44.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fccaa400640 1 -- 172.21.15.5:0/2333169530 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca4153080 con 0x7fcca40b2fc0 2024-08-18T22:19:44.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.642+0000 7fccaa400640 1 -- 172.21.15.5:0/2333169530 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca415c6f0 con 0x7fcca40b2fc0 2024-08-18T22:19:44.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.646+0000 7fcc9b400640 1 -- 172.21.15.5:0/2333169530 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc8c003600 con 0x7fcca40b2fc0 2024-08-18T22:19:44.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.646+0000 7fcc9b400640 1 -- 172.21.15.5:0/2333169530 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c017070 con 0x7fcca40b2fc0 2024-08-18T22:19:44.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.646+0000 7fccaa400640 1 -- 172.21.15.5:0/2333169530 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca40b3410 con 0x7fcca40b2fc0 2024-08-18T22:19:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.646+0000 7fcc9b400640 1 -- 172.21.15.5:0/2333169530 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc8c0037f0 con 0x7fcca40b2fc0 2024-08-18T22:19:44.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.646+0000 7f02cf000640 1 Processor -- start 2024-08-18T22:19:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.646+0000 7fcc9b400640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc80067cf0 0x7fcc8006a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7fcc9b400640 1 -- 172.21.15.5:0/2333169530 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcc8c0052e0 con 0x7fcca40b2fc0 2024-08-18T22:19:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7fcca3400640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc80067cf0 0x7fcc8006a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.646+0000 7f02cf000640 1 -- start start 2024-08-18T22:19:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02cf000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f02c0050c40 0x7f02c0009bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02cf000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02c0054cf0 0x7f02c000a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02cf000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c00395e0 con 0x7f02c00deb10 2024-08-18T22:19:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02cf000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f02c00398c0 con 0x7f02c0054cf0 2024-08-18T22:19:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02cf000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f02c0039ba0 con 0x7f02c0050c40 2024-08-18T22:19:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02c7400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f02c0050c40 0x7f02c0009bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02c7400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f02c0050c40 0x7f02c0009bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40110/0 (socket says 172.21.15.5:40110) 2024-08-18T22:19:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02c7400640 1 -- 172.21.15.5:0/1738164537 learned_addr learned my addr 172.21.15.5:0/1738164537 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02cd000640 1 --2- 172.21.15.5:0/1738164537 >> v2:172.21.15.5:3300/0 conn(0x7f02c0054cf0 0x7f02c000a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7fcca3400640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc80067cf0 0x7fcc8006a1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc940b4000 tx=0x7fcc94004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02c6a00640 1 -- 172.21.15.5:0/1738164537 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538207830 0 0) 0x7f02c00395e0 con 0x7f02c00deb10 2024-08-18T22:19:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02c6a00640 1 -- 172.21.15.5:0/1738164537 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b0003530 con 0x7f02c00deb10 2024-08-18T22:19:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02cd000640 1 -- 172.21.15.5:0/1738164537 >> v2:172.21.15.117:3300/0 conn(0x7f02c0050c40 msgr2=0x7f02c0009bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02cd000640 1 --2- 172.21.15.5:0/1738164537 >> v2:172.21.15.117:3300/0 conn(0x7f02c0050c40 0x7f02c0009bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02cd000640 1 -- 172.21.15.5:0/1738164537 >> v1:172.21.15.117:6789/0 conn(0x7f02c00deb10 legacy=0x7f02c00064a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.650+0000 7f02cd000640 1 -- 172.21.15.5:0/1738164537 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c0039e80 con 0x7f02c0054cf0 2024-08-18T22:19:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7fcc9b400640 1 -- 172.21.15.5:0/2333169530 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcc8c020020 con 0x7fcca40b2fc0 2024-08-18T22:19:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7f30c9800640 1 Processor -- start 2024-08-18T22:19:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7f30c9800640 1 -- start start 2024-08-18T22:19:44.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7f02cd000640 1 --2- 172.21.15.5:0/1738164537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c0054cf0 0x7f02c000a110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f02c80654f0 tx=0x7f02c8098130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c500f5c5f00eb7cd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7f30c9800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30c41636e0 0x7f30c40d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7f30c9800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f30c40d0ae0 0x7f30c40d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7f30c9800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30c409ae20 con 0x7f30c406d4b0 2024-08-18T22:19:44.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7f30c9800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f30c409ba30 con 0x7f30c40d0ae0 2024-08-18T22:19:44.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7f30c9800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30c409b100 con 0x7f30c41636e0 2024-08-18T22:19:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7f02c6a00640 1 -- 172.21.15.5:0/1738164537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8120cd0 con 0x7f02c0054cf0 2024-08-18T22:19:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7f02c6a00640 1 -- 172.21.15.5:0/1738164537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c8128440 con 0x7f02c0054cf0 2024-08-18T22:19:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.654+0000 7f02c6a00640 1 -- 172.21.15.5:0/1738164537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8128870 con 0x7f02c0054cf0 2024-08-18T22:19:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f30c3e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f30c406d4b0 0x7f30c406d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38636/0 (socket says 172.21.15.5:38636) 2024-08-18T22:19:44.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f30c3e00640 1 -- 172.21.15.5:0/182554486 learned_addr learned my addr 172.21.15.5:0/182554486 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f30c3400640 1 --2- 172.21.15.5:0/182554486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30c41636e0 0x7f30c40d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f30c2a00640 1 -- 172.21.15.5:0/182554486 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874118805 0 0) 0x7f30c409ae20 con 0x7f30c406d4b0 2024-08-18T22:19:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f30c2a00640 1 -- 172.21.15.5:0/182554486 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30a8003530 con 0x7f30c406d4b0 2024-08-18T22:19:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f30c8e00640 1 --2- 172.21.15.5:0/182554486 >> v2:172.21.15.117:3300/0 conn(0x7f30c40d0ae0 0x7f30c40d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f02cf000640 1 -- 172.21.15.5:0/1738164537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c0054cf0 msgr2=0x7f02c000a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f02cf000640 1 --2- 172.21.15.5:0/1738164537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c0054cf0 0x7f02c000a110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f02c80654f0 tx=0x7f02c8098130 comp rx=0 tx=0).stop 2024-08-18T22:19:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7fddfa200640 1 Processor -- start 2024-08-18T22:19:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f02cf000640 1 -- 172.21.15.5:0/1738164537 shutdown_connections 2024-08-18T22:19:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f02cf000640 1 --2- 172.21.15.5:0/1738164537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c0054cf0 0x7f02c000a110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f02cf000640 1 --2- 172.21.15.5:0/1738164537 >> v2:172.21.15.117:3300/0 conn(0x7f02c0050c40 0x7f02c0009bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f02cf000640 1 -- 172.21.15.5:0/1738164537 >> 172.21.15.5:0/1738164537 conn(0x7f02c001d970 msgr2=0x7f02c00545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f30c8e00640 1 -- 172.21.15.5:0/182554486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30c41636e0 msgr2=0x7f30c40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f30c8e00640 1 --2- 172.21.15.5:0/182554486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30c41636e0 0x7f30c40d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f30c8e00640 1 -- 172.21.15.5:0/182554486 >> v1:172.21.15.5:6789/0 conn(0x7f30c406d4b0 legacy=0x7f30c406d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f30c8e00640 1 -- 172.21.15.5:0/182554486 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c409b3e0 con 0x7f30c40d0ae0 2024-08-18T22:19:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7fddfa200640 1 -- start start 2024-08-18T22:19:44.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f3437200640 1 Processor -- start 2024-08-18T22:19:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f02cf000640 1 -- 172.21.15.5:0/1738164537 shutdown_connections 2024-08-18T22:19:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f3437200640 1 -- start start 2024-08-18T22:19:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7f02cf000640 1 -- 172.21.15.5:0/1738164537 wait complete. 2024-08-18T22:19:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f02cf000640 1 Processor -- start 2024-08-18T22:19:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f02cf000640 1 -- start start 2024-08-18T22:19:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fddfa200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf415b1c0 0x7fddf40ae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fddfa200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf40aec70 con 0x7fddf40b4850 2024-08-18T22:19:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fddfa200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf40aef50 con 0x7fddf40d1d20 2024-08-18T22:19:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fddfa200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fddf40af230 con 0x7fddf415b1c0 2024-08-18T22:19:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fddf3e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fddf40b4850 0x7fddf40b1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38650/0 (socket says 172.21.15.5:38650) 2024-08-18T22:19:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fddf3e00640 1 -- 172.21.15.5:0/669117047 learned_addr learned my addr 172.21.15.5:0/669117047 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fddf3400640 1 --2- 172.21.15.5:0/669117047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf415b1c0 0x7fddf40ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7fce11e00640 1 Processor -- start 2024-08-18T22:19:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f3437200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3430161c30 0x7f34300d23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f3437200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f343006e7e0 0x7f34300d28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f342fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3430161c30 0x7f34300d23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f3437200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34300b0ec0 con 0x7f34300b3910 2024-08-18T22:19:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f3437200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f34300b17d0 con 0x7f3430161c30 2024-08-18T22:19:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f342fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3430161c30 0x7f34300d23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40470/0 (socket says 172.21.15.5:40470) 2024-08-18T22:19:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f342fe00640 1 -- 172.21.15.5:0/3636525150 learned_addr learned my addr 172.21.15.5:0/3636525150 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f3437200640 1 -- 172.21.15.5:0/3636525150 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3430162010 con 0x7f343006e7e0 2024-08-18T22:19:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f342f400640 1 --2- 172.21.15.5:0/3636525150 >> v2:172.21.15.117:3300/0 conn(0x7f343006e7e0 0x7f34300d28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.658+0000 7fce11e00640 1 -- start start 2024-08-18T22:19:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fce11e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce0c06b9b0 0x7fce0c1636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fce11e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c06bd90 0x7fce0c166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fce11e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0c0b4440 con 0x7fce0c166770 2024-08-18T22:19:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fce11e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fce0c0b4720 con 0x7fce0c06b9b0 2024-08-18T22:19:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fce11e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fce0c0b2540 con 0x7fce0c06bd90 2024-08-18T22:19:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fce0a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c06bd90 0x7fce0c166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fddf3400640 1 -- 172.21.15.5:0/669117047 >> v1:172.21.15.117:6789/0 conn(0x7fddf40d1d20 legacy=0x7fddf415b5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:19:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fddf3400640 1 -- 172.21.15.5:0/669117047 >> v1:172.21.15.5:6789/0 conn(0x7fddf40b4850 legacy=0x7fddf40b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f02cf000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c0050c40 0x7f02c00d7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f02cf000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c0054cf0 0x7f02c00cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f02cf000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00deb10 0x7f02c00d4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cf000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f02c00eb070 con 0x7f02c0050c40 2024-08-18T22:19:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cf000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f02c0039290 con 0x7f02c0054cf0 2024-08-18T22:19:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cf000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f02c00eb1f0 con 0x7f02c00deb10 2024-08-18T22:19:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fddf3400640 1 -- 172.21.15.5:0/669117047 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf40af510 con 0x7fddf415b1c0 2024-08-18T22:19:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fdbdac00640 1 Processor -- start 2024-08-18T22:19:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fdbdac00640 1 -- start start 2024-08-18T22:19:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fce0aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce0c06b9b0 0x7fce0c1636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fce0a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c06bd90 0x7fce0c166230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47550/0 (socket says 172.21.15.5:47550) 2024-08-18T22:19:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7fce0a000640 1 -- 172.21.15.5:0/2935447278 learned_addr learned my addr 172.21.15.5:0/2935447278 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f342f400640 1 -- 172.21.15.5:0/3636525150 >> v2:172.21.15.5:3300/0 conn(0x7f3430161c30 msgr2=0x7f34300d23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f342f400640 1 --2- 172.21.15.5:0/3636525150 >> v2:172.21.15.5:3300/0 conn(0x7f3430161c30 0x7f34300d23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f342f400640 1 -- 172.21.15.5:0/3636525150 >> v1:172.21.15.5:6789/0 conn(0x7f34300b3910 legacy=0x7f343006ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.662+0000 7f342f400640 1 -- 172.21.15.5:0/3636525150 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34300d5120 con 0x7f343006e7e0 2024-08-18T22:19:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cd000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00deb10 0x7f02c00d4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cd000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00deb10 0x7f02c00d4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47564/0 (socket says 172.21.15.5:47564) 2024-08-18T22:19:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cd000640 1 -- 172.21.15.5:0/3214042387 learned_addr learned my addr 172.21.15.5:0/3214042387 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c8e00640 1 --2- 172.21.15.5:0/182554486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c40d0ae0 0x7f30c40d0f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009d90 tx=0x7f30bc01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e19d0a2c93a083c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cd000640 1 -- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c0054cf0 msgr2=0x7f02c00cffe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-18T22:19:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cd000640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c0054cf0 0x7f02c00cffe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cd000640 1 -- 172.21.15.5:0/3214042387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c0050c40 msgr2=0x7f02c00d7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02c7e00640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c0050c40 0x7f02c00d7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cd000640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c0050c40 0x7f02c00d7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cd000640 1 -- 172.21.15.5:0/3214042387 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c00d7d10 con 0x7f02c00deb10 2024-08-18T22:19:44.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02c7e00640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c0050c40 0x7f02c00d7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:44.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c2a00640 1 -- 172.21.15.5:0/182554486 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0b2070 con 0x7f30c40d0ae0 2024-08-18T22:19:44.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c2a00640 1 -- 172.21.15.5:0/182554486 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30bc0a5910 con 0x7f30c40d0ae0 2024-08-18T22:19:44.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c2a00640 1 -- 172.21.15.5:0/182554486 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0a5ce0 con 0x7f30c40d0ae0 2024-08-18T22:19:44.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fce0aa00640 1 -- 172.21.15.5:0/2935447278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c06bd90 msgr2=0x7fce0c166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fce0aa00640 1 --2- 172.21.15.5:0/2935447278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c06bd90 0x7fce0c166230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fce0aa00640 1 -- 172.21.15.5:0/2935447278 >> v1:172.21.15.5:6789/0 conn(0x7fce0c166770 legacy=0x7fce0c163e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fce0aa00640 1 -- 172.21.15.5:0/2935447278 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c0b2790 con 0x7fce0c06b9b0 2024-08-18T22:19:44.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fce0a000640 1 --2- 172.21.15.5:0/2935447278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c06bd90 0x7fce0c166230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:44.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c9800640 1 -- 172.21.15.5:0/182554486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c40d0ae0 msgr2=0x7f30c40d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c9800640 1 --2- 172.21.15.5:0/182554486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c40d0ae0 0x7f30c40d0f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009d90 tx=0x7f30bc01c940 comp rx=0 tx=0).stop 2024-08-18T22:19:44.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c9800640 1 -- 172.21.15.5:0/182554486 shutdown_connections 2024-08-18T22:19:44.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c9800640 1 --2- 172.21.15.5:0/182554486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c40d0ae0 0x7f30c40d0f70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c9800640 1 --2- 172.21.15.5:0/182554486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30c41636e0 0x7f30c40d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c9800640 1 -- 172.21.15.5:0/182554486 >> 172.21.15.5:0/182554486 conn(0x7f30c40d20c0 msgr2=0x7f30c40d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fdbdac00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd415e4b0 0x7fdbd40ada40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02cd000640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00deb10 0x7f02c00d4cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f02c8000b70 tx=0x7f02c8094f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fdbdac00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdbd40adf80 0x7fdbd40cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f878bc00640 1 Processor -- start 2024-08-18T22:19:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c9800640 1 -- 172.21.15.5:0/182554486 shutdown_connections 2024-08-18T22:19:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f878bc00640 1 -- start start 2024-08-18T22:19:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fdbd3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd415e4b0 0x7fdbd40ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fdbdac00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd40b32f0 con 0x7fdbd40ce450 2024-08-18T22:19:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fdbdac00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdbd40ae500 con 0x7fdbd40adf80 2024-08-18T22:19:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fdbdac00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd40ae7e0 con 0x7fdbd415e4b0 2024-08-18T22:19:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f30c9800640 1 -- 172.21.15.5:0/182554486 wait complete. 2024-08-18T22:19:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fdbd3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd415e4b0 0x7fdbd40ada40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47576/0 (socket says 172.21.15.5:47576) 2024-08-18T22:19:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fdbd3e00640 1 -- 172.21.15.5:0/3860992933 learned_addr learned my addr 172.21.15.5:0/3860992933 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fdbd3400640 1 --2- 172.21.15.5:0/3860992933 >> v2:172.21.15.117:3300/0 conn(0x7fdbd40adf80 0x7fdbd40cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02b7e00640 1 -- 172.21.15.5:0/3214042387 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8128800 con 0x7f02c00deb10 2024-08-18T22:19:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02b7e00640 1 -- 172.21.15.5:0/3214042387 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c81289a0 con 0x7f02c00deb10 2024-08-18T22:19:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7f02b7e00640 1 -- 172.21.15.5:0/3214042387 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8128d50 con 0x7f02c00deb10 2024-08-18T22:19:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.666+0000 7fdbd2a00640 1 -- 172.21.15.5:0/3860992933 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606354951 0 0) 0x7fdbd40b32f0 con 0x7fdbd40ce450 2024-08-18T22:19:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7fdbd2a00640 1 -- 172.21.15.5:0/3860992933 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb8003530 con 0x7fdbd40ce450 2024-08-18T22:19:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7fdbd3e00640 1 -- 172.21.15.5:0/3860992933 >> v2:172.21.15.117:3300/0 conn(0x7fdbd40adf80 msgr2=0x7fdbd40cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7fdbd3e00640 1 --2- 172.21.15.5:0/3860992933 >> v2:172.21.15.117:3300/0 conn(0x7fdbd40adf80 0x7fdbd40cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7fdbd3e00640 1 -- 172.21.15.5:0/3860992933 >> v1:172.21.15.117:6789/0 conn(0x7fdbd40ce450 legacy=0x7fdbd41620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7fdbd3e00640 1 -- 172.21.15.5:0/3860992933 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd40aeac0 con 0x7fdbd415e4b0 2024-08-18T22:19:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f02cf000640 1 -- 172.21.15.5:0/3214042387 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c00d7ff0 con 0x7f02c00deb10 2024-08-18T22:19:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f02cf000640 1 -- 172.21.15.5:0/3214042387 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c00d85b0 con 0x7f02c00deb10 2024-08-18T22:19:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f878bc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87840b40c0 0x7f87840b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f878bc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 0x7f878406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f878bc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87840b31f0 con 0x7f878415b0c0 2024-08-18T22:19:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f878bc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f87840b4a70 con 0x7f87840b40c0 2024-08-18T22:19:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f878bc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f87840b3d70 con 0x7f878406e410 2024-08-18T22:19:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f8789200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f878415b0c0 0x7f878406db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38680/0 (socket says 172.21.15.5:38680) 2024-08-18T22:19:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f8789200640 1 -- 172.21.15.5:0/3358965766 learned_addr learned my addr 172.21.15.5:0/3358965766 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c9800640 1 Processor -- start 2024-08-18T22:19:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c9800640 1 -- start start 2024-08-18T22:19:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f342f400640 1 --2- 172.21.15.5:0/3636525150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343006e7e0 0x7f34300d28e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34300b38a0 tx=0x7f341c01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dfd811bc459bb0b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f8789c00640 1 --2- 172.21.15.5:0/3358965766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 0x7f878406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f8783e00640 1 --2- 172.21.15.5:0/3358965766 >> v2:172.21.15.5:3300/0 conn(0x7f87840b40c0 0x7f87840b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f02cf000640 1 -- 172.21.15.5:0/3214042387 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c00064a0 con 0x7f02c00deb10 2024-08-18T22:19:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f8789c00640 1 -- 172.21.15.5:0/3358965766 >> v2:172.21.15.5:3300/0 conn(0x7f87840b40c0 msgr2=0x7f87840b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f8789c00640 1 --2- 172.21.15.5:0/3358965766 >> v2:172.21.15.5:3300/0 conn(0x7f87840b40c0 0x7f87840b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f8783400640 1 -- 172.21.15.5:0/3358965766 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2422183261 0 0) 0x7f87840b31f0 con 0x7f878415b0c0 2024-08-18T22:19:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f8789c00640 1 -- 172.21.15.5:0/3358965766 >> v1:172.21.15.5:6789/0 conn(0x7f878415b0c0 legacy=0x7f878406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f8789c00640 1 -- 172.21.15.5:0/3358965766 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87840b34d0 con 0x7f878406e410 2024-08-18T22:19:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7fce0aa00640 1 --2- 172.21.15.5:0/2935447278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce0c06b9b0 0x7fce0c1636c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0097f0 tx=0x7fcdfc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcb6b28b4a668d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7fce09600640 1 -- 172.21.15.5:0/2935447278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc0b0070 con 0x7fce0c06b9b0 2024-08-18T22:19:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7fce09600640 1 -- 172.21.15.5:0/2935447278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdfc0ab400 con 0x7fce0c06b9b0 2024-08-18T22:19:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7fce09600640 1 -- 172.21.15.5:0/2935447278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc0ab7d0 con 0x7fce0c06b9b0 2024-08-18T22:19:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f342ea00640 1 -- 172.21.15.5:0/3636525150 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c0b0070 con 0x7f343006e7e0 2024-08-18T22:19:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f342ea00640 1 -- 172.21.15.5:0/3636525150 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341c0ab600 con 0x7f343006e7e0 2024-08-18T22:19:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7fce11e00640 1 -- 172.21.15.5:0/2935447278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce0c06b9b0 msgr2=0x7fce0c1636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7fce11e00640 1 --2- 172.21.15.5:0/2935447278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce0c06b9b0 0x7fce0c1636c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0097f0 tx=0x7fcdfc01c460 comp rx=0 tx=0).stop 2024-08-18T22:19:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c9800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c406d4b0 0x7f30c40c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c9800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30c40d0ae0 0x7f30c40cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c9800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c41636e0 0x7f30c4160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c9800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f30c409abc0 con 0x7f30c41636e0 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c9800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30c409aa40 con 0x7f30c406d4b0 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c9800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30c4162900 con 0x7f30c40d0ae0 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c406d4b0 0x7f30c40c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c406d4b0 0x7f30c40c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40166/0 (socket says 172.21.15.5:40166) 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c3e00640 1 -- 172.21.15.5:0/836035787 learned_addr learned my addr 172.21.15.5:0/836035787 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c3400640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30c40d0ae0 0x7f30c40cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f30c8e00640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c41636e0 0x7f30c4160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f30c3e00640 1 -- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30c40d0ae0 msgr2=0x7f30c40cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f30c3e00640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30c40d0ae0 0x7f30c40cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f30c3e00640 1 -- 172.21.15.5:0/836035787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c41636e0 msgr2=0x7f30c4160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f30c3e00640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c41636e0 0x7f30c4160450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f30c3e00640 1 -- 172.21.15.5:0/836035787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c412f2c0 con 0x7f30c406d4b0 2024-08-18T22:19:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.670+0000 7f342ea00640 1 -- 172.21.15.5:0/3636525150 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c0ab9d0 con 0x7f343006e7e0 2024-08-18T22:19:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7fce11e00640 1 -- 172.21.15.5:0/2935447278 shutdown_connections 2024-08-18T22:19:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f3437200640 1 -- 172.21.15.5:0/3636525150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343006e7e0 msgr2=0x7f34300d28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f3437200640 1 --2- 172.21.15.5:0/3636525150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343006e7e0 0x7f34300d28e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34300b38a0 tx=0x7f341c01c440 comp rx=0 tx=0).stop 2024-08-18T22:19:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7fce11e00640 1 --2- 172.21.15.5:0/2935447278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c06bd90 0x7fce0c166230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7fce11e00640 1 --2- 172.21.15.5:0/2935447278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce0c06b9b0 0x7fce0c1636c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f30c3e00640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c406d4b0 0x7f30c40c9190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f30b400c420 tx=0x7f30b400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7fce11e00640 1 -- 172.21.15.5:0/2935447278 >> 172.21.15.5:0/2935447278 conn(0x7fce0c0b65f0 msgr2=0x7fce0c0b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f3437200640 1 -- 172.21.15.5:0/3636525150 shutdown_connections 2024-08-18T22:19:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f3437200640 1 --2- 172.21.15.5:0/3636525150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343006e7e0 0x7f34300d28e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f3437200640 1 --2- 172.21.15.5:0/3636525150 >> v2:172.21.15.5:3300/0 conn(0x7f3430161c30 0x7f34300d23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f3437200640 1 -- 172.21.15.5:0/3636525150 >> 172.21.15.5:0/3636525150 conn(0x7f343008bfd0 msgr2=0x7f34300d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7fce11e00640 1 -- 172.21.15.5:0/2935447278 shutdown_connections 2024-08-18T22:19:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7fce11e00640 1 -- 172.21.15.5:0/2935447278 wait complete. 2024-08-18T22:19:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f30bbe00640 1 -- 172.21.15.5:0/836035787 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b4017070 con 0x7f30c406d4b0 2024-08-18T22:19:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f02b7e00640 1 -- 172.21.15.5:0/3214042387 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f02c8137060 con 0x7f02c00deb10 2024-08-18T22:19:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7fddf3400640 1 --2- 172.21.15.5:0/669117047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf415b1c0 0x7fddf40ae670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdde400ba90 tx=0x7fdde401eb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5dbfe7624d1be6f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f3437200640 1 -- 172.21.15.5:0/3636525150 shutdown_connections 2024-08-18T22:19:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f30bbe00640 1 -- 172.21.15.5:0/836035787 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b4005cf0 con 0x7f30c406d4b0 2024-08-18T22:19:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f30bbe00640 1 -- 172.21.15.5:0/836035787 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40072d0 con 0x7f30c406d4b0 2024-08-18T22:19:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f30c9800640 1 -- 172.21.15.5:0/836035787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c406ea40 con 0x7f30c406d4b0 2024-08-18T22:19:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f30c9800640 1 -- 172.21.15.5:0/836035787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c40cbe40 con 0x7f30c406d4b0 2024-08-18T22:19:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f02b7e00640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f02ac067910 0x7f02ac069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f02b7e00640 1 -- 172.21.15.5:0/3214042387 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f02c819a9b0 con 0x7f02c00deb10 2024-08-18T22:19:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f02c7e00640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f02ac067910 0x7f02ac069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7fdbd3e00640 1 --2- 172.21.15.5:0/3860992933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd415e4b0 0x7fdbd40ada40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009870 tx=0x7fdbc401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=634af5738f46bbfb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.674+0000 7f3437200640 1 -- 172.21.15.5:0/3636525150 wait complete. 2024-08-18T22:19:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f8789c00640 1 --2- 172.21.15.5:0/3358965766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 0x7f878406e860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f877c009d90 tx=0x7f877c01c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1599836a4c9fd418 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f30c9800640 1 -- 172.21.15.5:0/836035787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c40d0f70 con 0x7f30c406d4b0 2024-08-18T22:19:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fddf2a00640 1 -- 172.21.15.5:0/669117047 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde40b4070 con 0x7fddf415b1c0 2024-08-18T22:19:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce11e00640 1 Processor -- start 2024-08-18T22:19:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f8783400640 1 -- 172.21.15.5:0/3358965766 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c0b2070 con 0x7f878406e410 2024-08-18T22:19:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fdbd2a00640 1 -- 172.21.15.5:0/3860992933 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40b0070 con 0x7fdbd415e4b0 2024-08-18T22:19:44.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce11e00640 1 -- start start 2024-08-18T22:19:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f3437200640 1 Processor -- start 2024-08-18T22:19:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f3437200640 1 -- start start 2024-08-18T22:19:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f8783400640 1 -- 172.21.15.5:0/3358965766 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877c0a5710 con 0x7f878406e410 2024-08-18T22:19:44.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f8783400640 1 -- 172.21.15.5:0/3358965766 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c0a5ae0 con 0x7f878406e410 2024-08-18T22:19:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fddf2a00640 1 -- 172.21.15.5:0/669117047 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde40a7c30 con 0x7fddf415b1c0 2024-08-18T22:19:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fddf2a00640 1 -- 172.21.15.5:0/669117047 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde40af440 con 0x7fddf415b1c0 2024-08-18T22:19:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f02c7e00640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f02ac067910 0x7f02ac069dd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f02b8000fc0 tx=0x7f02b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fddfa200640 1 -- 172.21.15.5:0/669117047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf415b1c0 msgr2=0x7fddf40ae670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fddfa200640 1 --2- 172.21.15.5:0/669117047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf415b1c0 0x7fddf40ae670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdde400ba90 tx=0x7fdde401eb40 comp rx=0 tx=0).stop 2024-08-18T22:19:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce11e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce0c06b9b0 0x7fce0c161510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce11e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c06bd90 0x7fce0c15ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce11e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c166770 0x7fce0c15f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce11e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c06c170 con 0x7fce0c06b9b0 2024-08-18T22:19:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce11e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c06c700 con 0x7fce0c166770 2024-08-18T22:19:44.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce11e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fce0c06c2f0 con 0x7fce0c06bd90 2024-08-18T22:19:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fddfa200640 1 -- 172.21.15.5:0/669117047 shutdown_connections 2024-08-18T22:19:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fddfa200640 1 --2- 172.21.15.5:0/669117047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf415b1c0 0x7fddf40ae670 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fddfa200640 1 -- 172.21.15.5:0/669117047 >> 172.21.15.5:0/669117047 conn(0x7fddf40b65f0 msgr2=0x7fddf40b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fdbd2a00640 1 -- 172.21.15.5:0/3860992933 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc40ab600 con 0x7fdbd415e4b0 2024-08-18T22:19:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fdbd2a00640 1 -- 172.21.15.5:0/3860992933 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40ab9b0 con 0x7fdbd415e4b0 2024-08-18T22:19:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fdbdac00640 1 -- 172.21.15.5:0/3860992933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd415e4b0 msgr2=0x7fdbd40ada40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fdbdac00640 1 --2- 172.21.15.5:0/3860992933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd415e4b0 0x7fdbd40ada40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009870 tx=0x7fdbc401c4d0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fdbdac00640 1 -- 172.21.15.5:0/3860992933 shutdown_connections 2024-08-18T22:19:44.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fdbdac00640 1 --2- 172.21.15.5:0/3860992933 >> v2:172.21.15.117:3300/0 conn(0x7fdbd40adf80 0x7fdbd40cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fdbdac00640 1 --2- 172.21.15.5:0/3860992933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd415e4b0 0x7fdbd40ada40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fdbdac00640 1 -- 172.21.15.5:0/3860992933 >> 172.21.15.5:0/3860992933 conn(0x7fdbd40b5800 msgr2=0x7fdbd4072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fdbdac00640 1 -- 172.21.15.5:0/3860992933 shutdown_connections 2024-08-18T22:19:44.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f878bc00640 1 -- 172.21.15.5:0/3358965766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 msgr2=0x7f878406e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f878bc00640 1 --2- 172.21.15.5:0/3358965766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 0x7f878406e860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f877c009d90 tx=0x7f877c01c850 comp rx=0 tx=0).stop 2024-08-18T22:19:44.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fdbdac00640 1 -- 172.21.15.5:0/3860992933 wait complete. 2024-08-18T22:19:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f3437200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343006e7e0 0x7f3430150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f02b7e00640 1 -- 172.21.15.5:0/3214042387 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f02c8091ed0 con 0x7f02c00deb10 2024-08-18T22:19:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fddfa200640 1 -- 172.21.15.5:0/669117047 shutdown_connections 2024-08-18T22:19:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fddfa200640 1 -- 172.21.15.5:0/669117047 wait complete. 2024-08-18T22:19:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f878bc00640 1 -- 172.21.15.5:0/3358965766 shutdown_connections 2024-08-18T22:19:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f878bc00640 1 --2- 172.21.15.5:0/3358965766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 0x7f878406e860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f878bc00640 1 --2- 172.21.15.5:0/3358965766 >> v2:172.21.15.5:3300/0 conn(0x7f87840b40c0 0x7f87840b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f878bc00640 1 -- 172.21.15.5:0/3358965766 >> 172.21.15.5:0/3358965766 conn(0x7f87840b1dc0 msgr2=0x7f87840b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce0b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c166770 0x7fce0c15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce0b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c166770 0x7fce0c15f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40170/0 (socket says 172.21.15.5:40170) 2024-08-18T22:19:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce0b400640 1 -- 172.21.15.5:0/27718232 learned_addr learned my addr 172.21.15.5:0/27718232 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f3437200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34300b3910 0x7f34301596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f342f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34300b3910 0x7f34301596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f342f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34300b3910 0x7f34301596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40532/0 (socket says 172.21.15.5:40532) 2024-08-18T22:19:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f342fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343006e7e0 0x7f3430150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f3437200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3430161c30 0x7f3430159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f3437200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f343016b480 con 0x7f34300b3910 2024-08-18T22:19:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f3437200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f343016b300 con 0x7f3430161c30 2024-08-18T22:19:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f3437200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f343016b600 con 0x7f343006e7e0 2024-08-18T22:19:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f342f400640 1 -- 172.21.15.5:0/3051785779 learned_addr learned my addr 172.21.15.5:0/3051785779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbdac00640 1 Processor -- start 2024-08-18T22:19:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f342f400640 1 -- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343006e7e0 msgr2=0x7f3430150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f878bc00640 1 -- 172.21.15.5:0/3358965766 shutdown_connections 2024-08-18T22:19:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbdac00640 1 -- start start 2024-08-18T22:19:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7f30bbe00640 1 -- 172.21.15.5:0/836035787 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30b401a070 con 0x7f30c406d4b0 2024-08-18T22:19:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f30bbe00640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f30a40678c0 0x7f30a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f30bbe00640 1 -- 172.21.15.5:0/836035787 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f30b40852f0 con 0x7f30c406d4b0 2024-08-18T22:19:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f878bc00640 1 -- 172.21.15.5:0/3358965766 wait complete. 2024-08-18T22:19:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce0aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce0c06b9b0 0x7fce0c161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce0b400640 1 -- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c06bd90 msgr2=0x7fce0c15ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce0b400640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c06bd90 0x7fce0c15ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce0b400640 1 -- 172.21.15.5:0/27718232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce0c06b9b0 msgr2=0x7fce0c161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce0b400640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce0c06b9b0 0x7fce0c161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fddfa200640 1 Processor -- start 2024-08-18T22:19:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.678+0000 7fce0b400640 1 -- 172.21.15.5:0/27718232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c0b0380 con 0x7fce0c166770 2024-08-18T22:19:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fce0b400640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c166770 0x7fce0c15f200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fce0400b990 tx=0x7fce0400be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f30c3400640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f30a40678c0 0x7f30a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f3435200640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3430161c30 0x7f3430159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f342f400640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343006e7e0 0x7f3430150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f342f400640 1 -- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3430161c30 msgr2=0x7f3430159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f342f400640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3430161c30 0x7f3430159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f342f400640 1 -- 172.21.15.5:0/3051785779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343015a880 con 0x7f34300b3910 2024-08-18T22:19:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f342fe00640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343006e7e0 0x7f3430150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f342f400640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34300b3910 0x7f34301596f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f341c0ae040 tx=0x7f341c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f3427e00640 1 -- 172.21.15.5:0/3051785779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c0b8020 con 0x7f34300b3910 2024-08-18T22:19:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fddfa200640 1 -- start start 2024-08-18T22:19:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fddfa200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddf40b4850 0x7fddf414a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fddfa200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddf415b1c0 0x7fddf4148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f3427e00640 1 -- 172.21.15.5:0/3051785779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341c0b4410 con 0x7f34300b3910 2024-08-18T22:19:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f3427e00640 1 -- 172.21.15.5:0/3051785779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c0b0040 con 0x7f34300b3910 2024-08-18T22:19:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f30c3400640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f30a40678c0 0x7f30a4069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f30c40b72c0 tx=0x7f30b0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fddfa200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf40d1170 0x7fddf40d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbdac00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd40adf80 0x7fdbd41605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbdac00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbd40ce450 0x7fdbd415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbdac00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbd415e4b0 0x7fdbd4156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbdac00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd416b3d0 con 0x7fdbd415e4b0 2024-08-18T22:19:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbdac00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd416b250 con 0x7fdbd40ce450 2024-08-18T22:19:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbdac00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd416b550 con 0x7fdbd40adf80 2024-08-18T22:19:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbd3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd40adf80 0x7fdbd41605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbd3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd40adf80 0x7fdbd41605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47624/0 (socket says 172.21.15.5:47624) 2024-08-18T22:19:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbd8c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbd415e4b0 0x7fdbd4156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbd3e00640 1 -- 172.21.15.5:0/2383255993 learned_addr learned my addr 172.21.15.5:0/2383255993 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbd3400640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbd40ce450 0x7fdbd415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbd8c00640 1 -- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd40adf80 msgr2=0x7fdbd41605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbd8c00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd40adf80 0x7fdbd41605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbd8c00640 1 -- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbd40ce450 msgr2=0x7fdbd415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbd8c00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbd40ce450 0x7fdbd415a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbd8c00640 1 -- 172.21.15.5:0/2383255993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd415f540 con 0x7fdbd415e4b0 2024-08-18T22:19:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbd8c00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbd415e4b0 0x7fdbd4156660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00c700 tx=0x7fdbcc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbcbe00640 1 -- 172.21.15.5:0/2383255993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc003b80 con 0x7fdbd415e4b0 2024-08-18T22:19:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbcbe00640 1 -- 172.21.15.5:0/2383255993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc003d20 con 0x7fdbd415e4b0 2024-08-18T22:19:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbcbe00640 1 -- 172.21.15.5:0/2383255993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc005310 con 0x7fdbd415e4b0 2024-08-18T22:19:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbdac00640 1 -- 172.21.15.5:0/2383255993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd415f820 con 0x7fdbd415e4b0 2024-08-18T22:19:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fdbdac00640 1 -- 172.21.15.5:0/2383255993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd415fde0 con 0x7fdbd415e4b0 2024-08-18T22:19:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fddfa200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fddf40b0520 con 0x7fddf415b1c0 2024-08-18T22:19:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fddf3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddf40b4850 0x7fddf414a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fddf3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddf40b4850 0x7fddf414a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40200/0 (socket says 172.21.15.5:40200) 2024-08-18T22:19:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fddf3400640 1 -- 172.21.15.5:0/2804935085 learned_addr learned my addr 172.21.15.5:0/2804935085 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fddfa200640 1 -- 172.21.15.5:0/2804935085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fddf40b2880 con 0x7fddf40b4850 2024-08-18T22:19:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7fddfa200640 1 -- 172.21.15.5:0/2804935085 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fddf40b06a0 con 0x7fddf40d1170 2024-08-18T22:19:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddf3400640 1 -- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf40d1170 msgr2=0x7fddf40d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddf3e00640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf40d1170 0x7fddf40d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f878bc00640 1 Processor -- start 2024-08-18T22:19:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddf3400640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf40d1170 0x7fddf40d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddf3400640 1 -- 172.21.15.5:0/2804935085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddf415b1c0 msgr2=0x7fddf4148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddf3400640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddf415b1c0 0x7fddf4148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddf3400640 1 -- 172.21.15.5:0/2804935085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf414d430 con 0x7fddf40b4850 2024-08-18T22:19:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddf3e00640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf40d1170 0x7fddf40d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.682+0000 7f3437200640 1 -- 172.21.15.5:0/3051785779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3430151530 con 0x7f34300b3910 2024-08-18T22:19:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddf3400640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddf40b4850 0x7fddf414a3d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdde401c790 tx=0x7fdde401b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fdbdac00640 1 -- 172.21.15.5:0/2383255993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd40cdf10 con 0x7fdbd415e4b0 2024-08-18T22:19:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7f3437200640 1 -- 172.21.15.5:0/3051785779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343015a5a0 con 0x7f34300b3910 2024-08-18T22:19:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fce03400640 1 -- 172.21.15.5:0/27718232 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04019070 con 0x7fce0c166770 2024-08-18T22:19:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fce03400640 1 -- 172.21.15.5:0/27718232 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0400cba0 con 0x7fce0c166770 2024-08-18T22:19:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fce03400640 1 -- 172.21.15.5:0/27718232 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04014440 con 0x7fce0c166770 2024-08-18T22:19:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddeb400640 1 -- 172.21.15.5:0/2804935085 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde40bf070 con 0x7fddf40b4850 2024-08-18T22:19:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddfa200640 1 -- 172.21.15.5:0/2804935085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf414cb90 con 0x7fddf40b4850 2024-08-18T22:19:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddfa200640 1 -- 172.21.15.5:0/2804935085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf414d150 con 0x7fddf40b4850 2024-08-18T22:19:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddeb400640 1 -- 172.21.15.5:0/2804935085 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde40afc60 con 0x7fddf40b4850 2024-08-18T22:19:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fddeb400640 1 -- 172.21.15.5:0/2804935085 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde40b4040 con 0x7fddf40b4850 2024-08-18T22:19:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7f878bc00640 1 -- start start 2024-08-18T22:19:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fce11e00640 1 -- 172.21.15.5:0/27718232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce0c0b0620 con 0x7fce0c166770 2024-08-18T22:19:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fce11e00640 1 -- 172.21.15.5:0/27718232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce0c09c1d0 con 0x7fce0c166770 2024-08-18T22:19:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7f3437200640 1 -- 172.21.15.5:0/3051785779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343006ca90 con 0x7f34300b3910 2024-08-18T22:19:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fdde8c00640 1 -- 172.21.15.5:0/2804935085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc40052a0 con 0x7fddf40b4850 2024-08-18T22:19:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7fddeb400640 1 -- 172.21.15.5:0/2804935085 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdde40c2070 con 0x7fddf40b4850 2024-08-18T22:19:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.686+0000 7fce11e00640 1 -- 172.21.15.5:0/27718232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce0c1604c0 con 0x7fce0c166770 2024-08-18T22:19:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7fce03400640 1 -- 172.21.15.5:0/27718232 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fce0401c070 con 0x7fce0c166770 2024-08-18T22:19:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7f30bbe00640 1 -- 172.21.15.5:0/836035787 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f30b4055490 con 0x7f30c406d4b0 2024-08-18T22:19:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7f3427e00640 1 -- 172.21.15.5:0/3051785779 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f341c0bb020 con 0x7f34300b3910 2024-08-18T22:19:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7f3427e00640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3410067910 0x7f3410069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7f3427e00640 1 -- 172.21.15.5:0/3051785779 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f341c11f950 con 0x7f34300b3910 2024-08-18T22:19:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7f342fe00640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3410067910 0x7f3410069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7fddeb400640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fddd0067910 0x7fddd0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7fddeb400640 1 -- 172.21.15.5:0/2804935085 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdde41206d0 con 0x7fddf40b4850 2024-08-18T22:19:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7fddebe00640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fddd0067910 0x7fddd0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7f342fe00640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3410067910 0x7f3410069dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f34301fa9d0 tx=0x7f3420008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7fce03400640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdec0678c0 0x7fcdec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.690+0000 7fce03400640 1 -- 172.21.15.5:0/27718232 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fce04085a30 con 0x7fce0c166770 2024-08-18T22:19:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f878bc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 0x7f878415d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f878bc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87840b40c0 0x7f8784206bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7fce0aa00640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdec0678c0 0x7fcdec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f878bc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878415b0c0 0x7f878415dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f878bc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f878406f330 con 0x7f87840b40c0 2024-08-18T22:19:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f878bc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f878406f1b0 con 0x7f878415b0c0 2024-08-18T22:19:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8789c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878415b0c0 0x7f878415dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f878bc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f878406f670 con 0x7f878406e410 2024-08-18T22:19:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8789c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878415b0c0 0x7f878415dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40216/0 (socket says 172.21.15.5:40216) 2024-08-18T22:19:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8789c00640 1 -- 172.21.15.5:0/2753164393 learned_addr learned my addr 172.21.15.5:0/2753164393 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8783e00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87840b40c0 0x7f8784206bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8789200640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 0x7f878415d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8789c00640 1 -- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 msgr2=0x7f878415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8789c00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 0x7f878415d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7fdbcbe00640 1 -- 172.21.15.5:0/2383255993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdbcc0054b0 con 0x7fdbd415e4b0 2024-08-18T22:19:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7fdbcbe00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbb4067990 0x7fdbb4069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8789c00640 1 -- 172.21.15.5:0/2753164393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87840b40c0 msgr2=0x7f8784206bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7fdbcbe00640 1 -- 172.21.15.5:0/2383255993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdbcc086940 con 0x7fdbd415e4b0 2024-08-18T22:19:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8789c00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87840b40c0 0x7f8784206bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7fddebe00640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fddd0067910 0x7fddd0069dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fddf4166cf0 tx=0x7fdddc006c50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8789c00640 1 -- 172.21.15.5:0/2753164393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87840afb30 con 0x7f878415b0c0 2024-08-18T22:19:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8783e00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87840b40c0 0x7f8784206bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8789200640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 0x7f878415d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7fce0aa00640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdec0678c0 0x7fcdec069d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0ad000 tx=0x7fcdfc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7fce03400640 1 -- 172.21.15.5:0/27718232 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fce04055be0 con 0x7fce0c166770 2024-08-18T22:19:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7f8789c00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878415b0c0 0x7f878415dae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f877c0b0040 tx=0x7f877c0195f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.694+0000 7fdbd3e00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbb4067990 0x7fdbb4069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.698+0000 7fdbd3e00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbb4067990 0x7fdbb4069e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdbc401ab80 tx=0x7fdbc40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.698+0000 7f8780c00640 1 -- 172.21.15.5:0/2753164393 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c0b2050 con 0x7f878415b0c0 2024-08-18T22:19:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.698+0000 7f878bc00640 1 -- 172.21.15.5:0/2753164393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f878415ca60 con 0x7f878415b0c0 2024-08-18T22:19:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.698+0000 7f878bc00640 1 -- 172.21.15.5:0/2753164393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87840adf70 con 0x7f878415b0c0 2024-08-18T22:19:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.698+0000 7f8780c00640 1 -- 172.21.15.5:0/2753164393 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877c0b3040 con 0x7f878415b0c0 2024-08-18T22:19:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.698+0000 7f8780c00640 1 -- 172.21.15.5:0/2753164393 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c0ad650 con 0x7f878415b0c0 2024-08-18T22:19:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.698+0000 7fdbcbe00640 1 -- 172.21.15.5:0/2383255993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdbcc057120 con 0x7fdbd415e4b0 2024-08-18T22:19:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.702+0000 7f878bc00640 1 -- 172.21.15.5:0/2753164393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87600052a0 con 0x7f878415b0c0 2024-08-18T22:19:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.702+0000 7fddeb400640 1 -- 172.21.15.5:0/2804935085 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdde4018780 con 0x7fddf40b4850 2024-08-18T22:19:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.702+0000 7f8780c00640 1 -- 172.21.15.5:0/2753164393 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f877c0c0020 con 0x7f878415b0c0 2024-08-18T22:19:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.706+0000 7f8780c00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87640679c0 0x7f8764069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.706+0000 7f8780c00640 1 -- 172.21.15.5:0/2753164393 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f877c120530 con 0x7f878415b0c0 2024-08-18T22:19:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.706+0000 7f8789200640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87640679c0 0x7f8764069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.706+0000 7f3427e00640 1 -- 172.21.15.5:0/3051785779 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f341c0c2030 con 0x7f34300b3910 2024-08-18T22:19:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.706+0000 7f8789200640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87640679c0 0x7f8764069e80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8778000f70 tx=0x7f8778009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:44.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:44.710+0000 7f8780c00640 1 -- 172.21.15.5:0/2753164393 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f877c0c7020 con 0x7f878415b0c0 2024-08-18T22:19:45.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.014+0000 7fccaa400640 1 -- 172.21.15.5:0/2333169530 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fcca406c210 con 0x7fcca40b2fc0 2024-08-18T22:19:45.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.014+0000 7fcc9b400640 1 -- 172.21.15.5:0/2333169530 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcca41476e0 con 0x7fcca40b2fc0 2024-08-18T22:19:45.021 INFO:teuthology.orchestra.run.smithi005.stdout:64424509448 2024-08-18T22:19:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.018+0000 7fccaa400640 1 -- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc80067cf0 msgr2=0x7fcc8006a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.018+0000 7fccaa400640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc80067cf0 0x7fcc8006a1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcc940b4000 tx=0x7fcc94004740 comp rx=0 tx=0).stop 2024-08-18T22:19:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.018+0000 7fccaa400640 1 -- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40b2fc0 msgr2=0x7fcca409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.018+0000 7fccaa400640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40b2fc0 0x7fcca409aa40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcca40cc5e0 tx=0x7fcc8c00c870 comp rx=0 tx=0).stop 2024-08-18T22:19:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.018+0000 7fccaa400640 1 -- 172.21.15.5:0/2333169530 shutdown_connections 2024-08-18T22:19:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.018+0000 7fccaa400640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc80067cf0 0x7fcc8006a1b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.018+0000 7fccaa400640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcca4159fe0 0x7fcca415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.018+0000 7fccaa400640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca40b2fc0 0x7fcca409aa40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.018+0000 7fccaa400640 1 --2- 172.21.15.5:0/2333169530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca406e190 0x7fcca4147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.018+0000 7fccaa400640 1 -- 172.21.15.5:0/2333169530 >> 172.21.15.5:0/2333169530 conn(0x7fcca406bb80 msgr2=0x7fcca40b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.022+0000 7fccaa400640 1 -- 172.21.15.5:0/2333169530 shutdown_connections 2024-08-18T22:19:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.022+0000 7fccaa400640 1 -- 172.21.15.5:0/2333169530 wait complete. 2024-08-18T22:19:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.034+0000 7f02cf000640 1 -- 172.21.15.5:0/3214042387 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f02c0033d20 con 0x7f02c00deb10 2024-08-18T22:19:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.034+0000 7f02b7e00640 1 -- 172.21.15.5:0/3214042387 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f02c816b190 con 0x7f02c00deb10 2024-08-18T22:19:45.043 INFO:teuthology.orchestra.run.smithi005.stdout:64424509449 2024-08-18T22:19:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.038+0000 7f02b5600640 1 -- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f02ac067910 msgr2=0x7f02ac069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.038+0000 7f02b5600640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f02ac067910 0x7f02ac069dd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f02b8000fc0 tx=0x7f02b8009040 comp rx=0 tx=0).stop 2024-08-18T22:19:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.038+0000 7f02b5600640 1 -- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00deb10 msgr2=0x7f02c00d4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.038+0000 7f02b5600640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00deb10 0x7f02c00d4cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f02c8000b70 tx=0x7f02c8094f20 comp rx=0 tx=0).stop 2024-08-18T22:19:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.038+0000 7f02b5600640 1 -- 172.21.15.5:0/3214042387 shutdown_connections 2024-08-18T22:19:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.038+0000 7f02b5600640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f02ac067910 0x7f02ac069dd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.038+0000 7f02b5600640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00deb10 0x7f02c00d4cf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.038+0000 7f02b5600640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c0054cf0 0x7f02c00cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.038+0000 7f02b5600640 1 --2- 172.21.15.5:0/3214042387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02c0050c40 0x7f02c00d7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.038+0000 7f02b5600640 1 -- 172.21.15.5:0/3214042387 >> 172.21.15.5:0/3214042387 conn(0x7f02c001d970 msgr2=0x7f02c0005820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.038+0000 7f02b5600640 1 -- 172.21.15.5:0/3214042387 shutdown_connections 2024-08-18T22:19:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.042+0000 7f02b5600640 1 -- 172.21.15.5:0/3214042387 wait complete. 2024-08-18T22:19:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.042+0000 7fce11e00640 1 -- 172.21.15.5:0/27718232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fce0c06dbf0 con 0x7fce0c166770 2024-08-18T22:19:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.042+0000 7f30c9800640 1 -- 172.21.15.5:0/836035787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f30c4069180 con 0x7f30c406d4b0 2024-08-18T22:19:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.046+0000 7fce03400640 1 -- 172.21.15.5:0/27718232 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fce04059ee0 con 0x7fce0c166770 2024-08-18T22:19:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.046+0000 7f30bbe00640 1 -- 172.21.15.5:0/836035787 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f30b4059790 con 0x7f30c406d4b0 2024-08-18T22:19:45.050 INFO:teuthology.orchestra.run.smithi005.stdout:64424509448 2024-08-18T22:19:45.053 INFO:teuthology.orchestra.run.smithi005.stdout:64424509449 2024-08-18T22:19:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 -- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdec0678c0 msgr2=0x7fcdec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdec0678c0 0x7fcdec069d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0ad000 tx=0x7fcdfc0a6000 comp rx=0 tx=0).stop 2024-08-18T22:19:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 -- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c166770 msgr2=0x7fce0c15f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c166770 0x7fce0c15f200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fce0400b990 tx=0x7fce0400be50 comp rx=0 tx=0).stop 2024-08-18T22:19:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 -- 172.21.15.5:0/27718232 shutdown_connections 2024-08-18T22:19:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdec0678c0 0x7fcdec069d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c166770 0x7fce0c15f200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce0c06bd90 0x7fce0c15ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 --2- 172.21.15.5:0/27718232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce0c06b9b0 0x7fce0c161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 -- 172.21.15.5:0/27718232 >> 172.21.15.5:0/27718232 conn(0x7fce0c0b65f0 msgr2=0x7fce0c0b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 -- 172.21.15.5:0/27718232 shutdown_connections 2024-08-18T22:19:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7fce11e00640 1 -- 172.21.15.5:0/27718232 wait complete. 2024-08-18T22:19:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 -- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f30a40678c0 msgr2=0x7f30a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f30a40678c0 0x7f30a4069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f30c40b72c0 tx=0x7f30b0009190 comp rx=0 tx=0).stop 2024-08-18T22:19:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 -- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c406d4b0 msgr2=0x7f30c40c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c406d4b0 0x7f30c40c9190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f30b400c420 tx=0x7f30b400c8e0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 -- 172.21.15.5:0/836035787 shutdown_connections 2024-08-18T22:19:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f30a40678c0 0x7f30a4069d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c41636e0 0x7f30c4160450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30c40d0ae0 0x7f30c40cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 --2- 172.21.15.5:0/836035787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30c406d4b0 0x7f30c40c9190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 -- 172.21.15.5:0/836035787 >> 172.21.15.5:0/836035787 conn(0x7f30c40d20c0 msgr2=0x7f30c40c8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 -- 172.21.15.5:0/836035787 shutdown_connections 2024-08-18T22:19:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.050+0000 7f30c9800640 1 -- 172.21.15.5:0/836035787 wait complete. 2024-08-18T22:19:45.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.1 2024-08-18T22:19:45.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.054+0000 7fdde8c00640 1 -- 172.21.15.5:0/2804935085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fddc4005590 con 0x7fddf40b4850 2024-08-18T22:19:45.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.054+0000 7fddeb400640 1 -- 172.21.15.5:0/2804935085 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdde40f0980 con 0x7fddf40b4850 2024-08-18T22:19:45.061 INFO:teuthology.orchestra.run.smithi005.stdout:64424509448 2024-08-18T22:19:45.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.054+0000 7f878bc00640 1 -- 172.21.15.5:0/2753164393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8760005590 con 0x7f878415b0c0 2024-08-18T22:19:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7f8780c00640 1 -- 172.21.15.5:0/2753164393 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f877c016560 con 0x7f878415b0c0 2024-08-18T22:19:45.062 INFO:teuthology.orchestra.run.smithi005.stdout:64424509450 2024-08-18T22:19:45.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 -- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fddd0067910 msgr2=0x7fddd0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fddd0067910 0x7fddd0069dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fddf4166cf0 tx=0x7fdddc006c50 comp rx=0 tx=0).stop 2024-08-18T22:19:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 -- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddf40b4850 msgr2=0x7fddf414a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddf40b4850 0x7fddf414a3d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdde401c790 tx=0x7fdde401b900 comp rx=0 tx=0).stop 2024-08-18T22:19:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 -- 172.21.15.5:0/2804935085 shutdown_connections 2024-08-18T22:19:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fddd0067910 0x7fddd0069dd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddf40d1170 0x7fddf40d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddf415b1c0 0x7fddf4148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 --2- 172.21.15.5:0/2804935085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddf40b4850 0x7fddf414a3d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 -- 172.21.15.5:0/2804935085 >> 172.21.15.5:0/2804935085 conn(0x7fddf40b65f0 msgr2=0x7fddf406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdbdac00640 1 -- 172.21.15.5:0/2383255993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdbd4072420 con 0x7fdbd415e4b0 2024-08-18T22:19:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 -- 172.21.15.5:0/2804935085 shutdown_connections 2024-08-18T22:19:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdde8c00640 1 -- 172.21.15.5:0/2804935085 wait complete. 2024-08-18T22:19:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.058+0000 7fdbcbe00640 1 -- 172.21.15.5:0/2383255993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdbcc056a20 con 0x7fdbd415e4b0 2024-08-18T22:19:45.066 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-08-18T22:19:45.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 -- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87640679c0 msgr2=0x7f8764069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87640679c0 0x7f8764069e80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8778000f70 tx=0x7f8778009040 comp rx=0 tx=0).stop 2024-08-18T22:19:45.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 -- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878415b0c0 msgr2=0x7f878415dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878415b0c0 0x7f878415dae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f877c0b0040 tx=0x7f877c0195f0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 -- 172.21.15.5:0/2753164393 shutdown_connections 2024-08-18T22:19:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87640679c0 0x7f8764069e80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f878415b0c0 0x7f878415dae0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87840b40c0 0x7f8784206bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 --2- 172.21.15.5:0/2753164393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f878406e410 0x7f878415d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 -- 172.21.15.5:0/2753164393 >> 172.21.15.5:0/2753164393 conn(0x7f87840b1dc0 msgr2=0x7f8784158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 -- 172.21.15.5:0/2753164393 shutdown_connections 2024-08-18T22:19:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f878bc00640 1 -- 172.21.15.5:0/2753164393 wait complete. 2024-08-18T22:19:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7fdbdac00640 1 -- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbb4067990 msgr2=0x7fdbb4069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7fdbdac00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbb4067990 0x7fdbb4069e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdbc401ab80 tx=0x7fdbc40a6000 comp rx=0 tx=0).stop 2024-08-18T22:19:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7fdbdac00640 1 -- 172.21.15.5:0/2383255993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbd415e4b0 msgr2=0x7fdbd4156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7fdbdac00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbd415e4b0 0x7fdbd4156660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00c700 tx=0x7fdbcc00cbc0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7f3437200640 1 -- 172.21.15.5:0/3051785779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f343015b9e0 con 0x7f34300b3910 2024-08-18T22:19:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7fdbdac00640 1 -- 172.21.15.5:0/2383255993 shutdown_connections 2024-08-18T22:19:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7fdbdac00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbb4067990 0x7fdbb4069e50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7fdbdac00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbd415e4b0 0x7fdbd4156660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7fdbdac00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbd40ce450 0x7fdbd415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7fdbdac00640 1 --2- 172.21.15.5:0/2383255993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbd40adf80 0x7fdbd41605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.062+0000 7fdbdac00640 1 -- 172.21.15.5:0/2383255993 >> 172.21.15.5:0/2383255993 conn(0x7fdbd40b5800 msgr2=0x7fdbd4072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7f3427e00640 1 -- 172.21.15.5:0/3051785779 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f341c016030 con 0x7f34300b3910 2024-08-18T22:19:45.070 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2024-08-18T22:19:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7fdbdac00640 1 -- 172.21.15.5:0/2383255993 shutdown_connections 2024-08-18T22:19:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7fdbdac00640 1 -- 172.21.15.5:0/2383255993 wait complete. 2024-08-18T22:19:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7f3437200640 1 -- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3410067910 msgr2=0x7f3410069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7f3437200640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3410067910 0x7f3410069dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f34301fa9d0 tx=0x7f3420008040 comp rx=0 tx=0).stop 2024-08-18T22:19:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7f3437200640 1 -- 172.21.15.5:0/3051785779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34300b3910 msgr2=0x7f34301596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7f3437200640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34300b3910 0x7f34301596f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f341c0ae040 tx=0x7f341c0191e0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7f3437200640 1 -- 172.21.15.5:0/3051785779 shutdown_connections 2024-08-18T22:19:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7f3437200640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3410067910 0x7f3410069dd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7f3437200640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3430161c30 0x7f3430159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7f3437200640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34300b3910 0x7f34301596f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7f3437200640 1 --2- 172.21.15.5:0/3051785779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343006e7e0 0x7f3430150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.066+0000 7f3437200640 1 -- 172.21.15.5:0/3051785779 >> 172.21.15.5:0/3051785779 conn(0x7f343008bfd0 msgr2=0x7f34300b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.070+0000 7f3437200640 1 -- 172.21.15.5:0/3051785779 shutdown_connections 2024-08-18T22:19:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:45.070+0000 7f3437200640 1 -- 172.21.15.5:0/3051785779 wait complete. 2024-08-18T22:19:45.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509449 for osd.3 2024-08-18T22:19:45.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509449 for osd.0 2024-08-18T22:19:45.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.7 2024-08-18T22:19:45.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-08-18T22:19:45.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509450 for osd.6 2024-08-18T22:19:45.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.5 2024-08-18T22:19:45.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-08-18T22:19:46.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-18T22:19:46.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-18T22:19:46.096 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-18T22:19:46.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-18T22:19:46.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-18T22:19:46.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-18T22:19:46.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-18T22:19:46.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-18T22:19:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.282+0000 7f885c200640 1 Processor -- start 2024-08-18T22:19:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.282+0000 7f885c200640 1 -- start start 2024-08-18T22:19:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.282+0000 7f885c200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88540b36d0 0x7f8854071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.282+0000 7f885c200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88540addd0 con 0x7f885406e8a0 2024-08-18T22:19:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.282+0000 7f885c200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88540b3cd0 con 0x7f8854159fe0 2024-08-18T22:19:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.282+0000 7f885c200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f88540ae070 con 0x7f88540b36d0 2024-08-18T22:19:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8859800640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f8854159fe0 0x7f885406e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:44826/0 (socket says 172.21.15.5:44826) 2024-08-18T22:19:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8859800640 1 -- 172.21.15.5:0/3048087680 learned_addr learned my addr 172.21.15.5:0/3048087680 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680940886 0 0) 0x7f88540b3cd0 con 0x7f8854159fe0 2024-08-18T22:19:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f883c003530 con 0x7f8854159fe0 2024-08-18T22:19:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3364961875 0 0) 0x7f883c003530 con 0x7f8854159fe0 2024-08-18T22:19:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 >> v2:172.21.15.5:3300/0 conn(0x7f88540b36d0 msgr2=0x7f8854071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 --2- 172.21.15.5:0/3048087680 >> v2:172.21.15.5:3300/0 conn(0x7f88540b36d0 0x7f8854071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 >> v1:172.21.15.5:6789/0 conn(0x7f885406e8a0 legacy=0x7f88540b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88540ae350 con 0x7f8854159fe0 2024-08-18T22:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f884c001a00 con 0x7f8854159fe0 2024-08-18T22:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 >> v1:172.21.15.117:6789/0 conn(0x7f8854159fe0 legacy=0x7f885406e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 --2- 172.21.15.5:0/3048087680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f883c003a10 0x7f883c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 --2- 172.21.15.5:0/3048087680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f883c004810 0x7f883c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 --2- 172.21.15.5:0/3048087680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c005380 0x7f883c00b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f88540ae070 con 0x7f883c005380 2024-08-18T22:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f883c00c2d0 con 0x7f883c004810 2024-08-18T22:19:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f883c00c4d0 con 0x7f883c003a10 2024-08-18T22:19:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8859800640 1 --2- 172.21.15.5:0/3048087680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f883c003a10 0x7f883c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8859800640 1 -- 172.21.15.5:0/3048087680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f883c004810 msgr2=0x7f883c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8859800640 1 --2- 172.21.15.5:0/3048087680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f883c004810 0x7f883c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8859800640 1 -- 172.21.15.5:0/3048087680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c005380 msgr2=0x7f883c00b9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T22:19:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f885a200640 1 --2- 172.21.15.5:0/3048087680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c005380 0x7f883c00b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8859800640 1 --2- 172.21.15.5:0/3048087680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c005380 0x7f883c00b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f8859800640 1 -- 172.21.15.5:0/3048087680 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883c003530 con 0x7f883c003a10 2024-08-18T22:19:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.286+0000 7f885a200640 1 --2- 172.21.15.5:0/3048087680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c005380 0x7f883c00b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.290+0000 7f885a200640 1 -- 172.21.15.5:0/3048087680 reap_dead start 2024-08-18T22:19:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.294+0000 7f8859800640 1 --2- 172.21.15.5:0/3048087680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f883c003a10 0x7f883c003e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f884c00a7d0 tx=0x7f884c01fa40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39e573c7a6938e80 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.294+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c00a3f0 con 0x7f883c003a10 2024-08-18T22:19:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.294+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884c0aa690 con 0x7f883c003a10 2024-08-18T22:19:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.294+0000 7f8853e00640 1 -- 172.21.15.5:0/3048087680 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0aaac0 con 0x7f883c003a10 2024-08-18T22:19:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.294+0000 7f885c200640 1 -- 172.21.15.5:0/3048087680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f883c003a10 msgr2=0x7f883c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.294+0000 7f885c200640 1 --2- 172.21.15.5:0/3048087680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f883c003a10 0x7f883c003e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f884c00a7d0 tx=0x7f884c01fa40 comp rx=0 tx=0).stop 2024-08-18T22:19:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.294+0000 7f885c200640 1 -- 172.21.15.5:0/3048087680 shutdown_connections 2024-08-18T22:19:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.294+0000 7f885c200640 1 --2- 172.21.15.5:0/3048087680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f883c003a10 0x7f883c003e10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.294+0000 7f885c200640 1 -- 172.21.15.5:0/3048087680 >> 172.21.15.5:0/3048087680 conn(0x7f885406bb80 msgr2=0x7f885406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.294+0000 7f885c200640 1 -- 172.21.15.5:0/3048087680 shutdown_connections 2024-08-18T22:19:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.294+0000 7f885c200640 1 -- 172.21.15.5:0/3048087680 wait complete. 2024-08-18T22:19:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.298+0000 7f885c200640 1 Processor -- start 2024-08-18T22:19:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.298+0000 7f885c200640 1 -- start start 2024-08-18T22:19:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.298+0000 7f885c200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c003a10 0x7f885409cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.298+0000 7f885c200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88542146b0 0x7f8854214b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.298+0000 7f885c200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8854212720 0x7f8854215090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.298+0000 7f885c200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f885406d9e0 con 0x7f883c003a10 2024-08-18T22:19:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.298+0000 7f885c200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f885415a3c0 con 0x7f88542146b0 2024-08-18T22:19:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885c200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f885406db60 con 0x7f8854212720 2024-08-18T22:19:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f8859800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c003a10 0x7f885409cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f8858e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88542146b0 0x7f8854214b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885a200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8854212720 0x7f8854215090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885a200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8854212720 0x7f8854215090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47664/0 (socket says 172.21.15.5:47664) 2024-08-18T22:19:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885a200640 1 -- 172.21.15.5:0/2605870040 learned_addr learned my addr 172.21.15.5:0/2605870040 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885a200640 1 -- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88542146b0 msgr2=0x7f8854214b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885a200640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88542146b0 0x7f8854214b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885a200640 1 -- 172.21.15.5:0/2605870040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c003a10 msgr2=0x7f885409cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885a200640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c003a10 0x7f885409cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885a200640 1 -- 172.21.15.5:0/2605870040 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885409c550 con 0x7f8854212720 2024-08-18T22:19:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885a200640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8854212720 0x7f8854215090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8854069630 tx=0x7f884000c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f8851600640 1 -- 172.21.15.5:0/2605870040 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840011800 con 0x7f8854212720 2024-08-18T22:19:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f8851600640 1 -- 172.21.15.5:0/2605870040 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8840018070 con 0x7f8854212720 2024-08-18T22:19:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f8851600640 1 -- 172.21.15.5:0/2605870040 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840011c00 con 0x7f8854212720 2024-08-18T22:19:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885c200640 1 -- 172.21.15.5:0/2605870040 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885409c270 con 0x7f8854212720 2024-08-18T22:19:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.302+0000 7f885c200640 1 -- 172.21.15.5:0/2605870040 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88540cd9a0 con 0x7f8854212720 2024-08-18T22:19:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.306+0000 7f8851600640 1 -- 172.21.15.5:0/2605870040 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f884001d460 con 0x7f8854212720 2024-08-18T22:19:46.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.306+0000 7f8846a00640 1 -- 172.21.15.5:0/2605870040 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88280052a0 con 0x7f8854212720 2024-08-18T22:19:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.310+0000 7f8851600640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88340678c0 0x7f8834069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.310+0000 7f8851600640 1 -- 172.21.15.5:0/2605870040 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f88400858d0 con 0x7f8854212720 2024-08-18T22:19:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.310+0000 7f8859800640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88340678c0 0x7f8834069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.310+0000 7f8859800640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88340678c0 0x7f8834069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f884c0b0000 tx=0x7f884c0ab000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.318+0000 7f8851600640 1 -- 172.21.15.5:0/2605870040 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8840056140 con 0x7f8854212720 2024-08-18T22:19:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7f8c0e000640 1 Processor -- start 2024-08-18T22:19:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.342+0000 7ff7d4c00640 1 Processor -- start 2024-08-18T22:19:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff7d4c00640 1 -- start start 2024-08-18T22:19:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff7d4c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7c8049780 0x7ff7c8049b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff7d4c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7c80e7360 0x7ff7c8050e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff7d4c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c8054070 con 0x7ff7c8057360 2024-08-18T22:19:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff7d4c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c80e8300 con 0x7ff7c80e7360 2024-08-18T22:19:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff7d4c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c804a0a0 con 0x7ff7c8049780 2024-08-18T22:19:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff41ec00640 1 Processor -- start 2024-08-18T22:19:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff41ec00640 1 -- start start 2024-08-18T22:19:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff7cde00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7c8049780 0x7ff7c8049b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff7cde00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7c8049780 0x7ff7c8049b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40242/0 (socket says 172.21.15.5:40242) 2024-08-18T22:19:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7f8c0e000640 1 -- start start 2024-08-18T22:19:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff7cde00640 1 -- 172.21.15.5:0/1454363873 learned_addr learned my addr 172.21.15.5:0/1454363873 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.346+0000 7ff7ce800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7c80e7360 0x7ff7c8050e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff41ec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4180ce620 0x7ff418162ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff41ec00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4181673c0 con 0x7ff41815cdb0 2024-08-18T22:19:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff41ec00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4181664d0 con 0x7ff418072060 2024-08-18T22:19:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff41ec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff4181667b0 con 0x7ff4180ce620 2024-08-18T22:19:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff7ce800640 1 -- 172.21.15.5:0/1454363873 >> v2:172.21.15.117:3300/0 conn(0x7ff7c8049780 msgr2=0x7ff7c8049b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff417e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff41815cdb0 0x7ff4180cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38698/0 (socket says 172.21.15.5:38698) 2024-08-18T22:19:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff417e00640 1 -- 172.21.15.5:0/1466371635 learned_addr learned my addr 172.21.15.5:0/1466371635 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff417400640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4180ce620 0x7ff418162ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff7ce800640 1 --2- 172.21.15.5:0/1454363873 >> v2:172.21.15.117:3300/0 conn(0x7ff7c8049780 0x7ff7c8049b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff7ce800640 1 -- 172.21.15.5:0/1454363873 >> v1:172.21.15.5:6789/0 conn(0x7ff7c8057360 legacy=0x7ff7c8053960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff7ce800640 1 -- 172.21.15.5:0/1454363873 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c80e7d40 con 0x7ff7c80e7360 2024-08-18T22:19:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264479183 0 0) 0x7ff4181673c0 con 0x7ff41815cdb0 2024-08-18T22:19:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3fc003530 con 0x7ff41815cdb0 2024-08-18T22:19:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 693994636 0 0) 0x7ff3fc003530 con 0x7ff41815cdb0 2024-08-18T22:19:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4180ce620 msgr2=0x7ff418162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4180ce620 0x7ff418162ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 >> v1:172.21.15.117:6789/0 conn(0x7ff418072060 legacy=0x7ff4180b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff418166a90 con 0x7ff41815cdb0 2024-08-18T22:19:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7ff408001660 con 0x7ff41815cdb0 2024-08-18T22:19:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 >> v1:172.21.15.5:6789/0 conn(0x7ff41815cdb0 legacy=0x7ff4180cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3fc003a10 0x7ff3fc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc004810 0x7ff3fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3fc005220 0x7ff3fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4181667b0 con 0x7ff3fc003a10 2024-08-18T22:19:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc00c100 con 0x7ff3fc004810 2024-08-18T22:19:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff3fc00c300 con 0x7ff3fc005220 2024-08-18T22:19:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7f8c0e000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8c08159a40 0x7f8c0815c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7f8c0e000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c0815ced0 con 0x7f8c080b4470 2024-08-18T22:19:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7f8c0e000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c0815d1b0 con 0x7f8c0815ca30 2024-08-18T22:19:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7f8c0e000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8c0806ff10 con 0x7f8c08159a40 2024-08-18T22:19:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7f8c07e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f8c0815ca30 0x7f8c0809aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:44848/0 (socket says 172.21.15.5:44848) 2024-08-18T22:19:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7f8c07e00640 1 -- 172.21.15.5:0/960156872 learned_addr learned my addr 172.21.15.5:0/960156872 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.350+0000 7ff41cc00640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3fc005220 0x7ff3fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7ff417400640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc004810 0x7ff3fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7ff417e00640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3fc003a10 0x7ff3fc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7ff41cc00640 1 -- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc004810 msgr2=0x7ff3fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7ff41cc00640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3fc004810 0x7ff3fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7ff41cc00640 1 -- 172.21.15.5:0/1466371635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3fc003a10 msgr2=0x7ff3fc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7ff41cc00640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3fc003a10 0x7ff3fc003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7ff41cc00640 1 -- 172.21.15.5:0/1466371635 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc003530 con 0x7ff3fc005220 2024-08-18T22:19:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8c07400640 1 -- 172.21.15.5:0/960156872 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591673824 0 0) 0x7f8c0815d1b0 con 0x7f8c0815ca30 2024-08-18T22:19:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8c07400640 1 -- 172.21.15.5:0/960156872 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bf0003530 con 0x7f8c0815ca30 2024-08-18T22:19:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8c07400640 1 -- 172.21.15.5:0/960156872 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3283468405 0 0) 0x7f8c0815ced0 con 0x7f8c080b4470 2024-08-18T22:19:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8c07400640 1 -- 172.21.15.5:0/960156872 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c0815d1b0 con 0x7f8c080b4470 2024-08-18T22:19:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8c0cc00640 1 --2- 172.21.15.5:0/960156872 >> v2:172.21.15.117:3300/0 conn(0x7f8c08159a40 0x7f8c0815c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7fa3e8a00640 1 Processor -- start 2024-08-18T22:19:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7fa3e8a00640 1 -- start start 2024-08-18T22:19:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8c0cc00640 1 -- 172.21.15.5:0/960156872 >> v1:172.21.15.117:6789/0 conn(0x7f8c0815ca30 legacy=0x7f8c0809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8c0cc00640 1 -- 172.21.15.5:0/960156872 >> v1:172.21.15.5:6789/0 conn(0x7f8c080b4470 legacy=0x7f8c08070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8c0cc00640 1 -- 172.21.15.5:0/960156872 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c080701f0 con 0x7f8c08159a40 2024-08-18T22:19:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8e70000640 1 Processor -- start 2024-08-18T22:19:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7fa3e8a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa3e40706a0 0x7fa3e40b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7fa3e8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40afe00 0x7fa3e40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7fa3e8a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e40b43e0 con 0x7fa3e415a690 2024-08-18T22:19:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7fa3e8a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e40b4190 con 0x7fa3e40706a0 2024-08-18T22:19:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7fa3e8a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e40b4d10 con 0x7fa3e40afe00 2024-08-18T22:19:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8e70000640 1 -- start start 2024-08-18T22:19:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8e70000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8e680ae0c0 0x7f8e681634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8e70000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e68166480 con 0x7f8e680aeb70 2024-08-18T22:19:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8e70000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e68072f50 con 0x7f8e68166010 2024-08-18T22:19:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.354+0000 7f8e70000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8e680aef50 con 0x7f8e680ae0c0 2024-08-18T22:19:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7fa3e1e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa3e40706a0 0x7fa3e40b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7fa3e1e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa3e40706a0 0x7fa3e40b56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40260/0 (socket says 172.21.15.5:40260) 2024-08-18T22:19:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7fa3e1e00640 1 -- 172.21.15.5:0/3217986401 learned_addr learned my addr 172.21.15.5:0/3217986401 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7fa3e3200640 1 --2- 172.21.15.5:0/3217986401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40afe00 0x7fa3e40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7f8e6d600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8e680aeb70 0x7f8e68073450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38708/0 (socket says 172.21.15.5:38708) 2024-08-18T22:19:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7f8e6d600640 1 -- 172.21.15.5:0/3841058763 learned_addr learned my addr 172.21.15.5:0/3841058763 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7fa3e1e00640 1 -- 172.21.15.5:0/3217986401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40afe00 msgr2=0x7fa3e40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7fa3e1e00640 1 --2- 172.21.15.5:0/3217986401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40afe00 0x7fa3e40ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7fa3e1e00640 1 -- 172.21.15.5:0/3217986401 >> v1:172.21.15.5:6789/0 conn(0x7fa3e415a690 legacy=0x7fa3e406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7fa3e1e00640 1 -- 172.21.15.5:0/3217986401 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e40b46c0 con 0x7fa3e40706a0 2024-08-18T22:19:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7f8e6e000640 1 --2- 172.21.15.5:0/3841058763 >> v2:172.21.15.5:3300/0 conn(0x7f8e680ae0c0 0x7f8e681634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7ff41cc00640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3fc005220 0x7ff3fc00b9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff418160a40 tx=0x7ff41001c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7454b0e6f72e6df server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7f8e6e000640 1 -- 172.21.15.5:0/3841058763 >> v1:172.21.15.117:6789/0 conn(0x7f8e68166010 legacy=0x7f8e680ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7f8e6e000640 1 -- 172.21.15.5:0/3841058763 >> v1:172.21.15.5:6789/0 conn(0x7f8e680aeb70 legacy=0x7f8e68073450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7f8e6e000640 1 -- 172.21.15.5:0/3841058763 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e68166710 con 0x7f8e680ae0c0 2024-08-18T22:19:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4100b0070 con 0x7ff3fc005220 2024-08-18T22:19:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7ff7ce800640 1 --2- 172.21.15.5:0/1454363873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7c80e7360 0x7ff7c8050e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff7c804a2b0 tx=0x7ff7c001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c03c4ec670a689 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff410003b80 con 0x7ff3fc005220 2024-08-18T22:19:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7ff416a00640 1 -- 172.21.15.5:0/1466371635 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4100b0070 con 0x7ff3fc005220 2024-08-18T22:19:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.358+0000 7f8c0cc00640 1 --2- 172.21.15.5:0/960156872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c08159a40 0x7f8c0815c4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc013050 tx=0x7f8bfc024bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfb05a45a72ebc0d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff41ec00640 1 -- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3fc005220 msgr2=0x7ff3fc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff41ec00640 1 --2- 172.21.15.5:0/1466371635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3fc005220 0x7ff3fc00b9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff418160a40 tx=0x7ff41001c720 comp rx=0 tx=0).stop 2024-08-18T22:19:46.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff41cc00640 1 -- 172.21.15.5:0/1466371635 reap_dead start 2024-08-18T22:19:46.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff7cca00640 1 -- 172.21.15.5:0/1454363873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00b0070 con 0x7ff7c80e7360 2024-08-18T22:19:46.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8c07400640 1 -- 172.21.15.5:0/960156872 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0ad990 con 0x7f8c08159a40 2024-08-18T22:19:46.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8c07400640 1 -- 172.21.15.5:0/960156872 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bfc0adb30 con 0x7f8c08159a40 2024-08-18T22:19:46.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8c07400640 1 -- 172.21.15.5:0/960156872 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0110d0 con 0x7f8c08159a40 2024-08-18T22:19:46.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff7cca00640 1 -- 172.21.15.5:0/1454363873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c00ab600 con 0x7ff7c80e7360 2024-08-18T22:19:46.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff7cca00640 1 -- 172.21.15.5:0/1454363873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00ab9d0 con 0x7ff7c80e7360 2024-08-18T22:19:46.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff41ec00640 1 -- 172.21.15.5:0/1466371635 shutdown_connections 2024-08-18T22:19:46.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff41ec00640 1 -- 172.21.15.5:0/1466371635 >> 172.21.15.5:0/1466371635 conn(0x7ff4180b5800 msgr2=0x7ff418072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff41ec00640 1 -- 172.21.15.5:0/1466371635 shutdown_connections 2024-08-18T22:19:46.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff41ec00640 1 -- 172.21.15.5:0/1466371635 wait complete. 2024-08-18T22:19:46.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8c0e000640 1 -- 172.21.15.5:0/960156872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c08159a40 msgr2=0x7f8c0815c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8c0e000640 1 --2- 172.21.15.5:0/960156872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c08159a40 0x7f8c0815c4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc013050 tx=0x7f8bfc024bd0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff7d4c00640 1 -- 172.21.15.5:0/1454363873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7c80e7360 msgr2=0x7ff7c8050e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff7d4c00640 1 --2- 172.21.15.5:0/1454363873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7c80e7360 0x7ff7c8050e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff7c804a2b0 tx=0x7ff7c001c3f0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8c0e000640 1 -- 172.21.15.5:0/960156872 shutdown_connections 2024-08-18T22:19:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8c0e000640 1 --2- 172.21.15.5:0/960156872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c08159a40 0x7f8c0815c4f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8c0e000640 1 -- 172.21.15.5:0/960156872 >> 172.21.15.5:0/960156872 conn(0x7f8c080b76c0 msgr2=0x7f8c080b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff7d4c00640 1 -- 172.21.15.5:0/1454363873 shutdown_connections 2024-08-18T22:19:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff7d4c00640 1 --2- 172.21.15.5:0/1454363873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7c80e7360 0x7ff7c8050e00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff7d4c00640 1 --2- 172.21.15.5:0/1454363873 >> v2:172.21.15.117:3300/0 conn(0x7ff7c8049780 0x7ff7c8049b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff7d4c00640 1 -- 172.21.15.5:0/1454363873 >> 172.21.15.5:0/1454363873 conn(0x7ff7c80567b0 msgr2=0x7ff7c8056bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8c0e000640 1 -- 172.21.15.5:0/960156872 shutdown_connections 2024-08-18T22:19:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8c0e000640 1 -- 172.21.15.5:0/960156872 wait complete. 2024-08-18T22:19:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7fa3e1e00640 1 --2- 172.21.15.5:0/3217986401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e40706a0 0x7fa3e40b56b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006fd0 tx=0x7fa3d401cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3e65e8562f96f68 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff7d4c00640 1 -- 172.21.15.5:0/1454363873 shutdown_connections 2024-08-18T22:19:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8e6e000640 1 --2- 172.21.15.5:0/3841058763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e680ae0c0 0x7f8e681634a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009d90 tx=0x7f8e6001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e195fff8f8b9aa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7ff7d4c00640 1 -- 172.21.15.5:0/1454363873 wait complete. 2024-08-18T22:19:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7fa3e1400640 1 -- 172.21.15.5:0/3217986401 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40ab070 con 0x7fa3e40706a0 2024-08-18T22:19:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7fa3e1400640 1 -- 172.21.15.5:0/3217986401 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d4004230 con 0x7fa3e40706a0 2024-08-18T22:19:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7fa3e1400640 1 -- 172.21.15.5:0/3217986401 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40a5840 con 0x7fa3e40706a0 2024-08-18T22:19:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.362+0000 7f8e67e00640 1 -- 172.21.15.5:0/3841058763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e600b2070 con 0x7f8e680ae0c0 2024-08-18T22:19:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7f8e67e00640 1 -- 172.21.15.5:0/3841058763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e600a5940 con 0x7f8e680ae0c0 2024-08-18T22:19:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7f8e67e00640 1 -- 172.21.15.5:0/3841058763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e600a5d10 con 0x7f8e680ae0c0 2024-08-18T22:19:46.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41ec00640 1 Processor -- start 2024-08-18T22:19:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41ec00640 1 -- start start 2024-08-18T22:19:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7f8c0e000640 1 Processor -- start 2024-08-18T22:19:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7fa3e8a00640 1 -- 172.21.15.5:0/3217986401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e40706a0 msgr2=0x7fa3e40b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7fa3e8a00640 1 --2- 172.21.15.5:0/3217986401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e40706a0 0x7fa3e40b56b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006fd0 tx=0x7fa3d401cb00 comp rx=0 tx=0).stop 2024-08-18T22:19:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff7d4c00640 1 Processor -- start 2024-08-18T22:19:46.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7fa3e8a00640 1 -- 172.21.15.5:0/3217986401 shutdown_connections 2024-08-18T22:19:46.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7fa3e8a00640 1 --2- 172.21.15.5:0/3217986401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40afe00 0x7fa3e40ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7fa3e8a00640 1 --2- 172.21.15.5:0/3217986401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e40706a0 0x7fa3e40b56b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7fa3e8a00640 1 -- 172.21.15.5:0/3217986401 >> 172.21.15.5:0/3217986401 conn(0x7fa3e4073070 msgr2=0x7fa3e406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7fa3e8a00640 1 -- 172.21.15.5:0/3217986401 shutdown_connections 2024-08-18T22:19:46.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7fa3e8a00640 1 -- 172.21.15.5:0/3217986401 wait complete. 2024-08-18T22:19:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7f8e70000640 1 -- 172.21.15.5:0/3841058763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e680ae0c0 msgr2=0x7f8e681634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7f8e70000640 1 --2- 172.21.15.5:0/3841058763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e680ae0c0 0x7f8e681634a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009d90 tx=0x7f8e6001c970 comp rx=0 tx=0).stop 2024-08-18T22:19:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7f8c0e000640 1 -- start start 2024-08-18T22:19:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41ec00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3fc005220 0x7ff418167590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41ec00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff418168cc0 0x7ff418159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41ec00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4180ad030 0x7ff4181698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41ec00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4180b1900 con 0x7ff3fc005220 2024-08-18T22:19:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41ec00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff4180b1780 con 0x7ff4180ad030 2024-08-18T22:19:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41ec00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff4180b1a80 con 0x7ff418168cc0 2024-08-18T22:19:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff417400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff418168cc0 0x7ff418159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff417400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff418168cc0 0x7ff418159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47694/0 (socket says 172.21.15.5:47694) 2024-08-18T22:19:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff417400640 1 -- 172.21.15.5:0/832692870 learned_addr learned my addr 172.21.15.5:0/832692870 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41cc00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4180ad030 0x7ff4181698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41cc00640 1 -- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff418168cc0 msgr2=0x7ff418159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41cc00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff418168cc0 0x7ff418159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41cc00640 1 -- 172.21.15.5:0/832692870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3fc005220 msgr2=0x7ff418167590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41cc00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3fc005220 0x7ff418167590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff41cc00640 1 -- 172.21.15.5:0/832692870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41815a710 con 0x7ff4180ad030 2024-08-18T22:19:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7f8e70000640 1 -- 172.21.15.5:0/3841058763 shutdown_connections 2024-08-18T22:19:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7f8e70000640 1 --2- 172.21.15.5:0/3841058763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e680ae0c0 0x7f8e681634a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7f8e70000640 1 -- 172.21.15.5:0/3841058763 >> 172.21.15.5:0/3841058763 conn(0x7f8e6806bdb0 msgr2=0x7f8e6806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8e70000640 1 -- 172.21.15.5:0/3841058763 shutdown_connections 2024-08-18T22:19:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8e70000640 1 -- 172.21.15.5:0/3841058763 wait complete. 2024-08-18T22:19:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff41cc00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4180ad030 0x7ff4181698c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00c4d0 tx=0x7ff3fc005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0e000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b4470 0x7f8c0814b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff7d4c00640 1 -- start start 2024-08-18T22:19:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff7d4c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7c8049780 0x7ff7c80e6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff7d4c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c8057360 0x7ff7c80cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff7d4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7c80e7360 0x7ff7c80d0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff7d4c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c80e1670 con 0x7ff7c80e7360 2024-08-18T22:19:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff7d4c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c8051750 con 0x7ff7c8057360 2024-08-18T22:19:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.366+0000 7ff7d4c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c80e17f0 con 0x7ff7c8049780 2024-08-18T22:19:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7cde00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7c8049780 0x7ff7c80e6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7cde00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7c8049780 0x7ff7c80e6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47698/0 (socket says 172.21.15.5:47698) 2024-08-18T22:19:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7cde00640 1 -- 172.21.15.5:0/3183860454 learned_addr learned my addr 172.21.15.5:0/3183860454 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7ce800640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7c80e7360 0x7ff7c80d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff40fe00640 1 -- 172.21.15.5:0/832692870 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4100b0040 con 0x7ff4180ad030 2024-08-18T22:19:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff40fe00640 1 -- 172.21.15.5:0/832692870 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff410005730 con 0x7ff4180ad030 2024-08-18T22:19:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff40fe00640 1 -- 172.21.15.5:0/832692870 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410001a90 con 0x7ff4180ad030 2024-08-18T22:19:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c08159a40 0x7f8c0814d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0cc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b4470 0x7f8c0814b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0cc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b4470 0x7f8c0814b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40272/0 (socket says 172.21.15.5:40272) 2024-08-18T22:19:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0cc00640 1 -- 172.21.15.5:0/625466309 learned_addr learned my addr 172.21.15.5:0/625466309 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0e000640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815ca30 0x7f8c0814d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7cde00640 1 -- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c8057360 msgr2=0x7ff7c80cfcc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-18T22:19:46.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7cde00640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c8057360 0x7ff7c80cfcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7cde00640 1 -- 172.21.15.5:0/3183860454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7c80e7360 msgr2=0x7ff7c80d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7cde00640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7c80e7360 0x7ff7c80d0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7cde00640 1 -- 172.21.15.5:0/3183860454 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c80e5ad0 con 0x7ff7c8049780 2024-08-18T22:19:46.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8c08071a00 con 0x7f8c08159a40 2024-08-18T22:19:46.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7cde00640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7c8049780 0x7ff7c80e6550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e810 tx=0x7ff7bc00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff41ec00640 1 -- 172.21.15.5:0/832692870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff418167c20 con 0x7ff4180ad030 2024-08-18T22:19:46.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c07e00640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c08159a40 0x7f8c0814d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0d600640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815ca30 0x7f8c0814d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8c08071880 con 0x7f8c080b4470 2024-08-18T22:19:46.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8c08167e80 con 0x7f8c0815ca30 2024-08-18T22:19:46.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0d600640 1 -- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b4470 msgr2=0x7f8c0814b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0d600640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b4470 0x7f8c0814b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0d600640 1 -- 172.21.15.5:0/625466309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c08159a40 msgr2=0x7f8c0814d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0d600640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c08159a40 0x7f8c0814d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0d600640 1 -- 172.21.15.5:0/625466309 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0814bd60 con 0x7f8c0815ca30 2024-08-18T22:19:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7c6000640 1 -- 172.21.15.5:0/3183860454 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00f040 con 0x7ff7c8049780 2024-08-18T22:19:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7c6000640 1 -- 172.21.15.5:0/3183860454 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7bc0096a0 con 0x7ff7c8049780 2024-08-18T22:19:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff7c6000640 1 -- 172.21.15.5:0/3183860454 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc009a70 con 0x7ff7c8049780 2024-08-18T22:19:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8e70000640 1 Processor -- start 2024-08-18T22:19:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7fa3e8a00640 1 Processor -- start 2024-08-18T22:19:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7fa3e8a00640 1 -- start start 2024-08-18T22:19:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8e70000640 1 -- start start 2024-08-18T22:19:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c0d600640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815ca30 0x7f8c0814d890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000c650 tx=0x7f8c0000cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7f8c04c00640 1 -- 172.21.15.5:0/625466309 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00003b80 con 0x7f8c0815ca30 2024-08-18T22:19:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e70000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e680aeb70 0x7f8e6816ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e70000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e68166010 0x7f8e68168de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.370+0000 7ff41ec00640 1 -- 172.21.15.5:0/832692870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4181681e0 con 0x7ff4180ad030 2024-08-18T22:19:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0814c040 con 0x7f8c0815ca30 2024-08-18T22:19:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0814c600 con 0x7f8c0815ca30 2024-08-18T22:19:46.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7ff7d4c00640 1 -- 172.21.15.5:0/3183860454 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c80e45c0 con 0x7ff7c8049780 2024-08-18T22:19:46.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7ff7d4c00640 1 -- 172.21.15.5:0/3183860454 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c80e5d50 con 0x7ff7c8049780 2024-08-18T22:19:46.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8c04c00640 1 -- 172.21.15.5:0/625466309 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c00003d40 con 0x7f8c0815ca30 2024-08-18T22:19:46.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8c04c00640 1 -- 172.21.15.5:0/625466309 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00005310 con 0x7f8c0815ca30 2024-08-18T22:19:46.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c0815c4f0 con 0x7f8c0815ca30 2024-08-18T22:19:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e6d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e680aeb70 0x7f8e6816ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e6d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e680aeb70 0x7f8e6816ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47708/0 (socket says 172.21.15.5:47708) 2024-08-18T22:19:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e6d600640 1 -- 172.21.15.5:0/256424392 learned_addr learned my addr 172.21.15.5:0/256424392 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e70000640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e6809cea0 0x7f8e6809d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e6cc00640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e68166010 0x7f8e68168de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8e681702f0 con 0x7f8e68166010 2024-08-18T22:19:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68170170 con 0x7f8e6809cea0 2024-08-18T22:19:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8e68170470 con 0x7f8e680aeb70 2024-08-18T22:19:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e6e000640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e6809cea0 0x7f8e6809d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e6e000640 1 -- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e680aeb70 msgr2=0x7f8e6816ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e6e000640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e680aeb70 0x7f8e6816ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e6e000640 1 -- 172.21.15.5:0/256424392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e68166010 msgr2=0x7f8e68168de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e6e000640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e68166010 0x7f8e68168de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7f8e6e000640 1 -- 172.21.15.5:0/256424392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e68169630 con 0x7f8e6809cea0 2024-08-18T22:19:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7ff40fe00640 1 -- 172.21.15.5:0/832692870 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff4100ab640 con 0x7ff4180ad030 2024-08-18T22:19:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7ff41ec00640 1 -- 172.21.15.5:0/832692870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4180b1070 con 0x7ff4180ad030 2024-08-18T22:19:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7ff40fe00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3f80679c0 0x7ff3f8069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7fa3e8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40706a0 0x7fa3e4149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7fa3e8a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e40afe00 0x7fa3e41481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7fa3e2800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40706a0 0x7fa3e4149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7fa3e2800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40706a0 0x7fa3e4149e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47710/0 (socket says 172.21.15.5:47710) 2024-08-18T22:19:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7fa3e8a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e415a690 0x7fa3e40aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7fa3e2800640 1 -- 172.21.15.5:0/1909474053 learned_addr learned my addr 172.21.15.5:0/1909474053 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e40cee70 con 0x7fa3e40afe00 2024-08-18T22:19:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e40cecf0 con 0x7fa3e415a690 2024-08-18T22:19:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e40ceff0 con 0x7fa3e40706a0 2024-08-18T22:19:46.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.374+0000 7ff7d4c00640 1 -- 172.21.15.5:0/3183860454 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c80e6080 con 0x7ff7c8049780 2024-08-18T22:19:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7fa3e1e00640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e40afe00 0x7fa3e41481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7ff40fe00640 1 -- 172.21.15.5:0/832692870 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff4100bf070 con 0x7ff4180ad030 2024-08-18T22:19:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7f8c04c00640 1 -- 172.21.15.5:0/625466309 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c000054b0 con 0x7f8c0815ca30 2024-08-18T22:19:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7ff417e00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3f80679c0 0x7ff3f8069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7f8e6e000640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e6809cea0 0x7f8e6809d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e600ac000 tx=0x7f8e60019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7fa3e2800640 1 -- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e415a690 msgr2=0x7fa3e40aedc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-18T22:19:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7fa3e2800640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e415a690 0x7fa3e40aedc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7fa3e2800640 1 -- 172.21.15.5:0/1909474053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e40afe00 msgr2=0x7fa3e41481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7ff7c6000640 1 -- 172.21.15.5:0/3183860454 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7bc009c10 con 0x7ff7c8049780 2024-08-18T22:19:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7ff417e00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3f80679c0 0x7ff3f8069e80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff408000fc0 tx=0x7ff408000f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7fa3e2800640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e40afe00 0x7fa3e41481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7fa3e2800640 1 -- 172.21.15.5:0/1909474053 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e41504a0 con 0x7fa3e40706a0 2024-08-18T22:19:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7f8c04c00640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8be80678c0 0x7f8be8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7f8c04c00640 1 -- 172.21.15.5:0/625466309 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8c00085d20 con 0x7f8c0815ca30 2024-08-18T22:19:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7fa3e2800640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40706a0 0x7fa3e4149e50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00ba50 tx=0x7fa3dc00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7f8c0cc00640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8be80678c0 0x7f8be8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7ff7c6000640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7b0067990 0x7ff7b0069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7ff7c6000640 1 -- 172.21.15.5:0/3183860454 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff7bc086130 con 0x7ff7c8049780 2024-08-18T22:19:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7ff7cd400640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7b0067990 0x7ff7b0069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.378+0000 7f8c0cc00640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8be80678c0 0x7f8be8069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc022800 tx=0x7f8bfc0af070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.382+0000 7ff7cd400640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7b0067990 0x7ff7b0069e50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80d47c0 tx=0x7ff7d00697f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.382+0000 7f8e65600640 1 -- 172.21.15.5:0/256424392 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e600b2040 con 0x7f8e6809cea0 2024-08-18T22:19:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.382+0000 7f8e65600640 1 -- 172.21.15.5:0/256424392 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e600ae4d0 con 0x7f8e6809cea0 2024-08-18T22:19:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.382+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6809aa40 con 0x7f8e6809cea0 2024-08-18T22:19:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.382+0000 7f8e65600640 1 -- 172.21.15.5:0/256424392 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e600ae8a0 con 0x7f8e6809cea0 2024-08-18T22:19:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.382+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e6809b000 con 0x7f8e6809cea0 2024-08-18T22:19:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.382+0000 7f8c04c00640 1 -- 172.21.15.5:0/625466309 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8c00055ec0 con 0x7f8c0815ca30 2024-08-18T22:19:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.382+0000 7ff40fe00640 1 -- 172.21.15.5:0/832692870 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff410016430 con 0x7ff4180ad030 2024-08-18T22:19:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.386+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e681634a0 con 0x7f8e6809cea0 2024-08-18T22:19:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.386+0000 7f8e65600640 1 -- 172.21.15.5:0/256424392 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e600c1030 con 0x7f8e6809cea0 2024-08-18T22:19:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.386+0000 7f8e65600640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8e48067940 0x7f8e48069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.386+0000 7f8e65600640 1 -- 172.21.15.5:0/256424392 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8e60120500 con 0x7f8e6809cea0 2024-08-18T22:19:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.386+0000 7f8e6d600640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8e48067940 0x7f8e48069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.386+0000 7ff7c6000640 1 -- 172.21.15.5:0/3183860454 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff7c80e5ad0 con 0x7ff7c8049780 2024-08-18T22:19:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.390+0000 7f8e6d600640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8e48067940 0x7f8e48069e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c005890 tx=0x7f8e5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.386+0000 7fa3daa00640 1 -- 172.21.15.5:0/1909474053 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc019070 con 0x7fa3e40706a0 2024-08-18T22:19:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.386+0000 7fa3daa00640 1 -- 172.21.15.5:0/1909474053 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc00cc10 con 0x7fa3e40706a0 2024-08-18T22:19:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.386+0000 7fa3daa00640 1 -- 172.21.15.5:0/1909474053 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc014440 con 0x7fa3e40706a0 2024-08-18T22:19:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.386+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e414f400 con 0x7fa3e40706a0 2024-08-18T22:19:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.386+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e414f9c0 con 0x7fa3e40706a0 2024-08-18T22:19:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.390+0000 7fa3daa00640 1 -- 172.21.15.5:0/1909474053 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3dc01c070 con 0x7fa3e40706a0 2024-08-18T22:19:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.390+0000 7f8e65600640 1 -- 172.21.15.5:0/256424392 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8e600c8060 con 0x7f8e6809cea0 2024-08-18T22:19:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.394+0000 7fa3daa00640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c4067990 0x7fa3c4069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.394+0000 7fa3daa00640 1 -- 172.21.15.5:0/1909474053 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa3dc085d80 con 0x7fa3e40706a0 2024-08-18T22:19:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.394+0000 7fa3e1e00640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c4067990 0x7fa3c4069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.394+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e40b56b0 con 0x7fa3e40706a0 2024-08-18T22:19:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.394+0000 7fa3e1e00640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c4067990 0x7fa3c4069e50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40af000 tx=0x7fa3d40a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.402+0000 7fa3daa00640 1 -- 172.21.15.5:0/1909474053 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa3dc055f10 con 0x7fa3e40706a0 2024-08-18T22:19:46.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.418+0000 7fc34d600640 1 Processor -- start 2024-08-18T22:19:46.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.418+0000 7fc34d600640 1 -- start start 2024-08-18T22:19:46.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.418+0000 7fc34d600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc348163ac0 0x7fc348162dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.418+0000 7fb60fe00640 1 Processor -- start 2024-08-18T22:19:46.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc34d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b2da0 0x7fc34806cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.418+0000 7fb60fe00640 1 -- start start 2024-08-18T22:19:46.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.418+0000 7fb60fe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb610159f50 0x7fb610071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.418+0000 7fb60fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb61006e1b0 0x7fb61006e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.418+0000 7fb60fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb610073390 0x7fb610073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.418+0000 7fb60fe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb61006eb40 con 0x7fb61006e1b0 2024-08-18T22:19:46.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.418+0000 7fb60fe00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb610073d60 con 0x7fb610159f50 2024-08-18T22:19:46.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.418+0000 7fb60fe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb61015de20 con 0x7fb610073390 2024-08-18T22:19:46.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc347e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc348163ac0 0x7fc348162dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc347e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc348163ac0 0x7fc348162dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40660/0 (socket says 172.21.15.5:40660) 2024-08-18T22:19:46.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fb60f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb610073390 0x7fb610073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fb60f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb610073390 0x7fb610073820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47716/0 (socket says 172.21.15.5:47716) 2024-08-18T22:19:46.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fb60f400640 1 -- 172.21.15.5:0/2203331616 learned_addr learned my addr 172.21.15.5:0/2203331616 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc347400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b2da0 0x7fc34806cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc34cc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3480b6f90 0x7fc3480d20a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38716/0 (socket says 172.21.15.5:38716) 2024-08-18T22:19:46.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fb60ea00640 1 --2- 172.21.15.5:0/2203331616 >> v2:172.21.15.117:3300/0 conn(0x7fb610159f50 0x7fb610071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fb60e000640 1 --2- 172.21.15.5:0/2203331616 >> v2:172.21.15.5:3300/0 conn(0x7fb61006e1b0 0x7fb61006e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc347400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b2da0 0x7fc34806cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47720/0 (socket says 172.21.15.5:47720) 2024-08-18T22:19:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc34d600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3480d09f0 con 0x7fc3480b6f90 2024-08-18T22:19:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc34d600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc3480d3880 con 0x7fc348163ac0 2024-08-18T22:19:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc34d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc3480d0710 con 0x7fc3480b2da0 2024-08-18T22:19:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc347e00640 1 -- 172.21.15.5:0/389440371 learned_addr learned my addr 172.21.15.5:0/389440371 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc347e00640 1 -- 172.21.15.5:0/389440371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b2da0 msgr2=0x7fc34806cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc347e00640 1 --2- 172.21.15.5:0/389440371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b2da0 0x7fc34806cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc347e00640 1 -- 172.21.15.5:0/389440371 >> v1:172.21.15.5:6789/0 conn(0x7fc3480b6f90 legacy=0x7fc3480d20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fc347e00640 1 -- 172.21.15.5:0/389440371 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3480d3b20 con 0x7fc348163ac0 2024-08-18T22:19:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fb60f400640 1 -- 172.21.15.5:0/2203331616 >> v2:172.21.15.117:3300/0 conn(0x7fb610159f50 msgr2=0x7fb610071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fb60f400640 1 --2- 172.21.15.5:0/2203331616 >> v2:172.21.15.117:3300/0 conn(0x7fb610159f50 0x7fb610071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fb60f400640 1 -- 172.21.15.5:0/2203331616 >> v2:172.21.15.5:3300/0 conn(0x7fb61006e1b0 msgr2=0x7fb61006e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:46.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fb60f400640 1 --2- 172.21.15.5:0/2203331616 >> v2:172.21.15.5:3300/0 conn(0x7fb61006e1b0 0x7fb61006e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.422+0000 7fb60f400640 1 -- 172.21.15.5:0/2203331616 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61015e100 con 0x7fb610073390 2024-08-18T22:19:46.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.426+0000 7fb60e000640 1 --2- 172.21.15.5:0/2203331616 >> v2:172.21.15.5:3300/0 conn(0x7fb61006e1b0 0x7fb61006e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.426+0000 7fc347e00640 1 --2- 172.21.15.5:0/389440371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc348163ac0 0x7fc348162dd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc340009e50 tx=0x7fc34001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d959c25dc3364f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.426+0000 7fb60f400640 1 --2- 172.21.15.5:0/2203331616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb610073390 0x7fb610073820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb6100b2c80 tx=0x7fb5fc01ea50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bc37feab0f8a979 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.426+0000 7fb60d600640 1 -- 172.21.15.5:0/2203331616 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0ad070 con 0x7fb610073390 2024-08-18T22:19:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fb60d600640 1 -- 172.21.15.5:0/2203331616 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5fc0a78e0 con 0x7fb610073390 2024-08-18T22:19:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fb60d600640 1 -- 172.21.15.5:0/2203331616 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0ad070 con 0x7fb610073390 2024-08-18T22:19:46.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fc346a00640 1 -- 172.21.15.5:0/389440371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3400a56f0 con 0x7fc348163ac0 2024-08-18T22:19:46.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fc346a00640 1 -- 172.21.15.5:0/389440371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3400a5890 con 0x7fc348163ac0 2024-08-18T22:19:46.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fb60fe00640 1 -- 172.21.15.5:0/2203331616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb610073390 msgr2=0x7fb610073820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fb60fe00640 1 --2- 172.21.15.5:0/2203331616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb610073390 0x7fb610073820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb6100b2c80 tx=0x7fb5fc01ea50 comp rx=0 tx=0).stop 2024-08-18T22:19:46.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fc34d600640 1 -- 172.21.15.5:0/389440371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc348163ac0 msgr2=0x7fc348162dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fc346a00640 1 -- 172.21.15.5:0/389440371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3400a56f0 con 0x7fc348163ac0 2024-08-18T22:19:46.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fb60fe00640 1 -- 172.21.15.5:0/2203331616 shutdown_connections 2024-08-18T22:19:46.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fb60fe00640 1 --2- 172.21.15.5:0/2203331616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb610073390 0x7fb610073820 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fb60fe00640 1 --2- 172.21.15.5:0/2203331616 >> v2:172.21.15.5:3300/0 conn(0x7fb61006e1b0 0x7fb61006e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fb60fe00640 1 --2- 172.21.15.5:0/2203331616 >> v2:172.21.15.117:3300/0 conn(0x7fb610159f50 0x7fb610071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fb60fe00640 1 -- 172.21.15.5:0/2203331616 >> 172.21.15.5:0/2203331616 conn(0x7fb61006bb80 msgr2=0x7fb61006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fc34d600640 1 --2- 172.21.15.5:0/389440371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc348163ac0 0x7fc348162dd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc340009e50 tx=0x7fc34001c960 comp rx=0 tx=0).stop 2024-08-18T22:19:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fc34d600640 1 -- 172.21.15.5:0/389440371 shutdown_connections 2024-08-18T22:19:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fc34d600640 1 --2- 172.21.15.5:0/389440371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b2da0 0x7fc34806cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fc34d600640 1 --2- 172.21.15.5:0/389440371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc348163ac0 0x7fc348162dd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fc34d600640 1 -- 172.21.15.5:0/389440371 >> 172.21.15.5:0/389440371 conn(0x7fc3480d4760 msgr2=0x7fc3480d4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fb60fe00640 1 -- 172.21.15.5:0/2203331616 shutdown_connections 2024-08-18T22:19:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fb60fe00640 1 -- 172.21.15.5:0/2203331616 wait complete. 2024-08-18T22:19:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fc34d600640 1 -- 172.21.15.5:0/389440371 shutdown_connections 2024-08-18T22:19:46.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.430+0000 7fc34d600640 1 -- 172.21.15.5:0/389440371 wait complete. 2024-08-18T22:19:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.434+0000 7fb60fe00640 1 Processor -- start 2024-08-18T22:19:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.434+0000 7fb60fe00640 1 -- start start 2024-08-18T22:19:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.434+0000 7fc34d600640 1 Processor -- start 2024-08-18T22:19:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.434+0000 7fc34d600640 1 -- start start 2024-08-18T22:19:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fb60fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61006e1b0 0x7fb6101563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fb60fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb610073390 0x7fb61015c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc34d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3480b2da0 0x7fc3480ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc34d600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3480b6f90 0x7fc3480cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fb60ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61006e1b0 0x7fb6101563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fb60ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61006e1b0 0x7fb6101563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47722/0 (socket says 172.21.15.5:47722) 2024-08-18T22:19:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc347e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3480b2da0 0x7fc3480ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc347e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3480b2da0 0x7fc3480ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40688/0 (socket says 172.21.15.5:40688) 2024-08-18T22:19:46.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fb60ea00640 1 -- 172.21.15.5:0/2263726964 learned_addr learned my addr 172.21.15.5:0/2263726964 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fb60fe00640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb610159f50 0x7fb61015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fb60e000640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb610073390 0x7fb61015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc347e00640 1 -- 172.21.15.5:0/2635352562 learned_addr learned my addr 172.21.15.5:0/2635352562 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:46.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc34d600640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34815fb40 0x7fc348158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fb60fe00640 1 -- 172.21.15.5:0/2263726964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb6100b3880 con 0x7fb610073390 2024-08-18T22:19:46.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc34d600640 1 -- 172.21.15.5:0/2635352562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc34816fbc0 con 0x7fc3480b2da0 2024-08-18T22:19:46.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc347400640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3480b6f90 0x7fc3480cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fb60f400640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb610159f50 0x7fb61015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc34d600640 1 -- 172.21.15.5:0/2635352562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc348163ea0 con 0x7fc3480b6f90 2024-08-18T22:19:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc34d600640 1 -- 172.21.15.5:0/2635352562 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc34816fd40 con 0x7fc34815fb40 2024-08-18T22:19:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc34cc00640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34815fb40 0x7fc348158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fb60fe00640 1 -- 172.21.15.5:0/2263726964 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb61015a540 con 0x7fb610159f50 2024-08-18T22:19:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fb60fe00640 1 -- 172.21.15.5:0/2263726964 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb6100b3a00 con 0x7fb61006e1b0 2024-08-18T22:19:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc347400640 1 -- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34815fb40 msgr2=0x7fc348158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc347400640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34815fb40 0x7fc348158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc347400640 1 -- 172.21.15.5:0/2635352562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3480b2da0 msgr2=0x7fc3480ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc347400640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3480b2da0 0x7fc3480ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.438+0000 7fc347400640 1 -- 172.21.15.5:0/2635352562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34815f500 con 0x7fc3480b6f90 2024-08-18T22:19:46.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fc347400640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3480b6f90 0x7fc3480cd2c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc33400d5a0 tx=0x7fc33400da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb60f400640 1 -- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61006e1b0 msgr2=0x7fb6101563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb60f400640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61006e1b0 0x7fb6101563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb60f400640 1 -- 172.21.15.5:0/2263726964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb610073390 msgr2=0x7fb61015c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb60f400640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb610073390 0x7fb61015c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb60f400640 1 -- 172.21.15.5:0/2263726964 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb610156930 con 0x7fb610159f50 2024-08-18T22:19:46.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb60f400640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb610159f50 0x7fb61015c660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc0af000 tx=0x7fb5fc01d290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb606a00640 1 -- 172.21.15.5:0/2263726964 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0bf070 con 0x7fb610159f50 2024-08-18T22:19:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fc33fe00640 1 -- 172.21.15.5:0/2635352562 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334019070 con 0x7fc3480b6f90 2024-08-18T22:19:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fc34d600640 1 -- 172.21.15.5:0/2635352562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34815dd10 con 0x7fc3480b6f90 2024-08-18T22:19:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fc34d600640 1 -- 172.21.15.5:0/2635352562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc34815e2d0 con 0x7fc3480b6f90 2024-08-18T22:19:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fc33fe00640 1 -- 172.21.15.5:0/2635352562 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc334004240 con 0x7fc3480b6f90 2024-08-18T22:19:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fc33fe00640 1 -- 172.21.15.5:0/2635352562 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334019070 con 0x7fc3480b6f90 2024-08-18T22:19:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb60fe00640 1 -- 172.21.15.5:0/2263726964 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6100af3e0 con 0x7fb610159f50 2024-08-18T22:19:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb60fe00640 1 -- 172.21.15.5:0/2263726964 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6100af9a0 con 0x7fb610159f50 2024-08-18T22:19:46.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb5fbe00640 1 -- 172.21.15.5:0/2263726964 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb610074820 con 0x7fb610159f50 2024-08-18T22:19:46.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb606a00640 1 -- 172.21.15.5:0/2263726964 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5fc0a78e0 con 0x7fb610159f50 2024-08-18T22:19:46.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.442+0000 7fb606a00640 1 -- 172.21.15.5:0/2263726964 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0bf070 con 0x7fb610159f50 2024-08-18T22:19:46.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.446+0000 7fc33d600640 1 -- 172.21.15.5:0/2635352562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3200052a0 con 0x7fc3480b6f90 2024-08-18T22:19:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.446+0000 7fb606a00640 1 -- 172.21.15.5:0/2263726964 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5fc008bf0 con 0x7fb610159f50 2024-08-18T22:19:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.446+0000 7fb606a00640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5f0067ac0 0x7fb5f0069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.446+0000 7fb606a00640 1 -- 172.21.15.5:0/2263726964 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb5fc123da0 con 0x7fb610159f50 2024-08-18T22:19:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.446+0000 7fc33fe00640 1 -- 172.21.15.5:0/2635352562 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc33401c070 con 0x7fc3480b6f90 2024-08-18T22:19:46.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.450+0000 7fb606a00640 1 -- 172.21.15.5:0/2263726964 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb610156930 con 0x7fb610159f50 2024-08-18T22:19:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.450+0000 7fc33fe00640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc328067ac0 0x7fc328069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.450+0000 7fc33fe00640 1 -- 172.21.15.5:0/2635352562 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc334085470 con 0x7fc3480b6f90 2024-08-18T22:19:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.450+0000 7fb60ea00640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5f0067ac0 0x7fb5f0069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.450+0000 7fc347e00640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc328067ac0 0x7fc328069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:46.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.450+0000 7fc347e00640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc328067ac0 0x7fc328069f80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc34001c9a0 tx=0x7fc3400a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.450+0000 7fb60ea00640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5f0067ac0 0x7fb5f0069f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb6080094c0 tx=0x7fb60800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:46.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.454+0000 7fc33fe00640 1 -- 172.21.15.5:0/2635352562 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc334055590 con 0x7fc3480b6f90 2024-08-18T22:19:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.694+0000 7f8846a00640 1 -- 172.21.15.5:0/2605870040 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8828005860 con 0x7f8854212720 2024-08-18T22:19:46.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.694+0000 7f8851600640 1 -- 172.21.15.5:0/2605870040 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8840055a40 con 0x7f8854212720 2024-08-18T22:19:46.704 INFO:teuthology.orchestra.run.smithi005.stdout:64424509450 2024-08-18T22:19:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.698+0000 7f8846a00640 1 -- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88340678c0 msgr2=0x7f8834069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.698+0000 7f8846a00640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88340678c0 0x7f8834069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f884c0b0000 tx=0x7f884c0ab000 comp rx=0 tx=0).stop 2024-08-18T22:19:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.698+0000 7f8846a00640 1 -- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8854212720 msgr2=0x7f8854215090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.698+0000 7f8846a00640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8854212720 0x7f8854215090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8854069630 tx=0x7f884000c890 comp rx=0 tx=0).stop 2024-08-18T22:19:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.698+0000 7f8846a00640 1 -- 172.21.15.5:0/2605870040 shutdown_connections 2024-08-18T22:19:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.698+0000 7f8846a00640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88340678c0 0x7f8834069d80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.698+0000 7f8846a00640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8854212720 0x7f8854215090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.698+0000 7f8846a00640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88542146b0 0x7f8854214b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.698+0000 7f8846a00640 1 --2- 172.21.15.5:0/2605870040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c003a10 0x7f885409cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.698+0000 7f8846a00640 1 -- 172.21.15.5:0/2605870040 >> 172.21.15.5:0/2605870040 conn(0x7f885406bb80 msgr2=0x7f8854157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.702+0000 7f8846a00640 1 -- 172.21.15.5:0/2605870040 shutdown_connections 2024-08-18T22:19:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.702+0000 7f8846a00640 1 -- 172.21.15.5:0/2605870040 wait complete. 2024-08-18T22:19:46.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.726+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8c0809bb60 con 0x7f8c0815ca30 2024-08-18T22:19:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.726+0000 7f8c04c00640 1 -- 172.21.15.5:0/625466309 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8c0005a1c0 con 0x7f8c0815ca30 2024-08-18T22:19:46.732 INFO:teuthology.orchestra.run.smithi005.stdout:64424509450 2024-08-18T22:19:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8be80678c0 msgr2=0x7f8be8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8be80678c0 0x7f8be8069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc022800 tx=0x7f8bfc0af070 comp rx=0 tx=0).stop 2024-08-18T22:19:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815ca30 msgr2=0x7f8c0814d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815ca30 0x7f8c0814d890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000c650 tx=0x7f8c0000cb10 comp rx=0 tx=0).stop 2024-08-18T22:19:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 shutdown_connections 2024-08-18T22:19:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8be80678c0 0x7f8be8069d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c0815ca30 0x7f8c0814d890 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c08159a40 0x7f8c0814d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 --2- 172.21.15.5:0/625466309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c080b4470 0x7f8c0814b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 >> 172.21.15.5:0/625466309 conn(0x7f8c080b76c0 msgr2=0x7f8c080b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 shutdown_connections 2024-08-18T22:19:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.730+0000 7f8c0e000640 1 -- 172.21.15.5:0/625466309 wait complete. 2024-08-18T22:19:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.734+0000 7ff41ec00640 1 -- 172.21.15.5:0/832692870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff418099e70 con 0x7ff4180ad030 2024-08-18T22:19:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.734+0000 7ff40fe00640 1 -- 172.21.15.5:0/832692870 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4100efbf0 con 0x7ff4180ad030 2024-08-18T22:19:46.739 INFO:teuthology.orchestra.run.smithi005.stdout:64424509451 2024-08-18T22:19:46.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2024-08-18T22:19:46.741 DEBUG:teuthology.parallel:result is None 2024-08-18T22:19:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 -- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3f80679c0 msgr2=0x7ff3f8069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3f80679c0 0x7ff3f8069e80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff408000fc0 tx=0x7ff408000f50 comp rx=0 tx=0).stop 2024-08-18T22:19:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 -- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4180ad030 msgr2=0x7ff4181698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4180ad030 0x7ff4181698c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00c4d0 tx=0x7ff3fc005840 comp rx=0 tx=0).stop 2024-08-18T22:19:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 -- 172.21.15.5:0/832692870 shutdown_connections 2024-08-18T22:19:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3f80679c0 0x7ff3f8069e80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4180ad030 0x7ff4181698c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff418168cc0 0x7ff418159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 --2- 172.21.15.5:0/832692870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3fc005220 0x7ff418167590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 -- 172.21.15.5:0/832692870 >> 172.21.15.5:0/832692870 conn(0x7ff4180b5800 msgr2=0x7ff41816d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 -- 172.21.15.5:0/832692870 shutdown_connections 2024-08-18T22:19:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.738+0000 7ff41ec00640 1 -- 172.21.15.5:0/832692870 wait complete. 2024-08-18T22:19:46.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.742+0000 7ff7d4c00640 1 -- 172.21.15.5:0/3183860454 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff7c80f1ac0 con 0x7ff7c8049780 2024-08-18T22:19:46.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.750+0000 7ff7c6000640 1 -- 172.21.15.5:0/3183860454 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff7bc0569a0 con 0x7ff7c8049780 2024-08-18T22:19:46.754 INFO:teuthology.orchestra.run.smithi005.stdout:64424509452 2024-08-18T22:19:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.750+0000 7ff7d4c00640 1 -- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7b0067990 msgr2=0x7ff7b0069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.750+0000 7ff7d4c00640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7b0067990 0x7ff7b0069e50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80d47c0 tx=0x7ff7d00697f0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.750+0000 7ff7d4c00640 1 -- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7c8049780 msgr2=0x7ff7c80e6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.750+0000 7ff7d4c00640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7c8049780 0x7ff7c80e6550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e810 tx=0x7ff7bc00ecd0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.754+0000 7ff7d4c00640 1 -- 172.21.15.5:0/3183860454 shutdown_connections 2024-08-18T22:19:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.754+0000 7ff7d4c00640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7b0067990 0x7ff7b0069e50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.754+0000 7ff7d4c00640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7c80e7360 0x7ff7c80d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.754+0000 7ff7d4c00640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c8057360 0x7ff7c80cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.754+0000 7ff7d4c00640 1 --2- 172.21.15.5:0/3183860454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7c8049780 0x7ff7c80e6550 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.754+0000 7ff7d4c00640 1 -- 172.21.15.5:0/3183860454 >> 172.21.15.5:0/3183860454 conn(0x7ff7c80567b0 msgr2=0x7ff7c80355c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.754+0000 7ff7d4c00640 1 -- 172.21.15.5:0/3183860454 shutdown_connections 2024-08-18T22:19:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.754+0000 7ff7d4c00640 1 -- 172.21.15.5:0/3183860454 wait complete. 2024-08-18T22:19:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.758+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8e68169320 con 0x7f8e6809cea0 2024-08-18T22:19:46.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.762+0000 7f8e65600640 1 -- 172.21.15.5:0/256424392 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e60016560 con 0x7f8e6809cea0 2024-08-18T22:19:46.767 INFO:teuthology.orchestra.run.smithi005.stdout:64424509451 2024-08-18T22:19:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8e48067940 msgr2=0x7f8e48069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8e48067940 0x7f8e48069e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c005890 tx=0x7f8e5c009040 comp rx=0 tx=0).stop 2024-08-18T22:19:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e6809cea0 msgr2=0x7f8e6809d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e6809cea0 0x7f8e6809d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e600ac000 tx=0x7f8e60019710 comp rx=0 tx=0).stop 2024-08-18T22:19:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 shutdown_connections 2024-08-18T22:19:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8e48067940 0x7f8e48069e00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e6809cea0 0x7f8e6809d350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e68166010 0x7f8e68168de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 --2- 172.21.15.5:0/256424392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e680aeb70 0x7f8e6816ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 >> 172.21.15.5:0/256424392 conn(0x7f8e6806bdb0 msgr2=0x7f8e6806e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 shutdown_connections 2024-08-18T22:19:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.766+0000 7f8e70000640 1 -- 172.21.15.5:0/256424392 wait complete. 2024-08-18T22:19:46.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-08-18T22:19:46.773 DEBUG:teuthology.parallel:result is None 2024-08-18T22:19:46.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.0 2024-08-18T22:19:46.783 DEBUG:teuthology.parallel:result is None 2024-08-18T22:19:46.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.6 2024-08-18T22:19:46.785 DEBUG:teuthology.parallel:result is None 2024-08-18T22:19:46.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.790+0000 7fb5fbe00640 1 -- 172.21.15.5:0/2263726964 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb6100cc8e0 con 0x7fb610159f50 2024-08-18T22:19:46.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.790+0000 7fb606a00640 1 -- 172.21.15.5:0/2263726964 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5fc018640 con 0x7fb610159f50 2024-08-18T22:19:46.795 INFO:teuthology.orchestra.run.smithi005.stdout:55834574858 2024-08-18T22:19:46.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.790+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa3e41486f0 con 0x7fa3e40706a0 2024-08-18T22:19:46.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3daa00640 1 -- 172.21.15.5:0/1909474053 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa3dc05a210 con 0x7fa3e40706a0 2024-08-18T22:19:46.798 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2024-08-18T22:19:46.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 -- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5f0067ac0 msgr2=0x7fb5f0069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5f0067ac0 0x7fb5f0069f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb6080094c0 tx=0x7fb60800b040 comp rx=0 tx=0).stop 2024-08-18T22:19:46.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 -- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb610159f50 msgr2=0x7fb61015c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb610159f50 0x7fb61015c660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc0af000 tx=0x7fb5fc01d290 comp rx=0 tx=0).stop 2024-08-18T22:19:46.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 -- 172.21.15.5:0/2263726964 shutdown_connections 2024-08-18T22:19:46.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5f0067ac0 0x7fb5f0069f80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb610159f50 0x7fb61015c660 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb610073390 0x7fb61015c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 --2- 172.21.15.5:0/2263726964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb61006e1b0 0x7fb6101563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 -- 172.21.15.5:0/2263726964 >> 172.21.15.5:0/2263726964 conn(0x7fb61006bb80 msgr2=0x7fb6100cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 -- 172.21.15.5:0/2263726964 shutdown_connections 2024-08-18T22:19:46.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fb5fbe00640 1 -- 172.21.15.5:0/2263726964 wait complete. 2024-08-18T22:19:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c4067990 msgr2=0x7fa3c4069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c4067990 0x7fa3c4069e50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40af000 tx=0x7fa3d40a7070 comp rx=0 tx=0).stop 2024-08-18T22:19:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40706a0 msgr2=0x7fa3e4149e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40706a0 0x7fa3e4149e50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00ba50 tx=0x7fa3dc00bf10 comp rx=0 tx=0).stop 2024-08-18T22:19:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 shutdown_connections 2024-08-18T22:19:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c4067990 0x7fa3c4069e50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e415a690 0x7fa3e40aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e40afe00 0x7fa3e41481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 --2- 172.21.15.5:0/1909474053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e40706a0 0x7fa3e4149e50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 >> 172.21.15.5:0/1909474053 conn(0x7fa3e4073070 msgr2=0x7fa3e4157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 shutdown_connections 2024-08-18T22:19:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.794+0000 7fa3e8a00640 1 -- 172.21.15.5:0/1909474053 wait complete. 2024-08-18T22:19:46.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2024-08-18T22:19:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.798+0000 7fc33d600640 1 -- 172.21.15.5:0/2635352562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc320005590 con 0x7fc3480b6f90 2024-08-18T22:19:46.804 DEBUG:teuthology.parallel:result is None 2024-08-18T22:19:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.798+0000 7fc33fe00640 1 -- 172.21.15.5:0/2635352562 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc334059890 con 0x7fc3480b6f90 2024-08-18T22:19:46.805 INFO:teuthology.orchestra.run.smithi005.stdout:64424509450 2024-08-18T22:19:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 -- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc328067ac0 msgr2=0x7fc328069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc328067ac0 0x7fc328069f80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc34001c9a0 tx=0x7fc3400a7070 comp rx=0 tx=0).stop 2024-08-18T22:19:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 -- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3480b6f90 msgr2=0x7fc3480cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3480b6f90 0x7fc3480cd2c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc33400d5a0 tx=0x7fc33400da60 comp rx=0 tx=0).stop 2024-08-18T22:19:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 -- 172.21.15.5:0/2635352562 shutdown_connections 2024-08-18T22:19:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc328067ac0 0x7fc328069f80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34815fb40 0x7fc348158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3480b6f90 0x7fc3480cd2c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 --2- 172.21.15.5:0/2635352562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3480b2da0 0x7fc3480ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 -- 172.21.15.5:0/2635352562 >> 172.21.15.5:0/2635352562 conn(0x7fc3480d4760 msgr2=0x7fc3480b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 -- 172.21.15.5:0/2635352562 shutdown_connections 2024-08-18T22:19:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:46.802+0000 7fc33d600640 1 -- 172.21.15.5:0/2635352562 wait complete. 2024-08-18T22:19:46.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-08-18T22:19:46.831 DEBUG:teuthology.parallel:result is None 2024-08-18T22:19:46.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-08-18T22:19:46.835 DEBUG:teuthology.parallel:result is None 2024-08-18T22:19:46.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-08-18T22:19:46.836 DEBUG:teuthology.parallel:result is None 2024-08-18T22:19:46.836 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:19:46.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:19:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.014+0000 7f56ab200640 1 Processor -- start 2024-08-18T22:19:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.014+0000 7f56ab200640 1 -- start start 2024-08-18T22:19:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.014+0000 7f56ab200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56a40ce610 0x7f56a409b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.014+0000 7f56ab200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a40cff50 con 0x7f56a415ff60 2024-08-18T22:19:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.014+0000 7f56ab200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a409ab70 con 0x7f56a409b8b0 2024-08-18T22:19:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.014+0000 7f56ab200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f56a40cfd00 con 0x7f56a40ce610 2024-08-18T22:19:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.014+0000 7f569b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56a40ce610 0x7f56a409b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.014+0000 7f56a3e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f56a415ff60 0x7f56a4160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38718/0 (socket says 172.21.15.5:38718) 2024-08-18T22:19:47.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.014+0000 7f56a3e00640 1 -- 172.21.15.5:0/1195133780 learned_addr learned my addr 172.21.15.5:0/1195133780 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:47.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.014+0000 7f569b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f56a40ce610 0x7f56a409b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40698/0 (socket says 172.21.15.5:40698) 2024-08-18T22:19:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.018+0000 7f569b400640 1 -- 172.21.15.5:0/1195133780 >> v1:172.21.15.117:6789/0 conn(0x7f56a409b8b0 legacy=0x7f56a40ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.018+0000 7f569b400640 1 -- 172.21.15.5:0/1195133780 >> v1:172.21.15.5:6789/0 conn(0x7f56a415ff60 legacy=0x7f56a4160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.018+0000 7f569b400640 1 -- 172.21.15.5:0/1195133780 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a4160a50 con 0x7f56a40ce610 2024-08-18T22:19:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.018+0000 7f56a3400640 1 -- 172.21.15.5:0/1195133780 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777962127 0 0) 0x7f56a40cff50 con 0x7f56a415ff60 2024-08-18T22:19:47.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.018+0000 7f569b400640 1 --2- 172.21.15.5:0/1195133780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a40ce610 0x7f56a409b370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f568c0097c0 tx=0x7f568c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f0adf900990d22 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.018+0000 7f56a3400640 1 -- 172.21.15.5:0/1195133780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c0b0070 con 0x7f56a40ce610 2024-08-18T22:19:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.018+0000 7f56a3400640 1 -- 172.21.15.5:0/1195133780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f568c0ab600 con 0x7f56a40ce610 2024-08-18T22:19:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.018+0000 7f56a3400640 1 -- 172.21.15.5:0/1195133780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c0ab9d0 con 0x7f56a40ce610 2024-08-18T22:19:47.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 -- 172.21.15.5:0/1195133780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a40ce610 msgr2=0x7f56a409b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 --2- 172.21.15.5:0/1195133780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a40ce610 0x7f56a409b370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f568c0097c0 tx=0x7f568c01c380 comp rx=0 tx=0).stop 2024-08-18T22:19:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 -- 172.21.15.5:0/1195133780 shutdown_connections 2024-08-18T22:19:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 --2- 172.21.15.5:0/1195133780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a40ce610 0x7f56a409b370 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 -- 172.21.15.5:0/1195133780 >> 172.21.15.5:0/1195133780 conn(0x7f56a40d2130 msgr2=0x7f56a40d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 -- 172.21.15.5:0/1195133780 shutdown_connections 2024-08-18T22:19:47.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 -- 172.21.15.5:0/1195133780 wait complete. 2024-08-18T22:19:47.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 Processor -- start 2024-08-18T22:19:47.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 -- start start 2024-08-18T22:19:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a409b8b0 0x7f56a40c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56a40ce610 0x7f56a4070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56a415ff60 0x7f56a414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f56a416aa70 con 0x7f56a409b8b0 2024-08-18T22:19:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f56a409aee0 con 0x7f56a40ce610 2024-08-18T22:19:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56ab200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f56a416abf0 con 0x7f56a415ff60 2024-08-18T22:19:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56a3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a409b8b0 0x7f56a40c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56a3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a409b8b0 0x7f56a40c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40714/0 (socket says 172.21.15.5:40714) 2024-08-18T22:19:47.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56a3e00640 1 -- 172.21.15.5:0/1221892701 learned_addr learned my addr 172.21.15.5:0/1221892701 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:47.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f569b400640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56a40ce610 0x7f56a4070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56a9200640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56a415ff60 0x7f56a414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56a3e00640 1 -- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56a415ff60 msgr2=0x7f56a414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56a3e00640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56a415ff60 0x7f56a414b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56a3e00640 1 -- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56a40ce610 msgr2=0x7f56a4070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56a3e00640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56a40ce610 0x7f56a4070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56a3e00640 1 -- 172.21.15.5:0/1221892701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a40c5d90 con 0x7f56a409b8b0 2024-08-18T22:19:47.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56a9200640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56a415ff60 0x7f56a414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:47.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.022+0000 7f56a3e00640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a409b8b0 0x7f56a40c6b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f569400c410 tx=0x7f569400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:47.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.026+0000 7f56a0c00640 1 -- 172.21.15.5:0/1221892701 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56940074e0 con 0x7f56a409b8b0 2024-08-18T22:19:47.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.026+0000 7f56a0c00640 1 -- 172.21.15.5:0/1221892701 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56940047f0 con 0x7f56a409b8b0 2024-08-18T22:19:47.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.026+0000 7f56ab200640 1 -- 172.21.15.5:0/1221892701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a40c6070 con 0x7f56a409b8b0 2024-08-18T22:19:47.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.026+0000 7f56a0c00640 1 -- 172.21.15.5:0/1221892701 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5694007680 con 0x7f56a409b8b0 2024-08-18T22:19:47.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.026+0000 7f56ab200640 1 -- 172.21.15.5:0/1221892701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a40711f0 con 0x7f56a409b8b0 2024-08-18T22:19:47.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.026+0000 7f56ab200640 1 -- 172.21.15.5:0/1221892701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56a40d0f90 con 0x7f56a409b8b0 2024-08-18T22:19:47.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.026+0000 7f56a0c00640 1 -- 172.21.15.5:0/1221892701 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5694011070 con 0x7f56a409b8b0 2024-08-18T22:19:47.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.026+0000 7f56a0c00640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56800678c0 0x7f5680069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.026+0000 7f56a0c00640 1 -- 172.21.15.5:0/1221892701 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5694085b90 con 0x7f56a409b8b0 2024-08-18T22:19:47.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.026+0000 7f569b400640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56800678c0 0x7f5680069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.030+0000 7f569b400640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56800678c0 0x7f5680069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f568c0ad000 tx=0x7f568c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:47.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.030+0000 7f56a0c00640 1 -- 172.21.15.5:0/1221892701 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5694056380 con 0x7f56a409b8b0 2024-08-18T22:19:47.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.194+0000 7f56ab200640 1 -- 172.21.15.5:0/1221892701 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56a40b6f00 con 0x7f56800678c0 2024-08-18T22:19:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.202+0000 7f56a0c00640 1 -- 172.21.15.5:0/1221892701 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f56a40b6f00 con 0x7f56800678c0 2024-08-18T22:19:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:19:47.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 -- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56800678c0 msgr2=0x7f5680069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56800678c0 0x7f5680069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f568c0ad000 tx=0x7f568c0a6000 comp rx=0 tx=0).stop 2024-08-18T22:19:47.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 -- 172.21.15.5:0/1221892701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a409b8b0 msgr2=0x7f56a40c6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a409b8b0 0x7f56a40c6b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f569400c410 tx=0x7f569400c8d0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 -- 172.21.15.5:0/1221892701 shutdown_connections 2024-08-18T22:19:47.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56800678c0 0x7f5680069d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56a415ff60 0x7f56a414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56a40ce610 0x7f56a4070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 --2- 172.21.15.5:0/1221892701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56a409b8b0 0x7f56a40c6b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 -- 172.21.15.5:0/1221892701 >> 172.21.15.5:0/1221892701 conn(0x7f56a40d2130 msgr2=0x7f56a40d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:47.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 -- 172.21.15.5:0/1221892701 shutdown_connections 2024-08-18T22:19:47.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.206+0000 7f56ab200640 1 -- 172.21.15.5:0/1221892701 wait complete. 2024-08-18T22:19:47.233 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-08-18T22:19:45.623672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231896,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742824,"statfs":{"total":773094113280,"available":772856651776,"internally_reserved":0,"allocated":3317760,"data_stored":2006566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003241"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409284+0000","last_change":"2024-08-18T22:19:20.123479+0000","last_active":"2024-08-18T22:19:27.409284+0000","last_peered":"2024-08-18T22:19:27.409284+0000","last_clean":"2024-08-18T22:19:27.409284+0000","last_became_active":"2024-08-18T22:19:20.122186+0000","last_became_peered":"2024-08-18T22:19:20.122186+0000","last_unstale":"2024-08-18T22:19:27.409284+0000","last_undegraded":"2024-08-18T22:19:27.409284+0000","last_fullsized":"2024-08-18T22:19:27.409284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:43.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040942+0000","last_change":"2024-08-18T22:19:21.129646+0000","last_active":"2024-08-18T22:19:27.040942+0000","last_peered":"2024-08-18T22:19:27.040942+0000","last_clean":"2024-08-18T22:19:27.040942+0000","last_became_active":"2024-08-18T22:19:21.129335+0000","last_became_peered":"2024-08-18T22:19:21.129335+0000","last_unstale":"2024-08-18T22:19:27.040942+0000","last_undegraded":"2024-08-18T22:19:27.040942+0000","last_fullsized":"2024-08-18T22:19:27.040942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:43.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040525+0000","last_change":"2024-08-18T22:19:25.367940+0000","last_active":"2024-08-18T22:19:27.040525+0000","last_peered":"2024-08-18T22:19:27.040525+0000","last_clean":"2024-08-18T22:19:27.040525+0000","last_became_active":"2024-08-18T22:19:25.367535+0000","last_became_peered":"2024-08-18T22:19:25.367535+0000","last_unstale":"2024-08-18T22:19:27.040525+0000","last_undegraded":"2024-08-18T22:19:27.040525+0000","last_fullsized":"2024-08-18T22:19:27.040525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:01.102831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041348+0000","last_change":"2024-08-18T22:19:20.124507+0000","last_active":"2024-08-18T22:19:27.041348+0000","last_peered":"2024-08-18T22:19:27.041348+0000","last_clean":"2024-08-18T22:19:27.041348+0000","last_became_active":"2024-08-18T22:19:20.124250+0000","last_became_peered":"2024-08-18T22:19:20.124250+0000","last_unstale":"2024-08-18T22:19:27.041348+0000","last_undegraded":"2024-08-18T22:19:27.041348+0000","last_fullsized":"2024-08-18T22:19:27.041348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:31.028689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409181+0000","last_change":"2024-08-18T22:19:21.137616+0000","last_active":"2024-08-18T22:19:27.409181+0000","last_peered":"2024-08-18T22:19:27.409181+0000","last_clean":"2024-08-18T22:19:27.409181+0000","last_became_active":"2024-08-18T22:19:21.134380+0000","last_became_peered":"2024-08-18T22:19:21.134380+0000","last_unstale":"2024-08-18T22:19:27.409181+0000","last_undegraded":"2024-08-18T22:19:27.409181+0000","last_fullsized":"2024-08-18T22:19:27.409181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343730+0000","last_change":"2024-08-18T22:19:25.363335+0000","last_active":"2024-08-18T22:19:26.343730+0000","last_peered":"2024-08-18T22:19:26.343730+0000","last_clean":"2024-08-18T22:19:26.343730+0000","last_became_active":"2024-08-18T22:19:25.362888+0000","last_became_peered":"2024-08-18T22:19:25.362888+0000","last_unstale":"2024-08-18T22:19:26.343730+0000","last_undegraded":"2024-08-18T22:19:26.343730+0000","last_fullsized":"2024-08-18T22:19:26.343730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:16.915639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345479+0000","last_change":"2024-08-18T22:19:20.129678+0000","last_active":"2024-08-18T22:19:26.345479+0000","last_peered":"2024-08-18T22:19:26.345479+0000","last_clean":"2024-08-18T22:19:26.345479+0000","last_became_active":"2024-08-18T22:19:20.129372+0000","last_became_peered":"2024-08-18T22:19:20.129372+0000","last_unstale":"2024-08-18T22:19:26.345479+0000","last_undegraded":"2024-08-18T22:19:26.345479+0000","last_fullsized":"2024-08-18T22:19:26.345479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:03.344308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335731+0000","last_change":"2024-08-18T22:19:21.130152+0000","last_active":"2024-08-18T22:19:27.335731+0000","last_peered":"2024-08-18T22:19:27.335731+0000","last_clean":"2024-08-18T22:19:27.335731+0000","last_became_active":"2024-08-18T22:19:21.127248+0000","last_became_peered":"2024-08-18T22:19:21.127248+0000","last_unstale":"2024-08-18T22:19:27.335731+0000","last_undegraded":"2024-08-18T22:19:27.335731+0000","last_fullsized":"2024-08-18T22:19:27.335731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:12.798866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344771+0000","last_change":"2024-08-18T22:19:25.375154+0000","last_active":"2024-08-18T22:19:26.344771+0000","last_peered":"2024-08-18T22:19:26.344771+0000","last_clean":"2024-08-18T22:19:26.344771+0000","last_became_active":"2024-08-18T22:19:25.374828+0000","last_became_peered":"2024-08-18T22:19:25.374828+0000","last_unstale":"2024-08-18T22:19:26.344771+0000","last_undegraded":"2024-08-18T22:19:26.344771+0000","last_fullsized":"2024-08-18T22:19:26.344771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:01.678786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345295+0000","last_change":"2024-08-18T22:19:20.127647+0000","last_active":"2024-08-18T22:19:26.345295+0000","last_peered":"2024-08-18T22:19:26.345295+0000","last_clean":"2024-08-18T22:19:26.345295+0000","last_became_active":"2024-08-18T22:19:20.126923+0000","last_became_peered":"2024-08-18T22:19:20.126923+0000","last_unstale":"2024-08-18T22:19:26.345295+0000","last_undegraded":"2024-08-18T22:19:26.345295+0000","last_fullsized":"2024-08-18T22:19:26.345295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:59:29.190977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335932+0000","last_change":"2024-08-18T22:19:21.115653+0000","last_active":"2024-08-18T22:19:27.335932+0000","last_peered":"2024-08-18T22:19:27.335932+0000","last_clean":"2024-08-18T22:19:27.335932+0000","last_became_active":"2024-08-18T22:19:21.115314+0000","last_became_peered":"2024-08-18T22:19:21.115314+0000","last_unstale":"2024-08-18T22:19:27.335932+0000","last_undegraded":"2024-08-18T22:19:27.335932+0000","last_fullsized":"2024-08-18T22:19:27.335932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:38.186074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344183+0000","last_change":"2024-08-18T22:19:25.371279+0000","last_active":"2024-08-18T22:19:26.344183+0000","last_peered":"2024-08-18T22:19:26.344183+0000","last_clean":"2024-08-18T22:19:26.344183+0000","last_became_active":"2024-08-18T22:19:25.370845+0000","last_became_peered":"2024-08-18T22:19:25.370845+0000","last_unstale":"2024-08-18T22:19:26.344183+0000","last_undegraded":"2024-08-18T22:19:26.344183+0000","last_fullsized":"2024-08-18T22:19:26.344183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:47.906445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342492+0000","last_change":"2024-08-18T22:19:21.117843+0000","last_active":"2024-08-18T22:19:26.342492+0000","last_peered":"2024-08-18T22:19:26.342492+0000","last_clean":"2024-08-18T22:19:26.342492+0000","last_became_active":"2024-08-18T22:19:21.117591+0000","last_became_peered":"2024-08-18T22:19:21.117591+0000","last_unstale":"2024-08-18T22:19:26.342492+0000","last_undegraded":"2024-08-18T22:19:26.342492+0000","last_fullsized":"2024-08-18T22:19:26.342492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345999+0000","last_change":"2024-08-18T22:19:20.130667+0000","last_active":"2024-08-18T22:19:26.345999+0000","last_peered":"2024-08-18T22:19:26.345999+0000","last_clean":"2024-08-18T22:19:26.345999+0000","last_became_active":"2024-08-18T22:19:20.130389+0000","last_became_peered":"2024-08-18T22:19:20.130389+0000","last_unstale":"2024-08-18T22:19:26.345999+0000","last_undegraded":"2024-08-18T22:19:26.345999+0000","last_fullsized":"2024-08-18T22:19:26.345999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:43.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344745+0000","last_change":"2024-08-18T22:19:25.362818+0000","last_active":"2024-08-18T22:19:26.344745+0000","last_peered":"2024-08-18T22:19:26.344745+0000","last_clean":"2024-08-18T22:19:26.344745+0000","last_became_active":"2024-08-18T22:19:25.360791+0000","last_became_peered":"2024-08-18T22:19:25.360791+0000","last_unstale":"2024-08-18T22:19:26.344745+0000","last_undegraded":"2024-08-18T22:19:26.344745+0000","last_fullsized":"2024-08-18T22:19:26.344745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:00.035629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040971+0000","last_change":"2024-08-18T22:19:21.140980+0000","last_active":"2024-08-18T22:19:27.040971+0000","last_peered":"2024-08-18T22:19:27.040971+0000","last_clean":"2024-08-18T22:19:27.040971+0000","last_became_active":"2024-08-18T22:19:21.139771+0000","last_became_peered":"2024-08-18T22:19:21.139771+0000","last_unstale":"2024-08-18T22:19:27.040971+0000","last_undegraded":"2024-08-18T22:19:27.040971+0000","last_fullsized":"2024-08-18T22:19:27.040971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407586+0000","last_change":"2024-08-18T22:19:20.119605+0000","last_active":"2024-08-18T22:19:27.407586+0000","last_peered":"2024-08-18T22:19:27.407586+0000","last_clean":"2024-08-18T22:19:27.407586+0000","last_became_active":"2024-08-18T22:19:20.118664+0000","last_became_peered":"2024-08-18T22:19:20.118664+0000","last_unstale":"2024-08-18T22:19:27.407586+0000","last_undegraded":"2024-08-18T22:19:27.407586+0000","last_fullsized":"2024-08-18T22:19:27.407586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344947+0000","last_change":"2024-08-18T22:19:25.376804+0000","last_active":"2024-08-18T22:19:26.344947+0000","last_peered":"2024-08-18T22:19:26.344947+0000","last_clean":"2024-08-18T22:19:26.344947+0000","last_became_active":"2024-08-18T22:19:25.376401+0000","last_became_peered":"2024-08-18T22:19:25.376401+0000","last_unstale":"2024-08-18T22:19:26.344947+0000","last_undegraded":"2024-08-18T22:19:26.344947+0000","last_fullsized":"2024-08-18T22:19:26.344947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:13.678679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041189+0000","last_change":"2024-08-18T22:19:21.115033+0000","last_active":"2024-08-18T22:19:27.041189+0000","last_peered":"2024-08-18T22:19:27.041189+0000","last_clean":"2024-08-18T22:19:27.041189+0000","last_became_active":"2024-08-18T22:19:21.114665+0000","last_became_peered":"2024-08-18T22:19:21.114665+0000","last_unstale":"2024-08-18T22:19:27.041189+0000","last_undegraded":"2024-08-18T22:19:27.041189+0000","last_fullsized":"2024-08-18T22:19:27.041189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406868+0000","last_change":"2024-08-18T22:19:20.118245+0000","last_active":"2024-08-18T22:19:27.406868+0000","last_peered":"2024-08-18T22:19:27.406868+0000","last_clean":"2024-08-18T22:19:27.406868+0000","last_became_active":"2024-08-18T22:19:20.117739+0000","last_became_peered":"2024-08-18T22:19:20.117739+0000","last_unstale":"2024-08-18T22:19:27.406868+0000","last_undegraded":"2024-08-18T22:19:27.406868+0000","last_fullsized":"2024-08-18T22:19:27.406868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408292+0000","last_change":"2024-08-18T22:19:25.369695+0000","last_active":"2024-08-18T22:19:27.408292+0000","last_peered":"2024-08-18T22:19:27.408292+0000","last_clean":"2024-08-18T22:19:27.408292+0000","last_became_active":"2024-08-18T22:19:25.368337+0000","last_became_peered":"2024-08-18T22:19:25.368337+0000","last_unstale":"2024-08-18T22:19:27.408292+0000","last_undegraded":"2024-08-18T22:19:27.408292+0000","last_fullsized":"2024-08-18T22:19:27.408292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:30.299592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343932+0000","last_change":"2024-08-18T22:19:21.123087+0000","last_active":"2024-08-18T22:19:26.343932+0000","last_peered":"2024-08-18T22:19:26.343932+0000","last_clean":"2024-08-18T22:19:26.343932+0000","last_became_active":"2024-08-18T22:19:21.121880+0000","last_became_peered":"2024-08-18T22:19:21.121880+0000","last_unstale":"2024-08-18T22:19:26.343932+0000","last_undegraded":"2024-08-18T22:19:26.343932+0000","last_fullsized":"2024-08-18T22:19:26.343932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:30.321238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343775+0000","last_change":"2024-08-18T22:19:20.127132+0000","last_active":"2024-08-18T22:19:26.343775+0000","last_peered":"2024-08-18T22:19:26.343775+0000","last_clean":"2024-08-18T22:19:26.343775+0000","last_became_active":"2024-08-18T22:19:20.126546+0000","last_became_peered":"2024-08-18T22:19:20.126546+0000","last_unstale":"2024-08-18T22:19:26.343775+0000","last_undegraded":"2024-08-18T22:19:26.343775+0000","last_fullsized":"2024-08-18T22:19:26.343775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:02.877029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345036+0000","last_change":"2024-08-18T22:19:25.372155+0000","last_active":"2024-08-18T22:19:26.345036+0000","last_peered":"2024-08-18T22:19:26.345036+0000","last_clean":"2024-08-18T22:19:26.345036+0000","last_became_active":"2024-08-18T22:19:25.370185+0000","last_became_peered":"2024-08-18T22:19:25.370185+0000","last_unstale":"2024-08-18T22:19:26.345036+0000","last_undegraded":"2024-08-18T22:19:26.345036+0000","last_fullsized":"2024-08-18T22:19:26.345036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:29:15.122631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409166+0000","last_change":"2024-08-18T22:19:21.132057+0000","last_active":"2024-08-18T22:19:27.409166+0000","last_peered":"2024-08-18T22:19:27.409166+0000","last_clean":"2024-08-18T22:19:27.409166+0000","last_became_active":"2024-08-18T22:19:21.131730+0000","last_became_peered":"2024-08-18T22:19:21.131730+0000","last_unstale":"2024-08-18T22:19:27.409166+0000","last_undegraded":"2024-08-18T22:19:27.409166+0000","last_fullsized":"2024-08-18T22:19:27.409166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344759+0000","last_change":"2024-08-18T22:19:20.124994+0000","last_active":"2024-08-18T22:19:26.344759+0000","last_peered":"2024-08-18T22:19:26.344759+0000","last_clean":"2024-08-18T22:19:26.344759+0000","last_became_active":"2024-08-18T22:19:20.124797+0000","last_became_peered":"2024-08-18T22:19:20.124797+0000","last_unstale":"2024-08-18T22:19:26.344759+0000","last_undegraded":"2024-08-18T22:19:26.344759+0000","last_fullsized":"2024-08-18T22:19:26.344759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343600+0000","last_change":"2024-08-18T22:19:25.359580+0000","last_active":"2024-08-18T22:19:26.343600+0000","last_peered":"2024-08-18T22:19:26.343600+0000","last_clean":"2024-08-18T22:19:26.343600+0000","last_became_active":"2024-08-18T22:19:25.359219+0000","last_became_peered":"2024-08-18T22:19:25.359219+0000","last_unstale":"2024-08-18T22:19:26.343600+0000","last_undegraded":"2024-08-18T22:19:26.343600+0000","last_fullsized":"2024-08-18T22:19:26.343600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:29.463841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041318+0000","last_change":"2024-08-18T22:19:21.121965+0000","last_active":"2024-08-18T22:19:27.041318+0000","last_peered":"2024-08-18T22:19:27.041318+0000","last_clean":"2024-08-18T22:19:27.041318+0000","last_became_active":"2024-08-18T22:19:21.118981+0000","last_became_peered":"2024-08-18T22:19:21.118981+0000","last_unstale":"2024-08-18T22:19:27.041318+0000","last_undegraded":"2024-08-18T22:19:27.041318+0000","last_fullsized":"2024-08-18T22:19:27.041318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408573+0000","last_change":"2024-08-18T22:19:20.127044+0000","last_active":"2024-08-18T22:19:27.408573+0000","last_peered":"2024-08-18T22:19:27.408573+0000","last_clean":"2024-08-18T22:19:27.408573+0000","last_became_active":"2024-08-18T22:19:20.126773+0000","last_became_peered":"2024-08-18T22:19:20.126773+0000","last_unstale":"2024-08-18T22:19:27.408573+0000","last_undegraded":"2024-08-18T22:19:27.408573+0000","last_fullsized":"2024-08-18T22:19:27.408573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040518+0000","last_change":"2024-08-18T22:19:25.365151+0000","last_active":"2024-08-18T22:19:27.040518+0000","last_peered":"2024-08-18T22:19:27.040518+0000","last_clean":"2024-08-18T22:19:27.040518+0000","last_became_active":"2024-08-18T22:19:25.364683+0000","last_became_peered":"2024-08-18T22:19:25.364683+0000","last_unstale":"2024-08-18T22:19:27.040518+0000","last_undegraded":"2024-08-18T22:19:27.040518+0000","last_fullsized":"2024-08-18T22:19:27.040518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:28.640280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407867+0000","last_change":"2024-08-18T22:19:21.113379+0000","last_active":"2024-08-18T22:19:27.407867+0000","last_peered":"2024-08-18T22:19:27.407867+0000","last_clean":"2024-08-18T22:19:27.407867+0000","last_became_active":"2024-08-18T22:19:21.113086+0000","last_became_peered":"2024-08-18T22:19:21.113086+0000","last_unstale":"2024-08-18T22:19:27.407867+0000","last_undegraded":"2024-08-18T22:19:27.407867+0000","last_fullsized":"2024-08-18T22:19:27.407867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345595+0000","last_change":"2024-08-18T22:19:20.130493+0000","last_active":"2024-08-18T22:19:26.345595+0000","last_peered":"2024-08-18T22:19:26.345595+0000","last_clean":"2024-08-18T22:19:26.345595+0000","last_became_active":"2024-08-18T22:19:20.130161+0000","last_became_peered":"2024-08-18T22:19:20.130161+0000","last_unstale":"2024-08-18T22:19:26.345595+0000","last_undegraded":"2024-08-18T22:19:26.345595+0000","last_fullsized":"2024-08-18T22:19:26.345595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:13.130477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408499+0000","last_change":"2024-08-18T22:19:25.375977+0000","last_active":"2024-08-18T22:19:27.408499+0000","last_peered":"2024-08-18T22:19:27.408499+0000","last_clean":"2024-08-18T22:19:27.408499+0000","last_became_active":"2024-08-18T22:19:25.366619+0000","last_became_peered":"2024-08-18T22:19:25.366619+0000","last_unstale":"2024-08-18T22:19:27.408499+0000","last_undegraded":"2024-08-18T22:19:27.408499+0000","last_fullsized":"2024-08-18T22:19:27.408499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:25.001121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336042+0000","last_change":"2024-08-18T22:19:21.126649+0000","last_active":"2024-08-18T22:19:27.336042+0000","last_peered":"2024-08-18T22:19:27.336042+0000","last_clean":"2024-08-18T22:19:27.336042+0000","last_became_active":"2024-08-18T22:19:21.125045+0000","last_became_peered":"2024-08-18T22:19:21.125045+0000","last_unstale":"2024-08-18T22:19:27.336042+0000","last_undegraded":"2024-08-18T22:19:27.336042+0000","last_fullsized":"2024-08-18T22:19:27.336042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:10.870419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407965+0000","last_change":"2024-08-18T22:19:20.113605+0000","last_active":"2024-08-18T22:19:27.407965+0000","last_peered":"2024-08-18T22:19:27.407965+0000","last_clean":"2024-08-18T22:19:27.407965+0000","last_became_active":"2024-08-18T22:19:20.113312+0000","last_became_peered":"2024-08-18T22:19:20.113312+0000","last_unstale":"2024-08-18T22:19:27.407965+0000","last_undegraded":"2024-08-18T22:19:27.407965+0000","last_fullsized":"2024-08-18T22:19:27.407965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407154+0000","last_change":"2024-08-18T22:19:25.379602+0000","last_active":"2024-08-18T22:19:27.407154+0000","last_peered":"2024-08-18T22:19:27.407154+0000","last_clean":"2024-08-18T22:19:27.407154+0000","last_became_active":"2024-08-18T22:19:25.379233+0000","last_became_peered":"2024-08-18T22:19:25.379233+0000","last_unstale":"2024-08-18T22:19:27.407154+0000","last_undegraded":"2024-08-18T22:19:27.407154+0000","last_fullsized":"2024-08-18T22:19:27.407154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:49.056286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344921+0000","last_change":"2024-08-18T22:19:21.137261+0000","last_active":"2024-08-18T22:19:26.344921+0000","last_peered":"2024-08-18T22:19:26.344921+0000","last_clean":"2024-08-18T22:19:26.344921+0000","last_became_active":"2024-08-18T22:19:21.137007+0000","last_became_peered":"2024-08-18T22:19:21.137007+0000","last_unstale":"2024-08-18T22:19:26.344921+0000","last_undegraded":"2024-08-18T22:19:26.344921+0000","last_fullsized":"2024-08-18T22:19:26.344921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:14.978071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335848+0000","last_change":"2024-08-18T22:19:20.118663+0000","last_active":"2024-08-18T22:19:27.335848+0000","last_peered":"2024-08-18T22:19:27.335848+0000","last_clean":"2024-08-18T22:19:27.335848+0000","last_became_active":"2024-08-18T22:19:20.118041+0000","last_became_peered":"2024-08-18T22:19:20.118041+0000","last_unstale":"2024-08-18T22:19:27.335848+0000","last_undegraded":"2024-08-18T22:19:27.335848+0000","last_fullsized":"2024-08-18T22:19:27.335848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407962+0000","last_change":"2024-08-18T22:19:25.375614+0000","last_active":"2024-08-18T22:19:27.407962+0000","last_peered":"2024-08-18T22:19:27.407962+0000","last_clean":"2024-08-18T22:19:27.407962+0000","last_became_active":"2024-08-18T22:19:25.374263+0000","last_became_peered":"2024-08-18T22:19:25.374263+0000","last_unstale":"2024-08-18T22:19:27.407962+0000","last_undegraded":"2024-08-18T22:19:27.407962+0000","last_fullsized":"2024-08-18T22:19:27.407962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:42.422194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406686+0000","last_change":"2024-08-18T22:19:21.110718+0000","last_active":"2024-08-18T22:19:27.406686+0000","last_peered":"2024-08-18T22:19:27.406686+0000","last_clean":"2024-08-18T22:19:27.406686+0000","last_became_active":"2024-08-18T22:19:21.110328+0000","last_became_peered":"2024-08-18T22:19:21.110328+0000","last_unstale":"2024-08-18T22:19:27.406686+0000","last_undegraded":"2024-08-18T22:19:27.406686+0000","last_fullsized":"2024-08-18T22:19:27.406686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406673+0000","last_change":"2024-08-18T22:19:20.110735+0000","last_active":"2024-08-18T22:19:27.406673+0000","last_peered":"2024-08-18T22:19:27.406673+0000","last_clean":"2024-08-18T22:19:27.406673+0000","last_became_active":"2024-08-18T22:19:20.110382+0000","last_became_peered":"2024-08-18T22:19:20.110382+0000","last_unstale":"2024-08-18T22:19:27.406673+0000","last_undegraded":"2024-08-18T22:19:27.406673+0000","last_fullsized":"2024-08-18T22:19:27.406673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:54.714769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408376+0000","last_change":"2024-08-18T22:19:25.374139+0000","last_active":"2024-08-18T22:19:27.408376+0000","last_peered":"2024-08-18T22:19:27.408376+0000","last_clean":"2024-08-18T22:19:27.408376+0000","last_became_active":"2024-08-18T22:19:25.373712+0000","last_became_peered":"2024-08-18T22:19:25.373712+0000","last_unstale":"2024-08-18T22:19:27.408376+0000","last_undegraded":"2024-08-18T22:19:27.408376+0000","last_fullsized":"2024-08-18T22:19:27.408376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:15.106539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407992+0000","last_change":"2024-08-18T22:19:21.134091+0000","last_active":"2024-08-18T22:19:27.407992+0000","last_peered":"2024-08-18T22:19:27.407992+0000","last_clean":"2024-08-18T22:19:27.407992+0000","last_became_active":"2024-08-18T22:19:21.133674+0000","last_became_peered":"2024-08-18T22:19:21.133674+0000","last_unstale":"2024-08-18T22:19:27.407992+0000","last_undegraded":"2024-08-18T22:19:27.407992+0000","last_fullsized":"2024-08-18T22:19:27.407992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:42:36.740493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343883+0000","last_change":"2024-08-18T22:19:20.125876+0000","last_active":"2024-08-18T22:19:26.343883+0000","last_peered":"2024-08-18T22:19:26.343883+0000","last_clean":"2024-08-18T22:19:26.343883+0000","last_became_active":"2024-08-18T22:19:20.125594+0000","last_became_peered":"2024-08-18T22:19:20.125594+0000","last_unstale":"2024-08-18T22:19:26.343883+0000","last_undegraded":"2024-08-18T22:19:26.343883+0000","last_fullsized":"2024-08-18T22:19:26.343883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:35:24.581822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409117+0000","last_change":"2024-08-18T22:19:25.366073+0000","last_active":"2024-08-18T22:19:27.409117+0000","last_peered":"2024-08-18T22:19:27.409117+0000","last_clean":"2024-08-18T22:19:27.409117+0000","last_became_active":"2024-08-18T22:19:25.364486+0000","last_became_peered":"2024-08-18T22:19:25.364486+0000","last_unstale":"2024-08-18T22:19:27.409117+0000","last_undegraded":"2024-08-18T22:19:27.409117+0000","last_fullsized":"2024-08-18T22:19:27.409117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:54.372527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040730+0000","last_change":"2024-08-18T22:19:21.126426+0000","last_active":"2024-08-18T22:19:27.040730+0000","last_peered":"2024-08-18T22:19:27.040730+0000","last_clean":"2024-08-18T22:19:27.040730+0000","last_became_active":"2024-08-18T22:19:21.126155+0000","last_became_peered":"2024-08-18T22:19:21.126155+0000","last_unstale":"2024-08-18T22:19:27.040730+0000","last_undegraded":"2024-08-18T22:19:27.040730+0000","last_fullsized":"2024-08-18T22:19:27.040730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:12.798866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335635+0000","last_change":"2024-08-18T22:19:20.120813+0000","last_active":"2024-08-18T22:19:27.335635+0000","last_peered":"2024-08-18T22:19:27.335635+0000","last_clean":"2024-08-18T22:19:27.335635+0000","last_became_active":"2024-08-18T22:19:20.120520+0000","last_became_peered":"2024-08-18T22:19:20.120520+0000","last_unstale":"2024-08-18T22:19:27.335635+0000","last_undegraded":"2024-08-18T22:19:27.335635+0000","last_fullsized":"2024-08-18T22:19:27.335635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343987+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:19:26.343987+0000","last_peered":"2024-08-18T22:19:26.343987+0000","last_clean":"2024-08-18T22:19:26.343987+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:19:26.343987+0000","last_undegraded":"2024-08-18T22:19:26.343987+0000","last_fullsized":"2024-08-18T22:19:26.343987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343553+0000","last_change":"2024-08-18T22:19:25.358088+0000","last_active":"2024-08-18T22:19:26.343553+0000","last_peered":"2024-08-18T22:19:26.343553+0000","last_clean":"2024-08-18T22:19:26.343553+0000","last_became_active":"2024-08-18T22:19:25.357741+0000","last_became_peered":"2024-08-18T22:19:25.357741+0000","last_unstale":"2024-08-18T22:19:26.343553+0000","last_undegraded":"2024-08-18T22:19:26.343553+0000","last_fullsized":"2024-08-18T22:19:26.343553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:12.001219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345357+0000","last_change":"2024-08-18T22:19:21.115625+0000","last_active":"2024-08-18T22:19:26.345357+0000","last_peered":"2024-08-18T22:19:26.345357+0000","last_clean":"2024-08-18T22:19:26.345357+0000","last_became_active":"2024-08-18T22:19:21.113832+0000","last_became_peered":"2024-08-18T22:19:21.113832+0000","last_unstale":"2024-08-18T22:19:26.345357+0000","last_undegraded":"2024-08-18T22:19:26.345357+0000","last_fullsized":"2024-08-18T22:19:26.345357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:07.765099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407470+0000","last_change":"2024-08-18T22:19:20.114087+0000","last_active":"2024-08-18T22:19:27.407470+0000","last_peered":"2024-08-18T22:19:27.407470+0000","last_clean":"2024-08-18T22:19:27.407470+0000","last_became_active":"2024-08-18T22:19:20.113655+0000","last_became_peered":"2024-08-18T22:19:20.113655+0000","last_unstale":"2024-08-18T22:19:27.407470+0000","last_undegraded":"2024-08-18T22:19:27.407470+0000","last_fullsized":"2024-08-18T22:19:27.407470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:31:21.374246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342469+0000","last_change":"2024-08-18T22:19:25.362833+0000","last_active":"2024-08-18T22:19:26.342469+0000","last_peered":"2024-08-18T22:19:26.342469+0000","last_clean":"2024-08-18T22:19:26.342469+0000","last_became_active":"2024-08-18T22:19:25.362232+0000","last_became_peered":"2024-08-18T22:19:25.362232+0000","last_unstale":"2024-08-18T22:19:26.342469+0000","last_undegraded":"2024-08-18T22:19:26.342469+0000","last_fullsized":"2024-08-18T22:19:26.342469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:10.830493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335872+0000","last_change":"2024-08-18T22:19:21.127671+0000","last_active":"2024-08-18T22:19:27.335872+0000","last_peered":"2024-08-18T22:19:27.335872+0000","last_clean":"2024-08-18T22:19:27.335872+0000","last_became_active":"2024-08-18T22:19:21.124718+0000","last_became_peered":"2024-08-18T22:19:21.124718+0000","last_unstale":"2024-08-18T22:19:27.335872+0000","last_undegraded":"2024-08-18T22:19:27.335872+0000","last_fullsized":"2024-08-18T22:19:27.335872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:07.765099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408089+0000","last_change":"2024-08-18T22:19:20.109318+0000","last_active":"2024-08-18T22:19:27.408089+0000","last_peered":"2024-08-18T22:19:27.408089+0000","last_clean":"2024-08-18T22:19:27.408089+0000","last_became_active":"2024-08-18T22:19:20.108894+0000","last_became_peered":"2024-08-18T22:19:20.108894+0000","last_unstale":"2024-08-18T22:19:27.408089+0000","last_undegraded":"2024-08-18T22:19:27.408089+0000","last_fullsized":"2024-08-18T22:19:27.408089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408668+0000","last_change":"2024-08-18T22:19:25.372355+0000","last_active":"2024-08-18T22:19:27.408668+0000","last_peered":"2024-08-18T22:19:27.408668+0000","last_clean":"2024-08-18T22:19:27.408668+0000","last_became_active":"2024-08-18T22:19:25.365235+0000","last_became_peered":"2024-08-18T22:19:25.365235+0000","last_unstale":"2024-08-18T22:19:27.408668+0000","last_undegraded":"2024-08-18T22:19:27.408668+0000","last_fullsized":"2024-08-18T22:19:27.408668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:42.422194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345949+0000","last_change":"2024-08-18T22:19:21.114675+0000","last_active":"2024-08-18T22:19:26.345949+0000","last_peered":"2024-08-18T22:19:26.345949+0000","last_clean":"2024-08-18T22:19:26.345949+0000","last_became_active":"2024-08-18T22:19:21.114251+0000","last_became_peered":"2024-08-18T22:19:21.114251+0000","last_unstale":"2024-08-18T22:19:26.345949+0000","last_undegraded":"2024-08-18T22:19:26.345949+0000","last_fullsized":"2024-08-18T22:19:26.345949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:24.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408143+0000","last_change":"2024-08-18T22:19:20.112330+0000","last_active":"2024-08-18T22:19:27.408143+0000","last_peered":"2024-08-18T22:19:27.408143+0000","last_clean":"2024-08-18T22:19:27.408143+0000","last_became_active":"2024-08-18T22:19:20.110530+0000","last_became_peered":"2024-08-18T22:19:20.110530+0000","last_unstale":"2024-08-18T22:19:27.408143+0000","last_undegraded":"2024-08-18T22:19:27.408143+0000","last_fullsized":"2024-08-18T22:19:27.408143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:18.857333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335519+0000","last_change":"2024-08-18T22:19:25.363810+0000","last_active":"2024-08-18T22:19:27.335519+0000","last_peered":"2024-08-18T22:19:27.335519+0000","last_clean":"2024-08-18T22:19:27.335519+0000","last_became_active":"2024-08-18T22:19:25.363407+0000","last_became_peered":"2024-08-18T22:19:25.363407+0000","last_unstale":"2024-08-18T22:19:27.335519+0000","last_undegraded":"2024-08-18T22:19:27.335519+0000","last_fullsized":"2024-08-18T22:19:27.335519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:28.640280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345615+0000","last_change":"2024-08-18T22:19:21.114404+0000","last_active":"2024-08-18T22:19:26.345615+0000","last_peered":"2024-08-18T22:19:26.345615+0000","last_clean":"2024-08-18T22:19:26.345615+0000","last_became_active":"2024-08-18T22:19:21.114109+0000","last_became_peered":"2024-08-18T22:19:21.114109+0000","last_unstale":"2024-08-18T22:19:26.345615+0000","last_undegraded":"2024-08-18T22:19:26.345615+0000","last_fullsized":"2024-08-18T22:19:26.345615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:50.136407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345199+0000","last_change":"2024-08-18T22:19:20.122497+0000","last_active":"2024-08-18T22:19:26.345199+0000","last_peered":"2024-08-18T22:19:26.345199+0000","last_clean":"2024-08-18T22:19:26.345199+0000","last_became_active":"2024-08-18T22:19:20.120755+0000","last_became_peered":"2024-08-18T22:19:20.120755+0000","last_unstale":"2024-08-18T22:19:26.345199+0000","last_undegraded":"2024-08-18T22:19:26.345199+0000","last_fullsized":"2024-08-18T22:19:26.345199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:29.746429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343340+0000","last_change":"2024-08-18T22:19:25.365173+0000","last_active":"2024-08-18T22:19:26.343340+0000","last_peered":"2024-08-18T22:19:26.343340+0000","last_clean":"2024-08-18T22:19:26.343340+0000","last_became_active":"2024-08-18T22:19:25.364765+0000","last_became_peered":"2024-08-18T22:19:25.364765+0000","last_unstale":"2024-08-18T22:19:26.343340+0000","last_undegraded":"2024-08-18T22:19:26.343340+0000","last_fullsized":"2024-08-18T22:19:26.343340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:28:02.302944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344594+0000","last_change":"2024-08-18T22:19:21.114669+0000","last_active":"2024-08-18T22:19:26.344594+0000","last_peered":"2024-08-18T22:19:26.344594+0000","last_clean":"2024-08-18T22:19:26.344594+0000","last_became_active":"2024-08-18T22:19:21.114275+0000","last_became_peered":"2024-08-18T22:19:21.114275+0000","last_unstale":"2024-08-18T22:19:26.344594+0000","last_undegraded":"2024-08-18T22:19:26.344594+0000","last_fullsized":"2024-08-18T22:19:26.344594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:26.063472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406470+0000","last_change":"2024-08-18T22:19:20.109986+0000","last_active":"2024-08-18T22:19:27.406470+0000","last_peered":"2024-08-18T22:19:27.406470+0000","last_clean":"2024-08-18T22:19:27.406470+0000","last_became_active":"2024-08-18T22:19:20.109629+0000","last_became_peered":"2024-08-18T22:19:20.109629+0000","last_unstale":"2024-08-18T22:19:27.406470+0000","last_undegraded":"2024-08-18T22:19:27.406470+0000","last_fullsized":"2024-08-18T22:19:27.406470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:41.309073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408961+0000","last_change":"2024-08-18T22:19:25.369993+0000","last_active":"2024-08-18T22:19:27.408961+0000","last_peered":"2024-08-18T22:19:27.408961+0000","last_clean":"2024-08-18T22:19:27.408961+0000","last_became_active":"2024-08-18T22:19:25.369546+0000","last_became_peered":"2024-08-18T22:19:25.369546+0000","last_unstale":"2024-08-18T22:19:27.408961+0000","last_undegraded":"2024-08-18T22:19:27.408961+0000","last_fullsized":"2024-08-18T22:19:27.408961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:15.106539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342013+0000","last_change":"2024-08-18T22:19:21.136153+0000","last_active":"2024-08-18T22:19:26.342013+0000","last_peered":"2024-08-18T22:19:26.342013+0000","last_clean":"2024-08-18T22:19:26.342013+0000","last_became_active":"2024-08-18T22:19:21.135862+0000","last_became_peered":"2024-08-18T22:19:21.135862+0000","last_unstale":"2024-08-18T22:19:26.342013+0000","last_undegraded":"2024-08-18T22:19:26.342013+0000","last_fullsized":"2024-08-18T22:19:26.342013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342398+0000","last_change":"2024-08-18T22:19:20.119295+0000","last_active":"2024-08-18T22:19:26.342398+0000","last_peered":"2024-08-18T22:19:26.342398+0000","last_clean":"2024-08-18T22:19:26.342398+0000","last_became_active":"2024-08-18T22:19:20.118960+0000","last_became_peered":"2024-08-18T22:19:20.118960+0000","last_unstale":"2024-08-18T22:19:26.342398+0000","last_undegraded":"2024-08-18T22:19:26.342398+0000","last_fullsized":"2024-08-18T22:19:26.342398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041372+0000","last_change":"2024-08-18T22:19:25.384579+0000","last_active":"2024-08-18T22:19:27.041372+0000","last_peered":"2024-08-18T22:19:27.041372+0000","last_clean":"2024-08-18T22:19:27.041372+0000","last_became_active":"2024-08-18T22:19:25.384216+0000","last_became_peered":"2024-08-18T22:19:25.384216+0000","last_unstale":"2024-08-18T22:19:27.041372+0000","last_undegraded":"2024-08-18T22:19:27.041372+0000","last_fullsized":"2024-08-18T22:19:27.041372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:56.704905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345875+0000","last_change":"2024-08-18T22:19:21.115242+0000","last_active":"2024-08-18T22:19:26.345875+0000","last_peered":"2024-08-18T22:19:26.345875+0000","last_clean":"2024-08-18T22:19:26.345875+0000","last_became_active":"2024-08-18T22:19:21.114992+0000","last_became_peered":"2024-08-18T22:19:21.114992+0000","last_unstale":"2024-08-18T22:19:26.345875+0000","last_undegraded":"2024-08-18T22:19:26.345875+0000","last_fullsized":"2024-08-18T22:19:26.345875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:20.765001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335813+0000","last_change":"2024-08-18T22:19:20.122264+0000","last_active":"2024-08-18T22:19:27.335813+0000","last_peered":"2024-08-18T22:19:27.335813+0000","last_clean":"2024-08-18T22:19:27.335813+0000","last_became_active":"2024-08-18T22:19:20.121940+0000","last_became_peered":"2024-08-18T22:19:20.121940+0000","last_unstale":"2024-08-18T22:19:27.335813+0000","last_undegraded":"2024-08-18T22:19:27.335813+0000","last_fullsized":"2024-08-18T22:19:27.335813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041119+0000","last_change":"2024-08-18T22:19:25.382796+0000","last_active":"2024-08-18T22:19:27.041119+0000","last_peered":"2024-08-18T22:19:27.041119+0000","last_clean":"2024-08-18T22:19:27.041119+0000","last_became_active":"2024-08-18T22:19:25.382015+0000","last_became_peered":"2024-08-18T22:19:25.382015+0000","last_unstale":"2024-08-18T22:19:27.041119+0000","last_undegraded":"2024-08-18T22:19:27.041119+0000","last_fullsized":"2024-08-18T22:19:27.041119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:13:06.606276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408452+0000","last_change":"2024-08-18T22:19:21.124994+0000","last_active":"2024-08-18T22:19:27.408452+0000","last_peered":"2024-08-18T22:19:27.408452+0000","last_clean":"2024-08-18T22:19:27.408452+0000","last_became_active":"2024-08-18T22:19:21.124714+0000","last_became_peered":"2024-08-18T22:19:21.124714+0000","last_unstale":"2024-08-18T22:19:27.408452+0000","last_undegraded":"2024-08-18T22:19:27.408452+0000","last_fullsized":"2024-08-18T22:19:27.408452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408670+0000","last_change":"2024-08-18T22:19:20.117524+0000","last_active":"2024-08-18T22:19:27.408670+0000","last_peered":"2024-08-18T22:19:27.408670+0000","last_clean":"2024-08-18T22:19:27.408670+0000","last_became_active":"2024-08-18T22:19:20.117271+0000","last_became_peered":"2024-08-18T22:19:20.117271+0000","last_unstale":"2024-08-18T22:19:27.408670+0000","last_undegraded":"2024-08-18T22:19:27.408670+0000","last_fullsized":"2024-08-18T22:19:27.408670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336048+0000","last_change":"2024-08-18T22:19:25.364903+0000","last_active":"2024-08-18T22:19:27.336048+0000","last_peered":"2024-08-18T22:19:27.336048+0000","last_clean":"2024-08-18T22:19:27.336048+0000","last_became_active":"2024-08-18T22:19:25.364491+0000","last_became_peered":"2024-08-18T22:19:25.364491+0000","last_unstale":"2024-08-18T22:19:27.336048+0000","last_undegraded":"2024-08-18T22:19:27.336048+0000","last_fullsized":"2024-08-18T22:19:27.336048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:01.102831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345257+0000","last_change":"2024-08-18T22:19:21.122735+0000","last_active":"2024-08-18T22:19:26.345257+0000","last_peered":"2024-08-18T22:19:26.345257+0000","last_clean":"2024-08-18T22:19:26.345257+0000","last_became_active":"2024-08-18T22:19:21.122489+0000","last_became_peered":"2024-08-18T22:19:21.122489+0000","last_unstale":"2024-08-18T22:19:26.345257+0000","last_undegraded":"2024-08-18T22:19:26.345257+0000","last_fullsized":"2024-08-18T22:19:26.345257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:44.820166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:32.234207+0000","last_change":"2024-08-18T22:19:20.121780+0000","last_active":"2024-08-18T22:19:32.234207+0000","last_peered":"2024-08-18T22:19:32.234207+0000","last_clean":"2024-08-18T22:19:32.234207+0000","last_became_active":"2024-08-18T22:19:20.121504+0000","last_became_peered":"2024-08-18T22:19:20.121504+0000","last_unstale":"2024-08-18T22:19:32.234207+0000","last_undegraded":"2024-08-18T22:19:32.234207+0000","last_fullsized":"2024-08-18T22:19:32.234207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407423+0000","last_change":"2024-08-18T22:19:25.380704+0000","last_active":"2024-08-18T22:19:27.407423+0000","last_peered":"2024-08-18T22:19:27.407423+0000","last_clean":"2024-08-18T22:19:27.407423+0000","last_became_active":"2024-08-18T22:19:25.380338+0000","last_became_peered":"2024-08-18T22:19:25.380338+0000","last_unstale":"2024-08-18T22:19:27.407423+0000","last_undegraded":"2024-08-18T22:19:27.407423+0000","last_fullsized":"2024-08-18T22:19:27.407423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:25.001121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345049+0000","last_change":"2024-08-18T22:19:21.105768+0000","last_active":"2024-08-18T22:19:26.345049+0000","last_peered":"2024-08-18T22:19:26.345049+0000","last_clean":"2024-08-18T22:19:26.345049+0000","last_became_active":"2024-08-18T22:19:21.105461+0000","last_became_peered":"2024-08-18T22:19:21.105461+0000","last_unstale":"2024-08-18T22:19:26.345049+0000","last_undegraded":"2024-08-18T22:19:26.345049+0000","last_fullsized":"2024-08-18T22:19:26.345049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:32.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407990+0000","last_change":"2024-08-18T22:19:20.122400+0000","last_active":"2024-08-18T22:19:27.407990+0000","last_peered":"2024-08-18T22:19:27.407990+0000","last_clean":"2024-08-18T22:19:27.407990+0000","last_became_active":"2024-08-18T22:19:20.121947+0000","last_became_peered":"2024-08-18T22:19:20.121947+0000","last_unstale":"2024-08-18T22:19:27.407990+0000","last_undegraded":"2024-08-18T22:19:27.407990+0000","last_fullsized":"2024-08-18T22:19:27.407990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:02.877029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344547+0000","last_change":"2024-08-18T22:19:25.372065+0000","last_active":"2024-08-18T22:19:26.344547+0000","last_peered":"2024-08-18T22:19:26.344547+0000","last_clean":"2024-08-18T22:19:26.344547+0000","last_became_active":"2024-08-18T22:19:25.371835+0000","last_became_peered":"2024-08-18T22:19:25.371835+0000","last_unstale":"2024-08-18T22:19:26.344547+0000","last_undegraded":"2024-08-18T22:19:26.344547+0000","last_fullsized":"2024-08-18T22:19:26.344547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:04:21.012114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409247+0000","last_change":"2024-08-18T22:19:21.138068+0000","last_active":"2024-08-18T22:19:27.409247+0000","last_peered":"2024-08-18T22:19:27.409247+0000","last_clean":"2024-08-18T22:19:27.409247+0000","last_became_active":"2024-08-18T22:19:21.132915+0000","last_became_peered":"2024-08-18T22:19:21.132915+0000","last_unstale":"2024-08-18T22:19:27.409247+0000","last_undegraded":"2024-08-18T22:19:27.409247+0000","last_fullsized":"2024-08-18T22:19:27.409247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336025+0000","last_change":"2024-08-18T22:19:20.127698+0000","last_active":"2024-08-18T22:19:27.336025+0000","last_peered":"2024-08-18T22:19:27.336025+0000","last_clean":"2024-08-18T22:19:27.336025+0000","last_became_active":"2024-08-18T22:19:20.127488+0000","last_became_peered":"2024-08-18T22:19:20.127488+0000","last_unstale":"2024-08-18T22:19:27.336025+0000","last_undegraded":"2024-08-18T22:19:27.336025+0000","last_fullsized":"2024-08-18T22:19:27.336025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041133+0000","last_change":"2024-08-18T22:19:25.365048+0000","last_active":"2024-08-18T22:19:27.041133+0000","last_peered":"2024-08-18T22:19:27.041133+0000","last_clean":"2024-08-18T22:19:27.041133+0000","last_became_active":"2024-08-18T22:19:25.364597+0000","last_became_peered":"2024-08-18T22:19:25.364597+0000","last_unstale":"2024-08-18T22:19:27.041133+0000","last_undegraded":"2024-08-18T22:19:27.041133+0000","last_fullsized":"2024-08-18T22:19:27.041133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:37.692476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336018+0000","last_change":"2024-08-18T22:19:21.130941+0000","last_active":"2024-08-18T22:19:27.336018+0000","last_peered":"2024-08-18T22:19:27.336018+0000","last_clean":"2024-08-18T22:19:27.336018+0000","last_became_active":"2024-08-18T22:19:21.130617+0000","last_became_peered":"2024-08-18T22:19:21.130617+0000","last_unstale":"2024-08-18T22:19:27.336018+0000","last_undegraded":"2024-08-18T22:19:27.336018+0000","last_fullsized":"2024-08-18T22:19:27.336018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:06.594373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344569+0000","last_change":"2024-08-18T22:19:20.124348+0000","last_active":"2024-08-18T22:19:26.344569+0000","last_peered":"2024-08-18T22:19:26.344569+0000","last_clean":"2024-08-18T22:19:26.344569+0000","last_became_active":"2024-08-18T22:19:20.123971+0000","last_became_peered":"2024-08-18T22:19:20.123971+0000","last_unstale":"2024-08-18T22:19:26.344569+0000","last_undegraded":"2024-08-18T22:19:26.344569+0000","last_fullsized":"2024-08-18T22:19:26.344569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041200+0000","last_change":"2024-08-18T22:19:25.364746+0000","last_active":"2024-08-18T22:19:27.041200+0000","last_peered":"2024-08-18T22:19:27.041200+0000","last_clean":"2024-08-18T22:19:27.041200+0000","last_became_active":"2024-08-18T22:19:25.364332+0000","last_became_peered":"2024-08-18T22:19:25.364332+0000","last_unstale":"2024-08-18T22:19:27.041200+0000","last_undegraded":"2024-08-18T22:19:27.041200+0000","last_fullsized":"2024-08-18T22:19:27.041200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:13.150322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408896+0000","last_change":"2024-08-18T22:19:25.380247+0000","last_active":"2024-08-18T22:19:27.408896+0000","last_peered":"2024-08-18T22:19:27.408896+0000","last_clean":"2024-08-18T22:19:27.408896+0000","last_became_active":"2024-08-18T22:19:25.376751+0000","last_became_peered":"2024-08-18T22:19:25.376751+0000","last_unstale":"2024-08-18T22:19:27.408896+0000","last_undegraded":"2024-08-18T22:19:27.408896+0000","last_fullsized":"2024-08-18T22:19:27.408896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:30.299592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406771+0000","last_change":"2024-08-18T22:19:21.118219+0000","last_active":"2024-08-18T22:19:27.406771+0000","last_peered":"2024-08-18T22:19:27.406771+0000","last_clean":"2024-08-18T22:19:27.406771+0000","last_became_active":"2024-08-18T22:19:21.117904+0000","last_became_peered":"2024-08-18T22:19:21.117904+0000","last_unstale":"2024-08-18T22:19:27.406771+0000","last_undegraded":"2024-08-18T22:19:27.406771+0000","last_fullsized":"2024-08-18T22:19:27.406771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335657+0000","last_change":"2024-08-18T22:19:20.113456+0000","last_active":"2024-08-18T22:19:27.335657+0000","last_peered":"2024-08-18T22:19:27.335657+0000","last_clean":"2024-08-18T22:19:27.335657+0000","last_became_active":"2024-08-18T22:19:20.113170+0000","last_became_peered":"2024-08-18T22:19:20.113170+0000","last_unstale":"2024-08-18T22:19:27.335657+0000","last_undegraded":"2024-08-18T22:19:27.335657+0000","last_fullsized":"2024-08-18T22:19:27.335657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344445+0000","last_change":"2024-08-18T22:19:25.362236+0000","last_active":"2024-08-18T22:19:26.344445+0000","last_peered":"2024-08-18T22:19:26.344445+0000","last_clean":"2024-08-18T22:19:26.344445+0000","last_became_active":"2024-08-18T22:19:25.361968+0000","last_became_peered":"2024-08-18T22:19:25.361968+0000","last_unstale":"2024-08-18T22:19:26.344445+0000","last_undegraded":"2024-08-18T22:19:26.344445+0000","last_fullsized":"2024-08-18T22:19:26.344445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:49.056286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040927+0000","last_change":"2024-08-18T22:19:21.142319+0000","last_active":"2024-08-18T22:19:27.040927+0000","last_peered":"2024-08-18T22:19:27.040927+0000","last_clean":"2024-08-18T22:19:27.040927+0000","last_became_active":"2024-08-18T22:19:21.142023+0000","last_became_peered":"2024-08-18T22:19:21.142023+0000","last_unstale":"2024-08-18T22:19:27.040927+0000","last_undegraded":"2024-08-18T22:19:27.040927+0000","last_fullsized":"2024-08-18T22:19:27.040927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040827+0000","last_change":"2024-08-18T22:19:20.126010+0000","last_active":"2024-08-18T22:19:27.040827+0000","last_peered":"2024-08-18T22:19:27.040827+0000","last_clean":"2024-08-18T22:19:27.040827+0000","last_became_active":"2024-08-18T22:19:20.125768+0000","last_became_peered":"2024-08-18T22:19:20.125768+0000","last_unstale":"2024-08-18T22:19:27.040827+0000","last_undegraded":"2024-08-18T22:19:27.040827+0000","last_fullsized":"2024-08-18T22:19:27.040827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:09.183754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342628+0000","last_change":"2024-08-18T22:19:20.118969+0000","last_active":"2024-08-18T22:19:26.342628+0000","last_peered":"2024-08-18T22:19:26.342628+0000","last_clean":"2024-08-18T22:19:26.342628+0000","last_became_active":"2024-08-18T22:19:20.118686+0000","last_became_peered":"2024-08-18T22:19:20.118686+0000","last_unstale":"2024-08-18T22:19:26.342628+0000","last_undegraded":"2024-08-18T22:19:26.342628+0000","last_fullsized":"2024-08-18T22:19:26.342628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408624+0000","last_change":"2024-08-18T22:19:21.138371+0000","last_active":"2024-08-18T22:19:27.408624+0000","last_peered":"2024-08-18T22:19:27.408624+0000","last_clean":"2024-08-18T22:19:27.408624+0000","last_became_active":"2024-08-18T22:19:21.138042+0000","last_became_peered":"2024-08-18T22:19:21.138042+0000","last_unstale":"2024-08-18T22:19:27.408624+0000","last_undegraded":"2024-08-18T22:19:27.408624+0000","last_fullsized":"2024-08-18T22:19:27.408624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406977+0000","last_change":"2024-08-18T22:19:25.377063+0000","last_active":"2024-08-18T22:19:27.406977+0000","last_peered":"2024-08-18T22:19:27.406977+0000","last_clean":"2024-08-18T22:19:27.406977+0000","last_became_active":"2024-08-18T22:19:25.376639+0000","last_became_peered":"2024-08-18T22:19:25.376639+0000","last_unstale":"2024-08-18T22:19:27.406977+0000","last_undegraded":"2024-08-18T22:19:27.406977+0000","last_fullsized":"2024-08-18T22:19:27.406977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:43.985709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041089+0000","last_change":"2024-08-18T22:19:20.129285+0000","last_active":"2024-08-18T22:19:27.041089+0000","last_peered":"2024-08-18T22:19:27.041089+0000","last_clean":"2024-08-18T22:19:27.041089+0000","last_became_active":"2024-08-18T22:19:20.129024+0000","last_became_peered":"2024-08-18T22:19:20.129024+0000","last_unstale":"2024-08-18T22:19:27.041089+0000","last_undegraded":"2024-08-18T22:19:27.041089+0000","last_fullsized":"2024-08-18T22:19:27.041089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344339+0000","last_change":"2024-08-18T22:19:21.102815+0000","last_active":"2024-08-18T22:19:26.344339+0000","last_peered":"2024-08-18T22:19:26.344339+0000","last_clean":"2024-08-18T22:19:26.344339+0000","last_became_active":"2024-08-18T22:19:21.102382+0000","last_became_peered":"2024-08-18T22:19:21.102382+0000","last_unstale":"2024-08-18T22:19:26.344339+0000","last_undegraded":"2024-08-18T22:19:26.344339+0000","last_fullsized":"2024-08-18T22:19:26.344339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:41.157892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041004+0000","last_change":"2024-08-18T22:19:25.365329+0000","last_active":"2024-08-18T22:19:27.041004+0000","last_peered":"2024-08-18T22:19:27.041004+0000","last_clean":"2024-08-18T22:19:27.041004+0000","last_became_active":"2024-08-18T22:19:25.364915+0000","last_became_peered":"2024-08-18T22:19:25.364915+0000","last_unstale":"2024-08-18T22:19:27.041004+0000","last_undegraded":"2024-08-18T22:19:27.041004+0000","last_fullsized":"2024-08-18T22:19:27.041004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:19:12.438973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342040+0000","last_change":"2024-08-18T22:19:21.137071+0000","last_active":"2024-08-18T22:19:26.342040+0000","last_peered":"2024-08-18T22:19:26.342040+0000","last_clean":"2024-08-18T22:19:26.342040+0000","last_became_active":"2024-08-18T22:19:21.136814+0000","last_became_peered":"2024-08-18T22:19:21.136814+0000","last_unstale":"2024-08-18T22:19:26.342040+0000","last_undegraded":"2024-08-18T22:19:26.342040+0000","last_fullsized":"2024-08-18T22:19:26.342040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406646+0000","last_change":"2024-08-18T22:19:21.118314+0000","last_active":"2024-08-18T22:19:27.406646+0000","last_peered":"2024-08-18T22:19:27.406646+0000","last_clean":"2024-08-18T22:19:27.406646+0000","last_became_active":"2024-08-18T22:19:21.117946+0000","last_became_peered":"2024-08-18T22:19:21.117946+0000","last_unstale":"2024-08-18T22:19:27.406646+0000","last_undegraded":"2024-08-18T22:19:27.406646+0000","last_fullsized":"2024-08-18T22:19:27.406646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:32.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335679+0000","last_change":"2024-08-18T22:19:21.126438+0000","last_active":"2024-08-18T22:19:27.335679+0000","last_peered":"2024-08-18T22:19:27.335679+0000","last_clean":"2024-08-18T22:19:27.335679+0000","last_became_active":"2024-08-18T22:19:21.125111+0000","last_became_peered":"2024-08-18T22:19:21.125111+0000","last_unstale":"2024-08-18T22:19:27.335679+0000","last_undegraded":"2024-08-18T22:19:27.335679+0000","last_fullsized":"2024-08-18T22:19:27.335679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:25:04.876293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408577+0000","last_change":"2024-08-18T22:19:21.127359+0000","last_active":"2024-08-18T22:19:27.408577+0000","last_peered":"2024-08-18T22:19:27.408577+0000","last_clean":"2024-08-18T22:19:27.408577+0000","last_became_active":"2024-08-18T22:19:21.126860+0000","last_became_peered":"2024-08-18T22:19:21.126860+0000","last_unstale":"2024-08-18T22:19:27.408577+0000","last_undegraded":"2024-08-18T22:19:27.408577+0000","last_fullsized":"2024-08-18T22:19:27.408577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041266+0000","last_change":"2024-08-18T22:19:21.132232+0000","last_active":"2024-08-18T22:19:27.041266+0000","last_peered":"2024-08-18T22:19:27.041266+0000","last_clean":"2024-08-18T22:19:27.041266+0000","last_became_active":"2024-08-18T22:19:21.131969+0000","last_became_peered":"2024-08-18T22:19:21.131969+0000","last_unstale":"2024-08-18T22:19:27.041266+0000","last_undegraded":"2024-08-18T22:19:27.041266+0000","last_fullsized":"2024-08-18T22:19:27.041266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:25:04.876293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407601+0000","last_change":"2024-08-18T22:19:21.116405+0000","last_active":"2024-08-18T22:19:27.407601+0000","last_peered":"2024-08-18T22:19:27.407601+0000","last_clean":"2024-08-18T22:19:27.407601+0000","last_became_active":"2024-08-18T22:19:21.116134+0000","last_became_peered":"2024-08-18T22:19:21.116134+0000","last_unstale":"2024-08-18T22:19:27.407601+0000","last_undegraded":"2024-08-18T22:19:27.407601+0000","last_fullsized":"2024-08-18T22:19:27.407601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344310+0000","last_change":"2024-08-18T22:19:21.119475+0000","last_active":"2024-08-18T22:19:26.344310+0000","last_peered":"2024-08-18T22:19:26.344310+0000","last_clean":"2024-08-18T22:19:26.344310+0000","last_became_active":"2024-08-18T22:19:21.118733+0000","last_became_peered":"2024-08-18T22:19:21.118733+0000","last_unstale":"2024-08-18T22:19:26.344310+0000","last_undegraded":"2024-08-18T22:19:26.344310+0000","last_fullsized":"2024-08-18T22:19:26.344310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041220+0000","last_change":"2024-08-18T22:19:21.130398+0000","last_active":"2024-08-18T22:19:27.041220+0000","last_peered":"2024-08-18T22:19:27.041220+0000","last_clean":"2024-08-18T22:19:27.041220+0000","last_became_active":"2024-08-18T22:19:21.130131+0000","last_became_peered":"2024-08-18T22:19:21.130131+0000","last_unstale":"2024-08-18T22:19:27.041220+0000","last_undegraded":"2024-08-18T22:19:27.041220+0000","last_fullsized":"2024-08-18T22:19:27.041220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335536+0000","last_change":"2024-08-18T22:19:21.127403+0000","last_active":"2024-08-18T22:19:27.335536+0000","last_peered":"2024-08-18T22:19:27.335536+0000","last_clean":"2024-08-18T22:19:27.335536+0000","last_became_active":"2024-08-18T22:19:21.125489+0000","last_became_peered":"2024-08-18T22:19:21.125489+0000","last_unstale":"2024-08-18T22:19:27.335536+0000","last_undegraded":"2024-08-18T22:19:27.335536+0000","last_fullsized":"2024-08-18T22:19:27.335536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:44.820166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040656+0000","last_change":"2024-08-18T22:19:21.119217+0000","last_active":"2024-08-18T22:19:27.040656+0000","last_peered":"2024-08-18T22:19:27.040656+0000","last_clean":"2024-08-18T22:19:27.040656+0000","last_became_active":"2024-08-18T22:19:21.118867+0000","last_became_peered":"2024-08-18T22:19:21.118867+0000","last_unstale":"2024-08-18T22:19:27.040656+0000","last_undegraded":"2024-08-18T22:19:27.040656+0000","last_fullsized":"2024-08-18T22:19:27.040656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335670+0000","last_change":"2024-08-18T22:19:21.131453+0000","last_active":"2024-08-18T22:19:27.335670+0000","last_peered":"2024-08-18T22:19:27.335670+0000","last_clean":"2024-08-18T22:19:27.335670+0000","last_became_active":"2024-08-18T22:19:21.131186+0000","last_became_peered":"2024-08-18T22:19:21.131186+0000","last_unstale":"2024-08-18T22:19:27.335670+0000","last_undegraded":"2024-08-18T22:19:27.335670+0000","last_fullsized":"2024-08-18T22:19:27.335670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:43.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408516+0000","last_change":"2024-08-18T22:19:21.133703+0000","last_active":"2024-08-18T22:19:27.408516+0000","last_peered":"2024-08-18T22:19:27.408516+0000","last_clean":"2024-08-18T22:19:27.408516+0000","last_became_active":"2024-08-18T22:19:21.129639+0000","last_became_peered":"2024-08-18T22:19:21.129639+0000","last_unstale":"2024-08-18T22:19:27.408516+0000","last_undegraded":"2024-08-18T22:19:27.408516+0000","last_fullsized":"2024-08-18T22:19:27.408516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342954+0000","last_change":"2024-08-18T22:19:21.119313+0000","last_active":"2024-08-18T22:19:26.342954+0000","last_peered":"2024-08-18T22:19:26.342954+0000","last_clean":"2024-08-18T22:19:26.342954+0000","last_became_active":"2024-08-18T22:19:21.119038+0000","last_became_peered":"2024-08-18T22:19:21.119038+0000","last_unstale":"2024-08-18T22:19:26.342954+0000","last_undegraded":"2024-08-18T22:19:26.342954+0000","last_fullsized":"2024-08-18T22:19:26.342954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345508+0000","last_change":"2024-08-18T22:19:21.123284+0000","last_active":"2024-08-18T22:19:26.345508+0000","last_peered":"2024-08-18T22:19:26.345508+0000","last_clean":"2024-08-18T22:19:26.345508+0000","last_became_active":"2024-08-18T22:19:21.123041+0000","last_became_peered":"2024-08-18T22:19:21.123041+0000","last_unstale":"2024-08-18T22:19:26.345508+0000","last_undegraded":"2024-08-18T22:19:26.345508+0000","last_fullsized":"2024-08-18T22:19:26.345508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:10.870419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408041+0000","last_change":"2024-08-18T22:19:21.120385+0000","last_active":"2024-08-18T22:19:27.408041+0000","last_peered":"2024-08-18T22:19:27.408041+0000","last_clean":"2024-08-18T22:19:27.408041+0000","last_became_active":"2024-08-18T22:19:21.119998+0000","last_became_peered":"2024-08-18T22:19:21.119998+0000","last_unstale":"2024-08-18T22:19:27.408041+0000","last_undegraded":"2024-08-18T22:19:27.408041+0000","last_fullsized":"2024-08-18T22:19:27.408041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:30.321238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336261+0000","last_change":"2024-08-18T22:19:21.131891+0000","last_active":"2024-08-18T22:19:27.336261+0000","last_peered":"2024-08-18T22:19:27.336261+0000","last_clean":"2024-08-18T22:19:27.336261+0000","last_became_active":"2024-08-18T22:19:21.131589+0000","last_became_peered":"2024-08-18T22:19:21.131589+0000","last_unstale":"2024-08-18T22:19:27.336261+0000","last_undegraded":"2024-08-18T22:19:27.336261+0000","last_fullsized":"2024-08-18T22:19:27.336261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:26.063472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335381+0000","last_change":"2024-08-18T22:19:21.126883+0000","last_active":"2024-08-18T22:19:27.335381+0000","last_peered":"2024-08-18T22:19:27.335381+0000","last_clean":"2024-08-18T22:19:27.335381+0000","last_became_active":"2024-08-18T22:19:21.126532+0000","last_became_peered":"2024-08-18T22:19:21.126532+0000","last_unstale":"2024-08-18T22:19:27.335381+0000","last_undegraded":"2024-08-18T22:19:27.335381+0000","last_fullsized":"2024-08-18T22:19:27.335381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406798+0000","last_change":"2024-08-18T22:19:21.105560+0000","last_active":"2024-08-18T22:19:27.406798+0000","last_peered":"2024-08-18T22:19:27.406798+0000","last_clean":"2024-08-18T22:19:27.406798+0000","last_became_active":"2024-08-18T22:19:21.105275+0000","last_became_peered":"2024-08-18T22:19:21.105275+0000","last_unstale":"2024-08-18T22:19:27.406798+0000","last_undegraded":"2024-08-18T22:19:27.406798+0000","last_fullsized":"2024-08-18T22:19:27.406798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408404+0000","last_change":"2024-08-18T22:19:21.131750+0000","last_active":"2024-08-18T22:19:27.408404+0000","last_peered":"2024-08-18T22:19:27.408404+0000","last_clean":"2024-08-18T22:19:27.408404+0000","last_became_active":"2024-08-18T22:19:21.131476+0000","last_became_peered":"2024-08-18T22:19:21.131476+0000","last_unstale":"2024-08-18T22:19:27.408404+0000","last_undegraded":"2024-08-18T22:19:27.408404+0000","last_fullsized":"2024-08-18T22:19:27.408404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:14.137945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040778+0000","last_change":"2024-08-18T22:19:21.137226+0000","last_active":"2024-08-18T22:19:27.040778+0000","last_peered":"2024-08-18T22:19:27.040778+0000","last_clean":"2024-08-18T22:19:27.040778+0000","last_became_active":"2024-08-18T22:19:21.136916+0000","last_became_peered":"2024-08-18T22:19:21.136916+0000","last_unstale":"2024-08-18T22:19:27.040778+0000","last_undegraded":"2024-08-18T22:19:27.040778+0000","last_fullsized":"2024-08-18T22:19:27.040778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344977+0000","last_change":"2024-08-18T22:19:21.122084+0000","last_active":"2024-08-18T22:19:26.344977+0000","last_peered":"2024-08-18T22:19:26.344977+0000","last_clean":"2024-08-18T22:19:26.344977+0000","last_became_active":"2024-08-18T22:19:21.121814+0000","last_became_peered":"2024-08-18T22:19:21.121814+0000","last_unstale":"2024-08-18T22:19:26.344977+0000","last_undegraded":"2024-08-18T22:19:26.344977+0000","last_fullsized":"2024-08-18T22:19:26.344977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:03.691264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343684+0000","last_change":"2024-08-18T22:19:21.118724+0000","last_active":"2024-08-18T22:19:26.343684+0000","last_peered":"2024-08-18T22:19:26.343684+0000","last_clean":"2024-08-18T22:19:26.343684+0000","last_became_active":"2024-08-18T22:19:21.118432+0000","last_became_peered":"2024-08-18T22:19:21.118432+0000","last_unstale":"2024-08-18T22:19:26.343684+0000","last_undegraded":"2024-08-18T22:19:26.343684+0000","last_fullsized":"2024-08-18T22:19:26.343684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344215+0000","last_change":"2024-08-18T22:19:21.119771+0000","last_active":"2024-08-18T22:19:26.344215+0000","last_peered":"2024-08-18T22:19:26.344215+0000","last_clean":"2024-08-18T22:19:26.344215+0000","last_became_active":"2024-08-18T22:19:21.119089+0000","last_became_peered":"2024-08-18T22:19:21.119089+0000","last_unstale":"2024-08-18T22:19:26.344215+0000","last_undegraded":"2024-08-18T22:19:26.344215+0000","last_fullsized":"2024-08-18T22:19:26.344215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345907+0000","last_change":"2024-08-18T22:19:21.116013+0000","last_active":"2024-08-18T22:19:26.345907+0000","last_peered":"2024-08-18T22:19:26.345907+0000","last_clean":"2024-08-18T22:19:26.345907+0000","last_became_active":"2024-08-18T22:19:21.115692+0000","last_became_peered":"2024-08-18T22:19:21.115692+0000","last_unstale":"2024-08-18T22:19:26.345907+0000","last_undegraded":"2024-08-18T22:19:26.345907+0000","last_fullsized":"2024-08-18T22:19:26.345907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:17.605306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040584+0000","last_change":"2024-08-18T22:19:21.121713+0000","last_active":"2024-08-18T22:19:27.040584+0000","last_peered":"2024-08-18T22:19:27.040584+0000","last_clean":"2024-08-18T22:19:27.040584+0000","last_became_active":"2024-08-18T22:19:21.121200+0000","last_became_peered":"2024-08-18T22:19:21.121200+0000","last_unstale":"2024-08-18T22:19:27.040584+0000","last_undegraded":"2024-08-18T22:19:27.040584+0000","last_fullsized":"2024-08-18T22:19:27.040584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344491+0000","last_change":"2024-08-18T22:19:21.129242+0000","last_active":"2024-08-18T22:19:26.344491+0000","last_peered":"2024-08-18T22:19:26.344491+0000","last_clean":"2024-08-18T22:19:26.344491+0000","last_became_active":"2024-08-18T22:19:21.128914+0000","last_became_peered":"2024-08-18T22:19:21.128914+0000","last_unstale":"2024-08-18T22:19:26.344491+0000","last_undegraded":"2024-08-18T22:19:26.344491+0000","last_fullsized":"2024-08-18T22:19:26.344491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:06.594373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335443+0000","last_change":"2024-08-18T22:19:21.136266+0000","last_active":"2024-08-18T22:19:27.335443+0000","last_peered":"2024-08-18T22:19:27.335443+0000","last_clean":"2024-08-18T22:19:27.335443+0000","last_became_active":"2024-08-18T22:19:21.135968+0000","last_became_peered":"2024-08-18T22:19:21.135968+0000","last_unstale":"2024-08-18T22:19:27.335443+0000","last_undegraded":"2024-08-18T22:19:27.335443+0000","last_fullsized":"2024-08-18T22:19:27.335443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345760+0000","last_change":"2024-08-18T22:19:21.115212+0000","last_active":"2024-08-18T22:19:26.345760+0000","last_peered":"2024-08-18T22:19:26.345760+0000","last_clean":"2024-08-18T22:19:26.345760+0000","last_became_active":"2024-08-18T22:19:21.114910+0000","last_became_peered":"2024-08-18T22:19:21.114910+0000","last_unstale":"2024-08-18T22:19:26.345760+0000","last_undegraded":"2024-08-18T22:19:26.345760+0000","last_fullsized":"2024-08-18T22:19:26.345760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:38.186074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335755+0000","last_change":"2024-08-18T22:19:21.127871+0000","last_active":"2024-08-18T22:19:27.335755+0000","last_peered":"2024-08-18T22:19:27.335755+0000","last_clean":"2024-08-18T22:19:27.335755+0000","last_became_active":"2024-08-18T22:19:21.126869+0000","last_became_peered":"2024-08-18T22:19:21.126869+0000","last_unstale":"2024-08-18T22:19:27.335755+0000","last_undegraded":"2024-08-18T22:19:27.335755+0000","last_fullsized":"2024-08-18T22:19:27.335755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:20.765001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408844+0000","last_change":"2024-08-18T22:19:21.131385+0000","last_active":"2024-08-18T22:19:27.408844+0000","last_peered":"2024-08-18T22:19:27.408844+0000","last_clean":"2024-08-18T22:19:27.408844+0000","last_became_active":"2024-08-18T22:19:21.131082+0000","last_became_peered":"2024-08-18T22:19:21.131082+0000","last_unstale":"2024-08-18T22:19:27.408844+0000","last_undegraded":"2024-08-18T22:19:27.408844+0000","last_fullsized":"2024-08-18T22:19:27.408844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408484+0000","last_change":"2024-08-18T22:19:21.136779+0000","last_active":"2024-08-18T22:19:27.408484+0000","last_peered":"2024-08-18T22:19:27.408484+0000","last_clean":"2024-08-18T22:19:27.408484+0000","last_became_active":"2024-08-18T22:19:21.136340+0000","last_became_peered":"2024-08-18T22:19:21.136340+0000","last_unstale":"2024-08-18T22:19:27.408484+0000","last_undegraded":"2024-08-18T22:19:27.408484+0000","last_fullsized":"2024-08-18T22:19:27.408484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345776+0000","last_change":"2024-08-18T22:19:21.122413+0000","last_active":"2024-08-18T22:19:26.345776+0000","last_peered":"2024-08-18T22:19:26.345776+0000","last_clean":"2024-08-18T22:19:26.345776+0000","last_became_active":"2024-08-18T22:19:21.122038+0000","last_became_peered":"2024-08-18T22:19:21.122038+0000","last_unstale":"2024-08-18T22:19:26.345776+0000","last_undegraded":"2024-08-18T22:19:26.345776+0000","last_fullsized":"2024-08-18T22:19:26.345776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:30:09.265589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":102159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":102229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":693075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:19:47.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:19:47.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.418+0000 7f9d56e00640 1 Processor -- start 2024-08-18T22:19:47.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.418+0000 7f9d56e00640 1 -- start start 2024-08-18T22:19:47.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.422+0000 7f9d56e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d500cb390 0x7f9d500735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.422+0000 7f9d56e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d50073c80 con 0x7f9d5015bed0 2024-08-18T22:19:47.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.422+0000 7f9d56e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d500ca5d0 con 0x7f9d5006da70 2024-08-18T22:19:47.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.422+0000 7f9d56e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9d500ca8b0 con 0x7f9d500cb390 2024-08-18T22:19:47.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.422+0000 7f9d4fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9d5015bed0 0x7f9d50071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38724/0 (socket says 172.21.15.5:38724) 2024-08-18T22:19:47.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.422+0000 7f9d47400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d500cb390 0x7f9d500735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.422+0000 7f9d4fe00640 1 -- 172.21.15.5:0/4178235723 learned_addr learned my addr 172.21.15.5:0/4178235723 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:47.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.422+0000 7f9d47400640 1 -- 172.21.15.5:0/4178235723 >> v1:172.21.15.117:6789/0 conn(0x7f9d5006da70 legacy=0x7f9d50165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:47.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.422+0000 7f9d47400640 1 -- 172.21.15.5:0/4178235723 >> v1:172.21.15.5:6789/0 conn(0x7f9d5015bed0 legacy=0x7f9d50071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.422+0000 7f9d47400640 1 -- 172.21.15.5:0/4178235723 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d500cab90 con 0x7f9d500cb390 2024-08-18T22:19:47.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.422+0000 7f9d4f400640 1 -- 172.21.15.5:0/4178235723 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660550253 0 0) 0x7f9d50073c80 con 0x7f9d5015bed0 2024-08-18T22:19:47.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d47400640 1 --2- 172.21.15.5:0/4178235723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d500cb390 0x7f9d500735a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009d90 tx=0x7f9d3801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6bd676e3ec9def server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:47.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d4f400640 1 -- 172.21.15.5:0/4178235723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d380b2070 con 0x7f9d500cb390 2024-08-18T22:19:47.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d4f400640 1 -- 172.21.15.5:0/4178235723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d380a59e0 con 0x7f9d500cb390 2024-08-18T22:19:47.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d4f400640 1 -- 172.21.15.5:0/4178235723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d380a5db0 con 0x7f9d500cb390 2024-08-18T22:19:47.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 -- 172.21.15.5:0/4178235723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d500cb390 msgr2=0x7f9d500735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 --2- 172.21.15.5:0/4178235723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d500cb390 0x7f9d500735a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009d90 tx=0x7f9d3801c900 comp rx=0 tx=0).stop 2024-08-18T22:19:47.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 -- 172.21.15.5:0/4178235723 shutdown_connections 2024-08-18T22:19:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 --2- 172.21.15.5:0/4178235723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d500cb390 0x7f9d500735a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 -- 172.21.15.5:0/4178235723 >> 172.21.15.5:0/4178235723 conn(0x7f9d500b1c50 msgr2=0x7f9d500b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 -- 172.21.15.5:0/4178235723 shutdown_connections 2024-08-18T22:19:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 -- 172.21.15.5:0/4178235723 wait complete. 2024-08-18T22:19:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 Processor -- start 2024-08-18T22:19:47.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 -- start start 2024-08-18T22:19:47.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5006da70 0x7f9d50153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d500cb390 0x7f9d5009cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5015bed0 0x7f9d501516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9d50169c40 con 0x7f9d5015bed0 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9d50169ac0 con 0x7f9d5006da70 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d56e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9d50169dc0 con 0x7f9d500cb390 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d54e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5015bed0 0x7f9d501516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d54e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5015bed0 0x7f9d501516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40728/0 (socket says 172.21.15.5:40728) 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.426+0000 7f9d54e00640 1 -- 172.21.15.5:0/1833977881 learned_addr learned my addr 172.21.15.5:0/1833977881 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d4fe00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5006da70 0x7f9d50153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d47400640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d500cb390 0x7f9d5009cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d54e00640 1 -- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d500cb390 msgr2=0x7f9d5009cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d54e00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d500cb390 0x7f9d5009cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d54e00640 1 -- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5006da70 msgr2=0x7f9d50153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d54e00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5006da70 0x7f9d50153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d54e00640 1 -- 172.21.15.5:0/1833977881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d500b3dd0 con 0x7f9d5015bed0 2024-08-18T22:19:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d4fe00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5006da70 0x7f9d50153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d54e00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5015bed0 0x7f9d501516f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c3c0 tx=0x7f9d4800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d4cc00640 1 -- 172.21.15.5:0/1833977881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48011790 con 0x7f9d5015bed0 2024-08-18T22:19:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d4cc00640 1 -- 172.21.15.5:0/1833977881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d48017070 con 0x7f9d5015bed0 2024-08-18T22:19:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d56e00640 1 -- 172.21.15.5:0/1833977881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5009abe0 con 0x7f9d5015bed0 2024-08-18T22:19:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d4cc00640 1 -- 172.21.15.5:0/1833977881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48011b70 con 0x7f9d5015bed0 2024-08-18T22:19:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d56e00640 1 -- 172.21.15.5:0/1833977881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5009d430 con 0x7f9d5015bed0 2024-08-18T22:19:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d56e00640 1 -- 172.21.15.5:0/1833977881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d500735a0 con 0x7f9d5015bed0 2024-08-18T22:19:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d4cc00640 1 -- 172.21.15.5:0/1833977881 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d48011d10 con 0x7f9d5015bed0 2024-08-18T22:19:47.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d4cc00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d2c0678c0 0x7f9d2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d4cc00640 1 -- 172.21.15.5:0/1833977881 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9d48085e10 con 0x7f9d5015bed0 2024-08-18T22:19:47.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.430+0000 7f9d4fe00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d2c0678c0 0x7f9d2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.434+0000 7f9d4fe00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d2c0678c0 0x7f9d2c069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9d40000f70 tx=0x7f9d40007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:47.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.434+0000 7f9d4cc00640 1 -- 172.21.15.5:0/1833977881 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9d48089030 con 0x7f9d5015bed0 2024-08-18T22:19:47.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.598+0000 7f9d56e00640 1 -- 172.21.15.5:0/1833977881 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d500cc4f0 con 0x7f9d2c0678c0 2024-08-18T22:19:47.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d4cc00640 1 -- 172.21.15.5:0/1833977881 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f9d500cc4f0 con 0x7f9d2c0678c0 2024-08-18T22:19:47.615 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:47.617 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:19:47.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 -- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d2c0678c0 msgr2=0x7f9d2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d2c0678c0 0x7f9d2c069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9d40000f70 tx=0x7f9d40007cb0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 -- 172.21.15.5:0/1833977881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5015bed0 msgr2=0x7f9d501516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5015bed0 0x7f9d501516f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c3c0 tx=0x7f9d4800c880 comp rx=0 tx=0).stop 2024-08-18T22:19:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 -- 172.21.15.5:0/1833977881 shutdown_connections 2024-08-18T22:19:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d2c0678c0 0x7f9d2c069d80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d5015bed0 0x7f9d501516f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d500cb390 0x7f9d5009cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 --2- 172.21.15.5:0/1833977881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d5006da70 0x7f9d50153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 -- 172.21.15.5:0/1833977881 >> 172.21.15.5:0/1833977881 conn(0x7f9d500b1c50 msgr2=0x7f9d500b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 -- 172.21.15.5:0/1833977881 shutdown_connections 2024-08-18T22:19:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.610+0000 7f9d56e00640 1 -- 172.21.15.5:0/1833977881 wait complete. 2024-08-18T22:19:47.637 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-08-18T22:19:45.623672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231896,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742824,"statfs":{"total":773094113280,"available":772856651776,"internally_reserved":0,"allocated":3317760,"data_stored":2006566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003241"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409284+0000","last_change":"2024-08-18T22:19:20.123479+0000","last_active":"2024-08-18T22:19:27.409284+0000","last_peered":"2024-08-18T22:19:27.409284+0000","last_clean":"2024-08-18T22:19:27.409284+0000","last_became_active":"2024-08-18T22:19:20.122186+0000","last_became_peered":"2024-08-18T22:19:20.122186+0000","last_unstale":"2024-08-18T22:19:27.409284+0000","last_undegraded":"2024-08-18T22:19:27.409284+0000","last_fullsized":"2024-08-18T22:19:27.409284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:43.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040942+0000","last_change":"2024-08-18T22:19:21.129646+0000","last_active":"2024-08-18T22:19:27.040942+0000","last_peered":"2024-08-18T22:19:27.040942+0000","last_clean":"2024-08-18T22:19:27.040942+0000","last_became_active":"2024-08-18T22:19:21.129335+0000","last_became_peered":"2024-08-18T22:19:21.129335+0000","last_unstale":"2024-08-18T22:19:27.040942+0000","last_undegraded":"2024-08-18T22:19:27.040942+0000","last_fullsized":"2024-08-18T22:19:27.040942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:43.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040525+0000","last_change":"2024-08-18T22:19:25.367940+0000","last_active":"2024-08-18T22:19:27.040525+0000","last_peered":"2024-08-18T22:19:27.040525+0000","last_clean":"2024-08-18T22:19:27.040525+0000","last_became_active":"2024-08-18T22:19:25.367535+0000","last_became_peered":"2024-08-18T22:19:25.367535+0000","last_unstale":"2024-08-18T22:19:27.040525+0000","last_undegraded":"2024-08-18T22:19:27.040525+0000","last_fullsized":"2024-08-18T22:19:27.040525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:01.102831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041348+0000","last_change":"2024-08-18T22:19:20.124507+0000","last_active":"2024-08-18T22:19:27.041348+0000","last_peered":"2024-08-18T22:19:27.041348+0000","last_clean":"2024-08-18T22:19:27.041348+0000","last_became_active":"2024-08-18T22:19:20.124250+0000","last_became_peered":"2024-08-18T22:19:20.124250+0000","last_unstale":"2024-08-18T22:19:27.041348+0000","last_undegraded":"2024-08-18T22:19:27.041348+0000","last_fullsized":"2024-08-18T22:19:27.041348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:31.028689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409181+0000","last_change":"2024-08-18T22:19:21.137616+0000","last_active":"2024-08-18T22:19:27.409181+0000","last_peered":"2024-08-18T22:19:27.409181+0000","last_clean":"2024-08-18T22:19:27.409181+0000","last_became_active":"2024-08-18T22:19:21.134380+0000","last_became_peered":"2024-08-18T22:19:21.134380+0000","last_unstale":"2024-08-18T22:19:27.409181+0000","last_undegraded":"2024-08-18T22:19:27.409181+0000","last_fullsized":"2024-08-18T22:19:27.409181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343730+0000","last_change":"2024-08-18T22:19:25.363335+0000","last_active":"2024-08-18T22:19:26.343730+0000","last_peered":"2024-08-18T22:19:26.343730+0000","last_clean":"2024-08-18T22:19:26.343730+0000","last_became_active":"2024-08-18T22:19:25.362888+0000","last_became_peered":"2024-08-18T22:19:25.362888+0000","last_unstale":"2024-08-18T22:19:26.343730+0000","last_undegraded":"2024-08-18T22:19:26.343730+0000","last_fullsized":"2024-08-18T22:19:26.343730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:11:16.915639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345479+0000","last_change":"2024-08-18T22:19:20.129678+0000","last_active":"2024-08-18T22:19:26.345479+0000","last_peered":"2024-08-18T22:19:26.345479+0000","last_clean":"2024-08-18T22:19:26.345479+0000","last_became_active":"2024-08-18T22:19:20.129372+0000","last_became_peered":"2024-08-18T22:19:20.129372+0000","last_unstale":"2024-08-18T22:19:26.345479+0000","last_undegraded":"2024-08-18T22:19:26.345479+0000","last_fullsized":"2024-08-18T22:19:26.345479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:03.344308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335731+0000","last_change":"2024-08-18T22:19:21.130152+0000","last_active":"2024-08-18T22:19:27.335731+0000","last_peered":"2024-08-18T22:19:27.335731+0000","last_clean":"2024-08-18T22:19:27.335731+0000","last_became_active":"2024-08-18T22:19:21.127248+0000","last_became_peered":"2024-08-18T22:19:21.127248+0000","last_unstale":"2024-08-18T22:19:27.335731+0000","last_undegraded":"2024-08-18T22:19:27.335731+0000","last_fullsized":"2024-08-18T22:19:27.335731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:12.798866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344771+0000","last_change":"2024-08-18T22:19:25.375154+0000","last_active":"2024-08-18T22:19:26.344771+0000","last_peered":"2024-08-18T22:19:26.344771+0000","last_clean":"2024-08-18T22:19:26.344771+0000","last_became_active":"2024-08-18T22:19:25.374828+0000","last_became_peered":"2024-08-18T22:19:25.374828+0000","last_unstale":"2024-08-18T22:19:26.344771+0000","last_undegraded":"2024-08-18T22:19:26.344771+0000","last_fullsized":"2024-08-18T22:19:26.344771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:01.678786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345295+0000","last_change":"2024-08-18T22:19:20.127647+0000","last_active":"2024-08-18T22:19:26.345295+0000","last_peered":"2024-08-18T22:19:26.345295+0000","last_clean":"2024-08-18T22:19:26.345295+0000","last_became_active":"2024-08-18T22:19:20.126923+0000","last_became_peered":"2024-08-18T22:19:20.126923+0000","last_unstale":"2024-08-18T22:19:26.345295+0000","last_undegraded":"2024-08-18T22:19:26.345295+0000","last_fullsized":"2024-08-18T22:19:26.345295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:59:29.190977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335932+0000","last_change":"2024-08-18T22:19:21.115653+0000","last_active":"2024-08-18T22:19:27.335932+0000","last_peered":"2024-08-18T22:19:27.335932+0000","last_clean":"2024-08-18T22:19:27.335932+0000","last_became_active":"2024-08-18T22:19:21.115314+0000","last_became_peered":"2024-08-18T22:19:21.115314+0000","last_unstale":"2024-08-18T22:19:27.335932+0000","last_undegraded":"2024-08-18T22:19:27.335932+0000","last_fullsized":"2024-08-18T22:19:27.335932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:38.186074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344183+0000","last_change":"2024-08-18T22:19:25.371279+0000","last_active":"2024-08-18T22:19:26.344183+0000","last_peered":"2024-08-18T22:19:26.344183+0000","last_clean":"2024-08-18T22:19:26.344183+0000","last_became_active":"2024-08-18T22:19:25.370845+0000","last_became_peered":"2024-08-18T22:19:25.370845+0000","last_unstale":"2024-08-18T22:19:26.344183+0000","last_undegraded":"2024-08-18T22:19:26.344183+0000","last_fullsized":"2024-08-18T22:19:26.344183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:47.906445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342492+0000","last_change":"2024-08-18T22:19:21.117843+0000","last_active":"2024-08-18T22:19:26.342492+0000","last_peered":"2024-08-18T22:19:26.342492+0000","last_clean":"2024-08-18T22:19:26.342492+0000","last_became_active":"2024-08-18T22:19:21.117591+0000","last_became_peered":"2024-08-18T22:19:21.117591+0000","last_unstale":"2024-08-18T22:19:26.342492+0000","last_undegraded":"2024-08-18T22:19:26.342492+0000","last_fullsized":"2024-08-18T22:19:26.342492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345999+0000","last_change":"2024-08-18T22:19:20.130667+0000","last_active":"2024-08-18T22:19:26.345999+0000","last_peered":"2024-08-18T22:19:26.345999+0000","last_clean":"2024-08-18T22:19:26.345999+0000","last_became_active":"2024-08-18T22:19:20.130389+0000","last_became_peered":"2024-08-18T22:19:20.130389+0000","last_unstale":"2024-08-18T22:19:26.345999+0000","last_undegraded":"2024-08-18T22:19:26.345999+0000","last_fullsized":"2024-08-18T22:19:26.345999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:37:43.620510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344745+0000","last_change":"2024-08-18T22:19:25.362818+0000","last_active":"2024-08-18T22:19:26.344745+0000","last_peered":"2024-08-18T22:19:26.344745+0000","last_clean":"2024-08-18T22:19:26.344745+0000","last_became_active":"2024-08-18T22:19:25.360791+0000","last_became_peered":"2024-08-18T22:19:25.360791+0000","last_unstale":"2024-08-18T22:19:26.344745+0000","last_undegraded":"2024-08-18T22:19:26.344745+0000","last_fullsized":"2024-08-18T22:19:26.344745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:00.035629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040971+0000","last_change":"2024-08-18T22:19:21.140980+0000","last_active":"2024-08-18T22:19:27.040971+0000","last_peered":"2024-08-18T22:19:27.040971+0000","last_clean":"2024-08-18T22:19:27.040971+0000","last_became_active":"2024-08-18T22:19:21.139771+0000","last_became_peered":"2024-08-18T22:19:21.139771+0000","last_unstale":"2024-08-18T22:19:27.040971+0000","last_undegraded":"2024-08-18T22:19:27.040971+0000","last_fullsized":"2024-08-18T22:19:27.040971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407586+0000","last_change":"2024-08-18T22:19:20.119605+0000","last_active":"2024-08-18T22:19:27.407586+0000","last_peered":"2024-08-18T22:19:27.407586+0000","last_clean":"2024-08-18T22:19:27.407586+0000","last_became_active":"2024-08-18T22:19:20.118664+0000","last_became_peered":"2024-08-18T22:19:20.118664+0000","last_unstale":"2024-08-18T22:19:27.407586+0000","last_undegraded":"2024-08-18T22:19:27.407586+0000","last_fullsized":"2024-08-18T22:19:27.407586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344947+0000","last_change":"2024-08-18T22:19:25.376804+0000","last_active":"2024-08-18T22:19:26.344947+0000","last_peered":"2024-08-18T22:19:26.344947+0000","last_clean":"2024-08-18T22:19:26.344947+0000","last_became_active":"2024-08-18T22:19:25.376401+0000","last_became_peered":"2024-08-18T22:19:25.376401+0000","last_unstale":"2024-08-18T22:19:26.344947+0000","last_undegraded":"2024-08-18T22:19:26.344947+0000","last_fullsized":"2024-08-18T22:19:26.344947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:13.678679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041189+0000","last_change":"2024-08-18T22:19:21.115033+0000","last_active":"2024-08-18T22:19:27.041189+0000","last_peered":"2024-08-18T22:19:27.041189+0000","last_clean":"2024-08-18T22:19:27.041189+0000","last_became_active":"2024-08-18T22:19:21.114665+0000","last_became_peered":"2024-08-18T22:19:21.114665+0000","last_unstale":"2024-08-18T22:19:27.041189+0000","last_undegraded":"2024-08-18T22:19:27.041189+0000","last_fullsized":"2024-08-18T22:19:27.041189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406868+0000","last_change":"2024-08-18T22:19:20.118245+0000","last_active":"2024-08-18T22:19:27.406868+0000","last_peered":"2024-08-18T22:19:27.406868+0000","last_clean":"2024-08-18T22:19:27.406868+0000","last_became_active":"2024-08-18T22:19:20.117739+0000","last_became_peered":"2024-08-18T22:19:20.117739+0000","last_unstale":"2024-08-18T22:19:27.406868+0000","last_undegraded":"2024-08-18T22:19:27.406868+0000","last_fullsized":"2024-08-18T22:19:27.406868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408292+0000","last_change":"2024-08-18T22:19:25.369695+0000","last_active":"2024-08-18T22:19:27.408292+0000","last_peered":"2024-08-18T22:19:27.408292+0000","last_clean":"2024-08-18T22:19:27.408292+0000","last_became_active":"2024-08-18T22:19:25.368337+0000","last_became_peered":"2024-08-18T22:19:25.368337+0000","last_unstale":"2024-08-18T22:19:27.408292+0000","last_undegraded":"2024-08-18T22:19:27.408292+0000","last_fullsized":"2024-08-18T22:19:27.408292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:30.299592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343932+0000","last_change":"2024-08-18T22:19:21.123087+0000","last_active":"2024-08-18T22:19:26.343932+0000","last_peered":"2024-08-18T22:19:26.343932+0000","last_clean":"2024-08-18T22:19:26.343932+0000","last_became_active":"2024-08-18T22:19:21.121880+0000","last_became_peered":"2024-08-18T22:19:21.121880+0000","last_unstale":"2024-08-18T22:19:26.343932+0000","last_undegraded":"2024-08-18T22:19:26.343932+0000","last_fullsized":"2024-08-18T22:19:26.343932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:30.321238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343775+0000","last_change":"2024-08-18T22:19:20.127132+0000","last_active":"2024-08-18T22:19:26.343775+0000","last_peered":"2024-08-18T22:19:26.343775+0000","last_clean":"2024-08-18T22:19:26.343775+0000","last_became_active":"2024-08-18T22:19:20.126546+0000","last_became_peered":"2024-08-18T22:19:20.126546+0000","last_unstale":"2024-08-18T22:19:26.343775+0000","last_undegraded":"2024-08-18T22:19:26.343775+0000","last_fullsized":"2024-08-18T22:19:26.343775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:02.877029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345036+0000","last_change":"2024-08-18T22:19:25.372155+0000","last_active":"2024-08-18T22:19:26.345036+0000","last_peered":"2024-08-18T22:19:26.345036+0000","last_clean":"2024-08-18T22:19:26.345036+0000","last_became_active":"2024-08-18T22:19:25.370185+0000","last_became_peered":"2024-08-18T22:19:25.370185+0000","last_unstale":"2024-08-18T22:19:26.345036+0000","last_undegraded":"2024-08-18T22:19:26.345036+0000","last_fullsized":"2024-08-18T22:19:26.345036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:29:15.122631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409166+0000","last_change":"2024-08-18T22:19:21.132057+0000","last_active":"2024-08-18T22:19:27.409166+0000","last_peered":"2024-08-18T22:19:27.409166+0000","last_clean":"2024-08-18T22:19:27.409166+0000","last_became_active":"2024-08-18T22:19:21.131730+0000","last_became_peered":"2024-08-18T22:19:21.131730+0000","last_unstale":"2024-08-18T22:19:27.409166+0000","last_undegraded":"2024-08-18T22:19:27.409166+0000","last_fullsized":"2024-08-18T22:19:27.409166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344759+0000","last_change":"2024-08-18T22:19:20.124994+0000","last_active":"2024-08-18T22:19:26.344759+0000","last_peered":"2024-08-18T22:19:26.344759+0000","last_clean":"2024-08-18T22:19:26.344759+0000","last_became_active":"2024-08-18T22:19:20.124797+0000","last_became_peered":"2024-08-18T22:19:20.124797+0000","last_unstale":"2024-08-18T22:19:26.344759+0000","last_undegraded":"2024-08-18T22:19:26.344759+0000","last_fullsized":"2024-08-18T22:19:26.344759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343600+0000","last_change":"2024-08-18T22:19:25.359580+0000","last_active":"2024-08-18T22:19:26.343600+0000","last_peered":"2024-08-18T22:19:26.343600+0000","last_clean":"2024-08-18T22:19:26.343600+0000","last_became_active":"2024-08-18T22:19:25.359219+0000","last_became_peered":"2024-08-18T22:19:25.359219+0000","last_unstale":"2024-08-18T22:19:26.343600+0000","last_undegraded":"2024-08-18T22:19:26.343600+0000","last_fullsized":"2024-08-18T22:19:26.343600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:29.463841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041318+0000","last_change":"2024-08-18T22:19:21.121965+0000","last_active":"2024-08-18T22:19:27.041318+0000","last_peered":"2024-08-18T22:19:27.041318+0000","last_clean":"2024-08-18T22:19:27.041318+0000","last_became_active":"2024-08-18T22:19:21.118981+0000","last_became_peered":"2024-08-18T22:19:21.118981+0000","last_unstale":"2024-08-18T22:19:27.041318+0000","last_undegraded":"2024-08-18T22:19:27.041318+0000","last_fullsized":"2024-08-18T22:19:27.041318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408573+0000","last_change":"2024-08-18T22:19:20.127044+0000","last_active":"2024-08-18T22:19:27.408573+0000","last_peered":"2024-08-18T22:19:27.408573+0000","last_clean":"2024-08-18T22:19:27.408573+0000","last_became_active":"2024-08-18T22:19:20.126773+0000","last_became_peered":"2024-08-18T22:19:20.126773+0000","last_unstale":"2024-08-18T22:19:27.408573+0000","last_undegraded":"2024-08-18T22:19:27.408573+0000","last_fullsized":"2024-08-18T22:19:27.408573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040518+0000","last_change":"2024-08-18T22:19:25.365151+0000","last_active":"2024-08-18T22:19:27.040518+0000","last_peered":"2024-08-18T22:19:27.040518+0000","last_clean":"2024-08-18T22:19:27.040518+0000","last_became_active":"2024-08-18T22:19:25.364683+0000","last_became_peered":"2024-08-18T22:19:25.364683+0000","last_unstale":"2024-08-18T22:19:27.040518+0000","last_undegraded":"2024-08-18T22:19:27.040518+0000","last_fullsized":"2024-08-18T22:19:27.040518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:28.640280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407867+0000","last_change":"2024-08-18T22:19:21.113379+0000","last_active":"2024-08-18T22:19:27.407867+0000","last_peered":"2024-08-18T22:19:27.407867+0000","last_clean":"2024-08-18T22:19:27.407867+0000","last_became_active":"2024-08-18T22:19:21.113086+0000","last_became_peered":"2024-08-18T22:19:21.113086+0000","last_unstale":"2024-08-18T22:19:27.407867+0000","last_undegraded":"2024-08-18T22:19:27.407867+0000","last_fullsized":"2024-08-18T22:19:27.407867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345595+0000","last_change":"2024-08-18T22:19:20.130493+0000","last_active":"2024-08-18T22:19:26.345595+0000","last_peered":"2024-08-18T22:19:26.345595+0000","last_clean":"2024-08-18T22:19:26.345595+0000","last_became_active":"2024-08-18T22:19:20.130161+0000","last_became_peered":"2024-08-18T22:19:20.130161+0000","last_unstale":"2024-08-18T22:19:26.345595+0000","last_undegraded":"2024-08-18T22:19:26.345595+0000","last_fullsized":"2024-08-18T22:19:26.345595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:13.130477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408499+0000","last_change":"2024-08-18T22:19:25.375977+0000","last_active":"2024-08-18T22:19:27.408499+0000","last_peered":"2024-08-18T22:19:27.408499+0000","last_clean":"2024-08-18T22:19:27.408499+0000","last_became_active":"2024-08-18T22:19:25.366619+0000","last_became_peered":"2024-08-18T22:19:25.366619+0000","last_unstale":"2024-08-18T22:19:27.408499+0000","last_undegraded":"2024-08-18T22:19:27.408499+0000","last_fullsized":"2024-08-18T22:19:27.408499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:25.001121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336042+0000","last_change":"2024-08-18T22:19:21.126649+0000","last_active":"2024-08-18T22:19:27.336042+0000","last_peered":"2024-08-18T22:19:27.336042+0000","last_clean":"2024-08-18T22:19:27.336042+0000","last_became_active":"2024-08-18T22:19:21.125045+0000","last_became_peered":"2024-08-18T22:19:21.125045+0000","last_unstale":"2024-08-18T22:19:27.336042+0000","last_undegraded":"2024-08-18T22:19:27.336042+0000","last_fullsized":"2024-08-18T22:19:27.336042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:10.870419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407965+0000","last_change":"2024-08-18T22:19:20.113605+0000","last_active":"2024-08-18T22:19:27.407965+0000","last_peered":"2024-08-18T22:19:27.407965+0000","last_clean":"2024-08-18T22:19:27.407965+0000","last_became_active":"2024-08-18T22:19:20.113312+0000","last_became_peered":"2024-08-18T22:19:20.113312+0000","last_unstale":"2024-08-18T22:19:27.407965+0000","last_undegraded":"2024-08-18T22:19:27.407965+0000","last_fullsized":"2024-08-18T22:19:27.407965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407154+0000","last_change":"2024-08-18T22:19:25.379602+0000","last_active":"2024-08-18T22:19:27.407154+0000","last_peered":"2024-08-18T22:19:27.407154+0000","last_clean":"2024-08-18T22:19:27.407154+0000","last_became_active":"2024-08-18T22:19:25.379233+0000","last_became_peered":"2024-08-18T22:19:25.379233+0000","last_unstale":"2024-08-18T22:19:27.407154+0000","last_undegraded":"2024-08-18T22:19:27.407154+0000","last_fullsized":"2024-08-18T22:19:27.407154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:49.056286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344921+0000","last_change":"2024-08-18T22:19:21.137261+0000","last_active":"2024-08-18T22:19:26.344921+0000","last_peered":"2024-08-18T22:19:26.344921+0000","last_clean":"2024-08-18T22:19:26.344921+0000","last_became_active":"2024-08-18T22:19:21.137007+0000","last_became_peered":"2024-08-18T22:19:21.137007+0000","last_unstale":"2024-08-18T22:19:26.344921+0000","last_undegraded":"2024-08-18T22:19:26.344921+0000","last_fullsized":"2024-08-18T22:19:26.344921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:14.978071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335848+0000","last_change":"2024-08-18T22:19:20.118663+0000","last_active":"2024-08-18T22:19:27.335848+0000","last_peered":"2024-08-18T22:19:27.335848+0000","last_clean":"2024-08-18T22:19:27.335848+0000","last_became_active":"2024-08-18T22:19:20.118041+0000","last_became_peered":"2024-08-18T22:19:20.118041+0000","last_unstale":"2024-08-18T22:19:27.335848+0000","last_undegraded":"2024-08-18T22:19:27.335848+0000","last_fullsized":"2024-08-18T22:19:27.335848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407962+0000","last_change":"2024-08-18T22:19:25.375614+0000","last_active":"2024-08-18T22:19:27.407962+0000","last_peered":"2024-08-18T22:19:27.407962+0000","last_clean":"2024-08-18T22:19:27.407962+0000","last_became_active":"2024-08-18T22:19:25.374263+0000","last_became_peered":"2024-08-18T22:19:25.374263+0000","last_unstale":"2024-08-18T22:19:27.407962+0000","last_undegraded":"2024-08-18T22:19:27.407962+0000","last_fullsized":"2024-08-18T22:19:27.407962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:42.422194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406686+0000","last_change":"2024-08-18T22:19:21.110718+0000","last_active":"2024-08-18T22:19:27.406686+0000","last_peered":"2024-08-18T22:19:27.406686+0000","last_clean":"2024-08-18T22:19:27.406686+0000","last_became_active":"2024-08-18T22:19:21.110328+0000","last_became_peered":"2024-08-18T22:19:21.110328+0000","last_unstale":"2024-08-18T22:19:27.406686+0000","last_undegraded":"2024-08-18T22:19:27.406686+0000","last_fullsized":"2024-08-18T22:19:27.406686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406673+0000","last_change":"2024-08-18T22:19:20.110735+0000","last_active":"2024-08-18T22:19:27.406673+0000","last_peered":"2024-08-18T22:19:27.406673+0000","last_clean":"2024-08-18T22:19:27.406673+0000","last_became_active":"2024-08-18T22:19:20.110382+0000","last_became_peered":"2024-08-18T22:19:20.110382+0000","last_unstale":"2024-08-18T22:19:27.406673+0000","last_undegraded":"2024-08-18T22:19:27.406673+0000","last_fullsized":"2024-08-18T22:19:27.406673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:54.714769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408376+0000","last_change":"2024-08-18T22:19:25.374139+0000","last_active":"2024-08-18T22:19:27.408376+0000","last_peered":"2024-08-18T22:19:27.408376+0000","last_clean":"2024-08-18T22:19:27.408376+0000","last_became_active":"2024-08-18T22:19:25.373712+0000","last_became_peered":"2024-08-18T22:19:25.373712+0000","last_unstale":"2024-08-18T22:19:27.408376+0000","last_undegraded":"2024-08-18T22:19:27.408376+0000","last_fullsized":"2024-08-18T22:19:27.408376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:15.106539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407992+0000","last_change":"2024-08-18T22:19:21.134091+0000","last_active":"2024-08-18T22:19:27.407992+0000","last_peered":"2024-08-18T22:19:27.407992+0000","last_clean":"2024-08-18T22:19:27.407992+0000","last_became_active":"2024-08-18T22:19:21.133674+0000","last_became_peered":"2024-08-18T22:19:21.133674+0000","last_unstale":"2024-08-18T22:19:27.407992+0000","last_undegraded":"2024-08-18T22:19:27.407992+0000","last_fullsized":"2024-08-18T22:19:27.407992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:42:36.740493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343883+0000","last_change":"2024-08-18T22:19:20.125876+0000","last_active":"2024-08-18T22:19:26.343883+0000","last_peered":"2024-08-18T22:19:26.343883+0000","last_clean":"2024-08-18T22:19:26.343883+0000","last_became_active":"2024-08-18T22:19:20.125594+0000","last_became_peered":"2024-08-18T22:19:20.125594+0000","last_unstale":"2024-08-18T22:19:26.343883+0000","last_undegraded":"2024-08-18T22:19:26.343883+0000","last_fullsized":"2024-08-18T22:19:26.343883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:35:24.581822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409117+0000","last_change":"2024-08-18T22:19:25.366073+0000","last_active":"2024-08-18T22:19:27.409117+0000","last_peered":"2024-08-18T22:19:27.409117+0000","last_clean":"2024-08-18T22:19:27.409117+0000","last_became_active":"2024-08-18T22:19:25.364486+0000","last_became_peered":"2024-08-18T22:19:25.364486+0000","last_unstale":"2024-08-18T22:19:27.409117+0000","last_undegraded":"2024-08-18T22:19:27.409117+0000","last_fullsized":"2024-08-18T22:19:27.409117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:54.372527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040730+0000","last_change":"2024-08-18T22:19:21.126426+0000","last_active":"2024-08-18T22:19:27.040730+0000","last_peered":"2024-08-18T22:19:27.040730+0000","last_clean":"2024-08-18T22:19:27.040730+0000","last_became_active":"2024-08-18T22:19:21.126155+0000","last_became_peered":"2024-08-18T22:19:21.126155+0000","last_unstale":"2024-08-18T22:19:27.040730+0000","last_undegraded":"2024-08-18T22:19:27.040730+0000","last_fullsized":"2024-08-18T22:19:27.040730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:12.798866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335635+0000","last_change":"2024-08-18T22:19:20.120813+0000","last_active":"2024-08-18T22:19:27.335635+0000","last_peered":"2024-08-18T22:19:27.335635+0000","last_clean":"2024-08-18T22:19:27.335635+0000","last_became_active":"2024-08-18T22:19:20.120520+0000","last_became_peered":"2024-08-18T22:19:20.120520+0000","last_unstale":"2024-08-18T22:19:27.335635+0000","last_undegraded":"2024-08-18T22:19:27.335635+0000","last_fullsized":"2024-08-18T22:19:27.335635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343987+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:19:26.343987+0000","last_peered":"2024-08-18T22:19:26.343987+0000","last_clean":"2024-08-18T22:19:26.343987+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:19:26.343987+0000","last_undegraded":"2024-08-18T22:19:26.343987+0000","last_fullsized":"2024-08-18T22:19:26.343987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343553+0000","last_change":"2024-08-18T22:19:25.358088+0000","last_active":"2024-08-18T22:19:26.343553+0000","last_peered":"2024-08-18T22:19:26.343553+0000","last_clean":"2024-08-18T22:19:26.343553+0000","last_became_active":"2024-08-18T22:19:25.357741+0000","last_became_peered":"2024-08-18T22:19:25.357741+0000","last_unstale":"2024-08-18T22:19:26.343553+0000","last_undegraded":"2024-08-18T22:19:26.343553+0000","last_fullsized":"2024-08-18T22:19:26.343553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:12.001219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345357+0000","last_change":"2024-08-18T22:19:21.115625+0000","last_active":"2024-08-18T22:19:26.345357+0000","last_peered":"2024-08-18T22:19:26.345357+0000","last_clean":"2024-08-18T22:19:26.345357+0000","last_became_active":"2024-08-18T22:19:21.113832+0000","last_became_peered":"2024-08-18T22:19:21.113832+0000","last_unstale":"2024-08-18T22:19:26.345357+0000","last_undegraded":"2024-08-18T22:19:26.345357+0000","last_fullsized":"2024-08-18T22:19:26.345357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:07.765099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407470+0000","last_change":"2024-08-18T22:19:20.114087+0000","last_active":"2024-08-18T22:19:27.407470+0000","last_peered":"2024-08-18T22:19:27.407470+0000","last_clean":"2024-08-18T22:19:27.407470+0000","last_became_active":"2024-08-18T22:19:20.113655+0000","last_became_peered":"2024-08-18T22:19:20.113655+0000","last_unstale":"2024-08-18T22:19:27.407470+0000","last_undegraded":"2024-08-18T22:19:27.407470+0000","last_fullsized":"2024-08-18T22:19:27.407470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:31:21.374246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342469+0000","last_change":"2024-08-18T22:19:25.362833+0000","last_active":"2024-08-18T22:19:26.342469+0000","last_peered":"2024-08-18T22:19:26.342469+0000","last_clean":"2024-08-18T22:19:26.342469+0000","last_became_active":"2024-08-18T22:19:25.362232+0000","last_became_peered":"2024-08-18T22:19:25.362232+0000","last_unstale":"2024-08-18T22:19:26.342469+0000","last_undegraded":"2024-08-18T22:19:26.342469+0000","last_fullsized":"2024-08-18T22:19:26.342469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:10.830493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335872+0000","last_change":"2024-08-18T22:19:21.127671+0000","last_active":"2024-08-18T22:19:27.335872+0000","last_peered":"2024-08-18T22:19:27.335872+0000","last_clean":"2024-08-18T22:19:27.335872+0000","last_became_active":"2024-08-18T22:19:21.124718+0000","last_became_peered":"2024-08-18T22:19:21.124718+0000","last_unstale":"2024-08-18T22:19:27.335872+0000","last_undegraded":"2024-08-18T22:19:27.335872+0000","last_fullsized":"2024-08-18T22:19:27.335872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:27:07.765099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408089+0000","last_change":"2024-08-18T22:19:20.109318+0000","last_active":"2024-08-18T22:19:27.408089+0000","last_peered":"2024-08-18T22:19:27.408089+0000","last_clean":"2024-08-18T22:19:27.408089+0000","last_became_active":"2024-08-18T22:19:20.108894+0000","last_became_peered":"2024-08-18T22:19:20.108894+0000","last_unstale":"2024-08-18T22:19:27.408089+0000","last_undegraded":"2024-08-18T22:19:27.408089+0000","last_fullsized":"2024-08-18T22:19:27.408089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408668+0000","last_change":"2024-08-18T22:19:25.372355+0000","last_active":"2024-08-18T22:19:27.408668+0000","last_peered":"2024-08-18T22:19:27.408668+0000","last_clean":"2024-08-18T22:19:27.408668+0000","last_became_active":"2024-08-18T22:19:25.365235+0000","last_became_peered":"2024-08-18T22:19:25.365235+0000","last_unstale":"2024-08-18T22:19:27.408668+0000","last_undegraded":"2024-08-18T22:19:27.408668+0000","last_fullsized":"2024-08-18T22:19:27.408668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:42.422194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345949+0000","last_change":"2024-08-18T22:19:21.114675+0000","last_active":"2024-08-18T22:19:26.345949+0000","last_peered":"2024-08-18T22:19:26.345949+0000","last_clean":"2024-08-18T22:19:26.345949+0000","last_became_active":"2024-08-18T22:19:21.114251+0000","last_became_peered":"2024-08-18T22:19:21.114251+0000","last_unstale":"2024-08-18T22:19:26.345949+0000","last_undegraded":"2024-08-18T22:19:26.345949+0000","last_fullsized":"2024-08-18T22:19:26.345949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:24.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408143+0000","last_change":"2024-08-18T22:19:20.112330+0000","last_active":"2024-08-18T22:19:27.408143+0000","last_peered":"2024-08-18T22:19:27.408143+0000","last_clean":"2024-08-18T22:19:27.408143+0000","last_became_active":"2024-08-18T22:19:20.110530+0000","last_became_peered":"2024-08-18T22:19:20.110530+0000","last_unstale":"2024-08-18T22:19:27.408143+0000","last_undegraded":"2024-08-18T22:19:27.408143+0000","last_fullsized":"2024-08-18T22:19:27.408143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:18.857333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335519+0000","last_change":"2024-08-18T22:19:25.363810+0000","last_active":"2024-08-18T22:19:27.335519+0000","last_peered":"2024-08-18T22:19:27.335519+0000","last_clean":"2024-08-18T22:19:27.335519+0000","last_became_active":"2024-08-18T22:19:25.363407+0000","last_became_peered":"2024-08-18T22:19:25.363407+0000","last_unstale":"2024-08-18T22:19:27.335519+0000","last_undegraded":"2024-08-18T22:19:27.335519+0000","last_fullsized":"2024-08-18T22:19:27.335519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:28.640280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345615+0000","last_change":"2024-08-18T22:19:21.114404+0000","last_active":"2024-08-18T22:19:26.345615+0000","last_peered":"2024-08-18T22:19:26.345615+0000","last_clean":"2024-08-18T22:19:26.345615+0000","last_became_active":"2024-08-18T22:19:21.114109+0000","last_became_peered":"2024-08-18T22:19:21.114109+0000","last_unstale":"2024-08-18T22:19:26.345615+0000","last_undegraded":"2024-08-18T22:19:26.345615+0000","last_fullsized":"2024-08-18T22:19:26.345615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:50.136407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345199+0000","last_change":"2024-08-18T22:19:20.122497+0000","last_active":"2024-08-18T22:19:26.345199+0000","last_peered":"2024-08-18T22:19:26.345199+0000","last_clean":"2024-08-18T22:19:26.345199+0000","last_became_active":"2024-08-18T22:19:20.120755+0000","last_became_peered":"2024-08-18T22:19:20.120755+0000","last_unstale":"2024-08-18T22:19:26.345199+0000","last_undegraded":"2024-08-18T22:19:26.345199+0000","last_fullsized":"2024-08-18T22:19:26.345199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:29.746429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343340+0000","last_change":"2024-08-18T22:19:25.365173+0000","last_active":"2024-08-18T22:19:26.343340+0000","last_peered":"2024-08-18T22:19:26.343340+0000","last_clean":"2024-08-18T22:19:26.343340+0000","last_became_active":"2024-08-18T22:19:25.364765+0000","last_became_peered":"2024-08-18T22:19:25.364765+0000","last_unstale":"2024-08-18T22:19:26.343340+0000","last_undegraded":"2024-08-18T22:19:26.343340+0000","last_fullsized":"2024-08-18T22:19:26.343340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:28:02.302944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344594+0000","last_change":"2024-08-18T22:19:21.114669+0000","last_active":"2024-08-18T22:19:26.344594+0000","last_peered":"2024-08-18T22:19:26.344594+0000","last_clean":"2024-08-18T22:19:26.344594+0000","last_became_active":"2024-08-18T22:19:21.114275+0000","last_became_peered":"2024-08-18T22:19:21.114275+0000","last_unstale":"2024-08-18T22:19:26.344594+0000","last_undegraded":"2024-08-18T22:19:26.344594+0000","last_fullsized":"2024-08-18T22:19:26.344594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:26.063472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406470+0000","last_change":"2024-08-18T22:19:20.109986+0000","last_active":"2024-08-18T22:19:27.406470+0000","last_peered":"2024-08-18T22:19:27.406470+0000","last_clean":"2024-08-18T22:19:27.406470+0000","last_became_active":"2024-08-18T22:19:20.109629+0000","last_became_peered":"2024-08-18T22:19:20.109629+0000","last_unstale":"2024-08-18T22:19:27.406470+0000","last_undegraded":"2024-08-18T22:19:27.406470+0000","last_fullsized":"2024-08-18T22:19:27.406470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:41.309073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408961+0000","last_change":"2024-08-18T22:19:25.369993+0000","last_active":"2024-08-18T22:19:27.408961+0000","last_peered":"2024-08-18T22:19:27.408961+0000","last_clean":"2024-08-18T22:19:27.408961+0000","last_became_active":"2024-08-18T22:19:25.369546+0000","last_became_peered":"2024-08-18T22:19:25.369546+0000","last_unstale":"2024-08-18T22:19:27.408961+0000","last_undegraded":"2024-08-18T22:19:27.408961+0000","last_fullsized":"2024-08-18T22:19:27.408961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:15.106539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342013+0000","last_change":"2024-08-18T22:19:21.136153+0000","last_active":"2024-08-18T22:19:26.342013+0000","last_peered":"2024-08-18T22:19:26.342013+0000","last_clean":"2024-08-18T22:19:26.342013+0000","last_became_active":"2024-08-18T22:19:21.135862+0000","last_became_peered":"2024-08-18T22:19:21.135862+0000","last_unstale":"2024-08-18T22:19:26.342013+0000","last_undegraded":"2024-08-18T22:19:26.342013+0000","last_fullsized":"2024-08-18T22:19:26.342013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342398+0000","last_change":"2024-08-18T22:19:20.119295+0000","last_active":"2024-08-18T22:19:26.342398+0000","last_peered":"2024-08-18T22:19:26.342398+0000","last_clean":"2024-08-18T22:19:26.342398+0000","last_became_active":"2024-08-18T22:19:20.118960+0000","last_became_peered":"2024-08-18T22:19:20.118960+0000","last_unstale":"2024-08-18T22:19:26.342398+0000","last_undegraded":"2024-08-18T22:19:26.342398+0000","last_fullsized":"2024-08-18T22:19:26.342398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041372+0000","last_change":"2024-08-18T22:19:25.384579+0000","last_active":"2024-08-18T22:19:27.041372+0000","last_peered":"2024-08-18T22:19:27.041372+0000","last_clean":"2024-08-18T22:19:27.041372+0000","last_became_active":"2024-08-18T22:19:25.384216+0000","last_became_peered":"2024-08-18T22:19:25.384216+0000","last_unstale":"2024-08-18T22:19:27.041372+0000","last_undegraded":"2024-08-18T22:19:27.041372+0000","last_fullsized":"2024-08-18T22:19:27.041372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:56.704905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345875+0000","last_change":"2024-08-18T22:19:21.115242+0000","last_active":"2024-08-18T22:19:26.345875+0000","last_peered":"2024-08-18T22:19:26.345875+0000","last_clean":"2024-08-18T22:19:26.345875+0000","last_became_active":"2024-08-18T22:19:21.114992+0000","last_became_peered":"2024-08-18T22:19:21.114992+0000","last_unstale":"2024-08-18T22:19:26.345875+0000","last_undegraded":"2024-08-18T22:19:26.345875+0000","last_fullsized":"2024-08-18T22:19:26.345875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:20.765001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335813+0000","last_change":"2024-08-18T22:19:20.122264+0000","last_active":"2024-08-18T22:19:27.335813+0000","last_peered":"2024-08-18T22:19:27.335813+0000","last_clean":"2024-08-18T22:19:27.335813+0000","last_became_active":"2024-08-18T22:19:20.121940+0000","last_became_peered":"2024-08-18T22:19:20.121940+0000","last_unstale":"2024-08-18T22:19:27.335813+0000","last_undegraded":"2024-08-18T22:19:27.335813+0000","last_fullsized":"2024-08-18T22:19:27.335813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041119+0000","last_change":"2024-08-18T22:19:25.382796+0000","last_active":"2024-08-18T22:19:27.041119+0000","last_peered":"2024-08-18T22:19:27.041119+0000","last_clean":"2024-08-18T22:19:27.041119+0000","last_became_active":"2024-08-18T22:19:25.382015+0000","last_became_peered":"2024-08-18T22:19:25.382015+0000","last_unstale":"2024-08-18T22:19:27.041119+0000","last_undegraded":"2024-08-18T22:19:27.041119+0000","last_fullsized":"2024-08-18T22:19:27.041119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:13:06.606276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408452+0000","last_change":"2024-08-18T22:19:21.124994+0000","last_active":"2024-08-18T22:19:27.408452+0000","last_peered":"2024-08-18T22:19:27.408452+0000","last_clean":"2024-08-18T22:19:27.408452+0000","last_became_active":"2024-08-18T22:19:21.124714+0000","last_became_peered":"2024-08-18T22:19:21.124714+0000","last_unstale":"2024-08-18T22:19:27.408452+0000","last_undegraded":"2024-08-18T22:19:27.408452+0000","last_fullsized":"2024-08-18T22:19:27.408452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408670+0000","last_change":"2024-08-18T22:19:20.117524+0000","last_active":"2024-08-18T22:19:27.408670+0000","last_peered":"2024-08-18T22:19:27.408670+0000","last_clean":"2024-08-18T22:19:27.408670+0000","last_became_active":"2024-08-18T22:19:20.117271+0000","last_became_peered":"2024-08-18T22:19:20.117271+0000","last_unstale":"2024-08-18T22:19:27.408670+0000","last_undegraded":"2024-08-18T22:19:27.408670+0000","last_fullsized":"2024-08-18T22:19:27.408670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336048+0000","last_change":"2024-08-18T22:19:25.364903+0000","last_active":"2024-08-18T22:19:27.336048+0000","last_peered":"2024-08-18T22:19:27.336048+0000","last_clean":"2024-08-18T22:19:27.336048+0000","last_became_active":"2024-08-18T22:19:25.364491+0000","last_became_peered":"2024-08-18T22:19:25.364491+0000","last_unstale":"2024-08-18T22:19:27.336048+0000","last_undegraded":"2024-08-18T22:19:27.336048+0000","last_fullsized":"2024-08-18T22:19:27.336048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:01.102831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345257+0000","last_change":"2024-08-18T22:19:21.122735+0000","last_active":"2024-08-18T22:19:26.345257+0000","last_peered":"2024-08-18T22:19:26.345257+0000","last_clean":"2024-08-18T22:19:26.345257+0000","last_became_active":"2024-08-18T22:19:21.122489+0000","last_became_peered":"2024-08-18T22:19:21.122489+0000","last_unstale":"2024-08-18T22:19:26.345257+0000","last_undegraded":"2024-08-18T22:19:26.345257+0000","last_fullsized":"2024-08-18T22:19:26.345257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:44.820166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:32.234207+0000","last_change":"2024-08-18T22:19:20.121780+0000","last_active":"2024-08-18T22:19:32.234207+0000","last_peered":"2024-08-18T22:19:32.234207+0000","last_clean":"2024-08-18T22:19:32.234207+0000","last_became_active":"2024-08-18T22:19:20.121504+0000","last_became_peered":"2024-08-18T22:19:20.121504+0000","last_unstale":"2024-08-18T22:19:32.234207+0000","last_undegraded":"2024-08-18T22:19:32.234207+0000","last_fullsized":"2024-08-18T22:19:32.234207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:53.346130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407423+0000","last_change":"2024-08-18T22:19:25.380704+0000","last_active":"2024-08-18T22:19:27.407423+0000","last_peered":"2024-08-18T22:19:27.407423+0000","last_clean":"2024-08-18T22:19:27.407423+0000","last_became_active":"2024-08-18T22:19:25.380338+0000","last_became_peered":"2024-08-18T22:19:25.380338+0000","last_unstale":"2024-08-18T22:19:27.407423+0000","last_undegraded":"2024-08-18T22:19:27.407423+0000","last_fullsized":"2024-08-18T22:19:27.407423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:25.001121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345049+0000","last_change":"2024-08-18T22:19:21.105768+0000","last_active":"2024-08-18T22:19:26.345049+0000","last_peered":"2024-08-18T22:19:26.345049+0000","last_clean":"2024-08-18T22:19:26.345049+0000","last_became_active":"2024-08-18T22:19:21.105461+0000","last_became_peered":"2024-08-18T22:19:21.105461+0000","last_unstale":"2024-08-18T22:19:26.345049+0000","last_undegraded":"2024-08-18T22:19:26.345049+0000","last_fullsized":"2024-08-18T22:19:26.345049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:32.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407990+0000","last_change":"2024-08-18T22:19:20.122400+0000","last_active":"2024-08-18T22:19:27.407990+0000","last_peered":"2024-08-18T22:19:27.407990+0000","last_clean":"2024-08-18T22:19:27.407990+0000","last_became_active":"2024-08-18T22:19:20.121947+0000","last_became_peered":"2024-08-18T22:19:20.121947+0000","last_unstale":"2024-08-18T22:19:27.407990+0000","last_undegraded":"2024-08-18T22:19:27.407990+0000","last_fullsized":"2024-08-18T22:19:27.407990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:02.877029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344547+0000","last_change":"2024-08-18T22:19:25.372065+0000","last_active":"2024-08-18T22:19:26.344547+0000","last_peered":"2024-08-18T22:19:26.344547+0000","last_clean":"2024-08-18T22:19:26.344547+0000","last_became_active":"2024-08-18T22:19:25.371835+0000","last_became_peered":"2024-08-18T22:19:25.371835+0000","last_unstale":"2024-08-18T22:19:26.344547+0000","last_undegraded":"2024-08-18T22:19:26.344547+0000","last_fullsized":"2024-08-18T22:19:26.344547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:04:21.012114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.409247+0000","last_change":"2024-08-18T22:19:21.138068+0000","last_active":"2024-08-18T22:19:27.409247+0000","last_peered":"2024-08-18T22:19:27.409247+0000","last_clean":"2024-08-18T22:19:27.409247+0000","last_became_active":"2024-08-18T22:19:21.132915+0000","last_became_peered":"2024-08-18T22:19:21.132915+0000","last_unstale":"2024-08-18T22:19:27.409247+0000","last_undegraded":"2024-08-18T22:19:27.409247+0000","last_fullsized":"2024-08-18T22:19:27.409247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336025+0000","last_change":"2024-08-18T22:19:20.127698+0000","last_active":"2024-08-18T22:19:27.336025+0000","last_peered":"2024-08-18T22:19:27.336025+0000","last_clean":"2024-08-18T22:19:27.336025+0000","last_became_active":"2024-08-18T22:19:20.127488+0000","last_became_peered":"2024-08-18T22:19:20.127488+0000","last_unstale":"2024-08-18T22:19:27.336025+0000","last_undegraded":"2024-08-18T22:19:27.336025+0000","last_fullsized":"2024-08-18T22:19:27.336025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:10.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041133+0000","last_change":"2024-08-18T22:19:25.365048+0000","last_active":"2024-08-18T22:19:27.041133+0000","last_peered":"2024-08-18T22:19:27.041133+0000","last_clean":"2024-08-18T22:19:27.041133+0000","last_became_active":"2024-08-18T22:19:25.364597+0000","last_became_peered":"2024-08-18T22:19:25.364597+0000","last_unstale":"2024-08-18T22:19:27.041133+0000","last_undegraded":"2024-08-18T22:19:27.041133+0000","last_fullsized":"2024-08-18T22:19:27.041133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:37.692476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336018+0000","last_change":"2024-08-18T22:19:21.130941+0000","last_active":"2024-08-18T22:19:27.336018+0000","last_peered":"2024-08-18T22:19:27.336018+0000","last_clean":"2024-08-18T22:19:27.336018+0000","last_became_active":"2024-08-18T22:19:21.130617+0000","last_became_peered":"2024-08-18T22:19:21.130617+0000","last_unstale":"2024-08-18T22:19:27.336018+0000","last_undegraded":"2024-08-18T22:19:27.336018+0000","last_fullsized":"2024-08-18T22:19:27.336018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:06.594373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344569+0000","last_change":"2024-08-18T22:19:20.124348+0000","last_active":"2024-08-18T22:19:26.344569+0000","last_peered":"2024-08-18T22:19:26.344569+0000","last_clean":"2024-08-18T22:19:26.344569+0000","last_became_active":"2024-08-18T22:19:20.123971+0000","last_became_peered":"2024-08-18T22:19:20.123971+0000","last_unstale":"2024-08-18T22:19:26.344569+0000","last_undegraded":"2024-08-18T22:19:26.344569+0000","last_fullsized":"2024-08-18T22:19:26.344569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:06.679497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041200+0000","last_change":"2024-08-18T22:19:25.364746+0000","last_active":"2024-08-18T22:19:27.041200+0000","last_peered":"2024-08-18T22:19:27.041200+0000","last_clean":"2024-08-18T22:19:27.041200+0000","last_became_active":"2024-08-18T22:19:25.364332+0000","last_became_peered":"2024-08-18T22:19:25.364332+0000","last_unstale":"2024-08-18T22:19:27.041200+0000","last_undegraded":"2024-08-18T22:19:27.041200+0000","last_fullsized":"2024-08-18T22:19:27.041200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:13.150322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408896+0000","last_change":"2024-08-18T22:19:25.380247+0000","last_active":"2024-08-18T22:19:27.408896+0000","last_peered":"2024-08-18T22:19:27.408896+0000","last_clean":"2024-08-18T22:19:27.408896+0000","last_became_active":"2024-08-18T22:19:25.376751+0000","last_became_peered":"2024-08-18T22:19:25.376751+0000","last_unstale":"2024-08-18T22:19:27.408896+0000","last_undegraded":"2024-08-18T22:19:27.408896+0000","last_fullsized":"2024-08-18T22:19:27.408896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:30.299592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406771+0000","last_change":"2024-08-18T22:19:21.118219+0000","last_active":"2024-08-18T22:19:27.406771+0000","last_peered":"2024-08-18T22:19:27.406771+0000","last_clean":"2024-08-18T22:19:27.406771+0000","last_became_active":"2024-08-18T22:19:21.117904+0000","last_became_peered":"2024-08-18T22:19:21.117904+0000","last_unstale":"2024-08-18T22:19:27.406771+0000","last_undegraded":"2024-08-18T22:19:27.406771+0000","last_fullsized":"2024-08-18T22:19:27.406771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335657+0000","last_change":"2024-08-18T22:19:20.113456+0000","last_active":"2024-08-18T22:19:27.335657+0000","last_peered":"2024-08-18T22:19:27.335657+0000","last_clean":"2024-08-18T22:19:27.335657+0000","last_became_active":"2024-08-18T22:19:20.113170+0000","last_became_peered":"2024-08-18T22:19:20.113170+0000","last_unstale":"2024-08-18T22:19:27.335657+0000","last_undegraded":"2024-08-18T22:19:27.335657+0000","last_fullsized":"2024-08-18T22:19:27.335657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344445+0000","last_change":"2024-08-18T22:19:25.362236+0000","last_active":"2024-08-18T22:19:26.344445+0000","last_peered":"2024-08-18T22:19:26.344445+0000","last_clean":"2024-08-18T22:19:26.344445+0000","last_became_active":"2024-08-18T22:19:25.361968+0000","last_became_peered":"2024-08-18T22:19:25.361968+0000","last_unstale":"2024-08-18T22:19:26.344445+0000","last_undegraded":"2024-08-18T22:19:26.344445+0000","last_fullsized":"2024-08-18T22:19:26.344445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:49.056286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040927+0000","last_change":"2024-08-18T22:19:21.142319+0000","last_active":"2024-08-18T22:19:27.040927+0000","last_peered":"2024-08-18T22:19:27.040927+0000","last_clean":"2024-08-18T22:19:27.040927+0000","last_became_active":"2024-08-18T22:19:21.142023+0000","last_became_peered":"2024-08-18T22:19:21.142023+0000","last_unstale":"2024-08-18T22:19:27.040927+0000","last_undegraded":"2024-08-18T22:19:27.040927+0000","last_fullsized":"2024-08-18T22:19:27.040927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040827+0000","last_change":"2024-08-18T22:19:20.126010+0000","last_active":"2024-08-18T22:19:27.040827+0000","last_peered":"2024-08-18T22:19:27.040827+0000","last_clean":"2024-08-18T22:19:27.040827+0000","last_became_active":"2024-08-18T22:19:20.125768+0000","last_became_peered":"2024-08-18T22:19:20.125768+0000","last_unstale":"2024-08-18T22:19:27.040827+0000","last_undegraded":"2024-08-18T22:19:27.040827+0000","last_fullsized":"2024-08-18T22:19:27.040827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:09.183754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342628+0000","last_change":"2024-08-18T22:19:20.118969+0000","last_active":"2024-08-18T22:19:26.342628+0000","last_peered":"2024-08-18T22:19:26.342628+0000","last_clean":"2024-08-18T22:19:26.342628+0000","last_became_active":"2024-08-18T22:19:20.118686+0000","last_became_peered":"2024-08-18T22:19:20.118686+0000","last_unstale":"2024-08-18T22:19:26.342628+0000","last_undegraded":"2024-08-18T22:19:26.342628+0000","last_fullsized":"2024-08-18T22:19:26.342628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:25.813263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408624+0000","last_change":"2024-08-18T22:19:21.138371+0000","last_active":"2024-08-18T22:19:27.408624+0000","last_peered":"2024-08-18T22:19:27.408624+0000","last_clean":"2024-08-18T22:19:27.408624+0000","last_became_active":"2024-08-18T22:19:21.138042+0000","last_became_peered":"2024-08-18T22:19:21.138042+0000","last_unstale":"2024-08-18T22:19:27.408624+0000","last_undegraded":"2024-08-18T22:19:27.408624+0000","last_fullsized":"2024-08-18T22:19:27.408624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406977+0000","last_change":"2024-08-18T22:19:25.377063+0000","last_active":"2024-08-18T22:19:27.406977+0000","last_peered":"2024-08-18T22:19:27.406977+0000","last_clean":"2024-08-18T22:19:27.406977+0000","last_became_active":"2024-08-18T22:19:25.376639+0000","last_became_peered":"2024-08-18T22:19:25.376639+0000","last_unstale":"2024-08-18T22:19:27.406977+0000","last_undegraded":"2024-08-18T22:19:27.406977+0000","last_fullsized":"2024-08-18T22:19:27.406977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:43.985709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041089+0000","last_change":"2024-08-18T22:19:20.129285+0000","last_active":"2024-08-18T22:19:27.041089+0000","last_peered":"2024-08-18T22:19:27.041089+0000","last_clean":"2024-08-18T22:19:27.041089+0000","last_became_active":"2024-08-18T22:19:20.129024+0000","last_became_peered":"2024-08-18T22:19:20.129024+0000","last_unstale":"2024-08-18T22:19:27.041089+0000","last_undegraded":"2024-08-18T22:19:27.041089+0000","last_fullsized":"2024-08-18T22:19:27.041089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:19.078356+0000","last_clean_scrub_stamp":"2024-08-18T22:19:19.078356+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:02.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344339+0000","last_change":"2024-08-18T22:19:21.102815+0000","last_active":"2024-08-18T22:19:26.344339+0000","last_peered":"2024-08-18T22:19:26.344339+0000","last_clean":"2024-08-18T22:19:26.344339+0000","last_became_active":"2024-08-18T22:19:21.102382+0000","last_became_peered":"2024-08-18T22:19:21.102382+0000","last_unstale":"2024-08-18T22:19:26.344339+0000","last_undegraded":"2024-08-18T22:19:26.344339+0000","last_fullsized":"2024-08-18T22:19:26.344339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:41.157892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041004+0000","last_change":"2024-08-18T22:19:25.365329+0000","last_active":"2024-08-18T22:19:27.041004+0000","last_peered":"2024-08-18T22:19:27.041004+0000","last_clean":"2024-08-18T22:19:27.041004+0000","last_became_active":"2024-08-18T22:19:25.364915+0000","last_became_peered":"2024-08-18T22:19:25.364915+0000","last_unstale":"2024-08-18T22:19:27.041004+0000","last_undegraded":"2024-08-18T22:19:27.041004+0000","last_fullsized":"2024-08-18T22:19:27.041004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:24.321944+0000","last_clean_scrub_stamp":"2024-08-18T22:19:24.321944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:19:12.438973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342040+0000","last_change":"2024-08-18T22:19:21.137071+0000","last_active":"2024-08-18T22:19:26.342040+0000","last_peered":"2024-08-18T22:19:26.342040+0000","last_clean":"2024-08-18T22:19:26.342040+0000","last_became_active":"2024-08-18T22:19:21.136814+0000","last_became_peered":"2024-08-18T22:19:21.136814+0000","last_unstale":"2024-08-18T22:19:26.342040+0000","last_undegraded":"2024-08-18T22:19:26.342040+0000","last_fullsized":"2024-08-18T22:19:26.342040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406646+0000","last_change":"2024-08-18T22:19:21.118314+0000","last_active":"2024-08-18T22:19:27.406646+0000","last_peered":"2024-08-18T22:19:27.406646+0000","last_clean":"2024-08-18T22:19:27.406646+0000","last_became_active":"2024-08-18T22:19:21.117946+0000","last_became_peered":"2024-08-18T22:19:21.117946+0000","last_unstale":"2024-08-18T22:19:27.406646+0000","last_undegraded":"2024-08-18T22:19:27.406646+0000","last_fullsized":"2024-08-18T22:19:27.406646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:32.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335679+0000","last_change":"2024-08-18T22:19:21.126438+0000","last_active":"2024-08-18T22:19:27.335679+0000","last_peered":"2024-08-18T22:19:27.335679+0000","last_clean":"2024-08-18T22:19:27.335679+0000","last_became_active":"2024-08-18T22:19:21.125111+0000","last_became_peered":"2024-08-18T22:19:21.125111+0000","last_unstale":"2024-08-18T22:19:27.335679+0000","last_undegraded":"2024-08-18T22:19:27.335679+0000","last_fullsized":"2024-08-18T22:19:27.335679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:25:04.876293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408577+0000","last_change":"2024-08-18T22:19:21.127359+0000","last_active":"2024-08-18T22:19:27.408577+0000","last_peered":"2024-08-18T22:19:27.408577+0000","last_clean":"2024-08-18T22:19:27.408577+0000","last_became_active":"2024-08-18T22:19:21.126860+0000","last_became_peered":"2024-08-18T22:19:21.126860+0000","last_unstale":"2024-08-18T22:19:27.408577+0000","last_undegraded":"2024-08-18T22:19:27.408577+0000","last_fullsized":"2024-08-18T22:19:27.408577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041266+0000","last_change":"2024-08-18T22:19:21.132232+0000","last_active":"2024-08-18T22:19:27.041266+0000","last_peered":"2024-08-18T22:19:27.041266+0000","last_clean":"2024-08-18T22:19:27.041266+0000","last_became_active":"2024-08-18T22:19:21.131969+0000","last_became_peered":"2024-08-18T22:19:21.131969+0000","last_unstale":"2024-08-18T22:19:27.041266+0000","last_undegraded":"2024-08-18T22:19:27.041266+0000","last_fullsized":"2024-08-18T22:19:27.041266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:25:04.876293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.407601+0000","last_change":"2024-08-18T22:19:21.116405+0000","last_active":"2024-08-18T22:19:27.407601+0000","last_peered":"2024-08-18T22:19:27.407601+0000","last_clean":"2024-08-18T22:19:27.407601+0000","last_became_active":"2024-08-18T22:19:21.116134+0000","last_became_peered":"2024-08-18T22:19:21.116134+0000","last_unstale":"2024-08-18T22:19:27.407601+0000","last_undegraded":"2024-08-18T22:19:27.407601+0000","last_fullsized":"2024-08-18T22:19:27.407601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344310+0000","last_change":"2024-08-18T22:19:21.119475+0000","last_active":"2024-08-18T22:19:26.344310+0000","last_peered":"2024-08-18T22:19:26.344310+0000","last_clean":"2024-08-18T22:19:26.344310+0000","last_became_active":"2024-08-18T22:19:21.118733+0000","last_became_peered":"2024-08-18T22:19:21.118733+0000","last_unstale":"2024-08-18T22:19:26.344310+0000","last_undegraded":"2024-08-18T22:19:26.344310+0000","last_fullsized":"2024-08-18T22:19:26.344310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.041220+0000","last_change":"2024-08-18T22:19:21.130398+0000","last_active":"2024-08-18T22:19:27.041220+0000","last_peered":"2024-08-18T22:19:27.041220+0000","last_clean":"2024-08-18T22:19:27.041220+0000","last_became_active":"2024-08-18T22:19:21.130131+0000","last_became_peered":"2024-08-18T22:19:21.130131+0000","last_unstale":"2024-08-18T22:19:27.041220+0000","last_undegraded":"2024-08-18T22:19:27.041220+0000","last_fullsized":"2024-08-18T22:19:27.041220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335536+0000","last_change":"2024-08-18T22:19:21.127403+0000","last_active":"2024-08-18T22:19:27.335536+0000","last_peered":"2024-08-18T22:19:27.335536+0000","last_clean":"2024-08-18T22:19:27.335536+0000","last_became_active":"2024-08-18T22:19:21.125489+0000","last_became_peered":"2024-08-18T22:19:21.125489+0000","last_unstale":"2024-08-18T22:19:27.335536+0000","last_undegraded":"2024-08-18T22:19:27.335536+0000","last_fullsized":"2024-08-18T22:19:27.335536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:53:44.820166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040656+0000","last_change":"2024-08-18T22:19:21.119217+0000","last_active":"2024-08-18T22:19:27.040656+0000","last_peered":"2024-08-18T22:19:27.040656+0000","last_clean":"2024-08-18T22:19:27.040656+0000","last_became_active":"2024-08-18T22:19:21.118867+0000","last_became_peered":"2024-08-18T22:19:21.118867+0000","last_unstale":"2024-08-18T22:19:27.040656+0000","last_undegraded":"2024-08-18T22:19:27.040656+0000","last_fullsized":"2024-08-18T22:19:27.040656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335670+0000","last_change":"2024-08-18T22:19:21.131453+0000","last_active":"2024-08-18T22:19:27.335670+0000","last_peered":"2024-08-18T22:19:27.335670+0000","last_clean":"2024-08-18T22:19:27.335670+0000","last_became_active":"2024-08-18T22:19:21.131186+0000","last_became_peered":"2024-08-18T22:19:21.131186+0000","last_unstale":"2024-08-18T22:19:27.335670+0000","last_undegraded":"2024-08-18T22:19:27.335670+0000","last_fullsized":"2024-08-18T22:19:27.335670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:43.149202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408516+0000","last_change":"2024-08-18T22:19:21.133703+0000","last_active":"2024-08-18T22:19:27.408516+0000","last_peered":"2024-08-18T22:19:27.408516+0000","last_clean":"2024-08-18T22:19:27.408516+0000","last_became_active":"2024-08-18T22:19:21.129639+0000","last_became_peered":"2024-08-18T22:19:21.129639+0000","last_unstale":"2024-08-18T22:19:27.408516+0000","last_undegraded":"2024-08-18T22:19:27.408516+0000","last_fullsized":"2024-08-18T22:19:27.408516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.342954+0000","last_change":"2024-08-18T22:19:21.119313+0000","last_active":"2024-08-18T22:19:26.342954+0000","last_peered":"2024-08-18T22:19:26.342954+0000","last_clean":"2024-08-18T22:19:26.342954+0000","last_became_active":"2024-08-18T22:19:21.119038+0000","last_became_peered":"2024-08-18T22:19:21.119038+0000","last_unstale":"2024-08-18T22:19:26.342954+0000","last_undegraded":"2024-08-18T22:19:26.342954+0000","last_fullsized":"2024-08-18T22:19:26.342954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345508+0000","last_change":"2024-08-18T22:19:21.123284+0000","last_active":"2024-08-18T22:19:26.345508+0000","last_peered":"2024-08-18T22:19:26.345508+0000","last_clean":"2024-08-18T22:19:26.345508+0000","last_became_active":"2024-08-18T22:19:21.123041+0000","last_became_peered":"2024-08-18T22:19:21.123041+0000","last_unstale":"2024-08-18T22:19:26.345508+0000","last_undegraded":"2024-08-18T22:19:26.345508+0000","last_fullsized":"2024-08-18T22:19:26.345508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:10.870419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408041+0000","last_change":"2024-08-18T22:19:21.120385+0000","last_active":"2024-08-18T22:19:27.408041+0000","last_peered":"2024-08-18T22:19:27.408041+0000","last_clean":"2024-08-18T22:19:27.408041+0000","last_became_active":"2024-08-18T22:19:21.119998+0000","last_became_peered":"2024-08-18T22:19:21.119998+0000","last_unstale":"2024-08-18T22:19:27.408041+0000","last_undegraded":"2024-08-18T22:19:27.408041+0000","last_fullsized":"2024-08-18T22:19:27.408041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:30.321238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.336261+0000","last_change":"2024-08-18T22:19:21.131891+0000","last_active":"2024-08-18T22:19:27.336261+0000","last_peered":"2024-08-18T22:19:27.336261+0000","last_clean":"2024-08-18T22:19:27.336261+0000","last_became_active":"2024-08-18T22:19:21.131589+0000","last_became_peered":"2024-08-18T22:19:21.131589+0000","last_unstale":"2024-08-18T22:19:27.336261+0000","last_undegraded":"2024-08-18T22:19:27.336261+0000","last_fullsized":"2024-08-18T22:19:27.336261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:26.063472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335381+0000","last_change":"2024-08-18T22:19:21.126883+0000","last_active":"2024-08-18T22:19:27.335381+0000","last_peered":"2024-08-18T22:19:27.335381+0000","last_clean":"2024-08-18T22:19:27.335381+0000","last_became_active":"2024-08-18T22:19:21.126532+0000","last_became_peered":"2024-08-18T22:19:21.126532+0000","last_unstale":"2024-08-18T22:19:27.335381+0000","last_undegraded":"2024-08-18T22:19:27.335381+0000","last_fullsized":"2024-08-18T22:19:27.335381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.406798+0000","last_change":"2024-08-18T22:19:21.105560+0000","last_active":"2024-08-18T22:19:27.406798+0000","last_peered":"2024-08-18T22:19:27.406798+0000","last_clean":"2024-08-18T22:19:27.406798+0000","last_became_active":"2024-08-18T22:19:21.105275+0000","last_became_peered":"2024-08-18T22:19:21.105275+0000","last_unstale":"2024-08-18T22:19:27.406798+0000","last_undegraded":"2024-08-18T22:19:27.406798+0000","last_fullsized":"2024-08-18T22:19:27.406798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:47.198772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408404+0000","last_change":"2024-08-18T22:19:21.131750+0000","last_active":"2024-08-18T22:19:27.408404+0000","last_peered":"2024-08-18T22:19:27.408404+0000","last_clean":"2024-08-18T22:19:27.408404+0000","last_became_active":"2024-08-18T22:19:21.131476+0000","last_became_peered":"2024-08-18T22:19:21.131476+0000","last_unstale":"2024-08-18T22:19:27.408404+0000","last_undegraded":"2024-08-18T22:19:27.408404+0000","last_fullsized":"2024-08-18T22:19:27.408404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:26:14.137945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040778+0000","last_change":"2024-08-18T22:19:21.137226+0000","last_active":"2024-08-18T22:19:27.040778+0000","last_peered":"2024-08-18T22:19:27.040778+0000","last_clean":"2024-08-18T22:19:27.040778+0000","last_became_active":"2024-08-18T22:19:21.136916+0000","last_became_peered":"2024-08-18T22:19:21.136916+0000","last_unstale":"2024-08-18T22:19:27.040778+0000","last_undegraded":"2024-08-18T22:19:27.040778+0000","last_fullsized":"2024-08-18T22:19:27.040778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344977+0000","last_change":"2024-08-18T22:19:21.122084+0000","last_active":"2024-08-18T22:19:26.344977+0000","last_peered":"2024-08-18T22:19:26.344977+0000","last_clean":"2024-08-18T22:19:26.344977+0000","last_became_active":"2024-08-18T22:19:21.121814+0000","last_became_peered":"2024-08-18T22:19:21.121814+0000","last_unstale":"2024-08-18T22:19:26.344977+0000","last_undegraded":"2024-08-18T22:19:26.344977+0000","last_fullsized":"2024-08-18T22:19:26.344977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:03.691264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.343684+0000","last_change":"2024-08-18T22:19:21.118724+0000","last_active":"2024-08-18T22:19:26.343684+0000","last_peered":"2024-08-18T22:19:26.343684+0000","last_clean":"2024-08-18T22:19:26.343684+0000","last_became_active":"2024-08-18T22:19:21.118432+0000","last_became_peered":"2024-08-18T22:19:21.118432+0000","last_unstale":"2024-08-18T22:19:26.343684+0000","last_undegraded":"2024-08-18T22:19:26.343684+0000","last_fullsized":"2024-08-18T22:19:26.343684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:52.277596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344215+0000","last_change":"2024-08-18T22:19:21.119771+0000","last_active":"2024-08-18T22:19:26.344215+0000","last_peered":"2024-08-18T22:19:26.344215+0000","last_clean":"2024-08-18T22:19:26.344215+0000","last_became_active":"2024-08-18T22:19:21.119089+0000","last_became_peered":"2024-08-18T22:19:21.119089+0000","last_unstale":"2024-08-18T22:19:26.344215+0000","last_undegraded":"2024-08-18T22:19:26.344215+0000","last_fullsized":"2024-08-18T22:19:26.344215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:00.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345907+0000","last_change":"2024-08-18T22:19:21.116013+0000","last_active":"2024-08-18T22:19:26.345907+0000","last_peered":"2024-08-18T22:19:26.345907+0000","last_clean":"2024-08-18T22:19:26.345907+0000","last_became_active":"2024-08-18T22:19:21.115692+0000","last_became_peered":"2024-08-18T22:19:21.115692+0000","last_unstale":"2024-08-18T22:19:26.345907+0000","last_undegraded":"2024-08-18T22:19:26.345907+0000","last_fullsized":"2024-08-18T22:19:26.345907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:17.605306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.040584+0000","last_change":"2024-08-18T22:19:21.121713+0000","last_active":"2024-08-18T22:19:27.040584+0000","last_peered":"2024-08-18T22:19:27.040584+0000","last_clean":"2024-08-18T22:19:27.040584+0000","last_became_active":"2024-08-18T22:19:21.121200+0000","last_became_peered":"2024-08-18T22:19:21.121200+0000","last_unstale":"2024-08-18T22:19:27.040584+0000","last_undegraded":"2024-08-18T22:19:27.040584+0000","last_fullsized":"2024-08-18T22:19:27.040584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:41.599243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.344491+0000","last_change":"2024-08-18T22:19:21.129242+0000","last_active":"2024-08-18T22:19:26.344491+0000","last_peered":"2024-08-18T22:19:26.344491+0000","last_clean":"2024-08-18T22:19:26.344491+0000","last_became_active":"2024-08-18T22:19:21.128914+0000","last_became_peered":"2024-08-18T22:19:21.128914+0000","last_unstale":"2024-08-18T22:19:26.344491+0000","last_undegraded":"2024-08-18T22:19:26.344491+0000","last_fullsized":"2024-08-18T22:19:26.344491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:06.594373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335443+0000","last_change":"2024-08-18T22:19:21.136266+0000","last_active":"2024-08-18T22:19:27.335443+0000","last_peered":"2024-08-18T22:19:27.335443+0000","last_clean":"2024-08-18T22:19:27.335443+0000","last_became_active":"2024-08-18T22:19:21.135968+0000","last_became_peered":"2024-08-18T22:19:21.135968+0000","last_unstale":"2024-08-18T22:19:27.335443+0000","last_undegraded":"2024-08-18T22:19:27.335443+0000","last_fullsized":"2024-08-18T22:19:27.335443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:19.153274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345760+0000","last_change":"2024-08-18T22:19:21.115212+0000","last_active":"2024-08-18T22:19:26.345760+0000","last_peered":"2024-08-18T22:19:26.345760+0000","last_clean":"2024-08-18T22:19:26.345760+0000","last_became_active":"2024-08-18T22:19:21.114910+0000","last_became_peered":"2024-08-18T22:19:21.114910+0000","last_unstale":"2024-08-18T22:19:26.345760+0000","last_undegraded":"2024-08-18T22:19:26.345760+0000","last_fullsized":"2024-08-18T22:19:26.345760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:48:38.186074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.335755+0000","last_change":"2024-08-18T22:19:21.127871+0000","last_active":"2024-08-18T22:19:27.335755+0000","last_peered":"2024-08-18T22:19:27.335755+0000","last_clean":"2024-08-18T22:19:27.335755+0000","last_became_active":"2024-08-18T22:19:21.126869+0000","last_became_peered":"2024-08-18T22:19:21.126869+0000","last_unstale":"2024-08-18T22:19:27.335755+0000","last_undegraded":"2024-08-18T22:19:27.335755+0000","last_fullsized":"2024-08-18T22:19:27.335755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:20.765001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408844+0000","last_change":"2024-08-18T22:19:21.131385+0000","last_active":"2024-08-18T22:19:27.408844+0000","last_peered":"2024-08-18T22:19:27.408844+0000","last_clean":"2024-08-18T22:19:27.408844+0000","last_became_active":"2024-08-18T22:19:21.131082+0000","last_became_peered":"2024-08-18T22:19:21.131082+0000","last_unstale":"2024-08-18T22:19:27.408844+0000","last_undegraded":"2024-08-18T22:19:27.408844+0000","last_fullsized":"2024-08-18T22:19:27.408844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:23.755957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:27.408484+0000","last_change":"2024-08-18T22:19:21.136779+0000","last_active":"2024-08-18T22:19:27.408484+0000","last_peered":"2024-08-18T22:19:27.408484+0000","last_clean":"2024-08-18T22:19:27.408484+0000","last_became_active":"2024-08-18T22:19:21.136340+0000","last_became_peered":"2024-08-18T22:19:21.136340+0000","last_unstale":"2024-08-18T22:19:27.408484+0000","last_undegraded":"2024-08-18T22:19:27.408484+0000","last_fullsized":"2024-08-18T22:19:27.408484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:07.444558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-18T22:19:26.345776+0000","last_change":"2024-08-18T22:19:21.122413+0000","last_active":"2024-08-18T22:19:26.345776+0000","last_peered":"2024-08-18T22:19:26.345776+0000","last_clean":"2024-08-18T22:19:26.345776+0000","last_became_active":"2024-08-18T22:19:21.122038+0000","last_became_peered":"2024-08-18T22:19:21.122038+0000","last_unstale":"2024-08-18T22:19:26.345776+0000","last_undegraded":"2024-08-18T22:19:26.345776+0000","last_fullsized":"2024-08-18T22:19:26.345776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:20.085824+0000","last_clean_scrub_stamp":"2024-08-18T22:19:20.085824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:30:09.265589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":693019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":102159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":102229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":693075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:19:47.641 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:19:47.641 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-18T22:19:47.641 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-18T22:19:47.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-18T22:19:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.814+0000 7f5b97200640 1 Processor -- start 2024-08-18T22:19:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.814+0000 7f5b97200640 1 -- start start 2024-08-18T22:19:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b97200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b981616d0 0x7f5b980d4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b97200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b98161ab0 0x7f5b980b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b97200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b980d2bc0 con 0x7f5b980b7500 2024-08-18T22:19:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b97200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5b980d2ea0 con 0x7f5b98161ab0 2024-08-18T22:19:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b97200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5b980cefd0 con 0x7f5b981616d0 2024-08-18T22:19:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b8d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b98161ab0 0x7f5b980b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b8d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b98161ab0 0x7f5b980b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40740/0 (socket says 172.21.15.5:40740) 2024-08-18T22:19:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b8d400640 1 -- 172.21.15.5:0/1723833230 learned_addr learned my addr 172.21.15.5:0/1723833230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b95e00640 1 --2- 172.21.15.5:0/1723833230 >> v2:172.21.15.117:3300/0 conn(0x7f5b981616d0 0x7f5b980d4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b8d400640 1 -- 172.21.15.5:0/1723833230 >> v2:172.21.15.117:3300/0 conn(0x7f5b981616d0 msgr2=0x7f5b980d4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b8d400640 1 --2- 172.21.15.5:0/1723833230 >> v2:172.21.15.117:3300/0 conn(0x7f5b981616d0 0x7f5b980d4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b8d400640 1 -- 172.21.15.5:0/1723833230 >> v1:172.21.15.117:6789/0 conn(0x7f5b980b7500 legacy=0x7f5b980cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.818+0000 7f5b8d400640 1 -- 172.21.15.5:0/1723833230 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b980cf2b0 con 0x7f5b98161ab0 2024-08-18T22:19:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b8d400640 1 --2- 172.21.15.5:0/1723833230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b98161ab0 0x7f5b980b6fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5b9809dbe0 tx=0x7f5b8001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d958a2ff32d568 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b95400640 1 -- 172.21.15.5:0/1723833230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b800b5070 con 0x7f5b98161ab0 2024-08-18T22:19:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b95400640 1 -- 172.21.15.5:0/1723833230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b800a8a10 con 0x7f5b98161ab0 2024-08-18T22:19:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b95400640 1 -- 172.21.15.5:0/1723833230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b800a8de0 con 0x7f5b98161ab0 2024-08-18T22:19:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 -- 172.21.15.5:0/1723833230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b98161ab0 msgr2=0x7f5b980b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 --2- 172.21.15.5:0/1723833230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b98161ab0 0x7f5b980b6fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5b9809dbe0 tx=0x7f5b8001ed10 comp rx=0 tx=0).stop 2024-08-18T22:19:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 -- 172.21.15.5:0/1723833230 shutdown_connections 2024-08-18T22:19:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 --2- 172.21.15.5:0/1723833230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b98161ab0 0x7f5b980b6fc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 --2- 172.21.15.5:0/1723833230 >> v2:172.21.15.117:3300/0 conn(0x7f5b981616d0 0x7f5b980d4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 -- 172.21.15.5:0/1723833230 >> 172.21.15.5:0/1723833230 conn(0x7f5b9809d4b0 msgr2=0x7f5b980d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 -- 172.21.15.5:0/1723833230 shutdown_connections 2024-08-18T22:19:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 -- 172.21.15.5:0/1723833230 wait complete. 2024-08-18T22:19:47.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 Processor -- start 2024-08-18T22:19:47.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 -- start start 2024-08-18T22:19:47.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b980b7500 0x7f5b98159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b981616d0 0x7f5b980c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b98161ab0 0x7f5b981e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5b980d0060 con 0x7f5b98161ab0 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5b980cfee0 con 0x7f5b980b7500 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.822+0000 7f5b97200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5b980d4ea0 con 0x7f5b981616d0 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b96800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b98161ab0 0x7f5b981e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b96800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b98161ab0 0x7f5b981e8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40748/0 (socket says 172.21.15.5:40748) 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b96800640 1 -- 172.21.15.5:0/3406296282 learned_addr learned my addr 172.21.15.5:0/3406296282 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b95e00640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b980b7500 0x7f5b98159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b8d400640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b981616d0 0x7f5b980c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b96800640 1 -- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b981616d0 msgr2=0x7f5b980c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b96800640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b981616d0 0x7f5b980c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b96800640 1 -- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b980b7500 msgr2=0x7f5b98159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b96800640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b980b7500 0x7f5b98159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b96800640 1 -- 172.21.15.5:0/3406296282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b98160ef0 con 0x7f5b98161ab0 2024-08-18T22:19:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b95e00640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b980b7500 0x7f5b98159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b8d400640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b981616d0 0x7f5b980c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b96800640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b98161ab0 0x7f5b981e8610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c340 tx=0x7f5b9000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b8ea00640 1 -- 172.21.15.5:0/3406296282 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90005220 con 0x7f5b98161ab0 2024-08-18T22:19:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b8ea00640 1 -- 172.21.15.5:0/3406296282 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b900053c0 con 0x7f5b98161ab0 2024-08-18T22:19:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b97200640 1 -- 172.21.15.5:0/3406296282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b98159a90 con 0x7f5b98161ab0 2024-08-18T22:19:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b8ea00640 1 -- 172.21.15.5:0/3406296282 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90007270 con 0x7f5b98161ab0 2024-08-18T22:19:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b97200640 1 -- 172.21.15.5:0/3406296282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b980c9c20 con 0x7f5b98161ab0 2024-08-18T22:19:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b97200640 1 -- 172.21.15.5:0/3406296282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b981e8c00 con 0x7f5b98161ab0 2024-08-18T22:19:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b8ea00640 1 -- 172.21.15.5:0/3406296282 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b90019020 con 0x7f5b98161ab0 2024-08-18T22:19:47.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b8ea00640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b740678c0 0x7f5b74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:47.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.826+0000 7f5b8ea00640 1 -- 172.21.15.5:0/3406296282 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5b90085360 con 0x7f5b98161ab0 2024-08-18T22:19:47.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.830+0000 7f5b95e00640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b740678c0 0x7f5b74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:47.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.830+0000 7f5b95e00640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b740678c0 0x7f5b74069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b88003fd0 tx=0x7f5b88003a00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:47.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:47.834+0000 7f5b8ea00640 1 -- 172.21.15.5:0/3406296282 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5b981e8c00 con 0x7f5b98161ab0 2024-08-18T22:19:48.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 -- 172.21.15.5:0/3406296282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5b980d35b0 con 0x7f5b98161ab0 2024-08-18T22:19:48.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b8ea00640 1 -- 172.21.15.5:0/3406296282 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5b98159a90 con 0x7f5b98161ab0 2024-08-18T22:19:48.039 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:48.039 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-18T22:19:48.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 -- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b740678c0 msgr2=0x7f5b74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b740678c0 0x7f5b74069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b88003fd0 tx=0x7f5b88003a00 comp rx=0 tx=0).stop 2024-08-18T22:19:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 -- 172.21.15.5:0/3406296282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b98161ab0 msgr2=0x7f5b981e8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b98161ab0 0x7f5b981e8610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c340 tx=0x7f5b9000c800 comp rx=0 tx=0).stop 2024-08-18T22:19:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 -- 172.21.15.5:0/3406296282 shutdown_connections 2024-08-18T22:19:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b740678c0 0x7f5b74069d80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b98161ab0 0x7f5b981e8610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b981616d0 0x7f5b980c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 --2- 172.21.15.5:0/3406296282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b980b7500 0x7f5b98159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 -- 172.21.15.5:0/3406296282 >> 172.21.15.5:0/3406296282 conn(0x7f5b9809d4b0 msgr2=0x7f5b98161e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 -- 172.21.15.5:0/3406296282 shutdown_connections 2024-08-18T22:19:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.034+0000 7f5b97200640 1 -- 172.21.15.5:0/3406296282 wait complete. 2024-08-18T22:19:48.060 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-18T22:19:48.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:19:48.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.194+0000 7f481b400640 1 Processor -- start 2024-08-18T22:19:48.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.194+0000 7f481b400640 1 -- start start 2024-08-18T22:19:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.194+0000 7f481b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4814070730 0x7f4814070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.194+0000 7f481b400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f481415dda0 0x7f481415e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.194+0000 7f481b400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4814070430 con 0x7f4814161960 2024-08-18T22:19:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.194+0000 7f481b400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f481415fcc0 con 0x7f481415dda0 2024-08-18T22:19:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f481b400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f48140710b0 con 0x7f4814070730 2024-08-18T22:19:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4818a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4814161960 0x7f481406fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38728/0 (socket says 172.21.15.5:38728) 2024-08-18T22:19:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4818a00640 1 -- 172.21.15.5:0/2885707816 learned_addr learned my addr 172.21.15.5:0/2885707816 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:48.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f480be00640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4814070730 0x7f4814070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4819400640 1 --2- 172.21.15.5:0/2885707816 >> v2:172.21.15.117:3300/0 conn(0x7f481415dda0 0x7f481415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1071452472 0 0) 0x7f4814070430 con 0x7f4814161960 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f8003530 con 0x7f4814161960 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3650266439 0 0) 0x7f47f8003530 con 0x7f4814161960 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4814070730 msgr2=0x7f4814070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4814070730 0x7f4814070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 >> v2:172.21.15.117:3300/0 conn(0x7f481415dda0 msgr2=0x7f481415e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 --2- 172.21.15.5:0/2885707816 >> v2:172.21.15.117:3300/0 conn(0x7f481415dda0 0x7f481415e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481415eb60 con 0x7f4814161960 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f4804001680 con 0x7f4814161960 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 >> v1:172.21.15.5:6789/0 conn(0x7f4814161960 legacy=0x7f481406fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f80039c0 0x7f47f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4814070730 0x7f47f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f8004d50 0x7f47f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f48140710b0 con 0x7f47f80039c0 2024-08-18T22:19:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47f800b9d0 con 0x7f47f8004d50 2024-08-18T22:19:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f47f800bb50 con 0x7f4814070730 2024-08-18T22:19:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4818a00640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f80039c0 0x7f47f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f480be00640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4814070730 0x7f47f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4819400640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f8004d50 0x7f47f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4818a00640 1 -- 172.21.15.5:0/2885707816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4814070730 msgr2=0x7f47f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4818a00640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4814070730 0x7f47f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4818a00640 1 -- 172.21.15.5:0/2885707816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f8004d50 msgr2=0x7f47f80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4818a00640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f8004d50 0x7f47f80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.198+0000 7f4818a00640 1 -- 172.21.15.5:0/2885707816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f8003530 con 0x7f47f80039c0 2024-08-18T22:19:48.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f4818a00640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f80039c0 0x7f47f8003de0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f480400c270 tx=0x7f480401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d8c4a54b4be876 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:48.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804007d60 con 0x7f47f80039c0 2024-08-18T22:19:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48040a9020 con 0x7f47f80039c0 2024-08-18T22:19:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f4813e00640 1 -- 172.21.15.5:0/2885707816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804005ae0 con 0x7f47f80039c0 2024-08-18T22:19:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f481b400640 1 -- 172.21.15.5:0/2885707816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f80039c0 msgr2=0x7f47f8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f481b400640 1 --2- 172.21.15.5:0/2885707816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47f80039c0 0x7f47f8003de0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f480400c270 tx=0x7f480401ccc0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f4819400640 1 -- 172.21.15.5:0/2885707816 reap_dead start 2024-08-18T22:19:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f481b400640 1 -- 172.21.15.5:0/2885707816 shutdown_connections 2024-08-18T22:19:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f481b400640 1 -- 172.21.15.5:0/2885707816 >> 172.21.15.5:0/2885707816 conn(0x7f48140d2130 msgr2=0x7f48140d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f481b400640 1 -- 172.21.15.5:0/2885707816 shutdown_connections 2024-08-18T22:19:48.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f481b400640 1 -- 172.21.15.5:0/2885707816 wait complete. 2024-08-18T22:19:48.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f481b400640 1 Processor -- start 2024-08-18T22:19:48.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f481b400640 1 -- start start 2024-08-18T22:19:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.202+0000 7f481b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f80039c0 0x7f48140c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f481b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48140cb260 0x7f481415c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f481b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f481415c7a0 0x7f48140cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f481b400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f481409ba30 con 0x7f481415c7a0 2024-08-18T22:19:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f481b400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f481415f6e0 con 0x7f47f80039c0 2024-08-18T22:19:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f481b400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f48140ca250 con 0x7f48140cb260 2024-08-18T22:19:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4818a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f80039c0 0x7f48140c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4819400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f481415c7a0 0x7f48140cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4818a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f80039c0 0x7f48140c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40362/0 (socket says 172.21.15.5:40362) 2024-08-18T22:19:48.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4818a00640 1 -- 172.21.15.5:0/3201750268 learned_addr learned my addr 172.21.15.5:0/3201750268 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f480be00640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48140cb260 0x7f481415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4818a00640 1 -- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48140cb260 msgr2=0x7f481415c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4818a00640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48140cb260 0x7f481415c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4818a00640 1 -- 172.21.15.5:0/3201750268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f481415c7a0 msgr2=0x7f48140cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4818a00640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f481415c7a0 0x7f48140cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4818a00640 1 -- 172.21.15.5:0/3201750268 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48140ca4a0 con 0x7f47f80039c0 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4819400640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f481415c7a0 0x7f48140cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4818a00640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f80039c0 0x7f48140c7e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f48040ab040 tx=0x7f47f8005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4811600640 1 -- 172.21.15.5:0/3201750268 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48040049f0 con 0x7f47f80039c0 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4811600640 1 -- 172.21.15.5:0/3201750268 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4804004b90 con 0x7f47f80039c0 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f481b400640 1 -- 172.21.15.5:0/3201750268 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48140ca780 con 0x7f47f80039c0 2024-08-18T22:19:48.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4811600640 1 -- 172.21.15.5:0/3201750268 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48040070d0 con 0x7f47f80039c0 2024-08-18T22:19:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f481b400640 1 -- 172.21.15.5:0/3201750268 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48140cad40 con 0x7f47f80039c0 2024-08-18T22:19:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f481b400640 1 -- 172.21.15.5:0/3201750268 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48140d0d80 con 0x7f47f80039c0 2024-08-18T22:19:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.206+0000 7f4811600640 1 -- 172.21.15.5:0/3201750268 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4804007270 con 0x7f47f80039c0 2024-08-18T22:19:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.210+0000 7f4811600640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47f00678c0 0x7f47f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.210+0000 7f4811600640 1 -- 172.21.15.5:0/3201750268 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f480411f4b0 con 0x7f47f80039c0 2024-08-18T22:19:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.210+0000 7f480be00640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47f00678c0 0x7f47f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.210+0000 7f480be00640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47f00678c0 0x7f47f0069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48140b8190 tx=0x7f47fc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:48.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.210+0000 7f4811600640 1 -- 172.21.15.5:0/3201750268 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f48040169d0 con 0x7f47f80039c0 2024-08-18T22:19:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.410+0000 7f481b400640 1 -- 172.21.15.5:0/3201750268 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f481409bbb0 con 0x7f47f80039c0 2024-08-18T22:19:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f4811600640 1 -- 172.21.15.5:0/3201750268 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7f48040efd20 con 0x7f47f80039c0 2024-08-18T22:19:48.423 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:48.423 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"btime":"2024-08-18T22:19:41:376873+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4007066150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4007066150},{"type":"v1","addr":"172.21.15.117:6836","nonce":4007066150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1179279001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1179279001},{"type":"v1","addr":"172.21.15.117:6837","nonce":1179279001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:19:20.503823+0000","modified":"2024-08-18T22:19:40.761749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3727670717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3727670717},{"type":"v1","addr":"172.21.15.5:6835","nonce":3727670717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-08-18T22:19:48.424 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-08-18T22:19:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 -- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47f00678c0 msgr2=0x7f47f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47f00678c0 0x7f47f0069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48140b8190 tx=0x7f47fc009190 comp rx=0 tx=0).stop 2024-08-18T22:19:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 -- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f80039c0 msgr2=0x7f48140c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f80039c0 0x7f48140c7e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f48040ab040 tx=0x7f47f8005840 comp rx=0 tx=0).stop 2024-08-18T22:19:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 -- 172.21.15.5:0/3201750268 shutdown_connections 2024-08-18T22:19:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47f00678c0 0x7f47f0069d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f481415c7a0 0x7f48140cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48140cb260 0x7f481415c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 --2- 172.21.15.5:0/3201750268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f80039c0 0x7f48140c7e00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 -- 172.21.15.5:0/3201750268 >> 172.21.15.5:0/3201750268 conn(0x7f48140d2130 msgr2=0x7f4814164e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 -- 172.21.15.5:0/3201750268 shutdown_connections 2024-08-18T22:19:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.422+0000 7f481b400640 1 -- 172.21.15.5:0/3201750268 wait complete. 2024-08-18T22:19:48.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:19:48.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.578+0000 7f15e5800640 1 Processor -- start 2024-08-18T22:19:48.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.578+0000 7f15e5800640 1 -- start start 2024-08-18T22:19:48.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.582+0000 7f15e5800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f15e00b3ea0 0x7f15e00af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.582+0000 7f15e5800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e015fc80 con 0x7f15e015c1f0 2024-08-18T22:19:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.582+0000 7f15e5800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e015fef0 con 0x7f15e00b5280 2024-08-18T22:19:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.582+0000 7f15e5800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f15e00b4350 con 0x7f15e00b3ea0 2024-08-18T22:19:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.582+0000 7f15dea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f15e015c1f0 0x7f15e00b4b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38744/0 (socket says 172.21.15.5:38744) 2024-08-18T22:19:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.582+0000 7f15dea00640 1 -- 172.21.15.5:0/835650579 learned_addr learned my addr 172.21.15.5:0/835650579 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.582+0000 7f15df400640 1 --2- 172.21.15.5:0/835650579 >> v2:172.21.15.5:3300/0 conn(0x7f15e00b3ea0 0x7f15e00af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.582+0000 7f15df400640 1 -- 172.21.15.5:0/835650579 >> v1:172.21.15.117:6789/0 conn(0x7f15e00b5280 legacy=0x7f15e0071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.582+0000 7f15df400640 1 -- 172.21.15.5:0/835650579 >> v1:172.21.15.5:6789/0 conn(0x7f15e015c1f0 legacy=0x7f15e00b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.582+0000 7f15de000640 1 -- 172.21.15.5:0/835650579 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1524279577 0 0) 0x7f15e015fc80 con 0x7f15e015c1f0 2024-08-18T22:19:48.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.582+0000 7f15df400640 1 -- 172.21.15.5:0/835650579 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e01601d0 con 0x7f15e00b3ea0 2024-08-18T22:19:48.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15df400640 1 --2- 172.21.15.5:0/835650579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00b3ea0 0x7f15e00af670 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009d90 tx=0x7f15d801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714c1b39b1f00794 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:48.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15de000640 1 -- 172.21.15.5:0/835650579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d80b2070 con 0x7f15e00b3ea0 2024-08-18T22:19:48.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15de000640 1 -- 172.21.15.5:0/835650579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d80a57a0 con 0x7f15e00b3ea0 2024-08-18T22:19:48.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15de000640 1 -- 172.21.15.5:0/835650579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d80a5b70 con 0x7f15e00b3ea0 2024-08-18T22:19:48.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15e5800640 1 -- 172.21.15.5:0/835650579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00b3ea0 msgr2=0x7f15e00af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15e5800640 1 --2- 172.21.15.5:0/835650579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00b3ea0 0x7f15e00af670 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009d90 tx=0x7f15d801c8e0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15e5800640 1 -- 172.21.15.5:0/835650579 shutdown_connections 2024-08-18T22:19:48.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15e5800640 1 --2- 172.21.15.5:0/835650579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e00b3ea0 0x7f15e00af670 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15e5800640 1 -- 172.21.15.5:0/835650579 >> 172.21.15.5:0/835650579 conn(0x7f15e00cce50 msgr2=0x7f15e00cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:48.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15e5800640 1 -- 172.21.15.5:0/835650579 shutdown_connections 2024-08-18T22:19:48.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15e5800640 1 -- 172.21.15.5:0/835650579 wait complete. 2024-08-18T22:19:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15e5800640 1 Processor -- start 2024-08-18T22:19:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15e5800640 1 -- start start 2024-08-18T22:19:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.586+0000 7f15e5800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e00b3ea0 0x7f15e00cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15e5800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e00b5280 0x7f15e00cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15e5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e015c1f0 0x7f15e014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15e5800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0169f00 con 0x7f15e015c1f0 2024-08-18T22:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15e5800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0169d80 con 0x7f15e00b3ea0 2024-08-18T22:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15e5800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f15e016a080 con 0x7f15e00b5280 2024-08-18T22:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15dea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e00b3ea0 0x7f15e00cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15dea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e00b3ea0 0x7f15e00cfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:40372/0 (socket says 172.21.15.5:40372) 2024-08-18T22:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15df400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e015c1f0 0x7f15e014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15dea00640 1 -- 172.21.15.5:0/2501586267 learned_addr learned my addr 172.21.15.5:0/2501586267 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15d6000640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e00b5280 0x7f15e00cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15dea00640 1 -- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e00b5280 msgr2=0x7f15e00cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15dea00640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e00b5280 0x7f15e00cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15dea00640 1 -- 172.21.15.5:0/2501586267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e015c1f0 msgr2=0x7f15e014f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15dea00640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e015c1f0 0x7f15e014f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15dea00640 1 -- 172.21.15.5:0/2501586267 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e00cdf80 con 0x7f15e00b3ea0 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15df400640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e015c1f0 0x7f15e014f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15dea00640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e00b3ea0 0x7f15e00cfe70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f15d000c4a0 tx=0x7f15d000c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15d7400640 1 -- 172.21.15.5:0/2501586267 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0018070 con 0x7f15e00b3ea0 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15d7400640 1 -- 172.21.15.5:0/2501586267 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d00074e0 con 0x7f15e00b3ea0 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15e5800640 1 -- 172.21.15.5:0/2501586267 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e0155970 con 0x7f15e00b3ea0 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15d7400640 1 -- 172.21.15.5:0/2501586267 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0004a30 con 0x7f15e00b3ea0 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15e5800640 1 -- 172.21.15.5:0/2501586267 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e00ce240 con 0x7f15e00b3ea0 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15e5800640 1 -- 172.21.15.5:0/2501586267 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e00686c0 con 0x7f15e00b3ea0 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.590+0000 7f15d7400640 1 -- 172.21.15.5:0/2501586267 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15d001b070 con 0x7f15e00b3ea0 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.594+0000 7f15d7400640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15bc0678c0 0x7f15bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.594+0000 7f15d7400640 1 -- 172.21.15.5:0/2501586267 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f15d0085540 con 0x7f15e00b3ea0 2024-08-18T22:19:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.594+0000 7f15d6000640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15bc0678c0 0x7f15bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.594+0000 7f15d6000640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15bc0678c0 0x7f15bc069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f15e0074ad0 tx=0x7f15c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.594+0000 7f15d7400640 1 -- 172.21.15.5:0/2501586267 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f15d0055760 con 0x7f15e00b3ea0 2024-08-18T22:19:48.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.794+0000 7f15e5800640 1 -- 172.21.15.5:0/2501586267 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15e006ce30 con 0x7f15e00b3ea0 2024-08-18T22:19:48.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15d7400640 1 -- 172.21.15.5:0/2501586267 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7f15d0059a60 con 0x7f15e00b3ea0 2024-08-18T22:19:48.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:48.802 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"btime":"2024-08-18T22:19:41:376873+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4007066150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4007066150},{"type":"v1","addr":"172.21.15.117:6836","nonce":4007066150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1179279001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1179279001},{"type":"v1","addr":"172.21.15.117:6837","nonce":1179279001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:19:20.503823+0000","modified":"2024-08-18T22:19:40.761749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3727670717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3727670717},{"type":"v1","addr":"172.21.15.5:6835","nonce":3727670717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-08-18T22:19:48.802 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 -- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15bc0678c0 msgr2=0x7f15bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15bc0678c0 0x7f15bc069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f15e0074ad0 tx=0x7f15c8009040 comp rx=0 tx=0).stop 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 -- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e00b3ea0 msgr2=0x7f15e00cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e00b3ea0 0x7f15e00cfe70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f15d000c4a0 tx=0x7f15d000c960 comp rx=0 tx=0).stop 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 -- 172.21.15.5:0/2501586267 shutdown_connections 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15bc0678c0 0x7f15bc069d80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15e015c1f0 0x7f15e014f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e00b5280 0x7f15e00cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 --2- 172.21.15.5:0/2501586267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e00b3ea0 0x7f15e00cfe70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 -- 172.21.15.5:0/2501586267 >> 172.21.15.5:0/2501586267 conn(0x7f15e00cce50 msgr2=0x7f15e00cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 -- 172.21.15.5:0/2501586267 shutdown_connections 2024-08-18T22:19:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.798+0000 7f15e5800640 1 -- 172.21.15.5:0/2501586267 wait complete. 2024-08-18T22:19:48.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 Processor -- start 2024-08-18T22:19:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 -- start start 2024-08-18T22:19:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f908c15b010 0x7f908c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f908c0cd3a0 0x7f908c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f908c0cee20 con 0x7f908c06f0c0 2024-08-18T22:19:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f908c0cfa30 con 0x7f908c0cd3a0 2024-08-18T22:19:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f908c0cf100 con 0x7f908c15b010 2024-08-18T22:19:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9083400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f908c0cd3a0 0x7f908c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9083400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f908c0cd3a0 0x7f908c06eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40796/0 (socket says 172.21.15.5:40796) 2024-08-18T22:19:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9083400640 1 -- 172.21.15.5:0/3234171903 learned_addr learned my addr 172.21.15.5:0/3234171903 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f908be00640 1 --2- 172.21.15.5:0/3234171903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f908c15b010 0x7f908c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9083400640 1 -- 172.21.15.5:0/3234171903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f908c15b010 msgr2=0x7f908c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9083400640 1 --2- 172.21.15.5:0/3234171903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f908c15b010 0x7f908c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9083400640 1 -- 172.21.15.5:0/3234171903 >> v1:172.21.15.117:6789/0 conn(0x7f908c06f0c0 legacy=0x7f908c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9083400640 1 -- 172.21.15.5:0/3234171903 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c0cf3e0 con 0x7f908c0cd3a0 2024-08-18T22:19:48.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9083400640 1 --2- 172.21.15.5:0/3234171903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f908c0cd3a0 0x7f908c06eb80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9074009870 tx=0x7f907401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f8cdb821325f6a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f908b400640 1 -- 172.21.15.5:0/3234171903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90740b2070 con 0x7f908c0cd3a0 2024-08-18T22:19:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f908b400640 1 -- 172.21.15.5:0/3234171903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90740a9070 con 0x7f908c0cd3a0 2024-08-18T22:19:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f908b400640 1 -- 172.21.15.5:0/3234171903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90740ad880 con 0x7f908c0cd3a0 2024-08-18T22:19:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 -- 172.21.15.5:0/3234171903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f908c0cd3a0 msgr2=0x7f908c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 --2- 172.21.15.5:0/3234171903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f908c0cd3a0 0x7f908c06eb80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9074009870 tx=0x7f907401c520 comp rx=0 tx=0).stop 2024-08-18T22:19:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 -- 172.21.15.5:0/3234171903 shutdown_connections 2024-08-18T22:19:48.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 --2- 172.21.15.5:0/3234171903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f908c0cd3a0 0x7f908c06eb80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 --2- 172.21.15.5:0/3234171903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f908c15b010 0x7f908c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 -- 172.21.15.5:0/3234171903 >> 172.21.15.5:0/3234171903 conn(0x7f908c0b1c50 msgr2=0x7f908c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:48.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 -- 172.21.15.5:0/3234171903 shutdown_connections 2024-08-18T22:19:48.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.962+0000 7f9092c00640 1 -- 172.21.15.5:0/3234171903 wait complete. 2024-08-18T22:19:48.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9092c00640 1 Processor -- start 2024-08-18T22:19:48.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9092c00640 1 -- start start 2024-08-18T22:19:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9092c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f908c06f0c0 0x7f908c146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9092c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f908c0cd3a0 0x7f908c156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9092c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f908c15b010 0x7f908c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9092c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f908c167dd0 con 0x7f908c06f0c0 2024-08-18T22:19:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9092c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f908c167c50 con 0x7f908c0cd3a0 2024-08-18T22:19:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9092c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f908c167f50 con 0x7f908c15b010 2024-08-18T22:19:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f908be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f908c06f0c0 0x7f908c146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f908be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f908c06f0c0 0x7f908c146b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40808/0 (socket says 172.21.15.5:40808) 2024-08-18T22:19:48.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f908be00640 1 -- 172.21.15.5:0/572963286 learned_addr learned my addr 172.21.15.5:0/572963286 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9090c00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f908c15b010 0x7f908c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f908be00640 1 -- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f908c15b010 msgr2=0x7f908c156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9083400640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f908c0cd3a0 0x7f908c156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f908be00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f908c15b010 0x7f908c156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f908be00640 1 -- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f908c0cd3a0 msgr2=0x7f908c156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f908be00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f908c0cd3a0 0x7f908c156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f908be00640 1 -- 172.21.15.5:0/572963286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c09bec0 con 0x7f908c06f0c0 2024-08-18T22:19:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9090c00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f908c15b010 0x7f908c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9083400640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f908c0cd3a0 0x7f908c156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f908be00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f908c06f0c0 0x7f908c146b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f907c00d5f0 tx=0x7f907c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9088c00640 1 -- 172.21.15.5:0/572963286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c0125f0 con 0x7f908c06f0c0 2024-08-18T22:19:48.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9088c00640 1 -- 172.21.15.5:0/572963286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907c019070 con 0x7f908c06f0c0 2024-08-18T22:19:48.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9088c00640 1 -- 172.21.15.5:0/572963286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c0129b0 con 0x7f908c06f0c0 2024-08-18T22:19:48.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9092c00640 1 -- 172.21.15.5:0/572963286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908c09bbe0 con 0x7f908c06f0c0 2024-08-18T22:19:48.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.966+0000 7f9092c00640 1 -- 172.21.15.5:0/572963286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908c09cf90 con 0x7f908c06f0c0 2024-08-18T22:19:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.970+0000 7f9092c00640 1 -- 172.21.15.5:0/572963286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f908c0af070 con 0x7f908c06f0c0 2024-08-18T22:19:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.970+0000 7f9088c00640 1 -- 172.21.15.5:0/572963286 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f907c012b50 con 0x7f908c06f0c0 2024-08-18T22:19:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.970+0000 7f9088c00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90680678c0 0x7f9068069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.970+0000 7f9088c00640 1 -- 172.21.15.5:0/572963286 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f907c086420 con 0x7f908c06f0c0 2024-08-18T22:19:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.970+0000 7f9083400640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90680678c0 0x7f9068069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.970+0000 7f9083400640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90680678c0 0x7f9068069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f90740af000 tx=0x7f90740a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:48.974+0000 7f9088c00640 1 -- 172.21.15.5:0/572963286 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f907c056c10 con 0x7f908c06f0c0 2024-08-18T22:19:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.146+0000 7f9092c00640 1 -- 172.21.15.5:0/572963286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f908c06eb40 con 0x7f908c06f0c0 2024-08-18T22:19:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.146+0000 7f9088c00640 1 -- 172.21.15.5:0/572963286 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18442 (secure 0 0 0) 0x7f907c056510 con 0x7f908c06f0c0 2024-08-18T22:19:49.148 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:49.148 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:25.756631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:19:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 -- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90680678c0 msgr2=0x7f9068069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90680678c0 0x7f9068069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f90740af000 tx=0x7f90740a7000 comp rx=0 tx=0).stop 2024-08-18T22:19:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 -- 172.21.15.5:0/572963286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f908c06f0c0 msgr2=0x7f908c146b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f908c06f0c0 0x7f908c146b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f907c00d5f0 tx=0x7f907c00dab0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 -- 172.21.15.5:0/572963286 shutdown_connections 2024-08-18T22:19:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90680678c0 0x7f9068069d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f908c15b010 0x7f908c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f908c0cd3a0 0x7f908c156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 --2- 172.21.15.5:0/572963286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f908c06f0c0 0x7f908c146b80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 -- 172.21.15.5:0/572963286 >> 172.21.15.5:0/572963286 conn(0x7f908c0b1c50 msgr2=0x7f908c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 -- 172.21.15.5:0/572963286 shutdown_connections 2024-08-18T22:19:49.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.150+0000 7f9092c00640 1 -- 172.21.15.5:0/572963286 wait complete. 2024-08-18T22:19:49.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:19:49.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.306+0000 7f8f9ca00640 1 Processor -- start 2024-08-18T22:19:49.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.306+0000 7f8f9ca00640 1 -- start start 2024-08-18T22:19:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f9ca00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8f98161960 0x7f8f9806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f9ca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9815e4b0 0x7f8f98070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f9ca00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f9815eb60 con 0x7f8f98070730 2024-08-18T22:19:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f9ca00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8f9815e940 con 0x7f8f98161960 2024-08-18T22:19:49.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f9ca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8f980710e0 con 0x7f8f9815e4b0 2024-08-18T22:19:49.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f95400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8f98070730 0x7f8f9815dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38746/0 (socket says 172.21.15.5:38746) 2024-08-18T22:19:49.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f95400640 1 -- 172.21.15.5:0/1460852403 learned_addr learned my addr 172.21.15.5:0/1460852403 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:49.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f95e00640 1 --2- 172.21.15.5:0/1460852403 >> v2:172.21.15.117:3300/0 conn(0x7f8f98161960 0x7f8f9806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:49.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f96800640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9815e4b0 0x7f8f98070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:49.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810995809 0 0) 0x7f8f9815eb60 con 0x7f8f98070730 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f7c003530 con 0x7f8f98070730 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 7951899 0 0) 0x7f8f7c003530 con 0x7f8f98070730 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9815e4b0 msgr2=0x7f8f98070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9815e4b0 0x7f8f98070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 >> v2:172.21.15.117:3300/0 conn(0x7f8f98161960 msgr2=0x7f8f9806fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 --2- 172.21.15.5:0/1460852403 >> v2:172.21.15.117:3300/0 conn(0x7f8f98161960 0x7f8f9806fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9815ee40 con 0x7f8f98070730 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f8f84001680 con 0x7f8f98070730 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 >> v1:172.21.15.5:6789/0 conn(0x7f8f98070730 legacy=0x7f8f9815dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c0039c0 0x7f8f7c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f7c004810 0x7f8f7c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7c0051d0 0x7f8f7c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9815e940 con 0x7f8f7c0039c0 2024-08-18T22:19:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8f980710e0 con 0x7f8f7c004810 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8f7c00bf10 con 0x7f8f7c0051d0 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f95e00640 1 --2- 172.21.15.5:0/1460852403 >> v2:172.21.15.117:3300/0 conn(0x7f8f98161960 0x7f8f9806fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f96800640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9815e4b0 0x7f8f98070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f95e00640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c0039c0 0x7f8f7c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f95400640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f7c004810 0x7f8f7c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f96800640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7c0051d0 0x7f8f7c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f95e00640 1 -- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7c0051d0 msgr2=0x7f8f7c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f95e00640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7c0051d0 0x7f8f7c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f95e00640 1 -- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f7c004810 msgr2=0x7f8f7c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f95e00640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f7c004810 0x7f8f7c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f95e00640 1 -- 172.21.15.5:0/1460852403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7c003530 con 0x7f8f7c0039c0 2024-08-18T22:19:49.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.310+0000 7f8f96800640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7c0051d0 0x7f8f7c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.314+0000 7f8f95e00640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c0039c0 0x7f8f7c003de0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009cc0 tx=0x7f8f8801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ac85a082438f01 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.314+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f88009860 con 0x7f8f7c0039c0 2024-08-18T22:19:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.314+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f88004020 con 0x7f8f7c0039c0 2024-08-18T22:19:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.314+0000 7f8f94a00640 1 -- 172.21.15.5:0/1460852403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f88004410 con 0x7f8f7c0039c0 2024-08-18T22:19:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.314+0000 7f8f9ca00640 1 -- 172.21.15.5:0/1460852403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c0039c0 msgr2=0x7f8f7c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.314+0000 7f8f9ca00640 1 --2- 172.21.15.5:0/1460852403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c0039c0 0x7f8f7c003de0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009cc0 tx=0x7f8f8801cc50 comp rx=0 tx=0).stop 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.314+0000 7f8f96800640 1 -- 172.21.15.5:0/1460852403 reap_dead start 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.314+0000 7f8f9ca00640 1 -- 172.21.15.5:0/1460852403 shutdown_connections 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.314+0000 7f8f9ca00640 1 -- 172.21.15.5:0/1460852403 >> 172.21.15.5:0/1460852403 conn(0x7f8f980d2130 msgr2=0x7f8f980d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.314+0000 7f8f9ca00640 1 -- 172.21.15.5:0/1460852403 shutdown_connections 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.314+0000 7f8f9ca00640 1 -- 172.21.15.5:0/1460852403 wait complete. 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f9ca00640 1 Processor -- start 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f9ca00640 1 -- start start 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f9ca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7c0039c0 0x7f8f9815dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f9ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f980b6570 0x7f8f980b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f9ca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f98165ab0 0x7f8f98165f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f9ca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9809ba30 con 0x7f8f980b6570 2024-08-18T22:19:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f9ca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8f98070260 con 0x7f8f98165ab0 2024-08-18T22:19:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f9ca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8f98166870 con 0x7f8f7c0039c0 2024-08-18T22:19:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f95400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f980b6570 0x7f8f980b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f95400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f980b6570 0x7f8f980b69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40830/0 (socket says 172.21.15.5:40830) 2024-08-18T22:19:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f95400640 1 -- 172.21.15.5:0/294189985 learned_addr learned my addr 172.21.15.5:0/294189985 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f95e00640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7c0039c0 0x7f8f9815dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f96800640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f98165ab0 0x7f8f98165f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f95400640 1 -- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7c0039c0 msgr2=0x7f8f9815dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f95400640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7c0039c0 0x7f8f9815dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f95400640 1 -- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f98165ab0 msgr2=0x7f8f98165f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:49.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f95400640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f98165ab0 0x7f8f98165f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f95400640 1 -- 172.21.15.5:0/294189985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f98166b50 con 0x7f8f980b6570 2024-08-18T22:19:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f96800640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f98165ab0 0x7f8f98165f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f95400640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f980b6570 0x7f8f980b69f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8f84004f80 tx=0x7f8f840074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f8e000640 1 -- 172.21.15.5:0/294189985 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400f7b0 con 0x7f8f980b6570 2024-08-18T22:19:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f8e000640 1 -- 172.21.15.5:0/294189985 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f84018070 con 0x7f8f980b6570 2024-08-18T22:19:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f9ca00640 1 -- 172.21.15.5:0/294189985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f98166e30 con 0x7f8f980b6570 2024-08-18T22:19:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f8e000640 1 -- 172.21.15.5:0/294189985 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400fbb0 con 0x7f8f980b6570 2024-08-18T22:19:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f9ca00640 1 -- 172.21.15.5:0/294189985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9815e200 con 0x7f8f980b6570 2024-08-18T22:19:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.318+0000 7f8f9ca00640 1 -- 172.21.15.5:0/294189985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f98167350 con 0x7f8f980b6570 2024-08-18T22:19:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.322+0000 7f8f8e000640 1 -- 172.21.15.5:0/294189985 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f8401d460 con 0x7f8f980b6570 2024-08-18T22:19:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.322+0000 7f8f8e000640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f780678f0 0x7f8f78069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.322+0000 7f8f8e000640 1 -- 172.21.15.5:0/294189985 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8f840860f0 con 0x7f8f980b6570 2024-08-18T22:19:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.322+0000 7f8f95e00640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f780678f0 0x7f8f78069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.322+0000 7f8f95e00640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f780678f0 0x7f8f78069db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f880ae000 tx=0x7f8f880046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:49.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.326+0000 7f8f8e000640 1 -- 172.21.15.5:0/294189985 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8f98167350 con 0x7f8f980b6570 2024-08-18T22:19:49.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 -- 172.21.15.5:0/294189985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f9815eb60 con 0x7f8f980b6570 2024-08-18T22:19:49.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f8e000640 1 -- 172.21.15.5:0/294189985 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7f8f840568e0 con 0x7f8f980b6570 2024-08-18T22:19:49.531 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:19:49.531 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"btime":"2024-08-18T22:19:41:376873+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4007066150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4007066150},{"type":"v1","addr":"172.21.15.117:6836","nonce":4007066150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1179279001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1179279001},{"type":"v1","addr":"172.21.15.117:6837","nonce":1179279001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:19:20.503823+0000","modified":"2024-08-18T22:19:40.761749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3727670717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3727670717},{"type":"v1","addr":"172.21.15.5:6835","nonce":3727670717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-08-18T22:19:49.531 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-08-18T22:19:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 -- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f780678f0 msgr2=0x7f8f78069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f780678f0 0x7f8f78069db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f880ae000 tx=0x7f8f880046d0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 -- 172.21.15.5:0/294189985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f980b6570 msgr2=0x7f8f980b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f980b6570 0x7f8f980b69f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8f84004f80 tx=0x7f8f840074f0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 -- 172.21.15.5:0/294189985 shutdown_connections 2024-08-18T22:19:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f780678f0 0x7f8f78069db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f98165ab0 0x7f8f98165f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f980b6570 0x7f8f980b69f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 --2- 172.21.15.5:0/294189985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7c0039c0 0x7f8f9815dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 -- 172.21.15.5:0/294189985 >> 172.21.15.5:0/294189985 conn(0x7f8f980d2130 msgr2=0x7f8f9806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 -- 172.21.15.5:0/294189985 shutdown_connections 2024-08-18T22:19:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:49.530+0000 7f8f9ca00640 1 -- 172.21.15.5:0/294189985 wait complete. 2024-08-18T22:19:49.955 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:19:20.503823+0000', 'modified': '2024-08-18T22:19:40.761749+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/3727670717', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 3727670717}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 3727670717}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4269, 'qdb_cluster': [4269]} 2024-08-18T22:19:49.955 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:19:49.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-18T22:19:50.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463f600640 1 Processor -- start 2024-08-18T22:19:50.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463f600640 1 -- start start 2024-08-18T22:19:50.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46380d15e0 0x7f46380b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463f600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46380d30b0 con 0x7f463815fb80 2024-08-18T22:19:50.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463f600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46380d1bd0 con 0x7f46380d1090 2024-08-18T22:19:50.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4638071c60 con 0x7f46380d15e0 2024-08-18T22:19:50.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463cc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f463815fb80 0x7f463806fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38750/0 (socket says 172.21.15.5:38750) 2024-08-18T22:19:50.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463cc00640 1 -- 172.21.15.5:0/1877288048 learned_addr learned my addr 172.21.15.5:0/1877288048 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:50.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463d600640 1 --2- 172.21.15.5:0/1877288048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46380d15e0 0x7f46380b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f4637e00640 1 -- 172.21.15.5:0/1877288048 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720400734 0 0) 0x7f46380d30b0 con 0x7f463815fb80 2024-08-18T22:19:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f4637e00640 1 -- 172.21.15.5:0/1877288048 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f461c003530 con 0x7f463815fb80 2024-08-18T22:19:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f4637e00640 1 -- 172.21.15.5:0/1877288048 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273253514 0 0) 0x7f46380d1bd0 con 0x7f46380d1090 2024-08-18T22:19:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f4637e00640 1 -- 172.21.15.5:0/1877288048 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46380d30b0 con 0x7f46380d1090 2024-08-18T22:19:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463d600640 1 -- 172.21.15.5:0/1877288048 >> v1:172.21.15.117:6789/0 conn(0x7f46380d1090 legacy=0x7f4638071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463d600640 1 -- 172.21.15.5:0/1877288048 >> v1:172.21.15.5:6789/0 conn(0x7f463815fb80 legacy=0x7f463806fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:50.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.110+0000 7f463d600640 1 -- 172.21.15.5:0/1877288048 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46380d2dd0 con 0x7f46380d15e0 2024-08-18T22:19:50.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.114+0000 7f463d600640 1 --2- 172.21.15.5:0/1877288048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46380d15e0 0x7f46380b5ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4630009dc0 tx=0x7f463001c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04c1a2807655d4d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:50.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.114+0000 7f4637e00640 1 -- 172.21.15.5:0/1877288048 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46300b2070 con 0x7f46380d15e0 2024-08-18T22:19:50.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.114+0000 7f4637e00640 1 -- 172.21.15.5:0/1877288048 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46300a5730 con 0x7f46380d15e0 2024-08-18T22:19:50.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.114+0000 7f4637e00640 1 -- 172.21.15.5:0/1877288048 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46300a5b00 con 0x7f46380d15e0 2024-08-18T22:19:50.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.114+0000 7f463f600640 1 -- 172.21.15.5:0/1877288048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46380d15e0 msgr2=0x7f46380b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:50.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.114+0000 7f463f600640 1 --2- 172.21.15.5:0/1877288048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46380d15e0 0x7f46380b5ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4630009dc0 tx=0x7f463001c870 comp rx=0 tx=0).stop 2024-08-18T22:19:50.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.114+0000 7f463f600640 1 -- 172.21.15.5:0/1877288048 shutdown_connections 2024-08-18T22:19:50.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.114+0000 7f463f600640 1 --2- 172.21.15.5:0/1877288048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46380d15e0 0x7f46380b5ad0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.114+0000 7f463f600640 1 -- 172.21.15.5:0/1877288048 >> 172.21.15.5:0/1877288048 conn(0x7f46380d2180 msgr2=0x7f46380d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:50.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.114+0000 7f463f600640 1 -- 172.21.15.5:0/1877288048 shutdown_connections 2024-08-18T22:19:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.114+0000 7f463f600640 1 -- 172.21.15.5:0/1877288048 wait complete. 2024-08-18T22:19:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463f600640 1 Processor -- start 2024-08-18T22:19:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463f600640 1 -- start start 2024-08-18T22:19:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463f600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46380d1090 0x7f463814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463f600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46380d15e0 0x7f463806d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463815fb80 0x7f46380cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463f600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f463816a310 con 0x7f46380d15e0 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463f600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f46380d1eb0 con 0x7f46380d1090 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f463816a490 con 0x7f463815fb80 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f462fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46380d15e0 0x7f463806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f462fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46380d15e0 0x7f463806d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40838/0 (socket says 172.21.15.5:40838) 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f462fe00640 1 -- 172.21.15.5:0/3305097199 learned_addr learned my addr 172.21.15.5:0/3305097199 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463d600640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463815fb80 0x7f46380cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463cc00640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46380d1090 0x7f463814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f462fe00640 1 -- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463815fb80 msgr2=0x7f46380cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f462fe00640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463815fb80 0x7f46380cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f462fe00640 1 -- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46380d1090 msgr2=0x7f463814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f462fe00640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46380d1090 0x7f463814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f462fe00640 1 -- 172.21.15.5:0/3305097199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463814e0c0 con 0x7f46380d15e0 2024-08-18T22:19:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463cc00640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46380d1090 0x7f463814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f462fe00640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46380d15e0 0x7f463806d510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f462000c500 tx=0x7f462000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f4635600640 1 -- 172.21.15.5:0/3305097199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46200052d0 con 0x7f46380d15e0 2024-08-18T22:19:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f4635600640 1 -- 172.21.15.5:0/3305097199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4620005490 con 0x7f46380d15e0 2024-08-18T22:19:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f4635600640 1 -- 172.21.15.5:0/3305097199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620012850 con 0x7f46380d15e0 2024-08-18T22:19:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463f600640 1 -- 172.21.15.5:0/3305097199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f463814d630 con 0x7f46380d15e0 2024-08-18T22:19:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.118+0000 7f463f600640 1 -- 172.21.15.5:0/3305097199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f463806e900 con 0x7f46380d15e0 2024-08-18T22:19:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f4635600640 1 -- 172.21.15.5:0/3305097199 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46200129f0 con 0x7f46380d15e0 2024-08-18T22:19:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f4635600640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46140678c0 0x7f4614069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f4635600640 1 -- 172.21.15.5:0/3305097199 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4620085bb0 con 0x7f46380d15e0 2024-08-18T22:19:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f4642b50000 1 Processor -- start 2024-08-18T22:19:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f463cc00640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46140678c0 0x7f4614069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f4642b50000 1 -- start start 2024-08-18T22:19:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f463cc00640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46140678c0 0x7f4614069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f46280011f0 tx=0x7f4628009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f4642b50000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 0x55d1a6621130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f4642b50000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a6621670 0x55d1a65d7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f4642b50000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a65d7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f4642b50000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d1a64bdfd0 con 0x55d1a65d7990 2024-08-18T22:19:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f4642b50000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d1a64243c0 con 0x55d1a6620d50 2024-08-18T22:19:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.122+0000 7f4642b50000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d1a63c9f70 con 0x55d1a6621670 2024-08-18T22:19:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f463d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a65d7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f463cc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 0x55d1a6621130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f463d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a65d7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40852/0 (socket says 172.21.15.5:40852) 2024-08-18T22:19:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f463d600640 1 -- 172.21.15.5:0/1619374779 learned_addr learned my addr 172.21.15.5:0/1619374779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f462fe00640 1 --2- 172.21.15.5:0/1619374779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a6621670 0x55d1a65d7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f463d600640 1 -- 172.21.15.5:0/1619374779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a6621670 msgr2=0x55d1a65d7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f463d600640 1 --2- 172.21.15.5:0/1619374779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a6621670 0x55d1a65d7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f463d600640 1 -- 172.21.15.5:0/1619374779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 msgr2=0x55d1a6621130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f463d600640 1 --2- 172.21.15.5:0/1619374779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 0x55d1a6621130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f463d600640 1 -- 172.21.15.5:0/1619374779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a63be2e0 con 0x55d1a65d7990 2024-08-18T22:19:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f463cc00640 1 --2- 172.21.15.5:0/1619374779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 0x55d1a6621130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f463d600640 1 --2- 172.21.15.5:0/1619374779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a65d7d70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f463001c8b0 tx=0x7f4630004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61095d83d79204f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f462d600640 1 -- 172.21.15.5:0/1619374779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46300be070 con 0x55d1a65d7990 2024-08-18T22:19:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f462d600640 1 -- 172.21.15.5:0/1619374779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46300b3040 con 0x55d1a65d7990 2024-08-18T22:19:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f462d600640 1 -- 172.21.15.5:0/1619374779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46300b2040 con 0x55d1a65d7990 2024-08-18T22:19:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f4642b50000 1 -- 172.21.15.5:0/1619374779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 msgr2=0x55d1a65d7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f4642b50000 1 --2- 172.21.15.5:0/1619374779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a65d7d70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f463001c8b0 tx=0x7f4630004ac0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f4642b50000 1 -- 172.21.15.5:0/1619374779 shutdown_connections 2024-08-18T22:19:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f4642b50000 1 --2- 172.21.15.5:0/1619374779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a65d7d70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f4642b50000 1 --2- 172.21.15.5:0/1619374779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a6621670 0x55d1a65d7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f4642b50000 1 --2- 172.21.15.5:0/1619374779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 0x55d1a6621130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f4642b50000 1 -- 172.21.15.5:0/1619374779 >> 172.21.15.5:0/1619374779 conn(0x55d1a65d3910 msgr2=0x55d1a65d5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f4642b50000 1 -- 172.21.15.5:0/1619374779 shutdown_connections 2024-08-18T22:19:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f4642b50000 1 -- 172.21.15.5:0/1619374779 wait complete. 2024-08-18T22:19:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f4642b50000 1 -- start start 2024-08-18T22:19:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.126+0000 7f4642b50000 1 Processor -- start 2024-08-18T22:19:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a65d7990 0x55d1a660e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 0x55d1a65dcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a6621670 0x55d1a65dd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d1a63cbe40 con 0x55d1a6621670 2024-08-18T22:19:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d1a64e1af0 con 0x55d1a6620d50 2024-08-18T22:19:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d1a6486450 con 0x55d1a65d7990 2024-08-18T22:19:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 10 client.0 _ll_register_callbacks cb 0x55d1a65c2630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:19:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a6621670 0x55d1a65dd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f462fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 0x55d1a65dcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a6621670 0x55d1a65dd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40862/0 (socket says 172.21.15.5:40862) 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463d600640 1 -- 172.21.15.5:0/4048437052 learned_addr learned my addr 172.21.15.5:0/4048437052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463cc00640 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a65d7990 0x55d1a660e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463d600640 1 -- 172.21.15.5:0/4048437052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a65d7990 msgr2=0x55d1a660e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463d600640 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a65d7990 0x55d1a660e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463d600640 1 -- 172.21.15.5:0/4048437052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 msgr2=0x55d1a65dcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463d600640 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 0x55d1a65dcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463d600640 1 -- 172.21.15.5:0/4048437052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1a63abfd0 con 0x55d1a6621670 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f462fe00640 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 0x55d1a65dcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463d600640 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a6621670 0x55d1a65dd0e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4630000f90 tx=0x7f463001b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef6620b67669803 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4626000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4626000640 1 -- 172.21.15.5:0/4048437052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46300b2070 con 0x55d1a6621670 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 1 -- 172.21.15.5:0/4048437052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46300b3040 con 0x55d1a6621670 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4626000640 1 -- 172.21.15.5:0/4048437052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4630003da0 con 0x55d1a6621670 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4626000640 1 -- 172.21.15.5:0/4048437052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f46300d0050 con 0x55d1a6621670 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 10 client.4701 fetch_fsmap learned FSMap version 8 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 1 -- 172.21.15.5:0/4048437052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d1a64a74d0 con 0x55d1a6621670 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4626000640 1 -- 172.21.15.5:0/4048437052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46300b3040 con 0x55d1a6621670 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4626000640 1 -- 172.21.15.5:0/4048437052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f46300d3020 con 0x55d1a6621670 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 10 client.4701 fetch_fsmap finished waiting for FSMap version 8 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 10 client.4701 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 20 client.4701 populate_metadata read hostname 'smithi005' 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55d1a660f4f0 0x55d1a660f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 4 client.4701 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:19:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4642b50000 1 -- 172.21.15.5:0/4048437052 --> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1a63bec00 con 0x55d1a660f4f0 2024-08-18T22:19:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463cc00640 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55d1a660f4f0 0x55d1a660f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f4626000640 10 client.4701 ms_handle_connect on v2:172.21.15.5:6833/3727670717 2024-08-18T22:19:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.130+0000 7f463cc00640 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55d1a660f4f0 0x55d1a660f8d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe13503e53a90452 server_cookie=b46fcd6ade71e834 in_seq=0 out_seq=0 2024-08-18T22:19:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4626000640 1 -- 172.21.15.5:0/4048437052 <== mds.0 v2:172.21.15.5:6833/3727670717 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1a63bec00 con 0x55d1a660f4f0 2024-08-18T22:19:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4626000640 10 client.4701 handle_command_reply: tid=0 2024-08-18T22:19:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 1 client.4701 shutdown 2024-08-18T22:19:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 1 -- 172.21.15.5:0/4048437052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a6621670 msgr2=0x55d1a65dd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a6621670 0x55d1a65dd0e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4630000f90 tx=0x7f463001b0b0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 1 -- 172.21.15.5:0/4048437052 shutdown_connections 2024-08-18T22:19:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a6621670 0x55d1a65dd0e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a6620d50 0x55d1a65dcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55d1a660f4f0 0x55d1a660f8d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 1 --2- 172.21.15.5:0/4048437052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a65d7990 0x55d1a660e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 1 -- 172.21.15.5:0/4048437052 >> 172.21.15.5:0/4048437052 conn(0x55d1a65d3910 msgr2=0x55d1a65d6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4626000640 0 client.4701 ms_handle_reset on v2:172.21.15.5:6833/3727670717 2024-08-18T22:19:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 1 -- 172.21.15.5:0/4048437052 shutdown_connections 2024-08-18T22:19:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 1 -- 172.21.15.5:0/4048437052 wait complete. 2024-08-18T22:19:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.134+0000 7f4642b50000 20 client.4701 trim_cache size 0 max 16384 2024-08-18T22:19:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.150+0000 7f4642b50000 1 Processor -- start 2024-08-18T22:19:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.150+0000 7f4642b50000 1 -- start start 2024-08-18T22:19:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a660e7a0 0x55d1a6638480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a65d3910 0x55d1a6620060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a65d7990 0x55d1a66205a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4638203e10 con 0x55d1a660e7a0 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4638151250 con 0x55d1a65d7990 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f46382037c0 con 0x55d1a65d3910 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f463cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a660e7a0 0x55d1a6638480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f463cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a660e7a0 0x55d1a6638480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40878/0 (socket says 172.21.15.5:40878) 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f463cc00640 1 -- 172.21.15.5:0/1613000616 learned_addr learned my addr 172.21.15.5:0/1613000616 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f463d600640 1 --2- 172.21.15.5:0/1613000616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a65d7990 0x55d1a66205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f462fe00640 1 --2- 172.21.15.5:0/1613000616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a65d3910 0x55d1a6620060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f463cc00640 1 -- 172.21.15.5:0/1613000616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a65d3910 msgr2=0x55d1a6620060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f463cc00640 1 --2- 172.21.15.5:0/1613000616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a65d3910 0x55d1a6620060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f463cc00640 1 -- 172.21.15.5:0/1613000616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a65d7990 msgr2=0x55d1a66205a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f463cc00640 1 --2- 172.21.15.5:0/1613000616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a65d7990 0x55d1a66205a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f463cc00640 1 -- 172.21.15.5:0/1613000616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a641db30 con 0x55d1a660e7a0 2024-08-18T22:19:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f462fe00640 1 --2- 172.21.15.5:0/1613000616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a65d3910 0x55d1a6620060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:19:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f463cc00640 1 --2- 172.21.15.5:0/1613000616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a660e7a0 0x55d1a6638480 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4628005c50 tx=0x7f4628011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aaa71db2d88fb6d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f462cc00640 1 -- 172.21.15.5:0/1613000616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46280075a0 con 0x55d1a660e7a0 2024-08-18T22:19:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f462cc00640 1 -- 172.21.15.5:0/1613000616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4628007740 con 0x55d1a660e7a0 2024-08-18T22:19:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f462cc00640 1 -- 172.21.15.5:0/1613000616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462800e7b0 con 0x55d1a660e7a0 2024-08-18T22:19:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- 172.21.15.5:0/1613000616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a660e7a0 msgr2=0x55d1a6638480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 --2- 172.21.15.5:0/1613000616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a660e7a0 0x55d1a6638480 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4628005c50 tx=0x7f4628011000 comp rx=0 tx=0).stop 2024-08-18T22:19:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- 172.21.15.5:0/1613000616 shutdown_connections 2024-08-18T22:19:50.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 --2- 172.21.15.5:0/1613000616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a65d7990 0x55d1a66205a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 --2- 172.21.15.5:0/1613000616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a65d3910 0x55d1a6620060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 --2- 172.21.15.5:0/1613000616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a660e7a0 0x55d1a6638480 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- 172.21.15.5:0/1613000616 >> 172.21.15.5:0/1613000616 conn(0x55d1a660dfd0 msgr2=0x55d1a661f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- 172.21.15.5:0/1613000616 shutdown_connections 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- 172.21.15.5:0/1613000616 wait complete. 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- start start 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 Processor -- start 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a65d3910 0x55d1a66947e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a6694d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a660e7a0 0x55d1a6635860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d1a63dd1d0 con 0x55d1a65d7990 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d1a63bb900 con 0x55d1a65d3910 2024-08-18T22:19:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.154+0000 7f4642b50000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d1a64236d0 con 0x55d1a660e7a0 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 10 client.0 _ll_register_callbacks cb 0x7f4628001d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f462fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a6694d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f462fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a6694d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40892/0 (socket says 172.21.15.5:40892) 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f462fe00640 1 -- 172.21.15.5:0/3001885254 learned_addr learned my addr 172.21.15.5:0/3001885254 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f463cc00640 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a65d3910 0x55d1a66947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f463d600640 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a660e7a0 0x55d1a6635860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f462fe00640 1 -- 172.21.15.5:0/3001885254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a660e7a0 msgr2=0x55d1a6635860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f462fe00640 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a660e7a0 0x55d1a6635860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f462fe00640 1 -- 172.21.15.5:0/3001885254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a65d3910 msgr2=0x55d1a66947e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f462fe00640 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a65d3910 0x55d1a66947e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f462fe00640 1 -- 172.21.15.5:0/3001885254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1a63d5810 con 0x55d1a65d7990 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f462fe00640 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a6694d20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f462000cec0 tx=0x7f4620000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c758be16090391f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:50.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4626000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4626000640 1 -- 172.21.15.5:0/3001885254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620082060 con 0x55d1a65d7990 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4626000640 1 -- 172.21.15.5:0/3001885254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4620052330 con 0x55d1a65d7990 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 -- 172.21.15.5:0/3001885254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d1a6431af0 con 0x55d1a65d7990 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4626000640 1 -- 172.21.15.5:0/3001885254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f4620079050 con 0x55d1a65d7990 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 10 client.4707 fetch_fsmap learned FSMap version 8 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 -- 172.21.15.5:0/3001885254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d1a63bad30 con 0x55d1a65d7990 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4626000640 1 -- 172.21.15.5:0/3001885254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d1a6431af0 con 0x55d1a65d7990 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4626000640 1 -- 172.21.15.5:0/3001885254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f462007c020 con 0x55d1a65d7990 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 10 client.4707 fetch_fsmap finished waiting for FSMap version 8 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 10 client.4707 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 20 client.4707 populate_metadata read hostname 'smithi005' 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55d1a6620d50 0x55d1a6635da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:50.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 4 client.4707 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:19:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 -- 172.21.15.5:0/3001885254 --> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] -- command(tid 0: {"prefix": "status"}) -- 0x55d1a642be40 con 0x55d1a6620d50 2024-08-18T22:19:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f463cc00640 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55d1a6620d50 0x55d1a6635da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4626000640 10 client.4707 ms_handle_connect on v2:172.21.15.5:6833/3727670717 2024-08-18T22:19:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f463cc00640 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55d1a6620d50 0x55d1a6635da0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9022266b238a3b51 server_cookie=7b0125f9a4c5aeaf in_seq=0 out_seq=0 2024-08-18T22:19:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4626000640 1 -- 172.21.15.5:0/3001885254 <== mds.0 v2:172.21.15.5:6833/3727670717 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55d1a642be40 con 0x55d1a6620d50 2024-08-18T22:19:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4626000640 10 client.4707 handle_command_reply: tid=0 2024-08-18T22:19:50.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 client.4707 shutdown 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 -- 172.21.15.5:0/3001885254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 msgr2=0x55d1a6694d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a6694d20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f462000cec0 tx=0x7f4620000ee0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 -- 172.21.15.5:0/3001885254 shutdown_connections 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.5:6833/3727670717,v1:172.21.15.5:6835/3727670717] conn(0x55d1a6620d50 0x55d1a6635da0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d1a660e7a0 0x55d1a6635860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1a65d7990 0x55d1a6694d20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 --2- 172.21.15.5:0/3001885254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d1a65d3910 0x55d1a66947e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4626000640 0 client.4707 ms_handle_reset on v2:172.21.15.5:6833/3727670717 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 -- 172.21.15.5:0/3001885254 >> 172.21.15.5:0/3001885254 conn(0x55d1a660dfd0 msgr2=0x55d1a6620170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 -- 172.21.15.5:0/3001885254 shutdown_connections 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 1 -- 172.21.15.5:0/3001885254 wait complete. 2024-08-18T22:19:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.158+0000 7f4642b50000 20 client.4707 trim_cache size 0 max 16384 2024-08-18T22:19:50.166 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:19:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:19:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:19:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4269, 2024-08-18T22:19:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:19:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:19:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:19:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 29.066022841999999, 2024-08-18T22:19:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 8, 2024-08-18T22:19:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 25, 2024-08-18T22:19:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 25, 2024-08-18T22:19:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 35.286857419999997 2024-08-18T22:19:50.167 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:19:50.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 -- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46140678c0 msgr2=0x7f4614069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:50.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46140678c0 0x7f4614069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f46280011f0 tx=0x7f4628009040 comp rx=0 tx=0).stop 2024-08-18T22:19:50.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 -- 172.21.15.5:0/3305097199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46380d15e0 msgr2=0x7f463806d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:50.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46380d15e0 0x7f463806d510 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f462000c500 tx=0x7f462000c9c0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 -- 172.21.15.5:0/3305097199 shutdown_connections 2024-08-18T22:19:50.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46140678c0 0x7f4614069d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463815fb80 0x7f46380cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46380d15e0 0x7f463806d510 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 --2- 172.21.15.5:0/3305097199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46380d1090 0x7f463814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:50.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 -- 172.21.15.5:0/3305097199 >> 172.21.15.5:0/3305097199 conn(0x7f46380d2180 msgr2=0x7f463815e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:50.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 -- 172.21.15.5:0/3305097199 shutdown_connections 2024-08-18T22:19:50.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:50.162+0000 7f463f600640 1 -- 172.21.15.5:0/3305097199 wait complete. 2024-08-18T22:19:50.182 INFO:teuthology.run_tasks:Running task sequential... 2024-08-18T22:19:50.193 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-08-18T22:19:50.193 INFO:teuthology.task.sequential:In sequential, running task print... 2024-08-18T22:19:50.194 INFO:teuthology.task.print:Enabling mgr modules 2024-08-18T22:19:50.194 INFO:teuthology.run_tasks:Running task kclient... 2024-08-18T22:19:50.217 INFO:tasks.kclient:Mounting kernel clients... 2024-08-18T22:19:50.217 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-18T22:19:50.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:50.217 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:19:50.226 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-08-18T22:19:50.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:50.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T22:19:50.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:50.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-18T22:19:50.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:50.764 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:19:50.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:50.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-18T22:19:50.844 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-08-18T22:19:50.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:19:50.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:50.846 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-08-18T22:19:50.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:50.856 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-08-18T22:19:50.921 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2024-08-18T22:19:50.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:19:50.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:50.923 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-08-18T22:19:50.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:50.979 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-08-18T22:19:51.048 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2024-08-18T22:19:51.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:19:51.050 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-08-18T22:19:51.050 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T22:19:51.050 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:19:51.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:19:51.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06d4a00640 1 Processor -- start 2024-08-18T22:19:51.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06d4a00640 1 -- start start 2024-08-18T22:19:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06d4a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f06d015c320 0x7f06d015f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06d4a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d00cee10 con 0x7f06d00d1af0 2024-08-18T22:19:51.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06d4a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d00cf0f0 con 0x7f06d00d4fa0 2024-08-18T22:19:51.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06d4a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f06d00cfa20 con 0x7f06d015c320 2024-08-18T22:19:51.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06ce800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f06d00d1af0 0x7f06d00d2390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38762/0 (socket says 172.21.15.5:38762) 2024-08-18T22:19:51.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06ce800640 1 -- 172.21.15.5:0/3611615815 learned_addr learned my addr 172.21.15.5:0/3611615815 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:51.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06cde00640 1 --2- 172.21.15.5:0/3611615815 >> v2:172.21.15.117:3300/0 conn(0x7f06d015c320 0x7f06d015f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:51.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06cd400640 1 -- 172.21.15.5:0/3611615815 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2336141320 0 0) 0x7f06d00cee10 con 0x7f06d00d1af0 2024-08-18T22:19:51.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06cd400640 1 -- 172.21.15.5:0/3611615815 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06b4003530 con 0x7f06d00d1af0 2024-08-18T22:19:51.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06cde00640 1 -- 172.21.15.5:0/3611615815 >> v1:172.21.15.117:6789/0 conn(0x7f06d00d4fa0 legacy=0x7f06d00d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:51.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06cd400640 1 -- 172.21.15.5:0/3611615815 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2940767146 0 0) 0x7f06d00cf0f0 con 0x7f06d00d4fa0 2024-08-18T22:19:51.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06cde00640 1 -- 172.21.15.5:0/3611615815 >> v1:172.21.15.5:6789/0 conn(0x7f06d00d1af0 legacy=0x7f06d00d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:51.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.190+0000 7f06cde00640 1 -- 172.21.15.5:0/3611615815 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d00cf3d0 con 0x7f06d015c320 2024-08-18T22:19:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.194+0000 7f06cde00640 1 --2- 172.21.15.5:0/3611615815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d015c320 0x7f06d015f490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06c00097c0 tx=0x7f06c001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b3062e49e992955 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.194+0000 7f06cd400640 1 -- 172.21.15.5:0/3611615815 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c00b0070 con 0x7f06d015c320 2024-08-18T22:19:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.194+0000 7f06cd400640 1 -- 172.21.15.5:0/3611615815 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c00ab600 con 0x7f06d015c320 2024-08-18T22:19:51.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.194+0000 7f06cd400640 1 -- 172.21.15.5:0/3611615815 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c00ab9d0 con 0x7f06d015c320 2024-08-18T22:19:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.194+0000 7f06d4a00640 1 -- 172.21.15.5:0/3611615815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d015c320 msgr2=0x7f06d015f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.194+0000 7f06d4a00640 1 --2- 172.21.15.5:0/3611615815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d015c320 0x7f06d015f490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06c00097c0 tx=0x7f06c001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:19:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.194+0000 7f06d4a00640 1 -- 172.21.15.5:0/3611615815 shutdown_connections 2024-08-18T22:19:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.194+0000 7f06d4a00640 1 --2- 172.21.15.5:0/3611615815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d015c320 0x7f06d015f490 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.194+0000 7f06d4a00640 1 -- 172.21.15.5:0/3611615815 >> 172.21.15.5:0/3611615815 conn(0x7f06d0067aa0 msgr2=0x7f06d0067eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.194+0000 7f06d4a00640 1 -- 172.21.15.5:0/3611615815 shutdown_connections 2024-08-18T22:19:51.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.194+0000 7f06d4a00640 1 -- 172.21.15.5:0/3611615815 wait complete. 2024-08-18T22:19:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06d4a00640 1 Processor -- start 2024-08-18T22:19:51.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06d4a00640 1 -- start start 2024-08-18T22:19:51.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06d4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d00d1af0 0x7f06d00c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:51.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06d4a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d00d4fa0 0x7f06d00ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:51.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06d4a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d015c320 0x7f06d00ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:51.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06d4a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f06d016c5b0 con 0x7f06d00d1af0 2024-08-18T22:19:51.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06d4a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f06d016c430 con 0x7f06d00d4fa0 2024-08-18T22:19:51.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06d4a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f06d016c730 con 0x7f06d015c320 2024-08-18T22:19:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06cde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d00d1af0 0x7f06d00c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06cde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d00d1af0 0x7f06d00c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40894/0 (socket says 172.21.15.5:40894) 2024-08-18T22:19:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06cde00640 1 -- 172.21.15.5:0/2633016769 learned_addr learned my addr 172.21.15.5:0/2633016769 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06c5400640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d00d4fa0 0x7f06d00ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06ce800640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d015c320 0x7f06d00ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06cde00640 1 -- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d015c320 msgr2=0x7f06d00ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06cde00640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d015c320 0x7f06d00ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06cde00640 1 -- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d00d4fa0 msgr2=0x7f06d00ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06cde00640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d00d4fa0 0x7f06d00ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06cde00640 1 -- 172.21.15.5:0/2633016769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d00c8e30 con 0x7f06d00d1af0 2024-08-18T22:19:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06cde00640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d00d1af0 0x7f06d00c8510 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f06c00097c0 tx=0x7f06c001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06c6a00640 1 -- 172.21.15.5:0/2633016769 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c00bb020 con 0x7f06d00d1af0 2024-08-18T22:19:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06c6a00640 1 -- 172.21.15.5:0/2633016769 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c00b1040 con 0x7f06d00d1af0 2024-08-18T22:19:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06d4a00640 1 -- 172.21.15.5:0/2633016769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d00c9110 con 0x7f06d00d1af0 2024-08-18T22:19:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06c6a00640 1 -- 172.21.15.5:0/2633016769 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c00b0050 con 0x7f06d00d1af0 2024-08-18T22:19:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.198+0000 7f06d4a00640 1 -- 172.21.15.5:0/2633016769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d00b8b90 con 0x7f06d00d1af0 2024-08-18T22:19:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.202+0000 7f06d4a00640 1 -- 172.21.15.5:0/2633016769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d015f490 con 0x7f06d00d1af0 2024-08-18T22:19:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.202+0000 7f06c6a00640 1 -- 172.21.15.5:0/2633016769 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06c00be070 con 0x7f06d00d1af0 2024-08-18T22:19:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.202+0000 7f06c6a00640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06ac0678c0 0x7f06ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.202+0000 7f06c6a00640 1 -- 172.21.15.5:0/2633016769 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f06c011f500 con 0x7f06d00d1af0 2024-08-18T22:19:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.202+0000 7f06c5400640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06ac0678c0 0x7f06ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.202+0000 7f06c5400640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06ac0678c0 0x7f06ac069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06d0163030 tx=0x7f06b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:51.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.206+0000 7f06c6a00640 1 -- 172.21.15.5:0/2633016769 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f06c0016090 con 0x7f06d00d1af0 2024-08-18T22:19:51.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.406+0000 7f06d4a00640 1 -- 172.21.15.5:0/2633016769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f06d00cee50 con 0x7f06d00d1af0 2024-08-18T22:19:51.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.406+0000 7f06c6a00640 1 -- 172.21.15.5:0/2633016769 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f06c00ef6a0 con 0x7f06d00d1af0 2024-08-18T22:19:51.409 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T22:19:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 -- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06ac0678c0 msgr2=0x7f06ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06ac0678c0 0x7f06ac069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06d0163030 tx=0x7f06b8009040 comp rx=0 tx=0).stop 2024-08-18T22:19:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 -- 172.21.15.5:0/2633016769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d00d1af0 msgr2=0x7f06d00c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d00d1af0 0x7f06d00c8510 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f06c00097c0 tx=0x7f06c001ace0 comp rx=0 tx=0).stop 2024-08-18T22:19:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 -- 172.21.15.5:0/2633016769 shutdown_connections 2024-08-18T22:19:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06ac0678c0 0x7f06ac069d80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:51.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06d015c320 0x7f06d00ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:51.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06d00d4fa0 0x7f06d00ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:51.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 --2- 172.21.15.5:0/2633016769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d00d1af0 0x7f06d00c8510 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:51.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 -- 172.21.15.5:0/2633016769 >> 172.21.15.5:0/2633016769 conn(0x7f06d0067aa0 msgr2=0x7f06d0162260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:51.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 -- 172.21.15.5:0/2633016769 shutdown_connections 2024-08-18T22:19:51.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51.410+0000 7f06d4a00640 1 -- 172.21.15.5:0/2633016769 wait complete. 2024-08-18T22:19:51.430 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T22:19:51.431 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:19:51.431 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:19:51.431 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:19:51.431 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:19:51.431 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T22:19:51.431 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T22:19:51.431 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:19:51.431 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:19:51.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:51.431 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:19:51.440 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:19:51.440 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:51.441 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:19:51.442 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:19:51.442 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42410sec preferred_lft 42410sec 2024-08-18T22:19:51.442 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:19:51.442 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:51.442 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:51.442 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:51.442 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:19:51.442 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:19:51.442 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:51.442 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:19:51.442 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:51.442 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-18T22:19:51.443 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:51.443 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:51.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-08-18T22:19:51.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-08-18T22:19:51.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-08-18T22:19:51.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-18T22:19:51.443 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:51.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:19:51.485 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:19:51.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:51.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:51.595 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:19:51.613 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:19:51.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:51.616 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:19:51.666 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:19:51.666 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:19:51.666 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:19:51.666 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:19:51.666 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:19:51.666 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:19:51.666 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:51.666 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:51.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:19:51.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:19:51.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:19:51.667 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:51.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:51.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:51.804 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:19:51.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:51.854 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-08-18T22:19:51.905 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:51.906 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:51.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:19:51.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-18T22:19:51.906 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:52.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:52.032 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-18T22:19:52.033 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:52.033 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:52.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-18T22:19:52.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-18T22:19:52.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-18T22:19:52.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-18T22:19:52.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-18T22:19:52.033 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:52.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:52.220 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:52.220 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:52.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:19:52.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-08-18T22:19:52.220 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:52.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:52.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:19:52.346 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:19:52.355 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:19:52.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:19:52.356 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:19:52.408 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:19:52.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:52.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:19:52.501 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:19:52.502 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:19:52.502 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:19:53.150 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:19:53.150 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:19:53.150 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:19:53.150 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:19:53.150 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:19:53.162 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:19:53.163 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:19:53.163 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:19:53.163 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:19:53.163 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:19:53.163 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:19:53.163 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:19:53.163 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:19:53.167 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:19:53.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:53.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:19:53.188 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:53.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:53.292 INFO:teuthology.orchestra.run.smithi005.stdout:client4716 2024-08-18T22:19:53.293 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:19:53.293 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:19:53.302 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:53.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:53.401 INFO:teuthology.orchestra.run.smithi005.stdout:client4716 2024-08-18T22:19:53.402 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:53.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:53.459 INFO:teuthology.orchestra.run.smithi005.stdout:client4716 2024-08-18T22:19:53.460 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2affb9c-c71f-418c-b271-e1d1f0126ce6.client4716/status') 2024-08-18T22:19:53.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:53.520 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4716 (3)192.168.0.1:0/4206086803 2024-08-18T22:19:53.520 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2024-08-18T22:19:53.520 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2024-08-18T22:19:53.520 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2024-08-18T22:19:53.521 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 5.4824e-05 s, 1.3 MB/s 2024-08-18T22:19:53.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:53.529 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-08-18T22:19:53.529 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T22:19:53.529 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-18T22:19:53.529 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:19:53.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.666+0000 7f29a0a00640 1 Processor -- start 2024-08-18T22:19:53.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.666+0000 7f29a0a00640 1 -- start start 2024-08-18T22:19:53.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f29a0a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f299c15b010 0x7f299c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:53.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f29a0a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f299c0cd3a0 0x7f299c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:53.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f29a0a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f299c0cee20 con 0x7f299c06f0c0 2024-08-18T22:19:53.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f29a0a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f299c0cfa30 con 0x7f299c15b010 2024-08-18T22:19:53.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f29a0a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f299c0cf100 con 0x7f299c0cd3a0 2024-08-18T22:19:53.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f2999e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f299c15b010 0x7f299c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:53.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f299a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f299c06f0c0 0x7f299c0caf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59270/0 (socket says 172.21.15.5:59270) 2024-08-18T22:19:53.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f299a800640 1 -- 172.21.15.5:0/3636976212 learned_addr learned my addr 172.21.15.5:0/3636976212 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:53.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f2999400640 1 --2- 172.21.15.5:0/3636976212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f299c0cd3a0 0x7f299c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:53.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f2999e00640 1 -- 172.21.15.5:0/3636976212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f299c0cd3a0 msgr2=0x7f299c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:53.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f2999e00640 1 --2- 172.21.15.5:0/3636976212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f299c0cd3a0 0x7f299c06eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:53.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f2999e00640 1 -- 172.21.15.5:0/3636976212 >> v1:172.21.15.5:6789/0 conn(0x7f299c06f0c0 legacy=0x7f299c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:53.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f2998a00640 1 -- 172.21.15.5:0/3636976212 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874674447 0 0) 0x7f299c0cee20 con 0x7f299c06f0c0 2024-08-18T22:19:53.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.670+0000 7f2999e00640 1 -- 172.21.15.5:0/3636976212 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c0cf3e0 con 0x7f299c15b010 2024-08-18T22:19:53.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f2999e00640 1 --2- 172.21.15.5:0/3636976212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299c15b010 0x7f299c0ce840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f298c009d90 tx=0x7f298c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d6530daa7595fa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:53.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f2998a00640 1 -- 172.21.15.5:0/3636976212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c0b2070 con 0x7f299c15b010 2024-08-18T22:19:53.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f2998a00640 1 -- 172.21.15.5:0/3636976212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f298c0a5850 con 0x7f299c15b010 2024-08-18T22:19:53.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f2998a00640 1 -- 172.21.15.5:0/3636976212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c0a5c20 con 0x7f299c15b010 2024-08-18T22:19:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f29a0a00640 1 -- 172.21.15.5:0/3636976212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299c15b010 msgr2=0x7f299c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f29a0a00640 1 --2- 172.21.15.5:0/3636976212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299c15b010 0x7f299c0ce840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f298c009d90 tx=0x7f298c01c970 comp rx=0 tx=0).stop 2024-08-18T22:19:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f29a0a00640 1 -- 172.21.15.5:0/3636976212 shutdown_connections 2024-08-18T22:19:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f29a0a00640 1 --2- 172.21.15.5:0/3636976212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f299c0cd3a0 0x7f299c06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f29a0a00640 1 --2- 172.21.15.5:0/3636976212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299c15b010 0x7f299c0ce840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f29a0a00640 1 -- 172.21.15.5:0/3636976212 >> 172.21.15.5:0/3636976212 conn(0x7f299c0b1c50 msgr2=0x7f299c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f29a0a00640 1 -- 172.21.15.5:0/3636976212 shutdown_connections 2024-08-18T22:19:53.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f29a0a00640 1 -- 172.21.15.5:0/3636976212 wait complete. 2024-08-18T22:19:53.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f29a0a00640 1 Processor -- start 2024-08-18T22:19:53.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.674+0000 7f29a0a00640 1 -- start start 2024-08-18T22:19:53.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f29a0a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299c06f0c0 0x7f299c14fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:53.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f29a0a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f299c0cd3a0 0x7f299c1f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:53.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f29a0a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c15b010 0x7f299c0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:53.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f29a0a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f299c167dd0 con 0x7f299c06f0c0 2024-08-18T22:19:53.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f29a0a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f299c167c50 con 0x7f299c15b010 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f29a0a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f299c167f50 con 0x7f299c0cd3a0 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2999e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299c06f0c0 0x7f299c14fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2999e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299c06f0c0 0x7f299c14fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40402/0 (socket says 172.21.15.5:40402) 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2999e00640 1 -- 172.21.15.5:0/2040752722 learned_addr learned my addr 172.21.15.5:0/2040752722 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2999400640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f299c0cd3a0 0x7f299c1f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f299a800640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c15b010 0x7f299c0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2999e00640 1 -- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f299c0cd3a0 msgr2=0x7f299c1f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2999e00640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f299c0cd3a0 0x7f299c1f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2999e00640 1 -- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c15b010 msgr2=0x7f299c0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2999e00640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c15b010 0x7f299c0b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2999e00640 1 -- 172.21.15.5:0/2040752722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c15d470 con 0x7f299c06f0c0 2024-08-18T22:19:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f299a800640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c15b010 0x7f299c0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2999e00640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299c06f0c0 0x7f299c14fca0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f298c009d90 tx=0x7f298c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2992000640 1 -- 172.21.15.5:0/2040752722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c0b2040 con 0x7f299c06f0c0 2024-08-18T22:19:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2992000640 1 -- 172.21.15.5:0/2040752722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f298c0b8470 con 0x7f299c06f0c0 2024-08-18T22:19:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f29a0a00640 1 -- 172.21.15.5:0/2040752722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c0af740 con 0x7f299c06f0c0 2024-08-18T22:19:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f2992000640 1 -- 172.21.15.5:0/2040752722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c0b8820 con 0x7f299c06f0c0 2024-08-18T22:19:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f29a0a00640 1 -- 172.21.15.5:0/2040752722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c1501e0 con 0x7f299c06f0c0 2024-08-18T22:19:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.678+0000 7f29a0a00640 1 -- 172.21.15.5:0/2040752722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c06eb80 con 0x7f299c06f0c0 2024-08-18T22:19:53.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.682+0000 7f2992000640 1 -- 172.21.15.5:0/2040752722 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f298c0c1020 con 0x7f299c06f0c0 2024-08-18T22:19:53.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.682+0000 7f2992000640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f297c0678c0 0x7f297c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:53.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.682+0000 7f2992000640 1 -- 172.21.15.5:0/2040752722 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f298c1214a0 con 0x7f299c06f0c0 2024-08-18T22:19:53.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.682+0000 7f2999400640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f297c0678c0 0x7f297c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:53.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.682+0000 7f2999400640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f297c0678c0 0x7f297c069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f299c165bd0 tx=0x7f2988008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.686+0000 7f2992000640 1 -- 172.21.15.5:0/2040752722 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f298c016560 con 0x7f299c06f0c0 2024-08-18T22:19:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 -- 172.21.15.5:0/2040752722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f299c0af100 con 0x7f299c06f0c0 2024-08-18T22:19:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f2992000640 1 -- 172.21.15.5:0/2040752722 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f298c0f1c80 con 0x7f299c06f0c0 2024-08-18T22:19:53.886 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T22:19:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 -- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f297c0678c0 msgr2=0x7f297c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f297c0678c0 0x7f297c069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f299c165bd0 tx=0x7f2988008040 comp rx=0 tx=0).stop 2024-08-18T22:19:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 -- 172.21.15.5:0/2040752722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299c06f0c0 msgr2=0x7f299c14fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299c06f0c0 0x7f299c14fca0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f298c009d90 tx=0x7f298c019710 comp rx=0 tx=0).stop 2024-08-18T22:19:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 -- 172.21.15.5:0/2040752722 shutdown_connections 2024-08-18T22:19:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f297c0678c0 0x7f297c069d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c15b010 0x7f299c0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f299c0cd3a0 0x7f299c1f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 --2- 172.21.15.5:0/2040752722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f299c06f0c0 0x7f299c14fca0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 -- 172.21.15.5:0/2040752722 >> 172.21.15.5:0/2040752722 conn(0x7f299c0b1c50 msgr2=0x7f299c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 -- 172.21.15.5:0/2040752722 shutdown_connections 2024-08-18T22:19:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:53.886+0000 7f29a0a00640 1 -- 172.21.15.5:0/2040752722 wait complete. 2024-08-18T22:19:53.908 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T22:19:53.908 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:19:53.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:19:53.908 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-18T22:19:53.908 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-18T22:19:53.908 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T22:19:53.908 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T22:19:53.909 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:19:53.909 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-18T22:19:53.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:53.909 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:19:53.918 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:19:53.918 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:19:53.918 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:19:53.918 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:53.918 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:19:53.918 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:53.918 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:53.918 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:53.918 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42407sec preferred_lft 42407sec 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:19:53.919 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-08-18T22:19:53.920 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:53.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:53.921 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:19:53.983 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:19:53.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:53.985 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:19:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:19:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:19:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:19:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:19:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:19:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:19:54.038 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:54.038 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:54.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:19:54.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:19:54.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:19:54.039 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:54.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:54.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:54.176 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:19:54.185 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:19:54.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:54.185 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-08-18T22:19:54.237 INFO:teuthology.orchestra.run.smithi005.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-18T22:19:54.238 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:54.238 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:54.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:19:54.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-18T22:19:54.238 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:54.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:54.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:54.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-18T22:19:54.385 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:19:54.386 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:19:54.386 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:19:54.386 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:54.386 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:19:54.386 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:54.386 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:19:54.386 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether d2:1c:e0:74:53:af brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-18T22:19:54.386 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-18T22:19:54.386 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:54.386 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::d01c:e0ff:fe74:53af/64 scope link 2024-08-18T22:19:54.386 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:54.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:54.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-18T22:19:54.453 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:19:54.453 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:19:54.453 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:19:54.453 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:54.453 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:19:54.454 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:54.454 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:19:54.454 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether d2:1c:e0:74:53:af brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-18T22:19:54.454 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-18T22:19:54.454 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:54.454 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::d01c:e0ff:fe74:53af/64 scope link 2024-08-18T22:19:54.454 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:54.455 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-18T22:19:54.455 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:54.455 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:54.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-18T22:19:54.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-18T22:19:54.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-18T22:19:54.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-18T22:19:54.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-18T22:19:54.456 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:54.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:54.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:54.642 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:54.642 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:19:54.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.1 up 2024-08-18T22:19:54.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.1 master ceph-brx 2024-08-18T22:19:54.642 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:19:54.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:54.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:54.727 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:19:54.727 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-18T22:19:54.736 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-18T22:19:54.736 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:19:54.736 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-18T22:19:54.784 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:19:54.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:54.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-08-18T22:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-08-18T22:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-08-18T22:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:19:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-08-18T22:19:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-08-18T22:19:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:19:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:19:54.893 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:19:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-08-18T22:19:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-08-18T22:19:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:19:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:19:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:19:54.903 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:19:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:19:54.904 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:19:54.908 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:19:54.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:54.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-18T22:19:54.928 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:55.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:55.026 INFO:teuthology.orchestra.run.smithi005.stdout:client4538 2024-08-18T22:19:55.026 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:19:55.026 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:19:55.037 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:55.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:55.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:55.138 INFO:teuthology.orchestra.run.smithi005.stdout:client4538 2024-08-18T22:19:55.138 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:55.239 INFO:teuthology.orchestra.run.smithi005.stdout:client4538 2024-08-18T22:19:55.239 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2affb9c-c71f-418c-b271-e1d1f0126ce6.client4538/status') 2024-08-18T22:19:55.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:55.300 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4538 (3)172.21.15.5:0/2953371797 2024-08-18T22:19:55.300 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2024-08-18T22:19:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2024-08-18T22:19:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2024-08-18T22:19:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 5.724e-05 s, 1.2 MB/s 2024-08-18T22:19:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:55.308 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-08-18T22:19:55.308 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T22:19:55.308 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-18T22:19:55.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:19:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.486+0000 7f107e400640 1 Processor -- start 2024-08-18T22:19:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f107e400640 1 -- start start 2024-08-18T22:19:55.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f107e400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f10780b54c0 0x7f1078071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:55.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f107e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107806dd80 0x7f10780b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:55.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f107e400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10780b5de0 con 0x7f107806fad0 2024-08-18T22:19:55.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f107e400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f10780cba40 con 0x7f10780b54c0 2024-08-18T22:19:55.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f107e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1078071c80 con 0x7f107806dd80 2024-08-18T22:19:55.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f1077e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f107806fad0 0x7f107806ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59274/0 (socket says 172.21.15.5:59274) 2024-08-18T22:19:55.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f1077e00640 1 -- 172.21.15.5:0/4162107633 learned_addr learned my addr 172.21.15.5:0/4162107633 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:55.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f1077400640 1 --2- 172.21.15.5:0/4162107633 >> v2:172.21.15.117:3300/0 conn(0x7f10780b54c0 0x7f1078071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:55.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f1076a00640 1 --2- 172.21.15.5:0/4162107633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107806dd80 0x7f10780b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:55.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f1076000640 1 -- 172.21.15.5:0/4162107633 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1271676534 0 0) 0x7f10780b5de0 con 0x7f107806fad0 2024-08-18T22:19:55.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f1076000640 1 -- 172.21.15.5:0/4162107633 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f105c003530 con 0x7f107806fad0 2024-08-18T22:19:55.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f1077400640 1 -- 172.21.15.5:0/4162107633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107806dd80 msgr2=0x7f10780b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:55.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f1077400640 1 --2- 172.21.15.5:0/4162107633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107806dd80 0x7f10780b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:55.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f1077400640 1 -- 172.21.15.5:0/4162107633 >> v1:172.21.15.5:6789/0 conn(0x7f107806fad0 legacy=0x7f107806ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:55.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f1077400640 1 -- 172.21.15.5:0/4162107633 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1078071f60 con 0x7f10780b54c0 2024-08-18T22:19:55.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.490+0000 7f1076a00640 1 --2- 172.21.15.5:0/4162107633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107806dd80 0x7f10780b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:19:55.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f1077400640 1 --2- 172.21.15.5:0/4162107633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780b54c0 0x7f1078071580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10680097c0 tx=0x7f106801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd09bc48a02c9733 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:55.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f1076000640 1 -- 172.21.15.5:0/4162107633 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10680b5070 con 0x7f10780b54c0 2024-08-18T22:19:55.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f1076000640 1 -- 172.21.15.5:0/4162107633 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10680a8990 con 0x7f10780b54c0 2024-08-18T22:19:55.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f1076000640 1 -- 172.21.15.5:0/4162107633 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10680a8d60 con 0x7f10780b54c0 2024-08-18T22:19:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f107e400640 1 -- 172.21.15.5:0/4162107633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780b54c0 msgr2=0x7f1078071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f107e400640 1 --2- 172.21.15.5:0/4162107633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780b54c0 0x7f1078071580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10680097c0 tx=0x7f106801ec90 comp rx=0 tx=0).stop 2024-08-18T22:19:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f107e400640 1 -- 172.21.15.5:0/4162107633 shutdown_connections 2024-08-18T22:19:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f107e400640 1 --2- 172.21.15.5:0/4162107633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107806dd80 0x7f10780b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f107e400640 1 --2- 172.21.15.5:0/4162107633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780b54c0 0x7f1078071580 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f107e400640 1 -- 172.21.15.5:0/4162107633 >> 172.21.15.5:0/4162107633 conn(0x7f10780b3eb0 msgr2=0x7f10780b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f107e400640 1 -- 172.21.15.5:0/4162107633 shutdown_connections 2024-08-18T22:19:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f107e400640 1 -- 172.21.15.5:0/4162107633 wait complete. 2024-08-18T22:19:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.494+0000 7f107e400640 1 Processor -- start 2024-08-18T22:19:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f107e400640 1 -- start start 2024-08-18T22:19:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f107e400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107806dd80 0x7f10781f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f107e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107806fad0 0x7f10780d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f107e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10780b54c0 0x7f10780cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f107e400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1078148020 con 0x7f10780b54c0 2024-08-18T22:19:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f107e400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f107806e1a0 con 0x7f107806dd80 2024-08-18T22:19:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f107e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10781481a0 con 0x7f107806fad0 2024-08-18T22:19:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f1077e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10780b54c0 0x7f10780cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f1077e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10780b54c0 0x7f10780cde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40418/0 (socket says 172.21.15.5:40418) 2024-08-18T22:19:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f1077e00640 1 -- 172.21.15.5:0/4291809496 learned_addr learned my addr 172.21.15.5:0/4291809496 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f1077400640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107806dd80 0x7f10781f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f1076a00640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107806fad0 0x7f10780d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f1077e00640 1 -- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107806fad0 msgr2=0x7f10780d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f1077e00640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107806fad0 0x7f10780d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f1077e00640 1 -- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107806dd80 msgr2=0x7f10781f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f1077e00640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107806dd80 0x7f10781f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f1077e00640 1 -- 172.21.15.5:0/4291809496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10780cf3f0 con 0x7f10780b54c0 2024-08-18T22:19:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f1077e00640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10780b54c0 0x7f10780cde40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f107000cb40 tx=0x7f107000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f106f400640 1 -- 172.21.15.5:0/4291809496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070017070 con 0x7f10780b54c0 2024-08-18T22:19:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f106f400640 1 -- 172.21.15.5:0/4291809496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107000aca0 con 0x7f10780b54c0 2024-08-18T22:19:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f107e400640 1 -- 172.21.15.5:0/4291809496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10780cf6d0 con 0x7f10780b54c0 2024-08-18T22:19:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f106f400640 1 -- 172.21.15.5:0/4291809496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070012620 con 0x7f10780b54c0 2024-08-18T22:19:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f107e400640 1 -- 172.21.15.5:0/4291809496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10780cfc90 con 0x7f10780b54c0 2024-08-18T22:19:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.498+0000 7f107e400640 1 -- 172.21.15.5:0/4291809496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1078071580 con 0x7f10780b54c0 2024-08-18T22:19:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.502+0000 7f106f400640 1 -- 172.21.15.5:0/4291809496 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f107001a070 con 0x7f10780b54c0 2024-08-18T22:19:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.502+0000 7f106f400640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10580678c0 0x7f1058069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.502+0000 7f106f400640 1 -- 172.21.15.5:0/4291809496 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1070085df0 con 0x7f10780b54c0 2024-08-18T22:19:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.502+0000 7f1077400640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10580678c0 0x7f1058069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.502+0000 7f1077400640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10580678c0 0x7f1058069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10680b2000 tx=0x7f1068008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.506+0000 7f106f400640 1 -- 172.21.15.5:0/4291809496 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f10700565e0 con 0x7f10780b54c0 2024-08-18T22:19:55.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.706+0000 7f107e400640 1 -- 172.21.15.5:0/4291809496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f107804fdd0 con 0x7f10780b54c0 2024-08-18T22:19:55.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.706+0000 7f106f400640 1 -- 172.21.15.5:0/4291809496 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f1070055ee0 con 0x7f10780b54c0 2024-08-18T22:19:55.708 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T22:19:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 -- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10580678c0 msgr2=0x7f1058069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10580678c0 0x7f1058069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10680b2000 tx=0x7f1068008040 comp rx=0 tx=0).stop 2024-08-18T22:19:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 -- 172.21.15.5:0/4291809496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10780b54c0 msgr2=0x7f10780cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10780b54c0 0x7f10780cde40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f107000cb40 tx=0x7f107000a060 comp rx=0 tx=0).stop 2024-08-18T22:19:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 -- 172.21.15.5:0/4291809496 shutdown_connections 2024-08-18T22:19:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10580678c0 0x7f1058069d80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10780b54c0 0x7f10780cde40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f107806fad0 0x7f10780d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:55.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 --2- 172.21.15.5:0/4291809496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107806dd80 0x7f10781f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:55.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 -- 172.21.15.5:0/4291809496 >> 172.21.15.5:0/4291809496 conn(0x7f10780b3eb0 msgr2=0x7f1078161210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:55.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 -- 172.21.15.5:0/4291809496 shutdown_connections 2024-08-18T22:19:55.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:55.710+0000 7f107e400640 1 -- 172.21.15.5:0/4291809496 wait complete. 2024-08-18T22:19:55.729 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T22:19:55.729 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:19:55.729 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-08-18T22:19:55.729 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-18T22:19:55.729 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-18T22:19:55.729 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T22:19:55.730 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T22:19:55.730 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:19:55.730 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-18T22:19:55.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:55.730 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-08-18T22:19:55.740 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:19:55.740 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:19:55.740 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:19:55.740 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:55.740 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-08-18T22:19:55.740 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:55.740 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:55.740 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:55.740 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42410sec preferred_lft 42410sec 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:b5:65:0d:33 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:19:55.742 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:55.742 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-18T22:19:55.743 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:55.743 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-18T22:19:55.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2024-08-18T22:19:55.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2024-08-18T22:19:55.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2024-08-18T22:19:55.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-18T22:19:55.743 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-18T22:19:55.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:55.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:55.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:55.906 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:19:55.924 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-08-18T22:19:55.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:55.926 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-08-18T22:19:56.014 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-08-18T22:19:56.014 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:19:56.014 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-18T22:19:56.014 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T22:19:56.014 INFO:teuthology.orchestra.run.smithi117.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-08-18T22:19:56.014 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:19:56.014 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T22:19:56.015 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-18T22:19:56.015 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-18T22:19:56.015 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-18T22:19:56.015 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:19:56.015 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:56.015 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-18T22:19:56.015 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T22:19:56.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T22:19:56.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T22:19:56.016 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-18T22:19:56.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:56.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:56.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:56.109 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-08-18T22:19:56.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:56.160 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-08-18T22:19:56.211 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:56.211 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-18T22:19:56.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T22:19:56.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-18T22:19:56.211 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-18T22:19:56.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:56.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:56.337 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-18T22:19:56.337 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:56.337 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-18T22:19:56.337 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-18T22:19:56.337 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-18T22:19:56.337 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-18T22:19:56.338 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-18T22:19:56.338 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-18T22:19:56.338 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-18T22:19:56.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:56.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:56.503 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:56.503 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-18T22:19:56.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-08-18T22:19:56.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2024-08-18T22:19:56.503 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-18T22:19:56.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:56.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:56.634 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:19:56.634 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-18T22:19:56.643 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-18T22:19:56.643 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:19:56.643 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-18T22:19:56.698 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:19:56.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:56.698 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-08-18T22:19:56.786 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-08-18T22:19:56.786 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-08-18T22:19:56.786 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2024-08-18T22:19:57.447 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-08-18T22:19:57.447 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-08-18T22:19:57.447 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2024-08-18T22:19:57.447 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:19:57.447 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:19:57.460 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-08-18T22:19:57.460 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-08-18T22:19:57.461 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2024-08-18T22:19:57.461 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:19:57.461 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:19:57.461 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:19:57.461 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:19:57.461 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:19:57.464 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:19:57.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:57.465 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-18T22:19:57.484 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:57.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:57.615 INFO:teuthology.orchestra.run.smithi117.stdout:client4734 2024-08-18T22:19:57.616 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:19:57.616 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:19:57.625 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:57.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:57.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:57.726 INFO:teuthology.orchestra.run.smithi117.stdout:client4734 2024-08-18T22:19:57.726 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:57.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:57.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:57.826 INFO:teuthology.orchestra.run.smithi117.stdout:client4734 2024-08-18T22:19:57.826 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2affb9c-c71f-418c-b271-e1d1f0126ce6.client4734/status') 2024-08-18T22:19:57.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:57.924 INFO:teuthology.orchestra.run.smithi117.stdout:instance: client.4734 (3)172.21.15.117:0/2630476673 2024-08-18T22:19:57.924 INFO:teuthology.orchestra.run.smithi117.stdout:blocklisted: false 2024-08-18T22:19:57.925 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records in 2024-08-18T22:19:57.925 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records out 2024-08-18T22:19:57.925 INFO:teuthology.orchestra.run.smithi117.stderr:71 bytes copied, 5.2301e-05 s, 1.4 MB/s 2024-08-18T22:19:57.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:57.932 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-08-18T22:19:57.932 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T22:19:57.932 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-18T22:19:57.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:19:58.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.082+0000 7f2f23400640 1 Processor -- start 2024-08-18T22:19:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.082+0000 7f2f23400640 1 -- start start 2024-08-18T22:19:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f23400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2f1c15bed0 0x7f2f1c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f23400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1c0cb390 0x7f2f1c071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f23400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f1c06da70 0x7f2f1c06df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f23400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2f1c072060 con 0x7f2f1c06da70 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f23400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2f1c073c80 con 0x7f2f1c15bed0 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f23400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1c0ca5d0 con 0x7f2f1c0cb390 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f21400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f1c06da70 0x7f2f1c06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f21400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f1c06da70 0x7f2f1c06df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40430/0 (socket says 172.21.15.5:40430) 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f21400640 1 -- 172.21.15.5:0/473573339 learned_addr learned my addr 172.21.15.5:0/473573339 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f20a00640 1 --2- 172.21.15.5:0/473573339 >> v2:172.21.15.117:3300/0 conn(0x7f2f1c15bed0 0x7f2f1c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f1be00640 1 --2- 172.21.15.5:0/473573339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1c0cb390 0x7f2f1c071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f21400640 1 -- 172.21.15.5:0/473573339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1c0cb390 msgr2=0x7f2f1c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f21400640 1 --2- 172.21.15.5:0/473573339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1c0cb390 0x7f2f1c071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f21400640 1 -- 172.21.15.5:0/473573339 >> v2:172.21.15.117:3300/0 conn(0x7f2f1c15bed0 msgr2=0x7f2f1c0735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f21400640 1 --2- 172.21.15.5:0/473573339 >> v2:172.21.15.117:3300/0 conn(0x7f2f1c15bed0 0x7f2f1c0735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.086+0000 7f2f21400640 1 -- 172.21.15.5:0/473573339 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1c0ca8b0 con 0x7f2f1c06da70 2024-08-18T22:19:58.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f21400640 1 --2- 172.21.15.5:0/473573339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f1c06da70 0x7f2f1c06df00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0b2cc0 tx=0x7f2f1401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6353c10091fd4a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:58.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f1b400640 1 -- 172.21.15.5:0/473573339 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f140a5760 con 0x7f2f1c06da70 2024-08-18T22:19:58.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f1b400640 1 -- 172.21.15.5:0/473573339 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f140a5900 con 0x7f2f1c06da70 2024-08-18T22:19:58.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f1b400640 1 -- 172.21.15.5:0/473573339 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f140a5cd0 con 0x7f2f1c06da70 2024-08-18T22:19:58.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f23400640 1 -- 172.21.15.5:0/473573339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f1c06da70 msgr2=0x7f2f1c06df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:58.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f23400640 1 --2- 172.21.15.5:0/473573339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f1c06da70 0x7f2f1c06df00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0b2cc0 tx=0x7f2f1401c9f0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f23400640 1 -- 172.21.15.5:0/473573339 shutdown_connections 2024-08-18T22:19:58.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f23400640 1 --2- 172.21.15.5:0/473573339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f1c06da70 0x7f2f1c06df00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f23400640 1 --2- 172.21.15.5:0/473573339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1c0cb390 0x7f2f1c071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f23400640 1 --2- 172.21.15.5:0/473573339 >> v2:172.21.15.117:3300/0 conn(0x7f2f1c15bed0 0x7f2f1c0735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f23400640 1 -- 172.21.15.5:0/473573339 >> 172.21.15.5:0/473573339 conn(0x7f2f1c0b1c50 msgr2=0x7f2f1c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f23400640 1 -- 172.21.15.5:0/473573339 shutdown_connections 2024-08-18T22:19:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f23400640 1 -- 172.21.15.5:0/473573339 wait complete. 2024-08-18T22:19:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f23400640 1 Processor -- start 2024-08-18T22:19:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.090+0000 7f2f23400640 1 -- start start 2024-08-18T22:19:58.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f23400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f1c06da70 0x7f2f1c14f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:58.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f23400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f1c0cb390 0x7f2f1c0b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:58.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f23400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1c15bed0 0x7f2f1c0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:58.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f23400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c0ccc40 con 0x7f2f1c0cb390 2024-08-18T22:19:58.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f23400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c0ccac0 con 0x7f2f1c06da70 2024-08-18T22:19:58.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f23400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1c0ccdc0 con 0x7f2f1c15bed0 2024-08-18T22:19:58.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f1be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f1c0cb390 0x7f2f1c0b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:58.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f1be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f1c0cb390 0x7f2f1c0b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40442/0 (socket says 172.21.15.5:40442) 2024-08-18T22:19:58.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f1be00640 1 -- 172.21.15.5:0/1331538836 learned_addr learned my addr 172.21.15.5:0/1331538836 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:58.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f20a00640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f1c06da70 0x7f2f1c14f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:58.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f21400640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1c15bed0 0x7f2f1c0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:58.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f1be00640 1 -- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1c15bed0 msgr2=0x7f2f1c0c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:58.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f1be00640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1c15bed0 0x7f2f1c0c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f1be00640 1 -- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f1c06da70 msgr2=0x7f2f1c14f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:58.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f1be00640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f1c06da70 0x7f2f1c14f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f1be00640 1 -- 172.21.15.5:0/1331538836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1c14fb70 con 0x7f2f1c0cb390 2024-08-18T22:19:58.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f1be00640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f1c0cb390 0x7f2f1c0b00d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800e930 tx=0x7f2f0800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:58.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f18c00640 1 -- 172.21.15.5:0/1331538836 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08017070 con 0x7f2f1c0cb390 2024-08-18T22:19:58.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f18c00640 1 -- 172.21.15.5:0/1331538836 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0800ca00 con 0x7f2f1c0cb390 2024-08-18T22:19:58.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f23400640 1 -- 172.21.15.5:0/1331538836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1c0b09b0 con 0x7f2f1c0cb390 2024-08-18T22:19:58.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f18c00640 1 -- 172.21.15.5:0/1331538836 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0800cdb0 con 0x7f2f1c0cb390 2024-08-18T22:19:58.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f23400640 1 -- 172.21.15.5:0/1331538836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1c0b0f70 con 0x7f2f1c0cb390 2024-08-18T22:19:58.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f23400640 1 -- 172.21.15.5:0/1331538836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1c0b1740 con 0x7f2f1c0cb390 2024-08-18T22:19:58.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.094+0000 7f2f18c00640 1 -- 172.21.15.5:0/1331538836 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f0801a070 con 0x7f2f1c0cb390 2024-08-18T22:19:58.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.098+0000 7f2f18c00640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2efc0678c0 0x7f2efc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:58.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.098+0000 7f2f18c00640 1 -- 172.21.15.5:0/1331538836 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2f08085f70 con 0x7f2f1c0cb390 2024-08-18T22:19:58.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.098+0000 7f2f20a00640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2efc0678c0 0x7f2efc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:58.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.098+0000 7f2f20a00640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2efc0678c0 0x7f2efc069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c15b5c0 tx=0x7f2f0c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:58.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.102+0000 7f2f18c00640 1 -- 172.21.15.5:0/1331538836 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2f080561d0 con 0x7f2f1c0cb390 2024-08-18T22:19:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.302+0000 7f2f23400640 1 -- 172.21.15.5:0/1331538836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2f1c06df00 con 0x7f2f1c0cb390 2024-08-18T22:19:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.302+0000 7f2f18c00640 1 -- 172.21.15.5:0/1331538836 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f2f0805a4d0 con 0x7f2f1c0cb390 2024-08-18T22:19:58.304 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T22:19:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 -- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2efc0678c0 msgr2=0x7f2efc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2efc0678c0 0x7f2efc069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c15b5c0 tx=0x7f2f0c009190 comp rx=0 tx=0).stop 2024-08-18T22:19:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 -- 172.21.15.5:0/1331538836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f1c0cb390 msgr2=0x7f2f1c0b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f1c0cb390 0x7f2f1c0b00d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800e930 tx=0x7f2f0800edf0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 -- 172.21.15.5:0/1331538836 shutdown_connections 2024-08-18T22:19:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2efc0678c0 0x7f2efc069d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1c15bed0 0x7f2f1c0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f1c0cb390 0x7f2f1c0b00d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 --2- 172.21.15.5:0/1331538836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f1c06da70 0x7f2f1c14f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 -- 172.21.15.5:0/1331538836 >> 172.21.15.5:0/1331538836 conn(0x7f2f1c0b1c50 msgr2=0x7f2f1c15a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 -- 172.21.15.5:0/1331538836 shutdown_connections 2024-08-18T22:19:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:58.306+0000 7f2f23400640 1 -- 172.21.15.5:0/1331538836 wait complete. 2024-08-18T22:19:58.326 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T22:19:58.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:19:58.326 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-08-18T22:19:58.326 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-18T22:19:58.326 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-18T22:19:58.326 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T22:19:58.327 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T22:19:58.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:19:58.327 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-18T22:19:58.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:58.327 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-08-18T22:19:58.336 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:19:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:19:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:19:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-08-18T22:19:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.336 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-08-18T22:19:58.336 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42407sec preferred_lft 42407sec 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:b5:65:0d:33 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:19:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.338 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:19:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:19:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:19:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:19:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.338 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:19:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T22:19:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:19:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:58.339 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:19:58.400 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-08-18T22:19:58.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:58.402 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-08-18T22:19:58.454 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-08-18T22:19:58.454 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:19:58.454 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-18T22:19:58.454 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T22:19:58.454 INFO:teuthology.orchestra.run.smithi117.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-08-18T22:19:58.454 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:19:58.455 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T22:19:58.455 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-18T22:19:58.455 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-18T22:19:58.455 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-18T22:19:58.455 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:19:58.455 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:58.455 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-18T22:19:58.455 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T22:19:58.455 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T22:19:58.455 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T22:19:58.455 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-18T22:19:58.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:58.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:58.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:58.592 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-08-18T22:19:58.600 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-18T22:19:58.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:58.602 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-08-18T22:19:58.651 INFO:teuthology.orchestra.run.smithi117.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-18T22:19:58.651 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:58.651 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-18T22:19:58.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-18T22:19:58.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-18T22:19:58.652 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-18T22:19:58.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:58.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:58.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:58.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-18T22:19:58.797 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:19:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:19:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:19:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-08-18T22:19:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.797 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:19:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 6a:da:d0:08:83:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-18T22:19:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-18T22:19:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::68da:d0ff:fe08:8307/64 scope link 2024-08-18T22:19:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:58.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-18T22:19:58.866 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:19:58.866 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:19:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:19:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-08-18T22:19:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.867 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:19:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 6a:da:d0:08:83:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-18T22:19:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-18T22:19:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.868 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::68da:d0ff:fe08:8307/64 scope link 2024-08-18T22:19:58.868 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:19:58.869 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-18T22:19:58.869 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:58.869 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-18T22:19:58.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-18T22:19:58.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-18T22:19:58.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-18T22:19:58.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-18T22:19:58.870 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-18T22:19:58.870 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-18T22:19:58.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:59.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:59.046 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:19:59.046 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-08-18T22:19:59.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.1 up 2024-08-18T22:19:59.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.1 master ceph-brx 2024-08-18T22:19:59.046 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-08-18T22:19:59.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:59.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:59.129 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:19:59.129 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-18T22:19:59.183 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-18T22:19:59.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:19:59.184 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-18T22:19:59.234 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:19:59.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:59.234 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-08-18T22:19:59.321 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-08-18T22:19:59.321 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-08-18T22:19:59.322 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2024-08-18T22:19:59.336 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-08-18T22:19:59.336 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-08-18T22:19:59.336 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2024-08-18T22:19:59.336 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:19:59.337 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:19:59.347 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-08-18T22:19:59.347 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-08-18T22:19:59.347 INFO:teuthology.orchestra.run.smithi117.stdout:invalid new device string format 2024-08-18T22:19:59.347 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:19:59.347 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:19:59.347 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:19:59.347 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:19:59.347 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:19:59.351 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:19:59.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:19:59.351 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-18T22:19:59.370 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:59.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:59.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:59.468 INFO:teuthology.orchestra.run.smithi117.stdout:client4553 2024-08-18T22:19:59.468 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:19:59.469 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:19:59.527 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:59.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:59.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:59.626 INFO:teuthology.orchestra.run.smithi117.stdout:client4553 2024-08-18T22:19:59.627 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:19:59.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:19:59.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:59.683 INFO:teuthology.orchestra.run.smithi117.stdout:client4553 2024-08-18T22:19:59.684 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2affb9c-c71f-418c-b271-e1d1f0126ce6.client4553/status') 2024-08-18T22:19:59.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:19:59.741 INFO:teuthology.orchestra.run.smithi117.stdout:instance: client.4553 (3)192.168.0.2:0/1928898541 2024-08-18T22:19:59.741 INFO:teuthology.orchestra.run.smithi117.stdout:blocklisted: false 2024-08-18T22:19:59.742 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records in 2024-08-18T22:19:59.742 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records out 2024-08-18T22:19:59.742 INFO:teuthology.orchestra.run.smithi117.stderr:69 bytes copied, 5.9852e-05 s, 1.2 MB/s 2024-08-18T22:19:59.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-08-18T22:19:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:19:59.750 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-18T22:19:59.800 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-08-18T22:19:59.800 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-08-18T22:19:59.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:19:59.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.950+0000 7f0d1ae00640 1 Processor -- start 2024-08-18T22:19:59.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.950+0000 7f0d1ae00640 1 -- start start 2024-08-18T22:19:59.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d1ae00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d140cee40 0x7f0d1406c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:59.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d1ae00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d140ca3e0 0x7f0d140ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:59.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d1ae00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d1415e840 con 0x7f0d1415e460 2024-08-18T22:19:59.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d1ae00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0d140ae750 con 0x7f0d140ca3e0 2024-08-18T22:19:59.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d1ae00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0d1406c900 con 0x7f0d140cee40 2024-08-18T22:19:59.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d18e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d140ca3e0 0x7f0d140ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:59.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d13e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0d1415e460 0x7f0d140ae040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59276/0 (socket says 172.21.15.5:59276) 2024-08-18T22:19:59.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d13e00640 1 -- 172.21.15.5:0/779641441 learned_addr learned my addr 172.21.15.5:0/779641441 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:19:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d13400640 1 --2- 172.21.15.5:0/779641441 >> v2:172.21.15.117:3300/0 conn(0x7f0d140cee40 0x7f0d1406c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d18e00640 1 -- 172.21.15.5:0/779641441 >> v2:172.21.15.117:3300/0 conn(0x7f0d140cee40 msgr2=0x7f0d1406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:19:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d18e00640 1 --2- 172.21.15.5:0/779641441 >> v2:172.21.15.117:3300/0 conn(0x7f0d140cee40 0x7f0d1406c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d18e00640 1 -- 172.21.15.5:0/779641441 >> v1:172.21.15.5:6789/0 conn(0x7f0d1415e460 legacy=0x7f0d140ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d18e00640 1 -- 172.21.15.5:0/779641441 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d140cf320 con 0x7f0d140ca3e0 2024-08-18T22:19:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d12a00640 1 -- 172.21.15.5:0/779641441 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 878072132 0 0) 0x7f0d1415e840 con 0x7f0d1415e460 2024-08-18T22:19:59.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.954+0000 7f0d18e00640 1 --2- 172.21.15.5:0/779641441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d140ca3e0 0x7f0d140ca890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0d14073ec0 tx=0x7f0d0c01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa60daead008033d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d12a00640 1 -- 172.21.15.5:0/779641441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0b4070 con 0x7f0d140ca3e0 2024-08-18T22:19:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d12a00640 1 -- 172.21.15.5:0/779641441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c0af600 con 0x7f0d140ca3e0 2024-08-18T22:19:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d12a00640 1 -- 172.21.15.5:0/779641441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0af9d0 con 0x7f0d140ca3e0 2024-08-18T22:19:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 -- 172.21.15.5:0/779641441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d140ca3e0 msgr2=0x7f0d140ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 --2- 172.21.15.5:0/779641441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d140ca3e0 0x7f0d140ca890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0d14073ec0 tx=0x7f0d0c01f110 comp rx=0 tx=0).stop 2024-08-18T22:19:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 -- 172.21.15.5:0/779641441 shutdown_connections 2024-08-18T22:19:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 --2- 172.21.15.5:0/779641441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d140ca3e0 0x7f0d140ca890 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 --2- 172.21.15.5:0/779641441 >> v2:172.21.15.117:3300/0 conn(0x7f0d140cee40 0x7f0d1406c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:59.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 -- 172.21.15.5:0/779641441 >> 172.21.15.5:0/779641441 conn(0x7f0d1409aa40 msgr2=0x7f0d140b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:19:59.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 -- 172.21.15.5:0/779641441 shutdown_connections 2024-08-18T22:19:59.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 -- 172.21.15.5:0/779641441 wait complete. 2024-08-18T22:19:59.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 Processor -- start 2024-08-18T22:19:59.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 -- start start 2024-08-18T22:19:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d140ca3e0 0x7f0d1414bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d140cee40 0x7f0d1414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d1415e460 0x7f0d140b6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0d140cfbc0 con 0x7f0d140ca3e0 2024-08-18T22:19:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0d140cf8e0 con 0x7f0d140cee40 2024-08-18T22:19:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d1ae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d140cfea0 con 0x7f0d1415e460 2024-08-18T22:19:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d13e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d140ca3e0 0x7f0d1414bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d13e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d140ca3e0 0x7f0d1414bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40470/0 (socket says 172.21.15.5:40470) 2024-08-18T22:19:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.958+0000 7f0d13e00640 1 -- 172.21.15.5:0/3795975079 learned_addr learned my addr 172.21.15.5:0/3795975079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:19:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d13400640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d140cee40 0x7f0d1414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d13e00640 1 -- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d1415e460 msgr2=0x7f0d140b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d18e00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d1415e460 0x7f0d140b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d13e00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d1415e460 0x7f0d140b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d13e00640 1 -- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d140cee40 msgr2=0x7f0d1414c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:19:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d13e00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d140cee40 0x7f0d1414c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:19:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d13e00640 1 -- 172.21.15.5:0/3795975079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d140cd1e0 con 0x7f0d140ca3e0 2024-08-18T22:19:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d18e00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d1415e460 0x7f0d140b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:19:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d13e00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d140ca3e0 0x7f0d1414bbf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c480 tx=0x7f0d0400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:59.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d0be00640 1 -- 172.21.15.5:0/3795975079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04018070 con 0x7f0d140ca3e0 2024-08-18T22:19:59.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d0be00640 1 -- 172.21.15.5:0/3795975079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d04007500 con 0x7f0d140ca3e0 2024-08-18T22:19:59.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d0be00640 1 -- 172.21.15.5:0/3795975079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04004a30 con 0x7f0d140ca3e0 2024-08-18T22:19:59.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d1ae00640 1 -- 172.21.15.5:0/3795975079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d140cd4c0 con 0x7f0d140ca3e0 2024-08-18T22:19:59.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d1ae00640 1 -- 172.21.15.5:0/3795975079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d140cda80 con 0x7f0d140ca3e0 2024-08-18T22:19:59.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d1ae00640 1 -- 172.21.15.5:0/3795975079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d140b3620 con 0x7f0d140ca3e0 2024-08-18T22:19:59.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d0be00640 1 -- 172.21.15.5:0/3795975079 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d0401b070 con 0x7f0d140ca3e0 2024-08-18T22:19:59.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d0be00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cf40678c0 0x7f0cf4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:19:59.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.962+0000 7f0d0be00640 1 -- 172.21.15.5:0/3795975079 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0d04085350 con 0x7f0d140ca3e0 2024-08-18T22:19:59.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.966+0000 7f0d13400640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cf40678c0 0x7f0cf4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:19:59.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.966+0000 7f0d13400640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cf40678c0 0x7f0cf4069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d1409f5a0 tx=0x7f0d00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:19:59.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:19:59.966+0000 7f0d0be00640 1 -- 172.21.15.5:0/3795975079 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0d04055b40 con 0x7f0d140ca3e0 2024-08-18T22:20:00.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.138+0000 7f0d1ae00640 1 -- 172.21.15.5:0/3795975079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d140ae4e0 con 0x7f0d140ca3e0 2024-08-18T22:20:00.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.138+0000 7f0d0be00640 1 -- 172.21.15.5:0/3795975079 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18442 (secure 0 0 0) 0x7f0d04055440 con 0x7f0d140ca3e0 2024-08-18T22:20:00.139 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:00.140 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:19:25.756631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 -- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cf40678c0 msgr2=0x7f0cf4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cf40678c0 0x7f0cf4069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d1409f5a0 tx=0x7f0d00008040 comp rx=0 tx=0).stop 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 -- 172.21.15.5:0/3795975079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d140ca3e0 msgr2=0x7f0d1414bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d140ca3e0 0x7f0d1414bbf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c480 tx=0x7f0d0400c940 comp rx=0 tx=0).stop 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 -- 172.21.15.5:0/3795975079 shutdown_connections 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cf40678c0 0x7f0cf4069d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d1415e460 0x7f0d140b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d140cee40 0x7f0d1414c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 --2- 172.21.15.5:0/3795975079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d140ca3e0 0x7f0d1414bbf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 -- 172.21.15.5:0/3795975079 >> 172.21.15.5:0/3795975079 conn(0x7f0d1409aa40 msgr2=0x7f0d1415ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 -- 172.21.15.5:0/3795975079 shutdown_connections 2024-08-18T22:20:00.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.142+0000 7f0d1ae00640 1 -- 172.21.15.5:0/3795975079 wait complete. 2024-08-18T22:20:00.161 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-18T22:19:18.279867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-18T22:19:19.497530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-18T22:19:23.370791+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-18T22:20:00.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:20:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facd6000640 1 Processor -- start 2024-08-18T22:20:00.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facd6000640 1 -- start start 2024-08-18T22:20:00.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facd6000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd015fb80 0x7facd00d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facd6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7facd00b5ad0 0x7facd006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facd6000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd00d30b0 con 0x7facd0071550 2024-08-18T22:20:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facd6000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7facd00d1eb0 con 0x7facd00b5ad0 2024-08-18T22:20:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facd6000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7facd00d1bd0 con 0x7facd015fb80 2024-08-18T22:20:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facc6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7facd00b5ad0 0x7facd006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7faccfe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7facd0071550 0x7facd009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59290/0 (socket says 172.21.15.5:59290) 2024-08-18T22:20:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7faccfe00640 1 -- 172.21.15.5:0/89064493 learned_addr learned my addr 172.21.15.5:0/89064493 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7faccf400640 1 --2- 172.21.15.5:0/89064493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd015fb80 0x7facd00d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facc6a00640 1 -- 172.21.15.5:0/89064493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd015fb80 msgr2=0x7facd00d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facc6a00640 1 --2- 172.21.15.5:0/89064493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd015fb80 0x7facd00d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facc6a00640 1 -- 172.21.15.5:0/89064493 >> v1:172.21.15.5:6789/0 conn(0x7facd0071550 legacy=0x7facd009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.306+0000 7facc6a00640 1 -- 172.21.15.5:0/89064493 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd00d2dd0 con 0x7facd00b5ad0 2024-08-18T22:20:00.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7facc6a00640 1 --2- 172.21.15.5:0/89064493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00b5ad0 0x7facd006fad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7facb80097c0 tx=0x7facb801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743acf73b12ad80 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:00.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7faccea00640 1 -- 172.21.15.5:0/89064493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb80b0070 con 0x7facd00b5ad0 2024-08-18T22:20:00.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7faccea00640 1 -- 172.21.15.5:0/89064493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb80ab600 con 0x7facd00b5ad0 2024-08-18T22:20:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7faccea00640 1 -- 172.21.15.5:0/89064493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb80ab9d0 con 0x7facd00b5ad0 2024-08-18T22:20:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7facd6000640 1 -- 172.21.15.5:0/89064493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00b5ad0 msgr2=0x7facd006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7facd6000640 1 --2- 172.21.15.5:0/89064493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00b5ad0 0x7facd006fad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7facb80097c0 tx=0x7facb801c380 comp rx=0 tx=0).stop 2024-08-18T22:20:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7facd6000640 1 -- 172.21.15.5:0/89064493 shutdown_connections 2024-08-18T22:20:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7facd6000640 1 --2- 172.21.15.5:0/89064493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00b5ad0 0x7facd006fad0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7facd6000640 1 --2- 172.21.15.5:0/89064493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd015fb80 0x7facd00d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7facd6000640 1 -- 172.21.15.5:0/89064493 >> 172.21.15.5:0/89064493 conn(0x7facd00d2180 msgr2=0x7facd00d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7facd6000640 1 -- 172.21.15.5:0/89064493 shutdown_connections 2024-08-18T22:20:00.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7facd6000640 1 -- 172.21.15.5:0/89064493 wait complete. 2024-08-18T22:20:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7facd6000640 1 Processor -- start 2024-08-18T22:20:00.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.310+0000 7facd6000640 1 -- start start 2024-08-18T22:20:00.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facd6000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd0071550 0x7facd006dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facd6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00b5ad0 0x7facd006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facd6000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd015fb80 0x7facd01537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facd6000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7facd009b2d0 con 0x7facd00b5ad0 2024-08-18T22:20:00.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facd6000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7facd009b150 con 0x7facd015fb80 2024-08-18T22:20:00.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facd6000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7facd0071980 con 0x7facd0071550 2024-08-18T22:20:00.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00b5ad0 0x7facd006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00b5ad0 0x7facd006e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40490/0 (socket says 172.21.15.5:40490) 2024-08-18T22:20:00.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc6a00640 1 -- 172.21.15.5:0/801761006 learned_addr learned my addr 172.21.15.5:0/801761006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:00.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7faccf400640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd0071550 0x7facd006dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7faccfe00640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd015fb80 0x7facd01537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc6a00640 1 -- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd0071550 msgr2=0x7facd006dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc6a00640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd0071550 0x7facd006dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc6a00640 1 -- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd015fb80 msgr2=0x7facd01537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc6a00640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd015fb80 0x7facd01537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc6a00640 1 -- 172.21.15.5:0/801761006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd006cb60 con 0x7facd00b5ad0 2024-08-18T22:20:00.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7faccfe00640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd015fb80 0x7facd01537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:00.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc6a00640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00b5ad0 0x7facd006e410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7facb80097c0 tx=0x7facb8019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:00.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc7e00640 1 -- 172.21.15.5:0/801761006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb80b8020 con 0x7facd00b5ad0 2024-08-18T22:20:00.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc7e00640 1 -- 172.21.15.5:0/801761006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb80b4610 con 0x7facd00b5ad0 2024-08-18T22:20:00.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facc7e00640 1 -- 172.21.15.5:0/801761006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb80b0040 con 0x7facd00b5ad0 2024-08-18T22:20:00.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facd6000640 1 -- 172.21.15.5:0/801761006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd006ce40 con 0x7facd00b5ad0 2024-08-18T22:20:00.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facd6000640 1 -- 172.21.15.5:0/801761006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd006d400 con 0x7facd00b5ad0 2024-08-18T22:20:00.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.314+0000 7facd6000640 1 -- 172.21.15.5:0/801761006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd006fad0 con 0x7facd00b5ad0 2024-08-18T22:20:00.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.318+0000 7facc7e00640 1 -- 172.21.15.5:0/801761006 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7facb80bb020 con 0x7facd00b5ad0 2024-08-18T22:20:00.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.318+0000 7facc7e00640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7facac0678c0 0x7facac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.318+0000 7facc7e00640 1 -- 172.21.15.5:0/801761006 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7facb811fac0 con 0x7facd00b5ad0 2024-08-18T22:20:00.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.318+0000 7faccf400640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7facac0678c0 0x7facac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.318+0000 7faccf400640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7facac0678c0 0x7facac069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7facc00079c0 tx=0x7facc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:00.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.322+0000 7facc7e00640 1 -- 172.21.15.5:0/801761006 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7facb80c2030 con 0x7facd00b5ad0 2024-08-18T22:20:00.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.486+0000 7facd6000640 1 -- 172.21.15.5:0/801761006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7facd00ce0d0 con 0x7facd00b5ad0 2024-08-18T22:20:00.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.486+0000 7facc7e00640 1 -- 172.21.15.5:0/801761006 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7facb8016090 con 0x7facd00b5ad0 2024-08-18T22:20:00.488 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:20:00.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 -- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7facac0678c0 msgr2=0x7facac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7facac0678c0 0x7facac069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7facc00079c0 tx=0x7facc0008040 comp rx=0 tx=0).stop 2024-08-18T22:20:00.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 -- 172.21.15.5:0/801761006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00b5ad0 msgr2=0x7facd006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00b5ad0 0x7facd006e410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7facb80097c0 tx=0x7facb8019120 comp rx=0 tx=0).stop 2024-08-18T22:20:00.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 -- 172.21.15.5:0/801761006 shutdown_connections 2024-08-18T22:20:00.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7facac0678c0 0x7facac069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd015fb80 0x7facd01537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00b5ad0 0x7facd006e410 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 --2- 172.21.15.5:0/801761006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd0071550 0x7facd006dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 -- 172.21.15.5:0/801761006 >> 172.21.15.5:0/801761006 conn(0x7facd00d2180 msgr2=0x7facd00d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:00.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 -- 172.21.15.5:0/801761006 shutdown_connections 2024-08-18T22:20:00.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.490+0000 7facd6000640 1 -- 172.21.15.5:0/801761006 wait complete. 2024-08-18T22:20:00.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-18T22:20:00.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc891600640 1 Processor -- start 2024-08-18T22:20:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc891600640 1 -- start start 2024-08-18T22:20:00.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc891600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc88c15e1c0 0x7fc88c0b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc891600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc88c0ae2c0 0x7fc88c0af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc891600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c0b6700 con 0x7fc88c0ae700 2024-08-18T22:20:00.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc891600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc88c0b5d30 con 0x7fc88c15e1c0 2024-08-18T22:20:00.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc891600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc88c0b5120 con 0x7fc88c0ae2c0 2024-08-18T22:20:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc88aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc88c15e1c0 0x7fc88c0b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc88b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc88c0ae700 0x7fc88c06efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59300/0 (socket says 172.21.15.5:59300) 2024-08-18T22:20:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc88b400640 1 -- 172.21.15.5:0/1082624545 learned_addr learned my addr 172.21.15.5:0/1082624545 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc882000640 1 --2- 172.21.15.5:0/1082624545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc88c0ae2c0 0x7fc88c0af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc88aa00640 1 -- 172.21.15.5:0/1082624545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc88c0ae2c0 msgr2=0x7fc88c0af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc88aa00640 1 --2- 172.21.15.5:0/1082624545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc88c0ae2c0 0x7fc88c0af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc88aa00640 1 -- 172.21.15.5:0/1082624545 >> v1:172.21.15.5:6789/0 conn(0x7fc88c0ae700 legacy=0x7fc88c06efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc88aa00640 1 -- 172.21.15.5:0/1082624545 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c0b5400 con 0x7fc88c15e1c0 2024-08-18T22:20:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.654+0000 7fc88a000640 1 -- 172.21.15.5:0/1082624545 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3087063255 0 0) 0x7fc88c0b6700 con 0x7fc88c0ae700 2024-08-18T22:20:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc88aa00640 1 --2- 172.21.15.5:0/1082624545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c15e1c0 0x7fc88c0b61c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0097c0 tx=0x7fc87c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4ccd6631503761 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc88a000640 1 -- 172.21.15.5:0/1082624545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0b2070 con 0x7fc88c15e1c0 2024-08-18T22:20:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc88a000640 1 -- 172.21.15.5:0/1082624545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c0ad680 con 0x7fc88c15e1c0 2024-08-18T22:20:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc88a000640 1 -- 172.21.15.5:0/1082624545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0ada50 con 0x7fc88c15e1c0 2024-08-18T22:20:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc891600640 1 -- 172.21.15.5:0/1082624545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c15e1c0 msgr2=0x7fc88c0b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc891600640 1 --2- 172.21.15.5:0/1082624545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c15e1c0 0x7fc88c0b61c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0097c0 tx=0x7fc87c01c470 comp rx=0 tx=0).stop 2024-08-18T22:20:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc891600640 1 -- 172.21.15.5:0/1082624545 shutdown_connections 2024-08-18T22:20:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc891600640 1 --2- 172.21.15.5:0/1082624545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc88c0ae2c0 0x7fc88c0af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc891600640 1 --2- 172.21.15.5:0/1082624545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c15e1c0 0x7fc88c0b61c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc891600640 1 -- 172.21.15.5:0/1082624545 >> 172.21.15.5:0/1082624545 conn(0x7fc88c071f30 msgr2=0x7fc88c072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc891600640 1 -- 172.21.15.5:0/1082624545 shutdown_connections 2024-08-18T22:20:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc891600640 1 -- 172.21.15.5:0/1082624545 wait complete. 2024-08-18T22:20:00.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc891600640 1 Processor -- start 2024-08-18T22:20:00.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.658+0000 7fc891600640 1 -- start start 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc891600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc88c0ae2c0 0x7fc88c1679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc891600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c0ae700 0x7fc88c1490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc891600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc88c15e1c0 0x7fc88c158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc891600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c15e720 con 0x7fc88c0ae700 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc891600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c15e5a0 con 0x7fc88c0ae2c0 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc891600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc88c0b37f0 con 0x7fc88c15e1c0 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc882000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c0ae700 0x7fc88c1490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc882000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c0ae700 0x7fc88c1490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40500/0 (socket says 172.21.15.5:40500) 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc882000640 1 -- 172.21.15.5:0/1256112645 learned_addr learned my addr 172.21.15.5:0/1256112645 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc88aa00640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc88c0ae2c0 0x7fc88c1679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc88b400640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc88c15e1c0 0x7fc88c158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc882000640 1 -- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc88c15e1c0 msgr2=0x7fc88c158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc882000640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc88c15e1c0 0x7fc88c158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc882000640 1 -- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc88c0ae2c0 msgr2=0x7fc88c1679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc882000640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc88c0ae2c0 0x7fc88c1679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc882000640 1 -- 172.21.15.5:0/1256112645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c149620 con 0x7fc88c0ae700 2024-08-18T22:20:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc882000640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c0ae700 0x7fc88c1490e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc87400d5f0 tx=0x7fc87400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc883400640 1 -- 172.21.15.5:0/1256112645 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8740125f0 con 0x7fc88c0ae700 2024-08-18T22:20:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc883400640 1 -- 172.21.15.5:0/1256112645 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc874019070 con 0x7fc88c0ae700 2024-08-18T22:20:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc891600640 1 -- 172.21.15.5:0/1256112645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c15c240 con 0x7fc88c0ae700 2024-08-18T22:20:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc883400640 1 -- 172.21.15.5:0/1256112645 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8740129b0 con 0x7fc88c0ae700 2024-08-18T22:20:00.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc891600640 1 -- 172.21.15.5:0/1256112645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c15caa0 con 0x7fc88c0ae700 2024-08-18T22:20:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc891600640 1 -- 172.21.15.5:0/1256112645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88c15c5f0 con 0x7fc88c0ae700 2024-08-18T22:20:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.662+0000 7fc883400640 1 -- 172.21.15.5:0/1256112645 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc874012b50 con 0x7fc88c0ae700 2024-08-18T22:20:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.666+0000 7fc883400640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8680678c0 0x7fc868069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:00.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.666+0000 7fc883400640 1 -- 172.21.15.5:0/1256112645 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc874086320 con 0x7fc88c0ae700 2024-08-18T22:20:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.666+0000 7fc88aa00640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8680678c0 0x7fc868069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.666+0000 7fc88aa00640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8680678c0 0x7fc868069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0af000 tx=0x7fc87c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:00.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.670+0000 7fc883400640 1 -- 172.21.15.5:0/1256112645 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc874056430 con 0x7fc88c0ae700 2024-08-18T22:20:00.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.834+0000 7fc891600640 1 -- 172.21.15.5:0/1256112645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc88c0af600 con 0x7fc88c0ae700 2024-08-18T22:20:00.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc883400640 1 -- 172.21.15.5:0/1256112645 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fc87405a730 con 0x7fc88c0ae700 2024-08-18T22:20:00.837 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 -- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8680678c0 msgr2=0x7fc868069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8680678c0 0x7fc868069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0af000 tx=0x7fc87c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 -- 172.21.15.5:0/1256112645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c0ae700 msgr2=0x7fc88c1490e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c0ae700 0x7fc88c1490e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc87400d5f0 tx=0x7fc87400dab0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 -- 172.21.15.5:0/1256112645 shutdown_connections 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8680678c0 0x7fc868069d80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc88c15e1c0 0x7fc88c158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c0ae700 0x7fc88c1490e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 --2- 172.21.15.5:0/1256112645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc88c0ae2c0 0x7fc88c1679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 -- 172.21.15.5:0/1256112645 >> 172.21.15.5:0/1256112645 conn(0x7fc88c071f30 msgr2=0x7fc88c0ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 -- 172.21.15.5:0/1256112645 shutdown_connections 2024-08-18T22:20:00.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:00.838+0000 7fc891600640 1 -- 172.21.15.5:0/1256112645 wait complete. 2024-08-18T22:20:00.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-18T22:20:01.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.002+0000 7f6039800640 1 Processor -- start 2024-08-18T22:20:01.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.002+0000 7f6039800640 1 -- start start 2024-08-18T22:20:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.002+0000 7f6039800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60340716e0 0x7f60340d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.002+0000 7f6039800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60340b4c00 con 0x7f603415f910 2024-08-18T22:20:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.002+0000 7f6039800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f603406ff60 con 0x7f603409aa40 2024-08-18T22:20:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.002+0000 7f6039800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f60340d1080 con 0x7f60340716e0 2024-08-18T22:20:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.002+0000 7f6032a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f603415f910 0x7f6034070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59314/0 (socket says 172.21.15.5:59314) 2024-08-18T22:20:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.002+0000 7f6032a00640 1 -- 172.21.15.5:0/4057539086 learned_addr learned my addr 172.21.15.5:0/4057539086 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.002+0000 7f6032000640 1 --2- 172.21.15.5:0/4057539086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60340716e0 0x7f60340d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.006+0000 7f6031600640 1 -- 172.21.15.5:0/4057539086 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2770727624 0 0) 0x7f60340b4c00 con 0x7f603415f910 2024-08-18T22:20:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.006+0000 7f6031600640 1 -- 172.21.15.5:0/4057539086 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6018003530 con 0x7f603415f910 2024-08-18T22:20:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.006+0000 7f6031600640 1 -- 172.21.15.5:0/4057539086 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252165184 0 0) 0x7f603406ff60 con 0x7f603409aa40 2024-08-18T22:20:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.006+0000 7f6032000640 1 -- 172.21.15.5:0/4057539086 >> v1:172.21.15.117:6789/0 conn(0x7f603409aa40 legacy=0x7f60340ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.006+0000 7f6032000640 1 -- 172.21.15.5:0/4057539086 >> v1:172.21.15.5:6789/0 conn(0x7f603415f910 legacy=0x7f6034070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.006+0000 7f6032000640 1 -- 172.21.15.5:0/4057539086 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6034070240 con 0x7f60340716e0 2024-08-18T22:20:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.006+0000 7f6032000640 1 --2- 172.21.15.5:0/4057539086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60340716e0 0x7f60340d0aa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f60200097f0 tx=0x7f602001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4bd05a6b88b81fb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.006+0000 7f6031600640 1 -- 172.21.15.5:0/4057539086 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60200aa660 con 0x7f60340716e0 2024-08-18T22:20:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.006+0000 7f6031600640 1 -- 172.21.15.5:0/4057539086 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60200af070 con 0x7f60340716e0 2024-08-18T22:20:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.006+0000 7f6031600640 1 -- 172.21.15.5:0/4057539086 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60200aaa00 con 0x7f60340716e0 2024-08-18T22:20:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.006+0000 7f6039800640 1 -- 172.21.15.5:0/4057539086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60340716e0 msgr2=0x7f60340d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 --2- 172.21.15.5:0/4057539086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60340716e0 0x7f60340d0aa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f60200097f0 tx=0x7f602001c4e0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 -- 172.21.15.5:0/4057539086 shutdown_connections 2024-08-18T22:20:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 --2- 172.21.15.5:0/4057539086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60340716e0 0x7f60340d0aa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 -- 172.21.15.5:0/4057539086 >> 172.21.15.5:0/4057539086 conn(0x7f60340b3d10 msgr2=0x7f60340b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 -- 172.21.15.5:0/4057539086 shutdown_connections 2024-08-18T22:20:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 -- 172.21.15.5:0/4057539086 wait complete. 2024-08-18T22:20:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 Processor -- start 2024-08-18T22:20:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 -- start start 2024-08-18T22:20:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60340716e0 0x7f6034167a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f603409aa40 0x7f603415e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f603415f910 0x7f603406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f603409b2a0 con 0x7f603415f910 2024-08-18T22:20:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f603415fcf0 con 0x7f603409aa40 2024-08-18T22:20:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6039800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f603416ab80 con 0x7f60340716e0 2024-08-18T22:20:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6033400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f603415f910 0x7f603406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6033400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f603415f910 0x7f603406cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40506/0 (socket says 172.21.15.5:40506) 2024-08-18T22:20:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6033400640 1 -- 172.21.15.5:0/1741066881 learned_addr learned my addr 172.21.15.5:0/1741066881 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6032000640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f603409aa40 0x7f603415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6032a00640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60340716e0 0x7f6034167a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6033400640 1 -- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60340716e0 msgr2=0x7f6034167a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6033400640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60340716e0 0x7f6034167a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6033400640 1 -- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f603409aa40 msgr2=0x7f603415e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6033400640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f603409aa40 0x7f603415e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6033400640 1 -- 172.21.15.5:0/1741066881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6034165520 con 0x7f603415f910 2024-08-18T22:20:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.010+0000 7f6033400640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f603415f910 0x7f603406cac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f602c00c7b0 tx=0x7f602c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.014+0000 7f602aa00640 1 -- 172.21.15.5:0/1741066881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c003db0 con 0x7f603415f910 2024-08-18T22:20:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.014+0000 7f602aa00640 1 -- 172.21.15.5:0/1741066881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602c005070 con 0x7f603415f910 2024-08-18T22:20:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.014+0000 7f602aa00640 1 -- 172.21.15.5:0/1741066881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c005460 con 0x7f603415f910 2024-08-18T22:20:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.014+0000 7f6039800640 1 -- 172.21.15.5:0/1741066881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6034165800 con 0x7f603415f910 2024-08-18T22:20:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.014+0000 7f6039800640 1 -- 172.21.15.5:0/1741066881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6034165e30 con 0x7f603415f910 2024-08-18T22:20:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.014+0000 7f6039800640 1 -- 172.21.15.5:0/1741066881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60341664e0 con 0x7f603415f910 2024-08-18T22:20:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.014+0000 7f602aa00640 1 -- 172.21.15.5:0/1741066881 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f602c005600 con 0x7f603415f910 2024-08-18T22:20:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.014+0000 7f602aa00640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60140678c0 0x7f6014069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.014+0000 7f602aa00640 1 -- 172.21.15.5:0/1741066881 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f602c085f90 con 0x7f603415f910 2024-08-18T22:20:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.014+0000 7f6032a00640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60140678c0 0x7f6014069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.014+0000 7f6032a00640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60140678c0 0x7f6014069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6024005890 tx=0x7f6024009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.018+0000 7f602aa00640 1 -- 172.21.15.5:0/1741066881 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f602c0566f0 con 0x7f603415f910 2024-08-18T22:20:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.186+0000 7f6039800640 1 -- 172.21.15.5:0/1741066881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f603406ff60 con 0x7f603415f910 2024-08-18T22:20:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f602aa00640 1 -- 172.21.15.5:0/1741066881 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f602c055ff0 con 0x7f603415f910 2024-08-18T22:20:01.190 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-18T22:20:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 -- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60140678c0 msgr2=0x7f6014069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60140678c0 0x7f6014069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6024005890 tx=0x7f6024009040 comp rx=0 tx=0).stop 2024-08-18T22:20:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 -- 172.21.15.5:0/1741066881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f603415f910 msgr2=0x7f603406cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f603415f910 0x7f603406cac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f602c00c7b0 tx=0x7f602c00cc70 comp rx=0 tx=0).stop 2024-08-18T22:20:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 -- 172.21.15.5:0/1741066881 shutdown_connections 2024-08-18T22:20:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60140678c0 0x7f6014069d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f603415f910 0x7f603406cac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f603409aa40 0x7f603415e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 --2- 172.21.15.5:0/1741066881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60340716e0 0x7f6034167a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 -- 172.21.15.5:0/1741066881 >> 172.21.15.5:0/1741066881 conn(0x7f60340b3d10 msgr2=0x7f60340b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 -- 172.21.15.5:0/1741066881 shutdown_connections 2024-08-18T22:20:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.190+0000 7f6039800640 1 -- 172.21.15.5:0/1741066881 wait complete. 2024-08-18T22:20:01.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-18T22:20:01.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde29c00640 1 Processor -- start 2024-08-18T22:20:01.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde29c00640 1 -- start start 2024-08-18T22:20:01.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde29c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fde2409aca0 0x7fde240afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde29c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2409b080 0x7fde240b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde29c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde2406e8a0 con 0x7fde240b1300 2024-08-18T22:20:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde29c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fde2409bb80 con 0x7fde2409aca0 2024-08-18T22:20:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde29c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fde240d2e40 con 0x7fde2409b080 2024-08-18T22:20:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde1a000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fde240b1300 0x7fde240affd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59320/0 (socket says 172.21.15.5:59320) 2024-08-18T22:20:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde1a000640 1 -- 172.21.15.5:0/1692671256 learned_addr learned my addr 172.21.15.5:0/1692671256 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde22a00640 1 --2- 172.21.15.5:0/1692671256 >> v2:172.21.15.117:3300/0 conn(0x7fde2409aca0 0x7fde240afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde23400640 1 --2- 172.21.15.5:0/1692671256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2409b080 0x7fde240b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde22000640 1 -- 172.21.15.5:0/1692671256 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868904555 0 0) 0x7fde2406e8a0 con 0x7fde240b1300 2024-08-18T22:20:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde22000640 1 -- 172.21.15.5:0/1692671256 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde08003530 con 0x7fde240b1300 2024-08-18T22:20:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde22a00640 1 -- 172.21.15.5:0/1692671256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2409b080 msgr2=0x7fde240b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde22a00640 1 --2- 172.21.15.5:0/1692671256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2409b080 0x7fde240b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde22a00640 1 -- 172.21.15.5:0/1692671256 >> v1:172.21.15.5:6789/0 conn(0x7fde240b1300 legacy=0x7fde240affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.354+0000 7fde22a00640 1 -- 172.21.15.5:0/1692671256 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2406cbd0 con 0x7fde2409aca0 2024-08-18T22:20:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde22a00640 1 --2- 172.21.15.5:0/1692671256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2409aca0 0x7fde240afa90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fde140097c0 tx=0x7fde1401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0f087693ad4a209 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde22000640 1 -- 172.21.15.5:0/1692671256 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde140b0070 con 0x7fde2409aca0 2024-08-18T22:20:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde22000640 1 -- 172.21.15.5:0/1692671256 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde14004230 con 0x7fde2409aca0 2024-08-18T22:20:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde22000640 1 -- 172.21.15.5:0/1692671256 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde14003620 con 0x7fde2409aca0 2024-08-18T22:20:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde29c00640 1 -- 172.21.15.5:0/1692671256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2409aca0 msgr2=0x7fde240afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde29c00640 1 --2- 172.21.15.5:0/1692671256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2409aca0 0x7fde240afa90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fde140097c0 tx=0x7fde1401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde29c00640 1 -- 172.21.15.5:0/1692671256 shutdown_connections 2024-08-18T22:20:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde29c00640 1 --2- 172.21.15.5:0/1692671256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2409b080 0x7fde240b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde29c00640 1 --2- 172.21.15.5:0/1692671256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2409aca0 0x7fde240afa90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde29c00640 1 -- 172.21.15.5:0/1692671256 >> 172.21.15.5:0/1692671256 conn(0x7fde240d2180 msgr2=0x7fde240d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde29c00640 1 -- 172.21.15.5:0/1692671256 shutdown_connections 2024-08-18T22:20:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.358+0000 7fde29c00640 1 -- 172.21.15.5:0/1692671256 wait complete. 2024-08-18T22:20:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde29c00640 1 Processor -- start 2024-08-18T22:20:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde29c00640 1 -- start start 2024-08-18T22:20:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde29c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2409aca0 0x7fde241526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde29c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2409b080 0x7fde240cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde29c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde240b1300 0x7fde240b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde29c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fde2416b6b0 con 0x7fde240b1300 2024-08-18T22:20:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde29c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fde2416b530 con 0x7fde2409aca0 2024-08-18T22:20:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde29c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fde2416b830 con 0x7fde2409b080 2024-08-18T22:20:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde23400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde240b1300 0x7fde240b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde1a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2409b080 0x7fde240cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde22a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2409aca0 0x7fde241526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde23400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde240b1300 0x7fde240b2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40514/0 (socket says 172.21.15.5:40514) 2024-08-18T22:20:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde23400640 1 -- 172.21.15.5:0/390148520 learned_addr learned my addr 172.21.15.5:0/390148520 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde1a000640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2409b080 0x7fde240cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:52988/0 (socket says 172.21.15.5:52988) 2024-08-18T22:20:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde23400640 1 -- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2409b080 msgr2=0x7fde240cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde23400640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2409b080 0x7fde240cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde23400640 1 -- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2409aca0 msgr2=0x7fde241526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde23400640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2409aca0 0x7fde241526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde23400640 1 -- 172.21.15.5:0/390148520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde240cb9b0 con 0x7fde240b1300 2024-08-18T22:20:01.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde23400640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde240b1300 0x7fde240b2c40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00efc0 tx=0x7fde1c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:01.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde1b400640 1 -- 172.21.15.5:0/390148520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c018020 con 0x7fde240b1300 2024-08-18T22:20:01.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde1b400640 1 -- 172.21.15.5:0/390148520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c014480 con 0x7fde240b1300 2024-08-18T22:20:01.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde1b400640 1 -- 172.21.15.5:0/390148520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c014870 con 0x7fde240b1300 2024-08-18T22:20:01.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde29c00640 1 -- 172.21.15.5:0/390148520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde24152d00 con 0x7fde240b1300 2024-08-18T22:20:01.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.362+0000 7fde29c00640 1 -- 172.21.15.5:0/390148520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde24157110 con 0x7fde240b1300 2024-08-18T22:20:01.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.366+0000 7fde29c00640 1 -- 172.21.15.5:0/390148520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde24161940 con 0x7fde240b1300 2024-08-18T22:20:01.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.366+0000 7fde1b400640 1 -- 172.21.15.5:0/390148520 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fde1c01b020 con 0x7fde240b1300 2024-08-18T22:20:01.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.366+0000 7fde1b400640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fde000678c0 0x7fde00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.366+0000 7fde1b400640 1 -- 172.21.15.5:0/390148520 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fde1c086c30 con 0x7fde240b1300 2024-08-18T22:20:01.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.366+0000 7fde22a00640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fde000678c0 0x7fde00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.366+0000 7fde22a00640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fde000678c0 0x7fde00069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde140ad000 tx=0x7fde14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:01.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.370+0000 7fde1b400640 1 -- 172.21.15.5:0/390148520 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fde1c08d080 con 0x7fde240b1300 2024-08-18T22:20:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.534+0000 7fde29c00640 1 -- 172.21.15.5:0/390148520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fde24070b00 con 0x7fde240b1300 2024-08-18T22:20:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.534+0000 7fde1b400640 1 -- 172.21.15.5:0/390148520 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fde1c022030 con 0x7fde240b1300 2024-08-18T22:20:01.537 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-18T22:20:01.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 -- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fde000678c0 msgr2=0x7fde00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fde000678c0 0x7fde00069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde140ad000 tx=0x7fde14008040 comp rx=0 tx=0).stop 2024-08-18T22:20:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 -- 172.21.15.5:0/390148520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde240b1300 msgr2=0x7fde240b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde240b1300 0x7fde240b2c40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00efc0 tx=0x7fde1c00c490 comp rx=0 tx=0).stop 2024-08-18T22:20:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 -- 172.21.15.5:0/390148520 shutdown_connections 2024-08-18T22:20:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fde000678c0 0x7fde00069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde240b1300 0x7fde240b2c40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2409b080 0x7fde240cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 --2- 172.21.15.5:0/390148520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde2409aca0 0x7fde241526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 -- 172.21.15.5:0/390148520 >> 172.21.15.5:0/390148520 conn(0x7fde240d2180 msgr2=0x7fde240b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 -- 172.21.15.5:0/390148520 shutdown_connections 2024-08-18T22:20:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.538+0000 7fde29c00640 1 -- 172.21.15.5:0/390148520 wait complete. 2024-08-18T22:20:01.560 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-08-18T22:20:01.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff69e600640 1 Processor -- start 2024-08-18T22:20:01.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff69e600640 1 -- start start 2024-08-18T22:20:01.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff69e600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff69815b010 0x7ff6980ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff69e600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6980cd3a0 0x7ff69806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff69e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69806f0c0 0x7ff6980caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff69e600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff6980cfa30 con 0x7ff6980cd3a0 2024-08-18T22:20:01.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff69e600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff6980cee20 con 0x7ff69815b010 2024-08-18T22:20:01.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff69e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff6980cf100 con 0x7ff69806f0c0 2024-08-18T22:20:01.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff68ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6980cd3a0 0x7ff69806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff68ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6980cd3a0 0x7ff69806eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40516/0 (socket says 172.21.15.5:40516) 2024-08-18T22:20:01.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff68ea00640 1 -- 172.21.15.5:0/2146961246 learned_addr learned my addr 172.21.15.5:0/2146961246 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:01.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff697e00640 1 --2- 172.21.15.5:0/2146961246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69806f0c0 0x7ff6980caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff697400640 1 --2- 172.21.15.5:0/2146961246 >> v2:172.21.15.117:3300/0 conn(0x7ff69815b010 0x7ff6980ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff68ea00640 1 -- 172.21.15.5:0/2146961246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69806f0c0 msgr2=0x7ff6980caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:01.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff68ea00640 1 --2- 172.21.15.5:0/2146961246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69806f0c0 0x7ff6980caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff68ea00640 1 -- 172.21.15.5:0/2146961246 >> v2:172.21.15.117:3300/0 conn(0x7ff69815b010 msgr2=0x7ff6980ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:01.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff68ea00640 1 --2- 172.21.15.5:0/2146961246 >> v2:172.21.15.117:3300/0 conn(0x7ff69815b010 0x7ff6980ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.702+0000 7ff68ea00640 1 -- 172.21.15.5:0/2146961246 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6980cf3e0 con 0x7ff6980cd3a0 2024-08-18T22:20:01.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff68ea00640 1 --2- 172.21.15.5:0/2146961246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6980cd3a0 0x7ff69806eb80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff6980b2cc0 tx=0x7ff68001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13742a12114fc38 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:01.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff696a00640 1 -- 172.21.15.5:0/2146961246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6800b0070 con 0x7ff6980cd3a0 2024-08-18T22:20:01.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff696a00640 1 -- 172.21.15.5:0/2146961246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6800ab600 con 0x7ff6980cd3a0 2024-08-18T22:20:01.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff696a00640 1 -- 172.21.15.5:0/2146961246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6800ab9d0 con 0x7ff6980cd3a0 2024-08-18T22:20:01.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff69e600640 1 -- 172.21.15.5:0/2146961246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6980cd3a0 msgr2=0x7ff69806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff69e600640 1 --2- 172.21.15.5:0/2146961246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6980cd3a0 0x7ff69806eb80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff6980b2cc0 tx=0x7ff68001c260 comp rx=0 tx=0).stop 2024-08-18T22:20:01.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff69e600640 1 -- 172.21.15.5:0/2146961246 shutdown_connections 2024-08-18T22:20:01.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff69e600640 1 --2- 172.21.15.5:0/2146961246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69806f0c0 0x7ff6980caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff69e600640 1 --2- 172.21.15.5:0/2146961246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6980cd3a0 0x7ff69806eb80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff69e600640 1 --2- 172.21.15.5:0/2146961246 >> v2:172.21.15.117:3300/0 conn(0x7ff69815b010 0x7ff6980ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff69e600640 1 -- 172.21.15.5:0/2146961246 >> 172.21.15.5:0/2146961246 conn(0x7ff6980b1c50 msgr2=0x7ff6980b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:01.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff69e600640 1 -- 172.21.15.5:0/2146961246 shutdown_connections 2024-08-18T22:20:01.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff69e600640 1 -- 172.21.15.5:0/2146961246 wait complete. 2024-08-18T22:20:01.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff69e600640 1 Processor -- start 2024-08-18T22:20:01.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.706+0000 7ff69e600640 1 -- start start 2024-08-18T22:20:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff69e600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff69806f0c0 0x7ff698159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff69e600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6980cd3a0 0x7ff69809c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff69e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69815b010 0x7ff6980ad940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff69e600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff698072780 con 0x7ff69806f0c0 2024-08-18T22:20:01.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff69e600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff698072600 con 0x7ff6980cd3a0 2024-08-18T22:20:01.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff69e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff698072900 con 0x7ff69815b010 2024-08-18T22:20:01.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff697400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff69806f0c0 0x7ff698159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff697400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff69806f0c0 0x7ff698159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40524/0 (socket says 172.21.15.5:40524) 2024-08-18T22:20:01.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff697400640 1 -- 172.21.15.5:0/1529913424 learned_addr learned my addr 172.21.15.5:0/1529913424 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:01.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff68ea00640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6980cd3a0 0x7ff69809c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff697e00640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69815b010 0x7ff6980ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff697400640 1 -- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69815b010 msgr2=0x7ff6980ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff697400640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69815b010 0x7ff6980ad940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff697400640 1 -- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6980cd3a0 msgr2=0x7ff69809c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff697400640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6980cd3a0 0x7ff69809c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff697400640 1 -- 172.21.15.5:0/1529913424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6980ade80 con 0x7ff69806f0c0 2024-08-18T22:20:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff68ea00640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6980cd3a0 0x7ff69809c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff697400640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff69806f0c0 0x7ff698159120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff68800e870 tx=0x7ff68800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff68fe00640 1 -- 172.21.15.5:0/1529913424 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688017070 con 0x7ff69806f0c0 2024-08-18T22:20:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff68fe00640 1 -- 172.21.15.5:0/1529913424 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68800c940 con 0x7ff69806f0c0 2024-08-18T22:20:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff69e600640 1 -- 172.21.15.5:0/1529913424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69809cb60 con 0x7ff69806f0c0 2024-08-18T22:20:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff68fe00640 1 -- 172.21.15.5:0/1529913424 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68800ccf0 con 0x7ff69806f0c0 2024-08-18T22:20:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff69e600640 1 -- 172.21.15.5:0/1529913424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69809d120 con 0x7ff69806f0c0 2024-08-18T22:20:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.710+0000 7ff69e600640 1 -- 172.21.15.5:0/1529913424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69806eb80 con 0x7ff69806f0c0 2024-08-18T22:20:01.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.714+0000 7ff68fe00640 1 -- 172.21.15.5:0/1529913424 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff68801a070 con 0x7ff69806f0c0 2024-08-18T22:20:01.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.714+0000 7ff68fe00640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6740678c0 0x7ff674069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:01.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.714+0000 7ff68fe00640 1 -- 172.21.15.5:0/1529913424 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff688085ec0 con 0x7ff69806f0c0 2024-08-18T22:20:01.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.714+0000 7ff68ea00640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6740678c0 0x7ff674069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:01.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.714+0000 7ff68ea00640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6740678c0 0x7ff674069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff6800ad000 tx=0x7ff680008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:01.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.718+0000 7ff68fe00640 1 -- 172.21.15.5:0/1529913424 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff688056620 con 0x7ff69806f0c0 2024-08-18T22:20:01.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:01.942+0000 7ff69e600640 1 -- 172.21.15.5:0/1529913424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7ff69815daa0 con 0x7ff69806f0c0 2024-08-18T22:20:02.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.462+0000 7ff68fe00640 1 -- 172.21.15.5:0/1529913424 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v59) ==== 151+0+0 (secure 0 0 0) 0x7ff688055f20 con 0x7ff69806f0c0 2024-08-18T22:20:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 -- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6740678c0 msgr2=0x7ff674069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6740678c0 0x7ff674069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff6800ad000 tx=0x7ff680008040 comp rx=0 tx=0).stop 2024-08-18T22:20:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 -- 172.21.15.5:0/1529913424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff69806f0c0 msgr2=0x7ff698159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff69806f0c0 0x7ff698159120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff68800e870 tx=0x7ff68800ec70 comp rx=0 tx=0).stop 2024-08-18T22:20:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 -- 172.21.15.5:0/1529913424 shutdown_connections 2024-08-18T22:20:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6740678c0 0x7ff674069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69815b010 0x7ff6980ad940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6980cd3a0 0x7ff69809c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 --2- 172.21.15.5:0/1529913424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff69806f0c0 0x7ff698159120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 -- 172.21.15.5:0/1529913424 >> 172.21.15.5:0/1529913424 conn(0x7ff6980b1c50 msgr2=0x7ff698159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:02.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 -- 172.21.15.5:0/1529913424 shutdown_connections 2024-08-18T22:20:02.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.466+0000 7ff69e600640 1 -- 172.21.15.5:0/1529913424 wait complete. 2024-08-18T22:20:02.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:20:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.642+0000 7f8418a00640 1 Processor -- start 2024-08-18T22:20:02.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.642+0000 7f8418a00640 1 -- start start 2024-08-18T22:20:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8418a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84140d1090 0x7f84140d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8418a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84140d30b0 con 0x7f84140b5ad0 2024-08-18T22:20:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8418a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84140d1bd0 con 0x7f841415fb80 2024-08-18T22:20:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8418a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8414071c60 con 0x7f84140d1090 2024-08-18T22:20:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8412800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f84140b5ad0 0x7f8414071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59326/0 (socket says 172.21.15.5:59326) 2024-08-18T22:20:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8412800640 1 -- 172.21.15.5:0/1188175779 learned_addr learned my addr 172.21.15.5:0/1188175779 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:02.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8409400640 1 --2- 172.21.15.5:0/1188175779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84140d1090 0x7f84140d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8411400640 1 -- 172.21.15.5:0/1188175779 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186975872 0 0) 0x7f84140d30b0 con 0x7f84140b5ad0 2024-08-18T22:20:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8411400640 1 -- 172.21.15.5:0/1188175779 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83f8003530 con 0x7f84140b5ad0 2024-08-18T22:20:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8411400640 1 -- 172.21.15.5:0/1188175779 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1574858262 0 0) 0x7f84140d1bd0 con 0x7f841415fb80 2024-08-18T22:20:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8411400640 1 -- 172.21.15.5:0/1188175779 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84140d30b0 con 0x7f841415fb80 2024-08-18T22:20:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8409400640 1 -- 172.21.15.5:0/1188175779 >> v1:172.21.15.117:6789/0 conn(0x7f841415fb80 legacy=0x7f841406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8409400640 1 -- 172.21.15.5:0/1188175779 >> v1:172.21.15.5:6789/0 conn(0x7f84140b5ad0 legacy=0x7f8414071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:02.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.646+0000 7f8409400640 1 -- 172.21.15.5:0/1188175779 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84140d2dd0 con 0x7f84140d1090 2024-08-18T22:20:02.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8409400640 1 --2- 172.21.15.5:0/1188175779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84140d1090 0x7f84140d15e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0097f0 tx=0x7f83fc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d31a69b589e283c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8411400640 1 -- 172.21.15.5:0/1188175779 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0b0070 con 0x7f84140d1090 2024-08-18T22:20:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8411400640 1 -- 172.21.15.5:0/1188175779 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83fc0a4e50 con 0x7f84140d1090 2024-08-18T22:20:02.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8411400640 1 -- 172.21.15.5:0/1188175779 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0ab820 con 0x7f84140d1090 2024-08-18T22:20:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 -- 172.21.15.5:0/1188175779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84140d1090 msgr2=0x7f84140d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 --2- 172.21.15.5:0/1188175779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84140d1090 0x7f84140d15e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0097f0 tx=0x7f83fc01c3c0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 -- 172.21.15.5:0/1188175779 shutdown_connections 2024-08-18T22:20:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 --2- 172.21.15.5:0/1188175779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84140d1090 0x7f84140d15e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 -- 172.21.15.5:0/1188175779 >> 172.21.15.5:0/1188175779 conn(0x7f84140d2180 msgr2=0x7f84140d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 -- 172.21.15.5:0/1188175779 shutdown_connections 2024-08-18T22:20:02.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 -- 172.21.15.5:0/1188175779 wait complete. 2024-08-18T22:20:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 Processor -- start 2024-08-18T22:20:02.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 -- start start 2024-08-18T22:20:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84140b5ad0 0x7f841414b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84140d1090 0x7f8414158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:02.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f841415fb80 0x7f84140b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f841416a310 con 0x7f84140b5ad0 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f84140d1eb0 con 0x7f841415fb80 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.650+0000 7f8418a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f841416a490 con 0x7f84140d1090 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8411e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84140b5ad0 0x7f841414b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8411e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84140b5ad0 0x7f841414b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40540/0 (socket says 172.21.15.5:40540) 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8411e00640 1 -- 172.21.15.5:0/1887940467 learned_addr learned my addr 172.21.15.5:0/1887940467 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8409400640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84140d1090 0x7f8414158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8412800640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f841415fb80 0x7f84140b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8411e00640 1 -- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84140d1090 msgr2=0x7f8414158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8411e00640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84140d1090 0x7f8414158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8411e00640 1 -- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f841415fb80 msgr2=0x7f84140b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8411e00640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f841415fb80 0x7f84140b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8411e00640 1 -- 172.21.15.5:0/1887940467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841415a730 con 0x7f84140b5ad0 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8411e00640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84140b5ad0 0x7f841414b900 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f840400c430 tx=0x7f840400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f840aa00640 1 -- 172.21.15.5:0/1887940467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404017070 con 0x7f84140b5ad0 2024-08-18T22:20:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f840aa00640 1 -- 172.21.15.5:0/1887940467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84040052f0 con 0x7f84140b5ad0 2024-08-18T22:20:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f840aa00640 1 -- 172.21.15.5:0/1887940467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404003840 con 0x7f84140b5ad0 2024-08-18T22:20:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8418a00640 1 -- 172.21.15.5:0/1887940467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841415ada0 con 0x7f84140b5ad0 2024-08-18T22:20:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8418a00640 1 -- 172.21.15.5:0/1887940467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841415b5e0 con 0x7f84140b5ad0 2024-08-18T22:20:02.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f8418a00640 1 -- 172.21.15.5:0/1887940467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84140d15e0 con 0x7f84140b5ad0 2024-08-18T22:20:02.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.654+0000 7f840aa00640 1 -- 172.21.15.5:0/1887940467 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f840401a070 con 0x7f84140b5ad0 2024-08-18T22:20:02.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.658+0000 7f840aa00640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83f00678c0 0x7f83f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.658+0000 7f840aa00640 1 -- 172.21.15.5:0/1887940467 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8404085370 con 0x7f84140b5ad0 2024-08-18T22:20:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.658+0000 7f8409400640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83f00678c0 0x7f83f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:02.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.658+0000 7f8409400640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83f00678c0 0x7f83f0069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0ad000 tx=0x7f83fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:02.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.662+0000 7f840aa00640 1 -- 172.21.15.5:0/1887940467 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f841415ada0 con 0x7f84140b5ad0 2024-08-18T22:20:02.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.830+0000 7f8418a00640 1 -- 172.21.15.5:0/1887940467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f84140ce0d0 con 0x7f84140b5ad0 2024-08-18T22:20:02.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.830+0000 7f840aa00640 1 -- 172.21.15.5:0/1887940467 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f84040554d0 con 0x7f84140b5ad0 2024-08-18T22:20:02.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 -- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83f00678c0 msgr2=0x7f83f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83f00678c0 0x7f83f0069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0ad000 tx=0x7f83fc008040 comp rx=0 tx=0).stop 2024-08-18T22:20:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 -- 172.21.15.5:0/1887940467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84140b5ad0 msgr2=0x7f841414b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84140b5ad0 0x7f841414b900 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f840400c430 tx=0x7f840400c8f0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 -- 172.21.15.5:0/1887940467 shutdown_connections 2024-08-18T22:20:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83f00678c0 0x7f83f0069d80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f841415fb80 0x7f84140b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84140d1090 0x7f8414158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 --2- 172.21.15.5:0/1887940467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84140b5ad0 0x7f841414b900 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 -- 172.21.15.5:0/1887940467 >> 172.21.15.5:0/1887940467 conn(0x7f84140d2180 msgr2=0x7f841414c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 -- 172.21.15.5:0/1887940467 shutdown_connections 2024-08-18T22:20:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:02.834+0000 7f8418a00640 1 -- 172.21.15.5:0/1887940467 wait complete. 2024-08-18T22:20:02.855 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:20:02.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:20:02.976 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:20:03.058 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:20:03.058 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:20:03.058 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:03.067 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:20:03.067 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:03.117 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:20:03.117 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:03.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:20:03.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa475200640 1 Processor -- start 2024-08-18T22:20:03.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa475200640 1 -- start start 2024-08-18T22:20:03.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa475200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa470156770 0x7fa47015d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa475200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa4700b4820 0x7fa4700d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa475200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4700b67e0 con 0x7fa4700b6020 2024-08-18T22:20:03.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa475200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa470156b50 con 0x7fa470156770 2024-08-18T22:20:03.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa475200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa4700b6ac0 con 0x7fa4700b4820 2024-08-18T22:20:03.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa46f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa470156770 0x7fa47015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa46f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa470156770 0x7fa47015d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40550/0 (socket says 172.21.15.5:40550) 2024-08-18T22:20:03.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa46f400640 1 -- 172.21.15.5:0/604014998 learned_addr learned my addr 172.21.15.5:0/604014998 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:03.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa46fe00640 1 --2- 172.21.15.5:0/604014998 >> v2:172.21.15.117:3300/0 conn(0x7fa4700b4820 0x7fa4700d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa46f400640 1 -- 172.21.15.5:0/604014998 >> v2:172.21.15.117:3300/0 conn(0x7fa4700b4820 msgr2=0x7fa4700d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:03.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa46f400640 1 --2- 172.21.15.5:0/604014998 >> v2:172.21.15.117:3300/0 conn(0x7fa4700b4820 0x7fa4700d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa46f400640 1 -- 172.21.15.5:0/604014998 >> v1:172.21.15.117:6789/0 conn(0x7fa4700b6020 legacy=0x7fa4700b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:03.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.354+0000 7fa46f400640 1 -- 172.21.15.5:0/604014998 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4700b6da0 con 0x7fa470156770 2024-08-18T22:20:03.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa46f400640 1 --2- 172.21.15.5:0/604014998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa470156770 0x7fa47015d120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa47015c5e0 tx=0x7fa46001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62c2dece448a7a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:03.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa46ea00640 1 -- 172.21.15.5:0/604014998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4600b1070 con 0x7fa470156770 2024-08-18T22:20:03.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa46ea00640 1 -- 172.21.15.5:0/604014998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4600ac640 con 0x7fa470156770 2024-08-18T22:20:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa46ea00640 1 -- 172.21.15.5:0/604014998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4600aca10 con 0x7fa470156770 2024-08-18T22:20:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa475200640 1 -- 172.21.15.5:0/604014998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa470156770 msgr2=0x7fa47015d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa475200640 1 --2- 172.21.15.5:0/604014998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa470156770 0x7fa47015d120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa47015c5e0 tx=0x7fa46001c490 comp rx=0 tx=0).stop 2024-08-18T22:20:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa475200640 1 -- 172.21.15.5:0/604014998 shutdown_connections 2024-08-18T22:20:03.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa475200640 1 --2- 172.21.15.5:0/604014998 >> v2:172.21.15.117:3300/0 conn(0x7fa4700b4820 0x7fa4700d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa475200640 1 --2- 172.21.15.5:0/604014998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa470156770 0x7fa47015d120 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa475200640 1 -- 172.21.15.5:0/604014998 >> 172.21.15.5:0/604014998 conn(0x7fa470067a70 msgr2=0x7fa470067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:03.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa475200640 1 -- 172.21.15.5:0/604014998 shutdown_connections 2024-08-18T22:20:03.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.358+0000 7fa475200640 1 -- 172.21.15.5:0/604014998 wait complete. 2024-08-18T22:20:03.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa475200640 1 Processor -- start 2024-08-18T22:20:03.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa475200640 1 -- start start 2024-08-18T22:20:03.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa475200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4700b4820 0x7fa47014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa475200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4700b6020 0x7fa470156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa475200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa470156770 0x7fa4701588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa475200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4700d1080 con 0x7fa4700b4820 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa475200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4700d0f00 con 0x7fa470156770 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa475200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa4700d1200 con 0x7fa4700b6020 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa46f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4700b4820 0x7fa47014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa46f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4700b4820 0x7fa47014ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40554/0 (socket says 172.21.15.5:40554) 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa46f400640 1 -- 172.21.15.5:0/754954668 learned_addr learned my addr 172.21.15.5:0/754954668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa466a00640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4700b6020 0x7fa470156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa46fe00640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa470156770 0x7fa4701588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa46f400640 1 -- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4700b6020 msgr2=0x7fa470156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa46f400640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4700b6020 0x7fa470156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa46f400640 1 -- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa470156770 msgr2=0x7fa4701588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa46f400640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa470156770 0x7fa4701588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa46f400640 1 -- 172.21.15.5:0/754954668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa470157480 con 0x7fa4700b4820 2024-08-18T22:20:03.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa46f400640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4700b4820 0x7fa47014ff60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4600af040 tx=0x7fa46001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:03.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa467e00640 1 -- 172.21.15.5:0/754954668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4600bb020 con 0x7fa4700b4820 2024-08-18T22:20:03.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa467e00640 1 -- 172.21.15.5:0/754954668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4600b7640 con 0x7fa4700b4820 2024-08-18T22:20:03.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa467e00640 1 -- 172.21.15.5:0/754954668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4600b1040 con 0x7fa4700b4820 2024-08-18T22:20:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa475200640 1 -- 172.21.15.5:0/754954668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa470159c60 con 0x7fa4700b4820 2024-08-18T22:20:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa475200640 1 -- 172.21.15.5:0/754954668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4701593c0 con 0x7fa4700b4820 2024-08-18T22:20:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.362+0000 7fa475200640 1 -- 172.21.15.5:0/754954668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4700d01b0 con 0x7fa4700b4820 2024-08-18T22:20:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.366+0000 7fa467e00640 1 -- 172.21.15.5:0/754954668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4600be020 con 0x7fa4700b4820 2024-08-18T22:20:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.366+0000 7fa467e00640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa44c0678c0 0x7fa44c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.366+0000 7fa467e00640 1 -- 172.21.15.5:0/754954668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa460120360 con 0x7fa4700b4820 2024-08-18T22:20:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.366+0000 7fa466a00640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa44c0678c0 0x7fa44c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.366+0000 7fa466a00640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa44c0678c0 0x7fa44c069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa470155080 tx=0x7fa458009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:03.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.370+0000 7fa467e00640 1 -- 172.21.15.5:0/754954668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa4600c5030 con 0x7fa4700b4820 2024-08-18T22:20:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 -- 172.21.15.5:0/754954668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa470158e10 con 0x7fa4700b4820 2024-08-18T22:20:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa467e00640 1 -- 172.21.15.5:0/754954668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fa460016110 con 0x7fa4700b4820 2024-08-18T22:20:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:20:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 -- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa44c0678c0 msgr2=0x7fa44c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa44c0678c0 0x7fa44c069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa470155080 tx=0x7fa458009040 comp rx=0 tx=0).stop 2024-08-18T22:20:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 -- 172.21.15.5:0/754954668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4700b4820 msgr2=0x7fa47014ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4700b4820 0x7fa47014ff60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4600af040 tx=0x7fa46001acd0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 -- 172.21.15.5:0/754954668 shutdown_connections 2024-08-18T22:20:03.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa44c0678c0 0x7fa44c069d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa470156770 0x7fa4701588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4700b6020 0x7fa470156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 --2- 172.21.15.5:0/754954668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4700b4820 0x7fa47014ff60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 -- 172.21.15.5:0/754954668 >> 172.21.15.5:0/754954668 conn(0x7fa470067a70 msgr2=0x7fa4700b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:03.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 -- 172.21.15.5:0/754954668 shutdown_connections 2024-08-18T22:20:03.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.558+0000 7fa475200640 1 -- 172.21.15.5:0/754954668 wait complete. 2024-08-18T22:20:03.581 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:20:03.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:03.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-18T22:20:03.617 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:20:03.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:03.618 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:20:03.670 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:20:03.670 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:03.679 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:20:03.679 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:03.735 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:20:03.736 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:03.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:20:03.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.926+0000 7fdec7c00640 1 Processor -- start 2024-08-18T22:20:03.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.926+0000 7fdec7c00640 1 -- start start 2024-08-18T22:20:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdec7c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdec00b40c0 0x7fdec00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdec7c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec00ce280 0x7fdec00ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdec7c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec00b31f0 con 0x7fdec015b0c0 2024-08-18T22:20:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdec7c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdec00b4a70 con 0x7fdec00b40c0 2024-08-18T22:20:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdec7c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdec00b3d70 con 0x7fdec00ce280 2024-08-18T22:20:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdebfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdec00b40c0 0x7fdec00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdebfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdec00b40c0 0x7fdec00b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45514/0 (socket says 172.21.15.5:45514) 2024-08-18T22:20:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdebfe00640 1 -- 172.21.15.5:0/1092258603 learned_addr learned my addr 172.21.15.5:0/1092258603 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdec5200640 1 --1- 172.21.15.5:0/1092258603 >> v1:172.21.15.5:6789/0 conn(0x7fdec015b0c0 0x7fdec006db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48912/0 (socket says 172.21.15.5:48912) 2024-08-18T22:20:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdec5c00640 1 --2- 172.21.15.5:0/1092258603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec00ce280 0x7fdec00ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdebfe00640 1 -- 172.21.15.5:0/1092258603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec00ce280 msgr2=0x7fdec00ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdebfe00640 1 --2- 172.21.15.5:0/1092258603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec00ce280 0x7fdec00ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdebfe00640 1 -- 172.21.15.5:0/1092258603 >> v1:172.21.15.5:6789/0 conn(0x7fdec015b0c0 legacy=0x7fdec006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.930+0000 7fdebfe00640 1 -- 172.21.15.5:0/1092258603 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec00b34d0 con 0x7fdec00b40c0 2024-08-18T22:20:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdebfe00640 1 --2- 172.21.15.5:0/1092258603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec00b40c0 0x7fdec00b4530 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009870 tx=0x7fdeac01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e369e88eeeab1b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdebf400640 1 -- 172.21.15.5:0/1092258603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac0b0070 con 0x7fdec00b40c0 2024-08-18T22:20:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdebf400640 1 -- 172.21.15.5:0/1092258603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeac0ab600 con 0x7fdec00b40c0 2024-08-18T22:20:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdebf400640 1 -- 172.21.15.5:0/1092258603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac0ab9d0 con 0x7fdec00b40c0 2024-08-18T22:20:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdec7c00640 1 -- 172.21.15.5:0/1092258603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec00b40c0 msgr2=0x7fdec00b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdec7c00640 1 --2- 172.21.15.5:0/1092258603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec00b40c0 0x7fdec00b4530 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009870 tx=0x7fdeac01c440 comp rx=0 tx=0).stop 2024-08-18T22:20:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdec7c00640 1 -- 172.21.15.5:0/1092258603 shutdown_connections 2024-08-18T22:20:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdec7c00640 1 --2- 172.21.15.5:0/1092258603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec00ce280 0x7fdec00ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdec7c00640 1 --2- 172.21.15.5:0/1092258603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec00b40c0 0x7fdec00b4530 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdec7c00640 1 -- 172.21.15.5:0/1092258603 >> 172.21.15.5:0/1092258603 conn(0x7fdec00b1dc0 msgr2=0x7fdec00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdec7c00640 1 -- 172.21.15.5:0/1092258603 shutdown_connections 2024-08-18T22:20:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdec7c00640 1 -- 172.21.15.5:0/1092258603 wait complete. 2024-08-18T22:20:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdec7c00640 1 Processor -- start 2024-08-18T22:20:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.934+0000 7fdec7c00640 1 -- start start 2024-08-18T22:20:03.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec7c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec00b40c0 0x7fdec0099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec7c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec00ce280 0x7fdec01573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec7c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec015b0c0 0x7fdec015d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec7c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdec006f7f0 con 0x7fdec00ce280 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec7c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdec006f670 con 0x7fdec015b0c0 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec7c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdec0167d10 con 0x7fdec00b40c0 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec00ce280 0x7fdec01573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec00ce280 0x7fdec01573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45526/0 (socket says 172.21.15.5:45526) 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebfe00640 1 -- 172.21.15.5:0/276813323 learned_addr learned my addr 172.21.15.5:0/276813323 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec5200640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec00b40c0 0x7fdec0099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec5c00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec015b0c0 0x7fdec015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebfe00640 1 -- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec00b40c0 msgr2=0x7fdec0099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebfe00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec00b40c0 0x7fdec0099980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebfe00640 1 -- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec015b0c0 msgr2=0x7fdec015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebfe00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec015b0c0 0x7fdec015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebfe00640 1 -- 172.21.15.5:0/276813323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec00b2af0 con 0x7fdec00ce280 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec5c00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec015b0c0 0x7fdec015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebfe00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec00ce280 0x7fdec01573c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0ae040 tx=0x7fdeac0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:03.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebcc00640 1 -- 172.21.15.5:0/276813323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac0b0040 con 0x7fdec00ce280 2024-08-18T22:20:03.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebcc00640 1 -- 172.21.15.5:0/276813323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeac0b4420 con 0x7fdec00ce280 2024-08-18T22:20:03.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebcc00640 1 -- 172.21.15.5:0/276813323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac0b4810 con 0x7fdec00ce280 2024-08-18T22:20:03.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec7c00640 1 -- 172.21.15.5:0/276813323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec0099ec0 con 0x7fdec00ce280 2024-08-18T22:20:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec7c00640 1 -- 172.21.15.5:0/276813323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec006eae0 con 0x7fdec00ce280 2024-08-18T22:20:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdec7c00640 1 -- 172.21.15.5:0/276813323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec00b4530 con 0x7fdec00ce280 2024-08-18T22:20:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.938+0000 7fdebcc00640 1 -- 172.21.15.5:0/276813323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdeac0b49b0 con 0x7fdec00ce280 2024-08-18T22:20:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.942+0000 7fdebcc00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea00678c0 0x7fdea0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.942+0000 7fdebcc00640 1 -- 172.21.15.5:0/276813323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fdeac11fca0 con 0x7fdec00ce280 2024-08-18T22:20:03.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.942+0000 7fdec5200640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea00678c0 0x7fdea0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:03.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.942+0000 7fdec5200640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea00678c0 0x7fdea0069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0000f70 tx=0x7fdeb0007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:03.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:03.946+0000 7fdebcc00640 1 -- 172.21.15.5:0/276813323 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdeac016150 con 0x7fdec00ce280 2024-08-18T22:20:04.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 -- 172.21.15.5:0/276813323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdec006cae0 con 0x7fdec00ce280 2024-08-18T22:20:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdebcc00640 1 -- 172.21.15.5:0/276813323 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fdeac0f03b0 con 0x7fdec00ce280 2024-08-18T22:20:04.127 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:20:04.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 -- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea00678c0 msgr2=0x7fdea0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:04.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea00678c0 0x7fdea0069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0000f70 tx=0x7fdeb0007cd0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 -- 172.21.15.5:0/276813323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec00ce280 msgr2=0x7fdec01573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:04.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec00ce280 0x7fdec01573c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0ae040 tx=0x7fdeac0191e0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 -- 172.21.15.5:0/276813323 shutdown_connections 2024-08-18T22:20:04.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea00678c0 0x7fdea0069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec015b0c0 0x7fdec015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec00ce280 0x7fdec01573c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 --2- 172.21.15.5:0/276813323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec00b40c0 0x7fdec0099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 -- 172.21.15.5:0/276813323 >> 172.21.15.5:0/276813323 conn(0x7fdec00b1dc0 msgr2=0x7fdec006db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 -- 172.21.15.5:0/276813323 shutdown_connections 2024-08-18T22:20:04.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.126+0000 7fdec7c00640 1 -- 172.21.15.5:0/276813323 wait complete. 2024-08-18T22:20:04.148 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-18T22:20:04.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:04.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-18T22:20:04.191 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:20:04.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:04.191 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-18T22:20:04.263 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:20:04.264 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:04.273 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:20:04.273 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:04.321 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:20:04.321 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:04.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:20:04.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.558+0000 7f5137800640 1 Processor -- start 2024-08-18T22:20:04.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.558+0000 7f5137800640 1 -- start start 2024-08-18T22:20:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.562+0000 7f5137800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f513015b0c0 0x7f513006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.562+0000 7f5137800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51300b31f0 con 0x7f51300b40c0 2024-08-18T22:20:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.562+0000 7f5137800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51300b34d0 con 0x7f51300cf290 2024-08-18T22:20:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.562+0000 7f5137800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f51300b3d70 con 0x7f513015b0c0 2024-08-18T22:20:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.562+0000 7f5134e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f513015b0c0 0x7f513006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.562+0000 7f5134e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f513015b0c0 0x7f513006db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45542/0 (socket says 172.21.15.5:45542) 2024-08-18T22:20:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.562+0000 7f5134e00640 1 -- 172.21.15.5:0/897568829 learned_addr learned my addr 172.21.15.5:0/897568829 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.562+0000 7f5134e00640 1 -- 172.21.15.5:0/897568829 >> v1:172.21.15.117:6789/0 conn(0x7f51300cf290 legacy=0x7f5130073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.562+0000 7f5134e00640 1 -- 172.21.15.5:0/897568829 >> v1:172.21.15.5:6789/0 conn(0x7f51300b40c0 legacy=0x7f5130072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.562+0000 7f5134e00640 1 -- 172.21.15.5:0/897568829 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51300b37b0 con 0x7f513015b0c0 2024-08-18T22:20:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.562+0000 7f512f400640 1 -- 172.21.15.5:0/897568829 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2660941499 0 0) 0x7f51300b31f0 con 0x7f51300b40c0 2024-08-18T22:20:04.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f5134e00640 1 --2- 172.21.15.5:0/897568829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513015b0c0 0x7f513006db80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5124009870 tx=0x7f512401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e822c6b065bd80c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:04.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f512f400640 1 -- 172.21.15.5:0/897568829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240ab430 con 0x7f513015b0c0 2024-08-18T22:20:04.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f512f400640 1 -- 172.21.15.5:0/897568829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240b0070 con 0x7f513015b0c0 2024-08-18T22:20:04.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f512f400640 1 -- 172.21.15.5:0/897568829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240ab7f0 con 0x7f513015b0c0 2024-08-18T22:20:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f5137800640 1 -- 172.21.15.5:0/897568829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513015b0c0 msgr2=0x7f513006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f5137800640 1 --2- 172.21.15.5:0/897568829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513015b0c0 0x7f513006db80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5124009870 tx=0x7f512401c410 comp rx=0 tx=0).stop 2024-08-18T22:20:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f5137800640 1 -- 172.21.15.5:0/897568829 shutdown_connections 2024-08-18T22:20:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f5137800640 1 --2- 172.21.15.5:0/897568829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513015b0c0 0x7f513006db80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f5137800640 1 -- 172.21.15.5:0/897568829 >> 172.21.15.5:0/897568829 conn(0x7f51300b1dc0 msgr2=0x7f51300b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f5137800640 1 -- 172.21.15.5:0/897568829 shutdown_connections 2024-08-18T22:20:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f5137800640 1 -- 172.21.15.5:0/897568829 wait complete. 2024-08-18T22:20:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f5137800640 1 Processor -- start 2024-08-18T22:20:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.566+0000 7f5137800640 1 -- start start 2024-08-18T22:20:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5137800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51300b40c0 0x7f513015b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5137800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51300cf290 0x7f513014d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5137800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513015b0c0 0x7f5130159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5137800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f513006e240 con 0x7f513015b0c0 2024-08-18T22:20:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5137800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f513006e0c0 con 0x7f51300b40c0 2024-08-18T22:20:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5137800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f513015b4a0 con 0x7f51300cf290 2024-08-18T22:20:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5135800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513015b0c0 0x7f5130159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5135800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513015b0c0 0x7f5130159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45552/0 (socket says 172.21.15.5:45552) 2024-08-18T22:20:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5135800640 1 -- 172.21.15.5:0/3688417067 learned_addr learned my addr 172.21.15.5:0/3688417067 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5134e00640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51300b40c0 0x7f513015b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f512fe00640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51300cf290 0x7f513014d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5135800640 1 -- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51300cf290 msgr2=0x7f513014d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5135800640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51300cf290 0x7f513014d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5135800640 1 -- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51300b40c0 msgr2=0x7f513015b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5135800640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51300b40c0 0x7f513015b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5135800640 1 -- 172.21.15.5:0/3688417067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513014ee00 con 0x7f513015b0c0 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f512fe00640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51300cf290 0x7f513014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5135800640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513015b0c0 0x7f5130159ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f512800c7a0 tx=0x7f512800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f512cc00640 1 -- 172.21.15.5:0/3688417067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128003b80 con 0x7f513015b0c0 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f512cc00640 1 -- 172.21.15.5:0/3688417067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5128003d20 con 0x7f513015b0c0 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f512cc00640 1 -- 172.21.15.5:0/3688417067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512800aa90 con 0x7f513015b0c0 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5137800640 1 -- 172.21.15.5:0/3688417067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513014cdf0 con 0x7f513015b0c0 2024-08-18T22:20:04.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5137800640 1 -- 172.21.15.5:0/3688417067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513014d3b0 con 0x7f513015b0c0 2024-08-18T22:20:04.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f5137800640 1 -- 172.21.15.5:0/3688417067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f513014d5b0 con 0x7f513015b0c0 2024-08-18T22:20:04.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.570+0000 7f512cc00640 1 -- 172.21.15.5:0/3688417067 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f512800ac30 con 0x7f513015b0c0 2024-08-18T22:20:04.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.574+0000 7f512cc00640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51100678c0 0x7f5110069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:04.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.574+0000 7f512cc00640 1 -- 172.21.15.5:0/3688417067 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f5128085ef0 con 0x7f513015b0c0 2024-08-18T22:20:04.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.574+0000 7f5134e00640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51100678c0 0x7f5110069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:04.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.574+0000 7f5134e00640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51100678c0 0x7f5110069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f51240af000 tx=0x7f51240a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:04.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.578+0000 7f512cc00640 1 -- 172.21.15.5:0/3688417067 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f513014d5b0 con 0x7f513015b0c0 2024-08-18T22:20:04.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.750+0000 7f5137800640 1 -- 172.21.15.5:0/3688417067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f513006f670 con 0x7f513015b0c0 2024-08-18T22:20:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f512cc00640 1 -- 172.21.15.5:0/3688417067 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f5128056600 con 0x7f513015b0c0 2024-08-18T22:20:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 -- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51100678c0 msgr2=0x7f5110069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51100678c0 0x7f5110069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f51240af000 tx=0x7f51240a7000 comp rx=0 tx=0).stop 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 -- 172.21.15.5:0/3688417067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513015b0c0 msgr2=0x7f5130159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513015b0c0 0x7f5130159ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f512800c7a0 tx=0x7f512800cc60 comp rx=0 tx=0).stop 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 -- 172.21.15.5:0/3688417067 shutdown_connections 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51100678c0 0x7f5110069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f513015b0c0 0x7f5130159ba0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51300cf290 0x7f513014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 --2- 172.21.15.5:0/3688417067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51300b40c0 0x7f513015b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 -- 172.21.15.5:0/3688417067 >> 172.21.15.5:0/3688417067 conn(0x7f51300b1dc0 msgr2=0x7f51300afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 -- 172.21.15.5:0/3688417067 shutdown_connections 2024-08-18T22:20:04.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:04.754+0000 7f5137800640 1 -- 172.21.15.5:0/3688417067 wait complete. 2024-08-18T22:20:04.775 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-18T22:20:04.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:04.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-18T22:20:04.798 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:20:04.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:04.798 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-18T22:20:04.854 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:20:04.854 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:04.867 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:20:04.867 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:04.915 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:20:04.915 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:04.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:20:05.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6148c00640 1 Processor -- start 2024-08-18T22:20:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6148c00640 1 -- start start 2024-08-18T22:20:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6148c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f614406e7e0 0x7f61440b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6148c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61440b0ec0 con 0x7f6144161c30 2024-08-18T22:20:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6148c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6144162010 con 0x7f61440d2ab0 2024-08-18T22:20:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6148c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f61440b17d0 con 0x7f614406e7e0 2024-08-18T22:20:05.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6144161c30 0x7f61440d23a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48926/0 (socket says 172.21.15.5:48926) 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141e00640 1 -- 172.21.15.5:0/135551291 learned_addr learned my addr 172.21.15.5:0/135551291 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6142800640 1 --2- 172.21.15.5:0/135551291 >> v2:172.21.15.117:3300/0 conn(0x7f614406e7e0 0x7f61440b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105813038 0 0) 0x7f61440b0ec0 con 0x7f6144161c30 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6128003530 con 0x7f6144161c30 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2659226619 0 0) 0x7f6144162010 con 0x7f61440d2ab0 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61440b0ec0 con 0x7f61440d2ab0 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4141537228 0 0) 0x7f6128003530 con 0x7f6144161c30 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 >> v2:172.21.15.117:3300/0 conn(0x7f614406e7e0 msgr2=0x7f61440b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 --2- 172.21.15.5:0/135551291 >> v2:172.21.15.117:3300/0 conn(0x7f614406e7e0 0x7f61440b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 >> v1:172.21.15.117:6789/0 conn(0x7f61440d2ab0 legacy=0x7f61440b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61440d5120 con 0x7f6144161c30 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f6134001600 con 0x7f6144161c30 2024-08-18T22:20:05.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 >> v1:172.21.15.5:6789/0 conn(0x7f6144161c30 legacy=0x7f61440d23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 0x7f6128003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6128004810 0x7f6128004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61280051d0 0x7f612800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f61440b17d0 con 0x7f6128003ba0 2024-08-18T22:20:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f612800c0a0 con 0x7f61280051d0 2024-08-18T22:20:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f612800c2a0 con 0x7f6128004810 2024-08-18T22:20:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141e00640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 0x7f6128003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6139400640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6128004810 0x7f6128004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6142800640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61280051d0 0x7f612800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141e00640 1 -- 172.21.15.5:0/135551291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6128004810 msgr2=0x7f6128004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:05.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141e00640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6128004810 0x7f6128004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141e00640 1 -- 172.21.15.5:0/135551291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61280051d0 msgr2=0x7f612800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:05.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141e00640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61280051d0 0x7f612800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6141e00640 1 -- 172.21.15.5:0/135551291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6128003530 con 0x7f6128003ba0 2024-08-18T22:20:05.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6142800640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61280051d0 0x7f612800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:05.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6139400640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6128004810 0x7f6128004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:05.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.114+0000 7f6142800640 1 -- 172.21.15.5:0/135551291 reap_dead start 2024-08-18T22:20:05.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.118+0000 7f6141e00640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 0x7f6128003fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6134007f90 tx=0x7f613401cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f139e99bdd4c24ab server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:05.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.118+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134007bb0 con 0x7f6128003ba0 2024-08-18T22:20:05.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.118+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61340a9070 con 0x7f6128003ba0 2024-08-18T22:20:05.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.118+0000 7f6141400640 1 -- 172.21.15.5:0/135551291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134005e40 con 0x7f6128003ba0 2024-08-18T22:20:05.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.118+0000 7f6148c00640 1 -- 172.21.15.5:0/135551291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 msgr2=0x7f6128003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.118+0000 7f6148c00640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 0x7f6128003fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6134007f90 tx=0x7f613401cb00 comp rx=0 tx=0).stop 2024-08-18T22:20:05.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.118+0000 7f6148c00640 1 -- 172.21.15.5:0/135551291 shutdown_connections 2024-08-18T22:20:05.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.118+0000 7f6148c00640 1 --2- 172.21.15.5:0/135551291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 0x7f6128003fa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.118+0000 7f6148c00640 1 -- 172.21.15.5:0/135551291 >> 172.21.15.5:0/135551291 conn(0x7f614408bfd0 msgr2=0x7f61440d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:05.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.118+0000 7f6148c00640 1 -- 172.21.15.5:0/135551291 shutdown_connections 2024-08-18T22:20:05.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.118+0000 7f6148c00640 1 -- 172.21.15.5:0/135551291 wait complete. 2024-08-18T22:20:05.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6148c00640 1 Processor -- start 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6148c00640 1 -- start start 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6148c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 0x7f61441fa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6148c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61440c7e60 0x7f61440c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6148c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61440c9da0 0x7f61440ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6148c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f61440d2930 con 0x7f6128003ba0 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6148c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f61440d27b0 con 0x7f61440c9da0 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6148c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f614406d2a0 con 0x7f61440c7e60 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6141e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 0x7f61441fa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6141e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 0x7f61441fa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45562/0 (socket says 172.21.15.5:45562) 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6141e00640 1 -- 172.21.15.5:0/235277909 learned_addr learned my addr 172.21.15.5:0/235277909 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6141e00640 1 -- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61440c7e60 msgr2=0x7f61440c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6142800640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61440c9da0 0x7f61440ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6139400640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61440c7e60 0x7f61440c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6141e00640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61440c7e60 0x7f61440c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6141e00640 1 -- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61440c9da0 msgr2=0x7f61440ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6141e00640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61440c9da0 0x7f61440ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6141e00640 1 -- 172.21.15.5:0/235277909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61440cab20 con 0x7f6128003ba0 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6142800640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61440c9da0 0x7f61440ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6139400640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61440c7e60 0x7f61440c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6141e00640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 0x7f61441fa570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6134007f90 tx=0x7f6128005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f613aa00640 1 -- 172.21.15.5:0/235277909 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134007bb0 con 0x7f6128003ba0 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f613aa00640 1 -- 172.21.15.5:0/235277909 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6134001400 con 0x7f6128003ba0 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f613aa00640 1 -- 172.21.15.5:0/235277909 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134005bc0 con 0x7f6128003ba0 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6148c00640 1 -- 172.21.15.5:0/235277909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61440cae00 con 0x7f6128003ba0 2024-08-18T22:20:05.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.122+0000 7f6148c00640 1 -- 172.21.15.5:0/235277909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61440ca740 con 0x7f6128003ba0 2024-08-18T22:20:05.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.126+0000 7f6148c00640 1 -- 172.21.15.5:0/235277909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614406d5d0 con 0x7f6128003ba0 2024-08-18T22:20:05.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.126+0000 7f613aa00640 1 -- 172.21.15.5:0/235277909 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f61340047f0 con 0x7f6128003ba0 2024-08-18T22:20:05.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.126+0000 7f613aa00640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61200678c0 0x7f6120069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.126+0000 7f613aa00640 1 -- 172.21.15.5:0/235277909 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f613411f760 con 0x7f6128003ba0 2024-08-18T22:20:05.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.126+0000 7f6139400640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61200678c0 0x7f6120069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.126+0000 7f6139400640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61200678c0 0x7f6120069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f612c007fd0 tx=0x7f612c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.130+0000 7f613aa00640 1 -- 172.21.15.5:0/235277909 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f61340be030 con 0x7f6128003ba0 2024-08-18T22:20:05.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.310+0000 7f6148c00640 1 -- 172.21.15.5:0/235277909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f61440cafd0 con 0x7f6128003ba0 2024-08-18T22:20:05.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.310+0000 7f613aa00640 1 -- 172.21.15.5:0/235277909 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f6134016810 con 0x7f6128003ba0 2024-08-18T22:20:05.312 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:20:05.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 -- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61200678c0 msgr2=0x7f6120069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61200678c0 0x7f6120069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f612c007fd0 tx=0x7f612c009040 comp rx=0 tx=0).stop 2024-08-18T22:20:05.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 -- 172.21.15.5:0/235277909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 msgr2=0x7f61441fa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 0x7f61441fa570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6134007f90 tx=0x7f6128005840 comp rx=0 tx=0).stop 2024-08-18T22:20:05.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 -- 172.21.15.5:0/235277909 shutdown_connections 2024-08-18T22:20:05.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61200678c0 0x7f6120069d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61440c9da0 0x7f61440ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61440c7e60 0x7f61440c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 --2- 172.21.15.5:0/235277909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6128003ba0 0x7f61441fa570 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 -- 172.21.15.5:0/235277909 >> 172.21.15.5:0/235277909 conn(0x7f614408bfd0 msgr2=0x7f61440d2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:05.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 -- 172.21.15.5:0/235277909 shutdown_connections 2024-08-18T22:20:05.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.314+0000 7f6148c00640 1 -- 172.21.15.5:0/235277909 wait complete. 2024-08-18T22:20:05.332 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-18T22:20:05.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:05.332 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-18T22:20:05.359 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:20:05.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:05.359 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-18T22:20:05.412 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:20:05.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:20:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.550+0000 7f53ea000640 1 Processor -- start 2024-08-18T22:20:05.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.550+0000 7f53ea000640 1 -- start start 2024-08-18T22:20:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53ea000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53e4161960 0x7f53e406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53ea000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f53e4070730 0x7f53e4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53ea000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53e415eb60 con 0x7f53e415dda0 2024-08-18T22:20:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53ea000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f53e40710e0 con 0x7f53e4161960 2024-08-18T22:20:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53ea000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f53e415e940 con 0x7f53e4070730 2024-08-18T22:20:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53e3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53e4161960 0x7f53e406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53e3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53e4161960 0x7f53e406fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45572/0 (socket says 172.21.15.5:45572) 2024-08-18T22:20:05.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53e3400640 1 -- 172.21.15.5:0/3734776509 learned_addr learned my addr 172.21.15.5:0/3734776509 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53e3400640 1 -- 172.21.15.5:0/3734776509 >> v2:172.21.15.117:3300/0 conn(0x7f53e4070730 msgr2=0x7f53e4070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53e3400640 1 --2- 172.21.15.5:0/3734776509 >> v2:172.21.15.117:3300/0 conn(0x7f53e4070730 0x7f53e4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53e3400640 1 -- 172.21.15.5:0/3734776509 >> v1:172.21.15.117:6789/0 conn(0x7f53e415dda0 legacy=0x7f53e415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:05.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53e3400640 1 -- 172.21.15.5:0/3734776509 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e415ee40 con 0x7f53e4161960 2024-08-18T22:20:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.554+0000 7f53e3400640 1 --2- 172.21.15.5:0/3734776509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e4161960 0x7f53e406fd20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f53e4071d80 tx=0x7f53d401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe5e6651d5c5547 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53e2a00640 1 -- 172.21.15.5:0/3734776509 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d40b0070 con 0x7f53e4161960 2024-08-18T22:20:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53e2a00640 1 -- 172.21.15.5:0/3734776509 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d40ab600 con 0x7f53e4161960 2024-08-18T22:20:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53e2a00640 1 -- 172.21.15.5:0/3734776509 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d40ab9d0 con 0x7f53e4161960 2024-08-18T22:20:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 -- 172.21.15.5:0/3734776509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e4161960 msgr2=0x7f53e406fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 --2- 172.21.15.5:0/3734776509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e4161960 0x7f53e406fd20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f53e4071d80 tx=0x7f53d401c4e0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 -- 172.21.15.5:0/3734776509 shutdown_connections 2024-08-18T22:20:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 --2- 172.21.15.5:0/3734776509 >> v2:172.21.15.117:3300/0 conn(0x7f53e4070730 0x7f53e4070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 --2- 172.21.15.5:0/3734776509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e4161960 0x7f53e406fd20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 -- 172.21.15.5:0/3734776509 >> 172.21.15.5:0/3734776509 conn(0x7f53e40d2130 msgr2=0x7f53e40d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 -- 172.21.15.5:0/3734776509 shutdown_connections 2024-08-18T22:20:05.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 -- 172.21.15.5:0/3734776509 wait complete. 2024-08-18T22:20:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 Processor -- start 2024-08-18T22:20:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 -- start start 2024-08-18T22:20:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e4070730 0x7f53e414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53e415dda0 0x7f53e415b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53e4161960 0x7f53e40c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f53e409ba30 con 0x7f53e4070730 2024-08-18T22:20:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4070260 con 0x7f53e4161960 2024-08-18T22:20:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53ea000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f53e415cbf0 con 0x7f53e415dda0 2024-08-18T22:20:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53e3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e4070730 0x7f53e414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53e3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e4070730 0x7f53e414d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45580/0 (socket says 172.21.15.5:45580) 2024-08-18T22:20:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.558+0000 7f53e3400640 1 -- 172.21.15.5:0/258018354 learned_addr learned my addr 172.21.15.5:0/258018354 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53e3400640 1 -- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53e415dda0 msgr2=0x7f53e415b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53e3400640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53e415dda0 0x7f53e415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53e3400640 1 -- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53e4161960 msgr2=0x7f53e40c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53e3e00640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53e4161960 0x7f53e40c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53e3400640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53e4161960 0x7f53e40c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53e3400640 1 -- 172.21.15.5:0/258018354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e415bd40 con 0x7f53e4070730 2024-08-18T22:20:05.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53e3e00640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53e4161960 0x7f53e40c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:05.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53e3400640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e4070730 0x7f53e414d670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f53d40ae040 tx=0x7f53d401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:05.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53dbe00640 1 -- 172.21.15.5:0/258018354 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d40b0040 con 0x7f53e4070730 2024-08-18T22:20:05.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53dbe00640 1 -- 172.21.15.5:0/258018354 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d40bc070 con 0x7f53e4070730 2024-08-18T22:20:05.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53dbe00640 1 -- 172.21.15.5:0/258018354 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d40b6880 con 0x7f53e4070730 2024-08-18T22:20:05.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53ea000640 1 -- 172.21.15.5:0/258018354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e415bfe0 con 0x7f53e4070730 2024-08-18T22:20:05.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53ea000640 1 -- 172.21.15.5:0/258018354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e415c5a0 con 0x7f53e4070730 2024-08-18T22:20:05.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53ea000640 1 -- 172.21.15.5:0/258018354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e4070ba0 con 0x7f53e4070730 2024-08-18T22:20:05.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53dbe00640 1 -- 172.21.15.5:0/258018354 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53d40b6a20 con 0x7f53e4070730 2024-08-18T22:20:05.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53dbe00640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53c00678c0 0x7f53c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.562+0000 7f53dbe00640 1 -- 172.21.15.5:0/258018354 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f53d4120560 con 0x7f53e4070730 2024-08-18T22:20:05.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.566+0000 7f53daa00640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53c00678c0 0x7f53c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.566+0000 7f53daa00640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53c00678c0 0x7f53c0069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f53e41faca0 tx=0x7f53cc006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:05.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.566+0000 7f53dbe00640 1 -- 172.21.15.5:0/258018354 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f53d40160d0 con 0x7f53e4070730 2024-08-18T22:20:05.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.766+0000 7f53ea000640 1 -- 172.21.15.5:0/258018354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53e409bbb0 con 0x7f53e4070730 2024-08-18T22:20:05.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.766+0000 7f53dbe00640 1 -- 172.21.15.5:0/258018354 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7f53d40f0be0 con 0x7f53e4070730 2024-08-18T22:20:05.768 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:05.768 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"btime":"2024-08-18T22:19:41:376873+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4007066150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4007066150},{"type":"v1","addr":"172.21.15.117:6836","nonce":4007066150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1179279001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1179279001},{"type":"v1","addr":"172.21.15.117:6837","nonce":1179279001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:19:20.503823+0000","modified":"2024-08-18T22:19:40.761749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3727670717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3727670717},{"type":"v1","addr":"172.21.15.5:6835","nonce":3727670717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-08-18T22:20:05.768 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-08-18T22:20:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 -- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53c00678c0 msgr2=0x7f53c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53c00678c0 0x7f53c0069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f53e41faca0 tx=0x7f53cc006c00 comp rx=0 tx=0).stop 2024-08-18T22:20:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 -- 172.21.15.5:0/258018354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e4070730 msgr2=0x7f53e414d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e4070730 0x7f53e414d670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f53d40ae040 tx=0x7f53d401ad20 comp rx=0 tx=0).stop 2024-08-18T22:20:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 -- 172.21.15.5:0/258018354 shutdown_connections 2024-08-18T22:20:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53c00678c0 0x7f53c0069d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53e4161960 0x7f53e40c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f53e415dda0 0x7f53e415b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 --2- 172.21.15.5:0/258018354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e4070730 0x7f53e414d670 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 -- 172.21.15.5:0/258018354 >> 172.21.15.5:0/258018354 conn(0x7f53e40d2130 msgr2=0x7f53e4169670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:05.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 -- 172.21.15.5:0/258018354 shutdown_connections 2024-08-18T22:20:05.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.770+0000 7f53ea000640 1 -- 172.21.15.5:0/258018354 wait complete. 2024-08-18T22:20:05.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:20:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.926+0000 7fa267200640 1 Processor -- start 2024-08-18T22:20:05.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa267200640 1 -- start start 2024-08-18T22:20:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa267200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa260162450 0x7fa2600ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa267200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa260162830 0x7fa2600cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa267200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa26006f990 con 0x7fa2600cef10 2024-08-18T22:20:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa267200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa2600cdfb0 con 0x7fa260162830 2024-08-18T22:20:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa267200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa2600cdc80 con 0x7fa260162450 2024-08-18T22:20:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa265200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa2600cef10 0x7fa2600cc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48934/0 (socket says 172.21.15.5:48934) 2024-08-18T22:20:05.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa265200640 1 -- 172.21.15.5:0/3908603398 learned_addr learned my addr 172.21.15.5:0/3908603398 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa25fe00640 1 --2- 172.21.15.5:0/3908603398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa260162450 0x7fa2600ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa25f400640 1 --2- 172.21.15.5:0/3908603398 >> v2:172.21.15.117:3300/0 conn(0x7fa260162830 0x7fa2600cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa25ea00640 1 -- 172.21.15.5:0/3908603398 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371549334 0 0) 0x7fa2580014a0 con 0x7fa2600cef10 2024-08-18T22:20:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa25ea00640 1 -- 172.21.15.5:0/3908603398 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa244003530 con 0x7fa2600cef10 2024-08-18T22:20:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa25fe00640 1 -- 172.21.15.5:0/3908603398 >> v2:172.21.15.117:3300/0 conn(0x7fa260162830 msgr2=0x7fa2600cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa25fe00640 1 --2- 172.21.15.5:0/3908603398 >> v2:172.21.15.117:3300/0 conn(0x7fa260162830 0x7fa2600cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa25fe00640 1 -- 172.21.15.5:0/3908603398 >> v1:172.21.15.5:6789/0 conn(0x7fa2600cef10 legacy=0x7fa2600cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa25fe00640 1 -- 172.21.15.5:0/3908603398 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2600ca6e0 con 0x7fa260162450 2024-08-18T22:20:05.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.930+0000 7fa25f400640 1 --2- 172.21.15.5:0/3908603398 >> v2:172.21.15.117:3300/0 conn(0x7fa260162830 0x7fa2600cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:20:05.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa25fe00640 1 --2- 172.21.15.5:0/3908603398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa260162450 0x7fa2600ce440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa2500097c0 tx=0x7fa25001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9395faf268c70487 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:05.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa25ea00640 1 -- 172.21.15.5:0/3908603398 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2500b0070 con 0x7fa260162450 2024-08-18T22:20:05.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa25ea00640 1 -- 172.21.15.5:0/3908603398 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2500ab600 con 0x7fa260162450 2024-08-18T22:20:05.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa25ea00640 1 -- 172.21.15.5:0/3908603398 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2500ab9d0 con 0x7fa260162450 2024-08-18T22:20:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa267200640 1 -- 172.21.15.5:0/3908603398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa260162450 msgr2=0x7fa2600ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa267200640 1 --2- 172.21.15.5:0/3908603398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa260162450 0x7fa2600ce440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa2500097c0 tx=0x7fa25001c410 comp rx=0 tx=0).stop 2024-08-18T22:20:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa267200640 1 -- 172.21.15.5:0/3908603398 shutdown_connections 2024-08-18T22:20:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa267200640 1 --2- 172.21.15.5:0/3908603398 >> v2:172.21.15.117:3300/0 conn(0x7fa260162830 0x7fa2600cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa267200640 1 --2- 172.21.15.5:0/3908603398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa260162450 0x7fa2600ce440 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa267200640 1 -- 172.21.15.5:0/3908603398 >> 172.21.15.5:0/3908603398 conn(0x7fa2600b1c50 msgr2=0x7fa2600b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa267200640 1 -- 172.21.15.5:0/3908603398 shutdown_connections 2024-08-18T22:20:05.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa267200640 1 -- 172.21.15.5:0/3908603398 wait complete. 2024-08-18T22:20:05.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.934+0000 7fa267200640 1 Processor -- start 2024-08-18T22:20:05.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa267200640 1 -- start start 2024-08-18T22:20:05.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa267200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2600cef10 0x7fa2600afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa267200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa260162450 0x7fa2600b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa267200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa260162830 0x7fa260159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa267200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa260166b40 con 0x7fa260162450 2024-08-18T22:20:05.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa267200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601669c0 con 0x7fa260162830 2024-08-18T22:20:05.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa267200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa260166cc0 con 0x7fa2600cef10 2024-08-18T22:20:05.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa25f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa260162450 0x7fa2600b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa25f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa260162450 0x7fa2600b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45590/0 (socket says 172.21.15.5:45590) 2024-08-18T22:20:05.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa25f400640 1 -- 172.21.15.5:0/644067242 learned_addr learned my addr 172.21.15.5:0/644067242 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa25fe00640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2600cef10 0x7fa2600afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa265200640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa260162830 0x7fa260159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa25f400640 1 -- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2600cef10 msgr2=0x7fa2600afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa25f400640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2600cef10 0x7fa2600afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa25f400640 1 -- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa260162830 msgr2=0x7fa260159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa25f400640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa260162830 0x7fa260159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa25f400640 1 -- 172.21.15.5:0/644067242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2600b39a0 con 0x7fa260162450 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa25f400640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa260162450 0x7fa2600b2f50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00e930 tx=0x7fa24c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa257e00640 1 -- 172.21.15.5:0/644067242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c017070 con 0x7fa260162450 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa257e00640 1 -- 172.21.15.5:0/644067242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24c00ca00 con 0x7fa260162450 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa267200640 1 -- 172.21.15.5:0/644067242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2600b3c80 con 0x7fa260162450 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa257e00640 1 -- 172.21.15.5:0/644067242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00cdd0 con 0x7fa260162450 2024-08-18T22:20:05.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa267200640 1 -- 172.21.15.5:0/644067242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2600b4240 con 0x7fa260162450 2024-08-18T22:20:05.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.938+0000 7fa267200640 1 -- 172.21.15.5:0/644067242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2600b46a0 con 0x7fa260162450 2024-08-18T22:20:05.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.942+0000 7fa257e00640 1 -- 172.21.15.5:0/644067242 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa24c01a070 con 0x7fa260162450 2024-08-18T22:20:05.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.942+0000 7fa257e00640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2400678c0 0x7fa240069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:05.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.942+0000 7fa257e00640 1 -- 172.21.15.5:0/644067242 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fa24c0862d0 con 0x7fa260162450 2024-08-18T22:20:05.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.942+0000 7fa25fe00640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2400678c0 0x7fa240069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:05.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.942+0000 7fa25fe00640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2400678c0 0x7fa240069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa2500ad000 tx=0x7fa2500a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:05.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:05.946+0000 7fa257e00640 1 -- 172.21.15.5:0/644067242 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa24c056390 con 0x7fa260162450 2024-08-18T22:20:06.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.142+0000 7fa267200640 1 -- 172.21.15.5:0/644067242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2600b4b60 con 0x7fa260162450 2024-08-18T22:20:06.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa257e00640 1 -- 172.21.15.5:0/644067242 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7fa24c05a690 con 0x7fa260162450 2024-08-18T22:20:06.146 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:06.146 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"btime":"2024-08-18T22:19:41:376873+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4007066150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4007066150},{"type":"v1","addr":"172.21.15.117:6836","nonce":4007066150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1179279001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1179279001},{"type":"v1","addr":"172.21.15.117:6837","nonce":1179279001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:19:20.503823+0000","modified":"2024-08-18T22:19:40.761749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3727670717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3727670717},{"type":"v1","addr":"172.21.15.5:6835","nonce":3727670717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-08-18T22:20:06.146 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-08-18T22:20:06.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 -- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2400678c0 msgr2=0x7fa240069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2400678c0 0x7fa240069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa2500ad000 tx=0x7fa2500a6000 comp rx=0 tx=0).stop 2024-08-18T22:20:06.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 -- 172.21.15.5:0/644067242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa260162450 msgr2=0x7fa2600b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa260162450 0x7fa2600b2f50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00e930 tx=0x7fa24c00edf0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 -- 172.21.15.5:0/644067242 shutdown_connections 2024-08-18T22:20:06.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2400678c0 0x7fa240069d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa260162830 0x7fa260159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa260162450 0x7fa2600b2f50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 --2- 172.21.15.5:0/644067242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2600cef10 0x7fa2600afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 -- 172.21.15.5:0/644067242 >> 172.21.15.5:0/644067242 conn(0x7fa2600b1c50 msgr2=0x7fa260071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:06.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 -- 172.21.15.5:0/644067242 shutdown_connections 2024-08-18T22:20:06.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.146+0000 7fa267200640 1 -- 172.21.15.5:0/644067242 wait complete. 2024-08-18T22:20:06.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:20:06.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d08600640 1 Processor -- start 2024-08-18T22:20:06.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d08600640 1 -- start start 2024-08-18T22:20:06.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d08600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 0x7f6d00070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:06.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d08600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d00070430 con 0x7f6d0015dda0 2024-08-18T22:20:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d08600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d0015eb60 con 0x7f6d00161960 2024-08-18T22:20:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d08600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0015fcc0 con 0x7f6d00070730 2024-08-18T22:20:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d06600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6d0015dda0 0x7f6d0015e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48944/0 (socket says 172.21.15.5:48944) 2024-08-18T22:20:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d06600640 1 -- 172.21.15.5:0/3376930030 learned_addr learned my addr 172.21.15.5:0/3376930030 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d05200640 1 --2- 172.21.15.5:0/3376930030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 0x7f6d00070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6cffe00640 1 -- 172.21.15.5:0/3376930030 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2336723944 0 0) 0x7f6d00070430 con 0x7f6d0015dda0 2024-08-18T22:20:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6cffe00640 1 -- 172.21.15.5:0/3376930030 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ce8003530 con 0x7f6d0015dda0 2024-08-18T22:20:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6cffe00640 1 -- 172.21.15.5:0/3376930030 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668656044 0 0) 0x7f6d0015eb60 con 0x7f6d00161960 2024-08-18T22:20:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6cffe00640 1 -- 172.21.15.5:0/3376930030 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d00070430 con 0x7f6d00161960 2024-08-18T22:20:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d05200640 1 -- 172.21.15.5:0/3376930030 >> v1:172.21.15.117:6789/0 conn(0x7f6d00161960 legacy=0x7f6d0006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d05200640 1 -- 172.21.15.5:0/3376930030 >> v1:172.21.15.5:6789/0 conn(0x7f6d0015dda0 legacy=0x7f6d0015e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6cffe00640 1 -- 172.21.15.5:0/3376930030 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1335286455 0 0) 0x7f6ce8003530 con 0x7f6d0015dda0 2024-08-18T22:20:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.306+0000 7f6d05200640 1 -- 172.21.15.5:0/3376930030 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0015ee40 con 0x7f6d00070730 2024-08-18T22:20:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.310+0000 7f6d05200640 1 --2- 172.21.15.5:0/3376930030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 0x7f6d00070b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097f0 tx=0x7f6cec01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2bc27371277d323 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.310+0000 7f6cffe00640 1 -- 172.21.15.5:0/3376930030 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0b0070 con 0x7f6d00070730 2024-08-18T22:20:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.310+0000 7f6cffe00640 1 -- 172.21.15.5:0/3376930030 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec0ab400 con 0x7f6d00070730 2024-08-18T22:20:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.310+0000 7f6cffe00640 1 -- 172.21.15.5:0/3376930030 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8001a00 con 0x7f6d00070730 2024-08-18T22:20:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.310+0000 7f6d08600640 1 -- 172.21.15.5:0/3376930030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 msgr2=0x7f6d00070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.310+0000 7f6d08600640 1 --2- 172.21.15.5:0/3376930030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 0x7f6d00070b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097f0 tx=0x7f6cec01c400 comp rx=0 tx=0).stop 2024-08-18T22:20:06.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.310+0000 7f6d08600640 1 -- 172.21.15.5:0/3376930030 shutdown_connections 2024-08-18T22:20:06.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.310+0000 7f6d08600640 1 --2- 172.21.15.5:0/3376930030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 0x7f6d00070b70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.310+0000 7f6d08600640 1 -- 172.21.15.5:0/3376930030 >> 172.21.15.5:0/3376930030 conn(0x7f6d000d2130 msgr2=0x7f6d000d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:06.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.310+0000 7f6d08600640 1 -- 172.21.15.5:0/3376930030 shutdown_connections 2024-08-18T22:20:06.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.310+0000 7f6d08600640 1 -- 172.21.15.5:0/3376930030 wait complete. 2024-08-18T22:20:06.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d08600640 1 Processor -- start 2024-08-18T22:20:06.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d08600640 1 -- start start 2024-08-18T22:20:06.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d08600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 0x7f6d001600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:06.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d08600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0015dda0 0x7f6d0015ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:06.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d08600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d00161960 0x7f6d001467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:06.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d08600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0009ba30 con 0x7f6d0015dda0 2024-08-18T22:20:06.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d08600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d000710b0 con 0x7f6d00161960 2024-08-18T22:20:06.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d08600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6d000ce640 con 0x7f6d00070730 2024-08-18T22:20:06.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d05200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0015dda0 0x7f6d0015ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:06.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d05200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0015dda0 0x7f6d0015ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45602/0 (socket says 172.21.15.5:45602) 2024-08-18T22:20:06.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d05200640 1 -- 172.21.15.5:0/651526460 learned_addr learned my addr 172.21.15.5:0/651526460 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d05c00640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 0x7f6d001600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d06600640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d00161960 0x7f6d001467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d05200640 1 -- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 msgr2=0x7f6d001600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d05200640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 0x7f6d001600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d05200640 1 -- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d00161960 msgr2=0x7f6d001467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d05200640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d00161960 0x7f6d001467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d05200640 1 -- 172.21.15.5:0/651526460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d000ce8e0 con 0x7f6d0015dda0 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d05c00640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 0x7f6d001600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d06600640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d00161960 0x7f6d001467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d05200640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0015dda0 0x7f6d0015ce60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097f0 tx=0x7f6cec01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6cfd600640 1 -- 172.21.15.5:0/651526460 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0bb020 con 0x7f6d0015dda0 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6cfd600640 1 -- 172.21.15.5:0/651526460 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec0b1040 con 0x7f6d0015dda0 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d08600640 1 -- 172.21.15.5:0/651526460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d000cebc0 con 0x7f6d0015dda0 2024-08-18T22:20:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6cfd600640 1 -- 172.21.15.5:0/651526460 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0b0050 con 0x7f6d0015dda0 2024-08-18T22:20:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.314+0000 7f6d08600640 1 -- 172.21.15.5:0/651526460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d000cf180 con 0x7f6d0015dda0 2024-08-18T22:20:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.318+0000 7f6d08600640 1 -- 172.21.15.5:0/651526460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d00070b70 con 0x7f6d0015dda0 2024-08-18T22:20:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.318+0000 7f6cfd600640 1 -- 172.21.15.5:0/651526460 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6cec0be070 con 0x7f6d0015dda0 2024-08-18T22:20:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.318+0000 7f6cfd600640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ce00678c0 0x7f6ce0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.318+0000 7f6cfd600640 1 -- 172.21.15.5:0/651526460 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f6cec11f670 con 0x7f6d0015dda0 2024-08-18T22:20:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.318+0000 7f6d05c00640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ce00678c0 0x7f6ce0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.318+0000 7f6d05c00640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ce00678c0 0x7f6ce0069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40016e0 tx=0x7f6cf4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.322+0000 7f6cfd600640 1 -- 172.21.15.5:0/651526460 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6cec015ff0 con 0x7f6d0015dda0 2024-08-18T22:20:06.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.490+0000 7f6d08600640 1 -- 172.21.15.5:0/651526460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d000d3010 con 0x7f6d0015dda0 2024-08-18T22:20:06.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.490+0000 7f6cfd600640 1 -- 172.21.15.5:0/651526460 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18876 (secure 0 0 0) 0x7f6cec0efd80 con 0x7f6d0015dda0 2024-08-18T22:20:06.491 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:06.492 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:20:03.464794+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:20:06.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 -- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ce00678c0 msgr2=0x7f6ce0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ce00678c0 0x7f6ce0069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40016e0 tx=0x7f6cf4009040 comp rx=0 tx=0).stop 2024-08-18T22:20:06.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 -- 172.21.15.5:0/651526460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0015dda0 msgr2=0x7f6d0015ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0015dda0 0x7f6d0015ce60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097f0 tx=0x7f6cec01ac40 comp rx=0 tx=0).stop 2024-08-18T22:20:06.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 -- 172.21.15.5:0/651526460 shutdown_connections 2024-08-18T22:20:06.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ce00678c0 0x7f6ce0069d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d00161960 0x7f6d001467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0015dda0 0x7f6d0015ce60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 --2- 172.21.15.5:0/651526460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d00070730 0x7f6d001600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 -- 172.21.15.5:0/651526460 >> 172.21.15.5:0/651526460 conn(0x7f6d000d2130 msgr2=0x7f6d00169a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:06.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 -- 172.21.15.5:0/651526460 shutdown_connections 2024-08-18T22:20:06.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.494+0000 7f6d08600640 1 -- 172.21.15.5:0/651526460 wait complete. 2024-08-18T22:20:06.514 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:20:06.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:20:06.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb9000640 1 Processor -- start 2024-08-18T22:20:06.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb9000640 1 -- start start 2024-08-18T22:20:06.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb9000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7effb415ff60 0x7effb40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:06.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effb4160340 0x7effb409b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:06.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb9000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb40cff50 con 0x7effb409b8b0 2024-08-18T22:20:06.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb9000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7effb40cfd00 con 0x7effb415ff60 2024-08-18T22:20:06.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb9000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effb40d0230 con 0x7effb4160340 2024-08-18T22:20:06.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb1e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7effb415ff60 0x7effb40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:06.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effa9400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effb4160340 0x7effb409b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:06.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb1e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7effb415ff60 0x7effb40ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:57016/0 (socket says 172.21.15.5:57016) 2024-08-18T22:20:06.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb1e00640 1 -- 172.21.15.5:0/1630753766 learned_addr learned my addr 172.21.15.5:0/1630753766 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:06.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb2800640 1 --1- 172.21.15.5:0/1630753766 >> v1:172.21.15.117:6789/0 conn(0x7effb409b8b0 0x7effb40ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:34964/0 (socket says 172.21.15.5:34964) 2024-08-18T22:20:06.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb1e00640 1 -- 172.21.15.5:0/1630753766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effb4160340 msgr2=0x7effb409b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:06.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb1e00640 1 --2- 172.21.15.5:0/1630753766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effb4160340 0x7effb409b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb1e00640 1 -- 172.21.15.5:0/1630753766 >> v1:172.21.15.117:6789/0 conn(0x7effb409b8b0 legacy=0x7effb40ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.654+0000 7effb1e00640 1 -- 172.21.15.5:0/1630753766 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb409ab70 con 0x7effb415ff60 2024-08-18T22:20:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb1e00640 1 --2- 172.21.15.5:0/1630753766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effb415ff60 0x7effb40ce610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7effa4009870 tx=0x7effa401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bd428721c07ad64 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb1400640 1 -- 172.21.15.5:0/1630753766 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa40b0070 con 0x7effb415ff60 2024-08-18T22:20:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb1400640 1 -- 172.21.15.5:0/1630753766 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa4004230 con 0x7effb415ff60 2024-08-18T22:20:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb1400640 1 -- 172.21.15.5:0/1630753766 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4003620 con 0x7effb415ff60 2024-08-18T22:20:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb9000640 1 -- 172.21.15.5:0/1630753766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effb415ff60 msgr2=0x7effb40ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb9000640 1 --2- 172.21.15.5:0/1630753766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effb415ff60 0x7effb40ce610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7effa4009870 tx=0x7effa401c440 comp rx=0 tx=0).stop 2024-08-18T22:20:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb9000640 1 -- 172.21.15.5:0/1630753766 shutdown_connections 2024-08-18T22:20:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb9000640 1 --2- 172.21.15.5:0/1630753766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effb4160340 0x7effb409b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb9000640 1 --2- 172.21.15.5:0/1630753766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effb415ff60 0x7effb40ce610 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb9000640 1 -- 172.21.15.5:0/1630753766 >> 172.21.15.5:0/1630753766 conn(0x7effb40d2130 msgr2=0x7effb40d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb9000640 1 -- 172.21.15.5:0/1630753766 shutdown_connections 2024-08-18T22:20:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.658+0000 7effb9000640 1 -- 172.21.15.5:0/1630753766 wait complete. 2024-08-18T22:20:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb9000640 1 Processor -- start 2024-08-18T22:20:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb9000640 1 -- start start 2024-08-18T22:20:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb409b8b0 0x7effb4157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb9000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effb415ff60 0x7effb415ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effb4160340 0x7effb40c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb9000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7effb4169be0 con 0x7effb409b8b0 2024-08-18T22:20:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb9000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effb4169a60 con 0x7effb415ff60 2024-08-18T22:20:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb9000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effb4169d60 con 0x7effb4160340 2024-08-18T22:20:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb409b8b0 0x7effb4157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb409b8b0 0x7effb4157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45614/0 (socket says 172.21.15.5:45614) 2024-08-18T22:20:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb1e00640 1 -- 172.21.15.5:0/2674823798 learned_addr learned my addr 172.21.15.5:0/2674823798 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effa9400640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effb415ff60 0x7effb415ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb2800640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effb4160340 0x7effb40c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb1e00640 1 -- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effb4160340 msgr2=0x7effb40c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb1e00640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effb4160340 0x7effb40c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb1e00640 1 -- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effb415ff60 msgr2=0x7effb415ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb1e00640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effb415ff60 0x7effb415ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb1e00640 1 -- 172.21.15.5:0/2674823798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb40b1850 con 0x7effb409b8b0 2024-08-18T22:20:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb1e00640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb409b8b0 0x7effb4157240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7effa401a070 tx=0x7effa40191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effaaa00640 1 -- 172.21.15.5:0/2674823798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa40b9020 con 0x7effb409b8b0 2024-08-18T22:20:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effaaa00640 1 -- 172.21.15.5:0/2674823798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa40b1040 con 0x7effb409b8b0 2024-08-18T22:20:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb9000640 1 -- 172.21.15.5:0/2674823798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb415e370 con 0x7effb409b8b0 2024-08-18T22:20:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effaaa00640 1 -- 172.21.15.5:0/2674823798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa40b0050 con 0x7effb409b8b0 2024-08-18T22:20:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.662+0000 7effb9000640 1 -- 172.21.15.5:0/2674823798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb4156ee0 con 0x7effb409b8b0 2024-08-18T22:20:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.666+0000 7effb9000640 1 -- 172.21.15.5:0/2674823798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb409b370 con 0x7effb409b8b0 2024-08-18T22:20:06.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.666+0000 7effaaa00640 1 -- 172.21.15.5:0/2674823798 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7effa40bc020 con 0x7effb409b8b0 2024-08-18T22:20:06.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.666+0000 7effaaa00640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff900678c0 0x7eff90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:06.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.666+0000 7effaaa00640 1 -- 172.21.15.5:0/2674823798 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7effa411fd60 con 0x7effb409b8b0 2024-08-18T22:20:06.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.666+0000 7effa9400640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff900678c0 0x7eff90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:06.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.666+0000 7effa9400640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff900678c0 0x7eff90069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7effb4165470 tx=0x7eff9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:06.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.670+0000 7effaaa00640 1 -- 172.21.15.5:0/2674823798 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7effa40c3030 con 0x7effb409b8b0 2024-08-18T22:20:06.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.870+0000 7effb9000640 1 -- 172.21.15.5:0/2674823798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effb40d0f90 con 0x7effb409b8b0 2024-08-18T22:20:06.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.870+0000 7effaaa00640 1 -- 172.21.15.5:0/2674823798 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7effa4016150 con 0x7effb409b8b0 2024-08-18T22:20:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:06.873 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"btime":"2024-08-18T22:19:41:376873+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4007066150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4007066150},{"type":"v1","addr":"172.21.15.117:6836","nonce":4007066150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1179279001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1179279001},{"type":"v1","addr":"172.21.15.117:6837","nonce":1179279001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:19:20.503823+0000","modified":"2024-08-18T22:19:40.761749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3727670717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3727670717},{"type":"v1","addr":"172.21.15.5:6835","nonce":3727670717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-08-18T22:20:06.873 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-08-18T22:20:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 -- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff900678c0 msgr2=0x7eff90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff900678c0 0x7eff90069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7effb4165470 tx=0x7eff9c008040 comp rx=0 tx=0).stop 2024-08-18T22:20:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 -- 172.21.15.5:0/2674823798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb409b8b0 msgr2=0x7effb4157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb409b8b0 0x7effb4157240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7effa401a070 tx=0x7effa40191e0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 -- 172.21.15.5:0/2674823798 shutdown_connections 2024-08-18T22:20:06.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff900678c0 0x7eff90069d80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effb4160340 0x7effb40c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effb415ff60 0x7effb415ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 --2- 172.21.15.5:0/2674823798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb409b8b0 0x7effb4157240 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:06.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 -- 172.21.15.5:0/2674823798 >> 172.21.15.5:0/2674823798 conn(0x7effb40d2130 msgr2=0x7effb40b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:06.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 -- 172.21.15.5:0/2674823798 shutdown_connections 2024-08-18T22:20:06.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:06.874+0000 7effb9000640 1 -- 172.21.15.5:0/2674823798 wait complete. 2024-08-18T22:20:06.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:20:07.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.034+0000 7ff6de400640 1 Processor -- start 2024-08-18T22:20:07.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.034+0000 7ff6de400640 1 -- start start 2024-08-18T22:20:07.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.034+0000 7ff6de400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8161960 0x7ff6d806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.034+0000 7ff6de400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff6d815e4b0 0x7ff6d8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.034+0000 7ff6de400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d815eb60 con 0x7ff6d8070730 2024-08-18T22:20:07.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.034+0000 7ff6de400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d815fcc0 con 0x7ff6d815e4b0 2024-08-18T22:20:07.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.034+0000 7ff6de400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d80710b0 con 0x7ff6d8161960 2024-08-18T22:20:07.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.034+0000 7ff6d7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8161960 0x7ff6d806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.034+0000 7ff6d7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8161960 0x7ff6d806fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:45740/0 (socket says 172.21.15.5:45740) 2024-08-18T22:20:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.034+0000 7ff6d7400640 1 -- 172.21.15.5:0/3133280341 learned_addr learned my addr 172.21.15.5:0/3133280341 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.034+0000 7ff6d7e00640 1 --2- 172.21.15.5:0/3133280341 >> v2:172.21.15.117:3300/0 conn(0x7ff6d815e4b0 0x7ff6d8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6d7400640 1 -- 172.21.15.5:0/3133280341 >> v2:172.21.15.117:3300/0 conn(0x7ff6d815e4b0 msgr2=0x7ff6d8070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6d7400640 1 --2- 172.21.15.5:0/3133280341 >> v2:172.21.15.117:3300/0 conn(0x7ff6d815e4b0 0x7ff6d8070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6d7400640 1 -- 172.21.15.5:0/3133280341 >> v1:172.21.15.117:6789/0 conn(0x7ff6d8070730 legacy=0x7ff6d815dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6d7400640 1 -- 172.21.15.5:0/3133280341 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d815ee40 con 0x7ff6d8161960 2024-08-18T22:20:07.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6d7400640 1 --2- 172.21.15.5:0/3133280341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8161960 0x7ff6d806fd20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009870 tx=0x7ff6c801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c0a847fdd254c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:07.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6d6a00640 1 -- 172.21.15.5:0/3133280341 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80b2070 con 0x7ff6d8161960 2024-08-18T22:20:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6d6a00640 1 -- 172.21.15.5:0/3133280341 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c80a9070 con 0x7ff6d8161960 2024-08-18T22:20:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6d6a00640 1 -- 172.21.15.5:0/3133280341 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80ad880 con 0x7ff6d8161960 2024-08-18T22:20:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6de400640 1 -- 172.21.15.5:0/3133280341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8161960 msgr2=0x7ff6d806fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6de400640 1 --2- 172.21.15.5:0/3133280341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8161960 0x7ff6d806fd20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009870 tx=0x7ff6c801c560 comp rx=0 tx=0).stop 2024-08-18T22:20:07.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6de400640 1 -- 172.21.15.5:0/3133280341 shutdown_connections 2024-08-18T22:20:07.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6de400640 1 --2- 172.21.15.5:0/3133280341 >> v2:172.21.15.117:3300/0 conn(0x7ff6d815e4b0 0x7ff6d8070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6de400640 1 --2- 172.21.15.5:0/3133280341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8161960 0x7ff6d806fd20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6de400640 1 -- 172.21.15.5:0/3133280341 >> 172.21.15.5:0/3133280341 conn(0x7ff6d80d2130 msgr2=0x7ff6d80d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:07.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6de400640 1 -- 172.21.15.5:0/3133280341 shutdown_connections 2024-08-18T22:20:07.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.038+0000 7ff6de400640 1 -- 172.21.15.5:0/3133280341 wait complete. 2024-08-18T22:20:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6de400640 1 Processor -- start 2024-08-18T22:20:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6de400640 1 -- start start 2024-08-18T22:20:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6de400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8070730 0x7ff6d815be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6de400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6d815e4b0 0x7ff6d80b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6de400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6d8161960 0x7ff6d80ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6de400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d809ba30 con 0x7ff6d8161960 2024-08-18T22:20:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6de400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8070260 con 0x7ff6d815e4b0 2024-08-18T22:20:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6de400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d80ca210 con 0x7ff6d8070730 2024-08-18T22:20:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6d7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8070730 0x7ff6d815be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6d7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6d8161960 0x7ff6d80ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6d7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8070730 0x7ff6d815be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:45744/0 (socket says 172.21.15.5:45744) 2024-08-18T22:20:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6d7400640 1 -- 172.21.15.5:0/1167857447 learned_addr learned my addr 172.21.15.5:0/1167857447 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6cea00640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6d815e4b0 0x7ff6d80b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6d7400640 1 -- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6d815e4b0 msgr2=0x7ff6d80b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6d7400640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6d815e4b0 0x7ff6d80b73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6d7400640 1 -- 172.21.15.5:0/1167857447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6d8161960 msgr2=0x7ff6d80ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6d7400640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6d8161960 0x7ff6d80ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6d7400640 1 -- 172.21.15.5:0/1167857447 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d80ca630 con 0x7ff6d8070730 2024-08-18T22:20:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.042+0000 7ff6d7400640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8070730 0x7ff6d815be60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80b0040 tx=0x7ff6c8019300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.046+0000 7ff6cfe00640 1 -- 172.21.15.5:0/1167857447 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80b2050 con 0x7ff6d8070730 2024-08-18T22:20:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.046+0000 7ff6cfe00640 1 -- 172.21.15.5:0/1167857447 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c80be070 con 0x7ff6d8070730 2024-08-18T22:20:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.046+0000 7ff6cfe00640 1 -- 172.21.15.5:0/1167857447 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80b9690 con 0x7ff6d8070730 2024-08-18T22:20:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.046+0000 7ff6de400640 1 -- 172.21.15.5:0/1167857447 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d80ca910 con 0x7ff6d8070730 2024-08-18T22:20:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.046+0000 7ff6de400640 1 -- 172.21.15.5:0/1167857447 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d80caed0 con 0x7ff6d8070730 2024-08-18T22:20:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.046+0000 7ff6de400640 1 -- 172.21.15.5:0/1167857447 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d8070b70 con 0x7ff6d8070730 2024-08-18T22:20:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.046+0000 7ff6cfe00640 1 -- 172.21.15.5:0/1167857447 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff6c80ab070 con 0x7ff6d8070730 2024-08-18T22:20:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.046+0000 7ff6cfe00640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6b40678c0 0x7ff6b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.046+0000 7ff6cfe00640 1 -- 172.21.15.5:0/1167857447 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ff6c8120ea0 con 0x7ff6d8070730 2024-08-18T22:20:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.046+0000 7ff6cea00640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6b40678c0 0x7ff6b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.050+0000 7ff6cea00640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6b40678c0 0x7ff6b4069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80c8d70 tx=0x7ff6c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:07.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.050+0000 7ff6cfe00640 1 -- 172.21.15.5:0/1167857447 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff6c8016150 con 0x7ff6d8070730 2024-08-18T22:20:07.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.250+0000 7ff6de400640 1 -- 172.21.15.5:0/1167857447 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6d809bbb0 con 0x7ff6d8070730 2024-08-18T22:20:07.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.250+0000 7ff6cfe00640 1 -- 172.21.15.5:0/1167857447 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5216 (secure 0 0 0) 0x7ff6c80f0fe0 con 0x7ff6d8070730 2024-08-18T22:20:07.252 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:07.252 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"btime":"2024-08-18T22:19:41:376873+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4252,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/734387203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":734387203},{"type":"v1","addr":"172.21.15.5:6834","nonce":734387203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4007066150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4007066150},{"type":"v1","addr":"172.21.15.117:6836","nonce":4007066150}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1179279001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1179279001},{"type":"v1","addr":"172.21.15.117:6837","nonce":1179279001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:19:20.503823+0000","modified":"2024-08-18T22:19:40.761749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3727670717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3727670717},{"type":"v1","addr":"172.21.15.5:6835","nonce":3727670717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-08-18T22:20:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-08-18T22:20:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 -- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6b40678c0 msgr2=0x7ff6b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6b40678c0 0x7ff6b4069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80c8d70 tx=0x7ff6c0009040 comp rx=0 tx=0).stop 2024-08-18T22:20:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 -- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8070730 msgr2=0x7ff6d815be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8070730 0x7ff6d815be60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80b0040 tx=0x7ff6c8019300 comp rx=0 tx=0).stop 2024-08-18T22:20:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 -- 172.21.15.5:0/1167857447 shutdown_connections 2024-08-18T22:20:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff6b40678c0 0x7ff6b4069d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6d8161960 0x7ff6d80ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6d815e4b0 0x7ff6d80b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 --2- 172.21.15.5:0/1167857447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6d8070730 0x7ff6d815be60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 -- 172.21.15.5:0/1167857447 >> 172.21.15.5:0/1167857447 conn(0x7ff6d80d2130 msgr2=0x7ff6d806d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 -- 172.21.15.5:0/1167857447 shutdown_connections 2024-08-18T22:20:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.254+0000 7ff6de400640 1 -- 172.21.15.5:0/1167857447 wait complete. 2024-08-18T22:20:07.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:20:07.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58d5600640 1 Processor -- start 2024-08-18T22:20:07.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58d5600640 1 -- start start 2024-08-18T22:20:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58d5600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58d0071c90 0x7f58d00b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58d5600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d00b5e30 con 0x7f58d006fad0 2024-08-18T22:20:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58d5600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d00b6110 con 0x7f58d015c180 2024-08-18T22:20:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58d5600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f58d00b63f0 con 0x7f58d0071c90 2024-08-18T22:20:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58ce000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58d0071c90 0x7f58d00b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58ce000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58d0071c90 0x7f58d00b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45624/0 (socket says 172.21.15.5:45624) 2024-08-18T22:20:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58ce000640 1 -- 172.21.15.5:0/521046044 learned_addr learned my addr 172.21.15.5:0/521046044 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58ce000640 1 -- 172.21.15.5:0/521046044 >> v1:172.21.15.117:6789/0 conn(0x7f58d015c180 legacy=0x7f58d0071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58ce000640 1 -- 172.21.15.5:0/521046044 >> v1:172.21.15.5:6789/0 conn(0x7f58d006fad0 legacy=0x7f58d00d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.414+0000 7f58ce000640 1 -- 172.21.15.5:0/521046044 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d00b66d0 con 0x7f58d0071c90 2024-08-18T22:20:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58ce000640 1 --2- 172.21.15.5:0/521046044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d0071c90 0x7f58d00b57c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009870 tx=0x7f58bc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994794e36fe3dd08 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58cd600640 1 -- 172.21.15.5:0/521046044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc0b1070 con 0x7f58d0071c90 2024-08-18T22:20:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58cd600640 1 -- 172.21.15.5:0/521046044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58bc0ac630 con 0x7f58d0071c90 2024-08-18T22:20:07.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58cd600640 1 -- 172.21.15.5:0/521046044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc0a8050 con 0x7f58d0071c90 2024-08-18T22:20:07.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58d5600640 1 -- 172.21.15.5:0/521046044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d0071c90 msgr2=0x7f58d00b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58d5600640 1 --2- 172.21.15.5:0/521046044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d0071c90 0x7f58d00b57c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009870 tx=0x7f58bc01c3e0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58d5600640 1 -- 172.21.15.5:0/521046044 shutdown_connections 2024-08-18T22:20:07.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58d5600640 1 --2- 172.21.15.5:0/521046044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d0071c90 0x7f58d00b57c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58d5600640 1 -- 172.21.15.5:0/521046044 >> 172.21.15.5:0/521046044 conn(0x7f58d00b3eb0 msgr2=0x7f58d00b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:07.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58d5600640 1 -- 172.21.15.5:0/521046044 shutdown_connections 2024-08-18T22:20:07.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58d5600640 1 -- 172.21.15.5:0/521046044 wait complete. 2024-08-18T22:20:07.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58d5600640 1 Processor -- start 2024-08-18T22:20:07.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.418+0000 7f58d5600640 1 -- start start 2024-08-18T22:20:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58d5600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d006fad0 0x7f58d0165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58d5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58d0071c90 0x7f58d00b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58d5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d015c180 0x7f58d01557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58d5600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f58d016a160 con 0x7f58d015c180 2024-08-18T22:20:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58d5600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f58d0169fe0 con 0x7f58d006fad0 2024-08-18T22:20:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58d5600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f58d016a2e0 con 0x7f58d0071c90 2024-08-18T22:20:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58cf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d015c180 0x7f58d01557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58cf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d015c180 0x7f58d01557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45632/0 (socket says 172.21.15.5:45632) 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58cf400640 1 -- 172.21.15.5:0/1333560780 learned_addr learned my addr 172.21.15.5:0/1333560780 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58cea00640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d006fad0 0x7f58d0165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58ce000640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58d0071c90 0x7f58d00b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58cf400640 1 -- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58d0071c90 msgr2=0x7f58d00b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58cf400640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58d0071c90 0x7f58d00b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58cf400640 1 -- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d006fad0 msgr2=0x7f58d0165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58cf400640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d006fad0 0x7f58d0165170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58cf400640 1 -- 172.21.15.5:0/1333560780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d015a660 con 0x7f58d015c180 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58cea00640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d006fad0 0x7f58d0165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58cf400640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d015c180 0x7f58d01557b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c730 tx=0x7f58c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58c6a00640 1 -- 172.21.15.5:0/1333560780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8003b80 con 0x7f58d015c180 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58c6a00640 1 -- 172.21.15.5:0/1333560780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c8003d20 con 0x7f58d015c180 2024-08-18T22:20:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58d5600640 1 -- 172.21.15.5:0/1333560780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d015ac40 con 0x7f58d015c180 2024-08-18T22:20:07.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58c6a00640 1 -- 172.21.15.5:0/1333560780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8005310 con 0x7f58d015c180 2024-08-18T22:20:07.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58d5600640 1 -- 172.21.15.5:0/1333560780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d00b2c40 con 0x7f58d015c180 2024-08-18T22:20:07.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58d5600640 1 -- 172.21.15.5:0/1333560780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d015aa30 con 0x7f58d015c180 2024-08-18T22:20:07.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.422+0000 7f58c6a00640 1 -- 172.21.15.5:0/1333560780 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58c80056c0 con 0x7f58d015c180 2024-08-18T22:20:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.426+0000 7f58c6a00640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58b00678c0 0x7f58b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.426+0000 7f58c6a00640 1 -- 172.21.15.5:0/1333560780 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f58c80861e0 con 0x7f58d015c180 2024-08-18T22:20:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.426+0000 7f58cea00640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58b00678c0 0x7f58b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.426+0000 7f58cea00640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58b00678c0 0x7f58b0069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f58c0001710 tx=0x7f58c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:07.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.430+0000 7f58c6a00640 1 -- 172.21.15.5:0/1333560780 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f58c80567d0 con 0x7f58d015c180 2024-08-18T22:20:07.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 -- 172.21.15.5:0/1333560780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58d00cf7d0 con 0x7f58d015c180 2024-08-18T22:20:07.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58c6a00640 1 -- 172.21.15.5:0/1333560780 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18876 (secure 0 0 0) 0x7f58c80560d0 con 0x7f58d015c180 2024-08-18T22:20:07.599 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:07.599 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:20:03.464794+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:19:18.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T22:19:19.497530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T22:19:23.370791+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:20:07.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 -- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58b00678c0 msgr2=0x7f58b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58b00678c0 0x7f58b0069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f58c0001710 tx=0x7f58c0009040 comp rx=0 tx=0).stop 2024-08-18T22:20:07.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 -- 172.21.15.5:0/1333560780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d015c180 msgr2=0x7f58d01557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d015c180 0x7f58d01557b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c730 tx=0x7f58c800cbf0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 -- 172.21.15.5:0/1333560780 shutdown_connections 2024-08-18T22:20:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58b00678c0 0x7f58b0069d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58d015c180 0x7f58d01557b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58d0071c90 0x7f58d00b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 --2- 172.21.15.5:0/1333560780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d006fad0 0x7f58d0165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 -- 172.21.15.5:0/1333560780 >> 172.21.15.5:0/1333560780 conn(0x7f58d00b3eb0 msgr2=0x7f58d0071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 -- 172.21.15.5:0/1333560780 shutdown_connections 2024-08-18T22:20:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.598+0000 7f58d5600640 1 -- 172.21.15.5:0/1333560780 wait complete. 2024-08-18T22:20:07.622 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:20:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.762+0000 7f0ab2200640 1 Processor -- start 2024-08-18T22:20:07.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.762+0000 7f0ab2200640 1 -- start start 2024-08-18T22:20:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0ab2200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0aac0b40c0 0x7f0aac0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0ab2200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0aac0ce280 0x7f0aac0ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0ab2200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aac0b31f0 con 0x7f0aac15b0c0 2024-08-18T22:20:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0ab2200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0aac0b4a70 con 0x7f0aac0ce280 2024-08-18T22:20:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0ab2200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0aac0b3d70 con 0x7f0aac0b40c0 2024-08-18T22:20:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0aabe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0aac0ce280 0x7f0aac0ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0aabe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0aac0ce280 0x7f0aac0ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45636/0 (socket says 172.21.15.5:45636) 2024-08-18T22:20:07.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0aabe00640 1 -- 172.21.15.5:0/2261918039 learned_addr learned my addr 172.21.15.5:0/2261918039 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0aabe00640 1 -- 172.21.15.5:0/2261918039 >> v2:172.21.15.117:3300/0 conn(0x7f0aac0b40c0 msgr2=0x7f0aac0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0aaaa00640 1 --2- 172.21.15.5:0/2261918039 >> v2:172.21.15.117:3300/0 conn(0x7f0aac0b40c0 0x7f0aac0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0aabe00640 1 --2- 172.21.15.5:0/2261918039 >> v2:172.21.15.117:3300/0 conn(0x7f0aac0b40c0 0x7f0aac0b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0aabe00640 1 -- 172.21.15.5:0/2261918039 >> v1:172.21.15.117:6789/0 conn(0x7f0aac15b0c0 legacy=0x7f0aac06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:07.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0aabe00640 1 -- 172.21.15.5:0/2261918039 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac0b34d0 con 0x7f0aac0ce280 2024-08-18T22:20:07.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0aaaa00640 1 --2- 172.21.15.5:0/2261918039 >> v2:172.21.15.117:3300/0 conn(0x7f0aac0b40c0 0x7f0aac0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:07.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.766+0000 7f0aabe00640 1 --2- 172.21.15.5:0/2261918039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aac0ce280 0x7f0aac0ce6d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0aac073f90 tx=0x7f0aa401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d5e4e501f8b7b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0aaa000640 1 -- 172.21.15.5:0/2261918039 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40a5640 con 0x7f0aac0ce280 2024-08-18T22:20:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0aaa000640 1 -- 172.21.15.5:0/2261918039 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aa40a57e0 con 0x7f0aac0ce280 2024-08-18T22:20:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0aaa000640 1 -- 172.21.15.5:0/2261918039 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40a5bb0 con 0x7f0aac0ce280 2024-08-18T22:20:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 -- 172.21.15.5:0/2261918039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aac0ce280 msgr2=0x7f0aac0ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 --2- 172.21.15.5:0/2261918039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aac0ce280 0x7f0aac0ce6d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0aac073f90 tx=0x7f0aa401c890 comp rx=0 tx=0).stop 2024-08-18T22:20:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 -- 172.21.15.5:0/2261918039 shutdown_connections 2024-08-18T22:20:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 --2- 172.21.15.5:0/2261918039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aac0ce280 0x7f0aac0ce6d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 --2- 172.21.15.5:0/2261918039 >> v2:172.21.15.117:3300/0 conn(0x7f0aac0b40c0 0x7f0aac0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 -- 172.21.15.5:0/2261918039 >> 172.21.15.5:0/2261918039 conn(0x7f0aac0b1dc0 msgr2=0x7f0aac0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 -- 172.21.15.5:0/2261918039 shutdown_connections 2024-08-18T22:20:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 -- 172.21.15.5:0/2261918039 wait complete. 2024-08-18T22:20:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 Processor -- start 2024-08-18T22:20:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 -- start start 2024-08-18T22:20:07.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0aac0b40c0 0x7f0aac0996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aac0ce280 0x7f0aac098a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aac15b0c0 0x7f0aac151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac06f7f0 con 0x7f0aac15b0c0 2024-08-18T22:20:07.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac06f670 con 0x7f0aac0ce280 2024-08-18T22:20:07.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0ab2200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac167d10 con 0x7f0aac0b40c0 2024-08-18T22:20:07.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0aabe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aac15b0c0 0x7f0aac151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0aabe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aac15b0c0 0x7f0aac151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45646/0 (socket says 172.21.15.5:45646) 2024-08-18T22:20:07.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0aabe00640 1 -- 172.21.15.5:0/3075282305 learned_addr learned my addr 172.21.15.5:0/3075282305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:07.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0aab400640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0aac0b40c0 0x7f0aac0996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.770+0000 7f0aaaa00640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aac0ce280 0x7f0aac098a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aabe00640 1 -- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0aac0b40c0 msgr2=0x7f0aac0996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aabe00640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0aac0b40c0 0x7f0aac0996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aabe00640 1 -- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aac0ce280 msgr2=0x7f0aac098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aabe00640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aac0ce280 0x7f0aac098a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aabe00640 1 -- 172.21.15.5:0/3075282305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac0734a0 con 0x7f0aac15b0c0 2024-08-18T22:20:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aabe00640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aac15b0c0 0x7f0aac151090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40af040 tx=0x7f0aa4019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aa3400640 1 -- 172.21.15.5:0/3075282305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40bc020 con 0x7f0aac15b0c0 2024-08-18T22:20:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aa3400640 1 -- 172.21.15.5:0/3075282305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aa40b8670 con 0x7f0aac15b0c0 2024-08-18T22:20:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0ab2200640 1 -- 172.21.15.5:0/3075282305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac14b000 con 0x7f0aac15b0c0 2024-08-18T22:20:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aa3400640 1 -- 172.21.15.5:0/3075282305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40b8a60 con 0x7f0aac15b0c0 2024-08-18T22:20:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0ab2200640 1 -- 172.21.15.5:0/3075282305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac073780 con 0x7f0aac15b0c0 2024-08-18T22:20:07.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0ab2200640 1 -- 172.21.15.5:0/3075282305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac0b4530 con 0x7f0aac15b0c0 2024-08-18T22:20:07.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aa3400640 1 -- 172.21.15.5:0/3075282305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0aa40bf020 con 0x7f0aac15b0c0 2024-08-18T22:20:07.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aa3400640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a8c0678c0 0x7f0a8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:07.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.774+0000 7f0aa3400640 1 -- 172.21.15.5:0/3075282305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f0aa4120fd0 con 0x7f0aac15b0c0 2024-08-18T22:20:07.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.778+0000 7f0aab400640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a8c0678c0 0x7f0a8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:07.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.778+0000 7f0aab400640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a8c0678c0 0x7f0a8c069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0098e0 tx=0x7f0a9c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.778+0000 7f0aa3400640 1 -- 172.21.15.5:0/3075282305 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0aa40c6030 con 0x7f0aac15b0c0 2024-08-18T22:20:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.982+0000 7f0ab2200640 1 -- 172.21.15.5:0/3075282305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0aac06cae0 con 0x7f0aac15b0c0 2024-08-18T22:20:07.983 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:20:07.982+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:20:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.986+0000 7f0aa3400640 1 -- 172.21.15.5:0/3075282305 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f0aa40165a0 con 0x7f0aac15b0c0 2024-08-18T22:20:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:20:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.986+0000 7f0ab2200640 1 -- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a8c0678c0 msgr2=0x7f0a8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.986+0000 7f0ab2200640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a8c0678c0 0x7f0a8c069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0098e0 tx=0x7f0a9c009060 comp rx=0 tx=0).stop 2024-08-18T22:20:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.986+0000 7f0ab2200640 1 -- 172.21.15.5:0/3075282305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aac15b0c0 msgr2=0x7f0aac151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.986+0000 7f0ab2200640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aac15b0c0 0x7f0aac151090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40af040 tx=0x7f0aa4019630 comp rx=0 tx=0).stop 2024-08-18T22:20:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.986+0000 7f0ab2200640 1 -- 172.21.15.5:0/3075282305 shutdown_connections 2024-08-18T22:20:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.986+0000 7f0ab2200640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a8c0678c0 0x7f0a8c069d80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.986+0000 7f0ab2200640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aac15b0c0 0x7f0aac151090 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.986+0000 7f0ab2200640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aac0ce280 0x7f0aac098a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.986+0000 7f0ab2200640 1 --2- 172.21.15.5:0/3075282305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0aac0b40c0 0x7f0aac0996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.986+0000 7f0ab2200640 1 -- 172.21.15.5:0/3075282305 >> 172.21.15.5:0/3075282305 conn(0x7f0aac0b1dc0 msgr2=0x7f0aac151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:07.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.990+0000 7f0ab2200640 1 -- 172.21.15.5:0/3075282305 shutdown_connections 2024-08-18T22:20:07.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:07.990+0000 7f0ab2200640 1 -- 172.21.15.5:0/3075282305 wait complete. 2024-08-18T22:20:07.997 INFO:tasks.ceph.mds.a.smithi005.stderr: -4404> 2024-08-18T22:19:25.883+0000 7fa9cf600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:20:08.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:20:08.047 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:20:08.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36cd800640 1 Processor -- start 2024-08-18T22:20:08.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36cd800640 1 -- start start 2024-08-18T22:20:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36cd800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f36c815c180 0x7f36c80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36cd800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36c815c560 0x7f36c80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36cd800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36c815d4d0 0x7f36c80ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36cd800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f36c815d040 con 0x7f36c815d4d0 2024-08-18T22:20:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36cd800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f36c80cfb00 con 0x7f36c815c180 2024-08-18T22:20:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36cd800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f36c815c9f0 con 0x7f36c815c560 2024-08-18T22:20:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36c7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36c815d4d0 0x7f36c80ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36c7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36c815d4d0 0x7f36c80ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45668/0 (socket says 172.21.15.5:45668) 2024-08-18T22:20:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36c7400640 1 -- 172.21.15.5:0/55357575 learned_addr learned my addr 172.21.15.5:0/55357575 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36c6a00640 1 --2- 172.21.15.5:0/55357575 >> v2:172.21.15.117:3300/0 conn(0x7f36c815c180 0x7f36c80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:08.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36c6000640 1 --2- 172.21.15.5:0/55357575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36c815c560 0x7f36c80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36c7400640 1 -- 172.21.15.5:0/55357575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36c815c560 msgr2=0x7f36c80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36c7400640 1 --2- 172.21.15.5:0/55357575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36c815c560 0x7f36c80ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36c7400640 1 -- 172.21.15.5:0/55357575 >> v2:172.21.15.117:3300/0 conn(0x7f36c815c180 msgr2=0x7f36c80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36c7400640 1 --2- 172.21.15.5:0/55357575 >> v2:172.21.15.117:3300/0 conn(0x7f36c815c180 0x7f36c80cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.154+0000 7f36c7400640 1 -- 172.21.15.5:0/55357575 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c815ccd0 con 0x7f36c815d4d0 2024-08-18T22:20:08.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36c7400640 1 --2- 172.21.15.5:0/55357575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c815d4d0 0x7f36c80ce990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f36c806d8a0 tx=0x7f36c001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d577ec7615682f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:08.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36c5600640 1 -- 172.21.15.5:0/55357575 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c00a5800 con 0x7f36c815d4d0 2024-08-18T22:20:08.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36c5600640 1 -- 172.21.15.5:0/55357575 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c00a59a0 con 0x7f36c815d4d0 2024-08-18T22:20:08.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36c5600640 1 -- 172.21.15.5:0/55357575 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c00a5d70 con 0x7f36c815d4d0 2024-08-18T22:20:08.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36cd800640 1 -- 172.21.15.5:0/55357575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c815d4d0 msgr2=0x7f36c80ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:08.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36cd800640 1 --2- 172.21.15.5:0/55357575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c815d4d0 0x7f36c80ce990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f36c806d8a0 tx=0x7f36c001c960 comp rx=0 tx=0).stop 2024-08-18T22:20:08.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36cd800640 1 -- 172.21.15.5:0/55357575 shutdown_connections 2024-08-18T22:20:08.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36cd800640 1 --2- 172.21.15.5:0/55357575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c815d4d0 0x7f36c80ce990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36cd800640 1 --2- 172.21.15.5:0/55357575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36c815c560 0x7f36c80ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36cd800640 1 --2- 172.21.15.5:0/55357575 >> v2:172.21.15.117:3300/0 conn(0x7f36c815c180 0x7f36c80cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36cd800640 1 -- 172.21.15.5:0/55357575 >> 172.21.15.5:0/55357575 conn(0x7f36c80b1dc0 msgr2=0x7f36c80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36cd800640 1 -- 172.21.15.5:0/55357575 shutdown_connections 2024-08-18T22:20:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.158+0000 7f36cd800640 1 -- 172.21.15.5:0/55357575 wait complete. 2024-08-18T22:20:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36cd800640 1 Processor -- start 2024-08-18T22:20:08.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36cd800640 1 -- start start 2024-08-18T22:20:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36cd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c815c180 0x7f36c80b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36cd800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36c815d4d0 0x7f36c81462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36cd800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36c81f7200 0x7f36c81564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36cd800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f36c8160930 con 0x7f36c815c180 2024-08-18T22:20:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36cd800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f36c81607b0 con 0x7f36c81f7200 2024-08-18T22:20:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36cd800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f36c8160ab0 con 0x7f36c815d4d0 2024-08-18T22:20:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36c6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c815c180 0x7f36c80b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:08.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36c6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c815c180 0x7f36c80b1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45680/0 (socket says 172.21.15.5:45680) 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36c6a00640 1 -- 172.21.15.5:0/1011339244 learned_addr learned my addr 172.21.15.5:0/1011339244 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36c6000640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36c815d4d0 0x7f36c81462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36c6a00640 1 -- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36c815d4d0 msgr2=0x7f36c81462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36c6a00640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36c815d4d0 0x7f36c81462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36c6a00640 1 -- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36c81f7200 msgr2=0x7f36c81564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36c6a00640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36c81f7200 0x7f36c81564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36c6a00640 1 -- 172.21.15.5:0/1011339244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c81467e0 con 0x7f36c815c180 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36c6a00640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c815c180 0x7f36c80b1360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f36b800e8a0 tx=0x7f36b800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36bea00640 1 -- 172.21.15.5:0/1011339244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8017070 con 0x7f36c815c180 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36bea00640 1 -- 172.21.15.5:0/1011339244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b800ee90 con 0x7f36c815c180 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36cd800640 1 -- 172.21.15.5:0/1011339244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c8159ed0 con 0x7f36c815c180 2024-08-18T22:20:08.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36bea00640 1 -- 172.21.15.5:0/1011339244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b800cb20 con 0x7f36c815c180 2024-08-18T22:20:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.162+0000 7f36cd800640 1 -- 172.21.15.5:0/1011339244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c80ad6a0 con 0x7f36c815c180 2024-08-18T22:20:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.166+0000 7f36cd800640 1 -- 172.21.15.5:0/1011339244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c80ad4c0 con 0x7f36c815c180 2024-08-18T22:20:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.166+0000 7f36bea00640 1 -- 172.21.15.5:0/1011339244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36b801a070 con 0x7f36c815c180 2024-08-18T22:20:08.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.166+0000 7f36bea00640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36a80678c0 0x7f36a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:08.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.166+0000 7f36bea00640 1 -- 172.21.15.5:0/1011339244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6850+0+0 (secure 0 0 0) 0x7f36b8085fc0 con 0x7f36c815c180 2024-08-18T22:20:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.166+0000 7f36c6000640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36a80678c0 0x7f36a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.170+0000 7f36c6000640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36a80678c0 0x7f36a8069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f36c80cc920 tx=0x7f36b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:08.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.170+0000 7f36bea00640 1 -- 172.21.15.5:0/1011339244 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f36c80ad4c0 con 0x7f36c815c180 2024-08-18T22:20:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.370+0000 7f36cd800640 1 -- 172.21.15.5:0/1011339244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f36c80cdf10 con 0x7f36c815c180 2024-08-18T22:20:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.986+0000 7f36bea00640 1 -- 172.21.15.5:0/1011339244 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f36b80565e0 con 0x7f36c815c180 2024-08-18T22:20:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 -- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36a80678c0 msgr2=0x7f36a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36a80678c0 0x7f36a8069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f36c80cc920 tx=0x7f36b4008040 comp rx=0 tx=0).stop 2024-08-18T22:20:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 -- 172.21.15.5:0/1011339244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c815c180 msgr2=0x7f36c80b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c815c180 0x7f36c80b1360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f36b800e8a0 tx=0x7f36b800ed60 comp rx=0 tx=0).stop 2024-08-18T22:20:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 -- 172.21.15.5:0/1011339244 shutdown_connections 2024-08-18T22:20:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36a80678c0 0x7f36a8069d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36c81f7200 0x7f36c81564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36c815d4d0 0x7f36c81462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 --2- 172.21.15.5:0/1011339244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36c815c180 0x7f36c80b1360 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 -- 172.21.15.5:0/1011339244 >> 172.21.15.5:0/1011339244 conn(0x7f36c80b1dc0 msgr2=0x7f36c8072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 -- 172.21.15.5:0/1011339244 shutdown_connections 2024-08-18T22:20:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:08.990+0000 7f36cd800640 1 -- 172.21.15.5:0/1011339244 wait complete. 2024-08-18T22:20:09.016 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:20:09.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4618800640 1 Processor -- start 2024-08-18T22:20:09.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4618800640 1 -- start start 2024-08-18T22:20:09.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4618800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 0x7f46100cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:09.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4618800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f461015d1d0 0x7f46100cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:09.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4618800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f461006ec70 con 0x7f46100cdf10 2024-08-18T22:20:09.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4618800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f46100cfe90 con 0x7f461015d1d0 2024-08-18T22:20:09.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4618800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f46100b37e0 con 0x7f46100ccaa0 2024-08-18T22:20:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4615e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 0x7f46100cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4616800640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f46100cdf10 0x7f46100ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:34988/0 (socket says 172.21.15.5:34988) 2024-08-18T22:20:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4615400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f461015d1d0 0x7f46100cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4616800640 1 -- 172.21.15.5:0/2590201366 learned_addr learned my addr 172.21.15.5:0/2590201366 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4615e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 0x7f46100cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:45796/0 (socket says 172.21.15.5:45796) 2024-08-18T22:20:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4614a00640 1 -- 172.21.15.5:0/2590201366 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626150383 0 0) 0x7f460c0014a0 con 0x7f46100cdf10 2024-08-18T22:20:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4615e00640 1 -- 172.21.15.5:0/2590201366 >> v2:172.21.15.117:3300/0 conn(0x7f461015d1d0 msgr2=0x7f46100cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4615e00640 1 --2- 172.21.15.5:0/2590201366 >> v2:172.21.15.117:3300/0 conn(0x7f461015d1d0 0x7f46100cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4615e00640 1 -- 172.21.15.5:0/2590201366 >> v1:172.21.15.117:6789/0 conn(0x7f46100cdf10 legacy=0x7f46100ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4615e00640 1 -- 172.21.15.5:0/2590201366 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46100b3260 con 0x7f46100ccaa0 2024-08-18T22:20:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.210+0000 7f4615400640 1 --2- 172.21.15.5:0/2590201366 >> v2:172.21.15.117:3300/0 conn(0x7f461015d1d0 0x7f46100cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:20:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4615e00640 1 --2- 172.21.15.5:0/2590201366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 0x7f46100cf760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f46040097c0 tx=0x7f460401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be5926ada49308bd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4614a00640 1 -- 172.21.15.5:0/2590201366 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46040b0070 con 0x7f46100ccaa0 2024-08-18T22:20:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4614a00640 1 -- 172.21.15.5:0/2590201366 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46040ab400 con 0x7f46100ccaa0 2024-08-18T22:20:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4614a00640 1 -- 172.21.15.5:0/2590201366 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46040ab7d0 con 0x7f46100ccaa0 2024-08-18T22:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4618800640 1 -- 172.21.15.5:0/2590201366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 msgr2=0x7f46100cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4618800640 1 --2- 172.21.15.5:0/2590201366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 0x7f46100cf760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f46040097c0 tx=0x7f460401c410 comp rx=0 tx=0).stop 2024-08-18T22:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4618800640 1 -- 172.21.15.5:0/2590201366 shutdown_connections 2024-08-18T22:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4618800640 1 --2- 172.21.15.5:0/2590201366 >> v2:172.21.15.117:3300/0 conn(0x7f461015d1d0 0x7f46100cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4618800640 1 --2- 172.21.15.5:0/2590201366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 0x7f46100cf760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4618800640 1 -- 172.21.15.5:0/2590201366 >> 172.21.15.5:0/2590201366 conn(0x7f461006b9b0 msgr2=0x7f461006bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4618800640 1 -- 172.21.15.5:0/2590201366 shutdown_connections 2024-08-18T22:20:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4618800640 1 -- 172.21.15.5:0/2590201366 wait complete. 2024-08-18T22:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4618800640 1 Processor -- start 2024-08-18T22:20:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.214+0000 7f4618800640 1 -- start start 2024-08-18T22:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4618800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 0x7f4610151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4618800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46100cdf10 0x7f461014ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4618800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f461015d1d0 0x7f4610153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4618800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4610156a10 con 0x7f461015d1d0 2024-08-18T22:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4618800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f46100afa50 con 0x7f46100cdf10 2024-08-18T22:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4618800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4610156b90 con 0x7f46100ccaa0 2024-08-18T22:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4616800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f461015d1d0 0x7f4610153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4615e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 0x7f4610151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4615400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46100cdf10 0x7f461014ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4616800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f461015d1d0 0x7f4610153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45682/0 (socket says 172.21.15.5:45682) 2024-08-18T22:20:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4615e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 0x7f4610151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:45804/0 (socket says 172.21.15.5:45804) 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4616800640 1 -- 172.21.15.5:0/3879930763 learned_addr learned my addr 172.21.15.5:0/3879930763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4615400640 1 -- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 msgr2=0x7f4610151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4615400640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 0x7f4610151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4615400640 1 -- 172.21.15.5:0/3879930763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f461015d1d0 msgr2=0x7f4610153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4615400640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f461015d1d0 0x7f4610153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4615400640 1 -- 172.21.15.5:0/3879930763 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46100ad360 con 0x7f46100cdf10 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4616800640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f461015d1d0 0x7f4610153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4615400640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46100cdf10 0x7f461014ffe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4600012b70 tx=0x7f4600010490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f460a000640 1 -- 172.21.15.5:0/3879930763 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460000d2d0 con 0x7f46100cdf10 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f460a000640 1 -- 172.21.15.5:0/3879930763 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460001d070 con 0x7f46100cdf10 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f460a000640 1 -- 172.21.15.5:0/3879930763 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600010dc0 con 0x7f46100cdf10 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4618800640 1 -- 172.21.15.5:0/3879930763 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46100ad640 con 0x7f46100cdf10 2024-08-18T22:20:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4618800640 1 -- 172.21.15.5:0/3879930763 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4610150520 con 0x7f46100cdf10 2024-08-18T22:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.218+0000 7f4618800640 1 -- 172.21.15.5:0/3879930763 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46100cf760 con 0x7f46100cdf10 2024-08-18T22:20:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.222+0000 7f460a000640 1 -- 172.21.15.5:0/3879930763 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4600016050 con 0x7f46100cdf10 2024-08-18T22:20:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.222+0000 7f460a000640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45f40678f0 0x7f45f4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.222+0000 7f460a000640 1 -- 172.21.15.5:0/3879930763 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6850+0+0 (secure 0 0 0) 0x7f460008a1c0 con 0x7f46100cdf10 2024-08-18T22:20:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.222+0000 7f4615e00640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45f40678f0 0x7f45f4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.222+0000 7f4615e00640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45f40678f0 0x7f45f4069db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f46040ad000 tx=0x7f46040a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.226+0000 7f460a000640 1 -- 172.21.15.5:0/3879930763 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4600027020 con 0x7f46100cdf10 2024-08-18T22:20:09.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.390+0000 7f4618800640 1 -- 172.21.15.5:0/3879930763 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f46100cc490 con 0x7f46100cdf10 2024-08-18T22:20:09.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.994+0000 7f460a000640 1 -- 172.21.15.5:0/3879930763 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f4600014040 con 0x7f46100cdf10 2024-08-18T22:20:09.997 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:20:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 -- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45f40678f0 msgr2=0x7f45f4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45f40678f0 0x7f45f4069db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f46040ad000 tx=0x7f46040a6000 comp rx=0 tx=0).stop 2024-08-18T22:20:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 -- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46100cdf10 msgr2=0x7f461014ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46100cdf10 0x7f461014ffe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4600012b70 tx=0x7f4600010490 comp rx=0 tx=0).stop 2024-08-18T22:20:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 -- 172.21.15.5:0/3879930763 shutdown_connections 2024-08-18T22:20:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45f40678f0 0x7f45f4069db0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f461015d1d0 0x7f4610153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46100cdf10 0x7f461014ffe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 --2- 172.21.15.5:0/3879930763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46100ccaa0 0x7f4610151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 -- 172.21.15.5:0/3879930763 >> 172.21.15.5:0/3879930763 conn(0x7f461006b9b0 msgr2=0x7f461015a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 -- 172.21.15.5:0/3879930763 shutdown_connections 2024-08-18T22:20:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:09.998+0000 7f4618800640 1 -- 172.21.15.5:0/3879930763 wait complete. 2024-08-18T22:20:10.021 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:20:10.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181c400640 1 Processor -- start 2024-08-18T22:20:10.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181c400640 1 -- start start 2024-08-18T22:20:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181c400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f181415f900 0x7f18140d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181c400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 0x7f18140d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181c400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181409b5f0 con 0x7f18140ce5d0 2024-08-18T22:20:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181c400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f181415fce0 con 0x7f181415f900 2024-08-18T22:20:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181c400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1814071a90 con 0x7f1814070e50 2024-08-18T22:20:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f1819000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f18140ce5d0 0x7f18140ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48968/0 (socket says 172.21.15.5:48968) 2024-08-18T22:20:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f1819000640 1 -- 172.21.15.5:0/2640242027 learned_addr learned my addr 172.21.15.5:0/2640242027 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:10.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181a400640 1 --2- 172.21.15.5:0/2640242027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 0x7f18140d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:10.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f1819a00640 1 --2- 172.21.15.5:0/2640242027 >> v2:172.21.15.117:3300/0 conn(0x7f181415f900 0x7f18140d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:10.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f1813e00640 1 -- 172.21.15.5:0/2640242027 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859031443 0 0) 0x7f181409b5f0 con 0x7f18140ce5d0 2024-08-18T22:20:10.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f1813e00640 1 -- 172.21.15.5:0/2640242027 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17fc003530 con 0x7f18140ce5d0 2024-08-18T22:20:10.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181a400640 1 -- 172.21.15.5:0/2640242027 >> v2:172.21.15.117:3300/0 conn(0x7f181415f900 msgr2=0x7f18140d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:10.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181a400640 1 --2- 172.21.15.5:0/2640242027 >> v2:172.21.15.117:3300/0 conn(0x7f181415f900 0x7f18140d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:10.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181a400640 1 -- 172.21.15.5:0/2640242027 >> v1:172.21.15.5:6789/0 conn(0x7f18140ce5d0 legacy=0x7f18140ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:10.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f1813e00640 1 -- 172.21.15.5:0/2640242027 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1285961357 0 0) 0x7f17fc003530 con 0x7f18140ce5d0 2024-08-18T22:20:10.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f181a400640 1 -- 172.21.15.5:0/2640242027 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1814071d70 con 0x7f1814070e50 2024-08-18T22:20:10.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.166+0000 7f1819a00640 1 --2- 172.21.15.5:0/2640242027 >> v2:172.21.15.117:3300/0 conn(0x7f181415f900 0x7f18140d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:20:10.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.170+0000 7f181a400640 1 --2- 172.21.15.5:0/2640242027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 0x7f18140d06c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f180c009dc0 tx=0x7f180c01f060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b2dd3c96ea41ec server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.170+0000 7f1813e00640 1 -- 172.21.15.5:0/2640242027 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c0b5070 con 0x7f1814070e50 2024-08-18T22:20:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.170+0000 7f1813e00640 1 -- 172.21.15.5:0/2640242027 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f180c0a8bf0 con 0x7f1814070e50 2024-08-18T22:20:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.170+0000 7f1813e00640 1 -- 172.21.15.5:0/2640242027 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800001680 con 0x7f1814070e50 2024-08-18T22:20:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.170+0000 7f181c400640 1 -- 172.21.15.5:0/2640242027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 msgr2=0x7f18140d06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.170+0000 7f181c400640 1 --2- 172.21.15.5:0/2640242027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 0x7f18140d06c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f180c009dc0 tx=0x7f180c01f060 comp rx=0 tx=0).stop 2024-08-18T22:20:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.170+0000 7f181c400640 1 -- 172.21.15.5:0/2640242027 shutdown_connections 2024-08-18T22:20:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.170+0000 7f181c400640 1 --2- 172.21.15.5:0/2640242027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 0x7f18140d06c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.170+0000 7f181c400640 1 --2- 172.21.15.5:0/2640242027 >> v2:172.21.15.117:3300/0 conn(0x7f181415f900 0x7f18140d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.170+0000 7f181c400640 1 -- 172.21.15.5:0/2640242027 >> 172.21.15.5:0/2640242027 conn(0x7f18140d2110 msgr2=0x7f18140d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181c400640 1 -- 172.21.15.5:0/2640242027 shutdown_connections 2024-08-18T22:20:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181c400640 1 -- 172.21.15.5:0/2640242027 wait complete. 2024-08-18T22:20:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181c400640 1 Processor -- start 2024-08-18T22:20:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181c400640 1 -- start start 2024-08-18T22:20:10.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181c400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 0x7f18141f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181c400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18140ce5d0 0x7f18140ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181c400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181415f900 0x7f18140b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181c400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18140cca80 con 0x7f18140ce5d0 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181c400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18140cc900 con 0x7f181415f900 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181c400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18140cd630 con 0x7f1814070e50 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f1819000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18140ce5d0 0x7f18140ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f1819000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18140ce5d0 0x7f18140ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45688/0 (socket says 172.21.15.5:45688) 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f1819000640 1 -- 172.21.15.5:0/466834287 learned_addr learned my addr 172.21.15.5:0/466834287 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f1819000640 1 -- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 msgr2=0x7f18141f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181a400640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181415f900 0x7f18140b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f1819a00640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 0x7f18141f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f1819000640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 0x7f18141f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f1819000640 1 -- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181415f900 msgr2=0x7f18140b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f1819000640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181415f900 0x7f18140b6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f1819000640 1 -- 172.21.15.5:0/466834287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18140cbb90 con 0x7f18140ce5d0 2024-08-18T22:20:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f181a400640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181415f900 0x7f18140b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f1819a00640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 0x7f18141f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.174+0000 7f1819000640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18140ce5d0 0x7f18140ca8a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18000011f0 tx=0x7f180000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.178+0000 7f1811600640 1 -- 172.21.15.5:0/466834287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800017070 con 0x7f18140ce5d0 2024-08-18T22:20:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.178+0000 7f1811600640 1 -- 172.21.15.5:0/466834287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1800005ae0 con 0x7f18140ce5d0 2024-08-18T22:20:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.178+0000 7f181c400640 1 -- 172.21.15.5:0/466834287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18140c7180 con 0x7f18140ce5d0 2024-08-18T22:20:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.178+0000 7f1811600640 1 -- 172.21.15.5:0/466834287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800007070 con 0x7f18140ce5d0 2024-08-18T22:20:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.178+0000 7f181c400640 1 -- 172.21.15.5:0/466834287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18140c7740 con 0x7f18140ce5d0 2024-08-18T22:20:10.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.178+0000 7f181c400640 1 -- 172.21.15.5:0/466834287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18140ccf20 con 0x7f18140ce5d0 2024-08-18T22:20:10.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.178+0000 7f1811600640 1 -- 172.21.15.5:0/466834287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f180001a070 con 0x7f18140ce5d0 2024-08-18T22:20:10.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.178+0000 7f1811600640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17f40678c0 0x7f17f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:10.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.178+0000 7f1811600640 1 -- 172.21.15.5:0/466834287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6412+0+0 (secure 0 0 0) 0x7f18000855b0 con 0x7f18140ce5d0 2024-08-18T22:20:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.178+0000 7f1819a00640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17f40678c0 0x7f17f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:10.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.182+0000 7f1819a00640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17f40678c0 0x7f17f4069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f18140b6e10 tx=0x7f1808008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:10.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.182+0000 7f1811600640 1 -- 172.21.15.5:0/466834287 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1800055d10 con 0x7f18140ce5d0 2024-08-18T22:20:10.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.350+0000 7f181c400640 1 -- 172.21.15.5:0/466834287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f181415e290 con 0x7f18140ce5d0 2024-08-18T22:20:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f1811600640 1 -- 172.21.15.5:0/466834287 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f1800055610 con 0x7f18140ce5d0 2024-08-18T22:20:10.998 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:20:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 -- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17f40678c0 msgr2=0x7f17f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17f40678c0 0x7f17f4069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f18140b6e10 tx=0x7f1808008040 comp rx=0 tx=0).stop 2024-08-18T22:20:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 -- 172.21.15.5:0/466834287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18140ce5d0 msgr2=0x7f18140ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18140ce5d0 0x7f18140ca8a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18000011f0 tx=0x7f180000cbe0 comp rx=0 tx=0).stop 2024-08-18T22:20:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 -- 172.21.15.5:0/466834287 shutdown_connections 2024-08-18T22:20:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17f40678c0 0x7f17f4069d80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181415f900 0x7f18140b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18140ce5d0 0x7f18140ca8a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 --2- 172.21.15.5:0/466834287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1814070e50 0x7f18141f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 -- 172.21.15.5:0/466834287 >> 172.21.15.5:0/466834287 conn(0x7f18140d2110 msgr2=0x7f18140cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 -- 172.21.15.5:0/466834287 shutdown_connections 2024-08-18T22:20:11.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:10.998+0000 7f181c400640 1 -- 172.21.15.5:0/466834287 wait complete. 2024-08-18T22:20:11.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-08-18T22:20:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.169+0000 7f1f57e00640 1 Processor -- start 2024-08-18T22:20:11.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.169+0000 7f1f57e00640 1 -- start start 2024-08-18T22:20:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.169+0000 7f1f57e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f500cf020 0x7f1f500cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.169+0000 7f1f57e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1f50072e80 0x7f1f5006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.169+0000 7f1f57e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f500cf940 con 0x7f1f50072a20 2024-08-18T22:20:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.169+0000 7f1f57e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1f500b4c30 con 0x7f1f50072e80 2024-08-18T22:20:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.169+0000 7f1f57e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f50073330 con 0x7f1f500cf020 2024-08-18T22:20:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.169+0000 7f1f55400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f500cf020 0x7f1f500cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.169+0000 7f1f55400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f500cf020 0x7f1f500cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:45826/0 (socket says 172.21.15.5:45826) 2024-08-18T22:20:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.169+0000 7f1f55400640 1 -- 172.21.15.5:0/1714398713 learned_addr learned my addr 172.21.15.5:0/1714398713 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.169+0000 7f1f55e00640 1 --2- 172.21.15.5:0/1714398713 >> v2:172.21.15.117:3300/0 conn(0x7f1f50072e80 0x7f1f5006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.173+0000 7f1f55400640 1 -- 172.21.15.5:0/1714398713 >> v2:172.21.15.117:3300/0 conn(0x7f1f50072e80 msgr2=0x7f1f5006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.173+0000 7f1f55400640 1 --2- 172.21.15.5:0/1714398713 >> v2:172.21.15.117:3300/0 conn(0x7f1f50072e80 0x7f1f5006f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.173+0000 7f1f55400640 1 -- 172.21.15.5:0/1714398713 >> v1:172.21.15.117:6789/0 conn(0x7f1f50072a20 legacy=0x7f1f5006ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.173+0000 7f1f55400640 1 -- 172.21.15.5:0/1714398713 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f500735e0 con 0x7f1f500cf020 2024-08-18T22:20:11.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.173+0000 7f1f4fe00640 1 -- 172.21.15.5:0/1714398713 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 558314371 0 0) 0x7f1f500cf940 con 0x7f1f50072a20 2024-08-18T22:20:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.173+0000 7f1f55400640 1 --2- 172.21.15.5:0/1714398713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f500cf020 0x7f1f500cf400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009870 tx=0x7f1f4401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3a38ffedffa864a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.173+0000 7f1f4fe00640 1 -- 172.21.15.5:0/1714398713 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f440a95f0 con 0x7f1f500cf020 2024-08-18T22:20:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.173+0000 7f1f4fe00640 1 -- 172.21.15.5:0/1714398713 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f440a9790 con 0x7f1f500cf020 2024-08-18T22:20:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.173+0000 7f1f4fe00640 1 -- 172.21.15.5:0/1714398713 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f440a9b60 con 0x7f1f500cf020 2024-08-18T22:20:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.173+0000 7f1f57e00640 1 -- 172.21.15.5:0/1714398713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f500cf020 msgr2=0x7f1f500cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.173+0000 7f1f57e00640 1 --2- 172.21.15.5:0/1714398713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f500cf020 0x7f1f500cf400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009870 tx=0x7f1f4401c530 comp rx=0 tx=0).stop 2024-08-18T22:20:11.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 -- 172.21.15.5:0/1714398713 shutdown_connections 2024-08-18T22:20:11.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 --2- 172.21.15.5:0/1714398713 >> v2:172.21.15.117:3300/0 conn(0x7f1f50072e80 0x7f1f5006f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:11.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 --2- 172.21.15.5:0/1714398713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f500cf020 0x7f1f500cf400 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:11.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 -- 172.21.15.5:0/1714398713 >> 172.21.15.5:0/1714398713 conn(0x7f1f5006b9b0 msgr2=0x7f1f5006bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:11.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 -- 172.21.15.5:0/1714398713 shutdown_connections 2024-08-18T22:20:11.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 -- 172.21.15.5:0/1714398713 wait complete. 2024-08-18T22:20:11.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 Processor -- start 2024-08-18T22:20:11.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 -- start start 2024-08-18T22:20:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f50072a20 0x7f1f50153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50072e80 0x7f1f5009d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f500cf020 0x7f1f50148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5006e3e0 con 0x7f1f500cf020 2024-08-18T22:20:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f50073e80 con 0x7f1f50072e80 2024-08-18T22:20:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f57e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f501558e0 con 0x7f1f50072a20 2024-08-18T22:20:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f55e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f500cf020 0x7f1f50148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f55e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f500cf020 0x7f1f50148460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45696/0 (socket says 172.21.15.5:45696) 2024-08-18T22:20:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f55e00640 1 -- 172.21.15.5:0/2997682423 learned_addr learned my addr 172.21.15.5:0/2997682423 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f55400640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f50072a20 0x7f1f50153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f54a00640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50072e80 0x7f1f5009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f55e00640 1 -- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f50072a20 msgr2=0x7f1f50153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f55e00640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f50072a20 0x7f1f50153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f55e00640 1 -- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50072e80 msgr2=0x7f1f5009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f55e00640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50072e80 0x7f1f5009d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f55e00640 1 -- 172.21.15.5:0/2997682423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5009dd60 con 0x7f1f500cf020 2024-08-18T22:20:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f54a00640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50072e80 0x7f1f5009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:11.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.177+0000 7f1f55e00640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f500cf020 0x7f1f50148460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800efc0 tx=0x7f1f4800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.181+0000 7f1f4d600640 1 -- 172.21.15.5:0/2997682423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48018020 con 0x7f1f500cf020 2024-08-18T22:20:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.181+0000 7f1f4d600640 1 -- 172.21.15.5:0/2997682423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f48014480 con 0x7f1f500cf020 2024-08-18T22:20:11.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.181+0000 7f1f57e00640 1 -- 172.21.15.5:0/2997682423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f50152d90 con 0x7f1f500cf020 2024-08-18T22:20:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.181+0000 7f1f4d600640 1 -- 172.21.15.5:0/2997682423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48014870 con 0x7f1f500cf020 2024-08-18T22:20:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.181+0000 7f1f57e00640 1 -- 172.21.15.5:0/2997682423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f50153350 con 0x7f1f500cf020 2024-08-18T22:20:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.181+0000 7f1f57e00640 1 -- 172.21.15.5:0/2997682423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5015c760 con 0x7f1f500cf020 2024-08-18T22:20:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.181+0000 7f1f4d600640 1 -- 172.21.15.5:0/2997682423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f4801b020 con 0x7f1f500cf020 2024-08-18T22:20:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.181+0000 7f1f4d600640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 0x7f1f30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.181+0000 7f1f4d600640 1 -- 172.21.15.5:0/2997682423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7f1f48086a80 con 0x7f1f500cf020 2024-08-18T22:20:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.181+0000 7f1f55400640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 0x7f1f30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:11.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.185+0000 7f1f55400640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 0x7f1f30069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f440ae000 tx=0x7f1f440a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:11.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.185+0000 7f1f4d600640 1 -- 172.21.15.5:0/2997682423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1f48022030 con 0x7f1f500cf020 2024-08-18T22:20:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:11.353+0000 7f1f57e00640 1 -- 172.21.15.5:0/2997682423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1f500cf650 con 0x7f1f500cf020 2024-08-18T22:20:12.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.001+0000 7f1f4d600640 1 -- 172.21.15.5:0/2997682423 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f1f5009dd60 con 0x7f1f500cf020 2024-08-18T22:20:12.005 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' removed 2024-08-18T22:20:12.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 -- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 msgr2=0x7f1f30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:12.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 0x7f1f30069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f440ae000 tx=0x7f1f440a7000 comp rx=0 tx=0).stop 2024-08-18T22:20:12.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 -- 172.21.15.5:0/2997682423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f500cf020 msgr2=0x7f1f50148460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:12.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f500cf020 0x7f1f50148460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800efc0 tx=0x7f1f4800c490 comp rx=0 tx=0).stop 2024-08-18T22:20:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 -- 172.21.15.5:0/2997682423 shutdown_connections 2024-08-18T22:20:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 0x7f1f30069d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f500cf020 0x7f1f50148460 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50072e80 0x7f1f5009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 --2- 172.21.15.5:0/2997682423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f50072a20 0x7f1f50153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 -- 172.21.15.5:0/2997682423 >> 172.21.15.5:0/2997682423 conn(0x7f1f5006b9b0 msgr2=0x7f1f500afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 -- 172.21.15.5:0/2997682423 shutdown_connections 2024-08-18T22:20:12.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.005+0000 7f1f57e00640 1 -- 172.21.15.5:0/2997682423 wait complete. 2024-08-18T22:20:12.033 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:20:12.033 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:20:12.033 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:20:12.033 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:20:12.033 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:20:12.033 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:20:12.034 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:20:12.034 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:20:12.034 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:20:12.034 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:20:12.034 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:20:12.034 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:20:12.034 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:20:12.035 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:20:12.035 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:20:12.035 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:20:12.055 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:20:12.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:20:12.056 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:20:12.057 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:20:12.058 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:20:12.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:20:12.063 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:20:12.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:20:12.101 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:20:12.102 DEBUG:teuthology.parallel:result is None 2024-08-18T22:20:12.103 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:20:12.104 DEBUG:teuthology.parallel:result is None 2024-08-18T22:20:12.111 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:20:12.111 DEBUG:teuthology.parallel:result is None 2024-08-18T22:20:12.113 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:20:12.113 DEBUG:teuthology.parallel:result is None 2024-08-18T22:20:12.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:20:12.190 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:20:12.190 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:20:12.199 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:20:12.199 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:20:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.257+0000 7feb6ac00640 1 Processor -- start 2024-08-18T22:20:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.257+0000 7feb6ac00640 1 -- start start 2024-08-18T22:20:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb6ac00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb640b40c0 0x7feb640b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb6ac00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb640ce280 0x7feb640ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb6ac00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb640b31f0 con 0x7feb6415b0c0 2024-08-18T22:20:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb6ac00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7feb640b4a70 con 0x7feb640b40c0 2024-08-18T22:20:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb6ac00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb640b3d70 con 0x7feb640ce280 2024-08-18T22:20:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb63e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feb6415b0c0 0x7feb6406db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48996/0 (socket says 172.21.15.5:48996) 2024-08-18T22:20:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb63400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb640b40c0 0x7feb640b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb63e00640 1 -- 172.21.15.5:0/2851204046 learned_addr learned my addr 172.21.15.5:0/2851204046 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb68c00640 1 --2- 172.21.15.5:0/2851204046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb640ce280 0x7feb640ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb62a00640 1 -- 172.21.15.5:0/2851204046 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293260190 0 0) 0x7feb640b31f0 con 0x7feb6415b0c0 2024-08-18T22:20:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb62a00640 1 -- 172.21.15.5:0/2851204046 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb48003530 con 0x7feb6415b0c0 2024-08-18T22:20:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb63400640 1 -- 172.21.15.5:0/2851204046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb640ce280 msgr2=0x7feb640ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb63400640 1 --2- 172.21.15.5:0/2851204046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb640ce280 0x7feb640ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb63400640 1 -- 172.21.15.5:0/2851204046 >> v1:172.21.15.5:6789/0 conn(0x7feb6415b0c0 legacy=0x7feb6406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb63400640 1 -- 172.21.15.5:0/2851204046 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb640b34d0 con 0x7feb640b40c0 2024-08-18T22:20:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.261+0000 7feb63400640 1 --2- 172.21.15.5:0/2851204046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb640b40c0 0x7feb640b4530 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feb500097c0 tx=0x7feb5001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481cada385262c54 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb62a00640 1 -- 172.21.15.5:0/2851204046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500b0070 con 0x7feb640b40c0 2024-08-18T22:20:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb62a00640 1 -- 172.21.15.5:0/2851204046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb500ab600 con 0x7feb640b40c0 2024-08-18T22:20:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb62a00640 1 -- 172.21.15.5:0/2851204046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500ab9b0 con 0x7feb640b40c0 2024-08-18T22:20:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 -- 172.21.15.5:0/2851204046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb640b40c0 msgr2=0x7feb640b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 --2- 172.21.15.5:0/2851204046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb640b40c0 0x7feb640b4530 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feb500097c0 tx=0x7feb5001c380 comp rx=0 tx=0).stop 2024-08-18T22:20:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 -- 172.21.15.5:0/2851204046 shutdown_connections 2024-08-18T22:20:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 --2- 172.21.15.5:0/2851204046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb640ce280 0x7feb640ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 --2- 172.21.15.5:0/2851204046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb640b40c0 0x7feb640b4530 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 -- 172.21.15.5:0/2851204046 >> 172.21.15.5:0/2851204046 conn(0x7feb640b1dc0 msgr2=0x7feb640b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 -- 172.21.15.5:0/2851204046 shutdown_connections 2024-08-18T22:20:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 -- 172.21.15.5:0/2851204046 wait complete. 2024-08-18T22:20:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 Processor -- start 2024-08-18T22:20:12.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 -- start start 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb640b40c0 0x7feb64147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb640ce280 0x7feb6414d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb6415b0c0 0x7feb6414d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb6406f7f0 con 0x7feb640ce280 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feb6406f670 con 0x7feb640b40c0 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb6ac00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb64167d10 con 0x7feb6415b0c0 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb63400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb640ce280 0x7feb6414d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb63400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb640ce280 0x7feb6414d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45746/0 (socket says 172.21.15.5:45746) 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb63400640 1 -- 172.21.15.5:0/1191416151 learned_addr learned my addr 172.21.15.5:0/1191416151 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb63e00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb640b40c0 0x7feb64147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.265+0000 7feb68c00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb6415b0c0 0x7feb6414d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:12.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb63400640 1 -- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb6415b0c0 msgr2=0x7feb6414d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb63400640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb6415b0c0 0x7feb6414d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb63400640 1 -- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb640b40c0 msgr2=0x7feb64147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb63400640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb640b40c0 0x7feb64147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb63400640 1 -- 172.21.15.5:0/1191416151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6415d550 con 0x7feb640ce280 2024-08-18T22:20:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb63e00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb640b40c0 0x7feb64147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb68c00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb6415b0c0 0x7feb6414d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:12.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb63400640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb640ce280 0x7feb6414d340 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb500ae040 tx=0x7feb50019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb5be00640 1 -- 172.21.15.5:0/1191416151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500b0040 con 0x7feb640ce280 2024-08-18T22:20:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb5be00640 1 -- 172.21.15.5:0/1191416151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb500b9070 con 0x7feb640ce280 2024-08-18T22:20:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb5be00640 1 -- 172.21.15.5:0/1191416151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500b4630 con 0x7feb640ce280 2024-08-18T22:20:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb6ac00640 1 -- 172.21.15.5:0/1191416151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6415d830 con 0x7feb640ce280 2024-08-18T22:20:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb6ac00640 1 -- 172.21.15.5:0/1191416151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6415ddf0 con 0x7feb640ce280 2024-08-18T22:20:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb6ac00640 1 -- 172.21.15.5:0/1191416151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb640b4530 con 0x7feb640ce280 2024-08-18T22:20:12.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb5be00640 1 -- 172.21.15.5:0/1191416151 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb500b47d0 con 0x7feb640ce280 2024-08-18T22:20:12.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb5be00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb440678c0 0x7feb44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:12.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb5be00640 1 -- 172.21.15.5:0/1191416151 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7feb5011f900 con 0x7feb640ce280 2024-08-18T22:20:12.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.269+0000 7feb63e00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb440678c0 0x7feb44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:12.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.273+0000 7feb63e00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb440678c0 0x7feb44069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb54005890 tx=0x7feb54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.277+0000 7feb5be00640 1 -- 172.21.15.5:0/1191416151 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7feb50016090 con 0x7feb640ce280 2024-08-18T22:20:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:12.453+0000 7feb6ac00640 1 -- 172.21.15.5:0/1191416151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7feb64151640 con 0x7feb640ce280 2024-08-18T22:20:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb5be00640 1 -- 172.21.15.5:0/1191416151 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7feb500f0510 con 0x7feb640ce280 2024-08-18T22:20:13.022 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:20:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 -- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb440678c0 msgr2=0x7feb44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb440678c0 0x7feb44069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb54005890 tx=0x7feb54009040 comp rx=0 tx=0).stop 2024-08-18T22:20:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 -- 172.21.15.5:0/1191416151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb640ce280 msgr2=0x7feb6414d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb640ce280 0x7feb6414d340 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb500ae040 tx=0x7feb50019120 comp rx=0 tx=0).stop 2024-08-18T22:20:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 -- 172.21.15.5:0/1191416151 shutdown_connections 2024-08-18T22:20:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb440678c0 0x7feb44069d80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb6415b0c0 0x7feb6414d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb640ce280 0x7feb6414d340 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 --2- 172.21.15.5:0/1191416151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb640b40c0 0x7feb64147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 -- 172.21.15.5:0/1191416151 >> 172.21.15.5:0/1191416151 conn(0x7feb640b1dc0 msgr2=0x7feb6406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 -- 172.21.15.5:0/1191416151 shutdown_connections 2024-08-18T22:20:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.021+0000 7feb6ac00640 1 -- 172.21.15.5:0/1191416151 wait complete. 2024-08-18T22:20:13.050 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:20:13.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f5e00640 1 Processor -- start 2024-08-18T22:20:13.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f5e00640 1 -- start start 2024-08-18T22:20:13.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01f015b010 0x7f01f00c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f006f020 0x7f01f00c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f5e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f015f820 con 0x7f01f0068a70 2024-08-18T22:20:13.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f5e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f01f00afbb0 con 0x7f01f015b010 2024-08-18T22:20:13.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f5e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01f00cda90 con 0x7f01f006f020 2024-08-18T22:20:13.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f4a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01f015b010 0x7f01f00c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01e7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f01f0068a70 0x7f01f0073080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49000/0 (socket says 172.21.15.5:49000) 2024-08-18T22:20:13.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01e7e00640 1 -- 172.21.15.5:0/2635119403 learned_addr learned my addr 172.21.15.5:0/2635119403 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:13.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f5400640 1 --2- 172.21.15.5:0/2635119403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f006f020 0x7f01f00c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f4a00640 1 -- 172.21.15.5:0/2635119403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f006f020 msgr2=0x7f01f00c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:13.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f4a00640 1 --2- 172.21.15.5:0/2635119403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f006f020 0x7f01f00c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f4a00640 1 -- 172.21.15.5:0/2635119403 >> v1:172.21.15.5:6789/0 conn(0x7f01f0068a70 legacy=0x7f01f0073080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.197+0000 7f01f4a00640 1 -- 172.21.15.5:0/2635119403 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f015fb50 con 0x7f01f015b010 2024-08-18T22:20:13.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01f4a00640 1 --2- 172.21.15.5:0/2635119403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01f015b010 0x7f01f00c6140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f01f00cdc10 tx=0x7f01e001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d6d37e0c5351d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:13.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01efe00640 1 -- 172.21.15.5:0/2635119403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e00aa5f0 con 0x7f01f015b010 2024-08-18T22:20:13.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01efe00640 1 -- 172.21.15.5:0/2635119403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e00af070 con 0x7f01f015b010 2024-08-18T22:20:13.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01efe00640 1 -- 172.21.15.5:0/2635119403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e00aa9b0 con 0x7f01f015b010 2024-08-18T22:20:13.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01f5e00640 1 -- 172.21.15.5:0/2635119403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01f015b010 msgr2=0x7f01f00c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01f5e00640 1 --2- 172.21.15.5:0/2635119403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01f015b010 0x7f01f00c6140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f01f00cdc10 tx=0x7f01e001c470 comp rx=0 tx=0).stop 2024-08-18T22:20:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01f5e00640 1 -- 172.21.15.5:0/2635119403 shutdown_connections 2024-08-18T22:20:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01f5e00640 1 --2- 172.21.15.5:0/2635119403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f006f020 0x7f01f00c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01f5e00640 1 --2- 172.21.15.5:0/2635119403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01f015b010 0x7f01f00c6140 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01f5e00640 1 -- 172.21.15.5:0/2635119403 >> 172.21.15.5:0/2635119403 conn(0x7f01f00ccbf0 msgr2=0x7f01f00cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01f5e00640 1 -- 172.21.15.5:0/2635119403 shutdown_connections 2024-08-18T22:20:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01f5e00640 1 -- 172.21.15.5:0/2635119403 wait complete. 2024-08-18T22:20:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01f5e00640 1 Processor -- start 2024-08-18T22:20:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.201+0000 7f01f5e00640 1 -- start start 2024-08-18T22:20:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01f5e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f0068a70 0x7f01f00b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01f006f020 0x7f01f014b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01f5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f015b010 0x7f01f00cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01f5e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0168130 con 0x7f01f006f020 2024-08-18T22:20:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01f5e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0167fb0 con 0x7f01f0068a70 2024-08-18T22:20:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01f5e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01f01682b0 con 0x7f01f015b010 2024-08-18T22:20:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01e7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01f006f020 0x7f01f014b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01e7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01f006f020 0x7f01f014b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45762/0 (socket says 172.21.15.5:45762) 2024-08-18T22:20:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01e7e00640 1 -- 172.21.15.5:0/2656354289 learned_addr learned my addr 172.21.15.5:0/2656354289 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:13.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01f4a00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f0068a70 0x7f01f00b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01f5400640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f015b010 0x7f01f00cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01e7e00640 1 -- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f015b010 msgr2=0x7f01f00cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01e7e00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f015b010 0x7f01f00cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01e7e00640 1 -- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f0068a70 msgr2=0x7f01f00b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01e7e00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f0068a70 0x7f01f00b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01e7e00640 1 -- 172.21.15.5:0/2656354289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f014c130 con 0x7f01f006f020 2024-08-18T22:20:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01e7e00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01f006f020 0x7f01f014b940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c420 tx=0x7f01d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01ed600640 1 -- 172.21.15.5:0/2656354289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8017070 con 0x7f01f006f020 2024-08-18T22:20:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01ed600640 1 -- 172.21.15.5:0/2656354289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d8005cf0 con 0x7f01f006f020 2024-08-18T22:20:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01ed600640 1 -- 172.21.15.5:0/2656354289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d80072f0 con 0x7f01f006f020 2024-08-18T22:20:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01f5e00640 1 -- 172.21.15.5:0/2656354289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f00b1af0 con 0x7f01f006f020 2024-08-18T22:20:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01f5e00640 1 -- 172.21.15.5:0/2656354289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f00b20b0 con 0x7f01f006f020 2024-08-18T22:20:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01f5e00640 1 -- 172.21.15.5:0/2656354289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f0073080 con 0x7f01f006f020 2024-08-18T22:20:13.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.205+0000 7f01ed600640 1 -- 172.21.15.5:0/2656354289 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f01d801a070 con 0x7f01f006f020 2024-08-18T22:20:13.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.209+0000 7f01ed600640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01cc0678c0 0x7f01cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.209+0000 7f01ed600640 1 -- 172.21.15.5:0/2656354289 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f01d8084e90 con 0x7f01f006f020 2024-08-18T22:20:13.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.209+0000 7f01f4a00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01cc0678c0 0x7f01cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.209+0000 7f01f4a00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01cc0678c0 0x7f01cc069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01e00ae000 tx=0x7f01e00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:13.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.213+0000 7f01ed600640 1 -- 172.21.15.5:0/2656354289 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f01d80554a0 con 0x7f01f006f020 2024-08-18T22:20:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.433+0000 7f01f5e00640 1 -- 172.21.15.5:0/2656354289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f01f00b3600 con 0x7f01f006f020 2024-08-18T22:20:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01ed600640 1 -- 172.21.15.5:0/2656354289 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f01d8086070 con 0x7f01f006f020 2024-08-18T22:20:13.438 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:13.438 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:20:13.438 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.439 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:20:13.440 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:20:13.440 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.440 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:20:13.440 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:20:13.440 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:20:13.440 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.440 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.440 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:20:13.440 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:20:13.441 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:20:13.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:20:13.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:20:13.441 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.441 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.441 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:20:13.441 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:20:13.441 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.442 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:20:13.442 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:20:13.442 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:20:13.442 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.442 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:20:13.442 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:20:13.442 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.442 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:20:13.443 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:20:13.443 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.443 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.443 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:20:13.443 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:20:13.443 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.443 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:20:13.443 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:20:13.443 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.444 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.444 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:20:13.444 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:20:13.444 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.444 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:20:13.444 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:20:13.444 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.444 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:20:13.445 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:20:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:20:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:20:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:20:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:20:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.446 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:20:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:20:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:20:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:20:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:20:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:20:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:20:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:20:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:20:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:20:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:20:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:20:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:20:13.450 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:20:13.450 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.450 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:20:13.450 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:20:13.450 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:20:13.450 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:20:13.450 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.450 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:20:13.450 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.451 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:20:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:20:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:20:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:20:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:20:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:20:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:20:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mds", 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBQc8Jmxe/EHxAAzo9s1i8zM+O7LK6LpFGnOA==", 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mds" 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.454 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mgr", 2024-08-18T22:20:13.454 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBQc8JmRAHFHxAA7Cj3FAvqJbHIo0RfZgTwaw==", 2024-08-18T22:20:13.454 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.454 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-18T22:20:13.454 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.454 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-osd", 2024-08-18T22:20:13.454 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBQc8JmTxDFHxAAd2cTyI+nOQg4WFM3d4yLJA==", 2024-08-18T22:20:13.454 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.454 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-osd" 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd", 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBQc8JmHRzFHxAAiX+ZPDBorNunV6QuKGvAfw==", 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-18T22:20:13.455 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBQc8Jm2STFHxAAw8fkJDAnO3yFXE4fsBesww==", 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rgw", 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBQc8JmuC3FHxAA/gSDEtowLeUXyg3tjz/vTg==", 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:20:13.457 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:20:13.458 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:20:13.458 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:20:13.458 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:20:13.458 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.458 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:13.458 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:20:13.458 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:20:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 -- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01cc0678c0 msgr2=0x7f01cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01cc0678c0 0x7f01cc069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01e00ae000 tx=0x7f01e00a7000 comp rx=0 tx=0).stop 2024-08-18T22:20:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 -- 172.21.15.5:0/2656354289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01f006f020 msgr2=0x7f01f014b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01f006f020 0x7f01f014b940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c420 tx=0x7f01d800c8e0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 -- 172.21.15.5:0/2656354289 shutdown_connections 2024-08-18T22:20:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01cc0678c0 0x7f01cc069d80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01f015b010 0x7f01f00cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01f006f020 0x7f01f014b940 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 --2- 172.21.15.5:0/2656354289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f0068a70 0x7f01f00b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 -- 172.21.15.5:0/2656354289 >> 172.21.15.5:0/2656354289 conn(0x7f01f00ccbf0 msgr2=0x7f01f00ad0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:13.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 -- 172.21.15.5:0/2656354289 shutdown_connections 2024-08-18T22:20:13.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.437+0000 7f01f5e00640 1 -- 172.21.15.5:0/2656354289 wait complete. 2024-08-18T22:20:13.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-18T22:20:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaae800640 1 Processor -- start 2024-08-18T22:20:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaae800640 1 -- start start 2024-08-18T22:20:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaae800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faaa80b2c60 0x7faaa80b4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaae800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faaa80b5c60 0x7faaa80b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaae800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa8070990 con 0x7faaa806ebb0 2024-08-18T22:20:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaae800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faaa815f7c0 con 0x7faaa80b5c60 2024-08-18T22:20:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaae800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faaa815f610 con 0x7faaa80b2c60 2024-08-18T22:20:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaade00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faaa806ebb0 0x7faaa806f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43230/0 (socket says 172.21.15.5:43230) 2024-08-18T22:20:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaade00640 1 -- 172.21.15.5:0/752003349 learned_addr learned my addr 172.21.15.5:0/752003349 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaad400640 1 --2- 172.21.15.5:0/752003349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faaa80b2c60 0x7faaa80b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaaca00640 1 --2- 172.21.15.5:0/752003349 >> v2:172.21.15.117:3300/0 conn(0x7faaa80b5c60 0x7faaa80b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaa7e00640 1 -- 172.21.15.5:0/752003349 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3336420601 0 0) 0x7faaa0001120 con 0x7faaa806ebb0 2024-08-18T22:20:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaa7e00640 1 -- 172.21.15.5:0/752003349 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa90003530 con 0x7faaa806ebb0 2024-08-18T22:20:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaad400640 1 -- 172.21.15.5:0/752003349 >> v2:172.21.15.117:3300/0 conn(0x7faaa80b5c60 msgr2=0x7faaa80b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaad400640 1 --2- 172.21.15.5:0/752003349 >> v2:172.21.15.117:3300/0 conn(0x7faaa80b5c60 0x7faaa80b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaad400640 1 -- 172.21.15.5:0/752003349 >> v1:172.21.15.5:6789/0 conn(0x7faaa806ebb0 legacy=0x7faaa806f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.601+0000 7faaad400640 1 -- 172.21.15.5:0/752003349 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa80b3580 con 0x7faaa80b2c60 2024-08-18T22:20:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaad400640 1 --2- 172.21.15.5:0/752003349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faaa80b2c60 0x7faaa80b4390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009d90 tx=0x7faa9c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f3c1225e4a86b54 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaa7e00640 1 -- 172.21.15.5:0/752003349 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c0b2070 con 0x7faaa80b2c60 2024-08-18T22:20:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaa7e00640 1 -- 172.21.15.5:0/752003349 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c0a5920 con 0x7faaa80b2c60 2024-08-18T22:20:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaa7e00640 1 -- 172.21.15.5:0/752003349 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c0a5cd0 con 0x7faaa80b2c60 2024-08-18T22:20:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaae800640 1 -- 172.21.15.5:0/752003349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faaa80b2c60 msgr2=0x7faaa80b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaae800640 1 --2- 172.21.15.5:0/752003349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faaa80b2c60 0x7faaa80b4390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009d90 tx=0x7faa9c01c970 comp rx=0 tx=0).stop 2024-08-18T22:20:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaae800640 1 -- 172.21.15.5:0/752003349 shutdown_connections 2024-08-18T22:20:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaae800640 1 --2- 172.21.15.5:0/752003349 >> v2:172.21.15.117:3300/0 conn(0x7faaa80b5c60 0x7faaa80b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaae800640 1 --2- 172.21.15.5:0/752003349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faaa80b2c60 0x7faaa80b4390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaae800640 1 -- 172.21.15.5:0/752003349 >> 172.21.15.5:0/752003349 conn(0x7faaa806cac0 msgr2=0x7faaa806ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaae800640 1 -- 172.21.15.5:0/752003349 shutdown_connections 2024-08-18T22:20:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.605+0000 7faaae800640 1 -- 172.21.15.5:0/752003349 wait complete. 2024-08-18T22:20:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaae800640 1 Processor -- start 2024-08-18T22:20:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaae800640 1 -- start start 2024-08-18T22:20:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaae800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaa806ebb0 0x7faaa814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaae800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa80b2c60 0x7faaa814fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaae800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faaa80b5c60 0x7faaa8159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaae800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faaa806c230 con 0x7faaa80b2c60 2024-08-18T22:20:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaae800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faaa806bf50 con 0x7faaa806ebb0 2024-08-18T22:20:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaae800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faaa806c750 con 0x7faaa80b5c60 2024-08-18T22:20:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaaca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa80b2c60 0x7faaa814fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaaca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa80b2c60 0x7faaa814fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41360/0 (socket says 172.21.15.5:41360) 2024-08-18T22:20:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaaca00640 1 -- 172.21.15.5:0/3272017255 learned_addr learned my addr 172.21.15.5:0/3272017255 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaad400640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaa806ebb0 0x7faaa814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaade00640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faaa80b5c60 0x7faaa8159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaaca00640 1 -- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faaa80b5c60 msgr2=0x7faaa8159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaaca00640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faaa80b5c60 0x7faaa8159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaaca00640 1 -- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaa806ebb0 msgr2=0x7faaa814e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaaca00640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaa806ebb0 0x7faaa814e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaaca00640 1 -- 172.21.15.5:0/3272017255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa815a4f0 con 0x7faaa80b2c60 2024-08-18T22:20:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaaca00640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa80b2c60 0x7faaa814fc40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faa9400e930 tx=0x7faa9400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaa5600640 1 -- 172.21.15.5:0/3272017255 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94017070 con 0x7faaa80b2c60 2024-08-18T22:20:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaa5600640 1 -- 172.21.15.5:0/3272017255 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9400ca00 con 0x7faaa80b2c60 2024-08-18T22:20:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaa5600640 1 -- 172.21.15.5:0/3272017255 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9400cdd0 con 0x7faaa80b2c60 2024-08-18T22:20:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaae800640 1 -- 172.21.15.5:0/3272017255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa815a7d0 con 0x7faaa80b2c60 2024-08-18T22:20:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.609+0000 7faaae800640 1 -- 172.21.15.5:0/3272017255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa815ad90 con 0x7faaa80b2c60 2024-08-18T22:20:13.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.613+0000 7faaae800640 1 -- 172.21.15.5:0/3272017255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa80b6040 con 0x7faaa80b2c60 2024-08-18T22:20:13.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.613+0000 7faaa5600640 1 -- 172.21.15.5:0/3272017255 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa9401a070 con 0x7faaa80b2c60 2024-08-18T22:20:13.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.613+0000 7faaa5600640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa880678c0 0x7faa88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:13.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.613+0000 7faaa5600640 1 -- 172.21.15.5:0/3272017255 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7faa94085f10 con 0x7faaa80b2c60 2024-08-18T22:20:13.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.613+0000 7faaad400640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa880678c0 0x7faa88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:13.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.613+0000 7faaad400640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa880678c0 0x7faa88069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0af000 tx=0x7faa9c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:13.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.617+0000 7faaa5600640 1 -- 172.21.15.5:0/3272017255 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7faa94056560 con 0x7faaa80b2c60 2024-08-18T22:20:13.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.837+0000 7faaae800640 1 -- 172.21.15.5:0/3272017255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7faaa80b28a0 con 0x7faaa80b2c60 2024-08-18T22:20:13.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaa5600640 1 -- 172.21.15.5:0/3272017255 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7faa9405a860 con 0x7faaa80b2c60 2024-08-18T22:20:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 -- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa880678c0 msgr2=0x7faa88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa880678c0 0x7faa88069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0af000 tx=0x7faa9c0a7070 comp rx=0 tx=0).stop 2024-08-18T22:20:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 -- 172.21.15.5:0/3272017255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa80b2c60 msgr2=0x7faaa814fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa80b2c60 0x7faaa814fc40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faa9400e930 tx=0x7faa9400edf0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 -- 172.21.15.5:0/3272017255 shutdown_connections 2024-08-18T22:20:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa880678c0 0x7faa88069d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faaa80b5c60 0x7faaa8159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa80b2c60 0x7faaa814fc40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 --2- 172.21.15.5:0/3272017255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaa806ebb0 0x7faaa814e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 -- 172.21.15.5:0/3272017255 >> 172.21.15.5:0/3272017255 conn(0x7faaa806cac0 msgr2=0x7faaa815f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 -- 172.21.15.5:0/3272017255 shutdown_connections 2024-08-18T22:20:13.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:13.841+0000 7faaae800640 1 -- 172.21.15.5:0/3272017255 wait complete. 2024-08-18T22:20:13.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-18T22:20:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f69a0c00640 1 Processor -- start 2024-08-18T22:20:14.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f69a0c00640 1 -- start start 2024-08-18T22:20:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f69a0c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f699c0d15e0 0x7f699c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f69a0c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f699c0d30b0 con 0x7f699c15fb80 2024-08-18T22:20:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f69a0c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f699c0d1bd0 con 0x7f699c0d1090 2024-08-18T22:20:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f69a0c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f699c071c60 con 0x7f699c0d15e0 2024-08-18T22:20:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f6999e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f699c15fb80 0x7f699c06fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43244/0 (socket says 172.21.15.5:43244) 2024-08-18T22:20:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f6999e00640 1 -- 172.21.15.5:0/2170872409 learned_addr learned my addr 172.21.15.5:0/2170872409 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:14.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f699a800640 1 --2- 172.21.15.5:0/2170872409 >> v2:172.21.15.5:3300/0 conn(0x7f699c0d15e0 0x7f699c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f6999400640 1 -- 172.21.15.5:0/2170872409 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482774249 0 0) 0x7f699c0d30b0 con 0x7f699c15fb80 2024-08-18T22:20:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f6999400640 1 -- 172.21.15.5:0/2170872409 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6980003530 con 0x7f699c15fb80 2024-08-18T22:20:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f699a800640 1 -- 172.21.15.5:0/2170872409 >> v1:172.21.15.117:6789/0 conn(0x7f699c0d1090 legacy=0x7f699c071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f699a800640 1 -- 172.21.15.5:0/2170872409 >> v1:172.21.15.5:6789/0 conn(0x7f699c15fb80 legacy=0x7f699c06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.005+0000 7f699a800640 1 -- 172.21.15.5:0/2170872409 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c0d2dd0 con 0x7f699c0d15e0 2024-08-18T22:20:14.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f699a800640 1 --2- 172.21.15.5:0/2170872409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f699c0d15e0 0x7f699c0b5ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6994009d90 tx=0x7f699401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bbe4e4fa7307be server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f6999400640 1 -- 172.21.15.5:0/2170872409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69940b2070 con 0x7f699c0d15e0 2024-08-18T22:20:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f6999400640 1 -- 172.21.15.5:0/2170872409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69940a5710 con 0x7f699c0d15e0 2024-08-18T22:20:14.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f6999400640 1 -- 172.21.15.5:0/2170872409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69940a5ae0 con 0x7f699c0d15e0 2024-08-18T22:20:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f69a0c00640 1 -- 172.21.15.5:0/2170872409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f699c0d15e0 msgr2=0x7f699c0b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f69a0c00640 1 --2- 172.21.15.5:0/2170872409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f699c0d15e0 0x7f699c0b5ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6994009d90 tx=0x7f699401c850 comp rx=0 tx=0).stop 2024-08-18T22:20:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f69a0c00640 1 -- 172.21.15.5:0/2170872409 shutdown_connections 2024-08-18T22:20:14.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f69a0c00640 1 --2- 172.21.15.5:0/2170872409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f699c0d15e0 0x7f699c0b5ad0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f69a0c00640 1 -- 172.21.15.5:0/2170872409 >> 172.21.15.5:0/2170872409 conn(0x7f699c0d2180 msgr2=0x7f699c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f69a0c00640 1 -- 172.21.15.5:0/2170872409 shutdown_connections 2024-08-18T22:20:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f69a0c00640 1 -- 172.21.15.5:0/2170872409 wait complete. 2024-08-18T22:20:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.009+0000 7f69a0c00640 1 Processor -- start 2024-08-18T22:20:14.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f69a0c00640 1 -- start start 2024-08-18T22:20:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f69a0c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f699c0d1090 0x7f699c0cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f69a0c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f699c0d15e0 0x7f699c0b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f69a0c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f699c15fb80 0x7f699c14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f69a0c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f699c16a310 con 0x7f699c0d15e0 2024-08-18T22:20:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f69a0c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f699c0d1eb0 con 0x7f699c15fb80 2024-08-18T22:20:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f69a0c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f699c16a490 con 0x7f699c0d1090 2024-08-18T22:20:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6993e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f699c0d15e0 0x7f699c0b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6993e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f699c0d15e0 0x7f699c0b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41374/0 (socket says 172.21.15.5:41374) 2024-08-18T22:20:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6993e00640 1 -- 172.21.15.5:0/3249402649 learned_addr learned my addr 172.21.15.5:0/3249402649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f699a800640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f699c15fb80 0x7f699c14c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6999e00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f699c0d1090 0x7f699c0cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6993e00640 1 -- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f699c0d1090 msgr2=0x7f699c0cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6993e00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f699c0d1090 0x7f699c0cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6993e00640 1 -- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f699c15fb80 msgr2=0x7f699c14c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6993e00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f699c15fb80 0x7f699c14c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6993e00640 1 -- 172.21.15.5:0/3249402649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c14f2c0 con 0x7f699c0d15e0 2024-08-18T22:20:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6999e00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f699c0d1090 0x7f699c0cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6993e00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f699c0d15e0 0x7f699c0b69e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f698400c450 tx=0x7f698400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6992000640 1 -- 172.21.15.5:0/3249402649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984016020 con 0x7f699c0d15e0 2024-08-18T22:20:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6992000640 1 -- 172.21.15.5:0/3249402649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69840052d0 con 0x7f699c0d15e0 2024-08-18T22:20:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f6992000640 1 -- 172.21.15.5:0/3249402649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984007260 con 0x7f699c0d15e0 2024-08-18T22:20:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f69a0c00640 1 -- 172.21.15.5:0/3249402649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699c14f5a0 con 0x7f699c0d15e0 2024-08-18T22:20:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f69a0c00640 1 -- 172.21.15.5:0/3249402649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699c15d510 con 0x7f699c0d15e0 2024-08-18T22:20:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.013+0000 7f69a0c00640 1 -- 172.21.15.5:0/3249402649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f699c15d8f0 con 0x7f699c0d15e0 2024-08-18T22:20:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.017+0000 7f6992000640 1 -- 172.21.15.5:0/3249402649 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6984007400 con 0x7f699c0d15e0 2024-08-18T22:20:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.017+0000 7f6992000640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69780678c0 0x7f6978069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.017+0000 7f6992000640 1 -- 172.21.15.5:0/3249402649 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f6984085490 con 0x7f699c0d15e0 2024-08-18T22:20:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.017+0000 7f6999e00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69780678c0 0x7f6978069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.017+0000 7f6999e00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69780678c0 0x7f6978069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f698c0011f0 tx=0x7f698c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.021+0000 7f6992000640 1 -- 172.21.15.5:0/3249402649 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6984020020 con 0x7f699c0d15e0 2024-08-18T22:20:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.249+0000 7f69a0c00640 1 -- 172.21.15.5:0/3249402649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f699c0b5ad0 con 0x7f699c0d15e0 2024-08-18T22:20:14.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.249+0000 7f6992000640 1 -- 172.21.15.5:0/3249402649 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f6984005480 con 0x7f699c0d15e0 2024-08-18T22:20:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 -- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69780678c0 msgr2=0x7f6978069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69780678c0 0x7f6978069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f698c0011f0 tx=0x7f698c009040 comp rx=0 tx=0).stop 2024-08-18T22:20:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 -- 172.21.15.5:0/3249402649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f699c0d15e0 msgr2=0x7f699c0b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f699c0d15e0 0x7f699c0b69e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f698400c450 tx=0x7f698400c910 comp rx=0 tx=0).stop 2024-08-18T22:20:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 -- 172.21.15.5:0/3249402649 shutdown_connections 2024-08-18T22:20:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69780678c0 0x7f6978069d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f699c15fb80 0x7f699c14c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f699c0d15e0 0x7f699c0b69e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 --2- 172.21.15.5:0/3249402649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f699c0d1090 0x7f699c0cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 -- 172.21.15.5:0/3249402649 >> 172.21.15.5:0/3249402649 conn(0x7f699c0d2180 msgr2=0x7f699c0b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:14.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 -- 172.21.15.5:0/3249402649 shutdown_connections 2024-08-18T22:20:14.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.253+0000 7f69a0c00640 1 -- 172.21.15.5:0/3249402649 wait complete. 2024-08-18T22:20:14.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-18T22:20:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.413+0000 7f7025e00640 1 Processor -- start 2024-08-18T22:20:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.413+0000 7f7025e00640 1 -- start start 2024-08-18T22:20:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f7025e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f702015c180 0x7f70200cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f7025e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f702015c560 0x7f70200ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f7025e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f702015d4d0 0x7f70200ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f7025e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f702015d040 con 0x7f702015c560 2024-08-18T22:20:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f7025e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f70200cfb00 con 0x7f702015d4d0 2024-08-18T22:20:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f7025e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f702015c9f0 con 0x7f702015c180 2024-08-18T22:20:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f701e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f702015c560 0x7f70200ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f701e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f702015c560 0x7f70200ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41382/0 (socket says 172.21.15.5:41382) 2024-08-18T22:20:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f701e000640 1 -- 172.21.15.5:0/572503888 learned_addr learned my addr 172.21.15.5:0/572503888 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f701f400640 1 --2- 172.21.15.5:0/572503888 >> v2:172.21.15.117:3300/0 conn(0x7f702015d4d0 0x7f70200ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f701ea00640 1 --2- 172.21.15.5:0/572503888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f702015c180 0x7f70200cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f701e000640 1 -- 172.21.15.5:0/572503888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f702015c180 msgr2=0x7f70200cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f701e000640 1 --2- 172.21.15.5:0/572503888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f702015c180 0x7f70200cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f701e000640 1 -- 172.21.15.5:0/572503888 >> v2:172.21.15.117:3300/0 conn(0x7f702015d4d0 msgr2=0x7f70200ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f701e000640 1 --2- 172.21.15.5:0/572503888 >> v2:172.21.15.117:3300/0 conn(0x7f702015d4d0 0x7f70200ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.417+0000 7f701e000640 1 -- 172.21.15.5:0/572503888 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702015ccd0 con 0x7f702015c560 2024-08-18T22:20:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f701e000640 1 --2- 172.21.15.5:0/572503888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f702015c560 0x7f70200ce450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f702006d2e0 tx=0x7f700c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234b9b6f64656296 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f701d600640 1 -- 172.21.15.5:0/572503888 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c0a7070 con 0x7f702015c560 2024-08-18T22:20:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f701d600640 1 -- 172.21.15.5:0/572503888 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f700c0b0070 con 0x7f702015c560 2024-08-18T22:20:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f701d600640 1 -- 172.21.15.5:0/572503888 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c0ab890 con 0x7f702015c560 2024-08-18T22:20:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 -- 172.21.15.5:0/572503888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f702015c560 msgr2=0x7f70200ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 --2- 172.21.15.5:0/572503888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f702015c560 0x7f70200ce450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f702006d2e0 tx=0x7f700c01c490 comp rx=0 tx=0).stop 2024-08-18T22:20:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 -- 172.21.15.5:0/572503888 shutdown_connections 2024-08-18T22:20:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 --2- 172.21.15.5:0/572503888 >> v2:172.21.15.117:3300/0 conn(0x7f702015d4d0 0x7f70200ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 --2- 172.21.15.5:0/572503888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f702015c560 0x7f70200ce450 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 --2- 172.21.15.5:0/572503888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f702015c180 0x7f70200cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 -- 172.21.15.5:0/572503888 >> 172.21.15.5:0/572503888 conn(0x7f70200b1dc0 msgr2=0x7f70200b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 -- 172.21.15.5:0/572503888 shutdown_connections 2024-08-18T22:20:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 -- 172.21.15.5:0/572503888 wait complete. 2024-08-18T22:20:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 Processor -- start 2024-08-18T22:20:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 -- start start 2024-08-18T22:20:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.421+0000 7f7025e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702015c180 0x7f702014cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7025e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f702015d4d0 0x7f702014d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7025e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70201fa710 0x7f70201fab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7025e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7020160930 con 0x7f70201fa710 2024-08-18T22:20:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7025e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f70201607b0 con 0x7f702015c180 2024-08-18T22:20:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7025e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7020160ab0 con 0x7f702015d4d0 2024-08-18T22:20:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70201fa710 0x7f70201fab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70201fa710 0x7f70201fab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41388/0 (socket says 172.21.15.5:41388) 2024-08-18T22:20:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701f400640 1 -- 172.21.15.5:0/4138802351 learned_addr learned my addr 172.21.15.5:0/4138802351 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701ea00640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702015c180 0x7f702014cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701e000640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f702015d4d0 0x7f702014d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701f400640 1 -- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f702015d4d0 msgr2=0x7f702014d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701f400640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f702015d4d0 0x7f702014d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701f400640 1 -- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702015c180 msgr2=0x7f702014cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701f400640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702015c180 0x7f702014cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701f400640 1 -- 172.21.15.5:0/4138802351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7020159f10 con 0x7f70201fa710 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701e000640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f702015d4d0 0x7f702014d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f701f400640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70201fa710 0x7f70201fab80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f701800e850 tx=0x7f701800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7017400640 1 -- 172.21.15.5:0/4138802351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018017070 con 0x7f70201fa710 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7017400640 1 -- 172.21.15.5:0/4138802351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701800c940 con 0x7f70201fa710 2024-08-18T22:20:14.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7017400640 1 -- 172.21.15.5:0/4138802351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701800cd10 con 0x7f70201fa710 2024-08-18T22:20:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7025e00640 1 -- 172.21.15.5:0/4138802351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702015a1f0 con 0x7f70201fa710 2024-08-18T22:20:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7025e00640 1 -- 172.21.15.5:0/4138802351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702015a7b0 con 0x7f70201fa710 2024-08-18T22:20:14.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7025e00640 1 -- 172.21.15.5:0/4138802351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70200cdf10 con 0x7f70201fa710 2024-08-18T22:20:14.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.425+0000 7f7017400640 1 -- 172.21.15.5:0/4138802351 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f701801a070 con 0x7f70201fa710 2024-08-18T22:20:14.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.429+0000 7f7017400640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70000678c0 0x7f7000069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.429+0000 7f7017400640 1 -- 172.21.15.5:0/4138802351 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f7018085e50 con 0x7f70201fa710 2024-08-18T22:20:14.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.429+0000 7f701ea00640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70000678c0 0x7f7000069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.429+0000 7f701ea00640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70000678c0 0x7f7000069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f70100039f0 tx=0x7f7010009790 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:14.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.433+0000 7f7017400640 1 -- 172.21.15.5:0/4138802351 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7018056460 con 0x7f70201fa710 2024-08-18T22:20:14.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.653+0000 7f7025e00640 1 -- 172.21.15.5:0/4138802351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f7020158060 con 0x7f70201fa710 2024-08-18T22:20:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.657+0000 7f7017400640 1 -- 172.21.15.5:0/4138802351 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f701805a760 con 0x7f70201fa710 2024-08-18T22:20:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 -- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70000678c0 msgr2=0x7f7000069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70000678c0 0x7f7000069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f70100039f0 tx=0x7f7010009790 comp rx=0 tx=0).stop 2024-08-18T22:20:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 -- 172.21.15.5:0/4138802351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70201fa710 msgr2=0x7f70201fab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70201fa710 0x7f70201fab80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f701800e850 tx=0x7f701800ed10 comp rx=0 tx=0).stop 2024-08-18T22:20:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 -- 172.21.15.5:0/4138802351 shutdown_connections 2024-08-18T22:20:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70000678c0 0x7f7000069d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70201fa710 0x7f70201fab80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f702015d4d0 0x7f702014d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 --2- 172.21.15.5:0/4138802351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f702015c180 0x7f702014cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 -- 172.21.15.5:0/4138802351 >> 172.21.15.5:0/4138802351 conn(0x7f70200b1dc0 msgr2=0x7f70200ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 -- 172.21.15.5:0/4138802351 shutdown_connections 2024-08-18T22:20:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.661+0000 7f7025e00640 1 -- 172.21.15.5:0/4138802351 wait complete. 2024-08-18T22:20:14.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-18T22:20:14.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3baf200640 1 Processor -- start 2024-08-18T22:20:14.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3baf200640 1 -- start start 2024-08-18T22:20:14.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3baf200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ba80b40c0 0x7f3ba80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3baf200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3ba80ce280 0x7f3ba80ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3baf200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ba80b31f0 con 0x7f3ba815b0c0 2024-08-18T22:20:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3baf200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3ba80b4a70 con 0x7f3ba80b40c0 2024-08-18T22:20:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3baf200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3ba80b3d70 con 0x7f3ba80ce280 2024-08-18T22:20:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3ba7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ba80b40c0 0x7f3ba80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3ba7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ba80b40c0 0x7f3ba80b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41402/0 (socket says 172.21.15.5:41402) 2024-08-18T22:20:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3ba7400640 1 -- 172.21.15.5:0/1318214441 learned_addr learned my addr 172.21.15.5:0/1318214441 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3bad200640 1 --2- 172.21.15.5:0/1318214441 >> v2:172.21.15.117:3300/0 conn(0x7f3ba80ce280 0x7f3ba80ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3ba7400640 1 -- 172.21.15.5:0/1318214441 >> v2:172.21.15.117:3300/0 conn(0x7f3ba80ce280 msgr2=0x7f3ba80ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3ba7400640 1 --2- 172.21.15.5:0/1318214441 >> v2:172.21.15.117:3300/0 conn(0x7f3ba80ce280 0x7f3ba80ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.821+0000 7f3ba7400640 1 -- 172.21.15.5:0/1318214441 >> v1:172.21.15.117:6789/0 conn(0x7f3ba815b0c0 legacy=0x7f3ba806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.825+0000 7f3ba7400640 1 -- 172.21.15.5:0/1318214441 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba80b34d0 con 0x7f3ba80b40c0 2024-08-18T22:20:14.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.825+0000 7f3ba7400640 1 --2- 172.21.15.5:0/1318214441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba80b40c0 0x7f3ba80b4530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80b4f30 tx=0x7f3b9401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8d557efd9b65bc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:14.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.825+0000 7f3ba6a00640 1 -- 172.21.15.5:0/1318214441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b940b0070 con 0x7f3ba80b40c0 2024-08-18T22:20:14.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.825+0000 7f3ba6a00640 1 -- 172.21.15.5:0/1318214441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b940ab600 con 0x7f3ba80b40c0 2024-08-18T22:20:14.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.825+0000 7f3ba6a00640 1 -- 172.21.15.5:0/1318214441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b940ab9d0 con 0x7f3ba80b40c0 2024-08-18T22:20:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.825+0000 7f3baf200640 1 -- 172.21.15.5:0/1318214441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba80b40c0 msgr2=0x7f3ba80b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.825+0000 7f3baf200640 1 --2- 172.21.15.5:0/1318214441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba80b40c0 0x7f3ba80b4530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80b4f30 tx=0x7f3b9401c3c0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 -- 172.21.15.5:0/1318214441 shutdown_connections 2024-08-18T22:20:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 --2- 172.21.15.5:0/1318214441 >> v2:172.21.15.117:3300/0 conn(0x7f3ba80ce280 0x7f3ba80ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 --2- 172.21.15.5:0/1318214441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba80b40c0 0x7f3ba80b4530 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 -- 172.21.15.5:0/1318214441 >> 172.21.15.5:0/1318214441 conn(0x7f3ba80b1dc0 msgr2=0x7f3ba80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 -- 172.21.15.5:0/1318214441 shutdown_connections 2024-08-18T22:20:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 -- 172.21.15.5:0/1318214441 wait complete. 2024-08-18T22:20:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 Processor -- start 2024-08-18T22:20:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 -- start start 2024-08-18T22:20:14.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba80b40c0 0x7f3ba81554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba80ce280 0x7f3ba815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba815b0c0 0x7f3ba815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba806f7f0 con 0x7f3ba815b0c0 2024-08-18T22:20:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba806f670 con 0x7f3ba80b40c0 2024-08-18T22:20:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba8165d00 con 0x7f3ba80ce280 2024-08-18T22:20:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3bad200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba815b0c0 0x7f3ba815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3bad200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba815b0c0 0x7f3ba815db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41406/0 (socket says 172.21.15.5:41406) 2024-08-18T22:20:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3bad200640 1 -- 172.21.15.5:0/122166860 learned_addr learned my addr 172.21.15.5:0/122166860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3ba7400640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba80ce280 0x7f3ba815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3ba7e00640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba80b40c0 0x7f3ba81554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3bad200640 1 -- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba80ce280 msgr2=0x7f3ba815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3bad200640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba80ce280 0x7f3ba815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3bad200640 1 -- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba80b40c0 msgr2=0x7f3ba81554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3bad200640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba80b40c0 0x7f3ba81554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3bad200640 1 -- 172.21.15.5:0/122166860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba8154a70 con 0x7f3ba815b0c0 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3bad200640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba815b0c0 0x7f3ba815db40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0007e70 tx=0x7f3ba000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3b9fe00640 1 -- 172.21.15.5:0/122166860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0014620 con 0x7f3ba815b0c0 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3b9fe00640 1 -- 172.21.15.5:0/122166860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba0019070 con 0x7f3ba815b0c0 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3b9fe00640 1 -- 172.21.15.5:0/122166860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0014a20 con 0x7f3ba815b0c0 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.829+0000 7f3baf200640 1 -- 172.21.15.5:0/122166860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba80af450 con 0x7f3ba815b0c0 2024-08-18T22:20:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.833+0000 7f3baf200640 1 -- 172.21.15.5:0/122166860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba8154ff0 con 0x7f3ba815b0c0 2024-08-18T22:20:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.833+0000 7f3baf200640 1 -- 172.21.15.5:0/122166860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba80b4530 con 0x7f3ba815b0c0 2024-08-18T22:20:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.833+0000 7f3b9fe00640 1 -- 172.21.15.5:0/122166860 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ba0014bc0 con 0x7f3ba815b0c0 2024-08-18T22:20:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.833+0000 7f3b9fe00640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b880678c0 0x7f3b88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:14.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.833+0000 7f3b9fe00640 1 -- 172.21.15.5:0/122166860 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f3ba0086400 con 0x7f3ba815b0c0 2024-08-18T22:20:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.833+0000 7f3ba7e00640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b880678c0 0x7f3b88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.837+0000 7f3ba7e00640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b880678c0 0x7f3b88069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b98001680 tx=0x7f3b98009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:14.837+0000 7f3b9fe00640 1 -- 172.21.15.5:0/122166860 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f3ba0011260 con 0x7f3ba815b0c0 2024-08-18T22:20:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.065+0000 7f3baf200640 1 -- 172.21.15.5:0/122166860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f3ba806dc50 con 0x7f3ba815b0c0 2024-08-18T22:20:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.065+0000 7f3b9fe00640 1 -- 172.21.15.5:0/122166860 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f3ba00570f0 con 0x7f3ba815b0c0 2024-08-18T22:20:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 -- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b880678c0 msgr2=0x7f3b88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b880678c0 0x7f3b88069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b98001680 tx=0x7f3b98009040 comp rx=0 tx=0).stop 2024-08-18T22:20:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 -- 172.21.15.5:0/122166860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba815b0c0 msgr2=0x7f3ba815db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba815b0c0 0x7f3ba815db40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0007e70 tx=0x7f3ba000e4b0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 -- 172.21.15.5:0/122166860 shutdown_connections 2024-08-18T22:20:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b880678c0 0x7f3b88069d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ba815b0c0 0x7f3ba815db40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ba80ce280 0x7f3ba815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 --2- 172.21.15.5:0/122166860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ba80b40c0 0x7f3ba81554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 -- 172.21.15.5:0/122166860 >> 172.21.15.5:0/122166860 conn(0x7f3ba80b1dc0 msgr2=0x7f3ba806e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 -- 172.21.15.5:0/122166860 shutdown_connections 2024-08-18T22:20:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.069+0000 7f3baf200640 1 -- 172.21.15.5:0/122166860 wait complete. 2024-08-18T22:20:15.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-18T22:20:15.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1627000640 1 Processor -- start 2024-08-18T22:20:15.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1627000640 1 -- start start 2024-08-18T22:20:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1627000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f162015c560 0x7f16200ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1627000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f162015d4d0 0x7f162006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1627000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16200cfb00 con 0x7f162015c180 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1627000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f162015d040 con 0x7f162015d4d0 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1627000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f162015c9f0 con 0x7f162015c560 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1625000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f162015d4d0 0x7f162006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1625000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f162015d4d0 0x7f162006db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41418/0 (socket says 172.21.15.5:41418) 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1625000640 1 -- 172.21.15.5:0/1959721829 learned_addr learned my addr 172.21.15.5:0/1959721829 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1617400640 1 --2- 172.21.15.5:0/1959721829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f162015c560 0x7f16200ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1625000640 1 -- 172.21.15.5:0/1959721829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f162015c560 msgr2=0x7f16200ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1625000640 1 --2- 172.21.15.5:0/1959721829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f162015c560 0x7f16200ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1625000640 1 -- 172.21.15.5:0/1959721829 >> v1:172.21.15.117:6789/0 conn(0x7f162015c180 legacy=0x7f16200cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.229+0000 7f1625000640 1 -- 172.21.15.5:0/1959721829 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162015ccd0 con 0x7f162015d4d0 2024-08-18T22:20:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f1625000640 1 --2- 172.21.15.5:0/1959721829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f162015d4d0 0x7f162006db80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1618009e50 tx=0x7f161801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89dc57ab9a907307 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f161f400640 1 -- 172.21.15.5:0/1959721829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16180a5880 con 0x7f162015d4d0 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f161f400640 1 -- 172.21.15.5:0/1959721829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16200ced70 con 0x7f162015d4d0 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f161f400640 1 -- 172.21.15.5:0/1959721829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16180a5c40 con 0x7f162015d4d0 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f1627000640 1 -- 172.21.15.5:0/1959721829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f162015d4d0 msgr2=0x7f162006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f1627000640 1 --2- 172.21.15.5:0/1959721829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f162015d4d0 0x7f162006db80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1618009e50 tx=0x7f161801c9a0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f1627000640 1 -- 172.21.15.5:0/1959721829 shutdown_connections 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f1627000640 1 --2- 172.21.15.5:0/1959721829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f162015d4d0 0x7f162006db80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f1627000640 1 --2- 172.21.15.5:0/1959721829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f162015c560 0x7f16200ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f1627000640 1 -- 172.21.15.5:0/1959721829 >> 172.21.15.5:0/1959721829 conn(0x7f16200b1dc0 msgr2=0x7f16200b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f1627000640 1 -- 172.21.15.5:0/1959721829 shutdown_connections 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.233+0000 7f1627000640 1 -- 172.21.15.5:0/1959721829 wait complete. 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1627000640 1 Processor -- start 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1627000640 1 -- start start 2024-08-18T22:20:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1627000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f162015c180 0x7f1620147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1627000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f162015d4d0 0x7f16200b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1627000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16200add90 0x7f1620157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1627000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f16201692b0 con 0x7f162015c180 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1627000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1620169130 con 0x7f16200add90 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1627000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1620169430 con 0x7f162015d4d0 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f162015c180 0x7f1620147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f162015c180 0x7f1620147260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41434/0 (socket says 172.21.15.5:41434) 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161fe00640 1 -- 172.21.15.5:0/185301714 learned_addr learned my addr 172.21.15.5:0/185301714 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1625000640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16200add90 0x7f1620157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1617400640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f162015d4d0 0x7f16200b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161fe00640 1 -- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f162015d4d0 msgr2=0x7f16200b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161fe00640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f162015d4d0 0x7f16200b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161fe00640 1 -- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16200add90 msgr2=0x7f1620157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161fe00640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16200add90 0x7f1620157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161fe00640 1 -- 172.21.15.5:0/185301714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16200ae220 con 0x7f162015c180 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161fe00640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f162015c180 0x7f1620147260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f161000c420 tx=0x7f161000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161cc00640 1 -- 172.21.15.5:0/185301714 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16100052d0 con 0x7f162015c180 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161cc00640 1 -- 172.21.15.5:0/185301714 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1610005470 con 0x7f162015c180 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f161cc00640 1 -- 172.21.15.5:0/185301714 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610007260 con 0x7f162015c180 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1627000640 1 -- 172.21.15.5:0/185301714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16200aec90 con 0x7f162015c180 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1627000640 1 -- 172.21.15.5:0/185301714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16200b16c0 con 0x7f162015c180 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.237+0000 7f1627000640 1 -- 172.21.15.5:0/185301714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f162015edb0 con 0x7f162015c180 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.241+0000 7f161cc00640 1 -- 172.21.15.5:0/185301714 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1610007400 con 0x7f162015c180 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.241+0000 7f161cc00640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15fc0678f0 0x7f15fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.241+0000 7f161cc00640 1 -- 172.21.15.5:0/185301714 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f1610084ec0 con 0x7f162015c180 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.241+0000 7f1617400640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15fc0678f0 0x7f15fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.241+0000 7f1617400640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15fc0678f0 0x7f15fc069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f16200cc860 tx=0x7f1608009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:15.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.245+0000 7f161cc00640 1 -- 172.21.15.5:0/185301714 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1610055600 con 0x7f162015c180 2024-08-18T22:20:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.469+0000 7f1627000640 1 -- 172.21.15.5:0/185301714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f162015ead0 con 0x7f162015c180 2024-08-18T22:20:15.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.469+0000 7f161cc00640 1 -- 172.21.15.5:0/185301714 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f1610059900 con 0x7f162015c180 2024-08-18T22:20:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 -- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15fc0678f0 msgr2=0x7f15fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15fc0678f0 0x7f15fc069db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f16200cc860 tx=0x7f1608009190 comp rx=0 tx=0).stop 2024-08-18T22:20:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 -- 172.21.15.5:0/185301714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f162015c180 msgr2=0x7f1620147260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f162015c180 0x7f1620147260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f161000c420 tx=0x7f161000c8e0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 -- 172.21.15.5:0/185301714 shutdown_connections 2024-08-18T22:20:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15fc0678f0 0x7f15fc069db0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16200add90 0x7f1620157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f162015d4d0 0x7f16200b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 --2- 172.21.15.5:0/185301714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f162015c180 0x7f1620147260 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 -- 172.21.15.5:0/185301714 >> 172.21.15.5:0/185301714 conn(0x7f16200b1dc0 msgr2=0x7f16200cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:15.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 -- 172.21.15.5:0/185301714 shutdown_connections 2024-08-18T22:20:15.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.473+0000 7f1627000640 1 -- 172.21.15.5:0/185301714 wait complete. 2024-08-18T22:20:15.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-18T22:20:15.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.633+0000 7f0b1a800640 1 Processor -- start 2024-08-18T22:20:15.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.633+0000 7f0b1a800640 1 -- start start 2024-08-18T22:20:15.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.633+0000 7f0b1a800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b1415fb20 0x7f0b1406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.633+0000 7f0b1a800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0b1406fe60 0x7f0b1406bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.633+0000 7f0b1a800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b14160000 con 0x7f0b14145420 2024-08-18T22:20:15.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.633+0000 7f0b1a800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0b141602e0 con 0x7f0b1415fb20 2024-08-18T22:20:15.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.633+0000 7f0b1a800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0b141605c0 con 0x7f0b1406fe60 2024-08-18T22:20:15.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b19400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0b14145420 0x7f0b14072de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43252/0 (socket says 172.21.15.5:43252) 2024-08-18T22:20:15.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b19400640 1 -- 172.21.15.5:0/1274818041 learned_addr learned my addr 172.21.15.5:0/1274818041 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:15.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b18a00640 1 --2- 172.21.15.5:0/1274818041 >> v2:172.21.15.5:3300/0 conn(0x7f0b1415fb20 0x7f0b1406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b19e00640 1 --2- 172.21.15.5:0/1274818041 >> v2:172.21.15.117:3300/0 conn(0x7f0b1406fe60 0x7f0b1406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b13e00640 1 -- 172.21.15.5:0/1274818041 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081432285 0 0) 0x7f0b14160000 con 0x7f0b14145420 2024-08-18T22:20:15.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b13e00640 1 -- 172.21.15.5:0/1274818041 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0afc003530 con 0x7f0b14145420 2024-08-18T22:20:15.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b18a00640 1 -- 172.21.15.5:0/1274818041 >> v2:172.21.15.117:3300/0 conn(0x7f0b1406fe60 msgr2=0x7f0b1406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:15.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b18a00640 1 --2- 172.21.15.5:0/1274818041 >> v2:172.21.15.117:3300/0 conn(0x7f0b1406fe60 0x7f0b1406bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b18a00640 1 -- 172.21.15.5:0/1274818041 >> v1:172.21.15.5:6789/0 conn(0x7f0b14145420 legacy=0x7f0b14072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b18a00640 1 -- 172.21.15.5:0/1274818041 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b141608a0 con 0x7f0b1415fb20 2024-08-18T22:20:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b18a00640 1 --2- 172.21.15.5:0/1274818041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b1415fb20 0x7f0b1406b9b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b140d1ef0 tx=0x7f0b0001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9d82a795641a8b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b13e00640 1 -- 172.21.15.5:0/1274818041 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b000ab640 con 0x7f0b1415fb20 2024-08-18T22:20:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b13e00640 1 -- 172.21.15.5:0/1274818041 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b000b0070 con 0x7f0b1415fb20 2024-08-18T22:20:15.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.637+0000 7f0b13e00640 1 -- 172.21.15.5:0/1274818041 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b000aba00 con 0x7f0b1415fb20 2024-08-18T22:20:15.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 -- 172.21.15.5:0/1274818041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b1415fb20 msgr2=0x7f0b1406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 --2- 172.21.15.5:0/1274818041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b1415fb20 0x7f0b1406b9b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b140d1ef0 tx=0x7f0b0001c480 comp rx=0 tx=0).stop 2024-08-18T22:20:15.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 -- 172.21.15.5:0/1274818041 shutdown_connections 2024-08-18T22:20:15.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 --2- 172.21.15.5:0/1274818041 >> v2:172.21.15.117:3300/0 conn(0x7f0b1406fe60 0x7f0b1406bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 --2- 172.21.15.5:0/1274818041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b1415fb20 0x7f0b1406b9b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 -- 172.21.15.5:0/1274818041 >> 172.21.15.5:0/1274818041 conn(0x7f0b140d1000 msgr2=0x7f0b140d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 -- 172.21.15.5:0/1274818041 shutdown_connections 2024-08-18T22:20:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 -- 172.21.15.5:0/1274818041 wait complete. 2024-08-18T22:20:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 Processor -- start 2024-08-18T22:20:15.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 -- start start 2024-08-18T22:20:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b1406fe60 0x7f0b140b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b14145420 0x7f0b1413edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b1415fb20 0x7f0b140b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140d0b30 con 0x7f0b1415fb20 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140d09b0 con 0x7f0b14145420 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b1a800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0b140d0cb0 con 0x7f0b1406fe60 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b19e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b1415fb20 0x7f0b140b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b19e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b1415fb20 0x7f0b140b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41438/0 (socket says 172.21.15.5:41438) 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b19e00640 1 -- 172.21.15.5:0/99479750 learned_addr learned my addr 172.21.15.5:0/99479750 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b19400640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b1406fe60 0x7f0b140b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.641+0000 7f0b18a00640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b14145420 0x7f0b1413edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b19e00640 1 -- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b1406fe60 msgr2=0x7f0b140b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b19e00640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b1406fe60 0x7f0b140b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b19e00640 1 -- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b14145420 msgr2=0x7f0b1413edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b19e00640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b14145420 0x7f0b1413edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b19e00640 1 -- 172.21.15.5:0/99479750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b140b27a0 con 0x7f0b1415fb20 2024-08-18T22:20:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b18a00640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b14145420 0x7f0b1413edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b19400640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b1406fe60 0x7f0b140b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b19e00640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b1415fb20 0x7f0b140b2260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00efc0 tx=0x7f0b0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b11600640 1 -- 172.21.15.5:0/99479750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c018020 con 0x7f0b1415fb20 2024-08-18T22:20:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b1a800640 1 -- 172.21.15.5:0/99479750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b140b11c0 con 0x7f0b1415fb20 2024-08-18T22:20:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b11600640 1 -- 172.21.15.5:0/99479750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c014480 con 0x7f0b1415fb20 2024-08-18T22:20:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b11600640 1 -- 172.21.15.5:0/99479750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c009e60 con 0x7f0b1415fb20 2024-08-18T22:20:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b1a800640 1 -- 172.21.15.5:0/99479750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b140b1780 con 0x7f0b1415fb20 2024-08-18T22:20:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b1a800640 1 -- 172.21.15.5:0/99479750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b141654c0 con 0x7f0b1415fb20 2024-08-18T22:20:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b11600640 1 -- 172.21.15.5:0/99479750 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0b0c01b020 con 0x7f0b1415fb20 2024-08-18T22:20:15.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b11600640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0af40678c0 0x7f0af4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:15.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.645+0000 7f0b11600640 1 -- 172.21.15.5:0/99479750 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f0b0c086880 con 0x7f0b1415fb20 2024-08-18T22:20:15.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.649+0000 7f0b19400640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0af40678c0 0x7f0af4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:15.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.649+0000 7f0b19400640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0af40678c0 0x7f0af4069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0b08005890 tx=0x7f0b08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.649+0000 7f0b11600640 1 -- 172.21.15.5:0/99479750 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0b0c022030 con 0x7f0b1415fb20 2024-08-18T22:20:15.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.873+0000 7f0b1a800640 1 -- 172.21.15.5:0/99479750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f0b141651e0 con 0x7f0b1415fb20 2024-08-18T22:20:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.873+0000 7f0b11600640 1 -- 172.21.15.5:0/99479750 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f0b0c010040 con 0x7f0b1415fb20 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 -- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0af40678c0 msgr2=0x7f0af4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0af40678c0 0x7f0af4069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0b08005890 tx=0x7f0b08009040 comp rx=0 tx=0).stop 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 -- 172.21.15.5:0/99479750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b1415fb20 msgr2=0x7f0b140b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b1415fb20 0x7f0b140b2260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00efc0 tx=0x7f0b0c00c490 comp rx=0 tx=0).stop 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 -- 172.21.15.5:0/99479750 shutdown_connections 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0af40678c0 0x7f0af4069d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b1415fb20 0x7f0b140b2260 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b14145420 0x7f0b1413edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 --2- 172.21.15.5:0/99479750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b1406fe60 0x7f0b140b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 -- 172.21.15.5:0/99479750 >> 172.21.15.5:0/99479750 conn(0x7f0b140d1000 msgr2=0x7f0b140b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 -- 172.21.15.5:0/99479750 shutdown_connections 2024-08-18T22:20:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:15.877+0000 7f0b1a800640 1 -- 172.21.15.5:0/99479750 wait complete. 2024-08-18T22:20:15.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:20:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.037+0000 7f0145800640 1 Processor -- start 2024-08-18T22:20:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.037+0000 7f0145800640 1 -- start start 2024-08-18T22:20:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0145800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f014009aa40 0x7f014015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0145800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01400cde30 0x7f014009ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0145800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01400b4510 0x7f014015fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0145800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f01400ce770 con 0x7f01400b4510 2024-08-18T22:20:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0145800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f014015d520 con 0x7f014009aa40 2024-08-18T22:20:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0145800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f014009b360 con 0x7f01400cde30 2024-08-18T22:20:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0144e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01400b4510 0x7f014015fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0144e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01400b4510 0x7f014015fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41440/0 (socket says 172.21.15.5:41440) 2024-08-18T22:20:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0144e00640 1 -- 172.21.15.5:0/300777035 learned_addr learned my addr 172.21.15.5:0/300777035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f013fe00640 1 --2- 172.21.15.5:0/300777035 >> v2:172.21.15.117:3300/0 conn(0x7f014009aa40 0x7f014015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f013f400640 1 --2- 172.21.15.5:0/300777035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01400cde30 0x7f014009ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0144e00640 1 -- 172.21.15.5:0/300777035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01400cde30 msgr2=0x7f014009ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0144e00640 1 --2- 172.21.15.5:0/300777035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01400cde30 0x7f014009ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0144e00640 1 -- 172.21.15.5:0/300777035 >> v2:172.21.15.117:3300/0 conn(0x7f014009aa40 msgr2=0x7f014015cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0144e00640 1 --2- 172.21.15.5:0/300777035 >> v2:172.21.15.117:3300/0 conn(0x7f014009aa40 0x7f014015cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.041+0000 7f0144e00640 1 -- 172.21.15.5:0/300777035 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01400ccd90 con 0x7f01400b4510 2024-08-18T22:20:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0144e00640 1 --2- 172.21.15.5:0/300777035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01400b4510 0x7f014015fb00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0140072fa0 tx=0x7f013801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ce55261138ba87 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f013ea00640 1 -- 172.21.15.5:0/300777035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01380a5580 con 0x7f01400b4510 2024-08-18T22:20:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f013ea00640 1 -- 172.21.15.5:0/300777035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01380a5720 con 0x7f01400b4510 2024-08-18T22:20:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f013ea00640 1 -- 172.21.15.5:0/300777035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01380a5af0 con 0x7f01400b4510 2024-08-18T22:20:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 -- 172.21.15.5:0/300777035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01400b4510 msgr2=0x7f014015fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 --2- 172.21.15.5:0/300777035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01400b4510 0x7f014015fb00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0140072fa0 tx=0x7f013801c700 comp rx=0 tx=0).stop 2024-08-18T22:20:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 -- 172.21.15.5:0/300777035 shutdown_connections 2024-08-18T22:20:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 --2- 172.21.15.5:0/300777035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01400b4510 0x7f014015fb00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 --2- 172.21.15.5:0/300777035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01400cde30 0x7f014009ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 --2- 172.21.15.5:0/300777035 >> v2:172.21.15.117:3300/0 conn(0x7f014009aa40 0x7f014015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 -- 172.21.15.5:0/300777035 >> 172.21.15.5:0/300777035 conn(0x7f01400b3a20 msgr2=0x7f01400b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 -- 172.21.15.5:0/300777035 shutdown_connections 2024-08-18T22:20:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 -- 172.21.15.5:0/300777035 wait complete. 2024-08-18T22:20:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 Processor -- start 2024-08-18T22:20:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 -- start start 2024-08-18T22:20:16.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f014009aa40 0x7f0140070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01400b4510 0x7f0140158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01400cde30 0x7f01400cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f014015c230 con 0x7f01400b4510 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01400cd910 con 0x7f014009aa40 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.045+0000 7f0145800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f014015c3b0 con 0x7f01400cde30 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f013f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01400b4510 0x7f0140158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f013f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01400b4510 0x7f0140158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41448/0 (socket says 172.21.15.5:41448) 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f013f400640 1 -- 172.21.15.5:0/3997685284 learned_addr learned my addr 172.21.15.5:0/3997685284 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f013fe00640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f014009aa40 0x7f0140070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f0144e00640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01400cde30 0x7f01400cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f013f400640 1 -- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01400cde30 msgr2=0x7f01400cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f013f400640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01400cde30 0x7f01400cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f013f400640 1 -- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f014009aa40 msgr2=0x7f0140070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f013f400640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f014009aa40 0x7f0140070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f013f400640 1 -- 172.21.15.5:0/3997685284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01400b72e0 con 0x7f01400b4510 2024-08-18T22:20:16.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f013f400640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01400b4510 0x7f0140158f50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f012c00e900 tx=0x7f012c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f0137e00640 1 -- 172.21.15.5:0/3997685284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c017070 con 0x7f01400b4510 2024-08-18T22:20:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f0137e00640 1 -- 172.21.15.5:0/3997685284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c00ca00 con 0x7f01400b4510 2024-08-18T22:20:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f0137e00640 1 -- 172.21.15.5:0/3997685284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c00cdf0 con 0x7f01400b4510 2024-08-18T22:20:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f0145800640 1 -- 172.21.15.5:0/3997685284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01400b75c0 con 0x7f01400b4510 2024-08-18T22:20:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f0145800640 1 -- 172.21.15.5:0/3997685284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01400b7b80 con 0x7f01400b4510 2024-08-18T22:20:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f0145800640 1 -- 172.21.15.5:0/3997685284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f014015fb00 con 0x7f01400b4510 2024-08-18T22:20:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f0137e00640 1 -- 172.21.15.5:0/3997685284 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f012c01a070 con 0x7f01400b4510 2024-08-18T22:20:16.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.049+0000 7f0137e00640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01200678c0 0x7f0120069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.053+0000 7f0137e00640 1 -- 172.21.15.5:0/3997685284 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f012c085e10 con 0x7f01400b4510 2024-08-18T22:20:16.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.053+0000 7f013fe00640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01200678c0 0x7f0120069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.053+0000 7f013fe00640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01200678c0 0x7f0120069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f014009ff90 tx=0x7f0130008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:16.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.057+0000 7f0137e00640 1 -- 172.21.15.5:0/3997685284 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f012c089030 con 0x7f01400b4510 2024-08-18T22:20:16.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.225+0000 7f0145800640 1 -- 172.21.15.5:0/3997685284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0140073d40 con 0x7f01400b4510 2024-08-18T22:20:16.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.225+0000 7f0137e00640 1 -- 172.21.15.5:0/3997685284 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f012c056b00 con 0x7f01400b4510 2024-08-18T22:20:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:16.229 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:20:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:20:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:20:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:20:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:20:16.229 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:20:16.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 -- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01200678c0 msgr2=0x7f0120069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:16.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01200678c0 0x7f0120069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f014009ff90 tx=0x7f0130008040 comp rx=0 tx=0).stop 2024-08-18T22:20:16.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 -- 172.21.15.5:0/3997685284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01400b4510 msgr2=0x7f0140158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:16.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01400b4510 0x7f0140158f50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f012c00e900 tx=0x7f012c00edc0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 -- 172.21.15.5:0/3997685284 shutdown_connections 2024-08-18T22:20:16.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01200678c0 0x7f0120069d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01400cde30 0x7f01400cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01400b4510 0x7f0140158f50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 --2- 172.21.15.5:0/3997685284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f014009aa40 0x7f0140070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 -- 172.21.15.5:0/3997685284 >> 172.21.15.5:0/3997685284 conn(0x7f01400b3a20 msgr2=0x7f0140159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:16.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 -- 172.21.15.5:0/3997685284 shutdown_connections 2024-08-18T22:20:16.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.229+0000 7f0145800640 1 -- 172.21.15.5:0/3997685284 wait complete. 2024-08-18T22:20:16.251 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:20:16.251 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:20:16.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.393+0000 7f1c64e00640 1 Processor -- start 2024-08-18T22:20:16.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.393+0000 7f1c64e00640 1 -- start start 2024-08-18T22:20:16.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.393+0000 7f1c64e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c60072e80 0x7f1c600b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.393+0000 7f1c64e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c60073310 con 0x7f1c600cf020 2024-08-18T22:20:16.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.393+0000 7f1c64e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c600735e0 con 0x7f1c60072a20 2024-08-18T22:20:16.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.393+0000 7f1c64e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c600738c0 con 0x7f1c60072e80 2024-08-18T22:20:16.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.393+0000 7f1c5de00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1c600cf020 0x7f1c600cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43262/0 (socket says 172.21.15.5:43262) 2024-08-18T22:20:16.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.393+0000 7f1c5de00640 1 -- 172.21.15.5:0/3835205650 learned_addr learned my addr 172.21.15.5:0/3835205650 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:16.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300414579 0 0) 0x7f1c60073310 con 0x7f1c600cf020 2024-08-18T22:20:16.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c44003530 con 0x7f1c600cf020 2024-08-18T22:20:16.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5e800640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c60072e80 0x7f1c600b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3745137535 0 0) 0x7f1c44003530 con 0x7f1c600cf020 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c60072e80 msgr2=0x7f1c600b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c60072e80 0x7f1c600b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 >> v1:172.21.15.117:6789/0 conn(0x7f1c60072a20 legacy=0x7f1c600b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c60073ba0 con 0x7f1c600cf020 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f1c50001680 con 0x7f1c600cf020 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 >> v1:172.21.15.5:6789/0 conn(0x7f1c600cf020 legacy=0x7f1c600cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c440039f0 0x7f1c44003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c44004810 0x7f1c44004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c440051d0 0x7f1c4400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1c600738c0 con 0x7f1c440039f0 2024-08-18T22:20:16.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4400c0a0 con 0x7f1c440051d0 2024-08-18T22:20:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c4400e4b0 con 0x7f1c44004810 2024-08-18T22:20:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5e800640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c60072e80 0x7f1c600b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5de00640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c440039f0 0x7f1c44003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5d400640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c44004810 0x7f1c44004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5e800640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c440051d0 0x7f1c4400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5de00640 1 -- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c44004810 msgr2=0x7f1c44004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5de00640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c44004810 0x7f1c44004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5de00640 1 -- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c440051d0 msgr2=0x7f1c4400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5de00640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c440051d0 0x7f1c4400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5de00640 1 -- 172.21.15.5:0/3835205650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c44003530 con 0x7f1c440039f0 2024-08-18T22:20:16.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.397+0000 7f1c5e800640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c440051d0 0x7f1c4400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c5de00640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c440039f0 0x7f1c44003e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000c210 tx=0x7f1c5001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94db88955e87f83 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c50007d40 con 0x7f1c440039f0 2024-08-18T22:20:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c500a9070 con 0x7f1c440039f0 2024-08-18T22:20:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c5ca00640 1 -- 172.21.15.5:0/3835205650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c500a5d50 con 0x7f1c440039f0 2024-08-18T22:20:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 -- 172.21.15.5:0/3835205650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c440039f0 msgr2=0x7f1c44003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 --2- 172.21.15.5:0/3835205650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c440039f0 0x7f1c44003e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000c210 tx=0x7f1c5001cc70 comp rx=0 tx=0).stop 2024-08-18T22:20:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c5e800640 1 -- 172.21.15.5:0/3835205650 reap_dead start 2024-08-18T22:20:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 -- 172.21.15.5:0/3835205650 shutdown_connections 2024-08-18T22:20:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 -- 172.21.15.5:0/3835205650 >> 172.21.15.5:0/3835205650 conn(0x7f1c6006b9b0 msgr2=0x7f1c6006bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 -- 172.21.15.5:0/3835205650 shutdown_connections 2024-08-18T22:20:16.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 -- 172.21.15.5:0/3835205650 wait complete. 2024-08-18T22:20:16.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 Processor -- start 2024-08-18T22:20:16.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 -- start start 2024-08-18T22:20:16.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c440039f0 0x7f1c60147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6014cd20 0x7f1c601f9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c6015b370 0x7f1c6015b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1c60155a60 con 0x7f1c6014cd20 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c601558e0 con 0x7f1c440039f0 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.401+0000 7f1c64e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c6015c760 con 0x7f1c6015b370 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c5d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6014cd20 0x7f1c601f9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c5d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6014cd20 0x7f1c601f9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41456/0 (socket says 172.21.15.5:41456) 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c5d400640 1 -- 172.21.15.5:0/1638050448 learned_addr learned my addr 172.21.15.5:0/1638050448 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c5de00640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c440039f0 0x7f1c60147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c5e800640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c6015b370 0x7f1c6015b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c5d400640 1 -- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c6015b370 msgr2=0x7f1c6015b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c5d400640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c6015b370 0x7f1c6015b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c5d400640 1 -- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c440039f0 msgr2=0x7f1c60147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:16.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c5d400640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c440039f0 0x7f1c60147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:16.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c5d400640 1 -- 172.21.15.5:0/1638050448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c60148d40 con 0x7f1c6014cd20 2024-08-18T22:20:16.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c5d400640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6014cd20 0x7f1c601f9ef0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00e500 tx=0x7f1c4c00e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:16.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c56000640 1 -- 172.21.15.5:0/1638050448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c0053a0 con 0x7f1c6014cd20 2024-08-18T22:20:16.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c56000640 1 -- 172.21.15.5:0/1638050448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4c018070 con 0x7f1c6014cd20 2024-08-18T22:20:16.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c56000640 1 -- 172.21.15.5:0/1638050448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c003820 con 0x7f1c6014cd20 2024-08-18T22:20:16.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c64e00640 1 -- 172.21.15.5:0/1638050448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6014bca0 con 0x7f1c6014cd20 2024-08-18T22:20:16.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c64e00640 1 -- 172.21.15.5:0/1638050448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6014bf80 con 0x7f1c6014cd20 2024-08-18T22:20:16.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c64e00640 1 -- 172.21.15.5:0/1638050448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c60073290 con 0x7f1c6014cd20 2024-08-18T22:20:16.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c56000640 1 -- 172.21.15.5:0/1638050448 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c4c0039c0 con 0x7f1c6014cd20 2024-08-18T22:20:16.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c56000640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c400678f0 0x7f1c40069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:16.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.405+0000 7f1c56000640 1 -- 172.21.15.5:0/1638050448 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f1c4c085740 con 0x7f1c6014cd20 2024-08-18T22:20:16.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.409+0000 7f1c5de00640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c400678f0 0x7f1c40069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:16.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.409+0000 7f1c5de00640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c400678f0 0x7f1c40069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000c210 tx=0x7f1c500b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.413+0000 7f1c56000640 1 -- 172.21.15.5:0/1638050448 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1c4c056450 con 0x7f1c6014cd20 2024-08-18T22:20:16.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:16.577+0000 7f1c64e00640 1 -- 172.21.15.5:0/1638050448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1c600b3e30 con 0x7f1c6014cd20 2024-08-18T22:20:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c56000640 1 -- 172.21.15.5:0/1638050448 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f1c4c055d50 con 0x7f1c6014cd20 2024-08-18T22:20:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:20:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 -- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c400678f0 msgr2=0x7f1c40069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c400678f0 0x7f1c40069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000c210 tx=0x7f1c500b1040 comp rx=0 tx=0).stop 2024-08-18T22:20:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 -- 172.21.15.5:0/1638050448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6014cd20 msgr2=0x7f1c601f9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6014cd20 0x7f1c601f9ef0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00e500 tx=0x7f1c4c00e9c0 comp rx=0 tx=0).stop 2024-08-18T22:20:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 -- 172.21.15.5:0/1638050448 shutdown_connections 2024-08-18T22:20:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c400678f0 0x7f1c40069db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c6015b370 0x7f1c6015b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6014cd20 0x7f1c601f9ef0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 --2- 172.21.15.5:0/1638050448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c440039f0 0x7f1c60147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 -- 172.21.15.5:0/1638050448 >> 172.21.15.5:0/1638050448 conn(0x7f1c6006b9b0 msgr2=0x7f1c60148310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 -- 172.21.15.5:0/1638050448 shutdown_connections 2024-08-18T22:20:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.477+0000 7f1c64e00640 1 -- 172.21.15.5:0/1638050448 wait complete. 2024-08-18T22:20:17.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:20:17.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.661+0000 7f766b200640 1 Processor -- start 2024-08-18T22:20:17.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.661+0000 7f766b200640 1 -- start start 2024-08-18T22:20:17.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.661+0000 7f766b200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f766c15c0b0 0x7f766c0729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:17.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.661+0000 7f766b200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f766c073880 con 0x7f766c06f0c0 2024-08-18T22:20:17.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.661+0000 7f766b200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f766c0b41e0 con 0x7f766c15b590 2024-08-18T22:20:17.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.661+0000 7f766b200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f766c0b4510 con 0x7f766c15c0b0 2024-08-18T22:20:17.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.661+0000 7f7669e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f766c15c0b0 0x7f766c0729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:17.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.661+0000 7f766a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f766c06f0c0 0x7f766c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43266/0 (socket says 172.21.15.5:43266) 2024-08-18T22:20:17.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.661+0000 7f766a800640 1 -- 172.21.15.5:0/157365553 learned_addr learned my addr 172.21.15.5:0/157365553 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:17.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f7669e00640 1 -- 172.21.15.5:0/157365553 >> v1:172.21.15.117:6789/0 conn(0x7f766c15b590 legacy=0x7f766c06e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:17.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f7669e00640 1 -- 172.21.15.5:0/157365553 >> v1:172.21.15.5:6789/0 conn(0x7f766c06f0c0 legacy=0x7f766c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:17.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f7669e00640 1 -- 172.21.15.5:0/157365553 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766c0732c0 con 0x7f766c15c0b0 2024-08-18T22:20:17.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f7669400640 1 -- 172.21.15.5:0/157365553 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604540010 0 0) 0x7f766c073880 con 0x7f766c06f0c0 2024-08-18T22:20:17.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f7669e00640 1 --2- 172.21.15.5:0/157365553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f766c15c0b0 0x7f766c0729c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f765c009d90 tx=0x7f765c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63e2727fc049848 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:17.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f7669400640 1 -- 172.21.15.5:0/157365553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c0b2070 con 0x7f766c15c0b0 2024-08-18T22:20:17.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f7669400640 1 -- 172.21.15.5:0/157365553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f765c0a57a0 con 0x7f766c15c0b0 2024-08-18T22:20:17.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f7669400640 1 -- 172.21.15.5:0/157365553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c0a5b70 con 0x7f766c15c0b0 2024-08-18T22:20:17.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f766b200640 1 -- 172.21.15.5:0/157365553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f766c15c0b0 msgr2=0x7f766c0729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:17.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f766b200640 1 --2- 172.21.15.5:0/157365553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f766c15c0b0 0x7f766c0729c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f765c009d90 tx=0x7f765c01c8e0 comp rx=0 tx=0).stop 2024-08-18T22:20:17.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f766b200640 1 -- 172.21.15.5:0/157365553 shutdown_connections 2024-08-18T22:20:17.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f766b200640 1 --2- 172.21.15.5:0/157365553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f766c15c0b0 0x7f766c0729c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:17.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f766b200640 1 -- 172.21.15.5:0/157365553 >> 172.21.15.5:0/157365553 conn(0x7f766c0d1000 msgr2=0x7f766c0d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:17.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.665+0000 7f766b200640 1 -- 172.21.15.5:0/157365553 shutdown_connections 2024-08-18T22:20:17.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766b200640 1 -- 172.21.15.5:0/157365553 wait complete. 2024-08-18T22:20:17.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766b200640 1 Processor -- start 2024-08-18T22:20:17.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766b200640 1 -- start start 2024-08-18T22:20:17.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766b200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f766c06f0c0 0x7f766c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:17.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f766c15b590 0x7f766c150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:17.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f766c15c0b0 0x7f766c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:17.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f766c0b5c50 con 0x7f766c15c0b0 2024-08-18T22:20:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766b200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f766c0b5ad0 con 0x7f766c06f0c0 2024-08-18T22:20:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f766c168c00 con 0x7f766c15b590 2024-08-18T22:20:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f766c15c0b0 0x7f766c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f7661400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f766c15b590 0x7f766c150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f7669e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f766c06f0c0 0x7f766c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f766c15c0b0 0x7f766c159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41480/0 (socket says 172.21.15.5:41480) 2024-08-18T22:20:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766a800640 1 -- 172.21.15.5:0/3481842491 learned_addr learned my addr 172.21.15.5:0/3481842491 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f7669e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f766c06f0c0 0x7f766c1553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:42776/0 (socket says 172.21.15.5:42776) 2024-08-18T22:20:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f7661400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f766c15b590 0x7f766c150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47486/0 (socket says 172.21.15.5:47486) 2024-08-18T22:20:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766a800640 1 -- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f766c15b590 msgr2=0x7f766c150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:17.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766a800640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f766c15b590 0x7f766c150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:17.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766a800640 1 -- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f766c06f0c0 msgr2=0x7f766c1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:17.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766a800640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f766c06f0c0 0x7f766c1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:17.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766a800640 1 -- 172.21.15.5:0/3481842491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766c155910 con 0x7f766c15c0b0 2024-08-18T22:20:17.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.669+0000 7f766a800640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f766c15c0b0 0x7f766c159840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f766400c480 tx=0x7f766400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:17.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.673+0000 7f7662a00640 1 -- 172.21.15.5:0/3481842491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664018070 con 0x7f766c15c0b0 2024-08-18T22:20:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.673+0000 7f7662a00640 1 -- 172.21.15.5:0/3481842491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76640074e0 con 0x7f766c15c0b0 2024-08-18T22:20:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.673+0000 7f7662a00640 1 -- 172.21.15.5:0/3481842491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664004a30 con 0x7f766c15c0b0 2024-08-18T22:20:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.673+0000 7f766b200640 1 -- 172.21.15.5:0/3481842491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766c151060 con 0x7f766c15c0b0 2024-08-18T22:20:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.673+0000 7f766b200640 1 -- 172.21.15.5:0/3481842491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f766c151620 con 0x7f766c15c0b0 2024-08-18T22:20:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.673+0000 7f766b200640 1 -- 172.21.15.5:0/3481842491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f766c151960 con 0x7f766c15c0b0 2024-08-18T22:20:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.673+0000 7f7662a00640 1 -- 172.21.15.5:0/3481842491 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f766401b070 con 0x7f766c15c0b0 2024-08-18T22:20:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.673+0000 7f7662a00640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76480678c0 0x7f7648069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.673+0000 7f7662a00640 1 -- 172.21.15.5:0/3481842491 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7f7664084df0 con 0x7f766c15c0b0 2024-08-18T22:20:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.673+0000 7f7669e00640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76480678c0 0x7f7648069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.677+0000 7f7669e00640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76480678c0 0x7f7648069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f765c0af000 tx=0x7f765c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.677+0000 7f7662a00640 1 -- 172.21.15.5:0/3481842491 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f766c151960 con 0x7f766c15c0b0 2024-08-18T22:20:17.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:17.849+0000 7f766b200640 1 -- 172.21.15.5:0/3481842491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f766c0729c0 con 0x7f766c15c0b0 2024-08-18T22:20:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.481+0000 7f7662a00640 1 -- 172.21.15.5:0/3481842491 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7f7664055320 con 0x7f766c15c0b0 2024-08-18T22:20:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:20:18.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 -- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76480678c0 msgr2=0x7f7648069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:18.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76480678c0 0x7f7648069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f765c0af000 tx=0x7f765c0a7070 comp rx=0 tx=0).stop 2024-08-18T22:20:18.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 -- 172.21.15.5:0/3481842491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f766c15c0b0 msgr2=0x7f766c159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f766c15c0b0 0x7f766c159840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f766400c480 tx=0x7f766400c940 comp rx=0 tx=0).stop 2024-08-18T22:20:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 -- 172.21.15.5:0/3481842491 shutdown_connections 2024-08-18T22:20:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76480678c0 0x7f7648069d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f766c15c0b0 0x7f766c159840 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f766c15b590 0x7f766c150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 --2- 172.21.15.5:0/3481842491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f766c06f0c0 0x7f766c1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 -- 172.21.15.5:0/3481842491 >> 172.21.15.5:0/3481842491 conn(0x7f766c0d1000 msgr2=0x7f766c15cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:18.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 -- 172.21.15.5:0/3481842491 shutdown_connections 2024-08-18T22:20:18.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.485+0000 7f766b200640 1 -- 172.21.15.5:0/3481842491 wait complete. 2024-08-18T22:20:18.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:20:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5cd200640 1 Processor -- start 2024-08-18T22:20:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5cd200640 1 -- start start 2024-08-18T22:20:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5cd200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5c815c560 0x7fb5c80ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5cd200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb5c815d4d0 0x7fb5c806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5cd200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c80cfb00 con 0x7fb5c815c180 2024-08-18T22:20:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5cd200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c815d040 con 0x7fb5c815d4d0 2024-08-18T22:20:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5cd200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c815c9f0 con 0x7fb5c815c560 2024-08-18T22:20:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c5e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb5c815c180 0x7fb5c80cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43282/0 (socket says 172.21.15.5:43282) 2024-08-18T22:20:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c5e00640 1 -- 172.21.15.5:0/2815774942 learned_addr learned my addr 172.21.15.5:0/2815774942 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c6800640 1 --2- 172.21.15.5:0/2815774942 >> v2:172.21.15.117:3300/0 conn(0x7fb5c815d4d0 0x7fb5c806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c5400640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5c815c560 0x7fb5c80ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2930374402 0 0) 0x7fb5c80cfb00 con 0x7fb5c815c180 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5ac003530 con 0x7fb5c815c180 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1848449700 0 0) 0x7fb5ac003530 con 0x7fb5c815c180 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5c815c560 msgr2=0x7fb5c80ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5c815c560 0x7fb5c80ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 >> v2:172.21.15.117:3300/0 conn(0x7fb5c815d4d0 msgr2=0x7fb5c806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 --2- 172.21.15.5:0/2815774942 >> v2:172.21.15.117:3300/0 conn(0x7fb5c815d4d0 0x7fb5c806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c815ccd0 con 0x7fb5c815c180 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fb5b8001680 con 0x7fb5c815c180 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 >> v1:172.21.15.5:6789/0 conn(0x7fb5c815c180 legacy=0x7fb5c80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ac0039c0 0x7fb5ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5ac004810 0x7fb5ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5ac005190 0x7fb5ac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c815d040 con 0x7fb5ac005190 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c815c9f0 con 0x7fb5ac0039c0 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ac00bf10 con 0x7fb5ac004810 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c6800640 1 --2- 172.21.15.5:0/2815774942 >> v2:172.21.15.117:3300/0 conn(0x7fb5c815d4d0 0x7fb5c806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c5e00640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ac0039c0 0x7fb5ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c5400640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5ac004810 0x7fb5ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c6800640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5ac005190 0x7fb5ac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c5e00640 1 -- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5ac004810 msgr2=0x7fb5ac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c5e00640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5ac004810 0x7fb5ac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c5e00640 1 -- 172.21.15.5:0/2815774942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5ac005190 msgr2=0x7fb5ac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c5e00640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5ac005190 0x7fb5ac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c5e00640 1 -- 172.21.15.5:0/2815774942 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac003530 con 0x7fb5ac0039c0 2024-08-18T22:20:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.673+0000 7fb5c6800640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5ac005190 0x7fb5ac00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:20:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.677+0000 7fb5c5e00640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ac0039c0 0x7fb5ac003de0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c240 tx=0x7fb5b801f410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=992ccf76b5204610 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.677+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8007d40 con 0x7fb5ac0039c0 2024-08-18T22:20:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.677+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b8005b00 con 0x7fb5ac0039c0 2024-08-18T22:20:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.677+0000 7fb5c4a00640 1 -- 172.21.15.5:0/2815774942 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8007070 con 0x7fb5ac0039c0 2024-08-18T22:20:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.677+0000 7fb5cd200640 1 -- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ac0039c0 msgr2=0x7fb5ac003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.677+0000 7fb5cd200640 1 --2- 172.21.15.5:0/2815774942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ac0039c0 0x7fb5ac003de0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c240 tx=0x7fb5b801f410 comp rx=0 tx=0).stop 2024-08-18T22:20:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.677+0000 7fb5c6800640 1 -- 172.21.15.5:0/2815774942 reap_dead start 2024-08-18T22:20:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.677+0000 7fb5cd200640 1 -- 172.21.15.5:0/2815774942 shutdown_connections 2024-08-18T22:20:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.677+0000 7fb5cd200640 1 -- 172.21.15.5:0/2815774942 >> 172.21.15.5:0/2815774942 conn(0x7fb5c80b1dc0 msgr2=0x7fb5c80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.677+0000 7fb5cd200640 1 -- 172.21.15.5:0/2815774942 shutdown_connections 2024-08-18T22:20:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.677+0000 7fb5cd200640 1 -- 172.21.15.5:0/2815774942 wait complete. 2024-08-18T22:20:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5cd200640 1 Processor -- start 2024-08-18T22:20:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5cd200640 1 -- start start 2024-08-18T22:20:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5cd200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ac0039c0 0x7fb5c8145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5cd200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5c80b0f20 0x7fb5c80b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5cd200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c8156550 0x7fb5c81569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5cd200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c80cf690 con 0x7fb5c8156550 2024-08-18T22:20:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5cd200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c80cf510 con 0x7fb5ac0039c0 2024-08-18T22:20:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5cd200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c80cf810 con 0x7fb5c80b0f20 2024-08-18T22:20:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c8156550 0x7fb5c81569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c8156550 0x7fb5c81569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41502/0 (socket says 172.21.15.5:41502) 2024-08-18T22:20:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c6800640 1 -- 172.21.15.5:0/3795463363 learned_addr learned my addr 172.21.15.5:0/3795463363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c5e00640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ac0039c0 0x7fb5c8145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c5400640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5c80b0f20 0x7fb5c80b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c6800640 1 -- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5c80b0f20 msgr2=0x7fb5c80b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c6800640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5c80b0f20 0x7fb5c80b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c6800640 1 -- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ac0039c0 msgr2=0x7fb5c8145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c6800640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ac0039c0 0x7fb5c8145c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c6800640 1 -- 172.21.15.5:0/3795463363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c8157280 con 0x7fb5c8156550 2024-08-18T22:20:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c5e00640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ac0039c0 0x7fb5c8145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:18.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5c6800640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c8156550 0x7fb5c81569d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8071390 tx=0x7fb5c000f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5be000640 1 -- 172.21.15.5:0/3795463363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0009de0 con 0x7fb5c8156550 2024-08-18T22:20:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5be000640 1 -- 172.21.15.5:0/3795463363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c0015630 con 0x7fb5c8156550 2024-08-18T22:20:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5be000640 1 -- 172.21.15.5:0/3795463363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0015a20 con 0x7fb5c8156550 2024-08-18T22:20:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.681+0000 7fb5cd200640 1 -- 172.21.15.5:0/3795463363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c8157560 con 0x7fb5c8156550 2024-08-18T22:20:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.685+0000 7fb5cd200640 1 -- 172.21.15.5:0/3795463363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c8146a20 con 0x7fb5c8156550 2024-08-18T22:20:18.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.685+0000 7fb5cd200640 1 -- 172.21.15.5:0/3795463363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c8146530 con 0x7fb5c8156550 2024-08-18T22:20:18.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.685+0000 7fb5be000640 1 -- 172.21.15.5:0/3795463363 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5c0015bc0 con 0x7fb5c8156550 2024-08-18T22:20:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.685+0000 7fb5be000640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5a80678c0 0x7fb5a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.685+0000 7fb5be000640 1 -- 172.21.15.5:0/3795463363 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7fb5c0086ed0 con 0x7fb5c8156550 2024-08-18T22:20:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.685+0000 7fb5c5e00640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5a80678c0 0x7fb5a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.689+0000 7fb5c5e00640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5a80678c0 0x7fb5a8069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80ae000 tx=0x7fb5c80cfcd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:18.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.693+0000 7fb5be000640 1 -- 172.21.15.5:0/3795463363 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb5c0019030 con 0x7fb5c8156550 2024-08-18T22:20:18.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:18.889+0000 7fb5cd200640 1 -- 172.21.15.5:0/3795463363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb5c815c560 con 0x7fb5c8156550 2024-08-18T22:20:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5be000640 1 -- 172.21.15.5:0/3795463363 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7fb5c0010040 con 0x7fb5c8156550 2024-08-18T22:20:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 5 and data pool 6 2024-08-18T22:20:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5cd200640 1 -- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5a80678c0 msgr2=0x7fb5a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5cd200640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5a80678c0 0x7fb5a8069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80ae000 tx=0x7fb5c80cfcd0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5cd200640 1 -- 172.21.15.5:0/3795463363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c8156550 msgr2=0x7fb5c81569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5cd200640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c8156550 0x7fb5c81569d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8071390 tx=0x7fb5c000f870 comp rx=0 tx=0).stop 2024-08-18T22:20:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5cd200640 1 -- 172.21.15.5:0/3795463363 shutdown_connections 2024-08-18T22:20:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5cd200640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5a80678c0 0x7fb5a8069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5cd200640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c8156550 0x7fb5c81569d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5cd200640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5c80b0f20 0x7fb5c80b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5cd200640 1 --2- 172.21.15.5:0/3795463363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ac0039c0 0x7fb5c8145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5cd200640 1 -- 172.21.15.5:0/3795463363 >> 172.21.15.5:0/3795463363 conn(0x7fb5c80b1dc0 msgr2=0x7fb5c815d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.485+0000 7fb5cd200640 1 -- 172.21.15.5:0/3795463363 shutdown_connections 2024-08-18T22:20:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.489+0000 7fb5cd200640 1 -- 172.21.15.5:0/3795463363 wait complete. 2024-08-18T22:20:19.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:20:19.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880fe00640 1 Processor -- start 2024-08-18T22:20:19.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880fe00640 1 -- start start 2024-08-18T22:20:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880fe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f88080caec0 0x7f880806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 0x7f8808071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880fe00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88080cb300 con 0x7f880815a800 2024-08-18T22:20:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880fe00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f880806f410 con 0x7f88080caec0 2024-08-18T22:20:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880fe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f88080cb5d0 con 0x7f880806ef80 2024-08-18T22:20:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880de00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 0x7f8808071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880ca00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f88080caec0 0x7f880806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880d400640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f880815a800 0x7f88080ce280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:55962/0 (socket says 172.21.15.5:55962) 2024-08-18T22:20:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880de00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 0x7f8808071b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47524/0 (socket says 172.21.15.5:47524) 2024-08-18T22:20:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.681+0000 7f880d400640 1 -- 172.21.15.5:0/2291339612 learned_addr learned my addr 172.21.15.5:0/2291339612 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.685+0000 7f880ca00640 1 -- 172.21.15.5:0/2291339612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 msgr2=0x7f8808071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.685+0000 7f880ca00640 1 --2- 172.21.15.5:0/2291339612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 0x7f8808071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.685+0000 7f880ca00640 1 -- 172.21.15.5:0/2291339612 >> v1:172.21.15.117:6789/0 conn(0x7f880815a800 legacy=0x7f88080ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:19.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.685+0000 7f880ca00640 1 -- 172.21.15.5:0/2291339612 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8808072e60 con 0x7f88080caec0 2024-08-18T22:20:19.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.685+0000 7f880de00640 1 --2- 172.21.15.5:0/2291339612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 0x7f8808071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:20:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.685+0000 7f880ca00640 1 --2- 172.21.15.5:0/2291339612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88080caec0 0x7f880806ea40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f87f400a960 tx=0x7f87f401e980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63289f52f346f34d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:19.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.685+0000 7f8807e00640 1 -- 172.21.15.5:0/2291339612 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f40b4070 con 0x7f88080caec0 2024-08-18T22:20:19.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.685+0000 7f8807e00640 1 -- 172.21.15.5:0/2291339612 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f40a78e0 con 0x7f88080caec0 2024-08-18T22:20:19.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.685+0000 7f8807e00640 1 -- 172.21.15.5:0/2291339612 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f400b040 con 0x7f88080caec0 2024-08-18T22:20:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.685+0000 7f880fe00640 1 -- 172.21.15.5:0/2291339612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88080caec0 msgr2=0x7f880806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.685+0000 7f880fe00640 1 --2- 172.21.15.5:0/2291339612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88080caec0 0x7f880806ea40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f87f400a960 tx=0x7f87f401e980 comp rx=0 tx=0).stop 2024-08-18T22:20:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 -- 172.21.15.5:0/2291339612 shutdown_connections 2024-08-18T22:20:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 --2- 172.21.15.5:0/2291339612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 0x7f8808071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 --2- 172.21.15.5:0/2291339612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88080caec0 0x7f880806ea40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 -- 172.21.15.5:0/2291339612 >> 172.21.15.5:0/2291339612 conn(0x7f88080b1c50 msgr2=0x7f88080b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 -- 172.21.15.5:0/2291339612 shutdown_connections 2024-08-18T22:20:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 -- 172.21.15.5:0/2291339612 wait complete. 2024-08-18T22:20:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 Processor -- start 2024-08-18T22:20:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 -- start start 2024-08-18T22:20:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 0x7f880809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88080caec0 0x7f880809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f880815a800 0x7f88080b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f88080721e0 con 0x7f880815a800 2024-08-18T22:20:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8808072060 con 0x7f88080caec0 2024-08-18T22:20:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880fe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8808072360 con 0x7f880806ef80 2024-08-18T22:20:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f880815a800 0x7f88080b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880d400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 0x7f880809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880ca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88080caec0 0x7f880809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f880815a800 0x7f88080b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41510/0 (socket says 172.21.15.5:41510) 2024-08-18T22:20:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880de00640 1 -- 172.21.15.5:0/2684076441 learned_addr learned my addr 172.21.15.5:0/2684076441 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880d400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 0x7f880809d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47528/0 (socket says 172.21.15.5:47528) 2024-08-18T22:20:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880de00640 1 -- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 msgr2=0x7f880809d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880de00640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 0x7f880809d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880de00640 1 -- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88080caec0 msgr2=0x7f880809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880de00640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88080caec0 0x7f880809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880de00640 1 -- 172.21.15.5:0/2684076441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8808157aa0 con 0x7f880815a800 2024-08-18T22:20:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.689+0000 7f880de00640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f880815a800 0x7f88080b34d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f880000efc0 tx=0x7f8800009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.693+0000 7f8805600640 1 -- 172.21.15.5:0/2684076441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800018030 con 0x7f880815a800 2024-08-18T22:20:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.693+0000 7f8805600640 1 -- 172.21.15.5:0/2684076441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880000cde0 con 0x7f880815a800 2024-08-18T22:20:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.693+0000 7f880fe00640 1 -- 172.21.15.5:0/2684076441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880809af80 con 0x7f880815a800 2024-08-18T22:20:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.693+0000 7f8805600640 1 -- 172.21.15.5:0/2684076441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800003bc0 con 0x7f880815a800 2024-08-18T22:20:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.693+0000 7f880fe00640 1 -- 172.21.15.5:0/2684076441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88080b3a10 con 0x7f880815a800 2024-08-18T22:20:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.693+0000 7f880fe00640 1 -- 172.21.15.5:0/2684076441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8808071b20 con 0x7f880815a800 2024-08-18T22:20:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.693+0000 7f8805600640 1 -- 172.21.15.5:0/2684076441 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f880001b070 con 0x7f880815a800 2024-08-18T22:20:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.693+0000 7f8805600640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87e80678f0 0x7f87e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.693+0000 7f8805600640 1 -- 172.21.15.5:0/2684076441 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f8800086780 con 0x7f880815a800 2024-08-18T22:20:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.693+0000 7f880d400640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87e80678f0 0x7f87e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.693+0000 7f880d400640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87e80678f0 0x7f87e8069db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f87fc005890 tx=0x7f87fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:19.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.697+0000 7f8805600640 1 -- 172.21.15.5:0/2684076441 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8800022070 con 0x7f880815a800 2024-08-18T22:20:19.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.869+0000 7f880fe00640 1 -- 172.21.15.5:0/2684076441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88080cd910 con 0x7f880815a800 2024-08-18T22:20:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.869+0000 7f8805600640 1 -- 172.21.15.5:0/2684076441 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16883 (secure 0 0 0) 0x7f880809af80 con 0x7f880815a800 2024-08-18T22:20:19.872 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:19.872 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":38,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:20:18.894736+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:20:16.626037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-08-18T22:20:17.895529+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:20:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.869+0000 7f880fe00640 1 -- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87e80678f0 msgr2=0x7f87e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.869+0000 7f880fe00640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87e80678f0 0x7f87e8069db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f87fc005890 tx=0x7f87fc009040 comp rx=0 tx=0).stop 2024-08-18T22:20:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.873+0000 7f880fe00640 1 -- 172.21.15.5:0/2684076441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f880815a800 msgr2=0x7f88080b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.873+0000 7f880fe00640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f880815a800 0x7f88080b34d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f880000efc0 tx=0x7f8800009f90 comp rx=0 tx=0).stop 2024-08-18T22:20:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.873+0000 7f880fe00640 1 -- 172.21.15.5:0/2684076441 shutdown_connections 2024-08-18T22:20:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.873+0000 7f880fe00640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87e80678f0 0x7f87e8069db0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.873+0000 7f880fe00640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f880815a800 0x7f88080b34d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.873+0000 7f880fe00640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88080caec0 0x7f880809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.873+0000 7f880fe00640 1 --2- 172.21.15.5:0/2684076441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f880806ef80 0x7f880809d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.873+0000 7f880fe00640 1 -- 172.21.15.5:0/2684076441 >> 172.21.15.5:0/2684076441 conn(0x7f88080b1c50 msgr2=0x7f88080cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.873+0000 7f880fe00640 1 -- 172.21.15.5:0/2684076441 shutdown_connections 2024-08-18T22:20:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:19.873+0000 7f880fe00640 1 -- 172.21.15.5:0/2684076441 wait complete. 2024-08-18T22:20:19.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:20:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9bb3000640 1 Processor -- start 2024-08-18T22:20:20.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9bb3000640 1 -- start start 2024-08-18T22:20:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9bb3000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bac15bed0 0x7f9bac0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9bb3000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9bac06da70 0x7f9bac06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9bb3000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bac073c80 con 0x7f9bac0cb390 2024-08-18T22:20:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9bb3000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9bac06e3e0 con 0x7f9bac15bed0 2024-08-18T22:20:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9bb3000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9bac0ca5d0 con 0x7f9bac06da70 2024-08-18T22:20:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9babe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bac15bed0 0x7f9bac0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9babe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bac15bed0 0x7f9bac0735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41524/0 (socket says 172.21.15.5:41524) 2024-08-18T22:20:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9babe00640 1 -- 172.21.15.5:0/3373542058 learned_addr learned my addr 172.21.15.5:0/3373542058 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9bb1000640 1 --2- 172.21.15.5:0/3373542058 >> v2:172.21.15.117:3300/0 conn(0x7f9bac06da70 0x7f9bac06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9babe00640 1 -- 172.21.15.5:0/3373542058 >> v2:172.21.15.117:3300/0 conn(0x7f9bac06da70 msgr2=0x7f9bac06dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9babe00640 1 --2- 172.21.15.5:0/3373542058 >> v2:172.21.15.117:3300/0 conn(0x7f9bac06da70 0x7f9bac06dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9babe00640 1 -- 172.21.15.5:0/3373542058 >> v1:172.21.15.117:6789/0 conn(0x7f9bac0cb390 legacy=0x7f9bac071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.033+0000 7f9babe00640 1 -- 172.21.15.5:0/3373542058 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bac0ca8b0 con 0x7f9bac15bed0 2024-08-18T22:20:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9babe00640 1 --2- 172.21.15.5:0/3373542058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bac15bed0 0x7f9bac0735a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0cfe50 tx=0x7f9b9c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13778ed1cee0512 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9bab400640 1 -- 172.21.15.5:0/3373542058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0aa650 con 0x7f9bac15bed0 2024-08-18T22:20:20.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9bab400640 1 -- 172.21.15.5:0/3373542058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c0af070 con 0x7f9bac15bed0 2024-08-18T22:20:20.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9bab400640 1 -- 172.21.15.5:0/3373542058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0aaa10 con 0x7f9bac15bed0 2024-08-18T22:20:20.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9bb3000640 1 -- 172.21.15.5:0/3373542058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bac15bed0 msgr2=0x7f9bac0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:20.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9bb3000640 1 --2- 172.21.15.5:0/3373542058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bac15bed0 0x7f9bac0735a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0cfe50 tx=0x7f9b9c01c4f0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9bb3000640 1 -- 172.21.15.5:0/3373542058 shutdown_connections 2024-08-18T22:20:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9bb3000640 1 --2- 172.21.15.5:0/3373542058 >> v2:172.21.15.117:3300/0 conn(0x7f9bac06da70 0x7f9bac06dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9bb3000640 1 --2- 172.21.15.5:0/3373542058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bac15bed0 0x7f9bac0735a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9bb3000640 1 -- 172.21.15.5:0/3373542058 >> 172.21.15.5:0/3373542058 conn(0x7f9bac0b1c50 msgr2=0x7f9bac0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9bb3000640 1 -- 172.21.15.5:0/3373542058 shutdown_connections 2024-08-18T22:20:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.037+0000 7f9bb3000640 1 -- 172.21.15.5:0/3373542058 wait complete. 2024-08-18T22:20:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9bb3000640 1 Processor -- start 2024-08-18T22:20:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9bb3000640 1 -- start start 2024-08-18T22:20:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9bb3000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bac06da70 0x7f9bac0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9bb3000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bac0cb390 0x7f9bac1fa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9bb3000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bac15bed0 0x7f9bac142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9bb3000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9bac168520 con 0x7f9bac0cb390 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9bb3000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9bac1683a0 con 0x7f9bac06da70 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9bb3000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9bac1686a0 con 0x7f9bac15bed0 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bac0cb390 0x7f9bac1fa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bac0cb390 0x7f9bac1fa9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41528/0 (socket says 172.21.15.5:41528) 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba3400640 1 -- 172.21.15.5:0/3545848094 learned_addr learned my addr 172.21.15.5:0/3545848094 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9babe00640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bac06da70 0x7f9bac0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9bb1000640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bac15bed0 0x7f9bac142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba3400640 1 -- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bac15bed0 msgr2=0x7f9bac142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba3400640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bac15bed0 0x7f9bac142f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba3400640 1 -- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bac06da70 msgr2=0x7f9bac0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba3400640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bac06da70 0x7f9bac0cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba3400640 1 -- 172.21.15.5:0/3545848094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bac1447e0 con 0x7f9bac0cb390 2024-08-18T22:20:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba3400640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bac0cb390 0x7f9bac1fa9d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400c790 tx=0x7f9b9400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba8c00640 1 -- 172.21.15.5:0/3545848094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94016020 con 0x7f9bac0cb390 2024-08-18T22:20:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba8c00640 1 -- 172.21.15.5:0/3545848094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b94006d60 con 0x7f9bac0cb390 2024-08-18T22:20:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9bb3000640 1 -- 172.21.15.5:0/3545848094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bac142920 con 0x7f9bac0cb390 2024-08-18T22:20:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9ba8c00640 1 -- 172.21.15.5:0/3545848094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94003bc0 con 0x7f9bac0cb390 2024-08-18T22:20:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.041+0000 7f9bb3000640 1 -- 172.21.15.5:0/3545848094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bac143d00 con 0x7f9bac0cb390 2024-08-18T22:20:20.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.045+0000 7f9bb3000640 1 -- 172.21.15.5:0/3545848094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bac06dea0 con 0x7f9bac0cb390 2024-08-18T22:20:20.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.045+0000 7f9ba8c00640 1 -- 172.21.15.5:0/3545848094 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b940050d0 con 0x7f9bac0cb390 2024-08-18T22:20:20.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.045+0000 7f9ba8c00640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b880678c0 0x7f9b88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.045+0000 7f9ba8c00640 1 -- 172.21.15.5:0/3545848094 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f9b94085c30 con 0x7f9bac0cb390 2024-08-18T22:20:20.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.045+0000 7f9babe00640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b880678c0 0x7f9b88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.045+0000 7f9babe00640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b880678c0 0x7f9b88069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0ae000 tx=0x7f9b9c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:20.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.049+0000 7f9ba8c00640 1 -- 172.21.15.5:0/3545848094 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9b94020020 con 0x7f9bac0cb390 2024-08-18T22:20:20.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.213+0000 7f9bb3000640 1 -- 172.21.15.5:0/3545848094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9bac0cc560 con 0x7f9bac0cb390 2024-08-18T22:20:20.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9ba8c00640 1 -- 172.21.15.5:0/3545848094 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16883 (secure 0 0 0) 0x7f9b940565d0 con 0x7f9bac0cb390 2024-08-18T22:20:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:20.218 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":38,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:20:18.894736+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:20:16.626037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-08-18T22:20:17.895529+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:20:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 -- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b880678c0 msgr2=0x7f9b88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b880678c0 0x7f9b88069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0ae000 tx=0x7f9b9c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:20:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 -- 172.21.15.5:0/3545848094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bac0cb390 msgr2=0x7f9bac1fa9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bac0cb390 0x7f9bac1fa9d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400c790 tx=0x7f9b9400cb90 comp rx=0 tx=0).stop 2024-08-18T22:20:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 -- 172.21.15.5:0/3545848094 shutdown_connections 2024-08-18T22:20:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b880678c0 0x7f9b88069d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bac15bed0 0x7f9bac142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bac0cb390 0x7f9bac1fa9d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 --2- 172.21.15.5:0/3545848094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bac06da70 0x7f9bac0cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 -- 172.21.15.5:0/3545848094 >> 172.21.15.5:0/3545848094 conn(0x7f9bac0b1c50 msgr2=0x7f9bac156880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:20.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 -- 172.21.15.5:0/3545848094 shutdown_connections 2024-08-18T22:20:20.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.217+0000 7f9bb3000640 1 -- 172.21.15.5:0/3545848094 wait complete. 2024-08-18T22:20:20.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:20:20.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.381+0000 7f1947000640 1 Processor -- start 2024-08-18T22:20:20.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.381+0000 7f1947000640 1 -- start start 2024-08-18T22:20:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.381+0000 7f1947000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194015b0c0 0x7f194006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.381+0000 7f1947000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19400b40c0 0x7f19400b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.381+0000 7f1947000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1940072a30 0x7f1940072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.381+0000 7f1947000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f19400b3d70 con 0x7f19400b40c0 2024-08-18T22:20:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.381+0000 7f1947000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f19400b4a40 con 0x7f1940072a30 2024-08-18T22:20:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.381+0000 7f1947000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f19400b31f0 con 0x7f194015b0c0 2024-08-18T22:20:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19400b40c0 0x7f19400b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19400b40c0 0x7f19400b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41530/0 (socket says 172.21.15.5:41530) 2024-08-18T22:20:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193f400640 1 -- 172.21.15.5:0/2682725662 learned_addr learned my addr 172.21.15.5:0/2682725662 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193fe00640 1 --2- 172.21.15.5:0/2682725662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194015b0c0 0x7f194006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f1945000640 1 --2- 172.21.15.5:0/2682725662 >> v2:172.21.15.117:3300/0 conn(0x7f1940072a30 0x7f1940072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193f400640 1 -- 172.21.15.5:0/2682725662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194015b0c0 msgr2=0x7f194006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:20.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193f400640 1 --2- 172.21.15.5:0/2682725662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194015b0c0 0x7f194006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193f400640 1 -- 172.21.15.5:0/2682725662 >> v2:172.21.15.117:3300/0 conn(0x7f1940072a30 msgr2=0x7f1940072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:20.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193f400640 1 --2- 172.21.15.5:0/2682725662 >> v2:172.21.15.117:3300/0 conn(0x7f1940072a30 0x7f1940072ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193f400640 1 -- 172.21.15.5:0/2682725662 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19400b34d0 con 0x7f19400b40c0 2024-08-18T22:20:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193f400640 1 --2- 172.21.15.5:0/2682725662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19400b40c0 0x7f19400b4500 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f194015ec00 tx=0x7f192c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c4026017e12e52 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193ea00640 1 -- 172.21.15.5:0/2682725662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c0b0070 con 0x7f19400b40c0 2024-08-18T22:20:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193ea00640 1 -- 172.21.15.5:0/2682725662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f192c0ab600 con 0x7f19400b40c0 2024-08-18T22:20:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.385+0000 7f193ea00640 1 -- 172.21.15.5:0/2682725662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c0ab9d0 con 0x7f19400b40c0 2024-08-18T22:20:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 -- 172.21.15.5:0/2682725662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19400b40c0 msgr2=0x7f19400b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 --2- 172.21.15.5:0/2682725662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19400b40c0 0x7f19400b4500 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f194015ec00 tx=0x7f192c01c3d0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 -- 172.21.15.5:0/2682725662 shutdown_connections 2024-08-18T22:20:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 --2- 172.21.15.5:0/2682725662 >> v2:172.21.15.117:3300/0 conn(0x7f1940072a30 0x7f1940072ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 --2- 172.21.15.5:0/2682725662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19400b40c0 0x7f19400b4500 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 --2- 172.21.15.5:0/2682725662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194015b0c0 0x7f194006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 -- 172.21.15.5:0/2682725662 >> 172.21.15.5:0/2682725662 conn(0x7f19400b1dc0 msgr2=0x7f19400b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:20.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 -- 172.21.15.5:0/2682725662 shutdown_connections 2024-08-18T22:20:20.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 -- 172.21.15.5:0/2682725662 wait complete. 2024-08-18T22:20:20.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 Processor -- start 2024-08-18T22:20:20.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 -- start start 2024-08-18T22:20:20.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1940072a30 0x7f19400999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19400b40c0 0x7f19400aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f194015b0c0 0x7f1940155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f194015b620 con 0x7f19400b40c0 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f194015b4a0 con 0x7f194015b0c0 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1947000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f19400737f0 con 0x7f1940072a30 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f193f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19400b40c0 0x7f19400aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f193fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1940072a30 0x7f19400999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f193f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19400b40c0 0x7f19400aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41534/0 (socket says 172.21.15.5:41534) 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f193f400640 1 -- 172.21.15.5:0/1996253214 learned_addr learned my addr 172.21.15.5:0/1996253214 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f1945000640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f194015b0c0 0x7f1940155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f193f400640 1 -- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1940072a30 msgr2=0x7f19400999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f193f400640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1940072a30 0x7f19400999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f193f400640 1 -- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f194015b0c0 msgr2=0x7f1940155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:20.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f193f400640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f194015b0c0 0x7f1940155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:20.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.389+0000 7f193f400640 1 -- 172.21.15.5:0/1996253214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19400ad4a0 con 0x7f19400b40c0 2024-08-18T22:20:20.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.393+0000 7f193f400640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19400b40c0 0x7f19400aecc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f192c01aa80 tx=0x7f192c019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:20.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.393+0000 7f1937e00640 1 -- 172.21.15.5:0/1996253214 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c0b9070 con 0x7f19400b40c0 2024-08-18T22:20:20.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.393+0000 7f1937e00640 1 -- 172.21.15.5:0/1996253214 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f192c0b4400 con 0x7f19400b40c0 2024-08-18T22:20:20.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.393+0000 7f1947000640 1 -- 172.21.15.5:0/1996253214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19400ad780 con 0x7f19400b40c0 2024-08-18T22:20:20.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.393+0000 7f1937e00640 1 -- 172.21.15.5:0/1996253214 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c0b0040 con 0x7f19400b40c0 2024-08-18T22:20:20.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.393+0000 7f1947000640 1 -- 172.21.15.5:0/1996253214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19400add40 con 0x7f19400b40c0 2024-08-18T22:20:20.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.393+0000 7f1947000640 1 -- 172.21.15.5:0/1996253214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f194006f670 con 0x7f19400b40c0 2024-08-18T22:20:20.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.393+0000 7f1937e00640 1 -- 172.21.15.5:0/1996253214 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f192c0bc070 con 0x7f19400b40c0 2024-08-18T22:20:20.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.393+0000 7f1937e00640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19200678c0 0x7f1920069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:20.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.393+0000 7f1937e00640 1 -- 172.21.15.5:0/1996253214 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f192c11f070 con 0x7f19400b40c0 2024-08-18T22:20:20.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.393+0000 7f193fe00640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19200678c0 0x7f1920069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:20.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.397+0000 7f193fe00640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19200678c0 0x7f1920069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f19300079c0 tx=0x7f1930008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:20.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.397+0000 7f1937e00640 1 -- 172.21.15.5:0/1996253214 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f192c016110 con 0x7f19400b40c0 2024-08-18T22:20:20.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:20.601+0000 7f1947000640 1 -- 172.21.15.5:0/1996253214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f19400ceb70 con 0x7f19400b40c0 2024-08-18T22:20:21.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.505+0000 7f1937e00640 1 -- 172.21.15.5:0/1996253214 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f192c0ef330 con 0x7f19400b40c0 2024-08-18T22:20:21.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 -- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19200678c0 msgr2=0x7f1920069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:21.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19200678c0 0x7f1920069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f19300079c0 tx=0x7f1930008040 comp rx=0 tx=0).stop 2024-08-18T22:20:21.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 -- 172.21.15.5:0/1996253214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19400b40c0 msgr2=0x7f19400aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:21.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19400b40c0 0x7f19400aecc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f192c01aa80 tx=0x7f192c019170 comp rx=0 tx=0).stop 2024-08-18T22:20:21.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 -- 172.21.15.5:0/1996253214 shutdown_connections 2024-08-18T22:20:21.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19200678c0 0x7f1920069d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f194015b0c0 0x7f1940155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19400b40c0 0x7f19400aecc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 --2- 172.21.15.5:0/1996253214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1940072a30 0x7f19400999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 -- 172.21.15.5:0/1996253214 >> 172.21.15.5:0/1996253214 conn(0x7f19400b1dc0 msgr2=0x7f19400cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:21.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 -- 172.21.15.5:0/1996253214 shutdown_connections 2024-08-18T22:20:21.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.509+0000 7f1947000640 1 -- 172.21.15.5:0/1996253214 wait complete. 2024-08-18T22:20:21.535 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:20:21.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:20:21.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:20:21.588 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:20:21.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.681+0000 7f8026a00640 1 Processor -- start 2024-08-18T22:20:21.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.681+0000 7f8026a00640 1 -- start start 2024-08-18T22:20:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.681+0000 7f8026a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802015b0c0 0x7f802006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.681+0000 7f8026a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f80200b40c0 0x7f80200b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.681+0000 7f8026a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8020072a30 0x7f8020072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.681+0000 7f8026a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f80200b3d70 con 0x7f8020072a30 2024-08-18T22:20:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.681+0000 7f8026a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f80200b4a40 con 0x7f80200b40c0 2024-08-18T22:20:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.681+0000 7f8026a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f80200b31f0 con 0x7f802015b0c0 2024-08-18T22:20:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.681+0000 7f8024a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8020072a30 0x7f8020072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.681+0000 7f8024a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8020072a30 0x7f8020072ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41538/0 (socket says 172.21.15.5:41538) 2024-08-18T22:20:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.681+0000 7f8024a00640 1 -- 172.21.15.5:0/3284429435 learned_addr learned my addr 172.21.15.5:0/3284429435 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f8017400640 1 --2- 172.21.15.5:0/3284429435 >> v2:172.21.15.117:3300/0 conn(0x7f80200b40c0 0x7f80200b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:21.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f801fe00640 1 --2- 172.21.15.5:0/3284429435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802015b0c0 0x7f802006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f8024a00640 1 -- 172.21.15.5:0/3284429435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802015b0c0 msgr2=0x7f802006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f8024a00640 1 --2- 172.21.15.5:0/3284429435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802015b0c0 0x7f802006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f8024a00640 1 -- 172.21.15.5:0/3284429435 >> v2:172.21.15.117:3300/0 conn(0x7f80200b40c0 msgr2=0x7f80200b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f8024a00640 1 --2- 172.21.15.5:0/3284429435 >> v2:172.21.15.117:3300/0 conn(0x7f80200b40c0 0x7f80200b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f8024a00640 1 -- 172.21.15.5:0/3284429435 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80200b34d0 con 0x7f8020072a30 2024-08-18T22:20:21.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f8024a00640 1 --2- 172.21.15.5:0/3284429435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8020072a30 0x7f8020072ea0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f802006d330 tx=0x7f801801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e7a14eca821bf5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:21.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f801f400640 1 -- 172.21.15.5:0/3284429435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80180b2070 con 0x7f8020072a30 2024-08-18T22:20:21.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f801f400640 1 -- 172.21.15.5:0/3284429435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80180ad640 con 0x7f8020072a30 2024-08-18T22:20:21.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f801f400640 1 -- 172.21.15.5:0/3284429435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80180ada10 con 0x7f8020072a30 2024-08-18T22:20:21.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f8026a00640 1 -- 172.21.15.5:0/3284429435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8020072a30 msgr2=0x7f8020072ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.685+0000 7f8026a00640 1 --2- 172.21.15.5:0/3284429435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8020072a30 0x7f8020072ea0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f802006d330 tx=0x7f801801c3d0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 -- 172.21.15.5:0/3284429435 shutdown_connections 2024-08-18T22:20:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 --2- 172.21.15.5:0/3284429435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8020072a30 0x7f8020072ea0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 --2- 172.21.15.5:0/3284429435 >> v2:172.21.15.117:3300/0 conn(0x7f80200b40c0 0x7f80200b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 --2- 172.21.15.5:0/3284429435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f802015b0c0 0x7f802006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 -- 172.21.15.5:0/3284429435 >> 172.21.15.5:0/3284429435 conn(0x7f80200b1dc0 msgr2=0x7f80200b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:21.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 -- 172.21.15.5:0/3284429435 shutdown_connections 2024-08-18T22:20:21.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 -- 172.21.15.5:0/3284429435 wait complete. 2024-08-18T22:20:21.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 Processor -- start 2024-08-18T22:20:21.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 -- start start 2024-08-18T22:20:21.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8020072a30 0x7f8020152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:21.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200b40c0 0x7f8020151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:21.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f802015b0c0 0x7f8020099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:21.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f802015b620 con 0x7f80200b40c0 2024-08-18T22:20:21.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f802015b4a0 con 0x7f802015b0c0 2024-08-18T22:20:21.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8026a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f80200737f0 con 0x7f8020072a30 2024-08-18T22:20:21.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8017400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200b40c0 0x7f8020151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:21.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8017400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200b40c0 0x7f8020151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41546/0 (socket says 172.21.15.5:41546) 2024-08-18T22:20:21.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8017400640 1 -- 172.21.15.5:0/358533069 learned_addr learned my addr 172.21.15.5:0/358533069 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:21.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f801fe00640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8020072a30 0x7f8020152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:21.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8024a00640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f802015b0c0 0x7f8020099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:21.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8017400640 1 -- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8020072a30 msgr2=0x7f8020152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:21.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8017400640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8020072a30 0x7f8020152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8017400640 1 -- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f802015b0c0 msgr2=0x7f8020099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:21.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8017400640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f802015b0c0 0x7f8020099980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:21.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8017400640 1 -- 172.21.15.5:0/358533069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8020099ec0 con 0x7f80200b40c0 2024-08-18T22:20:21.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f8017400640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200b40c0 0x7f8020151640 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f800800d7d0 tx=0x7f800800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:21.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.689+0000 7f801cc00640 1 -- 172.21.15.5:0/358533069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008018030 con 0x7f80200b40c0 2024-08-18T22:20:21.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.693+0000 7f801cc00640 1 -- 172.21.15.5:0/358533069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8008004020 con 0x7f80200b40c0 2024-08-18T22:20:21.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.693+0000 7f801cc00640 1 -- 172.21.15.5:0/358533069 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008004210 con 0x7f80200b40c0 2024-08-18T22:20:21.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.693+0000 7f8026a00640 1 -- 172.21.15.5:0/358533069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80200b01f0 con 0x7f80200b40c0 2024-08-18T22:20:21.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.693+0000 7f8026a00640 1 -- 172.21.15.5:0/358533069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80200b07b0 con 0x7f80200b40c0 2024-08-18T22:20:21.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.693+0000 7f8026a00640 1 -- 172.21.15.5:0/358533069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f802006f670 con 0x7f80200b40c0 2024-08-18T22:20:21.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.693+0000 7f801cc00640 1 -- 172.21.15.5:0/358533069 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f800801b070 con 0x7f80200b40c0 2024-08-18T22:20:21.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.693+0000 7f801cc00640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ffc0678c0 0x7f7ffc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:21.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.693+0000 7f801cc00640 1 -- 172.21.15.5:0/358533069 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8008086030 con 0x7f80200b40c0 2024-08-18T22:20:21.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.693+0000 7f801fe00640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ffc0678c0 0x7f7ffc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:21.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.693+0000 7f801fe00640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ffc0678c0 0x7f7ffc069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8010003fd0 tx=0x7f80100039a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:21.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.697+0000 7f801cc00640 1 -- 172.21.15.5:0/358533069 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f80080569d0 con 0x7f80200b40c0 2024-08-18T22:20:21.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:21.897+0000 7f8026a00640 1 -- 172.21.15.5:0/358533069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f80200cb670 con 0x7f80200b40c0 2024-08-18T22:20:22.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.513+0000 7f801cc00640 1 -- 172.21.15.5:0/358533069 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f80080562d0 con 0x7f80200b40c0 2024-08-18T22:20:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 -- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ffc0678c0 msgr2=0x7f7ffc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ffc0678c0 0x7f7ffc069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8010003fd0 tx=0x7f80100039a0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 -- 172.21.15.5:0/358533069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200b40c0 msgr2=0x7f8020151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200b40c0 0x7f8020151640 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f800800d7d0 tx=0x7f800800dc90 comp rx=0 tx=0).stop 2024-08-18T22:20:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 -- 172.21.15.5:0/358533069 shutdown_connections 2024-08-18T22:20:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ffc0678c0 0x7f7ffc069d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f802015b0c0 0x7f8020099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80200b40c0 0x7f8020151640 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 --2- 172.21.15.5:0/358533069 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8020072a30 0x7f8020152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 -- 172.21.15.5:0/358533069 >> 172.21.15.5:0/358533069 conn(0x7f80200b1dc0 msgr2=0x7f80200cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 -- 172.21.15.5:0/358533069 shutdown_connections 2024-08-18T22:20:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.517+0000 7f8026a00640 1 -- 172.21.15.5:0/358533069 wait complete. 2024-08-18T22:20:22.541 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:20:22.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:20:22.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.681+0000 7ff57d600640 1 Processor -- start 2024-08-18T22:20:22.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.681+0000 7ff57d600640 1 -- start start 2024-08-18T22:20:22.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff57d600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff578070730 0x7ff578070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:22.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff57d600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff578070430 con 0x7ff57815dda0 2024-08-18T22:20:22.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff57d600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff57815eb60 con 0x7ff578161960 2024-08-18T22:20:22.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff57d600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff5780710e0 con 0x7ff578070730 2024-08-18T22:20:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff56e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff578070730 0x7ff578070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff577400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff57815dda0 0x7ff57815e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43286/0 (socket says 172.21.15.5:43286) 2024-08-18T22:20:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff577400640 1 -- 172.21.15.5:0/3137809121 learned_addr learned my addr 172.21.15.5:0/3137809121 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff56e000640 1 -- 172.21.15.5:0/3137809121 >> v1:172.21.15.117:6789/0 conn(0x7ff578161960 legacy=0x7ff57806fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff56e000640 1 -- 172.21.15.5:0/3137809121 >> v1:172.21.15.5:6789/0 conn(0x7ff57815dda0 legacy=0x7ff57815e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff576000640 1 -- 172.21.15.5:0/3137809121 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230916575 0 0) 0x7ff57815eb60 con 0x7ff578161960 2024-08-18T22:20:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff56e000640 1 -- 172.21.15.5:0/3137809121 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57815ee40 con 0x7ff578070730 2024-08-18T22:20:22.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.685+0000 7ff56e000640 1 --2- 172.21.15.5:0/3137809121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff578070730 0x7ff578070ba0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff5600097c0 tx=0x7ff56001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541110c988875393 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:22.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff576000640 1 -- 172.21.15.5:0/3137809121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5600b0070 con 0x7ff578070730 2024-08-18T22:20:22.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff576000640 1 -- 172.21.15.5:0/3137809121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5600ab600 con 0x7ff578070730 2024-08-18T22:20:22.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff576000640 1 -- 172.21.15.5:0/3137809121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5600ab9d0 con 0x7ff578070730 2024-08-18T22:20:22.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 -- 172.21.15.5:0/3137809121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff578070730 msgr2=0x7ff578070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:22.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 --2- 172.21.15.5:0/3137809121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff578070730 0x7ff578070ba0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff5600097c0 tx=0x7ff56001c330 comp rx=0 tx=0).stop 2024-08-18T22:20:22.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 -- 172.21.15.5:0/3137809121 shutdown_connections 2024-08-18T22:20:22.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 --2- 172.21.15.5:0/3137809121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff578070730 0x7ff578070ba0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 -- 172.21.15.5:0/3137809121 >> 172.21.15.5:0/3137809121 conn(0x7ff5780d2130 msgr2=0x7ff5780d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:22.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 -- 172.21.15.5:0/3137809121 shutdown_connections 2024-08-18T22:20:22.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 -- 172.21.15.5:0/3137809121 wait complete. 2024-08-18T22:20:22.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 Processor -- start 2024-08-18T22:20:22.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 -- start start 2024-08-18T22:20:22.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff578070730 0x7ff5780c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:22.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57815dda0 0x7ff5780cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:22.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff578161960 0x7ff5780cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff57815e940 con 0x7ff57815dda0 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff57815f400 con 0x7ff578161960 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff57d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff5780c7690 con 0x7ff578070730 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff56e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57815dda0 0x7ff5780cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff56e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57815dda0 0x7ff5780cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41566/0 (socket says 172.21.15.5:41566) 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.689+0000 7ff56e000640 1 -- 172.21.15.5:0/603967949 learned_addr learned my addr 172.21.15.5:0/603967949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff576a00640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff578070730 0x7ff5780c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff577400640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff578161960 0x7ff5780cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56e000640 1 -- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff578070730 msgr2=0x7ff5780c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56e000640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff578070730 0x7ff5780c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56e000640 1 -- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff578161960 msgr2=0x7ff5780cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56e000640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff578161960 0x7ff5780cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56e000640 1 -- 172.21.15.5:0/603967949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5780c7970 con 0x7ff57815dda0 2024-08-18T22:20:22.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff577400640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff578161960 0x7ff5780cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:22.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56e000640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57815dda0 0x7ff5780cade0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff5600ae040 tx=0x7ff56001ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:22.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56f400640 1 -- 172.21.15.5:0/603967949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5600bc070 con 0x7ff57815dda0 2024-08-18T22:20:22.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56f400640 1 -- 172.21.15.5:0/603967949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5600b1040 con 0x7ff57815dda0 2024-08-18T22:20:22.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56f400640 1 -- 172.21.15.5:0/603967949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5600b0050 con 0x7ff57815dda0 2024-08-18T22:20:22.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff57d600640 1 -- 172.21.15.5:0/603967949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5780c7c50 con 0x7ff57815dda0 2024-08-18T22:20:22.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff57d600640 1 -- 172.21.15.5:0/603967949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57815a480 con 0x7ff57815dda0 2024-08-18T22:20:22.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff57d600640 1 -- 172.21.15.5:0/603967949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57815f6e0 con 0x7ff57815dda0 2024-08-18T22:20:22.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56f400640 1 -- 172.21.15.5:0/603967949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5600bf070 con 0x7ff57815dda0 2024-08-18T22:20:22.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56f400640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5540678c0 0x7ff554069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:22.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.693+0000 7ff56f400640 1 -- 172.21.15.5:0/603967949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff56011fcc0 con 0x7ff57815dda0 2024-08-18T22:20:22.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.697+0000 7ff576a00640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5540678c0 0x7ff554069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:22.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.697+0000 7ff576a00640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5540678c0 0x7ff554069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff568000f70 tx=0x7ff568009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:22.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.701+0000 7ff56f400640 1 -- 172.21.15.5:0/603967949 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff560126080 con 0x7ff57815dda0 2024-08-18T22:20:22.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.897+0000 7ff57d600640 1 -- 172.21.15.5:0/603967949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5780d3010 con 0x7ff57815dda0 2024-08-18T22:20:22.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.897+0000 7ff56f400640 1 -- 172.21.15.5:0/603967949 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7ff560015fb0 con 0x7ff57815dda0 2024-08-18T22:20:22.901 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:22.901 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"btime":"2024-08-18T22:20:22:509921+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3746061951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3746061951},{"type":"v1","addr":"172.21.15.117:6836","nonce":3746061951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2422794020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2422794020},{"type":"v1","addr":"172.21.15.117:6837","nonce":2422794020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3630211664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3630211664},{"type":"v1","addr":"172.21.15.5:6835","nonce":3630211664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:20:18.895099+0000","modified":"2024-08-18T22:20:21.900180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/771750285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":771750285},{"type":"v1","addr":"172.21.15.5:6834","nonce":771750285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4908,"qdb_cluster":[4908]},"id":2}]} 2024-08-18T22:20:22.901 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2024-08-18T22:20:22.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 -- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5540678c0 msgr2=0x7ff554069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:22.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5540678c0 0x7ff554069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff568000f70 tx=0x7ff568009040 comp rx=0 tx=0).stop 2024-08-18T22:20:22.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 -- 172.21.15.5:0/603967949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57815dda0 msgr2=0x7ff5780cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:22.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57815dda0 0x7ff5780cade0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff5600ae040 tx=0x7ff56001ab70 comp rx=0 tx=0).stop 2024-08-18T22:20:22.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 -- 172.21.15.5:0/603967949 shutdown_connections 2024-08-18T22:20:22.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5540678c0 0x7ff554069d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff578161960 0x7ff5780cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57815dda0 0x7ff5780cade0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 --2- 172.21.15.5:0/603967949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff578070730 0x7ff5780c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:22.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 -- 172.21.15.5:0/603967949 >> 172.21.15.5:0/603967949 conn(0x7ff5780d2130 msgr2=0x7ff57806fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:22.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 -- 172.21.15.5:0/603967949 shutdown_connections 2024-08-18T22:20:22.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:22.901+0000 7ff57d600640 1 -- 172.21.15.5:0/603967949 wait complete. 2024-08-18T22:20:22.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:20:23.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa984a00640 1 Processor -- start 2024-08-18T22:20:23.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa984a00640 1 -- start start 2024-08-18T22:20:23.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa984a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9800cee40 0x7fa98006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa984a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa98015e840 con 0x7fa98015e460 2024-08-18T22:20:23.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa984a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9800cf320 con 0x7fa9800ca3e0 2024-08-18T22:20:23.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa984a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa9800ae750 con 0x7fa9800cee40 2024-08-18T22:20:23.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97de00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa98015e460 0x7fa9800ae040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43300/0 (socket says 172.21.15.5:43300) 2024-08-18T22:20:23.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97de00640 1 -- 172.21.15.5:0/3529381707 learned_addr learned my addr 172.21.15.5:0/3529381707 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:23.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97d400640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9800cee40 0x7fa98006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3100748544 0 0) 0x7fa98015e840 con 0x7fa98015e460 2024-08-18T22:20:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa964003530 con 0x7fa98015e460 2024-08-18T22:20:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546603922 0 0) 0x7fa9800cf320 con 0x7fa9800ca3e0 2024-08-18T22:20:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa98015e840 con 0x7fa9800ca3e0 2024-08-18T22:20:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3383540408 0 0) 0x7fa964003530 con 0x7fa98015e460 2024-08-18T22:20:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9800cee40 msgr2=0x7fa98006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9800cee40 0x7fa98006c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 >> v1:172.21.15.117:6789/0 conn(0x7fa9800ca3e0 legacy=0x7fa9800d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9800cf600 con 0x7fa98015e460 2024-08-18T22:20:23.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fa970001680 con 0x7fa98015e460 2024-08-18T22:20:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97d400640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9800cee40 0x7fa98006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:20:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 >> v1:172.21.15.5:6789/0 conn(0x7fa98015e460 legacy=0x7fa9800ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa964003b80 0x7fa964003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 0x7fa964004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9640051d0 0x7fa96400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa9800ae750 con 0x7fa964004810 2024-08-18T22:20:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa96400bf70 con 0x7fa9640051d0 2024-08-18T22:20:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa96400c170 con 0x7fa964003b80 2024-08-18T22:20:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97d400640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 0x7fa964004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97de00640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa964003b80 0x7fa964003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.061+0000 7fa97e800640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9640051d0 0x7fa96400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa97d400640 1 -- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa964003b80 msgr2=0x7fa964003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:23.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa97d400640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa964003b80 0x7fa964003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa97d400640 1 -- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9640051d0 msgr2=0x7fa96400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:23.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa97d400640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9640051d0 0x7fa96400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa97d400640 1 -- 172.21.15.5:0/3529381707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa964003530 con 0x7fa964004810 2024-08-18T22:20:23.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa97d400640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 0x7fa964004c90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa9800b0360 tx=0x7fa96c01caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f426076c88ce776f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:23.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c009810 con 0x7fa964004810 2024-08-18T22:20:23.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa96c004030 con 0x7fa964004810 2024-08-18T22:20:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa97ca00640 1 -- 172.21.15.5:0/3529381707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0041e0 con 0x7fa964004810 2024-08-18T22:20:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa984a00640 1 -- 172.21.15.5:0/3529381707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 msgr2=0x7fa964004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa984a00640 1 --2- 172.21.15.5:0/3529381707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 0x7fa964004c90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa9800b0360 tx=0x7fa96c01caf0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa97e800640 1 -- 172.21.15.5:0/3529381707 reap_dead start 2024-08-18T22:20:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa984a00640 1 -- 172.21.15.5:0/3529381707 shutdown_connections 2024-08-18T22:20:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.065+0000 7fa984a00640 1 -- 172.21.15.5:0/3529381707 >> 172.21.15.5:0/3529381707 conn(0x7fa98009aa40 msgr2=0x7fa9800b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 -- 172.21.15.5:0/3529381707 shutdown_connections 2024-08-18T22:20:23.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 -- 172.21.15.5:0/3529381707 wait complete. 2024-08-18T22:20:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 Processor -- start 2024-08-18T22:20:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 -- start start 2024-08-18T22:20:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 0x7fa9800b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98014fb30 0x7fa9801614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9800b4060 0x7fa9800b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa9800cfea0 con 0x7fa964004810 2024-08-18T22:20:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa9800cfbc0 con 0x7fa9800b4060 2024-08-18T22:20:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa9800b3620 con 0x7fa98014fb30 2024-08-18T22:20:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa97de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 0x7fa9800b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa97de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 0x7fa9800b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41576/0 (socket says 172.21.15.5:41576) 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa97de00640 1 -- 172.21.15.5:0/1144418800 learned_addr learned my addr 172.21.15.5:0/1144418800 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa97d400640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98014fb30 0x7fa9801614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa97e800640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9800b4060 0x7fa9800b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa97de00640 1 -- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98014fb30 msgr2=0x7fa9801614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa97de00640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98014fb30 0x7fa9801614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa97de00640 1 -- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9800b4060 msgr2=0x7fa9800b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa97de00640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9800b4060 0x7fa9800b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa97de00640 1 -- 172.21.15.5:0/1144418800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa980150360 con 0x7fa964004810 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa97de00640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 0x7fa9800b61e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa970001a80 tx=0x7fa970012860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa976000640 1 -- 172.21.15.5:0/1144418800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97001c070 con 0x7fa964004810 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa976000640 1 -- 172.21.15.5:0/1144418800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa970014770 con 0x7fa964004810 2024-08-18T22:20:23.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 -- 172.21.15.5:0/1144418800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa98015f3a0 con 0x7fa964004810 2024-08-18T22:20:23.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa976000640 1 -- 172.21.15.5:0/1144418800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970014b60 con 0x7fa964004810 2024-08-18T22:20:23.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.069+0000 7fa984a00640 1 -- 172.21.15.5:0/1144418800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9800b6c50 con 0x7fa964004810 2024-08-18T22:20:23.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.073+0000 7fa984a00640 1 -- 172.21.15.5:0/1144418800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9800ca890 con 0x7fa964004810 2024-08-18T22:20:23.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.073+0000 7fa976000640 1 -- 172.21.15.5:0/1144418800 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa97001f070 con 0x7fa964004810 2024-08-18T22:20:23.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.073+0000 7fa976000640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9600678f0 0x7fa960069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.073+0000 7fa976000640 1 -- 172.21.15.5:0/1144418800 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa970088690 con 0x7fa964004810 2024-08-18T22:20:23.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.073+0000 7fa97d400640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9600678f0 0x7fa960069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.077+0000 7fa97d400640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9600678f0 0x7fa960069db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0ae000 tx=0x7fa96c0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:23.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.077+0000 7fa976000640 1 -- 172.21.15.5:0/1144418800 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa970058fa0 con 0x7fa964004810 2024-08-18T22:20:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 -- 172.21.15.5:0/1144418800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9800af6f0 con 0x7fa964004810 2024-08-18T22:20:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa976000640 1 -- 172.21.15.5:0/1144418800 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16870 (secure 0 0 0) 0x7fa9700588a0 con 0x7fa964004810 2024-08-18T22:20:23.247 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:23.247 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:20:20.496208+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:20:16.626037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-08-18T22:20:17.895529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:20:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 -- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9600678f0 msgr2=0x7fa960069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9600678f0 0x7fa960069db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0ae000 tx=0x7fa96c0046d0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 -- 172.21.15.5:0/1144418800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 msgr2=0x7fa9800b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 0x7fa9800b61e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa970001a80 tx=0x7fa970012860 comp rx=0 tx=0).stop 2024-08-18T22:20:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 -- 172.21.15.5:0/1144418800 shutdown_connections 2024-08-18T22:20:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9600678f0 0x7fa960069db0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9800b4060 0x7fa9800b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa98014fb30 0x7fa9801614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 --2- 172.21.15.5:0/1144418800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa964004810 0x7fa9800b61e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 -- 172.21.15.5:0/1144418800 >> 172.21.15.5:0/1144418800 conn(0x7fa98009aa40 msgr2=0x7fa98015ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 -- 172.21.15.5:0/1144418800 shutdown_connections 2024-08-18T22:20:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.245+0000 7fa984a00640 1 -- 172.21.15.5:0/1144418800 wait complete. 2024-08-18T22:20:23.269 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:20:23.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:20:23.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.405+0000 7f1aaa600640 1 Processor -- start 2024-08-18T22:20:23.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.405+0000 7f1aaa600640 1 -- start start 2024-08-18T22:20:23.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aaa600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1aa40b54c0 0x7f1aa4071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aaa600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa4071c80 con 0x7f1aa40cbed0 2024-08-18T22:20:23.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aaa600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa4071f60 con 0x7f1aa406dd80 2024-08-18T22:20:23.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aaa600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa40cba40 con 0x7f1aa40b54c0 2024-08-18T22:20:23.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aa3e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1aa40cbed0 0x7f1aa40cc360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43314/0 (socket says 172.21.15.5:43314) 2024-08-18T22:20:23.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aa3e00640 1 -- 172.21.15.5:0/1445431318 learned_addr learned my addr 172.21.15.5:0/1445431318 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:23.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aa3400640 1 --2- 172.21.15.5:0/1445431318 >> v2:172.21.15.117:3300/0 conn(0x7f1aa40b54c0 0x7f1aa4071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aa2a00640 1 -- 172.21.15.5:0/1445431318 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3590207752 0 0) 0x7f1aa4071c80 con 0x7f1aa40cbed0 2024-08-18T22:20:23.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aa2a00640 1 -- 172.21.15.5:0/1445431318 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a88003530 con 0x7f1aa40cbed0 2024-08-18T22:20:23.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aa2a00640 1 -- 172.21.15.5:0/1445431318 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 878051459 0 0) 0x7f1aa4071f60 con 0x7f1aa406dd80 2024-08-18T22:20:23.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aa3400640 1 -- 172.21.15.5:0/1445431318 >> v1:172.21.15.117:6789/0 conn(0x7f1aa406dd80 legacy=0x7f1aa40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aa3400640 1 -- 172.21.15.5:0/1445431318 >> v1:172.21.15.5:6789/0 conn(0x7f1aa40cbed0 legacy=0x7f1aa40cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.409+0000 7f1aa3400640 1 -- 172.21.15.5:0/1445431318 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa40cb6d0 con 0x7f1aa40b54c0 2024-08-18T22:20:23.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aa3400640 1 --2- 172.21.15.5:0/1445431318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa40b54c0 0x7f1aa4071580 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a940097c0 tx=0x7f1a9401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50fe356d7ed3d3d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:23.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aa2a00640 1 -- 172.21.15.5:0/1445431318 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940b5070 con 0x7f1aa40b54c0 2024-08-18T22:20:23.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aa2a00640 1 -- 172.21.15.5:0/1445431318 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a940a8990 con 0x7f1aa40b54c0 2024-08-18T22:20:23.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aa2a00640 1 -- 172.21.15.5:0/1445431318 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940a8d40 con 0x7f1aa40b54c0 2024-08-18T22:20:23.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aaa600640 1 -- 172.21.15.5:0/1445431318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa40b54c0 msgr2=0x7f1aa4071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aaa600640 1 --2- 172.21.15.5:0/1445431318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa40b54c0 0x7f1aa4071580 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a940097c0 tx=0x7f1a9401ec90 comp rx=0 tx=0).stop 2024-08-18T22:20:23.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aaa600640 1 -- 172.21.15.5:0/1445431318 shutdown_connections 2024-08-18T22:20:23.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aaa600640 1 --2- 172.21.15.5:0/1445431318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa40b54c0 0x7f1aa4071580 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aaa600640 1 -- 172.21.15.5:0/1445431318 >> 172.21.15.5:0/1445431318 conn(0x7f1aa40b3eb0 msgr2=0x7f1aa40b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:23.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aaa600640 1 -- 172.21.15.5:0/1445431318 shutdown_connections 2024-08-18T22:20:23.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aaa600640 1 -- 172.21.15.5:0/1445431318 wait complete. 2024-08-18T22:20:23.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aaa600640 1 Processor -- start 2024-08-18T22:20:23.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aaa600640 1 -- start start 2024-08-18T22:20:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aaa600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa406dd80 0x7f1aa41f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.413+0000 7f1aaa600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa40b54c0 0x7f1aa40d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1aaa600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa40cbed0 0x7f1aa4160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1aaa600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa41481a0 con 0x7f1aa40b54c0 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1aaa600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa4148020 con 0x7f1aa406dd80 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1aaa600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa40cca70 con 0x7f1aa40cbed0 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa40b54c0 0x7f1aa40d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa40b54c0 0x7f1aa40d1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41578/0 (socket says 172.21.15.5:41578) 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9aa00640 1 -- 172.21.15.5:0/4182726129 learned_addr learned my addr 172.21.15.5:0/4182726129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1aa3400640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa406dd80 0x7f1aa41f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1aa3e00640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa40cbed0 0x7f1aa4160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9aa00640 1 -- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa40cbed0 msgr2=0x7f1aa4160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9aa00640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa40cbed0 0x7f1aa4160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9aa00640 1 -- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa406dd80 msgr2=0x7f1aa41f3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9aa00640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa406dd80 0x7f1aa41f3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9aa00640 1 -- 172.21.15.5:0/4182726129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa40ce780 con 0x7f1aa40b54c0 2024-08-18T22:20:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1aa3400640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa406dd80 0x7f1aa41f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:23.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9aa00640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa40b54c0 0x7f1aa40d1a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c500 tx=0x7f1a8c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:23.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9be00640 1 -- 172.21.15.5:0/4182726129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c017070 con 0x7f1aa40b54c0 2024-08-18T22:20:23.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9be00640 1 -- 172.21.15.5:0/4182726129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c003600 con 0x7f1aa40b54c0 2024-08-18T22:20:23.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1aaa600640 1 -- 172.21.15.5:0/4182726129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa415fd70 con 0x7f1aa40b54c0 2024-08-18T22:20:23.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9be00640 1 -- 172.21.15.5:0/4182726129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0039f0 con 0x7f1aa40b54c0 2024-08-18T22:20:23.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1aaa600640 1 -- 172.21.15.5:0/4182726129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa40cf550 con 0x7f1aa40b54c0 2024-08-18T22:20:23.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1aaa600640 1 -- 172.21.15.5:0/4182726129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa4071f60 con 0x7f1aa40b54c0 2024-08-18T22:20:23.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.417+0000 7f1a9be00640 1 -- 172.21.15.5:0/4182726129 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1a8c01a070 con 0x7f1aa40b54c0 2024-08-18T22:20:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.421+0000 7f1a9be00640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a800678c0 0x7f1a80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.421+0000 7f1a9be00640 1 -- 172.21.15.5:0/4182726129 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f1a8c0851c0 con 0x7f1aa40b54c0 2024-08-18T22:20:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.421+0000 7f1aa3400640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a800678c0 0x7f1a80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.421+0000 7f1aa3400640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a800678c0 0x7f1a80069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1a940b2000 tx=0x7f1a940aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:23.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.425+0000 7f1a9be00640 1 -- 172.21.15.5:0/4182726129 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1a8c055cc0 con 0x7f1aa40b54c0 2024-08-18T22:20:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.585+0000 7f1aaa600640 1 -- 172.21.15.5:0/4182726129 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1aa40cf0b0 con 0x7f1a800678c0 2024-08-18T22:20:23.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.593+0000 7f1a9be00640 1 -- 172.21.15.5:0/4182726129 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247713 (secure 0 0 0) 0x7f1a940fb7c0 con 0x7f1a800678c0 2024-08-18T22:20:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:23.600 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:20:23.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 -- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a800678c0 msgr2=0x7f1a80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a800678c0 0x7f1a80069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1a940b2000 tx=0x7f1a940aa070 comp rx=0 tx=0).stop 2024-08-18T22:20:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 -- 172.21.15.5:0/4182726129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa40b54c0 msgr2=0x7f1aa40d1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa40b54c0 0x7f1aa40d1a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c500 tx=0x7f1a8c00c9c0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 -- 172.21.15.5:0/4182726129 shutdown_connections 2024-08-18T22:20:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a800678c0 0x7f1a80069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1aa40cbed0 0x7f1aa4160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aa40b54c0 0x7f1aa40d1a00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 --2- 172.21.15.5:0/4182726129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1aa406dd80 0x7f1aa41f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 -- 172.21.15.5:0/4182726129 >> 172.21.15.5:0/4182726129 conn(0x7f1aa40b3eb0 msgr2=0x7f1aa4147360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 -- 172.21.15.5:0/4182726129 shutdown_connections 2024-08-18T22:20:23.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.597+0000 7f1aaa600640 1 -- 172.21.15.5:0/4182726129 wait complete. 2024-08-18T22:20:23.620 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-08-18T22:20:21.632636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233080,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741640,"statfs":{"total":773094113280,"available":772855439360,"internally_reserved":0,"allocated":4530176,"data_stored":2600959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.152446"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493092+0000","last_change":"2024-08-18T22:20:18.493092+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493092+0000","last_undegraded":"2024-08-18T22:20:18.493092+0000","last_fullsized":"2024-08-18T22:20:18.493092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.496244+0000","last_change":"2024-08-18T22:20:18.496244+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.496244+0000","last_undegraded":"2024-08-18T22:20:18.496244+0000","last_fullsized":"2024-08-18T22:20:18.496244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.496407+0000","last_change":"2024-08-18T22:20:18.496407+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.496407+0000","last_undegraded":"2024-08-18T22:20:18.496407+0000","last_fullsized":"2024-08-18T22:20:18.496407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529400+0000","last_change":"2024-08-18T22:20:19.523171+0000","last_active":"2024-08-18T22:20:19.529400+0000","last_peered":"2024-08-18T22:20:19.529400+0000","last_clean":"2024-08-18T22:20:19.529400+0000","last_became_active":"2024-08-18T22:20:19.522915+0000","last_became_peered":"2024-08-18T22:20:19.522915+0000","last_unstale":"2024-08-18T22:20:19.529400+0000","last_undegraded":"2024-08-18T22:20:19.529400+0000","last_fullsized":"2024-08-18T22:20:19.529400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:55:25.376251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.522175+0000","last_change":"2024-08-18T22:20:19.514150+0000","last_active":"2024-08-18T22:20:19.522175+0000","last_peered":"2024-08-18T22:20:19.522175+0000","last_clean":"2024-08-18T22:20:19.522175+0000","last_became_active":"2024-08-18T22:20:19.513901+0000","last_became_peered":"2024-08-18T22:20:19.513901+0000","last_unstale":"2024-08-18T22:20:19.522175+0000","last_undegraded":"2024-08-18T22:20:19.522175+0000","last_fullsized":"2024-08-18T22:20:19.522175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:38.521131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493274+0000","last_change":"2024-08-18T22:20:18.493274+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493274+0000","last_undegraded":"2024-08-18T22:20:18.493274+0000","last_fullsized":"2024-08-18T22:20:18.493274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499887+0000","last_change":"2024-08-18T22:20:18.499887+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499887+0000","last_undegraded":"2024-08-18T22:20:18.499887+0000","last_fullsized":"2024-08-18T22:20:18.499887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491230+0000","last_change":"2024-08-18T22:20:18.491230+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491230+0000","last_undegraded":"2024-08-18T22:20:18.491230+0000","last_fullsized":"2024-08-18T22:20:18.491230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495448+0000","last_change":"2024-08-18T22:20:18.495448+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495448+0000","last_undegraded":"2024-08-18T22:20:18.495448+0000","last_fullsized":"2024-08-18T22:20:18.495448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498758+0000","last_change":"2024-08-18T22:20:18.498758+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498758+0000","last_undegraded":"2024-08-18T22:20:18.498758+0000","last_fullsized":"2024-08-18T22:20:18.498758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498892+0000","last_change":"2024-08-18T22:20:18.498892+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498892+0000","last_undegraded":"2024-08-18T22:20:18.498892+0000","last_fullsized":"2024-08-18T22:20:18.498892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495011+0000","last_change":"2024-08-18T22:20:18.495011+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495011+0000","last_undegraded":"2024-08-18T22:20:18.495011+0000","last_fullsized":"2024-08-18T22:20:18.495011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.504430+0000","last_change":"2024-08-18T22:20:18.504430+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.504430+0000","last_undegraded":"2024-08-18T22:20:18.504430+0000","last_fullsized":"2024-08-18T22:20:18.504430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506172+0000","last_change":"2024-08-18T22:20:19.510105+0000","last_active":"2024-08-18T22:20:20.506172+0000","last_peered":"2024-08-18T22:20:20.506172+0000","last_clean":"2024-08-18T22:20:20.506172+0000","last_became_active":"2024-08-18T22:20:19.509851+0000","last_became_peered":"2024-08-18T22:20:19.509851+0000","last_unstale":"2024-08-18T22:20:20.506172+0000","last_undegraded":"2024-08-18T22:20:20.506172+0000","last_fullsized":"2024-08-18T22:20:20.506172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:44.652528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499339+0000","last_change":"2024-08-18T22:20:18.499339+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499339+0000","last_undegraded":"2024-08-18T22:20:18.499339+0000","last_fullsized":"2024-08-18T22:20:18.499339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495978+0000","last_change":"2024-08-18T22:20:18.495978+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495978+0000","last_undegraded":"2024-08-18T22:20:18.495978+0000","last_fullsized":"2024-08-18T22:20:18.495978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.501271+0000","last_change":"2024-08-18T22:20:18.501271+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.501271+0000","last_undegraded":"2024-08-18T22:20:18.501271+0000","last_fullsized":"2024-08-18T22:20:18.501271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490502+0000","last_change":"2024-08-18T22:20:18.490502+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490502+0000","last_undegraded":"2024-08-18T22:20:18.490502+0000","last_fullsized":"2024-08-18T22:20:18.490502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.522894+0000","last_change":"2024-08-18T22:20:19.513201+0000","last_active":"2024-08-18T22:20:19.522894+0000","last_peered":"2024-08-18T22:20:19.522894+0000","last_clean":"2024-08-18T22:20:19.522894+0000","last_became_active":"2024-08-18T22:20:19.512920+0000","last_became_peered":"2024-08-18T22:20:19.512920+0000","last_unstale":"2024-08-18T22:20:19.522894+0000","last_undegraded":"2024-08-18T22:20:19.522894+0000","last_fullsized":"2024-08-18T22:20:19.522894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:03.535227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490750+0000","last_change":"2024-08-18T22:20:18.490750+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490750+0000","last_undegraded":"2024-08-18T22:20:18.490750+0000","last_fullsized":"2024-08-18T22:20:18.490750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497883+0000","last_change":"2024-08-18T22:20:18.497883+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497883+0000","last_undegraded":"2024-08-18T22:20:18.497883+0000","last_fullsized":"2024-08-18T22:20:18.497883+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506727+0000","last_change":"2024-08-18T22:20:19.517261+0000","last_active":"2024-08-18T22:20:20.506727+0000","last_peered":"2024-08-18T22:20:20.506727+0000","last_clean":"2024-08-18T22:20:20.506727+0000","last_became_active":"2024-08-18T22:20:19.516966+0000","last_became_peered":"2024-08-18T22:20:19.516966+0000","last_unstale":"2024-08-18T22:20:20.506727+0000","last_undegraded":"2024-08-18T22:20:20.506727+0000","last_fullsized":"2024-08-18T22:20:20.506727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:39:08.996900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497861+0000","last_change":"2024-08-18T22:20:18.497861+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497861+0000","last_undegraded":"2024-08-18T22:20:18.497861+0000","last_fullsized":"2024-08-18T22:20:18.497861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.528004+0000","last_change":"2024-08-18T22:20:19.518451+0000","last_active":"2024-08-18T22:20:19.528004+0000","last_peered":"2024-08-18T22:20:19.528004+0000","last_clean":"2024-08-18T22:20:19.528004+0000","last_became_active":"2024-08-18T22:20:19.517998+0000","last_became_peered":"2024-08-18T22:20:19.517998+0000","last_unstale":"2024-08-18T22:20:19.528004+0000","last_undegraded":"2024-08-18T22:20:19.528004+0000","last_fullsized":"2024-08-18T22:20:19.528004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:30:38.396904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490377+0000","last_change":"2024-08-18T22:20:18.490377+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490377+0000","last_undegraded":"2024-08-18T22:20:18.490377+0000","last_fullsized":"2024-08-18T22:20:18.490377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491526+0000","last_change":"2024-08-18T22:20:18.491526+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491526+0000","last_undegraded":"2024-08-18T22:20:18.491526+0000","last_fullsized":"2024-08-18T22:20:18.491526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490426+0000","last_change":"2024-08-18T22:20:18.490426+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490426+0000","last_undegraded":"2024-08-18T22:20:18.490426+0000","last_fullsized":"2024-08-18T22:20:18.490426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497790+0000","last_change":"2024-08-18T22:20:18.497790+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497790+0000","last_undegraded":"2024-08-18T22:20:18.497790+0000","last_fullsized":"2024-08-18T22:20:18.497790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490338+0000","last_change":"2024-08-18T22:20:18.490338+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490338+0000","last_undegraded":"2024-08-18T22:20:18.490338+0000","last_fullsized":"2024-08-18T22:20:18.490338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490566+0000","last_change":"2024-08-18T22:20:18.490566+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490566+0000","last_undegraded":"2024-08-18T22:20:18.490566+0000","last_fullsized":"2024-08-18T22:20:18.490566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493157+0000","last_change":"2024-08-18T22:20:18.493157+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493157+0000","last_undegraded":"2024-08-18T22:20:18.493157+0000","last_fullsized":"2024-08-18T22:20:18.493157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491344+0000","last_change":"2024-08-18T22:20:18.491344+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491344+0000","last_undegraded":"2024-08-18T22:20:18.491344+0000","last_fullsized":"2024-08-18T22:20:18.491344+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.500047+0000","last_change":"2024-08-18T22:20:18.500047+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.500047+0000","last_undegraded":"2024-08-18T22:20:18.500047+0000","last_fullsized":"2024-08-18T22:20:18.500047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510476+0000","last_change":"2024-08-18T22:20:18.507055+0000","last_active":"2024-08-18T22:20:18.510476+0000","last_peered":"2024-08-18T22:20:18.510476+0000","last_clean":"2024-08-18T22:20:18.510476+0000","last_became_active":"2024-08-18T22:20:18.506703+0000","last_became_peered":"2024-08-18T22:20:18.506703+0000","last_unstale":"2024-08-18T22:20:18.510476+0000","last_undegraded":"2024-08-18T22:20:18.510476+0000","last_fullsized":"2024-08-18T22:20:18.510476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:01:24.898465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492337+0000","last_change":"2024-08-18T22:20:18.492337+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492337+0000","last_undegraded":"2024-08-18T22:20:18.492337+0000","last_fullsized":"2024-08-18T22:20:18.492337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510279+0000","last_change":"2024-08-18T22:20:18.506164+0000","last_active":"2024-08-18T22:20:18.510279+0000","last_peered":"2024-08-18T22:20:18.510279+0000","last_clean":"2024-08-18T22:20:18.510279+0000","last_became_active":"2024-08-18T22:20:18.505859+0000","last_became_peered":"2024-08-18T22:20:18.505859+0000","last_unstale":"2024-08-18T22:20:18.510279+0000","last_undegraded":"2024-08-18T22:20:18.510279+0000","last_fullsized":"2024-08-18T22:20:18.510279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:13.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507281+0000","last_change":"2024-08-18T22:20:19.511725+0000","last_active":"2024-08-18T22:20:20.507281+0000","last_peered":"2024-08-18T22:20:20.507281+0000","last_clean":"2024-08-18T22:20:20.507281+0000","last_became_active":"2024-08-18T22:20:19.509416+0000","last_became_peered":"2024-08-18T22:20:19.509416+0000","last_unstale":"2024-08-18T22:20:20.507281+0000","last_undegraded":"2024-08-18T22:20:20.507281+0000","last_fullsized":"2024-08-18T22:20:20.507281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:46.028258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510679+0000","last_change":"2024-08-18T22:20:18.505900+0000","last_active":"2024-08-18T22:20:18.510679+0000","last_peered":"2024-08-18T22:20:18.510679+0000","last_clean":"2024-08-18T22:20:18.510679+0000","last_became_active":"2024-08-18T22:20:18.505628+0000","last_became_peered":"2024-08-18T22:20:18.505628+0000","last_unstale":"2024-08-18T22:20:18.510679+0000","last_undegraded":"2024-08-18T22:20:18.510679+0000","last_fullsized":"2024-08-18T22:20:18.510679+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:33.626411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493547+0000","last_change":"2024-08-18T22:20:18.493547+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493547+0000","last_undegraded":"2024-08-18T22:20:18.493547+0000","last_fullsized":"2024-08-18T22:20:18.493547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506625+0000","last_change":"2024-08-18T22:20:18.506470+0000","last_active":"2024-08-18T22:20:20.506625+0000","last_peered":"2024-08-18T22:20:20.506625+0000","last_clean":"2024-08-18T22:20:20.506625+0000","last_became_active":"2024-08-18T22:20:18.505750+0000","last_became_peered":"2024-08-18T22:20:18.505750+0000","last_unstale":"2024-08-18T22:20:20.506625+0000","last_undegraded":"2024-08-18T22:20:20.506625+0000","last_fullsized":"2024-08-18T22:20:20.506625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:28.594042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495750+0000","last_change":"2024-08-18T22:20:18.495750+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495750+0000","last_undegraded":"2024-08-18T22:20:18.495750+0000","last_fullsized":"2024-08-18T22:20:18.495750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518308+0000","last_change":"2024-08-18T22:20:18.513803+0000","last_active":"2024-08-18T22:20:18.518308+0000","last_peered":"2024-08-18T22:20:18.518308+0000","last_clean":"2024-08-18T22:20:18.518308+0000","last_became_active":"2024-08-18T22:20:18.513118+0000","last_became_peered":"2024-08-18T22:20:18.513118+0000","last_unstale":"2024-08-18T22:20:18.518308+0000","last_undegraded":"2024-08-18T22:20:18.518308+0000","last_fullsized":"2024-08-18T22:20:18.518308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:43.649712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497649+0000","last_change":"2024-08-18T22:20:18.497649+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497649+0000","last_undegraded":"2024-08-18T22:20:18.497649+0000","last_fullsized":"2024-08-18T22:20:18.497649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.514042+0000","last_change":"2024-08-18T22:20:18.507975+0000","last_active":"2024-08-18T22:20:18.514042+0000","last_peered":"2024-08-18T22:20:18.514042+0000","last_clean":"2024-08-18T22:20:18.514042+0000","last_became_active":"2024-08-18T22:20:18.507730+0000","last_became_peered":"2024-08-18T22:20:18.507730+0000","last_unstale":"2024-08-18T22:20:18.514042+0000","last_undegraded":"2024-08-18T22:20:18.514042+0000","last_fullsized":"2024-08-18T22:20:18.514042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:16.215376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506523+0000","last_change":"2024-08-18T22:20:19.512493+0000","last_active":"2024-08-18T22:20:20.506523+0000","last_peered":"2024-08-18T22:20:20.506523+0000","last_clean":"2024-08-18T22:20:20.506523+0000","last_became_active":"2024-08-18T22:20:19.512176+0000","last_became_peered":"2024-08-18T22:20:19.512176+0000","last_unstale":"2024-08-18T22:20:20.506523+0000","last_undegraded":"2024-08-18T22:20:20.506523+0000","last_fullsized":"2024-08-18T22:20:20.506523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:50.110322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516286+0000","last_change":"2024-08-18T22:20:18.514200+0000","last_active":"2024-08-18T22:20:18.516286+0000","last_peered":"2024-08-18T22:20:18.516286+0000","last_clean":"2024-08-18T22:20:18.516286+0000","last_became_active":"2024-08-18T22:20:18.513674+0000","last_became_peered":"2024-08-18T22:20:18.513674+0000","last_unstale":"2024-08-18T22:20:18.516286+0000","last_undegraded":"2024-08-18T22:20:18.516286+0000","last_fullsized":"2024-08-18T22:20:18.516286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:17.147946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499266+0000","last_change":"2024-08-18T22:20:18.499266+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499266+0000","last_undegraded":"2024-08-18T22:20:18.499266+0000","last_fullsized":"2024-08-18T22:20:18.499266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505383+0000","last_change":"2024-08-18T22:20:18.509839+0000","last_active":"2024-08-18T22:20:20.505383+0000","last_peered":"2024-08-18T22:20:20.505383+0000","last_clean":"2024-08-18T22:20:20.505383+0000","last_became_active":"2024-08-18T22:20:18.509566+0000","last_became_peered":"2024-08-18T22:20:18.509566+0000","last_unstale":"2024-08-18T22:20:20.505383+0000","last_undegraded":"2024-08-18T22:20:20.505383+0000","last_fullsized":"2024-08-18T22:20:20.505383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:52:05.432990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529421+0000","last_change":"2024-08-18T22:20:19.527869+0000","last_active":"2024-08-18T22:20:19.529421+0000","last_peered":"2024-08-18T22:20:19.529421+0000","last_clean":"2024-08-18T22:20:19.529421+0000","last_became_active":"2024-08-18T22:20:19.527597+0000","last_became_peered":"2024-08-18T22:20:19.527597+0000","last_unstale":"2024-08-18T22:20:19.529421+0000","last_undegraded":"2024-08-18T22:20:19.529421+0000","last_fullsized":"2024-08-18T22:20:19.529421+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:59.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511279+0000","last_change":"2024-08-18T22:20:18.504598+0000","last_active":"2024-08-18T22:20:18.511279+0000","last_peered":"2024-08-18T22:20:18.511279+0000","last_clean":"2024-08-18T22:20:18.511279+0000","last_became_active":"2024-08-18T22:20:18.502312+0000","last_became_peered":"2024-08-18T22:20:18.502312+0000","last_unstale":"2024-08-18T22:20:18.511279+0000","last_undegraded":"2024-08-18T22:20:18.511279+0000","last_fullsized":"2024-08-18T22:20:18.511279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:19:25.740187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495705+0000","last_change":"2024-08-18T22:20:18.495705+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495705+0000","last_undegraded":"2024-08-18T22:20:18.495705+0000","last_fullsized":"2024-08-18T22:20:18.495705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518366+0000","last_change":"2024-08-18T22:20:18.514724+0000","last_active":"2024-08-18T22:20:18.518366+0000","last_peered":"2024-08-18T22:20:18.518366+0000","last_clean":"2024-08-18T22:20:18.518366+0000","last_became_active":"2024-08-18T22:20:18.513465+0000","last_became_peered":"2024-08-18T22:20:18.513465+0000","last_unstale":"2024-08-18T22:20:18.518366+0000","last_undegraded":"2024-08-18T22:20:18.518366+0000","last_fullsized":"2024-08-18T22:20:18.518366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:01.005845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495051+0000","last_change":"2024-08-18T22:20:18.495051+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495051+0000","last_undegraded":"2024-08-18T22:20:18.495051+0000","last_fullsized":"2024-08-18T22:20:18.495051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.514527+0000","last_change":"2024-08-18T22:20:18.508636+0000","last_active":"2024-08-18T22:20:18.514527+0000","last_peered":"2024-08-18T22:20:18.514527+0000","last_clean":"2024-08-18T22:20:18.514527+0000","last_became_active":"2024-08-18T22:20:18.508356+0000","last_became_peered":"2024-08-18T22:20:18.508356+0000","last_unstale":"2024-08-18T22:20:18.514527+0000","last_undegraded":"2024-08-18T22:20:18.514527+0000","last_fullsized":"2024-08-18T22:20:18.514527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:50.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507231+0000","last_change":"2024-08-18T22:20:19.527189+0000","last_active":"2024-08-18T22:20:20.507231+0000","last_peered":"2024-08-18T22:20:20.507231+0000","last_clean":"2024-08-18T22:20:20.507231+0000","last_became_active":"2024-08-18T22:20:19.526929+0000","last_became_peered":"2024-08-18T22:20:19.526929+0000","last_unstale":"2024-08-18T22:20:20.507231+0000","last_undegraded":"2024-08-18T22:20:20.507231+0000","last_fullsized":"2024-08-18T22:20:20.507231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:27.898874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.513335+0000","last_change":"2024-08-18T22:20:18.505405+0000","last_active":"2024-08-18T22:20:18.513335+0000","last_peered":"2024-08-18T22:20:18.513335+0000","last_clean":"2024-08-18T22:20:18.513335+0000","last_became_active":"2024-08-18T22:20:18.505140+0000","last_became_peered":"2024-08-18T22:20:18.505140+0000","last_unstale":"2024-08-18T22:20:18.513335+0000","last_undegraded":"2024-08-18T22:20:18.513335+0000","last_fullsized":"2024-08-18T22:20:18.513335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:24.501896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495135+0000","last_change":"2024-08-18T22:20:18.495135+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495135+0000","last_undegraded":"2024-08-18T22:20:18.495135+0000","last_fullsized":"2024-08-18T22:20:18.495135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511185+0000","last_change":"2024-08-18T22:20:18.506928+0000","last_active":"2024-08-18T22:20:18.511185+0000","last_peered":"2024-08-18T22:20:18.511185+0000","last_clean":"2024-08-18T22:20:18.511185+0000","last_became_active":"2024-08-18T22:20:18.506655+0000","last_became_peered":"2024-08-18T22:20:18.506655+0000","last_unstale":"2024-08-18T22:20:18.511185+0000","last_undegraded":"2024-08-18T22:20:18.511185+0000","last_fullsized":"2024-08-18T22:20:18.511185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:49.429237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491918+0000","last_change":"2024-08-18T22:20:18.491918+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491918+0000","last_undegraded":"2024-08-18T22:20:18.491918+0000","last_fullsized":"2024-08-18T22:20:18.491918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.515266+0000","last_change":"2024-08-18T22:20:18.513595+0000","last_active":"2024-08-18T22:20:18.515266+0000","last_peered":"2024-08-18T22:20:18.515266+0000","last_clean":"2024-08-18T22:20:18.515266+0000","last_became_active":"2024-08-18T22:20:18.513298+0000","last_became_peered":"2024-08-18T22:20:18.513298+0000","last_unstale":"2024-08-18T22:20:18.515266+0000","last_undegraded":"2024-08-18T22:20:18.515266+0000","last_fullsized":"2024-08-18T22:20:18.515266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:03.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499687+0000","last_change":"2024-08-18T22:20:18.499687+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499687+0000","last_undegraded":"2024-08-18T22:20:18.499687+0000","last_fullsized":"2024-08-18T22:20:18.499687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511974+0000","last_change":"2024-08-18T22:20:18.507441+0000","last_active":"2024-08-18T22:20:18.511974+0000","last_peered":"2024-08-18T22:20:18.511974+0000","last_clean":"2024-08-18T22:20:18.511974+0000","last_became_active":"2024-08-18T22:20:18.507129+0000","last_became_peered":"2024-08-18T22:20:18.507129+0000","last_unstale":"2024-08-18T22:20:18.511974+0000","last_undegraded":"2024-08-18T22:20:18.511974+0000","last_fullsized":"2024-08-18T22:20:18.511974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:31.386164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498828+0000","last_change":"2024-08-18T22:20:18.498828+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498828+0000","last_undegraded":"2024-08-18T22:20:18.498828+0000","last_fullsized":"2024-08-18T22:20:18.498828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511125+0000","last_change":"2024-08-18T22:20:18.505545+0000","last_active":"2024-08-18T22:20:18.511125+0000","last_peered":"2024-08-18T22:20:18.511125+0000","last_clean":"2024-08-18T22:20:18.511125+0000","last_became_active":"2024-08-18T22:20:18.505240+0000","last_became_peered":"2024-08-18T22:20:18.505240+0000","last_unstale":"2024-08-18T22:20:18.511125+0000","last_undegraded":"2024-08-18T22:20:18.511125+0000","last_fullsized":"2024-08-18T22:20:18.511125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:50.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492381+0000","last_change":"2024-08-18T22:20:18.492381+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492381+0000","last_undegraded":"2024-08-18T22:20:18.492381+0000","last_fullsized":"2024-08-18T22:20:18.492381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516342+0000","last_change":"2024-08-18T22:20:18.511501+0000","last_active":"2024-08-18T22:20:18.516342+0000","last_peered":"2024-08-18T22:20:18.516342+0000","last_clean":"2024-08-18T22:20:18.516342+0000","last_became_active":"2024-08-18T22:20:18.511239+0000","last_became_peered":"2024-08-18T22:20:18.511239+0000","last_unstale":"2024-08-18T22:20:18.516342+0000","last_undegraded":"2024-08-18T22:20:18.516342+0000","last_fullsized":"2024-08-18T22:20:18.516342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:27:37.314171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498467+0000","last_change":"2024-08-18T22:20:18.498467+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498467+0000","last_undegraded":"2024-08-18T22:20:18.498467+0000","last_fullsized":"2024-08-18T22:20:18.498467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507244+0000","last_change":"2024-08-18T22:20:18.510173+0000","last_active":"2024-08-18T22:20:20.507244+0000","last_peered":"2024-08-18T22:20:20.507244+0000","last_clean":"2024-08-18T22:20:20.507244+0000","last_became_active":"2024-08-18T22:20:18.509595+0000","last_became_peered":"2024-08-18T22:20:18.509595+0000","last_unstale":"2024-08-18T22:20:20.507244+0000","last_undegraded":"2024-08-18T22:20:20.507244+0000","last_fullsized":"2024-08-18T22:20:20.507244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:03.733472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507175+0000","last_change":"2024-08-18T22:20:19.509550+0000","last_active":"2024-08-18T22:20:20.507175+0000","last_peered":"2024-08-18T22:20:20.507175+0000","last_clean":"2024-08-18T22:20:20.507175+0000","last_became_active":"2024-08-18T22:20:19.509074+0000","last_became_peered":"2024-08-18T22:20:19.509074+0000","last_unstale":"2024-08-18T22:20:20.507175+0000","last_undegraded":"2024-08-18T22:20:20.507175+0000","last_fullsized":"2024-08-18T22:20:20.507175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:30.801816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.526269+0000","last_change":"2024-08-18T22:20:18.510334+0000","last_active":"2024-08-18T22:20:19.526269+0000","last_peered":"2024-08-18T22:20:19.526269+0000","last_clean":"2024-08-18T22:20:19.526269+0000","last_became_active":"2024-08-18T22:20:18.510061+0000","last_became_peered":"2024-08-18T22:20:18.510061+0000","last_unstale":"2024-08-18T22:20:19.526269+0000","last_undegraded":"2024-08-18T22:20:19.526269+0000","last_fullsized":"2024-08-18T22:20:19.526269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:47:45.552211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529777+0000","last_change":"2024-08-18T22:20:19.525958+0000","last_active":"2024-08-18T22:20:19.529777+0000","last_peered":"2024-08-18T22:20:19.529777+0000","last_clean":"2024-08-18T22:20:19.529777+0000","last_became_active":"2024-08-18T22:20:19.524979+0000","last_became_peered":"2024-08-18T22:20:19.524979+0000","last_unstale":"2024-08-18T22:20:19.529777+0000","last_undegraded":"2024-08-18T22:20:19.529777+0000","last_fullsized":"2024-08-18T22:20:19.529777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:51.616637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510536+0000","last_change":"2024-08-18T22:20:18.505895+0000","last_active":"2024-08-18T22:20:18.510536+0000","last_peered":"2024-08-18T22:20:18.510536+0000","last_clean":"2024-08-18T22:20:18.510536+0000","last_became_active":"2024-08-18T22:20:18.505603+0000","last_became_peered":"2024-08-18T22:20:18.505603+0000","last_unstale":"2024-08-18T22:20:18.510536+0000","last_undegraded":"2024-08-18T22:20:18.510536+0000","last_fullsized":"2024-08-18T22:20:18.510536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:13.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493638+0000","last_change":"2024-08-18T22:20:18.493638+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493638+0000","last_undegraded":"2024-08-18T22:20:18.493638+0000","last_fullsized":"2024-08-18T22:20:18.493638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.521128+0000","last_change":"2024-08-18T22:20:18.513238+0000","last_active":"2024-08-18T22:20:19.521128+0000","last_peered":"2024-08-18T22:20:19.521128+0000","last_clean":"2024-08-18T22:20:19.521128+0000","last_became_active":"2024-08-18T22:20:18.512768+0000","last_became_peered":"2024-08-18T22:20:18.512768+0000","last_unstale":"2024-08-18T22:20:19.521128+0000","last_undegraded":"2024-08-18T22:20:19.521128+0000","last_fullsized":"2024-08-18T22:20:19.521128+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:33.762072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495481+0000","last_change":"2024-08-18T22:20:18.495481+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495481+0000","last_undegraded":"2024-08-18T22:20:18.495481+0000","last_fullsized":"2024-08-18T22:20:18.495481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.509691+0000","last_change":"2024-08-18T22:20:18.512744+0000","last_active":"2024-08-18T22:20:19.509691+0000","last_peered":"2024-08-18T22:20:19.509691+0000","last_clean":"2024-08-18T22:20:19.509691+0000","last_became_active":"2024-08-18T22:20:18.512351+0000","last_became_peered":"2024-08-18T22:20:18.512351+0000","last_unstale":"2024-08-18T22:20:19.509691+0000","last_undegraded":"2024-08-18T22:20:19.509691+0000","last_fullsized":"2024-08-18T22:20:19.509691+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:37:13.840163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.504630+0000","last_change":"2024-08-18T22:20:18.504630+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.504630+0000","last_undegraded":"2024-08-18T22:20:18.504630+0000","last_fullsized":"2024-08-18T22:20:18.504630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.515749+0000","last_change":"2024-08-18T22:20:18.510805+0000","last_active":"2024-08-18T22:20:18.515749+0000","last_peered":"2024-08-18T22:20:18.515749+0000","last_clean":"2024-08-18T22:20:18.515749+0000","last_became_active":"2024-08-18T22:20:18.510506+0000","last_became_peered":"2024-08-18T22:20:18.510506+0000","last_unstale":"2024-08-18T22:20:18.515749+0000","last_undegraded":"2024-08-18T22:20:18.515749+0000","last_fullsized":"2024-08-18T22:20:18.515749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:27:37.314171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493377+0000","last_change":"2024-08-18T22:20:18.493377+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493377+0000","last_undegraded":"2024-08-18T22:20:18.493377+0000","last_fullsized":"2024-08-18T22:20:18.493377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.508542+0000","last_change":"2024-08-18T22:20:18.509322+0000","last_active":"2024-08-18T22:20:19.508542+0000","last_peered":"2024-08-18T22:20:19.508542+0000","last_clean":"2024-08-18T22:20:19.508542+0000","last_became_active":"2024-08-18T22:20:18.509032+0000","last_became_peered":"2024-08-18T22:20:18.509032+0000","last_unstale":"2024-08-18T22:20:19.508542+0000","last_undegraded":"2024-08-18T22:20:19.508542+0000","last_fullsized":"2024-08-18T22:20:19.508542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:26:25.888447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492384+0000","last_change":"2024-08-18T22:20:18.492384+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492384+0000","last_undegraded":"2024-08-18T22:20:18.492384+0000","last_fullsized":"2024-08-18T22:20:18.492384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516322+0000","last_change":"2024-08-18T22:20:18.510784+0000","last_active":"2024-08-18T22:20:18.516322+0000","last_peered":"2024-08-18T22:20:18.516322+0000","last_clean":"2024-08-18T22:20:18.516322+0000","last_became_active":"2024-08-18T22:20:18.510472+0000","last_became_peered":"2024-08-18T22:20:18.510472+0000","last_unstale":"2024-08-18T22:20:18.516322+0000","last_undegraded":"2024-08-18T22:20:18.516322+0000","last_fullsized":"2024-08-18T22:20:18.516322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:16.215376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493125+0000","last_change":"2024-08-18T22:20:18.493125+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493125+0000","last_undegraded":"2024-08-18T22:20:18.493125+0000","last_fullsized":"2024-08-18T22:20:18.493125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.511615+0000","last_change":"2024-08-18T22:20:18.515716+0000","last_active":"2024-08-18T22:20:19.511615+0000","last_peered":"2024-08-18T22:20:19.511615+0000","last_clean":"2024-08-18T22:20:19.511615+0000","last_became_active":"2024-08-18T22:20:18.515475+0000","last_became_peered":"2024-08-18T22:20:18.515475+0000","last_unstale":"2024-08-18T22:20:19.511615+0000","last_undegraded":"2024-08-18T22:20:19.511615+0000","last_fullsized":"2024-08-18T22:20:19.511615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:00:01.480754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495710+0000","last_change":"2024-08-18T22:20:18.495710+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495710+0000","last_undegraded":"2024-08-18T22:20:18.495710+0000","last_fullsized":"2024-08-18T22:20:18.495710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.512673+0000","last_change":"2024-08-18T22:20:18.511256+0000","last_active":"2024-08-18T22:20:18.512673+0000","last_peered":"2024-08-18T22:20:18.512673+0000","last_clean":"2024-08-18T22:20:18.512673+0000","last_became_active":"2024-08-18T22:20:18.510423+0000","last_became_peered":"2024-08-18T22:20:18.510423+0000","last_unstale":"2024-08-18T22:20:18.512673+0000","last_undegraded":"2024-08-18T22:20:18.512673+0000","last_fullsized":"2024-08-18T22:20:18.512673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:03.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.494509+0000","last_change":"2024-08-18T22:20:18.494509+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.494509+0000","last_undegraded":"2024-08-18T22:20:18.494509+0000","last_fullsized":"2024-08-18T22:20:18.494509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.512641+0000","last_change":"2024-08-18T22:20:18.510833+0000","last_active":"2024-08-18T22:20:18.512641+0000","last_peered":"2024-08-18T22:20:18.512641+0000","last_clean":"2024-08-18T22:20:18.512641+0000","last_became_active":"2024-08-18T22:20:18.510510+0000","last_became_peered":"2024-08-18T22:20:18.510510+0000","last_unstale":"2024-08-18T22:20:18.512641+0000","last_undegraded":"2024-08-18T22:20:18.512641+0000","last_fullsized":"2024-08-18T22:20:18.512641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:33.626411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492553+0000","last_change":"2024-08-18T22:20:18.492553+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492553+0000","last_undegraded":"2024-08-18T22:20:18.492553+0000","last_fullsized":"2024-08-18T22:20:18.492553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511290+0000","last_change":"2024-08-18T22:20:18.508896+0000","last_active":"2024-08-18T22:20:18.511290+0000","last_peered":"2024-08-18T22:20:18.511290+0000","last_clean":"2024-08-18T22:20:18.511290+0000","last_became_active":"2024-08-18T22:20:18.508538+0000","last_became_peered":"2024-08-18T22:20:18.508538+0000","last_unstale":"2024-08-18T22:20:18.511290+0000","last_undegraded":"2024-08-18T22:20:18.511290+0000","last_fullsized":"2024-08-18T22:20:18.511290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:06.513442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506321+0000","last_change":"2024-08-18T22:20:19.524685+0000","last_active":"2024-08-18T22:20:20.506321+0000","last_peered":"2024-08-18T22:20:20.506321+0000","last_clean":"2024-08-18T22:20:20.506321+0000","last_became_active":"2024-08-18T22:20:19.524418+0000","last_became_peered":"2024-08-18T22:20:19.524418+0000","last_unstale":"2024-08-18T22:20:20.506321+0000","last_undegraded":"2024-08-18T22:20:20.506321+0000","last_fullsized":"2024-08-18T22:20:20.506321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:53.696643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505510+0000","last_change":"2024-08-18T22:20:18.506063+0000","last_active":"2024-08-18T22:20:20.505510+0000","last_peered":"2024-08-18T22:20:20.505510+0000","last_clean":"2024-08-18T22:20:20.505510+0000","last_became_active":"2024-08-18T22:20:18.505766+0000","last_became_peered":"2024-08-18T22:20:18.505766+0000","last_unstale":"2024-08-18T22:20:20.505510+0000","last_undegraded":"2024-08-18T22:20:20.505510+0000","last_fullsized":"2024-08-18T22:20:20.505510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:58.591575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499675+0000","last_change":"2024-08-18T22:20:18.499675+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499675+0000","last_undegraded":"2024-08-18T22:20:18.499675+0000","last_fullsized":"2024-08-18T22:20:18.499675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.507481+0000","last_change":"2024-08-18T22:20:18.501496+0000","last_active":"2024-08-18T22:20:18.507481+0000","last_peered":"2024-08-18T22:20:18.507481+0000","last_clean":"2024-08-18T22:20:18.507481+0000","last_became_active":"2024-08-18T22:20:18.501227+0000","last_became_peered":"2024-08-18T22:20:18.501227+0000","last_unstale":"2024-08-18T22:20:18.507481+0000","last_undegraded":"2024-08-18T22:20:18.507481+0000","last_fullsized":"2024-08-18T22:20:18.507481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:31.328987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.501385+0000","last_change":"2024-08-18T22:20:18.501385+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.501385+0000","last_undegraded":"2024-08-18T22:20:18.501385+0000","last_fullsized":"2024-08-18T22:20:18.501385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518280+0000","last_change":"2024-08-18T22:20:18.513740+0000","last_active":"2024-08-18T22:20:18.518280+0000","last_peered":"2024-08-18T22:20:18.518280+0000","last_clean":"2024-08-18T22:20:18.518280+0000","last_became_active":"2024-08-18T22:20:18.513369+0000","last_became_peered":"2024-08-18T22:20:18.513369+0000","last_unstale":"2024-08-18T22:20:18.518280+0000","last_undegraded":"2024-08-18T22:20:18.518280+0000","last_fullsized":"2024-08-18T22:20:18.518280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:43.649712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.497053+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:20:18.497053+0000","last_peered":"2024-08-18T22:20:18.497053+0000","last_clean":"2024-08-18T22:20:18.497053+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:20:18.497053+0000","last_undegraded":"2024-08-18T22:20:18.497053+0000","last_fullsized":"2024-08-18T22:20:18.497053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":768520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":171485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":178152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":178152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":171485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":761853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":185389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:20:23.626 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:20:23.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.797+0000 7f1f9b200640 1 Processor -- start 2024-08-18T22:20:23.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.797+0000 7f1f9b200640 1 -- start start 2024-08-18T22:20:23.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f9b200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1f9c15c080 0x7f1f9c0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f9b200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f9c070b50 con 0x7f1f9c06c0c0 2024-08-18T22:20:23.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f9b200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f9c070e30 con 0x7f1f9c0cd920 2024-08-18T22:20:23.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f9b200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9c0cfb40 con 0x7f1f9c15c080 2024-08-18T22:20:23.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f9a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1f9c06c0c0 0x7f1f9c0731c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60908/0 (socket says 172.21.15.5:60908) 2024-08-18T22:20:23.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f9a800640 1 -- 172.21.15.5:0/293270126 learned_addr learned my addr 172.21.15.5:0/293270126 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:23.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f99e00640 1 --2- 172.21.15.5:0/293270126 >> v2:172.21.15.117:3300/0 conn(0x7f1f9c15c080 0x7f1f9c0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f99400640 1 -- 172.21.15.5:0/293270126 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158143995 0 0) 0x7f1f9c070b50 con 0x7f1f9c06c0c0 2024-08-18T22:20:23.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f99400640 1 -- 172.21.15.5:0/293270126 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f80003530 con 0x7f1f9c06c0c0 2024-08-18T22:20:23.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f99400640 1 -- 172.21.15.5:0/293270126 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928436671 0 0) 0x7f1f9c070e30 con 0x7f1f9c0cd920 2024-08-18T22:20:23.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f99400640 1 -- 172.21.15.5:0/293270126 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f9c070b50 con 0x7f1f9c0cd920 2024-08-18T22:20:23.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f99e00640 1 -- 172.21.15.5:0/293270126 >> v1:172.21.15.117:6789/0 conn(0x7f1f9c0cd920 legacy=0x7f1f9c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f99e00640 1 -- 172.21.15.5:0/293270126 >> v1:172.21.15.5:6789/0 conn(0x7f1f9c06c0c0 legacy=0x7f1f9c0731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.801+0000 7f1f99e00640 1 -- 172.21.15.5:0/293270126 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c071110 con 0x7f1f9c15c080 2024-08-18T22:20:23.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f99e00640 1 --2- 172.21.15.5:0/293270126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f9c15c080 0x7f1f9c0cf600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0097c0 tx=0x7f1f8c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9489d8bb7a0004f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:23.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f99400640 1 -- 172.21.15.5:0/293270126 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c0a7070 con 0x7f1f9c15c080 2024-08-18T22:20:23.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f99400640 1 -- 172.21.15.5:0/293270126 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f8c0b0070 con 0x7f1f9c15c080 2024-08-18T22:20:23.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f99400640 1 -- 172.21.15.5:0/293270126 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c0ab890 con 0x7f1f9c15c080 2024-08-18T22:20:23.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f9b200640 1 -- 172.21.15.5:0/293270126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f9c15c080 msgr2=0x7f1f9c0cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f9b200640 1 --2- 172.21.15.5:0/293270126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f9c15c080 0x7f1f9c0cf600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0097c0 tx=0x7f1f8c01c470 comp rx=0 tx=0).stop 2024-08-18T22:20:23.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f9b200640 1 -- 172.21.15.5:0/293270126 shutdown_connections 2024-08-18T22:20:23.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f9b200640 1 --2- 172.21.15.5:0/293270126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f9c15c080 0x7f1f9c0cf600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f9b200640 1 -- 172.21.15.5:0/293270126 >> 172.21.15.5:0/293270126 conn(0x7f1f9c0d0ed0 msgr2=0x7f1f9c0d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:23.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f9b200640 1 -- 172.21.15.5:0/293270126 shutdown_connections 2024-08-18T22:20:23.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f9b200640 1 -- 172.21.15.5:0/293270126 wait complete. 2024-08-18T22:20:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f9b200640 1 Processor -- start 2024-08-18T22:20:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.805+0000 7f1f9b200640 1 -- start start 2024-08-18T22:20:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f9c06c0c0 0x7f1f9c14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9b200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f9c0cd920 0x7f1f9c0c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9c15c080 0x7f1f9c0cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c073ce0 con 0x7f1f9c15c080 2024-08-18T22:20:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9b200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c0707e0 con 0x7f1f9c0cd920 2024-08-18T22:20:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c073e60 con 0x7f1f9c06c0c0 2024-08-18T22:20:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9c15c080 0x7f1f9c0cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9c15c080 0x7f1f9c0cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46046/0 (socket says 172.21.15.5:46046) 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9a800640 1 -- 172.21.15.5:0/480045937 learned_addr learned my addr 172.21.15.5:0/480045937 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f99e00640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f9c06c0c0 0x7f1f9c14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f91400640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f9c0cd920 0x7f1f9c0c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9a800640 1 -- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f9c06c0c0 msgr2=0x7f1f9c14de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9a800640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f9c06c0c0 0x7f1f9c14de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9a800640 1 -- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f9c0cd920 msgr2=0x7f1f9c0c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9a800640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f9c0cd920 0x7f1f9c0c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9a800640 1 -- 172.21.15.5:0/480045937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c0b5260 con 0x7f1f9c15c080 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f99e00640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f9c06c0c0 0x7f1f9c14de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9a800640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9c15c080 0x7f1f9c0cfcf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400cb70 tx=0x7f1f9400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f92a00640 1 -- 172.21.15.5:0/480045937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94017070 con 0x7f1f9c15c080 2024-08-18T22:20:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f92a00640 1 -- 172.21.15.5:0/480045937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f9400ace0 con 0x7f1f9c15c080 2024-08-18T22:20:23.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f92a00640 1 -- 172.21.15.5:0/480045937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94012600 con 0x7f1f9c15c080 2024-08-18T22:20:23.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9b200640 1 -- 172.21.15.5:0/480045937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c159180 con 0x7f1f9c15c080 2024-08-18T22:20:23.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9b200640 1 -- 172.21.15.5:0/480045937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c159740 con 0x7f1f9c15c080 2024-08-18T22:20:23.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f9b200640 1 -- 172.21.15.5:0/480045937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9c159940 con 0x7f1f9c15c080 2024-08-18T22:20:23.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.809+0000 7f1f92a00640 1 -- 172.21.15.5:0/480045937 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f9401a070 con 0x7f1f9c15c080 2024-08-18T22:20:23.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.813+0000 7f1f92a00640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f780678c0 0x7f1f78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:23.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.813+0000 7f1f92a00640 1 -- 172.21.15.5:0/480045937 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f1f94085a20 con 0x7f1f9c15c080 2024-08-18T22:20:23.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.813+0000 7f1f99e00640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f780678c0 0x7f1f78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:23.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.813+0000 7f1f99e00640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f780678c0 0x7f1f78069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0af000 tx=0x7f1f8c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:23.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.817+0000 7f1f92a00640 1 -- 172.21.15.5:0/480045937 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1f9c159940 con 0x7f1f9c15c080 2024-08-18T22:20:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.977+0000 7f1f9b200640 1 -- 172.21.15.5:0/480045937 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f9c0cf600 con 0x7f1f780678c0 2024-08-18T22:20:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.985+0000 7f1f92a00640 1 -- 172.21.15.5:0/480045937 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247713 (secure 0 0 0) 0x7f1f9c0cf600 con 0x7f1f780678c0 2024-08-18T22:20:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:20:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 -- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f780678c0 msgr2=0x7f1f78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f780678c0 0x7f1f78069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0af000 tx=0x7f1f8c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:20:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 -- 172.21.15.5:0/480045937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9c15c080 msgr2=0x7f1f9c0cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9c15c080 0x7f1f9c0cfcf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400cb70 tx=0x7f1f9400a430 comp rx=0 tx=0).stop 2024-08-18T22:20:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 -- 172.21.15.5:0/480045937 shutdown_connections 2024-08-18T22:20:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f780678c0 0x7f1f78069d80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f9c15c080 0x7f1f9c0cfcf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f9c0cd920 0x7f1f9c0c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 --2- 172.21.15.5:0/480045937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f9c06c0c0 0x7f1f9c14de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 -- 172.21.15.5:0/480045937 >> 172.21.15.5:0/480045937 conn(0x7f1f9c0d0ed0 msgr2=0x7f1f9c0d1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 -- 172.21.15.5:0/480045937 shutdown_connections 2024-08-18T22:20:23.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:23.989+0000 7f1f9b200640 1 -- 172.21.15.5:0/480045937 wait complete. 2024-08-18T22:20:24.010 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-08-18T22:20:23.633052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233080,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741640,"statfs":{"total":773094113280,"available":772855439360,"internally_reserved":0,"allocated":4530176,"data_stored":2600959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001063"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493092+0000","last_change":"2024-08-18T22:20:18.493092+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493092+0000","last_undegraded":"2024-08-18T22:20:18.493092+0000","last_fullsized":"2024-08-18T22:20:18.493092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.496244+0000","last_change":"2024-08-18T22:20:18.496244+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.496244+0000","last_undegraded":"2024-08-18T22:20:18.496244+0000","last_fullsized":"2024-08-18T22:20:18.496244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.496407+0000","last_change":"2024-08-18T22:20:18.496407+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.496407+0000","last_undegraded":"2024-08-18T22:20:18.496407+0000","last_fullsized":"2024-08-18T22:20:18.496407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529400+0000","last_change":"2024-08-18T22:20:19.523171+0000","last_active":"2024-08-18T22:20:19.529400+0000","last_peered":"2024-08-18T22:20:19.529400+0000","last_clean":"2024-08-18T22:20:19.529400+0000","last_became_active":"2024-08-18T22:20:19.522915+0000","last_became_peered":"2024-08-18T22:20:19.522915+0000","last_unstale":"2024-08-18T22:20:19.529400+0000","last_undegraded":"2024-08-18T22:20:19.529400+0000","last_fullsized":"2024-08-18T22:20:19.529400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:55:25.376251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.522175+0000","last_change":"2024-08-18T22:20:19.514150+0000","last_active":"2024-08-18T22:20:19.522175+0000","last_peered":"2024-08-18T22:20:19.522175+0000","last_clean":"2024-08-18T22:20:19.522175+0000","last_became_active":"2024-08-18T22:20:19.513901+0000","last_became_peered":"2024-08-18T22:20:19.513901+0000","last_unstale":"2024-08-18T22:20:19.522175+0000","last_undegraded":"2024-08-18T22:20:19.522175+0000","last_fullsized":"2024-08-18T22:20:19.522175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:38.521131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493274+0000","last_change":"2024-08-18T22:20:18.493274+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493274+0000","last_undegraded":"2024-08-18T22:20:18.493274+0000","last_fullsized":"2024-08-18T22:20:18.493274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499887+0000","last_change":"2024-08-18T22:20:18.499887+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499887+0000","last_undegraded":"2024-08-18T22:20:18.499887+0000","last_fullsized":"2024-08-18T22:20:18.499887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491230+0000","last_change":"2024-08-18T22:20:18.491230+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491230+0000","last_undegraded":"2024-08-18T22:20:18.491230+0000","last_fullsized":"2024-08-18T22:20:18.491230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495448+0000","last_change":"2024-08-18T22:20:18.495448+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495448+0000","last_undegraded":"2024-08-18T22:20:18.495448+0000","last_fullsized":"2024-08-18T22:20:18.495448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498758+0000","last_change":"2024-08-18T22:20:18.498758+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498758+0000","last_undegraded":"2024-08-18T22:20:18.498758+0000","last_fullsized":"2024-08-18T22:20:18.498758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498892+0000","last_change":"2024-08-18T22:20:18.498892+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498892+0000","last_undegraded":"2024-08-18T22:20:18.498892+0000","last_fullsized":"2024-08-18T22:20:18.498892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495011+0000","last_change":"2024-08-18T22:20:18.495011+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495011+0000","last_undegraded":"2024-08-18T22:20:18.495011+0000","last_fullsized":"2024-08-18T22:20:18.495011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.504430+0000","last_change":"2024-08-18T22:20:18.504430+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.504430+0000","last_undegraded":"2024-08-18T22:20:18.504430+0000","last_fullsized":"2024-08-18T22:20:18.504430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506172+0000","last_change":"2024-08-18T22:20:19.510105+0000","last_active":"2024-08-18T22:20:20.506172+0000","last_peered":"2024-08-18T22:20:20.506172+0000","last_clean":"2024-08-18T22:20:20.506172+0000","last_became_active":"2024-08-18T22:20:19.509851+0000","last_became_peered":"2024-08-18T22:20:19.509851+0000","last_unstale":"2024-08-18T22:20:20.506172+0000","last_undegraded":"2024-08-18T22:20:20.506172+0000","last_fullsized":"2024-08-18T22:20:20.506172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:44.652528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499339+0000","last_change":"2024-08-18T22:20:18.499339+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499339+0000","last_undegraded":"2024-08-18T22:20:18.499339+0000","last_fullsized":"2024-08-18T22:20:18.499339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495978+0000","last_change":"2024-08-18T22:20:18.495978+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495978+0000","last_undegraded":"2024-08-18T22:20:18.495978+0000","last_fullsized":"2024-08-18T22:20:18.495978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.501271+0000","last_change":"2024-08-18T22:20:18.501271+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.501271+0000","last_undegraded":"2024-08-18T22:20:18.501271+0000","last_fullsized":"2024-08-18T22:20:18.501271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490502+0000","last_change":"2024-08-18T22:20:18.490502+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490502+0000","last_undegraded":"2024-08-18T22:20:18.490502+0000","last_fullsized":"2024-08-18T22:20:18.490502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.522894+0000","last_change":"2024-08-18T22:20:19.513201+0000","last_active":"2024-08-18T22:20:19.522894+0000","last_peered":"2024-08-18T22:20:19.522894+0000","last_clean":"2024-08-18T22:20:19.522894+0000","last_became_active":"2024-08-18T22:20:19.512920+0000","last_became_peered":"2024-08-18T22:20:19.512920+0000","last_unstale":"2024-08-18T22:20:19.522894+0000","last_undegraded":"2024-08-18T22:20:19.522894+0000","last_fullsized":"2024-08-18T22:20:19.522894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:03.535227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490750+0000","last_change":"2024-08-18T22:20:18.490750+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490750+0000","last_undegraded":"2024-08-18T22:20:18.490750+0000","last_fullsized":"2024-08-18T22:20:18.490750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497883+0000","last_change":"2024-08-18T22:20:18.497883+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497883+0000","last_undegraded":"2024-08-18T22:20:18.497883+0000","last_fullsized":"2024-08-18T22:20:18.497883+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506727+0000","last_change":"2024-08-18T22:20:19.517261+0000","last_active":"2024-08-18T22:20:20.506727+0000","last_peered":"2024-08-18T22:20:20.506727+0000","last_clean":"2024-08-18T22:20:20.506727+0000","last_became_active":"2024-08-18T22:20:19.516966+0000","last_became_peered":"2024-08-18T22:20:19.516966+0000","last_unstale":"2024-08-18T22:20:20.506727+0000","last_undegraded":"2024-08-18T22:20:20.506727+0000","last_fullsized":"2024-08-18T22:20:20.506727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:39:08.996900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497861+0000","last_change":"2024-08-18T22:20:18.497861+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497861+0000","last_undegraded":"2024-08-18T22:20:18.497861+0000","last_fullsized":"2024-08-18T22:20:18.497861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.528004+0000","last_change":"2024-08-18T22:20:19.518451+0000","last_active":"2024-08-18T22:20:19.528004+0000","last_peered":"2024-08-18T22:20:19.528004+0000","last_clean":"2024-08-18T22:20:19.528004+0000","last_became_active":"2024-08-18T22:20:19.517998+0000","last_became_peered":"2024-08-18T22:20:19.517998+0000","last_unstale":"2024-08-18T22:20:19.528004+0000","last_undegraded":"2024-08-18T22:20:19.528004+0000","last_fullsized":"2024-08-18T22:20:19.528004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:30:38.396904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490377+0000","last_change":"2024-08-18T22:20:18.490377+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490377+0000","last_undegraded":"2024-08-18T22:20:18.490377+0000","last_fullsized":"2024-08-18T22:20:18.490377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491526+0000","last_change":"2024-08-18T22:20:18.491526+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491526+0000","last_undegraded":"2024-08-18T22:20:18.491526+0000","last_fullsized":"2024-08-18T22:20:18.491526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490426+0000","last_change":"2024-08-18T22:20:18.490426+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490426+0000","last_undegraded":"2024-08-18T22:20:18.490426+0000","last_fullsized":"2024-08-18T22:20:18.490426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497790+0000","last_change":"2024-08-18T22:20:18.497790+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497790+0000","last_undegraded":"2024-08-18T22:20:18.497790+0000","last_fullsized":"2024-08-18T22:20:18.497790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490338+0000","last_change":"2024-08-18T22:20:18.490338+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490338+0000","last_undegraded":"2024-08-18T22:20:18.490338+0000","last_fullsized":"2024-08-18T22:20:18.490338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490566+0000","last_change":"2024-08-18T22:20:18.490566+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490566+0000","last_undegraded":"2024-08-18T22:20:18.490566+0000","last_fullsized":"2024-08-18T22:20:18.490566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493157+0000","last_change":"2024-08-18T22:20:18.493157+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493157+0000","last_undegraded":"2024-08-18T22:20:18.493157+0000","last_fullsized":"2024-08-18T22:20:18.493157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491344+0000","last_change":"2024-08-18T22:20:18.491344+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491344+0000","last_undegraded":"2024-08-18T22:20:18.491344+0000","last_fullsized":"2024-08-18T22:20:18.491344+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.500047+0000","last_change":"2024-08-18T22:20:18.500047+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.500047+0000","last_undegraded":"2024-08-18T22:20:18.500047+0000","last_fullsized":"2024-08-18T22:20:18.500047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510476+0000","last_change":"2024-08-18T22:20:18.507055+0000","last_active":"2024-08-18T22:20:18.510476+0000","last_peered":"2024-08-18T22:20:18.510476+0000","last_clean":"2024-08-18T22:20:18.510476+0000","last_became_active":"2024-08-18T22:20:18.506703+0000","last_became_peered":"2024-08-18T22:20:18.506703+0000","last_unstale":"2024-08-18T22:20:18.510476+0000","last_undegraded":"2024-08-18T22:20:18.510476+0000","last_fullsized":"2024-08-18T22:20:18.510476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:01:24.898465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492337+0000","last_change":"2024-08-18T22:20:18.492337+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492337+0000","last_undegraded":"2024-08-18T22:20:18.492337+0000","last_fullsized":"2024-08-18T22:20:18.492337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510279+0000","last_change":"2024-08-18T22:20:18.506164+0000","last_active":"2024-08-18T22:20:18.510279+0000","last_peered":"2024-08-18T22:20:18.510279+0000","last_clean":"2024-08-18T22:20:18.510279+0000","last_became_active":"2024-08-18T22:20:18.505859+0000","last_became_peered":"2024-08-18T22:20:18.505859+0000","last_unstale":"2024-08-18T22:20:18.510279+0000","last_undegraded":"2024-08-18T22:20:18.510279+0000","last_fullsized":"2024-08-18T22:20:18.510279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:13.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507281+0000","last_change":"2024-08-18T22:20:19.511725+0000","last_active":"2024-08-18T22:20:20.507281+0000","last_peered":"2024-08-18T22:20:20.507281+0000","last_clean":"2024-08-18T22:20:20.507281+0000","last_became_active":"2024-08-18T22:20:19.509416+0000","last_became_peered":"2024-08-18T22:20:19.509416+0000","last_unstale":"2024-08-18T22:20:20.507281+0000","last_undegraded":"2024-08-18T22:20:20.507281+0000","last_fullsized":"2024-08-18T22:20:20.507281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:46.028258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510679+0000","last_change":"2024-08-18T22:20:18.505900+0000","last_active":"2024-08-18T22:20:18.510679+0000","last_peered":"2024-08-18T22:20:18.510679+0000","last_clean":"2024-08-18T22:20:18.510679+0000","last_became_active":"2024-08-18T22:20:18.505628+0000","last_became_peered":"2024-08-18T22:20:18.505628+0000","last_unstale":"2024-08-18T22:20:18.510679+0000","last_undegraded":"2024-08-18T22:20:18.510679+0000","last_fullsized":"2024-08-18T22:20:18.510679+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:33.626411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493547+0000","last_change":"2024-08-18T22:20:18.493547+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493547+0000","last_undegraded":"2024-08-18T22:20:18.493547+0000","last_fullsized":"2024-08-18T22:20:18.493547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506625+0000","last_change":"2024-08-18T22:20:18.506470+0000","last_active":"2024-08-18T22:20:20.506625+0000","last_peered":"2024-08-18T22:20:20.506625+0000","last_clean":"2024-08-18T22:20:20.506625+0000","last_became_active":"2024-08-18T22:20:18.505750+0000","last_became_peered":"2024-08-18T22:20:18.505750+0000","last_unstale":"2024-08-18T22:20:20.506625+0000","last_undegraded":"2024-08-18T22:20:20.506625+0000","last_fullsized":"2024-08-18T22:20:20.506625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:28.594042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495750+0000","last_change":"2024-08-18T22:20:18.495750+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495750+0000","last_undegraded":"2024-08-18T22:20:18.495750+0000","last_fullsized":"2024-08-18T22:20:18.495750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518308+0000","last_change":"2024-08-18T22:20:18.513803+0000","last_active":"2024-08-18T22:20:18.518308+0000","last_peered":"2024-08-18T22:20:18.518308+0000","last_clean":"2024-08-18T22:20:18.518308+0000","last_became_active":"2024-08-18T22:20:18.513118+0000","last_became_peered":"2024-08-18T22:20:18.513118+0000","last_unstale":"2024-08-18T22:20:18.518308+0000","last_undegraded":"2024-08-18T22:20:18.518308+0000","last_fullsized":"2024-08-18T22:20:18.518308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:43.649712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497649+0000","last_change":"2024-08-18T22:20:18.497649+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497649+0000","last_undegraded":"2024-08-18T22:20:18.497649+0000","last_fullsized":"2024-08-18T22:20:18.497649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.514042+0000","last_change":"2024-08-18T22:20:18.507975+0000","last_active":"2024-08-18T22:20:18.514042+0000","last_peered":"2024-08-18T22:20:18.514042+0000","last_clean":"2024-08-18T22:20:18.514042+0000","last_became_active":"2024-08-18T22:20:18.507730+0000","last_became_peered":"2024-08-18T22:20:18.507730+0000","last_unstale":"2024-08-18T22:20:18.514042+0000","last_undegraded":"2024-08-18T22:20:18.514042+0000","last_fullsized":"2024-08-18T22:20:18.514042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:16.215376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506523+0000","last_change":"2024-08-18T22:20:19.512493+0000","last_active":"2024-08-18T22:20:20.506523+0000","last_peered":"2024-08-18T22:20:20.506523+0000","last_clean":"2024-08-18T22:20:20.506523+0000","last_became_active":"2024-08-18T22:20:19.512176+0000","last_became_peered":"2024-08-18T22:20:19.512176+0000","last_unstale":"2024-08-18T22:20:20.506523+0000","last_undegraded":"2024-08-18T22:20:20.506523+0000","last_fullsized":"2024-08-18T22:20:20.506523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:50.110322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516286+0000","last_change":"2024-08-18T22:20:18.514200+0000","last_active":"2024-08-18T22:20:18.516286+0000","last_peered":"2024-08-18T22:20:18.516286+0000","last_clean":"2024-08-18T22:20:18.516286+0000","last_became_active":"2024-08-18T22:20:18.513674+0000","last_became_peered":"2024-08-18T22:20:18.513674+0000","last_unstale":"2024-08-18T22:20:18.516286+0000","last_undegraded":"2024-08-18T22:20:18.516286+0000","last_fullsized":"2024-08-18T22:20:18.516286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:17.147946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499266+0000","last_change":"2024-08-18T22:20:18.499266+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499266+0000","last_undegraded":"2024-08-18T22:20:18.499266+0000","last_fullsized":"2024-08-18T22:20:18.499266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505383+0000","last_change":"2024-08-18T22:20:18.509839+0000","last_active":"2024-08-18T22:20:20.505383+0000","last_peered":"2024-08-18T22:20:20.505383+0000","last_clean":"2024-08-18T22:20:20.505383+0000","last_became_active":"2024-08-18T22:20:18.509566+0000","last_became_peered":"2024-08-18T22:20:18.509566+0000","last_unstale":"2024-08-18T22:20:20.505383+0000","last_undegraded":"2024-08-18T22:20:20.505383+0000","last_fullsized":"2024-08-18T22:20:20.505383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:52:05.432990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529421+0000","last_change":"2024-08-18T22:20:19.527869+0000","last_active":"2024-08-18T22:20:19.529421+0000","last_peered":"2024-08-18T22:20:19.529421+0000","last_clean":"2024-08-18T22:20:19.529421+0000","last_became_active":"2024-08-18T22:20:19.527597+0000","last_became_peered":"2024-08-18T22:20:19.527597+0000","last_unstale":"2024-08-18T22:20:19.529421+0000","last_undegraded":"2024-08-18T22:20:19.529421+0000","last_fullsized":"2024-08-18T22:20:19.529421+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:59.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511279+0000","last_change":"2024-08-18T22:20:18.504598+0000","last_active":"2024-08-18T22:20:18.511279+0000","last_peered":"2024-08-18T22:20:18.511279+0000","last_clean":"2024-08-18T22:20:18.511279+0000","last_became_active":"2024-08-18T22:20:18.502312+0000","last_became_peered":"2024-08-18T22:20:18.502312+0000","last_unstale":"2024-08-18T22:20:18.511279+0000","last_undegraded":"2024-08-18T22:20:18.511279+0000","last_fullsized":"2024-08-18T22:20:18.511279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:19:25.740187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495705+0000","last_change":"2024-08-18T22:20:18.495705+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495705+0000","last_undegraded":"2024-08-18T22:20:18.495705+0000","last_fullsized":"2024-08-18T22:20:18.495705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518366+0000","last_change":"2024-08-18T22:20:18.514724+0000","last_active":"2024-08-18T22:20:18.518366+0000","last_peered":"2024-08-18T22:20:18.518366+0000","last_clean":"2024-08-18T22:20:18.518366+0000","last_became_active":"2024-08-18T22:20:18.513465+0000","last_became_peered":"2024-08-18T22:20:18.513465+0000","last_unstale":"2024-08-18T22:20:18.518366+0000","last_undegraded":"2024-08-18T22:20:18.518366+0000","last_fullsized":"2024-08-18T22:20:18.518366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:01.005845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495051+0000","last_change":"2024-08-18T22:20:18.495051+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495051+0000","last_undegraded":"2024-08-18T22:20:18.495051+0000","last_fullsized":"2024-08-18T22:20:18.495051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.514527+0000","last_change":"2024-08-18T22:20:18.508636+0000","last_active":"2024-08-18T22:20:18.514527+0000","last_peered":"2024-08-18T22:20:18.514527+0000","last_clean":"2024-08-18T22:20:18.514527+0000","last_became_active":"2024-08-18T22:20:18.508356+0000","last_became_peered":"2024-08-18T22:20:18.508356+0000","last_unstale":"2024-08-18T22:20:18.514527+0000","last_undegraded":"2024-08-18T22:20:18.514527+0000","last_fullsized":"2024-08-18T22:20:18.514527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:50.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507231+0000","last_change":"2024-08-18T22:20:19.527189+0000","last_active":"2024-08-18T22:20:20.507231+0000","last_peered":"2024-08-18T22:20:20.507231+0000","last_clean":"2024-08-18T22:20:20.507231+0000","last_became_active":"2024-08-18T22:20:19.526929+0000","last_became_peered":"2024-08-18T22:20:19.526929+0000","last_unstale":"2024-08-18T22:20:20.507231+0000","last_undegraded":"2024-08-18T22:20:20.507231+0000","last_fullsized":"2024-08-18T22:20:20.507231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:27.898874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.513335+0000","last_change":"2024-08-18T22:20:18.505405+0000","last_active":"2024-08-18T22:20:18.513335+0000","last_peered":"2024-08-18T22:20:18.513335+0000","last_clean":"2024-08-18T22:20:18.513335+0000","last_became_active":"2024-08-18T22:20:18.505140+0000","last_became_peered":"2024-08-18T22:20:18.505140+0000","last_unstale":"2024-08-18T22:20:18.513335+0000","last_undegraded":"2024-08-18T22:20:18.513335+0000","last_fullsized":"2024-08-18T22:20:18.513335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:24.501896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495135+0000","last_change":"2024-08-18T22:20:18.495135+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495135+0000","last_undegraded":"2024-08-18T22:20:18.495135+0000","last_fullsized":"2024-08-18T22:20:18.495135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511185+0000","last_change":"2024-08-18T22:20:18.506928+0000","last_active":"2024-08-18T22:20:18.511185+0000","last_peered":"2024-08-18T22:20:18.511185+0000","last_clean":"2024-08-18T22:20:18.511185+0000","last_became_active":"2024-08-18T22:20:18.506655+0000","last_became_peered":"2024-08-18T22:20:18.506655+0000","last_unstale":"2024-08-18T22:20:18.511185+0000","last_undegraded":"2024-08-18T22:20:18.511185+0000","last_fullsized":"2024-08-18T22:20:18.511185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:49.429237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491918+0000","last_change":"2024-08-18T22:20:18.491918+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491918+0000","last_undegraded":"2024-08-18T22:20:18.491918+0000","last_fullsized":"2024-08-18T22:20:18.491918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.515266+0000","last_change":"2024-08-18T22:20:18.513595+0000","last_active":"2024-08-18T22:20:18.515266+0000","last_peered":"2024-08-18T22:20:18.515266+0000","last_clean":"2024-08-18T22:20:18.515266+0000","last_became_active":"2024-08-18T22:20:18.513298+0000","last_became_peered":"2024-08-18T22:20:18.513298+0000","last_unstale":"2024-08-18T22:20:18.515266+0000","last_undegraded":"2024-08-18T22:20:18.515266+0000","last_fullsized":"2024-08-18T22:20:18.515266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:03.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499687+0000","last_change":"2024-08-18T22:20:18.499687+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499687+0000","last_undegraded":"2024-08-18T22:20:18.499687+0000","last_fullsized":"2024-08-18T22:20:18.499687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511974+0000","last_change":"2024-08-18T22:20:18.507441+0000","last_active":"2024-08-18T22:20:18.511974+0000","last_peered":"2024-08-18T22:20:18.511974+0000","last_clean":"2024-08-18T22:20:18.511974+0000","last_became_active":"2024-08-18T22:20:18.507129+0000","last_became_peered":"2024-08-18T22:20:18.507129+0000","last_unstale":"2024-08-18T22:20:18.511974+0000","last_undegraded":"2024-08-18T22:20:18.511974+0000","last_fullsized":"2024-08-18T22:20:18.511974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:31.386164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498828+0000","last_change":"2024-08-18T22:20:18.498828+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498828+0000","last_undegraded":"2024-08-18T22:20:18.498828+0000","last_fullsized":"2024-08-18T22:20:18.498828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511125+0000","last_change":"2024-08-18T22:20:18.505545+0000","last_active":"2024-08-18T22:20:18.511125+0000","last_peered":"2024-08-18T22:20:18.511125+0000","last_clean":"2024-08-18T22:20:18.511125+0000","last_became_active":"2024-08-18T22:20:18.505240+0000","last_became_peered":"2024-08-18T22:20:18.505240+0000","last_unstale":"2024-08-18T22:20:18.511125+0000","last_undegraded":"2024-08-18T22:20:18.511125+0000","last_fullsized":"2024-08-18T22:20:18.511125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:50.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492381+0000","last_change":"2024-08-18T22:20:18.492381+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492381+0000","last_undegraded":"2024-08-18T22:20:18.492381+0000","last_fullsized":"2024-08-18T22:20:18.492381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516342+0000","last_change":"2024-08-18T22:20:18.511501+0000","last_active":"2024-08-18T22:20:18.516342+0000","last_peered":"2024-08-18T22:20:18.516342+0000","last_clean":"2024-08-18T22:20:18.516342+0000","last_became_active":"2024-08-18T22:20:18.511239+0000","last_became_peered":"2024-08-18T22:20:18.511239+0000","last_unstale":"2024-08-18T22:20:18.516342+0000","last_undegraded":"2024-08-18T22:20:18.516342+0000","last_fullsized":"2024-08-18T22:20:18.516342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:27:37.314171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498467+0000","last_change":"2024-08-18T22:20:18.498467+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498467+0000","last_undegraded":"2024-08-18T22:20:18.498467+0000","last_fullsized":"2024-08-18T22:20:18.498467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507244+0000","last_change":"2024-08-18T22:20:18.510173+0000","last_active":"2024-08-18T22:20:20.507244+0000","last_peered":"2024-08-18T22:20:20.507244+0000","last_clean":"2024-08-18T22:20:20.507244+0000","last_became_active":"2024-08-18T22:20:18.509595+0000","last_became_peered":"2024-08-18T22:20:18.509595+0000","last_unstale":"2024-08-18T22:20:20.507244+0000","last_undegraded":"2024-08-18T22:20:20.507244+0000","last_fullsized":"2024-08-18T22:20:20.507244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:03.733472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507175+0000","last_change":"2024-08-18T22:20:19.509550+0000","last_active":"2024-08-18T22:20:20.507175+0000","last_peered":"2024-08-18T22:20:20.507175+0000","last_clean":"2024-08-18T22:20:20.507175+0000","last_became_active":"2024-08-18T22:20:19.509074+0000","last_became_peered":"2024-08-18T22:20:19.509074+0000","last_unstale":"2024-08-18T22:20:20.507175+0000","last_undegraded":"2024-08-18T22:20:20.507175+0000","last_fullsized":"2024-08-18T22:20:20.507175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:30.801816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.526269+0000","last_change":"2024-08-18T22:20:18.510334+0000","last_active":"2024-08-18T22:20:19.526269+0000","last_peered":"2024-08-18T22:20:19.526269+0000","last_clean":"2024-08-18T22:20:19.526269+0000","last_became_active":"2024-08-18T22:20:18.510061+0000","last_became_peered":"2024-08-18T22:20:18.510061+0000","last_unstale":"2024-08-18T22:20:19.526269+0000","last_undegraded":"2024-08-18T22:20:19.526269+0000","last_fullsized":"2024-08-18T22:20:19.526269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:47:45.552211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529777+0000","last_change":"2024-08-18T22:20:19.525958+0000","last_active":"2024-08-18T22:20:19.529777+0000","last_peered":"2024-08-18T22:20:19.529777+0000","last_clean":"2024-08-18T22:20:19.529777+0000","last_became_active":"2024-08-18T22:20:19.524979+0000","last_became_peered":"2024-08-18T22:20:19.524979+0000","last_unstale":"2024-08-18T22:20:19.529777+0000","last_undegraded":"2024-08-18T22:20:19.529777+0000","last_fullsized":"2024-08-18T22:20:19.529777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:51.616637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510536+0000","last_change":"2024-08-18T22:20:18.505895+0000","last_active":"2024-08-18T22:20:18.510536+0000","last_peered":"2024-08-18T22:20:18.510536+0000","last_clean":"2024-08-18T22:20:18.510536+0000","last_became_active":"2024-08-18T22:20:18.505603+0000","last_became_peered":"2024-08-18T22:20:18.505603+0000","last_unstale":"2024-08-18T22:20:18.510536+0000","last_undegraded":"2024-08-18T22:20:18.510536+0000","last_fullsized":"2024-08-18T22:20:18.510536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:13.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493638+0000","last_change":"2024-08-18T22:20:18.493638+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493638+0000","last_undegraded":"2024-08-18T22:20:18.493638+0000","last_fullsized":"2024-08-18T22:20:18.493638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.521128+0000","last_change":"2024-08-18T22:20:18.513238+0000","last_active":"2024-08-18T22:20:19.521128+0000","last_peered":"2024-08-18T22:20:19.521128+0000","last_clean":"2024-08-18T22:20:19.521128+0000","last_became_active":"2024-08-18T22:20:18.512768+0000","last_became_peered":"2024-08-18T22:20:18.512768+0000","last_unstale":"2024-08-18T22:20:19.521128+0000","last_undegraded":"2024-08-18T22:20:19.521128+0000","last_fullsized":"2024-08-18T22:20:19.521128+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:33.762072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495481+0000","last_change":"2024-08-18T22:20:18.495481+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495481+0000","last_undegraded":"2024-08-18T22:20:18.495481+0000","last_fullsized":"2024-08-18T22:20:18.495481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.509691+0000","last_change":"2024-08-18T22:20:18.512744+0000","last_active":"2024-08-18T22:20:19.509691+0000","last_peered":"2024-08-18T22:20:19.509691+0000","last_clean":"2024-08-18T22:20:19.509691+0000","last_became_active":"2024-08-18T22:20:18.512351+0000","last_became_peered":"2024-08-18T22:20:18.512351+0000","last_unstale":"2024-08-18T22:20:19.509691+0000","last_undegraded":"2024-08-18T22:20:19.509691+0000","last_fullsized":"2024-08-18T22:20:19.509691+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:37:13.840163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.504630+0000","last_change":"2024-08-18T22:20:18.504630+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.504630+0000","last_undegraded":"2024-08-18T22:20:18.504630+0000","last_fullsized":"2024-08-18T22:20:18.504630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.515749+0000","last_change":"2024-08-18T22:20:18.510805+0000","last_active":"2024-08-18T22:20:18.515749+0000","last_peered":"2024-08-18T22:20:18.515749+0000","last_clean":"2024-08-18T22:20:18.515749+0000","last_became_active":"2024-08-18T22:20:18.510506+0000","last_became_peered":"2024-08-18T22:20:18.510506+0000","last_unstale":"2024-08-18T22:20:18.515749+0000","last_undegraded":"2024-08-18T22:20:18.515749+0000","last_fullsized":"2024-08-18T22:20:18.515749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:27:37.314171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493377+0000","last_change":"2024-08-18T22:20:18.493377+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493377+0000","last_undegraded":"2024-08-18T22:20:18.493377+0000","last_fullsized":"2024-08-18T22:20:18.493377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.508542+0000","last_change":"2024-08-18T22:20:18.509322+0000","last_active":"2024-08-18T22:20:19.508542+0000","last_peered":"2024-08-18T22:20:19.508542+0000","last_clean":"2024-08-18T22:20:19.508542+0000","last_became_active":"2024-08-18T22:20:18.509032+0000","last_became_peered":"2024-08-18T22:20:18.509032+0000","last_unstale":"2024-08-18T22:20:19.508542+0000","last_undegraded":"2024-08-18T22:20:19.508542+0000","last_fullsized":"2024-08-18T22:20:19.508542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:26:25.888447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492384+0000","last_change":"2024-08-18T22:20:18.492384+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492384+0000","last_undegraded":"2024-08-18T22:20:18.492384+0000","last_fullsized":"2024-08-18T22:20:18.492384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516322+0000","last_change":"2024-08-18T22:20:18.510784+0000","last_active":"2024-08-18T22:20:18.516322+0000","last_peered":"2024-08-18T22:20:18.516322+0000","last_clean":"2024-08-18T22:20:18.516322+0000","last_became_active":"2024-08-18T22:20:18.510472+0000","last_became_peered":"2024-08-18T22:20:18.510472+0000","last_unstale":"2024-08-18T22:20:18.516322+0000","last_undegraded":"2024-08-18T22:20:18.516322+0000","last_fullsized":"2024-08-18T22:20:18.516322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:16.215376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493125+0000","last_change":"2024-08-18T22:20:18.493125+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493125+0000","last_undegraded":"2024-08-18T22:20:18.493125+0000","last_fullsized":"2024-08-18T22:20:18.493125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.511615+0000","last_change":"2024-08-18T22:20:18.515716+0000","last_active":"2024-08-18T22:20:19.511615+0000","last_peered":"2024-08-18T22:20:19.511615+0000","last_clean":"2024-08-18T22:20:19.511615+0000","last_became_active":"2024-08-18T22:20:18.515475+0000","last_became_peered":"2024-08-18T22:20:18.515475+0000","last_unstale":"2024-08-18T22:20:19.511615+0000","last_undegraded":"2024-08-18T22:20:19.511615+0000","last_fullsized":"2024-08-18T22:20:19.511615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:00:01.480754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495710+0000","last_change":"2024-08-18T22:20:18.495710+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495710+0000","last_undegraded":"2024-08-18T22:20:18.495710+0000","last_fullsized":"2024-08-18T22:20:18.495710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.512673+0000","last_change":"2024-08-18T22:20:18.511256+0000","last_active":"2024-08-18T22:20:18.512673+0000","last_peered":"2024-08-18T22:20:18.512673+0000","last_clean":"2024-08-18T22:20:18.512673+0000","last_became_active":"2024-08-18T22:20:18.510423+0000","last_became_peered":"2024-08-18T22:20:18.510423+0000","last_unstale":"2024-08-18T22:20:18.512673+0000","last_undegraded":"2024-08-18T22:20:18.512673+0000","last_fullsized":"2024-08-18T22:20:18.512673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:03.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.494509+0000","last_change":"2024-08-18T22:20:18.494509+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.494509+0000","last_undegraded":"2024-08-18T22:20:18.494509+0000","last_fullsized":"2024-08-18T22:20:18.494509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.512641+0000","last_change":"2024-08-18T22:20:18.510833+0000","last_active":"2024-08-18T22:20:18.512641+0000","last_peered":"2024-08-18T22:20:18.512641+0000","last_clean":"2024-08-18T22:20:18.512641+0000","last_became_active":"2024-08-18T22:20:18.510510+0000","last_became_peered":"2024-08-18T22:20:18.510510+0000","last_unstale":"2024-08-18T22:20:18.512641+0000","last_undegraded":"2024-08-18T22:20:18.512641+0000","last_fullsized":"2024-08-18T22:20:18.512641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:33.626411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492553+0000","last_change":"2024-08-18T22:20:18.492553+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492553+0000","last_undegraded":"2024-08-18T22:20:18.492553+0000","last_fullsized":"2024-08-18T22:20:18.492553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511290+0000","last_change":"2024-08-18T22:20:18.508896+0000","last_active":"2024-08-18T22:20:18.511290+0000","last_peered":"2024-08-18T22:20:18.511290+0000","last_clean":"2024-08-18T22:20:18.511290+0000","last_became_active":"2024-08-18T22:20:18.508538+0000","last_became_peered":"2024-08-18T22:20:18.508538+0000","last_unstale":"2024-08-18T22:20:18.511290+0000","last_undegraded":"2024-08-18T22:20:18.511290+0000","last_fullsized":"2024-08-18T22:20:18.511290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:06.513442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506321+0000","last_change":"2024-08-18T22:20:19.524685+0000","last_active":"2024-08-18T22:20:20.506321+0000","last_peered":"2024-08-18T22:20:20.506321+0000","last_clean":"2024-08-18T22:20:20.506321+0000","last_became_active":"2024-08-18T22:20:19.524418+0000","last_became_peered":"2024-08-18T22:20:19.524418+0000","last_unstale":"2024-08-18T22:20:20.506321+0000","last_undegraded":"2024-08-18T22:20:20.506321+0000","last_fullsized":"2024-08-18T22:20:20.506321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:53.696643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505510+0000","last_change":"2024-08-18T22:20:18.506063+0000","last_active":"2024-08-18T22:20:20.505510+0000","last_peered":"2024-08-18T22:20:20.505510+0000","last_clean":"2024-08-18T22:20:20.505510+0000","last_became_active":"2024-08-18T22:20:18.505766+0000","last_became_peered":"2024-08-18T22:20:18.505766+0000","last_unstale":"2024-08-18T22:20:20.505510+0000","last_undegraded":"2024-08-18T22:20:20.505510+0000","last_fullsized":"2024-08-18T22:20:20.505510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:58.591575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499675+0000","last_change":"2024-08-18T22:20:18.499675+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499675+0000","last_undegraded":"2024-08-18T22:20:18.499675+0000","last_fullsized":"2024-08-18T22:20:18.499675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.507481+0000","last_change":"2024-08-18T22:20:18.501496+0000","last_active":"2024-08-18T22:20:18.507481+0000","last_peered":"2024-08-18T22:20:18.507481+0000","last_clean":"2024-08-18T22:20:18.507481+0000","last_became_active":"2024-08-18T22:20:18.501227+0000","last_became_peered":"2024-08-18T22:20:18.501227+0000","last_unstale":"2024-08-18T22:20:18.507481+0000","last_undegraded":"2024-08-18T22:20:18.507481+0000","last_fullsized":"2024-08-18T22:20:18.507481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:31.328987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.501385+0000","last_change":"2024-08-18T22:20:18.501385+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.501385+0000","last_undegraded":"2024-08-18T22:20:18.501385+0000","last_fullsized":"2024-08-18T22:20:18.501385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518280+0000","last_change":"2024-08-18T22:20:18.513740+0000","last_active":"2024-08-18T22:20:18.518280+0000","last_peered":"2024-08-18T22:20:18.518280+0000","last_clean":"2024-08-18T22:20:18.518280+0000","last_became_active":"2024-08-18T22:20:18.513369+0000","last_became_peered":"2024-08-18T22:20:18.513369+0000","last_unstale":"2024-08-18T22:20:18.518280+0000","last_undegraded":"2024-08-18T22:20:18.518280+0000","last_fullsized":"2024-08-18T22:20:18.518280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:43.649712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.497053+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:20:18.497053+0000","last_peered":"2024-08-18T22:20:18.497053+0000","last_clean":"2024-08-18T22:20:18.497053+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:20:18.497053+0000","last_undegraded":"2024-08-18T22:20:18.497053+0000","last_fullsized":"2024-08-18T22:20:18.497053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":768520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":171485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":178152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":178152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":171485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":761853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":185389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:20:24.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:20:24.035 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-08-18T22:20:24.033+0000 7ffaf0200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:20:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe023200640 1 Processor -- start 2024-08-18T22:20:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe023200640 1 -- start start 2024-08-18T22:20:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe023200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe01c06f290 0x7fe01c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe023200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe01c0cd3a0 0x7fe01c072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe023200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe01c0cd850 con 0x7fe01c15b010 2024-08-18T22:20:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe023200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe01c0cfa30 con 0x7fe01c0cd3a0 2024-08-18T22:20:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe023200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe01c0cee20 con 0x7fe01c06f290 2024-08-18T22:20:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe021200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe01c0cd3a0 0x7fe01c072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe021200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe01c0cd3a0 0x7fe01c072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46058/0 (socket says 172.21.15.5:46058) 2024-08-18T22:20:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe021200640 1 -- 172.21.15.5:0/1296995757 learned_addr learned my addr 172.21.15.5:0/1296995757 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe013400640 1 --2- 172.21.15.5:0/1296995757 >> v2:172.21.15.117:3300/0 conn(0x7fe01c06f290 0x7fe01c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe021200640 1 -- 172.21.15.5:0/1296995757 >> v2:172.21.15.117:3300/0 conn(0x7fe01c06f290 msgr2=0x7fe01c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe021200640 1 --2- 172.21.15.5:0/1296995757 >> v2:172.21.15.117:3300/0 conn(0x7fe01c06f290 0x7fe01c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe021200640 1 -- 172.21.15.5:0/1296995757 >> v1:172.21.15.117:6789/0 conn(0x7fe01c15b010 legacy=0x7fe01c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe021200640 1 -- 172.21.15.5:0/1296995757 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01c0cf100 con 0x7fe01c0cd3a0 2024-08-18T22:20:24.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.173+0000 7fe013400640 1 --2- 172.21.15.5:0/1296995757 >> v2:172.21.15.117:3300/0 conn(0x7fe01c06f290 0x7fe01c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:24.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe021200640 1 --2- 172.21.15.5:0/1296995757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe01c0cd3a0 0x7fe01c072620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0ca580 tx=0x7fe01401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6812e03c3e353857 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:24.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe01b400640 1 -- 172.21.15.5:0/1296995757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140aa610 con 0x7fe01c0cd3a0 2024-08-18T22:20:24.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe01b400640 1 -- 172.21.15.5:0/1296995757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0140af070 con 0x7fe01c0cd3a0 2024-08-18T22:20:24.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe01b400640 1 -- 172.21.15.5:0/1296995757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0140aa9d0 con 0x7fe01c0cd3a0 2024-08-18T22:20:24.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe023200640 1 -- 172.21.15.5:0/1296995757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe01c0cd3a0 msgr2=0x7fe01c072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe023200640 1 --2- 172.21.15.5:0/1296995757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe01c0cd3a0 0x7fe01c072620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0ca580 tx=0x7fe01401c4b0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe023200640 1 -- 172.21.15.5:0/1296995757 shutdown_connections 2024-08-18T22:20:24.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe023200640 1 --2- 172.21.15.5:0/1296995757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe01c0cd3a0 0x7fe01c072620 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe023200640 1 --2- 172.21.15.5:0/1296995757 >> v2:172.21.15.117:3300/0 conn(0x7fe01c06f290 0x7fe01c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe023200640 1 -- 172.21.15.5:0/1296995757 >> 172.21.15.5:0/1296995757 conn(0x7fe01c0b1c50 msgr2=0x7fe01c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:24.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe023200640 1 -- 172.21.15.5:0/1296995757 shutdown_connections 2024-08-18T22:20:24.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.177+0000 7fe023200640 1 -- 172.21.15.5:0/1296995757 wait complete. 2024-08-18T22:20:24.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe023200640 1 Processor -- start 2024-08-18T22:20:24.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe023200640 1 -- start start 2024-08-18T22:20:24.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe023200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe01c06f290 0x7fe01c157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe023200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe01c0cd3a0 0x7fe01c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe023200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe01c15b010 0x7fe01c15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe023200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c0734f0 con 0x7fe01c06f290 2024-08-18T22:20:24.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe023200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c073370 con 0x7fe01c0cd3a0 2024-08-18T22:20:24.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe023200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe01c073670 con 0x7fe01c15b010 2024-08-18T22:20:24.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe01be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe01c06f290 0x7fe01c157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe01be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe01c06f290 0x7fe01c157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46060/0 (socket says 172.21.15.5:46060) 2024-08-18T22:20:24.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe01be00640 1 -- 172.21.15.5:0/3263093228 learned_addr learned my addr 172.21.15.5:0/3263093228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:24.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe021200640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe01c15b010 0x7fe01c15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe013400640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe01c0cd3a0 0x7fe01c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe01be00640 1 -- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe01c15b010 msgr2=0x7fe01c15a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe01be00640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe01c15b010 0x7fe01c15a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe01be00640 1 -- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe01c0cd3a0 msgr2=0x7fe01c159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe01be00640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe01c0cd3a0 0x7fe01c159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe01be00640 1 -- 172.21.15.5:0/3263093228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01c156b50 con 0x7fe01c06f290 2024-08-18T22:20:24.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe01be00640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe01c06f290 0x7fe01c157ae0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00c440 tx=0x7fe00c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:24.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe018c00640 1 -- 172.21.15.5:0/3263093228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c016020 con 0x7fe01c06f290 2024-08-18T22:20:24.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe018c00640 1 -- 172.21.15.5:0/3263093228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c012850 con 0x7fe01c06f290 2024-08-18T22:20:24.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe023200640 1 -- 172.21.15.5:0/3263093228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01c156e30 con 0x7fe01c06f290 2024-08-18T22:20:24.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe018c00640 1 -- 172.21.15.5:0/3263093228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c012c40 con 0x7fe01c06f290 2024-08-18T22:20:24.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.181+0000 7fe023200640 1 -- 172.21.15.5:0/3263093228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe01c1573f0 con 0x7fe01c06f290 2024-08-18T22:20:24.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.185+0000 7fe023200640 1 -- 172.21.15.5:0/3263093228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe01c1575f0 con 0x7fe01c06f290 2024-08-18T22:20:24.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.185+0000 7fe018c00640 1 -- 172.21.15.5:0/3263093228 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe00c019020 con 0x7fe01c06f290 2024-08-18T22:20:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.185+0000 7fe018c00640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdff80678c0 0x7fdff8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.185+0000 7fe018c00640 1 -- 172.21.15.5:0/3263093228 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe00c085c50 con 0x7fe01c06f290 2024-08-18T22:20:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.185+0000 7fe013400640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdff80678c0 0x7fdff8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.185+0000 7fe013400640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdff80678c0 0x7fdff8069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe01c1578a0 tx=0x7fe004009910 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.189+0000 7fe018c00640 1 -- 172.21.15.5:0/3263093228 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe01c1575f0 con 0x7fe01c06f290 2024-08-18T22:20:24.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.349+0000 7fe023200640 1 -- 172.21.15.5:0/3263093228 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe01c0ce840 con 0x7fdff80678c0 2024-08-18T22:20:24.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.357+0000 7fe018c00640 1 -- 172.21.15.5:0/3263093228 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247713 (secure 0 0 0) 0x7fe01c0ce840 con 0x7fdff80678c0 2024-08-18T22:20:24.363 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:24.364 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:20:24.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 -- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdff80678c0 msgr2=0x7fdff8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdff80678c0 0x7fdff8069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe01c1578a0 tx=0x7fe004009910 comp rx=0 tx=0).stop 2024-08-18T22:20:24.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 -- 172.21.15.5:0/3263093228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe01c06f290 msgr2=0x7fe01c157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe01c06f290 0x7fe01c157ae0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00c440 tx=0x7fe00c00c900 comp rx=0 tx=0).stop 2024-08-18T22:20:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 -- 172.21.15.5:0/3263093228 shutdown_connections 2024-08-18T22:20:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdff80678c0 0x7fdff8069d80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe01c15b010 0x7fe01c15a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe01c0cd3a0 0x7fe01c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 --2- 172.21.15.5:0/3263093228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe01c06f290 0x7fe01c157ae0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 -- 172.21.15.5:0/3263093228 >> 172.21.15.5:0/3263093228 conn(0x7fe01c0b1c50 msgr2=0x7fe01c0c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 -- 172.21.15.5:0/3263093228 shutdown_connections 2024-08-18T22:20:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.361+0000 7fe023200640 1 -- 172.21.15.5:0/3263093228 wait complete. 2024-08-18T22:20:24.383 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-08-18T22:20:23.633052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233080,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741640,"statfs":{"total":773094113280,"available":772855439360,"internally_reserved":0,"allocated":4530176,"data_stored":2600959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001063"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493092+0000","last_change":"2024-08-18T22:20:18.493092+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493092+0000","last_undegraded":"2024-08-18T22:20:18.493092+0000","last_fullsized":"2024-08-18T22:20:18.493092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.496244+0000","last_change":"2024-08-18T22:20:18.496244+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.496244+0000","last_undegraded":"2024-08-18T22:20:18.496244+0000","last_fullsized":"2024-08-18T22:20:18.496244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.496407+0000","last_change":"2024-08-18T22:20:18.496407+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.496407+0000","last_undegraded":"2024-08-18T22:20:18.496407+0000","last_fullsized":"2024-08-18T22:20:18.496407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529400+0000","last_change":"2024-08-18T22:20:19.523171+0000","last_active":"2024-08-18T22:20:19.529400+0000","last_peered":"2024-08-18T22:20:19.529400+0000","last_clean":"2024-08-18T22:20:19.529400+0000","last_became_active":"2024-08-18T22:20:19.522915+0000","last_became_peered":"2024-08-18T22:20:19.522915+0000","last_unstale":"2024-08-18T22:20:19.529400+0000","last_undegraded":"2024-08-18T22:20:19.529400+0000","last_fullsized":"2024-08-18T22:20:19.529400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:55:25.376251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.522175+0000","last_change":"2024-08-18T22:20:19.514150+0000","last_active":"2024-08-18T22:20:19.522175+0000","last_peered":"2024-08-18T22:20:19.522175+0000","last_clean":"2024-08-18T22:20:19.522175+0000","last_became_active":"2024-08-18T22:20:19.513901+0000","last_became_peered":"2024-08-18T22:20:19.513901+0000","last_unstale":"2024-08-18T22:20:19.522175+0000","last_undegraded":"2024-08-18T22:20:19.522175+0000","last_fullsized":"2024-08-18T22:20:19.522175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:38.521131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493274+0000","last_change":"2024-08-18T22:20:18.493274+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493274+0000","last_undegraded":"2024-08-18T22:20:18.493274+0000","last_fullsized":"2024-08-18T22:20:18.493274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499887+0000","last_change":"2024-08-18T22:20:18.499887+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499887+0000","last_undegraded":"2024-08-18T22:20:18.499887+0000","last_fullsized":"2024-08-18T22:20:18.499887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491230+0000","last_change":"2024-08-18T22:20:18.491230+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491230+0000","last_undegraded":"2024-08-18T22:20:18.491230+0000","last_fullsized":"2024-08-18T22:20:18.491230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495448+0000","last_change":"2024-08-18T22:20:18.495448+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495448+0000","last_undegraded":"2024-08-18T22:20:18.495448+0000","last_fullsized":"2024-08-18T22:20:18.495448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498758+0000","last_change":"2024-08-18T22:20:18.498758+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498758+0000","last_undegraded":"2024-08-18T22:20:18.498758+0000","last_fullsized":"2024-08-18T22:20:18.498758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498892+0000","last_change":"2024-08-18T22:20:18.498892+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498892+0000","last_undegraded":"2024-08-18T22:20:18.498892+0000","last_fullsized":"2024-08-18T22:20:18.498892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495011+0000","last_change":"2024-08-18T22:20:18.495011+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495011+0000","last_undegraded":"2024-08-18T22:20:18.495011+0000","last_fullsized":"2024-08-18T22:20:18.495011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.504430+0000","last_change":"2024-08-18T22:20:18.504430+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.504430+0000","last_undegraded":"2024-08-18T22:20:18.504430+0000","last_fullsized":"2024-08-18T22:20:18.504430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506172+0000","last_change":"2024-08-18T22:20:19.510105+0000","last_active":"2024-08-18T22:20:20.506172+0000","last_peered":"2024-08-18T22:20:20.506172+0000","last_clean":"2024-08-18T22:20:20.506172+0000","last_became_active":"2024-08-18T22:20:19.509851+0000","last_became_peered":"2024-08-18T22:20:19.509851+0000","last_unstale":"2024-08-18T22:20:20.506172+0000","last_undegraded":"2024-08-18T22:20:20.506172+0000","last_fullsized":"2024-08-18T22:20:20.506172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:44.652528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499339+0000","last_change":"2024-08-18T22:20:18.499339+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499339+0000","last_undegraded":"2024-08-18T22:20:18.499339+0000","last_fullsized":"2024-08-18T22:20:18.499339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495978+0000","last_change":"2024-08-18T22:20:18.495978+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495978+0000","last_undegraded":"2024-08-18T22:20:18.495978+0000","last_fullsized":"2024-08-18T22:20:18.495978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.501271+0000","last_change":"2024-08-18T22:20:18.501271+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.501271+0000","last_undegraded":"2024-08-18T22:20:18.501271+0000","last_fullsized":"2024-08-18T22:20:18.501271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490502+0000","last_change":"2024-08-18T22:20:18.490502+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490502+0000","last_undegraded":"2024-08-18T22:20:18.490502+0000","last_fullsized":"2024-08-18T22:20:18.490502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.522894+0000","last_change":"2024-08-18T22:20:19.513201+0000","last_active":"2024-08-18T22:20:19.522894+0000","last_peered":"2024-08-18T22:20:19.522894+0000","last_clean":"2024-08-18T22:20:19.522894+0000","last_became_active":"2024-08-18T22:20:19.512920+0000","last_became_peered":"2024-08-18T22:20:19.512920+0000","last_unstale":"2024-08-18T22:20:19.522894+0000","last_undegraded":"2024-08-18T22:20:19.522894+0000","last_fullsized":"2024-08-18T22:20:19.522894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:03.535227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490750+0000","last_change":"2024-08-18T22:20:18.490750+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490750+0000","last_undegraded":"2024-08-18T22:20:18.490750+0000","last_fullsized":"2024-08-18T22:20:18.490750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497883+0000","last_change":"2024-08-18T22:20:18.497883+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497883+0000","last_undegraded":"2024-08-18T22:20:18.497883+0000","last_fullsized":"2024-08-18T22:20:18.497883+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506727+0000","last_change":"2024-08-18T22:20:19.517261+0000","last_active":"2024-08-18T22:20:20.506727+0000","last_peered":"2024-08-18T22:20:20.506727+0000","last_clean":"2024-08-18T22:20:20.506727+0000","last_became_active":"2024-08-18T22:20:19.516966+0000","last_became_peered":"2024-08-18T22:20:19.516966+0000","last_unstale":"2024-08-18T22:20:20.506727+0000","last_undegraded":"2024-08-18T22:20:20.506727+0000","last_fullsized":"2024-08-18T22:20:20.506727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:39:08.996900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497861+0000","last_change":"2024-08-18T22:20:18.497861+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497861+0000","last_undegraded":"2024-08-18T22:20:18.497861+0000","last_fullsized":"2024-08-18T22:20:18.497861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.528004+0000","last_change":"2024-08-18T22:20:19.518451+0000","last_active":"2024-08-18T22:20:19.528004+0000","last_peered":"2024-08-18T22:20:19.528004+0000","last_clean":"2024-08-18T22:20:19.528004+0000","last_became_active":"2024-08-18T22:20:19.517998+0000","last_became_peered":"2024-08-18T22:20:19.517998+0000","last_unstale":"2024-08-18T22:20:19.528004+0000","last_undegraded":"2024-08-18T22:20:19.528004+0000","last_fullsized":"2024-08-18T22:20:19.528004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:30:38.396904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490377+0000","last_change":"2024-08-18T22:20:18.490377+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490377+0000","last_undegraded":"2024-08-18T22:20:18.490377+0000","last_fullsized":"2024-08-18T22:20:18.490377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491526+0000","last_change":"2024-08-18T22:20:18.491526+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491526+0000","last_undegraded":"2024-08-18T22:20:18.491526+0000","last_fullsized":"2024-08-18T22:20:18.491526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490426+0000","last_change":"2024-08-18T22:20:18.490426+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490426+0000","last_undegraded":"2024-08-18T22:20:18.490426+0000","last_fullsized":"2024-08-18T22:20:18.490426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497790+0000","last_change":"2024-08-18T22:20:18.497790+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497790+0000","last_undegraded":"2024-08-18T22:20:18.497790+0000","last_fullsized":"2024-08-18T22:20:18.497790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490338+0000","last_change":"2024-08-18T22:20:18.490338+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490338+0000","last_undegraded":"2024-08-18T22:20:18.490338+0000","last_fullsized":"2024-08-18T22:20:18.490338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490566+0000","last_change":"2024-08-18T22:20:18.490566+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490566+0000","last_undegraded":"2024-08-18T22:20:18.490566+0000","last_fullsized":"2024-08-18T22:20:18.490566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493157+0000","last_change":"2024-08-18T22:20:18.493157+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493157+0000","last_undegraded":"2024-08-18T22:20:18.493157+0000","last_fullsized":"2024-08-18T22:20:18.493157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491344+0000","last_change":"2024-08-18T22:20:18.491344+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491344+0000","last_undegraded":"2024-08-18T22:20:18.491344+0000","last_fullsized":"2024-08-18T22:20:18.491344+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.500047+0000","last_change":"2024-08-18T22:20:18.500047+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.500047+0000","last_undegraded":"2024-08-18T22:20:18.500047+0000","last_fullsized":"2024-08-18T22:20:18.500047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510476+0000","last_change":"2024-08-18T22:20:18.507055+0000","last_active":"2024-08-18T22:20:18.510476+0000","last_peered":"2024-08-18T22:20:18.510476+0000","last_clean":"2024-08-18T22:20:18.510476+0000","last_became_active":"2024-08-18T22:20:18.506703+0000","last_became_peered":"2024-08-18T22:20:18.506703+0000","last_unstale":"2024-08-18T22:20:18.510476+0000","last_undegraded":"2024-08-18T22:20:18.510476+0000","last_fullsized":"2024-08-18T22:20:18.510476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:01:24.898465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492337+0000","last_change":"2024-08-18T22:20:18.492337+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492337+0000","last_undegraded":"2024-08-18T22:20:18.492337+0000","last_fullsized":"2024-08-18T22:20:18.492337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510279+0000","last_change":"2024-08-18T22:20:18.506164+0000","last_active":"2024-08-18T22:20:18.510279+0000","last_peered":"2024-08-18T22:20:18.510279+0000","last_clean":"2024-08-18T22:20:18.510279+0000","last_became_active":"2024-08-18T22:20:18.505859+0000","last_became_peered":"2024-08-18T22:20:18.505859+0000","last_unstale":"2024-08-18T22:20:18.510279+0000","last_undegraded":"2024-08-18T22:20:18.510279+0000","last_fullsized":"2024-08-18T22:20:18.510279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:13.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507281+0000","last_change":"2024-08-18T22:20:19.511725+0000","last_active":"2024-08-18T22:20:20.507281+0000","last_peered":"2024-08-18T22:20:20.507281+0000","last_clean":"2024-08-18T22:20:20.507281+0000","last_became_active":"2024-08-18T22:20:19.509416+0000","last_became_peered":"2024-08-18T22:20:19.509416+0000","last_unstale":"2024-08-18T22:20:20.507281+0000","last_undegraded":"2024-08-18T22:20:20.507281+0000","last_fullsized":"2024-08-18T22:20:20.507281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:46.028258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510679+0000","last_change":"2024-08-18T22:20:18.505900+0000","last_active":"2024-08-18T22:20:18.510679+0000","last_peered":"2024-08-18T22:20:18.510679+0000","last_clean":"2024-08-18T22:20:18.510679+0000","last_became_active":"2024-08-18T22:20:18.505628+0000","last_became_peered":"2024-08-18T22:20:18.505628+0000","last_unstale":"2024-08-18T22:20:18.510679+0000","last_undegraded":"2024-08-18T22:20:18.510679+0000","last_fullsized":"2024-08-18T22:20:18.510679+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:33.626411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493547+0000","last_change":"2024-08-18T22:20:18.493547+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493547+0000","last_undegraded":"2024-08-18T22:20:18.493547+0000","last_fullsized":"2024-08-18T22:20:18.493547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506625+0000","last_change":"2024-08-18T22:20:18.506470+0000","last_active":"2024-08-18T22:20:20.506625+0000","last_peered":"2024-08-18T22:20:20.506625+0000","last_clean":"2024-08-18T22:20:20.506625+0000","last_became_active":"2024-08-18T22:20:18.505750+0000","last_became_peered":"2024-08-18T22:20:18.505750+0000","last_unstale":"2024-08-18T22:20:20.506625+0000","last_undegraded":"2024-08-18T22:20:20.506625+0000","last_fullsized":"2024-08-18T22:20:20.506625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:28.594042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495750+0000","last_change":"2024-08-18T22:20:18.495750+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495750+0000","last_undegraded":"2024-08-18T22:20:18.495750+0000","last_fullsized":"2024-08-18T22:20:18.495750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518308+0000","last_change":"2024-08-18T22:20:18.513803+0000","last_active":"2024-08-18T22:20:18.518308+0000","last_peered":"2024-08-18T22:20:18.518308+0000","last_clean":"2024-08-18T22:20:18.518308+0000","last_became_active":"2024-08-18T22:20:18.513118+0000","last_became_peered":"2024-08-18T22:20:18.513118+0000","last_unstale":"2024-08-18T22:20:18.518308+0000","last_undegraded":"2024-08-18T22:20:18.518308+0000","last_fullsized":"2024-08-18T22:20:18.518308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:43.649712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497649+0000","last_change":"2024-08-18T22:20:18.497649+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497649+0000","last_undegraded":"2024-08-18T22:20:18.497649+0000","last_fullsized":"2024-08-18T22:20:18.497649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.514042+0000","last_change":"2024-08-18T22:20:18.507975+0000","last_active":"2024-08-18T22:20:18.514042+0000","last_peered":"2024-08-18T22:20:18.514042+0000","last_clean":"2024-08-18T22:20:18.514042+0000","last_became_active":"2024-08-18T22:20:18.507730+0000","last_became_peered":"2024-08-18T22:20:18.507730+0000","last_unstale":"2024-08-18T22:20:18.514042+0000","last_undegraded":"2024-08-18T22:20:18.514042+0000","last_fullsized":"2024-08-18T22:20:18.514042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:16.215376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506523+0000","last_change":"2024-08-18T22:20:19.512493+0000","last_active":"2024-08-18T22:20:20.506523+0000","last_peered":"2024-08-18T22:20:20.506523+0000","last_clean":"2024-08-18T22:20:20.506523+0000","last_became_active":"2024-08-18T22:20:19.512176+0000","last_became_peered":"2024-08-18T22:20:19.512176+0000","last_unstale":"2024-08-18T22:20:20.506523+0000","last_undegraded":"2024-08-18T22:20:20.506523+0000","last_fullsized":"2024-08-18T22:20:20.506523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:50.110322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516286+0000","last_change":"2024-08-18T22:20:18.514200+0000","last_active":"2024-08-18T22:20:18.516286+0000","last_peered":"2024-08-18T22:20:18.516286+0000","last_clean":"2024-08-18T22:20:18.516286+0000","last_became_active":"2024-08-18T22:20:18.513674+0000","last_became_peered":"2024-08-18T22:20:18.513674+0000","last_unstale":"2024-08-18T22:20:18.516286+0000","last_undegraded":"2024-08-18T22:20:18.516286+0000","last_fullsized":"2024-08-18T22:20:18.516286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:17.147946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499266+0000","last_change":"2024-08-18T22:20:18.499266+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499266+0000","last_undegraded":"2024-08-18T22:20:18.499266+0000","last_fullsized":"2024-08-18T22:20:18.499266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505383+0000","last_change":"2024-08-18T22:20:18.509839+0000","last_active":"2024-08-18T22:20:20.505383+0000","last_peered":"2024-08-18T22:20:20.505383+0000","last_clean":"2024-08-18T22:20:20.505383+0000","last_became_active":"2024-08-18T22:20:18.509566+0000","last_became_peered":"2024-08-18T22:20:18.509566+0000","last_unstale":"2024-08-18T22:20:20.505383+0000","last_undegraded":"2024-08-18T22:20:20.505383+0000","last_fullsized":"2024-08-18T22:20:20.505383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:52:05.432990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529421+0000","last_change":"2024-08-18T22:20:19.527869+0000","last_active":"2024-08-18T22:20:19.529421+0000","last_peered":"2024-08-18T22:20:19.529421+0000","last_clean":"2024-08-18T22:20:19.529421+0000","last_became_active":"2024-08-18T22:20:19.527597+0000","last_became_peered":"2024-08-18T22:20:19.527597+0000","last_unstale":"2024-08-18T22:20:19.529421+0000","last_undegraded":"2024-08-18T22:20:19.529421+0000","last_fullsized":"2024-08-18T22:20:19.529421+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:59.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511279+0000","last_change":"2024-08-18T22:20:18.504598+0000","last_active":"2024-08-18T22:20:18.511279+0000","last_peered":"2024-08-18T22:20:18.511279+0000","last_clean":"2024-08-18T22:20:18.511279+0000","last_became_active":"2024-08-18T22:20:18.502312+0000","last_became_peered":"2024-08-18T22:20:18.502312+0000","last_unstale":"2024-08-18T22:20:18.511279+0000","last_undegraded":"2024-08-18T22:20:18.511279+0000","last_fullsized":"2024-08-18T22:20:18.511279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:19:25.740187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495705+0000","last_change":"2024-08-18T22:20:18.495705+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495705+0000","last_undegraded":"2024-08-18T22:20:18.495705+0000","last_fullsized":"2024-08-18T22:20:18.495705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518366+0000","last_change":"2024-08-18T22:20:18.514724+0000","last_active":"2024-08-18T22:20:18.518366+0000","last_peered":"2024-08-18T22:20:18.518366+0000","last_clean":"2024-08-18T22:20:18.518366+0000","last_became_active":"2024-08-18T22:20:18.513465+0000","last_became_peered":"2024-08-18T22:20:18.513465+0000","last_unstale":"2024-08-18T22:20:18.518366+0000","last_undegraded":"2024-08-18T22:20:18.518366+0000","last_fullsized":"2024-08-18T22:20:18.518366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:01.005845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495051+0000","last_change":"2024-08-18T22:20:18.495051+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495051+0000","last_undegraded":"2024-08-18T22:20:18.495051+0000","last_fullsized":"2024-08-18T22:20:18.495051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.514527+0000","last_change":"2024-08-18T22:20:18.508636+0000","last_active":"2024-08-18T22:20:18.514527+0000","last_peered":"2024-08-18T22:20:18.514527+0000","last_clean":"2024-08-18T22:20:18.514527+0000","last_became_active":"2024-08-18T22:20:18.508356+0000","last_became_peered":"2024-08-18T22:20:18.508356+0000","last_unstale":"2024-08-18T22:20:18.514527+0000","last_undegraded":"2024-08-18T22:20:18.514527+0000","last_fullsized":"2024-08-18T22:20:18.514527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:50.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507231+0000","last_change":"2024-08-18T22:20:19.527189+0000","last_active":"2024-08-18T22:20:20.507231+0000","last_peered":"2024-08-18T22:20:20.507231+0000","last_clean":"2024-08-18T22:20:20.507231+0000","last_became_active":"2024-08-18T22:20:19.526929+0000","last_became_peered":"2024-08-18T22:20:19.526929+0000","last_unstale":"2024-08-18T22:20:20.507231+0000","last_undegraded":"2024-08-18T22:20:20.507231+0000","last_fullsized":"2024-08-18T22:20:20.507231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:27.898874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.513335+0000","last_change":"2024-08-18T22:20:18.505405+0000","last_active":"2024-08-18T22:20:18.513335+0000","last_peered":"2024-08-18T22:20:18.513335+0000","last_clean":"2024-08-18T22:20:18.513335+0000","last_became_active":"2024-08-18T22:20:18.505140+0000","last_became_peered":"2024-08-18T22:20:18.505140+0000","last_unstale":"2024-08-18T22:20:18.513335+0000","last_undegraded":"2024-08-18T22:20:18.513335+0000","last_fullsized":"2024-08-18T22:20:18.513335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:24.501896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495135+0000","last_change":"2024-08-18T22:20:18.495135+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495135+0000","last_undegraded":"2024-08-18T22:20:18.495135+0000","last_fullsized":"2024-08-18T22:20:18.495135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511185+0000","last_change":"2024-08-18T22:20:18.506928+0000","last_active":"2024-08-18T22:20:18.511185+0000","last_peered":"2024-08-18T22:20:18.511185+0000","last_clean":"2024-08-18T22:20:18.511185+0000","last_became_active":"2024-08-18T22:20:18.506655+0000","last_became_peered":"2024-08-18T22:20:18.506655+0000","last_unstale":"2024-08-18T22:20:18.511185+0000","last_undegraded":"2024-08-18T22:20:18.511185+0000","last_fullsized":"2024-08-18T22:20:18.511185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:49.429237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491918+0000","last_change":"2024-08-18T22:20:18.491918+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491918+0000","last_undegraded":"2024-08-18T22:20:18.491918+0000","last_fullsized":"2024-08-18T22:20:18.491918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.515266+0000","last_change":"2024-08-18T22:20:18.513595+0000","last_active":"2024-08-18T22:20:18.515266+0000","last_peered":"2024-08-18T22:20:18.515266+0000","last_clean":"2024-08-18T22:20:18.515266+0000","last_became_active":"2024-08-18T22:20:18.513298+0000","last_became_peered":"2024-08-18T22:20:18.513298+0000","last_unstale":"2024-08-18T22:20:18.515266+0000","last_undegraded":"2024-08-18T22:20:18.515266+0000","last_fullsized":"2024-08-18T22:20:18.515266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:03.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499687+0000","last_change":"2024-08-18T22:20:18.499687+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499687+0000","last_undegraded":"2024-08-18T22:20:18.499687+0000","last_fullsized":"2024-08-18T22:20:18.499687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511974+0000","last_change":"2024-08-18T22:20:18.507441+0000","last_active":"2024-08-18T22:20:18.511974+0000","last_peered":"2024-08-18T22:20:18.511974+0000","last_clean":"2024-08-18T22:20:18.511974+0000","last_became_active":"2024-08-18T22:20:18.507129+0000","last_became_peered":"2024-08-18T22:20:18.507129+0000","last_unstale":"2024-08-18T22:20:18.511974+0000","last_undegraded":"2024-08-18T22:20:18.511974+0000","last_fullsized":"2024-08-18T22:20:18.511974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:31.386164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498828+0000","last_change":"2024-08-18T22:20:18.498828+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498828+0000","last_undegraded":"2024-08-18T22:20:18.498828+0000","last_fullsized":"2024-08-18T22:20:18.498828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511125+0000","last_change":"2024-08-18T22:20:18.505545+0000","last_active":"2024-08-18T22:20:18.511125+0000","last_peered":"2024-08-18T22:20:18.511125+0000","last_clean":"2024-08-18T22:20:18.511125+0000","last_became_active":"2024-08-18T22:20:18.505240+0000","last_became_peered":"2024-08-18T22:20:18.505240+0000","last_unstale":"2024-08-18T22:20:18.511125+0000","last_undegraded":"2024-08-18T22:20:18.511125+0000","last_fullsized":"2024-08-18T22:20:18.511125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:50.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492381+0000","last_change":"2024-08-18T22:20:18.492381+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492381+0000","last_undegraded":"2024-08-18T22:20:18.492381+0000","last_fullsized":"2024-08-18T22:20:18.492381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516342+0000","last_change":"2024-08-18T22:20:18.511501+0000","last_active":"2024-08-18T22:20:18.516342+0000","last_peered":"2024-08-18T22:20:18.516342+0000","last_clean":"2024-08-18T22:20:18.516342+0000","last_became_active":"2024-08-18T22:20:18.511239+0000","last_became_peered":"2024-08-18T22:20:18.511239+0000","last_unstale":"2024-08-18T22:20:18.516342+0000","last_undegraded":"2024-08-18T22:20:18.516342+0000","last_fullsized":"2024-08-18T22:20:18.516342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:27:37.314171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498467+0000","last_change":"2024-08-18T22:20:18.498467+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498467+0000","last_undegraded":"2024-08-18T22:20:18.498467+0000","last_fullsized":"2024-08-18T22:20:18.498467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507244+0000","last_change":"2024-08-18T22:20:18.510173+0000","last_active":"2024-08-18T22:20:20.507244+0000","last_peered":"2024-08-18T22:20:20.507244+0000","last_clean":"2024-08-18T22:20:20.507244+0000","last_became_active":"2024-08-18T22:20:18.509595+0000","last_became_peered":"2024-08-18T22:20:18.509595+0000","last_unstale":"2024-08-18T22:20:20.507244+0000","last_undegraded":"2024-08-18T22:20:20.507244+0000","last_fullsized":"2024-08-18T22:20:20.507244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:03.733472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507175+0000","last_change":"2024-08-18T22:20:19.509550+0000","last_active":"2024-08-18T22:20:20.507175+0000","last_peered":"2024-08-18T22:20:20.507175+0000","last_clean":"2024-08-18T22:20:20.507175+0000","last_became_active":"2024-08-18T22:20:19.509074+0000","last_became_peered":"2024-08-18T22:20:19.509074+0000","last_unstale":"2024-08-18T22:20:20.507175+0000","last_undegraded":"2024-08-18T22:20:20.507175+0000","last_fullsized":"2024-08-18T22:20:20.507175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:30.801816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.526269+0000","last_change":"2024-08-18T22:20:18.510334+0000","last_active":"2024-08-18T22:20:19.526269+0000","last_peered":"2024-08-18T22:20:19.526269+0000","last_clean":"2024-08-18T22:20:19.526269+0000","last_became_active":"2024-08-18T22:20:18.510061+0000","last_became_peered":"2024-08-18T22:20:18.510061+0000","last_unstale":"2024-08-18T22:20:19.526269+0000","last_undegraded":"2024-08-18T22:20:19.526269+0000","last_fullsized":"2024-08-18T22:20:19.526269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:47:45.552211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529777+0000","last_change":"2024-08-18T22:20:19.525958+0000","last_active":"2024-08-18T22:20:19.529777+0000","last_peered":"2024-08-18T22:20:19.529777+0000","last_clean":"2024-08-18T22:20:19.529777+0000","last_became_active":"2024-08-18T22:20:19.524979+0000","last_became_peered":"2024-08-18T22:20:19.524979+0000","last_unstale":"2024-08-18T22:20:19.529777+0000","last_undegraded":"2024-08-18T22:20:19.529777+0000","last_fullsized":"2024-08-18T22:20:19.529777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:51.616637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510536+0000","last_change":"2024-08-18T22:20:18.505895+0000","last_active":"2024-08-18T22:20:18.510536+0000","last_peered":"2024-08-18T22:20:18.510536+0000","last_clean":"2024-08-18T22:20:18.510536+0000","last_became_active":"2024-08-18T22:20:18.505603+0000","last_became_peered":"2024-08-18T22:20:18.505603+0000","last_unstale":"2024-08-18T22:20:18.510536+0000","last_undegraded":"2024-08-18T22:20:18.510536+0000","last_fullsized":"2024-08-18T22:20:18.510536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:13.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493638+0000","last_change":"2024-08-18T22:20:18.493638+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493638+0000","last_undegraded":"2024-08-18T22:20:18.493638+0000","last_fullsized":"2024-08-18T22:20:18.493638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.521128+0000","last_change":"2024-08-18T22:20:18.513238+0000","last_active":"2024-08-18T22:20:19.521128+0000","last_peered":"2024-08-18T22:20:19.521128+0000","last_clean":"2024-08-18T22:20:19.521128+0000","last_became_active":"2024-08-18T22:20:18.512768+0000","last_became_peered":"2024-08-18T22:20:18.512768+0000","last_unstale":"2024-08-18T22:20:19.521128+0000","last_undegraded":"2024-08-18T22:20:19.521128+0000","last_fullsized":"2024-08-18T22:20:19.521128+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:33.762072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495481+0000","last_change":"2024-08-18T22:20:18.495481+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495481+0000","last_undegraded":"2024-08-18T22:20:18.495481+0000","last_fullsized":"2024-08-18T22:20:18.495481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.509691+0000","last_change":"2024-08-18T22:20:18.512744+0000","last_active":"2024-08-18T22:20:19.509691+0000","last_peered":"2024-08-18T22:20:19.509691+0000","last_clean":"2024-08-18T22:20:19.509691+0000","last_became_active":"2024-08-18T22:20:18.512351+0000","last_became_peered":"2024-08-18T22:20:18.512351+0000","last_unstale":"2024-08-18T22:20:19.509691+0000","last_undegraded":"2024-08-18T22:20:19.509691+0000","last_fullsized":"2024-08-18T22:20:19.509691+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:37:13.840163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.504630+0000","last_change":"2024-08-18T22:20:18.504630+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.504630+0000","last_undegraded":"2024-08-18T22:20:18.504630+0000","last_fullsized":"2024-08-18T22:20:18.504630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.515749+0000","last_change":"2024-08-18T22:20:18.510805+0000","last_active":"2024-08-18T22:20:18.515749+0000","last_peered":"2024-08-18T22:20:18.515749+0000","last_clean":"2024-08-18T22:20:18.515749+0000","last_became_active":"2024-08-18T22:20:18.510506+0000","last_became_peered":"2024-08-18T22:20:18.510506+0000","last_unstale":"2024-08-18T22:20:18.515749+0000","last_undegraded":"2024-08-18T22:20:18.515749+0000","last_fullsized":"2024-08-18T22:20:18.515749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:27:37.314171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493377+0000","last_change":"2024-08-18T22:20:18.493377+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493377+0000","last_undegraded":"2024-08-18T22:20:18.493377+0000","last_fullsized":"2024-08-18T22:20:18.493377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.508542+0000","last_change":"2024-08-18T22:20:18.509322+0000","last_active":"2024-08-18T22:20:19.508542+0000","last_peered":"2024-08-18T22:20:19.508542+0000","last_clean":"2024-08-18T22:20:19.508542+0000","last_became_active":"2024-08-18T22:20:18.509032+0000","last_became_peered":"2024-08-18T22:20:18.509032+0000","last_unstale":"2024-08-18T22:20:19.508542+0000","last_undegraded":"2024-08-18T22:20:19.508542+0000","last_fullsized":"2024-08-18T22:20:19.508542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:26:25.888447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492384+0000","last_change":"2024-08-18T22:20:18.492384+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492384+0000","last_undegraded":"2024-08-18T22:20:18.492384+0000","last_fullsized":"2024-08-18T22:20:18.492384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516322+0000","last_change":"2024-08-18T22:20:18.510784+0000","last_active":"2024-08-18T22:20:18.516322+0000","last_peered":"2024-08-18T22:20:18.516322+0000","last_clean":"2024-08-18T22:20:18.516322+0000","last_became_active":"2024-08-18T22:20:18.510472+0000","last_became_peered":"2024-08-18T22:20:18.510472+0000","last_unstale":"2024-08-18T22:20:18.516322+0000","last_undegraded":"2024-08-18T22:20:18.516322+0000","last_fullsized":"2024-08-18T22:20:18.516322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:16.215376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493125+0000","last_change":"2024-08-18T22:20:18.493125+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493125+0000","last_undegraded":"2024-08-18T22:20:18.493125+0000","last_fullsized":"2024-08-18T22:20:18.493125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.511615+0000","last_change":"2024-08-18T22:20:18.515716+0000","last_active":"2024-08-18T22:20:19.511615+0000","last_peered":"2024-08-18T22:20:19.511615+0000","last_clean":"2024-08-18T22:20:19.511615+0000","last_became_active":"2024-08-18T22:20:18.515475+0000","last_became_peered":"2024-08-18T22:20:18.515475+0000","last_unstale":"2024-08-18T22:20:19.511615+0000","last_undegraded":"2024-08-18T22:20:19.511615+0000","last_fullsized":"2024-08-18T22:20:19.511615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:00:01.480754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495710+0000","last_change":"2024-08-18T22:20:18.495710+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495710+0000","last_undegraded":"2024-08-18T22:20:18.495710+0000","last_fullsized":"2024-08-18T22:20:18.495710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.512673+0000","last_change":"2024-08-18T22:20:18.511256+0000","last_active":"2024-08-18T22:20:18.512673+0000","last_peered":"2024-08-18T22:20:18.512673+0000","last_clean":"2024-08-18T22:20:18.512673+0000","last_became_active":"2024-08-18T22:20:18.510423+0000","last_became_peered":"2024-08-18T22:20:18.510423+0000","last_unstale":"2024-08-18T22:20:18.512673+0000","last_undegraded":"2024-08-18T22:20:18.512673+0000","last_fullsized":"2024-08-18T22:20:18.512673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:03.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.494509+0000","last_change":"2024-08-18T22:20:18.494509+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.494509+0000","last_undegraded":"2024-08-18T22:20:18.494509+0000","last_fullsized":"2024-08-18T22:20:18.494509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.512641+0000","last_change":"2024-08-18T22:20:18.510833+0000","last_active":"2024-08-18T22:20:18.512641+0000","last_peered":"2024-08-18T22:20:18.512641+0000","last_clean":"2024-08-18T22:20:18.512641+0000","last_became_active":"2024-08-18T22:20:18.510510+0000","last_became_peered":"2024-08-18T22:20:18.510510+0000","last_unstale":"2024-08-18T22:20:18.512641+0000","last_undegraded":"2024-08-18T22:20:18.512641+0000","last_fullsized":"2024-08-18T22:20:18.512641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:33.626411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492553+0000","last_change":"2024-08-18T22:20:18.492553+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492553+0000","last_undegraded":"2024-08-18T22:20:18.492553+0000","last_fullsized":"2024-08-18T22:20:18.492553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511290+0000","last_change":"2024-08-18T22:20:18.508896+0000","last_active":"2024-08-18T22:20:18.511290+0000","last_peered":"2024-08-18T22:20:18.511290+0000","last_clean":"2024-08-18T22:20:18.511290+0000","last_became_active":"2024-08-18T22:20:18.508538+0000","last_became_peered":"2024-08-18T22:20:18.508538+0000","last_unstale":"2024-08-18T22:20:18.511290+0000","last_undegraded":"2024-08-18T22:20:18.511290+0000","last_fullsized":"2024-08-18T22:20:18.511290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:06.513442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506321+0000","last_change":"2024-08-18T22:20:19.524685+0000","last_active":"2024-08-18T22:20:20.506321+0000","last_peered":"2024-08-18T22:20:20.506321+0000","last_clean":"2024-08-18T22:20:20.506321+0000","last_became_active":"2024-08-18T22:20:19.524418+0000","last_became_peered":"2024-08-18T22:20:19.524418+0000","last_unstale":"2024-08-18T22:20:20.506321+0000","last_undegraded":"2024-08-18T22:20:20.506321+0000","last_fullsized":"2024-08-18T22:20:20.506321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:53.696643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505510+0000","last_change":"2024-08-18T22:20:18.506063+0000","last_active":"2024-08-18T22:20:20.505510+0000","last_peered":"2024-08-18T22:20:20.505510+0000","last_clean":"2024-08-18T22:20:20.505510+0000","last_became_active":"2024-08-18T22:20:18.505766+0000","last_became_peered":"2024-08-18T22:20:18.505766+0000","last_unstale":"2024-08-18T22:20:20.505510+0000","last_undegraded":"2024-08-18T22:20:20.505510+0000","last_fullsized":"2024-08-18T22:20:20.505510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:58.591575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499675+0000","last_change":"2024-08-18T22:20:18.499675+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499675+0000","last_undegraded":"2024-08-18T22:20:18.499675+0000","last_fullsized":"2024-08-18T22:20:18.499675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.507481+0000","last_change":"2024-08-18T22:20:18.501496+0000","last_active":"2024-08-18T22:20:18.507481+0000","last_peered":"2024-08-18T22:20:18.507481+0000","last_clean":"2024-08-18T22:20:18.507481+0000","last_became_active":"2024-08-18T22:20:18.501227+0000","last_became_peered":"2024-08-18T22:20:18.501227+0000","last_unstale":"2024-08-18T22:20:18.507481+0000","last_undegraded":"2024-08-18T22:20:18.507481+0000","last_fullsized":"2024-08-18T22:20:18.507481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:31.328987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.501385+0000","last_change":"2024-08-18T22:20:18.501385+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.501385+0000","last_undegraded":"2024-08-18T22:20:18.501385+0000","last_fullsized":"2024-08-18T22:20:18.501385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518280+0000","last_change":"2024-08-18T22:20:18.513740+0000","last_active":"2024-08-18T22:20:18.518280+0000","last_peered":"2024-08-18T22:20:18.518280+0000","last_clean":"2024-08-18T22:20:18.518280+0000","last_became_active":"2024-08-18T22:20:18.513369+0000","last_became_peered":"2024-08-18T22:20:18.513369+0000","last_unstale":"2024-08-18T22:20:18.518280+0000","last_undegraded":"2024-08-18T22:20:18.518280+0000","last_fullsized":"2024-08-18T22:20:18.518280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:43.649712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.497053+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:20:18.497053+0000","last_peered":"2024-08-18T22:20:18.497053+0000","last_clean":"2024-08-18T22:20:18.497053+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:20:18.497053+0000","last_undegraded":"2024-08-18T22:20:18.497053+0000","last_fullsized":"2024-08-18T22:20:18.497053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":768520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":171485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":178152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":178152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":171485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":761853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":185389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:20:24.387 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-08-18T22:20:24.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.493092+0000', 'last_change': '2024-08-18T22:20:18.493092+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.493092+0000', 'last_undegraded': '2024-08-18T22:20:18.493092+0000', 'last_fullsized': '2024-08-18T22:20:18.493092+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:20:24.387 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-08-18T22:20:24.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.496244+0000', 'last_change': '2024-08-18T22:20:18.496244+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.496244+0000', 'last_undegraded': '2024-08-18T22:20:18.496244+0000', 'last_fullsized': '2024-08-18T22:20:18.496244+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:20:24.387 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-08-18T22:20:24.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.496407+0000', 'last_change': '2024-08-18T22:20:18.496407+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.496407+0000', 'last_undegraded': '2024-08-18T22:20:18.496407+0000', 'last_fullsized': '2024-08-18T22:20:18.496407+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:20:24.387 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3a is not active+clean 2024-08-18T22:20:24.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.493274+0000', 'last_change': '2024-08-18T22:20:18.493274+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.493274+0000', 'last_undegraded': '2024-08-18T22:20:18.493274+0000', 'last_fullsized': '2024-08-18T22:20:18.493274+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:20:24.387 INFO:tasks.ceph.ceph_manager.ceph:PG 6.39 is not active+clean 2024-08-18T22:20:24.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.499887+0000', 'last_change': '2024-08-18T22:20:18.499887+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.499887+0000', 'last_undegraded': '2024-08-18T22:20:18.499887+0000', 'last_fullsized': '2024-08-18T22:20:18.499887+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:20:24.388 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-08-18T22:20:24.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.491230+0000', 'last_change': '2024-08-18T22:20:18.491230+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.491230+0000', 'last_undegraded': '2024-08-18T22:20:18.491230+0000', 'last_fullsized': '2024-08-18T22:20:18.491230+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:20:24.388 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-08-18T22:20:24.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.495448+0000', 'last_change': '2024-08-18T22:20:18.495448+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.495448+0000', 'last_undegraded': '2024-08-18T22:20:18.495448+0000', 'last_fullsized': '2024-08-18T22:20:18.495448+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:20:24.388 INFO:tasks.ceph.ceph_manager.ceph:PG 6.36 is not active+clean 2024-08-18T22:20:24.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.498758+0000', 'last_change': '2024-08-18T22:20:18.498758+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.498758+0000', 'last_undegraded': '2024-08-18T22:20:18.498758+0000', 'last_fullsized': '2024-08-18T22:20:18.498758+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:20:24.388 INFO:tasks.ceph.ceph_manager.ceph:PG 6.35 is not active+clean 2024-08-18T22:20:24.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.498892+0000', 'last_change': '2024-08-18T22:20:18.498892+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.498892+0000', 'last_undegraded': '2024-08-18T22:20:18.498892+0000', 'last_fullsized': '2024-08-18T22:20:18.498892+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:20:24.388 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-08-18T22:20:24.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.495011+0000', 'last_change': '2024-08-18T22:20:18.495011+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.495011+0000', 'last_undegraded': '2024-08-18T22:20:18.495011+0000', 'last_fullsized': '2024-08-18T22:20:18.495011+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:20:24.389 INFO:tasks.ceph.ceph_manager.ceph:PG 6.33 is not active+clean 2024-08-18T22:20:24.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.504430+0000', 'last_change': '2024-08-18T22:20:18.504430+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.504430+0000', 'last_undegraded': '2024-08-18T22:20:18.504430+0000', 'last_fullsized': '2024-08-18T22:20:18.504430+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:20:24.389 INFO:tasks.ceph.ceph_manager.ceph:PG 6.31 is not active+clean 2024-08-18T22:20:24.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.499339+0000', 'last_change': '2024-08-18T22:20:18.499339+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.499339+0000', 'last_undegraded': '2024-08-18T22:20:18.499339+0000', 'last_fullsized': '2024-08-18T22:20:18.499339+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:20:24.389 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-08-18T22:20:24.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.495978+0000', 'last_change': '2024-08-18T22:20:18.495978+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.495978+0000', 'last_undegraded': '2024-08-18T22:20:18.495978+0000', 'last_fullsized': '2024-08-18T22:20:18.495978+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:20:24.389 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-08-18T22:20:24.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.501271+0000', 'last_change': '2024-08-18T22:20:18.501271+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.501271+0000', 'last_undegraded': '2024-08-18T22:20:18.501271+0000', 'last_fullsized': '2024-08-18T22:20:18.501271+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:20:24.389 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-08-18T22:20:24.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.490502+0000', 'last_change': '2024-08-18T22:20:18.490502+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.490502+0000', 'last_undegraded': '2024-08-18T22:20:18.490502+0000', 'last_fullsized': '2024-08-18T22:20:18.490502+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:20:24.390 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-08-18T22:20:24.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.490750+0000', 'last_change': '2024-08-18T22:20:18.490750+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.490750+0000', 'last_undegraded': '2024-08-18T22:20:18.490750+0000', 'last_fullsized': '2024-08-18T22:20:18.490750+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:20:24.390 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2b is not active+clean 2024-08-18T22:20:24.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.497883+0000', 'last_change': '2024-08-18T22:20:18.497883+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.497883+0000', 'last_undegraded': '2024-08-18T22:20:18.497883+0000', 'last_fullsized': '2024-08-18T22:20:18.497883+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:20:24.390 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-08-18T22:20:24.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.497861+0000', 'last_change': '2024-08-18T22:20:18.497861+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.497861+0000', 'last_undegraded': '2024-08-18T22:20:18.497861+0000', 'last_fullsized': '2024-08-18T22:20:18.497861+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:20:24.390 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-08-18T22:20:24.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.490377+0000', 'last_change': '2024-08-18T22:20:18.490377+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.490377+0000', 'last_undegraded': '2024-08-18T22:20:18.490377+0000', 'last_fullsized': '2024-08-18T22:20:18.490377+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:PG 6.26 is not active+clean 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.491526+0000', 'last_change': '2024-08-18T22:20:18.491526+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.491526+0000', 'last_undegraded': '2024-08-18T22:20:18.491526+0000', 'last_fullsized': '2024-08-18T22:20:18.491526+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.490426+0000', 'last_change': '2024-08-18T22:20:18.490426+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.490426+0000', 'last_undegraded': '2024-08-18T22:20:18.490426+0000', 'last_fullsized': '2024-08-18T22:20:18.490426+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:PG 6.24 is not active+clean 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.497790+0000', 'last_change': '2024-08-18T22:20:18.497790+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.497790+0000', 'last_undegraded': '2024-08-18T22:20:18.497790+0000', 'last_fullsized': '2024-08-18T22:20:18.497790+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.490338+0000', 'last_change': '2024-08-18T22:20:18.490338+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.490338+0000', 'last_undegraded': '2024-08-18T22:20:18.490338+0000', 'last_fullsized': '2024-08-18T22:20:18.490338+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.490566+0000', 'last_change': '2024-08-18T22:20:18.490566+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.490566+0000', 'last_undegraded': '2024-08-18T22:20:18.490566+0000', 'last_fullsized': '2024-08-18T22:20:18.490566+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-08-18T22:20:24.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.493157+0000', 'last_change': '2024-08-18T22:20:18.493157+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.493157+0000', 'last_undegraded': '2024-08-18T22:20:18.493157+0000', 'last_fullsized': '2024-08-18T22:20:18.493157+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:PG 6.20 is not active+clean 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.491344+0000', 'last_change': '2024-08-18T22:20:18.491344+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.491344+0000', 'last_undegraded': '2024-08-18T22:20:18.491344+0000', 'last_fullsized': '2024-08-18T22:20:18.491344+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.500047+0000', 'last_change': '2024-08-18T22:20:18.500047+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.500047+0000', 'last_undegraded': '2024-08-18T22:20:18.500047+0000', 'last_fullsized': '2024-08-18T22:20:18.500047+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.492337+0000', 'last_change': '2024-08-18T22:20:18.492337+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.492337+0000', 'last_undegraded': '2024-08-18T22:20:18.492337+0000', 'last_fullsized': '2024-08-18T22:20:18.492337+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.493547+0000', 'last_change': '2024-08-18T22:20:18.493547+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.493547+0000', 'last_undegraded': '2024-08-18T22:20:18.493547+0000', 'last_fullsized': '2024-08-18T22:20:18.493547+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.495750+0000', 'last_change': '2024-08-18T22:20:18.495750+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.495750+0000', 'last_undegraded': '2024-08-18T22:20:18.495750+0000', 'last_fullsized': '2024-08-18T22:20:18.495750+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-08-18T22:20:24.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.497649+0000', 'last_change': '2024-08-18T22:20:18.497649+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.497649+0000', 'last_undegraded': '2024-08-18T22:20:18.497649+0000', 'last_fullsized': '2024-08-18T22:20:18.497649+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.499266+0000', 'last_change': '2024-08-18T22:20:18.499266+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.499266+0000', 'last_undegraded': '2024-08-18T22:20:18.499266+0000', 'last_fullsized': '2024-08-18T22:20:18.499266+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.495705+0000', 'last_change': '2024-08-18T22:20:18.495705+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.495705+0000', 'last_undegraded': '2024-08-18T22:20:18.495705+0000', 'last_fullsized': '2024-08-18T22:20:18.495705+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.495051+0000', 'last_change': '2024-08-18T22:20:18.495051+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.495051+0000', 'last_undegraded': '2024-08-18T22:20:18.495051+0000', 'last_fullsized': '2024-08-18T22:20:18.495051+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.495135+0000', 'last_change': '2024-08-18T22:20:18.495135+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.495135+0000', 'last_undegraded': '2024-08-18T22:20:18.495135+0000', 'last_fullsized': '2024-08-18T22:20:18.495135+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.491918+0000', 'last_change': '2024-08-18T22:20:18.491918+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.491918+0000', 'last_undegraded': '2024-08-18T22:20:18.491918+0000', 'last_fullsized': '2024-08-18T22:20:18.491918+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-08-18T22:20:24.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.499687+0000', 'last_change': '2024-08-18T22:20:18.499687+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.499687+0000', 'last_undegraded': '2024-08-18T22:20:18.499687+0000', 'last_fullsized': '2024-08-18T22:20:18.499687+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:20:24.394 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-08-18T22:20:24.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.498828+0000', 'last_change': '2024-08-18T22:20:18.498828+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.498828+0000', 'last_undegraded': '2024-08-18T22:20:18.498828+0000', 'last_fullsized': '2024-08-18T22:20:18.498828+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:20:24.394 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-08-18T22:20:24.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.492381+0000', 'last_change': '2024-08-18T22:20:18.492381+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.492381+0000', 'last_undegraded': '2024-08-18T22:20:18.492381+0000', 'last_fullsized': '2024-08-18T22:20:18.492381+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:20:24.394 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-08-18T22:20:24.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.498467+0000', 'last_change': '2024-08-18T22:20:18.498467+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.498467+0000', 'last_undegraded': '2024-08-18T22:20:18.498467+0000', 'last_fullsized': '2024-08-18T22:20:18.498467+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:20:24.394 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-08-18T22:20:24.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.493638+0000', 'last_change': '2024-08-18T22:20:18.493638+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.493638+0000', 'last_undegraded': '2024-08-18T22:20:18.493638+0000', 'last_fullsized': '2024-08-18T22:20:18.493638+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:20:24.394 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-08-18T22:20:24.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.495481+0000', 'last_change': '2024-08-18T22:20:18.495481+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.495481+0000', 'last_undegraded': '2024-08-18T22:20:18.495481+0000', 'last_fullsized': '2024-08-18T22:20:18.495481+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:20:24.395 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-08-18T22:20:24.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.504630+0000', 'last_change': '2024-08-18T22:20:18.504630+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.504630+0000', 'last_undegraded': '2024-08-18T22:20:18.504630+0000', 'last_fullsized': '2024-08-18T22:20:18.504630+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:20:24.395 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-08-18T22:20:24.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.493377+0000', 'last_change': '2024-08-18T22:20:18.493377+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.493377+0000', 'last_undegraded': '2024-08-18T22:20:18.493377+0000', 'last_fullsized': '2024-08-18T22:20:18.493377+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:20:24.395 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-08-18T22:20:24.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.492384+0000', 'last_change': '2024-08-18T22:20:18.492384+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.492384+0000', 'last_undegraded': '2024-08-18T22:20:18.492384+0000', 'last_fullsized': '2024-08-18T22:20:18.492384+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:20:24.395 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-08-18T22:20:24.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.493125+0000', 'last_change': '2024-08-18T22:20:18.493125+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.493125+0000', 'last_undegraded': '2024-08-18T22:20:18.493125+0000', 'last_fullsized': '2024-08-18T22:20:18.493125+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:20:24.395 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-08-18T22:20:24.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.495710+0000', 'last_change': '2024-08-18T22:20:18.495710+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.495710+0000', 'last_undegraded': '2024-08-18T22:20:18.495710+0000', 'last_fullsized': '2024-08-18T22:20:18.495710+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:20:24.395 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-08-18T22:20:24.396 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.494509+0000', 'last_change': '2024-08-18T22:20:18.494509+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.494509+0000', 'last_undegraded': '2024-08-18T22:20:18.494509+0000', 'last_fullsized': '2024-08-18T22:20:18.494509+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:20:24.396 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-08-18T22:20:24.396 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.492553+0000', 'last_change': '2024-08-18T22:20:18.492553+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.492553+0000', 'last_undegraded': '2024-08-18T22:20:18.492553+0000', 'last_fullsized': '2024-08-18T22:20:18.492553+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:20:24.396 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-08-18T22:20:24.396 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.499675+0000', 'last_change': '2024-08-18T22:20:18.499675+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.499675+0000', 'last_undegraded': '2024-08-18T22:20:18.499675+0000', 'last_fullsized': '2024-08-18T22:20:18.499675+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:20:24.396 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-08-18T22:20:24.396 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:20:18.501385+0000', 'last_change': '2024-08-18T22:20:18.501385+0000', 'last_active': '2024-08-18T22:20:18.479407+0000', 'last_peered': '2024-08-18T22:20:18.479407+0000', 'last_clean': '2024-08-18T22:20:18.479407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:20:18.501385+0000', 'last_undegraded': '2024-08-18T22:20:18.501385+0000', 'last_fullsized': '2024-08-18T22:20:18.501385+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'last_clean_scrub_stamp': '2024-08-18T22:20:18.479407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:20:24.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:20:24.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.561+0000 7f6a96a00640 1 Processor -- start 2024-08-18T22:20:24.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.561+0000 7f6a96a00640 1 -- start start 2024-08-18T22:20:24.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a96a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a9015a800 0x7f6a900caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a96a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6a900ce280 0x7f6a9006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a96a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a900cb5d0 con 0x7f6a900ce6c0 2024-08-18T22:20:24.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a96a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6a90072e60 con 0x7f6a9015a800 2024-08-18T22:20:24.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a96a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6a90073140 con 0x7f6a900ce280 2024-08-18T22:20:24.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a8fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a9015a800 0x7f6a900caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a94a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6a900ce6c0 0x7f6a9015e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60910/0 (socket says 172.21.15.5:60910) 2024-08-18T22:20:24.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a94a00640 1 -- 172.21.15.5:0/2294317779 learned_addr learned my addr 172.21.15.5:0/2294317779 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:24.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a8fe00640 1 -- 172.21.15.5:0/2294317779 >> v2:172.21.15.117:3300/0 conn(0x7f6a900ce280 msgr2=0x7f6a9006ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:24.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a87400640 1 --2- 172.21.15.5:0/2294317779 >> v2:172.21.15.117:3300/0 conn(0x7f6a900ce280 0x7f6a9006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a8f400640 1 -- 172.21.15.5:0/2294317779 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802412581 0 0) 0x7f6a900cb5d0 con 0x7f6a900ce6c0 2024-08-18T22:20:24.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a8fe00640 1 --2- 172.21.15.5:0/2294317779 >> v2:172.21.15.117:3300/0 conn(0x7f6a900ce280 0x7f6a9006ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a8fe00640 1 -- 172.21.15.5:0/2294317779 >> v1:172.21.15.5:6789/0 conn(0x7f6a900ce6c0 legacy=0x7f6a9015e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a8fe00640 1 -- 172.21.15.5:0/2294317779 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a90073420 con 0x7f6a9015a800 2024-08-18T22:20:24.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.565+0000 7f6a87400640 1 --2- 172.21.15.5:0/2294317779 >> v2:172.21.15.117:3300/0 conn(0x7f6a900ce280 0x7f6a9006ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:24.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a8fe00640 1 --2- 172.21.15.5:0/2294317779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9015a800 0x7f6a900caec0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6a900cac80 tx=0x7f6a8001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fc9c952127926 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:24.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a8f400640 1 -- 172.21.15.5:0/2294317779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a800b1070 con 0x7f6a9015a800 2024-08-18T22:20:24.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a8f400640 1 -- 172.21.15.5:0/2294317779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a800ac640 con 0x7f6a9015a800 2024-08-18T22:20:24.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a8f400640 1 -- 172.21.15.5:0/2294317779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a800aca10 con 0x7f6a9015a800 2024-08-18T22:20:24.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 -- 172.21.15.5:0/2294317779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9015a800 msgr2=0x7f6a900caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 --2- 172.21.15.5:0/2294317779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9015a800 0x7f6a900caec0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6a900cac80 tx=0x7f6a8001c480 comp rx=0 tx=0).stop 2024-08-18T22:20:24.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 -- 172.21.15.5:0/2294317779 shutdown_connections 2024-08-18T22:20:24.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 --2- 172.21.15.5:0/2294317779 >> v2:172.21.15.117:3300/0 conn(0x7f6a900ce280 0x7f6a9006ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 --2- 172.21.15.5:0/2294317779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9015a800 0x7f6a900caec0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 -- 172.21.15.5:0/2294317779 >> 172.21.15.5:0/2294317779 conn(0x7f6a900b1c50 msgr2=0x7f6a900b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:24.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 -- 172.21.15.5:0/2294317779 shutdown_connections 2024-08-18T22:20:24.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 -- 172.21.15.5:0/2294317779 wait complete. 2024-08-18T22:20:24.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 Processor -- start 2024-08-18T22:20:24.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 -- start start 2024-08-18T22:20:24.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a900ce280 0x7f6a90143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a900ce6c0 0x7f6a90152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a9015a800 0x7f6a90150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9015ecf0 con 0x7f6a900ce280 2024-08-18T22:20:24.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9015eb70 con 0x7f6a9015a800 2024-08-18T22:20:24.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a96a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9015ee70 con 0x7f6a900ce6c0 2024-08-18T22:20:24.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a8fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a900ce280 0x7f6a90143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a8fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a900ce280 0x7f6a90143de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46078/0 (socket says 172.21.15.5:46078) 2024-08-18T22:20:24.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.569+0000 7f6a8fe00640 1 -- 172.21.15.5:0/660199814 learned_addr learned my addr 172.21.15.5:0/660199814 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:24.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8fe00640 1 -- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a900ce6c0 msgr2=0x7f6a90152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8fe00640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a900ce6c0 0x7f6a90152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8fe00640 1 -- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a9015a800 msgr2=0x7f6a90150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8fe00640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a9015a800 0x7f6a90150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8fe00640 1 -- 172.21.15.5:0/660199814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a90144320 con 0x7f6a900ce280 2024-08-18T22:20:24.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8fe00640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a900ce280 0x7f6a90143de0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6a8001a0b0 tx=0x7f6a8001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:24.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8cc00640 1 -- 172.21.15.5:0/660199814 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a800b1050 con 0x7f6a900ce280 2024-08-18T22:20:24.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8cc00640 1 -- 172.21.15.5:0/660199814 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a800b2040 con 0x7f6a900ce280 2024-08-18T22:20:24.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a96a00640 1 -- 172.21.15.5:0/660199814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9015ad80 con 0x7f6a900ce280 2024-08-18T22:20:24.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8cc00640 1 -- 172.21.15.5:0/660199814 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80004220 con 0x7f6a900ce280 2024-08-18T22:20:24.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a96a00640 1 -- 172.21.15.5:0/660199814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9015b340 con 0x7f6a900ce280 2024-08-18T22:20:24.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a96a00640 1 -- 172.21.15.5:0/660199814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9006ea40 con 0x7f6a900ce280 2024-08-18T22:20:24.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8cc00640 1 -- 172.21.15.5:0/660199814 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a800bf060 con 0x7f6a900ce280 2024-08-18T22:20:24.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8cc00640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a6c0678c0 0x7f6a6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.573+0000 7f6a8cc00640 1 -- 172.21.15.5:0/660199814 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6a8011fb00 con 0x7f6a900ce280 2024-08-18T22:20:24.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.577+0000 7f6a87400640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a6c0678c0 0x7f6a6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.577+0000 7f6a87400640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a6c0678c0 0x7f6a6c069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a9009ae60 tx=0x7f6a78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:24.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.577+0000 7f6a8cc00640 1 -- 172.21.15.5:0/660199814 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6a80016070 con 0x7f6a900ce280 2024-08-18T22:20:24.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 -- 172.21.15.5:0/660199814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6a900cd910 con 0x7f6a900ce280 2024-08-18T22:20:24.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a8cc00640 1 -- 172.21.15.5:0/660199814 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1686 (secure 0 0 0) 0x7f6a8011fe20 con 0x7f6a900ce280 2024-08-18T22:20:24.804 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:24.804 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":88,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":51},{"state_name":"active+clean","count":46}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590438,"bytes_used":238673920,"bytes_avail":772855439360,"bytes_total":773094113280,"inactive_pgs_ratio":0.52577316761016846,"write_bytes_sec":170,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":17,"btime":"2024-08-18T22:20:22:509921+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4908}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-08-18T22:20:09.630683+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:20:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 -- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a6c0678c0 msgr2=0x7f6a6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a6c0678c0 0x7f6a6c069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a9009ae60 tx=0x7f6a78008040 comp rx=0 tx=0).stop 2024-08-18T22:20:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 -- 172.21.15.5:0/660199814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a900ce280 msgr2=0x7f6a90143de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a900ce280 0x7f6a90143de0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6a8001a0b0 tx=0x7f6a8001acc0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 -- 172.21.15.5:0/660199814 shutdown_connections 2024-08-18T22:20:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a6c0678c0 0x7f6a6c069d80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a9015a800 0x7f6a90150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a900ce6c0 0x7f6a90152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 --2- 172.21.15.5:0/660199814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a900ce280 0x7f6a90143de0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 -- 172.21.15.5:0/660199814 >> 172.21.15.5:0/660199814 conn(0x7f6a900b1c50 msgr2=0x7f6a900ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 -- 172.21.15.5:0/660199814 shutdown_connections 2024-08-18T22:20:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.801+0000 7f6a96a00640 1 -- 172.21.15.5:0/660199814 wait complete. 2024-08-18T22:20:24.825 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-18T22:20:24.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:20:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f34000640 1 Processor -- start 2024-08-18T22:20:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f34000640 1 -- start start 2024-08-18T22:20:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f34000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f2c15b010 0x7f4f2c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f34000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f2c0cd3a0 0x7f4f2c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f34000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f2c0cee20 con 0x7f4f2c06f0c0 2024-08-18T22:20:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f34000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2c0cfa30 con 0x7f4f2c0cd3a0 2024-08-18T22:20:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f34000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2c0cf100 con 0x7f4f2c15b010 2024-08-18T22:20:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f32000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4f2c06f0c0 0x7f4f2c0caf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60914/0 (socket says 172.21.15.5:60914) 2024-08-18T22:20:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f32000640 1 -- 172.21.15.5:0/2128278428 learned_addr learned my addr 172.21.15.5:0/2128278428 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f31600640 1 --2- 172.21.15.5:0/2128278428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f2c15b010 0x7f4f2c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f30c00640 1 --2- 172.21.15.5:0/2128278428 >> v2:172.21.15.117:3300/0 conn(0x7f4f2c0cd3a0 0x7f4f2c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f31600640 1 -- 172.21.15.5:0/2128278428 >> v2:172.21.15.117:3300/0 conn(0x7f4f2c0cd3a0 msgr2=0x7f4f2c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f31600640 1 --2- 172.21.15.5:0/2128278428 >> v2:172.21.15.117:3300/0 conn(0x7f4f2c0cd3a0 0x7f4f2c06eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f31600640 1 -- 172.21.15.5:0/2128278428 >> v1:172.21.15.5:6789/0 conn(0x7f4f2c06f0c0 legacy=0x7f4f2c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f31600640 1 -- 172.21.15.5:0/2128278428 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2c0cf3e0 con 0x7f4f2c15b010 2024-08-18T22:20:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.965+0000 7f4f2be00640 1 -- 172.21.15.5:0/2128278428 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033644289 0 0) 0x7f4f2c0cee20 con 0x7f4f2c06f0c0 2024-08-18T22:20:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f31600640 1 --2- 172.21.15.5:0/2128278428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f2c15b010 0x7f4f2c0ce840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f200097c0 tx=0x7f4f2001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6fcfa6f994adfbe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:24.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f2be00640 1 -- 172.21.15.5:0/2128278428 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f200b0070 con 0x7f4f2c15b010 2024-08-18T22:20:24.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f2be00640 1 -- 172.21.15.5:0/2128278428 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f200ab600 con 0x7f4f2c15b010 2024-08-18T22:20:24.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f2be00640 1 -- 172.21.15.5:0/2128278428 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f200ab9d0 con 0x7f4f2c15b010 2024-08-18T22:20:24.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f34000640 1 -- 172.21.15.5:0/2128278428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f2c15b010 msgr2=0x7f4f2c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f34000640 1 --2- 172.21.15.5:0/2128278428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f2c15b010 0x7f4f2c0ce840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f200097c0 tx=0x7f4f2001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f34000640 1 -- 172.21.15.5:0/2128278428 shutdown_connections 2024-08-18T22:20:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f34000640 1 --2- 172.21.15.5:0/2128278428 >> v2:172.21.15.117:3300/0 conn(0x7f4f2c0cd3a0 0x7f4f2c06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f34000640 1 --2- 172.21.15.5:0/2128278428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f2c15b010 0x7f4f2c0ce840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f34000640 1 -- 172.21.15.5:0/2128278428 >> 172.21.15.5:0/2128278428 conn(0x7f4f2c0b1c50 msgr2=0x7f4f2c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f34000640 1 -- 172.21.15.5:0/2128278428 shutdown_connections 2024-08-18T22:20:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.969+0000 7f4f34000640 1 -- 172.21.15.5:0/2128278428 wait complete. 2024-08-18T22:20:24.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f34000640 1 Processor -- start 2024-08-18T22:20:24.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f34000640 1 -- start start 2024-08-18T22:20:24.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f34000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f2c06f0c0 0x7f4f2c1f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f34000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f2c0cd3a0 0x7f4f2c14a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f34000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f2c15b010 0x7f4f2c0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f34000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c167dd0 con 0x7f4f2c15b010 2024-08-18T22:20:24.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f34000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c167c50 con 0x7f4f2c06f0c0 2024-08-18T22:20:24.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f34000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2c167f50 con 0x7f4f2c0cd3a0 2024-08-18T22:20:24.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f32000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f2c15b010 0x7f4f2c0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f32000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f2c15b010 0x7f4f2c0c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46090/0 (socket says 172.21.15.5:46090) 2024-08-18T22:20:24.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f32000640 1 -- 172.21.15.5:0/43897940 learned_addr learned my addr 172.21.15.5:0/43897940 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:24.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f31600640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f2c06f0c0 0x7f4f2c1f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f30c00640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f2c0cd3a0 0x7f4f2c14a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f32000640 1 -- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f2c0cd3a0 msgr2=0x7f4f2c14a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f32000640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f2c0cd3a0 0x7f4f2c14a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f32000640 1 -- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f2c06f0c0 msgr2=0x7f4f2c1f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:24.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f32000640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f2c06f0c0 0x7f4f2c1f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:24.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f32000640 1 -- 172.21.15.5:0/43897940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2c1527f0 con 0x7f4f2c15b010 2024-08-18T22:20:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f32000640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f2c15b010 0x7f4f2c0c92d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c7a0 tx=0x7f4f2400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f29600640 1 -- 172.21.15.5:0/43897940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24018070 con 0x7f4f2c15b010 2024-08-18T22:20:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f29600640 1 -- 172.21.15.5:0/43897940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2400a5e0 con 0x7f4f2c15b010 2024-08-18T22:20:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f34000640 1 -- 172.21.15.5:0/43897940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2c151ec0 con 0x7f4f2c15b010 2024-08-18T22:20:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f29600640 1 -- 172.21.15.5:0/43897940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400aa50 con 0x7f4f2c15b010 2024-08-18T22:20:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f34000640 1 -- 172.21.15.5:0/43897940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2c152480 con 0x7f4f2c15b010 2024-08-18T22:20:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.973+0000 7f4f34000640 1 -- 172.21.15.5:0/43897940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2c06eb80 con 0x7f4f2c15b010 2024-08-18T22:20:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.977+0000 7f4f29600640 1 -- 172.21.15.5:0/43897940 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f2401b070 con 0x7f4f2c15b010 2024-08-18T22:20:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.977+0000 7f4f29600640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4f0c0678f0 0x7f4f0c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.977+0000 7f4f29600640 1 -- 172.21.15.5:0/43897940 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4f240852f0 con 0x7f4f2c15b010 2024-08-18T22:20:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.977+0000 7f4f31600640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4f0c0678f0 0x7f4f0c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:24.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.977+0000 7f4f31600640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4f0c0678f0 0x7f4f0c069db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f200ad000 tx=0x7f4f200a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:24.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:24.981+0000 7f4f29600640 1 -- 172.21.15.5:0/43897940 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4f24055650 con 0x7f4f2c15b010 2024-08-18T22:20:25.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.141+0000 7f4f34000640 1 -- 172.21.15.5:0/43897940 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4f2c151c70 con 0x7f4f0c0678f0 2024-08-18T22:20:25.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.149+0000 7f4f29600640 1 -- 172.21.15.5:0/43897940 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247713 (secure 0 0 0) 0x7f4f2c151c70 con 0x7f4f0c0678f0 2024-08-18T22:20:25.155 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:25.156 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:20:25.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 -- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4f0c0678f0 msgr2=0x7f4f0c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:25.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4f0c0678f0 0x7f4f0c069db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f200ad000 tx=0x7f4f200a6000 comp rx=0 tx=0).stop 2024-08-18T22:20:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 -- 172.21.15.5:0/43897940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f2c15b010 msgr2=0x7f4f2c0c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f2c15b010 0x7f4f2c0c92d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c7a0 tx=0x7f4f2400cc60 comp rx=0 tx=0).stop 2024-08-18T22:20:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 -- 172.21.15.5:0/43897940 shutdown_connections 2024-08-18T22:20:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4f0c0678f0 0x7f4f0c069db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f2c15b010 0x7f4f2c0c92d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f2c0cd3a0 0x7f4f2c14a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 --2- 172.21.15.5:0/43897940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f2c06f0c0 0x7f4f2c1f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 -- 172.21.15.5:0/43897940 >> 172.21.15.5:0/43897940 conn(0x7f4f2c0b1c50 msgr2=0x7f4f2c0caf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 -- 172.21.15.5:0/43897940 shutdown_connections 2024-08-18T22:20:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:25.153+0000 7f4f34000640 1 -- 172.21.15.5:0/43897940 wait complete. 2024-08-18T22:20:25.176 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-08-18T22:20:23.633052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233080,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741640,"statfs":{"total":773094113280,"available":772855439360,"internally_reserved":0,"allocated":4530176,"data_stored":2600959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001063"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493092+0000","last_change":"2024-08-18T22:20:18.493092+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493092+0000","last_undegraded":"2024-08-18T22:20:18.493092+0000","last_fullsized":"2024-08-18T22:20:18.493092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.496244+0000","last_change":"2024-08-18T22:20:18.496244+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.496244+0000","last_undegraded":"2024-08-18T22:20:18.496244+0000","last_fullsized":"2024-08-18T22:20:18.496244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.496407+0000","last_change":"2024-08-18T22:20:18.496407+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.496407+0000","last_undegraded":"2024-08-18T22:20:18.496407+0000","last_fullsized":"2024-08-18T22:20:18.496407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529400+0000","last_change":"2024-08-18T22:20:19.523171+0000","last_active":"2024-08-18T22:20:19.529400+0000","last_peered":"2024-08-18T22:20:19.529400+0000","last_clean":"2024-08-18T22:20:19.529400+0000","last_became_active":"2024-08-18T22:20:19.522915+0000","last_became_peered":"2024-08-18T22:20:19.522915+0000","last_unstale":"2024-08-18T22:20:19.529400+0000","last_undegraded":"2024-08-18T22:20:19.529400+0000","last_fullsized":"2024-08-18T22:20:19.529400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:55:25.376251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.522175+0000","last_change":"2024-08-18T22:20:19.514150+0000","last_active":"2024-08-18T22:20:19.522175+0000","last_peered":"2024-08-18T22:20:19.522175+0000","last_clean":"2024-08-18T22:20:19.522175+0000","last_became_active":"2024-08-18T22:20:19.513901+0000","last_became_peered":"2024-08-18T22:20:19.513901+0000","last_unstale":"2024-08-18T22:20:19.522175+0000","last_undegraded":"2024-08-18T22:20:19.522175+0000","last_fullsized":"2024-08-18T22:20:19.522175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:38.521131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493274+0000","last_change":"2024-08-18T22:20:18.493274+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493274+0000","last_undegraded":"2024-08-18T22:20:18.493274+0000","last_fullsized":"2024-08-18T22:20:18.493274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499887+0000","last_change":"2024-08-18T22:20:18.499887+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499887+0000","last_undegraded":"2024-08-18T22:20:18.499887+0000","last_fullsized":"2024-08-18T22:20:18.499887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491230+0000","last_change":"2024-08-18T22:20:18.491230+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491230+0000","last_undegraded":"2024-08-18T22:20:18.491230+0000","last_fullsized":"2024-08-18T22:20:18.491230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495448+0000","last_change":"2024-08-18T22:20:18.495448+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495448+0000","last_undegraded":"2024-08-18T22:20:18.495448+0000","last_fullsized":"2024-08-18T22:20:18.495448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498758+0000","last_change":"2024-08-18T22:20:18.498758+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498758+0000","last_undegraded":"2024-08-18T22:20:18.498758+0000","last_fullsized":"2024-08-18T22:20:18.498758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498892+0000","last_change":"2024-08-18T22:20:18.498892+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498892+0000","last_undegraded":"2024-08-18T22:20:18.498892+0000","last_fullsized":"2024-08-18T22:20:18.498892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495011+0000","last_change":"2024-08-18T22:20:18.495011+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495011+0000","last_undegraded":"2024-08-18T22:20:18.495011+0000","last_fullsized":"2024-08-18T22:20:18.495011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.504430+0000","last_change":"2024-08-18T22:20:18.504430+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.504430+0000","last_undegraded":"2024-08-18T22:20:18.504430+0000","last_fullsized":"2024-08-18T22:20:18.504430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506172+0000","last_change":"2024-08-18T22:20:19.510105+0000","last_active":"2024-08-18T22:20:20.506172+0000","last_peered":"2024-08-18T22:20:20.506172+0000","last_clean":"2024-08-18T22:20:20.506172+0000","last_became_active":"2024-08-18T22:20:19.509851+0000","last_became_peered":"2024-08-18T22:20:19.509851+0000","last_unstale":"2024-08-18T22:20:20.506172+0000","last_undegraded":"2024-08-18T22:20:20.506172+0000","last_fullsized":"2024-08-18T22:20:20.506172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:44.652528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499339+0000","last_change":"2024-08-18T22:20:18.499339+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499339+0000","last_undegraded":"2024-08-18T22:20:18.499339+0000","last_fullsized":"2024-08-18T22:20:18.499339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495978+0000","last_change":"2024-08-18T22:20:18.495978+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495978+0000","last_undegraded":"2024-08-18T22:20:18.495978+0000","last_fullsized":"2024-08-18T22:20:18.495978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.501271+0000","last_change":"2024-08-18T22:20:18.501271+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.501271+0000","last_undegraded":"2024-08-18T22:20:18.501271+0000","last_fullsized":"2024-08-18T22:20:18.501271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490502+0000","last_change":"2024-08-18T22:20:18.490502+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490502+0000","last_undegraded":"2024-08-18T22:20:18.490502+0000","last_fullsized":"2024-08-18T22:20:18.490502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.522894+0000","last_change":"2024-08-18T22:20:19.513201+0000","last_active":"2024-08-18T22:20:19.522894+0000","last_peered":"2024-08-18T22:20:19.522894+0000","last_clean":"2024-08-18T22:20:19.522894+0000","last_became_active":"2024-08-18T22:20:19.512920+0000","last_became_peered":"2024-08-18T22:20:19.512920+0000","last_unstale":"2024-08-18T22:20:19.522894+0000","last_undegraded":"2024-08-18T22:20:19.522894+0000","last_fullsized":"2024-08-18T22:20:19.522894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:03.535227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490750+0000","last_change":"2024-08-18T22:20:18.490750+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490750+0000","last_undegraded":"2024-08-18T22:20:18.490750+0000","last_fullsized":"2024-08-18T22:20:18.490750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497883+0000","last_change":"2024-08-18T22:20:18.497883+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497883+0000","last_undegraded":"2024-08-18T22:20:18.497883+0000","last_fullsized":"2024-08-18T22:20:18.497883+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506727+0000","last_change":"2024-08-18T22:20:19.517261+0000","last_active":"2024-08-18T22:20:20.506727+0000","last_peered":"2024-08-18T22:20:20.506727+0000","last_clean":"2024-08-18T22:20:20.506727+0000","last_became_active":"2024-08-18T22:20:19.516966+0000","last_became_peered":"2024-08-18T22:20:19.516966+0000","last_unstale":"2024-08-18T22:20:20.506727+0000","last_undegraded":"2024-08-18T22:20:20.506727+0000","last_fullsized":"2024-08-18T22:20:20.506727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:39:08.996900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497861+0000","last_change":"2024-08-18T22:20:18.497861+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497861+0000","last_undegraded":"2024-08-18T22:20:18.497861+0000","last_fullsized":"2024-08-18T22:20:18.497861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.528004+0000","last_change":"2024-08-18T22:20:19.518451+0000","last_active":"2024-08-18T22:20:19.528004+0000","last_peered":"2024-08-18T22:20:19.528004+0000","last_clean":"2024-08-18T22:20:19.528004+0000","last_became_active":"2024-08-18T22:20:19.517998+0000","last_became_peered":"2024-08-18T22:20:19.517998+0000","last_unstale":"2024-08-18T22:20:19.528004+0000","last_undegraded":"2024-08-18T22:20:19.528004+0000","last_fullsized":"2024-08-18T22:20:19.528004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:30:38.396904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490377+0000","last_change":"2024-08-18T22:20:18.490377+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490377+0000","last_undegraded":"2024-08-18T22:20:18.490377+0000","last_fullsized":"2024-08-18T22:20:18.490377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491526+0000","last_change":"2024-08-18T22:20:18.491526+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491526+0000","last_undegraded":"2024-08-18T22:20:18.491526+0000","last_fullsized":"2024-08-18T22:20:18.491526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490426+0000","last_change":"2024-08-18T22:20:18.490426+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490426+0000","last_undegraded":"2024-08-18T22:20:18.490426+0000","last_fullsized":"2024-08-18T22:20:18.490426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497790+0000","last_change":"2024-08-18T22:20:18.497790+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497790+0000","last_undegraded":"2024-08-18T22:20:18.497790+0000","last_fullsized":"2024-08-18T22:20:18.497790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490338+0000","last_change":"2024-08-18T22:20:18.490338+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490338+0000","last_undegraded":"2024-08-18T22:20:18.490338+0000","last_fullsized":"2024-08-18T22:20:18.490338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.490566+0000","last_change":"2024-08-18T22:20:18.490566+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.490566+0000","last_undegraded":"2024-08-18T22:20:18.490566+0000","last_fullsized":"2024-08-18T22:20:18.490566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493157+0000","last_change":"2024-08-18T22:20:18.493157+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493157+0000","last_undegraded":"2024-08-18T22:20:18.493157+0000","last_fullsized":"2024-08-18T22:20:18.493157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491344+0000","last_change":"2024-08-18T22:20:18.491344+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491344+0000","last_undegraded":"2024-08-18T22:20:18.491344+0000","last_fullsized":"2024-08-18T22:20:18.491344+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.500047+0000","last_change":"2024-08-18T22:20:18.500047+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.500047+0000","last_undegraded":"2024-08-18T22:20:18.500047+0000","last_fullsized":"2024-08-18T22:20:18.500047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510476+0000","last_change":"2024-08-18T22:20:18.507055+0000","last_active":"2024-08-18T22:20:18.510476+0000","last_peered":"2024-08-18T22:20:18.510476+0000","last_clean":"2024-08-18T22:20:18.510476+0000","last_became_active":"2024-08-18T22:20:18.506703+0000","last_became_peered":"2024-08-18T22:20:18.506703+0000","last_unstale":"2024-08-18T22:20:18.510476+0000","last_undegraded":"2024-08-18T22:20:18.510476+0000","last_fullsized":"2024-08-18T22:20:18.510476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:01:24.898465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492337+0000","last_change":"2024-08-18T22:20:18.492337+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492337+0000","last_undegraded":"2024-08-18T22:20:18.492337+0000","last_fullsized":"2024-08-18T22:20:18.492337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510279+0000","last_change":"2024-08-18T22:20:18.506164+0000","last_active":"2024-08-18T22:20:18.510279+0000","last_peered":"2024-08-18T22:20:18.510279+0000","last_clean":"2024-08-18T22:20:18.510279+0000","last_became_active":"2024-08-18T22:20:18.505859+0000","last_became_peered":"2024-08-18T22:20:18.505859+0000","last_unstale":"2024-08-18T22:20:18.510279+0000","last_undegraded":"2024-08-18T22:20:18.510279+0000","last_fullsized":"2024-08-18T22:20:18.510279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:13.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507281+0000","last_change":"2024-08-18T22:20:19.511725+0000","last_active":"2024-08-18T22:20:20.507281+0000","last_peered":"2024-08-18T22:20:20.507281+0000","last_clean":"2024-08-18T22:20:20.507281+0000","last_became_active":"2024-08-18T22:20:19.509416+0000","last_became_peered":"2024-08-18T22:20:19.509416+0000","last_unstale":"2024-08-18T22:20:20.507281+0000","last_undegraded":"2024-08-18T22:20:20.507281+0000","last_fullsized":"2024-08-18T22:20:20.507281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:46.028258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510679+0000","last_change":"2024-08-18T22:20:18.505900+0000","last_active":"2024-08-18T22:20:18.510679+0000","last_peered":"2024-08-18T22:20:18.510679+0000","last_clean":"2024-08-18T22:20:18.510679+0000","last_became_active":"2024-08-18T22:20:18.505628+0000","last_became_peered":"2024-08-18T22:20:18.505628+0000","last_unstale":"2024-08-18T22:20:18.510679+0000","last_undegraded":"2024-08-18T22:20:18.510679+0000","last_fullsized":"2024-08-18T22:20:18.510679+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:33.626411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493547+0000","last_change":"2024-08-18T22:20:18.493547+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493547+0000","last_undegraded":"2024-08-18T22:20:18.493547+0000","last_fullsized":"2024-08-18T22:20:18.493547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506625+0000","last_change":"2024-08-18T22:20:18.506470+0000","last_active":"2024-08-18T22:20:20.506625+0000","last_peered":"2024-08-18T22:20:20.506625+0000","last_clean":"2024-08-18T22:20:20.506625+0000","last_became_active":"2024-08-18T22:20:18.505750+0000","last_became_peered":"2024-08-18T22:20:18.505750+0000","last_unstale":"2024-08-18T22:20:20.506625+0000","last_undegraded":"2024-08-18T22:20:20.506625+0000","last_fullsized":"2024-08-18T22:20:20.506625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:28.594042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495750+0000","last_change":"2024-08-18T22:20:18.495750+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495750+0000","last_undegraded":"2024-08-18T22:20:18.495750+0000","last_fullsized":"2024-08-18T22:20:18.495750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518308+0000","last_change":"2024-08-18T22:20:18.513803+0000","last_active":"2024-08-18T22:20:18.518308+0000","last_peered":"2024-08-18T22:20:18.518308+0000","last_clean":"2024-08-18T22:20:18.518308+0000","last_became_active":"2024-08-18T22:20:18.513118+0000","last_became_peered":"2024-08-18T22:20:18.513118+0000","last_unstale":"2024-08-18T22:20:18.518308+0000","last_undegraded":"2024-08-18T22:20:18.518308+0000","last_fullsized":"2024-08-18T22:20:18.518308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:43.649712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.497649+0000","last_change":"2024-08-18T22:20:18.497649+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.497649+0000","last_undegraded":"2024-08-18T22:20:18.497649+0000","last_fullsized":"2024-08-18T22:20:18.497649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.514042+0000","last_change":"2024-08-18T22:20:18.507975+0000","last_active":"2024-08-18T22:20:18.514042+0000","last_peered":"2024-08-18T22:20:18.514042+0000","last_clean":"2024-08-18T22:20:18.514042+0000","last_became_active":"2024-08-18T22:20:18.507730+0000","last_became_peered":"2024-08-18T22:20:18.507730+0000","last_unstale":"2024-08-18T22:20:18.514042+0000","last_undegraded":"2024-08-18T22:20:18.514042+0000","last_fullsized":"2024-08-18T22:20:18.514042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:16.215376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506523+0000","last_change":"2024-08-18T22:20:19.512493+0000","last_active":"2024-08-18T22:20:20.506523+0000","last_peered":"2024-08-18T22:20:20.506523+0000","last_clean":"2024-08-18T22:20:20.506523+0000","last_became_active":"2024-08-18T22:20:19.512176+0000","last_became_peered":"2024-08-18T22:20:19.512176+0000","last_unstale":"2024-08-18T22:20:20.506523+0000","last_undegraded":"2024-08-18T22:20:20.506523+0000","last_fullsized":"2024-08-18T22:20:20.506523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:50.110322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516286+0000","last_change":"2024-08-18T22:20:18.514200+0000","last_active":"2024-08-18T22:20:18.516286+0000","last_peered":"2024-08-18T22:20:18.516286+0000","last_clean":"2024-08-18T22:20:18.516286+0000","last_became_active":"2024-08-18T22:20:18.513674+0000","last_became_peered":"2024-08-18T22:20:18.513674+0000","last_unstale":"2024-08-18T22:20:18.516286+0000","last_undegraded":"2024-08-18T22:20:18.516286+0000","last_fullsized":"2024-08-18T22:20:18.516286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:17.147946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499266+0000","last_change":"2024-08-18T22:20:18.499266+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499266+0000","last_undegraded":"2024-08-18T22:20:18.499266+0000","last_fullsized":"2024-08-18T22:20:18.499266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505383+0000","last_change":"2024-08-18T22:20:18.509839+0000","last_active":"2024-08-18T22:20:20.505383+0000","last_peered":"2024-08-18T22:20:20.505383+0000","last_clean":"2024-08-18T22:20:20.505383+0000","last_became_active":"2024-08-18T22:20:18.509566+0000","last_became_peered":"2024-08-18T22:20:18.509566+0000","last_unstale":"2024-08-18T22:20:20.505383+0000","last_undegraded":"2024-08-18T22:20:20.505383+0000","last_fullsized":"2024-08-18T22:20:20.505383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:52:05.432990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529421+0000","last_change":"2024-08-18T22:20:19.527869+0000","last_active":"2024-08-18T22:20:19.529421+0000","last_peered":"2024-08-18T22:20:19.529421+0000","last_clean":"2024-08-18T22:20:19.529421+0000","last_became_active":"2024-08-18T22:20:19.527597+0000","last_became_peered":"2024-08-18T22:20:19.527597+0000","last_unstale":"2024-08-18T22:20:19.529421+0000","last_undegraded":"2024-08-18T22:20:19.529421+0000","last_fullsized":"2024-08-18T22:20:19.529421+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:59.595149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511279+0000","last_change":"2024-08-18T22:20:18.504598+0000","last_active":"2024-08-18T22:20:18.511279+0000","last_peered":"2024-08-18T22:20:18.511279+0000","last_clean":"2024-08-18T22:20:18.511279+0000","last_became_active":"2024-08-18T22:20:18.502312+0000","last_became_peered":"2024-08-18T22:20:18.502312+0000","last_unstale":"2024-08-18T22:20:18.511279+0000","last_undegraded":"2024-08-18T22:20:18.511279+0000","last_fullsized":"2024-08-18T22:20:18.511279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:19:25.740187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495705+0000","last_change":"2024-08-18T22:20:18.495705+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495705+0000","last_undegraded":"2024-08-18T22:20:18.495705+0000","last_fullsized":"2024-08-18T22:20:18.495705+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518366+0000","last_change":"2024-08-18T22:20:18.514724+0000","last_active":"2024-08-18T22:20:18.518366+0000","last_peered":"2024-08-18T22:20:18.518366+0000","last_clean":"2024-08-18T22:20:18.518366+0000","last_became_active":"2024-08-18T22:20:18.513465+0000","last_became_peered":"2024-08-18T22:20:18.513465+0000","last_unstale":"2024-08-18T22:20:18.518366+0000","last_undegraded":"2024-08-18T22:20:18.518366+0000","last_fullsized":"2024-08-18T22:20:18.518366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:01.005845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495051+0000","last_change":"2024-08-18T22:20:18.495051+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495051+0000","last_undegraded":"2024-08-18T22:20:18.495051+0000","last_fullsized":"2024-08-18T22:20:18.495051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.514527+0000","last_change":"2024-08-18T22:20:18.508636+0000","last_active":"2024-08-18T22:20:18.514527+0000","last_peered":"2024-08-18T22:20:18.514527+0000","last_clean":"2024-08-18T22:20:18.514527+0000","last_became_active":"2024-08-18T22:20:18.508356+0000","last_became_peered":"2024-08-18T22:20:18.508356+0000","last_unstale":"2024-08-18T22:20:18.514527+0000","last_undegraded":"2024-08-18T22:20:18.514527+0000","last_fullsized":"2024-08-18T22:20:18.514527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:50.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507231+0000","last_change":"2024-08-18T22:20:19.527189+0000","last_active":"2024-08-18T22:20:20.507231+0000","last_peered":"2024-08-18T22:20:20.507231+0000","last_clean":"2024-08-18T22:20:20.507231+0000","last_became_active":"2024-08-18T22:20:19.526929+0000","last_became_peered":"2024-08-18T22:20:19.526929+0000","last_unstale":"2024-08-18T22:20:20.507231+0000","last_undegraded":"2024-08-18T22:20:20.507231+0000","last_fullsized":"2024-08-18T22:20:20.507231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:27.898874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.513335+0000","last_change":"2024-08-18T22:20:18.505405+0000","last_active":"2024-08-18T22:20:18.513335+0000","last_peered":"2024-08-18T22:20:18.513335+0000","last_clean":"2024-08-18T22:20:18.513335+0000","last_became_active":"2024-08-18T22:20:18.505140+0000","last_became_peered":"2024-08-18T22:20:18.505140+0000","last_unstale":"2024-08-18T22:20:18.513335+0000","last_undegraded":"2024-08-18T22:20:18.513335+0000","last_fullsized":"2024-08-18T22:20:18.513335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:24.501896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495135+0000","last_change":"2024-08-18T22:20:18.495135+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495135+0000","last_undegraded":"2024-08-18T22:20:18.495135+0000","last_fullsized":"2024-08-18T22:20:18.495135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511185+0000","last_change":"2024-08-18T22:20:18.506928+0000","last_active":"2024-08-18T22:20:18.511185+0000","last_peered":"2024-08-18T22:20:18.511185+0000","last_clean":"2024-08-18T22:20:18.511185+0000","last_became_active":"2024-08-18T22:20:18.506655+0000","last_became_peered":"2024-08-18T22:20:18.506655+0000","last_unstale":"2024-08-18T22:20:18.511185+0000","last_undegraded":"2024-08-18T22:20:18.511185+0000","last_fullsized":"2024-08-18T22:20:18.511185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:49.429237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.491918+0000","last_change":"2024-08-18T22:20:18.491918+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.491918+0000","last_undegraded":"2024-08-18T22:20:18.491918+0000","last_fullsized":"2024-08-18T22:20:18.491918+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.515266+0000","last_change":"2024-08-18T22:20:18.513595+0000","last_active":"2024-08-18T22:20:18.515266+0000","last_peered":"2024-08-18T22:20:18.515266+0000","last_clean":"2024-08-18T22:20:18.515266+0000","last_became_active":"2024-08-18T22:20:18.513298+0000","last_became_peered":"2024-08-18T22:20:18.513298+0000","last_unstale":"2024-08-18T22:20:18.515266+0000","last_undegraded":"2024-08-18T22:20:18.515266+0000","last_fullsized":"2024-08-18T22:20:18.515266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:03.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499687+0000","last_change":"2024-08-18T22:20:18.499687+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499687+0000","last_undegraded":"2024-08-18T22:20:18.499687+0000","last_fullsized":"2024-08-18T22:20:18.499687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511974+0000","last_change":"2024-08-18T22:20:18.507441+0000","last_active":"2024-08-18T22:20:18.511974+0000","last_peered":"2024-08-18T22:20:18.511974+0000","last_clean":"2024-08-18T22:20:18.511974+0000","last_became_active":"2024-08-18T22:20:18.507129+0000","last_became_peered":"2024-08-18T22:20:18.507129+0000","last_unstale":"2024-08-18T22:20:18.511974+0000","last_undegraded":"2024-08-18T22:20:18.511974+0000","last_fullsized":"2024-08-18T22:20:18.511974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:31.386164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498828+0000","last_change":"2024-08-18T22:20:18.498828+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498828+0000","last_undegraded":"2024-08-18T22:20:18.498828+0000","last_fullsized":"2024-08-18T22:20:18.498828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511125+0000","last_change":"2024-08-18T22:20:18.505545+0000","last_active":"2024-08-18T22:20:18.511125+0000","last_peered":"2024-08-18T22:20:18.511125+0000","last_clean":"2024-08-18T22:20:18.511125+0000","last_became_active":"2024-08-18T22:20:18.505240+0000","last_became_peered":"2024-08-18T22:20:18.505240+0000","last_unstale":"2024-08-18T22:20:18.511125+0000","last_undegraded":"2024-08-18T22:20:18.511125+0000","last_fullsized":"2024-08-18T22:20:18.511125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:50.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492381+0000","last_change":"2024-08-18T22:20:18.492381+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492381+0000","last_undegraded":"2024-08-18T22:20:18.492381+0000","last_fullsized":"2024-08-18T22:20:18.492381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516342+0000","last_change":"2024-08-18T22:20:18.511501+0000","last_active":"2024-08-18T22:20:18.516342+0000","last_peered":"2024-08-18T22:20:18.516342+0000","last_clean":"2024-08-18T22:20:18.516342+0000","last_became_active":"2024-08-18T22:20:18.511239+0000","last_became_peered":"2024-08-18T22:20:18.511239+0000","last_unstale":"2024-08-18T22:20:18.516342+0000","last_undegraded":"2024-08-18T22:20:18.516342+0000","last_fullsized":"2024-08-18T22:20:18.516342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:27:37.314171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.498467+0000","last_change":"2024-08-18T22:20:18.498467+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.498467+0000","last_undegraded":"2024-08-18T22:20:18.498467+0000","last_fullsized":"2024-08-18T22:20:18.498467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507244+0000","last_change":"2024-08-18T22:20:18.510173+0000","last_active":"2024-08-18T22:20:20.507244+0000","last_peered":"2024-08-18T22:20:20.507244+0000","last_clean":"2024-08-18T22:20:20.507244+0000","last_became_active":"2024-08-18T22:20:18.509595+0000","last_became_peered":"2024-08-18T22:20:18.509595+0000","last_unstale":"2024-08-18T22:20:20.507244+0000","last_undegraded":"2024-08-18T22:20:20.507244+0000","last_fullsized":"2024-08-18T22:20:20.507244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:03.733472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507175+0000","last_change":"2024-08-18T22:20:19.509550+0000","last_active":"2024-08-18T22:20:20.507175+0000","last_peered":"2024-08-18T22:20:20.507175+0000","last_clean":"2024-08-18T22:20:20.507175+0000","last_became_active":"2024-08-18T22:20:19.509074+0000","last_became_peered":"2024-08-18T22:20:19.509074+0000","last_unstale":"2024-08-18T22:20:20.507175+0000","last_undegraded":"2024-08-18T22:20:20.507175+0000","last_fullsized":"2024-08-18T22:20:20.507175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:30.801816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.526269+0000","last_change":"2024-08-18T22:20:18.510334+0000","last_active":"2024-08-18T22:20:19.526269+0000","last_peered":"2024-08-18T22:20:19.526269+0000","last_clean":"2024-08-18T22:20:19.526269+0000","last_became_active":"2024-08-18T22:20:18.510061+0000","last_became_peered":"2024-08-18T22:20:18.510061+0000","last_unstale":"2024-08-18T22:20:19.526269+0000","last_undegraded":"2024-08-18T22:20:19.526269+0000","last_fullsized":"2024-08-18T22:20:19.526269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:47:45.552211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.529777+0000","last_change":"2024-08-18T22:20:19.525958+0000","last_active":"2024-08-18T22:20:19.529777+0000","last_peered":"2024-08-18T22:20:19.529777+0000","last_clean":"2024-08-18T22:20:19.529777+0000","last_became_active":"2024-08-18T22:20:19.524979+0000","last_became_peered":"2024-08-18T22:20:19.524979+0000","last_unstale":"2024-08-18T22:20:19.529777+0000","last_undegraded":"2024-08-18T22:20:19.529777+0000","last_fullsized":"2024-08-18T22:20:19.529777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:51.616637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.510536+0000","last_change":"2024-08-18T22:20:18.505895+0000","last_active":"2024-08-18T22:20:18.510536+0000","last_peered":"2024-08-18T22:20:18.510536+0000","last_clean":"2024-08-18T22:20:18.510536+0000","last_became_active":"2024-08-18T22:20:18.505603+0000","last_became_peered":"2024-08-18T22:20:18.505603+0000","last_unstale":"2024-08-18T22:20:18.510536+0000","last_undegraded":"2024-08-18T22:20:18.510536+0000","last_fullsized":"2024-08-18T22:20:18.510536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:13.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493638+0000","last_change":"2024-08-18T22:20:18.493638+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493638+0000","last_undegraded":"2024-08-18T22:20:18.493638+0000","last_fullsized":"2024-08-18T22:20:18.493638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.521128+0000","last_change":"2024-08-18T22:20:18.513238+0000","last_active":"2024-08-18T22:20:19.521128+0000","last_peered":"2024-08-18T22:20:19.521128+0000","last_clean":"2024-08-18T22:20:19.521128+0000","last_became_active":"2024-08-18T22:20:18.512768+0000","last_became_peered":"2024-08-18T22:20:18.512768+0000","last_unstale":"2024-08-18T22:20:19.521128+0000","last_undegraded":"2024-08-18T22:20:19.521128+0000","last_fullsized":"2024-08-18T22:20:19.521128+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:33.762072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495481+0000","last_change":"2024-08-18T22:20:18.495481+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495481+0000","last_undegraded":"2024-08-18T22:20:18.495481+0000","last_fullsized":"2024-08-18T22:20:18.495481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.509691+0000","last_change":"2024-08-18T22:20:18.512744+0000","last_active":"2024-08-18T22:20:19.509691+0000","last_peered":"2024-08-18T22:20:19.509691+0000","last_clean":"2024-08-18T22:20:19.509691+0000","last_became_active":"2024-08-18T22:20:18.512351+0000","last_became_peered":"2024-08-18T22:20:18.512351+0000","last_unstale":"2024-08-18T22:20:19.509691+0000","last_undegraded":"2024-08-18T22:20:19.509691+0000","last_fullsized":"2024-08-18T22:20:19.509691+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:37:13.840163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.504630+0000","last_change":"2024-08-18T22:20:18.504630+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.504630+0000","last_undegraded":"2024-08-18T22:20:18.504630+0000","last_fullsized":"2024-08-18T22:20:18.504630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.515749+0000","last_change":"2024-08-18T22:20:18.510805+0000","last_active":"2024-08-18T22:20:18.515749+0000","last_peered":"2024-08-18T22:20:18.515749+0000","last_clean":"2024-08-18T22:20:18.515749+0000","last_became_active":"2024-08-18T22:20:18.510506+0000","last_became_peered":"2024-08-18T22:20:18.510506+0000","last_unstale":"2024-08-18T22:20:18.515749+0000","last_undegraded":"2024-08-18T22:20:18.515749+0000","last_fullsized":"2024-08-18T22:20:18.515749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:27:37.314171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493377+0000","last_change":"2024-08-18T22:20:18.493377+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493377+0000","last_undegraded":"2024-08-18T22:20:18.493377+0000","last_fullsized":"2024-08-18T22:20:18.493377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.508542+0000","last_change":"2024-08-18T22:20:18.509322+0000","last_active":"2024-08-18T22:20:19.508542+0000","last_peered":"2024-08-18T22:20:19.508542+0000","last_clean":"2024-08-18T22:20:19.508542+0000","last_became_active":"2024-08-18T22:20:18.509032+0000","last_became_peered":"2024-08-18T22:20:18.509032+0000","last_unstale":"2024-08-18T22:20:19.508542+0000","last_undegraded":"2024-08-18T22:20:19.508542+0000","last_fullsized":"2024-08-18T22:20:19.508542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:26:25.888447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492384+0000","last_change":"2024-08-18T22:20:18.492384+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492384+0000","last_undegraded":"2024-08-18T22:20:18.492384+0000","last_fullsized":"2024-08-18T22:20:18.492384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.516322+0000","last_change":"2024-08-18T22:20:18.510784+0000","last_active":"2024-08-18T22:20:18.516322+0000","last_peered":"2024-08-18T22:20:18.516322+0000","last_clean":"2024-08-18T22:20:18.516322+0000","last_became_active":"2024-08-18T22:20:18.510472+0000","last_became_peered":"2024-08-18T22:20:18.510472+0000","last_unstale":"2024-08-18T22:20:18.516322+0000","last_undegraded":"2024-08-18T22:20:18.516322+0000","last_fullsized":"2024-08-18T22:20:18.516322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:16.215376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.493125+0000","last_change":"2024-08-18T22:20:18.493125+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.493125+0000","last_undegraded":"2024-08-18T22:20:18.493125+0000","last_fullsized":"2024-08-18T22:20:18.493125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T22:20:19.511615+0000","last_change":"2024-08-18T22:20:18.515716+0000","last_active":"2024-08-18T22:20:19.511615+0000","last_peered":"2024-08-18T22:20:19.511615+0000","last_clean":"2024-08-18T22:20:19.511615+0000","last_became_active":"2024-08-18T22:20:18.515475+0000","last_became_peered":"2024-08-18T22:20:18.515475+0000","last_unstale":"2024-08-18T22:20:19.511615+0000","last_undegraded":"2024-08-18T22:20:19.511615+0000","last_fullsized":"2024-08-18T22:20:19.511615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:00:01.480754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.495710+0000","last_change":"2024-08-18T22:20:18.495710+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.495710+0000","last_undegraded":"2024-08-18T22:20:18.495710+0000","last_fullsized":"2024-08-18T22:20:18.495710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.512673+0000","last_change":"2024-08-18T22:20:18.511256+0000","last_active":"2024-08-18T22:20:18.512673+0000","last_peered":"2024-08-18T22:20:18.512673+0000","last_clean":"2024-08-18T22:20:18.512673+0000","last_became_active":"2024-08-18T22:20:18.510423+0000","last_became_peered":"2024-08-18T22:20:18.510423+0000","last_unstale":"2024-08-18T22:20:18.512673+0000","last_undegraded":"2024-08-18T22:20:18.512673+0000","last_fullsized":"2024-08-18T22:20:18.512673+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:03.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.494509+0000","last_change":"2024-08-18T22:20:18.494509+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.494509+0000","last_undegraded":"2024-08-18T22:20:18.494509+0000","last_fullsized":"2024-08-18T22:20:18.494509+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.512641+0000","last_change":"2024-08-18T22:20:18.510833+0000","last_active":"2024-08-18T22:20:18.512641+0000","last_peered":"2024-08-18T22:20:18.512641+0000","last_clean":"2024-08-18T22:20:18.512641+0000","last_became_active":"2024-08-18T22:20:18.510510+0000","last_became_peered":"2024-08-18T22:20:18.510510+0000","last_unstale":"2024-08-18T22:20:18.512641+0000","last_undegraded":"2024-08-18T22:20:18.512641+0000","last_fullsized":"2024-08-18T22:20:18.512641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:33.626411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.492553+0000","last_change":"2024-08-18T22:20:18.492553+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.492553+0000","last_undegraded":"2024-08-18T22:20:18.492553+0000","last_fullsized":"2024-08-18T22:20:18.492553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.511290+0000","last_change":"2024-08-18T22:20:18.508896+0000","last_active":"2024-08-18T22:20:18.511290+0000","last_peered":"2024-08-18T22:20:18.511290+0000","last_clean":"2024-08-18T22:20:18.511290+0000","last_became_active":"2024-08-18T22:20:18.508538+0000","last_became_peered":"2024-08-18T22:20:18.508538+0000","last_unstale":"2024-08-18T22:20:18.511290+0000","last_undegraded":"2024-08-18T22:20:18.511290+0000","last_fullsized":"2024-08-18T22:20:18.511290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:06.513442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506321+0000","last_change":"2024-08-18T22:20:19.524685+0000","last_active":"2024-08-18T22:20:20.506321+0000","last_peered":"2024-08-18T22:20:20.506321+0000","last_clean":"2024-08-18T22:20:20.506321+0000","last_became_active":"2024-08-18T22:20:19.524418+0000","last_became_peered":"2024-08-18T22:20:19.524418+0000","last_unstale":"2024-08-18T22:20:20.506321+0000","last_undegraded":"2024-08-18T22:20:20.506321+0000","last_fullsized":"2024-08-18T22:20:20.506321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:53.696643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505510+0000","last_change":"2024-08-18T22:20:18.506063+0000","last_active":"2024-08-18T22:20:20.505510+0000","last_peered":"2024-08-18T22:20:20.505510+0000","last_clean":"2024-08-18T22:20:20.505510+0000","last_became_active":"2024-08-18T22:20:18.505766+0000","last_became_peered":"2024-08-18T22:20:18.505766+0000","last_unstale":"2024-08-18T22:20:20.505510+0000","last_undegraded":"2024-08-18T22:20:20.505510+0000","last_fullsized":"2024-08-18T22:20:20.505510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:58.591575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.499675+0000","last_change":"2024-08-18T22:20:18.499675+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.499675+0000","last_undegraded":"2024-08-18T22:20:18.499675+0000","last_fullsized":"2024-08-18T22:20:18.499675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.507481+0000","last_change":"2024-08-18T22:20:18.501496+0000","last_active":"2024-08-18T22:20:18.507481+0000","last_peered":"2024-08-18T22:20:18.507481+0000","last_clean":"2024-08-18T22:20:18.507481+0000","last_became_active":"2024-08-18T22:20:18.501227+0000","last_became_peered":"2024-08-18T22:20:18.501227+0000","last_unstale":"2024-08-18T22:20:18.507481+0000","last_undegraded":"2024-08-18T22:20:18.507481+0000","last_fullsized":"2024-08-18T22:20:18.507481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:31.328987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-08-18T22:20:18.501385+0000","last_change":"2024-08-18T22:20:18.501385+0000","last_active":"2024-08-18T22:20:18.479407+0000","last_peered":"2024-08-18T22:20:18.479407+0000","last_clean":"2024-08-18T22:20:18.479407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:20:18.501385+0000","last_undegraded":"2024-08-18T22:20:18.501385+0000","last_fullsized":"2024-08-18T22:20:18.501385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.518280+0000","last_change":"2024-08-18T22:20:18.513740+0000","last_active":"2024-08-18T22:20:18.518280+0000","last_peered":"2024-08-18T22:20:18.518280+0000","last_clean":"2024-08-18T22:20:18.518280+0000","last_became_active":"2024-08-18T22:20:18.513369+0000","last_became_peered":"2024-08-18T22:20:18.513369+0000","last_unstale":"2024-08-18T22:20:18.518280+0000","last_undegraded":"2024-08-18T22:20:18.518280+0000","last_fullsized":"2024-08-18T22:20:18.518280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:43.649712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-08-18T22:20:18.497053+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:20:18.497053+0000","last_peered":"2024-08-18T22:20:18.497053+0000","last_clean":"2024-08-18T22:20:18.497053+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:20:18.497053+0000","last_undegraded":"2024-08-18T22:20:18.497053+0000","last_fullsized":"2024-08-18T22:20:18.497053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":768520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":171485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":178152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":178152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":171485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":761853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":185389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:20:28.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:20:28.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.329+0000 7fb732000640 1 Processor -- start 2024-08-18T22:20:28.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb732000640 1 -- start start 2024-08-18T22:20:28.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb732000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c072c10 0x7fb72c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb732000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb72c06f3c0 0x7fb72c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb732000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c0ad820 con 0x7fb72c15ade0 2024-08-18T22:20:28.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb732000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb72c072030 con 0x7fb72c06f3c0 2024-08-18T22:20:28.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb732000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c0ae130 con 0x7fb72c072c10 2024-08-18T22:20:28.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb731600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb72c06f3c0 0x7fb72c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb730c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb72c15ade0 0x7fb72c0ae5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60920/0 (socket says 172.21.15.5:60920) 2024-08-18T22:20:28.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb730c00640 1 -- 172.21.15.5:0/679702802 learned_addr learned my addr 172.21.15.5:0/679702802 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:28.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb72be00640 1 --2- 172.21.15.5:0/679702802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c072c10 0x7fb72c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb731600640 1 -- 172.21.15.5:0/679702802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c072c10 msgr2=0x7fb72c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:28.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb731600640 1 --2- 172.21.15.5:0/679702802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c072c10 0x7fb72c06dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb731600640 1 -- 172.21.15.5:0/679702802 >> v1:172.21.15.5:6789/0 conn(0x7fb72c15ade0 legacy=0x7fb72c0ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb731600640 1 -- 172.21.15.5:0/679702802 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c0731e0 con 0x7fb72c06f3c0 2024-08-18T22:20:28.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb72b400640 1 -- 172.21.15.5:0/679702802 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837478226 0 0) 0x7fb72c0ad820 con 0x7fb72c15ade0 2024-08-18T22:20:28.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.333+0000 7fb72be00640 1 --2- 172.21.15.5:0/679702802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c072c10 0x7fb72c06dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:28.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb731600640 1 --2- 172.21.15.5:0/679702802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c06f3c0 0x7fb72c06f870 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb7240097c0 tx=0x7fb72401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2510160071e946f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb72b400640 1 -- 172.21.15.5:0/679702802 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7240b0070 con 0x7fb72c06f3c0 2024-08-18T22:20:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb72b400640 1 -- 172.21.15.5:0/679702802 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7240ab600 con 0x7fb72c06f3c0 2024-08-18T22:20:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb72b400640 1 -- 172.21.15.5:0/679702802 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7240ab9d0 con 0x7fb72c06f3c0 2024-08-18T22:20:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb732000640 1 -- 172.21.15.5:0/679702802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c06f3c0 msgr2=0x7fb72c06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb732000640 1 --2- 172.21.15.5:0/679702802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c06f3c0 0x7fb72c06f870 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb7240097c0 tx=0x7fb72401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb732000640 1 -- 172.21.15.5:0/679702802 shutdown_connections 2024-08-18T22:20:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb732000640 1 --2- 172.21.15.5:0/679702802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c06f3c0 0x7fb72c06f870 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb732000640 1 --2- 172.21.15.5:0/679702802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c072c10 0x7fb72c06dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb732000640 1 -- 172.21.15.5:0/679702802 >> 172.21.15.5:0/679702802 conn(0x7fb72c0b1b00 msgr2=0x7fb72c0b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb732000640 1 -- 172.21.15.5:0/679702802 shutdown_connections 2024-08-18T22:20:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb732000640 1 -- 172.21.15.5:0/679702802 wait complete. 2024-08-18T22:20:28.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb732000640 1 Processor -- start 2024-08-18T22:20:28.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.337+0000 7fb732000640 1 -- start start 2024-08-18T22:20:28.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb732000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c06f3c0 0x7fb72c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb732000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c072c10 0x7fb72c165260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb732000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c15ade0 0x7fb72c09c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb732000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c0734c0 con 0x7fb72c072c10 2024-08-18T22:20:28.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb732000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c0aecd0 con 0x7fb72c06f3c0 2024-08-18T22:20:28.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb732000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c167d40 con 0x7fb72c15ade0 2024-08-18T22:20:28.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb72be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c072c10 0x7fb72c165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb72be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c072c10 0x7fb72c165260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46116/0 (socket says 172.21.15.5:46116) 2024-08-18T22:20:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb72be00640 1 -- 172.21.15.5:0/361732760 learned_addr learned my addr 172.21.15.5:0/361732760 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb730c00640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c06f3c0 0x7fb72c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb731600640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c15ade0 0x7fb72c09c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb72be00640 1 -- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c15ade0 msgr2=0x7fb72c09c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb72be00640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c15ade0 0x7fb72c09c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb72be00640 1 -- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c06f3c0 msgr2=0x7fb72c1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb72be00640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c06f3c0 0x7fb72c1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb72be00640 1 -- 172.21.15.5:0/361732760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c1636d0 con 0x7fb72c072c10 2024-08-18T22:20:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb731600640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c15ade0 0x7fb72c09c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:28.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb72be00640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c072c10 0x7fb72c165260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb71800e760 tx=0x7fb71800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb728c00640 1 -- 172.21.15.5:0/361732760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718017070 con 0x7fb72c072c10 2024-08-18T22:20:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb728c00640 1 -- 172.21.15.5:0/361732760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71800c8d0 con 0x7fb72c072c10 2024-08-18T22:20:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb728c00640 1 -- 172.21.15.5:0/361732760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71800f040 con 0x7fb72c072c10 2024-08-18T22:20:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb732000640 1 -- 172.21.15.5:0/361732760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c1639b0 con 0x7fb72c072c10 2024-08-18T22:20:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb732000640 1 -- 172.21.15.5:0/361732760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c09d350 con 0x7fb72c072c10 2024-08-18T22:20:28.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.341+0000 7fb732000640 1 -- 172.21.15.5:0/361732760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c06f870 con 0x7fb72c072c10 2024-08-18T22:20:28.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.345+0000 7fb728c00640 1 -- 172.21.15.5:0/361732760 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb71801a070 con 0x7fb72c072c10 2024-08-18T22:20:28.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.345+0000 7fb728c00640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678c0 0x7fb70c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.345+0000 7fb728c00640 1 -- 172.21.15.5:0/361732760 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb718085a30 con 0x7fb72c072c10 2024-08-18T22:20:28.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.345+0000 7fb730c00640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678c0 0x7fb70c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.345+0000 7fb730c00640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678c0 0x7fb70c069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0012f0 tx=0x7fb71c005ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:28.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.349+0000 7fb728c00640 1 -- 172.21.15.5:0/361732760 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb7180563d0 con 0x7fb72c072c10 2024-08-18T22:20:28.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.513+0000 7fb732000640 1 -- 172.21.15.5:0/361732760 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb72c163480 con 0x7fb70c0678c0 2024-08-18T22:20:28.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.517+0000 7fb728c00640 1 -- 172.21.15.5:0/361732760 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251935 (secure 0 0 0) 0x7fb72c163480 con 0x7fb70c0678c0 2024-08-18T22:20:28.524 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:20:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 -- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678c0 msgr2=0x7fb70c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678c0 0x7fb70c069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0012f0 tx=0x7fb71c005ec0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 -- 172.21.15.5:0/361732760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c072c10 msgr2=0x7fb72c165260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c072c10 0x7fb72c165260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb71800e760 tx=0x7fb71800ec20 comp rx=0 tx=0).stop 2024-08-18T22:20:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 -- 172.21.15.5:0/361732760 shutdown_connections 2024-08-18T22:20:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678c0 0x7fb70c069d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c15ade0 0x7fb72c09c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c072c10 0x7fb72c165260 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 --2- 172.21.15.5:0/361732760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c06f3c0 0x7fb72c1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 -- 172.21.15.5:0/361732760 >> 172.21.15.5:0/361732760 conn(0x7fb72c0b1b00 msgr2=0x7fb72c0b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:28.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 -- 172.21.15.5:0/361732760 shutdown_connections 2024-08-18T22:20:28.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.521+0000 7fb732000640 1 -- 172.21.15.5:0/361732760 wait complete. 2024-08-18T22:20:28.544 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-08-18T22:20:27.634196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233368,"kb_used_data":4680,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741352,"statfs":{"total":773094113280,"available":772855144448,"internally_reserved":0,"allocated":4792320,"data_stored":2721644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.144327"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795028+0000","last_change":"2024-08-18T22:20:19.511475+0000","last_active":"2024-08-18T22:20:20.795028+0000","last_peered":"2024-08-18T22:20:20.795028+0000","last_clean":"2024-08-18T22:20:20.795028+0000","last_became_active":"2024-08-18T22:20:19.511158+0000","last_became_peered":"2024-08-18T22:20:19.511158+0000","last_unstale":"2024-08-18T22:20:20.795028+0000","last_undegraded":"2024-08-18T22:20:20.795028+0000","last_fullsized":"2024-08-18T22:20:20.795028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:07.103191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794127+0000","last_change":"2024-08-18T22:20:19.524817+0000","last_active":"2024-08-18T22:20:20.794127+0000","last_peered":"2024-08-18T22:20:20.794127+0000","last_clean":"2024-08-18T22:20:20.794127+0000","last_became_active":"2024-08-18T22:20:19.524363+0000","last_became_peered":"2024-08-18T22:20:19.524363+0000","last_unstale":"2024-08-18T22:20:20.794127+0000","last_undegraded":"2024-08-18T22:20:20.794127+0000","last_fullsized":"2024-08-18T22:20:20.794127+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:50:47.273620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795454+0000","last_change":"2024-08-18T22:20:19.521982+0000","last_active":"2024-08-18T22:20:20.795454+0000","last_peered":"2024-08-18T22:20:20.795454+0000","last_clean":"2024-08-18T22:20:20.795454+0000","last_became_active":"2024-08-18T22:20:19.521730+0000","last_became_peered":"2024-08-18T22:20:19.521730+0000","last_unstale":"2024-08-18T22:20:20.795454+0000","last_undegraded":"2024-08-18T22:20:20.795454+0000","last_fullsized":"2024-08-18T22:20:20.795454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:24.801731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794240+0000","last_change":"2024-08-18T22:20:19.523171+0000","last_active":"2024-08-18T22:20:20.794240+0000","last_peered":"2024-08-18T22:20:20.794240+0000","last_clean":"2024-08-18T22:20:20.794240+0000","last_became_active":"2024-08-18T22:20:19.522915+0000","last_became_peered":"2024-08-18T22:20:19.522915+0000","last_unstale":"2024-08-18T22:20:20.794240+0000","last_undegraded":"2024-08-18T22:20:20.794240+0000","last_fullsized":"2024-08-18T22:20:20.794240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:01.427217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.793883+0000","last_change":"2024-08-18T22:20:19.514150+0000","last_active":"2024-08-18T22:20:20.793883+0000","last_peered":"2024-08-18T22:20:20.793883+0000","last_clean":"2024-08-18T22:20:20.793883+0000","last_became_active":"2024-08-18T22:20:19.513901+0000","last_became_peered":"2024-08-18T22:20:19.513901+0000","last_unstale":"2024-08-18T22:20:20.793883+0000","last_undegraded":"2024-08-18T22:20:20.793883+0000","last_fullsized":"2024-08-18T22:20:20.793883+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:52:06.436565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794590+0000","last_change":"2024-08-18T22:20:19.516173+0000","last_active":"2024-08-18T22:20:20.794590+0000","last_peered":"2024-08-18T22:20:20.794590+0000","last_clean":"2024-08-18T22:20:20.794590+0000","last_became_active":"2024-08-18T22:20:19.515867+0000","last_became_peered":"2024-08-18T22:20:19.515867+0000","last_unstale":"2024-08-18T22:20:20.794590+0000","last_undegraded":"2024-08-18T22:20:20.794590+0000","last_fullsized":"2024-08-18T22:20:20.794590+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:29:32.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.793768+0000","last_change":"2024-08-18T22:20:19.524576+0000","last_active":"2024-08-18T22:20:20.793768+0000","last_peered":"2024-08-18T22:20:20.793768+0000","last_clean":"2024-08-18T22:20:20.793768+0000","last_became_active":"2024-08-18T22:20:19.523682+0000","last_became_peered":"2024-08-18T22:20:19.523682+0000","last_unstale":"2024-08-18T22:20:20.793768+0000","last_undegraded":"2024-08-18T22:20:20.793768+0000","last_fullsized":"2024-08-18T22:20:20.793768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:45:33.363308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794216+0000","last_change":"2024-08-18T22:20:19.519892+0000","last_active":"2024-08-18T22:20:20.794216+0000","last_peered":"2024-08-18T22:20:20.794216+0000","last_clean":"2024-08-18T22:20:20.794216+0000","last_became_active":"2024-08-18T22:20:19.519611+0000","last_became_peered":"2024-08-18T22:20:19.519611+0000","last_unstale":"2024-08-18T22:20:20.794216+0000","last_undegraded":"2024-08-18T22:20:20.794216+0000","last_fullsized":"2024-08-18T22:20:20.794216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:19.433032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795810+0000","last_change":"2024-08-18T22:20:19.523479+0000","last_active":"2024-08-18T22:20:20.795810+0000","last_peered":"2024-08-18T22:20:20.795810+0000","last_clean":"2024-08-18T22:20:20.795810+0000","last_became_active":"2024-08-18T22:20:19.518091+0000","last_became_peered":"2024-08-18T22:20:19.518091+0000","last_unstale":"2024-08-18T22:20:20.795810+0000","last_undegraded":"2024-08-18T22:20:20.795810+0000","last_fullsized":"2024-08-18T22:20:20.795810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:46:02.637926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794312+0000","last_change":"2024-08-18T22:20:19.519179+0000","last_active":"2024-08-18T22:20:20.794312+0000","last_peered":"2024-08-18T22:20:20.794312+0000","last_clean":"2024-08-18T22:20:20.794312+0000","last_became_active":"2024-08-18T22:20:19.518929+0000","last_became_peered":"2024-08-18T22:20:19.518929+0000","last_unstale":"2024-08-18T22:20:20.794312+0000","last_undegraded":"2024-08-18T22:20:20.794312+0000","last_fullsized":"2024-08-18T22:20:20.794312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:06.836563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794250+0000","last_change":"2024-08-18T22:20:19.517566+0000","last_active":"2024-08-18T22:20:20.794250+0000","last_peered":"2024-08-18T22:20:20.794250+0000","last_clean":"2024-08-18T22:20:20.794250+0000","last_became_active":"2024-08-18T22:20:19.517282+0000","last_became_peered":"2024-08-18T22:20:19.517282+0000","last_unstale":"2024-08-18T22:20:20.794250+0000","last_undegraded":"2024-08-18T22:20:20.794250+0000","last_fullsized":"2024-08-18T22:20:20.794250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:19.105126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795251+0000","last_change":"2024-08-18T22:20:19.514399+0000","last_active":"2024-08-18T22:20:20.795251+0000","last_peered":"2024-08-18T22:20:20.795251+0000","last_clean":"2024-08-18T22:20:20.795251+0000","last_became_active":"2024-08-18T22:20:19.514151+0000","last_became_peered":"2024-08-18T22:20:19.514151+0000","last_unstale":"2024-08-18T22:20:20.795251+0000","last_undegraded":"2024-08-18T22:20:20.795251+0000","last_fullsized":"2024-08-18T22:20:20.795251+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:21.901155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.793880+0000","last_change":"2024-08-18T22:20:19.514835+0000","last_active":"2024-08-18T22:20:20.793880+0000","last_peered":"2024-08-18T22:20:20.793880+0000","last_clean":"2024-08-18T22:20:20.793880+0000","last_became_active":"2024-08-18T22:20:19.514564+0000","last_became_peered":"2024-08-18T22:20:19.514564+0000","last_unstale":"2024-08-18T22:20:20.793880+0000","last_undegraded":"2024-08-18T22:20:20.793880+0000","last_fullsized":"2024-08-18T22:20:20.793880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:23.431051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506172+0000","last_change":"2024-08-18T22:20:19.510105+0000","last_active":"2024-08-18T22:20:20.506172+0000","last_peered":"2024-08-18T22:20:20.506172+0000","last_clean":"2024-08-18T22:20:20.506172+0000","last_became_active":"2024-08-18T22:20:19.509851+0000","last_became_peered":"2024-08-18T22:20:19.509851+0000","last_unstale":"2024-08-18T22:20:20.506172+0000","last_undegraded":"2024-08-18T22:20:20.506172+0000","last_fullsized":"2024-08-18T22:20:20.506172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:44.652528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.793963+0000","last_change":"2024-08-18T22:20:19.521772+0000","last_active":"2024-08-18T22:20:20.793963+0000","last_peered":"2024-08-18T22:20:20.793963+0000","last_clean":"2024-08-18T22:20:20.793963+0000","last_became_active":"2024-08-18T22:20:19.518676+0000","last_became_peered":"2024-08-18T22:20:19.518676+0000","last_unstale":"2024-08-18T22:20:20.793963+0000","last_undegraded":"2024-08-18T22:20:20.793963+0000","last_fullsized":"2024-08-18T22:20:20.793963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:50.489891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505277+0000","last_change":"2024-08-18T22:20:19.514243+0000","last_active":"2024-08-18T22:20:20.505277+0000","last_peered":"2024-08-18T22:20:20.505277+0000","last_clean":"2024-08-18T22:20:20.505277+0000","last_became_active":"2024-08-18T22:20:19.513942+0000","last_became_peered":"2024-08-18T22:20:19.513942+0000","last_unstale":"2024-08-18T22:20:20.505277+0000","last_undegraded":"2024-08-18T22:20:20.505277+0000","last_fullsized":"2024-08-18T22:20:20.505277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:16.008438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505172+0000","last_change":"2024-08-18T22:20:19.511521+0000","last_active":"2024-08-18T22:20:20.505172+0000","last_peered":"2024-08-18T22:20:20.505172+0000","last_clean":"2024-08-18T22:20:20.505172+0000","last_became_active":"2024-08-18T22:20:19.511268+0000","last_became_peered":"2024-08-18T22:20:19.511268+0000","last_unstale":"2024-08-18T22:20:20.505172+0000","last_undegraded":"2024-08-18T22:20:20.505172+0000","last_fullsized":"2024-08-18T22:20:20.505172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:40.966355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506903+0000","last_change":"2024-08-18T22:20:19.513244+0000","last_active":"2024-08-18T22:20:20.506903+0000","last_peered":"2024-08-18T22:20:20.506903+0000","last_clean":"2024-08-18T22:20:20.506903+0000","last_became_active":"2024-08-18T22:20:19.512841+0000","last_became_peered":"2024-08-18T22:20:19.512841+0000","last_unstale":"2024-08-18T22:20:20.506903+0000","last_undegraded":"2024-08-18T22:20:20.506903+0000","last_fullsized":"2024-08-18T22:20:20.506903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:29:32.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794107+0000","last_change":"2024-08-18T22:20:19.513201+0000","last_active":"2024-08-18T22:20:20.794107+0000","last_peered":"2024-08-18T22:20:20.794107+0000","last_clean":"2024-08-18T22:20:20.794107+0000","last_became_active":"2024-08-18T22:20:19.512920+0000","last_became_peered":"2024-08-18T22:20:19.512920+0000","last_unstale":"2024-08-18T22:20:20.794107+0000","last_undegraded":"2024-08-18T22:20:20.794107+0000","last_fullsized":"2024-08-18T22:20:20.794107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:29.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506047+0000","last_change":"2024-08-18T22:20:19.514754+0000","last_active":"2024-08-18T22:20:20.506047+0000","last_peered":"2024-08-18T22:20:20.506047+0000","last_clean":"2024-08-18T22:20:20.506047+0000","last_became_active":"2024-08-18T22:20:19.514506+0000","last_became_peered":"2024-08-18T22:20:19.514506+0000","last_unstale":"2024-08-18T22:20:20.506047+0000","last_undegraded":"2024-08-18T22:20:20.506047+0000","last_fullsized":"2024-08-18T22:20:20.506047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:19:26.743762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.793986+0000","last_change":"2024-08-18T22:20:19.513462+0000","last_active":"2024-08-18T22:20:20.793986+0000","last_peered":"2024-08-18T22:20:20.793986+0000","last_clean":"2024-08-18T22:20:20.793986+0000","last_became_active":"2024-08-18T22:20:19.513167+0000","last_became_peered":"2024-08-18T22:20:19.513167+0000","last_unstale":"2024-08-18T22:20:20.793986+0000","last_undegraded":"2024-08-18T22:20:20.793986+0000","last_fullsized":"2024-08-18T22:20:20.793986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:19.433032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506727+0000","last_change":"2024-08-18T22:20:19.517261+0000","last_active":"2024-08-18T22:20:20.506727+0000","last_peered":"2024-08-18T22:20:20.506727+0000","last_clean":"2024-08-18T22:20:20.506727+0000","last_became_active":"2024-08-18T22:20:19.516966+0000","last_became_peered":"2024-08-18T22:20:19.516966+0000","last_unstale":"2024-08-18T22:20:20.506727+0000","last_undegraded":"2024-08-18T22:20:20.506727+0000","last_fullsized":"2024-08-18T22:20:20.506727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:39:08.996900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505814+0000","last_change":"2024-08-18T22:20:19.523189+0000","last_active":"2024-08-18T22:20:20.505814+0000","last_peered":"2024-08-18T22:20:20.505814+0000","last_clean":"2024-08-18T22:20:20.505814+0000","last_became_active":"2024-08-18T22:20:19.522186+0000","last_became_peered":"2024-08-18T22:20:19.522186+0000","last_unstale":"2024-08-18T22:20:20.505814+0000","last_undegraded":"2024-08-18T22:20:20.505814+0000","last_fullsized":"2024-08-18T22:20:20.505814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:34.339332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794314+0000","last_change":"2024-08-18T22:20:19.518451+0000","last_active":"2024-08-18T22:20:20.794314+0000","last_peered":"2024-08-18T22:20:20.794314+0000","last_clean":"2024-08-18T22:20:20.794314+0000","last_became_active":"2024-08-18T22:20:19.517998+0000","last_became_peered":"2024-08-18T22:20:19.517998+0000","last_unstale":"2024-08-18T22:20:20.794314+0000","last_undegraded":"2024-08-18T22:20:20.794314+0000","last_fullsized":"2024-08-18T22:20:20.794314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506407+0000","last_change":"2024-08-18T22:20:19.515936+0000","last_active":"2024-08-18T22:20:20.506407+0000","last_peered":"2024-08-18T22:20:20.506407+0000","last_clean":"2024-08-18T22:20:20.506407+0000","last_became_active":"2024-08-18T22:20:19.510468+0000","last_became_peered":"2024-08-18T22:20:19.510468+0000","last_unstale":"2024-08-18T22:20:20.506407+0000","last_undegraded":"2024-08-18T22:20:20.506407+0000","last_fullsized":"2024-08-18T22:20:20.506407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:25.505471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795530+0000","last_change":"2024-08-18T22:20:19.519795+0000","last_active":"2024-08-18T22:20:20.795530+0000","last_peered":"2024-08-18T22:20:20.795530+0000","last_clean":"2024-08-18T22:20:20.795530+0000","last_became_active":"2024-08-18T22:20:19.519555+0000","last_became_peered":"2024-08-18T22:20:19.519555+0000","last_unstale":"2024-08-18T22:20:20.795530+0000","last_undegraded":"2024-08-18T22:20:20.795530+0000","last_fullsized":"2024-08-18T22:20:20.795530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:21.901155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506576+0000","last_change":"2024-08-18T22:20:19.517453+0000","last_active":"2024-08-18T22:20:20.506576+0000","last_peered":"2024-08-18T22:20:20.506576+0000","last_clean":"2024-08-18T22:20:20.506576+0000","last_became_active":"2024-08-18T22:20:19.517095+0000","last_became_peered":"2024-08-18T22:20:19.517095+0000","last_unstale":"2024-08-18T22:20:20.506576+0000","last_undegraded":"2024-08-18T22:20:20.506576+0000","last_fullsized":"2024-08-18T22:20:20.506576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:50.432812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794078+0000","last_change":"2024-08-18T22:20:19.523390+0000","last_active":"2024-08-18T22:20:20.794078+0000","last_peered":"2024-08-18T22:20:20.794078+0000","last_clean":"2024-08-18T22:20:20.794078+0000","last_became_active":"2024-08-18T22:20:19.523000+0000","last_became_peered":"2024-08-18T22:20:19.523000+0000","last_unstale":"2024-08-18T22:20:20.794078+0000","last_undegraded":"2024-08-18T22:20:20.794078+0000","last_fullsized":"2024-08-18T22:20:20.794078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:48:33.375745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505824+0000","last_change":"2024-08-18T22:20:19.500887+0000","last_active":"2024-08-18T22:20:20.505824+0000","last_peered":"2024-08-18T22:20:20.505824+0000","last_clean":"2024-08-18T22:20:20.505824+0000","last_became_active":"2024-08-18T22:20:19.500567+0000","last_became_peered":"2024-08-18T22:20:19.500567+0000","last_unstale":"2024-08-18T22:20:20.505824+0000","last_undegraded":"2024-08-18T22:20:20.505824+0000","last_fullsized":"2024-08-18T22:20:20.505824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:32.332562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505156+0000","last_change":"2024-08-18T22:20:19.503910+0000","last_active":"2024-08-18T22:20:20.505156+0000","last_peered":"2024-08-18T22:20:20.505156+0000","last_clean":"2024-08-18T22:20:20.505156+0000","last_became_active":"2024-08-18T22:20:19.503590+0000","last_became_peered":"2024-08-18T22:20:19.503590+0000","last_unstale":"2024-08-18T22:20:20.505156+0000","last_undegraded":"2024-08-18T22:20:20.505156+0000","last_fullsized":"2024-08-18T22:20:20.505156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:24.826294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505976+0000","last_change":"2024-08-18T22:20:19.522212+0000","last_active":"2024-08-18T22:20:20.505976+0000","last_peered":"2024-08-18T22:20:20.505976+0000","last_clean":"2024-08-18T22:20:20.505976+0000","last_became_active":"2024-08-18T22:20:19.520504+0000","last_became_peered":"2024-08-18T22:20:19.520504+0000","last_unstale":"2024-08-18T22:20:20.505976+0000","last_undegraded":"2024-08-18T22:20:20.505976+0000","last_fullsized":"2024-08-18T22:20:20.505976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:19.433032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794371+0000","last_change":"2024-08-18T22:20:19.512632+0000","last_active":"2024-08-18T22:20:20.794371+0000","last_peered":"2024-08-18T22:20:20.794371+0000","last_clean":"2024-08-18T22:20:20.794371+0000","last_became_active":"2024-08-18T22:20:19.511681+0000","last_became_peered":"2024-08-18T22:20:19.511681+0000","last_unstale":"2024-08-18T22:20:20.794371+0000","last_undegraded":"2024-08-18T22:20:20.794371+0000","last_fullsized":"2024-08-18T22:20:20.794371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:50.432812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505304+0000","last_change":"2024-08-18T22:20:19.519282+0000","last_active":"2024-08-18T22:20:20.505304+0000","last_peered":"2024-08-18T22:20:20.505304+0000","last_clean":"2024-08-18T22:20:20.505304+0000","last_became_active":"2024-08-18T22:20:19.518981+0000","last_became_peered":"2024-08-18T22:20:19.518981+0000","last_unstale":"2024-08-18T22:20:20.505304+0000","last_undegraded":"2024-08-18T22:20:20.505304+0000","last_fullsized":"2024-08-18T22:20:20.505304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:28:45.301701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506520+0000","last_change":"2024-08-18T22:20:18.507055+0000","last_active":"2024-08-18T22:20:20.506520+0000","last_peered":"2024-08-18T22:20:20.506520+0000","last_clean":"2024-08-18T22:20:20.506520+0000","last_became_active":"2024-08-18T22:20:18.506703+0000","last_became_peered":"2024-08-18T22:20:18.506703+0000","last_unstale":"2024-08-18T22:20:20.506520+0000","last_undegraded":"2024-08-18T22:20:20.506520+0000","last_fullsized":"2024-08-18T22:20:20.506520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:03.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795604+0000","last_change":"2024-08-18T22:20:19.514782+0000","last_active":"2024-08-18T22:20:20.795604+0000","last_peered":"2024-08-18T22:20:20.795604+0000","last_clean":"2024-08-18T22:20:20.795604+0000","last_became_active":"2024-08-18T22:20:19.514356+0000","last_became_peered":"2024-08-18T22:20:19.514356+0000","last_unstale":"2024-08-18T22:20:20.795604+0000","last_undegraded":"2024-08-18T22:20:20.795604+0000","last_fullsized":"2024-08-18T22:20:20.795604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:30:13.809548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795579+0000","last_change":"2024-08-18T22:20:18.506164+0000","last_active":"2024-08-18T22:20:20.795579+0000","last_peered":"2024-08-18T22:20:20.795579+0000","last_clean":"2024-08-18T22:20:20.795579+0000","last_became_active":"2024-08-18T22:20:18.505859+0000","last_became_peered":"2024-08-18T22:20:18.505859+0000","last_unstale":"2024-08-18T22:20:20.795579+0000","last_undegraded":"2024-08-18T22:20:20.795579+0000","last_fullsized":"2024-08-18T22:20:20.795579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:16.215376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507281+0000","last_change":"2024-08-18T22:20:19.511725+0000","last_active":"2024-08-18T22:20:20.507281+0000","last_peered":"2024-08-18T22:20:20.507281+0000","last_clean":"2024-08-18T22:20:20.507281+0000","last_became_active":"2024-08-18T22:20:19.509416+0000","last_became_peered":"2024-08-18T22:20:19.509416+0000","last_unstale":"2024-08-18T22:20:20.507281+0000","last_undegraded":"2024-08-18T22:20:20.507281+0000","last_fullsized":"2024-08-18T22:20:20.507281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:46.028258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795635+0000","last_change":"2024-08-18T22:20:18.505900+0000","last_active":"2024-08-18T22:20:20.795635+0000","last_peered":"2024-08-18T22:20:20.795635+0000","last_clean":"2024-08-18T22:20:20.795635+0000","last_became_active":"2024-08-18T22:20:18.505628+0000","last_became_peered":"2024-08-18T22:20:18.505628+0000","last_unstale":"2024-08-18T22:20:20.795635+0000","last_undegraded":"2024-08-18T22:20:20.795635+0000","last_fullsized":"2024-08-18T22:20:20.795635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:27:37.314171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794891+0000","last_change":"2024-08-18T22:20:19.519998+0000","last_active":"2024-08-18T22:20:20.794891+0000","last_peered":"2024-08-18T22:20:20.794891+0000","last_clean":"2024-08-18T22:20:20.794891+0000","last_became_active":"2024-08-18T22:20:19.519709+0000","last_became_peered":"2024-08-18T22:20:19.519709+0000","last_unstale":"2024-08-18T22:20:20.794891+0000","last_undegraded":"2024-08-18T22:20:20.794891+0000","last_fullsized":"2024-08-18T22:20:20.794891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:17.844670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506625+0000","last_change":"2024-08-18T22:20:18.506470+0000","last_active":"2024-08-18T22:20:20.506625+0000","last_peered":"2024-08-18T22:20:20.506625+0000","last_clean":"2024-08-18T22:20:20.506625+0000","last_became_active":"2024-08-18T22:20:18.505750+0000","last_became_peered":"2024-08-18T22:20:18.505750+0000","last_unstale":"2024-08-18T22:20:20.506625+0000","last_undegraded":"2024-08-18T22:20:20.506625+0000","last_fullsized":"2024-08-18T22:20:20.506625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:28.594042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.793933+0000","last_change":"2024-08-18T22:20:19.503715+0000","last_active":"2024-08-18T22:20:20.793933+0000","last_peered":"2024-08-18T22:20:20.793933+0000","last_clean":"2024-08-18T22:20:20.793933+0000","last_became_active":"2024-08-18T22:20:19.503427+0000","last_became_peered":"2024-08-18T22:20:19.503427+0000","last_unstale":"2024-08-18T22:20:20.793933+0000","last_undegraded":"2024-08-18T22:20:20.793933+0000","last_fullsized":"2024-08-18T22:20:20.793933+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:29:32.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794040+0000","last_change":"2024-08-18T22:20:18.513803+0000","last_active":"2024-08-18T22:20:20.794040+0000","last_peered":"2024-08-18T22:20:20.794040+0000","last_clean":"2024-08-18T22:20:20.794040+0000","last_became_active":"2024-08-18T22:20:18.513118+0000","last_became_peered":"2024-08-18T22:20:18.513118+0000","last_unstale":"2024-08-18T22:20:20.794040+0000","last_undegraded":"2024-08-18T22:20:20.794040+0000","last_fullsized":"2024-08-18T22:20:20.794040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:31.328987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.793979+0000","last_change":"2024-08-18T22:20:19.512290+0000","last_active":"2024-08-18T22:20:20.793979+0000","last_peered":"2024-08-18T22:20:20.793979+0000","last_clean":"2024-08-18T22:20:20.793979+0000","last_became_active":"2024-08-18T22:20:19.511970+0000","last_became_peered":"2024-08-18T22:20:19.511970+0000","last_unstale":"2024-08-18T22:20:20.793979+0000","last_undegraded":"2024-08-18T22:20:20.793979+0000","last_fullsized":"2024-08-18T22:20:20.793979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:50:47.273620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506636+0000","last_change":"2024-08-18T22:20:18.507975+0000","last_active":"2024-08-18T22:20:20.506636+0000","last_peered":"2024-08-18T22:20:20.506636+0000","last_clean":"2024-08-18T22:20:20.506636+0000","last_became_active":"2024-08-18T22:20:18.507730+0000","last_became_peered":"2024-08-18T22:20:18.507730+0000","last_unstale":"2024-08-18T22:20:20.506636+0000","last_undegraded":"2024-08-18T22:20:20.506636+0000","last_fullsized":"2024-08-18T22:20:20.506636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:19:25.740187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506523+0000","last_change":"2024-08-18T22:20:19.512493+0000","last_active":"2024-08-18T22:20:20.506523+0000","last_peered":"2024-08-18T22:20:20.506523+0000","last_clean":"2024-08-18T22:20:20.506523+0000","last_became_active":"2024-08-18T22:20:19.512176+0000","last_became_peered":"2024-08-18T22:20:19.512176+0000","last_unstale":"2024-08-18T22:20:20.506523+0000","last_undegraded":"2024-08-18T22:20:20.506523+0000","last_fullsized":"2024-08-18T22:20:20.506523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:50.110322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794799+0000","last_change":"2024-08-18T22:20:18.514200+0000","last_active":"2024-08-18T22:20:20.794799+0000","last_peered":"2024-08-18T22:20:20.794799+0000","last_clean":"2024-08-18T22:20:20.794799+0000","last_became_active":"2024-08-18T22:20:18.513674+0000","last_became_peered":"2024-08-18T22:20:18.513674+0000","last_unstale":"2024-08-18T22:20:20.794799+0000","last_undegraded":"2024-08-18T22:20:20.794799+0000","last_fullsized":"2024-08-18T22:20:20.794799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:14.250813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794571+0000","last_change":"2024-08-18T22:20:19.520930+0000","last_active":"2024-08-18T22:20:20.794571+0000","last_peered":"2024-08-18T22:20:20.794571+0000","last_clean":"2024-08-18T22:20:20.794571+0000","last_became_active":"2024-08-18T22:20:19.520338+0000","last_became_peered":"2024-08-18T22:20:19.520338+0000","last_unstale":"2024-08-18T22:20:20.794571+0000","last_undegraded":"2024-08-18T22:20:20.794571+0000","last_fullsized":"2024-08-18T22:20:20.794571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:19.105126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505383+0000","last_change":"2024-08-18T22:20:18.509839+0000","last_active":"2024-08-18T22:20:20.505383+0000","last_peered":"2024-08-18T22:20:20.505383+0000","last_clean":"2024-08-18T22:20:20.505383+0000","last_became_active":"2024-08-18T22:20:18.509566+0000","last_became_peered":"2024-08-18T22:20:18.509566+0000","last_unstale":"2024-08-18T22:20:20.505383+0000","last_undegraded":"2024-08-18T22:20:20.505383+0000","last_fullsized":"2024-08-18T22:20:20.505383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:52:05.432990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794692+0000","last_change":"2024-08-18T22:20:19.527869+0000","last_active":"2024-08-18T22:20:20.794692+0000","last_peered":"2024-08-18T22:20:20.794692+0000","last_clean":"2024-08-18T22:20:20.794692+0000","last_became_active":"2024-08-18T22:20:19.527597+0000","last_became_peered":"2024-08-18T22:20:19.527597+0000","last_unstale":"2024-08-18T22:20:20.794692+0000","last_undegraded":"2024-08-18T22:20:20.794692+0000","last_fullsized":"2024-08-18T22:20:20.794692+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:33:53.182118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795116+0000","last_change":"2024-08-18T22:20:18.504598+0000","last_active":"2024-08-18T22:20:20.795116+0000","last_peered":"2024-08-18T22:20:20.795116+0000","last_clean":"2024-08-18T22:20:20.795116+0000","last_became_active":"2024-08-18T22:20:18.502312+0000","last_became_peered":"2024-08-18T22:20:18.502312+0000","last_unstale":"2024-08-18T22:20:20.795116+0000","last_undegraded":"2024-08-18T22:20:20.795116+0000","last_fullsized":"2024-08-18T22:20:20.795116+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:29:31.717815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505743+0000","last_change":"2024-08-18T22:20:19.513487+0000","last_active":"2024-08-18T22:20:20.505743+0000","last_peered":"2024-08-18T22:20:20.505743+0000","last_clean":"2024-08-18T22:20:20.505743+0000","last_became_active":"2024-08-18T22:20:19.509674+0000","last_became_peered":"2024-08-18T22:20:19.509674+0000","last_unstale":"2024-08-18T22:20:20.505743+0000","last_undegraded":"2024-08-18T22:20:20.505743+0000","last_fullsized":"2024-08-18T22:20:20.505743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:01:23.431051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794463+0000","last_change":"2024-08-18T22:20:18.514724+0000","last_active":"2024-08-18T22:20:20.794463+0000","last_peered":"2024-08-18T22:20:20.794463+0000","last_clean":"2024-08-18T22:20:20.794463+0000","last_became_active":"2024-08-18T22:20:18.513465+0000","last_became_peered":"2024-08-18T22:20:18.513465+0000","last_unstale":"2024-08-18T22:20:20.794463+0000","last_undegraded":"2024-08-18T22:20:20.794463+0000","last_fullsized":"2024-08-18T22:20:20.794463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:49.429237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795799+0000","last_change":"2024-08-18T22:20:19.508092+0000","last_active":"2024-08-18T22:20:20.795799+0000","last_peered":"2024-08-18T22:20:20.795799+0000","last_clean":"2024-08-18T22:20:20.795799+0000","last_became_active":"2024-08-18T22:20:19.507580+0000","last_became_peered":"2024-08-18T22:20:19.507580+0000","last_unstale":"2024-08-18T22:20:20.795799+0000","last_undegraded":"2024-08-18T22:20:20.795799+0000","last_fullsized":"2024-08-18T22:20:20.795799+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:58.682042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794386+0000","last_change":"2024-08-18T22:20:18.508636+0000","last_active":"2024-08-18T22:20:20.794386+0000","last_peered":"2024-08-18T22:20:20.794386+0000","last_clean":"2024-08-18T22:20:20.794386+0000","last_became_active":"2024-08-18T22:20:18.508356+0000","last_became_peered":"2024-08-18T22:20:18.508356+0000","last_unstale":"2024-08-18T22:20:20.794386+0000","last_undegraded":"2024-08-18T22:20:20.794386+0000","last_fullsized":"2024-08-18T22:20:20.794386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:29:31.717815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507231+0000","last_change":"2024-08-18T22:20:19.527189+0000","last_active":"2024-08-18T22:20:20.507231+0000","last_peered":"2024-08-18T22:20:20.507231+0000","last_clean":"2024-08-18T22:20:20.507231+0000","last_became_active":"2024-08-18T22:20:19.526929+0000","last_became_peered":"2024-08-18T22:20:19.526929+0000","last_unstale":"2024-08-18T22:20:20.507231+0000","last_undegraded":"2024-08-18T22:20:20.507231+0000","last_fullsized":"2024-08-18T22:20:20.507231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:09:27.898874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795148+0000","last_change":"2024-08-18T22:20:18.505405+0000","last_active":"2024-08-18T22:20:20.795148+0000","last_peered":"2024-08-18T22:20:20.795148+0000","last_clean":"2024-08-18T22:20:20.795148+0000","last_became_active":"2024-08-18T22:20:18.505140+0000","last_became_peered":"2024-08-18T22:20:18.505140+0000","last_unstale":"2024-08-18T22:20:20.795148+0000","last_undegraded":"2024-08-18T22:20:20.795148+0000","last_fullsized":"2024-08-18T22:20:20.795148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:50:15.286491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794257+0000","last_change":"2024-08-18T22:20:19.513070+0000","last_active":"2024-08-18T22:20:20.794257+0000","last_peered":"2024-08-18T22:20:20.794257+0000","last_clean":"2024-08-18T22:20:20.794257+0000","last_became_active":"2024-08-18T22:20:19.512756+0000","last_became_peered":"2024-08-18T22:20:19.512756+0000","last_unstale":"2024-08-18T22:20:20.794257+0000","last_undegraded":"2024-08-18T22:20:20.794257+0000","last_fullsized":"2024-08-18T22:20:20.794257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:50:16.290066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794978+0000","last_change":"2024-08-18T22:20:18.506928+0000","last_active":"2024-08-18T22:20:20.794978+0000","last_peered":"2024-08-18T22:20:20.794978+0000","last_clean":"2024-08-18T22:20:20.794978+0000","last_became_active":"2024-08-18T22:20:18.506655+0000","last_became_peered":"2024-08-18T22:20:18.506655+0000","last_unstale":"2024-08-18T22:20:20.794978+0000","last_undegraded":"2024-08-18T22:20:20.794978+0000","last_fullsized":"2024-08-18T22:20:20.794978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:34:19.479820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794571+0000","last_change":"2024-08-18T22:20:19.519945+0000","last_active":"2024-08-18T22:20:20.794571+0000","last_peered":"2024-08-18T22:20:20.794571+0000","last_clean":"2024-08-18T22:20:20.794571+0000","last_became_active":"2024-08-18T22:20:19.519633+0000","last_became_peered":"2024-08-18T22:20:19.519633+0000","last_unstale":"2024-08-18T22:20:20.794571+0000","last_undegraded":"2024-08-18T22:20:20.794571+0000","last_fullsized":"2024-08-18T22:20:20.794571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:48:33.375745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795250+0000","last_change":"2024-08-18T22:20:18.513595+0000","last_active":"2024-08-18T22:20:20.795250+0000","last_peered":"2024-08-18T22:20:20.795250+0000","last_clean":"2024-08-18T22:20:20.795250+0000","last_became_active":"2024-08-18T22:20:18.513298+0000","last_became_peered":"2024-08-18T22:20:18.513298+0000","last_unstale":"2024-08-18T22:20:20.795250+0000","last_undegraded":"2024-08-18T22:20:20.795250+0000","last_fullsized":"2024-08-18T22:20:20.795250+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:16.215376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506608+0000","last_change":"2024-08-18T22:20:19.521158+0000","last_active":"2024-08-18T22:20:20.506608+0000","last_peered":"2024-08-18T22:20:20.506608+0000","last_clean":"2024-08-18T22:20:20.506608+0000","last_became_active":"2024-08-18T22:20:19.520879+0000","last_became_peered":"2024-08-18T22:20:19.520879+0000","last_unstale":"2024-08-18T22:20:20.506608+0000","last_undegraded":"2024-08-18T22:20:20.506608+0000","last_fullsized":"2024-08-18T22:20:20.506608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:48:33.375745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505054+0000","last_change":"2024-08-18T22:20:18.507441+0000","last_active":"2024-08-18T22:20:20.505054+0000","last_peered":"2024-08-18T22:20:20.505054+0000","last_clean":"2024-08-18T22:20:20.505054+0000","last_became_active":"2024-08-18T22:20:18.507129+0000","last_became_peered":"2024-08-18T22:20:18.507129+0000","last_unstale":"2024-08-18T22:20:20.505054+0000","last_undegraded":"2024-08-18T22:20:20.505054+0000","last_fullsized":"2024-08-18T22:20:20.505054+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:13.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794743+0000","last_change":"2024-08-18T22:20:19.521142+0000","last_active":"2024-08-18T22:20:20.794743+0000","last_peered":"2024-08-18T22:20:20.794743+0000","last_clean":"2024-08-18T22:20:20.794743+0000","last_became_active":"2024-08-18T22:20:19.520676+0000","last_became_peered":"2024-08-18T22:20:19.520676+0000","last_unstale":"2024-08-18T22:20:20.794743+0000","last_undegraded":"2024-08-18T22:20:20.794743+0000","last_fullsized":"2024-08-18T22:20:20.794743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:47.264852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505381+0000","last_change":"2024-08-18T22:20:18.505545+0000","last_active":"2024-08-18T22:20:20.505381+0000","last_peered":"2024-08-18T22:20:20.505381+0000","last_clean":"2024-08-18T22:20:20.505381+0000","last_became_active":"2024-08-18T22:20:18.505240+0000","last_became_peered":"2024-08-18T22:20:18.505240+0000","last_unstale":"2024-08-18T22:20:20.505381+0000","last_undegraded":"2024-08-18T22:20:20.505381+0000","last_fullsized":"2024-08-18T22:20:20.505381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:01.005845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795145+0000","last_change":"2024-08-18T22:20:19.512600+0000","last_active":"2024-08-18T22:20:20.795145+0000","last_peered":"2024-08-18T22:20:20.795145+0000","last_clean":"2024-08-18T22:20:20.795145+0000","last_became_active":"2024-08-18T22:20:19.512347+0000","last_became_peered":"2024-08-18T22:20:19.512347+0000","last_unstale":"2024-08-18T22:20:20.795145+0000","last_undegraded":"2024-08-18T22:20:20.795145+0000","last_fullsized":"2024-08-18T22:20:20.795145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:28:33.010443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794400+0000","last_change":"2024-08-18T22:20:18.511501+0000","last_active":"2024-08-18T22:20:20.794400+0000","last_peered":"2024-08-18T22:20:20.794400+0000","last_clean":"2024-08-18T22:20:20.794400+0000","last_became_active":"2024-08-18T22:20:18.511239+0000","last_became_peered":"2024-08-18T22:20:18.511239+0000","last_unstale":"2024-08-18T22:20:20.794400+0000","last_undegraded":"2024-08-18T22:20:20.794400+0000","last_fullsized":"2024-08-18T22:20:20.794400+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:19:25.740187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794293+0000","last_change":"2024-08-18T22:20:19.515966+0000","last_active":"2024-08-18T22:20:20.794293+0000","last_peered":"2024-08-18T22:20:20.794293+0000","last_clean":"2024-08-18T22:20:20.794293+0000","last_became_active":"2024-08-18T22:20:19.515465+0000","last_became_peered":"2024-08-18T22:20:19.515465+0000","last_unstale":"2024-08-18T22:20:20.794293+0000","last_undegraded":"2024-08-18T22:20:20.794293+0000","last_fullsized":"2024-08-18T22:20:20.794293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:47.264852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507244+0000","last_change":"2024-08-18T22:20:18.510173+0000","last_active":"2024-08-18T22:20:20.507244+0000","last_peered":"2024-08-18T22:20:20.507244+0000","last_clean":"2024-08-18T22:20:20.507244+0000","last_became_active":"2024-08-18T22:20:18.509595+0000","last_became_peered":"2024-08-18T22:20:18.509595+0000","last_unstale":"2024-08-18T22:20:20.507244+0000","last_undegraded":"2024-08-18T22:20:20.507244+0000","last_fullsized":"2024-08-18T22:20:20.507244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:03.733472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.507175+0000","last_change":"2024-08-18T22:20:19.509550+0000","last_active":"2024-08-18T22:20:20.507175+0000","last_peered":"2024-08-18T22:20:20.507175+0000","last_clean":"2024-08-18T22:20:20.507175+0000","last_became_active":"2024-08-18T22:20:19.509074+0000","last_became_peered":"2024-08-18T22:20:19.509074+0000","last_unstale":"2024-08-18T22:20:20.507175+0000","last_undegraded":"2024-08-18T22:20:20.507175+0000","last_fullsized":"2024-08-18T22:20:20.507175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:08:30.801816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794198+0000","last_change":"2024-08-18T22:20:18.510334+0000","last_active":"2024-08-18T22:20:20.794198+0000","last_peered":"2024-08-18T22:20:20.794198+0000","last_clean":"2024-08-18T22:20:20.794198+0000","last_became_active":"2024-08-18T22:20:18.510061+0000","last_became_peered":"2024-08-18T22:20:18.510061+0000","last_unstale":"2024-08-18T22:20:20.794198+0000","last_undegraded":"2024-08-18T22:20:20.794198+0000","last_fullsized":"2024-08-18T22:20:20.794198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:47:45.552211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794497+0000","last_change":"2024-08-18T22:20:19.525958+0000","last_active":"2024-08-18T22:20:20.794497+0000","last_peered":"2024-08-18T22:20:20.794497+0000","last_clean":"2024-08-18T22:20:20.794497+0000","last_became_active":"2024-08-18T22:20:19.524979+0000","last_became_peered":"2024-08-18T22:20:19.524979+0000","last_unstale":"2024-08-18T22:20:20.794497+0000","last_undegraded":"2024-08-18T22:20:20.794497+0000","last_fullsized":"2024-08-18T22:20:20.794497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:43:59.030240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795094+0000","last_change":"2024-08-18T22:20:18.505895+0000","last_active":"2024-08-18T22:20:20.795094+0000","last_peered":"2024-08-18T22:20:20.795094+0000","last_clean":"2024-08-18T22:20:20.795094+0000","last_became_active":"2024-08-18T22:20:18.505603+0000","last_became_peered":"2024-08-18T22:20:18.505603+0000","last_unstale":"2024-08-18T22:20:20.795094+0000","last_undegraded":"2024-08-18T22:20:20.795094+0000","last_fullsized":"2024-08-18T22:20:20.795094+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:50.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505550+0000","last_change":"2024-08-18T22:20:19.514867+0000","last_active":"2024-08-18T22:20:20.505550+0000","last_peered":"2024-08-18T22:20:20.505550+0000","last_clean":"2024-08-18T22:20:20.505550+0000","last_became_active":"2024-08-18T22:20:19.514595+0000","last_became_peered":"2024-08-18T22:20:19.514595+0000","last_unstale":"2024-08-18T22:20:20.505550+0000","last_undegraded":"2024-08-18T22:20:20.505550+0000","last_fullsized":"2024-08-18T22:20:20.505550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:45:33.363308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.793987+0000","last_change":"2024-08-18T22:20:18.513238+0000","last_active":"2024-08-18T22:20:20.793987+0000","last_peered":"2024-08-18T22:20:20.793987+0000","last_clean":"2024-08-18T22:20:20.793987+0000","last_became_active":"2024-08-18T22:20:18.512768+0000","last_became_peered":"2024-08-18T22:20:18.512768+0000","last_unstale":"2024-08-18T22:20:20.793987+0000","last_undegraded":"2024-08-18T22:20:20.793987+0000","last_fullsized":"2024-08-18T22:20:20.793987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:33.762072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795417+0000","last_change":"2024-08-18T22:20:19.508200+0000","last_active":"2024-08-18T22:20:20.795417+0000","last_peered":"2024-08-18T22:20:20.795417+0000","last_clean":"2024-08-18T22:20:20.795417+0000","last_became_active":"2024-08-18T22:20:19.507969+0000","last_became_peered":"2024-08-18T22:20:19.507969+0000","last_unstale":"2024-08-18T22:20:20.795417+0000","last_undegraded":"2024-08-18T22:20:20.795417+0000","last_fullsized":"2024-08-18T22:20:20.795417+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:30:13.809548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794585+0000","last_change":"2024-08-18T22:20:18.512744+0000","last_active":"2024-08-18T22:20:20.794585+0000","last_peered":"2024-08-18T22:20:20.794585+0000","last_clean":"2024-08-18T22:20:20.794585+0000","last_became_active":"2024-08-18T22:20:18.512351+0000","last_became_peered":"2024-08-18T22:20:18.512351+0000","last_unstale":"2024-08-18T22:20:20.794585+0000","last_undegraded":"2024-08-18T22:20:20.794585+0000","last_fullsized":"2024-08-18T22:20:20.794585+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:37:13.840163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.793914+0000","last_change":"2024-08-18T22:20:19.512625+0000","last_active":"2024-08-18T22:20:20.793914+0000","last_peered":"2024-08-18T22:20:20.793914+0000","last_clean":"2024-08-18T22:20:20.793914+0000","last_became_active":"2024-08-18T22:20:19.512361+0000","last_became_peered":"2024-08-18T22:20:19.512361+0000","last_unstale":"2024-08-18T22:20:20.793914+0000","last_undegraded":"2024-08-18T22:20:20.793914+0000","last_fullsized":"2024-08-18T22:20:20.793914+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:34.339332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506065+0000","last_change":"2024-08-18T22:20:18.510805+0000","last_active":"2024-08-18T22:20:20.506065+0000","last_peered":"2024-08-18T22:20:20.506065+0000","last_clean":"2024-08-18T22:20:20.506065+0000","last_became_active":"2024-08-18T22:20:18.510506+0000","last_became_peered":"2024-08-18T22:20:18.510506+0000","last_unstale":"2024-08-18T22:20:20.506065+0000","last_undegraded":"2024-08-18T22:20:20.506065+0000","last_fullsized":"2024-08-18T22:20:20.506065+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:31.328987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794882+0000","last_change":"2024-08-18T22:20:19.516302+0000","last_active":"2024-08-18T22:20:20.794882+0000","last_peered":"2024-08-18T22:20:20.794882+0000","last_clean":"2024-08-18T22:20:20.794882+0000","last_became_active":"2024-08-18T22:20:19.506838+0000","last_became_peered":"2024-08-18T22:20:19.506838+0000","last_unstale":"2024-08-18T22:20:20.794882+0000","last_undegraded":"2024-08-18T22:20:20.794882+0000","last_fullsized":"2024-08-18T22:20:20.794882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:45:06.836563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794418+0000","last_change":"2024-08-18T22:20:18.509322+0000","last_active":"2024-08-18T22:20:20.794418+0000","last_peered":"2024-08-18T22:20:20.794418+0000","last_clean":"2024-08-18T22:20:20.794418+0000","last_became_active":"2024-08-18T22:20:18.509032+0000","last_became_peered":"2024-08-18T22:20:18.509032+0000","last_unstale":"2024-08-18T22:20:20.794418+0000","last_undegraded":"2024-08-18T22:20:20.794418+0000","last_fullsized":"2024-08-18T22:20:20.794418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:26:25.888447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795235+0000","last_change":"2024-08-18T22:20:19.513545+0000","last_active":"2024-08-18T22:20:20.795235+0000","last_peered":"2024-08-18T22:20:20.795235+0000","last_clean":"2024-08-18T22:20:20.795235+0000","last_became_active":"2024-08-18T22:20:19.513250+0000","last_became_peered":"2024-08-18T22:20:19.513250+0000","last_unstale":"2024-08-18T22:20:20.795235+0000","last_undegraded":"2024-08-18T22:20:20.795235+0000","last_fullsized":"2024-08-18T22:20:20.795235+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:34:20.483395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794501+0000","last_change":"2024-08-18T22:20:18.510784+0000","last_active":"2024-08-18T22:20:20.794501+0000","last_peered":"2024-08-18T22:20:20.794501+0000","last_clean":"2024-08-18T22:20:20.794501+0000","last_became_active":"2024-08-18T22:20:18.510472+0000","last_became_peered":"2024-08-18T22:20:18.510472+0000","last_unstale":"2024-08-18T22:20:20.794501+0000","last_undegraded":"2024-08-18T22:20:20.794501+0000","last_fullsized":"2024-08-18T22:20:20.794501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:24.501896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505920+0000","last_change":"2024-08-18T22:20:19.507698+0000","last_active":"2024-08-18T22:20:20.505920+0000","last_peered":"2024-08-18T22:20:20.505920+0000","last_clean":"2024-08-18T22:20:20.505920+0000","last_became_active":"2024-08-18T22:20:19.507426+0000","last_became_peered":"2024-08-18T22:20:19.507426+0000","last_unstale":"2024-08-18T22:20:20.505920+0000","last_undegraded":"2024-08-18T22:20:20.505920+0000","last_fullsized":"2024-08-18T22:20:20.505920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:50:47.273620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794368+0000","last_change":"2024-08-18T22:20:18.515716+0000","last_active":"2024-08-18T22:20:20.794368+0000","last_peered":"2024-08-18T22:20:20.794368+0000","last_clean":"2024-08-18T22:20:20.794368+0000","last_became_active":"2024-08-18T22:20:18.515475+0000","last_became_peered":"2024-08-18T22:20:18.515475+0000","last_unstale":"2024-08-18T22:20:20.794368+0000","last_undegraded":"2024-08-18T22:20:20.794368+0000","last_fullsized":"2024-08-18T22:20:20.794368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:00:01.480754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794273+0000","last_change":"2024-08-18T22:20:19.509924+0000","last_active":"2024-08-18T22:20:20.794273+0000","last_peered":"2024-08-18T22:20:20.794273+0000","last_clean":"2024-08-18T22:20:20.794273+0000","last_became_active":"2024-08-18T22:20:19.509607+0000","last_became_peered":"2024-08-18T22:20:19.509607+0000","last_unstale":"2024-08-18T22:20:20.794273+0000","last_undegraded":"2024-08-18T22:20:20.794273+0000","last_fullsized":"2024-08-18T22:20:20.794273+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:50.489891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795422+0000","last_change":"2024-08-18T22:20:18.511256+0000","last_active":"2024-08-18T22:20:20.795422+0000","last_peered":"2024-08-18T22:20:20.795422+0000","last_clean":"2024-08-18T22:20:20.795422+0000","last_became_active":"2024-08-18T22:20:18.510423+0000","last_became_peered":"2024-08-18T22:20:18.510423+0000","last_unstale":"2024-08-18T22:20:20.795422+0000","last_undegraded":"2024-08-18T22:20:20.795422+0000","last_fullsized":"2024-08-18T22:20:20.795422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:14.250813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794450+0000","last_change":"2024-08-18T22:20:19.518333+0000","last_active":"2024-08-18T22:20:20.794450+0000","last_peered":"2024-08-18T22:20:20.794450+0000","last_clean":"2024-08-18T22:20:20.794450+0000","last_became_active":"2024-08-18T22:20:19.518035+0000","last_became_peered":"2024-08-18T22:20:19.518035+0000","last_unstale":"2024-08-18T22:20:20.794450+0000","last_undegraded":"2024-08-18T22:20:20.794450+0000","last_fullsized":"2024-08-18T22:20:20.794450+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:34:20.483395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.795284+0000","last_change":"2024-08-18T22:20:18.510833+0000","last_active":"2024-08-18T22:20:20.795284+0000","last_peered":"2024-08-18T22:20:20.795284+0000","last_clean":"2024-08-18T22:20:20.795284+0000","last_became_active":"2024-08-18T22:20:18.510510+0000","last_became_peered":"2024-08-18T22:20:18.510510+0000","last_unstale":"2024-08-18T22:20:20.795284+0000","last_undegraded":"2024-08-18T22:20:20.795284+0000","last_fullsized":"2024-08-18T22:20:20.795284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:50.936670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794710+0000","last_change":"2024-08-18T22:20:19.530151+0000","last_active":"2024-08-18T22:20:20.794710+0000","last_peered":"2024-08-18T22:20:20.794710+0000","last_clean":"2024-08-18T22:20:20.794710+0000","last_became_active":"2024-08-18T22:20:19.526375+0000","last_became_peered":"2024-08-18T22:20:19.526375+0000","last_unstale":"2024-08-18T22:20:20.794710+0000","last_undegraded":"2024-08-18T22:20:20.794710+0000","last_fullsized":"2024-08-18T22:20:20.794710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:50:16.290066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505187+0000","last_change":"2024-08-18T22:20:18.508896+0000","last_active":"2024-08-18T22:20:20.505187+0000","last_peered":"2024-08-18T22:20:20.505187+0000","last_clean":"2024-08-18T22:20:20.505187+0000","last_became_active":"2024-08-18T22:20:18.508538+0000","last_became_peered":"2024-08-18T22:20:18.508538+0000","last_unstale":"2024-08-18T22:20:20.505187+0000","last_undegraded":"2024-08-18T22:20:20.505187+0000","last_fullsized":"2024-08-18T22:20:20.505187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:33.626411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506321+0000","last_change":"2024-08-18T22:20:19.524685+0000","last_active":"2024-08-18T22:20:20.506321+0000","last_peered":"2024-08-18T22:20:20.506321+0000","last_clean":"2024-08-18T22:20:20.506321+0000","last_became_active":"2024-08-18T22:20:19.524418+0000","last_became_peered":"2024-08-18T22:20:19.524418+0000","last_unstale":"2024-08-18T22:20:20.506321+0000","last_undegraded":"2024-08-18T22:20:20.506321+0000","last_fullsized":"2024-08-18T22:20:20.506321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:53.696643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505510+0000","last_change":"2024-08-18T22:20:18.506063+0000","last_active":"2024-08-18T22:20:20.505510+0000","last_peered":"2024-08-18T22:20:20.505510+0000","last_clean":"2024-08-18T22:20:20.505510+0000","last_became_active":"2024-08-18T22:20:18.505766+0000","last_became_peered":"2024-08-18T22:20:18.505766+0000","last_unstale":"2024-08-18T22:20:20.505510+0000","last_undegraded":"2024-08-18T22:20:20.505510+0000","last_fullsized":"2024-08-18T22:20:20.505510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:58.591575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.506478+0000","last_change":"2024-08-18T22:20:19.507024+0000","last_active":"2024-08-18T22:20:20.506478+0000","last_peered":"2024-08-18T22:20:20.506478+0000","last_clean":"2024-08-18T22:20:20.506478+0000","last_became_active":"2024-08-18T22:20:19.506765+0000","last_became_peered":"2024-08-18T22:20:19.506765+0000","last_unstale":"2024-08-18T22:20:20.506478+0000","last_undegraded":"2024-08-18T22:20:20.506478+0000","last_fullsized":"2024-08-18T22:20:20.506478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:50.489891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794312+0000","last_change":"2024-08-18T22:20:18.501496+0000","last_active":"2024-08-18T22:20:20.794312+0000","last_peered":"2024-08-18T22:20:20.794312+0000","last_clean":"2024-08-18T22:20:20.794312+0000","last_became_active":"2024-08-18T22:20:18.501227+0000","last_became_peered":"2024-08-18T22:20:18.501227+0000","last_unstale":"2024-08-18T22:20:20.794312+0000","last_undegraded":"2024-08-18T22:20:20.794312+0000","last_fullsized":"2024-08-18T22:20:20.794312+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:20.897581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.794348+0000","last_change":"2024-08-18T22:20:19.530118+0000","last_active":"2024-08-18T22:20:20.794348+0000","last_peered":"2024-08-18T22:20:20.794348+0000","last_clean":"2024-08-18T22:20:20.794348+0000","last_became_active":"2024-08-18T22:20:19.529806+0000","last_became_peered":"2024-08-18T22:20:19.529806+0000","last_unstale":"2024-08-18T22:20:20.794348+0000","last_undegraded":"2024-08-18T22:20:20.794348+0000","last_fullsized":"2024-08-18T22:20:20.794348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:18.479407+0000","last_clean_scrub_stamp":"2024-08-18T22:20:18.479407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:17.844670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505410+0000","last_change":"2024-08-18T22:20:18.513740+0000","last_active":"2024-08-18T22:20:20.505410+0000","last_peered":"2024-08-18T22:20:20.505410+0000","last_clean":"2024-08-18T22:20:20.505410+0000","last_became_active":"2024-08-18T22:20:18.513369+0000","last_became_peered":"2024-08-18T22:20:18.513369+0000","last_unstale":"2024-08-18T22:20:20.505410+0000","last_undegraded":"2024-08-18T22:20:20.505410+0000","last_fullsized":"2024-08-18T22:20:20.505410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:20:17.475832+0000","last_clean_scrub_stamp":"2024-08-18T22:20:17.475832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:23.822720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":206,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-18T22:20:20.505626+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:20:20.505626+0000","last_peered":"2024-08-18T22:20:20.505626+0000","last_clean":"2024-08-18T22:20:20.505626+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:20:20.505626+0000","last_undegraded":"2024-08-18T22:20:20.505626+0000","last_fullsized":"2024-08-18T22:20:20.505626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":784061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":192593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":192123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":458752,"data_stored":193657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":446464,"data_stored":192101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1040384,"data_stored":782413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":192615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":192081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:20:28.548 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:20:28.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:20:28.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.729+0000 7f2701e00640 1 Processor -- start 2024-08-18T22:20:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.729+0000 7f2701e00640 1 -- start start 2024-08-18T22:20:28.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f2701e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26fc15b0c0 0x7f26fc06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f2701e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26fc0b40c0 0x7f26fc0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f2701e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26fc0b31f0 con 0x7f26fc072a30 2024-08-18T22:20:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f2701e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f26fc0b3d70 con 0x7f26fc0b40c0 2024-08-18T22:20:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f2701e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f26fc0b4a40 con 0x7f26fc15b0c0 2024-08-18T22:20:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26fb400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f26fc072a30 0x7f26fc072ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60934/0 (socket says 172.21.15.5:60934) 2024-08-18T22:20:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26fb400640 1 -- 172.21.15.5:0/3762961483 learned_addr learned my addr 172.21.15.5:0/3762961483 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26f2000640 1 --2- 172.21.15.5:0/3762961483 >> v2:172.21.15.5:3300/0 conn(0x7f26fc0b40c0 0x7f26fc0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26faa00640 1 --2- 172.21.15.5:0/3762961483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26fc15b0c0 0x7f26fc06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26f2000640 1 -- 172.21.15.5:0/3762961483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26fc15b0c0 msgr2=0x7f26fc06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26f2000640 1 --2- 172.21.15.5:0/3762961483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26fc15b0c0 0x7f26fc06db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26f2000640 1 -- 172.21.15.5:0/3762961483 >> v1:172.21.15.5:6789/0 conn(0x7f26fc072a30 legacy=0x7f26fc072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26f2000640 1 -- 172.21.15.5:0/3762961483 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26fc0b34d0 con 0x7f26fc0b40c0 2024-08-18T22:20:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26fa000640 1 -- 172.21.15.5:0/3762961483 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2404923497 0 0) 0x7f26fc0b31f0 con 0x7f26fc072a30 2024-08-18T22:20:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26faa00640 1 --2- 172.21.15.5:0/3762961483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26fc15b0c0 0x7f26fc06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:28.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26f2000640 1 --2- 172.21.15.5:0/3762961483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26fc0b40c0 0x7f26fc0b4500 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f26e40097c0 tx=0x7f26e401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c3ee263586496 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:28.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.733+0000 7f26fa000640 1 -- 172.21.15.5:0/3762961483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40b0070 con 0x7f26fc0b40c0 2024-08-18T22:20:28.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f26fa000640 1 -- 172.21.15.5:0/3762961483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e4004230 con 0x7f26fc0b40c0 2024-08-18T22:20:28.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f26fa000640 1 -- 172.21.15.5:0/3762961483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4003620 con 0x7f26fc0b40c0 2024-08-18T22:20:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 -- 172.21.15.5:0/3762961483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26fc0b40c0 msgr2=0x7f26fc0b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 --2- 172.21.15.5:0/3762961483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26fc0b40c0 0x7f26fc0b4500 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f26e40097c0 tx=0x7f26e401c350 comp rx=0 tx=0).stop 2024-08-18T22:20:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 -- 172.21.15.5:0/3762961483 shutdown_connections 2024-08-18T22:20:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 --2- 172.21.15.5:0/3762961483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26fc0b40c0 0x7f26fc0b4500 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 --2- 172.21.15.5:0/3762961483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26fc15b0c0 0x7f26fc06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 -- 172.21.15.5:0/3762961483 >> 172.21.15.5:0/3762961483 conn(0x7f26fc0b1dc0 msgr2=0x7f26fc0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 -- 172.21.15.5:0/3762961483 shutdown_connections 2024-08-18T22:20:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 -- 172.21.15.5:0/3762961483 wait complete. 2024-08-18T22:20:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 Processor -- start 2024-08-18T22:20:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 -- start start 2024-08-18T22:20:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26fc072a30 0x7f26fc14b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26fc0b40c0 0x7f26fc1493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26fc15b0c0 0x7f26fc14fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc15b4a0 con 0x7f26fc0b40c0 2024-08-18T22:20:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc0739c0 con 0x7f26fc072a30 2024-08-18T22:20:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f2701e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f26fc15b620 con 0x7f26fc15b0c0 2024-08-18T22:20:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f26f2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26fc0b40c0 0x7f26fc1493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f26f2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26fc0b40c0 0x7f26fc1493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46142/0 (socket says 172.21.15.5:46142) 2024-08-18T22:20:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f26f2000640 1 -- 172.21.15.5:0/3752284781 learned_addr learned my addr 172.21.15.5:0/3752284781 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f26fb400640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26fc15b0c0 0x7f26fc14fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.737+0000 7f26faa00640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26fc072a30 0x7f26fc14b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f2000640 1 -- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26fc15b0c0 msgr2=0x7f26fc14fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f2000640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26fc15b0c0 0x7f26fc14fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f2000640 1 -- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26fc072a30 msgr2=0x7f26fc14b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f2000640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26fc072a30 0x7f26fc14b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f2000640 1 -- 172.21.15.5:0/3752284781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26fc1fb540 con 0x7f26fc0b40c0 2024-08-18T22:20:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f2000640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26fc0b40c0 0x7f26fc1493f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f26e4019f80 tx=0x7f26e40190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f3e00640 1 -- 172.21.15.5:0/3752284781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40b9020 con 0x7f26fc0b40c0 2024-08-18T22:20:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f3e00640 1 -- 172.21.15.5:0/3752284781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e40043e0 con 0x7f26fc0b40c0 2024-08-18T22:20:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f3e00640 1 -- 172.21.15.5:0/3752284781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40b0040 con 0x7f26fc0b40c0 2024-08-18T22:20:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f2701e00640 1 -- 172.21.15.5:0/3752284781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26fc149930 con 0x7f26fc0b40c0 2024-08-18T22:20:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f2701e00640 1 -- 172.21.15.5:0/3752284781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26fc1faca0 con 0x7f26fc0b40c0 2024-08-18T22:20:28.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f2701e00640 1 -- 172.21.15.5:0/3752284781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26fc06f700 con 0x7f26fc0b40c0 2024-08-18T22:20:28.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f3e00640 1 -- 172.21.15.5:0/3752284781 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f26e40bc020 con 0x7f26fc0b40c0 2024-08-18T22:20:28.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f3e00640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26d80678c0 0x7f26d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:28.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.741+0000 7f26f3e00640 1 -- 172.21.15.5:0/3752284781 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f26e411fcd0 con 0x7f26fc0b40c0 2024-08-18T22:20:28.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.745+0000 7f26faa00640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26d80678c0 0x7f26d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.745+0000 7f26faa00640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26d80678c0 0x7f26d8069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0045f0 tx=0x7f26ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:28.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.745+0000 7f26f3e00640 1 -- 172.21.15.5:0/3752284781 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f26e40c3030 con 0x7f26fc0b40c0 2024-08-18T22:20:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.969+0000 7f2701e00640 1 -- 172.21.15.5:0/3752284781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f26fc0b2520 con 0x7f26fc0b40c0 2024-08-18T22:20:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f26f3e00640 1 -- 172.21.15.5:0/3752284781 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f26e4016090 con 0x7f26fc0b40c0 2024-08-18T22:20:28.976 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:20:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:20:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:20:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:20:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:20:28.976 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:20:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 -- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26d80678c0 msgr2=0x7f26d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26d80678c0 0x7f26d8069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0045f0 tx=0x7f26ec008040 comp rx=0 tx=0).stop 2024-08-18T22:20:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 -- 172.21.15.5:0/3752284781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26fc0b40c0 msgr2=0x7f26fc1493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26fc0b40c0 0x7f26fc1493f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f26e4019f80 tx=0x7f26e40190f0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 -- 172.21.15.5:0/3752284781 shutdown_connections 2024-08-18T22:20:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26d80678c0 0x7f26d8069d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26fc15b0c0 0x7f26fc14fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26fc0b40c0 0x7f26fc1493f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 --2- 172.21.15.5:0/3752284781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26fc072a30 0x7f26fc14b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 -- 172.21.15.5:0/3752284781 >> 172.21.15.5:0/3752284781 conn(0x7f26fc0b1dc0 msgr2=0x7f26fc1581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 -- 172.21.15.5:0/3752284781 shutdown_connections 2024-08-18T22:20:28.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:28.973+0000 7f2701e00640 1 -- 172.21.15.5:0/3752284781 wait complete. 2024-08-18T22:20:28.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:20:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff73dc00640 1 Processor -- start 2024-08-18T22:20:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff73dc00640 1 -- start start 2024-08-18T22:20:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff73dc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff73809aa40 0x7ff73815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff73dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380cde30 0x7ff73809ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff73dc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff73809b360 con 0x7ff7380b4510 2024-08-18T22:20:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff73dc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff7380ce770 con 0x7ff73809aa40 2024-08-18T22:20:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff73dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff73815d520 con 0x7ff7380cde30 2024-08-18T22:20:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff72fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380cde30 0x7ff73809ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff72fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380cde30 0x7ff73809ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:42514/0 (socket says 172.21.15.5:42514) 2024-08-18T22:20:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff72fe00640 1 -- 172.21.15.5:0/1412258486 learned_addr learned my addr 172.21.15.5:0/1412258486 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff737e00640 1 --2- 172.21.15.5:0/1412258486 >> v2:172.21.15.117:3300/0 conn(0x7ff73809aa40 0x7ff73815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff72fe00640 1 -- 172.21.15.5:0/1412258486 >> v2:172.21.15.117:3300/0 conn(0x7ff73809aa40 msgr2=0x7ff73815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff72fe00640 1 --2- 172.21.15.5:0/1412258486 >> v2:172.21.15.117:3300/0 conn(0x7ff73809aa40 0x7ff73815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff72fe00640 1 -- 172.21.15.5:0/1412258486 >> v1:172.21.15.117:6789/0 conn(0x7ff7380b4510 legacy=0x7ff73815fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.137+0000 7ff72fe00640 1 -- 172.21.15.5:0/1412258486 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7380ccd90 con 0x7ff7380cde30 2024-08-18T22:20:29.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff72fe00640 1 --2- 172.21.15.5:0/1412258486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380cde30 0x7ff73809ae20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff720009870 tx=0x7ff72001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e8c0a957e23ffa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff737400640 1 -- 172.21.15.5:0/1412258486 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7200ab650 con 0x7ff7380cde30 2024-08-18T22:20:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff737400640 1 -- 172.21.15.5:0/1412258486 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7200b0070 con 0x7ff7380cde30 2024-08-18T22:20:29.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff737400640 1 -- 172.21.15.5:0/1412258486 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7200aba10 con 0x7ff7380cde30 2024-08-18T22:20:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff73dc00640 1 -- 172.21.15.5:0/1412258486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380cde30 msgr2=0x7ff73809ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff73dc00640 1 --2- 172.21.15.5:0/1412258486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380cde30 0x7ff73809ae20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff720009870 tx=0x7ff72001c530 comp rx=0 tx=0).stop 2024-08-18T22:20:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff73dc00640 1 -- 172.21.15.5:0/1412258486 shutdown_connections 2024-08-18T22:20:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff73dc00640 1 --2- 172.21.15.5:0/1412258486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380cde30 0x7ff73809ae20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff73dc00640 1 --2- 172.21.15.5:0/1412258486 >> v2:172.21.15.117:3300/0 conn(0x7ff73809aa40 0x7ff73815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff73dc00640 1 -- 172.21.15.5:0/1412258486 >> 172.21.15.5:0/1412258486 conn(0x7ff7380b3a20 msgr2=0x7ff7380b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff73dc00640 1 -- 172.21.15.5:0/1412258486 shutdown_connections 2024-08-18T22:20:29.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff73dc00640 1 -- 172.21.15.5:0/1412258486 wait complete. 2024-08-18T22:20:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.141+0000 7ff73dc00640 1 Processor -- start 2024-08-18T22:20:29.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73dc00640 1 -- start start 2024-08-18T22:20:29.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73dc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73809aa40 0x7ff7380b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380b4510 0x7ff7380c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7380cde30 0x7ff7380ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73dc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff73815c230 con 0x7ff7380cde30 2024-08-18T22:20:29.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73dc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380cd910 con 0x7ff73809aa40 2024-08-18T22:20:29.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff73815c3b0 con 0x7ff7380b4510 2024-08-18T22:20:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7380cde30 0x7ff7380ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff72fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380b4510 0x7ff7380c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7380cde30 0x7ff7380ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46158/0 (socket says 172.21.15.5:46158) 2024-08-18T22:20:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73d200640 1 -- 172.21.15.5:0/2249408736 learned_addr learned my addr 172.21.15.5:0/2249408736 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff737e00640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73809aa40 0x7ff7380b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73d200640 1 -- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380b4510 msgr2=0x7ff7380c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73d200640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380b4510 0x7ff7380c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73d200640 1 -- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73809aa40 msgr2=0x7ff7380b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73d200640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73809aa40 0x7ff7380b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73d200640 1 -- 172.21.15.5:0/2249408736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7380cbcb0 con 0x7ff7380cde30 2024-08-18T22:20:29.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73d200640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7380cde30 0x7ff7380ceb80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c7a0 tx=0x7ff73000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:29.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff734c00640 1 -- 172.21.15.5:0/2249408736 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730003b80 con 0x7ff7380cde30 2024-08-18T22:20:29.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff734c00640 1 -- 172.21.15.5:0/2249408736 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff730003d20 con 0x7ff7380cde30 2024-08-18T22:20:29.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73dc00640 1 -- 172.21.15.5:0/2249408736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7380cbf90 con 0x7ff7380cde30 2024-08-18T22:20:29.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff734c00640 1 -- 172.21.15.5:0/2249408736 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73000aa90 con 0x7ff7380cde30 2024-08-18T22:20:29.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73dc00640 1 -- 172.21.15.5:0/2249408736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7380c7a50 con 0x7ff7380cde30 2024-08-18T22:20:29.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.145+0000 7ff73dc00640 1 -- 172.21.15.5:0/2249408736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff73815cfe0 con 0x7ff7380cde30 2024-08-18T22:20:29.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.149+0000 7ff734c00640 1 -- 172.21.15.5:0/2249408736 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff73000ac30 con 0x7ff7380cde30 2024-08-18T22:20:29.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.149+0000 7ff734c00640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7140678f0 0x7ff714069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.149+0000 7ff734c00640 1 -- 172.21.15.5:0/2249408736 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff730085ce0 con 0x7ff7380cde30 2024-08-18T22:20:29.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.149+0000 7ff737e00640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7140678f0 0x7ff714069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.149+0000 7ff737e00640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7140678f0 0x7ff714069db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff728009b60 tx=0x7ff728009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:29.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.153+0000 7ff734c00640 1 -- 172.21.15.5:0/2249408736 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff730055f20 con 0x7ff7380cde30 2024-08-18T22:20:29.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.353+0000 7ff73dc00640 1 -- 172.21.15.5:0/2249408736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff738073d40 con 0x7ff7380cde30 2024-08-18T22:20:29.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.353+0000 7ff734c00640 1 -- 172.21.15.5:0/2249408736 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7ff73005a220 con 0x7ff7380cde30 2024-08-18T22:20:29.356 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:20:29.356 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"btime":"2024-08-18T22:20:22:509921+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3746061951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3746061951},{"type":"v1","addr":"172.21.15.117:6836","nonce":3746061951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2422794020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2422794020},{"type":"v1","addr":"172.21.15.117:6837","nonce":2422794020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3630211664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3630211664},{"type":"v1","addr":"172.21.15.5:6835","nonce":3630211664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:20:18.895099+0000","modified":"2024-08-18T22:20:21.900180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/771750285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":771750285},{"type":"v1","addr":"172.21.15.5:6834","nonce":771750285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4908,"qdb_cluster":[4908]},"id":2}]} 2024-08-18T22:20:29.356 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2024-08-18T22:20:29.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.353+0000 7ff73dc00640 1 -- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7140678f0 msgr2=0x7ff714069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.353+0000 7ff73dc00640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7140678f0 0x7ff714069db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff728009b60 tx=0x7ff728009190 comp rx=0 tx=0).stop 2024-08-18T22:20:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.353+0000 7ff73dc00640 1 -- 172.21.15.5:0/2249408736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7380cde30 msgr2=0x7ff7380ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.353+0000 7ff73dc00640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7380cde30 0x7ff7380ceb80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c7a0 tx=0x7ff73000cc60 comp rx=0 tx=0).stop 2024-08-18T22:20:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.353+0000 7ff73dc00640 1 -- 172.21.15.5:0/2249408736 shutdown_connections 2024-08-18T22:20:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.353+0000 7ff73dc00640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7140678f0 0x7ff714069db0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.353+0000 7ff73dc00640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7380cde30 0x7ff7380ceb80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.357+0000 7ff73dc00640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7380b4510 0x7ff7380c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.357+0000 7ff73dc00640 1 --2- 172.21.15.5:0/2249408736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff73809aa40 0x7ff7380b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.357+0000 7ff73dc00640 1 -- 172.21.15.5:0/2249408736 >> 172.21.15.5:0/2249408736 conn(0x7ff7380b3a20 msgr2=0x7ff738071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.357+0000 7ff73dc00640 1 -- 172.21.15.5:0/2249408736 shutdown_connections 2024-08-18T22:20:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.357+0000 7ff73dc00640 1 -- 172.21.15.5:0/2249408736 wait complete. 2024-08-18T22:20:29.779 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:20:18.895099+0000', 'modified': '2024-08-18T22:20:21.900180+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4908}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4908': {'gid': 4908, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6834/771750285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 771750285}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 771750285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4908, 'qdb_cluster': [4908]} 2024-08-18T22:20:29.780 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:20:29.780 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-18T22:20:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.921+0000 7f8c2be00640 1 Processor -- start 2024-08-18T22:20:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.921+0000 7f8c2be00640 1 -- start start 2024-08-18T22:20:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.921+0000 7f8c2be00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8c2c0d2f00 0x7f8c2c0b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.921+0000 7f8c2be00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c0d2110 con 0x7f8c2c15e380 2024-08-18T22:20:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.921+0000 7f8c2be00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c0d23f0 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.921+0000 7f8c2be00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2c15e760 con 0x7f8c2c0d2f00 2024-08-18T22:20:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.925+0000 7f8c2aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8c2c15e380 0x7f8c2c0d27f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60948/0 (socket says 172.21.15.5:60948) 2024-08-18T22:20:29.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.925+0000 7f8c2aa00640 1 -- 172.21.15.5:0/485279948 learned_addr learned my addr 172.21.15.5:0/485279948 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.925+0000 7f8c2a000640 1 --2- 172.21.15.5:0/485279948 >> v2:172.21.15.117:3300/0 conn(0x7f8c2c0d2f00 0x7f8c2c0b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.925+0000 7f8c29600640 1 -- 172.21.15.5:0/485279948 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800103693 0 0) 0x7f8c2c0d2110 con 0x7f8c2c15e380 2024-08-18T22:20:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.925+0000 7f8c29600640 1 -- 172.21.15.5:0/485279948 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c10003530 con 0x7f8c2c15e380 2024-08-18T22:20:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.925+0000 7f8c29600640 1 -- 172.21.15.5:0/485279948 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2215088841 0 0) 0x7f8c2c0d23f0 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.925+0000 7f8c29600640 1 -- 172.21.15.5:0/485279948 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c2c0d2110 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.925+0000 7f8c2a000640 1 -- 172.21.15.5:0/485279948 >> v1:172.21.15.117:6789/0 conn(0x7f8c2c0d12a0 legacy=0x7f8c2c0b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.925+0000 7f8c2a000640 1 -- 172.21.15.5:0/485279948 >> v1:172.21.15.5:6789/0 conn(0x7f8c2c15e380 legacy=0x7f8c2c0d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.925+0000 7f8c2a000640 1 -- 172.21.15.5:0/485279948 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c0d4920 con 0x7f8c2c0d2f00 2024-08-18T22:20:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.925+0000 7f8c2a000640 1 --2- 172.21.15.5:0/485279948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c2c0d2f00 0x7f8c2c0b0f80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8c180097c0 tx=0x7f8c2c0b23e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd76dc4d171dbd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c29600640 1 -- 172.21.15.5:0/485279948 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180b1070 con 0x7f8c2c0d2f00 2024-08-18T22:20:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c29600640 1 -- 172.21.15.5:0/485279948 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c180ac410 con 0x7f8c2c0d2f00 2024-08-18T22:20:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c29600640 1 -- 172.21.15.5:0/485279948 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180ac7e0 con 0x7f8c2c0d2f00 2024-08-18T22:20:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 -- 172.21.15.5:0/485279948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c2c0d2f00 msgr2=0x7f8c2c0b0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 --2- 172.21.15.5:0/485279948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c2c0d2f00 0x7f8c2c0b0f80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8c180097c0 tx=0x7f8c2c0b23e0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 -- 172.21.15.5:0/485279948 shutdown_connections 2024-08-18T22:20:29.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 --2- 172.21.15.5:0/485279948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c2c0d2f00 0x7f8c2c0b0f80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 -- 172.21.15.5:0/485279948 >> 172.21.15.5:0/485279948 conn(0x7f8c2c09d4e0 msgr2=0x7f8c2c0d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 -- 172.21.15.5:0/485279948 shutdown_connections 2024-08-18T22:20:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 -- 172.21.15.5:0/485279948 wait complete. 2024-08-18T22:20:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 Processor -- start 2024-08-18T22:20:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 -- start start 2024-08-18T22:20:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c0d12a0 0x7f8c2c15ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c2c0d2f00 0x7f8c2c158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c2c15e380 0x7f8c2c0c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c16bfc0 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c16be40 con 0x7f8c2c0d2f00 2024-08-18T22:20:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2be00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c16c140 con 0x7f8c2c15e380 2024-08-18T22:20:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c0d12a0 0x7f8c2c15ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c0d12a0 0x7f8c2c15ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46170/0 (socket says 172.21.15.5:46170) 2024-08-18T22:20:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2aa00640 1 -- 172.21.15.5:0/1948359846 learned_addr learned my addr 172.21.15.5:0/1948359846 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2b400640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c2c15e380 0x7f8c2c0c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2a000640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c2c0d2f00 0x7f8c2c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2aa00640 1 -- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c2c15e380 msgr2=0x7f8c2c0c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2aa00640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c2c15e380 0x7f8c2c0c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2aa00640 1 -- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c2c0d2f00 msgr2=0x7f8c2c158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2aa00640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c2c0d2f00 0x7f8c2c158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.929+0000 7f8c2aa00640 1 -- 172.21.15.5:0/1948359846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c154680 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.933+0000 7f8c2aa00640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c0d12a0 0x7f8c2c15ada0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00c450 tx=0x7f8c1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.933+0000 7f8c22a00640 1 -- 172.21.15.5:0/1948359846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c017070 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.933+0000 7f8c22a00640 1 -- 172.21.15.5:0/1948359846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1c005cf0 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.933+0000 7f8c22a00640 1 -- 172.21.15.5:0/1948359846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c0072b0 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.933+0000 7f8c2be00640 1 -- 172.21.15.5:0/1948359846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2c154960 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.933+0000 7f8c2be00640 1 -- 172.21.15.5:0/1948359846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c2c154f20 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.933+0000 7f8c22a00640 1 -- 172.21.15.5:0/1948359846 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c1c01a070 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.933+0000 7f8c22a00640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c0c0678f0 0x7f8c0c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.933+0000 7f8c22a00640 1 -- 172.21.15.5:0/1948359846 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8c1c0851c0 con 0x7f8c2c0d12a0 2024-08-18T22:20:29.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.933+0000 7f8c2a000640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c0c0678f0 0x7f8c0c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 Processor -- start 2024-08-18T22:20:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 -- start start 2024-08-18T22:20:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2a000640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c0c0678f0 0x7f8c0c069db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c180ae000 tx=0x7f8c18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6bd50 0x55a860f6c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860f22450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860f22d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a860e08fd0 con 0x55a860f6c670 2024-08-18T22:20:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a860d6f3c0 con 0x55a860f6bd50 2024-08-18T22:20:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a860d14f70 con 0x55a860f22990 2024-08-18T22:20:29.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860f22450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860f22450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46174/0 (socket says 172.21.15.5:46174) 2024-08-18T22:20:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2a000640 1 -- 172.21.15.5:0/3597835426 learned_addr learned my addr 172.21.15.5:0/3597835426 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2aa00640 1 --2- 172.21.15.5:0/3597835426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6bd50 0x55a860f6c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2b400640 1 --2- 172.21.15.5:0/3597835426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860f22d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2a000640 1 -- 172.21.15.5:0/3597835426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 msgr2=0x55a860f22d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2a000640 1 --2- 172.21.15.5:0/3597835426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860f22d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2a000640 1 -- 172.21.15.5:0/3597835426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6bd50 msgr2=0x55a860f6c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2a000640 1 --2- 172.21.15.5:0/3597835426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6bd50 0x55a860f6c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2a000640 1 -- 172.21.15.5:0/3597835426 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a860d092e0 con 0x55a860f6c670 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2b400640 1 --2- 172.21.15.5:0/3597835426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860f22d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c2a000640 1 --2- 172.21.15.5:0/3597835426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860f22450 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8c18008010 tx=0x7f8c180046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0ea7bb7013fd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c17400640 1 -- 172.21.15.5:0/3597835426 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180c8070 con 0x55a860f6c670 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c17400640 1 -- 172.21.15.5:0/3597835426 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c180b2040 con 0x55a860f6c670 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c17400640 1 -- 172.21.15.5:0/3597835426 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180b8570 con 0x55a860f6c670 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 -- 172.21.15.5:0/3597835426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 msgr2=0x55a860f22450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 --2- 172.21.15.5:0/3597835426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860f22450 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8c18008010 tx=0x7f8c180046d0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 -- 172.21.15.5:0/3597835426 shutdown_connections 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 --2- 172.21.15.5:0/3597835426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860f22d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 --2- 172.21.15.5:0/3597835426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860f22450 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 --2- 172.21.15.5:0/3597835426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6bd50 0x55a860f6c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 -- 172.21.15.5:0/3597835426 >> 172.21.15.5:0/3597835426 conn(0x55a860f1e910 msgr2=0x55a860f20d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 -- 172.21.15.5:0/3597835426 shutdown_connections 2024-08-18T22:20:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 -- 172.21.15.5:0/3597835426 wait complete. 2024-08-18T22:20:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.937+0000 7f8c34b23000 1 -- start start 2024-08-18T22:20:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 1 Processor -- start 2024-08-18T22:20:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860f59640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6bd50 0x55a860f27be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6c670 0x55a860f28120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a860d16e40 con 0x55a860f6bd50 2024-08-18T22:20:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a860e2caf0 con 0x55a860f6c670 2024-08-18T22:20:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a860dd1450 con 0x55a860f22990 2024-08-18T22:20:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 10 client.0 _ll_register_callbacks cb 0x55a860f0d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:20:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6bd50 0x55a860f27be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860f59640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860f59640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:42554/0 (socket says 172.21.15.5:42554) 2024-08-18T22:20:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2aa00640 1 -- 172.21.15.5:0/2052513509 learned_addr learned my addr 172.21.15.5:0/2052513509 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2b400640 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6c670 0x55a860f28120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2a000640 1 -- 172.21.15.5:0/2052513509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 msgr2=0x55a860f59640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2a000640 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860f59640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2a000640 1 -- 172.21.15.5:0/2052513509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6c670 msgr2=0x55a860f28120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2a000640 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6c670 0x55a860f28120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2a000640 1 -- 172.21.15.5:0/2052513509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a860cf6fd0 con 0x55a860f6bd50 2024-08-18T22:20:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2a000640 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6bd50 0x55a860f27be0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000c10 tx=0x7f8c1801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2631540c49e820 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c0be00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c0be00640 1 -- 172.21.15.5:0/2052513509 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180d1060 con 0x55a860f6bd50 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 1 -- 172.21.15.5:0/2052513509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c180b2040 con 0x55a860f6bd50 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c0be00640 1 -- 172.21.15.5:0/2052513509 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8c180b8be0 con 0x55a860f6bd50 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c0be00640 1 -- 172.21.15.5:0/2052513509 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8c180d7050 con 0x55a860f6bd50 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 10 client.5100 fetch_fsmap learned FSMap version 17 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 1 -- 172.21.15.5:0/2052513509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55a860df24d0 con 0x55a860f6bd50 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c0be00640 1 -- 172.21.15.5:0/2052513509 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c180b2040 con 0x55a860f6bd50 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c0be00640 1 -- 172.21.15.5:0/2052513509 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f8c180da020 con 0x55a860f6bd50 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 10 client.5100 fetch_fsmap finished waiting for FSMap version 17 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 10 client.5100 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 20 client.5100 populate_metadata read hostname 'smithi005' 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55a860f5a4f0 0x55a860f5a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 4 client.5100 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c34b23000 1 -- 172.21.15.5:0/2052513509 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a860d09c00 con 0x55a860f5a4f0 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2aa00640 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55a860f5a4f0 0x55a860f5a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c2aa00640 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55a860f5a4f0 0x55a860f5a8d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f8bcf41097983fb server_cookie=91d303b021e481ff in_seq=0 out_seq=0 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.941+0000 7f8c0be00640 10 client.5100 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c0be00640 1 -- 172.21.15.5:0/2052513509 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a860d09c00 con 0x55a860f5a4f0 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c0be00640 10 client.5100 handle_command_reply: tid=0 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 1 client.5100 shutdown 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 1 -- 172.21.15.5:0/2052513509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6bd50 msgr2=0x55a860f27be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6bd50 0x55a860f27be0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000c10 tx=0x7f8c1801c4a0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 1 -- 172.21.15.5:0/2052513509 shutdown_connections 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55a860f5a4f0 0x55a860f5a8d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6c670 0x55a860f28120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6bd50 0x55a860f27be0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2052513509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860f59640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c0be00640 0 client.5100 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:20:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 1 -- 172.21.15.5:0/2052513509 >> 172.21.15.5:0/2052513509 conn(0x55a860f1e910 msgr2=0x55a860f21520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 1 -- 172.21.15.5:0/2052513509 shutdown_connections 2024-08-18T22:20:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 1 -- 172.21.15.5:0/2052513509 wait complete. 2024-08-18T22:20:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.945+0000 7f8c34b23000 20 client.5100 trim_cache size 0 max 16384 2024-08-18T22:20:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 Processor -- start 2024-08-18T22:20:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 -- start start 2024-08-18T22:20:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f1e910 0x55a860f20d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f22990 0x55a860f21240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6c670 0x55a860f21c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c202dc0 con 0x55a860f22990 2024-08-18T22:20:29.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c156420 con 0x55a860f6c670 2024-08-18T22:20:29.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c150dc0 con 0x55a860f1e910 2024-08-18T22:20:29.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f22990 0x55a860f21240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f22990 0x55a860f21240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46190/0 (socket says 172.21.15.5:46190) 2024-08-18T22:20:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2a000640 1 -- 172.21.15.5:0/23165480 learned_addr learned my addr 172.21.15.5:0/23165480 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2aa00640 1 --2- 172.21.15.5:0/23165480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f1e910 0x55a860f20d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2b400640 1 --2- 172.21.15.5:0/23165480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6c670 0x55a860f21c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2a000640 1 -- 172.21.15.5:0/23165480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f1e910 msgr2=0x55a860f20d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2a000640 1 --2- 172.21.15.5:0/23165480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f1e910 0x55a860f20d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2a000640 1 -- 172.21.15.5:0/23165480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6c670 msgr2=0x55a860f21c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2a000640 1 --2- 172.21.15.5:0/23165480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6c670 0x55a860f21c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2a000640 1 -- 172.21.15.5:0/23165480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a860d68b30 con 0x55a860f22990 2024-08-18T22:20:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2b400640 1 --2- 172.21.15.5:0/23165480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6c670 0x55a860f21c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c2a000640 1 --2- 172.21.15.5:0/23165480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f22990 0x55a860f21240 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8c1801cd40 tx=0x7f8c180ba050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611b9f02345ba86e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c16a00640 1 -- 172.21.15.5:0/23165480 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180a7040 con 0x55a860f22990 2024-08-18T22:20:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c16a00640 1 -- 172.21.15.5:0/23165480 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c180b2040 con 0x55a860f22990 2024-08-18T22:20:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c16a00640 1 -- 172.21.15.5:0/23165480 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180c8070 con 0x55a860f22990 2024-08-18T22:20:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 -- 172.21.15.5:0/23165480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f22990 msgr2=0x55a860f21240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 --2- 172.21.15.5:0/23165480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f22990 0x55a860f21240 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8c1801cd40 tx=0x7f8c180ba050 comp rx=0 tx=0).stop 2024-08-18T22:20:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 -- 172.21.15.5:0/23165480 shutdown_connections 2024-08-18T22:20:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 --2- 172.21.15.5:0/23165480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f6c670 0x55a860f21c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 --2- 172.21.15.5:0/23165480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f22990 0x55a860f21240 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 --2- 172.21.15.5:0/23165480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f1e910 0x55a860f20d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 -- 172.21.15.5:0/23165480 >> 172.21.15.5:0/23165480 conn(0x55a860f597a0 msgr2=0x55a860f794e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 -- 172.21.15.5:0/23165480 shutdown_connections 2024-08-18T22:20:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 -- 172.21.15.5:0/23165480 wait complete. 2024-08-18T22:20:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 -- start start 2024-08-18T22:20:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.965+0000 7f8c34b23000 1 Processor -- start 2024-08-18T22:20:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f1e910 0x55a860fdf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860fdf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860fdfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a860d281d0 con 0x55a860f6c670 2024-08-18T22:20:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a860d06900 con 0x55a860f1e910 2024-08-18T22:20:29.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a860d6e6d0 con 0x55a860f22990 2024-08-18T22:20:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 10 client.0 _ll_register_callbacks cb 0x7f8c180c6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:20:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860fdfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860fdfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46194/0 (socket says 172.21.15.5:46194) 2024-08-18T22:20:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860fdf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2b400640 1 -- 172.21.15.5:0/2579505798 learned_addr learned my addr 172.21.15.5:0/2579505798 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2aa00640 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f1e910 0x55a860fdf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2b400640 1 -- 172.21.15.5:0/2579505798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 msgr2=0x55a860fdf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2b400640 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860fdf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2b400640 1 -- 172.21.15.5:0/2579505798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f1e910 msgr2=0x55a860fdf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2b400640 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f1e910 0x55a860fdf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2b400640 1 -- 172.21.15.5:0/2579505798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a860d20810 con 0x55a860f6c670 2024-08-18T22:20:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2b400640 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860fdfc60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8c24001f80 tx=0x7f8c24005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f1c9fefe433d6a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c0be00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:20:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c0be00640 1 -- 172.21.15.5:0/2579505798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2401a070 con 0x55a860f6c670 2024-08-18T22:20:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c0be00640 1 -- 172.21.15.5:0/2579505798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8c24016630 con 0x55a860f6c670 2024-08-18T22:20:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 -- 172.21.15.5:0/2579505798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c180b2040 con 0x55a860f6c670 2024-08-18T22:20:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c0be00640 1 -- 172.21.15.5:0/2579505798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8c24016830 con 0x55a860f6c670 2024-08-18T22:20:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 10 client.5106 fetch_fsmap learned FSMap version 17 2024-08-18T22:20:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 -- 172.21.15.5:0/2579505798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55a860d05d30 con 0x55a860f6c670 2024-08-18T22:20:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c0be00640 1 -- 172.21.15.5:0/2579505798 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c180b2040 con 0x55a860f6c670 2024-08-18T22:20:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c0be00640 1 -- 172.21.15.5:0/2579505798 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f8c240169d0 con 0x55a860f6c670 2024-08-18T22:20:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 10 client.5106 fetch_fsmap finished waiting for FSMap version 17 2024-08-18T22:20:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 10 client.5106 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:20:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 20 client.5106 populate_metadata read hostname 'smithi005' 2024-08-18T22:20:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55a860f81a90 0x55a860f80bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 4 client.5106 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:20:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 -- 172.21.15.5:0/2579505798 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "status"}) -- 0x55a860d7caf0 con 0x55a860f81a90 2024-08-18T22:20:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2aa00640 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55a860f81a90 0x55a860f80bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c2aa00640 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55a860f81a90 0x55a860f80bb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f5667f806300232 server_cookie=95d96f7194e3b08f in_seq=0 out_seq=0 2024-08-18T22:20:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c0be00640 10 client.5106 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:20:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c0be00640 1 -- 172.21.15.5:0/2579505798 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a860d7caf0 con 0x55a860f81a90 2024-08-18T22:20:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c0be00640 10 client.5106 handle_command_reply: tid=0 2024-08-18T22:20:29.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 client.5106 shutdown 2024-08-18T22:20:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 -- 172.21.15.5:0/2579505798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 msgr2=0x55a860fdfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860fdfc60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8c24001f80 tx=0x7f8c24005420 comp rx=0 tx=0).stop 2024-08-18T22:20:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 -- 172.21.15.5:0/2579505798 shutdown_connections 2024-08-18T22:20:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55a860f81a90 0x55a860f80bb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a860f6c670 0x55a860fdfc60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a860f22990 0x55a860fdf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 --2- 172.21.15.5:0/2579505798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a860f1e910 0x55a860fdf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c0be00640 0 client.5106 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:20:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.969+0000 7f8c34b23000 1 -- 172.21.15.5:0/2579505798 >> 172.21.15.5:0/2579505798 conn(0x55a860f597a0 msgr2=0x55a860f6a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c34b23000 1 -- 172.21.15.5:0/2579505798 shutdown_connections 2024-08-18T22:20:29.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c34b23000 1 -- 172.21.15.5:0/2579505798 wait complete. 2024-08-18T22:20:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c34b23000 20 client.5106 trim_cache size 0 max 16384 2024-08-18T22:20:29.985 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:20:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:20:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:20:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4908, 2024-08-18T22:20:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:20:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:20:29.985 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:20:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.485774558999999, 2024-08-18T22:20:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 17, 2024-08-18T22:20:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 39, 2024-08-18T22:20:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 39, 2024-08-18T22:20:29.986 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 17.770776966 2024-08-18T22:20:29.986 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:20:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 -- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c0c0678f0 msgr2=0x7f8c0c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c0c0678f0 0x7f8c0c069db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c180ae000 tx=0x7f8c18008040 comp rx=0 tx=0).stop 2024-08-18T22:20:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 -- 172.21.15.5:0/1948359846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c0d12a0 msgr2=0x7f8c2c15ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c0d12a0 0x7f8c2c15ada0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00c450 tx=0x7f8c1c00c910 comp rx=0 tx=0).stop 2024-08-18T22:20:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 -- 172.21.15.5:0/1948359846 shutdown_connections 2024-08-18T22:20:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c0c0678f0 0x7f8c0c069db0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c2c15e380 0x7f8c2c0c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c2c0d2f00 0x7f8c2c158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 --2- 172.21.15.5:0/1948359846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c0d12a0 0x7f8c2c15ada0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:29.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 -- 172.21.15.5:0/1948359846 >> 172.21.15.5:0/1948359846 conn(0x7f8c2c09d4e0 msgr2=0x7f8c2c1566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:29.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 -- 172.21.15.5:0/1948359846 shutdown_connections 2024-08-18T22:20:29.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:29.973+0000 7f8c2be00640 1 -- 172.21.15.5:0/1948359846 wait complete. 2024-08-18T22:20:29.994 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:20:30.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a8a00640 1 Processor -- start 2024-08-18T22:20:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a8a00640 1 -- start start 2024-08-18T22:20:30.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a8a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc4a415c180 0x7fc4a40b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:30.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a4071c90 0x7fc4a415c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:30.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a8a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a40b5e30 con 0x7fc4a406fad0 2024-08-18T22:20:30.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a8a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a415caa0 con 0x7fc4a415c180 2024-08-18T22:20:30.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a8a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a40b6110 con 0x7fc4a4071c90 2024-08-18T22:20:30.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a1e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc4a415c180 0x7fc4a40b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:30.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a1400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc4a406fad0 0x7fc4a4071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60960/0 (socket says 172.21.15.5:60960) 2024-08-18T22:20:30.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a1400640 1 -- 172.21.15.5:0/2454842106 learned_addr learned my addr 172.21.15.5:0/2454842106 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a2800640 1 --2- 172.21.15.5:0/2454842106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a4071c90 0x7fc4a415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a1e00640 1 -- 172.21.15.5:0/2454842106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a4071c90 msgr2=0x7fc4a415c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a1e00640 1 --2- 172.21.15.5:0/2454842106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a4071c90 0x7fc4a415c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a1e00640 1 -- 172.21.15.5:0/2454842106 >> v1:172.21.15.5:6789/0 conn(0x7fc4a406fad0 legacy=0x7fc4a4071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a1e00640 1 -- 172.21.15.5:0/2454842106 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a40b63f0 con 0x7fc4a415c180 2024-08-18T22:20:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a0a00640 1 -- 172.21.15.5:0/2454842106 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530315208 0 0) 0x7fc4a40b5e30 con 0x7fc4a406fad0 2024-08-18T22:20:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.133+0000 7fc4a2800640 1 --2- 172.21.15.5:0/2454842106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a4071c90 0x7fc4a415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a1e00640 1 --2- 172.21.15.5:0/2454842106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a415c180 0x7fc4a40b57c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc4940097c0 tx=0x7fc49401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e264bd3e7df969ed server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a0a00640 1 -- 172.21.15.5:0/2454842106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4940b1070 con 0x7fc4a415c180 2024-08-18T22:20:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a0a00640 1 -- 172.21.15.5:0/2454842106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4940ac640 con 0x7fc4a415c180 2024-08-18T22:20:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a0a00640 1 -- 172.21.15.5:0/2454842106 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4940aca10 con 0x7fc4a415c180 2024-08-18T22:20:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a8a00640 1 -- 172.21.15.5:0/2454842106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a415c180 msgr2=0x7fc4a40b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a8a00640 1 --2- 172.21.15.5:0/2454842106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a415c180 0x7fc4a40b57c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc4940097c0 tx=0x7fc49401c350 comp rx=0 tx=0).stop 2024-08-18T22:20:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a8a00640 1 -- 172.21.15.5:0/2454842106 shutdown_connections 2024-08-18T22:20:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a8a00640 1 --2- 172.21.15.5:0/2454842106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a4071c90 0x7fc4a415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a8a00640 1 --2- 172.21.15.5:0/2454842106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a415c180 0x7fc4a40b57c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a8a00640 1 -- 172.21.15.5:0/2454842106 >> 172.21.15.5:0/2454842106 conn(0x7fc4a40b3eb0 msgr2=0x7fc4a40b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a8a00640 1 -- 172.21.15.5:0/2454842106 shutdown_connections 2024-08-18T22:20:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.137+0000 7fc4a8a00640 1 -- 172.21.15.5:0/2454842106 wait complete. 2024-08-18T22:20:30.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a8a00640 1 Processor -- start 2024-08-18T22:20:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a8a00640 1 -- start start 2024-08-18T22:20:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a8a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a406fad0 0x7fc4a414e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a4071c90 0x7fc4a414e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a8a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a415c180 0x7fc4a415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a8a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a40d1c30 con 0x7fc4a415c180 2024-08-18T22:20:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a8a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a40d1ab0 con 0x7fc4a406fad0 2024-08-18T22:20:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a8a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a40d1db0 con 0x7fc4a4071c90 2024-08-18T22:20:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a415c180 0x7fc4a415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a415c180 0x7fc4a415a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46208/0 (socket says 172.21.15.5:46208) 2024-08-18T22:20:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a2800640 1 -- 172.21.15.5:0/1854544120 learned_addr learned my addr 172.21.15.5:0/1854544120 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a1e00640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a406fad0 0x7fc4a414e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a1400640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a4071c90 0x7fc4a414e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a2800640 1 -- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a4071c90 msgr2=0x7fc4a414e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a2800640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a4071c90 0x7fc4a414e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a2800640 1 -- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a406fad0 msgr2=0x7fc4a414e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a2800640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a406fad0 0x7fc4a414e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a2800640 1 -- 172.21.15.5:0/1854544120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a4156d40 con 0x7fc4a415c180 2024-08-18T22:20:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a2800640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a415c180 0x7fc4a415a880 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009fa0 tx=0x7fc49c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc49a000640 1 -- 172.21.15.5:0/1854544120 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c01a070 con 0x7fc4a415c180 2024-08-18T22:20:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc49a000640 1 -- 172.21.15.5:0/1854544120 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c003bc0 con 0x7fc4a415c180 2024-08-18T22:20:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc49a000640 1 -- 172.21.15.5:0/1854544120 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c004030 con 0x7fc4a415c180 2024-08-18T22:20:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a8a00640 1 -- 172.21.15.5:0/1854544120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a4157020 con 0x7fc4a415c180 2024-08-18T22:20:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a8a00640 1 -- 172.21.15.5:0/1854544120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a41575e0 con 0x7fc4a415c180 2024-08-18T22:20:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.141+0000 7fc4a8a00640 1 -- 172.21.15.5:0/1854544120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a415c560 con 0x7fc4a415c180 2024-08-18T22:20:30.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.145+0000 7fc49a000640 1 -- 172.21.15.5:0/1854544120 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc49c01d070 con 0x7fc4a415c180 2024-08-18T22:20:30.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.145+0000 7fc49a000640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc4840678c0 0x7fc484069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.145+0000 7fc49a000640 1 -- 172.21.15.5:0/1854544120 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc49c086120 con 0x7fc4a415c180 2024-08-18T22:20:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.145+0000 7fc4a1e00640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc4840678c0 0x7fc484069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:30.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.145+0000 7fc4a1e00640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc4840678c0 0x7fc484069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc4940ae000 tx=0x7fc4940a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:30.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.149+0000 7fc49a000640 1 -- 172.21.15.5:0/1854544120 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc49c010070 con 0x7fc4a415c180 2024-08-18T22:20:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.349+0000 7fc4a8a00640 1 -- 172.21.15.5:0/1854544120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc4a40cf7d0 con 0x7fc4a415c180 2024-08-18T22:20:30.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.349+0000 7fc49a000640 1 -- 172.21.15.5:0/1854544120 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fc49c056470 con 0x7fc4a415c180 2024-08-18T22:20:30.353 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:20:30.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 -- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc4840678c0 msgr2=0x7fc484069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:30.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc4840678c0 0x7fc484069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc4940ae000 tx=0x7fc4940a6070 comp rx=0 tx=0).stop 2024-08-18T22:20:30.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 -- 172.21.15.5:0/1854544120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a415c180 msgr2=0x7fc4a415a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:30.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a415c180 0x7fc4a415a880 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009fa0 tx=0x7fc49c00d560 comp rx=0 tx=0).stop 2024-08-18T22:20:30.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 -- 172.21.15.5:0/1854544120 shutdown_connections 2024-08-18T22:20:30.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc4840678c0 0x7fc484069d80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:30.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a415c180 0x7fc4a415a880 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:30.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4a4071c90 0x7fc4a414e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:30.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 --2- 172.21.15.5:0/1854544120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a406fad0 0x7fc4a414e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:30.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 -- 172.21.15.5:0/1854544120 >> 172.21.15.5:0/1854544120 conn(0x7fc4a40b3eb0 msgr2=0x7fc4a40b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:30.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 -- 172.21.15.5:0/1854544120 shutdown_connections 2024-08-18T22:20:30.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30.353+0000 7fc4a8a00640 1 -- 172.21.15.5:0/1854544120 wait complete. 2024-08-18T22:20:30.375 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:20:30.375 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:20:30.375 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:20:30.375 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:20:30.375 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:20:30.375 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:20:30.375 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:20:30.375 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:20:30.375 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:20:30.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:30.376 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:20:30.385 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:20:30.386 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:20:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:20:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:20:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:20:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42371sec preferred_lft 42371sec 2024-08-18T22:20:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:20:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:20:30.386 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:20:30.386 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:20:30.387 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:20:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:20:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:20:30.388 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:20:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:20:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:20:30.388 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:20:30.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:30.389 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:20:30.451 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:20:30.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:30.453 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:20:30.510 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:20:30.510 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:20:30.510 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:20:30.511 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:20:30.511 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:20:30.511 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:20:30.511 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:20:30.511 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:20:30.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:20:30.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:20:30.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:20:30.511 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:20:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:20:30.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:20:30.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:30.648 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:20:30.657 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:20:30.657 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:20:30.658 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:20:30.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:30.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:20:30.725 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:20:30.726 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:20:30.777 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:20:30.777 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:20:30.777 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:20:30.828 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:20:30.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:30.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:20:30.923 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:20:30.923 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:20:30.923 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:20:30.938 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:20:30.938 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:20:30.938 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:20:30.938 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:20:30.938 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:20:30.948 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:20:30.948 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:20:30.948 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:20:30.948 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:20:30.948 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:20:30.948 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:20:30.948 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:20:30.949 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:20:30.953 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:20:30.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:30.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:20:30.974 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:20:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:20:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:20:31.080 INFO:teuthology.orchestra.run.smithi005.stdout:client4948 2024-08-18T22:20:31.080 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:20:31.080 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:31.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-08-18T22:20:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbe600640 1 Processor -- start 2024-08-18T22:20:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbe600640 1 -- start start 2024-08-18T22:20:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbe600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db815f120 0x7f8db80b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbe600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db813f730 con 0x7f8db815f500 2024-08-18T22:20:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbe600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db813fa10 con 0x7f8db815d610 2024-08-18T22:20:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbe600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8db813fcf0 con 0x7f8db815f120 2024-08-18T22:20:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8db815f500 0x7f8db815c7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60964/0 (socket says 172.21.15.5:60964) 2024-08-18T22:20:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7e00640 1 -- 172.21.15.5:0/1017116980 learned_addr learned my addr 172.21.15.5:0/1017116980 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:20:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbd200640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db815f120 0x7f8db80b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475895961 0 0) 0x7f8db813f730 con 0x7f8db815f500 2024-08-18T22:20:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d9c003530 con 0x7f8db815f500 2024-08-18T22:20:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2875756357 0 0) 0x7f8db813fa10 con 0x7f8db815d610 2024-08-18T22:20:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8db813f730 con 0x7f8db815d610 2024-08-18T22:20:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3744557047 0 0) 0x7f8d9c003530 con 0x7f8db815f500 2024-08-18T22:20:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db815f120 msgr2=0x7f8db80b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db815f120 0x7f8db80b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 >> v1:172.21.15.117:6789/0 conn(0x7f8db815d610 legacy=0x7f8db81404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db813ffd0 con 0x7f8db815f500 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f8da0001680 con 0x7f8db815f500 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 >> v1:172.21.15.5:6789/0 conn(0x7f8db815f500 legacy=0x7f8db815c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9c003bf0 0x7f8d9c003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db815f120 0x7f8d9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d9c004d50 0x7f8d9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8db813fcf0 con 0x7f8d9c003bf0 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c00bb90 con 0x7f8d9c004d50 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9c00bd90 con 0x7f8db815f120 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbd200640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9c003bf0 0x7f8d9c003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7e00640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db815f120 0x7f8d9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbdc00640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d9c004d50 0x7f8d9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbd200640 1 -- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db815f120 msgr2=0x7f8d9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbd200640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db815f120 0x7f8d9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbd200640 1 -- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d9c004d50 msgr2=0x7f8d9c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:20:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbd200640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d9c004d50 0x7f8d9c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8dbd200640 1 -- 172.21.15.5:0/1017116980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c003530 con 0x7f8d9c003bf0 2024-08-18T22:20:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.281+0000 7f8db7e00640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db815f120 0x7f8d9c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:20:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.285+0000 7f8dbd200640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9c003bf0 0x7f8d9c003ff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009ae0 tx=0x7f8db001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ef5d1cbbd7801c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.285+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db00b2070 con 0x7f8d9c003bf0 2024-08-18T22:20:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.285+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db815d2f0 con 0x7f8d9c003bf0 2024-08-18T22:20:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.285+0000 7f8db7400640 1 -- 172.21.15.5:0/1017116980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db00096b0 con 0x7f8d9c003bf0 2024-08-18T22:20:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.285+0000 7f8dbe600640 1 -- 172.21.15.5:0/1017116980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9c003bf0 msgr2=0x7f8d9c003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.285+0000 7f8dbe600640 1 --2- 172.21.15.5:0/1017116980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d9c003bf0 0x7f8d9c003ff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009ae0 tx=0x7f8db001ca70 comp rx=0 tx=0).stop 2024-08-18T22:20:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.285+0000 7f8dbdc00640 1 -- 172.21.15.5:0/1017116980 reap_dead start 2024-08-18T22:20:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.285+0000 7f8dbe600640 1 -- 172.21.15.5:0/1017116980 shutdown_connections 2024-08-18T22:20:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.285+0000 7f8dbe600640 1 -- 172.21.15.5:0/1017116980 >> 172.21.15.5:0/1017116980 conn(0x7f8db8067840 msgr2=0x7f8db8067c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.285+0000 7f8dbe600640 1 -- 172.21.15.5:0/1017116980 shutdown_connections 2024-08-18T22:20:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.285+0000 7f8dbe600640 1 -- 172.21.15.5:0/1017116980 wait complete. 2024-08-18T22:20:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8dbe600640 1 Processor -- start 2024-08-18T22:20:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8dbe600640 1 -- start start 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8dbe600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d9c003bf0 0x7f8db806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8dbe600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db8159260 0x7f8db8156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8dbe600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db81570c0 0x7f8db813e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8dbe600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8db80b4320 con 0x7f8db8159260 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8dbe600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8db80b41a0 con 0x7f8db81570c0 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8dbe600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8db80b44a0 con 0x7f8d9c003bf0 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db8159260 0x7f8db8156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db8159260 0x7f8db8156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46222/0 (socket says 172.21.15.5:46222) 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db7e00640 1 -- 172.21.15.5:0/1727574700 learned_addr learned my addr 172.21.15.5:0/1727574700 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8dbd200640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d9c003bf0 0x7f8db806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db7e00640 1 -- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d9c003bf0 msgr2=0x7f8db806d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:31.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db7e00640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d9c003bf0 0x7f8db806d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db7e00640 1 -- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db81570c0 msgr2=0x7f8db813e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db7e00640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db81570c0 0x7f8db813e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db7e00640 1 -- 172.21.15.5:0/1727574700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db8159700 con 0x7f8db8159260 2024-08-18T22:20:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db7e00640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db8159260 0x7f8db8156b80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8da0000c10 tx=0x7f8da000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db4c00640 1 -- 172.21.15.5:0/1727574700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da000c610 con 0x7f8db8159260 2024-08-18T22:20:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db4c00640 1 -- 172.21.15.5:0/1727574700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da0018070 con 0x7f8db8159260 2024-08-18T22:20:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8dbe600640 1 -- 172.21.15.5:0/1727574700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db81599e0 con 0x7f8db8159260 2024-08-18T22:20:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8db4c00640 1 -- 172.21.15.5:0/1727574700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da000c9b0 con 0x7f8db8159260 2024-08-18T22:20:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.289+0000 7f8dbe600640 1 -- 172.21.15.5:0/1727574700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db806d7b0 con 0x7f8db8159260 2024-08-18T22:20:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.293+0000 7f8dbe600640 1 -- 172.21.15.5:0/1727574700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db81404f0 con 0x7f8db8159260 2024-08-18T22:20:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.293+0000 7f8db4c00640 1 -- 172.21.15.5:0/1727574700 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8da000cb50 con 0x7f8db8159260 2024-08-18T22:20:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.293+0000 7f8db4c00640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d940678f0 0x7f8d94069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:20:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.293+0000 7f8db4c00640 1 -- 172.21.15.5:0/1727574700 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8da00857e0 con 0x7f8db8159260 2024-08-18T22:20:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.293+0000 7f8dbd200640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d940678f0 0x7f8d94069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:20:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.293+0000 7f8dbd200640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d940678f0 0x7f8d94069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8db00af000 tx=0x7f8db00046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:20:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.297+0000 7f8db4c00640 1 -- 172.21.15.5:0/1727574700 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8da0056180 con 0x7f8db8159260 2024-08-18T22:20:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.497+0000 7f8dbe600640 1 -- 172.21.15.5:0/1727574700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f8db8152b40 con 0x7f8db8159260 2024-08-18T22:20:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.537+0000 7f8db4c00640 1 -- 172.21.15.5:0/1727574700 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v18) ==== 167+0+0 (secure 0 0 0) 0x7f8da0055a80 con 0x7f8db8159260 2024-08-18T22:20:31.541 INFO:teuthology.orchestra.run.smithi005.stderr:enabled new snapshots 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 -- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d940678f0 msgr2=0x7f8d94069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d940678f0 0x7f8d94069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8db00af000 tx=0x7f8db00046d0 comp rx=0 tx=0).stop 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 -- 172.21.15.5:0/1727574700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db8159260 msgr2=0x7f8db8156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db8159260 0x7f8db8156b80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8da0000c10 tx=0x7f8da000ec10 comp rx=0 tx=0).stop 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 -- 172.21.15.5:0/1727574700 shutdown_connections 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d940678f0 0x7f8d94069db0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db81570c0 0x7f8db813e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8db8159260 0x7f8db8156b80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 --2- 172.21.15.5:0/1727574700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d9c003bf0 0x7f8db806d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 -- 172.21.15.5:0/1727574700 >> 172.21.15.5:0/1727574700 conn(0x7f8db8067840 msgr2=0x7f8db80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 -- 172.21.15.5:0/1727574700 shutdown_connections 2024-08-18T22:20:31.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:31.541+0000 7f8dbe600640 1 -- 172.21.15.5:0/1727574700 wait complete. 2024-08-18T22:20:31.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:31.563 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-08-18T22:20:31.580 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:20:31.580 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:20:31.634 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:20:31.634 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:20:31.634 DEBUG:teuthology.orchestra.run.smithi005:> import uuid 2024-08-18T22:20:31.634 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:20:31.634 DEBUG:teuthology.orchestra.run.smithi005:> n = 2000 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = False 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> if 3 > 0: 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = True 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> dpath = os.path.dirname(path) 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> fnameprefix = os.path.basename(path) 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> os.makedirs(dpath, exist_ok=True) 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> for i in range(n): 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-08-18T22:20:31.635 DEBUG:teuthology.orchestra.run.smithi005:> with open(fpath, '"'"'w'"'"') as f: 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> f.write(f"{i}") 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> f.flush() 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(f.fileno()) 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> os.unlink(fpath) 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> if create_hard_links: 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> for j in range(3): 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:20:31.636 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-08-18T22:20:31.637 DEBUG:teuthology.orchestra.run.smithi005:> finally: 2024-08-18T22:20:31.637 DEBUG:teuthology.orchestra.run.smithi005:> os.close(dirfd) 2024-08-18T22:20:31.637 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:20:51.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:20:51.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:20:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:20:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:20:55.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:55.525 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-08-18T22:20:55.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:20:55.803 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-08-18T22:21:21.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:21:21.720 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:21:24.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:21:24.293 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-08-18T22:21:24.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-08-18T22:21:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f73200640 1 Processor -- start 2024-08-18T22:21:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f73200640 1 -- start start 2024-08-18T22:21:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f73200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f6c15c180 0x7f6f6c0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f73200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f6c15c560 0x7f6f6c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f73200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c0cfb00 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f73200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6f6c15d040 con 0x7f6f6c15c560 2024-08-18T22:21:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f73200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6c15c9f0 con 0x7f6f6c15c180 2024-08-18T22:21:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f6b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f6c15c560 0x7f6f6c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f71200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6f6c15d4d0 0x7f6f6c15fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42612/0 (socket says 172.21.15.5:42612) 2024-08-18T22:21:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f71200640 1 -- 172.21.15.5:0/386415788 learned_addr learned my addr 172.21.15.5:0/386415788 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:21:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f6be00640 1 --2- 172.21.15.5:0/386415788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f6c15c180 0x7f6f6c0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f6aa00640 1 -- 172.21.15.5:0/386415788 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 945270860 0 0) 0x7f6f6c0cfb00 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f6aa00640 1 -- 172.21.15.5:0/386415788 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f50003530 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f6b400640 1 -- 172.21.15.5:0/386415788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f6c15c180 msgr2=0x7f6f6c0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f6b400640 1 --2- 172.21.15.5:0/386415788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f6c15c180 0x7f6f6c0cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f6b400640 1 -- 172.21.15.5:0/386415788 >> v1:172.21.15.5:6789/0 conn(0x7f6f6c15d4d0 legacy=0x7f6f6c15fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.488+0000 7f6f6b400640 1 -- 172.21.15.5:0/386415788 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c15ccd0 con 0x7f6f6c15c560 2024-08-18T22:21:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f6b400640 1 --2- 172.21.15.5:0/386415788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c15c560 0x7f6f6c0ce450 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6f580097c0 tx=0x7f6f5801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a793acc103467c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f6aa00640 1 -- 172.21.15.5:0/386415788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f580ab430 con 0x7f6f6c15c560 2024-08-18T22:21:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f6aa00640 1 -- 172.21.15.5:0/386415788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f580b0070 con 0x7f6f6c15c560 2024-08-18T22:21:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f6aa00640 1 -- 172.21.15.5:0/386415788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f580ab7d0 con 0x7f6f6c15c560 2024-08-18T22:21:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f73200640 1 -- 172.21.15.5:0/386415788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c15c560 msgr2=0x7f6f6c0ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f73200640 1 --2- 172.21.15.5:0/386415788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c15c560 0x7f6f6c0ce450 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6f580097c0 tx=0x7f6f5801c410 comp rx=0 tx=0).stop 2024-08-18T22:21:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f73200640 1 -- 172.21.15.5:0/386415788 shutdown_connections 2024-08-18T22:21:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f73200640 1 --2- 172.21.15.5:0/386415788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c15c560 0x7f6f6c0ce450 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f73200640 1 --2- 172.21.15.5:0/386415788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f6c15c180 0x7f6f6c0cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f73200640 1 -- 172.21.15.5:0/386415788 >> 172.21.15.5:0/386415788 conn(0x7f6f6c0b1dc0 msgr2=0x7f6f6c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f73200640 1 -- 172.21.15.5:0/386415788 shutdown_connections 2024-08-18T22:21:24.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.492+0000 7f6f73200640 1 -- 172.21.15.5:0/386415788 wait complete. 2024-08-18T22:21:24.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f73200640 1 Processor -- start 2024-08-18T22:21:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f73200640 1 -- start start 2024-08-18T22:21:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f73200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f6c15c180 0x7f6f6c14f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f73200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c15d4d0 0x7f6f6c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f73200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f6c14fcf0 0x7f6f6c15e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f73200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c1692b0 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f73200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c169130 con 0x7f6f6c15c180 2024-08-18T22:21:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f73200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6c169430 con 0x7f6f6c14fcf0 2024-08-18T22:21:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f6b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c15d4d0 0x7f6f6c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f6b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c15d4d0 0x7f6f6c0b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57372/0 (socket says 172.21.15.5:57372) 2024-08-18T22:21:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f6b400640 1 -- 172.21.15.5:0/1034608263 learned_addr learned my addr 172.21.15.5:0/1034608263 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f71200640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f6c14fcf0 0x7f6f6c15e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f6be00640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f6c15c180 0x7f6f6c14f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f6b400640 1 -- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f6c14fcf0 msgr2=0x7f6f6c15e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f6b400640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f6c14fcf0 0x7f6f6c15e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f6b400640 1 -- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f6c15c180 msgr2=0x7f6f6c14f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f6b400640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f6c15c180 0x7f6f6c14f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f6b400640 1 -- 172.21.15.5:0/1034608263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c071cc0 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f6b400640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c15d4d0 0x7f6f6c0b0750 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6f5801a040 tx=0x7f6f580191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f63e00640 1 -- 172.21.15.5:0/1034608263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f580039b0 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f63e00640 1 -- 172.21.15.5:0/1034608263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f58003b50 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f63e00640 1 -- 172.21.15.5:0/1034608263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f580ab430 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f73200640 1 -- 172.21.15.5:0/1034608263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6c071fa0 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.496+0000 7f6f73200640 1 -- 172.21.15.5:0/1034608263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6c072560 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.500+0000 7f6f63e00640 1 -- 172.21.15.5:0/1034608263 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f580ab5d0 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.500+0000 7f6f63e00640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f4c0678c0 0x7f6f4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.500+0000 7f6f63e00640 1 -- 172.21.15.5:0/1034608263 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f6f5811fde0 con 0x7f6f6c15d4d0 2024-08-18T22:21:24.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.500+0000 7f6f6be00640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f4c0678c0 0x7f6f4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.500+0000 7f6f767a3000 1 Processor -- start 2024-08-18T22:21:24.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.500+0000 7f6f767a3000 1 -- start start 2024-08-18T22:21:24.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.500+0000 7f6f6be00640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f4c0678c0 0x7f6f4c069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009ac0 tx=0x7f6f5c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f8ef70 0x556624f8f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624f42630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f42b70 0x556624f42f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556624d93470 con 0x556624f8f890 2024-08-18T22:21:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556624d4dad0 con 0x556624f8ef70 2024-08-18T22:21:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x556624d8f430 con 0x556624f42b70 2024-08-18T22:21:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f6b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624f42630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f6b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624f42630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57388/0 (socket says 172.21.15.5:57388) 2024-08-18T22:21:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f6b400640 1 -- 172.21.15.5:0/1009498479 learned_addr learned my addr 172.21.15.5:0/1009498479 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f6be00640 1 --2- 172.21.15.5:0/1009498479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f8ef70 0x556624f8f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f71200640 1 --2- 172.21.15.5:0/1009498479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f42b70 0x556624f42f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f6b400640 1 -- 172.21.15.5:0/1009498479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f42b70 msgr2=0x556624f42f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f6b400640 1 --2- 172.21.15.5:0/1009498479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f42b70 0x556624f42f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f6b400640 1 -- 172.21.15.5:0/1009498479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f8ef70 msgr2=0x556624f8f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f6b400640 1 --2- 172.21.15.5:0/1009498479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f8ef70 0x556624f8f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f6b400640 1 -- 172.21.15.5:0/1009498479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556624d33a10 con 0x556624f8f890 2024-08-18T22:21:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f6b400640 1 --2- 172.21.15.5:0/1009498479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624f42630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f580f8680 tx=0x7f6f580efb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cb22fff3a2d0b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f60c00640 1 -- 172.21.15.5:0/1009498479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f580ee380 con 0x556624f8f890 2024-08-18T22:21:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f60c00640 1 -- 172.21.15.5:0/1009498479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f580b0040 con 0x556624f8f890 2024-08-18T22:21:24.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f60c00640 1 -- 172.21.15.5:0/1009498479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f580ec6f0 con 0x556624f8f890 2024-08-18T22:21:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- 172.21.15.5:0/1009498479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 msgr2=0x556624f42630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 --2- 172.21.15.5:0/1009498479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624f42630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f580f8680 tx=0x7f6f580efb10 comp rx=0 tx=0).stop 2024-08-18T22:21:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- 172.21.15.5:0/1009498479 shutdown_connections 2024-08-18T22:21:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 --2- 172.21.15.5:0/1009498479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f42b70 0x556624f42f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 --2- 172.21.15.5:0/1009498479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624f42630 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 --2- 172.21.15.5:0/1009498479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f8ef70 0x556624f8f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- 172.21.15.5:0/1009498479 >> 172.21.15.5:0/1009498479 conn(0x556624f3c680 msgr2=0x556624f71df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- 172.21.15.5:0/1009498479 shutdown_connections 2024-08-18T22:21:24.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- 172.21.15.5:0/1009498479 wait complete. 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- start start 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 Processor -- start 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f42b70 0x556624f493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624f498f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f8f890 0x556624f49e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556624d5e770 con 0x556624f42b70 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556624d34c80 con 0x556624f8f890 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x556624e14130 con 0x556624f8ef70 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f767a3000 10 client.0 _ll_register_callbacks cb 0x556624f300e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.504+0000 7f6f6be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f42b70 0x556624f493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f42b70 0x556624f493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57402/0 (socket says 172.21.15.5:57402) 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6be00640 1 -- 172.21.15.5:0/4228353093 learned_addr learned my addr 172.21.15.5:0/4228353093 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:24.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6b400640 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624f498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f71200640 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f8f890 0x556624f49e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6be00640 1 -- 172.21.15.5:0/4228353093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 msgr2=0x556624f498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6be00640 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624f498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6be00640 1 -- 172.21.15.5:0/4228353093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f8f890 msgr2=0x556624f49e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6be00640 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f8f890 0x556624f49e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6be00640 1 -- 172.21.15.5:0/4228353093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556624d4bfe0 con 0x556624f42b70 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6b400640 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624f498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6be00640 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f42b70 0x556624f493b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c003620 tx=0x7f6f5c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488ddf91926b6594 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f55600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f55600640 1 -- 172.21.15.5:0/4228353093 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c027070 con 0x556624f42b70 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f55600640 1 -- 172.21.15.5:0/4228353093 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f6f5c014650 con 0x556624f42b70 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 -- 172.21.15.5:0/4228353093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f580b0040 con 0x556624f42b70 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f55600640 1 -- 172.21.15.5:0/4228353093 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f6f5c032050 con 0x556624f42b70 2024-08-18T22:21:24.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 10 client.5136 fetch_fsmap learned FSMap version 18 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 -- 172.21.15.5:0/4228353093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556624d5fed0 con 0x556624f42b70 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f55600640 1 -- 172.21.15.5:0/4228353093 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f580b0040 con 0x556624f42b70 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f55600640 1 -- 172.21.15.5:0/4228353093 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f6f5c035020 con 0x556624f42b70 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 10 client.5136 fetch_fsmap finished waiting for FSMap version 18 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 10 client.5136 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 20 client.5136 populate_metadata read hostname 'smithi005' 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x556624f4a840 0x556624fa1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 4 client.5136 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 -- 172.21.15.5:0/4228353093 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556624d2dd90 con 0x556624f4a840 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6b400640 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x556624f4a840 0x556624fa1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f6b400640 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x556624f4a840 0x556624fa1020 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7a88076307792c server_cookie=469c84a981226486 in_seq=0 out_seq=0 2024-08-18T22:21:24.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f55600640 10 client.5136 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:24.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f55600640 1 -- 172.21.15.5:0/4228353093 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556624d2dd90 con 0x556624f4a840 2024-08-18T22:21:24.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f55600640 10 client.5136 handle_command_reply: tid=0 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 client.5136 shutdown 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 -- 172.21.15.5:0/4228353093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f42b70 msgr2=0x556624f493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f42b70 0x556624f493b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c003620 tx=0x7f6f5c0046d0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 -- 172.21.15.5:0/4228353093 shutdown_connections 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x556624f4a840 0x556624fa1020 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f8f890 0x556624f49e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624f498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 --2- 172.21.15.5:0/4228353093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f42b70 0x556624f493b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 -- 172.21.15.5:0/4228353093 >> 172.21.15.5:0/4228353093 conn(0x556624f3c680 msgr2=0x556624f71df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f55600640 0 client.5136 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 -- 172.21.15.5:0/4228353093 shutdown_connections 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 1 -- 172.21.15.5:0/4228353093 wait complete. 2024-08-18T22:21:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.508+0000 7f6f767a3000 20 client.5136 trim_cache size 0 max 16384 2024-08-18T22:21:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 Processor -- start 2024-08-18T22:21:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 -- start start 2024-08-18T22:21:24.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 0x556624ffed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624fff280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fff7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c2041e0 con 0x556624f8f890 2024-08-18T22:21:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c203220 con 0x556624f42b70 2024-08-18T22:21:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6c073810 con 0x556624f8ef70 2024-08-18T22:21:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f71200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fff7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f71200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fff7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57418/0 (socket says 172.21.15.5:57418) 2024-08-18T22:21:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f71200640 1 -- 172.21.15.5:0/2412411043 learned_addr learned my addr 172.21.15.5:0/2412411043 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f6be00640 1 --2- 172.21.15.5:0/2412411043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 0x556624ffed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f6b400640 1 --2- 172.21.15.5:0/2412411043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624fff280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f71200640 1 -- 172.21.15.5:0/2412411043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 msgr2=0x556624fff280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f71200640 1 --2- 172.21.15.5:0/2412411043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624fff280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f71200640 1 -- 172.21.15.5:0/2412411043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 msgr2=0x556624ffed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f71200640 1 --2- 172.21.15.5:0/2412411043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 0x556624ffed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f71200640 1 -- 172.21.15.5:0/2412411043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556624f72330 con 0x556624f8f890 2024-08-18T22:21:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f6b400640 1 --2- 172.21.15.5:0/2412411043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624fff280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:21:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f71200640 1 --2- 172.21.15.5:0/2412411043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fff7c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f64007340 tx=0x7f6f64001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb3cfaae33ee993 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f57e00640 1 -- 172.21.15.5:0/2412411043 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f64007ad0 con 0x556624f8f890 2024-08-18T22:21:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f57e00640 1 -- 172.21.15.5:0/2412411043 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f640148a0 con 0x556624f8f890 2024-08-18T22:21:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f57e00640 1 -- 172.21.15.5:0/2412411043 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f64014c50 con 0x556624f8f890 2024-08-18T22:21:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 -- 172.21.15.5:0/2412411043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 msgr2=0x556624fff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 --2- 172.21.15.5:0/2412411043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fff7c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f64007340 tx=0x7f6f64001a20 comp rx=0 tx=0).stop 2024-08-18T22:21:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 -- 172.21.15.5:0/2412411043 shutdown_connections 2024-08-18T22:21:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 --2- 172.21.15.5:0/2412411043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fff7c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 --2- 172.21.15.5:0/2412411043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624fff280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 --2- 172.21.15.5:0/2412411043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 0x556624ffed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 -- 172.21.15.5:0/2412411043 >> 172.21.15.5:0/2412411043 conn(0x556624f3c680 msgr2=0x556624f416b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 -- 172.21.15.5:0/2412411043 shutdown_connections 2024-08-18T22:21:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 -- 172.21.15.5:0/2412411043 wait complete. 2024-08-18T22:21:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 -- start start 2024-08-18T22:21:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.528+0000 7f6f767a3000 1 Processor -- start 2024-08-18T22:21:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 0x556624fa42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624fa4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fbe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556624d3aa10 con 0x556624f8f890 2024-08-18T22:21:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c202c00 con 0x556624f42b70 2024-08-18T22:21:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x556624d92780 con 0x556624f8ef70 2024-08-18T22:21:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 10 client.0 _ll_register_callbacks cb 0x7f6f5c0041a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:21:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f71200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fbe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 0x556624fa42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624fa4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f71200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fbe350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57430/0 (socket says 172.21.15.5:57430) 2024-08-18T22:21:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 0x556624fa42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:48556/0 (socket says 172.21.15.5:48556) 2024-08-18T22:21:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f71200640 1 -- 172.21.15.5:0/265501795 learned_addr learned my addr 172.21.15.5:0/265501795 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6be00640 1 -- 172.21.15.5:0/265501795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 msgr2=0x556624fa4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6be00640 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624fa4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6be00640 1 -- 172.21.15.5:0/265501795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 msgr2=0x556624fbe350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6be00640 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fbe350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6be00640 1 -- 172.21.15.5:0/265501795 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556624e145c0 con 0x556624f42b70 2024-08-18T22:21:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f71200640 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fbe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6b400640 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624fa4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6be00640 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 0x556624fa42d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c011690 tx=0x7f6f5c019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5efc7208a354f9a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f55600640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-08-18T22:21:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f55600640 1 -- 172.21.15.5:0/265501795 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c027070 con 0x556624f42b70 2024-08-18T22:21:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f55600640 1 -- 172.21.15.5:0/265501795 <== mon.1 v2:172.21.15.117:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f6f5c02c440 con 0x556624f42b70 2024-08-18T22:21:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 1 -- 172.21.15.5:0/265501795 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f640148a0 con 0x556624f42b70 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f55600640 1 -- 172.21.15.5:0/265501795 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f6f5c02c640 con 0x556624f42b70 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 10 client.4966 fetch_fsmap learned FSMap version 18 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 1 -- 172.21.15.5:0/265501795 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556624d26c50 con 0x556624f42b70 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f55600640 1 -- 172.21.15.5:0/265501795 <== mon.1 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f640148a0 con 0x556624f42b70 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f55600640 1 -- 172.21.15.5:0/265501795 <== mon.1 v2:172.21.15.117:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f6f5c03e060 con 0x556624f42b70 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 10 client.4966 fetch_fsmap finished waiting for FSMap version 18 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 10 client.4966 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 20 client.4966 populate_metadata read hostname 'smithi005' 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x556625002800 0x556625002c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 4 client.4966 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f767a3000 1 -- 172.21.15.5:0/265501795 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "perf dump"}) -- 0x556624da0ba0 con 0x556625002800 2024-08-18T22:21:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6b400640 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x556625002800 0x556625002c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f6b400640 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x556625002800 0x556625002c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baecaa79a3a88232 server_cookie=5fc2e5fd6a089c9a in_seq=0 out_seq=0 2024-08-18T22:21:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.532+0000 7f6f55600640 10 client.4966 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f55600640 1 -- 172.21.15.5:0/265501795 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17988 (crc 0 0 0) 0x556624da0ba0 con 0x556625002800 2024-08-18T22:21:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f55600640 10 client.4966 handle_command_reply: tid=0 2024-08-18T22:21:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 1 client.4966 shutdown 2024-08-18T22:21:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 1 -- 172.21.15.5:0/265501795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 msgr2=0x556624fa42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 0x556624fa42d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c011690 tx=0x7f6f5c019000 comp rx=0 tx=0).stop 2024-08-18T22:21:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 1 -- 172.21.15.5:0/265501795 shutdown_connections 2024-08-18T22:21:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x556625002800 0x556625002c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556624f8f890 0x556624fbe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556624f8ef70 0x556624fa4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 1 --2- 172.21.15.5:0/265501795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556624f42b70 0x556624fa42d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f55600640 0 client.4966 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 1 -- 172.21.15.5:0/265501795 >> 172.21.15.5:0/265501795 conn(0x556624f3c680 msgr2=0x556624f41ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 1 -- 172.21.15.5:0/265501795 shutdown_connections 2024-08-18T22:21:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 1 -- 172.21.15.5:0/265501795 wait complete. 2024-08-18T22:21:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f767a3000 20 client.4966 trim_cache size 0 max 16384 2024-08-18T22:21:24.545 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:21:24.545 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:21:24.545 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1904, 2024-08-18T22:21:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 1903, 2024-08-18T22:21:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 477840, 2024-08-18T22:21:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 36364431, 2024-08-18T22:21:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 9, 2024-08-18T22:21:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 3, 2024-08-18T22:21:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.273027666, 2024-08-18T22:21:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.140475526, 2024-08-18T22:21:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.049431256, 2024-08-18T22:21:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.067404228, 2024-08-18T22:21:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1902, 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.463381132, 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000243628 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2, 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000154, 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000077 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2024-08-18T22:21:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1236, 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 1230, 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 408139, 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 23047932, 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 5, 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.179000007, 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.091649539, 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.045347294, 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.044533050, 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:21:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1230, 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.267019939, 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000217089 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 116736, 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 20400 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:21:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 28770, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 51141, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 10058723, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 53987930, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 8, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 3.646557509, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 2.696943917, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 2.373996254, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.047326464, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 51139, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.709676548, 2024-08-18T22:21:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000033431 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 47388, 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.010285998, 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000217 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 79488 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-08-18T22:21:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2024-08-18T22:21:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-18T22:21:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-18T22:21:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1367, 2024-08-18T22:21:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 16.520446088, 2024-08-18T22:21:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.012085183 2024-08-18T22:21:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2024-08-18T22:21:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-18T22:21:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-18T22:21:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1691, 2024-08-18T22:21:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.543937398, 2024-08-18T22:21:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000321666 2024-08-18T22:21:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-08-18T22:21:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 25770, 2024-08-18T22:21:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 25770, 2024-08-18T22:21:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2024-08-18T22:21:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 25770, 2024-08-18T22:21:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 307.094295936, 2024-08-18T22:21:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.011916736 2024-08-18T22:21:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2024-08-18T22:21:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2024-08-18T22:21:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2024-08-18T22:21:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2024-08-18T22:21:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 12, 2024-08-18T22:21:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2024-08-18T22:21:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 19774, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 0, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 19774, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 0, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 19773, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 0, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 47, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 47, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 2, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 46798, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 46259, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2024-08-18T22:21:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 108, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2024-08-18T22:21:24.556 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 1388, 2024-08-18T22:21:24.557 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 4042, 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 3627, 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 2620, 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 22, 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 14114 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2024-08-18T22:21:24.558 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 2000, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 331, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 4146, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 1624, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 2201, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2024-08-18T22:21:24.559 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_path": 0, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_inode": 0, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 0, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 29295, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2024-08-18T22:21:24.560 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 29295, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 46, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 46, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 4, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 97073291, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 0, 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2024-08-18T22:21:24.561 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2726, 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 92.969614668, 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.034104774 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 0 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 2014, 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 2014, 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 0, 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 13, 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 13, 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 0, 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 19774, 2024-08-18T22:21:24.562 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 19775, 2024-08-18T22:21:24.563 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 1, 2024-08-18T22:21:24.563 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 47, 2024-08-18T22:21:24.563 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 2783, 2024-08-18T22:21:24.563 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 2736, 2024-08-18T22:21:24.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 109556, 2024-08-18T22:21:24.563 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 231732 2024-08-18T22:21:24.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.566 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2024-08-18T22:21:24.566 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 28673, 2024-08-18T22:21:24.566 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 25770, 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 4, 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2000, 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.655752792, 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000827876 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 29, 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004053935, 2024-08-18T22:21:24.567 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000139790 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 6000, 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 7.504572002, 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001250762 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 7526, 2024-08-18T22:21:24.568 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 5.064121099, 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000672883 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2024-08-18T22:21:24.569 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000074434, 2024-08-18T22:21:24.570 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000074434 2024-08-18T22:21:24.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.571 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2024-08-18T22:21:24.571 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.571 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.571 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.571 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2024-08-18T22:21:24.571 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:24.571 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.003316657, 2024-08-18T22:21:24.571 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.003316657 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.255795536, 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.255795536 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2024-08-18T22:21:24.572 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000105016, 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000105016 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8, 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.653107452, 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.081638431 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2201, 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 272.687906175, 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.123892733 2024-08-18T22:21:24.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2024-08-18T22:21:24.574 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.575 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.575 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.575 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2024-08-18T22:21:24.575 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:24.575 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.044694574, 2024-08-18T22:21:24.575 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.044694574 2024-08-18T22:21:24.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.575 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2024-08-18T22:21:24.575 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000287708, 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000287708 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.577 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2024-08-18T22:21:24.577 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.577 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.577 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.577 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2024-08-18T22:21:24.577 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.577 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.577 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8000, 2024-08-18T22:21:24.578 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 19.220508556, 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002402563 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 1, 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 1, 2024-08-18T22:21:24.579 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 0, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 1, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 18344, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 18344, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 51, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:21:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:21:24.581 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:21:24.582 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 18146086, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 4606, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:21:24.583 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-08-18T22:21:24.584 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 5520, 2024-08-18T22:21:24.584 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 78, 2024-08-18T22:21:24.584 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:21:24.584 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:21:24.584 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-08-18T22:21:24.584 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-08-18T22:21:24.584 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 20741189, 2024-08-18T22:21:24.584 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 806613, 2024-08-18T22:21:24.584 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-08-18T22:21:24.584 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-08-18T22:21:24.584 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 4551, 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 93333275, 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 37, 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 4551, 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 4551, 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 23.455453001, 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.005153911 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.585 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2024-08-18T22:21:24.586 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2024-08-18T22:21:24.586 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 4551, 2024-08-18T22:21:24.586 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 4650 2024-08-18T22:21:24.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.586 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 4551, 2024-08-18T22:21:24.586 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 33, 2024-08-18T22:21:24.586 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 4518, 2024-08-18T22:21:24.586 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2024-08-18T22:21:24.586 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2024-08-18T22:21:24.586 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 0, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 11, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 33, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 2759, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 24, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 1624, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 34, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2024-08-18T22:21:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 22, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2024-08-18T22:21:24.588 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2024-08-18T22:21:24.589 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 41, 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 3, 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 8, 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 8, 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 0, 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 111, 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 0, 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 32 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2024-08-18T22:21:24.590 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 1, 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 32, 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2024-08-18T22:21:24.591 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 32, 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed_ops": 1624, 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 1624, 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 31906, 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 8504820, 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 31906, 2024-08-18T22:21:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 31906, 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 8504820, 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-18T22:21:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:21:24.594 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-18T22:21:24.594 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-18T22:21:24.594 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:21:24.594 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-18T22:21:24.594 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 4551, 2024-08-18T22:21:24.594 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 93510291, 2024-08-18T22:21:24.594 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 4551, 2024-08-18T22:21:24.594 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 93510291, 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-18T22:21:24.595 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 4551, 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 4551, 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 4551, 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 4551, 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2024-08-18T22:21:24.596 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 1624, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 177016, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 1624, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 33, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 177016, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.597 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x56078d064780": { 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 84, 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 29295, 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 92878987, 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 29295, 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:21:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:21:24.599 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2726, 2024-08-18T22:21:24.599 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 92878903, 2024-08-18T22:21:24.599 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:21:24.599 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:24.599 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:24.599 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:24.599 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:24.599 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:24.599 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:21:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 -- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f4c0678c0 msgr2=0x7f6f4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f4c0678c0 0x7f6f4c069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009ac0 tx=0x7f6f5c009190 comp rx=0 tx=0).stop 2024-08-18T22:21:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 -- 172.21.15.5:0/1034608263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c15d4d0 msgr2=0x7f6f6c0b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c15d4d0 0x7f6f6c0b0750 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6f5801a040 tx=0x7f6f580191b0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 -- 172.21.15.5:0/1034608263 shutdown_connections 2024-08-18T22:21:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f4c0678c0 0x7f6f4c069d80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f6c14fcf0 0x7f6f6c15e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f6c15d4d0 0x7f6f6c0b0750 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 --2- 172.21.15.5:0/1034608263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f6c15c180 0x7f6f6c14f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 -- 172.21.15.5:0/1034608263 >> 172.21.15.5:0/1034608263 conn(0x7f6f6c0b1dc0 msgr2=0x7f6f6c0cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 -- 172.21.15.5:0/1034608263 shutdown_connections 2024-08-18T22:21:24.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.536+0000 7f6f73200640 1 -- 172.21.15.5:0/1034608263 wait complete. 2024-08-18T22:21:24.603 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-08-18T22:21:24.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:21:24.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-08-18T22:21:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.780+0000 7fa6aba00640 1 Processor -- start 2024-08-18T22:21:24.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.780+0000 7fa6aba00640 1 -- start start 2024-08-18T22:21:24.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.780+0000 7fa6aba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6a406ddd0 0x7fa6a4169180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.780+0000 7fa6aba00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a409b860 con 0x7fa6a4070e10 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.780+0000 7fa6aba00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a40d2cd0 con 0x7fa6a41619b0 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.780+0000 7fa6aba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a40d1bd0 con 0x7fa6a406ddd0 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.780+0000 7fa6a3e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa6a4070e10 0x7fa6a409b150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42624/0 (socket says 172.21.15.5:42624) 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.780+0000 7fa6a3e00640 1 -- 172.21.15.5:0/3106698981 learned_addr learned my addr 172.21.15.5:0/3106698981 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.780+0000 7fa6a9a00640 1 --2- 172.21.15.5:0/3106698981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6a406ddd0 0x7fa6a4169180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.784+0000 7fa6a3400640 1 -- 172.21.15.5:0/3106698981 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997795499 0 0) 0x7fa6a409b860 con 0x7fa6a4070e10 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.784+0000 7fa6a3400640 1 -- 172.21.15.5:0/3106698981 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa68c003530 con 0x7fa6a4070e10 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.784+0000 7fa6a3400640 1 -- 172.21.15.5:0/3106698981 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 40364077 0 0) 0x7fa6a40d2cd0 con 0x7fa6a41619b0 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.784+0000 7fa6a3400640 1 -- 172.21.15.5:0/3106698981 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6a409b860 con 0x7fa6a41619b0 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.784+0000 7fa6a9a00640 1 -- 172.21.15.5:0/3106698981 >> v1:172.21.15.117:6789/0 conn(0x7fa6a41619b0 legacy=0x7fa6a409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.784+0000 7fa6a9a00640 1 -- 172.21.15.5:0/3106698981 >> v1:172.21.15.5:6789/0 conn(0x7fa6a4070e10 legacy=0x7fa6a409b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.784+0000 7fa6a9a00640 1 -- 172.21.15.5:0/3106698981 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a40d1eb0 con 0x7fa6a406ddd0 2024-08-18T22:21:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.784+0000 7fa6a9a00640 1 --2- 172.21.15.5:0/3106698981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6a406ddd0 0x7fa6a4169180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009dc0 tx=0x7fa69c01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79b338d8e3e73ece server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.784+0000 7fa6a3400640 1 -- 172.21.15.5:0/3106698981 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c0b2070 con 0x7fa6a406ddd0 2024-08-18T22:21:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.784+0000 7fa6a3400640 1 -- 172.21.15.5:0/3106698981 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69c0a5960 con 0x7fa6a406ddd0 2024-08-18T22:21:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.784+0000 7fa6a3400640 1 -- 172.21.15.5:0/3106698981 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c0a5d30 con 0x7fa6a406ddd0 2024-08-18T22:21:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 -- 172.21.15.5:0/3106698981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6a406ddd0 msgr2=0x7fa6a4169180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 --2- 172.21.15.5:0/3106698981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6a406ddd0 0x7fa6a4169180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009dc0 tx=0x7fa69c01c990 comp rx=0 tx=0).stop 2024-08-18T22:21:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 -- 172.21.15.5:0/3106698981 shutdown_connections 2024-08-18T22:21:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 --2- 172.21.15.5:0/3106698981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6a406ddd0 0x7fa6a4169180 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 -- 172.21.15.5:0/3106698981 >> 172.21.15.5:0/3106698981 conn(0x7fa6a40d2110 msgr2=0x7fa6a40d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 -- 172.21.15.5:0/3106698981 shutdown_connections 2024-08-18T22:21:24.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 -- 172.21.15.5:0/3106698981 wait complete. 2024-08-18T22:21:24.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 Processor -- start 2024-08-18T22:21:24.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 -- start start 2024-08-18T22:21:24.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a406ddd0 0x7fa6a40b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6a4070e10 0x7fa6a40b7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6a41619b0 0x7fa6a40b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a416c060 con 0x7fa6a406ddd0 2024-08-18T22:21:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a416bee0 con 0x7fa6a4070e10 2024-08-18T22:21:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6aba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a416c1e0 con 0x7fa6a41619b0 2024-08-18T22:21:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6a9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a406ddd0 0x7fa6a40b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6a9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a406ddd0 0x7fa6a40b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57442/0 (socket says 172.21.15.5:57442) 2024-08-18T22:21:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6a9000640 1 -- 172.21.15.5:0/980635165 learned_addr learned my addr 172.21.15.5:0/980635165 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6a4070e10 0x7fa6a40b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6a9a00640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6a41619b0 0x7fa6a40b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6a9000640 1 -- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6a41619b0 msgr2=0x7fa6a40b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6a9000640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6a41619b0 0x7fa6a40b7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6a9000640 1 -- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6a4070e10 msgr2=0x7fa6a40b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6a9000640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6a4070e10 0x7fa6a40b7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6a9000640 1 -- 172.21.15.5:0/980635165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a40b57d0 con 0x7fa6a406ddd0 2024-08-18T22:21:24.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.788+0000 7fa6a9000640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a406ddd0 0x7fa6a40b4f80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c430 tx=0x7fa69800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.792+0000 7fa6a0c00640 1 -- 172.21.15.5:0/980635165 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698017070 con 0x7fa6a406ddd0 2024-08-18T22:21:24.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.792+0000 7fa6a0c00640 1 -- 172.21.15.5:0/980635165 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6980052f0 con 0x7fa6a406ddd0 2024-08-18T22:21:24.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.792+0000 7fa6aba00640 1 -- 172.21.15.5:0/980635165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a4151770 con 0x7fa6a406ddd0 2024-08-18T22:21:24.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.792+0000 7fa6a0c00640 1 -- 172.21.15.5:0/980635165 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698003840 con 0x7fa6a406ddd0 2024-08-18T22:21:24.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.792+0000 7fa6aba00640 1 -- 172.21.15.5:0/980635165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a40b54c0 con 0x7fa6a406ddd0 2024-08-18T22:21:24.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.792+0000 7fa6a0c00640 1 -- 172.21.15.5:0/980635165 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa69801a070 con 0x7fa6a406ddd0 2024-08-18T22:21:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.792+0000 7fa6a0c00640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6840678c0 0x7fa684069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.792+0000 7fa6a0c00640 1 -- 172.21.15.5:0/980635165 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fa698085230 con 0x7fa6a406ddd0 2024-08-18T22:21:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.792+0000 7fa6aee76000 1 Processor -- start 2024-08-18T22:21:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.792+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6840678c0 0x7fa684069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.792+0000 7fa6aee76000 1 -- start start 2024-08-18T22:21:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6840678c0 0x7fa684069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40cbcd0 tx=0x7fa690007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 0x55dfd4949390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd49498d0 0x55dfd48ffb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4900060 0x55dfd4900440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dfd474d2f0 con 0x55dfd49498d0 2024-08-18T22:21:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dfd4707b50 con 0x55dfd4900060 2024-08-18T22:21:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dfd47492b0 con 0x55dfd4948fb0 2024-08-18T22:21:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 0x55dfd4949390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd49498d0 0x55dfd48ffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 0x55dfd4949390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:54502/0 (socket says 172.21.15.5:54502) 2024-08-18T22:21:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a9000640 1 -- 172.21.15.5:0/2357766543 learned_addr learned my addr 172.21.15.5:0/2357766543 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a9a00640 1 --2- 172.21.15.5:0/2357766543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4900060 0x55dfd4900440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a9000640 1 -- 172.21.15.5:0/2357766543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4900060 msgr2=0x55dfd4900440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a9000640 1 --2- 172.21.15.5:0/2357766543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4900060 0x55dfd4900440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a9000640 1 -- 172.21.15.5:0/2357766543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd49498d0 msgr2=0x55dfd48ffb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a9000640 1 --2- 172.21.15.5:0/2357766543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd49498d0 0x55dfd48ffb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a9000640 1 -- 172.21.15.5:0/2357766543 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd47f99e0 con 0x55dfd4948fb0 2024-08-18T22:21:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/2357766543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd49498d0 0x55dfd48ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6a9000640 1 --2- 172.21.15.5:0/2357766543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 0x55dfd4949390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa69800a040 tx=0x7fa6980055e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8fbb5b0c6e59d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa695600640 1 -- 172.21.15.5:0/2357766543 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69805e000 con 0x55dfd4948fb0 2024-08-18T22:21:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa695600640 1 -- 172.21.15.5:0/2357766543 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6980537d0 con 0x55dfd4948fb0 2024-08-18T22:21:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa695600640 1 -- 172.21.15.5:0/2357766543 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69806d170 con 0x55dfd4948fb0 2024-08-18T22:21:24.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 -- 172.21.15.5:0/2357766543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 msgr2=0x55dfd4949390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 --2- 172.21.15.5:0/2357766543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 0x55dfd4949390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa69800a040 tx=0x7fa6980055e0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 -- 172.21.15.5:0/2357766543 shutdown_connections 2024-08-18T22:21:24.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 --2- 172.21.15.5:0/2357766543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4900060 0x55dfd4900440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 --2- 172.21.15.5:0/2357766543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd49498d0 0x55dfd48ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 --2- 172.21.15.5:0/2357766543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 0x55dfd4949390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 -- 172.21.15.5:0/2357766543 >> 172.21.15.5:0/2357766543 conn(0x55dfd48fbfe0 msgr2=0x55dfd48fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 -- 172.21.15.5:0/2357766543 shutdown_connections 2024-08-18T22:21:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 -- 172.21.15.5:0/2357766543 wait complete. 2024-08-18T22:21:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 -- start start 2024-08-18T22:21:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.796+0000 7fa6aee76000 1 Processor -- start 2024-08-18T22:21:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4900060 0x55dfd4948900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4948fb0 0x55dfd490afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd49498d0 0x55dfd490b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dfd4751920 con 0x55dfd4900060 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dfd46eebb0 con 0x55dfd4948fb0 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dfd46f8f30 con 0x55dfd49498d0 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 10 client.0 _ll_register_callbacks cb 0x55dfd48eaaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4900060 0x55dfd4948900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4900060 0x55dfd4948900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57464/0 (socket says 172.21.15.5:57464) 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a9000640 1 -- 172.21.15.5:0/3877733035 learned_addr learned my addr 172.21.15.5:0/3877733035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4948fb0 0x55dfd490afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a9a00640 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd49498d0 0x55dfd490b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a9000640 1 -- 172.21.15.5:0/3877733035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd49498d0 msgr2=0x55dfd490b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a9000640 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd49498d0 0x55dfd490b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a9000640 1 -- 172.21.15.5:0/3877733035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4948fb0 msgr2=0x55dfd490afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a9000640 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4948fb0 0x55dfd490afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a9000640 1 -- 172.21.15.5:0/3877733035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd47f5990 con 0x55dfd4900060 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a9000640 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4900060 0x55dfd4948900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa69800cdf0 tx=0x7fa698000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175826945b397e06 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa68a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa68a000640 1 -- 172.21.15.5:0/3877733035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69806d370 con 0x55dfd4900060 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa68a000640 1 -- 172.21.15.5:0/3877733035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fa698054920 con 0x55dfd4900060 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 1 -- 172.21.15.5:0/3877733035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6980537d0 con 0x55dfd4900060 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa68a000640 1 -- 172.21.15.5:0/3877733035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fa698054b20 con 0x55dfd4900060 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 10 client.5154 fetch_fsmap learned FSMap version 18 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 1 -- 172.21.15.5:0/3877733035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55dfd47274d0 con 0x55dfd4900060 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa68a000640 1 -- 172.21.15.5:0/3877733035 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6980537d0 con 0x55dfd4900060 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa68a000640 1 -- 172.21.15.5:0/3877733035 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fa698051220 con 0x55dfd4900060 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 10 client.5154 fetch_fsmap finished waiting for FSMap version 18 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 10 client.5154 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 20 client.5154 populate_metadata read hostname 'smithi005' 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55dfd490c2a0 0x55dfd495b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 4 client.5154 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:21:24.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 1 -- 172.21.15.5:0/3877733035 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfd47e5de0 con 0x55dfd490c2a0 2024-08-18T22:21:24.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55dfd490c2a0 0x55dfd495b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa68a000640 10 client.5154 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:24.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55dfd490c2a0 0x55dfd495b270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76187705a7fc3b1e server_cookie=60bcb60587b31990 in_seq=0 out_seq=0 2024-08-18T22:21:24.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa68a000640 1 -- 172.21.15.5:0/3877733035 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfd47e5de0 con 0x55dfd490c2a0 2024-08-18T22:21:24.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa68a000640 10 client.5154 handle_command_reply: tid=0 2024-08-18T22:21:24.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.800+0000 7fa6aee76000 1 client.5154 shutdown 2024-08-18T22:21:24.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa6aee76000 1 -- 172.21.15.5:0/3877733035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4900060 msgr2=0x55dfd4948900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa6aee76000 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4900060 0x55dfd4948900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa69800cdf0 tx=0x7fa698000ee0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa6aee76000 1 -- 172.21.15.5:0/3877733035 shutdown_connections 2024-08-18T22:21:24.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa6aee76000 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55dfd490c2a0 0x55dfd495b270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa6aee76000 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd49498d0 0x55dfd490b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa6aee76000 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4948fb0 0x55dfd490afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa6aee76000 1 --2- 172.21.15.5:0/3877733035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4900060 0x55dfd4948900 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa68a000640 0 client.5154 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:24.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa6aee76000 1 -- 172.21.15.5:0/3877733035 >> 172.21.15.5:0/3877733035 conn(0x55dfd48fbfe0 msgr2=0x55dfd48febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa6aee76000 1 -- 172.21.15.5:0/3877733035 shutdown_connections 2024-08-18T22:21:24.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa6aee76000 1 -- 172.21.15.5:0/3877733035 wait complete. 2024-08-18T22:21:24.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.804+0000 7fa6aee76000 20 client.5154 trim_cache size 0 max 16384 2024-08-18T22:21:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.820+0000 7fa6aee76000 1 Processor -- start 2024-08-18T22:21:24.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.820+0000 7fa6aee76000 1 -- start start 2024-08-18T22:21:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.820+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd48fbfe0 0x55dfd495e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.820+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4900060 0x55dfd48ff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.820+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4948fb0 0x55dfd48ff920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.820+0000 7fa6aee76000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a4202f10 con 0x55dfd4948fb0 2024-08-18T22:21:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.820+0000 7fa6aee76000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a415c800 con 0x55dfd48fbfe0 2024-08-18T22:21:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.820+0000 7fa6aee76000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a42028c0 con 0x55dfd4900060 2024-08-18T22:21:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a9a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4948fb0 0x55dfd48ff920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4900060 0x55dfd48ff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a9a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4948fb0 0x55dfd48ff920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57468/0 (socket says 172.21.15.5:57468) 2024-08-18T22:21:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a9a00640 1 -- 172.21.15.5:0/3739726463 learned_addr learned my addr 172.21.15.5:0/3739726463 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a9000640 1 --2- 172.21.15.5:0/3739726463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd48fbfe0 0x55dfd495e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a3e00640 1 -- 172.21.15.5:0/3739726463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd48fbfe0 msgr2=0x55dfd495e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/3739726463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd48fbfe0 0x55dfd495e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a3e00640 1 -- 172.21.15.5:0/3739726463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4948fb0 msgr2=0x55dfd48ff920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/3739726463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4948fb0 0x55dfd48ff920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a3e00640 1 -- 172.21.15.5:0/3739726463 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd47a62a0 con 0x55dfd4900060 2024-08-18T22:21:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/3739726463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4900060 0x55dfd48ff3e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6a406e720 tx=0x7fa69000a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e3ba7e4e42969eb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa694c00640 1 -- 172.21.15.5:0/3739726463 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69002f070 con 0x55dfd4900060 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa694c00640 1 -- 172.21.15.5:0/3739726463 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa690001510 con 0x55dfd4900060 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa694c00640 1 -- 172.21.15.5:0/3739726463 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa690026030 con 0x55dfd4900060 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 -- 172.21.15.5:0/3739726463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4900060 msgr2=0x55dfd48ff3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 --2- 172.21.15.5:0/3739726463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4900060 0x55dfd48ff3e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6a406e720 tx=0x7fa69000a000 comp rx=0 tx=0).stop 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 -- 172.21.15.5:0/3739726463 shutdown_connections 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 --2- 172.21.15.5:0/3739726463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd4948fb0 0x55dfd48ff920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 --2- 172.21.15.5:0/3739726463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4900060 0x55dfd48ff3e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 --2- 172.21.15.5:0/3739726463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd48fbfe0 0x55dfd495e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 -- 172.21.15.5:0/3739726463 >> 172.21.15.5:0/3739726463 conn(0x55dfd4948bd0 msgr2=0x55dfd490a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 -- 172.21.15.5:0/3739726463 shutdown_connections 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 -- 172.21.15.5:0/3739726463 wait complete. 2024-08-18T22:21:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 -- start start 2024-08-18T22:21:24.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 Processor -- start 2024-08-18T22:21:24.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd48fbfe0 0x55dfd495dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4900060 0x55dfd4979560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 0x55dfd4979aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dfd46e92f0 con 0x55dfd48fbfe0 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dfd4717f60 con 0x55dfd4900060 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dfd46d28a0 con 0x55dfd4948fb0 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6aee76000 10 client.0 _ll_register_callbacks cb 0x7fa69806c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd48fbfe0 0x55dfd495dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd48fbfe0 0x55dfd495dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57472/0 (socket says 172.21.15.5:57472) 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.824+0000 7fa6a9000640 1 -- 172.21.15.5:0/2043469061 learned_addr learned my addr 172.21.15.5:0/2043469061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a9a00640 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 0x55dfd4979aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4900060 0x55dfd4979560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a9000640 1 -- 172.21.15.5:0/2043469061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 msgr2=0x55dfd4979aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a9000640 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 0x55dfd4979aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a9000640 1 -- 172.21.15.5:0/2043469061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4900060 msgr2=0x55dfd4979560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a9000640 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4900060 0x55dfd4979560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a9000640 1 -- 172.21.15.5:0/2043469061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd46e9980 con 0x55dfd48fbfe0 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a9a00640 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 0x55dfd4979aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4900060 0x55dfd4979560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a9000640 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd48fbfe0 0x55dfd495dbf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa69800a040 tx=0x7fa698057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887207decaff7951 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa68a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa68a000640 1 -- 172.21.15.5:0/2043469061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69806d380 con 0x55dfd48fbfe0 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa68a000640 1 -- 172.21.15.5:0/2043469061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fa698054390 con 0x55dfd48fbfe0 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6aee76000 1 -- 172.21.15.5:0/2043469061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa690001510 con 0x55dfd48fbfe0 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa68a000640 1 -- 172.21.15.5:0/2043469061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fa698054590 con 0x55dfd48fbfe0 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6aee76000 10 client.5160 fetch_fsmap learned FSMap version 18 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6aee76000 1 -- 172.21.15.5:0/2043469061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55dfd4408150 con 0x55dfd48fbfe0 2024-08-18T22:21:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa68a000640 1 -- 172.21.15.5:0/2043469061 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa690001510 con 0x55dfd48fbfe0 2024-08-18T22:21:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa68a000640 1 -- 172.21.15.5:0/2043469061 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fa69807a020 con 0x55dfd48fbfe0 2024-08-18T22:21:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6aee76000 10 client.5160 fetch_fsmap finished waiting for FSMap version 18 2024-08-18T22:21:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6aee76000 10 client.5160 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-08-18T22:21:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6aee76000 20 client.5160 populate_metadata read hostname 'smithi005' 2024-08-18T22:21:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6aee76000 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55dfd49498d0 0x55dfd4979fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6aee76000 4 client.5160 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-08-18T22:21:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6aee76000 1 -- 172.21.15.5:0/2043469061 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) -- 0x55dfd46e7b80 con 0x55dfd49498d0 2024-08-18T22:21:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55dfd49498d0 0x55dfd4979fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa6a3e00640 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55dfd49498d0 0x55dfd4979fe0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2db8ef99da11c2b7 server_cookie=331405bb02b910bf in_seq=0 out_seq=0 2024-08-18T22:21:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.828+0000 7fa68a000640 10 client.5160 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa68a000640 1 -- 172.21.15.5:0/2043469061 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dfd46e7b80 con 0x55dfd49498d0 2024-08-18T22:21:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa68a000640 10 client.5160 handle_command_reply: tid=0 2024-08-18T22:21:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 1 client.5160 shutdown 2024-08-18T22:21:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 1 -- 172.21.15.5:0/2043469061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd48fbfe0 msgr2=0x55dfd495dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd48fbfe0 0x55dfd495dbf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa69800a040 tx=0x7fa698057000 comp rx=0 tx=0).stop 2024-08-18T22:21:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 1 -- 172.21.15.5:0/2043469061 shutdown_connections 2024-08-18T22:21:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55dfd49498d0 0x55dfd4979fe0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dfd4948fb0 0x55dfd4979aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfd4900060 0x55dfd4979560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 1 --2- 172.21.15.5:0/2043469061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dfd48fbfe0 0x55dfd495dbf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 1 -- 172.21.15.5:0/2043469061 >> 172.21.15.5:0/2043469061 conn(0x55dfd4948bd0 msgr2=0x55dfd48ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa68a000640 0 client.5160 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 1 -- 172.21.15.5:0/2043469061 shutdown_connections 2024-08-18T22:21:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 1 -- 172.21.15.5:0/2043469061 wait complete. 2024-08-18T22:21:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.832+0000 7fa6aee76000 20 client.5160 trim_cache size 0 max 16384 2024-08-18T22:21:24.838 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:21:24.838 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:21:24.838 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "b6c072d1-618e-4597-80f7-9272da966564", 2024-08-18T22:21:24.839 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:21:24.839 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:21:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 -- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6840678c0 msgr2=0x7fa684069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6840678c0 0x7fa684069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40cbcd0 tx=0x7fa690007d40 comp rx=0 tx=0).stop 2024-08-18T22:21:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 -- 172.21.15.5:0/980635165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a406ddd0 msgr2=0x7fa6a40b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a406ddd0 0x7fa6a40b4f80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c430 tx=0x7fa69800c8f0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 -- 172.21.15.5:0/980635165 shutdown_connections 2024-08-18T22:21:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6840678c0 0x7fa684069d80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6a41619b0 0x7fa6a40b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6a4070e10 0x7fa6a40b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 --2- 172.21.15.5:0/980635165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a406ddd0 0x7fa6a40b4f80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 -- 172.21.15.5:0/980635165 >> 172.21.15.5:0/980635165 conn(0x7fa6a40d2110 msgr2=0x7fa6a415d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 -- 172.21.15.5:0/980635165 shutdown_connections 2024-08-18T22:21:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:24.836+0000 7fa6aba00640 1 -- 172.21.15.5:0/980635165 wait complete. 2024-08-18T22:21:24.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:21:24.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-08-18T22:21:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.048+0000 7f30b6400640 1 Processor -- start 2024-08-18T22:21:25.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.048+0000 7f30b6400640 1 -- start start 2024-08-18T22:21:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b6400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f30b0159d40 0x7f30b00d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b6400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b015eb70 0x7f30b006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b6400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b00b34a0 con 0x7f30b00d0660 2024-08-18T22:21:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b6400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f30b006d940 con 0x7f30b0159d40 2024-08-18T22:21:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b6400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30b00b3710 con 0x7f30b015eb70 2024-08-18T22:21:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b5000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f30b0159d40 0x7f30b00d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b5000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f30b0159d40 0x7f30b00d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57486/0 (socket says 172.21.15.5:57486) 2024-08-18T22:21:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b5000640 1 -- 172.21.15.5:0/963834298 learned_addr learned my addr 172.21.15.5:0/963834298 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30afe00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f30b00d0660 0x7f30b006b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:43324/0 (socket says 172.21.15.5:43324) 2024-08-18T22:21:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b5a00640 1 --2- 172.21.15.5:0/963834298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b015eb70 0x7f30b006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b5a00640 1 -- 172.21.15.5:0/963834298 >> v2:172.21.15.5:3300/0 conn(0x7f30b0159d40 msgr2=0x7f30b00d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b5a00640 1 --2- 172.21.15.5:0/963834298 >> v2:172.21.15.5:3300/0 conn(0x7f30b0159d40 0x7f30b00d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b5a00640 1 -- 172.21.15.5:0/963834298 >> v1:172.21.15.117:6789/0 conn(0x7f30b00d0660 legacy=0x7f30b006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b5a00640 1 -- 172.21.15.5:0/963834298 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b00b39f0 con 0x7f30b015eb70 2024-08-18T22:21:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30af400640 1 -- 172.21.15.5:0/963834298 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220826354 0 0) 0x7f30b00b34a0 con 0x7f30b00d0660 2024-08-18T22:21:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.052+0000 7f30b5000640 1 --2- 172.21.15.5:0/963834298 >> v2:172.21.15.5:3300/0 conn(0x7f30b0159d40 0x7f30b00d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:25.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30b5a00640 1 --2- 172.21.15.5:0/963834298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b015eb70 0x7f30b006c0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009d90 tx=0x7f30a801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd5dc4c458e3970 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:25.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30af400640 1 -- 172.21.15.5:0/963834298 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a80b2070 con 0x7f30b015eb70 2024-08-18T22:21:25.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30af400640 1 -- 172.21.15.5:0/963834298 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a80a5a50 con 0x7f30b015eb70 2024-08-18T22:21:25.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30af400640 1 -- 172.21.15.5:0/963834298 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a80a5e20 con 0x7f30b015eb70 2024-08-18T22:21:25.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30b6400640 1 -- 172.21.15.5:0/963834298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b015eb70 msgr2=0x7f30b006c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:25.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30b6400640 1 --2- 172.21.15.5:0/963834298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b015eb70 0x7f30b006c0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009d90 tx=0x7f30a801c970 comp rx=0 tx=0).stop 2024-08-18T22:21:25.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30b6400640 1 -- 172.21.15.5:0/963834298 shutdown_connections 2024-08-18T22:21:25.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30b6400640 1 --2- 172.21.15.5:0/963834298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b015eb70 0x7f30b006c0c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30b6400640 1 --2- 172.21.15.5:0/963834298 >> v2:172.21.15.5:3300/0 conn(0x7f30b0159d40 0x7f30b00d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30b6400640 1 -- 172.21.15.5:0/963834298 >> 172.21.15.5:0/963834298 conn(0x7f30b0073050 msgr2=0x7f30b00b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:25.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30b6400640 1 -- 172.21.15.5:0/963834298 shutdown_connections 2024-08-18T22:21:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.056+0000 7f30b6400640 1 -- 172.21.15.5:0/963834298 wait complete. 2024-08-18T22:21:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b6400640 1 Processor -- start 2024-08-18T22:21:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b6400640 1 -- start start 2024-08-18T22:21:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b6400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b00d0660 0x7f30b01fa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b6400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b0159d40 0x7f30b0148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b6400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30b015eb70 0x7f30b01488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b6400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f30b006c780 con 0x7f30b015eb70 2024-08-18T22:21:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b6400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30b006c600 con 0x7f30b00d0660 2024-08-18T22:21:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b6400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30b015d060 con 0x7f30b0159d40 2024-08-18T22:21:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b5000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b00d0660 0x7f30b01fa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b5a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30b015eb70 0x7f30b01488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b5000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b00d0660 0x7f30b01fa720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:48598/0 (socket says 172.21.15.5:48598) 2024-08-18T22:21:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.060+0000 7f30b5000640 1 -- 172.21.15.5:0/1609070290 learned_addr learned my addr 172.21.15.5:0/1609070290 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30afe00640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b0159d40 0x7f30b0148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30b5000640 1 -- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b0159d40 msgr2=0x7f30b0148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30b5000640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b0159d40 0x7f30b0148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30b5000640 1 -- 172.21.15.5:0/1609070290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30b015eb70 msgr2=0x7f30b01488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30b5000640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30b015eb70 0x7f30b01488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30b5000640 1 -- 172.21.15.5:0/1609070290 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b014fc70 con 0x7f30b00d0660 2024-08-18T22:21:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30b5000640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b00d0660 0x7f30b01fa720 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f30a400e9d0 tx=0x7f30a400ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30acc00640 1 -- 172.21.15.5:0/1609070290 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4017070 con 0x7f30b00d0660 2024-08-18T22:21:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30acc00640 1 -- 172.21.15.5:0/1609070290 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a400ca60 con 0x7f30b00d0660 2024-08-18T22:21:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30acc00640 1 -- 172.21.15.5:0/1609070290 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a400ce10 con 0x7f30b00d0660 2024-08-18T22:21:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30b6400640 1 -- 172.21.15.5:0/1609070290 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b014ff50 con 0x7f30b00d0660 2024-08-18T22:21:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.064+0000 7f30b6400640 1 -- 172.21.15.5:0/1609070290 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b0150510 con 0x7f30b00d0660 2024-08-18T22:21:25.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30acc00640 1 -- 172.21.15.5:0/1609070290 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30a401a070 con 0x7f30b00d0660 2024-08-18T22:21:25.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30acc00640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3090067910 0x7f3090069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30baed4000 1 Processor -- start 2024-08-18T22:21:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30acc00640 1 -- 172.21.15.5:0/1609070290 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f30a4086160 con 0x7f30b00d0660 2024-08-18T22:21:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30baed4000 1 -- start start 2024-08-18T22:21:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30afe00640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3090067910 0x7f3090069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30afe00640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3090067910 0x7f3090069dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f30b00cd080 tx=0x7f309c007bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30baed4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2509a0 0x5623ca250d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30baed4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 0x5623ca203fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30baed4000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca204500 0x5623ca2048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30baed4000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5623ca0edae0 con 0x5623ca204500 2024-08-18T22:21:25.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30baed4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5623ca0d9ba0 con 0x5623ca2512c0 2024-08-18T22:21:25.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30baed4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5623ca0544f0 con 0x5623ca2509a0 2024-08-18T22:21:25.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.068+0000 7f30b5a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca204500 0x5623ca2048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30b5a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca204500 0x5623ca2048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57508/0 (socket says 172.21.15.5:57508) 2024-08-18T22:21:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30b5a00640 1 -- 172.21.15.5:0/1309590426 learned_addr learned my addr 172.21.15.5:0/1309590426 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30afe00640 1 --2- 172.21.15.5:0/1309590426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 0x5623ca203fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30b5000640 1 --2- 172.21.15.5:0/1309590426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2509a0 0x5623ca250d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30afe00640 1 -- 172.21.15.5:0/1309590426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2509a0 msgr2=0x5623ca250d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30afe00640 1 --2- 172.21.15.5:0/1309590426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2509a0 0x5623ca250d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30afe00640 1 -- 172.21.15.5:0/1309590426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca204500 msgr2=0x5623ca2048e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30afe00640 1 --2- 172.21.15.5:0/1309590426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca204500 0x5623ca2048e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30afe00640 1 -- 172.21.15.5:0/1309590426 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c9ff4a90 con 0x5623ca2512c0 2024-08-18T22:21:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30b5000640 1 --2- 172.21.15.5:0/1309590426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2509a0 0x5623ca250d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30b5a00640 1 --2- 172.21.15.5:0/1309590426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca204500 0x5623ca2048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30afe00640 1 --2- 172.21.15.5:0/1309590426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 0x5623ca203fc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30b0166be0 tx=0x7f309c012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bbd0c5081f487f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30a1600640 1 -- 172.21.15.5:0/1309590426 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c005c90 con 0x5623ca2512c0 2024-08-18T22:21:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30a1600640 1 -- 172.21.15.5:0/1309590426 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c005e30 con 0x5623ca2512c0 2024-08-18T22:21:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30a1600640 1 -- 172.21.15.5:0/1309590426 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c015b90 con 0x5623ca2512c0 2024-08-18T22:21:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30baed4000 1 -- 172.21.15.5:0/1309590426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 msgr2=0x5623ca203fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30baed4000 1 --2- 172.21.15.5:0/1309590426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 0x5623ca203fc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30b0166be0 tx=0x7f309c012000 comp rx=0 tx=0).stop 2024-08-18T22:21:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30baed4000 1 -- 172.21.15.5:0/1309590426 shutdown_connections 2024-08-18T22:21:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30baed4000 1 --2- 172.21.15.5:0/1309590426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca204500 0x5623ca2048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30baed4000 1 --2- 172.21.15.5:0/1309590426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 0x5623ca203fc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30baed4000 1 --2- 172.21.15.5:0/1309590426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2509a0 0x5623ca250d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30baed4000 1 -- 172.21.15.5:0/1309590426 >> 172.21.15.5:0/1309590426 conn(0x5623ca1fe010 msgr2=0x5623ca233820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30baed4000 1 -- 172.21.15.5:0/1309590426 shutdown_connections 2024-08-18T22:21:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.072+0000 7f30baed4000 1 -- 172.21.15.5:0/1309590426 wait complete. 2024-08-18T22:21:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30baed4000 1 -- start start 2024-08-18T22:21:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30baed4000 1 Processor -- start 2024-08-18T22:21:25.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30baed4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca204500 0x5623ca231040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30baed4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2509a0 0x5623ca20c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30baed4000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2512c0 0x5623ca20c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30baed4000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5623ca0504b0 con 0x5623ca2512c0 2024-08-18T22:21:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30baed4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5623ca00eb50 con 0x5623ca204500 2024-08-18T22:21:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30baed4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5623c9ff5d00 con 0x5623ca2509a0 2024-08-18T22:21:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30baed4000 10 client.0 _ll_register_callbacks cb 0x5623ca1f1f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:21:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30b5000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca204500 0x5623ca231040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30b5000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca204500 0x5623ca231040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:48612/0 (socket says 172.21.15.5:48612) 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30b5000640 1 -- 172.21.15.5:0/1114306147 learned_addr learned my addr 172.21.15.5:0/1114306147 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30afe00640 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2509a0 0x5623ca20c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30b5a00640 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2512c0 0x5623ca20c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30b5000640 1 -- 172.21.15.5:0/1114306147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2509a0 msgr2=0x5623ca20c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30b5000640 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2509a0 0x5623ca20c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30b5000640 1 -- 172.21.15.5:0/1114306147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2512c0 msgr2=0x5623ca20c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30b5000640 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2512c0 0x5623ca20c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30b5000640 1 -- 172.21.15.5:0/1114306147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623ca00d060 con 0x5623ca204500 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30b5a00640 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2512c0 0x5623ca20c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f30b5000640 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca204500 0x5623ca231040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f30a40560f0 tx=0x7f30a4056530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8db8290bb43f1cbc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f3096000640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-08-18T22:21:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f3096000640 1 -- 172.21.15.5:0/1114306147 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4021040 con 0x5623ca204500 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.076+0000 7f3096000640 1 -- 172.21.15.5:0/1114306147 <== mon.1 v2:172.21.15.117:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f30a4055840 con 0x5623ca204500 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30baed4000 1 -- 172.21.15.5:0/1114306147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f309c005e30 con 0x5623ca204500 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f3096000640 1 -- 172.21.15.5:0/1114306147 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f30a4055a40 con 0x5623ca204500 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30baed4000 10 client.4993 fetch_fsmap learned FSMap version 18 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30baed4000 1 -- 172.21.15.5:0/1114306147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5623ca020f50 con 0x5623ca204500 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f3096000640 1 -- 172.21.15.5:0/1114306147 <== mon.1 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c005e30 con 0x5623ca204500 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f3096000640 1 -- 172.21.15.5:0/1114306147 <== mon.1 v2:172.21.15.117:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f30a4074ce0 con 0x5623ca204500 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30baed4000 10 client.4993 fetch_fsmap finished waiting for FSMap version 18 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30baed4000 10 client.4993 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30baed4000 20 client.4993 populate_metadata read hostname 'smithi005' 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30baed4000 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x5623ca232d30 0x5623ca233110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30baed4000 4 client.4993 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:21:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30baed4000 1 -- 172.21.15.5:0/1114306147 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623c9feee10 con 0x5623ca232d30 2024-08-18T22:21:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30afe00640 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x5623ca232d30 0x5623ca233110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30afe00640 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x5623ca232d30 0x5623ca233110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a13a49e16eaa309b server_cookie=ffcf7c3b1e90343c in_seq=0 out_seq=0 2024-08-18T22:21:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f3096000640 10 client.4993 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f3096000640 1 -- 172.21.15.5:0/1114306147 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623c9feee10 con 0x5623ca232d30 2024-08-18T22:21:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f3096000640 10 client.4993 handle_command_reply: tid=0 2024-08-18T22:21:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.080+0000 7f30baed4000 1 client.4993 shutdown 2024-08-18T22:21:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f30baed4000 1 -- 172.21.15.5:0/1114306147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca204500 msgr2=0x5623ca231040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f30baed4000 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca204500 0x5623ca231040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f30a40560f0 tx=0x7f30a4056530 comp rx=0 tx=0).stop 2024-08-18T22:21:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f30baed4000 1 -- 172.21.15.5:0/1114306147 shutdown_connections 2024-08-18T22:21:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f30baed4000 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x5623ca232d30 0x5623ca233110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f30baed4000 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2512c0 0x5623ca20c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f30baed4000 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2509a0 0x5623ca20c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f30baed4000 1 --2- 172.21.15.5:0/1114306147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca204500 0x5623ca231040 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f30a40560f0 tx=0x7f30a4056530 comp rx=0 tx=0).stop 2024-08-18T22:21:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f30baed4000 1 -- 172.21.15.5:0/1114306147 >> 172.21.15.5:0/1114306147 conn(0x5623ca1fe010 msgr2=0x5623ca2036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f3096000640 0 client.4993 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f30baed4000 1 -- 172.21.15.5:0/1114306147 shutdown_connections 2024-08-18T22:21:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f30baed4000 1 -- 172.21.15.5:0/1114306147 wait complete. 2024-08-18T22:21:25.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.084+0000 7f30baed4000 20 client.4993 trim_cache size 0 max 16384 2024-08-18T22:21:25.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 Processor -- start 2024-08-18T22:21:25.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 -- start start 2024-08-18T22:21:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 0x5623ca2c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 0x5623ca2c0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2c0a80 0x5623ca202790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f30b0207d30 con 0x5623ca2509a0 2024-08-18T22:21:25.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30b0206db0 con 0x5623ca2512c0 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f30b0206110 con 0x5623ca2c0a80 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30afe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 0x5623ca2c0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30b5000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 0x5623ca2c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30afe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 0x5623ca2c0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:48626/0 (socket says 172.21.15.5:48626) 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30afe00640 1 -- 172.21.15.5:0/3065303472 learned_addr learned my addr 172.21.15.5:0/3065303472 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30b5a00640 1 --2- 172.21.15.5:0/3065303472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2c0a80 0x5623ca202790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30afe00640 1 -- 172.21.15.5:0/3065303472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2c0a80 msgr2=0x5623ca202790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30afe00640 1 --2- 172.21.15.5:0/3065303472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2c0a80 0x5623ca202790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30afe00640 1 -- 172.21.15.5:0/3065303472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 msgr2=0x5623ca2c0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30afe00640 1 --2- 172.21.15.5:0/3065303472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 0x5623ca2c0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30afe00640 1 -- 172.21.15.5:0/3065303472 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623ca0d6dd0 con 0x5623ca2512c0 2024-08-18T22:21:25.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30afe00640 1 --2- 172.21.15.5:0/3065303472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 0x5623ca2c0540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f309c007360 tx=0x7f309c013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43221f5eddebb846 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:25.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30a0c00640 1 -- 172.21.15.5:0/3065303472 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c015a10 con 0x5623ca2512c0 2024-08-18T22:21:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30a0c00640 1 -- 172.21.15.5:0/3065303472 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c015bb0 con 0x5623ca2512c0 2024-08-18T22:21:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30a0c00640 1 -- 172.21.15.5:0/3065303472 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c021450 con 0x5623ca2512c0 2024-08-18T22:21:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 -- 172.21.15.5:0/3065303472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 msgr2=0x5623ca2c0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 --2- 172.21.15.5:0/3065303472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 0x5623ca2c0540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f309c007360 tx=0x7f309c013000 comp rx=0 tx=0).stop 2024-08-18T22:21:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 -- 172.21.15.5:0/3065303472 shutdown_connections 2024-08-18T22:21:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 --2- 172.21.15.5:0/3065303472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2c0a80 0x5623ca202790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 --2- 172.21.15.5:0/3065303472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2512c0 0x5623ca2c0540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 --2- 172.21.15.5:0/3065303472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 0x5623ca2c0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.112+0000 7f30baed4000 1 -- 172.21.15.5:0/3065303472 >> 172.21.15.5:0/3065303472 conn(0x5623ca1fe010 msgr2=0x5623ca25e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 -- 172.21.15.5:0/3065303472 shutdown_connections 2024-08-18T22:21:25.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 -- 172.21.15.5:0/3065303472 wait complete. 2024-08-18T22:21:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 -- start start 2024-08-18T22:21:25.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 Processor -- start 2024-08-18T22:21:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 0x5623ca2c0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2512c0 0x5623ca264fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2c0a80 0x5623ca2654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5623ca111240 con 0x5623ca2509a0 2024-08-18T22:21:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f30b0206760 con 0x5623ca2c0a80 2024-08-18T22:21:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5623ca01f7f0 con 0x5623ca2512c0 2024-08-18T22:21:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 10 client.0 _ll_register_callbacks cb 0x7f30a40561c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:21:25.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30b5000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 0x5623ca2c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30afe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2512c0 0x5623ca264fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30b5000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 0x5623ca2c0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57534/0 (socket says 172.21.15.5:57534) 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30b5000640 1 -- 172.21.15.5:0/637537986 learned_addr learned my addr 172.21.15.5:0/637537986 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30b5a00640 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2c0a80 0x5623ca2654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30b5000640 1 -- 172.21.15.5:0/637537986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2512c0 msgr2=0x5623ca264fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30b5000640 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2512c0 0x5623ca264fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30b5000640 1 -- 172.21.15.5:0/637537986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2c0a80 msgr2=0x5623ca2654e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30b5000640 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2c0a80 0x5623ca2654e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30b5000640 1 -- 172.21.15.5:0/637537986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c9fe7cd0 con 0x5623ca2509a0 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30b5000640 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 0x5623ca2c0210 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f30a400e9a0 tx=0x7f30a4084390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5ccd391bd81bd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f3096000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f3096000640 1 -- 172.21.15.5:0/637537986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4021040 con 0x5623ca2509a0 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f3096000640 1 -- 172.21.15.5:0/637537986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f30a40523a0 con 0x5623ca2509a0 2024-08-18T22:21:25.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 -- 172.21.15.5:0/637537986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f309c015bb0 con 0x5623ca2509a0 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f3096000640 1 -- 172.21.15.5:0/637537986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f30a405a160 con 0x5623ca2509a0 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 10 client.5178 fetch_fsmap learned FSMap version 18 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 -- 172.21.15.5:0/637537986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5623c9ffa320 con 0x5623ca2509a0 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f3096000640 1 -- 172.21.15.5:0/637537986 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c015bb0 con 0x5623ca2509a0 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f3096000640 1 -- 172.21.15.5:0/637537986 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f30a405a300 con 0x5623ca2509a0 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 10 client.5178 fetch_fsmap finished waiting for FSMap version 18 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 10 client.5178 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 20 client.5178 populate_metadata read hostname 'smithi005' 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x5623ca265a20 0x5623ca265e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 4 client.5178 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30baed4000 1 -- 172.21.15.5:0/637537986 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5623ca061c20 con 0x5623ca265a20 2024-08-18T22:21:25.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.116+0000 7f30afe00640 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x5623ca265a20 0x5623ca265e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30afe00640 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x5623ca265a20 0x5623ca265e30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=804bc9e75e3be0ea server_cookie=b21db05a2dd5cbe8 in_seq=0 out_seq=0 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f3096000640 10 client.5178 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f3096000640 1 -- 172.21.15.5:0/637537986 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x5623ca061c20 con 0x5623ca265a20 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f3096000640 10 client.5178 handle_command_reply: tid=0 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 1 client.5178 shutdown 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 1 -- 172.21.15.5:0/637537986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 msgr2=0x5623ca2c0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 0x5623ca2c0210 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f30a400e9a0 tx=0x7f30a4084390 comp rx=0 tx=0).stop 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 1 -- 172.21.15.5:0/637537986 shutdown_connections 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x5623ca265a20 0x5623ca265e30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623ca2c0a80 0x5623ca2654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623ca2512c0 0x5623ca264fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 1 --2- 172.21.15.5:0/637537986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623ca2509a0 0x5623ca2c0210 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f3096000640 0 client.5178 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 1 -- 172.21.15.5:0/637537986 >> 172.21.15.5:0/637537986 conn(0x5623ca1fe010 msgr2=0x5623ca231500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 1 -- 172.21.15.5:0/637537986 shutdown_connections 2024-08-18T22:21:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 1 -- 172.21.15.5:0/637537986 wait complete. 2024-08-18T22:21:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30baed4000 20 client.5178 trim_cache size 0 max 16384 2024-08-18T22:21:25.127 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:21:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-18T22:21:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-18T22:21:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: "b6c072d1-618e-4597-80f7-9272da966564": { 2024-08-18T22:21:25.127 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-18T22:21:25.128 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "b6c072d1-618e-4597-80f7-9272da966564", 2024-08-18T22:21:25.128 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,scrub_mdsdir" 2024-08-18T22:21:25.128 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:25.128 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:25.128 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 -- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3090067910 msgr2=0x7f3090069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3090067910 0x7f3090069dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f30b00cd080 tx=0x7f309c007bc0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 -- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b00d0660 msgr2=0x7f30b01fa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b00d0660 0x7f30b01fa720 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f30a400e9d0 tx=0x7f30a400ee90 comp rx=0 tx=0).stop 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 -- 172.21.15.5:0/1609070290 shutdown_connections 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3090067910 0x7f3090069dd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30b015eb70 0x7f30b01488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30b0159d40 0x7f30b0148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 --2- 172.21.15.5:0/1609070290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30b00d0660 0x7f30b01fa720 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 -- 172.21.15.5:0/1609070290 >> 172.21.15.5:0/1609070290 conn(0x7f30b0073050 msgr2=0x7f30b0166250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 -- 172.21.15.5:0/1609070290 shutdown_connections 2024-08-18T22:21:25.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:25.120+0000 7f30b6400640 1 -- 172.21.15.5:0/1609070290 wait complete. 2024-08-18T22:21:25.142 INFO:tasks.cephfs.filesystem:scrub status for tag:b6c072d1-618e-4597-80f7-9272da966564 - {'path': '/', 'tag': 'b6c072d1-618e-4597-80f7-9272da966564', 'options': 'recursive,scrub_mdsdir'} 2024-08-18T22:21:51.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:21:51.782 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:21:55.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:21:55.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-08-18T22:21:55.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a5a000640 1 Processor -- start 2024-08-18T22:21:55.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a5a000640 1 -- start start 2024-08-18T22:21:55.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a5a000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a54147dd0 0x7f4a540b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a5a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5415f000 0x7f4a540d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a5a000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a5406c850 con 0x7f4a5406c3c0 2024-08-18T22:21:55.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a5a000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4a5415f7c0 con 0x7f4a54147dd0 2024-08-18T22:21:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a5a000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4a540b6410 con 0x7f4a5415f000 2024-08-18T22:21:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a53400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a54147dd0 0x7f4a540b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a53e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5415f000 0x7f4a540d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a53400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a54147dd0 0x7f4a540b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:42564/0 (socket says 172.21.15.5:42564) 2024-08-18T22:21:55.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a53400640 1 -- 172.21.15.5:0/175167195 learned_addr learned my addr 172.21.15.5:0/175167195 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a53400640 1 -- 172.21.15.5:0/175167195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5415f000 msgr2=0x7f4a540d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a53400640 1 --2- 172.21.15.5:0/175167195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5415f000 0x7f4a540d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a53400640 1 -- 172.21.15.5:0/175167195 >> v1:172.21.15.117:6789/0 conn(0x7f4a5406c3c0 legacy=0x7f4a5415e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.295+0000 7f4a53400640 1 -- 172.21.15.5:0/175167195 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a540b46b0 con 0x7f4a54147dd0 2024-08-18T22:21:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a53400640 1 --2- 172.21.15.5:0/175167195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a54147dd0 0x7f4a540b40d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4a440098a0 tx=0x7f4a4401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69ec06c165b0ad54 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a52a00640 1 -- 172.21.15.5:0/175167195 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a440ab680 con 0x7f4a54147dd0 2024-08-18T22:21:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a52a00640 1 -- 172.21.15.5:0/175167195 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a440b0070 con 0x7f4a54147dd0 2024-08-18T22:21:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a52a00640 1 -- 172.21.15.5:0/175167195 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a440aba40 con 0x7f4a54147dd0 2024-08-18T22:21:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a5a000640 1 -- 172.21.15.5:0/175167195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a54147dd0 msgr2=0x7f4a540b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a5a000640 1 --2- 172.21.15.5:0/175167195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a54147dd0 0x7f4a540b40d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4a440098a0 tx=0x7f4a4401c480 comp rx=0 tx=0).stop 2024-08-18T22:21:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a5a000640 1 -- 172.21.15.5:0/175167195 shutdown_connections 2024-08-18T22:21:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a5a000640 1 --2- 172.21.15.5:0/175167195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5415f000 0x7f4a540d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a5a000640 1 --2- 172.21.15.5:0/175167195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a54147dd0 0x7f4a540b40d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a5a000640 1 -- 172.21.15.5:0/175167195 >> 172.21.15.5:0/175167195 conn(0x7f4a540b65f0 msgr2=0x7f4a540b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a5a000640 1 -- 172.21.15.5:0/175167195 shutdown_connections 2024-08-18T22:21:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.299+0000 7f4a5a000640 1 -- 172.21.15.5:0/175167195 wait complete. 2024-08-18T22:21:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a5a000640 1 Processor -- start 2024-08-18T22:21:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a5a000640 1 -- start start 2024-08-18T22:21:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a5a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5406c3c0 0x7f4a5415c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a5a000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a54147dd0 0x7f4a54144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a5a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5415f000 0x7f4a5413fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a5a000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4a540b5b30 con 0x7f4a5406c3c0 2024-08-18T22:21:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a5a000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5415f9e0 con 0x7f4a54147dd0 2024-08-18T22:21:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a5a000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4a540b5cb0 con 0x7f4a5415f000 2024-08-18T22:21:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a53400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5406c3c0 0x7f4a5415c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a53400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5406c3c0 0x7f4a5415c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39174/0 (socket says 172.21.15.5:39174) 2024-08-18T22:21:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a53400640 1 -- 172.21.15.5:0/2753811230 learned_addr learned my addr 172.21.15.5:0/2753811230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a4be00640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a54147dd0 0x7f4a54144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a53e00640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5415f000 0x7f4a5413fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a53400640 1 -- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5415f000 msgr2=0x7f4a5413fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a53400640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5415f000 0x7f4a5413fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a53400640 1 -- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a54147dd0 msgr2=0x7f4a54144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a53400640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a54147dd0 0x7f4a54144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a53400640 1 -- 172.21.15.5:0/2753811230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5413c590 con 0x7f4a5406c3c0 2024-08-18T22:21:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a53400640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5406c3c0 0x7f4a5415c0f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4a440097c0 tx=0x7f4a4401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a4b400640 1 -- 172.21.15.5:0/2753811230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a440abd90 con 0x7f4a5406c3c0 2024-08-18T22:21:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a4b400640 1 -- 172.21.15.5:0/2753811230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a440a7070 con 0x7f4a5406c3c0 2024-08-18T22:21:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a4b400640 1 -- 172.21.15.5:0/2753811230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a440be630 con 0x7f4a5406c3c0 2024-08-18T22:21:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a5a000640 1 -- 172.21.15.5:0/2753811230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5413c870 con 0x7f4a5406c3c0 2024-08-18T22:21:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.303+0000 7f4a5a000640 1 -- 172.21.15.5:0/2753811230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a5415cb90 con 0x7f4a5406c3c0 2024-08-18T22:21:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.307+0000 7f4a4b400640 1 -- 172.21.15.5:0/2753811230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a440c7440 con 0x7f4a5406c3c0 2024-08-18T22:21:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.307+0000 7f4a4b400640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4a300678c0 0x7f4a30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.307+0000 7f4a4b400640 1 -- 172.21.15.5:0/2753811230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f4a441202a0 con 0x7f4a5406c3c0 2024-08-18T22:21:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.307+0000 7f4a4be00640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4a300678c0 0x7f4a30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.307+0000 7f4a5d435000 1 Processor -- start 2024-08-18T22:21:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.307+0000 7f4a5d435000 1 -- start start 2024-08-18T22:21:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.307+0000 7f4a4be00640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4a300678c0 0x7f4a30069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4a5406c360 tx=0x7f4a3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.307+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e9706d2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d32c0 0x55e970685fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e9706868e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e97056fae0 con 0x55e9706d29a0 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e97055bba0 con 0x55e9706d32c0 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e9704d64f0 con 0x55e970686500 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a53400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e9706d2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a53400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e9706d2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39190/0 (socket says 172.21.15.5:39190) 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a53400640 1 -- 172.21.15.5:0/2929822839 learned_addr learned my addr 172.21.15.5:0/2929822839 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a4be00640 1 --2- 172.21.15.5:0/2929822839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d32c0 0x55e970685fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a53e00640 1 --2- 172.21.15.5:0/2929822839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e9706868e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a53400640 1 -- 172.21.15.5:0/2929822839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 msgr2=0x55e9706868e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a53400640 1 --2- 172.21.15.5:0/2929822839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e9706868e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a53400640 1 -- 172.21.15.5:0/2929822839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d32c0 msgr2=0x55e970685fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a53400640 1 --2- 172.21.15.5:0/2929822839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d32c0 0x55e970685fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a53400640 1 -- 172.21.15.5:0/2929822839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e970476a90 con 0x55e9706d29a0 2024-08-18T22:21:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a53400640 1 --2- 172.21.15.5:0/2929822839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e9706d2d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4a440f02c0 tx=0x7f4a440ec990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0393065946364f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a43e00640 1 -- 172.21.15.5:0/2929822839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a440f48c0 con 0x55e9706d29a0 2024-08-18T22:21:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a43e00640 1 -- 172.21.15.5:0/2929822839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a440b0050 con 0x55e9706d29a0 2024-08-18T22:21:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a43e00640 1 -- 172.21.15.5:0/2929822839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a440f90f0 con 0x55e9706d29a0 2024-08-18T22:21:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- 172.21.15.5:0/2929822839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 msgr2=0x55e9706d2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 --2- 172.21.15.5:0/2929822839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e9706d2d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4a440f02c0 tx=0x7f4a440ec990 comp rx=0 tx=0).stop 2024-08-18T22:21:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- 172.21.15.5:0/2929822839 shutdown_connections 2024-08-18T22:21:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 --2- 172.21.15.5:0/2929822839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e9706868e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 --2- 172.21.15.5:0/2929822839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d32c0 0x55e970685fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 --2- 172.21.15.5:0/2929822839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e9706d2d80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- 172.21.15.5:0/2929822839 >> 172.21.15.5:0/2929822839 conn(0x55e970680010 msgr2=0x55e9706b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- 172.21.15.5:0/2929822839 shutdown_connections 2024-08-18T22:21:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- 172.21.15.5:0/2929822839 wait complete. 2024-08-18T22:21:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- start start 2024-08-18T22:21:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 Processor -- start 2024-08-18T22:21:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e9706b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d29a0 0x55e97068de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e97068e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e9704d24b0 con 0x55e9706d32c0 2024-08-18T22:21:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e970490b50 con 0x55e9706d29a0 2024-08-18T22:21:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e970477d00 con 0x55e970686500 2024-08-18T22:21:55.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.311+0000 7f4a5d435000 10 client.0 _ll_register_callbacks cb 0x55e970673f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:21:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e97068e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e97068e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39200/0 (socket says 172.21.15.5:39200) 2024-08-18T22:21:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53e00640 1 -- 172.21.15.5:0/4134557612 learned_addr learned my addr 172.21.15.5:0/4134557612 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53400640 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e9706b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a4be00640 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d29a0 0x55e97068de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53e00640 1 -- 172.21.15.5:0/4134557612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 msgr2=0x55e9706b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53e00640 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e9706b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53e00640 1 -- 172.21.15.5:0/4134557612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d29a0 msgr2=0x55e97068de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53e00640 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d29a0 0x55e97068de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53e00640 1 -- 172.21.15.5:0/4134557612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e97048f060 con 0x55e9706d32c0 2024-08-18T22:21:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a4be00640 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d29a0 0x55e97068de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53e00640 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e97068e390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c007da0 tx=0x7f4a4c013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85a9172829f6312 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a40c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a40c00640 1 -- 172.21.15.5:0/4134557612 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c01c070 con 0x55e9706d32c0 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a40c00640 1 -- 172.21.15.5:0/4134557612 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f4a4c016430 con 0x55e9706d32c0 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 -- 172.21.15.5:0/4134557612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a440b0050 con 0x55e9706d32c0 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a40c00640 1 -- 172.21.15.5:0/4134557612 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4a4c016630 con 0x55e9706d32c0 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 10 client.5187 fetch_fsmap learned FSMap version 18 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 -- 172.21.15.5:0/4134557612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55e9704a2f50 con 0x55e9706d32c0 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a40c00640 1 -- 172.21.15.5:0/4134557612 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a440b0050 con 0x55e9706d32c0 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a40c00640 1 -- 172.21.15.5:0/4134557612 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f4a4c0167d0 con 0x55e9706d32c0 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 10 client.5187 fetch_fsmap finished waiting for FSMap version 18 2024-08-18T22:21:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 10 client.5187 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-08-18T22:21:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 20 client.5187 populate_metadata read hostname 'smithi005' 2024-08-18T22:21:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55e9706b4d30 0x55e9706b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 4 client.5187 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:21:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 -- 172.21.15.5:0/4134557612 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e970470e10 con 0x55e9706b4d30 2024-08-18T22:21:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53400640 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55e9706b4d30 0x55e9706b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a53400640 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55e9706b4d30 0x55e9706b5140 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e8b124e9e926af server_cookie=477182eb3ccf68cf in_seq=0 out_seq=0 2024-08-18T22:21:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a40c00640 10 client.5187 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a40c00640 1 -- 172.21.15.5:0/4134557612 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e970470e10 con 0x55e9706b4d30 2024-08-18T22:21:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a40c00640 10 client.5187 handle_command_reply: tid=0 2024-08-18T22:21:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 client.5187 shutdown 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 -- 172.21.15.5:0/4134557612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 msgr2=0x55e97068e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e97068e390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c007da0 tx=0x7f4a4c013680 comp rx=0 tx=0).stop 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 -- 172.21.15.5:0/4134557612 shutdown_connections 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55e9706b4d30 0x55e9706b5140 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e97068e390 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d29a0 0x55e97068de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 --2- 172.21.15.5:0/4134557612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e9706b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 -- 172.21.15.5:0/4134557612 >> 172.21.15.5:0/4134557612 conn(0x55e970680010 msgr2=0x55e9706856c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a40c00640 0 client.5187 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 -- 172.21.15.5:0/4134557612 shutdown_connections 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 1 -- 172.21.15.5:0/4134557612 wait complete. 2024-08-18T22:21:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.315+0000 7f4a5d435000 20 client.5187 trim_cache size 0 max 16384 2024-08-18T22:21:55.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a5d435000 1 Processor -- start 2024-08-18T22:21:55.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a5d435000 1 -- start start 2024-08-18T22:21:55.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e970686500 0x55e9706d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e9706d29a0 0x55e9706d1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e9706e2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a5d435000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4a54204120 con 0x55e9706d32c0 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a5d435000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a54203120 con 0x55e970686500 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a5d435000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5415dca0 con 0x55e9706d29a0 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a53e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e9706e2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a53e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e9706e2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39212/0 (socket says 172.21.15.5:39212) 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a53e00640 1 -- 172.21.15.5:0/3445761067 learned_addr learned my addr 172.21.15.5:0/3445761067 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a4be00640 1 --2- 172.21.15.5:0/3445761067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e9706d29a0 0x55e9706d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a53400640 1 --2- 172.21.15.5:0/3445761067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e970686500 0x55e9706d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a53e00640 1 -- 172.21.15.5:0/3445761067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e9706d29a0 msgr2=0x55e9706d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a53e00640 1 --2- 172.21.15.5:0/3445761067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e9706d29a0 0x55e9706d1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a53e00640 1 -- 172.21.15.5:0/3445761067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e970686500 msgr2=0x55e9706d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a53e00640 1 --2- 172.21.15.5:0/3445761067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e970686500 0x55e9706d11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a53e00640 1 -- 172.21.15.5:0/3445761067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e970558dd0 con 0x55e9706d32c0 2024-08-18T22:21:55.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a53e00640 1 --2- 172.21.15.5:0/3445761067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e9706e2c50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009aa0 tx=0x7f4a4c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9190291cdc5e50 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a43400640 1 -- 172.21.15.5:0/3445761067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c01c040 con 0x55e9706d32c0 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a43400640 1 -- 172.21.15.5:0/3445761067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4c0167d0 con 0x55e9706d32c0 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.335+0000 7f4a43400640 1 -- 172.21.15.5:0/3445761067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c027020 con 0x55e9706d32c0 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 -- 172.21.15.5:0/3445761067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 msgr2=0x55e9706e2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 --2- 172.21.15.5:0/3445761067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e9706e2c50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009aa0 tx=0x7f4a4c019000 comp rx=0 tx=0).stop 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 -- 172.21.15.5:0/3445761067 shutdown_connections 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 --2- 172.21.15.5:0/3445761067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d32c0 0x55e9706e2c50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 --2- 172.21.15.5:0/3445761067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e9706d29a0 0x55e9706d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 --2- 172.21.15.5:0/3445761067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e970686500 0x55e9706d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 -- 172.21.15.5:0/3445761067 >> 172.21.15.5:0/3445761067 conn(0x55e970680010 msgr2=0x55e9706d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 -- 172.21.15.5:0/3445761067 shutdown_connections 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 -- 172.21.15.5:0/3445761067 wait complete. 2024-08-18T22:21:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 -- start start 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 Processor -- start 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e970746450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e970746990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d32c0 0x55e970746ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e9706b46e0 con 0x55e9706d29a0 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e9704a17f0 con 0x55e9706d32c0 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e9704d5800 con 0x55e970686500 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 10 client.0 _ll_register_callbacks cb 0x7f4a4c009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a4be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e970746990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a53e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d32c0 0x55e970746ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a53400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e970746450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a4be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e970746990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39228/0 (socket says 172.21.15.5:39228) 2024-08-18T22:21:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a4be00640 1 -- 172.21.15.5:0/462171099 learned_addr learned my addr 172.21.15.5:0/462171099 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a4be00640 1 -- 172.21.15.5:0/462171099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 msgr2=0x55e970746450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a4be00640 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e970746450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a4be00640 1 -- 172.21.15.5:0/462171099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d32c0 msgr2=0x55e970746ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a4be00640 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d32c0 0x55e970746ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a4be00640 1 -- 172.21.15.5:0/462171099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e970469cd0 con 0x55e9706d29a0 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a53e00640 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d32c0 0x55e970746ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a4be00640 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e970746990 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c015770 tx=0x7f4a3c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bb0aa22c829db3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a40c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a40c00640 1 -- 172.21.15.5:0/462171099 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c027020 con 0x55e9706d29a0 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 -- 172.21.15.5:0/462171099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a4c0167d0 con 0x55e9706d29a0 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a40c00640 1 -- 172.21.15.5:0/462171099 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f4a3c023410 con 0x55e9706d29a0 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a40c00640 1 -- 172.21.15.5:0/462171099 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4a3c031050 con 0x55e9706d29a0 2024-08-18T22:21:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 10 client.5193 fetch_fsmap learned FSMap version 18 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 1 -- 172.21.15.5:0/462171099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55e97047c320 con 0x55e9706d29a0 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a40c00640 1 -- 172.21.15.5:0/462171099 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4c0167d0 con 0x55e9706d29a0 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a40c00640 1 -- 172.21.15.5:0/462171099 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f4a3c034020 con 0x55e9706d29a0 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 10 client.5193 fetch_fsmap finished waiting for FSMap version 18 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 10 client.5193 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.339+0000 7f4a5d435000 20 client.5193 populate_metadata read hostname 'smithi005' 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55e9706e5eb0 0x55e9706e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 4 client.5193 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 -- 172.21.15.5:0/462171099 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e9704e3c20 con 0x55e9706e5eb0 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a53400640 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55e9706e5eb0 0x55e9706e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a53400640 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55e9706e5eb0 0x55e9706e62c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6024f58634543599 server_cookie=95ddd9dbd8af9f in_seq=0 out_seq=0 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a40c00640 10 client.5193 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a40c00640 1 -- 172.21.15.5:0/462171099 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e9704e3c20 con 0x55e9706e5eb0 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a40c00640 10 client.5193 handle_command_reply: tid=0 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 client.5193 shutdown 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 -- 172.21.15.5:0/462171099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 msgr2=0x55e970746990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e970746990 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c015770 tx=0x7f4a3c000bd0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 -- 172.21.15.5:0/462171099 shutdown_connections 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x55e9706e5eb0 0x55e9706e62c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e9706d32c0 0x55e970746ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e9706d29a0 0x55e970746990 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 --2- 172.21.15.5:0/462171099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e970686500 0x55e970746450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a40c00640 0 client.5193 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 -- 172.21.15.5:0/462171099 >> 172.21.15.5:0/462171099 conn(0x55e970680010 msgr2=0x55e9706d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 -- 172.21.15.5:0/462171099 shutdown_connections 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 1 -- 172.21.15.5:0/462171099 wait complete. 2024-08-18T22:21:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5d435000 20 client.5193 trim_cache size 0 max 16384 2024-08-18T22:21:55.352 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:21:55.352 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-18T22:21:55.352 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-08-18T22:21:55.352 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:21:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 -- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4a300678c0 msgr2=0x7f4a30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4a300678c0 0x7f4a30069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4a5406c360 tx=0x7f4a3c009040 comp rx=0 tx=0).stop 2024-08-18T22:21:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 -- 172.21.15.5:0/2753811230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5406c3c0 msgr2=0x7f4a5415c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5406c3c0 0x7f4a5415c0f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4a440097c0 tx=0x7f4a4401acc0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 -- 172.21.15.5:0/2753811230 shutdown_connections 2024-08-18T22:21:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4a300678c0 0x7f4a30069d80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5415f000 0x7f4a5413fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a54147dd0 0x7f4a54144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 --2- 172.21.15.5:0/2753811230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5406c3c0 0x7f4a5415c0f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 -- 172.21.15.5:0/2753811230 >> 172.21.15.5:0/2753811230 conn(0x7f4a540b65f0 msgr2=0x7f4a540d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 -- 172.21.15.5:0/2753811230 shutdown_connections 2024-08-18T22:21:55.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.343+0000 7f4a5a000640 1 -- 172.21.15.5:0/2753811230 wait complete. 2024-08-18T22:21:55.366 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:21:55.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-08-18T22:21:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.507+0000 7f5eeb400640 1 Processor -- start 2024-08-18T22:21:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.507+0000 7f5eeb400640 1 -- start start 2024-08-18T22:21:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.507+0000 7f5eeb400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ee415c180 0x7f5ee40cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.507+0000 7f5eeb400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ee415d4d0 0x7f5ee406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.507+0000 7f5eeb400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ee40cfb00 con 0x7f5ee415c560 2024-08-18T22:21:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.507+0000 7f5eeb400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5ee415d040 con 0x7f5ee415c180 2024-08-18T22:21:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.507+0000 7f5eeb400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee415c9f0 con 0x7f5ee415d4d0 2024-08-18T22:21:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.507+0000 7f5edbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5ee415c560 0x7f5ee40ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46900/0 (socket says 172.21.15.5:46900) 2024-08-18T22:21:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.507+0000 7f5edbe00640 1 -- 172.21.15.5:0/3061100448 learned_addr learned my addr 172.21.15.5:0/3061100448 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:21:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.507+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/3061100448 >> v2:172.21.15.117:3300/0 conn(0x7f5ee415c180 0x7f5ee40cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.507+0000 7f5ee9400640 1 --2- 172.21.15.5:0/3061100448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ee415d4d0 0x7f5ee406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.511+0000 7f5ee3e00640 1 -- 172.21.15.5:0/3061100448 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490907745 0 0) 0x7f5ee40cfb00 con 0x7f5ee415c560 2024-08-18T22:21:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.511+0000 7f5ee3e00640 1 -- 172.21.15.5:0/3061100448 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ec8003530 con 0x7f5ee415c560 2024-08-18T22:21:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.511+0000 7f5ee9400640 1 -- 172.21.15.5:0/3061100448 >> v2:172.21.15.117:3300/0 conn(0x7f5ee415c180 msgr2=0x7f5ee40cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.511+0000 7f5ee9400640 1 --2- 172.21.15.5:0/3061100448 >> v2:172.21.15.117:3300/0 conn(0x7f5ee415c180 0x7f5ee40cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.511+0000 7f5ee9400640 1 -- 172.21.15.5:0/3061100448 >> v1:172.21.15.5:6789/0 conn(0x7f5ee415c560 legacy=0x7f5ee40ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.511+0000 7f5ee9400640 1 -- 172.21.15.5:0/3061100448 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee415ccd0 con 0x7f5ee415d4d0 2024-08-18T22:21:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.511+0000 7f5ee9400640 1 --2- 172.21.15.5:0/3061100448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ee415d4d0 0x7f5ee406db80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009d90 tx=0x7f5edc01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bdeee5382687d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5ee3e00640 1 -- 172.21.15.5:0/3061100448 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0b2070 con 0x7f5ee415d4d0 2024-08-18T22:21:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5ee3e00640 1 -- 172.21.15.5:0/3061100448 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee40ced70 con 0x7f5ee415d4d0 2024-08-18T22:21:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5ee3e00640 1 -- 172.21.15.5:0/3061100448 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0a5bc0 con 0x7f5ee415d4d0 2024-08-18T22:21:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5eeb400640 1 -- 172.21.15.5:0/3061100448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ee415d4d0 msgr2=0x7f5ee406db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5eeb400640 1 --2- 172.21.15.5:0/3061100448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ee415d4d0 0x7f5ee406db80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009d90 tx=0x7f5edc01c8e0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5eeb400640 1 -- 172.21.15.5:0/3061100448 shutdown_connections 2024-08-18T22:21:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5eeb400640 1 --2- 172.21.15.5:0/3061100448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ee415d4d0 0x7f5ee406db80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5eeb400640 1 --2- 172.21.15.5:0/3061100448 >> v2:172.21.15.117:3300/0 conn(0x7f5ee415c180 0x7f5ee40cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5eeb400640 1 -- 172.21.15.5:0/3061100448 >> 172.21.15.5:0/3061100448 conn(0x7f5ee40b1dc0 msgr2=0x7f5ee40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5eeb400640 1 -- 172.21.15.5:0/3061100448 shutdown_connections 2024-08-18T22:21:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5eeb400640 1 -- 172.21.15.5:0/3061100448 wait complete. 2024-08-18T22:21:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5eeb400640 1 Processor -- start 2024-08-18T22:21:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.515+0000 7f5eeb400640 1 -- start start 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5eeb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee415c180 0x7f5ee41430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5eeb400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ee415d4d0 0x7f5ee41525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5eeb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ee4152b00 0x7f5ee4141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5eeb400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee41692b0 con 0x7f5ee415c180 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5eeb400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee4169130 con 0x7f5ee4152b00 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5eeb400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee4169430 con 0x7f5ee415d4d0 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee8a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee415c180 0x7f5ee41430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee8a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee415c180 0x7f5ee41430a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39230/0 (socket says 172.21.15.5:39230) 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee8a00640 1 -- 172.21.15.5:0/1511669671 learned_addr learned my addr 172.21.15.5:0/1511669671 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5edbe00640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ee415d4d0 0x7f5ee41525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee9400640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ee4152b00 0x7f5ee4141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee8a00640 1 -- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ee415d4d0 msgr2=0x7f5ee41525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ee415d4d0 0x7f5ee41525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee8a00640 1 -- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ee4152b00 msgr2=0x7f5ee4141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ee4152b00 0x7f5ee4141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee8a00640 1 -- 172.21.15.5:0/1511669671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee4143680 con 0x7f5ee415c180 2024-08-18T22:21:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee415c180 0x7f5ee41430a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400e960 tx=0x7f5ed400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee1600640 1 -- 172.21.15.5:0/1511669671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4017070 con 0x7f5ee415c180 2024-08-18T22:21:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee1600640 1 -- 172.21.15.5:0/1511669671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed400ca00 con 0x7f5ee415c180 2024-08-18T22:21:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5eeb400640 1 -- 172.21.15.5:0/1511669671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee4143960 con 0x7f5ee415c180 2024-08-18T22:21:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5ee1600640 1 -- 172.21.15.5:0/1511669671 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400cdb0 con 0x7f5ee415c180 2024-08-18T22:21:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.519+0000 7f5eeb400640 1 -- 172.21.15.5:0/1511669671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee4143f20 con 0x7f5ee415c180 2024-08-18T22:21:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5ee1600640 1 -- 172.21.15.5:0/1511669671 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ed401a070 con 0x7f5ee415c180 2024-08-18T22:21:55.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5ee1600640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ec00678c0 0x7f5ec0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5ee1600640 1 -- 172.21.15.5:0/1511669671 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f5ed4086260 con 0x7f5ee415c180 2024-08-18T22:21:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5edbe00640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ec00678c0 0x7f5ec0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5eee8f8000 1 Processor -- start 2024-08-18T22:21:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5eee8f8000 1 -- start start 2024-08-18T22:21:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5edbe00640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ec00678c0 0x7f5ec0069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc007fd0 tx=0x7f5ecc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c62f70 0x561564c63350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c16630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c16b70 0x561564c16f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561564a67470 con 0x561564c63890 2024-08-18T22:21:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561564a21ad0 con 0x561564c62f70 2024-08-18T22:21:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561564a63430 con 0x561564c16b70 2024-08-18T22:21:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5edbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c16630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5edbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c16630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39238/0 (socket says 172.21.15.5:39238) 2024-08-18T22:21:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5edbe00640 1 -- 172.21.15.5:0/3239703175 learned_addr learned my addr 172.21.15.5:0/3239703175 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/3239703175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c62f70 0x561564c63350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5ee9400640 1 --2- 172.21.15.5:0/3239703175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c16b70 0x561564c16f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5edbe00640 1 -- 172.21.15.5:0/3239703175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c16b70 msgr2=0x561564c16f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5edbe00640 1 --2- 172.21.15.5:0/3239703175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c16b70 0x561564c16f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5edbe00640 1 -- 172.21.15.5:0/3239703175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c62f70 msgr2=0x561564c63350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5edbe00640 1 --2- 172.21.15.5:0/3239703175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c62f70 0x561564c63350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5edbe00640 1 -- 172.21.15.5:0/3239703175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561564a07a10 con 0x561564c63890 2024-08-18T22:21:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/3239703175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c62f70 0x561564c63350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5edbe00640 1 --2- 172.21.15.5:0/3239703175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c16630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00fae0 tx=0x7f5ecc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a242ca3f18bb1b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5ed9600640 1 -- 172.21.15.5:0/3239703175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc025070 con 0x561564c63890 2024-08-18T22:21:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5ed9600640 1 -- 172.21.15.5:0/3239703175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ecc015cb0 con 0x561564c63890 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.523+0000 7f5ed9600640 1 -- 172.21.15.5:0/3239703175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc015e60 con 0x561564c63890 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3239703175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 msgr2=0x561564c16630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/3239703175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c16630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00fae0 tx=0x7f5ecc000ee0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3239703175 shutdown_connections 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/3239703175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c16b70 0x561564c16f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/3239703175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c16630 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/3239703175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c62f70 0x561564c63350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3239703175 >> 172.21.15.5:0/3239703175 conn(0x561564c10680 msgr2=0x561564c45df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3239703175 shutdown_connections 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3239703175 wait complete. 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 -- start start 2024-08-18T22:21:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 Processor -- start 2024-08-18T22:21:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c16b70 0x561564c1d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c62f70 0x561564c1d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c1deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561564a32770 con 0x561564c63890 2024-08-18T22:21:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561564a08c80 con 0x561564c16b70 2024-08-18T22:21:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561564ae8130 con 0x561564c62f70 2024-08-18T22:21:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 10 client.0 _ll_register_callbacks cb 0x561564c040e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:21:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ee9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c1deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ee9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c1deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39250/0 (socket says 172.21.15.5:39250) 2024-08-18T22:21:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ee9400640 1 -- 172.21.15.5:0/1682924117 learned_addr learned my addr 172.21.15.5:0/1682924117 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c16b70 0x561564c1d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5edbe00640 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c62f70 0x561564c1d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ee9400640 1 -- 172.21.15.5:0/1682924117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c62f70 msgr2=0x561564c1d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ee9400640 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c62f70 0x561564c1d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ee9400640 1 -- 172.21.15.5:0/1682924117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c16b70 msgr2=0x561564c1d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ee9400640 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c16b70 0x561564c1d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ee9400640 1 -- 172.21.15.5:0/1682924117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561564a1ffe0 con 0x561564c63890 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ee9400640 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c1deb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009d90 tx=0x7f5edc01b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c28779ad91bd45 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ed2000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ed2000640 1 -- 172.21.15.5:0/1682924117 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0b2040 con 0x561564c63890 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5eee8f8000 1 -- 172.21.15.5:0/1682924117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ecc015cb0 con 0x561564c63890 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.527+0000 7f5ed2000640 1 -- 172.21.15.5:0/1682924117 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f5edc0a5b00 con 0x561564c63890 2024-08-18T22:21:55.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5ed2000640 1 -- 172.21.15.5:0/1682924117 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f5edc0cc050 con 0x561564c63890 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 10 client.5205 fetch_fsmap learned FSMap version 18 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 -- 172.21.15.5:0/1682924117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561564a33ed0 con 0x561564c63890 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5ed2000640 1 -- 172.21.15.5:0/1682924117 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ecc015cb0 con 0x561564c63890 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5ed2000640 1 -- 172.21.15.5:0/1682924117 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f5edc0cf020 con 0x561564c63890 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 10 client.5205 fetch_fsmap finished waiting for FSMap version 18 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 10 client.5205 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 20 client.5205 populate_metadata read hostname 'smithi005' 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x561564c1e8c0 0x561564c75020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 4 client.5205 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 -- 172.21.15.5:0/1682924117 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561564a01d90 con 0x561564c1e8c0 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x561564c1e8c0 0x561564c75020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x561564c1e8c0 0x561564c75020 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c79eb501ea83b5d4 server_cookie=475ec3389f4ba7a3 in_seq=0 out_seq=0 2024-08-18T22:21:55.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5ed2000640 10 client.5205 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5ed2000640 1 -- 172.21.15.5:0/1682924117 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561564a01d90 con 0x561564c1e8c0 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5ed2000640 10 client.5205 handle_command_reply: tid=0 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 client.5205 shutdown 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 -- 172.21.15.5:0/1682924117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 msgr2=0x561564c1deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c1deb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009d90 tx=0x7f5edc01b120 comp rx=0 tx=0).stop 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 -- 172.21.15.5:0/1682924117 shutdown_connections 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x561564c1e8c0 0x561564c75020 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564c1deb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c62f70 0x561564c1d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/1682924117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c16b70 0x561564c1d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5ed2000640 0 client.5205 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 -- 172.21.15.5:0/1682924117 >> 172.21.15.5:0/1682924117 conn(0x561564c10680 msgr2=0x561564c45df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 -- 172.21.15.5:0/1682924117 shutdown_connections 2024-08-18T22:21:55.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 1 -- 172.21.15.5:0/1682924117 wait complete. 2024-08-18T22:21:55.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.531+0000 7f5eee8f8000 20 client.5205 trim_cache size 0 max 16384 2024-08-18T22:21:55.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.547+0000 7f5eee8f8000 1 Processor -- start 2024-08-18T22:21:55.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.547+0000 7f5eee8f8000 1 -- start start 2024-08-18T22:21:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c16b70 0x561564cd1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c62f70 0x561564cd2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564cd29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee4204160 con 0x561564c63890 2024-08-18T22:21:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee4203180 con 0x561564c16b70 2024-08-18T22:21:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee4145550 con 0x561564c62f70 2024-08-18T22:21:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ee9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564cd29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ee9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564cd29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39258/0 (socket says 172.21.15.5:39258) 2024-08-18T22:21:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ee9400640 1 -- 172.21.15.5:0/278449025 learned_addr learned my addr 172.21.15.5:0/278449025 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:55.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/278449025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c16b70 0x561564cd1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5edbe00640 1 --2- 172.21.15.5:0/278449025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c62f70 0x561564cd2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ee9400640 1 -- 172.21.15.5:0/278449025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c62f70 msgr2=0x561564cd2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ee9400640 1 --2- 172.21.15.5:0/278449025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c62f70 0x561564cd2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ee9400640 1 -- 172.21.15.5:0/278449025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c16b70 msgr2=0x561564cd1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ee9400640 1 --2- 172.21.15.5:0/278449025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c16b70 0x561564cd1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ee9400640 1 -- 172.21.15.5:0/278449025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561564ae85c0 con 0x561564c63890 2024-08-18T22:21:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5edbe00640 1 --2- 172.21.15.5:0/278449025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c62f70 0x561564cd2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:21:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ee9400640 1 --2- 172.21.15.5:0/278449025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564cd29c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5edc01af90 tx=0x7f5edc0bb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38405d1bb240fb18 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ed8c00640 1 -- 172.21.15.5:0/278449025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0d5070 con 0x561564c63890 2024-08-18T22:21:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ed8c00640 1 -- 172.21.15.5:0/278449025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5edc0b3040 con 0x561564c63890 2024-08-18T22:21:55.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5ed8c00640 1 -- 172.21.15.5:0/278449025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0b2040 con 0x561564c63890 2024-08-18T22:21:55.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 -- 172.21.15.5:0/278449025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 msgr2=0x561564cd29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/278449025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564cd29c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5edc01af90 tx=0x7f5edc0bb000 comp rx=0 tx=0).stop 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 -- 172.21.15.5:0/278449025 shutdown_connections 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/278449025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c63890 0x561564cd29c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/278449025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c62f70 0x561564cd2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/278449025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c16b70 0x561564cd1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 -- 172.21.15.5:0/278449025 >> 172.21.15.5:0/278449025 conn(0x561564c10680 msgr2=0x561564c704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 -- 172.21.15.5:0/278449025 shutdown_connections 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 -- 172.21.15.5:0/278449025 wait complete. 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 -- start start 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 Processor -- start 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c16b70 0x561564c78370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c62f70 0x561564c788b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.551+0000 7f5eee8f8000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c63890 0x561564c91300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561564a0ea10 con 0x561564c62f70 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee4202b80 con 0x561564c63890 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561564a66780 con 0x561564c16b70 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 10 client.0 _ll_register_callbacks cb 0x7f5ed4009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5edbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c62f70 0x561564c788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ee8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c16b70 0x561564c78370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5edbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c62f70 0x561564c788b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39262/0 (socket says 172.21.15.5:39262) 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5edbe00640 1 -- 172.21.15.5:0/3637761367 learned_addr learned my addr 172.21.15.5:0/3637761367 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ee9400640 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c63890 0x561564c91300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5edbe00640 1 -- 172.21.15.5:0/3637761367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c16b70 msgr2=0x561564c78370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5edbe00640 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c16b70 0x561564c78370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5edbe00640 1 -- 172.21.15.5:0/3637761367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c63890 msgr2=0x561564c91300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:55.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5edbe00640 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c63890 0x561564c91300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5edbe00640 1 -- 172.21.15.5:0/3637761367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615649fac50 con 0x561564c62f70 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5edbe00640 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c62f70 0x561564c788b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0068a0 tx=0x7f5ecc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc23e43e002f2638 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ed2000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ed2000640 1 -- 172.21.15.5:0/3637761367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc025040 con 0x561564c62f70 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ed2000640 1 -- 172.21.15.5:0/3637761367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f5ecc0049f0 con 0x561564c62f70 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3637761367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5edc0b3040 con 0x561564c62f70 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ed2000640 1 -- 172.21.15.5:0/3637761367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f5ecc015e60 con 0x561564c62f70 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 10 client.5211 fetch_fsmap learned FSMap version 18 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3637761367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561564a0d2a0 con 0x561564c62f70 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ed2000640 1 -- 172.21.15.5:0/3637761367 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5edc0b3040 con 0x561564c62f70 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ed2000640 1 -- 172.21.15.5:0/3637761367 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f5ecc004bf0 con 0x561564c62f70 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 10 client.5211 fetch_fsmap finished waiting for FSMap version 18 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 10 client.5211 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-08-18T22:21:55.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 20 client.5211 populate_metadata read hostname 'smithi005' 2024-08-18T22:21:55.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x561564c91c00 0x561564cd59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:55.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 4 client.5211 mds_command: new command op to 4908 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-08-18T22:21:55.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3637761367 --> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] -- command(tid 0: {"prefix": "perf dump"}) -- 0x561564a74ba0 con 0x561564c91c00 2024-08-18T22:21:55.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x561564c91c00 0x561564cd59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:55.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ed2000640 10 client.5211 ms_handle_connect on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:55.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ee8a00640 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x561564c91c00 0x561564cd59c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2f111f5f5e2c770 server_cookie=1f3dc6dd249f363a in_seq=0 out_seq=0 2024-08-18T22:21:55.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ed2000640 1 -- 172.21.15.5:0/3637761367 <== mds.0 v2:172.21.15.5:6832/771750285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17998 (crc 0 0 0) 0x561564a74ba0 con 0x561564c91c00 2024-08-18T22:21:55.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ed2000640 10 client.5211 handle_command_reply: tid=0 2024-08-18T22:21:55.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 client.5211 shutdown 2024-08-18T22:21:55.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3637761367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c62f70 msgr2=0x561564c788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c62f70 0x561564c788b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0068a0 tx=0x7f5ecc000bd0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3637761367 shutdown_connections 2024-08-18T22:21:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.5:6832/771750285,v1:172.21.15.5:6834/771750285] conn(0x561564c91c00 0x561564cd59c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561564c63890 0x561564c91300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561564c62f70 0x561564c788b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5ed2000640 0 client.5211 ms_handle_reset on v2:172.21.15.5:6832/771750285 2024-08-18T22:21:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 --2- 172.21.15.5:0/3637761367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561564c16b70 0x561564c78370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3637761367 >> 172.21.15.5:0/3637761367 conn(0x561564c10680 msgr2=0x561564c156b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3637761367 shutdown_connections 2024-08-18T22:21:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 1 -- 172.21.15.5:0/3637761367 wait complete. 2024-08-18T22:21:55.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.555+0000 7f5eee8f8000 20 client.5211 trim_cache size 0 max 16384 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 3393, 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 3392, 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 856148, 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 38170128, 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 17, 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 6, 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.416038300, 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.198593655, 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.083083348, 2024-08-18T22:21:55.566 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.106623714, 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3391, 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.711080251, 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000209696 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 10, 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000947, 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000094 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2024-08-18T22:21:55.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 2724, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2718, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 786809, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 23539762, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 5, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.307912526, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.143179414, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.074763757, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.081192874, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2718, 2024-08-18T22:21:55.568 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.519268256, 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000191047 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 120880, 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 27376 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 29562, 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 51906, 2024-08-18T22:21:55.569 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 10468105, 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 54449850, 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 8, 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 3.723183560, 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 2.722376057, 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 2.392353013, 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.069020045, 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 51904, 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.846668134, 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000035578 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.570 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 47391, 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.010287465, 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000217 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 90336 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-18T22:21:55.571 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2615, 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 16.864349682, 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.006449082 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3348, 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.762213483, 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000227662 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 25770, 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 25770, 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 25770, 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 307.094295936, 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.011916736 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 12, 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2024-08-18T22:21:55.573 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 17774, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 0, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 17774, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 0, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 17773, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 0, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 2, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 2, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 2, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 46799, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 46260, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2024-08-18T22:21:55.574 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 108, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 1682, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2024-08-18T22:21:55.575 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 1682, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 13, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 2, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 11, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 1669, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 1388, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 4042, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-18T22:21:55.576 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-18T22:21:55.577 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 3627, 2024-08-18T22:21:55.577 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 2620, 2024-08-18T22:21:55.577 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 23, 2024-08-18T22:21:55.577 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 14114 2024-08-18T22:21:55.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.577 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2024-08-18T22:21:55.577 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2024-08-18T22:21:55.577 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2024-08-18T22:21:55.577 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2024-08-18T22:21:55.577 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2024-08-18T22:21:55.577 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 0, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 4146, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 3624, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 2201, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2024-08-18T22:21:55.578 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_path": 0, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_inode": 0, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 1, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 31302, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2024-08-18T22:21:55.579 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 31302, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 48, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 48, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 4, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 98275847, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 0, 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2024-08-18T22:21:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2730, 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 93.002425963, 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.034066822 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 0 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 14, 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 2016, 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 2002, 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 13, 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 13, 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 0, 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 17774, 2024-08-18T22:21:55.581 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 19775, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 2001, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 2, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 2783, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 2781, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 97540, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 231732 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 28673, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 25770, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 5, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2024-08-18T22:21:55.582 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2000, 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.655752792, 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000827876 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 29, 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004053935, 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000139790 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 6000, 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 7.504572002, 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001250762 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 7526, 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 5.064121099, 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000672883 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.584 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000074434, 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000074434 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.586 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.003316657, 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.003316657 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.255795536, 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.255795536 2024-08-18T22:21:55.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000105016, 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000105016 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8, 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.653107452, 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.081638431 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2201, 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 272.687906175, 2024-08-18T22:21:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.123892733 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2024-08-18T22:21:55.589 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.044694574, 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.044694574 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.590 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000287708, 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000287708 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8000, 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 19.220508556, 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002402563 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.593 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 1, 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 1, 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 0, 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 1, 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 18344, 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 18344, 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 81, 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-08-18T22:21:55.594 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-08-18T22:21:55.595 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:21:55.596 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 250601, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 86, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 5624, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 80, 2024-08-18T22:21:55.597 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 13388348, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 660675, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2024-08-18T22:21:55.598 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 8264, 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 94748674, 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 37, 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 8264, 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8264, 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 37.039162276, 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.004481989 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8264, 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 8366 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.599 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 8264, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 1727, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 6537, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 0, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 11, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 43, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 2771, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 28, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 1624, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 2034, 2024-08-18T22:21:55.600 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 1684, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 22, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2024-08-18T22:21:55.601 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2024-08-18T22:21:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 43, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 5, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 8, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 8, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 0, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 115, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 0, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 34 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 1, 2024-08-18T22:21:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 32, 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 32, 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed_ops": 3624, 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 3624, 2024-08-18T22:21:55.604 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 35674, 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 9331513, 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 35674, 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 35674, 2024-08-18T22:21:55.605 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 9331513, 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:21:55.606 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 8264, 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 95127690, 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 8264, 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 95127690, 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:21:55.607 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 8264, 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 8264, 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 8264, 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 8264, 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.608 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 3624, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 379016, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 3624, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 41, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 379016, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.609 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x56078d064780": { 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 31302, 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 94081543, 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 31302, 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:21:55.610 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:21:55.611 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2730, 2024-08-18T22:21:55.611 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 94081543, 2024-08-18T22:21:55.611 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:21:55.611 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:21:55.611 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:21:55.611 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:21:55.611 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:55.611 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:21:55.611 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:21:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 -- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ec00678c0 msgr2=0x7f5ec0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ec00678c0 0x7f5ec0069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc007fd0 tx=0x7f5ecc009040 comp rx=0 tx=0).stop 2024-08-18T22:21:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 -- 172.21.15.5:0/1511669671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee415c180 msgr2=0x7f5ee41430a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee415c180 0x7f5ee41430a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400e960 tx=0x7f5ed400ee20 comp rx=0 tx=0).stop 2024-08-18T22:21:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 -- 172.21.15.5:0/1511669671 shutdown_connections 2024-08-18T22:21:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ec00678c0 0x7f5ec0069d80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ee4152b00 0x7f5ee4141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ee415d4d0 0x7f5ee41525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 --2- 172.21.15.5:0/1511669671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee415c180 0x7f5ee41430a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 -- 172.21.15.5:0/1511669671 >> 172.21.15.5:0/1511669671 conn(0x7f5ee40b1dc0 msgr2=0x7f5ee4073480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 -- 172.21.15.5:0/1511669671 shutdown_connections 2024-08-18T22:21:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:55.559+0000 7f5eeb400640 1 -- 172.21.15.5:0/1511669671 wait complete. 2024-08-18T22:21:55.614 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:21:55.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:21:55.700 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:21:55.794 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:21:55.794 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:21:55.794 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:21:55.794 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:21:55.803 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:21:55.803 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:21:55.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:21:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f685c000640 1 Processor -- start 2024-08-18T22:21:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f685c000640 1 -- start start 2024-08-18T22:21:56.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f685c000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6854144050 0x7f685406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f685c000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6854147860 0x7f68540b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f685c000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f685406ddd0 con 0x7f685406f3b0 2024-08-18T22:21:56.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f685c000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f685406db80 con 0x7f6854144050 2024-08-18T22:21:56.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f685c000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f685406e9e0 con 0x7f6854147860 2024-08-18T22:21:56.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6858c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f685406f3b0 0x7f6854144430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46908/0 (socket says 172.21.15.5:46908) 2024-08-18T22:21:56.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6858c00640 1 -- 172.21.15.5:0/2226248035 learned_addr learned my addr 172.21.15.5:0/2226248035 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:21:56.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f685a000640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6854147860 0x7f68540b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6859600640 1 --2- 172.21.15.5:0/2226248035 >> v2:172.21.15.117:3300/0 conn(0x7f6854144050 0x7f685406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065461202 0 0) 0x7f685406ddd0 con 0x7f685406f3b0 2024-08-18T22:21:56.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f683c003530 con 0x7f685406f3b0 2024-08-18T22:21:56.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3451709365 0 0) 0x7f683c003530 con 0x7f685406f3b0 2024-08-18T22:21:56.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6854147860 msgr2=0x7f68540b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:56.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6854147860 0x7f68540b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 >> v2:172.21.15.117:3300/0 conn(0x7f6854144050 msgr2=0x7f685406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:56.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 --2- 172.21.15.5:0/2226248035 >> v2:172.21.15.117:3300/0 conn(0x7f6854144050 0x7f685406ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685406e0b0 con 0x7f685406f3b0 2024-08-18T22:21:56.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f6840001680 con 0x7f685406f3b0 2024-08-18T22:21:56.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 >> v1:172.21.15.5:6789/0 conn(0x7f685406f3b0 legacy=0x7f6854144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f683c0039c0 0x7f683c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6854147860 0x7f683c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c004d50 0x7f683c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f685406db80 con 0x7f683c004d50 2024-08-18T22:21:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f685406e9e0 con 0x7f683c0039c0 2024-08-18T22:21:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f683c00b9d0 con 0x7f6854147860 2024-08-18T22:21:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f685a000640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c004d50 0x7f683c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6859600640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f683c0039c0 0x7f683c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.039+0000 7f6858c00640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6854147860 0x7f683c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f685a000640 1 -- 172.21.15.5:0/2226248035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6854147860 msgr2=0x7f683c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f685a000640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6854147860 0x7f683c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f685a000640 1 -- 172.21.15.5:0/2226248035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f683c0039c0 msgr2=0x7f683c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:56.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f685a000640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f683c0039c0 0x7f683c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f685a000640 1 -- 172.21.15.5:0/2226248035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c003530 con 0x7f683c004d50 2024-08-18T22:21:56.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f685a000640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c004d50 0x7f683c0051d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f684c009ab0 tx=0x7f684c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda1bb5a73a33d8c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:56.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c0b2070 con 0x7f683c004d50 2024-08-18T22:21:56.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f684c0a5640 con 0x7f683c004d50 2024-08-18T22:21:56.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f6853e00640 1 -- 172.21.15.5:0/2226248035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c0096b0 con 0x7f683c004d50 2024-08-18T22:21:56.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f685c000640 1 -- 172.21.15.5:0/2226248035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c004d50 msgr2=0x7f683c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f685c000640 1 --2- 172.21.15.5:0/2226248035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f683c004d50 0x7f683c0051d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f684c009ab0 tx=0x7f684c01ca50 comp rx=0 tx=0).stop 2024-08-18T22:21:56.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.043+0000 7f685a000640 1 -- 172.21.15.5:0/2226248035 reap_dead start 2024-08-18T22:21:56.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 -- 172.21.15.5:0/2226248035 shutdown_connections 2024-08-18T22:21:56.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 -- 172.21.15.5:0/2226248035 >> 172.21.15.5:0/2226248035 conn(0x7f68540b1dc0 msgr2=0x7f68540b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:56.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 -- 172.21.15.5:0/2226248035 shutdown_connections 2024-08-18T22:21:56.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 -- 172.21.15.5:0/2226248035 wait complete. 2024-08-18T22:21:56.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 Processor -- start 2024-08-18T22:21:56.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 -- start start 2024-08-18T22:21:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f683c004d50 0x7f685409cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f685415dab0 0x7f6854154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68540ae080 0x7f68540ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6854144b40 con 0x7f685415dab0 2024-08-18T22:21:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f685406e670 con 0x7f68540ae080 2024-08-18T22:21:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f68540b30c0 con 0x7f683c004d50 2024-08-18T22:21:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6858c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f685415dab0 0x7f6854154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6858c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f685415dab0 0x7f6854154a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39276/0 (socket says 172.21.15.5:39276) 2024-08-18T22:21:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6858c00640 1 -- 172.21.15.5:0/940930218 learned_addr learned my addr 172.21.15.5:0/940930218 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685a000640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68540ae080 0x7f68540ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6859600640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f683c004d50 0x7f685409cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6858c00640 1 -- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f683c004d50 msgr2=0x7f685409cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6858c00640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f683c004d50 0x7f685409cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6858c00640 1 -- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68540ae080 msgr2=0x7f68540ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6858c00640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68540ae080 0x7f68540ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6858c00640 1 -- 172.21.15.5:0/940930218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685409d580 con 0x7f685415dab0 2024-08-18T22:21:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6858c00640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f685415dab0 0x7f6854154a00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6840012310 tx=0x7f68400127d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6851600640 1 -- 172.21.15.5:0/940930218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684001c070 con 0x7f685415dab0 2024-08-18T22:21:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6851600640 1 -- 172.21.15.5:0/940930218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6840014750 con 0x7f685415dab0 2024-08-18T22:21:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f6851600640 1 -- 172.21.15.5:0/940930218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6840014b40 con 0x7f685415dab0 2024-08-18T22:21:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.047+0000 7f685c000640 1 -- 172.21.15.5:0/940930218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685409d860 con 0x7f685415dab0 2024-08-18T22:21:56.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.051+0000 7f685c000640 1 -- 172.21.15.5:0/940930218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f685409de20 con 0x7f685415dab0 2024-08-18T22:21:56.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.051+0000 7f685c000640 1 -- 172.21.15.5:0/940930218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f685406ee70 con 0x7f685415dab0 2024-08-18T22:21:56.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.051+0000 7f6851600640 1 -- 172.21.15.5:0/940930218 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f684001f070 con 0x7f685415dab0 2024-08-18T22:21:56.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.051+0000 7f6851600640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68340678f0 0x7f6834069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.051+0000 7f6851600640 1 -- 172.21.15.5:0/940930218 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f6840088810 con 0x7f685415dab0 2024-08-18T22:21:56.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.051+0000 7f6859600640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68340678f0 0x7f6834069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.051+0000 7f6859600640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68340678f0 0x7f6834069db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6848007520 tx=0x7f684800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.055+0000 7f6851600640 1 -- 172.21.15.5:0/940930218 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6840058aa0 con 0x7f685415dab0 2024-08-18T22:21:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.231+0000 7f685c000640 1 -- 172.21.15.5:0/940930218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f68540aea40 con 0x7f685415dab0 2024-08-18T22:21:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.231+0000 7f6851600640 1 -- 172.21.15.5:0/940930218 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) ==== 80+0+0 (secure 0 0 0) 0x7f684005cda0 con 0x7f685415dab0 2024-08-18T22:21:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:21:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 -- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68340678f0 msgr2=0x7f6834069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68340678f0 0x7f6834069db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6848007520 tx=0x7f684800b040 comp rx=0 tx=0).stop 2024-08-18T22:21:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 -- 172.21.15.5:0/940930218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f685415dab0 msgr2=0x7f6854154a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f685415dab0 0x7f6854154a00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6840012310 tx=0x7f68400127d0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 -- 172.21.15.5:0/940930218 shutdown_connections 2024-08-18T22:21:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68340678f0 0x7f6834069db0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68540ae080 0x7f68540ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f685415dab0 0x7f6854154a00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 --2- 172.21.15.5:0/940930218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f683c004d50 0x7f685409cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 -- 172.21.15.5:0/940930218 >> 172.21.15.5:0/940930218 conn(0x7f68540b1dc0 msgr2=0x7f68540cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:56.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 -- 172.21.15.5:0/940930218 shutdown_connections 2024-08-18T22:21:56.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.235+0000 7f685c000640 1 -- 172.21.15.5:0/940930218 wait complete. 2024-08-18T22:21:56.258 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:21:56.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:21:56.258 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:21:56.309 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:21:56.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:21:56.310 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:21:56.335 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:21:56.335 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:21:56.335 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:21:56.344 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:21:56.344 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:21:56.345 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:21:56.345 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:21:56.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:21:56.389 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:21:56.390 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:21:56.390 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:21:56.399 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:21:56.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:21:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.571+0000 7f465d800640 1 Processor -- start 2024-08-18T22:21:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.571+0000 7f465d800640 1 -- start start 2024-08-18T22:21:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f465d800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f465809aa40 0x7f465815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f465d800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46580cde30 0x7f465809ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f465d800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465809b360 con 0x7f46580b4510 2024-08-18T22:21:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f465d800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f46580ce770 con 0x7f46580cde30 2024-08-18T22:21:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f465d800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f465815d520 con 0x7f465809aa40 2024-08-18T22:21:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f465ce00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f46580b4510 0x7f465815fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46922/0 (socket says 172.21.15.5:46922) 2024-08-18T22:21:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f465ce00640 1 -- 172.21.15.5:0/893934664 learned_addr learned my addr 172.21.15.5:0/893934664 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:21:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f464f400640 1 --2- 172.21.15.5:0/893934664 >> v2:172.21.15.117:3300/0 conn(0x7f46580cde30 0x7f465809ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f4657e00640 1 --2- 172.21.15.5:0/893934664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f465809aa40 0x7f465815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f4657400640 1 -- 172.21.15.5:0/893934664 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768125202 0 0) 0x7f465809b360 con 0x7f46580b4510 2024-08-18T22:21:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f4657400640 1 -- 172.21.15.5:0/893934664 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f463c003530 con 0x7f46580b4510 2024-08-18T22:21:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f464f400640 1 -- 172.21.15.5:0/893934664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f465809aa40 msgr2=0x7f465815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f464f400640 1 --2- 172.21.15.5:0/893934664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f465809aa40 0x7f465815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f464f400640 1 -- 172.21.15.5:0/893934664 >> v1:172.21.15.5:6789/0 conn(0x7f46580b4510 legacy=0x7f465815fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f464f400640 1 -- 172.21.15.5:0/893934664 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46580ccd90 con 0x7f46580cde30 2024-08-18T22:21:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.575+0000 7f4657e00640 1 --2- 172.21.15.5:0/893934664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f465809aa40 0x7f465815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:56.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f464f400640 1 --2- 172.21.15.5:0/893934664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46580cde30 0x7f465809ae20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f46400097f0 tx=0x7f464001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba9c98e29382e594 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f4657400640 1 -- 172.21.15.5:0/893934664 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46400b2070 con 0x7f46580cde30 2024-08-18T22:21:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f4657400640 1 -- 172.21.15.5:0/893934664 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46400ad640 con 0x7f46580cde30 2024-08-18T22:21:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f4657400640 1 -- 172.21.15.5:0/893934664 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46400ada10 con 0x7f46580cde30 2024-08-18T22:21:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f465d800640 1 -- 172.21.15.5:0/893934664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46580cde30 msgr2=0x7f465809ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f465d800640 1 --2- 172.21.15.5:0/893934664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46580cde30 0x7f465809ae20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f46400097f0 tx=0x7f464001c470 comp rx=0 tx=0).stop 2024-08-18T22:21:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f465d800640 1 -- 172.21.15.5:0/893934664 shutdown_connections 2024-08-18T22:21:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f465d800640 1 --2- 172.21.15.5:0/893934664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46580cde30 0x7f465809ae20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f465d800640 1 --2- 172.21.15.5:0/893934664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f465809aa40 0x7f465815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f465d800640 1 -- 172.21.15.5:0/893934664 >> 172.21.15.5:0/893934664 conn(0x7f46580b3a20 msgr2=0x7f46580b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f465d800640 1 -- 172.21.15.5:0/893934664 shutdown_connections 2024-08-18T22:21:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f465d800640 1 -- 172.21.15.5:0/893934664 wait complete. 2024-08-18T22:21:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f465d800640 1 Processor -- start 2024-08-18T22:21:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.579+0000 7f465d800640 1 -- start start 2024-08-18T22:21:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f465d800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465809aa40 0x7f4658158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f465d800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46580b4510 0x7f4658156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f465d800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46580cde30 0x7f46580aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f465d800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f465815c230 con 0x7f46580b4510 2024-08-18T22:21:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f465d800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f46580cd910 con 0x7f465809aa40 2024-08-18T22:21:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f465d800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f465815c3b0 con 0x7f46580cde30 2024-08-18T22:21:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f464f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46580b4510 0x7f4658156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f4657e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465809aa40 0x7f4658158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f4657e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465809aa40 0x7f4658158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:42702/0 (socket says 172.21.15.5:42702) 2024-08-18T22:21:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f4657e00640 1 -- 172.21.15.5:0/3272317371 learned_addr learned my addr 172.21.15.5:0/3272317371 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f465ce00640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46580cde30 0x7f46580aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f464f400640 1 -- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46580cde30 msgr2=0x7f46580aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f464f400640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46580cde30 0x7f46580aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f464f400640 1 -- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465809aa40 msgr2=0x7f4658158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f464f400640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465809aa40 0x7f4658158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f464f400640 1 -- 172.21.15.5:0/3272317371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465815db50 con 0x7f46580b4510 2024-08-18T22:21:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f4657e00640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465809aa40 0x7f4658158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:21:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f464f400640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46580b4510 0x7f4658156fc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f46400ac000 tx=0x7f4640019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f4654c00640 1 -- 172.21.15.5:0/3272317371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46400ba020 con 0x7f46580b4510 2024-08-18T22:21:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f4654c00640 1 -- 172.21.15.5:0/3272317371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46400b6410 con 0x7f46580b4510 2024-08-18T22:21:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f465d800640 1 -- 172.21.15.5:0/3272317371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465815de30 con 0x7f46580b4510 2024-08-18T22:21:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f4654c00640 1 -- 172.21.15.5:0/3272317371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46400b2040 con 0x7f46580b4510 2024-08-18T22:21:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f465d800640 1 -- 172.21.15.5:0/3272317371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465815e3f0 con 0x7f46580b4510 2024-08-18T22:21:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f465d800640 1 -- 172.21.15.5:0/3272317371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465815cfe0 con 0x7f46580b4510 2024-08-18T22:21:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.583+0000 7f4654c00640 1 -- 172.21.15.5:0/3272317371 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46400bd020 con 0x7f46580b4510 2024-08-18T22:21:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.587+0000 7f4654c00640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46340678c0 0x7f4634069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.587+0000 7f4654c00640 1 -- 172.21.15.5:0/3272317371 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f464011f9d0 con 0x7f46580b4510 2024-08-18T22:21:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.587+0000 7f4657e00640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46340678c0 0x7f4634069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.587+0000 7f4657e00640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46340678c0 0x7f4634069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f465815adf0 tx=0x7f4648009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.591+0000 7f4654c00640 1 -- 172.21.15.5:0/3272317371 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f46400c4030 con 0x7f46580b4510 2024-08-18T22:21:56.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.791+0000 7f465d800640 1 -- 172.21.15.5:0/3272317371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4658073d40 con 0x7f46580b4510 2024-08-18T22:21:56.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.791+0000 7f4654c00640 1 -- 172.21.15.5:0/3272317371 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5220 (secure 0 0 0) 0x7f4640016090 con 0x7f46580b4510 2024-08-18T22:21:56.797 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:21:56.797 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":18,"btime":"2024-08-18T22:20:31:539377+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3746061951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3746061951},{"type":"v1","addr":"172.21.15.117:6836","nonce":3746061951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2422794020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2422794020},{"type":"v1","addr":"172.21.15.117:6837","nonce":2422794020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3630211664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3630211664},{"type":"v1","addr":"172.21.15.5:6835","nonce":3630211664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-08-18T22:20:18.895099+0000","modified":"2024-08-18T22:20:31.502490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/771750285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":771750285},{"type":"v1","addr":"172.21.15.5:6834","nonce":771750285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4908,"qdb_cluster":[4908]},"id":2}]} 2024-08-18T22:21:56.797 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2024-08-18T22:21:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 -- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46340678c0 msgr2=0x7f4634069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46340678c0 0x7f4634069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f465815adf0 tx=0x7f4648009190 comp rx=0 tx=0).stop 2024-08-18T22:21:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 -- 172.21.15.5:0/3272317371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46580b4510 msgr2=0x7f4658156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46580b4510 0x7f4658156fc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f46400ac000 tx=0x7f4640019210 comp rx=0 tx=0).stop 2024-08-18T22:21:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 -- 172.21.15.5:0/3272317371 shutdown_connections 2024-08-18T22:21:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46340678c0 0x7f4634069d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46580cde30 0x7f46580aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46580b4510 0x7f4658156fc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 --2- 172.21.15.5:0/3272317371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f465809aa40 0x7f4658158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 -- 172.21.15.5:0/3272317371 >> 172.21.15.5:0/3272317371 conn(0x7f46580b3a20 msgr2=0x7f46580b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 -- 172.21.15.5:0/3272317371 shutdown_connections 2024-08-18T22:21:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.795+0000 7f465d800640 1 -- 172.21.15.5:0/3272317371 wait complete. 2024-08-18T22:21:56.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:21:56.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.951+0000 7fe9c6200640 1 Processor -- start 2024-08-18T22:21:56.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.951+0000 7fe9c6200640 1 -- start start 2024-08-18T22:21:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.955+0000 7fe9c6200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe9c00ce840 0x7fe9c00cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.955+0000 7fe9c6200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c00cee20 con 0x7fe9c006f290 2024-08-18T22:21:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.955+0000 7fe9c6200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c00cf100 con 0x7fe9c015b010 2024-08-18T22:21:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.955+0000 7fe9c6200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c00cd8e0 con 0x7fe9c00ce840 2024-08-18T22:21:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.955+0000 7fe9bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe9c00ce840 0x7fe9c00cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.955+0000 7fe9b6a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe9c006f290 0x7fe9c0072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46932/0 (socket says 172.21.15.5:46932) 2024-08-18T22:21:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.955+0000 7fe9b6a00640 1 -- 172.21.15.5:0/578634691 learned_addr learned my addr 172.21.15.5:0/578634691 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:21:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.955+0000 7fe9bfe00640 1 -- 172.21.15.5:0/578634691 >> v1:172.21.15.117:6789/0 conn(0x7fe9c015b010 legacy=0x7fe9c006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.955+0000 7fe9bfe00640 1 -- 172.21.15.5:0/578634691 >> v1:172.21.15.5:6789/0 conn(0x7fe9c006f290 legacy=0x7fe9c0072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.955+0000 7fe9bfe00640 1 -- 172.21.15.5:0/578634691 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c00cf3e0 con 0x7fe9c00ce840 2024-08-18T22:21:56.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9bfe00640 1 --2- 172.21.15.5:0/578634691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9c00ce840 0x7fe9c00cd3a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009d90 tx=0x7fe9b801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360ab85b1b709609 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9bea00640 1 -- 172.21.15.5:0/578634691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80b2070 con 0x7fe9c00ce840 2024-08-18T22:21:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9bea00640 1 -- 172.21.15.5:0/578634691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b80a57b0 con 0x7fe9c00ce840 2024-08-18T22:21:56.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9bea00640 1 -- 172.21.15.5:0/578634691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80a5b80 con 0x7fe9c00ce840 2024-08-18T22:21:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 -- 172.21.15.5:0/578634691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9c00ce840 msgr2=0x7fe9c00cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 --2- 172.21.15.5:0/578634691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9c00ce840 0x7fe9c00cd3a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009d90 tx=0x7fe9b801c8e0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 -- 172.21.15.5:0/578634691 shutdown_connections 2024-08-18T22:21:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 --2- 172.21.15.5:0/578634691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9c00ce840 0x7fe9c00cd3a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 -- 172.21.15.5:0/578634691 >> 172.21.15.5:0/578634691 conn(0x7fe9c00b1c50 msgr2=0x7fe9c00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 -- 172.21.15.5:0/578634691 shutdown_connections 2024-08-18T22:21:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 -- 172.21.15.5:0/578634691 wait complete. 2024-08-18T22:21:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 Processor -- start 2024-08-18T22:21:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 -- start start 2024-08-18T22:21:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9c006f290 0x7fe9c00b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9c00ce840 0x7fe9c0153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9c015b010 0x7fe9c014c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c00738d0 con 0x7fe9c006f290 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c0073750 con 0x7fe9c015b010 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9c6200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c0168c60 con 0x7fe9c00ce840 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9bf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9c006f290 0x7fe9c00b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9bf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9c006f290 0x7fe9c00b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39302/0 (socket says 172.21.15.5:39302) 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.959+0000 7fe9bf400640 1 -- 172.21.15.5:0/699715880 learned_addr learned my addr 172.21.15.5:0/699715880 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9bfe00640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9c015b010 0x7fe9c014c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9b6a00640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9c00ce840 0x7fe9c0153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9bf400640 1 -- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9c00ce840 msgr2=0x7fe9c0153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9bf400640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9c00ce840 0x7fe9c0153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9bf400640 1 -- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9c015b010 msgr2=0x7fe9c014c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9bf400640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9c015b010 0x7fe9c014c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9bf400640 1 -- 172.21.15.5:0/699715880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c0150ee0 con 0x7fe9c006f290 2024-08-18T22:21:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9bf400640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9c006f290 0x7fe9c00b2f50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000c530 tx=0x7fe9b000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9b7e00640 1 -- 172.21.15.5:0/699715880 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0016020 con 0x7fe9c006f290 2024-08-18T22:21:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9b7e00640 1 -- 172.21.15.5:0/699715880 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b0005220 con 0x7fe9c006f290 2024-08-18T22:21:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9b7e00640 1 -- 172.21.15.5:0/699715880 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0007030 con 0x7fe9c006f290 2024-08-18T22:21:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9c6200640 1 -- 172.21.15.5:0/699715880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c01511c0 con 0x7fe9c006f290 2024-08-18T22:21:56.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9c6200640 1 -- 172.21.15.5:0/699715880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c0151780 con 0x7fe9c006f290 2024-08-18T22:21:56.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9c6200640 1 -- 172.21.15.5:0/699715880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c00cd3a0 con 0x7fe9c006f290 2024-08-18T22:21:56.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9b7e00640 1 -- 172.21.15.5:0/699715880 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9b00071d0 con 0x7fe9c006f290 2024-08-18T22:21:56.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9b7e00640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe99c0678c0 0x7fe99c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:56.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.963+0000 7fe9b7e00640 1 -- 172.21.15.5:0/699715880 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7fe9b0085710 con 0x7fe9c006f290 2024-08-18T22:21:56.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.967+0000 7fe9b6a00640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe99c0678c0 0x7fe99c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:56.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.967+0000 7fe9b6a00640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe99c0678c0 0x7fe99c069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe9c014c850 tx=0x7fe9a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:56.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:56.967+0000 7fe9b7e00640 1 -- 172.21.15.5:0/699715880 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe9b0020020 con 0x7fe9c006f290 2024-08-18T22:21:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.167+0000 7fe9c6200640 1 -- 172.21.15.5:0/699715880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9c0151ba0 con 0x7fe9c006f290 2024-08-18T22:21:57.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.167+0000 7fe9b7e00640 1 -- 172.21.15.5:0/699715880 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5220 (secure 0 0 0) 0x7fe9b00074c0 con 0x7fe9c006f290 2024-08-18T22:21:57.173 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:21:57.173 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":18,"btime":"2024-08-18T22:20:31:539377+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3746061951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3746061951},{"type":"v1","addr":"172.21.15.117:6836","nonce":3746061951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2422794020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2422794020},{"type":"v1","addr":"172.21.15.117:6837","nonce":2422794020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3630211664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3630211664},{"type":"v1","addr":"172.21.15.5:6835","nonce":3630211664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-08-18T22:20:18.895099+0000","modified":"2024-08-18T22:20:31.502490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/771750285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":771750285},{"type":"v1","addr":"172.21.15.5:6834","nonce":771750285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4908,"qdb_cluster":[4908]},"id":2}]} 2024-08-18T22:21:57.173 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2024-08-18T22:21:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 -- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe99c0678c0 msgr2=0x7fe99c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe99c0678c0 0x7fe99c069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe9c014c850 tx=0x7fe9a8009040 comp rx=0 tx=0).stop 2024-08-18T22:21:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 -- 172.21.15.5:0/699715880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9c006f290 msgr2=0x7fe9c00b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9c006f290 0x7fe9c00b2f50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000c530 tx=0x7fe9b000c9f0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 -- 172.21.15.5:0/699715880 shutdown_connections 2024-08-18T22:21:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe99c0678c0 0x7fe99c069d80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9c015b010 0x7fe9c014c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9c00ce840 0x7fe9c0153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 --2- 172.21.15.5:0/699715880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9c006f290 0x7fe9c00b2f50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 -- 172.21.15.5:0/699715880 >> 172.21.15.5:0/699715880 conn(0x7fe9c00b1c50 msgr2=0x7fe9c00b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:57.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 -- 172.21.15.5:0/699715880 shutdown_connections 2024-08-18T22:21:57.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.171+0000 7fe9c6200640 1 -- 172.21.15.5:0/699715880 wait complete. 2024-08-18T22:21:57.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:21:57.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.327+0000 7f2505200640 1 Processor -- start 2024-08-18T22:21:57.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f2505200640 1 -- start start 2024-08-18T22:21:57.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f2505200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2500071c90 0x7f25000b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:57.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f2505200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f250006fad0 0x7f250015c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:57.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f2505200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25000b5e30 con 0x7f250015c180 2024-08-18T22:21:57.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f2505200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f250015caa0 con 0x7f250006fad0 2024-08-18T22:21:57.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f2505200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f25000b6110 con 0x7f2500071c90 2024-08-18T22:21:57.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f24fe800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f250006fad0 0x7f250015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:57.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f24fe800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f250006fad0 0x7f250015c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39316/0 (socket says 172.21.15.5:39316) 2024-08-18T22:21:57.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f24fe800640 1 -- 172.21.15.5:0/2137340686 learned_addr learned my addr 172.21.15.5:0/2137340686 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:57.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f24fd400640 1 --2- 172.21.15.5:0/2137340686 >> v2:172.21.15.117:3300/0 conn(0x7f2500071c90 0x7f25000b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:57.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f24fe800640 1 -- 172.21.15.5:0/2137340686 >> v2:172.21.15.117:3300/0 conn(0x7f2500071c90 msgr2=0x7f25000b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:57.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f24fe800640 1 --2- 172.21.15.5:0/2137340686 >> v2:172.21.15.117:3300/0 conn(0x7f2500071c90 0x7f25000b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f24fe800640 1 -- 172.21.15.5:0/2137340686 >> v1:172.21.15.117:6789/0 conn(0x7f250015c180 legacy=0x7f2500071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:57.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f24fe800640 1 -- 172.21.15.5:0/2137340686 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25000b63f0 con 0x7f250006fad0 2024-08-18T22:21:57.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.331+0000 7f24fd400640 1 --2- 172.21.15.5:0/2137340686 >> v2:172.21.15.117:3300/0 conn(0x7f2500071c90 0x7f25000b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:21:57.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f24fe800640 1 --2- 172.21.15.5:0/2137340686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f250006fad0 0x7f250015c560 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f25000694d0 tx=0x7f24f801c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c874e969c53fd31a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:57.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f24fca00640 1 -- 172.21.15.5:0/2137340686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f80a56e0 con 0x7f250006fad0 2024-08-18T22:21:57.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f24fca00640 1 -- 172.21.15.5:0/2137340686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f80a5880 con 0x7f250006fad0 2024-08-18T22:21:57.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f24fca00640 1 -- 172.21.15.5:0/2137340686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f80a5c50 con 0x7f250006fad0 2024-08-18T22:21:57.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f2505200640 1 -- 172.21.15.5:0/2137340686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f250006fad0 msgr2=0x7f250015c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f2505200640 1 --2- 172.21.15.5:0/2137340686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f250006fad0 0x7f250015c560 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f25000694d0 tx=0x7f24f801c860 comp rx=0 tx=0).stop 2024-08-18T22:21:57.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f2505200640 1 -- 172.21.15.5:0/2137340686 shutdown_connections 2024-08-18T22:21:57.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f2505200640 1 --2- 172.21.15.5:0/2137340686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f250006fad0 0x7f250015c560 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f2505200640 1 --2- 172.21.15.5:0/2137340686 >> v2:172.21.15.117:3300/0 conn(0x7f2500071c90 0x7f25000b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f2505200640 1 -- 172.21.15.5:0/2137340686 >> 172.21.15.5:0/2137340686 conn(0x7f25000b3eb0 msgr2=0x7f25000b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:57.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f2505200640 1 -- 172.21.15.5:0/2137340686 shutdown_connections 2024-08-18T22:21:57.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f2505200640 1 -- 172.21.15.5:0/2137340686 wait complete. 2024-08-18T22:21:57.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f2505200640 1 Processor -- start 2024-08-18T22:21:57.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.335+0000 7f2505200640 1 -- start start 2024-08-18T22:21:57.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f2505200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f250006fad0 0x7f250015df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f2505200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2500071c90 0x7f250014df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f2505200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f250015c180 0x7f25000b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f2505200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f25000d1c30 con 0x7f250015c180 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f2505200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25000d1ab0 con 0x7f2500071c90 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f2505200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f25000d1db0 con 0x7f250006fad0 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24fe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f250015c180 0x7f25000b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24fe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f250015c180 0x7f25000b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39326/0 (socket says 172.21.15.5:39326) 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24fe800640 1 -- 172.21.15.5:0/2902331691 learned_addr learned my addr 172.21.15.5:0/2902331691 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24fde00640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f250006fad0 0x7f250015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24fd400640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2500071c90 0x7f250014df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24fe800640 1 -- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f250006fad0 msgr2=0x7f250015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24fe800640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f250006fad0 0x7f250015df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24fe800640 1 -- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2500071c90 msgr2=0x7f250014df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24fe800640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2500071c90 0x7f250014df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24fe800640 1 -- 172.21.15.5:0/2902331691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250015ce80 con 0x7f250015c180 2024-08-18T22:21:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24fe800640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f250015c180 0x7f25000b3300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f24f80af040 tx=0x7f24f8019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24f6000640 1 -- 172.21.15.5:0/2902331691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f80bc020 con 0x7f250015c180 2024-08-18T22:21:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24f6000640 1 -- 172.21.15.5:0/2902331691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f80b8670 con 0x7f250015c180 2024-08-18T22:21:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24f6000640 1 -- 172.21.15.5:0/2902331691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f80b8a60 con 0x7f250015c180 2024-08-18T22:21:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f2505200640 1 -- 172.21.15.5:0/2902331691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250015d160 con 0x7f250015c180 2024-08-18T22:21:57.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f2505200640 1 -- 172.21.15.5:0/2902331691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250015d720 con 0x7f250015c180 2024-08-18T22:21:57.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f2505200640 1 -- 172.21.15.5:0/2902331691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f250015c560 con 0x7f250015c180 2024-08-18T22:21:57.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.339+0000 7f24f6000640 1 -- 172.21.15.5:0/2902331691 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24f80bf020 con 0x7f250015c180 2024-08-18T22:21:57.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.343+0000 7f24f6000640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24e00678c0 0x7f24e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.343+0000 7f24f6000640 1 -- 172.21.15.5:0/2902331691 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f24f8120ef0 con 0x7f250015c180 2024-08-18T22:21:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.343+0000 7f24fde00640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24e00678c0 0x7f24e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:57.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.343+0000 7f24fde00640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24e00678c0 0x7f24e0069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f24f00098e0 tx=0x7f24f0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:57.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.347+0000 7f24f6000640 1 -- 172.21.15.5:0/2902331691 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f24f80c6030 con 0x7f250015c180 2024-08-18T22:21:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.511+0000 7f2505200640 1 -- 172.21.15.5:0/2902331691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25000cf7d0 con 0x7f250015c180 2024-08-18T22:21:57.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.511+0000 7f24f6000640 1 -- 172.21.15.5:0/2902331691 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16928 (secure 0 0 0) 0x7f24f80165a0 con 0x7f250015c180 2024-08-18T22:21:57.517 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:21:57.517 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":43,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:21:36.338035+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:20:16.626037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-08-18T22:20:17.895529+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 -- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24e00678c0 msgr2=0x7f24e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24e00678c0 0x7f24e0069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f24f00098e0 tx=0x7f24f0009060 comp rx=0 tx=0).stop 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 -- 172.21.15.5:0/2902331691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f250015c180 msgr2=0x7f25000b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f250015c180 0x7f25000b3300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f24f80af040 tx=0x7f24f8019600 comp rx=0 tx=0).stop 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 -- 172.21.15.5:0/2902331691 shutdown_connections 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24e00678c0 0x7f24e0069d80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f250015c180 0x7f25000b3300 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2500071c90 0x7f250014df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 --2- 172.21.15.5:0/2902331691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f250006fad0 0x7f250015df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 -- 172.21.15.5:0/2902331691 >> 172.21.15.5:0/2902331691 conn(0x7f25000b3eb0 msgr2=0x7f2500166850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 -- 172.21.15.5:0/2902331691 shutdown_connections 2024-08-18T22:21:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.515+0000 7f2505200640 1 -- 172.21.15.5:0/2902331691 wait complete. 2024-08-18T22:21:57.541 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:21:57.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:21:57.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff29c200640 1 Processor -- start 2024-08-18T22:21:57.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff29c200640 1 -- start start 2024-08-18T22:21:57.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff29c200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff29406dd80 0x7ff2940cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:57.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff29c200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29406e210 con 0x7ff294071580 2024-08-18T22:21:57.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff29c200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff294071c80 con 0x7ff2940b54c0 2024-08-18T22:21:57.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff29c200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff2940cba40 con 0x7ff29406dd80 2024-08-18T22:21:57.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff298e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff294071580 0x7ff2940cbed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46948/0 (socket says 172.21.15.5:46948) 2024-08-18T22:21:57.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff298e00640 1 -- 172.21.15.5:0/1207473538 learned_addr learned my addr 172.21.15.5:0/1207473538 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:21:57.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff29a200640 1 --2- 172.21.15.5:0/1207473538 >> v2:172.21.15.5:3300/0 conn(0x7ff29406dd80 0x7ff2940cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:57.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff29a200640 1 -- 172.21.15.5:0/1207473538 >> v1:172.21.15.117:6789/0 conn(0x7ff2940b54c0 legacy=0x7ff2940b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:57.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff29a200640 1 -- 172.21.15.5:0/1207473538 >> v1:172.21.15.5:6789/0 conn(0x7ff294071580 legacy=0x7ff2940cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff29a200640 1 -- 172.21.15.5:0/1207473538 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff294071f60 con 0x7ff29406dd80 2024-08-18T22:21:57.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.679+0000 7ff293e00640 1 -- 172.21.15.5:0/1207473538 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360000272 0 0) 0x7ff280001120 con 0x7ff294071580 2024-08-18T22:21:57.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff29a200640 1 --2- 172.21.15.5:0/1207473538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff29406dd80 0x7ff2940cc5e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009d90 tx=0x7ff28c01f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9f30755bd3e751 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:57.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff293e00640 1 -- 172.21.15.5:0/1207473538 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0b4070 con 0x7ff29406dd80 2024-08-18T22:21:57.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff293e00640 1 -- 172.21.15.5:0/1207473538 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28c0af600 con 0x7ff29406dd80 2024-08-18T22:21:57.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff293e00640 1 -- 172.21.15.5:0/1207473538 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0af9d0 con 0x7ff29406dd80 2024-08-18T22:21:57.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff29c200640 1 -- 172.21.15.5:0/1207473538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff29406dd80 msgr2=0x7ff2940cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff29c200640 1 --2- 172.21.15.5:0/1207473538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff29406dd80 0x7ff2940cc5e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009d90 tx=0x7ff28c01f120 comp rx=0 tx=0).stop 2024-08-18T22:21:57.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff29c200640 1 -- 172.21.15.5:0/1207473538 shutdown_connections 2024-08-18T22:21:57.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff29c200640 1 --2- 172.21.15.5:0/1207473538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff29406dd80 0x7ff2940cc5e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff29c200640 1 -- 172.21.15.5:0/1207473538 >> 172.21.15.5:0/1207473538 conn(0x7ff2940b3eb0 msgr2=0x7ff2940b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:57.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff29c200640 1 -- 172.21.15.5:0/1207473538 shutdown_connections 2024-08-18T22:21:57.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff29c200640 1 -- 172.21.15.5:0/1207473538 wait complete. 2024-08-18T22:21:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff29c200640 1 Processor -- start 2024-08-18T22:21:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.683+0000 7ff29c200640 1 -- start start 2024-08-18T22:21:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29c200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29406dd80 0x7ff29415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29c200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff294071580 0x7ff294140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29c200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2940b54c0 0x7ff2941f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29c200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff294148020 con 0x7ff2940b54c0 2024-08-18T22:21:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29c200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff2940719a0 con 0x7ff29406dd80 2024-08-18T22:21:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29c200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff2941481a0 con 0x7ff294071580 2024-08-18T22:21:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2940b54c0 0x7ff2941f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2940b54c0 0x7ff2941f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39350/0 (socket says 172.21.15.5:39350) 2024-08-18T22:21:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29a200640 1 -- 172.21.15.5:0/4079354597 learned_addr learned my addr 172.21.15.5:0/4079354597 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff299800640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29406dd80 0x7ff29415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff298e00640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff294071580 0x7ff294140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29a200640 1 -- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff294071580 msgr2=0x7ff294140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29a200640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff294071580 0x7ff294140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29a200640 1 -- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29406dd80 msgr2=0x7ff29415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29a200640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29406dd80 0x7ff29415dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29a200640 1 -- 172.21.15.5:0/4079354597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2941f45f0 con 0x7ff2940b54c0 2024-08-18T22:21:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff299800640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29406dd80 0x7ff29415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:21:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29a200640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2940b54c0 0x7ff2941f3a70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff28c01cd50 tx=0x7ff28c01bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff291600640 1 -- 172.21.15.5:0/4079354597 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0b4040 con 0x7ff2940b54c0 2024-08-18T22:21:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff291600640 1 -- 172.21.15.5:0/4079354597 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28c0c2070 con 0x7ff2940b54c0 2024-08-18T22:21:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29c200640 1 -- 172.21.15.5:0/4079354597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2941f48d0 con 0x7ff2940b54c0 2024-08-18T22:21:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff291600640 1 -- 172.21.15.5:0/4079354597 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0ba660 con 0x7ff2940b54c0 2024-08-18T22:21:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29c200640 1 -- 172.21.15.5:0/4079354597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff294140950 con 0x7ff2940b54c0 2024-08-18T22:21:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.687+0000 7ff29c200640 1 -- 172.21.15.5:0/4079354597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff294140460 con 0x7ff2940b54c0 2024-08-18T22:21:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.691+0000 7ff291600640 1 -- 172.21.15.5:0/4079354597 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff28c0ba800 con 0x7ff2940b54c0 2024-08-18T22:21:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.691+0000 7ff291600640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2740678c0 0x7ff274069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.691+0000 7ff291600640 1 -- 172.21.15.5:0/4079354597 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7ff28c124670 con 0x7ff2940b54c0 2024-08-18T22:21:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.691+0000 7ff299800640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2740678c0 0x7ff274069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.691+0000 7ff299800640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2740678c0 0x7ff274069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff288003ec0 tx=0x7ff288009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.695+0000 7ff291600640 1 -- 172.21.15.5:0/4079354597 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff28c018c80 con 0x7ff2940b54c0 2024-08-18T22:21:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 -- 172.21.15.5:0/4079354597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2940b58a0 con 0x7ff2940b54c0 2024-08-18T22:21:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff291600640 1 -- 172.21.15.5:0/4079354597 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5220 (secure 0 0 0) 0x7ff28c0f4f50 con 0x7ff2940b54c0 2024-08-18T22:21:57.899 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:21:57.900 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":18,"btime":"2024-08-18T22:20:31:539377+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3746061951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3746061951},{"type":"v1","addr":"172.21.15.117:6836","nonce":3746061951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2422794020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2422794020},{"type":"v1","addr":"172.21.15.117:6837","nonce":2422794020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3630211664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3630211664},{"type":"v1","addr":"172.21.15.5:6835","nonce":3630211664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-08-18T22:20:18.895099+0000","modified":"2024-08-18T22:20:31.502490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/771750285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":771750285},{"type":"v1","addr":"172.21.15.5:6834","nonce":771750285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4908,"qdb_cluster":[4908]},"id":2}]} 2024-08-18T22:21:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2024-08-18T22:21:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 -- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2740678c0 msgr2=0x7ff274069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2740678c0 0x7ff274069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff288003ec0 tx=0x7ff288009040 comp rx=0 tx=0).stop 2024-08-18T22:21:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 -- 172.21.15.5:0/4079354597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2940b54c0 msgr2=0x7ff2941f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2940b54c0 0x7ff2941f3a70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff28c01cd50 tx=0x7ff28c01bec0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 -- 172.21.15.5:0/4079354597 shutdown_connections 2024-08-18T22:21:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2740678c0 0x7ff274069d80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2940b54c0 0x7ff2941f3a70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff294071580 0x7ff294140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 --2- 172.21.15.5:0/4079354597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff29406dd80 0x7ff29415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 -- 172.21.15.5:0/4079354597 >> 172.21.15.5:0/4079354597 conn(0x7ff2940b3eb0 msgr2=0x7ff294146d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 -- 172.21.15.5:0/4079354597 shutdown_connections 2024-08-18T22:21:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:57.895+0000 7ff29c200640 1 -- 172.21.15.5:0/4079354597 wait complete. 2024-08-18T22:21:57.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:21:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.055+0000 7f0461c00640 1 Processor -- start 2024-08-18T22:21:58.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.055+0000 7f0461c00640 1 -- start start 2024-08-18T22:21:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f0461c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f045c15b010 0x7f045c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f0461c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f045c0cd3a0 0x7f045c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f0461c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f045c06f0c0 0x7f045c0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f0461c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f045c0cfa30 con 0x7f045c0cd3a0 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f0461c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f045c0cee20 con 0x7f045c15b010 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f0461c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f045c0cf100 con 0x7f045c06f0c0 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f045a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f045c0cd3a0 0x7f045c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f045aa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f045c15b010 0x7f045c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f045a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f045c0cd3a0 0x7f045c06eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39352/0 (socket says 172.21.15.5:39352) 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f045a000640 1 -- 172.21.15.5:0/3408836988 learned_addr learned my addr 172.21.15.5:0/3408836988 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f045b400640 1 --2- 172.21.15.5:0/3408836988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f045c06f0c0 0x7f045c0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f045a000640 1 -- 172.21.15.5:0/3408836988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f045c06f0c0 msgr2=0x7f045c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f045a000640 1 --2- 172.21.15.5:0/3408836988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f045c06f0c0 0x7f045c0caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f045a000640 1 -- 172.21.15.5:0/3408836988 >> v2:172.21.15.117:3300/0 conn(0x7f045c15b010 msgr2=0x7f045c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f045a000640 1 --2- 172.21.15.5:0/3408836988 >> v2:172.21.15.117:3300/0 conn(0x7f045c15b010 0x7f045c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.059+0000 7f045a000640 1 -- 172.21.15.5:0/3408836988 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045c0cf3e0 con 0x7f045c0cd3a0 2024-08-18T22:21:58.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f045a000640 1 --2- 172.21.15.5:0/3408836988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f045c0cd3a0 0x7f045c06eb80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f045c0b2cc0 tx=0x7f044801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3091473a61723b87 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0459600640 1 -- 172.21.15.5:0/3408836988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04480b0070 con 0x7f045c0cd3a0 2024-08-18T22:21:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0459600640 1 -- 172.21.15.5:0/3408836988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04480ab600 con 0x7f045c0cd3a0 2024-08-18T22:21:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0459600640 1 -- 172.21.15.5:0/3408836988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04480ab9d0 con 0x7f045c0cd3a0 2024-08-18T22:21:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0461c00640 1 -- 172.21.15.5:0/3408836988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f045c0cd3a0 msgr2=0x7f045c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0461c00640 1 --2- 172.21.15.5:0/3408836988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f045c0cd3a0 0x7f045c06eb80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f045c0b2cc0 tx=0x7f044801c260 comp rx=0 tx=0).stop 2024-08-18T22:21:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0461c00640 1 -- 172.21.15.5:0/3408836988 shutdown_connections 2024-08-18T22:21:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0461c00640 1 --2- 172.21.15.5:0/3408836988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f045c06f0c0 0x7f045c0caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0461c00640 1 --2- 172.21.15.5:0/3408836988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f045c0cd3a0 0x7f045c06eb80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0461c00640 1 --2- 172.21.15.5:0/3408836988 >> v2:172.21.15.117:3300/0 conn(0x7f045c15b010 0x7f045c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0461c00640 1 -- 172.21.15.5:0/3408836988 >> 172.21.15.5:0/3408836988 conn(0x7f045c0b1c50 msgr2=0x7f045c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0461c00640 1 -- 172.21.15.5:0/3408836988 shutdown_connections 2024-08-18T22:21:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0461c00640 1 -- 172.21.15.5:0/3408836988 wait complete. 2024-08-18T22:21:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0461c00640 1 Processor -- start 2024-08-18T22:21:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.063+0000 7f0461c00640 1 -- start start 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0461c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f045c06f0c0 0x7f045c1fae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0461c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f045c0cd3a0 0x7f045c1420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0461c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f045c15b010 0x7f045c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0461c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f045c072780 con 0x7f045c0cd3a0 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0461c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f045c072600 con 0x7f045c15b010 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0461c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f045c072900 con 0x7f045c06f0c0 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f045c0cd3a0 0x7f045c1420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f045c0cd3a0 0x7f045c1420d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39360/0 (socket says 172.21.15.5:39360) 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045a000640 1 -- 172.21.15.5:0/631374771 learned_addr learned my addr 172.21.15.5:0/631374771 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045aa00640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f045c06f0c0 0x7f045c1fae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045b400640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f045c15b010 0x7f045c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045a000640 1 -- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f045c06f0c0 msgr2=0x7f045c1fae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045a000640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f045c06f0c0 0x7f045c1fae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045a000640 1 -- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f045c15b010 msgr2=0x7f045c15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045a000640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f045c15b010 0x7f045c15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045a000640 1 -- 172.21.15.5:0/631374771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045c15bf70 con 0x7f045c0cd3a0 2024-08-18T22:21:58.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045b400640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f045c15b010 0x7f045c15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:21:58.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f045a000640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f045c0cd3a0 0x7f045c1420d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f044801a910 tx=0x7f0448019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0452a00640 1 -- 172.21.15.5:0/631374771 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04480b0040 con 0x7f045c0cd3a0 2024-08-18T22:21:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0452a00640 1 -- 172.21.15.5:0/631374771 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04480b4420 con 0x7f045c0cd3a0 2024-08-18T22:21:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0452a00640 1 -- 172.21.15.5:0/631374771 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04480b47f0 con 0x7f045c0cd3a0 2024-08-18T22:21:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0461c00640 1 -- 172.21.15.5:0/631374771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045c15c250 con 0x7f045c0cd3a0 2024-08-18T22:21:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0461c00640 1 -- 172.21.15.5:0/631374771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045c1fa8e0 con 0x7f045c0cd3a0 2024-08-18T22:21:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0461c00640 1 -- 172.21.15.5:0/631374771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f045c06eb80 con 0x7f045c0cd3a0 2024-08-18T22:21:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.067+0000 7f0452a00640 1 -- 172.21.15.5:0/631374771 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04480b4990 con 0x7f045c0cd3a0 2024-08-18T22:21:58.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.071+0000 7f0452a00640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f043c0678c0 0x7f043c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.071+0000 7f0452a00640 1 -- 172.21.15.5:0/631374771 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f044811f9c0 con 0x7f045c0cd3a0 2024-08-18T22:21:58.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.071+0000 7f045aa00640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f043c0678c0 0x7f043c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.071+0000 7f045aa00640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f043c0678c0 0x7f043c069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f045c0b05a0 tx=0x7f044c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:58.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.075+0000 7f0452a00640 1 -- 172.21.15.5:0/631374771 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0448016110 con 0x7f045c0cd3a0 2024-08-18T22:21:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.275+0000 7f0461c00640 1 -- 172.21.15.5:0/631374771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f045c1580f0 con 0x7f045c0cd3a0 2024-08-18T22:21:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.275+0000 7f0452a00640 1 -- 172.21.15.5:0/631374771 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5220 (secure 0 0 0) 0x7f04480f0450 con 0x7f045c0cd3a0 2024-08-18T22:21:58.280 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:21:58.280 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":18,"btime":"2024-08-18T22:20:31:539377+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3746061951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3746061951},{"type":"v1","addr":"172.21.15.117:6836","nonce":3746061951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2422794020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2422794020},{"type":"v1","addr":"172.21.15.117:6837","nonce":2422794020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3630211664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3630211664},{"type":"v1","addr":"172.21.15.5:6835","nonce":3630211664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-08-18T22:20:18.895099+0000","modified":"2024-08-18T22:20:31.502490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/771750285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":771750285},{"type":"v1","addr":"172.21.15.5:6834","nonce":771750285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4908,"qdb_cluster":[4908]},"id":2}]} 2024-08-18T22:21:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2024-08-18T22:21:58.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 -- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f043c0678c0 msgr2=0x7f043c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f043c0678c0 0x7f043c069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f045c0b05a0 tx=0x7f044c009190 comp rx=0 tx=0).stop 2024-08-18T22:21:58.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 -- 172.21.15.5:0/631374771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f045c0cd3a0 msgr2=0x7f045c1420d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f045c0cd3a0 0x7f045c1420d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f044801a910 tx=0x7f0448019000 comp rx=0 tx=0).stop 2024-08-18T22:21:58.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 -- 172.21.15.5:0/631374771 shutdown_connections 2024-08-18T22:21:58.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f043c0678c0 0x7f043c069d80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f045c15b010 0x7f045c15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f045c0cd3a0 0x7f045c1420d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 --2- 172.21.15.5:0/631374771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f045c06f0c0 0x7f045c1fae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 -- 172.21.15.5:0/631374771 >> 172.21.15.5:0/631374771 conn(0x7f045c0b1c50 msgr2=0x7f045c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:58.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 -- 172.21.15.5:0/631374771 shutdown_connections 2024-08-18T22:21:58.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.279+0000 7f0461c00640 1 -- 172.21.15.5:0/631374771 wait complete. 2024-08-18T22:21:58.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:21:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1944400640 1 Processor -- start 2024-08-18T22:21:58.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1944400640 1 -- start start 2024-08-18T22:21:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1944400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f193c15b010 0x7f193c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1944400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f193c0cd3a0 0x7f193c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1944400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f193c06f0c0 0x7f193c0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1944400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f193c0cfa30 con 0x7f193c0cd3a0 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1944400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f193c0cee20 con 0x7f193c06f0c0 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1944400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f193c0cf100 con 0x7f193c15b010 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1941000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f193c0cd3a0 0x7f193c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1941000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f193c0cd3a0 0x7f193c06eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39374/0 (socket says 172.21.15.5:39374) 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1941000640 1 -- 172.21.15.5:0/2893143894 learned_addr learned my addr 172.21.15.5:0/2893143894 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1942400640 1 --2- 172.21.15.5:0/2893143894 >> v2:172.21.15.117:3300/0 conn(0x7f193c06f0c0 0x7f193c0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1941a00640 1 --2- 172.21.15.5:0/2893143894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f193c15b010 0x7f193c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1941000640 1 -- 172.21.15.5:0/2893143894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f193c15b010 msgr2=0x7f193c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1941000640 1 --2- 172.21.15.5:0/2893143894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f193c15b010 0x7f193c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1941000640 1 -- 172.21.15.5:0/2893143894 >> v2:172.21.15.117:3300/0 conn(0x7f193c06f0c0 msgr2=0x7f193c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1941000640 1 --2- 172.21.15.5:0/2893143894 >> v2:172.21.15.117:3300/0 conn(0x7f193c06f0c0 0x7f193c0caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1941000640 1 -- 172.21.15.5:0/2893143894 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193c0cf3e0 con 0x7f193c0cd3a0 2024-08-18T22:21:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.439+0000 7f1942400640 1 --2- 172.21.15.5:0/2893143894 >> v2:172.21.15.117:3300/0 conn(0x7f193c06f0c0 0x7f193c0caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:21:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f1941000640 1 --2- 172.21.15.5:0/2893143894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f193c0cd3a0 0x7f193c06eb80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f193c06ffa0 tx=0x7f192801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fc1a046a312c78 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f193be00640 1 -- 172.21.15.5:0/2893143894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19280b0070 con 0x7f193c0cd3a0 2024-08-18T22:21:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f193be00640 1 -- 172.21.15.5:0/2893143894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19280ab600 con 0x7f193c0cd3a0 2024-08-18T22:21:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f193be00640 1 -- 172.21.15.5:0/2893143894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19280ab9d0 con 0x7f193c0cd3a0 2024-08-18T22:21:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f1944400640 1 -- 172.21.15.5:0/2893143894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f193c0cd3a0 msgr2=0x7f193c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f1944400640 1 --2- 172.21.15.5:0/2893143894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f193c0cd3a0 0x7f193c06eb80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f193c06ffa0 tx=0x7f192801c260 comp rx=0 tx=0).stop 2024-08-18T22:21:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f1944400640 1 -- 172.21.15.5:0/2893143894 shutdown_connections 2024-08-18T22:21:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f1944400640 1 --2- 172.21.15.5:0/2893143894 >> v2:172.21.15.117:3300/0 conn(0x7f193c06f0c0 0x7f193c0caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f1944400640 1 --2- 172.21.15.5:0/2893143894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f193c0cd3a0 0x7f193c06eb80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f1944400640 1 --2- 172.21.15.5:0/2893143894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f193c15b010 0x7f193c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f1944400640 1 -- 172.21.15.5:0/2893143894 >> 172.21.15.5:0/2893143894 conn(0x7f193c0b1c50 msgr2=0x7f193c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f1944400640 1 -- 172.21.15.5:0/2893143894 shutdown_connections 2024-08-18T22:21:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.443+0000 7f1944400640 1 -- 172.21.15.5:0/2893143894 wait complete. 2024-08-18T22:21:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1944400640 1 Processor -- start 2024-08-18T22:21:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1944400640 1 -- start start 2024-08-18T22:21:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1944400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f193c06f0c0 0x7f193c14cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1944400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f193c0cd3a0 0x7f193c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1944400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f193c15b010 0x7f193c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1944400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f193c072780 con 0x7f193c0cd3a0 2024-08-18T22:21:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1944400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f193c072600 con 0x7f193c06f0c0 2024-08-18T22:21:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1944400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f193c072900 con 0x7f193c15b010 2024-08-18T22:21:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1941000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f193c0cd3a0 0x7f193c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1941000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f193c0cd3a0 0x7f193c15d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39388/0 (socket says 172.21.15.5:39388) 2024-08-18T22:21:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1941000640 1 -- 172.21.15.5:0/3969372762 learned_addr learned my addr 172.21.15.5:0/3969372762 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1941a00640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f193c06f0c0 0x7f193c14cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1942400640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f193c15b010 0x7f193c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1941000640 1 -- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f193c15b010 msgr2=0x7f193c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1941000640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f193c15b010 0x7f193c15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1941000640 1 -- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f193c06f0c0 msgr2=0x7f193c14cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1941000640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f193c06f0c0 0x7f193c14cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1941000640 1 -- 172.21.15.5:0/3969372762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193c06e450 con 0x7f193c0cd3a0 2024-08-18T22:21:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1942400640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f193c15b010 0x7f193c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:21:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1941000640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f193c0cd3a0 0x7f193c15d910 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f19280ae040 tx=0x7f192801aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1939600640 1 -- 172.21.15.5:0/3969372762 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19280b0040 con 0x7f193c0cd3a0 2024-08-18T22:21:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1939600640 1 -- 172.21.15.5:0/3969372762 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19280bc070 con 0x7f193c0cd3a0 2024-08-18T22:21:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1939600640 1 -- 172.21.15.5:0/3969372762 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19280b6880 con 0x7f193c0cd3a0 2024-08-18T22:21:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1944400640 1 -- 172.21.15.5:0/3969372762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193c06e730 con 0x7f193c0cd3a0 2024-08-18T22:21:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1944400640 1 -- 172.21.15.5:0/3969372762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193c14d240 con 0x7f193c0cd3a0 2024-08-18T22:21:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.447+0000 7f1944400640 1 -- 172.21.15.5:0/3969372762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193c06eb80 con 0x7f193c0cd3a0 2024-08-18T22:21:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.451+0000 7f1939600640 1 -- 172.21.15.5:0/3969372762 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f19280ab4c0 con 0x7f193c0cd3a0 2024-08-18T22:21:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.451+0000 7f1939600640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f191c0678c0 0x7f191c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.451+0000 7f1939600640 1 -- 172.21.15.5:0/3969372762 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f1928120290 con 0x7f193c0cd3a0 2024-08-18T22:21:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.451+0000 7f1941a00640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f191c0678c0 0x7f191c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.451+0000 7f1941a00640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f191c0678c0 0x7f191c069d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1930007940 tx=0x7f1930008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.455+0000 7f1939600640 1 -- 172.21.15.5:0/3969372762 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1928016110 con 0x7f193c0cd3a0 2024-08-18T22:21:58.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.619+0000 7f1944400640 1 -- 172.21.15.5:0/3969372762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f193c157760 con 0x7f193c0cd3a0 2024-08-18T22:21:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1939600640 1 -- 172.21.15.5:0/3969372762 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16928 (secure 0 0 0) 0x7f19280f0c00 con 0x7f193c0cd3a0 2024-08-18T22:21:58.626 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:21:58.626 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":43,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:21:36.338035+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:20:16.626037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-08-18T22:20:17.895529+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:21:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 -- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f191c0678c0 msgr2=0x7f191c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f191c0678c0 0x7f191c069d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1930007940 tx=0x7f1930008040 comp rx=0 tx=0).stop 2024-08-18T22:21:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 -- 172.21.15.5:0/3969372762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f193c0cd3a0 msgr2=0x7f193c15d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f193c0cd3a0 0x7f193c15d910 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f19280ae040 tx=0x7f192801aaa0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 -- 172.21.15.5:0/3969372762 shutdown_connections 2024-08-18T22:21:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f191c0678c0 0x7f191c069d80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f193c15b010 0x7f193c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f193c0cd3a0 0x7f193c15d910 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 --2- 172.21.15.5:0/3969372762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f193c06f0c0 0x7f193c14cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 -- 172.21.15.5:0/3969372762 >> 172.21.15.5:0/3969372762 conn(0x7f193c0b1c50 msgr2=0x7f193c158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 -- 172.21.15.5:0/3969372762 shutdown_connections 2024-08-18T22:21:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.623+0000 7f1944400640 1 -- 172.21.15.5:0/3969372762 wait complete. 2024-08-18T22:21:58.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:21:58.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.783+0000 7f64fba00640 1 Processor -- start 2024-08-18T22:21:58.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.783+0000 7f64fba00640 1 -- start start 2024-08-18T22:21:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64fba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f415c560 0x7f64f40ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64fba00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64f415d4d0 0x7f64f406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64fba00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64f40cfb00 con 0x7f64f415c180 2024-08-18T22:21:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64fba00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f64f415d040 con 0x7f64f415d4d0 2024-08-18T22:21:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64fba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f64f415c9f0 con 0x7f64f415c560 2024-08-18T22:21:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64f9a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64f415d4d0 0x7f64f406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64f9a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64f415d4d0 0x7f64f406db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39396/0 (socket says 172.21.15.5:39396) 2024-08-18T22:21:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64f9a00640 1 -- 172.21.15.5:0/1735580183 learned_addr learned my addr 172.21.15.5:0/1735580183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:58.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64ebe00640 1 --2- 172.21.15.5:0/1735580183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f415c560 0x7f64f40ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64f9a00640 1 -- 172.21.15.5:0/1735580183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f415c560 msgr2=0x7f64f40ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:58.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64f9a00640 1 --2- 172.21.15.5:0/1735580183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f415c560 0x7f64f40ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64f9a00640 1 -- 172.21.15.5:0/1735580183 >> v1:172.21.15.117:6789/0 conn(0x7f64f415c180 legacy=0x7f64f40cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64f9a00640 1 -- 172.21.15.5:0/1735580183 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f415ccd0 con 0x7f64f415d4d0 2024-08-18T22:21:58.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.787+0000 7f64ebe00640 1 --2- 172.21.15.5:0/1735580183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f415c560 0x7f64f40ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:21:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64f9a00640 1 --2- 172.21.15.5:0/1735580183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d4d0 0x7f64f406db80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009e50 tx=0x7f64ec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1a420d99650406 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64f3e00640 1 -- 172.21.15.5:0/1735580183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0a5880 con 0x7f64f415d4d0 2024-08-18T22:21:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64f3e00640 1 -- 172.21.15.5:0/1735580183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f40ced70 con 0x7f64f415d4d0 2024-08-18T22:21:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64f3e00640 1 -- 172.21.15.5:0/1735580183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0a5c40 con 0x7f64f415d4d0 2024-08-18T22:21:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64fba00640 1 -- 172.21.15.5:0/1735580183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d4d0 msgr2=0x7f64f406db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64fba00640 1 --2- 172.21.15.5:0/1735580183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d4d0 0x7f64f406db80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009e50 tx=0x7f64ec01c9a0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64fba00640 1 -- 172.21.15.5:0/1735580183 shutdown_connections 2024-08-18T22:21:58.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64fba00640 1 --2- 172.21.15.5:0/1735580183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d4d0 0x7f64f406db80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64fba00640 1 --2- 172.21.15.5:0/1735580183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f415c560 0x7f64f40ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64fba00640 1 -- 172.21.15.5:0/1735580183 >> 172.21.15.5:0/1735580183 conn(0x7f64f40b1dc0 msgr2=0x7f64f40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64fba00640 1 -- 172.21.15.5:0/1735580183 shutdown_connections 2024-08-18T22:21:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64fba00640 1 -- 172.21.15.5:0/1735580183 wait complete. 2024-08-18T22:21:58.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64fba00640 1 Processor -- start 2024-08-18T22:21:58.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.791+0000 7f64fba00640 1 -- start start 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64fba00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f415c180 0x7f64f4157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64fba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f415d4d0 0x7f64f4165a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64fba00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f4164de0 0x7f64f4165290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64fba00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f64f41692b0 con 0x7f64f4164de0 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64fba00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f64f4169130 con 0x7f64f415c180 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64fba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f64f4169430 con 0x7f64f415d4d0 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f9a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f4164de0 0x7f64f4165290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f9a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f4164de0 0x7f64f4165290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39406/0 (socket says 172.21.15.5:39406) 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f9a00640 1 -- 172.21.15.5:0/3945781729 learned_addr learned my addr 172.21.15.5:0/3945781729 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f9000640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f415c180 0x7f64f4157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64ebe00640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f415d4d0 0x7f64f4165a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f9a00640 1 -- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f415d4d0 msgr2=0x7f64f4165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f9a00640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f415d4d0 0x7f64f4165a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f9a00640 1 -- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f415c180 msgr2=0x7f64f4157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f9a00640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f415c180 0x7f64f4157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f9a00640 1 -- 172.21.15.5:0/3945781729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f40ad1d0 con 0x7f64f4164de0 2024-08-18T22:21:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f9000640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f415c180 0x7f64f4157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:21:58.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f9a00640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f4164de0 0x7f64f4165290 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f64ec01a5d0 tx=0x7f64ec019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:58.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f1600640 1 -- 172.21.15.5:0/3945781729 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0bc030 con 0x7f64f4164de0 2024-08-18T22:21:58.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f1600640 1 -- 172.21.15.5:0/3945781729 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ec0b8470 con 0x7f64f4164de0 2024-08-18T22:21:58.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64fba00640 1 -- 172.21.15.5:0/3945781729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f40ad4b0 con 0x7f64f4164de0 2024-08-18T22:21:58.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f1600640 1 -- 172.21.15.5:0/3945781729 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0b88a0 con 0x7f64f4164de0 2024-08-18T22:21:58.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64fba00640 1 -- 172.21.15.5:0/3945781729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f40ada70 con 0x7f64f4164de0 2024-08-18T22:21:58.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64fba00640 1 -- 172.21.15.5:0/3945781729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f40008e0 con 0x7f64f4164de0 2024-08-18T22:21:58.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.795+0000 7f64f1600640 1 -- 172.21.15.5:0/3945781729 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f64ec0bf070 con 0x7f64f4164de0 2024-08-18T22:21:58.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.799+0000 7f64f1600640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64d00678c0 0x7f64d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:58.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.799+0000 7f64f1600640 1 -- 172.21.15.5:0/3945781729 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f64ec120dd0 con 0x7f64f4164de0 2024-08-18T22:21:58.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.799+0000 7f64f9000640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64d00678c0 0x7f64d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:58.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.799+0000 7f64f9000640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64d00678c0 0x7f64d0069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f64e4001710 tx=0x7f64e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:58.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.803+0000 7f64f1600640 1 -- 172.21.15.5:0/3945781729 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f64ec0c6070 con 0x7f64f4164de0 2024-08-18T22:21:59.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:58.999+0000 7f64fba00640 1 -- 172.21.15.5:0/3945781729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f64f406cae0 con 0x7f64f4164de0 2024-08-18T22:21:59.005 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:21:59.003+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:21:59.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.003+0000 7f64f1600640 1 -- 172.21.15.5:0/3945781729 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f64ec016620 con 0x7f64f4164de0 2024-08-18T22:21:59.008 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:21:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 -- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64d00678c0 msgr2=0x7f64d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64d00678c0 0x7f64d0069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f64e4001710 tx=0x7f64e4009040 comp rx=0 tx=0).stop 2024-08-18T22:21:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 -- 172.21.15.5:0/3945781729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f4164de0 msgr2=0x7f64f4165290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f4164de0 0x7f64f4165290 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f64ec01a5d0 tx=0x7f64ec019740 comp rx=0 tx=0).stop 2024-08-18T22:21:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 -- 172.21.15.5:0/3945781729 shutdown_connections 2024-08-18T22:21:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64d00678c0 0x7f64d0069d80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f4164de0 0x7f64f4165290 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f415d4d0 0x7f64f4165a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 --2- 172.21.15.5:0/3945781729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f415c180 0x7f64f4157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 -- 172.21.15.5:0/3945781729 >> 172.21.15.5:0/3945781729 conn(0x7f64f40b1dc0 msgr2=0x7f64f409b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 -- 172.21.15.5:0/3945781729 shutdown_connections 2024-08-18T22:21:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.007+0000 7f64fba00640 1 -- 172.21.15.5:0/3945781729 wait complete. 2024-08-18T22:21:59.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:21:59.082 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:21:59.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.171+0000 7fd066200640 1 Processor -- start 2024-08-18T22:21:59.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.171+0000 7fd066200640 1 -- start start 2024-08-18T22:21:59.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd066200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06015b0c0 0x7fd06006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:59.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd066200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0600cf290 0x7fd0600b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:59.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd066200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0600b31f0 con 0x7fd0600b40c0 2024-08-18T22:21:59.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd066200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd0600b3d70 con 0x7fd0600cf290 2024-08-18T22:21:59.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd066200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd0600b4a40 con 0x7fd06015b0c0 2024-08-18T22:21:59.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd056a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd0600b40c0 0x7fd060072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46954/0 (socket says 172.21.15.5:46954) 2024-08-18T22:21:59.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd056a00640 1 -- 172.21.15.5:0/223657597 learned_addr learned my addr 172.21.15.5:0/223657597 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:21:59.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd05fe00640 1 --2- 172.21.15.5:0/223657597 >> v2:172.21.15.5:3300/0 conn(0x7fd0600cf290 0x7fd0600b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:59.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd05f400640 1 --2- 172.21.15.5:0/223657597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06015b0c0 0x7fd06006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:59.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd05ea00640 1 -- 172.21.15.5:0/223657597 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 390783482 0 0) 0x7fd0600b31f0 con 0x7fd0600b40c0 2024-08-18T22:21:59.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd05ea00640 1 -- 172.21.15.5:0/223657597 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd044003530 con 0x7fd0600b40c0 2024-08-18T22:21:59.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd05fe00640 1 -- 172.21.15.5:0/223657597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06015b0c0 msgr2=0x7fd06006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:21:59.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd05fe00640 1 --2- 172.21.15.5:0/223657597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06015b0c0 0x7fd06006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:59.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd05fe00640 1 -- 172.21.15.5:0/223657597 >> v1:172.21.15.5:6789/0 conn(0x7fd0600b40c0 legacy=0x7fd060072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:59.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.175+0000 7fd05fe00640 1 -- 172.21.15.5:0/223657597 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0600b34d0 con 0x7fd0600cf290 2024-08-18T22:21:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd05fe00640 1 --2- 172.21.15.5:0/223657597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0600cf290 0x7fd0600b4500 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd058009d90 tx=0x7fd05801c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdc01574a488c20 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd05ea00640 1 -- 172.21.15.5:0/223657597 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580b2070 con 0x7fd0600cf290 2024-08-18T22:21:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd05ea00640 1 -- 172.21.15.5:0/223657597 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0580a58e0 con 0x7fd0600cf290 2024-08-18T22:21:59.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd05ea00640 1 -- 172.21.15.5:0/223657597 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580a5c90 con 0x7fd0600cf290 2024-08-18T22:21:59.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd066200640 1 -- 172.21.15.5:0/223657597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0600cf290 msgr2=0x7fd0600b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:59.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd066200640 1 --2- 172.21.15.5:0/223657597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0600cf290 0x7fd0600b4500 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd058009d90 tx=0x7fd05801c820 comp rx=0 tx=0).stop 2024-08-18T22:21:59.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd066200640 1 -- 172.21.15.5:0/223657597 shutdown_connections 2024-08-18T22:21:59.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd066200640 1 --2- 172.21.15.5:0/223657597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0600cf290 0x7fd0600b4500 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:59.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd066200640 1 --2- 172.21.15.5:0/223657597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06015b0c0 0x7fd06006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:59.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd066200640 1 -- 172.21.15.5:0/223657597 >> 172.21.15.5:0/223657597 conn(0x7fd0600b1dc0 msgr2=0x7fd0600b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:21:59.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd066200640 1 -- 172.21.15.5:0/223657597 shutdown_connections 2024-08-18T22:21:59.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd066200640 1 -- 172.21.15.5:0/223657597 wait complete. 2024-08-18T22:21:59.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd066200640 1 Processor -- start 2024-08-18T22:21:59.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.179+0000 7fd066200640 1 -- start start 2024-08-18T22:21:59.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd066200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0600b40c0 0x7fd060152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:59.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd066200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0600cf290 0x7fd06006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:59.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd066200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd06015b0c0 0x7fd06006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:59.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd066200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd06015b620 con 0x7fd06015b0c0 2024-08-18T22:21:59.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd066200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd06015b4a0 con 0x7fd0600b40c0 2024-08-18T22:21:59.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd066200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd06006f670 con 0x7fd0600cf290 2024-08-18T22:21:59.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd05fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd06015b0c0 0x7fd06006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:59.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd05fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd06015b0c0 0x7fd06006e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39452/0 (socket says 172.21.15.5:39452) 2024-08-18T22:21:59.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd05fe00640 1 -- 172.21.15.5:0/282053194 learned_addr learned my addr 172.21.15.5:0/282053194 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:21:59.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd05f400640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0600b40c0 0x7fd060152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:59.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd056a00640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0600cf290 0x7fd06006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:59.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd05fe00640 1 -- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0600cf290 msgr2=0x7fd06006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:59.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd05fe00640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0600cf290 0x7fd06006e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:59.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd05fe00640 1 -- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0600b40c0 msgr2=0x7fd060152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:21:59.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd05fe00640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0600b40c0 0x7fd060152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:21:59.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd05fe00640 1 -- 172.21.15.5:0/282053194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd060149f80 con 0x7fd06015b0c0 2024-08-18T22:21:59.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd05fe00640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd06015b0c0 0x7fd06006e950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd05801aed0 tx=0x7fd0580195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:59.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd057e00640 1 -- 172.21.15.5:0/282053194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580b2050 con 0x7fd06015b0c0 2024-08-18T22:21:59.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd057e00640 1 -- 172.21.15.5:0/282053194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0580be070 con 0x7fd06015b0c0 2024-08-18T22:21:59.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd057e00640 1 -- 172.21.15.5:0/282053194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580ad850 con 0x7fd06015b0c0 2024-08-18T22:21:59.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd066200640 1 -- 172.21.15.5:0/282053194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0601525f0 con 0x7fd06015b0c0 2024-08-18T22:21:59.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd066200640 1 -- 172.21.15.5:0/282053194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd060157440 con 0x7fd06015b0c0 2024-08-18T22:21:59.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd066200640 1 -- 172.21.15.5:0/282053194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0600b4500 con 0x7fd06015b0c0 2024-08-18T22:21:59.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.183+0000 7fd057e00640 1 -- 172.21.15.5:0/282053194 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0580ad9f0 con 0x7fd06015b0c0 2024-08-18T22:21:59.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.187+0000 7fd057e00640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd03c0678c0 0x7fd03c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:21:59.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.187+0000 7fd057e00640 1 -- 172.21.15.5:0/282053194 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7fd058120d30 con 0x7fd06015b0c0 2024-08-18T22:21:59.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.187+0000 7fd05f400640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd03c0678c0 0x7fd03c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:21:59.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.187+0000 7fd05f400640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd03c0678c0 0x7fd03c069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd050009b60 tx=0x7fd050009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:21:59.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.191+0000 7fd057e00640 1 -- 172.21.15.5:0/282053194 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd060149f80 con 0x7fd06015b0c0 2024-08-18T22:21:59.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:21:59.391+0000 7fd066200640 1 -- 172.21.15.5:0/282053194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd06014cdd0 con 0x7fd06015b0c0 2024-08-18T22:22:00.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd057e00640 1 -- 172.21.15.5:0/282053194 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fd058016560 con 0x7fd06015b0c0 2024-08-18T22:22:00.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 -- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd03c0678c0 msgr2=0x7fd03c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:00.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd03c0678c0 0x7fd03c069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd050009b60 tx=0x7fd050009190 comp rx=0 tx=0).stop 2024-08-18T22:22:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 -- 172.21.15.5:0/282053194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd06015b0c0 msgr2=0x7fd06006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd06015b0c0 0x7fd06006e950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd05801aed0 tx=0x7fd0580195c0 comp rx=0 tx=0).stop 2024-08-18T22:22:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 -- 172.21.15.5:0/282053194 shutdown_connections 2024-08-18T22:22:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd03c0678c0 0x7fd03c069d80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd06015b0c0 0x7fd06006e950 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0600cf290 0x7fd06006e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 --2- 172.21.15.5:0/282053194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0600b40c0 0x7fd060152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 -- 172.21.15.5:0/282053194 >> 172.21.15.5:0/282053194 conn(0x7fd0600b1dc0 msgr2=0x7fd0600cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 -- 172.21.15.5:0/282053194 shutdown_connections 2024-08-18T22:22:00.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.007+0000 7fd066200640 1 -- 172.21.15.5:0/282053194 wait complete. 2024-08-18T22:22:00.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:22:00.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.179+0000 7fbf31c00640 1 Processor -- start 2024-08-18T22:22:00.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.179+0000 7fbf31c00640 1 -- start start 2024-08-18T22:22:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.179+0000 7fbf31c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf2c0cf020 0x7fbf2c0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.179+0000 7fbf31c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbf2c072e80 0x7fbf2c06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.179+0000 7fbf31c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf2c0cf940 con 0x7fbf2c072a20 2024-08-18T22:22:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.179+0000 7fbf31c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbf2c0b4c30 con 0x7fbf2c0cf020 2024-08-18T22:22:00.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.179+0000 7fbf31c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbf2c0735e0 con 0x7fbf2c072e80 2024-08-18T22:22:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.179+0000 7fbf2aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf2c0cf020 0x7fbf2c0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.179+0000 7fbf2a000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbf2c072a20 0x7fbf2c06ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46956/0 (socket says 172.21.15.5:46956) 2024-08-18T22:22:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.179+0000 7fbf2a000640 1 -- 172.21.15.5:0/1466282253 learned_addr learned my addr 172.21.15.5:0/1466282253 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.179+0000 7fbf2b400640 1 --2- 172.21.15.5:0/1466282253 >> v2:172.21.15.117:3300/0 conn(0x7fbf2c072e80 0x7fbf2c06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf2aa00640 1 -- 172.21.15.5:0/1466282253 >> v2:172.21.15.117:3300/0 conn(0x7fbf2c072e80 msgr2=0x7fbf2c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf2aa00640 1 --2- 172.21.15.5:0/1466282253 >> v2:172.21.15.117:3300/0 conn(0x7fbf2c072e80 0x7fbf2c06f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf2aa00640 1 -- 172.21.15.5:0/1466282253 >> v1:172.21.15.5:6789/0 conn(0x7fbf2c072a20 legacy=0x7fbf2c06ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:00.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf2aa00640 1 -- 172.21.15.5:0/1466282253 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c0738c0 con 0x7fbf2c0cf020 2024-08-18T22:22:00.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf2aa00640 1 --2- 172.21.15.5:0/1466282253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf2c0cf020 0x7fbf2c0cf400 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c071a80 tx=0x7fbf1c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408a2ac4dbd43319 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf29600640 1 -- 172.21.15.5:0/1466282253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0b2070 con 0x7fbf2c0cf020 2024-08-18T22:22:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf29600640 1 -- 172.21.15.5:0/1466282253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c0a59c0 con 0x7fbf2c0cf020 2024-08-18T22:22:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf29600640 1 -- 172.21.15.5:0/1466282253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0a5d90 con 0x7fbf2c0cf020 2024-08-18T22:22:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf31c00640 1 -- 172.21.15.5:0/1466282253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf2c0cf020 msgr2=0x7fbf2c0cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf31c00640 1 --2- 172.21.15.5:0/1466282253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf2c0cf020 0x7fbf2c0cf400 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c071a80 tx=0x7fbf1c01c900 comp rx=0 tx=0).stop 2024-08-18T22:22:00.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf31c00640 1 -- 172.21.15.5:0/1466282253 shutdown_connections 2024-08-18T22:22:00.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf31c00640 1 --2- 172.21.15.5:0/1466282253 >> v2:172.21.15.117:3300/0 conn(0x7fbf2c072e80 0x7fbf2c06f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:00.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf31c00640 1 --2- 172.21.15.5:0/1466282253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf2c0cf020 0x7fbf2c0cf400 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:00.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf31c00640 1 -- 172.21.15.5:0/1466282253 >> 172.21.15.5:0/1466282253 conn(0x7fbf2c06b9b0 msgr2=0x7fbf2c06bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:00.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf31c00640 1 -- 172.21.15.5:0/1466282253 shutdown_connections 2024-08-18T22:22:00.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.183+0000 7fbf31c00640 1 -- 172.21.15.5:0/1466282253 wait complete. 2024-08-18T22:22:00.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf31c00640 1 Processor -- start 2024-08-18T22:22:00.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf31c00640 1 -- start start 2024-08-18T22:22:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf31c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf2c072a20 0x7fbf2c1685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf31c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf2c072e80 0x7fbf2c146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf31c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf2c0cf020 0x7fbf2c155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf31c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c073290 con 0x7fbf2c072a20 2024-08-18T22:22:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf31c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c06e3e0 con 0x7fbf2c0cf020 2024-08-18T22:22:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf31c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbf2c1558e0 con 0x7fbf2c072e80 2024-08-18T22:22:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf2c072a20 0x7fbf2c1685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf2c072a20 0x7fbf2c1685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39480/0 (socket says 172.21.15.5:39480) 2024-08-18T22:22:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2aa00640 1 -- 172.21.15.5:0/3545218499 learned_addr learned my addr 172.21.15.5:0/3545218499 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2a000640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf2c072e80 0x7fbf2c146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2b400640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf2c0cf020 0x7fbf2c155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2aa00640 1 -- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf2c072e80 msgr2=0x7fbf2c146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2aa00640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf2c072e80 0x7fbf2c146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2aa00640 1 -- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf2c0cf020 msgr2=0x7fbf2c155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2aa00640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf2c0cf020 0x7fbf2c155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2aa00640 1 -- 172.21.15.5:0/3545218499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c148150 con 0x7fbf2c072a20 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2a000640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf2c072e80 0x7fbf2c146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2b400640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf2c0cf020 0x7fbf2c155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf2aa00640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf2c072a20 0x7fbf2c1685a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0b0040 tx=0x7fbf1c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf22a00640 1 -- 172.21.15.5:0/3545218499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0b2040 con 0x7fbf2c072a20 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf22a00640 1 -- 172.21.15.5:0/3545218499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c0bf070 con 0x7fbf2c072a20 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf31c00640 1 -- 172.21.15.5:0/3545218499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2c148490 con 0x7fbf2c072a20 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf22a00640 1 -- 172.21.15.5:0/3545218499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0b8890 con 0x7fbf2c072a20 2024-08-18T22:22:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.187+0000 7fbf31c00640 1 -- 172.21.15.5:0/3545218499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf2c168ae0 con 0x7fbf2c072a20 2024-08-18T22:22:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.191+0000 7fbf31c00640 1 -- 172.21.15.5:0/3545218499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf2c15c760 con 0x7fbf2c072a20 2024-08-18T22:22:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.191+0000 7fbf22a00640 1 -- 172.21.15.5:0/3545218499 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbf1c0b8a30 con 0x7fbf2c072a20 2024-08-18T22:22:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.191+0000 7fbf22a00640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbf0c0678c0 0x7fbf0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.191+0000 7fbf22a00640 1 -- 172.21.15.5:0/3545218499 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7fbf1c1211a0 con 0x7fbf2c072a20 2024-08-18T22:22:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.191+0000 7fbf2a000640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbf0c0678c0 0x7fbf0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.191+0000 7fbf2a000640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbf0c0678c0 0x7fbf0c069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbf18007fd0 tx=0x7fbf18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:00.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.195+0000 7fbf22a00640 1 -- 172.21.15.5:0/3545218499 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbf2c148490 con 0x7fbf2c072a20 2024-08-18T22:22:00.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:00.363+0000 7fbf31c00640 1 -- 172.21.15.5:0/3545218499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbf2c154dd0 con 0x7fbf2c072a20 2024-08-18T22:22:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.007+0000 7fbf22a00640 1 -- 172.21.15.5:0/3545218499 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) ==== 181+0+0 (secure 0 0 0) 0x7fbf1c016520 con 0x7fbf2c072a20 2024-08-18T22:22:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:22:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 -- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbf0c0678c0 msgr2=0x7fbf0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbf0c0678c0 0x7fbf0c069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbf18007fd0 tx=0x7fbf18009040 comp rx=0 tx=0).stop 2024-08-18T22:22:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 -- 172.21.15.5:0/3545218499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf2c072a20 msgr2=0x7fbf2c1685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf2c072a20 0x7fbf2c1685a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0b0040 tx=0x7fbf1c0196a0 comp rx=0 tx=0).stop 2024-08-18T22:22:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 -- 172.21.15.5:0/3545218499 shutdown_connections 2024-08-18T22:22:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbf0c0678c0 0x7fbf0c069d80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf2c0cf020 0x7fbf2c155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf2c072e80 0x7fbf2c146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 --2- 172.21.15.5:0/3545218499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf2c072a20 0x7fbf2c1685a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 -- 172.21.15.5:0/3545218499 >> 172.21.15.5:0/3545218499 conn(0x7fbf2c06b9b0 msgr2=0x7fbf2c154220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 -- 172.21.15.5:0/3545218499 shutdown_connections 2024-08-18T22:22:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.011+0000 7fbf31c00640 1 -- 172.21.15.5:0/3545218499 wait complete. 2024-08-18T22:22:01.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:22:01.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc34b800640 1 Processor -- start 2024-08-18T22:22:01.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc34b800640 1 -- start start 2024-08-18T22:22:01.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc34b800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 0x7fc3440cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc34b800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc34406dc60 0x7fc34406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc34b800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3440b3260 con 0x7fc34415d1d0 2024-08-18T22:22:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc34b800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc3440cfe90 con 0x7fc34406dc60 2024-08-18T22:22:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc34b800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc3440b37e0 con 0x7fc3440ccaa0 2024-08-18T22:22:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc349800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc34406dc60 0x7fc34406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc33be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc34415d1d0 0x7fc3440cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46960/0 (socket says 172.21.15.5:46960) 2024-08-18T22:22:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc33be00640 1 -- 172.21.15.5:0/1292203542 learned_addr learned my addr 172.21.15.5:0/1292203542 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:01.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc348e00640 1 --2- 172.21.15.5:0/1292203542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 0x7fc3440cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:01.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc349800640 1 -- 172.21.15.5:0/1292203542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 msgr2=0x7fc3440cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:01.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc349800640 1 --2- 172.21.15.5:0/1292203542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 0x7fc3440cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:01.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc349800640 1 -- 172.21.15.5:0/1292203542 >> v1:172.21.15.5:6789/0 conn(0x7fc34415d1d0 legacy=0x7fc3440cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:01.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc349800640 1 -- 172.21.15.5:0/1292203542 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34415d630 con 0x7fc34406dc60 2024-08-18T22:22:01.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc343e00640 1 -- 172.21.15.5:0/1292203542 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316722594 0 0) 0x7fc3440b3260 con 0x7fc34415d1d0 2024-08-18T22:22:01.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.183+0000 7fc348e00640 1 --2- 172.21.15.5:0/1292203542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 0x7fc3440cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc349800640 1 --2- 172.21.15.5:0/1292203542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34406dc60 0x7fc34406e110 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009d90 tx=0x7fc33c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f742f3d73c25928f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc343e00640 1 -- 172.21.15.5:0/1292203542 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0b2070 con 0x7fc34406dc60 2024-08-18T22:22:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc343e00640 1 -- 172.21.15.5:0/1292203542 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c0a57a0 con 0x7fc34406dc60 2024-08-18T22:22:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc343e00640 1 -- 172.21.15.5:0/1292203542 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0a5b70 con 0x7fc34406dc60 2024-08-18T22:22:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc34b800640 1 -- 172.21.15.5:0/1292203542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34406dc60 msgr2=0x7fc34406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc34b800640 1 --2- 172.21.15.5:0/1292203542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34406dc60 0x7fc34406e110 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009d90 tx=0x7fc33c01c8e0 comp rx=0 tx=0).stop 2024-08-18T22:22:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc34b800640 1 -- 172.21.15.5:0/1292203542 shutdown_connections 2024-08-18T22:22:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc34b800640 1 --2- 172.21.15.5:0/1292203542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34406dc60 0x7fc34406e110 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc34b800640 1 --2- 172.21.15.5:0/1292203542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 0x7fc3440cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc34b800640 1 -- 172.21.15.5:0/1292203542 >> 172.21.15.5:0/1292203542 conn(0x7fc34406b9b0 msgr2=0x7fc34406bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc34b800640 1 -- 172.21.15.5:0/1292203542 shutdown_connections 2024-08-18T22:22:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.187+0000 7fc34b800640 1 -- 172.21.15.5:0/1292203542 wait complete. 2024-08-18T22:22:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc34b800640 1 Processor -- start 2024-08-18T22:22:01.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc34b800640 1 -- start start 2024-08-18T22:22:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc34b800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34406dc60 0x7fc344153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc34b800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 0x7fc34409a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc34b800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34415d1d0 0x7fc34409d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc34b800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc34406ebe0 con 0x7fc34406dc60 2024-08-18T22:22:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc34b800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc34406ea60 con 0x7fc34415d1d0 2024-08-18T22:22:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc34b800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc344169510 con 0x7fc3440ccaa0 2024-08-18T22:22:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc348e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34406dc60 0x7fc344153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc348e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34406dc60 0x7fc344153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39486/0 (socket says 172.21.15.5:39486) 2024-08-18T22:22:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc348e00640 1 -- 172.21.15.5:0/3837163853 learned_addr learned my addr 172.21.15.5:0/3837163853 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc33be00640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 0x7fc34409a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc349800640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34415d1d0 0x7fc34409d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc348e00640 1 -- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 msgr2=0x7fc34409a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc348e00640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 0x7fc34409a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc348e00640 1 -- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34415d1d0 msgr2=0x7fc34409d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc348e00640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34415d1d0 0x7fc34409d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc348e00640 1 -- 172.21.15.5:0/3837163853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc344159d30 con 0x7fc34406dc60 2024-08-18T22:22:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc33be00640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 0x7fc34409a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc349800640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34415d1d0 0x7fc34409d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc348e00640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34406dc60 0x7fc344153f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc33400d800 tx=0x7fc33400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc341600640 1 -- 172.21.15.5:0/3837163853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334018020 con 0x7fc34406dc60 2024-08-18T22:22:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc341600640 1 -- 172.21.15.5:0/3837163853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3340096c0 con 0x7fc34406dc60 2024-08-18T22:22:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc341600640 1 -- 172.21.15.5:0/3837163853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334009ab0 con 0x7fc34406dc60 2024-08-18T22:22:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc34b800640 1 -- 172.21.15.5:0/3837163853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc344158d60 con 0x7fc34406dc60 2024-08-18T22:22:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.191+0000 7fc34b800640 1 -- 172.21.15.5:0/3837163853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc344159950 con 0x7fc34406dc60 2024-08-18T22:22:01.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.195+0000 7fc34b800640 1 -- 172.21.15.5:0/3837163853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc344158b50 con 0x7fc34406dc60 2024-08-18T22:22:01.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.195+0000 7fc341600640 1 -- 172.21.15.5:0/3837163853 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc33401b020 con 0x7fc34406dc60 2024-08-18T22:22:01.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.195+0000 7fc341600640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc3200678c0 0x7fc320069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:01.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.195+0000 7fc341600640 1 -- 172.21.15.5:0/3837163853 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5778+0+0 (secure 0 0 0) 0x7fc334086240 con 0x7fc34406dc60 2024-08-18T22:22:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.195+0000 7fc33be00640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc3200678c0 0x7fc320069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.195+0000 7fc33be00640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc3200678c0 0x7fc320069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc3440b1c40 tx=0x7fc32c007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.199+0000 7fc341600640 1 -- 172.21.15.5:0/3837163853 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc334022020 con 0x7fc34406dc60 2024-08-18T22:22:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:01.379+0000 7fc34b800640 1 -- 172.21.15.5:0/3837163853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc34406e110 con 0x7fc34406dc60 2024-08-18T22:22:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.011+0000 7fc341600640 1 -- 172.21.15.5:0/3837163853 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) ==== 169+0+0 (secure 0 0 0) 0x7fc334056d30 con 0x7fc34406dc60 2024-08-18T22:22:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:22:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 -- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc3200678c0 msgr2=0x7fc320069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc3200678c0 0x7fc320069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc3440b1c40 tx=0x7fc32c007cb0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 -- 172.21.15.5:0/3837163853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34406dc60 msgr2=0x7fc344153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34406dc60 0x7fc344153f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc33400d800 tx=0x7fc33400dcc0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 -- 172.21.15.5:0/3837163853 shutdown_connections 2024-08-18T22:22:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc3200678c0 0x7fc320069d80 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc3440b1c40 tx=0x7fc32c007cb0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34415d1d0 0x7fc34409d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440ccaa0 0x7fc34409a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 --2- 172.21.15.5:0/3837163853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34406dc60 0x7fc344153f60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 -- 172.21.15.5:0/3837163853 >> 172.21.15.5:0/3837163853 conn(0x7fc34406b9b0 msgr2=0x7fc34406bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 -- 172.21.15.5:0/3837163853 shutdown_connections 2024-08-18T22:22:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.015+0000 7fc34b800640 1 -- 172.21.15.5:0/3837163853 wait complete. 2024-08-18T22:22:02.048 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:22:02.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff87e000640 1 Processor -- start 2024-08-18T22:22:02.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff87e000640 1 -- start start 2024-08-18T22:22:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff87e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff87815c180 0x7ff8780cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff87e000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8780cfb00 con 0x7ff87815c560 2024-08-18T22:22:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff87e000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff87815c9f0 con 0x7ff87815d4d0 2024-08-18T22:22:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff87e000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff87815d040 con 0x7ff87815c180 2024-08-18T22:22:02.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff877400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff87815c180 0x7ff8780cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff86fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff87815c560 0x7ff8780ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46974/0 (socket says 172.21.15.5:46974) 2024-08-18T22:22:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff86fe00640 1 -- 172.21.15.5:0/1937573453 learned_addr learned my addr 172.21.15.5:0/1937573453 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff877400640 1 -- 172.21.15.5:0/1937573453 >> v1:172.21.15.117:6789/0 conn(0x7ff87815d4d0 legacy=0x7ff87806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff877400640 1 -- 172.21.15.5:0/1937573453 >> v1:172.21.15.5:6789/0 conn(0x7ff87815c560 legacy=0x7ff8780ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff877400640 1 -- 172.21.15.5:0/1937573453 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87815ccd0 con 0x7ff87815c180 2024-08-18T22:22:02.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.191+0000 7ff876a00640 1 -- 172.21.15.5:0/1937573453 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2018976839 0 0) 0x7ff8780cfb00 con 0x7ff87815c560 2024-08-18T22:22:02.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff877400640 1 --2- 172.21.15.5:0/1937573453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff87815c180 0x7ff8780cdf10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff8680097c0 tx=0x7ff86801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce33ef5a2edd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:02.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff876a00640 1 -- 172.21.15.5:0/1937573453 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8680ab5f0 con 0x7ff87815c180 2024-08-18T22:22:02.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff876a00640 1 -- 172.21.15.5:0/1937573453 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8680b0070 con 0x7ff87815c180 2024-08-18T22:22:02.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff876a00640 1 -- 172.21.15.5:0/1937573453 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8680ab9b0 con 0x7ff87815c180 2024-08-18T22:22:02.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff87e000640 1 -- 172.21.15.5:0/1937573453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff87815c180 msgr2=0x7ff8780cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff87e000640 1 --2- 172.21.15.5:0/1937573453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff87815c180 0x7ff8780cdf10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff8680097c0 tx=0x7ff86801c3d0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff87e000640 1 -- 172.21.15.5:0/1937573453 shutdown_connections 2024-08-18T22:22:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff87e000640 1 --2- 172.21.15.5:0/1937573453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff87815c180 0x7ff8780cdf10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff87e000640 1 -- 172.21.15.5:0/1937573453 >> 172.21.15.5:0/1937573453 conn(0x7ff8780b1dc0 msgr2=0x7ff8780b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff87e000640 1 -- 172.21.15.5:0/1937573453 shutdown_connections 2024-08-18T22:22:02.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff87e000640 1 -- 172.21.15.5:0/1937573453 wait complete. 2024-08-18T22:22:02.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff87e000640 1 Processor -- start 2024-08-18T22:22:02.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.195+0000 7ff87e000640 1 -- start start 2024-08-18T22:22:02.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff87e000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87815c180 0x7ff878148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff87e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff87815d4d0 0x7ff878159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff87e000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780aec80 0x7ff87815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff87e000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff87816a2c0 con 0x7ff87815d4d0 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff87e000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff87816a140 con 0x7ff87815c180 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff87e000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff87816a440 con 0x7ff8780aec80 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff87815d4d0 0x7ff878159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff87815d4d0 0x7ff878159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39502/0 (socket says 172.21.15.5:39502) 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86fe00640 1 -- 172.21.15.5:0/1925279729 learned_addr learned my addr 172.21.15.5:0/1925279729 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff877400640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87815c180 0x7ff878148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff877e00640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780aec80 0x7ff87815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86fe00640 1 -- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780aec80 msgr2=0x7ff87815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86fe00640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780aec80 0x7ff87815a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86fe00640 1 -- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87815c180 msgr2=0x7ff878148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86fe00640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87815c180 0x7ff878148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86fe00640 1 -- 172.21.15.5:0/1925279729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8780adbe0 con 0x7ff87815d4d0 2024-08-18T22:22:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff877e00640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780aec80 0x7ff87815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86fe00640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff87815d4d0 0x7ff878159b00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff8600011f0 tx=0x7ff86000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86f400640 1 -- 172.21.15.5:0/1925279729 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860018070 con 0x7ff87815d4d0 2024-08-18T22:22:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86f400640 1 -- 172.21.15.5:0/1925279729 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8600074e0 con 0x7ff87815d4d0 2024-08-18T22:22:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff87e000640 1 -- 172.21.15.5:0/1925279729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8780adec0 con 0x7ff87815d4d0 2024-08-18T22:22:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff86f400640 1 -- 172.21.15.5:0/1925279729 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860004a10 con 0x7ff87815d4d0 2024-08-18T22:22:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff87e000640 1 -- 172.21.15.5:0/1925279729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8780ae480 con 0x7ff87815d4d0 2024-08-18T22:22:02.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.199+0000 7ff87e000640 1 -- 172.21.15.5:0/1925279729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff878148a40 con 0x7ff87815d4d0 2024-08-18T22:22:02.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.203+0000 7ff86f400640 1 -- 172.21.15.5:0/1925279729 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff86001b070 con 0x7ff87815d4d0 2024-08-18T22:22:02.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.203+0000 7ff86f400640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8540678c0 0x7ff854069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:02.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.203+0000 7ff86f400640 1 -- 172.21.15.5:0/1925279729 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7ff860084e40 con 0x7ff87815d4d0 2024-08-18T22:22:02.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.203+0000 7ff877400640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8540678c0 0x7ff854069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:02.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.203+0000 7ff877400640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8540678c0 0x7ff854069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff8680af000 tx=0x7ff8680a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:02.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.207+0000 7ff86f400640 1 -- 172.21.15.5:0/1925279729 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff860055370 con 0x7ff87815d4d0 2024-08-18T22:22:02.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.383+0000 7ff87e000640 1 -- 172.21.15.5:0/1925279729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff878072710 con 0x7ff87815d4d0 2024-08-18T22:22:02.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.387+0000 7ff86f400640 1 -- 172.21.15.5:0/1925279729 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7ff860059670 con 0x7ff87815d4d0 2024-08-18T22:22:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 -- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8540678c0 msgr2=0x7ff854069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8540678c0 0x7ff854069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff8680af000 tx=0x7ff8680a7000 comp rx=0 tx=0).stop 2024-08-18T22:22:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 -- 172.21.15.5:0/1925279729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff87815d4d0 msgr2=0x7ff878159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff87815d4d0 0x7ff878159b00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff8600011f0 tx=0x7ff86000c9b0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 -- 172.21.15.5:0/1925279729 shutdown_connections 2024-08-18T22:22:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8540678c0 0x7ff854069d80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8780aec80 0x7ff87815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff87815d4d0 0x7ff878159b00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 --2- 172.21.15.5:0/1925279729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87815c180 0x7ff878148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 -- 172.21.15.5:0/1925279729 >> 172.21.15.5:0/1925279729 conn(0x7ff8780b1dc0 msgr2=0x7ff878156210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 -- 172.21.15.5:0/1925279729 shutdown_connections 2024-08-18T22:22:02.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.391+0000 7ff87e000640 1 -- 172.21.15.5:0/1925279729 wait complete. 2024-08-18T22:22:02.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-08-18T22:22:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.551+0000 7fc07a000640 1 Processor -- start 2024-08-18T22:22:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.551+0000 7fc07a000640 1 -- start start 2024-08-18T22:22:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.551+0000 7fc07a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc07415b010 0x7fc0740ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.555+0000 7fc07a000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0740cee20 con 0x7fc0740cd3a0 2024-08-18T22:22:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.555+0000 7fc07a000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0740cf100 con 0x7fc07406f290 2024-08-18T22:22:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.555+0000 7fc07a000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc0740cfa30 con 0x7fc07415b010 2024-08-18T22:22:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.555+0000 7fc073400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc07415b010 0x7fc0740ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.555+0000 7fc06aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc0740cd3a0 0x7fc07406eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46980/0 (socket says 172.21.15.5:46980) 2024-08-18T22:22:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.555+0000 7fc06aa00640 1 -- 172.21.15.5:0/3254827292 learned_addr learned my addr 172.21.15.5:0/3254827292 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.555+0000 7fc073400640 1 -- 172.21.15.5:0/3254827292 >> v1:172.21.15.117:6789/0 conn(0x7fc07406f290 legacy=0x7fc074072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.555+0000 7fc073400640 1 -- 172.21.15.5:0/3254827292 >> v1:172.21.15.5:6789/0 conn(0x7fc0740cd3a0 legacy=0x7fc07406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.555+0000 7fc073400640 1 -- 172.21.15.5:0/3254827292 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0740cf3e0 con 0x7fc07415b010 2024-08-18T22:22:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.555+0000 7fc073400640 1 --2- 172.21.15.5:0/3254827292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc07415b010 0x7fc0740ce840 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc0640097c0 tx=0x7fc06401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa61ff71662fc29 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc072a00640 1 -- 172.21.15.5:0/3254827292 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0640b2070 con 0x7fc07415b010 2024-08-18T22:22:02.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc072a00640 1 -- 172.21.15.5:0/3254827292 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0640a9070 con 0x7fc07415b010 2024-08-18T22:22:02.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc072a00640 1 -- 172.21.15.5:0/3254827292 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0640ad880 con 0x7fc07415b010 2024-08-18T22:22:02.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 -- 172.21.15.5:0/3254827292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc07415b010 msgr2=0x7fc0740ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 --2- 172.21.15.5:0/3254827292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc07415b010 0x7fc0740ce840 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc0640097c0 tx=0x7fc06401c430 comp rx=0 tx=0).stop 2024-08-18T22:22:02.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 -- 172.21.15.5:0/3254827292 shutdown_connections 2024-08-18T22:22:02.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 --2- 172.21.15.5:0/3254827292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc07415b010 0x7fc0740ce840 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 -- 172.21.15.5:0/3254827292 >> 172.21.15.5:0/3254827292 conn(0x7fc0740b1c50 msgr2=0x7fc0740b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:02.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 -- 172.21.15.5:0/3254827292 shutdown_connections 2024-08-18T22:22:02.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 -- 172.21.15.5:0/3254827292 wait complete. 2024-08-18T22:22:02.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 Processor -- start 2024-08-18T22:22:02.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 -- start start 2024-08-18T22:22:02.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc07406f290 0x7fc07414a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:02.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0740cd3a0 0x7fc0740c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc07415b010 0x7fc0740c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc0740736c0 con 0x7fc07406f290 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc074073540 con 0x7fc0740cd3a0 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc07a000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc074073840 con 0x7fc07415b010 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc073400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc07406f290 0x7fc07414a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc073400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc07406f290 0x7fc07414a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39506/0 (socket says 172.21.15.5:39506) 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc073400640 1 -- 172.21.15.5:0/2468826351 learned_addr learned my addr 172.21.15.5:0/2468826351 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc06aa00640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0740cd3a0 0x7fc0740c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.559+0000 7fc073e00640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc07415b010 0x7fc0740c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc073400640 1 -- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc07415b010 msgr2=0x7fc0740c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc073400640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc07415b010 0x7fc0740c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc073400640 1 -- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0740cd3a0 msgr2=0x7fc0740c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:02.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc073400640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0740cd3a0 0x7fc0740c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc073400640 1 -- 172.21.15.5:0/2468826351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07415bcd0 con 0x7fc07406f290 2024-08-18T22:22:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc073400640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc07406f290 0x7fc07414a150 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc0640b0040 tx=0x7fc06401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc06be00640 1 -- 172.21.15.5:0/2468826351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0640b2050 con 0x7fc07406f290 2024-08-18T22:22:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc06be00640 1 -- 172.21.15.5:0/2468826351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0640be070 con 0x7fc07406f290 2024-08-18T22:22:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc07a000640 1 -- 172.21.15.5:0/2468826351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07415bfb0 con 0x7fc07406f290 2024-08-18T22:22:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc06be00640 1 -- 172.21.15.5:0/2468826351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0640b98b0 con 0x7fc07406f290 2024-08-18T22:22:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc07a000640 1 -- 172.21.15.5:0/2468826351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07414ea50 con 0x7fc07406f290 2024-08-18T22:22:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc07a000640 1 -- 172.21.15.5:0/2468826351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0740ce840 con 0x7fc07406f290 2024-08-18T22:22:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc06be00640 1 -- 172.21.15.5:0/2468826351 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc0640ab070 con 0x7fc07406f290 2024-08-18T22:22:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc06be00640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0500678c0 0x7fc050069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.563+0000 7fc06be00640 1 -- 172.21.15.5:0/2468826351 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7fc064120180 con 0x7fc07406f290 2024-08-18T22:22:02.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.567+0000 7fc06aa00640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0500678c0 0x7fc050069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.567+0000 7fc06aa00640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0500678c0 0x7fc050069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0741fa410 tx=0x7fc05c007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.567+0000 7fc06be00640 1 -- 172.21.15.5:0/2468826351 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc064016050 con 0x7fc07406f290 2024-08-18T22:22:02.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:02.791+0000 7fc07a000640 1 -- 172.21.15.5:0/2468826351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7fc074150ea0 con 0x7fc07406f290 2024-08-18T22:22:03.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.011+0000 7fc06be00640 1 -- 172.21.15.5:0/2468826351 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v137) ==== 148+0+0 (secure 0 0 0) 0x7fc0640f08f0 con 0x7fc07406f290 2024-08-18T22:22:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 -- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0500678c0 msgr2=0x7fc050069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0500678c0 0x7fc050069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0741fa410 tx=0x7fc05c007e90 comp rx=0 tx=0).stop 2024-08-18T22:22:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 -- 172.21.15.5:0/2468826351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc07406f290 msgr2=0x7fc07414a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc07406f290 0x7fc07414a150 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc0640b0040 tx=0x7fc06401ac70 comp rx=0 tx=0).stop 2024-08-18T22:22:03.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 -- 172.21.15.5:0/2468826351 shutdown_connections 2024-08-18T22:22:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0500678c0 0x7fc050069d80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc07415b010 0x7fc0740c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0740cd3a0 0x7fc0740c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 --2- 172.21.15.5:0/2468826351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc07406f290 0x7fc07414a150 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 -- 172.21.15.5:0/2468826351 >> 172.21.15.5:0/2468826351 conn(0x7fc0740b1c50 msgr2=0x7fc074072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 -- 172.21.15.5:0/2468826351 shutdown_connections 2024-08-18T22:22:03.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.015+0000 7fc07a000640 1 -- 172.21.15.5:0/2468826351 wait complete. 2024-08-18T22:22:03.039 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-08-18T22:22:03.039 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-08-18T22:22:03.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:22:03.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.175+0000 7fc1eb200640 1 Processor -- start 2024-08-18T22:22:03.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.175+0000 7fc1eb200640 1 -- start start 2024-08-18T22:22:03.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1eb200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e406f290 0x7fc1e40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1eb200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1e40cd3a0 0x7fc1e4072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1eb200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e40cee20 con 0x7fc1e415b010 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1eb200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e40cfa30 con 0x7fc1e40cd3a0 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1eb200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e40cf100 con 0x7fc1e406f290 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1e9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1e40cd3a0 0x7fc1e4072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1e9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1e40cd3a0 0x7fc1e4072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39508/0 (socket says 172.21.15.5:39508) 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1e9200640 1 -- 172.21.15.5:0/3162800353 learned_addr learned my addr 172.21.15.5:0/3162800353 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1e3400640 1 --2- 172.21.15.5:0/3162800353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e406f290 0x7fc1e40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1e9200640 1 -- 172.21.15.5:0/3162800353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e406f290 msgr2=0x7fc1e40ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1e9200640 1 --2- 172.21.15.5:0/3162800353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e406f290 0x7fc1e40ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1e9200640 1 -- 172.21.15.5:0/3162800353 >> v1:172.21.15.117:6789/0 conn(0x7fc1e415b010 legacy=0x7fc1e406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1e9200640 1 -- 172.21.15.5:0/3162800353 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e40cf3e0 con 0x7fc1e40cd3a0 2024-08-18T22:22:03.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.179+0000 7fc1e9200640 1 --2- 172.21.15.5:0/3162800353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cd3a0 0x7fc1e4072620 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009e50 tx=0x7fc1dc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8278272bb2c8e672 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:03.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1e2a00640 1 -- 172.21.15.5:0/3162800353 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0a58b0 con 0x7fc1e40cd3a0 2024-08-18T22:22:03.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1e2a00640 1 -- 172.21.15.5:0/3162800353 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0a5a50 con 0x7fc1e40cd3a0 2024-08-18T22:22:03.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1e2a00640 1 -- 172.21.15.5:0/3162800353 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0a5e20 con 0x7fc1e40cd3a0 2024-08-18T22:22:03.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 -- 172.21.15.5:0/3162800353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cd3a0 msgr2=0x7fc1e4072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 --2- 172.21.15.5:0/3162800353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cd3a0 0x7fc1e4072620 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009e50 tx=0x7fc1dc01ca00 comp rx=0 tx=0).stop 2024-08-18T22:22:03.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 -- 172.21.15.5:0/3162800353 shutdown_connections 2024-08-18T22:22:03.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 --2- 172.21.15.5:0/3162800353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e40cd3a0 0x7fc1e4072620 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 --2- 172.21.15.5:0/3162800353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e406f290 0x7fc1e40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 -- 172.21.15.5:0/3162800353 >> 172.21.15.5:0/3162800353 conn(0x7fc1e40b1c50 msgr2=0x7fc1e40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:03.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 -- 172.21.15.5:0/3162800353 shutdown_connections 2024-08-18T22:22:03.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 -- 172.21.15.5:0/3162800353 wait complete. 2024-08-18T22:22:03.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 Processor -- start 2024-08-18T22:22:03.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 -- start start 2024-08-18T22:22:03.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e406f290 0x7fc1e40b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1e40cd3a0 0x7fc1e409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e415b010 0x7fc1e4157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e40734f0 con 0x7fc1e406f290 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4073370 con 0x7fc1e40cd3a0 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1eb200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e4073670 con 0x7fc1e415b010 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1e3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e406f290 0x7fc1e40b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1e3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e406f290 0x7fc1e40b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39522/0 (socket says 172.21.15.5:39522) 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1e3e00640 1 -- 172.21.15.5:0/978117136 learned_addr learned my addr 172.21.15.5:0/978117136 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1e3400640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1e40cd3a0 0x7fc1e409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.183+0000 7fc1e9200640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e415b010 0x7fc1e4157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1e3e00640 1 -- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e415b010 msgr2=0x7fc1e4157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1e3e00640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e415b010 0x7fc1e4157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1e3e00640 1 -- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1e40cd3a0 msgr2=0x7fc1e409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1e3e00640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1e40cd3a0 0x7fc1e409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1e3e00640 1 -- 172.21.15.5:0/978117136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e409cff0 con 0x7fc1e406f290 2024-08-18T22:22:03.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1e3e00640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e406f290 0x7fc1e40b5a20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c370 tx=0x7fc1d400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:03.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1dbe00640 1 -- 172.21.15.5:0/978117136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40052d0 con 0x7fc1e406f290 2024-08-18T22:22:03.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1dbe00640 1 -- 172.21.15.5:0/978117136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d4005470 con 0x7fc1e406f290 2024-08-18T22:22:03.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1dbe00640 1 -- 172.21.15.5:0/978117136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4007260 con 0x7fc1e406f290 2024-08-18T22:22:03.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1eb200640 1 -- 172.21.15.5:0/978117136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e409d2d0 con 0x7fc1e406f290 2024-08-18T22:22:03.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1eb200640 1 -- 172.21.15.5:0/978117136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e409d890 con 0x7fc1e406f290 2024-08-18T22:22:03.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1eb200640 1 -- 172.21.15.5:0/978117136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e40ce840 con 0x7fc1e406f290 2024-08-18T22:22:03.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1dbe00640 1 -- 172.21.15.5:0/978117136 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1d4007400 con 0x7fc1e406f290 2024-08-18T22:22:03.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1dbe00640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc1c40678c0 0x7fc1c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1dbe00640 1 -- 172.21.15.5:0/978117136 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7fc1d4084f10 con 0x7fc1e406f290 2024-08-18T22:22:03.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.187+0000 7fc1e3400640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc1c40678c0 0x7fc1c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.191+0000 7fc1e3400640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc1c40678c0 0x7fc1c4069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40ca830 tx=0x7fc1d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:03.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.191+0000 7fc1dbe00640 1 -- 172.21.15.5:0/978117136 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc1d4055c50 con 0x7fc1e406f290 2024-08-18T22:22:03.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.359+0000 7fc1eb200640 1 -- 172.21.15.5:0/978117136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1e4072790 con 0x7fc1e406f290 2024-08-18T22:22:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1dbe00640 1 -- 172.21.15.5:0/978117136 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+13217 (secure 0 0 0) 0x7fc1d4055550 con 0x7fc1e406f290 2024-08-18T22:22:03.367 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:03.367 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":46,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:22:02.012828+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6834/771750285":"2024-08-19T22:21:59.006365+0000","172.21.15.5:6832/771750285":"2024-08-19T22:21:59.006365+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:22:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 -- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc1c40678c0 msgr2=0x7fc1c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc1c40678c0 0x7fc1c4069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40ca830 tx=0x7fc1d0008040 comp rx=0 tx=0).stop 2024-08-18T22:22:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 -- 172.21.15.5:0/978117136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e406f290 msgr2=0x7fc1e40b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e406f290 0x7fc1e40b5a20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c370 tx=0x7fc1d400c830 comp rx=0 tx=0).stop 2024-08-18T22:22:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 -- 172.21.15.5:0/978117136 shutdown_connections 2024-08-18T22:22:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc1c40678c0 0x7fc1c4069d80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1e415b010 0x7fc1e4157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1e40cd3a0 0x7fc1e409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 --2- 172.21.15.5:0/978117136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1e406f290 0x7fc1e40b5a20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 -- 172.21.15.5:0/978117136 >> 172.21.15.5:0/978117136 conn(0x7fc1e40b1c50 msgr2=0x7fc1e40c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 -- 172.21.15.5:0/978117136 shutdown_connections 2024-08-18T22:22:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.363+0000 7fc1eb200640 1 -- 172.21.15.5:0/978117136 wait complete. 2024-08-18T22:22:03.388 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:22:03.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:22:03.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.527+0000 7f2ce3e00640 1 Processor -- start 2024-08-18T22:22:03.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.527+0000 7f2ce3e00640 1 -- start start 2024-08-18T22:22:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2ce3e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2cdc15b0c0 0x7f2cdc06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2ce3e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cdc0b31f0 con 0x7f2cdc0cf290 2024-08-18T22:22:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2ce3e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cdc0b34d0 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2ce3e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2cdc0b3d70 con 0x7f2cdc15b0c0 2024-08-18T22:22:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2ce1e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2cdc0cf290 0x7f2cdc073140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36286/0 (socket says 172.21.15.5:36286) 2024-08-18T22:22:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2ce1e00640 1 -- 172.21.15.5:0/85900982 learned_addr learned my addr 172.21.15.5:0/85900982 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2ce1400640 1 --2- 172.21.15.5:0/85900982 >> v2:172.21.15.117:3300/0 conn(0x7f2cdc15b0c0 0x7f2cdc06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2cdbe00640 1 -- 172.21.15.5:0/85900982 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3119958317 0 0) 0x7f2cdc0b31f0 con 0x7f2cdc0cf290 2024-08-18T22:22:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2cdbe00640 1 -- 172.21.15.5:0/85900982 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cc4003530 con 0x7f2cdc0cf290 2024-08-18T22:22:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2ce1400640 1 -- 172.21.15.5:0/85900982 >> v1:172.21.15.117:6789/0 conn(0x7f2cdc0b40c0 legacy=0x7f2cdc072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2ce1400640 1 -- 172.21.15.5:0/85900982 >> v1:172.21.15.5:6789/0 conn(0x7f2cdc0cf290 legacy=0x7f2cdc073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.531+0000 7f2ce1400640 1 -- 172.21.15.5:0/85900982 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cdc0b37b0 con 0x7f2cdc15b0c0 2024-08-18T22:22:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce1400640 1 --2- 172.21.15.5:0/85900982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc15b0c0 0x7f2cdc06db80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009d90 tx=0x7f2cd001c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df1091f0f57bf7f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2cdbe00640 1 -- 172.21.15.5:0/85900982 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd00b2070 con 0x7f2cdc15b0c0 2024-08-18T22:22:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2cdbe00640 1 -- 172.21.15.5:0/85900982 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd00a5900 con 0x7f2cdc15b0c0 2024-08-18T22:22:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2cdbe00640 1 -- 172.21.15.5:0/85900982 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd00a5cb0 con 0x7f2cdc15b0c0 2024-08-18T22:22:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 -- 172.21.15.5:0/85900982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc15b0c0 msgr2=0x7f2cdc06db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 --2- 172.21.15.5:0/85900982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc15b0c0 0x7f2cdc06db80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009d90 tx=0x7f2cd001c820 comp rx=0 tx=0).stop 2024-08-18T22:22:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 -- 172.21.15.5:0/85900982 shutdown_connections 2024-08-18T22:22:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 --2- 172.21.15.5:0/85900982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc15b0c0 0x7f2cdc06db80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 -- 172.21.15.5:0/85900982 >> 172.21.15.5:0/85900982 conn(0x7f2cdc0b1dc0 msgr2=0x7f2cdc0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 -- 172.21.15.5:0/85900982 shutdown_connections 2024-08-18T22:22:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 -- 172.21.15.5:0/85900982 wait complete. 2024-08-18T22:22:03.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 Processor -- start 2024-08-18T22:22:03.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 -- start start 2024-08-18T22:22:03.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cdc0b40c0 0x7f2cdc1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cdc0cf290 0x7f2cdc1f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc15b0c0 0x7f2cdc099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2cdc0b48e0 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2cdc15b4a0 con 0x7f2cdc15b0c0 2024-08-18T22:22:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.535+0000 7f2ce3e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2cdc14f840 con 0x7f2cdc0cf290 2024-08-18T22:22:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cdc0b40c0 0x7f2cdc1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cdc0b40c0 0x7f2cdc1584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41284/0 (socket says 172.21.15.5:41284) 2024-08-18T22:22:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce1400640 1 -- 172.21.15.5:0/1342019505 learned_addr learned my addr 172.21.15.5:0/1342019505 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce0a00640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cdc0cf290 0x7f2cdc1f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce1e00640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc15b0c0 0x7f2cdc099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce1400640 1 -- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cdc0cf290 msgr2=0x7f2cdc1f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce1400640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cdc0cf290 0x7f2cdc1f7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce1400640 1 -- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc15b0c0 msgr2=0x7f2cdc099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce1400640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc15b0c0 0x7f2cdc099980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce1400640 1 -- 172.21.15.5:0/1342019505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cdc099ec0 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce0a00640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cdc0cf290 0x7f2cdc1f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce1400640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cdc0b40c0 0x7f2cdc1584b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2cd001cd00 tx=0x7f2cd00195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2cd9600640 1 -- 172.21.15.5:0/1342019505 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd00bd020 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2cd9600640 1 -- 172.21.15.5:0/1342019505 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd0003ba0 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2cd9600640 1 -- 172.21.15.5:0/1342019505 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd00b2040 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce3e00640 1 -- 172.21.15.5:0/1342019505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cdc15a6f0 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce3e00640 1 -- 172.21.15.5:0/1342019505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cdc14fd70 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2ce3e00640 1 -- 172.21.15.5:0/1342019505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cdc06f670 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.539+0000 7f2cd9600640 1 -- 172.21.15.5:0/1342019505 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2cd00c0020 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.543+0000 7f2cd9600640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cbc0678f0 0x7f2cbc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.543+0000 7f2cd9600640 1 -- 172.21.15.5:0/1342019505 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f2cd0120740 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.543+0000 7f2ce0a00640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cbc0678f0 0x7f2cbc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.543+0000 7f2ce0a00640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cbc0678f0 0x7f2cbc069db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc157670 tx=0x7f2cc8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:03.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.547+0000 7f2cd9600640 1 -- 172.21.15.5:0/1342019505 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2cd00c7020 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 -- 172.21.15.5:0/1342019505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2cdc073420 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2cd9600640 1 -- 172.21.15.5:0/1342019505 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7f2cd0016560 con 0x7f2cdc0b40c0 2024-08-18T22:22:03.719 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:22:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 -- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cbc0678f0 msgr2=0x7f2cbc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cbc0678f0 0x7f2cbc069db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc157670 tx=0x7f2cc8009040 comp rx=0 tx=0).stop 2024-08-18T22:22:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 -- 172.21.15.5:0/1342019505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cdc0b40c0 msgr2=0x7f2cdc1584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cdc0b40c0 0x7f2cdc1584b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2cd001cd00 tx=0x7f2cd00195c0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 -- 172.21.15.5:0/1342019505 shutdown_connections 2024-08-18T22:22:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cbc0678f0 0x7f2cbc069db0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc15b0c0 0x7f2cdc099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cdc0cf290 0x7f2cdc1f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 --2- 172.21.15.5:0/1342019505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cdc0b40c0 0x7f2cdc1584b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 -- 172.21.15.5:0/1342019505 >> 172.21.15.5:0/1342019505 conn(0x7f2cdc0b1dc0 msgr2=0x7f2cdc06ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.715+0000 7f2ce3e00640 1 -- 172.21.15.5:0/1342019505 shutdown_connections 2024-08-18T22:22:03.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.719+0000 7f2ce3e00640 1 -- 172.21.15.5:0/1342019505 wait complete. 2024-08-18T22:22:03.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-08-18T22:22:03.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f9065e00640 1 Processor -- start 2024-08-18T22:22:03.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f9065e00640 1 -- start start 2024-08-18T22:22:03.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f9065e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f906013f020 0x7f90600d2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f9065e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90600d2850 0x7f90600d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f9065e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9060141770 con 0x7f906013ec40 2024-08-18T22:22:03.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f9065e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9060142380 con 0x7f906013f020 2024-08-18T22:22:03.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f9065e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9060141a50 con 0x7f90600d2850 2024-08-18T22:22:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f9064a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f906013ec40 0x7f906015cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36300/0 (socket says 172.21.15.5:36300) 2024-08-18T22:22:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f9064a00640 1 -- 172.21.15.5:0/4286185014 learned_addr learned my addr 172.21.15.5:0/4286185014 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f905fe00640 1 --2- 172.21.15.5:0/4286185014 >> v2:172.21.15.5:3300/0 conn(0x7f906013f020 0x7f90600d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f9065400640 1 --2- 172.21.15.5:0/4286185014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90600d2850 0x7f90600d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f905f400640 1 -- 172.21.15.5:0/4286185014 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587061631 0 0) 0x7f9060141770 con 0x7f906013ec40 2024-08-18T22:22:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f905f400640 1 -- 172.21.15.5:0/4286185014 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9048003530 con 0x7f906013ec40 2024-08-18T22:22:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f905fe00640 1 -- 172.21.15.5:0/4286185014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90600d2850 msgr2=0x7f90600d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f905fe00640 1 --2- 172.21.15.5:0/4286185014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90600d2850 0x7f90600d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f905fe00640 1 -- 172.21.15.5:0/4286185014 >> v1:172.21.15.5:6789/0 conn(0x7f906013ec40 legacy=0x7f906015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.879+0000 7f905fe00640 1 -- 172.21.15.5:0/4286185014 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9060141d30 con 0x7f906013f020 2024-08-18T22:22:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f905fe00640 1 --2- 172.21.15.5:0/4286185014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906013f020 0x7f90600d2310 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f904c0097c0 tx=0x7f904c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991d6ee2d2429f38 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f905f400640 1 -- 172.21.15.5:0/4286185014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c0b0070 con 0x7f906013f020 2024-08-18T22:22:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f905f400640 1 -- 172.21.15.5:0/4286185014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904c0ab600 con 0x7f906013f020 2024-08-18T22:22:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f905f400640 1 -- 172.21.15.5:0/4286185014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c0ab9b0 con 0x7f906013f020 2024-08-18T22:22:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f9065e00640 1 -- 172.21.15.5:0/4286185014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906013f020 msgr2=0x7f90600d2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f9065e00640 1 --2- 172.21.15.5:0/4286185014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906013f020 0x7f90600d2310 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f904c0097c0 tx=0x7f904c01c4a0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f9065e00640 1 -- 172.21.15.5:0/4286185014 shutdown_connections 2024-08-18T22:22:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f9065e00640 1 --2- 172.21.15.5:0/4286185014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90600d2850 0x7f90600d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f9065e00640 1 --2- 172.21.15.5:0/4286185014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906013f020 0x7f90600d2310 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f9065e00640 1 -- 172.21.15.5:0/4286185014 >> 172.21.15.5:0/4286185014 conn(0x7f9060067840 msgr2=0x7f9060067c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f9065e00640 1 -- 172.21.15.5:0/4286185014 shutdown_connections 2024-08-18T22:22:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.883+0000 7f9065e00640 1 -- 172.21.15.5:0/4286185014 wait complete. 2024-08-18T22:22:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065e00640 1 Processor -- start 2024-08-18T22:22:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065e00640 1 -- start start 2024-08-18T22:22:03.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90600d2850 0x7f9060158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f906013ec40 0x7f906013b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906013f020 0x7f9060157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f90600d1c30 con 0x7f906013f020 2024-08-18T22:22:03.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90600d1ab0 con 0x7f90600d2850 2024-08-18T22:22:03.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f90600d1db0 con 0x7f906013ec40 2024-08-18T22:22:03.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906013f020 0x7f9060157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906013f020 0x7f9060157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41298/0 (socket says 172.21.15.5:41298) 2024-08-18T22:22:03.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065400640 1 -- 172.21.15.5:0/1006250108 learned_addr learned my addr 172.21.15.5:0/1006250108 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f905fe00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f906013ec40 0x7f906013b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9064a00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90600d2850 0x7f9060158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065400640 1 -- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f906013ec40 msgr2=0x7f906013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065400640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f906013ec40 0x7f906013b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065400640 1 -- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90600d2850 msgr2=0x7f9060158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065400640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90600d2850 0x7f9060158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065400640 1 -- 172.21.15.5:0/1006250108 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9060154e30 con 0x7f906013f020 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9064a00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90600d2850 0x7f9060158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065400640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906013f020 0x7f9060157470 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f905800efc0 tx=0x7f905800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f905cc00640 1 -- 172.21.15.5:0/1006250108 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9058018020 con 0x7f906013f020 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f905cc00640 1 -- 172.21.15.5:0/1006250108 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9058014480 con 0x7f906013f020 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065e00640 1 -- 172.21.15.5:0/1006250108 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90601566b0 con 0x7f906013f020 2024-08-18T22:22:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f905cc00640 1 -- 172.21.15.5:0/1006250108 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9058014870 con 0x7f906013f020 2024-08-18T22:22:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065e00640 1 -- 172.21.15.5:0/1006250108 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9060156c70 con 0x7f906013f020 2024-08-18T22:22:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.887+0000 7f9065e00640 1 -- 172.21.15.5:0/1006250108 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90600d0b50 con 0x7f906013f020 2024-08-18T22:22:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.891+0000 7f905cc00640 1 -- 172.21.15.5:0/1006250108 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f905801b020 con 0x7f906013f020 2024-08-18T22:22:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.891+0000 7f905cc00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90400678c0 0x7f9040069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.891+0000 7f905cc00640 1 -- 172.21.15.5:0/1006250108 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f90580865d0 con 0x7f906013f020 2024-08-18T22:22:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.891+0000 7f9064a00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90400678c0 0x7f9040069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.891+0000 7f9064a00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90400678c0 0x7f9040069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9060155270 tx=0x7f9054009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:03.895+0000 7f905cc00640 1 -- 172.21.15.5:0/1006250108 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9058022070 con 0x7f906013f020 2024-08-18T22:22:04.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:04.119+0000 7f9065e00640 1 -- 172.21.15.5:0/1006250108 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f9060141490 con 0x7f906013f020 2024-08-18T22:22:05.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.019+0000 7f905cc00640 1 -- 172.21.15.5:0/1006250108 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v139) ==== 146+0+0 (secure 0 0 0) 0x7f9058010040 con 0x7f906013f020 2024-08-18T22:22:05.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 -- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90400678c0 msgr2=0x7f9040069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90400678c0 0x7f9040069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9060155270 tx=0x7f9054009040 comp rx=0 tx=0).stop 2024-08-18T22:22:05.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 -- 172.21.15.5:0/1006250108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906013f020 msgr2=0x7f9060157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906013f020 0x7f9060157470 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f905800efc0 tx=0x7f905800c490 comp rx=0 tx=0).stop 2024-08-18T22:22:05.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 -- 172.21.15.5:0/1006250108 shutdown_connections 2024-08-18T22:22:05.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90400678c0 0x7f9040069d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f906013f020 0x7f9060157470 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f906013ec40 0x7f906013b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 --2- 172.21.15.5:0/1006250108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90600d2850 0x7f9060158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 -- 172.21.15.5:0/1006250108 >> 172.21.15.5:0/1006250108 conn(0x7f9060067840 msgr2=0x7f906015cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 -- 172.21.15.5:0/1006250108 shutdown_connections 2024-08-18T22:22:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.023+0000 7f9065e00640 1 -- 172.21.15.5:0/1006250108 wait complete. 2024-08-18T22:22:05.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:22:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.195+0000 7f06c8600640 1 Processor -- start 2024-08-18T22:22:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.195+0000 7f06c8600640 1 -- start start 2024-08-18T22:22:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.195+0000 7f06c8600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06c015c180 0x7f06c00cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.195+0000 7f06c8600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c00cfb00 con 0x7f06c015c560 2024-08-18T22:22:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.195+0000 7f06c8600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c015c9f0 con 0x7f06c015d4d0 2024-08-18T22:22:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.195+0000 7f06c8600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f06c015d040 con 0x7f06c015c180 2024-08-18T22:22:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.195+0000 7f06c5c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06c015c180 0x7f06c00cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.195+0000 7f06c5200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f06c015c560 0x7f06c00ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36314/0 (socket says 172.21.15.5:36314) 2024-08-18T22:22:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.195+0000 7f06c5200640 1 -- 172.21.15.5:0/3904101425 learned_addr learned my addr 172.21.15.5:0/3904101425 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.199+0000 7f06c5c00640 1 -- 172.21.15.5:0/3904101425 >> v1:172.21.15.117:6789/0 conn(0x7f06c015d4d0 legacy=0x7f06c006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.199+0000 7f06c5c00640 1 -- 172.21.15.5:0/3904101425 >> v1:172.21.15.5:6789/0 conn(0x7f06c015c560 legacy=0x7f06c00ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.199+0000 7f06c5c00640 1 -- 172.21.15.5:0/3904101425 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c015ccd0 con 0x7f06c015c180 2024-08-18T22:22:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.199+0000 7f06bfe00640 1 -- 172.21.15.5:0/3904101425 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809925624 0 0) 0x7f06c00cfb00 con 0x7f06c015c560 2024-08-18T22:22:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.199+0000 7f06c5c00640 1 --2- 172.21.15.5:0/3904101425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c015c180 0x7f06c00cdf10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f06b40097c0 tx=0x7f06b401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3511792bc80f4474 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.199+0000 7f06bfe00640 1 -- 172.21.15.5:0/3904101425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b40ab430 con 0x7f06c015c180 2024-08-18T22:22:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.199+0000 7f06bfe00640 1 -- 172.21.15.5:0/3904101425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b40b0070 con 0x7f06c015c180 2024-08-18T22:22:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.199+0000 7f06bfe00640 1 -- 172.21.15.5:0/3904101425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b40ab7f0 con 0x7f06c015c180 2024-08-18T22:22:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.199+0000 7f06c8600640 1 -- 172.21.15.5:0/3904101425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c015c180 msgr2=0x7f06c00cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.199+0000 7f06c8600640 1 --2- 172.21.15.5:0/3904101425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c015c180 0x7f06c00cdf10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f06b40097c0 tx=0x7f06b401c410 comp rx=0 tx=0).stop 2024-08-18T22:22:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 -- 172.21.15.5:0/3904101425 shutdown_connections 2024-08-18T22:22:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 --2- 172.21.15.5:0/3904101425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c015c180 0x7f06c00cdf10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 -- 172.21.15.5:0/3904101425 >> 172.21.15.5:0/3904101425 conn(0x7f06c00b1dc0 msgr2=0x7f06c00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 -- 172.21.15.5:0/3904101425 shutdown_connections 2024-08-18T22:22:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 -- 172.21.15.5:0/3904101425 wait complete. 2024-08-18T22:22:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 Processor -- start 2024-08-18T22:22:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 -- start start 2024-08-18T22:22:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c015c180 0x7f06c015b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c015d4d0 0x7f06c014a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06c0157b90 0x7f06c0158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f06c016a2c0 con 0x7f06c015c180 2024-08-18T22:22:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f06c016a140 con 0x7f06c015d4d0 2024-08-18T22:22:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c8600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f06c016a440 con 0x7f06c0157b90 2024-08-18T22:22:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c5c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c015c180 0x7f06c015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c5c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c015c180 0x7f06c015b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41302/0 (socket says 172.21.15.5:41302) 2024-08-18T22:22:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c5c00640 1 -- 172.21.15.5:0/2307193667 learned_addr learned my addr 172.21.15.5:0/2307193667 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c5200640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c015d4d0 0x7f06c014a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c6600640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06c0157b90 0x7f06c0158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c5c00640 1 -- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06c0157b90 msgr2=0x7f06c0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c5c00640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06c0157b90 0x7f06c0158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c5c00640 1 -- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c015d4d0 msgr2=0x7f06c014a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c5c00640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c015d4d0 0x7f06c014a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c5c00640 1 -- 172.21.15.5:0/2307193667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c015a4d0 con 0x7f06c015c180 2024-08-18T22:22:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c5200640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c015d4d0 0x7f06c014a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06c5c00640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c015c180 0x7f06c015b570 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f06b4019020 tx=0x7f06b401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06bd600640 1 -- 172.21.15.5:0/2307193667 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b40bf610 con 0x7f06c015c180 2024-08-18T22:22:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06bd600640 1 -- 172.21.15.5:0/2307193667 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c00ced70 con 0x7f06c015c180 2024-08-18T22:22:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.203+0000 7f06bd600640 1 -- 172.21.15.5:0/2307193667 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b40bfa10 con 0x7f06c015c180 2024-08-18T22:22:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.207+0000 7f06c8600640 1 -- 172.21.15.5:0/2307193667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c015a7b0 con 0x7f06c015c180 2024-08-18T22:22:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.207+0000 7f06c8600640 1 -- 172.21.15.5:0/2307193667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c015ad70 con 0x7f06c015c180 2024-08-18T22:22:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.207+0000 7f06c8600640 1 -- 172.21.15.5:0/2307193667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c00ae970 con 0x7f06c015c180 2024-08-18T22:22:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.207+0000 7f06bd600640 1 -- 172.21.15.5:0/2307193667 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06b40bd020 con 0x7f06c015c180 2024-08-18T22:22:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.207+0000 7f06bd600640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06a00678c0 0x7f06a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.207+0000 7f06bd600640 1 -- 172.21.15.5:0/2307193667 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f06b40a8030 con 0x7f06c015c180 2024-08-18T22:22:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.207+0000 7f06c5200640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06a00678c0 0x7f06a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.211+0000 7f06c5200640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06a00678c0 0x7f06a0069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f06c0151550 tx=0x7f06ac007c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:05.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.211+0000 7f06bd600640 1 -- 172.21.15.5:0/2307193667 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f06b4016090 con 0x7f06c015c180 2024-08-18T22:22:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.379+0000 7f06c8600640 1 -- 172.21.15.5:0/2307193667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f06c00ae690 con 0x7f06c015c180 2024-08-18T22:22:05.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06bd600640 1 -- 172.21.15.5:0/2307193667 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f06b40f0500 con 0x7f06c015c180 2024-08-18T22:22:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 -- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06a00678c0 msgr2=0x7f06a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06a00678c0 0x7f06a0069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f06c0151550 tx=0x7f06ac007c60 comp rx=0 tx=0).stop 2024-08-18T22:22:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 -- 172.21.15.5:0/2307193667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c015c180 msgr2=0x7f06c015b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c015c180 0x7f06c015b570 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f06b4019020 tx=0x7f06b401ac50 comp rx=0 tx=0).stop 2024-08-18T22:22:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 -- 172.21.15.5:0/2307193667 shutdown_connections 2024-08-18T22:22:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06a00678c0 0x7f06a0069d80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06c0157b90 0x7f06c0158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c015d4d0 0x7f06c014a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 --2- 172.21.15.5:0/2307193667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c015c180 0x7f06c015b570 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 -- 172.21.15.5:0/2307193667 >> 172.21.15.5:0/2307193667 conn(0x7f06c00b1dc0 msgr2=0x7f06c006f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 -- 172.21.15.5:0/2307193667 shutdown_connections 2024-08-18T22:22:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.383+0000 7f06c8600640 1 -- 172.21.15.5:0/2307193667 wait complete. 2024-08-18T22:22:05.408 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:22:05.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:22:05.524 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:22:05.618 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:22:05.618 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:22:05.618 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:05.627 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:22:05.627 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:22:05.627 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:05.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:22:05.636 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:22:05.636 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:05.677 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:22:05.677 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:22:05.677 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:05.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:22:05.694 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:22:05.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:22:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.855+0000 7f51a1200640 1 Processor -- start 2024-08-18T22:22:05.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.855+0000 7f51a1200640 1 -- start start 2024-08-18T22:22:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f51a1200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 0x7f519c06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f51a1200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f519c15e4b0 0x7f519c070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f51a1200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f519c15eb60 con 0x7f519c070730 2024-08-18T22:22:05.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f51a1200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f519c15fcc0 con 0x7f519c15e4b0 2024-08-18T22:22:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f51a1200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f519c0710b0 con 0x7f519c161960 2024-08-18T22:22:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f5199e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 0x7f519c06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f5199e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 0x7f519c06fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:33464/0 (socket says 172.21.15.5:33464) 2024-08-18T22:22:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f5199e00640 1 -- 172.21.15.5:0/2994595659 learned_addr learned my addr 172.21.15.5:0/2994595659 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f5191400640 1 --1- 172.21.15.5:0/2994595659 >> v1:172.21.15.117:6789/0 conn(0x7f519c070730 0x7f519c15dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:54192/0 (socket says 172.21.15.5:54192) 2024-08-18T22:22:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f519a800640 1 --2- 172.21.15.5:0/2994595659 >> v2:172.21.15.117:3300/0 conn(0x7f519c15e4b0 0x7f519c070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f5199e00640 1 -- 172.21.15.5:0/2994595659 >> v2:172.21.15.117:3300/0 conn(0x7f519c15e4b0 msgr2=0x7f519c070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f5199e00640 1 --2- 172.21.15.5:0/2994595659 >> v2:172.21.15.117:3300/0 conn(0x7f519c15e4b0 0x7f519c070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f5199e00640 1 -- 172.21.15.5:0/2994595659 >> v1:172.21.15.117:6789/0 conn(0x7f519c070730 legacy=0x7f519c15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f5199e00640 1 -- 172.21.15.5:0/2994595659 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519c15ee40 con 0x7f519c161960 2024-08-18T22:22:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.859+0000 7f5199400640 1 -- 172.21.15.5:0/2994595659 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289514394 0 0) 0x7f519c15eb60 con 0x7f519c070730 2024-08-18T22:22:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f5199e00640 1 --2- 172.21.15.5:0/2994595659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 0x7f519c06fd20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f518c009870 tx=0x7f518c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=989bd999dd691c99 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f5199400640 1 -- 172.21.15.5:0/2994595659 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c0b2070 con 0x7f519c161960 2024-08-18T22:22:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f5199400640 1 -- 172.21.15.5:0/2994595659 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f518c0a9070 con 0x7f519c161960 2024-08-18T22:22:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f5199400640 1 -- 172.21.15.5:0/2994595659 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c0ad880 con 0x7f519c161960 2024-08-18T22:22:05.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f51a1200640 1 -- 172.21.15.5:0/2994595659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 msgr2=0x7f519c06fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f51a1200640 1 --2- 172.21.15.5:0/2994595659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 0x7f519c06fd20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f518c009870 tx=0x7f518c01c560 comp rx=0 tx=0).stop 2024-08-18T22:22:05.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f51a1200640 1 -- 172.21.15.5:0/2994595659 shutdown_connections 2024-08-18T22:22:05.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f51a1200640 1 --2- 172.21.15.5:0/2994595659 >> v2:172.21.15.117:3300/0 conn(0x7f519c15e4b0 0x7f519c070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f51a1200640 1 --2- 172.21.15.5:0/2994595659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 0x7f519c06fd20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f51a1200640 1 -- 172.21.15.5:0/2994595659 >> 172.21.15.5:0/2994595659 conn(0x7f519c0d2130 msgr2=0x7f519c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:05.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f51a1200640 1 -- 172.21.15.5:0/2994595659 shutdown_connections 2024-08-18T22:22:05.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f51a1200640 1 -- 172.21.15.5:0/2994595659 wait complete. 2024-08-18T22:22:05.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f51a1200640 1 Processor -- start 2024-08-18T22:22:05.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.863+0000 7f51a1200640 1 -- start start 2024-08-18T22:22:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f51a1200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f519c070730 0x7f519c160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f51a1200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c15e4b0 0x7f519c0cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f51a1200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 0x7f519c0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f51a1200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f519c09ba30 con 0x7f519c15e4b0 2024-08-18T22:22:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f51a1200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f519c070260 con 0x7f519c070730 2024-08-18T22:22:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f51a1200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f519c0b5fd0 con 0x7f519c161960 2024-08-18T22:22:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5191400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c15e4b0 0x7f519c0cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5191400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c15e4b0 0x7f519c0cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41310/0 (socket says 172.21.15.5:41310) 2024-08-18T22:22:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5191400640 1 -- 172.21.15.5:0/2328370423 learned_addr learned my addr 172.21.15.5:0/2328370423 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5199e00640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f519c070730 0x7f519c160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:05.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f519a800640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 0x7f519c0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:05.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5191400640 1 -- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 msgr2=0x7f519c0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5191400640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 0x7f519c0cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5191400640 1 -- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f519c070730 msgr2=0x7f519c160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:05.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5191400640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f519c070730 0x7f519c160770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:05.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5191400640 1 -- 172.21.15.5:0/2328370423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519c0cbe60 con 0x7f519c15e4b0 2024-08-18T22:22:05.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5191400640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c15e4b0 0x7f519c0cb2a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f518400c4b0 tx=0x7f518400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:05.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5192a00640 1 -- 172.21.15.5:0/2328370423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5184018070 con 0x7f519c15e4b0 2024-08-18T22:22:05.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5192a00640 1 -- 172.21.15.5:0/2328370423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5184007500 con 0x7f519c15e4b0 2024-08-18T22:22:05.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5192a00640 1 -- 172.21.15.5:0/2328370423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5184004a30 con 0x7f519c15e4b0 2024-08-18T22:22:05.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f51a1200640 1 -- 172.21.15.5:0/2328370423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f519c0cc140 con 0x7f519c15e4b0 2024-08-18T22:22:05.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f51a1200640 1 -- 172.21.15.5:0/2328370423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f519c0b6550 con 0x7f519c15e4b0 2024-08-18T22:22:05.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f51a1200640 1 -- 172.21.15.5:0/2328370423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f519c157830 con 0x7f519c15e4b0 2024-08-18T22:22:05.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.867+0000 7f5192a00640 1 -- 172.21.15.5:0/2328370423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5184004bd0 con 0x7f519c15e4b0 2024-08-18T22:22:05.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.871+0000 7f5192a00640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51780678c0 0x7f5178069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:05.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.871+0000 7f5192a00640 1 -- 172.21.15.5:0/2328370423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f5184084f90 con 0x7f519c15e4b0 2024-08-18T22:22:05.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.871+0000 7f5199e00640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51780678c0 0x7f5178069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:05.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.871+0000 7f5199e00640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51780678c0 0x7f5178069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f518c0af000 tx=0x7f518c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:05.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:05.875+0000 7f5192a00640 1 -- 172.21.15.5:0/2328370423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5184055580 con 0x7f519c15e4b0 2024-08-18T22:22:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.071+0000 7f51a1200640 1 -- 172.21.15.5:0/2328370423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f519c09bbb0 con 0x7f519c15e4b0 2024-08-18T22:22:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f5192a00640 1 -- 172.21.15.5:0/2328370423 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3911 (secure 0 0 0) 0x7f5184059880 con 0x7f519c15e4b0 2024-08-18T22:22:06.078 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:06.078 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"btime":"2024-08-18T22:22:00:008772+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3746061951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3746061951},{"type":"v1","addr":"172.21.15.117:6836","nonce":3746061951}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2422794020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2422794020},{"type":"v1","addr":"172.21.15.117:6837","nonce":2422794020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3630211664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3630211664},{"type":"v1","addr":"172.21.15.5:6835","nonce":3630211664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5274,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3707317564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3707317564},{"type":"v1","addr":"172.21.15.5:6834","nonce":3707317564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-08-18T22:22:06.078 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-08-18T22:22:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 -- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51780678c0 msgr2=0x7f5178069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51780678c0 0x7f5178069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f518c0af000 tx=0x7f518c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:22:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 -- 172.21.15.5:0/2328370423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c15e4b0 msgr2=0x7f519c0cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c15e4b0 0x7f519c0cb2a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f518400c4b0 tx=0x7f518400c970 comp rx=0 tx=0).stop 2024-08-18T22:22:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 -- 172.21.15.5:0/2328370423 shutdown_connections 2024-08-18T22:22:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f51780678c0 0x7f5178069d80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:06.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f519c161960 0x7f519c0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c15e4b0 0x7f519c0cb2a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 --2- 172.21.15.5:0/2328370423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f519c070730 0x7f519c160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 -- 172.21.15.5:0/2328370423 >> 172.21.15.5:0/2328370423 conn(0x7f519c0d2130 msgr2=0x7f519c06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 -- 172.21.15.5:0/2328370423 shutdown_connections 2024-08-18T22:22:06.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.075+0000 7f51a1200640 1 -- 172.21.15.5:0/2328370423 wait complete. 2024-08-18T22:22:06.099 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:22:06.099 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:22:06.099 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:22:06.099 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:22:06.100 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:22:06.100 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:22:06.100 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:22:06.100 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:22:06.100 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:22:06.100 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:22:06.101 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:22:06.101 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:22:06.101 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:22:06.101 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:22:06.101 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:22:06.101 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:22:06.112 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:22:06.112 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:22:06.113 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:22:06.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:22:06.115 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:22:06.115 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:22:06.116 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:22:06.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:22:06.159 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:22:06.160 DEBUG:teuthology.parallel:result is None 2024-08-18T22:22:06.161 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:22:06.161 DEBUG:teuthology.parallel:result is None 2024-08-18T22:22:06.162 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:22:06.162 DEBUG:teuthology.parallel:result is None 2024-08-18T22:22:06.163 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:22:06.163 DEBUG:teuthology.parallel:result is None 2024-08-18T22:22:06.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:22:06.245 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:22:06.247 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:22:06.251 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:22:06.253 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:22:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.303+0000 7f04a1c00640 1 Processor -- start 2024-08-18T22:22:06.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f04a1c00640 1 -- start start 2024-08-18T22:22:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f04a1c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f049c15d4d0 0x7f049c166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f04a1c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f049c0ced30 con 0x7f049c15c180 2024-08-18T22:22:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f04a1c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f049c0cfb00 con 0x7f049c15c560 2024-08-18T22:22:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f04a1c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f049c15d040 con 0x7f049c15d4d0 2024-08-18T22:22:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f049aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f049c15c180 0x7f049c0cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36322/0 (socket says 172.21.15.5:36322) 2024-08-18T22:22:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f049aa00640 1 -- 172.21.15.5:0/1008333489 learned_addr learned my addr 172.21.15.5:0/1008333489 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f049b400640 1 --2- 172.21.15.5:0/1008333489 >> v2:172.21.15.117:3300/0 conn(0x7f049c15d4d0 0x7f049c166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f049a000640 1 -- 172.21.15.5:0/1008333489 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4035070786 0 0) 0x7f049c0ced30 con 0x7f049c15c180 2024-08-18T22:22:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f049a000640 1 -- 172.21.15.5:0/1008333489 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0480003530 con 0x7f049c15c180 2024-08-18T22:22:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f049a000640 1 -- 172.21.15.5:0/1008333489 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 741636635 0 0) 0x7f049c0cfb00 con 0x7f049c15c560 2024-08-18T22:22:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f049a000640 1 -- 172.21.15.5:0/1008333489 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f049c0ced30 con 0x7f049c15c560 2024-08-18T22:22:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f049b400640 1 -- 172.21.15.5:0/1008333489 >> v1:172.21.15.117:6789/0 conn(0x7f049c15c560 legacy=0x7f049c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f049b400640 1 -- 172.21.15.5:0/1008333489 >> v1:172.21.15.5:6789/0 conn(0x7f049c15c180 legacy=0x7f049c0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.307+0000 7f049b400640 1 -- 172.21.15.5:0/1008333489 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c15c9f0 con 0x7f049c15d4d0 2024-08-18T22:22:06.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f049b400640 1 --2- 172.21.15.5:0/1008333489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c15d4d0 0x7f049c166f10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0494009d90 tx=0x7f049401c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e2e5ff894849a00 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f049a000640 1 -- 172.21.15.5:0/1008333489 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04940b2070 con 0x7f049c15d4d0 2024-08-18T22:22:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f049a000640 1 -- 172.21.15.5:0/1008333489 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04940a5990 con 0x7f049c15d4d0 2024-08-18T22:22:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f049a000640 1 -- 172.21.15.5:0/1008333489 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04940a5d60 con 0x7f049c15d4d0 2024-08-18T22:22:06.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f04a1c00640 1 -- 172.21.15.5:0/1008333489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c15d4d0 msgr2=0x7f049c166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:06.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f04a1c00640 1 --2- 172.21.15.5:0/1008333489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c15d4d0 0x7f049c166f10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0494009d90 tx=0x7f049401c8b0 comp rx=0 tx=0).stop 2024-08-18T22:22:06.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f04a1c00640 1 -- 172.21.15.5:0/1008333489 shutdown_connections 2024-08-18T22:22:06.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f04a1c00640 1 --2- 172.21.15.5:0/1008333489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c15d4d0 0x7f049c166f10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:06.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f04a1c00640 1 -- 172.21.15.5:0/1008333489 >> 172.21.15.5:0/1008333489 conn(0x7f049c0b1dc0 msgr2=0x7f049c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:06.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f04a1c00640 1 -- 172.21.15.5:0/1008333489 shutdown_connections 2024-08-18T22:22:06.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f04a1c00640 1 -- 172.21.15.5:0/1008333489 wait complete. 2024-08-18T22:22:06.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f04a1c00640 1 Processor -- start 2024-08-18T22:22:06.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.311+0000 7f04a1c00640 1 -- start start 2024-08-18T22:22:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f04a1c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c15c180 0x7f049c14da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f04a1c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c15d4d0 0x7f049c151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f04a1c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049c1515b0 0x7f049c149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f04a1c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f049c16a000 con 0x7f049c1515b0 2024-08-18T22:22:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f04a1c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f049c169e80 con 0x7f049c15d4d0 2024-08-18T22:22:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f04a1c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f049c16a180 con 0x7f049c15c180 2024-08-18T22:22:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f049b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049c1515b0 0x7f049c149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f049b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049c1515b0 0x7f049c149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41372/0 (socket says 172.21.15.5:41372) 2024-08-18T22:22:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f049b400640 1 -- 172.21.15.5:0/3285217889 learned_addr learned my addr 172.21.15.5:0/3285217889 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f049aa00640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c15c180 0x7f049c14da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f0492000640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c15d4d0 0x7f049c151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f049b400640 1 -- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c15c180 msgr2=0x7f049c14da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f049b400640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c15c180 0x7f049c14da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f049b400640 1 -- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c15d4d0 msgr2=0x7f049c151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f049b400640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c15d4d0 0x7f049c151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f049b400640 1 -- 172.21.15.5:0/3285217889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c1505d0 con 0x7f049c1515b0 2024-08-18T22:22:06.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f049aa00640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c15c180 0x7f049c14da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f049b400640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049c1515b0 0x7f049c149f00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f049401a4e0 tx=0x7f0494019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f0493400640 1 -- 172.21.15.5:0/3285217889 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04940b2050 con 0x7f049c1515b0 2024-08-18T22:22:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f0493400640 1 -- 172.21.15.5:0/3285217889 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04940be070 con 0x7f049c1515b0 2024-08-18T22:22:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f0493400640 1 -- 172.21.15.5:0/3285217889 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04940ada50 con 0x7f049c1515b0 2024-08-18T22:22:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f04a1c00640 1 -- 172.21.15.5:0/3285217889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049c1508b0 con 0x7f049c1515b0 2024-08-18T22:22:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f04a1c00640 1 -- 172.21.15.5:0/3285217889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c156270 con 0x7f049c1515b0 2024-08-18T22:22:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.315+0000 7f04a1c00640 1 -- 172.21.15.5:0/3285217889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049c157910 con 0x7f049c1515b0 2024-08-18T22:22:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.319+0000 7f0493400640 1 -- 172.21.15.5:0/3285217889 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04940a5810 con 0x7f049c1515b0 2024-08-18T22:22:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.319+0000 7f0493400640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04780678f0 0x7f0478069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.319+0000 7f0493400640 1 -- 172.21.15.5:0/3285217889 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f04941207a0 con 0x7f049c1515b0 2024-08-18T22:22:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.319+0000 7f049aa00640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04780678f0 0x7f0478069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.319+0000 7f049aa00640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04780678f0 0x7f0478069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f048c007fd0 tx=0x7f048c007d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:06.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.323+0000 7f0493400640 1 -- 172.21.15.5:0/3285217889 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f04940c7020 con 0x7f049c1515b0 2024-08-18T22:22:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:06.507+0000 7f04a1c00640 1 -- 172.21.15.5:0/3285217889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f049c0cdf10 con 0x7f049c1515b0 2024-08-18T22:22:07.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f0493400640 1 -- 172.21.15.5:0/3285217889 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) ==== 97+0+0 (secure 0 0 0) 0x7f0494016560 con 0x7f049c1515b0 2024-08-18T22:22:07.402 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:22:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 -- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04780678f0 msgr2=0x7f0478069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04780678f0 0x7f0478069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f048c007fd0 tx=0x7f048c007d80 comp rx=0 tx=0).stop 2024-08-18T22:22:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 -- 172.21.15.5:0/3285217889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049c1515b0 msgr2=0x7f049c149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049c1515b0 0x7f049c149f00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f049401a4e0 tx=0x7f0494019650 comp rx=0 tx=0).stop 2024-08-18T22:22:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 -- 172.21.15.5:0/3285217889 shutdown_connections 2024-08-18T22:22:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04780678f0 0x7f0478069db0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f049c1515b0 0x7f049c149f00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c15d4d0 0x7f049c151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 --2- 172.21.15.5:0/3285217889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c15c180 0x7f049c14da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 -- 172.21.15.5:0/3285217889 >> 172.21.15.5:0/3285217889 conn(0x7f049c0b1dc0 msgr2=0x7f049c0b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 -- 172.21.15.5:0/3285217889 shutdown_connections 2024-08-18T22:22:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.399+0000 7f04a1c00640 1 -- 172.21.15.5:0/3285217889 wait complete. 2024-08-18T22:22:07.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:22:07.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.571+0000 7f2c15e00640 1 Processor -- start 2024-08-18T22:22:07.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.571+0000 7f2c15e00640 1 -- start start 2024-08-18T22:22:07.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c15e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c10161960 0x7f2c1006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c15e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2c10070730 0x7f2c10070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c15e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1015eb60 con 0x7f2c1015dda0 2024-08-18T22:22:07.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c15e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2c100710e0 con 0x7f2c10161960 2024-08-18T22:22:07.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c15e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1015e940 con 0x7f2c10070730 2024-08-18T22:22:07.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c0ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c10161960 0x7f2c1006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:07.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c0ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c10161960 0x7f2c1006fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41380/0 (socket says 172.21.15.5:41380) 2024-08-18T22:22:07.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c0ea00640 1 -- 172.21.15.5:0/201562576 learned_addr learned my addr 172.21.15.5:0/201562576 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:07.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c0e000640 1 --2- 172.21.15.5:0/201562576 >> v2:172.21.15.117:3300/0 conn(0x7f2c10070730 0x7f2c10070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:07.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c0ea00640 1 -- 172.21.15.5:0/201562576 >> v2:172.21.15.117:3300/0 conn(0x7f2c10070730 msgr2=0x7f2c10070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:07.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c0ea00640 1 --2- 172.21.15.5:0/201562576 >> v2:172.21.15.117:3300/0 conn(0x7f2c10070730 0x7f2c10070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c0ea00640 1 -- 172.21.15.5:0/201562576 >> v1:172.21.15.117:6789/0 conn(0x7f2c1015dda0 legacy=0x7f2c1015e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:07.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c0ea00640 1 -- 172.21.15.5:0/201562576 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1015ee40 con 0x7f2c10161960 2024-08-18T22:22:07.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c0ea00640 1 --2- 172.21.15.5:0/201562576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c10161960 0x7f2c1006fd20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2c10071d80 tx=0x7f2c0001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cff7a94fda5f08 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:07.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.575+0000 7f2c0d600640 1 -- 172.21.15.5:0/201562576 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c000b0070 con 0x7f2c10161960 2024-08-18T22:22:07.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0d600640 1 -- 172.21.15.5:0/201562576 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c000ab600 con 0x7f2c10161960 2024-08-18T22:22:07.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0d600640 1 -- 172.21.15.5:0/201562576 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c000ab9d0 con 0x7f2c10161960 2024-08-18T22:22:07.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 -- 172.21.15.5:0/201562576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c10161960 msgr2=0x7f2c1006fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:07.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 --2- 172.21.15.5:0/201562576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c10161960 0x7f2c1006fd20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2c10071d80 tx=0x7f2c0001c4e0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 -- 172.21.15.5:0/201562576 shutdown_connections 2024-08-18T22:22:07.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 --2- 172.21.15.5:0/201562576 >> v2:172.21.15.117:3300/0 conn(0x7f2c10070730 0x7f2c10070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 --2- 172.21.15.5:0/201562576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c10161960 0x7f2c1006fd20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 -- 172.21.15.5:0/201562576 >> 172.21.15.5:0/201562576 conn(0x7f2c100d2130 msgr2=0x7f2c100d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:07.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 -- 172.21.15.5:0/201562576 shutdown_connections 2024-08-18T22:22:07.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 -- 172.21.15.5:0/201562576 wait complete. 2024-08-18T22:22:07.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 Processor -- start 2024-08-18T22:22:07.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 -- start start 2024-08-18T22:22:07.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c10070730 0x7f2c10157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c1015dda0 0x7f2c101579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c10161960 0x7f2c100c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1009ba30 con 0x7f2c10070730 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2c10070260 con 0x7f2c10161960 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c15e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2c10157ef0 con 0x7f2c1015dda0 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c10070730 0x7f2c10157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c10070730 0x7f2c10157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41386/0 (socket says 172.21.15.5:41386) 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0ea00640 1 -- 172.21.15.5:0/692475600 learned_addr learned my addr 172.21.15.5:0/692475600 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0f400640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c10161960 0x7f2c100c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0e000640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c1015dda0 0x7f2c101579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0ea00640 1 -- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c1015dda0 msgr2=0x7f2c101579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0ea00640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c1015dda0 0x7f2c101579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0ea00640 1 -- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c10161960 msgr2=0x7f2c100c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0ea00640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c10161960 0x7f2c100c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0ea00640 1 -- 172.21.15.5:0/692475600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1015a2d0 con 0x7f2c10070730 2024-08-18T22:22:07.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0f400640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c10161960 0x7f2c100c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:07.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.579+0000 7f2c0e000640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c1015dda0 0x7f2c101579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:07.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.583+0000 7f2c0ea00640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c10070730 0x7f2c10157470 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2c000ae040 tx=0x7f2c0001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:07.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.583+0000 7f2c07400640 1 -- 172.21.15.5:0/692475600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c000b0040 con 0x7f2c10070730 2024-08-18T22:22:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.583+0000 7f2c07400640 1 -- 172.21.15.5:0/692475600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c000bc070 con 0x7f2c10070730 2024-08-18T22:22:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.583+0000 7f2c07400640 1 -- 172.21.15.5:0/692475600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c000b6680 con 0x7f2c10070730 2024-08-18T22:22:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.583+0000 7f2c15e00640 1 -- 172.21.15.5:0/692475600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c100cc8e0 con 0x7f2c10070730 2024-08-18T22:22:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.583+0000 7f2c15e00640 1 -- 172.21.15.5:0/692475600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c100ccea0 con 0x7f2c10070730 2024-08-18T22:22:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.583+0000 7f2c15e00640 1 -- 172.21.15.5:0/692475600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c10070ba0 con 0x7f2c10070730 2024-08-18T22:22:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.583+0000 7f2c07400640 1 -- 172.21.15.5:0/692475600 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c000b6820 con 0x7f2c10070730 2024-08-18T22:22:07.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.583+0000 7f2c07400640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2bf00678c0 0x7f2bf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.583+0000 7f2c07400640 1 -- 172.21.15.5:0/692475600 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5249+0+0 (secure 0 0 0) 0x7f2c0011fe40 con 0x7f2c10070730 2024-08-18T22:22:07.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.583+0000 7f2c0e000640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2bf00678c0 0x7f2bf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:07.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.587+0000 7f2c0e000640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2bf00678c0 0x7f2bf0069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c100cc440 tx=0x7f2bfc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:07.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.587+0000 7f2c07400640 1 -- 172.21.15.5:0/692475600 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2c000160d0 con 0x7f2c10070730 2024-08-18T22:22:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.811+0000 7f2c15e00640 1 -- 172.21.15.5:0/692475600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f2c1009bbb0 con 0x7f2c10070730 2024-08-18T22:22:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.811+0000 7f2c07400640 1 -- 172.21.15.5:0/692475600 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f2c000f0aa0 con 0x7f2c10070730 2024-08-18T22:22:07.816 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:07.816 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:07.816 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:22:07.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.816 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:22:07.816 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:22:07.816 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.816 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:22:07.816 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:22:07.816 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:22:07.816 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.817 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.818 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.820 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:22:07.822 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:22:07.824 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:22:07.825 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:22:07.827 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.828 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:22:07.829 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 -- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2bf00678c0 msgr2=0x7f2bf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2bf00678c0 0x7f2bf0069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c100cc440 tx=0x7f2bfc008040 comp rx=0 tx=0).stop 2024-08-18T22:22:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 -- 172.21.15.5:0/692475600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c10070730 msgr2=0x7f2c10157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c10070730 0x7f2c10157470 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2c000ae040 tx=0x7f2c0001ad20 comp rx=0 tx=0).stop 2024-08-18T22:22:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 -- 172.21.15.5:0/692475600 shutdown_connections 2024-08-18T22:22:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2bf00678c0 0x7f2bf0069d80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c10161960 0x7f2c100c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c1015dda0 0x7f2c101579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 --2- 172.21.15.5:0/692475600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c10070730 0x7f2c10157470 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 -- 172.21.15.5:0/692475600 >> 172.21.15.5:0/692475600 conn(0x7f2c100d2130 msgr2=0x7f2c100d2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 -- 172.21.15.5:0/692475600 shutdown_connections 2024-08-18T22:22:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.815+0000 7f2c15e00640 1 -- 172.21.15.5:0/692475600 wait complete. 2024-08-18T22:22:07.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:22:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f806ca00640 1 Processor -- start 2024-08-18T22:22:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f806ca00640 1 -- start start 2024-08-18T22:22:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f806ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8068070510 0x7f806809b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f806ca00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f806815f130 0x7f80680708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f806ca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80680d02a0 0x7f80680d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f806ca00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8068070e30 con 0x7f8068070510 2024-08-18T22:22:07.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f806ca00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f806806fe70 con 0x7f806815f130 2024-08-18T22:22:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f806ca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8068070150 con 0x7f80680d02a0 2024-08-18T22:22:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f8066800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8068070510 0x7f806809b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f8066800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8068070510 0x7f806809b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41400/0 (socket says 172.21.15.5:41400) 2024-08-18T22:22:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f8066800640 1 -- 172.21.15.5:0/1059012271 learned_addr learned my addr 172.21.15.5:0/1059012271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f8066800640 1 -- 172.21.15.5:0/1059012271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80680d02a0 msgr2=0x7f80680d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f8066800640 1 --2- 172.21.15.5:0/1059012271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80680d02a0 0x7f80680d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f8066800640 1 -- 172.21.15.5:0/1059012271 >> v2:172.21.15.117:3300/0 conn(0x7f806815f130 msgr2=0x7f80680708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f8066800640 1 --2- 172.21.15.5:0/1059012271 >> v2:172.21.15.117:3300/0 conn(0x7f806815f130 0x7f80680708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.979+0000 7f8066800640 1 -- 172.21.15.5:0/1059012271 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806809aa40 con 0x7f8068070510 2024-08-18T22:22:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f8066800640 1 --2- 172.21.15.5:0/1059012271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8068070510 0x7f806809b520 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f806806ec20 tx=0x7f805801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ffe568625f312a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f8065400640 1 -- 172.21.15.5:0/1059012271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580b0070 con 0x7f8068070510 2024-08-18T22:22:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f8065400640 1 -- 172.21.15.5:0/1059012271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80580ab600 con 0x7f8068070510 2024-08-18T22:22:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f8065400640 1 -- 172.21.15.5:0/1059012271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580ab9d0 con 0x7f8068070510 2024-08-18T22:22:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f806ca00640 1 -- 172.21.15.5:0/1059012271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8068070510 msgr2=0x7f806809b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f806ca00640 1 --2- 172.21.15.5:0/1059012271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8068070510 0x7f806809b520 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f806806ec20 tx=0x7f805801c520 comp rx=0 tx=0).stop 2024-08-18T22:22:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f806ca00640 1 -- 172.21.15.5:0/1059012271 shutdown_connections 2024-08-18T22:22:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f806ca00640 1 --2- 172.21.15.5:0/1059012271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80680d02a0 0x7f80680d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f806ca00640 1 --2- 172.21.15.5:0/1059012271 >> v2:172.21.15.117:3300/0 conn(0x7f806815f130 0x7f80680708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f806ca00640 1 --2- 172.21.15.5:0/1059012271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8068070510 0x7f806809b520 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f806ca00640 1 -- 172.21.15.5:0/1059012271 >> 172.21.15.5:0/1059012271 conn(0x7f80680b3a20 msgr2=0x7f80680b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f806ca00640 1 -- 172.21.15.5:0/1059012271 shutdown_connections 2024-08-18T22:22:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.983+0000 7f806ca00640 1 -- 172.21.15.5:0/1059012271 wait complete. 2024-08-18T22:22:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f806ca00640 1 Processor -- start 2024-08-18T22:22:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f806ca00640 1 -- start start 2024-08-18T22:22:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f806ca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8068070510 0x7f80680c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f806ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80680d02a0 0x7f80680c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f806ca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f806815f130 0x7f80680c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f806ca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f806806fb00 con 0x7f80680d02a0 2024-08-18T22:22:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f806ca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f80680d1060 con 0x7f806815f130 2024-08-18T22:22:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f806ca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f80680b46d0 con 0x7f8068070510 2024-08-18T22:22:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8065e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80680d02a0 0x7f80680c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8065e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80680d02a0 0x7f80680c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41408/0 (socket says 172.21.15.5:41408) 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8065e00640 1 -- 172.21.15.5:0/322030499 learned_addr learned my addr 172.21.15.5:0/322030499 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8066800640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8068070510 0x7f80680c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8067200640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f806815f130 0x7f80680c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8065e00640 1 -- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8068070510 msgr2=0x7f80680c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8065e00640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8068070510 0x7f80680c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8065e00640 1 -- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f806815f130 msgr2=0x7f80680c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8065e00640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f806815f130 0x7f80680c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8065e00640 1 -- 172.21.15.5:0/322030499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80681592d0 con 0x7f80680d02a0 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8067200640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f806815f130 0x7f80680c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f8065e00640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80680d02a0 0x7f80680c8670 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f805400b440 tx=0x7f805400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f805ea00640 1 -- 172.21.15.5:0/322030499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8054015020 con 0x7f80680d02a0 2024-08-18T22:22:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f805ea00640 1 -- 172.21.15.5:0/322030499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80540118b0 con 0x7f80680d02a0 2024-08-18T22:22:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f806ca00640 1 -- 172.21.15.5:0/322030499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80681595b0 con 0x7f80680d02a0 2024-08-18T22:22:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f805ea00640 1 -- 172.21.15.5:0/322030499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8054011ca0 con 0x7f80680d02a0 2024-08-18T22:22:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f806ca00640 1 -- 172.21.15.5:0/322030499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8068159b70 con 0x7f80680d02a0 2024-08-18T22:22:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.987+0000 7f806ca00640 1 -- 172.21.15.5:0/322030499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80680d0710 con 0x7f80680d02a0 2024-08-18T22:22:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.991+0000 7f805ea00640 1 -- 172.21.15.5:0/322030499 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8054018020 con 0x7f80680d02a0 2024-08-18T22:22:07.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.991+0000 7f805ea00640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80480678c0 0x7f8048069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:07.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.991+0000 7f805ea00640 1 -- 172.21.15.5:0/322030499 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5249+0+0 (secure 0 0 0) 0x7f8054085c40 con 0x7f80680d02a0 2024-08-18T22:22:07.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.991+0000 7f8066800640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80480678c0 0x7f8048069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:07.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.991+0000 7f8066800640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80480678c0 0x7f8048069d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f80580ad000 tx=0x7f80580a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:07.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:07.995+0000 7f805ea00640 1 -- 172.21.15.5:0/322030499 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f805401f020 con 0x7f80680d02a0 2024-08-18T22:22:08.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.163+0000 7f806ca00640 1 -- 172.21.15.5:0/322030499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f80680b7eb0 con 0x7f80680d02a0 2024-08-18T22:22:08.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.163+0000 7f805ea00640 1 -- 172.21.15.5:0/322030499 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) ==== 84+0+65 (secure 0 0 0) 0x7f805400d040 con 0x7f80680d02a0 2024-08-18T22:22:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:08.168 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:22:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:22:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:22:08.168 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:08.169 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:22:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 -- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80480678c0 msgr2=0x7f8048069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80480678c0 0x7f8048069d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f80580ad000 tx=0x7f80580a6000 comp rx=0 tx=0).stop 2024-08-18T22:22:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 -- 172.21.15.5:0/322030499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80680d02a0 msgr2=0x7f80680c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80680d02a0 0x7f80680c8670 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f805400b440 tx=0x7f805400b900 comp rx=0 tx=0).stop 2024-08-18T22:22:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 -- 172.21.15.5:0/322030499 shutdown_connections 2024-08-18T22:22:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80480678c0 0x7f8048069d80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f806815f130 0x7f80680c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80680d02a0 0x7f80680c8670 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 --2- 172.21.15.5:0/322030499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8068070510 0x7f80680c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 -- 172.21.15.5:0/322030499 >> 172.21.15.5:0/322030499 conn(0x7f80680b3a20 msgr2=0x7f806815d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 -- 172.21.15.5:0/322030499 shutdown_connections 2024-08-18T22:22:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.167+0000 7f806ca00640 1 -- 172.21.15.5:0/322030499 wait complete. 2024-08-18T22:22:08.189 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:22:08.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:22:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc059600640 1 Processor -- start 2024-08-18T22:22:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc059600640 1 -- start start 2024-08-18T22:22:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc059600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc054072a20 0x7fc054072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc059600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0540735e0 con 0x7fc0540cf020 2024-08-18T22:22:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc059600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0540738c0 con 0x7fc0540b3c20 2024-08-18T22:22:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc059600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc0540733c0 con 0x7fc054072a20 2024-08-18T22:22:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc052a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc0540cf020 0x7fc0540cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36328/0 (socket says 172.21.15.5:36328) 2024-08-18T22:22:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc052a00640 1 -- 172.21.15.5:0/3476154686 learned_addr learned my addr 172.21.15.5:0/3476154686 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc04a000640 1 --2- 172.21.15.5:0/3476154686 >> v2:172.21.15.117:3300/0 conn(0x7fc054072a20 0x7fc054072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc052000640 1 -- 172.21.15.5:0/3476154686 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 104953035 0 0) 0x7fc0540735e0 con 0x7fc0540cf020 2024-08-18T22:22:08.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc052000640 1 -- 172.21.15.5:0/3476154686 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc038003530 con 0x7fc0540cf020 2024-08-18T22:22:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc052000640 1 -- 172.21.15.5:0/3476154686 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1695842439 0 0) 0x7fc038003530 con 0x7fc0540cf020 2024-08-18T22:22:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc04a000640 1 -- 172.21.15.5:0/3476154686 >> v1:172.21.15.117:6789/0 conn(0x7fc0540b3c20 legacy=0x7fc0540b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc04a000640 1 -- 172.21.15.5:0/3476154686 >> v1:172.21.15.5:6789/0 conn(0x7fc0540cf020 legacy=0x7fc0540cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:08.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.331+0000 7fc04a000640 1 -- 172.21.15.5:0/3476154686 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc054073ba0 con 0x7fc054072a20 2024-08-18T22:22:08.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.335+0000 7fc04a000640 1 --2- 172.21.15.5:0/3476154686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc054072a20 0x7fc054072e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0097c0 tx=0x7fc03c01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d91619658f65b701 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:08.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.335+0000 7fc052000640 1 -- 172.21.15.5:0/3476154686 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c0b0070 con 0x7fc054072a20 2024-08-18T22:22:08.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.335+0000 7fc052000640 1 -- 172.21.15.5:0/3476154686 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc03c0ab400 con 0x7fc054072a20 2024-08-18T22:22:08.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.335+0000 7fc052000640 1 -- 172.21.15.5:0/3476154686 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044001680 con 0x7fc054072a20 2024-08-18T22:22:08.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.335+0000 7fc059600640 1 -- 172.21.15.5:0/3476154686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc054072a20 msgr2=0x7fc054072e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:08.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.335+0000 7fc059600640 1 --2- 172.21.15.5:0/3476154686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc054072a20 0x7fc054072e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0097c0 tx=0x7fc03c01c390 comp rx=0 tx=0).stop 2024-08-18T22:22:08.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.335+0000 7fc059600640 1 -- 172.21.15.5:0/3476154686 shutdown_connections 2024-08-18T22:22:08.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.335+0000 7fc059600640 1 --2- 172.21.15.5:0/3476154686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc054072a20 0x7fc054072e80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:08.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.335+0000 7fc059600640 1 -- 172.21.15.5:0/3476154686 >> 172.21.15.5:0/3476154686 conn(0x7fc05406b9b0 msgr2=0x7fc05406bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:08.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.335+0000 7fc059600640 1 -- 172.21.15.5:0/3476154686 shutdown_connections 2024-08-18T22:22:08.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.335+0000 7fc059600640 1 -- 172.21.15.5:0/3476154686 wait complete. 2024-08-18T22:22:08.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc059600640 1 Processor -- start 2024-08-18T22:22:08.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc059600640 1 -- start start 2024-08-18T22:22:08.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc059600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc054072a20 0x7fc054148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:08.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc059600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0540b3c20 0x7fc0541492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:08.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc059600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0540cf020 0x7fc05414a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc059600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc0541558e0 con 0x7fc0540cf020 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc059600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc05406e3e0 con 0x7fc0540b3c20 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc059600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc054155a60 con 0x7fc054072a20 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc053400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0540cf020 0x7fc05414a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc053400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0540cf020 0x7fc05414a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41412/0 (socket says 172.21.15.5:41412) 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc053400640 1 -- 172.21.15.5:0/1057385029 learned_addr learned my addr 172.21.15.5:0/1057385029 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc04a000640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0540b3c20 0x7fc0541492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc052a00640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc054072a20 0x7fc054148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc053400640 1 -- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc054072a20 msgr2=0x7fc054148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc053400640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc054072a20 0x7fc054148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc053400640 1 -- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0540b3c20 msgr2=0x7fc0541492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:08.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc053400640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0540b3c20 0x7fc0541492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc053400640 1 -- 172.21.15.5:0/1057385029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05414f970 con 0x7fc0540cf020 2024-08-18T22:22:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc04a000640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0540b3c20 0x7fc0541492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc053400640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0540cf020 0x7fc05414a270 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c7a0 tx=0x7fc04c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc04b400640 1 -- 172.21.15.5:0/1057385029 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c003b80 con 0x7fc0540cf020 2024-08-18T22:22:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc04b400640 1 -- 172.21.15.5:0/1057385029 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc04c003d20 con 0x7fc0540cf020 2024-08-18T22:22:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc059600640 1 -- 172.21.15.5:0/1057385029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05414fc50 con 0x7fc0540cf020 2024-08-18T22:22:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc04b400640 1 -- 172.21.15.5:0/1057385029 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00aa90 con 0x7fc0540cf020 2024-08-18T22:22:08.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.339+0000 7fc059600640 1 -- 172.21.15.5:0/1057385029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc054150210 con 0x7fc0540cf020 2024-08-18T22:22:08.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.343+0000 7fc059600640 1 -- 172.21.15.5:0/1057385029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc05415c760 con 0x7fc0540cf020 2024-08-18T22:22:08.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.343+0000 7fc04b400640 1 -- 172.21.15.5:0/1057385029 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc04c00ac30 con 0x7fc0540cf020 2024-08-18T22:22:08.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.343+0000 7fc04b400640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0300678f0 0x7fc030069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:08.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.343+0000 7fc04b400640 1 -- 172.21.15.5:0/1057385029 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5249+0+0 (secure 0 0 0) 0x7fc04c085aa0 con 0x7fc0540cf020 2024-08-18T22:22:08.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.343+0000 7fc052a00640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0300678f0 0x7fc030069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:08.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.343+0000 7fc052a00640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0300678f0 0x7fc030069db0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc044005890 tx=0x7fc044009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:08.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.347+0000 7fc04b400640 1 -- 172.21.15.5:0/1057385029 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc04c056710 con 0x7fc0540cf020 2024-08-18T22:22:08.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:08.527+0000 7fc059600640 1 -- 172.21.15.5:0/1057385029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc0541524f0 con 0x7fc0540cf020 2024-08-18T22:22:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.403+0000 7fc04b400640 1 -- 172.21.15.5:0/1057385029 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) ==== 138+0+0 (secure 0 0 0) 0x7fc04c056010 con 0x7fc0540cf020 2024-08-18T22:22:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:22:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.403+0000 7fc059600640 1 -- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0300678f0 msgr2=0x7fc030069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.403+0000 7fc059600640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0300678f0 0x7fc030069db0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc044005890 tx=0x7fc044009040 comp rx=0 tx=0).stop 2024-08-18T22:22:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.403+0000 7fc059600640 1 -- 172.21.15.5:0/1057385029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0540cf020 msgr2=0x7fc05414a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.403+0000 7fc059600640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0540cf020 0x7fc05414a270 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c7a0 tx=0x7fc04c00cc60 comp rx=0 tx=0).stop 2024-08-18T22:22:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.407+0000 7fc059600640 1 -- 172.21.15.5:0/1057385029 shutdown_connections 2024-08-18T22:22:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.407+0000 7fc059600640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0300678f0 0x7fc030069db0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.407+0000 7fc059600640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0540cf020 0x7fc05414a270 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.407+0000 7fc059600640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0540b3c20 0x7fc0541492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.407+0000 7fc059600640 1 --2- 172.21.15.5:0/1057385029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc054072a20 0x7fc054148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.407+0000 7fc059600640 1 -- 172.21.15.5:0/1057385029 >> 172.21.15.5:0/1057385029 conn(0x7fc05406b9b0 msgr2=0x7fc054150d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.407+0000 7fc059600640 1 -- 172.21.15.5:0/1057385029 shutdown_connections 2024-08-18T22:22:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.407+0000 7fc059600640 1 -- 172.21.15.5:0/1057385029 wait complete. 2024-08-18T22:22:09.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:22:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.587+0000 7f73aca00640 1 Processor -- start 2024-08-18T22:22:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.587+0000 7f73aca00640 1 -- start start 2024-08-18T22:22:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.587+0000 7f73aca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a815f000 0x7f73a80b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.587+0000 7f73aca00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a80b46b0 con 0x7f73a8147dd0 2024-08-18T22:22:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.587+0000 7f73aca00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a80b2720 con 0x7f73a806c3c0 2024-08-18T22:22:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.587+0000 7f73aca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f73a815f7c0 con 0x7f73a815f000 2024-08-18T22:22:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.587+0000 7f73a5e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f73a8147dd0 0x7f73a815e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36330/0 (socket says 172.21.15.5:36330) 2024-08-18T22:22:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.587+0000 7f73a5e00640 1 -- 172.21.15.5:0/3501611661 learned_addr learned my addr 172.21.15.5:0/3501611661 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.587+0000 7f739d400640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a815f000 0x7f73a80b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.587+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379557688 0 0) 0x7f73a80b46b0 con 0x7f73a8147dd0 2024-08-18T22:22:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.587+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f738c003530 con 0x7f73a8147dd0 2024-08-18T22:22:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2725697160 0 0) 0x7f738c003530 con 0x7f73a8147dd0 2024-08-18T22:22:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a815f000 msgr2=0x7f73a80b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a815f000 0x7f73a80b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 >> v1:172.21.15.117:6789/0 conn(0x7f73a806c3c0 legacy=0x7f73a80d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a80b2a00 con 0x7f73a8147dd0 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f7398001680 con 0x7f73a8147dd0 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 >> v1:172.21.15.5:6789/0 conn(0x7f73a8147dd0 legacy=0x7f73a815e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738c0039f0 0x7f738c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738c0043a0 0x7f738c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a815f000 0x7f738c005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73a815f7c0 con 0x7f738c0043a0 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f738c00ba80 con 0x7f738c0039f0 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f738c00bc80 con 0x7f73a815f000 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f739d400640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738c0043a0 0x7f738c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a5e00640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738c0039f0 0x7f738c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f73a6800640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a815f000 0x7f738c005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f739d400640 1 -- 172.21.15.5:0/3501611661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a815f000 msgr2=0x7f738c005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f739d400640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a815f000 0x7f738c005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f739d400640 1 -- 172.21.15.5:0/3501611661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738c0039f0 msgr2=0x7f738c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f739d400640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738c0039f0 0x7f738c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.591+0000 7f739d400640 1 -- 172.21.15.5:0/3501611661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c003530 con 0x7f738c0043a0 2024-08-18T22:22:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f739d400640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738c0043a0 0x7f738c004870 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7390009ab0 tx=0x7f739001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89908cb8bbcd6f7b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73900b2070 con 0x7f738c0043a0 2024-08-18T22:22:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73900a5640 con 0x7f738c0043a0 2024-08-18T22:22:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73a5400640 1 -- 172.21.15.5:0/3501611661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73900096b0 con 0x7f738c0043a0 2024-08-18T22:22:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 -- 172.21.15.5:0/3501611661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738c0043a0 msgr2=0x7f738c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 --2- 172.21.15.5:0/3501611661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738c0043a0 0x7f738c004870 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7390009ab0 tx=0x7f739001ca50 comp rx=0 tx=0).stop 2024-08-18T22:22:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73a6800640 1 -- 172.21.15.5:0/3501611661 reap_dead start 2024-08-18T22:22:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 -- 172.21.15.5:0/3501611661 shutdown_connections 2024-08-18T22:22:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 -- 172.21.15.5:0/3501611661 >> 172.21.15.5:0/3501611661 conn(0x7f73a80b65f0 msgr2=0x7f73a80b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 -- 172.21.15.5:0/3501611661 shutdown_connections 2024-08-18T22:22:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 -- 172.21.15.5:0/3501611661 wait complete. 2024-08-18T22:22:09.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 Processor -- start 2024-08-18T22:22:09.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 -- start start 2024-08-18T22:22:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738c0043a0 0x7f73a8146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a80af360 0x7f73a80af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a8134720 0x7f73a8134bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73a806c870 con 0x7f73a80af360 2024-08-18T22:22:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f73a80b6410 con 0x7f738c0043a0 2024-08-18T22:22:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f73aca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f73a815f9e0 con 0x7f73a8134720 2024-08-18T22:22:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f739d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a80af360 0x7f73a80af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f739d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a80af360 0x7f73a80af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41420/0 (socket says 172.21.15.5:41420) 2024-08-18T22:22:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.595+0000 7f739d400640 1 -- 172.21.15.5:0/1622933375 learned_addr learned my addr 172.21.15.5:0/1622933375 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:09.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f73a5e00640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738c0043a0 0x7f73a8146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:09.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f73a6800640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a8134720 0x7f73a8134bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:09.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f739d400640 1 -- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a8134720 msgr2=0x7f73a8134bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:09.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f739d400640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a8134720 0x7f73a8134bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:09.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f739d400640 1 -- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738c0043a0 msgr2=0x7f73a8146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:09.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f739d400640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738c0043a0 0x7f73a8146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:09.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f739d400640 1 -- 172.21.15.5:0/1622933375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a8135110 con 0x7f73a80af360 2024-08-18T22:22:09.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f739d400640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a80af360 0x7f73a80af7c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7390009ab0 tx=0x7f738c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:09.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f739ea00640 1 -- 172.21.15.5:0/1622933375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73900bc020 con 0x7f73a80af360 2024-08-18T22:22:09.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f739ea00640 1 -- 172.21.15.5:0/1622933375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73900ad440 con 0x7f73a80af360 2024-08-18T22:22:09.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f739ea00640 1 -- 172.21.15.5:0/1622933375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73900b2040 con 0x7f73a80af360 2024-08-18T22:22:09.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f73aca00640 1 -- 172.21.15.5:0/1622933375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a80afef0 con 0x7f73a80af360 2024-08-18T22:22:09.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f73aca00640 1 -- 172.21.15.5:0/1622933375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a80b04b0 con 0x7f73a80af360 2024-08-18T22:22:09.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f73aca00640 1 -- 172.21.15.5:0/1622933375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a80b5b30 con 0x7f73a80af360 2024-08-18T22:22:09.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f739ea00640 1 -- 172.21.15.5:0/1622933375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73900ad7f0 con 0x7f73a80af360 2024-08-18T22:22:09.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.599+0000 7f739ea00640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73840678c0 0x7f7384069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:09.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.603+0000 7f739ea00640 1 -- 172.21.15.5:0/1622933375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5619+0+0 (secure 0 0 0) 0x7f7390120a60 con 0x7f73a80af360 2024-08-18T22:22:09.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.603+0000 7f73a5e00640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73840678c0 0x7f7384069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:09.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.603+0000 7f73a5e00640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73840678c0 0x7f7384069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7398000f70 tx=0x7f7398000f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:09.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.603+0000 7f739ea00640 1 -- 172.21.15.5:0/1622933375 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f73900c6020 con 0x7f73a80af360 2024-08-18T22:22:09.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:09.771+0000 7f73aca00640 1 -- 172.21.15.5:0/1622933375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f73a80d1e10 con 0x7f73a80af360 2024-08-18T22:22:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f739ea00640 1 -- 172.21.15.5:0/1622933375 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) ==== 170+0+0 (secure 0 0 0) 0x7f7390016760 con 0x7f73a80af360 2024-08-18T22:22:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:22:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 -- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73840678c0 msgr2=0x7f7384069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73840678c0 0x7f7384069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7398000f70 tx=0x7f7398000f00 comp rx=0 tx=0).stop 2024-08-18T22:22:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 -- 172.21.15.5:0/1622933375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a80af360 msgr2=0x7f73a80af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a80af360 0x7f73a80af7c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7390009ab0 tx=0x7f738c005840 comp rx=0 tx=0).stop 2024-08-18T22:22:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 -- 172.21.15.5:0/1622933375 shutdown_connections 2024-08-18T22:22:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73840678c0 0x7f7384069d80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a8134720 0x7f73a8134bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a80af360 0x7f73a80af7c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 --2- 172.21.15.5:0/1622933375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738c0043a0 0x7f73a8146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 -- 172.21.15.5:0/1622933375 >> 172.21.15.5:0/1622933375 conn(0x7f73a80b65f0 msgr2=0x7f73a806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:10.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 -- 172.21.15.5:0/1622933375 shutdown_connections 2024-08-18T22:22:10.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.411+0000 7f73aca00640 1 -- 172.21.15.5:0/1622933375 wait complete. 2024-08-18T22:22:10.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:22:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f66a7600640 1 Processor -- start 2024-08-18T22:22:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f66a7600640 1 -- start start 2024-08-18T22:22:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f66a7600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66a00b1300 0x7f66a0162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f66a7600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66a009b080 0x7f66a00b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f66a7600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a006e8a0 con 0x7f66a009aca0 2024-08-18T22:22:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f66a7600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f66a009bb80 con 0x7f66a00b1300 2024-08-18T22:22:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f66a7600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f66a00d2e40 con 0x7f66a009b080 2024-08-18T22:22:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f669fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66a00b1300 0x7f66a0162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f669fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66a00b1300 0x7f66a0162950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41426/0 (socket says 172.21.15.5:41426) 2024-08-18T22:22:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f669fe00640 1 -- 172.21.15.5:0/3489255930 learned_addr learned my addr 172.21.15.5:0/3489255930 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f66a5600640 1 --2- 172.21.15.5:0/3489255930 >> v2:172.21.15.117:3300/0 conn(0x7f66a009b080 0x7f66a00b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f669fe00640 1 -- 172.21.15.5:0/3489255930 >> v2:172.21.15.117:3300/0 conn(0x7f66a009b080 msgr2=0x7f66a00b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f669fe00640 1 --2- 172.21.15.5:0/3489255930 >> v2:172.21.15.117:3300/0 conn(0x7f66a009b080 0x7f66a00b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f669fe00640 1 -- 172.21.15.5:0/3489255930 >> v1:172.21.15.117:6789/0 conn(0x7f66a009aca0 legacy=0x7f66a00afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.599+0000 7f669fe00640 1 -- 172.21.15.5:0/3489255930 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a006cbd0 con 0x7f66a00b1300 2024-08-18T22:22:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f669fe00640 1 --2- 172.21.15.5:0/3489255930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a00b1300 0x7f66a0162950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f66a0073460 tx=0x7f668c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832cef56e978c499 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f669f400640 1 -- 172.21.15.5:0/3489255930 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c0ab430 con 0x7f66a00b1300 2024-08-18T22:22:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f669f400640 1 -- 172.21.15.5:0/3489255930 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668c0b0070 con 0x7f66a00b1300 2024-08-18T22:22:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f669f400640 1 -- 172.21.15.5:0/3489255930 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c0ab7f0 con 0x7f66a00b1300 2024-08-18T22:22:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f66a7600640 1 -- 172.21.15.5:0/3489255930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a00b1300 msgr2=0x7f66a0162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f66a7600640 1 --2- 172.21.15.5:0/3489255930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a00b1300 0x7f66a0162950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f66a0073460 tx=0x7f668c01c520 comp rx=0 tx=0).stop 2024-08-18T22:22:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f66a7600640 1 -- 172.21.15.5:0/3489255930 shutdown_connections 2024-08-18T22:22:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f66a7600640 1 --2- 172.21.15.5:0/3489255930 >> v2:172.21.15.117:3300/0 conn(0x7f66a009b080 0x7f66a00b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f66a7600640 1 --2- 172.21.15.5:0/3489255930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a00b1300 0x7f66a0162950 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f66a7600640 1 -- 172.21.15.5:0/3489255930 >> 172.21.15.5:0/3489255930 conn(0x7f66a00d2180 msgr2=0x7f66a00d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f66a7600640 1 -- 172.21.15.5:0/3489255930 shutdown_connections 2024-08-18T22:22:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.603+0000 7f66a7600640 1 -- 172.21.15.5:0/3489255930 wait complete. 2024-08-18T22:22:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a7600640 1 Processor -- start 2024-08-18T22:22:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a7600640 1 -- start start 2024-08-18T22:22:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a7600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a009aca0 0x7f66a0154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a7600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a009b080 0x7f66a014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a7600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66a00b1300 0x7f66a014ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a7600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f66a016bcb0 con 0x7f66a009b080 2024-08-18T22:22:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a7600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66a016bb30 con 0x7f66a00b1300 2024-08-18T22:22:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a7600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f66a016be30 con 0x7f66a009aca0 2024-08-18T22:22:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a009b080 0x7f66a014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a009b080 0x7f66a014e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41440/0 (socket says 172.21.15.5:41440) 2024-08-18T22:22:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669fe00640 1 -- 172.21.15.5:0/4073608467 learned_addr learned my addr 172.21.15.5:0/4073608467 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a5600640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66a00b1300 0x7f66a014ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a4c00640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a009aca0 0x7f66a0154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669fe00640 1 -- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a009aca0 msgr2=0x7f66a0154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669fe00640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a009aca0 0x7f66a0154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669fe00640 1 -- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66a00b1300 msgr2=0x7f66a014ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669fe00640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66a00b1300 0x7f66a014ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669fe00640 1 -- 172.21.15.5:0/4073608467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a0154850 con 0x7f66a009b080 2024-08-18T22:22:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669fe00640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a009b080 0x7f66a014e730 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f668c01abd0 tx=0x7f668c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669cc00640 1 -- 172.21.15.5:0/4073608467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c0be5f0 con 0x7f66a009b080 2024-08-18T22:22:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669cc00640 1 -- 172.21.15.5:0/4073608467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668c0be7b0 con 0x7f66a009b080 2024-08-18T22:22:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f669cc00640 1 -- 172.21.15.5:0/4073608467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c0beba0 con 0x7f66a009b080 2024-08-18T22:22:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a7600640 1 -- 172.21.15.5:0/4073608467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a00b65e0 con 0x7f66a009b080 2024-08-18T22:22:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a7600640 1 -- 172.21.15.5:0/4073608467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a0153b10 con 0x7f66a009b080 2024-08-18T22:22:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.607+0000 7f66a7600640 1 -- 172.21.15.5:0/4073608467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a00afa90 con 0x7f66a009b080 2024-08-18T22:22:10.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.611+0000 7f669cc00640 1 -- 172.21.15.5:0/4073608467 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f668c0b43f0 con 0x7f66a009b080 2024-08-18T22:22:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.611+0000 7f669cc00640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f66800678c0 0x7f6680069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.611+0000 7f669cc00640 1 -- 172.21.15.5:0/4073608467 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6001+0+0 (secure 0 0 0) 0x7f668c0a8070 con 0x7f66a009b080 2024-08-18T22:22:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.611+0000 7f66a4c00640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f66800678c0 0x7f6680069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.611+0000 7f66a4c00640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f66800678c0 0x7f6680069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f66a0150d50 tx=0x7f6690009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.615+0000 7f669cc00640 1 -- 172.21.15.5:0/4073608467 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f668c016110 con 0x7f66a009b080 2024-08-18T22:22:10.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:10.815+0000 7f66a7600640 1 -- 172.21.15.5:0/4073608467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f66a01521f0 con 0x7f66a009b080 2024-08-18T22:22:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.411+0000 7f669cc00640 1 -- 172.21.15.5:0/4073608467 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v22) ==== 172+0+0 (secure 0 0 0) 0x7f668c0f0590 con 0x7f66a009b080 2024-08-18T22:22:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 7 and data pool 8 2024-08-18T22:22:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.415+0000 7f66a7600640 1 -- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f66800678c0 msgr2=0x7f6680069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.415+0000 7f66a7600640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f66800678c0 0x7f6680069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f66a0150d50 tx=0x7f6690009040 comp rx=0 tx=0).stop 2024-08-18T22:22:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.415+0000 7f66a7600640 1 -- 172.21.15.5:0/4073608467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a009b080 msgr2=0x7f66a014e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.415+0000 7f66a7600640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a009b080 0x7f66a014e730 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f668c01abd0 tx=0x7f668c01ad60 comp rx=0 tx=0).stop 2024-08-18T22:22:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.415+0000 7f66a7600640 1 -- 172.21.15.5:0/4073608467 shutdown_connections 2024-08-18T22:22:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.415+0000 7f66a7600640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f66800678c0 0x7f6680069d80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.415+0000 7f66a7600640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66a00b1300 0x7f66a014ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.415+0000 7f66a7600640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66a009b080 0x7f66a014e730 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.415+0000 7f66a7600640 1 --2- 172.21.15.5:0/4073608467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66a009aca0 0x7f66a0154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.415+0000 7f66a7600640 1 -- 172.21.15.5:0/4073608467 >> 172.21.15.5:0/4073608467 conn(0x7f66a00d2180 msgr2=0x7f66a00aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.419+0000 7f66a7600640 1 -- 172.21.15.5:0/4073608467 shutdown_connections 2024-08-18T22:22:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.419+0000 7f66a7600640 1 -- 172.21.15.5:0/4073608467 wait complete. 2024-08-18T22:22:11.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:22:11.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d67a00640 1 Processor -- start 2024-08-18T22:22:11.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d67a00640 1 -- start start 2024-08-18T22:22:11.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d67a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d600ce610 0x7f0d6009b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:11.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d67a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d6009b8b0 0x7f0d600ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:11.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d67a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d600cff50 con 0x7f0d6015ff60 2024-08-18T22:22:11.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d67a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0d600cfd00 con 0x7f0d600ce610 2024-08-18T22:22:11.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d67a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0d600d0230 con 0x7f0d6009b8b0 2024-08-18T22:22:11.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d5fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d600ce610 0x7f0d6009b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d5fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d600ce610 0x7f0d6009b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41448/0 (socket says 172.21.15.5:41448) 2024-08-18T22:22:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d5fe00640 1 -- 172.21.15.5:0/3118114210 learned_addr learned my addr 172.21.15.5:0/3118114210 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d65a00640 1 --2- 172.21.15.5:0/3118114210 >> v2:172.21.15.117:3300/0 conn(0x7f0d6009b8b0 0x7f0d600ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d5fe00640 1 -- 172.21.15.5:0/3118114210 >> v2:172.21.15.117:3300/0 conn(0x7f0d6009b8b0 msgr2=0x7f0d600ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d5fe00640 1 --2- 172.21.15.5:0/3118114210 >> v2:172.21.15.117:3300/0 conn(0x7f0d6009b8b0 0x7f0d600ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d5fe00640 1 -- 172.21.15.5:0/3118114210 >> v1:172.21.15.5:6789/0 conn(0x7f0d6015ff60 legacy=0x7f0d60160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d5fe00640 1 -- 172.21.15.5:0/3118114210 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6009ab70 con 0x7f0d600ce610 2024-08-18T22:22:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d5f400640 1 -- 172.21.15.5:0/3118114210 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3982280351 0 0) 0x7f0d600cff50 con 0x7f0d6015ff60 2024-08-18T22:22:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.855+0000 7f0d65a00640 1 --2- 172.21.15.5:0/3118114210 >> v2:172.21.15.117:3300/0 conn(0x7f0d6009b8b0 0x7f0d600ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:11.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d5fe00640 1 --2- 172.21.15.5:0/3118114210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d600ce610 0x7f0d6009b370 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0d6006c680 tx=0x7f0d4c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3541e96d1f80fa6f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d5f400640 1 -- 172.21.15.5:0/3118114210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0b0070 con 0x7f0d600ce610 2024-08-18T22:22:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d5f400640 1 -- 172.21.15.5:0/3118114210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c0ab600 con 0x7f0d600ce610 2024-08-18T22:22:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d5f400640 1 -- 172.21.15.5:0/3118114210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0ab9d0 con 0x7f0d600ce610 2024-08-18T22:22:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d67a00640 1 -- 172.21.15.5:0/3118114210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d600ce610 msgr2=0x7f0d6009b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d67a00640 1 --2- 172.21.15.5:0/3118114210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d600ce610 0x7f0d6009b370 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0d6006c680 tx=0x7f0d4c01c400 comp rx=0 tx=0).stop 2024-08-18T22:22:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d67a00640 1 -- 172.21.15.5:0/3118114210 shutdown_connections 2024-08-18T22:22:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d67a00640 1 --2- 172.21.15.5:0/3118114210 >> v2:172.21.15.117:3300/0 conn(0x7f0d6009b8b0 0x7f0d600ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d67a00640 1 --2- 172.21.15.5:0/3118114210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d600ce610 0x7f0d6009b370 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d67a00640 1 -- 172.21.15.5:0/3118114210 >> 172.21.15.5:0/3118114210 conn(0x7f0d600d2130 msgr2=0x7f0d600d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d67a00640 1 -- 172.21.15.5:0/3118114210 shutdown_connections 2024-08-18T22:22:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.859+0000 7f0d67a00640 1 -- 172.21.15.5:0/3118114210 wait complete. 2024-08-18T22:22:11.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d67a00640 1 Processor -- start 2024-08-18T22:22:11.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d67a00640 1 -- start start 2024-08-18T22:22:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d67a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d6009b8b0 0x7f0d600b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d67a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d600ce610 0x7f0d6015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d67a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d6015ff60 0x7f0d600b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d67a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0d60169850 con 0x7f0d6015ff60 2024-08-18T22:22:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d67a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0d600cd560 con 0x7f0d600ce610 2024-08-18T22:22:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d67a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d601699d0 con 0x7f0d6009b8b0 2024-08-18T22:22:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d65a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d6015ff60 0x7f0d600b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d65a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d6015ff60 0x7f0d600b5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41458/0 (socket says 172.21.15.5:41458) 2024-08-18T22:22:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d65a00640 1 -- 172.21.15.5:0/4195928938 learned_addr learned my addr 172.21.15.5:0/4195928938 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d5fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d600ce610 0x7f0d6015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d65000640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d6009b8b0 0x7f0d600b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:11.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d65a00640 1 -- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d6009b8b0 msgr2=0x7f0d600b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:11.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d65a00640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d6009b8b0 0x7f0d600b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:11.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d65a00640 1 -- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d600ce610 msgr2=0x7f0d6015eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d65a00640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d600ce610 0x7f0d6015eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d65a00640 1 -- 172.21.15.5:0/4195928938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d600b3890 con 0x7f0d6015ff60 2024-08-18T22:22:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d65a00640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d6015ff60 0x7f0d600b5a60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800cd50 tx=0x7f0d5800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d5cc00640 1 -- 172.21.15.5:0/4195928938 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800f680 con 0x7f0d6015ff60 2024-08-18T22:22:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d5cc00640 1 -- 172.21.15.5:0/4195928938 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d5800f840 con 0x7f0d6015ff60 2024-08-18T22:22:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d5cc00640 1 -- 172.21.15.5:0/4195928938 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800fc30 con 0x7f0d6015ff60 2024-08-18T22:22:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d67a00640 1 -- 172.21.15.5:0/4195928938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d600b2b30 con 0x7f0d6015ff60 2024-08-18T22:22:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.863+0000 7f0d67a00640 1 -- 172.21.15.5:0/4195928938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d600b4f80 con 0x7f0d6015ff60 2024-08-18T22:22:11.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.867+0000 7f0d67a00640 1 -- 172.21.15.5:0/4195928938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d600ccc10 con 0x7f0d6015ff60 2024-08-18T22:22:11.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.867+0000 7f0d5cc00640 1 -- 172.21.15.5:0/4195928938 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d5800e3e0 con 0x7f0d6015ff60 2024-08-18T22:22:11.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.867+0000 7f0d5cc00640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d400678c0 0x7f0d40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:11.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.867+0000 7f0d5cc00640 1 -- 172.21.15.5:0/4195928938 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f0d58086b50 con 0x7f0d6015ff60 2024-08-18T22:22:11.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.867+0000 7f0d65000640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d400678c0 0x7f0d40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:11.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.867+0000 7f0d65000640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d400678c0 0x7f0d40069d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d50007fd0 tx=0x7f0d50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:11.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:11.871+0000 7f0d5cc00640 1 -- 172.21.15.5:0/4195928938 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0d58014030 con 0x7f0d6015ff60 2024-08-18T22:22:12.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.047+0000 7f0d67a00640 1 -- 172.21.15.5:0/4195928938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d600d0f90 con 0x7f0d6015ff60 2024-08-18T22:22:12.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d5cc00640 1 -- 172.21.15.5:0/4195928938 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16883 (secure 0 0 0) 0x7f0d58056e10 con 0x7f0d6015ff60 2024-08-18T22:22:12.054 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:12.055 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":54,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:22:10.822329+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:22:08.577033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-08-18T22:22:09.824932+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:22:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 -- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d400678c0 msgr2=0x7f0d40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d400678c0 0x7f0d40069d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d50007fd0 tx=0x7f0d50009040 comp rx=0 tx=0).stop 2024-08-18T22:22:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 -- 172.21.15.5:0/4195928938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d6015ff60 msgr2=0x7f0d600b5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d6015ff60 0x7f0d600b5a60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800cd50 tx=0x7f0d5800a650 comp rx=0 tx=0).stop 2024-08-18T22:22:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 -- 172.21.15.5:0/4195928938 shutdown_connections 2024-08-18T22:22:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d400678c0 0x7f0d40069d80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d6015ff60 0x7f0d600b5a60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d600ce610 0x7f0d6015eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 --2- 172.21.15.5:0/4195928938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d6009b8b0 0x7f0d600b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 -- 172.21.15.5:0/4195928938 >> 172.21.15.5:0/4195928938 conn(0x7f0d600d2130 msgr2=0x7f0d60160340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:12.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 -- 172.21.15.5:0/4195928938 shutdown_connections 2024-08-18T22:22:12.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.051+0000 7f0d67a00640 1 -- 172.21.15.5:0/4195928938 wait complete. 2024-08-18T22:22:12.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:22:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.211+0000 7f7ea7200640 1 Processor -- start 2024-08-18T22:22:12.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.211+0000 7f7ea7200640 1 -- start start 2024-08-18T22:22:12.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.215+0000 7f7ea7200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ea0071c90 0x7f7ea00b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.215+0000 7f7ea7200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea00b5e30 con 0x7f7ea015c180 2024-08-18T22:22:12.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.215+0000 7f7ea7200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea00b6110 con 0x7f7ea006fad0 2024-08-18T22:22:12.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.215+0000 7f7ea7200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea00b63f0 con 0x7f7ea0071c90 2024-08-18T22:22:12.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.215+0000 7f7e9f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ea0071c90 0x7f7ea00b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.215+0000 7f7e9fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7ea015c180 0x7f7ea0071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36342/0 (socket says 172.21.15.5:36342) 2024-08-18T22:22:12.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.215+0000 7f7e9fe00640 1 -- 172.21.15.5:0/952615161 learned_addr learned my addr 172.21.15.5:0/952615161 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:12.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.215+0000 7f7e9f400640 1 -- 172.21.15.5:0/952615161 >> v1:172.21.15.117:6789/0 conn(0x7f7ea006fad0 legacy=0x7f7ea00d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:12.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.215+0000 7f7e9f400640 1 -- 172.21.15.5:0/952615161 >> v1:172.21.15.5:6789/0 conn(0x7f7ea015c180 legacy=0x7f7ea0071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.215+0000 7f7e9f400640 1 -- 172.21.15.5:0/952615161 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea00b66d0 con 0x7f7ea0071c90 2024-08-18T22:22:12.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.215+0000 7f7e9ea00640 1 -- 172.21.15.5:0/952615161 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3513687166 0 0) 0x7f7ea00b5e30 con 0x7f7ea015c180 2024-08-18T22:22:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7e9f400640 1 --2- 172.21.15.5:0/952615161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea0071c90 0x7f7ea00b57c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0097c0 tx=0x7f7e8c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81e0b8d989c900b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7e9ea00640 1 -- 172.21.15.5:0/952615161 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0b0070 con 0x7f7ea0071c90 2024-08-18T22:22:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7e9ea00640 1 -- 172.21.15.5:0/952615161 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0ab600 con 0x7f7ea0071c90 2024-08-18T22:22:12.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7e9ea00640 1 -- 172.21.15.5:0/952615161 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0ab9d0 con 0x7f7ea0071c90 2024-08-18T22:22:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7ea7200640 1 -- 172.21.15.5:0/952615161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea0071c90 msgr2=0x7f7ea00b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7ea7200640 1 --2- 172.21.15.5:0/952615161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea0071c90 0x7f7ea00b57c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0097c0 tx=0x7f7e8c01c2e0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7ea7200640 1 -- 172.21.15.5:0/952615161 shutdown_connections 2024-08-18T22:22:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7ea7200640 1 --2- 172.21.15.5:0/952615161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea0071c90 0x7f7ea00b57c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7ea7200640 1 -- 172.21.15.5:0/952615161 >> 172.21.15.5:0/952615161 conn(0x7f7ea00b3eb0 msgr2=0x7f7ea00b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7ea7200640 1 -- 172.21.15.5:0/952615161 shutdown_connections 2024-08-18T22:22:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7ea7200640 1 -- 172.21.15.5:0/952615161 wait complete. 2024-08-18T22:22:12.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7ea7200640 1 Processor -- start 2024-08-18T22:22:12.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.219+0000 7f7ea7200640 1 -- start start 2024-08-18T22:22:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea7200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ea006fad0 0x7f7ea015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea7200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ea0071c90 0x7f7ea0166470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea7200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea015c180 0x7f7ea0157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea7200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea016a160 con 0x7f7ea015c180 2024-08-18T22:22:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea7200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea0169fe0 con 0x7f7ea006fad0 2024-08-18T22:22:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea7200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea016a2e0 con 0x7f7ea0071c90 2024-08-18T22:22:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea015c180 0x7f7ea0157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea015c180 0x7f7ea0157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41468/0 (socket says 172.21.15.5:41468) 2024-08-18T22:22:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea5200640 1 -- 172.21.15.5:0/213084558 learned_addr learned my addr 172.21.15.5:0/213084558 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7e9fe00640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ea006fad0 0x7f7ea015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea5200640 1 -- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ea0071c90 msgr2=0x7f7ea0166470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea5200640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ea0071c90 0x7f7ea0166470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea5200640 1 -- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ea006fad0 msgr2=0x7f7ea015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea5200640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ea006fad0 0x7f7ea015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea5200640 1 -- 172.21.15.5:0/213084558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea00a9880 con 0x7f7ea015c180 2024-08-18T22:22:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7e9fe00640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ea006fad0 0x7f7ea015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea5200640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea015c180 0x7f7ea0157400 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800ba10 tx=0x7f7e9800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7e97e00640 1 -- 172.21.15.5:0/213084558 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98019070 con 0x7f7ea015c180 2024-08-18T22:22:12.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7e97e00640 1 -- 172.21.15.5:0/213084558 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9800cb40 con 0x7f7ea015c180 2024-08-18T22:22:12.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7e97e00640 1 -- 172.21.15.5:0/213084558 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98014440 con 0x7f7ea015c180 2024-08-18T22:22:12.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea7200640 1 -- 172.21.15.5:0/213084558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea00a9b60 con 0x7f7ea015c180 2024-08-18T22:22:12.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea7200640 1 -- 172.21.15.5:0/213084558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea00aa120 con 0x7f7ea015c180 2024-08-18T22:22:12.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7ea7200640 1 -- 172.21.15.5:0/213084558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea00cf7d0 con 0x7f7ea015c180 2024-08-18T22:22:12.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.223+0000 7f7e97e00640 1 -- 172.21.15.5:0/213084558 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e9801c070 con 0x7f7ea015c180 2024-08-18T22:22:12.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.227+0000 7f7e97e00640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e800678c0 0x7f7e80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.227+0000 7f7e97e00640 1 -- 172.21.15.5:0/213084558 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f7e98085b40 con 0x7f7ea015c180 2024-08-18T22:22:12.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.227+0000 7f7e9fe00640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e800678c0 0x7f7e80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.227+0000 7f7e9fe00640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e800678c0 0x7f7e80069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7e90000f70 tx=0x7f7e90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:12.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.231+0000 7f7e97e00640 1 -- 172.21.15.5:0/213084558 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7e980563c0 con 0x7f7ea015c180 2024-08-18T22:22:12.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.399+0000 7f7ea7200640 1 -- 172.21.15.5:0/213084558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ea00725e0 con 0x7f7ea015c180 2024-08-18T22:22:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.399+0000 7f7e97e00640 1 -- 172.21.15.5:0/213084558 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16883 (secure 0 0 0) 0x7f7e98055cc0 con 0x7f7ea015c180 2024-08-18T22:22:12.404 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:12.404 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":54,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:22:10.822329+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:22:08.577033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-08-18T22:22:09.824932+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:22:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 -- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e800678c0 msgr2=0x7f7e80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e800678c0 0x7f7e80069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7e90000f70 tx=0x7f7e90009040 comp rx=0 tx=0).stop 2024-08-18T22:22:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 -- 172.21.15.5:0/213084558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea015c180 msgr2=0x7f7ea0157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea015c180 0x7f7ea0157400 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800ba10 tx=0x7f7e9800bed0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 -- 172.21.15.5:0/213084558 shutdown_connections 2024-08-18T22:22:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e800678c0 0x7f7e80069d80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea015c180 0x7f7ea0157400 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ea0071c90 0x7f7ea0166470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 --2- 172.21.15.5:0/213084558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ea006fad0 0x7f7ea015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 -- 172.21.15.5:0/213084558 >> 172.21.15.5:0/213084558 conn(0x7f7ea00b3eb0 msgr2=0x7f7ea00b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 -- 172.21.15.5:0/213084558 shutdown_connections 2024-08-18T22:22:12.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.403+0000 7f7ea7200640 1 -- 172.21.15.5:0/213084558 wait complete. 2024-08-18T22:22:12.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:22:12.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.567+0000 7fb229800640 1 Processor -- start 2024-08-18T22:22:12.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.567+0000 7fb229800640 1 -- start start 2024-08-18T22:22:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.567+0000 7fb229800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb22406c9c0 0x7fb22415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.567+0000 7fb229800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2240ce240 con 0x7fb22406cda0 2024-08-18T22:22:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.567+0000 7fb229800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2240ce520 con 0x7fb224152ae0 2024-08-18T22:22:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.567+0000 7fb229800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb2240b5b80 con 0x7fb22406c9c0 2024-08-18T22:22:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.567+0000 7fb21a000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb22406cda0 0x7fb2240cd9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36348/0 (socket says 172.21.15.5:36348) 2024-08-18T22:22:12.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.567+0000 7fb21a000640 1 -- 172.21.15.5:0/1205079819 learned_addr learned my addr 172.21.15.5:0/1205079819 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:12.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.567+0000 7fb222a00640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb22406c9c0 0x7fb22415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3442296477 0 0) 0x7fb2240ce240 con 0x7fb22406cda0 2024-08-18T22:22:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb208003530 con 0x7fb22406cda0 2024-08-18T22:22:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1582710417 0 0) 0x7fb208003530 con 0x7fb22406cda0 2024-08-18T22:22:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb22406c9c0 msgr2=0x7fb22415c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb22406c9c0 0x7fb22415c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 >> v1:172.21.15.117:6789/0 conn(0x7fb224152ae0 legacy=0x7fb224152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2240ce800 con 0x7fb22406cda0 2024-08-18T22:22:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fb20c001680 con 0x7fb22406cda0 2024-08-18T22:22:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 >> v1:172.21.15.5:6789/0 conn(0x7fb22406cda0 legacy=0x7fb2240cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb22406c9c0 0x7fb2080039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb208003f30 0x7fb208004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb208004d50 0x7fb2080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb2240b5b80 con 0x7fb208004d50 2024-08-18T22:22:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb20800ba30 con 0x7fb208003f30 2024-08-18T22:22:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb20800bc30 con 0x7fb22406c9c0 2024-08-18T22:22:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb223400640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb208004d50 0x7fb2080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb222a00640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb22406c9c0 0x7fb2080039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb21a000640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb208003f30 0x7fb208004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb223400640 1 -- 172.21.15.5:0/1205079819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb22406c9c0 msgr2=0x7fb2080039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:12.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb223400640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb22406c9c0 0x7fb2080039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb223400640 1 -- 172.21.15.5:0/1205079819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb208003f30 msgr2=0x7fb208004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb223400640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb208003f30 0x7fb208004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.571+0000 7fb223400640 1 -- 172.21.15.5:0/1205079819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb208003530 con 0x7fb208004d50 2024-08-18T22:22:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb223400640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb208004d50 0x7fb2080051d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb21c001f60 tx=0x7fb21c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded71be47d77729e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0b2070 con 0x7fb208004d50 2024-08-18T22:22:12.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb21c0a5770 con 0x7fb208004d50 2024-08-18T22:22:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb222000640 1 -- 172.21.15.5:0/1205079819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c001b60 con 0x7fb208004d50 2024-08-18T22:22:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 -- 172.21.15.5:0/1205079819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb208004d50 msgr2=0x7fb2080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 --2- 172.21.15.5:0/1205079819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb208004d50 0x7fb2080051d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb21c001f60 tx=0x7fb21c01c880 comp rx=0 tx=0).stop 2024-08-18T22:22:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb223400640 1 -- 172.21.15.5:0/1205079819 reap_dead start 2024-08-18T22:22:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 -- 172.21.15.5:0/1205079819 shutdown_connections 2024-08-18T22:22:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 -- 172.21.15.5:0/1205079819 >> 172.21.15.5:0/1205079819 conn(0x7fb2240723e0 msgr2=0x7fb2240727f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 -- 172.21.15.5:0/1205079819 shutdown_connections 2024-08-18T22:22:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 -- 172.21.15.5:0/1205079819 wait complete. 2024-08-18T22:22:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 Processor -- start 2024-08-18T22:22:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 -- start start 2024-08-18T22:22:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb208004d50 0x7fb2241393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22414eb40 0x7fb22414a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb22414efc0 0x7fb22414a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb22406d1e0 con 0x7fb22414eb40 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb2240cedc0 con 0x7fb22414efc0 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb229800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb224139900 con 0x7fb208004d50 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.575+0000 7fb21a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22414eb40 0x7fb22414a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22414eb40 0x7fb22414a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41486/0 (socket says 172.21.15.5:41486) 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21a000640 1 -- 172.21.15.5:0/504404779 learned_addr learned my addr 172.21.15.5:0/504404779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb223400640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb22414efc0 0x7fb22414a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb222a00640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb208004d50 0x7fb2241393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21a000640 1 -- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb208004d50 msgr2=0x7fb2241393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21a000640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb208004d50 0x7fb2241393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21a000640 1 -- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb22414efc0 msgr2=0x7fb22414a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21a000640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb22414efc0 0x7fb22414a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21a000640 1 -- 172.21.15.5:0/504404779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22414daa0 con 0x7fb22414eb40 2024-08-18T22:22:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb222a00640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb208004d50 0x7fb2241393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21a000640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22414eb40 0x7fb22414a380 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb20c012510 tx=0x7fb20c0129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21b400640 1 -- 172.21.15.5:0/504404779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c01c070 con 0x7fb22414eb40 2024-08-18T22:22:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21b400640 1 -- 172.21.15.5:0/504404779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20c014770 con 0x7fb22414eb40 2024-08-18T22:22:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21b400640 1 -- 172.21.15.5:0/504404779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c014b60 con 0x7fb22414eb40 2024-08-18T22:22:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb229800640 1 -- 172.21.15.5:0/504404779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22414dd80 con 0x7fb22414eb40 2024-08-18T22:22:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb229800640 1 -- 172.21.15.5:0/504404779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22414e340 con 0x7fb22414eb40 2024-08-18T22:22:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb229800640 1 -- 172.21.15.5:0/504404779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb224136a00 con 0x7fb22414eb40 2024-08-18T22:22:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21b400640 1 -- 172.21.15.5:0/504404779 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb20c01f070 con 0x7fb22414eb40 2024-08-18T22:22:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21b400640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2000678f0 0x7fb200069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.579+0000 7fb21b400640 1 -- 172.21.15.5:0/504404779 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fb20c088770 con 0x7fb22414eb40 2024-08-18T22:22:12.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.583+0000 7fb222a00640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2000678f0 0x7fb200069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.583+0000 7fb222a00640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2000678f0 0x7fb200069db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb214009be0 tx=0x7fb214008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.583+0000 7fb21b400640 1 -- 172.21.15.5:0/504404779 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb224136a00 con 0x7fb22414eb40 2024-08-18T22:22:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:12.787+0000 7fb229800640 1 -- 172.21.15.5:0/504404779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb2240ce1a0 con 0x7fb22414eb40 2024-08-18T22:22:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb21b400640 1 -- 172.21.15.5:0/504404779 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7fb20c058a30 con 0x7fb22414eb40 2024-08-18T22:22:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb229800640 1 -- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2000678f0 msgr2=0x7fb200069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb229800640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2000678f0 0x7fb200069db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb214009be0 tx=0x7fb214008040 comp rx=0 tx=0).stop 2024-08-18T22:22:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb229800640 1 -- 172.21.15.5:0/504404779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22414eb40 msgr2=0x7fb22414a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb229800640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22414eb40 0x7fb22414a380 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb20c012510 tx=0x7fb20c0129d0 comp rx=0 tx=0).stop 2024-08-18T22:22:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb229800640 1 -- 172.21.15.5:0/504404779 shutdown_connections 2024-08-18T22:22:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb229800640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2000678f0 0x7fb200069db0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb229800640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb22414efc0 0x7fb22414a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb229800640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb22414eb40 0x7fb22414a380 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb229800640 1 --2- 172.21.15.5:0/504404779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb208004d50 0x7fb2241393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb229800640 1 -- 172.21.15.5:0/504404779 >> 172.21.15.5:0/504404779 conn(0x7fb2240723e0 msgr2=0x7fb2240b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.435+0000 7fb229800640 1 -- 172.21.15.5:0/504404779 shutdown_connections 2024-08-18T22:22:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.439+0000 7fb229800640 1 -- 172.21.15.5:0/504404779 wait complete. 2024-08-18T22:22:13.466 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:22:13.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:22:13.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca21600640 1 Processor -- start 2024-08-18T22:22:13.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca21600640 1 -- start start 2024-08-18T22:22:13.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca21600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca1c15fb80 0x7fca1c0d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:13.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca21600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fca1c0d1090 0x7fca1c071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:13.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca21600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c0d30b0 con 0x7fca1c0b5ad0 2024-08-18T22:22:13.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca21600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fca1c0d1eb0 con 0x7fca1c15fb80 2024-08-18T22:22:13.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca21600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fca1c0d1bd0 con 0x7fca1c0d1090 2024-08-18T22:22:13.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca1aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca1c15fb80 0x7fca1c0d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:13.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca1a000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fca1c0b5ad0 0x7fca1c06fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59296/0 (socket says 172.21.15.5:59296) 2024-08-18T22:22:13.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca1a000640 1 -- 172.21.15.5:0/2611429194 learned_addr learned my addr 172.21.15.5:0/2611429194 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:13.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca1aa00640 1 -- 172.21.15.5:0/2611429194 >> v2:172.21.15.117:3300/0 conn(0x7fca1c0d1090 msgr2=0x7fca1c071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:13.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca1aa00640 1 --2- 172.21.15.5:0/2611429194 >> v2:172.21.15.117:3300/0 conn(0x7fca1c0d1090 0x7fca1c071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:13.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca1aa00640 1 -- 172.21.15.5:0/2611429194 >> v1:172.21.15.5:6789/0 conn(0x7fca1c0b5ad0 legacy=0x7fca1c06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:13.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.615+0000 7fca1aa00640 1 -- 172.21.15.5:0/2611429194 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c0d2dd0 con 0x7fca1c15fb80 2024-08-18T22:22:13.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca1aa00640 1 --2- 172.21.15.5:0/2611429194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c15fb80 0x7fca1c0d15e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fca1c073ce0 tx=0x7fca0c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a039dbb3ee0d78 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:13.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca19600640 1 -- 172.21.15.5:0/2611429194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0b0070 con 0x7fca1c15fb80 2024-08-18T22:22:13.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca19600640 1 -- 172.21.15.5:0/2611429194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0c0ab600 con 0x7fca1c15fb80 2024-08-18T22:22:13.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca19600640 1 -- 172.21.15.5:0/2611429194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0ab9d0 con 0x7fca1c15fb80 2024-08-18T22:22:13.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca21600640 1 -- 172.21.15.5:0/2611429194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c15fb80 msgr2=0x7fca1c0d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:13.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca21600640 1 --2- 172.21.15.5:0/2611429194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c15fb80 0x7fca1c0d15e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fca1c073ce0 tx=0x7fca0c01c360 comp rx=0 tx=0).stop 2024-08-18T22:22:13.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca21600640 1 -- 172.21.15.5:0/2611429194 shutdown_connections 2024-08-18T22:22:13.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca21600640 1 --2- 172.21.15.5:0/2611429194 >> v2:172.21.15.117:3300/0 conn(0x7fca1c0d1090 0x7fca1c071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:13.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca21600640 1 --2- 172.21.15.5:0/2611429194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c15fb80 0x7fca1c0d15e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:13.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca21600640 1 -- 172.21.15.5:0/2611429194 >> 172.21.15.5:0/2611429194 conn(0x7fca1c0d2180 msgr2=0x7fca1c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:13.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca21600640 1 -- 172.21.15.5:0/2611429194 shutdown_connections 2024-08-18T22:22:13.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.619+0000 7fca21600640 1 -- 172.21.15.5:0/2611429194 wait complete. 2024-08-18T22:22:13.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca21600640 1 Processor -- start 2024-08-18T22:22:13.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca21600640 1 -- start start 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca21600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca1c0b5ad0 0x7fca1c147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca21600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0d1090 0x7fca1c1f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca21600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca1c15fb80 0x7fca1c15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca21600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c169270 con 0x7fca1c0d1090 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca21600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c1690f0 con 0x7fca1c0b5ad0 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca21600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fca1c1693f0 con 0x7fca1c15fb80 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0d1090 0x7fca1c1f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0d1090 0x7fca1c1f7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52778/0 (socket says 172.21.15.5:52778) 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1a000640 1 -- 172.21.15.5:0/132931357 learned_addr learned my addr 172.21.15.5:0/132931357 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1b400640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca1c15fb80 0x7fca1c15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1aa00640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca1c0b5ad0 0x7fca1c147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1a000640 1 -- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca1c15fb80 msgr2=0x7fca1c15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:13.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1a000640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca1c15fb80 0x7fca1c15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1a000640 1 -- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca1c0b5ad0 msgr2=0x7fca1c147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1a000640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca1c0b5ad0 0x7fca1c147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1a000640 1 -- 172.21.15.5:0/132931357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c15bb40 con 0x7fca1c0d1090 2024-08-18T22:22:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1b400640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca1c15fb80 0x7fca1c15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca1a000640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0d1090 0x7fca1c1f7640 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fca0800c420 tx=0x7fca0800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca12a00640 1 -- 172.21.15.5:0/132931357 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08017070 con 0x7fca1c0d1090 2024-08-18T22:22:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca12a00640 1 -- 172.21.15.5:0/132931357 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca08005cf0 con 0x7fca1c0d1090 2024-08-18T22:22:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca21600640 1 -- 172.21.15.5:0/132931357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1c15be20 con 0x7fca1c0d1090 2024-08-18T22:22:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca12a00640 1 -- 172.21.15.5:0/132931357 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080072f0 con 0x7fca1c0d1090 2024-08-18T22:22:13.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.623+0000 7fca21600640 1 -- 172.21.15.5:0/132931357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1c15c3e0 con 0x7fca1c0d1090 2024-08-18T22:22:13.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.627+0000 7fca21600640 1 -- 172.21.15.5:0/132931357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1c15c8c0 con 0x7fca1c0d1090 2024-08-18T22:22:13.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.627+0000 7fca12a00640 1 -- 172.21.15.5:0/132931357 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fca0801a070 con 0x7fca1c0d1090 2024-08-18T22:22:13.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.627+0000 7fca12a00640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9fc0678f0 0x7fc9fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:13.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.627+0000 7fca12a00640 1 -- 172.21.15.5:0/132931357 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fca08085200 con 0x7fca1c0d1090 2024-08-18T22:22:13.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.627+0000 7fca1aa00640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9fc0678f0 0x7fc9fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:13.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.627+0000 7fca1aa00640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9fc0678f0 0x7fc9fc069db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0ad000 tx=0x7fca0c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:13.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.631+0000 7fca12a00640 1 -- 172.21.15.5:0/132931357 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fca1c15c8c0 con 0x7fca1c0d1090 2024-08-18T22:22:13.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:13.831+0000 7fca21600640 1 -- 172.21.15.5:0/132931357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fca1c071550 con 0x7fca1c0d1090 2024-08-18T22:22:14.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.439+0000 7fca12a00640 1 -- 172.21.15.5:0/132931357 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fca08055ba0 con 0x7fca1c0d1090 2024-08-18T22:22:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 -- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9fc0678f0 msgr2=0x7fc9fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9fc0678f0 0x7fc9fc069db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0ad000 tx=0x7fca0c0a6000 comp rx=0 tx=0).stop 2024-08-18T22:22:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 -- 172.21.15.5:0/132931357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0d1090 msgr2=0x7fca1c1f7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0d1090 0x7fca1c1f7640 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fca0800c420 tx=0x7fca0800c8e0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 -- 172.21.15.5:0/132931357 shutdown_connections 2024-08-18T22:22:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9fc0678f0 0x7fc9fc069db0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca1c15fb80 0x7fca1c15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0d1090 0x7fca1c1f7640 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 --2- 172.21.15.5:0/132931357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca1c0b5ad0 0x7fca1c147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 -- 172.21.15.5:0/132931357 >> 172.21.15.5:0/132931357 conn(0x7fca1c0d2180 msgr2=0x7fca1c0d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 -- 172.21.15.5:0/132931357 shutdown_connections 2024-08-18T22:22:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.443+0000 7fca21600640 1 -- 172.21.15.5:0/132931357 wait complete. 2024-08-18T22:22:14.471 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:22:14.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:22:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.611+0000 7fe47b200640 1 Processor -- start 2024-08-18T22:22:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.611+0000 7fe47b200640 1 -- start start 2024-08-18T22:22:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe47b200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe47c0cde30 0x7fe47c15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe47b200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe47c0b4510 0x7fe47c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe47b200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47c0ccd90 con 0x7fe47c09aa40 2024-08-18T22:22:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe47b200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe47c0ce770 con 0x7fe47c0cde30 2024-08-18T22:22:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe47b200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe47c15d520 con 0x7fe47c0b4510 2024-08-18T22:22:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe471400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe47c0cde30 0x7fe47c15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe471400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe47c0cde30 0x7fe47c15cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52794/0 (socket says 172.21.15.5:52794) 2024-08-18T22:22:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe471400640 1 -- 172.21.15.5:0/703033255 learned_addr learned my addr 172.21.15.5:0/703033255 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe471400640 1 -- 172.21.15.5:0/703033255 >> v2:172.21.15.117:3300/0 conn(0x7fe47c0b4510 msgr2=0x7fe47c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe471400640 1 --2- 172.21.15.5:0/703033255 >> v2:172.21.15.117:3300/0 conn(0x7fe47c0b4510 0x7fe47c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe471400640 1 -- 172.21.15.5:0/703033255 >> v1:172.21.15.5:6789/0 conn(0x7fe47c09aa40 legacy=0x7fe47c09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:14.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.615+0000 7fe471400640 1 -- 172.21.15.5:0/703033255 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47c0cd070 con 0x7fe47c0cde30 2024-08-18T22:22:14.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe471400640 1 --2- 172.21.15.5:0/703033255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0cde30 0x7fe47c15cfe0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0739f0 tx=0x7fe46401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0f9358eae7d232 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe479400640 1 -- 172.21.15.5:0/703033255 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4640aa650 con 0x7fe47c0cde30 2024-08-18T22:22:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe479400640 1 -- 172.21.15.5:0/703033255 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4640af070 con 0x7fe47c0cde30 2024-08-18T22:22:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe479400640 1 -- 172.21.15.5:0/703033255 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4640aaa10 con 0x7fe47c0cde30 2024-08-18T22:22:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 -- 172.21.15.5:0/703033255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0cde30 msgr2=0x7fe47c15cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 --2- 172.21.15.5:0/703033255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0cde30 0x7fe47c15cfe0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0739f0 tx=0x7fe46401c4f0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 -- 172.21.15.5:0/703033255 shutdown_connections 2024-08-18T22:22:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 --2- 172.21.15.5:0/703033255 >> v2:172.21.15.117:3300/0 conn(0x7fe47c0b4510 0x7fe47c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 --2- 172.21.15.5:0/703033255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0cde30 0x7fe47c15cfe0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 -- 172.21.15.5:0/703033255 >> 172.21.15.5:0/703033255 conn(0x7fe47c0b3a20 msgr2=0x7fe47c0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 -- 172.21.15.5:0/703033255 shutdown_connections 2024-08-18T22:22:14.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 -- 172.21.15.5:0/703033255 wait complete. 2024-08-18T22:22:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 Processor -- start 2024-08-18T22:22:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 -- start start 2024-08-18T22:22:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c09aa40 0x7fe47c1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c0b4510 0x7fe47c1fb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0cde30 0x7fe47c0b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c15c3b0 con 0x7fe47c0cde30 2024-08-18T22:22:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c15c230 con 0x7fe47c09aa40 2024-08-18T22:22:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.619+0000 7fe47b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe47c168e40 con 0x7fe47c0b4510 2024-08-18T22:22:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0cde30 0x7fe47c0b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0cde30 0x7fe47c0b5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52808/0 (socket says 172.21.15.5:52808) 2024-08-18T22:22:14.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47a800640 1 -- 172.21.15.5:0/2963680656 learned_addr learned my addr 172.21.15.5:0/2963680656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:14.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe471400640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c0b4510 0x7fe47c1fb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:14.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe479e00640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c09aa40 0x7fe47c1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:14.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47a800640 1 -- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c0b4510 msgr2=0x7fe47c1fb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:14.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47a800640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c0b4510 0x7fe47c1fb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47a800640 1 -- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c09aa40 msgr2=0x7fe47c1576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:14.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47a800640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c09aa40 0x7fe47c1576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47a800640 1 -- 172.21.15.5:0/2963680656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47c0b02c0 con 0x7fe47c0cde30 2024-08-18T22:22:14.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47a800640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0cde30 0x7fe47c0b5690 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe47400b970 tx=0x7fe47400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:14.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe472a00640 1 -- 172.21.15.5:0/2963680656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474019070 con 0x7fe47c0cde30 2024-08-18T22:22:14.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe472a00640 1 -- 172.21.15.5:0/2963680656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47400cb60 con 0x7fe47c0cde30 2024-08-18T22:22:14.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47b200640 1 -- 172.21.15.5:0/2963680656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47c0b05a0 con 0x7fe47c0cde30 2024-08-18T22:22:14.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe472a00640 1 -- 172.21.15.5:0/2963680656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474014440 con 0x7fe47c0cde30 2024-08-18T22:22:14.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47b200640 1 -- 172.21.15.5:0/2963680656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe47c0b0b60 con 0x7fe47c0cde30 2024-08-18T22:22:14.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe47b200640 1 -- 172.21.15.5:0/2963680656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe47c0cfb00 con 0x7fe47c0cde30 2024-08-18T22:22:14.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.623+0000 7fe472a00640 1 -- 172.21.15.5:0/2963680656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe47401c070 con 0x7fe47c0cde30 2024-08-18T22:22:14.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.627+0000 7fe472a00640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4580678c0 0x7fe458069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:14.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.627+0000 7fe472a00640 1 -- 172.21.15.5:0/2963680656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fe474085b00 con 0x7fe47c0cde30 2024-08-18T22:22:14.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.627+0000 7fe479e00640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4580678c0 0x7fe458069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:14.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.627+0000 7fe479e00640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4580678c0 0x7fe458069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe46c001810 tx=0x7fe46c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:14.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.631+0000 7fe472a00640 1 -- 172.21.15.5:0/2963680656 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe474055e50 con 0x7fe47c0cde30 2024-08-18T22:22:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 -- 172.21.15.5:0/2963680656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe47c0ce510 con 0x7fe47c0cde30 2024-08-18T22:22:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe472a00640 1 -- 172.21.15.5:0/2963680656 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5220 (secure 0 0 0) 0x7fe474085e20 con 0x7fe47c0cde30 2024-08-18T22:22:14.835 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:14.835 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"btime":"2024-08-18T22:22:14:439692+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3185015921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3185015921},{"type":"v1","addr":"172.21.15.117:6837","nonce":3185015921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3679281629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3679281629},{"type":"v1","addr":"172.21.15.117:6836","nonce":3679281629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/649845928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":649845928},{"type":"v1","addr":"172.21.15.5:6833","nonce":649845928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:22:10.822677+0000","modified":"2024-08-18T22:22:13.837029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3590404197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3590404197},{"type":"v1","addr":"172.21.15.5:6835","nonce":3590404197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5370,"qdb_cluster":[5370]},"id":3}]} 2024-08-18T22:22:14.835 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2024-08-18T22:22:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 -- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4580678c0 msgr2=0x7fe458069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4580678c0 0x7fe458069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe46c001810 tx=0x7fe46c009040 comp rx=0 tx=0).stop 2024-08-18T22:22:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 -- 172.21.15.5:0/2963680656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0cde30 msgr2=0x7fe47c0b5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0cde30 0x7fe47c0b5690 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe47400b970 tx=0x7fe47400be30 comp rx=0 tx=0).stop 2024-08-18T22:22:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 -- 172.21.15.5:0/2963680656 shutdown_connections 2024-08-18T22:22:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4580678c0 0x7fe458069d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe47c0cde30 0x7fe47c0b5690 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c0b4510 0x7fe47c1fb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 --2- 172.21.15.5:0/2963680656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c09aa40 0x7fe47c1576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 -- 172.21.15.5:0/2963680656 >> 172.21.15.5:0/2963680656 conn(0x7fe47c0b3a20 msgr2=0x7fe47c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 -- 172.21.15.5:0/2963680656 shutdown_connections 2024-08-18T22:22:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.831+0000 7fe47b200640 1 -- 172.21.15.5:0/2963680656 wait complete. 2024-08-18T22:22:14.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:22:14.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.991+0000 7f86c9000640 1 Processor -- start 2024-08-18T22:22:14.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.991+0000 7f86c9000640 1 -- start start 2024-08-18T22:22:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86c9000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86c4161960 0x7f86c406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86c9000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86c4070730 0x7f86c4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86c9000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c415eb60 con 0x7f86c415dda0 2024-08-18T22:22:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86c9000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f86c40710e0 con 0x7f86c4070730 2024-08-18T22:22:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86c9000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f86c415e940 con 0x7f86c4161960 2024-08-18T22:22:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86bbe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86c4070730 0x7f86c4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86bbe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86c4070730 0x7f86c4070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52812/0 (socket says 172.21.15.5:52812) 2024-08-18T22:22:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86bbe00640 1 -- 172.21.15.5:0/3086131008 learned_addr learned my addr 172.21.15.5:0/3086131008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86c1e00640 1 --2- 172.21.15.5:0/3086131008 >> v2:172.21.15.117:3300/0 conn(0x7f86c4161960 0x7f86c406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86bbe00640 1 -- 172.21.15.5:0/3086131008 >> v2:172.21.15.117:3300/0 conn(0x7f86c4161960 msgr2=0x7f86c406fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:15.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86bbe00640 1 --2- 172.21.15.5:0/3086131008 >> v2:172.21.15.117:3300/0 conn(0x7f86c4161960 0x7f86c406fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86bbe00640 1 -- 172.21.15.5:0/3086131008 >> v1:172.21.15.117:6789/0 conn(0x7f86c415dda0 legacy=0x7f86c415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.995+0000 7f86bbe00640 1 -- 172.21.15.5:0/3086131008 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c415ee40 con 0x7f86c4070730 2024-08-18T22:22:15.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86bbe00640 1 --2- 172.21.15.5:0/3086131008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c4070730 0x7f86c4070ba0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f86c4073070 tx=0x7f86ac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4f50f9b15fc018 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:15.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c1400640 1 -- 172.21.15.5:0/3086131008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0b0070 con 0x7f86c4070730 2024-08-18T22:22:15.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c1400640 1 -- 172.21.15.5:0/3086131008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ac0ab600 con 0x7f86c4070730 2024-08-18T22:22:15.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c1400640 1 -- 172.21.15.5:0/3086131008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0ab9d0 con 0x7f86c4070730 2024-08-18T22:22:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c9000640 1 -- 172.21.15.5:0/3086131008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c4070730 msgr2=0x7f86c4070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c9000640 1 --2- 172.21.15.5:0/3086131008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c4070730 0x7f86c4070ba0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f86c4073070 tx=0x7f86ac01c520 comp rx=0 tx=0).stop 2024-08-18T22:22:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c9000640 1 -- 172.21.15.5:0/3086131008 shutdown_connections 2024-08-18T22:22:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c9000640 1 --2- 172.21.15.5:0/3086131008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c4070730 0x7f86c4070ba0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c9000640 1 --2- 172.21.15.5:0/3086131008 >> v2:172.21.15.117:3300/0 conn(0x7f86c4161960 0x7f86c406fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c9000640 1 -- 172.21.15.5:0/3086131008 >> 172.21.15.5:0/3086131008 conn(0x7f86c40d2130 msgr2=0x7f86c40d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:15.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c9000640 1 -- 172.21.15.5:0/3086131008 shutdown_connections 2024-08-18T22:22:15.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c9000640 1 -- 172.21.15.5:0/3086131008 wait complete. 2024-08-18T22:22:15.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c9000640 1 Processor -- start 2024-08-18T22:22:15.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:14.999+0000 7f86c9000640 1 -- start start 2024-08-18T22:22:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c4070730 0x7f86c41583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c9000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c415dda0 0x7f86c40aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c4161960 0x7f86c40cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c9000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f86c409ba30 con 0x7f86c4070730 2024-08-18T22:22:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c9000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86c4070260 con 0x7f86c415dda0 2024-08-18T22:22:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c9000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f86c40c9ff0 con 0x7f86c4161960 2024-08-18T22:22:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c4070730 0x7f86c41583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c4070730 0x7f86c41583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52822/0 (socket says 172.21.15.5:52822) 2024-08-18T22:22:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c1e00640 1 -- 172.21.15.5:0/1317484184 learned_addr learned my addr 172.21.15.5:0/1317484184 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86bbe00640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c415dda0 0x7f86c40aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c2800640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c4161960 0x7f86c40cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c1e00640 1 -- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c4161960 msgr2=0x7f86c40cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c1e00640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c4161960 0x7f86c40cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c1e00640 1 -- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c415dda0 msgr2=0x7f86c40aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c1e00640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c415dda0 0x7f86c40aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c1e00640 1 -- 172.21.15.5:0/1317484184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c40ca240 con 0x7f86c4070730 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86bbe00640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c415dda0 0x7f86c40aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c1e00640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c4070730 0x7f86c41583e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f86b400e870 tx=0x7f86b400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86ba000640 1 -- 172.21.15.5:0/1317484184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b4017070 con 0x7f86c4070730 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86ba000640 1 -- 172.21.15.5:0/1317484184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b400c940 con 0x7f86c4070730 2024-08-18T22:22:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86ba000640 1 -- 172.21.15.5:0/1317484184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b400ccf0 con 0x7f86c4070730 2024-08-18T22:22:15.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c9000640 1 -- 172.21.15.5:0/1317484184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c40ca520 con 0x7f86c4070730 2024-08-18T22:22:15.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c9000640 1 -- 172.21.15.5:0/1317484184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c40af4a0 con 0x7f86c4070730 2024-08-18T22:22:15.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86c9000640 1 -- 172.21.15.5:0/1317484184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c40af790 con 0x7f86c4070730 2024-08-18T22:22:15.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.003+0000 7f86ba000640 1 -- 172.21.15.5:0/1317484184 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86b401a070 con 0x7f86c4070730 2024-08-18T22:22:15.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.007+0000 7f86ba000640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86a00678f0 0x7f86a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.007+0000 7f86ba000640 1 -- 172.21.15.5:0/1317484184 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f86b40860a0 con 0x7f86c4070730 2024-08-18T22:22:15.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.007+0000 7f86bbe00640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86a00678f0 0x7f86a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.007+0000 7f86bbe00640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86a00678f0 0x7f86a0069db0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0ad000 tx=0x7f86ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:15.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.011+0000 7f86ba000640 1 -- 172.21.15.5:0/1317484184 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f86b4056a40 con 0x7f86c4070730 2024-08-18T22:22:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.179+0000 7f86c9000640 1 -- 172.21.15.5:0/1317484184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86c4070ba0 con 0x7f86c4070730 2024-08-18T22:22:15.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.179+0000 7f86ba000640 1 -- 172.21.15.5:0/1317484184 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+16870 (secure 0 0 0) 0x7f86b4056340 con 0x7f86c4070730 2024-08-18T22:22:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:15.184 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:22:12.427264+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:22:08.577033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-08-18T22:22:09.824932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:22:15.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 -- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86a00678f0 msgr2=0x7f86a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86a00678f0 0x7f86a0069db0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0ad000 tx=0x7f86ac008040 comp rx=0 tx=0).stop 2024-08-18T22:22:15.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 -- 172.21.15.5:0/1317484184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c4070730 msgr2=0x7f86c41583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c4070730 0x7f86c41583e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f86b400e870 tx=0x7f86b400ec70 comp rx=0 tx=0).stop 2024-08-18T22:22:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 -- 172.21.15.5:0/1317484184 shutdown_connections 2024-08-18T22:22:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86a00678f0 0x7f86a0069db0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86c4161960 0x7f86c40cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86c415dda0 0x7f86c40aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 --2- 172.21.15.5:0/1317484184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c4070730 0x7f86c41583e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 -- 172.21.15.5:0/1317484184 >> 172.21.15.5:0/1317484184 conn(0x7f86c40d2130 msgr2=0x7f86c40d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 -- 172.21.15.5:0/1317484184 shutdown_connections 2024-08-18T22:22:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.183+0000 7f86c9000640 1 -- 172.21.15.5:0/1317484184 wait complete. 2024-08-18T22:22:15.206 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:22:15.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:22:15.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc659600640 1 Processor -- start 2024-08-18T22:22:15.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc659600640 1 -- start start 2024-08-18T22:22:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc659600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6540c6850 0x7fc65406e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc659600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc654068a70 0x7fc65406e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc659600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc65415f820 con 0x7fc65415b010 2024-08-18T22:22:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc659600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc6540afbb0 con 0x7fc654068a70 2024-08-18T22:22:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc659600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc6540cda90 con 0x7fc6540c6850 2024-08-18T22:22:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc65415b010 0x7fc6540c6140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59318/0 (socket says 172.21.15.5:59318) 2024-08-18T22:22:15.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653e00640 1 -- 172.21.15.5:0/1048162323 learned_addr learned my addr 172.21.15.5:0/1048162323 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc658c00640 1 --2- 172.21.15.5:0/1048162323 >> v2:172.21.15.117:3300/0 conn(0x7fc654068a70 0x7fc65406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc64b400640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6540c6850 0x7fc65406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146184157 0 0) 0x7fc65415f820 con 0x7fc65415b010 2024-08-18T22:22:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc638003530 con 0x7fc65415b010 2024-08-18T22:22:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 420964187 0 0) 0x7fc638003530 con 0x7fc65415b010 2024-08-18T22:22:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6540c6850 msgr2=0x7fc65406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6540c6850 0x7fc65406e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 >> v2:172.21.15.117:3300/0 conn(0x7fc654068a70 msgr2=0x7fc65406e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 --2- 172.21.15.5:0/1048162323 >> v2:172.21.15.117:3300/0 conn(0x7fc654068a70 0x7fc65406e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65415fb50 con 0x7fc65415b010 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fc644001680 con 0x7fc65415b010 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 >> v1:172.21.15.5:6789/0 conn(0x7fc65415b010 legacy=0x7fc6540c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6540c6850 0x7fc6380039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc638003f40 0x7fc638004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc638004d50 0x7fc6380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc6540afbb0 con 0x7fc638004d50 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc6540cda90 con 0x7fc638003f40 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc63800dbe0 con 0x7fc6540c6850 2024-08-18T22:22:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc658c00640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc638004d50 0x7fc6380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653e00640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6540c6850 0x7fc6380039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc64b400640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc638003f40 0x7fc638004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc658c00640 1 -- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6540c6850 msgr2=0x7fc6380039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc658c00640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6540c6850 0x7fc6380039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc658c00640 1 -- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc638003f40 msgr2=0x7fc638004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc658c00640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc638003f40 0x7fc638004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc658c00640 1 -- 172.21.15.5:0/1048162323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc638003530 con 0x7fc638004d50 2024-08-18T22:22:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.343+0000 7fc653e00640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6540c6850 0x7fc6380039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.347+0000 7fc658c00640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc638004d50 0x7fc6380051d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009fc0 tx=0x7fc64c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e42a8eadbb782cf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.347+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c0b2070 con 0x7fc638004d50 2024-08-18T22:22:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.347+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64c0a5cd0 con 0x7fc638004d50 2024-08-18T22:22:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.347+0000 7fc653400640 1 -- 172.21.15.5:0/1048162323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c009c10 con 0x7fc638004d50 2024-08-18T22:22:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.347+0000 7fc659600640 1 -- 172.21.15.5:0/1048162323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc638004d50 msgr2=0x7fc6380051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.347+0000 7fc659600640 1 --2- 172.21.15.5:0/1048162323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc638004d50 0x7fc6380051d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009fc0 tx=0x7fc64c01cc60 comp rx=0 tx=0).stop 2024-08-18T22:22:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.347+0000 7fc658c00640 1 -- 172.21.15.5:0/1048162323 reap_dead start 2024-08-18T22:22:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.347+0000 7fc659600640 1 -- 172.21.15.5:0/1048162323 shutdown_connections 2024-08-18T22:22:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.347+0000 7fc659600640 1 -- 172.21.15.5:0/1048162323 >> 172.21.15.5:0/1048162323 conn(0x7fc6540ccbf0 msgr2=0x7fc6540cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.347+0000 7fc659600640 1 -- 172.21.15.5:0/1048162323 shutdown_connections 2024-08-18T22:22:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.347+0000 7fc659600640 1 -- 172.21.15.5:0/1048162323 wait complete. 2024-08-18T22:22:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc659600640 1 Processor -- start 2024-08-18T22:22:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc659600640 1 -- start start 2024-08-18T22:22:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc659600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc654152240 0x7fc6540b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc659600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654152620 0x7fc6540cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc659600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc654152b00 0x7fc6540c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc659600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc65415b3f0 con 0x7fc654152b00 2024-08-18T22:22:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc659600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc6540cd710 con 0x7fc654152620 2024-08-18T22:22:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc659600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc65415b570 con 0x7fc654152240 2024-08-18T22:22:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc658c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc654152b00 0x7fc6540c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc658c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc654152b00 0x7fc6540c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52832/0 (socket says 172.21.15.5:52832) 2024-08-18T22:22:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc658c00640 1 -- 172.21.15.5:0/439450269 learned_addr learned my addr 172.21.15.5:0/439450269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc658c00640 1 -- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc654152240 msgr2=0x7fc6540b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc658c00640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc654152240 0x7fc6540b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc658c00640 1 -- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654152620 msgr2=0x7fc6540cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc658c00640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654152620 0x7fc6540cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc658c00640 1 -- 172.21.15.5:0/439450269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6540b4b80 con 0x7fc654152b00 2024-08-18T22:22:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc658c00640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc654152b00 0x7fc6540c7dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0b0040 tx=0x7fc64c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc650c00640 1 -- 172.21.15.5:0/439450269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c0bd070 con 0x7fc654152b00 2024-08-18T22:22:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc650c00640 1 -- 172.21.15.5:0/439450269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64c0a5ad0 con 0x7fc654152b00 2024-08-18T22:22:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc650c00640 1 -- 172.21.15.5:0/439450269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c0b2040 con 0x7fc654152b00 2024-08-18T22:22:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc659600640 1 -- 172.21.15.5:0/439450269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6540b4e20 con 0x7fc654152b00 2024-08-18T22:22:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc659600640 1 -- 172.21.15.5:0/439450269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6540b53e0 con 0x7fc654152b00 2024-08-18T22:22:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.351+0000 7fc659600640 1 -- 172.21.15.5:0/439450269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6540af250 con 0x7fc654152b00 2024-08-18T22:22:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.355+0000 7fc650c00640 1 -- 172.21.15.5:0/439450269 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc64c0c0070 con 0x7fc654152b00 2024-08-18T22:22:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.355+0000 7fc650c00640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6300678c0 0x7fc630069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.355+0000 7fc650c00640 1 -- 172.21.15.5:0/439450269 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fc64c11f9f0 con 0x7fc654152b00 2024-08-18T22:22:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.355+0000 7fc653e00640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6300678c0 0x7fc630069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.355+0000 7fc653e00640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6300678c0 0x7fc630069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc644000c10 tx=0x7fc644001e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.359+0000 7fc650c00640 1 -- 172.21.15.5:0/439450269 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc64c0169d0 con 0x7fc654152b00 2024-08-18T22:22:15.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.527+0000 7fc659600640 1 -- 172.21.15.5:0/439450269 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc65406e390 con 0x7fc6300678c0 2024-08-18T22:22:15.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc650c00640 1 -- 172.21.15.5:0/439450269 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238904 (secure 0 0 0) 0x7fc65406e390 con 0x7fc6300678c0 2024-08-18T22:22:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:15.544 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:22:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 -- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6300678c0 msgr2=0x7fc630069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6300678c0 0x7fc630069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc644000c10 tx=0x7fc644001e40 comp rx=0 tx=0).stop 2024-08-18T22:22:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 -- 172.21.15.5:0/439450269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc654152b00 msgr2=0x7fc6540c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc654152b00 0x7fc6540c7dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0b0040 tx=0x7fc64c009750 comp rx=0 tx=0).stop 2024-08-18T22:22:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 -- 172.21.15.5:0/439450269 shutdown_connections 2024-08-18T22:22:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6300678c0 0x7fc630069d80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc654152b00 0x7fc6540c7dd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654152620 0x7fc6540cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 --2- 172.21.15.5:0/439450269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc654152240 0x7fc6540b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 -- 172.21.15.5:0/439450269 >> 172.21.15.5:0/439450269 conn(0x7fc6540ccbf0 msgr2=0x7fc6540ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 -- 172.21.15.5:0/439450269 shutdown_connections 2024-08-18T22:22:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.539+0000 7fc659600640 1 -- 172.21.15.5:0/439450269 wait complete. 2024-08-18T22:22:15.563 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-18T22:22:13.659394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":292720,"kb_used_data":5808,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754682000,"statfs":{"total":773094113280,"available":772794368000,"internally_reserved":0,"allocated":5947392,"data_stored":3286742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.250669"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.420920+0000","last_change":"2024-08-18T22:22:10.420920+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.420920+0000","last_undegraded":"2024-08-18T22:22:10.420920+0000","last_fullsized":"2024-08-18T22:22:10.420920+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.423965+0000","last_change":"2024-08-18T22:22:10.423965+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.423965+0000","last_undegraded":"2024-08-18T22:22:10.423965+0000","last_fullsized":"2024-08-18T22:22:10.423965+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.422243+0000","last_change":"2024-08-18T22:22:10.422243+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.422243+0000","last_undegraded":"2024-08-18T22:22:10.422243+0000","last_fullsized":"2024-08-18T22:22:10.422243+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421708+0000","last_change":"2024-08-18T22:22:10.421708+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421708+0000","last_undegraded":"2024-08-18T22:22:10.421708+0000","last_fullsized":"2024-08-18T22:22:10.421708+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.434867+0000","last_change":"2024-08-18T22:22:10.430868+0000","last_active":"2024-08-18T22:22:10.434867+0000","last_peered":"2024-08-18T22:22:10.434867+0000","last_clean":"2024-08-18T22:22:10.434867+0000","last_became_active":"2024-08-18T22:22:10.430580+0000","last_became_peered":"2024-08-18T22:22:10.430580+0000","last_unstale":"2024-08-18T22:22:10.434867+0000","last_undegraded":"2024-08-18T22:22:10.434867+0000","last_fullsized":"2024-08-18T22:22:10.434867+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:31:35.633828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421236+0000","last_change":"2024-08-18T22:22:10.421236+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421236+0000","last_undegraded":"2024-08-18T22:22:10.421236+0000","last_fullsized":"2024-08-18T22:22:10.421236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.436265+0000","last_change":"2024-08-18T22:22:10.434830+0000","last_active":"2024-08-18T22:22:10.436265+0000","last_peered":"2024-08-18T22:22:10.436265+0000","last_clean":"2024-08-18T22:22:10.436265+0000","last_became_active":"2024-08-18T22:22:10.434370+0000","last_became_peered":"2024-08-18T22:22:10.434370+0000","last_unstale":"2024-08-18T22:22:10.436265+0000","last_undegraded":"2024-08-18T22:22:10.436265+0000","last_fullsized":"2024-08-18T22:22:10.436265+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:32:11.671929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.420415+0000","last_change":"2024-08-18T22:22:10.420415+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.420415+0000","last_undegraded":"2024-08-18T22:22:10.420415+0000","last_fullsized":"2024-08-18T22:22:10.420415+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.445295+0000","last_change":"2024-08-18T22:22:10.434500+0000","last_active":"2024-08-18T22:22:10.445295+0000","last_peered":"2024-08-18T22:22:10.445295+0000","last_clean":"2024-08-18T22:22:10.445295+0000","last_became_active":"2024-08-18T22:22:10.431542+0000","last_became_peered":"2024-08-18T22:22:10.431542+0000","last_unstale":"2024-08-18T22:22:10.445295+0000","last_undegraded":"2024-08-18T22:22:10.445295+0000","last_fullsized":"2024-08-18T22:22:10.445295+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:43.691497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421963+0000","last_change":"2024-08-18T22:22:10.421963+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421963+0000","last_undegraded":"2024-08-18T22:22:10.421963+0000","last_fullsized":"2024-08-18T22:22:10.421963+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.444995+0000","last_change":"2024-08-18T22:22:10.435989+0000","last_active":"2024-08-18T22:22:10.444995+0000","last_peered":"2024-08-18T22:22:10.444995+0000","last_clean":"2024-08-18T22:22:10.444995+0000","last_became_active":"2024-08-18T22:22:10.435491+0000","last_became_peered":"2024-08-18T22:22:10.435491+0000","last_unstale":"2024-08-18T22:22:10.444995+0000","last_undegraded":"2024-08-18T22:22:10.444995+0000","last_fullsized":"2024-08-18T22:22:10.444995+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:25:42.535149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.435850+0000","last_change":"2024-08-18T22:22:10.434323+0000","last_active":"2024-08-18T22:22:10.435850+0000","last_peered":"2024-08-18T22:22:10.435850+0000","last_clean":"2024-08-18T22:22:10.435850+0000","last_became_active":"2024-08-18T22:22:10.433352+0000","last_became_peered":"2024-08-18T22:22:10.433352+0000","last_unstale":"2024-08-18T22:22:10.435850+0000","last_undegraded":"2024-08-18T22:22:10.435850+0000","last_fullsized":"2024-08-18T22:22:10.435850+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:13:48.107104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:10.407943+0000","last_change":"2024-08-18T22:22:10.407943+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.407943+0000","last_undegraded":"2024-08-18T22:22:10.407943+0000","last_fullsized":"2024-08-18T22:22:10.407943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:22:09.404164+0000","last_change":"2024-08-18T22:22:09.404164+0000","last_active":"2024-08-18T22:22:09.404164+0000","last_peered":"2024-08-18T22:22:09.404164+0000","last_clean":"2024-08-18T22:22:09.404164+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:09.404164+0000","last_undegraded":"2024-08-18T22:22:09.404164+0000","last_fullsized":"2024-08-18T22:22:09.404164+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":231,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-08-18T22:22:07.409091+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:22:07.409091+0000","last_peered":"2024-08-18T22:22:07.409091+0000","last_clean":"2024-08-18T22:22:07.409091+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:22:07.409091+0000","last_undegraded":"2024-08-18T22:22:07.409091+0000","last_fullsized":"2024-08-18T22:22:07.409091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1191936,"data_stored":854826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35912,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335928,"statfs":{"total":96636764160,"available":96599990272,"internally_reserved":0,"allocated":585728,"data_stored":258939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35912,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335928,"statfs":{"total":96636764160,"available":96599990272,"internally_reserved":0,"allocated":585728,"data_stored":258939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40072,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331768,"statfs":{"total":96636764160,"available":96595730432,"internally_reserved":0,"allocated":585728,"data_stored":258939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35932,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335908,"statfs":{"total":96636764160,"available":96599969792,"internally_reserved":0,"allocated":598016,"data_stored":264458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40656,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331184,"statfs":{"total":96636764160,"available":96595132416,"internally_reserved":0,"allocated":1179648,"data_stored":849307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":610304,"data_stored":270667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35936,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335904,"statfs":{"total":96636764160,"available":96599965696,"internally_reserved":0,"allocated":610304,"data_stored":270667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:22:15.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:22:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb176a00640 1 Processor -- start 2024-08-18T22:22:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb176a00640 1 -- start start 2024-08-18T22:22:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb176a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb17006fad0 0x7fb1700b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb176a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1700b5e30 con 0x7fb170071c90 2024-08-18T22:22:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb176a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1700b6110 con 0x7fb17015c180 2024-08-18T22:22:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb176a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb1700b63f0 con 0x7fb17006fad0 2024-08-18T22:22:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb167e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb170071c90 0x7fb1700d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59324/0 (socket says 172.21.15.5:59324) 2024-08-18T22:22:15.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb167e00640 1 -- 172.21.15.5:0/1742316110 learned_addr learned my addr 172.21.15.5:0/1742316110 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb174a00640 1 --2- 172.21.15.5:0/1742316110 >> v2:172.21.15.117:3300/0 conn(0x7fb17006fad0 0x7fb1700b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3588285543 0 0) 0x7fb1700b5e30 con 0x7fb170071c90 2024-08-18T22:22:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb154003530 con 0x7fb170071c90 2024-08-18T22:22:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1389780142 0 0) 0x7fb154003530 con 0x7fb170071c90 2024-08-18T22:22:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 >> v2:172.21.15.117:3300/0 conn(0x7fb17006fad0 msgr2=0x7fb1700b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 --2- 172.21.15.5:0/1742316110 >> v2:172.21.15.117:3300/0 conn(0x7fb17006fad0 0x7fb1700b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 >> v1:172.21.15.117:6789/0 conn(0x7fb17015c180 legacy=0x7fb170071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1700b66d0 con 0x7fb170071c90 2024-08-18T22:22:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fb158001680 con 0x7fb170071c90 2024-08-18T22:22:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 >> v1:172.21.15.5:6789/0 conn(0x7fb170071c90 legacy=0x7fb1700d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 --2- 172.21.15.5:0/1742316110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1540039c0 0x7fb154003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 --2- 172.21.15.5:0/1742316110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb154004810 0x7fb154004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 --2- 172.21.15.5:0/1742316110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 0x7fb15400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700b63f0 con 0x7fb1540052f0 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb15400c1c0 con 0x7fb154004810 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb15400c3c0 con 0x7fb1540039c0 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb174a00640 1 --2- 172.21.15.5:0/1742316110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 0x7fb15400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb16fe00640 1 --2- 172.21.15.5:0/1742316110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1540039c0 0x7fb154003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb167e00640 1 --2- 172.21.15.5:0/1742316110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb154004810 0x7fb154004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb174a00640 1 -- 172.21.15.5:0/1742316110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1540039c0 msgr2=0x7fb154003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb174a00640 1 --2- 172.21.15.5:0/1742316110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1540039c0 0x7fb154003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb174a00640 1 -- 172.21.15.5:0/1742316110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb154004810 msgr2=0x7fb154004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb174a00640 1 --2- 172.21.15.5:0/1742316110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb154004810 0x7fb154004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.747+0000 7fb174a00640 1 -- 172.21.15.5:0/1742316110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb154003530 con 0x7fb1540052f0 2024-08-18T22:22:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb174a00640 1 -- 172.21.15.5:0/1742316110 reap_dead start 2024-08-18T22:22:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb174a00640 1 --2- 172.21.15.5:0/1742316110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 0x7fb15400b9d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb17006ff80 tx=0x7fb16801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f9723ab59093d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1680b2070 con 0x7fb1540052f0 2024-08-18T22:22:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1680a5be0 con 0x7fb1540052f0 2024-08-18T22:22:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb16f400640 1 -- 172.21.15.5:0/1742316110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168009c10 con 0x7fb1540052f0 2024-08-18T22:22:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb176a00640 1 -- 172.21.15.5:0/1742316110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 msgr2=0x7fb15400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb176a00640 1 --2- 172.21.15.5:0/1742316110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 0x7fb15400b9d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb17006ff80 tx=0x7fb16801cc00 comp rx=0 tx=0).stop 2024-08-18T22:22:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb176a00640 1 -- 172.21.15.5:0/1742316110 shutdown_connections 2024-08-18T22:22:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb176a00640 1 --2- 172.21.15.5:0/1742316110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 0x7fb15400b9d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb176a00640 1 -- 172.21.15.5:0/1742316110 >> 172.21.15.5:0/1742316110 conn(0x7fb1700b3eb0 msgr2=0x7fb1700b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb176a00640 1 -- 172.21.15.5:0/1742316110 shutdown_connections 2024-08-18T22:22:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.751+0000 7fb176a00640 1 -- 172.21.15.5:0/1742316110 wait complete. 2024-08-18T22:22:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb176a00640 1 Processor -- start 2024-08-18T22:22:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb176a00640 1 -- start start 2024-08-18T22:22:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb176a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 0x7fb17013ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb176a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb170155280 0x7fb170155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb176a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb170150f70 0x7fb1701513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb176a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700b5940 con 0x7fb1540052f0 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb176a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700b57c0 con 0x7fb170155280 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb176a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb1700b5ac0 con 0x7fb170150f70 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 0x7fb17013ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 0x7fb17013ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52852/0 (socket says 172.21.15.5:52852) 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16fe00640 1 -- 172.21.15.5:0/704518779 learned_addr learned my addr 172.21.15.5:0/704518779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb167e00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb170155280 0x7fb170155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb174a00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb170150f70 0x7fb1701513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16fe00640 1 -- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb170150f70 msgr2=0x7fb1701513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16fe00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb170150f70 0x7fb1701513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16fe00640 1 -- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb170155280 msgr2=0x7fb170155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16fe00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb170155280 0x7fb170155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16fe00640 1 -- 172.21.15.5:0/704518779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17014d980 con 0x7fb1540052f0 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb174a00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb170150f70 0x7fb1701513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16fe00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 0x7fb17013ed70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb16000f5f0 tx=0x7fb16000f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16cc00640 1 -- 172.21.15.5:0/704518779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1600052e0 con 0x7fb1540052f0 2024-08-18T22:22:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16cc00640 1 -- 172.21.15.5:0/704518779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb160018070 con 0x7fb1540052f0 2024-08-18T22:22:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb16cc00640 1 -- 172.21.15.5:0/704518779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160003820 con 0x7fb1540052f0 2024-08-18T22:22:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb176a00640 1 -- 172.21.15.5:0/704518779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17014dc60 con 0x7fb1540052f0 2024-08-18T22:22:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.755+0000 7fb176a00640 1 -- 172.21.15.5:0/704518779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17014e220 con 0x7fb1540052f0 2024-08-18T22:22:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.759+0000 7fb176a00640 1 -- 172.21.15.5:0/704518779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1700d12a0 con 0x7fb1540052f0 2024-08-18T22:22:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.759+0000 7fb16cc00640 1 -- 172.21.15.5:0/704518779 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1600039c0 con 0x7fb1540052f0 2024-08-18T22:22:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.759+0000 7fb16cc00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb14c0678c0 0x7fb14c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.759+0000 7fb16cc00640 1 -- 172.21.15.5:0/704518779 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fb160085be0 con 0x7fb1540052f0 2024-08-18T22:22:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.759+0000 7fb167e00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb14c0678c0 0x7fb14c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.759+0000 7fb167e00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb14c0678c0 0x7fb14c069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb170155dd0 tx=0x7fb158001160 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.763+0000 7fb16cc00640 1 -- 172.21.15.5:0/704518779 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb1600564f0 con 0x7fb1540052f0 2024-08-18T22:22:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.923+0000 7fb176a00640 1 -- 172.21.15.5:0/704518779 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb17014d730 con 0x7fb14c0678c0 2024-08-18T22:22:15.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb16cc00640 1 -- 172.21.15.5:0/704518779 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251362 (secure 0 0 0) 0x7fb17014d730 con 0x7fb14c0678c0 2024-08-18T22:22:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:15.940 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:22:15.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 -- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb14c0678c0 msgr2=0x7fb14c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb14c0678c0 0x7fb14c069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb170155dd0 tx=0x7fb158001160 comp rx=0 tx=0).stop 2024-08-18T22:22:15.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 -- 172.21.15.5:0/704518779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 msgr2=0x7fb17013ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:15.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 0x7fb17013ed70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb16000f5f0 tx=0x7fb16000f9f0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 -- 172.21.15.5:0/704518779 shutdown_connections 2024-08-18T22:22:15.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb14c0678c0 0x7fb14c069d80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb170150f70 0x7fb1701513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb170155280 0x7fb170155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 --2- 172.21.15.5:0/704518779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1540052f0 0x7fb17013ed70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 -- 172.21.15.5:0/704518779 >> 172.21.15.5:0/704518779 conn(0x7fb1700b3eb0 msgr2=0x7fb170071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 -- 172.21.15.5:0/704518779 shutdown_connections 2024-08-18T22:22:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:15.935+0000 7fb176a00640 1 -- 172.21.15.5:0/704518779 wait complete. 2024-08-18T22:22:15.959 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-08-18T22:22:15.659988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297220,"kb_used_data":6168,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677500,"statfs":{"total":773094113280,"available":772789760000,"internally_reserved":0,"allocated":6316032,"data_stored":3458470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001537"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.685732+0000","last_change":"2024-08-18T22:22:11.676580+0000","last_active":"2024-08-18T22:22:11.685732+0000","last_peered":"2024-08-18T22:22:11.685732+0000","last_clean":"2024-08-18T22:22:11.685732+0000","last_became_active":"2024-08-18T22:22:11.676262+0000","last_became_peered":"2024-08-18T22:22:11.676262+0000","last_unstale":"2024-08-18T22:22:11.685732+0000","last_undegraded":"2024-08-18T22:22:11.685732+0000","last_fullsized":"2024-08-18T22:22:11.685732+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:23.383477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436525+0000","last_change":"2024-08-18T22:22:11.440271+0000","last_active":"2024-08-18T22:22:12.436525+0000","last_peered":"2024-08-18T22:22:12.436525+0000","last_clean":"2024-08-18T22:22:12.436525+0000","last_became_active":"2024-08-18T22:22:11.438676+0000","last_became_peered":"2024-08-18T22:22:11.438676+0000","last_unstale":"2024-08-18T22:22:12.436525+0000","last_undegraded":"2024-08-18T22:22:12.436525+0000","last_fullsized":"2024-08-18T22:22:12.436525+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435228+0000","last_change":"2024-08-18T22:22:11.696380+0000","last_active":"2024-08-18T22:22:12.435228+0000","last_peered":"2024-08-18T22:22:12.435228+0000","last_clean":"2024-08-18T22:22:12.435228+0000","last_became_active":"2024-08-18T22:22:11.696082+0000","last_became_peered":"2024-08-18T22:22:11.696082+0000","last_unstale":"2024-08-18T22:22:12.435228+0000","last_undegraded":"2024-08-18T22:22:12.435228+0000","last_fullsized":"2024-08-18T22:22:12.435228+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:03.855436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436037+0000","last_change":"2024-08-18T22:22:11.682718+0000","last_active":"2024-08-18T22:22:12.436037+0000","last_peered":"2024-08-18T22:22:12.436037+0000","last_clean":"2024-08-18T22:22:12.436037+0000","last_became_active":"2024-08-18T22:22:11.682318+0000","last_became_peered":"2024-08-18T22:22:11.682318+0000","last_unstale":"2024-08-18T22:22:12.436037+0000","last_undegraded":"2024-08-18T22:22:12.436037+0000","last_fullsized":"2024-08-18T22:22:12.436037+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:01.509300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.420920+0000","last_change":"2024-08-18T22:22:10.420920+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.420920+0000","last_undegraded":"2024-08-18T22:22:10.420920+0000","last_fullsized":"2024-08-18T22:22:10.420920+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686120+0000","last_change":"2024-08-18T22:22:11.680962+0000","last_active":"2024-08-18T22:22:11.686120+0000","last_peered":"2024-08-18T22:22:11.686120+0000","last_clean":"2024-08-18T22:22:11.686120+0000","last_became_active":"2024-08-18T22:22:11.678373+0000","last_became_peered":"2024-08-18T22:22:11.678373+0000","last_unstale":"2024-08-18T22:22:11.686120+0000","last_undegraded":"2024-08-18T22:22:11.686120+0000","last_fullsized":"2024-08-18T22:22:11.686120+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:17:42.387805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434393+0000","last_change":"2024-08-18T22:22:11.694199+0000","last_active":"2024-08-18T22:22:12.434393+0000","last_peered":"2024-08-18T22:22:12.434393+0000","last_clean":"2024-08-18T22:22:12.434393+0000","last_became_active":"2024-08-18T22:22:11.693947+0000","last_became_peered":"2024-08-18T22:22:11.693947+0000","last_unstale":"2024-08-18T22:22:12.434393+0000","last_undegraded":"2024-08-18T22:22:12.434393+0000","last_fullsized":"2024-08-18T22:22:12.434393+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663710+0000","last_change":"2024-08-18T22:22:11.704329+0000","last_active":"2024-08-18T22:22:12.663710+0000","last_peered":"2024-08-18T22:22:12.663710+0000","last_clean":"2024-08-18T22:22:12.663710+0000","last_became_active":"2024-08-18T22:22:11.704045+0000","last_became_peered":"2024-08-18T22:22:11.704045+0000","last_unstale":"2024-08-18T22:22:12.663710+0000","last_undegraded":"2024-08-18T22:22:12.663710+0000","last_fullsized":"2024-08-18T22:22:12.663710+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:19.801891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664338+0000","last_change":"2024-08-18T22:22:11.707496+0000","last_active":"2024-08-18T22:22:12.664338+0000","last_peered":"2024-08-18T22:22:12.664338+0000","last_clean":"2024-08-18T22:22:12.664338+0000","last_became_active":"2024-08-18T22:22:11.706997+0000","last_became_peered":"2024-08-18T22:22:11.706997+0000","last_unstale":"2024-08-18T22:22:12.664338+0000","last_undegraded":"2024-08-18T22:22:12.664338+0000","last_fullsized":"2024-08-18T22:22:12.664338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:58:46.378942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686229+0000","last_change":"2024-08-18T22:22:11.679702+0000","last_active":"2024-08-18T22:22:11.686229+0000","last_peered":"2024-08-18T22:22:11.686229+0000","last_clean":"2024-08-18T22:22:11.686229+0000","last_became_active":"2024-08-18T22:22:11.679420+0000","last_became_peered":"2024-08-18T22:22:11.679420+0000","last_unstale":"2024-08-18T22:22:11.686229+0000","last_undegraded":"2024-08-18T22:22:11.686229+0000","last_fullsized":"2024-08-18T22:22:11.686229+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:44:32.585650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.423965+0000","last_change":"2024-08-18T22:22:10.423965+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.423965+0000","last_undegraded":"2024-08-18T22:22:10.423965+0000","last_fullsized":"2024-08-18T22:22:10.423965+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663831+0000","last_change":"2024-08-18T22:22:11.690698+0000","last_active":"2024-08-18T22:22:12.663831+0000","last_peered":"2024-08-18T22:22:12.663831+0000","last_clean":"2024-08-18T22:22:12.663831+0000","last_became_active":"2024-08-18T22:22:11.690395+0000","last_became_peered":"2024-08-18T22:22:11.690395+0000","last_unstale":"2024-08-18T22:22:12.663831+0000","last_undegraded":"2024-08-18T22:22:12.663831+0000","last_fullsized":"2024-08-18T22:22:12.663831+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:24.841562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.687694+0000","last_change":"2024-08-18T22:22:11.679618+0000","last_active":"2024-08-18T22:22:11.687694+0000","last_peered":"2024-08-18T22:22:11.687694+0000","last_clean":"2024-08-18T22:22:11.687694+0000","last_became_active":"2024-08-18T22:22:11.679314+0000","last_became_peered":"2024-08-18T22:22:11.679314+0000","last_unstale":"2024-08-18T22:22:11.687694+0000","last_undegraded":"2024-08-18T22:22:11.687694+0000","last_fullsized":"2024-08-18T22:22:11.687694+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:52.105226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434534+0000","last_change":"2024-08-18T22:22:11.701031+0000","last_active":"2024-08-18T22:22:12.434534+0000","last_peered":"2024-08-18T22:22:12.434534+0000","last_clean":"2024-08-18T22:22:12.434534+0000","last_became_active":"2024-08-18T22:22:11.698895+0000","last_became_peered":"2024-08-18T22:22:11.698895+0000","last_unstale":"2024-08-18T22:22:12.434534+0000","last_undegraded":"2024-08-18T22:22:12.434534+0000","last_fullsized":"2024-08-18T22:22:12.434534+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436082+0000","last_change":"2024-08-18T22:22:11.436504+0000","last_active":"2024-08-18T22:22:12.436082+0000","last_peered":"2024-08-18T22:22:12.436082+0000","last_clean":"2024-08-18T22:22:12.436082+0000","last_became_active":"2024-08-18T22:22:11.436178+0000","last_became_peered":"2024-08-18T22:22:11.436178+0000","last_unstale":"2024-08-18T22:22:12.436082+0000","last_undegraded":"2024-08-18T22:22:12.436082+0000","last_fullsized":"2024-08-18T22:22:12.436082+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:26.302065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686620+0000","last_change":"2024-08-18T22:22:11.678730+0000","last_active":"2024-08-18T22:22:11.686620+0000","last_peered":"2024-08-18T22:22:11.686620+0000","last_clean":"2024-08-18T22:22:11.686620+0000","last_became_active":"2024-08-18T22:22:11.678412+0000","last_became_peered":"2024-08-18T22:22:11.678412+0000","last_unstale":"2024-08-18T22:22:11.686620+0000","last_undegraded":"2024-08-18T22:22:11.686620+0000","last_fullsized":"2024-08-18T22:22:11.686620+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:40.583712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435557+0000","last_change":"2024-08-18T22:22:11.678067+0000","last_active":"2024-08-18T22:22:12.435557+0000","last_peered":"2024-08-18T22:22:12.435557+0000","last_clean":"2024-08-18T22:22:12.435557+0000","last_became_active":"2024-08-18T22:22:11.677369+0000","last_became_peered":"2024-08-18T22:22:11.677369+0000","last_unstale":"2024-08-18T22:22:12.435557+0000","last_undegraded":"2024-08-18T22:22:12.435557+0000","last_fullsized":"2024-08-18T22:22:12.435557+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:19.801891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436665+0000","last_change":"2024-08-18T22:22:11.438865+0000","last_active":"2024-08-18T22:22:12.436665+0000","last_peered":"2024-08-18T22:22:12.436665+0000","last_clean":"2024-08-18T22:22:12.436665+0000","last_became_active":"2024-08-18T22:22:11.438478+0000","last_became_peered":"2024-08-18T22:22:11.438478+0000","last_unstale":"2024-08-18T22:22:12.436665+0000","last_undegraded":"2024-08-18T22:22:12.436665+0000","last_fullsized":"2024-08-18T22:22:12.436665+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435197+0000","last_change":"2024-08-18T22:22:11.676615+0000","last_active":"2024-08-18T22:22:12.435197+0000","last_peered":"2024-08-18T22:22:12.435197+0000","last_clean":"2024-08-18T22:22:12.435197+0000","last_became_active":"2024-08-18T22:22:11.676354+0000","last_became_peered":"2024-08-18T22:22:11.676354+0000","last_unstale":"2024-08-18T22:22:12.435197+0000","last_undegraded":"2024-08-18T22:22:12.435197+0000","last_fullsized":"2024-08-18T22:22:12.435197+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:26.623153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.434745+0000","last_change":"2024-08-18T22:22:11.428854+0000","last_active":"2024-08-18T22:22:11.434745+0000","last_peered":"2024-08-18T22:22:11.434745+0000","last_clean":"2024-08-18T22:22:11.434745+0000","last_became_active":"2024-08-18T22:22:11.428471+0000","last_became_peered":"2024-08-18T22:22:11.428471+0000","last_unstale":"2024-08-18T22:22:11.434745+0000","last_undegraded":"2024-08-18T22:22:11.434745+0000","last_fullsized":"2024-08-18T22:22:11.434745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:31:36.024442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.436275+0000","last_change":"2024-08-18T22:22:11.434529+0000","last_active":"2024-08-18T22:22:11.436275+0000","last_peered":"2024-08-18T22:22:11.436275+0000","last_clean":"2024-08-18T22:22:11.436275+0000","last_became_active":"2024-08-18T22:22:11.434213+0000","last_became_peered":"2024-08-18T22:22:11.434213+0000","last_unstale":"2024-08-18T22:22:11.436275+0000","last_undegraded":"2024-08-18T22:22:11.436275+0000","last_fullsized":"2024-08-18T22:22:11.436275+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:51.767649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663686+0000","last_change":"2024-08-18T22:22:11.704537+0000","last_active":"2024-08-18T22:22:12.663686+0000","last_peered":"2024-08-18T22:22:12.663686+0000","last_clean":"2024-08-18T22:22:12.663686+0000","last_became_active":"2024-08-18T22:22:11.704264+0000","last_became_peered":"2024-08-18T22:22:11.704264+0000","last_unstale":"2024-08-18T22:22:12.663686+0000","last_undegraded":"2024-08-18T22:22:12.663686+0000","last_fullsized":"2024-08-18T22:22:12.663686+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:32.138824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.422243+0000","last_change":"2024-08-18T22:22:10.422243+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.422243+0000","last_undegraded":"2024-08-18T22:22:10.422243+0000","last_fullsized":"2024-08-18T22:22:10.422243+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434327+0000","last_change":"2024-08-18T22:22:11.688871+0000","last_active":"2024-08-18T22:22:12.434327+0000","last_peered":"2024-08-18T22:22:12.434327+0000","last_clean":"2024-08-18T22:22:12.434327+0000","last_became_active":"2024-08-18T22:22:11.688602+0000","last_became_peered":"2024-08-18T22:22:11.688602+0000","last_unstale":"2024-08-18T22:22:12.434327+0000","last_undegraded":"2024-08-18T22:22:12.434327+0000","last_fullsized":"2024-08-18T22:22:12.434327+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435719+0000","last_change":"2024-08-18T22:22:11.699877+0000","last_active":"2024-08-18T22:22:12.435719+0000","last_peered":"2024-08-18T22:22:12.435719+0000","last_clean":"2024-08-18T22:22:12.435719+0000","last_became_active":"2024-08-18T22:22:11.698188+0000","last_became_peered":"2024-08-18T22:22:11.698188+0000","last_unstale":"2024-08-18T22:22:12.435719+0000","last_undegraded":"2024-08-18T22:22:12.435719+0000","last_fullsized":"2024-08-18T22:22:12.435719+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:02.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664211+0000","last_change":"2024-08-18T22:22:11.693386+0000","last_active":"2024-08-18T22:22:12.664211+0000","last_peered":"2024-08-18T22:22:12.664211+0000","last_clean":"2024-08-18T22:22:12.664211+0000","last_became_active":"2024-08-18T22:22:11.693112+0000","last_became_peered":"2024-08-18T22:22:11.693112+0000","last_unstale":"2024-08-18T22:22:12.664211+0000","last_undegraded":"2024-08-18T22:22:12.664211+0000","last_fullsized":"2024-08-18T22:22:12.664211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:11.368781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686724+0000","last_change":"2024-08-18T22:22:11.681723+0000","last_active":"2024-08-18T22:22:11.686724+0000","last_peered":"2024-08-18T22:22:11.686724+0000","last_clean":"2024-08-18T22:22:11.686724+0000","last_became_active":"2024-08-18T22:22:11.681477+0000","last_became_peered":"2024-08-18T22:22:11.681477+0000","last_unstale":"2024-08-18T22:22:11.686724+0000","last_undegraded":"2024-08-18T22:22:11.686724+0000","last_fullsized":"2024-08-18T22:22:11.686724+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:54.446791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.682519+0000","last_change":"2024-08-18T22:22:11.681994+0000","last_active":"2024-08-18T22:22:11.682519+0000","last_peered":"2024-08-18T22:22:11.682519+0000","last_clean":"2024-08-18T22:22:11.682519+0000","last_became_active":"2024-08-18T22:22:11.681612+0000","last_became_peered":"2024-08-18T22:22:11.681612+0000","last_unstale":"2024-08-18T22:22:11.682519+0000","last_undegraded":"2024-08-18T22:22:11.682519+0000","last_fullsized":"2024-08-18T22:22:11.682519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:52.105226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434496+0000","last_change":"2024-08-18T22:22:11.674918+0000","last_active":"2024-08-18T22:22:12.434496+0000","last_peered":"2024-08-18T22:22:12.434496+0000","last_clean":"2024-08-18T22:22:12.434496+0000","last_became_active":"2024-08-18T22:22:11.674651+0000","last_became_peered":"2024-08-18T22:22:11.674651+0000","last_unstale":"2024-08-18T22:22:12.434496+0000","last_undegraded":"2024-08-18T22:22:12.434496+0000","last_fullsized":"2024-08-18T22:22:12.434496+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436444+0000","last_change":"2024-08-18T22:22:11.684544+0000","last_active":"2024-08-18T22:22:12.436444+0000","last_peered":"2024-08-18T22:22:12.436444+0000","last_clean":"2024-08-18T22:22:12.436444+0000","last_became_active":"2024-08-18T22:22:11.684231+0000","last_became_peered":"2024-08-18T22:22:11.684231+0000","last_unstale":"2024-08-18T22:22:12.436444+0000","last_undegraded":"2024-08-18T22:22:12.436444+0000","last_fullsized":"2024-08-18T22:22:12.436444+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434464+0000","last_change":"2024-08-18T22:22:11.694141+0000","last_active":"2024-08-18T22:22:12.434464+0000","last_peered":"2024-08-18T22:22:12.434464+0000","last_clean":"2024-08-18T22:22:12.434464+0000","last_became_active":"2024-08-18T22:22:11.690937+0000","last_became_peered":"2024-08-18T22:22:11.690937+0000","last_unstale":"2024-08-18T22:22:12.434464+0000","last_undegraded":"2024-08-18T22:22:12.434464+0000","last_fullsized":"2024-08-18T22:22:12.434464+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436109+0000","last_change":"2024-08-18T22:22:11.692230+0000","last_active":"2024-08-18T22:22:12.436109+0000","last_peered":"2024-08-18T22:22:12.436109+0000","last_clean":"2024-08-18T22:22:12.436109+0000","last_became_active":"2024-08-18T22:22:11.691972+0000","last_became_peered":"2024-08-18T22:22:11.691972+0000","last_unstale":"2024-08-18T22:22:12.436109+0000","last_undegraded":"2024-08-18T22:22:12.436109+0000","last_fullsized":"2024-08-18T22:22:12.436109+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:01.509300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435700+0000","last_change":"2024-08-18T22:22:11.438891+0000","last_active":"2024-08-18T22:22:12.435700+0000","last_peered":"2024-08-18T22:22:12.435700+0000","last_clean":"2024-08-18T22:22:12.435700+0000","last_became_active":"2024-08-18T22:22:11.438571+0000","last_became_peered":"2024-08-18T22:22:11.438571+0000","last_unstale":"2024-08-18T22:22:12.435700+0000","last_undegraded":"2024-08-18T22:22:12.435700+0000","last_fullsized":"2024-08-18T22:22:12.435700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:13.622996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"54'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.440725+0000","last_change":"2024-08-18T22:22:10.430588+0000","last_active":"2024-08-18T22:22:11.440725+0000","last_peered":"2024-08-18T22:22:11.440725+0000","last_clean":"2024-08-18T22:22:11.440725+0000","last_became_active":"2024-08-18T22:22:10.430291+0000","last_became_peered":"2024-08-18T22:22:10.430291+0000","last_unstale":"2024-08-18T22:22:11.440725+0000","last_undegraded":"2024-08-18T22:22:11.440725+0000","last_fullsized":"2024-08-18T22:22:11.440725+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:55.985496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436761+0000","last_change":"2024-08-18T22:22:11.437753+0000","last_active":"2024-08-18T22:22:12.436761+0000","last_peered":"2024-08-18T22:22:12.436761+0000","last_clean":"2024-08-18T22:22:12.436761+0000","last_became_active":"2024-08-18T22:22:11.437447+0000","last_became_peered":"2024-08-18T22:22:11.437447+0000","last_unstale":"2024-08-18T22:22:12.436761+0000","last_undegraded":"2024-08-18T22:22:12.436761+0000","last_fullsized":"2024-08-18T22:22:12.436761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.695976+0000","last_change":"2024-08-18T22:22:10.444416+0000","last_active":"2024-08-18T22:22:11.695976+0000","last_peered":"2024-08-18T22:22:11.695976+0000","last_clean":"2024-08-18T22:22:11.695976+0000","last_became_active":"2024-08-18T22:22:10.443904+0000","last_became_peered":"2024-08-18T22:22:10.443904+0000","last_unstale":"2024-08-18T22:22:11.695976+0000","last_undegraded":"2024-08-18T22:22:11.695976+0000","last_fullsized":"2024-08-18T22:22:11.695976+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:41.576670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.436460+0000","last_change":"2024-08-18T22:22:11.434634+0000","last_active":"2024-08-18T22:22:11.436460+0000","last_peered":"2024-08-18T22:22:11.436460+0000","last_clean":"2024-08-18T22:22:11.436460+0000","last_became_active":"2024-08-18T22:22:11.434339+0000","last_became_peered":"2024-08-18T22:22:11.434339+0000","last_unstale":"2024-08-18T22:22:11.436460+0000","last_undegraded":"2024-08-18T22:22:11.436460+0000","last_fullsized":"2024-08-18T22:22:11.436460+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:27.184054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.692067+0000","last_change":"2024-08-18T22:22:10.445086+0000","last_active":"2024-08-18T22:22:11.692067+0000","last_peered":"2024-08-18T22:22:11.692067+0000","last_clean":"2024-08-18T22:22:11.692067+0000","last_became_active":"2024-08-18T22:22:10.443901+0000","last_became_peered":"2024-08-18T22:22:10.443901+0000","last_unstale":"2024-08-18T22:22:11.692067+0000","last_undegraded":"2024-08-18T22:22:11.692067+0000","last_fullsized":"2024-08-18T22:22:11.692067+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:50.763870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663686+0000","last_change":"2024-08-18T22:22:11.696062+0000","last_active":"2024-08-18T22:22:12.663686+0000","last_peered":"2024-08-18T22:22:12.663686+0000","last_clean":"2024-08-18T22:22:12.663686+0000","last_became_active":"2024-08-18T22:22:11.693315+0000","last_became_peered":"2024-08-18T22:22:11.693315+0000","last_unstale":"2024-08-18T22:22:12.663686+0000","last_undegraded":"2024-08-18T22:22:12.663686+0000","last_fullsized":"2024-08-18T22:22:12.663686+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:35.835298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437395+0000","last_change":"2024-08-18T22:22:10.437524+0000","last_active":"2024-08-18T22:22:12.437395+0000","last_peered":"2024-08-18T22:22:12.437395+0000","last_clean":"2024-08-18T22:22:12.437395+0000","last_became_active":"2024-08-18T22:22:10.437205+0000","last_became_peered":"2024-08-18T22:22:10.437205+0000","last_unstale":"2024-08-18T22:22:12.437395+0000","last_undegraded":"2024-08-18T22:22:12.437395+0000","last_fullsized":"2024-08-18T22:22:12.437395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:38:35.135643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421708+0000","last_change":"2024-08-18T22:22:10.421708+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421708+0000","last_undegraded":"2024-08-18T22:22:10.421708+0000","last_fullsized":"2024-08-18T22:22:10.421708+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434997+0000","last_change":"2024-08-18T22:22:10.446348+0000","last_active":"2024-08-18T22:22:12.434997+0000","last_peered":"2024-08-18T22:22:12.434997+0000","last_clean":"2024-08-18T22:22:12.434997+0000","last_became_active":"2024-08-18T22:22:10.445868+0000","last_became_peered":"2024-08-18T22:22:10.445868+0000","last_unstale":"2024-08-18T22:22:12.434997+0000","last_undegraded":"2024-08-18T22:22:12.434997+0000","last_fullsized":"2024-08-18T22:22:12.434997+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:17:41.384026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436303+0000","last_change":"2024-08-18T22:22:11.685125+0000","last_active":"2024-08-18T22:22:12.436303+0000","last_peered":"2024-08-18T22:22:12.436303+0000","last_clean":"2024-08-18T22:22:12.436303+0000","last_became_active":"2024-08-18T22:22:11.684877+0000","last_became_peered":"2024-08-18T22:22:11.684877+0000","last_unstale":"2024-08-18T22:22:12.436303+0000","last_undegraded":"2024-08-18T22:22:12.436303+0000","last_fullsized":"2024-08-18T22:22:12.436303+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.434867+0000","last_change":"2024-08-18T22:22:10.430868+0000","last_active":"2024-08-18T22:22:10.434867+0000","last_peered":"2024-08-18T22:22:10.434867+0000","last_clean":"2024-08-18T22:22:10.434867+0000","last_became_active":"2024-08-18T22:22:10.430580+0000","last_became_peered":"2024-08-18T22:22:10.430580+0000","last_unstale":"2024-08-18T22:22:10.434867+0000","last_undegraded":"2024-08-18T22:22:10.434867+0000","last_fullsized":"2024-08-18T22:22:10.434867+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:31:35.633828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664190+0000","last_change":"2024-08-18T22:22:11.688121+0000","last_active":"2024-08-18T22:22:12.664190+0000","last_peered":"2024-08-18T22:22:12.664190+0000","last_clean":"2024-08-18T22:22:12.664190+0000","last_became_active":"2024-08-18T22:22:11.687691+0000","last_became_peered":"2024-08-18T22:22:11.687691+0000","last_unstale":"2024-08-18T22:22:12.664190+0000","last_undegraded":"2024-08-18T22:22:12.664190+0000","last_fullsized":"2024-08-18T22:22:12.664190+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:42:20.647483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.422044+0000","last_change":"2024-08-18T22:22:10.432702+0000","last_active":"2024-08-18T22:22:11.422044+0000","last_peered":"2024-08-18T22:22:11.422044+0000","last_clean":"2024-08-18T22:22:11.422044+0000","last_became_active":"2024-08-18T22:22:10.432258+0000","last_became_peered":"2024-08-18T22:22:10.432258+0000","last_unstale":"2024-08-18T22:22:11.422044+0000","last_undegraded":"2024-08-18T22:22:11.422044+0000","last_fullsized":"2024-08-18T22:22:11.422044+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:01:07.848661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436605+0000","last_change":"2024-08-18T22:22:11.675403+0000","last_active":"2024-08-18T22:22:12.436605+0000","last_peered":"2024-08-18T22:22:12.436605+0000","last_clean":"2024-08-18T22:22:12.436605+0000","last_became_active":"2024-08-18T22:22:11.675113+0000","last_became_peered":"2024-08-18T22:22:11.675113+0000","last_unstale":"2024-08-18T22:22:12.436605+0000","last_undegraded":"2024-08-18T22:22:12.436605+0000","last_fullsized":"2024-08-18T22:22:12.436605+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434330+0000","last_change":"2024-08-18T22:22:10.433218+0000","last_active":"2024-08-18T22:22:12.434330+0000","last_peered":"2024-08-18T22:22:12.434330+0000","last_clean":"2024-08-18T22:22:12.434330+0000","last_became_active":"2024-08-18T22:22:10.432947+0000","last_became_peered":"2024-08-18T22:22:10.432947+0000","last_unstale":"2024-08-18T22:22:12.434330+0000","last_undegraded":"2024-08-18T22:22:12.434330+0000","last_fullsized":"2024-08-18T22:22:12.434330+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:51.101447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421236+0000","last_change":"2024-08-18T22:22:10.421236+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421236+0000","last_undegraded":"2024-08-18T22:22:10.421236+0000","last_fullsized":"2024-08-18T22:22:10.421236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436697+0000","last_change":"2024-08-18T22:22:10.434355+0000","last_active":"2024-08-18T22:22:12.436697+0000","last_peered":"2024-08-18T22:22:12.436697+0000","last_clean":"2024-08-18T22:22:12.436697+0000","last_became_active":"2024-08-18T22:22:10.434027+0000","last_became_peered":"2024-08-18T22:22:10.434027+0000","last_unstale":"2024-08-18T22:22:12.436697+0000","last_undegraded":"2024-08-18T22:22:12.436697+0000","last_fullsized":"2024-08-18T22:22:12.436697+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:05:15.817540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436618+0000","last_change":"2024-08-18T22:22:11.440263+0000","last_active":"2024-08-18T22:22:12.436618+0000","last_peered":"2024-08-18T22:22:12.436618+0000","last_clean":"2024-08-18T22:22:12.436618+0000","last_became_active":"2024-08-18T22:22:11.439371+0000","last_became_peered":"2024-08-18T22:22:11.439371+0000","last_unstale":"2024-08-18T22:22:12.436618+0000","last_undegraded":"2024-08-18T22:22:12.436618+0000","last_fullsized":"2024-08-18T22:22:12.436618+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.436265+0000","last_change":"2024-08-18T22:22:10.434830+0000","last_active":"2024-08-18T22:22:10.436265+0000","last_peered":"2024-08-18T22:22:10.436265+0000","last_clean":"2024-08-18T22:22:10.436265+0000","last_became_active":"2024-08-18T22:22:10.434370+0000","last_became_peered":"2024-08-18T22:22:10.434370+0000","last_unstale":"2024-08-18T22:22:10.436265+0000","last_undegraded":"2024-08-18T22:22:10.436265+0000","last_fullsized":"2024-08-18T22:22:10.436265+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:32:11.671929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434721+0000","last_change":"2024-08-18T22:22:11.674739+0000","last_active":"2024-08-18T22:22:12.434721+0000","last_peered":"2024-08-18T22:22:12.434721+0000","last_clean":"2024-08-18T22:22:12.434721+0000","last_became_active":"2024-08-18T22:22:11.674451+0000","last_became_peered":"2024-08-18T22:22:11.674451+0000","last_unstale":"2024-08-18T22:22:12.434721+0000","last_undegraded":"2024-08-18T22:22:12.434721+0000","last_fullsized":"2024-08-18T22:22:12.434721+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:31.682951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"54'3","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436528+0000","last_change":"2024-08-18T22:22:10.445969+0000","last_active":"2024-08-18T22:22:12.436528+0000","last_peered":"2024-08-18T22:22:12.436528+0000","last_clean":"2024-08-18T22:22:12.436528+0000","last_became_active":"2024-08-18T22:22:10.445685+0000","last_became_peered":"2024-08-18T22:22:10.445685+0000","last_unstale":"2024-08-18T22:22:12.436528+0000","last_undegraded":"2024-08-18T22:22:12.436528+0000","last_fullsized":"2024-08-18T22:22:12.436528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:34:40.944063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.420415+0000","last_change":"2024-08-18T22:22:10.420415+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.420415+0000","last_undegraded":"2024-08-18T22:22:10.420415+0000","last_fullsized":"2024-08-18T22:22:10.420415+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664023+0000","last_change":"2024-08-18T22:22:10.441766+0000","last_active":"2024-08-18T22:22:12.664023+0000","last_peered":"2024-08-18T22:22:12.664023+0000","last_clean":"2024-08-18T22:22:12.664023+0000","last_became_active":"2024-08-18T22:22:10.441345+0000","last_became_peered":"2024-08-18T22:22:10.441345+0000","last_unstale":"2024-08-18T22:22:12.664023+0000","last_undegraded":"2024-08-18T22:22:12.664023+0000","last_fullsized":"2024-08-18T22:22:12.664023+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:00.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437013+0000","last_change":"2024-08-18T22:22:11.439705+0000","last_active":"2024-08-18T22:22:12.437013+0000","last_peered":"2024-08-18T22:22:12.437013+0000","last_clean":"2024-08-18T22:22:12.437013+0000","last_became_active":"2024-08-18T22:22:11.439381+0000","last_became_peered":"2024-08-18T22:22:11.439381+0000","last_unstale":"2024-08-18T22:22:12.437013+0000","last_undegraded":"2024-08-18T22:22:12.437013+0000","last_fullsized":"2024-08-18T22:22:12.437013+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435001+0000","last_change":"2024-08-18T22:22:10.435837+0000","last_active":"2024-08-18T22:22:12.435001+0000","last_peered":"2024-08-18T22:22:12.435001+0000","last_clean":"2024-08-18T22:22:12.435001+0000","last_became_active":"2024-08-18T22:22:10.435534+0000","last_became_peered":"2024-08-18T22:22:10.435534+0000","last_unstale":"2024-08-18T22:22:12.435001+0000","last_undegraded":"2024-08-18T22:22:12.435001+0000","last_fullsized":"2024-08-18T22:22:12.435001+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:53.443012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435338+0000","last_change":"2024-08-18T22:22:11.686961+0000","last_active":"2024-08-18T22:22:12.435338+0000","last_peered":"2024-08-18T22:22:12.435338+0000","last_clean":"2024-08-18T22:22:12.435338+0000","last_became_active":"2024-08-18T22:22:11.686690+0000","last_became_peered":"2024-08-18T22:22:11.686690+0000","last_unstale":"2024-08-18T22:22:12.435338+0000","last_undegraded":"2024-08-18T22:22:12.435338+0000","last_fullsized":"2024-08-18T22:22:12.435338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:57:48.800840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.421253+0000","last_change":"2024-08-18T22:22:10.435408+0000","last_active":"2024-08-18T22:22:11.421253+0000","last_peered":"2024-08-18T22:22:11.421253+0000","last_clean":"2024-08-18T22:22:11.421253+0000","last_became_active":"2024-08-18T22:22:10.435141+0000","last_became_peered":"2024-08-18T22:22:10.435141+0000","last_unstale":"2024-08-18T22:22:11.421253+0000","last_undegraded":"2024-08-18T22:22:11.421253+0000","last_fullsized":"2024-08-18T22:22:11.421253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:52.760163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664018+0000","last_change":"2024-08-18T22:22:11.680794+0000","last_active":"2024-08-18T22:22:12.664018+0000","last_peered":"2024-08-18T22:22:12.664018+0000","last_clean":"2024-08-18T22:22:12.664018+0000","last_became_active":"2024-08-18T22:22:11.680510+0000","last_became_peered":"2024-08-18T22:22:11.680510+0000","last_unstale":"2024-08-18T22:22:12.664018+0000","last_undegraded":"2024-08-18T22:22:12.664018+0000","last_fullsized":"2024-08-18T22:22:12.664018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:09.366034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436203+0000","last_change":"2024-08-18T22:22:10.430246+0000","last_active":"2024-08-18T22:22:12.436203+0000","last_peered":"2024-08-18T22:22:12.436203+0000","last_clean":"2024-08-18T22:22:12.436203+0000","last_became_active":"2024-08-18T22:22:10.429923+0000","last_became_peered":"2024-08-18T22:22:10.429923+0000","last_unstale":"2024-08-18T22:22:12.436203+0000","last_undegraded":"2024-08-18T22:22:12.436203+0000","last_fullsized":"2024-08-18T22:22:12.436203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:44:29.431155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435499+0000","last_change":"2024-08-18T22:22:11.677704+0000","last_active":"2024-08-18T22:22:12.435499+0000","last_peered":"2024-08-18T22:22:12.435499+0000","last_clean":"2024-08-18T22:22:12.435499+0000","last_became_active":"2024-08-18T22:22:11.676998+0000","last_became_peered":"2024-08-18T22:22:11.676998+0000","last_unstale":"2024-08-18T22:22:12.435499+0000","last_undegraded":"2024-08-18T22:22:12.435499+0000","last_fullsized":"2024-08-18T22:22:12.435499+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:32.138824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663844+0000","last_change":"2024-08-18T22:22:10.444587+0000","last_active":"2024-08-18T22:22:12.663844+0000","last_peered":"2024-08-18T22:22:12.663844+0000","last_clean":"2024-08-18T22:22:12.663844+0000","last_became_active":"2024-08-18T22:22:10.440296+0000","last_became_peered":"2024-08-18T22:22:10.440296+0000","last_unstale":"2024-08-18T22:22:12.663844+0000","last_undegraded":"2024-08-18T22:22:12.663844+0000","last_fullsized":"2024-08-18T22:22:12.663844+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:25.298286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663734+0000","last_change":"2024-08-18T22:22:11.694606+0000","last_active":"2024-08-18T22:22:12.663734+0000","last_peered":"2024-08-18T22:22:12.663734+0000","last_clean":"2024-08-18T22:22:12.663734+0000","last_became_active":"2024-08-18T22:22:11.694331+0000","last_became_peered":"2024-08-18T22:22:11.694331+0000","last_unstale":"2024-08-18T22:22:12.663734+0000","last_undegraded":"2024-08-18T22:22:12.663734+0000","last_fullsized":"2024-08-18T22:22:12.663734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:02.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435676+0000","last_change":"2024-08-18T22:22:10.444339+0000","last_active":"2024-08-18T22:22:12.435676+0000","last_peered":"2024-08-18T22:22:12.435676+0000","last_clean":"2024-08-18T22:22:12.435676+0000","last_became_active":"2024-08-18T22:22:10.442957+0000","last_became_peered":"2024-08-18T22:22:10.442957+0000","last_unstale":"2024-08-18T22:22:12.435676+0000","last_undegraded":"2024-08-18T22:22:12.435676+0000","last_fullsized":"2024-08-18T22:22:12.435676+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:36.521543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686160+0000","last_change":"2024-08-18T22:22:11.677128+0000","last_active":"2024-08-18T22:22:11.686160+0000","last_peered":"2024-08-18T22:22:11.686160+0000","last_clean":"2024-08-18T22:22:11.686160+0000","last_became_active":"2024-08-18T22:22:11.676813+0000","last_became_peered":"2024-08-18T22:22:11.676813+0000","last_unstale":"2024-08-18T22:22:11.686160+0000","last_undegraded":"2024-08-18T22:22:11.686160+0000","last_fullsized":"2024-08-18T22:22:11.686160+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:31:36.024442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.445295+0000","last_change":"2024-08-18T22:22:10.434500+0000","last_active":"2024-08-18T22:22:10.445295+0000","last_peered":"2024-08-18T22:22:10.445295+0000","last_clean":"2024-08-18T22:22:10.445295+0000","last_became_active":"2024-08-18T22:22:10.431542+0000","last_became_peered":"2024-08-18T22:22:10.431542+0000","last_unstale":"2024-08-18T22:22:10.445295+0000","last_undegraded":"2024-08-18T22:22:10.445295+0000","last_fullsized":"2024-08-18T22:22:10.445295+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:43.691497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421963+0000","last_change":"2024-08-18T22:22:10.421963+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421963+0000","last_undegraded":"2024-08-18T22:22:10.421963+0000","last_fullsized":"2024-08-18T22:22:10.421963+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686186+0000","last_change":"2024-08-18T22:22:10.445708+0000","last_active":"2024-08-18T22:22:11.686186+0000","last_peered":"2024-08-18T22:22:11.686186+0000","last_clean":"2024-08-18T22:22:11.686186+0000","last_became_active":"2024-08-18T22:22:10.445397+0000","last_became_peered":"2024-08-18T22:22:10.445397+0000","last_unstale":"2024-08-18T22:22:11.686186+0000","last_undegraded":"2024-08-18T22:22:11.686186+0000","last_fullsized":"2024-08-18T22:22:11.686186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:22.379698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.685628+0000","last_change":"2024-08-18T22:22:11.676481+0000","last_active":"2024-08-18T22:22:11.685628+0000","last_peered":"2024-08-18T22:22:11.685628+0000","last_clean":"2024-08-18T22:22:11.685628+0000","last_became_active":"2024-08-18T22:22:11.675869+0000","last_became_peered":"2024-08-18T22:22:11.675869+0000","last_unstale":"2024-08-18T22:22:11.685628+0000","last_undegraded":"2024-08-18T22:22:11.685628+0000","last_fullsized":"2024-08-18T22:22:11.685628+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:45.613060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.422259+0000","last_change":"2024-08-18T22:22:10.430687+0000","last_active":"2024-08-18T22:22:11.422259+0000","last_peered":"2024-08-18T22:22:11.422259+0000","last_clean":"2024-08-18T22:22:11.422259+0000","last_became_active":"2024-08-18T22:22:10.430161+0000","last_became_peered":"2024-08-18T22:22:10.430161+0000","last_unstale":"2024-08-18T22:22:11.422259+0000","last_undegraded":"2024-08-18T22:22:11.422259+0000","last_fullsized":"2024-08-18T22:22:11.422259+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:44.609281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437196+0000","last_change":"2024-08-18T22:22:11.441544+0000","last_active":"2024-08-18T22:22:12.437196+0000","last_peered":"2024-08-18T22:22:12.437196+0000","last_clean":"2024-08-18T22:22:12.437196+0000","last_became_active":"2024-08-18T22:22:11.441261+0000","last_became_peered":"2024-08-18T22:22:11.441261+0000","last_unstale":"2024-08-18T22:22:12.437196+0000","last_undegraded":"2024-08-18T22:22:12.437196+0000","last_fullsized":"2024-08-18T22:22:12.437196+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.692073+0000","last_change":"2024-08-18T22:22:10.444168+0000","last_active":"2024-08-18T22:22:11.692073+0000","last_peered":"2024-08-18T22:22:11.692073+0000","last_clean":"2024-08-18T22:22:11.692073+0000","last_became_active":"2024-08-18T22:22:10.443546+0000","last_became_peered":"2024-08-18T22:22:10.443546+0000","last_unstale":"2024-08-18T22:22:11.692073+0000","last_undegraded":"2024-08-18T22:22:11.692073+0000","last_fullsized":"2024-08-18T22:22:11.692073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:26.180275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.434642+0000","last_change":"2024-08-18T22:22:11.428926+0000","last_active":"2024-08-18T22:22:11.434642+0000","last_peered":"2024-08-18T22:22:11.434642+0000","last_clean":"2024-08-18T22:22:11.434642+0000","last_became_active":"2024-08-18T22:22:11.428494+0000","last_became_peered":"2024-08-18T22:22:11.428494+0000","last_unstale":"2024-08-18T22:22:11.434642+0000","last_undegraded":"2024-08-18T22:22:11.434642+0000","last_fullsized":"2024-08-18T22:22:11.434642+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:40.583712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663933+0000","last_change":"2024-08-18T22:22:10.439941+0000","last_active":"2024-08-18T22:22:12.663933+0000","last_peered":"2024-08-18T22:22:12.663933+0000","last_clean":"2024-08-18T22:22:12.663933+0000","last_became_active":"2024-08-18T22:22:10.439643+0000","last_became_peered":"2024-08-18T22:22:10.439643+0000","last_unstale":"2024-08-18T22:22:12.663933+0000","last_undegraded":"2024-08-18T22:22:12.663933+0000","last_fullsized":"2024-08-18T22:22:12.663933+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:17.149522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435392+0000","last_change":"2024-08-18T22:22:11.674241+0000","last_active":"2024-08-18T22:22:12.435392+0000","last_peered":"2024-08-18T22:22:12.435392+0000","last_clean":"2024-08-18T22:22:12.435392+0000","last_became_active":"2024-08-18T22:22:11.673969+0000","last_became_peered":"2024-08-18T22:22:11.673969+0000","last_unstale":"2024-08-18T22:22:12.435392+0000","last_undegraded":"2024-08-18T22:22:12.435392+0000","last_fullsized":"2024-08-18T22:22:12.435392+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:35.835298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434493+0000","last_change":"2024-08-18T22:22:10.447007+0000","last_active":"2024-08-18T22:22:12.434493+0000","last_peered":"2024-08-18T22:22:12.434493+0000","last_clean":"2024-08-18T22:22:12.434493+0000","last_became_active":"2024-08-18T22:22:10.446729+0000","last_became_peered":"2024-08-18T22:22:10.446729+0000","last_unstale":"2024-08-18T22:22:12.434493+0000","last_undegraded":"2024-08-18T22:22:12.434493+0000","last_fullsized":"2024-08-18T22:22:12.434493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:44:31.581871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.689947+0000","last_change":"2024-08-18T22:22:11.684053+0000","last_active":"2024-08-18T22:22:11.689947+0000","last_peered":"2024-08-18T22:22:11.689947+0000","last_clean":"2024-08-18T22:22:11.689947+0000","last_became_active":"2024-08-18T22:22:11.683737+0000","last_became_peered":"2024-08-18T22:22:11.683737+0000","last_unstale":"2024-08-18T22:22:11.689947+0000","last_undegraded":"2024-08-18T22:22:11.689947+0000","last_fullsized":"2024-08-18T22:22:11.689947+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:41.408974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.444995+0000","last_change":"2024-08-18T22:22:10.435989+0000","last_active":"2024-08-18T22:22:10.444995+0000","last_peered":"2024-08-18T22:22:10.444995+0000","last_clean":"2024-08-18T22:22:10.444995+0000","last_became_active":"2024-08-18T22:22:10.435491+0000","last_became_peered":"2024-08-18T22:22:10.435491+0000","last_unstale":"2024-08-18T22:22:10.444995+0000","last_undegraded":"2024-08-18T22:22:10.444995+0000","last_fullsized":"2024-08-18T22:22:10.444995+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:25:42.535149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436249+0000","last_change":"2024-08-18T22:22:11.685875+0000","last_active":"2024-08-18T22:22:12.436249+0000","last_peered":"2024-08-18T22:22:12.436249+0000","last_clean":"2024-08-18T22:22:12.436249+0000","last_became_active":"2024-08-18T22:22:11.685542+0000","last_became_peered":"2024-08-18T22:22:11.685542+0000","last_unstale":"2024-08-18T22:22:12.436249+0000","last_undegraded":"2024-08-18T22:22:12.436249+0000","last_fullsized":"2024-08-18T22:22:12.436249+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:26.302065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.675016+0000","last_change":"2024-08-18T22:22:10.438951+0000","last_active":"2024-08-18T22:22:11.675016+0000","last_peered":"2024-08-18T22:22:11.675016+0000","last_clean":"2024-08-18T22:22:11.675016+0000","last_became_active":"2024-08-18T22:22:10.438629+0000","last_became_peered":"2024-08-18T22:22:10.438629+0000","last_unstale":"2024-08-18T22:22:11.675016+0000","last_undegraded":"2024-08-18T22:22:11.675016+0000","last_fullsized":"2024-08-18T22:22:11.675016+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:52.125406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.692669+0000","last_change":"2024-08-18T22:22:11.689322+0000","last_active":"2024-08-18T22:22:11.692669+0000","last_peered":"2024-08-18T22:22:11.692669+0000","last_clean":"2024-08-18T22:22:11.692669+0000","last_became_active":"2024-08-18T22:22:11.689002+0000","last_became_peered":"2024-08-18T22:22:11.689002+0000","last_unstale":"2024-08-18T22:22:11.692669+0000","last_undegraded":"2024-08-18T22:22:11.692669+0000","last_fullsized":"2024-08-18T22:22:11.692669+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:37.525322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436640+0000","last_change":"2024-08-18T22:22:10.437824+0000","last_active":"2024-08-18T22:22:12.436640+0000","last_peered":"2024-08-18T22:22:12.436640+0000","last_clean":"2024-08-18T22:22:12.436640+0000","last_became_active":"2024-08-18T22:22:10.437457+0000","last_became_peered":"2024-08-18T22:22:10.437457+0000","last_unstale":"2024-08-18T22:22:12.436640+0000","last_undegraded":"2024-08-18T22:22:12.436640+0000","last_fullsized":"2024-08-18T22:22:12.436640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:05.210105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663838+0000","last_change":"2024-08-18T22:22:11.684534+0000","last_active":"2024-08-18T22:22:12.663838+0000","last_peered":"2024-08-18T22:22:12.663838+0000","last_clean":"2024-08-18T22:22:12.663838+0000","last_became_active":"2024-08-18T22:22:11.678903+0000","last_became_peered":"2024-08-18T22:22:11.678903+0000","last_unstale":"2024-08-18T22:22:12.663838+0000","last_undegraded":"2024-08-18T22:22:12.663838+0000","last_fullsized":"2024-08-18T22:22:12.663838+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:39.828882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435106+0000","last_change":"2024-08-18T22:22:10.443792+0000","last_active":"2024-08-18T22:22:12.435106+0000","last_peered":"2024-08-18T22:22:12.435106+0000","last_clean":"2024-08-18T22:22:12.435106+0000","last_became_active":"2024-08-18T22:22:10.443526+0000","last_became_peered":"2024-08-18T22:22:10.443526+0000","last_unstale":"2024-08-18T22:22:12.435106+0000","last_undegraded":"2024-08-18T22:22:12.435106+0000","last_fullsized":"2024-08-18T22:22:12.435106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:40.405195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435096+0000","last_change":"2024-08-18T22:22:11.697582+0000","last_active":"2024-08-18T22:22:12.435096+0000","last_peered":"2024-08-18T22:22:12.435096+0000","last_clean":"2024-08-18T22:22:12.435096+0000","last_became_active":"2024-08-18T22:22:11.696095+0000","last_became_peered":"2024-08-18T22:22:11.696095+0000","last_unstale":"2024-08-18T22:22:12.435096+0000","last_undegraded":"2024-08-18T22:22:12.435096+0000","last_fullsized":"2024-08-18T22:22:12.435096+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:03:06.402713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663942+0000","last_change":"2024-08-18T22:22:10.444120+0000","last_active":"2024-08-18T22:22:12.663942+0000","last_peered":"2024-08-18T22:22:12.663942+0000","last_clean":"2024-08-18T22:22:12.663942+0000","last_became_active":"2024-08-18T22:22:10.439575+0000","last_became_peered":"2024-08-18T22:22:10.439575+0000","last_unstale":"2024-08-18T22:22:12.663942+0000","last_undegraded":"2024-08-18T22:22:12.663942+0000","last_fullsized":"2024-08-18T22:22:12.663942+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:36:02.531876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436867+0000","last_change":"2024-08-18T22:22:11.439736+0000","last_active":"2024-08-18T22:22:12.436867+0000","last_peered":"2024-08-18T22:22:12.436867+0000","last_clean":"2024-08-18T22:22:12.436867+0000","last_became_active":"2024-08-18T22:22:11.439435+0000","last_became_peered":"2024-08-18T22:22:11.439435+0000","last_unstale":"2024-08-18T22:22:12.436867+0000","last_undegraded":"2024-08-18T22:22:12.436867+0000","last_fullsized":"2024-08-18T22:22:12.436867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663891+0000","last_change":"2024-08-18T22:22:10.446577+0000","last_active":"2024-08-18T22:22:12.663891+0000","last_peered":"2024-08-18T22:22:12.663891+0000","last_clean":"2024-08-18T22:22:12.663891+0000","last_became_active":"2024-08-18T22:22:10.445524+0000","last_became_peered":"2024-08-18T22:22:10.445524+0000","last_unstale":"2024-08-18T22:22:12.663891+0000","last_undegraded":"2024-08-18T22:22:12.663891+0000","last_fullsized":"2024-08-18T22:22:12.663891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:56:38.716953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435338+0000","last_change":"2024-08-18T22:22:11.691037+0000","last_active":"2024-08-18T22:22:12.435338+0000","last_peered":"2024-08-18T22:22:12.435338+0000","last_clean":"2024-08-18T22:22:12.435338+0000","last_became_active":"2024-08-18T22:22:11.690232+0000","last_became_peered":"2024-08-18T22:22:11.690232+0000","last_unstale":"2024-08-18T22:22:12.435338+0000","last_undegraded":"2024-08-18T22:22:12.435338+0000","last_fullsized":"2024-08-18T22:22:12.435338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:48.099976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.435850+0000","last_change":"2024-08-18T22:22:10.434323+0000","last_active":"2024-08-18T22:22:10.435850+0000","last_peered":"2024-08-18T22:22:10.435850+0000","last_clean":"2024-08-18T22:22:10.435850+0000","last_became_active":"2024-08-18T22:22:10.433352+0000","last_became_peered":"2024-08-18T22:22:10.433352+0000","last_unstale":"2024-08-18T22:22:10.435850+0000","last_undegraded":"2024-08-18T22:22:10.435850+0000","last_fullsized":"2024-08-18T22:22:10.435850+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:13:48.107104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664299+0000","last_change":"2024-08-18T22:22:11.707772+0000","last_active":"2024-08-18T22:22:12.664299+0000","last_peered":"2024-08-18T22:22:12.664299+0000","last_clean":"2024-08-18T22:22:12.664299+0000","last_became_active":"2024-08-18T22:22:11.707504+0000","last_became_peered":"2024-08-18T22:22:11.707504+0000","last_unstale":"2024-08-18T22:22:12.664299+0000","last_undegraded":"2024-08-18T22:22:12.664299+0000","last_fullsized":"2024-08-18T22:22:12.664299+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:12:52.604419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436339+0000","last_change":"2024-08-18T22:22:10.445621+0000","last_active":"2024-08-18T22:22:12.436339+0000","last_peered":"2024-08-18T22:22:12.436339+0000","last_clean":"2024-08-18T22:22:12.436339+0000","last_became_active":"2024-08-18T22:22:10.445287+0000","last_became_peered":"2024-08-18T22:22:10.445287+0000","last_unstale":"2024-08-18T22:22:12.436339+0000","last_undegraded":"2024-08-18T22:22:12.436339+0000","last_fullsized":"2024-08-18T22:22:12.436339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:52.642569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.441851+0000","last_change":"2024-08-18T22:22:11.439402+0000","last_active":"2024-08-18T22:22:11.441851+0000","last_peered":"2024-08-18T22:22:11.441851+0000","last_clean":"2024-08-18T22:22:11.441851+0000","last_became_active":"2024-08-18T22:22:11.439124+0000","last_became_peered":"2024-08-18T22:22:11.439124+0000","last_unstale":"2024-08-18T22:22:11.441851+0000","last_undegraded":"2024-08-18T22:22:11.441851+0000","last_fullsized":"2024-08-18T22:22:11.441851+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:42.580449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"55'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:13.429354+0000","last_change":"2024-08-18T22:22:10.439170+0000","last_active":"2024-08-18T22:22:13.429354+0000","last_peered":"2024-08-18T22:22:13.429354+0000","last_clean":"2024-08-18T22:22:13.429354+0000","last_became_active":"2024-08-18T22:22:10.438722+0000","last_became_peered":"2024-08-18T22:22:10.438722+0000","last_unstale":"2024-08-18T22:22:13.429354+0000","last_undegraded":"2024-08-18T22:22:13.429354+0000","last_fullsized":"2024-08-18T22:22:13.429354+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:05.210105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":239,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435645+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:22:12.435645+0000","last_peered":"2024-08-18T22:22:12.435645+0000","last_clean":"2024-08-18T22:22:12.435645+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:22:12.435645+0000","last_undegraded":"2024-08-18T22:22:12.435645+0000","last_fullsized":"2024-08-18T22:22:12.435645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36560,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335280,"statfs":{"total":96636764160,"available":96599326720,"internally_reserved":0,"allocated":1249280,"data_stored":881685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35968,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335872,"statfs":{"total":96636764160,"available":96599932928,"internally_reserved":0,"allocated":643072,"data_stored":285153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":647168,"data_stored":291193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40148,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331692,"statfs":{"total":96636764160,"available":96595652608,"internally_reserved":0,"allocated":663552,"data_stored":292827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35968,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335872,"statfs":{"total":96636764160,"available":96599932928,"internally_reserved":0,"allocated":643072,"data_stored":284661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1249280,"data_stored":881617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":610304,"data_stored":270667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35936,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335904,"statfs":{"total":96636764160,"available":96599965696,"internally_reserved":0,"allocated":610304,"data_stored":270667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:22:15.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:22:16.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92d0e00640 1 Processor -- start 2024-08-18T22:22:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92d0e00640 1 -- start start 2024-08-18T22:22:16.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92d0e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92cc09aa40 0x7f92cc15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92d0e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92cc0ccd90 con 0x7f92cc0b4510 2024-08-18T22:22:16.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92d0e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92cc0cd070 con 0x7f92cc0cde30 2024-08-18T22:22:16.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92d0e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f92cc0ce770 con 0x7f92cc09aa40 2024-08-18T22:22:16.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92cbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f92cc0b4510 0x7f92cc0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59328/0 (socket says 172.21.15.5:59328) 2024-08-18T22:22:16.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92cbe00640 1 -- 172.21.15.5:0/4081782624 learned_addr learned my addr 172.21.15.5:0/4081782624 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92cb400640 1 --2- 172.21.15.5:0/4081782624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92cc09aa40 0x7f92cc15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92ca000640 1 -- 172.21.15.5:0/4081782624 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693312152 0 0) 0x7f92cc0ccd90 con 0x7f92cc0b4510 2024-08-18T22:22:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92cb400640 1 -- 172.21.15.5:0/4081782624 >> v1:172.21.15.117:6789/0 conn(0x7f92cc0cde30 legacy=0x7f92cc09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92cb400640 1 -- 172.21.15.5:0/4081782624 >> v1:172.21.15.5:6789/0 conn(0x7f92cc0b4510 legacy=0x7f92cc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.139+0000 7f92cb400640 1 -- 172.21.15.5:0/4081782624 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc0cd350 con 0x7f92cc09aa40 2024-08-18T22:22:16.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.143+0000 7f92cb400640 1 --2- 172.21.15.5:0/4081782624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92cc09aa40 0x7f92cc15cfe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009770 tx=0x7f92bc01c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47f2ff0924c0a400 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.143+0000 7f92ca000640 1 -- 172.21.15.5:0/4081782624 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0b0070 con 0x7f92cc09aa40 2024-08-18T22:22:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.143+0000 7f92ca000640 1 -- 172.21.15.5:0/4081782624 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92bc0ab400 con 0x7f92cc09aa40 2024-08-18T22:22:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.143+0000 7f92ca000640 1 -- 172.21.15.5:0/4081782624 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0ab7d0 con 0x7f92cc09aa40 2024-08-18T22:22:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.143+0000 7f92d0e00640 1 -- 172.21.15.5:0/4081782624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92cc09aa40 msgr2=0x7f92cc15cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.143+0000 7f92d0e00640 1 --2- 172.21.15.5:0/4081782624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92cc09aa40 0x7f92cc15cfe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009770 tx=0x7f92bc01c280 comp rx=0 tx=0).stop 2024-08-18T22:22:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.143+0000 7f92d0e00640 1 -- 172.21.15.5:0/4081782624 shutdown_connections 2024-08-18T22:22:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.143+0000 7f92d0e00640 1 --2- 172.21.15.5:0/4081782624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92cc09aa40 0x7f92cc15cfe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.143+0000 7f92d0e00640 1 -- 172.21.15.5:0/4081782624 >> 172.21.15.5:0/4081782624 conn(0x7f92cc0b3a20 msgr2=0x7f92cc0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.143+0000 7f92d0e00640 1 -- 172.21.15.5:0/4081782624 shutdown_connections 2024-08-18T22:22:16.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.143+0000 7f92d0e00640 1 -- 172.21.15.5:0/4081782624 wait complete. 2024-08-18T22:22:16.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92d0e00640 1 Processor -- start 2024-08-18T22:22:16.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92d0e00640 1 -- start start 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92d0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92cc09aa40 0x7f92cc157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92d0e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92cc0b4510 0x7f92cc151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92d0e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92cc0cde30 0x7f92cc15e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92d0e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc169e50 con 0x7f92cc09aa40 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92d0e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc15c480 con 0x7f92cc0b4510 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92d0e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f92cc169fd0 con 0x7f92cc0cde30 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92cb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92cc09aa40 0x7f92cc157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92cb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92cc09aa40 0x7f92cc157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52866/0 (socket says 172.21.15.5:52866) 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92cb400640 1 -- 172.21.15.5:0/3158502210 learned_addr learned my addr 172.21.15.5:0/3158502210 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92cbe00640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92cc0cde30 0x7f92cc15e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92caa00640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92cc0b4510 0x7f92cc151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92cb400640 1 -- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92cc0cde30 msgr2=0x7f92cc15e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92cb400640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92cc0cde30 0x7f92cc15e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92cb400640 1 -- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92cc0b4510 msgr2=0x7f92cc151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92cb400640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92cc0b4510 0x7f92cc151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92cb400640 1 -- 172.21.15.5:0/3158502210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc15e9f0 con 0x7f92cc09aa40 2024-08-18T22:22:16.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92caa00640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92cc0b4510 0x7f92cc151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:16.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92cb400640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92cc09aa40 0x7f92cc157140 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0ae040 tx=0x7f92bc01aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:16.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92c3400640 1 -- 172.21.15.5:0/3158502210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0b0050 con 0x7f92cc09aa40 2024-08-18T22:22:16.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92c3400640 1 -- 172.21.15.5:0/3158502210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92bc0bc070 con 0x7f92cc09aa40 2024-08-18T22:22:16.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92d0e00640 1 -- 172.21.15.5:0/3158502210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92cc15ecd0 con 0x7f92cc09aa40 2024-08-18T22:22:16.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92c3400640 1 -- 172.21.15.5:0/3158502210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0b78b0 con 0x7f92cc09aa40 2024-08-18T22:22:16.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92d0e00640 1 -- 172.21.15.5:0/3158502210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92cc15f290 con 0x7f92cc09aa40 2024-08-18T22:22:16.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.147+0000 7f92d0e00640 1 -- 172.21.15.5:0/3158502210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92cc15cfe0 con 0x7f92cc09aa40 2024-08-18T22:22:16.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.151+0000 7f92c3400640 1 -- 172.21.15.5:0/3158502210 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92bc0b7a50 con 0x7f92cc09aa40 2024-08-18T22:22:16.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.151+0000 7f92c3400640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92ac0678c0 0x7f92ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.151+0000 7f92c3400640 1 -- 172.21.15.5:0/3158502210 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f92bc120530 con 0x7f92cc09aa40 2024-08-18T22:22:16.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.151+0000 7f92caa00640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92ac0678c0 0x7f92ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.151+0000 7f92caa00640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92ac0678c0 0x7f92ac069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0b1430 tx=0x7f92b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.155+0000 7f92c3400640 1 -- 172.21.15.5:0/3158502210 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f92bc015f90 con 0x7f92cc09aa40 2024-08-18T22:22:16.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.335+0000 7f92d0e00640 1 -- 172.21.15.5:0/3158502210 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92cc0c8d70 con 0x7f92ac0678c0 2024-08-18T22:22:16.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.339+0000 7f92c3400640 1 -- 172.21.15.5:0/3158502210 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251362 (secure 0 0 0) 0x7f92cc0c8d70 con 0x7f92ac0678c0 2024-08-18T22:22:16.347 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:16.348 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:22:16.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 -- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92ac0678c0 msgr2=0x7f92ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92ac0678c0 0x7f92ac069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0b1430 tx=0x7f92b8009040 comp rx=0 tx=0).stop 2024-08-18T22:22:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 -- 172.21.15.5:0/3158502210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92cc09aa40 msgr2=0x7f92cc157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92cc09aa40 0x7f92cc157140 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0ae040 tx=0x7f92bc01aac0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 -- 172.21.15.5:0/3158502210 shutdown_connections 2024-08-18T22:22:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92ac0678c0 0x7f92ac069d80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92cc0cde30 0x7f92cc15e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92cc0b4510 0x7f92cc151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 --2- 172.21.15.5:0/3158502210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92cc09aa40 0x7f92cc157140 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 -- 172.21.15.5:0/3158502210 >> 172.21.15.5:0/3158502210 conn(0x7f92cc0b3a20 msgr2=0x7f92cc0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 -- 172.21.15.5:0/3158502210 shutdown_connections 2024-08-18T22:22:16.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.343+0000 7f92d0e00640 1 -- 172.21.15.5:0/3158502210 wait complete. 2024-08-18T22:22:16.368 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-08-18T22:22:15.659988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297220,"kb_used_data":6168,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677500,"statfs":{"total":773094113280,"available":772789760000,"internally_reserved":0,"allocated":6316032,"data_stored":3458470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001537"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.685732+0000","last_change":"2024-08-18T22:22:11.676580+0000","last_active":"2024-08-18T22:22:11.685732+0000","last_peered":"2024-08-18T22:22:11.685732+0000","last_clean":"2024-08-18T22:22:11.685732+0000","last_became_active":"2024-08-18T22:22:11.676262+0000","last_became_peered":"2024-08-18T22:22:11.676262+0000","last_unstale":"2024-08-18T22:22:11.685732+0000","last_undegraded":"2024-08-18T22:22:11.685732+0000","last_fullsized":"2024-08-18T22:22:11.685732+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:23.383477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436525+0000","last_change":"2024-08-18T22:22:11.440271+0000","last_active":"2024-08-18T22:22:12.436525+0000","last_peered":"2024-08-18T22:22:12.436525+0000","last_clean":"2024-08-18T22:22:12.436525+0000","last_became_active":"2024-08-18T22:22:11.438676+0000","last_became_peered":"2024-08-18T22:22:11.438676+0000","last_unstale":"2024-08-18T22:22:12.436525+0000","last_undegraded":"2024-08-18T22:22:12.436525+0000","last_fullsized":"2024-08-18T22:22:12.436525+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435228+0000","last_change":"2024-08-18T22:22:11.696380+0000","last_active":"2024-08-18T22:22:12.435228+0000","last_peered":"2024-08-18T22:22:12.435228+0000","last_clean":"2024-08-18T22:22:12.435228+0000","last_became_active":"2024-08-18T22:22:11.696082+0000","last_became_peered":"2024-08-18T22:22:11.696082+0000","last_unstale":"2024-08-18T22:22:12.435228+0000","last_undegraded":"2024-08-18T22:22:12.435228+0000","last_fullsized":"2024-08-18T22:22:12.435228+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:03.855436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436037+0000","last_change":"2024-08-18T22:22:11.682718+0000","last_active":"2024-08-18T22:22:12.436037+0000","last_peered":"2024-08-18T22:22:12.436037+0000","last_clean":"2024-08-18T22:22:12.436037+0000","last_became_active":"2024-08-18T22:22:11.682318+0000","last_became_peered":"2024-08-18T22:22:11.682318+0000","last_unstale":"2024-08-18T22:22:12.436037+0000","last_undegraded":"2024-08-18T22:22:12.436037+0000","last_fullsized":"2024-08-18T22:22:12.436037+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:01.509300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.420920+0000","last_change":"2024-08-18T22:22:10.420920+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.420920+0000","last_undegraded":"2024-08-18T22:22:10.420920+0000","last_fullsized":"2024-08-18T22:22:10.420920+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686120+0000","last_change":"2024-08-18T22:22:11.680962+0000","last_active":"2024-08-18T22:22:11.686120+0000","last_peered":"2024-08-18T22:22:11.686120+0000","last_clean":"2024-08-18T22:22:11.686120+0000","last_became_active":"2024-08-18T22:22:11.678373+0000","last_became_peered":"2024-08-18T22:22:11.678373+0000","last_unstale":"2024-08-18T22:22:11.686120+0000","last_undegraded":"2024-08-18T22:22:11.686120+0000","last_fullsized":"2024-08-18T22:22:11.686120+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:17:42.387805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434393+0000","last_change":"2024-08-18T22:22:11.694199+0000","last_active":"2024-08-18T22:22:12.434393+0000","last_peered":"2024-08-18T22:22:12.434393+0000","last_clean":"2024-08-18T22:22:12.434393+0000","last_became_active":"2024-08-18T22:22:11.693947+0000","last_became_peered":"2024-08-18T22:22:11.693947+0000","last_unstale":"2024-08-18T22:22:12.434393+0000","last_undegraded":"2024-08-18T22:22:12.434393+0000","last_fullsized":"2024-08-18T22:22:12.434393+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663710+0000","last_change":"2024-08-18T22:22:11.704329+0000","last_active":"2024-08-18T22:22:12.663710+0000","last_peered":"2024-08-18T22:22:12.663710+0000","last_clean":"2024-08-18T22:22:12.663710+0000","last_became_active":"2024-08-18T22:22:11.704045+0000","last_became_peered":"2024-08-18T22:22:11.704045+0000","last_unstale":"2024-08-18T22:22:12.663710+0000","last_undegraded":"2024-08-18T22:22:12.663710+0000","last_fullsized":"2024-08-18T22:22:12.663710+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:19.801891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664338+0000","last_change":"2024-08-18T22:22:11.707496+0000","last_active":"2024-08-18T22:22:12.664338+0000","last_peered":"2024-08-18T22:22:12.664338+0000","last_clean":"2024-08-18T22:22:12.664338+0000","last_became_active":"2024-08-18T22:22:11.706997+0000","last_became_peered":"2024-08-18T22:22:11.706997+0000","last_unstale":"2024-08-18T22:22:12.664338+0000","last_undegraded":"2024-08-18T22:22:12.664338+0000","last_fullsized":"2024-08-18T22:22:12.664338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:58:46.378942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686229+0000","last_change":"2024-08-18T22:22:11.679702+0000","last_active":"2024-08-18T22:22:11.686229+0000","last_peered":"2024-08-18T22:22:11.686229+0000","last_clean":"2024-08-18T22:22:11.686229+0000","last_became_active":"2024-08-18T22:22:11.679420+0000","last_became_peered":"2024-08-18T22:22:11.679420+0000","last_unstale":"2024-08-18T22:22:11.686229+0000","last_undegraded":"2024-08-18T22:22:11.686229+0000","last_fullsized":"2024-08-18T22:22:11.686229+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:44:32.585650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.423965+0000","last_change":"2024-08-18T22:22:10.423965+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.423965+0000","last_undegraded":"2024-08-18T22:22:10.423965+0000","last_fullsized":"2024-08-18T22:22:10.423965+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663831+0000","last_change":"2024-08-18T22:22:11.690698+0000","last_active":"2024-08-18T22:22:12.663831+0000","last_peered":"2024-08-18T22:22:12.663831+0000","last_clean":"2024-08-18T22:22:12.663831+0000","last_became_active":"2024-08-18T22:22:11.690395+0000","last_became_peered":"2024-08-18T22:22:11.690395+0000","last_unstale":"2024-08-18T22:22:12.663831+0000","last_undegraded":"2024-08-18T22:22:12.663831+0000","last_fullsized":"2024-08-18T22:22:12.663831+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:24.841562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.687694+0000","last_change":"2024-08-18T22:22:11.679618+0000","last_active":"2024-08-18T22:22:11.687694+0000","last_peered":"2024-08-18T22:22:11.687694+0000","last_clean":"2024-08-18T22:22:11.687694+0000","last_became_active":"2024-08-18T22:22:11.679314+0000","last_became_peered":"2024-08-18T22:22:11.679314+0000","last_unstale":"2024-08-18T22:22:11.687694+0000","last_undegraded":"2024-08-18T22:22:11.687694+0000","last_fullsized":"2024-08-18T22:22:11.687694+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:52.105226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434534+0000","last_change":"2024-08-18T22:22:11.701031+0000","last_active":"2024-08-18T22:22:12.434534+0000","last_peered":"2024-08-18T22:22:12.434534+0000","last_clean":"2024-08-18T22:22:12.434534+0000","last_became_active":"2024-08-18T22:22:11.698895+0000","last_became_peered":"2024-08-18T22:22:11.698895+0000","last_unstale":"2024-08-18T22:22:12.434534+0000","last_undegraded":"2024-08-18T22:22:12.434534+0000","last_fullsized":"2024-08-18T22:22:12.434534+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436082+0000","last_change":"2024-08-18T22:22:11.436504+0000","last_active":"2024-08-18T22:22:12.436082+0000","last_peered":"2024-08-18T22:22:12.436082+0000","last_clean":"2024-08-18T22:22:12.436082+0000","last_became_active":"2024-08-18T22:22:11.436178+0000","last_became_peered":"2024-08-18T22:22:11.436178+0000","last_unstale":"2024-08-18T22:22:12.436082+0000","last_undegraded":"2024-08-18T22:22:12.436082+0000","last_fullsized":"2024-08-18T22:22:12.436082+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:26.302065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686620+0000","last_change":"2024-08-18T22:22:11.678730+0000","last_active":"2024-08-18T22:22:11.686620+0000","last_peered":"2024-08-18T22:22:11.686620+0000","last_clean":"2024-08-18T22:22:11.686620+0000","last_became_active":"2024-08-18T22:22:11.678412+0000","last_became_peered":"2024-08-18T22:22:11.678412+0000","last_unstale":"2024-08-18T22:22:11.686620+0000","last_undegraded":"2024-08-18T22:22:11.686620+0000","last_fullsized":"2024-08-18T22:22:11.686620+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:40.583712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435557+0000","last_change":"2024-08-18T22:22:11.678067+0000","last_active":"2024-08-18T22:22:12.435557+0000","last_peered":"2024-08-18T22:22:12.435557+0000","last_clean":"2024-08-18T22:22:12.435557+0000","last_became_active":"2024-08-18T22:22:11.677369+0000","last_became_peered":"2024-08-18T22:22:11.677369+0000","last_unstale":"2024-08-18T22:22:12.435557+0000","last_undegraded":"2024-08-18T22:22:12.435557+0000","last_fullsized":"2024-08-18T22:22:12.435557+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:19.801891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436665+0000","last_change":"2024-08-18T22:22:11.438865+0000","last_active":"2024-08-18T22:22:12.436665+0000","last_peered":"2024-08-18T22:22:12.436665+0000","last_clean":"2024-08-18T22:22:12.436665+0000","last_became_active":"2024-08-18T22:22:11.438478+0000","last_became_peered":"2024-08-18T22:22:11.438478+0000","last_unstale":"2024-08-18T22:22:12.436665+0000","last_undegraded":"2024-08-18T22:22:12.436665+0000","last_fullsized":"2024-08-18T22:22:12.436665+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435197+0000","last_change":"2024-08-18T22:22:11.676615+0000","last_active":"2024-08-18T22:22:12.435197+0000","last_peered":"2024-08-18T22:22:12.435197+0000","last_clean":"2024-08-18T22:22:12.435197+0000","last_became_active":"2024-08-18T22:22:11.676354+0000","last_became_peered":"2024-08-18T22:22:11.676354+0000","last_unstale":"2024-08-18T22:22:12.435197+0000","last_undegraded":"2024-08-18T22:22:12.435197+0000","last_fullsized":"2024-08-18T22:22:12.435197+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:26.623153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.434745+0000","last_change":"2024-08-18T22:22:11.428854+0000","last_active":"2024-08-18T22:22:11.434745+0000","last_peered":"2024-08-18T22:22:11.434745+0000","last_clean":"2024-08-18T22:22:11.434745+0000","last_became_active":"2024-08-18T22:22:11.428471+0000","last_became_peered":"2024-08-18T22:22:11.428471+0000","last_unstale":"2024-08-18T22:22:11.434745+0000","last_undegraded":"2024-08-18T22:22:11.434745+0000","last_fullsized":"2024-08-18T22:22:11.434745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:31:36.024442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.436275+0000","last_change":"2024-08-18T22:22:11.434529+0000","last_active":"2024-08-18T22:22:11.436275+0000","last_peered":"2024-08-18T22:22:11.436275+0000","last_clean":"2024-08-18T22:22:11.436275+0000","last_became_active":"2024-08-18T22:22:11.434213+0000","last_became_peered":"2024-08-18T22:22:11.434213+0000","last_unstale":"2024-08-18T22:22:11.436275+0000","last_undegraded":"2024-08-18T22:22:11.436275+0000","last_fullsized":"2024-08-18T22:22:11.436275+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:51.767649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663686+0000","last_change":"2024-08-18T22:22:11.704537+0000","last_active":"2024-08-18T22:22:12.663686+0000","last_peered":"2024-08-18T22:22:12.663686+0000","last_clean":"2024-08-18T22:22:12.663686+0000","last_became_active":"2024-08-18T22:22:11.704264+0000","last_became_peered":"2024-08-18T22:22:11.704264+0000","last_unstale":"2024-08-18T22:22:12.663686+0000","last_undegraded":"2024-08-18T22:22:12.663686+0000","last_fullsized":"2024-08-18T22:22:12.663686+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:32.138824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.422243+0000","last_change":"2024-08-18T22:22:10.422243+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.422243+0000","last_undegraded":"2024-08-18T22:22:10.422243+0000","last_fullsized":"2024-08-18T22:22:10.422243+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434327+0000","last_change":"2024-08-18T22:22:11.688871+0000","last_active":"2024-08-18T22:22:12.434327+0000","last_peered":"2024-08-18T22:22:12.434327+0000","last_clean":"2024-08-18T22:22:12.434327+0000","last_became_active":"2024-08-18T22:22:11.688602+0000","last_became_peered":"2024-08-18T22:22:11.688602+0000","last_unstale":"2024-08-18T22:22:12.434327+0000","last_undegraded":"2024-08-18T22:22:12.434327+0000","last_fullsized":"2024-08-18T22:22:12.434327+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435719+0000","last_change":"2024-08-18T22:22:11.699877+0000","last_active":"2024-08-18T22:22:12.435719+0000","last_peered":"2024-08-18T22:22:12.435719+0000","last_clean":"2024-08-18T22:22:12.435719+0000","last_became_active":"2024-08-18T22:22:11.698188+0000","last_became_peered":"2024-08-18T22:22:11.698188+0000","last_unstale":"2024-08-18T22:22:12.435719+0000","last_undegraded":"2024-08-18T22:22:12.435719+0000","last_fullsized":"2024-08-18T22:22:12.435719+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:02.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664211+0000","last_change":"2024-08-18T22:22:11.693386+0000","last_active":"2024-08-18T22:22:12.664211+0000","last_peered":"2024-08-18T22:22:12.664211+0000","last_clean":"2024-08-18T22:22:12.664211+0000","last_became_active":"2024-08-18T22:22:11.693112+0000","last_became_peered":"2024-08-18T22:22:11.693112+0000","last_unstale":"2024-08-18T22:22:12.664211+0000","last_undegraded":"2024-08-18T22:22:12.664211+0000","last_fullsized":"2024-08-18T22:22:12.664211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:11.368781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686724+0000","last_change":"2024-08-18T22:22:11.681723+0000","last_active":"2024-08-18T22:22:11.686724+0000","last_peered":"2024-08-18T22:22:11.686724+0000","last_clean":"2024-08-18T22:22:11.686724+0000","last_became_active":"2024-08-18T22:22:11.681477+0000","last_became_peered":"2024-08-18T22:22:11.681477+0000","last_unstale":"2024-08-18T22:22:11.686724+0000","last_undegraded":"2024-08-18T22:22:11.686724+0000","last_fullsized":"2024-08-18T22:22:11.686724+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:54.446791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.682519+0000","last_change":"2024-08-18T22:22:11.681994+0000","last_active":"2024-08-18T22:22:11.682519+0000","last_peered":"2024-08-18T22:22:11.682519+0000","last_clean":"2024-08-18T22:22:11.682519+0000","last_became_active":"2024-08-18T22:22:11.681612+0000","last_became_peered":"2024-08-18T22:22:11.681612+0000","last_unstale":"2024-08-18T22:22:11.682519+0000","last_undegraded":"2024-08-18T22:22:11.682519+0000","last_fullsized":"2024-08-18T22:22:11.682519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:52.105226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434496+0000","last_change":"2024-08-18T22:22:11.674918+0000","last_active":"2024-08-18T22:22:12.434496+0000","last_peered":"2024-08-18T22:22:12.434496+0000","last_clean":"2024-08-18T22:22:12.434496+0000","last_became_active":"2024-08-18T22:22:11.674651+0000","last_became_peered":"2024-08-18T22:22:11.674651+0000","last_unstale":"2024-08-18T22:22:12.434496+0000","last_undegraded":"2024-08-18T22:22:12.434496+0000","last_fullsized":"2024-08-18T22:22:12.434496+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436444+0000","last_change":"2024-08-18T22:22:11.684544+0000","last_active":"2024-08-18T22:22:12.436444+0000","last_peered":"2024-08-18T22:22:12.436444+0000","last_clean":"2024-08-18T22:22:12.436444+0000","last_became_active":"2024-08-18T22:22:11.684231+0000","last_became_peered":"2024-08-18T22:22:11.684231+0000","last_unstale":"2024-08-18T22:22:12.436444+0000","last_undegraded":"2024-08-18T22:22:12.436444+0000","last_fullsized":"2024-08-18T22:22:12.436444+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434464+0000","last_change":"2024-08-18T22:22:11.694141+0000","last_active":"2024-08-18T22:22:12.434464+0000","last_peered":"2024-08-18T22:22:12.434464+0000","last_clean":"2024-08-18T22:22:12.434464+0000","last_became_active":"2024-08-18T22:22:11.690937+0000","last_became_peered":"2024-08-18T22:22:11.690937+0000","last_unstale":"2024-08-18T22:22:12.434464+0000","last_undegraded":"2024-08-18T22:22:12.434464+0000","last_fullsized":"2024-08-18T22:22:12.434464+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436109+0000","last_change":"2024-08-18T22:22:11.692230+0000","last_active":"2024-08-18T22:22:12.436109+0000","last_peered":"2024-08-18T22:22:12.436109+0000","last_clean":"2024-08-18T22:22:12.436109+0000","last_became_active":"2024-08-18T22:22:11.691972+0000","last_became_peered":"2024-08-18T22:22:11.691972+0000","last_unstale":"2024-08-18T22:22:12.436109+0000","last_undegraded":"2024-08-18T22:22:12.436109+0000","last_fullsized":"2024-08-18T22:22:12.436109+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:01.509300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435700+0000","last_change":"2024-08-18T22:22:11.438891+0000","last_active":"2024-08-18T22:22:12.435700+0000","last_peered":"2024-08-18T22:22:12.435700+0000","last_clean":"2024-08-18T22:22:12.435700+0000","last_became_active":"2024-08-18T22:22:11.438571+0000","last_became_peered":"2024-08-18T22:22:11.438571+0000","last_unstale":"2024-08-18T22:22:12.435700+0000","last_undegraded":"2024-08-18T22:22:12.435700+0000","last_fullsized":"2024-08-18T22:22:12.435700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:13.622996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"54'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.440725+0000","last_change":"2024-08-18T22:22:10.430588+0000","last_active":"2024-08-18T22:22:11.440725+0000","last_peered":"2024-08-18T22:22:11.440725+0000","last_clean":"2024-08-18T22:22:11.440725+0000","last_became_active":"2024-08-18T22:22:10.430291+0000","last_became_peered":"2024-08-18T22:22:10.430291+0000","last_unstale":"2024-08-18T22:22:11.440725+0000","last_undegraded":"2024-08-18T22:22:11.440725+0000","last_fullsized":"2024-08-18T22:22:11.440725+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:55.985496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436761+0000","last_change":"2024-08-18T22:22:11.437753+0000","last_active":"2024-08-18T22:22:12.436761+0000","last_peered":"2024-08-18T22:22:12.436761+0000","last_clean":"2024-08-18T22:22:12.436761+0000","last_became_active":"2024-08-18T22:22:11.437447+0000","last_became_peered":"2024-08-18T22:22:11.437447+0000","last_unstale":"2024-08-18T22:22:12.436761+0000","last_undegraded":"2024-08-18T22:22:12.436761+0000","last_fullsized":"2024-08-18T22:22:12.436761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.695976+0000","last_change":"2024-08-18T22:22:10.444416+0000","last_active":"2024-08-18T22:22:11.695976+0000","last_peered":"2024-08-18T22:22:11.695976+0000","last_clean":"2024-08-18T22:22:11.695976+0000","last_became_active":"2024-08-18T22:22:10.443904+0000","last_became_peered":"2024-08-18T22:22:10.443904+0000","last_unstale":"2024-08-18T22:22:11.695976+0000","last_undegraded":"2024-08-18T22:22:11.695976+0000","last_fullsized":"2024-08-18T22:22:11.695976+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:41.576670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.436460+0000","last_change":"2024-08-18T22:22:11.434634+0000","last_active":"2024-08-18T22:22:11.436460+0000","last_peered":"2024-08-18T22:22:11.436460+0000","last_clean":"2024-08-18T22:22:11.436460+0000","last_became_active":"2024-08-18T22:22:11.434339+0000","last_became_peered":"2024-08-18T22:22:11.434339+0000","last_unstale":"2024-08-18T22:22:11.436460+0000","last_undegraded":"2024-08-18T22:22:11.436460+0000","last_fullsized":"2024-08-18T22:22:11.436460+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:27.184054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.692067+0000","last_change":"2024-08-18T22:22:10.445086+0000","last_active":"2024-08-18T22:22:11.692067+0000","last_peered":"2024-08-18T22:22:11.692067+0000","last_clean":"2024-08-18T22:22:11.692067+0000","last_became_active":"2024-08-18T22:22:10.443901+0000","last_became_peered":"2024-08-18T22:22:10.443901+0000","last_unstale":"2024-08-18T22:22:11.692067+0000","last_undegraded":"2024-08-18T22:22:11.692067+0000","last_fullsized":"2024-08-18T22:22:11.692067+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:50.763870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663686+0000","last_change":"2024-08-18T22:22:11.696062+0000","last_active":"2024-08-18T22:22:12.663686+0000","last_peered":"2024-08-18T22:22:12.663686+0000","last_clean":"2024-08-18T22:22:12.663686+0000","last_became_active":"2024-08-18T22:22:11.693315+0000","last_became_peered":"2024-08-18T22:22:11.693315+0000","last_unstale":"2024-08-18T22:22:12.663686+0000","last_undegraded":"2024-08-18T22:22:12.663686+0000","last_fullsized":"2024-08-18T22:22:12.663686+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:35.835298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437395+0000","last_change":"2024-08-18T22:22:10.437524+0000","last_active":"2024-08-18T22:22:12.437395+0000","last_peered":"2024-08-18T22:22:12.437395+0000","last_clean":"2024-08-18T22:22:12.437395+0000","last_became_active":"2024-08-18T22:22:10.437205+0000","last_became_peered":"2024-08-18T22:22:10.437205+0000","last_unstale":"2024-08-18T22:22:12.437395+0000","last_undegraded":"2024-08-18T22:22:12.437395+0000","last_fullsized":"2024-08-18T22:22:12.437395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:38:35.135643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421708+0000","last_change":"2024-08-18T22:22:10.421708+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421708+0000","last_undegraded":"2024-08-18T22:22:10.421708+0000","last_fullsized":"2024-08-18T22:22:10.421708+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434997+0000","last_change":"2024-08-18T22:22:10.446348+0000","last_active":"2024-08-18T22:22:12.434997+0000","last_peered":"2024-08-18T22:22:12.434997+0000","last_clean":"2024-08-18T22:22:12.434997+0000","last_became_active":"2024-08-18T22:22:10.445868+0000","last_became_peered":"2024-08-18T22:22:10.445868+0000","last_unstale":"2024-08-18T22:22:12.434997+0000","last_undegraded":"2024-08-18T22:22:12.434997+0000","last_fullsized":"2024-08-18T22:22:12.434997+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:17:41.384026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436303+0000","last_change":"2024-08-18T22:22:11.685125+0000","last_active":"2024-08-18T22:22:12.436303+0000","last_peered":"2024-08-18T22:22:12.436303+0000","last_clean":"2024-08-18T22:22:12.436303+0000","last_became_active":"2024-08-18T22:22:11.684877+0000","last_became_peered":"2024-08-18T22:22:11.684877+0000","last_unstale":"2024-08-18T22:22:12.436303+0000","last_undegraded":"2024-08-18T22:22:12.436303+0000","last_fullsized":"2024-08-18T22:22:12.436303+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.434867+0000","last_change":"2024-08-18T22:22:10.430868+0000","last_active":"2024-08-18T22:22:10.434867+0000","last_peered":"2024-08-18T22:22:10.434867+0000","last_clean":"2024-08-18T22:22:10.434867+0000","last_became_active":"2024-08-18T22:22:10.430580+0000","last_became_peered":"2024-08-18T22:22:10.430580+0000","last_unstale":"2024-08-18T22:22:10.434867+0000","last_undegraded":"2024-08-18T22:22:10.434867+0000","last_fullsized":"2024-08-18T22:22:10.434867+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:31:35.633828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664190+0000","last_change":"2024-08-18T22:22:11.688121+0000","last_active":"2024-08-18T22:22:12.664190+0000","last_peered":"2024-08-18T22:22:12.664190+0000","last_clean":"2024-08-18T22:22:12.664190+0000","last_became_active":"2024-08-18T22:22:11.687691+0000","last_became_peered":"2024-08-18T22:22:11.687691+0000","last_unstale":"2024-08-18T22:22:12.664190+0000","last_undegraded":"2024-08-18T22:22:12.664190+0000","last_fullsized":"2024-08-18T22:22:12.664190+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:42:20.647483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.422044+0000","last_change":"2024-08-18T22:22:10.432702+0000","last_active":"2024-08-18T22:22:11.422044+0000","last_peered":"2024-08-18T22:22:11.422044+0000","last_clean":"2024-08-18T22:22:11.422044+0000","last_became_active":"2024-08-18T22:22:10.432258+0000","last_became_peered":"2024-08-18T22:22:10.432258+0000","last_unstale":"2024-08-18T22:22:11.422044+0000","last_undegraded":"2024-08-18T22:22:11.422044+0000","last_fullsized":"2024-08-18T22:22:11.422044+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:01:07.848661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436605+0000","last_change":"2024-08-18T22:22:11.675403+0000","last_active":"2024-08-18T22:22:12.436605+0000","last_peered":"2024-08-18T22:22:12.436605+0000","last_clean":"2024-08-18T22:22:12.436605+0000","last_became_active":"2024-08-18T22:22:11.675113+0000","last_became_peered":"2024-08-18T22:22:11.675113+0000","last_unstale":"2024-08-18T22:22:12.436605+0000","last_undegraded":"2024-08-18T22:22:12.436605+0000","last_fullsized":"2024-08-18T22:22:12.436605+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434330+0000","last_change":"2024-08-18T22:22:10.433218+0000","last_active":"2024-08-18T22:22:12.434330+0000","last_peered":"2024-08-18T22:22:12.434330+0000","last_clean":"2024-08-18T22:22:12.434330+0000","last_became_active":"2024-08-18T22:22:10.432947+0000","last_became_peered":"2024-08-18T22:22:10.432947+0000","last_unstale":"2024-08-18T22:22:12.434330+0000","last_undegraded":"2024-08-18T22:22:12.434330+0000","last_fullsized":"2024-08-18T22:22:12.434330+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:51.101447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421236+0000","last_change":"2024-08-18T22:22:10.421236+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421236+0000","last_undegraded":"2024-08-18T22:22:10.421236+0000","last_fullsized":"2024-08-18T22:22:10.421236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436697+0000","last_change":"2024-08-18T22:22:10.434355+0000","last_active":"2024-08-18T22:22:12.436697+0000","last_peered":"2024-08-18T22:22:12.436697+0000","last_clean":"2024-08-18T22:22:12.436697+0000","last_became_active":"2024-08-18T22:22:10.434027+0000","last_became_peered":"2024-08-18T22:22:10.434027+0000","last_unstale":"2024-08-18T22:22:12.436697+0000","last_undegraded":"2024-08-18T22:22:12.436697+0000","last_fullsized":"2024-08-18T22:22:12.436697+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:05:15.817540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436618+0000","last_change":"2024-08-18T22:22:11.440263+0000","last_active":"2024-08-18T22:22:12.436618+0000","last_peered":"2024-08-18T22:22:12.436618+0000","last_clean":"2024-08-18T22:22:12.436618+0000","last_became_active":"2024-08-18T22:22:11.439371+0000","last_became_peered":"2024-08-18T22:22:11.439371+0000","last_unstale":"2024-08-18T22:22:12.436618+0000","last_undegraded":"2024-08-18T22:22:12.436618+0000","last_fullsized":"2024-08-18T22:22:12.436618+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.436265+0000","last_change":"2024-08-18T22:22:10.434830+0000","last_active":"2024-08-18T22:22:10.436265+0000","last_peered":"2024-08-18T22:22:10.436265+0000","last_clean":"2024-08-18T22:22:10.436265+0000","last_became_active":"2024-08-18T22:22:10.434370+0000","last_became_peered":"2024-08-18T22:22:10.434370+0000","last_unstale":"2024-08-18T22:22:10.436265+0000","last_undegraded":"2024-08-18T22:22:10.436265+0000","last_fullsized":"2024-08-18T22:22:10.436265+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:32:11.671929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434721+0000","last_change":"2024-08-18T22:22:11.674739+0000","last_active":"2024-08-18T22:22:12.434721+0000","last_peered":"2024-08-18T22:22:12.434721+0000","last_clean":"2024-08-18T22:22:12.434721+0000","last_became_active":"2024-08-18T22:22:11.674451+0000","last_became_peered":"2024-08-18T22:22:11.674451+0000","last_unstale":"2024-08-18T22:22:12.434721+0000","last_undegraded":"2024-08-18T22:22:12.434721+0000","last_fullsized":"2024-08-18T22:22:12.434721+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:31.682951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"54'3","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436528+0000","last_change":"2024-08-18T22:22:10.445969+0000","last_active":"2024-08-18T22:22:12.436528+0000","last_peered":"2024-08-18T22:22:12.436528+0000","last_clean":"2024-08-18T22:22:12.436528+0000","last_became_active":"2024-08-18T22:22:10.445685+0000","last_became_peered":"2024-08-18T22:22:10.445685+0000","last_unstale":"2024-08-18T22:22:12.436528+0000","last_undegraded":"2024-08-18T22:22:12.436528+0000","last_fullsized":"2024-08-18T22:22:12.436528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:34:40.944063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.420415+0000","last_change":"2024-08-18T22:22:10.420415+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.420415+0000","last_undegraded":"2024-08-18T22:22:10.420415+0000","last_fullsized":"2024-08-18T22:22:10.420415+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664023+0000","last_change":"2024-08-18T22:22:10.441766+0000","last_active":"2024-08-18T22:22:12.664023+0000","last_peered":"2024-08-18T22:22:12.664023+0000","last_clean":"2024-08-18T22:22:12.664023+0000","last_became_active":"2024-08-18T22:22:10.441345+0000","last_became_peered":"2024-08-18T22:22:10.441345+0000","last_unstale":"2024-08-18T22:22:12.664023+0000","last_undegraded":"2024-08-18T22:22:12.664023+0000","last_fullsized":"2024-08-18T22:22:12.664023+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:00.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437013+0000","last_change":"2024-08-18T22:22:11.439705+0000","last_active":"2024-08-18T22:22:12.437013+0000","last_peered":"2024-08-18T22:22:12.437013+0000","last_clean":"2024-08-18T22:22:12.437013+0000","last_became_active":"2024-08-18T22:22:11.439381+0000","last_became_peered":"2024-08-18T22:22:11.439381+0000","last_unstale":"2024-08-18T22:22:12.437013+0000","last_undegraded":"2024-08-18T22:22:12.437013+0000","last_fullsized":"2024-08-18T22:22:12.437013+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435001+0000","last_change":"2024-08-18T22:22:10.435837+0000","last_active":"2024-08-18T22:22:12.435001+0000","last_peered":"2024-08-18T22:22:12.435001+0000","last_clean":"2024-08-18T22:22:12.435001+0000","last_became_active":"2024-08-18T22:22:10.435534+0000","last_became_peered":"2024-08-18T22:22:10.435534+0000","last_unstale":"2024-08-18T22:22:12.435001+0000","last_undegraded":"2024-08-18T22:22:12.435001+0000","last_fullsized":"2024-08-18T22:22:12.435001+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:53.443012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435338+0000","last_change":"2024-08-18T22:22:11.686961+0000","last_active":"2024-08-18T22:22:12.435338+0000","last_peered":"2024-08-18T22:22:12.435338+0000","last_clean":"2024-08-18T22:22:12.435338+0000","last_became_active":"2024-08-18T22:22:11.686690+0000","last_became_peered":"2024-08-18T22:22:11.686690+0000","last_unstale":"2024-08-18T22:22:12.435338+0000","last_undegraded":"2024-08-18T22:22:12.435338+0000","last_fullsized":"2024-08-18T22:22:12.435338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:57:48.800840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.421253+0000","last_change":"2024-08-18T22:22:10.435408+0000","last_active":"2024-08-18T22:22:11.421253+0000","last_peered":"2024-08-18T22:22:11.421253+0000","last_clean":"2024-08-18T22:22:11.421253+0000","last_became_active":"2024-08-18T22:22:10.435141+0000","last_became_peered":"2024-08-18T22:22:10.435141+0000","last_unstale":"2024-08-18T22:22:11.421253+0000","last_undegraded":"2024-08-18T22:22:11.421253+0000","last_fullsized":"2024-08-18T22:22:11.421253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:52.760163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664018+0000","last_change":"2024-08-18T22:22:11.680794+0000","last_active":"2024-08-18T22:22:12.664018+0000","last_peered":"2024-08-18T22:22:12.664018+0000","last_clean":"2024-08-18T22:22:12.664018+0000","last_became_active":"2024-08-18T22:22:11.680510+0000","last_became_peered":"2024-08-18T22:22:11.680510+0000","last_unstale":"2024-08-18T22:22:12.664018+0000","last_undegraded":"2024-08-18T22:22:12.664018+0000","last_fullsized":"2024-08-18T22:22:12.664018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:09.366034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436203+0000","last_change":"2024-08-18T22:22:10.430246+0000","last_active":"2024-08-18T22:22:12.436203+0000","last_peered":"2024-08-18T22:22:12.436203+0000","last_clean":"2024-08-18T22:22:12.436203+0000","last_became_active":"2024-08-18T22:22:10.429923+0000","last_became_peered":"2024-08-18T22:22:10.429923+0000","last_unstale":"2024-08-18T22:22:12.436203+0000","last_undegraded":"2024-08-18T22:22:12.436203+0000","last_fullsized":"2024-08-18T22:22:12.436203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:44:29.431155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435499+0000","last_change":"2024-08-18T22:22:11.677704+0000","last_active":"2024-08-18T22:22:12.435499+0000","last_peered":"2024-08-18T22:22:12.435499+0000","last_clean":"2024-08-18T22:22:12.435499+0000","last_became_active":"2024-08-18T22:22:11.676998+0000","last_became_peered":"2024-08-18T22:22:11.676998+0000","last_unstale":"2024-08-18T22:22:12.435499+0000","last_undegraded":"2024-08-18T22:22:12.435499+0000","last_fullsized":"2024-08-18T22:22:12.435499+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:32.138824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663844+0000","last_change":"2024-08-18T22:22:10.444587+0000","last_active":"2024-08-18T22:22:12.663844+0000","last_peered":"2024-08-18T22:22:12.663844+0000","last_clean":"2024-08-18T22:22:12.663844+0000","last_became_active":"2024-08-18T22:22:10.440296+0000","last_became_peered":"2024-08-18T22:22:10.440296+0000","last_unstale":"2024-08-18T22:22:12.663844+0000","last_undegraded":"2024-08-18T22:22:12.663844+0000","last_fullsized":"2024-08-18T22:22:12.663844+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:25.298286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663734+0000","last_change":"2024-08-18T22:22:11.694606+0000","last_active":"2024-08-18T22:22:12.663734+0000","last_peered":"2024-08-18T22:22:12.663734+0000","last_clean":"2024-08-18T22:22:12.663734+0000","last_became_active":"2024-08-18T22:22:11.694331+0000","last_became_peered":"2024-08-18T22:22:11.694331+0000","last_unstale":"2024-08-18T22:22:12.663734+0000","last_undegraded":"2024-08-18T22:22:12.663734+0000","last_fullsized":"2024-08-18T22:22:12.663734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:02.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435676+0000","last_change":"2024-08-18T22:22:10.444339+0000","last_active":"2024-08-18T22:22:12.435676+0000","last_peered":"2024-08-18T22:22:12.435676+0000","last_clean":"2024-08-18T22:22:12.435676+0000","last_became_active":"2024-08-18T22:22:10.442957+0000","last_became_peered":"2024-08-18T22:22:10.442957+0000","last_unstale":"2024-08-18T22:22:12.435676+0000","last_undegraded":"2024-08-18T22:22:12.435676+0000","last_fullsized":"2024-08-18T22:22:12.435676+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:36.521543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686160+0000","last_change":"2024-08-18T22:22:11.677128+0000","last_active":"2024-08-18T22:22:11.686160+0000","last_peered":"2024-08-18T22:22:11.686160+0000","last_clean":"2024-08-18T22:22:11.686160+0000","last_became_active":"2024-08-18T22:22:11.676813+0000","last_became_peered":"2024-08-18T22:22:11.676813+0000","last_unstale":"2024-08-18T22:22:11.686160+0000","last_undegraded":"2024-08-18T22:22:11.686160+0000","last_fullsized":"2024-08-18T22:22:11.686160+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:31:36.024442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.445295+0000","last_change":"2024-08-18T22:22:10.434500+0000","last_active":"2024-08-18T22:22:10.445295+0000","last_peered":"2024-08-18T22:22:10.445295+0000","last_clean":"2024-08-18T22:22:10.445295+0000","last_became_active":"2024-08-18T22:22:10.431542+0000","last_became_peered":"2024-08-18T22:22:10.431542+0000","last_unstale":"2024-08-18T22:22:10.445295+0000","last_undegraded":"2024-08-18T22:22:10.445295+0000","last_fullsized":"2024-08-18T22:22:10.445295+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:43.691497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421963+0000","last_change":"2024-08-18T22:22:10.421963+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421963+0000","last_undegraded":"2024-08-18T22:22:10.421963+0000","last_fullsized":"2024-08-18T22:22:10.421963+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686186+0000","last_change":"2024-08-18T22:22:10.445708+0000","last_active":"2024-08-18T22:22:11.686186+0000","last_peered":"2024-08-18T22:22:11.686186+0000","last_clean":"2024-08-18T22:22:11.686186+0000","last_became_active":"2024-08-18T22:22:10.445397+0000","last_became_peered":"2024-08-18T22:22:10.445397+0000","last_unstale":"2024-08-18T22:22:11.686186+0000","last_undegraded":"2024-08-18T22:22:11.686186+0000","last_fullsized":"2024-08-18T22:22:11.686186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:22.379698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.685628+0000","last_change":"2024-08-18T22:22:11.676481+0000","last_active":"2024-08-18T22:22:11.685628+0000","last_peered":"2024-08-18T22:22:11.685628+0000","last_clean":"2024-08-18T22:22:11.685628+0000","last_became_active":"2024-08-18T22:22:11.675869+0000","last_became_peered":"2024-08-18T22:22:11.675869+0000","last_unstale":"2024-08-18T22:22:11.685628+0000","last_undegraded":"2024-08-18T22:22:11.685628+0000","last_fullsized":"2024-08-18T22:22:11.685628+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:45.613060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.422259+0000","last_change":"2024-08-18T22:22:10.430687+0000","last_active":"2024-08-18T22:22:11.422259+0000","last_peered":"2024-08-18T22:22:11.422259+0000","last_clean":"2024-08-18T22:22:11.422259+0000","last_became_active":"2024-08-18T22:22:10.430161+0000","last_became_peered":"2024-08-18T22:22:10.430161+0000","last_unstale":"2024-08-18T22:22:11.422259+0000","last_undegraded":"2024-08-18T22:22:11.422259+0000","last_fullsized":"2024-08-18T22:22:11.422259+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:44.609281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437196+0000","last_change":"2024-08-18T22:22:11.441544+0000","last_active":"2024-08-18T22:22:12.437196+0000","last_peered":"2024-08-18T22:22:12.437196+0000","last_clean":"2024-08-18T22:22:12.437196+0000","last_became_active":"2024-08-18T22:22:11.441261+0000","last_became_peered":"2024-08-18T22:22:11.441261+0000","last_unstale":"2024-08-18T22:22:12.437196+0000","last_undegraded":"2024-08-18T22:22:12.437196+0000","last_fullsized":"2024-08-18T22:22:12.437196+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.692073+0000","last_change":"2024-08-18T22:22:10.444168+0000","last_active":"2024-08-18T22:22:11.692073+0000","last_peered":"2024-08-18T22:22:11.692073+0000","last_clean":"2024-08-18T22:22:11.692073+0000","last_became_active":"2024-08-18T22:22:10.443546+0000","last_became_peered":"2024-08-18T22:22:10.443546+0000","last_unstale":"2024-08-18T22:22:11.692073+0000","last_undegraded":"2024-08-18T22:22:11.692073+0000","last_fullsized":"2024-08-18T22:22:11.692073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:26.180275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.434642+0000","last_change":"2024-08-18T22:22:11.428926+0000","last_active":"2024-08-18T22:22:11.434642+0000","last_peered":"2024-08-18T22:22:11.434642+0000","last_clean":"2024-08-18T22:22:11.434642+0000","last_became_active":"2024-08-18T22:22:11.428494+0000","last_became_peered":"2024-08-18T22:22:11.428494+0000","last_unstale":"2024-08-18T22:22:11.434642+0000","last_undegraded":"2024-08-18T22:22:11.434642+0000","last_fullsized":"2024-08-18T22:22:11.434642+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:40.583712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663933+0000","last_change":"2024-08-18T22:22:10.439941+0000","last_active":"2024-08-18T22:22:12.663933+0000","last_peered":"2024-08-18T22:22:12.663933+0000","last_clean":"2024-08-18T22:22:12.663933+0000","last_became_active":"2024-08-18T22:22:10.439643+0000","last_became_peered":"2024-08-18T22:22:10.439643+0000","last_unstale":"2024-08-18T22:22:12.663933+0000","last_undegraded":"2024-08-18T22:22:12.663933+0000","last_fullsized":"2024-08-18T22:22:12.663933+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:17.149522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435392+0000","last_change":"2024-08-18T22:22:11.674241+0000","last_active":"2024-08-18T22:22:12.435392+0000","last_peered":"2024-08-18T22:22:12.435392+0000","last_clean":"2024-08-18T22:22:12.435392+0000","last_became_active":"2024-08-18T22:22:11.673969+0000","last_became_peered":"2024-08-18T22:22:11.673969+0000","last_unstale":"2024-08-18T22:22:12.435392+0000","last_undegraded":"2024-08-18T22:22:12.435392+0000","last_fullsized":"2024-08-18T22:22:12.435392+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:35.835298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434493+0000","last_change":"2024-08-18T22:22:10.447007+0000","last_active":"2024-08-18T22:22:12.434493+0000","last_peered":"2024-08-18T22:22:12.434493+0000","last_clean":"2024-08-18T22:22:12.434493+0000","last_became_active":"2024-08-18T22:22:10.446729+0000","last_became_peered":"2024-08-18T22:22:10.446729+0000","last_unstale":"2024-08-18T22:22:12.434493+0000","last_undegraded":"2024-08-18T22:22:12.434493+0000","last_fullsized":"2024-08-18T22:22:12.434493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:44:31.581871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.689947+0000","last_change":"2024-08-18T22:22:11.684053+0000","last_active":"2024-08-18T22:22:11.689947+0000","last_peered":"2024-08-18T22:22:11.689947+0000","last_clean":"2024-08-18T22:22:11.689947+0000","last_became_active":"2024-08-18T22:22:11.683737+0000","last_became_peered":"2024-08-18T22:22:11.683737+0000","last_unstale":"2024-08-18T22:22:11.689947+0000","last_undegraded":"2024-08-18T22:22:11.689947+0000","last_fullsized":"2024-08-18T22:22:11.689947+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:41.408974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.444995+0000","last_change":"2024-08-18T22:22:10.435989+0000","last_active":"2024-08-18T22:22:10.444995+0000","last_peered":"2024-08-18T22:22:10.444995+0000","last_clean":"2024-08-18T22:22:10.444995+0000","last_became_active":"2024-08-18T22:22:10.435491+0000","last_became_peered":"2024-08-18T22:22:10.435491+0000","last_unstale":"2024-08-18T22:22:10.444995+0000","last_undegraded":"2024-08-18T22:22:10.444995+0000","last_fullsized":"2024-08-18T22:22:10.444995+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:25:42.535149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436249+0000","last_change":"2024-08-18T22:22:11.685875+0000","last_active":"2024-08-18T22:22:12.436249+0000","last_peered":"2024-08-18T22:22:12.436249+0000","last_clean":"2024-08-18T22:22:12.436249+0000","last_became_active":"2024-08-18T22:22:11.685542+0000","last_became_peered":"2024-08-18T22:22:11.685542+0000","last_unstale":"2024-08-18T22:22:12.436249+0000","last_undegraded":"2024-08-18T22:22:12.436249+0000","last_fullsized":"2024-08-18T22:22:12.436249+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:26.302065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.675016+0000","last_change":"2024-08-18T22:22:10.438951+0000","last_active":"2024-08-18T22:22:11.675016+0000","last_peered":"2024-08-18T22:22:11.675016+0000","last_clean":"2024-08-18T22:22:11.675016+0000","last_became_active":"2024-08-18T22:22:10.438629+0000","last_became_peered":"2024-08-18T22:22:10.438629+0000","last_unstale":"2024-08-18T22:22:11.675016+0000","last_undegraded":"2024-08-18T22:22:11.675016+0000","last_fullsized":"2024-08-18T22:22:11.675016+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:52.125406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.692669+0000","last_change":"2024-08-18T22:22:11.689322+0000","last_active":"2024-08-18T22:22:11.692669+0000","last_peered":"2024-08-18T22:22:11.692669+0000","last_clean":"2024-08-18T22:22:11.692669+0000","last_became_active":"2024-08-18T22:22:11.689002+0000","last_became_peered":"2024-08-18T22:22:11.689002+0000","last_unstale":"2024-08-18T22:22:11.692669+0000","last_undegraded":"2024-08-18T22:22:11.692669+0000","last_fullsized":"2024-08-18T22:22:11.692669+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:37.525322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436640+0000","last_change":"2024-08-18T22:22:10.437824+0000","last_active":"2024-08-18T22:22:12.436640+0000","last_peered":"2024-08-18T22:22:12.436640+0000","last_clean":"2024-08-18T22:22:12.436640+0000","last_became_active":"2024-08-18T22:22:10.437457+0000","last_became_peered":"2024-08-18T22:22:10.437457+0000","last_unstale":"2024-08-18T22:22:12.436640+0000","last_undegraded":"2024-08-18T22:22:12.436640+0000","last_fullsized":"2024-08-18T22:22:12.436640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:05.210105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663838+0000","last_change":"2024-08-18T22:22:11.684534+0000","last_active":"2024-08-18T22:22:12.663838+0000","last_peered":"2024-08-18T22:22:12.663838+0000","last_clean":"2024-08-18T22:22:12.663838+0000","last_became_active":"2024-08-18T22:22:11.678903+0000","last_became_peered":"2024-08-18T22:22:11.678903+0000","last_unstale":"2024-08-18T22:22:12.663838+0000","last_undegraded":"2024-08-18T22:22:12.663838+0000","last_fullsized":"2024-08-18T22:22:12.663838+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:39.828882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435106+0000","last_change":"2024-08-18T22:22:10.443792+0000","last_active":"2024-08-18T22:22:12.435106+0000","last_peered":"2024-08-18T22:22:12.435106+0000","last_clean":"2024-08-18T22:22:12.435106+0000","last_became_active":"2024-08-18T22:22:10.443526+0000","last_became_peered":"2024-08-18T22:22:10.443526+0000","last_unstale":"2024-08-18T22:22:12.435106+0000","last_undegraded":"2024-08-18T22:22:12.435106+0000","last_fullsized":"2024-08-18T22:22:12.435106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:40.405195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435096+0000","last_change":"2024-08-18T22:22:11.697582+0000","last_active":"2024-08-18T22:22:12.435096+0000","last_peered":"2024-08-18T22:22:12.435096+0000","last_clean":"2024-08-18T22:22:12.435096+0000","last_became_active":"2024-08-18T22:22:11.696095+0000","last_became_peered":"2024-08-18T22:22:11.696095+0000","last_unstale":"2024-08-18T22:22:12.435096+0000","last_undegraded":"2024-08-18T22:22:12.435096+0000","last_fullsized":"2024-08-18T22:22:12.435096+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:03:06.402713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663942+0000","last_change":"2024-08-18T22:22:10.444120+0000","last_active":"2024-08-18T22:22:12.663942+0000","last_peered":"2024-08-18T22:22:12.663942+0000","last_clean":"2024-08-18T22:22:12.663942+0000","last_became_active":"2024-08-18T22:22:10.439575+0000","last_became_peered":"2024-08-18T22:22:10.439575+0000","last_unstale":"2024-08-18T22:22:12.663942+0000","last_undegraded":"2024-08-18T22:22:12.663942+0000","last_fullsized":"2024-08-18T22:22:12.663942+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:36:02.531876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436867+0000","last_change":"2024-08-18T22:22:11.439736+0000","last_active":"2024-08-18T22:22:12.436867+0000","last_peered":"2024-08-18T22:22:12.436867+0000","last_clean":"2024-08-18T22:22:12.436867+0000","last_became_active":"2024-08-18T22:22:11.439435+0000","last_became_peered":"2024-08-18T22:22:11.439435+0000","last_unstale":"2024-08-18T22:22:12.436867+0000","last_undegraded":"2024-08-18T22:22:12.436867+0000","last_fullsized":"2024-08-18T22:22:12.436867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663891+0000","last_change":"2024-08-18T22:22:10.446577+0000","last_active":"2024-08-18T22:22:12.663891+0000","last_peered":"2024-08-18T22:22:12.663891+0000","last_clean":"2024-08-18T22:22:12.663891+0000","last_became_active":"2024-08-18T22:22:10.445524+0000","last_became_peered":"2024-08-18T22:22:10.445524+0000","last_unstale":"2024-08-18T22:22:12.663891+0000","last_undegraded":"2024-08-18T22:22:12.663891+0000","last_fullsized":"2024-08-18T22:22:12.663891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:56:38.716953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435338+0000","last_change":"2024-08-18T22:22:11.691037+0000","last_active":"2024-08-18T22:22:12.435338+0000","last_peered":"2024-08-18T22:22:12.435338+0000","last_clean":"2024-08-18T22:22:12.435338+0000","last_became_active":"2024-08-18T22:22:11.690232+0000","last_became_peered":"2024-08-18T22:22:11.690232+0000","last_unstale":"2024-08-18T22:22:12.435338+0000","last_undegraded":"2024-08-18T22:22:12.435338+0000","last_fullsized":"2024-08-18T22:22:12.435338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:48.099976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.435850+0000","last_change":"2024-08-18T22:22:10.434323+0000","last_active":"2024-08-18T22:22:10.435850+0000","last_peered":"2024-08-18T22:22:10.435850+0000","last_clean":"2024-08-18T22:22:10.435850+0000","last_became_active":"2024-08-18T22:22:10.433352+0000","last_became_peered":"2024-08-18T22:22:10.433352+0000","last_unstale":"2024-08-18T22:22:10.435850+0000","last_undegraded":"2024-08-18T22:22:10.435850+0000","last_fullsized":"2024-08-18T22:22:10.435850+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:13:48.107104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664299+0000","last_change":"2024-08-18T22:22:11.707772+0000","last_active":"2024-08-18T22:22:12.664299+0000","last_peered":"2024-08-18T22:22:12.664299+0000","last_clean":"2024-08-18T22:22:12.664299+0000","last_became_active":"2024-08-18T22:22:11.707504+0000","last_became_peered":"2024-08-18T22:22:11.707504+0000","last_unstale":"2024-08-18T22:22:12.664299+0000","last_undegraded":"2024-08-18T22:22:12.664299+0000","last_fullsized":"2024-08-18T22:22:12.664299+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:12:52.604419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436339+0000","last_change":"2024-08-18T22:22:10.445621+0000","last_active":"2024-08-18T22:22:12.436339+0000","last_peered":"2024-08-18T22:22:12.436339+0000","last_clean":"2024-08-18T22:22:12.436339+0000","last_became_active":"2024-08-18T22:22:10.445287+0000","last_became_peered":"2024-08-18T22:22:10.445287+0000","last_unstale":"2024-08-18T22:22:12.436339+0000","last_undegraded":"2024-08-18T22:22:12.436339+0000","last_fullsized":"2024-08-18T22:22:12.436339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:52.642569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.441851+0000","last_change":"2024-08-18T22:22:11.439402+0000","last_active":"2024-08-18T22:22:11.441851+0000","last_peered":"2024-08-18T22:22:11.441851+0000","last_clean":"2024-08-18T22:22:11.441851+0000","last_became_active":"2024-08-18T22:22:11.439124+0000","last_became_peered":"2024-08-18T22:22:11.439124+0000","last_unstale":"2024-08-18T22:22:11.441851+0000","last_undegraded":"2024-08-18T22:22:11.441851+0000","last_fullsized":"2024-08-18T22:22:11.441851+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:42.580449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"55'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:13.429354+0000","last_change":"2024-08-18T22:22:10.439170+0000","last_active":"2024-08-18T22:22:13.429354+0000","last_peered":"2024-08-18T22:22:13.429354+0000","last_clean":"2024-08-18T22:22:13.429354+0000","last_became_active":"2024-08-18T22:22:10.438722+0000","last_became_peered":"2024-08-18T22:22:10.438722+0000","last_unstale":"2024-08-18T22:22:13.429354+0000","last_undegraded":"2024-08-18T22:22:13.429354+0000","last_fullsized":"2024-08-18T22:22:13.429354+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:05.210105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":239,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435645+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:22:12.435645+0000","last_peered":"2024-08-18T22:22:12.435645+0000","last_clean":"2024-08-18T22:22:12.435645+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:22:12.435645+0000","last_undegraded":"2024-08-18T22:22:12.435645+0000","last_fullsized":"2024-08-18T22:22:12.435645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36560,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335280,"statfs":{"total":96636764160,"available":96599326720,"internally_reserved":0,"allocated":1249280,"data_stored":881685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35968,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335872,"statfs":{"total":96636764160,"available":96599932928,"internally_reserved":0,"allocated":643072,"data_stored":285153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":647168,"data_stored":291193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40148,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331692,"statfs":{"total":96636764160,"available":96595652608,"internally_reserved":0,"allocated":663552,"data_stored":292827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35968,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335872,"statfs":{"total":96636764160,"available":96599932928,"internally_reserved":0,"allocated":643072,"data_stored":284661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1249280,"data_stored":881617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":610304,"data_stored":270667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35936,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335904,"statfs":{"total":96636764160,"available":96599965696,"internally_reserved":0,"allocated":610304,"data_stored":270667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:22:16.372 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-08-18T22:22:16.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:22:10.420920+0000', 'last_change': '2024-08-18T22:22:10.420920+0000', 'last_active': '2024-08-18T22:22:10.407943+0000', 'last_peered': '2024-08-18T22:22:10.407943+0000', 'last_clean': '2024-08-18T22:22:10.407943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:22:10.420920+0000', 'last_undegraded': '2024-08-18T22:22:10.420920+0000', 'last_fullsized': '2024-08-18T22:22:10.420920+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_clean_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T22:22:16.372 INFO:tasks.ceph.ceph_manager.ceph:PG 8.35 is not active+clean 2024-08-18T22:22:16.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:22:10.423965+0000', 'last_change': '2024-08-18T22:22:10.423965+0000', 'last_active': '2024-08-18T22:22:10.407943+0000', 'last_peered': '2024-08-18T22:22:10.407943+0000', 'last_clean': '2024-08-18T22:22:10.407943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:22:10.423965+0000', 'last_undegraded': '2024-08-18T22:22:10.423965+0000', 'last_fullsized': '2024-08-18T22:22:10.423965+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_clean_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-18T22:22:16.372 INFO:tasks.ceph.ceph_manager.ceph:PG 8.29 is not active+clean 2024-08-18T22:22:16.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:22:10.422243+0000', 'last_change': '2024-08-18T22:22:10.422243+0000', 'last_active': '2024-08-18T22:22:10.407943+0000', 'last_peered': '2024-08-18T22:22:10.407943+0000', 'last_clean': '2024-08-18T22:22:10.407943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:22:10.422243+0000', 'last_undegraded': '2024-08-18T22:22:10.422243+0000', 'last_fullsized': '2024-08-18T22:22:10.422243+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_clean_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-18T22:22:16.373 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-08-18T22:22:16.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:22:10.421708+0000', 'last_change': '2024-08-18T22:22:10.421708+0000', 'last_active': '2024-08-18T22:22:10.407943+0000', 'last_peered': '2024-08-18T22:22:10.407943+0000', 'last_clean': '2024-08-18T22:22:10.407943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:22:10.421708+0000', 'last_undegraded': '2024-08-18T22:22:10.421708+0000', 'last_fullsized': '2024-08-18T22:22:10.421708+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_clean_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T22:22:16.373 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-08-18T22:22:16.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:22:10.421236+0000', 'last_change': '2024-08-18T22:22:10.421236+0000', 'last_active': '2024-08-18T22:22:10.407943+0000', 'last_peered': '2024-08-18T22:22:10.407943+0000', 'last_clean': '2024-08-18T22:22:10.407943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:22:10.421236+0000', 'last_undegraded': '2024-08-18T22:22:10.421236+0000', 'last_fullsized': '2024-08-18T22:22:10.421236+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_clean_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T22:22:16.373 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-08-18T22:22:16.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:22:10.420415+0000', 'last_change': '2024-08-18T22:22:10.420415+0000', 'last_active': '2024-08-18T22:22:10.407943+0000', 'last_peered': '2024-08-18T22:22:10.407943+0000', 'last_clean': '2024-08-18T22:22:10.407943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:22:10.420415+0000', 'last_undegraded': '2024-08-18T22:22:10.420415+0000', 'last_fullsized': '2024-08-18T22:22:10.420415+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_clean_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T22:22:16.373 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-08-18T22:22:16.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:22:10.421963+0000', 'last_change': '2024-08-18T22:22:10.421963+0000', 'last_active': '2024-08-18T22:22:10.407943+0000', 'last_peered': '2024-08-18T22:22:10.407943+0000', 'last_clean': '2024-08-18T22:22:10.407943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:22:10.421963+0000', 'last_undegraded': '2024-08-18T22:22:10.421963+0000', 'last_fullsized': '2024-08-18T22:22:10.421963+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'last_clean_scrub_stamp': '2024-08-18T22:22:10.407943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T22:22:16.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:22:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.551+0000 7f710b200640 1 Processor -- start 2024-08-18T22:22:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.551+0000 7f710b200640 1 -- start start 2024-08-18T22:22:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.551+0000 7f710b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c09aa40 0x7f710c15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.551+0000 7f710b200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c0ccd90 con 0x7f710c0cde30 2024-08-18T22:22:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.551+0000 7f710b200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c0cd070 con 0x7f710c0b4510 2024-08-18T22:22:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.551+0000 7f710b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f710c0ce770 con 0x7f710c09aa40 2024-08-18T22:22:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.551+0000 7f7109400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f710c0cde30 0x7f710c09ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59338/0 (socket says 172.21.15.5:59338) 2024-08-18T22:22:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.551+0000 7f7109400640 1 -- 172.21.15.5:0/3369295238 learned_addr learned my addr 172.21.15.5:0/3369295238 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7109e00640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c09aa40 0x7f710c15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642076802 0 0) 0x7f710c0ccd90 con 0x7f710c0cde30 2024-08-18T22:22:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70f0003530 con 0x7f710c0cde30 2024-08-18T22:22:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 747679343 0 0) 0x7f710c0cd070 con 0x7f710c0b4510 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f710c0ccd90 con 0x7f710c0b4510 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4076545983 0 0) 0x7f70f0003530 con 0x7f710c0cde30 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c09aa40 msgr2=0x7f710c15cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c09aa40 0x7f710c15cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 >> v1:172.21.15.117:6789/0 conn(0x7f710c0b4510 legacy=0x7f710c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c0cd350 con 0x7f710c0cde30 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7109e00640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c09aa40 0x7f710c15cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f70f8001680 con 0x7f710c0cde30 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 >> v1:172.21.15.5:6789/0 conn(0x7f710c0cde30 legacy=0x7f710c09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 0x7f70f0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c09aa40 0x7f70f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f0004d50 0x7f70f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0ce770 con 0x7f70f0003b80 2024-08-18T22:22:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f70f000bab0 con 0x7f70f0004d50 2024-08-18T22:22:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f70f000bcb0 con 0x7f710c09aa40 2024-08-18T22:22:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7109e00640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 0x7f70f0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7109400640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c09aa40 0x7f70f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f710a800640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f0004d50 0x7f70f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7109e00640 1 -- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c09aa40 msgr2=0x7f70f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7109e00640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c09aa40 0x7f70f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7109e00640 1 -- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f0004d50 msgr2=0x7f70f00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7109e00640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70f0004d50 0x7f70f00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.555+0000 7f7109e00640 1 -- 172.21.15.5:0/3369295238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f0003530 con 0x7f70f0003b80 2024-08-18T22:22:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f7109e00640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 0x7f70f0003f80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009cb0 tx=0x7f70fc01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cd8ef7bd97035d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0b2070 con 0x7f70f0003b80 2024-08-18T22:22:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70fc0a5880 con 0x7f70f0003b80 2024-08-18T22:22:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f7108a00640 1 -- 172.21.15.5:0/3369295238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc009880 con 0x7f70f0003b80 2024-08-18T22:22:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f710b200640 1 -- 172.21.15.5:0/3369295238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 msgr2=0x7f70f0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f710b200640 1 --2- 172.21.15.5:0/3369295238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 0x7f70f0003f80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009cb0 tx=0x7f70fc01cbe0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f710a800640 1 -- 172.21.15.5:0/3369295238 reap_dead start 2024-08-18T22:22:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f710b200640 1 -- 172.21.15.5:0/3369295238 shutdown_connections 2024-08-18T22:22:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f710b200640 1 -- 172.21.15.5:0/3369295238 >> 172.21.15.5:0/3369295238 conn(0x7f710c0b3a20 msgr2=0x7f710c0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f710b200640 1 -- 172.21.15.5:0/3369295238 shutdown_connections 2024-08-18T22:22:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f710b200640 1 -- 172.21.15.5:0/3369295238 wait complete. 2024-08-18T22:22:16.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f710b200640 1 Processor -- start 2024-08-18T22:22:16.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.559+0000 7f710b200640 1 -- start start 2024-08-18T22:22:16.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f710b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 0x7f710c15a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f710b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c0b06b0 0x7f710c0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f710b200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f710c15e6b0 0x7f710c15eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f710b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f710c15c3b0 con 0x7f70f0003b80 2024-08-18T22:22:16.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f710b200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f710c15c230 con 0x7f710c15e6b0 2024-08-18T22:22:16.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f710b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f710c167e40 con 0x7f710c0b06b0 2024-08-18T22:22:16.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7109e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 0x7f710c15a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7109e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 0x7f710c15a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52882/0 (socket says 172.21.15.5:52882) 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7109e00640 1 -- 172.21.15.5:0/3842913409 learned_addr learned my addr 172.21.15.5:0/3842913409 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7109400640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c0b06b0 0x7f710c0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f710a800640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f710c15e6b0 0x7f710c15eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7109e00640 1 -- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c0b06b0 msgr2=0x7f710c0b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7109e00640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c0b06b0 0x7f710c0b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7109e00640 1 -- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f710c15e6b0 msgr2=0x7f710c15eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7109e00640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f710c15e6b0 0x7f710c15eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7109e00640 1 -- 172.21.15.5:0/3842913409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c15ac10 con 0x7f70f0003b80 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7109e00640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 0x7f710c15a6d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0985e0 tx=0x7f70f0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7102000640 1 -- 172.21.15.5:0/3842913409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0b2040 con 0x7f70f0003b80 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7102000640 1 -- 172.21.15.5:0/3842913409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70fc009400 con 0x7f70f0003b80 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f710b200640 1 -- 172.21.15.5:0/3842913409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c0af030 con 0x7f70f0003b80 2024-08-18T22:22:16.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7102000640 1 -- 172.21.15.5:0/3842913409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc004220 con 0x7f70f0003b80 2024-08-18T22:22:16.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f710b200640 1 -- 172.21.15.5:0/3842913409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c0af5f0 con 0x7f70f0003b80 2024-08-18T22:22:16.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f710b200640 1 -- 172.21.15.5:0/3842913409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c0cfb00 con 0x7f70f0003b80 2024-08-18T22:22:16.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.563+0000 7f7102000640 1 -- 172.21.15.5:0/3842913409 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70fc003620 con 0x7f70f0003b80 2024-08-18T22:22:16.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.567+0000 7f7102000640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70ec0678c0 0x7f70ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:16.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.567+0000 7f7102000640 1 -- 172.21.15.5:0/3842913409 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f70fc11f540 con 0x7f70f0003b80 2024-08-18T22:22:16.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.567+0000 7f7109400640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70ec0678c0 0x7f70ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:16.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.567+0000 7f7109400640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70ec0678c0 0x7f70ec069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f710c0b33a0 tx=0x7f70f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:16.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.571+0000 7f7102000640 1 -- 172.21.15.5:0/3842913409 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f70fc016920 con 0x7f70f0003b80 2024-08-18T22:22:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.795+0000 7f710b200640 1 -- 172.21.15.5:0/3842913409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f710c073d40 con 0x7f70f0003b80 2024-08-18T22:22:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:16.801 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":200,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":55,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":90},{"state_name":"creating+peering","count":7}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":304353280,"bytes_avail":772789760000,"bytes_total":773094113280,"inactive_pgs_ratio":0.072164945304393768,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":26,"btime":"2024-08-18T22:22:14:439692+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5370}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-08-18T22:21:59.656284+0000","services":{}},"progress_events":{}} 2024-08-18T22:22:17.036 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-08-18T22:22:17.031+0000 7f1400400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:22:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.795+0000 7f7102000640 1 -- 172.21.15.5:0/3842913409 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1141 (secure 0 0 0) 0x7f70fc0ef770 con 0x7f70f0003b80 2024-08-18T22:22:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 -- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70ec0678c0 msgr2=0x7f70ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70ec0678c0 0x7f70ec069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f710c0b33a0 tx=0x7f70f8009040 comp rx=0 tx=0).stop 2024-08-18T22:22:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 -- 172.21.15.5:0/3842913409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 msgr2=0x7f710c15a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 0x7f710c15a6d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0985e0 tx=0x7f70f0005840 comp rx=0 tx=0).stop 2024-08-18T22:22:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 -- 172.21.15.5:0/3842913409 shutdown_connections 2024-08-18T22:22:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f70ec0678c0 0x7f70ec069d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f710c15e6b0 0x7f710c15eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f710c0b06b0 0x7f710c0b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 --2- 172.21.15.5:0/3842913409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f0003b80 0x7f710c15a6d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 -- 172.21.15.5:0/3842913409 >> 172.21.15.5:0/3842913409 conn(0x7f710c0b3a20 msgr2=0x7f710c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:17.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 -- 172.21.15.5:0/3842913409 shutdown_connections 2024-08-18T22:22:17.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:16.799+0000 7f710b200640 1 -- 172.21.15.5:0/3842913409 wait complete. 2024-08-18T22:22:17.096 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-18T22:22:17.096 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:22:17.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.243+0000 7fdcc5000640 1 Processor -- start 2024-08-18T22:22:17.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcc5000640 1 -- start start 2024-08-18T22:22:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcc5000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcc006b9b0 0x7fdcc00ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcc5000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdcc006bd90 0x7fdcc01453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcc5000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc00cca00 0x7fdcc00cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcc5000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc00b0bd0 con 0x7fdcc006b9b0 2024-08-18T22:22:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcc5000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc00b0e90 con 0x7fdcc006bd90 2024-08-18T22:22:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcc5000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc00b1170 con 0x7fdcc00cca00 2024-08-18T22:22:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcbde00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcc006b9b0 0x7fdcc00ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcbde00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcc006b9b0 0x7fdcc00ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52894/0 (socket says 172.21.15.5:52894) 2024-08-18T22:22:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcbde00640 1 -- 172.21.15.5:0/1277074795 learned_addr learned my addr 172.21.15.5:0/1277074795 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:17.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcbde00640 1 -- 172.21.15.5:0/1277074795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc00cca00 msgr2=0x7fdcc00cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:17.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcbde00640 1 --2- 172.21.15.5:0/1277074795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc00cca00 0x7fdcc00cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcbde00640 1 -- 172.21.15.5:0/1277074795 >> v2:172.21.15.117:3300/0 conn(0x7fdcc006bd90 msgr2=0x7fdcc01453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:17.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcb5400640 1 --2- 172.21.15.5:0/1277074795 >> v2:172.21.15.117:3300/0 conn(0x7fdcc006bd90 0x7fdcc01453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:17.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcbde00640 1 --2- 172.21.15.5:0/1277074795 >> v2:172.21.15.117:3300/0 conn(0x7fdcc006bd90 0x7fdcc01453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcbde00640 1 -- 172.21.15.5:0/1277074795 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc00b1450 con 0x7fdcc006b9b0 2024-08-18T22:22:17.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.247+0000 7fdcb5400640 1 --2- 172.21.15.5:0/1277074795 >> v2:172.21.15.117:3300/0 conn(0x7fdcc006bd90 0x7fdcc01453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:17.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcbde00640 1 --2- 172.21.15.5:0/1277074795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc006b9b0 0x7fdcc00ce520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdcc006e5a0 tx=0x7fdcb001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d368eb59ccc67f5c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:17.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcbd400640 1 -- 172.21.15.5:0/1277074795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00b1070 con 0x7fdcc006b9b0 2024-08-18T22:22:17.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcbd400640 1 -- 172.21.15.5:0/1277074795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb00ac630 con 0x7fdcc006b9b0 2024-08-18T22:22:17.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcbd400640 1 -- 172.21.15.5:0/1277074795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00a8050 con 0x7fdcc006b9b0 2024-08-18T22:22:17.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcc5000640 1 -- 172.21.15.5:0/1277074795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc006b9b0 msgr2=0x7fdcc00ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:17.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcc5000640 1 --2- 172.21.15.5:0/1277074795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc006b9b0 0x7fdcc00ce520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdcc006e5a0 tx=0x7fdcb001c4f0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcc5000640 1 -- 172.21.15.5:0/1277074795 shutdown_connections 2024-08-18T22:22:17.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcc5000640 1 --2- 172.21.15.5:0/1277074795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc00cca00 0x7fdcc00cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcc5000640 1 --2- 172.21.15.5:0/1277074795 >> v2:172.21.15.117:3300/0 conn(0x7fdcc006bd90 0x7fdcc01453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcc5000640 1 --2- 172.21.15.5:0/1277074795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc006b9b0 0x7fdcc00ce520 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcc5000640 1 -- 172.21.15.5:0/1277074795 >> 172.21.15.5:0/1277074795 conn(0x7fdcc009aa40 msgr2=0x7fdcc00b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:17.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcc5000640 1 -- 172.21.15.5:0/1277074795 shutdown_connections 2024-08-18T22:22:17.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcc5000640 1 -- 172.21.15.5:0/1277074795 wait complete. 2024-08-18T22:22:17.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcc5000640 1 Processor -- start 2024-08-18T22:22:17.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.251+0000 7fdcc5000640 1 -- start start 2024-08-18T22:22:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcc5000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc006b9b0 0x7fdcc015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcc5000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc006bd90 0x7fdcc015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcc5000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc00cca00 0x7fdcc009e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcc5000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc00cd960 con 0x7fdcc006bd90 2024-08-18T22:22:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcc5000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc00cd7e0 con 0x7fdcc006b9b0 2024-08-18T22:22:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcc5000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc006c170 con 0x7fdcc00cca00 2024-08-18T22:22:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcb5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc006bd90 0x7fdcc015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcbde00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc006b9b0 0x7fdcc015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcbde00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc006b9b0 0x7fdcc015ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:41570/0 (socket says 172.21.15.5:41570) 2024-08-18T22:22:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcbde00640 1 -- 172.21.15.5:0/1404226153 learned_addr learned my addr 172.21.15.5:0/1404226153 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcbe800640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc00cca00 0x7fdcc009e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcbde00640 1 -- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc00cca00 msgr2=0x7fdcc009e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcbde00640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc00cca00 0x7fdcc009e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcbde00640 1 -- 172.21.15.5:0/1404226153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc006bd90 msgr2=0x7fdcc015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcbde00640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc006bd90 0x7fdcc015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcbde00640 1 -- 172.21.15.5:0/1404226153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc013ebf0 con 0x7fdcc006b9b0 2024-08-18T22:22:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcbde00640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc006b9b0 0x7fdcc015ae80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00097c0 tx=0x7fdcb0019290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:17.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcb6a00640 1 -- 172.21.15.5:0/1404226153 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00bc070 con 0x7fdcc006b9b0 2024-08-18T22:22:17.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcb6a00640 1 -- 172.21.15.5:0/1404226153 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb00ab5e0 con 0x7fdcc006b9b0 2024-08-18T22:22:17.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcb6a00640 1 -- 172.21.15.5:0/1404226153 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00b1070 con 0x7fdcc006b9b0 2024-08-18T22:22:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcc5000640 1 -- 172.21.15.5:0/1404226153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc013eed0 con 0x7fdcc006b9b0 2024-08-18T22:22:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcc5000640 1 -- 172.21.15.5:0/1404226153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc013f1b0 con 0x7fdcc006b9b0 2024-08-18T22:22:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.255+0000 7fdcc5000640 1 -- 172.21.15.5:0/1404226153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc00ae040 con 0x7fdcc006b9b0 2024-08-18T22:22:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.259+0000 7fdcb6a00640 1 -- 172.21.15.5:0/1404226153 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdcb00bf070 con 0x7fdcc006b9b0 2024-08-18T22:22:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.259+0000 7fdcb6a00640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678f0 0x7fdc9c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.259+0000 7fdcb6a00640 1 -- 172.21.15.5:0/1404226153 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fdcb011f700 con 0x7fdcc006b9b0 2024-08-18T22:22:17.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.259+0000 7fdcb5400640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678f0 0x7fdc9c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:17.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.259+0000 7fdcb5400640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678f0 0x7fdc9c069db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdcc01404d0 tx=0x7fdca8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:17.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.263+0000 7fdcb6a00640 1 -- 172.21.15.5:0/1404226153 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdcb0016110 con 0x7fdcc006b9b0 2024-08-18T22:22:17.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.439+0000 7fdcc5000640 1 -- 172.21.15.5:0/1404226153 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdcc006c6c0 con 0x7fdc9c0678f0 2024-08-18T22:22:17.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.447+0000 7fdcb6a00640 1 -- 172.21.15.5:0/1404226153 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251362 (secure 0 0 0) 0x7fdcc006c6c0 con 0x7fdc9c0678f0 2024-08-18T22:22:17.453 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:22:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 -- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678f0 msgr2=0x7fdc9c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678f0 0x7fdc9c069db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdcc01404d0 tx=0x7fdca8008040 comp rx=0 tx=0).stop 2024-08-18T22:22:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 -- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc006b9b0 msgr2=0x7fdcc015ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc006b9b0 0x7fdcc015ae80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00097c0 tx=0x7fdcb0019290 comp rx=0 tx=0).stop 2024-08-18T22:22:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 -- 172.21.15.5:0/1404226153 shutdown_connections 2024-08-18T22:22:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678f0 0x7fdc9c069db0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc00cca00 0x7fdcc009e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc006bd90 0x7fdcc015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 --2- 172.21.15.5:0/1404226153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc006b9b0 0x7fdcc015ae80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 -- 172.21.15.5:0/1404226153 >> 172.21.15.5:0/1404226153 conn(0x7fdcc009aa40 msgr2=0x7fdcc00b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 -- 172.21.15.5:0/1404226153 shutdown_connections 2024-08-18T22:22:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:17.451+0000 7fdcc5000640 1 -- 172.21.15.5:0/1404226153 wait complete. 2024-08-18T22:22:17.475 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-08-18T22:22:15.659988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297220,"kb_used_data":6168,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677500,"statfs":{"total":773094113280,"available":772789760000,"internally_reserved":0,"allocated":6316032,"data_stored":3458470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001537"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.685732+0000","last_change":"2024-08-18T22:22:11.676580+0000","last_active":"2024-08-18T22:22:11.685732+0000","last_peered":"2024-08-18T22:22:11.685732+0000","last_clean":"2024-08-18T22:22:11.685732+0000","last_became_active":"2024-08-18T22:22:11.676262+0000","last_became_peered":"2024-08-18T22:22:11.676262+0000","last_unstale":"2024-08-18T22:22:11.685732+0000","last_undegraded":"2024-08-18T22:22:11.685732+0000","last_fullsized":"2024-08-18T22:22:11.685732+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:23.383477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436525+0000","last_change":"2024-08-18T22:22:11.440271+0000","last_active":"2024-08-18T22:22:12.436525+0000","last_peered":"2024-08-18T22:22:12.436525+0000","last_clean":"2024-08-18T22:22:12.436525+0000","last_became_active":"2024-08-18T22:22:11.438676+0000","last_became_peered":"2024-08-18T22:22:11.438676+0000","last_unstale":"2024-08-18T22:22:12.436525+0000","last_undegraded":"2024-08-18T22:22:12.436525+0000","last_fullsized":"2024-08-18T22:22:12.436525+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435228+0000","last_change":"2024-08-18T22:22:11.696380+0000","last_active":"2024-08-18T22:22:12.435228+0000","last_peered":"2024-08-18T22:22:12.435228+0000","last_clean":"2024-08-18T22:22:12.435228+0000","last_became_active":"2024-08-18T22:22:11.696082+0000","last_became_peered":"2024-08-18T22:22:11.696082+0000","last_unstale":"2024-08-18T22:22:12.435228+0000","last_undegraded":"2024-08-18T22:22:12.435228+0000","last_fullsized":"2024-08-18T22:22:12.435228+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:03.855436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436037+0000","last_change":"2024-08-18T22:22:11.682718+0000","last_active":"2024-08-18T22:22:12.436037+0000","last_peered":"2024-08-18T22:22:12.436037+0000","last_clean":"2024-08-18T22:22:12.436037+0000","last_became_active":"2024-08-18T22:22:11.682318+0000","last_became_peered":"2024-08-18T22:22:11.682318+0000","last_unstale":"2024-08-18T22:22:12.436037+0000","last_undegraded":"2024-08-18T22:22:12.436037+0000","last_fullsized":"2024-08-18T22:22:12.436037+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:01.509300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.420920+0000","last_change":"2024-08-18T22:22:10.420920+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.420920+0000","last_undegraded":"2024-08-18T22:22:10.420920+0000","last_fullsized":"2024-08-18T22:22:10.420920+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686120+0000","last_change":"2024-08-18T22:22:11.680962+0000","last_active":"2024-08-18T22:22:11.686120+0000","last_peered":"2024-08-18T22:22:11.686120+0000","last_clean":"2024-08-18T22:22:11.686120+0000","last_became_active":"2024-08-18T22:22:11.678373+0000","last_became_peered":"2024-08-18T22:22:11.678373+0000","last_unstale":"2024-08-18T22:22:11.686120+0000","last_undegraded":"2024-08-18T22:22:11.686120+0000","last_fullsized":"2024-08-18T22:22:11.686120+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:17:42.387805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434393+0000","last_change":"2024-08-18T22:22:11.694199+0000","last_active":"2024-08-18T22:22:12.434393+0000","last_peered":"2024-08-18T22:22:12.434393+0000","last_clean":"2024-08-18T22:22:12.434393+0000","last_became_active":"2024-08-18T22:22:11.693947+0000","last_became_peered":"2024-08-18T22:22:11.693947+0000","last_unstale":"2024-08-18T22:22:12.434393+0000","last_undegraded":"2024-08-18T22:22:12.434393+0000","last_fullsized":"2024-08-18T22:22:12.434393+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663710+0000","last_change":"2024-08-18T22:22:11.704329+0000","last_active":"2024-08-18T22:22:12.663710+0000","last_peered":"2024-08-18T22:22:12.663710+0000","last_clean":"2024-08-18T22:22:12.663710+0000","last_became_active":"2024-08-18T22:22:11.704045+0000","last_became_peered":"2024-08-18T22:22:11.704045+0000","last_unstale":"2024-08-18T22:22:12.663710+0000","last_undegraded":"2024-08-18T22:22:12.663710+0000","last_fullsized":"2024-08-18T22:22:12.663710+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:19.801891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664338+0000","last_change":"2024-08-18T22:22:11.707496+0000","last_active":"2024-08-18T22:22:12.664338+0000","last_peered":"2024-08-18T22:22:12.664338+0000","last_clean":"2024-08-18T22:22:12.664338+0000","last_became_active":"2024-08-18T22:22:11.706997+0000","last_became_peered":"2024-08-18T22:22:11.706997+0000","last_unstale":"2024-08-18T22:22:12.664338+0000","last_undegraded":"2024-08-18T22:22:12.664338+0000","last_fullsized":"2024-08-18T22:22:12.664338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:58:46.378942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686229+0000","last_change":"2024-08-18T22:22:11.679702+0000","last_active":"2024-08-18T22:22:11.686229+0000","last_peered":"2024-08-18T22:22:11.686229+0000","last_clean":"2024-08-18T22:22:11.686229+0000","last_became_active":"2024-08-18T22:22:11.679420+0000","last_became_peered":"2024-08-18T22:22:11.679420+0000","last_unstale":"2024-08-18T22:22:11.686229+0000","last_undegraded":"2024-08-18T22:22:11.686229+0000","last_fullsized":"2024-08-18T22:22:11.686229+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:44:32.585650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.423965+0000","last_change":"2024-08-18T22:22:10.423965+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.423965+0000","last_undegraded":"2024-08-18T22:22:10.423965+0000","last_fullsized":"2024-08-18T22:22:10.423965+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663831+0000","last_change":"2024-08-18T22:22:11.690698+0000","last_active":"2024-08-18T22:22:12.663831+0000","last_peered":"2024-08-18T22:22:12.663831+0000","last_clean":"2024-08-18T22:22:12.663831+0000","last_became_active":"2024-08-18T22:22:11.690395+0000","last_became_peered":"2024-08-18T22:22:11.690395+0000","last_unstale":"2024-08-18T22:22:12.663831+0000","last_undegraded":"2024-08-18T22:22:12.663831+0000","last_fullsized":"2024-08-18T22:22:12.663831+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:24.841562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.687694+0000","last_change":"2024-08-18T22:22:11.679618+0000","last_active":"2024-08-18T22:22:11.687694+0000","last_peered":"2024-08-18T22:22:11.687694+0000","last_clean":"2024-08-18T22:22:11.687694+0000","last_became_active":"2024-08-18T22:22:11.679314+0000","last_became_peered":"2024-08-18T22:22:11.679314+0000","last_unstale":"2024-08-18T22:22:11.687694+0000","last_undegraded":"2024-08-18T22:22:11.687694+0000","last_fullsized":"2024-08-18T22:22:11.687694+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:52.105226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434534+0000","last_change":"2024-08-18T22:22:11.701031+0000","last_active":"2024-08-18T22:22:12.434534+0000","last_peered":"2024-08-18T22:22:12.434534+0000","last_clean":"2024-08-18T22:22:12.434534+0000","last_became_active":"2024-08-18T22:22:11.698895+0000","last_became_peered":"2024-08-18T22:22:11.698895+0000","last_unstale":"2024-08-18T22:22:12.434534+0000","last_undegraded":"2024-08-18T22:22:12.434534+0000","last_fullsized":"2024-08-18T22:22:12.434534+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436082+0000","last_change":"2024-08-18T22:22:11.436504+0000","last_active":"2024-08-18T22:22:12.436082+0000","last_peered":"2024-08-18T22:22:12.436082+0000","last_clean":"2024-08-18T22:22:12.436082+0000","last_became_active":"2024-08-18T22:22:11.436178+0000","last_became_peered":"2024-08-18T22:22:11.436178+0000","last_unstale":"2024-08-18T22:22:12.436082+0000","last_undegraded":"2024-08-18T22:22:12.436082+0000","last_fullsized":"2024-08-18T22:22:12.436082+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:26.302065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686620+0000","last_change":"2024-08-18T22:22:11.678730+0000","last_active":"2024-08-18T22:22:11.686620+0000","last_peered":"2024-08-18T22:22:11.686620+0000","last_clean":"2024-08-18T22:22:11.686620+0000","last_became_active":"2024-08-18T22:22:11.678412+0000","last_became_peered":"2024-08-18T22:22:11.678412+0000","last_unstale":"2024-08-18T22:22:11.686620+0000","last_undegraded":"2024-08-18T22:22:11.686620+0000","last_fullsized":"2024-08-18T22:22:11.686620+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:40.583712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435557+0000","last_change":"2024-08-18T22:22:11.678067+0000","last_active":"2024-08-18T22:22:12.435557+0000","last_peered":"2024-08-18T22:22:12.435557+0000","last_clean":"2024-08-18T22:22:12.435557+0000","last_became_active":"2024-08-18T22:22:11.677369+0000","last_became_peered":"2024-08-18T22:22:11.677369+0000","last_unstale":"2024-08-18T22:22:12.435557+0000","last_undegraded":"2024-08-18T22:22:12.435557+0000","last_fullsized":"2024-08-18T22:22:12.435557+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:19.801891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436665+0000","last_change":"2024-08-18T22:22:11.438865+0000","last_active":"2024-08-18T22:22:12.436665+0000","last_peered":"2024-08-18T22:22:12.436665+0000","last_clean":"2024-08-18T22:22:12.436665+0000","last_became_active":"2024-08-18T22:22:11.438478+0000","last_became_peered":"2024-08-18T22:22:11.438478+0000","last_unstale":"2024-08-18T22:22:12.436665+0000","last_undegraded":"2024-08-18T22:22:12.436665+0000","last_fullsized":"2024-08-18T22:22:12.436665+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435197+0000","last_change":"2024-08-18T22:22:11.676615+0000","last_active":"2024-08-18T22:22:12.435197+0000","last_peered":"2024-08-18T22:22:12.435197+0000","last_clean":"2024-08-18T22:22:12.435197+0000","last_became_active":"2024-08-18T22:22:11.676354+0000","last_became_peered":"2024-08-18T22:22:11.676354+0000","last_unstale":"2024-08-18T22:22:12.435197+0000","last_undegraded":"2024-08-18T22:22:12.435197+0000","last_fullsized":"2024-08-18T22:22:12.435197+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:26.623153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.434745+0000","last_change":"2024-08-18T22:22:11.428854+0000","last_active":"2024-08-18T22:22:11.434745+0000","last_peered":"2024-08-18T22:22:11.434745+0000","last_clean":"2024-08-18T22:22:11.434745+0000","last_became_active":"2024-08-18T22:22:11.428471+0000","last_became_peered":"2024-08-18T22:22:11.428471+0000","last_unstale":"2024-08-18T22:22:11.434745+0000","last_undegraded":"2024-08-18T22:22:11.434745+0000","last_fullsized":"2024-08-18T22:22:11.434745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:31:36.024442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.436275+0000","last_change":"2024-08-18T22:22:11.434529+0000","last_active":"2024-08-18T22:22:11.436275+0000","last_peered":"2024-08-18T22:22:11.436275+0000","last_clean":"2024-08-18T22:22:11.436275+0000","last_became_active":"2024-08-18T22:22:11.434213+0000","last_became_peered":"2024-08-18T22:22:11.434213+0000","last_unstale":"2024-08-18T22:22:11.436275+0000","last_undegraded":"2024-08-18T22:22:11.436275+0000","last_fullsized":"2024-08-18T22:22:11.436275+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:51.767649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663686+0000","last_change":"2024-08-18T22:22:11.704537+0000","last_active":"2024-08-18T22:22:12.663686+0000","last_peered":"2024-08-18T22:22:12.663686+0000","last_clean":"2024-08-18T22:22:12.663686+0000","last_became_active":"2024-08-18T22:22:11.704264+0000","last_became_peered":"2024-08-18T22:22:11.704264+0000","last_unstale":"2024-08-18T22:22:12.663686+0000","last_undegraded":"2024-08-18T22:22:12.663686+0000","last_fullsized":"2024-08-18T22:22:12.663686+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:32.138824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.422243+0000","last_change":"2024-08-18T22:22:10.422243+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.422243+0000","last_undegraded":"2024-08-18T22:22:10.422243+0000","last_fullsized":"2024-08-18T22:22:10.422243+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434327+0000","last_change":"2024-08-18T22:22:11.688871+0000","last_active":"2024-08-18T22:22:12.434327+0000","last_peered":"2024-08-18T22:22:12.434327+0000","last_clean":"2024-08-18T22:22:12.434327+0000","last_became_active":"2024-08-18T22:22:11.688602+0000","last_became_peered":"2024-08-18T22:22:11.688602+0000","last_unstale":"2024-08-18T22:22:12.434327+0000","last_undegraded":"2024-08-18T22:22:12.434327+0000","last_fullsized":"2024-08-18T22:22:12.434327+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435719+0000","last_change":"2024-08-18T22:22:11.699877+0000","last_active":"2024-08-18T22:22:12.435719+0000","last_peered":"2024-08-18T22:22:12.435719+0000","last_clean":"2024-08-18T22:22:12.435719+0000","last_became_active":"2024-08-18T22:22:11.698188+0000","last_became_peered":"2024-08-18T22:22:11.698188+0000","last_unstale":"2024-08-18T22:22:12.435719+0000","last_undegraded":"2024-08-18T22:22:12.435719+0000","last_fullsized":"2024-08-18T22:22:12.435719+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:02.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664211+0000","last_change":"2024-08-18T22:22:11.693386+0000","last_active":"2024-08-18T22:22:12.664211+0000","last_peered":"2024-08-18T22:22:12.664211+0000","last_clean":"2024-08-18T22:22:12.664211+0000","last_became_active":"2024-08-18T22:22:11.693112+0000","last_became_peered":"2024-08-18T22:22:11.693112+0000","last_unstale":"2024-08-18T22:22:12.664211+0000","last_undegraded":"2024-08-18T22:22:12.664211+0000","last_fullsized":"2024-08-18T22:22:12.664211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:11.368781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686724+0000","last_change":"2024-08-18T22:22:11.681723+0000","last_active":"2024-08-18T22:22:11.686724+0000","last_peered":"2024-08-18T22:22:11.686724+0000","last_clean":"2024-08-18T22:22:11.686724+0000","last_became_active":"2024-08-18T22:22:11.681477+0000","last_became_peered":"2024-08-18T22:22:11.681477+0000","last_unstale":"2024-08-18T22:22:11.686724+0000","last_undegraded":"2024-08-18T22:22:11.686724+0000","last_fullsized":"2024-08-18T22:22:11.686724+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:54.446791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.682519+0000","last_change":"2024-08-18T22:22:11.681994+0000","last_active":"2024-08-18T22:22:11.682519+0000","last_peered":"2024-08-18T22:22:11.682519+0000","last_clean":"2024-08-18T22:22:11.682519+0000","last_became_active":"2024-08-18T22:22:11.681612+0000","last_became_peered":"2024-08-18T22:22:11.681612+0000","last_unstale":"2024-08-18T22:22:11.682519+0000","last_undegraded":"2024-08-18T22:22:11.682519+0000","last_fullsized":"2024-08-18T22:22:11.682519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:52.105226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434496+0000","last_change":"2024-08-18T22:22:11.674918+0000","last_active":"2024-08-18T22:22:12.434496+0000","last_peered":"2024-08-18T22:22:12.434496+0000","last_clean":"2024-08-18T22:22:12.434496+0000","last_became_active":"2024-08-18T22:22:11.674651+0000","last_became_peered":"2024-08-18T22:22:11.674651+0000","last_unstale":"2024-08-18T22:22:12.434496+0000","last_undegraded":"2024-08-18T22:22:12.434496+0000","last_fullsized":"2024-08-18T22:22:12.434496+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436444+0000","last_change":"2024-08-18T22:22:11.684544+0000","last_active":"2024-08-18T22:22:12.436444+0000","last_peered":"2024-08-18T22:22:12.436444+0000","last_clean":"2024-08-18T22:22:12.436444+0000","last_became_active":"2024-08-18T22:22:11.684231+0000","last_became_peered":"2024-08-18T22:22:11.684231+0000","last_unstale":"2024-08-18T22:22:12.436444+0000","last_undegraded":"2024-08-18T22:22:12.436444+0000","last_fullsized":"2024-08-18T22:22:12.436444+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434464+0000","last_change":"2024-08-18T22:22:11.694141+0000","last_active":"2024-08-18T22:22:12.434464+0000","last_peered":"2024-08-18T22:22:12.434464+0000","last_clean":"2024-08-18T22:22:12.434464+0000","last_became_active":"2024-08-18T22:22:11.690937+0000","last_became_peered":"2024-08-18T22:22:11.690937+0000","last_unstale":"2024-08-18T22:22:12.434464+0000","last_undegraded":"2024-08-18T22:22:12.434464+0000","last_fullsized":"2024-08-18T22:22:12.434464+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436109+0000","last_change":"2024-08-18T22:22:11.692230+0000","last_active":"2024-08-18T22:22:12.436109+0000","last_peered":"2024-08-18T22:22:12.436109+0000","last_clean":"2024-08-18T22:22:12.436109+0000","last_became_active":"2024-08-18T22:22:11.691972+0000","last_became_peered":"2024-08-18T22:22:11.691972+0000","last_unstale":"2024-08-18T22:22:12.436109+0000","last_undegraded":"2024-08-18T22:22:12.436109+0000","last_fullsized":"2024-08-18T22:22:12.436109+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:01.509300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435700+0000","last_change":"2024-08-18T22:22:11.438891+0000","last_active":"2024-08-18T22:22:12.435700+0000","last_peered":"2024-08-18T22:22:12.435700+0000","last_clean":"2024-08-18T22:22:12.435700+0000","last_became_active":"2024-08-18T22:22:11.438571+0000","last_became_peered":"2024-08-18T22:22:11.438571+0000","last_unstale":"2024-08-18T22:22:12.435700+0000","last_undegraded":"2024-08-18T22:22:12.435700+0000","last_fullsized":"2024-08-18T22:22:12.435700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:13.622996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"54'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.440725+0000","last_change":"2024-08-18T22:22:10.430588+0000","last_active":"2024-08-18T22:22:11.440725+0000","last_peered":"2024-08-18T22:22:11.440725+0000","last_clean":"2024-08-18T22:22:11.440725+0000","last_became_active":"2024-08-18T22:22:10.430291+0000","last_became_peered":"2024-08-18T22:22:10.430291+0000","last_unstale":"2024-08-18T22:22:11.440725+0000","last_undegraded":"2024-08-18T22:22:11.440725+0000","last_fullsized":"2024-08-18T22:22:11.440725+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:55.985496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436761+0000","last_change":"2024-08-18T22:22:11.437753+0000","last_active":"2024-08-18T22:22:12.436761+0000","last_peered":"2024-08-18T22:22:12.436761+0000","last_clean":"2024-08-18T22:22:12.436761+0000","last_became_active":"2024-08-18T22:22:11.437447+0000","last_became_peered":"2024-08-18T22:22:11.437447+0000","last_unstale":"2024-08-18T22:22:12.436761+0000","last_undegraded":"2024-08-18T22:22:12.436761+0000","last_fullsized":"2024-08-18T22:22:12.436761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.695976+0000","last_change":"2024-08-18T22:22:10.444416+0000","last_active":"2024-08-18T22:22:11.695976+0000","last_peered":"2024-08-18T22:22:11.695976+0000","last_clean":"2024-08-18T22:22:11.695976+0000","last_became_active":"2024-08-18T22:22:10.443904+0000","last_became_peered":"2024-08-18T22:22:10.443904+0000","last_unstale":"2024-08-18T22:22:11.695976+0000","last_undegraded":"2024-08-18T22:22:11.695976+0000","last_fullsized":"2024-08-18T22:22:11.695976+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:41.576670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.436460+0000","last_change":"2024-08-18T22:22:11.434634+0000","last_active":"2024-08-18T22:22:11.436460+0000","last_peered":"2024-08-18T22:22:11.436460+0000","last_clean":"2024-08-18T22:22:11.436460+0000","last_became_active":"2024-08-18T22:22:11.434339+0000","last_became_peered":"2024-08-18T22:22:11.434339+0000","last_unstale":"2024-08-18T22:22:11.436460+0000","last_undegraded":"2024-08-18T22:22:11.436460+0000","last_fullsized":"2024-08-18T22:22:11.436460+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:27.184054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.692067+0000","last_change":"2024-08-18T22:22:10.445086+0000","last_active":"2024-08-18T22:22:11.692067+0000","last_peered":"2024-08-18T22:22:11.692067+0000","last_clean":"2024-08-18T22:22:11.692067+0000","last_became_active":"2024-08-18T22:22:10.443901+0000","last_became_peered":"2024-08-18T22:22:10.443901+0000","last_unstale":"2024-08-18T22:22:11.692067+0000","last_undegraded":"2024-08-18T22:22:11.692067+0000","last_fullsized":"2024-08-18T22:22:11.692067+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:50.763870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663686+0000","last_change":"2024-08-18T22:22:11.696062+0000","last_active":"2024-08-18T22:22:12.663686+0000","last_peered":"2024-08-18T22:22:12.663686+0000","last_clean":"2024-08-18T22:22:12.663686+0000","last_became_active":"2024-08-18T22:22:11.693315+0000","last_became_peered":"2024-08-18T22:22:11.693315+0000","last_unstale":"2024-08-18T22:22:12.663686+0000","last_undegraded":"2024-08-18T22:22:12.663686+0000","last_fullsized":"2024-08-18T22:22:12.663686+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:35.835298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437395+0000","last_change":"2024-08-18T22:22:10.437524+0000","last_active":"2024-08-18T22:22:12.437395+0000","last_peered":"2024-08-18T22:22:12.437395+0000","last_clean":"2024-08-18T22:22:12.437395+0000","last_became_active":"2024-08-18T22:22:10.437205+0000","last_became_peered":"2024-08-18T22:22:10.437205+0000","last_unstale":"2024-08-18T22:22:12.437395+0000","last_undegraded":"2024-08-18T22:22:12.437395+0000","last_fullsized":"2024-08-18T22:22:12.437395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:38:35.135643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421708+0000","last_change":"2024-08-18T22:22:10.421708+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421708+0000","last_undegraded":"2024-08-18T22:22:10.421708+0000","last_fullsized":"2024-08-18T22:22:10.421708+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434997+0000","last_change":"2024-08-18T22:22:10.446348+0000","last_active":"2024-08-18T22:22:12.434997+0000","last_peered":"2024-08-18T22:22:12.434997+0000","last_clean":"2024-08-18T22:22:12.434997+0000","last_became_active":"2024-08-18T22:22:10.445868+0000","last_became_peered":"2024-08-18T22:22:10.445868+0000","last_unstale":"2024-08-18T22:22:12.434997+0000","last_undegraded":"2024-08-18T22:22:12.434997+0000","last_fullsized":"2024-08-18T22:22:12.434997+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:17:41.384026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436303+0000","last_change":"2024-08-18T22:22:11.685125+0000","last_active":"2024-08-18T22:22:12.436303+0000","last_peered":"2024-08-18T22:22:12.436303+0000","last_clean":"2024-08-18T22:22:12.436303+0000","last_became_active":"2024-08-18T22:22:11.684877+0000","last_became_peered":"2024-08-18T22:22:11.684877+0000","last_unstale":"2024-08-18T22:22:12.436303+0000","last_undegraded":"2024-08-18T22:22:12.436303+0000","last_fullsized":"2024-08-18T22:22:12.436303+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.434867+0000","last_change":"2024-08-18T22:22:10.430868+0000","last_active":"2024-08-18T22:22:10.434867+0000","last_peered":"2024-08-18T22:22:10.434867+0000","last_clean":"2024-08-18T22:22:10.434867+0000","last_became_active":"2024-08-18T22:22:10.430580+0000","last_became_peered":"2024-08-18T22:22:10.430580+0000","last_unstale":"2024-08-18T22:22:10.434867+0000","last_undegraded":"2024-08-18T22:22:10.434867+0000","last_fullsized":"2024-08-18T22:22:10.434867+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:31:35.633828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664190+0000","last_change":"2024-08-18T22:22:11.688121+0000","last_active":"2024-08-18T22:22:12.664190+0000","last_peered":"2024-08-18T22:22:12.664190+0000","last_clean":"2024-08-18T22:22:12.664190+0000","last_became_active":"2024-08-18T22:22:11.687691+0000","last_became_peered":"2024-08-18T22:22:11.687691+0000","last_unstale":"2024-08-18T22:22:12.664190+0000","last_undegraded":"2024-08-18T22:22:12.664190+0000","last_fullsized":"2024-08-18T22:22:12.664190+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:42:20.647483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.422044+0000","last_change":"2024-08-18T22:22:10.432702+0000","last_active":"2024-08-18T22:22:11.422044+0000","last_peered":"2024-08-18T22:22:11.422044+0000","last_clean":"2024-08-18T22:22:11.422044+0000","last_became_active":"2024-08-18T22:22:10.432258+0000","last_became_peered":"2024-08-18T22:22:10.432258+0000","last_unstale":"2024-08-18T22:22:11.422044+0000","last_undegraded":"2024-08-18T22:22:11.422044+0000","last_fullsized":"2024-08-18T22:22:11.422044+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:01:07.848661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436605+0000","last_change":"2024-08-18T22:22:11.675403+0000","last_active":"2024-08-18T22:22:12.436605+0000","last_peered":"2024-08-18T22:22:12.436605+0000","last_clean":"2024-08-18T22:22:12.436605+0000","last_became_active":"2024-08-18T22:22:11.675113+0000","last_became_peered":"2024-08-18T22:22:11.675113+0000","last_unstale":"2024-08-18T22:22:12.436605+0000","last_undegraded":"2024-08-18T22:22:12.436605+0000","last_fullsized":"2024-08-18T22:22:12.436605+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434330+0000","last_change":"2024-08-18T22:22:10.433218+0000","last_active":"2024-08-18T22:22:12.434330+0000","last_peered":"2024-08-18T22:22:12.434330+0000","last_clean":"2024-08-18T22:22:12.434330+0000","last_became_active":"2024-08-18T22:22:10.432947+0000","last_became_peered":"2024-08-18T22:22:10.432947+0000","last_unstale":"2024-08-18T22:22:12.434330+0000","last_undegraded":"2024-08-18T22:22:12.434330+0000","last_fullsized":"2024-08-18T22:22:12.434330+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:51.101447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421236+0000","last_change":"2024-08-18T22:22:10.421236+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421236+0000","last_undegraded":"2024-08-18T22:22:10.421236+0000","last_fullsized":"2024-08-18T22:22:10.421236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436697+0000","last_change":"2024-08-18T22:22:10.434355+0000","last_active":"2024-08-18T22:22:12.436697+0000","last_peered":"2024-08-18T22:22:12.436697+0000","last_clean":"2024-08-18T22:22:12.436697+0000","last_became_active":"2024-08-18T22:22:10.434027+0000","last_became_peered":"2024-08-18T22:22:10.434027+0000","last_unstale":"2024-08-18T22:22:12.436697+0000","last_undegraded":"2024-08-18T22:22:12.436697+0000","last_fullsized":"2024-08-18T22:22:12.436697+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:05:15.817540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436618+0000","last_change":"2024-08-18T22:22:11.440263+0000","last_active":"2024-08-18T22:22:12.436618+0000","last_peered":"2024-08-18T22:22:12.436618+0000","last_clean":"2024-08-18T22:22:12.436618+0000","last_became_active":"2024-08-18T22:22:11.439371+0000","last_became_peered":"2024-08-18T22:22:11.439371+0000","last_unstale":"2024-08-18T22:22:12.436618+0000","last_undegraded":"2024-08-18T22:22:12.436618+0000","last_fullsized":"2024-08-18T22:22:12.436618+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.436265+0000","last_change":"2024-08-18T22:22:10.434830+0000","last_active":"2024-08-18T22:22:10.436265+0000","last_peered":"2024-08-18T22:22:10.436265+0000","last_clean":"2024-08-18T22:22:10.436265+0000","last_became_active":"2024-08-18T22:22:10.434370+0000","last_became_peered":"2024-08-18T22:22:10.434370+0000","last_unstale":"2024-08-18T22:22:10.436265+0000","last_undegraded":"2024-08-18T22:22:10.436265+0000","last_fullsized":"2024-08-18T22:22:10.436265+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:32:11.671929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434721+0000","last_change":"2024-08-18T22:22:11.674739+0000","last_active":"2024-08-18T22:22:12.434721+0000","last_peered":"2024-08-18T22:22:12.434721+0000","last_clean":"2024-08-18T22:22:12.434721+0000","last_became_active":"2024-08-18T22:22:11.674451+0000","last_became_peered":"2024-08-18T22:22:11.674451+0000","last_unstale":"2024-08-18T22:22:12.434721+0000","last_undegraded":"2024-08-18T22:22:12.434721+0000","last_fullsized":"2024-08-18T22:22:12.434721+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:31.682951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"54'3","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436528+0000","last_change":"2024-08-18T22:22:10.445969+0000","last_active":"2024-08-18T22:22:12.436528+0000","last_peered":"2024-08-18T22:22:12.436528+0000","last_clean":"2024-08-18T22:22:12.436528+0000","last_became_active":"2024-08-18T22:22:10.445685+0000","last_became_peered":"2024-08-18T22:22:10.445685+0000","last_unstale":"2024-08-18T22:22:12.436528+0000","last_undegraded":"2024-08-18T22:22:12.436528+0000","last_fullsized":"2024-08-18T22:22:12.436528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:34:40.944063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.420415+0000","last_change":"2024-08-18T22:22:10.420415+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.420415+0000","last_undegraded":"2024-08-18T22:22:10.420415+0000","last_fullsized":"2024-08-18T22:22:10.420415+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664023+0000","last_change":"2024-08-18T22:22:10.441766+0000","last_active":"2024-08-18T22:22:12.664023+0000","last_peered":"2024-08-18T22:22:12.664023+0000","last_clean":"2024-08-18T22:22:12.664023+0000","last_became_active":"2024-08-18T22:22:10.441345+0000","last_became_peered":"2024-08-18T22:22:10.441345+0000","last_unstale":"2024-08-18T22:22:12.664023+0000","last_undegraded":"2024-08-18T22:22:12.664023+0000","last_fullsized":"2024-08-18T22:22:12.664023+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:00.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437013+0000","last_change":"2024-08-18T22:22:11.439705+0000","last_active":"2024-08-18T22:22:12.437013+0000","last_peered":"2024-08-18T22:22:12.437013+0000","last_clean":"2024-08-18T22:22:12.437013+0000","last_became_active":"2024-08-18T22:22:11.439381+0000","last_became_peered":"2024-08-18T22:22:11.439381+0000","last_unstale":"2024-08-18T22:22:12.437013+0000","last_undegraded":"2024-08-18T22:22:12.437013+0000","last_fullsized":"2024-08-18T22:22:12.437013+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435001+0000","last_change":"2024-08-18T22:22:10.435837+0000","last_active":"2024-08-18T22:22:12.435001+0000","last_peered":"2024-08-18T22:22:12.435001+0000","last_clean":"2024-08-18T22:22:12.435001+0000","last_became_active":"2024-08-18T22:22:10.435534+0000","last_became_peered":"2024-08-18T22:22:10.435534+0000","last_unstale":"2024-08-18T22:22:12.435001+0000","last_undegraded":"2024-08-18T22:22:12.435001+0000","last_fullsized":"2024-08-18T22:22:12.435001+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:53.443012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435338+0000","last_change":"2024-08-18T22:22:11.686961+0000","last_active":"2024-08-18T22:22:12.435338+0000","last_peered":"2024-08-18T22:22:12.435338+0000","last_clean":"2024-08-18T22:22:12.435338+0000","last_became_active":"2024-08-18T22:22:11.686690+0000","last_became_peered":"2024-08-18T22:22:11.686690+0000","last_unstale":"2024-08-18T22:22:12.435338+0000","last_undegraded":"2024-08-18T22:22:12.435338+0000","last_fullsized":"2024-08-18T22:22:12.435338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:57:48.800840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.421253+0000","last_change":"2024-08-18T22:22:10.435408+0000","last_active":"2024-08-18T22:22:11.421253+0000","last_peered":"2024-08-18T22:22:11.421253+0000","last_clean":"2024-08-18T22:22:11.421253+0000","last_became_active":"2024-08-18T22:22:10.435141+0000","last_became_peered":"2024-08-18T22:22:10.435141+0000","last_unstale":"2024-08-18T22:22:11.421253+0000","last_undegraded":"2024-08-18T22:22:11.421253+0000","last_fullsized":"2024-08-18T22:22:11.421253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:52.760163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664018+0000","last_change":"2024-08-18T22:22:11.680794+0000","last_active":"2024-08-18T22:22:12.664018+0000","last_peered":"2024-08-18T22:22:12.664018+0000","last_clean":"2024-08-18T22:22:12.664018+0000","last_became_active":"2024-08-18T22:22:11.680510+0000","last_became_peered":"2024-08-18T22:22:11.680510+0000","last_unstale":"2024-08-18T22:22:12.664018+0000","last_undegraded":"2024-08-18T22:22:12.664018+0000","last_fullsized":"2024-08-18T22:22:12.664018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:09.366034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436203+0000","last_change":"2024-08-18T22:22:10.430246+0000","last_active":"2024-08-18T22:22:12.436203+0000","last_peered":"2024-08-18T22:22:12.436203+0000","last_clean":"2024-08-18T22:22:12.436203+0000","last_became_active":"2024-08-18T22:22:10.429923+0000","last_became_peered":"2024-08-18T22:22:10.429923+0000","last_unstale":"2024-08-18T22:22:12.436203+0000","last_undegraded":"2024-08-18T22:22:12.436203+0000","last_fullsized":"2024-08-18T22:22:12.436203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:44:29.431155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435499+0000","last_change":"2024-08-18T22:22:11.677704+0000","last_active":"2024-08-18T22:22:12.435499+0000","last_peered":"2024-08-18T22:22:12.435499+0000","last_clean":"2024-08-18T22:22:12.435499+0000","last_became_active":"2024-08-18T22:22:11.676998+0000","last_became_peered":"2024-08-18T22:22:11.676998+0000","last_unstale":"2024-08-18T22:22:12.435499+0000","last_undegraded":"2024-08-18T22:22:12.435499+0000","last_fullsized":"2024-08-18T22:22:12.435499+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:32.138824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663844+0000","last_change":"2024-08-18T22:22:10.444587+0000","last_active":"2024-08-18T22:22:12.663844+0000","last_peered":"2024-08-18T22:22:12.663844+0000","last_clean":"2024-08-18T22:22:12.663844+0000","last_became_active":"2024-08-18T22:22:10.440296+0000","last_became_peered":"2024-08-18T22:22:10.440296+0000","last_unstale":"2024-08-18T22:22:12.663844+0000","last_undegraded":"2024-08-18T22:22:12.663844+0000","last_fullsized":"2024-08-18T22:22:12.663844+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:25.298286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663734+0000","last_change":"2024-08-18T22:22:11.694606+0000","last_active":"2024-08-18T22:22:12.663734+0000","last_peered":"2024-08-18T22:22:12.663734+0000","last_clean":"2024-08-18T22:22:12.663734+0000","last_became_active":"2024-08-18T22:22:11.694331+0000","last_became_peered":"2024-08-18T22:22:11.694331+0000","last_unstale":"2024-08-18T22:22:12.663734+0000","last_undegraded":"2024-08-18T22:22:12.663734+0000","last_fullsized":"2024-08-18T22:22:12.663734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:02.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435676+0000","last_change":"2024-08-18T22:22:10.444339+0000","last_active":"2024-08-18T22:22:12.435676+0000","last_peered":"2024-08-18T22:22:12.435676+0000","last_clean":"2024-08-18T22:22:12.435676+0000","last_became_active":"2024-08-18T22:22:10.442957+0000","last_became_peered":"2024-08-18T22:22:10.442957+0000","last_unstale":"2024-08-18T22:22:12.435676+0000","last_undegraded":"2024-08-18T22:22:12.435676+0000","last_fullsized":"2024-08-18T22:22:12.435676+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:36.521543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686160+0000","last_change":"2024-08-18T22:22:11.677128+0000","last_active":"2024-08-18T22:22:11.686160+0000","last_peered":"2024-08-18T22:22:11.686160+0000","last_clean":"2024-08-18T22:22:11.686160+0000","last_became_active":"2024-08-18T22:22:11.676813+0000","last_became_peered":"2024-08-18T22:22:11.676813+0000","last_unstale":"2024-08-18T22:22:11.686160+0000","last_undegraded":"2024-08-18T22:22:11.686160+0000","last_fullsized":"2024-08-18T22:22:11.686160+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:31:36.024442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.445295+0000","last_change":"2024-08-18T22:22:10.434500+0000","last_active":"2024-08-18T22:22:10.445295+0000","last_peered":"2024-08-18T22:22:10.445295+0000","last_clean":"2024-08-18T22:22:10.445295+0000","last_became_active":"2024-08-18T22:22:10.431542+0000","last_became_peered":"2024-08-18T22:22:10.431542+0000","last_unstale":"2024-08-18T22:22:10.445295+0000","last_undegraded":"2024-08-18T22:22:10.445295+0000","last_fullsized":"2024-08-18T22:22:10.445295+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:43.691497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-08-18T22:22:10.421963+0000","last_change":"2024-08-18T22:22:10.421963+0000","last_active":"2024-08-18T22:22:10.407943+0000","last_peered":"2024-08-18T22:22:10.407943+0000","last_clean":"2024-08-18T22:22:10.407943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:22:10.421963+0000","last_undegraded":"2024-08-18T22:22:10.421963+0000","last_fullsized":"2024-08-18T22:22:10.421963+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.686186+0000","last_change":"2024-08-18T22:22:10.445708+0000","last_active":"2024-08-18T22:22:11.686186+0000","last_peered":"2024-08-18T22:22:11.686186+0000","last_clean":"2024-08-18T22:22:11.686186+0000","last_became_active":"2024-08-18T22:22:10.445397+0000","last_became_peered":"2024-08-18T22:22:10.445397+0000","last_unstale":"2024-08-18T22:22:11.686186+0000","last_undegraded":"2024-08-18T22:22:11.686186+0000","last_fullsized":"2024-08-18T22:22:11.686186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:22.379698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.685628+0000","last_change":"2024-08-18T22:22:11.676481+0000","last_active":"2024-08-18T22:22:11.685628+0000","last_peered":"2024-08-18T22:22:11.685628+0000","last_clean":"2024-08-18T22:22:11.685628+0000","last_became_active":"2024-08-18T22:22:11.675869+0000","last_became_peered":"2024-08-18T22:22:11.675869+0000","last_unstale":"2024-08-18T22:22:11.685628+0000","last_undegraded":"2024-08-18T22:22:11.685628+0000","last_fullsized":"2024-08-18T22:22:11.685628+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:45.613060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.422259+0000","last_change":"2024-08-18T22:22:10.430687+0000","last_active":"2024-08-18T22:22:11.422259+0000","last_peered":"2024-08-18T22:22:11.422259+0000","last_clean":"2024-08-18T22:22:11.422259+0000","last_became_active":"2024-08-18T22:22:10.430161+0000","last_became_peered":"2024-08-18T22:22:10.430161+0000","last_unstale":"2024-08-18T22:22:11.422259+0000","last_undegraded":"2024-08-18T22:22:11.422259+0000","last_fullsized":"2024-08-18T22:22:11.422259+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:44.609281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437196+0000","last_change":"2024-08-18T22:22:11.441544+0000","last_active":"2024-08-18T22:22:12.437196+0000","last_peered":"2024-08-18T22:22:12.437196+0000","last_clean":"2024-08-18T22:22:12.437196+0000","last_became_active":"2024-08-18T22:22:11.441261+0000","last_became_peered":"2024-08-18T22:22:11.441261+0000","last_unstale":"2024-08-18T22:22:12.437196+0000","last_undegraded":"2024-08-18T22:22:12.437196+0000","last_fullsized":"2024-08-18T22:22:12.437196+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.692073+0000","last_change":"2024-08-18T22:22:10.444168+0000","last_active":"2024-08-18T22:22:11.692073+0000","last_peered":"2024-08-18T22:22:11.692073+0000","last_clean":"2024-08-18T22:22:11.692073+0000","last_became_active":"2024-08-18T22:22:10.443546+0000","last_became_peered":"2024-08-18T22:22:10.443546+0000","last_unstale":"2024-08-18T22:22:11.692073+0000","last_undegraded":"2024-08-18T22:22:11.692073+0000","last_fullsized":"2024-08-18T22:22:11.692073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:26.180275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.434642+0000","last_change":"2024-08-18T22:22:11.428926+0000","last_active":"2024-08-18T22:22:11.434642+0000","last_peered":"2024-08-18T22:22:11.434642+0000","last_clean":"2024-08-18T22:22:11.434642+0000","last_became_active":"2024-08-18T22:22:11.428494+0000","last_became_peered":"2024-08-18T22:22:11.428494+0000","last_unstale":"2024-08-18T22:22:11.434642+0000","last_undegraded":"2024-08-18T22:22:11.434642+0000","last_fullsized":"2024-08-18T22:22:11.434642+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:40.583712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663933+0000","last_change":"2024-08-18T22:22:10.439941+0000","last_active":"2024-08-18T22:22:12.663933+0000","last_peered":"2024-08-18T22:22:12.663933+0000","last_clean":"2024-08-18T22:22:12.663933+0000","last_became_active":"2024-08-18T22:22:10.439643+0000","last_became_peered":"2024-08-18T22:22:10.439643+0000","last_unstale":"2024-08-18T22:22:12.663933+0000","last_undegraded":"2024-08-18T22:22:12.663933+0000","last_fullsized":"2024-08-18T22:22:12.663933+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:17.149522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435392+0000","last_change":"2024-08-18T22:22:11.674241+0000","last_active":"2024-08-18T22:22:12.435392+0000","last_peered":"2024-08-18T22:22:12.435392+0000","last_clean":"2024-08-18T22:22:12.435392+0000","last_became_active":"2024-08-18T22:22:11.673969+0000","last_became_peered":"2024-08-18T22:22:11.673969+0000","last_unstale":"2024-08-18T22:22:12.435392+0000","last_undegraded":"2024-08-18T22:22:12.435392+0000","last_fullsized":"2024-08-18T22:22:12.435392+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:35.835298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434493+0000","last_change":"2024-08-18T22:22:10.447007+0000","last_active":"2024-08-18T22:22:12.434493+0000","last_peered":"2024-08-18T22:22:12.434493+0000","last_clean":"2024-08-18T22:22:12.434493+0000","last_became_active":"2024-08-18T22:22:10.446729+0000","last_became_peered":"2024-08-18T22:22:10.446729+0000","last_unstale":"2024-08-18T22:22:12.434493+0000","last_undegraded":"2024-08-18T22:22:12.434493+0000","last_fullsized":"2024-08-18T22:22:12.434493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:44:31.581871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.689947+0000","last_change":"2024-08-18T22:22:11.684053+0000","last_active":"2024-08-18T22:22:11.689947+0000","last_peered":"2024-08-18T22:22:11.689947+0000","last_clean":"2024-08-18T22:22:11.689947+0000","last_became_active":"2024-08-18T22:22:11.683737+0000","last_became_peered":"2024-08-18T22:22:11.683737+0000","last_unstale":"2024-08-18T22:22:11.689947+0000","last_undegraded":"2024-08-18T22:22:11.689947+0000","last_fullsized":"2024-08-18T22:22:11.689947+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:41.408974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.444995+0000","last_change":"2024-08-18T22:22:10.435989+0000","last_active":"2024-08-18T22:22:10.444995+0000","last_peered":"2024-08-18T22:22:10.444995+0000","last_clean":"2024-08-18T22:22:10.444995+0000","last_became_active":"2024-08-18T22:22:10.435491+0000","last_became_peered":"2024-08-18T22:22:10.435491+0000","last_unstale":"2024-08-18T22:22:10.444995+0000","last_undegraded":"2024-08-18T22:22:10.444995+0000","last_fullsized":"2024-08-18T22:22:10.444995+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:25:42.535149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436249+0000","last_change":"2024-08-18T22:22:11.685875+0000","last_active":"2024-08-18T22:22:12.436249+0000","last_peered":"2024-08-18T22:22:12.436249+0000","last_clean":"2024-08-18T22:22:12.436249+0000","last_became_active":"2024-08-18T22:22:11.685542+0000","last_became_peered":"2024-08-18T22:22:11.685542+0000","last_unstale":"2024-08-18T22:22:12.436249+0000","last_undegraded":"2024-08-18T22:22:12.436249+0000","last_fullsized":"2024-08-18T22:22:12.436249+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:26.302065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"54'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.675016+0000","last_change":"2024-08-18T22:22:10.438951+0000","last_active":"2024-08-18T22:22:11.675016+0000","last_peered":"2024-08-18T22:22:11.675016+0000","last_clean":"2024-08-18T22:22:11.675016+0000","last_became_active":"2024-08-18T22:22:10.438629+0000","last_became_peered":"2024-08-18T22:22:10.438629+0000","last_unstale":"2024-08-18T22:22:11.675016+0000","last_undegraded":"2024-08-18T22:22:11.675016+0000","last_fullsized":"2024-08-18T22:22:11.675016+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:52.125406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.692669+0000","last_change":"2024-08-18T22:22:11.689322+0000","last_active":"2024-08-18T22:22:11.692669+0000","last_peered":"2024-08-18T22:22:11.692669+0000","last_clean":"2024-08-18T22:22:11.692669+0000","last_became_active":"2024-08-18T22:22:11.689002+0000","last_became_peered":"2024-08-18T22:22:11.689002+0000","last_unstale":"2024-08-18T22:22:11.692669+0000","last_undegraded":"2024-08-18T22:22:11.692669+0000","last_fullsized":"2024-08-18T22:22:11.692669+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:37.525322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436640+0000","last_change":"2024-08-18T22:22:10.437824+0000","last_active":"2024-08-18T22:22:12.436640+0000","last_peered":"2024-08-18T22:22:12.436640+0000","last_clean":"2024-08-18T22:22:12.436640+0000","last_became_active":"2024-08-18T22:22:10.437457+0000","last_became_peered":"2024-08-18T22:22:10.437457+0000","last_unstale":"2024-08-18T22:22:12.436640+0000","last_undegraded":"2024-08-18T22:22:12.436640+0000","last_fullsized":"2024-08-18T22:22:12.436640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:05.210105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663838+0000","last_change":"2024-08-18T22:22:11.684534+0000","last_active":"2024-08-18T22:22:12.663838+0000","last_peered":"2024-08-18T22:22:12.663838+0000","last_clean":"2024-08-18T22:22:12.663838+0000","last_became_active":"2024-08-18T22:22:11.678903+0000","last_became_peered":"2024-08-18T22:22:11.678903+0000","last_unstale":"2024-08-18T22:22:12.663838+0000","last_undegraded":"2024-08-18T22:22:12.663838+0000","last_fullsized":"2024-08-18T22:22:12.663838+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:39.828882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435106+0000","last_change":"2024-08-18T22:22:10.443792+0000","last_active":"2024-08-18T22:22:12.435106+0000","last_peered":"2024-08-18T22:22:12.435106+0000","last_clean":"2024-08-18T22:22:12.435106+0000","last_became_active":"2024-08-18T22:22:10.443526+0000","last_became_peered":"2024-08-18T22:22:10.443526+0000","last_unstale":"2024-08-18T22:22:12.435106+0000","last_undegraded":"2024-08-18T22:22:12.435106+0000","last_fullsized":"2024-08-18T22:22:12.435106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:40.405195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435096+0000","last_change":"2024-08-18T22:22:11.697582+0000","last_active":"2024-08-18T22:22:12.435096+0000","last_peered":"2024-08-18T22:22:12.435096+0000","last_clean":"2024-08-18T22:22:12.435096+0000","last_became_active":"2024-08-18T22:22:11.696095+0000","last_became_peered":"2024-08-18T22:22:11.696095+0000","last_unstale":"2024-08-18T22:22:12.435096+0000","last_undegraded":"2024-08-18T22:22:12.435096+0000","last_fullsized":"2024-08-18T22:22:12.435096+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:03:06.402713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663942+0000","last_change":"2024-08-18T22:22:10.444120+0000","last_active":"2024-08-18T22:22:12.663942+0000","last_peered":"2024-08-18T22:22:12.663942+0000","last_clean":"2024-08-18T22:22:12.663942+0000","last_became_active":"2024-08-18T22:22:10.439575+0000","last_became_peered":"2024-08-18T22:22:10.439575+0000","last_unstale":"2024-08-18T22:22:12.663942+0000","last_undegraded":"2024-08-18T22:22:12.663942+0000","last_fullsized":"2024-08-18T22:22:12.663942+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:36:02.531876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436867+0000","last_change":"2024-08-18T22:22:11.439736+0000","last_active":"2024-08-18T22:22:12.436867+0000","last_peered":"2024-08-18T22:22:12.436867+0000","last_clean":"2024-08-18T22:22:12.436867+0000","last_became_active":"2024-08-18T22:22:11.439435+0000","last_became_peered":"2024-08-18T22:22:11.439435+0000","last_unstale":"2024-08-18T22:22:12.436867+0000","last_undegraded":"2024-08-18T22:22:12.436867+0000","last_fullsized":"2024-08-18T22:22:12.436867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663891+0000","last_change":"2024-08-18T22:22:10.446577+0000","last_active":"2024-08-18T22:22:12.663891+0000","last_peered":"2024-08-18T22:22:12.663891+0000","last_clean":"2024-08-18T22:22:12.663891+0000","last_became_active":"2024-08-18T22:22:10.445524+0000","last_became_peered":"2024-08-18T22:22:10.445524+0000","last_unstale":"2024-08-18T22:22:12.663891+0000","last_undegraded":"2024-08-18T22:22:12.663891+0000","last_fullsized":"2024-08-18T22:22:12.663891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:56:38.716953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435338+0000","last_change":"2024-08-18T22:22:11.691037+0000","last_active":"2024-08-18T22:22:12.435338+0000","last_peered":"2024-08-18T22:22:12.435338+0000","last_clean":"2024-08-18T22:22:12.435338+0000","last_became_active":"2024-08-18T22:22:11.690232+0000","last_became_peered":"2024-08-18T22:22:11.690232+0000","last_unstale":"2024-08-18T22:22:12.435338+0000","last_undegraded":"2024-08-18T22:22:12.435338+0000","last_fullsized":"2024-08-18T22:22:12.435338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:48.099976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-08-18T22:22:10.435850+0000","last_change":"2024-08-18T22:22:10.434323+0000","last_active":"2024-08-18T22:22:10.435850+0000","last_peered":"2024-08-18T22:22:10.435850+0000","last_clean":"2024-08-18T22:22:10.435850+0000","last_became_active":"2024-08-18T22:22:10.433352+0000","last_became_peered":"2024-08-18T22:22:10.433352+0000","last_unstale":"2024-08-18T22:22:10.435850+0000","last_undegraded":"2024-08-18T22:22:10.435850+0000","last_fullsized":"2024-08-18T22:22:10.435850+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:13:48.107104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664299+0000","last_change":"2024-08-18T22:22:11.707772+0000","last_active":"2024-08-18T22:22:12.664299+0000","last_peered":"2024-08-18T22:22:12.664299+0000","last_clean":"2024-08-18T22:22:12.664299+0000","last_became_active":"2024-08-18T22:22:11.707504+0000","last_became_peered":"2024-08-18T22:22:11.707504+0000","last_unstale":"2024-08-18T22:22:12.664299+0000","last_undegraded":"2024-08-18T22:22:12.664299+0000","last_fullsized":"2024-08-18T22:22:12.664299+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:12:52.604419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436339+0000","last_change":"2024-08-18T22:22:10.445621+0000","last_active":"2024-08-18T22:22:12.436339+0000","last_peered":"2024-08-18T22:22:12.436339+0000","last_clean":"2024-08-18T22:22:12.436339+0000","last_became_active":"2024-08-18T22:22:10.445287+0000","last_became_peered":"2024-08-18T22:22:10.445287+0000","last_unstale":"2024-08-18T22:22:12.436339+0000","last_undegraded":"2024-08-18T22:22:12.436339+0000","last_fullsized":"2024-08-18T22:22:12.436339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:52.642569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-08-18T22:22:11.441851+0000","last_change":"2024-08-18T22:22:11.439402+0000","last_active":"2024-08-18T22:22:11.441851+0000","last_peered":"2024-08-18T22:22:11.441851+0000","last_clean":"2024-08-18T22:22:11.441851+0000","last_became_active":"2024-08-18T22:22:11.439124+0000","last_became_peered":"2024-08-18T22:22:11.439124+0000","last_unstale":"2024-08-18T22:22:11.441851+0000","last_undegraded":"2024-08-18T22:22:11.441851+0000","last_fullsized":"2024-08-18T22:22:11.441851+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:42.580449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"55'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:13.429354+0000","last_change":"2024-08-18T22:22:10.439170+0000","last_active":"2024-08-18T22:22:13.429354+0000","last_peered":"2024-08-18T22:22:13.429354+0000","last_clean":"2024-08-18T22:22:13.429354+0000","last_became_active":"2024-08-18T22:22:10.438722+0000","last_became_peered":"2024-08-18T22:22:10.438722+0000","last_unstale":"2024-08-18T22:22:13.429354+0000","last_undegraded":"2024-08-18T22:22:13.429354+0000","last_fullsized":"2024-08-18T22:22:13.429354+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:05.210105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":239,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435645+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:22:12.435645+0000","last_peered":"2024-08-18T22:22:12.435645+0000","last_clean":"2024-08-18T22:22:12.435645+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:22:12.435645+0000","last_undegraded":"2024-08-18T22:22:12.435645+0000","last_fullsized":"2024-08-18T22:22:12.435645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36560,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335280,"statfs":{"total":96636764160,"available":96599326720,"internally_reserved":0,"allocated":1249280,"data_stored":881685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35968,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335872,"statfs":{"total":96636764160,"available":96599932928,"internally_reserved":0,"allocated":643072,"data_stored":285153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":647168,"data_stored":291193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40148,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331692,"statfs":{"total":96636764160,"available":96595652608,"internally_reserved":0,"allocated":663552,"data_stored":292827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35968,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335872,"statfs":{"total":96636764160,"available":96599932928,"internally_reserved":0,"allocated":643072,"data_stored":284661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1249280,"data_stored":881617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":610304,"data_stored":270667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35936,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335904,"statfs":{"total":96636764160,"available":96599965696,"internally_reserved":0,"allocated":610304,"data_stored":270667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:22:20.480 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:22:20.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fba600640 1 Processor -- start 2024-08-18T22:22:20.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fba600640 1 -- start start 2024-08-18T22:22:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fba600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40b54c0 0x7f0fb4071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fba600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb4071c80 con 0x7f0fb40cbed0 2024-08-18T22:22:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fba600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb4071f60 con 0x7f0fb406dd80 2024-08-18T22:22:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fba600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb40cba40 con 0x7f0fb40b54c0 2024-08-18T22:22:20.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb3e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0fb40cbed0 0x7f0fb40cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59346/0 (socket says 172.21.15.5:59346) 2024-08-18T22:22:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb3e00640 1 -- 172.21.15.5:0/3929380776 learned_addr learned my addr 172.21.15.5:0/3929380776 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb3400640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40b54c0 0x7f0fb4071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418013584 0 0) 0x7f0fb4071c80 con 0x7f0fb40cbed0 2024-08-18T22:22:20.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f98003530 con 0x7f0fb40cbed0 2024-08-18T22:22:20.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1134680130 0 0) 0x7f0f98003530 con 0x7f0fb40cbed0 2024-08-18T22:22:20.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40b54c0 msgr2=0x7f0fb4071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:20.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40b54c0 0x7f0fb4071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:20.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 >> v1:172.21.15.117:6789/0 conn(0x7f0fb406dd80 legacy=0x7f0fb40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:20.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb40cb6d0 con 0x7f0fb40cbed0 2024-08-18T22:22:20.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f0fac001a00 con 0x7f0fb40cbed0 2024-08-18T22:22:20.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 >> v1:172.21.15.5:6789/0 conn(0x7f0fb40cbed0 legacy=0x7f0fb40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40b54c0 0x7f0f980039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f98003f70 0x7f0f98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f98004d50 0x7f0f980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40cba40 con 0x7f0f98004d50 2024-08-18T22:22:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9800bb40 con 0x7f0f98003f70 2024-08-18T22:22:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0f9800bd40 con 0x7f0fb40b54c0 2024-08-18T22:22:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb3e00640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f98004d50 0x7f0f980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.631+0000 7f0fb3400640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40b54c0 0x7f0f980039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fb2a00640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f98003f70 0x7f0f98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fb3e00640 1 -- 172.21.15.5:0/3929380776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40b54c0 msgr2=0x7f0f980039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:20.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fb3e00640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40b54c0 0x7f0f980039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:20.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fb3e00640 1 -- 172.21.15.5:0/3929380776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f98003f70 msgr2=0x7f0f98004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:20.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fb3e00640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f98003f70 0x7f0f98004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:20.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fb3e00640 1 -- 172.21.15.5:0/3929380776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f98003530 con 0x7f0f98004d50 2024-08-18T22:22:20.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fb3e00640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f98004d50 0x7f0f980051d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00a850 tx=0x7f0fac01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa2520d54e95490 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:20.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00a4a0 con 0x7f0f98004d50 2024-08-18T22:22:20.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fac0ad650 con 0x7f0f98004d50 2024-08-18T22:22:20.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fb2000640 1 -- 172.21.15.5:0/3929380776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0ada80 con 0x7f0f98004d50 2024-08-18T22:22:20.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fba600640 1 -- 172.21.15.5:0/3929380776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f98004d50 msgr2=0x7f0f980051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:20.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fba600640 1 --2- 172.21.15.5:0/3929380776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f98004d50 0x7f0f980051d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00a850 tx=0x7f0fac01d3a0 comp rx=0 tx=0).stop 2024-08-18T22:22:20.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fb3e00640 1 -- 172.21.15.5:0/3929380776 reap_dead start 2024-08-18T22:22:20.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fba600640 1 -- 172.21.15.5:0/3929380776 shutdown_connections 2024-08-18T22:22:20.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.635+0000 7f0fba600640 1 -- 172.21.15.5:0/3929380776 >> 172.21.15.5:0/3929380776 conn(0x7f0fb40b3eb0 msgr2=0x7f0fb40b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:20.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fba600640 1 -- 172.21.15.5:0/3929380776 shutdown_connections 2024-08-18T22:22:20.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fba600640 1 -- 172.21.15.5:0/3929380776 wait complete. 2024-08-18T22:22:20.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fba600640 1 Processor -- start 2024-08-18T22:22:20.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fba600640 1 -- start start 2024-08-18T22:22:20.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fba600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fb41417e0 0x7f0fb40ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:20.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fba600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40cfaa0 0x7f0fb40d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:20.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fba600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cff00 0x7f0fb40d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:20.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fba600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb41481a0 con 0x7f0fb40cff00 2024-08-18T22:22:20.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fba600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb4148020 con 0x7f0fb41417e0 2024-08-18T22:22:20.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fba600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb4071580 con 0x7f0fb40cfaa0 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cff00 0x7f0fb40d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cff00 0x7f0fb40d1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52914/0 (socket says 172.21.15.5:52914) 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb3e00640 1 -- 172.21.15.5:0/2693005481 learned_addr learned my addr 172.21.15.5:0/2693005481 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb3400640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fb41417e0 0x7f0fb40ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb2a00640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40cfaa0 0x7f0fb40d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb3e00640 1 -- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40cfaa0 msgr2=0x7f0fb40d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb3e00640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40cfaa0 0x7f0fb40d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb3e00640 1 -- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fb41417e0 msgr2=0x7f0fb40ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb3e00640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fb41417e0 0x7f0fb40ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb3e00640 1 -- 172.21.15.5:0/2693005481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb40cd110 con 0x7f0fb40cff00 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb2a00640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40cfaa0 0x7f0fb40d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb3400640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fb41417e0 0x7f0fb40ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fb3e00640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cff00 0x7f0fb40d1c10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0fac01dc40 tx=0x7f0f98005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fab400640 1 -- 172.21.15.5:0/2693005481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00a480 con 0x7f0fb40cff00 2024-08-18T22:22:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fab400640 1 -- 172.21.15.5:0/2693005481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fac0bb070 con 0x7f0fb40cff00 2024-08-18T22:22:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fab400640 1 -- 172.21.15.5:0/2693005481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0011d0 con 0x7f0fb40cff00 2024-08-18T22:22:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.639+0000 7f0fba600640 1 -- 172.21.15.5:0/2693005481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb40cd3f0 con 0x7f0fb40cff00 2024-08-18T22:22:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.643+0000 7f0fba600640 1 -- 172.21.15.5:0/2693005481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb40cd9b0 con 0x7f0fb40cff00 2024-08-18T22:22:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.643+0000 7f0fba600640 1 -- 172.21.15.5:0/2693005481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb4071970 con 0x7f0fb40cff00 2024-08-18T22:22:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.643+0000 7f0fab400640 1 -- 172.21.15.5:0/2693005481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0fac0b5070 con 0x7f0fb40cff00 2024-08-18T22:22:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.643+0000 7f0fab400640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f940678f0 0x7f0f94069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.643+0000 7f0fab400640 1 -- 172.21.15.5:0/2693005481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f0fac120200 con 0x7f0fb40cff00 2024-08-18T22:22:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.643+0000 7f0fb3400640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f940678f0 0x7f0f94069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.643+0000 7f0fb3400640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f940678f0 0x7f0f94069db0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009be0 tx=0x7f0fa4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:20.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.647+0000 7f0fab400640 1 -- 172.21.15.5:0/2693005481 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0fac0170b0 con 0x7f0fb40cff00 2024-08-18T22:22:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.811+0000 7f0fba600640 1 -- 172.21.15.5:0/2693005481 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0fb40d2150 con 0x7f0f940678f0 2024-08-18T22:22:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.819+0000 7f0fab400640 1 -- 172.21.15.5:0/2693005481 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251909 (secure 0 0 0) 0x7f0fb40d2150 con 0x7f0f940678f0 2024-08-18T22:22:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:20.826 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:22:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 -- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f940678f0 msgr2=0x7f0f94069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f940678f0 0x7f0f94069db0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009be0 tx=0x7f0fa4008040 comp rx=0 tx=0).stop 2024-08-18T22:22:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 -- 172.21.15.5:0/2693005481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cff00 msgr2=0x7f0fb40d1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cff00 0x7f0fb40d1c10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0fac01dc40 tx=0x7f0f98005840 comp rx=0 tx=0).stop 2024-08-18T22:22:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 -- 172.21.15.5:0/2693005481 shutdown_connections 2024-08-18T22:22:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f940678f0 0x7f0f94069db0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fb40cff00 0x7f0fb40d1c10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fb40cfaa0 0x7f0fb40d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 --2- 172.21.15.5:0/2693005481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fb41417e0 0x7f0fb40ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 -- 172.21.15.5:0/2693005481 >> 172.21.15.5:0/2693005481 conn(0x7f0fb40b3eb0 msgr2=0x7f0fb4160c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 -- 172.21.15.5:0/2693005481 shutdown_connections 2024-08-18T22:22:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:20.823+0000 7f0fba600640 1 -- 172.21.15.5:0/2693005481 wait complete. 2024-08-18T22:22:20.845 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-18T22:22:19.661073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297332,"kb_used_data":6280,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754677388,"statfs":{"total":773094113280,"available":772789645312,"internally_reserved":0,"allocated":6430720,"data_stored":3515100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.242138"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361583+0000","last_change":"2024-08-18T22:22:11.676580+0000","last_active":"2024-08-18T22:22:14.361583+0000","last_peered":"2024-08-18T22:22:14.361583+0000","last_clean":"2024-08-18T22:22:14.361583+0000","last_became_active":"2024-08-18T22:22:11.676262+0000","last_became_peered":"2024-08-18T22:22:11.676262+0000","last_unstale":"2024-08-18T22:22:14.361583+0000","last_undegraded":"2024-08-18T22:22:14.361583+0000","last_fullsized":"2024-08-18T22:22:14.361583+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:21.924825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436525+0000","last_change":"2024-08-18T22:22:11.440271+0000","last_active":"2024-08-18T22:22:12.436525+0000","last_peered":"2024-08-18T22:22:12.436525+0000","last_clean":"2024-08-18T22:22:12.436525+0000","last_became_active":"2024-08-18T22:22:11.438676+0000","last_became_peered":"2024-08-18T22:22:11.438676+0000","last_unstale":"2024-08-18T22:22:12.436525+0000","last_undegraded":"2024-08-18T22:22:12.436525+0000","last_fullsized":"2024-08-18T22:22:12.436525+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435228+0000","last_change":"2024-08-18T22:22:11.696380+0000","last_active":"2024-08-18T22:22:12.435228+0000","last_peered":"2024-08-18T22:22:12.435228+0000","last_clean":"2024-08-18T22:22:12.435228+0000","last_became_active":"2024-08-18T22:22:11.696082+0000","last_became_peered":"2024-08-18T22:22:11.696082+0000","last_unstale":"2024-08-18T22:22:12.435228+0000","last_undegraded":"2024-08-18T22:22:12.435228+0000","last_fullsized":"2024-08-18T22:22:12.435228+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:03.855436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436037+0000","last_change":"2024-08-18T22:22:11.682718+0000","last_active":"2024-08-18T22:22:12.436037+0000","last_peered":"2024-08-18T22:22:12.436037+0000","last_clean":"2024-08-18T22:22:12.436037+0000","last_became_active":"2024-08-18T22:22:11.682318+0000","last_became_peered":"2024-08-18T22:22:11.682318+0000","last_unstale":"2024-08-18T22:22:12.436037+0000","last_undegraded":"2024-08-18T22:22:12.436037+0000","last_fullsized":"2024-08-18T22:22:12.436037+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:01.509300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361219+0000","last_change":"2024-08-18T22:22:11.437585+0000","last_active":"2024-08-18T22:22:14.361219+0000","last_peered":"2024-08-18T22:22:14.361219+0000","last_clean":"2024-08-18T22:22:14.361219+0000","last_became_active":"2024-08-18T22:22:11.437309+0000","last_became_peered":"2024-08-18T22:22:11.437309+0000","last_unstale":"2024-08-18T22:22:14.361219+0000","last_undegraded":"2024-08-18T22:22:14.361219+0000","last_fullsized":"2024-08-18T22:22:14.361219+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:08:41.056031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361153+0000","last_change":"2024-08-18T22:22:11.680962+0000","last_active":"2024-08-18T22:22:14.361153+0000","last_peered":"2024-08-18T22:22:14.361153+0000","last_clean":"2024-08-18T22:22:14.361153+0000","last_became_active":"2024-08-18T22:22:11.678373+0000","last_became_peered":"2024-08-18T22:22:11.678373+0000","last_unstale":"2024-08-18T22:22:14.361153+0000","last_undegraded":"2024-08-18T22:22:14.361153+0000","last_fullsized":"2024-08-18T22:22:14.361153+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:05:16.821319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434393+0000","last_change":"2024-08-18T22:22:11.694199+0000","last_active":"2024-08-18T22:22:12.434393+0000","last_peered":"2024-08-18T22:22:12.434393+0000","last_clean":"2024-08-18T22:22:12.434393+0000","last_became_active":"2024-08-18T22:22:11.693947+0000","last_became_peered":"2024-08-18T22:22:11.693947+0000","last_unstale":"2024-08-18T22:22:12.434393+0000","last_undegraded":"2024-08-18T22:22:12.434393+0000","last_fullsized":"2024-08-18T22:22:12.434393+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663710+0000","last_change":"2024-08-18T22:22:11.704329+0000","last_active":"2024-08-18T22:22:12.663710+0000","last_peered":"2024-08-18T22:22:12.663710+0000","last_clean":"2024-08-18T22:22:12.663710+0000","last_became_active":"2024-08-18T22:22:11.704045+0000","last_became_peered":"2024-08-18T22:22:11.704045+0000","last_unstale":"2024-08-18T22:22:12.663710+0000","last_undegraded":"2024-08-18T22:22:12.663710+0000","last_fullsized":"2024-08-18T22:22:12.663710+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:19.801891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664338+0000","last_change":"2024-08-18T22:22:11.707496+0000","last_active":"2024-08-18T22:22:12.664338+0000","last_peered":"2024-08-18T22:22:12.664338+0000","last_clean":"2024-08-18T22:22:12.664338+0000","last_became_active":"2024-08-18T22:22:11.706997+0000","last_became_peered":"2024-08-18T22:22:11.706997+0000","last_unstale":"2024-08-18T22:22:12.664338+0000","last_undegraded":"2024-08-18T22:22:12.664338+0000","last_fullsized":"2024-08-18T22:22:12.664338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:58:46.378942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361523+0000","last_change":"2024-08-18T22:22:11.679702+0000","last_active":"2024-08-18T22:22:14.361523+0000","last_peered":"2024-08-18T22:22:14.361523+0000","last_clean":"2024-08-18T22:22:14.361523+0000","last_became_active":"2024-08-18T22:22:11.679420+0000","last_became_peered":"2024-08-18T22:22:11.679420+0000","last_unstale":"2024-08-18T22:22:14.361523+0000","last_undegraded":"2024-08-18T22:22:14.361523+0000","last_fullsized":"2024-08-18T22:22:14.361523+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:35.423022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.525069+0000","last_change":"2024-08-18T22:22:11.674746+0000","last_active":"2024-08-18T22:22:12.525069+0000","last_peered":"2024-08-18T22:22:12.525069+0000","last_clean":"2024-08-18T22:22:12.525069+0000","last_became_active":"2024-08-18T22:22:11.674461+0000","last_became_peered":"2024-08-18T22:22:11.674461+0000","last_unstale":"2024-08-18T22:22:12.525069+0000","last_undegraded":"2024-08-18T22:22:12.525069+0000","last_fullsized":"2024-08-18T22:22:12.525069+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:22:25.950980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663831+0000","last_change":"2024-08-18T22:22:11.690698+0000","last_active":"2024-08-18T22:22:12.663831+0000","last_peered":"2024-08-18T22:22:12.663831+0000","last_clean":"2024-08-18T22:22:12.663831+0000","last_became_active":"2024-08-18T22:22:11.690395+0000","last_became_peered":"2024-08-18T22:22:11.690395+0000","last_unstale":"2024-08-18T22:22:12.663831+0000","last_undegraded":"2024-08-18T22:22:12.663831+0000","last_fullsized":"2024-08-18T22:22:12.663831+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:24.841562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361158+0000","last_change":"2024-08-18T22:22:11.679618+0000","last_active":"2024-08-18T22:22:14.361158+0000","last_peered":"2024-08-18T22:22:14.361158+0000","last_clean":"2024-08-18T22:22:14.361158+0000","last_became_active":"2024-08-18T22:22:11.679314+0000","last_became_peered":"2024-08-18T22:22:11.679314+0000","last_unstale":"2024-08-18T22:22:14.361158+0000","last_undegraded":"2024-08-18T22:22:14.361158+0000","last_fullsized":"2024-08-18T22:22:14.361158+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:44:30.434934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434534+0000","last_change":"2024-08-18T22:22:11.701031+0000","last_active":"2024-08-18T22:22:12.434534+0000","last_peered":"2024-08-18T22:22:12.434534+0000","last_clean":"2024-08-18T22:22:12.434534+0000","last_became_active":"2024-08-18T22:22:11.698895+0000","last_became_peered":"2024-08-18T22:22:11.698895+0000","last_unstale":"2024-08-18T22:22:12.434534+0000","last_undegraded":"2024-08-18T22:22:12.434534+0000","last_fullsized":"2024-08-18T22:22:12.434534+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436082+0000","last_change":"2024-08-18T22:22:11.436504+0000","last_active":"2024-08-18T22:22:12.436082+0000","last_peered":"2024-08-18T22:22:12.436082+0000","last_clean":"2024-08-18T22:22:12.436082+0000","last_became_active":"2024-08-18T22:22:11.436178+0000","last_became_peered":"2024-08-18T22:22:11.436178+0000","last_unstale":"2024-08-18T22:22:12.436082+0000","last_undegraded":"2024-08-18T22:22:12.436082+0000","last_fullsized":"2024-08-18T22:22:12.436082+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:26.302065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361097+0000","last_change":"2024-08-18T22:22:11.678730+0000","last_active":"2024-08-18T22:22:14.361097+0000","last_peered":"2024-08-18T22:22:14.361097+0000","last_clean":"2024-08-18T22:22:14.361097+0000","last_became_active":"2024-08-18T22:22:11.678412+0000","last_became_peered":"2024-08-18T22:22:11.678412+0000","last_unstale":"2024-08-18T22:22:14.361097+0000","last_undegraded":"2024-08-18T22:22:14.361097+0000","last_fullsized":"2024-08-18T22:22:14.361097+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:34:03.110661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435557+0000","last_change":"2024-08-18T22:22:11.678067+0000","last_active":"2024-08-18T22:22:12.435557+0000","last_peered":"2024-08-18T22:22:12.435557+0000","last_clean":"2024-08-18T22:22:12.435557+0000","last_became_active":"2024-08-18T22:22:11.677369+0000","last_became_peered":"2024-08-18T22:22:11.677369+0000","last_unstale":"2024-08-18T22:22:12.435557+0000","last_undegraded":"2024-08-18T22:22:12.435557+0000","last_fullsized":"2024-08-18T22:22:12.435557+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:19.801891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436665+0000","last_change":"2024-08-18T22:22:11.438865+0000","last_active":"2024-08-18T22:22:12.436665+0000","last_peered":"2024-08-18T22:22:12.436665+0000","last_clean":"2024-08-18T22:22:12.436665+0000","last_became_active":"2024-08-18T22:22:11.438478+0000","last_became_peered":"2024-08-18T22:22:11.438478+0000","last_unstale":"2024-08-18T22:22:12.436665+0000","last_undegraded":"2024-08-18T22:22:12.436665+0000","last_fullsized":"2024-08-18T22:22:12.436665+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435197+0000","last_change":"2024-08-18T22:22:11.676615+0000","last_active":"2024-08-18T22:22:12.435197+0000","last_peered":"2024-08-18T22:22:12.435197+0000","last_clean":"2024-08-18T22:22:12.435197+0000","last_became_active":"2024-08-18T22:22:11.676354+0000","last_became_peered":"2024-08-18T22:22:11.676354+0000","last_unstale":"2024-08-18T22:22:12.435197+0000","last_undegraded":"2024-08-18T22:22:12.435197+0000","last_fullsized":"2024-08-18T22:22:12.435197+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:26.623153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361380+0000","last_change":"2024-08-18T22:22:11.428854+0000","last_active":"2024-08-18T22:22:14.361380+0000","last_peered":"2024-08-18T22:22:14.361380+0000","last_clean":"2024-08-18T22:22:14.361380+0000","last_became_active":"2024-08-18T22:22:11.428471+0000","last_became_peered":"2024-08-18T22:22:11.428471+0000","last_unstale":"2024-08-18T22:22:14.361380+0000","last_undegraded":"2024-08-18T22:22:14.361380+0000","last_fullsized":"2024-08-18T22:22:14.361380+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:17:42.387805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361256+0000","last_change":"2024-08-18T22:22:11.434529+0000","last_active":"2024-08-18T22:22:14.361256+0000","last_peered":"2024-08-18T22:22:14.361256+0000","last_clean":"2024-08-18T22:22:14.361256+0000","last_became_active":"2024-08-18T22:22:11.434213+0000","last_became_peered":"2024-08-18T22:22:11.434213+0000","last_unstale":"2024-08-18T22:22:14.361256+0000","last_undegraded":"2024-08-18T22:22:14.361256+0000","last_fullsized":"2024-08-18T22:22:14.361256+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:44:32.585650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663686+0000","last_change":"2024-08-18T22:22:11.704537+0000","last_active":"2024-08-18T22:22:12.663686+0000","last_peered":"2024-08-18T22:22:12.663686+0000","last_clean":"2024-08-18T22:22:12.663686+0000","last_became_active":"2024-08-18T22:22:11.704264+0000","last_became_peered":"2024-08-18T22:22:11.704264+0000","last_unstale":"2024-08-18T22:22:12.663686+0000","last_undegraded":"2024-08-18T22:22:12.663686+0000","last_fullsized":"2024-08-18T22:22:12.663686+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:32.138824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.524860+0000","last_change":"2024-08-18T22:22:11.674035+0000","last_active":"2024-08-18T22:22:12.524860+0000","last_peered":"2024-08-18T22:22:12.524860+0000","last_clean":"2024-08-18T22:22:12.524860+0000","last_became_active":"2024-08-18T22:22:11.673482+0000","last_became_peered":"2024-08-18T22:22:11.673482+0000","last_unstale":"2024-08-18T22:22:12.524860+0000","last_undegraded":"2024-08-18T22:22:12.524860+0000","last_fullsized":"2024-08-18T22:22:12.524860+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:51:49.439758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434327+0000","last_change":"2024-08-18T22:22:11.688871+0000","last_active":"2024-08-18T22:22:12.434327+0000","last_peered":"2024-08-18T22:22:12.434327+0000","last_clean":"2024-08-18T22:22:12.434327+0000","last_became_active":"2024-08-18T22:22:11.688602+0000","last_became_peered":"2024-08-18T22:22:11.688602+0000","last_unstale":"2024-08-18T22:22:12.434327+0000","last_undegraded":"2024-08-18T22:22:12.434327+0000","last_fullsized":"2024-08-18T22:22:12.434327+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435719+0000","last_change":"2024-08-18T22:22:11.699877+0000","last_active":"2024-08-18T22:22:12.435719+0000","last_peered":"2024-08-18T22:22:12.435719+0000","last_clean":"2024-08-18T22:22:12.435719+0000","last_became_active":"2024-08-18T22:22:11.698188+0000","last_became_peered":"2024-08-18T22:22:11.698188+0000","last_unstale":"2024-08-18T22:22:12.435719+0000","last_undegraded":"2024-08-18T22:22:12.435719+0000","last_fullsized":"2024-08-18T22:22:12.435719+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:02.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664211+0000","last_change":"2024-08-18T22:22:11.693386+0000","last_active":"2024-08-18T22:22:12.664211+0000","last_peered":"2024-08-18T22:22:12.664211+0000","last_clean":"2024-08-18T22:22:12.664211+0000","last_became_active":"2024-08-18T22:22:11.693112+0000","last_became_peered":"2024-08-18T22:22:11.693112+0000","last_unstale":"2024-08-18T22:22:12.664211+0000","last_undegraded":"2024-08-18T22:22:12.664211+0000","last_fullsized":"2024-08-18T22:22:12.664211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:11.368781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361497+0000","last_change":"2024-08-18T22:22:11.681723+0000","last_active":"2024-08-18T22:22:14.361497+0000","last_peered":"2024-08-18T22:22:14.361497+0000","last_clean":"2024-08-18T22:22:14.361497+0000","last_became_active":"2024-08-18T22:22:11.681477+0000","last_became_peered":"2024-08-18T22:22:11.681477+0000","last_unstale":"2024-08-18T22:22:14.361497+0000","last_undegraded":"2024-08-18T22:22:14.361497+0000","last_fullsized":"2024-08-18T22:22:14.361497+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:38:36.139422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361751+0000","last_change":"2024-08-18T22:22:11.681994+0000","last_active":"2024-08-18T22:22:14.361751+0000","last_peered":"2024-08-18T22:22:14.361751+0000","last_clean":"2024-08-18T22:22:14.361751+0000","last_became_active":"2024-08-18T22:22:11.681612+0000","last_became_peered":"2024-08-18T22:22:11.681612+0000","last_unstale":"2024-08-18T22:22:14.361751+0000","last_undegraded":"2024-08-18T22:22:14.361751+0000","last_fullsized":"2024-08-18T22:22:14.361751+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:34:03.110661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434496+0000","last_change":"2024-08-18T22:22:11.674918+0000","last_active":"2024-08-18T22:22:12.434496+0000","last_peered":"2024-08-18T22:22:12.434496+0000","last_clean":"2024-08-18T22:22:12.434496+0000","last_became_active":"2024-08-18T22:22:11.674651+0000","last_became_peered":"2024-08-18T22:22:11.674651+0000","last_unstale":"2024-08-18T22:22:12.434496+0000","last_undegraded":"2024-08-18T22:22:12.434496+0000","last_fullsized":"2024-08-18T22:22:12.434496+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436444+0000","last_change":"2024-08-18T22:22:11.684544+0000","last_active":"2024-08-18T22:22:12.436444+0000","last_peered":"2024-08-18T22:22:12.436444+0000","last_clean":"2024-08-18T22:22:12.436444+0000","last_became_active":"2024-08-18T22:22:11.684231+0000","last_became_peered":"2024-08-18T22:22:11.684231+0000","last_unstale":"2024-08-18T22:22:12.436444+0000","last_undegraded":"2024-08-18T22:22:12.436444+0000","last_fullsized":"2024-08-18T22:22:12.436444+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434464+0000","last_change":"2024-08-18T22:22:11.694141+0000","last_active":"2024-08-18T22:22:12.434464+0000","last_peered":"2024-08-18T22:22:12.434464+0000","last_clean":"2024-08-18T22:22:12.434464+0000","last_became_active":"2024-08-18T22:22:11.690937+0000","last_became_peered":"2024-08-18T22:22:11.690937+0000","last_unstale":"2024-08-18T22:22:12.434464+0000","last_undegraded":"2024-08-18T22:22:12.434464+0000","last_fullsized":"2024-08-18T22:22:12.434464+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436109+0000","last_change":"2024-08-18T22:22:11.692230+0000","last_active":"2024-08-18T22:22:12.436109+0000","last_peered":"2024-08-18T22:22:12.436109+0000","last_clean":"2024-08-18T22:22:12.436109+0000","last_became_active":"2024-08-18T22:22:11.691972+0000","last_became_peered":"2024-08-18T22:22:11.691972+0000","last_unstale":"2024-08-18T22:22:12.436109+0000","last_undegraded":"2024-08-18T22:22:12.436109+0000","last_fullsized":"2024-08-18T22:22:12.436109+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:01.509300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435700+0000","last_change":"2024-08-18T22:22:11.438891+0000","last_active":"2024-08-18T22:22:12.435700+0000","last_peered":"2024-08-18T22:22:12.435700+0000","last_clean":"2024-08-18T22:22:12.435700+0000","last_became_active":"2024-08-18T22:22:11.438571+0000","last_became_peered":"2024-08-18T22:22:11.438571+0000","last_unstale":"2024-08-18T22:22:12.435700+0000","last_undegraded":"2024-08-18T22:22:12.435700+0000","last_fullsized":"2024-08-18T22:22:12.435700+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:13.622996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"54'4","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361566+0000","last_change":"2024-08-18T22:22:10.430588+0000","last_active":"2024-08-18T22:22:14.361566+0000","last_peered":"2024-08-18T22:22:14.361566+0000","last_clean":"2024-08-18T22:22:14.361566+0000","last_became_active":"2024-08-18T22:22:10.430291+0000","last_became_peered":"2024-08-18T22:22:10.430291+0000","last_unstale":"2024-08-18T22:22:14.361566+0000","last_undegraded":"2024-08-18T22:22:14.361566+0000","last_fullsized":"2024-08-18T22:22:14.361566+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:55.985496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436761+0000","last_change":"2024-08-18T22:22:11.437753+0000","last_active":"2024-08-18T22:22:12.436761+0000","last_peered":"2024-08-18T22:22:12.436761+0000","last_clean":"2024-08-18T22:22:12.436761+0000","last_became_active":"2024-08-18T22:22:11.437447+0000","last_became_peered":"2024-08-18T22:22:11.437447+0000","last_unstale":"2024-08-18T22:22:12.436761+0000","last_undegraded":"2024-08-18T22:22:12.436761+0000","last_fullsized":"2024-08-18T22:22:12.436761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:44.230542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361488+0000","last_change":"2024-08-18T22:22:10.444416+0000","last_active":"2024-08-18T22:22:14.361488+0000","last_peered":"2024-08-18T22:22:14.361488+0000","last_clean":"2024-08-18T22:22:14.361488+0000","last_became_active":"2024-08-18T22:22:10.443904+0000","last_became_peered":"2024-08-18T22:22:10.443904+0000","last_unstale":"2024-08-18T22:22:14.361488+0000","last_undegraded":"2024-08-18T22:22:14.361488+0000","last_fullsized":"2024-08-18T22:22:14.361488+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:41.576670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361620+0000","last_change":"2024-08-18T22:22:11.434634+0000","last_active":"2024-08-18T22:22:14.361620+0000","last_peered":"2024-08-18T22:22:14.361620+0000","last_clean":"2024-08-18T22:22:14.361620+0000","last_became_active":"2024-08-18T22:22:11.434339+0000","last_became_peered":"2024-08-18T22:22:11.434339+0000","last_unstale":"2024-08-18T22:22:14.361620+0000","last_undegraded":"2024-08-18T22:22:14.361620+0000","last_fullsized":"2024-08-18T22:22:14.361620+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:37.525322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361554+0000","last_change":"2024-08-18T22:22:10.445086+0000","last_active":"2024-08-18T22:22:14.361554+0000","last_peered":"2024-08-18T22:22:14.361554+0000","last_clean":"2024-08-18T22:22:14.361554+0000","last_became_active":"2024-08-18T22:22:10.443901+0000","last_became_peered":"2024-08-18T22:22:10.443901+0000","last_unstale":"2024-08-18T22:22:14.361554+0000","last_undegraded":"2024-08-18T22:22:14.361554+0000","last_fullsized":"2024-08-18T22:22:14.361554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:50.763870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663686+0000","last_change":"2024-08-18T22:22:11.696062+0000","last_active":"2024-08-18T22:22:12.663686+0000","last_peered":"2024-08-18T22:22:12.663686+0000","last_clean":"2024-08-18T22:22:12.663686+0000","last_became_active":"2024-08-18T22:22:11.693315+0000","last_became_peered":"2024-08-18T22:22:11.693315+0000","last_unstale":"2024-08-18T22:22:12.663686+0000","last_undegraded":"2024-08-18T22:22:12.663686+0000","last_fullsized":"2024-08-18T22:22:12.663686+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:35.835298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437395+0000","last_change":"2024-08-18T22:22:10.437524+0000","last_active":"2024-08-18T22:22:12.437395+0000","last_peered":"2024-08-18T22:22:12.437395+0000","last_clean":"2024-08-18T22:22:12.437395+0000","last_became_active":"2024-08-18T22:22:10.437205+0000","last_became_peered":"2024-08-18T22:22:10.437205+0000","last_unstale":"2024-08-18T22:22:12.437395+0000","last_undegraded":"2024-08-18T22:22:12.437395+0000","last_fullsized":"2024-08-18T22:22:12.437395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:38:35.135643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361386+0000","last_change":"2024-08-18T22:22:11.699121+0000","last_active":"2024-08-18T22:22:14.361386+0000","last_peered":"2024-08-18T22:22:14.361386+0000","last_clean":"2024-08-18T22:22:14.361386+0000","last_became_active":"2024-08-18T22:22:11.698942+0000","last_became_peered":"2024-08-18T22:22:11.698942+0000","last_unstale":"2024-08-18T22:22:14.361386+0000","last_undegraded":"2024-08-18T22:22:14.361386+0000","last_fullsized":"2024-08-18T22:22:14.361386+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:30:06.919194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434997+0000","last_change":"2024-08-18T22:22:10.446348+0000","last_active":"2024-08-18T22:22:12.434997+0000","last_peered":"2024-08-18T22:22:12.434997+0000","last_clean":"2024-08-18T22:22:12.434997+0000","last_became_active":"2024-08-18T22:22:10.445868+0000","last_became_peered":"2024-08-18T22:22:10.445868+0000","last_unstale":"2024-08-18T22:22:12.434997+0000","last_undegraded":"2024-08-18T22:22:12.434997+0000","last_fullsized":"2024-08-18T22:22:12.434997+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:17:41.384026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436303+0000","last_change":"2024-08-18T22:22:11.685125+0000","last_active":"2024-08-18T22:22:12.436303+0000","last_peered":"2024-08-18T22:22:12.436303+0000","last_clean":"2024-08-18T22:22:12.436303+0000","last_became_active":"2024-08-18T22:22:11.684877+0000","last_became_peered":"2024-08-18T22:22:11.684877+0000","last_unstale":"2024-08-18T22:22:12.436303+0000","last_undegraded":"2024-08-18T22:22:12.436303+0000","last_fullsized":"2024-08-18T22:22:12.436303+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361041+0000","last_change":"2024-08-18T22:22:10.430868+0000","last_active":"2024-08-18T22:22:14.361041+0000","last_peered":"2024-08-18T22:22:14.361041+0000","last_clean":"2024-08-18T22:22:14.361041+0000","last_became_active":"2024-08-18T22:22:10.430580+0000","last_became_peered":"2024-08-18T22:22:10.430580+0000","last_unstale":"2024-08-18T22:22:14.361041+0000","last_undegraded":"2024-08-18T22:22:14.361041+0000","last_fullsized":"2024-08-18T22:22:14.361041+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:26.919577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664190+0000","last_change":"2024-08-18T22:22:11.688121+0000","last_active":"2024-08-18T22:22:12.664190+0000","last_peered":"2024-08-18T22:22:12.664190+0000","last_clean":"2024-08-18T22:22:12.664190+0000","last_became_active":"2024-08-18T22:22:11.687691+0000","last_became_peered":"2024-08-18T22:22:11.687691+0000","last_unstale":"2024-08-18T22:22:12.664190+0000","last_undegraded":"2024-08-18T22:22:12.664190+0000","last_fullsized":"2024-08-18T22:22:12.664190+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:42:20.647483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361391+0000","last_change":"2024-08-18T22:22:10.432702+0000","last_active":"2024-08-18T22:22:14.361391+0000","last_peered":"2024-08-18T22:22:14.361391+0000","last_clean":"2024-08-18T22:22:14.361391+0000","last_became_active":"2024-08-18T22:22:10.432258+0000","last_became_peered":"2024-08-18T22:22:10.432258+0000","last_unstale":"2024-08-18T22:22:14.361391+0000","last_undegraded":"2024-08-18T22:22:14.361391+0000","last_fullsized":"2024-08-18T22:22:14.361391+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:01:07.848661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436605+0000","last_change":"2024-08-18T22:22:11.675403+0000","last_active":"2024-08-18T22:22:12.436605+0000","last_peered":"2024-08-18T22:22:12.436605+0000","last_clean":"2024-08-18T22:22:12.436605+0000","last_became_active":"2024-08-18T22:22:11.675113+0000","last_became_peered":"2024-08-18T22:22:11.675113+0000","last_unstale":"2024-08-18T22:22:12.436605+0000","last_undegraded":"2024-08-18T22:22:12.436605+0000","last_fullsized":"2024-08-18T22:22:12.436605+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434330+0000","last_change":"2024-08-18T22:22:10.433218+0000","last_active":"2024-08-18T22:22:12.434330+0000","last_peered":"2024-08-18T22:22:12.434330+0000","last_clean":"2024-08-18T22:22:12.434330+0000","last_became_active":"2024-08-18T22:22:10.432947+0000","last_became_peered":"2024-08-18T22:22:10.432947+0000","last_unstale":"2024-08-18T22:22:12.434330+0000","last_undegraded":"2024-08-18T22:22:12.434330+0000","last_fullsized":"2024-08-18T22:22:12.434330+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:28:51.101447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361030+0000","last_change":"2024-08-18T22:22:11.690110+0000","last_active":"2024-08-18T22:22:14.361030+0000","last_peered":"2024-08-18T22:22:14.361030+0000","last_clean":"2024-08-18T22:22:14.361030+0000","last_became_active":"2024-08-18T22:22:11.689833+0000","last_became_peered":"2024-08-18T22:22:11.689833+0000","last_unstale":"2024-08-18T22:22:14.361030+0000","last_undegraded":"2024-08-18T22:22:14.361030+0000","last_fullsized":"2024-08-18T22:22:14.361030+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:54.250255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436697+0000","last_change":"2024-08-18T22:22:10.434355+0000","last_active":"2024-08-18T22:22:12.436697+0000","last_peered":"2024-08-18T22:22:12.436697+0000","last_clean":"2024-08-18T22:22:12.436697+0000","last_became_active":"2024-08-18T22:22:10.434027+0000","last_became_peered":"2024-08-18T22:22:10.434027+0000","last_unstale":"2024-08-18T22:22:12.436697+0000","last_undegraded":"2024-08-18T22:22:12.436697+0000","last_fullsized":"2024-08-18T22:22:12.436697+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:05:15.817540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436618+0000","last_change":"2024-08-18T22:22:11.440263+0000","last_active":"2024-08-18T22:22:12.436618+0000","last_peered":"2024-08-18T22:22:12.436618+0000","last_clean":"2024-08-18T22:22:12.436618+0000","last_became_active":"2024-08-18T22:22:11.439371+0000","last_became_peered":"2024-08-18T22:22:11.439371+0000","last_unstale":"2024-08-18T22:22:12.436618+0000","last_undegraded":"2024-08-18T22:22:12.436618+0000","last_fullsized":"2024-08-18T22:22:12.436618+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:29:12.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361596+0000","last_change":"2024-08-18T22:22:10.434830+0000","last_active":"2024-08-18T22:22:14.361596+0000","last_peered":"2024-08-18T22:22:14.361596+0000","last_clean":"2024-08-18T22:22:14.361596+0000","last_became_active":"2024-08-18T22:22:10.434370+0000","last_became_peered":"2024-08-18T22:22:10.434370+0000","last_unstale":"2024-08-18T22:22:14.361596+0000","last_undegraded":"2024-08-18T22:22:14.361596+0000","last_fullsized":"2024-08-18T22:22:14.361596+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:29:45.617865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434721+0000","last_change":"2024-08-18T22:22:11.674739+0000","last_active":"2024-08-18T22:22:12.434721+0000","last_peered":"2024-08-18T22:22:12.434721+0000","last_clean":"2024-08-18T22:22:12.434721+0000","last_became_active":"2024-08-18T22:22:11.674451+0000","last_became_peered":"2024-08-18T22:22:11.674451+0000","last_unstale":"2024-08-18T22:22:12.434721+0000","last_undegraded":"2024-08-18T22:22:12.434721+0000","last_fullsized":"2024-08-18T22:22:12.434721+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:31.682951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"54'3","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436528+0000","last_change":"2024-08-18T22:22:10.445969+0000","last_active":"2024-08-18T22:22:12.436528+0000","last_peered":"2024-08-18T22:22:12.436528+0000","last_clean":"2024-08-18T22:22:12.436528+0000","last_became_active":"2024-08-18T22:22:10.445685+0000","last_became_peered":"2024-08-18T22:22:10.445685+0000","last_unstale":"2024-08-18T22:22:12.436528+0000","last_undegraded":"2024-08-18T22:22:12.436528+0000","last_fullsized":"2024-08-18T22:22:12.436528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:34:40.944063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361402+0000","last_change":"2024-08-18T22:22:11.680054+0000","last_active":"2024-08-18T22:22:14.361402+0000","last_peered":"2024-08-18T22:22:14.361402+0000","last_clean":"2024-08-18T22:22:14.361402+0000","last_became_active":"2024-08-18T22:22:11.679765+0000","last_became_peered":"2024-08-18T22:22:11.679765+0000","last_unstale":"2024-08-18T22:22:14.361402+0000","last_undegraded":"2024-08-18T22:22:14.361402+0000","last_fullsized":"2024-08-18T22:22:14.361402+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:32:16.881630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664023+0000","last_change":"2024-08-18T22:22:10.441766+0000","last_active":"2024-08-18T22:22:12.664023+0000","last_peered":"2024-08-18T22:22:12.664023+0000","last_clean":"2024-08-18T22:22:12.664023+0000","last_became_active":"2024-08-18T22:22:10.441345+0000","last_became_peered":"2024-08-18T22:22:10.441345+0000","last_unstale":"2024-08-18T22:22:12.664023+0000","last_undegraded":"2024-08-18T22:22:12.664023+0000","last_fullsized":"2024-08-18T22:22:12.664023+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:00.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437013+0000","last_change":"2024-08-18T22:22:11.439705+0000","last_active":"2024-08-18T22:22:12.437013+0000","last_peered":"2024-08-18T22:22:12.437013+0000","last_clean":"2024-08-18T22:22:12.437013+0000","last_became_active":"2024-08-18T22:22:11.439381+0000","last_became_peered":"2024-08-18T22:22:11.439381+0000","last_unstale":"2024-08-18T22:22:12.437013+0000","last_undegraded":"2024-08-18T22:22:12.437013+0000","last_fullsized":"2024-08-18T22:22:12.437013+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:25.043007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435001+0000","last_change":"2024-08-18T22:22:10.435837+0000","last_active":"2024-08-18T22:22:12.435001+0000","last_peered":"2024-08-18T22:22:12.435001+0000","last_clean":"2024-08-18T22:22:12.435001+0000","last_became_active":"2024-08-18T22:22:10.435534+0000","last_became_peered":"2024-08-18T22:22:10.435534+0000","last_unstale":"2024-08-18T22:22:12.435001+0000","last_undegraded":"2024-08-18T22:22:12.435001+0000","last_fullsized":"2024-08-18T22:22:12.435001+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:53.443012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435338+0000","last_change":"2024-08-18T22:22:11.686961+0000","last_active":"2024-08-18T22:22:12.435338+0000","last_peered":"2024-08-18T22:22:12.435338+0000","last_clean":"2024-08-18T22:22:12.435338+0000","last_became_active":"2024-08-18T22:22:11.686690+0000","last_became_peered":"2024-08-18T22:22:11.686690+0000","last_unstale":"2024-08-18T22:22:12.435338+0000","last_undegraded":"2024-08-18T22:22:12.435338+0000","last_fullsized":"2024-08-18T22:22:12.435338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:57:48.800840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361628+0000","last_change":"2024-08-18T22:22:10.435408+0000","last_active":"2024-08-18T22:22:14.361628+0000","last_peered":"2024-08-18T22:22:14.361628+0000","last_clean":"2024-08-18T22:22:14.361628+0000","last_became_active":"2024-08-18T22:22:10.435141+0000","last_became_peered":"2024-08-18T22:22:10.435141+0000","last_unstale":"2024-08-18T22:22:14.361628+0000","last_undegraded":"2024-08-18T22:22:14.361628+0000","last_fullsized":"2024-08-18T22:22:14.361628+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:52.760163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664018+0000","last_change":"2024-08-18T22:22:11.680794+0000","last_active":"2024-08-18T22:22:12.664018+0000","last_peered":"2024-08-18T22:22:12.664018+0000","last_clean":"2024-08-18T22:22:12.664018+0000","last_became_active":"2024-08-18T22:22:11.680510+0000","last_became_peered":"2024-08-18T22:22:11.680510+0000","last_unstale":"2024-08-18T22:22:12.664018+0000","last_undegraded":"2024-08-18T22:22:12.664018+0000","last_fullsized":"2024-08-18T22:22:12.664018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:09.366034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436203+0000","last_change":"2024-08-18T22:22:10.430246+0000","last_active":"2024-08-18T22:22:12.436203+0000","last_peered":"2024-08-18T22:22:12.436203+0000","last_clean":"2024-08-18T22:22:12.436203+0000","last_became_active":"2024-08-18T22:22:10.429923+0000","last_became_peered":"2024-08-18T22:22:10.429923+0000","last_unstale":"2024-08-18T22:22:12.436203+0000","last_undegraded":"2024-08-18T22:22:12.436203+0000","last_fullsized":"2024-08-18T22:22:12.436203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:44:29.431155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435499+0000","last_change":"2024-08-18T22:22:11.677704+0000","last_active":"2024-08-18T22:22:12.435499+0000","last_peered":"2024-08-18T22:22:12.435499+0000","last_clean":"2024-08-18T22:22:12.435499+0000","last_became_active":"2024-08-18T22:22:11.676998+0000","last_became_peered":"2024-08-18T22:22:11.676998+0000","last_unstale":"2024-08-18T22:22:12.435499+0000","last_undegraded":"2024-08-18T22:22:12.435499+0000","last_fullsized":"2024-08-18T22:22:12.435499+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:32.138824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663844+0000","last_change":"2024-08-18T22:22:10.444587+0000","last_active":"2024-08-18T22:22:12.663844+0000","last_peered":"2024-08-18T22:22:12.663844+0000","last_clean":"2024-08-18T22:22:12.663844+0000","last_became_active":"2024-08-18T22:22:10.440296+0000","last_became_peered":"2024-08-18T22:22:10.440296+0000","last_unstale":"2024-08-18T22:22:12.663844+0000","last_undegraded":"2024-08-18T22:22:12.663844+0000","last_fullsized":"2024-08-18T22:22:12.663844+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:25.298286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663734+0000","last_change":"2024-08-18T22:22:11.694606+0000","last_active":"2024-08-18T22:22:12.663734+0000","last_peered":"2024-08-18T22:22:12.663734+0000","last_clean":"2024-08-18T22:22:12.663734+0000","last_became_active":"2024-08-18T22:22:11.694331+0000","last_became_peered":"2024-08-18T22:22:11.694331+0000","last_unstale":"2024-08-18T22:22:12.663734+0000","last_undegraded":"2024-08-18T22:22:12.663734+0000","last_fullsized":"2024-08-18T22:22:12.663734+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:02.952657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435676+0000","last_change":"2024-08-18T22:22:10.444339+0000","last_active":"2024-08-18T22:22:12.435676+0000","last_peered":"2024-08-18T22:22:12.435676+0000","last_clean":"2024-08-18T22:22:12.435676+0000","last_became_active":"2024-08-18T22:22:10.442957+0000","last_became_peered":"2024-08-18T22:22:10.442957+0000","last_unstale":"2024-08-18T22:22:12.435676+0000","last_undegraded":"2024-08-18T22:22:12.435676+0000","last_fullsized":"2024-08-18T22:22:12.435676+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:36.521543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361210+0000","last_change":"2024-08-18T22:22:11.677128+0000","last_active":"2024-08-18T22:22:14.361210+0000","last_peered":"2024-08-18T22:22:14.361210+0000","last_clean":"2024-08-18T22:22:14.361210+0000","last_became_active":"2024-08-18T22:22:11.676813+0000","last_became_peered":"2024-08-18T22:22:11.676813+0000","last_unstale":"2024-08-18T22:22:14.361210+0000","last_undegraded":"2024-08-18T22:22:14.361210+0000","last_fullsized":"2024-08-18T22:22:14.361210+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:34:41.947842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.525135+0000","last_change":"2024-08-18T22:22:10.434500+0000","last_active":"2024-08-18T22:22:12.525135+0000","last_peered":"2024-08-18T22:22:12.525135+0000","last_clean":"2024-08-18T22:22:12.525135+0000","last_became_active":"2024-08-18T22:22:10.431542+0000","last_became_peered":"2024-08-18T22:22:10.431542+0000","last_unstale":"2024-08-18T22:22:12.525135+0000","last_undegraded":"2024-08-18T22:22:12.525135+0000","last_fullsized":"2024-08-18T22:22:12.525135+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:40:00.812485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.360917+0000","last_change":"2024-08-18T22:22:11.677763+0000","last_active":"2024-08-18T22:22:14.360917+0000","last_peered":"2024-08-18T22:22:14.360917+0000","last_clean":"2024-08-18T22:22:14.360917+0000","last_became_active":"2024-08-18T22:22:11.677440+0000","last_became_peered":"2024-08-18T22:22:11.677440+0000","last_unstale":"2024-08-18T22:22:14.360917+0000","last_undegraded":"2024-08-18T22:22:14.360917+0000","last_fullsized":"2024-08-18T22:22:14.360917+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:22:00.180712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361506+0000","last_change":"2024-08-18T22:22:10.445708+0000","last_active":"2024-08-18T22:22:14.361506+0000","last_peered":"2024-08-18T22:22:14.361506+0000","last_clean":"2024-08-18T22:22:14.361506+0000","last_became_active":"2024-08-18T22:22:10.445397+0000","last_became_peered":"2024-08-18T22:22:10.445397+0000","last_unstale":"2024-08-18T22:22:14.361506+0000","last_undegraded":"2024-08-18T22:22:14.361506+0000","last_fullsized":"2024-08-18T22:22:14.361506+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:22.379698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361191+0000","last_change":"2024-08-18T22:22:11.676481+0000","last_active":"2024-08-18T22:22:14.361191+0000","last_peered":"2024-08-18T22:22:14.361191+0000","last_clean":"2024-08-18T22:22:14.361191+0000","last_became_active":"2024-08-18T22:22:11.675869+0000","last_became_peered":"2024-08-18T22:22:11.675869+0000","last_unstale":"2024-08-18T22:22:14.361191+0000","last_undegraded":"2024-08-18T22:22:14.361191+0000","last_fullsized":"2024-08-18T22:22:14.361191+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:06.213884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361569+0000","last_change":"2024-08-18T22:22:10.430687+0000","last_active":"2024-08-18T22:22:14.361569+0000","last_peered":"2024-08-18T22:22:14.361569+0000","last_clean":"2024-08-18T22:22:14.361569+0000","last_became_active":"2024-08-18T22:22:10.430161+0000","last_became_peered":"2024-08-18T22:22:10.430161+0000","last_unstale":"2024-08-18T22:22:14.361569+0000","last_undegraded":"2024-08-18T22:22:14.361569+0000","last_fullsized":"2024-08-18T22:22:14.361569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:44.609281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.437196+0000","last_change":"2024-08-18T22:22:11.441544+0000","last_active":"2024-08-18T22:22:12.437196+0000","last_peered":"2024-08-18T22:22:12.437196+0000","last_clean":"2024-08-18T22:22:12.437196+0000","last_became_active":"2024-08-18T22:22:11.441261+0000","last_became_peered":"2024-08-18T22:22:11.441261+0000","last_unstale":"2024-08-18T22:22:12.437196+0000","last_undegraded":"2024-08-18T22:22:12.437196+0000","last_fullsized":"2024-08-18T22:22:12.437196+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:09.847042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361328+0000","last_change":"2024-08-18T22:22:10.444168+0000","last_active":"2024-08-18T22:22:14.361328+0000","last_peered":"2024-08-18T22:22:14.361328+0000","last_clean":"2024-08-18T22:22:14.361328+0000","last_became_active":"2024-08-18T22:22:10.443546+0000","last_became_peered":"2024-08-18T22:22:10.443546+0000","last_unstale":"2024-08-18T22:22:14.361328+0000","last_undegraded":"2024-08-18T22:22:14.361328+0000","last_fullsized":"2024-08-18T22:22:14.361328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:03:26.180275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361486+0000","last_change":"2024-08-18T22:22:11.428926+0000","last_active":"2024-08-18T22:22:14.361486+0000","last_peered":"2024-08-18T22:22:14.361486+0000","last_clean":"2024-08-18T22:22:14.361486+0000","last_became_active":"2024-08-18T22:22:11.428494+0000","last_became_peered":"2024-08-18T22:22:11.428494+0000","last_unstale":"2024-08-18T22:22:14.361486+0000","last_undegraded":"2024-08-18T22:22:14.361486+0000","last_fullsized":"2024-08-18T22:22:14.361486+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:41.408974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663933+0000","last_change":"2024-08-18T22:22:10.439941+0000","last_active":"2024-08-18T22:22:12.663933+0000","last_peered":"2024-08-18T22:22:12.663933+0000","last_clean":"2024-08-18T22:22:12.663933+0000","last_became_active":"2024-08-18T22:22:10.439643+0000","last_became_peered":"2024-08-18T22:22:10.439643+0000","last_unstale":"2024-08-18T22:22:12.663933+0000","last_undegraded":"2024-08-18T22:22:12.663933+0000","last_fullsized":"2024-08-18T22:22:12.663933+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:17.149522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435392+0000","last_change":"2024-08-18T22:22:11.674241+0000","last_active":"2024-08-18T22:22:12.435392+0000","last_peered":"2024-08-18T22:22:12.435392+0000","last_clean":"2024-08-18T22:22:12.435392+0000","last_became_active":"2024-08-18T22:22:11.673969+0000","last_became_peered":"2024-08-18T22:22:11.673969+0000","last_unstale":"2024-08-18T22:22:12.435392+0000","last_undegraded":"2024-08-18T22:22:12.435392+0000","last_fullsized":"2024-08-18T22:22:12.435392+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:35.835298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.434493+0000","last_change":"2024-08-18T22:22:10.447007+0000","last_active":"2024-08-18T22:22:12.434493+0000","last_peered":"2024-08-18T22:22:12.434493+0000","last_clean":"2024-08-18T22:22:12.434493+0000","last_became_active":"2024-08-18T22:22:10.446729+0000","last_became_peered":"2024-08-18T22:22:10.446729+0000","last_unstale":"2024-08-18T22:22:12.434493+0000","last_undegraded":"2024-08-18T22:22:12.434493+0000","last_fullsized":"2024-08-18T22:22:12.434493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:44:31.581871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361519+0000","last_change":"2024-08-18T22:22:11.684053+0000","last_active":"2024-08-18T22:22:14.361519+0000","last_peered":"2024-08-18T22:22:14.361519+0000","last_clean":"2024-08-18T22:22:14.361519+0000","last_became_active":"2024-08-18T22:22:11.683737+0000","last_became_peered":"2024-08-18T22:22:11.683737+0000","last_unstale":"2024-08-18T22:22:14.361519+0000","last_undegraded":"2024-08-18T22:22:14.361519+0000","last_fullsized":"2024-08-18T22:22:14.361519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:50:08.344652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.524688+0000","last_change":"2024-08-18T22:22:10.435989+0000","last_active":"2024-08-18T22:22:12.524688+0000","last_peered":"2024-08-18T22:22:12.524688+0000","last_clean":"2024-08-18T22:22:12.524688+0000","last_became_active":"2024-08-18T22:22:10.435491+0000","last_became_peered":"2024-08-18T22:22:10.435491+0000","last_unstale":"2024-08-18T22:22:12.524688+0000","last_undegraded":"2024-08-18T22:22:12.524688+0000","last_fullsized":"2024-08-18T22:22:12.524688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:06.742938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436249+0000","last_change":"2024-08-18T22:22:11.685875+0000","last_active":"2024-08-18T22:22:12.436249+0000","last_peered":"2024-08-18T22:22:12.436249+0000","last_clean":"2024-08-18T22:22:12.436249+0000","last_became_active":"2024-08-18T22:22:11.685542+0000","last_became_peered":"2024-08-18T22:22:11.685542+0000","last_unstale":"2024-08-18T22:22:12.436249+0000","last_undegraded":"2024-08-18T22:22:12.436249+0000","last_fullsized":"2024-08-18T22:22:12.436249+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:21:26.302065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361631+0000","last_change":"2024-08-18T22:22:10.438951+0000","last_active":"2024-08-18T22:22:14.361631+0000","last_peered":"2024-08-18T22:22:14.361631+0000","last_clean":"2024-08-18T22:22:14.361631+0000","last_became_active":"2024-08-18T22:22:10.438629+0000","last_became_peered":"2024-08-18T22:22:10.438629+0000","last_unstale":"2024-08-18T22:22:14.361631+0000","last_undegraded":"2024-08-18T22:22:14.361631+0000","last_fullsized":"2024-08-18T22:22:14.361631+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:52.125406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361227+0000","last_change":"2024-08-18T22:22:11.689322+0000","last_active":"2024-08-18T22:22:14.361227+0000","last_peered":"2024-08-18T22:22:14.361227+0000","last_clean":"2024-08-18T22:22:14.361227+0000","last_became_active":"2024-08-18T22:22:11.689002+0000","last_became_peered":"2024-08-18T22:22:11.689002+0000","last_unstale":"2024-08-18T22:22:14.361227+0000","last_undegraded":"2024-08-18T22:22:14.361227+0000","last_fullsized":"2024-08-18T22:22:14.361227+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:53.646348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436640+0000","last_change":"2024-08-18T22:22:10.437824+0000","last_active":"2024-08-18T22:22:12.436640+0000","last_peered":"2024-08-18T22:22:12.436640+0000","last_clean":"2024-08-18T22:22:12.436640+0000","last_became_active":"2024-08-18T22:22:10.437457+0000","last_became_peered":"2024-08-18T22:22:10.437457+0000","last_unstale":"2024-08-18T22:22:12.436640+0000","last_undegraded":"2024-08-18T22:22:12.436640+0000","last_fullsized":"2024-08-18T22:22:12.436640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:05.210105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663838+0000","last_change":"2024-08-18T22:22:11.684534+0000","last_active":"2024-08-18T22:22:12.663838+0000","last_peered":"2024-08-18T22:22:12.663838+0000","last_clean":"2024-08-18T22:22:12.663838+0000","last_became_active":"2024-08-18T22:22:11.678903+0000","last_became_peered":"2024-08-18T22:22:11.678903+0000","last_unstale":"2024-08-18T22:22:12.663838+0000","last_undegraded":"2024-08-18T22:22:12.663838+0000","last_fullsized":"2024-08-18T22:22:12.663838+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:43:39.828882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435106+0000","last_change":"2024-08-18T22:22:10.443792+0000","last_active":"2024-08-18T22:22:12.435106+0000","last_peered":"2024-08-18T22:22:12.435106+0000","last_clean":"2024-08-18T22:22:12.435106+0000","last_became_active":"2024-08-18T22:22:10.443526+0000","last_became_peered":"2024-08-18T22:22:10.443526+0000","last_unstale":"2024-08-18T22:22:12.435106+0000","last_undegraded":"2024-08-18T22:22:12.435106+0000","last_fullsized":"2024-08-18T22:22:12.435106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:40.405195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435096+0000","last_change":"2024-08-18T22:22:11.697582+0000","last_active":"2024-08-18T22:22:12.435096+0000","last_peered":"2024-08-18T22:22:12.435096+0000","last_clean":"2024-08-18T22:22:12.435096+0000","last_became_active":"2024-08-18T22:22:11.696095+0000","last_became_peered":"2024-08-18T22:22:11.696095+0000","last_unstale":"2024-08-18T22:22:12.435096+0000","last_undegraded":"2024-08-18T22:22:12.435096+0000","last_fullsized":"2024-08-18T22:22:12.435096+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:03:06.402713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663942+0000","last_change":"2024-08-18T22:22:10.444120+0000","last_active":"2024-08-18T22:22:12.663942+0000","last_peered":"2024-08-18T22:22:12.663942+0000","last_clean":"2024-08-18T22:22:12.663942+0000","last_became_active":"2024-08-18T22:22:10.439575+0000","last_became_peered":"2024-08-18T22:22:10.439575+0000","last_unstale":"2024-08-18T22:22:12.663942+0000","last_undegraded":"2024-08-18T22:22:12.663942+0000","last_fullsized":"2024-08-18T22:22:12.663942+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:36:02.531876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436867+0000","last_change":"2024-08-18T22:22:11.439736+0000","last_active":"2024-08-18T22:22:12.436867+0000","last_peered":"2024-08-18T22:22:12.436867+0000","last_clean":"2024-08-18T22:22:12.436867+0000","last_became_active":"2024-08-18T22:22:11.439435+0000","last_became_peered":"2024-08-18T22:22:11.439435+0000","last_unstale":"2024-08-18T22:22:12.436867+0000","last_undegraded":"2024-08-18T22:22:12.436867+0000","last_fullsized":"2024-08-18T22:22:12.436867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:20:01.507182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.663891+0000","last_change":"2024-08-18T22:22:10.446577+0000","last_active":"2024-08-18T22:22:12.663891+0000","last_peered":"2024-08-18T22:22:12.663891+0000","last_clean":"2024-08-18T22:22:12.663891+0000","last_became_active":"2024-08-18T22:22:10.445524+0000","last_became_peered":"2024-08-18T22:22:10.445524+0000","last_unstale":"2024-08-18T22:22:12.663891+0000","last_undegraded":"2024-08-18T22:22:12.663891+0000","last_fullsized":"2024-08-18T22:22:12.663891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:56:38.716953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435338+0000","last_change":"2024-08-18T22:22:11.691037+0000","last_active":"2024-08-18T22:22:12.435338+0000","last_peered":"2024-08-18T22:22:12.435338+0000","last_clean":"2024-08-18T22:22:12.435338+0000","last_became_active":"2024-08-18T22:22:11.690232+0000","last_became_peered":"2024-08-18T22:22:11.690232+0000","last_unstale":"2024-08-18T22:22:12.435338+0000","last_undegraded":"2024-08-18T22:22:12.435338+0000","last_fullsized":"2024-08-18T22:22:12.435338+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:48.099976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.360870+0000","last_change":"2024-08-18T22:22:10.434323+0000","last_active":"2024-08-18T22:22:14.360870+0000","last_peered":"2024-08-18T22:22:14.360870+0000","last_clean":"2024-08-18T22:22:14.360870+0000","last_became_active":"2024-08-18T22:22:10.433352+0000","last_became_peered":"2024-08-18T22:22:10.433352+0000","last_unstale":"2024-08-18T22:22:14.360870+0000","last_undegraded":"2024-08-18T22:22:14.360870+0000","last_fullsized":"2024-08-18T22:22:14.360870+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:06.502547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.664299+0000","last_change":"2024-08-18T22:22:11.707772+0000","last_active":"2024-08-18T22:22:12.664299+0000","last_peered":"2024-08-18T22:22:12.664299+0000","last_clean":"2024-08-18T22:22:12.664299+0000","last_became_active":"2024-08-18T22:22:11.707504+0000","last_became_peered":"2024-08-18T22:22:11.707504+0000","last_unstale":"2024-08-18T22:22:12.664299+0000","last_undegraded":"2024-08-18T22:22:12.664299+0000","last_fullsized":"2024-08-18T22:22:12.664299+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:12:52.604419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.436339+0000","last_change":"2024-08-18T22:22:10.445621+0000","last_active":"2024-08-18T22:22:12.436339+0000","last_peered":"2024-08-18T22:22:12.436339+0000","last_clean":"2024-08-18T22:22:12.436339+0000","last_became_active":"2024-08-18T22:22:10.445287+0000","last_became_peered":"2024-08-18T22:22:10.445287+0000","last_unstale":"2024-08-18T22:22:12.436339+0000","last_undegraded":"2024-08-18T22:22:12.436339+0000","last_fullsized":"2024-08-18T22:22:12.436339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:52.642569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:14.361384+0000","last_change":"2024-08-18T22:22:11.439402+0000","last_active":"2024-08-18T22:22:14.361384+0000","last_peered":"2024-08-18T22:22:14.361384+0000","last_clean":"2024-08-18T22:22:14.361384+0000","last_became_active":"2024-08-18T22:22:11.439124+0000","last_became_peered":"2024-08-18T22:22:11.439124+0000","last_unstale":"2024-08-18T22:22:14.361384+0000","last_undegraded":"2024-08-18T22:22:14.361384+0000","last_fullsized":"2024-08-18T22:22:14.361384+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:10.407943+0000","last_clean_scrub_stamp":"2024-08-18T22:22:10.407943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:54.446791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"55'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:13.429354+0000","last_change":"2024-08-18T22:22:10.439170+0000","last_active":"2024-08-18T22:22:13.429354+0000","last_peered":"2024-08-18T22:22:13.429354+0000","last_clean":"2024-08-18T22:22:13.429354+0000","last_became_active":"2024-08-18T22:22:10.438722+0000","last_became_peered":"2024-08-18T22:22:10.438722+0000","last_unstale":"2024-08-18T22:22:13.429354+0000","last_undegraded":"2024-08-18T22:22:13.429354+0000","last_fullsized":"2024-08-18T22:22:13.429354+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:22:09.404164+0000","last_clean_scrub_stamp":"2024-08-18T22:22:09.404164+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:05.210105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":239,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-08-18T22:22:12.435645+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:22:12.435645+0000","last_peered":"2024-08-18T22:22:12.435645+0000","last_clean":"2024-08-18T22:22:12.435645+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:22:12.435645+0000","last_undegraded":"2024-08-18T22:22:12.435645+0000","last_fullsized":"2024-08-18T22:22:12.435645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36560,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335280,"statfs":{"total":96636764160,"available":96599326720,"internally_reserved":0,"allocated":1249280,"data_stored":881685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":655360,"data_stored":291845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":647168,"data_stored":291193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40148,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331692,"statfs":{"total":96636764160,"available":96595652608,"internally_reserved":0,"allocated":663552,"data_stored":292827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":655360,"data_stored":291353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1249280,"data_stored":881617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35976,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335864,"statfs":{"total":96636764160,"available":96599924736,"internally_reserved":0,"allocated":651264,"data_stored":291775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35988,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335852,"statfs":{"total":96636764160,"available":96599912448,"internally_reserved":0,"allocated":659456,"data_stored":292805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:22:20.898 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:22:20.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:22:21.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.039+0000 7f8049a00640 1 Processor -- start 2024-08-18T22:22:21.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.039+0000 7f8049a00640 1 -- start start 2024-08-18T22:22:21.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8049a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80440b40c0 0x7f80440b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8049a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f80440ce280 0x7f80440ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8049a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80440b31f0 con 0x7f804415b0c0 2024-08-18T22:22:21.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8049a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f80440b3d70 con 0x7f80440ce280 2024-08-18T22:22:21.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8049a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f80440b4a40 con 0x7f80440b40c0 2024-08-18T22:22:21.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8042a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f804415b0c0 0x7f804406db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59348/0 (socket says 172.21.15.5:59348) 2024-08-18T22:22:21.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8042a00640 1 -- 172.21.15.5:0/82070530 learned_addr learned my addr 172.21.15.5:0/82070530 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f803a000640 1 --2- 172.21.15.5:0/82070530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80440b40c0 0x7f80440b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8043400640 1 --2- 172.21.15.5:0/82070530 >> v2:172.21.15.117:3300/0 conn(0x7f80440ce280 0x7f80440ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8042000640 1 -- 172.21.15.5:0/82070530 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160675567 0 0) 0x7f80440b31f0 con 0x7f804415b0c0 2024-08-18T22:22:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8042000640 1 -- 172.21.15.5:0/82070530 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8028003530 con 0x7f804415b0c0 2024-08-18T22:22:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8043400640 1 -- 172.21.15.5:0/82070530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80440b40c0 msgr2=0x7f80440b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8042000640 1 -- 172.21.15.5:0/82070530 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3296559652 0 0) 0x7f8028003530 con 0x7f804415b0c0 2024-08-18T22:22:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8043400640 1 --2- 172.21.15.5:0/82070530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80440b40c0 0x7f80440b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8043400640 1 -- 172.21.15.5:0/82070530 >> v1:172.21.15.5:6789/0 conn(0x7f804415b0c0 legacy=0x7f804406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f8043400640 1 -- 172.21.15.5:0/82070530 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80440b34d0 con 0x7f80440ce280 2024-08-18T22:22:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.043+0000 7f803a000640 1 --2- 172.21.15.5:0/82070530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80440b40c0 0x7f80440b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:21.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8043400640 1 --2- 172.21.15.5:0/82070530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80440ce280 0x7f80440ce6d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f803c009d90 tx=0x7f803c01c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e88710a05491b73 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8042000640 1 -- 172.21.15.5:0/82070530 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803c0ac070 con 0x7f80440ce280 2024-08-18T22:22:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8042000640 1 -- 172.21.15.5:0/82070530 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803c0a6470 con 0x7f80440ce280 2024-08-18T22:22:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8042000640 1 -- 172.21.15.5:0/82070530 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034001680 con 0x7f80440ce280 2024-08-18T22:22:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8049a00640 1 -- 172.21.15.5:0/82070530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80440ce280 msgr2=0x7f80440ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8049a00640 1 --2- 172.21.15.5:0/82070530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80440ce280 0x7f80440ce6d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f803c009d90 tx=0x7f803c01c770 comp rx=0 tx=0).stop 2024-08-18T22:22:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8049a00640 1 -- 172.21.15.5:0/82070530 shutdown_connections 2024-08-18T22:22:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8049a00640 1 --2- 172.21.15.5:0/82070530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80440ce280 0x7f80440ce6d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8049a00640 1 --2- 172.21.15.5:0/82070530 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80440b40c0 0x7f80440b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8049a00640 1 -- 172.21.15.5:0/82070530 >> 172.21.15.5:0/82070530 conn(0x7f80440b1dc0 msgr2=0x7f80440b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8049a00640 1 -- 172.21.15.5:0/82070530 shutdown_connections 2024-08-18T22:22:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8049a00640 1 -- 172.21.15.5:0/82070530 wait complete. 2024-08-18T22:22:21.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8049a00640 1 Processor -- start 2024-08-18T22:22:21.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.047+0000 7f8049a00640 1 -- start start 2024-08-18T22:22:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8049a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80440b40c0 0x7f8044154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8049a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80440ce280 0x7f8044155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8049a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804415b0c0 0x7f8044151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8049a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f804406f7f0 con 0x7f804415b0c0 2024-08-18T22:22:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8049a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f804406f670 con 0x7f80440b40c0 2024-08-18T22:22:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8049a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8044167d10 con 0x7f80440ce280 2024-08-18T22:22:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8043400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804415b0c0 0x7f8044151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8043400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804415b0c0 0x7f8044151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52918/0 (socket says 172.21.15.5:52918) 2024-08-18T22:22:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8043400640 1 -- 172.21.15.5:0/3618279384 learned_addr learned my addr 172.21.15.5:0/3618279384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:21.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f803a000640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80440ce280 0x7f8044155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8042a00640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80440b40c0 0x7f8044154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8043400640 1 -- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80440ce280 msgr2=0x7f8044155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8043400640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80440ce280 0x7f8044155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8043400640 1 -- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80440b40c0 msgr2=0x7f8044154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8043400640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80440b40c0 0x7f8044154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8043400640 1 -- 172.21.15.5:0/3618279384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80440ad1d0 con 0x7f804415b0c0 2024-08-18T22:22:21.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8043400640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804415b0c0 0x7f8044151da0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f803c009d90 tx=0x7f803c019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f803b400640 1 -- 172.21.15.5:0/3618279384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803c0c0070 con 0x7f804415b0c0 2024-08-18T22:22:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f803b400640 1 -- 172.21.15.5:0/3618279384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803c0bb470 con 0x7f804415b0c0 2024-08-18T22:22:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f803b400640 1 -- 172.21.15.5:0/3618279384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803c0ac050 con 0x7f804415b0c0 2024-08-18T22:22:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8049a00640 1 -- 172.21.15.5:0/3618279384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80441556c0 con 0x7f804415b0c0 2024-08-18T22:22:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8049a00640 1 -- 172.21.15.5:0/3618279384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80440ad750 con 0x7f804415b0c0 2024-08-18T22:22:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f8049a00640 1 -- 172.21.15.5:0/3618279384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80440b4500 con 0x7f804415b0c0 2024-08-18T22:22:21.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.051+0000 7f803b400640 1 -- 172.21.15.5:0/3618279384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f803c0af070 con 0x7f804415b0c0 2024-08-18T22:22:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.055+0000 7f803b400640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80200678c0 0x7f8020069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.055+0000 7f803b400640 1 -- 172.21.15.5:0/3618279384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f803c120240 con 0x7f804415b0c0 2024-08-18T22:22:21.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.055+0000 7f8042a00640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80200678c0 0x7f8020069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.055+0000 7f8042a00640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80200678c0 0x7f8020069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f80340011f0 tx=0x7f8034009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.059+0000 7f803b400640 1 -- 172.21.15.5:0/3618279384 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f803c016480 con 0x7f804415b0c0 2024-08-18T22:22:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.279+0000 7f8049a00640 1 -- 172.21.15.5:0/3618279384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f804406dd20 con 0x7f804415b0c0 2024-08-18T22:22:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f803b400640 1 -- 172.21.15.5:0/3618279384 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f803c0f0d00 con 0x7f804415b0c0 2024-08-18T22:22:21.286 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:22:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:22:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:22:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:22:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:22:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:22:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 -- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80200678c0 msgr2=0x7f8020069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80200678c0 0x7f8020069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f80340011f0 tx=0x7f8034009040 comp rx=0 tx=0).stop 2024-08-18T22:22:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 -- 172.21.15.5:0/3618279384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804415b0c0 msgr2=0x7f8044151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804415b0c0 0x7f8044151da0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f803c009d90 tx=0x7f803c019510 comp rx=0 tx=0).stop 2024-08-18T22:22:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 -- 172.21.15.5:0/3618279384 shutdown_connections 2024-08-18T22:22:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80200678c0 0x7f8020069d80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f804415b0c0 0x7f8044151da0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80440ce280 0x7f8044155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 --2- 172.21.15.5:0/3618279384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80440b40c0 0x7f8044154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 -- 172.21.15.5:0/3618279384 >> 172.21.15.5:0/3618279384 conn(0x7f80440b1dc0 msgr2=0x7f80440b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 -- 172.21.15.5:0/3618279384 shutdown_connections 2024-08-18T22:22:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.283+0000 7f8049a00640 1 -- 172.21.15.5:0/3618279384 wait complete. 2024-08-18T22:22:21.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:22:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda9e00640 1 Processor -- start 2024-08-18T22:22:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda9e00640 1 -- start start 2024-08-18T22:22:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda9e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda415c180 0x7efda40b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda9e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efda4071c90 0x7efda415c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda9e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda40b5e30 con 0x7efda406fad0 2024-08-18T22:22:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda9e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7efda415caa0 con 0x7efda4071c90 2024-08-18T22:22:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda9e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efda40b6110 con 0x7efda415c180 2024-08-18T22:22:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda2a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda415c180 0x7efda40b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda3400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efda4071c90 0x7efda415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda2a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda415c180 0x7efda40b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:41868/0 (socket says 172.21.15.5:41868) 2024-08-18T22:22:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda2a00640 1 -- 172.21.15.5:0/3748824181 learned_addr learned my addr 172.21.15.5:0/3748824181 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda2a00640 1 -- 172.21.15.5:0/3748824181 >> v2:172.21.15.117:3300/0 conn(0x7efda4071c90 msgr2=0x7efda415c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda2a00640 1 --2- 172.21.15.5:0/3748824181 >> v2:172.21.15.117:3300/0 conn(0x7efda4071c90 0x7efda415c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda2a00640 1 -- 172.21.15.5:0/3748824181 >> v1:172.21.15.117:6789/0 conn(0x7efda406fad0 legacy=0x7efda4071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.447+0000 7efda2a00640 1 -- 172.21.15.5:0/3748824181 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda40b63f0 con 0x7efda415c180 2024-08-18T22:22:21.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda2a00640 1 --2- 172.21.15.5:0/3748824181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda415c180 0x7efda40b57c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd94009870 tx=0x7efd9401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67127c09c0d26937 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda2000640 1 -- 172.21.15.5:0/3748824181 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940b1070 con 0x7efda415c180 2024-08-18T22:22:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda2000640 1 -- 172.21.15.5:0/3748824181 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd940ac630 con 0x7efda415c180 2024-08-18T22:22:21.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda2000640 1 -- 172.21.15.5:0/3748824181 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940a8050 con 0x7efda415c180 2024-08-18T22:22:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda9e00640 1 -- 172.21.15.5:0/3748824181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda415c180 msgr2=0x7efda40b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda9e00640 1 --2- 172.21.15.5:0/3748824181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda415c180 0x7efda40b57c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd94009870 tx=0x7efd9401c410 comp rx=0 tx=0).stop 2024-08-18T22:22:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda9e00640 1 -- 172.21.15.5:0/3748824181 shutdown_connections 2024-08-18T22:22:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda9e00640 1 --2- 172.21.15.5:0/3748824181 >> v2:172.21.15.117:3300/0 conn(0x7efda4071c90 0x7efda415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda9e00640 1 --2- 172.21.15.5:0/3748824181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda415c180 0x7efda40b57c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda9e00640 1 -- 172.21.15.5:0/3748824181 >> 172.21.15.5:0/3748824181 conn(0x7efda40b3eb0 msgr2=0x7efda40b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda9e00640 1 -- 172.21.15.5:0/3748824181 shutdown_connections 2024-08-18T22:22:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.451+0000 7efda9e00640 1 -- 172.21.15.5:0/3748824181 wait complete. 2024-08-18T22:22:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda9e00640 1 Processor -- start 2024-08-18T22:22:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda9e00640 1 -- start start 2024-08-18T22:22:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda406fad0 0x7efda4153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda9e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda4071c90 0x7efda406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda9e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda415c180 0x7efda406d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda9e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efda40d1c30 con 0x7efda406fad0 2024-08-18T22:22:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda9e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efda40d1ab0 con 0x7efda415c180 2024-08-18T22:22:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda9e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efda40d1db0 con 0x7efda4071c90 2024-08-18T22:22:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda406fad0 0x7efda4153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda406fad0 0x7efda4153ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52932/0 (socket says 172.21.15.5:52932) 2024-08-18T22:22:21.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda2a00640 1 -- 172.21.15.5:0/2280844511 learned_addr learned my addr 172.21.15.5:0/2280844511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda3400640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda415c180 0x7efda406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efd9a000640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda4071c90 0x7efda406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda2a00640 1 -- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda4071c90 msgr2=0x7efda406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda2a00640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda4071c90 0x7efda406cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda2a00640 1 -- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda415c180 msgr2=0x7efda406d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda2a00640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda415c180 0x7efda406d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda2a00640 1 -- 172.21.15.5:0/2280844511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda415b6d0 con 0x7efda406fad0 2024-08-18T22:22:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda3400640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda415c180 0x7efda406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:21.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efd9a000640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda4071c90 0x7efda406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda2a00640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda406fad0 0x7efda4153ed0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efd940af040 tx=0x7efd940191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efd9be00640 1 -- 172.21.15.5:0/2280844511 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940a8050 con 0x7efda406fad0 2024-08-18T22:22:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efd9be00640 1 -- 172.21.15.5:0/2280844511 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd940bc070 con 0x7efda406fad0 2024-08-18T22:22:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efd9be00640 1 -- 172.21.15.5:0/2280844511 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940b1040 con 0x7efda406fad0 2024-08-18T22:22:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda9e00640 1 -- 172.21.15.5:0/2280844511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda40a9540 con 0x7efda406fad0 2024-08-18T22:22:21.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.455+0000 7efda9e00640 1 -- 172.21.15.5:0/2280844511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda40a9b00 con 0x7efda406fad0 2024-08-18T22:22:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.459+0000 7efda9e00640 1 -- 172.21.15.5:0/2280844511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda415c560 con 0x7efda406fad0 2024-08-18T22:22:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.459+0000 7efd9be00640 1 -- 172.21.15.5:0/2280844511 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efd940b7680 con 0x7efda406fad0 2024-08-18T22:22:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.459+0000 7efd9be00640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efd800678f0 0x7efd80069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.459+0000 7efd9be00640 1 -- 172.21.15.5:0/2280844511 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7efd941201a0 con 0x7efda406fad0 2024-08-18T22:22:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.459+0000 7efd9a000640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efd800678f0 0x7efd80069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.459+0000 7efd9a000640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efd800678f0 0x7efd80069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efda41575d0 tx=0x7efd8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.463+0000 7efd9be00640 1 -- 172.21.15.5:0/2280844511 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7efd94016150 con 0x7efda406fad0 2024-08-18T22:22:21.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.663+0000 7efda9e00640 1 -- 172.21.15.5:0/2280844511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efda40725e0 con 0x7efda406fad0 2024-08-18T22:22:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.663+0000 7efd9be00640 1 -- 172.21.15.5:0/2280844511 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5220 (secure 0 0 0) 0x7efd940f0ab0 con 0x7efda406fad0 2024-08-18T22:22:21.668 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:21.668 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"btime":"2024-08-18T22:22:14:439692+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3185015921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3185015921},{"type":"v1","addr":"172.21.15.117:6837","nonce":3185015921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3679281629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3679281629},{"type":"v1","addr":"172.21.15.117:6836","nonce":3679281629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/649845928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":649845928},{"type":"v1","addr":"172.21.15.5:6833","nonce":649845928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:22:10.822677+0000","modified":"2024-08-18T22:22:13.837029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3590404197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3590404197},{"type":"v1","addr":"172.21.15.5:6835","nonce":3590404197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5370,"qdb_cluster":[5370]},"id":3}]} 2024-08-18T22:22:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2024-08-18T22:22:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 -- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efd800678f0 msgr2=0x7efd80069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efd800678f0 0x7efd80069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efda41575d0 tx=0x7efd8c009040 comp rx=0 tx=0).stop 2024-08-18T22:22:21.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 -- 172.21.15.5:0/2280844511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda406fad0 msgr2=0x7efda4153ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda406fad0 0x7efda4153ed0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efd940af040 tx=0x7efd940191b0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 -- 172.21.15.5:0/2280844511 shutdown_connections 2024-08-18T22:22:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efd800678f0 0x7efd80069db0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efda415c180 0x7efda406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efda4071c90 0x7efda406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 --2- 172.21.15.5:0/2280844511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efda406fad0 0x7efda4153ed0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 -- 172.21.15.5:0/2280844511 >> 172.21.15.5:0/2280844511 conn(0x7efda40b3eb0 msgr2=0x7efda4069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 -- 172.21.15.5:0/2280844511 shutdown_connections 2024-08-18T22:22:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:21.667+0000 7efda9e00640 1 -- 172.21.15.5:0/2280844511 wait complete. 2024-08-18T22:22:21.881 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:22:21.884 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:22:22.094 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:22:10.822677+0000', 'modified': '2024-08-18T22:22:13.837029+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5370}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5370': {'gid': 5370, 'name': 'c', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/3590404197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 3590404197}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 3590404197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5370, 'qdb_cluster': [5370]} 2024-08-18T22:22:22.094 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:22:22.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-18T22:22:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846fc00640 1 Processor -- start 2024-08-18T22:22:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846fc00640 1 -- start start 2024-08-18T22:22:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846fc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f846809aca0 0x7f84680afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846fc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84680b1300 0x7f84680affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846fc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846806e8a0 con 0x7f846809b080 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846fc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f846809bb80 con 0x7f846809aca0 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846fc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f84680d2e40 con 0x7f84680b1300 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846d200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f846809aca0 0x7f84680afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846d200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f846809aca0 0x7f84680afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52948/0 (socket says 172.21.15.5:52948) 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846d200640 1 -- 172.21.15.5:0/2772733620 learned_addr learned my addr 172.21.15.5:0/2772733620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f845fe00640 1 --2- 172.21.15.5:0/2772733620 >> v2:172.21.15.117:3300/0 conn(0x7f84680b1300 0x7f84680affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846d200640 1 -- 172.21.15.5:0/2772733620 >> v2:172.21.15.117:3300/0 conn(0x7f84680b1300 msgr2=0x7f84680affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846d200640 1 --2- 172.21.15.5:0/2772733620 >> v2:172.21.15.117:3300/0 conn(0x7f84680b1300 0x7f84680affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846d200640 1 -- 172.21.15.5:0/2772733620 >> v1:172.21.15.117:6789/0 conn(0x7f846809b080 legacy=0x7f84680b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.235+0000 7f846d200640 1 -- 172.21.15.5:0/2772733620 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846806cbd0 con 0x7f846809aca0 2024-08-18T22:22:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f846d200640 1 --2- 172.21.15.5:0/2772733620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f846809aca0 0x7f84680afa90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8468050430 tx=0x7f845801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d101548018c5b0d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f8467e00640 1 -- 172.21.15.5:0/2772733620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84580b2070 con 0x7f846809aca0 2024-08-18T22:22:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f8467e00640 1 -- 172.21.15.5:0/2772733620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84580ad640 con 0x7f846809aca0 2024-08-18T22:22:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f8467e00640 1 -- 172.21.15.5:0/2772733620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84580ada10 con 0x7f846809aca0 2024-08-18T22:22:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f846fc00640 1 -- 172.21.15.5:0/2772733620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f846809aca0 msgr2=0x7f84680afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f846fc00640 1 --2- 172.21.15.5:0/2772733620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f846809aca0 0x7f84680afa90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8468050430 tx=0x7f845801c4e0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f846fc00640 1 -- 172.21.15.5:0/2772733620 shutdown_connections 2024-08-18T22:22:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f846fc00640 1 --2- 172.21.15.5:0/2772733620 >> v2:172.21.15.117:3300/0 conn(0x7f84680b1300 0x7f84680affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f846fc00640 1 --2- 172.21.15.5:0/2772733620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f846809aca0 0x7f84680afa90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f846fc00640 1 -- 172.21.15.5:0/2772733620 >> 172.21.15.5:0/2772733620 conn(0x7f84680d2180 msgr2=0x7f84680d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f846fc00640 1 -- 172.21.15.5:0/2772733620 shutdown_connections 2024-08-18T22:22:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.239+0000 7f846fc00640 1 -- 172.21.15.5:0/2772733620 wait complete. 2024-08-18T22:22:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846fc00640 1 Processor -- start 2024-08-18T22:22:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846fc00640 1 -- start start 2024-08-18T22:22:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846fc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f846809aca0 0x7f8468155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846fc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846809b080 0x7f8468153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846fc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84680b1300 0x7f8468154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846fc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f846816b6b0 con 0x7f84680b1300 2024-08-18T22:22:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846fc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f846816b530 con 0x7f846809b080 2024-08-18T22:22:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846fc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f846816b830 con 0x7f846809aca0 2024-08-18T22:22:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84680b1300 0x7f8468154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84680b1300 0x7f8468154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52962/0 (socket says 172.21.15.5:52962) 2024-08-18T22:22:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846dc00640 1 -- 172.21.15.5:0/2221109837 learned_addr learned my addr 172.21.15.5:0/2221109837 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846d200640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f846809aca0 0x7f8468155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f845fe00640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846809b080 0x7f8468153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846dc00640 1 -- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f846809aca0 msgr2=0x7f8468155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846dc00640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f846809aca0 0x7f8468155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846dc00640 1 -- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846809b080 msgr2=0x7f8468153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846dc00640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846809b080 0x7f8468153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846dc00640 1 -- 172.21.15.5:0/2221109837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8468151a80 con 0x7f84680b1300 2024-08-18T22:22:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846dc00640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84680b1300 0x7f8468154070 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f846000c780 tx=0x7f846000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f8465600640 1 -- 172.21.15.5:0/2221109837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460004b70 con 0x7f84680b1300 2024-08-18T22:22:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f8465600640 1 -- 172.21.15.5:0/2221109837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8460004d10 con 0x7f84680b1300 2024-08-18T22:22:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f8465600640 1 -- 172.21.15.5:0/2221109837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846000aa90 con 0x7f84680b1300 2024-08-18T22:22:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846fc00640 1 -- 172.21.15.5:0/2221109837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84681527e0 con 0x7f84680b1300 2024-08-18T22:22:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.243+0000 7f846fc00640 1 -- 172.21.15.5:0/2221109837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8468151d00 con 0x7f84680b1300 2024-08-18T22:22:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f8465600640 1 -- 172.21.15.5:0/2221109837 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f846000ac30 con 0x7f84680b1300 2024-08-18T22:22:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f8465600640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84440678c0 0x7f8444069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f8465600640 1 -- 172.21.15.5:0/2221109837 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8460086050 con 0x7f84680b1300 2024-08-18T22:22:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f846d200640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84440678c0 0x7f8444069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f84730a0000 1 Processor -- start 2024-08-18T22:22:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f84730a0000 1 -- start start 2024-08-18T22:22:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f846d200640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84440678c0 0x7f8444069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f84580af000 tx=0x7f8458008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f84730a0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2e1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f84730a0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e1670 0x55f6db297450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f84730a0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db297d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f84730a0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f6db17dfd0 con 0x55f6db2e0d50 2024-08-18T22:22:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f84730a0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f6db0e43c0 con 0x55f6db2e1670 2024-08-18T22:22:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f84730a0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f6db089f70 con 0x55f6db297990 2024-08-18T22:22:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f846d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2e1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f846d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2e1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52968/0 (socket says 172.21.15.5:52968) 2024-08-18T22:22:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f846d200640 1 -- 172.21.15.5:0/2437069830 learned_addr learned my addr 172.21.15.5:0/2437069830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.247+0000 7f846dc00640 1 --2- 172.21.15.5:0/2437069830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db297d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f845fe00640 1 --2- 172.21.15.5:0/2437069830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e1670 0x55f6db297450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f846d200640 1 -- 172.21.15.5:0/2437069830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 msgr2=0x55f6db297d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f846d200640 1 --2- 172.21.15.5:0/2437069830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db297d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f846d200640 1 -- 172.21.15.5:0/2437069830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e1670 msgr2=0x55f6db297450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f846d200640 1 --2- 172.21.15.5:0/2437069830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e1670 0x55f6db297450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f846d200640 1 -- 172.21.15.5:0/2437069830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6db07e2e0 con 0x55f6db2e0d50 2024-08-18T22:22:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f845fe00640 1 --2- 172.21.15.5:0/2437069830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e1670 0x55f6db297450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f846d200640 1 --2- 172.21.15.5:0/2437069830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2e1130 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f84580b0040 tx=0x7f84580a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529bbe2d93579cfc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f845d600640 1 -- 172.21.15.5:0/2437069830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84580c9070 con 0x55f6db2e0d50 2024-08-18T22:22:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f845d600640 1 -- 172.21.15.5:0/2437069830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84580b8470 con 0x55f6db2e0d50 2024-08-18T22:22:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f845d600640 1 -- 172.21.15.5:0/2437069830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84580b2040 con 0x55f6db2e0d50 2024-08-18T22:22:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 -- 172.21.15.5:0/2437069830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 msgr2=0x55f6db2e1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 --2- 172.21.15.5:0/2437069830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2e1130 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f84580b0040 tx=0x7f84580a7070 comp rx=0 tx=0).stop 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 -- 172.21.15.5:0/2437069830 shutdown_connections 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 --2- 172.21.15.5:0/2437069830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db297d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 --2- 172.21.15.5:0/2437069830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e1670 0x55f6db297450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 --2- 172.21.15.5:0/2437069830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2e1130 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 -- 172.21.15.5:0/2437069830 >> 172.21.15.5:0/2437069830 conn(0x55f6db293910 msgr2=0x55f6db295d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 -- 172.21.15.5:0/2437069830 shutdown_connections 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 -- 172.21.15.5:0/2437069830 wait complete. 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 -- start start 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 Processor -- start 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db2ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e0d50 0x55f6db29cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e1670 0x55f6db29d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f6db08be40 con 0x55f6db2e1670 2024-08-18T22:22:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f6db1a1af0 con 0x55f6db2e0d50 2024-08-18T22:22:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f6db146450 con 0x55f6db297990 2024-08-18T22:22:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f84730a0000 10 client.0 _ll_register_callbacks cb 0x55f6db282630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.251+0000 7f846dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e1670 0x55f6db29d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f846d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db2ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f846dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e1670 0x55f6db29d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52980/0 (socket says 172.21.15.5:52980) 2024-08-18T22:22:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f846dc00640 1 -- 172.21.15.5:0/2386591290 learned_addr learned my addr 172.21.15.5:0/2386591290 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f845fe00640 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e0d50 0x55f6db29cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f846dc00640 1 -- 172.21.15.5:0/2386591290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 msgr2=0x55f6db2ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f846dc00640 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db2ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f846dc00640 1 -- 172.21.15.5:0/2386591290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e0d50 msgr2=0x55f6db29cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f846dc00640 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e0d50 0x55f6db29cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f846dc00640 1 -- 172.21.15.5:0/2386591290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6db06bfd0 con 0x55f6db2e1670 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f846dc00640 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e1670 0x55f6db29d0d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8460052770 tx=0x7f846005a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d142f737c2be99 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f8456000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f8456000640 1 -- 172.21.15.5:0/2386591290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460081020 con 0x55f6db2e1670 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f8456000640 1 -- 172.21.15.5:0/2386591290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f846005e9b0 con 0x55f6db2e1670 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 -- 172.21.15.5:0/2386591290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84580b8470 con 0x55f6db2e1670 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f8456000640 1 -- 172.21.15.5:0/2386591290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f84600546d0 con 0x55f6db2e1670 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 10 client.5517 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 -- 172.21.15.5:0/2386591290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f6db1674d0 con 0x55f6db2e1670 2024-08-18T22:22:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f8456000640 1 -- 172.21.15.5:0/2386591290 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84580b8470 con 0x55f6db2e1670 2024-08-18T22:22:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f8456000640 1 -- 172.21.15.5:0/2386591290 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f8460074b70 con 0x55f6db2e1670 2024-08-18T22:22:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 10 client.5517 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 10 client.5517 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:22:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 20 client.5517 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6db2cf4f0 0x55f6db2cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 4 client.5517 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 -- 172.21.15.5:0/2386591290 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6db07ec00 con 0x55f6db2cf4f0 2024-08-18T22:22:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f846d200640 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6db2cf4f0 0x55f6db2cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f846d200640 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6db2cf4f0 0x55f6db2cf8d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdc85376dea1dbda server_cookie=26291a63906335b4 in_seq=0 out_seq=0 2024-08-18T22:22:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f8456000640 10 client.5517 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f8456000640 1 -- 172.21.15.5:0/2386591290 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6db07ec00 con 0x55f6db2cf4f0 2024-08-18T22:22:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f8456000640 10 client.5517 handle_command_reply: tid=0 2024-08-18T22:22:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 client.5517 shutdown 2024-08-18T22:22:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 -- 172.21.15.5:0/2386591290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e1670 msgr2=0x55f6db29d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e1670 0x55f6db29d0d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8460052770 tx=0x7f846005a610 comp rx=0 tx=0).stop 2024-08-18T22:22:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 -- 172.21.15.5:0/2386591290 shutdown_connections 2024-08-18T22:22:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6db2cf4f0 0x55f6db2cf8d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e1670 0x55f6db29d0d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e0d50 0x55f6db29cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 --2- 172.21.15.5:0/2386591290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db2ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 -- 172.21.15.5:0/2386591290 >> 172.21.15.5:0/2386591290 conn(0x55f6db293910 msgr2=0x55f6db296520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f8456000640 0 client.5517 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 -- 172.21.15.5:0/2386591290 shutdown_connections 2024-08-18T22:22:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 1 -- 172.21.15.5:0/2386591290 wait complete. 2024-08-18T22:22:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.255+0000 7f84730a0000 20 client.5517 trim_cache size 0 max 16384 2024-08-18T22:22:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f84730a0000 1 Processor -- start 2024-08-18T22:22:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f84730a0000 1 -- start start 2024-08-18T22:22:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f84730a0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db2f3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f84730a0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2f3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f84730a0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e1670 0x55f6db2f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f84730a0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8468203020 con 0x55f6db2e0d50 2024-08-18T22:22:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f84730a0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f84680af9e0 con 0x55f6db2e1670 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f84730a0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f84680b0030 con 0x55f6db297990 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f845fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f845fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2f3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52982/0 (socket says 172.21.15.5:52982) 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f845fe00640 1 -- 172.21.15.5:0/203319565 learned_addr learned my addr 172.21.15.5:0/203319565 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f846d200640 1 --2- 172.21.15.5:0/203319565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db2f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f846dc00640 1 --2- 172.21.15.5:0/203319565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e1670 0x55f6db2f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f845fe00640 1 -- 172.21.15.5:0/203319565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 msgr2=0x55f6db2f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f845fe00640 1 --2- 172.21.15.5:0/203319565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db2f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f845fe00640 1 -- 172.21.15.5:0/203319565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e1670 msgr2=0x55f6db2f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f845fe00640 1 --2- 172.21.15.5:0/203319565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e1670 0x55f6db2f3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.275+0000 7f845fe00640 1 -- 172.21.15.5:0/203319565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6db2e14a0 con 0x55f6db2e0d50 2024-08-18T22:22:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f845fe00640 1 --2- 172.21.15.5:0/203319565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2f3550 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8450007900 tx=0x7f8450007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6c68604ec25ef0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f845cc00640 1 -- 172.21.15.5:0/203319565 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450015a60 con 0x55f6db2e0d50 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f845cc00640 1 -- 172.21.15.5:0/203319565 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8450015c00 con 0x55f6db2e0d50 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f845cc00640 1 -- 172.21.15.5:0/203319565 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845001f430 con 0x55f6db2e0d50 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 -- 172.21.15.5:0/203319565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 msgr2=0x55f6db2f3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 --2- 172.21.15.5:0/203319565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2f3550 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8450007900 tx=0x7f8450007dc0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 -- 172.21.15.5:0/203319565 shutdown_connections 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 --2- 172.21.15.5:0/203319565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e1670 0x55f6db2f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 --2- 172.21.15.5:0/203319565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db2e0d50 0x55f6db2f3550 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 --2- 172.21.15.5:0/203319565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db297990 0x55f6db2f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 -- 172.21.15.5:0/203319565 >> 172.21.15.5:0/203319565 conn(0x55f6db293910 msgr2=0x55f6db29cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 -- 172.21.15.5:0/203319565 shutdown_connections 2024-08-18T22:22:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 -- 172.21.15.5:0/203319565 wait complete. 2024-08-18T22:22:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 -- start start 2024-08-18T22:22:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 Processor -- start 2024-08-18T22:22:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db297990 0x55f6db353e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e0d50 0x55f6db354370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db2e1670 0x55f6db3548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f6db09d1d0 con 0x55f6db297990 2024-08-18T22:22:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f6db07b900 con 0x55f6db2e0d50 2024-08-18T22:22:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f6db0e36d0 con 0x55f6db2e1670 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f84730a0000 10 client.0 _ll_register_callbacks cb 0x7f8460055e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f846d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db297990 0x55f6db353e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f846d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db297990 0x55f6db353e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52990/0 (socket says 172.21.15.5:52990) 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f846d200640 1 -- 172.21.15.5:0/3526924903 learned_addr learned my addr 172.21.15.5:0/3526924903 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f845fe00640 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e0d50 0x55f6db354370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f846dc00640 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db2e1670 0x55f6db3548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f846d200640 1 -- 172.21.15.5:0/3526924903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db2e1670 msgr2=0x55f6db3548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f846d200640 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db2e1670 0x55f6db3548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f846d200640 1 -- 172.21.15.5:0/3526924903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e0d50 msgr2=0x55f6db354370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f846d200640 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e0d50 0x55f6db354370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f846d200640 1 -- 172.21.15.5:0/3526924903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6db0ddb30 con 0x55f6db297990 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f846dc00640 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db2e1670 0x55f6db3548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f846d200640 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db297990 0x55f6db353e30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f84580b0040 tx=0x7f845801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff067d3c09fa00b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.279+0000 7f8456000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f8456000640 1 -- 172.21.15.5:0/3526924903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84580c9040 con 0x55f6db297990 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f8456000640 1 -- 172.21.15.5:0/3526924903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f84580b8920 con 0x55f6db297990 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 -- 172.21.15.5:0/3526924903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8450015c00 con 0x55f6db297990 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f8456000640 1 -- 172.21.15.5:0/3526924903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f84580b2040 con 0x55f6db297990 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 10 client.5523 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 -- 172.21.15.5:0/3526924903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f6db095810 con 0x55f6db297990 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f8456000640 1 -- 172.21.15.5:0/3526924903 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8450015c00 con 0x55f6db297990 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f8456000640 1 -- 172.21.15.5:0/3526924903 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f84580d9030 con 0x55f6db297990 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 10 client.5523 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 10 client.5523 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 20 client.5523 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6db2f53f0 0x55f6db2f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 4 client.5523 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 -- 172.21.15.5:0/3526924903 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "status"}) -- 0x55f6db2ce9d0 con 0x55f6db2f53f0 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f845fe00640 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6db2f53f0 0x55f6db2f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f845fe00640 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6db2f53f0 0x55f6db2f57d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37dc1a9d473f06a0 server_cookie=a13ffb42da145b50 in_seq=0 out_seq=0 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f8456000640 10 client.5523 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f8456000640 1 -- 172.21.15.5:0/3526924903 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55f6db2ce9d0 con 0x55f6db2f53f0 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f8456000640 10 client.5523 handle_command_reply: tid=0 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 client.5523 shutdown 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 -- 172.21.15.5:0/3526924903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db297990 msgr2=0x55f6db353e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db297990 0x55f6db353e30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f84580b0040 tx=0x7f845801ad20 comp rx=0 tx=0).stop 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 -- 172.21.15.5:0/3526924903 shutdown_connections 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6db2f53f0 0x55f6db2f57d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6db2e1670 0x55f6db3548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6db2e0d50 0x55f6db354370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f8456000640 0 client.5523 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 --2- 172.21.15.5:0/3526924903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6db297990 0x55f6db353e30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 -- 172.21.15.5:0/3526924903 >> 172.21.15.5:0/3526924903 conn(0x55f6db293910 msgr2=0x55f6db2df570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 -- 172.21.15.5:0/3526924903 shutdown_connections 2024-08-18T22:22:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 1 -- 172.21.15.5:0/3526924903 wait complete. 2024-08-18T22:22:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f84730a0000 20 client.5523 trim_cache size 0 max 16384 2024-08-18T22:22:22.293 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:22.293 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:22:22.293 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:22:22.293 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5370, 2024-08-18T22:22:22.293 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:22:22.293 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:22:22.293 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:22:22.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.87052645, 2024-08-18T22:22:22.293 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 26, 2024-08-18T22:22:22.293 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 55, 2024-08-18T22:22:22.293 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 55, 2024-08-18T22:22:22.294 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 16.035774610000001 2024-08-18T22:22:22.294 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 -- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84440678c0 msgr2=0x7f8444069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84440678c0 0x7f8444069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f84580af000 tx=0x7f8458008040 comp rx=0 tx=0).stop 2024-08-18T22:22:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 -- 172.21.15.5:0/2221109837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84680b1300 msgr2=0x7f8468154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84680b1300 0x7f8468154070 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f846000c780 tx=0x7f846000cc40 comp rx=0 tx=0).stop 2024-08-18T22:22:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 -- 172.21.15.5:0/2221109837 shutdown_connections 2024-08-18T22:22:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84440678c0 0x7f8444069d80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84680b1300 0x7f8468154070 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f846809b080 0x7f8468153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 --2- 172.21.15.5:0/2221109837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f846809aca0 0x7f8468155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 -- 172.21.15.5:0/2221109837 >> 172.21.15.5:0/2221109837 conn(0x7f84680d2180 msgr2=0x7f84680d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 -- 172.21.15.5:0/2221109837 shutdown_connections 2024-08-18T22:22:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.283+0000 7f846fc00640 1 -- 172.21.15.5:0/2221109837 wait complete. 2024-08-18T22:22:22.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:22:22.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.443+0000 7fdd76c00640 1 Processor -- start 2024-08-18T22:22:22.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.443+0000 7fdd76c00640 1 -- start start 2024-08-18T22:22:22.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd76c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd7015e140 0x7fdd700b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd76c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd700b5e60 0x7fdd700af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd76c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd700b65d0 con 0x7fdd700afc80 2024-08-18T22:22:22.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd76c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdd7006e560 con 0x7fdd7015e140 2024-08-18T22:22:22.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd76c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd700b68b0 con 0x7fdd700b5e60 2024-08-18T22:22:22.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd6fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd7015e140 0x7fdd700b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd6fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd7015e140 0x7fdd700b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52996/0 (socket says 172.21.15.5:52996) 2024-08-18T22:22:22.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd6fe00640 1 -- 172.21.15.5:0/134744683 learned_addr learned my addr 172.21.15.5:0/134744683 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:22.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd67400640 1 --2- 172.21.15.5:0/134744683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd700b5e60 0x7fdd700af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd6fe00640 1 -- 172.21.15.5:0/134744683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd700b5e60 msgr2=0x7fdd700af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd6fe00640 1 --2- 172.21.15.5:0/134744683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd700b5e60 0x7fdd700af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd6fe00640 1 -- 172.21.15.5:0/134744683 >> v1:172.21.15.117:6789/0 conn(0x7fdd700afc80 legacy=0x7fdd700ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.447+0000 7fdd6fe00640 1 -- 172.21.15.5:0/134744683 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7006e7b0 con 0x7fdd7015e140 2024-08-18T22:22:22.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd6fe00640 1 --2- 172.21.15.5:0/134744683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd7015e140 0x7fdd700b4e40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009870 tx=0x7fdd6001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69642ba3394aba77 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:22.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd6f400640 1 -- 172.21.15.5:0/134744683 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd600b0070 con 0x7fdd7015e140 2024-08-18T22:22:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd6f400640 1 -- 172.21.15.5:0/134744683 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd600ab600 con 0x7fdd7015e140 2024-08-18T22:22:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd6f400640 1 -- 172.21.15.5:0/134744683 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd600ab9d0 con 0x7fdd7015e140 2024-08-18T22:22:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd76c00640 1 -- 172.21.15.5:0/134744683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd7015e140 msgr2=0x7fdd700b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd76c00640 1 --2- 172.21.15.5:0/134744683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd7015e140 0x7fdd700b4e40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009870 tx=0x7fdd6001c4d0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd76c00640 1 -- 172.21.15.5:0/134744683 shutdown_connections 2024-08-18T22:22:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd76c00640 1 --2- 172.21.15.5:0/134744683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd700b5e60 0x7fdd700af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd76c00640 1 --2- 172.21.15.5:0/134744683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd7015e140 0x7fdd700b4e40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd76c00640 1 -- 172.21.15.5:0/134744683 >> 172.21.15.5:0/134744683 conn(0x7fdd7006b9b0 msgr2=0x7fdd7006bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:22.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd76c00640 1 -- 172.21.15.5:0/134744683 shutdown_connections 2024-08-18T22:22:22.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd76c00640 1 -- 172.21.15.5:0/134744683 wait complete. 2024-08-18T22:22:22.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd76c00640 1 Processor -- start 2024-08-18T22:22:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.451+0000 7fdd76c00640 1 -- start start 2024-08-18T22:22:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd76c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd700afc80 0x7fdd701612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd76c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd700b5e60 0x7fdd7014d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd76c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd7015e140 0x7fdd7014fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd76c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdd70070140 con 0x7fdd700b5e60 2024-08-18T22:22:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd76c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7006ffc0 con 0x7fdd7015e140 2024-08-18T22:22:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd76c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7016ad60 con 0x7fdd700afc80 2024-08-18T22:22:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd67400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd700b5e60 0x7fdd7014d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd67400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd700b5e60 0x7fdd7014d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52998/0 (socket says 172.21.15.5:52998) 2024-08-18T22:22:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd67400640 1 -- 172.21.15.5:0/3890885433 learned_addr learned my addr 172.21.15.5:0/3890885433 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:22.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd6fe00640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd700afc80 0x7fdd701612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd74c00640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd7015e140 0x7fdd7014fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd67400640 1 -- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd700afc80 msgr2=0x7fdd701612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd67400640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd700afc80 0x7fdd701612b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd67400640 1 -- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd7015e140 msgr2=0x7fdd7014fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd67400640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd7015e140 0x7fdd7014fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd67400640 1 -- 172.21.15.5:0/3890885433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd701617f0 con 0x7fdd700b5e60 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd67400640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd700b5e60 0x7fdd7014d280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800e870 tx=0x7fdd5800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd6cc00640 1 -- 172.21.15.5:0/3890885433 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58017070 con 0x7fdd700b5e60 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd6cc00640 1 -- 172.21.15.5:0/3890885433 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5800c940 con 0x7fdd700b5e60 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd6cc00640 1 -- 172.21.15.5:0/3890885433 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800ccf0 con 0x7fdd700b5e60 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd76c00640 1 -- 172.21.15.5:0/3890885433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd7015e820 con 0x7fdd700b5e60 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd76c00640 1 -- 172.21.15.5:0/3890885433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd7015f060 con 0x7fdd700b5e60 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd76c00640 1 -- 172.21.15.5:0/3890885433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd700af740 con 0x7fdd700b5e60 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.455+0000 7fdd6cc00640 1 -- 172.21.15.5:0/3890885433 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdd5801a070 con 0x7fdd700b5e60 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.459+0000 7fdd6cc00640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd4c0678c0 0x7fdd4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.459+0000 7fdd6cc00640 1 -- 172.21.15.5:0/3890885433 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fdd58085db0 con 0x7fdd700b5e60 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.459+0000 7fdd6fe00640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd4c0678c0 0x7fdd4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.459+0000 7fdd6fe00640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd4c0678c0 0x7fdd4c069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdd600ad000 tx=0x7fdd600a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:22.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.463+0000 7fdd6cc00640 1 -- 172.21.15.5:0/3890885433 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdd5808a070 con 0x7fdd700b5e60 2024-08-18T22:22:22.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 -- 172.21.15.5:0/3890885433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdd700d06c0 con 0x7fdd700b5e60 2024-08-18T22:22:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd6cc00640 1 -- 172.21.15.5:0/3890885433 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7fdd7015e820 con 0x7fdd700b5e60 2024-08-18T22:22:22.671 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:22:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 -- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd4c0678c0 msgr2=0x7fdd4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd4c0678c0 0x7fdd4c069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdd600ad000 tx=0x7fdd600a4f90 comp rx=0 tx=0).stop 2024-08-18T22:22:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 -- 172.21.15.5:0/3890885433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd700b5e60 msgr2=0x7fdd7014d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd700b5e60 0x7fdd7014d280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800e870 tx=0x7fdd5800ec70 comp rx=0 tx=0).stop 2024-08-18T22:22:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 -- 172.21.15.5:0/3890885433 shutdown_connections 2024-08-18T22:22:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd4c0678c0 0x7fdd4c069d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd7015e140 0x7fdd7014fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd700b5e60 0x7fdd7014d280 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 --2- 172.21.15.5:0/3890885433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd700afc80 0x7fdd701612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 -- 172.21.15.5:0/3890885433 >> 172.21.15.5:0/3890885433 conn(0x7fdd7006b9b0 msgr2=0x7fdd700ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:22.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 -- 172.21.15.5:0/3890885433 shutdown_connections 2024-08-18T22:22:22.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22.667+0000 7fdd76c00640 1 -- 172.21.15.5:0/3890885433 wait complete. 2024-08-18T22:22:22.692 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:22:22.692 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:22:22.692 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:22:22.692 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:22:22.692 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:22:22.692 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:22:22.692 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:22:22.692 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:22:22.692 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:22:22.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:22.692 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:22:22.701 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:22:22.701 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:22:22.701 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:22:22.701 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:22:22.701 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:22:22.701 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:22:22.702 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:22:22.702 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:22:22.702 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:22:22.702 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:22:22.702 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:22:22.702 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:22:22.702 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:22:22.702 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:22:22.702 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:22:22.702 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:22:22.702 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42259sec preferred_lft 42259sec 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:22:22.703 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:22:22.704 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:22:22.704 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:22:22.704 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:22:22.704 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:22:22.704 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:22:22.704 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:22:22.704 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:22:22.704 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:22:22.704 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:22:22.704 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:22:22.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:22.705 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:22:22.766 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:22:22.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:22.769 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:22:22.822 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:22:22.822 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:22:22.822 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:22:22.823 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:22:22.823 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:22:22.823 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:22:22.823 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:22:22.823 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:22:22.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:22:22.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:22:22.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:22:22.823 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:22:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:22:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:22:22.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:22.961 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:22:22.970 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:22:22.970 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:22:22.971 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:22:22.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:22.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:22:23.037 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:22:23.037 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:22:23.085 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:22:23.085 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:22:23.085 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:22:23.136 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:22:23.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:23.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:22:23.225 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:22:23.225 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:22:23.225 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:22:23.240 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:22:23.241 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:22:23.241 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:22:23.241 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:22:23.241 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:22:23.249 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:22:23.250 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:22:23.250 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:22:23.250 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:22:23.250 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:22:23.250 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:22:23.250 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:22:23.250 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:22:23.254 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:22:23.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:23.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:22:23.275 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:22:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:22:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:22:23.381 INFO:teuthology.orchestra.run.smithi005.stdout:client5281 2024-08-18T22:22:23.381 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:22:23.381 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:23.390 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-08-18T22:22:23.390 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-08-18T22:22:23.390 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-08-18T22:22:23.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:23.391 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-08-18T22:22:23.451 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:22:23.451 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:22:23.451 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-08-18T22:22:23.451 DEBUG:teuthology.orchestra.run.smithi005:> import json 2024-08-18T22:22:23.451 DEBUG:teuthology.orchestra.run.smithi005:> import sys 2024-08-18T22:22:23.451 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:22:23.451 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-08-18T22:22:23.451 DEBUG:teuthology.orchestra.run.smithi005:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-08-18T22:22:23.451 DEBUG:teuthology.orchestra.run.smithi005:> except OSError as e: 2024-08-18T22:22:23.451 DEBUG:teuthology.orchestra.run.smithi005:> sys.exit(e.errno) 2024-08-18T22:22:23.451 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:22:23.452 DEBUG:teuthology.orchestra.run.smithi005:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-08-18T22:22:23.452 DEBUG:teuthology.orchestra.run.smithi005:> print(json.dumps( 2024-08-18T22:22:23.452 DEBUG:teuthology.orchestra.run.smithi005:> dict([(a, getattr(s, a)) for a in attrs]), 2024-08-18T22:22:23.452 DEBUG:teuthology.orchestra.run.smithi005:> indent=2)) 2024-08-18T22:22:23.452 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:22:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:23 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-08-18T22:22:23.576 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-08-18T22:22:23.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:23.577 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-08-18T22:22:23.627 INFO:teuthology.orchestra.run.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-08-18T22:22:23.803 INFO:teuthology.orchestra.run.smithi005.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-08-18T22:22:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 83% (1169/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-08-18T22:22:27.012 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-08-18T22:22:27.012 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-08-18T22:22:27.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-08-18T22:22:27.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.191+0000 7f592a200640 1 Processor -- start 2024-08-18T22:22:27.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.191+0000 7f592a200640 1 -- start start 2024-08-18T22:22:27.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f592a200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5924147dd0 0x7f59240b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f592a200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f592406c3c0 0x7f592415e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f592a200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592406c850 con 0x7f592415ee30 2024-08-18T22:22:27.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f592a200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f592415f7c0 con 0x7f592406c3c0 2024-08-18T22:22:27.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f592a200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f59240b6410 con 0x7f5924147dd0 2024-08-18T22:22:27.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f591aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f592406c3c0 0x7f592415e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f5923e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f592415ee30 0x7f5924161ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43078/0 (socket says 172.21.15.5:43078) 2024-08-18T22:22:27.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f5923e00640 1 -- 172.21.15.5:0/89213302 learned_addr learned my addr 172.21.15.5:0/89213302 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:27.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f5923400640 1 --2- 172.21.15.5:0/89213302 >> v2:172.21.15.117:3300/0 conn(0x7f5924147dd0 0x7f59240b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f591aa00640 1 -- 172.21.15.5:0/89213302 >> v2:172.21.15.117:3300/0 conn(0x7f5924147dd0 msgr2=0x7f59240b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f591aa00640 1 --2- 172.21.15.5:0/89213302 >> v2:172.21.15.117:3300/0 conn(0x7f5924147dd0 0x7f59240b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f591aa00640 1 -- 172.21.15.5:0/89213302 >> v1:172.21.15.5:6789/0 conn(0x7f592415ee30 legacy=0x7f5924161ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f591aa00640 1 -- 172.21.15.5:0/89213302 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592415f2a0 con 0x7f592406c3c0 2024-08-18T22:22:27.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.195+0000 7f5922a00640 1 -- 172.21.15.5:0/89213302 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013032836 0 0) 0x7f591c0014a0 con 0x7f592415ee30 2024-08-18T22:22:27.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f591aa00640 1 --2- 172.21.15.5:0/89213302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f592406c3c0 0x7f592415e8f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f59240d20a0 tx=0x7f590c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5aba835dab50926 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f5922a00640 1 -- 172.21.15.5:0/89213302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c0b0070 con 0x7f592406c3c0 2024-08-18T22:22:27.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f5922a00640 1 -- 172.21.15.5:0/89213302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590c0ab600 con 0x7f592406c3c0 2024-08-18T22:22:27.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f5922a00640 1 -- 172.21.15.5:0/89213302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c0ab9d0 con 0x7f592406c3c0 2024-08-18T22:22:27.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 -- 172.21.15.5:0/89213302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f592406c3c0 msgr2=0x7f592415e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 --2- 172.21.15.5:0/89213302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f592406c3c0 0x7f592415e8f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f59240d20a0 tx=0x7f590c01c3d0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 -- 172.21.15.5:0/89213302 shutdown_connections 2024-08-18T22:22:27.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 --2- 172.21.15.5:0/89213302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f592406c3c0 0x7f592415e8f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 --2- 172.21.15.5:0/89213302 >> v2:172.21.15.117:3300/0 conn(0x7f5924147dd0 0x7f59240b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 -- 172.21.15.5:0/89213302 >> 172.21.15.5:0/89213302 conn(0x7f59240b65f0 msgr2=0x7f59240b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 -- 172.21.15.5:0/89213302 shutdown_connections 2024-08-18T22:22:27.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 -- 172.21.15.5:0/89213302 wait complete. 2024-08-18T22:22:27.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 Processor -- start 2024-08-18T22:22:27.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 -- start start 2024-08-18T22:22:27.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f592406c3c0 0x7f5924146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5924147dd0 0x7f592406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f592415ee30 0x7f592406f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f59240b5b30 con 0x7f592406c3c0 2024-08-18T22:22:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f592415f9e0 con 0x7f5924147dd0 2024-08-18T22:22:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f592a200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f59240b5cb0 con 0x7f592415ee30 2024-08-18T22:22:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f5923400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f592406c3c0 0x7f5924146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f5923400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f592406c3c0 0x7f5924146370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41722/0 (socket says 172.21.15.5:41722) 2024-08-18T22:22:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.199+0000 7f5923400640 1 -- 172.21.15.5:0/2627056037 learned_addr learned my addr 172.21.15.5:0/2627056037 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f591aa00640 1 --2- 172.21.15.5:0/2627056037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5924147dd0 0x7f592406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f5923e00640 1 --2- 172.21.15.5:0/2627056037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f592415ee30 0x7f592406f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f5923400640 1 -- 172.21.15.5:0/2627056037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f592415ee30 msgr2=0x7f592406f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f5923400640 1 --2- 172.21.15.5:0/2627056037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f592415ee30 0x7f592406f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f5923400640 1 -- 172.21.15.5:0/2627056037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5924147dd0 msgr2=0x7f592406ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f5923400640 1 --2- 172.21.15.5:0/2627056037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5924147dd0 0x7f592406ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f5923400640 1 -- 172.21.15.5:0/2627056037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592415f470 con 0x7f592406c3c0 2024-08-18T22:22:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f5923400640 1 --2- 172.21.15.5:0/2627056037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f592406c3c0 0x7f5924146370 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f591400d800 tx=0x7f591400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f591be00640 1 -- 172.21.15.5:0/2627056037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591400b6c0 con 0x7f592406c3c0 2024-08-18T22:22:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f591be00640 1 -- 172.21.15.5:0/2627056037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5914019070 con 0x7f592406c3c0 2024-08-18T22:22:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f591be00640 1 -- 172.21.15.5:0/2627056037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591400ba60 con 0x7f592406c3c0 2024-08-18T22:22:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f592a200640 1 -- 172.21.15.5:0/2627056037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592413fc50 con 0x7f592406c3c0 2024-08-18T22:22:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f592a200640 1 -- 172.21.15.5:0/2627056037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592406fe80 con 0x7f592406c3c0 2024-08-18T22:22:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.203+0000 7f591be00640 1 -- 172.21.15.5:0/2627056037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f591400bc00 con 0x7f592406c3c0 2024-08-18T22:22:27.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f591be00640 1 --2- 172.21.15.5:0/2627056037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59000678c0 0x7f5900069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f591be00640 1 -- 172.21.15.5:0/2627056037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f59140862e0 con 0x7f592406c3c0 2024-08-18T22:22:27.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f592d65e000 1 Processor -- start 2024-08-18T22:22:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f591aa00640 1 --2- 172.21.15.5:0/2627056037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59000678c0 0x7f5900069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f592d65e000 1 -- start start 2024-08-18T22:22:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f591aa00640 1 --2- 172.21.15.5:0/2627056037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59000678c0 0x7f5900069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f590c0ad000 tx=0x7f590c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f592d65e000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd77d680 0x55cfdd77da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f592d65e000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd730b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f592d65e000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd731050 0x55cfdd731430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f592d65e000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55cfdd50a2a0 con 0x55cfdd731050 2024-08-18T22:22:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f592d65e000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cfdd5821d0 con 0x55cfdd77dfa0 2024-08-18T22:22:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f592d65e000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55cfdd5287e0 con 0x55cfdd77d680 2024-08-18T22:22:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5923e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd731050 0x55cfdd731430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5923e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd731050 0x55cfdd731430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41728/0 (socket says 172.21.15.5:41728) 2024-08-18T22:22:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5923e00640 1 -- 172.21.15.5:0/1781038729 learned_addr learned my addr 172.21.15.5:0/1781038729 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5923400640 1 --2- 172.21.15.5:0/1781038729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd77d680 0x55cfdd77da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f591aa00640 1 --2- 172.21.15.5:0/1781038729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd730b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5923e00640 1 -- 172.21.15.5:0/1781038729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd77d680 msgr2=0x55cfdd77da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5923e00640 1 --2- 172.21.15.5:0/1781038729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd77d680 0x55cfdd77da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5923e00640 1 -- 172.21.15.5:0/1781038729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 msgr2=0x55cfdd730b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5923e00640 1 --2- 172.21.15.5:0/1781038729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd730b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5923e00640 1 -- 172.21.15.5:0/1781038729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdd528a30 con 0x55cfdd731050 2024-08-18T22:22:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5923e00640 1 --2- 172.21.15.5:0/1781038729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd731050 0x55cfdd731430 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f591c007450 tx=0x7f591c007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3275b1e6d04bdde server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5913e00640 1 -- 172.21.15.5:0/1781038729 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c019070 con 0x55cfdd731050 2024-08-18T22:22:27.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5913e00640 1 -- 172.21.15.5:0/1781038729 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f591c001c60 con 0x55cfdd731050 2024-08-18T22:22:27.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.207+0000 7f5913e00640 1 -- 172.21.15.5:0/1781038729 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c002010 con 0x55cfdd731050 2024-08-18T22:22:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 -- 172.21.15.5:0/1781038729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd731050 msgr2=0x55cfdd731430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 --2- 172.21.15.5:0/1781038729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd731050 0x55cfdd731430 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f591c007450 tx=0x7f591c007910 comp rx=0 tx=0).stop 2024-08-18T22:22:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 -- 172.21.15.5:0/1781038729 shutdown_connections 2024-08-18T22:22:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 --2- 172.21.15.5:0/1781038729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd731050 0x55cfdd731430 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 --2- 172.21.15.5:0/1781038729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd730b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 --2- 172.21.15.5:0/1781038729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd77d680 0x55cfdd77da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 -- 172.21.15.5:0/1781038729 >> 172.21.15.5:0/1781038729 conn(0x55cfdd72ab60 msgr2=0x55cfdd760500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 -- 172.21.15.5:0/1781038729 shutdown_connections 2024-08-18T22:22:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 -- 172.21.15.5:0/1781038729 wait complete. 2024-08-18T22:22:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 -- start start 2024-08-18T22:22:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 Processor -- start 2024-08-18T22:22:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd7839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd783f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd732480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55cfdd602e60 con 0x55cfdd77d680 2024-08-18T22:22:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cfdd63d780 con 0x55cfdd77dfa0 2024-08-18T22:22:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55cfdd53bb00 con 0x55cfdd731050 2024-08-18T22:22:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 10 client.0 _ll_register_callbacks cb 0x55cfdd71ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f591aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd783f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f591aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd783f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41744/0 (socket says 172.21.15.5:41744) 2024-08-18T22:22:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f591aa00640 1 -- 172.21.15.5:0/2851444505 learned_addr learned my addr 172.21.15.5:0/2851444505 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f5923e00640 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd732480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f5923400640 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd7839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f591aa00640 1 -- 172.21.15.5:0/2851444505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 msgr2=0x55cfdd7839d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f591aa00640 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd7839d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f591aa00640 1 -- 172.21.15.5:0/2851444505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 msgr2=0x55cfdd732480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f591aa00640 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd732480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f591aa00640 1 -- 172.21.15.5:0/2851444505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfdd54f540 con 0x55cfdd77d680 2024-08-18T22:22:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f591aa00640 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd783f10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f590c018fe0 tx=0x7f590c01ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bc540f3376ae7a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f5910c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f5910c00640 1 -- 172.21.15.5:0/2851444505 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c0b0050 con 0x55cfdd77d680 2024-08-18T22:22:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 -- 172.21.15.5:0/2851444505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f591c001c60 con 0x55cfdd77d680 2024-08-18T22:22:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f5910c00640 1 -- 172.21.15.5:0/2851444505 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f590c003c30 con 0x55cfdd77d680 2024-08-18T22:22:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f5910c00640 1 -- 172.21.15.5:0/2851444505 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f590c0d1050 con 0x55cfdd77d680 2024-08-18T22:22:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 10 client.5544 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.211+0000 7f592d65e000 1 -- 172.21.15.5:0/2851444505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55cfdd6032f0 con 0x55cfdd77d680 2024-08-18T22:22:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f5910c00640 1 -- 172.21.15.5:0/2851444505 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f591c001c60 con 0x55cfdd77d680 2024-08-18T22:22:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f5910c00640 1 -- 172.21.15.5:0/2851444505 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f590c0d4020 con 0x55cfdd77d680 2024-08-18T22:22:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 10 client.5544 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 10 client.5544 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 20 client.5544 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55cfdd732e90 0x55cfdd7332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 4 client.5544 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 -- 172.21.15.5:0/2851444505 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfdd51d150 con 0x55cfdd732e90 2024-08-18T22:22:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f5923400640 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55cfdd732e90 0x55cfdd7332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f5923400640 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55cfdd732e90 0x55cfdd7332a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2386bb86372576d server_cookie=6a86632e0f9aeacf in_seq=0 out_seq=0 2024-08-18T22:22:27.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f5910c00640 10 client.5544 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f5910c00640 1 -- 172.21.15.5:0/2851444505 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cfdd51d150 con 0x55cfdd732e90 2024-08-18T22:22:27.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f5910c00640 10 client.5544 handle_command_reply: tid=0 2024-08-18T22:22:27.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 client.5544 shutdown 2024-08-18T22:22:27.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 -- 172.21.15.5:0/2851444505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 msgr2=0x55cfdd783f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd783f10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f590c018fe0 tx=0x7f590c01ac10 comp rx=0 tx=0).stop 2024-08-18T22:22:27.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 -- 172.21.15.5:0/2851444505 shutdown_connections 2024-08-18T22:22:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55cfdd732e90 0x55cfdd7332a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd732480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd783f10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f5910c00640 0 client.5544 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 --2- 172.21.15.5:0/2851444505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd7839d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 -- 172.21.15.5:0/2851444505 >> 172.21.15.5:0/2851444505 conn(0x55cfdd72ab60 msgr2=0x55cfdd760500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 -- 172.21.15.5:0/2851444505 shutdown_connections 2024-08-18T22:22:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 1 -- 172.21.15.5:0/2851444505 wait complete. 2024-08-18T22:22:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.215+0000 7f592d65e000 20 client.5544 trim_cache size 0 max 16384 2024-08-18T22:22:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f592d65e000 1 Processor -- start 2024-08-18T22:22:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f592d65e000 1 -- start start 2024-08-18T22:22:27.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f592d65e000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd793d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f592d65e000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7942c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f592d65e000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd7805a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f592d65e000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5924202ca0 con 0x55cfdd77d680 2024-08-18T22:22:27.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f592d65e000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5924141280 con 0x55cfdd77dfa0 2024-08-18T22:22:27.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f592d65e000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5924202650 con 0x55cfdd731050 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f591aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7942c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f591aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7942c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41752/0 (socket says 172.21.15.5:41752) 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f591aa00640 1 -- 172.21.15.5:0/3409564516 learned_addr learned my addr 172.21.15.5:0/3409564516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f5923e00640 1 --2- 172.21.15.5:0/3409564516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd7805a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f5923400640 1 --2- 172.21.15.5:0/3409564516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd793d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f591aa00640 1 -- 172.21.15.5:0/3409564516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 msgr2=0x55cfdd793d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f591aa00640 1 --2- 172.21.15.5:0/3409564516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd793d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f591aa00640 1 -- 172.21.15.5:0/3409564516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 msgr2=0x55cfdd7805a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f591aa00640 1 --2- 172.21.15.5:0/3409564516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd7805a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f591aa00640 1 -- 172.21.15.5:0/3409564516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdd5da1e0 con 0x55cfdd77d680 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f591aa00640 1 --2- 172.21.15.5:0/3409564516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7942c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f590c01c200 tx=0x7f590c0c3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b05d3eb8b21846a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f5913400640 1 -- 172.21.15.5:0/3409564516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c0da070 con 0x55cfdd77d680 2024-08-18T22:22:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f5913400640 1 -- 172.21.15.5:0/3409564516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590c0c9070 con 0x55cfdd77d680 2024-08-18T22:22:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.231+0000 7f5913400640 1 -- 172.21.15.5:0/3409564516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c0b0040 con 0x55cfdd77d680 2024-08-18T22:22:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 -- 172.21.15.5:0/3409564516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 msgr2=0x55cfdd7942c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 --2- 172.21.15.5:0/3409564516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7942c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f590c01c200 tx=0x7f590c0c3000 comp rx=0 tx=0).stop 2024-08-18T22:22:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 -- 172.21.15.5:0/3409564516 shutdown_connections 2024-08-18T22:22:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 --2- 172.21.15.5:0/3409564516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd7805a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 --2- 172.21.15.5:0/3409564516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7942c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 --2- 172.21.15.5:0/3409564516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd793d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 -- 172.21.15.5:0/3409564516 >> 172.21.15.5:0/3409564516 conn(0x55cfdd72ab60 msgr2=0x55cfdd730170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 -- 172.21.15.5:0/3409564516 shutdown_connections 2024-08-18T22:22:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 -- 172.21.15.5:0/3409564516 wait complete. 2024-08-18T22:22:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 -- start start 2024-08-18T22:22:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 Processor -- start 2024-08-18T22:22:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd7839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7acb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd7ad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55cfdd519e50 con 0x55cfdd77d680 2024-08-18T22:22:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cfdd51cb30 con 0x55cfdd77dfa0 2024-08-18T22:22:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55cfdd5814e0 con 0x55cfdd731050 2024-08-18T22:22:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 10 client.0 _ll_register_callbacks cb 0x7f590c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f591aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f591aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41764/0 (socket says 172.21.15.5:41764) 2024-08-18T22:22:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f591aa00640 1 -- 172.21.15.5:0/2985252578 learned_addr learned my addr 172.21.15.5:0/2985252578 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f5923400640 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd7839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f5923e00640 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd7ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f591aa00640 1 -- 172.21.15.5:0/2985252578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 msgr2=0x55cfdd7839d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f591aa00640 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd7839d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f591aa00640 1 -- 172.21.15.5:0/2985252578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 msgr2=0x55cfdd7ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f591aa00640 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd7ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f591aa00640 1 -- 172.21.15.5:0/2985252578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfdd515e50 con 0x55cfdd77d680 2024-08-18T22:22:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f591aa00640 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7acb00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f590c01c940 tx=0x7f590c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57c65429dc91412 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f5910c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f5910c00640 1 -- 172.21.15.5:0/2985252578 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c0da070 con 0x55cfdd77d680 2024-08-18T22:22:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f5910c00640 1 -- 172.21.15.5:0/2985252578 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f590c0b8cd0 con 0x55cfdd77d680 2024-08-18T22:22:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 -- 172.21.15.5:0/2985252578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f590c0c9070 con 0x55cfdd77d680 2024-08-18T22:22:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f5910c00640 1 -- 172.21.15.5:0/2985252578 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f590c0e6050 con 0x55cfdd77d680 2024-08-18T22:22:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 10 client.5550 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f592d65e000 1 -- 172.21.15.5:0/2985252578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55cfdd5192c0 con 0x55cfdd77d680 2024-08-18T22:22:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.235+0000 7f5910c00640 1 -- 172.21.15.5:0/2985252578 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590c0c9070 con 0x55cfdd77d680 2024-08-18T22:22:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f5910c00640 1 -- 172.21.15.5:0/2985252578 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f590c0e9020 con 0x55cfdd77d680 2024-08-18T22:22:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 10 client.5550 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 10 client.5550 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 20 client.5550 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55cfdd7ad580 0x55cfdd7f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 4 client.5550 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-08-18T22:22:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 -- 172.21.15.5:0/2985252578 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55cfdd58f900 con 0x55cfdd7ad580 2024-08-18T22:22:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f5923400640 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55cfdd7ad580 0x55cfdd7f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f5923400640 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55cfdd7ad580 0x55cfdd7f0da0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb5148a2ddadc929 server_cookie=402f4efb43188dfd in_seq=0 out_seq=0 2024-08-18T22:22:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f5910c00640 10 client.5550 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f5910c00640 1 -- 172.21.15.5:0/2985252578 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x55cfdd58f900 con 0x55cfdd7ad580 2024-08-18T22:22:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f5910c00640 10 client.5550 handle_command_reply: tid=0 2024-08-18T22:22:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 client.5550 shutdown 2024-08-18T22:22:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 -- 172.21.15.5:0/2985252578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 msgr2=0x55cfdd7acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7acb00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f590c01c940 tx=0x7f590c008040 comp rx=0 tx=0).stop 2024-08-18T22:22:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 -- 172.21.15.5:0/2985252578 shutdown_connections 2024-08-18T22:22:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55cfdd7ad580 0x55cfdd7f0da0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cfdd77dfa0 0x55cfdd7ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cfdd77d680 0x55cfdd7acb00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 --2- 172.21.15.5:0/2985252578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cfdd731050 0x55cfdd7839d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f5910c00640 0 client.5550 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 -- 172.21.15.5:0/2985252578 >> 172.21.15.5:0/2985252578 conn(0x55cfdd72ab60 msgr2=0x55cfdd792d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 -- 172.21.15.5:0/2985252578 shutdown_connections 2024-08-18T22:22:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 1 -- 172.21.15.5:0/2985252578 wait complete. 2024-08-18T22:22:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.239+0000 7f592d65e000 20 client.5550 trim_cache size 0 max 16384 2024-08-18T22:22:27.249 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:27.249 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:22:27.249 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": -2 2024-08-18T22:22:27.249 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:27.250 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-08-18T22:22:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENOENT: 2024-08-18T22:22:27.251 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-08-18T22:22:27.251 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-08-18T22:22:27.251 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-08-18T22:22:27.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad93e00640 1 Processor -- start 2024-08-18T22:22:27.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad93e00640 1 -- start start 2024-08-18T22:22:27.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad93e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad8c073ba0 0x7fad8c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad93e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad8c06f610 0x7fad8c06e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad93e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad8c15adc0 con 0x7fad8c15a9e0 2024-08-18T22:22:27.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad93e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fad8c072b00 con 0x7fad8c073ba0 2024-08-18T22:22:27.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad93e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c072de0 con 0x7fad8c06f610 2024-08-18T22:22:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad90a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad8c073ba0 0x7fad8c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad90a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad8c073ba0 0x7fad8c06e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:36074/0 (socket says 172.21.15.5:36074) 2024-08-18T22:22:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad90a00640 1 -- 172.21.15.5:0/2771764007 learned_addr learned my addr 172.21.15.5:0/2771764007 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad91400640 1 --1- 172.21.15.5:0/2771764007 >> v1:172.21.15.117:6789/0 conn(0x7fad8c15a9e0 0x7fad8c072220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:37984/0 (socket says 172.21.15.5:37984) 2024-08-18T22:22:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad91e00640 1 --2- 172.21.15.5:0/2771764007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad8c06f610 0x7fad8c06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad90a00640 1 -- 172.21.15.5:0/2771764007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad8c06f610 msgr2=0x7fad8c06e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad90a00640 1 --2- 172.21.15.5:0/2771764007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad8c06f610 0x7fad8c06e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad90a00640 1 -- 172.21.15.5:0/2771764007 >> v1:172.21.15.117:6789/0 conn(0x7fad8c15a9e0 legacy=0x7fad8c072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.391+0000 7fad90a00640 1 -- 172.21.15.5:0/2771764007 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c0730c0 con 0x7fad8c073ba0 2024-08-18T22:22:27.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad90a00640 1 --2- 172.21.15.5:0/2771764007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad8c073ba0 0x7fad8c06e410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad7800bb10 tx=0x7fad7801ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80dbdb20c0b1489d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad8be00640 1 -- 172.21.15.5:0/2771764007 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad780b4070 con 0x7fad8c073ba0 2024-08-18T22:22:27.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad8be00640 1 -- 172.21.15.5:0/2771764007 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad780a7b70 con 0x7fad8c073ba0 2024-08-18T22:22:27.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad8be00640 1 -- 172.21.15.5:0/2771764007 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad780af440 con 0x7fad8c073ba0 2024-08-18T22:22:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad93e00640 1 -- 172.21.15.5:0/2771764007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad8c073ba0 msgr2=0x7fad8c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad93e00640 1 --2- 172.21.15.5:0/2771764007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad8c073ba0 0x7fad8c06e410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad7800bb10 tx=0x7fad7801ec30 comp rx=0 tx=0).stop 2024-08-18T22:22:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad93e00640 1 -- 172.21.15.5:0/2771764007 shutdown_connections 2024-08-18T22:22:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad93e00640 1 --2- 172.21.15.5:0/2771764007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad8c06f610 0x7fad8c06e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad93e00640 1 --2- 172.21.15.5:0/2771764007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad8c073ba0 0x7fad8c06e410 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad93e00640 1 -- 172.21.15.5:0/2771764007 >> 172.21.15.5:0/2771764007 conn(0x7fad8c0b1dc0 msgr2=0x7fad8c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad93e00640 1 -- 172.21.15.5:0/2771764007 shutdown_connections 2024-08-18T22:22:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.395+0000 7fad93e00640 1 -- 172.21.15.5:0/2771764007 wait complete. 2024-08-18T22:22:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad93e00640 1 Processor -- start 2024-08-18T22:22:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad93e00640 1 -- start start 2024-08-18T22:22:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad93e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8c06f610 0x7fad8c1463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad93e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad8c073ba0 0x7fad8c14d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad93e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad8c15a9e0 0x7fad8c0ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad93e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c0ce2a0 con 0x7fad8c06f610 2024-08-18T22:22:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad93e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c0ce120 con 0x7fad8c073ba0 2024-08-18T22:22:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad93e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c0ce420 con 0x7fad8c15a9e0 2024-08-18T22:22:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad91400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8c06f610 0x7fad8c1463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad91400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8c06f610 0x7fad8c1463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41772/0 (socket says 172.21.15.5:41772) 2024-08-18T22:22:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad91400640 1 -- 172.21.15.5:0/624950743 learned_addr learned my addr 172.21.15.5:0/624950743 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad91e00640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad8c15a9e0 0x7fad8c0ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad90a00640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad8c073ba0 0x7fad8c14d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad91400640 1 -- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad8c15a9e0 msgr2=0x7fad8c0ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad91400640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad8c15a9e0 0x7fad8c0ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad91400640 1 -- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad8c073ba0 msgr2=0x7fad8c14d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad91400640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad8c073ba0 0x7fad8c14d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad91400640 1 -- 172.21.15.5:0/624950743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c164fb0 con 0x7fad8c06f610 2024-08-18T22:22:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad90a00640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad8c073ba0 0x7fad8c14d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad91400640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8c06f610 0x7fad8c1463a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fad8000c370 tx=0x7fad8000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad89600640 1 -- 172.21.15.5:0/624950743 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad800074e0 con 0x7fad8c06f610 2024-08-18T22:22:27.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad89600640 1 -- 172.21.15.5:0/624950743 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad80007680 con 0x7fad8c06f610 2024-08-18T22:22:27.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad89600640 1 -- 172.21.15.5:0/624950743 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80004a30 con 0x7fad8c06f610 2024-08-18T22:22:27.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad93e00640 1 -- 172.21.15.5:0/624950743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8c148eb0 con 0x7fad8c06f610 2024-08-18T22:22:27.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.399+0000 7fad93e00640 1 -- 172.21.15.5:0/624950743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad8c165600 con 0x7fad8c06f610 2024-08-18T22:22:27.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad89600640 1 -- 172.21.15.5:0/624950743 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fad8001a020 con 0x7fad8c06f610 2024-08-18T22:22:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad89600640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fad6c0678c0 0x7fad6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad89600640 1 -- 172.21.15.5:0/624950743 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fad80085500 con 0x7fad8c06f610 2024-08-18T22:22:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad971f1000 1 Processor -- start 2024-08-18T22:22:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad90a00640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fad6c0678c0 0x7fad6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad971f1000 1 -- start start 2024-08-18T22:22:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad90a00640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fad6c0678c0 0x7fad6c069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fad780b1000 tx=0x7fad78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad971f1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x5569887a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad971f1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887a2f10 0x556988755cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad971f1000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887561f0 0x5569887565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad971f1000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5569885a72a0 con 0x5569887561f0 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad971f1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55698854d090 con 0x5569887a2f10 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad971f1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5569885a3260 con 0x5569887a25f0 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.403+0000 7fad91e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887561f0 0x5569887565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887561f0 0x5569887565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41786/0 (socket says 172.21.15.5:41786) 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91e00640 1 -- 172.21.15.5:0/623571111 learned_addr learned my addr 172.21.15.5:0/623571111 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad90a00640 1 --2- 172.21.15.5:0/623571111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887a2f10 0x556988755cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91400640 1 --2- 172.21.15.5:0/623571111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x5569887a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91e00640 1 -- 172.21.15.5:0/623571111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 msgr2=0x5569887a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91e00640 1 --2- 172.21.15.5:0/623571111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x5569887a29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91e00640 1 -- 172.21.15.5:0/623571111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887a2f10 msgr2=0x556988755cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91e00640 1 --2- 172.21.15.5:0/623571111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887a2f10 0x556988755cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91e00640 1 -- 172.21.15.5:0/623571111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698864e780 con 0x5569887561f0 2024-08-18T22:22:27.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91e00640 1 --2- 172.21.15.5:0/623571111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887561f0 0x5569887565d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fad84007470 tx=0x7fad84009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38270ae035dac34b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad7e000640 1 -- 172.21.15.5:0/623571111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84019020 con 0x5569887561f0 2024-08-18T22:22:27.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad7e000640 1 -- 172.21.15.5:0/623571111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad84015600 con 0x5569887561f0 2024-08-18T22:22:27.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad7e000640 1 -- 172.21.15.5:0/623571111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad840159f0 con 0x5569887561f0 2024-08-18T22:22:27.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 -- 172.21.15.5:0/623571111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887561f0 msgr2=0x5569887565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 --2- 172.21.15.5:0/623571111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887561f0 0x5569887565d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fad84007470 tx=0x7fad84009750 comp rx=0 tx=0).stop 2024-08-18T22:22:27.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 -- 172.21.15.5:0/623571111 shutdown_connections 2024-08-18T22:22:27.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 --2- 172.21.15.5:0/623571111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887561f0 0x5569887565d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 --2- 172.21.15.5:0/623571111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887a2f10 0x556988755cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 --2- 172.21.15.5:0/623571111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x5569887a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 -- 172.21.15.5:0/623571111 >> 172.21.15.5:0/623571111 conn(0x5569887834a0 msgr2=0x556988785890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 -- 172.21.15.5:0/623571111 shutdown_connections 2024-08-18T22:22:27.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 -- 172.21.15.5:0/623571111 wait complete. 2024-08-18T22:22:27.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 -- start start 2024-08-18T22:22:27.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 Processor -- start 2024-08-18T22:22:27.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887561f0 0x556988784ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x556988784ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988785530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5569885a65b0 con 0x5569887a2f10 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5569885611f0 con 0x5569887561f0 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5569885ab8d0 con 0x5569887a25f0 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad971f1000 10 client.0 _ll_register_callbacks cb 0x5569887439c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988785530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988785530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41792/0 (socket says 172.21.15.5:41792) 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.407+0000 7fad91e00640 1 -- 172.21.15.5:0/989223785 learned_addr learned my addr 172.21.15.5:0/989223785 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad91400640 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887561f0 0x556988784ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad90a00640 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x556988784ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad91e00640 1 -- 172.21.15.5:0/989223785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 msgr2=0x556988784ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad91e00640 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x556988784ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad91e00640 1 -- 172.21.15.5:0/989223785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887561f0 msgr2=0x556988784ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad91e00640 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887561f0 0x556988784ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad91e00640 1 -- 172.21.15.5:0/989223785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569885ebb90 con 0x5569887a2f10 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad91e00640 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988785530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fad84008010 tx=0x7fad84004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1559135b40a7c280 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad72a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad72a00640 1 -- 172.21.15.5:0/989223785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84024070 con 0x5569887a2f10 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad72a00640 1 -- 172.21.15.5:0/989223785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fad84029c40 con 0x5569887a2f10 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 -- 172.21.15.5:0/989223785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad84015600 con 0x5569887a2f10 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad72a00640 1 -- 172.21.15.5:0/989223785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fad84029e40 con 0x5569887a2f10 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 10 client.5559 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 -- 172.21.15.5:0/989223785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55698857fbc0 con 0x5569887a2f10 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad72a00640 1 -- 172.21.15.5:0/989223785 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad84015600 con 0x5569887a2f10 2024-08-18T22:22:27.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad72a00640 1 -- 172.21.15.5:0/989223785 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fad8401e830 con 0x5569887a2f10 2024-08-18T22:22:27.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 10 client.5559 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:27.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 10 client.5559 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:27.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 20 client.5559 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:27.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5569887b2690 0x5569887b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 4 client.5559 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:27.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 -- 172.21.15.5:0/989223785 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556988541cc0 con 0x5569887b2690 2024-08-18T22:22:27.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad91400640 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5569887b2690 0x5569887b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad91400640 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5569887b2690 0x5569887b4a80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6be57c359ee6fef server_cookie=38868600ad75fc92 in_seq=0 out_seq=0 2024-08-18T22:22:27.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad72a00640 10 client.5559 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad72a00640 1 -- 172.21.15.5:0/989223785 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556988541cc0 con 0x5569887b2690 2024-08-18T22:22:27.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad72a00640 10 client.5559 handle_command_reply: tid=0 2024-08-18T22:22:27.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 client.5559 shutdown 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 -- 172.21.15.5:0/989223785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 msgr2=0x556988785530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988785530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fad84008010 tx=0x7fad84004ac0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 -- 172.21.15.5:0/989223785 shutdown_connections 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5569887b2690 0x5569887b4a80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988785530 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x556988784ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 --2- 172.21.15.5:0/989223785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887561f0 0x556988784ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 -- 172.21.15.5:0/989223785 >> 172.21.15.5:0/989223785 conn(0x5569887834a0 msgr2=0x5569887553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad72a00640 0 client.5559 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 -- 172.21.15.5:0/989223785 shutdown_connections 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 1 -- 172.21.15.5:0/989223785 wait complete. 2024-08-18T22:22:27.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.411+0000 7fad971f1000 20 client.5559 trim_cache size 0 max 16384 2024-08-18T22:22:27.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad971f1000 1 Processor -- start 2024-08-18T22:22:27.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad971f1000 1 -- start start 2024-08-18T22:22:27.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad971f1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887561f0 0x556988812bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad971f1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x556988813100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad971f1000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988813640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad971f1000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c202d90 con 0x5569887a2f10 2024-08-18T22:22:27.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad971f1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c14ff60 con 0x5569887561f0 2024-08-18T22:22:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad971f1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c1505b0 con 0x5569887a25f0 2024-08-18T22:22:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad91e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988813640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad91400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887561f0 0x556988812bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad90a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x556988813100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad91e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988813640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41800/0 (socket says 172.21.15.5:41800) 2024-08-18T22:22:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad91e00640 1 -- 172.21.15.5:0/2120570051 learned_addr learned my addr 172.21.15.5:0/2120570051 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad91400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887561f0 0x556988812bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:36112/0 (socket says 172.21.15.5:36112) 2024-08-18T22:22:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad91e00640 1 -- 172.21.15.5:0/2120570051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 msgr2=0x556988813100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad91e00640 1 --2- 172.21.15.5:0/2120570051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x556988813100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad91e00640 1 -- 172.21.15.5:0/2120570051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887561f0 msgr2=0x556988812bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad91e00640 1 --2- 172.21.15.5:0/2120570051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887561f0 0x556988812bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad91e00640 1 -- 172.21.15.5:0/2120570051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569885642c0 con 0x5569887a2f10 2024-08-18T22:22:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad91e00640 1 --2- 172.21.15.5:0/2120570051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988813640 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fad84007ec0 tx=0x7fad84020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc6d8381024389 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.431+0000 7fad7d600640 1 -- 172.21.15.5:0/2120570051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84036030 con 0x5569887a2f10 2024-08-18T22:22:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad7d600640 1 -- 172.21.15.5:0/2120570051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad84009c50 con 0x5569887a2f10 2024-08-18T22:22:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad7d600640 1 -- 172.21.15.5:0/2120570051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84019070 con 0x5569887a2f10 2024-08-18T22:22:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 -- 172.21.15.5:0/2120570051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 msgr2=0x556988813640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 --2- 172.21.15.5:0/2120570051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988813640 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fad84007ec0 tx=0x7fad84020070 comp rx=0 tx=0).stop 2024-08-18T22:22:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 -- 172.21.15.5:0/2120570051 shutdown_connections 2024-08-18T22:22:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 --2- 172.21.15.5:0/2120570051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a2f10 0x556988813640 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 --2- 172.21.15.5:0/2120570051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887a25f0 0x556988813100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 --2- 172.21.15.5:0/2120570051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887561f0 0x556988812bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 -- 172.21.15.5:0/2120570051 >> 172.21.15.5:0/2120570051 conn(0x5569887834a0 msgr2=0x556988755550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 -- 172.21.15.5:0/2120570051 shutdown_connections 2024-08-18T22:22:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 -- 172.21.15.5:0/2120570051 wait complete. 2024-08-18T22:22:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 -- start start 2024-08-18T22:22:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 Processor -- start 2024-08-18T22:22:27.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887561f0 0x556988816a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a25f0 0x556988816f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887a2f10 0x5569887d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5569885487e0 con 0x5569887a25f0 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55698854a810 con 0x5569887a2f10 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55698854ef00 con 0x5569887561f0 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad971f1000 10 client.0 _ll_register_callbacks cb 0x7fad780b2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad90a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a25f0 0x556988816f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad90a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a25f0 0x556988816f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41812/0 (socket says 172.21.15.5:41812) 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad90a00640 1 -- 172.21.15.5:0/191901523 learned_addr learned my addr 172.21.15.5:0/191901523 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad91400640 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887561f0 0x556988816a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad91e00640 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887a2f10 0x5569887d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad90a00640 1 -- 172.21.15.5:0/191901523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887561f0 msgr2=0x556988816a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad90a00640 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887561f0 0x556988816a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad90a00640 1 -- 172.21.15.5:0/191901523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887a2f10 msgr2=0x5569887d1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad90a00640 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887a2f10 0x5569887d1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad90a00640 1 -- 172.21.15.5:0/191901523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556988542cf0 con 0x5569887a25f0 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad90a00640 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a25f0 0x556988816f60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fad780b2040 tx=0x7fad7801d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e33b778b1d861cc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad72a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.435+0000 7fad72a00640 1 -- 172.21.15.5:0/191901523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad780cc060 con 0x5569887a25f0 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad72a00640 1 -- 172.21.15.5:0/191901523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fad780c7670 con 0x5569887a25f0 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 -- 172.21.15.5:0/191901523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad84009c50 con 0x5569887a25f0 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad72a00640 1 -- 172.21.15.5:0/191901523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fad780d2050 con 0x5569887a25f0 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 10 client.5565 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 -- 172.21.15.5:0/191901523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55698853cfe0 con 0x5569887a25f0 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad72a00640 1 -- 172.21.15.5:0/191901523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad84009c50 con 0x5569887a25f0 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad72a00640 1 -- 172.21.15.5:0/191901523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fad780d5020 con 0x5569887a25f0 2024-08-18T22:22:27.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 10 client.5565 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 10 client.5565 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 20 client.5565 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5569887d22f0 0x5569887d2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 4 client.5565 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 -- 172.21.15.5:0/191901523 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x5569885b49d0 con 0x5569887d22f0 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad91400640 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5569887d22f0 0x5569887d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad91400640 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5569887d22f0 0x5569887d2700 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be033e6815e253ce server_cookie=8234f0d7ba8e35e5 in_seq=0 out_seq=0 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad72a00640 10 client.5565 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad72a00640 1 -- 172.21.15.5:0/191901523 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x5569885b49d0 con 0x5569887d22f0 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad72a00640 10 client.5565 handle_command_reply: tid=0 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 client.5565 shutdown 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 -- 172.21.15.5:0/191901523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a25f0 msgr2=0x556988816f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a25f0 0x556988816f60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fad780b2040 tx=0x7fad7801d470 comp rx=0 tx=0).stop 2024-08-18T22:22:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 -- 172.21.15.5:0/191901523 shutdown_connections 2024-08-18T22:22:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5569887d22f0 0x5569887d2700 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569887a2f10 0x5569887d1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5569887a25f0 0x556988816f60 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 --2- 172.21.15.5:0/191901523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5569887561f0 0x556988816a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad72a00640 0 client.5565 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 -- 172.21.15.5:0/191901523 >> 172.21.15.5:0/191901523 conn(0x5569887834a0 msgr2=0x5569887b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 -- 172.21.15.5:0/191901523 shutdown_connections 2024-08-18T22:22:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 1 -- 172.21.15.5:0/191901523 wait complete. 2024-08-18T22:22:27.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad971f1000 20 client.5565 trim_cache size 0 max 16384 2024-08-18T22:22:27.447 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:27.448 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": -2 2024-08-18T22:22:27.448 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 -- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fad6c0678c0 msgr2=0x7fad6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fad6c0678c0 0x7fad6c069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fad780b1000 tx=0x7fad78008040 comp rx=0 tx=0).stop 2024-08-18T22:22:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 -- 172.21.15.5:0/624950743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8c06f610 msgr2=0x7fad8c1463a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8c06f610 0x7fad8c1463a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fad8000c370 tx=0x7fad8000c830 comp rx=0 tx=0).stop 2024-08-18T22:22:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 -- 172.21.15.5:0/624950743 shutdown_connections 2024-08-18T22:22:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fad6c0678c0 0x7fad6c069d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad8c15a9e0 0x7fad8c0ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad8c073ba0 0x7fad8c14d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 --2- 172.21.15.5:0/624950743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad8c06f610 0x7fad8c1463a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 -- 172.21.15.5:0/624950743 >> 172.21.15.5:0/624950743 conn(0x7fad8c0b1dc0 msgr2=0x7fad8c0b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 -- 172.21.15.5:0/624950743 shutdown_connections 2024-08-18T22:22:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.439+0000 7fad93e00640 1 -- 172.21.15.5:0/624950743 wait complete. 2024-08-18T22:22:27.462 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-08-18T22:22:27.463 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-08-18T22:22:27.463 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-08-18T22:22:27.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites 2024-08-18T22:22:27.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2827c00640 1 Processor -- start 2024-08-18T22:22:27.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2827c00640 1 -- start start 2024-08-18T22:22:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2827c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2820147dd0 0x7f28200b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2827c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f282015f000 0x7f28200d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2827c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28200b46b0 con 0x7f282006c3c0 2024-08-18T22:22:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2827c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f282015f7c0 con 0x7f282015f000 2024-08-18T22:22:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2827c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28200b6410 con 0x7f2820147dd0 2024-08-18T22:22:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2825c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f282015f000 0x7f28200d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2825c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f282015f000 0x7f28200d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41822/0 (socket says 172.21.15.5:41822) 2024-08-18T22:22:27.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2825c00640 1 -- 172.21.15.5:0/2889310439 learned_addr learned my addr 172.21.15.5:0/2889310439 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2825200640 1 --2- 172.21.15.5:0/2889310439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2820147dd0 0x7f28200b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2825c00640 1 -- 172.21.15.5:0/2889310439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2820147dd0 msgr2=0x7f28200b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2825c00640 1 --2- 172.21.15.5:0/2889310439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2820147dd0 0x7f28200b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2825c00640 1 -- 172.21.15.5:0/2889310439 >> v1:172.21.15.117:6789/0 conn(0x7f282006c3c0 legacy=0x7f282015e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.603+0000 7f2825c00640 1 -- 172.21.15.5:0/2889310439 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282006c820 con 0x7f282015f000 2024-08-18T22:22:27.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f2825c00640 1 --2- 172.21.15.5:0/2889310439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282015f000 0x7f28200d0f70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2818009e50 tx=0x7f281801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868cd0f2f3a314cd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f281f400640 1 -- 172.21.15.5:0/2889310439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28180a57b0 con 0x7f282015f000 2024-08-18T22:22:27.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f281f400640 1 -- 172.21.15.5:0/2889310439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28180a5950 con 0x7f282015f000 2024-08-18T22:22:27.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f281f400640 1 -- 172.21.15.5:0/2889310439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28180a5d20 con 0x7f282015f000 2024-08-18T22:22:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f2827c00640 1 -- 172.21.15.5:0/2889310439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282015f000 msgr2=0x7f28200d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f2827c00640 1 --2- 172.21.15.5:0/2889310439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282015f000 0x7f28200d0f70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2818009e50 tx=0x7f281801c930 comp rx=0 tx=0).stop 2024-08-18T22:22:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f2827c00640 1 -- 172.21.15.5:0/2889310439 shutdown_connections 2024-08-18T22:22:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f2827c00640 1 --2- 172.21.15.5:0/2889310439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282015f000 0x7f28200d0f70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f2827c00640 1 --2- 172.21.15.5:0/2889310439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2820147dd0 0x7f28200b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f2827c00640 1 -- 172.21.15.5:0/2889310439 >> 172.21.15.5:0/2889310439 conn(0x7f28200b65f0 msgr2=0x7f28200b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f2827c00640 1 -- 172.21.15.5:0/2889310439 shutdown_connections 2024-08-18T22:22:27.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f2827c00640 1 -- 172.21.15.5:0/2889310439 wait complete. 2024-08-18T22:22:27.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f2827c00640 1 Processor -- start 2024-08-18T22:22:27.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.607+0000 7f2827c00640 1 -- start start 2024-08-18T22:22:27.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2827c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282006c3c0 0x7f282013ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2827c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2820147dd0 0x7f2820134b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2827c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282015f000 0x7f28201350a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2827c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f28200b5b30 con 0x7f282015f000 2024-08-18T22:22:27.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2827c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f282015f9e0 con 0x7f282006c3c0 2024-08-18T22:22:27.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2827c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28200b5cb0 con 0x7f2820147dd0 2024-08-18T22:22:27.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2825c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282015f000 0x7f28201350a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2825200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282006c3c0 0x7f282013ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2825c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282015f000 0x7f28201350a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41828/0 (socket says 172.21.15.5:41828) 2024-08-18T22:22:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2825200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282006c3c0 0x7f282013ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:36136/0 (socket says 172.21.15.5:36136) 2024-08-18T22:22:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2825c00640 1 -- 172.21.15.5:0/1869189863 learned_addr learned my addr 172.21.15.5:0/1869189863 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f281fe00640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2820147dd0 0x7f2820134b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2825c00640 1 -- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2820147dd0 msgr2=0x7f2820134b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2825c00640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2820147dd0 0x7f2820134b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2825c00640 1 -- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282006c3c0 msgr2=0x7f282013ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2825c00640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282006c3c0 0x7f282013ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2825c00640 1 -- 172.21.15.5:0/1869189863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2820138f50 con 0x7f282015f000 2024-08-18T22:22:27.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2825c00640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282015f000 0x7f28201350a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2818009e50 tx=0x7f28180196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f281cc00640 1 -- 172.21.15.5:0/1869189863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818009250 con 0x7f282015f000 2024-08-18T22:22:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f281cc00640 1 -- 172.21.15.5:0/1869189863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28180be070 con 0x7f282015f000 2024-08-18T22:22:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f281cc00640 1 -- 172.21.15.5:0/1869189863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28180b8690 con 0x7f282015f000 2024-08-18T22:22:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2827c00640 1 -- 172.21.15.5:0/1869189863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282015d3b0 con 0x7f282015f000 2024-08-18T22:22:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.611+0000 7f2827c00640 1 -- 172.21.15.5:0/1869189863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2820138b90 con 0x7f282015f000 2024-08-18T22:22:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f281cc00640 1 -- 172.21.15.5:0/1869189863 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28180b8830 con 0x7f282015f000 2024-08-18T22:22:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f281cc00640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28000678c0 0x7f2800069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f281cc00640 1 -- 172.21.15.5:0/1869189863 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f2818120c20 con 0x7f282015f000 2024-08-18T22:22:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f282b17e000 1 Processor -- start 2024-08-18T22:22:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f2825200640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28000678c0 0x7f2800069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f282b17e000 1 -- start start 2024-08-18T22:22:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f2825200640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28000678c0 0x7f2800069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2810007a60 tx=0x7f2810008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f282b17e000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dbbb0 0x5626c33dbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f282b17e000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33dc4d0 0x5626c3391b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f282b17e000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33920a0 0x5626c3392480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f282b17e000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5626c31e1370 con 0x5626c33dbbb0 2024-08-18T22:22:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f282b17e000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5626c317d370 con 0x5626c33920a0 2024-08-18T22:22:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f282b17e000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5626c31dd330 con 0x5626c33dc4d0 2024-08-18T22:22:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f2825200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dbbb0 0x5626c33dbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f2825200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dbbb0 0x5626c33dbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41832/0 (socket says 172.21.15.5:41832) 2024-08-18T22:22:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f2825200640 1 -- 172.21.15.5:0/234464747 learned_addr learned my addr 172.21.15.5:0/234464747 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f281fe00640 1 --2- 172.21.15.5:0/234464747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33dc4d0 0x5626c3391b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.615+0000 7f2825c00640 1 --2- 172.21.15.5:0/234464747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33920a0 0x5626c3392480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 -- 172.21.15.5:0/234464747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33dc4d0 msgr2=0x5626c3391b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 --2- 172.21.15.5:0/234464747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33dc4d0 0x5626c3391b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 -- 172.21.15.5:0/234464747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33920a0 msgr2=0x5626c3392480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 --2- 172.21.15.5:0/234464747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33920a0 0x5626c3392480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 -- 172.21.15.5:0/234464747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626c321bf00 con 0x5626c33dbbb0 2024-08-18T22:22:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 --2- 172.21.15.5:0/234464747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dbbb0 0x5626c33dbf90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2810007fd0 tx=0x7f2810013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f9b8cea5c2627d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2815600640 1 -- 172.21.15.5:0/234464747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281001c050 con 0x5626c33dbbb0 2024-08-18T22:22:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2815600640 1 -- 172.21.15.5:0/234464747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2810026070 con 0x5626c33dbbb0 2024-08-18T22:22:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2815600640 1 -- 172.21.15.5:0/234464747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810021640 con 0x5626c33dbbb0 2024-08-18T22:22:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 -- 172.21.15.5:0/234464747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dbbb0 msgr2=0x5626c33dbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 --2- 172.21.15.5:0/234464747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dbbb0 0x5626c33dbf90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2810007fd0 tx=0x7f2810013000 comp rx=0 tx=0).stop 2024-08-18T22:22:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 -- 172.21.15.5:0/234464747 shutdown_connections 2024-08-18T22:22:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 --2- 172.21.15.5:0/234464747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33920a0 0x5626c3392480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 --2- 172.21.15.5:0/234464747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33dc4d0 0x5626c3391b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 --2- 172.21.15.5:0/234464747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dbbb0 0x5626c33dbf90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 -- 172.21.15.5:0/234464747 >> 172.21.15.5:0/234464747 conn(0x5626c33bca60 msgr2=0x5626c33bee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 -- 172.21.15.5:0/234464747 shutdown_connections 2024-08-18T22:22:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 -- 172.21.15.5:0/234464747 wait complete. 2024-08-18T22:22:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 -- start start 2024-08-18T22:22:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 Processor -- start 2024-08-18T22:22:27.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33920a0 0x5626c3397900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33dbbb0 0x5626c3397e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dc4d0 0x5626c3398380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5626c3183590 con 0x5626c33920a0 2024-08-18T22:22:27.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5626c31dc160 con 0x5626c33dc4d0 2024-08-18T22:22:27.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5626c31de920 con 0x5626c33dbbb0 2024-08-18T22:22:27.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f282b17e000 10 client.0 _ll_register_callbacks cb 0x5626c3293ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:27.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33920a0 0x5626c3397900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33920a0 0x5626c3397900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41836/0 (socket says 172.21.15.5:41836) 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 -- 172.21.15.5:0/4175464901 learned_addr learned my addr 172.21.15.5:0/4175464901 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f281fe00640 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33dbbb0 0x5626c3397e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825c00640 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dc4d0 0x5626c3398380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 -- 172.21.15.5:0/4175464901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33dbbb0 msgr2=0x5626c3397e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33dbbb0 0x5626c3397e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 -- 172.21.15.5:0/4175464901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dc4d0 msgr2=0x5626c3398380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dc4d0 0x5626c3398380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.619+0000 7f2825200640 1 -- 172.21.15.5:0/4175464901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626c31a3ed0 con 0x5626c33920a0 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f2825200640 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33920a0 0x5626c3397900 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x5626c3299ef0 tx=0x7f2810004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec072678e2c4ce38 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f280a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:27.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f280a000640 1 -- 172.21.15.5:0/4175464901 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281002e070 con 0x5626c33920a0 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f280a000640 1 -- 172.21.15.5:0/4175464901 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f2810006450 con 0x5626c33920a0 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 -- 172.21.15.5:0/4175464901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2810026070 con 0x5626c33920a0 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f280a000640 1 -- 172.21.15.5:0/4175464901 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2810016e50 con 0x5626c33920a0 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 10 client.5577 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 -- 172.21.15.5:0/4175464901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5626c325d380 con 0x5626c33920a0 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f280a000640 1 -- 172.21.15.5:0/4175464901 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2810026070 con 0x5626c33920a0 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f280a000640 1 -- 172.21.15.5:0/4175464901 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f2810006650 con 0x5626c33920a0 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 10 client.5577 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 10 client.5577 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 20 client.5577 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626c3398d90 0x5626c33edc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 4 client.5577 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 -- 172.21.15.5:0/4175464901 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626c317c1b0 con 0x5626c3398d90 2024-08-18T22:22:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f281fe00640 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626c3398d90 0x5626c33edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f281fe00640 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626c3398d90 0x5626c33edc60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf43956a7f021560 server_cookie=dfa2d9c57a867979 in_seq=0 out_seq=0 2024-08-18T22:22:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f280a000640 10 client.5577 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f280a000640 1 -- 172.21.15.5:0/4175464901 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626c317c1b0 con 0x5626c3398d90 2024-08-18T22:22:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f280a000640 10 client.5577 handle_command_reply: tid=0 2024-08-18T22:22:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 client.5577 shutdown 2024-08-18T22:22:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 -- 172.21.15.5:0/4175464901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33920a0 msgr2=0x5626c3397900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33920a0 0x5626c3397900 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x5626c3299ef0 tx=0x7f2810004740 comp rx=0 tx=0).stop 2024-08-18T22:22:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 -- 172.21.15.5:0/4175464901 shutdown_connections 2024-08-18T22:22:27.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626c3398d90 0x5626c33edc60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dc4d0 0x5626c3398380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33dbbb0 0x5626c3397e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 --2- 172.21.15.5:0/4175464901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33920a0 0x5626c3397900 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f280a000640 0 client.5577 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 -- 172.21.15.5:0/4175464901 >> 172.21.15.5:0/4175464901 conn(0x5626c33bca60 msgr2=0x5626c3391260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 -- 172.21.15.5:0/4175464901 shutdown_connections 2024-08-18T22:22:27.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 1 -- 172.21.15.5:0/4175464901 wait complete. 2024-08-18T22:22:27.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.623+0000 7f282b17e000 20 client.5577 trim_cache size 0 max 16384 2024-08-18T22:22:27.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f282b17e000 1 Processor -- start 2024-08-18T22:22:27.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f282b17e000 1 -- start start 2024-08-18T22:22:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f282b17e000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33920a0 0x5626c339a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f282b17e000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dbbb0 0x5626c3399170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f282b17e000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33996b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f282b17e000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2820203e00 con 0x5626c33dc4d0 2024-08-18T22:22:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f282b17e000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2820202e10 con 0x5626c33dbbb0 2024-08-18T22:22:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f282b17e000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f282013c6b0 con 0x5626c33920a0 2024-08-18T22:22:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f2825c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f2825c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41838/0 (socket says 172.21.15.5:41838) 2024-08-18T22:22:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f2825c00640 1 -- 172.21.15.5:0/484768867 learned_addr learned my addr 172.21.15.5:0/484768867 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f2825200640 1 --2- 172.21.15.5:0/484768867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33920a0 0x5626c339a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f281fe00640 1 --2- 172.21.15.5:0/484768867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dbbb0 0x5626c3399170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f2825c00640 1 -- 172.21.15.5:0/484768867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33920a0 msgr2=0x5626c339a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f2825c00640 1 --2- 172.21.15.5:0/484768867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33920a0 0x5626c339a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f2825c00640 1 -- 172.21.15.5:0/484768867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dbbb0 msgr2=0x5626c3399170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f2825c00640 1 --2- 172.21.15.5:0/484768867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dbbb0 0x5626c3399170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.639+0000 7f2825c00640 1 -- 172.21.15.5:0/484768867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626c3239190 con 0x5626c33dc4d0 2024-08-18T22:22:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2825c00640 1 --2- 172.21.15.5:0/484768867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33996b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f28180ed2b0 tx=0x7f2818009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35f46a13ab2266e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2814c00640 1 -- 172.21.15.5:0/484768867 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281811c070 con 0x5626c33dc4d0 2024-08-18T22:22:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2814c00640 1 -- 172.21.15.5:0/484768867 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28180f9a10 con 0x5626c33dc4d0 2024-08-18T22:22:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2814c00640 1 -- 172.21.15.5:0/484768867 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28180ed4c0 con 0x5626c33dc4d0 2024-08-18T22:22:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 -- 172.21.15.5:0/484768867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 msgr2=0x5626c33996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 --2- 172.21.15.5:0/484768867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33996b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f28180ed2b0 tx=0x7f2818009810 comp rx=0 tx=0).stop 2024-08-18T22:22:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 -- 172.21.15.5:0/484768867 shutdown_connections 2024-08-18T22:22:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 --2- 172.21.15.5:0/484768867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33996b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 --2- 172.21.15.5:0/484768867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dbbb0 0x5626c3399170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 --2- 172.21.15.5:0/484768867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33920a0 0x5626c339a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 -- 172.21.15.5:0/484768867 >> 172.21.15.5:0/484768867 conn(0x5626c33bca60 msgr2=0x5626c33bee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 -- 172.21.15.5:0/484768867 shutdown_connections 2024-08-18T22:22:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 -- 172.21.15.5:0/484768867 wait complete. 2024-08-18T22:22:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 -- start start 2024-08-18T22:22:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 Processor -- start 2024-08-18T22:22:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33920a0 0x5626c33eecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dbbb0 0x5626c33ef1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33ef730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5626c31e1370 con 0x5626c33dc4d0 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f28202027f0 con 0x5626c33dbbb0 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5626c317d370 con 0x5626c33920a0 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 10 client.0 _ll_register_callbacks cb 0x7f28180a5f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2825c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2825c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33ef730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41850/0 (socket says 172.21.15.5:41850) 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2825c00640 1 -- 172.21.15.5:0/3496098373 learned_addr learned my addr 172.21.15.5:0/3496098373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2825200640 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33920a0 0x5626c33eecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f281fe00640 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dbbb0 0x5626c33ef1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2825c00640 1 -- 172.21.15.5:0/3496098373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33920a0 msgr2=0x5626c33eecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2825c00640 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33920a0 0x5626c33eecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2825c00640 1 -- 172.21.15.5:0/3496098373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dbbb0 msgr2=0x5626c33ef1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2825c00640 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dbbb0 0x5626c33ef1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2825c00640 1 -- 172.21.15.5:0/3496098373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626c3175000 con 0x5626c33dc4d0 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f2825c00640 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33ef730 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f281801ce10 tx=0x7f2818009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f43db8782f5d81a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f280a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f280a000640 1 -- 172.21.15.5:0/3496098373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281811c040 con 0x5626c33dc4d0 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f280a000640 1 -- 172.21.15.5:0/3496098373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f281800a000 con 0x5626c33dc4d0 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.643+0000 7f282b17e000 1 -- 172.21.15.5:0/3496098373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28180f9a10 con 0x5626c33dc4d0 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f280a000640 1 -- 172.21.15.5:0/3496098373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f281800a200 con 0x5626c33dc4d0 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f282b17e000 10 client.5583 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f282b17e000 1 -- 172.21.15.5:0/3496098373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5626c3187ae0 con 0x5626c33dc4d0 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f280a000640 1 -- 172.21.15.5:0/3496098373 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28180f9a10 con 0x5626c33dc4d0 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f280a000640 1 -- 172.21.15.5:0/3496098373 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f28180f10b0 con 0x5626c33dc4d0 2024-08-18T22:22:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f282b17e000 10 client.5583 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f282b17e000 10 client.5583 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f282b17e000 20 client.5583 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f282b17e000 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626c344cfe0 0x5626c33efc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f282b17e000 4 client.5583 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-08-18T22:22:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f282b17e000 1 -- 172.21.15.5:0/3496098373 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x5626c31eeaa0 con 0x5626c344cfe0 2024-08-18T22:22:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f2825200640 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626c344cfe0 0x5626c33efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f280a000640 10 client.5583 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.647+0000 7f2825200640 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626c344cfe0 0x5626c33efc70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed02fffb8bdf7673 server_cookie=41b36d09ceacfa2 in_seq=0 out_seq=0 2024-08-18T22:22:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f280a000640 1 -- 172.21.15.5:0/3496098373 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5626c31eeaa0 con 0x5626c344cfe0 2024-08-18T22:22:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f280a000640 10 client.5583 handle_command_reply: tid=0 2024-08-18T22:22:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 1 client.5583 shutdown 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 1 -- 172.21.15.5:0/3496098373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 msgr2=0x5626c33ef730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33ef730 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f281801ce10 tx=0x7f2818009640 comp rx=0 tx=0).stop 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 1 -- 172.21.15.5:0/3496098373 shutdown_connections 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626c344cfe0 0x5626c33efc70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626c33dc4d0 0x5626c33ef730 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626c33dbbb0 0x5626c33ef1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 1 --2- 172.21.15.5:0/3496098373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626c33920a0 0x5626c33eecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f280a000640 0 client.5583 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 1 -- 172.21.15.5:0/3496098373 >> 172.21.15.5:0/3496098373 conn(0x5626c33bca60 msgr2=0x5626c3392ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 1 -- 172.21.15.5:0/3496098373 shutdown_connections 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 1 -- 172.21.15.5:0/3496098373 wait complete. 2024-08-18T22:22:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f282b17e000 20 client.5583 trim_cache size 0 max 16384 2024-08-18T22:22:27.656 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:27.656 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:22:27.656 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:22:27.656 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 -- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28000678c0 msgr2=0x7f2800069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28000678c0 0x7f2800069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2810007a60 tx=0x7f2810008040 comp rx=0 tx=0).stop 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 -- 172.21.15.5:0/1869189863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282015f000 msgr2=0x7f28201350a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282015f000 0x7f28201350a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2818009e50 tx=0x7f28180196d0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 -- 172.21.15.5:0/1869189863 shutdown_connections 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28000678c0 0x7f2800069d80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282015f000 0x7f28201350a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2820147dd0 0x7f2820134b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 --2- 172.21.15.5:0/1869189863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f282006c3c0 0x7f282013ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 -- 172.21.15.5:0/1869189863 >> 172.21.15.5:0/1869189863 conn(0x7f28200b65f0 msgr2=0x7f282015e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 -- 172.21.15.5:0/1869189863 shutdown_connections 2024-08-18T22:22:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.651+0000 7f2827c00640 1 -- 172.21.15.5:0/1869189863 wait complete. 2024-08-18T22:22:27.673 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' returned '{'message': '', 'return_code': 0}' 2024-08-18T22:22:27.673 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-08-18T22:22:27.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-08-18T22:22:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f8329e00640 1 Processor -- start 2024-08-18T22:22:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f8329e00640 1 -- start start 2024-08-18T22:22:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f8329e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832415fb80 0x7f83240d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f8329e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83240b5ad0 0x7f832406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f8329e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83240d30b0 con 0x7f8324071550 2024-08-18T22:22:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f8329e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f83240d1eb0 con 0x7f83240b5ad0 2024-08-18T22:22:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f8329e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f83240d1bd0 con 0x7f832415fb80 2024-08-18T22:22:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f831a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83240b5ad0 0x7f832406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f8323400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8324071550 0x7f832409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43094/0 (socket says 172.21.15.5:43094) 2024-08-18T22:22:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f8323400640 1 -- 172.21.15.5:0/812795938 learned_addr learned my addr 172.21.15.5:0/812795938 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f831a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83240b5ad0 0x7f832406fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41866/0 (socket says 172.21.15.5:41866) 2024-08-18T22:22:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f8322a00640 1 --2- 172.21.15.5:0/812795938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832415fb80 0x7f83240d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f831a000640 1 -- 172.21.15.5:0/812795938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832415fb80 msgr2=0x7f83240d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f831a000640 1 --2- 172.21.15.5:0/812795938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832415fb80 0x7f83240d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f831a000640 1 -- 172.21.15.5:0/812795938 >> v1:172.21.15.5:6789/0 conn(0x7f8324071550 legacy=0x7f832409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.815+0000 7f831a000640 1 -- 172.21.15.5:0/812795938 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83240d2dd0 con 0x7f83240b5ad0 2024-08-18T22:22:27.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f831a000640 1 --2- 172.21.15.5:0/812795938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83240b5ad0 0x7f832406fad0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f830c0097c0 tx=0x7f830c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73493d31cdb213a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f8322000640 1 -- 172.21.15.5:0/812795938 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c0b0070 con 0x7f83240b5ad0 2024-08-18T22:22:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f8322000640 1 -- 172.21.15.5:0/812795938 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830c0ab600 con 0x7f83240b5ad0 2024-08-18T22:22:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f8322000640 1 -- 172.21.15.5:0/812795938 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c0ab9d0 con 0x7f83240b5ad0 2024-08-18T22:22:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f8329e00640 1 -- 172.21.15.5:0/812795938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83240b5ad0 msgr2=0x7f832406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f8329e00640 1 --2- 172.21.15.5:0/812795938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83240b5ad0 0x7f832406fad0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f830c0097c0 tx=0x7f830c01c380 comp rx=0 tx=0).stop 2024-08-18T22:22:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f8329e00640 1 -- 172.21.15.5:0/812795938 shutdown_connections 2024-08-18T22:22:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f8329e00640 1 --2- 172.21.15.5:0/812795938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83240b5ad0 0x7f832406fad0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f8329e00640 1 --2- 172.21.15.5:0/812795938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832415fb80 0x7f83240d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f8329e00640 1 -- 172.21.15.5:0/812795938 >> 172.21.15.5:0/812795938 conn(0x7f83240d2180 msgr2=0x7f83240d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f8329e00640 1 -- 172.21.15.5:0/812795938 shutdown_connections 2024-08-18T22:22:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.819+0000 7f8329e00640 1 -- 172.21.15.5:0/812795938 wait complete. 2024-08-18T22:22:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8329e00640 1 Processor -- start 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8329e00640 1 -- start start 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8329e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8324071550 0x7f83241537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8329e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83240b5ad0 0x7f832413d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8329e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832415fb80 0x7f832413dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8329e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f832409b2d0 con 0x7f83240b5ad0 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8329e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f832409b150 con 0x7f8324071550 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8329e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8324071980 con 0x7f832415fb80 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83240b5ad0 0x7f832413d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83240b5ad0 0x7f832413d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41874/0 (socket says 172.21.15.5:41874) 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831a000640 1 -- 172.21.15.5:0/2887266619 learned_addr learned my addr 172.21.15.5:0/2887266619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8323400640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832415fb80 0x7f832413dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8322a00640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8324071550 0x7f83241537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831a000640 1 -- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832415fb80 msgr2=0x7f832413dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831a000640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832415fb80 0x7f832413dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831a000640 1 -- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8324071550 msgr2=0x7f83241537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831a000640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8324071550 0x7f83241537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831a000640 1 -- 172.21.15.5:0/2887266619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8324159080 con 0x7f83240b5ad0 2024-08-18T22:22:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831a000640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83240b5ad0 0x7f832413d720 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f830c019fb0 tx=0x7f830c019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831be00640 1 -- 172.21.15.5:0/2887266619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c0b8020 con 0x7f83240b5ad0 2024-08-18T22:22:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831be00640 1 -- 172.21.15.5:0/2887266619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830c0b4610 con 0x7f83240b5ad0 2024-08-18T22:22:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f831be00640 1 -- 172.21.15.5:0/2887266619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c0b0040 con 0x7f83240b5ad0 2024-08-18T22:22:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8329e00640 1 -- 172.21.15.5:0/2887266619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8324158470 con 0x7f83240b5ad0 2024-08-18T22:22:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.823+0000 7f8329e00640 1 -- 172.21.15.5:0/2887266619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8324158a30 con 0x7f83240b5ad0 2024-08-18T22:22:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.827+0000 7f831be00640 1 -- 172.21.15.5:0/2887266619 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f830c0bb020 con 0x7f83240b5ad0 2024-08-18T22:22:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.827+0000 7f831be00640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83000678c0 0x7f8300069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.827+0000 7f831be00640 1 -- 172.21.15.5:0/2887266619 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f830c11fa30 con 0x7f83240b5ad0 2024-08-18T22:22:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.827+0000 7f832d201000 1 Processor -- start 2024-08-18T22:22:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.827+0000 7f8322a00640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83000678c0 0x7f8300069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.827+0000 7f832d201000 1 -- start start 2024-08-18T22:22:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8322a00640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83000678c0 0x7f8300069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f83240cf5c0 tx=0x7f8314008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x561206913ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56120690db70 0x56120690df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x561206957210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5612067f4580 con 0x561206913900 2024-08-18T22:22:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56120675b340 con 0x56120690db70 2024-08-18T22:22:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5612066f6d90 con 0x56120690e490 2024-08-18T22:22:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8322a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x561206913ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8322a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x561206913ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41882/0 (socket says 172.21.15.5:41882) 2024-08-18T22:22:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8322a00640 1 -- 172.21.15.5:0/2703453699 learned_addr learned my addr 172.21.15.5:0/2703453699 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8323400640 1 --2- 172.21.15.5:0/2703453699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x561206957210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f831a000640 1 --2- 172.21.15.5:0/2703453699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56120690db70 0x56120690df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8322a00640 1 -- 172.21.15.5:0/2703453699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 msgr2=0x561206957210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8322a00640 1 --2- 172.21.15.5:0/2703453699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x561206957210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8322a00640 1 -- 172.21.15.5:0/2703453699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56120690db70 msgr2=0x56120690df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8322a00640 1 --2- 172.21.15.5:0/2703453699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56120690db70 0x56120690df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8322a00640 1 -- 172.21.15.5:0/2703453699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612066fb850 con 0x561206913900 2024-08-18T22:22:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8322a00640 1 --2- 172.21.15.5:0/2703453699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x561206913ce0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f831400f9f0 tx=0x7f8314012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344fdad07c0eaaba server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8313e00640 1 -- 172.21.15.5:0/2703453699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831401b050 con 0x561206913900 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8313e00640 1 -- 172.21.15.5:0/2703453699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8314025070 con 0x561206913900 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f8313e00640 1 -- 172.21.15.5:0/2703453699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314014de0 con 0x561206913900 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 -- 172.21.15.5:0/2703453699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 msgr2=0x561206913ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 --2- 172.21.15.5:0/2703453699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x561206913ce0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f831400f9f0 tx=0x7f8314012000 comp rx=0 tx=0).stop 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 -- 172.21.15.5:0/2703453699 shutdown_connections 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 --2- 172.21.15.5:0/2703453699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x561206957210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 --2- 172.21.15.5:0/2703453699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56120690db70 0x56120690df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 --2- 172.21.15.5:0/2703453699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x561206913ce0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 -- 172.21.15.5:0/2703453699 >> 172.21.15.5:0/2703453699 conn(0x5612069054a0 msgr2=0x56120690c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 -- 172.21.15.5:0/2703453699 shutdown_connections 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 -- 172.21.15.5:0/2703453699 wait complete. 2024-08-18T22:22:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 -- start start 2024-08-18T22:22:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.831+0000 7f832d201000 1 Processor -- start 2024-08-18T22:22:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690db70 0x561206962870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56120690e490 0x561206962db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x5612069632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5612066fce70 con 0x561206913900 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561206757300 con 0x56120690e490 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5612066e0ac0 con 0x56120690db70 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 10 client.0 _ll_register_callbacks cb 0x5612068f9340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8323400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x5612069632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8323400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x5612069632f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41898/0 (socket says 172.21.15.5:41898) 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8323400640 1 -- 172.21.15.5:0/3733652545 learned_addr learned my addr 172.21.15.5:0/3733652545 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8322a00640 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690db70 0x561206962870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f831a000640 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56120690e490 0x561206962db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8323400640 1 -- 172.21.15.5:0/3733652545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690db70 msgr2=0x561206962870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8323400640 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690db70 0x561206962870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8323400640 1 -- 172.21.15.5:0/3733652545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56120690e490 msgr2=0x561206962db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8323400640 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56120690e490 0x561206962db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8323400640 1 -- 172.21.15.5:0/3733652545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120671df40 con 0x561206913900 2024-08-18T22:22:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8323400640 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x5612069632f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f831c011940 tx=0x7f831c011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fba02c3db31880a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8310c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8310c00640 1 -- 172.21.15.5:0/3733652545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c00fa20 con 0x561206913900 2024-08-18T22:22:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8310c00640 1 -- 172.21.15.5:0/3733652545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f831c00fbc0 con 0x561206913900 2024-08-18T22:22:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 1 -- 172.21.15.5:0/3733652545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8314025070 con 0x561206913900 2024-08-18T22:22:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8310c00640 1 -- 172.21.15.5:0/3733652545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f831c00fdc0 con 0x561206913900 2024-08-18T22:22:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 10 client.5598 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 1 -- 172.21.15.5:0/3733652545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5612066f6fe0 con 0x561206913900 2024-08-18T22:22:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8310c00640 1 -- 172.21.15.5:0/3733652545 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8314025070 con 0x561206913900 2024-08-18T22:22:27.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8310c00640 1 -- 172.21.15.5:0/3733652545 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f831c015470 con 0x561206913900 2024-08-18T22:22:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 10 client.5598 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 10 client.5598 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 20 client.5598 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56120696ac40 0x56120696d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 4 client.5598 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 1 -- 172.21.15.5:0/3733652545 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612066f5d60 con 0x56120696ac40 2024-08-18T22:22:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8322a00640 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56120696ac40 0x56120696d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8310c00640 10 client.5598 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8322a00640 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56120696ac40 0x56120696d030 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35169fb06c423446 server_cookie=d66730b2c7c31928 in_seq=0 out_seq=0 2024-08-18T22:22:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8310c00640 1 -- 172.21.15.5:0/3733652545 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612066f5d60 con 0x56120696ac40 2024-08-18T22:22:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f8310c00640 10 client.5598 handle_command_reply: tid=0 2024-08-18T22:22:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.835+0000 7f832d201000 1 client.5598 shutdown 2024-08-18T22:22:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f832d201000 1 -- 172.21.15.5:0/3733652545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 msgr2=0x5612069632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f832d201000 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x5612069632f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f831c011940 tx=0x7f831c011e00 comp rx=0 tx=0).stop 2024-08-18T22:22:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f832d201000 1 -- 172.21.15.5:0/3733652545 shutdown_connections 2024-08-18T22:22:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f832d201000 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56120696ac40 0x56120696d030 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f832d201000 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561206913900 0x5612069632f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f832d201000 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56120690e490 0x561206962db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f832d201000 1 --2- 172.21.15.5:0/3733652545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690db70 0x561206962870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f8310c00640 0 client.5598 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f832d201000 1 -- 172.21.15.5:0/3733652545 >> 172.21.15.5:0/3733652545 conn(0x5612069054a0 msgr2=0x56120690c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f832d201000 1 -- 172.21.15.5:0/3733652545 shutdown_connections 2024-08-18T22:22:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f832d201000 1 -- 172.21.15.5:0/3733652545 wait complete. 2024-08-18T22:22:27.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.839+0000 7f832d201000 20 client.5598 trim_cache size 0 max 16384 2024-08-18T22:22:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f832d201000 1 Processor -- start 2024-08-18T22:22:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f832d201000 1 -- start start 2024-08-18T22:22:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f832d201000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f832d201000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x5612069cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f832d201000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561206913900 0x5612069cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f832d201000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f832406e320 con 0x56120690db70 2024-08-18T22:22:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f832d201000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f832414fe80 con 0x561206913900 2024-08-18T22:22:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f832d201000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f832406dcd0 con 0x56120690e490 2024-08-18T22:22:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f8322a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f8322a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069cad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41906/0 (socket says 172.21.15.5:41906) 2024-08-18T22:22:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f8322a00640 1 -- 172.21.15.5:0/4069376206 learned_addr learned my addr 172.21.15.5:0/4069376206 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f831a000640 1 --2- 172.21.15.5:0/4069376206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x5612069cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f8323400640 1 --2- 172.21.15.5:0/4069376206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561206913900 0x5612069cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f8322a00640 1 -- 172.21.15.5:0/4069376206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 msgr2=0x5612069cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f8322a00640 1 --2- 172.21.15.5:0/4069376206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x5612069cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f8322a00640 1 -- 172.21.15.5:0/4069376206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561206913900 msgr2=0x5612069cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f8322a00640 1 --2- 172.21.15.5:0/4069376206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561206913900 0x5612069cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f8322a00640 1 -- 172.21.15.5:0/4069376206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561206919470 con 0x56120690db70 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.855+0000 7f831a000640 1 --2- 172.21.15.5:0/4069376206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x5612069cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8322a00640 1 --2- 172.21.15.5:0/4069376206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069cad30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f831400f9c0 tx=0x7f8314014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d421dd99a63304f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8313400640 1 -- 172.21.15.5:0/4069376206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831401b050 con 0x56120690db70 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8313400640 1 -- 172.21.15.5:0/4069376206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8314025040 con 0x56120690db70 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8313400640 1 -- 172.21.15.5:0/4069376206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314006e20 con 0x56120690db70 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 -- 172.21.15.5:0/4069376206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 msgr2=0x5612069cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 --2- 172.21.15.5:0/4069376206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069cad30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f831400f9c0 tx=0x7f8314014000 comp rx=0 tx=0).stop 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 -- 172.21.15.5:0/4069376206 shutdown_connections 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 --2- 172.21.15.5:0/4069376206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561206913900 0x5612069cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 --2- 172.21.15.5:0/4069376206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x5612069cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 --2- 172.21.15.5:0/4069376206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069cad30 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 -- 172.21.15.5:0/4069376206 >> 172.21.15.5:0/4069376206 conn(0x5612069054a0 msgr2=0x56120690ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 -- 172.21.15.5:0/4069376206 shutdown_connections 2024-08-18T22:22:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 -- 172.21.15.5:0/4069376206 wait complete. 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 -- start start 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 Processor -- start 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x5612069cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561206913900 0x5612069cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5612067dd7a0 con 0x56120690db70 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56120675f970 con 0x561206913900 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5612068180a0 con 0x56120690e490 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f832d201000 10 client.0 _ll_register_callbacks cb 0x7f831c001d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8322a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8322a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41908/0 (socket says 172.21.15.5:41908) 2024-08-18T22:22:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8322a00640 1 -- 172.21.15.5:0/2148806373 learned_addr learned my addr 172.21.15.5:0/2148806373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f831a000640 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x5612069cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8323400640 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561206913900 0x5612069cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8322a00640 1 -- 172.21.15.5:0/2148806373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 msgr2=0x5612069cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8322a00640 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x5612069cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8322a00640 1 -- 172.21.15.5:0/2148806373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561206913900 msgr2=0x5612069cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8322a00640 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561206913900 0x5612069cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8322a00640 1 -- 172.21.15.5:0/2148806373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612067ddc30 con 0x56120690db70 2024-08-18T22:22:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8323400640 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561206913900 0x5612069cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8322a00640 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069ceb60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8314021000 tx=0x7f8314004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8757e17617c8e47b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.859+0000 7f8310c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8310c00640 1 -- 172.21.15.5:0/2148806373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314005ba0 con 0x56120690db70 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8310c00640 1 -- 172.21.15.5:0/2148806373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8314005d40 con 0x56120690db70 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 -- 172.21.15.5:0/2148806373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8314025040 con 0x56120690db70 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8310c00640 1 -- 172.21.15.5:0/2148806373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f831401b020 con 0x56120690db70 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 10 client.5604 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 -- 172.21.15.5:0/2148806373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5612067b4b20 con 0x56120690db70 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8310c00640 1 -- 172.21.15.5:0/2148806373 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8314025040 con 0x56120690db70 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8310c00640 1 -- 172.21.15.5:0/2148806373 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f8314034070 con 0x56120690db70 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 10 client.5604 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 10 client.5604 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 20 client.5604 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5612069670a0 0x561206967480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 4 client.5604 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-08-18T22:22:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 -- 172.21.15.5:0/2148806373 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x561206768a70 con 0x5612069670a0 2024-08-18T22:22:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f831a000640 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5612069670a0 0x561206967480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f831a000640 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5612069670a0 0x561206967480 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f760ab7979b48d81 server_cookie=47bcf98e70555ee0 in_seq=0 out_seq=0 2024-08-18T22:22:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8310c00640 10 client.5604 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8310c00640 1 -- 172.21.15.5:0/2148806373 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561206768a70 con 0x5612069670a0 2024-08-18T22:22:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8310c00640 10 client.5604 handle_command_reply: tid=0 2024-08-18T22:22:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 client.5604 shutdown 2024-08-18T22:22:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 -- 172.21.15.5:0/2148806373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 msgr2=0x5612069ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069ceb60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8314021000 tx=0x7f8314004740 comp rx=0 tx=0).stop 2024-08-18T22:22:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 -- 172.21.15.5:0/2148806373 shutdown_connections 2024-08-18T22:22:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5612069670a0 0x561206967480 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561206913900 0x5612069cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56120690e490 0x5612069cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 --2- 172.21.15.5:0/2148806373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56120690db70 0x5612069ceb60 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 -- 172.21.15.5:0/2148806373 >> 172.21.15.5:0/2148806373 conn(0x5612069054a0 msgr2=0x56120690f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8310c00640 0 client.5604 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 -- 172.21.15.5:0/2148806373 shutdown_connections 2024-08-18T22:22:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 1 -- 172.21.15.5:0/2148806373 wait complete. 2024-08-18T22:22:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f832d201000 20 client.5604 trim_cache size 0 max 16384 2024-08-18T22:22:27.874 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:22:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "7797be5a-e14b-4f04-95de-10a9d4d8d25a", 2024-08-18T22:22:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:22:27.874 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:27.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 -- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83000678c0 msgr2=0x7f8300069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83000678c0 0x7f8300069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f83240cf5c0 tx=0x7f8314008040 comp rx=0 tx=0).stop 2024-08-18T22:22:27.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 -- 172.21.15.5:0/2887266619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83240b5ad0 msgr2=0x7f832413d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:27.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83240b5ad0 0x7f832413d720 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f830c019fb0 tx=0x7f830c019120 comp rx=0 tx=0).stop 2024-08-18T22:22:27.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 -- 172.21.15.5:0/2887266619 shutdown_connections 2024-08-18T22:22:27.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83000678c0 0x7f8300069d80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f832415fb80 0x7f832413dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83240b5ad0 0x7f832413d720 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 --2- 172.21.15.5:0/2887266619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8324071550 0x7f83241537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:27.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 -- 172.21.15.5:0/2887266619 >> 172.21.15.5:0/2887266619 conn(0x7f83240d2180 msgr2=0x7f83240d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:27.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 -- 172.21.15.5:0/2887266619 shutdown_connections 2024-08-18T22:22:27.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:27.863+0000 7f8329e00640 1 -- 172.21.15.5:0/2887266619 wait complete. 2024-08-18T22:22:27.887 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '7797be5a-e14b-4f04-95de-10a9d4d8d25a', 'mode': 'asynchronous'}' 2024-08-18T22:22:27.887 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-08-18T22:22:27.887 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-08-18T22:22:27.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-08-18T22:22:28.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b8a000640 1 Processor -- start 2024-08-18T22:22:28.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b8a000640 1 -- start start 2024-08-18T22:22:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b8a000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8b8415c180 0x7f8b840cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b8a000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b840cfb00 con 0x7f8b8415c560 2024-08-18T22:22:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b8a000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b8415c9f0 con 0x7f8b8415d4d0 2024-08-18T22:22:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b8a000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8b8415d040 con 0x7f8b8415c180 2024-08-18T22:22:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b82a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8b8415c560 0x7f8b840ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43108/0 (socket says 172.21.15.5:43108) 2024-08-18T22:22:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b82a00640 1 -- 172.21.15.5:0/2475159213 learned_addr learned my addr 172.21.15.5:0/2475159213 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b83400640 1 --2- 172.21.15.5:0/2475159213 >> v2:172.21.15.117:3300/0 conn(0x7f8b8415c180 0x7f8b840cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b82000640 1 -- 172.21.15.5:0/2475159213 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185765396 0 0) 0x7f8b840cfb00 con 0x7f8b8415c560 2024-08-18T22:22:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b82000640 1 -- 172.21.15.5:0/2475159213 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b68003530 con 0x7f8b8415c560 2024-08-18T22:22:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b83400640 1 -- 172.21.15.5:0/2475159213 >> v1:172.21.15.117:6789/0 conn(0x7f8b8415d4d0 legacy=0x7f8b8406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b83400640 1 -- 172.21.15.5:0/2475159213 >> v1:172.21.15.5:6789/0 conn(0x7f8b8415c560 legacy=0x7f8b840ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.027+0000 7f8b83400640 1 -- 172.21.15.5:0/2475159213 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8415ccd0 con 0x7f8b8415c180 2024-08-18T22:22:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b83400640 1 --2- 172.21.15.5:0/2475159213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415c180 0x7f8b840cdf10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8b740097c0 tx=0x7f8b7401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87edfa6b11f17ae7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b82000640 1 -- 172.21.15.5:0/2475159213 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b740ab430 con 0x7f8b8415c180 2024-08-18T22:22:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b82000640 1 -- 172.21.15.5:0/2475159213 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b740b0070 con 0x7f8b8415c180 2024-08-18T22:22:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b82000640 1 -- 172.21.15.5:0/2475159213 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b740ab7d0 con 0x7f8b8415c180 2024-08-18T22:22:28.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b8a000640 1 -- 172.21.15.5:0/2475159213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415c180 msgr2=0x7f8b840cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b8a000640 1 --2- 172.21.15.5:0/2475159213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415c180 0x7f8b840cdf10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8b740097c0 tx=0x7f8b7401c410 comp rx=0 tx=0).stop 2024-08-18T22:22:28.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b8a000640 1 -- 172.21.15.5:0/2475159213 shutdown_connections 2024-08-18T22:22:28.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b8a000640 1 --2- 172.21.15.5:0/2475159213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415c180 0x7f8b840cdf10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b8a000640 1 -- 172.21.15.5:0/2475159213 >> 172.21.15.5:0/2475159213 conn(0x7f8b840b1dc0 msgr2=0x7f8b840b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b8a000640 1 -- 172.21.15.5:0/2475159213 shutdown_connections 2024-08-18T22:22:28.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b8a000640 1 -- 172.21.15.5:0/2475159213 wait complete. 2024-08-18T22:22:28.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.031+0000 7f8b8a000640 1 Processor -- start 2024-08-18T22:22:28.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b8a000640 1 -- start start 2024-08-18T22:22:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b8a000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415c180 0x7f8b8414bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b8a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b8415d4d0 0x7f8b840ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b8a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b840ae800 0x7f8b84157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b8a000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8416a2c0 con 0x7f8b840ae800 2024-08-18T22:22:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b8a000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8416a140 con 0x7f8b8415c180 2024-08-18T22:22:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b8a000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8416a440 con 0x7f8b8415d4d0 2024-08-18T22:22:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b83e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b840ae800 0x7f8b84157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b83e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b840ae800 0x7f8b84157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41910/0 (socket says 172.21.15.5:41910) 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b83e00640 1 -- 172.21.15.5:0/143487683 learned_addr learned my addr 172.21.15.5:0/143487683 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b82a00640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b8415d4d0 0x7f8b840ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b83400640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415c180 0x7f8b8414bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b83e00640 1 -- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b8415d4d0 msgr2=0x7f8b840ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b83e00640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b8415d4d0 0x7f8b840ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b83e00640 1 -- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415c180 msgr2=0x7f8b8414bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b83e00640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415c180 0x7f8b8414bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b83e00640 1 -- 172.21.15.5:0/143487683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b84153cf0 con 0x7f8b840ae800 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b83e00640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b840ae800 0x7f8b84157920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00c7a0 tx=0x7f8b7c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b7b400640 1 -- 172.21.15.5:0/143487683 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c003b80 con 0x7f8b840ae800 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b7b400640 1 -- 172.21.15.5:0/143487683 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c003d20 con 0x7f8b840ae800 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b7b400640 1 -- 172.21.15.5:0/143487683 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00aa90 con 0x7f8b840ae800 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b8a000640 1 -- 172.21.15.5:0/143487683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b84153f60 con 0x7f8b840ae800 2024-08-18T22:22:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.035+0000 7f8b8a000640 1 -- 172.21.15.5:0/143487683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b84154520 con 0x7f8b840ae800 2024-08-18T22:22:28.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b7b400640 1 -- 172.21.15.5:0/143487683 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b7c00ac30 con 0x7f8b840ae800 2024-08-18T22:22:28.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b7b400640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b640678c0 0x7f8b64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b7b400640 1 -- 172.21.15.5:0/143487683 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8b7c085e00 con 0x7f8b840ae800 2024-08-18T22:22:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b83400640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b640678c0 0x7f8b64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b8d4fa000 1 Processor -- start 2024-08-18T22:22:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b8d4fa000 1 -- start start 2024-08-18T22:22:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b83400640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b640678c0 0x7f8b64069d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b740af000 tx=0x7f8b740a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c8b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6c41860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6c42180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6a90740 con 0x55e7f6c8b370 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6a4af40 con 0x55e7f6c8bc90 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e7f6a8c700 con 0x55e7f6c41da0 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b83400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c8b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b83400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c8b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41924/0 (socket says 172.21.15.5:41924) 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b83400640 1 -- 172.21.15.5:0/2088670606 learned_addr learned my addr 172.21.15.5:0/2088670606 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b83400640 1 -- 172.21.15.5:0/2088670606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 msgr2=0x55e7f6c42180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b83400640 1 --2- 172.21.15.5:0/2088670606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6c42180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b83400640 1 -- 172.21.15.5:0/2088670606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 msgr2=0x55e7f6c41860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b82a00640 1 --2- 172.21.15.5:0/2088670606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6c41860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b83400640 1 --2- 172.21.15.5:0/2088670606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6c41860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b83400640 1 -- 172.21.15.5:0/2088670606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f6acb670 con 0x55e7f6c8b370 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b82a00640 1 --2- 172.21.15.5:0/2088670606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6c41860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b83400640 1 --2- 172.21.15.5:0/2088670606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c8b750 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8b740ad040 tx=0x7f8b74004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d6b0691457852a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.039+0000 7f8b6fe00640 1 -- 172.21.15.5:0/2088670606 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b740bb070 con 0x55e7f6c8b370 2024-08-18T22:22:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b6fe00640 1 -- 172.21.15.5:0/2088670606 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b740b0040 con 0x55e7f6c8b370 2024-08-18T22:22:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b6fe00640 1 -- 172.21.15.5:0/2088670606 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74003d70 con 0x55e7f6c8b370 2024-08-18T22:22:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/2088670606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 msgr2=0x55e7f6c8b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/2088670606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c8b750 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8b740ad040 tx=0x7f8b74004740 comp rx=0 tx=0).stop 2024-08-18T22:22:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/2088670606 shutdown_connections 2024-08-18T22:22:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/2088670606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6c42180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/2088670606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6c41860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/2088670606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c8b750 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/2088670606 >> 172.21.15.5:0/2088670606 conn(0x55e7f6c3dd20 msgr2=0x55e7f6c40140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/2088670606 shutdown_connections 2024-08-18T22:22:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/2088670606 wait complete. 2024-08-18T22:22:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 -- start start 2024-08-18T22:22:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 Processor -- start 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6c4cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c4d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6c4d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6a8fa50 con 0x55e7f6c8b370 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6a4d990 con 0x55e7f6c8bc90 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e7f6a140b0 con 0x55e7f6c41da0 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 10 client.0 _ll_register_callbacks cb 0x55e7f6c2ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b82a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c4d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b82a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c4d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41938/0 (socket says 172.21.15.5:41938) 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b82a00640 1 -- 172.21.15.5:0/1491888374 learned_addr learned my addr 172.21.15.5:0/1491888374 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b83400640 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6c4cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b83e00640 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6c4d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b82a00640 1 -- 172.21.15.5:0/1491888374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 msgr2=0x55e7f6c4cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b82a00640 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6c4cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b82a00640 1 -- 172.21.15.5:0/1491888374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 msgr2=0x55e7f6c4d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b82a00640 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6c4d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b82a00640 1 -- 172.21.15.5:0/1491888374 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f6a5ded0 con 0x55e7f6c8b370 2024-08-18T22:22:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b83e00640 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6c4d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b82a00640 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c4d4a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000f70 tx=0x7f8b7000f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e36373799ef15d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b6cc00640 1 -- 172.21.15.5:0/1491888374 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7000fe90 con 0x55e7f6c8b370 2024-08-18T22:22:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b6cc00640 1 -- 172.21.15.5:0/1491888374 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8b70005ad0 con 0x55e7f6c8b370 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/1491888374 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b740b0040 con 0x55e7f6c8b370 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b6cc00640 1 -- 172.21.15.5:0/1491888374 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8b70005cd0 con 0x55e7f6c8b370 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 10 client.5616 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.043+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/1491888374 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e7f6ae8960 con 0x55e7f6c8b370 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b6cc00640 1 -- 172.21.15.5:0/1491888374 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b740b0040 con 0x55e7f6c8b370 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b6cc00640 1 -- 172.21.15.5:0/1491888374 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f8b70023080 con 0x55e7f6c8b370 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 10 client.5616 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 10 client.5616 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 20 client.5616 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55e7f6c4e3f0 0x55e7f6c9d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 4 client.5616 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/1491888374 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7f6a2b210 con 0x55e7f6c4e3f0 2024-08-18T22:22:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b83400640 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55e7f6c4e3f0 0x55e7f6c9d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b83400640 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55e7f6c4e3f0 0x55e7f6c9d630 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7302beaea6602828 server_cookie=135ccdb516176ad5 in_seq=0 out_seq=0 2024-08-18T22:22:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b6cc00640 10 client.5616 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b6cc00640 1 -- 172.21.15.5:0/1491888374 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7f6a2b210 con 0x55e7f6c4e3f0 2024-08-18T22:22:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b6cc00640 10 client.5616 handle_command_reply: tid=0 2024-08-18T22:22:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 client.5616 shutdown 2024-08-18T22:22:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/1491888374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 msgr2=0x55e7f6c4d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c4d4a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000f70 tx=0x7f8b7000f660 comp rx=0 tx=0).stop 2024-08-18T22:22:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/1491888374 shutdown_connections 2024-08-18T22:22:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55e7f6c4e3f0 0x55e7f6c9d630 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6c4d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6c4d4a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/1491888374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6c4cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b6cc00640 0 client.5616 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/1491888374 >> 172.21.15.5:0/1491888374 conn(0x55e7f6c3dd20 msgr2=0x55e7f6c40930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/1491888374 shutdown_connections 2024-08-18T22:22:28.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/1491888374 wait complete. 2024-08-18T22:22:28.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.047+0000 7f8b8d4fa000 20 client.5616 trim_cache size 0 max 16384 2024-08-18T22:22:28.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b8d4fa000 1 Processor -- start 2024-08-18T22:22:28.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b8d4fa000 1 -- start start 2024-08-18T22:22:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6cfb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6cfb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6cfbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6c47a40 con 0x55e7f6c8b370 2024-08-18T22:22:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b842040f0 con 0x55e7f6c8bc90 2024-08-18T22:22:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b84203150 con 0x55e7f6c41da0 2024-08-18T22:22:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b82a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6cfb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b82a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6cfb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41940/0 (socket says 172.21.15.5:41940) 2024-08-18T22:22:28.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b82a00640 1 -- 172.21.15.5:0/2059954389 learned_addr learned my addr 172.21.15.5:0/2059954389 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b83e00640 1 --2- 172.21.15.5:0/2059954389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6cfbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b83400640 1 --2- 172.21.15.5:0/2059954389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6cfb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b82a00640 1 -- 172.21.15.5:0/2059954389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 msgr2=0x55e7f6cfb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b82a00640 1 --2- 172.21.15.5:0/2059954389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6cfb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b82a00640 1 -- 172.21.15.5:0/2059954389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 msgr2=0x55e7f6cfbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b82a00640 1 --2- 172.21.15.5:0/2059954389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6cfbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b82a00640 1 -- 172.21.15.5:0/2059954389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f6a2eb70 con 0x55e7f6c8b370 2024-08-18T22:22:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b82a00640 1 --2- 172.21.15.5:0/2059954389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6cfb670 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8b70001210 tx=0x7f8b70007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e04c4987e30014 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b6f400640 1 -- 172.21.15.5:0/2059954389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700074f0 con 0x55e7f6c8b370 2024-08-18T22:22:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b6f400640 1 -- 172.21.15.5:0/2059954389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b70018070 con 0x55e7f6c8b370 2024-08-18T22:22:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.063+0000 7f8b6f400640 1 -- 172.21.15.5:0/2059954389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7002a3f0 con 0x55e7f6c8b370 2024-08-18T22:22:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/2059954389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 msgr2=0x55e7f6cfb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/2059954389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6cfb670 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8b70001210 tx=0x7f8b70007f90 comp rx=0 tx=0).stop 2024-08-18T22:22:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/2059954389 shutdown_connections 2024-08-18T22:22:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/2059954389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6cfbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/2059954389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6cfb670 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/2059954389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6cfb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/2059954389 >> 172.21.15.5:0/2059954389 conn(0x55e7f6c3dd20 msgr2=0x55e7f6c4c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/2059954389 shutdown_connections 2024-08-18T22:22:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/2059954389 wait complete. 2024-08-18T22:22:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 -- start start 2024-08-18T22:22:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 Processor -- start 2024-08-18T22:22:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6c9fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6ca0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6cbb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8414f670 con 0x55e7f6c8b370 2024-08-18T22:22:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8414f020 con 0x55e7f6c8bc90 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e7f6a8fa50 con 0x55e7f6c41da0 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 10 client.0 _ll_register_callbacks cb 0x7f8b70007ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b82a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6ca0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b82a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6ca0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41956/0 (socket says 172.21.15.5:41956) 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b82a00640 1 -- 172.21.15.5:0/587950696 learned_addr learned my addr 172.21.15.5:0/587950696 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b83e00640 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6cbb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b83400640 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6c9fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b82a00640 1 -- 172.21.15.5:0/587950696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 msgr2=0x55e7f6c9fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b82a00640 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6c9fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b82a00640 1 -- 172.21.15.5:0/587950696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 msgr2=0x55e7f6cbb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b82a00640 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6cbb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b82a00640 1 -- 172.21.15.5:0/587950696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f6a49c60 con 0x55e7f6c8b370 2024-08-18T22:22:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b82a00640 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6ca0310 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8b70011010 tx=0x7f8b70001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba48db2ea13b34dc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b6cc00640 1 -- 172.21.15.5:0/587950696 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70037060 con 0x55e7f6c8b370 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b6cc00640 1 -- 172.21.15.5:0/587950696 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8b70004a00 con 0x55e7f6c8b370 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.067+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/587950696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b70018070 con 0x55e7f6c8b370 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b6cc00640 1 -- 172.21.15.5:0/587950696 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8b7003d050 con 0x55e7f6c8b370 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b8d4fa000 10 client.5622 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/587950696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e7f6a36450 con 0x55e7f6c8b370 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b6cc00640 1 -- 172.21.15.5:0/587950696 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b70018070 con 0x55e7f6c8b370 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b6cc00640 1 -- 172.21.15.5:0/587950696 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f8b70040020 con 0x55e7f6c8b370 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b8d4fa000 10 client.5622 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b8d4fa000 10 client.5622 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b8d4fa000 20 client.5622 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55e7f6cbc280 0x55e7f6cfef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b8d4fa000 4 client.5622 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-08-18T22:22:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/587950696 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x55e7f6a9de70 con 0x55e7f6cbc280 2024-08-18T22:22:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b83400640 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55e7f6cbc280 0x55e7f6cfef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b83400640 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55e7f6cbc280 0x55e7f6cfef60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ddc76af72788ab3 server_cookie=6f4033f203259450 in_seq=0 out_seq=0 2024-08-18T22:22:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.071+0000 7f8b6cc00640 10 client.5622 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b6cc00640 1 -- 172.21.15.5:0/587950696 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e7f6a9de70 con 0x55e7f6cbc280 2024-08-18T22:22:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b6cc00640 10 client.5622 handle_command_reply: tid=0 2024-08-18T22:22:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 1 client.5622 shutdown 2024-08-18T22:22:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/587950696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 msgr2=0x55e7f6ca0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6ca0310 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8b70011010 tx=0x7f8b70001160 comp rx=0 tx=0).stop 2024-08-18T22:22:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/587950696 shutdown_connections 2024-08-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55e7f6cbc280 0x55e7f6cfef60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7f6c8bc90 0x55e7f6cbb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7f6c8b370 0x55e7f6ca0310 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b6cc00640 0 client.5622 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 1 --2- 172.21.15.5:0/587950696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7f6c41da0 0x55e7f6c9fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/587950696 >> 172.21.15.5:0/587950696 conn(0x55e7f6c3dd20 msgr2=0x55e7f6c4cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/587950696 shutdown_connections 2024-08-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 1 -- 172.21.15.5:0/587950696 wait complete. 2024-08-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8d4fa000 20 client.5622 trim_cache size 0 max 16384 2024-08-18T22:22:28.079 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:22:28.080 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 -- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b640678c0 msgr2=0x7f8b64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b640678c0 0x7f8b64069d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b740af000 tx=0x7f8b740a7000 comp rx=0 tx=0).stop 2024-08-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 -- 172.21.15.5:0/143487683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b840ae800 msgr2=0x7f8b84157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b840ae800 0x7f8b84157920 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00c7a0 tx=0x7f8b7c00cc60 comp rx=0 tx=0).stop 2024-08-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 -- 172.21.15.5:0/143487683 shutdown_connections 2024-08-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b640678c0 0x7f8b64069d80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b840ae800 0x7f8b84157920 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b8415d4d0 0x7f8b840ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 --2- 172.21.15.5:0/143487683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b8415c180 0x7f8b8414bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 -- 172.21.15.5:0/143487683 >> 172.21.15.5:0/143487683 conn(0x7f8b840b1dc0 msgr2=0x7f8b840afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 -- 172.21.15.5:0/143487683 shutdown_connections 2024-08-18T22:22:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.075+0000 7f8b8a000640 1 -- 172.21.15.5:0/143487683 wait complete. 2024-08-18T22:22:28.098 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'message': '', 'return_code': 0}' 2024-08-18T22:22:28.098 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-08-18T22:22:28.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-08-18T22:22:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effaf800640 1 Processor -- start 2024-08-18T22:22:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effaf800640 1 -- start start 2024-08-18T22:22:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effaf800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa815c180 0x7effa80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effaf800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7effa815c560 0x7effa80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effaf800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effa815d4d0 0x7effa80ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effaf800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7effa815d040 con 0x7effa815d4d0 2024-08-18T22:22:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effaf800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7effa80cfb00 con 0x7effa815c560 2024-08-18T22:22:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effaf800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effa815c9f0 con 0x7effa815c180 2024-08-18T22:22:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effad800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effa815d4d0 0x7effa80ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effad800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effa815d4d0 0x7effa80ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41968/0 (socket says 172.21.15.5:41968) 2024-08-18T22:22:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effad800640 1 -- 172.21.15.5:0/2693746060 learned_addr learned my addr 172.21.15.5:0/2693746060 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7efface00640 1 --2- 172.21.15.5:0/2693746060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa815c180 0x7effa80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7eff9fe00640 1 --2- 172.21.15.5:0/2693746060 >> v2:172.21.15.117:3300/0 conn(0x7effa815c560 0x7effa80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effad800640 1 -- 172.21.15.5:0/2693746060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa815c180 msgr2=0x7effa80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effad800640 1 --2- 172.21.15.5:0/2693746060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa815c180 0x7effa80cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effad800640 1 -- 172.21.15.5:0/2693746060 >> v2:172.21.15.117:3300/0 conn(0x7effa815c560 msgr2=0x7effa80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effad800640 1 --2- 172.21.15.5:0/2693746060 >> v2:172.21.15.117:3300/0 conn(0x7effa815c560 0x7effa80ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.239+0000 7effad800640 1 -- 172.21.15.5:0/2693746060 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa815ccd0 con 0x7effa815d4d0 2024-08-18T22:22:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effad800640 1 --2- 172.21.15.5:0/2693746060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815d4d0 0x7effa80ce990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7effa806d330 tx=0x7effa001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd495ef662d0f9d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effa7e00640 1 -- 172.21.15.5:0/2693746060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00a5800 con 0x7effa815d4d0 2024-08-18T22:22:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effa7e00640 1 -- 172.21.15.5:0/2693746060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa00a59a0 con 0x7effa815d4d0 2024-08-18T22:22:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effa7e00640 1 -- 172.21.15.5:0/2693746060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00a5d70 con 0x7effa815d4d0 2024-08-18T22:22:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effaf800640 1 -- 172.21.15.5:0/2693746060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815d4d0 msgr2=0x7effa80ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effaf800640 1 --2- 172.21.15.5:0/2693746060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815d4d0 0x7effa80ce990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7effa806d330 tx=0x7effa001c960 comp rx=0 tx=0).stop 2024-08-18T22:22:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effaf800640 1 -- 172.21.15.5:0/2693746060 shutdown_connections 2024-08-18T22:22:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effaf800640 1 --2- 172.21.15.5:0/2693746060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815d4d0 0x7effa80ce990 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effaf800640 1 --2- 172.21.15.5:0/2693746060 >> v2:172.21.15.117:3300/0 conn(0x7effa815c560 0x7effa80ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effaf800640 1 --2- 172.21.15.5:0/2693746060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa815c180 0x7effa80cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effaf800640 1 -- 172.21.15.5:0/2693746060 >> 172.21.15.5:0/2693746060 conn(0x7effa80b1dc0 msgr2=0x7effa80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effaf800640 1 -- 172.21.15.5:0/2693746060 shutdown_connections 2024-08-18T22:22:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effaf800640 1 -- 172.21.15.5:0/2693746060 wait complete. 2024-08-18T22:22:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effaf800640 1 Processor -- start 2024-08-18T22:22:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.243+0000 7effaf800640 1 -- start start 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effaf800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815c180 0x7effa815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effaf800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa815d4d0 0x7effa81401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effaf800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa8159440 0x7effa814efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effaf800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7effa8160930 con 0x7effa815c180 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effaf800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effa81607b0 con 0x7effa815d4d0 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effaf800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effa8160ab0 con 0x7effa8159440 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7efface00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815c180 0x7effa815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7efface00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815c180 0x7effa815a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41980/0 (socket says 172.21.15.5:41980) 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7efface00640 1 -- 172.21.15.5:0/95067770 learned_addr learned my addr 172.21.15.5:0/95067770 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effad800640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa8159440 0x7effa814efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7eff9fe00640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa815d4d0 0x7effa81401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7efface00640 1 -- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa8159440 msgr2=0x7effa814efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7efface00640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa8159440 0x7effa814efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7efface00640 1 -- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa815d4d0 msgr2=0x7effa81401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7efface00640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa815d4d0 0x7effa81401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7efface00640 1 -- 172.21.15.5:0/95067770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa815aa60 con 0x7effa815c180 2024-08-18T22:22:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7efface00640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815c180 0x7effa815a360 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7eff9800d800 tx=0x7eff9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effa5600640 1 -- 172.21.15.5:0/95067770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98018030 con 0x7effa815c180 2024-08-18T22:22:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effa5600640 1 -- 172.21.15.5:0/95067770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff98009640 con 0x7effa815c180 2024-08-18T22:22:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effa5600640 1 -- 172.21.15.5:0/95067770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98009810 con 0x7effa815c180 2024-08-18T22:22:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effaf800640 1 -- 172.21.15.5:0/95067770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa815ad40 con 0x7effa815c180 2024-08-18T22:22:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.247+0000 7effaf800640 1 -- 172.21.15.5:0/95067770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa814ea90 con 0x7effa815c180 2024-08-18T22:22:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effa5600640 1 -- 172.21.15.5:0/95067770 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff9801b070 con 0x7effa815c180 2024-08-18T22:22:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effa5600640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff840678c0 0x7eff84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effa5600640 1 -- 172.21.15.5:0/95067770 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7eff980861a0 con 0x7effa815c180 2024-08-18T22:22:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7eff9fe00640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff840678c0 0x7eff84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effb2d74000 1 Processor -- start 2024-08-18T22:22:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effb2d74000 1 -- start start 2024-08-18T22:22:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7eff9fe00640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff840678c0 0x7eff84069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7effa81518a0 tx=0x7eff90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effb2d74000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a40ca0 0x5588e1a41080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effb2d74000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 0x5588e19f7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effb2d74000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e19f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effb2d74000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5588e18dde80 con 0x5588e19f7690 2024-08-18T22:22:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effb2d74000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5588e1880a60 con 0x5588e1a415c0 2024-08-18T22:22:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effb2d74000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5588e18456e0 con 0x5588e1a40ca0 2024-08-18T22:22:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effad800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e19f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7eff9fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 0x5588e19f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7efface00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a40ca0 0x5588e1a41080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7eff9fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 0x5588e19f7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:36284/0 (socket says 172.21.15.5:36284) 2024-08-18T22:22:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7eff9fe00640 1 -- 172.21.15.5:0/891499673 learned_addr learned my addr 172.21.15.5:0/891499673 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effad800640 1 -- 172.21.15.5:0/891499673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a40ca0 msgr2=0x5588e1a41080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effad800640 1 --2- 172.21.15.5:0/891499673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a40ca0 0x5588e1a41080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effad800640 1 -- 172.21.15.5:0/891499673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 msgr2=0x5588e19f7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effad800640 1 --2- 172.21.15.5:0/891499673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 0x5588e19f7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7effad800640 1 -- 172.21.15.5:0/891499673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588e180c1f0 con 0x5588e19f7690 2024-08-18T22:22:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.251+0000 7eff9fe00640 1 --2- 172.21.15.5:0/891499673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 0x5588e19f7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effad800640 1 --2- 172.21.15.5:0/891499673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e19f7a70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7effa00ab000 tx=0x7effa0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850c6a91502154ee server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7eff9d600640 1 -- 172.21.15.5:0/891499673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00a5800 con 0x5588e19f7690 2024-08-18T22:22:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7eff9d600640 1 -- 172.21.15.5:0/891499673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa00a59a0 con 0x5588e19f7690 2024-08-18T22:22:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7eff9d600640 1 -- 172.21.15.5:0/891499673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00a5d90 con 0x5588e19f7690 2024-08-18T22:22:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 -- 172.21.15.5:0/891499673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 msgr2=0x5588e19f7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 --2- 172.21.15.5:0/891499673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e19f7a70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7effa00ab000 tx=0x7effa0004ac0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 -- 172.21.15.5:0/891499673 shutdown_connections 2024-08-18T22:22:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 --2- 172.21.15.5:0/891499673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e19f7a70 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 --2- 172.21.15.5:0/891499673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 0x5588e19f7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 --2- 172.21.15.5:0/891499673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a40ca0 0x5588e1a41080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 -- 172.21.15.5:0/891499673 >> 172.21.15.5:0/891499673 conn(0x5588e19eea80 msgr2=0x5588e19f5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 -- 172.21.15.5:0/891499673 shutdown_connections 2024-08-18T22:22:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 -- 172.21.15.5:0/891499673 wait complete. 2024-08-18T22:22:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 -- start start 2024-08-18T22:22:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 Processor -- start 2024-08-18T22:22:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a47e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 0x5588e1a48360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a415c0 0x5588e1a488a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5588e18416a0 con 0x5588e19f7690 2024-08-18T22:22:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5588e17e1200 con 0x5588e1a40ca0 2024-08-18T22:22:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5588e1802a50 con 0x5588e1a415c0 2024-08-18T22:22:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effb2d74000 10 client.0 _ll_register_callbacks cb 0x5588e19e29a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7efface00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a47e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7efface00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a47e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41998/0 (socket says 172.21.15.5:41998) 2024-08-18T22:22:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7efface00640 1 -- 172.21.15.5:0/2978808499 learned_addr learned my addr 172.21.15.5:0/2978808499 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7efface00640 1 -- 172.21.15.5:0/2978808499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a415c0 msgr2=0x5588e1a488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7effad800640 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a415c0 0x5588e1a488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7eff9fe00640 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 0x5588e1a48360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7efface00640 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a415c0 0x5588e1a488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7efface00640 1 -- 172.21.15.5:0/2978808499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 msgr2=0x5588e1a48360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7efface00640 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 0x5588e1a48360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7efface00640 1 -- 172.21.15.5:0/2978808499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588e17e1450 con 0x5588e19f7690 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.255+0000 7eff9fe00640 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 0x5588e1a48360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7efface00640 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a47e20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7eff98009490 tx=0x7eff980563e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fed6888771ed5d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff96000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff96000640 1 -- 172.21.15.5:0/2978808499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98082060 con 0x5588e19f7690 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff96000640 1 -- 172.21.15.5:0/2978808499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7eff98054620 con 0x5588e19f7690 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 -- 172.21.15.5:0/2978808499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effa00a59a0 con 0x5588e19f7690 2024-08-18T22:22:28.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff96000640 1 -- 172.21.15.5:0/2978808499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7eff98073050 con 0x5588e19f7690 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 10 client.5634 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 -- 172.21.15.5:0/2978808499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5588e17cd4a0 con 0x5588e19f7690 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff96000640 1 -- 172.21.15.5:0/2978808499 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa00a59a0 con 0x5588e19f7690 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff96000640 1 -- 172.21.15.5:0/2978808499 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7eff98025060 con 0x5588e19f7690 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 10 client.5634 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 10 client.5634 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 20 client.5634 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5588e1a501f0 0x5588e1a525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 4 client.5634 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 -- 172.21.15.5:0/2978808499 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588e17e01d0 con 0x5588e1a501f0 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff9fe00640 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5588e1a501f0 0x5588e1a525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff9fe00640 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5588e1a501f0 0x5588e1a525e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=189ac2de4e750e1 server_cookie=182b9b3ccd0b7114 in_seq=0 out_seq=0 2024-08-18T22:22:28.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff96000640 10 client.5634 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff96000640 1 -- 172.21.15.5:0/2978808499 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5588e17e01d0 con 0x5588e1a501f0 2024-08-18T22:22:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff96000640 10 client.5634 handle_command_reply: tid=0 2024-08-18T22:22:28.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 client.5634 shutdown 2024-08-18T22:22:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 -- 172.21.15.5:0/2978808499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 msgr2=0x5588e1a47e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a47e20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7eff98009490 tx=0x7eff980563e0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 -- 172.21.15.5:0/2978808499 shutdown_connections 2024-08-18T22:22:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5588e1a501f0 0x5588e1a525e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a415c0 0x5588e1a488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 0x5588e1a48360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7eff96000640 0 client.5634 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 --2- 172.21.15.5:0/2978808499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a47e20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 -- 172.21.15.5:0/2978808499 >> 172.21.15.5:0/2978808499 conn(0x5588e19eea80 msgr2=0x5588e19f5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 -- 172.21.15.5:0/2978808499 shutdown_connections 2024-08-18T22:22:28.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 1 -- 172.21.15.5:0/2978808499 wait complete. 2024-08-18T22:22:28.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.259+0000 7effb2d74000 20 client.5634 trim_cache size 0 max 16384 2024-08-18T22:22:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 Processor -- start 2024-08-18T22:22:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 -- start start 2024-08-18T22:22:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e19f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a40ca0 0x5588e19f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 0x5588e1a535f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7effa8203ca0 con 0x5588e19f7690 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effa8202ce0 con 0x5588e1a415c0 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effa81543c0 con 0x5588e1a40ca0 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7efface00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e19f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7efface00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e19f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42000/0 (socket says 172.21.15.5:42000) 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7efface00640 1 -- 172.21.15.5:0/762273075 learned_addr learned my addr 172.21.15.5:0/762273075 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7eff9fe00640 1 --2- 172.21.15.5:0/762273075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a40ca0 0x5588e19f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effad800640 1 --2- 172.21.15.5:0/762273075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 0x5588e1a535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7efface00640 1 -- 172.21.15.5:0/762273075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a40ca0 msgr2=0x5588e19f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7efface00640 1 --2- 172.21.15.5:0/762273075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a40ca0 0x5588e19f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7efface00640 1 -- 172.21.15.5:0/762273075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 msgr2=0x5588e1a535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7efface00640 1 --2- 172.21.15.5:0/762273075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 0x5588e1a535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7efface00640 1 -- 172.21.15.5:0/762273075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588e1810880 con 0x5588e19f7690 2024-08-18T22:22:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effad800640 1 --2- 172.21.15.5:0/762273075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 0x5588e1a535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7efface00640 1 --2- 172.21.15.5:0/762273075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e19f8a30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7eff98055f60 tx=0x7eff9806b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59ff3dd3a0a528e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7eff9cc00640 1 -- 172.21.15.5:0/762273075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98052ad0 con 0x5588e19f7690 2024-08-18T22:22:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7eff9cc00640 1 -- 172.21.15.5:0/762273075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff98054620 con 0x5588e19f7690 2024-08-18T22:22:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7eff9cc00640 1 -- 172.21.15.5:0/762273075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98055770 con 0x5588e19f7690 2024-08-18T22:22:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 -- 172.21.15.5:0/762273075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 msgr2=0x5588e19f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 --2- 172.21.15.5:0/762273075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e19f8a30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7eff98055f60 tx=0x7eff9806b000 comp rx=0 tx=0).stop 2024-08-18T22:22:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 -- 172.21.15.5:0/762273075 shutdown_connections 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 --2- 172.21.15.5:0/762273075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a415c0 0x5588e1a535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 --2- 172.21.15.5:0/762273075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a40ca0 0x5588e19f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 --2- 172.21.15.5:0/762273075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e19f8a30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.279+0000 7effb2d74000 1 -- 172.21.15.5:0/762273075 >> 172.21.15.5:0/762273075 conn(0x5588e19eea80 msgr2=0x5588e19f8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 -- 172.21.15.5:0/762273075 shutdown_connections 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 -- 172.21.15.5:0/762273075 wait complete. 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 -- start start 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 Processor -- start 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 0x5588e1a6f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a415c0 0x5588e1a6fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5588e1849d10 con 0x5588e19f7690 2024-08-18T22:22:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effa8154a10 con 0x5588e1a40ca0 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5588e18039c0 con 0x5588e1a415c0 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 10 client.0 _ll_register_callbacks cb 0x7eff980561e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7efface00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7efface00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42006/0 (socket says 172.21.15.5:42006) 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7efface00640 1 -- 172.21.15.5:0/1364781337 learned_addr learned my addr 172.21.15.5:0/1364781337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7eff9fe00640 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 0x5588e1a6f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effad800640 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a415c0 0x5588e1a6fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7efface00640 1 -- 172.21.15.5:0/1364781337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a415c0 msgr2=0x5588e1a6fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7efface00640 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a415c0 0x5588e1a6fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7efface00640 1 -- 172.21.15.5:0/1364781337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 msgr2=0x5588e1a6f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7efface00640 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 0x5588e1a6f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7efface00640 1 -- 172.21.15.5:0/1364781337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588e18c74d0 con 0x5588e19f7690 2024-08-18T22:22:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7eff9fe00640 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 0x5588e1a6f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7efface00640 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a559d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7eff98000c10 tx=0x7eff98086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bb34801fff6f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7eff96000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7eff96000640 1 -- 172.21.15.5:0/1364781337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98079020 con 0x5588e19f7690 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7eff96000640 1 -- 172.21.15.5:0/1364781337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7eff98055980 con 0x5588e19f7690 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 -- 172.21.15.5:0/1364781337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff98054620 con 0x5588e19f7690 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7eff96000640 1 -- 172.21.15.5:0/1364781337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7eff98052070 con 0x5588e19f7690 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 10 client.5640 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 -- 172.21.15.5:0/1364781337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5588e189e150 con 0x5588e19f7690 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7eff96000640 1 -- 172.21.15.5:0/1364781337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff98054620 con 0x5588e19f7690 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7eff96000640 1 -- 172.21.15.5:0/1364781337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7eff98013050 con 0x5588e19f7690 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 10 client.5640 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 10 client.5640 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 20 client.5640 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5588e1a70390 0x5588e1ab3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 4 client.5640 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-08-18T22:22:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7effb2d74000 1 -- 172.21.15.5:0/1364781337 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x5588e1852e10 con 0x5588e1a70390 2024-08-18T22:22:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.283+0000 7eff9fe00640 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5588e1a70390 0x5588e1ab3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7eff9fe00640 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5588e1a70390 0x5588e1ab3bb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5259eda4529b3a1f server_cookie=247dcc8a6c08669e in_seq=0 out_seq=0 2024-08-18T22:22:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7eff96000640 10 client.5640 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7eff96000640 1 -- 172.21.15.5:0/1364781337 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5588e1852e10 con 0x5588e1a70390 2024-08-18T22:22:28.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7eff96000640 10 client.5640 handle_command_reply: tid=0 2024-08-18T22:22:28.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 1 client.5640 shutdown 2024-08-18T22:22:28.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 1 -- 172.21.15.5:0/1364781337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 msgr2=0x5588e1a559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a559d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7eff98000c10 tx=0x7eff98086040 comp rx=0 tx=0).stop 2024-08-18T22:22:28.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 1 -- 172.21.15.5:0/1364781337 shutdown_connections 2024-08-18T22:22:28.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5588e1a70390 0x5588e1ab3bb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5588e1a415c0 0x5588e1a6fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5588e1a40ca0 0x5588e1a6f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 1 --2- 172.21.15.5:0/1364781337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588e19f7690 0x5588e1a559d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7eff96000640 0 client.5640 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 1 -- 172.21.15.5:0/1364781337 >> 172.21.15.5:0/1364781337 conn(0x5588e19eea80 msgr2=0x5588e19f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 1 -- 172.21.15.5:0/1364781337 shutdown_connections 2024-08-18T22:22:28.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 1 -- 172.21.15.5:0/1364781337 wait complete. 2024-08-18T22:22:28.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effb2d74000 20 client.5640 trim_cache size 0 max 16384 2024-08-18T22:22:28.295 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:22:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "1296ec89-87d6-41b2-8d22-b21de2ef2e51", 2024-08-18T22:22:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:22:28.296 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:28.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 -- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff840678c0 msgr2=0x7eff84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff840678c0 0x7eff84069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7effa81518a0 tx=0x7eff90008040 comp rx=0 tx=0).stop 2024-08-18T22:22:28.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 -- 172.21.15.5:0/95067770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815c180 msgr2=0x7effa815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815c180 0x7effa815a360 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7eff9800d800 tx=0x7eff9800dcc0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 -- 172.21.15.5:0/95067770 shutdown_connections 2024-08-18T22:22:28.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff840678c0 0x7eff84069d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa8159440 0x7effa814efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa815d4d0 0x7effa81401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 --2- 172.21.15.5:0/95067770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effa815c180 0x7effa815a360 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 -- 172.21.15.5:0/95067770 >> 172.21.15.5:0/95067770 conn(0x7effa80b1dc0 msgr2=0x7effa814daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 -- 172.21.15.5:0/95067770 shutdown_connections 2024-08-18T22:22:28.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.287+0000 7effaf800640 1 -- 172.21.15.5:0/95067770 wait complete. 2024-08-18T22:22:28.310 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '1296ec89-87d6-41b2-8d22-b21de2ef2e51', 'mode': 'asynchronous'}' 2024-08-18T22:22:28.310 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-08-18T22:22:28.310 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-08-18T22:22:28.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-08-18T22:22:28.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda7ca00640 1 Processor -- start 2024-08-18T22:22:28.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda7ca00640 1 -- start start 2024-08-18T22:22:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda7ca00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda78144050 0x7fda7806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda7ca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7806f3b0 0x7fda78144430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda7ca00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda7806ddd0 con 0x7fda78147860 2024-08-18T22:22:28.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda7ca00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fda7806db80 con 0x7fda78144050 2024-08-18T22:22:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda7ca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fda7806e9e0 con 0x7fda7806f3b0 2024-08-18T22:22:28.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda76800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fda78147860 0x7fda780b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43124/0 (socket says 172.21.15.5:43124) 2024-08-18T22:22:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda76800640 1 -- 172.21.15.5:0/2163816692 learned_addr learned my addr 172.21.15.5:0/2163816692 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda75e00640 1 --2- 172.21.15.5:0/2163816692 >> v2:172.21.15.117:3300/0 conn(0x7fda78144050 0x7fda7806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda75400640 1 --2- 172.21.15.5:0/2163816692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7806f3b0 0x7fda78144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda74a00640 1 -- 172.21.15.5:0/2163816692 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2526688861 0 0) 0x7fda7806ddd0 con 0x7fda78147860 2024-08-18T22:22:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda75e00640 1 -- 172.21.15.5:0/2163816692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7806f3b0 msgr2=0x7fda78144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda75e00640 1 --2- 172.21.15.5:0/2163816692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7806f3b0 0x7fda78144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda75e00640 1 -- 172.21.15.5:0/2163816692 >> v1:172.21.15.5:6789/0 conn(0x7fda78147860 legacy=0x7fda780b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.451+0000 7fda75e00640 1 -- 172.21.15.5:0/2163816692 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7806e0b0 con 0x7fda78144050 2024-08-18T22:22:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda75e00640 1 --2- 172.21.15.5:0/2163816692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda78144050 0x7fda7806ee70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda68009d90 tx=0x7fda6801c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564fb23f3b4163fd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda74a00640 1 -- 172.21.15.5:0/2163816692 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda680b2070 con 0x7fda78144050 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda74a00640 1 -- 172.21.15.5:0/2163816692 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda680a5970 con 0x7fda78144050 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda74a00640 1 -- 172.21.15.5:0/2163816692 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda680a5d40 con 0x7fda78144050 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda7ca00640 1 -- 172.21.15.5:0/2163816692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda78144050 msgr2=0x7fda7806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda7ca00640 1 --2- 172.21.15.5:0/2163816692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda78144050 0x7fda7806ee70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda68009d90 tx=0x7fda6801c8b0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda7ca00640 1 -- 172.21.15.5:0/2163816692 shutdown_connections 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda7ca00640 1 --2- 172.21.15.5:0/2163816692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda7806f3b0 0x7fda78144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda7ca00640 1 --2- 172.21.15.5:0/2163816692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda78144050 0x7fda7806ee70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda7ca00640 1 -- 172.21.15.5:0/2163816692 >> 172.21.15.5:0/2163816692 conn(0x7fda780b1dc0 msgr2=0x7fda780b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda7ca00640 1 -- 172.21.15.5:0/2163816692 shutdown_connections 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.455+0000 7fda7ca00640 1 -- 172.21.15.5:0/2163816692 wait complete. 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda7ca00640 1 Processor -- start 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda7ca00640 1 -- start start 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda7ca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7806f3b0 0x7fda7815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda7ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78144050 0x7fda78145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda7ca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda78147860 0x7fda781462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda7ca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda780b3950 con 0x7fda78144050 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda7ca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda780b37d0 con 0x7fda7806f3b0 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda7ca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fda78144970 con 0x7fda78147860 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda75400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78144050 0x7fda78145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda75400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78144050 0x7fda78145db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42022/0 (socket says 172.21.15.5:42022) 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda75400640 1 -- 172.21.15.5:0/2996966213 learned_addr learned my addr 172.21.15.5:0/2996966213 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda75e00640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7806f3b0 0x7fda7815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda76800640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda78147860 0x7fda781462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda75400640 1 -- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda78147860 msgr2=0x7fda781462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda75400640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda78147860 0x7fda781462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda75400640 1 -- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7806f3b0 msgr2=0x7fda7815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda75400640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7806f3b0 0x7fda7815d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda75400640 1 -- 172.21.15.5:0/2996966213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7815e2e0 con 0x7fda78144050 2024-08-18T22:22:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda75400640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78144050 0x7fda78145db0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fda6400e840 tx=0x7fda6400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda6e000640 1 -- 172.21.15.5:0/2996966213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64017070 con 0x7fda78144050 2024-08-18T22:22:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda6e000640 1 -- 172.21.15.5:0/2996966213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6400c730 con 0x7fda78144050 2024-08-18T22:22:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda7ca00640 1 -- 172.21.15.5:0/2996966213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7809d940 con 0x7fda78144050 2024-08-18T22:22:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda6e000640 1 -- 172.21.15.5:0/2996966213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6400cb20 con 0x7fda78144050 2024-08-18T22:22:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.459+0000 7fda7ca00640 1 -- 172.21.15.5:0/2996966213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7809df00 con 0x7fda78144050 2024-08-18T22:22:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda6e000640 1 -- 172.21.15.5:0/2996966213 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda6401a070 con 0x7fda78144050 2024-08-18T22:22:28.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda6e000640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda580678c0 0x7fda58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda6e000640 1 -- 172.21.15.5:0/2996966213 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fda64085bf0 con 0x7fda78144050 2024-08-18T22:22:28.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda75e00640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda580678c0 0x7fda58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda7fdf5000 1 Processor -- start 2024-08-18T22:22:28.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda7fdf5000 1 -- start start 2024-08-18T22:22:28.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda75e00640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda580678c0 0x7fda58069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fda680af000 tx=0x7fda680a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c84074250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84074790 0x557c84027560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84027aa0 0x557c84027e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557c83e790f0 con 0x557c84027aa0 2024-08-18T22:22:28.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557c83e151e0 con 0x557c84073e70 2024-08-18T22:22:28.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x557c83e750b0 con 0x557c84074790 2024-08-18T22:22:28.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda76800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84027aa0 0x557c84027e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda76800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84027aa0 0x557c84027e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42028/0 (socket says 172.21.15.5:42028) 2024-08-18T22:22:28.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda75400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84074790 0x557c84027560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda76800640 1 -- 172.21.15.5:0/1350713504 learned_addr learned my addr 172.21.15.5:0/1350713504 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda75e00640 1 --2- 172.21.15.5:0/1350713504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c84074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda75400640 1 -- 172.21.15.5:0/1350713504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 msgr2=0x557c84074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda75400640 1 --2- 172.21.15.5:0/1350713504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c84074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda75400640 1 -- 172.21.15.5:0/1350713504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84027aa0 msgr2=0x557c84027e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda75400640 1 --2- 172.21.15.5:0/1350713504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84027aa0 0x557c84027e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda75400640 1 -- 172.21.15.5:0/1350713504 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c83ebeac0 con 0x557c84074790 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.463+0000 7fda76800640 1 --2- 172.21.15.5:0/1350713504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84027aa0 0x557c84027e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda75400640 1 --2- 172.21.15.5:0/1350713504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84074790 0x557c84027560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fda64083f80 tx=0x7fda6405a240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2821ad0955484c10 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda62a00640 1 -- 172.21.15.5:0/1350713504 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64021040 con 0x557c84074790 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda62a00640 1 -- 172.21.15.5:0/1350713504 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda64054240 con 0x557c84074790 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda62a00640 1 -- 172.21.15.5:0/1350713504 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6400ccc0 con 0x557c84074790 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 -- 172.21.15.5:0/1350713504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84074790 msgr2=0x557c84027560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/1350713504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84074790 0x557c84027560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fda64083f80 tx=0x7fda6405a240 comp rx=0 tx=0).stop 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 -- 172.21.15.5:0/1350713504 shutdown_connections 2024-08-18T22:22:28.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/1350713504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84027aa0 0x557c84027e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/1350713504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84074790 0x557c84027560 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/1350713504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c84074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 -- 172.21.15.5:0/1350713504 >> 172.21.15.5:0/1350713504 conn(0x557c840215b0 msgr2=0x557c84056cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 -- 172.21.15.5:0/1350713504 shutdown_connections 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 -- 172.21.15.5:0/1350713504 wait complete. 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 -- start start 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 Processor -- start 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84027aa0 0x557c8402e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84073e70 0x557c8402e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84074790 0x557c8402ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557c83e1b400 con 0x557c84073e70 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557c83e20b70 con 0x557c84027aa0 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x557c83efb090 con 0x557c84074790 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda7fdf5000 10 client.0 _ll_register_callbacks cb 0x557c840151f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda75400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84073e70 0x557c8402e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda75400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84073e70 0x557c8402e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42044/0 (socket says 172.21.15.5:42044) 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda75400640 1 -- 172.21.15.5:0/3350575098 learned_addr learned my addr 172.21.15.5:0/3350575098 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda75e00640 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84027aa0 0x557c8402e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda76800640 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84074790 0x557c8402ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda75400640 1 -- 172.21.15.5:0/3350575098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84074790 msgr2=0x557c8402ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda75400640 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84074790 0x557c8402ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda75400640 1 -- 172.21.15.5:0/3350575098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84027aa0 msgr2=0x557c8402e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda75400640 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84027aa0 0x557c8402e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda75400640 1 -- 172.21.15.5:0/3350575098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c83e31030 con 0x557c84073e70 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda75400640 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84073e70 0x557c8402e7c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fda6400c520 tx=0x7fda64006d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1af798a47ee170d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda57400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.467+0000 7fda57400640 1 -- 172.21.15.5:0/3350575098 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64074060 con 0x557c84073e70 2024-08-18T22:22:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda57400640 1 -- 172.21.15.5:0/3350575098 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fda64074400 con 0x557c84073e70 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3350575098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda64054240 con 0x557c84073e70 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda57400640 1 -- 172.21.15.5:0/3350575098 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fda64021070 con 0x557c84073e70 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 10 client.5652 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3350575098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x557c83e15430 con 0x557c84073e70 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda57400640 1 -- 172.21.15.5:0/3350575098 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda64054240 con 0x557c84073e70 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda57400640 1 -- 172.21.15.5:0/3350575098 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fda64024060 con 0x557c84073e70 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 10 client.5652 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 10 client.5652 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 20 client.5652 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x557c8402f710 0x557c84086130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 4 client.5652 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3350575098 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c83e14020 con 0x557c8402f710 2024-08-18T22:22:28.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda75e00640 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x557c8402f710 0x557c84086130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda75e00640 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x557c8402f710 0x557c84086130 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0121add88fdcde9 server_cookie=26ff7c5b827d7040 in_seq=0 out_seq=0 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda57400640 10 client.5652 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda57400640 1 -- 172.21.15.5:0/3350575098 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c83e14020 con 0x557c8402f710 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda57400640 10 client.5652 handle_command_reply: tid=0 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 client.5652 shutdown 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3350575098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84073e70 msgr2=0x557c8402e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84073e70 0x557c8402e7c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fda6400c520 tx=0x7fda64006d50 comp rx=0 tx=0).stop 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3350575098 shutdown_connections 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x557c8402f710 0x557c84086130 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84074790 0x557c8402ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c84073e70 0x557c8402e7c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda57400640 0 client.5652 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3350575098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84027aa0 0x557c8402e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3350575098 >> 172.21.15.5:0/3350575098 conn(0x557c840215b0 msgr2=0x557c84056cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3350575098 shutdown_connections 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3350575098 wait complete. 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.471+0000 7fda7fdf5000 20 client.5652 trim_cache size 0 max 16384 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.487+0000 7fda7fdf5000 1 Processor -- start 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.487+0000 7fda7fdf5000 1 -- start start 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.487+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840265e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.487+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84027aa0 0x557c84026b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.487+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c84085130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.487+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda78202aa0 con 0x557c840215b0 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.487+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda780ca290 con 0x557c84073e70 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.487+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fda780cbac0 con 0x557c84027aa0 2024-08-18T22:22:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.487+0000 7fda75e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.487+0000 7fda75e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840265e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42058/0 (socket says 172.21.15.5:42058) 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.487+0000 7fda75e00640 1 -- 172.21.15.5:0/2043834044 learned_addr learned my addr 172.21.15.5:0/2043834044 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda76800640 1 --2- 172.21.15.5:0/2043834044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c84085130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda75400640 1 --2- 172.21.15.5:0/2043834044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84027aa0 0x557c84026b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda75e00640 1 -- 172.21.15.5:0/2043834044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84027aa0 msgr2=0x557c84026b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda75e00640 1 --2- 172.21.15.5:0/2043834044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84027aa0 0x557c84026b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda75e00640 1 -- 172.21.15.5:0/2043834044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 msgr2=0x557c84085130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda75e00640 1 --2- 172.21.15.5:0/2043834044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c84085130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda75e00640 1 -- 172.21.15.5:0/2043834044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c83e463b0 con 0x557c840215b0 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda76800640 1 --2- 172.21.15.5:0/2043834044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c84085130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda75e00640 1 --2- 172.21.15.5:0/2043834044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840265e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fda6801c8f0 tx=0x7fda68004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75e8f7ac4c3e1c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda62000640 1 -- 172.21.15.5:0/2043834044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda680b2040 con 0x557c840215b0 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda62000640 1 -- 172.21.15.5:0/2043834044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda680b95e0 con 0x557c840215b0 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda62000640 1 -- 172.21.15.5:0/2043834044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda680b99b0 con 0x557c840215b0 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 -- 172.21.15.5:0/2043834044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 msgr2=0x557c840265e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/2043834044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840265e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fda6801c8f0 tx=0x7fda68004ac0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 -- 172.21.15.5:0/2043834044 shutdown_connections 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/2043834044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c84085130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/2043834044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84027aa0 0x557c84026b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/2043834044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840265e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 -- 172.21.15.5:0/2043834044 >> 172.21.15.5:0/2043834044 conn(0x557c84057080 msgr2=0x557c84027320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 -- 172.21.15.5:0/2043834044 shutdown_connections 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 -- 172.21.15.5:0/2043834044 wait complete. 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 -- start start 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 Processor -- start 2024-08-18T22:22:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840e7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84027aa0 0x557c840e8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c840e8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557c83e360e0 con 0x557c840215b0 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557c83e82ef0 con 0x557c84073e70 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x557c83e10d20 con 0x557c84027aa0 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda7fdf5000 10 client.0 _ll_register_callbacks cb 0x7fda70007d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda75e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840e7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda75e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840e7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42072/0 (socket says 172.21.15.5:42072) 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda75e00640 1 -- 172.21.15.5:0/3760937949 learned_addr learned my addr 172.21.15.5:0/3760937949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda76800640 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c840e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.491+0000 7fda75400640 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84027aa0 0x557c840e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda75e00640 1 -- 172.21.15.5:0/3760937949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84027aa0 msgr2=0x557c840e8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda75e00640 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84027aa0 0x557c840e8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda75e00640 1 -- 172.21.15.5:0/3760937949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 msgr2=0x557c840e8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda75e00640 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c840e8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda75e00640 1 -- 172.21.15.5:0/3760937949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c83efb520 con 0x557c840215b0 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda75e00640 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840e7ce0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fda68098490 tx=0x7fda6801b0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fae79b870b8fafb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda57400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda57400640 1 -- 172.21.15.5:0/3760937949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda680b2040 con 0x557c840215b0 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda57400640 1 -- 172.21.15.5:0/3760937949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fda680dbc50 con 0x557c840215b0 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3760937949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda680b95e0 con 0x557c840215b0 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda57400640 1 -- 172.21.15.5:0/3760937949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fda680dbe50 con 0x557c840215b0 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda7fdf5000 10 client.5658 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3760937949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x557c83e1f720 con 0x557c840215b0 2024-08-18T22:22:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda57400640 1 -- 172.21.15.5:0/3760937949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda680b95e0 con 0x557c840215b0 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda57400640 1 -- 172.21.15.5:0/3760937949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fda680b98d0 con 0x557c840215b0 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda7fdf5000 10 client.5658 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda7fdf5000 10 client.5658 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda7fdf5000 20 client.5658 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x557c84074790 0x557c840888d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda7fdf5000 4 client.5658 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3760937949 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x557c84057460 con 0x557c84074790 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda75400640 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x557c84074790 0x557c840888d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda75400640 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x557c84074790 0x557c840888d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21c81b9c29f9750b server_cookie=a9b5a3960139c6a1 in_seq=0 out_seq=0 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.495+0000 7fda57400640 10 client.5658 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda57400640 1 -- 172.21.15.5:0/3760937949 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557c84057460 con 0x557c84074790 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda57400640 10 client.5658 handle_command_reply: tid=0 2024-08-18T22:22:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 1 client.5658 shutdown 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3760937949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 msgr2=0x557c840e7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840e7ce0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fda68098490 tx=0x7fda6801b0f0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3760937949 shutdown_connections 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x557c84074790 0x557c840888d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557c84073e70 0x557c840e8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557c84027aa0 0x557c840e8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda57400640 0 client.5658 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 1 --2- 172.21.15.5:0/3760937949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557c840215b0 0x557c840e7ce0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3760937949 >> 172.21.15.5:0/3760937949 conn(0x557c84057080 msgr2=0x557c84026e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3760937949 shutdown_connections 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 1 -- 172.21.15.5:0/3760937949 wait complete. 2024-08-18T22:22:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7fdf5000 20 client.5658 trim_cache size 0 max 16384 2024-08-18T22:22:28.545 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:28.545 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:22:28.545 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:22:28.545 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 -- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda580678c0 msgr2=0x7fda58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda580678c0 0x7fda58069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fda680af000 tx=0x7fda680a7070 comp rx=0 tx=0).stop 2024-08-18T22:22:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 -- 172.21.15.5:0/2996966213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78144050 msgr2=0x7fda78145db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78144050 0x7fda78145db0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fda6400e840 tx=0x7fda6400ed00 comp rx=0 tx=0).stop 2024-08-18T22:22:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 -- 172.21.15.5:0/2996966213 shutdown_connections 2024-08-18T22:22:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda580678c0 0x7fda58069d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda78147860 0x7fda781462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78144050 0x7fda78145db0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 --2- 172.21.15.5:0/2996966213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda7806f3b0 0x7fda7815d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 -- 172.21.15.5:0/2996966213 >> 172.21.15.5:0/2996966213 conn(0x7fda780b1dc0 msgr2=0x7fda780afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 -- 172.21.15.5:0/2996966213 shutdown_connections 2024-08-18T22:22:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.499+0000 7fda7ca00640 1 -- 172.21.15.5:0/2996966213 wait complete. 2024-08-18T22:22:28.547 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-08-18T22:22:28.548 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-08-18T22:22:28.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-08-18T22:22:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.687+0000 7fdbe0e00640 1 Processor -- start 2024-08-18T22:22:28.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.687+0000 7fdbe0e00640 1 -- start start 2024-08-18T22:22:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.691+0000 7fdbe0e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdbdc15b0c0 0x7fdbdc06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.691+0000 7fdbe0e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbdc0b31f0 con 0x7fdbdc0cf290 2024-08-18T22:22:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.691+0000 7fdbe0e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbdc0b34d0 con 0x7fdbdc0b40c0 2024-08-18T22:22:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.691+0000 7fdbe0e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdbdc0b3d70 con 0x7fdbdc15b0c0 2024-08-18T22:22:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.691+0000 7fdbd9e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdbdc15b0c0 0x7fdbdc06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.691+0000 7fdbda800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdbdc0cf290 0x7fdbdc073140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43138/0 (socket says 172.21.15.5:43138) 2024-08-18T22:22:28.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.691+0000 7fdbda800640 1 -- 172.21.15.5:0/3020298445 learned_addr learned my addr 172.21.15.5:0/3020298445 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:28.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.691+0000 7fdbd9e00640 1 -- 172.21.15.5:0/3020298445 >> v1:172.21.15.117:6789/0 conn(0x7fdbdc0b40c0 legacy=0x7fdbdc072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.691+0000 7fdbd8a00640 1 -- 172.21.15.5:0/3020298445 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4126175685 0 0) 0x7fdbdc0b31f0 con 0x7fdbdc0cf290 2024-08-18T22:22:28.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.691+0000 7fdbd9e00640 1 -- 172.21.15.5:0/3020298445 >> v1:172.21.15.5:6789/0 conn(0x7fdbdc0cf290 legacy=0x7fdbdc073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.691+0000 7fdbd9e00640 1 -- 172.21.15.5:0/3020298445 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc0b37b0 con 0x7fdbdc15b0c0 2024-08-18T22:22:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/3020298445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc15b0c0 0x7fdbdc06db80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0097c0 tx=0x7fdbcc01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f64ca3926a0502a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbd8a00640 1 -- 172.21.15.5:0/3020298445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0b0070 con 0x7fdbdc15b0c0 2024-08-18T22:22:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbd8a00640 1 -- 172.21.15.5:0/3020298445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc0ab600 con 0x7fdbdc15b0c0 2024-08-18T22:22:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbd8a00640 1 -- 172.21.15.5:0/3020298445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0ab9d0 con 0x7fdbdc15b0c0 2024-08-18T22:22:28.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 -- 172.21.15.5:0/3020298445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc15b0c0 msgr2=0x7fdbdc06db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 --2- 172.21.15.5:0/3020298445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc15b0c0 0x7fdbdc06db80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0097c0 tx=0x7fdbcc01c350 comp rx=0 tx=0).stop 2024-08-18T22:22:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 -- 172.21.15.5:0/3020298445 shutdown_connections 2024-08-18T22:22:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 --2- 172.21.15.5:0/3020298445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc15b0c0 0x7fdbdc06db80 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 -- 172.21.15.5:0/3020298445 >> 172.21.15.5:0/3020298445 conn(0x7fdbdc0b1dc0 msgr2=0x7fdbdc0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 -- 172.21.15.5:0/3020298445 shutdown_connections 2024-08-18T22:22:28.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 -- 172.21.15.5:0/3020298445 wait complete. 2024-08-18T22:22:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 Processor -- start 2024-08-18T22:22:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 -- start start 2024-08-18T22:22:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0b40c0 0x7fdbdc158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbdc15b0c0 0x7fdbdc15b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc0b48e0 con 0x7fdbdc0cf290 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc15b4a0 con 0x7fdbdc15b0c0 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.695+0000 7fdbe0e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdbdc14b780 con 0x7fdbdc0b40c0 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42084/0 (socket says 172.21.15.5:42084) 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd9400640 1 -- 172.21.15.5:0/318197383 learned_addr learned my addr 172.21.15.5:0/318197383 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0b40c0 0x7fdbdc158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbda800640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbdc15b0c0 0x7fdbdc15b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd9400640 1 -- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0b40c0 msgr2=0x7fdbdc158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd9400640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0b40c0 0x7fdbdc158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd9400640 1 -- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbdc15b0c0 msgr2=0x7fdbdc15b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd9400640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbdc15b0c0 0x7fdbdc15b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd9400640 1 -- 172.21.15.5:0/318197383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc14fab0 con 0x7fdbdc0cf290 2024-08-18T22:22:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd9400640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc157240 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800c420 tx=0x7fdbc800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd2000640 1 -- 172.21.15.5:0/318197383 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80052d0 con 0x7fdbdc0cf290 2024-08-18T22:22:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd2000640 1 -- 172.21.15.5:0/318197383 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc8005470 con 0x7fdbdc0cf290 2024-08-18T22:22:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd2000640 1 -- 172.21.15.5:0/318197383 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8007260 con 0x7fdbdc0cf290 2024-08-18T22:22:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbe0e00640 1 -- 172.21.15.5:0/318197383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbdc14fd90 con 0x7fdbdc0cf290 2024-08-18T22:22:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbe0e00640 1 -- 172.21.15.5:0/318197383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbdc150350 con 0x7fdbdc0cf290 2024-08-18T22:22:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd2000640 1 -- 172.21.15.5:0/318197383 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdbc8007400 con 0x7fdbdc0cf290 2024-08-18T22:22:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.699+0000 7fdbd2000640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbbc0678c0 0x7fdbbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd2000640 1 -- 172.21.15.5:0/318197383 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fdbc8085240 con 0x7fdbdc0cf290 2024-08-18T22:22:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbbc0678c0 0x7fdbbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 Processor -- start 2024-08-18T22:22:28.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 -- start start 2024-08-18T22:22:28.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbbc0678c0 0x7fdbbc069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0ad000 tx=0x7fdbcc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479ee400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee940 0x55db479a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db479a2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55db477f2520 con 0x55db479ee020 2024-08-18T22:22:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55db477acb80 con 0x55db479a1c20 2024-08-18T22:22:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55db477ee4e0 con 0x55db479ee940 2024-08-18T22:22:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479ee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479ee400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42090/0 (socket says 172.21.15.5:42090) 2024-08-18T22:22:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9e00640 1 -- 172.21.15.5:0/2926436875 learned_addr learned my addr 172.21.15.5:0/2926436875 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbda800640 1 --2- 172.21.15.5:0/2926436875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db479a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9400640 1 --2- 172.21.15.5:0/2926436875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee940 0x55db479a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9e00640 1 -- 172.21.15.5:0/2926436875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee940 msgr2=0x55db479a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/2926436875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee940 0x55db479a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9e00640 1 -- 172.21.15.5:0/2926436875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 msgr2=0x55db479a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/2926436875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db479a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9e00640 1 -- 172.21.15.5:0/2926436875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db47792ac0 con 0x55db479ee020 2024-08-18T22:22:28.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/2926436875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479ee400 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0ae040 tx=0x7fdbcc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b04faff3c2ab0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbc6a00640 1 -- 172.21.15.5:0/2926436875 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0b0040 con 0x55db479ee020 2024-08-18T22:22:28.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbc6a00640 1 -- 172.21.15.5:0/2926436875 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc0b1040 con 0x55db479ee020 2024-08-18T22:22:28.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbc6a00640 1 -- 172.21.15.5:0/2926436875 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0c3610 con 0x55db479ee020 2024-08-18T22:22:28.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2926436875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 msgr2=0x55db479ee400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/2926436875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479ee400 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0ae040 tx=0x7fdbcc004740 comp rx=0 tx=0).stop 2024-08-18T22:22:28.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2926436875 shutdown_connections 2024-08-18T22:22:28.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/2926436875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db479a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/2926436875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee940 0x55db479a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/2926436875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479ee400 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2926436875 >> 172.21.15.5:0/2926436875 conn(0x55db4799b730 msgr2=0x55db479d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2926436875 shutdown_connections 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.703+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2926436875 wait complete. 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 -- start start 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 Processor -- start 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db479a84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee940 0x55db479a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55db477bd820 con 0x55db479ee020 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55db47793d30 con 0x55db479a1c20 2024-08-18T22:22:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55db478731e0 con 0x55db479ee940 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 10 client.0 _ll_register_callbacks cb 0x55db4798f190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbd9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbd9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479a8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42102/0 (socket says 172.21.15.5:42102) 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbd9400640 1 -- 172.21.15.5:0/2065116343 learned_addr learned my addr 172.21.15.5:0/2065116343 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db479a84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbda800640 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee940 0x55db479a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbd9400640 1 -- 172.21.15.5:0/2065116343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee940 msgr2=0x55db479a8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbd9400640 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee940 0x55db479a8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbd9400640 1 -- 172.21.15.5:0/2065116343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 msgr2=0x55db479a84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbd9400640 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db479a84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbd9400640 1 -- 172.21.15.5:0/2065116343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db477ab090 con 0x55db479ee020 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbda800640 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee940 0x55db479a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbd9400640 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479a8a20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdbc805dc10 tx=0x7fdbc8055610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c593348b708415e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbbb400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbbb400640 1 -- 172.21.15.5:0/2065116343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8054a60 con 0x55db479ee020 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbbb400640 1 -- 172.21.15.5:0/2065116343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fdbc8054c00 con 0x55db479ee020 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2065116343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbcc0b1040 con 0x55db479ee020 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbbb400640 1 -- 172.21.15.5:0/2065116343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdbc8083050 con 0x55db479ee020 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 10 client.5673 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2065116343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55db477bef80 con 0x55db479ee020 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbbb400640 1 -- 172.21.15.5:0/2065116343 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc0b1040 con 0x55db479ee020 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbbb400640 1 -- 172.21.15.5:0/2065116343 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fdbc80831f0 con 0x55db479ee020 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 10 client.5673 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 10 client.5673 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 20 client.5673 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55db479a9970 0x55db47a000d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 4 client.5673 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2065116343 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db4778ce40 con 0x55db479a9970 2024-08-18T22:22:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.707+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55db479a9970 0x55db47a000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55db479a9970 0x55db47a000d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77a2e024edc97ca8 server_cookie=9834e715918d3462 in_seq=0 out_seq=0 2024-08-18T22:22:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbbb400640 10 client.5673 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbbb400640 1 -- 172.21.15.5:0/2065116343 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db4778ce40 con 0x55db479a9970 2024-08-18T22:22:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbbb400640 10 client.5673 handle_command_reply: tid=0 2024-08-18T22:22:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 1 client.5673 shutdown 2024-08-18T22:22:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2065116343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 msgr2=0x55db479a8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479a8a20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdbc805dc10 tx=0x7fdbc8055610 comp rx=0 tx=0).stop 2024-08-18T22:22:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2065116343 shutdown_connections 2024-08-18T22:22:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55db479a9970 0x55db47a000d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee940 0x55db479a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db479a8a20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/2065116343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db479a84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbbb400640 0 client.5673 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2065116343 >> 172.21.15.5:0/2065116343 conn(0x55db4799b730 msgr2=0x55db479d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2065116343 shutdown_connections 2024-08-18T22:22:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 1 -- 172.21.15.5:0/2065116343 wait complete. 2024-08-18T22:22:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.711+0000 7fdbe42a4000 20 client.5673 trim_cache size 0 max 16384 2024-08-18T22:22:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.727+0000 7fdbe42a4000 1 Processor -- start 2024-08-18T22:22:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.727+0000 7fdbe42a4000 1 -- start start 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db4799b730 0x55db47a5e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db47a5e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee020 0x55db47a5ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc203e00 con 0x55db4799b730 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc202ec0 con 0x55db479a1c20 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdbdc14da70 con 0x55db479ee020 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbd9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db4799b730 0x55db47a5e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbd9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db4799b730 0x55db47a5e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42104/0 (socket says 172.21.15.5:42104) 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbd9e00640 1 -- 172.21.15.5:0/930948124 learned_addr learned my addr 172.21.15.5:0/930948124 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbda800640 1 --2- 172.21.15.5:0/930948124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee020 0x55db47a5ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbd9400640 1 --2- 172.21.15.5:0/930948124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db47a5e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbd9e00640 1 -- 172.21.15.5:0/930948124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee020 msgr2=0x55db47a5ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/930948124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee020 0x55db47a5ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbd9e00640 1 -- 172.21.15.5:0/930948124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 msgr2=0x55db47a5e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/930948124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db47a5e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbd9e00640 1 -- 172.21.15.5:0/930948124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db47873670 con 0x55db4799b730 2024-08-18T22:22:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/930948124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db4799b730 0x55db47a5e210 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0ae040 tx=0x7fdbcc0b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573fcb00dd539162 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbc6000640 1 -- 172.21.15.5:0/930948124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0b0040 con 0x55db4799b730 2024-08-18T22:22:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbc6000640 1 -- 172.21.15.5:0/930948124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc0c3750 con 0x55db4799b730 2024-08-18T22:22:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbc6000640 1 -- 172.21.15.5:0/930948124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0c3b00 con 0x55db4799b730 2024-08-18T22:22:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- 172.21.15.5:0/930948124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db4799b730 msgr2=0x55db47a5e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/930948124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db4799b730 0x55db47a5e210 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0ae040 tx=0x7fdbcc0b6000 comp rx=0 tx=0).stop 2024-08-18T22:22:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- 172.21.15.5:0/930948124 shutdown_connections 2024-08-18T22:22:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/930948124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479ee020 0x55db47a5ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/930948124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db479a1c20 0x55db47a5e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/930948124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db4799b730 0x55db47a5e210 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- 172.21.15.5:0/930948124 >> 172.21.15.5:0/930948124 conn(0x55db479d13e0 msgr2=0x55db479a0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- 172.21.15.5:0/930948124 shutdown_connections 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- 172.21.15.5:0/930948124 wait complete. 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- start start 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 Processor -- start 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db4799b730 0x55db47a621d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479a1c20 0x55db47a62710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db47a62c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55db47799ac0 con 0x55db479ee020 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc14afc0 con 0x55db4799b730 2024-08-18T22:22:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.731+0000 7fdbe42a4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55db477f1830 con 0x55db479a1c20 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 10 client.0 _ll_register_callbacks cb 0x7fdbcc0ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbda800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db47a62c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbda800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db47a62c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42120/0 (socket says 172.21.15.5:42120) 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbda800640 1 -- 172.21.15.5:0/1295807182 learned_addr learned my addr 172.21.15.5:0/1295807182 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db4799b730 0x55db47a621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbd9400640 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479a1c20 0x55db47a62710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbda800640 1 -- 172.21.15.5:0/1295807182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479a1c20 msgr2=0x55db47a62710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbda800640 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479a1c20 0x55db47a62710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbda800640 1 -- 172.21.15.5:0/1295807182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db4799b730 msgr2=0x55db47a621d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbda800640 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db4799b730 0x55db47a621d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbda800640 1 -- 172.21.15.5:0/1295807182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db47785d00 con 0x55db479ee020 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbda800640 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db47a62c50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40073d0 tx=0x7fdbd4007890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9682d6e175c9e79d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbbb400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbbb400640 1 -- 172.21.15.5:0/1295807182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd401b070 con 0x55db479ee020 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 -- 172.21.15.5:0/1295807182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbcc0c3750 con 0x55db479ee020 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbbb400640 1 -- 172.21.15.5:0/1295807182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fdbd40158b0 con 0x55db479ee020 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbbb400640 1 -- 172.21.15.5:0/1295807182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdbd4026050 con 0x55db479ee020 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 10 client.5679 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 -- 172.21.15.5:0/1295807182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55db47798350 con 0x55db479ee020 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbbb400640 1 -- 172.21.15.5:0/1295807182 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc0c3750 con 0x55db479ee020 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbbb400640 1 -- 172.21.15.5:0/1295807182 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fdbd4015ab0 con 0x55db479ee020 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 10 client.5679 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 10 client.5679 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 20 client.5679 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55db479ee940 0x55db47a1dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 4 client.5679 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-08-18T22:22:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 -- 172.21.15.5:0/1295807182 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x55db477ffc50 con 0x55db479ee940 2024-08-18T22:22:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55db479ee940 0x55db47a1dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbd9e00640 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55db479ee940 0x55db47a1dc80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6658834e60c88fc5 server_cookie=55fdc6ad38079575 in_seq=0 out_seq=0 2024-08-18T22:22:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbbb400640 10 client.5679 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbbb400640 1 -- 172.21.15.5:0/1295807182 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55db477ffc50 con 0x55db479ee940 2024-08-18T22:22:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbbb400640 10 client.5679 handle_command_reply: tid=0 2024-08-18T22:22:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 client.5679 shutdown 2024-08-18T22:22:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 -- 172.21.15.5:0/1295807182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 msgr2=0x55db47a62c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db47a62c50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40073d0 tx=0x7fdbd4007890 comp rx=0 tx=0).stop 2024-08-18T22:22:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 -- 172.21.15.5:0/1295807182 shutdown_connections 2024-08-18T22:22:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55db479ee940 0x55db47a1dc80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db479ee020 0x55db47a62c50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55db479a1c20 0x55db47a62710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 --2- 172.21.15.5:0/1295807182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55db4799b730 0x55db47a621d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbbb400640 0 client.5679 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 -- 172.21.15.5:0/1295807182 >> 172.21.15.5:0/1295807182 conn(0x55db479d13e0 msgr2=0x55db479fb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 -- 172.21.15.5:0/1295807182 shutdown_connections 2024-08-18T22:22:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 1 -- 172.21.15.5:0/1295807182 wait complete. 2024-08-18T22:22:28.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.735+0000 7fdbe42a4000 20 client.5679 trim_cache size 0 max 16384 2024-08-18T22:22:28.746 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:28.746 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:22:28.746 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "979534e0-9382-4046-bb9d-ac4440c7bc1d", 2024-08-18T22:22:28.746 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:22:28.746 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 -- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbbc0678c0 msgr2=0x7fdbbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbbc0678c0 0x7fdbbc069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0ad000 tx=0x7fdbcc0a6000 comp rx=0 tx=0).stop 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 -- 172.21.15.5:0/318197383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0cf290 msgr2=0x7fdbdc157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc157240 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800c420 tx=0x7fdbc800c8e0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 -- 172.21.15.5:0/318197383 shutdown_connections 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbbc0678c0 0x7fdbbc069d80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbdc15b0c0 0x7fdbdc15b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc157240 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 --2- 172.21.15.5:0/318197383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbdc0b40c0 0x7fdbdc158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 -- 172.21.15.5:0/318197383 >> 172.21.15.5:0/318197383 conn(0x7fdbdc0b1dc0 msgr2=0x7fdbdc073140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 -- 172.21.15.5:0/318197383 shutdown_connections 2024-08-18T22:22:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.739+0000 7fdbe0e00640 1 -- 172.21.15.5:0/318197383 wait complete. 2024-08-18T22:22:28.765 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '979534e0-9382-4046-bb9d-ac4440c7bc1d', 'mode': 'asynchronous'}' 2024-08-18T22:22:28.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:28.765 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-08-18T22:22:28.777 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-08-18T22:22:28.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-08-18T22:22:28.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a4bc00640 1 Processor -- start 2024-08-18T22:22:28.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a4bc00640 1 -- start start 2024-08-18T22:22:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a4bc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4415c180 0x7f0a440cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a4bc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0a4415c560 0x7f0a440ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a4bc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a4415d4d0 0x7f0a440ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a4bc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0a4415d040 con 0x7f0a4415d4d0 2024-08-18T22:22:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a4bc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0a440cfb00 con 0x7f0a4415c560 2024-08-18T22:22:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a4bc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0a4415c9f0 con 0x7f0a4415c180 2024-08-18T22:22:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a49c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a4415d4d0 0x7f0a440ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a49c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a4415d4d0 0x7f0a440ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42132/0 (socket says 172.21.15.5:42132) 2024-08-18T22:22:28.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a49c00640 1 -- 172.21.15.5:0/218757487 learned_addr learned my addr 172.21.15.5:0/218757487 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a3be00640 1 --2- 172.21.15.5:0/218757487 >> v2:172.21.15.117:3300/0 conn(0x7f0a4415c560 0x7f0a440ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a49200640 1 --2- 172.21.15.5:0/218757487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4415c180 0x7f0a440cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a49c00640 1 -- 172.21.15.5:0/218757487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4415c180 msgr2=0x7f0a440cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a49c00640 1 --2- 172.21.15.5:0/218757487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4415c180 0x7f0a440cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a49c00640 1 -- 172.21.15.5:0/218757487 >> v2:172.21.15.117:3300/0 conn(0x7f0a4415c560 msgr2=0x7f0a440ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a49c00640 1 --2- 172.21.15.5:0/218757487 >> v2:172.21.15.117:3300/0 conn(0x7f0a4415c560 0x7f0a440ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a49c00640 1 -- 172.21.15.5:0/218757487 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4415ccd0 con 0x7f0a4415d4d0 2024-08-18T22:22:28.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.959+0000 7f0a49200640 1 --2- 172.21.15.5:0/218757487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4415c180 0x7f0a440cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a49c00640 1 --2- 172.21.15.5:0/218757487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a4415d4d0 0x7f0a440ce990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0a4406d330 tx=0x7f0a3c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98d3f8aaa5beed3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a43e00640 1 -- 172.21.15.5:0/218757487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0a5800 con 0x7f0a4415d4d0 2024-08-18T22:22:28.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a43e00640 1 -- 172.21.15.5:0/218757487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3c0a59a0 con 0x7f0a4415d4d0 2024-08-18T22:22:28.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a43e00640 1 -- 172.21.15.5:0/218757487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0a5d70 con 0x7f0a4415d4d0 2024-08-18T22:22:28.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a4bc00640 1 -- 172.21.15.5:0/218757487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a4415d4d0 msgr2=0x7f0a440ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a4bc00640 1 --2- 172.21.15.5:0/218757487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a4415d4d0 0x7f0a440ce990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0a4406d330 tx=0x7f0a3c01c960 comp rx=0 tx=0).stop 2024-08-18T22:22:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a4bc00640 1 -- 172.21.15.5:0/218757487 shutdown_connections 2024-08-18T22:22:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a4bc00640 1 --2- 172.21.15.5:0/218757487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a4415d4d0 0x7f0a440ce990 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a4bc00640 1 --2- 172.21.15.5:0/218757487 >> v2:172.21.15.117:3300/0 conn(0x7f0a4415c560 0x7f0a440ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a4bc00640 1 --2- 172.21.15.5:0/218757487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4415c180 0x7f0a440cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a4bc00640 1 -- 172.21.15.5:0/218757487 >> 172.21.15.5:0/218757487 conn(0x7f0a440b1dc0 msgr2=0x7f0a440b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a4bc00640 1 -- 172.21.15.5:0/218757487 shutdown_connections 2024-08-18T22:22:28.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.963+0000 7f0a4bc00640 1 -- 172.21.15.5:0/218757487 wait complete. 2024-08-18T22:22:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a4bc00640 1 Processor -- start 2024-08-18T22:22:28.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a4bc00640 1 -- start start 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a4bc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4415c180 0x7f0a441540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a4bc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a4415d4d0 0x7f0a44158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a4bc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a44159350 0x7f0a4415ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a4bc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44160930 con 0x7f0a4415d4d0 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a4bc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0a441607b0 con 0x7f0a44159350 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a4bc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0a44160ab0 con 0x7f0a4415c180 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a3be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a4415d4d0 0x7f0a44158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a3be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a4415d4d0 0x7f0a44158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42148/0 (socket says 172.21.15.5:42148) 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a3be00640 1 -- 172.21.15.5:0/1865596969 learned_addr learned my addr 172.21.15.5:0/1865596969 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a49c00640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a44159350 0x7f0a4415ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a49200640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4415c180 0x7f0a441540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a3be00640 1 -- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4415c180 msgr2=0x7f0a441540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a3be00640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4415c180 0x7f0a441540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a3be00640 1 -- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a44159350 msgr2=0x7f0a4415ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a3be00640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a44159350 0x7f0a4415ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a3be00640 1 -- 172.21.15.5:0/1865596969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a441549b0 con 0x7f0a4415d4d0 2024-08-18T22:22:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a49c00640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a44159350 0x7f0a4415ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a3be00640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a4415d4d0 0x7f0a44158e10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00e930 tx=0x7f0a2c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a41600640 1 -- 172.21.15.5:0/1865596969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c017070 con 0x7f0a4415d4d0 2024-08-18T22:22:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a41600640 1 -- 172.21.15.5:0/1865596969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c00c9a0 con 0x7f0a4415d4d0 2024-08-18T22:22:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a41600640 1 -- 172.21.15.5:0/1865596969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c00cd50 con 0x7f0a4415d4d0 2024-08-18T22:22:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a4bc00640 1 -- 172.21.15.5:0/1865596969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a44071d70 con 0x7f0a4415d4d0 2024-08-18T22:22:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.967+0000 7f0a4bc00640 1 -- 172.21.15.5:0/1865596969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a44072330 con 0x7f0a4415d4d0 2024-08-18T22:22:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a41600640 1 -- 172.21.15.5:0/1865596969 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a2c01a070 con 0x7f0a4415d4d0 2024-08-18T22:22:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a41600640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a200678c0 0x7f0a20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a41600640 1 -- 172.21.15.5:0/1865596969 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f0a2c0860a0 con 0x7f0a4415d4d0 2024-08-18T22:22:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a49200640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a200678c0 0x7f0a20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a4f0a7000 1 Processor -- start 2024-08-18T22:22:28.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a4f0a7000 1 -- start start 2024-08-18T22:22:28.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a49200640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a200678c0 0x7f0a20069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0a340045f0 tx=0x7f0a34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cbe0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cbe1500 0x55de0cb940d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cb94610 0x55de0cb949f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55de0c9e4280 con 0x55de0cbe0be0 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55de0c9803a0 con 0x55de0cb94610 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55de0c9e0240 con 0x55de0cbe1500 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a49200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cbe0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a49200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cbe0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42160/0 (socket says 172.21.15.5:42160) 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a49200640 1 -- 172.21.15.5:0/1033162540 learned_addr learned my addr 172.21.15.5:0/1033162540 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a49c00640 1 --2- 172.21.15.5:0/1033162540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cb94610 0x55de0cb949f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.971+0000 7f0a3be00640 1 --2- 172.21.15.5:0/1033162540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cbe1500 0x55de0cb940d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49200640 1 -- 172.21.15.5:0/1033162540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cbe1500 msgr2=0x55de0cb940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49200640 1 --2- 172.21.15.5:0/1033162540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cbe1500 0x55de0cb940d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49200640 1 -- 172.21.15.5:0/1033162540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cb94610 msgr2=0x55de0cb949f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49200640 1 --2- 172.21.15.5:0/1033162540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cb94610 0x55de0cb949f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49200640 1 -- 172.21.15.5:0/1033162540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de0c9805f0 con 0x55de0cbe0be0 2024-08-18T22:22:28.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49c00640 1 --2- 172.21.15.5:0/1033162540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cb94610 0x55de0cb949f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:28.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49200640 1 --2- 172.21.15.5:0/1033162540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cbe0fc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400b8d0 tx=0x7f0a34004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7386305b0fc2f66 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a39600640 1 -- 172.21.15.5:0/1033162540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3401c050 con 0x55de0cbe0be0 2024-08-18T22:22:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a39600640 1 -- 172.21.15.5:0/1033162540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a34026070 con 0x55de0cbe0be0 2024-08-18T22:22:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a39600640 1 -- 172.21.15.5:0/1033162540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34016e10 con 0x55de0cbe0be0 2024-08-18T22:22:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1033162540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 msgr2=0x55de0cbe0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1033162540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cbe0fc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400b8d0 tx=0x7f0a34004620 comp rx=0 tx=0).stop 2024-08-18T22:22:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1033162540 shutdown_connections 2024-08-18T22:22:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1033162540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cb94610 0x55de0cb949f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1033162540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cbe1500 0x55de0cb940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1033162540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cbe0fc0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1033162540 >> 172.21.15.5:0/1033162540 conn(0x55de0cbc1a90 msgr2=0x55de0cbc3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1033162540 shutdown_connections 2024-08-18T22:22:28.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1033162540 wait complete. 2024-08-18T22:22:28.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 -- start start 2024-08-18T22:22:28.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 Processor -- start 2024-08-18T22:22:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cb94610 0x55de0cbe7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cbe0be0 0x55de0cbe7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbe83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55de0c9a8f10 con 0x55de0cbe1500 2024-08-18T22:22:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55de0c986600 con 0x55de0cb94610 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55de0c9e3590 con 0x55de0cbe0be0 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a4f0a7000 10 client.0 _ll_register_callbacks cb 0x55de0ca982d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbe83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbe83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42162/0 (socket says 172.21.15.5:42162) 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49c00640 1 -- 172.21.15.5:0/1347120047 learned_addr learned my addr 172.21.15.5:0/1347120047 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49200640 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cb94610 0x55de0cbe7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a3be00640 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cbe0be0 0x55de0cbe7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49c00640 1 -- 172.21.15.5:0/1347120047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cbe0be0 msgr2=0x55de0cbe7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49c00640 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cbe0be0 0x55de0cbe7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49c00640 1 -- 172.21.15.5:0/1347120047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cb94610 msgr2=0x55de0cbe7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.975+0000 7f0a49c00640 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cb94610 0x55de0cbe7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a49c00640 1 -- 172.21.15.5:0/1347120047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de0c9b0ed0 con 0x55de0cbe1500 2024-08-18T22:22:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a49c00640 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbe83c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c01ce40 tx=0x7f0a3c01b1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7cd4dbf303d218 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a32000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a32000640 1 -- 172.21.15.5:0/1347120047 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0a5d90 con 0x55de0cbe1500 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a32000640 1 -- 172.21.15.5:0/1347120047 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f0a3c0c1450 con 0x55de0cbe1500 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1347120047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a34026070 con 0x55de0cbe1500 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a32000640 1 -- 172.21.15.5:0/1347120047 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0a3c0039a0 con 0x55de0cbe1500 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 10 client.5691 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1347120047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55de0c9ef4c0 con 0x55de0cbe1500 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a32000640 1 -- 172.21.15.5:0/1347120047 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a34026070 con 0x55de0cbe1500 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a32000640 1 -- 172.21.15.5:0/1347120047 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f0a3c003b40 con 0x55de0cbe1500 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 10 client.5691 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 10 client.5691 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 20 client.5691 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55de0cbefd10 0x55de0cbf2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:28.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 4 client.5691 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:28.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1347120047 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de0c97f1e0 con 0x55de0cbefd10 2024-08-18T22:22:28.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a49200640 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55de0cbefd10 0x55de0cbf2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:28.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a49200640 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55de0cbefd10 0x55de0cbf2100 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61477619b018dbe6 server_cookie=7e098eb4d2cba8d9 in_seq=0 out_seq=0 2024-08-18T22:22:28.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a32000640 10 client.5691 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a32000640 1 -- 172.21.15.5:0/1347120047 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de0c97f1e0 con 0x55de0cbefd10 2024-08-18T22:22:28.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a32000640 10 client.5691 handle_command_reply: tid=0 2024-08-18T22:22:28.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 client.5691 shutdown 2024-08-18T22:22:28.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1347120047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 msgr2=0x55de0cbe83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:28.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbe83c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c01ce40 tx=0x7f0a3c01b1a0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1347120047 shutdown_connections 2024-08-18T22:22:28.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55de0cbefd10 0x55de0cbf2100 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbe83c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cbe0be0 0x55de0cbe7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a32000640 0 client.5691 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1347120047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cb94610 0x55de0cbe7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1347120047 >> 172.21.15.5:0/1347120047 conn(0x55de0cbc1a90 msgr2=0x55de0cb937d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1347120047 shutdown_connections 2024-08-18T22:22:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1347120047 wait complete. 2024-08-18T22:22:28.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.979+0000 7f0a4f0a7000 20 client.5691 trim_cache size 0 max 16384 2024-08-18T22:22:29.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.995+0000 7f0a4f0a7000 1 Processor -- start 2024-08-18T22:22:29.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.995+0000 7f0a4f0a7000 1 -- start start 2024-08-18T22:22:29.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.995+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cb94610 0x55de0cbc3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.995+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cbe0be0 0x55de0cbc43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.995+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbed990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.995+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44203c00 con 0x55de0cbe1500 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.995+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44202c40 con 0x55de0cbe0be0 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.995+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0a44166010 con 0x55de0cb94610 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.995+0000 7f0a49c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.995+0000 7f0a49c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbed990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42168/0 (socket says 172.21.15.5:42168) 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.995+0000 7f0a49c00640 1 -- 172.21.15.5:0/1224814722 learned_addr learned my addr 172.21.15.5:0/1224814722 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a49200640 1 --2- 172.21.15.5:0/1224814722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cb94610 0x55de0cbc3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a3be00640 1 --2- 172.21.15.5:0/1224814722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cbe0be0 0x55de0cbc43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a49c00640 1 -- 172.21.15.5:0/1224814722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cb94610 msgr2=0x55de0cbc3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a49c00640 1 --2- 172.21.15.5:0/1224814722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cb94610 0x55de0cbc3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a49c00640 1 -- 172.21.15.5:0/1224814722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cbe0be0 msgr2=0x55de0cbc43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a49c00640 1 --2- 172.21.15.5:0/1224814722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cbe0be0 0x55de0cbc43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a49c00640 1 -- 172.21.15.5:0/1224814722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de0ca67160 con 0x55de0cbe1500 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a49c00640 1 --2- 172.21.15.5:0/1224814722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbed990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c098520 tx=0x7f0a3c0b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18bd6f1e16cbb43 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a38c00640 1 -- 172.21.15.5:0/1224814722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c009510 con 0x55de0cbe1500 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a38c00640 1 -- 172.21.15.5:0/1224814722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3c0c1450 con 0x55de0cbe1500 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a38c00640 1 -- 172.21.15.5:0/1224814722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0a5b90 con 0x55de0cbe1500 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1224814722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 msgr2=0x55de0cbed990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1224814722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbed990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c098520 tx=0x7f0a3c0b8040 comp rx=0 tx=0).stop 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1224814722 shutdown_connections 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1224814722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe1500 0x55de0cbed990 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1224814722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cbe0be0 0x55de0cbc43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/1224814722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cb94610 0x55de0cbc3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1224814722 >> 172.21.15.5:0/1224814722 conn(0x55de0cbc1a90 msgr2=0x55de0cbe00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1224814722 shutdown_connections 2024-08-18T22:22:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/1224814722 wait complete. 2024-08-18T22:22:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 -- start start 2024-08-18T22:22:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 Processor -- start 2024-08-18T22:22:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cb94610 0x55de0cc54680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cc54bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cbe1500 0x55de0cc55100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0a440738c0 con 0x55de0cbe0be0 2024-08-18T22:22:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55de0c9de010 con 0x55de0cbe1500 2024-08-18T22:22:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55de0ca66cd0 con 0x55de0cb94610 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a4f0a7000 10 client.0 _ll_register_callbacks cb 0x7f0a2c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a3be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cc54bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a3be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cc54bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42174/0 (socket says 172.21.15.5:42174) 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a3be00640 1 -- 172.21.15.5:0/669907999 learned_addr learned my addr 172.21.15.5:0/669907999 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a49c00640 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cbe1500 0x55de0cc55100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a49200640 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cb94610 0x55de0cc54680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a3be00640 1 -- 172.21.15.5:0/669907999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cb94610 msgr2=0x55de0cc54680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a3be00640 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cb94610 0x55de0cc54680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a3be00640 1 -- 172.21.15.5:0/669907999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cbe1500 msgr2=0x55de0cc55100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a3be00640 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cbe1500 0x55de0cc55100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:28.999+0000 7f0a3be00640 1 -- 172.21.15.5:0/669907999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de0ca3d9c0 con 0x55de0cbe0be0 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a3be00640 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cc54bc0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00c520 tx=0x7f0a2c056610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1da2819ebd5660 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a32000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a32000640 1 -- 172.21.15.5:0/669907999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c073060 con 0x55de0cbe0be0 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a32000640 1 -- 172.21.15.5:0/669907999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f0a2c055ba0 con 0x55de0cbe0be0 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/669907999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a3c0c1450 con 0x55de0cbe0be0 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a32000640 1 -- 172.21.15.5:0/669907999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0a2c079050 con 0x55de0cbe0be0 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a4f0a7000 10 client.5697 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/669907999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55de0c98a9a0 con 0x55de0cbe0be0 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a32000640 1 -- 172.21.15.5:0/669907999 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3c0c1450 con 0x55de0cbe0be0 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a32000640 1 -- 172.21.15.5:0/669907999 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f0a2c07c020 con 0x55de0cbe0be0 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a4f0a7000 10 client.5697 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a4f0a7000 10 client.5697 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a4f0a7000 20 client.5697 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55de0cbebe90 0x55de0cbec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a4f0a7000 4 client.5697 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}] 2024-08-18T22:22:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/669907999 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}) -- 0x55de0c9f19b0 con 0x55de0cbebe90 2024-08-18T22:22:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a49200640 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55de0cbebe90 0x55de0cbec2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a32000640 10 client.5697 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.003+0000 7f0a49200640 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55de0cbebe90 0x55de0cbec2a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d924408dd186c245 server_cookie=f665ca6ad00512cf in_seq=0 out_seq=0 2024-08-18T22:22:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a32000640 1 -- 172.21.15.5:0/669907999 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de0c9f19b0 con 0x55de0cbebe90 2024-08-18T22:22:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a32000640 10 client.5697 handle_command_reply: tid=0 2024-08-18T22:22:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 1 client.5697 shutdown 2024-08-18T22:22:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/669907999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 msgr2=0x55de0cc54bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cc54bc0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00c520 tx=0x7f0a2c056610 comp rx=0 tx=0).stop 2024-08-18T22:22:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/669907999 shutdown_connections 2024-08-18T22:22:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55de0cbebe90 0x55de0cbec2a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55de0cbe1500 0x55de0cc55100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de0cbe0be0 0x55de0cc54bc0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a32000640 0 client.5697 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 1 --2- 172.21.15.5:0/669907999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55de0cb94610 0x55de0cc54680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/669907999 >> 172.21.15.5:0/669907999 conn(0x55de0cbc1a90 msgr2=0x55de0cb928a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/669907999 shutdown_connections 2024-08-18T22:22:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 1 -- 172.21.15.5:0/669907999 wait complete. 2024-08-18T22:22:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4f0a7000 20 client.5697 trim_cache size 0 max 16384 2024-08-18T22:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:22:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 -- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a200678c0 msgr2=0x7f0a20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a200678c0 0x7f0a20069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0a340045f0 tx=0x7f0a34008040 comp rx=0 tx=0).stop 2024-08-18T22:22:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 -- 172.21.15.5:0/1865596969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a4415d4d0 msgr2=0x7f0a44158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a4415d4d0 0x7f0a44158e10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00e930 tx=0x7f0a2c00edf0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 -- 172.21.15.5:0/1865596969 shutdown_connections 2024-08-18T22:22:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a200678c0 0x7f0a20069d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a44159350 0x7f0a4415ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a4415d4d0 0x7f0a44158e10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 --2- 172.21.15.5:0/1865596969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a4415c180 0x7f0a441540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 -- 172.21.15.5:0/1865596969 >> 172.21.15.5:0/1865596969 conn(0x7f0a440b1dc0 msgr2=0x7f0a4409a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 -- 172.21.15.5:0/1865596969 shutdown_connections 2024-08-18T22:22:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.007+0000 7f0a4bc00640 1 -- 172.21.15.5:0/1865596969 wait complete. 2024-08-18T22:22:29.029 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' returned '{'message': '', 'return_code': 0}' 2024-08-18T22:22:29.029 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:22:29.029 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:29.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:29.039 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-08-18T22:22:29.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:22:29.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:22:29.113 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226889 s, 46.2 MB/s 2024-08-18T22:22:29.114 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-08-18T22:22:29.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-08-18T22:22:29.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.295+0000 7f15b8200640 1 Processor -- start 2024-08-18T22:22:29.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.295+0000 7f15b8200640 1 -- start start 2024-08-18T22:22:29.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.295+0000 7f15b8200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15b015c560 0x7f15b00ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.295+0000 7f15b8200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b00cfb00 con 0x7f15b015d4d0 2024-08-18T22:22:29.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.299+0000 7f15b8200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b015c9f0 con 0x7f15b015c180 2024-08-18T22:22:29.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.299+0000 7f15b8200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f15b015d040 con 0x7f15b015c560 2024-08-18T22:22:29.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.299+0000 7f15b6200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f15b015d4d0 0x7f15b006db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43146/0 (socket says 172.21.15.5:43146) 2024-08-18T22:22:29.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.299+0000 7f15b6200640 1 -- 172.21.15.5:0/3018433157 learned_addr learned my addr 172.21.15.5:0/3018433157 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:29.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.299+0000 7f15b4e00640 1 --2- 172.21.15.5:0/3018433157 >> v2:172.21.15.117:3300/0 conn(0x7f15b015c560 0x7f15b00ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.299+0000 7f15afe00640 1 -- 172.21.15.5:0/3018433157 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422187675 0 0) 0x7f15b00cfb00 con 0x7f15b015d4d0 2024-08-18T22:22:29.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.299+0000 7f15afe00640 1 -- 172.21.15.5:0/3018433157 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1598003530 con 0x7f15b015d4d0 2024-08-18T22:22:29.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.299+0000 7f15b4e00640 1 -- 172.21.15.5:0/3018433157 >> v1:172.21.15.117:6789/0 conn(0x7f15b015c180 legacy=0x7f15b00cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.299+0000 7f15b4e00640 1 -- 172.21.15.5:0/3018433157 >> v1:172.21.15.5:6789/0 conn(0x7f15b015d4d0 legacy=0x7f15b006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.299+0000 7f15b4e00640 1 -- 172.21.15.5:0/3018433157 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b015ccd0 con 0x7f15b015c560 2024-08-18T22:22:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.299+0000 7f15b4e00640 1 --2- 172.21.15.5:0/3018433157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15b015c560 0x7f15b00ce620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097c0 tx=0x7f159c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4be323952b15bd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15afe00640 1 -- 172.21.15.5:0/3018433157 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0ab430 con 0x7f15b015c560 2024-08-18T22:22:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15afe00640 1 -- 172.21.15.5:0/3018433157 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f159c0b0070 con 0x7f15b015c560 2024-08-18T22:22:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15afe00640 1 -- 172.21.15.5:0/3018433157 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0ab7d0 con 0x7f15b015c560 2024-08-18T22:22:29.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 -- 172.21.15.5:0/3018433157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15b015c560 msgr2=0x7f15b00ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 --2- 172.21.15.5:0/3018433157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15b015c560 0x7f15b00ce620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097c0 tx=0x7f159c01c410 comp rx=0 tx=0).stop 2024-08-18T22:22:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 -- 172.21.15.5:0/3018433157 shutdown_connections 2024-08-18T22:22:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 --2- 172.21.15.5:0/3018433157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15b015c560 0x7f15b00ce620 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 -- 172.21.15.5:0/3018433157 >> 172.21.15.5:0/3018433157 conn(0x7f15b00b1dc0 msgr2=0x7f15b00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 -- 172.21.15.5:0/3018433157 shutdown_connections 2024-08-18T22:22:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 -- 172.21.15.5:0/3018433157 wait complete. 2024-08-18T22:22:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 Processor -- start 2024-08-18T22:22:29.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 -- start start 2024-08-18T22:22:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15b015c180 0x7f15b0150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15b015d4d0 0x7f15b009b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15b0151540 0x7f15b01598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f15b016a2c0 con 0x7f15b015d4d0 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15b016a140 con 0x7f15b0151540 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b8200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f15b016a440 con 0x7f15b015c180 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b4e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15b015d4d0 0x7f15b009b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b4e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15b015d4d0 0x7f15b009b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42176/0 (socket says 172.21.15.5:42176) 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.303+0000 7f15b4e00640 1 -- 172.21.15.5:0/1734088258 learned_addr learned my addr 172.21.15.5:0/1734088258 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b6200640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15b0151540 0x7f15b01598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b5800640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15b015c180 0x7f15b0150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b4e00640 1 -- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15b015c180 msgr2=0x7f15b0150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b4e00640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15b015c180 0x7f15b0150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b4e00640 1 -- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15b0151540 msgr2=0x7f15b01598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b4e00640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15b0151540 0x7f15b01598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b4e00640 1 -- 172.21.15.5:0/1734088258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b00ae960 con 0x7f15b015d4d0 2024-08-18T22:22:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b5800640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15b015c180 0x7f15b0150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b6200640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15b0151540 0x7f15b01598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b4e00640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15b015d4d0 0x7f15b009b750 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f159c019020 tx=0x7f159c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15ad600640 1 -- 172.21.15.5:0/1734088258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0bf610 con 0x7f15b015d4d0 2024-08-18T22:22:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15ad600640 1 -- 172.21.15.5:0/1734088258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b00ced70 con 0x7f15b015d4d0 2024-08-18T22:22:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15ad600640 1 -- 172.21.15.5:0/1734088258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0bf9d0 con 0x7f15b015d4d0 2024-08-18T22:22:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b8200640 1 -- 172.21.15.5:0/1734088258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b00aec40 con 0x7f15b015d4d0 2024-08-18T22:22:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15b8200640 1 -- 172.21.15.5:0/1734088258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b01593c0 con 0x7f15b015d4d0 2024-08-18T22:22:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15ad600640 1 -- 172.21.15.5:0/1734088258 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f159c0bd020 con 0x7f15b015d4d0 2024-08-18T22:22:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.307+0000 7f15ad600640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15900678c0 0x7f1590069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15ad600640 1 -- 172.21.15.5:0/1734088258 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f159c0a8020 con 0x7f15b015d4d0 2024-08-18T22:22:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b5800640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15900678c0 0x7f1590069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 Processor -- start 2024-08-18T22:22:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 -- start start 2024-08-18T22:22:29.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b5800640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15900678c0 0x7f1590069d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f15a4000f70 tx=0x7f15a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae2be0 0x55bec0ae2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ae3500 0x55bec0a960d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0a969f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bec08e6280 con 0x55bec0a96610 2024-08-18T22:22:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bec08823a0 con 0x55bec0ae2be0 2024-08-18T22:22:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55bec08e2240 con 0x55bec0ae3500 2024-08-18T22:22:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0a969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0a969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42186/0 (socket says 172.21.15.5:42186) 2024-08-18T22:22:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b6200640 1 -- 172.21.15.5:0/3226287305 learned_addr learned my addr 172.21.15.5:0/3226287305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b5800640 1 --2- 172.21.15.5:0/3226287305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae2be0 0x55bec0ae2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b4e00640 1 --2- 172.21.15.5:0/3226287305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ae3500 0x55bec0a960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b6200640 1 -- 172.21.15.5:0/3226287305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ae3500 msgr2=0x55bec0a960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b6200640 1 --2- 172.21.15.5:0/3226287305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ae3500 0x55bec0a960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b6200640 1 -- 172.21.15.5:0/3226287305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae2be0 msgr2=0x55bec0ae2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b6200640 1 --2- 172.21.15.5:0/3226287305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae2be0 0x55bec0ae2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b6200640 1 -- 172.21.15.5:0/3226287305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec08825f0 con 0x55bec0a96610 2024-08-18T22:22:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15b6200640 1 --2- 172.21.15.5:0/3226287305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0a969f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f15a80021f0 tx=0x7f15a800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfcae0778198bac server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15a2000640 1 -- 172.21.15.5:0/3226287305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8018070 con 0x55bec0a96610 2024-08-18T22:22:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15a2000640 1 -- 172.21.15.5:0/3226287305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8013670 con 0x55bec0a96610 2024-08-18T22:22:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15a2000640 1 -- 172.21.15.5:0/3226287305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8013a20 con 0x55bec0a96610 2024-08-18T22:22:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 -- 172.21.15.5:0/3226287305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 msgr2=0x55bec0a969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/3226287305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0a969f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f15a80021f0 tx=0x7f15a800d520 comp rx=0 tx=0).stop 2024-08-18T22:22:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 -- 172.21.15.5:0/3226287305 shutdown_connections 2024-08-18T22:22:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/3226287305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0a969f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/3226287305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ae3500 0x55bec0a960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/3226287305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae2be0 0x55bec0ae2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 -- 172.21.15.5:0/3226287305 >> 172.21.15.5:0/3226287305 conn(0x55bec0ac3a90 msgr2=0x55bec0ac5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 -- 172.21.15.5:0/3226287305 shutdown_connections 2024-08-18T22:22:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.311+0000 7f15bb6f0000 1 -- 172.21.15.5:0/3226287305 wait complete. 2024-08-18T22:22:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 -- start start 2024-08-18T22:22:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 Processor -- start 2024-08-18T22:22:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0ae8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ae2be0 0x55bec0ae8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae3500 0x55bec0ae8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bec08aaf10 con 0x55bec0a96610 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bec0888600 con 0x55bec0ae3500 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55bec08e5590 con 0x55bec0ae2be0 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 10 client.0 _ll_register_callbacks cb 0x55bec099a2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15b5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0ae8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15b5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0ae8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42192/0 (socket says 172.21.15.5:42192) 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15b5800640 1 -- 172.21.15.5:0/2693353810 learned_addr learned my addr 172.21.15.5:0/2693353810 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15b4e00640 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ae2be0 0x55bec0ae8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15b6200640 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae3500 0x55bec0ae8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15b5800640 1 -- 172.21.15.5:0/2693353810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ae2be0 msgr2=0x55bec0ae8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15b5800640 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ae2be0 0x55bec0ae8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15b5800640 1 -- 172.21.15.5:0/2693353810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae3500 msgr2=0x55bec0ae8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15b5800640 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae3500 0x55bec0ae8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15b5800640 1 -- 172.21.15.5:0/2693353810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bec08b2ed0 con 0x55bec0a96610 2024-08-18T22:22:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15b5800640 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0ae8040 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f15a400de50 tx=0x7f15a4001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1184ff281f2e608 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f1596a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f1596a00640 1 -- 172.21.15.5:0/2693353810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4024020 con 0x55bec0a96610 2024-08-18T22:22:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2693353810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15a8013670 con 0x55bec0a96610 2024-08-18T22:22:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f1596a00640 1 -- 172.21.15.5:0/2693353810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f15a40203f0 con 0x55bec0a96610 2024-08-18T22:22:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f1596a00640 1 -- 172.21.15.5:0/2693353810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f15a402e050 con 0x55bec0a96610 2024-08-18T22:22:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 10 client.5709 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2693353810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55bec08f14c0 con 0x55bec0a96610 2024-08-18T22:22:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f1596a00640 1 -- 172.21.15.5:0/2693353810 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8013670 con 0x55bec0a96610 2024-08-18T22:22:29.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f1596a00640 1 -- 172.21.15.5:0/2693353810 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f15a4031020 con 0x55bec0a96610 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 10 client.5709 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 10 client.5709 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 20 client.5709 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55bec0ae94d0 0x55bec0af8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 4 client.5709 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.315+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2693353810 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bec08811e0 con 0x55bec0ae94d0 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15b4e00640 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55bec0ae94d0 0x55bec0af8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15b4e00640 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55bec0ae94d0 0x55bec0af8580 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58b3e32db14196e2 server_cookie=e0e5996cffe4d955 in_seq=0 out_seq=0 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f1596a00640 10 client.5709 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f1596a00640 1 -- 172.21.15.5:0/2693353810 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bec08811e0 con 0x55bec0ae94d0 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f1596a00640 10 client.5709 handle_command_reply: tid=0 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 1 client.5709 shutdown 2024-08-18T22:22:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2693353810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 msgr2=0x55bec0ae8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0ae8040 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f15a400de50 tx=0x7f15a4001090 comp rx=0 tx=0).stop 2024-08-18T22:22:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2693353810 shutdown_connections 2024-08-18T22:22:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55bec0ae94d0 0x55bec0af8580 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae3500 0x55bec0ae8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ae2be0 0x55bec0ae8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f1596a00640 0 client.5709 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2693353810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0ae8040 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2693353810 >> 172.21.15.5:0/2693353810 conn(0x55bec0ac3a90 msgr2=0x55bec0a957d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2693353810 shutdown_connections 2024-08-18T22:22:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2693353810 wait complete. 2024-08-18T22:22:29.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.319+0000 7f15bb6f0000 20 client.5709 trim_cache size 0 max 16384 2024-08-18T22:22:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 Processor -- start 2024-08-18T22:22:29.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 -- start start 2024-08-18T22:22:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ac3a90 0x55bec0b576c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0a96610 0x55bec0b57c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0ae2be0 0x55bec0b58140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01ffce0 con 0x55bec0ae2be0 2024-08-18T22:22:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15b0073360 con 0x55bec0ac3a90 2024-08-18T22:22:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f15b0157be0 con 0x55bec0a96610 2024-08-18T22:22:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0ae2be0 0x55bec0b58140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0ae2be0 0x55bec0b58140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42194/0 (socket says 172.21.15.5:42194) 2024-08-18T22:22:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b6200640 1 -- 172.21.15.5:0/4035249898 learned_addr learned my addr 172.21.15.5:0/4035249898 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b4e00640 1 --2- 172.21.15.5:0/4035249898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0a96610 0x55bec0b57c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b5800640 1 --2- 172.21.15.5:0/4035249898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ac3a90 0x55bec0b576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b6200640 1 -- 172.21.15.5:0/4035249898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0a96610 msgr2=0x55bec0b57c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b6200640 1 --2- 172.21.15.5:0/4035249898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0a96610 0x55bec0b57c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b6200640 1 -- 172.21.15.5:0/4035249898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ac3a90 msgr2=0x55bec0b576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b6200640 1 --2- 172.21.15.5:0/4035249898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ac3a90 0x55bec0b576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b6200640 1 -- 172.21.15.5:0/4035249898 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec0969160 con 0x55bec0ae2be0 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b5800640 1 --2- 172.21.15.5:0/4035249898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ac3a90 0x55bec0b576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b4e00640 1 --2- 172.21.15.5:0/4035249898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0a96610 0x55bec0b57c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15b6200640 1 --2- 172.21.15.5:0/4035249898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0ae2be0 0x55bec0b58140 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f15a800d560 tx=0x7f15a800b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f22050ec872ddc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15a1600640 1 -- 172.21.15.5:0/4035249898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8024070 con 0x55bec0ae2be0 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15a1600640 1 -- 172.21.15.5:0/4035249898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8020470 con 0x55bec0ae2be0 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15a1600640 1 -- 172.21.15.5:0/4035249898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8018040 con 0x55bec0ae2be0 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 -- 172.21.15.5:0/4035249898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0ae2be0 msgr2=0x55bec0b58140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/4035249898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0ae2be0 0x55bec0b58140 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f15a800d560 tx=0x7f15a800b000 comp rx=0 tx=0).stop 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 -- 172.21.15.5:0/4035249898 shutdown_connections 2024-08-18T22:22:29.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/4035249898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0ae2be0 0x55bec0b58140 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/4035249898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0a96610 0x55bec0b57c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/4035249898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ac3a90 0x55bec0b576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 -- 172.21.15.5:0/4035249898 >> 172.21.15.5:0/4035249898 conn(0x55bec0ae2070 msgr2=0x55bec0ae38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 -- 172.21.15.5:0/4035249898 shutdown_connections 2024-08-18T22:22:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.335+0000 7f15bb6f0000 1 -- 172.21.15.5:0/4035249898 wait complete. 2024-08-18T22:22:29.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 -- start start 2024-08-18T22:22:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 Processor -- start 2024-08-18T22:22:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0b5b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ac3a90 0x55bec0b5bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae2be0 0x55bec0b5c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bec08aaf10 con 0x55bec0a96610 2024-08-18T22:22:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15b0072d10 con 0x55bec0ae2be0 2024-08-18T22:22:29.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55bec0968cd0 con 0x55bec0ac3a90 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 10 client.0 _ll_register_callbacks cb 0x7f15a400d600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0b5b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0b5b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42198/0 (socket says 172.21.15.5:42198) 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b5800640 1 -- 172.21.15.5:0/2777434400 learned_addr learned my addr 172.21.15.5:0/2777434400 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b6200640 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae2be0 0x55bec0b5c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b4e00640 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ac3a90 0x55bec0b5bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b5800640 1 -- 172.21.15.5:0/2777434400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ac3a90 msgr2=0x55bec0b5bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b5800640 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ac3a90 0x55bec0b5bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b5800640 1 -- 172.21.15.5:0/2777434400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae2be0 msgr2=0x55bec0b5c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b5800640 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae2be0 0x55bec0b5c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b5800640 1 -- 172.21.15.5:0/2777434400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bec093f9c0 con 0x55bec0a96610 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b5800640 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0b5b640 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f15a400d810 tx=0x7f15a4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8cee0b548d7235 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f1596a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:29.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f1596a00640 1 -- 172.21.15.5:0/2777434400 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4024070 con 0x55bec0a96610 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f1596a00640 1 -- 172.21.15.5:0/2777434400 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f15a4007450 con 0x55bec0a96610 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2777434400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15a8020470 con 0x55bec0a96610 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f1596a00640 1 -- 172.21.15.5:0/2777434400 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f15a4007650 con 0x55bec0a96610 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 10 client.5715 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2777434400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55bec088c9a0 con 0x55bec0a96610 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f1596a00640 1 -- 172.21.15.5:0/2777434400 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8020470 con 0x55bec0a96610 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f1596a00640 1 -- 172.21.15.5:0/2777434400 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f15a4031070 con 0x55bec0a96610 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 10 client.5715 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 10 client.5715 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 20 client.5715 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55bec0ae3500 0x55bec0b17270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 4 client.5715 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-08-18T22:22:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2777434400 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x55bec08f39b0 con 0x55bec0ae3500 2024-08-18T22:22:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.339+0000 7f15b4e00640 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55bec0ae3500 0x55bec0b17270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.343+0000 7f1596a00640 10 client.5715 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.343+0000 7f15b4e00640 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55bec0ae3500 0x55bec0b17270 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b50fc1bf66be3d3 server_cookie=30806b17bbecb057 in_seq=0 out_seq=0 2024-08-18T22:22:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f1596a00640 1 -- 172.21.15.5:0/2777434400 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bec08f39b0 con 0x55bec0ae3500 2024-08-18T22:22:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f1596a00640 10 client.5715 handle_command_reply: tid=0 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 1 client.5715 shutdown 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2777434400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 msgr2=0x55bec0b5b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0b5b640 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f15a400d810 tx=0x7f15a4014000 comp rx=0 tx=0).stop 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2777434400 shutdown_connections 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55bec0ae3500 0x55bec0b17270 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bec0ae2be0 0x55bec0b5c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55bec0ac3a90 0x55bec0b5bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f1596a00640 0 client.5715 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 1 --2- 172.21.15.5:0/2777434400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bec0a96610 0x55bec0b5b640 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2777434400 >> 172.21.15.5:0/2777434400 conn(0x55bec0ae2070 msgr2=0x55bec0ae38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2777434400 shutdown_connections 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 1 -- 172.21.15.5:0/2777434400 wait complete. 2024-08-18T22:22:29.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15bb6f0000 20 client.5715 trim_cache size 0 max 16384 2024-08-18T22:22:29.352 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:22:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:22:29.352 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:29.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 -- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15900678c0 msgr2=0x7f1590069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15900678c0 0x7f1590069d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f15a4000f70 tx=0x7f15a4009040 comp rx=0 tx=0).stop 2024-08-18T22:22:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 -- 172.21.15.5:0/1734088258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15b015d4d0 msgr2=0x7f15b009b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15b015d4d0 0x7f15b009b750 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f159c019020 tx=0x7f159c01ac50 comp rx=0 tx=0).stop 2024-08-18T22:22:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 -- 172.21.15.5:0/1734088258 shutdown_connections 2024-08-18T22:22:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15900678c0 0x7f1590069d80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15b0151540 0x7f15b01598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15b015d4d0 0x7f15b009b750 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 --2- 172.21.15.5:0/1734088258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15b015c180 0x7f15b0150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 -- 172.21.15.5:0/1734088258 >> 172.21.15.5:0/1734088258 conn(0x7f15b00b1dc0 msgr2=0x7f15b00cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 -- 172.21.15.5:0/1734088258 shutdown_connections 2024-08-18T22:22:29.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.347+0000 7f15b8200640 1 -- 172.21.15.5:0/1734088258 wait complete. 2024-08-18T22:22:29.370 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'message': '', 'return_code': 0}' 2024-08-18T22:22:29.370 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:22:29.370 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:22:29.370 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-08-18T22:22:29.370 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:22:29.371 DEBUG:teuthology.orchestra.run.smithi005:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-08-18T22:22:29.371 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:22:29.437 INFO:teuthology.orchestra.run.smithi005.stdout:1099511630409 2024-08-18T22:22:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:22:29.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-08-18T22:22:29.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.631+0000 7faa24200640 1 Processor -- start 2024-08-18T22:22:29.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.631+0000 7faa24200640 1 -- start start 2024-08-18T22:22:29.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa24200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faa1c0b1300 0x7faa1c162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa24200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa1c06e8a0 con 0x7faa1c09b080 2024-08-18T22:22:29.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa24200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa1c09bb80 con 0x7faa1c09aca0 2024-08-18T22:22:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa24200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faa1c0d2e40 con 0x7faa1c0b1300 2024-08-18T22:22:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa22200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faa1c09b080 0x7faa1c0b01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43152/0 (socket says 172.21.15.5:43152) 2024-08-18T22:22:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa22200640 1 -- 172.21.15.5:0/1128950010 learned_addr learned my addr 172.21.15.5:0/1128950010 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa20e00640 1 --2- 172.21.15.5:0/1128950010 >> v2:172.21.15.117:3300/0 conn(0x7faa1c0b1300 0x7faa1c162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa1be00640 1 -- 172.21.15.5:0/1128950010 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428677803 0 0) 0x7faa1c06e8a0 con 0x7faa1c09b080 2024-08-18T22:22:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa1be00640 1 -- 172.21.15.5:0/1128950010 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa04003530 con 0x7faa1c09b080 2024-08-18T22:22:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa1be00640 1 -- 172.21.15.5:0/1128950010 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120830445 0 0) 0x7faa1c09bb80 con 0x7faa1c09aca0 2024-08-18T22:22:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa1be00640 1 -- 172.21.15.5:0/1128950010 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa1c06e8a0 con 0x7faa1c09aca0 2024-08-18T22:22:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa20e00640 1 -- 172.21.15.5:0/1128950010 >> v1:172.21.15.117:6789/0 conn(0x7faa1c09aca0 legacy=0x7faa1c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa20e00640 1 -- 172.21.15.5:0/1128950010 >> v1:172.21.15.5:6789/0 conn(0x7faa1c09b080 legacy=0x7faa1c0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa1be00640 1 -- 172.21.15.5:0/1128950010 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1929679940 0 0) 0x7faa04003530 con 0x7faa1c09b080 2024-08-18T22:22:29.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.635+0000 7faa20e00640 1 -- 172.21.15.5:0/1128950010 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c06cbd0 con 0x7faa1c0b1300 2024-08-18T22:22:29.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa20e00640 1 --2- 172.21.15.5:0/1128950010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c0b1300 0x7faa1c162950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faa080097c0 tx=0x7faa0801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31c8a2910f2fe747 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa1be00640 1 -- 172.21.15.5:0/1128950010 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080b1070 con 0x7faa1c0b1300 2024-08-18T22:22:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa1be00640 1 -- 172.21.15.5:0/1128950010 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa080ac410 con 0x7faa1c0b1300 2024-08-18T22:22:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa1be00640 1 -- 172.21.15.5:0/1128950010 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080ac7c0 con 0x7faa1c0b1300 2024-08-18T22:22:29.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 -- 172.21.15.5:0/1128950010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c0b1300 msgr2=0x7faa1c162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 --2- 172.21.15.5:0/1128950010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c0b1300 0x7faa1c162950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faa080097c0 tx=0x7faa0801c4a0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 -- 172.21.15.5:0/1128950010 shutdown_connections 2024-08-18T22:22:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 --2- 172.21.15.5:0/1128950010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c0b1300 0x7faa1c162950 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 -- 172.21.15.5:0/1128950010 >> 172.21.15.5:0/1128950010 conn(0x7faa1c0d2180 msgr2=0x7faa1c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 -- 172.21.15.5:0/1128950010 shutdown_connections 2024-08-18T22:22:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 -- 172.21.15.5:0/1128950010 wait complete. 2024-08-18T22:22:29.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 Processor -- start 2024-08-18T22:22:29.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 -- start start 2024-08-18T22:22:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa1c09aca0 0x7faa1c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c09b080 0x7faa1c14fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0b1300 0x7faa1c160670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c16ced0 con 0x7faa1c0b1300 2024-08-18T22:22:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c16cd50 con 0x7faa1c09b080 2024-08-18T22:22:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.639+0000 7faa24200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faa1c16d050 con 0x7faa1c09aca0 2024-08-18T22:22:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa22200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0b1300 0x7faa1c160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa22200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0b1300 0x7faa1c160670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42212/0 (socket says 172.21.15.5:42212) 2024-08-18T22:22:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa22200640 1 -- 172.21.15.5:0/3729056912 learned_addr learned my addr 172.21.15.5:0/3729056912 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa20e00640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c09b080 0x7faa1c14fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa21800640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa1c09aca0 0x7faa1c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa22200640 1 -- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa1c09aca0 msgr2=0x7faa1c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa22200640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa1c09aca0 0x7faa1c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa22200640 1 -- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c09b080 msgr2=0x7faa1c14fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa22200640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c09b080 0x7faa1c14fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa22200640 1 -- 172.21.15.5:0/3729056912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c0b6a40 con 0x7faa1c0b1300 2024-08-18T22:22:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa22200640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0b1300 0x7faa1c160670 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7faa1400c450 tx=0x7faa1400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa19600640 1 -- 172.21.15.5:0/3729056912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14005cf0 con 0x7faa1c0b1300 2024-08-18T22:22:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa19600640 1 -- 172.21.15.5:0/3729056912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa14007070 con 0x7faa1c0b1300 2024-08-18T22:22:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa24200640 1 -- 172.21.15.5:0/3729056912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1c15ce70 con 0x7faa1c0b1300 2024-08-18T22:22:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa19600640 1 -- 172.21.15.5:0/3729056912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14007460 con 0x7faa1c0b1300 2024-08-18T22:22:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa24200640 1 -- 172.21.15.5:0/3729056912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1c15d110 con 0x7faa1c0b1300 2024-08-18T22:22:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa19600640 1 -- 172.21.15.5:0/3729056912 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa14007600 con 0x7faa1c0b1300 2024-08-18T22:22:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.643+0000 7faa19600640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9fc0678f0 0x7fa9fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa19600640 1 -- 172.21.15.5:0/3729056912 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7faa14085900 con 0x7faa1c0b1300 2024-08-18T22:22:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa21800640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9fc0678f0 0x7fa9fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 Processor -- start 2024-08-18T22:22:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 -- start start 2024-08-18T22:22:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa21800640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9fc0678f0 0x7fa9fc069db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa10001570 tx=0x7faa10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e69b0 0x55ecba9e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e72d0 0x55ecba999fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba99a510 0x55ecba99a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ecba883af0 con 0x55ecba9e72d0 2024-08-18T22:22:29.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ecba86fbb0 con 0x55ecba9e69b0 2024-08-18T22:22:29.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ecba7ea500 con 0x55ecba99a510 2024-08-18T22:22:29.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa20e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e72d0 0x55ecba999fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa20e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e72d0 0x55ecba999fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42216/0 (socket says 172.21.15.5:42216) 2024-08-18T22:22:29.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa20e00640 1 -- 172.21.15.5:0/2673282323 learned_addr learned my addr 172.21.15.5:0/2673282323 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa21800640 1 --2- 172.21.15.5:0/2673282323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e69b0 0x55ecba9e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa22200640 1 --2- 172.21.15.5:0/2673282323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba99a510 0x55ecba99a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa20e00640 1 -- 172.21.15.5:0/2673282323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba99a510 msgr2=0x55ecba99a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa20e00640 1 --2- 172.21.15.5:0/2673282323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba99a510 0x55ecba99a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa20e00640 1 -- 172.21.15.5:0/2673282323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e69b0 msgr2=0x55ecba9e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa20e00640 1 --2- 172.21.15.5:0/2673282323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e69b0 0x55ecba9e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa20e00640 1 -- 172.21.15.5:0/2673282323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecba78aaa0 con 0x55ecba9e72d0 2024-08-18T22:22:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa21800640 1 --2- 172.21.15.5:0/2673282323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e69b0 0x55ecba9e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa20e00640 1 --2- 172.21.15.5:0/2673282323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e72d0 0x55ecba999fd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faa0801c4e0 tx=0x7faa080a6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4acebddf6cb546 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa0e000640 1 -- 172.21.15.5:0/2673282323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080b1040 con 0x55ecba9e72d0 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa0e000640 1 -- 172.21.15.5:0/2673282323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa080ac5d0 con 0x55ecba9e72d0 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa0e000640 1 -- 172.21.15.5:0/2673282323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080ac980 con 0x55ecba9e72d0 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 -- 172.21.15.5:0/2673282323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e72d0 msgr2=0x55ecba999fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 --2- 172.21.15.5:0/2673282323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e72d0 0x55ecba999fd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faa0801c4e0 tx=0x7faa080a6040 comp rx=0 tx=0).stop 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 -- 172.21.15.5:0/2673282323 shutdown_connections 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 --2- 172.21.15.5:0/2673282323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba99a510 0x55ecba99a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 --2- 172.21.15.5:0/2673282323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e72d0 0x55ecba999fd0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 --2- 172.21.15.5:0/2673282323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e69b0 0x55ecba9e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 -- 172.21.15.5:0/2673282323 >> 172.21.15.5:0/2673282323 conn(0x55ecba994020 msgr2=0x55ecba9c9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 -- 172.21.15.5:0/2673282323 shutdown_connections 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.647+0000 7faa27637000 1 -- 172.21.15.5:0/2673282323 wait complete. 2024-08-18T22:22:29.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 -- start start 2024-08-18T22:22:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 Processor -- start 2024-08-18T22:22:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba99a510 0x55ecba9c7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecba9a2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e72d0 0x55ecba9a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ecba7e64c0 con 0x55ecba9e69b0 2024-08-18T22:22:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ecba7a4b60 con 0x55ecba99a510 2024-08-18T22:22:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ecba78bd10 con 0x55ecba9e72d0 2024-08-18T22:22:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 10 client.0 _ll_register_callbacks cb 0x55ecba987f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa20e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecba9a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa20e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecba9a2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42222/0 (socket says 172.21.15.5:42222) 2024-08-18T22:22:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa20e00640 1 -- 172.21.15.5:0/929105938 learned_addr learned my addr 172.21.15.5:0/929105938 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa21800640 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba99a510 0x55ecba9c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa22200640 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e72d0 0x55ecba9a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa20e00640 1 -- 172.21.15.5:0/929105938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e72d0 msgr2=0x55ecba9a25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa20e00640 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e72d0 0x55ecba9a25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa20e00640 1 -- 172.21.15.5:0/929105938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba99a510 msgr2=0x55ecba9c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa20e00640 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba99a510 0x55ecba9c7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa20e00640 1 -- 172.21.15.5:0/929105938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecba7a3070 con 0x55ecba9e69b0 2024-08-18T22:22:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa21800640 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba99a510 0x55ecba9c7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa20e00640 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecba9a2080 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faa080190b0 tx=0x7faa0801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f2aae73b9d4857 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa02a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa02a00640 1 -- 172.21.15.5:0/929105938 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080c5060 con 0x55ecba9e69b0 2024-08-18T22:22:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 -- 172.21.15.5:0/929105938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa080ac5d0 con 0x55ecba9e69b0 2024-08-18T22:22:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa02a00640 1 -- 172.21.15.5:0/929105938 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7faa080ac780 con 0x55ecba9e69b0 2024-08-18T22:22:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa02a00640 1 -- 172.21.15.5:0/929105938 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faa080cb050 con 0x55ecba9e69b0 2024-08-18T22:22:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 10 client.5727 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 -- 172.21.15.5:0/929105938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ecba7b6f60 con 0x55ecba9e69b0 2024-08-18T22:22:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa02a00640 1 -- 172.21.15.5:0/929105938 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa080ac5d0 con 0x55ecba9e69b0 2024-08-18T22:22:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa02a00640 1 -- 172.21.15.5:0/929105938 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7faa080ce020 con 0x55ecba9e69b0 2024-08-18T22:22:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 10 client.5727 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 10 client.5727 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 20 client.5727 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ecba9c8d40 0x55ecba9c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 4 client.5727 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa27637000 1 -- 172.21.15.5:0/929105938 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecba784e20 con 0x55ecba9c8d40 2024-08-18T22:22:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.651+0000 7faa21800640 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ecba9c8d40 0x55ecba9c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa21800640 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ecba9c8d40 0x55ecba9c9120 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c6dc38c23051b6 server_cookie=47f8a72c8b6d68c9 in_seq=0 out_seq=0 2024-08-18T22:22:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa02a00640 10 client.5727 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa02a00640 1 -- 172.21.15.5:0/929105938 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ecba784e20 con 0x55ecba9c8d40 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa02a00640 10 client.5727 handle_command_reply: tid=0 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 1 client.5727 shutdown 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 1 -- 172.21.15.5:0/929105938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 msgr2=0x55ecba9a2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecba9a2080 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faa080190b0 tx=0x7faa0801ace0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 1 -- 172.21.15.5:0/929105938 shutdown_connections 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ecba9c8d40 0x55ecba9c9120 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e72d0 0x55ecba9a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecba9a2080 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 1 --2- 172.21.15.5:0/929105938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba99a510 0x55ecba9c7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa02a00640 0 client.5727 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 1 -- 172.21.15.5:0/929105938 >> 172.21.15.5:0/929105938 conn(0x55ecba994020 msgr2=0x55ecba9996d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 1 -- 172.21.15.5:0/929105938 shutdown_connections 2024-08-18T22:22:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 1 -- 172.21.15.5:0/929105938 wait complete. 2024-08-18T22:22:29.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.655+0000 7faa27637000 20 client.5727 trim_cache size 0 max 16384 2024-08-18T22:22:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.667+0000 7faa27637000 1 Processor -- start 2024-08-18T22:22:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.667+0000 7faa27637000 1 -- start start 2024-08-18T22:22:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba99a510 0x55ecba9fe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e69b0 0x55ecba9c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e72d0 0x55ecba9c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c2043a0 con 0x55ecba99a510 2024-08-18T22:22:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c2033e0 con 0x55ecba9e72d0 2024-08-18T22:22:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faa1c15fee0 con 0x55ecba9e69b0 2024-08-18T22:22:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa21800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba99a510 0x55ecba9fe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa21800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba99a510 0x55ecba9fe2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42230/0 (socket says 172.21.15.5:42230) 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa21800640 1 -- 172.21.15.5:0/171273297 learned_addr learned my addr 172.21.15.5:0/171273297 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa22200640 1 --2- 172.21.15.5:0/171273297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e72d0 0x55ecba9c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa20e00640 1 --2- 172.21.15.5:0/171273297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e69b0 0x55ecba9c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa21800640 1 -- 172.21.15.5:0/171273297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e69b0 msgr2=0x55ecba9c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa21800640 1 --2- 172.21.15.5:0/171273297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e69b0 0x55ecba9c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa21800640 1 -- 172.21.15.5:0/171273297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e72d0 msgr2=0x55ecba9c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa21800640 1 --2- 172.21.15.5:0/171273297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e72d0 0x55ecba9c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa21800640 1 -- 172.21.15.5:0/171273297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecba86cde0 con 0x55ecba99a510 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa20e00640 1 --2- 172.21.15.5:0/171273297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e69b0 0x55ecba9c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa22200640 1 --2- 172.21.15.5:0/171273297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e72d0 0x55ecba9c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa21800640 1 --2- 172.21.15.5:0/171273297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba99a510 0x55ecba9fe2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faa1000ff00 tx=0x7faa10012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9db0b55b021c93a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa0d600640 1 -- 172.21.15.5:0/171273297 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10014e20 con 0x55ecba99a510 2024-08-18T22:22:29.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa0d600640 1 -- 172.21.15.5:0/171273297 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1001b040 con 0x55ecba99a510 2024-08-18T22:22:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa0d600640 1 -- 172.21.15.5:0/171273297 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10023680 con 0x55ecba99a510 2024-08-18T22:22:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 -- 172.21.15.5:0/171273297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba99a510 msgr2=0x55ecba9fe2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 --2- 172.21.15.5:0/171273297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba99a510 0x55ecba9fe2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faa1000ff00 tx=0x7faa10012000 comp rx=0 tx=0).stop 2024-08-18T22:22:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 -- 172.21.15.5:0/171273297 shutdown_connections 2024-08-18T22:22:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 --2- 172.21.15.5:0/171273297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba9e72d0 0x55ecba9c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 --2- 172.21.15.5:0/171273297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e69b0 0x55ecba9c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 --2- 172.21.15.5:0/171273297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba99a510 0x55ecba9fe2f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 -- 172.21.15.5:0/171273297 >> 172.21.15.5:0/171273297 conn(0x55ecba994020 msgr2=0x55ecba9c75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 -- 172.21.15.5:0/171273297 shutdown_connections 2024-08-18T22:22:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 -- 172.21.15.5:0/171273297 wait complete. 2024-08-18T22:22:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 -- start start 2024-08-18T22:22:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.671+0000 7faa27637000 1 Processor -- start 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba99a510 0x55ecbaa5a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecbaa5a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e72d0 0x55ecbaa5ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ecba86c950 con 0x55ecba9e69b0 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ecba7b5800 con 0x55ecba99a510 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ecba7c57b0 con 0x55ecba9e72d0 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 10 client.0 _ll_register_callbacks cb 0x7faa04003890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa20e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecbaa5a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa20e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecbaa5a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42238/0 (socket says 172.21.15.5:42238) 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa20e00640 1 -- 172.21.15.5:0/2163558212 learned_addr learned my addr 172.21.15.5:0/2163558212 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa21800640 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba99a510 0x55ecbaa5a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa22200640 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e72d0 0x55ecbaa5ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa20e00640 1 -- 172.21.15.5:0/2163558212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e72d0 msgr2=0x55ecbaa5ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa20e00640 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e72d0 0x55ecbaa5ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa20e00640 1 -- 172.21.15.5:0/2163558212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba99a510 msgr2=0x55ecbaa5a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa20e00640 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba99a510 0x55ecbaa5a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa20e00640 1 -- 172.21.15.5:0/2163558212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecba77dce0 con 0x55ecba9e69b0 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa22200640 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e72d0 0x55ecbaa5ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa20e00640 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecbaa5a7a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faa080190b0 tx=0x7faa08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e67cbcae78981b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa02a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa02a00640 1 -- 172.21.15.5:0/2163558212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080b1040 con 0x55ecba9e69b0 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa02a00640 1 -- 172.21.15.5:0/2163558212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7faa080ac5d0 con 0x55ecba9e69b0 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 -- 172.21.15.5:0/2163558212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa1001b040 con 0x55ecba9e69b0 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa02a00640 1 -- 172.21.15.5:0/2163558212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faa080ac7d0 con 0x55ecba9e69b0 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 10 client.5733 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 -- 172.21.15.5:0/2163558212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ecba790330 con 0x55ecba9e69b0 2024-08-18T22:22:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa02a00640 1 -- 172.21.15.5:0/2163558212 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1001b040 con 0x55ecba9e69b0 2024-08-18T22:22:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa02a00640 1 -- 172.21.15.5:0/2163558212 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7faa080d7050 con 0x55ecba9e69b0 2024-08-18T22:22:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 10 client.5733 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 10 client.5733 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 20 client.5733 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ecba9fbd10 0x55ecba9fc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 4 client.5733 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:22:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 -- 172.21.15.5:0/2163558212 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ecba7f7c30 con 0x55ecba9fbd10 2024-08-18T22:22:29.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa21800640 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ecba9fbd10 0x55ecba9fc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa02a00640 10 client.5733 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa21800640 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ecba9fbd10 0x55ecba9fc120 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e622cd88553fbf82 server_cookie=3ab8387b3e2845bb in_seq=0 out_seq=0 2024-08-18T22:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa02a00640 1 -- 172.21.15.5:0/2163558212 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ecba7f7c30 con 0x55ecba9fbd10 2024-08-18T22:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa02a00640 10 client.5733 handle_command_reply: tid=0 2024-08-18T22:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 client.5733 shutdown 2024-08-18T22:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 -- 172.21.15.5:0/2163558212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 msgr2=0x55ecbaa5a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecbaa5a7a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faa080190b0 tx=0x7faa08008040 comp rx=0 tx=0).stop 2024-08-18T22:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 -- 172.21.15.5:0/2163558212 shutdown_connections 2024-08-18T22:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ecba9fbd10 0x55ecba9fc120 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ecba9e72d0 0x55ecbaa5ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecba9e69b0 0x55ecbaa5a7a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 --2- 172.21.15.5:0/2163558212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ecba99a510 0x55ecbaa5a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa02a00640 0 client.5733 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 -- 172.21.15.5:0/2163558212 >> 172.21.15.5:0/2163558212 conn(0x55ecba994020 msgr2=0x55ecba9c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 -- 172.21.15.5:0/2163558212 shutdown_connections 2024-08-18T22:22:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 1 -- 172.21.15.5:0/2163558212 wait complete. 2024-08-18T22:22:29.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.675+0000 7faa27637000 20 client.5733 trim_cache size 0 max 16384 2024-08-18T22:22:29.686 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-18T22:22:29.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 -- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9fc0678f0 msgr2=0x7fa9fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9fc0678f0 0x7fa9fc069db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa10001570 tx=0x7faa10009040 comp rx=0 tx=0).stop 2024-08-18T22:22:29.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 -- 172.21.15.5:0/3729056912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0b1300 msgr2=0x7faa1c160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0b1300 0x7faa1c160670 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7faa1400c450 tx=0x7faa1400c910 comp rx=0 tx=0).stop 2024-08-18T22:22:29.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 -- 172.21.15.5:0/3729056912 shutdown_connections 2024-08-18T22:22:29.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9fc0678f0 0x7fa9fc069db0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0b1300 0x7faa1c160670 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa1c09b080 0x7faa1c14fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 --2- 172.21.15.5:0/3729056912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa1c09aca0 0x7faa1c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 -- 172.21.15.5:0/3729056912 >> 172.21.15.5:0/3729056912 conn(0x7faa1c0d2180 msgr2=0x7faa1c06fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 -- 172.21.15.5:0/3729056912 shutdown_connections 2024-08-18T22:22:29.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.679+0000 7faa24200640 1 -- 172.21.15.5:0/3729056912 wait complete. 2024-08-18T22:22:29.701 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a49.00000000 parent 2024-08-18T22:22:29.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.743+0000 7fbc16585080 1 Processor -- start 2024-08-18T22:22:29.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.743+0000 7fbc16585080 1 -- start start 2024-08-18T22:22:29.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.743+0000 7fbc16585080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 0x55b2b896b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.743+0000 7fbc16585080 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b2b896c950 0x55b2b88c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.743+0000 7fbc16585080 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b2b896cd30 0x55b2b88c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.743+0000 7fbc16585080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b2b87e6aa0 con 0x55b2b88e0b90 2024-08-18T22:22:29.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.743+0000 7fbc16585080 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b2b88401f0 con 0x55b2b896c950 2024-08-18T22:22:29.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.743+0000 7fbc16585080 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55b2b88c9620 con 0x55b2b896cd30 2024-08-18T22:22:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.743+0000 7fbc13800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 0x55b2b896b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.743+0000 7fbc13800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 0x55b2b896b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42246/0 (socket says 172.21.15.5:42246) 2024-08-18T22:22:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc13800640 1 -- 172.21.15.5:0/19427336 learned_addr learned my addr 172.21.15.5:0/19427336 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc14200640 1 --2- 172.21.15.5:0/19427336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b2b896cd30 0x55b2b88c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc12e00640 1 --2- 172.21.15.5:0/19427336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b2b896c950 0x55b2b88c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc13800640 1 -- 172.21.15.5:0/19427336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b2b896cd30 msgr2=0x55b2b88c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc13800640 1 --2- 172.21.15.5:0/19427336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b2b896cd30 0x55b2b88c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc13800640 1 -- 172.21.15.5:0/19427336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b2b896c950 msgr2=0x55b2b88c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc13800640 1 --2- 172.21.15.5:0/19427336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b2b896c950 0x55b2b88c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc13800640 1 -- 172.21.15.5:0/19427336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b8963870 con 0x55b2b88e0b90 2024-08-18T22:22:29.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc12e00640 1 --2- 172.21.15.5:0/19427336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b2b896c950 0x55b2b88c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc13800640 1 --2- 172.21.15.5:0/19427336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 0x55b2b896b180 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400b4e0 tx=0x7fbc0400b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed5b3e5e4d66c6b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc11a00640 1 -- 172.21.15.5:0/19427336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04012070 con 0x55b2b88e0b90 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc11a00640 1 -- 172.21.15.5:0/19427336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0400d6b0 con 0x55b2b88e0b90 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc11a00640 1 -- 172.21.15.5:0/19427336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400daa0 con 0x55b2b88e0b90 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 -- 172.21.15.5:0/19427336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 msgr2=0x55b2b896b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 --2- 172.21.15.5:0/19427336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 0x55b2b896b180 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400b4e0 tx=0x7fbc0400b9a0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 -- 172.21.15.5:0/19427336 shutdown_connections 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 --2- 172.21.15.5:0/19427336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b2b896cd30 0x55b2b88c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 --2- 172.21.15.5:0/19427336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b2b896c950 0x55b2b88c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 --2- 172.21.15.5:0/19427336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 0x55b2b896b180 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 -- 172.21.15.5:0/19427336 >> 172.21.15.5:0/19427336 conn(0x55b2b8895980 msgr2=0x55b2b8949b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 -- 172.21.15.5:0/19427336 shutdown_connections 2024-08-18T22:22:29.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 -- 172.21.15.5:0/19427336 wait complete. 2024-08-18T22:22:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 Processor -- start 2024-08-18T22:22:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 -- start start 2024-08-18T22:22:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 0x55b2b894d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b2b896c950 0x55b2b8968e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b2b896cd30 0x55b2b896e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b2b896e270 con 0x55b2b88e0b90 2024-08-18T22:22:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b2b896e4d0 con 0x55b2b896cd30 2024-08-18T22:22:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc16585080 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55b2b894a770 con 0x55b2b896c950 2024-08-18T22:22:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc13800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 0x55b2b894d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc13800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 0x55b2b894d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42252/0 (socket says 172.21.15.5:42252) 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc13800640 1 -- 172.21.15.5:0/3649958895 learned_addr learned my addr 172.21.15.5:0/3649958895 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc12e00640 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b2b896c950 0x55b2b8968e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.747+0000 7fbc14200640 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b2b896cd30 0x55b2b896e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc13800640 1 -- 172.21.15.5:0/3649958895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b2b896c950 msgr2=0x55b2b8968e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc13800640 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b2b896c950 0x55b2b8968e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc13800640 1 -- 172.21.15.5:0/3649958895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b2b896cd30 msgr2=0x55b2b896e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc13800640 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b2b896cd30 0x55b2b896e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc13800640 1 -- 172.21.15.5:0/3649958895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b8967f10 con 0x55b2b88e0b90 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc13800640 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 0x55b2b894d9c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbc04004180 tx=0x7fbc04001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc0be00640 1 -- 172.21.15.5:0/3649958895 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400ecc0 con 0x55b2b88e0b90 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc0be00640 1 -- 172.21.15.5:0/3649958895 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc04001420 con 0x55b2b88e0b90 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc0be00640 1 -- 172.21.15.5:0/3649958895 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04017690 con 0x55b2b88e0b90 2024-08-18T22:22:29.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc16585080 1 -- 172.21.15.5:0/3649958895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2b89681b0 con 0x55b2b88e0b90 2024-08-18T22:22:29.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc16585080 1 -- 172.21.15.5:0/3649958895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b89686f0 con 0x55b2b88e0b90 2024-08-18T22:22:29.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc0be00640 1 -- 172.21.15.5:0/3649958895 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbc04022070 con 0x55b2b88e0b90 2024-08-18T22:22:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc0be00640 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbbf40662a0 0x7fbbf4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc0be00640 1 -- 172.21.15.5:0/3649958895 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fbc04005030 con 0x55b2b88e0b90 2024-08-18T22:22:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc16585080 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x55b2b896edd0 0x55b2b894b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc12e00640 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbbf40662a0 0x7fbbf4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc16585080 1 -- 172.21.15.5:0/3649958895 --> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] -- osd_op(unknown.0.0:1 8.1f 8:f95eeb57:::10000000a49.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) -- 0x55b2b8a09750 con 0x55b2b896edd0 2024-08-18T22:22:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.751+0000 7fbc14200640 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x55b2b896edd0 0x55b2b894b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc14200640 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x55b2b896edd0 0x55b2b894b430 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc12e00640 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbbf40662a0 0x7fbbf4068760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbc000ac000 tx=0x7fbc000a5000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc14200640 1 -- 172.21.15.5:0/3649958895 <== osd.0 v2:172.21.15.5:6816/1731152634 1 ==== osd_op_reply(1 10000000a49.00000000 [rmxattr] v55'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbc0c003890 con 0x55b2b896edd0 2024-08-18T22:22:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc16585080 1 -- 172.21.15.5:0/3649958895 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x55b2b896edd0 msgr2=0x55b2b894b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc16585080 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x55b2b896edd0 0x55b2b894b430 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc16585080 1 -- 172.21.15.5:0/3649958895 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbbf40662a0 msgr2=0x7fbbf4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc16585080 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbbf40662a0 0x7fbbf4068760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbc000ac000 tx=0x7fbc000a5000 comp rx=0 tx=0).stop 2024-08-18T22:22:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc16585080 1 -- 172.21.15.5:0/3649958895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 msgr2=0x55b2b894d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc16585080 1 --2- 172.21.15.5:0/3649958895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2b88e0b90 0x55b2b894d9c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbc04004180 tx=0x7fbc04001160 comp rx=0 tx=0).stop 2024-08-18T22:22:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc14200640 1 -- 172.21.15.5:0/3649958895 reap_dead start 2024-08-18T22:22:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc16585080 1 -- 172.21.15.5:0/3649958895 shutdown_connections 2024-08-18T22:22:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc16585080 1 -- 172.21.15.5:0/3649958895 >> 172.21.15.5:0/3649958895 conn(0x55b2b8895980 msgr2=0x55b2b896fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc16585080 1 -- 172.21.15.5:0/3649958895 shutdown_connections 2024-08-18T22:22:29.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.755+0000 7fbc16585080 1 -- 172.21.15.5:0/3649958895 wait complete. 2024-08-18T22:22:29.764 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-08-18T22:22:29.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-08-18T22:22:29.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.943+0000 7f036e600640 1 Processor -- start 2024-08-18T22:22:29.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.943+0000 7f036e600640 1 -- start start 2024-08-18T22:22:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f036e600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03680b40c0 0x7f03680b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f036e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03680ce280 0x7f03680ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f036e600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03680b31f0 con 0x7f036815b0c0 2024-08-18T22:22:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f036e600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f03680b4a70 con 0x7f03680b40c0 2024-08-18T22:22:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f036e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03680b3d70 con 0x7f03680ce280 2024-08-18T22:22:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f0367400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f036815b0c0 0x7f036806db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43168/0 (socket says 172.21.15.5:43168) 2024-08-18T22:22:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f0367400640 1 -- 172.21.15.5:0/2065264200 learned_addr learned my addr 172.21.15.5:0/2065264200 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f0366a00640 1 --2- 172.21.15.5:0/2065264200 >> v2:172.21.15.5:3300/0 conn(0x7f03680b40c0 0x7f03680b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f0367e00640 1 --2- 172.21.15.5:0/2065264200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03680ce280 0x7f03680ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f0366a00640 1 -- 172.21.15.5:0/2065264200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03680ce280 msgr2=0x7f03680ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f0366a00640 1 --2- 172.21.15.5:0/2065264200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03680ce280 0x7f03680ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f0366a00640 1 -- 172.21.15.5:0/2065264200 >> v1:172.21.15.5:6789/0 conn(0x7f036815b0c0 legacy=0x7f036806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f0366a00640 1 -- 172.21.15.5:0/2065264200 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03680b34d0 con 0x7f03680b40c0 2024-08-18T22:22:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.947+0000 7f0366000640 1 -- 172.21.15.5:0/2065264200 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859658941 0 0) 0x7f03680b31f0 con 0x7f036815b0c0 2024-08-18T22:22:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f0366a00640 1 --2- 172.21.15.5:0/2065264200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03680b40c0 0x7f03680b4530 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f03540097c0 tx=0x7f035401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ade3b8a1cb689c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f0366000640 1 -- 172.21.15.5:0/2065264200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03540b0070 con 0x7f03680b40c0 2024-08-18T22:22:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f0366000640 1 -- 172.21.15.5:0/2065264200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03540ab600 con 0x7f03680b40c0 2024-08-18T22:22:29.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f0366000640 1 -- 172.21.15.5:0/2065264200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03540ab9d0 con 0x7f03680b40c0 2024-08-18T22:22:29.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 -- 172.21.15.5:0/2065264200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03680b40c0 msgr2=0x7f03680b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 --2- 172.21.15.5:0/2065264200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03680b40c0 0x7f03680b4530 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f03540097c0 tx=0x7f035401c380 comp rx=0 tx=0).stop 2024-08-18T22:22:29.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 -- 172.21.15.5:0/2065264200 shutdown_connections 2024-08-18T22:22:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 --2- 172.21.15.5:0/2065264200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03680ce280 0x7f03680ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 --2- 172.21.15.5:0/2065264200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03680b40c0 0x7f03680b4530 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 -- 172.21.15.5:0/2065264200 >> 172.21.15.5:0/2065264200 conn(0x7f03680b1dc0 msgr2=0x7f03680b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 -- 172.21.15.5:0/2065264200 shutdown_connections 2024-08-18T22:22:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 -- 172.21.15.5:0/2065264200 wait complete. 2024-08-18T22:22:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 Processor -- start 2024-08-18T22:22:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 -- start start 2024-08-18T22:22:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03680b40c0 0x7f03680ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03680ce280 0x7f0368150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036815b0c0 0x7f0368151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f036806f7f0 con 0x7f03680b40c0 2024-08-18T22:22:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f036806f670 con 0x7f03680ce280 2024-08-18T22:22:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f036e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0368167d10 con 0x7f036815b0c0 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f0367400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03680b40c0 0x7f03680ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f0367400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03680b40c0 0x7f03680ad030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42268/0 (socket says 172.21.15.5:42268) 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.951+0000 7f0367400640 1 -- 172.21.15.5:0/1935983172 learned_addr learned my addr 172.21.15.5:0/1935983172 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f0367e00640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036815b0c0 0x7f0368151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f0366a00640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03680ce280 0x7f0368150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f0367400640 1 -- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036815b0c0 msgr2=0x7f0368151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f0367400640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036815b0c0 0x7f0368151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f0367400640 1 -- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03680ce280 msgr2=0x7f0368150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f0367400640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03680ce280 0x7f0368150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f0367400640 1 -- 172.21.15.5:0/1935983172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03680cd8b0 con 0x7f03680b40c0 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f0367400640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03680b40c0 0x7f03680ad030 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f035800c480 tx=0x7f035800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f035f400640 1 -- 172.21.15.5:0/1935983172 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358018070 con 0x7f03680b40c0 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f035f400640 1 -- 172.21.15.5:0/1935983172 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0358007500 con 0x7f03680b40c0 2024-08-18T22:22:29.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f035f400640 1 -- 172.21.15.5:0/1935983172 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358004a30 con 0x7f03680b40c0 2024-08-18T22:22:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f036e600640 1 -- 172.21.15.5:0/1935983172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03680ad570 con 0x7f03680b40c0 2024-08-18T22:22:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f036e600640 1 -- 172.21.15.5:0/1935983172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f036815b900 con 0x7f03680b40c0 2024-08-18T22:22:29.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f035f400640 1 -- 172.21.15.5:0/1935983172 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0358004bd0 con 0x7f03680b40c0 2024-08-18T22:22:29.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.955+0000 7f035f400640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03480678c0 0x7f0348069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f035f400640 1 -- 172.21.15.5:0/1935983172 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f0358085000 con 0x7f03680b40c0 2024-08-18T22:22:29.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 Processor -- start 2024-08-18T22:22:29.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0366a00640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03480678c0 0x7f0348069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 -- start start 2024-08-18T22:22:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0366a00640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03480678c0 0x7f0348069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f03540ad000 tx=0x7f03540a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1e320 0x563022f1e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1ec40 0x563022ed48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022ed4de0 0x563022ed51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563022d22390 con 0x563022f1ec40 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563022cbdd60 con 0x563022f1e320 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563022d1e350 con 0x563022ed4de0 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0366a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1ec40 0x563022ed48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0366a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1ec40 0x563022ed48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42284/0 (socket says 172.21.15.5:42284) 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0366a00640 1 -- 172.21.15.5:0/2470106974 learned_addr learned my addr 172.21.15.5:0/2470106974 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0367400640 1 --2- 172.21.15.5:0/2470106974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1e320 0x563022f1e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0367e00640 1 --2- 172.21.15.5:0/2470106974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022ed4de0 0x563022ed51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0366a00640 1 -- 172.21.15.5:0/2470106974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022ed4de0 msgr2=0x563022ed51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0366a00640 1 --2- 172.21.15.5:0/2470106974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022ed4de0 0x563022ed51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0366a00640 1 -- 172.21.15.5:0/2470106974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1e320 msgr2=0x563022f1e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0366a00640 1 --2- 172.21.15.5:0/2470106974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1e320 0x563022f1e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0366a00640 1 -- 172.21.15.5:0/2470106974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563022cbdfb0 con 0x563022f1ec40 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0366a00640 1 --2- 172.21.15.5:0/2470106974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1ec40 0x563022ed48a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0354019fb0 tx=0x7f0354004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470e3aa0d21e6360 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0353e00640 1 -- 172.21.15.5:0/2470106974 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03540b0040 con 0x563022f1ec40 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0353e00640 1 -- 172.21.15.5:0/2470106974 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03540c8070 con 0x563022f1ec40 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f0353e00640 1 -- 172.21.15.5:0/2470106974 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03540c3810 con 0x563022f1ec40 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 -- 172.21.15.5:0/2470106974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1ec40 msgr2=0x563022ed48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 --2- 172.21.15.5:0/2470106974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1ec40 0x563022ed48a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0354019fb0 tx=0x7f0354004740 comp rx=0 tx=0).stop 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 -- 172.21.15.5:0/2470106974 shutdown_connections 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 --2- 172.21.15.5:0/2470106974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022ed4de0 0x563022ed51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 --2- 172.21.15.5:0/2470106974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1ec40 0x563022ed48a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 --2- 172.21.15.5:0/2470106974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1e320 0x563022f1e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 -- 172.21.15.5:0/2470106974 >> 172.21.15.5:0/2470106974 conn(0x563022dbc750 msgr2=0x563022ed3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 -- 172.21.15.5:0/2470106974 shutdown_connections 2024-08-18T22:22:29.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 -- 172.21.15.5:0/2470106974 wait complete. 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.959+0000 7f03719fd000 1 -- start start 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 1 Processor -- start 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022ed4de0 0x563022f25290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1e320 0x563022f257d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 0x563022f25d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563022cc3f10 con 0x563022f1e320 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563022ddf5d0 con 0x563022ed4de0 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563022d628a0 con 0x563022f1ec40 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 10 client.0 _ll_register_callbacks cb 0x563022ebfe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0366a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1e320 0x563022f257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0366a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1e320 0x563022f257d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42286/0 (socket says 172.21.15.5:42286) 2024-08-18T22:22:29.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0366a00640 1 -- 172.21.15.5:0/836263081 learned_addr learned my addr 172.21.15.5:0/836263081 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0367400640 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022ed4de0 0x563022f25290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0367e00640 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 0x563022f25d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0366a00640 1 -- 172.21.15.5:0/836263081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 msgr2=0x563022f25d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0366a00640 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 0x563022f25d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0366a00640 1 -- 172.21.15.5:0/836263081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022ed4de0 msgr2=0x563022f25290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0366a00640 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022ed4de0 0x563022f25290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0366a00640 1 -- 172.21.15.5:0/836263081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563022ceef30 con 0x563022f1e320 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0367e00640 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 0x563022f25d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0366a00640 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1e320 0x563022f257d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f035401c860 tx=0x7f035401abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166a1ae4c66f4dd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0350c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0350c00640 1 -- 172.21.15.5:0/836263081 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03540c36d0 con 0x563022f1e320 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0350c00640 1 -- 172.21.15.5:0/836263081 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f03540d7c50 con 0x563022f1e320 2024-08-18T22:22:29.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 1 -- 172.21.15.5:0/836263081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03540c8070 con 0x563022f1e320 2024-08-18T22:22:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0350c00640 1 -- 172.21.15.5:0/836263081 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f03540d7e50 con 0x563022f1e320 2024-08-18T22:22:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 10 client.5757 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 1 -- 172.21.15.5:0/836263081 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x563022da5360 con 0x563022f1e320 2024-08-18T22:22:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0350c00640 1 -- 172.21.15.5:0/836263081 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03540c8070 con 0x563022f1e320 2024-08-18T22:22:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0350c00640 1 -- 172.21.15.5:0/836263081 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f03540c3870 con 0x563022f1e320 2024-08-18T22:22:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 10 client.5757 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 10 client.5757 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 20 client.5757 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563022f2d660 0x563022f2fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 4 client.5757 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f03719fd000 1 -- 172.21.15.5:0/836263081 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563022cbcd30 con 0x563022f2d660 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0367400640 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563022f2d660 0x563022f2fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0367400640 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563022f2d660 0x563022f2fa50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3086c9fb005495e server_cookie=979749163c271ee in_seq=0 out_seq=0 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.963+0000 7f0350c00640 10 client.5757 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f0350c00640 1 -- 172.21.15.5:0/836263081 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563022cbcd30 con 0x563022f2d660 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f0350c00640 10 client.5757 handle_command_reply: tid=0 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 1 client.5757 shutdown 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 1 -- 172.21.15.5:0/836263081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1e320 msgr2=0x563022f257d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1e320 0x563022f257d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f035401c860 tx=0x7f035401abc0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 1 -- 172.21.15.5:0/836263081 shutdown_connections 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563022f2d660 0x563022f2fa50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 0x563022f25d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022f1e320 0x563022f257d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 1 --2- 172.21.15.5:0/836263081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022ed4de0 0x563022f25290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f0350c00640 0 client.5757 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 1 -- 172.21.15.5:0/836263081 >> 172.21.15.5:0/836263081 conn(0x563022dbc750 msgr2=0x563022ed3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 1 -- 172.21.15.5:0/836263081 shutdown_connections 2024-08-18T22:22:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 1 -- 172.21.15.5:0/836263081 wait complete. 2024-08-18T22:22:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.967+0000 7f03719fd000 20 client.5757 trim_cache size 0 max 16384 2024-08-18T22:22:29.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.983+0000 7f03719fd000 1 Processor -- start 2024-08-18T22:22:29.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.983+0000 7f03719fd000 1 -- start start 2024-08-18T22:22:29.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.983+0000 7f03719fd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f8db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1e320 0x563022f8e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 0x563022f8e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0368202c50 con 0x563022ed4de0 2024-08-18T22:22:29.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0368153a40 con 0x563022f1e320 2024-08-18T22:22:29.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0368202680 con 0x563022f1ec40 2024-08-18T22:22:29.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f8db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f8db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42296/0 (socket says 172.21.15.5:42296) 2024-08-18T22:22:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 -- 172.21.15.5:0/2106229544 learned_addr learned my addr 172.21.15.5:0/2106229544 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367e00640 1 --2- 172.21.15.5:0/2106229544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 0x563022f8e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0366a00640 1 --2- 172.21.15.5:0/2106229544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1e320 0x563022f8e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 -- 172.21.15.5:0/2106229544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 msgr2=0x563022f8e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 --2- 172.21.15.5:0/2106229544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 0x563022f8e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 -- 172.21.15.5:0/2106229544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1e320 msgr2=0x563022f8e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 --2- 172.21.15.5:0/2106229544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1e320 0x563022f8e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 -- 172.21.15.5:0/2106229544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563022d7b5e0 con 0x563022ed4de0 2024-08-18T22:22:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367e00640 1 --2- 172.21.15.5:0/2106229544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 0x563022f8e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 --2- 172.21.15.5:0/2106229544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f8db90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0358055330 tx=0x7f0358059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977f1e525745624a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0353400640 1 -- 172.21.15.5:0/2106229544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358001090 con 0x563022ed4de0 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0353400640 1 -- 172.21.15.5:0/2106229544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0358080020 con 0x563022ed4de0 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0353400640 1 -- 172.21.15.5:0/2106229544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358051a60 con 0x563022ed4de0 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- 172.21.15.5:0/2106229544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 msgr2=0x563022f8db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 --2- 172.21.15.5:0/2106229544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f8db90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0358055330 tx=0x7f0358059040 comp rx=0 tx=0).stop 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- 172.21.15.5:0/2106229544 shutdown_connections 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 --2- 172.21.15.5:0/2106229544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1ec40 0x563022f8e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 --2- 172.21.15.5:0/2106229544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1e320 0x563022f8e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 --2- 172.21.15.5:0/2106229544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f8db90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- 172.21.15.5:0/2106229544 >> 172.21.15.5:0/2106229544 conn(0x563022dbc750 msgr2=0x563022f1d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- 172.21.15.5:0/2106229544 shutdown_connections 2024-08-18T22:22:29.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- 172.21.15.5:0/2106229544 wait complete. 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- start start 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 Processor -- start 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f91b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1e320 0x563022f92090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1ec40 0x563022f925d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563022ca7dc0 con 0x563022ed4de0 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563022cdb2f0 con 0x563022f1ec40 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563022d216a0 con 0x563022f1e320 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f03719fd000 10 client.0 _ll_register_callbacks cb 0x7f03600096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f91b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f91b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42300/0 (socket says 172.21.15.5:42300) 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0367400640 1 -- 172.21.15.5:0/3601729472 learned_addr learned my addr 172.21.15.5:0/3601729472 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.987+0000 7f0366a00640 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1e320 0x563022f92090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0367e00640 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1ec40 0x563022f925d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0367400640 1 -- 172.21.15.5:0/3601729472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1e320 msgr2=0x563022f92090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0367400640 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1e320 0x563022f92090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0367400640 1 -- 172.21.15.5:0/3601729472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1ec40 msgr2=0x563022f925d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0367400640 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1ec40 0x563022f925d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0367400640 1 -- 172.21.15.5:0/3601729472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563022cd37d0 con 0x563022ed4de0 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0367e00640 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1ec40 0x563022f925d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0367400640 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f91b50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f035800c450 tx=0x7f0358083300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4467c606e055de24 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0350c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0350c00640 1 -- 172.21.15.5:0/3601729472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03580536f0 con 0x563022ed4de0 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0350c00640 1 -- 172.21.15.5:0/3601729472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f0358051a60 con 0x563022ed4de0 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 -- 172.21.15.5:0/3601729472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0358080020 con 0x563022ed4de0 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0350c00640 1 -- 172.21.15.5:0/3601729472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f035806d0c0 con 0x563022ed4de0 2024-08-18T22:22:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 10 client.5763 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:29.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 -- 172.21.15.5:0/3601729472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x563022cc8450 con 0x563022ed4de0 2024-08-18T22:22:29.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0350c00640 1 -- 172.21.15.5:0/3601729472 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0358080020 con 0x563022ed4de0 2024-08-18T22:22:29.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0350c00640 1 -- 172.21.15.5:0/3601729472 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f0358054840 con 0x563022ed4de0 2024-08-18T22:22:29.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 10 client.5763 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:29.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 10 client.5763 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:29.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 20 client.5763 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:29.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563022f4d200 0x563022f4d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:29.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 4 client.5763 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-08-18T22:22:29.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 -- 172.21.15.5:0/3601729472 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x563022d2fac0 con 0x563022f4d200 2024-08-18T22:22:29.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0366a00640 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563022f4d200 0x563022f4d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0366a00640 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563022f4d200 0x563022f4d610 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24cf0abb1657741c server_cookie=3dcc979d8eba705d in_seq=0 out_seq=0 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0350c00640 10 client.5763 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0350c00640 1 -- 172.21.15.5:0/3601729472 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563022d2fac0 con 0x563022f4d200 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0350c00640 10 client.5763 handle_command_reply: tid=0 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 client.5763 shutdown 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 -- 172.21.15.5:0/3601729472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 msgr2=0x563022f91b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f91b50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f035800c450 tx=0x7f0358083300 comp rx=0 tx=0).stop 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 -- 172.21.15.5:0/3601729472 shutdown_connections 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563022f4d200 0x563022f4d610 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563022f1ec40 0x563022f925d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563022f1e320 0x563022f92090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 --2- 172.21.15.5:0/3601729472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563022ed4de0 0x563022f91b50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 -- 172.21.15.5:0/3601729472 >> 172.21.15.5:0/3601729472 conn(0x563022dbc750 msgr2=0x563022f2fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f0350c00640 0 client.5763 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:30.001 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f13fb400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a49 [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v424 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5281=0-4194304@1} caps={5281=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5281 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55b68216c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a49:[<0x10000000001/new_file_0 v424>,<0x10000000000/ceph-qa-suite v40>,<0x1/scrub_test_path v15>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-08-18T22:22:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 -- 172.21.15.5:0/3601729472 shutdown_connections 2024-08-18T22:22:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 1 -- 172.21.15.5:0/3601729472 wait complete. 2024-08-18T22:22:30.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f03719fd000 20 client.5763 trim_cache size 0 max 16384 2024-08-18T22:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "df84d0de-65ac-4478-92f6-39f66cea6d92", 2024-08-18T22:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:22:30.002 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f036e600640 1 -- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03480678c0 msgr2=0x7f0348069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f036e600640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03480678c0 0x7f0348069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f03540ad000 tx=0x7f03540a6000 comp rx=0 tx=0).stop 2024-08-18T22:22:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f036e600640 1 -- 172.21.15.5:0/1935983172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03680b40c0 msgr2=0x7f03680ad030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f036e600640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03680b40c0 0x7f03680ad030 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f035800c480 tx=0x7f035800c940 comp rx=0 tx=0).stop 2024-08-18T22:22:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f036e600640 1 -- 172.21.15.5:0/1935983172 shutdown_connections 2024-08-18T22:22:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f036e600640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03480678c0 0x7f0348069d80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f036e600640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036815b0c0 0x7f0368151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f036e600640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03680ce280 0x7f0368150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f036e600640 1 --2- 172.21.15.5:0/1935983172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03680b40c0 0x7f03680ad030 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.991+0000 7f036e600640 1 -- 172.21.15.5:0/1935983172 >> 172.21.15.5:0/1935983172 conn(0x7f03680b1dc0 msgr2=0x7f03680b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:30.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.995+0000 7f036e600640 1 -- 172.21.15.5:0/1935983172 shutdown_connections 2024-08-18T22:22:30.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:29.995+0000 7f036e600640 1 -- 172.21.15.5:0/1935983172 wait complete. 2024-08-18T22:22:30.023 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': 'df84d0de-65ac-4478-92f6-39f66cea6d92', 'mode': 'asynchronous'}' 2024-08-18T22:22:30.023 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-18T22:22:30.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-08-18T22:22:30.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db7600640 1 Processor -- start 2024-08-18T22:22:30.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db7600640 1 -- start start 2024-08-18T22:22:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db7600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7db015fb80 0x7f7db00d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db7600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db00d30b0 con 0x7f7db00b5ad0 2024-08-18T22:22:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db7600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db00d1bd0 con 0x7f7db00d1090 2024-08-18T22:22:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db7600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7db0071c60 con 0x7f7db015fb80 2024-08-18T22:22:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db4c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7db015fb80 0x7f7db00d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db4c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7db015fb80 0x7f7db00d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42308/0 (socket says 172.21.15.5:42308) 2024-08-18T22:22:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db4c00640 1 -- 172.21.15.5:0/3592887611 learned_addr learned my addr 172.21.15.5:0/3592887611 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7dafe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7db00b5ad0 0x7f7db006fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43180/0 (socket says 172.21.15.5:43180) 2024-08-18T22:22:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db4c00640 1 -- 172.21.15.5:0/3592887611 >> v1:172.21.15.117:6789/0 conn(0x7f7db00d1090 legacy=0x7f7db0071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db4c00640 1 -- 172.21.15.5:0/3592887611 >> v1:172.21.15.5:6789/0 conn(0x7f7db00b5ad0 legacy=0x7f7db006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7daf400640 1 -- 172.21.15.5:0/3592887611 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920232935 0 0) 0x7f7db00d30b0 con 0x7f7db00b5ad0 2024-08-18T22:22:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.163+0000 7f7db4c00640 1 -- 172.21.15.5:0/3592887611 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db00d2dd0 con 0x7f7db015fb80 2024-08-18T22:22:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.167+0000 7f7db4c00640 1 --2- 172.21.15.5:0/3592887611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db015fb80 0x7f7db00d15e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009e50 tx=0x7f7da001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e580b6fa34da8fd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.167+0000 7f7daf400640 1 -- 172.21.15.5:0/3592887611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da00a56e0 con 0x7f7db015fb80 2024-08-18T22:22:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.167+0000 7f7daf400640 1 -- 172.21.15.5:0/3592887611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da00a5880 con 0x7f7db015fb80 2024-08-18T22:22:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.167+0000 7f7daf400640 1 -- 172.21.15.5:0/3592887611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da00a5c50 con 0x7f7db015fb80 2024-08-18T22:22:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.167+0000 7f7db7600640 1 -- 172.21.15.5:0/3592887611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db015fb80 msgr2=0x7f7db00d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.167+0000 7f7db7600640 1 --2- 172.21.15.5:0/3592887611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db015fb80 0x7f7db00d15e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009e50 tx=0x7f7da001c910 comp rx=0 tx=0).stop 2024-08-18T22:22:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.167+0000 7f7db7600640 1 -- 172.21.15.5:0/3592887611 shutdown_connections 2024-08-18T22:22:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.167+0000 7f7db7600640 1 --2- 172.21.15.5:0/3592887611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db015fb80 0x7f7db00d15e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.167+0000 7f7db7600640 1 -- 172.21.15.5:0/3592887611 >> 172.21.15.5:0/3592887611 conn(0x7f7db00d2180 msgr2=0x7f7db00d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.167+0000 7f7db7600640 1 -- 172.21.15.5:0/3592887611 shutdown_connections 2024-08-18T22:22:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.167+0000 7f7db7600640 1 -- 172.21.15.5:0/3592887611 wait complete. 2024-08-18T22:22:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db7600640 1 Processor -- start 2024-08-18T22:22:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db7600640 1 -- start start 2024-08-18T22:22:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db7600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db00b5ad0 0x7f7db0153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db7600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7db00d1090 0x7f7db014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db7600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db015fb80 0x7f7db014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db7600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7db00d1eb0 con 0x7f7db00b5ad0 2024-08-18T22:22:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db7600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7db016a310 con 0x7f7db00d1090 2024-08-18T22:22:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db7600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7db016a490 con 0x7f7db015fb80 2024-08-18T22:22:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db00b5ad0 0x7f7db0153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db00b5ad0 0x7f7db0153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42314/0 (socket says 172.21.15.5:42314) 2024-08-18T22:22:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db4c00640 1 -- 172.21.15.5:0/3454312625 learned_addr learned my addr 172.21.15.5:0/3454312625 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7dafe00640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7db00d1090 0x7f7db014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db5600640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db015fb80 0x7f7db014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db4c00640 1 -- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db015fb80 msgr2=0x7f7db014da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db4c00640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db015fb80 0x7f7db014da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db4c00640 1 -- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7db00d1090 msgr2=0x7f7db014e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db4c00640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7db00d1090 0x7f7db014e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db4c00640 1 -- 172.21.15.5:0/3454312625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db0152a60 con 0x7f7db00b5ad0 2024-08-18T22:22:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db5600640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db015fb80 0x7f7db014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db4c00640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db00b5ad0 0x7f7db0153bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7da00af040 tx=0x7f7da00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7dacc00640 1 -- 172.21.15.5:0/3454312625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da00bc020 con 0x7f7db00b5ad0 2024-08-18T22:22:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7dacc00640 1 -- 172.21.15.5:0/3454312625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da00b8670 con 0x7f7db00b5ad0 2024-08-18T22:22:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7dacc00640 1 -- 172.21.15.5:0/3454312625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da00b8a60 con 0x7f7db00b5ad0 2024-08-18T22:22:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db7600640 1 -- 172.21.15.5:0/3454312625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db0152d40 con 0x7f7db00b5ad0 2024-08-18T22:22:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.171+0000 7f7db7600640 1 -- 172.21.15.5:0/3454312625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db0156ca0 con 0x7f7db00b5ad0 2024-08-18T22:22:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.175+0000 7f7dacc00640 1 -- 172.21.15.5:0/3454312625 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7da00bf020 con 0x7f7db00b5ad0 2024-08-18T22:22:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.175+0000 7f7dacc00640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7d900678c0 0x7f7d90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.175+0000 7f7dacc00640 1 -- 172.21.15.5:0/3454312625 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f7da0120e10 con 0x7f7db00b5ad0 2024-08-18T22:22:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.175+0000 7f7dbab64000 1 Processor -- start 2024-08-18T22:22:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.175+0000 7f7dafe00640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7d900678c0 0x7f7d90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.175+0000 7f7dbab64000 1 -- start start 2024-08-18T22:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.175+0000 7f7dafe00640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7d900678c0 0x7f7d90069d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c007fd0 tx=0x7f7d9c007ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d635401ed0 0x55d6354022b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6354027f0 0x55d6353b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d63529aae0 con 0x55d6353b5910 2024-08-18T22:22:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d635286ba0 con 0x55d6354027f0 2024-08-18T22:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d6352014f0 con 0x55d635401ed0 2024-08-18T22:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7db5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7db5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42324/0 (socket says 172.21.15.5:42324) 2024-08-18T22:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7db5600640 1 -- 172.21.15.5:0/3998849085 learned_addr learned my addr 172.21.15.5:0/3998849085 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7db4c00640 1 --2- 172.21.15.5:0/3998849085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d635401ed0 0x55d6354022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dafe00640 1 --2- 172.21.15.5:0/3998849085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6354027f0 0x55d6353b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7db5600640 1 -- 172.21.15.5:0/3998849085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d635401ed0 msgr2=0x55d6354022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:30.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7db5600640 1 --2- 172.21.15.5:0/3998849085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d635401ed0 0x55d6354022b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7db5600640 1 -- 172.21.15.5:0/3998849085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6354027f0 msgr2=0x55d6353b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7db5600640 1 --2- 172.21.15.5:0/3998849085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6354027f0 0x55d6353b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7db5600640 1 -- 172.21.15.5:0/3998849085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6351a1a90 con 0x55d6353b5910 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7db4c00640 1 --2- 172.21.15.5:0/3998849085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d635401ed0 0x55d6354022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7db5600640 1 --2- 172.21.15.5:0/3998849085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353b5cf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7da8001610 tx=0x7f7da8001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8db4c6fc784853f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7da5600640 1 -- 172.21.15.5:0/3998849085 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8019070 con 0x55d6353b5910 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7da5600640 1 -- 172.21.15.5:0/3998849085 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8001d20 con 0x55d6353b5910 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7da5600640 1 -- 172.21.15.5:0/3998849085 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da800e740 con 0x55d6353b5910 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- 172.21.15.5:0/3998849085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 msgr2=0x55d6353b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 --2- 172.21.15.5:0/3998849085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353b5cf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7da8001610 tx=0x7f7da8001ad0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- 172.21.15.5:0/3998849085 shutdown_connections 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 --2- 172.21.15.5:0/3998849085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353b5cf0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 --2- 172.21.15.5:0/3998849085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6354027f0 0x55d6353b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 --2- 172.21.15.5:0/3998849085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d635401ed0 0x55d6354022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- 172.21.15.5:0/3998849085 >> 172.21.15.5:0/3998849085 conn(0x55d6353ab010 msgr2=0x55d6353e0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:30.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- 172.21.15.5:0/3998849085 shutdown_connections 2024-08-18T22:22:30.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- 172.21.15.5:0/3998849085 wait complete. 2024-08-18T22:22:30.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- start start 2024-08-18T22:22:30.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 Processor -- start 2024-08-18T22:22:30.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353e23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d635401ed0 0x55d6353e28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6354027f0 0x55d6353e2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d6351fd4b0 con 0x55d6353b5910 2024-08-18T22:22:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d6351bbb50 con 0x55d635401ed0 2024-08-18T22:22:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d6351a2d00 con 0x55d6354027f0 2024-08-18T22:22:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.179+0000 7f7dbab64000 10 client.0 _ll_register_callbacks cb 0x55d63539ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7db4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353e23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7db4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353e23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42330/0 (socket says 172.21.15.5:42330) 2024-08-18T22:22:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7db4c00640 1 -- 172.21.15.5:0/2392855122 learned_addr learned my addr 172.21.15.5:0/2392855122 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dafe00640 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d635401ed0 0x55d6353e28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7db5600640 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6354027f0 0x55d6353e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7db4c00640 1 -- 172.21.15.5:0/2392855122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6354027f0 msgr2=0x55d6353e2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7db4c00640 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6354027f0 0x55d6353e2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7db4c00640 1 -- 172.21.15.5:0/2392855122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d635401ed0 msgr2=0x55d6353e28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7db4c00640 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d635401ed0 0x55d6353e28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7db4c00640 1 -- 172.21.15.5:0/2392855122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6351ba060 con 0x55d6353b5910 2024-08-18T22:22:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7db4c00640 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353e23a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7da001ce80 tx=0x7f7da00c0f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b5cf6763b25194 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7d9a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7d9a000640 1 -- 172.21.15.5:0/2392855122 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da00f5460 con 0x55d6353b5910 2024-08-18T22:22:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7d9a000640 1 -- 172.21.15.5:0/2392855122 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f7da00f1310 con 0x55d6353b5910 2024-08-18T22:22:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 -- 172.21.15.5:0/2392855122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7da8001d20 con 0x55d6353b5910 2024-08-18T22:22:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7d9a000640 1 -- 172.21.15.5:0/2392855122 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7da00f9c90 con 0x55d6353b5910 2024-08-18T22:22:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 10 client.5778 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 -- 172.21.15.5:0/2392855122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55d6351cdf50 con 0x55d6353b5910 2024-08-18T22:22:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7d9a000640 1 -- 172.21.15.5:0/2392855122 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8001d20 con 0x55d6353b5910 2024-08-18T22:22:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7d9a000640 1 -- 172.21.15.5:0/2392855122 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f7db009b250 con 0x55d6353b5910 2024-08-18T22:22:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 10 client.5778 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 10 client.5778 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 20 client.5778 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55d6353e3830 0x55d635413180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 4 client.5778 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 -- 172.21.15.5:0/2392855122 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d63519be10 con 0x55d6353e3830 2024-08-18T22:22:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dafe00640 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55d6353e3830 0x55d635413180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dafe00640 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55d6353e3830 0x55d635413180 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9efe27a883c51ed6 server_cookie=44a359336dde7064 in_seq=0 out_seq=0 2024-08-18T22:22:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7d9a000640 10 client.5778 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7d9a000640 1 -- 172.21.15.5:0/2392855122 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d63519be10 con 0x55d6353e3830 2024-08-18T22:22:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7d9a000640 10 client.5778 handle_command_reply: tid=0 2024-08-18T22:22:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 client.5778 shutdown 2024-08-18T22:22:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 -- 172.21.15.5:0/2392855122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 msgr2=0x55d6353e23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353e23a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7da001ce80 tx=0x7f7da00c0f10 comp rx=0 tx=0).stop 2024-08-18T22:22:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 -- 172.21.15.5:0/2392855122 shutdown_connections 2024-08-18T22:22:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55d6353e3830 0x55d635413180 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6354027f0 0x55d6353e2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d635401ed0 0x55d6353e28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7d9a000640 0 client.5778 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:30.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 --2- 172.21.15.5:0/2392855122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d6353b5910 0x55d6353e23a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 -- 172.21.15.5:0/2392855122 >> 172.21.15.5:0/2392855122 conn(0x55d6353ab010 msgr2=0x55d6353b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:30.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 -- 172.21.15.5:0/2392855122 shutdown_connections 2024-08-18T22:22:30.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 1 -- 172.21.15.5:0/2392855122 wait complete. 2024-08-18T22:22:30.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.183+0000 7f7dbab64000 20 client.5778 trim_cache size 0 max 16384 2024-08-18T22:22:30.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7dbab64000 1 Processor -- start 2024-08-18T22:22:30.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7dbab64000 1 -- start start 2024-08-18T22:22:30.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6353ab010 0x55d6353e8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6353b5910 0x55d6353e91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635413180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7dbab64000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01ffa00 con 0x55d635401ed0 2024-08-18T22:22:30.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7dbab64000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01fea60 con 0x55d6353b5910 2024-08-18T22:22:30.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7dbab64000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7db006e5e0 con 0x55d6353ab010 2024-08-18T22:22:30.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7db5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635413180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7db5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635413180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42332/0 (socket says 172.21.15.5:42332) 2024-08-18T22:22:30.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7db5600640 1 -- 172.21.15.5:0/2438700224 learned_addr learned my addr 172.21.15.5:0/2438700224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:30.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7dafe00640 1 --2- 172.21.15.5:0/2438700224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6353b5910 0x55d6353e91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7db4c00640 1 --2- 172.21.15.5:0/2438700224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6353ab010 0x55d6353e8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7db5600640 1 -- 172.21.15.5:0/2438700224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6353ab010 msgr2=0x55d6353e8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7db5600640 1 --2- 172.21.15.5:0/2438700224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6353ab010 0x55d6353e8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7db5600640 1 -- 172.21.15.5:0/2438700224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6353b5910 msgr2=0x55d6353e91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7db5600640 1 --2- 172.21.15.5:0/2438700224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6353b5910 0x55d6353e91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7db5600640 1 -- 172.21.15.5:0/2438700224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d635283dd0 con 0x55d635401ed0 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7db5600640 1 --2- 172.21.15.5:0/2438700224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635413180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7da8000f70 tx=0x7f7da800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5274d7d7203ac453 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7da4c00640 1 -- 172.21.15.5:0/2438700224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8019040 con 0x55d635401ed0 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7da4c00640 1 -- 172.21.15.5:0/2438700224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8024070 con 0x55d635401ed0 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.203+0000 7f7da4c00640 1 -- 172.21.15.5:0/2438700224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da800e740 con 0x55d635401ed0 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 -- 172.21.15.5:0/2438700224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 msgr2=0x55d635413180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 --2- 172.21.15.5:0/2438700224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635413180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7da8000f70 tx=0x7f7da800a000 comp rx=0 tx=0).stop 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 -- 172.21.15.5:0/2438700224 shutdown_connections 2024-08-18T22:22:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 --2- 172.21.15.5:0/2438700224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635413180 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 --2- 172.21.15.5:0/2438700224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6353b5910 0x55d6353e91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 --2- 172.21.15.5:0/2438700224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6353ab010 0x55d6353e8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 -- 172.21.15.5:0/2438700224 >> 172.21.15.5:0/2438700224 conn(0x55d6353b0830 msgr2=0x55d6353dd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:30.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 -- 172.21.15.5:0/2438700224 shutdown_connections 2024-08-18T22:22:30.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 -- 172.21.15.5:0/2438700224 wait complete. 2024-08-18T22:22:30.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 -- start start 2024-08-18T22:22:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 Processor -- start 2024-08-18T22:22:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6353ab010 0x55d635415ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6353b5910 0x55d635416400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635431470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d6351cc7f0 con 0x55d635401ed0 2024-08-18T22:22:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7db006ec30 con 0x55d6353ab010 2024-08-18T22:22:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d6351db2c0 con 0x55d6353b5910 2024-08-18T22:22:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 10 client.0 _ll_register_callbacks cb 0x7f7da0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7db5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635431470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7db5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635431470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42336/0 (socket says 172.21.15.5:42336) 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7db5600640 1 -- 172.21.15.5:0/4255043554 learned_addr learned my addr 172.21.15.5:0/4255043554 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7db4c00640 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6353ab010 0x55d635415ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dafe00640 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6353b5910 0x55d635416400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7db5600640 1 -- 172.21.15.5:0/4255043554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6353b5910 msgr2=0x55d635416400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7db5600640 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6353b5910 0x55d635416400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7db5600640 1 -- 172.21.15.5:0/4255043554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6353ab010 msgr2=0x55d635415ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7db5600640 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6353ab010 0x55d635415ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7db5600640 1 -- 172.21.15.5:0/4255043554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d635194cd0 con 0x55d635401ed0 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dafe00640 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6353b5910 0x55d635416400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7db5600640 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635431470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7da8013000 tx=0x7f7da8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b652945ef82f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7d9a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7d9a000640 1 -- 172.21.15.5:0/4255043554 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8019040 con 0x55d635401ed0 2024-08-18T22:22:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7d9a000640 1 -- 172.21.15.5:0/4255043554 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f7da8010070 con 0x55d635401ed0 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 -- 172.21.15.5:0/4255043554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7da8024070 con 0x55d635401ed0 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7d9a000640 1 -- 172.21.15.5:0/4255043554 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7da8034050 con 0x55d635401ed0 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 10 client.5784 fetch_fsmap learned FSMap version 26 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.207+0000 7f7dbab64000 1 -- 172.21.15.5:0/4255043554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55d6351a7320 con 0x55d635401ed0 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7d9a000640 1 -- 172.21.15.5:0/4255043554 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8024070 con 0x55d635401ed0 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7d9a000640 1 -- 172.21.15.5:0/4255043554 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f7da8037020 con 0x55d635401ed0 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 10 client.5784 fetch_fsmap finished waiting for FSMap version 26 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 10 client.5784 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 20 client.5784 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55d6354027f0 0x55d635431e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 4 client.5784 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:22:30.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 -- 172.21.15.5:0/4255043554 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d63520ec20 con 0x55d6354027f0 2024-08-18T22:22:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db4c00640 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55d6354027f0 0x55d635431e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db4c00640 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55d6354027f0 0x55d635431e30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=514950870367b600 server_cookie=778211781a8b3784 in_seq=0 out_seq=0 2024-08-18T22:22:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7d9a000640 10 client.5784 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7d9a000640 1 -- 172.21.15.5:0/4255043554 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+903 (crc 0 0 0) 0x55d63520ec20 con 0x55d6354027f0 2024-08-18T22:22:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7d9a000640 10 client.5784 handle_command_reply: tid=0 2024-08-18T22:22:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 client.5784 shutdown 2024-08-18T22:22:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 -- 172.21.15.5:0/4255043554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 msgr2=0x55d635431470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635431470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7da8013000 tx=0x7f7da8000ee0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 -- 172.21.15.5:0/4255043554 shutdown_connections 2024-08-18T22:22:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55d6354027f0 0x55d635431e30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d635401ed0 0x55d635431470 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d6353b5910 0x55d635416400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 --2- 172.21.15.5:0/4255043554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d6353ab010 0x55d635415ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7d9a000640 0 client.5784 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 -- 172.21.15.5:0/4255043554 >> 172.21.15.5:0/4255043554 conn(0x55d6353b0830 msgr2=0x55d6353dd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 -- 172.21.15.5:0/4255043554 shutdown_connections 2024-08-18T22:22:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 1 -- 172.21.15.5:0/4255043554 wait complete. 2024-08-18T22:22:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7dbab64000 20 client.5784 trim_cache size 0 max 16384 2024-08-18T22:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-18T22:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-18T22:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "1296ec89-87d6-41b2-8d22-b21de2ef2e51": { 2024-08-18T22:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-08-18T22:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "1296ec89-87d6-41b2-8d22-b21de2ef2e51", 2024-08-18T22:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-08-18T22:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "7797be5a-e14b-4f04-95de-10a9d4d8d25a": { 2024-08-18T22:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-08-18T22:22:30.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "7797be5a-e14b-4f04-95de-10a9d4d8d25a", 2024-08-18T22:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-08-18T22:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "979534e0-9382-4046-bb9d-ac4440c7bc1d": { 2024-08-18T22:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-18T22:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "979534e0-9382-4046-bb9d-ac4440c7bc1d", 2024-08-18T22:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-08-18T22:22:30.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "df84d0de-65ac-4478-92f6-39f66cea6d92": { 2024-08-18T22:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-08-18T22:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "df84d0de-65ac-4478-92f6-39f66cea6d92", 2024-08-18T22:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-08-18T22:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 -- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7d900678c0 msgr2=0x7f7d90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7d900678c0 0x7f7d90069d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c007fd0 tx=0x7f7d9c007ba0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 -- 172.21.15.5:0/3454312625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db00b5ad0 msgr2=0x7f7db0153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db00b5ad0 0x7f7db0153bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7da00af040 tx=0x7f7da00196b0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 -- 172.21.15.5:0/3454312625 shutdown_connections 2024-08-18T22:22:30.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7d900678c0 0x7f7d90069d80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7db015fb80 0x7f7db014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7db00d1090 0x7f7db014e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 --2- 172.21.15.5:0/3454312625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db00b5ad0 0x7f7db0153bf0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:30.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 -- 172.21.15.5:0/3454312625 >> 172.21.15.5:0/3454312625 conn(0x7f7db00d2180 msgr2=0x7f7db00b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:30.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 -- 172.21.15.5:0/3454312625 shutdown_connections 2024-08-18T22:22:30.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:30.211+0000 7f7db7600640 1 -- 172.21.15.5:0/3454312625 wait complete. 2024-08-18T22:22:32.498 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:22:32.495+0000 7fc7f5400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-18T22:22:35.234 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-18T22:22:35.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-08-18T22:22:35.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.383+0000 7f8b80400640 1 Processor -- start 2024-08-18T22:22:35.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.383+0000 7f8b80400640 1 -- start start 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b80400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8b7815c180 0x7f8b780cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b80400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b7815c560 0x7f8b780ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b80400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b7815d4d0 0x7f8b780ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b80400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8b7815d040 con 0x7f8b7815d4d0 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b80400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8b780cfb00 con 0x7f8b7815c180 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b80400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7815c9f0 con 0x7f8b7815c560 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b7e400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b7815d4d0 0x7f8b780ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b7e400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b7815d4d0 0x7f8b780ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57342/0 (socket says 172.21.15.5:57342) 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b7e400640 1 -- 172.21.15.5:0/2625117381 learned_addr learned my addr 172.21.15.5:0/2625117381 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b7d000640 1 --2- 172.21.15.5:0/2625117381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b7815c560 0x7f8b780ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b7da00640 1 --2- 172.21.15.5:0/2625117381 >> v2:172.21.15.117:3300/0 conn(0x7f8b7815c180 0x7f8b780cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b7e400640 1 -- 172.21.15.5:0/2625117381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b7815c560 msgr2=0x7f8b780ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b7e400640 1 --2- 172.21.15.5:0/2625117381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b7815c560 0x7f8b780ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b7e400640 1 -- 172.21.15.5:0/2625117381 >> v2:172.21.15.117:3300/0 conn(0x7f8b7815c180 msgr2=0x7f8b780cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b7e400640 1 --2- 172.21.15.5:0/2625117381 >> v2:172.21.15.117:3300/0 conn(0x7f8b7815c180 0x7f8b780cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.387+0000 7f8b7e400640 1 -- 172.21.15.5:0/2625117381 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7815ccd0 con 0x7f8b7815d4d0 2024-08-18T22:22:35.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b7e400640 1 --2- 172.21.15.5:0/2625117381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7815d4d0 0x7f8b780ce990 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8b7806d8a0 tx=0x7f8b7001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3b7782175abf06 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b77e00640 1 -- 172.21.15.5:0/2625117381 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700a5800 con 0x7f8b7815d4d0 2024-08-18T22:22:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b77e00640 1 -- 172.21.15.5:0/2625117381 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b700a59a0 con 0x7f8b7815d4d0 2024-08-18T22:22:35.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b77e00640 1 -- 172.21.15.5:0/2625117381 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700a5d70 con 0x7f8b7815d4d0 2024-08-18T22:22:35.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b80400640 1 -- 172.21.15.5:0/2625117381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7815d4d0 msgr2=0x7f8b780ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b80400640 1 --2- 172.21.15.5:0/2625117381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7815d4d0 0x7f8b780ce990 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8b7806d8a0 tx=0x7f8b7001c960 comp rx=0 tx=0).stop 2024-08-18T22:22:35.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b80400640 1 -- 172.21.15.5:0/2625117381 shutdown_connections 2024-08-18T22:22:35.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b80400640 1 --2- 172.21.15.5:0/2625117381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7815d4d0 0x7f8b780ce990 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b80400640 1 --2- 172.21.15.5:0/2625117381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b7815c560 0x7f8b780ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b80400640 1 --2- 172.21.15.5:0/2625117381 >> v2:172.21.15.117:3300/0 conn(0x7f8b7815c180 0x7f8b780cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b80400640 1 -- 172.21.15.5:0/2625117381 >> 172.21.15.5:0/2625117381 conn(0x7f8b780b1dc0 msgr2=0x7f8b780b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b80400640 1 -- 172.21.15.5:0/2625117381 shutdown_connections 2024-08-18T22:22:35.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b80400640 1 -- 172.21.15.5:0/2625117381 wait complete. 2024-08-18T22:22:35.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b80400640 1 Processor -- start 2024-08-18T22:22:35.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.391+0000 7f8b80400640 1 -- start start 2024-08-18T22:22:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b80400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b7815c180 0x7f8b781518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b80400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b7815d4d0 0x7f8b7809d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b80400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7809d860 0x7f8b781597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b80400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b78160930 con 0x7f8b7809d860 2024-08-18T22:22:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b80400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b781607b0 con 0x7f8b7815c180 2024-08-18T22:22:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b80400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b78160ab0 con 0x7f8b7815d4d0 2024-08-18T22:22:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7809d860 0x7f8b781597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7809d860 0x7f8b781597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57356/0 (socket says 172.21.15.5:57356) 2024-08-18T22:22:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7e400640 1 -- 172.21.15.5:0/2059600368 learned_addr learned my addr 172.21.15.5:0/2059600368 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7da00640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b7815c180 0x7f8b781518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7d000640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b7815d4d0 0x7f8b7809d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7e400640 1 -- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b7815d4d0 msgr2=0x7f8b7809d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7e400640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b7815d4d0 0x7f8b7809d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7e400640 1 -- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b7815c180 msgr2=0x7f8b781518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7e400640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b7815c180 0x7f8b781518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7e400640 1 -- 172.21.15.5:0/2059600368 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7815a750 con 0x7f8b7809d860 2024-08-18T22:22:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7d000640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b7815d4d0 0x7f8b7809d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b7e400640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7809d860 0x7f8b781597b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8b700af040 tx=0x7f8b70019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b75600640 1 -- 172.21.15.5:0/2059600368 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700bc020 con 0x7f8b7809d860 2024-08-18T22:22:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b75600640 1 -- 172.21.15.5:0/2059600368 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b700b88a0 con 0x7f8b7809d860 2024-08-18T22:22:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b80400640 1 -- 172.21.15.5:0/2059600368 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7815a190 con 0x7f8b7809d860 2024-08-18T22:22:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b75600640 1 -- 172.21.15.5:0/2059600368 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700b8c90 con 0x7f8b7809d860 2024-08-18T22:22:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b80400640 1 -- 172.21.15.5:0/2059600368 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b7809cb20 con 0x7f8b7809d860 2024-08-18T22:22:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.395+0000 7f8b75600640 1 -- 172.21.15.5:0/2059600368 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b700bf020 con 0x7f8b7809d860 2024-08-18T22:22:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b75600640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b580678c0 0x7f8b58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b75600640 1 -- 172.21.15.5:0/2059600368 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8b70120ec0 con 0x7f8b7809d860 2024-08-18T22:22:35.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7da00640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b580678c0 0x7f8b58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b83969000 1 Processor -- start 2024-08-18T22:22:35.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b83969000 1 -- start start 2024-08-18T22:22:35.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7da00640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b580678c0 0x7f8b58069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8b7809ae40 tx=0x7f8b6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b83969000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc789ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b83969000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7851fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b83969000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 0x55ebc78528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b83969000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ebc773bae0 con 0x55ebc789f2c0 2024-08-18T22:22:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b83969000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ebc7727ba0 con 0x55ebc789e9a0 2024-08-18T22:22:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b83969000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ebc76a24f0 con 0x55ebc7852500 2024-08-18T22:22:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7851fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7851fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57366/0 (socket says 172.21.15.5:57366) 2024-08-18T22:22:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7d000640 1 -- 172.21.15.5:0/667546293 learned_addr learned my addr 172.21.15.5:0/667546293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7da00640 1 --2- 172.21.15.5:0/667546293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc789ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7e400640 1 --2- 172.21.15.5:0/667546293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 0x55ebc78528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7d000640 1 -- 172.21.15.5:0/667546293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 msgr2=0x55ebc78528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7d000640 1 --2- 172.21.15.5:0/667546293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 0x55ebc78528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7d000640 1 -- 172.21.15.5:0/667546293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 msgr2=0x55ebc789ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7d000640 1 --2- 172.21.15.5:0/667546293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc789ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7d000640 1 -- 172.21.15.5:0/667546293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc7642a90 con 0x55ebc789f2c0 2024-08-18T22:22:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7da00640 1 --2- 172.21.15.5:0/667546293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc789ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b7d000640 1 --2- 172.21.15.5:0/667546293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7851fc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8b64007a20 tx=0x7f8b64007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab48ae1cb41da69f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b6a000640 1 -- 172.21.15.5:0/667546293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64018020 con 0x55ebc789f2c0 2024-08-18T22:22:35.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b6a000640 1 -- 172.21.15.5:0/667546293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b6400fa80 con 0x55ebc789f2c0 2024-08-18T22:22:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b6a000640 1 -- 172.21.15.5:0/667546293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6400fe70 con 0x55ebc789f2c0 2024-08-18T22:22:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b83969000 1 -- 172.21.15.5:0/667546293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 msgr2=0x55ebc7851fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.399+0000 7f8b83969000 1 --2- 172.21.15.5:0/667546293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7851fc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8b64007a20 tx=0x7f8b64007e20 comp rx=0 tx=0).stop 2024-08-18T22:22:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 -- 172.21.15.5:0/667546293 shutdown_connections 2024-08-18T22:22:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 --2- 172.21.15.5:0/667546293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 0x55ebc78528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 --2- 172.21.15.5:0/667546293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7851fc0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 --2- 172.21.15.5:0/667546293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc789ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 -- 172.21.15.5:0/667546293 >> 172.21.15.5:0/667546293 conn(0x55ebc784c010 msgr2=0x55ebc7881820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 -- 172.21.15.5:0/667546293 shutdown_connections 2024-08-18T22:22:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 -- 172.21.15.5:0/667546293 wait complete. 2024-08-18T22:22:35.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 -- start start 2024-08-18T22:22:35.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 Processor -- start 2024-08-18T22:22:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc7852500 0x55ebc787f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc789e9a0 0x55ebc785a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc785a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ebc769e4b0 con 0x55ebc789f2c0 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ebc765cb50 con 0x55ebc7852500 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ebc7643d00 con 0x55ebc789e9a0 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 10 client.0 _ll_register_callbacks cb 0x55ebc783ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b7e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc785a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b7e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc785a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57378/0 (socket says 172.21.15.5:57378) 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b7e400640 1 -- 172.21.15.5:0/1101933559 learned_addr learned my addr 172.21.15.5:0/1101933559 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b7d000640 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc789e9a0 0x55ebc785a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b7da00640 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc7852500 0x55ebc787f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b7e400640 1 -- 172.21.15.5:0/1101933559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc789e9a0 msgr2=0x55ebc785a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b7e400640 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc789e9a0 0x55ebc785a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b7e400640 1 -- 172.21.15.5:0/1101933559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc7852500 msgr2=0x55ebc787f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b7e400640 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc7852500 0x55ebc787f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b7e400640 1 -- 172.21.15.5:0/1101933559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebc765b060 con 0x55ebc789f2c0 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b7e400640 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc785a5f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8b7001d200 tx=0x7f8b700f0b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ade095be300540 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1101933559 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700f9cc0 con 0x55ebc789f2c0 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1101933559 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8b70106db0 con 0x55ebc789f2c0 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 -- 172.21.15.5:0/1101933559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b6400fa80 con 0x55ebc789f2c0 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1101933559 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b7010e0a0 con 0x55ebc789f2c0 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 10 client.5796 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 -- 172.21.15.5:0/1101933559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ebc766ef50 con 0x55ebc789f2c0 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1101933559 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b6400fa80 con 0x55ebc789f2c0 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1101933559 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f8b7010f040 con 0x55ebc789f2c0 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 10 client.5796 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 10 client.5796 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 20 client.5796 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ebc7881060 0x55ebc78b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 4 client.5796 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.403+0000 7f8b83969000 1 -- 172.21.15.5:0/1101933559 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebc763ce10 con 0x55ebc7881060 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b7da00640 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ebc7881060 0x55ebc78b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b7da00640 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ebc7881060 0x55ebc78b0c60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d7813d5b6dd0036 server_cookie=79dda945a7b3857c in_seq=0 out_seq=0 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b5ea00640 10 client.5796 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1101933559 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ebc763ce10 con 0x55ebc7881060 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b5ea00640 10 client.5796 handle_command_reply: tid=0 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 1 client.5796 shutdown 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 1 -- 172.21.15.5:0/1101933559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 msgr2=0x55ebc785a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc785a5f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8b7001d200 tx=0x7f8b700f0b00 comp rx=0 tx=0).stop 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 1 -- 172.21.15.5:0/1101933559 shutdown_connections 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ebc7881060 0x55ebc78b0c60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc785a5f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc789e9a0 0x55ebc785a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 1 --2- 172.21.15.5:0/1101933559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc7852500 0x55ebc787f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 1 -- 172.21.15.5:0/1101933559 >> 172.21.15.5:0/1101933559 conn(0x55ebc784c010 msgr2=0x55ebc78516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b5ea00640 0 client.5796 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:35.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 1 -- 172.21.15.5:0/1101933559 shutdown_connections 2024-08-18T22:22:35.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 1 -- 172.21.15.5:0/1101933559 wait complete. 2024-08-18T22:22:35.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.407+0000 7f8b83969000 20 client.5796 trim_cache size 0 max 16384 2024-08-18T22:22:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 Processor -- start 2024-08-18T22:22:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 -- start start 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 0x55ebc78b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc7850790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7850cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b78203cc0 con 0x55ebc789f2c0 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b78202ce0 con 0x55ebc789e9a0 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7809c060 con 0x55ebc7852500 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b7e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7850cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b7e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7850cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57394/0 (socket says 172.21.15.5:57394) 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b7e400640 1 -- 172.21.15.5:0/3476558466 learned_addr learned my addr 172.21.15.5:0/3476558466 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b7e400640 1 -- 172.21.15.5:0/3476558466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 msgr2=0x55ebc78b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b7e400640 1 --2- 172.21.15.5:0/3476558466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 0x55ebc78b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b7e400640 1 -- 172.21.15.5:0/3476558466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 msgr2=0x55ebc7850790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b7e400640 1 --2- 172.21.15.5:0/3476558466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc7850790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b7e400640 1 -- 172.21.15.5:0/3476558466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc7724dd0 con 0x55ebc789f2c0 2024-08-18T22:22:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b7e400640 1 --2- 172.21.15.5:0/3476558466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7850cd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8b7001b010 tx=0x7f8b700c2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c23d763b9ce1de server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b69600640 1 -- 172.21.15.5:0/3476558466 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700f9cc0 con 0x55ebc789f2c0 2024-08-18T22:22:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b69600640 1 -- 172.21.15.5:0/3476558466 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b700f9830 con 0x55ebc789f2c0 2024-08-18T22:22:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b69600640 1 -- 172.21.15.5:0/3476558466 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700f0c20 con 0x55ebc789f2c0 2024-08-18T22:22:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 -- 172.21.15.5:0/3476558466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 msgr2=0x55ebc7850cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 --2- 172.21.15.5:0/3476558466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7850cd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8b7001b010 tx=0x7f8b700c2000 comp rx=0 tx=0).stop 2024-08-18T22:22:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 -- 172.21.15.5:0/3476558466 shutdown_connections 2024-08-18T22:22:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 --2- 172.21.15.5:0/3476558466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7850cd0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 --2- 172.21.15.5:0/3476558466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc7850790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 --2- 172.21.15.5:0/3476558466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 0x55ebc78b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 -- 172.21.15.5:0/3476558466 >> 172.21.15.5:0/3476558466 conn(0x55ebc784c010 msgr2=0x55ebc7856f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 -- 172.21.15.5:0/3476558466 shutdown_connections 2024-08-18T22:22:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 -- 172.21.15.5:0/3476558466 wait complete. 2024-08-18T22:22:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 -- start start 2024-08-18T22:22:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.427+0000 7f8b83969000 1 Processor -- start 2024-08-18T22:22:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 0x55ebc79119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc7911ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7912420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ebc76a1800 con 0x55ebc789f2c0 2024-08-18T22:22:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ebc766d7f0 con 0x55ebc789e9a0 2024-08-18T22:22:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ebc767c2c0 con 0x55ebc7852500 2024-08-18T22:22:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 10 client.0 _ll_register_callbacks cb 0x7f8b700f0eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7912420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7912420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57400/0 (socket says 172.21.15.5:57400) 2024-08-18T22:22:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7e400640 1 -- 172.21.15.5:0/1077263452 learned_addr learned my addr 172.21.15.5:0/1077263452 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7da00640 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 0x55ebc79119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7d000640 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc7911ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7e400640 1 -- 172.21.15.5:0/1077263452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 msgr2=0x55ebc79119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7e400640 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 0x55ebc79119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7e400640 1 -- 172.21.15.5:0/1077263452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 msgr2=0x55ebc7911ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7e400640 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc7911ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7e400640 1 -- 172.21.15.5:0/1077263452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebc7635cd0 con 0x55ebc789f2c0 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7e400640 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7912420 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8b7010e240 tx=0x7f8b7011f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdee35126c23264 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1077263452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700f0c20 con 0x55ebc789f2c0 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1077263452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8b70118bb0 con 0x55ebc789f2c0 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 -- 172.21.15.5:0/1077263452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b700f9830 con 0x55ebc789f2c0 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1077263452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b700f9cc0 con 0x55ebc789f2c0 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 10 client.5802 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 -- 172.21.15.5:0/1077263452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ebc7648320 con 0x55ebc789f2c0 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1077263452 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b700f9830 con 0x55ebc789f2c0 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1077263452 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f8b7010f040 con 0x55ebc789f2c0 2024-08-18T22:22:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 10 client.5802 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 10 client.5802 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 20 client.5802 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ebc78b26a0 0x55ebc78b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 4 client.5802 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 -- 172.21.15.5:0/1077263452 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ebc76afc20 con 0x55ebc78b26a0 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7da00640 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ebc78b26a0 0x55ebc78b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b7da00640 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ebc78b26a0 0x55ebc78b2ab0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=854088ca0aa93c9e server_cookie=989d2e3c8c1abb2 in_seq=0 out_seq=0 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b5ea00640 10 client.5802 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b5ea00640 1 -- 172.21.15.5:0/1077263452 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ebc76afc20 con 0x55ebc78b26a0 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b5ea00640 10 client.5802 handle_command_reply: tid=0 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 client.5802 shutdown 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 -- 172.21.15.5:0/1077263452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 msgr2=0x55ebc7912420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7912420 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8b7010e240 tx=0x7f8b7011f120 comp rx=0 tx=0).stop 2024-08-18T22:22:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 -- 172.21.15.5:0/1077263452 shutdown_connections 2024-08-18T22:22:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ebc78b26a0 0x55ebc78b2ab0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebc789f2c0 0x55ebc7912420 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ebc789e9a0 0x55ebc7911ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b5ea00640 0 client.5802 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 --2- 172.21.15.5:0/1077263452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ebc7852500 0x55ebc79119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 -- 172.21.15.5:0/1077263452 >> 172.21.15.5:0/1077263452 conn(0x55ebc784c010 msgr2=0x55ebc78ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 -- 172.21.15.5:0/1077263452 shutdown_connections 2024-08-18T22:22:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 1 -- 172.21.15.5:0/1077263452 wait complete. 2024-08-18T22:22:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.431+0000 7f8b83969000 20 client.5802 trim_cache size 0 max 16384 2024-08-18T22:22:35.442 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:35.442 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-18T22:22:35.442 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-08-18T22:22:35.442 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 -- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b580678c0 msgr2=0x7f8b58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b580678c0 0x7f8b58069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8b7809ae40 tx=0x7f8b6c008040 comp rx=0 tx=0).stop 2024-08-18T22:22:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 -- 172.21.15.5:0/2059600368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7809d860 msgr2=0x7f8b781597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7809d860 0x7f8b781597b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8b700af040 tx=0x7f8b70019700 comp rx=0 tx=0).stop 2024-08-18T22:22:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 -- 172.21.15.5:0/2059600368 shutdown_connections 2024-08-18T22:22:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b580678c0 0x7f8b58069d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7809d860 0x7f8b781597b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b7815d4d0 0x7f8b7809d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 --2- 172.21.15.5:0/2059600368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b7815c180 0x7f8b781518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 -- 172.21.15.5:0/2059600368 >> 172.21.15.5:0/2059600368 conn(0x7f8b780b1dc0 msgr2=0x7f8b7815f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 -- 172.21.15.5:0/2059600368 shutdown_connections 2024-08-18T22:22:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.435+0000 7f8b80400640 1 -- 172.21.15.5:0/2059600368 wait complete. 2024-08-18T22:22:35.456 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:22:35.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-08-18T22:22:35.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.595+0000 7f1623e00640 1 Processor -- start 2024-08-18T22:22:35.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.595+0000 7f1623e00640 1 -- start start 2024-08-18T22:22:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.595+0000 7f1623e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 0x7f162415d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.595+0000 7f1623e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16240b6020 0x7f16240b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.595+0000 7f1623e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16240b4650 0x7f162406fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.595+0000 7f1623e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f16240b4ac0 con 0x7f16240b4650 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.595+0000 7f1623e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1624156b50 con 0x7f16240b6020 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.595+0000 7f1623e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f16240b67e0 con 0x7f1624156770 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.595+0000 7f1623400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16240b4650 0x7f162406fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.595+0000 7f1623400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16240b4650 0x7f162406fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57404/0 (socket says 172.21.15.5:57404) 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.595+0000 7f1623400640 1 -- 172.21.15.5:0/1259645941 learned_addr learned my addr 172.21.15.5:0/1259645941 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1622a00640 1 --2- 172.21.15.5:0/1259645941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 0x7f162415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f161a000640 1 --2- 172.21.15.5:0/1259645941 >> v2:172.21.15.117:3300/0 conn(0x7f16240b6020 0x7f16240b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1623400640 1 -- 172.21.15.5:0/1259645941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 msgr2=0x7f162415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1623400640 1 --2- 172.21.15.5:0/1259645941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 0x7f162415d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1623400640 1 -- 172.21.15.5:0/1259645941 >> v2:172.21.15.117:3300/0 conn(0x7f16240b6020 msgr2=0x7f16240b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1623400640 1 --2- 172.21.15.5:0/1259645941 >> v2:172.21.15.117:3300/0 conn(0x7f16240b6020 0x7f16240b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1623400640 1 -- 172.21.15.5:0/1259645941 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16240b6ac0 con 0x7f16240b4650 2024-08-18T22:22:35.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1622a00640 1 --2- 172.21.15.5:0/1259645941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 0x7f162415d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:35.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1623400640 1 --2- 172.21.15.5:0/1259645941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16240b4650 0x7f162406fd70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f16240ceaf0 tx=0x7f161c01c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd98aa356d3e6a3a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1622000640 1 -- 172.21.15.5:0/1259645941 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c0ac020 con 0x7f16240b4650 2024-08-18T22:22:35.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1622000640 1 -- 172.21.15.5:0/1259645941 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f161c0a6420 con 0x7f16240b4650 2024-08-18T22:22:35.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1622000640 1 -- 172.21.15.5:0/1259645941 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c0a67f0 con 0x7f16240b4650 2024-08-18T22:22:35.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1623e00640 1 -- 172.21.15.5:0/1259645941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16240b4650 msgr2=0x7f162406fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1623e00640 1 --2- 172.21.15.5:0/1259645941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16240b4650 0x7f162406fd70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f16240ceaf0 tx=0x7f161c01c6a0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1623e00640 1 -- 172.21.15.5:0/1259645941 shutdown_connections 2024-08-18T22:22:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.599+0000 7f1623e00640 1 --2- 172.21.15.5:0/1259645941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16240b4650 0x7f162406fd70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 --2- 172.21.15.5:0/1259645941 >> v2:172.21.15.117:3300/0 conn(0x7f16240b6020 0x7f16240b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 --2- 172.21.15.5:0/1259645941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 0x7f162415d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 -- 172.21.15.5:0/1259645941 >> 172.21.15.5:0/1259645941 conn(0x7f1624067a70 msgr2=0x7f1624067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 -- 172.21.15.5:0/1259645941 shutdown_connections 2024-08-18T22:22:35.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 -- 172.21.15.5:0/1259645941 wait complete. 2024-08-18T22:22:35.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 Processor -- start 2024-08-18T22:22:35.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 -- start start 2024-08-18T22:22:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16240b4650 0x7f162415f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16240b6020 0x7f1624158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 0x7f1624154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f16240b6580 con 0x7f16240b4650 2024-08-18T22:22:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16240b6400 con 0x7f16240b6020 2024-08-18T22:22:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f16240d01b0 con 0x7f1624156770 2024-08-18T22:22:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1622a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16240b4650 0x7f162415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1622a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16240b4650 0x7f162415f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57408/0 (socket says 172.21.15.5:57408) 2024-08-18T22:22:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1622a00640 1 -- 172.21.15.5:0/3317685281 learned_addr learned my addr 172.21.15.5:0/3317685281 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f161a000640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16240b6020 0x7f1624158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1622a00640 1 -- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 msgr2=0x7f1624154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623400640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 0x7f1624154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1622a00640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 0x7f1624154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1622a00640 1 -- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16240b6020 msgr2=0x7f1624158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1622a00640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16240b6020 0x7f1624158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1622a00640 1 -- 172.21.15.5:0/3317685281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1624156e00 con 0x7f16240b4650 2024-08-18T22:22:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f161a000640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16240b6020 0x7f1624158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1623400640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 0x7f1624154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.603+0000 7f1622a00640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16240b4650 0x7f162415f360 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f161400d800 tx=0x7f161400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.607+0000 7f161be00640 1 -- 172.21.15.5:0/3317685281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614018020 con 0x7f16240b4650 2024-08-18T22:22:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.607+0000 7f161be00640 1 -- 172.21.15.5:0/3317685281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16140096c0 con 0x7f16240b4650 2024-08-18T22:22:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.607+0000 7f1623e00640 1 -- 172.21.15.5:0/3317685281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1624157140 con 0x7f16240b4650 2024-08-18T22:22:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.607+0000 7f161be00640 1 -- 172.21.15.5:0/3317685281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614009ab0 con 0x7f16240b4650 2024-08-18T22:22:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.607+0000 7f1623e00640 1 -- 172.21.15.5:0/3317685281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1624157980 con 0x7f16240b4650 2024-08-18T22:22:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.607+0000 7f161be00640 1 -- 172.21.15.5:0/3317685281 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f161401b020 con 0x7f16240b4650 2024-08-18T22:22:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.607+0000 7f161be00640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16000678c0 0x7f1600069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.607+0000 7f161be00640 1 -- 172.21.15.5:0/3317685281 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f1614086390 con 0x7f16240b4650 2024-08-18T22:22:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.607+0000 7f161a000640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16000678c0 0x7f1600069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.607+0000 7f162d229000 1 Processor -- start 2024-08-18T22:22:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.607+0000 7f162d229000 1 -- start start 2024-08-18T22:22:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f161a000640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16000678c0 0x7f1600069d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f160c0097c0 tx=0x7f160c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92c99b0 0x55f5c92c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92ca2d0 0x55f5c927cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c927d510 0x55f5c927d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f5c9166af0 con 0x55f5c92c99b0 2024-08-18T22:22:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f5c9152bb0 con 0x55f5c92ca2d0 2024-08-18T22:22:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f5c90cd500 con 0x55f5c927d510 2024-08-18T22:22:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1622a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92c99b0 0x55f5c92c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1622a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92c99b0 0x55f5c92c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57418/0 (socket says 172.21.15.5:57418) 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1622a00640 1 -- 172.21.15.5:0/2294383679 learned_addr learned my addr 172.21.15.5:0/2294383679 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f161a000640 1 --2- 172.21.15.5:0/2294383679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92ca2d0 0x55f5c927cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1623400640 1 --2- 172.21.15.5:0/2294383679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c927d510 0x55f5c927d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1622a00640 1 -- 172.21.15.5:0/2294383679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c927d510 msgr2=0x55f5c927d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1622a00640 1 --2- 172.21.15.5:0/2294383679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c927d510 0x55f5c927d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1622a00640 1 -- 172.21.15.5:0/2294383679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92ca2d0 msgr2=0x55f5c927cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1622a00640 1 --2- 172.21.15.5:0/2294383679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92ca2d0 0x55f5c927cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1622a00640 1 -- 172.21.15.5:0/2294383679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5c906daa0 con 0x55f5c92c99b0 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1622a00640 1 --2- 172.21.15.5:0/2294383679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92c99b0 0x55f5c92c9d90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f16140565c0 tx=0x7f1614056e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7a2beec9cecfa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1613e00640 1 -- 172.21.15.5:0/2294383679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161405f210 con 0x55f5c92c99b0 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1613e00640 1 -- 172.21.15.5:0/2294383679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1614054930 con 0x55f5c92c99b0 2024-08-18T22:22:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f1613e00640 1 -- 172.21.15.5:0/2294383679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614052ca0 con 0x55f5c92c99b0 2024-08-18T22:22:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 -- 172.21.15.5:0/2294383679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92c99b0 msgr2=0x55f5c92c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 --2- 172.21.15.5:0/2294383679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92c99b0 0x55f5c92c9d90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f16140565c0 tx=0x7f1614056e70 comp rx=0 tx=0).stop 2024-08-18T22:22:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 -- 172.21.15.5:0/2294383679 shutdown_connections 2024-08-18T22:22:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 --2- 172.21.15.5:0/2294383679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c927d510 0x55f5c927d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 --2- 172.21.15.5:0/2294383679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92ca2d0 0x55f5c927cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 --2- 172.21.15.5:0/2294383679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92c99b0 0x55f5c92c9d90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 -- 172.21.15.5:0/2294383679 >> 172.21.15.5:0/2294383679 conn(0x55f5c9277020 msgr2=0x55f5c92ac830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 -- 172.21.15.5:0/2294383679 shutdown_connections 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 -- 172.21.15.5:0/2294383679 wait complete. 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 -- start start 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.611+0000 7f162d229000 1 Processor -- start 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c927d510 0x55f5c92aa050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c92c99b0 0x55f5c92850c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c9285600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f5c90c94c0 con 0x55f5c92ca2d0 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f5c9087b60 con 0x55f5c927d510 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f5c906ed10 con 0x55f5c92c99b0 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 10 client.0 _ll_register_callbacks cb 0x55f5c926af40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1623400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c9285600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1623400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c9285600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57426/0 (socket says 172.21.15.5:57426) 2024-08-18T22:22:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1623400640 1 -- 172.21.15.5:0/3292621785 learned_addr learned my addr 172.21.15.5:0/3292621785 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1622a00640 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c927d510 0x55f5c92aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f161a000640 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c92c99b0 0x55f5c92850c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1623400640 1 -- 172.21.15.5:0/3292621785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c92c99b0 msgr2=0x55f5c92850c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1623400640 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c92c99b0 0x55f5c92850c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1623400640 1 -- 172.21.15.5:0/3292621785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c927d510 msgr2=0x55f5c92aa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1623400640 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c927d510 0x55f5c92aa050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1623400640 1 -- 172.21.15.5:0/3292621785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5c9086070 con 0x55f5c92ca2d0 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1622a00640 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c927d510 0x55f5c92aa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1623400640 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c9285600 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f161c01cb80 tx=0x7f161c01aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92435eb2c1235bd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1610c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1610c00640 1 -- 172.21.15.5:0/3292621785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c0ac040 con 0x55f5c92ca2d0 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 1 -- 172.21.15.5:0/3292621785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1614054930 con 0x55f5c92ca2d0 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1610c00640 1 -- 172.21.15.5:0/3292621785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f161c009110 con 0x55f5c92ca2d0 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1610c00640 1 -- 172.21.15.5:0/3292621785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f161c009510 con 0x55f5c92ca2d0 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 10 client.5814 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 1 -- 172.21.15.5:0/3292621785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f5c9099f60 con 0x55f5c92ca2d0 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1610c00640 1 -- 172.21.15.5:0/3292621785 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1614054930 con 0x55f5c92ca2d0 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1610c00640 1 -- 172.21.15.5:0/3292621785 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f161c0ba070 con 0x55f5c92ca2d0 2024-08-18T22:22:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 10 client.5814 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 10 client.5814 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 20 client.5814 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f5c92ac0a0 0x55f5c92dbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 4 client.5814 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f162d229000 1 -- 172.21.15.5:0/3292621785 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5c9067e20 con 0x55f5c92ac0a0 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1622a00640 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f5c92ac0a0 0x55f5c92dbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1622a00640 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f5c92ac0a0 0x55f5c92dbc70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d60e23051c051a80 server_cookie=37b6015a3d4e701b in_seq=0 out_seq=0 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.615+0000 7f1610c00640 10 client.5814 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f1610c00640 1 -- 172.21.15.5:0/3292621785 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5c9067e20 con 0x55f5c92ac0a0 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f1610c00640 10 client.5814 handle_command_reply: tid=0 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 1 client.5814 shutdown 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 1 -- 172.21.15.5:0/3292621785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 msgr2=0x55f5c9285600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c9285600 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f161c01cb80 tx=0x7f161c01aee0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 1 -- 172.21.15.5:0/3292621785 shutdown_connections 2024-08-18T22:22:35.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f5c92ac0a0 0x55f5c92dbc70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c9285600 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c92c99b0 0x55f5c92850c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 1 --2- 172.21.15.5:0/3292621785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c927d510 0x55f5c92aa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 1 -- 172.21.15.5:0/3292621785 >> 172.21.15.5:0/3292621785 conn(0x55f5c9277020 msgr2=0x55f5c927c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f1610c00640 0 client.5814 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:35.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 1 -- 172.21.15.5:0/3292621785 shutdown_connections 2024-08-18T22:22:35.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 1 -- 172.21.15.5:0/3292621785 wait complete. 2024-08-18T22:22:35.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.619+0000 7f162d229000 20 client.5814 trim_cache size 0 max 16384 2024-08-18T22:22:35.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.631+0000 7f162d229000 1 Processor -- start 2024-08-18T22:22:35.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.631+0000 7f162d229000 1 -- start start 2024-08-18T22:22:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.631+0000 7f162d229000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c927d510 0x55f5c92df4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.631+0000 7f162d229000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92c99b0 0x55f5c927c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.631+0000 7f162d229000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c927ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.631+0000 7f162d229000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1624203c10 con 0x55f5c92ca2d0 2024-08-18T22:22:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.631+0000 7f162d229000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1624202c10 con 0x55f5c92c99b0 2024-08-18T22:22:35.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.631+0000 7f162d229000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f16241f7a50 con 0x55f5c927d510 2024-08-18T22:22:35.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1623400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c927ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1623400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c927ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57442/0 (socket says 172.21.15.5:57442) 2024-08-18T22:22:35.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1623400640 1 -- 172.21.15.5:0/2305640241 learned_addr learned my addr 172.21.15.5:0/2305640241 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1623400640 1 -- 172.21.15.5:0/2305640241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c927d510 msgr2=0x55f5c92df4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1623400640 1 --2- 172.21.15.5:0/2305640241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c927d510 0x55f5c92df4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1623400640 1 -- 172.21.15.5:0/2305640241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92c99b0 msgr2=0x55f5c927c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1623400640 1 --2- 172.21.15.5:0/2305640241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92c99b0 0x55f5c927c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1623400640 1 -- 172.21.15.5:0/2305640241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5c914fde0 con 0x55f5c92ca2d0 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1623400640 1 --2- 172.21.15.5:0/2305640241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c927ccf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f161c01ad50 tx=0x7f161c0b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e334c9dfb14ea8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1613400640 1 -- 172.21.15.5:0/2305640241 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c0ac070 con 0x55f5c92ca2d0 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1613400640 1 -- 172.21.15.5:0/2305640241 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f161c0b27d0 con 0x55f5c92ca2d0 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1613400640 1 -- 172.21.15.5:0/2305640241 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c003bc0 con 0x55f5c92ca2d0 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 -- 172.21.15.5:0/2305640241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 msgr2=0x55f5c927ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 --2- 172.21.15.5:0/2305640241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c927ccf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f161c01ad50 tx=0x7f161c0b7000 comp rx=0 tx=0).stop 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 -- 172.21.15.5:0/2305640241 shutdown_connections 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 --2- 172.21.15.5:0/2305640241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c92ca2d0 0x55f5c927ccf0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 --2- 172.21.15.5:0/2305640241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92c99b0 0x55f5c927c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 --2- 172.21.15.5:0/2305640241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c927d510 0x55f5c92df4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 -- 172.21.15.5:0/2305640241 >> 172.21.15.5:0/2305640241 conn(0x55f5c9277020 msgr2=0x55f5c92aa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 -- 172.21.15.5:0/2305640241 shutdown_connections 2024-08-18T22:22:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 -- 172.21.15.5:0/2305640241 wait complete. 2024-08-18T22:22:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 -- start start 2024-08-18T22:22:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 Processor -- start 2024-08-18T22:22:35.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c927d510 0x55f5c92de410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92c99b0 0x55f5c92de950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c92ca2d0 0x55f5c92f9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f16242025c0 con 0x55f5c927d510 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f5c90cc810 con 0x55f5c92c99b0 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f5c9098800 con 0x55f5c92ca2d0 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f162d229000 10 client.0 _ll_register_callbacks cb 0x7f161c009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1622a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c927d510 0x55f5c92de410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1622a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c927d510 0x55f5c92de410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57450/0 (socket says 172.21.15.5:57450) 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1622a00640 1 -- 172.21.15.5:0/1407521804 learned_addr learned my addr 172.21.15.5:0/1407521804 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f161a000640 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92c99b0 0x55f5c92de950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.635+0000 7f1623400640 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c92ca2d0 0x55f5c92f9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1622a00640 1 -- 172.21.15.5:0/1407521804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c92ca2d0 msgr2=0x55f5c92f9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1622a00640 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c92ca2d0 0x55f5c92f9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1622a00640 1 -- 172.21.15.5:0/1407521804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92c99b0 msgr2=0x55f5c92de950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:35.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1622a00640 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92c99b0 0x55f5c92de950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1622a00640 1 -- 172.21.15.5:0/1407521804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5c9060ce0 con 0x55f5c927d510 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1622a00640 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c927d510 0x55f5c92de410 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f16140567f0 tx=0x7f16140845f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b481fe18b2b6262 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1610c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1610c00640 1 -- 172.21.15.5:0/1407521804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614054930 con 0x55f5c927d510 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1610c00640 1 -- 172.21.15.5:0/1407521804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f1614084350 con 0x55f5c927d510 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 -- 172.21.15.5:0/1407521804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f161c0b27d0 con 0x55f5c927d510 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1610c00640 1 -- 172.21.15.5:0/1407521804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1614052ca0 con 0x55f5c927d510 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 10 client.5820 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 -- 172.21.15.5:0/1407521804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f5c9073330 con 0x55f5c927d510 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1610c00640 1 -- 172.21.15.5:0/1407521804 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f161c0b27d0 con 0x55f5c927d510 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1610c00640 1 -- 172.21.15.5:0/1407521804 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f1614013050 con 0x55f5c927d510 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 10 client.5820 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 10 client.5820 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 20 client.5820 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f5c92fa920 0x55f5c933d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 4 client.5820 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 -- 172.21.15.5:0/1407521804 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f5c90dac30 con 0x55f5c92fa920 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f161a000640 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f5c92fa920 0x55f5c933d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f161a000640 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f5c92fa920 0x55f5c933d9c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aee4ed8fb3d9c11 server_cookie=74b1930219904485 in_seq=0 out_seq=0 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1610c00640 10 client.5820 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1610c00640 1 -- 172.21.15.5:0/1407521804 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+167 (crc 0 0 0) 0x55f5c90dac30 con 0x55f5c92fa920 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1610c00640 10 client.5820 handle_command_reply: tid=0 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 client.5820 shutdown 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 -- 172.21.15.5:0/1407521804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c927d510 msgr2=0x55f5c92de410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c927d510 0x55f5c92de410 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f16140567f0 tx=0x7f16140845f0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 -- 172.21.15.5:0/1407521804 shutdown_connections 2024-08-18T22:22:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f5c92fa920 0x55f5c933d9c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f5c92ca2d0 0x55f5c92f9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f5c92c99b0 0x55f5c92de950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1610c00640 0 client.5820 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:35.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 --2- 172.21.15.5:0/1407521804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f5c927d510 0x55f5c92de410 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 -- 172.21.15.5:0/1407521804 >> 172.21.15.5:0/1407521804 conn(0x55f5c9277020 msgr2=0x55f5c92aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 -- 172.21.15.5:0/1407521804 shutdown_connections 2024-08-18T22:22:35.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 1 -- 172.21.15.5:0/1407521804 wait complete. 2024-08-18T22:22:35.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f162d229000 20 client.5820 trim_cache size 0 max 16384 2024-08-18T22:22:35.648 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:22:35.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:35.649 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2024-08-18T22:22:35.649 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 563254647, 2024-08-18T22:22:35.649 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511630409, 2024-08-18T22:22:35.649 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-08-18T22:22:35.649 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:35.649 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:22:35.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 -- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16000678c0 msgr2=0x7f1600069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16000678c0 0x7f1600069d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f160c0097c0 tx=0x7f160c008040 comp rx=0 tx=0).stop 2024-08-18T22:22:35.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 -- 172.21.15.5:0/3317685281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16240b4650 msgr2=0x7f162415f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16240b4650 0x7f162415f360 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f161400d800 tx=0x7f161400dcc0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 -- 172.21.15.5:0/3317685281 shutdown_connections 2024-08-18T22:22:35.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16000678c0 0x7f1600069d80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1624156770 0x7f1624154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16240b6020 0x7f1624158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 --2- 172.21.15.5:0/3317685281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16240b4650 0x7f162415f360 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 -- 172.21.15.5:0/3317685281 >> 172.21.15.5:0/3317685281 conn(0x7f1624067a70 msgr2=0x7f162415a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 -- 172.21.15.5:0/3317685281 shutdown_connections 2024-08-18T22:22:35.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.639+0000 7f1623e00640 1 -- 172.21.15.5:0/3317685281 wait complete. 2024-08-18T22:22:35.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:22:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f1ce00640 1 Processor -- start 2024-08-18T22:22:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f1ce00640 1 -- start start 2024-08-18T22:22:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f1ce00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1813ec40 0x7f0f1815cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f1ce00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f18141770 con 0x7f0f1813f020 2024-08-18T22:22:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f1ce00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f18141a50 con 0x7f0f180d2a20 2024-08-18T22:22:35.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f1ce00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0f18142380 con 0x7f0f1813ec40 2024-08-18T22:22:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f0ea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0f1813f020 0x7f0f180d2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50406/0 (socket says 172.21.15.5:50406) 2024-08-18T22:22:35.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f0ea00640 1 -- 172.21.15.5:0/4046665972 learned_addr learned my addr 172.21.15.5:0/4046665972 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f17400640 1 --2- 172.21.15.5:0/4046665972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1813ec40 0x7f0f1815cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f16a00640 1 -- 172.21.15.5:0/4046665972 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2594369128 0 0) 0x7f0f18141770 con 0x7f0f1813f020 2024-08-18T22:22:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f16a00640 1 -- 172.21.15.5:0/4046665972 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0efc003530 con 0x7f0f1813f020 2024-08-18T22:22:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f16a00640 1 -- 172.21.15.5:0/4046665972 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59995513 0 0) 0x7f0f18141a50 con 0x7f0f180d2a20 2024-08-18T22:22:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f16a00640 1 -- 172.21.15.5:0/4046665972 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f18141770 con 0x7f0f180d2a20 2024-08-18T22:22:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f17400640 1 -- 172.21.15.5:0/4046665972 >> v1:172.21.15.117:6789/0 conn(0x7f0f180d2a20 legacy=0x7f0f180d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f17400640 1 -- 172.21.15.5:0/4046665972 >> v1:172.21.15.5:6789/0 conn(0x7f0f1813f020 legacy=0x7f0f180d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.807+0000 7f0f17400640 1 -- 172.21.15.5:0/4046665972 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f18141d30 con 0x7f0f1813ec40 2024-08-18T22:22:35.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.811+0000 7f0f17400640 1 --2- 172.21.15.5:0/4046665972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1813ec40 0x7f0f1815cd50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f18142500 tx=0x7f0f0801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93c09bfcc581f13c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.811+0000 7f0f16a00640 1 -- 172.21.15.5:0/4046665972 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f080b1070 con 0x7f0f1813ec40 2024-08-18T22:22:35.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.811+0000 7f0f16a00640 1 -- 172.21.15.5:0/4046665972 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f080ac620 con 0x7f0f1813ec40 2024-08-18T22:22:35.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.811+0000 7f0f16a00640 1 -- 172.21.15.5:0/4046665972 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f080ac9d0 con 0x7f0f1813ec40 2024-08-18T22:22:35.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.811+0000 7f0f1ce00640 1 -- 172.21.15.5:0/4046665972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1813ec40 msgr2=0x7f0f1815cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.811+0000 7f0f1ce00640 1 --2- 172.21.15.5:0/4046665972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1813ec40 0x7f0f1815cd50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f18142500 tx=0x7f0f0801c490 comp rx=0 tx=0).stop 2024-08-18T22:22:35.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.811+0000 7f0f1ce00640 1 -- 172.21.15.5:0/4046665972 shutdown_connections 2024-08-18T22:22:35.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.811+0000 7f0f1ce00640 1 --2- 172.21.15.5:0/4046665972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1813ec40 0x7f0f1815cd50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.811+0000 7f0f1ce00640 1 -- 172.21.15.5:0/4046665972 >> 172.21.15.5:0/4046665972 conn(0x7f0f18067840 msgr2=0x7f0f18067c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:35.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.811+0000 7f0f1ce00640 1 -- 172.21.15.5:0/4046665972 shutdown_connections 2024-08-18T22:22:35.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f1ce00640 1 -- 172.21.15.5:0/4046665972 wait complete. 2024-08-18T22:22:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f1ce00640 1 Processor -- start 2024-08-18T22:22:35.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f1ce00640 1 -- start start 2024-08-18T22:22:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f1ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f180d2a20 0x7f0f1813c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f1ce00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f1813ec40 0x7f0f180b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f1ce00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1813f020 0x7f0f18139b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f1ce00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0f180d1bf0 con 0x7f0f180d2a20 2024-08-18T22:22:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f1ce00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0f180d1a70 con 0x7f0f1813ec40 2024-08-18T22:22:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f1ce00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0f180d1d70 con 0x7f0f1813f020 2024-08-18T22:22:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f180d2a20 0x7f0f1813c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f180d2a20 0x7f0f1813c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57460/0 (socket says 172.21.15.5:57460) 2024-08-18T22:22:35.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f17400640 1 -- 172.21.15.5:0/3267339347 learned_addr learned my addr 172.21.15.5:0/3267339347 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f0ea00640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f1813ec40 0x7f0f180b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f17400640 1 -- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1813f020 msgr2=0x7f0f18139b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f17400640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1813f020 0x7f0f18139b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f17400640 1 -- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f1813ec40 msgr2=0x7f0f180b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f17400640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f1813ec40 0x7f0f180b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f17400640 1 -- 172.21.15.5:0/3267339347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1813b6d0 con 0x7f0f180d2a20 2024-08-18T22:22:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f0ea00640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f1813ec40 0x7f0f180b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f17400640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f180d2a20 0x7f0f1813c730 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0f0801a0c0 tx=0x7f0f08019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.815+0000 7f0f0fe00640 1 -- 172.21.15.5:0/3267339347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f080ba020 con 0x7f0f180d2a20 2024-08-18T22:22:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.819+0000 7f0f0fe00640 1 -- 172.21.15.5:0/3267339347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f080ac7d0 con 0x7f0f180d2a20 2024-08-18T22:22:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.819+0000 7f0f1ce00640 1 -- 172.21.15.5:0/3267339347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1813b970 con 0x7f0f180d2a20 2024-08-18T22:22:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.819+0000 7f0f0fe00640 1 -- 172.21.15.5:0/3267339347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f080b1040 con 0x7f0f180d2a20 2024-08-18T22:22:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.819+0000 7f0f1ce00640 1 -- 172.21.15.5:0/3267339347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1813bf30 con 0x7f0f180d2a20 2024-08-18T22:22:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.819+0000 7f0f1ce00640 1 -- 172.21.15.5:0/3267339347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1815cd50 con 0x7f0f180d2a20 2024-08-18T22:22:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.819+0000 7f0f0fe00640 1 -- 172.21.15.5:0/3267339347 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f080bd020 con 0x7f0f180d2a20 2024-08-18T22:22:35.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.819+0000 7f0f0fe00640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678c0 0x7f0ef4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:35.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.819+0000 7f0f0fe00640 1 -- 172.21.15.5:0/3267339347 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f0f0811fe00 con 0x7f0f180d2a20 2024-08-18T22:22:35.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.819+0000 7f0f0ea00640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678c0 0x7f0ef4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:35.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.819+0000 7f0f0ea00640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678c0 0x7f0ef4069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0f1815e940 tx=0x7f0f00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:35.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:35.823+0000 7f0f0fe00640 1 -- 172.21.15.5:0/3267339347 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0f080c4030 con 0x7f0f180d2a20 2024-08-18T22:22:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.023+0000 7f0f1ce00640 1 -- 172.21.15.5:0/3267339347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f180721f0 con 0x7f0f180d2a20 2024-08-18T22:22:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.023+0000 7f0f0fe00640 1 -- 172.21.15.5:0/3267339347 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5220 (secure 0 0 0) 0x7f0f080160b0 con 0x7f0f180d2a20 2024-08-18T22:22:36.029 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:36.029 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"btime":"2024-08-18T22:22:32:499269+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3185015921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3185015921},{"type":"v1","addr":"172.21.15.117:6837","nonce":3185015921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3679281629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3679281629},{"type":"v1","addr":"172.21.15.117:6836","nonce":3679281629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/649845928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":649845928},{"type":"v1","addr":"172.21.15.5:6833","nonce":649845928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:22:10.822677+0000","modified":"2024-08-18T22:22:31.713110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.5:6835/3590404197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3590404197},{"type":"v1","addr":"172.21.15.5:6835","nonce":3590404197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5370,"qdb_cluster":[5370]},"id":3}]} 2024-08-18T22:22:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2024-08-18T22:22:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 -- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678c0 msgr2=0x7f0ef4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678c0 0x7f0ef4069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0f1815e940 tx=0x7f0f00009040 comp rx=0 tx=0).stop 2024-08-18T22:22:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 -- 172.21.15.5:0/3267339347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f180d2a20 msgr2=0x7f0f1813c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f180d2a20 0x7f0f1813c730 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0f0801a0c0 tx=0x7f0f08019230 comp rx=0 tx=0).stop 2024-08-18T22:22:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 -- 172.21.15.5:0/3267339347 shutdown_connections 2024-08-18T22:22:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678c0 0x7f0ef4069d80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1813f020 0x7f0f18139b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f1813ec40 0x7f0f180b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 --2- 172.21.15.5:0/3267339347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f180d2a20 0x7f0f1813c730 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 -- 172.21.15.5:0/3267339347 >> 172.21.15.5:0/3267339347 conn(0x7f0f18067840 msgr2=0x7f0f1815f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 -- 172.21.15.5:0/3267339347 shutdown_connections 2024-08-18T22:22:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.027+0000 7f0f1ce00640 1 -- 172.21.15.5:0/3267339347 wait complete. 2024-08-18T22:22:36.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 563254647 2024-08-18T22:22:36.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.191+0000 7f836ba00640 1 Processor -- start 2024-08-18T22:22:36.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.191+0000 7f836ba00640 1 -- start start 2024-08-18T22:22:36.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f836ba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83640b40c0 0x7f83640b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f836ba00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83640ce280 0x7f83640ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f836ba00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83640b31f0 con 0x7f836415b0c0 2024-08-18T22:22:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f836ba00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f83640b3d70 con 0x7f83640ce280 2024-08-18T22:22:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f836ba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f83640b4a40 con 0x7f83640b40c0 2024-08-18T22:22:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f8369a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83640ce280 0x7f83640ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f8369a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83640ce280 0x7f83640ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57470/0 (socket says 172.21.15.5:57470) 2024-08-18T22:22:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f8369a00640 1 -- 172.21.15.5:0/3221324765 learned_addr learned my addr 172.21.15.5:0/3221324765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f835be00640 1 --2- 172.21.15.5:0/3221324765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83640b40c0 0x7f83640b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f8369a00640 1 -- 172.21.15.5:0/3221324765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83640b40c0 msgr2=0x7f83640b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f8369a00640 1 --2- 172.21.15.5:0/3221324765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83640b40c0 0x7f83640b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f8369a00640 1 -- 172.21.15.5:0/3221324765 >> v1:172.21.15.117:6789/0 conn(0x7f836415b0c0 legacy=0x7f836406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.195+0000 7f8369a00640 1 -- 172.21.15.5:0/3221324765 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83640b34d0 con 0x7f83640ce280 2024-08-18T22:22:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f8369a00640 1 --2- 172.21.15.5:0/3221324765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83640ce280 0x7f83640ce6d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f835c009e50 tx=0x7f835c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba3632c38fdf28f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f8363e00640 1 -- 172.21.15.5:0/3221324765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c0a56c0 con 0x7f83640ce280 2024-08-18T22:22:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f8363e00640 1 -- 172.21.15.5:0/3221324765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835c0a5860 con 0x7f83640ce280 2024-08-18T22:22:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f8363e00640 1 -- 172.21.15.5:0/3221324765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c0a5c30 con 0x7f83640ce280 2024-08-18T22:22:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 -- 172.21.15.5:0/3221324765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83640ce280 msgr2=0x7f83640ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 --2- 172.21.15.5:0/3221324765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83640ce280 0x7f83640ce6d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f835c009e50 tx=0x7f835c01c910 comp rx=0 tx=0).stop 2024-08-18T22:22:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 -- 172.21.15.5:0/3221324765 shutdown_connections 2024-08-18T22:22:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 --2- 172.21.15.5:0/3221324765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83640ce280 0x7f83640ce6d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 --2- 172.21.15.5:0/3221324765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83640b40c0 0x7f83640b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 -- 172.21.15.5:0/3221324765 >> 172.21.15.5:0/3221324765 conn(0x7f83640b1dc0 msgr2=0x7f83640b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 -- 172.21.15.5:0/3221324765 shutdown_connections 2024-08-18T22:22:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 -- 172.21.15.5:0/3221324765 wait complete. 2024-08-18T22:22:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 Processor -- start 2024-08-18T22:22:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 -- start start 2024-08-18T22:22:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83640b40c0 0x7f8364099910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83640ce280 0x7f836409daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f836415b0c0 0x7f836409e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f836406f7f0 con 0x7f83640ce280 2024-08-18T22:22:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f836406f670 con 0x7f836415b0c0 2024-08-18T22:22:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.199+0000 7f836ba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8364167d10 con 0x7f83640b40c0 2024-08-18T22:22:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f835be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83640ce280 0x7f836409daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f835be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83640ce280 0x7f836409daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57478/0 (socket says 172.21.15.5:57478) 2024-08-18T22:22:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f835be00640 1 -- 172.21.15.5:0/2999200307 learned_addr learned my addr 172.21.15.5:0/2999200307 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f8369000640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83640b40c0 0x7f8364099910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f8369a00640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f836415b0c0 0x7f836409e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f835be00640 1 -- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83640b40c0 msgr2=0x7f8364099910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f835be00640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83640b40c0 0x7f8364099910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f835be00640 1 -- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f836415b0c0 msgr2=0x7f836409e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f835be00640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f836415b0c0 0x7f836409e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f835be00640 1 -- 172.21.15.5:0/2999200307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836409ac70 con 0x7f83640ce280 2024-08-18T22:22:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f8369a00640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f836415b0c0 0x7f836409e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:36.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f835be00640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83640ce280 0x7f836409daf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f834c00e870 tx=0x7f834c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f8361600640 1 -- 172.21.15.5:0/2999200307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c017070 con 0x7f83640ce280 2024-08-18T22:22:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f8361600640 1 -- 172.21.15.5:0/2999200307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834c00c940 con 0x7f83640ce280 2024-08-18T22:22:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f836ba00640 1 -- 172.21.15.5:0/2999200307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836409af50 con 0x7f83640ce280 2024-08-18T22:22:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f8361600640 1 -- 172.21.15.5:0/2999200307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c00ccf0 con 0x7f83640ce280 2024-08-18T22:22:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f836ba00640 1 -- 172.21.15.5:0/2999200307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f836409b510 con 0x7f83640ce280 2024-08-18T22:22:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f8361600640 1 -- 172.21.15.5:0/2999200307 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f834c01a070 con 0x7f83640ce280 2024-08-18T22:22:36.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.203+0000 7f8361600640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83400678c0 0x7f8340069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f8361600640 1 -- 172.21.15.5:0/2999200307 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f834c086080 con 0x7f83640ce280 2024-08-18T22:22:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f8369000640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83400678c0 0x7f8340069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 Processor -- start 2024-08-18T22:22:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 -- start start 2024-08-18T22:22:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f8369000640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83400678c0 0x7f8340069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8354001810 tx=0x7f8354009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b733d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733da90 0x55f6b72f0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b72f0c70 0x55f6b72f1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f6b713e140 con 0x55f6b733da90 2024-08-18T22:22:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f6b70f8c20 con 0x55f6b733d170 2024-08-18T22:22:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f6b713a100 con 0x55f6b72f0c70 2024-08-18T22:22:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f835be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733da90 0x55f6b72f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f835be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733da90 0x55f6b72f0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57484/0 (socket says 172.21.15.5:57484) 2024-08-18T22:22:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f835be00640 1 -- 172.21.15.5:0/2106292254 learned_addr learned my addr 172.21.15.5:0/2106292254 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f8369000640 1 --2- 172.21.15.5:0/2106292254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b733d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f8369a00640 1 --2- 172.21.15.5:0/2106292254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b72f0c70 0x55f6b72f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f835be00640 1 -- 172.21.15.5:0/2106292254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b72f0c70 msgr2=0x55f6b72f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f835be00640 1 --2- 172.21.15.5:0/2106292254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b72f0c70 0x55f6b72f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f835be00640 1 -- 172.21.15.5:0/2106292254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 msgr2=0x55f6b733d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f835be00640 1 --2- 172.21.15.5:0/2106292254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b733d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f835be00640 1 -- 172.21.15.5:0/2106292254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6b71833d0 con 0x55f6b733da90 2024-08-18T22:22:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f8369a00640 1 --2- 172.21.15.5:0/2106292254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b72f0c70 0x55f6b72f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f835be00640 1 --2- 172.21.15.5:0/2106292254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733da90 0x55f6b72f0730 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f834c0527a0 tx=0x7f834c056340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4e067739e1a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f8359600640 1 -- 172.21.15.5:0/2106292254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c021040 con 0x55f6b733da90 2024-08-18T22:22:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f8359600640 1 -- 172.21.15.5:0/2106292254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834c054640 con 0x55f6b733da90 2024-08-18T22:22:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f8359600640 1 -- 172.21.15.5:0/2106292254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c0529b0 con 0x55f6b733da90 2024-08-18T22:22:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 -- 172.21.15.5:0/2106292254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733da90 msgr2=0x55f6b72f0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 --2- 172.21.15.5:0/2106292254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733da90 0x55f6b72f0730 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f834c0527a0 tx=0x7f834c056340 comp rx=0 tx=0).stop 2024-08-18T22:22:36.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 -- 172.21.15.5:0/2106292254 shutdown_connections 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 --2- 172.21.15.5:0/2106292254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b72f0c70 0x55f6b72f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 --2- 172.21.15.5:0/2106292254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733da90 0x55f6b72f0730 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 --2- 172.21.15.5:0/2106292254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b733d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 -- 172.21.15.5:0/2106292254 >> 172.21.15.5:0/2106292254 conn(0x55f6b731dff0 msgr2=0x55f6b7320410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 -- 172.21.15.5:0/2106292254 shutdown_connections 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.207+0000 7f836eeb0000 1 -- 172.21.15.5:0/2106292254 wait complete. 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 -- start start 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 Processor -- start 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b72f0c70 0x55f6b731d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733d170 0x55f6b73227b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733da90 0x55f6b7322cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f6b71becb0 con 0x55f6b733d170 2024-08-18T22:22:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f6b70dfc90 con 0x55f6b733da90 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f6b7142770 con 0x55f6b72f0c70 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 10 client.0 _ll_register_callbacks cb 0x55f6b70fb640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f835be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733d170 0x55f6b73227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f835be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733d170 0x55f6b73227b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57500/0 (socket says 172.21.15.5:57500) 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f835be00640 1 -- 172.21.15.5:0/2048177139 learned_addr learned my addr 172.21.15.5:0/2048177139 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f8369000640 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b72f0c70 0x55f6b731d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f8369a00640 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733da90 0x55f6b7322cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f835be00640 1 -- 172.21.15.5:0/2048177139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b72f0c70 msgr2=0x55f6b731d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f835be00640 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b72f0c70 0x55f6b731d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f835be00640 1 -- 172.21.15.5:0/2048177139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733da90 msgr2=0x55f6b7322cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f835be00640 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733da90 0x55f6b7322cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f835be00640 1 -- 172.21.15.5:0/2048177139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6b70de6e0 con 0x55f6b733d170 2024-08-18T22:22:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f835be00640 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733d170 0x55f6b73227b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f834c00e840 tx=0x7f834c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d227bd961583f76a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f8352000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f8352000640 1 -- 172.21.15.5:0/2048177139 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c073060 con 0x55f6b733d170 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f8352000640 1 -- 172.21.15.5:0/2048177139 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f834c05a370 con 0x55f6b733d170 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 -- 172.21.15.5:0/2048177139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f834c054640 con 0x55f6b733d170 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f8352000640 1 -- 172.21.15.5:0/2048177139 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f834c021040 con 0x55f6b733d170 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 10 client.5838 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 -- 172.21.15.5:0/2048177139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f6b70f4fc0 con 0x55f6b733d170 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f8352000640 1 -- 172.21.15.5:0/2048177139 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834c054640 con 0x55f6b733d170 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f8352000640 1 -- 172.21.15.5:0/2048177139 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f834c07dce0 con 0x55f6b733d170 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 10 client.5838 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 10 client.5838 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 20 client.5838 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6b7323a90 0x55f6b734f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 4 client.5838 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f836eeb0000 1 -- 172.21.15.5:0/2048177139 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6b70d8bf0 con 0x55f6b7323a90 2024-08-18T22:22:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f8369000640 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6b7323a90 0x55f6b734f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f8369000640 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6b7323a90 0x55f6b734f430 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e29adeae40bb22df server_cookie=59b0c68662b198fa in_seq=0 out_seq=0 2024-08-18T22:22:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.211+0000 7f8352000640 10 client.5838 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f8352000640 1 -- 172.21.15.5:0/2048177139 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6b70d8bf0 con 0x55f6b7323a90 2024-08-18T22:22:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f8352000640 10 client.5838 handle_command_reply: tid=0 2024-08-18T22:22:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 1 client.5838 shutdown 2024-08-18T22:22:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 1 -- 172.21.15.5:0/2048177139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733d170 msgr2=0x55f6b73227b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733d170 0x55f6b73227b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f834c00e840 tx=0x7f834c000bd0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 1 -- 172.21.15.5:0/2048177139 shutdown_connections 2024-08-18T22:22:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6b7323a90 0x55f6b734f430 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733da90 0x55f6b7322cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b733d170 0x55f6b73227b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 1 --2- 172.21.15.5:0/2048177139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b72f0c70 0x55f6b731d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f8352000640 0 client.5838 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 1 -- 172.21.15.5:0/2048177139 >> 172.21.15.5:0/2048177139 conn(0x55f6b731dff0 msgr2=0x55f6b72eff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 1 -- 172.21.15.5:0/2048177139 shutdown_connections 2024-08-18T22:22:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 1 -- 172.21.15.5:0/2048177139 wait complete. 2024-08-18T22:22:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.215+0000 7f836eeb0000 20 client.5838 trim_cache size 0 max 16384 2024-08-18T22:22:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 Processor -- start 2024-08-18T22:22:36.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 -- start start 2024-08-18T22:22:36.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b7322b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b72f3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b733da90 0x55f6b72f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f6b70c39f0 con 0x55f6b72f0c70 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f6b71f94c0 con 0x55f6b733d170 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f6b70df810 con 0x55f6b733da90 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8369000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b7322b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8369000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b7322b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57514/0 (socket says 172.21.15.5:57514) 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8369000640 1 -- 172.21.15.5:0/3472586715 learned_addr learned my addr 172.21.15.5:0/3472586715 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f835be00640 1 --2- 172.21.15.5:0/3472586715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b72f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8369a00640 1 --2- 172.21.15.5:0/3472586715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b733da90 0x55f6b72f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8369000640 1 -- 172.21.15.5:0/3472586715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b733da90 msgr2=0x55f6b72f35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8369000640 1 --2- 172.21.15.5:0/3472586715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b733da90 0x55f6b72f35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8369000640 1 -- 172.21.15.5:0/3472586715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 msgr2=0x55f6b72f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8369000640 1 --2- 172.21.15.5:0/3472586715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b72f3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8369000640 1 -- 172.21.15.5:0/3472586715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6b71bf140 con 0x55f6b72f0c70 2024-08-18T22:22:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f835be00640 1 --2- 172.21.15.5:0/3472586715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b72f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:36.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8369000640 1 --2- 172.21.15.5:0/3472586715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b7322b90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8354007bd0 tx=0x7f8354000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7675da848ce4b98e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8358c00640 1 -- 172.21.15.5:0/3472586715 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354032070 con 0x55f6b72f0c70 2024-08-18T22:22:36.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8358c00640 1 -- 172.21.15.5:0/3472586715 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8354015930 con 0x55f6b72f0c70 2024-08-18T22:22:36.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f8358c00640 1 -- 172.21.15.5:0/3472586715 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354015ae0 con 0x55f6b72f0c70 2024-08-18T22:22:36.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 -- 172.21.15.5:0/3472586715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 msgr2=0x55f6b7322b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 --2- 172.21.15.5:0/3472586715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b7322b90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8354007bd0 tx=0x7f8354000ee0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 -- 172.21.15.5:0/3472586715 shutdown_connections 2024-08-18T22:22:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 --2- 172.21.15.5:0/3472586715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b733da90 0x55f6b72f35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 --2- 172.21.15.5:0/3472586715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b72f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 --2- 172.21.15.5:0/3472586715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b7322b90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 -- 172.21.15.5:0/3472586715 >> 172.21.15.5:0/3472586715 conn(0x55f6b731dff0 msgr2=0x55f6b72ef720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 -- 172.21.15.5:0/3472586715 shutdown_connections 2024-08-18T22:22:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.231+0000 7f836eeb0000 1 -- 172.21.15.5:0/3472586715 wait complete. 2024-08-18T22:22:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 -- start start 2024-08-18T22:22:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 Processor -- start 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b73b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b73b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b733da90 0x55f6b73b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f6b70dfc90 con 0x55f6b72f0c70 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f6b71becb0 con 0x55f6b733d170 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f6b7142770 con 0x55f6b733da90 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 10 client.0 _ll_register_callbacks cb 0x7f8354001df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8369000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b73b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8369000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b73b0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57530/0 (socket says 172.21.15.5:57530) 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8369000640 1 -- 172.21.15.5:0/127329704 learned_addr learned my addr 172.21.15.5:0/127329704 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f835be00640 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b73b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8369a00640 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b733da90 0x55f6b73b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8369000640 1 -- 172.21.15.5:0/127329704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b733da90 msgr2=0x55f6b73b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8369000640 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b733da90 0x55f6b73b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8369000640 1 -- 172.21.15.5:0/127329704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 msgr2=0x55f6b73b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8369000640 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b73b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8369000640 1 -- 172.21.15.5:0/127329704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6b70fab60 con 0x55f6b72f0c70 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8369000640 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b73b0d50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8354007bd0 tx=0x7f8354000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6543cf4278aaa0d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8352000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8352000640 1 -- 172.21.15.5:0/127329704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354032070 con 0x55f6b72f0c70 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 -- 172.21.15.5:0/127329704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8354015930 con 0x55f6b72f0c70 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8352000640 1 -- 172.21.15.5:0/127329704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f835402d670 con 0x55f6b72f0c70 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8352000640 1 -- 172.21.15.5:0/127329704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8354043050 con 0x55f6b72f0c70 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 10 client.5844 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:36.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 -- 172.21.15.5:0/127329704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f6b70e4220 con 0x55f6b72f0c70 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8352000640 1 -- 172.21.15.5:0/127329704 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8354015930 con 0x55f6b72f0c70 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f8352000640 1 -- 172.21.15.5:0/127329704 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f8354046020 con 0x55f6b72f0c70 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 10 client.5844 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 10 client.5844 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 20 client.5844 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6b7350870 0x55f6b7350c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 4 client.5844 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 563254647}] 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.235+0000 7f836eeb0000 1 -- 172.21.15.5:0/127329704 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "damage rm", "damage_id": 563254647}) -- 0x55f6b714b870 con 0x55f6b7350870 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f835be00640 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6b7350870 0x55f6b7350c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f8352000640 10 client.5844 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f835be00640 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6b7350870 0x55f6b7350c50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a2811a2909b9cf4 server_cookie=2b94c873bb95bbe3 in_seq=0 out_seq=0 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f8352000640 1 -- 172.21.15.5:0/127329704 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55f6b714b870 con 0x55f6b7350870 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f8352000640 10 client.5844 handle_command_reply: tid=0 2024-08-18T22:22:36.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 1 client.5844 shutdown 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 1 -- 172.21.15.5:0/127329704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 msgr2=0x55f6b73b0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b73b0d50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8354007bd0 tx=0x7f8354000bd0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 1 -- 172.21.15.5:0/127329704 shutdown_connections 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55f6b7350870 0x55f6b7350c50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f6b733da90 0x55f6b73b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6b733d170 0x55f6b73b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f8352000640 0 client.5844 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 1 --2- 172.21.15.5:0/127329704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6b72f0c70 0x55f6b73b0d50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 1 -- 172.21.15.5:0/127329704 >> 172.21.15.5:0/127329704 conn(0x55f6b731dff0 msgr2=0x55f6b72f0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 1 -- 172.21.15.5:0/127329704 shutdown_connections 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 1 -- 172.21.15.5:0/127329704 wait complete. 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836eeb0000 20 client.5844 trim_cache size 0 max 16384 2024-08-18T22:22:36.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 -- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83400678c0 msgr2=0x7f8340069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83400678c0 0x7f8340069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8354001810 tx=0x7f8354009040 comp rx=0 tx=0).stop 2024-08-18T22:22:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 -- 172.21.15.5:0/2999200307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83640ce280 msgr2=0x7f836409daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83640ce280 0x7f836409daf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f834c00e870 tx=0x7f834c00ec70 comp rx=0 tx=0).stop 2024-08-18T22:22:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 -- 172.21.15.5:0/2999200307 shutdown_connections 2024-08-18T22:22:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f83400678c0 0x7f8340069d80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f836415b0c0 0x7f836409e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83640ce280 0x7f836409daf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 --2- 172.21.15.5:0/2999200307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83640b40c0 0x7f8364099910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 -- 172.21.15.5:0/2999200307 >> 172.21.15.5:0/2999200307 conn(0x7f83640b1dc0 msgr2=0x7f83640b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 -- 172.21.15.5:0/2999200307 shutdown_connections 2024-08-18T22:22:36.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.239+0000 7f836ba00640 1 -- 172.21.15.5:0/2999200307 wait complete. 2024-08-18T22:22:36.265 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-08-18T22:22:36.265 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-08-18T22:22:36.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb79dc00640 1 Processor -- start 2024-08-18T22:22:36.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb79dc00640 1 -- start start 2024-08-18T22:22:36.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb79dc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7980b40c0 0x7fb7980b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb79dc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7980ce280 0x7fb7980ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb79dc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7980b31f0 con 0x7fb79815b0c0 2024-08-18T22:22:36.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb79dc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb7980b4a70 con 0x7fb7980ce280 2024-08-18T22:22:36.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb79dc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb7980b3d70 con 0x7fb7980b40c0 2024-08-18T22:22:36.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb796a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb79815b0c0 0x7fb79806db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50418/0 (socket says 172.21.15.5:50418) 2024-08-18T22:22:36.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb797400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7980ce280 0x7fb7980ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb796a00640 1 -- 172.21.15.5:0/229026581 learned_addr learned my addr 172.21.15.5:0/229026581 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:36.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb78e000640 1 --2- 172.21.15.5:0/229026581 >> v2:172.21.15.117:3300/0 conn(0x7fb7980b40c0 0x7fb7980b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb797400640 1 -- 172.21.15.5:0/229026581 >> v2:172.21.15.117:3300/0 conn(0x7fb7980b40c0 msgr2=0x7fb7980b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb797400640 1 --2- 172.21.15.5:0/229026581 >> v2:172.21.15.117:3300/0 conn(0x7fb7980b40c0 0x7fb7980b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb797400640 1 -- 172.21.15.5:0/229026581 >> v1:172.21.15.5:6789/0 conn(0x7fb79815b0c0 legacy=0x7fb79806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb797400640 1 -- 172.21.15.5:0/229026581 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7980b34d0 con 0x7fb7980ce280 2024-08-18T22:22:36.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb796000640 1 -- 172.21.15.5:0/229026581 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4026581536 0 0) 0x7fb7980b31f0 con 0x7fb79815b0c0 2024-08-18T22:22:36.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.415+0000 7fb78e000640 1 --2- 172.21.15.5:0/229026581 >> v2:172.21.15.117:3300/0 conn(0x7fb7980b40c0 0x7fb7980b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:36.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb797400640 1 --2- 172.21.15.5:0/229026581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7980ce280 0x7fb7980ce6d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb798073f90 tx=0x7fb79001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8197a41810cc09 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb796000640 1 -- 172.21.15.5:0/229026581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7900b2070 con 0x7fb7980ce280 2024-08-18T22:22:36.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb796000640 1 -- 172.21.15.5:0/229026581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7900a57c0 con 0x7fb7980ce280 2024-08-18T22:22:36.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb796000640 1 -- 172.21.15.5:0/229026581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7900a5b90 con 0x7fb7980ce280 2024-08-18T22:22:36.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb79dc00640 1 -- 172.21.15.5:0/229026581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7980ce280 msgr2=0x7fb7980ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb79dc00640 1 --2- 172.21.15.5:0/229026581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7980ce280 0x7fb7980ce6d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb798073f90 tx=0x7fb79001c810 comp rx=0 tx=0).stop 2024-08-18T22:22:36.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb79dc00640 1 -- 172.21.15.5:0/229026581 shutdown_connections 2024-08-18T22:22:36.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb79dc00640 1 --2- 172.21.15.5:0/229026581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7980ce280 0x7fb7980ce6d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb79dc00640 1 --2- 172.21.15.5:0/229026581 >> v2:172.21.15.117:3300/0 conn(0x7fb7980b40c0 0x7fb7980b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb79dc00640 1 -- 172.21.15.5:0/229026581 >> 172.21.15.5:0/229026581 conn(0x7fb7980b1dc0 msgr2=0x7fb7980b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb79dc00640 1 -- 172.21.15.5:0/229026581 shutdown_connections 2024-08-18T22:22:36.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.419+0000 7fb79dc00640 1 -- 172.21.15.5:0/229026581 wait complete. 2024-08-18T22:22:36.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb79dc00640 1 Processor -- start 2024-08-18T22:22:36.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb79dc00640 1 -- start start 2024-08-18T22:22:36.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb79dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7980b40c0 0x7fb79814cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb79dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7980ce280 0x7fb798156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb79dc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb79815b0c0 0x7fb79806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb79dc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb79806f7f0 con 0x7fb7980b40c0 2024-08-18T22:22:36.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb79dc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb79806f670 con 0x7fb79815b0c0 2024-08-18T22:22:36.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb79dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb798167d10 con 0x7fb7980ce280 2024-08-18T22:22:36.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb796a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7980b40c0 0x7fb79814cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb796a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7980b40c0 0x7fb79814cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57550/0 (socket says 172.21.15.5:57550) 2024-08-18T22:22:36.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb796a00640 1 -- 172.21.15.5:0/4185998317 learned_addr learned my addr 172.21.15.5:0/4185998317 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb797400640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb79815b0c0 0x7fb79806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb78e000640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7980ce280 0x7fb798156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb796a00640 1 -- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7980ce280 msgr2=0x7fb798156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb796a00640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7980ce280 0x7fb798156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb796a00640 1 -- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb79815b0c0 msgr2=0x7fb79806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb796a00640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb79815b0c0 0x7fb79806e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb796a00640 1 -- 172.21.15.5:0/4185998317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79814d4b0 con 0x7fb7980b40c0 2024-08-18T22:22:36.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb796a00640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7980b40c0 0x7fb79814cf70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb78800c4b0 tx=0x7fb78800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb78f400640 1 -- 172.21.15.5:0/4185998317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788018070 con 0x7fb7980b40c0 2024-08-18T22:22:36.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb78f400640 1 -- 172.21.15.5:0/4185998317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb788007500 con 0x7fb7980b40c0 2024-08-18T22:22:36.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb78f400640 1 -- 172.21.15.5:0/4185998317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788004a30 con 0x7fb7980b40c0 2024-08-18T22:22:36.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb79dc00640 1 -- 172.21.15.5:0/4185998317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb798157620 con 0x7fb7980b40c0 2024-08-18T22:22:36.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.423+0000 7fb79dc00640 1 -- 172.21.15.5:0/4185998317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb798157be0 con 0x7fb7980b40c0 2024-08-18T22:22:36.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.427+0000 7fb78f400640 1 -- 172.21.15.5:0/4185998317 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb78801b070 con 0x7fb7980b40c0 2024-08-18T22:22:36.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.427+0000 7fb78f400640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb774067910 0x7fb774069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.427+0000 7fb78f400640 1 -- 172.21.15.5:0/4185998317 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fb788085150 con 0x7fb7980b40c0 2024-08-18T22:22:36.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.427+0000 7fb7a115a000 1 Processor -- start 2024-08-18T22:22:36.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.427+0000 7fb78e000640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb774067910 0x7fb774069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.427+0000 7fb7a115a000 1 -- start start 2024-08-18T22:22:36.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb78e000640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb774067910 0x7fb774069dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb7980c9660 tx=0x7fb780008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36be1e70 0x562a36be2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36be2790 0x562a36b95560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36b95aa0 0x562a36b95e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562a369e70f0 con 0x562a36be2790 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562a369831e0 con 0x562a36be1e70 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562a369e30b0 con 0x562a36b95aa0 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb78e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36be2790 0x562a36b95560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb78e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36be2790 0x562a36b95560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57558/0 (socket says 172.21.15.5:57558) 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb78e000640 1 -- 172.21.15.5:0/3110101467 learned_addr learned my addr 172.21.15.5:0/3110101467 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb796a00640 1 --2- 172.21.15.5:0/3110101467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36be1e70 0x562a36be2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb797400640 1 --2- 172.21.15.5:0/3110101467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36b95aa0 0x562a36b95e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb78e000640 1 -- 172.21.15.5:0/3110101467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36b95aa0 msgr2=0x562a36b95e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb78e000640 1 --2- 172.21.15.5:0/3110101467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36b95aa0 0x562a36b95e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb78e000640 1 -- 172.21.15.5:0/3110101467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36be1e70 msgr2=0x562a36be2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb78e000640 1 --2- 172.21.15.5:0/3110101467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36be1e70 0x562a36be2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb78e000640 1 -- 172.21.15.5:0/3110101467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a36a2cac0 con 0x562a36be2790 2024-08-18T22:22:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb78e000640 1 --2- 172.21.15.5:0/3110101467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36be2790 0x562a36b95560 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb780004400 tx=0x7fb780012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de09fd384b7a9014 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb787400640 1 -- 172.21.15.5:0/3110101467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78001b050 con 0x562a36be2790 2024-08-18T22:22:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb787400640 1 -- 172.21.15.5:0/3110101467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb780025070 con 0x562a36be2790 2024-08-18T22:22:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb787400640 1 -- 172.21.15.5:0/3110101467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780013460 con 0x562a36be2790 2024-08-18T22:22:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 -- 172.21.15.5:0/3110101467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36be2790 msgr2=0x562a36b95560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 --2- 172.21.15.5:0/3110101467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36be2790 0x562a36b95560 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb780004400 tx=0x7fb780012000 comp rx=0 tx=0).stop 2024-08-18T22:22:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 -- 172.21.15.5:0/3110101467 shutdown_connections 2024-08-18T22:22:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 --2- 172.21.15.5:0/3110101467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36b95aa0 0x562a36b95e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 --2- 172.21.15.5:0/3110101467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36be2790 0x562a36b95560 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 --2- 172.21.15.5:0/3110101467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36be1e70 0x562a36be2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 -- 172.21.15.5:0/3110101467 >> 172.21.15.5:0/3110101467 conn(0x562a36b8f5b0 msgr2=0x562a36bc4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 -- 172.21.15.5:0/3110101467 shutdown_connections 2024-08-18T22:22:36.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 -- 172.21.15.5:0/3110101467 wait complete. 2024-08-18T22:22:36.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 -- start start 2024-08-18T22:22:36.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.431+0000 7fb7a115a000 1 Processor -- start 2024-08-18T22:22:36.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36bc2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36be1e70 0x562a36b9c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36be2790 0x562a36b9c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562a36989400 con 0x562a36b95aa0 2024-08-18T22:22:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562a3698eb70 con 0x562a36be2790 2024-08-18T22:22:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562a36a69090 con 0x562a36be1e70 2024-08-18T22:22:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 10 client.0 _ll_register_callbacks cb 0x562a36b831f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb796a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36bc2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb796a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36bc2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57562/0 (socket says 172.21.15.5:57562) 2024-08-18T22:22:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb796a00640 1 -- 172.21.15.5:0/3693933782 learned_addr learned my addr 172.21.15.5:0/3693933782 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb78e000640 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36be1e70 0x562a36b9c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb797400640 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36be2790 0x562a36b9c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb796a00640 1 -- 172.21.15.5:0/3693933782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36be1e70 msgr2=0x562a36b9c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb796a00640 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36be1e70 0x562a36b9c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb796a00640 1 -- 172.21.15.5:0/3693933782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36be2790 msgr2=0x562a36b9c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb796a00640 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36be2790 0x562a36b9c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb796a00640 1 -- 172.21.15.5:0/3693933782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a3699f030 con 0x562a36b95aa0 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb796a00640 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36bc2510 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb7880554b0 tx=0x7fb7880598e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991b2b952929ff1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb77be00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb77be00640 1 -- 172.21.15.5:0/3693933782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78805ddc0 con 0x562a36b95aa0 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb77be00640 1 -- 172.21.15.5:0/3693933782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fb788054970 con 0x562a36b95aa0 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 -- 172.21.15.5:0/3693933782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb780025070 con 0x562a36b95aa0 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb77be00640 1 -- 172.21.15.5:0/3693933782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb788001130 con 0x562a36b95aa0 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 10 client.5859 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 -- 172.21.15.5:0/3693933782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x562a36983430 con 0x562a36b95aa0 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb77be00640 1 -- 172.21.15.5:0/3693933782 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb780025070 con 0x562a36b95aa0 2024-08-18T22:22:36.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb77be00640 1 -- 172.21.15.5:0/3693933782 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fb788083020 con 0x562a36b95aa0 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 10 client.5859 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 10 client.5859 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 20 client.5859 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562a36b9d560 0x562a36bf4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 4 client.5859 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 -- 172.21.15.5:0/3693933782 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a36982020 con 0x562a36b9d560 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb78e000640 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562a36b9d560 0x562a36bf4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb78e000640 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562a36b9d560 0x562a36bf4130 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3834a66d309a039 server_cookie=8401d0a4164c8e5b in_seq=0 out_seq=0 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb77be00640 10 client.5859 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb77be00640 1 -- 172.21.15.5:0/3693933782 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a36982020 con 0x562a36b9d560 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb77be00640 10 client.5859 handle_command_reply: tid=0 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 client.5859 shutdown 2024-08-18T22:22:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 -- 172.21.15.5:0/3693933782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 msgr2=0x562a36bc2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36bc2510 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb7880554b0 tx=0x7fb7880598e0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 -- 172.21.15.5:0/3693933782 shutdown_connections 2024-08-18T22:22:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562a36b9d560 0x562a36bf4130 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36be2790 0x562a36b9c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36be1e70 0x562a36b9c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 --2- 172.21.15.5:0/3693933782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36bc2510 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb77be00640 0 client.5859 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.435+0000 7fb7a115a000 1 -- 172.21.15.5:0/3693933782 >> 172.21.15.5:0/3693933782 conn(0x562a36b8f5b0 msgr2=0x562a36bc4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.439+0000 7fb7a115a000 1 -- 172.21.15.5:0/3693933782 shutdown_connections 2024-08-18T22:22:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.439+0000 7fb7a115a000 1 -- 172.21.15.5:0/3693933782 wait complete. 2024-08-18T22:22:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.439+0000 7fb7a115a000 20 client.5859 trim_cache size 0 max 16384 2024-08-18T22:22:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 Processor -- start 2024-08-18T22:22:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 -- start start 2024-08-18T22:22:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36bc4d70 0x562a36c52680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36b8f5b0 0x562a36c52bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36c53100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb79814ea30 con 0x562a36b95aa0 2024-08-18T22:22:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7980caa20 con 0x562a36b8f5b0 2024-08-18T22:22:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb79814e3e0 con 0x562a36bc4d70 2024-08-18T22:22:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb797400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36c53100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb797400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36c53100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57574/0 (socket says 172.21.15.5:57574) 2024-08-18T22:22:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb797400640 1 -- 172.21.15.5:0/437161299 learned_addr learned my addr 172.21.15.5:0/437161299 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb78e000640 1 --2- 172.21.15.5:0/437161299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36b8f5b0 0x562a36c52bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb796a00640 1 --2- 172.21.15.5:0/437161299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36bc4d70 0x562a36c52680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb797400640 1 -- 172.21.15.5:0/437161299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36bc4d70 msgr2=0x562a36c52680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb797400640 1 --2- 172.21.15.5:0/437161299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36bc4d70 0x562a36c52680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb797400640 1 -- 172.21.15.5:0/437161299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36b8f5b0 msgr2=0x562a36c52bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb797400640 1 --2- 172.21.15.5:0/437161299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36b8f5b0 0x562a36c52bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb797400640 1 -- 172.21.15.5:0/437161299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a369b43b0 con 0x562a36b95aa0 2024-08-18T22:22:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb78e000640 1 --2- 172.21.15.5:0/437161299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36b8f5b0 0x562a36c52bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb797400640 1 --2- 172.21.15.5:0/437161299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36c53100 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b0040 tx=0x7fb790004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212a091a98cfd67a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb786a00640 1 -- 172.21.15.5:0/437161299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7900b2040 con 0x562a36b95aa0 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb786a00640 1 -- 172.21.15.5:0/437161299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7900b3040 con 0x562a36b95aa0 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb786a00640 1 -- 172.21.15.5:0/437161299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7900a5c70 con 0x562a36b95aa0 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 -- 172.21.15.5:0/437161299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 msgr2=0x562a36c53100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 --2- 172.21.15.5:0/437161299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36c53100 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b0040 tx=0x7fb790004ac0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 -- 172.21.15.5:0/437161299 shutdown_connections 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 --2- 172.21.15.5:0/437161299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b95aa0 0x562a36c53100 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 --2- 172.21.15.5:0/437161299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36b8f5b0 0x562a36c52bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 --2- 172.21.15.5:0/437161299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36bc4d70 0x562a36c52680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 -- 172.21.15.5:0/437161299 >> 172.21.15.5:0/437161299 conn(0x562a36bef6f0 msgr2=0x562a36b94bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 -- 172.21.15.5:0/437161299 shutdown_connections 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 -- 172.21.15.5:0/437161299 wait complete. 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 -- start start 2024-08-18T22:22:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.455+0000 7fb7a115a000 1 Processor -- start 2024-08-18T22:22:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b8f5b0 0x562a36bf7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36b95aa0 0x562a36bf7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36bc4d70 0x562a36c12420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562a369a40e0 con 0x562a36b8f5b0 2024-08-18T22:22:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562a369f0ef0 con 0x562a36b95aa0 2024-08-18T22:22:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562a3697ed20 con 0x562a36bc4d70 2024-08-18T22:22:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 10 client.0 _ll_register_callbacks cb 0x7fb7880076b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb796a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b8f5b0 0x562a36bf7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb796a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b8f5b0 0x562a36bf7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57582/0 (socket says 172.21.15.5:57582) 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb796a00640 1 -- 172.21.15.5:0/1821097123 learned_addr learned my addr 172.21.15.5:0/1821097123 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb797400640 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36bc4d70 0x562a36c12420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb78e000640 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36b95aa0 0x562a36bf7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb796a00640 1 -- 172.21.15.5:0/1821097123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36bc4d70 msgr2=0x562a36c12420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb796a00640 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36bc4d70 0x562a36c12420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb796a00640 1 -- 172.21.15.5:0/1821097123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36b95aa0 msgr2=0x562a36bf7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb796a00640 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36b95aa0 0x562a36bf7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb796a00640 1 -- 172.21.15.5:0/1821097123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a36a69520 con 0x562a36b8f5b0 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb796a00640 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b8f5b0 0x562a36bf7040 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb788007050 tx=0x7fb788083430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876fa33d46cf7b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb77be00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb77be00640 1 -- 172.21.15.5:0/1821097123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788054e80 con 0x562a36b8f5b0 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb77be00640 1 -- 172.21.15.5:0/1821097123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fb7880545f0 con 0x562a36b8f5b0 2024-08-18T22:22:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 1 -- 172.21.15.5:0/1821097123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7900b3040 con 0x562a36b8f5b0 2024-08-18T22:22:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb77be00640 1 -- 172.21.15.5:0/1821097123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb788001130 con 0x562a36b8f5b0 2024-08-18T22:22:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 10 client.5865 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 1 -- 172.21.15.5:0/1821097123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x562a3698d720 con 0x562a36b8f5b0 2024-08-18T22:22:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb77be00640 1 -- 172.21.15.5:0/1821097123 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7900b3040 con 0x562a36b8f5b0 2024-08-18T22:22:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb77be00640 1 -- 172.21.15.5:0/1821097123 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fb78806d040 con 0x562a36b8f5b0 2024-08-18T22:22:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 10 client.5865 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 10 client.5865 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 20 client.5865 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562a36be1e70 0x562a36c12db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 4 client.5865 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-08-18T22:22:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb7a115a000 1 -- 172.21.15.5:0/1821097123 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x562a369f4820 con 0x562a36be1e70 2024-08-18T22:22:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb78e000640 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562a36be1e70 0x562a36c12db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb78e000640 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562a36be1e70 0x562a36c12db0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d350a0aad7895bad server_cookie=b935b14f03437901 in_seq=0 out_seq=0 2024-08-18T22:22:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.459+0000 7fb77be00640 10 client.5865 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb77be00640 1 -- 172.21.15.5:0/1821097123 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a369f4820 con 0x562a36be1e70 2024-08-18T22:22:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb77be00640 10 client.5865 handle_command_reply: tid=0 2024-08-18T22:22:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 1 client.5865 shutdown 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 1 -- 172.21.15.5:0/1821097123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b8f5b0 msgr2=0x562a36bf7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b8f5b0 0x562a36bf7040 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb788007050 tx=0x7fb788083430 comp rx=0 tx=0).stop 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 1 -- 172.21.15.5:0/1821097123 shutdown_connections 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562a36be1e70 0x562a36c12db0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562a36bc4d70 0x562a36c12420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562a36b95aa0 0x562a36bf7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 1 --2- 172.21.15.5:0/1821097123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a36b8f5b0 0x562a36bf7040 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb77be00640 0 client.5865 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 1 -- 172.21.15.5:0/1821097123 >> 172.21.15.5:0/1821097123 conn(0x562a36bef6f0 msgr2=0x562a36bf2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 1 -- 172.21.15.5:0/1821097123 shutdown_connections 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 1 -- 172.21.15.5:0/1821097123 wait complete. 2024-08-18T22:22:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb7a115a000 20 client.5865 trim_cache size 0 max 16384 2024-08-18T22:22:36.471 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:36.471 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:22:36.471 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:22:36.471 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 -- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb774067910 msgr2=0x7fb774069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb774067910 0x7fb774069dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb7980c9660 tx=0x7fb780008040 comp rx=0 tx=0).stop 2024-08-18T22:22:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 -- 172.21.15.5:0/4185998317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7980b40c0 msgr2=0x7fb79814cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7980b40c0 0x7fb79814cf70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb78800c4b0 tx=0x7fb78800c970 comp rx=0 tx=0).stop 2024-08-18T22:22:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 -- 172.21.15.5:0/4185998317 shutdown_connections 2024-08-18T22:22:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb774067910 0x7fb774069dd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb79815b0c0 0x7fb79806e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7980ce280 0x7fb798156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 --2- 172.21.15.5:0/4185998317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7980b40c0 0x7fb79814cf70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 -- 172.21.15.5:0/4185998317 >> 172.21.15.5:0/4185998317 conn(0x7fb7980b1dc0 msgr2=0x7fb79806db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 -- 172.21.15.5:0/4185998317 shutdown_connections 2024-08-18T22:22:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.463+0000 7fb79dc00640 1 -- 172.21.15.5:0/4185998317 wait complete. 2024-08-18T22:22:36.487 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-08-18T22:22:36.487 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-08-18T22:22:36.487 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-08-18T22:22:36.487 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-08-18T22:22:36.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:36.487 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-08-18T22:22:36.497 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:22:36.497 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:22:36.497 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-08-18T22:22:36.497 DEBUG:teuthology.orchestra.run.smithi005:> import json 2024-08-18T22:22:36.497 DEBUG:teuthology.orchestra.run.smithi005:> import sys 2024-08-18T22:22:36.497 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:22:36.497 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-08-18T22:22:36.497 DEBUG:teuthology.orchestra.run.smithi005:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-08-18T22:22:36.497 DEBUG:teuthology.orchestra.run.smithi005:> except OSError as e: 2024-08-18T22:22:36.497 DEBUG:teuthology.orchestra.run.smithi005:> sys.exit(e.errno) 2024-08-18T22:22:36.497 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:22:36.498 DEBUG:teuthology.orchestra.run.smithi005:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-08-18T22:22:36.498 DEBUG:teuthology.orchestra.run.smithi005:> print(json.dumps( 2024-08-18T22:22:36.498 DEBUG:teuthology.orchestra.run.smithi005:> dict([(a, getattr(s, a)) for a in attrs]), 2024-08-18T22:22:36.498 DEBUG:teuthology.orchestra.run.smithi005:> indent=2)) 2024-08-18T22:22:36.498 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:22:36.611 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:36.612 INFO:teuthology.orchestra.run.smithi005.stdout: "st_mode": 16893, 2024-08-18T22:22:36.612 INFO:teuthology.orchestra.run.smithi005.stdout: "st_ino": 1099511627777, 2024-08-18T22:22:36.612 INFO:teuthology.orchestra.run.smithi005.stdout: "st_dev": 44, 2024-08-18T22:22:36.612 INFO:teuthology.orchestra.run.smithi005.stdout: "st_nlink": 16, 2024-08-18T22:22:36.612 INFO:teuthology.orchestra.run.smithi005.stdout: "st_uid": 1000, 2024-08-18T22:22:36.612 INFO:teuthology.orchestra.run.smithi005.stdout: "st_gid": 1271, 2024-08-18T22:22:36.612 INFO:teuthology.orchestra.run.smithi005.stdout: "st_size": 18, 2024-08-18T22:22:36.612 INFO:teuthology.orchestra.run.smithi005.stdout: "st_atime": 1724019743.623444, 2024-08-18T22:22:36.612 INFO:teuthology.orchestra.run.smithi005.stdout: "st_mtime": 1724019749.0833845, 2024-08-18T22:22:36.612 INFO:teuthology.orchestra.run.smithi005.stdout: "st_ctime": 1724019749.0833845 2024-08-18T22:22:36.612 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:36.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:22:36.621 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-08-18T22:22:36.621 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-08-18T22:22:36.621 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-08-18T22:22:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.803+0000 7fd418e00640 1 Processor -- start 2024-08-18T22:22:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.803+0000 7fd418e00640 1 -- start start 2024-08-18T22:22:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.803+0000 7fd418e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41406d0d0 0x7fd414155080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.803+0000 7fd418e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4140ae030 con 0x7fd414070540 2024-08-18T22:22:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.803+0000 7fd418e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4140ae310 con 0x7fd414070920 2024-08-18T22:22:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.803+0000 7fd418e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4140aec40 con 0x7fd41406d0d0 2024-08-18T22:22:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.803+0000 7fd413400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd414070540 0x7fd41406c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50426/0 (socket says 172.21.15.5:50426) 2024-08-18T22:22:36.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.803+0000 7fd413400640 1 -- 172.21.15.5:0/1307757021 learned_addr learned my addr 172.21.15.5:0/1307757021 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:36.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd413e00640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41406d0d0 0x7fd414155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858369714 0 0) 0x7fd4140ae030 con 0x7fd414070540 2024-08-18T22:22:36.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3f8003530 con 0x7fd414070540 2024-08-18T22:22:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1836159593 0 0) 0x7fd3f8003530 con 0x7fd414070540 2024-08-18T22:22:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41406d0d0 msgr2=0x7fd414155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41406d0d0 0x7fd414155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 >> v1:172.21.15.117:6789/0 conn(0x7fd414070920 legacy=0x7fd414154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4140ae5f0 con 0x7fd414070540 2024-08-18T22:22:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fd404001680 con 0x7fd414070540 2024-08-18T22:22:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 >> v1:172.21.15.5:6789/0 conn(0x7fd414070540 legacy=0x7fd41406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41406d0d0 0x7fd3f80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3f8003fc0 0x7fd3f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f8004d50 0x7fd3f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd4140aec40 con 0x7fd3f8003fc0 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f800bb10 con 0x7fd3f8004d50 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f800bd10 con 0x7fd41406d0d0 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412a00640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3f8003fc0 0x7fd3f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd413400640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41406d0d0 0x7fd3f80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd413e00640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f8004d50 0x7fd3f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd413400640 1 -- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f8004d50 msgr2=0x7fd3f80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd413400640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f8004d50 0x7fd3f80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd413400640 1 -- 172.21.15.5:0/1307757021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3f8003fc0 msgr2=0x7fd3f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd413400640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3f8003fc0 0x7fd3f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd413400640 1 -- 172.21.15.5:0/1307757021 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f8003530 con 0x7fd41406d0d0 2024-08-18T22:22:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.807+0000 7fd412a00640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3f8003fc0 0x7fd3f8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd413400640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41406d0d0 0x7fd3f80039f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c110 tx=0x7fd40401f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed9830ba8ef14b42 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd404007c30 con 0x7fd41406d0d0 2024-08-18T22:22:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4040ac020 con 0x7fd41406d0d0 2024-08-18T22:22:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd412000640 1 -- 172.21.15.5:0/1307757021 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4040a8e50 con 0x7fd41406d0d0 2024-08-18T22:22:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd418e00640 1 -- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41406d0d0 msgr2=0x7fd3f80039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd418e00640 1 --2- 172.21.15.5:0/1307757021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41406d0d0 0x7fd3f80039f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c110 tx=0x7fd40401f230 comp rx=0 tx=0).stop 2024-08-18T22:22:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd413e00640 1 -- 172.21.15.5:0/1307757021 reap_dead start 2024-08-18T22:22:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd418e00640 1 -- 172.21.15.5:0/1307757021 shutdown_connections 2024-08-18T22:22:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd418e00640 1 -- 172.21.15.5:0/1307757021 >> 172.21.15.5:0/1307757021 conn(0x7fd414072130 msgr2=0x7fd414072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd418e00640 1 -- 172.21.15.5:0/1307757021 shutdown_connections 2024-08-18T22:22:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd418e00640 1 -- 172.21.15.5:0/1307757021 wait complete. 2024-08-18T22:22:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd418e00640 1 Processor -- start 2024-08-18T22:22:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.811+0000 7fd418e00640 1 -- start start 2024-08-18T22:22:36.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd418e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd41406d0d0 0x7fd414155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd418e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4141f4f10 0x7fd4141523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd418e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4140cf2a0 0x7fd4140cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd418e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd4140adb50 con 0x7fd4141f4f10 2024-08-18T22:22:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd418e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd4140731f0 con 0x7fd41406d0d0 2024-08-18T22:22:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd418e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4140adcd0 con 0x7fd4140cf2a0 2024-08-18T22:22:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd412a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4141f4f10 0x7fd4141523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd412a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4141f4f10 0x7fd4141523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57606/0 (socket says 172.21.15.5:57606) 2024-08-18T22:22:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd412a00640 1 -- 172.21.15.5:0/3590356237 learned_addr learned my addr 172.21.15.5:0/3590356237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd413400640 1 --2- 172.21.15.5:0/3590356237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd41406d0d0 0x7fd414155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd413e00640 1 --2- 172.21.15.5:0/3590356237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4140cf2a0 0x7fd4140cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd412a00640 1 -- 172.21.15.5:0/3590356237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4140cf2a0 msgr2=0x7fd4140cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd412a00640 1 --2- 172.21.15.5:0/3590356237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4140cf2a0 0x7fd4140cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd412a00640 1 -- 172.21.15.5:0/3590356237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd41406d0d0 msgr2=0x7fd414155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd412a00640 1 --2- 172.21.15.5:0/3590356237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd41406d0d0 0x7fd414155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd412a00640 1 -- 172.21.15.5:0/3590356237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41415dd90 con 0x7fd4141f4f10 2024-08-18T22:22:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd413400640 1 --2- 172.21.15.5:0/3590356237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd41406d0d0 0x7fd414155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd412a00640 1 --2- 172.21.15.5:0/3590356237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4141f4f10 0x7fd4141523b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd40000f7f0 tx=0x7fd40000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd40b400640 1 -- 172.21.15.5:0/3590356237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40000fea0 con 0x7fd4141f4f10 2024-08-18T22:22:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd40b400640 1 -- 172.21.15.5:0/3590356237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd400018070 con 0x7fd4141f4f10 2024-08-18T22:22:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd40b400640 1 -- 172.21.15.5:0/3590356237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40000d730 con 0x7fd4141f4f10 2024-08-18T22:22:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd418e00640 1 -- 172.21.15.5:0/3590356237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4141f5390 con 0x7fd4141f4f10 2024-08-18T22:22:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd418e00640 1 -- 172.21.15.5:0/3590356237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41415d7d0 con 0x7fd4141f4f10 2024-08-18T22:22:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.815+0000 7fd40b400640 1 -- 172.21.15.5:0/3590356237 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd40000d8d0 con 0x7fd4141f4f10 2024-08-18T22:22:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd40b400640 1 --2- 172.21.15.5:0/3590356237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3f40678f0 0x7fd3f4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd40b400640 1 -- 172.21.15.5:0/3590356237 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fd400085dd0 con 0x7fd4141f4f10 2024-08-18T22:22:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd413400640 1 --2- 172.21.15.5:0/3590356237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3f40678f0 0x7fd3f4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd41d880000 1 Processor -- start 2024-08-18T22:22:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd41d880000 1 -- start start 2024-08-18T22:22:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd413400640 1 --2- 172.21.15.5:0/3590356237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3f40678f0 0x7fd3f4069db0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd4040ad000 tx=0x7fd4140ae200 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd41d880000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4680 0x5602743c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd41d880000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4fa0 0x560274377b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd41d880000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560274378050 0x560274378430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd41d880000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5602741512a0 con 0x5602743c4fa0 2024-08-18T22:22:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd41d880000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5602741c91d0 con 0x5602743c4680 2024-08-18T22:22:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd41d880000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56027416f7e0 con 0x560274378050 2024-08-18T22:22:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd412a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4fa0 0x560274377b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd412a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4fa0 0x560274377b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57614/0 (socket says 172.21.15.5:57614) 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd412a00640 1 -- 172.21.15.5:0/2251661722 learned_addr learned my addr 172.21.15.5:0/2251661722 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd413400640 1 --2- 172.21.15.5:0/2251661722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4680 0x5602743c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd413e00640 1 --2- 172.21.15.5:0/2251661722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560274378050 0x560274378430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd412a00640 1 -- 172.21.15.5:0/2251661722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560274378050 msgr2=0x560274378430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd412a00640 1 --2- 172.21.15.5:0/2251661722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560274378050 0x560274378430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd412a00640 1 -- 172.21.15.5:0/2251661722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4680 msgr2=0x5602743c4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd412a00640 1 --2- 172.21.15.5:0/2251661722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4680 0x5602743c4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd412a00640 1 -- 172.21.15.5:0/2251661722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56027416fa30 con 0x5602743c4fa0 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd413e00640 1 --2- 172.21.15.5:0/2251661722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560274378050 0x560274378430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd412a00640 1 --2- 172.21.15.5:0/2251661722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4fa0 0x560274377b10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd400005630 tx=0x7fd400055a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11c60b097b0f6f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd3ffe00640 1 -- 172.21.15.5:0/2251661722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400055fe0 con 0x5602743c4fa0 2024-08-18T22:22:36.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd3ffe00640 1 -- 172.21.15.5:0/2251661722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40005a390 con 0x5602743c4fa0 2024-08-18T22:22:36.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.819+0000 7fd3ffe00640 1 -- 172.21.15.5:0/2251661722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40005ebc0 con 0x5602743c4fa0 2024-08-18T22:22:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 -- 172.21.15.5:0/2251661722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4fa0 msgr2=0x560274377b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 --2- 172.21.15.5:0/2251661722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4fa0 0x560274377b10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd400005630 tx=0x7fd400055a00 comp rx=0 tx=0).stop 2024-08-18T22:22:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 -- 172.21.15.5:0/2251661722 shutdown_connections 2024-08-18T22:22:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 --2- 172.21.15.5:0/2251661722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560274378050 0x560274378430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 --2- 172.21.15.5:0/2251661722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4fa0 0x560274377b10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 --2- 172.21.15.5:0/2251661722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4680 0x5602743c4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 -- 172.21.15.5:0/2251661722 >> 172.21.15.5:0/2251661722 conn(0x560274371b60 msgr2=0x5602743a7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 -- 172.21.15.5:0/2251661722 shutdown_connections 2024-08-18T22:22:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 -- 172.21.15.5:0/2251661722 wait complete. 2024-08-18T22:22:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 -- start start 2024-08-18T22:22:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 Processor -- start 2024-08-18T22:22:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560274378050 0x5602743ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602743c4680 0x5602743caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4fa0 0x560274379480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560274249e60 con 0x560274378050 2024-08-18T22:22:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560274284780 con 0x5602743c4fa0 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560274182b00 con 0x5602743c4680 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 10 client.0 _ll_register_callbacks cb 0x560274365a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd413400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560274378050 0x5602743ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd413400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560274378050 0x5602743ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57626/0 (socket says 172.21.15.5:57626) 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd413400640 1 -- 172.21.15.5:0/3475414657 learned_addr learned my addr 172.21.15.5:0/3475414657 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd413e00640 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4fa0 0x560274379480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd412a00640 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602743c4680 0x5602743caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd413400640 1 -- 172.21.15.5:0/3475414657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602743c4680 msgr2=0x5602743caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd413400640 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602743c4680 0x5602743caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd413400640 1 -- 172.21.15.5:0/3475414657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4fa0 msgr2=0x560274379480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd413400640 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4fa0 0x560274379480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd413400640 1 -- 172.21.15.5:0/3475414657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560274196540 con 0x560274378050 2024-08-18T22:22:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd412a00640 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602743c4680 0x5602743caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd413400640 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560274378050 0x5602743ca9d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd40401f060 tx=0x7fd40401da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476da9a6c3848d7e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd3fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd3fcc00640 1 -- 172.21.15.5:0/3475414657 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4040cc060 con 0x560274378050 2024-08-18T22:22:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 -- 172.21.15.5:0/3475414657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd40005a390 con 0x560274378050 2024-08-18T22:22:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd3fcc00640 1 -- 172.21.15.5:0/3475414657 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fd404007190 con 0x560274378050 2024-08-18T22:22:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd3fcc00640 1 -- 172.21.15.5:0/3475414657 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd4040d2050 con 0x560274378050 2024-08-18T22:22:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 10 client.5877 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.823+0000 7fd41d880000 1 -- 172.21.15.5:0/3475414657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x56027424a2f0 con 0x560274378050 2024-08-18T22:22:36.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd3fcc00640 1 -- 172.21.15.5:0/3475414657 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40005a390 con 0x560274378050 2024-08-18T22:22:36.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd3fcc00640 1 -- 172.21.15.5:0/3475414657 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fd4040d5020 con 0x560274378050 2024-08-18T22:22:36.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 10 client.5877 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:36.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 10 client.5877 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:36.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 20 client.5877 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:36.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x560274379e90 0x56027437a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 4 client.5877 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:36.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 -- 172.21.15.5:0/3475414657 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560274164150 con 0x560274379e90 2024-08-18T22:22:36.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd412a00640 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x560274379e90 0x56027437a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd412a00640 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x560274379e90 0x56027437a2a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ccb37a6f03a431d server_cookie=3fee1d3653c81a21 in_seq=0 out_seq=0 2024-08-18T22:22:36.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd3fcc00640 10 client.5877 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd3fcc00640 1 -- 172.21.15.5:0/3475414657 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560274164150 con 0x560274379e90 2024-08-18T22:22:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd3fcc00640 10 client.5877 handle_command_reply: tid=0 2024-08-18T22:22:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 client.5877 shutdown 2024-08-18T22:22:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 -- 172.21.15.5:0/3475414657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560274378050 msgr2=0x5602743ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560274378050 0x5602743ca9d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd40401f060 tx=0x7fd40401da70 comp rx=0 tx=0).stop 2024-08-18T22:22:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 -- 172.21.15.5:0/3475414657 shutdown_connections 2024-08-18T22:22:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x560274379e90 0x56027437a2a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4fa0 0x560274379480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602743c4680 0x5602743caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 --2- 172.21.15.5:0/3475414657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560274378050 0x5602743ca9d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd3fcc00640 0 client.5877 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 -- 172.21.15.5:0/3475414657 >> 172.21.15.5:0/3475414657 conn(0x560274371b60 msgr2=0x5602743a7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 -- 172.21.15.5:0/3475414657 shutdown_connections 2024-08-18T22:22:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 1 -- 172.21.15.5:0/3475414657 wait complete. 2024-08-18T22:22:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.827+0000 7fd41d880000 20 client.5877 trim_cache size 0 max 16384 2024-08-18T22:22:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd41d880000 1 Processor -- start 2024-08-18T22:22:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd41d880000 1 -- start start 2024-08-18T22:22:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd41d880000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560274378050 0x5602743762e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd41d880000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x560274376820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd41d880000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602743c4fa0 0x5602743c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd41d880000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd4142005a0 con 0x5602743c4680 2024-08-18T22:22:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd41d880000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd414160010 con 0x560274378050 2024-08-18T22:22:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd41d880000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4141fff50 con 0x5602743c4fa0 2024-08-18T22:22:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd412a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x560274376820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd412a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x560274376820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57638/0 (socket says 172.21.15.5:57638) 2024-08-18T22:22:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd412a00640 1 -- 172.21.15.5:0/756273627 learned_addr learned my addr 172.21.15.5:0/756273627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd413400640 1 --2- 172.21.15.5:0/756273627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560274378050 0x5602743762e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd413e00640 1 --2- 172.21.15.5:0/756273627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602743c4fa0 0x5602743c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd412a00640 1 -- 172.21.15.5:0/756273627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602743c4fa0 msgr2=0x5602743c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd412a00640 1 --2- 172.21.15.5:0/756273627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602743c4fa0 0x5602743c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd412a00640 1 -- 172.21.15.5:0/756273627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560274378050 msgr2=0x5602743762e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd412a00640 1 --2- 172.21.15.5:0/756273627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560274378050 0x5602743762e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd412a00640 1 -- 172.21.15.5:0/756273627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602742211e0 con 0x5602743c4680 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd413400640 1 --2- 172.21.15.5:0/756273627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560274378050 0x5602743762e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd412a00640 1 --2- 172.21.15.5:0/756273627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x560274376820 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd400055ce0 tx=0x7fd40005c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf51b0c41b50bb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd3ff400640 1 -- 172.21.15.5:0/756273627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400079070 con 0x5602743c4680 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd3ff400640 1 -- 172.21.15.5:0/756273627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40005a390 con 0x5602743c4680 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.843+0000 7fd3ff400640 1 -- 172.21.15.5:0/756273627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400055fe0 con 0x5602743c4680 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- 172.21.15.5:0/756273627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 msgr2=0x560274376820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 --2- 172.21.15.5:0/756273627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x560274376820 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd400055ce0 tx=0x7fd40005c000 comp rx=0 tx=0).stop 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- 172.21.15.5:0/756273627 shutdown_connections 2024-08-18T22:22:36.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 --2- 172.21.15.5:0/756273627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5602743c4fa0 0x5602743c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 --2- 172.21.15.5:0/756273627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x560274376820 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 --2- 172.21.15.5:0/756273627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560274378050 0x5602743762e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- 172.21.15.5:0/756273627 >> 172.21.15.5:0/756273627 conn(0x560274371b60 msgr2=0x5602743db1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- 172.21.15.5:0/756273627 shutdown_connections 2024-08-18T22:22:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- 172.21.15.5:0/756273627 wait complete. 2024-08-18T22:22:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- start start 2024-08-18T22:22:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 Processor -- start 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560274378050 0x5602743c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x5602743f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4fa0 0x5602743f4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560274160e50 con 0x5602743c4680 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560274163b30 con 0x5602743c4fa0 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5602741c84e0 con 0x560274378050 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 10 client.0 _ll_register_callbacks cb 0x7fd3f80045e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd412a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x5602743f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd412a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x5602743f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57642/0 (socket says 172.21.15.5:57642) 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd412a00640 1 -- 172.21.15.5:0/2235290300 learned_addr learned my addr 172.21.15.5:0/2235290300 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd413400640 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560274378050 0x5602743c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd413e00640 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4fa0 0x5602743f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd412a00640 1 -- 172.21.15.5:0/2235290300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560274378050 msgr2=0x5602743c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd412a00640 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560274378050 0x5602743c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd412a00640 1 -- 172.21.15.5:0/2235290300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4fa0 msgr2=0x5602743f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd412a00640 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4fa0 0x5602743f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd412a00640 1 -- 172.21.15.5:0/2235290300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56027415ce50 con 0x5602743c4680 2024-08-18T22:22:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd413e00640 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4fa0 0x5602743f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd412a00640 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x5602743f3b00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd400055ce0 tx=0x7fd400001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a221961b8d8829f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd3fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd3fcc00640 1 -- 172.21.15.5:0/2235290300 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400079020 con 0x5602743c4680 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd3fcc00640 1 -- 172.21.15.5:0/2235290300 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fd400054080 con 0x5602743c4680 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- 172.21.15.5:0/2235290300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd40005a390 con 0x5602743c4680 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd3fcc00640 1 -- 172.21.15.5:0/2235290300 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd40006e040 con 0x5602743c4680 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 10 client.5883 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- 172.21.15.5:0/2235290300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5602741602c0 con 0x5602743c4680 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd3fcc00640 1 -- 172.21.15.5:0/2235290300 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40005a390 con 0x5602743c4680 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd3fcc00640 1 -- 172.21.15.5:0/2235290300 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fd400052650 con 0x5602743c4680 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 10 client.5883 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 10 client.5883 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 20 client.5883 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:36.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5602743f4580 0x560274437560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 4 client.5883 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-08-18T22:22:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd41d880000 1 -- 172.21.15.5:0/2235290300 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x5602741d6900 con 0x5602743f4580 2024-08-18T22:22:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.847+0000 7fd413400640 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5602743f4580 0x560274437560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd413400640 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5602743f4580 0x560274437560 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88fd3f6d30ab7491 server_cookie=4f72e0b54032eb69 in_seq=0 out_seq=0 2024-08-18T22:22:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd3fcc00640 10 client.5883 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd3fcc00640 1 -- 172.21.15.5:0/2235290300 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x5602741d6900 con 0x5602743f4580 2024-08-18T22:22:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd3fcc00640 10 client.5883 handle_command_reply: tid=0 2024-08-18T22:22:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 1 client.5883 shutdown 2024-08-18T22:22:36.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 1 -- 172.21.15.5:0/2235290300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 msgr2=0x5602743f3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x5602743f3b00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd400055ce0 tx=0x7fd400001e60 comp rx=0 tx=0).stop 2024-08-18T22:22:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 1 -- 172.21.15.5:0/2235290300 shutdown_connections 2024-08-18T22:22:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5602743f4580 0x560274437560 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5602743c4fa0 0x5602743f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5602743c4680 0x5602743f3b00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 1 --2- 172.21.15.5:0/2235290300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560274378050 0x5602743c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd3fcc00640 0 client.5883 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 1 -- 172.21.15.5:0/2235290300 >> 172.21.15.5:0/2235290300 conn(0x560274371b60 msgr2=0x5602743d9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 1 -- 172.21.15.5:0/2235290300 shutdown_connections 2024-08-18T22:22:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 1 -- 172.21.15.5:0/2235290300 wait complete. 2024-08-18T22:22:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:36.851+0000 7fd41d880000 20 client.5883 trim_cache size 0 max 16384 2024-08-18T22:22:36.861 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:36.861 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:22:36.861 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": -2 2024-08-18T22:22:36.861 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:36.862 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-08-18T22:22:36.863 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENOENT: 2024-08-18T22:22:36.863 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-08-18T22:22:36.863 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-08-18T22:22:36.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-08-18T22:22:37.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a32600640 1 Processor -- start 2024-08-18T22:22:37.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a32600640 1 -- start start 2024-08-18T22:22:37.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a32600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c15fb80 0x7f8a2c0d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a32600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a2c0d30b0 con 0x7f8a2c0b5ad0 2024-08-18T22:22:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a32600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a2c0d1bd0 con 0x7f8a2c0d1090 2024-08-18T22:22:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a32600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2c071c60 con 0x7f8a2c15fb80 2024-08-18T22:22:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a23e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8a2c0b5ad0 0x7f8a2c06fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50432/0 (socket says 172.21.15.5:50432) 2024-08-18T22:22:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a23e00640 1 -- 172.21.15.5:0/1711429456 learned_addr learned my addr 172.21.15.5:0/1711429456 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a2b400640 1 --2- 172.21.15.5:0/1711429456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c15fb80 0x7f8a2c0d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a2aa00640 1 -- 172.21.15.5:0/1711429456 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273195275 0 0) 0x7f8a2c0d30b0 con 0x7f8a2c0b5ad0 2024-08-18T22:22:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a2aa00640 1 -- 172.21.15.5:0/1711429456 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a10003530 con 0x7f8a2c0b5ad0 2024-08-18T22:22:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a2aa00640 1 -- 172.21.15.5:0/1711429456 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2817300516 0 0) 0x7f8a2c0d1bd0 con 0x7f8a2c0d1090 2024-08-18T22:22:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a2aa00640 1 -- 172.21.15.5:0/1711429456 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a2c0d30b0 con 0x7f8a2c0d1090 2024-08-18T22:22:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a2b400640 1 -- 172.21.15.5:0/1711429456 >> v1:172.21.15.117:6789/0 conn(0x7f8a2c0d1090 legacy=0x7f8a2c071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a2b400640 1 -- 172.21.15.5:0/1711429456 >> v1:172.21.15.5:6789/0 conn(0x7f8a2c0b5ad0 legacy=0x7f8a2c06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.003+0000 7f8a2b400640 1 -- 172.21.15.5:0/1711429456 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c0d2dd0 con 0x7f8a2c15fb80 2024-08-18T22:22:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.007+0000 7f8a2b400640 1 --2- 172.21.15.5:0/1711429456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c15fb80 0x7f8a2c0d15e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0097f0 tx=0x7f8a1c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5285d5d457540aa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.007+0000 7f8a2aa00640 1 -- 172.21.15.5:0/1711429456 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0b0070 con 0x7f8a2c15fb80 2024-08-18T22:22:37.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.007+0000 7f8a2aa00640 1 -- 172.21.15.5:0/1711429456 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c0a4e50 con 0x7f8a2c15fb80 2024-08-18T22:22:37.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.007+0000 7f8a2aa00640 1 -- 172.21.15.5:0/1711429456 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0ab820 con 0x7f8a2c15fb80 2024-08-18T22:22:37.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.007+0000 7f8a32600640 1 -- 172.21.15.5:0/1711429456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c15fb80 msgr2=0x7f8a2c0d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.007+0000 7f8a32600640 1 --2- 172.21.15.5:0/1711429456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c15fb80 0x7f8a2c0d15e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0097f0 tx=0x7f8a1c01c3c0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.007+0000 7f8a32600640 1 -- 172.21.15.5:0/1711429456 shutdown_connections 2024-08-18T22:22:37.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.007+0000 7f8a32600640 1 --2- 172.21.15.5:0/1711429456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c15fb80 0x7f8a2c0d15e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.007+0000 7f8a32600640 1 -- 172.21.15.5:0/1711429456 >> 172.21.15.5:0/1711429456 conn(0x7f8a2c0d2180 msgr2=0x7f8a2c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.007+0000 7f8a32600640 1 -- 172.21.15.5:0/1711429456 shutdown_connections 2024-08-18T22:22:37.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.007+0000 7f8a32600640 1 -- 172.21.15.5:0/1711429456 wait complete. 2024-08-18T22:22:37.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a32600640 1 Processor -- start 2024-08-18T22:22:37.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a32600640 1 -- start start 2024-08-18T22:22:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a32600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c0b5ad0 0x7f8a2c1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a32600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a2c0d1090 0x7f8a2c0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a32600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a2c15fb80 0x7f8a2c0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a32600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c16a310 con 0x7f8a2c0d1090 2024-08-18T22:22:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a32600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c0b5ed0 con 0x7f8a2c15fb80 2024-08-18T22:22:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a32600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2c16a490 con 0x7f8a2c0b5ad0 2024-08-18T22:22:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a2c0d1090 0x7f8a2c0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a2c0d1090 0x7f8a2c0b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57656/0 (socket says 172.21.15.5:57656) 2024-08-18T22:22:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23e00640 1 -- 172.21.15.5:0/532864738 learned_addr learned my addr 172.21.15.5:0/532864738 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a2b400640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c0b5ad0 0x7f8a2c1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a2be00640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a2c15fb80 0x7f8a2c0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23e00640 1 -- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c0b5ad0 msgr2=0x7f8a2c1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23e00640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c0b5ad0 0x7f8a2c1557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23e00640 1 -- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a2c15fb80 msgr2=0x7f8a2c0b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23e00640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a2c15fb80 0x7f8a2c0b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23e00640 1 -- 172.21.15.5:0/532864738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c09c3f0 con 0x7f8a2c0d1090 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a2b400640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c0b5ad0 0x7f8a2c1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23e00640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a2c0d1090 0x7f8a2c0b3510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c4d0 tx=0x7f8a1400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23400640 1 -- 172.21.15.5:0/532864738 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14017070 con 0x7f8a2c0d1090 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23400640 1 -- 172.21.15.5:0/532864738 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a14005cf0 con 0x7f8a2c0d1090 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a23400640 1 -- 172.21.15.5:0/532864738 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140072b0 con 0x7f8a2c0d1090 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a32600640 1 -- 172.21.15.5:0/532864738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2c09c6d0 con 0x7f8a2c0d1090 2024-08-18T22:22:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.011+0000 7f8a32600640 1 -- 172.21.15.5:0/532864738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2c09d1b0 con 0x7f8a2c0d1090 2024-08-18T22:22:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a23400640 1 -- 172.21.15.5:0/532864738 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a1401a070 con 0x7f8a2c0d1090 2024-08-18T22:22:37.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a23400640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a080678c0 0x7f8a08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a23400640 1 -- 172.21.15.5:0/532864738 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8a14085260 con 0x7f8a2c0d1090 2024-08-18T22:22:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a35a25000 1 Processor -- start 2024-08-18T22:22:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a2b400640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a080678c0 0x7f8a08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a35a25000 1 -- start start 2024-08-18T22:22:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a2b400640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a080678c0 0x7f8a08069d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0ad000 tx=0x7f8a1c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a35f0 0x5626416a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a3f10 0x562641656cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416571f0 0x5626416575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a35a25000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5626414a82a0 con 0x5626416a35f0 2024-08-18T22:22:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a35a25000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56264144e090 con 0x5626416571f0 2024-08-18T22:22:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.015+0000 7f8a35a25000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5626414a4260 con 0x5626416a3f10 2024-08-18T22:22:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a35f0 0x5626416a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a35f0 0x5626416a39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57662/0 (socket says 172.21.15.5:57662) 2024-08-18T22:22:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 -- 172.21.15.5:0/3013124638 learned_addr learned my addr 172.21.15.5:0/3013124638 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2be00640 1 --2- 172.21.15.5:0/3013124638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416571f0 0x5626416575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a23e00640 1 --2- 172.21.15.5:0/3013124638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a3f10 0x562641656cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 -- 172.21.15.5:0/3013124638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a3f10 msgr2=0x562641656cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 --2- 172.21.15.5:0/3013124638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a3f10 0x562641656cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 -- 172.21.15.5:0/3013124638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416571f0 msgr2=0x5626416575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 --2- 172.21.15.5:0/3013124638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416571f0 0x5626416575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 -- 172.21.15.5:0/3013124638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56264154f780 con 0x5626416a35f0 2024-08-18T22:22:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 --2- 172.21.15.5:0/3013124638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a35f0 0x5626416a39d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c018fd0 tx=0x7f8a1c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0a1499a375d577 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a1be00640 1 -- 172.21.15.5:0/3013124638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0b0040 con 0x5626416a35f0 2024-08-18T22:22:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a1be00640 1 -- 172.21.15.5:0/3013124638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c0c6070 con 0x5626416a35f0 2024-08-18T22:22:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a1be00640 1 -- 172.21.15.5:0/3013124638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0c1620 con 0x5626416a35f0 2024-08-18T22:22:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 -- 172.21.15.5:0/3013124638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a35f0 msgr2=0x5626416a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 --2- 172.21.15.5:0/3013124638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a35f0 0x5626416a39d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c018fd0 tx=0x7f8a1c004740 comp rx=0 tx=0).stop 2024-08-18T22:22:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 -- 172.21.15.5:0/3013124638 shutdown_connections 2024-08-18T22:22:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 --2- 172.21.15.5:0/3013124638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416571f0 0x5626416575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 --2- 172.21.15.5:0/3013124638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a3f10 0x562641656cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 --2- 172.21.15.5:0/3013124638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a35f0 0x5626416a39d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 -- 172.21.15.5:0/3013124638 >> 172.21.15.5:0/3013124638 conn(0x5626416844a0 msgr2=0x562641686890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 -- 172.21.15.5:0/3013124638 shutdown_connections 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 -- 172.21.15.5:0/3013124638 wait complete. 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 -- start start 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 Processor -- start 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416571f0 0x562641685ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a35f0 0x562641685ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416a3f10 0x562641686530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5626414a75b0 con 0x5626416571f0 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5626414621f0 con 0x5626416a3f10 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5626414ac8d0 con 0x5626416a35f0 2024-08-18T22:22:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a35a25000 10 client.0 _ll_register_callbacks cb 0x5626416449c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416571f0 0x562641685ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416571f0 0x562641685ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57670/0 (socket says 172.21.15.5:57670) 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.019+0000 7f8a2b400640 1 -- 172.21.15.5:0/1761146408 learned_addr learned my addr 172.21.15.5:0/1761146408 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a2be00640 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416a3f10 0x562641686530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a23e00640 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a35f0 0x562641685ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a2b400640 1 -- 172.21.15.5:0/1761146408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a35f0 msgr2=0x562641685ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a2b400640 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a35f0 0x562641685ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a2b400640 1 -- 172.21.15.5:0/1761146408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416a3f10 msgr2=0x562641686530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a2b400640 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416a3f10 0x562641686530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a2b400640 1 -- 172.21.15.5:0/1761146408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626414ecb90 con 0x5626416571f0 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a2b400640 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416571f0 0x562641685ab0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c018fd0 tx=0x7f8a1c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c723f96cf925e22 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a18c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a18c00640 1 -- 172.21.15.5:0/1761146408 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0d0070 con 0x5626416571f0 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a18c00640 1 -- 172.21.15.5:0/1761146408 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8a1c0c1a90 con 0x5626416571f0 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 -- 172.21.15.5:0/1761146408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a1c0c6070 con 0x5626416571f0 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a18c00640 1 -- 172.21.15.5:0/1761146408 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8a1c0b0040 con 0x5626416571f0 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 10 client.5895 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 -- 172.21.15.5:0/1761146408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x562641480bc0 con 0x5626416571f0 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a18c00640 1 -- 172.21.15.5:0/1761146408 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c0c6070 con 0x5626416571f0 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a18c00640 1 -- 172.21.15.5:0/1761146408 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f8a1c0de080 con 0x5626416571f0 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 10 client.5895 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 10 client.5895 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 20 client.5895 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626416b3690 0x5626416b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 4 client.5895 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 -- 172.21.15.5:0/1761146408 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562641442cc0 con 0x5626416b3690 2024-08-18T22:22:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a23e00640 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626416b3690 0x5626416b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a23e00640 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626416b3690 0x5626416b5a80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37024bf193874408 server_cookie=8634992ab5975afd in_seq=0 out_seq=0 2024-08-18T22:22:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a18c00640 10 client.5895 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a18c00640 1 -- 172.21.15.5:0/1761146408 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562641442cc0 con 0x5626416b3690 2024-08-18T22:22:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a18c00640 10 client.5895 handle_command_reply: tid=0 2024-08-18T22:22:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 client.5895 shutdown 2024-08-18T22:22:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 -- 172.21.15.5:0/1761146408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416571f0 msgr2=0x562641685ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416571f0 0x562641685ab0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c018fd0 tx=0x7f8a1c01ac00 comp rx=0 tx=0).stop 2024-08-18T22:22:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 -- 172.21.15.5:0/1761146408 shutdown_connections 2024-08-18T22:22:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626416b3690 0x5626416b5a80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416a3f10 0x562641686530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a35f0 0x562641685ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 --2- 172.21.15.5:0/1761146408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416571f0 0x562641685ab0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a18c00640 0 client.5895 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 -- 172.21.15.5:0/1761146408 >> 172.21.15.5:0/1761146408 conn(0x5626416844a0 msgr2=0x5626416563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 -- 172.21.15.5:0/1761146408 shutdown_connections 2024-08-18T22:22:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 1 -- 172.21.15.5:0/1761146408 wait complete. 2024-08-18T22:22:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.023+0000 7f8a35a25000 20 client.5895 trim_cache size 0 max 16384 2024-08-18T22:22:37.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a35a25000 1 Processor -- start 2024-08-18T22:22:37.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a35a25000 1 -- start start 2024-08-18T22:22:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416571f0 0x562641656440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a35f0 0x562641656980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a35a25000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c202fd0 con 0x5626416a3f10 2024-08-18T22:22:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a35a25000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c1f7ef0 con 0x5626416571f0 2024-08-18T22:22:37.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a35a25000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2c1f8540 con 0x5626416a35f0 2024-08-18T22:22:37.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a2be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a2be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416b6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57684/0 (socket says 172.21.15.5:57684) 2024-08-18T22:22:37.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a2be00640 1 -- 172.21.15.5:0/3303377040 learned_addr learned my addr 172.21.15.5:0/3303377040 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a2b400640 1 --2- 172.21.15.5:0/3303377040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416571f0 0x562641656440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a23e00640 1 --2- 172.21.15.5:0/3303377040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a35f0 0x562641656980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a2be00640 1 -- 172.21.15.5:0/3303377040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a35f0 msgr2=0x562641656980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a2be00640 1 --2- 172.21.15.5:0/3303377040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a35f0 0x562641656980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a2be00640 1 -- 172.21.15.5:0/3303377040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416571f0 msgr2=0x562641656440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a2be00640 1 --2- 172.21.15.5:0/3303377040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416571f0 0x562641656440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a2be00640 1 -- 172.21.15.5:0/3303377040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626414652c0 con 0x5626416a3f10 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a2b400640 1 --2- 172.21.15.5:0/3303377040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416571f0 0x562641656440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a23e00640 1 --2- 172.21.15.5:0/3303377040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a35f0 0x562641656980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.043+0000 7f8a2be00640 1 --2- 172.21.15.5:0/3303377040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416b6a90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8a24001c30 tx=0x7f8a240020f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b6cc9b1f8e3eda server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a1b400640 1 -- 172.21.15.5:0/3303377040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2401a070 con 0x5626416a3f10 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a1b400640 1 -- 172.21.15.5:0/3303377040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a24003b90 con 0x5626416a3f10 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a1b400640 1 -- 172.21.15.5:0/3303377040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a240149c0 con 0x5626416a3f10 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 -- 172.21.15.5:0/3303377040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 msgr2=0x5626416b6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 --2- 172.21.15.5:0/3303377040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416b6a90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8a24001c30 tx=0x7f8a240020f0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 -- 172.21.15.5:0/3303377040 shutdown_connections 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 --2- 172.21.15.5:0/3303377040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416b6a90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 --2- 172.21.15.5:0/3303377040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416a35f0 0x562641656980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 --2- 172.21.15.5:0/3303377040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416571f0 0x562641656440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 -- 172.21.15.5:0/3303377040 >> 172.21.15.5:0/3303377040 conn(0x5626416844a0 msgr2=0x562641655d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 -- 172.21.15.5:0/3303377040 shutdown_connections 2024-08-18T22:22:37.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 -- 172.21.15.5:0/3303377040 wait complete. 2024-08-18T22:22:37.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 -- start start 2024-08-18T22:22:37.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 Processor -- start 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416571f0 0x5626416b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416a35f0 0x5626416fc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416fc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5626414497e0 con 0x5626416a3f10 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56264144b810 con 0x5626416a35f0 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56264144ff00 con 0x5626416571f0 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 10 client.0 _ll_register_callbacks cb 0x7f8a240016e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a2be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416fc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a2be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416fc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57698/0 (socket says 172.21.15.5:57698) 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a2be00640 1 -- 172.21.15.5:0/585935541 learned_addr learned my addr 172.21.15.5:0/585935541 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a2b400640 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416571f0 0x5626416b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a23e00640 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416a35f0 0x5626416fc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a2be00640 1 -- 172.21.15.5:0/585935541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416571f0 msgr2=0x5626416b8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a2be00640 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416571f0 0x5626416b8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a2be00640 1 -- 172.21.15.5:0/585935541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416a35f0 msgr2=0x5626416fc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a2be00640 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416a35f0 0x5626416fc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a2be00640 1 -- 172.21.15.5:0/585935541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562641443cf0 con 0x5626416a3f10 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a2b400640 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416571f0 0x5626416b8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a23e00640 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416a35f0 0x5626416fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a2be00640 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416fc790 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8a24002130 tx=0x7f8a24001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8cb70dc25a7994 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a18c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a18c00640 1 -- 172.21.15.5:0/585935541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2401a070 con 0x5626416a3f10 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a35a25000 1 -- 172.21.15.5:0/585935541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a24003b90 con 0x5626416a3f10 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.047+0000 7f8a18c00640 1 -- 172.21.15.5:0/585935541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8a2402a450 con 0x5626416a3f10 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a18c00640 1 -- 172.21.15.5:0/585935541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8a24032050 con 0x5626416a3f10 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 10 client.5901 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:37.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 -- 172.21.15.5:0/585935541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x56264143dfe0 con 0x5626416a3f10 2024-08-18T22:22:37.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a18c00640 1 -- 172.21.15.5:0/585935541 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a24003b90 con 0x5626416a3f10 2024-08-18T22:22:37.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a18c00640 1 -- 172.21.15.5:0/585935541 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f8a24035020 con 0x5626416a3f10 2024-08-18T22:22:37.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 10 client.5901 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:37.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 10 client.5901 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:37.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 20 client.5901 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:37.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626416fccd0 0x5626417176f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 4 client.5901 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-08-18T22:22:37.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 -- 172.21.15.5:0/585935541 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x5626414b59d0 con 0x5626416fccd0 2024-08-18T22:22:37.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a2b400640 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626416fccd0 0x5626417176f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a2b400640 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626416fccd0 0x5626417176f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83ed8990b013156 server_cookie=3ecac74cea9ac6f7 in_seq=0 out_seq=0 2024-08-18T22:22:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a18c00640 10 client.5901 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a18c00640 1 -- 172.21.15.5:0/585935541 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x5626414b59d0 con 0x5626416fccd0 2024-08-18T22:22:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a18c00640 10 client.5901 handle_command_reply: tid=0 2024-08-18T22:22:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 client.5901 shutdown 2024-08-18T22:22:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 -- 172.21.15.5:0/585935541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 msgr2=0x5626416fc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416fc790 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8a24002130 tx=0x7f8a24001260 comp rx=0 tx=0).stop 2024-08-18T22:22:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 -- 172.21.15.5:0/585935541 shutdown_connections 2024-08-18T22:22:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5626416fccd0 0x5626417176f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5626416a3f10 0x5626416fc790 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5626416a35f0 0x5626416fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 --2- 172.21.15.5:0/585935541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5626416571f0 0x5626416b8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a18c00640 0 client.5901 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 -- 172.21.15.5:0/585935541 >> 172.21.15.5:0/585935541 conn(0x5626416844a0 msgr2=0x562641656550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 -- 172.21.15.5:0/585935541 shutdown_connections 2024-08-18T22:22:37.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 1 -- 172.21.15.5:0/585935541 wait complete. 2024-08-18T22:22:37.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a35a25000 20 client.5901 trim_cache size 0 max 16384 2024-08-18T22:22:37.060 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": -2 2024-08-18T22:22:37.060 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:37.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 -- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a080678c0 msgr2=0x7f8a08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a080678c0 0x7f8a08069d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0ad000 tx=0x7f8a1c0a6000 comp rx=0 tx=0).stop 2024-08-18T22:22:37.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 -- 172.21.15.5:0/532864738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a2c0d1090 msgr2=0x7f8a2c0b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a2c0d1090 0x7f8a2c0b3510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c4d0 tx=0x7f8a1400c990 comp rx=0 tx=0).stop 2024-08-18T22:22:37.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 -- 172.21.15.5:0/532864738 shutdown_connections 2024-08-18T22:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a080678c0 0x7f8a08069d80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a2c15fb80 0x7f8a2c0b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a2c0d1090 0x7f8a2c0b3510 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 --2- 172.21.15.5:0/532864738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a2c0b5ad0 0x7f8a2c1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 -- 172.21.15.5:0/532864738 >> 172.21.15.5:0/532864738 conn(0x7f8a2c0d2180 msgr2=0x7f8a2c0b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 -- 172.21.15.5:0/532864738 shutdown_connections 2024-08-18T22:22:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.051+0000 7f8a32600640 1 -- 172.21.15.5:0/532864738 wait complete. 2024-08-18T22:22:37.075 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-08-18T22:22:37.075 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-08-18T22:22:37.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-08-18T22:22:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6849400640 1 Processor -- start 2024-08-18T22:22:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6849400640 1 -- start start 2024-08-18T22:22:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6849400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f684415b0c0 0x7f684406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6849400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68440b31f0 con 0x7f68440b40c0 2024-08-18T22:22:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6849400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68440b34d0 con 0x7f68440cf290 2024-08-18T22:22:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6849400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f68440b3d70 con 0x7f684415b0c0 2024-08-18T22:22:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6842800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f684415b0c0 0x7f684406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6842800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f684415b0c0 0x7f684406db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57714/0 (socket says 172.21.15.5:57714) 2024-08-18T22:22:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6842800640 1 -- 172.21.15.5:0/3562402813 learned_addr learned my addr 172.21.15.5:0/3562402813 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6842800640 1 -- 172.21.15.5:0/3562402813 >> v1:172.21.15.117:6789/0 conn(0x7f68440cf290 legacy=0x7f6844073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6842800640 1 -- 172.21.15.5:0/3562402813 >> v1:172.21.15.5:6789/0 conn(0x7f68440b40c0 legacy=0x7f6844072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.215+0000 7f6842800640 1 -- 172.21.15.5:0/3562402813 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68440b37b0 con 0x7f684415b0c0 2024-08-18T22:22:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.219+0000 7f6842800640 1 --2- 172.21.15.5:0/3562402813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684415b0c0 0x7f684406db80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f683400bb10 tx=0x7f683401eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311d22809b147052 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.219+0000 7f6841e00640 1 -- 172.21.15.5:0/3562402813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68340b4070 con 0x7f684415b0c0 2024-08-18T22:22:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.219+0000 7f6841e00640 1 -- 172.21.15.5:0/3562402813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68340a7ad0 con 0x7f684415b0c0 2024-08-18T22:22:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.219+0000 7f6841e00640 1 -- 172.21.15.5:0/3562402813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68340af440 con 0x7f684415b0c0 2024-08-18T22:22:37.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.219+0000 7f6849400640 1 -- 172.21.15.5:0/3562402813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684415b0c0 msgr2=0x7f684406db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.219+0000 7f6849400640 1 --2- 172.21.15.5:0/3562402813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684415b0c0 0x7f684406db80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f683400bb10 tx=0x7f683401eae0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.219+0000 7f6849400640 1 -- 172.21.15.5:0/3562402813 shutdown_connections 2024-08-18T22:22:37.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.219+0000 7f6849400640 1 --2- 172.21.15.5:0/3562402813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f684415b0c0 0x7f684406db80 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.219+0000 7f6849400640 1 -- 172.21.15.5:0/3562402813 >> 172.21.15.5:0/3562402813 conn(0x7f68440b1dc0 msgr2=0x7f68440b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.219+0000 7f6849400640 1 -- 172.21.15.5:0/3562402813 shutdown_connections 2024-08-18T22:22:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.219+0000 7f6849400640 1 -- 172.21.15.5:0/3562402813 wait complete. 2024-08-18T22:22:37.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6849400640 1 Processor -- start 2024-08-18T22:22:37.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6849400640 1 -- start start 2024-08-18T22:22:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6849400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68440b40c0 0x7f684415c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6849400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440cf290 0x7f684414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6849400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f684415b0c0 0x7f6844150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6849400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f68440b48e0 con 0x7f68440cf290 2024-08-18T22:22:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6849400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f684415b4a0 con 0x7f684415b0c0 2024-08-18T22:22:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6849400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f684415c710 con 0x7f68440b40c0 2024-08-18T22:22:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6839e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440cf290 0x7f684414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6839e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440cf290 0x7f684414db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57724/0 (socket says 172.21.15.5:57724) 2024-08-18T22:22:37.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6839e00640 1 -- 172.21.15.5:0/559451981 learned_addr learned my addr 172.21.15.5:0/559451981 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6842800640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68440b40c0 0x7f684415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6843200640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f684415b0c0 0x7f6844150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6839e00640 1 -- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68440b40c0 msgr2=0x7f684415c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6839e00640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68440b40c0 0x7f684415c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6839e00640 1 -- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f684415b0c0 msgr2=0x7f6844150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6839e00640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f684415b0c0 0x7f6844150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6839e00640 1 -- 172.21.15.5:0/559451981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684415c9f0 con 0x7f68440cf290 2024-08-18T22:22:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6842800640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68440b40c0 0x7f684415c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6839e00640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440cf290 0x7f684414db10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c500 tx=0x7f682c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f683b400640 1 -- 172.21.15.5:0/559451981 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c016020 con 0x7f68440cf290 2024-08-18T22:22:37.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f683b400640 1 -- 172.21.15.5:0/559451981 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c005220 con 0x7f68440cf290 2024-08-18T22:22:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f683b400640 1 -- 172.21.15.5:0/559451981 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c007030 con 0x7f68440cf290 2024-08-18T22:22:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6849400640 1 -- 172.21.15.5:0/559451981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684415ccd0 con 0x7f68440cf290 2024-08-18T22:22:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.223+0000 7f6849400640 1 -- 172.21.15.5:0/559451981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f684415d290 con 0x7f68440cf290 2024-08-18T22:22:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f683b400640 1 -- 172.21.15.5:0/559451981 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f682c0071d0 con 0x7f68440cf290 2024-08-18T22:22:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f683b400640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68200678c0 0x7f6820069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f683b400640 1 -- 172.21.15.5:0/559451981 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f682c0858b0 con 0x7f68440cf290 2024-08-18T22:22:37.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6842800640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68200678c0 0x7f6820069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f684c8d3000 1 Processor -- start 2024-08-18T22:22:37.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f684c8d3000 1 -- start start 2024-08-18T22:22:37.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6842800640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68200678c0 0x7f6820069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f68340b1000 tx=0x7f6834008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf9900 0x56257cbf9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 0x56257cc3d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f684c8d3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56257cada580 con 0x56257cbf3b70 2024-08-18T22:22:37.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f684c8d3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56257ca41340 con 0x56257cbf9900 2024-08-18T22:22:37.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f684c8d3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56257c9dcd90 con 0x56257cbf4490 2024-08-18T22:22:37.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6839e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6839e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57730/0 (socket says 172.21.15.5:57730) 2024-08-18T22:22:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6839e00640 1 -- 172.21.15.5:0/3348175540 learned_addr learned my addr 172.21.15.5:0/3348175540 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6842800640 1 --2- 172.21.15.5:0/3348175540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf9900 0x56257cbf9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6843200640 1 --2- 172.21.15.5:0/3348175540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 0x56257cc3d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6839e00640 1 -- 172.21.15.5:0/3348175540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 msgr2=0x56257cc3d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6839e00640 1 --2- 172.21.15.5:0/3348175540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 0x56257cc3d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6839e00640 1 -- 172.21.15.5:0/3348175540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf9900 msgr2=0x56257cbf9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6839e00640 1 --2- 172.21.15.5:0/3348175540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf9900 0x56257cbf9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6839e00640 1 -- 172.21.15.5:0/3348175540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56257c9e1850 con 0x56257cbf3b70 2024-08-18T22:22:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6843200640 1 --2- 172.21.15.5:0/3348175540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 0x56257cc3d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.227+0000 7f6839e00640 1 --2- 172.21.15.5:0/3348175540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf3f50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f682c083be0 tx=0x7f682c055b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7601b1f67a90560b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6833400640 1 -- 172.21.15.5:0/3348175540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c053b70 con 0x56257cbf3b70 2024-08-18T22:22:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6833400640 1 -- 172.21.15.5:0/3348175540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c053dd0 con 0x56257cbf3b70 2024-08-18T22:22:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6833400640 1 -- 172.21.15.5:0/3348175540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c052140 con 0x56257cbf3b70 2024-08-18T22:22:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 -- 172.21.15.5:0/3348175540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 msgr2=0x56257cbf3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 --2- 172.21.15.5:0/3348175540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf3f50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f682c083be0 tx=0x7f682c055b90 comp rx=0 tx=0).stop 2024-08-18T22:22:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 -- 172.21.15.5:0/3348175540 shutdown_connections 2024-08-18T22:22:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 --2- 172.21.15.5:0/3348175540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 0x56257cc3d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 --2- 172.21.15.5:0/3348175540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf3f50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 --2- 172.21.15.5:0/3348175540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf9900 0x56257cbf9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 -- 172.21.15.5:0/3348175540 >> 172.21.15.5:0/3348175540 conn(0x56257cbeb4a0 msgr2=0x56257cbf2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 -- 172.21.15.5:0/3348175540 shutdown_connections 2024-08-18T22:22:37.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 -- 172.21.15.5:0/3348175540 wait complete. 2024-08-18T22:22:37.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 -- start start 2024-08-18T22:22:37.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 Processor -- start 2024-08-18T22:22:37.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf3b70 0x56257cc44410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf4490 0x56257cc44950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf9900 0x56257cc44e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56257c9e2e70 con 0x56257cbf4490 2024-08-18T22:22:37.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56257ca3d300 con 0x56257cbf9900 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56257c9c6ac0 con 0x56257cbf3b70 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 10 client.0 _ll_register_callbacks cb 0x56257cbdf340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6839e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf4490 0x56257cc44950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6839e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf4490 0x56257cc44950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57732/0 (socket says 172.21.15.5:57732) 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6839e00640 1 -- 172.21.15.5:0/2386232593 learned_addr learned my addr 172.21.15.5:0/2386232593 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6842800640 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf3b70 0x56257cc44410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6843200640 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf9900 0x56257cc44e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6839e00640 1 -- 172.21.15.5:0/2386232593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf3b70 msgr2=0x56257cc44410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6839e00640 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf3b70 0x56257cc44410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6839e00640 1 -- 172.21.15.5:0/2386232593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf9900 msgr2=0x56257cc44e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6839e00640 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf9900 0x56257cc44e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6839e00640 1 -- 172.21.15.5:0/2386232593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56257ca03f40 con 0x56257cbf4490 2024-08-18T22:22:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6843200640 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf9900 0x56257cc44e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6839e00640 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf4490 0x56257cc44950 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f682c05c040 tx=0x7f682c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648dc53b1ce9e371 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6827e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6827e00640 1 -- 172.21.15.5:0/2386232593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c052140 con 0x56257cbf4490 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6827e00640 1 -- 172.21.15.5:0/2386232593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f682c056e00 con 0x56257cbf4490 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f684c8d3000 1 -- 172.21.15.5:0/2386232593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f682c053dd0 con 0x56257cbf4490 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.231+0000 7f6827e00640 1 -- 172.21.15.5:0/2386232593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f682c079050 con 0x56257cbf4490 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 10 client.5916 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 -- 172.21.15.5:0/2386232593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x56257c9dcfe0 con 0x56257cbf4490 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f6827e00640 1 -- 172.21.15.5:0/2386232593 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c053dd0 con 0x56257cbf4490 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f6827e00640 1 -- 172.21.15.5:0/2386232593 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f682c07c020 con 0x56257cbf4490 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 10 client.5916 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 10 client.5916 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 20 client.5916 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:37.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56257cc4c7e0 0x56257cc4ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 4 client.5916 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 -- 172.21.15.5:0/2386232593 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56257c9dbd60 con 0x56257cc4c7e0 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f6842800640 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56257cc4c7e0 0x56257cc4ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f6842800640 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56257cc4c7e0 0x56257cc4ebd0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1ef3d02db62ef93 server_cookie=5fff8949831ff676 in_seq=0 out_seq=0 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f6827e00640 10 client.5916 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f6827e00640 1 -- 172.21.15.5:0/2386232593 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56257c9dbd60 con 0x56257cc4c7e0 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f6827e00640 10 client.5916 handle_command_reply: tid=0 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 client.5916 shutdown 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 -- 172.21.15.5:0/2386232593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf4490 msgr2=0x56257cc44950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf4490 0x56257cc44950 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f682c05c040 tx=0x7f682c00f000 comp rx=0 tx=0).stop 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 -- 172.21.15.5:0/2386232593 shutdown_connections 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56257cc4c7e0 0x56257cc4ebd0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf9900 0x56257cc44e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf4490 0x56257cc44950 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 --2- 172.21.15.5:0/2386232593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf3b70 0x56257cc44410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f6827e00640 0 client.5916 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 -- 172.21.15.5:0/2386232593 >> 172.21.15.5:0/2386232593 conn(0x56257cbeb4a0 msgr2=0x56257cbf2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 -- 172.21.15.5:0/2386232593 shutdown_connections 2024-08-18T22:22:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 1 -- 172.21.15.5:0/2386232593 wait complete. 2024-08-18T22:22:37.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.235+0000 7f684c8d3000 20 client.5916 trim_cache size 0 max 16384 2024-08-18T22:22:37.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 Processor -- start 2024-08-18T22:22:37.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 -- start start 2024-08-18T22:22:37.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbeb4a0 0x56257cc52440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 0x56257cbf3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6844203070 con 0x56257cbf3b70 2024-08-18T22:22:37.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f68441f7eb0 con 0x56257cbeb4a0 2024-08-18T22:22:37.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6844202ad0 con 0x56257cbf4490 2024-08-18T22:22:37.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6839e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6839e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57744/0 (socket says 172.21.15.5:57744) 2024-08-18T22:22:37.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6839e00640 1 -- 172.21.15.5:0/1572865680 learned_addr learned my addr 172.21.15.5:0/1572865680 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6842800640 1 --2- 172.21.15.5:0/1572865680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbeb4a0 0x56257cc52440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6843200640 1 --2- 172.21.15.5:0/1572865680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 0x56257cbf3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6839e00640 1 -- 172.21.15.5:0/1572865680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 msgr2=0x56257cbf3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6839e00640 1 --2- 172.21.15.5:0/1572865680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 0x56257cbf3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6839e00640 1 -- 172.21.15.5:0/1572865680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbeb4a0 msgr2=0x56257cc52440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6839e00640 1 --2- 172.21.15.5:0/1572865680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbeb4a0 0x56257cc52440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6839e00640 1 -- 172.21.15.5:0/1572865680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56257cbf70f0 con 0x56257cbf3b70 2024-08-18T22:22:37.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6843200640 1 --2- 172.21.15.5:0/1572865680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 0x56257cbf3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6839e00640 1 --2- 172.21.15.5:0/1572865680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf2c40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f682c053d80 tx=0x7f682c06f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddf8a8686813eac server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6832a00640 1 -- 172.21.15.5:0/1572865680 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c059e80 con 0x56257cbf3b70 2024-08-18T22:22:37.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6832a00640 1 -- 172.21.15.5:0/1572865680 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c053dd0 con 0x56257cbf3b70 2024-08-18T22:22:37.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f6832a00640 1 -- 172.21.15.5:0/1572865680 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c0074c0 con 0x56257cbf3b70 2024-08-18T22:22:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 -- 172.21.15.5:0/1572865680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 msgr2=0x56257cbf2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 --2- 172.21.15.5:0/1572865680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf2c40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f682c053d80 tx=0x7f682c06f070 comp rx=0 tx=0).stop 2024-08-18T22:22:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 -- 172.21.15.5:0/1572865680 shutdown_connections 2024-08-18T22:22:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 --2- 172.21.15.5:0/1572865680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf4490 0x56257cbf3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 --2- 172.21.15.5:0/1572865680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbf3b70 0x56257cbf2c40 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 --2- 172.21.15.5:0/1572865680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbeb4a0 0x56257cc52440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 -- 172.21.15.5:0/1572865680 >> 172.21.15.5:0/1572865680 conn(0x56257cbfede0 msgr2=0x56257cbf60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 -- 172.21.15.5:0/1572865680 shutdown_connections 2024-08-18T22:22:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.255+0000 7f684c8d3000 1 -- 172.21.15.5:0/1572865680 wait complete. 2024-08-18T22:22:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 -- start start 2024-08-18T22:22:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 Processor -- start 2024-08-18T22:22:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbeb4a0 0x56257cc51880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf3b70 0x56257cc51dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf4490 0x56257cc6cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56257cac37a0 con 0x56257cbeb4a0 2024-08-18T22:22:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56257ca45970 con 0x56257cbf4490 2024-08-18T22:22:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56257cafe0a0 con 0x56257cbf3b70 2024-08-18T22:22:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 10 client.0 _ll_register_callbacks cb 0x7f68340b2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6842800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbeb4a0 0x56257cc51880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6842800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbeb4a0 0x56257cc51880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57756/0 (socket says 172.21.15.5:57756) 2024-08-18T22:22:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6842800640 1 -- 172.21.15.5:0/1372444056 learned_addr learned my addr 172.21.15.5:0/1372444056 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6839e00640 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf3b70 0x56257cc51dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6843200640 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf4490 0x56257cc6cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6842800640 1 -- 172.21.15.5:0/1372444056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf3b70 msgr2=0x56257cc51dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6842800640 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf3b70 0x56257cc51dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6842800640 1 -- 172.21.15.5:0/1372444056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf4490 msgr2=0x56257cc6cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6842800640 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf4490 0x56257cc6cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6842800640 1 -- 172.21.15.5:0/1372444056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56257cac3c30 con 0x56257cbeb4a0 2024-08-18T22:22:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6842800640 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbeb4a0 0x56257cc51880 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f68340b2040 tx=0x7f6834004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be550cb18a1791e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6827e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6827e00640 1 -- 172.21.15.5:0/1372444056 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68340d4020 con 0x56257cbeb4a0 2024-08-18T22:22:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6827e00640 1 -- 172.21.15.5:0/1372444056 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f68340d1c40 con 0x56257cbeb4a0 2024-08-18T22:22:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 -- 172.21.15.5:0/1372444056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f682c053dd0 con 0x56257cbeb4a0 2024-08-18T22:22:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6827e00640 1 -- 172.21.15.5:0/1372444056 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f68340b4040 con 0x56257cbeb4a0 2024-08-18T22:22:37.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 10 client.5922 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 -- 172.21.15.5:0/1372444056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x56257ca9ab20 con 0x56257cbeb4a0 2024-08-18T22:22:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6827e00640 1 -- 172.21.15.5:0/1372444056 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c053dd0 con 0x56257cbeb4a0 2024-08-18T22:22:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6827e00640 1 -- 172.21.15.5:0/1372444056 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f68340c3040 con 0x56257cbeb4a0 2024-08-18T22:22:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 10 client.5922 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 10 client.5922 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 20 client.5922 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56257cbf9900 0x56257ccb0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 4 client.5922 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-08-18T22:22:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f684c8d3000 1 -- 172.21.15.5:0/1372444056 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x56257ca4ea70 con 0x56257cbf9900 2024-08-18T22:22:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.259+0000 7f6839e00640 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56257cbf9900 0x56257ccb0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6839e00640 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56257cbf9900 0x56257ccb0710 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc4faf47b5be57c2 server_cookie=7db7d95a6b5fecdc in_seq=0 out_seq=0 2024-08-18T22:22:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6827e00640 10 client.5922 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6827e00640 1 -- 172.21.15.5:0/1372444056 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56257ca4ea70 con 0x56257cbf9900 2024-08-18T22:22:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6827e00640 10 client.5922 handle_command_reply: tid=0 2024-08-18T22:22:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 1 client.5922 shutdown 2024-08-18T22:22:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 1 -- 172.21.15.5:0/1372444056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbeb4a0 msgr2=0x56257cc51880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbeb4a0 0x56257cc51880 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f68340b2040 tx=0x7f6834004740 comp rx=0 tx=0).stop 2024-08-18T22:22:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 1 -- 172.21.15.5:0/1372444056 shutdown_connections 2024-08-18T22:22:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x56257cbf9900 0x56257ccb0710 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56257cbf4490 0x56257cc6cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56257cbf3b70 0x56257cc51dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 1 --2- 172.21.15.5:0/1372444056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56257cbeb4a0 0x56257cc51880 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 1 -- 172.21.15.5:0/1372444056 >> 172.21.15.5:0/1372444056 conn(0x56257cbfede0 msgr2=0x56257cbf1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6827e00640 0 client.5922 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 1 -- 172.21.15.5:0/1372444056 shutdown_connections 2024-08-18T22:22:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 1 -- 172.21.15.5:0/1372444056 wait complete. 2024-08-18T22:22:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f684c8d3000 20 client.5922 trim_cache size 0 max 16384 2024-08-18T22:22:37.275 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:37.275 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:22:37.275 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "d3d812d8-0737-4ae2-adf0-22398b502dd7", 2024-08-18T22:22:37.275 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:22:37.275 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:37.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 -- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68200678c0 msgr2=0x7f6820069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68200678c0 0x7f6820069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f68340b1000 tx=0x7f6834008040 comp rx=0 tx=0).stop 2024-08-18T22:22:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 -- 172.21.15.5:0/559451981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440cf290 msgr2=0x7f684414db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440cf290 0x7f684414db10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c500 tx=0x7f682c00c9c0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 -- 172.21.15.5:0/559451981 shutdown_connections 2024-08-18T22:22:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68200678c0 0x7f6820069d80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f684415b0c0 0x7f6844150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68440cf290 0x7f684414db10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 --2- 172.21.15.5:0/559451981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68440b40c0 0x7f684415c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 -- 172.21.15.5:0/559451981 >> 172.21.15.5:0/559451981 conn(0x7f68440b1dc0 msgr2=0x7f6844152090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 -- 172.21.15.5:0/559451981 shutdown_connections 2024-08-18T22:22:37.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.263+0000 7f6849400640 1 -- 172.21.15.5:0/559451981 wait complete. 2024-08-18T22:22:37.286 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'd3d812d8-0737-4ae2-adf0-22398b502dd7', 'mode': 'asynchronous'}' 2024-08-18T22:22:37.286 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-08-18T22:22:37.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-08-18T22:22:37.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f0a01600640 1 Processor -- start 2024-08-18T22:22:37.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f0a01600640 1 -- start start 2024-08-18T22:22:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f0a01600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc09aca0 0x7f09fc0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f0a01600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09fc0b1300 0x7f09fc0affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f0a01600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09fc06e8a0 con 0x7f09fc09b080 2024-08-18T22:22:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f0a01600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f09fc09bb80 con 0x7f09fc0b1300 2024-08-18T22:22:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f0a01600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f09fc0d2e40 con 0x7f09fc09aca0 2024-08-18T22:22:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f09f2000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09fc0b1300 0x7f09fc0affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f09f2000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09fc0b1300 0x7f09fc0affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57766/0 (socket says 172.21.15.5:57766) 2024-08-18T22:22:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f09f2000640 1 -- 172.21.15.5:0/1412953851 learned_addr learned my addr 172.21.15.5:0/1412953851 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f09faa00640 1 --2- 172.21.15.5:0/1412953851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc09aca0 0x7f09fc0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f09f2000640 1 -- 172.21.15.5:0/1412953851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc09aca0 msgr2=0x7f09fc0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f09f2000640 1 --2- 172.21.15.5:0/1412953851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc09aca0 0x7f09fc0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f09f2000640 1 -- 172.21.15.5:0/1412953851 >> v1:172.21.15.117:6789/0 conn(0x7f09fc09b080 legacy=0x7f09fc0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.427+0000 7f09f2000640 1 -- 172.21.15.5:0/1412953851 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09fc06cbd0 con 0x7f09fc0b1300 2024-08-18T22:22:37.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f09f2000640 1 --2- 172.21.15.5:0/1412953851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09fc0b1300 0x7f09fc0affd0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f09e40098a0 tx=0x7f09e401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c567001f44d940ef server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f09fa000640 1 -- 172.21.15.5:0/1412953851 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40ab5f0 con 0x7f09fc0b1300 2024-08-18T22:22:37.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f09fa000640 1 -- 172.21.15.5:0/1412953851 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e40b0070 con 0x7f09fc0b1300 2024-08-18T22:22:37.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f09fa000640 1 -- 172.21.15.5:0/1412953851 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40ab9b0 con 0x7f09fc0b1300 2024-08-18T22:22:37.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f0a01600640 1 -- 172.21.15.5:0/1412953851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09fc0b1300 msgr2=0x7f09fc0affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f0a01600640 1 --2- 172.21.15.5:0/1412953851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09fc0b1300 0x7f09fc0affd0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f09e40098a0 tx=0x7f09e401c540 comp rx=0 tx=0).stop 2024-08-18T22:22:37.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f0a01600640 1 -- 172.21.15.5:0/1412953851 shutdown_connections 2024-08-18T22:22:37.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f0a01600640 1 --2- 172.21.15.5:0/1412953851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09fc0b1300 0x7f09fc0affd0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f0a01600640 1 --2- 172.21.15.5:0/1412953851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc09aca0 0x7f09fc0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f0a01600640 1 -- 172.21.15.5:0/1412953851 >> 172.21.15.5:0/1412953851 conn(0x7f09fc0d2180 msgr2=0x7f09fc0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f0a01600640 1 -- 172.21.15.5:0/1412953851 shutdown_connections 2024-08-18T22:22:37.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.431+0000 7f0a01600640 1 -- 172.21.15.5:0/1412953851 wait complete. 2024-08-18T22:22:37.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f0a01600640 1 Processor -- start 2024-08-18T22:22:37.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f0a01600640 1 -- start start 2024-08-18T22:22:37.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f0a01600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09fc09aca0 0x7f09fc15d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f0a01600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09fc09b080 0x7f09fc168af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f0a01600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0b1300 0x7f09fc15c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f0a01600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc16b6b0 con 0x7f09fc09aca0 2024-08-18T22:22:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f0a01600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc16b530 con 0x7f09fc09b080 2024-08-18T22:22:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f0a01600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f09fc16b830 con 0x7f09fc0b1300 2024-08-18T22:22:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09faa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09fc09aca0 0x7f09fc15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09faa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09fc09aca0 0x7f09fc15d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57776/0 (socket says 172.21.15.5:57776) 2024-08-18T22:22:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09faa00640 1 -- 172.21.15.5:0/18680496 learned_addr learned my addr 172.21.15.5:0/18680496 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09f2000640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09fc09b080 0x7f09fc168af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09fb400640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0b1300 0x7f09fc15c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09faa00640 1 -- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0b1300 msgr2=0x7f09fc15c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09faa00640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0b1300 0x7f09fc15c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09faa00640 1 -- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09fc09b080 msgr2=0x7f09fc168af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09faa00640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09fc09b080 0x7f09fc168af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09faa00640 1 -- 172.21.15.5:0/18680496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09fc160b40 con 0x7f09fc09aca0 2024-08-18T22:22:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09fb400640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0b1300 0x7f09fc15c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09faa00640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09fc09aca0 0x7f09fc15d870 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00e9b0 tx=0x7f09ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09f3400640 1 -- 172.21.15.5:0/18680496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec017070 con 0x7f09fc09aca0 2024-08-18T22:22:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09f3400640 1 -- 172.21.15.5:0/18680496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ec00c9a0 con 0x7f09fc09aca0 2024-08-18T22:22:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f09f3400640 1 -- 172.21.15.5:0/18680496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00cd70 con 0x7f09fc09aca0 2024-08-18T22:22:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f0a01600640 1 -- 172.21.15.5:0/18680496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09fc160e20 con 0x7f09fc09aca0 2024-08-18T22:22:37.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.435+0000 7f0a01600640 1 -- 172.21.15.5:0/18680496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09fc15c0a0 con 0x7f09fc09aca0 2024-08-18T22:22:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f09f3400640 1 -- 172.21.15.5:0/18680496 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09ec01a070 con 0x7f09fc09aca0 2024-08-18T22:22:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f09f3400640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09d80678c0 0x7f09d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f09f3400640 1 -- 172.21.15.5:0/18680496 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f09ec0862a0 con 0x7f09fc09aca0 2024-08-18T22:22:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f09f2000640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09d80678c0 0x7f09d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f0a04a16000 1 Processor -- start 2024-08-18T22:22:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f0a04a16000 1 -- start start 2024-08-18T22:22:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f09f2000640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09d80678c0 0x7f09d8069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09e40af000 tx=0x7f09e40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562443607ca0 0x562443608080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x5624435be150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624435be690 0x5624435bea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f0a04a16000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5624434a4e80 con 0x5624436085c0 2024-08-18T22:22:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f0a04a16000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562443447a60 con 0x5624435be690 2024-08-18T22:22:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.439+0000 7f0a04a16000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56244340c6e0 con 0x562443607ca0 2024-08-18T22:22:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x5624435be150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x5624435be150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57786/0 (socket says 172.21.15.5:57786) 2024-08-18T22:22:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 -- 172.21.15.5:0/1168969947 learned_addr learned my addr 172.21.15.5:0/1168969947 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09faa00640 1 --2- 172.21.15.5:0/1168969947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562443607ca0 0x562443608080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09fb400640 1 --2- 172.21.15.5:0/1168969947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624435be690 0x5624435bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 -- 172.21.15.5:0/1168969947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562443607ca0 msgr2=0x562443608080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 --2- 172.21.15.5:0/1168969947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562443607ca0 0x562443608080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 -- 172.21.15.5:0/1168969947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624435be690 msgr2=0x5624435bea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 --2- 172.21.15.5:0/1168969947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624435be690 0x5624435bea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 -- 172.21.15.5:0/1168969947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624433d31f0 con 0x5624436085c0 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 --2- 172.21.15.5:0/1168969947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x5624435be150 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f09e401abf0 tx=0x7f09e4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1009bc769e416fdb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09eb400640 1 -- 172.21.15.5:0/1168969947 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40c9430 con 0x5624436085c0 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09eb400640 1 -- 172.21.15.5:0/1168969947 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e40b0040 con 0x5624436085c0 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09eb400640 1 -- 172.21.15.5:0/1168969947 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40c97d0 con 0x5624436085c0 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 -- 172.21.15.5:0/1168969947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 msgr2=0x5624435be150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 --2- 172.21.15.5:0/1168969947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x5624435be150 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f09e401abf0 tx=0x7f09e4004740 comp rx=0 tx=0).stop 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 -- 172.21.15.5:0/1168969947 shutdown_connections 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 --2- 172.21.15.5:0/1168969947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624435be690 0x5624435bea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 --2- 172.21.15.5:0/1168969947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x5624435be150 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 --2- 172.21.15.5:0/1168969947 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562443607ca0 0x562443608080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 -- 172.21.15.5:0/1168969947 >> 172.21.15.5:0/1168969947 conn(0x5624435b5a80 msgr2=0x5624435bca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 -- 172.21.15.5:0/1168969947 shutdown_connections 2024-08-18T22:22:37.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 -- 172.21.15.5:0/1168969947 wait complete. 2024-08-18T22:22:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 -- start start 2024-08-18T22:22:37.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 Processor -- start 2024-08-18T22:22:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624435be690 0x56244360ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244360f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624436085c0 0x56244360f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5624434086a0 con 0x562443607ca0 2024-08-18T22:22:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5624433a8200 con 0x5624436085c0 2024-08-18T22:22:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5624433c9a50 con 0x5624435be690 2024-08-18T22:22:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f0a04a16000 10 client.0 _ll_register_callbacks cb 0x5624435a99a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244360f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244360f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57798/0 (socket says 172.21.15.5:57798) 2024-08-18T22:22:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.443+0000 7f09f2000640 1 -- 172.21.15.5:0/1944791224 learned_addr learned my addr 172.21.15.5:0/1944791224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09fb400640 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624436085c0 0x56244360f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09faa00640 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624435be690 0x56244360ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09f2000640 1 -- 172.21.15.5:0/1944791224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624435be690 msgr2=0x56244360ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09f2000640 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624435be690 0x56244360ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09f2000640 1 -- 172.21.15.5:0/1944791224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624436085c0 msgr2=0x56244360f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09f2000640 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624436085c0 0x56244360f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09f2000640 1 -- 172.21.15.5:0/1944791224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624433a8450 con 0x562443607ca0 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09f2000640 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244360f360 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f09e401ca20 tx=0x7f09e401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4465900e3e141acd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09dfe00640 1 -- 172.21.15.5:0/1944791224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40d6060 con 0x562443607ca0 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 -- 172.21.15.5:0/1944791224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09e40b0040 con 0x562443607ca0 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09dfe00640 1 -- 172.21.15.5:0/1944791224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f09e40c96f0 con 0x562443607ca0 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09dfe00640 1 -- 172.21.15.5:0/1944791224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f09e40dc050 con 0x562443607ca0 2024-08-18T22:22:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 10 client.5934 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 -- 172.21.15.5:0/1944791224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5624433944a0 con 0x562443607ca0 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09dfe00640 1 -- 172.21.15.5:0/1944791224 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e40b0040 con 0x562443607ca0 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09dfe00640 1 -- 172.21.15.5:0/1944791224 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f09e40df020 con 0x562443607ca0 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 10 client.5934 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 10 client.5934 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 20 client.5934 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5624436171f0 0x5624436195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 4 client.5934 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 -- 172.21.15.5:0/1944791224 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624433a71d0 con 0x5624436171f0 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09faa00640 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5624436171f0 0x5624436195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09faa00640 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5624436171f0 0x5624436195e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a66c5edc8fe0f923 server_cookie=775b0575141c357e in_seq=0 out_seq=0 2024-08-18T22:22:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09dfe00640 10 client.5934 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09dfe00640 1 -- 172.21.15.5:0/1944791224 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5624433a71d0 con 0x5624436171f0 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09dfe00640 10 client.5934 handle_command_reply: tid=0 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 client.5934 shutdown 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 -- 172.21.15.5:0/1944791224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 msgr2=0x56244360f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244360f360 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f09e401ca20 tx=0x7f09e401ad80 comp rx=0 tx=0).stop 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 -- 172.21.15.5:0/1944791224 shutdown_connections 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5624436171f0 0x5624436195e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624436085c0 0x56244360f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244360f360 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 --2- 172.21.15.5:0/1944791224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624435be690 0x56244360ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f09dfe00640 0 client.5934 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 -- 172.21.15.5:0/1944791224 >> 172.21.15.5:0/1944791224 conn(0x5624435b5a80 msgr2=0x5624435bca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 -- 172.21.15.5:0/1944791224 shutdown_connections 2024-08-18T22:22:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 1 -- 172.21.15.5:0/1944791224 wait complete. 2024-08-18T22:22:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.447+0000 7f0a04a16000 20 client.5934 trim_cache size 0 max 16384 2024-08-18T22:22:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f0a04a16000 1 Processor -- start 2024-08-18T22:22:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f0a04a16000 1 -- start start 2024-08-18T22:22:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624435be690 0x56244367f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244367f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624436085c0 0x56244367fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f0a04a16000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc203ef0 con 0x562443607ca0 2024-08-18T22:22:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f0a04a16000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc202f00 con 0x5624435be690 2024-08-18T22:22:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f0a04a16000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f09fc15fe30 con 0x5624436085c0 2024-08-18T22:22:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09f2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244367f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09f2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244367f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57804/0 (socket says 172.21.15.5:57804) 2024-08-18T22:22:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09f2000640 1 -- 172.21.15.5:0/264904529 learned_addr learned my addr 172.21.15.5:0/264904529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09fb400640 1 --2- 172.21.15.5:0/264904529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624436085c0 0x56244367fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09faa00640 1 --2- 172.21.15.5:0/264904529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624435be690 0x56244367f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09f2000640 1 -- 172.21.15.5:0/264904529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624436085c0 msgr2=0x56244367fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09f2000640 1 --2- 172.21.15.5:0/264904529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624436085c0 0x56244367fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09f2000640 1 -- 172.21.15.5:0/264904529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624435be690 msgr2=0x56244367f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09f2000640 1 --2- 172.21.15.5:0/264904529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624435be690 0x56244367f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09f2000640 1 -- 172.21.15.5:0/264904529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624433d7880 con 0x562443607ca0 2024-08-18T22:22:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09f2000640 1 --2- 172.21.15.5:0/264904529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244367f870 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f09e4097f20 tx=0x7f09e400b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b600dab90c41a66 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09eaa00640 1 -- 172.21.15.5:0/264904529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40c96f0 con 0x562443607ca0 2024-08-18T22:22:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09eaa00640 1 -- 172.21.15.5:0/264904529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e40b0040 con 0x562443607ca0 2024-08-18T22:22:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.467+0000 7f09eaa00640 1 -- 172.21.15.5:0/264904529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40d1420 con 0x562443607ca0 2024-08-18T22:22:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 -- 172.21.15.5:0/264904529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 msgr2=0x56244367f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 --2- 172.21.15.5:0/264904529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244367f870 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f09e4097f20 tx=0x7f09e400b050 comp rx=0 tx=0).stop 2024-08-18T22:22:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 -- 172.21.15.5:0/264904529 shutdown_connections 2024-08-18T22:22:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 --2- 172.21.15.5:0/264904529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624436085c0 0x56244367fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 --2- 172.21.15.5:0/264904529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562443607ca0 0x56244367f870 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 --2- 172.21.15.5:0/264904529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5624435be690 0x56244367f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 -- 172.21.15.5:0/264904529 >> 172.21.15.5:0/264904529 conn(0x5624435b5a80 msgr2=0x5624435c2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 -- 172.21.15.5:0/264904529 shutdown_connections 2024-08-18T22:22:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 -- 172.21.15.5:0/264904529 wait complete. 2024-08-18T22:22:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 -- start start 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 Processor -- start 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624435be690 0x562443614770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562443607ca0 0x5624436400e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x562443640620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5624435c22c0 con 0x5624436085c0 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5624433cedb0 con 0x562443607ca0 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56244340c6e0 con 0x5624435be690 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 10 client.0 _ll_register_callbacks cb 0x7f09f4001730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09fb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x562443640620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09fb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x562443640620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57806/0 (socket says 172.21.15.5:57806) 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09fb400640 1 -- 172.21.15.5:0/971385439 learned_addr learned my addr 172.21.15.5:0/971385439 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09f2000640 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562443607ca0 0x5624436400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09faa00640 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624435be690 0x562443614770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09fb400640 1 -- 172.21.15.5:0/971385439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624435be690 msgr2=0x562443614770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09fb400640 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624435be690 0x562443614770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09fb400640 1 -- 172.21.15.5:0/971385439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562443607ca0 msgr2=0x5624436400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09fb400640 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562443607ca0 0x5624436400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09fb400640 1 -- 172.21.15.5:0/971385439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56244348e4d0 con 0x5624436085c0 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09f2000640 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562443607ca0 0x5624436400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09fb400640 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x562443640620 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f09f40169f0 tx=0x7f09f4016eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd65e2632270604 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09dfe00640 1 -- 172.21.15.5:0/971385439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f4015ca0 con 0x5624436085c0 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09dfe00640 1 -- 172.21.15.5:0/971385439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f09f4015e40 con 0x5624436085c0 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 -- 172.21.15.5:0/971385439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09e40b0040 con 0x5624436085c0 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09dfe00640 1 -- 172.21.15.5:0/971385439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f09f4003980 con 0x5624436085c0 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 10 client.5940 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:37.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f0a04a16000 1 -- 172.21.15.5:0/971385439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x562443465150 con 0x5624436085c0 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09dfe00640 1 -- 172.21.15.5:0/971385439 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e40b0040 con 0x5624436085c0 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.471+0000 7f09dfe00640 1 -- 172.21.15.5:0/971385439 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f09f4029020 con 0x5624436085c0 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 10 client.5940 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 10 client.5940 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 20 client.5940 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562443640b60 0x56244368b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 4 client.5940 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 -- 172.21.15.5:0/971385439 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x562443419e10 con 0x562443640b60 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f09faa00640 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562443640b60 0x56244368b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f09faa00640 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562443640b60 0x56244368b550 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deee8b29822deba8 server_cookie=666ff5b0e718497c in_seq=0 out_seq=0 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f09dfe00640 10 client.5940 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f09dfe00640 1 -- 172.21.15.5:0/971385439 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562443419e10 con 0x562443640b60 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f09dfe00640 10 client.5940 handle_command_reply: tid=0 2024-08-18T22:22:37.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 client.5940 shutdown 2024-08-18T22:22:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 -- 172.21.15.5:0/971385439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 msgr2=0x562443640620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x562443640620 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f09f40169f0 tx=0x7f09f4016eb0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 -- 172.21.15.5:0/971385439 shutdown_connections 2024-08-18T22:22:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562443640b60 0x56244368b550 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624436085c0 0x562443640620 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562443607ca0 0x5624436400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f09dfe00640 0 client.5940 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 --2- 172.21.15.5:0/971385439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5624435be690 0x562443614770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 -- 172.21.15.5:0/971385439 >> 172.21.15.5:0/971385439 conn(0x5624435b5a80 msgr2=0x5624435c2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 -- 172.21.15.5:0/971385439 shutdown_connections 2024-08-18T22:22:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 1 -- 172.21.15.5:0/971385439 wait complete. 2024-08-18T22:22:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a04a16000 20 client.5940 trim_cache size 0 max 16384 2024-08-18T22:22:37.486 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:37.486 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:22:37.486 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "1a93caaf-753b-4f09-998b-0fc2226ab62e", 2024-08-18T22:22:37.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:22:37.487 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 -- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09d80678c0 msgr2=0x7f09d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09d80678c0 0x7f09d8069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09e40af000 tx=0x7f09e40a7000 comp rx=0 tx=0).stop 2024-08-18T22:22:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 -- 172.21.15.5:0/18680496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09fc09aca0 msgr2=0x7f09fc15d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09fc09aca0 0x7f09fc15d870 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00e9b0 tx=0x7f09ec00ee70 comp rx=0 tx=0).stop 2024-08-18T22:22:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 -- 172.21.15.5:0/18680496 shutdown_connections 2024-08-18T22:22:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09d80678c0 0x7f09d8069d80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09fc0b1300 0x7f09fc15c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09fc09b080 0x7f09fc168af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 --2- 172.21.15.5:0/18680496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09fc09aca0 0x7f09fc15d870 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 -- 172.21.15.5:0/18680496 >> 172.21.15.5:0/18680496 conn(0x7f09fc0d2180 msgr2=0x7f09fc0d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 -- 172.21.15.5:0/18680496 shutdown_connections 2024-08-18T22:22:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.475+0000 7f0a01600640 1 -- 172.21.15.5:0/18680496 wait complete. 2024-08-18T22:22:37.498 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '1a93caaf-753b-4f09-998b-0fc2226ab62e', 'mode': 'asynchronous'}' 2024-08-18T22:22:37.499 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-08-18T22:22:37.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-08-18T22:22:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2d06400640 1 Processor -- start 2024-08-18T22:22:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2d06400640 1 -- start start 2024-08-18T22:22:37.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2d06400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0015fb80 0x7f2d000d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2d06400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d000d1090 0x7f2d00071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2d06400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d000d30b0 con 0x7f2d000b5ad0 2024-08-18T22:22:37.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2d06400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2d000d1eb0 con 0x7f2d000d1090 2024-08-18T22:22:37.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2d06400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2d000d1bd0 con 0x7f2d0015fb80 2024-08-18T22:22:37.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2cffe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d000d1090 0x7f2d00071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2cf6a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2d000b5ad0 0x7f2d0006fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50458/0 (socket says 172.21.15.5:50458) 2024-08-18T22:22:37.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2cf6a00640 1 -- 172.21.15.5:0/913039562 learned_addr learned my addr 172.21.15.5:0/913039562 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:37.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2cff400640 1 --2- 172.21.15.5:0/913039562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0015fb80 0x7f2d000d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2cffe00640 1 -- 172.21.15.5:0/913039562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0015fb80 msgr2=0x7f2d000d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2cffe00640 1 --2- 172.21.15.5:0/913039562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0015fb80 0x7f2d000d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2cffe00640 1 -- 172.21.15.5:0/913039562 >> v1:172.21.15.5:6789/0 conn(0x7f2d000b5ad0 legacy=0x7f2d0006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2cffe00640 1 -- 172.21.15.5:0/913039562 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d000d2dd0 con 0x7f2d000d1090 2024-08-18T22:22:37.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2cff400640 1 --2- 172.21.15.5:0/913039562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0015fb80 0x7f2d000d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.639+0000 7f2cfea00640 1 -- 172.21.15.5:0/913039562 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164998686 0 0) 0x7f2d000d30b0 con 0x7f2d000b5ad0 2024-08-18T22:22:37.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2cffe00640 1 --2- 172.21.15.5:0/913039562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000d1090 0x7f2d00071550 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009d90 tx=0x7f2cf801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5b5e75dfc219fc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2cfea00640 1 -- 172.21.15.5:0/913039562 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80b2070 con 0x7f2d000d1090 2024-08-18T22:22:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2cfea00640 1 -- 172.21.15.5:0/913039562 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf80a5710 con 0x7f2d000d1090 2024-08-18T22:22:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2cfea00640 1 -- 172.21.15.5:0/913039562 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80a5ae0 con 0x7f2d000d1090 2024-08-18T22:22:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2d06400640 1 -- 172.21.15.5:0/913039562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000d1090 msgr2=0x7f2d00071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2d06400640 1 --2- 172.21.15.5:0/913039562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000d1090 0x7f2d00071550 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009d90 tx=0x7f2cf801c850 comp rx=0 tx=0).stop 2024-08-18T22:22:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2d06400640 1 -- 172.21.15.5:0/913039562 shutdown_connections 2024-08-18T22:22:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2d06400640 1 --2- 172.21.15.5:0/913039562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000d1090 0x7f2d00071550 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2d06400640 1 --2- 172.21.15.5:0/913039562 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0015fb80 0x7f2d000d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2d06400640 1 -- 172.21.15.5:0/913039562 >> 172.21.15.5:0/913039562 conn(0x7f2d000d2180 msgr2=0x7f2d000d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2d06400640 1 -- 172.21.15.5:0/913039562 shutdown_connections 2024-08-18T22:22:37.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.643+0000 7f2d06400640 1 -- 172.21.15.5:0/913039562 wait complete. 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2d06400640 1 Processor -- start 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2d06400640 1 -- start start 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2d06400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d000b5ad0 0x7f2d00152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2d06400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000d1090 0x7f2d0014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2d06400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0015fb80 0x7f2d000b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2d06400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d00169270 con 0x7f2d000d1090 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2d06400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2d001690f0 con 0x7f2d000b5ad0 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2d06400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2d001693f0 con 0x7f2d0015fb80 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000d1090 0x7f2d0014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000d1090 0x7f2d0014ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57822/0 (socket says 172.21.15.5:57822) 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf6a00640 1 -- 172.21.15.5:0/4103006685 learned_addr learned my addr 172.21.15.5:0/4103006685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cff400640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d000b5ad0 0x7f2d00152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cffe00640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0015fb80 0x7f2d000b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf6a00640 1 -- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0015fb80 msgr2=0x7f2d000b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0015fb80 0x7f2d000b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf6a00640 1 -- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d000b5ad0 msgr2=0x7f2d00152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d000b5ad0 0x7f2d00152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf6a00640 1 -- 172.21.15.5:0/4103006685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d000cdb20 con 0x7f2d000d1090 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000d1090 0x7f2d0014ee50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800c480 tx=0x7f2ce800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf7e00640 1 -- 172.21.15.5:0/4103006685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8018070 con 0x7f2d000d1090 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf7e00640 1 -- 172.21.15.5:0/4103006685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce80074e0 con 0x7f2d000d1090 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2cf7e00640 1 -- 172.21.15.5:0/4103006685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80049f0 con 0x7f2d000d1090 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2d06400640 1 -- 172.21.15.5:0/4103006685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d001515e0 con 0x7f2d000d1090 2024-08-18T22:22:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.647+0000 7f2d06400640 1 -- 172.21.15.5:0/4103006685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d000cde00 con 0x7f2d000d1090 2024-08-18T22:22:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2cf7e00640 1 -- 172.21.15.5:0/4103006685 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ce8004b90 con 0x7f2d000d1090 2024-08-18T22:22:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2cf7e00640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cdc0678c0 0x7f2cdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2cf7e00640 1 -- 172.21.15.5:0/4103006685 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f2ce80850d0 con 0x7f2d000d1090 2024-08-18T22:22:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2cff400640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cdc0678c0 0x7f2cdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2d09942000 1 Processor -- start 2024-08-18T22:22:37.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2d09942000 1 -- start start 2024-08-18T22:22:37.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2cff400640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cdc0678c0 0x7f2cdc069d80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2d000d0aa0 tx=0x7f2cf0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2d09942000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636e49020 0x55c636e49400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2d09942000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636dfc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2d09942000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636dfcc20 0x55c636dfd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2d09942000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c636c4d520 con 0x55c636e49940 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2d09942000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c636c07b80 con 0x55c636e49020 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.651+0000 7f2d09942000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c636c494e0 con 0x55c636dfcc20 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636dfc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636dfc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57826/0 (socket says 172.21.15.5:57826) 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 -- 172.21.15.5:0/2076406434 learned_addr learned my addr 172.21.15.5:0/2076406434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cffe00640 1 --2- 172.21.15.5:0/2076406434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636dfcc20 0x55c636dfd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cff400640 1 --2- 172.21.15.5:0/2076406434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636e49020 0x55c636e49400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 -- 172.21.15.5:0/2076406434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636dfcc20 msgr2=0x55c636dfd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/2076406434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636dfcc20 0x55c636dfd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 -- 172.21.15.5:0/2076406434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636e49020 msgr2=0x55c636e49400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/2076406434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636e49020 0x55c636e49400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 -- 172.21.15.5:0/2076406434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c636bedac0 con 0x55c636e49940 2024-08-18T22:22:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/2076406434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636dfc6e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8051880 tx=0x7f2ce80554e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf048278a614c52b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cefe00640 1 -- 172.21.15.5:0/2076406434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80534c0 con 0x55c636e49940 2024-08-18T22:22:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cefe00640 1 -- 172.21.15.5:0/2076406434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce8053720 con 0x55c636e49940 2024-08-18T22:22:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cefe00640 1 -- 172.21.15.5:0/2076406434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8054870 con 0x55c636e49940 2024-08-18T22:22:37.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 -- 172.21.15.5:0/2076406434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 msgr2=0x55c636dfc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 --2- 172.21.15.5:0/2076406434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636dfc6e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8051880 tx=0x7f2ce80554e0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 -- 172.21.15.5:0/2076406434 shutdown_connections 2024-08-18T22:22:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 --2- 172.21.15.5:0/2076406434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636dfcc20 0x55c636dfd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 --2- 172.21.15.5:0/2076406434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636dfc6e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 --2- 172.21.15.5:0/2076406434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636e49020 0x55c636e49400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 -- 172.21.15.5:0/2076406434 >> 172.21.15.5:0/2076406434 conn(0x55c636df6730 msgr2=0x55c636e2bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 -- 172.21.15.5:0/2076406434 shutdown_connections 2024-08-18T22:22:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 -- 172.21.15.5:0/2076406434 wait complete. 2024-08-18T22:22:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 -- start start 2024-08-18T22:22:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 Processor -- start 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636e034e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49020 0x55c636e03a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49940 0x55c636e03f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c636c18820 con 0x55c636e49020 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c636beed30 con 0x55c636dfcc20 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c636cce1e0 con 0x55c636e49940 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2d09942000 10 client.0 _ll_register_callbacks cb 0x55c636dea190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49020 0x55c636e03a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49020 0x55c636e03a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57842/0 (socket says 172.21.15.5:57842) 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cf6a00640 1 -- 172.21.15.5:0/2654998818 learned_addr learned my addr 172.21.15.5:0/2654998818 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.655+0000 7f2cffe00640 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49940 0x55c636e03f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cff400640 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636e034e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cf6a00640 1 -- 172.21.15.5:0/2654998818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49940 msgr2=0x55c636e03f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49940 0x55c636e03f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cf6a00640 1 -- 172.21.15.5:0/2654998818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 msgr2=0x55c636e034e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636e034e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cf6a00640 1 -- 172.21.15.5:0/2654998818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c636c06090 con 0x55c636e49020 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49020 0x55c636e03a20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800c450 tx=0x7f2ce8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e9e3a2c31945dc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cecc00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cecc00640 1 -- 172.21.15.5:0/2654998818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8080030 con 0x55c636e49020 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cecc00640 1 -- 172.21.15.5:0/2654998818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f2ce806d1e0 con 0x55c636e49020 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 -- 172.21.15.5:0/2654998818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce8053720 con 0x55c636e49020 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cecc00640 1 -- 172.21.15.5:0/2654998818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2ce8054870 con 0x55c636e49020 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 10 client.5955 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 -- 172.21.15.5:0/2654998818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55c636c19f80 con 0x55c636e49020 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cecc00640 1 -- 172.21.15.5:0/2654998818 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce8053720 con 0x55c636e49020 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cecc00640 1 -- 172.21.15.5:0/2654998818 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f2ce8054a10 con 0x55c636e49020 2024-08-18T22:22:37.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 10 client.5955 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 10 client.5955 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 20 client.5955 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55c636e04970 0x55c636e5b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 4 client.5955 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 -- 172.21.15.5:0/2654998818 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c636be7e40 con 0x55c636e04970 2024-08-18T22:22:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cff400640 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55c636e04970 0x55c636e5b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cff400640 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55c636e04970 0x55c636e5b0d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16d257a6bba82456 server_cookie=b96cd9e14cf82b13 in_seq=0 out_seq=0 2024-08-18T22:22:37.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cecc00640 10 client.5955 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cecc00640 1 -- 172.21.15.5:0/2654998818 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c636be7e40 con 0x55c636e04970 2024-08-18T22:22:37.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cecc00640 10 client.5955 handle_command_reply: tid=0 2024-08-18T22:22:37.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 client.5955 shutdown 2024-08-18T22:22:37.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 -- 172.21.15.5:0/2654998818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49020 msgr2=0x55c636e03a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49020 0x55c636e03a20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800c450 tx=0x7f2ce8000ee0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 -- 172.21.15.5:0/2654998818 shutdown_connections 2024-08-18T22:22:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55c636e04970 0x55c636e5b0d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49940 0x55c636e03f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49020 0x55c636e03a20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 --2- 172.21.15.5:0/2654998818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636e034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 -- 172.21.15.5:0/2654998818 >> 172.21.15.5:0/2654998818 conn(0x55c636df6730 msgr2=0x55c636e2bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2cecc00640 0 client.5955 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 -- 172.21.15.5:0/2654998818 shutdown_connections 2024-08-18T22:22:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 1 -- 172.21.15.5:0/2654998818 wait complete. 2024-08-18T22:22:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.659+0000 7f2d09942000 20 client.5955 trim_cache size 0 max 16384 2024-08-18T22:22:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2d09942000 1 Processor -- start 2024-08-18T22:22:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2d09942000 1 -- start start 2024-08-18T22:22:37.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2d09942000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636eb9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2d09942000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49020 0x55c636eb9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2d09942000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636eb9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2d09942000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d00203dd0 con 0x55c636e49940 2024-08-18T22:22:37.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2d09942000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2d00202e60 con 0x55c636dfcc20 2024-08-18T22:22:37.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2d09942000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2d00150f80 con 0x55c636e49020 2024-08-18T22:22:37.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636eb9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636eb9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57848/0 (socket says 172.21.15.5:57848) 2024-08-18T22:22:37.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cffe00640 1 -- 172.21.15.5:0/1986923860 learned_addr learned my addr 172.21.15.5:0/1986923860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cff400640 1 --2- 172.21.15.5:0/1986923860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636eb9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/1986923860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49020 0x55c636eb9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cffe00640 1 -- 172.21.15.5:0/1986923860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49020 msgr2=0x55c636eb9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cffe00640 1 --2- 172.21.15.5:0/1986923860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49020 0x55c636eb9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cffe00640 1 -- 172.21.15.5:0/1986923860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 msgr2=0x55c636eb9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cffe00640 1 --2- 172.21.15.5:0/1986923860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636eb9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cffe00640 1 -- 172.21.15.5:0/1986923860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c636e00d60 con 0x55c636e49940 2024-08-18T22:22:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/1986923860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49020 0x55c636eb9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cff400640 1 --2- 172.21.15.5:0/1986923860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636eb9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.679+0000 7f2cffe00640 1 --2- 172.21.15.5:0/1986923860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636eb9c90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2cf801c890 tx=0x7f2cf8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed94a09dbb65c70 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cef400640 1 -- 172.21.15.5:0/1986923860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80b2050 con 0x55c636e49940 2024-08-18T22:22:37.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cef400640 1 -- 172.21.15.5:0/1986923860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf80b3040 con 0x55c636e49940 2024-08-18T22:22:37.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cef400640 1 -- 172.21.15.5:0/1986923860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8004040 con 0x55c636e49940 2024-08-18T22:22:37.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 -- 172.21.15.5:0/1986923860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 msgr2=0x55c636eb9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 --2- 172.21.15.5:0/1986923860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636eb9c90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2cf801c890 tx=0x7f2cf8004ac0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 -- 172.21.15.5:0/1986923860 shutdown_connections 2024-08-18T22:22:37.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 --2- 172.21.15.5:0/1986923860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636eb9c90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 --2- 172.21.15.5:0/1986923860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49020 0x55c636eb9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 --2- 172.21.15.5:0/1986923860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636eb9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 -- 172.21.15.5:0/1986923860 >> 172.21.15.5:0/1986923860 conn(0x55c636df6730 msgr2=0x55c636dfb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 -- 172.21.15.5:0/1986923860 shutdown_connections 2024-08-18T22:22:37.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 -- 172.21.15.5:0/1986923860 wait complete. 2024-08-18T22:22:37.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 -- start start 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 Processor -- start 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636ebcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49020 0x55c636ebd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636ebda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c636bf4ac0 con 0x55c636e49940 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2d00202810 con 0x55c636dfcc20 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c636c4c830 con 0x55c636e49020 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 10 client.0 _ll_register_callbacks cb 0x7f2cf0009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636ebda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636ebda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57860/0 (socket says 172.21.15.5:57860) 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cffe00640 1 -- 172.21.15.5:0/3509573437 learned_addr learned my addr 172.21.15.5:0/3509573437 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cff400640 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636ebcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cf6a00640 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49020 0x55c636ebd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cffe00640 1 -- 172.21.15.5:0/3509573437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49020 msgr2=0x55c636ebd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cffe00640 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49020 0x55c636ebd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cffe00640 1 -- 172.21.15.5:0/3509573437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 msgr2=0x55c636ebcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cffe00640 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636ebcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cffe00640 1 -- 172.21.15.5:0/3509573437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c636cce670 con 0x55c636e49940 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cffe00640 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636ebda40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2cf801cd30 tx=0x7f2cf801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fd3d152f76b889 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cecc00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cecc00640 1 -- 172.21.15.5:0/3509573437 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80b2070 con 0x55c636e49940 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2cecc00640 1 -- 172.21.15.5:0/3509573437 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f2cf80a5780 con 0x55c636e49940 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.683+0000 7f2d09942000 1 -- 172.21.15.5:0/3509573437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cf80b3040 con 0x55c636e49940 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2cecc00640 1 -- 172.21.15.5:0/3509573437 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2cf80d3050 con 0x55c636e49940 2024-08-18T22:22:37.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 10 client.5961 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 -- 172.21.15.5:0/3509573437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55c636be0d00 con 0x55c636e49940 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2cecc00640 1 -- 172.21.15.5:0/3509573437 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf80b3040 con 0x55c636e49940 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2cecc00640 1 -- 172.21.15.5:0/3509573437 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f2cf80d6020 con 0x55c636e49940 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 10 client.5961 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 10 client.5961 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 20 client.5961 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55c636e788b0 0x55c636e78cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 4 client.5961 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 -- 172.21.15.5:0/3509573437 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x55c636c5ac50 con 0x55c636e788b0 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2cff400640 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55c636e788b0 0x55c636e78cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2cff400640 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55c636e788b0 0x55c636e78cc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17e559e5c54d08a6 server_cookie=6ed51cf7976ebff9 in_seq=0 out_seq=0 2024-08-18T22:22:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2cecc00640 10 client.5961 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2cecc00640 1 -- 172.21.15.5:0/3509573437 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c636c5ac50 con 0x55c636e788b0 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2cecc00640 10 client.5961 handle_command_reply: tid=0 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 client.5961 shutdown 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 -- 172.21.15.5:0/3509573437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 msgr2=0x55c636ebda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636ebda40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2cf801cd30 tx=0x7f2cf801b090 comp rx=0 tx=0).stop 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 -- 172.21.15.5:0/3509573437 shutdown_connections 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55c636e788b0 0x55c636e78cc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c636e49940 0x55c636ebda40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c636e49020 0x55c636ebd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 --2- 172.21.15.5:0/3509573437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c636dfcc20 0x55c636ebcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2cecc00640 0 client.5961 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 -- 172.21.15.5:0/3509573437 >> 172.21.15.5:0/3509573437 conn(0x55c636df6730 msgr2=0x55c636e563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 -- 172.21.15.5:0/3509573437 shutdown_connections 2024-08-18T22:22:37.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 1 -- 172.21.15.5:0/3509573437 wait complete. 2024-08-18T22:22:37.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d09942000 20 client.5961 trim_cache size 0 max 16384 2024-08-18T22:22:37.697 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:22:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "2abdf81f-e49e-4c07-90b5-dc03abb04a45", 2024-08-18T22:22:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:22:37.697 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:37.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 -- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cdc0678c0 msgr2=0x7f2cdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cdc0678c0 0x7f2cdc069d80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2d000d0aa0 tx=0x7f2cf0008040 comp rx=0 tx=0).stop 2024-08-18T22:22:37.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 -- 172.21.15.5:0/4103006685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000d1090 msgr2=0x7f2d0014ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000d1090 0x7f2d0014ee50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800c480 tx=0x7f2ce800c940 comp rx=0 tx=0).stop 2024-08-18T22:22:37.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 -- 172.21.15.5:0/4103006685 shutdown_connections 2024-08-18T22:22:37.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2cdc0678c0 0x7f2cdc069d80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0015fb80 0x7f2d000b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000d1090 0x7f2d0014ee50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 --2- 172.21.15.5:0/4103006685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d000b5ad0 0x7f2d00152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 -- 172.21.15.5:0/4103006685 >> 172.21.15.5:0/4103006685 conn(0x7f2d000d2180 msgr2=0x7f2d0015e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 -- 172.21.15.5:0/4103006685 shutdown_connections 2024-08-18T22:22:37.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.687+0000 7f2d06400640 1 -- 172.21.15.5:0/4103006685 wait complete. 2024-08-18T22:22:37.712 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '2abdf81f-e49e-4c07-90b5-dc03abb04a45', 'mode': 'asynchronous'}' 2024-08-18T22:22:37.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:37.712 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-08-18T22:22:37.723 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-08-18T22:22:37.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-08-18T22:22:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa807a00640 1 Processor -- start 2024-08-18T22:22:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa807a00640 1 -- start start 2024-08-18T22:22:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa807a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa80015b0c0 0x7fa80006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa807a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8000b40c0 0x7fa8000b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa807a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8000b31f0 con 0x7fa800072a30 2024-08-18T22:22:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa807a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa8000b3d70 con 0x7fa80015b0c0 2024-08-18T22:22:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa807a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa8000b4a40 con 0x7fa8000b40c0 2024-08-18T22:22:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa805000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa80015b0c0 0x7fa80006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa805000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa80015b0c0 0x7fa80006db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57866/0 (socket says 172.21.15.5:57866) 2024-08-18T22:22:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa805000640 1 -- 172.21.15.5:0/1237175807 learned_addr learned my addr 172.21.15.5:0/1237175807 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/1237175807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8000b40c0 0x7fa8000b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa805000640 1 -- 172.21.15.5:0/1237175807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8000b40c0 msgr2=0x7fa8000b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa805000640 1 --2- 172.21.15.5:0/1237175807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8000b40c0 0x7fa8000b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa805000640 1 -- 172.21.15.5:0/1237175807 >> v1:172.21.15.5:6789/0 conn(0x7fa800072a30 legacy=0x7fa800072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.907+0000 7fa805000640 1 -- 172.21.15.5:0/1237175807 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8000b34d0 con 0x7fa80015b0c0 2024-08-18T22:22:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa805000640 1 --2- 172.21.15.5:0/1237175807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa80015b0c0 0x7fa80006db80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009870 tx=0x7fa7f401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a13b600bfd692b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa7ff400640 1 -- 172.21.15.5:0/1237175807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40ab610 con 0x7fa80015b0c0 2024-08-18T22:22:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa7ff400640 1 -- 172.21.15.5:0/1237175807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f40b0070 con 0x7fa80015b0c0 2024-08-18T22:22:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa7ff400640 1 -- 172.21.15.5:0/1237175807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40ab9d0 con 0x7fa80015b0c0 2024-08-18T22:22:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa807a00640 1 -- 172.21.15.5:0/1237175807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa80015b0c0 msgr2=0x7fa80006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa807a00640 1 --2- 172.21.15.5:0/1237175807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa80015b0c0 0x7fa80006db80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009870 tx=0x7fa7f401c410 comp rx=0 tx=0).stop 2024-08-18T22:22:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa807a00640 1 -- 172.21.15.5:0/1237175807 shutdown_connections 2024-08-18T22:22:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa807a00640 1 --2- 172.21.15.5:0/1237175807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8000b40c0 0x7fa8000b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa807a00640 1 --2- 172.21.15.5:0/1237175807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa80015b0c0 0x7fa80006db80 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa807a00640 1 -- 172.21.15.5:0/1237175807 >> 172.21.15.5:0/1237175807 conn(0x7fa8000b1dc0 msgr2=0x7fa8000b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa807a00640 1 -- 172.21.15.5:0/1237175807 shutdown_connections 2024-08-18T22:22:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa807a00640 1 -- 172.21.15.5:0/1237175807 wait complete. 2024-08-18T22:22:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.911+0000 7fa807a00640 1 Processor -- start 2024-08-18T22:22:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa807a00640 1 -- start start 2024-08-18T22:22:37.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa807a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa800072a30 0x7fa800145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa807a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8000b40c0 0x7fa80014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa807a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa80015b0c0 0x7fa80015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa807a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa80015b4a0 con 0x7fa8000b40c0 2024-08-18T22:22:37.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa807a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa8000739a0 con 0x7fa80015b0c0 2024-08-18T22:22:37.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa807a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa80015b620 con 0x7fa800072a30 2024-08-18T22:22:37.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8000b40c0 0x7fa80014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8000b40c0 0x7fa80014d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57874/0 (socket says 172.21.15.5:57874) 2024-08-18T22:22:37.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7ffe00640 1 -- 172.21.15.5:0/3659488280 learned_addr learned my addr 172.21.15.5:0/3659488280 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa805000640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa800072a30 0x7fa800145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa805a00640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa80015b0c0 0x7fa80015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7ffe00640 1 -- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa800072a30 msgr2=0x7fa800145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa800072a30 0x7fa800145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7ffe00640 1 -- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa80015b0c0 msgr2=0x7fa80015ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa80015b0c0 0x7fa80015ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7ffe00640 1 -- 172.21.15.5:0/3659488280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8000b4500 con 0x7fa8000b40c0 2024-08-18T22:22:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8000b40c0 0x7fa80014d6a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00d800 tx=0x7fa7ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7fcc00640 1 -- 172.21.15.5:0/3659488280 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec00b6c0 con 0x7fa8000b40c0 2024-08-18T22:22:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7fcc00640 1 -- 172.21.15.5:0/3659488280 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec019070 con 0x7fa8000b40c0 2024-08-18T22:22:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa7fcc00640 1 -- 172.21.15.5:0/3659488280 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec00ba60 con 0x7fa8000b40c0 2024-08-18T22:22:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa807a00640 1 -- 172.21.15.5:0/3659488280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80014dfd0 con 0x7fa8000b40c0 2024-08-18T22:22:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.915+0000 7fa807a00640 1 -- 172.21.15.5:0/3659488280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80014e590 con 0x7fa8000b40c0 2024-08-18T22:22:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7fcc00640 1 -- 172.21.15.5:0/3659488280 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7ec00bc00 con 0x7fa8000b40c0 2024-08-18T22:22:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7fcc00640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7e00678c0 0x7fa7e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7fcc00640 1 -- 172.21.15.5:0/3659488280 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fa7ec086240 con 0x7fa8000b40c0 2024-08-18T22:22:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa805000640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7e00678c0 0x7fa7e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa80ae1b000 1 Processor -- start 2024-08-18T22:22:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa80ae1b000 1 -- start start 2024-08-18T22:22:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa805000640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7e00678c0 0x7fa7e0069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40af000 tx=0x7fa7f40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e57cbe0 0x562b2e57cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5300d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e530610 0x562b2e5309f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562b2e380280 con 0x562b2e57d500 2024-08-18T22:22:37.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562b2e31c3a0 con 0x562b2e57cbe0 2024-08-18T22:22:37.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562b2e37c240 con 0x562b2e530610 2024-08-18T22:22:37.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5300d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57890/0 (socket says 172.21.15.5:57890) 2024-08-18T22:22:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7ffe00640 1 -- 172.21.15.5:0/3380430554 learned_addr learned my addr 172.21.15.5:0/3380430554 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa805000640 1 --2- 172.21.15.5:0/3380430554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e57cbe0 0x562b2e57cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa805a00640 1 --2- 172.21.15.5:0/3380430554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e530610 0x562b2e5309f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7ffe00640 1 -- 172.21.15.5:0/3380430554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e530610 msgr2=0x562b2e5309f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/3380430554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e530610 0x562b2e5309f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7ffe00640 1 -- 172.21.15.5:0/3380430554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e57cbe0 msgr2=0x562b2e57cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/3380430554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e57cbe0 0x562b2e57cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7ffe00640 1 -- 172.21.15.5:0/3380430554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2e31c5f0 con 0x562b2e57d500 2024-08-18T22:22:37.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.919+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/3380430554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5300d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec056200 tx=0x7fa7ec056500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5e0c056757f33 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa7f1600640 1 -- 172.21.15.5:0/3380430554 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec05f030 con 0x562b2e57d500 2024-08-18T22:22:37.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa7f1600640 1 -- 172.21.15.5:0/3380430554 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec054800 con 0x562b2e57d500 2024-08-18T22:22:37.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa7f1600640 1 -- 172.21.15.5:0/3380430554 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec06e1c0 con 0x562b2e57d500 2024-08-18T22:22:37.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 -- 172.21.15.5:0/3380430554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 msgr2=0x562b2e5300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/3380430554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5300d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec056200 tx=0x7fa7ec056500 comp rx=0 tx=0).stop 2024-08-18T22:22:37.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 -- 172.21.15.5:0/3380430554 shutdown_connections 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/3380430554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e530610 0x562b2e5309f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/3380430554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5300d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/3380430554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e57cbe0 0x562b2e57cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 -- 172.21.15.5:0/3380430554 >> 172.21.15.5:0/3380430554 conn(0x562b2e55da90 msgr2=0x562b2e55fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 -- 172.21.15.5:0/3380430554 shutdown_connections 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 -- 172.21.15.5:0/3380430554 wait complete. 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 -- start start 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 Processor -- start 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e530610 0x562b2e583b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e57cbe0 0x562b2e584090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5845d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562b2e344f10 con 0x562b2e57d500 2024-08-18T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562b2e322600 con 0x562b2e57cbe0 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562b2e37f590 con 0x562b2e530610 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa80ae1b000 10 client.0 _ll_register_callbacks cb 0x562b2e4342d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa805a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5845d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa805a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5845d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57898/0 (socket says 172.21.15.5:57898) 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa805a00640 1 -- 172.21.15.5:0/4104955516 learned_addr learned my addr 172.21.15.5:0/4104955516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa805000640 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e530610 0x562b2e583b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e57cbe0 0x562b2e584090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa805a00640 1 -- 172.21.15.5:0/4104955516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e530610 msgr2=0x562b2e583b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa805a00640 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e530610 0x562b2e583b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa805a00640 1 -- 172.21.15.5:0/4104955516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e57cbe0 msgr2=0x562b2e584090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa805a00640 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e57cbe0 0x562b2e584090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa805a00640 1 -- 172.21.15.5:0/4104955516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2e34ced0 con 0x562b2e57d500 2024-08-18T22:22:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa805a00640 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5845d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80126b0 tx=0x7fa7f8012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134191099e2c1ea6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.923+0000 7fa7e6000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa7e6000640 1 -- 172.21.15.5:0/4104955516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8019020 con 0x562b2e57d500 2024-08-18T22:22:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa7e6000640 1 -- 172.21.15.5:0/4104955516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fa7f8003980 con 0x562b2e57d500 2024-08-18T22:22:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 -- 172.21.15.5:0/4104955516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7ec054800 con 0x562b2e57d500 2024-08-18T22:22:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa7e6000640 1 -- 172.21.15.5:0/4104955516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa7f8023050 con 0x562b2e57d500 2024-08-18T22:22:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 10 client.5976 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 -- 172.21.15.5:0/4104955516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x562b2e38b4c0 con 0x562b2e57d500 2024-08-18T22:22:37.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa7e6000640 1 -- 172.21.15.5:0/4104955516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec054800 con 0x562b2e57d500 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa7e6000640 1 -- 172.21.15.5:0/4104955516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fa7f8026020 con 0x562b2e57d500 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 10 client.5976 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 10 client.5976 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 20 client.5976 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562b2e58bf20 0x562b2e58e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 4 client.5976 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 -- 172.21.15.5:0/4104955516 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b2e31b1e0 con 0x562b2e58bf20 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa805000640 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562b2e58bf20 0x562b2e58e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa805000640 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562b2e58bf20 0x562b2e58e310 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b0a142bf93ec34b server_cookie=2c9267fecd89fc15 in_seq=0 out_seq=0 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa7e6000640 10 client.5976 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa7e6000640 1 -- 172.21.15.5:0/4104955516 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b2e31b1e0 con 0x562b2e58bf20 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa7e6000640 10 client.5976 handle_command_reply: tid=0 2024-08-18T22:22:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 client.5976 shutdown 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 -- 172.21.15.5:0/4104955516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 msgr2=0x562b2e5845d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5845d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80126b0 tx=0x7fa7f8012b70 comp rx=0 tx=0).stop 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 -- 172.21.15.5:0/4104955516 shutdown_connections 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562b2e58bf20 0x562b2e58e310 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e57d500 0x562b2e5845d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e57cbe0 0x562b2e584090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/4104955516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e530610 0x562b2e583b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa7e6000640 0 client.5976 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 -- 172.21.15.5:0/4104955516 >> 172.21.15.5:0/4104955516 conn(0x562b2e55da90 msgr2=0x562b2e52f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 -- 172.21.15.5:0/4104955516 shutdown_connections 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 1 -- 172.21.15.5:0/4104955516 wait complete. 2024-08-18T22:22:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.927+0000 7fa80ae1b000 20 client.5976 trim_cache size 0 max 16384 2024-08-18T22:22:37.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa80ae1b000 1 Processor -- start 2024-08-18T22:22:37.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa80ae1b000 1 -- start start 2024-08-18T22:22:37.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e55da90 0x562b2e591970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e530610 0x562b2e52efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e57cbe0 0x562b2e52f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa8001ffe80 con 0x562b2e55da90 2024-08-18T22:22:37.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa8001feec0 con 0x562b2e530610 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa8000ae0a0 con 0x562b2e57cbe0 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa805000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e55da90 0x562b2e591970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa805000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e55da90 0x562b2e591970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57900/0 (socket says 172.21.15.5:57900) 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa805000640 1 -- 172.21.15.5:0/2665107930 learned_addr learned my addr 172.21.15.5:0/2665107930 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/2665107930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e530610 0x562b2e52efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa805a00640 1 --2- 172.21.15.5:0/2665107930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e57cbe0 0x562b2e52f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa805000640 1 -- 172.21.15.5:0/2665107930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e57cbe0 msgr2=0x562b2e52f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa805000640 1 --2- 172.21.15.5:0/2665107930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e57cbe0 0x562b2e52f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa805000640 1 -- 172.21.15.5:0/2665107930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e530610 msgr2=0x562b2e52efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa805000640 1 --2- 172.21.15.5:0/2665107930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e530610 0x562b2e52efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa805000640 1 -- 172.21.15.5:0/2665107930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2e403160 con 0x562b2e55da90 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.943+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/2665107930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e530610 0x562b2e52efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa805000640 1 --2- 172.21.15.5:0/2665107930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e55da90 0x562b2e591970 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40ad040 tx=0x7fa7f4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db73644d7bb2187e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa7f0c00640 1 -- 172.21.15.5:0/2665107930 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4003bf0 con 0x562b2e55da90 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa7f0c00640 1 -- 172.21.15.5:0/2665107930 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f40b0040 con 0x562b2e55da90 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa7f0c00640 1 -- 172.21.15.5:0/2665107930 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40ab510 con 0x562b2e55da90 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 -- 172.21.15.5:0/2665107930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e55da90 msgr2=0x562b2e591970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/2665107930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e55da90 0x562b2e591970 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40ad040 tx=0x7fa7f4004740 comp rx=0 tx=0).stop 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 -- 172.21.15.5:0/2665107930 shutdown_connections 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/2665107930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e57cbe0 0x562b2e52f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/2665107930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e530610 0x562b2e52efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/2665107930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e55da90 0x562b2e591970 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 -- 172.21.15.5:0/2665107930 >> 172.21.15.5:0/2665107930 conn(0x562b2e57c3c0 msgr2=0x562b2e52e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 -- 172.21.15.5:0/2665107930 shutdown_connections 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 -- 172.21.15.5:0/2665107930 wait complete. 2024-08-18T22:22:37.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 -- start start 2024-08-18T22:22:37.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 Processor -- start 2024-08-18T22:22:37.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e530610 0x562b2e5f5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e55da90 0x562b2e5f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e57cbe0 0x562b2e5f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562b2e344f10 con 0x562b2e530610 2024-08-18T22:22:37.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa8000ae6f0 con 0x562b2e55da90 2024-08-18T22:22:37.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562b2e53b810 con 0x562b2e57cbe0 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa80ae1b000 10 client.0 _ll_register_callbacks cb 0x7fa7f8001a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa805000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e530610 0x562b2e5f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa805000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e530610 0x562b2e5f5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57902/0 (socket says 172.21.15.5:57902) 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa805000640 1 -- 172.21.15.5:0/1762073731 learned_addr learned my addr 172.21.15.5:0/1762073731 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e55da90 0x562b2e5f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa805a00640 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e57cbe0 0x562b2e5f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa805000640 1 -- 172.21.15.5:0/1762073731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e57cbe0 msgr2=0x562b2e5f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa805000640 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e57cbe0 0x562b2e5f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa805000640 1 -- 172.21.15.5:0/1762073731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e55da90 msgr2=0x562b2e5f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa805000640 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e55da90 0x562b2e5f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa805000640 1 -- 172.21.15.5:0/1762073731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2e3d99c0 con 0x562b2e530610 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e55da90 0x562b2e5f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa805000640 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e530610 0x562b2e5f5260 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa7f401a040 tx=0x7fa7f401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5909fe61da131d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.947+0000 7fa7e6000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa7e6000640 1 -- 172.21.15.5:0/1762073731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4003e30 con 0x562b2e530610 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa7e6000640 1 -- 172.21.15.5:0/1762073731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fa7f40ab510 con 0x562b2e530610 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa80ae1b000 1 -- 172.21.15.5:0/1762073731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7f40b0040 con 0x562b2e530610 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa7e6000640 1 -- 172.21.15.5:0/1762073731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa7f40eb050 con 0x562b2e530610 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa80ae1b000 10 client.5982 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa80ae1b000 1 -- 172.21.15.5:0/1762073731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x562b2e3269a0 con 0x562b2e530610 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa7e6000640 1 -- 172.21.15.5:0/1762073731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f40b0040 con 0x562b2e530610 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa7e6000640 1 -- 172.21.15.5:0/1762073731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fa7f40ee020 con 0x562b2e530610 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa80ae1b000 10 client.5982 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa80ae1b000 10 client.5982 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa80ae1b000 20 client.5982 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562b2e57d500 0x562b2e58fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa80ae1b000 4 client.5982 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}] 2024-08-18T22:22:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa80ae1b000 1 -- 172.21.15.5:0/1762073731 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}) -- 0x562b2e535190 con 0x562b2e57d500 2024-08-18T22:22:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562b2e57d500 0x562b2e58fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa7ffe00640 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562b2e57d500 0x562b2e58fc10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa2f4434e1939214 server_cookie=6f4c15111ac78452 in_seq=0 out_seq=0 2024-08-18T22:22:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.951+0000 7fa7e6000640 10 client.5982 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa7e6000640 1 -- 172.21.15.5:0/1762073731 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b2e535190 con 0x562b2e57d500 2024-08-18T22:22:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa7e6000640 10 client.5982 handle_command_reply: tid=0 2024-08-18T22:22:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 1 client.5982 shutdown 2024-08-18T22:22:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 1 -- 172.21.15.5:0/1762073731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e530610 msgr2=0x562b2e5f5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e530610 0x562b2e5f5260 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa7f401a040 tx=0x7fa7f401ac50 comp rx=0 tx=0).stop 2024-08-18T22:22:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 1 -- 172.21.15.5:0/1762073731 shutdown_connections 2024-08-18T22:22:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x562b2e57d500 0x562b2e58fc10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562b2e57cbe0 0x562b2e5f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562b2e55da90 0x562b2e5f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa7e6000640 0 client.5982 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 1 --2- 172.21.15.5:0/1762073731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562b2e530610 0x562b2e5f5260 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 1 -- 172.21.15.5:0/1762073731 >> 172.21.15.5:0/1762073731 conn(0x562b2e57c3c0 msgr2=0x562b2e52f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 1 -- 172.21.15.5:0/1762073731 shutdown_connections 2024-08-18T22:22:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 1 -- 172.21.15.5:0/1762073731 wait complete. 2024-08-18T22:22:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa80ae1b000 20 client.5982 trim_cache size 0 max 16384 2024-08-18T22:22:37.961 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:37.961 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:22:37.961 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:22:37.961 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 -- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7e00678c0 msgr2=0x7fa7e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7e00678c0 0x7fa7e0069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40af000 tx=0x7fa7f40a7000 comp rx=0 tx=0).stop 2024-08-18T22:22:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 -- 172.21.15.5:0/3659488280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8000b40c0 msgr2=0x7fa80014d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8000b40c0 0x7fa80014d6a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00d800 tx=0x7fa7ec00dcc0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 -- 172.21.15.5:0/3659488280 shutdown_connections 2024-08-18T22:22:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7e00678c0 0x7fa7e0069d80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa80015b0c0 0x7fa80015ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8000b40c0 0x7fa80014d6a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 --2- 172.21.15.5:0/3659488280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa800072a30 0x7fa800145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 -- 172.21.15.5:0/3659488280 >> 172.21.15.5:0/3659488280 conn(0x7fa8000b1dc0 msgr2=0x7fa8000b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 -- 172.21.15.5:0/3659488280 shutdown_connections 2024-08-18T22:22:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:37.955+0000 7fa807a00640 1 -- 172.21.15.5:0/3659488280 wait complete. 2024-08-18T22:22:37.979 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' returned '{'message': '', 'return_code': 0}' 2024-08-18T22:22:37.979 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:22:37.979 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:37.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:37.988 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-08-18T22:22:38.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:22:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:22:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202209 s, 51.9 MB/s 2024-08-18T22:22:38.059 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-08-18T22:22:38.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-08-18T22:22:38.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f4860600640 1 Processor -- start 2024-08-18T22:22:38.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f4860600640 1 -- start start 2024-08-18T22:22:38.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f4860600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f485815b0c0 0x7f485806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f4860600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48580b40c0 0x7f48580b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f4860600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48580b31f0 con 0x7f4858072a30 2024-08-18T22:22:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f4860600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f48580b3d70 con 0x7f485815b0c0 2024-08-18T22:22:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f4860600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f48580b4a40 con 0x7f48580b40c0 2024-08-18T22:22:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f485dc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f485815b0c0 0x7f485806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f485dc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f485815b0c0 0x7f485806db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57914/0 (socket says 172.21.15.5:57914) 2024-08-18T22:22:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f485dc00640 1 -- 172.21.15.5:0/2029500050 learned_addr learned my addr 172.21.15.5:0/2029500050 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f485d200640 1 --2- 172.21.15.5:0/2029500050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48580b40c0 0x7f48580b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f485dc00640 1 -- 172.21.15.5:0/2029500050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48580b40c0 msgr2=0x7f48580b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f485dc00640 1 --2- 172.21.15.5:0/2029500050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48580b40c0 0x7f48580b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f485dc00640 1 -- 172.21.15.5:0/2029500050 >> v1:172.21.15.117:6789/0 conn(0x7f4858072a30 legacy=0x7f4858072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f485dc00640 1 -- 172.21.15.5:0/2029500050 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48580b34d0 con 0x7f485815b0c0 2024-08-18T22:22:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.243+0000 7f485d200640 1 --2- 172.21.15.5:0/2029500050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48580b40c0 0x7f48580b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.247+0000 7f485dc00640 1 --2- 172.21.15.5:0/2029500050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485815b0c0 0x7f485806db80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f484c00bb10 tx=0x7f484c01eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5269c6fbf62679 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.247+0000 7f4857e00640 1 -- 172.21.15.5:0/2029500050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c0b4070 con 0x7f485815b0c0 2024-08-18T22:22:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.247+0000 7f4857e00640 1 -- 172.21.15.5:0/2029500050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484c0a7a30 con 0x7f485815b0c0 2024-08-18T22:22:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.247+0000 7f4857e00640 1 -- 172.21.15.5:0/2029500050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c0a7e00 con 0x7f485815b0c0 2024-08-18T22:22:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.247+0000 7f4860600640 1 -- 172.21.15.5:0/2029500050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485815b0c0 msgr2=0x7f485806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.247+0000 7f4860600640 1 --2- 172.21.15.5:0/2029500050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485815b0c0 0x7f485806db80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f484c00bb10 tx=0x7f484c01eaa0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 -- 172.21.15.5:0/2029500050 shutdown_connections 2024-08-18T22:22:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 --2- 172.21.15.5:0/2029500050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48580b40c0 0x7f48580b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 --2- 172.21.15.5:0/2029500050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485815b0c0 0x7f485806db80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 -- 172.21.15.5:0/2029500050 >> 172.21.15.5:0/2029500050 conn(0x7f48580b1dc0 msgr2=0x7f48580b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 -- 172.21.15.5:0/2029500050 shutdown_connections 2024-08-18T22:22:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 -- 172.21.15.5:0/2029500050 wait complete. 2024-08-18T22:22:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 Processor -- start 2024-08-18T22:22:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 -- start start 2024-08-18T22:22:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4858072a30 0x7f48581fa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48580b40c0 0x7f48581f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f485815b0c0 0x7f48580ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f485815b4a0 con 0x7f4858072a30 2024-08-18T22:22:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48580739a0 con 0x7f48580b40c0 2024-08-18T22:22:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4860600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f485815b620 con 0x7f485815b0c0 2024-08-18T22:22:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4858072a30 0x7f48581fa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4858072a30 0x7f48581fa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57922/0 (socket says 172.21.15.5:57922) 2024-08-18T22:22:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485dc00640 1 -- 172.21.15.5:0/1377512225 learned_addr learned my addr 172.21.15.5:0/1377512225 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485d200640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48580b40c0 0x7f48581f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485e600640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f485815b0c0 0x7f48580ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485dc00640 1 -- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f485815b0c0 msgr2=0x7f48580ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485dc00640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f485815b0c0 0x7f48580ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485dc00640 1 -- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48580b40c0 msgr2=0x7f48581f76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485dc00640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48580b40c0 0x7f48581f76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485dc00640 1 -- 172.21.15.5:0/1377512225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48581f81a0 con 0x7f4858072a30 2024-08-18T22:22:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485e600640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f485815b0c0 0x7f48580ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f485dc00640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4858072a30 0x7f48581fa6c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f484c00b2c0 tx=0x7f484c01b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4855600640 1 -- 172.21.15.5:0/1377512225 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c0b4070 con 0x7f4858072a30 2024-08-18T22:22:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.251+0000 7f4855600640 1 -- 172.21.15.5:0/1377512225 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484c0b6070 con 0x7f4858072a30 2024-08-18T22:22:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.255+0000 7f4855600640 1 -- 172.21.15.5:0/1377512225 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c0afe60 con 0x7f4858072a30 2024-08-18T22:22:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.255+0000 7f4860600640 1 -- 172.21.15.5:0/1377512225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48581f8480 con 0x7f4858072a30 2024-08-18T22:22:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.255+0000 7f4860600640 1 -- 172.21.15.5:0/1377512225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485815cbb0 con 0x7f4858072a30 2024-08-18T22:22:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.255+0000 7f4855600640 1 -- 172.21.15.5:0/1377512225 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f484c0c33a0 con 0x7f4858072a30 2024-08-18T22:22:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.255+0000 7f4855600640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48380678c0 0x7f4838069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.255+0000 7f4855600640 1 -- 172.21.15.5:0/1377512225 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f484c11ff50 con 0x7f4858072a30 2024-08-18T22:22:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.255+0000 7f485d200640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48380678c0 0x7f4838069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.255+0000 7f4863adf000 1 Processor -- start 2024-08-18T22:22:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.255+0000 7f4863adf000 1 -- start start 2024-08-18T22:22:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485d200640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48380678c0 0x7f4838069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4858157d60 tx=0x7f4844008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 0x5623cb0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0ce500 0x5623cb0810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb081610 0x5623cb0819f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5623caed1280 con 0x5623cb0ce500 2024-08-18T22:22:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5623cae6d3a0 con 0x5623cb081610 2024-08-18T22:22:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5623caecd240 con 0x5623cb0cdbe0 2024-08-18T22:22:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0ce500 0x5623cb0810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 0x5623cb0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0ce500 0x5623cb0810d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57926/0 (socket says 172.21.15.5:57926) 2024-08-18T22:22:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485d200640 1 -- 172.21.15.5:0/270029774 learned_addr learned my addr 172.21.15.5:0/270029774 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485e600640 1 --2- 172.21.15.5:0/270029774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb081610 0x5623cb0819f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485d200640 1 -- 172.21.15.5:0/270029774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 msgr2=0x5623cb0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485d200640 1 --2- 172.21.15.5:0/270029774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 0x5623cb0cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485d200640 1 -- 172.21.15.5:0/270029774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb081610 msgr2=0x5623cb0819f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485d200640 1 --2- 172.21.15.5:0/270029774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb081610 0x5623cb0819f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485d200640 1 -- 172.21.15.5:0/270029774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623cae6d5f0 con 0x5623cb0ce500 2024-08-18T22:22:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485dc00640 1 --2- 172.21.15.5:0/270029774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 0x5623cb0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f485d200640 1 --2- 172.21.15.5:0/270029774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0ce500 0x5623cb0810d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f484400f9c0 tx=0x7f4844012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90d22805676d7b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f484a000640 1 -- 172.21.15.5:0/270029774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484401b050 con 0x5623cb0ce500 2024-08-18T22:22:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f484a000640 1 -- 172.21.15.5:0/270029774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4844025070 con 0x5623cb0ce500 2024-08-18T22:22:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f484a000640 1 -- 172.21.15.5:0/270029774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844014e20 con 0x5623cb0ce500 2024-08-18T22:22:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 -- 172.21.15.5:0/270029774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0ce500 msgr2=0x5623cb0810d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 --2- 172.21.15.5:0/270029774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0ce500 0x5623cb0810d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f484400f9c0 tx=0x7f4844012000 comp rx=0 tx=0).stop 2024-08-18T22:22:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 -- 172.21.15.5:0/270029774 shutdown_connections 2024-08-18T22:22:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 --2- 172.21.15.5:0/270029774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb081610 0x5623cb0819f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 --2- 172.21.15.5:0/270029774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0ce500 0x5623cb0810d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 --2- 172.21.15.5:0/270029774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 0x5623cb0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 -- 172.21.15.5:0/270029774 >> 172.21.15.5:0/270029774 conn(0x5623cb0aea90 msgr2=0x5623cb0b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 -- 172.21.15.5:0/270029774 shutdown_connections 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 -- 172.21.15.5:0/270029774 wait complete. 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 -- start start 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.259+0000 7f4863adf000 1 Processor -- start 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb081610 0x5623cb0d4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 0x5623cb0d5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0d55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5623cae95f10 con 0x5623cb081610 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5623cae73600 con 0x5623cb0ce500 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5623caed0590 con 0x5623cb0cdbe0 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 10 client.0 _ll_register_callbacks cb 0x5623caf852d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb081610 0x5623cb0d4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb081610 0x5623cb0d4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57928/0 (socket says 172.21.15.5:57928) 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485dc00640 1 -- 172.21.15.5:0/1877569359 learned_addr learned my addr 172.21.15.5:0/1877569359 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485d200640 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 0x5623cb0d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485e600640 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0d55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485dc00640 1 -- 172.21.15.5:0/1877569359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 msgr2=0x5623cb0d5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485dc00640 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 0x5623cb0d5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485dc00640 1 -- 172.21.15.5:0/1877569359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 msgr2=0x5623cb0d55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485dc00640 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0d55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485dc00640 1 -- 172.21.15.5:0/1877569359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623cae9ded0 con 0x5623cb081610 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485d200640 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 0x5623cb0d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485e600640 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0d55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485dc00640 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb081610 0x5623cb0d4b50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f484c01f340 tx=0x7f484c0f0860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74db2f0f70724917 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f483ea00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f483ea00640 1 -- 172.21.15.5:0/1877569359 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c0bf040 con 0x5623cb081610 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f483ea00640 1 -- 172.21.15.5:0/1877569359 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f484c0f4120 con 0x5623cb081610 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 1 -- 172.21.15.5:0/1877569359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4844025070 con 0x5623cb081610 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f483ea00640 1 -- 172.21.15.5:0/1877569359 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f484c0f8d40 con 0x5623cb081610 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 10 client.5994 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 1 -- 172.21.15.5:0/1877569359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5623caedc4c0 con 0x5623cb081610 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f483ea00640 1 -- 172.21.15.5:0/1877569359 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4844025070 con 0x5623cb081610 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f483ea00640 1 -- 172.21.15.5:0/1877569359 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f484c00e040 con 0x5623cb081610 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 10 client.5994 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 10 client.5994 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 20 client.5994 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:38.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5623cb0dcf20 0x5623cb0df310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 4 client.5994 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:38.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f4863adf000 1 -- 172.21.15.5:0/1877569359 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623cae6c1e0 con 0x5623cb0dcf20 2024-08-18T22:22:38.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485d200640 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5623cb0dcf20 0x5623cb0df310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f485d200640 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5623cb0dcf20 0x5623cb0df310 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2450f8e66ec68eae server_cookie=eab03c6085da9843 in_seq=0 out_seq=0 2024-08-18T22:22:38.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.263+0000 7f483ea00640 10 client.5994 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f483ea00640 1 -- 172.21.15.5:0/1877569359 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623cae6c1e0 con 0x5623cb0dcf20 2024-08-18T22:22:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f483ea00640 10 client.5994 handle_command_reply: tid=0 2024-08-18T22:22:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 1 client.5994 shutdown 2024-08-18T22:22:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 1 -- 172.21.15.5:0/1877569359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb081610 msgr2=0x5623cb0d4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb081610 0x5623cb0d4b50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f484c01f340 tx=0x7f484c0f0860 comp rx=0 tx=0).stop 2024-08-18T22:22:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 1 -- 172.21.15.5:0/1877569359 shutdown_connections 2024-08-18T22:22:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5623cb0dcf20 0x5623cb0df310 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0d55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb0cdbe0 0x5623cb0d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 1 --2- 172.21.15.5:0/1877569359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb081610 0x5623cb0d4b50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f483ea00640 0 client.5994 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 1 -- 172.21.15.5:0/1877569359 >> 172.21.15.5:0/1877569359 conn(0x5623cb0aea90 msgr2=0x5623cb0807d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 1 -- 172.21.15.5:0/1877569359 shutdown_connections 2024-08-18T22:22:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 1 -- 172.21.15.5:0/1877569359 wait complete. 2024-08-18T22:22:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.267+0000 7f4863adf000 20 client.5994 trim_cache size 0 max 16384 2024-08-18T22:22:38.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 Processor -- start 2024-08-18T22:22:38.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 -- start start 2024-08-18T22:22:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb081610 0x5623cb07f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb07fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0daba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f48582043b0 con 0x5623cb0cdbe0 2024-08-18T22:22:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48582033b0 con 0x5623cb0ce500 2024-08-18T22:22:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f485815e440 con 0x5623cb081610 2024-08-18T22:22:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f485d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb07fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f485d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb07fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57934/0 (socket says 172.21.15.5:57934) 2024-08-18T22:22:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f485d200640 1 -- 172.21.15.5:0/2494258784 learned_addr learned my addr 172.21.15.5:0/2494258784 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f485e600640 1 --2- 172.21.15.5:0/2494258784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0daba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f485dc00640 1 --2- 172.21.15.5:0/2494258784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb081610 0x5623cb07f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f485d200640 1 -- 172.21.15.5:0/2494258784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb081610 msgr2=0x5623cb07f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f485d200640 1 --2- 172.21.15.5:0/2494258784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb081610 0x5623cb07f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f485d200640 1 -- 172.21.15.5:0/2494258784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 msgr2=0x5623cb0daba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f485d200640 1 --2- 172.21.15.5:0/2494258784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0daba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f485d200640 1 -- 172.21.15.5:0/2494258784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623caf54160 con 0x5623cb0cdbe0 2024-08-18T22:22:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f485d200640 1 --2- 172.21.15.5:0/2494258784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb07fde0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4844022040 tx=0x7f4844014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298402ca8d996ad server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4849600640 1 -- 172.21.15.5:0/2494258784 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484401b070 con 0x5623cb0cdbe0 2024-08-18T22:22:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4849600640 1 -- 172.21.15.5:0/2494258784 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4844025040 con 0x5623cb0cdbe0 2024-08-18T22:22:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4849600640 1 -- 172.21.15.5:0/2494258784 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844005be0 con 0x5623cb0cdbe0 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 -- 172.21.15.5:0/2494258784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 msgr2=0x5623cb07fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 --2- 172.21.15.5:0/2494258784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb07fde0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4844022040 tx=0x7f4844014000 comp rx=0 tx=0).stop 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 -- 172.21.15.5:0/2494258784 shutdown_connections 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 --2- 172.21.15.5:0/2494258784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0daba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 --2- 172.21.15.5:0/2494258784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb07fde0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 --2- 172.21.15.5:0/2494258784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb081610 0x5623cb07f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 -- 172.21.15.5:0/2494258784 >> 172.21.15.5:0/2494258784 conn(0x5623cb0aea90 msgr2=0x5623cb0d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 -- 172.21.15.5:0/2494258784 shutdown_connections 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 -- 172.21.15.5:0/2494258784 wait complete. 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 -- start start 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.283+0000 7f4863adf000 1 Processor -- start 2024-08-18T22:22:38.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb081610 0x5623cb07ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb0804f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0d7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5623caf53cd0 con 0x5623cb0cdbe0 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5623cae95f10 con 0x5623cb0ce500 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5623caf88b10 con 0x5623cb081610 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 10 client.0 _ll_register_callbacks cb 0x7f484c0ec490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb0804f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb0804f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57946/0 (socket says 172.21.15.5:57946) 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485d200640 1 -- 172.21.15.5:0/3411234516 learned_addr learned my addr 172.21.15.5:0/3411234516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485dc00640 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb081610 0x5623cb07ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485e600640 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0d7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485d200640 1 -- 172.21.15.5:0/3411234516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb081610 msgr2=0x5623cb07ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485d200640 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb081610 0x5623cb07ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485d200640 1 -- 172.21.15.5:0/3411234516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 msgr2=0x5623cb0d7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485d200640 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0d7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485d200640 1 -- 172.21.15.5:0/3411234516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623caf2a9c0 con 0x5623cb0cdbe0 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485d200640 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb0804f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x5623cae9cb90 tx=0x7f4844004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b37e6bf793f1c9d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f483ea00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f483ea00640 1 -- 172.21.15.5:0/3411234516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484401b050 con 0x5623cb0cdbe0 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f483ea00640 1 -- 172.21.15.5:0/3411234516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f4844005ba0 con 0x5623cb0cdbe0 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 1 -- 172.21.15.5:0/3411234516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4844025040 con 0x5623cb0cdbe0 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f483ea00640 1 -- 172.21.15.5:0/3411234516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4844045050 con 0x5623cb0cdbe0 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 10 client.6000 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 1 -- 172.21.15.5:0/3411234516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5623cae779a0 con 0x5623cb0cdbe0 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f483ea00640 1 -- 172.21.15.5:0/3411234516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4844025040 con 0x5623cb0cdbe0 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f483ea00640 1 -- 172.21.15.5:0/3411234516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f4844048020 con 0x5623cb0cdbe0 2024-08-18T22:22:38.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 10 client.6000 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 10 client.6000 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 20 client.6000 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5623cb0d8360 0x5623cb141460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 4 client.6000 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-08-18T22:22:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f4863adf000 1 -- 172.21.15.5:0/3411234516 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x5623caede9b0 con 0x5623cb0d8360 2024-08-18T22:22:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485dc00640 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5623cb0d8360 0x5623cb141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f485dc00640 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5623cb0d8360 0x5623cb141460 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea79995800a3666 server_cookie=b636ac9fa6264cb3 in_seq=0 out_seq=0 2024-08-18T22:22:38.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.287+0000 7f483ea00640 10 client.6000 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.291+0000 7f483ea00640 1 -- 172.21.15.5:0/3411234516 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623caede9b0 con 0x5623cb0d8360 2024-08-18T22:22:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.291+0000 7f483ea00640 10 client.6000 handle_command_reply: tid=0 2024-08-18T22:22:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.291+0000 7f4863adf000 1 client.6000 shutdown 2024-08-18T22:22:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4863adf000 1 -- 172.21.15.5:0/3411234516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 msgr2=0x5623cb0804f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4863adf000 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb0804f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x5623cae9cb90 tx=0x7f4844004740 comp rx=0 tx=0).stop 2024-08-18T22:22:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4863adf000 1 -- 172.21.15.5:0/3411234516 shutdown_connections 2024-08-18T22:22:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4863adf000 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5623cb0d8360 0x5623cb141460 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4863adf000 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5623cb0ce500 0x5623cb0d7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4863adf000 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623cb0cdbe0 0x5623cb0804f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4863adf000 1 --2- 172.21.15.5:0/3411234516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5623cb081610 0x5623cb07ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4863adf000 1 -- 172.21.15.5:0/3411234516 >> 172.21.15.5:0/3411234516 conn(0x5623cb0aea90 msgr2=0x5623cb07f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f483ea00640 0 client.6000 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4863adf000 1 -- 172.21.15.5:0/3411234516 shutdown_connections 2024-08-18T22:22:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4863adf000 1 -- 172.21.15.5:0/3411234516 wait complete. 2024-08-18T22:22:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4863adf000 20 client.6000 trim_cache size 0 max 16384 2024-08-18T22:22:38.300 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:22:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:22:38.300 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 -- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48380678c0 msgr2=0x7f4838069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48380678c0 0x7f4838069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4858157d60 tx=0x7f4844008040 comp rx=0 tx=0).stop 2024-08-18T22:22:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 -- 172.21.15.5:0/1377512225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4858072a30 msgr2=0x7f48581fa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4858072a30 0x7f48581fa6c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f484c00b2c0 tx=0x7f484c01b840 comp rx=0 tx=0).stop 2024-08-18T22:22:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 -- 172.21.15.5:0/1377512225 shutdown_connections 2024-08-18T22:22:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48380678c0 0x7f4838069d80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f485815b0c0 0x7f48580ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48580b40c0 0x7f48581f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 --2- 172.21.15.5:0/1377512225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4858072a30 0x7f48581fa6c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 -- 172.21.15.5:0/1377512225 >> 172.21.15.5:0/1377512225 conn(0x7f48580b1dc0 msgr2=0x7f48580cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 -- 172.21.15.5:0/1377512225 shutdown_connections 2024-08-18T22:22:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.295+0000 7f4860600640 1 -- 172.21.15.5:0/1377512225 wait complete. 2024-08-18T22:22:38.317 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'message': '', 'return_code': 0}' 2024-08-18T22:22:38.317 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:22:38.317 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:22:38.318 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-08-18T22:22:38.318 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:22:38.318 DEBUG:teuthology.orchestra.run.smithi005:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-08-18T22:22:38.318 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:22:38.384 INFO:teuthology.orchestra.run.smithi005.stdout:1099511630411 2024-08-18T22:22:38.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:22:38.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-08-18T22:22:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f454ac00640 1 Processor -- start 2024-08-18T22:22:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f454ac00640 1 -- start start 2024-08-18T22:22:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f454ac00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f454415fb80 0x7f45440d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f454ac00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45440d30b0 con 0x7f45440d1090 2024-08-18T22:22:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f454ac00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45440d1bd0 con 0x7f45440b5ad0 2024-08-18T22:22:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f454ac00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4544071c60 con 0x7f454415fb80 2024-08-18T22:22:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4548c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f45440d1090 0x7f4544071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50470/0 (socket says 172.21.15.5:50470) 2024-08-18T22:22:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4548c00640 1 -- 172.21.15.5:0/699159227 learned_addr learned my addr 172.21.15.5:0/699159227 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4543e00640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f454415fb80 0x7f45440d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675315144 0 0) 0x7f45440d30b0 con 0x7f45440d1090 2024-08-18T22:22:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4528003530 con 0x7f45440d1090 2024-08-18T22:22:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411916929 0 0) 0x7f45440d1bd0 con 0x7f45440b5ad0 2024-08-18T22:22:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45440d30b0 con 0x7f45440b5ad0 2024-08-18T22:22:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4190875817 0 0) 0x7f4528003530 con 0x7f45440d1090 2024-08-18T22:22:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f454415fb80 msgr2=0x7f45440d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f454415fb80 0x7f45440d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 >> v1:172.21.15.117:6789/0 conn(0x7f45440b5ad0 legacy=0x7f454406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45440d2dd0 con 0x7f45440d1090 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f453c001a00 con 0x7f45440d1090 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 >> v1:172.21.15.5:6789/0 conn(0x7f45440d1090 legacy=0x7f4544071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4528003b80 0x7f4528003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.579+0000 7f4542a00640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f454415fb80 0x7f4528004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4542a00640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4528004d50 0x7f45280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4544071c60 con 0x7f4528004d50 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f452800bb90 con 0x7f4528003b80 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f452800bd90 con 0x7f454415fb80 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4548c00640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4528004d50 0x7f45280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4543e00640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4528003b80 0x7f4528003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4543400640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f454415fb80 0x7f4528004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4548c00640 1 -- 172.21.15.5:0/699159227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f454415fb80 msgr2=0x7f4528004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4548c00640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f454415fb80 0x7f4528004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4548c00640 1 -- 172.21.15.5:0/699159227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4528003b80 msgr2=0x7f4528003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4548c00640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4528003b80 0x7f4528003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4548c00640 1 -- 172.21.15.5:0/699159227 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4528003530 con 0x7f4528004d50 2024-08-18T22:22:38.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4548c00640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4528004d50 0x7f45280051d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f453c00a7f0 tx=0x7f453c01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be67ee363906cb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c00a410 con 0x7f4528004d50 2024-08-18T22:22:38.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453c0ad630 con 0x7f4528004d50 2024-08-18T22:22:38.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.583+0000 7f4542a00640 1 -- 172.21.15.5:0/699159227 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c0ada20 con 0x7f4528004d50 2024-08-18T22:22:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 -- 172.21.15.5:0/699159227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4528004d50 msgr2=0x7f45280051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 --2- 172.21.15.5:0/699159227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4528004d50 0x7f45280051d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f453c00a7f0 tx=0x7f453c01d300 comp rx=0 tx=0).stop 2024-08-18T22:22:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f4548c00640 1 -- 172.21.15.5:0/699159227 reap_dead start 2024-08-18T22:22:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 -- 172.21.15.5:0/699159227 shutdown_connections 2024-08-18T22:22:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 -- 172.21.15.5:0/699159227 >> 172.21.15.5:0/699159227 conn(0x7f45440d2180 msgr2=0x7f45440d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 -- 172.21.15.5:0/699159227 shutdown_connections 2024-08-18T22:22:38.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 -- 172.21.15.5:0/699159227 wait complete. 2024-08-18T22:22:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 Processor -- start 2024-08-18T22:22:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 -- start start 2024-08-18T22:22:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4528004d50 0x7f4544160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45440b01f0 0x7f454415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4544154ae0 0x7f4544157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f45440b5eb0 con 0x7f4544154ae0 2024-08-18T22:22:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f45440d1eb0 con 0x7f4528004d50 2024-08-18T22:22:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f454ac00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4544168300 con 0x7f45440b01f0 2024-08-18T22:22:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f4548c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4544154ae0 0x7f4544157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f4548c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4544154ae0 0x7f4544157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57966/0 (socket says 172.21.15.5:57966) 2024-08-18T22:22:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f4548c00640 1 -- 172.21.15.5:0/2470995733 learned_addr learned my addr 172.21.15.5:0/2470995733 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f4543e00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4528004d50 0x7f4544160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f4543400640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45440b01f0 0x7f454415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f4548c00640 1 -- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45440b01f0 msgr2=0x7f454415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f4548c00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45440b01f0 0x7f454415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f4548c00640 1 -- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4528004d50 msgr2=0x7f4544160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f4548c00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4528004d50 0x7f4544160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.587+0000 7f4548c00640 1 -- 172.21.15.5:0/2470995733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454415ae60 con 0x7f4544154ae0 2024-08-18T22:22:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.591+0000 7f4548c00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4544154ae0 0x7f4544157690 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f453c01cd70 tx=0x7f4528005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.591+0000 7f453be00640 1 -- 172.21.15.5:0/2470995733 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c001f90 con 0x7f4544154ae0 2024-08-18T22:22:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.591+0000 7f453be00640 1 -- 172.21.15.5:0/2470995733 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453c0ad430 con 0x7f4544154ae0 2024-08-18T22:22:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.591+0000 7f454ac00640 1 -- 172.21.15.5:0/2470995733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454415b140 con 0x7f4544154ae0 2024-08-18T22:22:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.591+0000 7f453be00640 1 -- 172.21.15.5:0/2470995733 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c001800 con 0x7f4544154ae0 2024-08-18T22:22:38.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.591+0000 7f454ac00640 1 -- 172.21.15.5:0/2470995733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454415cd50 con 0x7f4544154ae0 2024-08-18T22:22:38.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.591+0000 7f453be00640 1 -- 172.21.15.5:0/2470995733 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f453c0b5070 con 0x7f4544154ae0 2024-08-18T22:22:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f453be00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45240678c0 0x7f4524069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f453be00640 1 -- 172.21.15.5:0/2470995733 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f453c11f9e0 con 0x7f4544154ae0 2024-08-18T22:22:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 Processor -- start 2024-08-18T22:22:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4543e00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45240678c0 0x7f4524069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 -- start start 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4543e00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45240678c0 0x7f4524069d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4534009be0 tx=0x7f4534009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88bd8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88bd92d0 0x555f88b8bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b8c510 0x555f88b8c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555f88a75af0 con 0x555f88b8c510 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555f88a61bb0 con 0x555f88bd89b0 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555f889dc500 con 0x555f88bd92d0 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4548c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b8c510 0x555f88b8c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4548c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b8c510 0x555f88b8c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57982/0 (socket says 172.21.15.5:57982) 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4548c00640 1 -- 172.21.15.5:0/783559731 learned_addr learned my addr 172.21.15.5:0/783559731 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4543e00640 1 --2- 172.21.15.5:0/783559731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88bd8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4543400640 1 --2- 172.21.15.5:0/783559731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88bd92d0 0x555f88b8bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4548c00640 1 -- 172.21.15.5:0/783559731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88bd92d0 msgr2=0x555f88b8bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4548c00640 1 --2- 172.21.15.5:0/783559731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88bd92d0 0x555f88b8bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4548c00640 1 -- 172.21.15.5:0/783559731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 msgr2=0x555f88bd8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4548c00640 1 --2- 172.21.15.5:0/783559731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88bd8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4548c00640 1 -- 172.21.15.5:0/783559731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f8897caa0 con 0x555f88b8c510 2024-08-18T22:22:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4548c00640 1 --2- 172.21.15.5:0/783559731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b8c510 0x555f88b8c8f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f453c11de10 tx=0x7f453c0ef840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de883eea8b97e5af server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4538c00640 1 -- 172.21.15.5:0/783559731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c0f4190 con 0x555f88b8c510 2024-08-18T22:22:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4538c00640 1 -- 172.21.15.5:0/783559731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453c0f3040 con 0x555f88b8c510 2024-08-18T22:22:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f4538c00640 1 -- 172.21.15.5:0/783559731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c0f89c0 con 0x555f88b8c510 2024-08-18T22:22:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 -- 172.21.15.5:0/783559731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b8c510 msgr2=0x555f88b8c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 --2- 172.21.15.5:0/783559731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b8c510 0x555f88b8c8f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f453c11de10 tx=0x7f453c0ef840 comp rx=0 tx=0).stop 2024-08-18T22:22:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 -- 172.21.15.5:0/783559731 shutdown_connections 2024-08-18T22:22:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 --2- 172.21.15.5:0/783559731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b8c510 0x555f88b8c8f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 --2- 172.21.15.5:0/783559731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88bd92d0 0x555f88b8bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 --2- 172.21.15.5:0/783559731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88bd8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 -- 172.21.15.5:0/783559731 >> 172.21.15.5:0/783559731 conn(0x555f88b86020 msgr2=0x555f88bbb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 -- 172.21.15.5:0/783559731 shutdown_connections 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.595+0000 7f454e1df000 1 -- 172.21.15.5:0/783559731 wait complete. 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 -- start start 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 Processor -- start 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88bb8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88b93ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd92d0 0x555f88b943e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555f889d84c0 con 0x555f88bd92d0 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555f88996b60 con 0x555f88bd89b0 2024-08-18T22:22:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555f8897dd10 con 0x555f88b8c510 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 10 client.0 _ll_register_callbacks cb 0x555f88b79f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4548c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd92d0 0x555f88b943e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4548c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd92d0 0x555f88b943e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57984/0 (socket says 172.21.15.5:57984) 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4548c00640 1 -- 172.21.15.5:0/956178581 learned_addr learned my addr 172.21.15.5:0/956178581 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4543400640 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88b93ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4543e00640 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88bb8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4548c00640 1 -- 172.21.15.5:0/956178581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 msgr2=0x555f88bb8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4548c00640 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88bb8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4548c00640 1 -- 172.21.15.5:0/956178581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 msgr2=0x555f88b93ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4548c00640 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88b93ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4548c00640 1 -- 172.21.15.5:0/956178581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f88995070 con 0x555f88bd92d0 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4548c00640 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd92d0 0x555f88b943e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f453c01d340 tx=0x7f453c0021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6343fd4c7f7e38 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f452d600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f452d600640 1 -- 172.21.15.5:0/956178581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c10d070 con 0x555f88bd92d0 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f452d600640 1 -- 172.21.15.5:0/956178581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f453c11c040 con 0x555f88bd92d0 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 -- 172.21.15.5:0/956178581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f453c0f3040 con 0x555f88bd92d0 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f452d600640 1 -- 172.21.15.5:0/956178581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f453c0f89c0 con 0x555f88bd92d0 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 10 client.6012 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 -- 172.21.15.5:0/956178581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x555f889a8f60 con 0x555f88bd92d0 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f452d600640 1 -- 172.21.15.5:0/956178581 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453c0f3040 con 0x555f88bd92d0 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f452d600640 1 -- 172.21.15.5:0/956178581 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f454409b250 con 0x555f88bd92d0 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 10 client.6012 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 10 client.6012 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 20 client.6012 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555f88bbad40 0x555f88bbb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 4 client.6012 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f454e1df000 1 -- 172.21.15.5:0/956178581 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f88976e20 con 0x555f88bbad40 2024-08-18T22:22:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4543e00640 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555f88bbad40 0x555f88bbb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f4543e00640 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555f88bbad40 0x555f88bbb120 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6743d3b38ef1be8e server_cookie=72e52a48fae35233 in_seq=0 out_seq=0 2024-08-18T22:22:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.599+0000 7f452d600640 10 client.6012 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f452d600640 1 -- 172.21.15.5:0/956178581 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f88976e20 con 0x555f88bbad40 2024-08-18T22:22:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f452d600640 10 client.6012 handle_command_reply: tid=0 2024-08-18T22:22:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 1 client.6012 shutdown 2024-08-18T22:22:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 1 -- 172.21.15.5:0/956178581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd92d0 msgr2=0x555f88b943e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd92d0 0x555f88b943e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f453c01d340 tx=0x7f453c0021e0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 1 -- 172.21.15.5:0/956178581 shutdown_connections 2024-08-18T22:22:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555f88bbad40 0x555f88bbb120 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd92d0 0x555f88b943e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88b93ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 1 --2- 172.21.15.5:0/956178581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88bb8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f452d600640 0 client.6012 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 1 -- 172.21.15.5:0/956178581 >> 172.21.15.5:0/956178581 conn(0x555f88b86020 msgr2=0x555f88b8b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 1 -- 172.21.15.5:0/956178581 shutdown_connections 2024-08-18T22:22:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 1 -- 172.21.15.5:0/956178581 wait complete. 2024-08-18T22:22:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.603+0000 7f454e1df000 20 client.6012 trim_cache size 0 max 16384 2024-08-18T22:22:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.615+0000 7f454e1df000 1 Processor -- start 2024-08-18T22:22:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.615+0000 7f454e1df000 1 -- start start 2024-08-18T22:22:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88b86020 0x555f88bd7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88b8b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd89b0 0x555f88b8bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f45442048f0 con 0x555f88bd89b0 2024-08-18T22:22:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4544203930 con 0x555f88b86020 2024-08-18T22:22:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f45441fb7f0 con 0x555f88b8c510 2024-08-18T22:22:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f4548c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd89b0 0x555f88b8bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f4548c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd89b0 0x555f88b8bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57994/0 (socket says 172.21.15.5:57994) 2024-08-18T22:22:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f4548c00640 1 -- 172.21.15.5:0/4186788868 learned_addr learned my addr 172.21.15.5:0/4186788868 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f4543e00640 1 --2- 172.21.15.5:0/4186788868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88b86020 0x555f88bd7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f4543400640 1 --2- 172.21.15.5:0/4186788868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88b8b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f4548c00640 1 -- 172.21.15.5:0/4186788868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 msgr2=0x555f88b8b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f4548c00640 1 --2- 172.21.15.5:0/4186788868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88b8b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f4548c00640 1 -- 172.21.15.5:0/4186788868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88b86020 msgr2=0x555f88bd7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f4548c00640 1 --2- 172.21.15.5:0/4186788868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88b86020 0x555f88bd7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f4548c00640 1 -- 172.21.15.5:0/4186788868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f88a5ede0 con 0x555f88bd89b0 2024-08-18T22:22:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f4548c00640 1 --2- 172.21.15.5:0/4186788868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd89b0 0x555f88b8bcf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f453c01d7e0 tx=0x7f453c109070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fdab45dffab89b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f452fe00640 1 -- 172.21.15.5:0/4186788868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c10d040 con 0x555f88bd89b0 2024-08-18T22:22:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f452fe00640 1 -- 172.21.15.5:0/4186788868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453c0f3040 con 0x555f88bd89b0 2024-08-18T22:22:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f452fe00640 1 -- 172.21.15.5:0/4186788868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c0ef740 con 0x555f88bd89b0 2024-08-18T22:22:38.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- 172.21.15.5:0/4186788868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd89b0 msgr2=0x555f88b8bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 --2- 172.21.15.5:0/4186788868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd89b0 0x555f88b8bcf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f453c01d7e0 tx=0x7f453c109070 comp rx=0 tx=0).stop 2024-08-18T22:22:38.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- 172.21.15.5:0/4186788868 shutdown_connections 2024-08-18T22:22:38.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 --2- 172.21.15.5:0/4186788868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88bd89b0 0x555f88b8bcf0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 --2- 172.21.15.5:0/4186788868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88b8b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 --2- 172.21.15.5:0/4186788868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88b86020 0x555f88bd7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- 172.21.15.5:0/4186788868 >> 172.21.15.5:0/4186788868 conn(0x555f88b90ed0 msgr2=0x555f88bd7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- 172.21.15.5:0/4186788868 shutdown_connections 2024-08-18T22:22:38.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- 172.21.15.5:0/4186788868 wait complete. 2024-08-18T22:22:38.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- start start 2024-08-18T22:22:38.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 Processor -- start 2024-08-18T22:22:38.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b86020 0x555f88c4c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88c4c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88c4ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f45442032e0 con 0x555f88b86020 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555f889db810 con 0x555f88bd89b0 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.619+0000 7f454e1df000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555f889b62d0 con 0x555f88b8c510 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 10 client.0 _ll_register_callbacks cb 0x7f4534009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b86020 0x555f88c4c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b86020 0x555f88c4c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57998/0 (socket says 172.21.15.5:57998) 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543e00640 1 -- 172.21.15.5:0/1633104559 learned_addr learned my addr 172.21.15.5:0/1633104559 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543400640 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88c4c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4548c00640 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88c4ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543e00640 1 -- 172.21.15.5:0/1633104559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 msgr2=0x555f88c4c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543e00640 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88c4c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543e00640 1 -- 172.21.15.5:0/1633104559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 msgr2=0x555f88c4ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543e00640 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88c4ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543e00640 1 -- 172.21.15.5:0/1633104559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f8896fce0 con 0x555f88b86020 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4548c00640 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88c4ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543e00640 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b86020 0x555f88c4c250 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4534004510 tx=0x7f4534017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e7d514d50fbf75 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f452d600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f452d600640 1 -- 172.21.15.5:0/1633104559 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453401b070 con 0x555f88b86020 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f452d600640 1 -- 172.21.15.5:0/1633104559 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f453402e620 con 0x555f88b86020 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 -- 172.21.15.5:0/1633104559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f453c0f3040 con 0x555f88b86020 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f452d600640 1 -- 172.21.15.5:0/1633104559 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f453403f050 con 0x555f88b86020 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 10 client.6018 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 -- 172.21.15.5:0/1633104559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x555f88982330 con 0x555f88b86020 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f452d600640 1 -- 172.21.15.5:0/1633104559 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453c0f3040 con 0x555f88b86020 2024-08-18T22:22:38.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f452d600640 1 -- 172.21.15.5:0/1633104559 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f453402e820 con 0x555f88b86020 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 10 client.6018 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 10 client.6018 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 20 client.6018 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555f88bd92d0 0x555f88bebb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 4 client.6018 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 -- 172.21.15.5:0/1633104559 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555f889e9c30 con 0x555f88bd92d0 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543400640 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555f88bd92d0 0x555f88bebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f4543400640 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555f88bd92d0 0x555f88bebb80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72d7a12389cb7cce server_cookie=4d4551bf4edff5b7 in_seq=0 out_seq=0 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f452d600640 10 client.6018 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f452d600640 1 -- 172.21.15.5:0/1633104559 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555f889e9c30 con 0x555f88bd92d0 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f452d600640 10 client.6018 handle_command_reply: tid=0 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 client.6018 shutdown 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 -- 172.21.15.5:0/1633104559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b86020 msgr2=0x555f88c4c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b86020 0x555f88c4c250 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4534004510 tx=0x7f4534017070 comp rx=0 tx=0).stop 2024-08-18T22:22:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 -- 172.21.15.5:0/1633104559 shutdown_connections 2024-08-18T22:22:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555f88bd92d0 0x555f88bebb80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555f88bd89b0 0x555f88c4ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555f88b8c510 0x555f88c4c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 --2- 172.21.15.5:0/1633104559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555f88b86020 0x555f88c4c250 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f452d600640 0 client.6018 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 -- 172.21.15.5:0/1633104559 >> 172.21.15.5:0/1633104559 conn(0x555f88b90ed0 msgr2=0x555f88bd7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 -- 172.21.15.5:0/1633104559 shutdown_connections 2024-08-18T22:22:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 1 -- 172.21.15.5:0/1633104559 wait complete. 2024-08-18T22:22:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454e1df000 20 client.6018 trim_cache size 0 max 16384 2024-08-18T22:22:38.632 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454ac00640 1 -- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45240678c0 msgr2=0x7f4524069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454ac00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45240678c0 0x7f4524069d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4534009be0 tx=0x7f4534009190 comp rx=0 tx=0).stop 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454ac00640 1 -- 172.21.15.5:0/2470995733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4544154ae0 msgr2=0x7f4544157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454ac00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4544154ae0 0x7f4544157690 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f453c01cd70 tx=0x7f4528005840 comp rx=0 tx=0).stop 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454ac00640 1 -- 172.21.15.5:0/2470995733 shutdown_connections 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454ac00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45240678c0 0x7f4524069d80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.623+0000 7f454ac00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4544154ae0 0x7f4544157690 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.627+0000 7f454ac00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45440b01f0 0x7f454415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.627+0000 7f454ac00640 1 --2- 172.21.15.5:0/2470995733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4528004d50 0x7f4544160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.627+0000 7f454ac00640 1 -- 172.21.15.5:0/2470995733 >> 172.21.15.5:0/2470995733 conn(0x7f45440d2180 msgr2=0x7f45441674d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.627+0000 7f454ac00640 1 -- 172.21.15.5:0/2470995733 shutdown_connections 2024-08-18T22:22:38.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.627+0000 7f454ac00640 1 -- 172.21.15.5:0/2470995733 wait complete. 2024-08-18T22:22:38.648 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4b.00000000 parent 2024-08-18T22:22:38.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5b2b7e080 1 Processor -- start 2024-08-18T22:22:38.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5b2b7e080 1 -- start start 2024-08-18T22:22:38.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5b2b7e080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 0x55e3fb78b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5b2b7e080 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e3fb78f850 0x55e3fb78be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5b2b7e080 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3fb78fc30 0x55e3fb78d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5b2b7e080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e3fb609aa0 con 0x55e3fb702100 2024-08-18T22:22:38.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5b2b7e080 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e3fb6631f0 con 0x55e3fb78fc30 2024-08-18T22:22:38.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5b2b7e080 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e3fb7025a0 con 0x55e3fb78f850 2024-08-18T22:22:38.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 0x55e3fb78b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 0x55e3fb78b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58004/0 (socket says 172.21.15.5:58004) 2024-08-18T22:22:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5afe00640 1 -- 172.21.15.5:0/1990869272 learned_addr learned my addr 172.21.15.5:0/1990869272 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5b0800640 1 --2- 172.21.15.5:0/1990869272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3fb78fc30 0x55e3fb78d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5af400640 1 --2- 172.21.15.5:0/1990869272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e3fb78f850 0x55e3fb78be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5afe00640 1 -- 172.21.15.5:0/1990869272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e3fb78f850 msgr2=0x55e3fb78be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5afe00640 1 --2- 172.21.15.5:0/1990869272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e3fb78f850 0x55e3fb78be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5afe00640 1 -- 172.21.15.5:0/1990869272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3fb78fc30 msgr2=0x55e3fb78d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5afe00640 1 --2- 172.21.15.5:0/1990869272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3fb78fc30 0x55e3fb78d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5afe00640 1 -- 172.21.15.5:0/1990869272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3fb6e9140 con 0x55e3fb702100 2024-08-18T22:22:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5afe00640 1 --2- 172.21.15.5:0/1990869272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 0x55e3fb78b930 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000b2a0 tx=0x7fa5a000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd35b74dae5b11e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5ae000640 1 -- 172.21.15.5:0/1990869272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000a040 con 0x55e3fb702100 2024-08-18T22:22:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5ae000640 1 -- 172.21.15.5:0/1990869272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a000f620 con 0x55e3fb702100 2024-08-18T22:22:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.691+0000 7fa5ae000640 1 -- 172.21.15.5:0/1990869272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000fa10 con 0x55e3fb702100 2024-08-18T22:22:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/1990869272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 msgr2=0x55e3fb78b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 --2- 172.21.15.5:0/1990869272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 0x55e3fb78b930 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000b2a0 tx=0x7fa5a000b760 comp rx=0 tx=0).stop 2024-08-18T22:22:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/1990869272 shutdown_connections 2024-08-18T22:22:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 --2- 172.21.15.5:0/1990869272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3fb78fc30 0x55e3fb78d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 --2- 172.21.15.5:0/1990869272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e3fb78f850 0x55e3fb78be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 --2- 172.21.15.5:0/1990869272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 0x55e3fb78b930 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/1990869272 >> 172.21.15.5:0/1990869272 conn(0x55e3fb6bb330 msgr2=0x55e3fb6b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/1990869272 shutdown_connections 2024-08-18T22:22:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/1990869272 wait complete. 2024-08-18T22:22:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 Processor -- start 2024-08-18T22:22:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 -- start start 2024-08-18T22:22:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 0x55e3fb6e3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e3fb78f850 0x55e3fb6e56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3fb78fc30 0x55e3fb6e5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e3fb6e9680 con 0x55e3fb702100 2024-08-18T22:22:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e3fb6e93e0 con 0x55e3fb78fc30 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e3fb6e4ff0 con 0x55e3fb78f850 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 0x55e3fb6e3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 0x55e3fb6e3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58006/0 (socket says 172.21.15.5:58006) 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5afe00640 1 -- 172.21.15.5:0/2494727513 learned_addr learned my addr 172.21.15.5:0/2494727513 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5af400640 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e3fb78f850 0x55e3fb6e56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b0800640 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3fb78fc30 0x55e3fb6e5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5afe00640 1 -- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e3fb78f850 msgr2=0x55e3fb6e56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5afe00640 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e3fb78f850 0x55e3fb6e56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5afe00640 1 -- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3fb78fc30 msgr2=0x55e3fb6e5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5afe00640 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e3fb78fc30 0x55e3fb6e5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5afe00640 1 -- 172.21.15.5:0/2494727513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3fb78b3d0 con 0x55e3fb702100 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5afe00640 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 0x55e3fb6e3a90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0001360 tx=0x7fa5a0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5acc00640 1 -- 172.21.15.5:0/2494727513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0001650 con 0x55e3fb702100 2024-08-18T22:22:38.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5acc00640 1 -- 172.21.15.5:0/2494727513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a0021020 con 0x55e3fb702100 2024-08-18T22:22:38.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/2494727513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3fb78a950 con 0x55e3fb702100 2024-08-18T22:22:38.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5acc00640 1 -- 172.21.15.5:0/2494727513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000fe30 con 0x55e3fb702100 2024-08-18T22:22:38.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.695+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/2494727513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3fb78ae90 con 0x55e3fb702100 2024-08-18T22:22:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.699+0000 7fa5acc00640 1 -- 172.21.15.5:0/2494727513 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5a0017070 con 0x55e3fb702100 2024-08-18T22:22:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.699+0000 7fa5acc00640 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa590066490 0x7fa590068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.699+0000 7fa5acc00640 1 -- 172.21.15.5:0/2494727513 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fa5a0086580 con 0x55e3fb702100 2024-08-18T22:22:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.699+0000 7fa5b2b7e080 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x55e3fb825cf0 0x55e3fb8260d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.699+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/2494727513 --> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] -- osd_op(unknown.0.0:1 8.24 8:256cebcc:::10000000a4b.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55) -- 0x55e3fb826610 con 0x55e3fb825cf0 2024-08-18T22:22:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.699+0000 7fa5af400640 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa590066490 0x7fa590068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.699+0000 7fa5b0800640 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x55e3fb825cf0 0x55e3fb8260d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.699+0000 7fa5af400640 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa590066490 0x7fa590068950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa59c010420 tx=0x7fa59c0017a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.699+0000 7fa5b0800640 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x55e3fb825cf0 0x55e3fb8260d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b0800640 1 -- 172.21.15.5:0/2494727513 <== osd.6 v2:172.21.15.117:6824/3026847861 1 ==== osd_op_reply(1 10000000a4b.00000000 [rmxattr] v55'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa5a80a8ad0 con 0x55e3fb825cf0 2024-08-18T22:22:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x55e3fb825cf0 msgr2=0x55e3fb8260d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b2b7e080 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x55e3fb825cf0 0x55e3fb8260d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa590066490 msgr2=0x7fa590068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b2b7e080 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa590066490 0x7fa590068950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa59c010420 tx=0x7fa59c0017a0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/2494727513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 msgr2=0x55e3fb6e3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b2b7e080 1 --2- 172.21.15.5:0/2494727513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e3fb702100 0x55e3fb6e3a90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0001360 tx=0x7fa5a0000ee0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b0800640 1 -- 172.21.15.5:0/2494727513 reap_dead start 2024-08-18T22:22:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/2494727513 shutdown_connections 2024-08-18T22:22:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/2494727513 >> 172.21.15.5:0/2494727513 conn(0x55e3fb6bb330 msgr2=0x55e3fb6e8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/2494727513 shutdown_connections 2024-08-18T22:22:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.703+0000 7fa5b2b7e080 1 -- 172.21.15.5:0/2494727513 wait complete. 2024-08-18T22:22:38.711 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-08-18T22:22:38.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-08-18T22:22:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03e5a00640 1 Processor -- start 2024-08-18T22:22:38.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03e5a00640 1 -- start start 2024-08-18T22:22:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03e5a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03e00b40c0 0x7f03e00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03e5a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03e00b31f0 con 0x7f03e00ce280 2024-08-18T22:22:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03e5a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03e00b34d0 con 0x7f03e015b0c0 2024-08-18T22:22:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03e5a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f03e00b4a70 con 0x7f03e00b40c0 2024-08-18T22:22:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03d6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03e00b40c0 0x7f03e00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03df400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f03e00ce280 0x7f03e00ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50494/0 (socket says 172.21.15.5:50494) 2024-08-18T22:22:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03df400640 1 -- 172.21.15.5:0/643645329 learned_addr learned my addr 172.21.15.5:0/643645329 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03d6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03e00b40c0 0x7f03e00b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58008/0 (socket says 172.21.15.5:58008) 2024-08-18T22:22:38.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03d6000640 1 -- 172.21.15.5:0/643645329 >> v1:172.21.15.117:6789/0 conn(0x7f03e015b0c0 legacy=0x7f03e006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03d6000640 1 -- 172.21.15.5:0/643645329 >> v1:172.21.15.5:6789/0 conn(0x7f03e00ce280 legacy=0x7f03e00ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03d6000640 1 -- 172.21.15.5:0/643645329 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e00b37b0 con 0x7f03e00b40c0 2024-08-18T22:22:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.851+0000 7f03de000640 1 -- 172.21.15.5:0/643645329 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047382684 0 0) 0x7f03e00b31f0 con 0x7f03e00ce280 2024-08-18T22:22:38.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.855+0000 7f03d6000640 1 --2- 172.21.15.5:0/643645329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00b40c0 0x7f03e00b4530 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f03c800bfa0 tx=0x7f03c801ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1248f14e9cce48f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.855+0000 7f03de000640 1 -- 172.21.15.5:0/643645329 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c800b2d0 con 0x7f03e00b40c0 2024-08-18T22:22:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.855+0000 7f03de000640 1 -- 172.21.15.5:0/643645329 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c80a7720 con 0x7f03e00b40c0 2024-08-18T22:22:38.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.855+0000 7f03de000640 1 -- 172.21.15.5:0/643645329 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c80a7af0 con 0x7f03e00b40c0 2024-08-18T22:22:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.855+0000 7f03e5a00640 1 -- 172.21.15.5:0/643645329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00b40c0 msgr2=0x7f03e00b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.855+0000 7f03e5a00640 1 --2- 172.21.15.5:0/643645329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00b40c0 0x7f03e00b4530 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f03c800bfa0 tx=0x7f03c801ea50 comp rx=0 tx=0).stop 2024-08-18T22:22:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.855+0000 7f03e5a00640 1 -- 172.21.15.5:0/643645329 shutdown_connections 2024-08-18T22:22:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.855+0000 7f03e5a00640 1 --2- 172.21.15.5:0/643645329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00b40c0 0x7f03e00b4530 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.855+0000 7f03e5a00640 1 -- 172.21.15.5:0/643645329 >> 172.21.15.5:0/643645329 conn(0x7f03e00b1dc0 msgr2=0x7f03e00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.855+0000 7f03e5a00640 1 -- 172.21.15.5:0/643645329 shutdown_connections 2024-08-18T22:22:38.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.855+0000 7f03e5a00640 1 -- 172.21.15.5:0/643645329 wait complete. 2024-08-18T22:22:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03e5a00640 1 Processor -- start 2024-08-18T22:22:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03e5a00640 1 -- start start 2024-08-18T22:22:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03e5a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03e00b40c0 0x7f03e014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03e5a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00ce280 0x7f03e00cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03e5a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03e015b0c0 0x7f03e00ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03e5a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03e006e410 con 0x7f03e00ce280 2024-08-18T22:22:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03e5a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f03e006f880 con 0x7f03e00b40c0 2024-08-18T22:22:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03e5a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03e006e590 con 0x7f03e015b0c0 2024-08-18T22:22:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00ce280 0x7f03e00cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00ce280 0x7f03e00cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58022/0 (socket says 172.21.15.5:58022) 2024-08-18T22:22:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d6000640 1 -- 172.21.15.5:0/1587081242 learned_addr learned my addr 172.21.15.5:0/1587081242 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03dea00640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03e00b40c0 0x7f03e014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03df400640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03e015b0c0 0x7f03e00ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d6000640 1 -- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03e015b0c0 msgr2=0x7f03e00ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d6000640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03e015b0c0 0x7f03e00ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d6000640 1 -- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03e00b40c0 msgr2=0x7f03e014f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d6000640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03e00b40c0 0x7f03e014f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d6000640 1 -- 172.21.15.5:0/1587081242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e00b2af0 con 0x7f03e00ce280 2024-08-18T22:22:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03dea00640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03e00b40c0 0x7f03e014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d6000640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00ce280 0x7f03e00cb750 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f03c800bfa0 tx=0x7f03c801b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d7400640 1 -- 172.21.15.5:0/1587081242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8009540 con 0x7f03e00ce280 2024-08-18T22:22:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d7400640 1 -- 172.21.15.5:0/1587081242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c80096e0 con 0x7f03e00ce280 2024-08-18T22:22:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03e5a00640 1 -- 172.21.15.5:0/1587081242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e014fff0 con 0x7f03e00ce280 2024-08-18T22:22:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03d7400640 1 -- 172.21.15.5:0/1587081242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8009ad0 con 0x7f03e00ce280 2024-08-18T22:22:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.859+0000 7f03e5a00640 1 -- 172.21.15.5:0/1587081242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e01505b0 con 0x7f03e00ce280 2024-08-18T22:22:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03d7400640 1 -- 172.21.15.5:0/1587081242 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f03c80c0020 con 0x7f03e00ce280 2024-08-18T22:22:38.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03d7400640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03bc0678c0 0x7f03bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03d7400640 1 -- 172.21.15.5:0/1587081242 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f03c8120670 con 0x7f03e00ce280 2024-08-18T22:22:38.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03dea00640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03bc0678c0 0x7f03bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03e8f34000 1 Processor -- start 2024-08-18T22:22:38.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03e8f34000 1 -- start start 2024-08-18T22:22:38.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03dea00640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03bc0678c0 0x7f03bc069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f03d0000f70 tx=0x7f03d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e9421d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e941d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e941d41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03e8f34000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563e94021390 con 0x563e941d3de0 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03e8f34000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563e93fbcd60 con 0x563e9421dc40 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.863+0000 7f03e8f34000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563e9401d350 con 0x563e9421d320 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03df400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e941d41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03df400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e941d41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58030/0 (socket says 172.21.15.5:58030) 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03df400640 1 -- 172.21.15.5:0/2438444811 learned_addr learned my addr 172.21.15.5:0/2438444811 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03dea00640 1 --2- 172.21.15.5:0/2438444811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e9421d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03d6000640 1 --2- 172.21.15.5:0/2438444811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e941d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03df400640 1 -- 172.21.15.5:0/2438444811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 msgr2=0x563e9421d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03df400640 1 --2- 172.21.15.5:0/2438444811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e9421d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03df400640 1 -- 172.21.15.5:0/2438444811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 msgr2=0x563e941d38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03df400640 1 --2- 172.21.15.5:0/2438444811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e941d38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03df400640 1 -- 172.21.15.5:0/2438444811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e93fbcfb0 con 0x563e941d3de0 2024-08-18T22:22:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03df400640 1 --2- 172.21.15.5:0/2438444811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e941d41c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f03d8007950 tx=0x7f03d8004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49b9929945ded11 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03cf400640 1 -- 172.21.15.5:0/2438444811 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d801a070 con 0x563e941d3de0 2024-08-18T22:22:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03cf400640 1 -- 172.21.15.5:0/2438444811 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d80018a0 con 0x563e941d3de0 2024-08-18T22:22:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03cf400640 1 -- 172.21.15.5:0/2438444811 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8001c90 con 0x563e941d3de0 2024-08-18T22:22:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 -- 172.21.15.5:0/2438444811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 msgr2=0x563e941d41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 --2- 172.21.15.5:0/2438444811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e941d41c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f03d8007950 tx=0x7f03d8004bc0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 -- 172.21.15.5:0/2438444811 shutdown_connections 2024-08-18T22:22:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 --2- 172.21.15.5:0/2438444811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e941d41c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 --2- 172.21.15.5:0/2438444811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e941d38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 --2- 172.21.15.5:0/2438444811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e9421d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 -- 172.21.15.5:0/2438444811 >> 172.21.15.5:0/2438444811 conn(0x563e940bb750 msgr2=0x563e941d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 -- 172.21.15.5:0/2438444811 shutdown_connections 2024-08-18T22:22:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 -- 172.21.15.5:0/2438444811 wait complete. 2024-08-18T22:22:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 -- start start 2024-08-18T22:22:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 Processor -- start 2024-08-18T22:22:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e941d3de0 0x563e94224290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e9421d320 0x563e942247d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e94224d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563e93fc2f10 con 0x563e9421d320 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563e940de5d0 con 0x563e9421dc40 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563e940618a0 con 0x563e941d3de0 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03e8f34000 10 client.0 _ll_register_callbacks cb 0x563e941bee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03d6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e9421d320 0x563e942247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03d6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e9421d320 0x563e942247d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58046/0 (socket says 172.21.15.5:58046) 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.867+0000 7f03d6000640 1 -- 172.21.15.5:0/1056534885 learned_addr learned my addr 172.21.15.5:0/1056534885 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03dea00640 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e941d3de0 0x563e94224290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03df400640 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e94224d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03d6000640 1 -- 172.21.15.5:0/1056534885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e941d3de0 msgr2=0x563e94224290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03d6000640 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e941d3de0 0x563e94224290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03d6000640 1 -- 172.21.15.5:0/1056534885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 msgr2=0x563e94224d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03d6000640 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e94224d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03d6000640 1 -- 172.21.15.5:0/1056534885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e93fedf30 con 0x563e9421d320 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03df400640 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e94224d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03d6000640 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e9421d320 0x563e942247d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f03c8025060 tx=0x7f03c8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8186ba2562d0b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03c3e00640 1 -- 172.21.15.5:0/1056534885 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c80f4c30 con 0x563e9421d320 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03c3e00640 1 -- 172.21.15.5:0/1056534885 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f03c80f70b0 con 0x563e9421d320 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 -- 172.21.15.5:0/1056534885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03d80018a0 con 0x563e9421d320 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03c3e00640 1 -- 172.21.15.5:0/1056534885 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f03c80f9460 con 0x563e9421d320 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 10 client.6045 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 -- 172.21.15.5:0/1056534885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x563e940a4360 con 0x563e9421d320 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03c3e00640 1 -- 172.21.15.5:0/1056534885 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d80018a0 con 0x563e9421d320 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03c3e00640 1 -- 172.21.15.5:0/1056534885 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f03c80b8070 con 0x563e9421d320 2024-08-18T22:22:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 10 client.6045 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 10 client.6045 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 20 client.6045 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563e9422c660 0x563e9422ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 4 client.6045 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 -- 172.21.15.5:0/1056534885 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e93fbbd30 con 0x563e9422c660 2024-08-18T22:22:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03dea00640 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563e9422c660 0x563e9422ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03dea00640 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563e9422c660 0x563e9422ea50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5be21089bdd0cabd server_cookie=ce65adc3b152a936 in_seq=0 out_seq=0 2024-08-18T22:22:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03c3e00640 10 client.6045 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03c3e00640 1 -- 172.21.15.5:0/1056534885 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e93fbbd30 con 0x563e9422c660 2024-08-18T22:22:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03c3e00640 10 client.6045 handle_command_reply: tid=0 2024-08-18T22:22:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 client.6045 shutdown 2024-08-18T22:22:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 -- 172.21.15.5:0/1056534885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e9421d320 msgr2=0x563e942247d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e9421d320 0x563e942247d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f03c8025060 tx=0x7f03c8000f50 comp rx=0 tx=0).stop 2024-08-18T22:22:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 -- 172.21.15.5:0/1056534885 shutdown_connections 2024-08-18T22:22:38.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563e9422c660 0x563e9422ea50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e94224d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e9421d320 0x563e942247d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 --2- 172.21.15.5:0/1056534885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e941d3de0 0x563e94224290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03c3e00640 0 client.6045 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 -- 172.21.15.5:0/1056534885 >> 172.21.15.5:0/1056534885 conn(0x563e940bb750 msgr2=0x563e941d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 -- 172.21.15.5:0/1056534885 shutdown_connections 2024-08-18T22:22:38.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 1 -- 172.21.15.5:0/1056534885 wait complete. 2024-08-18T22:22:38.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.871+0000 7f03e8f34000 20 client.6045 trim_cache size 0 max 16384 2024-08-18T22:22:38.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03e8f34000 1 Processor -- start 2024-08-18T22:22:38.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03e8f34000 1 -- start start 2024-08-18T22:22:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94289f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e942282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e94228800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03e8f34000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03e0202d20 con 0x563e941d3de0 2024-08-18T22:22:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03e8f34000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f03e01546d0 con 0x563e9421dc40 2024-08-18T22:22:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03e8f34000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03e0154d20 con 0x563e9421d320 2024-08-18T22:22:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03dea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94289f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03dea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94289f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58052/0 (socket says 172.21.15.5:58052) 2024-08-18T22:22:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03dea00640 1 -- 172.21.15.5:0/1411080254 learned_addr learned my addr 172.21.15.5:0/1411080254 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03df400640 1 --2- 172.21.15.5:0/1411080254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e94228800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03d6000640 1 --2- 172.21.15.5:0/1411080254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e942282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03dea00640 1 -- 172.21.15.5:0/1411080254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 msgr2=0x563e942282c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03dea00640 1 --2- 172.21.15.5:0/1411080254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e942282c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03dea00640 1 -- 172.21.15.5:0/1411080254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 msgr2=0x563e94228800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03dea00640 1 --2- 172.21.15.5:0/1411080254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e94228800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03dea00640 1 -- 172.21.15.5:0/1411080254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e9407a5e0 con 0x563e941d3de0 2024-08-18T22:22:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03df400640 1 --2- 172.21.15.5:0/1411080254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e94228800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03d6000640 1 --2- 172.21.15.5:0/1411080254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e942282c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03dea00640 1 --2- 172.21.15.5:0/1411080254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94289f80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f03d00079f0 tx=0x7f03d0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521a84a14d8a5600 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03cea00640 1 -- 172.21.15.5:0/1411080254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0003600 con 0x563e941d3de0 2024-08-18T22:22:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03cea00640 1 -- 172.21.15.5:0/1411080254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d00037a0 con 0x563e941d3de0 2024-08-18T22:22:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.891+0000 7f03cea00640 1 -- 172.21.15.5:0/1411080254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0003950 con 0x563e941d3de0 2024-08-18T22:22:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 -- 172.21.15.5:0/1411080254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 msgr2=0x563e94289f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 --2- 172.21.15.5:0/1411080254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94289f80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f03d00079f0 tx=0x7f03d0012000 comp rx=0 tx=0).stop 2024-08-18T22:22:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 -- 172.21.15.5:0/1411080254 shutdown_connections 2024-08-18T22:22:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 --2- 172.21.15.5:0/1411080254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e94228800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 --2- 172.21.15.5:0/1411080254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e942282c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 --2- 172.21.15.5:0/1411080254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94289f80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 -- 172.21.15.5:0/1411080254 >> 172.21.15.5:0/1411080254 conn(0x563e940bb750 msgr2=0x563e9421c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 -- 172.21.15.5:0/1411080254 shutdown_connections 2024-08-18T22:22:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 -- 172.21.15.5:0/1411080254 wait complete. 2024-08-18T22:22:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 -- start start 2024-08-18T22:22:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 Processor -- start 2024-08-18T22:22:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94290d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e942912a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e942917e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563e93fa6dc0 con 0x563e941d3de0 2024-08-18T22:22:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563e93fda2f0 con 0x563e9421dc40 2024-08-18T22:22:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563e940206a0 con 0x563e9421d320 2024-08-18T22:22:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 10 client.0 _ll_register_callbacks cb 0x7f03c800bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03dea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94290d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03dea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94290d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58056/0 (socket says 172.21.15.5:58056) 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03dea00640 1 -- 172.21.15.5:0/930048090 learned_addr learned my addr 172.21.15.5:0/930048090 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03df400640 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e942917e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03d6000640 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e942912a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03dea00640 1 -- 172.21.15.5:0/930048090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 msgr2=0x563e942912a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03dea00640 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e942912a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03dea00640 1 -- 172.21.15.5:0/930048090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 msgr2=0x563e942917e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03dea00640 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e942917e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03dea00640 1 -- 172.21.15.5:0/930048090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e93fd27d0 con 0x563e941d3de0 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03dea00640 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94290d60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f03d000e530 tx=0x7f03d0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897a0d4f32199e65 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03c3e00640 1 -- 172.21.15.5:0/930048090 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0003c60 con 0x563e941d3de0 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03c3e00640 1 -- 172.21.15.5:0/930048090 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f03d001e040 con 0x563e941d3de0 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 -- 172.21.15.5:0/930048090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03d00037a0 con 0x563e941d3de0 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03c3e00640 1 -- 172.21.15.5:0/930048090 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f03d0003e00 con 0x563e941d3de0 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 10 client.6051 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03e8f34000 1 -- 172.21.15.5:0/930048090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x563e93fc7450 con 0x563e941d3de0 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.895+0000 7f03c3e00640 1 -- 172.21.15.5:0/930048090 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d00037a0 con 0x563e941d3de0 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03c3e00640 1 -- 172.21.15.5:0/930048090 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f03d0037440 con 0x563e941d3de0 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 10 client.6051 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 10 client.6051 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 20 client.6051 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563e9424c530 0x563e9424c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 4 client.6051 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-08-18T22:22:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 -- 172.21.15.5:0/930048090 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x563e9402eac0 con 0x563e9424c530 2024-08-18T22:22:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03d6000640 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563e9424c530 0x563e9424c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03d6000640 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563e9424c530 0x563e9424c940 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebbdea3cd3c6b095 server_cookie=323342763dd4908c in_seq=0 out_seq=0 2024-08-18T22:22:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03c3e00640 10 client.6051 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03c3e00640 1 -- 172.21.15.5:0/930048090 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563e9402eac0 con 0x563e9424c530 2024-08-18T22:22:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03c3e00640 10 client.6051 handle_command_reply: tid=0 2024-08-18T22:22:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 client.6051 shutdown 2024-08-18T22:22:38.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 -- 172.21.15.5:0/930048090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 msgr2=0x563e94290d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94290d60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f03d000e530 tx=0x7f03d0000ee0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.906 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f13fb400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4b [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v449 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5281=0-4194304@1} caps={5281=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5281 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55b68216c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a4b:[<0x10000000001/new_file_1 v449>,<0x10000000000/ceph-qa-suite v57>,<0x1/scrub_test_path v24>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-08-18T22:22:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 -- 172.21.15.5:0/930048090 shutdown_connections 2024-08-18T22:22:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x563e9424c530 0x563e9424c940 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563e9421dc40 0x563e942917e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563e9421d320 0x563e942912a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 --2- 172.21.15.5:0/930048090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e941d3de0 0x563e94290d60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03c3e00640 0 client.6051 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 -- 172.21.15.5:0/930048090 >> 172.21.15.5:0/930048090 conn(0x563e940bb750 msgr2=0x563e94227260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 -- 172.21.15.5:0/930048090 shutdown_connections 2024-08-18T22:22:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 1 -- 172.21.15.5:0/930048090 wait complete. 2024-08-18T22:22:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e8f34000 20 client.6051 trim_cache size 0 max 16384 2024-08-18T22:22:38.907 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:22:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "48445c28-efad-4356-a35d-c041d55f5972", 2024-08-18T22:22:38.908 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:22:38.908 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 -- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03bc0678c0 msgr2=0x7f03bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03bc0678c0 0x7f03bc069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f03d0000f70 tx=0x7f03d0009040 comp rx=0 tx=0).stop 2024-08-18T22:22:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 -- 172.21.15.5:0/1587081242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00ce280 msgr2=0x7f03e00cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00ce280 0x7f03e00cb750 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f03c800bfa0 tx=0x7f03c801b7f0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 -- 172.21.15.5:0/1587081242 shutdown_connections 2024-08-18T22:22:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03bc0678c0 0x7f03bc069d80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03e015b0c0 0x7f03e00ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00ce280 0x7f03e00cb750 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 --2- 172.21.15.5:0/1587081242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03e00b40c0 0x7f03e014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 -- 172.21.15.5:0/1587081242 >> 172.21.15.5:0/1587081242 conn(0x7f03e00b1dc0 msgr2=0x7f03e00ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 -- 172.21.15.5:0/1587081242 shutdown_connections 2024-08-18T22:22:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:38.899+0000 7f03e5a00640 1 -- 172.21.15.5:0/1587081242 wait complete. 2024-08-18T22:22:38.922 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': '48445c28-efad-4356-a35d-c041d55f5972', 'mode': 'asynchronous'}' 2024-08-18T22:22:38.923 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-18T22:22:38.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-08-18T22:22:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8bf800640 1 Processor -- start 2024-08-18T22:22:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8bf800640 1 -- start start 2024-08-18T22:22:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8bf800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8b809aca0 0x7fc8b80afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8bf800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8b80b1300 0x7fc8b80affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8bf800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b806e8a0 con 0x7fc8b809b080 2024-08-18T22:22:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8bf800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b809bb80 con 0x7fc8b80b1300 2024-08-18T22:22:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8bf800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b80d2e40 con 0x7fc8b809aca0 2024-08-18T22:22:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8b7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8b80b1300 0x7fc8b80affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8b7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8b80b1300 0x7fc8b80affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58058/0 (socket says 172.21.15.5:58058) 2024-08-18T22:22:39.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8b7e00640 1 -- 172.21.15.5:0/3322242222 learned_addr learned my addr 172.21.15.5:0/3322242222 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:39.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8bce00640 1 --2- 172.21.15.5:0/3322242222 >> v2:172.21.15.117:3300/0 conn(0x7fc8b809aca0 0x7fc8b80afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8b7e00640 1 -- 172.21.15.5:0/3322242222 >> v2:172.21.15.117:3300/0 conn(0x7fc8b809aca0 msgr2=0x7fc8b80afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:39.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8b7e00640 1 --2- 172.21.15.5:0/3322242222 >> v2:172.21.15.117:3300/0 conn(0x7fc8b809aca0 0x7fc8b80afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8b7e00640 1 -- 172.21.15.5:0/3322242222 >> v1:172.21.15.117:6789/0 conn(0x7fc8b809b080 legacy=0x7fc8b80b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:39.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.063+0000 7fc8b7e00640 1 -- 172.21.15.5:0/3322242222 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b806cbd0 con 0x7fc8b80b1300 2024-08-18T22:22:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8b7e00640 1 --2- 172.21.15.5:0/3322242222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b80b1300 0x7fc8b80affd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc8b806f260 tx=0x7fc8a401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccf35fd1c871574 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8b7400640 1 -- 172.21.15.5:0/3322242222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40b1070 con 0x7fc8b80b1300 2024-08-18T22:22:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8b7400640 1 -- 172.21.15.5:0/3322242222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a40ac630 con 0x7fc8b80b1300 2024-08-18T22:22:39.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8b7400640 1 -- 172.21.15.5:0/3322242222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40a8050 con 0x7fc8b80b1300 2024-08-18T22:22:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8bf800640 1 -- 172.21.15.5:0/3322242222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b80b1300 msgr2=0x7fc8b80affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8bf800640 1 --2- 172.21.15.5:0/3322242222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b80b1300 0x7fc8b80affd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc8b806f260 tx=0x7fc8a401c520 comp rx=0 tx=0).stop 2024-08-18T22:22:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8bf800640 1 -- 172.21.15.5:0/3322242222 shutdown_connections 2024-08-18T22:22:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8bf800640 1 --2- 172.21.15.5:0/3322242222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b80b1300 0x7fc8b80affd0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8bf800640 1 --2- 172.21.15.5:0/3322242222 >> v2:172.21.15.117:3300/0 conn(0x7fc8b809aca0 0x7fc8b80afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8bf800640 1 -- 172.21.15.5:0/3322242222 >> 172.21.15.5:0/3322242222 conn(0x7fc8b80d2180 msgr2=0x7fc8b80d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8bf800640 1 -- 172.21.15.5:0/3322242222 shutdown_connections 2024-08-18T22:22:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8bf800640 1 -- 172.21.15.5:0/3322242222 wait complete. 2024-08-18T22:22:39.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8bf800640 1 Processor -- start 2024-08-18T22:22:39.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.067+0000 7fc8bf800640 1 -- start start 2024-08-18T22:22:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bf800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b809aca0 0x7fc8b8155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bf800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b809b080 0x7fc8b81555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bf800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b80b1300 0x7fc8b8155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bf800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b816b6b0 con 0x7fc8b80b1300 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bf800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b816b530 con 0x7fc8b809b080 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bf800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b816b830 con 0x7fc8b809aca0 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b80b1300 0x7fc8b8155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bce00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b809aca0 0x7fc8b8155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b80b1300 0x7fc8b8155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58074/0 (socket says 172.21.15.5:58074) 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bd800640 1 -- 172.21.15.5:0/3797968696 learned_addr learned my addr 172.21.15.5:0/3797968696 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8b7e00640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b809b080 0x7fc8b81555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bd800640 1 -- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b809aca0 msgr2=0x7fc8b8155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bd800640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b809aca0 0x7fc8b8155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bd800640 1 -- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b809b080 msgr2=0x7fc8b81555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bd800640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b809b080 0x7fc8b81555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bd800640 1 -- 172.21.15.5:0/3797968696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b8150dc0 con 0x7fc8b80b1300 2024-08-18T22:22:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bd800640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b80b1300 0x7fc8b8155b00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000c7a0 tx=0x7fc8b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8b4c00640 1 -- 172.21.15.5:0/3797968696 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0003b80 con 0x7fc8b80b1300 2024-08-18T22:22:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8b4c00640 1 -- 172.21.15.5:0/3797968696 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b0003d20 con 0x7fc8b80b1300 2024-08-18T22:22:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8b4c00640 1 -- 172.21.15.5:0/3797968696 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000aa90 con 0x7fc8b80b1300 2024-08-18T22:22:39.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bf800640 1 -- 172.21.15.5:0/3797968696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b80b27a0 con 0x7fc8b80b1300 2024-08-18T22:22:39.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.071+0000 7fc8bf800640 1 -- 172.21.15.5:0/3797968696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b81508c0 con 0x7fc8b80b1300 2024-08-18T22:22:39.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8b4c00640 1 -- 172.21.15.5:0/3797968696 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc8b000ac30 con 0x7fc8b80b1300 2024-08-18T22:22:39.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8b4c00640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8980678f0 0x7fc898069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8b4c00640 1 -- 172.21.15.5:0/3797968696 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fc8b0085c70 con 0x7fc8b80b1300 2024-08-18T22:22:39.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8c2cd7000 1 Processor -- start 2024-08-18T22:22:39.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bce00640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8980678f0 0x7fc898069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8c2cd7000 1 -- start start 2024-08-18T22:22:39.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bce00640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8980678f0 0x7fc898069db0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009b60 tx=0x7fc8ac009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:39.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995db9a0 0x555b995dbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b995dc2c0 0x555b9958efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b9958f500 0x555b9958f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555b99478ae0 con 0x555b9958f500 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555b99464ba0 con 0x555b995db9a0 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555b993df4f0 con 0x555b995dc2c0 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b9958f500 0x555b9958f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b9958f500 0x555b9958f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58078/0 (socket says 172.21.15.5:58078) 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bd800640 1 -- 172.21.15.5:0/2795119617 learned_addr learned my addr 172.21.15.5:0/2795119617 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8b7e00640 1 --2- 172.21.15.5:0/2795119617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b995dc2c0 0x555b9958efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bce00640 1 --2- 172.21.15.5:0/2795119617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995db9a0 0x555b995dbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bd800640 1 -- 172.21.15.5:0/2795119617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b995dc2c0 msgr2=0x555b9958efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bd800640 1 --2- 172.21.15.5:0/2795119617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b995dc2c0 0x555b9958efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bd800640 1 -- 172.21.15.5:0/2795119617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995db9a0 msgr2=0x555b995dbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bd800640 1 --2- 172.21.15.5:0/2795119617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995db9a0 0x555b995dbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bd800640 1 -- 172.21.15.5:0/2795119617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b9937fa90 con 0x555b9958f500 2024-08-18T22:22:39.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8bd800640 1 --2- 172.21.15.5:0/2795119617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b9958f500 0x555b9958f8e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc8b005e530 tx=0x7fc8b000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a152df408a353cd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:39.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8a9600640 1 -- 172.21.15.5:0/2795119617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b005ea60 con 0x555b9958f500 2024-08-18T22:22:39.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8a9600640 1 -- 172.21.15.5:0/2795119617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b0054230 con 0x555b9958f500 2024-08-18T22:22:39.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8a9600640 1 -- 172.21.15.5:0/2795119617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0055380 con 0x555b9958f500 2024-08-18T22:22:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/2795119617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b9958f500 msgr2=0x555b9958f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.075+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/2795119617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b9958f500 0x555b9958f8e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc8b005e530 tx=0x7fc8b000f000 comp rx=0 tx=0).stop 2024-08-18T22:22:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/2795119617 shutdown_connections 2024-08-18T22:22:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/2795119617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b9958f500 0x555b9958f8e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/2795119617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b995dc2c0 0x555b9958efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/2795119617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995db9a0 0x555b995dbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/2795119617 >> 172.21.15.5:0/2795119617 conn(0x555b99589010 msgr2=0x555b995be820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/2795119617 shutdown_connections 2024-08-18T22:22:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/2795119617 wait complete. 2024-08-18T22:22:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 -- start start 2024-08-18T22:22:39.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 Processor -- start 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b9958f500 0x555b995bc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b995db9a0 0x555b99597070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995975b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555b993db4b0 con 0x555b995dc2c0 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555b99399b50 con 0x555b9958f500 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555b99380d00 con 0x555b995db9a0 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 10 client.0 _ll_register_callbacks cb 0x555b9957cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8bd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8bd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995975b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58088/0 (socket says 172.21.15.5:58088) 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8bd800640 1 -- 172.21.15.5:0/1095489200 learned_addr learned my addr 172.21.15.5:0/1095489200 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8bce00640 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b9958f500 0x555b995bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8b7e00640 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b995db9a0 0x555b99597070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8bd800640 1 -- 172.21.15.5:0/1095489200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b995db9a0 msgr2=0x555b99597070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8bd800640 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b995db9a0 0x555b99597070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8bd800640 1 -- 172.21.15.5:0/1095489200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b9958f500 msgr2=0x555b995bc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8bd800640 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b9958f500 0x555b995bc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8bd800640 1 -- 172.21.15.5:0/1095489200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b99398060 con 0x555b995dc2c0 2024-08-18T22:22:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8bd800640 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995975b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc8b005e530 tx=0x7fc8b0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cc86f34a316d34 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc89e000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc89e000640 1 -- 172.21.15.5:0/1095489200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0072070 con 0x555b995dc2c0 2024-08-18T22:22:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc89e000640 1 -- 172.21.15.5:0/1095489200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fc8b0074310 con 0x555b995dc2c0 2024-08-18T22:22:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1095489200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8b0054230 con 0x555b995dc2c0 2024-08-18T22:22:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc89e000640 1 -- 172.21.15.5:0/1095489200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc8b005ea60 con 0x555b995dc2c0 2024-08-18T22:22:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 10 client.6063 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1095489200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x555b993abf50 con 0x555b995dc2c0 2024-08-18T22:22:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc89e000640 1 -- 172.21.15.5:0/1095489200 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b0054230 con 0x555b995dc2c0 2024-08-18T22:22:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc89e000640 1 -- 172.21.15.5:0/1095489200 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fc8b007d3d0 con 0x555b995dc2c0 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 10 client.6063 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 10 client.6063 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 20 client.6063 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555b995bdd30 0x555b995be110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 4 client.6063 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.079+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1095489200 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b99379e10 con 0x555b995bdd30 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8bce00640 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555b995bdd30 0x555b995be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8bce00640 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555b995bdd30 0x555b995be110 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=744264ca14c63fe3 server_cookie=f7769c30ba3a0923 in_seq=0 out_seq=0 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc89e000640 10 client.6063 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc89e000640 1 -- 172.21.15.5:0/1095489200 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b99379e10 con 0x555b995bdd30 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc89e000640 10 client.6063 handle_command_reply: tid=0 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 1 client.6063 shutdown 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1095489200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 msgr2=0x555b995975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:39.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995975b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc8b005e530 tx=0x7fc8b0001260 comp rx=0 tx=0).stop 2024-08-18T22:22:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1095489200 shutdown_connections 2024-08-18T22:22:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555b995bdd30 0x555b995be110 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995975b0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b995db9a0 0x555b99597070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc89e000640 0 client.6063 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1095489200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b9958f500 0x555b995bc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1095489200 >> 172.21.15.5:0/1095489200 conn(0x555b99589010 msgr2=0x555b9958e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1095489200 shutdown_connections 2024-08-18T22:22:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1095489200 wait complete. 2024-08-18T22:22:39.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.083+0000 7fc8c2cd7000 20 client.6063 trim_cache size 0 max 16384 2024-08-18T22:22:39.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.099+0000 7fc8c2cd7000 1 Processor -- start 2024-08-18T22:22:39.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.099+0000 7fc8c2cd7000 1 -- start start 2024-08-18T22:22:39.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b9958f500 0x555b995f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995db9a0 0x555b995bcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995bd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8203ff0 con 0x555b995dc2c0 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8202ff0 con 0x555b995db9a0 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b814fb80 con 0x555b9958f500 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8bd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995bd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8bd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995bd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58090/0 (socket says 172.21.15.5:58090) 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8bd800640 1 -- 172.21.15.5:0/796986967 learned_addr learned my addr 172.21.15.5:0/796986967 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8bce00640 1 --2- 172.21.15.5:0/796986967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b9958f500 0x555b995f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8b7e00640 1 --2- 172.21.15.5:0/796986967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995db9a0 0x555b995bcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8bd800640 1 -- 172.21.15.5:0/796986967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b9958f500 msgr2=0x555b995f32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8bd800640 1 --2- 172.21.15.5:0/796986967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b9958f500 0x555b995f32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8bd800640 1 -- 172.21.15.5:0/796986967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995db9a0 msgr2=0x555b995bcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8bd800640 1 --2- 172.21.15.5:0/796986967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995db9a0 0x555b995bcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8bd800640 1 -- 172.21.15.5:0/796986967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b99461dd0 con 0x555b995dc2c0 2024-08-18T22:22:39.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8bd800640 1 --2- 172.21.15.5:0/796986967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995bd150 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc8b005a3f0 tx=0x7fc8b0083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed17f2f9ca4b524 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:39.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8a8c00640 1 -- 172.21.15.5:0/796986967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0054230 con 0x555b995dc2c0 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8a8c00640 1 -- 172.21.15.5:0/796986967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b0062070 con 0x555b995dc2c0 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8a8c00640 1 -- 172.21.15.5:0/796986967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0074310 con 0x555b995dc2c0 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/796986967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 msgr2=0x555b995bd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/796986967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995bd150 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc8b005a3f0 tx=0x7fc8b0083000 comp rx=0 tx=0).stop 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/796986967 shutdown_connections 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/796986967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995dc2c0 0x555b995bd150 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/796986967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995db9a0 0x555b995bcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/796986967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b9958f500 0x555b995f32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/796986967 >> 172.21.15.5:0/796986967 conn(0x555b99589010 msgr2=0x555b995bc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/796986967 shutdown_connections 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/796986967 wait complete. 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 -- start start 2024-08-18T22:22:39.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 Processor -- start 2024-08-18T22:22:39.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.103+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b9958f500 0x555b9964f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995db9a0 0x555b9964f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995dc2c0 0x555b9964fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555b99461940 con 0x555b995db9a0 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555b993ba7a0 con 0x555b995dc2c0 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555b993df4f0 con 0x555b9958f500 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 10 client.0 _ll_register_callbacks cb 0x7fc8ac009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8b7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995db9a0 0x555b9964f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8bce00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b9958f500 0x555b9964f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8b7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995db9a0 0x555b9964f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58096/0 (socket says 172.21.15.5:58096) 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8b7e00640 1 -- 172.21.15.5:0/1446585307 learned_addr learned my addr 172.21.15.5:0/1446585307 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8bd800640 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995dc2c0 0x555b9964fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8b7e00640 1 -- 172.21.15.5:0/1446585307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b9958f500 msgr2=0x555b9964f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8b7e00640 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b9958f500 0x555b9964f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8b7e00640 1 -- 172.21.15.5:0/1446585307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995dc2c0 msgr2=0x555b9964fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:39.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8b7e00640 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995dc2c0 0x555b9964fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8b7e00640 1 -- 172.21.15.5:0/1446585307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b99372cd0 con 0x555b995db9a0 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8b7e00640 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995db9a0 0x555b9964f580 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc8a401ca00 tx=0x7fc8a40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19770e4548e52e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc89e000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc89e000640 1 -- 172.21.15.5:0/1446585307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40c6060 con 0x555b995db9a0 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc89e000640 1 -- 172.21.15.5:0/1446585307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fc8a40acdc0 con 0x555b995db9a0 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1446585307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8b0062070 con 0x555b995db9a0 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc89e000640 1 -- 172.21.15.5:0/1446585307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc8a40cc050 con 0x555b995db9a0 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 10 client.6069 fetch_fsmap learned FSMap version 27 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1446585307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x555b99385320 con 0x555b995db9a0 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc89e000640 1 -- 172.21.15.5:0/1446585307 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b0062070 con 0x555b995db9a0 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc89e000640 1 -- 172.21.15.5:0/1446585307 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fc8a40cf020 con 0x555b995db9a0 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 10 client.6069 fetch_fsmap finished waiting for FSMap version 27 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 10 client.6069 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 20 client.6069 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555b995f0d10 0x555b995f1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 4 client.6069 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1446585307 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555b993ecc20 con 0x555b995f0d10 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8bce00640 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555b995f0d10 0x555b995f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8bce00640 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555b995f0d10 0x555b995f1120 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1f4a49f20f7b6b0 server_cookie=982bea54f59da334 in_seq=0 out_seq=0 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc89e000640 10 client.6069 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc89e000640 1 -- 172.21.15.5:0/1446585307 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+903 (crc 0 0 0) 0x555b993ecc20 con 0x555b995f0d10 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc89e000640 10 client.6069 handle_command_reply: tid=0 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 client.6069 shutdown 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1446585307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995db9a0 msgr2=0x555b9964f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995db9a0 0x555b9964f580 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc8a401ca00 tx=0x7fc8a40046d0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1446585307 shutdown_connections 2024-08-18T22:22:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555b995f0d10 0x555b995f1120 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b995dc2c0 0x555b9964fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b995db9a0 0x555b9964f580 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 --2- 172.21.15.5:0/1446585307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b9958f500 0x555b9964f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1446585307 >> 172.21.15.5:0/1446585307 conn(0x555b99589010 msgr2=0x555b995bcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:39.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc89e000640 0 client.6069 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:39.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1446585307 shutdown_connections 2024-08-18T22:22:39.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 1 -- 172.21.15.5:0/1446585307 wait complete. 2024-08-18T22:22:39.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.107+0000 7fc8c2cd7000 20 client.6069 trim_cache size 0 max 16384 2024-08-18T22:22:39.117 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-18T22:22:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-18T22:22:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "1a93caaf-753b-4f09-998b-0fc2226ab62e": { 2024-08-18T22:22:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-08-18T22:22:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "1a93caaf-753b-4f09-998b-0fc2226ab62e", 2024-08-18T22:22:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-08-18T22:22:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "2abdf81f-e49e-4c07-90b5-dc03abb04a45": { 2024-08-18T22:22:39.117 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "2abdf81f-e49e-4c07-90b5-dc03abb04a45", 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "48445c28-efad-4356-a35d-c041d55f5972": { 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "48445c28-efad-4356-a35d-c041d55f5972", 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "d3d812d8-0737-4ae2-adf0-22398b502dd7": { 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "d3d812d8-0737-4ae2-adf0-22398b502dd7", 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "" 2024-08-18T22:22:39.118 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:39.119 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:39.119 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:39.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 -- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8980678f0 msgr2=0x7fc898069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:39.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8980678f0 0x7fc898069db0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009b60 tx=0x7fc8ac009190 comp rx=0 tx=0).stop 2024-08-18T22:22:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 -- 172.21.15.5:0/3797968696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b80b1300 msgr2=0x7fc8b8155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b80b1300 0x7fc8b8155b00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000c7a0 tx=0x7fc8b000cc60 comp rx=0 tx=0).stop 2024-08-18T22:22:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 -- 172.21.15.5:0/3797968696 shutdown_connections 2024-08-18T22:22:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8980678f0 0x7fc898069db0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8b80b1300 0x7fc8b8155b00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b809b080 0x7fc8b81555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 --2- 172.21.15.5:0/3797968696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b809aca0 0x7fc8b8155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 -- 172.21.15.5:0/3797968696 >> 172.21.15.5:0/3797968696 conn(0x7fc8b80d2180 msgr2=0x7fc8b806fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 -- 172.21.15.5:0/3797968696 shutdown_connections 2024-08-18T22:22:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:39.111+0000 7fc8bf800640 1 -- 172.21.15.5:0/3797968696 wait complete. 2024-08-18T22:22:44.133 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-18T22:22:44.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-08-18T22:22:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.283+0000 7f3b57600640 1 Processor -- start 2024-08-18T22:22:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.283+0000 7f3b57600640 1 -- start start 2024-08-18T22:22:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b57600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5015c180 0x7f3b500cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b57600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b5015c560 0x7f3b500ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b57600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b5015d4d0 0x7f3b500ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b57600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5015d040 con 0x7f3b5015c560 2024-08-18T22:22:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b57600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3b500cfb00 con 0x7f3b5015d4d0 2024-08-18T22:22:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b57600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5015c9f0 con 0x7f3b5015c180 2024-08-18T22:22:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b4fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b5015c560 0x7f3b500ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b4fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b5015c560 0x7f3b500ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55542/0 (socket says 172.21.15.5:55542) 2024-08-18T22:22:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b4fe00640 1 -- 172.21.15.5:0/280416452 learned_addr learned my addr 172.21.15.5:0/280416452 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b55600640 1 --2- 172.21.15.5:0/280416452 >> v2:172.21.15.117:3300/0 conn(0x7f3b5015d4d0 0x7f3b500ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b54c00640 1 --2- 172.21.15.5:0/280416452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5015c180 0x7f3b500cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b4fe00640 1 -- 172.21.15.5:0/280416452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5015c180 msgr2=0x7f3b500cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/280416452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5015c180 0x7f3b500cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b4fe00640 1 -- 172.21.15.5:0/280416452 >> v2:172.21.15.117:3300/0 conn(0x7f3b5015d4d0 msgr2=0x7f3b500ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/280416452 >> v2:172.21.15.117:3300/0 conn(0x7f3b5015d4d0 0x7f3b500ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b4fe00640 1 -- 172.21.15.5:0/280416452 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5015ccd0 con 0x7f3b5015c560 2024-08-18T22:22:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.287+0000 7f3b54c00640 1 --2- 172.21.15.5:0/280416452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5015c180 0x7f3b500cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/280416452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5015c560 0x7f3b500ce450 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3b5006d2e0 tx=0x7f3b3c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccb3e1e338baaa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b4f400640 1 -- 172.21.15.5:0/280416452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0a7070 con 0x7f3b5015c560 2024-08-18T22:22:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b4f400640 1 -- 172.21.15.5:0/280416452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c0b0070 con 0x7f3b5015c560 2024-08-18T22:22:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b4f400640 1 -- 172.21.15.5:0/280416452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0ab890 con 0x7f3b5015c560 2024-08-18T22:22:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b57600640 1 -- 172.21.15.5:0/280416452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5015c560 msgr2=0x7f3b500ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b57600640 1 --2- 172.21.15.5:0/280416452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5015c560 0x7f3b500ce450 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3b5006d2e0 tx=0x7f3b3c01c490 comp rx=0 tx=0).stop 2024-08-18T22:22:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b57600640 1 -- 172.21.15.5:0/280416452 shutdown_connections 2024-08-18T22:22:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b57600640 1 --2- 172.21.15.5:0/280416452 >> v2:172.21.15.117:3300/0 conn(0x7f3b5015d4d0 0x7f3b500ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b57600640 1 --2- 172.21.15.5:0/280416452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5015c560 0x7f3b500ce450 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b57600640 1 --2- 172.21.15.5:0/280416452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5015c180 0x7f3b500cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b57600640 1 -- 172.21.15.5:0/280416452 >> 172.21.15.5:0/280416452 conn(0x7f3b500b1dc0 msgr2=0x7f3b500b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b57600640 1 -- 172.21.15.5:0/280416452 shutdown_connections 2024-08-18T22:22:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b57600640 1 -- 172.21.15.5:0/280416452 wait complete. 2024-08-18T22:22:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b57600640 1 Processor -- start 2024-08-18T22:22:44.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.291+0000 7f3b57600640 1 -- start start 2024-08-18T22:22:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b57600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5015c180 0x7f3b5014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b57600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b5015d4d0 0x7f3b50152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b57600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b501507a0 0x7f3b5006db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b57600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b50160930 con 0x7f3b501507a0 2024-08-18T22:22:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b57600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b501607b0 con 0x7f3b5015d4d0 2024-08-18T22:22:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b57600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3b50160ab0 con 0x7f3b5015c180 2024-08-18T22:22:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b55600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b501507a0 0x7f3b5006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b55600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b501507a0 0x7f3b5006db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55544/0 (socket says 172.21.15.5:55544) 2024-08-18T22:22:44.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b55600640 1 -- 172.21.15.5:0/13303343 learned_addr learned my addr 172.21.15.5:0/13303343 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b5015d4d0 0x7f3b50152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b54c00640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5015c180 0x7f3b5014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b55600640 1 -- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5015c180 msgr2=0x7f3b5014ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b55600640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5015c180 0x7f3b5014ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b55600640 1 -- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b5015d4d0 msgr2=0x7f3b50152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b55600640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b5015d4d0 0x7f3b50152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b55600640 1 -- 172.21.15.5:0/13303343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5014f270 con 0x7f3b501507a0 2024-08-18T22:22:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b55600640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b501507a0 0x7f3b5006db80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3b48007de0 tx=0x7f3b4800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b4cc00640 1 -- 172.21.15.5:0/13303343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48014620 con 0x7f3b501507a0 2024-08-18T22:22:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b4cc00640 1 -- 172.21.15.5:0/13303343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b48019070 con 0x7f3b501507a0 2024-08-18T22:22:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b4cc00640 1 -- 172.21.15.5:0/13303343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48014a20 con 0x7f3b501507a0 2024-08-18T22:22:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b57600640 1 -- 172.21.15.5:0/13303343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5014f550 con 0x7f3b501507a0 2024-08-18T22:22:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.295+0000 7f3b57600640 1 -- 172.21.15.5:0/13303343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5014fb10 con 0x7f3b501507a0 2024-08-18T22:22:44.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b4cc00640 1 -- 172.21.15.5:0/13303343 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3b48014bc0 con 0x7f3b501507a0 2024-08-18T22:22:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b4cc00640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b300678c0 0x7f3b30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b4cc00640 1 -- 172.21.15.5:0/13303343 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f3b48086650 con 0x7f3b501507a0 2024-08-18T22:22:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b5a9eb000 1 Processor -- start 2024-08-18T22:22:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b54c00640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b300678c0 0x7f3b30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b5a9eb000 1 -- start start 2024-08-18T22:22:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b54c00640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b300678c0 0x7f3b30069d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3b50152320 tx=0x7f3b40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab22bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1defc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab1df8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555cab0c8ae0 con 0x555cab22c2c0 2024-08-18T22:22:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555cab0b4ba0 con 0x555cab1df500 2024-08-18T22:22:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555cab02f4f0 con 0x555cab22b9a0 2024-08-18T22:22:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1defc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b54c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab22bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1defc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55548/0 (socket says 172.21.15.5:55548) 2024-08-18T22:22:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b4fe00640 1 -- 172.21.15.5:0/470315493 learned_addr learned my addr 172.21.15.5:0/470315493 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b54c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab22bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:35378/0 (socket says 172.21.15.5:35378) 2024-08-18T22:22:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b55600640 1 --2- 172.21.15.5:0/470315493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab1df8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b4fe00640 1 -- 172.21.15.5:0/470315493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 msgr2=0x555cab22bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/470315493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab22bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b4fe00640 1 -- 172.21.15.5:0/470315493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 msgr2=0x555cab1df8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/470315493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab1df8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.299+0000 7f3b4fe00640 1 -- 172.21.15.5:0/470315493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555caafcfa90 con 0x555cab22c2c0 2024-08-18T22:22:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/470315493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1defc0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c01cd30 tx=0x7f3b3c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409f4d7c32b5296 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b45600640 1 -- 172.21.15.5:0/470315493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0abb40 con 0x555cab22c2c0 2024-08-18T22:22:44.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b45600640 1 -- 172.21.15.5:0/470315493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c0b0040 con 0x555cab22c2c0 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b45600640 1 -- 172.21.15.5:0/470315493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0bf450 con 0x555cab22c2c0 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/470315493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 msgr2=0x555cab1defc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/470315493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1defc0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c01cd30 tx=0x7f3b3c004740 comp rx=0 tx=0).stop 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/470315493 shutdown_connections 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/470315493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab1df8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/470315493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1defc0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/470315493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab22bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/470315493 >> 172.21.15.5:0/470315493 conn(0x555cab1d9010 msgr2=0x555cab20e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/470315493 shutdown_connections 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/470315493 wait complete. 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 -- start start 2024-08-18T22:22:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 Processor -- start 2024-08-18T22:22:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab20c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab1e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1e75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555cab02b4b0 con 0x555cab22c2c0 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555caafe9b50 con 0x555cab1df500 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555caafd0d00 con 0x555cab22b9a0 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b5a9eb000 10 client.0 _ll_register_callbacks cb 0x555cab1ccf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b55600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1e75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b55600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1e75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55556/0 (socket says 172.21.15.5:55556) 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b55600640 1 -- 172.21.15.5:0/237018316 learned_addr learned my addr 172.21.15.5:0/237018316 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b54c00640 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab20c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab1e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b55600640 1 -- 172.21.15.5:0/237018316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 msgr2=0x555cab1e70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b55600640 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab1e70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b55600640 1 -- 172.21.15.5:0/237018316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 msgr2=0x555cab20c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b55600640 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab20c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.303+0000 7f3b55600640 1 -- 172.21.15.5:0/237018316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555caafe8060 con 0x555cab22c2c0 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b55600640 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1e75f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3b480849e0 tx=0x7f3b4805ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363a343ff590956c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b3a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b3a000640 1 -- 172.21.15.5:0/237018316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4805f040 con 0x555cab22c2c0 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b3a000640 1 -- 172.21.15.5:0/237018316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f3b4805f1e0 con 0x555cab22c2c0 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/237018316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3c0b0040 con 0x555cab22c2c0 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b3a000640 1 -- 172.21.15.5:0/237018316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b4806eb50 con 0x555cab22c2c0 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 10 client.6081 fetch_fsmap learned FSMap version 28 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/237018316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x555caaffbf50 con 0x555cab22c2c0 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b3a000640 1 -- 172.21.15.5:0/237018316 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c0b0040 con 0x555cab22c2c0 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b3a000640 1 -- 172.21.15.5:0/237018316 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f3b48055df0 con 0x555cab22c2c0 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 10 client.6081 fetch_fsmap finished waiting for FSMap version 28 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 10 client.6081 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 20 client.6081 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555cab20e0c0 0x555cab23dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 4 client.6081 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/237018316 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555caafc9e10 con 0x555cab20e0c0 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b54c00640 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555cab20e0c0 0x555cab23dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b3a000640 10 client.6081 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b54c00640 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555cab20e0c0 0x555cab23dc60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af7dfc06326eeee server_cookie=18d533e8c731977a in_seq=0 out_seq=0 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b3a000640 1 -- 172.21.15.5:0/237018316 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555caafc9e10 con 0x555cab20e0c0 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b3a000640 10 client.6081 handle_command_reply: tid=0 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 client.6081 shutdown 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/237018316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 msgr2=0x555cab1e75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1e75f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3b480849e0 tx=0x7f3b4805ad70 comp rx=0 tx=0).stop 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/237018316 shutdown_connections 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555cab20e0c0 0x555cab23dc60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab1e75f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab1e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/237018316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab20c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b3a000640 0 client.6081 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:44.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/237018316 >> 172.21.15.5:0/237018316 conn(0x555cab1d9010 msgr2=0x555cab1de6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/237018316 shutdown_connections 2024-08-18T22:22:44.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/237018316 wait complete. 2024-08-18T22:22:44.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.307+0000 7f3b5a9eb000 20 client.6081 trim_cache size 0 max 16384 2024-08-18T22:22:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 Processor -- start 2024-08-18T22:22:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 -- start start 2024-08-18T22:22:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab2413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22b9a0 0x555cab240060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22c2c0 0x555cab2405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b50201850 con 0x555cab22b9a0 2024-08-18T22:22:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b50200890 con 0x555cab1df500 2024-08-18T22:22:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3b50153c10 con 0x555cab22c2c0 2024-08-18T22:22:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22b9a0 0x555cab240060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22b9a0 0x555cab240060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55562/0 (socket says 172.21.15.5:55562) 2024-08-18T22:22:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b4fe00640 1 -- 172.21.15.5:0/2634653847 learned_addr learned my addr 172.21.15.5:0/2634653847 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b4fe00640 1 -- 172.21.15.5:0/2634653847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22c2c0 msgr2=0x555cab2405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/2634653847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22c2c0 0x555cab2405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b4fe00640 1 -- 172.21.15.5:0/2634653847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 msgr2=0x555cab2413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/2634653847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab2413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b4fe00640 1 -- 172.21.15.5:0/2634653847 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cab0b1dd0 con 0x555cab22b9a0 2024-08-18T22:22:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/2634653847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22b9a0 0x555cab240060 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c01a0c0 tx=0x7f3b3c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b366267c213b590d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b44c00640 1 -- 172.21.15.5:0/2634653847 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0c6070 con 0x555cab22b9a0 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b44c00640 1 -- 172.21.15.5:0/2634653847 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c0b0040 con 0x555cab22b9a0 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b44c00640 1 -- 172.21.15.5:0/2634653847 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c004430 con 0x555cab22b9a0 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/2634653847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22b9a0 msgr2=0x555cab240060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/2634653847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22b9a0 0x555cab240060 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c01a0c0 tx=0x7f3b3c009240 comp rx=0 tx=0).stop 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/2634653847 shutdown_connections 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/2634653847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22c2c0 0x555cab2405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/2634653847 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22b9a0 0x555cab240060 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/2634653847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab2413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/2634653847 >> 172.21.15.5:0/2634653847 conn(0x555cab1d9010 msgr2=0x555cab239130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.327+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/2634653847 shutdown_connections 2024-08-18T22:22:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/2634653847 wait complete. 2024-08-18T22:22:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 -- start start 2024-08-18T22:22:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 Processor -- start 2024-08-18T22:22:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab2a3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab2a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab2a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555cab0092c0 con 0x555cab22c2c0 2024-08-18T22:22:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555cab0ec240 con 0x555cab1df500 2024-08-18T22:22:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555cab02e800 con 0x555cab22b9a0 2024-08-18T22:22:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 10 client.0 _ll_register_callbacks cb 0x7f3b48004a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b55600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab2a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b55600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab2a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55576/0 (socket says 172.21.15.5:55576) 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b55600640 1 -- 172.21.15.5:0/3533859417 learned_addr learned my addr 172.21.15.5:0/3533859417 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b54c00640 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab2a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b4fe00640 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab2a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b55600640 1 -- 172.21.15.5:0/3533859417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 msgr2=0x555cab2a3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b55600640 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab2a3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b55600640 1 -- 172.21.15.5:0/3533859417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 msgr2=0x555cab2a3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b55600640 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab2a3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b55600640 1 -- 172.21.15.5:0/3533859417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555caafc2cd0 con 0x555cab22c2c0 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b55600640 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab2a43e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800c040 tx=0x7f3b48007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dcf9ff25d35aa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b3a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b3a000640 1 -- 172.21.15.5:0/3533859417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b480569a0 con 0x555cab22c2c0 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b3a000640 1 -- 172.21.15.5:0/3533859417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f3b480526f0 con 0x555cab22c2c0 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/3533859417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3c0b0040 con 0x555cab22c2c0 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b3a000640 1 -- 172.21.15.5:0/3533859417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b480528f0 con 0x555cab22c2c0 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 10 client.6087 fetch_fsmap learned FSMap version 28 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/3533859417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x555caafd5320 con 0x555cab22c2c0 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b3a000640 1 -- 172.21.15.5:0/3533859417 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c0b0040 con 0x555cab22c2c0 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b3a000640 1 -- 172.21.15.5:0/3533859417 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f3b48078060 con 0x555cab22c2c0 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 10 client.6087 fetch_fsmap finished waiting for FSMap version 28 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 10 client.6087 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 20 client.6087 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555cab25f580 0x555cab25f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 4 client.6087 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:22:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/3533859417 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555cab03cc20 con 0x555cab25f580 2024-08-18T22:22:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.331+0000 7f3b54c00640 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555cab25f580 0x555cab25f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b54c00640 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555cab25f580 0x555cab25f990 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9ed5dddd5a8da24 server_cookie=ca47ec2f46a9b290 in_seq=0 out_seq=0 2024-08-18T22:22:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b3a000640 10 client.6087 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b3a000640 1 -- 172.21.15.5:0/3533859417 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555cab03cc20 con 0x555cab25f580 2024-08-18T22:22:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b3a000640 10 client.6087 handle_command_reply: tid=0 2024-08-18T22:22:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 1 client.6087 shutdown 2024-08-18T22:22:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/3533859417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 msgr2=0x555cab2a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab2a43e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800c040 tx=0x7f3b48007040 comp rx=0 tx=0).stop 2024-08-18T22:22:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/3533859417 shutdown_connections 2024-08-18T22:22:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x555cab25f580 0x555cab25f990 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555cab22c2c0 0x555cab2a43e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555cab22b9a0 0x555cab2a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 1 --2- 172.21.15.5:0/3533859417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cab1df500 0x555cab2a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b3a000640 0 client.6087 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/3533859417 >> 172.21.15.5:0/3533859417 conn(0x555cab1d9010 msgr2=0x555cab20c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/3533859417 shutdown_connections 2024-08-18T22:22:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 1 -- 172.21.15.5:0/3533859417 wait complete. 2024-08-18T22:22:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b5a9eb000 20 client.6087 trim_cache size 0 max 16384 2024-08-18T22:22:44.342 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:44.343 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-18T22:22:44.343 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-08-18T22:22:44.343 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 -- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b300678c0 msgr2=0x7f3b30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b300678c0 0x7f3b30069d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3b50152320 tx=0x7f3b40008040 comp rx=0 tx=0).stop 2024-08-18T22:22:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 -- 172.21.15.5:0/13303343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b501507a0 msgr2=0x7f3b5006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b501507a0 0x7f3b5006db80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3b48007de0 tx=0x7f3b4800e4b0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 -- 172.21.15.5:0/13303343 shutdown_connections 2024-08-18T22:22:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3b300678c0 0x7f3b30069d80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b501507a0 0x7f3b5006db80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b5015d4d0 0x7f3b50152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 --2- 172.21.15.5:0/13303343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5015c180 0x7f3b5014ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 -- 172.21.15.5:0/13303343 >> 172.21.15.5:0/13303343 conn(0x7f3b500b1dc0 msgr2=0x7f3b5009a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 -- 172.21.15.5:0/13303343 shutdown_connections 2024-08-18T22:22:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.335+0000 7f3b57600640 1 -- 172.21.15.5:0/13303343 wait complete. 2024-08-18T22:22:44.357 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:22:44.357 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-08-18T22:22:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.495+0000 7f806f400640 1 Processor -- start 2024-08-18T22:22:44.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.495+0000 7f806f400640 1 -- start start 2024-08-18T22:22:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.499+0000 7f806f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f806809aca0 0x7f80680afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.499+0000 7f806f400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f806806e8a0 con 0x7f806809b080 2024-08-18T22:22:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.499+0000 7f806f400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f806809bb80 con 0x7f80680b1300 2024-08-18T22:22:44.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.499+0000 7f806f400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f80680d2e40 con 0x7f806809aca0 2024-08-18T22:22:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.499+0000 7f806ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f806809aca0 0x7f80680afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.499+0000 7f806d400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f806809b080 0x7f8068162950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54400/0 (socket says 172.21.15.5:54400) 2024-08-18T22:22:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.499+0000 7f806d400640 1 -- 172.21.15.5:0/1472221704 learned_addr learned my addr 172.21.15.5:0/1472221704 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.499+0000 7f806ca00640 1 -- 172.21.15.5:0/1472221704 >> v1:172.21.15.117:6789/0 conn(0x7f80680b1300 legacy=0x7f80680affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.499+0000 7f806ca00640 1 -- 172.21.15.5:0/1472221704 >> v1:172.21.15.5:6789/0 conn(0x7f806809b080 legacy=0x7f8068162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.499+0000 7f806ca00640 1 -- 172.21.15.5:0/1472221704 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806806cbd0 con 0x7f806809aca0 2024-08-18T22:22:44.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.499+0000 7f8067e00640 1 -- 172.21.15.5:0/1472221704 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694249239 0 0) 0x7f806806e8a0 con 0x7f806809b080 2024-08-18T22:22:44.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806ca00640 1 --2- 172.21.15.5:0/1472221704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806809aca0 0x7f80680afa90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f80580097c0 tx=0x7f805801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e774fe39c71bc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f8067e00640 1 -- 172.21.15.5:0/1472221704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580b1070 con 0x7f806809aca0 2024-08-18T22:22:44.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f8067e00640 1 -- 172.21.15.5:0/1472221704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80580ac410 con 0x7f806809aca0 2024-08-18T22:22:44.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f8067e00640 1 -- 172.21.15.5:0/1472221704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580ac7e0 con 0x7f806809aca0 2024-08-18T22:22:44.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 -- 172.21.15.5:0/1472221704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806809aca0 msgr2=0x7f80680afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 --2- 172.21.15.5:0/1472221704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806809aca0 0x7f80680afa90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f80580097c0 tx=0x7f805801c4a0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 -- 172.21.15.5:0/1472221704 shutdown_connections 2024-08-18T22:22:44.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 --2- 172.21.15.5:0/1472221704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806809aca0 0x7f80680afa90 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 -- 172.21.15.5:0/1472221704 >> 172.21.15.5:0/1472221704 conn(0x7f80680d2180 msgr2=0x7f80680d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 -- 172.21.15.5:0/1472221704 shutdown_connections 2024-08-18T22:22:44.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 -- 172.21.15.5:0/1472221704 wait complete. 2024-08-18T22:22:44.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 Processor -- start 2024-08-18T22:22:44.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 -- start start 2024-08-18T22:22:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f806809aca0 0x7f80680cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806809b080 0x7f8068153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680b1300 0x7f80680b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f806816ced0 con 0x7f806809b080 2024-08-18T22:22:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f806816cd50 con 0x7f80680b1300 2024-08-18T22:22:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f806f400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f806816d050 con 0x7f806809aca0 2024-08-18T22:22:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f805fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806809b080 0x7f8068153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f805fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806809b080 0x7f8068153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55590/0 (socket says 172.21.15.5:55590) 2024-08-18T22:22:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.503+0000 7f805fe00640 1 -- 172.21.15.5:0/1415966989 learned_addr learned my addr 172.21.15.5:0/1415966989 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f806ca00640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f806809aca0 0x7f80680cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f806d400640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680b1300 0x7f80680b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f805fe00640 1 -- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f806809aca0 msgr2=0x7f80680cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f805fe00640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f806809aca0 0x7f80680cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f805fe00640 1 -- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680b1300 msgr2=0x7f80680b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f805fe00640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680b1300 0x7f80680b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f805fe00640 1 -- 172.21.15.5:0/1415966989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80680ce470 con 0x7f806809b080 2024-08-18T22:22:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f806ca00640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f806809aca0 0x7f80680cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f805fe00640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806809b080 0x7f8068153ea0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f805000c500 tx=0x7f805000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f8065600640 1 -- 172.21.15.5:0/1415966989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050016020 con 0x7f806809b080 2024-08-18T22:22:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f8065600640 1 -- 172.21.15.5:0/1415966989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8050005220 con 0x7f806809b080 2024-08-18T22:22:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f8065600640 1 -- 172.21.15.5:0/1415966989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050007030 con 0x7f806809b080 2024-08-18T22:22:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f806f400640 1 -- 172.21.15.5:0/1415966989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8068160c60 con 0x7f806809b080 2024-08-18T22:22:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f806f400640 1 -- 172.21.15.5:0/1415966989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80681543e0 con 0x7f806809b080 2024-08-18T22:22:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f8065600640 1 -- 172.21.15.5:0/1415966989 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80500071d0 con 0x7f806809b080 2024-08-18T22:22:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f8065600640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80440678c0 0x7f8044069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.507+0000 7f8065600640 1 -- 172.21.15.5:0/1415966989 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f8050085880 con 0x7f806809b080 2024-08-18T22:22:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806ca00640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80440678c0 0x7f8044069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 Processor -- start 2024-08-18T22:22:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 -- start start 2024-08-18T22:22:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806ca00640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80440678c0 0x7f8044069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f80580ae000 tx=0x7f8058008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce54fe3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce54f96fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54f978f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ce54e80af0 con 0x55ce54f97510 2024-08-18T22:22:44.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ce54e6cbb0 con 0x55ce54fe39b0 2024-08-18T22:22:44.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ce54de7500 con 0x55ce54fe42d0 2024-08-18T22:22:44.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54f978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54f978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55596/0 (socket says 172.21.15.5:55596) 2024-08-18T22:22:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806d400640 1 -- 172.21.15.5:0/1378020643 learned_addr learned my addr 172.21.15.5:0/1378020643 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806ca00640 1 --2- 172.21.15.5:0/1378020643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce54fe3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f805fe00640 1 --2- 172.21.15.5:0/1378020643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce54f96fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806d400640 1 -- 172.21.15.5:0/1378020643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 msgr2=0x55ce54f96fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806d400640 1 --2- 172.21.15.5:0/1378020643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce54f96fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806d400640 1 -- 172.21.15.5:0/1378020643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 msgr2=0x55ce54fe3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806d400640 1 --2- 172.21.15.5:0/1378020643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce54fe3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806d400640 1 -- 172.21.15.5:0/1378020643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce54d87aa0 con 0x55ce54f97510 2024-08-18T22:22:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f806d400640 1 --2- 172.21.15.5:0/1378020643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54f978f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f80600072e0 tx=0x7f80600077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee29afe82d2c30d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f805d600640 1 -- 172.21.15.5:0/1378020643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060019070 con 0x55ce54f97510 2024-08-18T22:22:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f805d600640 1 -- 172.21.15.5:0/1378020643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8060004d80 con 0x55ce54f97510 2024-08-18T22:22:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f805d600640 1 -- 172.21.15.5:0/1378020643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060001e60 con 0x55ce54f97510 2024-08-18T22:22:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 -- 172.21.15.5:0/1378020643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 msgr2=0x55ce54f978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 --2- 172.21.15.5:0/1378020643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54f978f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f80600072e0 tx=0x7f80600077a0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 -- 172.21.15.5:0/1378020643 shutdown_connections 2024-08-18T22:22:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 --2- 172.21.15.5:0/1378020643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54f978f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 --2- 172.21.15.5:0/1378020643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce54f96fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 --2- 172.21.15.5:0/1378020643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce54fe3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 -- 172.21.15.5:0/1378020643 >> 172.21.15.5:0/1378020643 conn(0x55ce54f91020 msgr2=0x55ce54fc6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 -- 172.21.15.5:0/1378020643 shutdown_connections 2024-08-18T22:22:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.511+0000 7f8072937000 1 -- 172.21.15.5:0/1378020643 wait complete. 2024-08-18T22:22:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 -- start start 2024-08-18T22:22:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 Processor -- start 2024-08-18T22:22:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54fc4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce54f9f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce54f9f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ce54de34c0 con 0x55ce54f97510 2024-08-18T22:22:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ce54da1b60 con 0x55ce54fe39b0 2024-08-18T22:22:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ce54d88d10 con 0x55ce54fe42d0 2024-08-18T22:22:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 10 client.0 _ll_register_callbacks cb 0x55ce54f84f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f806ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54fc4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f806ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54fc4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55598/0 (socket says 172.21.15.5:55598) 2024-08-18T22:22:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f806ca00640 1 -- 172.21.15.5:0/788013432 learned_addr learned my addr 172.21.15.5:0/788013432 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f805fe00640 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce54f9f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f806d400640 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce54f9f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f806ca00640 1 -- 172.21.15.5:0/788013432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 msgr2=0x55ce54f9f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f806ca00640 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce54f9f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f806ca00640 1 -- 172.21.15.5:0/788013432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 msgr2=0x55ce54f9f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f806ca00640 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce54f9f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f806ca00640 1 -- 172.21.15.5:0/788013432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce54da0070 con 0x55ce54f97510 2024-08-18T22:22:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f805fe00640 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce54f9f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f806ca00640 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54fc4050 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8058000c10 tx=0x7f805801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58df173dd999313 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8056000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8056000640 1 -- 172.21.15.5:0/788013432 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580b1040 con 0x55ce54f97510 2024-08-18T22:22:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8056000640 1 -- 172.21.15.5:0/788013432 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f80580b7cd0 con 0x55ce54f97510 2024-08-18T22:22:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 -- 172.21.15.5:0/788013432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8060004d80 con 0x55ce54f97510 2024-08-18T22:22:44.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8056000640 1 -- 172.21.15.5:0/788013432 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80580d2050 con 0x55ce54f97510 2024-08-18T22:22:44.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 10 client.6102 fetch_fsmap learned FSMap version 28 2024-08-18T22:22:44.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 -- 172.21.15.5:0/788013432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55ce54db3f60 con 0x55ce54f97510 2024-08-18T22:22:44.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8056000640 1 -- 172.21.15.5:0/788013432 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8060004d80 con 0x55ce54f97510 2024-08-18T22:22:44.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8056000640 1 -- 172.21.15.5:0/788013432 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f80580d5020 con 0x55ce54f97510 2024-08-18T22:22:44.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 10 client.6102 fetch_fsmap finished waiting for FSMap version 28 2024-08-18T22:22:44.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 10 client.6102 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:44.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 20 client.6102 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:44.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ce54fc60d0 0x55ce54ff5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 4 client.6102 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:44.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8072937000 1 -- 172.21.15.5:0/788013432 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce54d81e20 con 0x55ce54fc60d0 2024-08-18T22:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f805fe00640 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ce54fc60d0 0x55ce54ff5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f805fe00640 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ce54fc60d0 0x55ce54ff5c70 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afe19d59cabf4b9e server_cookie=3bae5d35fa1a5420 in_seq=0 out_seq=0 2024-08-18T22:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.515+0000 7f8056000640 10 client.6102 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8056000640 1 -- 172.21.15.5:0/788013432 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce54d81e20 con 0x55ce54fc60d0 2024-08-18T22:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8056000640 10 client.6102 handle_command_reply: tid=0 2024-08-18T22:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 1 client.6102 shutdown 2024-08-18T22:22:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 1 -- 172.21.15.5:0/788013432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 msgr2=0x55ce54fc4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54fc4050 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8058000c10 tx=0x7f805801ace0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 1 -- 172.21.15.5:0/788013432 shutdown_connections 2024-08-18T22:22:44.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ce54fc60d0 0x55ce54ff5c70 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce54f9f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce54f9f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 1 --2- 172.21.15.5:0/788013432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54fc4050 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8056000640 0 client.6102 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 1 -- 172.21.15.5:0/788013432 >> 172.21.15.5:0/788013432 conn(0x55ce54f91020 msgr2=0x55ce54f966d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 1 -- 172.21.15.5:0/788013432 shutdown_connections 2024-08-18T22:22:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 1 -- 172.21.15.5:0/788013432 wait complete. 2024-08-18T22:22:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.519+0000 7f8072937000 20 client.6102 trim_cache size 0 max 16384 2024-08-18T22:22:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.531+0000 7f8072937000 1 Processor -- start 2024-08-18T22:22:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.531+0000 7f8072937000 1 -- start start 2024-08-18T22:22:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54ff90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe39b0 0x55ce54fc4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe42d0 0x55ce54fc4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f80682043f0 con 0x55ce54f97510 2024-08-18T22:22:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8068203410 con 0x55ce54fe42d0 2024-08-18T22:22:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f80681fb470 con 0x55ce54fe39b0 2024-08-18T22:22:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f806ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54ff90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f806ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54ff90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55606/0 (socket says 172.21.15.5:55606) 2024-08-18T22:22:44.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f806ca00640 1 -- 172.21.15.5:0/3584500816 learned_addr learned my addr 172.21.15.5:0/3584500816 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f805fe00640 1 --2- 172.21.15.5:0/3584500816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe39b0 0x55ce54fc4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f806d400640 1 --2- 172.21.15.5:0/3584500816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe42d0 0x55ce54fc4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f806ca00640 1 -- 172.21.15.5:0/3584500816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe39b0 msgr2=0x55ce54fc4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f806ca00640 1 --2- 172.21.15.5:0/3584500816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe39b0 0x55ce54fc4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f806ca00640 1 -- 172.21.15.5:0/3584500816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe42d0 msgr2=0x55ce54fc4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f806ca00640 1 --2- 172.21.15.5:0/3584500816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe42d0 0x55ce54fc4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f806ca00640 1 -- 172.21.15.5:0/3584500816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce54e69de0 con 0x55ce54f97510 2024-08-18T22:22:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f806ca00640 1 --2- 172.21.15.5:0/3584500816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54ff90c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8058008010 tx=0x7f80580c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9720e9ef89fed7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.548 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:22:44.535+0000 7fc7f5400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-18T22:22:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f805cc00640 1 -- 172.21.15.5:0/3584500816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580b1040 con 0x55ce54f97510 2024-08-18T22:22:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f805cc00640 1 -- 172.21.15.5:0/3584500816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80580ca070 con 0x55ce54f97510 2024-08-18T22:22:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f805cc00640 1 -- 172.21.15.5:0/3584500816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580c5760 con 0x55ce54f97510 2024-08-18T22:22:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 -- 172.21.15.5:0/3584500816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 msgr2=0x55ce54ff90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 --2- 172.21.15.5:0/3584500816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54ff90c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8058008010 tx=0x7f80580c1000 comp rx=0 tx=0).stop 2024-08-18T22:22:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 -- 172.21.15.5:0/3584500816 shutdown_connections 2024-08-18T22:22:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 --2- 172.21.15.5:0/3584500816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe42d0 0x55ce54fc4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 --2- 172.21.15.5:0/3584500816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe39b0 0x55ce54fc4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 --2- 172.21.15.5:0/3584500816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce54ff90c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 -- 172.21.15.5:0/3584500816 >> 172.21.15.5:0/3584500816 conn(0x55ce54f91020 msgr2=0x55ce54f96de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 -- 172.21.15.5:0/3584500816 shutdown_connections 2024-08-18T22:22:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 -- 172.21.15.5:0/3584500816 wait complete. 2024-08-18T22:22:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 -- start start 2024-08-18T22:22:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.535+0000 7f8072937000 1 Processor -- start 2024-08-18T22:22:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8072937000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce55057610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8072937000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce55057b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8072937000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce55058090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8072937000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8068202df0 con 0x55ce54f97510 2024-08-18T22:22:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8072937000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ce54fa2bd0 con 0x55ce54fe39b0 2024-08-18T22:22:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8072937000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ce54e69950 con 0x55ce54fe42d0 2024-08-18T22:22:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8072937000 10 client.0 _ll_register_callbacks cb 0x7f8058009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f806ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce55057610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f806ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce55057610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55614/0 (socket says 172.21.15.5:55614) 2024-08-18T22:22:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f806ca00640 1 -- 172.21.15.5:0/3110431606 learned_addr learned my addr 172.21.15.5:0/3110431606 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f805fe00640 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce55057b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f806d400640 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce55058090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f806ca00640 1 -- 172.21.15.5:0/3110431606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 msgr2=0x55ce55058090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f806ca00640 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce55058090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f806ca00640 1 -- 172.21.15.5:0/3110431606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 msgr2=0x55ce55057b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f806ca00640 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce55057b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f806ca00640 1 -- 172.21.15.5:0/3110431606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce54d7ace0 con 0x55ce54f97510 2024-08-18T22:22:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f806d400640 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce55058090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f806ca00640 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce55057610 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8058009160 tx=0x7f8058009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3342a581ebf61575 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8056000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8056000640 1 -- 172.21.15.5:0/3110431606 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580b1040 con 0x55ce54f97510 2024-08-18T22:22:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8072937000 1 -- 172.21.15.5:0/3110431606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80580ca070 con 0x55ce54f97510 2024-08-18T22:22:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8056000640 1 -- 172.21.15.5:0/3110431606 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f80580c5480 con 0x55ce54f97510 2024-08-18T22:22:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8056000640 1 -- 172.21.15.5:0/3110431606 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80580b7e60 con 0x55ce54f97510 2024-08-18T22:22:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8072937000 10 client.6108 fetch_fsmap learned FSMap version 28 2024-08-18T22:22:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.539+0000 7f8072937000 1 -- 172.21.15.5:0/3110431606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55ce54d8d330 con 0x55ce54f97510 2024-08-18T22:22:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8056000640 1 -- 172.21.15.5:0/3110431606 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80580ca070 con 0x55ce54f97510 2024-08-18T22:22:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8056000640 1 -- 172.21.15.5:0/3110431606 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f80580d5070 con 0x55ce54f97510 2024-08-18T22:22:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 10 client.6108 fetch_fsmap finished waiting for FSMap version 28 2024-08-18T22:22:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 10 client.6108 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 20 client.6108 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ce54ff8090 0x55ce54ff84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 4 client.6108 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:22:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 -- 172.21.15.5:0/3110431606 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce54df4c30 con 0x55ce54ff8090 2024-08-18T22:22:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f805fe00640 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ce54ff8090 0x55ce54ff84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f805fe00640 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ce54ff8090 0x55ce54ff84a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80debe5a3bcd63bf server_cookie=6cd761662d1b115f in_seq=0 out_seq=0 2024-08-18T22:22:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8056000640 10 client.6108 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8056000640 1 -- 172.21.15.5:0/3110431606 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x55ce54df4c30 con 0x55ce54ff8090 2024-08-18T22:22:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8056000640 10 client.6108 handle_command_reply: tid=0 2024-08-18T22:22:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 client.6108 shutdown 2024-08-18T22:22:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 -- 172.21.15.5:0/3110431606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 msgr2=0x55ce55057610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce55057610 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8058009160 tx=0x7f8058009190 comp rx=0 tx=0).stop 2024-08-18T22:22:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 -- 172.21.15.5:0/3110431606 shutdown_connections 2024-08-18T22:22:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55ce54ff8090 0x55ce54ff84a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ce54fe42d0 0x55ce55058090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ce54fe39b0 0x55ce55057b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 --2- 172.21.15.5:0/3110431606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ce54f97510 0x55ce55057610 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 -- 172.21.15.5:0/3110431606 >> 172.21.15.5:0/3110431606 conn(0x55ce54f91020 msgr2=0x55ce54ff1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8056000640 0 client.6108 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 -- 172.21.15.5:0/3110431606 shutdown_connections 2024-08-18T22:22:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 1 -- 172.21.15.5:0/3110431606 wait complete. 2024-08-18T22:22:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f8072937000 20 client.6108 trim_cache size 0 max 16384 2024-08-18T22:22:44.564 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:22:44.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:22:44.564 INFO:teuthology.orchestra.run.smithi005.stdout: "damage_type": "backtrace", 2024-08-18T22:22:44.564 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 1201039661, 2024-08-18T22:22:44.565 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 1099511630411, 2024-08-18T22:22:44.565 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-08-18T22:22:44.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:22:44.565 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:22:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 -- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80440678c0 msgr2=0x7f8044069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80440678c0 0x7f8044069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f80580ae000 tx=0x7f8058008040 comp rx=0 tx=0).stop 2024-08-18T22:22:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 -- 172.21.15.5:0/1415966989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806809b080 msgr2=0x7f8068153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806809b080 0x7f8068153ea0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f805000c500 tx=0x7f805000c9c0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 -- 172.21.15.5:0/1415966989 shutdown_connections 2024-08-18T22:22:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80440678c0 0x7f8044069d80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680b1300 0x7f80680b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806809b080 0x7f8068153ea0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 --2- 172.21.15.5:0/1415966989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f806809aca0 0x7f80680cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 -- 172.21.15.5:0/1415966989 >> 172.21.15.5:0/1415966989 conn(0x7f80680d2180 msgr2=0x7f8068169a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 -- 172.21.15.5:0/1415966989 shutdown_connections 2024-08-18T22:22:44.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.543+0000 7f806f400640 1 -- 172.21.15.5:0/1415966989 wait complete. 2024-08-18T22:22:44.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:22:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0970c00640 1 Processor -- start 2024-08-18T22:22:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0970c00640 1 -- start start 2024-08-18T22:22:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0970c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f096c15b010 0x7f096c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0970c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f096c0cd3a0 0x7f096c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0970c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c0cee20 con 0x7f096c06f0c0 2024-08-18T22:22:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0970c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f096c0cfa30 con 0x7f096c15b010 2024-08-18T22:22:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0970c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f096c0cf100 con 0x7f096c0cd3a0 2024-08-18T22:22:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0969e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f096c15b010 0x7f096c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0961400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f096c0cd3a0 0x7f096c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0969e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f096c15b010 0x7f096c0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:43602/0 (socket says 172.21.15.5:43602) 2024-08-18T22:22:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0969e00640 1 -- 172.21.15.5:0/3060815227 learned_addr learned my addr 172.21.15.5:0/3060815227 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0969e00640 1 -- 172.21.15.5:0/3060815227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f096c0cd3a0 msgr2=0x7f096c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0969e00640 1 --2- 172.21.15.5:0/3060815227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f096c0cd3a0 0x7f096c06eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0969e00640 1 -- 172.21.15.5:0/3060815227 >> v1:172.21.15.117:6789/0 conn(0x7f096c06f0c0 legacy=0x7f096c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0969e00640 1 -- 172.21.15.5:0/3060815227 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c0cf3e0 con 0x7f096c15b010 2024-08-18T22:22:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.707+0000 7f0961400640 1 --2- 172.21.15.5:0/3060815227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f096c0cd3a0 0x7f096c06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0969e00640 1 --2- 172.21.15.5:0/3060815227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c15b010 0x7f096c0ce840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f095c009870 tx=0x7f095c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6336326269746456 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0969400640 1 -- 172.21.15.5:0/3060815227 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c0b2070 con 0x7f096c15b010 2024-08-18T22:22:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0969400640 1 -- 172.21.15.5:0/3060815227 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095c0ad680 con 0x7f096c15b010 2024-08-18T22:22:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0969400640 1 -- 172.21.15.5:0/3060815227 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c0ada50 con 0x7f096c15b010 2024-08-18T22:22:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0970c00640 1 -- 172.21.15.5:0/3060815227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c15b010 msgr2=0x7f096c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0970c00640 1 --2- 172.21.15.5:0/3060815227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c15b010 0x7f096c0ce840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f095c009870 tx=0x7f095c01c560 comp rx=0 tx=0).stop 2024-08-18T22:22:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0970c00640 1 -- 172.21.15.5:0/3060815227 shutdown_connections 2024-08-18T22:22:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0970c00640 1 --2- 172.21.15.5:0/3060815227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f096c0cd3a0 0x7f096c06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0970c00640 1 --2- 172.21.15.5:0/3060815227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c15b010 0x7f096c0ce840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0970c00640 1 -- 172.21.15.5:0/3060815227 >> 172.21.15.5:0/3060815227 conn(0x7f096c0b1c50 msgr2=0x7f096c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0970c00640 1 -- 172.21.15.5:0/3060815227 shutdown_connections 2024-08-18T22:22:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.711+0000 7f0970c00640 1 -- 172.21.15.5:0/3060815227 wait complete. 2024-08-18T22:22:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0970c00640 1 Processor -- start 2024-08-18T22:22:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0970c00640 1 -- start start 2024-08-18T22:22:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0970c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c06f0c0 0x7f096c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0970c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f096c0cd3a0 0x7f096c15d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0970c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f096c15b010 0x7f096c0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0970c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f096c167dd0 con 0x7f096c15b010 2024-08-18T22:22:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0970c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f096c167c50 con 0x7f096c06f0c0 2024-08-18T22:22:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0970c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f096c167f50 con 0x7f096c0cd3a0 2024-08-18T22:22:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f096a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f096c15b010 0x7f096c0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0969e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c06f0c0 0x7f096c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f096a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f096c15b010 0x7f096c0c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55620/0 (socket says 172.21.15.5:55620) 2024-08-18T22:22:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f096a800640 1 -- 172.21.15.5:0/3719347598 learned_addr learned my addr 172.21.15.5:0/3719347598 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0961400640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f096c0cd3a0 0x7f096c15d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0969e00640 1 -- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f096c0cd3a0 msgr2=0x7f096c15d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0969e00640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f096c0cd3a0 0x7f096c15d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0969e00640 1 -- 172.21.15.5:0/3719347598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f096c15b010 msgr2=0x7f096c0c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0969e00640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f096c15b010 0x7f096c0c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0969e00640 1 -- 172.21.15.5:0/3719347598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c15c800 con 0x7f096c06f0c0 2024-08-18T22:22:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f096a800640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f096c15b010 0x7f096c0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0969e00640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c06f0c0 0x7f096c153070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f095c0ac000 tx=0x7f095c01ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0962a00640 1 -- 172.21.15.5:0/3719347598 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c0b2040 con 0x7f096c06f0c0 2024-08-18T22:22:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0962a00640 1 -- 172.21.15.5:0/3719347598 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095c0bd070 con 0x7f096c06f0c0 2024-08-18T22:22:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0962a00640 1 -- 172.21.15.5:0/3719347598 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c0b8450 con 0x7f096c06f0c0 2024-08-18T22:22:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0970c00640 1 -- 172.21.15.5:0/3719347598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096c158ec0 con 0x7f096c06f0c0 2024-08-18T22:22:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.715+0000 7f0970c00640 1 -- 172.21.15.5:0/3719347598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096c159480 con 0x7f096c06f0c0 2024-08-18T22:22:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.719+0000 7f0970c00640 1 -- 172.21.15.5:0/3719347598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f096c06eb80 con 0x7f096c06f0c0 2024-08-18T22:22:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.719+0000 7f0962a00640 1 -- 172.21.15.5:0/3719347598 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f095c0b85f0 con 0x7f096c06f0c0 2024-08-18T22:22:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.719+0000 7f0962a00640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09480678c0 0x7f0948069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.719+0000 7f0962a00640 1 -- 172.21.15.5:0/3719347598 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f095c1207d0 con 0x7f096c06f0c0 2024-08-18T22:22:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.719+0000 7f0961400640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09480678c0 0x7f0948069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.719+0000 7f0961400640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09480678c0 0x7f0948069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0954009580 tx=0x7f0954009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.723+0000 7f0962a00640 1 -- 172.21.15.5:0/3719347598 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f095c016150 con 0x7f096c06f0c0 2024-08-18T22:22:44.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.919+0000 7f0970c00640 1 -- 172.21.15.5:0/3719347598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f096c06e7b0 con 0x7f096c06f0c0 2024-08-18T22:22:44.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.919+0000 7f0962a00640 1 -- 172.21.15.5:0/3719347598 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5221 (secure 0 0 0) 0x7f095c0f0b10 con 0x7f096c06f0c0 2024-08-18T22:22:44.924 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:44.924 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"btime":"2024-08-18T22:22:44:539948+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3185015921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3185015921},{"type":"v1","addr":"172.21.15.117:6837","nonce":3185015921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3679281629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3679281629},{"type":"v1","addr":"172.21.15.117:6836","nonce":3679281629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/649845928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":649845928},{"type":"v1","addr":"172.21.15.5:6833","nonce":649845928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:22:10.822677+0000","modified":"2024-08-18T22:22:43.716170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.5:6835/3590404197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3590404197},{"type":"v1","addr":"172.21.15.5:6835","nonce":3590404197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5370,"qdb_cluster":[5370]},"id":3}]} 2024-08-18T22:22:44.924 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2024-08-18T22:22:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 -- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09480678c0 msgr2=0x7f0948069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09480678c0 0x7f0948069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0954009580 tx=0x7f0954009190 comp rx=0 tx=0).stop 2024-08-18T22:22:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 -- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c06f0c0 msgr2=0x7f096c153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c06f0c0 0x7f096c153070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f095c0ac000 tx=0x7f095c01ada0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 -- 172.21.15.5:0/3719347598 shutdown_connections 2024-08-18T22:22:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09480678c0 0x7f0948069d80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f096c15b010 0x7f096c0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f096c0cd3a0 0x7f096c15d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 --2- 172.21.15.5:0/3719347598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f096c06f0c0 0x7f096c153070 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 -- 172.21.15.5:0/3719347598 >> 172.21.15.5:0/3719347598 conn(0x7f096c0b1c50 msgr2=0x7f096c0caf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 -- 172.21.15.5:0/3719347598 shutdown_connections 2024-08-18T22:22:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:44.923+0000 7f0970c00640 1 -- 172.21.15.5:0/3719347598 wait complete. 2024-08-18T22:22:44.945 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 1201039661 2024-08-18T22:22:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee71000640 1 Processor -- start 2024-08-18T22:22:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee71000640 1 -- start start 2024-08-18T22:22:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee71000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee6c15c180 0x7fee6c0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee71000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c0cfb00 con 0x7fee6c15c560 2024-08-18T22:22:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee71000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c15c9f0 con 0x7fee6c15d4d0 2024-08-18T22:22:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee71000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fee6c15d040 con 0x7fee6c15c180 2024-08-18T22:22:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee69e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee6c15c180 0x7fee6c0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee61400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fee6c15c560 0x7fee6c0ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54402/0 (socket says 172.21.15.5:54402) 2024-08-18T22:22:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee61400640 1 -- 172.21.15.5:0/3798504956 learned_addr learned my addr 172.21.15.5:0/3798504956 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee69e00640 1 -- 172.21.15.5:0/3798504956 >> v1:172.21.15.117:6789/0 conn(0x7fee6c15d4d0 legacy=0x7fee6c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee69e00640 1 -- 172.21.15.5:0/3798504956 >> v1:172.21.15.5:6789/0 conn(0x7fee6c15c560 legacy=0x7fee6c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee69e00640 1 -- 172.21.15.5:0/3798504956 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c15ccd0 con 0x7fee6c15c180 2024-08-18T22:22:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.087+0000 7fee69400640 1 -- 172.21.15.5:0/3798504956 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310919179 0 0) 0x7fee6c0cfb00 con 0x7fee6c15c560 2024-08-18T22:22:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee69e00640 1 --2- 172.21.15.5:0/3798504956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6c15c180 0x7fee6c0cdf10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097c0 tx=0x7fee5c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e969ba3e92e4a6f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee69400640 1 -- 172.21.15.5:0/3798504956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0ab430 con 0x7fee6c15c180 2024-08-18T22:22:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee69400640 1 -- 172.21.15.5:0/3798504956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5c0b0070 con 0x7fee6c15c180 2024-08-18T22:22:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee69400640 1 -- 172.21.15.5:0/3798504956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0ab7f0 con 0x7fee6c15c180 2024-08-18T22:22:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee71000640 1 -- 172.21.15.5:0/3798504956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6c15c180 msgr2=0x7fee6c0cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee71000640 1 --2- 172.21.15.5:0/3798504956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6c15c180 0x7fee6c0cdf10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097c0 tx=0x7fee5c01c410 comp rx=0 tx=0).stop 2024-08-18T22:22:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee71000640 1 -- 172.21.15.5:0/3798504956 shutdown_connections 2024-08-18T22:22:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee71000640 1 --2- 172.21.15.5:0/3798504956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6c15c180 0x7fee6c0cdf10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee71000640 1 -- 172.21.15.5:0/3798504956 >> 172.21.15.5:0/3798504956 conn(0x7fee6c0b1dc0 msgr2=0x7fee6c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee71000640 1 -- 172.21.15.5:0/3798504956 shutdown_connections 2024-08-18T22:22:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee71000640 1 -- 172.21.15.5:0/3798504956 wait complete. 2024-08-18T22:22:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee71000640 1 Processor -- start 2024-08-18T22:22:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.091+0000 7fee71000640 1 -- start start 2024-08-18T22:22:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee71000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6c15c180 0x7fee6c14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee71000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6c15d4d0 0x7fee6c152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee71000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee6c14a7e0 0x7fee6c0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee71000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c16a2c0 con 0x7fee6c15c180 2024-08-18T22:22:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee71000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c16a140 con 0x7fee6c15d4d0 2024-08-18T22:22:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee71000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c16a440 con 0x7fee6c14a7e0 2024-08-18T22:22:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee69e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6c15c180 0x7fee6c14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee69e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6c15c180 0x7fee6c14a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55638/0 (socket says 172.21.15.5:55638) 2024-08-18T22:22:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee69e00640 1 -- 172.21.15.5:0/103348430 learned_addr learned my addr 172.21.15.5:0/103348430 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee61400640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6c15d4d0 0x7fee6c152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee6a800640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee6c14a7e0 0x7fee6c0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee69e00640 1 -- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee6c14a7e0 msgr2=0x7fee6c0721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee69e00640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee6c14a7e0 0x7fee6c0721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee69e00640 1 -- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6c15d4d0 msgr2=0x7fee6c152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee69e00640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6c15d4d0 0x7fee6c152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee69e00640 1 -- 172.21.15.5:0/103348430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c14a5a0 con 0x7fee6c15c180 2024-08-18T22:22:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee69e00640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6c15c180 0x7fee6c14a060 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097c0 tx=0x7fee5c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee62a00640 1 -- 172.21.15.5:0/103348430 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c004230 con 0x7fee6c15c180 2024-08-18T22:22:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee62a00640 1 -- 172.21.15.5:0/103348430 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6c0ced70 con 0x7fee6c15c180 2024-08-18T22:22:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee71000640 1 -- 172.21.15.5:0/103348430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c072e60 con 0x7fee6c15c180 2024-08-18T22:22:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee62a00640 1 -- 172.21.15.5:0/103348430 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c003620 con 0x7fee6c15c180 2024-08-18T22:22:45.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee71000640 1 -- 172.21.15.5:0/103348430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6c1525c0 con 0x7fee6c15c180 2024-08-18T22:22:45.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.095+0000 7fee62a00640 1 -- 172.21.15.5:0/103348430 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee5c0037c0 con 0x7fee6c15c180 2024-08-18T22:22:45.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee62a00640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee480678f0 0x7fee48069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee62a00640 1 -- 172.21.15.5:0/103348430 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fee5c0a8030 con 0x7fee6c15c180 2024-08-18T22:22:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee61400640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee480678f0 0x7fee48069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee744d9000 1 Processor -- start 2024-08-18T22:22:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee744d9000 1 -- start start 2024-08-18T22:22:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee61400640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee480678f0 0x7fee48069db0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fee6c06e1f0 tx=0x7fee54007bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee744d9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 0x55a8971ed990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee744d9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a8971a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee744d9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a8971a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee744d9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a896ff14c0 con 0x55a8971eded0 2024-08-18T22:22:45.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee744d9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a896f8cd50 con 0x55a8971a4710 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee744d9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a896fed480 con 0x55a8971ed5b0 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee61400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a8971a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee61400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a8971a41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55646/0 (socket says 172.21.15.5:55646) 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee61400640 1 -- 172.21.15.5:0/2222061509 learned_addr learned my addr 172.21.15.5:0/2222061509 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee61400640 1 -- 172.21.15.5:0/2222061509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 msgr2=0x55a8971ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee61400640 1 --2- 172.21.15.5:0/2222061509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 0x55a8971ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee61400640 1 -- 172.21.15.5:0/2222061509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 msgr2=0x55a8971a4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee6a800640 1 --2- 172.21.15.5:0/2222061509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a8971a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee61400640 1 --2- 172.21.15.5:0/2222061509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a8971a4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee61400640 1 -- 172.21.15.5:0/2222061509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a896fbdd50 con 0x55a8971eded0 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee6a800640 1 --2- 172.21.15.5:0/2222061509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a8971a4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:45.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.099+0000 7fee61400640 1 --2- 172.21.15.5:0/2222061509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a8971a41d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fee54000c10 tx=0x7fee54012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8762683a806a46 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee5aa00640 1 -- 172.21.15.5:0/2222061509 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54015110 con 0x55a8971eded0 2024-08-18T22:22:45.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee5aa00640 1 -- 172.21.15.5:0/2222061509 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee54015990 con 0x55a8971eded0 2024-08-18T22:22:45.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee5aa00640 1 -- 172.21.15.5:0/2222061509 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54015d40 con 0x55a8971eded0 2024-08-18T22:22:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 -- 172.21.15.5:0/2222061509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 msgr2=0x55a8971a41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 --2- 172.21.15.5:0/2222061509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a8971a41d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fee54000c10 tx=0x7fee54012000 comp rx=0 tx=0).stop 2024-08-18T22:22:45.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 -- 172.21.15.5:0/2222061509 shutdown_connections 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 --2- 172.21.15.5:0/2222061509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a8971a4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 --2- 172.21.15.5:0/2222061509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a8971a41d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 --2- 172.21.15.5:0/2222061509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 0x55a8971ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 -- 172.21.15.5:0/2222061509 >> 172.21.15.5:0/2222061509 conn(0x55a89708c040 msgr2=0x55a8971a2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 -- 172.21.15.5:0/2222061509 shutdown_connections 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 -- 172.21.15.5:0/2222061509 wait complete. 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 -- start start 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 Processor -- start 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a8971a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971ed5b0 0x55a8971aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971eded0 0x55a8971aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a896f92fd0 con 0x55a8971ed5b0 2024-08-18T22:22:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a896ff5af0 con 0x55a8971a4710 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a896fcadc0 con 0x55a8971eded0 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 10 client.0 _ll_register_callbacks cb 0x55a89718fca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee61400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971ed5b0 0x55a8971aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee61400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971ed5b0 0x55a8971aa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55660/0 (socket says 172.21.15.5:55660) 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee61400640 1 -- 172.21.15.5:0/334770101 learned_addr learned my addr 172.21.15.5:0/334770101 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee69e00640 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a8971a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee6a800640 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971eded0 0x55a8971aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee61400640 1 -- 172.21.15.5:0/334770101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971eded0 msgr2=0x55a8971aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee61400640 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971eded0 0x55a8971aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee61400640 1 -- 172.21.15.5:0/334770101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 msgr2=0x55a8971a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee61400640 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a8971a9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee61400640 1 -- 172.21.15.5:0/334770101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a896fbc610 con 0x55a8971ed5b0 2024-08-18T22:22:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee69e00640 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a8971a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee61400640 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971ed5b0 0x55a8971aa3c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fee54005fd0 tx=0x7fee54007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2853d28e8cfa755b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee4f400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee4f400640 1 -- 172.21.15.5:0/334770101 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54021450 con 0x55a8971ed5b0 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee4f400640 1 -- 172.21.15.5:0/334770101 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fee54010050 con 0x55a8971ed5b0 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.103+0000 7fee744d9000 1 -- 172.21.15.5:0/334770101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee54015990 con 0x55a8971ed5b0 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee4f400640 1 -- 172.21.15.5:0/334770101 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fee54033050 con 0x55a8971ed5b0 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 10 client.6126 fetch_fsmap learned FSMap version 29 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 -- 172.21.15.5:0/334770101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55a897073d20 con 0x55a8971ed5b0 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee4f400640 1 -- 172.21.15.5:0/334770101 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee54015990 con 0x55a8971ed5b0 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee4f400640 1 -- 172.21.15.5:0/334770101 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fee54036020 con 0x55a8971ed5b0 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 10 client.6126 fetch_fsmap finished waiting for FSMap version 29 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 10 client.6126 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 20 client.6126 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55a8971af960 0x55a8971fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 4 client.6126 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 -- 172.21.15.5:0/334770101 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a896f8bcd0 con 0x55a8971af960 2024-08-18T22:22:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee69e00640 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55a8971af960 0x55a8971fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee69e00640 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55a8971af960 0x55a8971fe650 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36d1a21e1e8ef233 server_cookie=1bf4ff89f395da38 in_seq=0 out_seq=0 2024-08-18T22:22:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee4f400640 10 client.6126 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee4f400640 1 -- 172.21.15.5:0/334770101 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a896f8bcd0 con 0x55a8971af960 2024-08-18T22:22:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee4f400640 10 client.6126 handle_command_reply: tid=0 2024-08-18T22:22:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 client.6126 shutdown 2024-08-18T22:22:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 -- 172.21.15.5:0/334770101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971ed5b0 msgr2=0x55a8971aa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971ed5b0 0x55a8971aa3c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fee54005fd0 tx=0x7fee54007a20 comp rx=0 tx=0).stop 2024-08-18T22:22:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 -- 172.21.15.5:0/334770101 shutdown_connections 2024-08-18T22:22:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55a8971af960 0x55a8971fe650 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971eded0 0x55a8971aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971ed5b0 0x55a8971aa3c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 --2- 172.21.15.5:0/334770101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a8971a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee4f400640 0 client.6126 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 -- 172.21.15.5:0/334770101 >> 172.21.15.5:0/334770101 conn(0x55a89708c040 msgr2=0x55a8971a31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 -- 172.21.15.5:0/334770101 shutdown_connections 2024-08-18T22:22:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 1 -- 172.21.15.5:0/334770101 wait complete. 2024-08-18T22:22:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.107+0000 7fee744d9000 20 client.6126 trim_cache size 0 max 16384 2024-08-18T22:22:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 Processor -- start 2024-08-18T22:22:45.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 -- start start 2024-08-18T22:22:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a89725c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 0x55a89725cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a89725d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c203160 con 0x55a8971eded0 2024-08-18T22:22:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c159430 con 0x55a8971a4710 2024-08-18T22:22:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c159a80 con 0x55a8971ed5b0 2024-08-18T22:22:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee6a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a89725d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee6a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a89725d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55670/0 (socket says 172.21.15.5:55670) 2024-08-18T22:22:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee6a800640 1 -- 172.21.15.5:0/963993181 learned_addr learned my addr 172.21.15.5:0/963993181 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee69e00640 1 --2- 172.21.15.5:0/963993181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a89725c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee61400640 1 --2- 172.21.15.5:0/963993181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 0x55a89725cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee6a800640 1 -- 172.21.15.5:0/963993181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 msgr2=0x55a89725cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee6a800640 1 --2- 172.21.15.5:0/963993181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 0x55a89725cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee6a800640 1 -- 172.21.15.5:0/963993181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 msgr2=0x55a89725c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee6a800640 1 --2- 172.21.15.5:0/963993181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a89725c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee6a800640 1 -- 172.21.15.5:0/963993181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8971a8490 con 0x55a8971eded0 2024-08-18T22:22:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee6a800640 1 --2- 172.21.15.5:0/963993181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a89725d000 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fee64003f40 tx=0x7fee640057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108e16f7fed3de52 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee5a000640 1 -- 172.21.15.5:0/963993181 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64001d40 con 0x55a8971eded0 2024-08-18T22:22:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee5a000640 1 -- 172.21.15.5:0/963993181 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6401a070 con 0x55a8971eded0 2024-08-18T22:22:45.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee5a000640 1 -- 172.21.15.5:0/963993181 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64015470 con 0x55a8971eded0 2024-08-18T22:22:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 -- 172.21.15.5:0/963993181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 msgr2=0x55a89725d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 --2- 172.21.15.5:0/963993181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a89725d000 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fee64003f40 tx=0x7fee640057b0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 -- 172.21.15.5:0/963993181 shutdown_connections 2024-08-18T22:22:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 --2- 172.21.15.5:0/963993181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971eded0 0x55a89725d000 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 --2- 172.21.15.5:0/963993181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 0x55a89725cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 --2- 172.21.15.5:0/963993181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971a4710 0x55a89725c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 -- 172.21.15.5:0/963993181 >> 172.21.15.5:0/963993181 conn(0x55a89708c040 msgr2=0x55a8971a6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 -- 172.21.15.5:0/963993181 shutdown_connections 2024-08-18T22:22:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 -- 172.21.15.5:0/963993181 wait complete. 2024-08-18T22:22:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.123+0000 7fee744d9000 1 -- start start 2024-08-18T22:22:45.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 Processor -- start 2024-08-18T22:22:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971a4710 0x55a897260330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 0x55a897260870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971eded0 0x55a897260db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a8970aeec0 con 0x55a8971a4710 2024-08-18T22:22:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a8970be220 con 0x55a8971eded0 2024-08-18T22:22:45.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a896f98690 con 0x55a8971ed5b0 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 10 client.0 _ll_register_callbacks cb 0x7fee540072b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee69e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971a4710 0x55a897260330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee69e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971a4710 0x55a897260330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55686/0 (socket says 172.21.15.5:55686) 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee69e00640 1 -- 172.21.15.5:0/3986812024 learned_addr learned my addr 172.21.15.5:0/3986812024 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee6a800640 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971eded0 0x55a897260db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee61400640 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 0x55a897260870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee69e00640 1 -- 172.21.15.5:0/3986812024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 msgr2=0x55a897260870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee69e00640 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 0x55a897260870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee69e00640 1 -- 172.21.15.5:0/3986812024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971eded0 msgr2=0x55a897260db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee69e00640 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971eded0 0x55a897260db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee69e00640 1 -- 172.21.15.5:0/3986812024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a89700e9d0 con 0x55a8971a4710 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee69e00640 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971a4710 0x55a897260330 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fee5c01c980 tx=0x7fee5c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484b1e3f56324bf6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee4f400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee4f400640 1 -- 172.21.15.5:0/3986812024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0f9bb0 con 0x55a8971a4710 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee4f400640 1 -- 172.21.15.5:0/3986812024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fee5c0ed640 con 0x55a8971a4710 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 -- 172.21.15.5:0/3986812024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee6401a070 con 0x55a8971a4710 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee4f400640 1 -- 172.21.15.5:0/3986812024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fee5c11e050 con 0x55a8971a4710 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 10 client.6132 fetch_fsmap learned FSMap version 29 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 -- 172.21.15.5:0/3986812024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55a896fa2910 con 0x55a8971a4710 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee4f400640 1 -- 172.21.15.5:0/3986812024 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6401a070 con 0x55a8971a4710 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee4f400640 1 -- 172.21.15.5:0/3986812024 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fee5c0c7070 con 0x55a8971a4710 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 10 client.6132 fetch_fsmap finished waiting for FSMap version 29 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 10 client.6132 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 20 client.6132 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55a89721d010 0x55a89721c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 4 client.6132 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 1201039661}] 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 -- 172.21.15.5:0/3986812024 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "damage rm", "damage_id": 1201039661}) -- 0x55a896fcc530 con 0x55a89721d010 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee61400640 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55a89721d010 0x55a89721c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee61400640 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55a89721d010 0x55a89721c020 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=204ff0753f280543 server_cookie=bf7f080edbdad2f4 in_seq=0 out_seq=0 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee4f400640 10 client.6132 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee4f400640 1 -- 172.21.15.5:0/3986812024 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55a896fcc530 con 0x55a89721d010 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee4f400640 10 client.6132 handle_command_reply: tid=0 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 client.6132 shutdown 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 -- 172.21.15.5:0/3986812024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971a4710 msgr2=0x55a897260330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.127+0000 7fee744d9000 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971a4710 0x55a897260330 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fee5c01c980 tx=0x7fee5c0191b0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee744d9000 1 -- 172.21.15.5:0/3986812024 shutdown_connections 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee744d9000 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x55a89721d010 0x55a89721c020 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee744d9000 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a8971eded0 0x55a897260db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee744d9000 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a8971ed5b0 0x55a897260870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee4f400640 0 client.6132 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee744d9000 1 --2- 172.21.15.5:0/3986812024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8971a4710 0x55a897260330 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee744d9000 1 -- 172.21.15.5:0/3986812024 >> 172.21.15.5:0/3986812024 conn(0x55a89708c040 msgr2=0x55a8971fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee744d9000 1 -- 172.21.15.5:0/3986812024 shutdown_connections 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee744d9000 1 -- 172.21.15.5:0/3986812024 wait complete. 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee744d9000 20 client.6132 trim_cache size 0 max 16384 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 -- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee480678f0 msgr2=0x7fee48069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee480678f0 0x7fee48069db0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fee6c06e1f0 tx=0x7fee54007bc0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 -- 172.21.15.5:0/103348430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6c15c180 msgr2=0x7fee6c14a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6c15c180 0x7fee6c14a060 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097c0 tx=0x7fee5c01ac50 comp rx=0 tx=0).stop 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 -- 172.21.15.5:0/103348430 shutdown_connections 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee480678f0 0x7fee48069db0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee6c14a7e0 0x7fee6c0721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6c15d4d0 0x7fee6c152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 --2- 172.21.15.5:0/103348430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee6c15c180 0x7fee6c14a060 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 -- 172.21.15.5:0/103348430 >> 172.21.15.5:0/103348430 conn(0x7fee6c0b1dc0 msgr2=0x7fee6c06eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 -- 172.21.15.5:0/103348430 shutdown_connections 2024-08-18T22:22:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.131+0000 7fee71000640 1 -- 172.21.15.5:0/103348430 wait complete. 2024-08-18T22:22:45.152 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-08-18T22:22:45.153 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-08-18T22:22:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.291+0000 7fa4a3e00640 1 Processor -- start 2024-08-18T22:22:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.291+0000 7fa4a3e00640 1 -- start start 2024-08-18T22:22:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.291+0000 7fa4a3e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa49c15c560 0x7fa49c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.291+0000 7fa4a3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa49c15d4d0 0x7fa49c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.291+0000 7fa4a3e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49c0cfb00 con 0x7fa49c15c180 2024-08-18T22:22:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.291+0000 7fa4a3e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa49c15d040 con 0x7fa49c15d4d0 2024-08-18T22:22:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.291+0000 7fa4a3e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa49c15c9f0 con 0x7fa49c15c560 2024-08-18T22:22:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.291+0000 7fa4a1e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa49c15d4d0 0x7fa49c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.295+0000 7fa4a1e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa49c15d4d0 0x7fa49c06db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55700/0 (socket says 172.21.15.5:55700) 2024-08-18T22:22:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.295+0000 7fa4a1e00640 1 -- 172.21.15.5:0/3009445260 learned_addr learned my addr 172.21.15.5:0/3009445260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.295+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/3009445260 >> v2:172.21.15.117:3300/0 conn(0x7fa49c15c560 0x7fa49c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.295+0000 7fa4a1e00640 1 -- 172.21.15.5:0/3009445260 >> v2:172.21.15.117:3300/0 conn(0x7fa49c15c560 msgr2=0x7fa49c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.295+0000 7fa4a1e00640 1 --2- 172.21.15.5:0/3009445260 >> v2:172.21.15.117:3300/0 conn(0x7fa49c15c560 0x7fa49c0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.295+0000 7fa4a1e00640 1 -- 172.21.15.5:0/3009445260 >> v1:172.21.15.117:6789/0 conn(0x7fa49c15c180 legacy=0x7fa49c0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.295+0000 7fa4a1e00640 1 -- 172.21.15.5:0/3009445260 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c15ccd0 con 0x7fa49c15d4d0 2024-08-18T22:22:45.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.295+0000 7fa4a1e00640 1 --2- 172.21.15.5:0/3009445260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c15d4d0 0x7fa49c06db80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0b5260 tx=0x7fa49401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c38e834074782b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.295+0000 7fa49be00640 1 -- 172.21.15.5:0/3009445260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940a5800 con 0x7fa49c15d4d0 2024-08-18T22:22:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.295+0000 7fa49be00640 1 -- 172.21.15.5:0/3009445260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49c0ced70 con 0x7fa49c15d4d0 2024-08-18T22:22:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.295+0000 7fa49be00640 1 -- 172.21.15.5:0/3009445260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940a5bc0 con 0x7fa49c15d4d0 2024-08-18T22:22:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3009445260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c15d4d0 msgr2=0x7fa49c06db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 --2- 172.21.15.5:0/3009445260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c15d4d0 0x7fa49c06db80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0b5260 tx=0x7fa49401c920 comp rx=0 tx=0).stop 2024-08-18T22:22:45.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3009445260 shutdown_connections 2024-08-18T22:22:45.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 --2- 172.21.15.5:0/3009445260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c15d4d0 0x7fa49c06db80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 --2- 172.21.15.5:0/3009445260 >> v2:172.21.15.117:3300/0 conn(0x7fa49c15c560 0x7fa49c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3009445260 >> 172.21.15.5:0/3009445260 conn(0x7fa49c0b1dc0 msgr2=0x7fa49c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3009445260 shutdown_connections 2024-08-18T22:22:45.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3009445260 wait complete. 2024-08-18T22:22:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 Processor -- start 2024-08-18T22:22:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 -- start start 2024-08-18T22:22:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c15c180 0x7fa49c14c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c15d4d0 0x7fa49c149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49c1574e0 0x7fa49c14cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c1692b0 con 0x7fa49c15c180 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c169130 con 0x7fa49c1574e0 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a3e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c169430 con 0x7fa49c15d4d0 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c15c180 0x7fa49c14c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c15c180 0x7fa49c14c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55708/0 (socket says 172.21.15.5:55708) 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a1400640 1 -- 172.21.15.5:0/3864192597 learned_addr learned my addr 172.21.15.5:0/3864192597 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a1e00640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49c1574e0 0x7fa49c14cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c15d4d0 0x7fa49c149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a1400640 1 -- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c15d4d0 msgr2=0x7fa49c149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a1400640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c15d4d0 0x7fa49c149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a1400640 1 -- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49c1574e0 msgr2=0x7fa49c14cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a1400640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49c1574e0 0x7fa49c14cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a1400640 1 -- 172.21.15.5:0/3864192597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c06fbf0 con 0x7fa49c15c180 2024-08-18T22:22:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.299+0000 7fa4a1400640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c15c180 0x7fa49c14c290 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c450 tx=0x7fa49000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.303+0000 7fa499600640 1 -- 172.21.15.5:0/3864192597 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490012830 con 0x7fa49c15c180 2024-08-18T22:22:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.303+0000 7fa499600640 1 -- 172.21.15.5:0/3864192597 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490017070 con 0x7fa49c15c180 2024-08-18T22:22:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.303+0000 7fa499600640 1 -- 172.21.15.5:0/3864192597 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490012c30 con 0x7fa49c15c180 2024-08-18T22:22:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.303+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3864192597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c14c7d0 con 0x7fa49c15c180 2024-08-18T22:22:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.303+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3864192597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c156720 con 0x7fa49c15c180 2024-08-18T22:22:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.303+0000 7fa499600640 1 -- 172.21.15.5:0/3864192597 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa49001c460 con 0x7fa49c15c180 2024-08-18T22:22:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.303+0000 7fa499600640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa47c0678f0 0x7fa47c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.303+0000 7fa499600640 1 -- 172.21.15.5:0/3864192597 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fa490085ae0 con 0x7fa49c15c180 2024-08-18T22:22:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa47c0678f0 0x7fa47c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 Processor -- start 2024-08-18T22:22:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 -- start start 2024-08-18T22:22:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa47c0678f0 0x7fa47c069db0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa49c158470 tx=0x7fa488008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5b5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5d90 0x5651cf568970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf568eb0 0x5651cf569290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5651cf3b60f0 con 0x5651cf5b5470 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5651cf3521e0 con 0x5651cf568eb0 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5651cf3b20b0 con 0x5651cf5b5d90 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5b5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55722/0 (socket says 172.21.15.5:55722) 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a1400640 1 -- 172.21.15.5:0/4034961627 learned_addr learned my addr 172.21.15.5:0/4034961627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/4034961627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5d90 0x5651cf568970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a1e00640 1 --2- 172.21.15.5:0/4034961627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf568eb0 0x5651cf569290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a1400640 1 -- 172.21.15.5:0/4034961627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5d90 msgr2=0x5651cf568970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a1400640 1 --2- 172.21.15.5:0/4034961627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5d90 0x5651cf568970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a1400640 1 -- 172.21.15.5:0/4034961627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf568eb0 msgr2=0x5651cf569290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a1400640 1 --2- 172.21.15.5:0/4034961627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf568eb0 0x5651cf569290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a1400640 1 -- 172.21.15.5:0/4034961627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651cf3fbac0 con 0x5651cf5b5470 2024-08-18T22:22:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a1400640 1 --2- 172.21.15.5:0/4034961627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5b5850 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa49005e430 tx=0x7fa4900565b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a71013fd852c4f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa48e000640 1 -- 172.21.15.5:0/4034961627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490082070 con 0x5651cf5b5470 2024-08-18T22:22:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa48e000640 1 -- 172.21.15.5:0/4034961627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490054080 con 0x5651cf5b5470 2024-08-18T22:22:45.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa48e000640 1 -- 172.21.15.5:0/4034961627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4900551d0 con 0x5651cf5b5470 2024-08-18T22:22:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 -- 172.21.15.5:0/4034961627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 msgr2=0x5651cf5b5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/4034961627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5b5850 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa49005e430 tx=0x7fa4900565b0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 -- 172.21.15.5:0/4034961627 shutdown_connections 2024-08-18T22:22:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/4034961627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf568eb0 0x5651cf569290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/4034961627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5d90 0x5651cf568970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/4034961627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5b5850 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 -- 172.21.15.5:0/4034961627 >> 172.21.15.5:0/4034961627 conn(0x5651cf55e5b0 msgr2=0x5651cf593cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 -- 172.21.15.5:0/4034961627 shutdown_connections 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 -- 172.21.15.5:0/4034961627 wait complete. 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 -- start start 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.307+0000 7fa4a72e7000 1 Processor -- start 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf575440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5470 0x5651cf575980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf5b5d90 0x5651cf575ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5651cf358400 con 0x5651cf568eb0 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5651cf35db70 con 0x5651cf5b5d90 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5651cf438090 con 0x5651cf5b5470 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 10 client.0 _ll_register_callbacks cb 0x5651cf5521f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf575440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf575440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55726/0 (socket says 172.21.15.5:55726) 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a1400640 1 -- 172.21.15.5:0/2510597162 learned_addr learned my addr 172.21.15.5:0/2510597162 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5470 0x5651cf575980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a1e00640 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf5b5d90 0x5651cf575ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a1400640 1 -- 172.21.15.5:0/2510597162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5470 msgr2=0x5651cf575980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a1400640 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5470 0x5651cf575980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a1400640 1 -- 172.21.15.5:0/2510597162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf5b5d90 msgr2=0x5651cf575ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a1400640 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf5b5d90 0x5651cf575ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a1400640 1 -- 172.21.15.5:0/2510597162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651cf36e030 con 0x5651cf568eb0 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5470 0x5651cf575980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a1e00640 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf5b5d90 0x5651cf575ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a1400640 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf575440 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa490055d10 tx=0x7fa490007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e73435e2b33b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa482a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:45.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa482a00640 1 -- 172.21.15.5:0/2510597162 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490073070 con 0x5651cf568eb0 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa482a00640 1 -- 172.21.15.5:0/2510597162 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fa4900523f0 con 0x5651cf568eb0 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 1 -- 172.21.15.5:0/2510597162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa490054080 con 0x5651cf568eb0 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa482a00640 1 -- 172.21.15.5:0/2510597162 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa490082040 con 0x5651cf568eb0 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 10 client.6144 fetch_fsmap learned FSMap version 29 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 1 -- 172.21.15.5:0/2510597162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5651cf352430 con 0x5651cf568eb0 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa482a00640 1 -- 172.21.15.5:0/2510597162 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490054080 con 0x5651cf568eb0 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa482a00640 1 -- 172.21.15.5:0/2510597162 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fa49007d400 con 0x5651cf568eb0 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 10 client.6144 fetch_fsmap finished waiting for FSMap version 29 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 10 client.6144 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 20 client.6144 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5651cf5768d0 0x5651cf5c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 4 client.6144 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a72e7000 1 -- 172.21.15.5:0/2510597162 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651cf351020 con 0x5651cf5768d0 2024-08-18T22:22:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5651cf5768d0 0x5651cf5c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5651cf5768d0 0x5651cf5c6510 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abccad06e5b75670 server_cookie=6261ac5c6b7093c0 in_seq=0 out_seq=0 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.311+0000 7fa482a00640 10 client.6144 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa482a00640 1 -- 172.21.15.5:0/2510597162 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651cf351020 con 0x5651cf5768d0 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa482a00640 10 client.6144 handle_command_reply: tid=0 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 1 client.6144 shutdown 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 1 -- 172.21.15.5:0/2510597162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 msgr2=0x5651cf575440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf575440 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa490055d10 tx=0x7fa490007f90 comp rx=0 tx=0).stop 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 1 -- 172.21.15.5:0/2510597162 shutdown_connections 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5651cf5768d0 0x5651cf5c6510 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf5b5d90 0x5651cf575ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5470 0x5651cf575980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/2510597162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf575440 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa482a00640 0 client.6144 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:45.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 1 -- 172.21.15.5:0/2510597162 >> 172.21.15.5:0/2510597162 conn(0x5651cf55e5b0 msgr2=0x5651cf563550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 1 -- 172.21.15.5:0/2510597162 shutdown_connections 2024-08-18T22:22:45.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 1 -- 172.21.15.5:0/2510597162 wait complete. 2024-08-18T22:22:45.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.315+0000 7fa4a72e7000 20 client.6144 trim_cache size 0 max 16384 2024-08-18T22:22:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 Processor -- start 2024-08-18T22:22:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 -- start start 2024-08-18T22:22:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf568eb0 0x5651cf5c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5d90 0x5651cf571c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c072f80 con 0x5651cf5b5470 2024-08-18T22:22:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c14abd0 con 0x5651cf568eb0 2024-08-18T22:22:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c14b220 con 0x5651cf5b5d90 2024-08-18T22:22:45.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a0a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a0a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55728/0 (socket says 172.21.15.5:55728) 2024-08-18T22:22:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a0a00640 1 -- 172.21.15.5:0/4211889958 learned_addr learned my addr 172.21.15.5:0/4211889958 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a1400640 1 --2- 172.21.15.5:0/4211889958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf568eb0 0x5651cf5c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a1e00640 1 --2- 172.21.15.5:0/4211889958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5d90 0x5651cf571c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a0a00640 1 -- 172.21.15.5:0/4211889958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5d90 msgr2=0x5651cf571c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/4211889958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5d90 0x5651cf571c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a0a00640 1 -- 172.21.15.5:0/4211889958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf568eb0 msgr2=0x5651cf5c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/4211889958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf568eb0 0x5651cf5c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a0a00640 1 -- 172.21.15.5:0/4211889958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651cf3833b0 con 0x5651cf5b5470 2024-08-18T22:22:45.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/4211889958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5716c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa48800fac0 tx=0x7fa488015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a101be82726b43 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa48d600640 1 -- 172.21.15.5:0/4211889958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48801b030 con 0x5651cf5b5470 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa48d600640 1 -- 172.21.15.5:0/4211889958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48801c040 con 0x5651cf5b5470 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa48d600640 1 -- 172.21.15.5:0/4211889958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48802d440 con 0x5651cf5b5470 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 -- 172.21.15.5:0/4211889958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 msgr2=0x5651cf5716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/4211889958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5716c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa48800fac0 tx=0x7fa488015000 comp rx=0 tx=0).stop 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 -- 172.21.15.5:0/4211889958 shutdown_connections 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/4211889958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5d90 0x5651cf571c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/4211889958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf5b5470 0x5651cf5716c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/4211889958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf568eb0 0x5651cf5c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 -- 172.21.15.5:0/4211889958 >> 172.21.15.5:0/4211889958 conn(0x5651cf55e5b0 msgr2=0x5651cf5b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 -- 172.21.15.5:0/4211889958 shutdown_connections 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 -- 172.21.15.5:0/4211889958 wait complete. 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.331+0000 7fa4a72e7000 1 -- start start 2024-08-18T22:22:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 1 Processor -- start 2024-08-18T22:22:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf5c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5470 0x5651cf5c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf5b5d90 0x5651cf5e4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5651cf3730e0 con 0x5651cf568eb0 2024-08-18T22:22:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5651cf3bfef0 con 0x5651cf5b5d90 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5651cf34dd20 con 0x5651cf5b5470 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 10 client.0 _ll_register_callbacks cb 0x7fa490080070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf5c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf5c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55742/0 (socket says 172.21.15.5:55742) 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a1400640 1 -- 172.21.15.5:0/3168349519 learned_addr learned my addr 172.21.15.5:0/3168349519 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a1e00640 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf5b5d90 0x5651cf5e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5470 0x5651cf5c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a1400640 1 -- 172.21.15.5:0/3168349519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5470 msgr2=0x5651cf5c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a1400640 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5470 0x5651cf5c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a1400640 1 -- 172.21.15.5:0/3168349519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf5b5d90 msgr2=0x5651cf5e4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a1400640 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf5b5d90 0x5651cf5e4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a1400640 1 -- 172.21.15.5:0/3168349519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651cf438520 con 0x5651cf568eb0 2024-08-18T22:22:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a1400640 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf5c8d60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa490055850 tx=0x7fa490059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6079a5ab22f20fa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa482a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa482a00640 1 -- 172.21.15.5:0/3168349519 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490073040 con 0x5651cf568eb0 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa482a00640 1 -- 172.21.15.5:0/3168349519 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fa4900553e0 con 0x5651cf568eb0 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 1 -- 172.21.15.5:0/3168349519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa48801c040 con 0x5651cf568eb0 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa482a00640 1 -- 172.21.15.5:0/3168349519 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa490047050 con 0x5651cf568eb0 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 10 client.6150 fetch_fsmap learned FSMap version 29 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 1 -- 172.21.15.5:0/3168349519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5651cf35c720 con 0x5651cf568eb0 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa482a00640 1 -- 172.21.15.5:0/3168349519 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48801c040 con 0x5651cf568eb0 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa482a00640 1 -- 172.21.15.5:0/3168349519 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fa49004a080 con 0x5651cf568eb0 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 10 client.6150 fetch_fsmap finished waiting for FSMap version 29 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 10 client.6150 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 20 client.6150 populate_metadata read hostname 'smithi005' 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5651cf5e51f0 0x5651cf628470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 4 client.6150 mds_command: new command op to 5370 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-08-18T22:22:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a72e7000 1 -- 172.21.15.5:0/3168349519 --> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x5651cf3c3820 con 0x5651cf5e51f0 2024-08-18T22:22:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5651cf5e51f0 0x5651cf628470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa4a0a00640 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5651cf5e51f0 0x5651cf628470 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11dad2ec2330102f server_cookie=367e87df001b1ea8 in_seq=0 out_seq=0 2024-08-18T22:22:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.335+0000 7fa482a00640 10 client.6150 ms_handle_connect on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa482a00640 1 -- 172.21.15.5:0/3168349519 <== mds.0 v2:172.21.15.5:6834/3590404197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5651cf3c3820 con 0x5651cf5e51f0 2024-08-18T22:22:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa482a00640 10 client.6150 handle_command_reply: tid=0 2024-08-18T22:22:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 1 client.6150 shutdown 2024-08-18T22:22:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 1 -- 172.21.15.5:0/3168349519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 msgr2=0x5651cf5c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf5c8d60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa490055850 tx=0x7fa490059000 comp rx=0 tx=0).stop 2024-08-18T22:22:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 1 -- 172.21.15.5:0/3168349519 shutdown_connections 2024-08-18T22:22:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.5:6834/3590404197,v1:172.21.15.5:6835/3590404197] conn(0x5651cf5e51f0 0x5651cf628470 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651cf5b5d90 0x5651cf5e4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5651cf5b5470 0x5651cf5c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 1 --2- 172.21.15.5:0/3168349519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5651cf568eb0 0x5651cf5c8d60 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa482a00640 0 client.6150 ms_handle_reset on v2:172.21.15.5:6834/3590404197 2024-08-18T22:22:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 1 -- 172.21.15.5:0/3168349519 >> 172.21.15.5:0/3168349519 conn(0x5651cf55e5b0 msgr2=0x5651cf571ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 1 -- 172.21.15.5:0/3168349519 shutdown_connections 2024-08-18T22:22:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 1 -- 172.21.15.5:0/3168349519 wait complete. 2024-08-18T22:22:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a72e7000 20 client.6150 trim_cache size 0 max 16384 2024-08-18T22:22:45.346 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:22:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:22:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:22:45.346 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:22:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa47c0678f0 msgr2=0x7fa47c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa47c0678f0 0x7fa47c069db0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa49c158470 tx=0x7fa488008040 comp rx=0 tx=0).stop 2024-08-18T22:22:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3864192597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c15c180 msgr2=0x7fa49c14c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c15c180 0x7fa49c14c290 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c450 tx=0x7fa49000c910 comp rx=0 tx=0).stop 2024-08-18T22:22:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3864192597 shutdown_connections 2024-08-18T22:22:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa47c0678f0 0x7fa47c069db0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49c1574e0 0x7fa49c14cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa49c15d4d0 0x7fa49c149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 --2- 172.21.15.5:0/3864192597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa49c15c180 0x7fa49c14c290 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3864192597 >> 172.21.15.5:0/3864192597 conn(0x7fa49c0b1dc0 msgr2=0x7fa49c14bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3864192597 shutdown_connections 2024-08-18T22:22:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.339+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3864192597 wait complete. 2024-08-18T22:22:45.362 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-08-18T22:22:45.363 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:22:45.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:22:45.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:22:45.562 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:22:45.562 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:22:45.562 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:22:45.562 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:45.571 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:22:45.571 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:45.621 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:22:45.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff281200640 1 Processor -- start 2024-08-18T22:22:45.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff281200640 1 -- start start 2024-08-18T22:22:45.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff281200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff27c0b40c0 0x7ff27c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff281200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c0ce280 0x7ff27c0ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff281200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff27c0b31f0 con 0x7ff27c15b0c0 2024-08-18T22:22:45.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff281200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff27c0b4a70 con 0x7ff27c0b40c0 2024-08-18T22:22:45.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff281200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff27c0b3d70 con 0x7ff27c0ce280 2024-08-18T22:22:45.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff279e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff27c15b0c0 0x7ff27c06db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54412/0 (socket says 172.21.15.5:54412) 2024-08-18T22:22:45.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff279e00640 1 -- 172.21.15.5:0/390525493 learned_addr learned my addr 172.21.15.5:0/390525493 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:45.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff27a800640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c0ce280 0x7ff27c0ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff279400640 1 --2- 172.21.15.5:0/390525493 >> v2:172.21.15.117:3300/0 conn(0x7ff27c0b40c0 0x7ff27c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650926165 0 0) 0x7ff27c0b31f0 con 0x7ff27c15b0c0 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff260003530 con 0x7ff27c15b0c0 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1007857311 0 0) 0x7ff260003530 con 0x7ff27c15b0c0 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c0ce280 msgr2=0x7ff27c0ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c0ce280 0x7ff27c0ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 >> v2:172.21.15.117:3300/0 conn(0x7ff27c0b40c0 msgr2=0x7ff27c0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 --2- 172.21.15.5:0/390525493 >> v2:172.21.15.117:3300/0 conn(0x7ff27c0b40c0 0x7ff27c0b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c0b34d0 con 0x7ff27c15b0c0 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7ff26c001680 con 0x7ff27c15b0c0 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 >> v1:172.21.15.5:6789/0 conn(0x7ff27c15b0c0 legacy=0x7ff27c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2600039c0 0x7ff260003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c0ce280 0x7ff260004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff260004d50 0x7ff2600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c0b4a70 con 0x7ff260004d50 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c0b3d70 con 0x7ff2600039c0 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff26000baa0 con 0x7ff27c0ce280 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff27a800640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff260004d50 0x7ff2600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff279e00640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2600039c0 0x7ff260003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff279400640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c0ce280 0x7ff260004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff27a800640 1 -- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c0ce280 msgr2=0x7ff260004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff27a800640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c0ce280 0x7ff260004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff27a800640 1 -- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2600039c0 msgr2=0x7ff260003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff27a800640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2600039c0 0x7ff260003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff27a800640 1 -- 172.21.15.5:0/390525493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff260003530 con 0x7ff260004d50 2024-08-18T22:22:45.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.803+0000 7ff279400640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff27c0ce280 0x7ff260004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:45.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.807+0000 7ff27a800640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff260004d50 0x7ff2600051d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff274009fc0 tx=0x7ff27401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33867bd9b641132b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.807+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740b2070 con 0x7ff260004d50 2024-08-18T22:22:45.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.807+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2740a5b60 con 0x7ff260004d50 2024-08-18T22:22:45.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.807+0000 7ff278a00640 1 -- 172.21.15.5:0/390525493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274009c10 con 0x7ff260004d50 2024-08-18T22:22:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.807+0000 7ff281200640 1 -- 172.21.15.5:0/390525493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff260004d50 msgr2=0x7ff2600051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.807+0000 7ff281200640 1 --2- 172.21.15.5:0/390525493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff260004d50 0x7ff2600051d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff274009fc0 tx=0x7ff27401cc80 comp rx=0 tx=0).stop 2024-08-18T22:22:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.807+0000 7ff27a800640 1 -- 172.21.15.5:0/390525493 reap_dead start 2024-08-18T22:22:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.807+0000 7ff281200640 1 -- 172.21.15.5:0/390525493 shutdown_connections 2024-08-18T22:22:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.807+0000 7ff281200640 1 -- 172.21.15.5:0/390525493 >> 172.21.15.5:0/390525493 conn(0x7ff27c0b1dc0 msgr2=0x7ff27c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.807+0000 7ff281200640 1 -- 172.21.15.5:0/390525493 shutdown_connections 2024-08-18T22:22:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.807+0000 7ff281200640 1 -- 172.21.15.5:0/390525493 wait complete. 2024-08-18T22:22:45.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff281200640 1 Processor -- start 2024-08-18T22:22:45.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff281200640 1 -- start start 2024-08-18T22:22:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff281200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff260004d50 0x7ff27c0aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff281200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff27c1543b0 0x7ff27c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff281200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27c1467a0 0x7ff27c159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff281200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c06f7f0 con 0x7ff27c1467a0 2024-08-18T22:22:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff281200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c06f670 con 0x7ff27c1543b0 2024-08-18T22:22:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff281200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff27c0ceea0 con 0x7ff260004d50 2024-08-18T22:22:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff27a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27c1467a0 0x7ff27c159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff27a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27c1467a0 0x7ff27c159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55768/0 (socket says 172.21.15.5:55768) 2024-08-18T22:22:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff27a800640 1 -- 172.21.15.5:0/2546083639 learned_addr learned my addr 172.21.15.5:0/2546083639 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff279e00640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff260004d50 0x7ff27c0aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff279400640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff27c1543b0 0x7ff27c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff27a800640 1 -- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff260004d50 msgr2=0x7ff27c0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff27a800640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff260004d50 0x7ff27c0aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff27a800640 1 -- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff27c1543b0 msgr2=0x7ff27c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff27a800640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff27c1543b0 0x7ff27c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff27a800640 1 -- 172.21.15.5:0/2546083639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c0af4f0 con 0x7ff27c1467a0 2024-08-18T22:22:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff27a800640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27c1467a0 0x7ff27c159c70 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff2740b0040 tx=0x7ff274009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff272000640 1 -- 172.21.15.5:0/2546083639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740bd070 con 0x7ff27c1467a0 2024-08-18T22:22:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff272000640 1 -- 172.21.15.5:0/2546083639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2740a5960 con 0x7ff27c1467a0 2024-08-18T22:22:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff272000640 1 -- 172.21.15.5:0/2546083639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740b2040 con 0x7ff27c1467a0 2024-08-18T22:22:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff281200640 1 -- 172.21.15.5:0/2546083639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27c157bd0 con 0x7ff27c1467a0 2024-08-18T22:22:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.811+0000 7ff281200640 1 -- 172.21.15.5:0/2546083639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27c157070 con 0x7ff27c1467a0 2024-08-18T22:22:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.815+0000 7ff281200640 1 -- 172.21.15.5:0/2546083639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff27c1579c0 con 0x7ff27c1467a0 2024-08-18T22:22:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.815+0000 7ff272000640 1 -- 172.21.15.5:0/2546083639 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2740a5d10 con 0x7ff27c1467a0 2024-08-18T22:22:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.815+0000 7ff272000640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff25c0678c0 0x7ff25c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:45.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.815+0000 7ff272000640 1 -- 172.21.15.5:0/2546083639 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7ff27411f900 con 0x7ff27c1467a0 2024-08-18T22:22:45.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.815+0000 7ff279e00640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff25c0678c0 0x7ff25c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:45.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.815+0000 7ff279e00640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff25c0678c0 0x7ff25c069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff27c15a9a0 tx=0x7ff26c001e00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:45.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.819+0000 7ff272000640 1 -- 172.21.15.5:0/2546083639 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff274016990 con 0x7ff27c1467a0 2024-08-18T22:22:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.995+0000 7ff281200640 1 -- 172.21.15.5:0/2546083639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff27c0cf2b0 con 0x7ff27c1467a0 2024-08-18T22:22:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.995+0000 7ff272000640 1 -- 172.21.15.5:0/2546083639 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) ==== 80+0+0 (secure 0 0 0) 0x7ff2740efce0 con 0x7ff27c1467a0 2024-08-18T22:22:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:22:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 -- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff25c0678c0 msgr2=0x7ff25c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff25c0678c0 0x7ff25c069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff27c15a9a0 tx=0x7ff26c001e00 comp rx=0 tx=0).stop 2024-08-18T22:22:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 -- 172.21.15.5:0/2546083639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27c1467a0 msgr2=0x7ff27c159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27c1467a0 0x7ff27c159c70 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff2740b0040 tx=0x7ff274009750 comp rx=0 tx=0).stop 2024-08-18T22:22:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 -- 172.21.15.5:0/2546083639 shutdown_connections 2024-08-18T22:22:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff25c0678c0 0x7ff25c069d80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27c1467a0 0x7ff27c159c70 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff27c1543b0 0x7ff27c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 --2- 172.21.15.5:0/2546083639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff260004d50 0x7ff27c0aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 -- 172.21.15.5:0/2546083639 >> 172.21.15.5:0/2546083639 conn(0x7ff27c0b1dc0 msgr2=0x7ff27c06db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 -- 172.21.15.5:0/2546083639 shutdown_connections 2024-08-18T22:22:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:45.999+0000 7ff281200640 1 -- 172.21.15.5:0/2546083639 wait complete. 2024-08-18T22:22:46.023 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:22:46.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:46.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:22:47.280 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:22:47.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:22:47.280 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:22:47.290 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:22:47.290 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:22:47.290 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:47.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:22:47.299 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:22:47.299 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:22:47.299 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:47.345 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:22:47.345 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:22:47.345 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:22:47.345 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:47.353 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:22:47.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:22:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb975000640 1 Processor -- start 2024-08-18T22:22:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb975000640 1 -- start start 2024-08-18T22:22:47.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb975000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb97009aa40 0x7fb97015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb975000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb9700b4510 0x7fb9700cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb975000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9700ccd90 con 0x7fb9700cde30 2024-08-18T22:22:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb975000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb9700ce770 con 0x7fb97009aa40 2024-08-18T22:22:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb975000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb97015d520 con 0x7fb9700b4510 2024-08-18T22:22:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb96f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb97009aa40 0x7fb97015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb96f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb97009aa40 0x7fb97015cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55784/0 (socket says 172.21.15.5:55784) 2024-08-18T22:22:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb96f400640 1 -- 172.21.15.5:0/4034823775 learned_addr learned my addr 172.21.15.5:0/4034823775 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb96fe00640 1 --2- 172.21.15.5:0/4034823775 >> v2:172.21.15.117:3300/0 conn(0x7fb9700b4510 0x7fb9700cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb96f400640 1 -- 172.21.15.5:0/4034823775 >> v2:172.21.15.117:3300/0 conn(0x7fb9700b4510 msgr2=0x7fb9700cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:47.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb96f400640 1 --2- 172.21.15.5:0/4034823775 >> v2:172.21.15.117:3300/0 conn(0x7fb9700b4510 0x7fb9700cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb96f400640 1 -- 172.21.15.5:0/4034823775 >> v1:172.21.15.117:6789/0 conn(0x7fb9700cde30 legacy=0x7fb97009ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:47.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.531+0000 7fb96f400640 1 -- 172.21.15.5:0/4034823775 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9700cd070 con 0x7fb97009aa40 2024-08-18T22:22:47.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb96f400640 1 --2- 172.21.15.5:0/4034823775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97009aa40 0x7fb97015cfe0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb9700739f0 tx=0x7fb96001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9224b7f70dbfd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb96ea00640 1 -- 172.21.15.5:0/4034823775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600aa650 con 0x7fb97009aa40 2024-08-18T22:22:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb96ea00640 1 -- 172.21.15.5:0/4034823775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9600af070 con 0x7fb97009aa40 2024-08-18T22:22:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb96ea00640 1 -- 172.21.15.5:0/4034823775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600aaa10 con 0x7fb97009aa40 2024-08-18T22:22:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb975000640 1 -- 172.21.15.5:0/4034823775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97009aa40 msgr2=0x7fb97015cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb975000640 1 --2- 172.21.15.5:0/4034823775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97009aa40 0x7fb97015cfe0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb9700739f0 tx=0x7fb96001c4f0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb975000640 1 -- 172.21.15.5:0/4034823775 shutdown_connections 2024-08-18T22:22:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb975000640 1 --2- 172.21.15.5:0/4034823775 >> v2:172.21.15.117:3300/0 conn(0x7fb9700b4510 0x7fb9700cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb975000640 1 --2- 172.21.15.5:0/4034823775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb97009aa40 0x7fb97015cfe0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb975000640 1 -- 172.21.15.5:0/4034823775 >> 172.21.15.5:0/4034823775 conn(0x7fb9700b3a20 msgr2=0x7fb9700b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb975000640 1 -- 172.21.15.5:0/4034823775 shutdown_connections 2024-08-18T22:22:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb975000640 1 -- 172.21.15.5:0/4034823775 wait complete. 2024-08-18T22:22:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb975000640 1 Processor -- start 2024-08-18T22:22:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.535+0000 7fb975000640 1 -- start start 2024-08-18T22:22:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb975000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb97009aa40 0x7fb970157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb975000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9700b4510 0x7fb9700b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb975000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9700cde30 0x7fb97006db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb975000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb97015c3b0 con 0x7fb9700b4510 2024-08-18T22:22:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb975000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb97015c230 con 0x7fb97009aa40 2024-08-18T22:22:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb975000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb970168e40 con 0x7fb9700cde30 2024-08-18T22:22:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb966a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9700b4510 0x7fb9700b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb96f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb97009aa40 0x7fb970157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb966a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9700b4510 0x7fb9700b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55796/0 (socket says 172.21.15.5:55796) 2024-08-18T22:22:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb966a00640 1 -- 172.21.15.5:0/996889128 learned_addr learned my addr 172.21.15.5:0/996889128 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb96fe00640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9700cde30 0x7fb97006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb966a00640 1 -- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9700cde30 msgr2=0x7fb97006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb966a00640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9700cde30 0x7fb97006db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb966a00640 1 -- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb97009aa40 msgr2=0x7fb970157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb966a00640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb97009aa40 0x7fb970157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb966a00640 1 -- 172.21.15.5:0/996889128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9700b4d80 con 0x7fb9700b4510 2024-08-18T22:22:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb966a00640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9700b4510 0x7fb9700b08b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb95800c3a0 tx=0x7fb95800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb967e00640 1 -- 172.21.15.5:0/996889128 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9580052d0 con 0x7fb9700b4510 2024-08-18T22:22:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb967e00640 1 -- 172.21.15.5:0/996889128 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb958005470 con 0x7fb9700b4510 2024-08-18T22:22:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb967e00640 1 -- 172.21.15.5:0/996889128 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958007260 con 0x7fb9700b4510 2024-08-18T22:22:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb975000640 1 -- 172.21.15.5:0/996889128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9700b10e0 con 0x7fb9700b4510 2024-08-18T22:22:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb975000640 1 -- 172.21.15.5:0/996889128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9700b5320 con 0x7fb9700b4510 2024-08-18T22:22:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.539+0000 7fb975000640 1 -- 172.21.15.5:0/996889128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb97015cfe0 con 0x7fb9700b4510 2024-08-18T22:22:47.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.543+0000 7fb967e00640 1 -- 172.21.15.5:0/996889128 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb958007400 con 0x7fb9700b4510 2024-08-18T22:22:47.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.543+0000 7fb967e00640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb94c0678c0 0x7fb94c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.543+0000 7fb967e00640 1 -- 172.21.15.5:0/996889128 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7fb9580851b0 con 0x7fb9700b4510 2024-08-18T22:22:47.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.543+0000 7fb96f400640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb94c0678c0 0x7fb94c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.543+0000 7fb96f400640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb94c0678c0 0x7fb94c069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb9600ae000 tx=0x7fb9600a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:47.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.547+0000 7fb967e00640 1 -- 172.21.15.5:0/996889128 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb958055500 con 0x7fb9700b4510 2024-08-18T22:22:47.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.747+0000 7fb975000640 1 -- 172.21.15.5:0/996889128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb970073d40 con 0x7fb9700b4510 2024-08-18T22:22:47.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.747+0000 7fb967e00640 1 -- 172.21.15.5:0/996889128 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5221 (secure 0 0 0) 0x7fb958059800 con 0x7fb9700b4510 2024-08-18T22:22:47.752 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:47.752 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"btime":"2024-08-18T22:22:44:539948+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3185015921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3185015921},{"type":"v1","addr":"172.21.15.117:6837","nonce":3185015921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3679281629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3679281629},{"type":"v1","addr":"172.21.15.117:6836","nonce":3679281629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/649845928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":649845928},{"type":"v1","addr":"172.21.15.5:6833","nonce":649845928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:22:10.822677+0000","modified":"2024-08-18T22:22:43.716170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.5:6835/3590404197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3590404197},{"type":"v1","addr":"172.21.15.5:6835","nonce":3590404197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5370,"qdb_cluster":[5370]},"id":3}]} 2024-08-18T22:22:47.752 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2024-08-18T22:22:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 -- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb94c0678c0 msgr2=0x7fb94c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb94c0678c0 0x7fb94c069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb9600ae000 tx=0x7fb9600a7000 comp rx=0 tx=0).stop 2024-08-18T22:22:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 -- 172.21.15.5:0/996889128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9700b4510 msgr2=0x7fb9700b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9700b4510 0x7fb9700b08b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb95800c3a0 tx=0x7fb95800c860 comp rx=0 tx=0).stop 2024-08-18T22:22:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 -- 172.21.15.5:0/996889128 shutdown_connections 2024-08-18T22:22:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb94c0678c0 0x7fb94c069d80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9700cde30 0x7fb97006db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9700b4510 0x7fb9700b08b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 --2- 172.21.15.5:0/996889128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb97009aa40 0x7fb970157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 -- 172.21.15.5:0/996889128 >> 172.21.15.5:0/996889128 conn(0x7fb9700b3a20 msgr2=0x7fb97006fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 -- 172.21.15.5:0/996889128 shutdown_connections 2024-08-18T22:22:47.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.751+0000 7fb975000640 1 -- 172.21.15.5:0/996889128 wait complete. 2024-08-18T22:22:47.772 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:22:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.907+0000 7faf35800640 1 Processor -- start 2024-08-18T22:22:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.907+0000 7faf35800640 1 -- start start 2024-08-18T22:22:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf35800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 0x7faf3006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf35800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faf300cee40 0x7faf300ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf35800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf3015e840 con 0x7faf300ca3e0 2024-08-18T22:22:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf35800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faf3006c900 con 0x7faf300cee40 2024-08-18T22:22:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf35800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf300cf320 con 0x7faf3015e460 2024-08-18T22:22:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf2ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 0x7faf3006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf2e000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faf300cee40 0x7faf300ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf2ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 0x7faf3006c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:35604/0 (socket says 172.21.15.5:35604) 2024-08-18T22:22:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf2ea00640 1 -- 172.21.15.5:0/1899916451 learned_addr learned my addr 172.21.15.5:0/1899916451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf2e000640 1 -- 172.21.15.5:0/1899916451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 msgr2=0x7faf3006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf2e000640 1 --2- 172.21.15.5:0/1899916451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 0x7faf3006c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf2e000640 1 -- 172.21.15.5:0/1899916451 >> v1:172.21.15.117:6789/0 conn(0x7faf300ca3e0 legacy=0x7faf300d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf2e000640 1 -- 172.21.15.5:0/1899916451 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf300cf600 con 0x7faf300cee40 2024-08-18T22:22:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf2ea00640 1 --2- 172.21.15.5:0/1899916451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 0x7faf3006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.911+0000 7faf2d600640 1 -- 172.21.15.5:0/1899916451 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859366536 0 0) 0x7faf3015e840 con 0x7faf300ca3e0 2024-08-18T22:22:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf2e000640 1 --2- 172.21.15.5:0/1899916451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf300cee40 0x7faf300ae040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0097c0 tx=0x7faf1c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d24cfa2a2e688cb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf2d600640 1 -- 172.21.15.5:0/1899916451 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0b5070 con 0x7faf300cee40 2024-08-18T22:22:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf2d600640 1 -- 172.21.15.5:0/1899916451 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c0a8990 con 0x7faf300cee40 2024-08-18T22:22:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf2d600640 1 -- 172.21.15.5:0/1899916451 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0a8d60 con 0x7faf300cee40 2024-08-18T22:22:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 -- 172.21.15.5:0/1899916451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf300cee40 msgr2=0x7faf300ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 --2- 172.21.15.5:0/1899916451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf300cee40 0x7faf300ae040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0097c0 tx=0x7faf1c01ec90 comp rx=0 tx=0).stop 2024-08-18T22:22:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 -- 172.21.15.5:0/1899916451 shutdown_connections 2024-08-18T22:22:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 --2- 172.21.15.5:0/1899916451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf300cee40 0x7faf300ae040 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 --2- 172.21.15.5:0/1899916451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 0x7faf3006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 -- 172.21.15.5:0/1899916451 >> 172.21.15.5:0/1899916451 conn(0x7faf3009aa40 msgr2=0x7faf300b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 -- 172.21.15.5:0/1899916451 shutdown_connections 2024-08-18T22:22:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 -- 172.21.15.5:0/1899916451 wait complete. 2024-08-18T22:22:47.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 Processor -- start 2024-08-18T22:22:47.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 -- start start 2024-08-18T22:22:47.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf300ca3e0 0x7faf300ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf300cee40 0x7faf300b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 0x7faf300b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faf300cfea0 con 0x7faf300ca3e0 2024-08-18T22:22:47.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faf300cfbc0 con 0x7faf300cee40 2024-08-18T22:22:47.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.915+0000 7faf35800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf300b3620 con 0x7faf3015e460 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf300ca3e0 0x7faf300ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf300ca3e0 0x7faf300ae040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55808/0 (socket says 172.21.15.5:55808) 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2ea00640 1 -- 172.21.15.5:0/1744318951 learned_addr learned my addr 172.21.15.5:0/1744318951 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2f400640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 0x7faf300b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2e000640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf300cee40 0x7faf300b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2ea00640 1 -- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 msgr2=0x7faf300b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2ea00640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 0x7faf300b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2ea00640 1 -- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf300cee40 msgr2=0x7faf300b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2ea00640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf300cee40 0x7faf300b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2ea00640 1 -- 172.21.15.5:0/1744318951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf300afeb0 con 0x7faf300ca3e0 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2e000640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf300cee40 0x7faf300b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:47.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf2ea00640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf300ca3e0 0x7faf300ae040 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7faf2000e930 tx=0x7faf2000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:47.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf26a00640 1 -- 172.21.15.5:0/1744318951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20017070 con 0x7faf300ca3e0 2024-08-18T22:22:47.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf26a00640 1 -- 172.21.15.5:0/1744318951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2000ca00 con 0x7faf300ca3e0 2024-08-18T22:22:47.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf35800640 1 -- 172.21.15.5:0/1744318951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf300b0190 con 0x7faf300ca3e0 2024-08-18T22:22:47.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf26a00640 1 -- 172.21.15.5:0/1744318951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2000cdd0 con 0x7faf300ca3e0 2024-08-18T22:22:47.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf35800640 1 -- 172.21.15.5:0/1744318951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf300b0750 con 0x7faf300ca3e0 2024-08-18T22:22:47.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf35800640 1 -- 172.21.15.5:0/1744318951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf300b0ba0 con 0x7faf300ca3e0 2024-08-18T22:22:47.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf26a00640 1 -- 172.21.15.5:0/1744318951 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf2001a070 con 0x7faf300ca3e0 2024-08-18T22:22:47.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf26a00640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf100678c0 0x7faf10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:47.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.919+0000 7faf26a00640 1 -- 172.21.15.5:0/1744318951 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7faf200860e0 con 0x7faf300ca3e0 2024-08-18T22:22:47.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.923+0000 7faf2e000640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf100678c0 0x7faf10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.923+0000 7faf2e000640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf100678c0 0x7faf10069d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0b2000 tx=0x7faf1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:47.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:47.927+0000 7faf26a00640 1 -- 172.21.15.5:0/1744318951 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7faf300b0ba0 con 0x7faf300ca3e0 2024-08-18T22:22:48.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 -- 172.21.15.5:0/1744318951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf300afbd0 con 0x7faf300ca3e0 2024-08-18T22:22:48.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf26a00640 1 -- 172.21.15.5:0/1744318951 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5221 (secure 0 0 0) 0x7faf20056a90 con 0x7faf300ca3e0 2024-08-18T22:22:48.131 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:48.131 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"btime":"2024-08-18T22:22:44:539948+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3185015921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3185015921},{"type":"v1","addr":"172.21.15.117:6837","nonce":3185015921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3679281629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3679281629},{"type":"v1","addr":"172.21.15.117:6836","nonce":3679281629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/649845928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":649845928},{"type":"v1","addr":"172.21.15.5:6833","nonce":649845928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:22:10.822677+0000","modified":"2024-08-18T22:22:43.716170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.5:6835/3590404197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3590404197},{"type":"v1","addr":"172.21.15.5:6835","nonce":3590404197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5370,"qdb_cluster":[5370]},"id":3}]} 2024-08-18T22:22:48.131 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2024-08-18T22:22:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 -- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf100678c0 msgr2=0x7faf10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf100678c0 0x7faf10069d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0b2000 tx=0x7faf1c008040 comp rx=0 tx=0).stop 2024-08-18T22:22:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 -- 172.21.15.5:0/1744318951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf300ca3e0 msgr2=0x7faf300ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf300ca3e0 0x7faf300ae040 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7faf2000e930 tx=0x7faf2000edf0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 -- 172.21.15.5:0/1744318951 shutdown_connections 2024-08-18T22:22:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf100678c0 0x7faf10069d80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf3015e460 0x7faf300b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf300cee40 0x7faf300b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 --2- 172.21.15.5:0/1744318951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf300ca3e0 0x7faf300ae040 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 -- 172.21.15.5:0/1744318951 >> 172.21.15.5:0/1744318951 conn(0x7faf3009aa40 msgr2=0x7faf300ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 -- 172.21.15.5:0/1744318951 shutdown_connections 2024-08-18T22:22:48.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.127+0000 7faf35800640 1 -- 172.21.15.5:0/1744318951 wait complete. 2024-08-18T22:22:48.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:22:48.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.287+0000 7f07ba200640 1 Processor -- start 2024-08-18T22:22:48.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.287+0000 7f07ba200640 1 -- start start 2024-08-18T22:22:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07ba200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07b4161d40 0x7f07b415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07ba200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b40c92d0 0x7f07b40c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07ba200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b4162300 con 0x7f07b41618d0 2024-08-18T22:22:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07ba200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f07b40c9c60 con 0x7f07b4161d40 2024-08-18T22:22:48.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07ba200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07b41625e0 con 0x7f07b40c92d0 2024-08-18T22:22:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07b2a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07b4161d40 0x7f07b415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07b3400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f07b41618d0 0x7f07b415f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54420/0 (socket says 172.21.15.5:54420) 2024-08-18T22:22:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07b3400640 1 -- 172.21.15.5:0/1140357858 learned_addr learned my addr 172.21.15.5:0/1140357858 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07b3e00640 1 --2- 172.21.15.5:0/1140357858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b40c92d0 0x7f07b40c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07b2a00640 1 -- 172.21.15.5:0/1140357858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b40c92d0 msgr2=0x7f07b40c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07b2a00640 1 --2- 172.21.15.5:0/1140357858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b40c92d0 0x7f07b40c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07b2a00640 1 -- 172.21.15.5:0/1140357858 >> v1:172.21.15.5:6789/0 conn(0x7f07b41618d0 legacy=0x7f07b415f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07b2a00640 1 -- 172.21.15.5:0/1140357858 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b41628c0 con 0x7f07b4161d40 2024-08-18T22:22:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07b2000640 1 -- 172.21.15.5:0/1140357858 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261481167 0 0) 0x7f07b4162300 con 0x7f07b41618d0 2024-08-18T22:22:48.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.291+0000 7f07b3e00640 1 --2- 172.21.15.5:0/1140357858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b40c92d0 0x7f07b40c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:48.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07b2a00640 1 --2- 172.21.15.5:0/1140357858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b4161d40 0x7f07b415f1d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f07a00097c0 tx=0x7f07a001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ef4f2c6eb41138 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:48.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07b2000640 1 -- 172.21.15.5:0/1140357858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a00b0070 con 0x7f07b4161d40 2024-08-18T22:22:48.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07b2000640 1 -- 172.21.15.5:0/1140357858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a00ab600 con 0x7f07b4161d40 2024-08-18T22:22:48.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07b2000640 1 -- 172.21.15.5:0/1140357858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a00ab9d0 con 0x7f07b4161d40 2024-08-18T22:22:48.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07ba200640 1 -- 172.21.15.5:0/1140357858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b4161d40 msgr2=0x7f07b415f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07ba200640 1 --2- 172.21.15.5:0/1140357858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b4161d40 0x7f07b415f1d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f07a00097c0 tx=0x7f07a001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07ba200640 1 -- 172.21.15.5:0/1140357858 shutdown_connections 2024-08-18T22:22:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07ba200640 1 --2- 172.21.15.5:0/1140357858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b40c92d0 0x7f07b40c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07ba200640 1 --2- 172.21.15.5:0/1140357858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b4161d40 0x7f07b415f1d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07ba200640 1 -- 172.21.15.5:0/1140357858 >> 172.21.15.5:0/1140357858 conn(0x7f07b40b1c50 msgr2=0x7f07b40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07ba200640 1 -- 172.21.15.5:0/1140357858 shutdown_connections 2024-08-18T22:22:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07ba200640 1 -- 172.21.15.5:0/1140357858 wait complete. 2024-08-18T22:22:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07ba200640 1 Processor -- start 2024-08-18T22:22:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.295+0000 7f07ba200640 1 -- start start 2024-08-18T22:22:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ba200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40c92d0 0x7f07b4071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ba200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b41618d0 0x7f07b415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ba200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07b4161d40 0x7f07b4154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ba200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f07b416b0e0 con 0x7f07b40c92d0 2024-08-18T22:22:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ba200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f07b40cf280 con 0x7f07b4161d40 2024-08-18T22:22:48.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ba200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07b416b260 con 0x7f07b41618d0 2024-08-18T22:22:48.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40c92d0 0x7f07b4071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:48.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40c92d0 0x7f07b4071900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55826/0 (socket says 172.21.15.5:55826) 2024-08-18T22:22:48.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b3400640 1 -- 172.21.15.5:0/1012141980 learned_addr learned my addr 172.21.15.5:0/1012141980 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:48.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b3e00640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07b4161d40 0x7f07b4154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:48.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b2a00640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b41618d0 0x7f07b415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:48.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b3400640 1 -- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b41618d0 msgr2=0x7f07b415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b3400640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b41618d0 0x7f07b415dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b3400640 1 -- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07b4161d40 msgr2=0x7f07b4154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b3400640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07b4161d40 0x7f07b4154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b3400640 1 -- 172.21.15.5:0/1012141980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b415c1a0 con 0x7f07b40c92d0 2024-08-18T22:22:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b2a00640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b41618d0 0x7f07b415dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07b3400640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40c92d0 0x7f07b4071900 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f07a400c520 tx=0x7f07a400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ab400640 1 -- 172.21.15.5:0/1012141980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4018070 con 0x7f07b40c92d0 2024-08-18T22:22:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ab400640 1 -- 172.21.15.5:0/1012141980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a40074e0 con 0x7f07b40c92d0 2024-08-18T22:22:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ba200640 1 -- 172.21.15.5:0/1012141980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b40ccd00 con 0x7f07b40c92d0 2024-08-18T22:22:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ab400640 1 -- 172.21.15.5:0/1012141980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a40049f0 con 0x7f07b40c92d0 2024-08-18T22:22:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ba200640 1 -- 172.21.15.5:0/1012141980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b415c7d0 con 0x7f07b40c92d0 2024-08-18T22:22:48.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.299+0000 7f07ba200640 1 -- 172.21.15.5:0/1012141980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b406df80 con 0x7f07b40c92d0 2024-08-18T22:22:48.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.303+0000 7f07ab400640 1 -- 172.21.15.5:0/1012141980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07a4004b90 con 0x7f07b40c92d0 2024-08-18T22:22:48.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.303+0000 7f07ab400640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 0x7f0794069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:48.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.303+0000 7f07ab400640 1 -- 172.21.15.5:0/1012141980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f07a4085120 con 0x7f07b40c92d0 2024-08-18T22:22:48.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.303+0000 7f07b2a00640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 0x7f0794069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:48.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.303+0000 7f07b2a00640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 0x7f0794069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f07a00ad000 tx=0x7f07a00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:48.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.307+0000 7f07ab400640 1 -- 172.21.15.5:0/1012141980 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f07a40553f0 con 0x7f07b40c92d0 2024-08-18T22:22:48.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.471+0000 7f07ba200640 1 -- 172.21.15.5:0/1012141980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07b415e600 con 0x7f07b40c92d0 2024-08-18T22:22:48.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ab400640 1 -- 172.21.15.5:0/1012141980 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+16870 (secure 0 0 0) 0x7f07a40596f0 con 0x7f07b40c92d0 2024-08-18T22:22:48.478 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:48.479 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:22:12.427264+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:22:08.577033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-08-18T22:22:09.824932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:22:48.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 -- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 msgr2=0x7f0794069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 0x7f0794069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f07a00ad000 tx=0x7f07a00a6000 comp rx=0 tx=0).stop 2024-08-18T22:22:48.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 -- 172.21.15.5:0/1012141980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40c92d0 msgr2=0x7f07b4071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40c92d0 0x7f07b4071900 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f07a400c520 tx=0x7f07a400c9e0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 -- 172.21.15.5:0/1012141980 shutdown_connections 2024-08-18T22:22:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 0x7f0794069d80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07b4161d40 0x7f07b4154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b41618d0 0x7f07b415dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 --2- 172.21.15.5:0/1012141980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b40c92d0 0x7f07b4071900 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 -- 172.21.15.5:0/1012141980 >> 172.21.15.5:0/1012141980 conn(0x7f07b40b1c50 msgr2=0x7f07b40b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 -- 172.21.15.5:0/1012141980 shutdown_connections 2024-08-18T22:22:48.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.475+0000 7f07ba200640 1 -- 172.21.15.5:0/1012141980 wait complete. 2024-08-18T22:22:48.501 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:22:48.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:22:48.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ed6000640 1 Processor -- start 2024-08-18T22:22:48.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ed6000640 1 -- start start 2024-08-18T22:22:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ed6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ed009b520 0x7f9ed015f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ed6000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed009b9b0 con 0x7f9ed0070510 2024-08-18T22:22:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ed6000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed006fe70 con 0x7f9ed00d02a0 2024-08-18T22:22:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ed6000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed015f670 con 0x7f9ed009b520 2024-08-18T22:22:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ecfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ed009b520 0x7f9ed015f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ecfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ed009b520 0x7f9ed015f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55832/0 (socket says 172.21.15.5:55832) 2024-08-18T22:22:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ecfe00640 1 -- 172.21.15.5:0/2443252238 learned_addr learned my addr 172.21.15.5:0/2443252238 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ecfe00640 1 -- 172.21.15.5:0/2443252238 >> v1:172.21.15.117:6789/0 conn(0x7f9ed00d02a0 legacy=0x7f9ed00d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ecfe00640 1 -- 172.21.15.5:0/2443252238 >> v1:172.21.15.5:6789/0 conn(0x7f9ed0070510 legacy=0x7f9ed00708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.639+0000 7f9ecfe00640 1 -- 172.21.15.5:0/2443252238 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed0070150 con 0x7f9ed009b520 2024-08-18T22:22:48.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ecfe00640 1 --2- 172.21.15.5:0/2443252238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ed009b520 0x7f9ed015f130 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009870 tx=0x7f9ebc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f6f6288f5c979c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ecf400640 1 -- 172.21.15.5:0/2443252238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0ab610 con 0x7f9ed009b520 2024-08-18T22:22:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ecf400640 1 -- 172.21.15.5:0/2443252238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ebc0b0070 con 0x7f9ed009b520 2024-08-18T22:22:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ecf400640 1 -- 172.21.15.5:0/2443252238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0ab9d0 con 0x7f9ed009b520 2024-08-18T22:22:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ed6000640 1 -- 172.21.15.5:0/2443252238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ed009b520 msgr2=0x7f9ed015f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ed6000640 1 --2- 172.21.15.5:0/2443252238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ed009b520 0x7f9ed015f130 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009870 tx=0x7f9ebc01c520 comp rx=0 tx=0).stop 2024-08-18T22:22:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ed6000640 1 -- 172.21.15.5:0/2443252238 shutdown_connections 2024-08-18T22:22:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ed6000640 1 --2- 172.21.15.5:0/2443252238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ed009b520 0x7f9ed015f130 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ed6000640 1 -- 172.21.15.5:0/2443252238 >> 172.21.15.5:0/2443252238 conn(0x7f9ed00b3a20 msgr2=0x7f9ed00b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ed6000640 1 -- 172.21.15.5:0/2443252238 shutdown_connections 2024-08-18T22:22:48.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ed6000640 1 -- 172.21.15.5:0/2443252238 wait complete. 2024-08-18T22:22:48.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ed6000640 1 Processor -- start 2024-08-18T22:22:48.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.643+0000 7f9ed6000640 1 -- start start 2024-08-18T22:22:48.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ed0070510 0x7f9ed0162710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed6000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ed009b520 0x7f9ed0158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed6000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ed00d02a0 0x7f9ed00c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed6000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed00b46d0 con 0x7f9ed0070510 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed6000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed006fb00 con 0x7f9ed009b520 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed6000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed00b4850 con 0x7f9ed00d02a0 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ed0070510 0x7f9ed0162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ed0070510 0x7f9ed0162710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55838/0 (socket says 172.21.15.5:55838) 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed4c00640 1 -- 172.21.15.5:0/495875541 learned_addr learned my addr 172.21.15.5:0/495875541 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ecfe00640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ed009b520 0x7f9ed0158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed5600640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ed00d02a0 0x7f9ed00c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed4c00640 1 -- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ed00d02a0 msgr2=0x7f9ed00c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed4c00640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ed00d02a0 0x7f9ed00c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed4c00640 1 -- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ed009b520 msgr2=0x7f9ed0158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed4c00640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ed009b520 0x7f9ed0158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed4c00640 1 -- 172.21.15.5:0/495875541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed0161480 con 0x7f9ed0070510 2024-08-18T22:22:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ecfe00640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ed009b520 0x7f9ed0158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:48.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed4c00640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ed0070510 0x7f9ed0162710 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400c420 tx=0x7f9ec400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9eccc00640 1 -- 172.21.15.5:0/495875541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40052d0 con 0x7f9ed0070510 2024-08-18T22:22:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9eccc00640 1 -- 172.21.15.5:0/495875541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec4005470 con 0x7f9ed0070510 2024-08-18T22:22:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9eccc00640 1 -- 172.21.15.5:0/495875541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4007260 con 0x7f9ed0070510 2024-08-18T22:22:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed6000640 1 -- 172.21.15.5:0/495875541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed0161760 con 0x7f9ed0070510 2024-08-18T22:22:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed6000640 1 -- 172.21.15.5:0/495875541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed0161d20 con 0x7f9ed0070510 2024-08-18T22:22:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9ed6000640 1 -- 172.21.15.5:0/495875541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed015f130 con 0x7f9ed0070510 2024-08-18T22:22:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.647+0000 7f9eccc00640 1 -- 172.21.15.5:0/495875541 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ec4007400 con 0x7f9ed0070510 2024-08-18T22:22:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.651+0000 7f9eccc00640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9eb00678c0 0x7f9eb0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.651+0000 7f9eccc00640 1 -- 172.21.15.5:0/495875541 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f9ec40853b0 con 0x7f9ed0070510 2024-08-18T22:22:48.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.651+0000 7f9ecfe00640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9eb00678c0 0x7f9eb0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:48.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.651+0000 7f9ecfe00640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9eb00678c0 0x7f9eb0069d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0af000 tx=0x7f9ebc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:48.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.655+0000 7f9eccc00640 1 -- 172.21.15.5:0/495875541 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9ec4055d50 con 0x7f9ed0070510 2024-08-18T22:22:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 -- 172.21.15.5:0/495875541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ed0073d40 con 0x7f9ed0070510 2024-08-18T22:22:48.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9eccc00640 1 -- 172.21.15.5:0/495875541 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5221 (secure 0 0 0) 0x7f9ec4055650 con 0x7f9ed0070510 2024-08-18T22:22:48.859 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:48.859 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"btime":"2024-08-18T22:22:48:599119+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3185015921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3185015921},{"type":"v1","addr":"172.21.15.117:6837","nonce":3185015921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3679281629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3679281629},{"type":"v1","addr":"172.21.15.117:6836","nonce":3679281629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/649845928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":649845928},{"type":"v1","addr":"172.21.15.5:6833","nonce":649845928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:22:10.822677+0000","modified":"2024-08-18T22:22:47.715515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.5:6835/3590404197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3590404197},{"type":"v1","addr":"172.21.15.5:6835","nonce":3590404197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5370,"qdb_cluster":[5370]},"id":3}]} 2024-08-18T22:22:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-08-18T22:22:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 -- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9eb00678c0 msgr2=0x7f9eb0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9eb00678c0 0x7f9eb0069d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0af000 tx=0x7f9ebc0a7000 comp rx=0 tx=0).stop 2024-08-18T22:22:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 -- 172.21.15.5:0/495875541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ed0070510 msgr2=0x7f9ed0162710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ed0070510 0x7f9ed0162710 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400c420 tx=0x7f9ec400c8e0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 -- 172.21.15.5:0/495875541 shutdown_connections 2024-08-18T22:22:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9eb00678c0 0x7f9eb0069d80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ed00d02a0 0x7f9ed00c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ed009b520 0x7f9ed0158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 --2- 172.21.15.5:0/495875541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ed0070510 0x7f9ed0162710 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 -- 172.21.15.5:0/495875541 >> 172.21.15.5:0/495875541 conn(0x7f9ed00b3a20 msgr2=0x7f9ed006d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 -- 172.21.15.5:0/495875541 shutdown_connections 2024-08-18T22:22:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:48.855+0000 7f9ed6000640 1 -- 172.21.15.5:0/495875541 wait complete. 2024-08-18T22:22:48.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:22:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.015+0000 7f9f56c00640 1 Processor -- start 2024-08-18T22:22:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.015+0000 7f9f56c00640 1 -- start start 2024-08-18T22:22:49.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f56c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9f5015bed0 0x7f9f500735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f56c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f500cb390 0x7f9f50071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f56c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f5006da70 0x7f9f5006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f56c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9f5006e420 con 0x7f9f500cb390 2024-08-18T22:22:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f56c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9f50072060 con 0x7f9f5015bed0 2024-08-18T22:22:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f56c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9f50073c80 con 0x7f9f5006da70 2024-08-18T22:22:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f4f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f500cb390 0x7f9f50071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f4f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f500cb390 0x7f9f50071b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55846/0 (socket says 172.21.15.5:55846) 2024-08-18T22:22:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f4f400640 1 -- 172.21.15.5:0/1938129025 learned_addr learned my addr 172.21.15.5:0/1938129025 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f54c00640 1 --2- 172.21.15.5:0/1938129025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f5006da70 0x7f9f5006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f4fe00640 1 --2- 172.21.15.5:0/1938129025 >> v2:172.21.15.117:3300/0 conn(0x7f9f5015bed0 0x7f9f500735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f4f400640 1 -- 172.21.15.5:0/1938129025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f5006da70 msgr2=0x7f9f5006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f4f400640 1 --2- 172.21.15.5:0/1938129025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f5006da70 0x7f9f5006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f4f400640 1 -- 172.21.15.5:0/1938129025 >> v2:172.21.15.117:3300/0 conn(0x7f9f5015bed0 msgr2=0x7f9f500735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f4f400640 1 --2- 172.21.15.5:0/1938129025 >> v2:172.21.15.117:3300/0 conn(0x7f9f5015bed0 0x7f9f500735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f4f400640 1 -- 172.21.15.5:0/1938129025 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f500ca5d0 con 0x7f9f500cb390 2024-08-18T22:22:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f54c00640 1 --2- 172.21.15.5:0/1938129025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f5006da70 0x7f9f5006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.019+0000 7f9f4fe00640 1 --2- 172.21.15.5:0/1938129025 >> v2:172.21.15.117:3300/0 conn(0x7f9f5015bed0 0x7f9f500735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f4f400640 1 --2- 172.21.15.5:0/1938129025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f500cb390 0x7f9f50071b20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9f500b2cc0 tx=0x7f9f3c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46afcf7565fc6792 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:49.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f4ea00640 1 -- 172.21.15.5:0/1938129025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0aa610 con 0x7f9f500cb390 2024-08-18T22:22:49.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f4ea00640 1 -- 172.21.15.5:0/1938129025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f3c0af070 con 0x7f9f500cb390 2024-08-18T22:22:49.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f4ea00640 1 -- 172.21.15.5:0/1938129025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0aa9d0 con 0x7f9f500cb390 2024-08-18T22:22:49.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f56c00640 1 -- 172.21.15.5:0/1938129025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f500cb390 msgr2=0x7f9f50071b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f56c00640 1 --2- 172.21.15.5:0/1938129025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f500cb390 0x7f9f50071b20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9f500b2cc0 tx=0x7f9f3c01c4f0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f56c00640 1 -- 172.21.15.5:0/1938129025 shutdown_connections 2024-08-18T22:22:49.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f56c00640 1 --2- 172.21.15.5:0/1938129025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f5006da70 0x7f9f5006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f56c00640 1 --2- 172.21.15.5:0/1938129025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f500cb390 0x7f9f50071b20 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f56c00640 1 --2- 172.21.15.5:0/1938129025 >> v2:172.21.15.117:3300/0 conn(0x7f9f5015bed0 0x7f9f500735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f56c00640 1 -- 172.21.15.5:0/1938129025 >> 172.21.15.5:0/1938129025 conn(0x7f9f500b1c50 msgr2=0x7f9f500b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f56c00640 1 -- 172.21.15.5:0/1938129025 shutdown_connections 2024-08-18T22:22:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f56c00640 1 -- 172.21.15.5:0/1938129025 wait complete. 2024-08-18T22:22:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f56c00640 1 Processor -- start 2024-08-18T22:22:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.023+0000 7f9f56c00640 1 -- start start 2024-08-18T22:22:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f56c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5006da70 0x7f9f50148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f56c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f500cb390 0x7f9f50158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f56c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f5015bed0 0x7f9f500c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f56c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5015c430 con 0x7f9f5006da70 2024-08-18T22:22:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f56c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5015c2b0 con 0x7f9f500cb390 2024-08-18T22:22:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f56c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9f500ccac0 con 0x7f9f5015bed0 2024-08-18T22:22:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5006da70 0x7f9f50148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5006da70 0x7f9f50148aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55860/0 (socket says 172.21.15.5:55860) 2024-08-18T22:22:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f4fe00640 1 -- 172.21.15.5:0/872055516 learned_addr learned my addr 172.21.15.5:0/872055516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f54c00640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f5015bed0 0x7f9f500c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f4f400640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f500cb390 0x7f9f50158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f4fe00640 1 -- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f5015bed0 msgr2=0x7f9f500c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f4fe00640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f5015bed0 0x7f9f500c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f4fe00640 1 -- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f500cb390 msgr2=0x7f9f50158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f4fe00640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f500cb390 0x7f9f50158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f4fe00640 1 -- 172.21.15.5:0/872055516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f50148fe0 con 0x7f9f5006da70 2024-08-18T22:22:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f4fe00640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5006da70 0x7f9f50148aa0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000c820 tx=0x7f9f4000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f47e00640 1 -- 172.21.15.5:0/872055516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40015070 con 0x7f9f5006da70 2024-08-18T22:22:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f47e00640 1 -- 172.21.15.5:0/872055516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f40007a30 con 0x7f9f5006da70 2024-08-18T22:22:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f47e00640 1 -- 172.21.15.5:0/872055516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40007e40 con 0x7f9f5006da70 2024-08-18T22:22:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f56c00640 1 -- 172.21.15.5:0/872055516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f501560e0 con 0x7f9f5006da70 2024-08-18T22:22:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f56c00640 1 -- 172.21.15.5:0/872055516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f501566a0 con 0x7f9f5006da70 2024-08-18T22:22:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f56c00640 1 -- 172.21.15.5:0/872055516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f500cce30 con 0x7f9f5006da70 2024-08-18T22:22:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.027+0000 7f9f47e00640 1 -- 172.21.15.5:0/872055516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9f40018070 con 0x7f9f5006da70 2024-08-18T22:22:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.031+0000 7f9f47e00640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9f300678c0 0x7f9f30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.031+0000 7f9f47e00640 1 -- 172.21.15.5:0/872055516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f9f40085bd0 con 0x7f9f5006da70 2024-08-18T22:22:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.031+0000 7f9f4f400640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9f300678c0 0x7f9f30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.031+0000 7f9f4f400640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9f300678c0 0x7f9f30069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0ae000 tx=0x7f9f3c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.035+0000 7f9f47e00640 1 -- 172.21.15.5:0/872055516 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9f40055f20 con 0x7f9f5006da70 2024-08-18T22:22:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.231+0000 7f9f56c00640 1 -- 172.21.15.5:0/872055516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f500cdb50 con 0x7f9f5006da70 2024-08-18T22:22:49.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f47e00640 1 -- 172.21.15.5:0/872055516 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5221 (secure 0 0 0) 0x7f9f4005a220 con 0x7f9f5006da70 2024-08-18T22:22:49.238 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:49.238 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"btime":"2024-08-18T22:22:48:599119+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3185015921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3185015921},{"type":"v1","addr":"172.21.15.117:6837","nonce":3185015921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3679281629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3679281629},{"type":"v1","addr":"172.21.15.117:6836","nonce":3679281629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/649845928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":649845928},{"type":"v1","addr":"172.21.15.5:6833","nonce":649845928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:22:10.822677+0000","modified":"2024-08-18T22:22:47.715515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.5:6835/3590404197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3590404197},{"type":"v1","addr":"172.21.15.5:6835","nonce":3590404197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5370,"qdb_cluster":[5370]},"id":3}]} 2024-08-18T22:22:49.238 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-08-18T22:22:49.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 -- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9f300678c0 msgr2=0x7f9f30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9f300678c0 0x7f9f30069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0ae000 tx=0x7f9f3c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:22:49.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 -- 172.21.15.5:0/872055516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5006da70 msgr2=0x7f9f50148aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5006da70 0x7f9f50148aa0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000c820 tx=0x7f9f4000cce0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 -- 172.21.15.5:0/872055516 shutdown_connections 2024-08-18T22:22:49.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9f300678c0 0x7f9f30069d80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9f5015bed0 0x7f9f500c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f500cb390 0x7f9f50158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 --2- 172.21.15.5:0/872055516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f5006da70 0x7f9f50148aa0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 -- 172.21.15.5:0/872055516 >> 172.21.15.5:0/872055516 conn(0x7f9f500b1c50 msgr2=0x7f9f500ad0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 -- 172.21.15.5:0/872055516 shutdown_connections 2024-08-18T22:22:49.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.235+0000 7f9f56c00640 1 -- 172.21.15.5:0/872055516 wait complete. 2024-08-18T22:22:49.258 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:22:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b1d200640 1 Processor -- start 2024-08-18T22:22:49.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b1d200640 1 -- start start 2024-08-18T22:22:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b1d200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b1815e460 0x7f1b1806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b1d200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b180ca3e0 0x7f1b180ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b1d200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b1815e840 con 0x7f1b180cee40 2024-08-18T22:22:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b1d200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1b180ae750 con 0x7f1b1815e460 2024-08-18T22:22:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b1d200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1806c900 con 0x7f1b180ca3e0 2024-08-18T22:22:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b15e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b1815e460 0x7f1b1806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b15e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b1815e460 0x7f1b1806c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55874/0 (socket says 172.21.15.5:55874) 2024-08-18T22:22:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b15e00640 1 -- 172.21.15.5:0/3377953611 learned_addr learned my addr 172.21.15.5:0/3377953611 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b16800640 1 --2- 172.21.15.5:0/3377953611 >> v2:172.21.15.117:3300/0 conn(0x7f1b180ca3e0 0x7f1b180ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b15e00640 1 -- 172.21.15.5:0/3377953611 >> v2:172.21.15.117:3300/0 conn(0x7f1b180ca3e0 msgr2=0x7f1b180ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b15e00640 1 --2- 172.21.15.5:0/3377953611 >> v2:172.21.15.117:3300/0 conn(0x7f1b180ca3e0 0x7f1b180ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b15e00640 1 -- 172.21.15.5:0/3377953611 >> v1:172.21.15.117:6789/0 conn(0x7f1b180cee40 legacy=0x7f1b180ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b15e00640 1 -- 172.21.15.5:0/3377953611 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b180cf320 con 0x7f1b1815e460 2024-08-18T22:22:49.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.395+0000 7f1b16800640 1 --2- 172.21.15.5:0/3377953611 >> v2:172.21.15.117:3300/0 conn(0x7f1b180ca3e0 0x7f1b180ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:22:49.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b15e00640 1 --2- 172.21.15.5:0/3377953611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b1815e460 0x7f1b1806c3c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1b18072b50 tx=0x7f1b0801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af92233e8863501 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b15400640 1 -- 172.21.15.5:0/3377953611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080b5070 con 0x7f1b1815e460 2024-08-18T22:22:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b15400640 1 -- 172.21.15.5:0/3377953611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b080a89d0 con 0x7f1b1815e460 2024-08-18T22:22:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b15400640 1 -- 172.21.15.5:0/3377953611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080a8da0 con 0x7f1b1815e460 2024-08-18T22:22:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b1d200640 1 -- 172.21.15.5:0/3377953611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b1815e460 msgr2=0x7f1b1806c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b1d200640 1 --2- 172.21.15.5:0/3377953611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b1815e460 0x7f1b1806c3c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1b18072b50 tx=0x7f1b0801ecd0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b1d200640 1 -- 172.21.15.5:0/3377953611 shutdown_connections 2024-08-18T22:22:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b1d200640 1 --2- 172.21.15.5:0/3377953611 >> v2:172.21.15.117:3300/0 conn(0x7f1b180ca3e0 0x7f1b180ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b1d200640 1 --2- 172.21.15.5:0/3377953611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b1815e460 0x7f1b1806c3c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b1d200640 1 -- 172.21.15.5:0/3377953611 >> 172.21.15.5:0/3377953611 conn(0x7f1b1809aa40 msgr2=0x7f1b180b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b1d200640 1 -- 172.21.15.5:0/3377953611 shutdown_connections 2024-08-18T22:22:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.399+0000 7f1b1d200640 1 -- 172.21.15.5:0/3377953611 wait complete. 2024-08-18T22:22:49.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b1d200640 1 Processor -- start 2024-08-18T22:22:49.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b1d200640 1 -- start start 2024-08-18T22:22:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b1d200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b180ca3e0 0x7f1b181f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b1d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b180cee40 0x7f1b181f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b1d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b1815e460 0x7f1b180b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b1d200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1b180cfbc0 con 0x7f1b180cee40 2024-08-18T22:22:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b1d200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1b180cf8e0 con 0x7f1b180ca3e0 2024-08-18T22:22:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b1d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1b180cfea0 con 0x7f1b1815e460 2024-08-18T22:22:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b180cee40 0x7f1b181f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b15e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b180ca3e0 0x7f1b181f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b180cee40 0x7f1b181f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55878/0 (socket says 172.21.15.5:55878) 2024-08-18T22:22:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b15e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b180ca3e0 0x7f1b181f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:43874/0 (socket says 172.21.15.5:43874) 2024-08-18T22:22:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0d400640 1 -- 172.21.15.5:0/2765684908 learned_addr learned my addr 172.21.15.5:0/2765684908 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b16800640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b1815e460 0x7f1b180b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0d400640 1 -- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b1815e460 msgr2=0x7f1b180b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0d400640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b1815e460 0x7f1b180b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0d400640 1 -- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b180ca3e0 msgr2=0x7f1b181f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0d400640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b180ca3e0 0x7f1b181f67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0d400640 1 -- 172.21.15.5:0/2765684908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b181f5740 con 0x7f1b180cee40 2024-08-18T22:22:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0d400640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b180cee40 0x7f1b181f4cf0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000c450 tx=0x7f1b0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0ea00640 1 -- 172.21.15.5:0/2765684908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00012830 con 0x7f1b180cee40 2024-08-18T22:22:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0ea00640 1 -- 172.21.15.5:0/2765684908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b00017070 con 0x7f1b180cee40 2024-08-18T22:22:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b0ea00640 1 -- 172.21.15.5:0/2765684908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00012c30 con 0x7f1b180cee40 2024-08-18T22:22:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b1d200640 1 -- 172.21.15.5:0/2765684908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b181f5a20 con 0x7f1b180cee40 2024-08-18T22:22:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.403+0000 7f1b1d200640 1 -- 172.21.15.5:0/2765684908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b181f5fe0 con 0x7f1b180cee40 2024-08-18T22:22:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.407+0000 7f1b1d200640 1 -- 172.21.15.5:0/2765684908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b180b3620 con 0x7f1b180cee40 2024-08-18T22:22:49.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.407+0000 7f1b0ea00640 1 -- 172.21.15.5:0/2765684908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b0001c460 con 0x7f1b180cee40 2024-08-18T22:22:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.407+0000 7f1b0ea00640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1af4067940 0x7f1af4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.407+0000 7f1b0ea00640 1 -- 172.21.15.5:0/2765684908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f1b00085960 con 0x7f1b180cee40 2024-08-18T22:22:49.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.407+0000 7f1b15e00640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1af4067940 0x7f1af4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.411+0000 7f1b15e00640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1af4067940 0x7f1af4069e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1b080b2000 tx=0x7f1b08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:49.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.411+0000 7f1b0ea00640 1 -- 172.21.15.5:0/2765684908 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1b00055da0 con 0x7f1b180cee40 2024-08-18T22:22:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.575+0000 7f1b1d200640 1 -- 172.21.15.5:0/2765684908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b180aeef0 con 0x7f1b180cee40 2024-08-18T22:22:49.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b0ea00640 1 -- 172.21.15.5:0/2765684908 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+16870 (secure 0 0 0) 0x7f1b0005a0a0 con 0x7f1b180cee40 2024-08-18T22:22:49.582 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:49.582 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:22:12.427264+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:22:08.577033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-08-18T22:22:09.824932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:22:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 -- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1af4067940 msgr2=0x7f1af4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1af4067940 0x7f1af4069e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1b080b2000 tx=0x7f1b08009040 comp rx=0 tx=0).stop 2024-08-18T22:22:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 -- 172.21.15.5:0/2765684908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b180cee40 msgr2=0x7f1b181f4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b180cee40 0x7f1b181f4cf0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000c450 tx=0x7f1b0000c910 comp rx=0 tx=0).stop 2024-08-18T22:22:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 -- 172.21.15.5:0/2765684908 shutdown_connections 2024-08-18T22:22:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1af4067940 0x7f1af4069e00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b1815e460 0x7f1b180b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b180cee40 0x7f1b181f4cf0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 --2- 172.21.15.5:0/2765684908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b180ca3e0 0x7f1b181f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 -- 172.21.15.5:0/2765684908 >> 172.21.15.5:0/2765684908 conn(0x7f1b1809aa40 msgr2=0x7f1b180af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 -- 172.21.15.5:0/2765684908 shutdown_connections 2024-08-18T22:22:49.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.579+0000 7f1b1d200640 1 -- 172.21.15.5:0/2765684908 wait complete. 2024-08-18T22:22:49.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:22:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7ad3200640 1 Processor -- start 2024-08-18T22:22:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7ad3200640 1 -- start start 2024-08-18T22:22:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7ad3200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ad415fb20 0x7f7ad406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7ad3200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad4160000 con 0x7f7ad4145420 2024-08-18T22:22:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7ad3200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad41602e0 con 0x7f7ad406fe60 2024-08-18T22:22:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7ad3200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad41605c0 con 0x7f7ad415fb20 2024-08-18T22:22:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7acbe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ad415fb20 0x7f7ad406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7ad1e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7ad4145420 0x7f7ad4072de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54434/0 (socket says 172.21.15.5:54434) 2024-08-18T22:22:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7ad1e00640 1 -- 172.21.15.5:0/3343644094 learned_addr learned my addr 172.21.15.5:0/3343644094 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7acbe00640 1 -- 172.21.15.5:0/3343644094 >> v1:172.21.15.117:6789/0 conn(0x7f7ad406fe60 legacy=0x7f7ad40cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7acbe00640 1 -- 172.21.15.5:0/3343644094 >> v1:172.21.15.5:6789/0 conn(0x7f7ad4145420 legacy=0x7f7ad4072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.743+0000 7f7acbe00640 1 -- 172.21.15.5:0/3343644094 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad41608a0 con 0x7f7ad415fb20 2024-08-18T22:22:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7acbe00640 1 --2- 172.21.15.5:0/3343644094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad415fb20 0x7f7ad406b9b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0097c0 tx=0x7f7abc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cb6808b7096a22 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad1400640 1 -- 172.21.15.5:0/3343644094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0b0070 con 0x7f7ad415fb20 2024-08-18T22:22:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad1400640 1 -- 172.21.15.5:0/3343644094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7abc0ab600 con 0x7f7ad415fb20 2024-08-18T22:22:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad1400640 1 -- 172.21.15.5:0/3343644094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0ab9d0 con 0x7f7ad415fb20 2024-08-18T22:22:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad3200640 1 -- 172.21.15.5:0/3343644094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad415fb20 msgr2=0x7f7ad406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad3200640 1 --2- 172.21.15.5:0/3343644094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad415fb20 0x7f7ad406b9b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0097c0 tx=0x7f7abc01c460 comp rx=0 tx=0).stop 2024-08-18T22:22:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad3200640 1 -- 172.21.15.5:0/3343644094 shutdown_connections 2024-08-18T22:22:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad3200640 1 --2- 172.21.15.5:0/3343644094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad415fb20 0x7f7ad406b9b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad3200640 1 -- 172.21.15.5:0/3343644094 >> 172.21.15.5:0/3343644094 conn(0x7f7ad40d1000 msgr2=0x7f7ad40d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad3200640 1 -- 172.21.15.5:0/3343644094 shutdown_connections 2024-08-18T22:22:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad3200640 1 -- 172.21.15.5:0/3343644094 wait complete. 2024-08-18T22:22:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad3200640 1 Processor -- start 2024-08-18T22:22:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.747+0000 7f7ad3200640 1 -- start start 2024-08-18T22:22:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad3200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ad406fe60 0x7f7ad415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad4145420 0x7f7ad4139080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ad415fb20 0x7f7ad4141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad3200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad416a050 con 0x7f7ad4145420 2024-08-18T22:22:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad3200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad4169ed0 con 0x7f7ad406fe60 2024-08-18T22:22:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad416a1d0 con 0x7f7ad415fb20 2024-08-18T22:22:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7acbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad4145420 0x7f7ad4139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7acbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad4145420 0x7f7ad4139080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55894/0 (socket says 172.21.15.5:55894) 2024-08-18T22:22:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7acbe00640 1 -- 172.21.15.5:0/1424109607 learned_addr learned my addr 172.21.15.5:0/1424109607 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad1e00640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ad406fe60 0x7f7ad415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad2800640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ad415fb20 0x7f7ad4141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7acbe00640 1 -- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ad415fb20 msgr2=0x7f7ad4141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7acbe00640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ad415fb20 0x7f7ad4141780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7acbe00640 1 -- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ad406fe60 msgr2=0x7f7ad415bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7acbe00640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ad406fe60 0x7f7ad415bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7acbe00640 1 -- 172.21.15.5:0/1424109607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad41599b0 con 0x7f7ad4145420 2024-08-18T22:22:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad1e00640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ad406fe60 0x7f7ad415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7acbe00640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad4145420 0x7f7ad4139080 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7abc019070 tx=0x7f7abc019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7aca000640 1 -- 172.21.15.5:0/1424109607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0b0040 con 0x7f7ad4145420 2024-08-18T22:22:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7aca000640 1 -- 172.21.15.5:0/1424109607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7abc0ba070 con 0x7f7ad4145420 2024-08-18T22:22:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7aca000640 1 -- 172.21.15.5:0/1424109607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0b4870 con 0x7f7ad4145420 2024-08-18T22:22:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad3200640 1 -- 172.21.15.5:0/1424109607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad4159c90 con 0x7f7ad4145420 2024-08-18T22:22:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad3200640 1 -- 172.21.15.5:0/1424109607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad415a250 con 0x7f7ad4145420 2024-08-18T22:22:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.751+0000 7f7ad3200640 1 -- 172.21.15.5:0/1424109607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad406b9b0 con 0x7f7ad4145420 2024-08-18T22:22:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.755+0000 7f7aca000640 1 -- 172.21.15.5:0/1424109607 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7abc0ab480 con 0x7f7ad4145420 2024-08-18T22:22:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.755+0000 7f7aca000640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ab00678c0 0x7f7ab0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.755+0000 7f7aca000640 1 -- 172.21.15.5:0/1424109607 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6101+0+0 (secure 0 0 0) 0x7f7abc11fbd0 con 0x7f7ad4145420 2024-08-18T22:22:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.755+0000 7f7ad1e00640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ab00678c0 0x7f7ab0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.755+0000 7f7ad1e00640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ab00678c0 0x7f7ab0069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4141120 tx=0x7f7ac4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:49.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.759+0000 7f7aca000640 1 -- 172.21.15.5:0/1424109607 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7abc016050 con 0x7f7ad4145420 2024-08-18T22:22:49.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.959+0000 7f7ad3200640 1 -- 172.21.15.5:0/1424109607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7ad4159120 con 0x7f7ad4145420 2024-08-18T22:22:49.963 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:22:49.959+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:22:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.959+0000 7f7aca000640 1 -- 172.21.15.5:0/1424109607 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7f7abc0f04e0 con 0x7f7ad4145420 2024-08-18T22:22:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:22:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 -- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ab00678c0 msgr2=0x7f7ab0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ab00678c0 0x7f7ab0069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4141120 tx=0x7f7ac4009040 comp rx=0 tx=0).stop 2024-08-18T22:22:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 -- 172.21.15.5:0/1424109607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad4145420 msgr2=0x7f7ad4139080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad4145420 0x7f7ad4139080 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7abc019070 tx=0x7f7abc019200 comp rx=0 tx=0).stop 2024-08-18T22:22:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 -- 172.21.15.5:0/1424109607 shutdown_connections 2024-08-18T22:22:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ab00678c0 0x7f7ab0069d80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ad415fb20 0x7f7ad4141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad4145420 0x7f7ad4139080 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 --2- 172.21.15.5:0/1424109607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ad406fe60 0x7f7ad415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 -- 172.21.15.5:0/1424109607 >> 172.21.15.5:0/1424109607 conn(0x7f7ad40d1000 msgr2=0x7f7ad40cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 -- 172.21.15.5:0/1424109607 shutdown_connections 2024-08-18T22:22:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:49.963+0000 7f7ad3200640 1 -- 172.21.15.5:0/1424109607 wait complete. 2024-08-18T22:22:49.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:22:50.050 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:22:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.139+0000 7f588ba00640 1 Processor -- start 2024-08-18T22:22:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.139+0000 7f588ba00640 1 -- start start 2024-08-18T22:22:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.139+0000 7f588ba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 0x7f58840d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.139+0000 7f588ba00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58840d30b0 con 0x7f588415fb80 2024-08-18T22:22:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.139+0000 7f588ba00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58840d1bd0 con 0x7f58840b5ad0 2024-08-18T22:22:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.139+0000 7f588ba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5884071c60 con 0x7f58840d1090 2024-08-18T22:22:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f5889000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f588415fb80 0x7f588406fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54448/0 (socket says 172.21.15.5:54448) 2024-08-18T22:22:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f5889000640 1 -- 172.21.15.5:0/586144816 learned_addr learned my addr 172.21.15.5:0/586144816 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f587be00640 1 --2- 172.21.15.5:0/586144816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 0x7f58840d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f5883e00640 1 -- 172.21.15.5:0/586144816 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 819066885 0 0) 0x7f58840d30b0 con 0x7f588415fb80 2024-08-18T22:22:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f5883e00640 1 -- 172.21.15.5:0/586144816 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5868003530 con 0x7f588415fb80 2024-08-18T22:22:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f5883e00640 1 -- 172.21.15.5:0/586144816 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352928504 0 0) 0x7f58840d1bd0 con 0x7f58840b5ad0 2024-08-18T22:22:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f587be00640 1 -- 172.21.15.5:0/586144816 >> v1:172.21.15.117:6789/0 conn(0x7f58840b5ad0 legacy=0x7f5884071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f587be00640 1 -- 172.21.15.5:0/586144816 >> v1:172.21.15.5:6789/0 conn(0x7f588415fb80 legacy=0x7f588406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f587be00640 1 -- 172.21.15.5:0/586144816 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58840d2dd0 con 0x7f58840d1090 2024-08-18T22:22:50.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f587be00640 1 --2- 172.21.15.5:0/586144816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 0x7f58840d15e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f586c0097f0 tx=0x7f586c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15721429134b2680 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:50.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f5883e00640 1 -- 172.21.15.5:0/586144816 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c0b0070 con 0x7f58840d1090 2024-08-18T22:22:50.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f5883e00640 1 -- 172.21.15.5:0/586144816 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f586c0a4e50 con 0x7f58840d1090 2024-08-18T22:22:50.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.143+0000 7f5883e00640 1 -- 172.21.15.5:0/586144816 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c0ab800 con 0x7f58840d1090 2024-08-18T22:22:50.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 -- 172.21.15.5:0/586144816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 msgr2=0x7f58840d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:50.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 --2- 172.21.15.5:0/586144816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 0x7f58840d15e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f586c0097f0 tx=0x7f586c01c3c0 comp rx=0 tx=0).stop 2024-08-18T22:22:50.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 -- 172.21.15.5:0/586144816 shutdown_connections 2024-08-18T22:22:50.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 --2- 172.21.15.5:0/586144816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 0x7f58840d15e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:50.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 -- 172.21.15.5:0/586144816 >> 172.21.15.5:0/586144816 conn(0x7f58840d2180 msgr2=0x7f58840d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:50.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 -- 172.21.15.5:0/586144816 shutdown_connections 2024-08-18T22:22:50.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 -- 172.21.15.5:0/586144816 wait complete. 2024-08-18T22:22:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 Processor -- start 2024-08-18T22:22:50.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 -- start start 2024-08-18T22:22:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58840b5ad0 0x7f588415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 0x7f5884155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:50.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588415fb80 0x7f58840d0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f588416a310 con 0x7f588415fb80 2024-08-18T22:22:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f58840d1eb0 con 0x7f58840b5ad0 2024-08-18T22:22:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f588ba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f588416a490 con 0x7f58840d1090 2024-08-18T22:22:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f5889a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588415fb80 0x7f58840d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f5889000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58840b5ad0 0x7f588415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f5889a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588415fb80 0x7f58840d0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55914/0 (socket says 172.21.15.5:55914) 2024-08-18T22:22:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f5889a00640 1 -- 172.21.15.5:0/316068412 learned_addr learned my addr 172.21.15.5:0/316068412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:50.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f587be00640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 0x7f5884155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f5889a00640 1 -- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 msgr2=0x7f5884155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f5889a00640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 0x7f5884155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f5889a00640 1 -- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58840b5ad0 msgr2=0x7f588415a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f5889a00640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58840b5ad0 0x7f588415a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f5889a00640 1 -- 172.21.15.5:0/316068412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588415acb0 con 0x7f588415fb80 2024-08-18T22:22:50.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.147+0000 7f587be00640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 0x7f5884155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:22:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.151+0000 7f5889a00640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588415fb80 0x7f58840d0080 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f587c00c780 tx=0x7f587c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.151+0000 7f5881600640 1 -- 172.21.15.5:0/316068412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c003db0 con 0x7f588415fb80 2024-08-18T22:22:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.151+0000 7f5881600640 1 -- 172.21.15.5:0/316068412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587c005070 con 0x7f588415fb80 2024-08-18T22:22:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.151+0000 7f5881600640 1 -- 172.21.15.5:0/316068412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c005460 con 0x7f588415fb80 2024-08-18T22:22:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.151+0000 7f588ba00640 1 -- 172.21.15.5:0/316068412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588415b5b0 con 0x7f588415fb80 2024-08-18T22:22:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.151+0000 7f588ba00640 1 -- 172.21.15.5:0/316068412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f588415af50 con 0x7f588415fb80 2024-08-18T22:22:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.151+0000 7f588ba00640 1 -- 172.21.15.5:0/316068412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58840d15e0 con 0x7f588415fb80 2024-08-18T22:22:50.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.151+0000 7f5881600640 1 -- 172.21.15.5:0/316068412 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f587c005600 con 0x7f588415fb80 2024-08-18T22:22:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.151+0000 7f5881600640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58600678c0 0x7f5860069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:50.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.151+0000 7f5881600640 1 -- 172.21.15.5:0/316068412 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6187+0+0 (secure 0 0 0) 0x7f587c085d00 con 0x7f588415fb80 2024-08-18T22:22:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.151+0000 7f5889000640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58600678c0 0x7f5860069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.155+0000 7f5889000640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58600678c0 0x7f5860069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5874007fd0 tx=0x7f5874009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:50.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.155+0000 7f5881600640 1 -- 172.21.15.5:0/316068412 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f587c055f70 con 0x7f588415fb80 2024-08-18T22:22:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.355+0000 7f588ba00640 1 -- 172.21.15.5:0/316068412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f58840ce0d0 con 0x7f588415fb80 2024-08-18T22:22:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.963+0000 7f5881600640 1 -- 172.21.15.5:0/316068412 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f587c05a270 con 0x7f588415fb80 2024-08-18T22:22:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 -- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58600678c0 msgr2=0x7f5860069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:50.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58600678c0 0x7f5860069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5874007fd0 tx=0x7f5874009040 comp rx=0 tx=0).stop 2024-08-18T22:22:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 -- 172.21.15.5:0/316068412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588415fb80 msgr2=0x7f58840d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588415fb80 0x7f58840d0080 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f587c00c780 tx=0x7f587c00cc40 comp rx=0 tx=0).stop 2024-08-18T22:22:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 -- 172.21.15.5:0/316068412 shutdown_connections 2024-08-18T22:22:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58600678c0 0x7f5860069d80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f588415fb80 0x7f58840d0080 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58840d1090 0x7f5884155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 --2- 172.21.15.5:0/316068412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58840b5ad0 0x7f588415a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 -- 172.21.15.5:0/316068412 >> 172.21.15.5:0/316068412 conn(0x7f58840d2180 msgr2=0x7f58840d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 -- 172.21.15.5:0/316068412 shutdown_connections 2024-08-18T22:22:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:50.967+0000 7f588ba00640 1 -- 172.21.15.5:0/316068412 wait complete. 2024-08-18T22:22:50.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:22:51.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.135+0000 7fa800000640 1 Processor -- start 2024-08-18T22:22:51.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.135+0000 7fa800000640 1 -- start start 2024-08-18T22:22:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa800000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f815c0d0 0x7fa7f80af620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa800000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f806ffc0 con 0x7fa7f809b150 2024-08-18T22:22:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa800000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f80702a0 con 0x7fa7f80b50d0 2024-08-18T22:22:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa800000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f815c4b0 con 0x7fa7f815c0d0 2024-08-18T22:22:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa7fe000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa7f809b150 0x7fa7f8071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54458/0 (socket says 172.21.15.5:54458) 2024-08-18T22:22:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa7fe000640 1 -- 172.21.15.5:0/4047818074 learned_addr learned my addr 172.21.15.5:0/4047818074 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa7fd600640 1 --2- 172.21.15.5:0/4047818074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f815c0d0 0x7fa7f80af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa7f7e00640 1 -- 172.21.15.5:0/4047818074 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634660054 0 0) 0x7fa7f806ffc0 con 0x7fa7f809b150 2024-08-18T22:22:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa7f7e00640 1 -- 172.21.15.5:0/4047818074 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7e0003530 con 0x7fa7f809b150 2024-08-18T22:22:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa7fd600640 1 -- 172.21.15.5:0/4047818074 >> v1:172.21.15.117:6789/0 conn(0x7fa7f80b50d0 legacy=0x7fa7f809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa7fd600640 1 -- 172.21.15.5:0/4047818074 >> v1:172.21.15.5:6789/0 conn(0x7fa7f809b150 legacy=0x7fa7f8071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa7f7e00640 1 -- 172.21.15.5:0/4047818074 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001110408 0 0) 0x7fa7f80702a0 con 0x7fa7f80b50d0 2024-08-18T22:22:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.139+0000 7fa7fd600640 1 -- 172.21.15.5:0/4047818074 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f8070580 con 0x7fa7f815c0d0 2024-08-18T22:22:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa7fd600640 1 --2- 172.21.15.5:0/4047818074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f815c0d0 0x7fa7f80af620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0097f0 tx=0x7fa7ec01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ad48f8e46e930ee server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa7f7e00640 1 -- 172.21.15.5:0/4047818074 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0b0070 con 0x7fa7f815c0d0 2024-08-18T22:22:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa7f7e00640 1 -- 172.21.15.5:0/4047818074 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec0ab600 con 0x7fa7f815c0d0 2024-08-18T22:22:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa7f7e00640 1 -- 172.21.15.5:0/4047818074 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0ab9d0 con 0x7fa7f815c0d0 2024-08-18T22:22:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa800000640 1 -- 172.21.15.5:0/4047818074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f815c0d0 msgr2=0x7fa7f80af620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa800000640 1 --2- 172.21.15.5:0/4047818074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f815c0d0 0x7fa7f80af620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0097f0 tx=0x7fa7ec01c4e0 comp rx=0 tx=0).stop 2024-08-18T22:22:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa800000640 1 -- 172.21.15.5:0/4047818074 shutdown_connections 2024-08-18T22:22:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa800000640 1 --2- 172.21.15.5:0/4047818074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f815c0d0 0x7fa7f80af620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa800000640 1 -- 172.21.15.5:0/4047818074 >> 172.21.15.5:0/4047818074 conn(0x7fa7f80b3dd0 msgr2=0x7fa7f80b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa800000640 1 -- 172.21.15.5:0/4047818074 shutdown_connections 2024-08-18T22:22:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa800000640 1 -- 172.21.15.5:0/4047818074 wait complete. 2024-08-18T22:22:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa800000640 1 Processor -- start 2024-08-18T22:22:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa800000640 1 -- start start 2024-08-18T22:22:51.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.143+0000 7fa800000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f809b150 0x7fa7f814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:51.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa800000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7f80b50d0 0x7fa7f81599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa800000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f815c0d0 0x7fa7f8159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa800000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8071d00 con 0x7fa7f809b150 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa800000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8071b80 con 0x7fa7f80b50d0 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa800000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f816a560 con 0x7fa7f815c0d0 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7fd600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f809b150 0x7fa7f814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7fd600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f809b150 0x7fa7f814acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55918/0 (socket says 172.21.15.5:55918) 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7fd600640 1 -- 172.21.15.5:0/3607751724 learned_addr learned my addr 172.21.15.5:0/3607751724 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7fcc00640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7f80b50d0 0x7fa7f81599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7fe000640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f815c0d0 0x7fa7f8159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7fd600640 1 -- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f815c0d0 msgr2=0x7fa7f8159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7fd600640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f815c0d0 0x7fa7f8159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:51.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7fd600640 1 -- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7f80b50d0 msgr2=0x7fa7f81599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7fd600640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7f80b50d0 0x7fa7f81599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7fd600640 1 -- 172.21.15.5:0/3607751724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f814d410 con 0x7fa7f809b150 2024-08-18T22:22:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7fd600640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f809b150 0x7fa7f814acf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0097f0 tx=0x7fa7ec019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:51.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7f5600640 1 -- 172.21.15.5:0/3607751724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0bb070 con 0x7fa7f809b150 2024-08-18T22:22:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7f5600640 1 -- 172.21.15.5:0/3607751724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec004020 con 0x7fa7f809b150 2024-08-18T22:22:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7f5600640 1 -- 172.21.15.5:0/3607751724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0b0040 con 0x7fa7f809b150 2024-08-18T22:22:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa800000640 1 -- 172.21.15.5:0/3607751724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f815a8e0 con 0x7fa7f809b150 2024-08-18T22:22:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa800000640 1 -- 172.21.15.5:0/3607751724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f814d6c0 con 0x7fa7f809b150 2024-08-18T22:22:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa800000640 1 -- 172.21.15.5:0/3607751724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f80af620 con 0x7fa7f809b150 2024-08-18T22:22:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.147+0000 7fa7f5600640 1 -- 172.21.15.5:0/3607751724 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7ec0b3040 con 0x7fa7f809b150 2024-08-18T22:22:51.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.151+0000 7fa7f5600640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678c0 0x7fa7d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:51.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.151+0000 7fa7f5600640 1 -- 172.21.15.5:0/3607751724 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6187+0+0 (secure 0 0 0) 0x7fa7ec11ffa0 con 0x7fa7f809b150 2024-08-18T22:22:51.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.151+0000 7fa7fcc00640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678c0 0x7fa7d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.151+0000 7fa7fcc00640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678c0 0x7fa7d8069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8147d20 tx=0x7fa7e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:51.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.155+0000 7fa7f5600640 1 -- 172.21.15.5:0/3607751724 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa7ec0160d0 con 0x7fa7f809b150 2024-08-18T22:22:51.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.319+0000 7fa800000640 1 -- 172.21.15.5:0/3607751724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa7f80008e0 con 0x7fa7f809b150 2024-08-18T22:22:51.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:22:51.938 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:22:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.967+0000 7fa7f5600640 1 -- 172.21.15.5:0/3607751724 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) ==== 181+0+0 (secure 0 0 0) 0x7fa7ec0f08f0 con 0x7fa7f809b150 2024-08-18T22:22:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:22:51.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.967+0000 7fa800000640 1 -- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678c0 msgr2=0x7fa7d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:51.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.967+0000 7fa800000640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678c0 0x7fa7d8069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8147d20 tx=0x7fa7e4009040 comp rx=0 tx=0).stop 2024-08-18T22:22:51.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.967+0000 7fa800000640 1 -- 172.21.15.5:0/3607751724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f809b150 msgr2=0x7fa7f814acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:51.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.971+0000 7fa800000640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f809b150 0x7fa7f814acf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0097f0 tx=0x7fa7ec019280 comp rx=0 tx=0).stop 2024-08-18T22:22:51.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.971+0000 7fa800000640 1 -- 172.21.15.5:0/3607751724 shutdown_connections 2024-08-18T22:22:51.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.971+0000 7fa800000640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678c0 0x7fa7d8069d80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:51.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.971+0000 7fa800000640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f815c0d0 0x7fa7f8159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:51.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.971+0000 7fa800000640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7f80b50d0 0x7fa7f81599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:51.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.971+0000 7fa800000640 1 --2- 172.21.15.5:0/3607751724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f809b150 0x7fa7f814acf0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:51.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.971+0000 7fa800000640 1 -- 172.21.15.5:0/3607751724 >> 172.21.15.5:0/3607751724 conn(0x7fa7f80b3dd0 msgr2=0x7fa7f80b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:51.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.971+0000 7fa800000640 1 -- 172.21.15.5:0/3607751724 shutdown_connections 2024-08-18T22:22:51.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:51.971+0000 7fa800000640 1 -- 172.21.15.5:0/3607751724 wait complete. 2024-08-18T22:22:51.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:22:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.191+0000 7f8710200640 1 Processor -- start 2024-08-18T22:22:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.191+0000 7f8710200640 1 -- start start 2024-08-18T22:22:52.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f8710200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8708072a20 0x7f8708072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f8710200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87080b3c20 0x7f87080b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f8710200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87080735e0 con 0x7f87080cf020 2024-08-18T22:22:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f8710200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f87080733c0 con 0x7f87080b3c20 2024-08-18T22:22:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f8710200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f87080738c0 con 0x7f8708072a20 2024-08-18T22:22:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f870e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87080b3c20 0x7f87080b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f870e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87080b3c20 0x7f87080b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55930/0 (socket says 172.21.15.5:55930) 2024-08-18T22:22:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f870e200640 1 -- 172.21.15.5:0/665474274 learned_addr learned my addr 172.21.15.5:0/665474274 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f870ce00640 1 --2- 172.21.15.5:0/665474274 >> v2:172.21.15.117:3300/0 conn(0x7f8708072a20 0x7f8708072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f870e200640 1 -- 172.21.15.5:0/665474274 >> v2:172.21.15.117:3300/0 conn(0x7f8708072a20 msgr2=0x7f8708072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f870e200640 1 --2- 172.21.15.5:0/665474274 >> v2:172.21.15.117:3300/0 conn(0x7f8708072a20 0x7f8708072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f870e200640 1 -- 172.21.15.5:0/665474274 >> v1:172.21.15.117:6789/0 conn(0x7f87080cf020 legacy=0x7f87080cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f870e200640 1 -- 172.21.15.5:0/665474274 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8708073ba0 con 0x7f87080b3c20 2024-08-18T22:22:52.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.195+0000 7f870e200640 1 --2- 172.21.15.5:0/665474274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87080b3c20 0x7f87080b40b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f87080af670 tx=0x7f870001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a708e107d3f970 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:52.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8707e00640 1 -- 172.21.15.5:0/665474274 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87000a57e0 con 0x7f87080b3c20 2024-08-18T22:22:52.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8707e00640 1 -- 172.21.15.5:0/665474274 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87000a5980 con 0x7f87080b3c20 2024-08-18T22:22:52.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8707e00640 1 -- 172.21.15.5:0/665474274 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87000a5d50 con 0x7f87080b3c20 2024-08-18T22:22:52.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 -- 172.21.15.5:0/665474274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87080b3c20 msgr2=0x7f87080b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:52.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 --2- 172.21.15.5:0/665474274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87080b3c20 0x7f87080b40b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f87080af670 tx=0x7f870001c980 comp rx=0 tx=0).stop 2024-08-18T22:22:52.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 -- 172.21.15.5:0/665474274 shutdown_connections 2024-08-18T22:22:52.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 --2- 172.21.15.5:0/665474274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87080b3c20 0x7f87080b40b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:52.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 --2- 172.21.15.5:0/665474274 >> v2:172.21.15.117:3300/0 conn(0x7f8708072a20 0x7f8708072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:52.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 -- 172.21.15.5:0/665474274 >> 172.21.15.5:0/665474274 conn(0x7f870806b9b0 msgr2=0x7f870806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 -- 172.21.15.5:0/665474274 shutdown_connections 2024-08-18T22:22:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 -- 172.21.15.5:0/665474274 wait complete. 2024-08-18T22:22:52.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 Processor -- start 2024-08-18T22:22:52.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 -- start start 2024-08-18T22:22:52.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8708072a20 0x7f87081591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:52.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87080b3c20 0x7f8708099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:52.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87080cf020 0x7f87080ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:52.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8708155a60 con 0x7f87080cf020 2024-08-18T22:22:52.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f87081558e0 con 0x7f8708072a20 2024-08-18T22:22:52.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f8710200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f870815c760 con 0x7f87080b3c20 2024-08-18T22:22:52.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f870e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87080cf020 0x7f87080ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:52.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f870e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87080cf020 0x7f87080ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55934/0 (socket says 172.21.15.5:55934) 2024-08-18T22:22:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f870e200640 1 -- 172.21.15.5:0/3617745221 learned_addr learned my addr 172.21.15.5:0/3617745221 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f870d800640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8708072a20 0x7f87081591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.199+0000 7f870ce00640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87080b3c20 0x7f8708099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f870e200640 1 -- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87080b3c20 msgr2=0x7f8708099b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f870e200640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87080b3c20 0x7f8708099b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f870e200640 1 -- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8708072a20 msgr2=0x7f87081591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f870e200640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8708072a20 0x7f87081591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f870e200640 1 -- 172.21.15.5:0/3617745221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87080adb50 con 0x7f87080cf020 2024-08-18T22:22:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f870e200640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87080cf020 0x7f87080ae2e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8700019590 tx=0x7f8700019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:52.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f8705600640 1 -- 172.21.15.5:0/3617745221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700009510 con 0x7f87080cf020 2024-08-18T22:22:52.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f8705600640 1 -- 172.21.15.5:0/3617745221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87000be070 con 0x7f87080cf020 2024-08-18T22:22:52.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f8705600640 1 -- 172.21.15.5:0/3617745221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87000b88b0 con 0x7f87080cf020 2024-08-18T22:22:52.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f8710200640 1 -- 172.21.15.5:0/3617745221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8708158620 con 0x7f87080cf020 2024-08-18T22:22:52.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f8710200640 1 -- 172.21.15.5:0/3617745221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8708156d40 con 0x7f87080cf020 2024-08-18T22:22:52.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f8710200640 1 -- 172.21.15.5:0/3617745221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8708156f70 con 0x7f87080cf020 2024-08-18T22:22:52.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f8705600640 1 -- 172.21.15.5:0/3617745221 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87000b8a50 con 0x7f87080cf020 2024-08-18T22:22:52.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f8705600640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e80678f0 0x7f86e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:52.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f8705600640 1 -- 172.21.15.5:0/3617745221 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5749+0+0 (secure 0 0 0) 0x7f8700120cc0 con 0x7f87080cf020 2024-08-18T22:22:52.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.203+0000 7f870d800640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e80678f0 0x7f86e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:52.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.207+0000 7f870d800640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e80678f0 0x7f86e8069db0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f86fc007fd0 tx=0x7f86fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:52.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.207+0000 7f8705600640 1 -- 172.21.15.5:0/3617745221 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8700127080 con 0x7f87080cf020 2024-08-18T22:22:52.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.379+0000 7f8710200640 1 -- 172.21.15.5:0/3617745221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8708072e80 con 0x7f87080cf020 2024-08-18T22:22:52.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.967+0000 7f8705600640 1 -- 172.21.15.5:0/3617745221 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) ==== 169+0+0 (secure 0 0 0) 0x7f87000165a0 con 0x7f87080cf020 2024-08-18T22:22:52.971 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:22:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 -- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e80678f0 msgr2=0x7f86e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e80678f0 0x7f86e8069db0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f86fc007fd0 tx=0x7f86fc009040 comp rx=0 tx=0).stop 2024-08-18T22:22:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 -- 172.21.15.5:0/3617745221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87080cf020 msgr2=0x7f87080ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87080cf020 0x7f87080ae2e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8700019590 tx=0x7f8700019720 comp rx=0 tx=0).stop 2024-08-18T22:22:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 -- 172.21.15.5:0/3617745221 shutdown_connections 2024-08-18T22:22:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e80678f0 0x7f86e8069db0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87080cf020 0x7f87080ae2e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87080b3c20 0x7f8708099b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:52.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 --2- 172.21.15.5:0/3617745221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8708072a20 0x7f87081591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 -- 172.21.15.5:0/3617745221 >> 172.21.15.5:0/3617745221 conn(0x7f870806b9b0 msgr2=0x7f8708150ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 -- 172.21.15.5:0/3617745221 shutdown_connections 2024-08-18T22:22:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:52.971+0000 7f8710200640 1 -- 172.21.15.5:0/3617745221 wait complete. 2024-08-18T22:22:52.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:22:53.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cc6a00640 1 Processor -- start 2024-08-18T22:22:53.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cc6a00640 1 -- start start 2024-08-18T22:22:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cc6a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc009aca0 0x7f7cc00afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cc6a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7cc00b1300 0x7f7cc00affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cc6a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc006e8a0 con 0x7f7cc009b080 2024-08-18T22:22:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cc6a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc009bb80 con 0x7f7cc00b1300 2024-08-18T22:22:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cc6a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc00d2e40 con 0x7f7cc009aca0 2024-08-18T22:22:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cbfe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc009aca0 0x7f7cc00afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cc4a00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7cc009b080 0x7f7cc00b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:54588/0 (socket says 172.21.15.5:54588) 2024-08-18T22:22:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cb7400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7cc00b1300 0x7f7cc00affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cc4a00640 1 -- 172.21.15.5:0/2665206771 learned_addr learned my addr 172.21.15.5:0/2665206771 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cbfe00640 1 -- 172.21.15.5:0/2665206771 >> v2:172.21.15.117:3300/0 conn(0x7f7cc00b1300 msgr2=0x7f7cc00affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cbfe00640 1 --2- 172.21.15.5:0/2665206771 >> v2:172.21.15.117:3300/0 conn(0x7f7cc00b1300 0x7f7cc00affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cbfe00640 1 -- 172.21.15.5:0/2665206771 >> v1:172.21.15.117:6789/0 conn(0x7f7cc009b080 legacy=0x7f7cc00b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cbfe00640 1 -- 172.21.15.5:0/2665206771 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc006cbd0 con 0x7f7cc009aca0 2024-08-18T22:22:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.155+0000 7f7cbf400640 1 -- 172.21.15.5:0/2665206771 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2221776212 0 0) 0x7f7cc006e8a0 con 0x7f7cc009b080 2024-08-18T22:22:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cbfe00640 1 --2- 172.21.15.5:0/2665206771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc009aca0 0x7f7cc00afa90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00097f0 tx=0x7f7cb001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aba69bf1dffeced server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cbf400640 1 -- 172.21.15.5:0/2665206771 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb00b0070 con 0x7f7cc009aca0 2024-08-18T22:22:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cbf400640 1 -- 172.21.15.5:0/2665206771 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb0004230 con 0x7f7cc009aca0 2024-08-18T22:22:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cbf400640 1 -- 172.21.15.5:0/2665206771 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0003620 con 0x7f7cc009aca0 2024-08-18T22:22:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cc6a00640 1 -- 172.21.15.5:0/2665206771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc009aca0 msgr2=0x7f7cc00afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cc6a00640 1 --2- 172.21.15.5:0/2665206771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc009aca0 0x7f7cc00afa90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00097f0 tx=0x7f7cb001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cc6a00640 1 -- 172.21.15.5:0/2665206771 shutdown_connections 2024-08-18T22:22:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cc6a00640 1 --2- 172.21.15.5:0/2665206771 >> v2:172.21.15.117:3300/0 conn(0x7f7cc00b1300 0x7f7cc00affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cc6a00640 1 --2- 172.21.15.5:0/2665206771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc009aca0 0x7f7cc00afa90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cc6a00640 1 -- 172.21.15.5:0/2665206771 >> 172.21.15.5:0/2665206771 conn(0x7f7cc00d2180 msgr2=0x7f7cc00d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cc6a00640 1 -- 172.21.15.5:0/2665206771 shutdown_connections 2024-08-18T22:22:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.159+0000 7f7cc6a00640 1 -- 172.21.15.5:0/2665206771 wait complete. 2024-08-18T22:22:53.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cc6a00640 1 Processor -- start 2024-08-18T22:22:53.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cc6a00640 1 -- start start 2024-08-18T22:22:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cc6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc009aca0 0x7f7cc00cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cc6a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc009b080 0x7f7cc01523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cc6a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cc00b1300 0x7f7cc0167a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cc6a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc016b6b0 con 0x7f7cc009aca0 2024-08-18T22:22:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cc6a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc016b530 con 0x7f7cc00b1300 2024-08-18T22:22:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cc6a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc016b830 con 0x7f7cc009b080 2024-08-18T22:22:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc009aca0 0x7f7cc00cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc009aca0 0x7f7cc00cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55950/0 (socket says 172.21.15.5:55950) 2024-08-18T22:22:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbfe00640 1 -- 172.21.15.5:0/1253613571 learned_addr learned my addr 172.21.15.5:0/1253613571 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cb7400640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc009b080 0x7f7cc01523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:53.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cc4a00640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cc00b1300 0x7f7cc0167a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbfe00640 1 -- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc009b080 msgr2=0x7f7cc01523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbfe00640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc009b080 0x7f7cc01523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbfe00640 1 -- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cc00b1300 msgr2=0x7f7cc0167a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbfe00640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cc00b1300 0x7f7cc0167a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbfe00640 1 -- 172.21.15.5:0/1253613571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc009eef0 con 0x7f7cc009aca0 2024-08-18T22:22:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbfe00640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc009aca0 0x7f7cc00cc850 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7cb001a0d0 tx=0x7f7cb0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbcc00640 1 -- 172.21.15.5:0/1253613571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb00b0040 con 0x7f7cc009aca0 2024-08-18T22:22:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbcc00640 1 -- 172.21.15.5:0/1253613571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb00bc070 con 0x7f7cc009aca0 2024-08-18T22:22:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cbcc00640 1 -- 172.21.15.5:0/1253613571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb00b56c0 con 0x7f7cc009aca0 2024-08-18T22:22:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1253613571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc00cb900 con 0x7f7cc009aca0 2024-08-18T22:22:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.163+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1253613571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc00cbec0 con 0x7f7cc009aca0 2024-08-18T22:22:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.167+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1253613571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc009f0c0 con 0x7f7cc009aca0 2024-08-18T22:22:53.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.167+0000 7f7cbcc00640 1 -- 172.21.15.5:0/1253613571 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7cb00b3070 con 0x7f7cc009aca0 2024-08-18T22:22:53.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.167+0000 7f7cbcc00640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c9c0678c0 0x7f7c9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:53.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.167+0000 7f7cbcc00640 1 -- 172.21.15.5:0/1253613571 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f7cb011f8d0 con 0x7f7cc009aca0 2024-08-18T22:22:53.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.167+0000 7f7cb7400640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c9c0678c0 0x7f7c9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.167+0000 7f7cb7400640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c9c0678c0 0x7f7c9c069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0167790 tx=0x7f7ca8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.171+0000 7f7cbcc00640 1 -- 172.21.15.5:0/1253613571 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7cb0016090 con 0x7f7cc009aca0 2024-08-18T22:22:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.335+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1253613571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f7cc0161940 con 0x7f7cc009aca0 2024-08-18T22:22:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.339+0000 7f7cbcc00640 1 -- 172.21.15.5:0/1253613571 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f7cb00efe90 con 0x7f7cc009aca0 2024-08-18T22:22:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c9c0678c0 msgr2=0x7f7c9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c9c0678c0 0x7f7c9c069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0167790 tx=0x7f7ca8009190 comp rx=0 tx=0).stop 2024-08-18T22:22:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1253613571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc009aca0 msgr2=0x7f7cc00cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc009aca0 0x7f7cc00cc850 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7cb001a0d0 tx=0x7f7cb0019240 comp rx=0 tx=0).stop 2024-08-18T22:22:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1253613571 shutdown_connections 2024-08-18T22:22:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c9c0678c0 0x7f7c9c069d80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cc00b1300 0x7f7cc0167a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7cc009b080 0x7f7cc01523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 --2- 172.21.15.5:0/1253613571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cc009aca0 0x7f7cc00cc850 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1253613571 >> 172.21.15.5:0/1253613571 conn(0x7f7cc00d2180 msgr2=0x7f7cc00d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1253613571 shutdown_connections 2024-08-18T22:22:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.343+0000 7f7cc6a00640 1 -- 172.21.15.5:0/1253613571 wait complete. 2024-08-18T22:22:53.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-08-18T22:22:53.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.503+0000 7f7006a00640 1 Processor -- start 2024-08-18T22:22:53.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.503+0000 7f7006a00640 1 -- start start 2024-08-18T22:22:53.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.503+0000 7f7006a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7000070730 0x7f7000070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:53.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.503+0000 7f7006a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7000070430 con 0x7f700015dda0 2024-08-18T22:22:53.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.503+0000 7f7006a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f700015eb60 con 0x7f7000161960 2024-08-18T22:22:53.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.503+0000 7f7006a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f70000710e0 con 0x7f7000070730 2024-08-18T22:22:53.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.503+0000 7f7004a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f700015dda0 0x7f700015e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54460/0 (socket says 172.21.15.5:54460) 2024-08-18T22:22:53.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.503+0000 7f7004a00640 1 -- 172.21.15.5:0/3136426868 learned_addr learned my addr 172.21.15.5:0/3136426868 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:53.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.503+0000 7f6ff7400640 1 --2- 172.21.15.5:0/3136426868 >> v2:172.21.15.117:3300/0 conn(0x7f7000070730 0x7f7000070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:53.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.507+0000 7f6fff400640 1 -- 172.21.15.5:0/3136426868 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297369606 0 0) 0x7f7000070430 con 0x7f700015dda0 2024-08-18T22:22:53.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.507+0000 7f6ff7400640 1 -- 172.21.15.5:0/3136426868 >> v1:172.21.15.117:6789/0 conn(0x7f7000161960 legacy=0x7f700006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.507+0000 7f6ff7400640 1 -- 172.21.15.5:0/3136426868 >> v1:172.21.15.5:6789/0 conn(0x7f700015dda0 legacy=0x7f700015e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.507+0000 7f6ff7400640 1 -- 172.21.15.5:0/3136426868 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700015ee40 con 0x7f7000070730 2024-08-18T22:22:53.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.507+0000 7f6ff7400640 1 --2- 172.21.15.5:0/3136426868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000070730 0x7f7000070ba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80097c0 tx=0x7f6fe801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5b2053d7e27ba06 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:53.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.507+0000 7f6fff400640 1 -- 172.21.15.5:0/3136426868 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80b0070 con 0x7f7000070730 2024-08-18T22:22:53.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.507+0000 7f6fff400640 1 -- 172.21.15.5:0/3136426868 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe80ab600 con 0x7f7000070730 2024-08-18T22:22:53.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.507+0000 7f6fff400640 1 -- 172.21.15.5:0/3136426868 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80ab9d0 con 0x7f7000070730 2024-08-18T22:22:53.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.507+0000 7f7006a00640 1 -- 172.21.15.5:0/3136426868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000070730 msgr2=0x7f7000070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.507+0000 7f7006a00640 1 --2- 172.21.15.5:0/3136426868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000070730 0x7f7000070ba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80097c0 tx=0x7f6fe801c4a0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 -- 172.21.15.5:0/3136426868 shutdown_connections 2024-08-18T22:22:53.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 --2- 172.21.15.5:0/3136426868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000070730 0x7f7000070ba0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 -- 172.21.15.5:0/3136426868 >> 172.21.15.5:0/3136426868 conn(0x7f70000d2130 msgr2=0x7f70000d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:53.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 -- 172.21.15.5:0/3136426868 shutdown_connections 2024-08-18T22:22:53.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 -- 172.21.15.5:0/3136426868 wait complete. 2024-08-18T22:22:53.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 Processor -- start 2024-08-18T22:22:53.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 -- start start 2024-08-18T22:22:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7000070730 0x7f70000b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f700015dda0 0x7f70000b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000161960 0x7f70000b7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f700009ba30 con 0x7f700015dda0 2024-08-18T22:22:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f700015e940 con 0x7f7000161960 2024-08-18T22:22:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f70000b5dd0 con 0x7f7000070730 2024-08-18T22:22:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ff7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f700015dda0 0x7f70000b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ff7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f700015dda0 0x7f70000b7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55956/0 (socket says 172.21.15.5:55956) 2024-08-18T22:22:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ff7400640 1 -- 172.21.15.5:0/3870236094 learned_addr learned my addr 172.21.15.5:0/3870236094 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:53.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6fffe00640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7000070730 0x7f70000b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:53.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7004a00640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000161960 0x7f70000b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ff7400640 1 -- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7000070730 msgr2=0x7f70000b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ff7400640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7000070730 0x7f70000b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ff7400640 1 -- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000161960 msgr2=0x7f70000b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ff7400640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000161960 0x7f70000b7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ff7400640 1 -- 172.21.15.5:0/3870236094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70000c5b90 con 0x7f700015dda0 2024-08-18T22:22:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ff7400640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f700015dda0 0x7f70000b7400 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80097c0 tx=0x7f6fe8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ffcc00640 1 -- 172.21.15.5:0/3870236094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80b8030 con 0x7f700015dda0 2024-08-18T22:22:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ffcc00640 1 -- 172.21.15.5:0/3870236094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe80b4410 con 0x7f700015dda0 2024-08-18T22:22:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f7006a00640 1 -- 172.21.15.5:0/3870236094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70000c5e70 con 0x7f700015dda0 2024-08-18T22:22:53.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.511+0000 7f6ffcc00640 1 -- 172.21.15.5:0/3870236094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80b0040 con 0x7f700015dda0 2024-08-18T22:22:53.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.515+0000 7f7006a00640 1 -- 172.21.15.5:0/3870236094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70000b6ad0 con 0x7f700015dda0 2024-08-18T22:22:53.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.515+0000 7f7006a00640 1 -- 172.21.15.5:0/3870236094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7000070ba0 con 0x7f700015dda0 2024-08-18T22:22:53.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.515+0000 7f6ffcc00640 1 -- 172.21.15.5:0/3870236094 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6fe80bb070 con 0x7f700015dda0 2024-08-18T22:22:53.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.515+0000 7f6ffcc00640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fdc0678c0 0x7f6fdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:53.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.515+0000 7f6ffcc00640 1 -- 172.21.15.5:0/3870236094 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f6fe811fd70 con 0x7f700015dda0 2024-08-18T22:22:53.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.515+0000 7f6fffe00640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fdc0678c0 0x7f6fdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:53.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.515+0000 7f6fffe00640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fdc0678c0 0x7f6fdc069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f70000c8ec0 tx=0x7f6ff0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:53.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.519+0000 7f6ffcc00640 1 -- 172.21.15.5:0/3870236094 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6fe8016090 con 0x7f700015dda0 2024-08-18T22:22:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.743+0000 7f7006a00640 1 -- 172.21.15.5:0/3870236094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f70000d3010 con 0x7f700015dda0 2024-08-18T22:22:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f6ffcc00640 1 -- 172.21.15.5:0/3870236094 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v183) ==== 143+0+0 (secure 0 0 0) 0x7f6fe80f0560 con 0x7f700015dda0 2024-08-18T22:22:53.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 -- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fdc0678c0 msgr2=0x7f6fdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fdc0678c0 0x7f6fdc069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f70000c8ec0 tx=0x7f6ff0009040 comp rx=0 tx=0).stop 2024-08-18T22:22:53.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 -- 172.21.15.5:0/3870236094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f700015dda0 msgr2=0x7f70000b7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f700015dda0 0x7f70000b7400 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80097c0 tx=0x7f6fe8019240 comp rx=0 tx=0).stop 2024-08-18T22:22:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 -- 172.21.15.5:0/3870236094 shutdown_connections 2024-08-18T22:22:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fdc0678c0 0x7f6fdc069d80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000161960 0x7f70000b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f700015dda0 0x7f70000b7400 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 --2- 172.21.15.5:0/3870236094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7000070730 0x7f70000b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 -- 172.21.15.5:0/3870236094 >> 172.21.15.5:0/3870236094 conn(0x7f70000d2130 msgr2=0x7f7000161e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 -- 172.21.15.5:0/3870236094 shutdown_connections 2024-08-18T22:22:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:53.983+0000 7f7006a00640 1 -- 172.21.15.5:0/3870236094 wait complete. 2024-08-18T22:22:54.007 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-08-18T22:22:54.008 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is merged during scrub. 2024-08-18T22:22:54.008 INFO:tasks.cephfs_test_runner:test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-08-18T22:22:54.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:22:54.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b2a00640 1 Processor -- start 2024-08-18T22:22:54.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b2a00640 1 -- start start 2024-08-18T22:22:54.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b2a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f23ac15c180 0x7f23ac0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b2a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23ac071c90 0x7f23ac15c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b2a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23ac0b5e30 con 0x7f23ac06fad0 2024-08-18T22:22:54.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b2a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f23ac15caa0 con 0x7f23ac071c90 2024-08-18T22:22:54.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b2a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f23ac0b6110 con 0x7f23ac15c180 2024-08-18T22:22:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b0a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23ac071c90 0x7f23ac15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b0a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23ac071c90 0x7f23ac15c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42008/0 (socket says 172.21.15.5:42008) 2024-08-18T22:22:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b0a00640 1 -- 172.21.15.5:0/187096424 learned_addr learned my addr 172.21.15.5:0/187096424 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23abe00640 1 --2- 172.21.15.5:0/187096424 >> v2:172.21.15.117:3300/0 conn(0x7f23ac15c180 0x7f23ac0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b0a00640 1 -- 172.21.15.5:0/187096424 >> v2:172.21.15.117:3300/0 conn(0x7f23ac15c180 msgr2=0x7f23ac0b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b0a00640 1 --2- 172.21.15.5:0/187096424 >> v2:172.21.15.117:3300/0 conn(0x7f23ac15c180 0x7f23ac0b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b0a00640 1 -- 172.21.15.5:0/187096424 >> v1:172.21.15.5:6789/0 conn(0x7f23ac06fad0 legacy=0x7f23ac071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23b0a00640 1 -- 172.21.15.5:0/187096424 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac0b63f0 con 0x7f23ac071c90 2024-08-18T22:22:54.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.151+0000 7f23ab400640 1 -- 172.21.15.5:0/187096424 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640006583 0 0) 0x7f23ac0b5e30 con 0x7f23ac06fad0 2024-08-18T22:22:54.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23b0a00640 1 --2- 172.21.15.5:0/187096424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac071c90 0x7f23ac15c560 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f23ac050430 tx=0x7f23a401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aea6c83fd4cb07b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:54.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23ab400640 1 -- 172.21.15.5:0/187096424 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a40a5720 con 0x7f23ac071c90 2024-08-18T22:22:54.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23ab400640 1 -- 172.21.15.5:0/187096424 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a40a58c0 con 0x7f23ac071c90 2024-08-18T22:22:54.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23ab400640 1 -- 172.21.15.5:0/187096424 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a40a5c90 con 0x7f23ac071c90 2024-08-18T22:22:54.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23b2a00640 1 -- 172.21.15.5:0/187096424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac071c90 msgr2=0x7f23ac15c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23b2a00640 1 --2- 172.21.15.5:0/187096424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac071c90 0x7f23ac15c560 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f23ac050430 tx=0x7f23a401c8a0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23b2a00640 1 -- 172.21.15.5:0/187096424 shutdown_connections 2024-08-18T22:22:54.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23b2a00640 1 --2- 172.21.15.5:0/187096424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac071c90 0x7f23ac15c560 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23b2a00640 1 --2- 172.21.15.5:0/187096424 >> v2:172.21.15.117:3300/0 conn(0x7f23ac15c180 0x7f23ac0b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23b2a00640 1 -- 172.21.15.5:0/187096424 >> 172.21.15.5:0/187096424 conn(0x7f23ac0b3eb0 msgr2=0x7f23ac0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:54.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23b2a00640 1 -- 172.21.15.5:0/187096424 shutdown_connections 2024-08-18T22:22:54.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.155+0000 7f23b2a00640 1 -- 172.21.15.5:0/187096424 wait complete. 2024-08-18T22:22:54.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23b2a00640 1 Processor -- start 2024-08-18T22:22:54.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23b2a00640 1 -- start start 2024-08-18T22:22:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23b2a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23ac06fad0 0x7f23ac1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23b2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac071c90 0x7f23ac1f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23b2a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23ac15c180 0x7f23ac1f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23b2a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac0d1c30 con 0x7f23ac071c90 2024-08-18T22:22:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23b2a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac0d1ab0 con 0x7f23ac06fad0 2024-08-18T22:22:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23b2a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f23ac0d1db0 con 0x7f23ac15c180 2024-08-18T22:22:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac071c90 0x7f23ac1f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac071c90 0x7f23ac1f6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42010/0 (socket says 172.21.15.5:42010) 2024-08-18T22:22:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a3400640 1 -- 172.21.15.5:0/2586486472 learned_addr learned my addr 172.21.15.5:0/2586486472 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23abe00640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23ac06fad0 0x7f23ac1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23b0a00640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23ac15c180 0x7f23ac1f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a3400640 1 -- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23ac15c180 msgr2=0x7f23ac1f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a3400640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23ac15c180 0x7f23ac1f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a3400640 1 -- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23ac06fad0 msgr2=0x7f23ac1578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a3400640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23ac06fad0 0x7f23ac1578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a3400640 1 -- 172.21.15.5:0/2586486472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac0b3c00 con 0x7f23ac071c90 2024-08-18T22:22:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a3400640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac071c90 0x7f23ac1f6910 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f239400c500 tx=0x7f239400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a8c00640 1 -- 172.21.15.5:0/2586486472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394017070 con 0x7f23ac071c90 2024-08-18T22:22:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a8c00640 1 -- 172.21.15.5:0/2586486472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2394003600 con 0x7f23ac071c90 2024-08-18T22:22:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23a8c00640 1 -- 172.21.15.5:0/2586486472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23940039f0 con 0x7f23ac071c90 2024-08-18T22:22:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23b2a00640 1 -- 172.21.15.5:0/2586486472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ac0b3920 con 0x7f23ac071c90 2024-08-18T22:22:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.159+0000 7f23b2a00640 1 -- 172.21.15.5:0/2586486472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ac15d970 con 0x7f23ac071c90 2024-08-18T22:22:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.163+0000 7f23b2a00640 1 -- 172.21.15.5:0/2586486472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ac15c560 con 0x7f23ac071c90 2024-08-18T22:22:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.163+0000 7f23a8c00640 1 -- 172.21.15.5:0/2586486472 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f239401a070 con 0x7f23ac071c90 2024-08-18T22:22:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.163+0000 7f23a8c00640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23880678c0 0x7f2388069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.163+0000 7f23a8c00640 1 -- 172.21.15.5:0/2586486472 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f2394084f20 con 0x7f23ac071c90 2024-08-18T22:22:54.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.163+0000 7f23abe00640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23880678c0 0x7f2388069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.163+0000 7f23abe00640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23880678c0 0x7f2388069d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f23ac1521f0 tx=0x7f239c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:54.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.167+0000 7f23a8c00640 1 -- 172.21.15.5:0/2586486472 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2394055630 con 0x7f23ac071c90 2024-08-18T22:22:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.335+0000 7f23b2a00640 1 -- 172.21.15.5:0/2586486472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23ac0725e0 con 0x7f23ac071c90 2024-08-18T22:22:54.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.335+0000 7f23a8c00640 1 -- 172.21.15.5:0/2586486472 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+13219 (secure 0 0 0) 0x7f2394059930 con 0x7f23ac071c90 2024-08-18T22:22:54.341 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:54.341 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":58,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:22:52.970521+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/3590404197":"2024-08-19T22:22:49.964076+0000","172.21.15.5:6834/3590404197":"2024-08-19T22:22:49.964076+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:22:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 -- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23880678c0 msgr2=0x7f2388069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23880678c0 0x7f2388069d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f23ac1521f0 tx=0x7f239c008040 comp rx=0 tx=0).stop 2024-08-18T22:22:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 -- 172.21.15.5:0/2586486472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac071c90 msgr2=0x7f23ac1f6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac071c90 0x7f23ac1f6910 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f239400c500 tx=0x7f239400c9c0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 -- 172.21.15.5:0/2586486472 shutdown_connections 2024-08-18T22:22:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23880678c0 0x7f2388069d80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23ac15c180 0x7f23ac1f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac071c90 0x7f23ac1f6910 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 --2- 172.21.15.5:0/2586486472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23ac06fad0 0x7f23ac1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 -- 172.21.15.5:0/2586486472 >> 172.21.15.5:0/2586486472 conn(0x7f23ac0b3eb0 msgr2=0x7f23ac0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 -- 172.21.15.5:0/2586486472 shutdown_connections 2024-08-18T22:22:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.339+0000 7f23b2a00640 1 -- 172.21.15.5:0/2586486472 wait complete. 2024-08-18T22:22:54.363 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:22:54.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:22:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.503+0000 7f92e2400640 1 Processor -- start 2024-08-18T22:22:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.503+0000 7f92e2400640 1 -- start start 2024-08-18T22:22:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.503+0000 7f92e2400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92dc0b40c0 0x7f92dc0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.503+0000 7f92e2400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f92dc0ce280 0x7f92dc0ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.503+0000 7f92e2400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92dc0b31f0 con 0x7f92dc15b0c0 2024-08-18T22:22:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.503+0000 7f92e2400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f92dc0b3d70 con 0x7f92dc0ce280 2024-08-18T22:22:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.503+0000 7f92e2400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f92dc0b4a40 con 0x7f92dc0b40c0 2024-08-18T22:22:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92d2a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92dc0b40c0 0x7f92dc0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92dbe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f92dc0ce280 0x7f92dc0ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92d2a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92dc0b40c0 0x7f92dc0b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:43046/0 (socket says 172.21.15.5:43046) 2024-08-18T22:22:54.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92d2a00640 1 -- 172.21.15.5:0/2625215502 learned_addr learned my addr 172.21.15.5:0/2625215502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:54.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92dbe00640 1 -- 172.21.15.5:0/2625215502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92dc0b40c0 msgr2=0x7f92dc0b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:54.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92dbe00640 1 --2- 172.21.15.5:0/2625215502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92dc0b40c0 0x7f92dc0b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92dbe00640 1 -- 172.21.15.5:0/2625215502 >> v1:172.21.15.117:6789/0 conn(0x7f92dc15b0c0 legacy=0x7f92dc06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92dbe00640 1 -- 172.21.15.5:0/2625215502 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc0b34d0 con 0x7f92dc0ce280 2024-08-18T22:22:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92dbe00640 1 --2- 172.21.15.5:0/2625215502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92dc0ce280 0x7f92dc0ce6d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009d90 tx=0x7f92d401c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cfabe044fb8f2d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92daa00640 1 -- 172.21.15.5:0/2625215502 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d40b2070 con 0x7f92dc0ce280 2024-08-18T22:22:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92daa00640 1 -- 172.21.15.5:0/2625215502 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d40a5800 con 0x7f92dc0ce280 2024-08-18T22:22:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.507+0000 7f92daa00640 1 -- 172.21.15.5:0/2625215502 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d40a5bd0 con 0x7f92dc0ce280 2024-08-18T22:22:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 -- 172.21.15.5:0/2625215502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92dc0ce280 msgr2=0x7f92dc0ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 --2- 172.21.15.5:0/2625215502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92dc0ce280 0x7f92dc0ce6d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009d90 tx=0x7f92d401c850 comp rx=0 tx=0).stop 2024-08-18T22:22:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 -- 172.21.15.5:0/2625215502 shutdown_connections 2024-08-18T22:22:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 --2- 172.21.15.5:0/2625215502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92dc0ce280 0x7f92dc0ce6d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 --2- 172.21.15.5:0/2625215502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92dc0b40c0 0x7f92dc0b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 -- 172.21.15.5:0/2625215502 >> 172.21.15.5:0/2625215502 conn(0x7f92dc0b1dc0 msgr2=0x7f92dc0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 -- 172.21.15.5:0/2625215502 shutdown_connections 2024-08-18T22:22:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 -- 172.21.15.5:0/2625215502 wait complete. 2024-08-18T22:22:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 Processor -- start 2024-08-18T22:22:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 -- start start 2024-08-18T22:22:54.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92dc0b40c0 0x7f92dc14d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92dc0ce280 0x7f92dc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92dc15b0c0 0x7f92dc06e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc06f7f0 con 0x7f92dc0b40c0 2024-08-18T22:22:54.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc06f670 con 0x7f92dc15b0c0 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92e2400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f92dc165d00 con 0x7f92dc0ce280 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92db400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92dc0b40c0 0x7f92dc14d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92db400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92dc0b40c0 0x7f92dc14d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42016/0 (socket says 172.21.15.5:42016) 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92db400640 1 -- 172.21.15.5:0/892360161 learned_addr learned my addr 172.21.15.5:0/892360161 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92dbe00640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92dc15b0c0 0x7f92dc06e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.511+0000 7f92d2a00640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92dc0ce280 0x7f92dc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92db400640 1 -- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92dc0ce280 msgr2=0x7f92dc06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92db400640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92dc0ce280 0x7f92dc06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92db400640 1 -- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92dc15b0c0 msgr2=0x7f92dc06e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92db400640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92dc15b0c0 0x7f92dc06e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92db400640 1 -- 172.21.15.5:0/892360161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc167e30 con 0x7f92dc0b40c0 2024-08-18T22:22:54.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92db400640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92dc0b40c0 0x7f92dc14d410 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c3a0 tx=0x7f92cc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:54.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92d3e00640 1 -- 172.21.15.5:0/892360161 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0052d0 con 0x7f92dc0b40c0 2024-08-18T22:22:54.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92d3e00640 1 -- 172.21.15.5:0/892360161 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc005470 con 0x7f92dc0b40c0 2024-08-18T22:22:54.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92d3e00640 1 -- 172.21.15.5:0/892360161 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc007260 con 0x7f92dc0b40c0 2024-08-18T22:22:54.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92e2400640 1 -- 172.21.15.5:0/892360161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92dc168110 con 0x7f92dc0b40c0 2024-08-18T22:22:54.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92e2400640 1 -- 172.21.15.5:0/892360161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92dc14d950 con 0x7f92dc0b40c0 2024-08-18T22:22:54.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92e2400640 1 -- 172.21.15.5:0/892360161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92dc0b4500 con 0x7f92dc0b40c0 2024-08-18T22:22:54.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.515+0000 7f92d3e00640 1 -- 172.21.15.5:0/892360161 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92cc007400 con 0x7f92dc0b40c0 2024-08-18T22:22:54.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.519+0000 7f92d3e00640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92b80678f0 0x7f92b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.519+0000 7f92d3e00640 1 -- 172.21.15.5:0/892360161 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f92cc084f00 con 0x7f92dc0b40c0 2024-08-18T22:22:54.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.519+0000 7f92d2a00640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92b80678f0 0x7f92b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.519+0000 7f92d2a00640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92b80678f0 0x7f92b8069db0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f92dc1fa860 tx=0x7f92c4009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:54.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.523+0000 7f92d3e00640 1 -- 172.21.15.5:0/892360161 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f92cc055550 con 0x7f92dc0b40c0 2024-08-18T22:22:54.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.687+0000 7f92e2400640 1 -- 172.21.15.5:0/892360161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f92dc0af280 con 0x7f92dc0b40c0 2024-08-18T22:22:54.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.687+0000 7f92d3e00640 1 -- 172.21.15.5:0/892360161 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) ==== 93+0+10 (secure 0 0 0) 0x7f92cc059850 con 0x7f92dc0b40c0 2024-08-18T22:22:54.692 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:22:54.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 -- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92b80678f0 msgr2=0x7f92b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92b80678f0 0x7f92b8069db0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f92dc1fa860 tx=0x7f92c4009240 comp rx=0 tx=0).stop 2024-08-18T22:22:54.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 -- 172.21.15.5:0/892360161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92dc0b40c0 msgr2=0x7f92dc14d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92dc0b40c0 0x7f92dc14d410 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c3a0 tx=0x7f92cc00c860 comp rx=0 tx=0).stop 2024-08-18T22:22:54.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 -- 172.21.15.5:0/892360161 shutdown_connections 2024-08-18T22:22:54.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92b80678f0 0x7f92b8069db0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92dc15b0c0 0x7f92dc06e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92dc0ce280 0x7f92dc06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 --2- 172.21.15.5:0/892360161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92dc0b40c0 0x7f92dc14d410 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 -- 172.21.15.5:0/892360161 >> 172.21.15.5:0/892360161 conn(0x7f92dc0b1dc0 msgr2=0x7f92dc06db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:54.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 -- 172.21.15.5:0/892360161 shutdown_connections 2024-08-18T22:22:54.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.691+0000 7f92e2400640 1 -- 172.21.15.5:0/892360161 wait complete. 2024-08-18T22:22:54.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-08-18T22:22:54.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c6200640 1 Processor -- start 2024-08-18T22:22:54.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c6200640 1 -- start start 2024-08-18T22:22:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c6200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c009b520 0x7f32c015f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c6200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32c00d02a0 0x7f32c00d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c6200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32c009b980 con 0x7f32c0070510 2024-08-18T22:22:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c6200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f32c015f670 con 0x7f32c00d02a0 2024-08-18T22:22:54.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c6200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f32c006fe70 con 0x7f32c009b520 2024-08-18T22:22:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c4e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f32c0070510 0x7f32c00708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37952/0 (socket says 172.21.15.5:37952) 2024-08-18T22:22:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c4e00640 1 -- 172.21.15.5:0/592775635 learned_addr learned my addr 172.21.15.5:0/592775635 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c5800640 1 --2- 172.21.15.5:0/592775635 >> v2:172.21.15.117:3300/0 conn(0x7f32c00d02a0 0x7f32c00d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32bfe00640 1 --2- 172.21.15.5:0/592775635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c009b520 0x7f32c015f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32bf400640 1 -- 172.21.15.5:0/592775635 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104697057 0 0) 0x7f32c009b980 con 0x7f32c0070510 2024-08-18T22:22:54.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32bf400640 1 -- 172.21.15.5:0/592775635 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32a4003530 con 0x7f32c0070510 2024-08-18T22:22:54.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c5800640 1 -- 172.21.15.5:0/592775635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c009b520 msgr2=0x7f32c015f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:54.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c5800640 1 --2- 172.21.15.5:0/592775635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c009b520 0x7f32c015f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c5800640 1 -- 172.21.15.5:0/592775635 >> v1:172.21.15.5:6789/0 conn(0x7f32c0070510 legacy=0x7f32c00708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.851+0000 7f32c5800640 1 -- 172.21.15.5:0/592775635 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c0070150 con 0x7f32c00d02a0 2024-08-18T22:22:54.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32c5800640 1 --2- 172.21.15.5:0/592775635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c00d02a0 0x7f32c00d0730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f32b80097c0 tx=0x7f32b801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3fd0854226abdce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32bf400640 1 -- 172.21.15.5:0/592775635 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b80b0070 con 0x7f32c00d02a0 2024-08-18T22:22:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32bf400640 1 -- 172.21.15.5:0/592775635 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b80ab600 con 0x7f32c00d02a0 2024-08-18T22:22:54.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32bf400640 1 -- 172.21.15.5:0/592775635 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b80ab9d0 con 0x7f32c00d02a0 2024-08-18T22:22:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32c6200640 1 -- 172.21.15.5:0/592775635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c00d02a0 msgr2=0x7f32c00d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32c6200640 1 --2- 172.21.15.5:0/592775635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c00d02a0 0x7f32c00d0730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f32b80097c0 tx=0x7f32b801c4a0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32c6200640 1 -- 172.21.15.5:0/592775635 shutdown_connections 2024-08-18T22:22:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32c6200640 1 --2- 172.21.15.5:0/592775635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c00d02a0 0x7f32c00d0730 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32c6200640 1 --2- 172.21.15.5:0/592775635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c009b520 0x7f32c015f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32c6200640 1 -- 172.21.15.5:0/592775635 >> 172.21.15.5:0/592775635 conn(0x7f32c00b3a20 msgr2=0x7f32c00b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32c6200640 1 -- 172.21.15.5:0/592775635 shutdown_connections 2024-08-18T22:22:54.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.855+0000 7f32c6200640 1 -- 172.21.15.5:0/592775635 wait complete. 2024-08-18T22:22:54.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c6200640 1 Processor -- start 2024-08-18T22:22:54.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c6200640 1 -- start start 2024-08-18T22:22:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c6200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c0070510 0x7f32c0150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c6200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c009b520 0x7f32c0162270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c00d02a0 0x7f32c015d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c6200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f32c00b46d0 con 0x7f32c00d02a0 2024-08-18T22:22:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c6200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f32c006fb00 con 0x7f32c009b520 2024-08-18T22:22:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c6200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f32c00b4850 con 0x7f32c0070510 2024-08-18T22:22:54.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c00d02a0 0x7f32c015d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c00d02a0 0x7f32c015d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42032/0 (socket says 172.21.15.5:42032) 2024-08-18T22:22:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c5800640 1 -- 172.21.15.5:0/2159193978 learned_addr learned my addr 172.21.15.5:0/2159193978 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32bfe00640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c009b520 0x7f32c0162270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c4e00640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c0070510 0x7f32c0150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c5800640 1 -- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c0070510 msgr2=0x7f32c0150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c5800640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c0070510 0x7f32c0150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c5800640 1 -- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c009b520 msgr2=0x7f32c0162270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c5800640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c009b520 0x7f32c0162270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c5800640 1 -- 172.21.15.5:0/2159193978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c006d770 con 0x7f32c00d02a0 2024-08-18T22:22:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c4e00640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c0070510 0x7f32c0150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:22:54.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c5800640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c00d02a0 0x7f32c015d300 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f32b801a0d0 tx=0x7f32b8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:54.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32bcc00640 1 -- 172.21.15.5:0/2159193978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b80b0040 con 0x7f32c00d02a0 2024-08-18T22:22:54.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32bcc00640 1 -- 172.21.15.5:0/2159193978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b80b9070 con 0x7f32c00d02a0 2024-08-18T22:22:54.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c6200640 1 -- 172.21.15.5:0/2159193978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c015c260 con 0x7f32c00d02a0 2024-08-18T22:22:54.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32bcc00640 1 -- 172.21.15.5:0/2159193978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b80b4650 con 0x7f32c00d02a0 2024-08-18T22:22:54.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c6200640 1 -- 172.21.15.5:0/2159193978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c015c820 con 0x7f32c00d02a0 2024-08-18T22:22:54.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.859+0000 7f32c6200640 1 -- 172.21.15.5:0/2159193978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c0073d40 con 0x7f32c00d02a0 2024-08-18T22:22:54.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.863+0000 7f32bcc00640 1 -- 172.21.15.5:0/2159193978 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32b80b47f0 con 0x7f32c00d02a0 2024-08-18T22:22:54.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.863+0000 7f32bcc00640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a00678c0 0x7f32a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:54.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.863+0000 7f32bcc00640 1 -- 172.21.15.5:0/2159193978 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f32b811f9a0 con 0x7f32c00d02a0 2024-08-18T22:22:54.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.863+0000 7f32c4e00640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a00678c0 0x7f32a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:54.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.863+0000 7f32c4e00640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a00678c0 0x7f32a0069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f32b0005c10 tx=0x7f32b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:54.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:54.867+0000 7f32bcc00640 1 -- 172.21.15.5:0/2159193978 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f32b8016090 con 0x7f32c00d02a0 2024-08-18T22:22:55.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.091+0000 7f32c6200640 1 -- 172.21.15.5:0/2159193978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7f32c00b11d0 con 0x7f32c00d02a0 2024-08-18T22:22:55.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.987+0000 7f32bcc00640 1 -- 172.21.15.5:0/2159193978 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v185) ==== 154+0+0 (secure 0 0 0) 0x7f32b80f05b0 con 0x7f32c00d02a0 2024-08-18T22:22:55.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 -- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a00678c0 msgr2=0x7f32a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:55.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a00678c0 0x7f32a0069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f32b0005c10 tx=0x7f32b0009040 comp rx=0 tx=0).stop 2024-08-18T22:22:55.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 -- 172.21.15.5:0/2159193978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c00d02a0 msgr2=0x7f32c015d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:55.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c00d02a0 0x7f32c015d300 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f32b801a0d0 tx=0x7f32b8019240 comp rx=0 tx=0).stop 2024-08-18T22:22:55.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 -- 172.21.15.5:0/2159193978 shutdown_connections 2024-08-18T22:22:55.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a00678c0 0x7f32a0069d80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:55.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c00d02a0 0x7f32c015d300 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:55.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c009b520 0x7f32c0162270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:55.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 --2- 172.21.15.5:0/2159193978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c0070510 0x7f32c0150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:55.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 -- 172.21.15.5:0/2159193978 >> 172.21.15.5:0/2159193978 conn(0x7f32c00b3a20 msgr2=0x7f32c00708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:55.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 -- 172.21.15.5:0/2159193978 shutdown_connections 2024-08-18T22:22:55.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:55.991+0000 7f32c6200640 1 -- 172.21.15.5:0/2159193978 wait complete. 2024-08-18T22:22:56.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:22:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8ab0000640 1 Processor -- start 2024-08-18T22:22:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8ab0000640 1 -- start start 2024-08-18T22:22:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8ab0000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa809aca0 0x7f8aa80afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8ab0000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8aa809b080 0x7f8aa80b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8ab0000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aa806e8a0 con 0x7f8aa80b1300 2024-08-18T22:22:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8ab0000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8aa809bb80 con 0x7f8aa809b080 2024-08-18T22:22:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8ab0000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa80d2e40 con 0x7f8aa809aca0 2024-08-18T22:22:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8aae000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8aa809b080 0x7f8aa80b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8aad600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa809aca0 0x7f8aa80afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8aae000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8aa809b080 0x7f8aa80b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:59810/0 (socket says 172.21.15.5:59810) 2024-08-18T22:22:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8aae000640 1 -- 172.21.15.5:0/2431280077 learned_addr learned my addr 172.21.15.5:0/2431280077 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.163+0000 7f8aacc00640 1 --1- 172.21.15.5:0/2431280077 >> v1:172.21.15.117:6789/0 conn(0x7f8aa80b1300 0x7f8aa80affd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:36048/0 (socket says 172.21.15.5:36048) 2024-08-18T22:22:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.167+0000 7f8aad600640 1 -- 172.21.15.5:0/2431280077 >> v2:172.21.15.117:3300/0 conn(0x7f8aa809b080 msgr2=0x7f8aa80b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.167+0000 7f8aad600640 1 --2- 172.21.15.5:0/2431280077 >> v2:172.21.15.117:3300/0 conn(0x7f8aa809b080 0x7f8aa80b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.167+0000 7f8aad600640 1 -- 172.21.15.5:0/2431280077 >> v1:172.21.15.117:6789/0 conn(0x7f8aa80b1300 legacy=0x7f8aa80affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.167+0000 7f8aad600640 1 -- 172.21.15.5:0/2431280077 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa806cbd0 con 0x7f8aa809aca0 2024-08-18T22:22:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.167+0000 7f8aad600640 1 --2- 172.21.15.5:0/2431280077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa809aca0 0x7f8aa80afa90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0097f0 tx=0x7f8a9c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1befe6e1d67ec1a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.167+0000 7f8aa7e00640 1 -- 172.21.15.5:0/2431280077 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0b0070 con 0x7f8aa809aca0 2024-08-18T22:22:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.167+0000 7f8aa7e00640 1 -- 172.21.15.5:0/2431280077 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c004230 con 0x7f8aa809aca0 2024-08-18T22:22:56.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.167+0000 7f8aa7e00640 1 -- 172.21.15.5:0/2431280077 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c003620 con 0x7f8aa809aca0 2024-08-18T22:22:56.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.167+0000 7f8ab0000640 1 -- 172.21.15.5:0/2431280077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa809aca0 msgr2=0x7f8aa80afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:56.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.167+0000 7f8ab0000640 1 --2- 172.21.15.5:0/2431280077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa809aca0 0x7f8aa80afa90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0097f0 tx=0x7f8a9c01c4a0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 -- 172.21.15.5:0/2431280077 shutdown_connections 2024-08-18T22:22:56.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 --2- 172.21.15.5:0/2431280077 >> v2:172.21.15.117:3300/0 conn(0x7f8aa809b080 0x7f8aa80b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 --2- 172.21.15.5:0/2431280077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa809aca0 0x7f8aa80afa90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 -- 172.21.15.5:0/2431280077 >> 172.21.15.5:0/2431280077 conn(0x7f8aa80d2180 msgr2=0x7f8aa80d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:56.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 -- 172.21.15.5:0/2431280077 shutdown_connections 2024-08-18T22:22:56.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 -- 172.21.15.5:0/2431280077 wait complete. 2024-08-18T22:22:56.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 Processor -- start 2024-08-18T22:22:56.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 -- start start 2024-08-18T22:22:56.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa809aca0 0x7f8aa8150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa809b080 0x7f8aa80b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8aa80b1300 0x7f8aa8150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa816b6b0 con 0x7f8aa809b080 2024-08-18T22:22:56.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa816b530 con 0x7f8aa80b1300 2024-08-18T22:22:56.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8ab0000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa816b830 con 0x7f8aa809aca0 2024-08-18T22:22:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8aacc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa809b080 0x7f8aa80b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8aacc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa809b080 0x7f8aa80b6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42034/0 (socket says 172.21.15.5:42034) 2024-08-18T22:22:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8aacc00640 1 -- 172.21.15.5:0/1159200382 learned_addr learned my addr 172.21.15.5:0/1159200382 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8aae000640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8aa80b1300 0x7f8aa8150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8aad600640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa809aca0 0x7f8aa8150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8aacc00640 1 -- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa809aca0 msgr2=0x7f8aa8150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8aacc00640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa809aca0 0x7f8aa8150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8aacc00640 1 -- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8aa80b1300 msgr2=0x7f8aa8150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8aacc00640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8aa80b1300 0x7f8aa8150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8aacc00640 1 -- 172.21.15.5:0/1159200382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa80af690 con 0x7f8aa809b080 2024-08-18T22:22:56.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.171+0000 7f8aacc00640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa809b080 0x7f8aa80b6f90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c340 tx=0x7f8a9400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:56.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.175+0000 7f8aa5600640 1 -- 172.21.15.5:0/1159200382 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a940074e0 con 0x7f8aa809b080 2024-08-18T22:22:56.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.175+0000 7f8aa5600640 1 -- 172.21.15.5:0/1159200382 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a94007680 con 0x7f8aa809b080 2024-08-18T22:22:56.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.175+0000 7f8aa5600640 1 -- 172.21.15.5:0/1159200382 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94004a30 con 0x7f8aa809b080 2024-08-18T22:22:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.175+0000 7f8ab0000640 1 -- 172.21.15.5:0/1159200382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa80af970 con 0x7f8aa809b080 2024-08-18T22:22:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.175+0000 7f8ab0000640 1 -- 172.21.15.5:0/1159200382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa80aff30 con 0x7f8aa809b080 2024-08-18T22:22:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.175+0000 7f8ab0000640 1 -- 172.21.15.5:0/1159200382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa8161940 con 0x7f8aa809b080 2024-08-18T22:22:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.175+0000 7f8aa5600640 1 -- 172.21.15.5:0/1159200382 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a9401a020 con 0x7f8aa809b080 2024-08-18T22:22:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.175+0000 7f8aa5600640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a880678f0 0x7f8a88069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.175+0000 7f8aa5600640 1 -- 172.21.15.5:0/1159200382 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f8a940852b0 con 0x7f8aa809b080 2024-08-18T22:22:56.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.175+0000 7f8aad600640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a880678f0 0x7f8a88069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.179+0000 7f8aad600640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a880678f0 0x7f8a88069db0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0ad000 tx=0x7f8a9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:56.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.179+0000 7f8aa5600640 1 -- 172.21.15.5:0/1159200382 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8a94055f50 con 0x7f8aa809b080 2024-08-18T22:22:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.351+0000 7f8ab0000640 1 -- 172.21.15.5:0/1159200382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8aa8168d70 con 0x7f8aa809b080 2024-08-18T22:22:56.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.351+0000 7f8aa5600640 1 -- 172.21.15.5:0/1159200382 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f8a94055850 con 0x7f8aa809b080 2024-08-18T22:22:56.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 -- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a880678f0 msgr2=0x7f8a88069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:56.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a880678f0 0x7f8a88069db0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0ad000 tx=0x7f8a9c008040 comp rx=0 tx=0).stop 2024-08-18T22:22:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 -- 172.21.15.5:0/1159200382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa809b080 msgr2=0x7f8aa80b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa809b080 0x7f8aa80b6f90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c340 tx=0x7f8a9400c800 comp rx=0 tx=0).stop 2024-08-18T22:22:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 -- 172.21.15.5:0/1159200382 shutdown_connections 2024-08-18T22:22:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a880678f0 0x7f8a88069db0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8aa80b1300 0x7f8aa8150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa809b080 0x7f8aa80b6f90 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 --2- 172.21.15.5:0/1159200382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa809aca0 0x7f8aa8150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 -- 172.21.15.5:0/1159200382 >> 172.21.15.5:0/1159200382 conn(0x7f8aa80d2180 msgr2=0x7f8aa80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 -- 172.21.15.5:0/1159200382 shutdown_connections 2024-08-18T22:22:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.355+0000 7f8ab0000640 1 -- 172.21.15.5:0/1159200382 wait complete. 2024-08-18T22:22:56.379 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:22:56.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:22:56.467 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:22:56.574 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:22:56.574 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:22:56.574 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:56.583 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:22:56.583 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:22:56.583 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:56.592 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:22:56.592 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:22:56.592 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:56.632 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:22:56.633 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:22:56.633 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:22:56.646 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:22:56.646 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:22:56.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:22:56.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d3200640 1 Processor -- start 2024-08-18T22:22:56.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d3200640 1 -- start start 2024-08-18T22:22:56.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d415c080 0x7ff1d40cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d3200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff1d40cd920 0x7ff1d40cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d3200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d4070b50 con 0x7ff1d406b9b0 2024-08-18T22:22:56.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d3200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d40cfb40 con 0x7ff1d40cd920 2024-08-18T22:22:56.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d4070e30 con 0x7ff1d415c080 2024-08-18T22:22:56.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d2800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff1d406b9b0 0x7ff1d40731c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37958/0 (socket says 172.21.15.5:37958) 2024-08-18T22:22:56.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d2800640 1 -- 172.21.15.5:0/3902018505 learned_addr learned my addr 172.21.15.5:0/3902018505 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:22:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1e00640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d415c080 0x7ff1d40cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1c9400640 1 --2- 172.21.15.5:0/3902018505 >> v2:172.21.15.117:3300/0 conn(0x7ff1d40cd920 0x7ff1d40cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144463049 0 0) 0x7ff1d4070b50 con 0x7ff1d406b9b0 2024-08-18T22:22:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1b8003530 con 0x7ff1d406b9b0 2024-08-18T22:22:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 297595109 0 0) 0x7ff1b8003530 con 0x7ff1d406b9b0 2024-08-18T22:22:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d415c080 msgr2=0x7ff1d40cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d415c080 0x7ff1d40cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 >> v2:172.21.15.117:3300/0 conn(0x7ff1d40cd920 msgr2=0x7ff1d40cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 --2- 172.21.15.5:0/3902018505 >> v2:172.21.15.117:3300/0 conn(0x7ff1d40cd920 0x7ff1d40cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d4071110 con 0x7ff1d406b9b0 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7ff1cc001a00 con 0x7ff1d406b9b0 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 >> v1:172.21.15.5:6789/0 conn(0x7ff1d406b9b0 legacy=0x7ff1d40731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b80039c0 0x7ff1b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 0x7ff1b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d415c080 0x7ff1b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d40cfb40 con 0x7ff1b8004810 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4070e30 con 0x7ff1b80039c0 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b800b9d0 con 0x7ff1d415c080 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1c9400640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 0x7ff1b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d1e00640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b80039c0 0x7ff1b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1d2800640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d415c080 0x7ff1b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1c9400640 1 -- 172.21.15.5:0/3902018505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d415c080 msgr2=0x7ff1b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:56.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1c9400640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d415c080 0x7ff1b80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1c9400640 1 -- 172.21.15.5:0/3902018505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b80039c0 msgr2=0x7ff1b8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:22:56.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1c9400640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b80039c0 0x7ff1b8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.819+0000 7ff1c9400640 1 -- 172.21.15.5:0/3902018505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b8003530 con 0x7ff1b8004810 2024-08-18T22:22:56.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.823+0000 7ff1c9400640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 0x7ff1b8004c90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009ab0 tx=0x7ff1bc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3987dd7727c6c34 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:56.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.823+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0b2070 con 0x7ff1b8004810 2024-08-18T22:22:56.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.823+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc0a55a0 con 0x7ff1b8004810 2024-08-18T22:22:56.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.823+0000 7ff1d1400640 1 -- 172.21.15.5:0/3902018505 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0096b0 con 0x7ff1b8004810 2024-08-18T22:22:56.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.823+0000 7ff1d3200640 1 -- 172.21.15.5:0/3902018505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 msgr2=0x7ff1b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:56.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.823+0000 7ff1d3200640 1 --2- 172.21.15.5:0/3902018505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 0x7ff1b8004c90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009ab0 tx=0x7ff1bc01ca30 comp rx=0 tx=0).stop 2024-08-18T22:22:56.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.823+0000 7ff1d2800640 1 -- 172.21.15.5:0/3902018505 reap_dead start 2024-08-18T22:22:56.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.823+0000 7ff1d3200640 1 -- 172.21.15.5:0/3902018505 shutdown_connections 2024-08-18T22:22:56.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.823+0000 7ff1d3200640 1 -- 172.21.15.5:0/3902018505 >> 172.21.15.5:0/3902018505 conn(0x7ff1d40d0ed0 msgr2=0x7ff1d40d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:56.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.823+0000 7ff1d3200640 1 -- 172.21.15.5:0/3902018505 shutdown_connections 2024-08-18T22:22:56.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.823+0000 7ff1d3200640 1 -- 172.21.15.5:0/3902018505 wait complete. 2024-08-18T22:22:56.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d3200640 1 Processor -- start 2024-08-18T22:22:56.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d3200640 1 -- start start 2024-08-18T22:22:56.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 0x7ff1d41581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d3200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d4156af0 0x7ff1d4147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d41f3de0 0x7ff1d4159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d3200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d40707e0 con 0x7ff1b8004810 2024-08-18T22:22:56.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d3200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4072ca0 con 0x7ff1d4156af0 2024-08-18T22:22:56.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d40cf600 con 0x7ff1d41f3de0 2024-08-18T22:22:56.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 0x7ff1d41581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 0x7ff1d41581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42064/0 (socket says 172.21.15.5:42064) 2024-08-18T22:22:56.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d1e00640 1 -- 172.21.15.5:0/746093894 learned_addr learned my addr 172.21.15.5:0/746093894 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:22:56.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d1e00640 1 -- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d41f3de0 msgr2=0x7ff1d4159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:56.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d1e00640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d41f3de0 0x7ff1d4159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d1e00640 1 -- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d4156af0 msgr2=0x7ff1d4147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:56.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d1e00640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d4156af0 0x7ff1d4147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:56.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d1e00640 1 -- 172.21.15.5:0/746093894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d4158790 con 0x7ff1b8004810 2024-08-18T22:22:56.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d1e00640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 0x7ff1d41581b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40119d0 tx=0x7ff1c4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:56.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1caa00640 1 -- 172.21.15.5:0/746093894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400faf0 con 0x7ff1b8004810 2024-08-18T22:22:56.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1caa00640 1 -- 172.21.15.5:0/746093894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c400fc90 con 0x7ff1b8004810 2024-08-18T22:22:56.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d3200640 1 -- 172.21.15.5:0/746093894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d40aefe0 con 0x7ff1b8004810 2024-08-18T22:22:56.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1caa00640 1 -- 172.21.15.5:0/746093894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4014440 con 0x7ff1b8004810 2024-08-18T22:22:56.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.827+0000 7ff1d3200640 1 -- 172.21.15.5:0/746093894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d4147ea0 con 0x7ff1b8004810 2024-08-18T22:22:56.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.831+0000 7ff1d3200640 1 -- 172.21.15.5:0/746093894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d40aedf0 con 0x7ff1b8004810 2024-08-18T22:22:56.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.831+0000 7ff1caa00640 1 -- 172.21.15.5:0/746093894 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1c4012040 con 0x7ff1b8004810 2024-08-18T22:22:56.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.831+0000 7ff1caa00640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1b00678f0 0x7ff1b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:22:56.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.831+0000 7ff1caa00640 1 -- 172.21.15.5:0/746093894 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7ff1c40860d0 con 0x7ff1b8004810 2024-08-18T22:22:56.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.831+0000 7ff1c9400640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1b00678f0 0x7ff1b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:22:56.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.831+0000 7ff1c9400640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1b00678f0 0x7ff1b0069db0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0af000 tx=0x7ff1bc004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:22:56.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:56.835+0000 7ff1caa00640 1 -- 172.21.15.5:0/746093894 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff1c4019030 con 0x7ff1b8004810 2024-08-18T22:22:57.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.035+0000 7ff1d3200640 1 -- 172.21.15.5:0/746093894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1d40cdd60 con 0x7ff1b8004810 2024-08-18T22:22:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.035+0000 7ff1caa00640 1 -- 172.21.15.5:0/746093894 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+3908 (secure 0 0 0) 0x7ff1c4056e30 con 0x7ff1b8004810 2024-08-18T22:22:57.039 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:22:57.039 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"btime":"2024-08-18T22:22:50:966233+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5000,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3185015921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3185015921},{"type":"v1","addr":"172.21.15.117:6837","nonce":3185015921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3679281629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3679281629},{"type":"v1","addr":"172.21.15.117:6836","nonce":3679281629}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/649845928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":649845928},{"type":"v1","addr":"172.21.15.5:6833","nonce":649845928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1394302574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1394302574},{"type":"v1","addr":"172.21.15.5:6835","nonce":1394302574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[]} 2024-08-18T22:22:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2024-08-18T22:22:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.035+0000 7ff1d3200640 1 -- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1b00678f0 msgr2=0x7ff1b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.035+0000 7ff1d3200640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1b00678f0 0x7ff1b0069db0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0af000 tx=0x7ff1bc004740 comp rx=0 tx=0).stop 2024-08-18T22:22:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.035+0000 7ff1d3200640 1 -- 172.21.15.5:0/746093894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 msgr2=0x7ff1d41581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:22:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.035+0000 7ff1d3200640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 0x7ff1d41581b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40119d0 tx=0x7ff1c4011e90 comp rx=0 tx=0).stop 2024-08-18T22:22:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.039+0000 7ff1d3200640 1 -- 172.21.15.5:0/746093894 shutdown_connections 2024-08-18T22:22:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.039+0000 7ff1d3200640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1b00678f0 0x7ff1b0069db0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.039+0000 7ff1d3200640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d41f3de0 0x7ff1d4159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.039+0000 7ff1d3200640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d4156af0 0x7ff1d4147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.039+0000 7ff1d3200640 1 --2- 172.21.15.5:0/746093894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1b8004810 0x7ff1d41581b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:22:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.039+0000 7ff1d3200640 1 -- 172.21.15.5:0/746093894 >> 172.21.15.5:0/746093894 conn(0x7ff1d40d0ed0 msgr2=0x7ff1d40b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:22:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.039+0000 7ff1d3200640 1 -- 172.21.15.5:0/746093894 shutdown_connections 2024-08-18T22:22:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:22:57.039+0000 7ff1d3200640 1 -- 172.21.15.5:0/746093894 wait complete. 2024-08-18T22:22:57.061 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:22:57.061 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:22:57.061 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:22:57.061 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:22:57.061 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:22:57.061 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:22:57.062 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:22:57.062 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:22:57.062 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:22:57.062 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:22:57.062 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:22:57.062 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:22:57.062 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:22:57.063 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:22:57.063 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:22:57.063 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:22:57.074 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:22:57.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:22:57.076 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:22:57.076 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:22:57.076 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:22:57.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:22:57.122 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:22:57.122 DEBUG:teuthology.parallel:result is None 2024-08-18T22:22:57.123 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:22:57.123 DEBUG:teuthology.parallel:result is None 2024-08-18T22:22:57.124 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:22:57.124 DEBUG:teuthology.parallel:result is None 2024-08-18T22:22:57.206 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:22:57.212 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:22:57.214 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:22:59.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-08-18T22:23:03.075 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:23:03.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:23:03.079 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:23:03.079 DEBUG:teuthology.parallel:result is None 2024-08-18T22:23:03.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:23:03.173 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:23:03.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c9c00640 1 Processor -- start 2024-08-18T22:23:03.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c9c00640 1 -- start start 2024-08-18T22:23:03.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c9c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f79c415b0c0 0x7f79c406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:03.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c9c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79c40cf290 0x7f79c40b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:03.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c9c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c40b31f0 con 0x7f79c40b40c0 2024-08-18T22:23:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c9c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f79c40b4a70 con 0x7f79c40cf290 2024-08-18T22:23:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c9c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f79c40b3d70 con 0x7f79c415b0c0 2024-08-18T22:23:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79c40cf290 0x7f79c40b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79ba000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f79c40b40c0 0x7f79c4072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37984/0 (socket says 172.21.15.5:37984) 2024-08-18T22:23:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79ba000640 1 -- 172.21.15.5:0/873967323 learned_addr learned my addr 172.21.15.5:0/873967323 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c2a00640 1 --2- 172.21.15.5:0/873967323 >> v2:172.21.15.117:3300/0 conn(0x7f79c415b0c0 0x7f79c406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:03.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c3400640 1 -- 172.21.15.5:0/873967323 >> v2:172.21.15.117:3300/0 conn(0x7f79c415b0c0 msgr2=0x7f79c406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c3400640 1 --2- 172.21.15.5:0/873967323 >> v2:172.21.15.117:3300/0 conn(0x7f79c415b0c0 0x7f79c406db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c3400640 1 -- 172.21.15.5:0/873967323 >> v1:172.21.15.5:6789/0 conn(0x7f79c40b40c0 legacy=0x7f79c4072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c2000640 1 -- 172.21.15.5:0/873967323 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2241528236 0 0) 0x7f79c40b31f0 con 0x7f79c40b40c0 2024-08-18T22:23:03.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.231+0000 7f79c3400640 1 -- 172.21.15.5:0/873967323 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c40b34d0 con 0x7f79c40cf290 2024-08-18T22:23:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c3400640 1 --2- 172.21.15.5:0/873967323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c40cf290 0x7f79c40b4530 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f79c4070ba0 tx=0x7f79bc01c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a13ff166551f50f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c2000640 1 -- 172.21.15.5:0/873967323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc0b2070 con 0x7f79c40cf290 2024-08-18T22:23:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c2000640 1 -- 172.21.15.5:0/873967323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79bc0a58a0 con 0x7f79c40cf290 2024-08-18T22:23:03.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c2000640 1 -- 172.21.15.5:0/873967323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc0a5c70 con 0x7f79c40cf290 2024-08-18T22:23:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c9c00640 1 -- 172.21.15.5:0/873967323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c40cf290 msgr2=0x7f79c40b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c9c00640 1 --2- 172.21.15.5:0/873967323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c40cf290 0x7f79c40b4530 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f79c4070ba0 tx=0x7f79bc01c7e0 comp rx=0 tx=0).stop 2024-08-18T22:23:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c9c00640 1 -- 172.21.15.5:0/873967323 shutdown_connections 2024-08-18T22:23:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c9c00640 1 --2- 172.21.15.5:0/873967323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c40cf290 0x7f79c40b4530 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:03.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c9c00640 1 --2- 172.21.15.5:0/873967323 >> v2:172.21.15.117:3300/0 conn(0x7f79c415b0c0 0x7f79c406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c9c00640 1 -- 172.21.15.5:0/873967323 >> 172.21.15.5:0/873967323 conn(0x7f79c40b1dc0 msgr2=0x7f79c40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c9c00640 1 -- 172.21.15.5:0/873967323 shutdown_connections 2024-08-18T22:23:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.235+0000 7f79c9c00640 1 -- 172.21.15.5:0/873967323 wait complete. 2024-08-18T22:23:03.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c9c00640 1 Processor -- start 2024-08-18T22:23:03.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c9c00640 1 -- start start 2024-08-18T22:23:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c9c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79c40b40c0 0x7f79c415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c9c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c40cf290 0x7f79c409a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c9c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79c415b0c0 0x7f79c40b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c9c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79c415b620 con 0x7f79c40cf290 2024-08-18T22:23:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c9c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f79c415b4a0 con 0x7f79c415b0c0 2024-08-18T22:23:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c9c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f79c406f670 con 0x7f79c40b40c0 2024-08-18T22:23:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79ba000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c40cf290 0x7f79c409a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:03.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79ba000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c40cf290 0x7f79c409a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42108/0 (socket says 172.21.15.5:42108) 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79ba000640 1 -- 172.21.15.5:0/2420842120 learned_addr learned my addr 172.21.15.5:0/2420842120 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c2a00640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79c40b40c0 0x7f79c415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c3400640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79c415b0c0 0x7f79c40b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79ba000640 1 -- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79c40b40c0 msgr2=0x7f79c415ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79ba000640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79c40b40c0 0x7f79c415ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79ba000640 1 -- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79c415b0c0 msgr2=0x7f79c40b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79ba000640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79c415b0c0 0x7f79c40b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79ba000640 1 -- 172.21.15.5:0/2420842120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c409a6f0 con 0x7f79c40cf290 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c3400640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79c415b0c0 0x7f79c40b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79ba000640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c40cf290 0x7f79c409a1b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00c4b0 tx=0x7f79ac00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79bb400640 1 -- 172.21.15.5:0/2420842120 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac018070 con 0x7f79c40cf290 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79bb400640 1 -- 172.21.15.5:0/2420842120 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79ac007500 con 0x7f79c40cf290 2024-08-18T22:23:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79bb400640 1 -- 172.21.15.5:0/2420842120 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac004a30 con 0x7f79c40cf290 2024-08-18T22:23:03.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c9c00640 1 -- 172.21.15.5:0/2420842120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c4154570 con 0x7f79c40cf290 2024-08-18T22:23:03.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.239+0000 7f79c9c00640 1 -- 172.21.15.5:0/2420842120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c415d030 con 0x7f79c40cf290 2024-08-18T22:23:03.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.243+0000 7f79c9c00640 1 -- 172.21.15.5:0/2420842120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c40b4530 con 0x7f79c40cf290 2024-08-18T22:23:03.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.243+0000 7f79bb400640 1 -- 172.21.15.5:0/2420842120 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f79ac004bd0 con 0x7f79c40cf290 2024-08-18T22:23:03.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.243+0000 7f79bb400640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79a00678c0 0x7f79a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:03.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.243+0000 7f79bb400640 1 -- 172.21.15.5:0/2420842120 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5335+0+0 (secure 0 0 0) 0x7f79ac084cc0 con 0x7f79c40cf290 2024-08-18T22:23:03.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.243+0000 7f79c2a00640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79a00678c0 0x7f79a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:03.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.243+0000 7f79c2a00640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79a00678c0 0x7f79a0069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f79c415e5a0 tx=0x7f79b4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:03.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.247+0000 7f79bb400640 1 -- 172.21.15.5:0/2420842120 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f79ac08b080 con 0x7f79c40cf290 2024-08-18T22:23:03.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:03.427+0000 7f79c9c00640 1 -- 172.21.15.5:0/2420842120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f79c4073c70 con 0x7f79c40cf290 2024-08-18T22:23:05.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79bb400640 1 -- 172.21.15.5:0/2420842120 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) ==== 97+0+0 (secure 0 0 0) 0x7f79ac055310 con 0x7f79c40cf290 2024-08-18T22:23:05.026 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:23:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 -- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79a00678c0 msgr2=0x7f79a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79a00678c0 0x7f79a0069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f79c415e5a0 tx=0x7f79b4009190 comp rx=0 tx=0).stop 2024-08-18T22:23:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 -- 172.21.15.5:0/2420842120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c40cf290 msgr2=0x7f79c409a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c40cf290 0x7f79c409a1b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00c4b0 tx=0x7f79ac00c970 comp rx=0 tx=0).stop 2024-08-18T22:23:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 -- 172.21.15.5:0/2420842120 shutdown_connections 2024-08-18T22:23:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79a00678c0 0x7f79a0069d80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79c415b0c0 0x7f79c40b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c40cf290 0x7f79c409a1b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 --2- 172.21.15.5:0/2420842120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79c40b40c0 0x7f79c415ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 -- 172.21.15.5:0/2420842120 >> 172.21.15.5:0/2420842120 conn(0x7f79c40b1dc0 msgr2=0x7f79c40cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 -- 172.21.15.5:0/2420842120 shutdown_connections 2024-08-18T22:23:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.022+0000 7f79c9c00640 1 -- 172.21.15.5:0/2420842120 wait complete. 2024-08-18T22:23:05.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:23:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.194+0000 7fc8d4200640 1 Processor -- start 2024-08-18T22:23:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.194+0000 7fc8d4200640 1 -- start start 2024-08-18T22:23:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8d4200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8cc06e180 0x7fc8cc0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8d4200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8cc073c80 con 0x7fc8cc15bed0 2024-08-18T22:23:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8d4200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8cc0ca5d0 con 0x7fc8cc0cb390 2024-08-18T22:23:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8d4200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc8cc0ca8b0 con 0x7fc8cc06e180 2024-08-18T22:23:05.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8d1800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc8cc15bed0 0x7fc8cc071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35472/0 (socket says 172.21.15.5:35472) 2024-08-18T22:23:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8d1800640 1 -- 172.21.15.5:0/3603078472 learned_addr learned my addr 172.21.15.5:0/3603078472 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8d2200640 1 --2- 172.21.15.5:0/3603078472 >> v2:172.21.15.5:3300/0 conn(0x7fc8cc06e180 0x7fc8cc0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8cbe00640 1 -- 172.21.15.5:0/3603078472 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687055892 0 0) 0x7fc8cc073c80 con 0x7fc8cc15bed0 2024-08-18T22:23:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8d2200640 1 -- 172.21.15.5:0/3603078472 >> v1:172.21.15.117:6789/0 conn(0x7fc8cc0cb390 legacy=0x7fc8cc06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8d2200640 1 -- 172.21.15.5:0/3603078472 >> v1:172.21.15.5:6789/0 conn(0x7fc8cc15bed0 legacy=0x7fc8cc071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8d2200640 1 -- 172.21.15.5:0/3603078472 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8cc0cab90 con 0x7fc8cc06e180 2024-08-18T22:23:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.198+0000 7fc8d2200640 1 --2- 172.21.15.5:0/3603078472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc06e180 0x7fc8cc0735a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009d90 tx=0x7fc8c401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e54890e86cfb47 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8cbe00640 1 -- 172.21.15.5:0/3603078472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c40b2070 con 0x7fc8cc06e180 2024-08-18T22:23:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8cbe00640 1 -- 172.21.15.5:0/3603078472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c40a5a20 con 0x7fc8cc06e180 2024-08-18T22:23:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8cbe00640 1 -- 172.21.15.5:0/3603078472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c40a5df0 con 0x7fc8cc06e180 2024-08-18T22:23:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 -- 172.21.15.5:0/3603078472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc06e180 msgr2=0x7fc8cc0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 --2- 172.21.15.5:0/3603078472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc06e180 0x7fc8cc0735a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009d90 tx=0x7fc8c401c940 comp rx=0 tx=0).stop 2024-08-18T22:23:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 -- 172.21.15.5:0/3603078472 shutdown_connections 2024-08-18T22:23:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 --2- 172.21.15.5:0/3603078472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc06e180 0x7fc8cc0735a0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 -- 172.21.15.5:0/3603078472 >> 172.21.15.5:0/3603078472 conn(0x7fc8cc0b1c50 msgr2=0x7fc8cc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 -- 172.21.15.5:0/3603078472 shutdown_connections 2024-08-18T22:23:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 -- 172.21.15.5:0/3603078472 wait complete. 2024-08-18T22:23:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 Processor -- start 2024-08-18T22:23:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 -- start start 2024-08-18T22:23:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc06e180 0x7fc8cc0b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc0cb390 0x7fc8cc15d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc15bed0 0x7fc8cc15d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc169b50 con 0x7fc8cc06e180 2024-08-18T22:23:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc1699d0 con 0x7fc8cc15bed0 2024-08-18T22:23:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d4200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc8cc169cd0 con 0x7fc8cc0cb390 2024-08-18T22:23:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d1800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc06e180 0x7fc8cc0b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d1800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc06e180 0x7fc8cc0b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43622/0 (socket says 172.21.15.5:43622) 2024-08-18T22:23:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d1800640 1 -- 172.21.15.5:0/3569728010 learned_addr learned my addr 172.21.15.5:0/3569728010 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d2200640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc15bed0 0x7fc8cc15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.202+0000 7fc8d0e00640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc0cb390 0x7fc8cc15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8d1800640 1 -- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc0cb390 msgr2=0x7fc8cc15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8d1800640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc0cb390 0x7fc8cc15d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8d1800640 1 -- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc15bed0 msgr2=0x7fc8cc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8d1800640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc15bed0 0x7fc8cc15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8d1800640 1 -- 172.21.15.5:0/3569728010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8cc15dfb0 con 0x7fc8cc06e180 2024-08-18T22:23:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8d1800640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc06e180 0x7fc8cc0b4c40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000c440 tx=0x7fc8c000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8c9600640 1 -- 172.21.15.5:0/3569728010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0018070 con 0x7fc8cc06e180 2024-08-18T22:23:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8c9600640 1 -- 172.21.15.5:0/3569728010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c00074e0 con 0x7fc8cc06e180 2024-08-18T22:23:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8d4200640 1 -- 172.21.15.5:0/3569728010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8cc15e290 con 0x7fc8cc06e180 2024-08-18T22:23:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8c9600640 1 -- 172.21.15.5:0/3569728010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0004a10 con 0x7fc8cc06e180 2024-08-18T22:23:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8d4200640 1 -- 172.21.15.5:0/3569728010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8cc15c990 con 0x7fc8cc06e180 2024-08-18T22:23:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8d4200640 1 -- 172.21.15.5:0/3569728010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8cc0735a0 con 0x7fc8cc06e180 2024-08-18T22:23:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8c9600640 1 -- 172.21.15.5:0/3569728010 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc8c001b070 con 0x7fc8cc06e180 2024-08-18T22:23:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8c9600640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8ac0678c0 0x7fc8ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.206+0000 7fc8c9600640 1 -- 172.21.15.5:0/3569728010 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5249+0+0 (secure 0 0 0) 0x7fc8c0084d40 con 0x7fc8cc06e180 2024-08-18T22:23:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.210+0000 7fc8d0e00640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8ac0678c0 0x7fc8ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.210+0000 7fc8d0e00640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8ac0678c0 0x7fc8ac069d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc166b60 tx=0x7fc8b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:05.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.210+0000 7fc8c9600640 1 -- 172.21.15.5:0/3569728010 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc8c0055350 con 0x7fc8cc06e180 2024-08-18T22:23:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.434+0000 7fc8d4200640 1 -- 172.21.15.5:0/3569728010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc8cc04fcf0 con 0x7fc8cc06e180 2024-08-18T22:23:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.434+0000 7fc8c9600640 1 -- 172.21.15.5:0/3569728010 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7fc8c0059650 con 0x7fc8cc06e180 2024-08-18T22:23:05.440 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:05.440 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:23:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:23:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:23:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:23:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:23:05.443 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:23:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:23:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:23:05.444 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.445 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:23:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:23:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:23:05.447 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:23:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:23:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.449 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:23:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:23:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:23:05.450 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:23:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:23:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:23:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.451 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:23:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:23:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:05.452 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:23:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:23:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:23:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:23:05.453 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:05.454 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:23:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:23:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:23:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:23:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:23:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.455 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:23:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:23:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:23:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:23:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:23:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.456 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:23:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:23:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:23:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:23:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:23:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:23:05.457 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:23:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:23:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:23:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:23:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:23:05.458 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.459 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:23:05.459 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:23:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 -- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8ac0678c0 msgr2=0x7fc8ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8ac0678c0 0x7fc8ac069d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc166b60 tx=0x7fc8b8009040 comp rx=0 tx=0).stop 2024-08-18T22:23:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 -- 172.21.15.5:0/3569728010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc06e180 msgr2=0x7fc8cc0b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc06e180 0x7fc8cc0b4c40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000c440 tx=0x7fc8c000c900 comp rx=0 tx=0).stop 2024-08-18T22:23:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 -- 172.21.15.5:0/3569728010 shutdown_connections 2024-08-18T22:23:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8ac0678c0 0x7fc8ac069d80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc15bed0 0x7fc8cc15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc0cb390 0x7fc8cc15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 --2- 172.21.15.5:0/3569728010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc06e180 0x7fc8cc0b4c40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 -- 172.21.15.5:0/3569728010 >> 172.21.15.5:0/3569728010 conn(0x7fc8cc0b1c50 msgr2=0x7fc8cc0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 -- 172.21.15.5:0/3569728010 shutdown_connections 2024-08-18T22:23:05.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.438+0000 7fc8d4200640 1 -- 172.21.15.5:0/3569728010 wait complete. 2024-08-18T22:23:05.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:23:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.598+0000 7f60d9a00640 1 Processor -- start 2024-08-18T22:23:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.598+0000 7f60d9a00640 1 -- start start 2024-08-18T22:23:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60d9a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60d40cb390 0x7f60d40735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60d9a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f60d406da70 0x7f60d406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60d9a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d4073c80 con 0x7f60d415bed0 2024-08-18T22:23:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60d9a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f60d406e3e0 con 0x7f60d40cb390 2024-08-18T22:23:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60d9a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f60d40ca5d0 con 0x7f60d406da70 2024-08-18T22:23:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60d2a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f60d415bed0 0x7f60d4071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35486/0 (socket says 172.21.15.5:35486) 2024-08-18T22:23:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60d2a00640 1 -- 172.21.15.5:0/874968795 learned_addr learned my addr 172.21.15.5:0/874968795 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60ca000640 1 --2- 172.21.15.5:0/874968795 >> v2:172.21.15.5:3300/0 conn(0x7f60d40cb390 0x7f60d40735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60d3400640 1 --2- 172.21.15.5:0/874968795 >> v2:172.21.15.117:3300/0 conn(0x7f60d406da70 0x7f60d406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60d2000640 1 -- 172.21.15.5:0/874968795 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1033709404 0 0) 0x7f60d4073c80 con 0x7f60d415bed0 2024-08-18T22:23:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60d2000640 1 -- 172.21.15.5:0/874968795 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60b8003530 con 0x7f60d415bed0 2024-08-18T22:23:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60ca000640 1 -- 172.21.15.5:0/874968795 >> v2:172.21.15.117:3300/0 conn(0x7f60d406da70 msgr2=0x7f60d406dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60ca000640 1 --2- 172.21.15.5:0/874968795 >> v2:172.21.15.117:3300/0 conn(0x7f60d406da70 0x7f60d406dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60ca000640 1 -- 172.21.15.5:0/874968795 >> v1:172.21.15.5:6789/0 conn(0x7f60d415bed0 legacy=0x7f60d4071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.602+0000 7f60ca000640 1 -- 172.21.15.5:0/874968795 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d40ca8b0 con 0x7f60d40cb390 2024-08-18T22:23:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60ca000640 1 --2- 172.21.15.5:0/874968795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d40cb390 0x7f60d40735a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f60d40cfe50 tx=0x7f60bc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c0e207e96ed802 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d2000640 1 -- 172.21.15.5:0/874968795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0ab650 con 0x7f60d40cb390 2024-08-18T22:23:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d2000640 1 -- 172.21.15.5:0/874968795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60bc0b0070 con 0x7f60d40cb390 2024-08-18T22:23:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d2000640 1 -- 172.21.15.5:0/874968795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0ab9f0 con 0x7f60d40cb390 2024-08-18T22:23:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 -- 172.21.15.5:0/874968795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d40cb390 msgr2=0x7f60d40735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 --2- 172.21.15.5:0/874968795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d40cb390 0x7f60d40735a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f60d40cfe50 tx=0x7f60bc01c450 comp rx=0 tx=0).stop 2024-08-18T22:23:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 -- 172.21.15.5:0/874968795 shutdown_connections 2024-08-18T22:23:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 --2- 172.21.15.5:0/874968795 >> v2:172.21.15.117:3300/0 conn(0x7f60d406da70 0x7f60d406dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 --2- 172.21.15.5:0/874968795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d40cb390 0x7f60d40735a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 -- 172.21.15.5:0/874968795 >> 172.21.15.5:0/874968795 conn(0x7f60d40b1c50 msgr2=0x7f60d40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 -- 172.21.15.5:0/874968795 shutdown_connections 2024-08-18T22:23:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 -- 172.21.15.5:0/874968795 wait complete. 2024-08-18T22:23:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 Processor -- start 2024-08-18T22:23:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 -- start start 2024-08-18T22:23:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d406da70 0x7f60d414cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d40cb390 0x7f60d40b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d415bed0 0x7f60d40b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f60d4168520 con 0x7f60d406da70 2024-08-18T22:23:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f60d41683a0 con 0x7f60d415bed0 2024-08-18T22:23:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.606+0000 7f60d9a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f60d41686a0 con 0x7f60d40cb390 2024-08-18T22:23:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d406da70 0x7f60d414cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d406da70 0x7f60d414cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43648/0 (socket says 172.21.15.5:43648) 2024-08-18T22:23:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d2a00640 1 -- 172.21.15.5:0/979525455 learned_addr learned my addr 172.21.15.5:0/979525455 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60ca000640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d40cb390 0x7f60d40b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d3400640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d415bed0 0x7f60d40b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d2a00640 1 -- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d40cb390 msgr2=0x7f60d40b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d2a00640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d40cb390 0x7f60d40b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d2a00640 1 -- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d415bed0 msgr2=0x7f60d40b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d2a00640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d415bed0 0x7f60d40b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d2a00640 1 -- 172.21.15.5:0/979525455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d4152cd0 con 0x7f60d406da70 2024-08-18T22:23:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d3400640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d415bed0 0x7f60d40b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d2a00640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d406da70 0x7f60d414cdc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f60c400c3c0 tx=0x7f60c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60cb400640 1 -- 172.21.15.5:0/979525455 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c4017070 con 0x7f60d406da70 2024-08-18T22:23:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60cb400640 1 -- 172.21.15.5:0/979525455 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c4005cf0 con 0x7f60d406da70 2024-08-18T22:23:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60cb400640 1 -- 172.21.15.5:0/979525455 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c40072f0 con 0x7f60d406da70 2024-08-18T22:23:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d9a00640 1 -- 172.21.15.5:0/979525455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d4152fb0 con 0x7f60d406da70 2024-08-18T22:23:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d9a00640 1 -- 172.21.15.5:0/979525455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d414d300 con 0x7f60d406da70 2024-08-18T22:23:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60d9a00640 1 -- 172.21.15.5:0/979525455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d4154eb0 con 0x7f60d406da70 2024-08-18T22:23:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60cb400640 1 -- 172.21.15.5:0/979525455 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f60c401a070 con 0x7f60d406da70 2024-08-18T22:23:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.610+0000 7f60cb400640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60b00678c0 0x7f60b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.614+0000 7f60cb400640 1 -- 172.21.15.5:0/979525455 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5249+0+0 (secure 0 0 0) 0x7f60c4084e00 con 0x7f60d406da70 2024-08-18T22:23:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.614+0000 7f60ca000640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60b00678c0 0x7f60b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.614+0000 7f60ca000640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60b00678c0 0x7f60b0069d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0af000 tx=0x7f60bc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.618+0000 7f60cb400640 1 -- 172.21.15.5:0/979525455 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f60d4154eb0 con 0x7f60d406da70 2024-08-18T22:23:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.782+0000 7f60d9a00640 1 -- 172.21.15.5:0/979525455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f60d406dea0 con 0x7f60d406da70 2024-08-18T22:23:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.782+0000 7f60cb400640 1 -- 172.21.15.5:0/979525455 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) ==== 84+0+65 (secure 0 0 0) 0x7f60c40554b0 con 0x7f60d406da70 2024-08-18T22:23:05.788 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:05.788 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:23:05.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:05.789 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:23:05.789 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:23:05.789 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:05.789 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:23:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 -- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60b00678c0 msgr2=0x7f60b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60b00678c0 0x7f60b0069d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0af000 tx=0x7f60bc0a7000 comp rx=0 tx=0).stop 2024-08-18T22:23:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 -- 172.21.15.5:0/979525455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d406da70 msgr2=0x7f60d414cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d406da70 0x7f60d414cdc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f60c400c3c0 tx=0x7f60c400c880 comp rx=0 tx=0).stop 2024-08-18T22:23:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 -- 172.21.15.5:0/979525455 shutdown_connections 2024-08-18T22:23:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60b00678c0 0x7f60b0069d80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d415bed0 0x7f60d40b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d40cb390 0x7f60d40b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 --2- 172.21.15.5:0/979525455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d406da70 0x7f60d414cdc0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 -- 172.21.15.5:0/979525455 >> 172.21.15.5:0/979525455 conn(0x7f60d40b1c50 msgr2=0x7f60d40b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 -- 172.21.15.5:0/979525455 shutdown_connections 2024-08-18T22:23:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.786+0000 7f60d9a00640 1 -- 172.21.15.5:0/979525455 wait complete. 2024-08-18T22:23:05.810 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:23:05.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:23:05.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc4a600640 1 Processor -- start 2024-08-18T22:23:05.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc4a600640 1 -- start start 2024-08-18T22:23:05.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc4a600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc4415bfe0 0x7fbc4409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc4a600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc440b5ae0 0x7fbc440b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc4a600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc440b6440 con 0x7fbc4415fb90 2024-08-18T22:23:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc4a600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbc440af8e0 con 0x7fbc4415bfe0 2024-08-18T22:23:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc4a600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc440b0d80 con 0x7fbc440b5ae0 2024-08-18T22:23:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc43e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbc4415fb90 0x7fbc44160000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35494/0 (socket says 172.21.15.5:35494) 2024-08-18T22:23:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc43e00640 1 -- 172.21.15.5:0/3239353323 learned_addr learned my addr 172.21.15.5:0/3239353323 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc43400640 1 --2- 172.21.15.5:0/3239353323 >> v2:172.21.15.117:3300/0 conn(0x7fbc4415bfe0 0x7fbc4409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc3aa00640 1 --2- 172.21.15.5:0/3239353323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc440b5ae0 0x7fbc440b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc42a00640 1 -- 172.21.15.5:0/3239353323 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812187562 0 0) 0x7fbc440b6440 con 0x7fbc4415fb90 2024-08-18T22:23:05.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc42a00640 1 -- 172.21.15.5:0/3239353323 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc28003530 con 0x7fbc4415fb90 2024-08-18T22:23:05.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc43400640 1 -- 172.21.15.5:0/3239353323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc440b5ae0 msgr2=0x7fbc440b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:05.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc43400640 1 --2- 172.21.15.5:0/3239353323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc440b5ae0 0x7fbc440b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc43400640 1 -- 172.21.15.5:0/3239353323 >> v1:172.21.15.5:6789/0 conn(0x7fbc4415fb90 legacy=0x7fbc44160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.950+0000 7fbc43400640 1 -- 172.21.15.5:0/3239353323 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4409b3e0 con 0x7fbc4415bfe0 2024-08-18T22:23:05.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc43400640 1 --2- 172.21.15.5:0/3239353323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc4415bfe0 0x7fbc4409aa40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbc340097c0 tx=0x7fbc3401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d4d9092896817bd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:05.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc42a00640 1 -- 172.21.15.5:0/3239353323 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc340b2070 con 0x7fbc4415bfe0 2024-08-18T22:23:05.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc42a00640 1 -- 172.21.15.5:0/3239353323 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc340ad640 con 0x7fbc4415bfe0 2024-08-18T22:23:05.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc42a00640 1 -- 172.21.15.5:0/3239353323 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc340ad9f0 con 0x7fbc4415bfe0 2024-08-18T22:23:05.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc4a600640 1 -- 172.21.15.5:0/3239353323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc4415bfe0 msgr2=0x7fbc4409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc4a600640 1 --2- 172.21.15.5:0/3239353323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc4415bfe0 0x7fbc4409aa40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbc340097c0 tx=0x7fbc3401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc4a600640 1 -- 172.21.15.5:0/3239353323 shutdown_connections 2024-08-18T22:23:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc4a600640 1 --2- 172.21.15.5:0/3239353323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc440b5ae0 0x7fbc440b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc4a600640 1 --2- 172.21.15.5:0/3239353323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc4415bfe0 0x7fbc4409aa40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc4a600640 1 -- 172.21.15.5:0/3239353323 >> 172.21.15.5:0/3239353323 conn(0x7fbc440b3d60 msgr2=0x7fbc440b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc4a600640 1 -- 172.21.15.5:0/3239353323 shutdown_connections 2024-08-18T22:23:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.954+0000 7fbc4a600640 1 -- 172.21.15.5:0/3239353323 wait complete. 2024-08-18T22:23:05.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc4a600640 1 Processor -- start 2024-08-18T22:23:05.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc4a600640 1 -- start start 2024-08-18T22:23:05.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc4a600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc440b5ae0 0x7fbc4415db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc4a600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4415bfe0 0x7fbc441434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc4a600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4415fb90 0x7fbc441502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc4a600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4406fee0 con 0x7fbc4415bfe0 2024-08-18T22:23:05.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc4a600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4415c3c0 con 0x7fbc440b5ae0 2024-08-18T22:23:05.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc4a600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbc440b55b0 con 0x7fbc4415fb90 2024-08-18T22:23:05.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4415bfe0 0x7fbc441434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4415bfe0 0x7fbc441434c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43650/0 (socket says 172.21.15.5:43650) 2024-08-18T22:23:05.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3aa00640 1 -- 172.21.15.5:0/85317988 learned_addr learned my addr 172.21.15.5:0/85317988 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:05.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc43400640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc440b5ae0 0x7fbc4415db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc43e00640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4415fb90 0x7fbc441502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3aa00640 1 -- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4415fb90 msgr2=0x7fbc441502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3aa00640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4415fb90 0x7fbc441502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3aa00640 1 -- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc440b5ae0 msgr2=0x7fbc4415db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:05.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3aa00640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc440b5ae0 0x7fbc4415db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:05.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3aa00640 1 -- 172.21.15.5:0/85317988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc44143a00 con 0x7fbc4415bfe0 2024-08-18T22:23:05.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc43e00640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4415fb90 0x7fbc441502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:05.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3aa00640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4415bfe0 0x7fbc441434c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00e840 tx=0x7fbc2c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:05.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3be00640 1 -- 172.21.15.5:0/85317988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c017070 con 0x7fbc4415bfe0 2024-08-18T22:23:05.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3be00640 1 -- 172.21.15.5:0/85317988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc2c00ee90 con 0x7fbc4415bfe0 2024-08-18T22:23:05.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc3be00640 1 -- 172.21.15.5:0/85317988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c00cb60 con 0x7fbc4415bfe0 2024-08-18T22:23:05.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc4a600640 1 -- 172.21.15.5:0/85317988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc441fa7f0 con 0x7fbc4415bfe0 2024-08-18T22:23:05.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc4a600640 1 -- 172.21.15.5:0/85317988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc441fadb0 con 0x7fbc4415bfe0 2024-08-18T22:23:05.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.958+0000 7fbc4a600640 1 -- 172.21.15.5:0/85317988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc440b5f00 con 0x7fbc4415bfe0 2024-08-18T22:23:05.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.962+0000 7fbc3be00640 1 -- 172.21.15.5:0/85317988 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbc2c01a070 con 0x7fbc4415bfe0 2024-08-18T22:23:05.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.962+0000 7fbc3be00640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbc200678c0 0x7fbc20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:05.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.962+0000 7fbc3be00640 1 -- 172.21.15.5:0/85317988 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5249+0+0 (secure 0 0 0) 0x7fbc2c085d10 con 0x7fbc4415bfe0 2024-08-18T22:23:05.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.962+0000 7fbc43400640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbc200678c0 0x7fbc20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:05.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.962+0000 7fbc43400640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbc200678c0 0x7fbc20069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbc340af000 tx=0x7fbc340a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:05.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:05.966+0000 7fbc3be00640 1 -- 172.21.15.5:0/85317988 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbc44143a00 con 0x7fbc4415bfe0 2024-08-18T22:23:06.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-08-18T22:23:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:06.134+0000 7fbc4a600640 1 -- 172.21.15.5:0/85317988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbc44147180 con 0x7fbc4415bfe0 2024-08-18T22:23:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.358+0000 7fbc3be00640 1 -- 172.21.15.5:0/85317988 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) ==== 138+0+0 (secure 0 0 0) 0x7fbc2c056320 con 0x7fbc4415bfe0 2024-08-18T22:23:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:23:07.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.362+0000 7fbc4a600640 1 -- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbc200678c0 msgr2=0x7fbc20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:07.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.362+0000 7fbc4a600640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbc200678c0 0x7fbc20069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbc340af000 tx=0x7fbc340a7070 comp rx=0 tx=0).stop 2024-08-18T22:23:07.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.362+0000 7fbc4a600640 1 -- 172.21.15.5:0/85317988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4415bfe0 msgr2=0x7fbc441434c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:07.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.362+0000 7fbc4a600640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4415bfe0 0x7fbc441434c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00e840 tx=0x7fbc2c00ec40 comp rx=0 tx=0).stop 2024-08-18T22:23:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.362+0000 7fbc4a600640 1 -- 172.21.15.5:0/85317988 shutdown_connections 2024-08-18T22:23:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.362+0000 7fbc4a600640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbc200678c0 0x7fbc20069d80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.362+0000 7fbc4a600640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc4415fb90 0x7fbc441502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.362+0000 7fbc4a600640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4415bfe0 0x7fbc441434c0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.362+0000 7fbc4a600640 1 --2- 172.21.15.5:0/85317988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc440b5ae0 0x7fbc4415db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:07.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.362+0000 7fbc4a600640 1 -- 172.21.15.5:0/85317988 >> 172.21.15.5:0/85317988 conn(0x7fbc440b3d60 msgr2=0x7fbc44151520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:07.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.366+0000 7fbc4a600640 1 -- 172.21.15.5:0/85317988 shutdown_connections 2024-08-18T22:23:07.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.366+0000 7fbc4a600640 1 -- 172.21.15.5:0/85317988 wait complete. 2024-08-18T22:23:07.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:23:07.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f5e800640 1 Processor -- start 2024-08-18T22:23:07.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f5e800640 1 -- start start 2024-08-18T22:23:07.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f5e800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2f58144050 0x7f2f5806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:07.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f5e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f5806f3b0 0x7f2f58144430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:07.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f5e800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5806ddd0 con 0x7f2f58147860 2024-08-18T22:23:07.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f5e800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5806db80 con 0x7f2f5806f3b0 2024-08-18T22:23:07.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f5e800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5806e9e0 con 0x7f2f58144050 2024-08-18T22:23:07.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f56a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f5806f3b0 0x7f2f58144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f56a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f5806f3b0 0x7f2f58144430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43662/0 (socket says 172.21.15.5:43662) 2024-08-18T22:23:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f56a00640 1 -- 172.21.15.5:0/2283179944 learned_addr learned my addr 172.21.15.5:0/2283179944 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f57400640 1 --2- 172.21.15.5:0/2283179944 >> v2:172.21.15.117:3300/0 conn(0x7f2f58144050 0x7f2f5806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f56a00640 1 -- 172.21.15.5:0/2283179944 >> v2:172.21.15.117:3300/0 conn(0x7f2f58144050 msgr2=0x7f2f5806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f56a00640 1 --2- 172.21.15.5:0/2283179944 >> v2:172.21.15.117:3300/0 conn(0x7f2f58144050 0x7f2f5806ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:07.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f56a00640 1 -- 172.21.15.5:0/2283179944 >> v1:172.21.15.117:6789/0 conn(0x7f2f58147860 legacy=0x7f2f580b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:07.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.546+0000 7f2f56a00640 1 -- 172.21.15.5:0/2283179944 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5806e0b0 con 0x7f2f5806f3b0 2024-08-18T22:23:07.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f56a00640 1 --2- 172.21.15.5:0/2283179944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f5806f3b0 0x7f2f58144430 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2f58070ba0 tx=0x7f2f4401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4183c29f5caee8c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:07.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f56000640 1 -- 172.21.15.5:0/2283179944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f440ab620 con 0x7f2f5806f3b0 2024-08-18T22:23:07.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f56000640 1 -- 172.21.15.5:0/2283179944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f440b0070 con 0x7f2f5806f3b0 2024-08-18T22:23:07.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f56000640 1 -- 172.21.15.5:0/2283179944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f440ab9e0 con 0x7f2f5806f3b0 2024-08-18T22:23:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f5e800640 1 -- 172.21.15.5:0/2283179944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f5806f3b0 msgr2=0x7f2f58144430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f5e800640 1 --2- 172.21.15.5:0/2283179944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f5806f3b0 0x7f2f58144430 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2f58070ba0 tx=0x7f2f4401c420 comp rx=0 tx=0).stop 2024-08-18T22:23:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f5e800640 1 -- 172.21.15.5:0/2283179944 shutdown_connections 2024-08-18T22:23:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f5e800640 1 --2- 172.21.15.5:0/2283179944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f5806f3b0 0x7f2f58144430 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f5e800640 1 --2- 172.21.15.5:0/2283179944 >> v2:172.21.15.117:3300/0 conn(0x7f2f58144050 0x7f2f5806ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f5e800640 1 -- 172.21.15.5:0/2283179944 >> 172.21.15.5:0/2283179944 conn(0x7f2f580b1dc0 msgr2=0x7f2f580b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f5e800640 1 -- 172.21.15.5:0/2283179944 shutdown_connections 2024-08-18T22:23:07.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.550+0000 7f2f5e800640 1 -- 172.21.15.5:0/2283179944 wait complete. 2024-08-18T22:23:07.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f5e800640 1 Processor -- start 2024-08-18T22:23:07.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f5e800640 1 -- start start 2024-08-18T22:23:07.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f5e800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f5806f3b0 0x7f2f58146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:07.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f5e800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f58144050 0x7f2f5809d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f5e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f58147860 0x7f2f5815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f5e800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2f580b3950 con 0x7f2f58147860 2024-08-18T22:23:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f5e800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2f580b37d0 con 0x7f2f58144050 2024-08-18T22:23:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f5e800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2f58144970 con 0x7f2f5806f3b0 2024-08-18T22:23:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f57e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f58147860 0x7f2f5815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f57e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f58147860 0x7f2f5815ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43666/0 (socket says 172.21.15.5:43666) 2024-08-18T22:23:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f56a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f58144050 0x7f2f5809d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f57e00640 1 -- 172.21.15.5:0/1512144768 learned_addr learned my addr 172.21.15.5:0/1512144768 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:07.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f57400640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f5806f3b0 0x7f2f58146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f57e00640 1 -- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f5806f3b0 msgr2=0x7f2f58146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f57e00640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f5806f3b0 0x7f2f58146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f57e00640 1 -- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f58144050 msgr2=0x7f2f5809d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f57e00640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f58144050 0x7f2f5809d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f57e00640 1 -- 172.21.15.5:0/1512144768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5809cae0 con 0x7f2f58147860 2024-08-18T22:23:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f57e00640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f58147860 0x7f2f5815ea90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c3c0 tx=0x7f2f5000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f4f400640 1 -- 172.21.15.5:0/1512144768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50011790 con 0x7f2f58147860 2024-08-18T22:23:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f4f400640 1 -- 172.21.15.5:0/1512144768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f50017070 con 0x7f2f58147860 2024-08-18T22:23:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f4f400640 1 -- 172.21.15.5:0/1512144768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50011b70 con 0x7f2f58147860 2024-08-18T22:23:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f5e800640 1 -- 172.21.15.5:0/1512144768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5809cdc0 con 0x7f2f58147860 2024-08-18T22:23:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f5e800640 1 -- 172.21.15.5:0/1512144768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5809c700 con 0x7f2f58147860 2024-08-18T22:23:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.554+0000 7f2f5e800640 1 -- 172.21.15.5:0/1512144768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f58144430 con 0x7f2f58147860 2024-08-18T22:23:07.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.558+0000 7f2f4f400640 1 -- 172.21.15.5:0/1512144768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f50011d10 con 0x7f2f58147860 2024-08-18T22:23:07.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.558+0000 7f2f4f400640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f380678c0 0x7f2f38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:07.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.558+0000 7f2f4f400640 1 -- 172.21.15.5:0/1512144768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5619+0+0 (secure 0 0 0) 0x7f2f50086440 con 0x7f2f58147860 2024-08-18T22:23:07.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.558+0000 7f2f57400640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f380678c0 0x7f2f38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:07.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.558+0000 7f2f57400640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f380678c0 0x7f2f38069d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2f48003b90 tx=0x7f2f480098d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:07.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.562+0000 7f2f4f400640 1 -- 172.21.15.5:0/1512144768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2f50056960 con 0x7f2f58147860 2024-08-18T22:23:07.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:07.726+0000 7f2f5e800640 1 -- 172.21.15.5:0/1512144768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2f5806f7c0 con 0x7f2f58147860 2024-08-18T22:23:08.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.366+0000 7f2f4f400640 1 -- 172.21.15.5:0/1512144768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) ==== 170+0+0 (secure 0 0 0) 0x7f2f5005ac60 con 0x7f2f58147860 2024-08-18T22:23:08.370 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:23:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.366+0000 7f2f5e800640 1 -- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f380678c0 msgr2=0x7f2f38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.370+0000 7f2f5e800640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f380678c0 0x7f2f38069d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2f48003b90 tx=0x7f2f480098d0 comp rx=0 tx=0).stop 2024-08-18T22:23:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.370+0000 7f2f5e800640 1 -- 172.21.15.5:0/1512144768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f58147860 msgr2=0x7f2f5815ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.370+0000 7f2f5e800640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f58147860 0x7f2f5815ea90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c3c0 tx=0x7f2f5000c880 comp rx=0 tx=0).stop 2024-08-18T22:23:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.370+0000 7f2f5e800640 1 -- 172.21.15.5:0/1512144768 shutdown_connections 2024-08-18T22:23:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.370+0000 7f2f5e800640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f380678c0 0x7f2f38069d80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.370+0000 7f2f5e800640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f58147860 0x7f2f5815ea90 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.370+0000 7f2f5e800640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f58144050 0x7f2f5809d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.370+0000 7f2f5e800640 1 --2- 172.21.15.5:0/1512144768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f5806f3b0 0x7f2f58146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.370+0000 7f2f5e800640 1 -- 172.21.15.5:0/1512144768 >> 172.21.15.5:0/1512144768 conn(0x7f2f580b1dc0 msgr2=0x7f2f58071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.370+0000 7f2f5e800640 1 -- 172.21.15.5:0/1512144768 shutdown_connections 2024-08-18T22:23:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.370+0000 7f2f5e800640 1 -- 172.21.15.5:0/1512144768 wait complete. 2024-08-18T22:23:08.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:23:08.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.558+0000 7f5ed9800640 1 Processor -- start 2024-08-18T22:23:08.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.558+0000 7f5ed9800640 1 -- start start 2024-08-18T22:23:08.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.558+0000 7f5ed9800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ed40b40c0 0x7f5ed40b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:08.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.558+0000 7f5ed9800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ed40b31f0 con 0x7f5ed40ce280 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.558+0000 7f5ed9800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ed40b34d0 con 0x7f5ed415b0c0 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.558+0000 7f5ed9800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5ed40b4a70 con 0x7f5ed40b40c0 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.558+0000 7f5ed3400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5ed40ce280 0x7f5ed40ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35496/0 (socket says 172.21.15.5:35496) 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.558+0000 7f5ed3400640 1 -- 172.21.15.5:0/3609162883 learned_addr learned my addr 172.21.15.5:0/3609162883 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed2000640 1 --2- 172.21.15.5:0/3609162883 >> v2:172.21.15.117:3300/0 conn(0x7f5ed40b40c0 0x7f5ed40b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed1600640 1 -- 172.21.15.5:0/3609162883 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750749737 0 0) 0x7f5ed40b31f0 con 0x7f5ed40ce280 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed1600640 1 -- 172.21.15.5:0/3609162883 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eb8005740 con 0x7f5ed40ce280 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed1600640 1 -- 172.21.15.5:0/3609162883 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3068274508 0 0) 0x7f5ed40b34d0 con 0x7f5ed415b0c0 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed1600640 1 -- 172.21.15.5:0/3609162883 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ed40b31f0 con 0x7f5ed415b0c0 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed1600640 1 -- 172.21.15.5:0/3609162883 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1930477937 0 0) 0x7f5eb8005740 con 0x7f5ed40ce280 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed2000640 1 -- 172.21.15.5:0/3609162883 >> v1:172.21.15.117:6789/0 conn(0x7f5ed415b0c0 legacy=0x7f5ed406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed2000640 1 -- 172.21.15.5:0/3609162883 >> v1:172.21.15.5:6789/0 conn(0x7f5ed40ce280 legacy=0x7f5ed40ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:08.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed2000640 1 -- 172.21.15.5:0/3609162883 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed40b37b0 con 0x7f5ed40b40c0 2024-08-18T22:23:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed2000640 1 --2- 172.21.15.5:0/3609162883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40b40c0 0x7f5ed40b4530 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00097c0 tx=0x7f5ec001c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79803dc5beaff21c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed1600640 1 -- 172.21.15.5:0/3609162883 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00b0070 con 0x7f5ed40b40c0 2024-08-18T22:23:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed1600640 1 -- 172.21.15.5:0/3609162883 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec00ab400 con 0x7f5ed40b40c0 2024-08-18T22:23:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.562+0000 7f5ed1600640 1 -- 172.21.15.5:0/3609162883 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc001a00 con 0x7f5ed40b40c0 2024-08-18T22:23:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 -- 172.21.15.5:0/3609162883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40b40c0 msgr2=0x7f5ed40b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 --2- 172.21.15.5:0/3609162883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40b40c0 0x7f5ed40b4530 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00097c0 tx=0x7f5ec001c2a0 comp rx=0 tx=0).stop 2024-08-18T22:23:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 -- 172.21.15.5:0/3609162883 shutdown_connections 2024-08-18T22:23:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 --2- 172.21.15.5:0/3609162883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40b40c0 0x7f5ed40b4530 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 -- 172.21.15.5:0/3609162883 >> 172.21.15.5:0/3609162883 conn(0x7f5ed40b1dc0 msgr2=0x7f5ed40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 -- 172.21.15.5:0/3609162883 shutdown_connections 2024-08-18T22:23:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 -- 172.21.15.5:0/3609162883 wait complete. 2024-08-18T22:23:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 Processor -- start 2024-08-18T22:23:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 -- start start 2024-08-18T22:23:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40b40c0 0x7f5ed414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40ce280 0x7f5ed40c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed415b0c0 0x7f5ed40ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed406e410 con 0x7f5ed415b0c0 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed406f880 con 0x7f5ed40ce280 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed9800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed406e590 con 0x7f5ed40b40c0 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed415b0c0 0x7f5ed40ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed415b0c0 0x7f5ed40ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43672/0 (socket says 172.21.15.5:43672) 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed3400640 1 -- 172.21.15.5:0/2758039513 learned_addr learned my addr 172.21.15.5:0/2758039513 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed2000640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40ce280 0x7f5ed40c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed2a00640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40b40c0 0x7f5ed414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed3400640 1 -- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40b40c0 msgr2=0x7f5ed414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed3400640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40b40c0 0x7f5ed414b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed3400640 1 -- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40ce280 msgr2=0x7f5ed40c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:08.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed3400640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40ce280 0x7f5ed40c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:08.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed3400640 1 -- 172.21.15.5:0/2758039513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed41529b0 con 0x7f5ed415b0c0 2024-08-18T22:23:08.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.566+0000 7f5ed2a00640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40b40c0 0x7f5ed414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:08.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.570+0000 7f5ed3400640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed415b0c0 0x7f5ed40ca350 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc001fc0 tx=0x7f5ecc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:08.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.570+0000 7f5ecaa00640 1 -- 172.21.15.5:0/2758039513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc017070 con 0x7f5ed415b0c0 2024-08-18T22:23:08.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.570+0000 7f5ecaa00640 1 -- 172.21.15.5:0/2758039513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ecc012400 con 0x7f5ed415b0c0 2024-08-18T22:23:08.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.570+0000 7f5ed9800640 1 -- 172.21.15.5:0/2758039513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed4151da0 con 0x7f5ed415b0c0 2024-08-18T22:23:08.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.570+0000 7f5ecaa00640 1 -- 172.21.15.5:0/2758039513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc012830 con 0x7f5ed415b0c0 2024-08-18T22:23:08.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.570+0000 7f5ed9800640 1 -- 172.21.15.5:0/2758039513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed4152360 con 0x7f5ed415b0c0 2024-08-18T22:23:08.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.570+0000 7f5ed9800640 1 -- 172.21.15.5:0/2758039513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed40b4530 con 0x7f5ed415b0c0 2024-08-18T22:23:08.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.570+0000 7f5ecaa00640 1 -- 172.21.15.5:0/2758039513 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ecc01a070 con 0x7f5ed415b0c0 2024-08-18T22:23:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.570+0000 7f5ecaa00640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5eb40678c0 0x7f5eb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:08.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.570+0000 7f5ecaa00640 1 -- 172.21.15.5:0/2758039513 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6001+0+0 (secure 0 0 0) 0x7f5ecc085ea0 con 0x7f5ed415b0c0 2024-08-18T22:23:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.570+0000 7f5ed2a00640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5eb40678c0 0x7f5eb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.574+0000 7f5ed2a00640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5eb40678c0 0x7f5eb4069d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40011f0 tx=0x7f5ec4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:08.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.578+0000 7f5ecaa00640 1 -- 172.21.15.5:0/2758039513 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5ecc056810 con 0x7f5ed415b0c0 2024-08-18T22:23:08.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:08.778+0000 7f5ed9800640 1 -- 172.21.15.5:0/2758039513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5ed40b1660 con 0x7f5ed415b0c0 2024-08-18T22:23:09.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.366+0000 7f5ecaa00640 1 -- 172.21.15.5:0/2758039513 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v36) ==== 173+0+0 (secure 0 0 0) 0x7f5ecc056110 con 0x7f5ed415b0c0 2024-08-18T22:23:09.372 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 9 and data pool 10 2024-08-18T22:23:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.370+0000 7f5ed9800640 1 -- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5eb40678c0 msgr2=0x7f5eb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.370+0000 7f5ed9800640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5eb40678c0 0x7f5eb4069d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40011f0 tx=0x7f5ec4009040 comp rx=0 tx=0).stop 2024-08-18T22:23:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.370+0000 7f5ed9800640 1 -- 172.21.15.5:0/2758039513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed415b0c0 msgr2=0x7f5ed40ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.370+0000 7f5ed9800640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed415b0c0 0x7f5ed40ca350 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc001fc0 tx=0x7f5ecc00a430 comp rx=0 tx=0).stop 2024-08-18T22:23:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.370+0000 7f5ed9800640 1 -- 172.21.15.5:0/2758039513 shutdown_connections 2024-08-18T22:23:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.370+0000 7f5ed9800640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5eb40678c0 0x7f5eb4069d80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.370+0000 7f5ed9800640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed415b0c0 0x7f5ed40ca350 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.374+0000 7f5ed9800640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40ce280 0x7f5ed40c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.374+0000 7f5ed9800640 1 --2- 172.21.15.5:0/2758039513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40b40c0 0x7f5ed414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.374+0000 7f5ed9800640 1 -- 172.21.15.5:0/2758039513 >> 172.21.15.5:0/2758039513 conn(0x7f5ed40b1dc0 msgr2=0x7f5ed40b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:09.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.374+0000 7f5ed9800640 1 -- 172.21.15.5:0/2758039513 shutdown_connections 2024-08-18T22:23:09.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.374+0000 7f5ed9800640 1 -- 172.21.15.5:0/2758039513 wait complete. 2024-08-18T22:23:09.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:23:09.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effd5400640 1 Processor -- start 2024-08-18T22:23:09.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effd5400640 1 -- start start 2024-08-18T22:23:09.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effd5400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effd006e180 0x7effd00735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:09.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effd5400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd0073c80 con 0x7effd00cb390 2024-08-18T22:23:09.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effd5400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd00ca5d0 con 0x7effd015bed0 2024-08-18T22:23:09.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effd5400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7effd00ca8b0 con 0x7effd006e180 2024-08-18T22:23:09.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effcf200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effd006e180 0x7effd00735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:09.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effc5e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7effd00cb390 0x7effd006da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35510/0 (socket says 172.21.15.5:35510) 2024-08-18T22:23:09.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effc5e00640 1 -- 172.21.15.5:0/2269052200 learned_addr learned my addr 172.21.15.5:0/2269052200 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:09.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effcf200640 1 -- 172.21.15.5:0/2269052200 >> v1:172.21.15.117:6789/0 conn(0x7effd015bed0 legacy=0x7effd0071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:09.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effcf200640 1 -- 172.21.15.5:0/2269052200 >> v1:172.21.15.5:6789/0 conn(0x7effd00cb390 legacy=0x7effd006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.562+0000 7effcf200640 1 -- 172.21.15.5:0/2269052200 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd00cab90 con 0x7effd006e180 2024-08-18T22:23:09.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.566+0000 7effcf200640 1 --2- 172.21.15.5:0/2269052200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effd006e180 0x7effd00735a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7effc8009d90 tx=0x7effc801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09df4f8c206ab46 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:09.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.566+0000 7effcde00640 1 -- 172.21.15.5:0/2269052200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc80b2070 con 0x7effd006e180 2024-08-18T22:23:09.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.566+0000 7effcde00640 1 -- 172.21.15.5:0/2269052200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc80a59e0 con 0x7effd006e180 2024-08-18T22:23:09.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.566+0000 7effcde00640 1 -- 172.21.15.5:0/2269052200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc80a5db0 con 0x7effd006e180 2024-08-18T22:23:09.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.566+0000 7effd5400640 1 -- 172.21.15.5:0/2269052200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effd006e180 msgr2=0x7effd00735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.566+0000 7effd5400640 1 --2- 172.21.15.5:0/2269052200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effd006e180 0x7effd00735a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7effc8009d90 tx=0x7effc801c900 comp rx=0 tx=0).stop 2024-08-18T22:23:09.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.566+0000 7effd5400640 1 -- 172.21.15.5:0/2269052200 shutdown_connections 2024-08-18T22:23:09.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.566+0000 7effd5400640 1 --2- 172.21.15.5:0/2269052200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effd006e180 0x7effd00735a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.566+0000 7effd5400640 1 -- 172.21.15.5:0/2269052200 >> 172.21.15.5:0/2269052200 conn(0x7effd00b1c50 msgr2=0x7effd00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:09.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.566+0000 7effd5400640 1 -- 172.21.15.5:0/2269052200 shutdown_connections 2024-08-18T22:23:09.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.566+0000 7effd5400640 1 -- 172.21.15.5:0/2269052200 wait complete. 2024-08-18T22:23:09.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effd5400640 1 Processor -- start 2024-08-18T22:23:09.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effd5400640 1 -- start start 2024-08-18T22:23:09.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effd5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effd006e180 0x7effd0146a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:09.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effd5400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effd00cb390 0x7effd00b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:09.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effd5400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effd015bed0 0x7effd00b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:09.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effd5400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7effd0169b50 con 0x7effd006e180 2024-08-18T22:23:09.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effd5400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7effd01699d0 con 0x7effd00cb390 2024-08-18T22:23:09.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effd5400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7effd0169cd0 con 0x7effd015bed0 2024-08-18T22:23:09.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effce800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effd006e180 0x7effd0146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:09.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effce800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effd006e180 0x7effd0146a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43690/0 (socket says 172.21.15.5:43690) 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effce800640 1 -- 172.21.15.5:0/2940145031 learned_addr learned my addr 172.21.15.5:0/2940145031 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effcf200640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effd015bed0 0x7effd00b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effc5e00640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effd00cb390 0x7effd00b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effce800640 1 -- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effd015bed0 msgr2=0x7effd00b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effce800640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effd015bed0 0x7effd00b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effce800640 1 -- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effd00cb390 msgr2=0x7effd00b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effce800640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effd00cb390 0x7effd00b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effce800640 1 -- 172.21.15.5:0/2940145031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd0146fc0 con 0x7effd006e180 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effce800640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effd006e180 0x7effd0146a80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7effc000b410 tx=0x7effc000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effc7400640 1 -- 172.21.15.5:0/2940145031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0015030 con 0x7effd006e180 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effc7400640 1 -- 172.21.15.5:0/2940145031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc0004020 con 0x7effd006e180 2024-08-18T22:23:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effc7400640 1 -- 172.21.15.5:0/2940145031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0004410 con 0x7effd006e180 2024-08-18T22:23:09.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effd5400640 1 -- 172.21.15.5:0/2940145031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd00b3490 con 0x7effd006e180 2024-08-18T22:23:09.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effd5400640 1 -- 172.21.15.5:0/2940145031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd015ac50 con 0x7effd006e180 2024-08-18T22:23:09.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.570+0000 7effd5400640 1 -- 172.21.15.5:0/2940145031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd00735a0 con 0x7effd006e180 2024-08-18T22:23:09.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.574+0000 7effc7400640 1 -- 172.21.15.5:0/2940145031 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7effc0018070 con 0x7effd006e180 2024-08-18T22:23:09.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.574+0000 7effc7400640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effac0678f0 0x7effac069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:09.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.574+0000 7effc7400640 1 -- 172.21.15.5:0/2940145031 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7effc00860f0 con 0x7effd006e180 2024-08-18T22:23:09.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.574+0000 7effc5e00640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effac0678f0 0x7effac069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:09.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.574+0000 7effc5e00640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effac0678f0 0x7effac069db0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7effd00b5b80 tx=0x7effb8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:09.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.578+0000 7effc7400640 1 -- 172.21.15.5:0/2940145031 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7effc0056b10 con 0x7effd006e180 2024-08-18T22:23:09.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.746+0000 7effd5400640 1 -- 172.21.15.5:0/2940145031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7effd00cd5d0 con 0x7effd006e180 2024-08-18T22:23:09.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.746+0000 7effc7400640 1 -- 172.21.15.5:0/2940145031 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+16825 (secure 0 0 0) 0x7effc0056410 con 0x7effd006e180 2024-08-18T22:23:09.752 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:09.752 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":66,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:23:08.785663+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:23:06.185079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-08-18T22:23:07.780380+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:23:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 -- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effac0678f0 msgr2=0x7effac069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effac0678f0 0x7effac069db0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7effd00b5b80 tx=0x7effb8009040 comp rx=0 tx=0).stop 2024-08-18T22:23:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 -- 172.21.15.5:0/2940145031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effd006e180 msgr2=0x7effd0146a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effd006e180 0x7effd0146a80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7effc000b410 tx=0x7effc000b8d0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 -- 172.21.15.5:0/2940145031 shutdown_connections 2024-08-18T22:23:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effac0678f0 0x7effac069db0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effd015bed0 0x7effd00b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effd00cb390 0x7effd00b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 --2- 172.21.15.5:0/2940145031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effd006e180 0x7effd0146a80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 -- 172.21.15.5:0/2940145031 >> 172.21.15.5:0/2940145031 conn(0x7effd00b1c50 msgr2=0x7effd00cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 -- 172.21.15.5:0/2940145031 shutdown_connections 2024-08-18T22:23:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.750+0000 7effd5400640 1 -- 172.21.15.5:0/2940145031 wait complete. 2024-08-18T22:23:09.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:23:09.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.910+0000 7f2187000640 1 Processor -- start 2024-08-18T22:23:09.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.910+0000 7f2187000640 1 -- start start 2024-08-18T22:23:09.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.914+0000 7f2187000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2180070730 0x7f2180070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:09.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.914+0000 7f2187000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2180070430 con 0x7f218015dda0 2024-08-18T22:23:09.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.914+0000 7f2187000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f218015eb60 con 0x7f2180161960 2024-08-18T22:23:09.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.914+0000 7f2187000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f21800710e0 con 0x7f2180070730 2024-08-18T22:23:09.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.914+0000 7f2185000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f218015dda0 0x7f218015e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35520/0 (socket says 172.21.15.5:35520) 2024-08-18T22:23:09.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.914+0000 7f2185000640 1 -- 172.21.15.5:0/1639701111 learned_addr learned my addr 172.21.15.5:0/1639701111 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:09.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.914+0000 7f217f400640 1 --2- 172.21.15.5:0/1639701111 >> v2:172.21.15.5:3300/0 conn(0x7f2180070730 0x7f2180070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:09.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.914+0000 7f217f400640 1 -- 172.21.15.5:0/1639701111 >> v1:172.21.15.117:6789/0 conn(0x7f2180161960 legacy=0x7f218006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.914+0000 7f217f400640 1 -- 172.21.15.5:0/1639701111 >> v1:172.21.15.5:6789/0 conn(0x7f218015dda0 legacy=0x7f218015e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.914+0000 7f217f400640 1 -- 172.21.15.5:0/1639701111 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218015ee40 con 0x7f2180070730 2024-08-18T22:23:09.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f217f400640 1 --2- 172.21.15.5:0/1639701111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2180070730 0x7f2180070ba0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f216c0097c0 tx=0x7f216c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa31fef247ec43b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f217ea00640 1 -- 172.21.15.5:0/1639701111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0b0070 con 0x7f2180070730 2024-08-18T22:23:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f217ea00640 1 -- 172.21.15.5:0/1639701111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f216c0ab600 con 0x7f2180070730 2024-08-18T22:23:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f217ea00640 1 -- 172.21.15.5:0/1639701111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0ab9d0 con 0x7f2180070730 2024-08-18T22:23:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f2187000640 1 -- 172.21.15.5:0/1639701111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2180070730 msgr2=0x7f2180070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f2187000640 1 --2- 172.21.15.5:0/1639701111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2180070730 0x7f2180070ba0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f216c0097c0 tx=0x7f216c01c4a0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f2187000640 1 -- 172.21.15.5:0/1639701111 shutdown_connections 2024-08-18T22:23:09.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f2187000640 1 --2- 172.21.15.5:0/1639701111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2180070730 0x7f2180070ba0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f2187000640 1 -- 172.21.15.5:0/1639701111 >> 172.21.15.5:0/1639701111 conn(0x7f21800d2130 msgr2=0x7f21800d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:09.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f2187000640 1 -- 172.21.15.5:0/1639701111 shutdown_connections 2024-08-18T22:23:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f2187000640 1 -- 172.21.15.5:0/1639701111 wait complete. 2024-08-18T22:23:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f2187000640 1 Processor -- start 2024-08-18T22:23:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.918+0000 7f2187000640 1 -- start start 2024-08-18T22:23:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2187000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2180070730 0x7f21800b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2187000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f218015dda0 0x7f21801495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2187000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2180161960 0x7f21800ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2187000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f218009ba30 con 0x7f2180161960 2024-08-18T22:23:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2187000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f218015e940 con 0x7f218015dda0 2024-08-18T22:23:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2187000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2180149ae0 con 0x7f2180070730 2024-08-18T22:23:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2185000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2180161960 0x7f21800ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2185000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2180161960 0x7f21800ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43700/0 (socket says 172.21.15.5:43700) 2024-08-18T22:23:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2185000640 1 -- 172.21.15.5:0/2081019883 learned_addr learned my addr 172.21.15.5:0/2081019883 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f217f400640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f218015dda0 0x7f21801495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2185000640 1 -- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2180070730 msgr2=0x7f21800b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2185000640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2180070730 0x7f21800b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2185000640 1 -- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f218015dda0 msgr2=0x7f21801495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2185000640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f218015dda0 0x7f21801495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2185000640 1 -- 172.21.15.5:0/2081019883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21800b7d80 con 0x7f2180161960 2024-08-18T22:23:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f217f400640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f218015dda0 0x7f21801495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2185000640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2180161960 0x7f21800ca880 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f217800ca80 tx=0x7f217800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2177e00640 1 -- 172.21.15.5:0/2081019883 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178017070 con 0x7f2180161960 2024-08-18T22:23:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2177e00640 1 -- 172.21.15.5:0/2081019883 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f217800ac30 con 0x7f2180161960 2024-08-18T22:23:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2187000640 1 -- 172.21.15.5:0/2081019883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21800cb630 con 0x7f2180161960 2024-08-18T22:23:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2177e00640 1 -- 172.21.15.5:0/2081019883 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178012600 con 0x7f2180161960 2024-08-18T22:23:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2187000640 1 -- 172.21.15.5:0/2081019883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21800cbbf0 con 0x7f2180161960 2024-08-18T22:23:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2187000640 1 -- 172.21.15.5:0/2081019883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2180070ba0 con 0x7f2180161960 2024-08-18T22:23:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.922+0000 7f2177e00640 1 -- 172.21.15.5:0/2081019883 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f217801a070 con 0x7f2180161960 2024-08-18T22:23:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.926+0000 7f2177e00640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21600678c0 0x7f2160069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:09.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.926+0000 7f2177e00640 1 -- 172.21.15.5:0/2081019883 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7f2178085ac0 con 0x7f2180161960 2024-08-18T22:23:09.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.926+0000 7f217fe00640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21600678c0 0x7f2160069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:09.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.926+0000 7f217fe00640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21600678c0 0x7f2160069d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2170000f70 tx=0x7f21700079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:09.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:09.930+0000 7f2177e00640 1 -- 172.21.15.5:0/2081019883 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f217800ae20 con 0x7f2180161960 2024-08-18T22:23:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.094+0000 7f2187000640 1 -- 172.21.15.5:0/2081019883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f218009bbb0 con 0x7f2180161960 2024-08-18T22:23:10.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2177e00640 1 -- 172.21.15.5:0/2081019883 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+16825 (secure 0 0 0) 0x7f2178055d80 con 0x7f2180161960 2024-08-18T22:23:10.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:10.102 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":66,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:23:08.785663+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:23:06.185079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-08-18T22:23:07.780380+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:23:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 -- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21600678c0 msgr2=0x7f2160069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21600678c0 0x7f2160069d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2170000f70 tx=0x7f21700079c0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 -- 172.21.15.5:0/2081019883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2180161960 msgr2=0x7f21800ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2180161960 0x7f21800ca880 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f217800ca80 tx=0x7f217800cf40 comp rx=0 tx=0).stop 2024-08-18T22:23:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 -- 172.21.15.5:0/2081019883 shutdown_connections 2024-08-18T22:23:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21600678c0 0x7f2160069d80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2180161960 0x7f21800ca880 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f218015dda0 0x7f21801495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 --2- 172.21.15.5:0/2081019883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2180070730 0x7f21800b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 -- 172.21.15.5:0/2081019883 >> 172.21.15.5:0/2081019883 conn(0x7f21800d2130 msgr2=0x7f218006fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 -- 172.21.15.5:0/2081019883 shutdown_connections 2024-08-18T22:23:10.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.098+0000 7f2187000640 1 -- 172.21.15.5:0/2081019883 wait complete. 2024-08-18T22:23:10.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:23:10.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.262+0000 7f5263c00640 1 Processor -- start 2024-08-18T22:23:10.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.262+0000 7f5263c00640 1 -- start start 2024-08-18T22:23:10.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.262+0000 7f5263c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c15c180 0x7f525c0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:10.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.262+0000 7f5263c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f525c15c560 0x7f525c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:10.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.262+0000 7f5263c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f525c0cfb00 con 0x7f525c15d4d0 2024-08-18T22:23:10.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.262+0000 7f5263c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f525c15d040 con 0x7f525c15c560 2024-08-18T22:23:10.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.262+0000 7f5263c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f525c15c9f0 con 0x7f525c15c180 2024-08-18T22:23:10.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.262+0000 7f5261c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f525c15d4d0 0x7f525c15fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35530/0 (socket says 172.21.15.5:35530) 2024-08-18T22:23:10.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.262+0000 7f5261c00640 1 -- 172.21.15.5:0/3677620878 learned_addr learned my addr 172.21.15.5:0/3677620878 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f5261200640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c15c180 0x7f525c0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525be00640 1 --2- 172.21.15.5:0/3677620878 >> v2:172.21.15.117:3300/0 conn(0x7f525c15c560 0x7f525c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 650141849 0 0) 0x7f525c0cfb00 con 0x7f525c15d4d0 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5240003530 con 0x7f525c15d4d0 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2194678401 0 0) 0x7f5240003530 con 0x7f525c15d4d0 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c15c180 msgr2=0x7f525c0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c15c180 0x7f525c0cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 >> v2:172.21.15.117:3300/0 conn(0x7f525c15c560 msgr2=0x7f525c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 --2- 172.21.15.5:0/3677620878 >> v2:172.21.15.117:3300/0 conn(0x7f525c15c560 0x7f525c0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c15ccd0 con 0x7f525c15d4d0 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f5254001a00 con 0x7f525c15d4d0 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 >> v1:172.21.15.5:6789/0 conn(0x7f525c15d4d0 legacy=0x7f525c15fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52400039c0 0x7f5240003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c15c180 0x7f5240004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5240004d50 0x7f52400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f525c15d040 con 0x7f5240004d50 2024-08-18T22:23:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f525c15c9f0 con 0x7f52400039c0 2024-08-18T22:23:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f524000b9d0 con 0x7f525c15c180 2024-08-18T22:23:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f5261c00640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5240004d50 0x7f52400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f5261200640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52400039c0 0x7f5240003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f525be00640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c15c180 0x7f5240004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f5261c00640 1 -- 172.21.15.5:0/3677620878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c15c180 msgr2=0x7f5240004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f5261c00640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525c15c180 0x7f5240004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f5261c00640 1 -- 172.21.15.5:0/3677620878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52400039c0 msgr2=0x7f5240003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f5261c00640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52400039c0 0x7f5240003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.266+0000 7f5261c00640 1 -- 172.21.15.5:0/3677620878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5240003530 con 0x7f5240004d50 2024-08-18T22:23:10.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5261c00640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5240004d50 0x7f52400051d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f525c0b5280 tx=0x7f525401faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b202784ab8486dd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:10.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525400a4a0 con 0x7f5240004d50 2024-08-18T22:23:10.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52540aa6f0 con 0x7f5240004d50 2024-08-18T22:23:10.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f525b400640 1 -- 172.21.15.5:0/3677620878 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52540aaae0 con 0x7f5240004d50 2024-08-18T22:23:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 -- 172.21.15.5:0/3677620878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5240004d50 msgr2=0x7f52400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 --2- 172.21.15.5:0/3677620878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5240004d50 0x7f52400051d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f525c0b5280 tx=0x7f525401faa0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5261c00640 1 -- 172.21.15.5:0/3677620878 reap_dead start 2024-08-18T22:23:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 -- 172.21.15.5:0/3677620878 shutdown_connections 2024-08-18T22:23:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 -- 172.21.15.5:0/3677620878 >> 172.21.15.5:0/3677620878 conn(0x7f525c0b1dc0 msgr2=0x7f525c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 -- 172.21.15.5:0/3677620878 shutdown_connections 2024-08-18T22:23:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 -- 172.21.15.5:0/3677620878 wait complete. 2024-08-18T22:23:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 Processor -- start 2024-08-18T22:23:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 -- start start 2024-08-18T22:23:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5240004d50 0x7f525c1453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525c158c30 0x7f525c155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f525c0ae080 0x7f525c0ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0cf690 con 0x7f525c158c30 2024-08-18T22:23:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0cf510 con 0x7f525c0ae080 2024-08-18T22:23:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.270+0000 7f5263c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f525c0cf810 con 0x7f5240004d50 2024-08-18T22:23:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f525be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525c158c30 0x7f525c155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f525be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525c158c30 0x7f525c155b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43710/0 (socket says 172.21.15.5:43710) 2024-08-18T22:23:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f525be00640 1 -- 172.21.15.5:0/735912220 learned_addr learned my addr 172.21.15.5:0/735912220 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5261200640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5240004d50 0x7f525c1453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5261c00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f525c0ae080 0x7f525c0ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f525be00640 1 -- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5240004d50 msgr2=0x7f525c1453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f525be00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5240004d50 0x7f525c1453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f525be00640 1 -- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f525c0ae080 msgr2=0x7f525c0ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f525be00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f525c0ae080 0x7f525c0ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f525be00640 1 -- 172.21.15.5:0/735912220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c152820 con 0x7f525c158c30 2024-08-18T22:23:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5261200640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5240004d50 0x7f525c1453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5261c00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f525c0ae080 0x7f525c0ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f525be00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525c158c30 0x7f525c155b50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5248011aa0 tx=0x7f5248011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5258c00640 1 -- 172.21.15.5:0/735912220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524800fb20 con 0x7f525c158c30 2024-08-18T22:23:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5258c00640 1 -- 172.21.15.5:0/735912220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524800fcc0 con 0x7f525c158c30 2024-08-18T22:23:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5263c00640 1 -- 172.21.15.5:0/735912220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c152b00 con 0x7f525c158c30 2024-08-18T22:23:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5258c00640 1 -- 172.21.15.5:0/735912220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248014680 con 0x7f525c158c30 2024-08-18T22:23:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5263c00640 1 -- 172.21.15.5:0/735912220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c156090 con 0x7f525c158c30 2024-08-18T22:23:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5263c00640 1 -- 172.21.15.5:0/735912220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c0cfa60 con 0x7f525c158c30 2024-08-18T22:23:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5258c00640 1 -- 172.21.15.5:0/735912220 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5248012040 con 0x7f525c158c30 2024-08-18T22:23:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.274+0000 7f5258c00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f523c0678c0 0x7f523c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.278+0000 7f5258c00640 1 -- 172.21.15.5:0/735912220 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6101+0+0 (secure 0 0 0) 0x7f5248086600 con 0x7f525c158c30 2024-08-18T22:23:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.278+0000 7f5261200640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f523c0678c0 0x7f523c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:10.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.278+0000 7f5261200640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f523c0678c0 0x7f523c069d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f525c0af320 tx=0x7f524c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:10.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.278+0000 7f5258c00640 1 -- 172.21.15.5:0/735912220 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5248019030 con 0x7f525c158c30 2024-08-18T22:23:10.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:10.486+0000 7f5263c00640 1 -- 172.21.15.5:0/735912220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f525c15bd00 con 0x7f525c158c30 2024-08-18T22:23:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.398+0000 7f5258c00640 1 -- 172.21.15.5:0/735912220 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) ==== 118+0+0 (secure 0 0 0) 0x7f52480568c0 con 0x7f525c158c30 2024-08-18T22:23:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 -- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f523c0678c0 msgr2=0x7f523c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f523c0678c0 0x7f523c069d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f525c0af320 tx=0x7f524c008040 comp rx=0 tx=0).stop 2024-08-18T22:23:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 -- 172.21.15.5:0/735912220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525c158c30 msgr2=0x7f525c155b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525c158c30 0x7f525c155b50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5248011aa0 tx=0x7f5248011f60 comp rx=0 tx=0).stop 2024-08-18T22:23:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 -- 172.21.15.5:0/735912220 shutdown_connections 2024-08-18T22:23:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f523c0678c0 0x7f523c069d80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f525c0ae080 0x7f525c0ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f525c158c30 0x7f525c155b50 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 --2- 172.21.15.5:0/735912220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5240004d50 0x7f525c1453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 -- 172.21.15.5:0/735912220 >> 172.21.15.5:0/735912220 conn(0x7f525c0b1dc0 msgr2=0x7f525c0cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 -- 172.21.15.5:0/735912220 shutdown_connections 2024-08-18T22:23:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.402+0000 7f5263c00640 1 -- 172.21.15.5:0/735912220 wait complete. 2024-08-18T22:23:11.431 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:23:11.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:23:11.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.574+0000 7fd5d0600640 1 Processor -- start 2024-08-18T22:23:11.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.574+0000 7fd5d0600640 1 -- start start 2024-08-18T22:23:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.574+0000 7fd5d0600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5c815b0c0 0x7fd5c806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.574+0000 7fd5d0600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5c80b31f0 con 0x7fd5c80cf290 2024-08-18T22:23:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5d0600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5c80b34d0 con 0x7fd5c80b40c0 2024-08-18T22:23:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5d0600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c80b3d70 con 0x7fd5c815b0c0 2024-08-18T22:23:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5ce600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd5c80cf290 0x7fd5c8073140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35534/0 (socket says 172.21.15.5:35534) 2024-08-18T22:23:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5ce600640 1 -- 172.21.15.5:0/3105872465 learned_addr learned my addr 172.21.15.5:0/3105872465 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5cdc00640 1 --2- 172.21.15.5:0/3105872465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5c815b0c0 0x7fd5c806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5c7e00640 1 -- 172.21.15.5:0/3105872465 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946474972 0 0) 0x7fd5c80b31f0 con 0x7fd5c80cf290 2024-08-18T22:23:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5c7e00640 1 -- 172.21.15.5:0/3105872465 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5b0003530 con 0x7fd5c80cf290 2024-08-18T22:23:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5c7e00640 1 -- 172.21.15.5:0/3105872465 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564069763 0 0) 0x7fd5c80b34d0 con 0x7fd5c80b40c0 2024-08-18T22:23:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5c7e00640 1 -- 172.21.15.5:0/3105872465 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c80b31f0 con 0x7fd5c80b40c0 2024-08-18T22:23:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5cdc00640 1 -- 172.21.15.5:0/3105872465 >> v1:172.21.15.117:6789/0 conn(0x7fd5c80b40c0 legacy=0x7fd5c8072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:11.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5cdc00640 1 -- 172.21.15.5:0/3105872465 >> v1:172.21.15.5:6789/0 conn(0x7fd5c80cf290 legacy=0x7fd5c8073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:11.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5cdc00640 1 -- 172.21.15.5:0/3105872465 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c80b37b0 con 0x7fd5c815b0c0 2024-08-18T22:23:11.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.578+0000 7fd5cdc00640 1 --2- 172.21.15.5:0/3105872465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5c815b0c0 0x7fd5c806db80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80b3ef0 tx=0x7fd5bc01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcb83847520fa9f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:11.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5c7e00640 1 -- 172.21.15.5:0/3105872465 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0b0070 con 0x7fd5c815b0c0 2024-08-18T22:23:11.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5c7e00640 1 -- 172.21.15.5:0/3105872465 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5bc0ab600 con 0x7fd5c815b0c0 2024-08-18T22:23:11.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5c7e00640 1 -- 172.21.15.5:0/3105872465 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0ab9d0 con 0x7fd5c815b0c0 2024-08-18T22:23:11.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 -- 172.21.15.5:0/3105872465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5c815b0c0 msgr2=0x7fd5c806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:11.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 --2- 172.21.15.5:0/3105872465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5c815b0c0 0x7fd5c806db80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80b3ef0 tx=0x7fd5bc01c370 comp rx=0 tx=0).stop 2024-08-18T22:23:11.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 -- 172.21.15.5:0/3105872465 shutdown_connections 2024-08-18T22:23:11.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 --2- 172.21.15.5:0/3105872465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5c815b0c0 0x7fd5c806db80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:11.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 -- 172.21.15.5:0/3105872465 >> 172.21.15.5:0/3105872465 conn(0x7fd5c80b1dc0 msgr2=0x7fd5c80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:11.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 -- 172.21.15.5:0/3105872465 shutdown_connections 2024-08-18T22:23:11.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 -- 172.21.15.5:0/3105872465 wait complete. 2024-08-18T22:23:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 Processor -- start 2024-08-18T22:23:11.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 -- start start 2024-08-18T22:23:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5c80b40c0 0x7fd5c814a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5c80cf290 0x7fd5c815e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5c815b0c0 0x7fd5c815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c815b620 con 0x7fd5c815b0c0 2024-08-18T22:23:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c815b4a0 con 0x7fd5c80cf290 2024-08-18T22:23:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5d0600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c80b48b0 con 0x7fd5c80b40c0 2024-08-18T22:23:11.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5ce600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5c815b0c0 0x7fd5c815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5ce600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5c815b0c0 0x7fd5c815ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43714/0 (socket says 172.21.15.5:43714) 2024-08-18T22:23:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.582+0000 7fd5ce600640 1 -- 172.21.15.5:0/3052424136 learned_addr learned my addr 172.21.15.5:0/3052424136 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5cdc00640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5c80b40c0 0x7fd5c814a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5cd200640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5c80cf290 0x7fd5c815e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5ce600640 1 -- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5c80b40c0 msgr2=0x7fd5c814a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5ce600640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5c80b40c0 0x7fd5c814a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5ce600640 1 -- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5c80cf290 msgr2=0x7fd5c815e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5ce600640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5c80cf290 0x7fd5c815e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5ce600640 1 -- 172.21.15.5:0/3052424136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c814af90 con 0x7fd5c815b0c0 2024-08-18T22:23:11.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5ce600640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5c815b0c0 0x7fd5c815ced0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000caf0 tx=0x7fd5c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:11.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5c5600640 1 -- 172.21.15.5:0/3052424136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0017070 con 0x7fd5c815b0c0 2024-08-18T22:23:11.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5c5600640 1 -- 172.21.15.5:0/3052424136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c000aca0 con 0x7fd5c815b0c0 2024-08-18T22:23:11.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5d0600640 1 -- 172.21.15.5:0/3052424136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c814b550 con 0x7fd5c815b0c0 2024-08-18T22:23:11.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5c5600640 1 -- 172.21.15.5:0/3052424136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0012600 con 0x7fd5c815b0c0 2024-08-18T22:23:11.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5d0600640 1 -- 172.21.15.5:0/3052424136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c815c9b0 con 0x7fd5c815b0c0 2024-08-18T22:23:11.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5d0600640 1 -- 172.21.15.5:0/3052424136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c814ad00 con 0x7fd5c815b0c0 2024-08-18T22:23:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5c5600640 1 -- 172.21.15.5:0/3052424136 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5c001a070 con 0x7fd5c815b0c0 2024-08-18T22:23:11.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.586+0000 7fd5c5600640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5a80678c0 0x7fd5a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:11.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.590+0000 7fd5c5600640 1 -- 172.21.15.5:0/3052424136 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fd5c0085b60 con 0x7fd5c815b0c0 2024-08-18T22:23:11.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.590+0000 7fd5cdc00640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5a80678c0 0x7fd5a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:11.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.590+0000 7fd5cdc00640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5a80678c0 0x7fd5a8069d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0ad000 tx=0x7fd5bc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:11.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.594+0000 7fd5c5600640 1 -- 172.21.15.5:0/3052424136 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd5c0055e20 con 0x7fd5c815b0c0 2024-08-18T22:23:11.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:11.794+0000 7fd5d0600640 1 -- 172.21.15.5:0/3052424136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd5c806f670 con 0x7fd5c815b0c0 2024-08-18T22:23:12.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.406+0000 7fd5c5600640 1 -- 172.21.15.5:0/3052424136 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7fd5c005a120 con 0x7fd5c815b0c0 2024-08-18T22:23:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.406+0000 7fd5d0600640 1 -- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5a80678c0 msgr2=0x7fd5a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.406+0000 7fd5d0600640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5a80678c0 0x7fd5a8069d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0ad000 tx=0x7fd5bc0a6000 comp rx=0 tx=0).stop 2024-08-18T22:23:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.410+0000 7fd5d0600640 1 -- 172.21.15.5:0/3052424136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5c815b0c0 msgr2=0x7fd5c815ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.410+0000 7fd5d0600640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5c815b0c0 0x7fd5c815ced0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000caf0 tx=0x7fd5c000a060 comp rx=0 tx=0).stop 2024-08-18T22:23:12.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.410+0000 7fd5d0600640 1 -- 172.21.15.5:0/3052424136 shutdown_connections 2024-08-18T22:23:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.410+0000 7fd5d0600640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5a80678c0 0x7fd5a8069d80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.410+0000 7fd5d0600640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5c815b0c0 0x7fd5c815ced0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.410+0000 7fd5d0600640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5c80cf290 0x7fd5c815e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.410+0000 7fd5d0600640 1 --2- 172.21.15.5:0/3052424136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5c80b40c0 0x7fd5c814a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.410+0000 7fd5d0600640 1 -- 172.21.15.5:0/3052424136 >> 172.21.15.5:0/3052424136 conn(0x7fd5c80b1dc0 msgr2=0x7fd5c8159da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.410+0000 7fd5d0600640 1 -- 172.21.15.5:0/3052424136 shutdown_connections 2024-08-18T22:23:12.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.410+0000 7fd5d0600640 1 -- 172.21.15.5:0/3052424136 wait complete. 2024-08-18T22:23:12.435 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:23:12.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.574+0000 7f8585600640 1 Processor -- start 2024-08-18T22:23:12.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.574+0000 7f8585600640 1 -- start start 2024-08-18T22:23:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f8585600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f858015b010 0x7f85800ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f8585600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f858006f290 0x7f8580072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f8585600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85800cee20 con 0x7f85800cd3a0 2024-08-18T22:23:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f8585600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f85800cfa30 con 0x7f858006f290 2024-08-18T22:23:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f8585600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f85800cf100 con 0x7f858015b010 2024-08-18T22:23:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f857f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f858006f290 0x7f8580072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f857e000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f85800cd3a0 0x7f858006eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35546/0 (socket says 172.21.15.5:35546) 2024-08-18T22:23:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f857e000640 1 -- 172.21.15.5:0/3086410370 learned_addr learned my addr 172.21.15.5:0/3086410370 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:12.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f857ea00640 1 --2- 172.21.15.5:0/3086410370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f858015b010 0x7f85800ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f857f400640 1 -- 172.21.15.5:0/3086410370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f858015b010 msgr2=0x7f85800ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f857f400640 1 --2- 172.21.15.5:0/3086410370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f858015b010 0x7f85800ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f857f400640 1 -- 172.21.15.5:0/3086410370 >> v1:172.21.15.5:6789/0 conn(0x7f85800cd3a0 legacy=0x7f858006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f857f400640 1 -- 172.21.15.5:0/3086410370 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85800cf3e0 con 0x7f858006f290 2024-08-18T22:23:12.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f857d600640 1 -- 172.21.15.5:0/3086410370 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831839294 0 0) 0x7f85800cee20 con 0x7f85800cd3a0 2024-08-18T22:23:12.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.578+0000 7f857f400640 1 --2- 172.21.15.5:0/3086410370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f858006f290 0x7f8580072620 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8578009d90 tx=0x7f857801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3badee18411e1d19 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f857d600640 1 -- 172.21.15.5:0/3086410370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85780b2070 con 0x7f858006f290 2024-08-18T22:23:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f857d600640 1 -- 172.21.15.5:0/3086410370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85780a5a20 con 0x7f858006f290 2024-08-18T22:23:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f857d600640 1 -- 172.21.15.5:0/3086410370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85780a5df0 con 0x7f858006f290 2024-08-18T22:23:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 -- 172.21.15.5:0/3086410370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f858006f290 msgr2=0x7f8580072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 --2- 172.21.15.5:0/3086410370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f858006f290 0x7f8580072620 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8578009d90 tx=0x7f857801c940 comp rx=0 tx=0).stop 2024-08-18T22:23:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 -- 172.21.15.5:0/3086410370 shutdown_connections 2024-08-18T22:23:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 --2- 172.21.15.5:0/3086410370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f858006f290 0x7f8580072620 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 --2- 172.21.15.5:0/3086410370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f858015b010 0x7f85800ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 -- 172.21.15.5:0/3086410370 >> 172.21.15.5:0/3086410370 conn(0x7f85800b1c50 msgr2=0x7f85800b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 -- 172.21.15.5:0/3086410370 shutdown_connections 2024-08-18T22:23:12.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 -- 172.21.15.5:0/3086410370 wait complete. 2024-08-18T22:23:12.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 Processor -- start 2024-08-18T22:23:12.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 -- start start 2024-08-18T22:23:12.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f858006f290 0x7f858015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85800cd3a0 0x7f8580157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f858015b010 0x7f85800b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f85800734f0 con 0x7f858006f290 2024-08-18T22:23:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8580073370 con 0x7f85800cd3a0 2024-08-18T22:23:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f8585600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8580073670 con 0x7f858015b010 2024-08-18T22:23:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f857ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f858006f290 0x7f858015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f857ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f858006f290 0x7f858015b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43742/0 (socket says 172.21.15.5:43742) 2024-08-18T22:23:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f857ea00640 1 -- 172.21.15.5:0/2206583326 learned_addr learned my addr 172.21.15.5:0/2206583326 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:12.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f857f400640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f858015b010 0x7f85800b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.582+0000 7f857e000640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85800cd3a0 0x7f8580157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f857ea00640 1 -- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f858015b010 msgr2=0x7f85800b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f857ea00640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f858015b010 0x7f85800b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f857ea00640 1 -- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85800cd3a0 msgr2=0x7f8580157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f857ea00640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85800cd3a0 0x7f8580157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f857ea00640 1 -- 172.21.15.5:0/2206583326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85800b2ff0 con 0x7f858006f290 2024-08-18T22:23:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f857e000640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85800cd3a0 0x7f8580157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f857ea00640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f858006f290 0x7f858015b600 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f857000d620 tx=0x7f857000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f8576a00640 1 -- 172.21.15.5:0/2206583326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857000b620 con 0x7f858006f290 2024-08-18T22:23:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f8576a00640 1 -- 172.21.15.5:0/2206583326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8570019070 con 0x7f858006f290 2024-08-18T22:23:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f8576a00640 1 -- 172.21.15.5:0/2206583326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857000b9e0 con 0x7f858006f290 2024-08-18T22:23:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f8585600640 1 -- 172.21.15.5:0/2206583326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85800b32d0 con 0x7f858006f290 2024-08-18T22:23:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f8585600640 1 -- 172.21.15.5:0/2206583326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85800b5db0 con 0x7f858006f290 2024-08-18T22:23:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f8585600640 1 -- 172.21.15.5:0/2206583326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8580072620 con 0x7f858006f290 2024-08-18T22:23:12.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.586+0000 7f8576a00640 1 -- 172.21.15.5:0/2206583326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f857000bb80 con 0x7f858006f290 2024-08-18T22:23:12.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.590+0000 7f8576a00640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85600678f0 0x7f8560069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.590+0000 7f8576a00640 1 -- 172.21.15.5:0/2206583326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f8570086220 con 0x7f858006f290 2024-08-18T22:23:12.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.590+0000 7f857e000640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85600678f0 0x7f8560069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.590+0000 7f857e000640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85600678f0 0x7f8560069db0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f856c007fd0 tx=0x7f856c007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:12.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.594+0000 7f8576a00640 1 -- 172.21.15.5:0/2206583326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8570056b30 con 0x7f858006f290 2024-08-18T22:23:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.790+0000 7f8585600640 1 -- 172.21.15.5:0/2206583326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85800ca360 con 0x7f858006f290 2024-08-18T22:23:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8576a00640 1 -- 172.21.15.5:0/2206583326 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5218 (secure 0 0 0) 0x7f8570056430 con 0x7f858006f290 2024-08-18T22:23:12.798 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:12.798 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"btime":"2024-08-18T22:23:12:405942+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1431678393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1431678393},{"type":"v1","addr":"172.21.15.117:6835","nonce":1431678393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5953,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/620847831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":620847831},{"type":"v1","addr":"172.21.15.117:6837","nonce":620847831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5959,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/124523467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":124523467},{"type":"v1","addr":"172.21.15.5:6835","nonce":124523467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:11.801854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6833/3174043628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3174043628},{"type":"v1","addr":"172.21.15.5:6833","nonce":3174043628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6276,"qdb_cluster":[6276]},"id":4}]} 2024-08-18T22:23:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 40 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 -- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85600678f0 msgr2=0x7f8560069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85600678f0 0x7f8560069db0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f856c007fd0 tx=0x7f856c007c20 comp rx=0 tx=0).stop 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 -- 172.21.15.5:0/2206583326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f858006f290 msgr2=0x7f858015b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f858006f290 0x7f858015b600 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f857000d620 tx=0x7f857000dae0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 -- 172.21.15.5:0/2206583326 shutdown_connections 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85600678f0 0x7f8560069db0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f858015b010 0x7f85800b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85800cd3a0 0x7f8580157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 --2- 172.21.15.5:0/2206583326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f858006f290 0x7f858015b600 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 -- 172.21.15.5:0/2206583326 >> 172.21.15.5:0/2206583326 conn(0x7f85800b1c50 msgr2=0x7f858006e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 -- 172.21.15.5:0/2206583326 shutdown_connections 2024-08-18T22:23:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.794+0000 7f8585600640 1 -- 172.21.15.5:0/2206583326 wait complete. 2024-08-18T22:23:12.819 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:23:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.954+0000 7f9b79e00640 1 Processor -- start 2024-08-18T22:23:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.954+0000 7f9b79e00640 1 -- start start 2024-08-18T22:23:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.954+0000 7f9b79e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b74161960 0x7f9b7406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.954+0000 7f9b79e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b74070730 0x7f9b74070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.954+0000 7f9b79e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b7415eb60 con 0x7f9b7415dda0 2024-08-18T22:23:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.954+0000 7f9b79e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9b740710e0 con 0x7f9b74161960 2024-08-18T22:23:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.954+0000 7f9b79e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9b7415e940 con 0x7f9b74070730 2024-08-18T22:23:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.954+0000 7f9b72a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b74161960 0x7f9b7406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.954+0000 7f9b72a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b74161960 0x7f9b7406fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43744/0 (socket says 172.21.15.5:43744) 2024-08-18T22:23:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.954+0000 7f9b72a00640 1 -- 172.21.15.5:0/3186210928 learned_addr learned my addr 172.21.15.5:0/3186210928 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.954+0000 7f9b72000640 1 --2- 172.21.15.5:0/3186210928 >> v2:172.21.15.117:3300/0 conn(0x7f9b74070730 0x7f9b74070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b72a00640 1 -- 172.21.15.5:0/3186210928 >> v2:172.21.15.117:3300/0 conn(0x7f9b74070730 msgr2=0x7f9b74070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:12.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b72a00640 1 --2- 172.21.15.5:0/3186210928 >> v2:172.21.15.117:3300/0 conn(0x7f9b74070730 0x7f9b74070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b72a00640 1 -- 172.21.15.5:0/3186210928 >> v1:172.21.15.117:6789/0 conn(0x7f9b7415dda0 legacy=0x7f9b7415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b72a00640 1 -- 172.21.15.5:0/3186210928 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7415ee40 con 0x7f9b74161960 2024-08-18T22:23:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b72a00640 1 --2- 172.21.15.5:0/3186210928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b74161960 0x7f9b7406fd20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9b74071d80 tx=0x7f9b6401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524c6c0de563c110 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b71600640 1 -- 172.21.15.5:0/3186210928 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640b0070 con 0x7f9b74161960 2024-08-18T22:23:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b71600640 1 -- 172.21.15.5:0/3186210928 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b640ab600 con 0x7f9b74161960 2024-08-18T22:23:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b71600640 1 -- 172.21.15.5:0/3186210928 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640ab9d0 con 0x7f9b74161960 2024-08-18T22:23:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b79e00640 1 -- 172.21.15.5:0/3186210928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b74161960 msgr2=0x7f9b7406fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b79e00640 1 --2- 172.21.15.5:0/3186210928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b74161960 0x7f9b7406fd20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9b74071d80 tx=0x7f9b6401c520 comp rx=0 tx=0).stop 2024-08-18T22:23:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b79e00640 1 -- 172.21.15.5:0/3186210928 shutdown_connections 2024-08-18T22:23:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b79e00640 1 --2- 172.21.15.5:0/3186210928 >> v2:172.21.15.117:3300/0 conn(0x7f9b74070730 0x7f9b74070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b79e00640 1 --2- 172.21.15.5:0/3186210928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b74161960 0x7f9b7406fd20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b79e00640 1 -- 172.21.15.5:0/3186210928 >> 172.21.15.5:0/3186210928 conn(0x7f9b740d2130 msgr2=0x7f9b740d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b79e00640 1 -- 172.21.15.5:0/3186210928 shutdown_connections 2024-08-18T22:23:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.958+0000 7f9b79e00640 1 -- 172.21.15.5:0/3186210928 wait complete. 2024-08-18T22:23:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b79e00640 1 Processor -- start 2024-08-18T22:23:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b79e00640 1 -- start start 2024-08-18T22:23:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b79e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b74070730 0x7f9b740b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b79e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b7415dda0 0x7f9b7415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b79e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b74161960 0x7f9b7415cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b79e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7409ba30 con 0x7f9b7415dda0 2024-08-18T22:23:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b79e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9b74070260 con 0x7f9b74161960 2024-08-18T22:23:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b79e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7415ac70 con 0x7f9b74070730 2024-08-18T22:23:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b72000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b7415dda0 0x7f9b7415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b72a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b74070730 0x7f9b740b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b72000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b7415dda0 0x7f9b7415c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43750/0 (socket says 172.21.15.5:43750) 2024-08-18T22:23:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b72000640 1 -- 172.21.15.5:0/1215389532 learned_addr learned my addr 172.21.15.5:0/1215389532 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b73400640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b74161960 0x7f9b7415cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b72000640 1 -- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b74070730 msgr2=0x7f9b740b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b72000640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b74070730 0x7f9b740b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b72000640 1 -- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b74161960 msgr2=0x7f9b7415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b72000640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b74161960 0x7f9b7415cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b72000640 1 -- 172.21.15.5:0/1215389532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b740c9e20 con 0x7f9b7415dda0 2024-08-18T22:23:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b73400640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b74161960 0x7f9b7415cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b72000640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b7415dda0 0x7f9b7415c7e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000d800 tx=0x7f9b6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b6b400640 1 -- 172.21.15.5:0/1215389532 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000b6c0 con 0x7f9b7415dda0 2024-08-18T22:23:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b6b400640 1 -- 172.21.15.5:0/1215389532 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b60019070 con 0x7f9b7415dda0 2024-08-18T22:23:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b6b400640 1 -- 172.21.15.5:0/1215389532 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000ba60 con 0x7f9b7415dda0 2024-08-18T22:23:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.962+0000 7f9b79e00640 1 -- 172.21.15.5:0/1215389532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b740ca100 con 0x7f9b7415dda0 2024-08-18T22:23:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.966+0000 7f9b79e00640 1 -- 172.21.15.5:0/1215389532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b740b7de0 con 0x7f9b7415dda0 2024-08-18T22:23:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.966+0000 7f9b79e00640 1 -- 172.21.15.5:0/1215389532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b74070ba0 con 0x7f9b7415dda0 2024-08-18T22:23:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.966+0000 7f9b6b400640 1 -- 172.21.15.5:0/1215389532 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b6000bc00 con 0x7f9b7415dda0 2024-08-18T22:23:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.966+0000 7f9b6b400640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b540678f0 0x7f9b54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.966+0000 7f9b6b400640 1 -- 172.21.15.5:0/1215389532 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f9b600862f0 con 0x7f9b7415dda0 2024-08-18T22:23:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.966+0000 7f9b72a00640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b540678f0 0x7f9b54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:12.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.970+0000 7f9b72a00640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b540678f0 0x7f9b54069db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9b640ad000 tx=0x7f9b640a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:12.970+0000 7f9b6b400640 1 -- 172.21.15.5:0/1215389532 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9b60056c00 con 0x7f9b7415dda0 2024-08-18T22:23:13.005 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-08-18T22:23:13.002+0000 7f2ca4c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:23:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.138+0000 7f9b79e00640 1 -- 172.21.15.5:0/1215389532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b7409bbb0 con 0x7f9b7415dda0 2024-08-18T22:23:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.138+0000 7f9b6b400640 1 -- 172.21.15.5:0/1215389532 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16812 (secure 0 0 0) 0x7f9b60056500 con 0x7f9b7415dda0 2024-08-18T22:23:13.144 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:13.144 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":67,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:23:10.373116+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:23:06.185079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-08-18T22:23:07.780380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:23:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 -- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b540678f0 msgr2=0x7f9b54069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b540678f0 0x7f9b54069db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9b640ad000 tx=0x7f9b640a6000 comp rx=0 tx=0).stop 2024-08-18T22:23:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 -- 172.21.15.5:0/1215389532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b7415dda0 msgr2=0x7f9b7415c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b7415dda0 0x7f9b7415c7e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000d800 tx=0x7f9b6000dcc0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 -- 172.21.15.5:0/1215389532 shutdown_connections 2024-08-18T22:23:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9b540678f0 0x7f9b54069db0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b74161960 0x7f9b7415cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b7415dda0 0x7f9b7415c7e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 --2- 172.21.15.5:0/1215389532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b74070730 0x7f9b740b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 -- 172.21.15.5:0/1215389532 >> 172.21.15.5:0/1215389532 conn(0x7f9b740d2130 msgr2=0x7f9b7406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 -- 172.21.15.5:0/1215389532 shutdown_connections 2024-08-18T22:23:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.142+0000 7f9b79e00640 1 -- 172.21.15.5:0/1215389532 wait complete. 2024-08-18T22:23:13.167 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:23:13.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:23:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.302+0000 7fd829800640 1 Processor -- start 2024-08-18T22:23:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.302+0000 7fd829800640 1 -- start start 2024-08-18T22:23:13.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd829800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd82415bed0 0x7fd8240735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:13.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd829800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd824073c80 con 0x7fd8240cb390 2024-08-18T22:23:13.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd829800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8240ca5d0 con 0x7fd82406da70 2024-08-18T22:23:13.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd829800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd8240ca8b0 con 0x7fd82415bed0 2024-08-18T22:23:13.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd822000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd8240cb390 0x7fd824071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35554/0 (socket says 172.21.15.5:35554) 2024-08-18T22:23:13.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd822000640 1 -- 172.21.15.5:0/52081303 learned_addr learned my addr 172.21.15.5:0/52081303 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:13.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd822a00640 1 --2- 172.21.15.5:0/52081303 >> v2:172.21.15.117:3300/0 conn(0x7fd82415bed0 0x7fd8240735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd821600640 1 -- 172.21.15.5:0/52081303 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2117114732 0 0) 0x7fd824073c80 con 0x7fd8240cb390 2024-08-18T22:23:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd821600640 1 -- 172.21.15.5:0/52081303 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd808003530 con 0x7fd8240cb390 2024-08-18T22:23:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd822a00640 1 -- 172.21.15.5:0/52081303 >> v1:172.21.15.117:6789/0 conn(0x7fd82406da70 legacy=0x7fd824165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd821600640 1 -- 172.21.15.5:0/52081303 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029156139 0 0) 0x7fd8240ca5d0 con 0x7fd82406da70 2024-08-18T22:23:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd822a00640 1 -- 172.21.15.5:0/52081303 >> v1:172.21.15.5:6789/0 conn(0x7fd8240cb390 legacy=0x7fd824071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.306+0000 7fd822a00640 1 -- 172.21.15.5:0/52081303 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8240cab90 con 0x7fd82415bed0 2024-08-18T22:23:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd822a00640 1 --2- 172.21.15.5:0/52081303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd82415bed0 0x7fd8240735a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd8140097c0 tx=0x7fd81401c2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5f68b05626b19fe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd821600640 1 -- 172.21.15.5:0/52081303 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8140b0070 con 0x7fd82415bed0 2024-08-18T22:23:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd821600640 1 -- 172.21.15.5:0/52081303 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8140ab400 con 0x7fd82415bed0 2024-08-18T22:23:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd821600640 1 -- 172.21.15.5:0/52081303 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810001680 con 0x7fd82415bed0 2024-08-18T22:23:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 -- 172.21.15.5:0/52081303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd82415bed0 msgr2=0x7fd8240735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 --2- 172.21.15.5:0/52081303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd82415bed0 0x7fd8240735a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd8140097c0 tx=0x7fd81401c2b0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 -- 172.21.15.5:0/52081303 shutdown_connections 2024-08-18T22:23:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 --2- 172.21.15.5:0/52081303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd82415bed0 0x7fd8240735a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 -- 172.21.15.5:0/52081303 >> 172.21.15.5:0/52081303 conn(0x7fd8240b1c50 msgr2=0x7fd8240b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 -- 172.21.15.5:0/52081303 shutdown_connections 2024-08-18T22:23:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 -- 172.21.15.5:0/52081303 wait complete. 2024-08-18T22:23:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 Processor -- start 2024-08-18T22:23:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 -- start start 2024-08-18T22:23:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd82406da70 0x7fd824154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8240cb390 0x7fd82414e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:13.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.310+0000 7fd829800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82415bed0 0x7fd8240c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd829800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd824169c40 con 0x7fd82415bed0 2024-08-18T22:23:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd829800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd824169ac0 con 0x7fd82406da70 2024-08-18T22:23:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd829800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd824169dc0 con 0x7fd8240cb390 2024-08-18T22:23:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd823400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82415bed0 0x7fd8240c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd823400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82415bed0 0x7fd8240c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43766/0 (socket says 172.21.15.5:43766) 2024-08-18T22:23:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd823400640 1 -- 172.21.15.5:0/2100339576 learned_addr learned my addr 172.21.15.5:0/2100339576 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:13.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd822a00640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd82406da70 0x7fd824154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd822000640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8240cb390 0x7fd82414e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd823400640 1 -- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8240cb390 msgr2=0x7fd82414e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd823400640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8240cb390 0x7fd82414e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd823400640 1 -- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd82406da70 msgr2=0x7fd824154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd823400640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd82406da70 0x7fd824154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd823400640 1 -- 172.21.15.5:0/2100339576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8240b2f50 con 0x7fd82415bed0 2024-08-18T22:23:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd823400640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82415bed0 0x7fd8240c92d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00c780 tx=0x7fd81c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd81aa00640 1 -- 172.21.15.5:0/2100339576 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c003db0 con 0x7fd82415bed0 2024-08-18T22:23:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd81aa00640 1 -- 172.21.15.5:0/2100339576 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd81c005070 con 0x7fd82415bed0 2024-08-18T22:23:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd829800640 1 -- 172.21.15.5:0/2100339576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8240cf780 con 0x7fd82415bed0 2024-08-18T22:23:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd81aa00640 1 -- 172.21.15.5:0/2100339576 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c005460 con 0x7fd82415bed0 2024-08-18T22:23:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd829800640 1 -- 172.21.15.5:0/2100339576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8240b3210 con 0x7fd82415bed0 2024-08-18T22:23:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd829800640 1 -- 172.21.15.5:0/2100339576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8240735a0 con 0x7fd82415bed0 2024-08-18T22:23:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.314+0000 7fd81aa00640 1 -- 172.21.15.5:0/2100339576 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd81c005600 con 0x7fd82415bed0 2024-08-18T22:23:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.318+0000 7fd81aa00640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8040678c0 0x7fd804069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.318+0000 7fd81aa00640 1 -- 172.21.15.5:0/2100339576 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fd81c085d30 con 0x7fd82415bed0 2024-08-18T22:23:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.318+0000 7fd822a00640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8040678c0 0x7fd804069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:13.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.318+0000 7fd822a00640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8040678c0 0x7fd804069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd8140ad000 tx=0x7fd8140a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:13.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.322+0000 7fd81aa00640 1 -- 172.21.15.5:0/2100339576 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd81c056650 con 0x7fd82415bed0 2024-08-18T22:23:13.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.486+0000 7fd829800640 1 -- 172.21.15.5:0/2100339576 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8240cc530 con 0x7fd8040678c0 2024-08-18T22:23:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.494+0000 7fd81aa00640 1 -- 172.21.15.5:0/2100339576 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247948 (secure 0 0 0) 0x7fd8240cc530 con 0x7fd8040678c0 2024-08-18T22:23:13.500 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:23:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 -- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8040678c0 msgr2=0x7fd804069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8040678c0 0x7fd804069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd8140ad000 tx=0x7fd8140a6000 comp rx=0 tx=0).stop 2024-08-18T22:23:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 -- 172.21.15.5:0/2100339576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82415bed0 msgr2=0x7fd8240c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82415bed0 0x7fd8240c92d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00c780 tx=0x7fd81c00cc40 comp rx=0 tx=0).stop 2024-08-18T22:23:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 -- 172.21.15.5:0/2100339576 shutdown_connections 2024-08-18T22:23:13.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8040678c0 0x7fd804069d80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82415bed0 0x7fd8240c92d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8240cb390 0x7fd82414e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 --2- 172.21.15.5:0/2100339576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd82406da70 0x7fd824154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 -- 172.21.15.5:0/2100339576 >> 172.21.15.5:0/2100339576 conn(0x7fd8240b1c50 msgr2=0x7fd8240b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 -- 172.21.15.5:0/2100339576 shutdown_connections 2024-08-18T22:23:13.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.498+0000 7fd829800640 1 -- 172.21.15.5:0/2100339576 wait complete. 2024-08-18T22:23:13.521 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-08-18T22:23:11.673964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302444,"kb_used_data":7228,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754672276,"statfs":{"total":773094113280,"available":772784410624,"internally_reserved":0,"allocated":7401472,"data_stored":3974439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.308777"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379544+0000","last_change":"2024-08-18T22:23:08.379544+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379544+0000","last_undegraded":"2024-08-18T22:23:08.379544+0000","last_fullsized":"2024-08-18T22:23:08.379544+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379610+0000","last_change":"2024-08-18T22:23:08.379610+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379610+0000","last_undegraded":"2024-08-18T22:23:08.379610+0000","last_fullsized":"2024-08-18T22:23:08.379610+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377622+0000","last_change":"2024-08-18T22:23:08.377622+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377622+0000","last_undegraded":"2024-08-18T22:23:08.377622+0000","last_fullsized":"2024-08-18T22:23:08.377622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378840+0000","last_change":"2024-08-18T22:23:09.404026+0000","last_active":"2024-08-18T22:23:10.378840+0000","last_peered":"2024-08-18T22:23:10.378840+0000","last_clean":"2024-08-18T22:23:10.378840+0000","last_became_active":"2024-08-18T22:23:09.403744+0000","last_became_peered":"2024-08-18T22:23:09.403744+0000","last_unstale":"2024-08-18T22:23:10.378840+0000","last_undegraded":"2024-08-18T22:23:10.378840+0000","last_fullsized":"2024-08-18T22:23:10.378840+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:03.641586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.388498+0000","last_change":"2024-08-18T22:23:08.388498+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.388498+0000","last_undegraded":"2024-08-18T22:23:08.388498+0000","last_fullsized":"2024-08-18T22:23:08.388498+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380971+0000","last_change":"2024-08-18T22:23:08.380971+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380971+0000","last_undegraded":"2024-08-18T22:23:08.380971+0000","last_fullsized":"2024-08-18T22:23:08.380971+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376888+0000","last_change":"2024-08-18T22:23:09.395052+0000","last_active":"2024-08-18T22:23:10.376888+0000","last_peered":"2024-08-18T22:23:10.376888+0000","last_clean":"2024-08-18T22:23:10.376888+0000","last_became_active":"2024-08-18T22:23:09.394746+0000","last_became_peered":"2024-08-18T22:23:09.394746+0000","last_unstale":"2024-08-18T22:23:10.376888+0000","last_undegraded":"2024-08-18T22:23:10.376888+0000","last_fullsized":"2024-08-18T22:23:10.376888+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:39.163319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379653+0000","last_change":"2024-08-18T22:23:08.379653+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379653+0000","last_undegraded":"2024-08-18T22:23:08.379653+0000","last_fullsized":"2024-08-18T22:23:08.379653+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375590+0000","last_change":"2024-08-18T22:23:08.375590+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375590+0000","last_undegraded":"2024-08-18T22:23:08.375590+0000","last_fullsized":"2024-08-18T22:23:08.375590+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377182+0000","last_change":"2024-08-18T22:23:08.377182+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377182+0000","last_undegraded":"2024-08-18T22:23:08.377182+0000","last_fullsized":"2024-08-18T22:23:08.377182+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378492+0000","last_change":"2024-08-18T22:23:09.391970+0000","last_active":"2024-08-18T22:23:10.378492+0000","last_peered":"2024-08-18T22:23:10.378492+0000","last_clean":"2024-08-18T22:23:10.378492+0000","last_became_active":"2024-08-18T22:23:09.391134+0000","last_became_peered":"2024-08-18T22:23:09.391134+0000","last_unstale":"2024-08-18T22:23:10.378492+0000","last_undegraded":"2024-08-18T22:23:10.378492+0000","last_fullsized":"2024-08-18T22:23:10.378492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:45.196677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380357+0000","last_change":"2024-08-18T22:23:08.380357+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380357+0000","last_undegraded":"2024-08-18T22:23:08.380357+0000","last_fullsized":"2024-08-18T22:23:08.380357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381798+0000","last_change":"2024-08-18T22:23:08.381798+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381798+0000","last_undegraded":"2024-08-18T22:23:08.381798+0000","last_fullsized":"2024-08-18T22:23:08.381798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.374132+0000","last_change":"2024-08-18T22:23:08.374132+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.374132+0000","last_undegraded":"2024-08-18T22:23:08.374132+0000","last_fullsized":"2024-08-18T22:23:08.374132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.374384+0000","last_change":"2024-08-18T22:23:08.374384+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.374384+0000","last_undegraded":"2024-08-18T22:23:08.374384+0000","last_fullsized":"2024-08-18T22:23:08.374384+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376855+0000","last_change":"2024-08-18T22:23:09.404695+0000","last_active":"2024-08-18T22:23:10.376855+0000","last_peered":"2024-08-18T22:23:10.376855+0000","last_clean":"2024-08-18T22:23:10.376855+0000","last_became_active":"2024-08-18T22:23:09.404441+0000","last_became_peered":"2024-08-18T22:23:09.404441+0000","last_unstale":"2024-08-18T22:23:10.376855+0000","last_undegraded":"2024-08-18T22:23:10.376855+0000","last_fullsized":"2024-08-18T22:23:10.376855+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:14.838422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377153+0000","last_change":"2024-08-18T22:23:08.377153+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377153+0000","last_undegraded":"2024-08-18T22:23:08.377153+0000","last_fullsized":"2024-08-18T22:23:08.377153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378673+0000","last_change":"2024-08-18T22:23:09.406570+0000","last_active":"2024-08-18T22:23:10.378673+0000","last_peered":"2024-08-18T22:23:10.378673+0000","last_clean":"2024-08-18T22:23:10.378673+0000","last_became_active":"2024-08-18T22:23:09.406243+0000","last_became_peered":"2024-08-18T22:23:09.406243+0000","last_unstale":"2024-08-18T22:23:10.378673+0000","last_undegraded":"2024-08-18T22:23:10.378673+0000","last_fullsized":"2024-08-18T22:23:10.378673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:23:09.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386571+0000","last_change":"2024-08-18T22:23:08.386571+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386571+0000","last_undegraded":"2024-08-18T22:23:08.386571+0000","last_fullsized":"2024-08-18T22:23:08.386571+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378280+0000","last_change":"2024-08-18T22:23:08.378280+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378280+0000","last_undegraded":"2024-08-18T22:23:08.378280+0000","last_fullsized":"2024-08-18T22:23:08.378280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380722+0000","last_change":"2024-08-18T22:23:08.380722+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380722+0000","last_undegraded":"2024-08-18T22:23:08.380722+0000","last_fullsized":"2024-08-18T22:23:08.380722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379817+0000","last_change":"2024-08-18T22:23:08.379817+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379817+0000","last_undegraded":"2024-08-18T22:23:08.379817+0000","last_fullsized":"2024-08-18T22:23:08.379817+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379291+0000","last_change":"2024-08-18T22:23:08.379291+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379291+0000","last_undegraded":"2024-08-18T22:23:08.379291+0000","last_fullsized":"2024-08-18T22:23:08.379291+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375422+0000","last_change":"2024-08-18T22:23:08.375422+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375422+0000","last_undegraded":"2024-08-18T22:23:08.375422+0000","last_fullsized":"2024-08-18T22:23:08.375422+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380267+0000","last_change":"2024-08-18T22:23:08.380267+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380267+0000","last_undegraded":"2024-08-18T22:23:08.380267+0000","last_fullsized":"2024-08-18T22:23:08.380267+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380461+0000","last_change":"2024-08-18T22:23:08.380461+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380461+0000","last_undegraded":"2024-08-18T22:23:08.380461+0000","last_fullsized":"2024-08-18T22:23:08.380461+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378559+0000","last_change":"2024-08-18T22:23:09.395874+0000","last_active":"2024-08-18T22:23:10.378559+0000","last_peered":"2024-08-18T22:23:10.378559+0000","last_clean":"2024-08-18T22:23:10.378559+0000","last_became_active":"2024-08-18T22:23:09.395607+0000","last_became_peered":"2024-08-18T22:23:09.395607+0000","last_unstale":"2024-08-18T22:23:10.378559+0000","last_undegraded":"2024-08-18T22:23:10.378559+0000","last_fullsized":"2024-08-18T22:23:10.378559+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:18.768258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378078+0000","last_change":"2024-08-18T22:23:08.378078+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378078+0000","last_undegraded":"2024-08-18T22:23:08.378078+0000","last_fullsized":"2024-08-18T22:23:08.378078+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375798+0000","last_change":"2024-08-18T22:23:08.375798+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375798+0000","last_undegraded":"2024-08-18T22:23:08.375798+0000","last_fullsized":"2024-08-18T22:23:08.375798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380964+0000","last_change":"2024-08-18T22:23:08.380964+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380964+0000","last_undegraded":"2024-08-18T22:23:08.380964+0000","last_fullsized":"2024-08-18T22:23:08.380964+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377611+0000","last_change":"2024-08-18T22:23:09.387587+0000","last_active":"2024-08-18T22:23:10.377611+0000","last_peered":"2024-08-18T22:23:10.377611+0000","last_clean":"2024-08-18T22:23:10.377611+0000","last_became_active":"2024-08-18T22:23:09.387364+0000","last_became_peered":"2024-08-18T22:23:09.387364+0000","last_unstale":"2024-08-18T22:23:10.377611+0000","last_undegraded":"2024-08-18T22:23:10.377611+0000","last_fullsized":"2024-08-18T22:23:10.377611+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:22.989793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.382343+0000","last_change":"2024-08-18T22:23:08.382343+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.382343+0000","last_undegraded":"2024-08-18T22:23:08.382343+0000","last_fullsized":"2024-08-18T22:23:08.382343+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385161+0000","last_change":"2024-08-18T22:23:08.385161+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385161+0000","last_undegraded":"2024-08-18T22:23:08.385161+0000","last_fullsized":"2024-08-18T22:23:08.385161+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.388533+0000","last_change":"2024-08-18T22:23:08.381923+0000","last_active":"2024-08-18T22:23:08.388533+0000","last_peered":"2024-08-18T22:23:08.388533+0000","last_clean":"2024-08-18T22:23:08.388533+0000","last_became_active":"2024-08-18T22:23:08.381398+0000","last_became_peered":"2024-08-18T22:23:08.381398+0000","last_unstale":"2024-08-18T22:23:08.388533+0000","last_undegraded":"2024-08-18T22:23:08.388533+0000","last_fullsized":"2024-08-18T22:23:08.388533+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:04:03.032855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378673+0000","last_change":"2024-08-18T22:23:09.406503+0000","last_active":"2024-08-18T22:23:10.378673+0000","last_peered":"2024-08-18T22:23:10.378673+0000","last_clean":"2024-08-18T22:23:10.378673+0000","last_became_active":"2024-08-18T22:23:09.406229+0000","last_became_peered":"2024-08-18T22:23:09.406229+0000","last_unstale":"2024-08-18T22:23:10.378673+0000","last_undegraded":"2024-08-18T22:23:10.378673+0000","last_fullsized":"2024-08-18T22:23:10.378673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:12.297162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397347+0000","last_change":"2024-08-18T22:23:08.395735+0000","last_active":"2024-08-18T22:23:08.397347+0000","last_peered":"2024-08-18T22:23:08.397347+0000","last_clean":"2024-08-18T22:23:08.397347+0000","last_became_active":"2024-08-18T22:23:08.395477+0000","last_became_peered":"2024-08-18T22:23:08.395477+0000","last_unstale":"2024-08-18T22:23:08.397347+0000","last_undegraded":"2024-08-18T22:23:08.397347+0000","last_fullsized":"2024-08-18T22:23:08.397347+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:46.358052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385633+0000","last_change":"2024-08-18T22:23:08.385633+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385633+0000","last_undegraded":"2024-08-18T22:23:08.385633+0000","last_fullsized":"2024-08-18T22:23:08.385633+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397091+0000","last_change":"2024-08-18T22:23:08.390884+0000","last_active":"2024-08-18T22:23:08.397091+0000","last_peered":"2024-08-18T22:23:08.397091+0000","last_clean":"2024-08-18T22:23:08.397091+0000","last_became_active":"2024-08-18T22:23:08.390605+0000","last_became_peered":"2024-08-18T22:23:08.390605+0000","last_unstale":"2024-08-18T22:23:08.397091+0000","last_undegraded":"2024-08-18T22:23:08.397091+0000","last_fullsized":"2024-08-18T22:23:08.397091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:30.832117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.376017+0000","last_change":"2024-08-18T22:23:08.376017+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.376017+0000","last_undegraded":"2024-08-18T22:23:08.376017+0000","last_fullsized":"2024-08-18T22:23:08.376017+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397608+0000","last_change":"2024-08-18T22:23:08.396665+0000","last_active":"2024-08-18T22:23:08.397608+0000","last_peered":"2024-08-18T22:23:08.397608+0000","last_clean":"2024-08-18T22:23:08.397608+0000","last_became_active":"2024-08-18T22:23:08.396386+0000","last_became_peered":"2024-08-18T22:23:08.396386+0000","last_unstale":"2024-08-18T22:23:08.397608+0000","last_undegraded":"2024-08-18T22:23:08.397608+0000","last_fullsized":"2024-08-18T22:23:08.397608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:28:52.107125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376874+0000","last_change":"2024-08-18T22:23:09.390577+0000","last_active":"2024-08-18T22:23:10.376874+0000","last_peered":"2024-08-18T22:23:10.376874+0000","last_clean":"2024-08-18T22:23:10.376874+0000","last_became_active":"2024-08-18T22:23:09.390330+0000","last_became_peered":"2024-08-18T22:23:09.390330+0000","last_unstale":"2024-08-18T22:23:10.376874+0000","last_undegraded":"2024-08-18T22:23:10.376874+0000","last_fullsized":"2024-08-18T22:23:10.376874+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:05.538156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398721+0000","last_change":"2024-08-18T22:23:08.395039+0000","last_active":"2024-08-18T22:23:08.398721+0000","last_peered":"2024-08-18T22:23:08.398721+0000","last_clean":"2024-08-18T22:23:08.398721+0000","last_became_active":"2024-08-18T22:23:08.390586+0000","last_became_peered":"2024-08-18T22:23:08.390586+0000","last_unstale":"2024-08-18T22:23:08.398721+0000","last_undegraded":"2024-08-18T22:23:08.398721+0000","last_fullsized":"2024-08-18T22:23:08.398721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:52.259773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377105+0000","last_change":"2024-08-18T22:23:08.377105+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377105+0000","last_undegraded":"2024-08-18T22:23:08.377105+0000","last_fullsized":"2024-08-18T22:23:08.377105+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400310+0000","last_change":"2024-08-18T22:23:08.399282+0000","last_active":"2024-08-18T22:23:08.400310+0000","last_peered":"2024-08-18T22:23:08.400310+0000","last_clean":"2024-08-18T22:23:08.400310+0000","last_became_active":"2024-08-18T22:23:08.398958+0000","last_became_peered":"2024-08-18T22:23:08.398958+0000","last_unstale":"2024-08-18T22:23:08.400310+0000","last_undegraded":"2024-08-18T22:23:08.400310+0000","last_fullsized":"2024-08-18T22:23:08.400310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:50.360086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.390818+0000","last_change":"2024-08-18T22:23:08.390818+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.390818+0000","last_undegraded":"2024-08-18T22:23:08.390818+0000","last_fullsized":"2024-08-18T22:23:08.390818+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399618+0000","last_change":"2024-08-18T22:23:08.397746+0000","last_active":"2024-08-18T22:23:08.399618+0000","last_peered":"2024-08-18T22:23:08.399618+0000","last_clean":"2024-08-18T22:23:08.399618+0000","last_became_active":"2024-08-18T22:23:08.397305+0000","last_became_peered":"2024-08-18T22:23:08.397305+0000","last_unstale":"2024-08-18T22:23:08.399618+0000","last_undegraded":"2024-08-18T22:23:08.399618+0000","last_fullsized":"2024-08-18T22:23:08.399618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:10.981993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378196+0000","last_change":"2024-08-18T22:23:08.378196+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378196+0000","last_undegraded":"2024-08-18T22:23:08.378196+0000","last_fullsized":"2024-08-18T22:23:08.378196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.395398+0000","last_change":"2024-08-18T22:23:08.393396+0000","last_active":"2024-08-18T22:23:08.395398+0000","last_peered":"2024-08-18T22:23:08.395398+0000","last_clean":"2024-08-18T22:23:08.395398+0000","last_became_active":"2024-08-18T22:23:08.393124+0000","last_became_peered":"2024-08-18T22:23:08.393124+0000","last_unstale":"2024-08-18T22:23:08.395398+0000","last_undegraded":"2024-08-18T22:23:08.395398+0000","last_fullsized":"2024-08-18T22:23:08.395398+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:45:40.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377628+0000","last_change":"2024-08-18T22:23:08.377628+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377628+0000","last_undegraded":"2024-08-18T22:23:08.377628+0000","last_fullsized":"2024-08-18T22:23:08.377628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.395706+0000","last_change":"2024-08-18T22:23:08.393152+0000","last_active":"2024-08-18T22:23:08.395706+0000","last_peered":"2024-08-18T22:23:08.395706+0000","last_clean":"2024-08-18T22:23:08.395706+0000","last_became_active":"2024-08-18T22:23:08.392860+0000","last_became_peered":"2024-08-18T22:23:08.392860+0000","last_unstale":"2024-08-18T22:23:08.395706+0000","last_undegraded":"2024-08-18T22:23:08.395706+0000","last_fullsized":"2024-08-18T22:23:08.395706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:14.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378339+0000","last_change":"2024-08-18T22:23:08.378339+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378339+0000","last_undegraded":"2024-08-18T22:23:08.378339+0000","last_fullsized":"2024-08-18T22:23:08.378339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378791+0000","last_change":"2024-08-18T22:23:08.390558+0000","last_active":"2024-08-18T22:23:10.378791+0000","last_peered":"2024-08-18T22:23:10.378791+0000","last_clean":"2024-08-18T22:23:10.378791+0000","last_became_active":"2024-08-18T22:23:08.389931+0000","last_became_peered":"2024-08-18T22:23:08.389931+0000","last_unstale":"2024-08-18T22:23:10.378791+0000","last_undegraded":"2024-08-18T22:23:10.378791+0000","last_fullsized":"2024-08-18T22:23:10.378791+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:42.339748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386741+0000","last_change":"2024-08-18T22:23:08.386741+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386741+0000","last_undegraded":"2024-08-18T22:23:08.386741+0000","last_fullsized":"2024-08-18T22:23:08.386741+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394701+0000","last_change":"2024-08-18T22:23:08.391640+0000","last_active":"2024-08-18T22:23:08.394701+0000","last_peered":"2024-08-18T22:23:08.394701+0000","last_clean":"2024-08-18T22:23:08.394701+0000","last_became_active":"2024-08-18T22:23:08.391377+0000","last_became_peered":"2024-08-18T22:23:08.391377+0000","last_unstale":"2024-08-18T22:23:08.394701+0000","last_undegraded":"2024-08-18T22:23:08.394701+0000","last_fullsized":"2024-08-18T22:23:08.394701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:43.009084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379015+0000","last_change":"2024-08-18T22:23:09.394815+0000","last_active":"2024-08-18T22:23:10.379015+0000","last_peered":"2024-08-18T22:23:10.379015+0000","last_clean":"2024-08-18T22:23:10.379015+0000","last_became_active":"2024-08-18T22:23:09.391502+0000","last_became_peered":"2024-08-18T22:23:09.391502+0000","last_unstale":"2024-08-18T22:23:10.379015+0000","last_undegraded":"2024-08-18T22:23:10.379015+0000","last_fullsized":"2024-08-18T22:23:10.379015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:42.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.390750+0000","last_change":"2024-08-18T22:23:08.382205+0000","last_active":"2024-08-18T22:23:08.390750+0000","last_peered":"2024-08-18T22:23:08.390750+0000","last_clean":"2024-08-18T22:23:08.390750+0000","last_became_active":"2024-08-18T22:23:08.381817+0000","last_became_peered":"2024-08-18T22:23:08.381817+0000","last_unstale":"2024-08-18T22:23:08.390750+0000","last_undegraded":"2024-08-18T22:23:08.390750+0000","last_fullsized":"2024-08-18T22:23:08.390750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:23.253295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377624+0000","last_change":"2024-08-18T22:23:09.385959+0000","last_active":"2024-08-18T22:23:10.377624+0000","last_peered":"2024-08-18T22:23:10.377624+0000","last_clean":"2024-08-18T22:23:10.377624+0000","last_became_active":"2024-08-18T22:23:09.385743+0000","last_became_peered":"2024-08-18T22:23:09.385743+0000","last_unstale":"2024-08-18T22:23:10.377624+0000","last_undegraded":"2024-08-18T22:23:10.377624+0000","last_fullsized":"2024-08-18T22:23:10.377624+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:44:47.120395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400736+0000","last_change":"2024-08-18T22:23:08.395722+0000","last_active":"2024-08-18T22:23:08.400736+0000","last_peered":"2024-08-18T22:23:08.400736+0000","last_clean":"2024-08-18T22:23:08.400736+0000","last_became_active":"2024-08-18T22:23:08.395423+0000","last_became_peered":"2024-08-18T22:23:08.395423+0000","last_unstale":"2024-08-18T22:23:08.400736+0000","last_undegraded":"2024-08-18T22:23:08.400736+0000","last_fullsized":"2024-08-18T22:23:08.400736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:59.063303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381691+0000","last_change":"2024-08-18T22:23:08.381691+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381691+0000","last_undegraded":"2024-08-18T22:23:08.381691+0000","last_fullsized":"2024-08-18T22:23:08.381691+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394708+0000","last_change":"2024-08-18T22:23:08.391632+0000","last_active":"2024-08-18T22:23:08.394708+0000","last_peered":"2024-08-18T22:23:08.394708+0000","last_clean":"2024-08-18T22:23:08.394708+0000","last_became_active":"2024-08-18T22:23:08.391350+0000","last_became_peered":"2024-08-18T22:23:08.391350+0000","last_unstale":"2024-08-18T22:23:08.394708+0000","last_undegraded":"2024-08-18T22:23:08.394708+0000","last_fullsized":"2024-08-18T22:23:08.394708+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:43.009084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.389670+0000","last_change":"2024-08-18T22:23:08.389670+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.389670+0000","last_undegraded":"2024-08-18T22:23:08.389670+0000","last_fullsized":"2024-08-18T22:23:08.389670+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.393053+0000","last_change":"2024-08-18T22:23:08.388076+0000","last_active":"2024-08-18T22:23:08.393053+0000","last_peered":"2024-08-18T22:23:08.393053+0000","last_clean":"2024-08-18T22:23:08.393053+0000","last_became_active":"2024-08-18T22:23:08.387745+0000","last_became_peered":"2024-08-18T22:23:08.387745+0000","last_unstale":"2024-08-18T22:23:08.393053+0000","last_undegraded":"2024-08-18T22:23:08.393053+0000","last_fullsized":"2024-08-18T22:23:08.393053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:07.998922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377058+0000","last_change":"2024-08-18T22:23:08.377058+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377058+0000","last_undegraded":"2024-08-18T22:23:08.377058+0000","last_fullsized":"2024-08-18T22:23:08.377058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377736+0000","last_change":"2024-08-18T22:23:08.384953+0000","last_active":"2024-08-18T22:23:10.377736+0000","last_peered":"2024-08-18T22:23:10.377736+0000","last_clean":"2024-08-18T22:23:10.377736+0000","last_became_active":"2024-08-18T22:23:08.384684+0000","last_became_peered":"2024-08-18T22:23:08.384684+0000","last_unstale":"2024-08-18T22:23:10.377736+0000","last_undegraded":"2024-08-18T22:23:10.377736+0000","last_fullsized":"2024-08-18T22:23:10.377736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:22:31.028819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.376243+0000","last_change":"2024-08-18T22:23:08.376243+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.376243+0000","last_undegraded":"2024-08-18T22:23:08.376243+0000","last_fullsized":"2024-08-18T22:23:08.376243+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394606+0000","last_change":"2024-08-18T22:23:08.391894+0000","last_active":"2024-08-18T22:23:08.394606+0000","last_peered":"2024-08-18T22:23:08.394606+0000","last_clean":"2024-08-18T22:23:08.394606+0000","last_became_active":"2024-08-18T22:23:08.391616+0000","last_became_peered":"2024-08-18T22:23:08.391616+0000","last_unstale":"2024-08-18T22:23:08.394606+0000","last_undegraded":"2024-08-18T22:23:08.394606+0000","last_fullsized":"2024-08-18T22:23:08.394606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:14.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.384174+0000","last_change":"2024-08-18T22:23:08.384174+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.384174+0000","last_undegraded":"2024-08-18T22:23:08.384174+0000","last_fullsized":"2024-08-18T22:23:08.384174+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398240+0000","last_change":"2024-08-18T22:23:08.394584+0000","last_active":"2024-08-18T22:23:08.398240+0000","last_peered":"2024-08-18T22:23:08.398240+0000","last_clean":"2024-08-18T22:23:08.398240+0000","last_became_active":"2024-08-18T22:23:08.394230+0000","last_became_peered":"2024-08-18T22:23:08.394230+0000","last_unstale":"2024-08-18T22:23:08.398240+0000","last_undegraded":"2024-08-18T22:23:08.398240+0000","last_fullsized":"2024-08-18T22:23:08.398240+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:54.525986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378753+0000","last_change":"2024-08-18T22:23:09.406775+0000","last_active":"2024-08-18T22:23:10.378753+0000","last_peered":"2024-08-18T22:23:10.378753+0000","last_clean":"2024-08-18T22:23:10.378753+0000","last_became_active":"2024-08-18T22:23:09.402616+0000","last_became_peered":"2024-08-18T22:23:09.402616+0000","last_unstale":"2024-08-18T22:23:10.378753+0000","last_undegraded":"2024-08-18T22:23:10.378753+0000","last_fullsized":"2024-08-18T22:23:10.378753+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:29.447896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394723+0000","last_change":"2024-08-18T22:23:08.392035+0000","last_active":"2024-08-18T22:23:08.394723+0000","last_peered":"2024-08-18T22:23:08.394723+0000","last_clean":"2024-08-18T22:23:08.394723+0000","last_became_active":"2024-08-18T22:23:08.391621+0000","last_became_peered":"2024-08-18T22:23:08.391621+0000","last_unstale":"2024-08-18T22:23:08.394723+0000","last_undegraded":"2024-08-18T22:23:08.394723+0000","last_fullsized":"2024-08-18T22:23:08.394723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:05.935611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.387403+0000","last_change":"2024-08-18T22:23:08.387403+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.387403+0000","last_undegraded":"2024-08-18T22:23:08.387403+0000","last_fullsized":"2024-08-18T22:23:08.387403+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.388888+0000","last_change":"2024-08-18T22:23:08.385515+0000","last_active":"2024-08-18T22:23:08.388888+0000","last_peered":"2024-08-18T22:23:08.388888+0000","last_clean":"2024-08-18T22:23:08.388888+0000","last_became_active":"2024-08-18T22:23:08.385221+0000","last_became_peered":"2024-08-18T22:23:08.385221+0000","last_unstale":"2024-08-18T22:23:08.388888+0000","last_undegraded":"2024-08-18T22:23:08.388888+0000","last_fullsized":"2024-08-18T22:23:08.388888+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:02.573262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381329+0000","last_change":"2024-08-18T22:23:08.381329+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381329+0000","last_undegraded":"2024-08-18T22:23:08.381329+0000","last_fullsized":"2024-08-18T22:23:08.381329+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400409+0000","last_change":"2024-08-18T22:23:08.399434+0000","last_active":"2024-08-18T22:23:08.400409+0000","last_peered":"2024-08-18T22:23:08.400409+0000","last_clean":"2024-08-18T22:23:08.400409+0000","last_became_active":"2024-08-18T22:23:08.398753+0000","last_became_peered":"2024-08-18T22:23:08.398753+0000","last_unstale":"2024-08-18T22:23:08.400409+0000","last_undegraded":"2024-08-18T22:23:08.400409+0000","last_fullsized":"2024-08-18T22:23:08.400409+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:14.567719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381170+0000","last_change":"2024-08-18T22:23:08.381170+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381170+0000","last_undegraded":"2024-08-18T22:23:08.381170+0000","last_fullsized":"2024-08-18T22:23:08.381170+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394765+0000","last_change":"2024-08-18T22:23:08.391747+0000","last_active":"2024-08-18T22:23:08.394765+0000","last_peered":"2024-08-18T22:23:08.394765+0000","last_clean":"2024-08-18T22:23:08.394765+0000","last_became_active":"2024-08-18T22:23:08.391425+0000","last_became_peered":"2024-08-18T22:23:08.391425+0000","last_unstale":"2024-08-18T22:23:08.394765+0000","last_undegraded":"2024-08-18T22:23:08.394765+0000","last_fullsized":"2024-08-18T22:23:08.394765+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:05.935611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385306+0000","last_change":"2024-08-18T22:23:08.385306+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385306+0000","last_undegraded":"2024-08-18T22:23:08.385306+0000","last_fullsized":"2024-08-18T22:23:08.385306+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397144+0000","last_change":"2024-08-18T22:23:08.391816+0000","last_active":"2024-08-18T22:23:08.397144+0000","last_peered":"2024-08-18T22:23:08.397144+0000","last_clean":"2024-08-18T22:23:08.397144+0000","last_became_active":"2024-08-18T22:23:08.391406+0000","last_became_peered":"2024-08-18T22:23:08.391406+0000","last_unstale":"2024-08-18T22:23:08.397144+0000","last_undegraded":"2024-08-18T22:23:08.397144+0000","last_fullsized":"2024-08-18T22:23:08.397144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:18.572969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.382712+0000","last_change":"2024-08-18T22:23:08.382712+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.382712+0000","last_undegraded":"2024-08-18T22:23:08.382712+0000","last_fullsized":"2024-08-18T22:23:08.382712+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.393416+0000","last_change":"2024-08-18T22:23:08.388283+0000","last_active":"2024-08-18T22:23:08.393416+0000","last_peered":"2024-08-18T22:23:08.393416+0000","last_clean":"2024-08-18T22:23:08.393416+0000","last_became_active":"2024-08-18T22:23:08.387990+0000","last_became_peered":"2024-08-18T22:23:08.387990+0000","last_unstale":"2024-08-18T22:23:08.393416+0000","last_undegraded":"2024-08-18T22:23:08.393416+0000","last_fullsized":"2024-08-18T22:23:08.393416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:07.998922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377137+0000","last_change":"2024-08-18T22:23:09.416113+0000","last_active":"2024-08-18T22:23:10.377137+0000","last_peered":"2024-08-18T22:23:10.377137+0000","last_clean":"2024-08-18T22:23:10.377137+0000","last_became_active":"2024-08-18T22:23:09.415833+0000","last_became_peered":"2024-08-18T22:23:09.415833+0000","last_unstale":"2024-08-18T22:23:10.377137+0000","last_undegraded":"2024-08-18T22:23:10.377137+0000","last_fullsized":"2024-08-18T22:23:10.377137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:31:02.876930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394274+0000","last_change":"2024-08-18T22:23:08.390232+0000","last_active":"2024-08-18T22:23:08.394274+0000","last_peered":"2024-08-18T22:23:08.394274+0000","last_clean":"2024-08-18T22:23:08.394274+0000","last_became_active":"2024-08-18T22:23:08.389799+0000","last_became_peered":"2024-08-18T22:23:08.389799+0000","last_unstale":"2024-08-18T22:23:08.394274+0000","last_undegraded":"2024-08-18T22:23:08.394274+0000","last_fullsized":"2024-08-18T22:23:08.394274+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:49.234560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380011+0000","last_change":"2024-08-18T22:23:08.380011+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380011+0000","last_undegraded":"2024-08-18T22:23:08.380011+0000","last_fullsized":"2024-08-18T22:23:08.380011+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397063+0000","last_change":"2024-08-18T22:23:08.390855+0000","last_active":"2024-08-18T22:23:08.397063+0000","last_peered":"2024-08-18T22:23:08.397063+0000","last_clean":"2024-08-18T22:23:08.397063+0000","last_became_active":"2024-08-18T22:23:08.390531+0000","last_became_peered":"2024-08-18T22:23:08.390531+0000","last_unstale":"2024-08-18T22:23:08.397063+0000","last_undegraded":"2024-08-18T22:23:08.397063+0000","last_fullsized":"2024-08-18T22:23:08.397063+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:16:46.918953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.384431+0000","last_change":"2024-08-18T22:23:08.384431+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.384431+0000","last_undegraded":"2024-08-18T22:23:08.384431+0000","last_fullsized":"2024-08-18T22:23:08.384431+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.392709+0000","last_change":"2024-08-18T22:23:08.391499+0000","last_active":"2024-08-18T22:23:08.392709+0000","last_peered":"2024-08-18T22:23:08.392709+0000","last_clean":"2024-08-18T22:23:08.392709+0000","last_became_active":"2024-08-18T22:23:08.391180+0000","last_became_peered":"2024-08-18T22:23:08.391180+0000","last_unstale":"2024-08-18T22:23:08.392709+0000","last_undegraded":"2024-08-18T22:23:08.392709+0000","last_fullsized":"2024-08-18T22:23:08.392709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:00.485578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386323+0000","last_change":"2024-08-18T22:23:08.386323+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386323+0000","last_undegraded":"2024-08-18T22:23:08.386323+0000","last_fullsized":"2024-08-18T22:23:08.386323+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394100+0000","last_change":"2024-08-18T22:23:08.390531+0000","last_active":"2024-08-18T22:23:08.394100+0000","last_peered":"2024-08-18T22:23:08.394100+0000","last_clean":"2024-08-18T22:23:08.394100+0000","last_became_active":"2024-08-18T22:23:08.390244+0000","last_became_peered":"2024-08-18T22:23:08.390244+0000","last_unstale":"2024-08-18T22:23:08.394100+0000","last_undegraded":"2024-08-18T22:23:08.394100+0000","last_fullsized":"2024-08-18T22:23:08.394100+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:49.234560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378005+0000","last_change":"2024-08-18T22:23:09.385451+0000","last_active":"2024-08-18T22:23:10.378005+0000","last_peered":"2024-08-18T22:23:10.378005+0000","last_clean":"2024-08-18T22:23:10.378005+0000","last_became_active":"2024-08-18T22:23:09.385180+0000","last_became_peered":"2024-08-18T22:23:09.385180+0000","last_unstale":"2024-08-18T22:23:10.378005+0000","last_undegraded":"2024-08-18T22:23:10.378005+0000","last_fullsized":"2024-08-18T22:23:10.378005+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:30.197348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399161+0000","last_change":"2024-08-18T22:23:08.395413+0000","last_active":"2024-08-18T22:23:08.399161+0000","last_peered":"2024-08-18T22:23:08.399161+0000","last_clean":"2024-08-18T22:23:08.399161+0000","last_became_active":"2024-08-18T22:23:08.394853+0000","last_became_peered":"2024-08-18T22:23:08.394853+0000","last_unstale":"2024-08-18T22:23:08.399161+0000","last_undegraded":"2024-08-18T22:23:08.399161+0000","last_fullsized":"2024-08-18T22:23:08.399161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:40.966159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377294+0000","last_change":"2024-08-18T22:23:08.377294+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377294+0000","last_undegraded":"2024-08-18T22:23:08.377294+0000","last_fullsized":"2024-08-18T22:23:08.377294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399640+0000","last_change":"2024-08-18T22:23:08.397936+0000","last_active":"2024-08-18T22:23:08.399640+0000","last_peered":"2024-08-18T22:23:08.399640+0000","last_clean":"2024-08-18T22:23:08.399640+0000","last_became_active":"2024-08-18T22:23:08.397588+0000","last_became_peered":"2024-08-18T22:23:08.397588+0000","last_unstale":"2024-08-18T22:23:08.399640+0000","last_undegraded":"2024-08-18T22:23:08.399640+0000","last_fullsized":"2024-08-18T22:23:08.399640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:13.990634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377070+0000","last_change":"2024-08-18T22:23:09.400184+0000","last_active":"2024-08-18T22:23:10.377070+0000","last_peered":"2024-08-18T22:23:10.377070+0000","last_clean":"2024-08-18T22:23:10.377070+0000","last_became_active":"2024-08-18T22:23:09.399916+0000","last_became_peered":"2024-08-18T22:23:09.399916+0000","last_unstale":"2024-08-18T22:23:10.377070+0000","last_undegraded":"2024-08-18T22:23:10.377070+0000","last_fullsized":"2024-08-18T22:23:10.377070+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:47.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398926+0000","last_change":"2024-08-18T22:23:08.395341+0000","last_active":"2024-08-18T22:23:08.398926+0000","last_peered":"2024-08-18T22:23:08.398926+0000","last_clean":"2024-08-18T22:23:08.398926+0000","last_became_active":"2024-08-18T22:23:08.395079+0000","last_became_peered":"2024-08-18T22:23:08.395079+0000","last_unstale":"2024-08-18T22:23:08.398926+0000","last_undegraded":"2024-08-18T22:23:08.398926+0000","last_fullsized":"2024-08-18T22:23:08.398926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:44.730118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.388065+0000","last_change":"2024-08-18T22:23:08.388065+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.388065+0000","last_undegraded":"2024-08-18T22:23:08.388065+0000","last_fullsized":"2024-08-18T22:23:08.388065+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.390965+0000","last_change":"2024-08-18T22:23:08.389367+0000","last_active":"2024-08-18T22:23:08.390965+0000","last_peered":"2024-08-18T22:23:08.390965+0000","last_clean":"2024-08-18T22:23:08.390965+0000","last_became_active":"2024-08-18T22:23:08.389090+0000","last_became_peered":"2024-08-18T22:23:08.389090+0000","last_unstale":"2024-08-18T22:23:08.390965+0000","last_undegraded":"2024-08-18T22:23:08.390965+0000","last_fullsized":"2024-08-18T22:23:08.390965+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:45.554618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":260,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.378100+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:23:08.378100+0000","last_peered":"2024-08-18T22:23:08.378100+0000","last_clean":"2024-08-18T22:23:08.378100+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:23:08.378100+0000","last_undegraded":"2024-08-18T22:23:08.378100+0000","last_fullsized":"2024-08-18T22:23:08.378100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36684,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335156,"statfs":{"total":96636764160,"available":96599199744,"internally_reserved":0,"allocated":1372160,"data_stored":940913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40248,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331592,"statfs":{"total":96636764160,"available":96595550208,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40252,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331588,"statfs":{"total":96636764160,"available":96595546112,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40828,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331012,"statfs":{"total":96636764160,"available":96594956288,"internally_reserved":0,"allocated":1359872,"data_stored":934254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":815104,"data_stored":366016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36120,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335720,"statfs":{"total":96636764160,"available":96599777280,"internally_reserved":0,"allocated":790528,"data_stored":357712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:23:13.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:23:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f15a5000640 1 Processor -- start 2024-08-18T22:23:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f15a5000640 1 -- start start 2024-08-18T22:23:13.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f15a5000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15a00ace90 0x7f15a015ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f15a5000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15a015d390 con 0x7f15a015d5e0 2024-08-18T22:23:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f15a5000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15a006dc70 con 0x7f15a00aea40 2024-08-18T22:23:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f15a5000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f15a006da20 con 0x7f15a00ace90 2024-08-18T22:23:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f159fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f15a015d5e0 0x7f15a006ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47226/0 (socket says 172.21.15.5:47226) 2024-08-18T22:23:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f159fe00640 1 -- 172.21.15.5:0/770155837 learned_addr learned my addr 172.21.15.5:0/770155837 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f1597e00640 1 --2- 172.21.15.5:0/770155837 >> v2:172.21.15.117:3300/0 conn(0x7f15a00ace90 0x7f15a015ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:13.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f159ea00640 1 -- 172.21.15.5:0/770155837 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452840338 0 0) 0x7f15a015d390 con 0x7f15a015d5e0 2024-08-18T22:23:13.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f159ea00640 1 -- 172.21.15.5:0/770155837 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1584003530 con 0x7f15a015d5e0 2024-08-18T22:23:13.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f1597e00640 1 -- 172.21.15.5:0/770155837 >> v1:172.21.15.117:6789/0 conn(0x7f15a00aea40 legacy=0x7f15a00aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f1597e00640 1 -- 172.21.15.5:0/770155837 >> v1:172.21.15.5:6789/0 conn(0x7f15a015d5e0 legacy=0x7f15a006ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.702+0000 7f1597e00640 1 -- 172.21.15.5:0/770155837 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a006df50 con 0x7f15a00ace90 2024-08-18T22:23:13.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.706+0000 7f1597e00640 1 --2- 172.21.15.5:0/770155837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a00ace90 0x7f15a015ce50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f15880097c0 tx=0x7f158801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f969e2eac7bdaae7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:13.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.706+0000 7f159ea00640 1 -- 172.21.15.5:0/770155837 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15880a7070 con 0x7f15a00ace90 2024-08-18T22:23:13.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.706+0000 7f159ea00640 1 -- 172.21.15.5:0/770155837 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15880b0070 con 0x7f15a00ace90 2024-08-18T22:23:13.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.706+0000 7f159ea00640 1 -- 172.21.15.5:0/770155837 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15880ab870 con 0x7f15a00ace90 2024-08-18T22:23:13.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.706+0000 7f15a5000640 1 -- 172.21.15.5:0/770155837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a00ace90 msgr2=0x7f15a015ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.706+0000 7f15a5000640 1 --2- 172.21.15.5:0/770155837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a00ace90 0x7f15a015ce50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f15880097c0 tx=0x7f158801c470 comp rx=0 tx=0).stop 2024-08-18T22:23:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.706+0000 7f15a5000640 1 -- 172.21.15.5:0/770155837 shutdown_connections 2024-08-18T22:23:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.706+0000 7f15a5000640 1 --2- 172.21.15.5:0/770155837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a00ace90 0x7f15a015ce50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.706+0000 7f15a5000640 1 -- 172.21.15.5:0/770155837 >> 172.21.15.5:0/770155837 conn(0x7f15a00b1b00 msgr2=0x7f15a00b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.706+0000 7f15a5000640 1 -- 172.21.15.5:0/770155837 shutdown_connections 2024-08-18T22:23:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.706+0000 7f15a5000640 1 -- 172.21.15.5:0/770155837 wait complete. 2024-08-18T22:23:13.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f15a5000640 1 Processor -- start 2024-08-18T22:23:13.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f15a5000640 1 -- start start 2024-08-18T22:23:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f15a5000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15a00ace90 0x7f15a00ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f15a5000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a00aea40 0x7f15a0153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f15a5000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a015d5e0 0x7f15a0152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f15a5000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f15a006f830 con 0x7f15a00aea40 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f15a5000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15a015f730 con 0x7f15a015d5e0 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f15a5000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f15a015d9f0 con 0x7f15a00ace90 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a00aea40 0x7f15a0153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a00aea40 0x7f15a0153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46692/0 (socket says 172.21.15.5:46692) 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597e00640 1 -- 172.21.15.5:0/703675696 learned_addr learned my addr 172.21.15.5:0/703675696 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f159f400640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15a00ace90 0x7f15a00ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f159fe00640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a015d5e0 0x7f15a0152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597e00640 1 -- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15a00ace90 msgr2=0x7f15a00ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597e00640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15a00ace90 0x7f15a00ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597e00640 1 -- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a015d5e0 msgr2=0x7f15a0152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597e00640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a015d5e0 0x7f15a0152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597e00640 1 -- 172.21.15.5:0/703675696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a0153b40 con 0x7f15a00aea40 2024-08-18T22:23:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f159fe00640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a015d5e0 0x7f15a0152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597e00640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a00aea40 0x7f15a0153600 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f15880097c0 tx=0x7f158801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597400640 1 -- 172.21.15.5:0/703675696 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588006e20 con 0x7f15a00aea40 2024-08-18T22:23:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597400640 1 -- 172.21.15.5:0/703675696 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1588004220 con 0x7f15a00aea40 2024-08-18T22:23:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f1597400640 1 -- 172.21.15.5:0/703675696 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588003620 con 0x7f15a00aea40 2024-08-18T22:23:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f15a5000640 1 -- 172.21.15.5:0/703675696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a0155860 con 0x7f15a00aea40 2024-08-18T22:23:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f15a5000640 1 -- 172.21.15.5:0/703675696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a0155e20 con 0x7f15a00aea40 2024-08-18T22:23:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.710+0000 7f15a5000640 1 -- 172.21.15.5:0/703675696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a00aee20 con 0x7f15a00aea40 2024-08-18T22:23:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.714+0000 7f1597400640 1 -- 172.21.15.5:0/703675696 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15880037c0 con 0x7f15a00aea40 2024-08-18T22:23:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.714+0000 7f1597400640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f157c0678c0 0x7f157c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.714+0000 7f1597400640 1 -- 172.21.15.5:0/703675696 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f15881205d0 con 0x7f15a00aea40 2024-08-18T22:23:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.714+0000 7f159f400640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f157c0678c0 0x7f157c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.714+0000 7f159f400640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f157c0678c0 0x7f157c069d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1590007fd0 tx=0x7f1590009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:13.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.718+0000 7f1597400640 1 -- 172.21.15.5:0/703675696 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f15a0153b40 con 0x7f15a00aea40 2024-08-18T22:23:13.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.882+0000 7f15a5000640 1 -- 172.21.15.5:0/703675696 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15a0153dc0 con 0x7f157c0678c0 2024-08-18T22:23:13.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f1597400640 1 -- 172.21.15.5:0/703675696 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247948 (secure 0 0 0) 0x7f15900014f0 con 0x7f157c0678c0 2024-08-18T22:23:13.895 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:23:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 -- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f157c0678c0 msgr2=0x7f157c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f157c0678c0 0x7f157c069d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1590007fd0 tx=0x7f1590009040 comp rx=0 tx=0).stop 2024-08-18T22:23:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 -- 172.21.15.5:0/703675696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a00aea40 msgr2=0x7f15a0153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a00aea40 0x7f15a0153600 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f15880097c0 tx=0x7f158801acb0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 -- 172.21.15.5:0/703675696 shutdown_connections 2024-08-18T22:23:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f157c0678c0 0x7f157c069d80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a015d5e0 0x7f15a0152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15a00aea40 0x7f15a0153600 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 --2- 172.21.15.5:0/703675696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15a00ace90 0x7f15a00ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:13.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 -- 172.21.15.5:0/703675696 >> 172.21.15.5:0/703675696 conn(0x7f15a00b1b00 msgr2=0x7f15a0072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 -- 172.21.15.5:0/703675696 shutdown_connections 2024-08-18T22:23:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:13.890+0000 7f15a5000640 1 -- 172.21.15.5:0/703675696 wait complete. 2024-08-18T22:23:13.917 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-08-18T22:23:13.674633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302444,"kb_used_data":7228,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754672276,"statfs":{"total":773094113280,"available":772784410624,"internally_reserved":0,"allocated":7401472,"data_stored":3974439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001957"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379544+0000","last_change":"2024-08-18T22:23:08.379544+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379544+0000","last_undegraded":"2024-08-18T22:23:08.379544+0000","last_fullsized":"2024-08-18T22:23:08.379544+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379610+0000","last_change":"2024-08-18T22:23:08.379610+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379610+0000","last_undegraded":"2024-08-18T22:23:08.379610+0000","last_fullsized":"2024-08-18T22:23:08.379610+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377622+0000","last_change":"2024-08-18T22:23:08.377622+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377622+0000","last_undegraded":"2024-08-18T22:23:08.377622+0000","last_fullsized":"2024-08-18T22:23:08.377622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378840+0000","last_change":"2024-08-18T22:23:09.404026+0000","last_active":"2024-08-18T22:23:10.378840+0000","last_peered":"2024-08-18T22:23:10.378840+0000","last_clean":"2024-08-18T22:23:10.378840+0000","last_became_active":"2024-08-18T22:23:09.403744+0000","last_became_peered":"2024-08-18T22:23:09.403744+0000","last_unstale":"2024-08-18T22:23:10.378840+0000","last_undegraded":"2024-08-18T22:23:10.378840+0000","last_fullsized":"2024-08-18T22:23:10.378840+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:03.641586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.388498+0000","last_change":"2024-08-18T22:23:08.388498+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.388498+0000","last_undegraded":"2024-08-18T22:23:08.388498+0000","last_fullsized":"2024-08-18T22:23:08.388498+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380971+0000","last_change":"2024-08-18T22:23:08.380971+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380971+0000","last_undegraded":"2024-08-18T22:23:08.380971+0000","last_fullsized":"2024-08-18T22:23:08.380971+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376888+0000","last_change":"2024-08-18T22:23:09.395052+0000","last_active":"2024-08-18T22:23:10.376888+0000","last_peered":"2024-08-18T22:23:10.376888+0000","last_clean":"2024-08-18T22:23:10.376888+0000","last_became_active":"2024-08-18T22:23:09.394746+0000","last_became_peered":"2024-08-18T22:23:09.394746+0000","last_unstale":"2024-08-18T22:23:10.376888+0000","last_undegraded":"2024-08-18T22:23:10.376888+0000","last_fullsized":"2024-08-18T22:23:10.376888+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:39.163319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379653+0000","last_change":"2024-08-18T22:23:08.379653+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379653+0000","last_undegraded":"2024-08-18T22:23:08.379653+0000","last_fullsized":"2024-08-18T22:23:08.379653+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375590+0000","last_change":"2024-08-18T22:23:08.375590+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375590+0000","last_undegraded":"2024-08-18T22:23:08.375590+0000","last_fullsized":"2024-08-18T22:23:08.375590+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377182+0000","last_change":"2024-08-18T22:23:08.377182+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377182+0000","last_undegraded":"2024-08-18T22:23:08.377182+0000","last_fullsized":"2024-08-18T22:23:08.377182+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378492+0000","last_change":"2024-08-18T22:23:09.391970+0000","last_active":"2024-08-18T22:23:10.378492+0000","last_peered":"2024-08-18T22:23:10.378492+0000","last_clean":"2024-08-18T22:23:10.378492+0000","last_became_active":"2024-08-18T22:23:09.391134+0000","last_became_peered":"2024-08-18T22:23:09.391134+0000","last_unstale":"2024-08-18T22:23:10.378492+0000","last_undegraded":"2024-08-18T22:23:10.378492+0000","last_fullsized":"2024-08-18T22:23:10.378492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:45.196677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380357+0000","last_change":"2024-08-18T22:23:08.380357+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380357+0000","last_undegraded":"2024-08-18T22:23:08.380357+0000","last_fullsized":"2024-08-18T22:23:08.380357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381798+0000","last_change":"2024-08-18T22:23:08.381798+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381798+0000","last_undegraded":"2024-08-18T22:23:08.381798+0000","last_fullsized":"2024-08-18T22:23:08.381798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.374132+0000","last_change":"2024-08-18T22:23:08.374132+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.374132+0000","last_undegraded":"2024-08-18T22:23:08.374132+0000","last_fullsized":"2024-08-18T22:23:08.374132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.374384+0000","last_change":"2024-08-18T22:23:08.374384+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.374384+0000","last_undegraded":"2024-08-18T22:23:08.374384+0000","last_fullsized":"2024-08-18T22:23:08.374384+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376855+0000","last_change":"2024-08-18T22:23:09.404695+0000","last_active":"2024-08-18T22:23:10.376855+0000","last_peered":"2024-08-18T22:23:10.376855+0000","last_clean":"2024-08-18T22:23:10.376855+0000","last_became_active":"2024-08-18T22:23:09.404441+0000","last_became_peered":"2024-08-18T22:23:09.404441+0000","last_unstale":"2024-08-18T22:23:10.376855+0000","last_undegraded":"2024-08-18T22:23:10.376855+0000","last_fullsized":"2024-08-18T22:23:10.376855+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:14.838422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377153+0000","last_change":"2024-08-18T22:23:08.377153+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377153+0000","last_undegraded":"2024-08-18T22:23:08.377153+0000","last_fullsized":"2024-08-18T22:23:08.377153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378673+0000","last_change":"2024-08-18T22:23:09.406570+0000","last_active":"2024-08-18T22:23:10.378673+0000","last_peered":"2024-08-18T22:23:10.378673+0000","last_clean":"2024-08-18T22:23:10.378673+0000","last_became_active":"2024-08-18T22:23:09.406243+0000","last_became_peered":"2024-08-18T22:23:09.406243+0000","last_unstale":"2024-08-18T22:23:10.378673+0000","last_undegraded":"2024-08-18T22:23:10.378673+0000","last_fullsized":"2024-08-18T22:23:10.378673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:23:09.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386571+0000","last_change":"2024-08-18T22:23:08.386571+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386571+0000","last_undegraded":"2024-08-18T22:23:08.386571+0000","last_fullsized":"2024-08-18T22:23:08.386571+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378280+0000","last_change":"2024-08-18T22:23:08.378280+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378280+0000","last_undegraded":"2024-08-18T22:23:08.378280+0000","last_fullsized":"2024-08-18T22:23:08.378280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380722+0000","last_change":"2024-08-18T22:23:08.380722+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380722+0000","last_undegraded":"2024-08-18T22:23:08.380722+0000","last_fullsized":"2024-08-18T22:23:08.380722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379817+0000","last_change":"2024-08-18T22:23:08.379817+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379817+0000","last_undegraded":"2024-08-18T22:23:08.379817+0000","last_fullsized":"2024-08-18T22:23:08.379817+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379291+0000","last_change":"2024-08-18T22:23:08.379291+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379291+0000","last_undegraded":"2024-08-18T22:23:08.379291+0000","last_fullsized":"2024-08-18T22:23:08.379291+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375422+0000","last_change":"2024-08-18T22:23:08.375422+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375422+0000","last_undegraded":"2024-08-18T22:23:08.375422+0000","last_fullsized":"2024-08-18T22:23:08.375422+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380267+0000","last_change":"2024-08-18T22:23:08.380267+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380267+0000","last_undegraded":"2024-08-18T22:23:08.380267+0000","last_fullsized":"2024-08-18T22:23:08.380267+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380461+0000","last_change":"2024-08-18T22:23:08.380461+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380461+0000","last_undegraded":"2024-08-18T22:23:08.380461+0000","last_fullsized":"2024-08-18T22:23:08.380461+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378559+0000","last_change":"2024-08-18T22:23:09.395874+0000","last_active":"2024-08-18T22:23:10.378559+0000","last_peered":"2024-08-18T22:23:10.378559+0000","last_clean":"2024-08-18T22:23:10.378559+0000","last_became_active":"2024-08-18T22:23:09.395607+0000","last_became_peered":"2024-08-18T22:23:09.395607+0000","last_unstale":"2024-08-18T22:23:10.378559+0000","last_undegraded":"2024-08-18T22:23:10.378559+0000","last_fullsized":"2024-08-18T22:23:10.378559+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:18.768258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378078+0000","last_change":"2024-08-18T22:23:08.378078+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378078+0000","last_undegraded":"2024-08-18T22:23:08.378078+0000","last_fullsized":"2024-08-18T22:23:08.378078+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375798+0000","last_change":"2024-08-18T22:23:08.375798+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375798+0000","last_undegraded":"2024-08-18T22:23:08.375798+0000","last_fullsized":"2024-08-18T22:23:08.375798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380964+0000","last_change":"2024-08-18T22:23:08.380964+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380964+0000","last_undegraded":"2024-08-18T22:23:08.380964+0000","last_fullsized":"2024-08-18T22:23:08.380964+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377611+0000","last_change":"2024-08-18T22:23:09.387587+0000","last_active":"2024-08-18T22:23:10.377611+0000","last_peered":"2024-08-18T22:23:10.377611+0000","last_clean":"2024-08-18T22:23:10.377611+0000","last_became_active":"2024-08-18T22:23:09.387364+0000","last_became_peered":"2024-08-18T22:23:09.387364+0000","last_unstale":"2024-08-18T22:23:10.377611+0000","last_undegraded":"2024-08-18T22:23:10.377611+0000","last_fullsized":"2024-08-18T22:23:10.377611+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:22.989793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.382343+0000","last_change":"2024-08-18T22:23:08.382343+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.382343+0000","last_undegraded":"2024-08-18T22:23:08.382343+0000","last_fullsized":"2024-08-18T22:23:08.382343+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385161+0000","last_change":"2024-08-18T22:23:08.385161+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385161+0000","last_undegraded":"2024-08-18T22:23:08.385161+0000","last_fullsized":"2024-08-18T22:23:08.385161+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.388533+0000","last_change":"2024-08-18T22:23:08.381923+0000","last_active":"2024-08-18T22:23:08.388533+0000","last_peered":"2024-08-18T22:23:08.388533+0000","last_clean":"2024-08-18T22:23:08.388533+0000","last_became_active":"2024-08-18T22:23:08.381398+0000","last_became_peered":"2024-08-18T22:23:08.381398+0000","last_unstale":"2024-08-18T22:23:08.388533+0000","last_undegraded":"2024-08-18T22:23:08.388533+0000","last_fullsized":"2024-08-18T22:23:08.388533+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:04:03.032855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378673+0000","last_change":"2024-08-18T22:23:09.406503+0000","last_active":"2024-08-18T22:23:10.378673+0000","last_peered":"2024-08-18T22:23:10.378673+0000","last_clean":"2024-08-18T22:23:10.378673+0000","last_became_active":"2024-08-18T22:23:09.406229+0000","last_became_peered":"2024-08-18T22:23:09.406229+0000","last_unstale":"2024-08-18T22:23:10.378673+0000","last_undegraded":"2024-08-18T22:23:10.378673+0000","last_fullsized":"2024-08-18T22:23:10.378673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:12.297162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397347+0000","last_change":"2024-08-18T22:23:08.395735+0000","last_active":"2024-08-18T22:23:08.397347+0000","last_peered":"2024-08-18T22:23:08.397347+0000","last_clean":"2024-08-18T22:23:08.397347+0000","last_became_active":"2024-08-18T22:23:08.395477+0000","last_became_peered":"2024-08-18T22:23:08.395477+0000","last_unstale":"2024-08-18T22:23:08.397347+0000","last_undegraded":"2024-08-18T22:23:08.397347+0000","last_fullsized":"2024-08-18T22:23:08.397347+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:46.358052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385633+0000","last_change":"2024-08-18T22:23:08.385633+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385633+0000","last_undegraded":"2024-08-18T22:23:08.385633+0000","last_fullsized":"2024-08-18T22:23:08.385633+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397091+0000","last_change":"2024-08-18T22:23:08.390884+0000","last_active":"2024-08-18T22:23:08.397091+0000","last_peered":"2024-08-18T22:23:08.397091+0000","last_clean":"2024-08-18T22:23:08.397091+0000","last_became_active":"2024-08-18T22:23:08.390605+0000","last_became_peered":"2024-08-18T22:23:08.390605+0000","last_unstale":"2024-08-18T22:23:08.397091+0000","last_undegraded":"2024-08-18T22:23:08.397091+0000","last_fullsized":"2024-08-18T22:23:08.397091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:30.832117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.376017+0000","last_change":"2024-08-18T22:23:08.376017+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.376017+0000","last_undegraded":"2024-08-18T22:23:08.376017+0000","last_fullsized":"2024-08-18T22:23:08.376017+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397608+0000","last_change":"2024-08-18T22:23:08.396665+0000","last_active":"2024-08-18T22:23:08.397608+0000","last_peered":"2024-08-18T22:23:08.397608+0000","last_clean":"2024-08-18T22:23:08.397608+0000","last_became_active":"2024-08-18T22:23:08.396386+0000","last_became_peered":"2024-08-18T22:23:08.396386+0000","last_unstale":"2024-08-18T22:23:08.397608+0000","last_undegraded":"2024-08-18T22:23:08.397608+0000","last_fullsized":"2024-08-18T22:23:08.397608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:28:52.107125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376874+0000","last_change":"2024-08-18T22:23:09.390577+0000","last_active":"2024-08-18T22:23:10.376874+0000","last_peered":"2024-08-18T22:23:10.376874+0000","last_clean":"2024-08-18T22:23:10.376874+0000","last_became_active":"2024-08-18T22:23:09.390330+0000","last_became_peered":"2024-08-18T22:23:09.390330+0000","last_unstale":"2024-08-18T22:23:10.376874+0000","last_undegraded":"2024-08-18T22:23:10.376874+0000","last_fullsized":"2024-08-18T22:23:10.376874+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:05.538156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398721+0000","last_change":"2024-08-18T22:23:08.395039+0000","last_active":"2024-08-18T22:23:08.398721+0000","last_peered":"2024-08-18T22:23:08.398721+0000","last_clean":"2024-08-18T22:23:08.398721+0000","last_became_active":"2024-08-18T22:23:08.390586+0000","last_became_peered":"2024-08-18T22:23:08.390586+0000","last_unstale":"2024-08-18T22:23:08.398721+0000","last_undegraded":"2024-08-18T22:23:08.398721+0000","last_fullsized":"2024-08-18T22:23:08.398721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:52.259773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377105+0000","last_change":"2024-08-18T22:23:08.377105+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377105+0000","last_undegraded":"2024-08-18T22:23:08.377105+0000","last_fullsized":"2024-08-18T22:23:08.377105+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400310+0000","last_change":"2024-08-18T22:23:08.399282+0000","last_active":"2024-08-18T22:23:08.400310+0000","last_peered":"2024-08-18T22:23:08.400310+0000","last_clean":"2024-08-18T22:23:08.400310+0000","last_became_active":"2024-08-18T22:23:08.398958+0000","last_became_peered":"2024-08-18T22:23:08.398958+0000","last_unstale":"2024-08-18T22:23:08.400310+0000","last_undegraded":"2024-08-18T22:23:08.400310+0000","last_fullsized":"2024-08-18T22:23:08.400310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:50.360086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.390818+0000","last_change":"2024-08-18T22:23:08.390818+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.390818+0000","last_undegraded":"2024-08-18T22:23:08.390818+0000","last_fullsized":"2024-08-18T22:23:08.390818+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399618+0000","last_change":"2024-08-18T22:23:08.397746+0000","last_active":"2024-08-18T22:23:08.399618+0000","last_peered":"2024-08-18T22:23:08.399618+0000","last_clean":"2024-08-18T22:23:08.399618+0000","last_became_active":"2024-08-18T22:23:08.397305+0000","last_became_peered":"2024-08-18T22:23:08.397305+0000","last_unstale":"2024-08-18T22:23:08.399618+0000","last_undegraded":"2024-08-18T22:23:08.399618+0000","last_fullsized":"2024-08-18T22:23:08.399618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:10.981993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378196+0000","last_change":"2024-08-18T22:23:08.378196+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378196+0000","last_undegraded":"2024-08-18T22:23:08.378196+0000","last_fullsized":"2024-08-18T22:23:08.378196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.395398+0000","last_change":"2024-08-18T22:23:08.393396+0000","last_active":"2024-08-18T22:23:08.395398+0000","last_peered":"2024-08-18T22:23:08.395398+0000","last_clean":"2024-08-18T22:23:08.395398+0000","last_became_active":"2024-08-18T22:23:08.393124+0000","last_became_peered":"2024-08-18T22:23:08.393124+0000","last_unstale":"2024-08-18T22:23:08.395398+0000","last_undegraded":"2024-08-18T22:23:08.395398+0000","last_fullsized":"2024-08-18T22:23:08.395398+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:45:40.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377628+0000","last_change":"2024-08-18T22:23:08.377628+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377628+0000","last_undegraded":"2024-08-18T22:23:08.377628+0000","last_fullsized":"2024-08-18T22:23:08.377628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.395706+0000","last_change":"2024-08-18T22:23:08.393152+0000","last_active":"2024-08-18T22:23:08.395706+0000","last_peered":"2024-08-18T22:23:08.395706+0000","last_clean":"2024-08-18T22:23:08.395706+0000","last_became_active":"2024-08-18T22:23:08.392860+0000","last_became_peered":"2024-08-18T22:23:08.392860+0000","last_unstale":"2024-08-18T22:23:08.395706+0000","last_undegraded":"2024-08-18T22:23:08.395706+0000","last_fullsized":"2024-08-18T22:23:08.395706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:14.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378339+0000","last_change":"2024-08-18T22:23:08.378339+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378339+0000","last_undegraded":"2024-08-18T22:23:08.378339+0000","last_fullsized":"2024-08-18T22:23:08.378339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378791+0000","last_change":"2024-08-18T22:23:08.390558+0000","last_active":"2024-08-18T22:23:10.378791+0000","last_peered":"2024-08-18T22:23:10.378791+0000","last_clean":"2024-08-18T22:23:10.378791+0000","last_became_active":"2024-08-18T22:23:08.389931+0000","last_became_peered":"2024-08-18T22:23:08.389931+0000","last_unstale":"2024-08-18T22:23:10.378791+0000","last_undegraded":"2024-08-18T22:23:10.378791+0000","last_fullsized":"2024-08-18T22:23:10.378791+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:42.339748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386741+0000","last_change":"2024-08-18T22:23:08.386741+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386741+0000","last_undegraded":"2024-08-18T22:23:08.386741+0000","last_fullsized":"2024-08-18T22:23:08.386741+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394701+0000","last_change":"2024-08-18T22:23:08.391640+0000","last_active":"2024-08-18T22:23:08.394701+0000","last_peered":"2024-08-18T22:23:08.394701+0000","last_clean":"2024-08-18T22:23:08.394701+0000","last_became_active":"2024-08-18T22:23:08.391377+0000","last_became_peered":"2024-08-18T22:23:08.391377+0000","last_unstale":"2024-08-18T22:23:08.394701+0000","last_undegraded":"2024-08-18T22:23:08.394701+0000","last_fullsized":"2024-08-18T22:23:08.394701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:43.009084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379015+0000","last_change":"2024-08-18T22:23:09.394815+0000","last_active":"2024-08-18T22:23:10.379015+0000","last_peered":"2024-08-18T22:23:10.379015+0000","last_clean":"2024-08-18T22:23:10.379015+0000","last_became_active":"2024-08-18T22:23:09.391502+0000","last_became_peered":"2024-08-18T22:23:09.391502+0000","last_unstale":"2024-08-18T22:23:10.379015+0000","last_undegraded":"2024-08-18T22:23:10.379015+0000","last_fullsized":"2024-08-18T22:23:10.379015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:42.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.390750+0000","last_change":"2024-08-18T22:23:08.382205+0000","last_active":"2024-08-18T22:23:08.390750+0000","last_peered":"2024-08-18T22:23:08.390750+0000","last_clean":"2024-08-18T22:23:08.390750+0000","last_became_active":"2024-08-18T22:23:08.381817+0000","last_became_peered":"2024-08-18T22:23:08.381817+0000","last_unstale":"2024-08-18T22:23:08.390750+0000","last_undegraded":"2024-08-18T22:23:08.390750+0000","last_fullsized":"2024-08-18T22:23:08.390750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:23.253295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377624+0000","last_change":"2024-08-18T22:23:09.385959+0000","last_active":"2024-08-18T22:23:10.377624+0000","last_peered":"2024-08-18T22:23:10.377624+0000","last_clean":"2024-08-18T22:23:10.377624+0000","last_became_active":"2024-08-18T22:23:09.385743+0000","last_became_peered":"2024-08-18T22:23:09.385743+0000","last_unstale":"2024-08-18T22:23:10.377624+0000","last_undegraded":"2024-08-18T22:23:10.377624+0000","last_fullsized":"2024-08-18T22:23:10.377624+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:44:47.120395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400736+0000","last_change":"2024-08-18T22:23:08.395722+0000","last_active":"2024-08-18T22:23:08.400736+0000","last_peered":"2024-08-18T22:23:08.400736+0000","last_clean":"2024-08-18T22:23:08.400736+0000","last_became_active":"2024-08-18T22:23:08.395423+0000","last_became_peered":"2024-08-18T22:23:08.395423+0000","last_unstale":"2024-08-18T22:23:08.400736+0000","last_undegraded":"2024-08-18T22:23:08.400736+0000","last_fullsized":"2024-08-18T22:23:08.400736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:59.063303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381691+0000","last_change":"2024-08-18T22:23:08.381691+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381691+0000","last_undegraded":"2024-08-18T22:23:08.381691+0000","last_fullsized":"2024-08-18T22:23:08.381691+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394708+0000","last_change":"2024-08-18T22:23:08.391632+0000","last_active":"2024-08-18T22:23:08.394708+0000","last_peered":"2024-08-18T22:23:08.394708+0000","last_clean":"2024-08-18T22:23:08.394708+0000","last_became_active":"2024-08-18T22:23:08.391350+0000","last_became_peered":"2024-08-18T22:23:08.391350+0000","last_unstale":"2024-08-18T22:23:08.394708+0000","last_undegraded":"2024-08-18T22:23:08.394708+0000","last_fullsized":"2024-08-18T22:23:08.394708+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:43.009084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.389670+0000","last_change":"2024-08-18T22:23:08.389670+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.389670+0000","last_undegraded":"2024-08-18T22:23:08.389670+0000","last_fullsized":"2024-08-18T22:23:08.389670+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.393053+0000","last_change":"2024-08-18T22:23:08.388076+0000","last_active":"2024-08-18T22:23:08.393053+0000","last_peered":"2024-08-18T22:23:08.393053+0000","last_clean":"2024-08-18T22:23:08.393053+0000","last_became_active":"2024-08-18T22:23:08.387745+0000","last_became_peered":"2024-08-18T22:23:08.387745+0000","last_unstale":"2024-08-18T22:23:08.393053+0000","last_undegraded":"2024-08-18T22:23:08.393053+0000","last_fullsized":"2024-08-18T22:23:08.393053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:07.998922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377058+0000","last_change":"2024-08-18T22:23:08.377058+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377058+0000","last_undegraded":"2024-08-18T22:23:08.377058+0000","last_fullsized":"2024-08-18T22:23:08.377058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377736+0000","last_change":"2024-08-18T22:23:08.384953+0000","last_active":"2024-08-18T22:23:10.377736+0000","last_peered":"2024-08-18T22:23:10.377736+0000","last_clean":"2024-08-18T22:23:10.377736+0000","last_became_active":"2024-08-18T22:23:08.384684+0000","last_became_peered":"2024-08-18T22:23:08.384684+0000","last_unstale":"2024-08-18T22:23:10.377736+0000","last_undegraded":"2024-08-18T22:23:10.377736+0000","last_fullsized":"2024-08-18T22:23:10.377736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:22:31.028819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.376243+0000","last_change":"2024-08-18T22:23:08.376243+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.376243+0000","last_undegraded":"2024-08-18T22:23:08.376243+0000","last_fullsized":"2024-08-18T22:23:08.376243+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394606+0000","last_change":"2024-08-18T22:23:08.391894+0000","last_active":"2024-08-18T22:23:08.394606+0000","last_peered":"2024-08-18T22:23:08.394606+0000","last_clean":"2024-08-18T22:23:08.394606+0000","last_became_active":"2024-08-18T22:23:08.391616+0000","last_became_peered":"2024-08-18T22:23:08.391616+0000","last_unstale":"2024-08-18T22:23:08.394606+0000","last_undegraded":"2024-08-18T22:23:08.394606+0000","last_fullsized":"2024-08-18T22:23:08.394606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:14.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.384174+0000","last_change":"2024-08-18T22:23:08.384174+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.384174+0000","last_undegraded":"2024-08-18T22:23:08.384174+0000","last_fullsized":"2024-08-18T22:23:08.384174+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398240+0000","last_change":"2024-08-18T22:23:08.394584+0000","last_active":"2024-08-18T22:23:08.398240+0000","last_peered":"2024-08-18T22:23:08.398240+0000","last_clean":"2024-08-18T22:23:08.398240+0000","last_became_active":"2024-08-18T22:23:08.394230+0000","last_became_peered":"2024-08-18T22:23:08.394230+0000","last_unstale":"2024-08-18T22:23:08.398240+0000","last_undegraded":"2024-08-18T22:23:08.398240+0000","last_fullsized":"2024-08-18T22:23:08.398240+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:54.525986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378753+0000","last_change":"2024-08-18T22:23:09.406775+0000","last_active":"2024-08-18T22:23:10.378753+0000","last_peered":"2024-08-18T22:23:10.378753+0000","last_clean":"2024-08-18T22:23:10.378753+0000","last_became_active":"2024-08-18T22:23:09.402616+0000","last_became_peered":"2024-08-18T22:23:09.402616+0000","last_unstale":"2024-08-18T22:23:10.378753+0000","last_undegraded":"2024-08-18T22:23:10.378753+0000","last_fullsized":"2024-08-18T22:23:10.378753+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:29.447896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394723+0000","last_change":"2024-08-18T22:23:08.392035+0000","last_active":"2024-08-18T22:23:08.394723+0000","last_peered":"2024-08-18T22:23:08.394723+0000","last_clean":"2024-08-18T22:23:08.394723+0000","last_became_active":"2024-08-18T22:23:08.391621+0000","last_became_peered":"2024-08-18T22:23:08.391621+0000","last_unstale":"2024-08-18T22:23:08.394723+0000","last_undegraded":"2024-08-18T22:23:08.394723+0000","last_fullsized":"2024-08-18T22:23:08.394723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:05.935611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.387403+0000","last_change":"2024-08-18T22:23:08.387403+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.387403+0000","last_undegraded":"2024-08-18T22:23:08.387403+0000","last_fullsized":"2024-08-18T22:23:08.387403+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.388888+0000","last_change":"2024-08-18T22:23:08.385515+0000","last_active":"2024-08-18T22:23:08.388888+0000","last_peered":"2024-08-18T22:23:08.388888+0000","last_clean":"2024-08-18T22:23:08.388888+0000","last_became_active":"2024-08-18T22:23:08.385221+0000","last_became_peered":"2024-08-18T22:23:08.385221+0000","last_unstale":"2024-08-18T22:23:08.388888+0000","last_undegraded":"2024-08-18T22:23:08.388888+0000","last_fullsized":"2024-08-18T22:23:08.388888+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:02.573262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381329+0000","last_change":"2024-08-18T22:23:08.381329+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381329+0000","last_undegraded":"2024-08-18T22:23:08.381329+0000","last_fullsized":"2024-08-18T22:23:08.381329+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400409+0000","last_change":"2024-08-18T22:23:08.399434+0000","last_active":"2024-08-18T22:23:08.400409+0000","last_peered":"2024-08-18T22:23:08.400409+0000","last_clean":"2024-08-18T22:23:08.400409+0000","last_became_active":"2024-08-18T22:23:08.398753+0000","last_became_peered":"2024-08-18T22:23:08.398753+0000","last_unstale":"2024-08-18T22:23:08.400409+0000","last_undegraded":"2024-08-18T22:23:08.400409+0000","last_fullsized":"2024-08-18T22:23:08.400409+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:14.567719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381170+0000","last_change":"2024-08-18T22:23:08.381170+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381170+0000","last_undegraded":"2024-08-18T22:23:08.381170+0000","last_fullsized":"2024-08-18T22:23:08.381170+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394765+0000","last_change":"2024-08-18T22:23:08.391747+0000","last_active":"2024-08-18T22:23:08.394765+0000","last_peered":"2024-08-18T22:23:08.394765+0000","last_clean":"2024-08-18T22:23:08.394765+0000","last_became_active":"2024-08-18T22:23:08.391425+0000","last_became_peered":"2024-08-18T22:23:08.391425+0000","last_unstale":"2024-08-18T22:23:08.394765+0000","last_undegraded":"2024-08-18T22:23:08.394765+0000","last_fullsized":"2024-08-18T22:23:08.394765+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:05.935611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385306+0000","last_change":"2024-08-18T22:23:08.385306+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385306+0000","last_undegraded":"2024-08-18T22:23:08.385306+0000","last_fullsized":"2024-08-18T22:23:08.385306+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397144+0000","last_change":"2024-08-18T22:23:08.391816+0000","last_active":"2024-08-18T22:23:08.397144+0000","last_peered":"2024-08-18T22:23:08.397144+0000","last_clean":"2024-08-18T22:23:08.397144+0000","last_became_active":"2024-08-18T22:23:08.391406+0000","last_became_peered":"2024-08-18T22:23:08.391406+0000","last_unstale":"2024-08-18T22:23:08.397144+0000","last_undegraded":"2024-08-18T22:23:08.397144+0000","last_fullsized":"2024-08-18T22:23:08.397144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:18.572969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.382712+0000","last_change":"2024-08-18T22:23:08.382712+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.382712+0000","last_undegraded":"2024-08-18T22:23:08.382712+0000","last_fullsized":"2024-08-18T22:23:08.382712+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.393416+0000","last_change":"2024-08-18T22:23:08.388283+0000","last_active":"2024-08-18T22:23:08.393416+0000","last_peered":"2024-08-18T22:23:08.393416+0000","last_clean":"2024-08-18T22:23:08.393416+0000","last_became_active":"2024-08-18T22:23:08.387990+0000","last_became_peered":"2024-08-18T22:23:08.387990+0000","last_unstale":"2024-08-18T22:23:08.393416+0000","last_undegraded":"2024-08-18T22:23:08.393416+0000","last_fullsized":"2024-08-18T22:23:08.393416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:07.998922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377137+0000","last_change":"2024-08-18T22:23:09.416113+0000","last_active":"2024-08-18T22:23:10.377137+0000","last_peered":"2024-08-18T22:23:10.377137+0000","last_clean":"2024-08-18T22:23:10.377137+0000","last_became_active":"2024-08-18T22:23:09.415833+0000","last_became_peered":"2024-08-18T22:23:09.415833+0000","last_unstale":"2024-08-18T22:23:10.377137+0000","last_undegraded":"2024-08-18T22:23:10.377137+0000","last_fullsized":"2024-08-18T22:23:10.377137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:31:02.876930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394274+0000","last_change":"2024-08-18T22:23:08.390232+0000","last_active":"2024-08-18T22:23:08.394274+0000","last_peered":"2024-08-18T22:23:08.394274+0000","last_clean":"2024-08-18T22:23:08.394274+0000","last_became_active":"2024-08-18T22:23:08.389799+0000","last_became_peered":"2024-08-18T22:23:08.389799+0000","last_unstale":"2024-08-18T22:23:08.394274+0000","last_undegraded":"2024-08-18T22:23:08.394274+0000","last_fullsized":"2024-08-18T22:23:08.394274+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:49.234560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380011+0000","last_change":"2024-08-18T22:23:08.380011+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380011+0000","last_undegraded":"2024-08-18T22:23:08.380011+0000","last_fullsized":"2024-08-18T22:23:08.380011+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397063+0000","last_change":"2024-08-18T22:23:08.390855+0000","last_active":"2024-08-18T22:23:08.397063+0000","last_peered":"2024-08-18T22:23:08.397063+0000","last_clean":"2024-08-18T22:23:08.397063+0000","last_became_active":"2024-08-18T22:23:08.390531+0000","last_became_peered":"2024-08-18T22:23:08.390531+0000","last_unstale":"2024-08-18T22:23:08.397063+0000","last_undegraded":"2024-08-18T22:23:08.397063+0000","last_fullsized":"2024-08-18T22:23:08.397063+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:16:46.918953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.384431+0000","last_change":"2024-08-18T22:23:08.384431+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.384431+0000","last_undegraded":"2024-08-18T22:23:08.384431+0000","last_fullsized":"2024-08-18T22:23:08.384431+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.392709+0000","last_change":"2024-08-18T22:23:08.391499+0000","last_active":"2024-08-18T22:23:08.392709+0000","last_peered":"2024-08-18T22:23:08.392709+0000","last_clean":"2024-08-18T22:23:08.392709+0000","last_became_active":"2024-08-18T22:23:08.391180+0000","last_became_peered":"2024-08-18T22:23:08.391180+0000","last_unstale":"2024-08-18T22:23:08.392709+0000","last_undegraded":"2024-08-18T22:23:08.392709+0000","last_fullsized":"2024-08-18T22:23:08.392709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:00.485578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386323+0000","last_change":"2024-08-18T22:23:08.386323+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386323+0000","last_undegraded":"2024-08-18T22:23:08.386323+0000","last_fullsized":"2024-08-18T22:23:08.386323+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394100+0000","last_change":"2024-08-18T22:23:08.390531+0000","last_active":"2024-08-18T22:23:08.394100+0000","last_peered":"2024-08-18T22:23:08.394100+0000","last_clean":"2024-08-18T22:23:08.394100+0000","last_became_active":"2024-08-18T22:23:08.390244+0000","last_became_peered":"2024-08-18T22:23:08.390244+0000","last_unstale":"2024-08-18T22:23:08.394100+0000","last_undegraded":"2024-08-18T22:23:08.394100+0000","last_fullsized":"2024-08-18T22:23:08.394100+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:49.234560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378005+0000","last_change":"2024-08-18T22:23:09.385451+0000","last_active":"2024-08-18T22:23:10.378005+0000","last_peered":"2024-08-18T22:23:10.378005+0000","last_clean":"2024-08-18T22:23:10.378005+0000","last_became_active":"2024-08-18T22:23:09.385180+0000","last_became_peered":"2024-08-18T22:23:09.385180+0000","last_unstale":"2024-08-18T22:23:10.378005+0000","last_undegraded":"2024-08-18T22:23:10.378005+0000","last_fullsized":"2024-08-18T22:23:10.378005+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:30.197348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399161+0000","last_change":"2024-08-18T22:23:08.395413+0000","last_active":"2024-08-18T22:23:08.399161+0000","last_peered":"2024-08-18T22:23:08.399161+0000","last_clean":"2024-08-18T22:23:08.399161+0000","last_became_active":"2024-08-18T22:23:08.394853+0000","last_became_peered":"2024-08-18T22:23:08.394853+0000","last_unstale":"2024-08-18T22:23:08.399161+0000","last_undegraded":"2024-08-18T22:23:08.399161+0000","last_fullsized":"2024-08-18T22:23:08.399161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:40.966159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377294+0000","last_change":"2024-08-18T22:23:08.377294+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377294+0000","last_undegraded":"2024-08-18T22:23:08.377294+0000","last_fullsized":"2024-08-18T22:23:08.377294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399640+0000","last_change":"2024-08-18T22:23:08.397936+0000","last_active":"2024-08-18T22:23:08.399640+0000","last_peered":"2024-08-18T22:23:08.399640+0000","last_clean":"2024-08-18T22:23:08.399640+0000","last_became_active":"2024-08-18T22:23:08.397588+0000","last_became_peered":"2024-08-18T22:23:08.397588+0000","last_unstale":"2024-08-18T22:23:08.399640+0000","last_undegraded":"2024-08-18T22:23:08.399640+0000","last_fullsized":"2024-08-18T22:23:08.399640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:13.990634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377070+0000","last_change":"2024-08-18T22:23:09.400184+0000","last_active":"2024-08-18T22:23:10.377070+0000","last_peered":"2024-08-18T22:23:10.377070+0000","last_clean":"2024-08-18T22:23:10.377070+0000","last_became_active":"2024-08-18T22:23:09.399916+0000","last_became_peered":"2024-08-18T22:23:09.399916+0000","last_unstale":"2024-08-18T22:23:10.377070+0000","last_undegraded":"2024-08-18T22:23:10.377070+0000","last_fullsized":"2024-08-18T22:23:10.377070+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:47.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398926+0000","last_change":"2024-08-18T22:23:08.395341+0000","last_active":"2024-08-18T22:23:08.398926+0000","last_peered":"2024-08-18T22:23:08.398926+0000","last_clean":"2024-08-18T22:23:08.398926+0000","last_became_active":"2024-08-18T22:23:08.395079+0000","last_became_peered":"2024-08-18T22:23:08.395079+0000","last_unstale":"2024-08-18T22:23:08.398926+0000","last_undegraded":"2024-08-18T22:23:08.398926+0000","last_fullsized":"2024-08-18T22:23:08.398926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:44.730118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.388065+0000","last_change":"2024-08-18T22:23:08.388065+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.388065+0000","last_undegraded":"2024-08-18T22:23:08.388065+0000","last_fullsized":"2024-08-18T22:23:08.388065+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.390965+0000","last_change":"2024-08-18T22:23:08.389367+0000","last_active":"2024-08-18T22:23:08.390965+0000","last_peered":"2024-08-18T22:23:08.390965+0000","last_clean":"2024-08-18T22:23:08.390965+0000","last_became_active":"2024-08-18T22:23:08.389090+0000","last_became_peered":"2024-08-18T22:23:08.389090+0000","last_unstale":"2024-08-18T22:23:08.390965+0000","last_undegraded":"2024-08-18T22:23:08.390965+0000","last_fullsized":"2024-08-18T22:23:08.390965+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:45.554618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":260,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.378100+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:23:08.378100+0000","last_peered":"2024-08-18T22:23:08.378100+0000","last_clean":"2024-08-18T22:23:08.378100+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:23:08.378100+0000","last_undegraded":"2024-08-18T22:23:08.378100+0000","last_fullsized":"2024-08-18T22:23:08.378100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36684,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335156,"statfs":{"total":96636764160,"available":96599199744,"internally_reserved":0,"allocated":1372160,"data_stored":940913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40248,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331592,"statfs":{"total":96636764160,"available":96595550208,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40252,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331588,"statfs":{"total":96636764160,"available":96595546112,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40828,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331012,"statfs":{"total":96636764160,"available":96594956288,"internally_reserved":0,"allocated":1359872,"data_stored":934254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":815104,"data_stored":366016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36120,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335720,"statfs":{"total":96636764160,"available":96599777280,"internally_reserved":0,"allocated":790528,"data_stored":357712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:23:13.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:23:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b53000640 1 Processor -- start 2024-08-18T22:23:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b53000640 1 -- start start 2024-08-18T22:23:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b53000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c15c180 0x7f8b4c0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b53000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8b4c071c90 0x7f8b4c15c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b53000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b4c0b5e30 con 0x7f8b4c06fad0 2024-08-18T22:23:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b53000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8b4c15caa0 con 0x7f8b4c071c90 2024-08-18T22:23:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b53000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4c0b6110 con 0x7f8b4c15c180 2024-08-18T22:23:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b4b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8b4c06fad0 0x7f8b4c071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47232/0 (socket says 172.21.15.5:47232) 2024-08-18T22:23:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b4b400640 1 -- 172.21.15.5:0/1591576301 learned_addr learned my addr 172.21.15.5:0/1591576301 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b4be00640 1 --2- 172.21.15.5:0/1591576301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c15c180 0x7f8b4c0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b51000640 1 --2- 172.21.15.5:0/1591576301 >> v2:172.21.15.117:3300/0 conn(0x7f8b4c071c90 0x7f8b4c15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b4aa00640 1 -- 172.21.15.5:0/1591576301 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300147696 0 0) 0x7f8b4c0b5e30 con 0x7f8b4c06fad0 2024-08-18T22:23:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b4aa00640 1 -- 172.21.15.5:0/1591576301 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b30003530 con 0x7f8b4c06fad0 2024-08-18T22:23:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b4be00640 1 -- 172.21.15.5:0/1591576301 >> v2:172.21.15.117:3300/0 conn(0x7f8b4c071c90 msgr2=0x7f8b4c15c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b4be00640 1 --2- 172.21.15.5:0/1591576301 >> v2:172.21.15.117:3300/0 conn(0x7f8b4c071c90 0x7f8b4c15c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b4be00640 1 -- 172.21.15.5:0/1591576301 >> v1:172.21.15.5:6789/0 conn(0x7f8b4c06fad0 legacy=0x7f8b4c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.102+0000 7f8b4be00640 1 -- 172.21.15.5:0/1591576301 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4c0b63f0 con 0x7f8b4c15c180 2024-08-18T22:23:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b4be00640 1 --2- 172.21.15.5:0/1591576301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c15c180 0x7f8b4c0b57c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0097c0 tx=0x7f8b3c01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbc4894af914722f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b4aa00640 1 -- 172.21.15.5:0/1591576301 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0b1070 con 0x7f8b4c15c180 2024-08-18T22:23:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b4aa00640 1 -- 172.21.15.5:0/1591576301 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3c0ac640 con 0x7f8b4c15c180 2024-08-18T22:23:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b4aa00640 1 -- 172.21.15.5:0/1591576301 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0ac9f0 con 0x7f8b4c15c180 2024-08-18T22:23:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b53000640 1 -- 172.21.15.5:0/1591576301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c15c180 msgr2=0x7f8b4c0b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b53000640 1 --2- 172.21.15.5:0/1591576301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c15c180 0x7f8b4c0b57c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0097c0 tx=0x7f8b3c01c350 comp rx=0 tx=0).stop 2024-08-18T22:23:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b53000640 1 -- 172.21.15.5:0/1591576301 shutdown_connections 2024-08-18T22:23:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b53000640 1 --2- 172.21.15.5:0/1591576301 >> v2:172.21.15.117:3300/0 conn(0x7f8b4c071c90 0x7f8b4c15c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b53000640 1 --2- 172.21.15.5:0/1591576301 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c15c180 0x7f8b4c0b57c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b53000640 1 -- 172.21.15.5:0/1591576301 >> 172.21.15.5:0/1591576301 conn(0x7f8b4c0b3eb0 msgr2=0x7f8b4c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b53000640 1 -- 172.21.15.5:0/1591576301 shutdown_connections 2024-08-18T22:23:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.106+0000 7f8b53000640 1 -- 172.21.15.5:0/1591576301 wait complete. 2024-08-18T22:23:14.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b53000640 1 Processor -- start 2024-08-18T22:23:14.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b53000640 1 -- start start 2024-08-18T22:23:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b53000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c06fad0 0x7f8b4c1f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b53000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c071c90 0x7f8b4c14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b53000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b4c15c180 0x7f8b4c1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b53000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4c0d1c30 con 0x7f8b4c071c90 2024-08-18T22:23:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b53000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4c0d1ab0 con 0x7f8b4c15c180 2024-08-18T22:23:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b53000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4c0d1db0 con 0x7f8b4c06fad0 2024-08-18T22:23:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b4b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c071c90 0x7f8b4c14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b4b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c071c90 0x7f8b4c14e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46704/0 (socket says 172.21.15.5:46704) 2024-08-18T22:23:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b4b400640 1 -- 172.21.15.5:0/2440850694 learned_addr learned my addr 172.21.15.5:0/2440850694 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b4be00640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c06fad0 0x7f8b4c1f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b51000640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b4c15c180 0x7f8b4c1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b4b400640 1 -- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c06fad0 msgr2=0x7f8b4c1f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b4b400640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c06fad0 0x7f8b4c1f6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b4b400640 1 -- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b4c15c180 msgr2=0x7f8b4c1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b4b400640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b4c15c180 0x7f8b4c1522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b4b400640 1 -- 172.21.15.5:0/2440850694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4c06d570 con 0x7f8b4c071c90 2024-08-18T22:23:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b4b400640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c071c90 0x7f8b4c14e8b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800c420 tx=0x7f8b3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b43e00640 1 -- 172.21.15.5:0/2440850694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38017070 con 0x7f8b4c071c90 2024-08-18T22:23:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b43e00640 1 -- 172.21.15.5:0/2440850694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b38005d10 con 0x7f8b4c071c90 2024-08-18T22:23:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b43e00640 1 -- 172.21.15.5:0/2440850694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38007310 con 0x7f8b4c071c90 2024-08-18T22:23:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b53000640 1 -- 172.21.15.5:0/2440850694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b4c160e50 con 0x7f8b4c071c90 2024-08-18T22:23:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b53000640 1 -- 172.21.15.5:0/2440850694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b4c06d7e0 con 0x7f8b4c071c90 2024-08-18T22:23:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.110+0000 7f8b53000640 1 -- 172.21.15.5:0/2440850694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b4c15c560 con 0x7f8b4c071c90 2024-08-18T22:23:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.114+0000 7f8b43e00640 1 -- 172.21.15.5:0/2440850694 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b3801a070 con 0x7f8b4c071c90 2024-08-18T22:23:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.114+0000 7f8b43e00640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 0x7f8b2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.114+0000 7f8b43e00640 1 -- 172.21.15.5:0/2440850694 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f8b380852c0 con 0x7f8b4c071c90 2024-08-18T22:23:14.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.114+0000 7f8b4be00640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 0x7f8b2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.114+0000 7f8b4be00640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 0x7f8b2c069d80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0ae000 tx=0x7f8b3c0a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:14.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.118+0000 7f8b43e00640 1 -- 172.21.15.5:0/2440850694 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8b38055d20 con 0x7f8b4c071c90 2024-08-18T22:23:14.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.278+0000 7f8b53000640 1 -- 172.21.15.5:0/2440850694 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b4c15b7f0 con 0x7f8b2c0678c0 2024-08-18T22:23:14.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.286+0000 7f8b43e00640 1 -- 172.21.15.5:0/2440850694 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247948 (secure 0 0 0) 0x7f8b4c15b7f0 con 0x7f8b2c0678c0 2024-08-18T22:23:14.293 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:14.294 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:23:14.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 -- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 msgr2=0x7f8b2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 0x7f8b2c069d80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0ae000 tx=0x7f8b3c0a6070 comp rx=0 tx=0).stop 2024-08-18T22:23:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 -- 172.21.15.5:0/2440850694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c071c90 msgr2=0x7f8b4c14e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c071c90 0x7f8b4c14e8b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800c420 tx=0x7f8b3800c8e0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 -- 172.21.15.5:0/2440850694 shutdown_connections 2024-08-18T22:23:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 0x7f8b2c069d80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b4c15c180 0x7f8b4c1522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c071c90 0x7f8b4c14e8b0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 --2- 172.21.15.5:0/2440850694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c06fad0 0x7f8b4c1f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 -- 172.21.15.5:0/2440850694 >> 172.21.15.5:0/2440850694 conn(0x7f8b4c0b3eb0 msgr2=0x7f8b4c06feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 -- 172.21.15.5:0/2440850694 shutdown_connections 2024-08-18T22:23:14.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.290+0000 7f8b53000640 1 -- 172.21.15.5:0/2440850694 wait complete. 2024-08-18T22:23:14.313 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-08-18T22:23:13.674633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302444,"kb_used_data":7228,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754672276,"statfs":{"total":773094113280,"available":772784410624,"internally_reserved":0,"allocated":7401472,"data_stored":3974439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001957"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379544+0000","last_change":"2024-08-18T22:23:08.379544+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379544+0000","last_undegraded":"2024-08-18T22:23:08.379544+0000","last_fullsized":"2024-08-18T22:23:08.379544+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379610+0000","last_change":"2024-08-18T22:23:08.379610+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379610+0000","last_undegraded":"2024-08-18T22:23:08.379610+0000","last_fullsized":"2024-08-18T22:23:08.379610+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377622+0000","last_change":"2024-08-18T22:23:08.377622+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377622+0000","last_undegraded":"2024-08-18T22:23:08.377622+0000","last_fullsized":"2024-08-18T22:23:08.377622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378840+0000","last_change":"2024-08-18T22:23:09.404026+0000","last_active":"2024-08-18T22:23:10.378840+0000","last_peered":"2024-08-18T22:23:10.378840+0000","last_clean":"2024-08-18T22:23:10.378840+0000","last_became_active":"2024-08-18T22:23:09.403744+0000","last_became_peered":"2024-08-18T22:23:09.403744+0000","last_unstale":"2024-08-18T22:23:10.378840+0000","last_undegraded":"2024-08-18T22:23:10.378840+0000","last_fullsized":"2024-08-18T22:23:10.378840+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:03.641586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.388498+0000","last_change":"2024-08-18T22:23:08.388498+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.388498+0000","last_undegraded":"2024-08-18T22:23:08.388498+0000","last_fullsized":"2024-08-18T22:23:08.388498+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380971+0000","last_change":"2024-08-18T22:23:08.380971+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380971+0000","last_undegraded":"2024-08-18T22:23:08.380971+0000","last_fullsized":"2024-08-18T22:23:08.380971+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376888+0000","last_change":"2024-08-18T22:23:09.395052+0000","last_active":"2024-08-18T22:23:10.376888+0000","last_peered":"2024-08-18T22:23:10.376888+0000","last_clean":"2024-08-18T22:23:10.376888+0000","last_became_active":"2024-08-18T22:23:09.394746+0000","last_became_peered":"2024-08-18T22:23:09.394746+0000","last_unstale":"2024-08-18T22:23:10.376888+0000","last_undegraded":"2024-08-18T22:23:10.376888+0000","last_fullsized":"2024-08-18T22:23:10.376888+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:39.163319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379653+0000","last_change":"2024-08-18T22:23:08.379653+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379653+0000","last_undegraded":"2024-08-18T22:23:08.379653+0000","last_fullsized":"2024-08-18T22:23:08.379653+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375590+0000","last_change":"2024-08-18T22:23:08.375590+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375590+0000","last_undegraded":"2024-08-18T22:23:08.375590+0000","last_fullsized":"2024-08-18T22:23:08.375590+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377182+0000","last_change":"2024-08-18T22:23:08.377182+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377182+0000","last_undegraded":"2024-08-18T22:23:08.377182+0000","last_fullsized":"2024-08-18T22:23:08.377182+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378492+0000","last_change":"2024-08-18T22:23:09.391970+0000","last_active":"2024-08-18T22:23:10.378492+0000","last_peered":"2024-08-18T22:23:10.378492+0000","last_clean":"2024-08-18T22:23:10.378492+0000","last_became_active":"2024-08-18T22:23:09.391134+0000","last_became_peered":"2024-08-18T22:23:09.391134+0000","last_unstale":"2024-08-18T22:23:10.378492+0000","last_undegraded":"2024-08-18T22:23:10.378492+0000","last_fullsized":"2024-08-18T22:23:10.378492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:45.196677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380357+0000","last_change":"2024-08-18T22:23:08.380357+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380357+0000","last_undegraded":"2024-08-18T22:23:08.380357+0000","last_fullsized":"2024-08-18T22:23:08.380357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381798+0000","last_change":"2024-08-18T22:23:08.381798+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381798+0000","last_undegraded":"2024-08-18T22:23:08.381798+0000","last_fullsized":"2024-08-18T22:23:08.381798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.374132+0000","last_change":"2024-08-18T22:23:08.374132+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.374132+0000","last_undegraded":"2024-08-18T22:23:08.374132+0000","last_fullsized":"2024-08-18T22:23:08.374132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.374384+0000","last_change":"2024-08-18T22:23:08.374384+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.374384+0000","last_undegraded":"2024-08-18T22:23:08.374384+0000","last_fullsized":"2024-08-18T22:23:08.374384+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376855+0000","last_change":"2024-08-18T22:23:09.404695+0000","last_active":"2024-08-18T22:23:10.376855+0000","last_peered":"2024-08-18T22:23:10.376855+0000","last_clean":"2024-08-18T22:23:10.376855+0000","last_became_active":"2024-08-18T22:23:09.404441+0000","last_became_peered":"2024-08-18T22:23:09.404441+0000","last_unstale":"2024-08-18T22:23:10.376855+0000","last_undegraded":"2024-08-18T22:23:10.376855+0000","last_fullsized":"2024-08-18T22:23:10.376855+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:14.838422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377153+0000","last_change":"2024-08-18T22:23:08.377153+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377153+0000","last_undegraded":"2024-08-18T22:23:08.377153+0000","last_fullsized":"2024-08-18T22:23:08.377153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378673+0000","last_change":"2024-08-18T22:23:09.406570+0000","last_active":"2024-08-18T22:23:10.378673+0000","last_peered":"2024-08-18T22:23:10.378673+0000","last_clean":"2024-08-18T22:23:10.378673+0000","last_became_active":"2024-08-18T22:23:09.406243+0000","last_became_peered":"2024-08-18T22:23:09.406243+0000","last_unstale":"2024-08-18T22:23:10.378673+0000","last_undegraded":"2024-08-18T22:23:10.378673+0000","last_fullsized":"2024-08-18T22:23:10.378673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:23:09.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386571+0000","last_change":"2024-08-18T22:23:08.386571+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386571+0000","last_undegraded":"2024-08-18T22:23:08.386571+0000","last_fullsized":"2024-08-18T22:23:08.386571+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378280+0000","last_change":"2024-08-18T22:23:08.378280+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378280+0000","last_undegraded":"2024-08-18T22:23:08.378280+0000","last_fullsized":"2024-08-18T22:23:08.378280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380722+0000","last_change":"2024-08-18T22:23:08.380722+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380722+0000","last_undegraded":"2024-08-18T22:23:08.380722+0000","last_fullsized":"2024-08-18T22:23:08.380722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379817+0000","last_change":"2024-08-18T22:23:08.379817+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379817+0000","last_undegraded":"2024-08-18T22:23:08.379817+0000","last_fullsized":"2024-08-18T22:23:08.379817+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379291+0000","last_change":"2024-08-18T22:23:08.379291+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379291+0000","last_undegraded":"2024-08-18T22:23:08.379291+0000","last_fullsized":"2024-08-18T22:23:08.379291+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375422+0000","last_change":"2024-08-18T22:23:08.375422+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375422+0000","last_undegraded":"2024-08-18T22:23:08.375422+0000","last_fullsized":"2024-08-18T22:23:08.375422+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380267+0000","last_change":"2024-08-18T22:23:08.380267+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380267+0000","last_undegraded":"2024-08-18T22:23:08.380267+0000","last_fullsized":"2024-08-18T22:23:08.380267+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380461+0000","last_change":"2024-08-18T22:23:08.380461+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380461+0000","last_undegraded":"2024-08-18T22:23:08.380461+0000","last_fullsized":"2024-08-18T22:23:08.380461+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378559+0000","last_change":"2024-08-18T22:23:09.395874+0000","last_active":"2024-08-18T22:23:10.378559+0000","last_peered":"2024-08-18T22:23:10.378559+0000","last_clean":"2024-08-18T22:23:10.378559+0000","last_became_active":"2024-08-18T22:23:09.395607+0000","last_became_peered":"2024-08-18T22:23:09.395607+0000","last_unstale":"2024-08-18T22:23:10.378559+0000","last_undegraded":"2024-08-18T22:23:10.378559+0000","last_fullsized":"2024-08-18T22:23:10.378559+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:18.768258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378078+0000","last_change":"2024-08-18T22:23:08.378078+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378078+0000","last_undegraded":"2024-08-18T22:23:08.378078+0000","last_fullsized":"2024-08-18T22:23:08.378078+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375798+0000","last_change":"2024-08-18T22:23:08.375798+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375798+0000","last_undegraded":"2024-08-18T22:23:08.375798+0000","last_fullsized":"2024-08-18T22:23:08.375798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380964+0000","last_change":"2024-08-18T22:23:08.380964+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380964+0000","last_undegraded":"2024-08-18T22:23:08.380964+0000","last_fullsized":"2024-08-18T22:23:08.380964+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377611+0000","last_change":"2024-08-18T22:23:09.387587+0000","last_active":"2024-08-18T22:23:10.377611+0000","last_peered":"2024-08-18T22:23:10.377611+0000","last_clean":"2024-08-18T22:23:10.377611+0000","last_became_active":"2024-08-18T22:23:09.387364+0000","last_became_peered":"2024-08-18T22:23:09.387364+0000","last_unstale":"2024-08-18T22:23:10.377611+0000","last_undegraded":"2024-08-18T22:23:10.377611+0000","last_fullsized":"2024-08-18T22:23:10.377611+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:22.989793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.382343+0000","last_change":"2024-08-18T22:23:08.382343+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.382343+0000","last_undegraded":"2024-08-18T22:23:08.382343+0000","last_fullsized":"2024-08-18T22:23:08.382343+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385161+0000","last_change":"2024-08-18T22:23:08.385161+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385161+0000","last_undegraded":"2024-08-18T22:23:08.385161+0000","last_fullsized":"2024-08-18T22:23:08.385161+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.388533+0000","last_change":"2024-08-18T22:23:08.381923+0000","last_active":"2024-08-18T22:23:08.388533+0000","last_peered":"2024-08-18T22:23:08.388533+0000","last_clean":"2024-08-18T22:23:08.388533+0000","last_became_active":"2024-08-18T22:23:08.381398+0000","last_became_peered":"2024-08-18T22:23:08.381398+0000","last_unstale":"2024-08-18T22:23:08.388533+0000","last_undegraded":"2024-08-18T22:23:08.388533+0000","last_fullsized":"2024-08-18T22:23:08.388533+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:04:03.032855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378673+0000","last_change":"2024-08-18T22:23:09.406503+0000","last_active":"2024-08-18T22:23:10.378673+0000","last_peered":"2024-08-18T22:23:10.378673+0000","last_clean":"2024-08-18T22:23:10.378673+0000","last_became_active":"2024-08-18T22:23:09.406229+0000","last_became_peered":"2024-08-18T22:23:09.406229+0000","last_unstale":"2024-08-18T22:23:10.378673+0000","last_undegraded":"2024-08-18T22:23:10.378673+0000","last_fullsized":"2024-08-18T22:23:10.378673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:12.297162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397347+0000","last_change":"2024-08-18T22:23:08.395735+0000","last_active":"2024-08-18T22:23:08.397347+0000","last_peered":"2024-08-18T22:23:08.397347+0000","last_clean":"2024-08-18T22:23:08.397347+0000","last_became_active":"2024-08-18T22:23:08.395477+0000","last_became_peered":"2024-08-18T22:23:08.395477+0000","last_unstale":"2024-08-18T22:23:08.397347+0000","last_undegraded":"2024-08-18T22:23:08.397347+0000","last_fullsized":"2024-08-18T22:23:08.397347+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:46.358052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385633+0000","last_change":"2024-08-18T22:23:08.385633+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385633+0000","last_undegraded":"2024-08-18T22:23:08.385633+0000","last_fullsized":"2024-08-18T22:23:08.385633+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397091+0000","last_change":"2024-08-18T22:23:08.390884+0000","last_active":"2024-08-18T22:23:08.397091+0000","last_peered":"2024-08-18T22:23:08.397091+0000","last_clean":"2024-08-18T22:23:08.397091+0000","last_became_active":"2024-08-18T22:23:08.390605+0000","last_became_peered":"2024-08-18T22:23:08.390605+0000","last_unstale":"2024-08-18T22:23:08.397091+0000","last_undegraded":"2024-08-18T22:23:08.397091+0000","last_fullsized":"2024-08-18T22:23:08.397091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:30.832117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.376017+0000","last_change":"2024-08-18T22:23:08.376017+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.376017+0000","last_undegraded":"2024-08-18T22:23:08.376017+0000","last_fullsized":"2024-08-18T22:23:08.376017+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397608+0000","last_change":"2024-08-18T22:23:08.396665+0000","last_active":"2024-08-18T22:23:08.397608+0000","last_peered":"2024-08-18T22:23:08.397608+0000","last_clean":"2024-08-18T22:23:08.397608+0000","last_became_active":"2024-08-18T22:23:08.396386+0000","last_became_peered":"2024-08-18T22:23:08.396386+0000","last_unstale":"2024-08-18T22:23:08.397608+0000","last_undegraded":"2024-08-18T22:23:08.397608+0000","last_fullsized":"2024-08-18T22:23:08.397608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:28:52.107125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376874+0000","last_change":"2024-08-18T22:23:09.390577+0000","last_active":"2024-08-18T22:23:10.376874+0000","last_peered":"2024-08-18T22:23:10.376874+0000","last_clean":"2024-08-18T22:23:10.376874+0000","last_became_active":"2024-08-18T22:23:09.390330+0000","last_became_peered":"2024-08-18T22:23:09.390330+0000","last_unstale":"2024-08-18T22:23:10.376874+0000","last_undegraded":"2024-08-18T22:23:10.376874+0000","last_fullsized":"2024-08-18T22:23:10.376874+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:05.538156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398721+0000","last_change":"2024-08-18T22:23:08.395039+0000","last_active":"2024-08-18T22:23:08.398721+0000","last_peered":"2024-08-18T22:23:08.398721+0000","last_clean":"2024-08-18T22:23:08.398721+0000","last_became_active":"2024-08-18T22:23:08.390586+0000","last_became_peered":"2024-08-18T22:23:08.390586+0000","last_unstale":"2024-08-18T22:23:08.398721+0000","last_undegraded":"2024-08-18T22:23:08.398721+0000","last_fullsized":"2024-08-18T22:23:08.398721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:52.259773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377105+0000","last_change":"2024-08-18T22:23:08.377105+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377105+0000","last_undegraded":"2024-08-18T22:23:08.377105+0000","last_fullsized":"2024-08-18T22:23:08.377105+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400310+0000","last_change":"2024-08-18T22:23:08.399282+0000","last_active":"2024-08-18T22:23:08.400310+0000","last_peered":"2024-08-18T22:23:08.400310+0000","last_clean":"2024-08-18T22:23:08.400310+0000","last_became_active":"2024-08-18T22:23:08.398958+0000","last_became_peered":"2024-08-18T22:23:08.398958+0000","last_unstale":"2024-08-18T22:23:08.400310+0000","last_undegraded":"2024-08-18T22:23:08.400310+0000","last_fullsized":"2024-08-18T22:23:08.400310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:50.360086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.390818+0000","last_change":"2024-08-18T22:23:08.390818+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.390818+0000","last_undegraded":"2024-08-18T22:23:08.390818+0000","last_fullsized":"2024-08-18T22:23:08.390818+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399618+0000","last_change":"2024-08-18T22:23:08.397746+0000","last_active":"2024-08-18T22:23:08.399618+0000","last_peered":"2024-08-18T22:23:08.399618+0000","last_clean":"2024-08-18T22:23:08.399618+0000","last_became_active":"2024-08-18T22:23:08.397305+0000","last_became_peered":"2024-08-18T22:23:08.397305+0000","last_unstale":"2024-08-18T22:23:08.399618+0000","last_undegraded":"2024-08-18T22:23:08.399618+0000","last_fullsized":"2024-08-18T22:23:08.399618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:10.981993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378196+0000","last_change":"2024-08-18T22:23:08.378196+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378196+0000","last_undegraded":"2024-08-18T22:23:08.378196+0000","last_fullsized":"2024-08-18T22:23:08.378196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.395398+0000","last_change":"2024-08-18T22:23:08.393396+0000","last_active":"2024-08-18T22:23:08.395398+0000","last_peered":"2024-08-18T22:23:08.395398+0000","last_clean":"2024-08-18T22:23:08.395398+0000","last_became_active":"2024-08-18T22:23:08.393124+0000","last_became_peered":"2024-08-18T22:23:08.393124+0000","last_unstale":"2024-08-18T22:23:08.395398+0000","last_undegraded":"2024-08-18T22:23:08.395398+0000","last_fullsized":"2024-08-18T22:23:08.395398+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:45:40.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377628+0000","last_change":"2024-08-18T22:23:08.377628+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377628+0000","last_undegraded":"2024-08-18T22:23:08.377628+0000","last_fullsized":"2024-08-18T22:23:08.377628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.395706+0000","last_change":"2024-08-18T22:23:08.393152+0000","last_active":"2024-08-18T22:23:08.395706+0000","last_peered":"2024-08-18T22:23:08.395706+0000","last_clean":"2024-08-18T22:23:08.395706+0000","last_became_active":"2024-08-18T22:23:08.392860+0000","last_became_peered":"2024-08-18T22:23:08.392860+0000","last_unstale":"2024-08-18T22:23:08.395706+0000","last_undegraded":"2024-08-18T22:23:08.395706+0000","last_fullsized":"2024-08-18T22:23:08.395706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:14.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378339+0000","last_change":"2024-08-18T22:23:08.378339+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378339+0000","last_undegraded":"2024-08-18T22:23:08.378339+0000","last_fullsized":"2024-08-18T22:23:08.378339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378791+0000","last_change":"2024-08-18T22:23:08.390558+0000","last_active":"2024-08-18T22:23:10.378791+0000","last_peered":"2024-08-18T22:23:10.378791+0000","last_clean":"2024-08-18T22:23:10.378791+0000","last_became_active":"2024-08-18T22:23:08.389931+0000","last_became_peered":"2024-08-18T22:23:08.389931+0000","last_unstale":"2024-08-18T22:23:10.378791+0000","last_undegraded":"2024-08-18T22:23:10.378791+0000","last_fullsized":"2024-08-18T22:23:10.378791+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:42.339748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386741+0000","last_change":"2024-08-18T22:23:08.386741+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386741+0000","last_undegraded":"2024-08-18T22:23:08.386741+0000","last_fullsized":"2024-08-18T22:23:08.386741+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394701+0000","last_change":"2024-08-18T22:23:08.391640+0000","last_active":"2024-08-18T22:23:08.394701+0000","last_peered":"2024-08-18T22:23:08.394701+0000","last_clean":"2024-08-18T22:23:08.394701+0000","last_became_active":"2024-08-18T22:23:08.391377+0000","last_became_peered":"2024-08-18T22:23:08.391377+0000","last_unstale":"2024-08-18T22:23:08.394701+0000","last_undegraded":"2024-08-18T22:23:08.394701+0000","last_fullsized":"2024-08-18T22:23:08.394701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:43.009084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379015+0000","last_change":"2024-08-18T22:23:09.394815+0000","last_active":"2024-08-18T22:23:10.379015+0000","last_peered":"2024-08-18T22:23:10.379015+0000","last_clean":"2024-08-18T22:23:10.379015+0000","last_became_active":"2024-08-18T22:23:09.391502+0000","last_became_peered":"2024-08-18T22:23:09.391502+0000","last_unstale":"2024-08-18T22:23:10.379015+0000","last_undegraded":"2024-08-18T22:23:10.379015+0000","last_fullsized":"2024-08-18T22:23:10.379015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:42.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.390750+0000","last_change":"2024-08-18T22:23:08.382205+0000","last_active":"2024-08-18T22:23:08.390750+0000","last_peered":"2024-08-18T22:23:08.390750+0000","last_clean":"2024-08-18T22:23:08.390750+0000","last_became_active":"2024-08-18T22:23:08.381817+0000","last_became_peered":"2024-08-18T22:23:08.381817+0000","last_unstale":"2024-08-18T22:23:08.390750+0000","last_undegraded":"2024-08-18T22:23:08.390750+0000","last_fullsized":"2024-08-18T22:23:08.390750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:23.253295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377624+0000","last_change":"2024-08-18T22:23:09.385959+0000","last_active":"2024-08-18T22:23:10.377624+0000","last_peered":"2024-08-18T22:23:10.377624+0000","last_clean":"2024-08-18T22:23:10.377624+0000","last_became_active":"2024-08-18T22:23:09.385743+0000","last_became_peered":"2024-08-18T22:23:09.385743+0000","last_unstale":"2024-08-18T22:23:10.377624+0000","last_undegraded":"2024-08-18T22:23:10.377624+0000","last_fullsized":"2024-08-18T22:23:10.377624+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:44:47.120395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400736+0000","last_change":"2024-08-18T22:23:08.395722+0000","last_active":"2024-08-18T22:23:08.400736+0000","last_peered":"2024-08-18T22:23:08.400736+0000","last_clean":"2024-08-18T22:23:08.400736+0000","last_became_active":"2024-08-18T22:23:08.395423+0000","last_became_peered":"2024-08-18T22:23:08.395423+0000","last_unstale":"2024-08-18T22:23:08.400736+0000","last_undegraded":"2024-08-18T22:23:08.400736+0000","last_fullsized":"2024-08-18T22:23:08.400736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:59.063303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381691+0000","last_change":"2024-08-18T22:23:08.381691+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381691+0000","last_undegraded":"2024-08-18T22:23:08.381691+0000","last_fullsized":"2024-08-18T22:23:08.381691+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394708+0000","last_change":"2024-08-18T22:23:08.391632+0000","last_active":"2024-08-18T22:23:08.394708+0000","last_peered":"2024-08-18T22:23:08.394708+0000","last_clean":"2024-08-18T22:23:08.394708+0000","last_became_active":"2024-08-18T22:23:08.391350+0000","last_became_peered":"2024-08-18T22:23:08.391350+0000","last_unstale":"2024-08-18T22:23:08.394708+0000","last_undegraded":"2024-08-18T22:23:08.394708+0000","last_fullsized":"2024-08-18T22:23:08.394708+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:43.009084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.389670+0000","last_change":"2024-08-18T22:23:08.389670+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.389670+0000","last_undegraded":"2024-08-18T22:23:08.389670+0000","last_fullsized":"2024-08-18T22:23:08.389670+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.393053+0000","last_change":"2024-08-18T22:23:08.388076+0000","last_active":"2024-08-18T22:23:08.393053+0000","last_peered":"2024-08-18T22:23:08.393053+0000","last_clean":"2024-08-18T22:23:08.393053+0000","last_became_active":"2024-08-18T22:23:08.387745+0000","last_became_peered":"2024-08-18T22:23:08.387745+0000","last_unstale":"2024-08-18T22:23:08.393053+0000","last_undegraded":"2024-08-18T22:23:08.393053+0000","last_fullsized":"2024-08-18T22:23:08.393053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:07.998922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377058+0000","last_change":"2024-08-18T22:23:08.377058+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377058+0000","last_undegraded":"2024-08-18T22:23:08.377058+0000","last_fullsized":"2024-08-18T22:23:08.377058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377736+0000","last_change":"2024-08-18T22:23:08.384953+0000","last_active":"2024-08-18T22:23:10.377736+0000","last_peered":"2024-08-18T22:23:10.377736+0000","last_clean":"2024-08-18T22:23:10.377736+0000","last_became_active":"2024-08-18T22:23:08.384684+0000","last_became_peered":"2024-08-18T22:23:08.384684+0000","last_unstale":"2024-08-18T22:23:10.377736+0000","last_undegraded":"2024-08-18T22:23:10.377736+0000","last_fullsized":"2024-08-18T22:23:10.377736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:22:31.028819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.376243+0000","last_change":"2024-08-18T22:23:08.376243+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.376243+0000","last_undegraded":"2024-08-18T22:23:08.376243+0000","last_fullsized":"2024-08-18T22:23:08.376243+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394606+0000","last_change":"2024-08-18T22:23:08.391894+0000","last_active":"2024-08-18T22:23:08.394606+0000","last_peered":"2024-08-18T22:23:08.394606+0000","last_clean":"2024-08-18T22:23:08.394606+0000","last_became_active":"2024-08-18T22:23:08.391616+0000","last_became_peered":"2024-08-18T22:23:08.391616+0000","last_unstale":"2024-08-18T22:23:08.394606+0000","last_undegraded":"2024-08-18T22:23:08.394606+0000","last_fullsized":"2024-08-18T22:23:08.394606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:14.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.384174+0000","last_change":"2024-08-18T22:23:08.384174+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.384174+0000","last_undegraded":"2024-08-18T22:23:08.384174+0000","last_fullsized":"2024-08-18T22:23:08.384174+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398240+0000","last_change":"2024-08-18T22:23:08.394584+0000","last_active":"2024-08-18T22:23:08.398240+0000","last_peered":"2024-08-18T22:23:08.398240+0000","last_clean":"2024-08-18T22:23:08.398240+0000","last_became_active":"2024-08-18T22:23:08.394230+0000","last_became_peered":"2024-08-18T22:23:08.394230+0000","last_unstale":"2024-08-18T22:23:08.398240+0000","last_undegraded":"2024-08-18T22:23:08.398240+0000","last_fullsized":"2024-08-18T22:23:08.398240+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:54.525986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378753+0000","last_change":"2024-08-18T22:23:09.406775+0000","last_active":"2024-08-18T22:23:10.378753+0000","last_peered":"2024-08-18T22:23:10.378753+0000","last_clean":"2024-08-18T22:23:10.378753+0000","last_became_active":"2024-08-18T22:23:09.402616+0000","last_became_peered":"2024-08-18T22:23:09.402616+0000","last_unstale":"2024-08-18T22:23:10.378753+0000","last_undegraded":"2024-08-18T22:23:10.378753+0000","last_fullsized":"2024-08-18T22:23:10.378753+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:29.447896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394723+0000","last_change":"2024-08-18T22:23:08.392035+0000","last_active":"2024-08-18T22:23:08.394723+0000","last_peered":"2024-08-18T22:23:08.394723+0000","last_clean":"2024-08-18T22:23:08.394723+0000","last_became_active":"2024-08-18T22:23:08.391621+0000","last_became_peered":"2024-08-18T22:23:08.391621+0000","last_unstale":"2024-08-18T22:23:08.394723+0000","last_undegraded":"2024-08-18T22:23:08.394723+0000","last_fullsized":"2024-08-18T22:23:08.394723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:05.935611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.387403+0000","last_change":"2024-08-18T22:23:08.387403+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.387403+0000","last_undegraded":"2024-08-18T22:23:08.387403+0000","last_fullsized":"2024-08-18T22:23:08.387403+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.388888+0000","last_change":"2024-08-18T22:23:08.385515+0000","last_active":"2024-08-18T22:23:08.388888+0000","last_peered":"2024-08-18T22:23:08.388888+0000","last_clean":"2024-08-18T22:23:08.388888+0000","last_became_active":"2024-08-18T22:23:08.385221+0000","last_became_peered":"2024-08-18T22:23:08.385221+0000","last_unstale":"2024-08-18T22:23:08.388888+0000","last_undegraded":"2024-08-18T22:23:08.388888+0000","last_fullsized":"2024-08-18T22:23:08.388888+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:02.573262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381329+0000","last_change":"2024-08-18T22:23:08.381329+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381329+0000","last_undegraded":"2024-08-18T22:23:08.381329+0000","last_fullsized":"2024-08-18T22:23:08.381329+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400409+0000","last_change":"2024-08-18T22:23:08.399434+0000","last_active":"2024-08-18T22:23:08.400409+0000","last_peered":"2024-08-18T22:23:08.400409+0000","last_clean":"2024-08-18T22:23:08.400409+0000","last_became_active":"2024-08-18T22:23:08.398753+0000","last_became_peered":"2024-08-18T22:23:08.398753+0000","last_unstale":"2024-08-18T22:23:08.400409+0000","last_undegraded":"2024-08-18T22:23:08.400409+0000","last_fullsized":"2024-08-18T22:23:08.400409+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:14.567719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381170+0000","last_change":"2024-08-18T22:23:08.381170+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381170+0000","last_undegraded":"2024-08-18T22:23:08.381170+0000","last_fullsized":"2024-08-18T22:23:08.381170+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394765+0000","last_change":"2024-08-18T22:23:08.391747+0000","last_active":"2024-08-18T22:23:08.394765+0000","last_peered":"2024-08-18T22:23:08.394765+0000","last_clean":"2024-08-18T22:23:08.394765+0000","last_became_active":"2024-08-18T22:23:08.391425+0000","last_became_peered":"2024-08-18T22:23:08.391425+0000","last_unstale":"2024-08-18T22:23:08.394765+0000","last_undegraded":"2024-08-18T22:23:08.394765+0000","last_fullsized":"2024-08-18T22:23:08.394765+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:05.935611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385306+0000","last_change":"2024-08-18T22:23:08.385306+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385306+0000","last_undegraded":"2024-08-18T22:23:08.385306+0000","last_fullsized":"2024-08-18T22:23:08.385306+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397144+0000","last_change":"2024-08-18T22:23:08.391816+0000","last_active":"2024-08-18T22:23:08.397144+0000","last_peered":"2024-08-18T22:23:08.397144+0000","last_clean":"2024-08-18T22:23:08.397144+0000","last_became_active":"2024-08-18T22:23:08.391406+0000","last_became_peered":"2024-08-18T22:23:08.391406+0000","last_unstale":"2024-08-18T22:23:08.397144+0000","last_undegraded":"2024-08-18T22:23:08.397144+0000","last_fullsized":"2024-08-18T22:23:08.397144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:18.572969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.382712+0000","last_change":"2024-08-18T22:23:08.382712+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.382712+0000","last_undegraded":"2024-08-18T22:23:08.382712+0000","last_fullsized":"2024-08-18T22:23:08.382712+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.393416+0000","last_change":"2024-08-18T22:23:08.388283+0000","last_active":"2024-08-18T22:23:08.393416+0000","last_peered":"2024-08-18T22:23:08.393416+0000","last_clean":"2024-08-18T22:23:08.393416+0000","last_became_active":"2024-08-18T22:23:08.387990+0000","last_became_peered":"2024-08-18T22:23:08.387990+0000","last_unstale":"2024-08-18T22:23:08.393416+0000","last_undegraded":"2024-08-18T22:23:08.393416+0000","last_fullsized":"2024-08-18T22:23:08.393416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:07.998922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377137+0000","last_change":"2024-08-18T22:23:09.416113+0000","last_active":"2024-08-18T22:23:10.377137+0000","last_peered":"2024-08-18T22:23:10.377137+0000","last_clean":"2024-08-18T22:23:10.377137+0000","last_became_active":"2024-08-18T22:23:09.415833+0000","last_became_peered":"2024-08-18T22:23:09.415833+0000","last_unstale":"2024-08-18T22:23:10.377137+0000","last_undegraded":"2024-08-18T22:23:10.377137+0000","last_fullsized":"2024-08-18T22:23:10.377137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:31:02.876930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394274+0000","last_change":"2024-08-18T22:23:08.390232+0000","last_active":"2024-08-18T22:23:08.394274+0000","last_peered":"2024-08-18T22:23:08.394274+0000","last_clean":"2024-08-18T22:23:08.394274+0000","last_became_active":"2024-08-18T22:23:08.389799+0000","last_became_peered":"2024-08-18T22:23:08.389799+0000","last_unstale":"2024-08-18T22:23:08.394274+0000","last_undegraded":"2024-08-18T22:23:08.394274+0000","last_fullsized":"2024-08-18T22:23:08.394274+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:49.234560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380011+0000","last_change":"2024-08-18T22:23:08.380011+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380011+0000","last_undegraded":"2024-08-18T22:23:08.380011+0000","last_fullsized":"2024-08-18T22:23:08.380011+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397063+0000","last_change":"2024-08-18T22:23:08.390855+0000","last_active":"2024-08-18T22:23:08.397063+0000","last_peered":"2024-08-18T22:23:08.397063+0000","last_clean":"2024-08-18T22:23:08.397063+0000","last_became_active":"2024-08-18T22:23:08.390531+0000","last_became_peered":"2024-08-18T22:23:08.390531+0000","last_unstale":"2024-08-18T22:23:08.397063+0000","last_undegraded":"2024-08-18T22:23:08.397063+0000","last_fullsized":"2024-08-18T22:23:08.397063+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:16:46.918953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.384431+0000","last_change":"2024-08-18T22:23:08.384431+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.384431+0000","last_undegraded":"2024-08-18T22:23:08.384431+0000","last_fullsized":"2024-08-18T22:23:08.384431+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.392709+0000","last_change":"2024-08-18T22:23:08.391499+0000","last_active":"2024-08-18T22:23:08.392709+0000","last_peered":"2024-08-18T22:23:08.392709+0000","last_clean":"2024-08-18T22:23:08.392709+0000","last_became_active":"2024-08-18T22:23:08.391180+0000","last_became_peered":"2024-08-18T22:23:08.391180+0000","last_unstale":"2024-08-18T22:23:08.392709+0000","last_undegraded":"2024-08-18T22:23:08.392709+0000","last_fullsized":"2024-08-18T22:23:08.392709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:00.485578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386323+0000","last_change":"2024-08-18T22:23:08.386323+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386323+0000","last_undegraded":"2024-08-18T22:23:08.386323+0000","last_fullsized":"2024-08-18T22:23:08.386323+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394100+0000","last_change":"2024-08-18T22:23:08.390531+0000","last_active":"2024-08-18T22:23:08.394100+0000","last_peered":"2024-08-18T22:23:08.394100+0000","last_clean":"2024-08-18T22:23:08.394100+0000","last_became_active":"2024-08-18T22:23:08.390244+0000","last_became_peered":"2024-08-18T22:23:08.390244+0000","last_unstale":"2024-08-18T22:23:08.394100+0000","last_undegraded":"2024-08-18T22:23:08.394100+0000","last_fullsized":"2024-08-18T22:23:08.394100+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:49.234560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378005+0000","last_change":"2024-08-18T22:23:09.385451+0000","last_active":"2024-08-18T22:23:10.378005+0000","last_peered":"2024-08-18T22:23:10.378005+0000","last_clean":"2024-08-18T22:23:10.378005+0000","last_became_active":"2024-08-18T22:23:09.385180+0000","last_became_peered":"2024-08-18T22:23:09.385180+0000","last_unstale":"2024-08-18T22:23:10.378005+0000","last_undegraded":"2024-08-18T22:23:10.378005+0000","last_fullsized":"2024-08-18T22:23:10.378005+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:30.197348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399161+0000","last_change":"2024-08-18T22:23:08.395413+0000","last_active":"2024-08-18T22:23:08.399161+0000","last_peered":"2024-08-18T22:23:08.399161+0000","last_clean":"2024-08-18T22:23:08.399161+0000","last_became_active":"2024-08-18T22:23:08.394853+0000","last_became_peered":"2024-08-18T22:23:08.394853+0000","last_unstale":"2024-08-18T22:23:08.399161+0000","last_undegraded":"2024-08-18T22:23:08.399161+0000","last_fullsized":"2024-08-18T22:23:08.399161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:40.966159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377294+0000","last_change":"2024-08-18T22:23:08.377294+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377294+0000","last_undegraded":"2024-08-18T22:23:08.377294+0000","last_fullsized":"2024-08-18T22:23:08.377294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399640+0000","last_change":"2024-08-18T22:23:08.397936+0000","last_active":"2024-08-18T22:23:08.399640+0000","last_peered":"2024-08-18T22:23:08.399640+0000","last_clean":"2024-08-18T22:23:08.399640+0000","last_became_active":"2024-08-18T22:23:08.397588+0000","last_became_peered":"2024-08-18T22:23:08.397588+0000","last_unstale":"2024-08-18T22:23:08.399640+0000","last_undegraded":"2024-08-18T22:23:08.399640+0000","last_fullsized":"2024-08-18T22:23:08.399640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:13.990634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377070+0000","last_change":"2024-08-18T22:23:09.400184+0000","last_active":"2024-08-18T22:23:10.377070+0000","last_peered":"2024-08-18T22:23:10.377070+0000","last_clean":"2024-08-18T22:23:10.377070+0000","last_became_active":"2024-08-18T22:23:09.399916+0000","last_became_peered":"2024-08-18T22:23:09.399916+0000","last_unstale":"2024-08-18T22:23:10.377070+0000","last_undegraded":"2024-08-18T22:23:10.377070+0000","last_fullsized":"2024-08-18T22:23:10.377070+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:47.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398926+0000","last_change":"2024-08-18T22:23:08.395341+0000","last_active":"2024-08-18T22:23:08.398926+0000","last_peered":"2024-08-18T22:23:08.398926+0000","last_clean":"2024-08-18T22:23:08.398926+0000","last_became_active":"2024-08-18T22:23:08.395079+0000","last_became_peered":"2024-08-18T22:23:08.395079+0000","last_unstale":"2024-08-18T22:23:08.398926+0000","last_undegraded":"2024-08-18T22:23:08.398926+0000","last_fullsized":"2024-08-18T22:23:08.398926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:44.730118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.388065+0000","last_change":"2024-08-18T22:23:08.388065+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.388065+0000","last_undegraded":"2024-08-18T22:23:08.388065+0000","last_fullsized":"2024-08-18T22:23:08.388065+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.390965+0000","last_change":"2024-08-18T22:23:08.389367+0000","last_active":"2024-08-18T22:23:08.390965+0000","last_peered":"2024-08-18T22:23:08.390965+0000","last_clean":"2024-08-18T22:23:08.390965+0000","last_became_active":"2024-08-18T22:23:08.389090+0000","last_became_peered":"2024-08-18T22:23:08.389090+0000","last_unstale":"2024-08-18T22:23:08.390965+0000","last_undegraded":"2024-08-18T22:23:08.390965+0000","last_fullsized":"2024-08-18T22:23:08.390965+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:45.554618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":260,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.378100+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:23:08.378100+0000","last_peered":"2024-08-18T22:23:08.378100+0000","last_clean":"2024-08-18T22:23:08.378100+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:23:08.378100+0000","last_undegraded":"2024-08-18T22:23:08.378100+0000","last_fullsized":"2024-08-18T22:23:08.378100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36684,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335156,"statfs":{"total":96636764160,"available":96599199744,"internally_reserved":0,"allocated":1372160,"data_stored":940913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40248,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331592,"statfs":{"total":96636764160,"available":96595550208,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40252,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331588,"statfs":{"total":96636764160,"available":96595546112,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40828,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331012,"statfs":{"total":96636764160,"available":96594956288,"internally_reserved":0,"allocated":1359872,"data_stored":934254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":815104,"data_stored":366016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36120,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335720,"statfs":{"total":96636764160,"available":96599777280,"internally_reserved":0,"allocated":790528,"data_stored":357712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:23:14.317 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3f is not active+clean 2024-08-18T22:23:14.317 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.379544+0000', 'last_change': '2024-08-18T22:23:08.379544+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.379544+0000', 'last_undegraded': '2024-08-18T22:23:08.379544+0000', 'last_fullsized': '2024-08-18T22:23:08.379544+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:14.317 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3e is not active+clean 2024-08-18T22:23:14.317 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.379610+0000', 'last_change': '2024-08-18T22:23:08.379610+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.379610+0000', 'last_undegraded': '2024-08-18T22:23:08.379610+0000', 'last_fullsized': '2024-08-18T22:23:08.379610+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:14.317 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3d is not active+clean 2024-08-18T22:23:14.317 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.377622+0000', 'last_change': '2024-08-18T22:23:08.377622+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.377622+0000', 'last_undegraded': '2024-08-18T22:23:08.377622+0000', 'last_fullsized': '2024-08-18T22:23:08.377622+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:14.317 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3b is not active+clean 2024-08-18T22:23:14.317 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.388498+0000', 'last_change': '2024-08-18T22:23:08.388498+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.388498+0000', 'last_undegraded': '2024-08-18T22:23:08.388498+0000', 'last_fullsized': '2024-08-18T22:23:08.388498+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.318 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3a is not active+clean 2024-08-18T22:23:14.318 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.380971+0000', 'last_change': '2024-08-18T22:23:08.380971+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.380971+0000', 'last_undegraded': '2024-08-18T22:23:08.380971+0000', 'last_fullsized': '2024-08-18T22:23:08.380971+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:14.318 INFO:tasks.ceph.ceph_manager.ceph:PG 10.38 is not active+clean 2024-08-18T22:23:14.318 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.379653+0000', 'last_change': '2024-08-18T22:23:08.379653+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.379653+0000', 'last_undegraded': '2024-08-18T22:23:08.379653+0000', 'last_fullsized': '2024-08-18T22:23:08.379653+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:14.318 INFO:tasks.ceph.ceph_manager.ceph:PG 10.37 is not active+clean 2024-08-18T22:23:14.318 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.375590+0000', 'last_change': '2024-08-18T22:23:08.375590+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.375590+0000', 'last_undegraded': '2024-08-18T22:23:08.375590+0000', 'last_fullsized': '2024-08-18T22:23:08.375590+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:14.318 INFO:tasks.ceph.ceph_manager.ceph:PG 10.36 is not active+clean 2024-08-18T22:23:14.318 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.377182+0000', 'last_change': '2024-08-18T22:23:08.377182+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.377182+0000', 'last_undegraded': '2024-08-18T22:23:08.377182+0000', 'last_fullsized': '2024-08-18T22:23:08.377182+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:14.318 INFO:tasks.ceph.ceph_manager.ceph:PG 10.34 is not active+clean 2024-08-18T22:23:14.318 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.380357+0000', 'last_change': '2024-08-18T22:23:08.380357+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.380357+0000', 'last_undegraded': '2024-08-18T22:23:08.380357+0000', 'last_fullsized': '2024-08-18T22:23:08.380357+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:14.318 INFO:tasks.ceph.ceph_manager.ceph:PG 10.33 is not active+clean 2024-08-18T22:23:14.319 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.381798+0000', 'last_change': '2024-08-18T22:23:08.381798+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.381798+0000', 'last_undegraded': '2024-08-18T22:23:08.381798+0000', 'last_fullsized': '2024-08-18T22:23:08.381798+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:14.319 INFO:tasks.ceph.ceph_manager.ceph:PG 10.32 is not active+clean 2024-08-18T22:23:14.319 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.374132+0000', 'last_change': '2024-08-18T22:23:08.374132+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.374132+0000', 'last_undegraded': '2024-08-18T22:23:08.374132+0000', 'last_fullsized': '2024-08-18T22:23:08.374132+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:14.319 INFO:tasks.ceph.ceph_manager.ceph:PG 10.31 is not active+clean 2024-08-18T22:23:14.319 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.374384+0000', 'last_change': '2024-08-18T22:23:08.374384+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.374384+0000', 'last_undegraded': '2024-08-18T22:23:08.374384+0000', 'last_fullsized': '2024-08-18T22:23:08.374384+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:14.319 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2f is not active+clean 2024-08-18T22:23:14.319 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.377153+0000', 'last_change': '2024-08-18T22:23:08.377153+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.377153+0000', 'last_undegraded': '2024-08-18T22:23:08.377153+0000', 'last_fullsized': '2024-08-18T22:23:08.377153+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:14.319 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2d is not active+clean 2024-08-18T22:23:14.319 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.386571+0000', 'last_change': '2024-08-18T22:23:08.386571+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.386571+0000', 'last_undegraded': '2024-08-18T22:23:08.386571+0000', 'last_fullsized': '2024-08-18T22:23:08.386571+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.319 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2c is not active+clean 2024-08-18T22:23:14.319 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.378280+0000', 'last_change': '2024-08-18T22:23:08.378280+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.378280+0000', 'last_undegraded': '2024-08-18T22:23:08.378280+0000', 'last_fullsized': '2024-08-18T22:23:08.378280+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:23:14.320 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2b is not active+clean 2024-08-18T22:23:14.320 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.380722+0000', 'last_change': '2024-08-18T22:23:08.380722+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.380722+0000', 'last_undegraded': '2024-08-18T22:23:08.380722+0000', 'last_fullsized': '2024-08-18T22:23:08.380722+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:14.320 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2a is not active+clean 2024-08-18T22:23:14.320 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.379817+0000', 'last_change': '2024-08-18T22:23:08.379817+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.379817+0000', 'last_undegraded': '2024-08-18T22:23:08.379817+0000', 'last_fullsized': '2024-08-18T22:23:08.379817+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:23:14.320 INFO:tasks.ceph.ceph_manager.ceph:PG 10.29 is not active+clean 2024-08-18T22:23:14.320 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.379291+0000', 'last_change': '2024-08-18T22:23:08.379291+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.379291+0000', 'last_undegraded': '2024-08-18T22:23:08.379291+0000', 'last_fullsized': '2024-08-18T22:23:08.379291+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:23:14.320 INFO:tasks.ceph.ceph_manager.ceph:PG 10.28 is not active+clean 2024-08-18T22:23:14.320 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.375422+0000', 'last_change': '2024-08-18T22:23:08.375422+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.375422+0000', 'last_undegraded': '2024-08-18T22:23:08.375422+0000', 'last_fullsized': '2024-08-18T22:23:08.375422+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:14.320 INFO:tasks.ceph.ceph_manager.ceph:PG 10.27 is not active+clean 2024-08-18T22:23:14.320 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.380267+0000', 'last_change': '2024-08-18T22:23:08.380267+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.380267+0000', 'last_undegraded': '2024-08-18T22:23:08.380267+0000', 'last_fullsized': '2024-08-18T22:23:08.380267+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:14.320 INFO:tasks.ceph.ceph_manager.ceph:PG 10.26 is not active+clean 2024-08-18T22:23:14.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.380461+0000', 'last_change': '2024-08-18T22:23:08.380461+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.380461+0000', 'last_undegraded': '2024-08-18T22:23:08.380461+0000', 'last_fullsized': '2024-08-18T22:23:08.380461+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:14.321 INFO:tasks.ceph.ceph_manager.ceph:PG 10.24 is not active+clean 2024-08-18T22:23:14.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.378078+0000', 'last_change': '2024-08-18T22:23:08.378078+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.378078+0000', 'last_undegraded': '2024-08-18T22:23:08.378078+0000', 'last_fullsized': '2024-08-18T22:23:08.378078+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:14.321 INFO:tasks.ceph.ceph_manager.ceph:PG 10.23 is not active+clean 2024-08-18T22:23:14.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.375798+0000', 'last_change': '2024-08-18T22:23:08.375798+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.375798+0000', 'last_undegraded': '2024-08-18T22:23:08.375798+0000', 'last_fullsized': '2024-08-18T22:23:08.375798+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:14.321 INFO:tasks.ceph.ceph_manager.ceph:PG 10.22 is not active+clean 2024-08-18T22:23:14.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.380964+0000', 'last_change': '2024-08-18T22:23:08.380964+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.380964+0000', 'last_undegraded': '2024-08-18T22:23:08.380964+0000', 'last_fullsized': '2024-08-18T22:23:08.380964+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:14.321 INFO:tasks.ceph.ceph_manager.ceph:PG 10.20 is not active+clean 2024-08-18T22:23:14.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.382343+0000', 'last_change': '2024-08-18T22:23:08.382343+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.382343+0000', 'last_undegraded': '2024-08-18T22:23:08.382343+0000', 'last_fullsized': '2024-08-18T22:23:08.382343+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:14.321 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1c is not active+clean 2024-08-18T22:23:14.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.385161+0000', 'last_change': '2024-08-18T22:23:08.385161+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.385161+0000', 'last_undegraded': '2024-08-18T22:23:08.385161+0000', 'last_fullsized': '2024-08-18T22:23:08.385161+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.322 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1e is not active+clean 2024-08-18T22:23:14.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.385633+0000', 'last_change': '2024-08-18T22:23:08.385633+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.385633+0000', 'last_undegraded': '2024-08-18T22:23:08.385633+0000', 'last_fullsized': '2024-08-18T22:23:08.385633+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:14.322 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1f is not active+clean 2024-08-18T22:23:14.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.376017+0000', 'last_change': '2024-08-18T22:23:08.376017+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.376017+0000', 'last_undegraded': '2024-08-18T22:23:08.376017+0000', 'last_fullsized': '2024-08-18T22:23:08.376017+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:14.322 INFO:tasks.ceph.ceph_manager.ceph:PG 10.19 is not active+clean 2024-08-18T22:23:14.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.377105+0000', 'last_change': '2024-08-18T22:23:08.377105+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.377105+0000', 'last_undegraded': '2024-08-18T22:23:08.377105+0000', 'last_fullsized': '2024-08-18T22:23:08.377105+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:14.322 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1a is not active+clean 2024-08-18T22:23:14.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.390818+0000', 'last_change': '2024-08-18T22:23:08.390818+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.390818+0000', 'last_undegraded': '2024-08-18T22:23:08.390818+0000', 'last_fullsized': '2024-08-18T22:23:08.390818+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.322 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1b is not active+clean 2024-08-18T22:23:14.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.378196+0000', 'last_change': '2024-08-18T22:23:08.378196+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.378196+0000', 'last_undegraded': '2024-08-18T22:23:08.378196+0000', 'last_fullsized': '2024-08-18T22:23:08.378196+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:23:14.322 INFO:tasks.ceph.ceph_manager.ceph:PG 10.14 is not active+clean 2024-08-18T22:23:14.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.377628+0000', 'last_change': '2024-08-18T22:23:08.377628+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.377628+0000', 'last_undegraded': '2024-08-18T22:23:08.377628+0000', 'last_fullsized': '2024-08-18T22:23:08.377628+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:14.323 INFO:tasks.ceph.ceph_manager.ceph:PG 10.15 is not active+clean 2024-08-18T22:23:14.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.378339+0000', 'last_change': '2024-08-18T22:23:08.378339+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.378339+0000', 'last_undegraded': '2024-08-18T22:23:08.378339+0000', 'last_fullsized': '2024-08-18T22:23:08.378339+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:23:14.323 INFO:tasks.ceph.ceph_manager.ceph:PG 10.16 is not active+clean 2024-08-18T22:23:14.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.386741+0000', 'last_change': '2024-08-18T22:23:08.386741+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.386741+0000', 'last_undegraded': '2024-08-18T22:23:08.386741+0000', 'last_fullsized': '2024-08-18T22:23:08.386741+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.323 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-08-18T22:23:14.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.381691+0000', 'last_change': '2024-08-18T22:23:08.381691+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.381691+0000', 'last_undegraded': '2024-08-18T22:23:08.381691+0000', 'last_fullsized': '2024-08-18T22:23:08.381691+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:14.323 INFO:tasks.ceph.ceph_manager.ceph:PG 10.12 is not active+clean 2024-08-18T22:23:14.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.389670+0000', 'last_change': '2024-08-18T22:23:08.389670+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.389670+0000', 'last_undegraded': '2024-08-18T22:23:08.389670+0000', 'last_fullsized': '2024-08-18T22:23:08.389670+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.323 INFO:tasks.ceph.ceph_manager.ceph:PG 10.13 is not active+clean 2024-08-18T22:23:14.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.377058+0000', 'last_change': '2024-08-18T22:23:08.377058+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.377058+0000', 'last_undegraded': '2024-08-18T22:23:08.377058+0000', 'last_fullsized': '2024-08-18T22:23:08.377058+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:PG 10.c is not active+clean 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.376243+0000', 'last_change': '2024-08-18T22:23:08.376243+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.376243+0000', 'last_undegraded': '2024-08-18T22:23:08.376243+0000', 'last_fullsized': '2024-08-18T22:23:08.376243+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:PG 10.d is not active+clean 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.384174+0000', 'last_change': '2024-08-18T22:23:08.384174+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.384174+0000', 'last_undegraded': '2024-08-18T22:23:08.384174+0000', 'last_fullsized': '2024-08-18T22:23:08.384174+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.387403+0000', 'last_change': '2024-08-18T22:23:08.387403+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.387403+0000', 'last_undegraded': '2024-08-18T22:23:08.387403+0000', 'last_fullsized': '2024-08-18T22:23:08.387403+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:PG 10.8 is not active+clean 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.381329+0000', 'last_change': '2024-08-18T22:23:08.381329+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.381329+0000', 'last_undegraded': '2024-08-18T22:23:08.381329+0000', 'last_fullsized': '2024-08-18T22:23:08.381329+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.381170+0000', 'last_change': '2024-08-18T22:23:08.381170+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.381170+0000', 'last_undegraded': '2024-08-18T22:23:08.381170+0000', 'last_fullsized': '2024-08-18T22:23:08.381170+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:PG 10.a is not active+clean 2024-08-18T22:23:14.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.385306+0000', 'last_change': '2024-08-18T22:23:08.385306+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.385306+0000', 'last_undegraded': '2024-08-18T22:23:08.385306+0000', 'last_fullsized': '2024-08-18T22:23:08.385306+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:PG 10.4 is not active+clean 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.382712+0000', 'last_change': '2024-08-18T22:23:08.382712+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.382712+0000', 'last_undegraded': '2024-08-18T22:23:08.382712+0000', 'last_fullsized': '2024-08-18T22:23:08.382712+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.380011+0000', 'last_change': '2024-08-18T22:23:08.380011+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.380011+0000', 'last_undegraded': '2024-08-18T22:23:08.380011+0000', 'last_fullsized': '2024-08-18T22:23:08.380011+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.384431+0000', 'last_change': '2024-08-18T22:23:08.384431+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.384431+0000', 'last_undegraded': '2024-08-18T22:23:08.384431+0000', 'last_fullsized': '2024-08-18T22:23:08.384431+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:PG 10.0 is not active+clean 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.386323+0000', 'last_change': '2024-08-18T22:23:08.386323+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.386323+0000', 'last_undegraded': '2024-08-18T22:23:08.386323+0000', 'last_fullsized': '2024-08-18T22:23:08.386323+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2 is not active+clean 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.377294+0000', 'last_change': '2024-08-18T22:23:08.377294+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.377294+0000', 'last_undegraded': '2024-08-18T22:23:08.377294+0000', 'last_fullsized': '2024-08-18T22:23:08.377294+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:PG 10.b is not active+clean 2024-08-18T22:23:14.325 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:08.388065+0000', 'last_change': '2024-08-18T22:23:08.388065+0000', 'last_active': '2024-08-18T22:23:08.364735+0000', 'last_peered': '2024-08-18T22:23:08.364735+0000', 'last_clean': '2024-08-18T22:23:08.364735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:08.388065+0000', 'last_undegraded': '2024-08-18T22:23:08.388065+0000', 'last_fullsized': '2024-08-18T22:23:08.388065+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:08.364735+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:14.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:23:14.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85ee00640 1 Processor -- start 2024-08-18T22:23:14.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85ee00640 1 -- start start 2024-08-18T22:23:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85ee00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8580cde30 0x7fb85815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85ee00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8580ccd90 con 0x7fb8580b4510 2024-08-18T22:23:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85ee00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8580cd070 con 0x7fb85809aa40 2024-08-18T22:23:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85ee00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb8580ce770 con 0x7fb8580cde30 2024-08-18T22:23:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85e400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb8580b4510 0x7fb8580cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47240/0 (socket says 172.21.15.5:47240) 2024-08-18T22:23:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85da00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb85809aa40 0x7fb85809ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:48310/0 (socket says 172.21.15.5:48310) 2024-08-18T22:23:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85e400640 1 -- 172.21.15.5:0/4082961934 learned_addr learned my addr 172.21.15.5:0/4082961934 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:14.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85d000640 1 --2- 172.21.15.5:0/4082961934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8580cde30 0x7fb85815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb857e00640 1 -- 172.21.15.5:0/4082961934 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847434477 0 0) 0x7fb8580ccd90 con 0x7fb8580b4510 2024-08-18T22:23:14.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb857e00640 1 -- 172.21.15.5:0/4082961934 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb840003530 con 0x7fb8580b4510 2024-08-18T22:23:14.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb857e00640 1 -- 172.21.15.5:0/4082961934 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 679347007 0 0) 0x7fb8580cd070 con 0x7fb85809aa40 2024-08-18T22:23:14.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb857e00640 1 -- 172.21.15.5:0/4082961934 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8580ccd90 con 0x7fb85809aa40 2024-08-18T22:23:14.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85d000640 1 -- 172.21.15.5:0/4082961934 >> v1:172.21.15.117:6789/0 conn(0x7fb85809aa40 legacy=0x7fb85809ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85d000640 1 -- 172.21.15.5:0/4082961934 >> v1:172.21.15.5:6789/0 conn(0x7fb8580b4510 legacy=0x7fb8580cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.494+0000 7fb85d000640 1 -- 172.21.15.5:0/4082961934 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8580cd350 con 0x7fb8580cde30 2024-08-18T22:23:14.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.498+0000 7fb85d000640 1 --2- 172.21.15.5:0/4082961934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8580cde30 0x7fb85815cfe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097f0 tx=0x7fb84401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e576bfb81885091 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:14.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.498+0000 7fb857e00640 1 -- 172.21.15.5:0/4082961934 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8440b0070 con 0x7fb8580cde30 2024-08-18T22:23:14.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.498+0000 7fb857e00640 1 -- 172.21.15.5:0/4082961934 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8440ab600 con 0x7fb8580cde30 2024-08-18T22:23:14.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.498+0000 7fb857e00640 1 -- 172.21.15.5:0/4082961934 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8440ab9d0 con 0x7fb8580cde30 2024-08-18T22:23:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.498+0000 7fb85ee00640 1 -- 172.21.15.5:0/4082961934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8580cde30 msgr2=0x7fb85815cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.498+0000 7fb85ee00640 1 --2- 172.21.15.5:0/4082961934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8580cde30 0x7fb85815cfe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097f0 tx=0x7fb84401c450 comp rx=0 tx=0).stop 2024-08-18T22:23:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.498+0000 7fb85ee00640 1 -- 172.21.15.5:0/4082961934 shutdown_connections 2024-08-18T22:23:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.498+0000 7fb85ee00640 1 --2- 172.21.15.5:0/4082961934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8580cde30 0x7fb85815cfe0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.498+0000 7fb85ee00640 1 -- 172.21.15.5:0/4082961934 >> 172.21.15.5:0/4082961934 conn(0x7fb8580b3a20 msgr2=0x7fb8580b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.498+0000 7fb85ee00640 1 -- 172.21.15.5:0/4082961934 shutdown_connections 2024-08-18T22:23:14.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.498+0000 7fb85ee00640 1 -- 172.21.15.5:0/4082961934 wait complete. 2024-08-18T22:23:14.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85ee00640 1 Processor -- start 2024-08-18T22:23:14.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85ee00640 1 -- start start 2024-08-18T22:23:14.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85ee00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb85809aa40 0x7fb858165de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85ee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8580b4510 0x7fb858156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85ee00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8580cde30 0x7fb85815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85ee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb858169e50 con 0x7fb8580b4510 2024-08-18T22:23:14.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85ee00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb85815c440 con 0x7fb85809aa40 2024-08-18T22:23:14.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85ee00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb858169fd0 con 0x7fb8580cde30 2024-08-18T22:23:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8580b4510 0x7fb858156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85da00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb85809aa40 0x7fb858165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8580b4510 0x7fb858156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46720/0 (socket says 172.21.15.5:46720) 2024-08-18T22:23:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85d000640 1 -- 172.21.15.5:0/1299836242 learned_addr learned my addr 172.21.15.5:0/1299836242 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85e400640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8580cde30 0x7fb85815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85d000640 1 -- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8580cde30 msgr2=0x7fb85815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85d000640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8580cde30 0x7fb85815f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85d000640 1 -- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb85809aa40 msgr2=0x7fb858165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85d000640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb85809aa40 0x7fb858165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85d000640 1 -- 172.21.15.5:0/1299836242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb858167300 con 0x7fb8580b4510 2024-08-18T22:23:14.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85d000640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8580b4510 0x7fb858156500 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097f0 tx=0x7fb84401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb855600640 1 -- 172.21.15.5:0/1299836242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8440b9020 con 0x7fb8580b4510 2024-08-18T22:23:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb855600640 1 -- 172.21.15.5:0/1299836242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8440b1040 con 0x7fb8580b4510 2024-08-18T22:23:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85ee00640 1 -- 172.21.15.5:0/1299836242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb858165340 con 0x7fb8580b4510 2024-08-18T22:23:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb855600640 1 -- 172.21.15.5:0/1299836242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8440b0070 con 0x7fb8580b4510 2024-08-18T22:23:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85ee00640 1 -- 172.21.15.5:0/1299836242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb858166d40 con 0x7fb8580b4510 2024-08-18T22:23:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.502+0000 7fb85ee00640 1 -- 172.21.15.5:0/1299836242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85815cfe0 con 0x7fb8580b4510 2024-08-18T22:23:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.506+0000 7fb855600640 1 -- 172.21.15.5:0/1299836242 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb8440bc020 con 0x7fb8580b4510 2024-08-18T22:23:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.506+0000 7fb855600640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8380678f0 0x7fb838069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.506+0000 7fb855600640 1 -- 172.21.15.5:0/1299836242 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fb84411f860 con 0x7fb8580b4510 2024-08-18T22:23:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.506+0000 7fb85da00640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8380678f0 0x7fb838069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.506+0000 7fb85da00640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8380678f0 0x7fb838069db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0011f0 tx=0x7fb84c007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:14.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.510+0000 7fb855600640 1 -- 172.21.15.5:0/1299836242 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb8440c3070 con 0x7fb8580b4510 2024-08-18T22:23:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.734+0000 7fb85ee00640 1 -- 172.21.15.5:0/1299836242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb858073d40 con 0x7fb8580b4510 2024-08-18T22:23:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.734+0000 7fb855600640 1 -- 172.21.15.5:0/1299836242 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1137 (secure 0 0 0) 0x7fb8440160d0 con 0x7fb8580b4510 2024-08-18T22:23:14.740 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:14.740 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":258,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":67,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":49},{"state_name":"active+clean","count":48}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590368,"bytes_used":309702656,"bytes_avail":772784410624,"bytes_total":773094113280,"inactive_pgs_ratio":0.50515460968017578,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":40,"btime":"2024-08-18T22:23:12:405942+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6276}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-08-18T22:21:59.656284+0000","services":{}},"progress_events":{}} 2024-08-18T22:23:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 -- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8380678f0 msgr2=0x7fb838069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8380678f0 0x7fb838069db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0011f0 tx=0x7fb84c007d40 comp rx=0 tx=0).stop 2024-08-18T22:23:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 -- 172.21.15.5:0/1299836242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8580b4510 msgr2=0x7fb858156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8580b4510 0x7fb858156500 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097f0 tx=0x7fb84401ac90 comp rx=0 tx=0).stop 2024-08-18T22:23:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 -- 172.21.15.5:0/1299836242 shutdown_connections 2024-08-18T22:23:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8380678f0 0x7fb838069db0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8580cde30 0x7fb85815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8580b4510 0x7fb858156500 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 --2- 172.21.15.5:0/1299836242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb85809aa40 0x7fb858165de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 -- 172.21.15.5:0/1299836242 >> 172.21.15.5:0/1299836242 conn(0x7fb8580b3a20 msgr2=0x7fb858167680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 -- 172.21.15.5:0/1299836242 shutdown_connections 2024-08-18T22:23:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.738+0000 7fb85ee00640 1 -- 172.21.15.5:0/1299836242 wait complete. 2024-08-18T22:23:14.761 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-18T22:23:14.761 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:23:14.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.894+0000 7fbcd3c00640 1 Processor -- start 2024-08-18T22:23:14.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbcd3c00640 1 -- start start 2024-08-18T22:23:14.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbcd3c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbccc15e460 0x7fbccc06c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbcd3c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbccc15e840 con 0x7fbccc0cee40 2024-08-18T22:23:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbcd3c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbccc0cf320 con 0x7fbccc0ca3e0 2024-08-18T22:23:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbcd3c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbccc0ae750 con 0x7fbccc15e460 2024-08-18T22:23:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbccbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbccc0cee40 0x7fbccc0ae040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47244/0 (socket says 172.21.15.5:47244) 2024-08-18T22:23:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbccbe00640 1 -- 172.21.15.5:0/3810279876 learned_addr learned my addr 172.21.15.5:0/3810279876 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbcd1200640 1 --2- 172.21.15.5:0/3810279876 >> v2:172.21.15.117:3300/0 conn(0x7fbccc15e460 0x7fbccc06c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbccb400640 1 -- 172.21.15.5:0/3810279876 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461260234 0 0) 0x7fbccc15e840 con 0x7fbccc0cee40 2024-08-18T22:23:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbccb400640 1 -- 172.21.15.5:0/3810279876 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb0003530 con 0x7fbccc0cee40 2024-08-18T22:23:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbccb400640 1 -- 172.21.15.5:0/3810279876 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387194532 0 0) 0x7fbccc0cf320 con 0x7fbccc0ca3e0 2024-08-18T22:23:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbccb400640 1 -- 172.21.15.5:0/3810279876 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbccc15e840 con 0x7fbccc0ca3e0 2024-08-18T22:23:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbccb400640 1 -- 172.21.15.5:0/3810279876 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1837045547 0 0) 0x7fbcb0003530 con 0x7fbccc0cee40 2024-08-18T22:23:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbcd1200640 1 -- 172.21.15.5:0/3810279876 >> v1:172.21.15.117:6789/0 conn(0x7fbccc0ca3e0 legacy=0x7fbccc0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbcd1200640 1 -- 172.21.15.5:0/3810279876 >> v1:172.21.15.5:6789/0 conn(0x7fbccc0cee40 legacy=0x7fbccc0ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.898+0000 7fbcd1200640 1 -- 172.21.15.5:0/3810279876 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc0cf600 con 0x7fbccc15e460 2024-08-18T22:23:14.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.902+0000 7fbcd1200640 1 --2- 172.21.15.5:0/3810279876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbccc15e460 0x7fbccc06c3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097c0 tx=0x7fbcbc01ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0bb98bb9564db2c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:14.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.902+0000 7fbccb400640 1 -- 172.21.15.5:0/3810279876 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0b5070 con 0x7fbccc15e460 2024-08-18T22:23:14.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.902+0000 7fbccb400640 1 -- 172.21.15.5:0/3810279876 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc0a8630 con 0x7fbccc15e460 2024-08-18T22:23:14.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.902+0000 7fbccb400640 1 -- 172.21.15.5:0/3810279876 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8001680 con 0x7fbccc15e460 2024-08-18T22:23:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.902+0000 7fbcd3c00640 1 -- 172.21.15.5:0/3810279876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbccc15e460 msgr2=0x7fbccc06c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.902+0000 7fbcd3c00640 1 --2- 172.21.15.5:0/3810279876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbccc15e460 0x7fbccc06c3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097c0 tx=0x7fbcbc01ebb0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.902+0000 7fbcd3c00640 1 -- 172.21.15.5:0/3810279876 shutdown_connections 2024-08-18T22:23:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.902+0000 7fbcd3c00640 1 --2- 172.21.15.5:0/3810279876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbccc15e460 0x7fbccc06c3c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.902+0000 7fbcd3c00640 1 -- 172.21.15.5:0/3810279876 >> 172.21.15.5:0/3810279876 conn(0x7fbccc09aa40 msgr2=0x7fbccc0b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.902+0000 7fbcd3c00640 1 -- 172.21.15.5:0/3810279876 shutdown_connections 2024-08-18T22:23:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.902+0000 7fbcd3c00640 1 -- 172.21.15.5:0/3810279876 wait complete. 2024-08-18T22:23:14.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd3c00640 1 Processor -- start 2024-08-18T22:23:14.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd3c00640 1 -- start start 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd3c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbccc0ca3e0 0x7fbccc149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd3c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbccc0cee40 0x7fbccc0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd3c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbccc15e460 0x7fbccc0b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd3c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc0cfbc0 con 0x7fbccc0cee40 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd3c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc06c900 con 0x7fbccc0ca3e0 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd3c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbccc0cfea0 con 0x7fbccc15e460 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbccbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbccc0cee40 0x7fbccc0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbccbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbccc0cee40 0x7fbccc0b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46724/0 (socket says 172.21.15.5:46724) 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbccbe00640 1 -- 172.21.15.5:0/2724182014 learned_addr learned my addr 172.21.15.5:0/2724182014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd1200640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbccc0ca3e0 0x7fbccc149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd1c00640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbccc15e460 0x7fbccc0b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbccbe00640 1 -- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbccc15e460 msgr2=0x7fbccc0b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbccbe00640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbccc15e460 0x7fbccc0b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbccbe00640 1 -- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbccc0ca3e0 msgr2=0x7fbccc149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:14.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbccbe00640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbccc0ca3e0 0x7fbccc149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:14.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbccbe00640 1 -- 172.21.15.5:0/2724182014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc0b6910 con 0x7fbccc0cee40 2024-08-18T22:23:14.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbccbe00640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbccc0cee40 0x7fbccc0b5da0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800c780 tx=0x7fbcb800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcc8c00640 1 -- 172.21.15.5:0/2724182014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8005cf0 con 0x7fbccc0cee40 2024-08-18T22:23:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcc8c00640 1 -- 172.21.15.5:0/2724182014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb800ce30 con 0x7fbccc0cee40 2024-08-18T22:23:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcc8c00640 1 -- 172.21.15.5:0/2724182014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8007290 con 0x7fbccc0cee40 2024-08-18T22:23:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd3c00640 1 -- 172.21.15.5:0/2724182014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbccc0b6bf0 con 0x7fbccc0cee40 2024-08-18T22:23:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd3c00640 1 -- 172.21.15.5:0/2724182014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbccc0cb850 con 0x7fbccc0cee40 2024-08-18T22:23:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.906+0000 7fbcd3c00640 1 -- 172.21.15.5:0/2724182014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbccc0cba50 con 0x7fbccc0cee40 2024-08-18T22:23:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.910+0000 7fbcc8c00640 1 -- 172.21.15.5:0/2724182014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbcb8007430 con 0x7fbccc0cee40 2024-08-18T22:23:14.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.910+0000 7fbcc8c00640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbcac0678c0 0x7fbcac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:14.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.910+0000 7fbcc8c00640 1 -- 172.21.15.5:0/2724182014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fbcb8085ba0 con 0x7fbccc0cee40 2024-08-18T22:23:14.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.910+0000 7fbcd1200640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbcac0678c0 0x7fbcac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:14.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.910+0000 7fbcd1200640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbcac0678c0 0x7fbcac069d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0b2000 tx=0x7fbcbc0aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:14.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:14.914+0000 7fbcc8c00640 1 -- 172.21.15.5:0/2724182014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbccc0cba50 con 0x7fbccc0cee40 2024-08-18T22:23:15.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.074+0000 7fbcd3c00640 1 -- 172.21.15.5:0/2724182014 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbccc0b36b0 con 0x7fbcac0678c0 2024-08-18T22:23:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.078+0000 7fbcc8c00640 1 -- 172.21.15.5:0/2724182014 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247948 (secure 0 0 0) 0x7fbcbc0fc8a0 con 0x7fbcac0678c0 2024-08-18T22:23:15.087 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 -- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbcac0678c0 msgr2=0x7fbcac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbcac0678c0 0x7fbcac069d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0b2000 tx=0x7fbcbc0aa070 comp rx=0 tx=0).stop 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 -- 172.21.15.5:0/2724182014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbccc0cee40 msgr2=0x7fbccc0b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbccc0cee40 0x7fbccc0b5da0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800c780 tx=0x7fbcb800cc40 comp rx=0 tx=0).stop 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 -- 172.21.15.5:0/2724182014 shutdown_connections 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbcac0678c0 0x7fbcac069d80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbccc15e460 0x7fbccc0b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbccc0cee40 0x7fbccc0b5da0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 --2- 172.21.15.5:0/2724182014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbccc0ca3e0 0x7fbccc149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 -- 172.21.15.5:0/2724182014 >> 172.21.15.5:0/2724182014 conn(0x7fbccc09aa40 msgr2=0x7fbccc070450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 -- 172.21.15.5:0/2724182014 shutdown_connections 2024-08-18T22:23:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:15.082+0000 7fbcd3c00640 1 -- 172.21.15.5:0/2724182014 wait complete. 2024-08-18T22:23:15.107 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-08-18T22:23:13.674633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302444,"kb_used_data":7228,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754672276,"statfs":{"total":773094113280,"available":772784410624,"internally_reserved":0,"allocated":7401472,"data_stored":3974439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001957"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379544+0000","last_change":"2024-08-18T22:23:08.379544+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379544+0000","last_undegraded":"2024-08-18T22:23:08.379544+0000","last_fullsized":"2024-08-18T22:23:08.379544+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379610+0000","last_change":"2024-08-18T22:23:08.379610+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379610+0000","last_undegraded":"2024-08-18T22:23:08.379610+0000","last_fullsized":"2024-08-18T22:23:08.379610+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377622+0000","last_change":"2024-08-18T22:23:08.377622+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377622+0000","last_undegraded":"2024-08-18T22:23:08.377622+0000","last_fullsized":"2024-08-18T22:23:08.377622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378840+0000","last_change":"2024-08-18T22:23:09.404026+0000","last_active":"2024-08-18T22:23:10.378840+0000","last_peered":"2024-08-18T22:23:10.378840+0000","last_clean":"2024-08-18T22:23:10.378840+0000","last_became_active":"2024-08-18T22:23:09.403744+0000","last_became_peered":"2024-08-18T22:23:09.403744+0000","last_unstale":"2024-08-18T22:23:10.378840+0000","last_undegraded":"2024-08-18T22:23:10.378840+0000","last_fullsized":"2024-08-18T22:23:10.378840+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:03.641586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.388498+0000","last_change":"2024-08-18T22:23:08.388498+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.388498+0000","last_undegraded":"2024-08-18T22:23:08.388498+0000","last_fullsized":"2024-08-18T22:23:08.388498+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380971+0000","last_change":"2024-08-18T22:23:08.380971+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380971+0000","last_undegraded":"2024-08-18T22:23:08.380971+0000","last_fullsized":"2024-08-18T22:23:08.380971+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376888+0000","last_change":"2024-08-18T22:23:09.395052+0000","last_active":"2024-08-18T22:23:10.376888+0000","last_peered":"2024-08-18T22:23:10.376888+0000","last_clean":"2024-08-18T22:23:10.376888+0000","last_became_active":"2024-08-18T22:23:09.394746+0000","last_became_peered":"2024-08-18T22:23:09.394746+0000","last_unstale":"2024-08-18T22:23:10.376888+0000","last_undegraded":"2024-08-18T22:23:10.376888+0000","last_fullsized":"2024-08-18T22:23:10.376888+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:39.163319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379653+0000","last_change":"2024-08-18T22:23:08.379653+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379653+0000","last_undegraded":"2024-08-18T22:23:08.379653+0000","last_fullsized":"2024-08-18T22:23:08.379653+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375590+0000","last_change":"2024-08-18T22:23:08.375590+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375590+0000","last_undegraded":"2024-08-18T22:23:08.375590+0000","last_fullsized":"2024-08-18T22:23:08.375590+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377182+0000","last_change":"2024-08-18T22:23:08.377182+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377182+0000","last_undegraded":"2024-08-18T22:23:08.377182+0000","last_fullsized":"2024-08-18T22:23:08.377182+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378492+0000","last_change":"2024-08-18T22:23:09.391970+0000","last_active":"2024-08-18T22:23:10.378492+0000","last_peered":"2024-08-18T22:23:10.378492+0000","last_clean":"2024-08-18T22:23:10.378492+0000","last_became_active":"2024-08-18T22:23:09.391134+0000","last_became_peered":"2024-08-18T22:23:09.391134+0000","last_unstale":"2024-08-18T22:23:10.378492+0000","last_undegraded":"2024-08-18T22:23:10.378492+0000","last_fullsized":"2024-08-18T22:23:10.378492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:45.196677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380357+0000","last_change":"2024-08-18T22:23:08.380357+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380357+0000","last_undegraded":"2024-08-18T22:23:08.380357+0000","last_fullsized":"2024-08-18T22:23:08.380357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381798+0000","last_change":"2024-08-18T22:23:08.381798+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381798+0000","last_undegraded":"2024-08-18T22:23:08.381798+0000","last_fullsized":"2024-08-18T22:23:08.381798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.374132+0000","last_change":"2024-08-18T22:23:08.374132+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.374132+0000","last_undegraded":"2024-08-18T22:23:08.374132+0000","last_fullsized":"2024-08-18T22:23:08.374132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.374384+0000","last_change":"2024-08-18T22:23:08.374384+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.374384+0000","last_undegraded":"2024-08-18T22:23:08.374384+0000","last_fullsized":"2024-08-18T22:23:08.374384+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376855+0000","last_change":"2024-08-18T22:23:09.404695+0000","last_active":"2024-08-18T22:23:10.376855+0000","last_peered":"2024-08-18T22:23:10.376855+0000","last_clean":"2024-08-18T22:23:10.376855+0000","last_became_active":"2024-08-18T22:23:09.404441+0000","last_became_peered":"2024-08-18T22:23:09.404441+0000","last_unstale":"2024-08-18T22:23:10.376855+0000","last_undegraded":"2024-08-18T22:23:10.376855+0000","last_fullsized":"2024-08-18T22:23:10.376855+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:14.838422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377153+0000","last_change":"2024-08-18T22:23:08.377153+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377153+0000","last_undegraded":"2024-08-18T22:23:08.377153+0000","last_fullsized":"2024-08-18T22:23:08.377153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378673+0000","last_change":"2024-08-18T22:23:09.406570+0000","last_active":"2024-08-18T22:23:10.378673+0000","last_peered":"2024-08-18T22:23:10.378673+0000","last_clean":"2024-08-18T22:23:10.378673+0000","last_became_active":"2024-08-18T22:23:09.406243+0000","last_became_peered":"2024-08-18T22:23:09.406243+0000","last_unstale":"2024-08-18T22:23:10.378673+0000","last_undegraded":"2024-08-18T22:23:10.378673+0000","last_fullsized":"2024-08-18T22:23:10.378673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:23:09.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386571+0000","last_change":"2024-08-18T22:23:08.386571+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386571+0000","last_undegraded":"2024-08-18T22:23:08.386571+0000","last_fullsized":"2024-08-18T22:23:08.386571+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378280+0000","last_change":"2024-08-18T22:23:08.378280+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378280+0000","last_undegraded":"2024-08-18T22:23:08.378280+0000","last_fullsized":"2024-08-18T22:23:08.378280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380722+0000","last_change":"2024-08-18T22:23:08.380722+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380722+0000","last_undegraded":"2024-08-18T22:23:08.380722+0000","last_fullsized":"2024-08-18T22:23:08.380722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379817+0000","last_change":"2024-08-18T22:23:08.379817+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379817+0000","last_undegraded":"2024-08-18T22:23:08.379817+0000","last_fullsized":"2024-08-18T22:23:08.379817+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.379291+0000","last_change":"2024-08-18T22:23:08.379291+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.379291+0000","last_undegraded":"2024-08-18T22:23:08.379291+0000","last_fullsized":"2024-08-18T22:23:08.379291+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375422+0000","last_change":"2024-08-18T22:23:08.375422+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375422+0000","last_undegraded":"2024-08-18T22:23:08.375422+0000","last_fullsized":"2024-08-18T22:23:08.375422+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380267+0000","last_change":"2024-08-18T22:23:08.380267+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380267+0000","last_undegraded":"2024-08-18T22:23:08.380267+0000","last_fullsized":"2024-08-18T22:23:08.380267+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380461+0000","last_change":"2024-08-18T22:23:08.380461+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380461+0000","last_undegraded":"2024-08-18T22:23:08.380461+0000","last_fullsized":"2024-08-18T22:23:08.380461+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378559+0000","last_change":"2024-08-18T22:23:09.395874+0000","last_active":"2024-08-18T22:23:10.378559+0000","last_peered":"2024-08-18T22:23:10.378559+0000","last_clean":"2024-08-18T22:23:10.378559+0000","last_became_active":"2024-08-18T22:23:09.395607+0000","last_became_peered":"2024-08-18T22:23:09.395607+0000","last_unstale":"2024-08-18T22:23:10.378559+0000","last_undegraded":"2024-08-18T22:23:10.378559+0000","last_fullsized":"2024-08-18T22:23:10.378559+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:18.768258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378078+0000","last_change":"2024-08-18T22:23:08.378078+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378078+0000","last_undegraded":"2024-08-18T22:23:08.378078+0000","last_fullsized":"2024-08-18T22:23:08.378078+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.375798+0000","last_change":"2024-08-18T22:23:08.375798+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.375798+0000","last_undegraded":"2024-08-18T22:23:08.375798+0000","last_fullsized":"2024-08-18T22:23:08.375798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380964+0000","last_change":"2024-08-18T22:23:08.380964+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380964+0000","last_undegraded":"2024-08-18T22:23:08.380964+0000","last_fullsized":"2024-08-18T22:23:08.380964+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377611+0000","last_change":"2024-08-18T22:23:09.387587+0000","last_active":"2024-08-18T22:23:10.377611+0000","last_peered":"2024-08-18T22:23:10.377611+0000","last_clean":"2024-08-18T22:23:10.377611+0000","last_became_active":"2024-08-18T22:23:09.387364+0000","last_became_peered":"2024-08-18T22:23:09.387364+0000","last_unstale":"2024-08-18T22:23:10.377611+0000","last_undegraded":"2024-08-18T22:23:10.377611+0000","last_fullsized":"2024-08-18T22:23:10.377611+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:22.989793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.382343+0000","last_change":"2024-08-18T22:23:08.382343+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.382343+0000","last_undegraded":"2024-08-18T22:23:08.382343+0000","last_fullsized":"2024-08-18T22:23:08.382343+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385161+0000","last_change":"2024-08-18T22:23:08.385161+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385161+0000","last_undegraded":"2024-08-18T22:23:08.385161+0000","last_fullsized":"2024-08-18T22:23:08.385161+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.388533+0000","last_change":"2024-08-18T22:23:08.381923+0000","last_active":"2024-08-18T22:23:08.388533+0000","last_peered":"2024-08-18T22:23:08.388533+0000","last_clean":"2024-08-18T22:23:08.388533+0000","last_became_active":"2024-08-18T22:23:08.381398+0000","last_became_peered":"2024-08-18T22:23:08.381398+0000","last_unstale":"2024-08-18T22:23:08.388533+0000","last_undegraded":"2024-08-18T22:23:08.388533+0000","last_fullsized":"2024-08-18T22:23:08.388533+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:04:03.032855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378673+0000","last_change":"2024-08-18T22:23:09.406503+0000","last_active":"2024-08-18T22:23:10.378673+0000","last_peered":"2024-08-18T22:23:10.378673+0000","last_clean":"2024-08-18T22:23:10.378673+0000","last_became_active":"2024-08-18T22:23:09.406229+0000","last_became_peered":"2024-08-18T22:23:09.406229+0000","last_unstale":"2024-08-18T22:23:10.378673+0000","last_undegraded":"2024-08-18T22:23:10.378673+0000","last_fullsized":"2024-08-18T22:23:10.378673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:12.297162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397347+0000","last_change":"2024-08-18T22:23:08.395735+0000","last_active":"2024-08-18T22:23:08.397347+0000","last_peered":"2024-08-18T22:23:08.397347+0000","last_clean":"2024-08-18T22:23:08.397347+0000","last_became_active":"2024-08-18T22:23:08.395477+0000","last_became_peered":"2024-08-18T22:23:08.395477+0000","last_unstale":"2024-08-18T22:23:08.397347+0000","last_undegraded":"2024-08-18T22:23:08.397347+0000","last_fullsized":"2024-08-18T22:23:08.397347+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:46.358052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385633+0000","last_change":"2024-08-18T22:23:08.385633+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385633+0000","last_undegraded":"2024-08-18T22:23:08.385633+0000","last_fullsized":"2024-08-18T22:23:08.385633+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397091+0000","last_change":"2024-08-18T22:23:08.390884+0000","last_active":"2024-08-18T22:23:08.397091+0000","last_peered":"2024-08-18T22:23:08.397091+0000","last_clean":"2024-08-18T22:23:08.397091+0000","last_became_active":"2024-08-18T22:23:08.390605+0000","last_became_peered":"2024-08-18T22:23:08.390605+0000","last_unstale":"2024-08-18T22:23:08.397091+0000","last_undegraded":"2024-08-18T22:23:08.397091+0000","last_fullsized":"2024-08-18T22:23:08.397091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:30.832117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.376017+0000","last_change":"2024-08-18T22:23:08.376017+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.376017+0000","last_undegraded":"2024-08-18T22:23:08.376017+0000","last_fullsized":"2024-08-18T22:23:08.376017+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397608+0000","last_change":"2024-08-18T22:23:08.396665+0000","last_active":"2024-08-18T22:23:08.397608+0000","last_peered":"2024-08-18T22:23:08.397608+0000","last_clean":"2024-08-18T22:23:08.397608+0000","last_became_active":"2024-08-18T22:23:08.396386+0000","last_became_peered":"2024-08-18T22:23:08.396386+0000","last_unstale":"2024-08-18T22:23:08.397608+0000","last_undegraded":"2024-08-18T22:23:08.397608+0000","last_fullsized":"2024-08-18T22:23:08.397608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:28:52.107125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376874+0000","last_change":"2024-08-18T22:23:09.390577+0000","last_active":"2024-08-18T22:23:10.376874+0000","last_peered":"2024-08-18T22:23:10.376874+0000","last_clean":"2024-08-18T22:23:10.376874+0000","last_became_active":"2024-08-18T22:23:09.390330+0000","last_became_peered":"2024-08-18T22:23:09.390330+0000","last_unstale":"2024-08-18T22:23:10.376874+0000","last_undegraded":"2024-08-18T22:23:10.376874+0000","last_fullsized":"2024-08-18T22:23:10.376874+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:05.538156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398721+0000","last_change":"2024-08-18T22:23:08.395039+0000","last_active":"2024-08-18T22:23:08.398721+0000","last_peered":"2024-08-18T22:23:08.398721+0000","last_clean":"2024-08-18T22:23:08.398721+0000","last_became_active":"2024-08-18T22:23:08.390586+0000","last_became_peered":"2024-08-18T22:23:08.390586+0000","last_unstale":"2024-08-18T22:23:08.398721+0000","last_undegraded":"2024-08-18T22:23:08.398721+0000","last_fullsized":"2024-08-18T22:23:08.398721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:52.259773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377105+0000","last_change":"2024-08-18T22:23:08.377105+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377105+0000","last_undegraded":"2024-08-18T22:23:08.377105+0000","last_fullsized":"2024-08-18T22:23:08.377105+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400310+0000","last_change":"2024-08-18T22:23:08.399282+0000","last_active":"2024-08-18T22:23:08.400310+0000","last_peered":"2024-08-18T22:23:08.400310+0000","last_clean":"2024-08-18T22:23:08.400310+0000","last_became_active":"2024-08-18T22:23:08.398958+0000","last_became_peered":"2024-08-18T22:23:08.398958+0000","last_unstale":"2024-08-18T22:23:08.400310+0000","last_undegraded":"2024-08-18T22:23:08.400310+0000","last_fullsized":"2024-08-18T22:23:08.400310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:50.360086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.390818+0000","last_change":"2024-08-18T22:23:08.390818+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.390818+0000","last_undegraded":"2024-08-18T22:23:08.390818+0000","last_fullsized":"2024-08-18T22:23:08.390818+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399618+0000","last_change":"2024-08-18T22:23:08.397746+0000","last_active":"2024-08-18T22:23:08.399618+0000","last_peered":"2024-08-18T22:23:08.399618+0000","last_clean":"2024-08-18T22:23:08.399618+0000","last_became_active":"2024-08-18T22:23:08.397305+0000","last_became_peered":"2024-08-18T22:23:08.397305+0000","last_unstale":"2024-08-18T22:23:08.399618+0000","last_undegraded":"2024-08-18T22:23:08.399618+0000","last_fullsized":"2024-08-18T22:23:08.399618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:10.981993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378196+0000","last_change":"2024-08-18T22:23:08.378196+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378196+0000","last_undegraded":"2024-08-18T22:23:08.378196+0000","last_fullsized":"2024-08-18T22:23:08.378196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.395398+0000","last_change":"2024-08-18T22:23:08.393396+0000","last_active":"2024-08-18T22:23:08.395398+0000","last_peered":"2024-08-18T22:23:08.395398+0000","last_clean":"2024-08-18T22:23:08.395398+0000","last_became_active":"2024-08-18T22:23:08.393124+0000","last_became_peered":"2024-08-18T22:23:08.393124+0000","last_unstale":"2024-08-18T22:23:08.395398+0000","last_undegraded":"2024-08-18T22:23:08.395398+0000","last_fullsized":"2024-08-18T22:23:08.395398+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:45:40.860684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377628+0000","last_change":"2024-08-18T22:23:08.377628+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377628+0000","last_undegraded":"2024-08-18T22:23:08.377628+0000","last_fullsized":"2024-08-18T22:23:08.377628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.395706+0000","last_change":"2024-08-18T22:23:08.393152+0000","last_active":"2024-08-18T22:23:08.395706+0000","last_peered":"2024-08-18T22:23:08.395706+0000","last_clean":"2024-08-18T22:23:08.395706+0000","last_became_active":"2024-08-18T22:23:08.392860+0000","last_became_peered":"2024-08-18T22:23:08.392860+0000","last_unstale":"2024-08-18T22:23:08.395706+0000","last_undegraded":"2024-08-18T22:23:08.395706+0000","last_fullsized":"2024-08-18T22:23:08.395706+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:14.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.378339+0000","last_change":"2024-08-18T22:23:08.378339+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.378339+0000","last_undegraded":"2024-08-18T22:23:08.378339+0000","last_fullsized":"2024-08-18T22:23:08.378339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378791+0000","last_change":"2024-08-18T22:23:08.390558+0000","last_active":"2024-08-18T22:23:10.378791+0000","last_peered":"2024-08-18T22:23:10.378791+0000","last_clean":"2024-08-18T22:23:10.378791+0000","last_became_active":"2024-08-18T22:23:08.389931+0000","last_became_peered":"2024-08-18T22:23:08.389931+0000","last_unstale":"2024-08-18T22:23:10.378791+0000","last_undegraded":"2024-08-18T22:23:10.378791+0000","last_fullsized":"2024-08-18T22:23:10.378791+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:42.339748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386741+0000","last_change":"2024-08-18T22:23:08.386741+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386741+0000","last_undegraded":"2024-08-18T22:23:08.386741+0000","last_fullsized":"2024-08-18T22:23:08.386741+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394701+0000","last_change":"2024-08-18T22:23:08.391640+0000","last_active":"2024-08-18T22:23:08.394701+0000","last_peered":"2024-08-18T22:23:08.394701+0000","last_clean":"2024-08-18T22:23:08.394701+0000","last_became_active":"2024-08-18T22:23:08.391377+0000","last_became_peered":"2024-08-18T22:23:08.391377+0000","last_unstale":"2024-08-18T22:23:08.394701+0000","last_undegraded":"2024-08-18T22:23:08.394701+0000","last_fullsized":"2024-08-18T22:23:08.394701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:43.009084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379015+0000","last_change":"2024-08-18T22:23:09.394815+0000","last_active":"2024-08-18T22:23:10.379015+0000","last_peered":"2024-08-18T22:23:10.379015+0000","last_clean":"2024-08-18T22:23:10.379015+0000","last_became_active":"2024-08-18T22:23:09.391502+0000","last_became_peered":"2024-08-18T22:23:09.391502+0000","last_unstale":"2024-08-18T22:23:10.379015+0000","last_undegraded":"2024-08-18T22:23:10.379015+0000","last_fullsized":"2024-08-18T22:23:10.379015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:42.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.390750+0000","last_change":"2024-08-18T22:23:08.382205+0000","last_active":"2024-08-18T22:23:08.390750+0000","last_peered":"2024-08-18T22:23:08.390750+0000","last_clean":"2024-08-18T22:23:08.390750+0000","last_became_active":"2024-08-18T22:23:08.381817+0000","last_became_peered":"2024-08-18T22:23:08.381817+0000","last_unstale":"2024-08-18T22:23:08.390750+0000","last_undegraded":"2024-08-18T22:23:08.390750+0000","last_fullsized":"2024-08-18T22:23:08.390750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:23.253295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377624+0000","last_change":"2024-08-18T22:23:09.385959+0000","last_active":"2024-08-18T22:23:10.377624+0000","last_peered":"2024-08-18T22:23:10.377624+0000","last_clean":"2024-08-18T22:23:10.377624+0000","last_became_active":"2024-08-18T22:23:09.385743+0000","last_became_peered":"2024-08-18T22:23:09.385743+0000","last_unstale":"2024-08-18T22:23:10.377624+0000","last_undegraded":"2024-08-18T22:23:10.377624+0000","last_fullsized":"2024-08-18T22:23:10.377624+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:44:47.120395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400736+0000","last_change":"2024-08-18T22:23:08.395722+0000","last_active":"2024-08-18T22:23:08.400736+0000","last_peered":"2024-08-18T22:23:08.400736+0000","last_clean":"2024-08-18T22:23:08.400736+0000","last_became_active":"2024-08-18T22:23:08.395423+0000","last_became_peered":"2024-08-18T22:23:08.395423+0000","last_unstale":"2024-08-18T22:23:08.400736+0000","last_undegraded":"2024-08-18T22:23:08.400736+0000","last_fullsized":"2024-08-18T22:23:08.400736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:59.063303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381691+0000","last_change":"2024-08-18T22:23:08.381691+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381691+0000","last_undegraded":"2024-08-18T22:23:08.381691+0000","last_fullsized":"2024-08-18T22:23:08.381691+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394708+0000","last_change":"2024-08-18T22:23:08.391632+0000","last_active":"2024-08-18T22:23:08.394708+0000","last_peered":"2024-08-18T22:23:08.394708+0000","last_clean":"2024-08-18T22:23:08.394708+0000","last_became_active":"2024-08-18T22:23:08.391350+0000","last_became_peered":"2024-08-18T22:23:08.391350+0000","last_unstale":"2024-08-18T22:23:08.394708+0000","last_undegraded":"2024-08-18T22:23:08.394708+0000","last_fullsized":"2024-08-18T22:23:08.394708+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:43.009084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.389670+0000","last_change":"2024-08-18T22:23:08.389670+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.389670+0000","last_undegraded":"2024-08-18T22:23:08.389670+0000","last_fullsized":"2024-08-18T22:23:08.389670+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.393053+0000","last_change":"2024-08-18T22:23:08.388076+0000","last_active":"2024-08-18T22:23:08.393053+0000","last_peered":"2024-08-18T22:23:08.393053+0000","last_clean":"2024-08-18T22:23:08.393053+0000","last_became_active":"2024-08-18T22:23:08.387745+0000","last_became_peered":"2024-08-18T22:23:08.387745+0000","last_unstale":"2024-08-18T22:23:08.393053+0000","last_undegraded":"2024-08-18T22:23:08.393053+0000","last_fullsized":"2024-08-18T22:23:08.393053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:07.998922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377058+0000","last_change":"2024-08-18T22:23:08.377058+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377058+0000","last_undegraded":"2024-08-18T22:23:08.377058+0000","last_fullsized":"2024-08-18T22:23:08.377058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377736+0000","last_change":"2024-08-18T22:23:08.384953+0000","last_active":"2024-08-18T22:23:10.377736+0000","last_peered":"2024-08-18T22:23:10.377736+0000","last_clean":"2024-08-18T22:23:10.377736+0000","last_became_active":"2024-08-18T22:23:08.384684+0000","last_became_peered":"2024-08-18T22:23:08.384684+0000","last_unstale":"2024-08-18T22:23:10.377736+0000","last_undegraded":"2024-08-18T22:23:10.377736+0000","last_fullsized":"2024-08-18T22:23:10.377736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:22:31.028819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.376243+0000","last_change":"2024-08-18T22:23:08.376243+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.376243+0000","last_undegraded":"2024-08-18T22:23:08.376243+0000","last_fullsized":"2024-08-18T22:23:08.376243+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394606+0000","last_change":"2024-08-18T22:23:08.391894+0000","last_active":"2024-08-18T22:23:08.394606+0000","last_peered":"2024-08-18T22:23:08.394606+0000","last_clean":"2024-08-18T22:23:08.394606+0000","last_became_active":"2024-08-18T22:23:08.391616+0000","last_became_peered":"2024-08-18T22:23:08.391616+0000","last_unstale":"2024-08-18T22:23:08.394606+0000","last_undegraded":"2024-08-18T22:23:08.394606+0000","last_fullsized":"2024-08-18T22:23:08.394606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:14.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.384174+0000","last_change":"2024-08-18T22:23:08.384174+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.384174+0000","last_undegraded":"2024-08-18T22:23:08.384174+0000","last_fullsized":"2024-08-18T22:23:08.384174+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398240+0000","last_change":"2024-08-18T22:23:08.394584+0000","last_active":"2024-08-18T22:23:08.398240+0000","last_peered":"2024-08-18T22:23:08.398240+0000","last_clean":"2024-08-18T22:23:08.398240+0000","last_became_active":"2024-08-18T22:23:08.394230+0000","last_became_peered":"2024-08-18T22:23:08.394230+0000","last_unstale":"2024-08-18T22:23:08.398240+0000","last_undegraded":"2024-08-18T22:23:08.398240+0000","last_fullsized":"2024-08-18T22:23:08.398240+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:54.525986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378753+0000","last_change":"2024-08-18T22:23:09.406775+0000","last_active":"2024-08-18T22:23:10.378753+0000","last_peered":"2024-08-18T22:23:10.378753+0000","last_clean":"2024-08-18T22:23:10.378753+0000","last_became_active":"2024-08-18T22:23:09.402616+0000","last_became_peered":"2024-08-18T22:23:09.402616+0000","last_unstale":"2024-08-18T22:23:10.378753+0000","last_undegraded":"2024-08-18T22:23:10.378753+0000","last_fullsized":"2024-08-18T22:23:10.378753+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:29.447896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394723+0000","last_change":"2024-08-18T22:23:08.392035+0000","last_active":"2024-08-18T22:23:08.394723+0000","last_peered":"2024-08-18T22:23:08.394723+0000","last_clean":"2024-08-18T22:23:08.394723+0000","last_became_active":"2024-08-18T22:23:08.391621+0000","last_became_peered":"2024-08-18T22:23:08.391621+0000","last_unstale":"2024-08-18T22:23:08.394723+0000","last_undegraded":"2024-08-18T22:23:08.394723+0000","last_fullsized":"2024-08-18T22:23:08.394723+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:05.935611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.387403+0000","last_change":"2024-08-18T22:23:08.387403+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.387403+0000","last_undegraded":"2024-08-18T22:23:08.387403+0000","last_fullsized":"2024-08-18T22:23:08.387403+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.388888+0000","last_change":"2024-08-18T22:23:08.385515+0000","last_active":"2024-08-18T22:23:08.388888+0000","last_peered":"2024-08-18T22:23:08.388888+0000","last_clean":"2024-08-18T22:23:08.388888+0000","last_became_active":"2024-08-18T22:23:08.385221+0000","last_became_peered":"2024-08-18T22:23:08.385221+0000","last_unstale":"2024-08-18T22:23:08.388888+0000","last_undegraded":"2024-08-18T22:23:08.388888+0000","last_fullsized":"2024-08-18T22:23:08.388888+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:02.573262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381329+0000","last_change":"2024-08-18T22:23:08.381329+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381329+0000","last_undegraded":"2024-08-18T22:23:08.381329+0000","last_fullsized":"2024-08-18T22:23:08.381329+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.400409+0000","last_change":"2024-08-18T22:23:08.399434+0000","last_active":"2024-08-18T22:23:08.400409+0000","last_peered":"2024-08-18T22:23:08.400409+0000","last_clean":"2024-08-18T22:23:08.400409+0000","last_became_active":"2024-08-18T22:23:08.398753+0000","last_became_peered":"2024-08-18T22:23:08.398753+0000","last_unstale":"2024-08-18T22:23:08.400409+0000","last_undegraded":"2024-08-18T22:23:08.400409+0000","last_fullsized":"2024-08-18T22:23:08.400409+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:14.567719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.381170+0000","last_change":"2024-08-18T22:23:08.381170+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.381170+0000","last_undegraded":"2024-08-18T22:23:08.381170+0000","last_fullsized":"2024-08-18T22:23:08.381170+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394765+0000","last_change":"2024-08-18T22:23:08.391747+0000","last_active":"2024-08-18T22:23:08.394765+0000","last_peered":"2024-08-18T22:23:08.394765+0000","last_clean":"2024-08-18T22:23:08.394765+0000","last_became_active":"2024-08-18T22:23:08.391425+0000","last_became_peered":"2024-08-18T22:23:08.391425+0000","last_unstale":"2024-08-18T22:23:08.394765+0000","last_undegraded":"2024-08-18T22:23:08.394765+0000","last_fullsized":"2024-08-18T22:23:08.394765+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:05.935611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.385306+0000","last_change":"2024-08-18T22:23:08.385306+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.385306+0000","last_undegraded":"2024-08-18T22:23:08.385306+0000","last_fullsized":"2024-08-18T22:23:08.385306+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397144+0000","last_change":"2024-08-18T22:23:08.391816+0000","last_active":"2024-08-18T22:23:08.397144+0000","last_peered":"2024-08-18T22:23:08.397144+0000","last_clean":"2024-08-18T22:23:08.397144+0000","last_became_active":"2024-08-18T22:23:08.391406+0000","last_became_peered":"2024-08-18T22:23:08.391406+0000","last_unstale":"2024-08-18T22:23:08.397144+0000","last_undegraded":"2024-08-18T22:23:08.397144+0000","last_fullsized":"2024-08-18T22:23:08.397144+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:18.572969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.382712+0000","last_change":"2024-08-18T22:23:08.382712+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.382712+0000","last_undegraded":"2024-08-18T22:23:08.382712+0000","last_fullsized":"2024-08-18T22:23:08.382712+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.393416+0000","last_change":"2024-08-18T22:23:08.388283+0000","last_active":"2024-08-18T22:23:08.393416+0000","last_peered":"2024-08-18T22:23:08.393416+0000","last_clean":"2024-08-18T22:23:08.393416+0000","last_became_active":"2024-08-18T22:23:08.387990+0000","last_became_peered":"2024-08-18T22:23:08.387990+0000","last_unstale":"2024-08-18T22:23:08.393416+0000","last_undegraded":"2024-08-18T22:23:08.393416+0000","last_fullsized":"2024-08-18T22:23:08.393416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:07.998922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377137+0000","last_change":"2024-08-18T22:23:09.416113+0000","last_active":"2024-08-18T22:23:10.377137+0000","last_peered":"2024-08-18T22:23:10.377137+0000","last_clean":"2024-08-18T22:23:10.377137+0000","last_became_active":"2024-08-18T22:23:09.415833+0000","last_became_peered":"2024-08-18T22:23:09.415833+0000","last_unstale":"2024-08-18T22:23:10.377137+0000","last_undegraded":"2024-08-18T22:23:10.377137+0000","last_fullsized":"2024-08-18T22:23:10.377137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:31:02.876930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394274+0000","last_change":"2024-08-18T22:23:08.390232+0000","last_active":"2024-08-18T22:23:08.394274+0000","last_peered":"2024-08-18T22:23:08.394274+0000","last_clean":"2024-08-18T22:23:08.394274+0000","last_became_active":"2024-08-18T22:23:08.389799+0000","last_became_peered":"2024-08-18T22:23:08.389799+0000","last_unstale":"2024-08-18T22:23:08.394274+0000","last_undegraded":"2024-08-18T22:23:08.394274+0000","last_fullsized":"2024-08-18T22:23:08.394274+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:49.234560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.380011+0000","last_change":"2024-08-18T22:23:08.380011+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.380011+0000","last_undegraded":"2024-08-18T22:23:08.380011+0000","last_fullsized":"2024-08-18T22:23:08.380011+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.397063+0000","last_change":"2024-08-18T22:23:08.390855+0000","last_active":"2024-08-18T22:23:08.397063+0000","last_peered":"2024-08-18T22:23:08.397063+0000","last_clean":"2024-08-18T22:23:08.397063+0000","last_became_active":"2024-08-18T22:23:08.390531+0000","last_became_peered":"2024-08-18T22:23:08.390531+0000","last_unstale":"2024-08-18T22:23:08.397063+0000","last_undegraded":"2024-08-18T22:23:08.397063+0000","last_fullsized":"2024-08-18T22:23:08.397063+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:16:46.918953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.384431+0000","last_change":"2024-08-18T22:23:08.384431+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.384431+0000","last_undegraded":"2024-08-18T22:23:08.384431+0000","last_fullsized":"2024-08-18T22:23:08.384431+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.392709+0000","last_change":"2024-08-18T22:23:08.391499+0000","last_active":"2024-08-18T22:23:08.392709+0000","last_peered":"2024-08-18T22:23:08.392709+0000","last_clean":"2024-08-18T22:23:08.392709+0000","last_became_active":"2024-08-18T22:23:08.391180+0000","last_became_peered":"2024-08-18T22:23:08.391180+0000","last_unstale":"2024-08-18T22:23:08.392709+0000","last_undegraded":"2024-08-18T22:23:08.392709+0000","last_fullsized":"2024-08-18T22:23:08.392709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:00.485578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.386323+0000","last_change":"2024-08-18T22:23:08.386323+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.386323+0000","last_undegraded":"2024-08-18T22:23:08.386323+0000","last_fullsized":"2024-08-18T22:23:08.386323+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.394100+0000","last_change":"2024-08-18T22:23:08.390531+0000","last_active":"2024-08-18T22:23:08.394100+0000","last_peered":"2024-08-18T22:23:08.394100+0000","last_clean":"2024-08-18T22:23:08.394100+0000","last_became_active":"2024-08-18T22:23:08.390244+0000","last_became_peered":"2024-08-18T22:23:08.390244+0000","last_unstale":"2024-08-18T22:23:08.394100+0000","last_undegraded":"2024-08-18T22:23:08.394100+0000","last_fullsized":"2024-08-18T22:23:08.394100+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:49.234560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378005+0000","last_change":"2024-08-18T22:23:09.385451+0000","last_active":"2024-08-18T22:23:10.378005+0000","last_peered":"2024-08-18T22:23:10.378005+0000","last_clean":"2024-08-18T22:23:10.378005+0000","last_became_active":"2024-08-18T22:23:09.385180+0000","last_became_peered":"2024-08-18T22:23:09.385180+0000","last_unstale":"2024-08-18T22:23:10.378005+0000","last_undegraded":"2024-08-18T22:23:10.378005+0000","last_fullsized":"2024-08-18T22:23:10.378005+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:30.197348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399161+0000","last_change":"2024-08-18T22:23:08.395413+0000","last_active":"2024-08-18T22:23:08.399161+0000","last_peered":"2024-08-18T22:23:08.399161+0000","last_clean":"2024-08-18T22:23:08.399161+0000","last_became_active":"2024-08-18T22:23:08.394853+0000","last_became_peered":"2024-08-18T22:23:08.394853+0000","last_unstale":"2024-08-18T22:23:08.399161+0000","last_undegraded":"2024-08-18T22:23:08.399161+0000","last_fullsized":"2024-08-18T22:23:08.399161+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:40.966159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.377294+0000","last_change":"2024-08-18T22:23:08.377294+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.377294+0000","last_undegraded":"2024-08-18T22:23:08.377294+0000","last_fullsized":"2024-08-18T22:23:08.377294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.399640+0000","last_change":"2024-08-18T22:23:08.397936+0000","last_active":"2024-08-18T22:23:08.399640+0000","last_peered":"2024-08-18T22:23:08.399640+0000","last_clean":"2024-08-18T22:23:08.399640+0000","last_became_active":"2024-08-18T22:23:08.397588+0000","last_became_peered":"2024-08-18T22:23:08.397588+0000","last_unstale":"2024-08-18T22:23:08.399640+0000","last_undegraded":"2024-08-18T22:23:08.399640+0000","last_fullsized":"2024-08-18T22:23:08.399640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:13.990634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377070+0000","last_change":"2024-08-18T22:23:09.400184+0000","last_active":"2024-08-18T22:23:10.377070+0000","last_peered":"2024-08-18T22:23:10.377070+0000","last_clean":"2024-08-18T22:23:10.377070+0000","last_became_active":"2024-08-18T22:23:09.399916+0000","last_became_peered":"2024-08-18T22:23:09.399916+0000","last_unstale":"2024-08-18T22:23:10.377070+0000","last_undegraded":"2024-08-18T22:23:10.377070+0000","last_fullsized":"2024-08-18T22:23:10.377070+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:47.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.398926+0000","last_change":"2024-08-18T22:23:08.395341+0000","last_active":"2024-08-18T22:23:08.398926+0000","last_peered":"2024-08-18T22:23:08.398926+0000","last_clean":"2024-08-18T22:23:08.398926+0000","last_became_active":"2024-08-18T22:23:08.395079+0000","last_became_peered":"2024-08-18T22:23:08.395079+0000","last_unstale":"2024-08-18T22:23:08.398926+0000","last_undegraded":"2024-08-18T22:23:08.398926+0000","last_fullsized":"2024-08-18T22:23:08.398926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:44.730118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-08-18T22:23:08.388065+0000","last_change":"2024-08-18T22:23:08.388065+0000","last_active":"2024-08-18T22:23:08.364735+0000","last_peered":"2024-08-18T22:23:08.364735+0000","last_clean":"2024-08-18T22:23:08.364735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:08.388065+0000","last_undegraded":"2024-08-18T22:23:08.388065+0000","last_fullsized":"2024-08-18T22:23:08.388065+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.390965+0000","last_change":"2024-08-18T22:23:08.389367+0000","last_active":"2024-08-18T22:23:08.390965+0000","last_peered":"2024-08-18T22:23:08.390965+0000","last_clean":"2024-08-18T22:23:08.390965+0000","last_became_active":"2024-08-18T22:23:08.389090+0000","last_became_peered":"2024-08-18T22:23:08.389090+0000","last_unstale":"2024-08-18T22:23:08.390965+0000","last_undegraded":"2024-08-18T22:23:08.390965+0000","last_fullsized":"2024-08-18T22:23:08.390965+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:45.554618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":260,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-08-18T22:23:08.378100+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:23:08.378100+0000","last_peered":"2024-08-18T22:23:08.378100+0000","last_clean":"2024-08-18T22:23:08.378100+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:23:08.378100+0000","last_undegraded":"2024-08-18T22:23:08.378100+0000","last_fullsized":"2024-08-18T22:23:08.378100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36684,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335156,"statfs":{"total":96636764160,"available":96599199744,"internally_reserved":0,"allocated":1372160,"data_stored":940913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40248,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331592,"statfs":{"total":96636764160,"available":96595550208,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40252,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331588,"statfs":{"total":96636764160,"available":96595546112,"internally_reserved":0,"allocated":765952,"data_stored":343886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40828,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331012,"statfs":{"total":96636764160,"available":96594956288,"internally_reserved":0,"allocated":1359872,"data_stored":934254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":815104,"data_stored":366016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36120,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335720,"statfs":{"total":96636764160,"available":96599777280,"internally_reserved":0,"allocated":790528,"data_stored":357712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:23:18.112 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:23:18.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d62a00640 1 Processor -- start 2024-08-18T22:23:18.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d62a00640 1 -- start start 2024-08-18T22:23:18.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d62a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2d5c15bed0 0x7f2d5c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d62a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5c073c80 con 0x7f2d5c0cb390 2024-08-18T22:23:18.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d62a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5c0ca5d0 con 0x7f2d5c06da70 2024-08-18T22:23:18.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d62a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2d5c0ca8b0 con 0x7f2d5c15bed0 2024-08-18T22:23:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d53400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2d5c0cb390 0x7f2d5c071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47246/0 (socket says 172.21.15.5:47246) 2024-08-18T22:23:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d53400640 1 -- 172.21.15.5:0/3282647709 learned_addr learned my addr 172.21.15.5:0/3282647709 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5be00640 1 --2- 172.21.15.5:0/3282647709 >> v2:172.21.15.117:3300/0 conn(0x7f2d5c15bed0 0x7f2d5c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1450742907 0 0) 0x7f2d5c073c80 con 0x7f2d5c0cb390 2024-08-18T22:23:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d40003530 con 0x7f2d5c0cb390 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4122048680 0 0) 0x7f2d40003530 con 0x7f2d5c0cb390 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 >> v2:172.21.15.117:3300/0 conn(0x7f2d5c15bed0 msgr2=0x7f2d5c0735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 --2- 172.21.15.5:0/3282647709 >> v2:172.21.15.117:3300/0 conn(0x7f2d5c15bed0 0x7f2d5c0735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 >> v1:172.21.15.117:6789/0 conn(0x7f2d5c06da70 legacy=0x7f2d5c165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c0cab90 con 0x7f2d5c0cb390 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f2d44001680 con 0x7f2d5c0cb390 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 >> v1:172.21.15.5:6789/0 conn(0x7f2d5c0cb390 legacy=0x7f2d5c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40003a10 0x7f2d40003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d40004810 0x7f2d40004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d400051d0 0x7f2d4000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c0ca8b0 con 0x7f2d40003a10 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4000c0d0 con 0x7f2d400051d0 2024-08-18T22:23:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2d4000c2d0 con 0x7f2d40004810 2024-08-18T22:23:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d5be00640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40003a10 0x7f2d40003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d53400640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d40004810 0x7f2d40004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.262+0000 7f2d60a00640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d400051d0 0x7f2d4000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d5be00640 1 -- 172.21.15.5:0/3282647709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d40004810 msgr2=0x7f2d40004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d5be00640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d40004810 0x7f2d40004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d5be00640 1 -- 172.21.15.5:0/3282647709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d400051d0 msgr2=0x7f2d4000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d5be00640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d400051d0 0x7f2d4000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d5be00640 1 -- 172.21.15.5:0/3282647709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d40003530 con 0x7f2d40003a10 2024-08-18T22:23:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d60a00640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d400051d0 0x7f2d4000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:18.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d60a00640 1 -- 172.21.15.5:0/3282647709 reap_dead start 2024-08-18T22:23:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d5be00640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40003a10 0x7f2d40003e30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009ae0 tx=0x7f2d4c01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d2941908a946d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0b2070 con 0x7f2d40003a10 2024-08-18T22:23:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0a55d0 con 0x7f2d40003a10 2024-08-18T22:23:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d5b400640 1 -- 172.21.15.5:0/3282647709 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0096b0 con 0x7f2d40003a10 2024-08-18T22:23:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d62a00640 1 -- 172.21.15.5:0/3282647709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40003a10 msgr2=0x7f2d40003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d62a00640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40003a10 0x7f2d40003e30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009ae0 tx=0x7f2d4c01ca40 comp rx=0 tx=0).stop 2024-08-18T22:23:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d62a00640 1 -- 172.21.15.5:0/3282647709 shutdown_connections 2024-08-18T22:23:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d62a00640 1 --2- 172.21.15.5:0/3282647709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d40003a10 0x7f2d40003e30 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d62a00640 1 -- 172.21.15.5:0/3282647709 >> 172.21.15.5:0/3282647709 conn(0x7f2d5c0b1c50 msgr2=0x7f2d5c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d62a00640 1 -- 172.21.15.5:0/3282647709 shutdown_connections 2024-08-18T22:23:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.266+0000 7f2d62a00640 1 -- 172.21.15.5:0/3282647709 wait complete. 2024-08-18T22:23:18.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d62a00640 1 Processor -- start 2024-08-18T22:23:18.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d62a00640 1 -- start start 2024-08-18T22:23:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d62a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d40003a10 0x7f2d5c14ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d62a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5c1f7630 0x7f2d5c0ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d62a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c09cbf0 0x7f2d5c15e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d62a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c15c430 con 0x7f2d5c09cbf0 2024-08-18T22:23:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d62a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c15c2b0 con 0x7f2d5c1f7630 2024-08-18T22:23:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d62a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2d5c06de50 con 0x7f2d40003a10 2024-08-18T22:23:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d60a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c09cbf0 0x7f2d5c15e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d5be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d40003a10 0x7f2d5c14ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d53400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5c1f7630 0x7f2d5c0ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d5be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d40003a10 0x7f2d5c14ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:52226/0 (socket says 172.21.15.5:52226) 2024-08-18T22:23:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d5be00640 1 -- 172.21.15.5:0/2415302683 learned_addr learned my addr 172.21.15.5:0/2415302683 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d5be00640 1 -- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5c1f7630 msgr2=0x7f2d5c0ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d5be00640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5c1f7630 0x7f2d5c0ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d5be00640 1 -- 172.21.15.5:0/2415302683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c09cbf0 msgr2=0x7f2d5c15e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d5be00640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c09cbf0 0x7f2d5c15e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d5be00640 1 -- 172.21.15.5:0/2415302683 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c09dc50 con 0x7f2d40003a10 2024-08-18T22:23:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d60a00640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c09cbf0 0x7f2d5c15e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d53400640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5c1f7630 0x7f2d5c0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d5be00640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d40003a10 0x7f2d5c14ea70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0b0040 tx=0x7f2d4c0197e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.270+0000 7f2d58c00640 1 -- 172.21.15.5:0/2415302683 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0b2040 con 0x7f2d40003a10 2024-08-18T22:23:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.274+0000 7f2d58c00640 1 -- 172.21.15.5:0/2415302683 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0a5e20 con 0x7f2d40003a10 2024-08-18T22:23:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.274+0000 7f2d58c00640 1 -- 172.21.15.5:0/2415302683 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0096b0 con 0x7f2d40003a10 2024-08-18T22:23:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.274+0000 7f2d62a00640 1 -- 172.21.15.5:0/2415302683 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5c09d0d0 con 0x7f2d40003a10 2024-08-18T22:23:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.274+0000 7f2d62a00640 1 -- 172.21.15.5:0/2415302683 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d5c09d690 con 0x7f2d40003a10 2024-08-18T22:23:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.274+0000 7f2d62a00640 1 -- 172.21.15.5:0/2415302683 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d5c06e180 con 0x7f2d40003a10 2024-08-18T22:23:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.274+0000 7f2d58c00640 1 -- 172.21.15.5:0/2415302683 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2d4c0bf060 con 0x7f2d40003a10 2024-08-18T22:23:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.274+0000 7f2d58c00640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d380678c0 0x7f2d38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.274+0000 7f2d58c00640 1 -- 172.21.15.5:0/2415302683 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f2d4c11f6f0 con 0x7f2d40003a10 2024-08-18T22:23:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.274+0000 7f2d53400640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d380678c0 0x7f2d38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.278+0000 7f2d53400640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d380678c0 0x7f2d38069d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c09abd0 tx=0x7f2d44000ff0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:18.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.282+0000 7f2d58c00640 1 -- 172.21.15.5:0/2415302683 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2d4c016780 con 0x7f2d40003a10 2024-08-18T22:23:18.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.442+0000 7f2d62a00640 1 -- 172.21.15.5:0/2415302683 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d5c074880 con 0x7f2d380678c0 2024-08-18T22:23:18.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.450+0000 7f2d58c00640 1 -- 172.21.15.5:0/2415302683 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251996 (secure 0 0 0) 0x7f2d5c074880 con 0x7f2d380678c0 2024-08-18T22:23:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:18.458 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:23:18.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 -- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d380678c0 msgr2=0x7f2d38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d380678c0 0x7f2d38069d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c09abd0 tx=0x7f2d44000ff0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 -- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d40003a10 msgr2=0x7f2d5c14ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d40003a10 0x7f2d5c14ea70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0b0040 tx=0x7f2d4c0197e0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 -- 172.21.15.5:0/2415302683 shutdown_connections 2024-08-18T22:23:18.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d380678c0 0x7f2d38069d80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5c09cbf0 0x7f2d5c15e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5c1f7630 0x7f2d5c0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 --2- 172.21.15.5:0/2415302683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d40003a10 0x7f2d5c14ea70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 -- 172.21.15.5:0/2415302683 >> 172.21.15.5:0/2415302683 conn(0x7f2d5c0b1c50 msgr2=0x7f2d5c0b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:18.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 -- 172.21.15.5:0/2415302683 shutdown_connections 2024-08-18T22:23:18.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.454+0000 7f2d62a00640 1 -- 172.21.15.5:0/2415302683 wait complete. 2024-08-18T22:23:18.477 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-08-18T22:23:17.675978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302700,"kb_used_data":7496,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754672020,"statfs":{"total":773094113280,"available":772784148480,"internally_reserved":0,"allocated":7675904,"data_stored":4100788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.301920"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.666072+0000","last_change":"2024-08-18T22:23:09.402298+0000","last_active":"2024-08-18T22:23:11.666072+0000","last_peered":"2024-08-18T22:23:11.666072+0000","last_clean":"2024-08-18T22:23:11.666072+0000","last_became_active":"2024-08-18T22:23:09.401868+0000","last_became_peered":"2024-08-18T22:23:09.401868+0000","last_unstale":"2024-08-18T22:23:11.666072+0000","last_undegraded":"2024-08-18T22:23:11.666072+0000","last_fullsized":"2024-08-18T22:23:11.666072+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:14.423004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.666001+0000","last_change":"2024-08-18T22:23:09.404468+0000","last_active":"2024-08-18T22:23:11.666001+0000","last_peered":"2024-08-18T22:23:11.666001+0000","last_clean":"2024-08-18T22:23:11.666001+0000","last_became_active":"2024-08-18T22:23:09.404138+0000","last_became_peered":"2024-08-18T22:23:09.404138+0000","last_unstale":"2024-08-18T22:23:11.666001+0000","last_undegraded":"2024-08-18T22:23:11.666001+0000","last_fullsized":"2024-08-18T22:23:11.666001+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:07:03.605006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379374+0000","last_change":"2024-08-18T22:23:09.405000+0000","last_active":"2024-08-18T22:23:10.379374+0000","last_peered":"2024-08-18T22:23:10.379374+0000","last_clean":"2024-08-18T22:23:10.379374+0000","last_became_active":"2024-08-18T22:23:09.404244+0000","last_became_peered":"2024-08-18T22:23:09.404244+0000","last_unstale":"2024-08-18T22:23:10.379374+0000","last_undegraded":"2024-08-18T22:23:10.379374+0000","last_fullsized":"2024-08-18T22:23:10.379374+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:21.107675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378840+0000","last_change":"2024-08-18T22:23:09.404026+0000","last_active":"2024-08-18T22:23:10.378840+0000","last_peered":"2024-08-18T22:23:10.378840+0000","last_clean":"2024-08-18T22:23:10.378840+0000","last_became_active":"2024-08-18T22:23:09.403744+0000","last_became_peered":"2024-08-18T22:23:09.403744+0000","last_unstale":"2024-08-18T22:23:10.378840+0000","last_undegraded":"2024-08-18T22:23:10.378840+0000","last_fullsized":"2024-08-18T22:23:10.378840+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:03.641586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.663859+0000","last_change":"2024-08-18T22:23:09.403037+0000","last_active":"2024-08-18T22:23:11.663859+0000","last_peered":"2024-08-18T22:23:11.663859+0000","last_clean":"2024-08-18T22:23:11.663859+0000","last_became_active":"2024-08-18T22:23:09.402763+0000","last_became_peered":"2024-08-18T22:23:09.402763+0000","last_unstale":"2024-08-18T22:23:11.663859+0000","last_undegraded":"2024-08-18T22:23:11.663859+0000","last_fullsized":"2024-08-18T22:23:11.663859+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:09.325573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665004+0000","last_change":"2024-08-18T22:23:09.403774+0000","last_active":"2024-08-18T22:23:11.665004+0000","last_peered":"2024-08-18T22:23:11.665004+0000","last_clean":"2024-08-18T22:23:11.665004+0000","last_became_active":"2024-08-18T22:23:09.403522+0000","last_became_peered":"2024-08-18T22:23:09.403522+0000","last_unstale":"2024-08-18T22:23:11.665004+0000","last_undegraded":"2024-08-18T22:23:11.665004+0000","last_fullsized":"2024-08-18T22:23:11.665004+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:42:15.961443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376888+0000","last_change":"2024-08-18T22:23:09.395052+0000","last_active":"2024-08-18T22:23:10.376888+0000","last_peered":"2024-08-18T22:23:10.376888+0000","last_clean":"2024-08-18T22:23:10.376888+0000","last_became_active":"2024-08-18T22:23:09.394746+0000","last_became_peered":"2024-08-18T22:23:09.394746+0000","last_unstale":"2024-08-18T22:23:10.376888+0000","last_undegraded":"2024-08-18T22:23:10.376888+0000","last_fullsized":"2024-08-18T22:23:10.376888+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:39.163319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.166873+0000","last_change":"2024-08-18T22:23:09.392683+0000","last_active":"2024-08-18T22:23:11.166873+0000","last_peered":"2024-08-18T22:23:11.166873+0000","last_clean":"2024-08-18T22:23:11.166873+0000","last_became_active":"2024-08-18T22:23:09.392358+0000","last_became_peered":"2024-08-18T22:23:09.392358+0000","last_unstale":"2024-08-18T22:23:11.166873+0000","last_undegraded":"2024-08-18T22:23:11.166873+0000","last_fullsized":"2024-08-18T22:23:11.166873+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:53.586423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379708+0000","last_change":"2024-08-18T22:23:09.395439+0000","last_active":"2024-08-18T22:23:10.379708+0000","last_peered":"2024-08-18T22:23:10.379708+0000","last_clean":"2024-08-18T22:23:10.379708+0000","last_became_active":"2024-08-18T22:23:09.395217+0000","last_became_peered":"2024-08-18T22:23:09.395217+0000","last_unstale":"2024-08-18T22:23:10.379708+0000","last_undegraded":"2024-08-18T22:23:10.379708+0000","last_fullsized":"2024-08-18T22:23:10.379708+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:22.068493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379477+0000","last_change":"2024-08-18T22:23:09.387307+0000","last_active":"2024-08-18T22:23:10.379477+0000","last_peered":"2024-08-18T22:23:10.379477+0000","last_clean":"2024-08-18T22:23:10.379477+0000","last_became_active":"2024-08-18T22:23:09.387008+0000","last_became_peered":"2024-08-18T22:23:09.387008+0000","last_unstale":"2024-08-18T22:23:10.379477+0000","last_undegraded":"2024-08-18T22:23:10.379477+0000","last_fullsized":"2024-08-18T22:23:10.379477+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:03.811428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378492+0000","last_change":"2024-08-18T22:23:09.391970+0000","last_active":"2024-08-18T22:23:10.378492+0000","last_peered":"2024-08-18T22:23:10.378492+0000","last_clean":"2024-08-18T22:23:10.378492+0000","last_became_active":"2024-08-18T22:23:09.391134+0000","last_became_peered":"2024-08-18T22:23:09.391134+0000","last_unstale":"2024-08-18T22:23:10.378492+0000","last_undegraded":"2024-08-18T22:23:10.378492+0000","last_fullsized":"2024-08-18T22:23:10.378492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:45.196677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.167038+0000","last_change":"2024-08-18T22:23:09.393329+0000","last_active":"2024-08-18T22:23:11.167038+0000","last_peered":"2024-08-18T22:23:11.167038+0000","last_clean":"2024-08-18T22:23:11.167038+0000","last_became_active":"2024-08-18T22:23:09.393031+0000","last_became_peered":"2024-08-18T22:23:09.393031+0000","last_unstale":"2024-08-18T22:23:11.167038+0000","last_undegraded":"2024-08-18T22:23:11.167038+0000","last_fullsized":"2024-08-18T22:23:11.167038+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:29.750883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.167002+0000","last_change":"2024-08-18T22:23:09.398456+0000","last_active":"2024-08-18T22:23:11.167002+0000","last_peered":"2024-08-18T22:23:11.167002+0000","last_clean":"2024-08-18T22:23:11.167002+0000","last_became_active":"2024-08-18T22:23:09.398185+0000","last_became_peered":"2024-08-18T22:23:09.398185+0000","last_unstale":"2024-08-18T22:23:11.167002+0000","last_undegraded":"2024-08-18T22:23:11.167002+0000","last_fullsized":"2024-08-18T22:23:11.167002+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:51.686736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378372+0000","last_change":"2024-08-18T22:23:09.395228+0000","last_active":"2024-08-18T22:23:10.378372+0000","last_peered":"2024-08-18T22:23:10.378372+0000","last_clean":"2024-08-18T22:23:10.378372+0000","last_became_active":"2024-08-18T22:23:09.394934+0000","last_became_peered":"2024-08-18T22:23:09.394934+0000","last_unstale":"2024-08-18T22:23:10.378372+0000","last_undegraded":"2024-08-18T22:23:10.378372+0000","last_fullsized":"2024-08-18T22:23:10.378372+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:51.686736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377934+0000","last_change":"2024-08-18T22:23:09.388701+0000","last_active":"2024-08-18T22:23:10.377934+0000","last_peered":"2024-08-18T22:23:10.377934+0000","last_clean":"2024-08-18T22:23:10.377934+0000","last_became_active":"2024-08-18T22:23:09.388296+0000","last_became_peered":"2024-08-18T22:23:09.388296+0000","last_unstale":"2024-08-18T22:23:10.377934+0000","last_undegraded":"2024-08-18T22:23:10.377934+0000","last_fullsized":"2024-08-18T22:23:10.377934+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:15.317284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376855+0000","last_change":"2024-08-18T22:23:09.404695+0000","last_active":"2024-08-18T22:23:10.376855+0000","last_peered":"2024-08-18T22:23:10.376855+0000","last_clean":"2024-08-18T22:23:10.376855+0000","last_became_active":"2024-08-18T22:23:09.404441+0000","last_became_peered":"2024-08-18T22:23:09.404441+0000","last_unstale":"2024-08-18T22:23:10.376855+0000","last_undegraded":"2024-08-18T22:23:10.376855+0000","last_fullsized":"2024-08-18T22:23:10.376855+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:14.838422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.666143+0000","last_change":"2024-08-18T22:23:09.398552+0000","last_active":"2024-08-18T22:23:11.666143+0000","last_peered":"2024-08-18T22:23:11.666143+0000","last_clean":"2024-08-18T22:23:11.666143+0000","last_became_active":"2024-08-18T22:23:09.398291+0000","last_became_peered":"2024-08-18T22:23:09.398291+0000","last_unstale":"2024-08-18T22:23:11.666143+0000","last_undegraded":"2024-08-18T22:23:11.666143+0000","last_fullsized":"2024-08-18T22:23:11.666143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:09:41.059528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378673+0000","last_change":"2024-08-18T22:23:09.406570+0000","last_active":"2024-08-18T22:23:10.378673+0000","last_peered":"2024-08-18T22:23:10.378673+0000","last_clean":"2024-08-18T22:23:10.378673+0000","last_became_active":"2024-08-18T22:23:09.406243+0000","last_became_peered":"2024-08-18T22:23:09.406243+0000","last_unstale":"2024-08-18T22:23:10.378673+0000","last_undegraded":"2024-08-18T22:23:10.378673+0000","last_fullsized":"2024-08-18T22:23:10.378673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:23:09.147938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664150+0000","last_change":"2024-08-18T22:23:09.413365+0000","last_active":"2024-08-18T22:23:11.664150+0000","last_peered":"2024-08-18T22:23:11.664150+0000","last_clean":"2024-08-18T22:23:11.664150+0000","last_became_active":"2024-08-18T22:23:09.412487+0000","last_became_peered":"2024-08-18T22:23:09.412487+0000","last_unstale":"2024-08-18T22:23:11.664150+0000","last_undegraded":"2024-08-18T22:23:11.664150+0000","last_fullsized":"2024-08-18T22:23:11.664150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:07.262261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665248+0000","last_change":"2024-08-18T22:23:09.407025+0000","last_active":"2024-08-18T22:23:11.665248+0000","last_peered":"2024-08-18T22:23:11.665248+0000","last_clean":"2024-08-18T22:23:11.665248+0000","last_became_active":"2024-08-18T22:23:09.406041+0000","last_became_peered":"2024-08-18T22:23:09.406041+0000","last_unstale":"2024-08-18T22:23:11.665248+0000","last_undegraded":"2024-08-18T22:23:11.665248+0000","last_fullsized":"2024-08-18T22:23:11.665248+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:28:52.944808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.167210+0000","last_change":"2024-08-18T22:23:09.388665+0000","last_active":"2024-08-18T22:23:11.167210+0000","last_peered":"2024-08-18T22:23:11.167210+0000","last_clean":"2024-08-18T22:23:11.167210+0000","last_became_active":"2024-08-18T22:23:09.388308+0000","last_became_peered":"2024-08-18T22:23:09.388308+0000","last_unstale":"2024-08-18T22:23:11.167210+0000","last_undegraded":"2024-08-18T22:23:11.167210+0000","last_fullsized":"2024-08-18T22:23:11.167210+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:21.107675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664452+0000","last_change":"2024-08-18T22:23:09.394609+0000","last_active":"2024-08-18T22:23:11.664452+0000","last_peered":"2024-08-18T22:23:11.664452+0000","last_clean":"2024-08-18T22:23:11.664452+0000","last_became_active":"2024-08-18T22:23:09.393897+0000","last_became_peered":"2024-08-18T22:23:09.393897+0000","last_unstale":"2024-08-18T22:23:11.664452+0000","last_undegraded":"2024-08-18T22:23:11.664452+0000","last_fullsized":"2024-08-18T22:23:11.664452+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:42:20.249995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664497+0000","last_change":"2024-08-18T22:23:09.393837+0000","last_active":"2024-08-18T22:23:11.664497+0000","last_peered":"2024-08-18T22:23:11.664497+0000","last_clean":"2024-08-18T22:23:11.664497+0000","last_became_active":"2024-08-18T22:23:09.393532+0000","last_became_peered":"2024-08-18T22:23:09.393532+0000","last_unstale":"2024-08-18T22:23:11.664497+0000","last_undegraded":"2024-08-18T22:23:11.664497+0000","last_fullsized":"2024-08-18T22:23:11.664497+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:08.231507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377648+0000","last_change":"2024-08-18T22:23:09.404143+0000","last_active":"2024-08-18T22:23:10.377648+0000","last_peered":"2024-08-18T22:23:10.377648+0000","last_clean":"2024-08-18T22:23:10.377648+0000","last_became_active":"2024-08-18T22:23:09.403858+0000","last_became_peered":"2024-08-18T22:23:09.403858+0000","last_unstale":"2024-08-18T22:23:10.377648+0000","last_undegraded":"2024-08-18T22:23:10.377648+0000","last_fullsized":"2024-08-18T22:23:10.377648+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:12.308644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.167282+0000","last_change":"2024-08-18T22:23:09.398945+0000","last_active":"2024-08-18T22:23:11.167282+0000","last_peered":"2024-08-18T22:23:11.167282+0000","last_clean":"2024-08-18T22:23:11.167282+0000","last_became_active":"2024-08-18T22:23:09.398675+0000","last_became_peered":"2024-08-18T22:23:09.398675+0000","last_unstale":"2024-08-18T22:23:11.167282+0000","last_undegraded":"2024-08-18T22:23:11.167282+0000","last_fullsized":"2024-08-18T22:23:11.167282+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:05:39.990444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.166985+0000","last_change":"2024-08-18T22:23:09.399750+0000","last_active":"2024-08-18T22:23:11.166985+0000","last_peered":"2024-08-18T22:23:11.166985+0000","last_clean":"2024-08-18T22:23:11.166985+0000","last_became_active":"2024-08-18T22:23:09.399495+0000","last_became_peered":"2024-08-18T22:23:09.399495+0000","last_unstale":"2024-08-18T22:23:11.166985+0000","last_undegraded":"2024-08-18T22:23:11.166985+0000","last_fullsized":"2024-08-18T22:23:11.166985+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:12.308644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378559+0000","last_change":"2024-08-18T22:23:09.395874+0000","last_active":"2024-08-18T22:23:10.378559+0000","last_peered":"2024-08-18T22:23:10.378559+0000","last_clean":"2024-08-18T22:23:10.378559+0000","last_became_active":"2024-08-18T22:23:09.395607+0000","last_became_peered":"2024-08-18T22:23:09.395607+0000","last_unstale":"2024-08-18T22:23:10.378559+0000","last_undegraded":"2024-08-18T22:23:10.378559+0000","last_fullsized":"2024-08-18T22:23:10.378559+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:18.768258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665590+0000","last_change":"2024-08-18T22:23:09.406417+0000","last_active":"2024-08-18T22:23:11.665590+0000","last_peered":"2024-08-18T22:23:11.665590+0000","last_clean":"2024-08-18T22:23:11.665590+0000","last_became_active":"2024-08-18T22:23:09.405954+0000","last_became_peered":"2024-08-18T22:23:09.405954+0000","last_unstale":"2024-08-18T22:23:11.665590+0000","last_undegraded":"2024-08-18T22:23:11.665590+0000","last_fullsized":"2024-08-18T22:23:11.665590+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:39:00.389953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378807+0000","last_change":"2024-08-18T22:23:09.397595+0000","last_active":"2024-08-18T22:23:10.378807+0000","last_peered":"2024-08-18T22:23:10.378807+0000","last_clean":"2024-08-18T22:23:10.378807+0000","last_became_active":"2024-08-18T22:23:09.397304+0000","last_became_peered":"2024-08-18T22:23:09.397304+0000","last_unstale":"2024-08-18T22:23:10.378807+0000","last_undegraded":"2024-08-18T22:23:10.378807+0000","last_fullsized":"2024-08-18T22:23:10.378807+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:14:04.853338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.167114+0000","last_change":"2024-08-18T22:23:09.395243+0000","last_active":"2024-08-18T22:23:11.167114+0000","last_peered":"2024-08-18T22:23:11.167114+0000","last_clean":"2024-08-18T22:23:11.167114+0000","last_became_active":"2024-08-18T22:23:09.394970+0000","last_became_peered":"2024-08-18T22:23:09.394970+0000","last_unstale":"2024-08-18T22:23:11.167114+0000","last_undegraded":"2024-08-18T22:23:11.167114+0000","last_fullsized":"2024-08-18T22:23:11.167114+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:14:04.853338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377611+0000","last_change":"2024-08-18T22:23:09.387587+0000","last_active":"2024-08-18T22:23:10.377611+0000","last_peered":"2024-08-18T22:23:10.377611+0000","last_clean":"2024-08-18T22:23:10.377611+0000","last_became_active":"2024-08-18T22:23:09.387364+0000","last_became_peered":"2024-08-18T22:23:09.387364+0000","last_unstale":"2024-08-18T22:23:10.377611+0000","last_undegraded":"2024-08-18T22:23:10.377611+0000","last_fullsized":"2024-08-18T22:23:10.377611+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:22.989793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664185+0000","last_change":"2024-08-18T22:23:09.413968+0000","last_active":"2024-08-18T22:23:11.664185+0000","last_peered":"2024-08-18T22:23:11.664185+0000","last_clean":"2024-08-18T22:23:11.664185+0000","last_became_active":"2024-08-18T22:23:09.413705+0000","last_became_peered":"2024-08-18T22:23:09.413705+0000","last_unstale":"2024-08-18T22:23:11.664185+0000","last_undegraded":"2024-08-18T22:23:11.664185+0000","last_fullsized":"2024-08-18T22:23:11.664185+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:22.068493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664164+0000","last_change":"2024-08-18T22:23:09.408716+0000","last_active":"2024-08-18T22:23:11.664164+0000","last_peered":"2024-08-18T22:23:11.664164+0000","last_clean":"2024-08-18T22:23:11.664164+0000","last_became_active":"2024-08-18T22:23:09.408437+0000","last_became_peered":"2024-08-18T22:23:09.408437+0000","last_unstale":"2024-08-18T22:23:11.664164+0000","last_undegraded":"2024-08-18T22:23:11.664164+0000","last_fullsized":"2024-08-18T22:23:11.664164+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:15.576289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"66'4","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.666188+0000","last_change":"2024-08-18T22:23:08.381923+0000","last_active":"2024-08-18T22:23:11.666188+0000","last_peered":"2024-08-18T22:23:11.666188+0000","last_clean":"2024-08-18T22:23:11.666188+0000","last_became_active":"2024-08-18T22:23:08.381398+0000","last_became_peered":"2024-08-18T22:23:08.381398+0000","last_unstale":"2024-08-18T22:23:11.666188+0000","last_undegraded":"2024-08-18T22:23:11.666188+0000","last_fullsized":"2024-08-18T22:23:11.666188+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:59.582799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378673+0000","last_change":"2024-08-18T22:23:09.406503+0000","last_active":"2024-08-18T22:23:10.378673+0000","last_peered":"2024-08-18T22:23:10.378673+0000","last_clean":"2024-08-18T22:23:10.378673+0000","last_became_active":"2024-08-18T22:23:09.406229+0000","last_became_peered":"2024-08-18T22:23:09.406229+0000","last_unstale":"2024-08-18T22:23:10.378673+0000","last_undegraded":"2024-08-18T22:23:10.378673+0000","last_fullsized":"2024-08-18T22:23:10.378673+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:12.297162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665371+0000","last_change":"2024-08-18T22:23:08.395735+0000","last_active":"2024-08-18T22:23:11.665371+0000","last_peered":"2024-08-18T22:23:11.665371+0000","last_clean":"2024-08-18T22:23:11.665371+0000","last_became_active":"2024-08-18T22:23:08.395477+0000","last_became_peered":"2024-08-18T22:23:08.395477+0000","last_unstale":"2024-08-18T22:23:11.665371+0000","last_undegraded":"2024-08-18T22:23:11.665371+0000","last_fullsized":"2024-08-18T22:23:11.665371+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:28.424233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665334+0000","last_change":"2024-08-18T22:23:09.414078+0000","last_active":"2024-08-18T22:23:11.665334+0000","last_peered":"2024-08-18T22:23:11.665334+0000","last_clean":"2024-08-18T22:23:11.665334+0000","last_became_active":"2024-08-18T22:23:09.413778+0000","last_became_peered":"2024-08-18T22:23:09.413778+0000","last_unstale":"2024-08-18T22:23:11.665334+0000","last_undegraded":"2024-08-18T22:23:11.665334+0000","last_fullsized":"2024-08-18T22:23:11.665334+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:33:53.219479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665066+0000","last_change":"2024-08-18T22:23:08.390884+0000","last_active":"2024-08-18T22:23:11.665066+0000","last_peered":"2024-08-18T22:23:11.665066+0000","last_clean":"2024-08-18T22:23:11.665066+0000","last_became_active":"2024-08-18T22:23:08.390605+0000","last_became_peered":"2024-08-18T22:23:08.390605+0000","last_unstale":"2024-08-18T22:23:11.665066+0000","last_undegraded":"2024-08-18T22:23:11.665066+0000","last_fullsized":"2024-08-18T22:23:11.665066+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:13.990634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379562+0000","last_change":"2024-08-18T22:23:09.383463+0000","last_active":"2024-08-18T22:23:10.379562+0000","last_peered":"2024-08-18T22:23:10.379562+0000","last_clean":"2024-08-18T22:23:10.379562+0000","last_became_active":"2024-08-18T22:23:09.382838+0000","last_became_peered":"2024-08-18T22:23:09.382838+0000","last_unstale":"2024-08-18T22:23:10.379562+0000","last_undegraded":"2024-08-18T22:23:10.379562+0000","last_fullsized":"2024-08-18T22:23:10.379562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:05:39.990444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665048+0000","last_change":"2024-08-18T22:23:08.396665+0000","last_active":"2024-08-18T22:23:11.665048+0000","last_peered":"2024-08-18T22:23:11.665048+0000","last_clean":"2024-08-18T22:23:11.665048+0000","last_became_active":"2024-08-18T22:23:08.396386+0000","last_became_peered":"2024-08-18T22:23:08.396386+0000","last_unstale":"2024-08-18T22:23:11.665048+0000","last_undegraded":"2024-08-18T22:23:11.665048+0000","last_fullsized":"2024-08-18T22:23:11.665048+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:10.981993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.376874+0000","last_change":"2024-08-18T22:23:09.390577+0000","last_active":"2024-08-18T22:23:10.376874+0000","last_peered":"2024-08-18T22:23:10.376874+0000","last_clean":"2024-08-18T22:23:10.376874+0000","last_became_active":"2024-08-18T22:23:09.390330+0000","last_became_peered":"2024-08-18T22:23:09.390330+0000","last_unstale":"2024-08-18T22:23:10.376874+0000","last_undegraded":"2024-08-18T22:23:10.376874+0000","last_fullsized":"2024-08-18T22:23:10.376874+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:05.538156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664866+0000","last_change":"2024-08-18T22:23:08.395039+0000","last_active":"2024-08-18T22:23:11.664866+0000","last_peered":"2024-08-18T22:23:11.664866+0000","last_clean":"2024-08-18T22:23:11.664866+0000","last_became_active":"2024-08-18T22:23:08.390586+0000","last_became_peered":"2024-08-18T22:23:08.390586+0000","last_unstale":"2024-08-18T22:23:11.664866+0000","last_undegraded":"2024-08-18T22:23:11.664866+0000","last_fullsized":"2024-08-18T22:23:11.664866+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:05:38.663794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664548+0000","last_change":"2024-08-18T22:23:09.396989+0000","last_active":"2024-08-18T22:23:11.664548+0000","last_peered":"2024-08-18T22:23:11.664548+0000","last_clean":"2024-08-18T22:23:11.664548+0000","last_became_active":"2024-08-18T22:23:09.392348+0000","last_became_peered":"2024-08-18T22:23:09.392348+0000","last_unstale":"2024-08-18T22:23:11.664548+0000","last_undegraded":"2024-08-18T22:23:11.664548+0000","last_fullsized":"2024-08-18T22:23:11.664548+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:15.576289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664545+0000","last_change":"2024-08-18T22:23:08.399282+0000","last_active":"2024-08-18T22:23:11.664545+0000","last_peered":"2024-08-18T22:23:11.664545+0000","last_clean":"2024-08-18T22:23:11.664545+0000","last_became_active":"2024-08-18T22:23:08.398958+0000","last_became_peered":"2024-08-18T22:23:08.398958+0000","last_unstale":"2024-08-18T22:23:11.664545+0000","last_undegraded":"2024-08-18T22:23:11.664545+0000","last_fullsized":"2024-08-18T22:23:11.664545+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:19.781025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.663761+0000","last_change":"2024-08-18T22:23:09.410938+0000","last_active":"2024-08-18T22:23:11.663761+0000","last_peered":"2024-08-18T22:23:11.663761+0000","last_clean":"2024-08-18T22:23:11.663761+0000","last_became_active":"2024-08-18T22:23:09.410566+0000","last_became_peered":"2024-08-18T22:23:09.410566+0000","last_unstale":"2024-08-18T22:23:11.663761+0000","last_undegraded":"2024-08-18T22:23:11.663761+0000","last_fullsized":"2024-08-18T22:23:11.663761+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:07.322826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664584+0000","last_change":"2024-08-18T22:23:08.397746+0000","last_active":"2024-08-18T22:23:11.664584+0000","last_peered":"2024-08-18T22:23:11.664584+0000","last_clean":"2024-08-18T22:23:11.664584+0000","last_became_active":"2024-08-18T22:23:08.397305+0000","last_became_peered":"2024-08-18T22:23:08.397305+0000","last_unstale":"2024-08-18T22:23:11.664584+0000","last_undegraded":"2024-08-18T22:23:11.664584+0000","last_fullsized":"2024-08-18T22:23:11.664584+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:44.681254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664775+0000","last_change":"2024-08-18T22:23:09.395840+0000","last_active":"2024-08-18T22:23:11.664775+0000","last_peered":"2024-08-18T22:23:11.664775+0000","last_clean":"2024-08-18T22:23:11.664775+0000","last_became_active":"2024-08-18T22:23:09.395582+0000","last_became_peered":"2024-08-18T22:23:09.395582+0000","last_unstale":"2024-08-18T22:23:11.664775+0000","last_undegraded":"2024-08-18T22:23:11.664775+0000","last_fullsized":"2024-08-18T22:23:11.664775+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:14.234640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.663687+0000","last_change":"2024-08-18T22:23:08.393396+0000","last_active":"2024-08-18T22:23:11.663687+0000","last_peered":"2024-08-18T22:23:11.663687+0000","last_clean":"2024-08-18T22:23:11.663687+0000","last_became_active":"2024-08-18T22:23:08.393124+0000","last_became_peered":"2024-08-18T22:23:08.393124+0000","last_unstale":"2024-08-18T22:23:11.663687+0000","last_undegraded":"2024-08-18T22:23:11.663687+0000","last_fullsized":"2024-08-18T22:23:11.663687+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:21.673149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665659+0000","last_change":"2024-08-18T22:23:09.391090+0000","last_active":"2024-08-18T22:23:11.665659+0000","last_peered":"2024-08-18T22:23:11.665659+0000","last_clean":"2024-08-18T22:23:11.665659+0000","last_became_active":"2024-08-18T22:23:09.390394+0000","last_became_peered":"2024-08-18T22:23:09.390394+0000","last_unstale":"2024-08-18T22:23:11.665659+0000","last_undegraded":"2024-08-18T22:23:11.665659+0000","last_fullsized":"2024-08-18T22:23:11.665659+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:08:23.321647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379870+0000","last_change":"2024-08-18T22:23:08.393152+0000","last_active":"2024-08-18T22:23:10.379870+0000","last_peered":"2024-08-18T22:23:10.379870+0000","last_clean":"2024-08-18T22:23:10.379870+0000","last_became_active":"2024-08-18T22:23:08.392860+0000","last_became_peered":"2024-08-18T22:23:08.392860+0000","last_unstale":"2024-08-18T22:23:10.379870+0000","last_undegraded":"2024-08-18T22:23:10.379870+0000","last_fullsized":"2024-08-18T22:23:10.379870+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:07:02.278355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665443+0000","last_change":"2024-08-18T22:23:09.398891+0000","last_active":"2024-08-18T22:23:11.665443+0000","last_peered":"2024-08-18T22:23:11.665443+0000","last_clean":"2024-08-18T22:23:11.665443+0000","last_became_active":"2024-08-18T22:23:09.398535+0000","last_became_peered":"2024-08-18T22:23:09.398535+0000","last_unstale":"2024-08-18T22:23:11.665443+0000","last_undegraded":"2024-08-18T22:23:11.665443+0000","last_fullsized":"2024-08-18T22:23:11.665443+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:05.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378791+0000","last_change":"2024-08-18T22:23:08.390558+0000","last_active":"2024-08-18T22:23:10.378791+0000","last_peered":"2024-08-18T22:23:10.378791+0000","last_clean":"2024-08-18T22:23:10.378791+0000","last_became_active":"2024-08-18T22:23:08.389931+0000","last_became_peered":"2024-08-18T22:23:08.389931+0000","last_unstale":"2024-08-18T22:23:10.378791+0000","last_undegraded":"2024-08-18T22:23:10.378791+0000","last_fullsized":"2024-08-18T22:23:10.378791+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:42.339748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664250+0000","last_change":"2024-08-18T22:23:09.406457+0000","last_active":"2024-08-18T22:23:11.664250+0000","last_peered":"2024-08-18T22:23:11.664250+0000","last_clean":"2024-08-18T22:23:11.664250+0000","last_became_active":"2024-08-18T22:23:09.406192+0000","last_became_peered":"2024-08-18T22:23:09.406192+0000","last_unstale":"2024-08-18T22:23:11.664250+0000","last_undegraded":"2024-08-18T22:23:11.664250+0000","last_fullsized":"2024-08-18T22:23:11.664250+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:39:00.389953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"66'3","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379304+0000","last_change":"2024-08-18T22:23:08.391640+0000","last_active":"2024-08-18T22:23:10.379304+0000","last_peered":"2024-08-18T22:23:10.379304+0000","last_clean":"2024-08-18T22:23:10.379304+0000","last_became_active":"2024-08-18T22:23:08.391377+0000","last_became_peered":"2024-08-18T22:23:08.391377+0000","last_unstale":"2024-08-18T22:23:10.379304+0000","last_undegraded":"2024-08-18T22:23:10.379304+0000","last_fullsized":"2024-08-18T22:23:10.379304+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:03.937885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379015+0000","last_change":"2024-08-18T22:23:09.394815+0000","last_active":"2024-08-18T22:23:10.379015+0000","last_peered":"2024-08-18T22:23:10.379015+0000","last_clean":"2024-08-18T22:23:10.379015+0000","last_became_active":"2024-08-18T22:23:09.391502+0000","last_became_peered":"2024-08-18T22:23:09.391502+0000","last_unstale":"2024-08-18T22:23:10.379015+0000","last_undegraded":"2024-08-18T22:23:10.379015+0000","last_fullsized":"2024-08-18T22:23:10.379015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:42.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"66'6","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665701+0000","last_change":"2024-08-18T22:23:08.382205+0000","last_active":"2024-08-18T22:23:11.665701+0000","last_peered":"2024-08-18T22:23:11.665701+0000","last_clean":"2024-08-18T22:23:11.665701+0000","last_became_active":"2024-08-18T22:23:08.381817+0000","last_became_peered":"2024-08-18T22:23:08.381817+0000","last_unstale":"2024-08-18T22:23:11.665701+0000","last_undegraded":"2024-08-18T22:23:11.665701+0000","last_fullsized":"2024-08-18T22:23:11.665701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:22:16.432033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377624+0000","last_change":"2024-08-18T22:23:09.385959+0000","last_active":"2024-08-18T22:23:10.377624+0000","last_peered":"2024-08-18T22:23:10.377624+0000","last_clean":"2024-08-18T22:23:10.377624+0000","last_became_active":"2024-08-18T22:23:09.385743+0000","last_became_peered":"2024-08-18T22:23:09.385743+0000","last_unstale":"2024-08-18T22:23:10.377624+0000","last_undegraded":"2024-08-18T22:23:10.377624+0000","last_fullsized":"2024-08-18T22:23:10.377624+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:44:47.120395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378904+0000","last_change":"2024-08-18T22:23:08.395722+0000","last_active":"2024-08-18T22:23:10.378904+0000","last_peered":"2024-08-18T22:23:10.378904+0000","last_clean":"2024-08-18T22:23:10.378904+0000","last_became_active":"2024-08-18T22:23:08.395423+0000","last_became_peered":"2024-08-18T22:23:08.395423+0000","last_unstale":"2024-08-18T22:23:10.378904+0000","last_undegraded":"2024-08-18T22:23:10.378904+0000","last_fullsized":"2024-08-18T22:23:10.378904+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:09:39.732878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.166853+0000","last_change":"2024-08-18T22:23:09.404980+0000","last_active":"2024-08-18T22:23:11.166853+0000","last_peered":"2024-08-18T22:23:11.166853+0000","last_clean":"2024-08-18T22:23:11.166853+0000","last_became_active":"2024-08-18T22:23:09.404673+0000","last_became_peered":"2024-08-18T22:23:09.404673+0000","last_unstale":"2024-08-18T22:23:11.166853+0000","last_undegraded":"2024-08-18T22:23:11.166853+0000","last_fullsized":"2024-08-18T22:23:11.166853+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:42.292809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.166755+0000","last_change":"2024-08-18T22:23:08.391632+0000","last_active":"2024-08-18T22:23:11.166755+0000","last_peered":"2024-08-18T22:23:11.166755+0000","last_clean":"2024-08-18T22:23:11.166755+0000","last_became_active":"2024-08-18T22:23:08.391350+0000","last_became_peered":"2024-08-18T22:23:08.391350+0000","last_unstale":"2024-08-18T22:23:11.166755+0000","last_undegraded":"2024-08-18T22:23:11.166755+0000","last_fullsized":"2024-08-18T22:23:11.166755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:54.525986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.663766+0000","last_change":"2024-08-18T22:23:09.399369+0000","last_active":"2024-08-18T22:23:11.663766+0000","last_peered":"2024-08-18T22:23:11.663766+0000","last_clean":"2024-08-18T22:23:11.663766+0000","last_became_active":"2024-08-18T22:23:09.399073+0000","last_became_peered":"2024-08-18T22:23:09.399073+0000","last_unstale":"2024-08-18T22:23:11.663766+0000","last_undegraded":"2024-08-18T22:23:11.663766+0000","last_fullsized":"2024-08-18T22:23:11.663766+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:43:18.604275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377997+0000","last_change":"2024-08-18T22:23:08.388076+0000","last_active":"2024-08-18T22:23:10.377997+0000","last_peered":"2024-08-18T22:23:10.377997+0000","last_clean":"2024-08-18T22:23:10.377997+0000","last_became_active":"2024-08-18T22:23:08.387745+0000","last_became_peered":"2024-08-18T22:23:08.387745+0000","last_unstale":"2024-08-18T22:23:10.377997+0000","last_undegraded":"2024-08-18T22:23:10.377997+0000","last_fullsized":"2024-08-18T22:23:10.377997+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:08:21.994997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665812+0000","last_change":"2024-08-18T22:23:09.389518+0000","last_active":"2024-08-18T22:23:11.665812+0000","last_peered":"2024-08-18T22:23:11.665812+0000","last_clean":"2024-08-18T22:23:11.665812+0000","last_became_active":"2024-08-18T22:23:09.389259+0000","last_became_peered":"2024-08-18T22:23:09.389259+0000","last_unstale":"2024-08-18T22:23:11.665812+0000","last_undegraded":"2024-08-18T22:23:11.665812+0000","last_fullsized":"2024-08-18T22:23:11.665812+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:10:25.165426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377736+0000","last_change":"2024-08-18T22:23:08.384953+0000","last_active":"2024-08-18T22:23:10.377736+0000","last_peered":"2024-08-18T22:23:10.377736+0000","last_clean":"2024-08-18T22:23:10.377736+0000","last_became_active":"2024-08-18T22:23:08.384684+0000","last_became_peered":"2024-08-18T22:23:08.384684+0000","last_unstale":"2024-08-18T22:23:10.377736+0000","last_undegraded":"2024-08-18T22:23:10.377736+0000","last_fullsized":"2024-08-18T22:23:10.377736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:22:31.028819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379237+0000","last_change":"2024-08-18T22:23:09.395053+0000","last_active":"2024-08-18T22:23:10.379237+0000","last_peered":"2024-08-18T22:23:10.379237+0000","last_clean":"2024-08-18T22:23:10.379237+0000","last_became_active":"2024-08-18T22:23:09.394776+0000","last_became_peered":"2024-08-18T22:23:09.394776+0000","last_unstale":"2024-08-18T22:23:10.379237+0000","last_undegraded":"2024-08-18T22:23:10.379237+0000","last_fullsized":"2024-08-18T22:23:10.379237+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:29.750883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.167194+0000","last_change":"2024-08-18T22:23:08.391894+0000","last_active":"2024-08-18T22:23:11.167194+0000","last_peered":"2024-08-18T22:23:11.167194+0000","last_clean":"2024-08-18T22:23:11.167194+0000","last_became_active":"2024-08-18T22:23:08.391616+0000","last_became_peered":"2024-08-18T22:23:08.391616+0000","last_unstale":"2024-08-18T22:23:11.167194+0000","last_undegraded":"2024-08-18T22:23:11.167194+0000","last_fullsized":"2024-08-18T22:23:11.167194+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:10:23.838776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664187+0000","last_change":"2024-08-18T22:23:09.407271+0000","last_active":"2024-08-18T22:23:11.664187+0000","last_peered":"2024-08-18T22:23:11.664187+0000","last_clean":"2024-08-18T22:23:11.664187+0000","last_became_active":"2024-08-18T22:23:09.407019+0000","last_became_peered":"2024-08-18T22:23:09.407019+0000","last_unstale":"2024-08-18T22:23:11.664187+0000","last_undegraded":"2024-08-18T22:23:11.664187+0000","last_fullsized":"2024-08-18T22:23:11.664187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:55.852636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379444+0000","last_change":"2024-08-18T22:23:08.394584+0000","last_active":"2024-08-18T22:23:10.379444+0000","last_peered":"2024-08-18T22:23:10.379444+0000","last_clean":"2024-08-18T22:23:10.379444+0000","last_became_active":"2024-08-18T22:23:08.394230+0000","last_became_peered":"2024-08-18T22:23:08.394230+0000","last_unstale":"2024-08-18T22:23:10.379444+0000","last_undegraded":"2024-08-18T22:23:10.379444+0000","last_fullsized":"2024-08-18T22:23:10.379444+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:13.096354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378753+0000","last_change":"2024-08-18T22:23:09.406775+0000","last_active":"2024-08-18T22:23:10.378753+0000","last_peered":"2024-08-18T22:23:10.378753+0000","last_clean":"2024-08-18T22:23:10.378753+0000","last_became_active":"2024-08-18T22:23:09.402616+0000","last_became_peered":"2024-08-18T22:23:09.402616+0000","last_unstale":"2024-08-18T22:23:10.378753+0000","last_undegraded":"2024-08-18T22:23:10.378753+0000","last_fullsized":"2024-08-18T22:23:10.378753+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:29.447896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379473+0000","last_change":"2024-08-18T22:23:08.392035+0000","last_active":"2024-08-18T22:23:10.379473+0000","last_peered":"2024-08-18T22:23:10.379473+0000","last_clean":"2024-08-18T22:23:10.379473+0000","last_became_active":"2024-08-18T22:23:08.391621+0000","last_became_peered":"2024-08-18T22:23:08.391621+0000","last_unstale":"2024-08-18T22:23:10.379473+0000","last_undegraded":"2024-08-18T22:23:10.379473+0000","last_fullsized":"2024-08-18T22:23:10.379473+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:16:46.918953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664314+0000","last_change":"2024-08-18T22:23:09.408669+0000","last_active":"2024-08-18T22:23:11.664314+0000","last_peered":"2024-08-18T22:23:11.664314+0000","last_clean":"2024-08-18T22:23:11.664314+0000","last_became_active":"2024-08-18T22:23:09.405820+0000","last_became_peered":"2024-08-18T22:23:09.405820+0000","last_unstale":"2024-08-18T22:23:11.664314+0000","last_undegraded":"2024-08-18T22:23:11.664314+0000","last_fullsized":"2024-08-18T22:23:11.664314+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:08:23.321647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665429+0000","last_change":"2024-08-18T22:23:08.385515+0000","last_active":"2024-08-18T22:23:11.665429+0000","last_peered":"2024-08-18T22:23:11.665429+0000","last_clean":"2024-08-18T22:23:11.665429+0000","last_became_active":"2024-08-18T22:23:08.385221+0000","last_became_peered":"2024-08-18T22:23:08.385221+0000","last_unstale":"2024-08-18T22:23:11.665429+0000","last_undegraded":"2024-08-18T22:23:11.665429+0000","last_fullsized":"2024-08-18T22:23:11.665429+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:20.741843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664334+0000","last_change":"2024-08-18T22:23:09.413883+0000","last_active":"2024-08-18T22:23:11.664334+0000","last_peered":"2024-08-18T22:23:11.664334+0000","last_clean":"2024-08-18T22:23:11.664334+0000","last_became_active":"2024-08-18T22:23:09.413535+0000","last_became_peered":"2024-08-18T22:23:09.413535+0000","last_unstale":"2024-08-18T22:23:11.664334+0000","last_undegraded":"2024-08-18T22:23:11.664334+0000","last_fullsized":"2024-08-18T22:23:11.664334+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:46.007904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664910+0000","last_change":"2024-08-18T22:23:08.399434+0000","last_active":"2024-08-18T22:23:11.664910+0000","last_peered":"2024-08-18T22:23:11.664910+0000","last_clean":"2024-08-18T22:23:11.664910+0000","last_became_active":"2024-08-18T22:23:08.398753+0000","last_became_peered":"2024-08-18T22:23:08.398753+0000","last_unstale":"2024-08-18T22:23:11.664910+0000","last_undegraded":"2024-08-18T22:23:11.664910+0000","last_fullsized":"2024-08-18T22:23:11.664910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:40.966159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.166837+0000","last_change":"2024-08-18T22:23:09.396659+0000","last_active":"2024-08-18T22:23:11.166837+0000","last_peered":"2024-08-18T22:23:11.166837+0000","last_clean":"2024-08-18T22:23:11.166837+0000","last_became_active":"2024-08-18T22:23:09.396357+0000","last_became_peered":"2024-08-18T22:23:09.396357+0000","last_unstale":"2024-08-18T22:23:11.166837+0000","last_undegraded":"2024-08-18T22:23:11.166837+0000","last_fullsized":"2024-08-18T22:23:11.166837+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:15.317284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.166956+0000","last_change":"2024-08-18T22:23:08.391747+0000","last_active":"2024-08-18T22:23:11.166956+0000","last_peered":"2024-08-18T22:23:11.166956+0000","last_clean":"2024-08-18T22:23:11.166956+0000","last_became_active":"2024-08-18T22:23:08.391425+0000","last_became_peered":"2024-08-18T22:23:08.391425+0000","last_unstale":"2024-08-18T22:23:11.166956+0000","last_undegraded":"2024-08-18T22:23:11.166956+0000","last_fullsized":"2024-08-18T22:23:11.166956+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:59.063303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.663973+0000","last_change":"2024-08-18T22:23:09.403995+0000","last_active":"2024-08-18T22:23:11.663973+0000","last_peered":"2024-08-18T22:23:11.663973+0000","last_clean":"2024-08-18T22:23:11.663973+0000","last_became_active":"2024-08-18T22:23:09.403723+0000","last_became_peered":"2024-08-18T22:23:09.403723+0000","last_unstale":"2024-08-18T22:23:11.663973+0000","last_undegraded":"2024-08-18T22:23:11.663973+0000","last_fullsized":"2024-08-18T22:23:11.663973+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:44.335734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664670+0000","last_change":"2024-08-18T22:23:08.391816+0000","last_active":"2024-08-18T22:23:11.664670+0000","last_peered":"2024-08-18T22:23:11.664670+0000","last_clean":"2024-08-18T22:23:11.664670+0000","last_became_active":"2024-08-18T22:23:08.391406+0000","last_became_peered":"2024-08-18T22:23:08.391406+0000","last_unstale":"2024-08-18T22:23:11.664670+0000","last_undegraded":"2024-08-18T22:23:11.664670+0000","last_fullsized":"2024-08-18T22:23:11.664670+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:52.259773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665047+0000","last_change":"2024-08-18T22:23:09.411275+0000","last_active":"2024-08-18T22:23:11.665047+0000","last_peered":"2024-08-18T22:23:11.665047+0000","last_clean":"2024-08-18T22:23:11.665047+0000","last_became_active":"2024-08-18T22:23:09.410970+0000","last_became_peered":"2024-08-18T22:23:09.410970+0000","last_unstale":"2024-08-18T22:23:11.665047+0000","last_undegraded":"2024-08-18T22:23:11.665047+0000","last_fullsized":"2024-08-18T22:23:11.665047+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:20.966019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.167387+0000","last_change":"2024-08-18T22:23:08.388283+0000","last_active":"2024-08-18T22:23:11.167387+0000","last_peered":"2024-08-18T22:23:11.167387+0000","last_clean":"2024-08-18T22:23:11.167387+0000","last_became_active":"2024-08-18T22:23:08.387990+0000","last_became_peered":"2024-08-18T22:23:08.387990+0000","last_unstale":"2024-08-18T22:23:11.167387+0000","last_undegraded":"2024-08-18T22:23:11.167387+0000","last_fullsized":"2024-08-18T22:23:11.167387+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:07:02.278355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377137+0000","last_change":"2024-08-18T22:23:09.416113+0000","last_active":"2024-08-18T22:23:10.377137+0000","last_peered":"2024-08-18T22:23:10.377137+0000","last_clean":"2024-08-18T22:23:10.377137+0000","last_became_active":"2024-08-18T22:23:09.415833+0000","last_became_peered":"2024-08-18T22:23:09.415833+0000","last_unstale":"2024-08-18T22:23:10.377137+0000","last_undegraded":"2024-08-18T22:23:10.377137+0000","last_fullsized":"2024-08-18T22:23:10.377137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:31:02.876930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"67'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.167333+0000","last_change":"2024-08-18T22:23:08.390232+0000","last_active":"2024-08-18T22:23:11.167333+0000","last_peered":"2024-08-18T22:23:11.167333+0000","last_clean":"2024-08-18T22:23:11.167333+0000","last_became_active":"2024-08-18T22:23:08.389799+0000","last_became_peered":"2024-08-18T22:23:08.389799+0000","last_unstale":"2024-08-18T22:23:11.167333+0000","last_undegraded":"2024-08-18T22:23:11.167333+0000","last_fullsized":"2024-08-18T22:23:11.167333+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:13.096354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.167243+0000","last_change":"2024-08-18T22:23:09.415128+0000","last_active":"2024-08-18T22:23:11.167243+0000","last_peered":"2024-08-18T22:23:11.167243+0000","last_clean":"2024-08-18T22:23:11.167243+0000","last_became_active":"2024-08-18T22:23:09.414669+0000","last_became_peered":"2024-08-18T22:23:09.414669+0000","last_unstale":"2024-08-18T22:23:11.167243+0000","last_undegraded":"2024-08-18T22:23:11.167243+0000","last_fullsized":"2024-08-18T22:23:11.167243+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:03.811428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665082+0000","last_change":"2024-08-18T22:23:08.390855+0000","last_active":"2024-08-18T22:23:11.665082+0000","last_peered":"2024-08-18T22:23:11.665082+0000","last_clean":"2024-08-18T22:23:11.665082+0000","last_became_active":"2024-08-18T22:23:08.390531+0000","last_became_peered":"2024-08-18T22:23:08.390531+0000","last_unstale":"2024-08-18T22:23:11.665082+0000","last_undegraded":"2024-08-18T22:23:11.665082+0000","last_fullsized":"2024-08-18T22:23:11.665082+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:50.360086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664366+0000","last_change":"2024-08-18T22:23:09.408370+0000","last_active":"2024-08-18T22:23:11.664366+0000","last_peered":"2024-08-18T22:23:11.664366+0000","last_clean":"2024-08-18T22:23:11.664366+0000","last_became_active":"2024-08-18T22:23:09.405449+0000","last_became_peered":"2024-08-18T22:23:09.405449+0000","last_unstale":"2024-08-18T22:23:11.664366+0000","last_undegraded":"2024-08-18T22:23:11.664366+0000","last_fullsized":"2024-08-18T22:23:11.664366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:10:25.165426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665748+0000","last_change":"2024-08-18T22:23:08.391499+0000","last_active":"2024-08-18T22:23:11.665748+0000","last_peered":"2024-08-18T22:23:11.665748+0000","last_clean":"2024-08-18T22:23:11.665748+0000","last_became_active":"2024-08-18T22:23:08.391180+0000","last_became_peered":"2024-08-18T22:23:08.391180+0000","last_unstale":"2024-08-18T22:23:11.665748+0000","last_undegraded":"2024-08-18T22:23:11.665748+0000","last_fullsized":"2024-08-18T22:23:11.665748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:28.768966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.663728+0000","last_change":"2024-08-18T22:23:09.406843+0000","last_active":"2024-08-18T22:23:11.663728+0000","last_peered":"2024-08-18T22:23:11.663728+0000","last_clean":"2024-08-18T22:23:11.663728+0000","last_became_active":"2024-08-18T22:23:09.406546+0000","last_became_peered":"2024-08-18T22:23:09.406546+0000","last_unstale":"2024-08-18T22:23:11.663728+0000","last_undegraded":"2024-08-18T22:23:11.663728+0000","last_fullsized":"2024-08-18T22:23:11.663728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:44:37.785674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.379008+0000","last_change":"2024-08-18T22:23:08.390531+0000","last_active":"2024-08-18T22:23:10.379008+0000","last_peered":"2024-08-18T22:23:10.379008+0000","last_clean":"2024-08-18T22:23:10.379008+0000","last_became_active":"2024-08-18T22:23:08.390244+0000","last_became_peered":"2024-08-18T22:23:08.390244+0000","last_unstale":"2024-08-18T22:23:10.379008+0000","last_undegraded":"2024-08-18T22:23:10.379008+0000","last_fullsized":"2024-08-18T22:23:10.379008+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:10:23.838776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.378005+0000","last_change":"2024-08-18T22:23:09.385451+0000","last_active":"2024-08-18T22:23:10.378005+0000","last_peered":"2024-08-18T22:23:10.378005+0000","last_clean":"2024-08-18T22:23:10.378005+0000","last_became_active":"2024-08-18T22:23:09.385180+0000","last_became_peered":"2024-08-18T22:23:09.385180+0000","last_unstale":"2024-08-18T22:23:10.378005+0000","last_undegraded":"2024-08-18T22:23:10.378005+0000","last_fullsized":"2024-08-18T22:23:10.378005+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:30.197348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664638+0000","last_change":"2024-08-18T22:23:08.395413+0000","last_active":"2024-08-18T22:23:11.664638+0000","last_peered":"2024-08-18T22:23:11.664638+0000","last_clean":"2024-08-18T22:23:11.664638+0000","last_became_active":"2024-08-18T22:23:08.394853+0000","last_became_peered":"2024-08-18T22:23:08.394853+0000","last_unstale":"2024-08-18T22:23:11.664638+0000","last_undegraded":"2024-08-18T22:23:11.664638+0000","last_fullsized":"2024-08-18T22:23:11.664638+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:15:02.484778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.665142+0000","last_change":"2024-08-18T22:23:09.388337+0000","last_active":"2024-08-18T22:23:11.665142+0000","last_peered":"2024-08-18T22:23:11.665142+0000","last_clean":"2024-08-18T22:23:11.665142+0000","last_became_active":"2024-08-18T22:23:09.388087+0000","last_became_peered":"2024-08-18T22:23:09.388087+0000","last_unstale":"2024-08-18T22:23:11.665142+0000","last_undegraded":"2024-08-18T22:23:11.665142+0000","last_fullsized":"2024-08-18T22:23:11.665142+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:55.852636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664668+0000","last_change":"2024-08-18T22:23:08.397936+0000","last_active":"2024-08-18T22:23:11.664668+0000","last_peered":"2024-08-18T22:23:11.664668+0000","last_clean":"2024-08-18T22:23:11.664668+0000","last_became_active":"2024-08-18T22:23:08.397588+0000","last_became_peered":"2024-08-18T22:23:08.397588+0000","last_unstale":"2024-08-18T22:23:11.664668+0000","last_undegraded":"2024-08-18T22:23:11.664668+0000","last_fullsized":"2024-08-18T22:23:11.664668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:42:14.634793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377070+0000","last_change":"2024-08-18T22:23:09.400184+0000","last_active":"2024-08-18T22:23:10.377070+0000","last_peered":"2024-08-18T22:23:10.377070+0000","last_clean":"2024-08-18T22:23:10.377070+0000","last_became_active":"2024-08-18T22:23:09.399916+0000","last_became_peered":"2024-08-18T22:23:09.399916+0000","last_unstale":"2024-08-18T22:23:10.377070+0000","last_undegraded":"2024-08-18T22:23:10.377070+0000","last_fullsized":"2024-08-18T22:23:10.377070+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:36:47.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664232+0000","last_change":"2024-08-18T22:23:08.395341+0000","last_active":"2024-08-18T22:23:11.664232+0000","last_peered":"2024-08-18T22:23:11.664232+0000","last_clean":"2024-08-18T22:23:11.664232+0000","last_became_active":"2024-08-18T22:23:08.395079+0000","last_became_peered":"2024-08-18T22:23:08.395079+0000","last_unstale":"2024-08-18T22:23:11.664232+0000","last_undegraded":"2024-08-18T22:23:11.664232+0000","last_fullsized":"2024-08-18T22:23:11.664232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:04:32.465440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.663909+0000","last_change":"2024-08-18T22:23:09.393082+0000","last_active":"2024-08-18T22:23:11.663909+0000","last_peered":"2024-08-18T22:23:11.663909+0000","last_clean":"2024-08-18T22:23:11.663909+0000","last_became_active":"2024-08-18T22:23:09.392585+0000","last_became_peered":"2024-08-18T22:23:09.392585+0000","last_unstale":"2024-08-18T22:23:11.663909+0000","last_undegraded":"2024-08-18T22:23:11.663909+0000","last_fullsized":"2024-08-18T22:23:11.663909+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:08.364735+0000","last_clean_scrub_stamp":"2024-08-18T22:23:08.364735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:50.561211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:11.664278+0000","last_change":"2024-08-18T22:23:08.389367+0000","last_active":"2024-08-18T22:23:11.664278+0000","last_peered":"2024-08-18T22:23:11.664278+0000","last_clean":"2024-08-18T22:23:11.664278+0000","last_became_active":"2024-08-18T22:23:08.389090+0000","last_became_peered":"2024-08-18T22:23:08.389090+0000","last_unstale":"2024-08-18T22:23:11.664278+0000","last_undegraded":"2024-08-18T22:23:11.664278+0000","last_fullsized":"2024-08-18T22:23:11.664278+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:07.038085+0000","last_clean_scrub_stamp":"2024-08-18T22:23:07.038085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:28.424233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":264,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-08-18T22:23:10.377759+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:23:10.377759+0000","last_peered":"2024-08-18T22:23:10.377759+0000","last_clean":"2024-08-18T22:23:10.377759+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:23:10.377759+0000","last_undegraded":"2024-08-18T22:23:10.377759+0000","last_fullsized":"2024-08-18T22:23:10.377759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509492,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36724,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335116,"statfs":{"total":96636764160,"available":96599158784,"internally_reserved":0,"allocated":1413120,"data_stored":955548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36128,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335712,"statfs":{"total":96636764160,"available":96599769088,"internally_reserved":0,"allocated":806912,"data_stored":364438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509492,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36128,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335712,"statfs":{"total":96636764160,"available":96599769088,"internally_reserved":0,"allocated":806912,"data_stored":364426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40284,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331556,"statfs":{"total":96636764160,"available":96595513344,"internally_reserved":0,"allocated":802816,"data_stored":364404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40312,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331528,"statfs":{"total":96636764160,"available":96595484672,"internally_reserved":0,"allocated":831488,"data_stored":366780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40864,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330976,"statfs":{"total":96636764160,"available":96594919424,"internally_reserved":0,"allocated":1396736,"data_stored":954772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":815104,"data_stored":366016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":802816,"data_stored":364404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:23:18.481 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:23:18.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:23:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.662+0000 7fb736c00640 1 Processor -- start 2024-08-18T22:23:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.662+0000 7fb736c00640 1 -- start start 2024-08-18T22:23:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb736c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73015fb80 0x7fb7300d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb736c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7300d30b0 con 0x7fb7300d1090 2024-08-18T22:23:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb736c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7300d1bd0 con 0x7fb7300b5ad0 2024-08-18T22:23:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb736c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb730071c60 con 0x7fb73015fb80 2024-08-18T22:23:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb734c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb7300d1090 0x7fb730071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47254/0 (socket says 172.21.15.5:47254) 2024-08-18T22:23:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb734c00640 1 -- 172.21.15.5:0/2211607412 learned_addr learned my addr 172.21.15.5:0/2211607412 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72fe00640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73015fb80 0x7fb7300d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969125411 0 0) 0x7fb7300d30b0 con 0x7fb7300d1090 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb714003530 con 0x7fb7300d1090 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493888188 0 0) 0x7fb7300d1bd0 con 0x7fb7300b5ad0 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7300d30b0 con 0x7fb7300b5ad0 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1096903856 0 0) 0x7fb714003530 con 0x7fb7300d1090 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73015fb80 msgr2=0x7fb7300d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73015fb80 0x7fb7300d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 >> v1:172.21.15.117:6789/0 conn(0x7fb7300b5ad0 legacy=0x7fb73006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7300d2dd0 con 0x7fb7300d1090 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fb728001a00 con 0x7fb7300d1090 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 >> v1:172.21.15.5:6789/0 conn(0x7fb7300d1090 legacy=0x7fb730071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73015fb80 0x7fb714003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 0x7fb714004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb714004d50 0x7fb7140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb730071c60 con 0x7fb7140040e0 2024-08-18T22:23:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb71400bbe0 con 0x7fb714004d50 2024-08-18T22:23:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb71400bde0 con 0x7fb73015fb80 2024-08-18T22:23:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb727400640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 0x7fb714004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb72fe00640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73015fb80 0x7fb714003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb734c00640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb714004d50 0x7fb7140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb727400640 1 -- 172.21.15.5:0/2211607412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73015fb80 msgr2=0x7fb714003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb727400640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73015fb80 0x7fb714003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb727400640 1 -- 172.21.15.5:0/2211607412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb714004d50 msgr2=0x7fb7140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb727400640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb714004d50 0x7fb7140051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.666+0000 7fb727400640 1 -- 172.21.15.5:0/2211607412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb714003530 con 0x7fb7140040e0 2024-08-18T22:23:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb727400640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 0x7fb714004810 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb730074220 tx=0x7fb71801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361ae75768296097 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718001520 con 0x7fb7140040e0 2024-08-18T22:23:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7180052f0 con 0x7fb7140040e0 2024-08-18T22:23:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb72f400640 1 -- 172.21.15.5:0/2211607412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718003840 con 0x7fb7140040e0 2024-08-18T22:23:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb736c00640 1 -- 172.21.15.5:0/2211607412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 msgr2=0x7fb714004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb736c00640 1 --2- 172.21.15.5:0/2211607412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 0x7fb714004810 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb730074220 tx=0x7fb71801c560 comp rx=0 tx=0).stop 2024-08-18T22:23:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb734c00640 1 -- 172.21.15.5:0/2211607412 reap_dead start 2024-08-18T22:23:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb736c00640 1 -- 172.21.15.5:0/2211607412 shutdown_connections 2024-08-18T22:23:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb736c00640 1 -- 172.21.15.5:0/2211607412 >> 172.21.15.5:0/2211607412 conn(0x7fb7300d2180 msgr2=0x7fb7300d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb736c00640 1 -- 172.21.15.5:0/2211607412 shutdown_connections 2024-08-18T22:23:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb736c00640 1 -- 172.21.15.5:0/2211607412 wait complete. 2024-08-18T22:23:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb736c00640 1 Processor -- start 2024-08-18T22:23:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.670+0000 7fb736c00640 1 -- start start 2024-08-18T22:23:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb736c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 0x7fb730146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb736c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7300b0170 0x7fb7300b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb736c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73006cac0 0x7fb73006cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb736c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb7300b5ed0 con 0x7fb7140040e0 2024-08-18T22:23:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb736c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7300d1eb0 con 0x7fb7300b0170 2024-08-18T22:23:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb736c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb730168300 con 0x7fb73006cac0 2024-08-18T22:23:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 0x7fb730146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 0x7fb730146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46748/0 (socket says 172.21.15.5:46748) 2024-08-18T22:23:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72fe00640 1 -- 172.21.15.5:0/3916894953 learned_addr learned my addr 172.21.15.5:0/3916894953 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb727400640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7300b0170 0x7fb7300b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb734c00640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73006cac0 0x7fb73006cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72fe00640 1 -- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73006cac0 msgr2=0x7fb73006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72fe00640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73006cac0 0x7fb73006cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72fe00640 1 -- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7300b0170 msgr2=0x7fb7300b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72fe00640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7300b0170 0x7fb7300b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72fe00640 1 -- 172.21.15.5:0/3916894953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7300af0d0 con 0x7fb7140040e0 2024-08-18T22:23:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72fe00640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 0x7fb730146b60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb7200115e0 tx=0x7fb720011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72cc00640 1 -- 172.21.15.5:0/3916894953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72000f8f0 con 0x7fb7140040e0 2024-08-18T22:23:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72cc00640 1 -- 172.21.15.5:0/3916894953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72000fa90 con 0x7fb7140040e0 2024-08-18T22:23:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb72cc00640 1 -- 172.21.15.5:0/3916894953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72000fe40 con 0x7fb7140040e0 2024-08-18T22:23:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb736c00640 1 -- 172.21.15.5:0/3916894953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7300af3b0 con 0x7fb7140040e0 2024-08-18T22:23:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb736c00640 1 -- 172.21.15.5:0/3916894953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7300af970 con 0x7fb7140040e0 2024-08-18T22:23:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.674+0000 7fb736c00640 1 -- 172.21.15.5:0/3916894953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb730071550 con 0x7fb7140040e0 2024-08-18T22:23:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.678+0000 7fb72cc00640 1 -- 172.21.15.5:0/3916894953 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb720015460 con 0x7fb7140040e0 2024-08-18T22:23:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.678+0000 7fb72cc00640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678f0 0x7fb70c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.678+0000 7fb72cc00640 1 -- 172.21.15.5:0/3916894953 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fb720086530 con 0x7fb7140040e0 2024-08-18T22:23:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.678+0000 7fb727400640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678f0 0x7fb70c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.678+0000 7fb727400640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678f0 0x7fb70c069db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb7180ac000 tx=0x7fb7180a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.682+0000 7fb72cc00640 1 -- 172.21.15.5:0/3916894953 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb720019030 con 0x7fb7140040e0 2024-08-18T22:23:18.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.902+0000 7fb736c00640 1 -- 172.21.15.5:0/3916894953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb7300ce0d0 con 0x7fb7140040e0 2024-08-18T22:23:18.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb72cc00640 1 -- 172.21.15.5:0/3916894953 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fb720056900 con 0x7fb7140040e0 2024-08-18T22:23:18.911 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:23:18.911 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:23:18.911 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:23:18.911 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:23:18.911 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:23:18.913 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:23:18.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 -- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678f0 msgr2=0x7fb70c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678f0 0x7fb70c069db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb7180ac000 tx=0x7fb7180a6000 comp rx=0 tx=0).stop 2024-08-18T22:23:18.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 -- 172.21.15.5:0/3916894953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 msgr2=0x7fb730146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:18.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 0x7fb730146b60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb7200115e0 tx=0x7fb720011aa0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 -- 172.21.15.5:0/3916894953 shutdown_connections 2024-08-18T22:23:18.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb70c0678f0 0x7fb70c069db0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73006cac0 0x7fb73006cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7300b0170 0x7fb7300b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 --2- 172.21.15.5:0/3916894953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7140040e0 0x7fb730146b60 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:18.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 -- 172.21.15.5:0/3916894953 >> 172.21.15.5:0/3916894953 conn(0x7fb7300d2180 msgr2=0x7fb730160940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:18.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 -- 172.21.15.5:0/3916894953 shutdown_connections 2024-08-18T22:23:18.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:18.906+0000 7fb736c00640 1 -- 172.21.15.5:0/3916894953 wait complete. 2024-08-18T22:23:18.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:19.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff351000640 1 Processor -- start 2024-08-18T22:23:19.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff351000640 1 -- start start 2024-08-18T22:23:19.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff351000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 0x7ff34c06c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff351000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34c15e840 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff351000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34c0cf320 con 0x7ff34c0cee40 2024-08-18T22:23:19.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff351000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff34c0ae750 con 0x7ff34c15e460 2024-08-18T22:23:19.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff34a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff34c0ca3e0 0x7ff34c0d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47268/0 (socket says 172.21.15.5:47268) 2024-08-18T22:23:19.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff34a800640 1 -- 172.21.15.5:0/2657419151 learned_addr learned my addr 172.21.15.5:0/2657419151 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:19.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff349e00640 1 --2- 172.21.15.5:0/2657419151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 0x7ff34c06c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff349400640 1 -- 172.21.15.5:0/2657419151 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016834204 0 0) 0x7ff34c15e840 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff349400640 1 -- 172.21.15.5:0/2657419151 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff330003530 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff349400640 1 -- 172.21.15.5:0/2657419151 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1246368909 0 0) 0x7ff34c0cf320 con 0x7ff34c0cee40 2024-08-18T22:23:19.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff349e00640 1 -- 172.21.15.5:0/2657419151 >> v1:172.21.15.117:6789/0 conn(0x7ff34c0cee40 legacy=0x7ff34c0ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff349e00640 1 -- 172.21.15.5:0/2657419151 >> v1:172.21.15.5:6789/0 conn(0x7ff34c0ca3e0 legacy=0x7ff34c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.070+0000 7ff349e00640 1 -- 172.21.15.5:0/2657419151 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34c0cf600 con 0x7ff34c15e460 2024-08-18T22:23:19.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.074+0000 7ff349e00640 1 --2- 172.21.15.5:0/2657419151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 0x7ff34c06c3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0097f0 tx=0x7ff33c01ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d921e6381c9ee50c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:19.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.074+0000 7ff349400640 1 -- 172.21.15.5:0/2657419151 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0b5070 con 0x7ff34c15e460 2024-08-18T22:23:19.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.074+0000 7ff349400640 1 -- 172.21.15.5:0/2657419151 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff33c0a8870 con 0x7ff34c15e460 2024-08-18T22:23:19.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.074+0000 7ff349400640 1 -- 172.21.15.5:0/2657419151 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0a8c20 con 0x7ff34c15e460 2024-08-18T22:23:19.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.074+0000 7ff351000640 1 -- 172.21.15.5:0/2657419151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 msgr2=0x7ff34c06c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.074+0000 7ff351000640 1 --2- 172.21.15.5:0/2657419151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 0x7ff34c06c3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0097f0 tx=0x7ff33c01ebf0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.074+0000 7ff351000640 1 -- 172.21.15.5:0/2657419151 shutdown_connections 2024-08-18T22:23:19.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.074+0000 7ff351000640 1 --2- 172.21.15.5:0/2657419151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 0x7ff34c06c3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.074+0000 7ff351000640 1 -- 172.21.15.5:0/2657419151 >> 172.21.15.5:0/2657419151 conn(0x7ff34c09aa40 msgr2=0x7ff34c0b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:19.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.074+0000 7ff351000640 1 -- 172.21.15.5:0/2657419151 shutdown_connections 2024-08-18T22:23:19.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.074+0000 7ff351000640 1 -- 172.21.15.5:0/2657419151 wait complete. 2024-08-18T22:23:19.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff351000640 1 Processor -- start 2024-08-18T22:23:19.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff351000640 1 -- start start 2024-08-18T22:23:19.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff351000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34c0ca3e0 0x7ff34c14ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff351000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff34c0cee40 0x7ff34c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff351000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 0x7ff34c159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff351000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff34c0cfbc0 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff351000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff34c06c900 con 0x7ff34c0cee40 2024-08-18T22:23:19.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff351000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff34c0cfea0 con 0x7ff34c15e460 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff349e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34c0ca3e0 0x7ff34c14ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff349e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34c0ca3e0 0x7ff34c14ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46752/0 (socket says 172.21.15.5:46752) 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff349e00640 1 -- 172.21.15.5:0/1618696037 learned_addr learned my addr 172.21.15.5:0/1618696037 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff343e00640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff34c0cee40 0x7ff34c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff34a800640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 0x7ff34c159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff349e00640 1 -- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 msgr2=0x7ff34c159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff349e00640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 0x7ff34c159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff349e00640 1 -- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff34c0cee40 msgr2=0x7ff34c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff349e00640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff34c0cee40 0x7ff34c1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff349e00640 1 -- 172.21.15.5:0/1618696037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34c14b070 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff343e00640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff34c0cee40 0x7ff34c1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff34a800640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 0x7ff34c159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff349e00640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34c0ca3e0 0x7ff34c14ab30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0097f0 tx=0x7ff33c01b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:19.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff342000640 1 -- 172.21.15.5:0/1618696037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0b5040 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff342000640 1 -- 172.21.15.5:0/1618696037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff33c0b0440 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff351000640 1 -- 172.21.15.5:0/1618696037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff34c0cdd10 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff342000640 1 -- 172.21.15.5:0/1618696037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0b07f0 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff351000640 1 -- 172.21.15.5:0/1618696037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff34c0b42b0 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.078+0000 7ff351000640 1 -- 172.21.15.5:0/1618696037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff34c0b36b0 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.082+0000 7ff342000640 1 -- 172.21.15.5:0/1618696037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff33c0c4020 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.082+0000 7ff342000640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3280678c0 0x7ff328069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.082+0000 7ff342000640 1 -- 172.21.15.5:0/1618696037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7ff33c1232b0 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.082+0000 7ff343e00640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3280678c0 0x7ff328069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.082+0000 7ff343e00640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3280678c0 0x7ff328069d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff34c06f450 tx=0x7ff334009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:19.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.086+0000 7ff342000640 1 -- 172.21.15.5:0/1618696037 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff33c018750 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.282+0000 7ff351000640 1 -- 172.21.15.5:0/1618696037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff34c0b0010 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff342000640 1 -- 172.21.15.5:0/1618696037 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5218 (secure 0 0 0) 0x7ff33c0f3bc0 con 0x7ff34c0ca3e0 2024-08-18T22:23:19.289 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:19.289 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"btime":"2024-08-18T22:23:12:405942+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1431678393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1431678393},{"type":"v1","addr":"172.21.15.117:6835","nonce":1431678393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5953,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/620847831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":620847831},{"type":"v1","addr":"172.21.15.117:6837","nonce":620847831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5959,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/124523467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":124523467},{"type":"v1","addr":"172.21.15.5:6835","nonce":124523467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:11.801854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6833/3174043628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3174043628},{"type":"v1","addr":"172.21.15.5:6833","nonce":3174043628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6276,"qdb_cluster":[6276]},"id":4}]} 2024-08-18T22:23:19.289 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 40 2024-08-18T22:23:19.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 -- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3280678c0 msgr2=0x7ff328069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3280678c0 0x7ff328069d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff34c06f450 tx=0x7ff334009040 comp rx=0 tx=0).stop 2024-08-18T22:23:19.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 -- 172.21.15.5:0/1618696037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34c0ca3e0 msgr2=0x7ff34c14ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34c0ca3e0 0x7ff34c14ab30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0097f0 tx=0x7ff33c01b990 comp rx=0 tx=0).stop 2024-08-18T22:23:19.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 -- 172.21.15.5:0/1618696037 shutdown_connections 2024-08-18T22:23:19.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3280678c0 0x7ff328069d80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34c15e460 0x7ff34c159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff34c0cee40 0x7ff34c1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 --2- 172.21.15.5:0/1618696037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34c0ca3e0 0x7ff34c14ab30 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 -- 172.21.15.5:0/1618696037 >> 172.21.15.5:0/1618696037 conn(0x7ff34c09aa40 msgr2=0x7ff34c0d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:19.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 -- 172.21.15.5:0/1618696037 shutdown_connections 2024-08-18T22:23:19.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.286+0000 7ff351000640 1 -- 172.21.15.5:0/1618696037 wait complete. 2024-08-18T22:23:19.714 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:23:08.785969+0000', 'modified': '2024-08-18T22:23:11.801854+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6276': {'gid': 6276, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.5:6833/3174043628', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 3174043628}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 3174043628}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6276, 'qdb_cluster': [6276]} 2024-08-18T22:23:19.714 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:23:19.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-18T22:23:19.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd602600640 1 Processor -- start 2024-08-18T22:23:19.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd602600640 1 -- start start 2024-08-18T22:23:19.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd602600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd5fc15c180 0x7fd5fc0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd602600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5fc15c560 0x7fd5fc0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd602600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5fc15d4d0 0x7fd5fc0ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd602600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd5fc15d040 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd602600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd5fc0cfb00 con 0x7fd5fc15c180 2024-08-18T22:23:19.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd602600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5fc15c9f0 con 0x7fd5fc15c560 2024-08-18T22:23:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd5fbe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5fc15d4d0 0x7fd5fc0ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd5fbe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5fc15d4d0 0x7fd5fc0ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46764/0 (socket says 172.21.15.5:46764) 2024-08-18T22:23:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd5fbe00640 1 -- 172.21.15.5:0/463464798 learned_addr learned my addr 172.21.15.5:0/463464798 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd5fb400640 1 --2- 172.21.15.5:0/463464798 >> v2:172.21.15.117:3300/0 conn(0x7fd5fc15c180 0x7fd5fc0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd5faa00640 1 --2- 172.21.15.5:0/463464798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5fc15c560 0x7fd5fc0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd5fbe00640 1 -- 172.21.15.5:0/463464798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5fc15c560 msgr2=0x7fd5fc0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd5fbe00640 1 --2- 172.21.15.5:0/463464798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5fc15c560 0x7fd5fc0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd5fbe00640 1 -- 172.21.15.5:0/463464798 >> v2:172.21.15.117:3300/0 conn(0x7fd5fc15c180 msgr2=0x7fd5fc0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd5fbe00640 1 --2- 172.21.15.5:0/463464798 >> v2:172.21.15.117:3300/0 conn(0x7fd5fc15c180 0x7fd5fc0cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.854+0000 7fd5fbe00640 1 -- 172.21.15.5:0/463464798 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc15ccd0 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd5fbe00640 1 --2- 172.21.15.5:0/463464798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5fc15d4d0 0x7fd5fc0ce990 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc06d8a0 tx=0x7fd5f401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3c0271089beaac server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:19.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd5fa000640 1 -- 172.21.15.5:0/463464798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f40a5800 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd5fa000640 1 -- 172.21.15.5:0/463464798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f40a59a0 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd5fa000640 1 -- 172.21.15.5:0/463464798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f40a5d70 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd602600640 1 -- 172.21.15.5:0/463464798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5fc15d4d0 msgr2=0x7fd5fc0ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd602600640 1 --2- 172.21.15.5:0/463464798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5fc15d4d0 0x7fd5fc0ce990 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc06d8a0 tx=0x7fd5f401c960 comp rx=0 tx=0).stop 2024-08-18T22:23:19.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd602600640 1 -- 172.21.15.5:0/463464798 shutdown_connections 2024-08-18T22:23:19.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd602600640 1 --2- 172.21.15.5:0/463464798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5fc15d4d0 0x7fd5fc0ce990 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd602600640 1 --2- 172.21.15.5:0/463464798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5fc15c560 0x7fd5fc0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd602600640 1 --2- 172.21.15.5:0/463464798 >> v2:172.21.15.117:3300/0 conn(0x7fd5fc15c180 0x7fd5fc0cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd602600640 1 -- 172.21.15.5:0/463464798 >> 172.21.15.5:0/463464798 conn(0x7fd5fc0b1dc0 msgr2=0x7fd5fc0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd602600640 1 -- 172.21.15.5:0/463464798 shutdown_connections 2024-08-18T22:23:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd602600640 1 -- 172.21.15.5:0/463464798 wait complete. 2024-08-18T22:23:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.858+0000 7fd602600640 1 Processor -- start 2024-08-18T22:23:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd602600640 1 -- start start 2024-08-18T22:23:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd602600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5fc15c180 0x7fd5fc166820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd602600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5fc15d4d0 0x7fd5fc155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd602600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5fc155e70 0x7fd5fc09c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd602600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc160930 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd602600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc1607b0 con 0x7fd5fc155e70 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd602600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5fc160ab0 con 0x7fd5fc15c180 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5faa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5fc15d4d0 0x7fd5fc155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5faa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5fc15d4d0 0x7fd5fc155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46774/0 (socket says 172.21.15.5:46774) 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5faa00640 1 -- 172.21.15.5:0/2320115952 learned_addr learned my addr 172.21.15.5:0/2320115952 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5fbe00640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5fc155e70 0x7fd5fc09c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5fb400640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5fc15c180 0x7fd5fc166820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5faa00640 1 -- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5fc15c180 msgr2=0x7fd5fc166820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5faa00640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5fc15c180 0x7fd5fc166820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5faa00640 1 -- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5fc155e70 msgr2=0x7fd5fc09c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5faa00640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5fc155e70 0x7fd5fc09c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5faa00640 1 -- 172.21.15.5:0/2320115952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc156310 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5fbe00640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5fc155e70 0x7fd5fc09c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5faa00640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5fc15d4d0 0x7fd5fc155930 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800d830 tx=0x7fd5e800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5f3400640 1 -- 172.21.15.5:0/2320115952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e800b6c0 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5f3400640 1 -- 172.21.15.5:0/2320115952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e8019070 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd602600640 1 -- 172.21.15.5:0/2320115952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5fc1565f0 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd5f3400640 1 -- 172.21.15.5:0/2320115952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e800ba60 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.862+0000 7fd602600640 1 -- 172.21.15.5:0/2320115952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5fc1543a0 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5f3400640 1 -- 172.21.15.5:0/2320115952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5e801e460 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5f3400640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5dc0678c0 0x7fd5dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5f3400640 1 -- 172.21.15.5:0/2320115952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fd5e8086470 con 0x7fd5fc15d4d0 2024-08-18T22:23:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5fb400640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5dc0678c0 0x7fd5dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd605b6c000 1 Processor -- start 2024-08-18T22:23:19.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd605b6c000 1 -- start start 2024-08-18T22:23:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5fb400640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5dc0678c0 0x7fd5dc069d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009a40 tx=0x7fd5ec009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa98867d50 0x55fa98868130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa9881e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa9881e990 0x55fa9881ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd605b6c000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fa98704fd0 con 0x55fa98868670 2024-08-18T22:23:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd605b6c000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fa9866b3c0 con 0x55fa9881e990 2024-08-18T22:23:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd605b6c000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fa98610f70 con 0x55fa98867d50 2024-08-18T22:23:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5faa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa9881e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5faa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa9881e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46790/0 (socket says 172.21.15.5:46790) 2024-08-18T22:23:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5faa00640 1 -- 172.21.15.5:0/4015095689 learned_addr learned my addr 172.21.15.5:0/4015095689 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5fbe00640 1 --2- 172.21.15.5:0/4015095689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa9881e990 0x55fa9881ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5fb400640 1 --2- 172.21.15.5:0/4015095689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa98867d50 0x55fa98868130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5faa00640 1 -- 172.21.15.5:0/4015095689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa98867d50 msgr2=0x55fa98868130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5faa00640 1 --2- 172.21.15.5:0/4015095689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa98867d50 0x55fa98868130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5faa00640 1 -- 172.21.15.5:0/4015095689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa9881e990 msgr2=0x55fa9881ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5faa00640 1 --2- 172.21.15.5:0/4015095689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa9881e990 0x55fa9881ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5faa00640 1 -- 172.21.15.5:0/4015095689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa986052e0 con 0x55fa98868670 2024-08-18T22:23:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5fbe00640 1 --2- 172.21.15.5:0/4015095689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa9881e990 0x55fa9881ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5fb400640 1 --2- 172.21.15.5:0/4015095689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa98867d50 0x55fa98868130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:19.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5faa00640 1 --2- 172.21.15.5:0/4015095689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa9881e450 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd5e805ed30 tx=0x7fd5e8056870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9bf56941aa0d6be server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.866+0000 7fd5e7e00640 1 -- 172.21.15.5:0/4015095689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8054a30 con 0x55fa98868670 2024-08-18T22:23:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5e7e00640 1 -- 172.21.15.5:0/4015095689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e8052da0 con 0x55fa98868670 2024-08-18T22:23:19.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5e7e00640 1 -- 172.21.15.5:0/4015095689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e805edd0 con 0x55fa98868670 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 -- 172.21.15.5:0/4015095689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 msgr2=0x55fa9881e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 --2- 172.21.15.5:0/4015095689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa9881e450 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd5e805ed30 tx=0x7fd5e8056870 comp rx=0 tx=0).stop 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 -- 172.21.15.5:0/4015095689 shutdown_connections 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 --2- 172.21.15.5:0/4015095689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa9881e990 0x55fa9881ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 --2- 172.21.15.5:0/4015095689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa9881e450 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 --2- 172.21.15.5:0/4015095689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa98867d50 0x55fa98868130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 -- 172.21.15.5:0/4015095689 >> 172.21.15.5:0/4015095689 conn(0x55fa9881a910 msgr2=0x55fa9881cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 -- 172.21.15.5:0/4015095689 shutdown_connections 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 -- 172.21.15.5:0/4015095689 wait complete. 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 -- start start 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 Processor -- start 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa9881e990 0x55fa98855640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98867d50 0x55fa98823ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa988240e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fa98612e40 con 0x55fa98868670 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fa98728af0 con 0x55fa98867d50 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fa986cd450 con 0x55fa9881e990 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 10 client.0 _ll_register_callbacks cb 0x55fa98809630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5fbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa988240e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5fbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa988240e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46800/0 (socket says 172.21.15.5:46800) 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5fbe00640 1 -- 172.21.15.5:0/3572274770 learned_addr learned my addr 172.21.15.5:0/3572274770 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5faa00640 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98867d50 0x55fa98823ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5fb400640 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa9881e990 0x55fa98855640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5fbe00640 1 -- 172.21.15.5:0/3572274770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa9881e990 msgr2=0x55fa98855640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5fbe00640 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa9881e990 0x55fa98855640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5fbe00640 1 -- 172.21.15.5:0/3572274770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98867d50 msgr2=0x55fa98823ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5fbe00640 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98867d50 0x55fa98823ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5fbe00640 1 -- 172.21.15.5:0/3572274770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa985f2fd0 con 0x55fa98868670 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5fb400640 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa9881e990 0x55fa98855640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5fbe00640 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa988240e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd5f401d200 tx=0x7fd5f401b1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80948c3a2eb48633 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5e4c00640 1 -- 172.21.15.5:0/3572274770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f40bc070 con 0x55fa98868670 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd5e4c00640 1 -- 172.21.15.5:0/3572274770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fd5f40c1e40 con 0x55fa98868670 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.870+0000 7fd605b6c000 1 -- 172.21.15.5:0/3572274770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5e8052da0 con 0x55fa98868670 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd5e4c00640 1 -- 172.21.15.5:0/3572274770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd5f40c0600 con 0x55fa98868670 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 10 client.6438 fetch_fsmap learned FSMap version 40 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 -- 172.21.15.5:0/3572274770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55fa986ee4d0 con 0x55fa98868670 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd5e4c00640 1 -- 172.21.15.5:0/3572274770 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e8052da0 con 0x55fa98868670 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd5e4c00640 1 -- 172.21.15.5:0/3572274770 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7fd5f40c07a0 con 0x55fa98868670 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 10 client.6438 fetch_fsmap finished waiting for FSMap version 40 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 10 client.6438 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:23:19.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 20 client.6438 populate_metadata read hostname 'smithi005' 2024-08-18T22:23:19.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x55fa988564f0 0x55fa988568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 4 client.6438 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:23:19.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 -- 172.21.15.5:0/3572274770 --> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa98605c00 con 0x55fa988564f0 2024-08-18T22:23:19.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd5fb400640 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x55fa988564f0 0x55fa988568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd5fb400640 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x55fa988564f0 0x55fa988568d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce97dba46d4e0f74 server_cookie=1d5ccd1179c39b54 in_seq=0 out_seq=0 2024-08-18T22:23:19.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd5e4c00640 10 client.6438 ms_handle_connect on v2:172.21.15.5:6832/3174043628 2024-08-18T22:23:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd5e4c00640 1 -- 172.21.15.5:0/3572274770 <== mds.0 v2:172.21.15.5:6832/3174043628 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa98605c00 con 0x55fa988564f0 2024-08-18T22:23:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd5e4c00640 10 client.6438 handle_command_reply: tid=0 2024-08-18T22:23:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 client.6438 shutdown 2024-08-18T22:23:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 -- 172.21.15.5:0/3572274770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 msgr2=0x55fa988240e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa988240e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd5f401d200 tx=0x7fd5f401b1a0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 -- 172.21.15.5:0/3572274770 shutdown_connections 2024-08-18T22:23:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x55fa988564f0 0x55fa988568d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98868670 0x55fa988240e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98867d50 0x55fa98823ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 --2- 172.21.15.5:0/3572274770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa9881e990 0x55fa98855640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd5e4c00640 0 client.6438 ms_handle_reset on v2:172.21.15.5:6832/3174043628 2024-08-18T22:23:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 -- 172.21.15.5:0/3572274770 >> 172.21.15.5:0/3572274770 conn(0x55fa9881a910 msgr2=0x55fa9881d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 -- 172.21.15.5:0/3572274770 shutdown_connections 2024-08-18T22:23:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 1 -- 172.21.15.5:0/3572274770 wait complete. 2024-08-18T22:23:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.874+0000 7fd605b6c000 20 client.6438 trim_cache size 0 max 16384 2024-08-18T22:23:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd605b6c000 1 Processor -- start 2024-08-18T22:23:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd605b6c000 1 -- start start 2024-08-18T22:23:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa9881e990 0x55fa9887a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa98867d50 0x55fa9887a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98868670 0x55fa9887aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd605b6c000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc202c40 con 0x55fa9881e990 2024-08-18T22:23:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd605b6c000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc142490 con 0x55fa98868670 2024-08-18T22:23:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd605b6c000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5fc142ae0 con 0x55fa98867d50 2024-08-18T22:23:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa9881e990 0x55fa9887a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa9881e990 0x55fa9887a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46816/0 (socket says 172.21.15.5:46816) 2024-08-18T22:23:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5fb400640 1 -- 172.21.15.5:0/999338103 learned_addr learned my addr 172.21.15.5:0/999338103 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5fb400640 1 -- 172.21.15.5:0/999338103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa98867d50 msgr2=0x55fa9887a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5fb400640 1 --2- 172.21.15.5:0/999338103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa98867d50 0x55fa9887a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5fb400640 1 -- 172.21.15.5:0/999338103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98868670 msgr2=0x55fa9887aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5fb400640 1 --2- 172.21.15.5:0/999338103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98868670 0x55fa9887aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5fb400640 1 -- 172.21.15.5:0/999338103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa98664b30 con 0x55fa9881e990 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5fb400640 1 --2- 172.21.15.5:0/999338103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa9881e990 0x55fa9887a010 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec011c20 tx=0x7fd5ec014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d441b112f8adbc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5e7400640 1 -- 172.21.15.5:0/999338103 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec01e040 con 0x55fa9881e990 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5e7400640 1 -- 172.21.15.5:0/999338103 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec02a070 con 0x55fa9881e990 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.894+0000 7fd5e7400640 1 -- 172.21.15.5:0/999338103 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec0039a0 con 0x55fa9881e990 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 -- 172.21.15.5:0/999338103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa9881e990 msgr2=0x55fa9887a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 --2- 172.21.15.5:0/999338103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa9881e990 0x55fa9887a010 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec011c20 tx=0x7fd5ec014000 comp rx=0 tx=0).stop 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 -- 172.21.15.5:0/999338103 shutdown_connections 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 --2- 172.21.15.5:0/999338103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98868670 0x55fa9887aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 --2- 172.21.15.5:0/999338103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa98867d50 0x55fa9887a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 --2- 172.21.15.5:0/999338103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa9881e990 0x55fa9887a010 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 -- 172.21.15.5:0/999338103 >> 172.21.15.5:0/999338103 conn(0x55fa9881a910 msgr2=0x55fa98823f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 -- 172.21.15.5:0/999338103 shutdown_connections 2024-08-18T22:23:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 -- 172.21.15.5:0/999338103 wait complete. 2024-08-18T22:23:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 -- start start 2024-08-18T22:23:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 Processor -- start 2024-08-18T22:23:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98867d50 0x55fa9887c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98868670 0x55fa9887c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa9887cdd0 0x55fa9887d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fa986241d0 con 0x55fa98867d50 2024-08-18T22:23:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fa98602900 con 0x55fa98868670 2024-08-18T22:23:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fa9866a6d0 con 0x55fa9887cdd0 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 10 client.0 _ll_register_callbacks cb 0x7fd5f4009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98867d50 0x55fa9887c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98867d50 0x55fa9887c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46830/0 (socket says 172.21.15.5:46830) 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5fb400640 1 -- 172.21.15.5:0/1022672770 learned_addr learned my addr 172.21.15.5:0/1022672770 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5faa00640 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98868670 0x55fa9887c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5fbe00640 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa9887cdd0 0x55fa9887d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5fb400640 1 -- 172.21.15.5:0/1022672770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa9887cdd0 msgr2=0x55fa9887d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5fb400640 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa9887cdd0 0x55fa9887d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5fb400640 1 -- 172.21.15.5:0/1022672770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98868670 msgr2=0x55fa9887c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5fb400640 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98868670 0x55fa9887c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5fb400640 1 -- 172.21.15.5:0/1022672770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa9861c810 con 0x55fa98867d50 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5fb400640 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98867d50 0x55fa9887c350 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec031040 tx=0x7fd5ec004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a05e035c78644d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5e4c00640 1 -- 172.21.15.5:0/1022672770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec040060 con 0x55fa98867d50 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5e4c00640 1 -- 172.21.15.5:0/1022672770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fd5ec0037a0 con 0x55fa98867d50 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 -- 172.21.15.5:0/1022672770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5ec02a070 con 0x55fa98867d50 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5e4c00640 1 -- 172.21.15.5:0/1022672770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd5ec01e030 con 0x55fa98867d50 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 10 client.6444 fetch_fsmap learned FSMap version 40 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd605b6c000 1 -- 172.21.15.5:0/1022672770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55fa98601d30 con 0x55fa98867d50 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.898+0000 7fd5e4c00640 1 -- 172.21.15.5:0/1022672770 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec02a070 con 0x55fa98867d50 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd5e4c00640 1 -- 172.21.15.5:0/1022672770 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7fd5ec0039a0 con 0x55fa98867d50 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 10 client.6444 fetch_fsmap finished waiting for FSMap version 40 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 10 client.6444 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 20 client.6444 populate_metadata read hostname 'smithi005' 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x55fa9887d6f0 0x55fa988e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 4 client.6444 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 -- 172.21.15.5:0/1022672770 --> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] -- command(tid 0: {"prefix": "status"}) -- 0x55fa988559d0 con 0x55fa9887d6f0 2024-08-18T22:23:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd5faa00640 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x55fa9887d6f0 0x55fa988e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd5e4c00640 10 client.6444 ms_handle_connect on v2:172.21.15.5:6832/3174043628 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd5faa00640 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x55fa9887d6f0 0x55fa988e3220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a38607155a607ffe server_cookie=17ceb5b3a8bbfc1b in_seq=0 out_seq=0 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd5e4c00640 1 -- 172.21.15.5:0/1022672770 <== mds.0 v2:172.21.15.5:6832/3174043628 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55fa988559d0 con 0x55fa9887d6f0 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd5e4c00640 10 client.6444 handle_command_reply: tid=0 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 client.6444 shutdown 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 -- 172.21.15.5:0/1022672770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98867d50 msgr2=0x55fa9887c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98867d50 0x55fa9887c350 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec031040 tx=0x7fd5ec004740 comp rx=0 tx=0).stop 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 -- 172.21.15.5:0/1022672770 shutdown_connections 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x55fa9887d6f0 0x55fa988e3220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fa9887cdd0 0x55fa9887d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fa98868670 0x55fa9887c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 --2- 172.21.15.5:0/1022672770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa98867d50 0x55fa9887c350 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd5e4c00640 0 client.6444 ms_handle_reset on v2:172.21.15.5:6832/3174043628 2024-08-18T22:23:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 -- 172.21.15.5:0/1022672770 >> 172.21.15.5:0/1022672770 conn(0x55fa9881a910 msgr2=0x55fa98866950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 -- 172.21.15.5:0/1022672770 shutdown_connections 2024-08-18T22:23:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 1 -- 172.21.15.5:0/1022672770 wait complete. 2024-08-18T22:23:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd605b6c000 20 client.6444 trim_cache size 0 max 16384 2024-08-18T22:23:19.910 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:23:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:23:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:23:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6276, 2024-08-18T22:23:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:23:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:23:19.910 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:23:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.53343787, 2024-08-18T22:23:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 40, 2024-08-18T22:23:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 67, 2024-08-18T22:23:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 67, 2024-08-18T22:23:19.911 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 22.696457615 2024-08-18T22:23:19.911 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 -- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5dc0678c0 msgr2=0x7fd5dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5dc0678c0 0x7fd5dc069d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009a40 tx=0x7fd5ec009190 comp rx=0 tx=0).stop 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 -- 172.21.15.5:0/2320115952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5fc15d4d0 msgr2=0x7fd5fc155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5fc15d4d0 0x7fd5fc155930 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800d830 tx=0x7fd5e800dcf0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 -- 172.21.15.5:0/2320115952 shutdown_connections 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5dc0678c0 0x7fd5dc069d80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5fc155e70 0x7fd5fc09c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5fc15d4d0 0x7fd5fc155930 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 --2- 172.21.15.5:0/2320115952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5fc15c180 0x7fd5fc166820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 -- 172.21.15.5:0/2320115952 >> 172.21.15.5:0/2320115952 conn(0x7fd5fc0b1dc0 msgr2=0x7fd5fc1573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 -- 172.21.15.5:0/2320115952 shutdown_connections 2024-08-18T22:23:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:19.902+0000 7fd602600640 1 -- 172.21.15.5:0/2320115952 wait complete. 2024-08-18T22:23:19.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:23:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.062+0000 7f38a0000640 1 Processor -- start 2024-08-18T22:23:20.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.062+0000 7f38a0000640 1 -- start start 2024-08-18T22:23:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.062+0000 7f38a0000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f389815bed0 0x7f38980735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.062+0000 7f38a0000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3898073c80 con 0x7f389806da70 2024-08-18T22:23:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.062+0000 7f38a0000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38980ca5d0 con 0x7f38980cb390 2024-08-18T22:23:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.062+0000 7f38a0000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f38980ca8b0 con 0x7f389815bed0 2024-08-18T22:23:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.066+0000 7f389e000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f389806da70 0x7f3898165b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47270/0 (socket says 172.21.15.5:47270) 2024-08-18T22:23:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.066+0000 7f389e000640 1 -- 172.21.15.5:0/4143449163 learned_addr learned my addr 172.21.15.5:0/4143449163 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:20.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.066+0000 7f389d600640 1 --2- 172.21.15.5:0/4143449163 >> v2:172.21.15.117:3300/0 conn(0x7f389815bed0 0x7f38980735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.066+0000 7f3897e00640 1 -- 172.21.15.5:0/4143449163 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3129062593 0 0) 0x7f3898073c80 con 0x7f389806da70 2024-08-18T22:23:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.066+0000 7f3897e00640 1 -- 172.21.15.5:0/4143449163 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3880003530 con 0x7f389806da70 2024-08-18T22:23:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.066+0000 7f3897e00640 1 -- 172.21.15.5:0/4143449163 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 30926643 0 0) 0x7f38980ca5d0 con 0x7f38980cb390 2024-08-18T22:23:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.066+0000 7f3897e00640 1 -- 172.21.15.5:0/4143449163 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3898073c80 con 0x7f38980cb390 2024-08-18T22:23:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.066+0000 7f389d600640 1 -- 172.21.15.5:0/4143449163 >> v1:172.21.15.117:6789/0 conn(0x7f38980cb390 legacy=0x7f3898071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.066+0000 7f389d600640 1 -- 172.21.15.5:0/4143449163 >> v1:172.21.15.5:6789/0 conn(0x7f389806da70 legacy=0x7f3898165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:20.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.066+0000 7f389d600640 1 -- 172.21.15.5:0/4143449163 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38980cab90 con 0x7f389815bed0 2024-08-18T22:23:20.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.066+0000 7f389d600640 1 --2- 172.21.15.5:0/4143449163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389815bed0 0x7f38980735a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f388c0097c0 tx=0x7f388c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=819d37d86b07fcee server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:20.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f3897e00640 1 -- 172.21.15.5:0/4143449163 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c0b1070 con 0x7f389815bed0 2024-08-18T22:23:20.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f3897e00640 1 -- 172.21.15.5:0/4143449163 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c0ac5f0 con 0x7f389815bed0 2024-08-18T22:23:20.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f3897e00640 1 -- 172.21.15.5:0/4143449163 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c0ac9a0 con 0x7f389815bed0 2024-08-18T22:23:20.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 -- 172.21.15.5:0/4143449163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389815bed0 msgr2=0x7f38980735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:20.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 --2- 172.21.15.5:0/4143449163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389815bed0 0x7f38980735a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f388c0097c0 tx=0x7f388c01c470 comp rx=0 tx=0).stop 2024-08-18T22:23:20.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 -- 172.21.15.5:0/4143449163 shutdown_connections 2024-08-18T22:23:20.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 --2- 172.21.15.5:0/4143449163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389815bed0 0x7f38980735a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:20.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 -- 172.21.15.5:0/4143449163 >> 172.21.15.5:0/4143449163 conn(0x7f38980b1c50 msgr2=0x7f38980b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:20.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 -- 172.21.15.5:0/4143449163 shutdown_connections 2024-08-18T22:23:20.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 -- 172.21.15.5:0/4143449163 wait complete. 2024-08-18T22:23:20.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 Processor -- start 2024-08-18T22:23:20.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 -- start start 2024-08-18T22:23:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389806da70 0x7f389809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38980cb390 0x7f38980b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389815bed0 0x7f38980b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3898169c40 con 0x7f38980cb390 2024-08-18T22:23:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3898169ac0 con 0x7f389806da70 2024-08-18T22:23:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f38a0000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3898169dc0 con 0x7f389815bed0 2024-08-18T22:23:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f389cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38980cb390 0x7f38980b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f389cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38980cb390 0x7f38980b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46838/0 (socket says 172.21.15.5:46838) 2024-08-18T22:23:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f389cc00640 1 -- 172.21.15.5:0/1589335223 learned_addr learned my addr 172.21.15.5:0/1589335223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:20.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f389d600640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389806da70 0x7f389809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.070+0000 7f389e000640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389815bed0 0x7f38980b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f389cc00640 1 -- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389815bed0 msgr2=0x7f38980b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f389cc00640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389815bed0 0x7f38980b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f389cc00640 1 -- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389806da70 msgr2=0x7f389809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f389cc00640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389806da70 0x7f389809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f389cc00640 1 -- 172.21.15.5:0/1589335223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3898150d40 con 0x7f38980cb390 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f389e000640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389815bed0 0x7f38980b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f389cc00640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38980cb390 0x7f38980b36e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f388400c490 tx=0x7f388400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f3895600640 1 -- 172.21.15.5:0/1589335223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38840052d0 con 0x7f38980cb390 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f3895600640 1 -- 172.21.15.5:0/1589335223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3884005470 con 0x7f38980cb390 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f3895600640 1 -- 172.21.15.5:0/1589335223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884012870 con 0x7f38980cb390 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f38a0000640 1 -- 172.21.15.5:0/1589335223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3898151020 con 0x7f38980cb390 2024-08-18T22:23:20.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f38a0000640 1 -- 172.21.15.5:0/1589335223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38981515e0 con 0x7f38980cb390 2024-08-18T22:23:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f38a0000640 1 -- 172.21.15.5:0/1589335223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38980735a0 con 0x7f38980cb390 2024-08-18T22:23:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f3895600640 1 -- 172.21.15.5:0/1589335223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3884012a10 con 0x7f38980cb390 2024-08-18T22:23:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f3895600640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678c0 0x7f3878069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:20.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.074+0000 7f3895600640 1 -- 172.21.15.5:0/1589335223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f3884085a50 con 0x7f38980cb390 2024-08-18T22:23:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.078+0000 7f389d600640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678c0 0x7f3878069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:20.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.078+0000 7f389d600640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678c0 0x7f3878069d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f388c0ae000 tx=0x7f388c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:20.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.078+0000 7f3895600640 1 -- 172.21.15.5:0/1589335223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f38840563f0 con 0x7f38980cb390 2024-08-18T22:23:20.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.282+0000 7f38a0000640 1 -- 172.21.15.5:0/1589335223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f38980cd4b0 con 0x7f38980cb390 2024-08-18T22:23:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.282+0000 7f3895600640 1 -- 172.21.15.5:0/1589335223 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) ==== 53+0+73 (secure 0 0 0) 0x7f3884055cf0 con 0x7f38980cb390 2024-08-18T22:23:20.287 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:23:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.282+0000 7f38a0000640 1 -- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678c0 msgr2=0x7f3878069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.282+0000 7f38a0000640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678c0 0x7f3878069d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f388c0ae000 tx=0x7f388c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:23:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.282+0000 7f38a0000640 1 -- 172.21.15.5:0/1589335223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38980cb390 msgr2=0x7f38980b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.282+0000 7f38a0000640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38980cb390 0x7f38980b36e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f388400c490 tx=0x7f388400c950 comp rx=0 tx=0).stop 2024-08-18T22:23:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.286+0000 7f38a0000640 1 -- 172.21.15.5:0/1589335223 shutdown_connections 2024-08-18T22:23:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.286+0000 7f38a0000640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678c0 0x7f3878069d80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.286+0000 7f38a0000640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389815bed0 0x7f38980b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.286+0000 7f38a0000640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38980cb390 0x7f38980b36e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.286+0000 7f38a0000640 1 --2- 172.21.15.5:0/1589335223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389806da70 0x7f389809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.286+0000 7f38a0000640 1 -- 172.21.15.5:0/1589335223 >> 172.21.15.5:0/1589335223 conn(0x7f38980b1c50 msgr2=0x7f38980b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.286+0000 7f38a0000640 1 -- 172.21.15.5:0/1589335223 shutdown_connections 2024-08-18T22:23:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20.286+0000 7f38a0000640 1 -- 172.21.15.5:0/1589335223 wait complete. 2024-08-18T22:23:20.309 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:23:20.309 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:23:20.309 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:23:20.309 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:23:20.309 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:23:20.309 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:23:20.309 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:23:20.310 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:23:20.310 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:23:20.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:23:20.310 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:23:20.319 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:23:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:23:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:23:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:23:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:23:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:23:20.320 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:23:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:23:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:23:20.320 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:23:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:23:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:23:20.320 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:23:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:23:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42201sec preferred_lft 42201sec 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:23:20.321 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:23:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:23:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:23:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:23:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:23:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:23:20.322 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:23:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:23:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:23:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:23:20.323 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:23:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:23:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:23:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:23:20.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:23:20.324 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:23:20.383 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:23:20.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:23:20.385 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:23:20.438 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:23:20.438 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:23:20.438 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:23:20.439 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:23:20.439 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:23:20.439 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:23:20.439 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:23:20.439 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:23:20.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:23:20.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:23:20.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:23:20.439 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:23:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:23:20.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:23:20.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:23:20.576 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:23:20.585 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:23:20.586 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:23:20.586 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:23:20.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:23:20.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:23:20.652 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:23:20.652 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:23:20.708 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:23:20.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:23:20.709 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:23:20.760 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:23:20.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:23:20.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:23:20.850 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:23:20.850 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:23:20.850 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:23:20.865 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:23:20.865 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:23:20.866 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:23:20.866 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:23:20.866 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:23:20.875 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:23:20.875 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:23:20.875 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:23:20.875 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:23:20.875 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:23:20.875 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:23:20.875 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:23:20.875 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:23:20.879 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:23:20.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:23:20.879 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:23:20.899 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:23:20.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:23:20.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:23:21.003 INFO:teuthology.orchestra.run.smithi005.stdout:client6453 2024-08-18T22:23:21.003 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:23:21.003 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:21.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-08-18T22:23:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd182e00640 1 Processor -- start 2024-08-18T22:23:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd182e00640 1 -- start start 2024-08-18T22:23:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd182e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd17c15c560 0x7fd17c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd182e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15d4d0 0x7fd17c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd182e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd17c0cfb00 con 0x7fd17c15c180 2024-08-18T22:23:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd182e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd17c15d040 con 0x7fd17c15c560 2024-08-18T22:23:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd182e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd17c15c9f0 con 0x7fd17c15d4d0 2024-08-18T22:23:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd180e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15d4d0 0x7fd17c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd17be00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd17c15c180 0x7fd17c0cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:48374/0 (socket says 172.21.15.5:48374) 2024-08-18T22:23:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd17be00640 1 -- 172.21.15.5:0/916329460 learned_addr learned my addr 172.21.15.5:0/916329460 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd180e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15d4d0 0x7fd17c06db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:52310/0 (socket says 172.21.15.5:52310) 2024-08-18T22:23:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd173400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd17c15c560 0x7fd17c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd17b400640 1 -- 172.21.15.5:0/916329460 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1635410112 0 0) 0x7fd17c0cfb00 con 0x7fd17c15c180 2024-08-18T22:23:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd17b400640 1 -- 172.21.15.5:0/916329460 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd160003530 con 0x7fd17c15c180 2024-08-18T22:23:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd180e00640 1 -- 172.21.15.5:0/916329460 >> v2:172.21.15.117:3300/0 conn(0x7fd17c15c560 msgr2=0x7fd17c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd180e00640 1 --2- 172.21.15.5:0/916329460 >> v2:172.21.15.117:3300/0 conn(0x7fd17c15c560 0x7fd17c0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd180e00640 1 -- 172.21.15.5:0/916329460 >> v1:172.21.15.117:6789/0 conn(0x7fd17c15c180 legacy=0x7fd17c0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.194+0000 7fd180e00640 1 -- 172.21.15.5:0/916329460 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c15ccd0 con 0x7fd17c15d4d0 2024-08-18T22:23:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd173400640 1 --2- 172.21.15.5:0/916329460 >> v2:172.21.15.117:3300/0 conn(0x7fd17c15c560 0x7fd17c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:21.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd180e00640 1 --2- 172.21.15.5:0/916329460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15d4d0 0x7fd17c06db80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd174009d90 tx=0x7fd17401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4634c8ccce03ff39 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:21.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd17b400640 1 -- 172.21.15.5:0/916329460 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1740b2070 con 0x7fd17c15d4d0 2024-08-18T22:23:21.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd17b400640 1 -- 172.21.15.5:0/916329460 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17c0ced70 con 0x7fd17c15d4d0 2024-08-18T22:23:21.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd17b400640 1 -- 172.21.15.5:0/916329460 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1740a5be0 con 0x7fd17c15d4d0 2024-08-18T22:23:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd182e00640 1 -- 172.21.15.5:0/916329460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15d4d0 msgr2=0x7fd17c06db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd182e00640 1 --2- 172.21.15.5:0/916329460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15d4d0 0x7fd17c06db80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd174009d90 tx=0x7fd17401c8e0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd182e00640 1 -- 172.21.15.5:0/916329460 shutdown_connections 2024-08-18T22:23:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd182e00640 1 --2- 172.21.15.5:0/916329460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15d4d0 0x7fd17c06db80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd182e00640 1 --2- 172.21.15.5:0/916329460 >> v2:172.21.15.117:3300/0 conn(0x7fd17c15c560 0x7fd17c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd182e00640 1 -- 172.21.15.5:0/916329460 >> 172.21.15.5:0/916329460 conn(0x7fd17c0b1dc0 msgr2=0x7fd17c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd182e00640 1 -- 172.21.15.5:0/916329460 shutdown_connections 2024-08-18T22:23:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.198+0000 7fd182e00640 1 -- 172.21.15.5:0/916329460 wait complete. 2024-08-18T22:23:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd182e00640 1 Processor -- start 2024-08-18T22:23:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd182e00640 1 -- start start 2024-08-18T22:23:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd182e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15c180 0x7fd17c149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd182e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17c15d4d0 0x7fd17c09c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd182e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd17c09ce10 0x7fd17c162650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd182e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c1692b0 con 0x7fd17c15d4d0 2024-08-18T22:23:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd182e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c169130 con 0x7fd17c09ce10 2024-08-18T22:23:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd182e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd17c169430 con 0x7fd17c15c180 2024-08-18T22:23:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd173400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17c15d4d0 0x7fd17c09c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd173400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17c15d4d0 0x7fd17c09c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46842/0 (socket says 172.21.15.5:46842) 2024-08-18T22:23:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd173400640 1 -- 172.21.15.5:0/3325254450 learned_addr learned my addr 172.21.15.5:0/3325254450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd180e00640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd17c09ce10 0x7fd17c162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd17be00640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15c180 0x7fd17c149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd173400640 1 -- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15c180 msgr2=0x7fd17c149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd173400640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15c180 0x7fd17c149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd173400640 1 -- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd17c09ce10 msgr2=0x7fd17c162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd173400640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd17c09ce10 0x7fd17c162650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd173400640 1 -- 172.21.15.5:0/3325254450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c161a80 con 0x7fd17c15d4d0 2024-08-18T22:23:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd173400640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17c15d4d0 0x7fd17c09c8d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd16400ebe0 tx=0x7fd16400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd178c00640 1 -- 172.21.15.5:0/3325254450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd164017070 con 0x7fd17c15d4d0 2024-08-18T22:23:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd178c00640 1 -- 172.21.15.5:0/3325254450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16400cc30 con 0x7fd17c15d4d0 2024-08-18T22:23:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.202+0000 7fd182e00640 1 -- 172.21.15.5:0/3325254450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17c160740 con 0x7fd17c15d4d0 2024-08-18T22:23:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.206+0000 7fd178c00640 1 -- 172.21.15.5:0/3325254450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd164013470 con 0x7fd17c15d4d0 2024-08-18T22:23:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.206+0000 7fd182e00640 1 -- 172.21.15.5:0/3325254450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17c160cc0 con 0x7fd17c15d4d0 2024-08-18T22:23:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.206+0000 7fd182e00640 1 -- 172.21.15.5:0/3325254450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17c15b200 con 0x7fd17c15d4d0 2024-08-18T22:23:21.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.206+0000 7fd178c00640 1 -- 172.21.15.5:0/3325254450 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd16401a070 con 0x7fd17c15d4d0 2024-08-18T22:23:21.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.206+0000 7fd178c00640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1580678f0 0x7fd158069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.206+0000 7fd178c00640 1 -- 172.21.15.5:0/3325254450 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fd164085d60 con 0x7fd17c15d4d0 2024-08-18T22:23:21.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.206+0000 7fd17be00640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1580678f0 0x7fd158069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.206+0000 7fd17be00640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1580678f0 0x7fd158069db0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd16c007fd0 tx=0x7fd16c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:21.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.210+0000 7fd178c00640 1 -- 172.21.15.5:0/3325254450 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd17c161a80 con 0x7fd17c15d4d0 2024-08-18T22:23:21.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.378+0000 7fd182e00640 1 -- 172.21.15.5:0/3325254450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fd17c15af20 con 0x7fd17c15d4d0 2024-08-18T22:23:21.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd178c00640 1 -- 172.21.15.5:0/3325254450 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7fd164056020 con 0x7fd17c15d4d0 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 -- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1580678f0 msgr2=0x7fd158069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1580678f0 0x7fd158069db0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd16c007fd0 tx=0x7fd16c009040 comp rx=0 tx=0).stop 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 -- 172.21.15.5:0/3325254450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17c15d4d0 msgr2=0x7fd17c09c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17c15d4d0 0x7fd17c09c8d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd16400ebe0 tx=0x7fd16400c520 comp rx=0 tx=0).stop 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 -- 172.21.15.5:0/3325254450 shutdown_connections 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1580678f0 0x7fd158069db0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd17c09ce10 0x7fd17c162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd17c15d4d0 0x7fd17c09c8d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 --2- 172.21.15.5:0/3325254450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd17c15c180 0x7fd17c149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 -- 172.21.15.5:0/3325254450 >> 172.21.15.5:0/3325254450 conn(0x7fd17c0b1dc0 msgr2=0x7fd17c06ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 -- 172.21.15.5:0/3325254450 shutdown_connections 2024-08-18T22:23:21.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.382+0000 7fd182e00640 1 -- 172.21.15.5:0/3325254450 wait complete. 2024-08-18T22:23:21.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-08-18T22:23:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.546+0000 7f847f200640 1 Processor -- start 2024-08-18T22:23:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.546+0000 7f847f200640 1 -- start start 2024-08-18T22:23:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.546+0000 7f847f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f847809aca0 0x7f84780afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.546+0000 7f847f200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84780b1300 0x7f84780affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f847f200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f847806e8a0 con 0x7f847809b080 2024-08-18T22:23:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f847f200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f847809bb80 con 0x7f84780b1300 2024-08-18T22:23:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f847f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f84780d2e40 con 0x7f847809aca0 2024-08-18T22:23:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f847d200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f847809b080 0x7f84780b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47272/0 (socket says 172.21.15.5:47272) 2024-08-18T22:23:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f847d200640 1 -- 172.21.15.5:0/4268155800 learned_addr learned my addr 172.21.15.5:0/4268155800 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477e00640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f847809aca0 0x7f84780afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f846f400640 1 --2- 172.21.15.5:0/4268155800 >> v2:172.21.15.117:3300/0 conn(0x7f84780b1300 0x7f84780affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649154473 0 0) 0x7f847806e8a0 con 0x7f847809b080 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f845c003530 con 0x7f847809b080 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 173777017 0 0) 0x7f845c003530 con 0x7f847809b080 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f847809aca0 msgr2=0x7f84780afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f847809aca0 0x7f84780afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 >> v2:172.21.15.117:3300/0 conn(0x7f84780b1300 msgr2=0x7f84780affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 --2- 172.21.15.5:0/4268155800 >> v2:172.21.15.117:3300/0 conn(0x7f84780b1300 0x7f84780affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847806cbd0 con 0x7f847809b080 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f8470001a00 con 0x7f847809b080 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 >> v1:172.21.15.5:6789/0 conn(0x7f847809b080 legacy=0x7f84780b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f847809aca0 0x7f845c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f845c003f90 0x7f845c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f845c004d50 0x7f845c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f847809bb80 con 0x7f845c004d50 2024-08-18T22:23:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f84780d2e40 con 0x7f845c003f90 2024-08-18T22:23:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f845c00b9d0 con 0x7f847809aca0 2024-08-18T22:23:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f847d200640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f845c004d50 0x7f845c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f8477e00640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f847809aca0 0x7f845c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f846f400640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f845c003f90 0x7f845c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f847d200640 1 -- 172.21.15.5:0/4268155800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f847809aca0 msgr2=0x7f845c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f847d200640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f847809aca0 0x7f845c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f847d200640 1 -- 172.21.15.5:0/4268155800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f845c003f90 msgr2=0x7f845c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f847d200640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f845c003f90 0x7f845c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.550+0000 7f847d200640 1 -- 172.21.15.5:0/4268155800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c003530 con 0x7f845c004d50 2024-08-18T22:23:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f847d200640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f845c004d50 0x7f845c0051d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f847000a7e0 tx=0x7f847001d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da987d7ab84da745 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847000a3d0 con 0x7f845c004d50 2024-08-18T22:23:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84700ad630 con 0x7f845c004d50 2024-08-18T22:23:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f8477400640 1 -- 172.21.15.5:0/4268155800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84700adaa0 con 0x7f845c004d50 2024-08-18T22:23:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f847f200640 1 -- 172.21.15.5:0/4268155800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f845c004d50 msgr2=0x7f845c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f847f200640 1 --2- 172.21.15.5:0/4268155800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f845c004d50 0x7f845c0051d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f847000a7e0 tx=0x7f847001d2c0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f847d200640 1 -- 172.21.15.5:0/4268155800 reap_dead start 2024-08-18T22:23:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f847f200640 1 -- 172.21.15.5:0/4268155800 shutdown_connections 2024-08-18T22:23:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f847f200640 1 -- 172.21.15.5:0/4268155800 >> 172.21.15.5:0/4268155800 conn(0x7f84780d2180 msgr2=0x7f84780d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f847f200640 1 -- 172.21.15.5:0/4268155800 shutdown_connections 2024-08-18T22:23:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f847f200640 1 -- 172.21.15.5:0/4268155800 wait complete. 2024-08-18T22:23:21.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f847f200640 1 Processor -- start 2024-08-18T22:23:21.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.554+0000 7f847f200640 1 -- start start 2024-08-18T22:23:21.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8478144670 0x7f84781552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84781f4b10 0x7f8478144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8478144f90 0x7f84780cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f84780b1960 con 0x7f8478144f90 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f84780b17e0 con 0x7f8478144670 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f84780b1ae0 con 0x7f84781f4b10 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8478144f90 0x7f84780cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8478144f90 0x7f84780cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46860/0 (socket says 172.21.15.5:46860) 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847d200640 1 -- 172.21.15.5:0/3039072724 learned_addr learned my addr 172.21.15.5:0/3039072724 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f8477e00640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8478144670 0x7f84781552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f846f400640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84781f4b10 0x7f8478144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847d200640 1 -- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84781f4b10 msgr2=0x7f8478144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847d200640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84781f4b10 0x7f8478144a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847d200640 1 -- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8478144670 msgr2=0x7f84781552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847d200640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8478144670 0x7f84781552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847d200640 1 -- 172.21.15.5:0/3039072724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8478155980 con 0x7f8478144f90 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f8477e00640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8478144670 0x7f84781552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847d200640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8478144f90 0x7f84780cc4c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f847000a7e0 tx=0x7f845c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f8474c00640 1 -- 172.21.15.5:0/3039072724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84700bb070 con 0x7f8478144f90 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f8474c00640 1 -- 172.21.15.5:0/3039072724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84700ad430 con 0x7f8478144f90 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f8474c00640 1 -- 172.21.15.5:0/3039072724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847000a3d0 con 0x7f8478144f90 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847f200640 1 -- 172.21.15.5:0/3039072724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8478155c60 con 0x7f8478144f90 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847f200640 1 -- 172.21.15.5:0/3039072724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8478156220 con 0x7f8478144f90 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f847f200640 1 -- 172.21.15.5:0/3039072724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f847806e6e0 con 0x7f8478144f90 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.558+0000 7f8474c00640 1 -- 172.21.15.5:0/3039072724 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f84700be070 con 0x7f8478144f90 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.562+0000 7f8474c00640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84540678f0 0x7f8454069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.562+0000 7f8474c00640 1 -- 172.21.15.5:0/3039072724 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f847011fcb0 con 0x7f8478144f90 2024-08-18T22:23:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.562+0000 7f8477e00640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84540678f0 0x7f8454069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.562+0000 7f8477e00640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84540678f0 0x7f8454069db0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8478153400 tx=0x7f8468009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:21.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.566+0000 7f8474c00640 1 -- 172.21.15.5:0/3039072724 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8470016fd0 con 0x7f8478144f90 2024-08-18T22:23:21.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.730+0000 7f847f200640 1 -- 172.21.15.5:0/3039072724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f84780b04b0 con 0x7f8478144f90 2024-08-18T22:23:21.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.734+0000 7f8474c00640 1 -- 172.21.15.5:0/3039072724 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f84700f0140 con 0x7f8478144f90 2024-08-18T22:23:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 -- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84540678f0 msgr2=0x7f8454069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84540678f0 0x7f8454069db0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8478153400 tx=0x7f8468009190 comp rx=0 tx=0).stop 2024-08-18T22:23:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 -- 172.21.15.5:0/3039072724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8478144f90 msgr2=0x7f84780cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8478144f90 0x7f84780cc4c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f847000a7e0 tx=0x7f845c005840 comp rx=0 tx=0).stop 2024-08-18T22:23:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 -- 172.21.15.5:0/3039072724 shutdown_connections 2024-08-18T22:23:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84540678f0 0x7f8454069db0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8478144f90 0x7f84780cc4c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84781f4b10 0x7f8478144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 --2- 172.21.15.5:0/3039072724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8478144670 0x7f84781552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 -- 172.21.15.5:0/3039072724 >> 172.21.15.5:0/3039072724 conn(0x7f84780d2180 msgr2=0x7f84780af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 -- 172.21.15.5:0/3039072724 shutdown_connections 2024-08-18T22:23:21.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.738+0000 7f847f200640 1 -- 172.21.15.5:0/3039072724 wait complete. 2024-08-18T22:23:21.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-08-18T22:23:21.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.902+0000 7f04cc800640 1 Processor -- start 2024-08-18T22:23:21.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.902+0000 7f04cc800640 1 -- start start 2024-08-18T22:23:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.902+0000 7f04cc800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04c415c180 0x7f04c40cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.902+0000 7f04cc800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04c415d4d0 0x7f04c406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.902+0000 7f04cc800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04c40cfb00 con 0x7f04c415c560 2024-08-18T22:23:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.902+0000 7f04cc800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f04c415d040 con 0x7f04c415d4d0 2024-08-18T22:23:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.902+0000 7f04cc800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f04c415c9f0 con 0x7f04c415c180 2024-08-18T22:23:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04ca800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04c415d4d0 0x7f04c406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04ca800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04c415d4d0 0x7f04c406db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46872/0 (socket says 172.21.15.5:46872) 2024-08-18T22:23:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04ca800640 1 -- 172.21.15.5:0/2096692865 learned_addr learned my addr 172.21.15.5:0/2096692865 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04c9400640 1 --1- 172.21.15.5:0/2096692865 >> v1:172.21.15.5:6789/0 conn(0x7f04c415c560 0x7f04c40ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47284/0 (socket says 172.21.15.5:47284) 2024-08-18T22:23:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04c9e00640 1 --2- 172.21.15.5:0/2096692865 >> v2:172.21.15.117:3300/0 conn(0x7f04c415c180 0x7f04c40cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04ca800640 1 -- 172.21.15.5:0/2096692865 >> v2:172.21.15.117:3300/0 conn(0x7f04c415c180 msgr2=0x7f04c40cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04ca800640 1 --2- 172.21.15.5:0/2096692865 >> v2:172.21.15.117:3300/0 conn(0x7f04c415c180 0x7f04c40cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04ca800640 1 -- 172.21.15.5:0/2096692865 >> v1:172.21.15.5:6789/0 conn(0x7f04c415c560 legacy=0x7f04c40ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04ca800640 1 -- 172.21.15.5:0/2096692865 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c415ccd0 con 0x7f04c415d4d0 2024-08-18T22:23:21.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04ca800640 1 --2- 172.21.15.5:0/2096692865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c415d4d0 0x7f04c406db80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f04c406d8a0 tx=0x7f04c001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c3b8e7da35fd65 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04c8a00640 1 -- 172.21.15.5:0/2096692865 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c00a5840 con 0x7f04c415d4d0 2024-08-18T22:23:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04c8a00640 1 -- 172.21.15.5:0/2096692865 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c40ced70 con 0x7f04c415d4d0 2024-08-18T22:23:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.906+0000 7f04c8a00640 1 -- 172.21.15.5:0/2096692865 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c00a5c00 con 0x7f04c415d4d0 2024-08-18T22:23:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 -- 172.21.15.5:0/2096692865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c415d4d0 msgr2=0x7f04c406db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 --2- 172.21.15.5:0/2096692865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c415d4d0 0x7f04c406db80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f04c406d8a0 tx=0x7f04c001c960 comp rx=0 tx=0).stop 2024-08-18T22:23:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 -- 172.21.15.5:0/2096692865 shutdown_connections 2024-08-18T22:23:21.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 --2- 172.21.15.5:0/2096692865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c415d4d0 0x7f04c406db80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 --2- 172.21.15.5:0/2096692865 >> v2:172.21.15.117:3300/0 conn(0x7f04c415c180 0x7f04c40cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 -- 172.21.15.5:0/2096692865 >> 172.21.15.5:0/2096692865 conn(0x7f04c40b1dc0 msgr2=0x7f04c40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:21.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 -- 172.21.15.5:0/2096692865 shutdown_connections 2024-08-18T22:23:21.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 -- 172.21.15.5:0/2096692865 wait complete. 2024-08-18T22:23:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 Processor -- start 2024-08-18T22:23:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 -- start start 2024-08-18T22:23:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04c415c180 0x7f04c4071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c415d4d0 0x7f04c414b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04c40734f0 0x7f04c41565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f04c41692b0 con 0x7f04c415d4d0 2024-08-18T22:23:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f04c4169130 con 0x7f04c40734f0 2024-08-18T22:23:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04cc800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04c4169430 con 0x7f04c415c180 2024-08-18T22:23:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04c9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c415d4d0 0x7f04c414b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04c9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c415d4d0 0x7f04c414b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46880/0 (socket says 172.21.15.5:46880) 2024-08-18T22:23:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04c9400640 1 -- 172.21.15.5:0/2676406908 learned_addr learned my addr 172.21.15.5:0/2676406908 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04ca800640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04c40734f0 0x7f04c41565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04c9e00640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04c415c180 0x7f04c4071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04c9400640 1 -- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04c415c180 msgr2=0x7f04c4071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04c9400640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04c415c180 0x7f04c4071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04c9400640 1 -- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04c40734f0 msgr2=0x7f04c41565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04c9400640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04c40734f0 0x7f04c41565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.910+0000 7f04c9400640 1 -- 172.21.15.5:0/2676406908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c4156b00 con 0x7f04c415d4d0 2024-08-18T22:23:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.914+0000 7f04c9400640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c415d4d0 0x7f04c414b4a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c450 tx=0x7f04b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.914+0000 7f04be000640 1 -- 172.21.15.5:0/2676406908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b4018070 con 0x7f04c415d4d0 2024-08-18T22:23:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.914+0000 7f04be000640 1 -- 172.21.15.5:0/2676406908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b4007480 con 0x7f04c415d4d0 2024-08-18T22:23:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.914+0000 7f04cc800640 1 -- 172.21.15.5:0/2676406908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c4072450 con 0x7f04c415d4d0 2024-08-18T22:23:21.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.914+0000 7f04be000640 1 -- 172.21.15.5:0/2676406908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b40047f0 con 0x7f04c415d4d0 2024-08-18T22:23:21.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.914+0000 7f04cc800640 1 -- 172.21.15.5:0/2676406908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c4072a10 con 0x7f04c415d4d0 2024-08-18T22:23:21.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.914+0000 7f04cc800640 1 -- 172.21.15.5:0/2676406908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04c4074880 con 0x7f04c415d4d0 2024-08-18T22:23:21.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.914+0000 7f04be000640 1 -- 172.21.15.5:0/2676406908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04b401b070 con 0x7f04c415d4d0 2024-08-18T22:23:21.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.914+0000 7f04be000640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04a80678c0 0x7f04a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:21.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.914+0000 7f04be000640 1 -- 172.21.15.5:0/2676406908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f04b4085310 con 0x7f04c415d4d0 2024-08-18T22:23:21.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.914+0000 7f04c9e00640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04a80678c0 0x7f04a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:21.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.918+0000 7f04c9e00640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04a80678c0 0x7f04a8069d80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f04c4166ec0 tx=0x7f04b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:21.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:21.918+0000 7f04be000640 1 -- 172.21.15.5:0/2676406908 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f04b4055650 con 0x7f04c415d4d0 2024-08-18T22:23:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.082+0000 7f04cc800640 1 -- 172.21.15.5:0/2676406908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f04c4159550 con 0x7f04c415d4d0 2024-08-18T22:23:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.086+0000 7f04be000640 1 -- 172.21.15.5:0/2676406908 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v17)=0 v17) ==== 116+0+0 (secure 0 0 0) 0x7f04b40850d0 con 0x7f04c415d4d0 2024-08-18T22:23:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 -- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04a80678c0 msgr2=0x7f04a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04a80678c0 0x7f04a8069d80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f04c4166ec0 tx=0x7f04b8008040 comp rx=0 tx=0).stop 2024-08-18T22:23:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 -- 172.21.15.5:0/2676406908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c415d4d0 msgr2=0x7f04c414b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c415d4d0 0x7f04c414b4a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c450 tx=0x7f04b400c910 comp rx=0 tx=0).stop 2024-08-18T22:23:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 -- 172.21.15.5:0/2676406908 shutdown_connections 2024-08-18T22:23:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04a80678c0 0x7f04a8069d80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04c40734f0 0x7f04c41565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04c415d4d0 0x7f04c414b4a0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 --2- 172.21.15.5:0/2676406908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04c415c180 0x7f04c4071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 -- 172.21.15.5:0/2676406908 >> 172.21.15.5:0/2676406908 conn(0x7f04c40b1dc0 msgr2=0x7f04c414bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 -- 172.21.15.5:0/2676406908 shutdown_connections 2024-08-18T22:23:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.090+0000 7f04cc800640 1 -- 172.21.15.5:0/2676406908 wait complete. 2024-08-18T22:23:22.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:23:22.115 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-08-18T22:23:22.129 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:23:22.130 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:23:22.130 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-08-18T22:23:22.130 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:23:22.130 DEBUG:teuthology.orchestra.run.smithi005:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-08-18T22:23:22.130 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:23:22.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:23:22.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:23:22.238 INFO:teuthology.orchestra.run.smithi005.stdout:1099511627776 2024-08-18T22:23:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:23:22.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:22.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.422+0000 7fd34b000640 1 Processor -- start 2024-08-18T22:23:22.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd34b000640 1 -- start start 2024-08-18T22:23:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd34b000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd34415b010 0x7fd3440ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd34b000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd34406f290 0x7fd344072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd34b000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3440cee20 con 0x7fd3440cd3a0 2024-08-18T22:23:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd34b000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd3440cfa30 con 0x7fd34415b010 2024-08-18T22:23:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd34b000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd3440cf100 con 0x7fd34406f290 2024-08-18T22:23:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd343e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd34415b010 0x7fd3440ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd343e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd34415b010 0x7fd3440ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46888/0 (socket says 172.21.15.5:46888) 2024-08-18T22:23:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd343e00640 1 -- 172.21.15.5:0/222911261 learned_addr learned my addr 172.21.15.5:0/222911261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd349000640 1 --2- 172.21.15.5:0/222911261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd34406f290 0x7fd344072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:22.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd343e00640 1 -- 172.21.15.5:0/222911261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd34406f290 msgr2=0x7fd344072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:22.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd343e00640 1 --2- 172.21.15.5:0/222911261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd34406f290 0x7fd344072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd343e00640 1 -- 172.21.15.5:0/222911261 >> v1:172.21.15.117:6789/0 conn(0x7fd3440cd3a0 legacy=0x7fd34406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:22.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.426+0000 7fd343e00640 1 -- 172.21.15.5:0/222911261 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3440cf3e0 con 0x7fd34415b010 2024-08-18T22:23:22.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd343e00640 1 --2- 172.21.15.5:0/222911261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34415b010 0x7fd3440ce840 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd334009870 tx=0x7fd33401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9149c372be8aba5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:22.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd342a00640 1 -- 172.21.15.5:0/222911261 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3340ab660 con 0x7fd34415b010 2024-08-18T22:23:22.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd342a00640 1 -- 172.21.15.5:0/222911261 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3340b0070 con 0x7fd34415b010 2024-08-18T22:23:22.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd342a00640 1 -- 172.21.15.5:0/222911261 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3340aba20 con 0x7fd34415b010 2024-08-18T22:23:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd34b000640 1 -- 172.21.15.5:0/222911261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34415b010 msgr2=0x7fd3440ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd34b000640 1 --2- 172.21.15.5:0/222911261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34415b010 0x7fd3440ce840 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd334009870 tx=0x7fd33401c530 comp rx=0 tx=0).stop 2024-08-18T22:23:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd34b000640 1 -- 172.21.15.5:0/222911261 shutdown_connections 2024-08-18T22:23:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd34b000640 1 --2- 172.21.15.5:0/222911261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd34406f290 0x7fd344072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd34b000640 1 --2- 172.21.15.5:0/222911261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34415b010 0x7fd3440ce840 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd34b000640 1 -- 172.21.15.5:0/222911261 >> 172.21.15.5:0/222911261 conn(0x7fd3440b1c50 msgr2=0x7fd3440b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd34b000640 1 -- 172.21.15.5:0/222911261 shutdown_connections 2024-08-18T22:23:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd34b000640 1 -- 172.21.15.5:0/222911261 wait complete. 2024-08-18T22:23:22.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd34b000640 1 Processor -- start 2024-08-18T22:23:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.430+0000 7fd34b000640 1 -- start start 2024-08-18T22:23:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd34b000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd34406f290 0x7fd3440c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd34b000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3440cd3a0 0x7fd344157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd34b000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd34415b010 0x7fd34409b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd34b000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd3440734f0 con 0x7fd3440cd3a0 2024-08-18T22:23:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd34b000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd344073370 con 0x7fd34406f290 2024-08-18T22:23:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd34b000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd344073670 con 0x7fd34415b010 2024-08-18T22:23:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd343400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3440cd3a0 0x7fd344157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd343400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3440cd3a0 0x7fd344157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46904/0 (socket says 172.21.15.5:46904) 2024-08-18T22:23:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd343400640 1 -- 172.21.15.5:0/3458160866 learned_addr learned my addr 172.21.15.5:0/3458160866 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd349000640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd34415b010 0x7fd34409b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd343e00640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd34406f290 0x7fd3440c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd343400640 1 -- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd34415b010 msgr2=0x7fd34409b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd343400640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd34415b010 0x7fd34409b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd343400640 1 -- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd34406f290 msgr2=0x7fd3440c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd343400640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd34406f290 0x7fd3440c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd343400640 1 -- 172.21.15.5:0/3458160866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34409d9f0 con 0x7fd3440cd3a0 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd343e00640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd34406f290 0x7fd3440c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd343400640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3440cd3a0 0x7fd344157a50 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd33000c420 tx=0x7fd33000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd33be00640 1 -- 172.21.15.5:0/3458160866 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3300052d0 con 0x7fd3440cd3a0 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd33be00640 1 -- 172.21.15.5:0/3458160866 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd330005470 con 0x7fd3440cd3a0 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd33be00640 1 -- 172.21.15.5:0/3458160866 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330007260 con 0x7fd3440cd3a0 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd34b000640 1 -- 172.21.15.5:0/3458160866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34409ac90 con 0x7fd3440cd3a0 2024-08-18T22:23:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd34b000640 1 -- 172.21.15.5:0/3458160866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3441580c0 con 0x7fd3440cd3a0 2024-08-18T22:23:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd34b000640 1 -- 172.21.15.5:0/3458160866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd344072600 con 0x7fd3440cd3a0 2024-08-18T22:23:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.434+0000 7fd33be00640 1 -- 172.21.15.5:0/3458160866 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd330007400 con 0x7fd3440cd3a0 2024-08-18T22:23:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.438+0000 7fd33be00640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3240678c0 0x7fd324069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.438+0000 7fd33be00640 1 -- 172.21.15.5:0/3458160866 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fd330085420 con 0x7fd3440cd3a0 2024-08-18T22:23:22.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.438+0000 7fd343e00640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3240678c0 0x7fd324069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:22.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.438+0000 7fd343e00640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3240678c0 0x7fd324069d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd3340af000 tx=0x7fd3340a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:22.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.442+0000 7fd33be00640 1 -- 172.21.15.5:0/3458160866 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd330055d30 con 0x7fd3440cd3a0 2024-08-18T22:23:22.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.642+0000 7fd34b000640 1 -- 172.21.15.5:0/3458160866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3440b05d0 con 0x7fd3440cd3a0 2024-08-18T22:23:22.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.642+0000 7fd33be00640 1 -- 172.21.15.5:0/3458160866 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5218 (secure 0 0 0) 0x7fd330055630 con 0x7fd3440cd3a0 2024-08-18T22:23:22.648 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:22.648 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"btime":"2024-08-18T22:23:12:405942+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1431678393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1431678393},{"type":"v1","addr":"172.21.15.117:6835","nonce":1431678393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5953,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/620847831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":620847831},{"type":"v1","addr":"172.21.15.117:6837","nonce":620847831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5959,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/124523467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":124523467},{"type":"v1","addr":"172.21.15.5:6835","nonce":124523467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:11.801854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6276":{"gid":6276,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6833/3174043628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3174043628},{"type":"v1","addr":"172.21.15.5:6833","nonce":3174043628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6276,"qdb_cluster":[6276]},"id":4}]} 2024-08-18T22:23:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 40 2024-08-18T22:23:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 -- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3240678c0 msgr2=0x7fd324069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3240678c0 0x7fd324069d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd3340af000 tx=0x7fd3340a7000 comp rx=0 tx=0).stop 2024-08-18T22:23:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 -- 172.21.15.5:0/3458160866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3440cd3a0 msgr2=0x7fd344157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3440cd3a0 0x7fd344157a50 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd33000c420 tx=0x7fd33000c8e0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 -- 172.21.15.5:0/3458160866 shutdown_connections 2024-08-18T22:23:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3240678c0 0x7fd324069d80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd34415b010 0x7fd34409b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3440cd3a0 0x7fd344157a50 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 --2- 172.21.15.5:0/3458160866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd34406f290 0x7fd3440c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 -- 172.21.15.5:0/3458160866 >> 172.21.15.5:0/3458160866 conn(0x7fd3440b1c50 msgr2=0x7fd3440b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 -- 172.21.15.5:0/3458160866 shutdown_connections 2024-08-18T22:23:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:22.646+0000 7fd34b000640 1 -- 172.21.15.5:0/3458160866 wait complete. 2024-08-18T22:23:22.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-08-18T22:23:22.834 INFO:teuthology.orchestra.run.smithi005.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-08-18T22:23:22.122816+0000","btime":"2024-08-18T22:23:22.122816+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-08-18T22:23:22.122816+0000","atime":"2024-08-18T22:23:22.122816+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6453,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6453,"want_loner":6453,"mds_caps_wanted":[],"is_subvolume":false} 2024-08-18T22:23:22.834 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-08-18T22:23:22.122816+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-08-18T22:23:22.122816+0000", "change_attr": 0, "client_caps": [ { "client_id": 6453, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-08-18T22:23:22.122816+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6453, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-08-18T22:23:22.122816+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6453, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [] } 2024-08-18T22:23:22.835 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:23:22.835 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:22.844 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:23:22.844 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:23:22.844 DEBUG:teuthology.orchestra.run.smithi005:> import uuid 2024-08-18T22:23:22.844 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:23:22.844 DEBUG:teuthology.orchestra.run.smithi005:> n = 40 2024-08-18T22:23:22.844 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = False 2024-08-18T22:23:22.844 DEBUG:teuthology.orchestra.run.smithi005:> if 0 > 0: 2024-08-18T22:23:22.845 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = True 2024-08-18T22:23:22.845 DEBUG:teuthology.orchestra.run.smithi005:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-08-18T22:23:22.845 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:23:22.845 DEBUG:teuthology.orchestra.run.smithi005:> dpath = os.path.dirname(path) 2024-08-18T22:23:22.845 DEBUG:teuthology.orchestra.run.smithi005:> fnameprefix = os.path.basename(path) 2024-08-18T22:23:22.845 DEBUG:teuthology.orchestra.run.smithi005:> os.makedirs(dpath, exist_ok=True) 2024-08-18T22:23:22.845 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:23:22.845 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-08-18T22:23:22.845 DEBUG:teuthology.orchestra.run.smithi005:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-08-18T22:23:22.845 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:23:22.845 DEBUG:teuthology.orchestra.run.smithi005:> for i in range(n): 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> with open(fpath, '"'"'w'"'"') as f: 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> f.write(f"{i}") 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> f.flush() 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(f.fileno()) 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> os.unlink(fpath) 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> if create_hard_links: 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> for j in range(0): 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-08-18T22:23:22.846 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:23:22.847 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-08-18T22:23:22.847 DEBUG:teuthology.orchestra.run.smithi005:> finally: 2024-08-18T22:23:22.847 DEBUG:teuthology.orchestra.run.smithi005:> os.close(dirfd) 2024-08-18T22:23:22.847 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:23:23.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:23:23.023 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:23:23.023 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:23.074 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:23:23.074 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:23.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:23:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.306+0000 7fce00000640 1 Processor -- start 2024-08-18T22:23:23.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.306+0000 7fce00000640 1 -- start start 2024-08-18T22:23:23.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.306+0000 7fce00000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdf815b0c0 0x7fcdf806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.306+0000 7fce00000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf80b31f0 con 0x7fcdf80cf290 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.306+0000 7fce00000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf80b34d0 con 0x7fcdf80b40c0 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.306+0000 7fce00000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf80b3d70 con 0x7fcdf815b0c0 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.306+0000 7fcdfe000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcdf80cf290 0x7fcdf8073140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47288/0 (socket says 172.21.15.5:47288) 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.306+0000 7fcdfe000640 1 -- 172.21.15.5:0/3342209771 learned_addr learned my addr 172.21.15.5:0/3342209771 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.306+0000 7fcdfd600640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdf815b0c0 0x7fcdf806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.306+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000786772 0 0) 0x7fcdf80b31f0 con 0x7fcdf80cf290 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.306+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcde0003530 con 0x7fcdf80cf290 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 691558530 0 0) 0x7fcde0003530 con 0x7fcdf80cf290 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdf815b0c0 msgr2=0x7fcdf806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdf815b0c0 0x7fcdf806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 >> v1:172.21.15.117:6789/0 conn(0x7fcdf80b40c0 legacy=0x7fcdf8072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf80b37b0 con 0x7fcdf80cf290 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fcdf0001a00 con 0x7fcdf80cf290 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 >> v1:172.21.15.5:6789/0 conn(0x7fcdf80cf290 legacy=0x7fcdf8073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00039f0 0x7fcde0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 0x7fcde0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcde0005220 0x7fcde000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf80b3d70 con 0x7fcde0004810 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcde000c100 con 0x7fcde00039f0 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcde000c300 con 0x7fcde0005220 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdfd600640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdf815b0c0 0x7fcdf806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdfcc00640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 0x7fcde0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdfd600640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00039f0 0x7fcde0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdfe000640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcde0005220 0x7fcde000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdfcc00640 1 -- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcde0005220 msgr2=0x7fcde000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:23.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdfcc00640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcde0005220 0x7fcde000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdfcc00640 1 -- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00039f0 msgr2=0x7fcde0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdfcc00640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00039f0 0x7fcde0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdfcc00640 1 -- 172.21.15.5:0/3342209771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde0003530 con 0x7fcde0004810 2024-08-18T22:23:23.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdfd600640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00039f0 0x7fcde0003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.310+0000 7fcdfcc00640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 0x7fcde0004c90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcdf809e380 tx=0x7fcde401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd717fb9172e4bc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde40b1070 con 0x7fcde0004810 2024-08-18T22:23:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde40ac600 con 0x7fcde0004810 2024-08-18T22:23:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fcdf7e00640 1 -- 172.21.15.5:0/3342209771 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde4001460 con 0x7fcde0004810 2024-08-18T22:23:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 -- 172.21.15.5:0/3342209771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 msgr2=0x7fcde0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 --2- 172.21.15.5:0/3342209771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 0x7fcde0004c90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcdf809e380 tx=0x7fcde401c490 comp rx=0 tx=0).stop 2024-08-18T22:23:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fcdfe000640 1 -- 172.21.15.5:0/3342209771 reap_dead start 2024-08-18T22:23:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 -- 172.21.15.5:0/3342209771 shutdown_connections 2024-08-18T22:23:23.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 -- 172.21.15.5:0/3342209771 >> 172.21.15.5:0/3342209771 conn(0x7fcdf80b1dc0 msgr2=0x7fcdf80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 -- 172.21.15.5:0/3342209771 shutdown_connections 2024-08-18T22:23:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 -- 172.21.15.5:0/3342209771 wait complete. 2024-08-18T22:23:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 Processor -- start 2024-08-18T22:23:23.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 -- start start 2024-08-18T22:23:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 0x7fcdf815e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdf8154420 0x7fcdf814b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdf80ccaa0 0x7fcdf80ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf815b620 con 0x7fcde0004810 2024-08-18T22:23:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf815b4a0 con 0x7fcdf8154420 2024-08-18T22:23:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fce00000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf806f670 con 0x7fcdf80ccaa0 2024-08-18T22:23:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fcdfd600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 0x7fcdf815e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fcdfd600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 0x7fcdf815e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46920/0 (socket says 172.21.15.5:46920) 2024-08-18T22:23:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fcdfd600640 1 -- 172.21.15.5:0/2751718350 learned_addr learned my addr 172.21.15.5:0/2751718350 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:23.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fcdfe000640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdf80ccaa0 0x7fcdf80ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.314+0000 7fcdfcc00640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdf8154420 0x7fcdf814b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdfd600640 1 -- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdf80ccaa0 msgr2=0x7fcdf80ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdfd600640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdf80ccaa0 0x7fcdf80ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdfd600640 1 -- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdf8154420 msgr2=0x7fcdf814b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdfd600640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdf8154420 0x7fcdf814b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdfd600640 1 -- 172.21.15.5:0/2751718350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf81549c0 con 0x7fcde0004810 2024-08-18T22:23:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdfd600640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 0x7fcdf815e380 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0116b0 tx=0x7fcdec011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdf5600640 1 -- 172.21.15.5:0/2751718350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec00f9c0 con 0x7fcde0004810 2024-08-18T22:23:23.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdf5600640 1 -- 172.21.15.5:0/2751718350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdec00fb60 con 0x7fcde0004810 2024-08-18T22:23:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdf5600640 1 -- 172.21.15.5:0/2751718350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec015460 con 0x7fcde0004810 2024-08-18T22:23:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fce00000640 1 -- 172.21.15.5:0/2751718350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf8154ca0 con 0x7fcde0004810 2024-08-18T22:23:23.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fce00000640 1 -- 172.21.15.5:0/2751718350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf8155260 con 0x7fcde0004810 2024-08-18T22:23:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fce00000640 1 -- 172.21.15.5:0/2751718350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf8072a30 con 0x7fcde0004810 2024-08-18T22:23:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdf5600640 1 -- 172.21.15.5:0/2751718350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcdec015600 con 0x7fcde0004810 2024-08-18T22:23:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdf5600640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdd80678c0 0x7fcdd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.318+0000 7fcdf5600640 1 -- 172.21.15.5:0/2751718350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fcdec086830 con 0x7fcde0004810 2024-08-18T22:23:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.322+0000 7fcdfcc00640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdd80678c0 0x7fcdd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.322+0000 7fcdfcc00640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdd80678c0 0x7fcdd8069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcde40ae000 tx=0x7fcde40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:23.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.322+0000 7fcdf5600640 1 -- 172.21.15.5:0/2751718350 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcdec019030 con 0x7fcde0004810 2024-08-18T22:23:23.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 -- 172.21.15.5:0/2751718350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcdf80afed0 con 0x7fcde0004810 2024-08-18T22:23:23.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fcdf5600640 1 -- 172.21.15.5:0/2751718350 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v67) ==== 80+0+0 (secure 0 0 0) 0x7fcdec056af0 con 0x7fcde0004810 2024-08-18T22:23:23.507 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:23:23.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 -- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdd80678c0 msgr2=0x7fcdd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdd80678c0 0x7fcdd8069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcde40ae000 tx=0x7fcde40a7000 comp rx=0 tx=0).stop 2024-08-18T22:23:23.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 -- 172.21.15.5:0/2751718350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 msgr2=0x7fcdf815e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 0x7fcdf815e380 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0116b0 tx=0x7fcdec011b70 comp rx=0 tx=0).stop 2024-08-18T22:23:23.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 -- 172.21.15.5:0/2751718350 shutdown_connections 2024-08-18T22:23:23.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcdd80678c0 0x7fcdd8069d80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcdf80ccaa0 0x7fcdf80ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcdf8154420 0x7fcdf814b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 --2- 172.21.15.5:0/2751718350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcde0004810 0x7fcdf815e380 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 -- 172.21.15.5:0/2751718350 >> 172.21.15.5:0/2751718350 conn(0x7fcdf80b1dc0 msgr2=0x7fcdf80b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:23.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 -- 172.21.15.5:0/2751718350 shutdown_connections 2024-08-18T22:23:23.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.502+0000 7fce00000640 1 -- 172.21.15.5:0/2751718350 wait complete. 2024-08-18T22:23:23.527 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:23:23.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:23:23.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:23:23.613 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:23:23.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:23:23.613 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:23:23.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-08-18T22:23:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.806+0000 7fa9fcc00640 1 Processor -- start 2024-08-18T22:23:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.806+0000 7fa9fcc00640 1 -- start start 2024-08-18T22:23:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.806+0000 7fa9fcc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa9f80b40c0 0x7fa9f80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.806+0000 7fa9fcc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f80b31f0 con 0x7fa9f80ce280 2024-08-18T22:23:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9fcc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f80b34d0 con 0x7fa9f815b0c0 2024-08-18T22:23:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9fcc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f80b4a70 con 0x7fa9f80b40c0 2024-08-18T22:23:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9f6800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa9f80ce280 0x7fa9f80ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50262/0 (socket says 172.21.15.5:50262) 2024-08-18T22:23:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9f6800640 1 -- 172.21.15.5:0/426707875 learned_addr learned my addr 172.21.15.5:0/426707875 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9ed400640 1 --2- 172.21.15.5:0/426707875 >> v2:172.21.15.117:3300/0 conn(0x7fa9f80b40c0 0x7fa9f80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9f5400640 1 -- 172.21.15.5:0/426707875 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1448825306 0 0) 0x7fa9f80b31f0 con 0x7fa9f80ce280 2024-08-18T22:23:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9f5400640 1 -- 172.21.15.5:0/426707875 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9dc003530 con 0x7fa9f80ce280 2024-08-18T22:23:23.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9f5400640 1 -- 172.21.15.5:0/426707875 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096058439 0 0) 0x7fa9f80b34d0 con 0x7fa9f815b0c0 2024-08-18T22:23:23.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9f5400640 1 -- 172.21.15.5:0/426707875 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9f80b31f0 con 0x7fa9f815b0c0 2024-08-18T22:23:23.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9ed400640 1 -- 172.21.15.5:0/426707875 >> v1:172.21.15.117:6789/0 conn(0x7fa9f815b0c0 legacy=0x7fa9f806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9ed400640 1 -- 172.21.15.5:0/426707875 >> v1:172.21.15.5:6789/0 conn(0x7fa9f80ce280 legacy=0x7fa9f80ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9f5400640 1 -- 172.21.15.5:0/426707875 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4148595723 0 0) 0x7fa9dc003530 con 0x7fa9f80ce280 2024-08-18T22:23:23.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.810+0000 7fa9ed400640 1 -- 172.21.15.5:0/426707875 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f80b37b0 con 0x7fa9f80b40c0 2024-08-18T22:23:23.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9ed400640 1 --2- 172.21.15.5:0/426707875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f80b40c0 0x7fa9f80b4530 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00097c0 tx=0x7fa9e001c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d9757305f5f624d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:23.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9f5400640 1 -- 172.21.15.5:0/426707875 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00b0070 con 0x7fa9f80b40c0 2024-08-18T22:23:23.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9f5400640 1 -- 172.21.15.5:0/426707875 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e00ab400 con 0x7fa9f80b40c0 2024-08-18T22:23:23.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9f5400640 1 -- 172.21.15.5:0/426707875 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0001680 con 0x7fa9f80b40c0 2024-08-18T22:23:23.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 -- 172.21.15.5:0/426707875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f80b40c0 msgr2=0x7fa9f80b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 --2- 172.21.15.5:0/426707875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f80b40c0 0x7fa9f80b4530 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00097c0 tx=0x7fa9e001c2a0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 -- 172.21.15.5:0/426707875 shutdown_connections 2024-08-18T22:23:23.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 --2- 172.21.15.5:0/426707875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f80b40c0 0x7fa9f80b4530 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 -- 172.21.15.5:0/426707875 >> 172.21.15.5:0/426707875 conn(0x7fa9f80b1dc0 msgr2=0x7fa9f80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:23.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 -- 172.21.15.5:0/426707875 shutdown_connections 2024-08-18T22:23:23.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 -- 172.21.15.5:0/426707875 wait complete. 2024-08-18T22:23:23.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 Processor -- start 2024-08-18T22:23:23.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 -- start start 2024-08-18T22:23:23.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f80b40c0 0x7fa9f814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9f80ce280 0x7fa9f8152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9f815b0c0 0x7fa9f81509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8168d20 con 0x7fa9f815b0c0 2024-08-18T22:23:23.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f806f880 con 0x7fa9f80b40c0 2024-08-18T22:23:23.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9fcc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f8168ea0 con 0x7fa9f80ce280 2024-08-18T22:23:23.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9f6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9f815b0c0 0x7fa9f81509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9f6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9f815b0c0 0x7fa9f81509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51638/0 (socket says 172.21.15.5:51638) 2024-08-18T22:23:23.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9f6800640 1 -- 172.21.15.5:0/178876186 learned_addr learned my addr 172.21.15.5:0/178876186 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:23.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.814+0000 7fa9f5e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f80b40c0 0x7fa9f814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9ed400640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9f80ce280 0x7fa9f8152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9f6800640 1 -- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9f80ce280 msgr2=0x7fa9f8152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9f6800640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9f80ce280 0x7fa9f8152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9f6800640 1 -- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f80b40c0 msgr2=0x7fa9f814c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9f6800640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f80b40c0 0x7fa9f814c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9f6800640 1 -- 172.21.15.5:0/178876186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f8153600 con 0x7fa9f815b0c0 2024-08-18T22:23:23.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9f6800640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9f815b0c0 0x7fa9f81509e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000c600 tx=0x7fa9f000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:23.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9eea00640 1 -- 172.21.15.5:0/178876186 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0005cf0 con 0x7fa9f815b0c0 2024-08-18T22:23:23.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9eea00640 1 -- 172.21.15.5:0/178876186 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f0007070 con 0x7fa9f815b0c0 2024-08-18T22:23:23.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9fcc00640 1 -- 172.21.15.5:0/178876186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f81538e0 con 0x7fa9f815b0c0 2024-08-18T22:23:23.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9eea00640 1 -- 172.21.15.5:0/178876186 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0007460 con 0x7fa9f815b0c0 2024-08-18T22:23:23.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9fcc00640 1 -- 172.21.15.5:0/178876186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f8153ea0 con 0x7fa9f815b0c0 2024-08-18T22:23:23.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9eea00640 1 -- 172.21.15.5:0/178876186 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa9f0007600 con 0x7fa9f815b0c0 2024-08-18T22:23:23.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.818+0000 7fa9eea00640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9d40678c0 0x7fa9d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9eea00640 1 -- 172.21.15.5:0/178876186 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fa9f0085bc0 con 0x7fa9f815b0c0 2024-08-18T22:23:23.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9d40678c0 0x7fa9d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 Processor -- start 2024-08-18T22:23:23.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 -- start start 2024-08-18T22:23:23.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9d40678c0 0x7fa9d4069d80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8001570 tx=0x7fa9e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:23.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fb9a0 0x557a509fbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fc2c0 0x557a509aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509af500 0x557a509af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557a50898ae0 con 0x557a509fb9a0 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557a50884ba0 con 0x557a509fc2c0 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x557a507ff4f0 con 0x557a509af500 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fb9a0 0x557a509fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fb9a0 0x557a509fbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51654/0 (socket says 172.21.15.5:51654) 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3718381371 learned_addr learned my addr 172.21.15.5:0/3718381371 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9ed400640 1 --2- 172.21.15.5:0/3718381371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fc2c0 0x557a509aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f6800640 1 --2- 172.21.15.5:0/3718381371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509af500 0x557a509af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3718381371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509af500 msgr2=0x557a509af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3718381371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509af500 0x557a509af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3718381371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fc2c0 msgr2=0x557a509aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:23.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3718381371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fc2c0 0x557a509aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3718381371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a5079fa90 con 0x557a509fb9a0 2024-08-18T22:23:23.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3718381371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fb9a0 0x557a509fbd80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8002070 tx=0x7fa9e8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19909bbee3801e16 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:23.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9e6a00640 1 -- 172.21.15.5:0/3718381371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8025070 con 0x557a509fb9a0 2024-08-18T22:23:23.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9e6a00640 1 -- 172.21.15.5:0/3718381371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e801b050 con 0x557a509fb9a0 2024-08-18T22:23:23.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7fa9e6a00640 1 -- 172.21.15.5:0/3718381371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e80137c0 con 0x557a509fb9a0 2024-08-18T22:23:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 -- 172.21.15.5:0/3718381371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fb9a0 msgr2=0x557a509fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 --2- 172.21.15.5:0/3718381371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fb9a0 0x557a509fbd80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8002070 tx=0x7fa9e8012000 comp rx=0 tx=0).stop 2024-08-18T22:23:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 -- 172.21.15.5:0/3718381371 shutdown_connections 2024-08-18T22:23:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 --2- 172.21.15.5:0/3718381371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509af500 0x557a509af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 --2- 172.21.15.5:0/3718381371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fc2c0 0x557a509aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 --2- 172.21.15.5:0/3718381371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fb9a0 0x557a509fbd80 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 -- 172.21.15.5:0/3718381371 >> 172.21.15.5:0/3718381371 conn(0x557a509a9010 msgr2=0x557a509de820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:23.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 -- 172.21.15.5:0/3718381371 shutdown_connections 2024-08-18T22:23:23.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.822+0000 7faa001d7000 1 -- 172.21.15.5:0/3718381371 wait complete. 2024-08-18T22:23:23.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 -- start start 2024-08-18T22:23:23.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 Processor -- start 2024-08-18T22:23:23.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509fb9a0 0x557a509b7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fc2c0 0x557a509b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557a507fb4b0 con 0x557a509af500 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557a507b9b50 con 0x557a509fc2c0 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x557a507a0d00 con 0x557a509fb9a0 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 10 client.0 _ll_register_callbacks cb 0x557a5099cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9ed400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509fb9a0 0x557a509b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51660/0 (socket says 172.21.15.5:51660) 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3460988618 learned_addr learned my addr 172.21.15.5:0/3460988618 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9f6800640 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fc2c0 0x557a509b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3460988618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509fb9a0 msgr2=0x557a509b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:23.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509fb9a0 0x557a509b7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3460988618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fc2c0 msgr2=0x557a509b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fc2c0 0x557a509b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3460988618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a507b8060 con 0x557a509af500 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dc040 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8014cb0 tx=0x7fa9e80014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb0c123b3ef0787 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9db400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9db400640 1 -- 172.21.15.5:0/3460988618 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8030060 con 0x557a509af500 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9db400640 1 -- 172.21.15.5:0/3460988618 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fa9e802b610 con 0x557a509af500 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 -- 172.21.15.5:0/3460988618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9e801b050 con 0x557a509af500 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9db400640 1 -- 172.21.15.5:0/3460988618 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa9e8036050 con 0x557a509af500 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 10 client.6495 fetch_fsmap learned FSMap version 40 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 -- 172.21.15.5:0/3460988618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x557a507cbf50 con 0x557a509af500 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9db400640 1 -- 172.21.15.5:0/3460988618 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e801b050 con 0x557a509af500 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9db400640 1 -- 172.21.15.5:0/3460988618 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7fa9e8039020 con 0x557a509af500 2024-08-18T22:23:23.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 10 client.6495 fetch_fsmap finished waiting for FSMap version 40 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 10 client.6495 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 20 client.6495 populate_metadata read hostname 'smithi005' 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x557a509ddd30 0x557a509de110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 4 client.6495 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7faa001d7000 1 -- 172.21.15.5:0/3460988618 --> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a50799e10 con 0x557a509ddd30 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.826+0000 7fa9ed400640 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x557a509ddd30 0x557a509de110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7fa9db400640 10 client.6495 ms_handle_connect on v2:172.21.15.5:6832/3174043628 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7fa9ed400640 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x557a509ddd30 0x557a509de110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6290ec32a701da6 server_cookie=f651fdee28a8413e in_seq=0 out_seq=0 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7fa9db400640 1 -- 172.21.15.5:0/3460988618 <== mds.0 v2:172.21.15.5:6832/3174043628 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a50799e10 con 0x557a509ddd30 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7fa9db400640 10 client.6495 handle_command_reply: tid=0 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 1 client.6495 shutdown 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 1 -- 172.21.15.5:0/3460988618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 msgr2=0x557a509dc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dc040 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8014cb0 tx=0x7fa9e80014e0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 1 -- 172.21.15.5:0/3460988618 shutdown_connections 2024-08-18T22:23:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x557a509ddd30 0x557a509de110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fc2c0 0x557a509b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509fb9a0 0x557a509b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 1 --2- 172.21.15.5:0/3460988618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dc040 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7fa9db400640 0 client.6495 ms_handle_reset on v2:172.21.15.5:6832/3174043628 2024-08-18T22:23:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 1 -- 172.21.15.5:0/3460988618 >> 172.21.15.5:0/3460988618 conn(0x557a509a9010 msgr2=0x557a509ae6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 1 -- 172.21.15.5:0/3460988618 shutdown_connections 2024-08-18T22:23:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 1 -- 172.21.15.5:0/3460988618 wait complete. 2024-08-18T22:23:23.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.830+0000 7faa001d7000 20 client.6495 trim_cache size 0 max 16384 2024-08-18T22:23:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 Processor -- start 2024-08-18T22:23:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 -- start start 2024-08-18T22:23:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fb9a0 0x557a509dd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509fc2c0 0x557a50a12070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8201b60 con 0x557a509af500 2024-08-18T22:23:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8200bc0 con 0x557a509fb9a0 2024-08-18T22:23:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f813bb40 con 0x557a509fc2c0 2024-08-18T22:23:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51670/0 (socket says 172.21.15.5:51670) 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3854328320 learned_addr learned my addr 172.21.15.5:0/3854328320 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9ed400640 1 --2- 172.21.15.5:0/3854328320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fb9a0 0x557a509dd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9f6800640 1 --2- 172.21.15.5:0/3854328320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509fc2c0 0x557a50a12070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3854328320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509fc2c0 msgr2=0x557a50a12070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3854328320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509fc2c0 0x557a50a12070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3854328320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fb9a0 msgr2=0x557a509dd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3854328320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fb9a0 0x557a509dd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9f5e00640 1 -- 172.21.15.5:0/3854328320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a50881dd0 con 0x557a509af500 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9ed400640 1 --2- 172.21.15.5:0/3854328320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fb9a0 0x557a509dd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9f6800640 1 --2- 172.21.15.5:0/3854328320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509fc2c0 0x557a50a12070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3854328320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dccf0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80012a0 tx=0x7fa9e8029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8df9023b7912e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9e6000640 1 -- 172.21.15.5:0/3854328320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e803f070 con 0x557a509af500 2024-08-18T22:23:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9e6000640 1 -- 172.21.15.5:0/3854328320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e801b070 con 0x557a509af500 2024-08-18T22:23:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7fa9e6000640 1 -- 172.21.15.5:0/3854328320 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8025070 con 0x557a509af500 2024-08-18T22:23:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 -- 172.21.15.5:0/3854328320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 msgr2=0x557a509dccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 --2- 172.21.15.5:0/3854328320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dccf0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80012a0 tx=0x7fa9e8029000 comp rx=0 tx=0).stop 2024-08-18T22:23:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 -- 172.21.15.5:0/3854328320 shutdown_connections 2024-08-18T22:23:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 --2- 172.21.15.5:0/3854328320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509fc2c0 0x557a50a12070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 --2- 172.21.15.5:0/3854328320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fb9a0 0x557a509dd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 --2- 172.21.15.5:0/3854328320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509af500 0x557a509dccf0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 -- 172.21.15.5:0/3854328320 >> 172.21.15.5:0/3854328320 conn(0x557a509a9010 msgr2=0x557a509dc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 -- 172.21.15.5:0/3854328320 shutdown_connections 2024-08-18T22:23:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.846+0000 7faa001d7000 1 -- 172.21.15.5:0/3854328320 wait complete. 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 -- start start 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 Processor -- start 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509af500 0x557a50a73840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fb9a0 0x557a50a73d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fc2c0 0x557a50a742c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557a508bc240 con 0x557a509fc2c0 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557a50881940 con 0x557a509fb9a0 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x557a507fe800 con 0x557a509af500 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 10 client.0 _ll_register_callbacks cb 0x7fa9e8023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fc2c0 0x557a50a742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fc2c0 0x557a50a742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51686/0 (socket says 172.21.15.5:51686) 2024-08-18T22:23:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f6800640 1 -- 172.21.15.5:0/3891723919 learned_addr learned my addr 172.21.15.5:0/3891723919 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509af500 0x557a50a73840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9ed400640 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fb9a0 0x557a50a73d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f6800640 1 -- 172.21.15.5:0/3891723919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509af500 msgr2=0x557a50a73840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f6800640 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509af500 0x557a50a73840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f6800640 1 -- 172.21.15.5:0/3891723919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fb9a0 msgr2=0x557a50a73d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f6800640 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fb9a0 0x557a50a73d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f6800640 1 -- 172.21.15.5:0/3891723919 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a50792cd0 con 0x557a509fc2c0 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509af500 0x557a50a73840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f6800640 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fc2c0 0x557a50a742c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0055b80 tx=0x7fa9f005a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e8b4bad5c14bb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9db400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9db400640 1 -- 172.21.15.5:0/3891723919 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0059040 con 0x557a509fc2c0 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9db400640 1 -- 172.21.15.5:0/3891723919 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fa9f005e520 con 0x557a509fc2c0 2024-08-18T22:23:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 -- 172.21.15.5:0/3891723919 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9e801b070 con 0x557a509fc2c0 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9db400640 1 -- 172.21.15.5:0/3891723919 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa9f005e720 con 0x557a509fc2c0 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 10 client.6501 fetch_fsmap learned FSMap version 40 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 -- 172.21.15.5:0/3891723919 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x557a507a5320 con 0x557a509fc2c0 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9db400640 1 -- 172.21.15.5:0/3891723919 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e801b070 con 0x557a509fc2c0 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9db400640 1 -- 172.21.15.5:0/3891723919 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7fa9f00552d0 con 0x557a509fc2c0 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 10 client.6501 fetch_fsmap finished waiting for FSMap version 40 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 10 client.6501 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 20 client.6501 populate_metadata read hostname 'smithi005' 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x557a50a2eef0 0x557a50a2f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 4 client.6501 mds_command: new command op to 6276 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7faa001d7000 1 -- 172.21.15.5:0/3891723919 --> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a5080cc20 con 0x557a50a2eef0 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x557a50a2eef0 0x557a50a2f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9f5e00640 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x557a50a2eef0 0x557a50a2f300 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41cb2b217bcde645 server_cookie=a5ab281ff904b060 in_seq=0 out_seq=0 2024-08-18T22:23:23.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.850+0000 7fa9db400640 10 client.6501 ms_handle_connect on v2:172.21.15.5:6832/3174043628 2024-08-18T22:23:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7fa9db400640 1 -- 172.21.15.5:0/3891723919 <== mds.0 v2:172.21.15.5:6832/3174043628 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557a5080cc20 con 0x557a50a2eef0 2024-08-18T22:23:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7fa9db400640 10 client.6501 handle_command_reply: tid=0 2024-08-18T22:23:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7faa001d7000 1 client.6501 shutdown 2024-08-18T22:23:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7faa001d7000 1 -- 172.21.15.5:0/3891723919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fc2c0 msgr2=0x557a50a742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7faa001d7000 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fc2c0 0x557a50a742c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0055b80 tx=0x7fa9f005a240 comp rx=0 tx=0).stop 2024-08-18T22:23:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7faa001d7000 1 -- 172.21.15.5:0/3891723919 shutdown_connections 2024-08-18T22:23:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7faa001d7000 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.5:6832/3174043628,v1:172.21.15.5:6833/3174043628] conn(0x557a50a2eef0 0x557a50a2f300 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7faa001d7000 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a509fc2c0 0x557a50a742c0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7faa001d7000 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a509fb9a0 0x557a50a73d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7faa001d7000 1 --2- 172.21.15.5:0/3891723919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a509af500 0x557a50a73840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7fa9db400640 0 client.6501 ms_handle_reset on v2:172.21.15.5:6832/3174043628 2024-08-18T22:23:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7faa001d7000 1 -- 172.21.15.5:0/3891723919 >> 172.21.15.5:0/3891723919 conn(0x557a509a9010 msgr2=0x557a509dcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7faa001d7000 1 -- 172.21.15.5:0/3891723919 shutdown_connections 2024-08-18T22:23:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.866+0000 7faa001d7000 1 -- 172.21.15.5:0/3891723919 wait complete. 2024-08-18T22:23:23.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7faa001d7000 20 client.6501 trim_cache size 0 max 16384 2024-08-18T22:23:23.874 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:23:23.874 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:23:23.874 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:23:23.875 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:23:23.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 -- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9d40678c0 msgr2=0x7fa9d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9d40678c0 0x7fa9d4069d80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8001570 tx=0x7fa9e8009040 comp rx=0 tx=0).stop 2024-08-18T22:23:23.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 -- 172.21.15.5:0/178876186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9f815b0c0 msgr2=0x7fa9f81509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:23.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9f815b0c0 0x7fa9f81509e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa9f000c600 tx=0x7fa9f000cac0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 -- 172.21.15.5:0/178876186 shutdown_connections 2024-08-18T22:23:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9d40678c0 0x7fa9d4069d80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9f815b0c0 0x7fa9f81509e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9f80ce280 0x7fa9f8152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 --2- 172.21.15.5:0/178876186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f80b40c0 0x7fa9f814c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 -- 172.21.15.5:0/178876186 >> 172.21.15.5:0/178876186 conn(0x7fa9f80b1dc0 msgr2=0x7fa9f80af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 -- 172.21.15.5:0/178876186 shutdown_connections 2024-08-18T22:23:23.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:23.870+0000 7fa9fcc00640 1 -- 172.21.15.5:0/178876186 wait complete. 2024-08-18T22:23:23.892 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:23:23.892 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:23:23.893 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:23:23.893 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:23:23.893 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:23:23.893 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:23:23.893 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:23:23.894 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:23:23.907 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:23:23.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-08-18T22:23:23.908 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:23:23.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-08-18T22:23:23.909 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:23:23.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-08-18T22:23:23.910 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:23:23.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-08-18T22:23:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52c00640 1 Processor -- start 2024-08-18T22:23:24.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb029400640 1 Processor -- start 2024-08-18T22:23:24.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52c00640 1 -- start start 2024-08-18T22:23:24.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb029400640 1 -- start start 2024-08-18T22:23:24.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fac4c15e110 0x7fac4c0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac4c0b3370 0x7fac4c06ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac4c073170 con 0x7fac4c0b6210 2024-08-18T22:23:24.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fac4c0b3fd0 con 0x7fac4c0b3370 2024-08-18T22:23:24.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fac4c15e4f0 con 0x7fac4c15e110 2024-08-18T22:23:24.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7f99c7400640 1 Processor -- start 2024-08-18T22:23:24.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac4c0b3370 0x7fac4c06ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac4c0b3370 0x7fac4c06ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51694/0 (socket says 172.21.15.5:51694) 2024-08-18T22:23:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52200640 1 -- 172.21.15.5:0/567412424 learned_addr learned my addr 172.21.15.5:0/567412424 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac51800640 1 --2- 172.21.15.5:0/567412424 >> v2:172.21.15.117:3300/0 conn(0x7fac4c15e110 0x7fac4c0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7f99c7400640 1 -- start start 2024-08-18T22:23:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb029400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb02415c180 0x7fb0240cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb029400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02415c560 0x7fb0240ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52200640 1 -- 172.21.15.5:0/567412424 >> v2:172.21.15.117:3300/0 conn(0x7fac4c15e110 msgr2=0x7fac4c0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:24.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52200640 1 --2- 172.21.15.5:0/567412424 >> v2:172.21.15.117:3300/0 conn(0x7fac4c15e110 0x7fac4c0b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb029400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb02415d4d0 0x7fb0240ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb029400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb02415d040 con 0x7fb02415c180 2024-08-18T22:23:24.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb029400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb0240cfb00 con 0x7fb02415d4d0 2024-08-18T22:23:24.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb029400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb02415c9f0 con 0x7fb02415c560 2024-08-18T22:23:24.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52200640 1 -- 172.21.15.5:0/567412424 >> v1:172.21.15.5:6789/0 conn(0x7fac4c0b6210 legacy=0x7fac4c0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fac52200640 1 -- 172.21.15.5:0/567412424 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4c073450 con 0x7fac4c0b3370 2024-08-18T22:23:24.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb023200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb02415d4d0 0x7fb0240ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb01be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02415c560 0x7fb0240ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb022800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb02415c180 0x7fb0240cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb023200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb02415d4d0 0x7fb0240ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:55634/0 (socket says 172.21.15.5:55634) 2024-08-18T22:23:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb023200640 1 -- 172.21.15.5:0/3577106205 learned_addr learned my addr 172.21.15.5:0/3577106205 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb023200640 1 -- 172.21.15.5:0/3577106205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02415c560 msgr2=0x7fb0240ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb023200640 1 --2- 172.21.15.5:0/3577106205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02415c560 0x7fb0240ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb023200640 1 -- 172.21.15.5:0/3577106205 >> v2:172.21.15.5:3300/0 conn(0x7fb02415c180 msgr2=0x7fb0240cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb023200640 1 --2- 172.21.15.5:0/3577106205 >> v2:172.21.15.5:3300/0 conn(0x7fb02415c180 0x7fb0240cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb023200640 1 -- 172.21.15.5:0/3577106205 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02415ccd0 con 0x7fb02415d4d0 2024-08-18T22:23:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb01be00640 1 --2- 172.21.15.5:0/3577106205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02415c560 0x7fb0240ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7fb022800640 1 --2- 172.21.15.5:0/3577106205 >> v2:172.21.15.5:3300/0 conn(0x7fb02415c180 0x7fb0240cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:24.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7f99c7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99c015b150 0x7f99c00d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.094+0000 7f99c7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c015c480 0x7f99c00b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f99c7400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99c00d0880 con 0x7f99c00ce120 2024-08-18T22:23:24.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f99c7400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f99c00cdc90 con 0x7f99c015b150 2024-08-18T22:23:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f99c7400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f99c00d0620 con 0x7f99c015c480 2024-08-18T22:23:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f99c4a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99c015b150 0x7f99c00d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f99c4a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99c015b150 0x7f99c00d1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51710/0 (socket says 172.21.15.5:51710) 2024-08-18T22:23:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f99c4a00640 1 -- 172.21.15.5:0/3262721204 learned_addr learned my addr 172.21.15.5:0/3262721204 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f99bfe00640 1 --2- 172.21.15.5:0/3262721204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c015c480 0x7f99c00b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f99c4a00640 1 -- 172.21.15.5:0/3262721204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c015c480 msgr2=0x7f99c00b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f99c4a00640 1 --2- 172.21.15.5:0/3262721204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c015c480 0x7f99c00b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f99c4a00640 1 -- 172.21.15.5:0/3262721204 >> v1:172.21.15.117:6789/0 conn(0x7f99c00ce120 legacy=0x7f99c00ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f99c4a00640 1 -- 172.21.15.5:0/3262721204 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c00d0b60 con 0x7f99c015b150 2024-08-18T22:23:24.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac52200640 1 --2- 172.21.15.5:0/567412424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac4c0b3370 0x7fac4c06ebb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fac4c09ef30 tx=0x7fac4401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d337eefd2d79f547 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac4be00640 1 -- 172.21.15.5:0/567412424 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac440a5880 con 0x7fac4c0b3370 2024-08-18T22:23:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac4be00640 1 -- 172.21.15.5:0/567412424 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac440a5a20 con 0x7fac4c0b3370 2024-08-18T22:23:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac4be00640 1 -- 172.21.15.5:0/567412424 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac440a5df0 con 0x7fac4c0b3370 2024-08-18T22:23:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac52c00640 1 -- 172.21.15.5:0/567412424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac4c0b3370 msgr2=0x7fac4c06ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac52c00640 1 --2- 172.21.15.5:0/567412424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac4c0b3370 0x7fac4c06ebb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fac4c09ef30 tx=0x7fac4401c9c0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac52c00640 1 -- 172.21.15.5:0/567412424 shutdown_connections 2024-08-18T22:23:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac52c00640 1 --2- 172.21.15.5:0/567412424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac4c0b3370 0x7fac4c06ebb0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac52c00640 1 --2- 172.21.15.5:0/567412424 >> v2:172.21.15.117:3300/0 conn(0x7fac4c15e110 0x7fac4c0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac52c00640 1 -- 172.21.15.5:0/567412424 >> 172.21.15.5:0/567412424 conn(0x7fac4c06cac0 msgr2=0x7fac4c06ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f2593e00640 1 Processor -- start 2024-08-18T22:23:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac52c00640 1 -- 172.21.15.5:0/567412424 shutdown_connections 2024-08-18T22:23:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7fac52c00640 1 -- 172.21.15.5:0/567412424 wait complete. 2024-08-18T22:23:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.098+0000 7f2593e00640 1 -- start start 2024-08-18T22:23:24.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb023200640 1 --2- 172.21.15.5:0/3577106205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb02415d4d0 0x7fb0240ce990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb02406d2e0 tx=0x7fb01c01c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6e02fadb536ed23 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb021e00640 1 -- 172.21.15.5:0/3577106205 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c0a56f0 con 0x7fb02415d4d0 2024-08-18T22:23:24.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb021e00640 1 -- 172.21.15.5:0/3577106205 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01c0a5890 con 0x7fb02415d4d0 2024-08-18T22:23:24.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb021e00640 1 -- 172.21.15.5:0/3577106205 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c0a5c60 con 0x7fb02415d4d0 2024-08-18T22:23:24.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99c4a00640 1 --2- 172.21.15.5:0/3262721204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015b150 0x7f99c00d1a00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009870 tx=0x7f99b401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62c2feb854ec8c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb029400640 1 -- 172.21.15.5:0/3577106205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb02415d4d0 msgr2=0x7fb0240ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb029400640 1 --2- 172.21.15.5:0/3577106205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb02415d4d0 0x7fb0240ce990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb02406d2e0 tx=0x7fb01c01c960 comp rx=0 tx=0).stop 2024-08-18T22:23:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb029400640 1 -- 172.21.15.5:0/3577106205 shutdown_connections 2024-08-18T22:23:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb029400640 1 --2- 172.21.15.5:0/3577106205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb02415d4d0 0x7fb0240ce990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb029400640 1 --2- 172.21.15.5:0/3577106205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb02415c560 0x7fb0240ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb029400640 1 --2- 172.21.15.5:0/3577106205 >> v2:172.21.15.5:3300/0 conn(0x7fb02415c180 0x7fb0240cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb029400640 1 -- 172.21.15.5:0/3577106205 >> 172.21.15.5:0/3577106205 conn(0x7fb0240b1dc0 msgr2=0x7fb0240b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99bf400640 1 -- 172.21.15.5:0/3262721204 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40ab430 con 0x7f99c015b150 2024-08-18T22:23:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99bf400640 1 -- 172.21.15.5:0/3262721204 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b40b0070 con 0x7f99c015b150 2024-08-18T22:23:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f2593e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f259415c310 0x7f259415c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99bf400640 1 -- 172.21.15.5:0/3262721204 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40ab7f0 con 0x7f99c015b150 2024-08-18T22:23:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f2593e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25940b2c60 0x7f25940b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f2593e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25940ae6c0 con 0x7f259415bf30 2024-08-18T22:23:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f2593e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f25940b0a40 con 0x7f259415c310 2024-08-18T22:23:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f2593e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f25940b35d0 con 0x7f25940b2c60 2024-08-18T22:23:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb029400640 1 -- 172.21.15.5:0/3577106205 shutdown_connections 2024-08-18T22:23:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fb029400640 1 -- 172.21.15.5:0/3577106205 wait complete. 2024-08-18T22:23:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac52c00640 1 Processor -- start 2024-08-18T22:23:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac52c00640 1 -- start start 2024-08-18T22:23:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f258a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f259415c310 0x7f259415c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f258a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f259415c310 0x7f259415c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51724/0 (socket says 172.21.15.5:51724) 2024-08-18T22:23:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f2592a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f259415bf30 0x7f25940adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50272/0 (socket says 172.21.15.5:50272) 2024-08-18T22:23:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f258a000640 1 -- 172.21.15.5:0/257720967 learned_addr learned my addr 172.21.15.5:0/257720967 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99c7400640 1 -- 172.21.15.5:0/3262721204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015b150 msgr2=0x7f99c00d1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99c7400640 1 --2- 172.21.15.5:0/3262721204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015b150 0x7f99c00d1a00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009870 tx=0x7f99b401c560 comp rx=0 tx=0).stop 2024-08-18T22:23:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f258a000640 1 -- 172.21.15.5:0/257720967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25940b2c60 msgr2=0x7f25940b3090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:23:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f258a000640 1 --2- 172.21.15.5:0/257720967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25940b2c60 0x7f25940b3090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f258a000640 1 -- 172.21.15.5:0/257720967 >> v1:172.21.15.5:6789/0 conn(0x7f259415bf30 legacy=0x7f25940adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f258a000640 1 -- 172.21.15.5:0/257720967 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25940afc20 con 0x7f259415c310 2024-08-18T22:23:24.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99c7400640 1 -- 172.21.15.5:0/3262721204 shutdown_connections 2024-08-18T22:23:24.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99c7400640 1 --2- 172.21.15.5:0/3262721204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c015c480 0x7f99c00b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99c7400640 1 --2- 172.21.15.5:0/3262721204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015b150 0x7f99c00d1a00 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99c7400640 1 -- 172.21.15.5:0/3262721204 >> 172.21.15.5:0/3262721204 conn(0x7f99c00b65f0 msgr2=0x7f99c00b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:24.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99c7400640 1 -- 172.21.15.5:0/3262721204 shutdown_connections 2024-08-18T22:23:24.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7f99c7400640 1 -- 172.21.15.5:0/3262721204 wait complete. 2024-08-18T22:23:24.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac52c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac4c0b3370 0x7fac4c0d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac52c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac4c0b6210 0x7fac4c14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac52c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac4c15e110 0x7fac4c14a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac52c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fac4c06fa80 con 0x7fac4c15e110 2024-08-18T22:23:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac52c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fac4c06f900 con 0x7fac4c0b6210 2024-08-18T22:23:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac52c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fac4c06fc00 con 0x7fac4c0b3370 2024-08-18T22:23:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac52200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac4c15e110 0x7fac4c14a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac52200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac4c15e110 0x7fac4c14a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51734/0 (socket says 172.21.15.5:51734) 2024-08-18T22:23:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac52200640 1 -- 172.21.15.5:0/2404977614 learned_addr learned my addr 172.21.15.5:0/2404977614 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.102+0000 7fac50e00640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac4c0b6210 0x7fac4c14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb029400640 1 Processor -- start 2024-08-18T22:23:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac51800640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac4c0b3370 0x7fac4c0d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac52200640 1 -- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac4c0b3370 msgr2=0x7fac4c0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac52200640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac4c0b3370 0x7fac4c0d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac52200640 1 -- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac4c0b6210 msgr2=0x7fac4c14a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac52200640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac4c0b6210 0x7fac4c14a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac52200640 1 -- 172.21.15.5:0/2404977614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4c156240 con 0x7fac4c15e110 2024-08-18T22:23:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb029400640 1 -- start start 2024-08-18T22:23:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac52200640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac4c15e110 0x7fac4c14a8f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fac440af040 tx=0x7fac44019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac49600640 1 -- 172.21.15.5:0/2404977614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac440b8670 con 0x7fac4c15e110 2024-08-18T22:23:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac49600640 1 -- 172.21.15.5:0/2404977614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac440be070 con 0x7fac4c15e110 2024-08-18T22:23:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac49600640 1 -- 172.21.15.5:0/2404977614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac440b8a70 con 0x7fac4c15e110 2024-08-18T22:23:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c7400640 1 Processor -- start 2024-08-18T22:23:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c7400640 1 -- start start 2024-08-18T22:23:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb029400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb02415c180 0x7fb0240ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb029400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb02415d4d0 0x7fb02415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb029400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb024154730 0x7fb02409c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb029400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb024160930 con 0x7fb02415d4d0 2024-08-18T22:23:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb029400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb0241607b0 con 0x7fb02415c180 2024-08-18T22:23:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb029400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb024160ab0 con 0x7fb024154730 2024-08-18T22:23:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb01be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb02415d4d0 0x7fb02415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb022800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb02415c180 0x7fb0240ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb022800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb02415c180 0x7fb0240ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:55658/0 (socket says 172.21.15.5:55658) 2024-08-18T22:23:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb022800640 1 -- 172.21.15.5:0/618607601 learned_addr learned my addr 172.21.15.5:0/618607601 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac52c00640 1 -- 172.21.15.5:0/2404977614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4c0d0850 con 0x7fac4c15e110 2024-08-18T22:23:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac52c00640 1 -- 172.21.15.5:0/2404977614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac4c14ae30 con 0x7fac4c15e110 2024-08-18T22:23:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb023200640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb024154730 0x7fb02409c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb022800640 1 -- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb024154730 msgr2=0x7fb02409c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb022800640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb024154730 0x7fb02409c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb022800640 1 -- 172.21.15.5:0/618607601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb02415d4d0 msgr2=0x7fb02415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb022800640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb02415d4d0 0x7fb02415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb022800640 1 -- 172.21.15.5:0/618607601 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02409b210 con 0x7fb02415c180 2024-08-18T22:23:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f258a000640 1 --2- 172.21.15.5:0/257720967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f259415c310 0x7f259415c7a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f25940b0bc0 tx=0x7f257c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6c1c7e9dd7a7c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c7400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c00ce120 0x7f99c014a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015b150 0x7f99c01491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb022800640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb02415c180 0x7fb0240ad410 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb01400e930 tx=0x7fb01400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c015c480 0x7f99c015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c7400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99c015bec0 con 0x7f99c015b150 2024-08-18T22:23:24.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f2592000640 1 -- 172.21.15.5:0/257720967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c0a5830 con 0x7f259415c310 2024-08-18T22:23:24.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f2592000640 1 -- 172.21.15.5:0/257720967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257c0a59d0 con 0x7f259415c310 2024-08-18T22:23:24.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f2592000640 1 -- 172.21.15.5:0/257720967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c0a5da0 con 0x7f259415c310 2024-08-18T22:23:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c7400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99c015bd40 con 0x7f99c00ce120 2024-08-18T22:23:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c7400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f99c015c040 con 0x7f99c015c480 2024-08-18T22:23:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c4a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c00ce120 0x7f99c014a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c4a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c00ce120 0x7f99c014a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:55670/0 (socket says 172.21.15.5:55670) 2024-08-18T22:23:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c4a00640 1 -- 172.21.15.5:0/3375449037 learned_addr learned my addr 172.21.15.5:0/3375449037 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fac52c00640 1 -- 172.21.15.5:0/2404977614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac4c06ebb0 con 0x7fac4c15e110 2024-08-18T22:23:24.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99bfe00640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015b150 0x7f99c01491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb01aa00640 1 -- 172.21.15.5:0/618607601 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb014017070 con 0x7fb02415c180 2024-08-18T22:23:24.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb01aa00640 1 -- 172.21.15.5:0/618607601 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01400ca00 con 0x7fb02415c180 2024-08-18T22:23:24.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb01aa00640 1 -- 172.21.15.5:0/618607601 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01400cdd0 con 0x7fb02415c180 2024-08-18T22:23:24.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb029400640 1 -- 172.21.15.5:0/618607601 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02409b4f0 con 0x7fb02415c180 2024-08-18T22:23:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c5400640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c015c480 0x7f99c015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c4a00640 1 -- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c015c480 msgr2=0x7f99c015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c4a00640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c015c480 0x7f99c015efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c4a00640 1 -- 172.21.15.5:0/3375449037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015b150 msgr2=0x7f99c01491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c4a00640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015b150 0x7f99c01491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7f99c4a00640 1 -- 172.21.15.5:0/3375449037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c014b0a0 con 0x7f99c00ce120 2024-08-18T22:23:24.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f99c5400640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c015c480 0x7f99c015efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.106+0000 7fb029400640 1 -- 172.21.15.5:0/618607601 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb02409bab0 con 0x7fb02415c180 2024-08-18T22:23:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f99c4a00640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c00ce120 0x7f99c014a770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f99b401a190 tx=0x7f99b4019300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f99bcc00640 1 -- 172.21.15.5:0/3375449037 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40abe20 con 0x7f99c00ce120 2024-08-18T22:23:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f99bcc00640 1 -- 172.21.15.5:0/3375449037 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b40bb070 con 0x7f99c00ce120 2024-08-18T22:23:24.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f99bcc00640 1 -- 172.21.15.5:0/3375449037 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40b4660 con 0x7f99c00ce120 2024-08-18T22:23:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f99c7400640 1 -- 172.21.15.5:0/3375449037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c015df20 con 0x7f99c00ce120 2024-08-18T22:23:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f99c7400640 1 -- 172.21.15.5:0/3375449037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c015e4e0 con 0x7f99c00ce120 2024-08-18T22:23:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7fac49600640 1 -- 172.21.15.5:0/2404977614 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac440b8c10 con 0x7fac4c15e110 2024-08-18T22:23:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7fb029400640 1 -- 172.21.15.5:0/618607601 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0240cdf10 con 0x7fb02415c180 2024-08-18T22:23:24.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f99c7400640 1 -- 172.21.15.5:0/3375449037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c00682e0 con 0x7f99c00ce120 2024-08-18T22:23:24.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7fac49600640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac2c0678c0 0x7fac2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7fac49600640 1 -- 172.21.15.5:0/2404977614 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fac44120fa0 con 0x7fac4c15e110 2024-08-18T22:23:24.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7fb01aa00640 1 -- 172.21.15.5:0/618607601 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb01401a070 con 0x7fb02415c180 2024-08-18T22:23:24.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7fac51800640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac2c0678c0 0x7fac2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f2593e00640 1 -- 172.21.15.5:0/257720967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f259415c310 msgr2=0x7f259415c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f2593e00640 1 --2- 172.21.15.5:0/257720967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f259415c310 0x7f259415c7a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f25940b0bc0 tx=0x7f257c01c970 comp rx=0 tx=0).stop 2024-08-18T22:23:24.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f2593e00640 1 -- 172.21.15.5:0/257720967 shutdown_connections 2024-08-18T22:23:24.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f2593e00640 1 --2- 172.21.15.5:0/257720967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25940b2c60 0x7f25940b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f2593e00640 1 --2- 172.21.15.5:0/257720967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f259415c310 0x7f259415c7a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f2593e00640 1 -- 172.21.15.5:0/257720967 >> 172.21.15.5:0/257720967 conn(0x7f259406cac0 msgr2=0x7f259406ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:24.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f2593e00640 1 -- 172.21.15.5:0/257720967 shutdown_connections 2024-08-18T22:23:24.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f2593e00640 1 -- 172.21.15.5:0/257720967 wait complete. 2024-08-18T22:23:24.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f2593e00640 1 Processor -- start 2024-08-18T22:23:24.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f2593e00640 1 -- start start 2024-08-18T22:23:24.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7f99bcc00640 1 -- 172.21.15.5:0/3375449037 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99b40b4800 con 0x7f99c00ce120 2024-08-18T22:23:24.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7fac51800640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac2c0678c0 0x7fac2c069d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fac40009a50 tx=0x7fac40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.110+0000 7fb01aa00640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb000067940 0x7fb000069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7fb01aa00640 1 -- 172.21.15.5:0/618607601 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7fb014085ec0 con 0x7fb02415c180 2024-08-18T22:23:24.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2593e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25940b2c60 0x7f2594149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2593e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f259415bf30 0x7f2594149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2593e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f259415c310 0x7f2594134460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2593e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2594070590 con 0x7f259415bf30 2024-08-18T22:23:24.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2593e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25940b0760 con 0x7f259415c310 2024-08-18T22:23:24.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2593e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f259406c530 con 0x7f25940b2c60 2024-08-18T22:23:24.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7fb01be00640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb000067940 0x7fb000069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2592a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25940b2c60 0x7f2594149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2592a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25940b2c60 0x7f2594149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:52030/0 (socket says 172.21.15.5:52030) 2024-08-18T22:23:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f258a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f259415bf30 0x7f2594149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2592a00640 1 -- 172.21.15.5:0/1201602358 learned_addr learned my addr 172.21.15.5:0/1201602358 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2593400640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f259415c310 0x7f2594134460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f99bcc00640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99a00678c0 0x7f99a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f99bcc00640 1 -- 172.21.15.5:0/3375449037 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f99b411fc30 con 0x7f99c00ce120 2024-08-18T22:23:24.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2592a00640 1 -- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f259415c310 msgr2=0x7f2594134460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2592a00640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f259415c310 0x7f2594134460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f99bfe00640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99a00678c0 0x7f99a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2592a00640 1 -- 172.21.15.5:0/1201602358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f259415bf30 msgr2=0x7f2594149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2592a00640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f259415bf30 0x7f2594149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2592a00640 1 -- 172.21.15.5:0/1201602358 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259414e740 con 0x7f25940b2c60 2024-08-18T22:23:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2593400640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f259415c310 0x7f2594134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f258a000640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f259415bf30 0x7f2594149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7fb01be00640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb000067940 0x7fb000069e00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009580 tx=0x7fb00c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2592a00640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25940b2c60 0x7f2594149510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f258400c420 tx=0x7f258400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f99bfe00640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99a00678c0 0x7f99a0069d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f99c0169100 tx=0x7f99ac009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f258b400640 1 -- 172.21.15.5:0/1201602358 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840074e0 con 0x7f25940b2c60 2024-08-18T22:23:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f258b400640 1 -- 172.21.15.5:0/1201602358 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2584007680 con 0x7f25940b2c60 2024-08-18T22:23:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f258b400640 1 -- 172.21.15.5:0/1201602358 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2584004a30 con 0x7f25940b2c60 2024-08-18T22:23:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2593e00640 1 -- 172.21.15.5:0/1201602358 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259414ea20 con 0x7f25940b2c60 2024-08-18T22:23:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2593e00640 1 -- 172.21.15.5:0/1201602358 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25941351f0 con 0x7f25940b2c60 2024-08-18T22:23:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.114+0000 7f2593e00640 1 -- 172.21.15.5:0/1201602358 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25940732b0 con 0x7f25940b2c60 2024-08-18T22:23:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.118+0000 7fac49600640 1 -- 172.21.15.5:0/2404977614 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fac440165e0 con 0x7fac4c15e110 2024-08-18T22:23:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.118+0000 7f258b400640 1 -- 172.21.15.5:0/1201602358 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f258401a020 con 0x7f25940b2c60 2024-08-18T22:23:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.118+0000 7f258b400640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25700678c0 0x7f2570069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:24.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.118+0000 7f258b400640 1 -- 172.21.15.5:0/1201602358 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(67..67 src has 1..67) ==== 6101+0+0 (secure 0 0 0) 0x7f2584085810 con 0x7f25940b2c60 2024-08-18T22:23:24.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.118+0000 7f258a000640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25700678c0 0x7f2570069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:24.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.118+0000 7fb01aa00640 1 -- 172.21.15.5:0/618607601 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb014056350 con 0x7fb02415c180 2024-08-18T22:23:24.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.118+0000 7f258a000640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25700678c0 0x7f2570069d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f257c0ae000 tx=0x7f257c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:24.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.122+0000 7f258b400640 1 -- 172.21.15.5:0/1201602358 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f25840561c0 con 0x7f25940b2c60 2024-08-18T22:23:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.122+0000 7f99bcc00640 1 -- 172.21.15.5:0/3375449037 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f99b4016150 con 0x7f99c00ce120 2024-08-18T22:23:24.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.346+0000 7fac52c00640 1 -- 172.21.15.5:0/2404977614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7fac4c06dad0 con 0x7fac4c15e110 2024-08-18T22:23:24.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.346+0000 7fb029400640 1 -- 172.21.15.5:0/618607601 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fb02406dec0 con 0x7fb02415c180 2024-08-18T22:23:24.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.350+0000 7f2593e00640 1 -- 172.21.15.5:0/1201602358 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f25941515f0 con 0x7f25940b2c60 2024-08-18T22:23:24.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.354+0000 7f99c7400640 1 -- 172.21.15.5:0/3375449037 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f99c00d1a00 con 0x7f99c00ce120 2024-08-18T22:23:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.750+0000 7fac49600640 1 -- 172.21.15.5:0/2404977614 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5953 v41) ==== 95+0+0 (secure 0 0 0) 0x7fac440f1a70 con 0x7fac4c15e110 2024-08-18T22:23:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 5953 2024-08-18T22:23:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.750+0000 7fac52c00640 1 -- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac2c0678c0 msgr2=0x7fac2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.750+0000 7fac52c00640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac2c0678c0 0x7fac2c069d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fac40009a50 tx=0x7fac40008040 comp rx=0 tx=0).stop 2024-08-18T22:23:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.750+0000 7fac52c00640 1 -- 172.21.15.5:0/2404977614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac4c15e110 msgr2=0x7fac4c14a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.750+0000 7fac52c00640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac4c15e110 0x7fac4c14a8f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fac440af040 tx=0x7fac44019760 comp rx=0 tx=0).stop 2024-08-18T22:23:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.750+0000 7fac52c00640 1 -- 172.21.15.5:0/2404977614 shutdown_connections 2024-08-18T22:23:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.750+0000 7fac52c00640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac2c0678c0 0x7fac2c069d80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.750+0000 7fac52c00640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac4c15e110 0x7fac4c14a8f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.750+0000 7fac52c00640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac4c0b6210 0x7fac4c14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.750+0000 7fac52c00640 1 --2- 172.21.15.5:0/2404977614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac4c0b3370 0x7fac4c0d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.750+0000 7fac52c00640 1 -- 172.21.15.5:0/2404977614 >> 172.21.15.5:0/2404977614 conn(0x7fac4c06cac0 msgr2=0x7fac4c0d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.754+0000 7fac52c00640 1 -- 172.21.15.5:0/2404977614 shutdown_connections 2024-08-18T22:23:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.754+0000 7fac52c00640 1 -- 172.21.15.5:0/2404977614 wait complete. 2024-08-18T22:23:24.761 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:23:24.758+0000 7fc7ef000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:23:24.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.766+0000 7f258b400640 1 -- 172.21.15.5:0/1201602358 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6276 v42) ==== 95+0+0 (secure 0 0 0) 0x7f2584055ac0 con 0x7f25940b2c60 2024-08-18T22:23:24.772 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 6276 2024-08-18T22:23:24.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.766+0000 7fb01aa00640 1 -- 172.21.15.5:0/618607601 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5950 v42) ==== 95+0+0 (secure 0 0 0) 0x7fb01405a650 con 0x7fb02415c180 2024-08-18T22:23:24.772 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 5950 2024-08-18T22:23:24.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 -- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb000067940 msgr2=0x7fb000069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb000067940 0x7fb000069e00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009580 tx=0x7fb00c009190 comp rx=0 tx=0).stop 2024-08-18T22:23:24.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 -- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb02415c180 msgr2=0x7fb0240ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb02415c180 0x7fb0240ad410 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb01400e930 tx=0x7fb01400edf0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 -- 172.21.15.5:0/618607601 shutdown_connections 2024-08-18T22:23:24.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb000067940 0x7fb000069e00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 -- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25700678c0 msgr2=0x7f2570069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25700678c0 0x7f2570069d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f257c0ae000 tx=0x7f257c0a7070 comp rx=0 tx=0).stop 2024-08-18T22:23:24.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb024154730 0x7fb02409c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb02415d4d0 0x7fb02415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 --2- 172.21.15.5:0/618607601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb02415c180 0x7fb0240ad410 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 -- 172.21.15.5:0/618607601 >> 172.21.15.5:0/618607601 conn(0x7fb0240b1dc0 msgr2=0x7fb0240b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:24.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 -- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25940b2c60 msgr2=0x7f2594149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:24.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25940b2c60 0x7f2594149510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f258400c420 tx=0x7f258400c8e0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 -- 172.21.15.5:0/618607601 shutdown_connections 2024-08-18T22:23:24.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7fb029400640 1 -- 172.21.15.5:0/618607601 wait complete. 2024-08-18T22:23:24.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 -- 172.21.15.5:0/1201602358 shutdown_connections 2024-08-18T22:23:24.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25700678c0 0x7f2570069d80 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f257c0ae000 tx=0x7f257c0a7070 comp rx=0 tx=0).stop 2024-08-18T22:23:24.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f259415c310 0x7f2594134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f259415bf30 0x7f2594149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 --2- 172.21.15.5:0/1201602358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25940b2c60 0x7f2594149510 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:24.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 -- 172.21.15.5:0/1201602358 >> 172.21.15.5:0/1201602358 conn(0x7f259406cac0 msgr2=0x7f259406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:24.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 -- 172.21.15.5:0/1201602358 shutdown_connections 2024-08-18T22:23:24.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:24.770+0000 7f2593e00640 1 -- 172.21.15.5:0/1201602358 wait complete. 2024-08-18T22:23:24.784 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:23:24.784 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:23:24.787 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:23:24.787 DEBUG:teuthology.parallel:result is None 2024-08-18T22:23:24.800 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:23:24.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:23:24.801 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:23:24.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:23:24.804 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:23:24.804 DEBUG:teuthology.parallel:result is None 2024-08-18T22:23:24.847 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:23:24.847 DEBUG:teuthology.parallel:result is None 2024-08-18T22:23:24.872 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:23:24.890 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:23:24.933 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:23:25.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.766+0000 7f99bcc00640 1 -- 172.21.15.5:0/3375449037 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5959 v43) ==== 95+0+0 (secure 0 0 0) 0x7f99b40f05e0 con 0x7f99c00ce120 2024-08-18T22:23:25.771 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 5959 2024-08-18T22:23:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 -- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99a00678c0 msgr2=0x7f99a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99a00678c0 0x7f99a0069d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f99c0169100 tx=0x7f99ac009190 comp rx=0 tx=0).stop 2024-08-18T22:23:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 -- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c00ce120 msgr2=0x7f99c014a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c00ce120 0x7f99c014a770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f99b401a190 tx=0x7f99b4019300 comp rx=0 tx=0).stop 2024-08-18T22:23:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 -- 172.21.15.5:0/3375449037 shutdown_connections 2024-08-18T22:23:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99a00678c0 0x7f99a0069d80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c015c480 0x7f99c015efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015b150 0x7f99c01491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 --2- 172.21.15.5:0/3375449037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c00ce120 0x7f99c014a770 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 -- 172.21.15.5:0/3375449037 >> 172.21.15.5:0/3375449037 conn(0x7f99c00b65f0 msgr2=0x7f99c00b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 -- 172.21.15.5:0/3375449037 shutdown_connections 2024-08-18T22:23:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.770+0000 7f99c7400640 1 -- 172.21.15.5:0/3375449037 wait complete. 2024-08-18T22:23:25.801 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:23:25.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:23:25.847 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:23:25.847 DEBUG:teuthology.parallel:result is None 2024-08-18T22:23:25.848 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:25.937 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:23:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58fe000640 1 Processor -- start 2024-08-18T22:23:25.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58fe000640 1 -- start start 2024-08-18T22:23:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58fe000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58f815b010 0x7f58f80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58fe000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f80cee20 con 0x7f58f806f290 2024-08-18T22:23:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58fe000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f80cf100 con 0x7f58f80cd3a0 2024-08-18T22:23:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58fe000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f58f80cfa30 con 0x7f58f815b010 2024-08-18T22:23:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58f7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f58f806f290 0x7f58f8072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50302/0 (socket says 172.21.15.5:50302) 2024-08-18T22:23:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58f7e00640 1 -- 172.21.15.5:0/219852091 learned_addr learned my addr 172.21.15.5:0/219852091 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58f7400640 1 --2- 172.21.15.5:0/219852091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58f815b010 0x7f58f80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58f7400640 1 -- 172.21.15.5:0/219852091 >> v1:172.21.15.117:6789/0 conn(0x7f58f80cd3a0 legacy=0x7f58f806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58f6a00640 1 -- 172.21.15.5:0/219852091 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745003924 0 0) 0x7f58f80cee20 con 0x7f58f806f290 2024-08-18T22:23:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58f7400640 1 -- 172.21.15.5:0/219852091 >> v1:172.21.15.5:6789/0 conn(0x7f58f806f290 legacy=0x7f58f8072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:25.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.990+0000 7f58f7400640 1 -- 172.21.15.5:0/219852091 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f80cf3e0 con 0x7f58f815b010 2024-08-18T22:23:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.994+0000 7f58f7400640 1 --2- 172.21.15.5:0/219852091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58f815b010 0x7f58f80ce840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009770 tx=0x7f58e801e520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6431cf73738fc0e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.994+0000 7f58f6a00640 1 -- 172.21.15.5:0/219852091 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e80ab610 con 0x7f58f815b010 2024-08-18T22:23:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.994+0000 7f58f6a00640 1 -- 172.21.15.5:0/219852091 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e80ab7b0 con 0x7f58f815b010 2024-08-18T22:23:25.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.994+0000 7f58f6a00640 1 -- 172.21.15.5:0/219852091 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e80abb80 con 0x7f58f815b010 2024-08-18T22:23:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.994+0000 7f58fe000640 1 -- 172.21.15.5:0/219852091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58f815b010 msgr2=0x7f58f80ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.994+0000 7f58fe000640 1 --2- 172.21.15.5:0/219852091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58f815b010 0x7f58f80ce840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009770 tx=0x7f58e801e520 comp rx=0 tx=0).stop 2024-08-18T22:23:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.994+0000 7f58fe000640 1 -- 172.21.15.5:0/219852091 shutdown_connections 2024-08-18T22:23:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.994+0000 7f58fe000640 1 --2- 172.21.15.5:0/219852091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58f815b010 0x7f58f80ce840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.994+0000 7f58fe000640 1 -- 172.21.15.5:0/219852091 >> 172.21.15.5:0/219852091 conn(0x7f58f80b1c50 msgr2=0x7f58f80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.994+0000 7f58fe000640 1 -- 172.21.15.5:0/219852091 shutdown_connections 2024-08-18T22:23:26.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.994+0000 7f58fe000640 1 -- 172.21.15.5:0/219852091 wait complete. 2024-08-18T22:23:26.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58fe000640 1 Processor -- start 2024-08-18T22:23:26.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58fe000640 1 -- start start 2024-08-18T22:23:26.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58fe000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58f806f290 0x7f58f81506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:26.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58fe000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58f80cd3a0 0x7f58f80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58fe000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f815b010 0x7f58f8157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58fe000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f58f815b3f0 con 0x7f58f815b010 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58fe000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f58f80cd7e0 con 0x7f58f80cd3a0 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58fe000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f58f815c1b0 con 0x7f58f806f290 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58f7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f815b010 0x7f58f8157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58f7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f815b010 0x7f58f8157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51798/0 (socket says 172.21.15.5:51798) 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58f7e00640 1 -- 172.21.15.5:0/3810926886 learned_addr learned my addr 172.21.15.5:0/3810926886 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58eea00640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58f80cd3a0 0x7f58f80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58f7400640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58f806f290 0x7f58f81506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58f7e00640 1 -- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58f806f290 msgr2=0x7f58f81506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58f7e00640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58f806f290 0x7f58f81506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58f7e00640 1 -- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58f80cd3a0 msgr2=0x7f58f80b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58f7e00640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58f80cd3a0 0x7f58f80b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58f7e00640 1 -- 172.21.15.5:0/3810926886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f815b880 con 0x7f58f815b010 2024-08-18T22:23:26.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58f7e00640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f815b010 0x7f58f8157330 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f58f000c8c0 tx=0x7f58f000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:26.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58efe00640 1 -- 172.21.15.5:0/3810926886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0018070 con 0x7f58f815b010 2024-08-18T22:23:26.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58efe00640 1 -- 172.21.15.5:0/3810926886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f000a640 con 0x7f58f815b010 2024-08-18T22:23:26.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58efe00640 1 -- 172.21.15.5:0/3810926886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f000aa30 con 0x7f58f815b010 2024-08-18T22:23:26.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58fe000640 1 -- 172.21.15.5:0/3810926886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f815bb60 con 0x7f58f815b010 2024-08-18T22:23:26.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58fe000640 1 -- 172.21.15.5:0/3810926886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f8150c10 con 0x7f58f815b010 2024-08-18T22:23:26.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:25.998+0000 7f58fe000640 1 -- 172.21.15.5:0/3810926886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f80ce840 con 0x7f58f815b010 2024-08-18T22:23:26.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.002+0000 7f58efe00640 1 -- 172.21.15.5:0/3810926886 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58f000abd0 con 0x7f58f815b010 2024-08-18T22:23:26.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.002+0000 7f58efe00640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58d40678c0 0x7f58d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:26.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.002+0000 7f58efe00640 1 -- 172.21.15.5:0/3810926886 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f58f00853d0 con 0x7f58f815b010 2024-08-18T22:23:26.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.002+0000 7f58f7400640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58d40678c0 0x7f58d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:26.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.002+0000 7f58f7400640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58d40678c0 0x7f58d4069d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f58e80b0000 tx=0x7f58e80a9000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:26.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.006+0000 7f58efe00640 1 -- 172.21.15.5:0/3810926886 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f58f00556d0 con 0x7f58f815b010 2024-08-18T22:23:26.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58fe000640 1 -- 172.21.15.5:0/3810926886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58f806eae0 con 0x7f58f815b010 2024-08-18T22:23:26.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58efe00640 1 -- 172.21.15.5:0/3810926886 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+4396 (secure 0 0 0) 0x7f58f00599d0 con 0x7f58f815b010 2024-08-18T22:23:26.211 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:26.211 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":44,"btime":"2024-08-18T22:23:25:771870+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3998000168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3998000168},{"type":"v1","addr":"172.21.15.117:6837","nonce":3998000168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1741701025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1741701025},{"type":"v1","addr":"172.21.15.117:6835","nonce":1741701025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:25.771860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"c","rank":0,"incarnation":44,"state":"up:replay","state_seq":1,"addr":"172.21.15.5:6833/1715051733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1715051733},{"type":"v1","addr":"172.21.15.5:6833","nonce":1715051733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-08-18T22:23:26.211 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 44 2024-08-18T22:23:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58fe000640 1 -- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58d40678c0 msgr2=0x7f58d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58fe000640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58d40678c0 0x7f58d4069d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f58e80b0000 tx=0x7f58e80a9000 comp rx=0 tx=0).stop 2024-08-18T22:23:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58fe000640 1 -- 172.21.15.5:0/3810926886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f815b010 msgr2=0x7f58f8157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58fe000640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f815b010 0x7f58f8157330 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f58f000c8c0 tx=0x7f58f000cd80 comp rx=0 tx=0).stop 2024-08-18T22:23:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58fe000640 1 -- 172.21.15.5:0/3810926886 shutdown_connections 2024-08-18T22:23:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58fe000640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58d40678c0 0x7f58d4069d80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58fe000640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f815b010 0x7f58f8157330 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58fe000640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58f80cd3a0 0x7f58f80b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:26.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58fe000640 1 --2- 172.21.15.5:0/3810926886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58f806f290 0x7f58f81506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:26.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.206+0000 7f58fe000640 1 -- 172.21.15.5:0/3810926886 >> 172.21.15.5:0/3810926886 conn(0x7f58f80b1c50 msgr2=0x7f58f81592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:26.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.210+0000 7f58fe000640 1 -- 172.21.15.5:0/3810926886 shutdown_connections 2024-08-18T22:23:26.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:26.210+0000 7f58fe000640 1 -- 172.21.15.5:0/3810926886 wait complete. 2024-08-18T22:23:26.635 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:23:08.785969+0000', 'modified': '2024-08-18T22:23:25.771860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6543}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6543': {'gid': 6543, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.5:6833/1715051733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 1715051733}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 1715051733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-18T22:23:26.635 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6543:up:replay 2024-08-18T22:23:27.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc026200640 1 Processor -- start 2024-08-18T22:23:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc026200640 1 -- start start 2024-08-18T22:23:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc026200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc02006f150 0x7fc020165560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc026200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0200cb300 con 0x7fc0200caec0 2024-08-18T22:23:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc026200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0200cb5d0 con 0x7fc02015a800 2024-08-18T22:23:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc026200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc020072e60 con 0x7fc02006f150 2024-08-18T22:23:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc016a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc0200caec0 0x7fc02006ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50316/0 (socket says 172.21.15.5:50316) 2024-08-18T22:23:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc016a00640 1 -- 172.21.15.5:0/3484460984 learned_addr learned my addr 172.21.15.5:0/3484460984 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:27.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc01fe00640 1 --2- 172.21.15.5:0/3484460984 >> v2:172.21.15.117:3300/0 conn(0x7fc02006f150 0x7fc020165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc01ea00640 1 -- 172.21.15.5:0/3484460984 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766105112 0 0) 0x7fc0200cb300 con 0x7fc0200caec0 2024-08-18T22:23:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc01ea00640 1 -- 172.21.15.5:0/3484460984 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc004003530 con 0x7fc0200caec0 2024-08-18T22:23:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc01fe00640 1 -- 172.21.15.5:0/3484460984 >> v1:172.21.15.117:6789/0 conn(0x7fc02015a800 legacy=0x7fc0200ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc01ea00640 1 -- 172.21.15.5:0/3484460984 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1933716767 0 0) 0x7fc0200cb5d0 con 0x7fc02015a800 2024-08-18T22:23:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc01fe00640 1 -- 172.21.15.5:0/3484460984 >> v1:172.21.15.5:6789/0 conn(0x7fc0200caec0 legacy=0x7fc02006ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:27.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.786+0000 7fc01fe00640 1 -- 172.21.15.5:0/3484460984 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc020073140 con 0x7fc02006f150 2024-08-18T22:23:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.790+0000 7fc01fe00640 1 --2- 172.21.15.5:0/3484460984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02006f150 0x7fc020165560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc018009d90 tx=0x7fc01801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31815f010303af5e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.790+0000 7fc01ea00640 1 -- 172.21.15.5:0/3484460984 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0180b2070 con 0x7fc02006f150 2024-08-18T22:23:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.790+0000 7fc01ea00640 1 -- 172.21.15.5:0/3484460984 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0180a58c0 con 0x7fc02006f150 2024-08-18T22:23:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.790+0000 7fc01ea00640 1 -- 172.21.15.5:0/3484460984 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0180a5c70 con 0x7fc02006f150 2024-08-18T22:23:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.790+0000 7fc026200640 1 -- 172.21.15.5:0/3484460984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02006f150 msgr2=0x7fc020165560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.790+0000 7fc026200640 1 --2- 172.21.15.5:0/3484460984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02006f150 0x7fc020165560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc018009d90 tx=0x7fc01801c970 comp rx=0 tx=0).stop 2024-08-18T22:23:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.790+0000 7fc026200640 1 -- 172.21.15.5:0/3484460984 shutdown_connections 2024-08-18T22:23:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.790+0000 7fc026200640 1 --2- 172.21.15.5:0/3484460984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02006f150 0x7fc020165560 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.790+0000 7fc026200640 1 -- 172.21.15.5:0/3484460984 >> 172.21.15.5:0/3484460984 conn(0x7fc0200b1c50 msgr2=0x7fc0200b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.790+0000 7fc026200640 1 -- 172.21.15.5:0/3484460984 shutdown_connections 2024-08-18T22:23:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.790+0000 7fc026200640 1 -- 172.21.15.5:0/3484460984 wait complete. 2024-08-18T22:23:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc026200640 1 Processor -- start 2024-08-18T22:23:27.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc026200640 1 -- start start 2024-08-18T22:23:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc026200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02006f150 0x7fc0200b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc026200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200caec0 0x7fc0200cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc026200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02015a800 0x7fc0200cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc026200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc020168d50 con 0x7fc02006f150 2024-08-18T22:23:27.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc026200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc020168bd0 con 0x7fc02015a800 2024-08-18T22:23:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc026200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc020168ed0 con 0x7fc0200caec0 2024-08-18T22:23:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc01f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02006f150 0x7fc0200b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc01f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02006f150 0x7fc0200b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51800/0 (socket says 172.21.15.5:51800) 2024-08-18T22:23:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc01f400640 1 -- 172.21.15.5:0/482167106 learned_addr learned my addr 172.21.15.5:0/482167106 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc01fe00640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02015a800 0x7fc0200cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc016a00640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200caec0 0x7fc0200cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc01f400640 1 -- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200caec0 msgr2=0x7fc0200cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc01f400640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200caec0 0x7fc0200cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc01f400640 1 -- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02015a800 msgr2=0x7fc0200cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc01f400640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02015a800 0x7fc0200cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:27.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc01f400640 1 -- 172.21.15.5:0/482167106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0200b3df0 con 0x7fc02006f150 2024-08-18T22:23:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc01f400640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02006f150 0x7fc0200b2f50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc01000c480 tx=0x7fc01000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc017e00640 1 -- 172.21.15.5:0/482167106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc010005480 con 0x7fc02006f150 2024-08-18T22:23:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc017e00640 1 -- 172.21.15.5:0/482167106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc010003600 con 0x7fc02006f150 2024-08-18T22:23:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc017e00640 1 -- 172.21.15.5:0/482167106 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0100039f0 con 0x7fc02006f150 2024-08-18T22:23:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.794+0000 7fc026200640 1 -- 172.21.15.5:0/482167106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0200b3830 con 0x7fc02006f150 2024-08-18T22:23:27.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.798+0000 7fc026200640 1 -- 172.21.15.5:0/482167106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02009b6b0 con 0x7fc02006f150 2024-08-18T22:23:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.798+0000 7fc026200640 1 -- 172.21.15.5:0/482167106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02006ea40 con 0x7fc02006f150 2024-08-18T22:23:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.798+0000 7fc017e00640 1 -- 172.21.15.5:0/482167106 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc010003b90 con 0x7fc02006f150 2024-08-18T22:23:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.798+0000 7fc017e00640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbffc0678c0 0x7fbffc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.798+0000 7fc017e00640 1 -- 172.21.15.5:0/482167106 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7fc010085af0 con 0x7fc02006f150 2024-08-18T22:23:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.798+0000 7fc016a00640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbffc0678c0 0x7fbffc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:27.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.798+0000 7fc016a00640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbffc0678c0 0x7fbffc069d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc008005890 tx=0x7fc008009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:27.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:27.802+0000 7fc017e00640 1 -- 172.21.15.5:0/482167106 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc0200b3df0 con 0x7fc02006f150 2024-08-18T22:23:28.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.006+0000 7fc026200640 1 -- 172.21.15.5:0/482167106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc020150000 con 0x7fc02006f150 2024-08-18T22:23:28.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.006+0000 7fc017e00640 1 -- 172.21.15.5:0/482167106 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5215 (secure 0 0 0) 0x7fc010056440 con 0x7fc02006f150 2024-08-18T22:23:28.011 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:28.011 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":46,"btime":"2024-08-18T22:23:27:779613+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3998000168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3998000168},{"type":"v1","addr":"172.21.15.117:6837","nonce":3998000168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1741701025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1741701025},{"type":"v1","addr":"172.21.15.117:6835","nonce":1741701025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/188037311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":188037311},{"type":"v1","addr":"172.21.15.5:6835","nonce":188037311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:26.781160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"c","rank":0,"incarnation":44,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.5:6833/1715051733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1715051733},{"type":"v1","addr":"172.21.15.5:6833","nonce":1715051733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-08-18T22:23:28.012 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 46 2024-08-18T22:23:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.006+0000 7fc026200640 1 -- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbffc0678c0 msgr2=0x7fbffc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.006+0000 7fc026200640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbffc0678c0 0x7fbffc069d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc008005890 tx=0x7fc008009040 comp rx=0 tx=0).stop 2024-08-18T22:23:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.006+0000 7fc026200640 1 -- 172.21.15.5:0/482167106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02006f150 msgr2=0x7fc0200b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.006+0000 7fc026200640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02006f150 0x7fc0200b2f50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc01000c480 tx=0x7fc01000c940 comp rx=0 tx=0).stop 2024-08-18T22:23:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.010+0000 7fc026200640 1 -- 172.21.15.5:0/482167106 shutdown_connections 2024-08-18T22:23:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.010+0000 7fc026200640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbffc0678c0 0x7fbffc069d80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.010+0000 7fc026200640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02015a800 0x7fc0200cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.010+0000 7fc026200640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200caec0 0x7fc0200cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.010+0000 7fc026200640 1 --2- 172.21.15.5:0/482167106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02006f150 0x7fc0200b2f50 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.010+0000 7fc026200640 1 -- 172.21.15.5:0/482167106 >> 172.21.15.5:0/482167106 conn(0x7fc0200b1c50 msgr2=0x7fc0200c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:28.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.010+0000 7fc026200640 1 -- 172.21.15.5:0/482167106 shutdown_connections 2024-08-18T22:23:28.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:28.010+0000 7fc026200640 1 -- 172.21.15.5:0/482167106 wait complete. 2024-08-18T22:23:28.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:23:08.785969+0000', 'modified': '2024-08-18T22:23:26.781160+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6543}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6543': {'gid': 6543, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.5:6833/1715051733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 1715051733}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 1715051733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-18T22:23:28.435 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6543:up:rejoin 2024-08-18T22:23:29.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:29.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd111800640 1 Processor -- start 2024-08-18T22:23:29.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd111800640 1 -- start start 2024-08-18T22:23:29.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd111800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd10c15bed0 0x7fd10c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd111800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd10c073c80 con 0x7fd10c0cb390 2024-08-18T22:23:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd111800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd10c0ca5d0 con 0x7fd10c06da70 2024-08-18T22:23:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd111800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd10c0ca8b0 con 0x7fd10c15bed0 2024-08-18T22:23:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd103e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd10c0cb390 0x7fd10c071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50318/0 (socket says 172.21.15.5:50318) 2024-08-18T22:23:29.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd103e00640 1 -- 172.21.15.5:0/2247491573 learned_addr learned my addr 172.21.15.5:0/2247491573 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd10aa00640 1 --2- 172.21.15.5:0/2247491573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd10c15bed0 0x7fd10c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd10a000640 1 -- 172.21.15.5:0/2247491573 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339894156 0 0) 0x7fd10c073c80 con 0x7fd10c0cb390 2024-08-18T22:23:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd10a000640 1 -- 172.21.15.5:0/2247491573 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0f0003530 con 0x7fd10c0cb390 2024-08-18T22:23:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd10a000640 1 -- 172.21.15.5:0/2247491573 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942608558 0 0) 0x7fd10c0ca5d0 con 0x7fd10c06da70 2024-08-18T22:23:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd10a000640 1 -- 172.21.15.5:0/2247491573 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd10c073c80 con 0x7fd10c06da70 2024-08-18T22:23:29.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd10a000640 1 -- 172.21.15.5:0/2247491573 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4179957082 0 0) 0x7fd0f0003530 con 0x7fd10c0cb390 2024-08-18T22:23:29.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd10aa00640 1 -- 172.21.15.5:0/2247491573 >> v1:172.21.15.117:6789/0 conn(0x7fd10c06da70 legacy=0x7fd10c165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:29.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd10aa00640 1 -- 172.21.15.5:0/2247491573 >> v1:172.21.15.5:6789/0 conn(0x7fd10c0cb390 legacy=0x7fd10c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:29.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.586+0000 7fd10aa00640 1 -- 172.21.15.5:0/2247491573 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10c0cab90 con 0x7fd10c15bed0 2024-08-18T22:23:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.590+0000 7fd10aa00640 1 --2- 172.21.15.5:0/2247491573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd10c15bed0 0x7fd10c0735a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0097f0 tx=0x7fd0fc01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eb07c8e2ec35b03 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.590+0000 7fd10a000640 1 -- 172.21.15.5:0/2247491573 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0b0070 con 0x7fd10c15bed0 2024-08-18T22:23:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.590+0000 7fd10a000640 1 -- 172.21.15.5:0/2247491573 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0fc0ab400 con 0x7fd10c15bed0 2024-08-18T22:23:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.590+0000 7fd10a000640 1 -- 172.21.15.5:0/2247491573 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4001680 con 0x7fd10c15bed0 2024-08-18T22:23:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.590+0000 7fd111800640 1 -- 172.21.15.5:0/2247491573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd10c15bed0 msgr2=0x7fd10c0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.590+0000 7fd111800640 1 --2- 172.21.15.5:0/2247491573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd10c15bed0 0x7fd10c0735a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0097f0 tx=0x7fd0fc01c3d0 comp rx=0 tx=0).stop 2024-08-18T22:23:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.590+0000 7fd111800640 1 -- 172.21.15.5:0/2247491573 shutdown_connections 2024-08-18T22:23:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.590+0000 7fd111800640 1 --2- 172.21.15.5:0/2247491573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd10c15bed0 0x7fd10c0735a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.590+0000 7fd111800640 1 -- 172.21.15.5:0/2247491573 >> 172.21.15.5:0/2247491573 conn(0x7fd10c0b1c50 msgr2=0x7fd10c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.590+0000 7fd111800640 1 -- 172.21.15.5:0/2247491573 shutdown_connections 2024-08-18T22:23:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.590+0000 7fd111800640 1 -- 172.21.15.5:0/2247491573 wait complete. 2024-08-18T22:23:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd111800640 1 Processor -- start 2024-08-18T22:23:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd111800640 1 -- start start 2024-08-18T22:23:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd111800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd10c06da70 0x7fd10c14b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd111800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd10c0cb390 0x7fd10c09bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd111800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd10c15bed0 0x7fd10c0b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd111800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c169c40 con 0x7fd10c15bed0 2024-08-18T22:23:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd111800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c169ac0 con 0x7fd10c06da70 2024-08-18T22:23:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd111800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd10c169dc0 con 0x7fd10c0cb390 2024-08-18T22:23:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd10b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd10c15bed0 0x7fd10c0b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd10b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd10c15bed0 0x7fd10c0b5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51806/0 (socket says 172.21.15.5:51806) 2024-08-18T22:23:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd10b400640 1 -- 172.21.15.5:0/3893832838 learned_addr learned my addr 172.21.15.5:0/3893832838 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd103e00640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd10c0cb390 0x7fd10c09bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd10aa00640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd10c06da70 0x7fd10c14b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd10b400640 1 -- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd10c0cb390 msgr2=0x7fd10c09bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd10b400640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd10c0cb390 0x7fd10c09bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd10b400640 1 -- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd10c06da70 msgr2=0x7fd10c14b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd10b400640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd10c06da70 0x7fd10c14b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd10b400640 1 -- 172.21.15.5:0/3893832838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10c09d240 con 0x7fd10c15bed0 2024-08-18T22:23:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd10b400640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd10c15bed0 0x7fd10c0b5580 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd10400c790 tx=0x7fd10400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd102a00640 1 -- 172.21.15.5:0/3893832838 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104003b80 con 0x7fd10c15bed0 2024-08-18T22:23:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd102a00640 1 -- 172.21.15.5:0/3893832838 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd104003d20 con 0x7fd10c15bed0 2024-08-18T22:23:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd102a00640 1 -- 172.21.15.5:0/3893832838 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10400a9f0 con 0x7fd10c15bed0 2024-08-18T22:23:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd111800640 1 -- 172.21.15.5:0/3893832838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10c09aed0 con 0x7fd10c15bed0 2024-08-18T22:23:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.594+0000 7fd111800640 1 -- 172.21.15.5:0/3893832838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd10c09b490 con 0x7fd10c15bed0 2024-08-18T22:23:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.598+0000 7fd111800640 1 -- 172.21.15.5:0/3893832838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd10c0735a0 con 0x7fd10c15bed0 2024-08-18T22:23:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.598+0000 7fd102a00640 1 -- 172.21.15.5:0/3893832838 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd10400ab90 con 0x7fd10c15bed0 2024-08-18T22:23:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.598+0000 7fd102a00640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0e80678f0 0x7fd0e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.598+0000 7fd102a00640 1 -- 172.21.15.5:0/3893832838 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7fd104085c70 con 0x7fd10c15bed0 2024-08-18T22:23:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.598+0000 7fd10aa00640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0e80678f0 0x7fd0e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.598+0000 7fd10aa00640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0e80678f0 0x7fd0e8069db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0ad000 tx=0x7fd0fc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.602+0000 7fd102a00640 1 -- 172.21.15.5:0/3893832838 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd10c09d240 con 0x7fd10c15bed0 2024-08-18T22:23:29.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.802+0000 7fd111800640 1 -- 172.21.15.5:0/3893832838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd10c0ade20 con 0x7fd10c15bed0 2024-08-18T22:23:29.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.802+0000 7fd102a00640 1 -- 172.21.15.5:0/3893832838 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7fd104055f70 con 0x7fd10c15bed0 2024-08-18T22:23:29.809 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:29.809 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":47,"btime":"2024-08-18T22:23:28:785339+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3998000168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3998000168},{"type":"v1","addr":"172.21.15.117:6837","nonce":3998000168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1741701025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1741701025},{"type":"v1","addr":"172.21.15.117:6835","nonce":1741701025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/188037311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":188037311},{"type":"v1","addr":"172.21.15.5:6835","nonce":188037311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:28.785328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/1715051733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1715051733},{"type":"v1","addr":"172.21.15.5:6833","nonce":1715051733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6543,"qdb_cluster":[6543]},"id":4}]} 2024-08-18T22:23:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 47 2024-08-18T22:23:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 -- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0e80678f0 msgr2=0x7fd0e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0e80678f0 0x7fd0e8069db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0ad000 tx=0x7fd0fc0a6000 comp rx=0 tx=0).stop 2024-08-18T22:23:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 -- 172.21.15.5:0/3893832838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd10c15bed0 msgr2=0x7fd10c0b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd10c15bed0 0x7fd10c0b5580 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd10400c790 tx=0x7fd10400cc50 comp rx=0 tx=0).stop 2024-08-18T22:23:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 -- 172.21.15.5:0/3893832838 shutdown_connections 2024-08-18T22:23:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0e80678f0 0x7fd0e8069db0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd10c15bed0 0x7fd10c0b5580 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd10c0cb390 0x7fd10c09bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 --2- 172.21.15.5:0/3893832838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd10c06da70 0x7fd10c14b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 -- 172.21.15.5:0/3893832838 >> 172.21.15.5:0/3893832838 conn(0x7fd10c0b1c50 msgr2=0x7fd10c0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 -- 172.21.15.5:0/3893832838 shutdown_connections 2024-08-18T22:23:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:29.806+0000 7fd111800640 1 -- 172.21.15.5:0/3893832838 wait complete. 2024-08-18T22:23:30.233 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:23:08.785969+0000', 'modified': '2024-08-18T22:23:28.785328+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6543}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6543': {'gid': 6543, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.5:6833/1715051733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 1715051733}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 1715051733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6543, 'qdb_cluster': [6543]} 2024-08-18T22:23:30.234 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:23:30.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-18T22:23:30.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.374+0000 7f4cbda00640 1 Processor -- start 2024-08-18T22:23:30.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cbda00640 1 -- start start 2024-08-18T22:23:30.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cbda00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4cb815b0c0 0x7f4cb806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cbda00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4cb80cf290 0x7f4cb80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cbda00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb80b31f0 con 0x7f4cb80b40c0 2024-08-18T22:23:30.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cbda00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb80b4a70 con 0x7f4cb815b0c0 2024-08-18T22:23:30.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cbda00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb80b3d70 con 0x7f4cb80cf290 2024-08-18T22:23:30.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cb6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4cb815b0c0 0x7f4cb806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cb6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4cb815b0c0 0x7f4cb806db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51816/0 (socket says 172.21.15.5:51816) 2024-08-18T22:23:30.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cb6a00640 1 -- 172.21.15.5:0/2347880136 learned_addr learned my addr 172.21.15.5:0/2347880136 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cafe00640 1 --1- 172.21.15.5:0/2347880136 >> v1:172.21.15.5:6789/0 conn(0x7f4cb80b40c0 0x7f4cb8072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50324/0 (socket says 172.21.15.5:50324) 2024-08-18T22:23:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cb7400640 1 --2- 172.21.15.5:0/2347880136 >> v2:172.21.15.117:3300/0 conn(0x7f4cb80cf290 0x7f4cb80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cb6a00640 1 -- 172.21.15.5:0/2347880136 >> v2:172.21.15.117:3300/0 conn(0x7f4cb80cf290 msgr2=0x7f4cb80b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/2347880136 >> v2:172.21.15.117:3300/0 conn(0x7f4cb80cf290 0x7f4cb80b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cb6a00640 1 -- 172.21.15.5:0/2347880136 >> v1:172.21.15.5:6789/0 conn(0x7f4cb80b40c0 legacy=0x7f4cb8072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.378+0000 7f4cb6a00640 1 -- 172.21.15.5:0/2347880136 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb80b34d0 con 0x7f4cb815b0c0 2024-08-18T22:23:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/2347880136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb815b0c0 0x7f4cb806db80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80b4f30 tx=0x7f4ca801eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708cb9d88bc93dc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cb6000640 1 -- 172.21.15.5:0/2347880136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80b4070 con 0x7f4cb815b0c0 2024-08-18T22:23:30.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cb6000640 1 -- 172.21.15.5:0/2347880136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca80a7b70 con 0x7f4cb815b0c0 2024-08-18T22:23:30.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cb6000640 1 -- 172.21.15.5:0/2347880136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80af440 con 0x7f4cb815b0c0 2024-08-18T22:23:30.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cbda00640 1 -- 172.21.15.5:0/2347880136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb815b0c0 msgr2=0x7f4cb806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cbda00640 1 --2- 172.21.15.5:0/2347880136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb815b0c0 0x7f4cb806db80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80b4f30 tx=0x7f4ca801eaa0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cbda00640 1 -- 172.21.15.5:0/2347880136 shutdown_connections 2024-08-18T22:23:30.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cbda00640 1 --2- 172.21.15.5:0/2347880136 >> v2:172.21.15.117:3300/0 conn(0x7f4cb80cf290 0x7f4cb80b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cbda00640 1 --2- 172.21.15.5:0/2347880136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb815b0c0 0x7f4cb806db80 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cbda00640 1 -- 172.21.15.5:0/2347880136 >> 172.21.15.5:0/2347880136 conn(0x7f4cb80b1dc0 msgr2=0x7f4cb80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:30.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cbda00640 1 -- 172.21.15.5:0/2347880136 shutdown_connections 2024-08-18T22:23:30.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cbda00640 1 -- 172.21.15.5:0/2347880136 wait complete. 2024-08-18T22:23:30.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cbda00640 1 Processor -- start 2024-08-18T22:23:30.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.382+0000 7f4cbda00640 1 -- start start 2024-08-18T22:23:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cbda00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cb80b40c0 0x7f4cb8146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cbda00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb80cf290 0x7f4cb814f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cbda00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb815b0c0 0x7f4cb8150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cbda00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb815b620 con 0x7f4cb815b0c0 2024-08-18T22:23:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cbda00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb815b4a0 con 0x7f4cb80b40c0 2024-08-18T22:23:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cbda00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb806f670 con 0x7f4cb80cf290 2024-08-18T22:23:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cb7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb815b0c0 0x7f4cb8150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cb7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb815b0c0 0x7f4cb8150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51830/0 (socket says 172.21.15.5:51830) 2024-08-18T22:23:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cb7400640 1 -- 172.21.15.5:0/2370750010 learned_addr learned my addr 172.21.15.5:0/2370750010 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cb80b40c0 0x7f4cb8146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cafe00640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb80cf290 0x7f4cb814f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cb7400640 1 -- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb80cf290 msgr2=0x7f4cb814f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cb7400640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb80cf290 0x7f4cb814f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cb7400640 1 -- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cb80b40c0 msgr2=0x7f4cb8146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cb7400640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cb80b40c0 0x7f4cb8146330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cb7400640 1 -- 172.21.15.5:0/2370750010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb814b8b0 con 0x7f4cb815b0c0 2024-08-18T22:23:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cb7400640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb815b0c0 0x7f4cb8150170 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0007e40 tx=0x7f4cb000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4caea00640 1 -- 172.21.15.5:0/2370750010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0014620 con 0x7f4cb815b0c0 2024-08-18T22:23:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4caea00640 1 -- 172.21.15.5:0/2370750010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb0019070 con 0x7f4cb815b0c0 2024-08-18T22:23:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4caea00640 1 -- 172.21.15.5:0/2370750010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0014a20 con 0x7f4cb815b0c0 2024-08-18T22:23:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cbda00640 1 -- 172.21.15.5:0/2370750010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb8156fe0 con 0x7f4cb815b0c0 2024-08-18T22:23:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4cbda00640 1 -- 172.21.15.5:0/2370750010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb814bb20 con 0x7f4cb815b0c0 2024-08-18T22:23:30.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.386+0000 7f4caea00640 1 -- 172.21.15.5:0/2370750010 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4cb0014bc0 con 0x7f4cb815b0c0 2024-08-18T22:23:30.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4caea00640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4c940678c0 0x7f4c94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4caea00640 1 -- 172.21.15.5:0/2370750010 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f4cb00865b0 con 0x7f4cb815b0c0 2024-08-18T22:23:30.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4c940678c0 0x7f4c94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 Processor -- start 2024-08-18T22:23:30.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 -- start start 2024-08-18T22:23:30.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4c940678c0 0x7f4c94069d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80b1000 tx=0x7f4ca8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b178130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b178670 0x56438b12e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b12e990 0x56438b12ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56438b014fd0 con 0x56438b177d50 2024-08-18T22:23:30.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56438af7b3c0 con 0x56438b12e990 2024-08-18T22:23:30.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56438af20f70 con 0x56438b178670 2024-08-18T22:23:30.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b178130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b178130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51836/0 (socket says 172.21.15.5:51836) 2024-08-18T22:23:30.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb6a00640 1 -- 172.21.15.5:0/3616245360 learned_addr learned my addr 172.21.15.5:0/3616245360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:30.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cafe00640 1 --2- 172.21.15.5:0/3616245360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b178670 0x56438b12e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb6a00640 1 -- 172.21.15.5:0/3616245360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b178670 msgr2=0x56438b12e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb7400640 1 --2- 172.21.15.5:0/3616245360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b12e990 0x56438b12ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/3616245360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b178670 0x56438b12e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb6a00640 1 -- 172.21.15.5:0/3616245360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b12e990 msgr2=0x56438b12ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/3616245360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b12e990 0x56438b12ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb6a00640 1 -- 172.21.15.5:0/3616245360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56438af152e0 con 0x56438b177d50 2024-08-18T22:23:30.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cafe00640 1 --2- 172.21.15.5:0/3616245360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b178670 0x56438b12e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:30.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb7400640 1 --2- 172.21.15.5:0/3616245360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b12e990 0x56438b12ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:30.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/3616245360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b178130 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4ca801c6d0 tx=0x7f4ca8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e41f875e152fb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4ca7400640 1 -- 172.21.15.5:0/3616245360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80ca070 con 0x56438b177d50 2024-08-18T22:23:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4ca7400640 1 -- 172.21.15.5:0/3616245360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca80af910 con 0x56438b177d50 2024-08-18T22:23:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4ca7400640 1 -- 172.21.15.5:0/3616245360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80b4040 con 0x56438b177d50 2024-08-18T22:23:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 -- 172.21.15.5:0/3616245360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 msgr2=0x56438b178130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/3616245360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b178130 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4ca801c6d0 tx=0x7f4ca8004740 comp rx=0 tx=0).stop 2024-08-18T22:23:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 -- 172.21.15.5:0/3616245360 shutdown_connections 2024-08-18T22:23:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/3616245360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b12e990 0x56438b12ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/3616245360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b178670 0x56438b12e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/3616245360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b178130 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.390+0000 7f4cc0e46000 1 -- 172.21.15.5:0/3616245360 >> 172.21.15.5:0/3616245360 conn(0x56438b12a910 msgr2=0x56438b12cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 -- 172.21.15.5:0/3616245360 shutdown_connections 2024-08-18T22:23:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 -- 172.21.15.5:0/3616245360 wait complete. 2024-08-18T22:23:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 -- start start 2024-08-18T22:23:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 Processor -- start 2024-08-18T22:23:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b12e990 0x56438b165640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b133b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b178670 0x56438b1340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56438af22e40 con 0x56438b177d50 2024-08-18T22:23:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56438b038af0 con 0x56438b178670 2024-08-18T22:23:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56438afdd450 con 0x56438b12e990 2024-08-18T22:23:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 10 client.0 _ll_register_callbacks cb 0x56438b119630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:23:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cafe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b133b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cafe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b133b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51848/0 (socket says 172.21.15.5:51848) 2024-08-18T22:23:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cafe00640 1 -- 172.21.15.5:0/2292300023 learned_addr learned my addr 172.21.15.5:0/2292300023 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cb7400640 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b178670 0x56438b1340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b12e990 0x56438b165640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cafe00640 1 -- 172.21.15.5:0/2292300023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b12e990 msgr2=0x56438b165640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cafe00640 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b12e990 0x56438b165640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cafe00640 1 -- 172.21.15.5:0/2292300023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b178670 msgr2=0x56438b1340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cafe00640 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b178670 0x56438b1340d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cafe00640 1 -- 172.21.15.5:0/2292300023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56438af02fd0 con 0x56438b177d50 2024-08-18T22:23:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cafe00640 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b133b90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0007320 tx=0x7f4ca00077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a1e1cc775838a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4c9be00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4c9be00640 1 -- 172.21.15.5:0/2292300023 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0001c40 con 0x56438b177d50 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2292300023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca80af910 con 0x56438b177d50 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4c9be00640 1 -- 172.21.15.5:0/2292300023 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f4ca000c960 con 0x56438b177d50 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4c9be00640 1 -- 172.21.15.5:0/2292300023 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f4ca000cb60 con 0x56438b177d50 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 10 client.6582 fetch_fsmap learned FSMap version 47 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2292300023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x56438affe4d0 con 0x56438b177d50 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4c9be00640 1 -- 172.21.15.5:0/2292300023 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca80af910 con 0x56438b177d50 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4c9be00640 1 -- 172.21.15.5:0/2292300023 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f4ca001f460 con 0x56438b177d50 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 10 client.6582 fetch_fsmap finished waiting for FSMap version 47 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 10 client.6582 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 20 client.6582 populate_metadata read hostname 'smithi005' 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x56438b1664f0 0x56438b1668d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 4 client.6582 mds_command: new command op to 6543 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.394+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2292300023 --> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56438af15c00 con 0x56438b1664f0 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x56438b1664f0 0x56438b1668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x56438b1664f0 0x56438b1668d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17828a3898773799 server_cookie=bc5c31862000f2c8 in_seq=0 out_seq=0 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4c9be00640 10 client.6582 ms_handle_connect on v2:172.21.15.5:6832/1715051733 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4c9be00640 1 -- 172.21.15.5:0/2292300023 <== mds.0 v2:172.21.15.5:6832/1715051733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56438af15c00 con 0x56438b1664f0 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4c9be00640 10 client.6582 handle_command_reply: tid=0 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 1 client.6582 shutdown 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2292300023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 msgr2=0x56438b133b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b133b90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0007320 tx=0x7f4ca00077e0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2292300023 shutdown_connections 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x56438b1664f0 0x56438b1668d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b178670 0x56438b1340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b177d50 0x56438b133b90 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4c9be00640 0 client.6582 ms_handle_reset on v2:172.21.15.5:6832/1715051733 2024-08-18T22:23:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/2292300023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b12e990 0x56438b165640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2292300023 >> 172.21.15.5:0/2292300023 conn(0x56438b12a910 msgr2=0x56438b12d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2292300023 shutdown_connections 2024-08-18T22:23:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2292300023 wait complete. 2024-08-18T22:23:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.398+0000 7f4cc0e46000 20 client.6582 trim_cache size 0 max 16384 2024-08-18T22:23:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 Processor -- start 2024-08-18T22:23:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 -- start start 2024-08-18T22:23:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b12e990 0x56438b12cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b177d50 0x56438b12d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b12da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8202e80 con 0x56438b178670 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8158010 con 0x56438b177d50 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb8158660 con 0x56438b12e990 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cb7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b12da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cb7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b12da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51850/0 (socket says 172.21.15.5:51850) 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cb7400640 1 -- 172.21.15.5:0/2533560650 learned_addr learned my addr 172.21.15.5:0/2533560650 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/2533560650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b12e990 0x56438b12cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cafe00640 1 --2- 172.21.15.5:0/2533560650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b177d50 0x56438b12d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cb7400640 1 -- 172.21.15.5:0/2533560650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b12e990 msgr2=0x56438b12cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cb7400640 1 --2- 172.21.15.5:0/2533560650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b12e990 0x56438b12cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cb7400640 1 -- 172.21.15.5:0/2533560650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b177d50 msgr2=0x56438b12d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cb7400640 1 --2- 172.21.15.5:0/2533560650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b177d50 0x56438b12d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cb7400640 1 -- 172.21.15.5:0/2533560650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56438b1784a0 con 0x56438b178670 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cafe00640 1 --2- 172.21.15.5:0/2533560650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b177d50 0x56438b12d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cb7400640 1 --2- 172.21.15.5:0/2533560650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b12da40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00565b0 tx=0x7f4cb00562d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c468bf6fe040beaf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4ca6a00640 1 -- 172.21.15.5:0/2533560650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb005f3e0 con 0x56438b178670 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4ca6a00640 1 -- 172.21.15.5:0/2533560650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb0054950 con 0x56438b178670 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4ca6a00640 1 -- 172.21.15.5:0/2533560650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0052f20 con 0x56438b178670 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2533560650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 msgr2=0x56438b12da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/2533560650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b12da40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00565b0 tx=0x7f4cb00562d0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2533560650 shutdown_connections 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/2533560650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b12da40 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/2533560650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b177d50 0x56438b12d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/2533560650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b12e990 0x56438b12cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2533560650 >> 172.21.15.5:0/2533560650 conn(0x56438b12a910 msgr2=0x56438b133fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2533560650 shutdown_connections 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 -- 172.21.15.5:0/2533560650 wait complete. 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.418+0000 7f4cc0e46000 1 -- start start 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 Processor -- start 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b12e990 0x56438b1eb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b177d50 0x56438b1eb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b1ebc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56438af341d0 con 0x56438b178670 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56438af12900 con 0x56438b12e990 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56438af7f9f0 con 0x56438b177d50 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 10 client.0 _ll_register_callbacks cb 0x7f4ca0004830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b1ebc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b1ebc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51862/0 (socket says 172.21.15.5:51862) 2024-08-18T22:23:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb7400640 1 -- 172.21.15.5:0/427489345 learned_addr learned my addr 172.21.15.5:0/427489345 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b12e990 0x56438b1eb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cafe00640 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b177d50 0x56438b1eb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb7400640 1 -- 172.21.15.5:0/427489345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b177d50 msgr2=0x56438b1eb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb7400640 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b177d50 0x56438b1eb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb7400640 1 -- 172.21.15.5:0/427489345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b12e990 msgr2=0x56438b1eb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb7400640 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b12e990 0x56438b1eb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb7400640 1 -- 172.21.15.5:0/427489345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56438af74b30 con 0x56438b178670 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb7400640 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b1ebc60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0056a70 tx=0x7f4cb001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9b367f7dc35913 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4c9be00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4c9be00640 1 -- 172.21.15.5:0/427489345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0074070 con 0x56438b178670 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 -- 172.21.15.5:0/427489345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cb0054950 con 0x56438b178670 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4c9be00640 1 -- 172.21.15.5:0/427489345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f4cb005ef50 con 0x56438b178670 2024-08-18T22:23:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4c9be00640 1 -- 172.21.15.5:0/427489345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f4cb005f3e0 con 0x56438b178670 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 10 client.6588 fetch_fsmap learned FSMap version 47 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 -- 172.21.15.5:0/427489345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x56438af2c810 con 0x56438b178670 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4c9be00640 1 -- 172.21.15.5:0/427489345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb0054950 con 0x56438b178670 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4c9be00640 1 -- 172.21.15.5:0/427489345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f4cb0080020 con 0x56438b178670 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 10 client.6588 fetch_fsmap finished waiting for FSMap version 47 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 10 client.6588 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 20 client.6588 populate_metadata read hostname 'smithi005' 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x56438b18c770 0x56438b18cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 4 client.6588 mds_command: new command op to 6543 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 -- 172.21.15.5:0/427489345 --> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] -- command(tid 0: {"prefix": "status"}) -- 0x56438b1659d0 con 0x56438b18c770 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x56438b18c770 0x56438b18cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cb6a00640 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x56438b18c770 0x56438b18cb50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89e0349d95bda3c server_cookie=83c3fbb56076b405 in_seq=0 out_seq=0 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4c9be00640 10 client.6588 ms_handle_connect on v2:172.21.15.5:6832/1715051733 2024-08-18T22:23:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4c9be00640 1 -- 172.21.15.5:0/427489345 <== mds.0 v2:172.21.15.5:6832/1715051733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56438b1659d0 con 0x56438b18c770 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4c9be00640 10 client.6588 handle_command_reply: tid=0 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 client.6588 shutdown 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 -- 172.21.15.5:0/427489345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 msgr2=0x56438b1ebc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b1ebc60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0056a70 tx=0x7f4cb001f000 comp rx=0 tx=0).stop 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 -- 172.21.15.5:0/427489345 shutdown_connections 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x56438b18c770 0x56438b18cb50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56438b178670 0x56438b1ebc60 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.422+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56438b177d50 0x56438b1eb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cc0e46000 1 --2- 172.21.15.5:0/427489345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56438b12e990 0x56438b1eb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cc0e46000 1 -- 172.21.15.5:0/427489345 >> 172.21.15.5:0/427489345 conn(0x56438b12a910 msgr2=0x56438b176950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4c9be00640 0 client.6588 ms_handle_reset on v2:172.21.15.5:6832/1715051733 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cc0e46000 1 -- 172.21.15.5:0/427489345 shutdown_connections 2024-08-18T22:23:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cc0e46000 1 -- 172.21.15.5:0/427489345 wait complete. 2024-08-18T22:23:30.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cc0e46000 20 client.6588 trim_cache size 0 max 16384 2024-08-18T22:23:30.439 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:23:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:23:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:23:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6543, 2024-08-18T22:23:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:23:30.439 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:23:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:23:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 4.6521182200000002, 2024-08-18T22:23:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 47, 2024-08-18T22:23:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 71, 2024-08-18T22:23:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 71, 2024-08-18T22:23:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 5.4912960709999998 2024-08-18T22:23:30.440 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:23:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 -- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4c940678c0 msgr2=0x7f4c94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4c940678c0 0x7f4c94069d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80b1000 tx=0x7f4ca8008040 comp rx=0 tx=0).stop 2024-08-18T22:23:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 -- 172.21.15.5:0/2370750010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb815b0c0 msgr2=0x7f4cb8150170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb815b0c0 0x7f4cb8150170 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0007e40 tx=0x7f4cb000e4b0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 -- 172.21.15.5:0/2370750010 shutdown_connections 2024-08-18T22:23:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4c940678c0 0x7f4c94069d80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cb815b0c0 0x7f4cb8150170 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cb80cf290 0x7f4cb814f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 --2- 172.21.15.5:0/2370750010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cb80b40c0 0x7f4cb8146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 -- 172.21.15.5:0/2370750010 >> 172.21.15.5:0/2370750010 conn(0x7f4cb80b1dc0 msgr2=0x7f4cb8159120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 -- 172.21.15.5:0/2370750010 shutdown_connections 2024-08-18T22:23:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.426+0000 7f4cbda00640 1 -- 172.21.15.5:0/2370750010 wait complete. 2024-08-18T22:23:30.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 100 2024-08-18T22:23:30.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3570c00640 1 Processor -- start 2024-08-18T22:23:30.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3570c00640 1 -- start start 2024-08-18T22:23:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3570c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f356c15b0c0 0x7f356c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3570c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f356c0b40c0 0x7f356c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3570c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356c0b31f0 con 0x7f356c072a30 2024-08-18T22:23:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3570c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f356c0b4a70 con 0x7f356c0b40c0 2024-08-18T22:23:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3570c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f356c0b3d70 con 0x7f356c15b0c0 2024-08-18T22:23:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3569400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f356c0b40c0 0x7f356c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f356a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f356c072a30 0x7f356c072e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50328/0 (socket says 172.21.15.5:50328) 2024-08-18T22:23:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f356a800640 1 -- 172.21.15.5:0/3989926773 learned_addr learned my addr 172.21.15.5:0/3989926773 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3569e00640 1 --2- 172.21.15.5:0/3989926773 >> v2:172.21.15.117:3300/0 conn(0x7f356c15b0c0 0x7f356c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3568a00640 1 -- 172.21.15.5:0/3989926773 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881834700 0 0) 0x7f356c0b31f0 con 0x7f356c072a30 2024-08-18T22:23:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3568a00640 1 -- 172.21.15.5:0/3989926773 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3550003530 con 0x7f356c072a30 2024-08-18T22:23:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3569400640 1 -- 172.21.15.5:0/3989926773 >> v2:172.21.15.117:3300/0 conn(0x7f356c15b0c0 msgr2=0x7f356c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3569400640 1 --2- 172.21.15.5:0/3989926773 >> v2:172.21.15.117:3300/0 conn(0x7f356c15b0c0 0x7f356c06db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3569400640 1 -- 172.21.15.5:0/3989926773 >> v1:172.21.15.5:6789/0 conn(0x7f356c072a30 legacy=0x7f356c072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.590+0000 7f3569400640 1 -- 172.21.15.5:0/3989926773 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c0b34d0 con 0x7f356c0b40c0 2024-08-18T22:23:30.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3569400640 1 --2- 172.21.15.5:0/3989926773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c0b40c0 0x7f356c0b4530 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f356c070ba0 tx=0x7f355801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc72ea2e87447af server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3568a00640 1 -- 172.21.15.5:0/3989926773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580b0070 con 0x7f356c0b40c0 2024-08-18T22:23:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3568a00640 1 -- 172.21.15.5:0/3989926773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35580ab600 con 0x7f356c0b40c0 2024-08-18T22:23:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3568a00640 1 -- 172.21.15.5:0/3989926773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580ab9d0 con 0x7f356c0b40c0 2024-08-18T22:23:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3570c00640 1 -- 172.21.15.5:0/3989926773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c0b40c0 msgr2=0x7f356c0b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3570c00640 1 --2- 172.21.15.5:0/3989926773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c0b40c0 0x7f356c0b4530 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f356c070ba0 tx=0x7f355801c330 comp rx=0 tx=0).stop 2024-08-18T22:23:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3570c00640 1 -- 172.21.15.5:0/3989926773 shutdown_connections 2024-08-18T22:23:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3570c00640 1 --2- 172.21.15.5:0/3989926773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c0b40c0 0x7f356c0b4530 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3570c00640 1 --2- 172.21.15.5:0/3989926773 >> v2:172.21.15.117:3300/0 conn(0x7f356c15b0c0 0x7f356c06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3570c00640 1 -- 172.21.15.5:0/3989926773 >> 172.21.15.5:0/3989926773 conn(0x7f356c0b1dc0 msgr2=0x7f356c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3570c00640 1 -- 172.21.15.5:0/3989926773 shutdown_connections 2024-08-18T22:23:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.594+0000 7f3570c00640 1 -- 172.21.15.5:0/3989926773 wait complete. 2024-08-18T22:23:30.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3570c00640 1 Processor -- start 2024-08-18T22:23:30.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3570c00640 1 -- start start 2024-08-18T22:23:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3570c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f356c072a30 0x7f356c099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3570c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c0b40c0 0x7f356c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3570c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f356c15b0c0 0x7f356c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3570c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f356c15b4a0 con 0x7f356c0b40c0 2024-08-18T22:23:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3570c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f356c0739a0 con 0x7f356c15b0c0 2024-08-18T22:23:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3570c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f356c15b620 con 0x7f356c072a30 2024-08-18T22:23:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3569400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c0b40c0 0x7f356c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3569400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c0b40c0 0x7f356c154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51884/0 (socket says 172.21.15.5:51884) 2024-08-18T22:23:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3569400640 1 -- 172.21.15.5:0/3822500146 learned_addr learned my addr 172.21.15.5:0/3822500146 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f356a800640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f356c15b0c0 0x7f356c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3569e00640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f356c072a30 0x7f356c099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3569400640 1 -- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f356c072a30 msgr2=0x7f356c099940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3569400640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f356c072a30 0x7f356c099940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3569400640 1 -- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f356c15b0c0 msgr2=0x7f356c151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3569400640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f356c15b0c0 0x7f356c151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3569400640 1 -- 172.21.15.5:0/3822500146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c099e80 con 0x7f356c0b40c0 2024-08-18T22:23:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3569400640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c0b40c0 0x7f356c154b20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f35580ae040 tx=0x7f35580190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3562000640 1 -- 172.21.15.5:0/3822500146 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580b8020 con 0x7f356c0b40c0 2024-08-18T22:23:30.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3562000640 1 -- 172.21.15.5:0/3822500146 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35580b4410 con 0x7f356c0b40c0 2024-08-18T22:23:30.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3570c00640 1 -- 172.21.15.5:0/3822500146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356c152f00 con 0x7f356c0b40c0 2024-08-18T22:23:30.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3562000640 1 -- 172.21.15.5:0/3822500146 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580b0040 con 0x7f356c0b40c0 2024-08-18T22:23:30.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3570c00640 1 -- 172.21.15.5:0/3822500146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f356c1534c0 con 0x7f356c0b40c0 2024-08-18T22:23:30.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.598+0000 7f3570c00640 1 -- 172.21.15.5:0/3822500146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f356c06f700 con 0x7f356c0b40c0 2024-08-18T22:23:30.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.602+0000 7f3562000640 1 -- 172.21.15.5:0/3822500146 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35580bb020 con 0x7f356c0b40c0 2024-08-18T22:23:30.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.602+0000 7f3562000640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f354c0678f0 0x7f354c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.602+0000 7f3562000640 1 -- 172.21.15.5:0/3822500146 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f355811fab0 con 0x7f356c0b40c0 2024-08-18T22:23:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.602+0000 7f3569e00640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f354c0678f0 0x7f354c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.602+0000 7f3569e00640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f354c0678f0 0x7f354c069db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f355c009a50 tx=0x7f355c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.606+0000 7f3562000640 1 -- 172.21.15.5:0/3822500146 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f35580c2030 con 0x7f356c0b40c0 2024-08-18T22:23:30.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.774+0000 7f3570c00640 1 -- 172.21.15.5:0/3822500146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f356c154830 con 0x7f356c0b40c0 2024-08-18T22:23:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3562000640 1 -- 172.21.15.5:0/3822500146 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v18)=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f3558016070 con 0x7f356c0b40c0 2024-08-18T22:23:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 -- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f354c0678f0 msgr2=0x7f354c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f354c0678f0 0x7f354c069db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f355c009a50 tx=0x7f355c008040 comp rx=0 tx=0).stop 2024-08-18T22:23:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 -- 172.21.15.5:0/3822500146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c0b40c0 msgr2=0x7f356c154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c0b40c0 0x7f356c154b20 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f35580ae040 tx=0x7f35580190d0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 -- 172.21.15.5:0/3822500146 shutdown_connections 2024-08-18T22:23:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f354c0678f0 0x7f354c069db0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f356c15b0c0 0x7f356c151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f356c0b40c0 0x7f356c154b20 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 --2- 172.21.15.5:0/3822500146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f356c072a30 0x7f356c099940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 -- 172.21.15.5:0/3822500146 >> 172.21.15.5:0/3822500146 conn(0x7f356c0b1dc0 msgr2=0x7f356c072e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:30.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 -- 172.21.15.5:0/3822500146 shutdown_connections 2024-08-18T22:23:30.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.778+0000 7f3570c00640 1 -- 172.21.15.5:0/3822500146 wait complete. 2024-08-18T22:23:30.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 30 2024-08-18T22:23:30.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.942+0000 7f7f68a00640 1 Processor -- start 2024-08-18T22:23:30.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.942+0000 7f7f68a00640 1 -- start start 2024-08-18T22:23:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f68a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f6415e060 0x7f7f64071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f68a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f640b55f0 0x7f7f640b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f68a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f6406eae0 con 0x7f7f640b3fe0 2024-08-18T22:23:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f68a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7f640b4990 con 0x7f7f6415e060 2024-08-18T22:23:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f68a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7f64071440 con 0x7f7f640b55f0 2024-08-18T22:23:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f62800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f6415e060 0x7f7f64071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f62800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f6415e060 0x7f7f64071ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51898/0 (socket says 172.21.15.5:51898) 2024-08-18T22:23:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f62800640 1 -- 172.21.15.5:0/1556092384 learned_addr learned my addr 172.21.15.5:0/1556092384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f62800640 1 -- 172.21.15.5:0/1556092384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f640b55f0 msgr2=0x7f7f640b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f62800640 1 --2- 172.21.15.5:0/1556092384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f640b55f0 0x7f7f640b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f62800640 1 -- 172.21.15.5:0/1556092384 >> v1:172.21.15.117:6789/0 conn(0x7f7f640b3fe0 legacy=0x7f7f640b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.946+0000 7f7f62800640 1 -- 172.21.15.5:0/1556092384 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6406e800 con 0x7f7f6415e060 2024-08-18T22:23:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f62800640 1 --2- 172.21.15.5:0/1556092384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6415e060 0x7f7f64071ee0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009870 tx=0x7f7f5401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12edca6827500f21 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f61400640 1 -- 172.21.15.5:0/1556092384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f540ab650 con 0x7f7f6415e060 2024-08-18T22:23:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f61400640 1 -- 172.21.15.5:0/1556092384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f540b0070 con 0x7f7f6415e060 2024-08-18T22:23:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f61400640 1 -- 172.21.15.5:0/1556092384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f540aba10 con 0x7f7f6415e060 2024-08-18T22:23:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 -- 172.21.15.5:0/1556092384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6415e060 msgr2=0x7f7f64071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 --2- 172.21.15.5:0/1556092384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6415e060 0x7f7f64071ee0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009870 tx=0x7f7f5401c490 comp rx=0 tx=0).stop 2024-08-18T22:23:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 -- 172.21.15.5:0/1556092384 shutdown_connections 2024-08-18T22:23:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 --2- 172.21.15.5:0/1556092384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f640b55f0 0x7f7f640b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 --2- 172.21.15.5:0/1556092384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6415e060 0x7f7f64071ee0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 -- 172.21.15.5:0/1556092384 >> 172.21.15.5:0/1556092384 conn(0x7f7f64067a70 msgr2=0x7f7f64067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 -- 172.21.15.5:0/1556092384 shutdown_connections 2024-08-18T22:23:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 -- 172.21.15.5:0/1556092384 wait complete. 2024-08-18T22:23:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 Processor -- start 2024-08-18T22:23:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 -- start start 2024-08-18T22:23:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f640b3fe0 0x7f7f6414ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f640b55f0 0x7f7f6414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6415e060 0x7f7f6414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6406e270 con 0x7f7f640b55f0 2024-08-18T22:23:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7f64072420 con 0x7f7f640b3fe0 2024-08-18T22:23:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f68a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6406e3f0 con 0x7f7f6415e060 2024-08-18T22:23:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f61e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f640b55f0 0x7f7f6414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f61e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f640b55f0 0x7f7f6414f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51904/0 (socket says 172.21.15.5:51904) 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.950+0000 7f7f61e00640 1 -- 172.21.15.5:0/3958837865 learned_addr learned my addr 172.21.15.5:0/3958837865 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f62800640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f640b3fe0 0x7f7f6414ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f63200640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6415e060 0x7f7f6414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f61e00640 1 -- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6415e060 msgr2=0x7f7f6414fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f61e00640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6415e060 0x7f7f6414fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f61e00640 1 -- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f640b3fe0 msgr2=0x7f7f6414ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f61e00640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f640b3fe0 0x7f7f6414ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f61e00640 1 -- 172.21.15.5:0/3958837865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6414ef60 con 0x7f7f640b55f0 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f62800640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f640b3fe0 0x7f7f6414ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f61e00640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f640b55f0 0x7f7f6414f500 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000b3e0 tx=0x7f7f5000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f5aa00640 1 -- 172.21.15.5:0/3958837865 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50015020 con 0x7f7f640b55f0 2024-08-18T22:23:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f5aa00640 1 -- 172.21.15.5:0/3958837865 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f50011850 con 0x7f7f640b55f0 2024-08-18T22:23:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f5aa00640 1 -- 172.21.15.5:0/3958837865 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50011c40 con 0x7f7f640b55f0 2024-08-18T22:23:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f68a00640 1 -- 172.21.15.5:0/3958837865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f641f7540 con 0x7f7f640b55f0 2024-08-18T22:23:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f68a00640 1 -- 172.21.15.5:0/3958837865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f64150070 con 0x7f7f640b55f0 2024-08-18T22:23:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f68a00640 1 -- 172.21.15.5:0/3958837865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f640b4450 con 0x7f7f640b55f0 2024-08-18T22:23:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.954+0000 7f7f5aa00640 1 -- 172.21.15.5:0/3958837865 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f50018020 con 0x7f7f640b55f0 2024-08-18T22:23:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.958+0000 7f7f5aa00640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f440678c0 0x7f7f44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.958+0000 7f7f5aa00640 1 -- 172.21.15.5:0/3958837865 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f7f50085dc0 con 0x7f7f640b55f0 2024-08-18T22:23:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.958+0000 7f7f62800640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f440678c0 0x7f7f44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.958+0000 7f7f62800640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f440678c0 0x7f7f44069d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7f540af000 tx=0x7f7f540a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:30.962+0000 7f7f5aa00640 1 -- 172.21.15.5:0/3958837865 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7f5001f020 con 0x7f7f640b55f0 2024-08-18T22:23:31.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.126+0000 7f7f68a00640 1 -- 172.21.15.5:0/3958837865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f7f640d2bc0 con 0x7f7f640b55f0 2024-08-18T22:23:31.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.130+0000 7f7f5aa00640 1 -- 172.21.15.5:0/3958837865 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7f7f500172c0 con 0x7f7f640b55f0 2024-08-18T22:23:31.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.130+0000 7f7f68a00640 1 -- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f440678c0 msgr2=0x7f7f44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.134+0000 7f7f68a00640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f440678c0 0x7f7f44069d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7f540af000 tx=0x7f7f540a7000 comp rx=0 tx=0).stop 2024-08-18T22:23:31.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.134+0000 7f7f68a00640 1 -- 172.21.15.5:0/3958837865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f640b55f0 msgr2=0x7f7f6414f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.134+0000 7f7f68a00640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f640b55f0 0x7f7f6414f500 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000b3e0 tx=0x7f7f5000b8a0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.134+0000 7f7f68a00640 1 -- 172.21.15.5:0/3958837865 shutdown_connections 2024-08-18T22:23:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.134+0000 7f7f68a00640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f440678c0 0x7f7f44069d80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.134+0000 7f7f68a00640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6415e060 0x7f7f6414fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.134+0000 7f7f68a00640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f640b55f0 0x7f7f6414f500 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.134+0000 7f7f68a00640 1 --2- 172.21.15.5:0/3958837865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f640b3fe0 0x7f7f6414ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.134+0000 7f7f68a00640 1 -- 172.21.15.5:0/3958837865 >> 172.21.15.5:0/3958837865 conn(0x7f7f64067a70 msgr2=0x7f7f640b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.134+0000 7f7f68a00640 1 -- 172.21.15.5:0/3958837865 shutdown_connections 2024-08-18T22:23:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.134+0000 7f7f68a00640 1 -- 172.21.15.5:0/3958837865 wait complete. 2024-08-18T22:23:31.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc8d000640 1 Processor -- start 2024-08-18T22:23:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc8d000640 1 -- start start 2024-08-18T22:23:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc8d000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc88071c90 0x7fcc880b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc8d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc8806fad0 0x7fcc8815c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc8d000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc880b5e30 con 0x7fcc8815c180 2024-08-18T22:23:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc8d000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcc8815caa0 con 0x7fcc88071c90 2024-08-18T22:23:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc8d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcc880b6110 con 0x7fcc8806fad0 2024-08-18T22:23:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc85400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc88071c90 0x7fcc880b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc85400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc88071c90 0x7fcc880b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51920/0 (socket says 172.21.15.5:51920) 2024-08-18T22:23:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc85400640 1 -- 172.21.15.5:0/2994601859 learned_addr learned my addr 172.21.15.5:0/2994601859 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc86800640 1 --2- 172.21.15.5:0/2994601859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc8806fad0 0x7fcc8815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc85400640 1 -- 172.21.15.5:0/2994601859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc8806fad0 msgr2=0x7fcc8815c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc85400640 1 --2- 172.21.15.5:0/2994601859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc8806fad0 0x7fcc8815c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc85400640 1 -- 172.21.15.5:0/2994601859 >> v1:172.21.15.117:6789/0 conn(0x7fcc8815c180 legacy=0x7fcc88071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.294+0000 7fcc85400640 1 -- 172.21.15.5:0/2994601859 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc880b63f0 con 0x7fcc88071c90 2024-08-18T22:23:31.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc85400640 1 --2- 172.21.15.5:0/2994601859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88071c90 0x7fcc880b57c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009870 tx=0x7fcc7401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49aa53faf43709b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:31.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc84a00640 1 -- 172.21.15.5:0/2994601859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc740b1070 con 0x7fcc88071c90 2024-08-18T22:23:31.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc84a00640 1 -- 172.21.15.5:0/2994601859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc740ac630 con 0x7fcc88071c90 2024-08-18T22:23:31.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc84a00640 1 -- 172.21.15.5:0/2994601859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc740a8050 con 0x7fcc88071c90 2024-08-18T22:23:31.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc8d000640 1 -- 172.21.15.5:0/2994601859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88071c90 msgr2=0x7fcc880b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc8d000640 1 --2- 172.21.15.5:0/2994601859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88071c90 0x7fcc880b57c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009870 tx=0x7fcc7401c410 comp rx=0 tx=0).stop 2024-08-18T22:23:31.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc8d000640 1 -- 172.21.15.5:0/2994601859 shutdown_connections 2024-08-18T22:23:31.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc8d000640 1 --2- 172.21.15.5:0/2994601859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc8806fad0 0x7fcc8815c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc8d000640 1 --2- 172.21.15.5:0/2994601859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88071c90 0x7fcc880b57c0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc8d000640 1 -- 172.21.15.5:0/2994601859 >> 172.21.15.5:0/2994601859 conn(0x7fcc880b3eb0 msgr2=0x7fcc880b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:31.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc8d000640 1 -- 172.21.15.5:0/2994601859 shutdown_connections 2024-08-18T22:23:31.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc8d000640 1 -- 172.21.15.5:0/2994601859 wait complete. 2024-08-18T22:23:31.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc8d000640 1 Processor -- start 2024-08-18T22:23:31.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.298+0000 7fcc8d000640 1 -- start start 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc8d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc8806fad0 0x7fcc88148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc8d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88071c90 0x7fcc881665a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc8d000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc8815c180 0x7fcc8815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc8d000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcc880d1c30 con 0x7fcc88071c90 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc8d000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcc880d1ab0 con 0x7fcc8815c180 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc8d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcc880d1db0 con 0x7fcc8806fad0 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc85400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88071c90 0x7fcc881665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc85400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88071c90 0x7fcc881665a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51922/0 (socket says 172.21.15.5:51922) 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc85400640 1 -- 172.21.15.5:0/437833100 learned_addr learned my addr 172.21.15.5:0/437833100 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc86800640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc8815c180 0x7fcc8815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc85e00640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc8806fad0 0x7fcc88148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc85400640 1 -- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc8806fad0 msgr2=0x7fcc88148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc85400640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc8806fad0 0x7fcc88148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc85400640 1 -- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc8815c180 msgr2=0x7fcc8815a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc85400640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc8815c180 0x7fcc8815a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc85400640 1 -- 172.21.15.5:0/437833100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc88165210 con 0x7fcc88071c90 2024-08-18T22:23:31.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc85400640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88071c90 0x7fcc881665a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fcc740af040 tx=0x7fcc740191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:31.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc7e000640 1 -- 172.21.15.5:0/437833100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc740bc070 con 0x7fcc88071c90 2024-08-18T22:23:31.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc7e000640 1 -- 172.21.15.5:0/437833100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc740ab5e0 con 0x7fcc88071c90 2024-08-18T22:23:31.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc7e000640 1 -- 172.21.15.5:0/437833100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc740b1070 con 0x7fcc88071c90 2024-08-18T22:23:31.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc8d000640 1 -- 172.21.15.5:0/437833100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc881654f0 con 0x7fcc88071c90 2024-08-18T22:23:31.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc8d000640 1 -- 172.21.15.5:0/437833100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc88165ab0 con 0x7fcc88071c90 2024-08-18T22:23:31.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc8d000640 1 -- 172.21.15.5:0/437833100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc8815c560 con 0x7fcc88071c90 2024-08-18T22:23:31.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.302+0000 7fcc7e000640 1 -- 172.21.15.5:0/437833100 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc740ab9d0 con 0x7fcc88071c90 2024-08-18T22:23:31.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.306+0000 7fcc7e000640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc680678c0 0x7fcc68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.306+0000 7fcc7e000640 1 -- 172.21.15.5:0/437833100 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7fcc7411f940 con 0x7fcc88071c90 2024-08-18T22:23:31.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.306+0000 7fcc85e00640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc680678c0 0x7fcc68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.306+0000 7fcc85e00640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc680678c0 0x7fcc68069d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcc8815f250 tx=0x7fcc78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:31.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.310+0000 7fcc7e000640 1 -- 172.21.15.5:0/437833100 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcc74016150 con 0x7fcc88071c90 2024-08-18T22:23:31.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.506+0000 7fcc8d000640 1 -- 172.21.15.5:0/437833100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc880cf7d0 con 0x7fcc88071c90 2024-08-18T22:23:31.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.506+0000 7fcc7e000640 1 -- 172.21.15.5:0/437833100 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7fcc740f0200 con 0x7fcc88071c90 2024-08-18T22:23:31.511 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:31.511 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":47,"btime":"2024-08-18T22:23:28:785339+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3998000168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3998000168},{"type":"v1","addr":"172.21.15.117:6837","nonce":3998000168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1741701025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1741701025},{"type":"v1","addr":"172.21.15.117:6835","nonce":1741701025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/188037311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":188037311},{"type":"v1","addr":"172.21.15.5:6835","nonce":188037311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:28.785328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/1715051733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1715051733},{"type":"v1","addr":"172.21.15.5:6833","nonce":1715051733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6543,"qdb_cluster":[6543]},"id":4}]} 2024-08-18T22:23:31.511 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 47 2024-08-18T22:23:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.506+0000 7fcc8d000640 1 -- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc680678c0 msgr2=0x7fcc68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.506+0000 7fcc8d000640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc680678c0 0x7fcc68069d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcc8815f250 tx=0x7fcc78009040 comp rx=0 tx=0).stop 2024-08-18T22:23:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.506+0000 7fcc8d000640 1 -- 172.21.15.5:0/437833100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88071c90 msgr2=0x7fcc881665a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.506+0000 7fcc8d000640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88071c90 0x7fcc881665a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fcc740af040 tx=0x7fcc740191b0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.510+0000 7fcc8d000640 1 -- 172.21.15.5:0/437833100 shutdown_connections 2024-08-18T22:23:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.510+0000 7fcc8d000640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcc680678c0 0x7fcc68069d80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.510+0000 7fcc8d000640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc8815c180 0x7fcc8815a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.510+0000 7fcc8d000640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc88071c90 0x7fcc881665a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.510+0000 7fcc8d000640 1 --2- 172.21.15.5:0/437833100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc8806fad0 0x7fcc88148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.510+0000 7fcc8d000640 1 -- 172.21.15.5:0/437833100 >> 172.21.15.5:0/437833100 conn(0x7fcc880b3eb0 msgr2=0x7fcc880b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.510+0000 7fcc8d000640 1 -- 172.21.15.5:0/437833100 shutdown_connections 2024-08-18T22:23:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.510+0000 7fcc8d000640 1 -- 172.21.15.5:0/437833100 wait complete. 2024-08-18T22:23:31.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-08-18T22:23:31.695 INFO:teuthology.orchestra.run.smithi005.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-08-18T22:23:23.006807+0000","btime":"2024-08-18T22:23:22.122816+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-08-18T22:23:23.006807+0000","atime":"2024-08-18T22:23:22.122816+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-08-18T22:23:23.006807+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:23:23.006807+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:23:23.006807+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-08-18T22:23:31.695 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-08-18T22:23:23.006807+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-08-18T22:23:22.122816+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-08-18T22:23:22.122816+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-08-18T22:23:23.006807+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-08-18T22:23:23.006807+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-08-18T22:23:23.006807+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-08-18T22:23:23.006807+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-08-18T22:23:31.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:23:31.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /testdir recursive 2024-08-18T22:23:31.779 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-08-18T22:23:31.770+0000 7fa23fc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:23:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f4195e00640 1 Processor -- start 2024-08-18T22:23:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f4195e00640 1 -- start start 2024-08-18T22:23:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f4195e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41900b59d0 0x7f41900d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f4195e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41900d2b10 0x7f41900b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f4195e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419015eee0 con 0x7f4190147c60 2024-08-18T22:23:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f4195e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f419015f1c0 con 0x7f41900b59d0 2024-08-18T22:23:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f4195e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f419015f4a0 con 0x7f41900d2b10 2024-08-18T22:23:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f418fe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41900b59d0 0x7f41900d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f418fe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41900b59d0 0x7f41900d25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:55870/0 (socket says 172.21.15.5:55870) 2024-08-18T22:23:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f418fe00640 1 -- 172.21.15.5:0/2237171815 learned_addr learned my addr 172.21.15.5:0/2237171815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f4194a00640 1 --1- 172.21.15.5:0/2237171815 >> v1:172.21.15.117:6789/0 conn(0x7f4190147c60 0x7f419015e640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:33072/0 (socket says 172.21.15.5:33072) 2024-08-18T22:23:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f4195400640 1 --2- 172.21.15.5:0/2237171815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41900d2b10 0x7f41900b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f418fe00640 1 -- 172.21.15.5:0/2237171815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41900d2b10 msgr2=0x7f41900b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f418fe00640 1 --2- 172.21.15.5:0/2237171815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41900d2b10 0x7f41900b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f418fe00640 1 -- 172.21.15.5:0/2237171815 >> v1:172.21.15.117:6789/0 conn(0x7f4190147c60 legacy=0x7f419015e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f418fe00640 1 -- 172.21.15.5:0/2237171815 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41900d1dd0 con 0x7f41900b59d0 2024-08-18T22:23:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f418f400640 1 -- 172.21.15.5:0/2237171815 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3039081623 0 0) 0x7f419015eee0 con 0x7f4190147c60 2024-08-18T22:23:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.838+0000 7f4195400640 1 --2- 172.21.15.5:0/2237171815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41900d2b10 0x7f41900b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f418fe00640 1 --2- 172.21.15.5:0/2237171815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41900b59d0 0x7f41900d25d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f417c009870 tx=0x7f417c01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4548c1b8c22ab67f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f418f400640 1 -- 172.21.15.5:0/2237171815 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0ab640 con 0x7f41900b59d0 2024-08-18T22:23:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f418f400640 1 -- 172.21.15.5:0/2237171815 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c0b0070 con 0x7f41900b59d0 2024-08-18T22:23:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f418f400640 1 -- 172.21.15.5:0/2237171815 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0aba00 con 0x7f41900b59d0 2024-08-18T22:23:31.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f4195e00640 1 -- 172.21.15.5:0/2237171815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41900b59d0 msgr2=0x7f41900d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f4195e00640 1 --2- 172.21.15.5:0/2237171815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41900b59d0 0x7f41900d25d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f417c009870 tx=0x7f417c01c530 comp rx=0 tx=0).stop 2024-08-18T22:23:31.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f4195e00640 1 -- 172.21.15.5:0/2237171815 shutdown_connections 2024-08-18T22:23:31.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f4195e00640 1 --2- 172.21.15.5:0/2237171815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41900d2b10 0x7f41900b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f4195e00640 1 --2- 172.21.15.5:0/2237171815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41900b59d0 0x7f41900d25d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f4195e00640 1 -- 172.21.15.5:0/2237171815 >> 172.21.15.5:0/2237171815 conn(0x7f4190067840 msgr2=0x7f4190067c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f4195e00640 1 -- 172.21.15.5:0/2237171815 shutdown_connections 2024-08-18T22:23:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f4195e00640 1 -- 172.21.15.5:0/2237171815 wait complete. 2024-08-18T22:23:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f4195e00640 1 Processor -- start 2024-08-18T22:23:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.842+0000 7f4195e00640 1 -- start start 2024-08-18T22:23:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41900b59d0 0x7f4190143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41900d2b10 0x7f419013c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4190147c60 0x7f419015f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f419016b130 con 0x7f4190147c60 2024-08-18T22:23:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f419016afb0 con 0x7f41900d2b10 2024-08-18T22:23:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f419016b2b0 con 0x7f41900b59d0 2024-08-18T22:23:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4190147c60 0x7f419015f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4190147c60 0x7f419015f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51930/0 (socket says 172.21.15.5:51930) 2024-08-18T22:23:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195400640 1 -- 172.21.15.5:0/1170572584 learned_addr learned my addr 172.21.15.5:0/1170572584 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f418fe00640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41900d2b10 0x7f419013c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4194a00640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41900b59d0 0x7f4190143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195400640 1 -- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41900b59d0 msgr2=0x7f4190143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195400640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41900b59d0 0x7f4190143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195400640 1 -- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41900d2b10 msgr2=0x7f419013c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195400640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41900d2b10 0x7f419013c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195400640 1 -- 172.21.15.5:0/1170572584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4190161930 con 0x7f4190147c60 2024-08-18T22:23:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195400640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4190147c60 0x7f419015f7e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f418800efc0 tx=0x7f418800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f418cc00640 1 -- 172.21.15.5:0/1170572584 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188018020 con 0x7f4190147c60 2024-08-18T22:23:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f418cc00640 1 -- 172.21.15.5:0/1170572584 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4188014480 con 0x7f4190147c60 2024-08-18T22:23:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195e00640 1 -- 172.21.15.5:0/1170572584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4190144e70 con 0x7f4190147c60 2024-08-18T22:23:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f418cc00640 1 -- 172.21.15.5:0/1170572584 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188014870 con 0x7f4190147c60 2024-08-18T22:23:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.846+0000 7f4195e00640 1 -- 172.21.15.5:0/1170572584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41901434d0 con 0x7f4190147c60 2024-08-18T22:23:31.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f418cc00640 1 -- 172.21.15.5:0/1170572584 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f418801b020 con 0x7f4190147c60 2024-08-18T22:23:31.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f418cc00640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41700678c0 0x7f4170069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f418cc00640 1 -- 172.21.15.5:0/1170572584 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f4188086ad0 con 0x7f4190147c60 2024-08-18T22:23:31.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f4194a00640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41700678c0 0x7f4170069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f419a8af000 1 Processor -- start 2024-08-18T22:23:31.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f419a8af000 1 -- start start 2024-08-18T22:23:31.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f4194a00640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41700678c0 0x7f4170069d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4184000f70 tx=0x7f4184007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f419a8af000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x5585359677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f419a8af000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 0x55853591dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f419a8af000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55853591e2c0 0x55853591e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f419a8af000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558535825c80 con 0x5585359673f0 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f419a8af000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558535804c30 con 0x558535967d10 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f419a8af000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55853576b2b0 con 0x55853591e2c0 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f4194a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x5585359677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f4194a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x5585359677d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51932/0 (socket says 172.21.15.5:51932) 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f4194a00640 1 -- 172.21.15.5:0/2794195026 learned_addr learned my addr 172.21.15.5:0/2794195026 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f418fe00640 1 --2- 172.21.15.5:0/2794195026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 0x55853591dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f4195400640 1 --2- 172.21.15.5:0/2794195026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55853591e2c0 0x55853591e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f4194a00640 1 -- 172.21.15.5:0/2794195026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55853591e2c0 msgr2=0x55853591e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f4194a00640 1 --2- 172.21.15.5:0/2794195026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55853591e2c0 0x55853591e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.850+0000 7f4194a00640 1 -- 172.21.15.5:0/2794195026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 msgr2=0x55853591dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f4194a00640 1 --2- 172.21.15.5:0/2794195026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 0x55853591dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f4194a00640 1 -- 172.21.15.5:0/2794195026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558535814070 con 0x5585359673f0 2024-08-18T22:23:31.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f4194a00640 1 --2- 172.21.15.5:0/2794195026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x5585359677d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4184005d10 tx=0x7f4184012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210fda072b27403c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f4181600640 1 -- 172.21.15.5:0/2794195026 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184015110 con 0x5585359673f0 2024-08-18T22:23:31.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f4181600640 1 -- 172.21.15.5:0/2794195026 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41840159c0 con 0x5585359673f0 2024-08-18T22:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f4181600640 1 -- 172.21.15.5:0/2794195026 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184015d70 con 0x5585359673f0 2024-08-18T22:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 -- 172.21.15.5:0/2794195026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 msgr2=0x5585359677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 --2- 172.21.15.5:0/2794195026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x5585359677d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4184005d10 tx=0x7f4184012000 comp rx=0 tx=0).stop 2024-08-18T22:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 -- 172.21.15.5:0/2794195026 shutdown_connections 2024-08-18T22:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 --2- 172.21.15.5:0/2794195026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55853591e2c0 0x55853591e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 --2- 172.21.15.5:0/2794195026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 0x55853591dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 --2- 172.21.15.5:0/2794195026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x5585359677d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 -- 172.21.15.5:0/2794195026 >> 172.21.15.5:0/2794195026 conn(0x55853591a270 msgr2=0x55853591c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:31.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 -- 172.21.15.5:0/2794195026 shutdown_connections 2024-08-18T22:23:31.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 -- 172.21.15.5:0/2794195026 wait complete. 2024-08-18T22:23:31.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 -- start start 2024-08-18T22:23:31.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 Processor -- start 2024-08-18T22:23:31.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55853591e2c0 0x558535966d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x558535929400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 0x558535929940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558535767270 con 0x5585359673f0 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5585357259b0 con 0x558535967d10 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55853570cd10 con 0x55853591e2c0 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f419a8af000 10 client.0 _ll_register_callbacks cb 0x558535748d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f418fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x558535929400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f418fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x558535929400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51936/0 (socket says 172.21.15.5:51936) 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f418fe00640 1 -- 172.21.15.5:0/1352213075 learned_addr learned my addr 172.21.15.5:0/1352213075 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f4194a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55853591e2c0 0x558535966d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f4195400640 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 0x558535929940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f418fe00640 1 -- 172.21.15.5:0/1352213075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55853591e2c0 msgr2=0x558535966d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:31.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.854+0000 7f418fe00640 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55853591e2c0 0x558535966d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f418fe00640 1 -- 172.21.15.5:0/1352213075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 msgr2=0x558535929940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f418fe00640 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 0x558535929940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f418fe00640 1 -- 172.21.15.5:0/1352213075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585357483b0 con 0x5585359673f0 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f418fe00640 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x558535929400 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f417c009870 tx=0x7f417c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de2cbf3b1ed30d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4176000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4176000640 1 -- 172.21.15.5:0/1352213075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c0aba90 con 0x5585359673f0 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4176000640 1 -- 172.21.15.5:0/1352213075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f417c0c0cb0 con 0x5585359673f0 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 -- 172.21.15.5:0/1352213075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41840159c0 con 0x5585359673f0 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4176000640 1 -- 172.21.15.5:0/1352213075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f417c0abc30 con 0x5585359673f0 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 10 client.6618 fetch_fsmap learned FSMap version 47 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 -- 172.21.15.5:0/1352213075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x5585357b1860 con 0x5585359673f0 2024-08-18T22:23:31.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4176000640 1 -- 172.21.15.5:0/1352213075 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41840159c0 con 0x5585359673f0 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4176000640 1 -- 172.21.15.5:0/1352213075 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f417c0c7050 con 0x5585359673f0 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 10 client.6618 fetch_fsmap finished waiting for FSMap version 47 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 10 client.6618 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 20 client.6618 populate_metadata read hostname 'smithi005' 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x55853592a680 0x5585359794a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 4 client.6618 mds_command: new command op to 6543 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 -- 172.21.15.5:0/1352213075 --> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558535705e30 con 0x55853592a680 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4194a00640 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x55853592a680 0x5585359794a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4194a00640 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x55853592a680 0x5585359794a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abfe6b58e87c5057 server_cookie=78fa82d6295f59d8 in_seq=0 out_seq=0 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4176000640 10 client.6618 ms_handle_connect on v2:172.21.15.5:6832/1715051733 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4176000640 1 -- 172.21.15.5:0/1352213075 <== mds.0 v2:172.21.15.5:6832/1715051733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558535705e30 con 0x55853592a680 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4176000640 10 client.6618 handle_command_reply: tid=0 2024-08-18T22:23:31.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 client.6618 shutdown 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 -- 172.21.15.5:0/1352213075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 msgr2=0x558535929400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x558535929400 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f417c009870 tx=0x7f417c0046d0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 -- 172.21.15.5:0/1352213075 shutdown_connections 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x55853592a680 0x5585359794a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 0x558535929940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5585359673f0 0x558535929400 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 --2- 172.21.15.5:0/1352213075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55853591e2c0 0x558535966d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f4176000640 0 client.6618 ms_handle_reset on v2:172.21.15.5:6832/1715051733 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 -- 172.21.15.5:0/1352213075 >> 172.21.15.5:0/1352213075 conn(0x55853591a270 msgr2=0x55853591ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 -- 172.21.15.5:0/1352213075 shutdown_connections 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 1 -- 172.21.15.5:0/1352213075 wait complete. 2024-08-18T22:23:31.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.858+0000 7f419a8af000 20 client.6618 trim_cache size 0 max 16384 2024-08-18T22:23:31.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 Processor -- start 2024-08-18T22:23:31.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 -- start start 2024-08-18T22:23:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55853591e2c0 0x55853597cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585359673f0 0x55853591d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 0x55853591dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f41902040f0 con 0x55853591e2c0 2024-08-18T22:23:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4190203100 con 0x558535967d10 2024-08-18T22:23:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4190146000 con 0x5585359673f0 2024-08-18T22:23:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4194a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55853591e2c0 0x55853597cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4194a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55853591e2c0 0x55853597cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51940/0 (socket says 172.21.15.5:51940) 2024-08-18T22:23:31.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4194a00640 1 -- 172.21.15.5:0/2499157645 learned_addr learned my addr 172.21.15.5:0/2499157645 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4194a00640 1 -- 172.21.15.5:0/2499157645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585359673f0 msgr2=0x55853591d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4194a00640 1 --2- 172.21.15.5:0/2499157645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585359673f0 0x55853591d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4194a00640 1 -- 172.21.15.5:0/2499157645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 msgr2=0x55853591dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4194a00640 1 --2- 172.21.15.5:0/2499157645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 0x55853591dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4194a00640 1 -- 172.21.15.5:0/2499157645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55853570bab0 con 0x55853591e2c0 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4194a00640 1 --2- 172.21.15.5:0/2499157645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55853591e2c0 0x55853597cb00 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f41840011f0 tx=0x7f4184013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55287dffd62fc9f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4180c00640 1 -- 172.21.15.5:0/2499157645 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184015a00 con 0x55853591e2c0 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4180c00640 1 -- 172.21.15.5:0/2499157645 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4184015ba0 con 0x55853591e2c0 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f4180c00640 1 -- 172.21.15.5:0/2499157645 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184021450 con 0x55853591e2c0 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 -- 172.21.15.5:0/2499157645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55853591e2c0 msgr2=0x55853597cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 --2- 172.21.15.5:0/2499157645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55853591e2c0 0x55853597cb00 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f41840011f0 tx=0x7f4184013000 comp rx=0 tx=0).stop 2024-08-18T22:23:31.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 -- 172.21.15.5:0/2499157645 shutdown_connections 2024-08-18T22:23:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 --2- 172.21.15.5:0/2499157645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558535967d10 0x55853591dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 --2- 172.21.15.5:0/2499157645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585359673f0 0x55853591d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 --2- 172.21.15.5:0/2499157645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55853591e2c0 0x55853597cb00 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 -- 172.21.15.5:0/2499157645 >> 172.21.15.5:0/2499157645 conn(0x55853591a270 msgr2=0x558535928bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 -- 172.21.15.5:0/2499157645 shutdown_connections 2024-08-18T22:23:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.878+0000 7f419a8af000 1 -- 172.21.15.5:0/2499157645 wait complete. 2024-08-18T22:23:31.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 -- start start 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 Processor -- start 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853591e2c0 0x5585359dac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585359673f0 0x5585359db170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558535967d10 0x5585359db6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5585357edab0 con 0x558535967d10 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55853576f8e0 con 0x55853591e2c0 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558535733180 con 0x5585359673f0 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 10 client.0 _ll_register_callbacks cb 0x7f41880095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4195400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558535967d10 0x5585359db6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4195400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558535967d10 0x5585359db6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51952/0 (socket says 172.21.15.5:51952) 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4195400640 1 -- 172.21.15.5:0/498915522 learned_addr learned my addr 172.21.15.5:0/498915522 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:31.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4194a00640 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853591e2c0 0x5585359dac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f418fe00640 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585359673f0 0x5585359db170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4195400640 1 -- 172.21.15.5:0/498915522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585359673f0 msgr2=0x5585359db170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4195400640 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585359673f0 0x5585359db170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4195400640 1 -- 172.21.15.5:0/498915522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853591e2c0 msgr2=0x5585359dac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4195400640 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853591e2c0 0x5585359dac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4195400640 1 -- 172.21.15.5:0/498915522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585357edf40 con 0x558535967d10 2024-08-18T22:23:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4194a00640 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853591e2c0 0x5585359dac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:31.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4195400640 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558535967d10 0x5585359db6b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4188056cb0 tx=0x7f418805b190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dfb0e3362de24d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4176000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:23:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4176000640 1 -- 172.21.15.5:0/498915522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188072070 con 0x558535967d10 2024-08-18T22:23:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4176000640 1 -- 172.21.15.5:0/498915522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f4188056170 con 0x558535967d10 2024-08-18T22:23:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 -- 172.21.15.5:0/498915522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4184015ba0 con 0x558535967d10 2024-08-18T22:23:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4176000640 1 -- 172.21.15.5:0/498915522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f4188075360 con 0x558535967d10 2024-08-18T22:23:31.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 10 client.6624 fetch_fsmap learned FSMap version 47 2024-08-18T22:23:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 -- 172.21.15.5:0/498915522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x5585357c4a20 con 0x558535967d10 2024-08-18T22:23:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4176000640 1 -- 172.21.15.5:0/498915522 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4184015ba0 con 0x558535967d10 2024-08-18T22:23:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4176000640 1 -- 172.21.15.5:0/498915522 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f4188024b80 con 0x558535967d10 2024-08-18T22:23:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 10 client.6624 fetch_fsmap finished waiting for FSMap version 47 2024-08-18T22:23:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 10 client.6624 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-08-18T22:23:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 20 client.6624 populate_metadata read hostname 'smithi005' 2024-08-18T22:23:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x55853597bef0 0x55853597c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 4 client.6624 mds_command: new command op to 6543 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-08-18T22:23:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f419a8af000 1 -- 172.21.15.5:0/498915522 --> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x5585357789e0 con 0x55853597bef0 2024-08-18T22:23:31.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.882+0000 7f4194a00640 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x55853597bef0 0x55853597c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4194a00640 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x55853597bef0 0x55853597c300 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77c2b91343003d3a server_cookie=e0cb3192751dc2eb in_seq=0 out_seq=0 2024-08-18T22:23:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4176000640 10 client.6624 ms_handle_connect on v2:172.21.15.5:6832/1715051733 2024-08-18T22:23:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4176000640 1 -- 172.21.15.5:0/498915522 <== mds.0 v2:172.21.15.5:6832/1715051733 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5585357789e0 con 0x55853597bef0 2024-08-18T22:23:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4176000640 10 client.6624 handle_command_reply: tid=0 2024-08-18T22:23:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 1 client.6624 shutdown 2024-08-18T22:23:31.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 1 -- 172.21.15.5:0/498915522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558535967d10 msgr2=0x5585359db6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558535967d10 0x5585359db6b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4188056cb0 tx=0x7f418805b190 comp rx=0 tx=0).stop 2024-08-18T22:23:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 1 -- 172.21.15.5:0/498915522 shutdown_connections 2024-08-18T22:23:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.5:6832/1715051733,v1:172.21.15.5:6833/1715051733] conn(0x55853597bef0 0x55853597c300 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558535967d10 0x5585359db6b0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5585359673f0 0x5585359db170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4176000640 0 client.6624 ms_handle_reset on v2:172.21.15.5:6832/1715051733 2024-08-18T22:23:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 1 --2- 172.21.15.5:0/498915522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55853591e2c0 0x5585359dac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 1 -- 172.21.15.5:0/498915522 >> 172.21.15.5:0/498915522 conn(0x55853591a270 msgr2=0x55853591d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 1 -- 172.21.15.5:0/498915522 shutdown_connections 2024-08-18T22:23:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 1 -- 172.21.15.5:0/498915522 wait complete. 2024-08-18T22:23:31.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f419a8af000 20 client.6624 trim_cache size 0 max 16384 2024-08-18T22:23:31.896 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:23:31.896 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:23:31.896 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "4918b44b-affd-48c3-9709-68e90fb29d6e", 2024-08-18T22:23:31.896 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:23:31.896 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:23:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 -- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41700678c0 msgr2=0x7f4170069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41700678c0 0x7f4170069d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4184000f70 tx=0x7f4184007b60 comp rx=0 tx=0).stop 2024-08-18T22:23:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 -- 172.21.15.5:0/1170572584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4190147c60 msgr2=0x7f419015f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4190147c60 0x7f419015f7e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f418800efc0 tx=0x7f418800c490 comp rx=0 tx=0).stop 2024-08-18T22:23:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 -- 172.21.15.5:0/1170572584 shutdown_connections 2024-08-18T22:23:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41700678c0 0x7f4170069d80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4190147c60 0x7f419015f7e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41900d2b10 0x7f419013c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 --2- 172.21.15.5:0/1170572584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41900b59d0 0x7f4190143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 -- 172.21.15.5:0/1170572584 >> 172.21.15.5:0/1170572584 conn(0x7f4190067840 msgr2=0x7f419006db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 -- 172.21.15.5:0/1170572584 shutdown_connections 2024-08-18T22:23:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:31.886+0000 7f4195e00640 1 -- 172.21.15.5:0/1170572584 wait complete. 2024-08-18T22:23:31.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8614000640 1 Processor -- start 2024-08-18T22:23:32.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8614000640 1 -- start start 2024-08-18T22:23:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8614000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f860c0b54c0 0x7f860c071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8614000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f860c0cbed0 0x7f860c0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8614000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860c071c80 con 0x7f860c06dd80 2024-08-18T22:23:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8614000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f860c0cba40 con 0x7f860c0cbed0 2024-08-18T22:23:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8614000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f860c071f60 con 0x7f860c0b54c0 2024-08-18T22:23:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8612000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f860c0cbed0 0x7f860c0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8612000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f860c0cbed0 0x7f860c0cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51964/0 (socket says 172.21.15.5:51964) 2024-08-18T22:23:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8612000640 1 -- 172.21.15.5:0/2911757469 learned_addr learned my addr 172.21.15.5:0/2911757469 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8611600640 1 --2- 172.21.15.5:0/2911757469 >> v2:172.21.15.117:3300/0 conn(0x7f860c0b54c0 0x7f860c071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8612000640 1 -- 172.21.15.5:0/2911757469 >> v2:172.21.15.117:3300/0 conn(0x7f860c0b54c0 msgr2=0x7f860c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8612000640 1 --2- 172.21.15.5:0/2911757469 >> v2:172.21.15.117:3300/0 conn(0x7f860c0b54c0 0x7f860c071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8612000640 1 -- 172.21.15.5:0/2911757469 >> v1:172.21.15.117:6789/0 conn(0x7f860c06dd80 legacy=0x7f860c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:32.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.050+0000 7f8612000640 1 -- 172.21.15.5:0/2911757469 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c0cb6d0 con 0x7f860c0cbed0 2024-08-18T22:23:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f8612000640 1 --2- 172.21.15.5:0/2911757469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c0cbed0 0x7f860c0cc360 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f860c0502d0 tx=0x7f860401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f23fe8e2bac4b5a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f860be00640 1 -- 172.21.15.5:0/2911757469 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86040b5070 con 0x7f860c0cbed0 2024-08-18T22:23:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f860be00640 1 -- 172.21.15.5:0/2911757469 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86040a89d0 con 0x7f860c0cbed0 2024-08-18T22:23:32.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f860be00640 1 -- 172.21.15.5:0/2911757469 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86040a8da0 con 0x7f860c0cbed0 2024-08-18T22:23:32.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f8614000640 1 -- 172.21.15.5:0/2911757469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c0cbed0 msgr2=0x7f860c0cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:32.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f8614000640 1 --2- 172.21.15.5:0/2911757469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c0cbed0 0x7f860c0cc360 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f860c0502d0 tx=0x7f860401ecd0 comp rx=0 tx=0).stop 2024-08-18T22:23:32.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f8614000640 1 -- 172.21.15.5:0/2911757469 shutdown_connections 2024-08-18T22:23:32.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f8614000640 1 --2- 172.21.15.5:0/2911757469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c0cbed0 0x7f860c0cc360 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:32.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f8614000640 1 --2- 172.21.15.5:0/2911757469 >> v2:172.21.15.117:3300/0 conn(0x7f860c0b54c0 0x7f860c071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:32.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f8614000640 1 -- 172.21.15.5:0/2911757469 >> 172.21.15.5:0/2911757469 conn(0x7f860c0b3eb0 msgr2=0x7f860c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:32.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f8614000640 1 -- 172.21.15.5:0/2911757469 shutdown_connections 2024-08-18T22:23:32.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.054+0000 7f8614000640 1 -- 172.21.15.5:0/2911757469 wait complete. 2024-08-18T22:23:32.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8614000640 1 Processor -- start 2024-08-18T22:23:32.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8614000640 1 -- start start 2024-08-18T22:23:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8614000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f860c06dd80 0x7f860c161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8614000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f860c0b54c0 0x7f860c0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8614000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c0cbed0 0x7f860c1437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8614000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f860c1481a0 con 0x7f860c0cbed0 2024-08-18T22:23:32.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8614000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f860c148020 con 0x7f860c0b54c0 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8614000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f860c0cc8a0 con 0x7f860c06dd80 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8612000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c0cbed0 0x7f860c1437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8612000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c0cbed0 0x7f860c1437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51978/0 (socket says 172.21.15.5:51978) 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8612000640 1 -- 172.21.15.5:0/2112925361 learned_addr learned my addr 172.21.15.5:0/2112925361 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8611600640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f860c06dd80 0x7f860c161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8610c00640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f860c0b54c0 0x7f860c0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8612000640 1 -- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f860c06dd80 msgr2=0x7f860c161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8612000640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f860c06dd80 0x7f860c161330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8612000640 1 -- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f860c0b54c0 msgr2=0x7f860c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8612000640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f860c0b54c0 0x7f860c0d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8612000640 1 -- 172.21.15.5:0/2112925361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c1442c0 con 0x7f860c0cbed0 2024-08-18T22:23:32.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8612000640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c0cbed0 0x7f860c1437e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f86040b3040 tx=0x7f860401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8609600640 1 -- 172.21.15.5:0/2112925361 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86040b5070 con 0x7f860c0cbed0 2024-08-18T22:23:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8609600640 1 -- 172.21.15.5:0/2112925361 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86040b09f0 con 0x7f860c0cbed0 2024-08-18T22:23:32.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8609600640 1 -- 172.21.15.5:0/2112925361 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86040b0de0 con 0x7f860c0cbed0 2024-08-18T22:23:32.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8614000640 1 -- 172.21.15.5:0/2112925361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f860c161950 con 0x7f860c0cbed0 2024-08-18T22:23:32.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.058+0000 7f8614000640 1 -- 172.21.15.5:0/2112925361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f860c15fdf0 con 0x7f860c0cbed0 2024-08-18T22:23:32.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.062+0000 7f8614000640 1 -- 172.21.15.5:0/2112925361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f860c0cc360 con 0x7f860c0cbed0 2024-08-18T22:23:32.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.062+0000 7f8609600640 1 -- 172.21.15.5:0/2112925361 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86040c2060 con 0x7f860c0cbed0 2024-08-18T22:23:32.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.062+0000 7f8609600640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85ec0678f0 0x7f85ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:32.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.062+0000 7f8609600640 1 -- 172.21.15.5:0/2112925361 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f8604122cc0 con 0x7f860c0cbed0 2024-08-18T22:23:32.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.062+0000 7f8611600640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85ec0678f0 0x7f85ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:32.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.062+0000 7f8611600640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85ec0678f0 0x7f85ec069db0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f860c145020 tx=0x7f86000098a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:32.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.066+0000 7f8609600640 1 -- 172.21.15.5:0/2112925361 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f860c1442c0 con 0x7f860c0cbed0 2024-08-18T22:23:32.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 -- 172.21.15.5:0/2112925361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f860c15e510 con 0x7f860c0cbed0 2024-08-18T22:23:32.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8609600640 1 -- 172.21.15.5:0/2112925361 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f8604018830 con 0x7f860c0cbed0 2024-08-18T22:23:32.274 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:32.274 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":47,"btime":"2024-08-18T22:23:28:785339+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3998000168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3998000168},{"type":"v1","addr":"172.21.15.117:6837","nonce":3998000168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1741701025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1741701025},{"type":"v1","addr":"172.21.15.117:6835","nonce":1741701025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/188037311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":188037311},{"type":"v1","addr":"172.21.15.5:6835","nonce":188037311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:28.785328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/1715051733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1715051733},{"type":"v1","addr":"172.21.15.5:6833","nonce":1715051733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6543,"qdb_cluster":[6543]},"id":4}]} 2024-08-18T22:23:32.274 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 47 2024-08-18T22:23:32.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 -- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85ec0678f0 msgr2=0x7f85ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:32.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85ec0678f0 0x7f85ec069db0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f860c145020 tx=0x7f86000098a0 comp rx=0 tx=0).stop 2024-08-18T22:23:32.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 -- 172.21.15.5:0/2112925361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c0cbed0 msgr2=0x7f860c1437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:32.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c0cbed0 0x7f860c1437e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f86040b3040 tx=0x7f860401ba70 comp rx=0 tx=0).stop 2024-08-18T22:23:32.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 -- 172.21.15.5:0/2112925361 shutdown_connections 2024-08-18T22:23:32.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85ec0678f0 0x7f85ec069db0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:32.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860c0cbed0 0x7f860c1437e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:32.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f860c0b54c0 0x7f860c0d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:32.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 --2- 172.21.15.5:0/2112925361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f860c06dd80 0x7f860c161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:32.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 -- 172.21.15.5:0/2112925361 >> 172.21.15.5:0/2112925361 conn(0x7f860c0b3eb0 msgr2=0x7f860c1447d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:32.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 -- 172.21.15.5:0/2112925361 shutdown_connections 2024-08-18T22:23:32.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:32.270+0000 7f8614000640 1 -- 172.21.15.5:0/2112925361 wait complete. 2024-08-18T22:23:32.294 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-08-18T22:23:32.456 INFO:teuthology.orchestra.run.smithi005.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-08-18T22:23:23.006807+0000","btime":"2024-08-18T22:23:22.122816+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-08-18T22:23:23.006807+0000","atime":"2024-08-18T22:23:22.122816+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-08-18T22:23:23.006807+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:23:23.006807+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:23:23.006807+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":2,"authpin":0,"scrubqueue":0},"nref":2,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-08-18T22:23:32.457 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-08-18T22:23:23.006807+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-08-18T22:23:22.122816+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-08-18T22:23:22.122816+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-08-18T22:23:23.006807+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-08-18T22:23:23.006807+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-08-18T22:23:23.006807+0000", "nestlock": {}, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-08-18T22:23:23.006807+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-08-18T22:23:32.457 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-08-18T22:23:37.459 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:37.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.606+0000 7f7c2fe00640 1 Processor -- start 2024-08-18T22:23:37.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.606+0000 7f7c2fe00640 1 -- start start 2024-08-18T22:23:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c2815bed0 0x7f7c280735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c280cb390 0x7f7c28071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2fe00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c28072060 con 0x7f7c2806da70 2024-08-18T22:23:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2fe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7c28073c80 con 0x7f7c280cb390 2024-08-18T22:23:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2fe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7c280ca5d0 con 0x7f7c2815bed0 2024-08-18T22:23:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c280cb390 0x7f7c28071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c280cb390 0x7f7c28071b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34412/0 (socket says 172.21.15.5:34412) 2024-08-18T22:23:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2ca00640 1 -- 172.21.15.5:0/1663216510 learned_addr learned my addr 172.21.15.5:0/1663216510 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:37.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2d400640 1 --2- 172.21.15.5:0/1663216510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c2815bed0 0x7f7c280735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2ca00640 1 -- 172.21.15.5:0/1663216510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c2815bed0 msgr2=0x7f7c280735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2ca00640 1 --2- 172.21.15.5:0/1663216510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c2815bed0 0x7f7c280735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2ca00640 1 -- 172.21.15.5:0/1663216510 >> v1:172.21.15.117:6789/0 conn(0x7f7c2806da70 legacy=0x7f7c280cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.610+0000 7f7c2ca00640 1 -- 172.21.15.5:0/1663216510 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c280ca8b0 con 0x7f7c280cb390 2024-08-18T22:23:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2ca00640 1 --2- 172.21.15.5:0/1663216510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c280cb390 0x7f7c28071b20 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009870 tx=0x7f7c1401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62799ed8b3a62e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c27e00640 1 -- 172.21.15.5:0/1663216510 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140a95f0 con 0x7f7c280cb390 2024-08-18T22:23:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c27e00640 1 -- 172.21.15.5:0/1663216510 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c140a9790 con 0x7f7c280cb390 2024-08-18T22:23:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c27e00640 1 -- 172.21.15.5:0/1663216510 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140a9b60 con 0x7f7c280cb390 2024-08-18T22:23:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 -- 172.21.15.5:0/1663216510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c280cb390 msgr2=0x7f7c28071b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 --2- 172.21.15.5:0/1663216510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c280cb390 0x7f7c28071b20 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009870 tx=0x7f7c1401c530 comp rx=0 tx=0).stop 2024-08-18T22:23:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 -- 172.21.15.5:0/1663216510 shutdown_connections 2024-08-18T22:23:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 --2- 172.21.15.5:0/1663216510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c280cb390 0x7f7c28071b20 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 --2- 172.21.15.5:0/1663216510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c2815bed0 0x7f7c280735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 -- 172.21.15.5:0/1663216510 >> 172.21.15.5:0/1663216510 conn(0x7f7c280b1c50 msgr2=0x7f7c280b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:37.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 -- 172.21.15.5:0/1663216510 shutdown_connections 2024-08-18T22:23:37.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 -- 172.21.15.5:0/1663216510 wait complete. 2024-08-18T22:23:37.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 Processor -- start 2024-08-18T22:23:37.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 -- start start 2024-08-18T22:23:37.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c2806da70 0x7f7c28152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:37.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.614+0000 7f7c2fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c280cb390 0x7f7c280c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:37.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c2815bed0 0x7f7c280c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:37.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2fe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2815c430 con 0x7f7c280cb390 2024-08-18T22:23:37.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2fe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2815c2b0 con 0x7f7c2806da70 2024-08-18T22:23:37.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2fe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7c28168ba0 con 0x7f7c2815bed0 2024-08-18T22:23:37.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c280cb390 0x7f7c280c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:37.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c280cb390 0x7f7c280c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34428/0 (socket says 172.21.15.5:34428) 2024-08-18T22:23:37.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2ca00640 1 -- 172.21.15.5:0/2353168604 learned_addr learned my addr 172.21.15.5:0/2353168604 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:37.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2de00640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c2815bed0 0x7f7c280c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:37.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2d400640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c2806da70 0x7f7c28152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:37.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2ca00640 1 -- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c2815bed0 msgr2=0x7f7c280c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:37.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2ca00640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c2815bed0 0x7f7c280c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:37.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2ca00640 1 -- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c2806da70 msgr2=0x7f7c28152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:37.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2ca00640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c2806da70 0x7f7c28152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:37.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2ca00640 1 -- 172.21.15.5:0/2353168604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c281539d0 con 0x7f7c280cb390 2024-08-18T22:23:37.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2ca00640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c280cb390 0x7f7c280c92d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7c140ab040 tx=0x7f7c1401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:37.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c25600640 1 -- 172.21.15.5:0/2353168604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140b1800 con 0x7f7c280cb390 2024-08-18T22:23:37.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c25600640 1 -- 172.21.15.5:0/2353168604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c140b19c0 con 0x7f7c280cb390 2024-08-18T22:23:37.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2fe00640 1 -- 172.21.15.5:0/2353168604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c280b3fa0 con 0x7f7c280cb390 2024-08-18T22:23:37.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c25600640 1 -- 172.21.15.5:0/2353168604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140b1db0 con 0x7f7c280cb390 2024-08-18T22:23:37.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2fe00640 1 -- 172.21.15.5:0/2353168604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c280b4560 con 0x7f7c280cb390 2024-08-18T22:23:37.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c2fe00640 1 -- 172.21.15.5:0/2353168604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c28071b20 con 0x7f7c280cb390 2024-08-18T22:23:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.618+0000 7f7c25600640 1 -- 172.21.15.5:0/2353168604 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7c140c53f0 con 0x7f7c280cb390 2024-08-18T22:23:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.622+0000 7f7c25600640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c080678c0 0x7f7c08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.622+0000 7f7c25600640 1 -- 172.21.15.5:0/2353168604 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f7c141208d0 con 0x7f7c280cb390 2024-08-18T22:23:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.622+0000 7f7c2d400640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c080678c0 0x7f7c08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.622+0000 7f7c2d400640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c080678c0 0x7f7c08069d80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c007a60 tx=0x7f7c1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.626+0000 7f7c25600640 1 -- 172.21.15.5:0/2353168604 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7c140ad020 con 0x7f7c280cb390 2024-08-18T22:23:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.822+0000 7f7c2fe00640 1 -- 172.21.15.5:0/2353168604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c280aed20 con 0x7f7c280cb390 2024-08-18T22:23:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.822+0000 7f7c25600640 1 -- 172.21.15.5:0/2353168604 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f7c14016150 con 0x7f7c280cb390 2024-08-18T22:23:37.829 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:37.829 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":47,"btime":"2024-08-18T22:23:28:785339+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3998000168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3998000168},{"type":"v1","addr":"172.21.15.117:6837","nonce":3998000168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1741701025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1741701025},{"type":"v1","addr":"172.21.15.117:6835","nonce":1741701025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/188037311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":188037311},{"type":"v1","addr":"172.21.15.5:6835","nonce":188037311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:28.785328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/1715051733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1715051733},{"type":"v1","addr":"172.21.15.5:6833","nonce":1715051733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6543,"qdb_cluster":[6543]},"id":4}]} 2024-08-18T22:23:37.829 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 47 2024-08-18T22:23:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 -- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c080678c0 msgr2=0x7f7c08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c080678c0 0x7f7c08069d80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c007a60 tx=0x7f7c1c008040 comp rx=0 tx=0).stop 2024-08-18T22:23:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 -- 172.21.15.5:0/2353168604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c280cb390 msgr2=0x7f7c280c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c280cb390 0x7f7c280c92d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7c140ab040 tx=0x7f7c1401ad70 comp rx=0 tx=0).stop 2024-08-18T22:23:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 -- 172.21.15.5:0/2353168604 shutdown_connections 2024-08-18T22:23:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7c080678c0 0x7f7c08069d80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c2815bed0 0x7f7c280c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c280cb390 0x7f7c280c92d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:37.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 --2- 172.21.15.5:0/2353168604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c2806da70 0x7f7c28152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 -- 172.21.15.5:0/2353168604 >> 172.21.15.5:0/2353168604 conn(0x7f7c280b1c50 msgr2=0x7f7c2815a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 -- 172.21.15.5:0/2353168604 shutdown_connections 2024-08-18T22:23:37.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:37.826+0000 7f7c2fe00640 1 -- 172.21.15.5:0/2353168604 wait complete. 2024-08-18T22:23:37.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-08-18T22:23:38.012 INFO:teuthology.orchestra.run.smithi005.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-08-18T22:23:23.006807+0000","btime":"2024-08-18T22:23:22.122816+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-08-18T22:23:23.006807+0000","atime":"2024-08-18T22:23:22.122816+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-08-18T22:23:23.006807+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:23:23.006807+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:23:23.006807+0000"},"version":247,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-08-18T22:23:31.892598+0000","last_scrub_version":244,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-08-18T22:23:38.012 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-08-18T22:23:23.006807+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-08-18T22:23:22.122816+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-08-18T22:23:22.122816+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-08-18T22:23:23.006807+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-08-18T22:23:23.006807+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-08-18T22:23:31.892598+0000", "last_scrub_version": 244, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-08-18T22:23:23.006807+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-08-18T22:23:23.006807+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 247, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-08-18T22:23:38.013 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-18T22:23:38.013 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:23:38.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:23:38.083 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:23:38.154 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:23:38.154 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:23:38.154 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:23:38.155 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:38.164 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:23:38.164 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:23:38.164 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:23:38.164 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:38.173 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:23:38.173 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:23:38.173 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:23:38.173 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:38.213 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:23:38.213 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:23:38.213 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:23:38.213 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:38.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:23:38.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:38.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.390+0000 7f4306600640 1 Processor -- start 2024-08-18T22:23:38.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.390+0000 7f4306600640 1 -- start start 2024-08-18T22:23:38.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f4306600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f430006f290 0x7f43000ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f4306600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f43000cd3a0 0x7f4300072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f4306600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43000cd850 con 0x7f430015b010 2024-08-18T22:23:38.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f4306600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f43000cfa30 con 0x7f430006f290 2024-08-18T22:23:38.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f4306600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f43000cee20 con 0x7f43000cd3a0 2024-08-18T22:23:38.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f42f6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f430006f290 0x7f43000ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f42f6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f430006f290 0x7f43000ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34438/0 (socket says 172.21.15.5:34438) 2024-08-18T22:23:38.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f42f6a00640 1 -- 172.21.15.5:0/1154311763 learned_addr learned my addr 172.21.15.5:0/1154311763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:38.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f42ffe00640 1 --2- 172.21.15.5:0/1154311763 >> v2:172.21.15.117:3300/0 conn(0x7f43000cd3a0 0x7f4300072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f42f6a00640 1 -- 172.21.15.5:0/1154311763 >> v2:172.21.15.117:3300/0 conn(0x7f43000cd3a0 msgr2=0x7f4300072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:38.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f42f6a00640 1 --2- 172.21.15.5:0/1154311763 >> v2:172.21.15.117:3300/0 conn(0x7f43000cd3a0 0x7f4300072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f42f6a00640 1 -- 172.21.15.5:0/1154311763 >> v1:172.21.15.117:6789/0 conn(0x7f430015b010 legacy=0x7f430006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.394+0000 7f42f6a00640 1 -- 172.21.15.5:0/1154311763 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43000cf100 con 0x7f430006f290 2024-08-18T22:23:38.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f42f6a00640 1 --2- 172.21.15.5:0/1154311763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f430006f290 0x7f43000ce840 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f43000af570 tx=0x7f42e801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ff9fa9d89a95d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:38.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f42fea00640 1 -- 172.21.15.5:0/1154311763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e80aa650 con 0x7f430006f290 2024-08-18T22:23:38.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f42fea00640 1 -- 172.21.15.5:0/1154311763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e80af070 con 0x7f430006f290 2024-08-18T22:23:38.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f42fea00640 1 -- 172.21.15.5:0/1154311763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e80aaa10 con 0x7f430006f290 2024-08-18T22:23:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f4306600640 1 -- 172.21.15.5:0/1154311763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f430006f290 msgr2=0x7f43000ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f4306600640 1 --2- 172.21.15.5:0/1154311763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f430006f290 0x7f43000ce840 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f43000af570 tx=0x7f42e801c4f0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f4306600640 1 -- 172.21.15.5:0/1154311763 shutdown_connections 2024-08-18T22:23:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f4306600640 1 --2- 172.21.15.5:0/1154311763 >> v2:172.21.15.117:3300/0 conn(0x7f43000cd3a0 0x7f4300072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f4306600640 1 --2- 172.21.15.5:0/1154311763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f430006f290 0x7f43000ce840 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f4306600640 1 -- 172.21.15.5:0/1154311763 >> 172.21.15.5:0/1154311763 conn(0x7f43000b1c50 msgr2=0x7f43000b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:38.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f4306600640 1 -- 172.21.15.5:0/1154311763 shutdown_connections 2024-08-18T22:23:38.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f4306600640 1 -- 172.21.15.5:0/1154311763 wait complete. 2024-08-18T22:23:38.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f4306600640 1 Processor -- start 2024-08-18T22:23:38.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.398+0000 7f4306600640 1 -- start start 2024-08-18T22:23:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f4306600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f430006f290 0x7f43001447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f4306600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43000cd3a0 0x7f43000c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f4306600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430015b010 0x7f43000c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f4306600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f43000734f0 con 0x7f430006f290 2024-08-18T22:23:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f4306600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4300073370 con 0x7f430015b010 2024-08-18T22:23:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f4306600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4300073670 con 0x7f43000cd3a0 2024-08-18T22:23:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42ff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f430006f290 0x7f43001447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42ff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f430006f290 0x7f43001447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34446/0 (socket says 172.21.15.5:34446) 2024-08-18T22:23:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42ff400640 1 -- 172.21.15.5:0/2183254987 learned_addr learned my addr 172.21.15.5:0/2183254987 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:38.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42ffe00640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430015b010 0x7f43000c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42f6a00640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43000cd3a0 0x7f43000c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42ff400640 1 -- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43000cd3a0 msgr2=0x7f43000c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42ff400640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43000cd3a0 0x7f43000c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42ff400640 1 -- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430015b010 msgr2=0x7f43000c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42ff400640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430015b010 0x7f43000c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42ff400640 1 -- 172.21.15.5:0/2183254987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4300159760 con 0x7f430006f290 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42f6a00640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43000cd3a0 0x7f43000c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42ff400640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f430006f290 0x7f43001447f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c3c0 tx=0x7f42f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42f7e00640 1 -- 172.21.15.5:0/2183254987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0017070 con 0x7f430006f290 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42f7e00640 1 -- 172.21.15.5:0/2183254987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00052d0 con 0x7f430006f290 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f4306600640 1 -- 172.21.15.5:0/2183254987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4300159a40 con 0x7f430006f290 2024-08-18T22:23:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42f7e00640 1 -- 172.21.15.5:0/2183254987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0003840 con 0x7f430006f290 2024-08-18T22:23:38.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f4306600640 1 -- 172.21.15.5:0/2183254987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430015a000 con 0x7f430006f290 2024-08-18T22:23:38.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f4306600640 1 -- 172.21.15.5:0/2183254987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43000ce840 con 0x7f430006f290 2024-08-18T22:23:38.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.402+0000 7f42f7e00640 1 -- 172.21.15.5:0/2183254987 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42f001a070 con 0x7f430006f290 2024-08-18T22:23:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.406+0000 7f42f7e00640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f42dc0678c0 0x7f42dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.406+0000 7f42f7e00640 1 -- 172.21.15.5:0/2183254987 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f42f00851f0 con 0x7f430006f290 2024-08-18T22:23:38.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.406+0000 7f42f6a00640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f42dc0678c0 0x7f42dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.406+0000 7f42f6a00640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f42dc0678c0 0x7f42dc069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f42e80ae000 tx=0x7f42e80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.410+0000 7f42f7e00640 1 -- 172.21.15.5:0/2183254987 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f42f0005480 con 0x7f430006f290 2024-08-18T22:23:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 -- 172.21.15.5:0/2183254987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4300073b70 con 0x7f430006f290 2024-08-18T22:23:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f42f7e00640 1 -- 172.21.15.5:0/2183254987 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f42f00553d0 con 0x7f430006f290 2024-08-18T22:23:38.614 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:38.614 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":47,"btime":"2024-08-18T22:23:28:785339+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3998000168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3998000168},{"type":"v1","addr":"172.21.15.117:6837","nonce":3998000168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1741701025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1741701025},{"type":"v1","addr":"172.21.15.117:6835","nonce":1741701025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/188037311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":188037311},{"type":"v1","addr":"172.21.15.5:6835","nonce":188037311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:28.785328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/1715051733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1715051733},{"type":"v1","addr":"172.21.15.5:6833","nonce":1715051733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6543,"qdb_cluster":[6543]},"id":4}]} 2024-08-18T22:23:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 47 2024-08-18T22:23:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 -- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f42dc0678c0 msgr2=0x7f42dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f42dc0678c0 0x7f42dc069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f42e80ae000 tx=0x7f42e80a7000 comp rx=0 tx=0).stop 2024-08-18T22:23:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 -- 172.21.15.5:0/2183254987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f430006f290 msgr2=0x7f43001447f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f430006f290 0x7f43001447f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c3c0 tx=0x7f42f000c880 comp rx=0 tx=0).stop 2024-08-18T22:23:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 -- 172.21.15.5:0/2183254987 shutdown_connections 2024-08-18T22:23:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f42dc0678c0 0x7f42dc069d80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f430015b010 0x7f43000c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43000cd3a0 0x7f43000c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 --2- 172.21.15.5:0/2183254987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f430006f290 0x7f43001447f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 -- 172.21.15.5:0/2183254987 >> 172.21.15.5:0/2183254987 conn(0x7f43000b1c50 msgr2=0x7f43000b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 -- 172.21.15.5:0/2183254987 shutdown_connections 2024-08-18T22:23:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.610+0000 7f4306600640 1 -- 172.21.15.5:0/2183254987 wait complete. 2024-08-18T22:23:38.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.770+0000 7f7be5600640 1 Processor -- start 2024-08-18T22:23:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.770+0000 7f7be5600640 1 -- start start 2024-08-18T22:23:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7be5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 0x7f7be006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7be5600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7be0070730 0x7f7be0070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7be5600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be015eb60 con 0x7f7be015dda0 2024-08-18T22:23:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7be5600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7be015fcc0 con 0x7f7be0070730 2024-08-18T22:23:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7be5600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7be00710b0 con 0x7f7be0161960 2024-08-18T22:23:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7bdf400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7be015dda0 0x7f7be015e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34800/0 (socket says 172.21.15.5:34800) 2024-08-18T22:23:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7bdf400640 1 -- 172.21.15.5:0/1908288442 learned_addr learned my addr 172.21.15.5:0/1908288442 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7bd6000640 1 --2- 172.21.15.5:0/1908288442 >> v2:172.21.15.117:3300/0 conn(0x7f7be0070730 0x7f7be0070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7bdea00640 1 --2- 172.21.15.5:0/1908288442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 0x7f7be006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7bde000640 1 -- 172.21.15.5:0/1908288442 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2148187505 0 0) 0x7f7be015eb60 con 0x7f7be015dda0 2024-08-18T22:23:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7bde000640 1 -- 172.21.15.5:0/1908288442 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bc4003530 con 0x7f7be015dda0 2024-08-18T22:23:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7bd6000640 1 -- 172.21.15.5:0/1908288442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 msgr2=0x7f7be006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7bd6000640 1 --2- 172.21.15.5:0/1908288442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 0x7f7be006fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7bd6000640 1 -- 172.21.15.5:0/1908288442 >> v1:172.21.15.5:6789/0 conn(0x7f7be015dda0 legacy=0x7f7be015e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7bd6000640 1 -- 172.21.15.5:0/1908288442 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be015ee40 con 0x7f7be0070730 2024-08-18T22:23:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.774+0000 7f7bdea00640 1 --2- 172.21.15.5:0/1908288442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 0x7f7be006fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7bd6000640 1 --2- 172.21.15.5:0/1908288442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0070730 0x7f7be0070b70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80097c0 tx=0x7f7bc801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6268c8de11519ac server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7bde000640 1 -- 172.21.15.5:0/1908288442 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc80b0070 con 0x7f7be0070730 2024-08-18T22:23:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7bde000640 1 -- 172.21.15.5:0/1908288442 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc80ab600 con 0x7f7be0070730 2024-08-18T22:23:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7bde000640 1 -- 172.21.15.5:0/1908288442 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc80ab9d0 con 0x7f7be0070730 2024-08-18T22:23:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7be5600640 1 -- 172.21.15.5:0/1908288442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0070730 msgr2=0x7f7be0070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7be5600640 1 --2- 172.21.15.5:0/1908288442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0070730 0x7f7be0070b70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80097c0 tx=0x7f7bc801c4a0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7be5600640 1 -- 172.21.15.5:0/1908288442 shutdown_connections 2024-08-18T22:23:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7be5600640 1 --2- 172.21.15.5:0/1908288442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0070730 0x7f7be0070b70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7be5600640 1 --2- 172.21.15.5:0/1908288442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 0x7f7be006fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7be5600640 1 -- 172.21.15.5:0/1908288442 >> 172.21.15.5:0/1908288442 conn(0x7f7be00d2130 msgr2=0x7f7be00d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:38.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7be5600640 1 -- 172.21.15.5:0/1908288442 shutdown_connections 2024-08-18T22:23:38.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7be5600640 1 -- 172.21.15.5:0/1908288442 wait complete. 2024-08-18T22:23:38.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7be5600640 1 Processor -- start 2024-08-18T22:23:38.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.778+0000 7f7be5600640 1 -- start start 2024-08-18T22:23:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7be5600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0070730 0x7f7be00b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7be5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be015dda0 0x7f7be00b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7be5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 0x7f7be0156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7be5600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7be009ba30 con 0x7f7be015dda0 2024-08-18T22:23:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7be5600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7be0070260 con 0x7f7be0070730 2024-08-18T22:23:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7be5600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7be00b3670 con 0x7f7be0161960 2024-08-18T22:23:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be015dda0 0x7f7be00b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be015dda0 0x7f7be00b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34454/0 (socket says 172.21.15.5:34454) 2024-08-18T22:23:38.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd6000640 1 -- 172.21.15.5:0/1700059754 learned_addr learned my addr 172.21.15.5:0/1700059754 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bdf400640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 0x7f7be0156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bdea00640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0070730 0x7f7be00b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd6000640 1 -- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 msgr2=0x7f7be0156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd6000640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 0x7f7be0156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd6000640 1 -- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0070730 msgr2=0x7f7be00b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd6000640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0070730 0x7f7be00b78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd6000640 1 -- 172.21.15.5:0/1700059754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be00b6090 con 0x7f7be015dda0 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bdf400640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 0x7f7be0156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bdea00640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0070730 0x7f7be00b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd6000640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be015dda0 0x7f7be00b5990 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80ae040 tx=0x7f7bc801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd7400640 1 -- 172.21.15.5:0/1700059754 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc80b0050 con 0x7f7be015dda0 2024-08-18T22:23:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd7400640 1 -- 172.21.15.5:0/1700059754 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc80bc070 con 0x7f7be015dda0 2024-08-18T22:23:38.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd7400640 1 -- 172.21.15.5:0/1700059754 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8006e20 con 0x7f7be015dda0 2024-08-18T22:23:38.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7be5600640 1 -- 172.21.15.5:0/1700059754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be01f8590 con 0x7f7be015dda0 2024-08-18T22:23:38.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7be5600640 1 -- 172.21.15.5:0/1700059754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be01f8b50 con 0x7f7be015dda0 2024-08-18T22:23:38.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7be5600640 1 -- 172.21.15.5:0/1700059754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be0070b70 con 0x7f7be015dda0 2024-08-18T22:23:38.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.782+0000 7f7bd7400640 1 -- 172.21.15.5:0/1700059754 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7bc80b5830 con 0x7f7be015dda0 2024-08-18T22:23:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.786+0000 7f7bd7400640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678c0 0x7f7bbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.786+0000 7f7bd7400640 1 -- 172.21.15.5:0/1700059754 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f7bc81205c0 con 0x7f7be015dda0 2024-08-18T22:23:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.786+0000 7f7bdea00640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678c0 0x7f7bbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:38.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.786+0000 7f7bdea00640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678c0 0x7f7bbc069d80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009ae0 tx=0x7f7bd0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:38.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.790+0000 7f7bd7400640 1 -- 172.21.15.5:0/1700059754 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7bc8016090 con 0x7f7be015dda0 2024-08-18T22:23:38.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.986+0000 7f7be5600640 1 -- 172.21.15.5:0/1700059754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7be00d3010 con 0x7f7be015dda0 2024-08-18T22:23:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.986+0000 7f7bd7400640 1 -- 172.21.15.5:0/1700059754 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f7bc80f0fa0 con 0x7f7be015dda0 2024-08-18T22:23:38.992 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:38.992 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":47,"btime":"2024-08-18T22:23:28:785339+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3998000168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3998000168},{"type":"v1","addr":"172.21.15.117:6837","nonce":3998000168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1741701025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1741701025},{"type":"v1","addr":"172.21.15.117:6835","nonce":1741701025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/188037311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":188037311},{"type":"v1","addr":"172.21.15.5:6835","nonce":188037311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:28.785328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/1715051733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1715051733},{"type":"v1","addr":"172.21.15.5:6833","nonce":1715051733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6543,"qdb_cluster":[6543]},"id":4}]} 2024-08-18T22:23:38.992 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 47 2024-08-18T22:23:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 -- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678c0 msgr2=0x7f7bbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678c0 0x7f7bbc069d80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009ae0 tx=0x7f7bd0008040 comp rx=0 tx=0).stop 2024-08-18T22:23:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 -- 172.21.15.5:0/1700059754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be015dda0 msgr2=0x7f7be00b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be015dda0 0x7f7be00b5990 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80ae040 tx=0x7f7bc801ace0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 -- 172.21.15.5:0/1700059754 shutdown_connections 2024-08-18T22:23:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678c0 0x7f7bbc069d80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0161960 0x7f7be0156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be015dda0 0x7f7be00b5990 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 --2- 172.21.15.5:0/1700059754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0070730 0x7f7be00b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 -- 172.21.15.5:0/1700059754 >> 172.21.15.5:0/1700059754 conn(0x7f7be00d2130 msgr2=0x7f7be006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 -- 172.21.15.5:0/1700059754 shutdown_connections 2024-08-18T22:23:38.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:38.990+0000 7f7be5600640 1 -- 172.21.15.5:0/1700059754 wait complete. 2024-08-18T22:23:39.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:23:39.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4dea000640 1 Processor -- start 2024-08-18T22:23:39.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4dea000640 1 -- start start 2024-08-18T22:23:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4dea000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4de415c180 0x7f4de40b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4dea000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de4071c90 0x7f4de415c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4dea000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de40b5e30 con 0x7f4de406fad0 2024-08-18T22:23:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4dea000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4de415caa0 con 0x7f4de415c180 2024-08-18T22:23:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4dea000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4de40b6110 con 0x7f4de4071c90 2024-08-18T22:23:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4de3400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4de415c180 0x7f4de40b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4de3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de4071c90 0x7f4de415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4de3400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4de415c180 0x7f4de40b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:50468/0 (socket says 172.21.15.5:50468) 2024-08-18T22:23:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4de3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de4071c90 0x7f4de415c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:52398/0 (socket says 172.21.15.5:52398) 2024-08-18T22:23:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4de3400640 1 -- 172.21.15.5:0/2775347507 learned_addr learned my addr 172.21.15.5:0/2775347507 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4de2a00640 1 --1- 172.21.15.5:0/2775347507 >> v1:172.21.15.117:6789/0 conn(0x7f4de406fad0 0x7f4de4071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:57016/0 (socket says 172.21.15.5:57016) 2024-08-18T22:23:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4de3e00640 1 -- 172.21.15.5:0/2775347507 >> v2:172.21.15.117:3300/0 conn(0x7f4de415c180 msgr2=0x7f4de40b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4de3e00640 1 --2- 172.21.15.5:0/2775347507 >> v2:172.21.15.117:3300/0 conn(0x7f4de415c180 0x7f4de40b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4de3e00640 1 -- 172.21.15.5:0/2775347507 >> v1:172.21.15.117:6789/0 conn(0x7f4de406fad0 legacy=0x7f4de4071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4de2000640 1 -- 172.21.15.5:0/2775347507 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913029851 0 0) 0x7f4de40b5e30 con 0x7f4de406fad0 2024-08-18T22:23:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.150+0000 7f4de3e00640 1 -- 172.21.15.5:0/2775347507 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de40b63f0 con 0x7f4de4071c90 2024-08-18T22:23:39.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4de3e00640 1 --2- 172.21.15.5:0/2775347507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de4071c90 0x7f4de415c560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009d90 tx=0x7f4ddc01c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5144e703c07123 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:39.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4de2000640 1 -- 172.21.15.5:0/2775347507 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc0b2070 con 0x7f4de4071c90 2024-08-18T22:23:39.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4de2000640 1 -- 172.21.15.5:0/2775347507 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ddc0a58a0 con 0x7f4de4071c90 2024-08-18T22:23:39.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4de2000640 1 -- 172.21.15.5:0/2775347507 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc0a5c70 con 0x7f4de4071c90 2024-08-18T22:23:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4dea000640 1 -- 172.21.15.5:0/2775347507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de4071c90 msgr2=0x7f4de415c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4dea000640 1 --2- 172.21.15.5:0/2775347507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de4071c90 0x7f4de415c560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009d90 tx=0x7f4ddc01c820 comp rx=0 tx=0).stop 2024-08-18T22:23:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4dea000640 1 -- 172.21.15.5:0/2775347507 shutdown_connections 2024-08-18T22:23:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4dea000640 1 --2- 172.21.15.5:0/2775347507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de4071c90 0x7f4de415c560 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4dea000640 1 --2- 172.21.15.5:0/2775347507 >> v2:172.21.15.117:3300/0 conn(0x7f4de415c180 0x7f4de40b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4dea000640 1 -- 172.21.15.5:0/2775347507 >> 172.21.15.5:0/2775347507 conn(0x7f4de40b3eb0 msgr2=0x7f4de40b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4dea000640 1 -- 172.21.15.5:0/2775347507 shutdown_connections 2024-08-18T22:23:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.154+0000 7f4dea000640 1 -- 172.21.15.5:0/2775347507 wait complete. 2024-08-18T22:23:39.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4dea000640 1 Processor -- start 2024-08-18T22:23:39.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4dea000640 1 -- start start 2024-08-18T22:23:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4dea000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de406fad0 0x7f4de4148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4dea000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4de4071c90 0x7f4de414c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4dea000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de415c180 0x7f4de414cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4dea000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4de40d1c30 con 0x7f4de406fad0 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4dea000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4de40d1ab0 con 0x7f4de4071c90 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4dea000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4de40d1db0 con 0x7f4de415c180 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de406fad0 0x7f4de4148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de406fad0 0x7f4de4148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34464/0 (socket says 172.21.15.5:34464) 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de3400640 1 -- 172.21.15.5:0/4119429176 learned_addr learned my addr 172.21.15.5:0/4119429176 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de3e00640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de415c180 0x7f4de414cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de2a00640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4de4071c90 0x7f4de414c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de3400640 1 -- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de415c180 msgr2=0x7f4de414cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de3400640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de415c180 0x7f4de414cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de3400640 1 -- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4de4071c90 msgr2=0x7f4de414c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de3400640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4de4071c90 0x7f4de414c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de3400640 1 -- 172.21.15.5:0/4119429176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de414d260 con 0x7f4de406fad0 2024-08-18T22:23:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de2a00640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4de4071c90 0x7f4de414c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:39.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.158+0000 7f4de3400640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de406fad0 0x7f4de4148480 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400e890 tx=0x7f4dd400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.162+0000 7f4ddb400640 1 -- 172.21.15.5:0/4119429176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4017070 con 0x7f4de406fad0 2024-08-18T22:23:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.162+0000 7f4ddb400640 1 -- 172.21.15.5:0/4119429176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd400c940 con 0x7f4de406fad0 2024-08-18T22:23:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.162+0000 7f4dea000640 1 -- 172.21.15.5:0/4119429176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de414fb00 con 0x7f4de406fad0 2024-08-18T22:23:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.162+0000 7f4ddb400640 1 -- 172.21.15.5:0/4119429176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd400cd30 con 0x7f4de406fad0 2024-08-18T22:23:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.162+0000 7f4dea000640 1 -- 172.21.15.5:0/4119429176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de41500c0 con 0x7f4de406fad0 2024-08-18T22:23:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.162+0000 7f4dea000640 1 -- 172.21.15.5:0/4119429176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de415c560 con 0x7f4de406fad0 2024-08-18T22:23:39.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.162+0000 7f4ddb400640 1 -- 172.21.15.5:0/4119429176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4dd401a070 con 0x7f4de406fad0 2024-08-18T22:23:39.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.162+0000 7f4ddb400640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4dc40678c0 0x7f4dc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.162+0000 7f4ddb400640 1 -- 172.21.15.5:0/4119429176 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f4dd4086070 con 0x7f4de406fad0 2024-08-18T22:23:39.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.162+0000 7f4de2a00640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4dc40678c0 0x7f4dc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.162+0000 7f4de2a00640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4dc40678c0 0x7f4dc4069d80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4de415b8e0 tx=0x7f4dd0007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:39.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.166+0000 7f4ddb400640 1 -- 172.21.15.5:0/4119429176 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4dd4056410 con 0x7f4de406fad0 2024-08-18T22:23:39.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.330+0000 7f4dea000640 1 -- 172.21.15.5:0/4119429176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4de40cf7d0 con 0x7f4de406fad0 2024-08-18T22:23:39.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4ddb400640 1 -- 172.21.15.5:0/4119429176 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16939 (secure 0 0 0) 0x7f4dd405a710 con 0x7f4de406fad0 2024-08-18T22:23:39.338 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:39.338 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":71,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:23:24.771847+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:23:06.185079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-08-18T22:23:07.780380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6833/3174043628":"2024-08-19T22:23:24.762498+0000","172.21.15.5:6832/3174043628":"2024-08-19T22:23:24.762498+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:23:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 -- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4dc40678c0 msgr2=0x7f4dc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4dc40678c0 0x7f4dc4069d80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4de415b8e0 tx=0x7f4dd0007cb0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 -- 172.21.15.5:0/4119429176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de406fad0 msgr2=0x7f4de4148480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de406fad0 0x7f4de4148480 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400e890 tx=0x7f4dd400ed50 comp rx=0 tx=0).stop 2024-08-18T22:23:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 -- 172.21.15.5:0/4119429176 shutdown_connections 2024-08-18T22:23:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4dc40678c0 0x7f4dc4069d80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4de415c180 0x7f4de414cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4de4071c90 0x7f4de414c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 --2- 172.21.15.5:0/4119429176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de406fad0 0x7f4de4148480 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 -- 172.21.15.5:0/4119429176 >> 172.21.15.5:0/4119429176 conn(0x7f4de40b3eb0 msgr2=0x7f4de40d2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:39.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 -- 172.21.15.5:0/4119429176 shutdown_connections 2024-08-18T22:23:39.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.334+0000 7f4dea000640 1 -- 172.21.15.5:0/4119429176 wait complete. 2024-08-18T22:23:39.359 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:23:39.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6fa0e00640 1 Processor -- start 2024-08-18T22:23:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6fa0e00640 1 -- start start 2024-08-18T22:23:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6fa0e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f9c15c320 0x7f6f9c15f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6fa0e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6f9c0d4fa0 0x7f6f9c0d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6fa0e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9c0d1920 0x7f6f9c1622d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6fa0e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6f9c0cfa20 con 0x7f6f9c15c320 2024-08-18T22:23:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6fa0e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6f9c0cee10 con 0x7f6f9c0d4fa0 2024-08-18T22:23:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6fa0e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c0cf0f0 con 0x7f6f9c0d1920 2024-08-18T22:23:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6f99e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f9c15c320 0x7f6f9c15f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6f99e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f9c15c320 0x7f6f9c15f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34468/0 (socket says 172.21.15.5:34468) 2024-08-18T22:23:39.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6f99e00640 1 -- 172.21.15.5:0/3053365673 learned_addr learned my addr 172.21.15.5:0/3053365673 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:39.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6f9a800640 1 --2- 172.21.15.5:0/3053365673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9c0d1920 0x7f6f9c1622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6f99400640 1 --2- 172.21.15.5:0/3053365673 >> v2:172.21.15.117:3300/0 conn(0x7f6f9c0d4fa0 0x7f6f9c0d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6f99e00640 1 -- 172.21.15.5:0/3053365673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9c0d1920 msgr2=0x7f6f9c1622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:39.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6f99e00640 1 --2- 172.21.15.5:0/3053365673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9c0d1920 0x7f6f9c1622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6f99e00640 1 -- 172.21.15.5:0/3053365673 >> v2:172.21.15.117:3300/0 conn(0x7f6f9c0d4fa0 msgr2=0x7f6f9c0d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:39.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6f99e00640 1 --2- 172.21.15.5:0/3053365673 >> v2:172.21.15.117:3300/0 conn(0x7f6f9c0d4fa0 0x7f6f9c0d13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.498+0000 7f6f99e00640 1 -- 172.21.15.5:0/3053365673 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c0cf3d0 con 0x7f6f9c15c320 2024-08-18T22:23:39.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6f99e00640 1 --2- 172.21.15.5:0/3053365673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c15c320 0x7f6f9c15f490 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0c7dc0 tx=0x7f6f8c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd93d5a4133da90 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:39.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6f98a00640 1 -- 172.21.15.5:0/3053365673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0b0070 con 0x7f6f9c15c320 2024-08-18T22:23:39.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6f98a00640 1 -- 172.21.15.5:0/3053365673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8c0ab600 con 0x7f6f9c15c320 2024-08-18T22:23:39.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6f98a00640 1 -- 172.21.15.5:0/3053365673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0ab9d0 con 0x7f6f9c15c320 2024-08-18T22:23:39.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6fa0e00640 1 -- 172.21.15.5:0/3053365673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c15c320 msgr2=0x7f6f9c15f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6fa0e00640 1 --2- 172.21.15.5:0/3053365673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c15c320 0x7f6f9c15f490 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0c7dc0 tx=0x7f6f8c01c260 comp rx=0 tx=0).stop 2024-08-18T22:23:39.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6fa0e00640 1 -- 172.21.15.5:0/3053365673 shutdown_connections 2024-08-18T22:23:39.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6fa0e00640 1 --2- 172.21.15.5:0/3053365673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9c0d1920 0x7f6f9c1622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6fa0e00640 1 --2- 172.21.15.5:0/3053365673 >> v2:172.21.15.117:3300/0 conn(0x7f6f9c0d4fa0 0x7f6f9c0d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6fa0e00640 1 --2- 172.21.15.5:0/3053365673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c15c320 0x7f6f9c15f490 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6fa0e00640 1 -- 172.21.15.5:0/3053365673 >> 172.21.15.5:0/3053365673 conn(0x7f6f9c067aa0 msgr2=0x7f6f9c067eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:39.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6fa0e00640 1 -- 172.21.15.5:0/3053365673 shutdown_connections 2024-08-18T22:23:39.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6fa0e00640 1 -- 172.21.15.5:0/3053365673 wait complete. 2024-08-18T22:23:39.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6fa0e00640 1 Processor -- start 2024-08-18T22:23:39.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.502+0000 7f6fa0e00640 1 -- start start 2024-08-18T22:23:39.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6fa0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c0d1920 0x7f6f9c14d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6fa0e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9c0d4fa0 0x7f6f9c0b9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6fa0e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9c15c320 0x7f6f9c0b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6fa0e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c0d2510 con 0x7f6f9c0d1920 2024-08-18T22:23:39.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6fa0e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c0d2390 con 0x7f6f9c0d4fa0 2024-08-18T22:23:39.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6fa0e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c0d2690 con 0x7f6f9c15c320 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f99e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c0d1920 0x7f6f9c14d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f99e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c0d1920 0x7f6f9c14d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34474/0 (socket says 172.21.15.5:34474) 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f99e00640 1 -- 172.21.15.5:0/1187385037 learned_addr learned my addr 172.21.15.5:0/1187385037 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f9a800640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9c15c320 0x7f6f9c0b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f99400640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9c0d4fa0 0x7f6f9c0b9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f99e00640 1 -- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9c15c320 msgr2=0x7f6f9c0b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f99e00640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9c15c320 0x7f6f9c0b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f99e00640 1 -- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9c0d4fa0 msgr2=0x7f6f9c0b9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f99e00640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9c0d4fa0 0x7f6f9c0b9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f99e00640 1 -- 172.21.15.5:0/1187385037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c0b9d50 con 0x7f6f9c0d1920 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f99e00640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c0d1920 0x7f6f9c14d790 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0ae040 tx=0x7f6f8c01aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f92000640 1 -- 172.21.15.5:0/1187385037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0b0040 con 0x7f6f9c0d1920 2024-08-18T22:23:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f92000640 1 -- 172.21.15.5:0/1187385037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8c0bc070 con 0x7f6f9c0d1920 2024-08-18T22:23:39.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6fa0e00640 1 -- 172.21.15.5:0/1187385037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9c0d4010 con 0x7f6f9c0d1920 2024-08-18T22:23:39.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f92000640 1 -- 172.21.15.5:0/1187385037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0b6880 con 0x7f6f9c0d1920 2024-08-18T22:23:39.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6fa0e00640 1 -- 172.21.15.5:0/1187385037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9c154210 con 0x7f6f9c0d1920 2024-08-18T22:23:39.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6fa0e00640 1 -- 172.21.15.5:0/1187385037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9c1549f0 con 0x7f6f9c0d1920 2024-08-18T22:23:39.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.506+0000 7f6f92000640 1 -- 172.21.15.5:0/1187385037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f8c0ab4c0 con 0x7f6f9c0d1920 2024-08-18T22:23:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.510+0000 7f6f92000640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f7c0678c0 0x7f6f7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.510+0000 7f6f92000640 1 -- 172.21.15.5:0/1187385037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f6f8c1201e0 con 0x7f6f9c0d1920 2024-08-18T22:23:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.510+0000 7f6f99400640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f7c0678c0 0x7f6f7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.510+0000 7f6f99400640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f7c0678c0 0x7f6f7c069d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c15ba90 tx=0x7f6f88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:39.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.514+0000 7f6f92000640 1 -- 172.21.15.5:0/1187385037 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6f9c1549f0 con 0x7f6f9c0d1920 2024-08-18T22:23:39.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 -- 172.21.15.5:0/1187385037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f9c0d13e0 con 0x7f6f9c0d1920 2024-08-18T22:23:39.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6f92000640 1 -- 172.21.15.5:0/1187385037 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f6f8c016110 con 0x7f6f9c0d1920 2024-08-18T22:23:39.718 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:39.718 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":47,"btime":"2024-08-18T22:23:28:785339+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3998000168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3998000168},{"type":"v1","addr":"172.21.15.117:6837","nonce":3998000168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1741701025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1741701025},{"type":"v1","addr":"172.21.15.117:6835","nonce":1741701025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/188037311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":188037311},{"type":"v1","addr":"172.21.15.5:6835","nonce":188037311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:28.785328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/1715051733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1715051733},{"type":"v1","addr":"172.21.15.5:6833","nonce":1715051733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6543,"qdb_cluster":[6543]},"id":4}]} 2024-08-18T22:23:39.718 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 47 2024-08-18T22:23:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 -- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f7c0678c0 msgr2=0x7f6f7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f7c0678c0 0x7f6f7c069d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c15ba90 tx=0x7f6f88008040 comp rx=0 tx=0).stop 2024-08-18T22:23:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 -- 172.21.15.5:0/1187385037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c0d1920 msgr2=0x7f6f9c14d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c0d1920 0x7f6f9c14d790 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0ae040 tx=0x7f6f8c01aaa0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 -- 172.21.15.5:0/1187385037 shutdown_connections 2024-08-18T22:23:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f7c0678c0 0x7f6f7c069d80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f9c15c320 0x7f6f9c0b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9c0d4fa0 0x7f6f9c0b9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 --2- 172.21.15.5:0/1187385037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f9c0d1920 0x7f6f9c14d790 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 -- 172.21.15.5:0/1187385037 >> 172.21.15.5:0/1187385037 conn(0x7f6f9c067aa0 msgr2=0x7f6f9c1558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:39.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 -- 172.21.15.5:0/1187385037 shutdown_connections 2024-08-18T22:23:39.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.714+0000 7f6fa0e00640 1 -- 172.21.15.5:0/1187385037 wait complete. 2024-08-18T22:23:39.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:39.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.874+0000 7f8f96000640 1 Processor -- start 2024-08-18T22:23:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.874+0000 7f8f96000640 1 -- start start 2024-08-18T22:23:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f96000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9006f290 0x7f8f900ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f96000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f900cd3a0 0x7f8f90072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f96000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f900cee20 con 0x7f8f9015b010 2024-08-18T22:23:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f96000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8f900cfa30 con 0x7f8f900cd3a0 2024-08-18T22:23:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f96000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8f900cf100 con 0x7f8f9006f290 2024-08-18T22:23:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f8f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8f9015b010 0x7f8f9006eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34802/0 (socket says 172.21.15.5:34802) 2024-08-18T22:23:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f8f400640 1 -- 172.21.15.5:0/468084042 learned_addr learned my addr 172.21.15.5:0/468084042 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f8fe00640 1 --2- 172.21.15.5:0/468084042 >> v2:172.21.15.5:3300/0 conn(0x7f8f900cd3a0 0x7f8f90072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f8ea00640 1 --2- 172.21.15.5:0/468084042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9006f290 0x7f8f900ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f8fe00640 1 -- 172.21.15.5:0/468084042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9006f290 msgr2=0x7f8f900ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f8fe00640 1 --2- 172.21.15.5:0/468084042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9006f290 0x7f8f900ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f8fe00640 1 -- 172.21.15.5:0/468084042 >> v1:172.21.15.5:6789/0 conn(0x7f8f9015b010 legacy=0x7f8f9006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f8fe00640 1 -- 172.21.15.5:0/468084042 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f900cf3e0 con 0x7f8f900cd3a0 2024-08-18T22:23:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.878+0000 7f8f8e000640 1 -- 172.21.15.5:0/468084042 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1003964654 0 0) 0x7f8f900cee20 con 0x7f8f9015b010 2024-08-18T22:23:39.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f8fe00640 1 --2- 172.21.15.5:0/468084042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f900cd3a0 0x7f8f90072620 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009d90 tx=0x7f8f8801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65152add0d4bf18 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:39.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f8e000640 1 -- 172.21.15.5:0/468084042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f880b2070 con 0x7f8f900cd3a0 2024-08-18T22:23:39.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f8e000640 1 -- 172.21.15.5:0/468084042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f880a59e0 con 0x7f8f900cd3a0 2024-08-18T22:23:39.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f8e000640 1 -- 172.21.15.5:0/468084042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f880a5db0 con 0x7f8f900cd3a0 2024-08-18T22:23:39.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f96000640 1 -- 172.21.15.5:0/468084042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f900cd3a0 msgr2=0x7f8f90072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f96000640 1 --2- 172.21.15.5:0/468084042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f900cd3a0 0x7f8f90072620 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009d90 tx=0x7f8f8801c940 comp rx=0 tx=0).stop 2024-08-18T22:23:39.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f96000640 1 -- 172.21.15.5:0/468084042 shutdown_connections 2024-08-18T22:23:39.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f96000640 1 --2- 172.21.15.5:0/468084042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f900cd3a0 0x7f8f90072620 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f96000640 1 --2- 172.21.15.5:0/468084042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9006f290 0x7f8f900ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f96000640 1 -- 172.21.15.5:0/468084042 >> 172.21.15.5:0/468084042 conn(0x7f8f900b1c50 msgr2=0x7f8f900b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:39.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f96000640 1 -- 172.21.15.5:0/468084042 shutdown_connections 2024-08-18T22:23:39.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f96000640 1 -- 172.21.15.5:0/468084042 wait complete. 2024-08-18T22:23:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f96000640 1 Processor -- start 2024-08-18T22:23:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.882+0000 7f8f96000640 1 -- start start 2024-08-18T22:23:39.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f96000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f9006f290 0x7f8f9015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f96000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f900cd3a0 0x7f8f90145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f96000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9015b010 0x7f8f900b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f96000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f900734f0 con 0x7f8f9006f290 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f96000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8f90073370 con 0x7f8f900cd3a0 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f96000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8f90073670 con 0x7f8f9015b010 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f8f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f9006f290 0x7f8f9015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f8f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f9006f290 0x7f8f9015b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34504/0 (socket says 172.21.15.5:34504) 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f8f400640 1 -- 172.21.15.5:0/3943062446 learned_addr learned my addr 172.21.15.5:0/3943062446 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f8fe00640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9015b010 0x7f8f900b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f8ea00640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f900cd3a0 0x7f8f90145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f8f400640 1 -- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9015b010 msgr2=0x7f8f900b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f8f400640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9015b010 0x7f8f900b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f8f400640 1 -- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f900cd3a0 msgr2=0x7f8f90145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f8f400640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f900cd3a0 0x7f8f90145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f8f400640 1 -- 172.21.15.5:0/3943062446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f90153ff0 con 0x7f8f9006f290 2024-08-18T22:23:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f8f400640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f9006f290 0x7f8f9015b600 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c480 tx=0x7f8f8000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f87400640 1 -- 172.21.15.5:0/3943062446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80018070 con 0x7f8f9006f290 2024-08-18T22:23:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f87400640 1 -- 172.21.15.5:0/3943062446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f80007500 con 0x7f8f9006f290 2024-08-18T22:23:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f87400640 1 -- 172.21.15.5:0/3943062446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80004a30 con 0x7f8f9006f290 2024-08-18T22:23:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f96000640 1 -- 172.21.15.5:0/3943062446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f90152e90 con 0x7f8f9006f290 2024-08-18T22:23:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f96000640 1 -- 172.21.15.5:0/3943062446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f901542b0 con 0x7f8f9006f290 2024-08-18T22:23:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f96000640 1 -- 172.21.15.5:0/3943062446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f900ce840 con 0x7f8f9006f290 2024-08-18T22:23:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.886+0000 7f8f87400640 1 -- 172.21.15.5:0/3943062446 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f80004bd0 con 0x7f8f9006f290 2024-08-18T22:23:39.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.890+0000 7f8f87400640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f700678c0 0x7f8f70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:39.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.890+0000 7f8f87400640 1 -- 172.21.15.5:0/3943062446 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f8f80085060 con 0x7f8f9006f290 2024-08-18T22:23:39.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.890+0000 7f8f8ea00640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f700678c0 0x7f8f70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:39.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.890+0000 7f8f8ea00640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f700678c0 0x7f8f70069d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8f900ca070 tx=0x7f8f7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:39.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:39.898+0000 7f8f87400640 1 -- 172.21.15.5:0/3943062446 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8f80055360 con 0x7f8f9006f290 2024-08-18T22:23:40.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.090+0000 7f8f96000640 1 -- 172.21.15.5:0/3943062446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f900b19c0 con 0x7f8f9006f290 2024-08-18T22:23:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f87400640 1 -- 172.21.15.5:0/3943062446 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f8f80059660 con 0x7f8f9006f290 2024-08-18T22:23:40.097 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:40.097 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":47,"btime":"2024-08-18T22:23:28:785339+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3998000168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3998000168},{"type":"v1","addr":"172.21.15.117:6837","nonce":3998000168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1741701025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1741701025},{"type":"v1","addr":"172.21.15.117:6835","nonce":1741701025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/188037311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":188037311},{"type":"v1","addr":"172.21.15.5:6835","nonce":188037311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:08.785969+0000","modified":"2024-08-18T22:23:28.785328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6833/1715051733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1715051733},{"type":"v1","addr":"172.21.15.5:6833","nonce":1715051733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6543,"qdb_cluster":[6543]},"id":4}]} 2024-08-18T22:23:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 47 2024-08-18T22:23:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 -- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f700678c0 msgr2=0x7f8f70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f700678c0 0x7f8f70069d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8f900ca070 tx=0x7f8f7c008040 comp rx=0 tx=0).stop 2024-08-18T22:23:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 -- 172.21.15.5:0/3943062446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f9006f290 msgr2=0x7f8f9015b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f9006f290 0x7f8f9015b600 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c480 tx=0x7f8f8000c940 comp rx=0 tx=0).stop 2024-08-18T22:23:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 -- 172.21.15.5:0/3943062446 shutdown_connections 2024-08-18T22:23:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f700678c0 0x7f8f70069d80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f9015b010 0x7f8f900b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f900cd3a0 0x7f8f90145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 --2- 172.21.15.5:0/3943062446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f9006f290 0x7f8f9015b600 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 -- 172.21.15.5:0/3943062446 >> 172.21.15.5:0/3943062446 conn(0x7f8f900b1c50 msgr2=0x7f8f901599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 -- 172.21.15.5:0/3943062446 shutdown_connections 2024-08-18T22:23:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.094+0000 7f8f96000640 1 -- 172.21.15.5:0/3943062446 wait complete. 2024-08-18T22:23:40.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:23:40.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77ed000640 1 Processor -- start 2024-08-18T22:23:40.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77ed000640 1 -- start start 2024-08-18T22:23:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77ed000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e815b010 0x7f77e80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77ed000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77e806f290 0x7f77e8072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77ed000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e80cee20 con 0x7f77e80cd3a0 2024-08-18T22:23:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77ed000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f77e80cfa30 con 0x7f77e806f290 2024-08-18T22:23:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77ed000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f77e80cf100 con 0x7f77e815b010 2024-08-18T22:23:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e6800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77e806f290 0x7f77e8072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e5400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f77e80cd3a0 0x7f77e806eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34810/0 (socket says 172.21.15.5:34810) 2024-08-18T22:23:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e5400640 1 -- 172.21.15.5:0/3504635712 learned_addr learned my addr 172.21.15.5:0/3504635712 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e5e00640 1 --2- 172.21.15.5:0/3504635712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e815b010 0x7f77e80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e6800640 1 -- 172.21.15.5:0/3504635712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e815b010 msgr2=0x7f77e80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e6800640 1 --2- 172.21.15.5:0/3504635712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e815b010 0x7f77e80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e6800640 1 -- 172.21.15.5:0/3504635712 >> v1:172.21.15.5:6789/0 conn(0x7f77e80cd3a0 legacy=0x7f77e806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e6800640 1 -- 172.21.15.5:0/3504635712 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e80cf3e0 con 0x7f77e806f290 2024-08-18T22:23:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e6800640 1 --2- 172.21.15.5:0/3504635712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e806f290 0x7f77e8072620 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009d90 tx=0x7f77e001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8111e8cff951ca6a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e4a00640 1 -- 172.21.15.5:0/3504635712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e00b2070 con 0x7f77e806f290 2024-08-18T22:23:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e4a00640 1 -- 172.21.15.5:0/3504635712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e00a5930 con 0x7f77e806f290 2024-08-18T22:23:40.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.258+0000 7f77e4a00640 1 -- 172.21.15.5:0/3504635712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e00a5d00 con 0x7f77e806f290 2024-08-18T22:23:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 -- 172.21.15.5:0/3504635712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e806f290 msgr2=0x7f77e8072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 --2- 172.21.15.5:0/3504635712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e806f290 0x7f77e8072620 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009d90 tx=0x7f77e001c940 comp rx=0 tx=0).stop 2024-08-18T22:23:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 -- 172.21.15.5:0/3504635712 shutdown_connections 2024-08-18T22:23:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 --2- 172.21.15.5:0/3504635712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e806f290 0x7f77e8072620 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 --2- 172.21.15.5:0/3504635712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e815b010 0x7f77e80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 -- 172.21.15.5:0/3504635712 >> 172.21.15.5:0/3504635712 conn(0x7f77e80b1c50 msgr2=0x7f77e80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 -- 172.21.15.5:0/3504635712 shutdown_connections 2024-08-18T22:23:40.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 -- 172.21.15.5:0/3504635712 wait complete. 2024-08-18T22:23:40.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 Processor -- start 2024-08-18T22:23:40.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 -- start start 2024-08-18T22:23:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e806f290 0x7f77e8153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e80cd3a0 0x7f77e8154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e815b010 0x7f77e81550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77e80734f0 con 0x7f77e80cd3a0 2024-08-18T22:23:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8073370 con 0x7f77e815b010 2024-08-18T22:23:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77ed000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f77e8073670 con 0x7f77e806f290 2024-08-18T22:23:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77e5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e80cd3a0 0x7f77e8154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77e5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e80cd3a0 0x7f77e8154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34534/0 (socket says 172.21.15.5:34534) 2024-08-18T22:23:40.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77e5400640 1 -- 172.21.15.5:0/65114151 learned_addr learned my addr 172.21.15.5:0/65114151 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77e6800640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e815b010 0x7f77e81550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77e5e00640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e806f290 0x7f77e8153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77e5400640 1 -- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e806f290 msgr2=0x7f77e8153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77e5400640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e806f290 0x7f77e8153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77e5400640 1 -- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e815b010 msgr2=0x7f77e81550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77e5400640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e815b010 0x7f77e81550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77e5400640 1 -- 172.21.15.5:0/65114151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e80b5270 con 0x7f77e80cd3a0 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77e5400640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e80cd3a0 0x7f77e8154ba0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c460 tx=0x7f77d400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.262+0000 7f77de000640 1 -- 172.21.15.5:0/65114151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4017070 con 0x7f77e80cd3a0 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.266+0000 7f77de000640 1 -- 172.21.15.5:0/65114151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d4005cf0 con 0x7f77e80cd3a0 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.266+0000 7f77de000640 1 -- 172.21.15.5:0/65114151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4007290 con 0x7f77e80cd3a0 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.266+0000 7f77ed000640 1 -- 172.21.15.5:0/65114151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e815b7a0 con 0x7f77e80cd3a0 2024-08-18T22:23:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.266+0000 7f77ed000640 1 -- 172.21.15.5:0/65114151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e815bd60 con 0x7f77e80cd3a0 2024-08-18T22:23:40.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.266+0000 7f77ed000640 1 -- 172.21.15.5:0/65114151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e8072620 con 0x7f77e80cd3a0 2024-08-18T22:23:40.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.266+0000 7f77de000640 1 -- 172.21.15.5:0/65114151 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77d401a070 con 0x7f77e80cd3a0 2024-08-18T22:23:40.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.266+0000 7f77de000640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c80678c0 0x7f77c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.266+0000 7f77de000640 1 -- 172.21.15.5:0/65114151 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f77d4085250 con 0x7f77e80cd3a0 2024-08-18T22:23:40.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.266+0000 7f77e5e00640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c80678c0 0x7f77c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.270+0000 7f77e5e00640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c80678c0 0x7f77c8069d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f77d800b930 tx=0x7f77d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:40.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.270+0000 7f77de000640 1 -- 172.21.15.5:0/65114151 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f77d4055b10 con 0x7f77e80cd3a0 2024-08-18T22:23:40.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 -- 172.21.15.5:0/65114151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77e815bf30 con 0x7f77e80cd3a0 2024-08-18T22:23:40.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77de000640 1 -- 172.21.15.5:0/65114151 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16939 (secure 0 0 0) 0x7f77d4055410 con 0x7f77e80cd3a0 2024-08-18T22:23:40.446 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:40.447 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":71,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:23:24.771847+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:23:06.185079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-08-18T22:23:07.780380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6833/3174043628":"2024-08-19T22:23:24.762498+0000","172.21.15.5:6832/3174043628":"2024-08-19T22:23:24.762498+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:23:40.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 -- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c80678c0 msgr2=0x7f77c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c80678c0 0x7f77c8069d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f77d800b930 tx=0x7f77d8008040 comp rx=0 tx=0).stop 2024-08-18T22:23:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 -- 172.21.15.5:0/65114151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e80cd3a0 msgr2=0x7f77e8154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e80cd3a0 0x7f77e8154ba0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c460 tx=0x7f77d400c920 comp rx=0 tx=0).stop 2024-08-18T22:23:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 -- 172.21.15.5:0/65114151 shutdown_connections 2024-08-18T22:23:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c80678c0 0x7f77c8069d80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e815b010 0x7f77e81550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e80cd3a0 0x7f77e8154ba0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 --2- 172.21.15.5:0/65114151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e806f290 0x7f77e8153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 -- 172.21.15.5:0/65114151 >> 172.21.15.5:0/65114151 conn(0x7f77e80b1c50 msgr2=0x7f77e8159f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 -- 172.21.15.5:0/65114151 shutdown_connections 2024-08-18T22:23:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.442+0000 7f77ed000640 1 -- 172.21.15.5:0/65114151 wait complete. 2024-08-18T22:23:40.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:23:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16eb600640 1 Processor -- start 2024-08-18T22:23:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16eb600640 1 -- start start 2024-08-18T22:23:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16eb600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16e409aca0 0x7f16e40afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16eb600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16e40b1300 0x7f16e40affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16eb600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16e409b080 0x7f16e40b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16eb600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f16e406e8a0 con 0x7f16e409aca0 2024-08-18T22:23:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16eb600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f16e409bb80 con 0x7f16e409b080 2024-08-18T22:23:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16eb600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f16e40d2e40 con 0x7f16e40b1300 2024-08-18T22:23:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16e8c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16e409aca0 0x7f16e40afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16e8c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16e409aca0 0x7f16e40afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34542/0 (socket says 172.21.15.5:34542) 2024-08-18T22:23:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16e8c00640 1 -- 172.21.15.5:0/1501801986 learned_addr learned my addr 172.21.15.5:0/1501801986 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16e9600640 1 --2- 172.21.15.5:0/1501801986 >> v2:172.21.15.117:3300/0 conn(0x7f16e409b080 0x7f16e40b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16e3e00640 1 --2- 172.21.15.5:0/1501801986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16e40b1300 0x7f16e40affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16e8c00640 1 -- 172.21.15.5:0/1501801986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16e40b1300 msgr2=0x7f16e40affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16e8c00640 1 --2- 172.21.15.5:0/1501801986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16e40b1300 0x7f16e40affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16e8c00640 1 -- 172.21.15.5:0/1501801986 >> v2:172.21.15.117:3300/0 conn(0x7f16e409b080 msgr2=0x7f16e40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16e8c00640 1 --2- 172.21.15.5:0/1501801986 >> v2:172.21.15.117:3300/0 conn(0x7f16e409b080 0x7f16e40b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16e8c00640 1 -- 172.21.15.5:0/1501801986 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e406cbd0 con 0x7f16e409aca0 2024-08-18T22:23:40.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.610+0000 7f16e3e00640 1 --2- 172.21.15.5:0/1501801986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16e40b1300 0x7f16e40affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16e8c00640 1 --2- 172.21.15.5:0/1501801986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16e409aca0 0x7f16e40afa90 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f16e406f830 tx=0x7f16d801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5880eb0b0d8bf38f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16e3400640 1 -- 172.21.15.5:0/1501801986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80ab5f0 con 0x7f16e409aca0 2024-08-18T22:23:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16e3400640 1 -- 172.21.15.5:0/1501801986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d80b0070 con 0x7f16e409aca0 2024-08-18T22:23:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16e3400640 1 -- 172.21.15.5:0/1501801986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80ab9b0 con 0x7f16e409aca0 2024-08-18T22:23:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16eb600640 1 -- 172.21.15.5:0/1501801986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16e409aca0 msgr2=0x7f16e40afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16eb600640 1 --2- 172.21.15.5:0/1501801986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16e409aca0 0x7f16e40afa90 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f16e406f830 tx=0x7f16d801c520 comp rx=0 tx=0).stop 2024-08-18T22:23:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16eb600640 1 -- 172.21.15.5:0/1501801986 shutdown_connections 2024-08-18T22:23:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16eb600640 1 --2- 172.21.15.5:0/1501801986 >> v2:172.21.15.117:3300/0 conn(0x7f16e409b080 0x7f16e40b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16eb600640 1 --2- 172.21.15.5:0/1501801986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16e40b1300 0x7f16e40affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16eb600640 1 --2- 172.21.15.5:0/1501801986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16e409aca0 0x7f16e40afa90 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16eb600640 1 -- 172.21.15.5:0/1501801986 >> 172.21.15.5:0/1501801986 conn(0x7f16e40d2180 msgr2=0x7f16e40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16eb600640 1 -- 172.21.15.5:0/1501801986 shutdown_connections 2024-08-18T22:23:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.614+0000 7f16eb600640 1 -- 172.21.15.5:0/1501801986 wait complete. 2024-08-18T22:23:40.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16eb600640 1 Processor -- start 2024-08-18T22:23:40.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16eb600640 1 -- start start 2024-08-18T22:23:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16eb600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16e409aca0 0x7f16e4153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16eb600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16e409b080 0x7f16e4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16eb600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16e40b1300 0x7f16e4156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16eb600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41624e0 con 0x7f16e409aca0 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16eb600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4162360 con 0x7f16e40b1300 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16eb600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f16e4162660 con 0x7f16e409b080 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e8c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16e409aca0 0x7f16e4153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e8c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16e409aca0 0x7f16e4153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34550/0 (socket says 172.21.15.5:34550) 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e8c00640 1 -- 172.21.15.5:0/510789328 learned_addr learned my addr 172.21.15.5:0/510789328 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e3e00640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16e409b080 0x7f16e4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e9600640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16e40b1300 0x7f16e4156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e8c00640 1 -- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16e409b080 msgr2=0x7f16e4071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e8c00640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16e409b080 0x7f16e4071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e8c00640 1 -- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16e40b1300 msgr2=0x7f16e4156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e8c00640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16e40b1300 0x7f16e4156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e8c00640 1 -- 172.21.15.5:0/510789328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e40cc350 con 0x7f16e409aca0 2024-08-18T22:23:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e9600640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16e40b1300 0x7f16e4156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e8c00640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16e409aca0 0x7f16e4153db0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f16d801abd0 tx=0x7f16d801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e0c00640 1 -- 172.21.15.5:0/510789328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80abe60 con 0x7f16e409aca0 2024-08-18T22:23:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e0c00640 1 -- 172.21.15.5:0/510789328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d80be5f0 con 0x7f16e409aca0 2024-08-18T22:23:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16e0c00640 1 -- 172.21.15.5:0/510789328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80be9c0 con 0x7f16e409aca0 2024-08-18T22:23:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16eb600640 1 -- 172.21.15.5:0/510789328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e40cc630 con 0x7f16e409aca0 2024-08-18T22:23:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16eb600640 1 -- 172.21.15.5:0/510789328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e40ccbf0 con 0x7f16e409aca0 2024-08-18T22:23:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.618+0000 7f16eb600640 1 -- 172.21.15.5:0/510789328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e4162990 con 0x7f16e409aca0 2024-08-18T22:23:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.622+0000 7f16e0c00640 1 -- 172.21.15.5:0/510789328 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16d80b43f0 con 0x7f16e409aca0 2024-08-18T22:23:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.622+0000 7f16e0c00640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16c40678c0 0x7f16c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.622+0000 7f16e0c00640 1 -- 172.21.15.5:0/510789328 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6187+0+0 (secure 0 0 0) 0x7f16d811fc50 con 0x7f16e409aca0 2024-08-18T22:23:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.622+0000 7f16e3e00640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16c40678c0 0x7f16c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.622+0000 7f16e3e00640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16c40678c0 0x7f16c4069d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f16e41fa6e0 tx=0x7f16d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:40.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.626+0000 7f16e0c00640 1 -- 172.21.15.5:0/510789328 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f16d8016110 con 0x7f16e409aca0 2024-08-18T22:23:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.830+0000 7f16eb600640 1 -- 172.21.15.5:0/510789328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f16e409b600 con 0x7f16e409aca0 2024-08-18T22:23:40.830 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:23:40.830+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:23:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16e0c00640 1 -- 172.21.15.5:0/510789328 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) ==== 161+0+0 (secure 0 0 0) 0x7f16d80f0070 con 0x7f16e409aca0 2024-08-18T22:23:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:23:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 -- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16c40678c0 msgr2=0x7f16c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16c40678c0 0x7f16c4069d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f16e41fa6e0 tx=0x7f16d0008040 comp rx=0 tx=0).stop 2024-08-18T22:23:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 -- 172.21.15.5:0/510789328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16e409aca0 msgr2=0x7f16e4153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16e409aca0 0x7f16e4153db0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f16d801abd0 tx=0x7f16d801ad60 comp rx=0 tx=0).stop 2024-08-18T22:23:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 -- 172.21.15.5:0/510789328 shutdown_connections 2024-08-18T22:23:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16c40678c0 0x7f16c4069d80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16e40b1300 0x7f16e4156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16e409b080 0x7f16e4071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 --2- 172.21.15.5:0/510789328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16e409aca0 0x7f16e4153db0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 -- 172.21.15.5:0/510789328 >> 172.21.15.5:0/510789328 conn(0x7f16e40d2180 msgr2=0x7f16e40d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 -- 172.21.15.5:0/510789328 shutdown_connections 2024-08-18T22:23:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:40.834+0000 7f16eb600640 1 -- 172.21.15.5:0/510789328 wait complete. 2024-08-18T22:23:40.842 INFO:tasks.ceph.mds.c.smithi005.stderr: -2122> 2024-08-18T22:23:31.770+0000 7fa23fc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:23:40.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:23:40.888 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:23:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbd6e00640 1 Processor -- start 2024-08-18T22:23:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbd6e00640 1 -- start start 2024-08-18T22:23:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbd6e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015b0c0 0x7fcbd006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbd6e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbd00b31f0 con 0x7fcbd00b40c0 2024-08-18T22:23:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbd6e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbd00b34d0 con 0x7fcbd00cf290 2024-08-18T22:23:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbd6e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd00b3d70 con 0x7fcbd015b0c0 2024-08-18T22:23:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbcf400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcbd00b40c0 0x7fcbd0072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34826/0 (socket says 172.21.15.5:34826) 2024-08-18T22:23:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbcf400640 1 -- 172.21.15.5:0/3917838948 learned_addr learned my addr 172.21.15.5:0/3917838948 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbcfe00640 1 --2- 172.21.15.5:0/3917838948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015b0c0 0x7fcbd006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbcea00640 1 -- 172.21.15.5:0/3917838948 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933636869 0 0) 0x7fcbd00b31f0 con 0x7fcbd00b40c0 2024-08-18T22:23:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbcea00640 1 -- 172.21.15.5:0/3917838948 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbb4003530 con 0x7fcbd00b40c0 2024-08-18T22:23:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbcea00640 1 -- 172.21.15.5:0/3917838948 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2963989659 0 0) 0x7fcbd00b34d0 con 0x7fcbd00cf290 2024-08-18T22:23:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbcea00640 1 -- 172.21.15.5:0/3917838948 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbd00b31f0 con 0x7fcbd00cf290 2024-08-18T22:23:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbcfe00640 1 -- 172.21.15.5:0/3917838948 >> v1:172.21.15.117:6789/0 conn(0x7fcbd00cf290 legacy=0x7fcbd0073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbcfe00640 1 -- 172.21.15.5:0/3917838948 >> v1:172.21.15.5:6789/0 conn(0x7fcbd00b40c0 legacy=0x7fcbd0072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.002+0000 7fcbcfe00640 1 -- 172.21.15.5:0/3917838948 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd00b37b0 con 0x7fcbd015b0c0 2024-08-18T22:23:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.006+0000 7fcbcfe00640 1 --2- 172.21.15.5:0/3917838948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015b0c0 0x7fcbd006db80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcbd00b3ef0 tx=0x7fcbc001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b54dd92d3ecb05e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.006+0000 7fcbcea00640 1 -- 172.21.15.5:0/3917838948 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00b1070 con 0x7fcbd015b0c0 2024-08-18T22:23:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.006+0000 7fcbcea00640 1 -- 172.21.15.5:0/3917838948 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc00ac5f0 con 0x7fcbd015b0c0 2024-08-18T22:23:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.006+0000 7fcbcea00640 1 -- 172.21.15.5:0/3917838948 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00ac9a0 con 0x7fcbd015b0c0 2024-08-18T22:23:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.006+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3917838948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015b0c0 msgr2=0x7fcbd006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.006+0000 7fcbd6e00640 1 --2- 172.21.15.5:0/3917838948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015b0c0 0x7fcbd006db80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcbd00b3ef0 tx=0x7fcbc001c370 comp rx=0 tx=0).stop 2024-08-18T22:23:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.006+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3917838948 shutdown_connections 2024-08-18T22:23:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.006+0000 7fcbd6e00640 1 --2- 172.21.15.5:0/3917838948 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015b0c0 0x7fcbd006db80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.006+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3917838948 >> 172.21.15.5:0/3917838948 conn(0x7fcbd00b1dc0 msgr2=0x7fcbd00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.006+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3917838948 shutdown_connections 2024-08-18T22:23:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.006+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3917838948 wait complete. 2024-08-18T22:23:41.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbd6e00640 1 Processor -- start 2024-08-18T22:23:41.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbd6e00640 1 -- start start 2024-08-18T22:23:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbd6e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd00b40c0 0x7fcbd014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbd6e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbd00cf290 0x7fcbd00cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbd6e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015b0c0 0x7fcbd00c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbd6e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd015b620 con 0x7fcbd00b40c0 2024-08-18T22:23:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbd6e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd015b4a0 con 0x7fcbd00cf290 2024-08-18T22:23:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbd6e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd00b48b0 con 0x7fcbd015b0c0 2024-08-18T22:23:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbcfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd00b40c0 0x7fcbd014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbcfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd00b40c0 0x7fcbd014aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34586/0 (socket says 172.21.15.5:34586) 2024-08-18T22:23:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbcfe00640 1 -- 172.21.15.5:0/3909902768 learned_addr learned my addr 172.21.15.5:0/3909902768 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbcf400640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbd00cf290 0x7fcbd00cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbd4e00640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015b0c0 0x7fcbd00c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbcfe00640 1 -- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015b0c0 msgr2=0x7fcbd00c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbcfe00640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015b0c0 0x7fcbd00c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbcfe00640 1 -- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbd00cf290 msgr2=0x7fcbd00cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbcfe00640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbd00cf290 0x7fcbd00cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbcfe00640 1 -- 172.21.15.5:0/3909902768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd00cb470 con 0x7fcbd00b40c0 2024-08-18T22:23:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbcfe00640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd00b40c0 0x7fcbd014aa70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0000c10 tx=0x7fcbc0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbc7e00640 1 -- 172.21.15.5:0/3909902768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00bb070 con 0x7fcbd00b40c0 2024-08-18T22:23:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbc7e00640 1 -- 172.21.15.5:0/3909902768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc00b6460 con 0x7fcbd00b40c0 2024-08-18T22:23:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbc7e00640 1 -- 172.21.15.5:0/3909902768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00b1040 con 0x7fcbd00b40c0 2024-08-18T22:23:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3909902768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd00cb750 con 0x7fcbd00b40c0 2024-08-18T22:23:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.010+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3909902768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd00cb180 con 0x7fcbd00b40c0 2024-08-18T22:23:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.014+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3909902768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd006f670 con 0x7fcbd00b40c0 2024-08-18T22:23:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.014+0000 7fcbc7e00640 1 -- 172.21.15.5:0/3909902768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcbc00be070 con 0x7fcbd00b40c0 2024-08-18T22:23:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.014+0000 7fcbc7e00640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbb00678c0 0x7fcbb0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.014+0000 7fcbc7e00640 1 -- 172.21.15.5:0/3909902768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7fcbc01202e0 con 0x7fcbd00b40c0 2024-08-18T22:23:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.014+0000 7fcbcf400640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbb00678c0 0x7fcbb0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.014+0000 7fcbcf400640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbb00678c0 0x7fcbb0069d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0166a80 tx=0x7fcbbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:41.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.018+0000 7fcbc7e00640 1 -- 172.21.15.5:0/3909902768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcbc00a9070 con 0x7fcbd00b40c0 2024-08-18T22:23:41.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.218+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3909902768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcbd01557b0 con 0x7fcbd00b40c0 2024-08-18T22:23:41.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.834+0000 7fcbc7e00640 1 -- 172.21.15.5:0/3909902768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7fcbc00160b0 con 0x7fcbd00b40c0 2024-08-18T22:23:41.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbb00678c0 msgr2=0x7fcbb0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbb00678c0 0x7fcbb0069d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0166a80 tx=0x7fcbbc009040 comp rx=0 tx=0).stop 2024-08-18T22:23:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3909902768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd00b40c0 msgr2=0x7fcbd014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd00b40c0 0x7fcbd014aa70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0000c10 tx=0x7fcbc0019110 comp rx=0 tx=0).stop 2024-08-18T22:23:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3909902768 shutdown_connections 2024-08-18T22:23:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbb00678c0 0x7fcbb0069d80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbd015b0c0 0x7fcbd00c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbd00cf290 0x7fcbd00cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 --2- 172.21.15.5:0/3909902768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbd00b40c0 0x7fcbd014aa70 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3909902768 >> 172.21.15.5:0/3909902768 conn(0x7fcbd00b1dc0 msgr2=0x7fcbd00729f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3909902768 shutdown_connections 2024-08-18T22:23:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:41.838+0000 7fcbd6e00640 1 -- 172.21.15.5:0/3909902768 wait complete. 2024-08-18T22:23:41.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:23:42.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac83200640 1 Processor -- start 2024-08-18T22:23:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac83200640 1 -- start start 2024-08-18T22:23:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac83200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac7c15c0d0 0x7fac7c0af620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac83200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac7c06ffc0 con 0x7fac7c0b50d0 2024-08-18T22:23:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac83200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac7c0702a0 con 0x7fac7c09b150 2024-08-18T22:23:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac83200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fac7c15c4b0 con 0x7fac7c15c0d0 2024-08-18T22:23:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac7be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac7c15c0d0 0x7fac7c0af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac7be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac7c15c0d0 0x7fac7c0af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34594/0 (socket says 172.21.15.5:34594) 2024-08-18T22:23:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac7be00640 1 -- 172.21.15.5:0/1014522831 learned_addr learned my addr 172.21.15.5:0/1014522831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac7be00640 1 -- 172.21.15.5:0/1014522831 >> v1:172.21.15.117:6789/0 conn(0x7fac7c09b150 legacy=0x7fac7c071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac7be00640 1 -- 172.21.15.5:0/1014522831 >> v1:172.21.15.5:6789/0 conn(0x7fac7c0b50d0 legacy=0x7fac7c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.054+0000 7fac7be00640 1 -- 172.21.15.5:0/1014522831 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c070580 con 0x7fac7c15c0d0 2024-08-18T22:23:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.058+0000 7fac7be00640 1 --2- 172.21.15.5:0/1014522831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7c15c0d0 0x7fac7c0af620 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009870 tx=0x7fac6c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15273f1732de1fb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.058+0000 7fac7aa00640 1 -- 172.21.15.5:0/1014522831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0b0070 con 0x7fac7c15c0d0 2024-08-18T22:23:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.058+0000 7fac7aa00640 1 -- 172.21.15.5:0/1014522831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6c0ab600 con 0x7fac7c15c0d0 2024-08-18T22:23:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.058+0000 7fac7aa00640 1 -- 172.21.15.5:0/1014522831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0ab9d0 con 0x7fac7c15c0d0 2024-08-18T22:23:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.058+0000 7fac83200640 1 -- 172.21.15.5:0/1014522831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7c15c0d0 msgr2=0x7fac7c0af620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.058+0000 7fac83200640 1 --2- 172.21.15.5:0/1014522831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7c15c0d0 0x7fac7c0af620 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009870 tx=0x7fac6c01c520 comp rx=0 tx=0).stop 2024-08-18T22:23:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.058+0000 7fac83200640 1 -- 172.21.15.5:0/1014522831 shutdown_connections 2024-08-18T22:23:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.058+0000 7fac83200640 1 --2- 172.21.15.5:0/1014522831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7c15c0d0 0x7fac7c0af620 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.058+0000 7fac83200640 1 -- 172.21.15.5:0/1014522831 >> 172.21.15.5:0/1014522831 conn(0x7fac7c0b3dd0 msgr2=0x7fac7c0b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.058+0000 7fac83200640 1 -- 172.21.15.5:0/1014522831 shutdown_connections 2024-08-18T22:23:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.058+0000 7fac83200640 1 -- 172.21.15.5:0/1014522831 wait complete. 2024-08-18T22:23:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac83200640 1 Processor -- start 2024-08-18T22:23:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac83200640 1 -- start start 2024-08-18T22:23:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac83200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac7c09b150 0x7fac7c14dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac83200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac7c0b50d0 0x7fac7c06d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac83200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7c15c0d0 0x7fac7c156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac83200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c071d00 con 0x7fac7c15c0d0 2024-08-18T22:23:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac83200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c071b80 con 0x7fac7c0b50d0 2024-08-18T22:23:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac83200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fac7c16a560 con 0x7fac7c09b150 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac81200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7c15c0d0 0x7fac7c156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac81200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7c15c0d0 0x7fac7c156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34600/0 (socket says 172.21.15.5:34600) 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac81200640 1 -- 172.21.15.5:0/3847269244 learned_addr learned my addr 172.21.15.5:0/3847269244 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac7b400640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac7c0b50d0 0x7fac7c06d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac7be00640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac7c09b150 0x7fac7c14dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac81200640 1 -- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac7c09b150 msgr2=0x7fac7c14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac81200640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac7c09b150 0x7fac7c14dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac81200640 1 -- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac7c0b50d0 msgr2=0x7fac7c06d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac81200640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac7c0b50d0 0x7fac7c06d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac81200640 1 -- 172.21.15.5:0/3847269244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c151380 con 0x7fac7c15c0d0 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac7b400640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac7c0b50d0 0x7fac7c06d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac7be00640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac7c09b150 0x7fac7c14dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac81200640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7c15c0d0 0x7fac7c156fe0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fac7400b970 tx=0x7fac7400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:42.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac73e00640 1 -- 172.21.15.5:0/3847269244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74019070 con 0x7fac7c15c0d0 2024-08-18T22:23:42.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac73e00640 1 -- 172.21.15.5:0/3847269244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7400cb40 con 0x7fac7c15c0d0 2024-08-18T22:23:42.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac73e00640 1 -- 172.21.15.5:0/3847269244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74014440 con 0x7fac7c15c0d0 2024-08-18T22:23:42.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac83200640 1 -- 172.21.15.5:0/3847269244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7c14d640 con 0x7fac7c15c0d0 2024-08-18T22:23:42.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac83200640 1 -- 172.21.15.5:0/3847269244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7c1518e0 con 0x7fac7c15c0d0 2024-08-18T22:23:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.062+0000 7fac83200640 1 -- 172.21.15.5:0/3847269244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac7c0af620 con 0x7fac7c15c0d0 2024-08-18T22:23:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.066+0000 7fac73e00640 1 -- 172.21.15.5:0/3847269244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac7401c070 con 0x7fac7c15c0d0 2024-08-18T22:23:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.066+0000 7fac73e00640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac5c0678c0 0x7fac5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.066+0000 7fac73e00640 1 -- 172.21.15.5:0/3847269244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6273+0+0 (secure 0 0 0) 0x7fac74085ba0 con 0x7fac7c15c0d0 2024-08-18T22:23:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.066+0000 7fac7be00640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac5c0678c0 0x7fac5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:42.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.066+0000 7fac7be00640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac5c0678c0 0x7fac5c069d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0ad000 tx=0x7fac6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:42.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.070+0000 7fac73e00640 1 -- 172.21.15.5:0/3847269244 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fac7c151380 con 0x7fac7c15c0d0 2024-08-18T22:23:42.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:42.238+0000 7fac83200640 1 -- 172.21.15.5:0/3847269244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac7c09bc90 con 0x7fac7c15c0d0 2024-08-18T22:23:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.178+0000 7fac73e00640 1 -- 172.21.15.5:0/3847269244 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) ==== 181+0+0 (secure 0 0 0) 0x7fac74056400 con 0x7fac7c15c0d0 2024-08-18T22:23:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:23:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 -- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac5c0678c0 msgr2=0x7fac5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac5c0678c0 0x7fac5c069d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0ad000 tx=0x7fac6c008040 comp rx=0 tx=0).stop 2024-08-18T22:23:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 -- 172.21.15.5:0/3847269244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7c15c0d0 msgr2=0x7fac7c156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7c15c0d0 0x7fac7c156fe0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fac7400b970 tx=0x7fac7400be30 comp rx=0 tx=0).stop 2024-08-18T22:23:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 -- 172.21.15.5:0/3847269244 shutdown_connections 2024-08-18T22:23:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fac5c0678c0 0x7fac5c069d80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7c15c0d0 0x7fac7c156fe0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac7c0b50d0 0x7fac7c06d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 --2- 172.21.15.5:0/3847269244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac7c09b150 0x7fac7c14dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 -- 172.21.15.5:0/3847269244 >> 172.21.15.5:0/3847269244 conn(0x7fac7c0b3dd0 msgr2=0x7fac7c14b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 -- 172.21.15.5:0/3847269244 shutdown_connections 2024-08-18T22:23:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.182+0000 7fac83200640 1 -- 172.21.15.5:0/3847269244 wait complete. 2024-08-18T22:23:43.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:23:43.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd90d200640 1 Processor -- start 2024-08-18T22:23:43.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd90d200640 1 -- start start 2024-08-18T22:23:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd90d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9080cceb0 0x7fd9080ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd90d200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd908161f70 con 0x7fd9080cca50 2024-08-18T22:23:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd90d200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd908162250 con 0x7fd90815e350 2024-08-18T22:23:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd90d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd908162530 con 0x7fd9080cceb0 2024-08-18T22:23:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd8fd400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd9080cca50 0x7fd9080cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34852/0 (socket says 172.21.15.5:34852) 2024-08-18T22:23:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd8fd400640 1 -- 172.21.15.5:0/530339602 learned_addr learned my addr 172.21.15.5:0/530339602 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd906800640 1 --2- 172.21.15.5:0/530339602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9080cceb0 0x7fd9080ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd905400640 1 -- 172.21.15.5:0/530339602 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759597710 0 0) 0x7fd908161f70 con 0x7fd9080cca50 2024-08-18T22:23:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd905400640 1 -- 172.21.15.5:0/530339602 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8ec003530 con 0x7fd9080cca50 2024-08-18T22:23:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd905400640 1 -- 172.21.15.5:0/530339602 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606620223 0 0) 0x7fd908162250 con 0x7fd90815e350 2024-08-18T22:23:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd905400640 1 -- 172.21.15.5:0/530339602 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd908161f70 con 0x7fd90815e350 2024-08-18T22:23:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd906800640 1 -- 172.21.15.5:0/530339602 >> v1:172.21.15.117:6789/0 conn(0x7fd90815e350 legacy=0x7fd9080b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd906800640 1 -- 172.21.15.5:0/530339602 >> v1:172.21.15.5:6789/0 conn(0x7fd9080cca50 legacy=0x7fd9080cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.358+0000 7fd906800640 1 -- 172.21.15.5:0/530339602 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd908162810 con 0x7fd9080cceb0 2024-08-18T22:23:43.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.362+0000 7fd906800640 1 --2- 172.21.15.5:0/530339602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9080cceb0 0x7fd9080ce620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd900009dc0 tx=0x7fd90001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36413c7090c9c4f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:43.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.362+0000 7fd905400640 1 -- 172.21.15.5:0/530339602 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000b2070 con 0x7fd9080cceb0 2024-08-18T22:23:43.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.362+0000 7fd905400640 1 -- 172.21.15.5:0/530339602 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9000a5850 con 0x7fd9080cceb0 2024-08-18T22:23:43.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.362+0000 7fd905400640 1 -- 172.21.15.5:0/530339602 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000a5c00 con 0x7fd9080cceb0 2024-08-18T22:23:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.362+0000 7fd90d200640 1 -- 172.21.15.5:0/530339602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9080cceb0 msgr2=0x7fd9080ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.362+0000 7fd90d200640 1 --2- 172.21.15.5:0/530339602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9080cceb0 0x7fd9080ce620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd900009dc0 tx=0x7fd90001c990 comp rx=0 tx=0).stop 2024-08-18T22:23:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.362+0000 7fd90d200640 1 -- 172.21.15.5:0/530339602 shutdown_connections 2024-08-18T22:23:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.362+0000 7fd90d200640 1 --2- 172.21.15.5:0/530339602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9080cceb0 0x7fd9080ce620 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.362+0000 7fd90d200640 1 -- 172.21.15.5:0/530339602 >> 172.21.15.5:0/530339602 conn(0x7fd90806b9b0 msgr2=0x7fd90806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.362+0000 7fd90d200640 1 -- 172.21.15.5:0/530339602 shutdown_connections 2024-08-18T22:23:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.362+0000 7fd90d200640 1 -- 172.21.15.5:0/530339602 wait complete. 2024-08-18T22:23:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd90d200640 1 Processor -- start 2024-08-18T22:23:43.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd90d200640 1 -- start start 2024-08-18T22:23:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd90d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9080cca50 0x7fd908146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd90d200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9080cceb0 0x7fd90815a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd90d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd90815e350 0x7fd90815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd90d200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd9080cfd90 con 0x7fd9080cca50 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd90d200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd9080cfc10 con 0x7fd9080cceb0 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd90d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd9080b3b20 con 0x7fd90815e350 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd905e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9080cca50 0x7fd908146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd905e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9080cca50 0x7fd908146470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34608/0 (socket says 172.21.15.5:34608) 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd905e00640 1 -- 172.21.15.5:0/2809689771 learned_addr learned my addr 172.21.15.5:0/2809689771 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd905e00640 1 -- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd90815e350 msgr2=0x7fd90815c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd905e00640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd90815e350 0x7fd90815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd905e00640 1 -- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9080cceb0 msgr2=0x7fd90815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd8fd400640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9080cceb0 0x7fd90815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd905e00640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9080cceb0 0x7fd90815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd905e00640 1 -- 172.21.15.5:0/2809689771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd908145710 con 0x7fd9080cca50 2024-08-18T22:23:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd8fd400640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9080cceb0 0x7fd90815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd905e00640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9080cca50 0x7fd908146470 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c4c0 tx=0x7fd8f800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd8fea00640 1 -- 172.21.15.5:0/2809689771 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80052d0 con 0x7fd9080cca50 2024-08-18T22:23:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd8fea00640 1 -- 172.21.15.5:0/2809689771 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f8005470 con 0x7fd9080cca50 2024-08-18T22:23:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd90d200640 1 -- 172.21.15.5:0/2809689771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9080b1af0 con 0x7fd9080cca50 2024-08-18T22:23:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd8fea00640 1 -- 172.21.15.5:0/2809689771 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8012870 con 0x7fd9080cca50 2024-08-18T22:23:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd90d200640 1 -- 172.21.15.5:0/2809689771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd908145c70 con 0x7fd9080cca50 2024-08-18T22:23:43.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.366+0000 7fd90d200640 1 -- 172.21.15.5:0/2809689771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9080b3410 con 0x7fd9080cca50 2024-08-18T22:23:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.370+0000 7fd8fea00640 1 -- 172.21.15.5:0/2809689771 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8f8012a10 con 0x7fd9080cca50 2024-08-18T22:23:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.370+0000 7fd8fea00640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8e40678f0 0x7fd8e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.370+0000 7fd8fea00640 1 -- 172.21.15.5:0/2809689771 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5835+0+0 (secure 0 0 0) 0x7fd8f8085940 con 0x7fd9080cca50 2024-08-18T22:23:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.370+0000 7fd8fd400640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8e40678f0 0x7fd8e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.370+0000 7fd8fd400640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8e40678f0 0x7fd8e4069db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd9080b4150 tx=0x7fd8f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:43.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.374+0000 7fd8fea00640 1 -- 172.21.15.5:0/2809689771 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd908145710 con 0x7fd9080cca50 2024-08-18T22:23:43.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:43.538+0000 7fd90d200640 1 -- 172.21.15.5:0/2809689771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd90815d150 con 0x7fd9080cca50 2024-08-18T22:23:44.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd8fea00640 1 -- 172.21.15.5:0/2809689771 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) ==== 169+0+0 (secure 0 0 0) 0x7fd8f8056490 con 0x7fd9080cca50 2024-08-18T22:23:44.186 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:23:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 -- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8e40678f0 msgr2=0x7fd8e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8e40678f0 0x7fd8e4069db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd9080b4150 tx=0x7fd8f0009040 comp rx=0 tx=0).stop 2024-08-18T22:23:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 -- 172.21.15.5:0/2809689771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9080cca50 msgr2=0x7fd908146470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9080cca50 0x7fd908146470 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c4c0 tx=0x7fd8f800c980 comp rx=0 tx=0).stop 2024-08-18T22:23:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 -- 172.21.15.5:0/2809689771 shutdown_connections 2024-08-18T22:23:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8e40678f0 0x7fd8e4069db0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd90815e350 0x7fd90815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9080cceb0 0x7fd90815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 --2- 172.21.15.5:0/2809689771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9080cca50 0x7fd908146470 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 -- 172.21.15.5:0/2809689771 >> 172.21.15.5:0/2809689771 conn(0x7fd90806b9b0 msgr2=0x7fd90806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 -- 172.21.15.5:0/2809689771 shutdown_connections 2024-08-18T22:23:44.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.186+0000 7fd90d200640 1 -- 172.21.15.5:0/2809689771 wait complete. 2024-08-18T22:23:44.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-08-18T22:23:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33eac00640 1 Processor -- start 2024-08-18T22:23:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33eac00640 1 -- start start 2024-08-18T22:23:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33eac00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33e4147dd0 0x7f33e40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33eac00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e40b46b0 con 0x7f33e406c3c0 2024-08-18T22:23:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33eac00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e406c820 con 0x7f33e415f000 2024-08-18T22:23:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33eac00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f33e415f7c0 con 0x7f33e4147dd0 2024-08-18T22:23:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e3400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f33e406c3c0 0x7f33e415e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47912/0 (socket says 172.21.15.5:47912) 2024-08-18T22:23:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e3400640 1 -- 172.21.15.5:0/3976586448 learned_addr learned my addr 172.21.15.5:0/3976586448 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3958002 0 0) 0x7f33e40b46b0 con 0x7f33e406c3c0 2024-08-18T22:23:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e3e00640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33e4147dd0 0x7f33e40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33c8003530 con 0x7f33e406c3c0 2024-08-18T22:23:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264050832 0 0) 0x7f33e406c820 con 0x7f33e415f000 2024-08-18T22:23:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33e40b46b0 con 0x7f33e415f000 2024-08-18T22:23:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1826572252 0 0) 0x7f33c8003530 con 0x7f33e406c3c0 2024-08-18T22:23:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33e4147dd0 msgr2=0x7f33e40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33e4147dd0 0x7f33e40b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 >> v1:172.21.15.117:6789/0 conn(0x7f33e415f000 legacy=0x7f33e40d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e40b2720 con 0x7f33e406c3c0 2024-08-18T22:23:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f33d0001680 con 0x7f33e406c3c0 2024-08-18T22:23:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 >> v1:172.21.15.5:6789/0 conn(0x7f33e406c3c0 legacy=0x7f33e415e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c8003b80 0x7f33c8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33c8004810 0x7f33c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33e4147dd0 0x7f33c80051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f33e415f7c0 con 0x7f33c8003b80 2024-08-18T22:23:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33c800bae0 con 0x7f33c8004810 2024-08-18T22:23:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f33c800bce0 con 0x7f33e4147dd0 2024-08-18T22:23:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e3e00640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c8003b80 0x7f33c8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e3400640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33c8004810 0x7f33c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e8c00640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33e4147dd0 0x7f33c80051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e3e00640 1 -- 172.21.15.5:0/3976586448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33e4147dd0 msgr2=0x7f33c80051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e3e00640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33e4147dd0 0x7f33c80051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e3e00640 1 -- 172.21.15.5:0/3976586448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33c8004810 msgr2=0x7f33c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e3e00640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33c8004810 0x7f33c8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.354+0000 7f33e3e00640 1 -- 172.21.15.5:0/3976586448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c8003530 con 0x7f33c8003b80 2024-08-18T22:23:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.358+0000 7f33e3e00640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c8003b80 0x7f33c8003f80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009ae0 tx=0x7f33d401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5402422d7086082 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.358+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d40096b0 con 0x7f33c8003b80 2024-08-18T22:23:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.358+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33d40a6450 con 0x7f33c8003b80 2024-08-18T22:23:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.358+0000 7f33e2a00640 1 -- 172.21.15.5:0/3976586448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d40a6840 con 0x7f33c8003b80 2024-08-18T22:23:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.358+0000 7f33eac00640 1 -- 172.21.15.5:0/3976586448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c8003b80 msgr2=0x7f33c8003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.358+0000 7f33eac00640 1 --2- 172.21.15.5:0/3976586448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c8003b80 0x7f33c8003f80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009ae0 tx=0x7f33d401ca70 comp rx=0 tx=0).stop 2024-08-18T22:23:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.358+0000 7f33e8c00640 1 -- 172.21.15.5:0/3976586448 reap_dead start 2024-08-18T22:23:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.358+0000 7f33eac00640 1 -- 172.21.15.5:0/3976586448 shutdown_connections 2024-08-18T22:23:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.358+0000 7f33eac00640 1 -- 172.21.15.5:0/3976586448 >> 172.21.15.5:0/3976586448 conn(0x7f33e40b65f0 msgr2=0x7f33e40b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.358+0000 7f33eac00640 1 -- 172.21.15.5:0/3976586448 shutdown_connections 2024-08-18T22:23:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.358+0000 7f33eac00640 1 -- 172.21.15.5:0/3976586448 wait complete. 2024-08-18T22:23:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33eac00640 1 Processor -- start 2024-08-18T22:23:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33eac00640 1 -- start start 2024-08-18T22:23:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33eac00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33c8003b80 0x7f33e4165020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33eac00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e4141570 0x7f33e41425f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33eac00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e41419f0 0x7f33e4142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33eac00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f33e40b5cb0 con 0x7f33e4141570 2024-08-18T22:23:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33eac00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33e40b5b30 con 0x7f33e41419f0 2024-08-18T22:23:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33eac00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f33e416a050 con 0x7f33c8003b80 2024-08-18T22:23:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33e3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e4141570 0x7f33e41425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33e3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e4141570 0x7f33e41425f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45784/0 (socket says 172.21.15.5:45784) 2024-08-18T22:23:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33e3400640 1 -- 172.21.15.5:0/2074005779 learned_addr learned my addr 172.21.15.5:0/2074005779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33e3e00640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33c8003b80 0x7f33e4165020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33e8c00640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e41419f0 0x7f33e4142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33e3400640 1 -- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33c8003b80 msgr2=0x7f33e4165020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33e3400640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33c8003b80 0x7f33e4165020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33e3400640 1 -- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e41419f0 msgr2=0x7f33e4142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33e3400640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e41419f0 0x7f33e4142b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33e3400640 1 -- 172.21.15.5:0/2074005779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e4162250 con 0x7f33e4141570 2024-08-18T22:23:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33e3400640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e4141570 0x7f33e41425f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f33d0004e80 tx=0x7f33d0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33dbe00640 1 -- 172.21.15.5:0/2074005779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d000f730 con 0x7f33e4141570 2024-08-18T22:23:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33dbe00640 1 -- 172.21.15.5:0/2074005779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33d0018070 con 0x7f33e4141570 2024-08-18T22:23:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33eac00640 1 -- 172.21.15.5:0/2074005779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e4162530 con 0x7f33e4141570 2024-08-18T22:23:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33dbe00640 1 -- 172.21.15.5:0/2074005779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d000fb50 con 0x7f33e4141570 2024-08-18T22:23:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.362+0000 7f33eac00640 1 -- 172.21.15.5:0/2074005779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e4162af0 con 0x7f33e4141570 2024-08-18T22:23:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.366+0000 7f33eac00640 1 -- 172.21.15.5:0/2074005779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e415e8f0 con 0x7f33e4141570 2024-08-18T22:23:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.366+0000 7f33dbe00640 1 -- 172.21.15.5:0/2074005779 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33d000fcf0 con 0x7f33e4141570 2024-08-18T22:23:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.366+0000 7f33dbe00640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c40678c0 0x7f33c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.366+0000 7f33dbe00640 1 -- 172.21.15.5:0/2074005779 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f33d0085890 con 0x7f33e4141570 2024-08-18T22:23:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.366+0000 7f33e3e00640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c40678c0 0x7f33c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.366+0000 7f33e3e00640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c40678c0 0x7f33c4069d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f33d40ad000 tx=0x7f33d40b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.370+0000 7f33dbe00640 1 -- 172.21.15.5:0/2074005779 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f33d0055e90 con 0x7f33e4141570 2024-08-18T22:23:44.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.534+0000 7f33eac00640 1 -- 172.21.15.5:0/2074005779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7f33e4166a80 con 0x7f33e4141570 2024-08-18T22:23:44.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.538+0000 7f33dbe00640 1 -- 172.21.15.5:0/2074005779 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v20) ==== 101+0+0 (secure 0 0 0) 0x7f33d005a190 con 0x7f33e4141570 2024-08-18T22:23:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 -- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c40678c0 msgr2=0x7f33c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c40678c0 0x7f33c4069d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f33d40ad000 tx=0x7f33d40b2040 comp rx=0 tx=0).stop 2024-08-18T22:23:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 -- 172.21.15.5:0/2074005779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e4141570 msgr2=0x7f33e41425f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e4141570 0x7f33e41425f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f33d0004e80 tx=0x7f33d0007430 comp rx=0 tx=0).stop 2024-08-18T22:23:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 -- 172.21.15.5:0/2074005779 shutdown_connections 2024-08-18T22:23:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c40678c0 0x7f33c4069d80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33e41419f0 0x7f33e4142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e4141570 0x7f33e41425f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 --2- 172.21.15.5:0/2074005779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33c8003b80 0x7f33e4165020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 -- 172.21.15.5:0/2074005779 >> 172.21.15.5:0/2074005779 conn(0x7f33e40b65f0 msgr2=0x7f33e4070230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 -- 172.21.15.5:0/2074005779 shutdown_connections 2024-08-18T22:23:44.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.542+0000 7f33eac00640 1 -- 172.21.15.5:0/2074005779 wait complete. 2024-08-18T22:23:44.562 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:23:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b6fa00640 1 Processor -- start 2024-08-18T22:23:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b6fa00640 1 -- start start 2024-08-18T22:23:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b6fa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b6815c560 0x7f0b680ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b6fa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6815d4d0 0x7f0b6806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b6fa00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b680cfb00 con 0x7f0b6815c180 2024-08-18T22:23:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b6fa00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0b6815d040 con 0x7f0b6815c560 2024-08-18T22:23:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b6fa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0b6815c9f0 con 0x7f0b6815d4d0 2024-08-18T22:23:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b67e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b6815c560 0x7f0b680ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b6d000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0b6815c180 0x7f0b680cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47916/0 (socket says 172.21.15.5:47916) 2024-08-18T22:23:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b6d000640 1 -- 172.21.15.5:0/870101310 learned_addr learned my addr 172.21.15.5:0/870101310 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b67e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b6815c560 0x7f0b680ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45788/0 (socket says 172.21.15.5:45788) 2024-08-18T22:23:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b6da00640 1 --2- 172.21.15.5:0/870101310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6815d4d0 0x7f0b6806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b67e00640 1 -- 172.21.15.5:0/870101310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6815d4d0 msgr2=0x7f0b6806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b67e00640 1 --2- 172.21.15.5:0/870101310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6815d4d0 0x7f0b6806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b67e00640 1 -- 172.21.15.5:0/870101310 >> v1:172.21.15.5:6789/0 conn(0x7f0b6815c180 legacy=0x7f0b680cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.706+0000 7f0b67e00640 1 -- 172.21.15.5:0/870101310 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6815ccd0 con 0x7f0b6815c560 2024-08-18T22:23:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b67e00640 1 --2- 172.21.15.5:0/870101310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b6815c560 0x7f0b680ce620 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0b540097c0 tx=0x7f0b5401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396c67be926d36c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b67400640 1 -- 172.21.15.5:0/870101310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b540ab430 con 0x7f0b6815c560 2024-08-18T22:23:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b67400640 1 -- 172.21.15.5:0/870101310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b540b0070 con 0x7f0b6815c560 2024-08-18T22:23:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b67400640 1 -- 172.21.15.5:0/870101310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b540ab7f0 con 0x7f0b6815c560 2024-08-18T22:23:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b6fa00640 1 -- 172.21.15.5:0/870101310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b6815c560 msgr2=0x7f0b680ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b6fa00640 1 --2- 172.21.15.5:0/870101310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b6815c560 0x7f0b680ce620 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0b540097c0 tx=0x7f0b5401c410 comp rx=0 tx=0).stop 2024-08-18T22:23:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b6fa00640 1 -- 172.21.15.5:0/870101310 shutdown_connections 2024-08-18T22:23:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b6fa00640 1 --2- 172.21.15.5:0/870101310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6815d4d0 0x7f0b6806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b6fa00640 1 --2- 172.21.15.5:0/870101310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b6815c560 0x7f0b680ce620 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b6fa00640 1 -- 172.21.15.5:0/870101310 >> 172.21.15.5:0/870101310 conn(0x7f0b680b1dc0 msgr2=0x7f0b680b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b6fa00640 1 -- 172.21.15.5:0/870101310 shutdown_connections 2024-08-18T22:23:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b6fa00640 1 -- 172.21.15.5:0/870101310 wait complete. 2024-08-18T22:23:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b6fa00640 1 Processor -- start 2024-08-18T22:23:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.710+0000 7f0b6fa00640 1 -- start start 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6fa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6815c180 0x7f0b681505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6fa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b6815d4d0 0x7f0b6809b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6fa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b68150d20 0x7f0b681577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6fa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0b681692b0 con 0x7f0b6815d4d0 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6fa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0b68169130 con 0x7f0b68150d20 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6fa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0b68169430 con 0x7f0b6815c180 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b67e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b6815d4d0 0x7f0b6809b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b67e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b6815d4d0 0x7f0b6809b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45802/0 (socket says 172.21.15.5:45802) 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b67e00640 1 -- 172.21.15.5:0/2375967267 learned_addr learned my addr 172.21.15.5:0/2375967267 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6d000640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6815c180 0x7f0b681505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6da00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b68150d20 0x7f0b681577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b67e00640 1 -- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6815c180 msgr2=0x7f0b681505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b67e00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6815c180 0x7f0b681505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b67e00640 1 -- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b68150d20 msgr2=0x7f0b681577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b67e00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b68150d20 0x7f0b681577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b67e00640 1 -- 172.21.15.5:0/2375967267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b68150b30 con 0x7f0b6815d4d0 2024-08-18T22:23:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6da00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b68150d20 0x7f0b681577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b67e00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b6815d4d0 0x7f0b6809b280 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0b540ad040 tx=0x7f0b540191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b64c00640 1 -- 172.21.15.5:0/2375967267 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b540bd480 con 0x7f0b6815d4d0 2024-08-18T22:23:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b64c00640 1 -- 172.21.15.5:0/2375967267 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b680ced70 con 0x7f0b6815d4d0 2024-08-18T22:23:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b64c00640 1 -- 172.21.15.5:0/2375967267 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b540bd840 con 0x7f0b6815d4d0 2024-08-18T22:23:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6fa00640 1 -- 172.21.15.5:0/2375967267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6809b7c0 con 0x7f0b6815d4d0 2024-08-18T22:23:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6fa00640 1 -- 172.21.15.5:0/2375967267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b68154920 con 0x7f0b6815d4d0 2024-08-18T22:23:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b6fa00640 1 -- 172.21.15.5:0/2375967267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6806edd0 con 0x7f0b6815d4d0 2024-08-18T22:23:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.714+0000 7f0b64c00640 1 -- 172.21.15.5:0/2375967267 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0b540bd9e0 con 0x7f0b6815d4d0 2024-08-18T22:23:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.718+0000 7f0b64c00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b480678f0 0x7f0b48069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.718+0000 7f0b64c00640 1 -- 172.21.15.5:0/2375967267 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f0b5411fe50 con 0x7f0b6815d4d0 2024-08-18T22:23:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.718+0000 7f0b6d000640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b480678f0 0x7f0b48069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.718+0000 7f0b6d000640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b480678f0 0x7f0b48069db0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0b580012f0 tx=0x7f0b58001a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.722+0000 7f0b64c00640 1 -- 172.21.15.5:0/2375967267 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0b540c4030 con 0x7f0b6815d4d0 2024-08-18T22:23:44.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.894+0000 7f0b6fa00640 1 -- 172.21.15.5:0/2375967267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f0b6806db00 con 0x7f0b6815d4d0 2024-08-18T22:23:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.894+0000 7f0b64c00640 1 -- 172.21.15.5:0/2375967267 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f0b6809b7c0 con 0x7f0b6815d4d0 2024-08-18T22:23:44.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 -- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b480678f0 msgr2=0x7f0b48069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b480678f0 0x7f0b48069db0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0b580012f0 tx=0x7f0b58001a40 comp rx=0 tx=0).stop 2024-08-18T22:23:44.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 -- 172.21.15.5:0/2375967267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b6815d4d0 msgr2=0x7f0b6809b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:44.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b6815d4d0 0x7f0b6809b280 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0b540ad040 tx=0x7f0b540191b0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 -- 172.21.15.5:0/2375967267 shutdown_connections 2024-08-18T22:23:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b480678f0 0x7f0b48069db0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b68150d20 0x7f0b681577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b6815d4d0 0x7f0b6809b280 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 --2- 172.21.15.5:0/2375967267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6815c180 0x7f0b681505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 -- 172.21.15.5:0/2375967267 >> 172.21.15.5:0/2375967267 conn(0x7f0b680b1dc0 msgr2=0x7f0b6815acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 -- 172.21.15.5:0/2375967267 shutdown_connections 2024-08-18T22:23:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:44.898+0000 7f0b6fa00640 1 -- 172.21.15.5:0/2375967267 wait complete. 2024-08-18T22:23:44.918 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-08-18T22:23:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.058+0000 7f3017200640 1 Processor -- start 2024-08-18T22:23:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3017200640 1 -- start start 2024-08-18T22:23:45.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3017200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f301015c180 0x7f30100cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3017200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f301015d4d0 0x7f301006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3017200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30100cfb00 con 0x7f301015c560 2024-08-18T22:23:45.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3017200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f301015d040 con 0x7f301015d4d0 2024-08-18T22:23:45.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3017200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f301015c9f0 con 0x7f301015c180 2024-08-18T22:23:45.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3015200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f301015d4d0 0x7f301006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f300fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f301015c180 0x7f30100cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3015200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f301015d4d0 0x7f301006db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:36446/0 (socket says 172.21.15.5:36446) 2024-08-18T22:23:45.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3015200640 1 -- 172.21.15.5:0/2838381046 learned_addr learned my addr 172.21.15.5:0/2838381046 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3015200640 1 -- 172.21.15.5:0/2838381046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f301015c180 msgr2=0x7f30100cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3015200640 1 --2- 172.21.15.5:0/2838381046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f301015c180 0x7f30100cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3015200640 1 -- 172.21.15.5:0/2838381046 >> v1:172.21.15.117:6789/0 conn(0x7f301015c560 legacy=0x7f30100ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f3015200640 1 -- 172.21.15.5:0/2838381046 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301015ccd0 con 0x7f301015d4d0 2024-08-18T22:23:45.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.062+0000 7f300f400640 1 -- 172.21.15.5:0/2838381046 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1265884101 0 0) 0x7f30100cfb00 con 0x7f301015c560 2024-08-18T22:23:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f3015200640 1 --2- 172.21.15.5:0/2838381046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f301015d4d0 0x7f301006db80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3008009e50 tx=0x7f300801c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f54d4c7f7694232 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:45.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f300f400640 1 -- 172.21.15.5:0/2838381046 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30080a5880 con 0x7f301015d4d0 2024-08-18T22:23:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f300f400640 1 -- 172.21.15.5:0/2838381046 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30100ced70 con 0x7f301015d4d0 2024-08-18T22:23:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f300f400640 1 -- 172.21.15.5:0/2838381046 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30080a5c40 con 0x7f301015d4d0 2024-08-18T22:23:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f3017200640 1 -- 172.21.15.5:0/2838381046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f301015d4d0 msgr2=0x7f301006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f3017200640 1 --2- 172.21.15.5:0/2838381046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f301015d4d0 0x7f301006db80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3008009e50 tx=0x7f300801c9a0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f3017200640 1 -- 172.21.15.5:0/2838381046 shutdown_connections 2024-08-18T22:23:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f3017200640 1 --2- 172.21.15.5:0/2838381046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f301015d4d0 0x7f301006db80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f3017200640 1 --2- 172.21.15.5:0/2838381046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f301015c180 0x7f30100cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f3017200640 1 -- 172.21.15.5:0/2838381046 >> 172.21.15.5:0/2838381046 conn(0x7f30100b1dc0 msgr2=0x7f30100b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f3017200640 1 -- 172.21.15.5:0/2838381046 shutdown_connections 2024-08-18T22:23:45.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f3017200640 1 -- 172.21.15.5:0/2838381046 wait complete. 2024-08-18T22:23:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f3017200640 1 Processor -- start 2024-08-18T22:23:45.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.066+0000 7f3017200640 1 -- start start 2024-08-18T22:23:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f3017200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f301015c180 0x7f301014f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f3017200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f301015d4d0 0x7f3010073490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f3017200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30100cbc50 0x7f3010153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f3017200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f30101692b0 con 0x7f301015c180 2024-08-18T22:23:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f3017200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3010169130 con 0x7f30100cbc50 2024-08-18T22:23:45.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f3017200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3010169430 con 0x7f301015d4d0 2024-08-18T22:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f301015c180 0x7f301014f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f301015c180 0x7f301014f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45816/0 (socket says 172.21.15.5:45816) 2024-08-18T22:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300fe00640 1 -- 172.21.15.5:0/470411036 learned_addr learned my addr 172.21.15.5:0/470411036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f3007400640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f301015d4d0 0x7f3010073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f3015200640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30100cbc50 0x7f3010153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300fe00640 1 -- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f301015d4d0 msgr2=0x7f3010073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300fe00640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f301015d4d0 0x7f3010073490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300fe00640 1 -- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30100cbc50 msgr2=0x7f3010153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300fe00640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30100cbc50 0x7f3010153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300fe00640 1 -- 172.21.15.5:0/470411036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30100cc150 con 0x7f301015c180 2024-08-18T22:23:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300fe00640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f301015c180 0x7f301014f660 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f300000e930 tx=0x7f300000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300cc00640 1 -- 172.21.15.5:0/470411036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000017070 con 0x7f301015c180 2024-08-18T22:23:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300cc00640 1 -- 172.21.15.5:0/470411036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300000ca00 con 0x7f301015c180 2024-08-18T22:23:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f300cc00640 1 -- 172.21.15.5:0/470411036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300000cdb0 con 0x7f301015c180 2024-08-18T22:23:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f3017200640 1 -- 172.21.15.5:0/470411036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30100c9570 con 0x7f301015c180 2024-08-18T22:23:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f3017200640 1 -- 172.21.15.5:0/470411036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30100c9b30 con 0x7f301015c180 2024-08-18T22:23:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.070+0000 7f3017200640 1 -- 172.21.15.5:0/470411036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3010155cd0 con 0x7f301015c180 2024-08-18T22:23:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.074+0000 7f300cc00640 1 -- 172.21.15.5:0/470411036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f300001a070 con 0x7f301015c180 2024-08-18T22:23:45.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.074+0000 7f300cc00640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2fec0678c0 0x7f2fec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.074+0000 7f300cc00640 1 -- 172.21.15.5:0/470411036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f3000085ee0 con 0x7f301015c180 2024-08-18T22:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.074+0000 7f3007400640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2fec0678c0 0x7f2fec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.074+0000 7f3007400640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2fec0678c0 0x7f2fec069d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3010154810 tx=0x7f2ff8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:45.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.078+0000 7f300cc00640 1 -- 172.21.15.5:0/470411036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f30000565a0 con 0x7f301015c180 2024-08-18T22:23:45.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.246+0000 7f3017200640 1 -- 172.21.15.5:0/470411036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7f30101559f0 con 0x7f301015c180 2024-08-18T22:23:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f300cc00640 1 -- 172.21.15.5:0/470411036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v22) ==== 101+0+0 (secure 0 0 0) 0x7f300005a8a0 con 0x7f301015c180 2024-08-18T22:23:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 -- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2fec0678c0 msgr2=0x7f2fec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2fec0678c0 0x7f2fec069d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3010154810 tx=0x7f2ff8009040 comp rx=0 tx=0).stop 2024-08-18T22:23:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 -- 172.21.15.5:0/470411036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f301015c180 msgr2=0x7f301014f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f301015c180 0x7f301014f660 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f300000e930 tx=0x7f300000edf0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 -- 172.21.15.5:0/470411036 shutdown_connections 2024-08-18T22:23:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2fec0678c0 0x7f2fec069d80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30100cbc50 0x7f3010153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f301015d4d0 0x7f3010073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 --2- 172.21.15.5:0/470411036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f301015c180 0x7f301014f660 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 -- 172.21.15.5:0/470411036 >> 172.21.15.5:0/470411036 conn(0x7f30100b1dc0 msgr2=0x7f30100b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 -- 172.21.15.5:0/470411036 shutdown_connections 2024-08-18T22:23:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.250+0000 7f3017200640 1 -- 172.21.15.5:0/470411036 wait complete. 2024-08-18T22:23:45.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-08-18T22:23:45.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e16c00640 1 Processor -- start 2024-08-18T22:23:45.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e16c00640 1 -- start start 2024-08-18T22:23:45.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e16c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e10147860 0x7f9e10144430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e16c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10144970 0x7f9e100b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e16c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e1006ddd0 con 0x7f9e10144050 2024-08-18T22:23:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e16c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9e1006db80 con 0x7f9e10147860 2024-08-18T22:23:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e16c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1006e9e0 con 0x7f9e10144970 2024-08-18T22:23:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e14c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10144970 0x7f9e100b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e07400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e10147860 0x7f9e10144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e14c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10144970 0x7f9e100b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:58572/0 (socket says 172.21.15.5:58572) 2024-08-18T22:23:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e14c00640 1 -- 172.21.15.5:0/2827002626 learned_addr learned my addr 172.21.15.5:0/2827002626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e07400640 1 -- 172.21.15.5:0/2827002626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10144970 msgr2=0x7f9e100b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e07400640 1 --2- 172.21.15.5:0/2827002626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10144970 0x7f9e100b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e07400640 1 -- 172.21.15.5:0/2827002626 >> v1:172.21.15.117:6789/0 conn(0x7f9e10144050 legacy=0x7f9e1006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e07400640 1 -- 172.21.15.5:0/2827002626 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1006e0b0 con 0x7f9e10147860 2024-08-18T22:23:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.414+0000 7f9e14c00640 1 --2- 172.21.15.5:0/2827002626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10144970 0x7f9e100b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:45.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e07400640 1 --2- 172.21.15.5:0/2827002626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e10147860 0x7f9e10144430 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9df80097c0 tx=0x7f9df801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e84ba6e8dc4af91e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:45.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e0f400640 1 -- 172.21.15.5:0/2827002626 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80b0070 con 0x7f9e10147860 2024-08-18T22:23:45.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e0f400640 1 -- 172.21.15.5:0/2827002626 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df80ab600 con 0x7f9e10147860 2024-08-18T22:23:45.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e0f400640 1 -- 172.21.15.5:0/2827002626 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80ab9d0 con 0x7f9e10147860 2024-08-18T22:23:45.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e16c00640 1 -- 172.21.15.5:0/2827002626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e10147860 msgr2=0x7f9e10144430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e16c00640 1 --2- 172.21.15.5:0/2827002626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e10147860 0x7f9e10144430 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9df80097c0 tx=0x7f9df801c3e0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e16c00640 1 -- 172.21.15.5:0/2827002626 shutdown_connections 2024-08-18T22:23:45.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e16c00640 1 --2- 172.21.15.5:0/2827002626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10144970 0x7f9e100b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e16c00640 1 --2- 172.21.15.5:0/2827002626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e10147860 0x7f9e10144430 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e16c00640 1 -- 172.21.15.5:0/2827002626 >> 172.21.15.5:0/2827002626 conn(0x7f9e100b1dc0 msgr2=0x7f9e100b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:45.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e16c00640 1 -- 172.21.15.5:0/2827002626 shutdown_connections 2024-08-18T22:23:45.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.418+0000 7f9e16c00640 1 -- 172.21.15.5:0/2827002626 wait complete. 2024-08-18T22:23:45.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e16c00640 1 Processor -- start 2024-08-18T22:23:45.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e16c00640 1 -- start start 2024-08-18T22:23:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e16c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e10144050 0x7f9e1015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e16c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e10144970 0x7f9e1009c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e16c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10147860 0x7f9e1009c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e16c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1016b4d0 con 0x7f9e10144050 2024-08-18T22:23:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e16c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1016b350 con 0x7f9e10144970 2024-08-18T22:23:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e16c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1016b650 con 0x7f9e10147860 2024-08-18T22:23:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e10144050 0x7f9e1015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e10144050 0x7f9e1015abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45828/0 (socket says 172.21.15.5:45828) 2024-08-18T22:23:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0fe00640 1 -- 172.21.15.5:0/3240298988 learned_addr learned my addr 172.21.15.5:0/3240298988 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e07400640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e10144970 0x7f9e1009c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e14c00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10147860 0x7f9e1009c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0fe00640 1 -- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10147860 msgr2=0x7f9e1009c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0fe00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10147860 0x7f9e1009c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0fe00640 1 -- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e10144970 msgr2=0x7f9e1009c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0fe00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e10144970 0x7f9e1009c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0fe00640 1 -- 172.21.15.5:0/3240298988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e10147130 con 0x7f9e10144050 2024-08-18T22:23:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e14c00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10147860 0x7f9e1009c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0fe00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e10144050 0x7f9e1015abe0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000c3f0 tx=0x7f9e0000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0cc00640 1 -- 172.21.15.5:0/3240298988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00017070 con 0x7f9e10144050 2024-08-18T22:23:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0cc00640 1 -- 172.21.15.5:0/3240298988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e000052d0 con 0x7f9e10144050 2024-08-18T22:23:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e16c00640 1 -- 172.21.15.5:0/3240298988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e10145a10 con 0x7f9e10144050 2024-08-18T22:23:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e0cc00640 1 -- 172.21.15.5:0/3240298988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00003840 con 0x7f9e10144050 2024-08-18T22:23:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e16c00640 1 -- 172.21.15.5:0/3240298988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e10145fd0 con 0x7f9e10144050 2024-08-18T22:23:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.422+0000 7f9e16c00640 1 -- 172.21.15.5:0/3240298988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e100b30c0 con 0x7f9e10144050 2024-08-18T22:23:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.426+0000 7f9e0cc00640 1 -- 172.21.15.5:0/3240298988 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e0001a070 con 0x7f9e10144050 2024-08-18T22:23:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.426+0000 7f9e0cc00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678c0 0x7f9dec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.426+0000 7f9e0cc00640 1 -- 172.21.15.5:0/3240298988 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f9e00084f00 con 0x7f9e10144050 2024-08-18T22:23:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.426+0000 7f9e07400640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678c0 0x7f9dec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.426+0000 7f9e07400640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678c0 0x7f9dec069d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9df80ad000 tx=0x7f9df80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:45.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.430+0000 7f9e0cc00640 1 -- 172.21.15.5:0/3240298988 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9e00005480 con 0x7f9e10144050 2024-08-18T22:23:45.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.594+0000 7f9e16c00640 1 -- 172.21.15.5:0/3240298988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7f9e1006f7c0 con 0x7f9e10144050 2024-08-18T22:23:45.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.598+0000 7f9e0cc00640 1 -- 172.21.15.5:0/3240298988 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v23) ==== 101+0+0 (secure 0 0 0) 0x7f9e00055470 con 0x7f9e10144050 2024-08-18T22:23:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 -- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678c0 msgr2=0x7f9dec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678c0 0x7f9dec069d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9df80ad000 tx=0x7f9df80a6000 comp rx=0 tx=0).stop 2024-08-18T22:23:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 -- 172.21.15.5:0/3240298988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e10144050 msgr2=0x7f9e1015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e10144050 0x7f9e1015abe0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000c3f0 tx=0x7f9e0000c8b0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 -- 172.21.15.5:0/3240298988 shutdown_connections 2024-08-18T22:23:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678c0 0x7f9dec069d80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e10147860 0x7f9e1009c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e10144970 0x7f9e1009c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 --2- 172.21.15.5:0/3240298988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e10144050 0x7f9e1015abe0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 -- 172.21.15.5:0/3240298988 >> 172.21.15.5:0/3240298988 conn(0x7f9e100b1dc0 msgr2=0x7f9e101430f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 -- 172.21.15.5:0/3240298988 shutdown_connections 2024-08-18T22:23:45.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.602+0000 7f9e16c00640 1 -- 172.21.15.5:0/3240298988 wait complete. 2024-08-18T22:23:45.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-08-18T22:23:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c74600640 1 Processor -- start 2024-08-18T22:23:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c74600640 1 -- start start 2024-08-18T22:23:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c74600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c6c15c180 0x7f6c6c0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c74600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c6c071c90 0x7f6c6c15c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c74600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c6c0b5e30 con 0x7f6c6c06fad0 2024-08-18T22:23:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c74600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6c6c15caa0 con 0x7f6c6c071c90 2024-08-18T22:23:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c74600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6c6c0b6110 con 0x7f6c6c15c180 2024-08-18T22:23:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c72600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c6c071c90 0x7f6c6c15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c72600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c6c071c90 0x7f6c6c15c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45834/0 (socket says 172.21.15.5:45834) 2024-08-18T22:23:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c72600640 1 -- 172.21.15.5:0/842319291 learned_addr learned my addr 172.21.15.5:0/842319291 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:45.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c71c00640 1 --2- 172.21.15.5:0/842319291 >> v2:172.21.15.117:3300/0 conn(0x7f6c6c15c180 0x7f6c6c0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c72600640 1 -- 172.21.15.5:0/842319291 >> v2:172.21.15.117:3300/0 conn(0x7f6c6c15c180 msgr2=0x7f6c6c0b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:45.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c72600640 1 --2- 172.21.15.5:0/842319291 >> v2:172.21.15.117:3300/0 conn(0x7f6c6c15c180 0x7f6c6c0b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c72600640 1 -- 172.21.15.5:0/842319291 >> v1:172.21.15.117:6789/0 conn(0x7f6c6c06fad0 legacy=0x7f6c6c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.766+0000 7f6c72600640 1 -- 172.21.15.5:0/842319291 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c0b63f0 con 0x7f6c6c071c90 2024-08-18T22:23:45.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c72600640 1 --2- 172.21.15.5:0/842319291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c071c90 0x7f6c6c15c560 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c050430 tx=0x7f6c6401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7959132fa8cd16d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:45.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c6be00640 1 -- 172.21.15.5:0/842319291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c640a5720 con 0x7f6c6c071c90 2024-08-18T22:23:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c6be00640 1 -- 172.21.15.5:0/842319291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c640a58c0 con 0x7f6c6c071c90 2024-08-18T22:23:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c6be00640 1 -- 172.21.15.5:0/842319291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c640a5c90 con 0x7f6c6c071c90 2024-08-18T22:23:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c74600640 1 -- 172.21.15.5:0/842319291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c071c90 msgr2=0x7f6c6c15c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c74600640 1 --2- 172.21.15.5:0/842319291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c071c90 0x7f6c6c15c560 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c050430 tx=0x7f6c6401c8a0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c74600640 1 -- 172.21.15.5:0/842319291 shutdown_connections 2024-08-18T22:23:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c74600640 1 --2- 172.21.15.5:0/842319291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c071c90 0x7f6c6c15c560 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c74600640 1 --2- 172.21.15.5:0/842319291 >> v2:172.21.15.117:3300/0 conn(0x7f6c6c15c180 0x7f6c6c0b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c74600640 1 -- 172.21.15.5:0/842319291 >> 172.21.15.5:0/842319291 conn(0x7f6c6c0b3eb0 msgr2=0x7f6c6c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c74600640 1 -- 172.21.15.5:0/842319291 shutdown_connections 2024-08-18T22:23:45.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c74600640 1 -- 172.21.15.5:0/842319291 wait complete. 2024-08-18T22:23:45.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c74600640 1 Processor -- start 2024-08-18T22:23:45.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.770+0000 7f6c74600640 1 -- start start 2024-08-18T22:23:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c74600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c06fad0 0x7f6c6c153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c74600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c6c071c90 0x7f6c6c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c74600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c6c15c180 0x7f6c6c154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c74600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c0d1c30 con 0x7f6c6c06fad0 2024-08-18T22:23:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c74600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c0d1ab0 con 0x7f6c6c15c180 2024-08-18T22:23:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c74600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c0d1db0 con 0x7f6c6c071c90 2024-08-18T22:23:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c71c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c06fad0 0x7f6c6c153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c71c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c06fad0 0x7f6c6c153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45850/0 (socket says 172.21.15.5:45850) 2024-08-18T22:23:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c71c00640 1 -- 172.21.15.5:0/1575211522 learned_addr learned my addr 172.21.15.5:0/1575211522 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c71200640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c6c071c90 0x7f6c6c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c72600640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c6c15c180 0x7f6c6c154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c71c00640 1 -- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c6c071c90 msgr2=0x7f6c6c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c71c00640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c6c071c90 0x7f6c6c06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c71c00640 1 -- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c6c15c180 msgr2=0x7f6c6c154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c71c00640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c6c15c180 0x7f6c6c154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c71c00640 1 -- 172.21.15.5:0/1575211522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c06cac0 con 0x7f6c6c06fad0 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c72600640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c6c15c180 0x7f6c6c154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c71c00640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c06fad0 0x7f6c6c153830 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000e8a0 tx=0x7f6c6000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c69600640 1 -- 172.21.15.5:0/1575211522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60017070 con 0x7f6c6c06fad0 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c69600640 1 -- 172.21.15.5:0/1575211522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6000c940 con 0x7f6c6c06fad0 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c69600640 1 -- 172.21.15.5:0/1575211522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000ccf0 con 0x7f6c6c06fad0 2024-08-18T22:23:45.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c74600640 1 -- 172.21.15.5:0/1575211522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c06cda0 con 0x7f6c6c06fad0 2024-08-18T22:23:45.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c74600640 1 -- 172.21.15.5:0/1575211522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c06d360 con 0x7f6c6c06fad0 2024-08-18T22:23:45.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.774+0000 7f6c74600640 1 -- 172.21.15.5:0/1575211522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6c15c560 con 0x7f6c6c06fad0 2024-08-18T22:23:45.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.778+0000 7f6c69600640 1 -- 172.21.15.5:0/1575211522 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c6001a070 con 0x7f6c6c06fad0 2024-08-18T22:23:45.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.778+0000 7f6c69600640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6c4c0678c0 0x7f6c4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:45.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.778+0000 7f6c69600640 1 -- 172.21.15.5:0/1575211522 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f6c60085e00 con 0x7f6c6c06fad0 2024-08-18T22:23:45.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.778+0000 7f6c71200640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6c4c0678c0 0x7f6c4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:45.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.778+0000 7f6c71200640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6c4c0678c0 0x7f6c4c069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c166940 tx=0x7f6c58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:45.782+0000 7f6c69600640 1 -- 172.21.15.5:0/1575211522 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6c60056370 con 0x7f6c6c06fad0 2024-08-18T22:23:46.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.014+0000 7f6c74600640 1 -- 172.21.15.5:0/1575211522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7f6c6c0725e0 con 0x7f6c6c06fad0 2024-08-18T22:23:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c69600640 1 -- 172.21.15.5:0/1575211522 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v231) ==== 151+0+0 (secure 0 0 0) 0x7f6c6005a670 con 0x7f6c6c06fad0 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 -- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6c4c0678c0 msgr2=0x7f6c4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6c4c0678c0 0x7f6c4c069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c166940 tx=0x7f6c58009040 comp rx=0 tx=0).stop 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 -- 172.21.15.5:0/1575211522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c06fad0 msgr2=0x7f6c6c153830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c06fad0 0x7f6c6c153830 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000e8a0 tx=0x7f6c6000eca0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 -- 172.21.15.5:0/1575211522 shutdown_connections 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6c4c0678c0 0x7f6c4c069d80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c6c15c180 0x7f6c6c154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c6c071c90 0x7f6c6c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 --2- 172.21.15.5:0/1575211522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c6c06fad0 0x7f6c6c153830 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 -- 172.21.15.5:0/1575211522 >> 172.21.15.5:0/1575211522 conn(0x7f6c6c0b3eb0 msgr2=0x7f6c6c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 -- 172.21.15.5:0/1575211522 shutdown_connections 2024-08-18T22:23:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.190+0000 7f6c74600640 1 -- 172.21.15.5:0/1575211522 wait complete. 2024-08-18T22:23:46.212 INFO:tasks.cephfs_test_runner:That a directory is merged during scrub. ... ok 2024-08-18T22:23:46.212 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-08-18T22:23:46.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:23:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41db200640 1 Processor -- start 2024-08-18T22:23:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41db200640 1 -- start start 2024-08-18T22:23:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41db200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d415bed0 0x7f41d40735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41db200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41d406da70 0x7f41d406df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41db200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d4073c80 con 0x7f41d40cb390 2024-08-18T22:23:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41db200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f41d40ca5d0 con 0x7f41d406da70 2024-08-18T22:23:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41db200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41d40ca8b0 con 0x7f41d415bed0 2024-08-18T22:23:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41d9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41d406da70 0x7f41d406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41d9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41d406da70 0x7f41d406df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45852/0 (socket says 172.21.15.5:45852) 2024-08-18T22:23:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41d9200640 1 -- 172.21.15.5:0/4248663049 learned_addr learned my addr 172.21.15.5:0/4248663049 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41d9200640 1 -- 172.21.15.5:0/4248663049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d415bed0 msgr2=0x7f41d40735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41d3e00640 1 --2- 172.21.15.5:0/4248663049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d415bed0 0x7f41d40735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41d9200640 1 --2- 172.21.15.5:0/4248663049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d415bed0 0x7f41d40735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41d9200640 1 -- 172.21.15.5:0/4248663049 >> v1:172.21.15.117:6789/0 conn(0x7f41d40cb390 legacy=0x7f41d4071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41d9200640 1 -- 172.21.15.5:0/4248663049 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d40cab90 con 0x7f41d406da70 2024-08-18T22:23:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.354+0000 7f41d3e00640 1 --2- 172.21.15.5:0/4248663049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d415bed0 0x7f41d40735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41d9200640 1 --2- 172.21.15.5:0/4248663049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41d406da70 0x7f41d406df20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009e50 tx=0x7f41cc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfc1d3aedd97ab7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41d2a00640 1 -- 172.21.15.5:0/4248663049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0a5780 con 0x7f41d406da70 2024-08-18T22:23:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41d2a00640 1 -- 172.21.15.5:0/4248663049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41cc0a5920 con 0x7f41d406da70 2024-08-18T22:23:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41d2a00640 1 -- 172.21.15.5:0/4248663049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0a5cf0 con 0x7f41d406da70 2024-08-18T22:23:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41db200640 1 -- 172.21.15.5:0/4248663049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41d406da70 msgr2=0x7f41d406df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41db200640 1 --2- 172.21.15.5:0/4248663049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41d406da70 0x7f41d406df20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009e50 tx=0x7f41cc01c9f0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41db200640 1 -- 172.21.15.5:0/4248663049 shutdown_connections 2024-08-18T22:23:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41db200640 1 --2- 172.21.15.5:0/4248663049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41d406da70 0x7f41d406df20 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41db200640 1 --2- 172.21.15.5:0/4248663049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d415bed0 0x7f41d40735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41db200640 1 -- 172.21.15.5:0/4248663049 >> 172.21.15.5:0/4248663049 conn(0x7f41d40b1c50 msgr2=0x7f41d40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41db200640 1 -- 172.21.15.5:0/4248663049 shutdown_connections 2024-08-18T22:23:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41db200640 1 -- 172.21.15.5:0/4248663049 wait complete. 2024-08-18T22:23:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.358+0000 7f41db200640 1 Processor -- start 2024-08-18T22:23:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41db200640 1 -- start start 2024-08-18T22:23:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41db200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d406da70 0x7f41d414db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41db200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41d40cb390 0x7f41d40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41db200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41d415bed0 0x7f41d40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41db200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4168730 con 0x7f41d40cb390 2024-08-18T22:23:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41db200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41685b0 con 0x7f41d415bed0 2024-08-18T22:23:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41db200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41d41688b0 con 0x7f41d406da70 2024-08-18T22:23:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41d3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41d40cb390 0x7f41d40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41d3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41d40cb390 0x7f41d40c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45862/0 (socket says 172.21.15.5:45862) 2024-08-18T22:23:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41d3400640 1 -- 172.21.15.5:0/3836732846 learned_addr learned my addr 172.21.15.5:0/3836732846 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41d3e00640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d406da70 0x7f41d414db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41d9200640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41d415bed0 0x7f41d40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41d3400640 1 -- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d406da70 msgr2=0x7f41d414db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41d3400640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d406da70 0x7f41d414db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41d3400640 1 -- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41d415bed0 msgr2=0x7f41d40c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41d3400640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41d415bed0 0x7f41d40c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41d3400640 1 -- 172.21.15.5:0/3836732846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d414e0a0 con 0x7f41d40cb390 2024-08-18T22:23:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41d3400640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41d40cb390 0x7f41d40c94c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f41c000c440 tx=0x7f41c000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41cbe00640 1 -- 172.21.15.5:0/3836732846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0016020 con 0x7f41d40cb390 2024-08-18T22:23:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41cbe00640 1 -- 172.21.15.5:0/3836732846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c0012830 con 0x7f41d40cb390 2024-08-18T22:23:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41cbe00640 1 -- 172.21.15.5:0/3836732846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0012c20 con 0x7f41d40cb390 2024-08-18T22:23:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41db200640 1 -- 172.21.15.5:0/3836732846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d4151ad0 con 0x7f41d40cb390 2024-08-18T22:23:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41db200640 1 -- 172.21.15.5:0/3836732846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d4152090 con 0x7f41d40cb390 2024-08-18T22:23:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.362+0000 7f41db200640 1 -- 172.21.15.5:0/3836732846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d406df20 con 0x7f41d40cb390 2024-08-18T22:23:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.366+0000 7f41cbe00640 1 -- 172.21.15.5:0/3836732846 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f41c0019020 con 0x7f41d40cb390 2024-08-18T22:23:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.366+0000 7f41cbe00640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41b40678c0 0x7f41b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.366+0000 7f41cbe00640 1 -- 172.21.15.5:0/3836732846 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f41c0085730 con 0x7f41d40cb390 2024-08-18T22:23:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.366+0000 7f41d3e00640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41b40678c0 0x7f41b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.366+0000 7f41d3e00640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41b40678c0 0x7f41b4069d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f41c400ab60 tx=0x7f41c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:46.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.370+0000 7f41cbe00640 1 -- 172.21.15.5:0/3836732846 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f41c0020030 con 0x7f41d40cb390 2024-08-18T22:23:46.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.538+0000 7f41db200640 1 -- 172.21.15.5:0/3836732846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41d40cc310 con 0x7f41d40cb390 2024-08-18T22:23:46.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.538+0000 7f41cbe00640 1 -- 172.21.15.5:0/3836732846 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+13348 (secure 0 0 0) 0x7f41c0003810 con 0x7f41d40cb390 2024-08-18T22:23:46.539 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:46.539 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":74,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:23:44.182806+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6833/1715051733":"2024-08-19T22:23:40.832228+0000","172.21.15.5:6832/1715051733":"2024-08-19T22:23:40.832228+0000","172.21.15.5:6833/3174043628":"2024-08-19T22:23:24.762498+0000","172.21.15.5:6832/3174043628":"2024-08-19T22:23:24.762498+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:23:46.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 -- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41b40678c0 msgr2=0x7f41b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41b40678c0 0x7f41b4069d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f41c400ab60 tx=0x7f41c4008040 comp rx=0 tx=0).stop 2024-08-18T22:23:46.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 -- 172.21.15.5:0/3836732846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41d40cb390 msgr2=0x7f41d40c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41d40cb390 0x7f41d40c94c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f41c000c440 tx=0x7f41c000c900 comp rx=0 tx=0).stop 2024-08-18T22:23:46.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 -- 172.21.15.5:0/3836732846 shutdown_connections 2024-08-18T22:23:46.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41b40678c0 0x7f41b4069d80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41d415bed0 0x7f41d40c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41d40cb390 0x7f41d40c94c0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 --2- 172.21.15.5:0/3836732846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41d406da70 0x7f41d414db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 -- 172.21.15.5:0/3836732846 >> 172.21.15.5:0/3836732846 conn(0x7f41d40b1c50 msgr2=0x7f41d40b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 -- 172.21.15.5:0/3836732846 shutdown_connections 2024-08-18T22:23:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.542+0000 7f41db200640 1 -- 172.21.15.5:0/3836732846 wait complete. 2024-08-18T22:23:46.560 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:23:46.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:23:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.702+0000 7f7f54a00640 1 Processor -- start 2024-08-18T22:23:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.702+0000 7f7f54a00640 1 -- start start 2024-08-18T22:23:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f54a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f5015c180 0x7f7f500cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f54a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7f5015d4d0 0x7f7f5006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f54a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f500cfb00 con 0x7f7f5015c560 2024-08-18T22:23:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f54a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7f5015d040 con 0x7f7f5015c180 2024-08-18T22:23:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f54a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7f5015c9f0 con 0x7f7f5015d4d0 2024-08-18T22:23:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f4de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f5015c180 0x7f7f500cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f45400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7f5015c560 0x7f7f500ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47924/0 (socket says 172.21.15.5:47924) 2024-08-18T22:23:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f45400640 1 -- 172.21.15.5:0/1624277237 learned_addr learned my addr 172.21.15.5:0/1624277237 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f4e800640 1 --2- 172.21.15.5:0/1624277237 >> v2:172.21.15.117:3300/0 conn(0x7f7f5015d4d0 0x7f7f5006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f4de00640 1 -- 172.21.15.5:0/1624277237 >> v2:172.21.15.117:3300/0 conn(0x7f7f5015d4d0 msgr2=0x7f7f5006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f4de00640 1 --2- 172.21.15.5:0/1624277237 >> v2:172.21.15.117:3300/0 conn(0x7f7f5015d4d0 0x7f7f5006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f4de00640 1 -- 172.21.15.5:0/1624277237 >> v1:172.21.15.5:6789/0 conn(0x7f7f5015c560 legacy=0x7f7f500ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f4de00640 1 -- 172.21.15.5:0/1624277237 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5015ccd0 con 0x7f7f5015c180 2024-08-18T22:23:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.706+0000 7f7f4e800640 1 --2- 172.21.15.5:0/1624277237 >> v2:172.21.15.117:3300/0 conn(0x7f7f5015d4d0 0x7f7f5006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f4de00640 1 --2- 172.21.15.5:0/1624277237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5015c180 0x7f7f500cdf10 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f7f500cdd30 tx=0x7f7f4001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56424f3eddb9844a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f4d400640 1 -- 172.21.15.5:0/1624277237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400ab610 con 0x7f7f5015c180 2024-08-18T22:23:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f4d400640 1 -- 172.21.15.5:0/1624277237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f400b0070 con 0x7f7f5015c180 2024-08-18T22:23:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f4d400640 1 -- 172.21.15.5:0/1624277237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400ab9d0 con 0x7f7f5015c180 2024-08-18T22:23:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f54a00640 1 -- 172.21.15.5:0/1624277237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5015c180 msgr2=0x7f7f500cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f54a00640 1 --2- 172.21.15.5:0/1624277237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5015c180 0x7f7f500cdf10 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f7f500cdd30 tx=0x7f7f4001c3f0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f54a00640 1 -- 172.21.15.5:0/1624277237 shutdown_connections 2024-08-18T22:23:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f54a00640 1 --2- 172.21.15.5:0/1624277237 >> v2:172.21.15.117:3300/0 conn(0x7f7f5015d4d0 0x7f7f5006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f54a00640 1 --2- 172.21.15.5:0/1624277237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5015c180 0x7f7f500cdf10 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f54a00640 1 -- 172.21.15.5:0/1624277237 >> 172.21.15.5:0/1624277237 conn(0x7f7f500b1dc0 msgr2=0x7f7f500b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f54a00640 1 -- 172.21.15.5:0/1624277237 shutdown_connections 2024-08-18T22:23:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f54a00640 1 -- 172.21.15.5:0/1624277237 wait complete. 2024-08-18T22:23:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f54a00640 1 Processor -- start 2024-08-18T22:23:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.710+0000 7f7f54a00640 1 -- start start 2024-08-18T22:23:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f54a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f5015c180 0x7f7f5014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f54a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f5015d4d0 0x7f7f5014da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f54a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5014fdf0 0x7f7f50150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f54a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7f501692b0 con 0x7f7f5014fdf0 2024-08-18T22:23:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f54a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7f50169130 con 0x7f7f5015d4d0 2024-08-18T22:23:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f54a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7f50169430 con 0x7f7f5015c180 2024-08-18T22:23:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f4e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5014fdf0 0x7f7f50150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f4e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5014fdf0 0x7f7f50150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45878/0 (socket says 172.21.15.5:45878) 2024-08-18T22:23:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f4e800640 1 -- 172.21.15.5:0/3620195295 learned_addr learned my addr 172.21.15.5:0/3620195295 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f45400640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f5015d4d0 0x7f7f5014da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f4de00640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f5015c180 0x7f7f5014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f4e800640 1 -- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f5015c180 msgr2=0x7f7f5014e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f4e800640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f5015c180 0x7f7f5014e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f4e800640 1 -- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f5015d4d0 msgr2=0x7f7f5014da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f4e800640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f5015d4d0 0x7f7f5014da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f4e800640 1 -- 172.21.15.5:0/3620195295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5014ed50 con 0x7f7f5014fdf0 2024-08-18T22:23:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f4e800640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5014fdf0 0x7f7f50150bd0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800cd80 tx=0x7f7f4800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:46.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f46a00640 1 -- 172.21.15.5:0/3620195295 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4800f680 con 0x7f7f5014fdf0 2024-08-18T22:23:46.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f46a00640 1 -- 172.21.15.5:0/3620195295 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4800f840 con 0x7f7f5014fdf0 2024-08-18T22:23:46.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f46a00640 1 -- 172.21.15.5:0/3620195295 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4800fc30 con 0x7f7f5014fdf0 2024-08-18T22:23:46.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f54a00640 1 -- 172.21.15.5:0/3620195295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5014f030 con 0x7f7f5014fdf0 2024-08-18T22:23:46.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f54a00640 1 -- 172.21.15.5:0/3620195295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5014f5f0 con 0x7f7f5014fdf0 2024-08-18T22:23:46.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f54a00640 1 -- 172.21.15.5:0/3620195295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f50157cd0 con 0x7f7f5014fdf0 2024-08-18T22:23:46.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.714+0000 7f7f46a00640 1 -- 172.21.15.5:0/3620195295 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f4800e3e0 con 0x7f7f5014fdf0 2024-08-18T22:23:46.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.718+0000 7f7f46a00640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f2c0678c0 0x7f7f2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:46.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.718+0000 7f7f46a00640 1 -- 172.21.15.5:0/3620195295 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f7f480868b0 con 0x7f7f5014fdf0 2024-08-18T22:23:46.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.718+0000 7f7f4de00640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f2c0678c0 0x7f7f2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:46.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.718+0000 7f7f4de00640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f2c0678c0 0x7f7f2c069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7f400af000 tx=0x7f7f400a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:46.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.722+0000 7f7f46a00640 1 -- 172.21.15.5:0/3620195295 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7f48014030 con 0x7f7f5014fdf0 2024-08-18T22:23:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f54a00640 1 -- 172.21.15.5:0/3620195295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7f501579f0 con 0x7f7f5014fdf0 2024-08-18T22:23:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f46a00640 1 -- 172.21.15.5:0/3620195295 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f7f48056e20 con 0x7f7f5014fdf0 2024-08-18T22:23:46.887 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f54a00640 1 -- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f2c0678c0 msgr2=0x7f7f2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f54a00640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f2c0678c0 0x7f7f2c069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7f400af000 tx=0x7f7f400a7000 comp rx=0 tx=0).stop 2024-08-18T22:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f54a00640 1 -- 172.21.15.5:0/3620195295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5014fdf0 msgr2=0x7f7f50150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f54a00640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5014fdf0 0x7f7f50150bd0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800cd80 tx=0x7f7f4800a650 comp rx=0 tx=0).stop 2024-08-18T22:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f54a00640 1 -- 172.21.15.5:0/3620195295 shutdown_connections 2024-08-18T22:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f54a00640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f2c0678c0 0x7f7f2c069d80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f54a00640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5014fdf0 0x7f7f50150bd0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f54a00640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f5015d4d0 0x7f7f5014da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f54a00640 1 --2- 172.21.15.5:0/3620195295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f5015c180 0x7f7f5014e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.886+0000 7f7f54a00640 1 -- 172.21.15.5:0/3620195295 >> 172.21.15.5:0/3620195295 conn(0x7f7f500b1dc0 msgr2=0x7f7f5015b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.890+0000 7f7f54a00640 1 -- 172.21.15.5:0/3620195295 shutdown_connections 2024-08-18T22:23:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:46.890+0000 7f7f54a00640 1 -- 172.21.15.5:0/3620195295 wait complete. 2024-08-18T22:23:46.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-08-18T22:23:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.046+0000 7f597cc00640 1 Processor -- start 2024-08-18T22:23:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.046+0000 7f597cc00640 1 -- start start 2024-08-18T22:23:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f597cc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597815b010 0x7f59780ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f597cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59780cd3a0 0x7f597806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f597cc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f597806f0c0 0x7f59780caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f597cc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f59780cfa30 con 0x7f59780cd3a0 2024-08-18T22:23:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f597cc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f59780cee20 con 0x7f597806f0c0 2024-08-18T22:23:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f597cc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f59780cf100 con 0x7f597815b010 2024-08-18T22:23:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f5975400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59780cd3a0 0x7f597806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f5975400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59780cd3a0 0x7f597806eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45884/0 (socket says 172.21.15.5:45884) 2024-08-18T22:23:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f5975400640 1 -- 172.21.15.5:0/335869678 learned_addr learned my addr 172.21.15.5:0/335869678 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f5976800640 1 --2- 172.21.15.5:0/335869678 >> v2:172.21.15.117:3300/0 conn(0x7f597806f0c0 0x7f59780caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f5975e00640 1 --2- 172.21.15.5:0/335869678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597815b010 0x7f59780ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f5975400640 1 -- 172.21.15.5:0/335869678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597815b010 msgr2=0x7f59780ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f5975400640 1 --2- 172.21.15.5:0/335869678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597815b010 0x7f59780ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f5975400640 1 -- 172.21.15.5:0/335869678 >> v2:172.21.15.117:3300/0 conn(0x7f597806f0c0 msgr2=0x7f59780caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f5975400640 1 --2- 172.21.15.5:0/335869678 >> v2:172.21.15.117:3300/0 conn(0x7f597806f0c0 0x7f59780caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f5975400640 1 -- 172.21.15.5:0/335869678 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59780cf3e0 con 0x7f59780cd3a0 2024-08-18T22:23:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.050+0000 7f5976800640 1 --2- 172.21.15.5:0/335869678 >> v2:172.21.15.117:3300/0 conn(0x7f597806f0c0 0x7f59780caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f5975400640 1 --2- 172.21.15.5:0/335869678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59780cd3a0 0x7f597806eb80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f597806ffa0 tx=0x7f596401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2429a79ec4d137b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f5974a00640 1 -- 172.21.15.5:0/335869678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640b0070 con 0x7f59780cd3a0 2024-08-18T22:23:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f5974a00640 1 -- 172.21.15.5:0/335869678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59640ab600 con 0x7f59780cd3a0 2024-08-18T22:23:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f5974a00640 1 -- 172.21.15.5:0/335869678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640ab9d0 con 0x7f59780cd3a0 2024-08-18T22:23:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 -- 172.21.15.5:0/335869678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59780cd3a0 msgr2=0x7f597806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 --2- 172.21.15.5:0/335869678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59780cd3a0 0x7f597806eb80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f597806ffa0 tx=0x7f596401c260 comp rx=0 tx=0).stop 2024-08-18T22:23:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 -- 172.21.15.5:0/335869678 shutdown_connections 2024-08-18T22:23:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 --2- 172.21.15.5:0/335869678 >> v2:172.21.15.117:3300/0 conn(0x7f597806f0c0 0x7f59780caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 --2- 172.21.15.5:0/335869678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59780cd3a0 0x7f597806eb80 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 --2- 172.21.15.5:0/335869678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597815b010 0x7f59780ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 -- 172.21.15.5:0/335869678 >> 172.21.15.5:0/335869678 conn(0x7f59780b1c50 msgr2=0x7f59780b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 -- 172.21.15.5:0/335869678 shutdown_connections 2024-08-18T22:23:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 -- 172.21.15.5:0/335869678 wait complete. 2024-08-18T22:23:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 Processor -- start 2024-08-18T22:23:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 -- start start 2024-08-18T22:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.054+0000 7f597cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f597806f0c0 0x7f5978142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f597cc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59780cd3a0 0x7f59780b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f597cc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597815b010 0x7f59780c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f597cc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5978072780 con 0x7f597806f0c0 2024-08-18T22:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f597cc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5978072600 con 0x7f59780cd3a0 2024-08-18T22:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f597cc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5978072900 con 0x7f597815b010 2024-08-18T22:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5975e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f597806f0c0 0x7f5978142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5975e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f597806f0c0 0x7f5978142330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45888/0 (socket says 172.21.15.5:45888) 2024-08-18T22:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5975e00640 1 -- 172.21.15.5:0/1890372135 learned_addr learned my addr 172.21.15.5:0/1890372135 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5976800640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597815b010 0x7f59780c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5975400640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59780cd3a0 0x7f59780b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5975e00640 1 -- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597815b010 msgr2=0x7f59780c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5975e00640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597815b010 0x7f59780c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5975e00640 1 -- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59780cd3a0 msgr2=0x7f59780b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5975e00640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59780cd3a0 0x7f59780b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5975e00640 1 -- 172.21.15.5:0/1890372135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59780b3880 con 0x7f597806f0c0 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5975400640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59780cd3a0 0x7f59780b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f5975e00640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f597806f0c0 0x7f5978142330 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f596800d5f0 tx=0x7f596800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f596e000640 1 -- 172.21.15.5:0/1890372135 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59680125f0 con 0x7f597806f0c0 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f596e000640 1 -- 172.21.15.5:0/1890372135 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5968019070 con 0x7f597806f0c0 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f596e000640 1 -- 172.21.15.5:0/1890372135 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59680129b0 con 0x7f597806f0c0 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f597cc00640 1 -- 172.21.15.5:0/1890372135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59780b4ce0 con 0x7f597806f0c0 2024-08-18T22:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f597cc00640 1 -- 172.21.15.5:0/1890372135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5978145780 con 0x7f597806f0c0 2024-08-18T22:23:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f597cc00640 1 -- 172.21.15.5:0/1890372135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f597806eb80 con 0x7f597806f0c0 2024-08-18T22:23:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.058+0000 7f596e000640 1 -- 172.21.15.5:0/1890372135 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5968012b50 con 0x7f597806f0c0 2024-08-18T22:23:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.062+0000 7f596e000640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59580678c0 0x7f5958069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.062+0000 7f596e000640 1 -- 172.21.15.5:0/1890372135 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f59680869a0 con 0x7f597806f0c0 2024-08-18T22:23:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.062+0000 7f5975400640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59580678c0 0x7f5958069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.062+0000 7f5975400640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59580678c0 0x7f5958069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f59640ad000 tx=0x7f59640a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.062+0000 7f596e000640 1 -- 172.21.15.5:0/1890372135 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f59780b3880 con 0x7f597806f0c0 2024-08-18T22:23:47.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:47.290+0000 7f597cc00640 1 -- 172.21.15.5:0/1890372135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f5978073040 con 0x7f597806f0c0 2024-08-18T22:23:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.194+0000 7f596e000640 1 -- 172.21.15.5:0/1890372135 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v233) ==== 146+0+0 (secure 0 0 0) 0x7f59680575e0 con 0x7f597806f0c0 2024-08-18T22:23:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.198+0000 7f597cc00640 1 -- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59580678c0 msgr2=0x7f5958069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.198+0000 7f597cc00640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59580678c0 0x7f5958069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f59640ad000 tx=0x7f59640a6000 comp rx=0 tx=0).stop 2024-08-18T22:23:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.198+0000 7f597cc00640 1 -- 172.21.15.5:0/1890372135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f597806f0c0 msgr2=0x7f5978142330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.198+0000 7f597cc00640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f597806f0c0 0x7f5978142330 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f596800d5f0 tx=0x7f596800dab0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.202+0000 7f597cc00640 1 -- 172.21.15.5:0/1890372135 shutdown_connections 2024-08-18T22:23:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.202+0000 7f597cc00640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59580678c0 0x7f5958069d80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.202+0000 7f597cc00640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597815b010 0x7f59780c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.202+0000 7f597cc00640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59780cd3a0 0x7f59780b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.202+0000 7f597cc00640 1 --2- 172.21.15.5:0/1890372135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f597806f0c0 0x7f5978142330 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.202+0000 7f597cc00640 1 -- 172.21.15.5:0/1890372135 >> 172.21.15.5:0/1890372135 conn(0x7f59780b1c50 msgr2=0x7f597806da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.202+0000 7f597cc00640 1 -- 172.21.15.5:0/1890372135 shutdown_connections 2024-08-18T22:23:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.202+0000 7f597cc00640 1 -- 172.21.15.5:0/1890372135 wait complete. 2024-08-18T22:23:48.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:23:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.370+0000 7f14f5600640 1 Processor -- start 2024-08-18T22:23:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.370+0000 7f14f5600640 1 -- start start 2024-08-18T22:23:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14f5600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14f0147dd0 0x7f14f00b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14f5600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14f006c3c0 0x7f14f015e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14f5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14f015ee30 0x7f14f0161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14f5600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f14f015f7c0 con 0x7f14f006c3c0 2024-08-18T22:23:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14f5600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f14f00b6410 con 0x7f14f0147dd0 2024-08-18T22:23:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14f5600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f14f015f2c0 con 0x7f14f015ee30 2024-08-18T22:23:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14e6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14f006c3c0 0x7f14f015e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14e6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14f006c3c0 0x7f14f015e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45900/0 (socket says 172.21.15.5:45900) 2024-08-18T22:23:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14e6000640 1 -- 172.21.15.5:0/192744009 learned_addr learned my addr 172.21.15.5:0/192744009 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14eea00640 1 --2- 172.21.15.5:0/192744009 >> v2:172.21.15.117:3300/0 conn(0x7f14f0147dd0 0x7f14f00b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14ef400640 1 --2- 172.21.15.5:0/192744009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14f015ee30 0x7f14f0161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14e6000640 1 -- 172.21.15.5:0/192744009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14f015ee30 msgr2=0x7f14f0161ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14e6000640 1 --2- 172.21.15.5:0/192744009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14f015ee30 0x7f14f0161ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14e6000640 1 -- 172.21.15.5:0/192744009 >> v2:172.21.15.117:3300/0 conn(0x7f14f0147dd0 msgr2=0x7f14f00b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14e6000640 1 --2- 172.21.15.5:0/192744009 >> v2:172.21.15.117:3300/0 conn(0x7f14f0147dd0 0x7f14f00b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14e6000640 1 -- 172.21.15.5:0/192744009 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f006c850 con 0x7f14f006c3c0 2024-08-18T22:23:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.374+0000 7f14ef400640 1 --2- 172.21.15.5:0/192744009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14f015ee30 0x7f14f0161ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:48.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14e6000640 1 --2- 172.21.15.5:0/192744009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f006c3c0 0x7f14f015e8f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f14f00d20a0 tx=0x7f14d801c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54cc977134ddebd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:48.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14ee000640 1 -- 172.21.15.5:0/192744009 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80b0070 con 0x7f14f006c3c0 2024-08-18T22:23:48.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14ee000640 1 -- 172.21.15.5:0/192744009 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d80ab600 con 0x7f14f006c3c0 2024-08-18T22:23:48.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14ee000640 1 -- 172.21.15.5:0/192744009 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80ab9d0 con 0x7f14f006c3c0 2024-08-18T22:23:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14f5600640 1 -- 172.21.15.5:0/192744009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f006c3c0 msgr2=0x7f14f015e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14f5600640 1 --2- 172.21.15.5:0/192744009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f006c3c0 0x7f14f015e8f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f14f00d20a0 tx=0x7f14d801c1d0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14f5600640 1 -- 172.21.15.5:0/192744009 shutdown_connections 2024-08-18T22:23:48.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14f5600640 1 --2- 172.21.15.5:0/192744009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14f015ee30 0x7f14f0161ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14f5600640 1 --2- 172.21.15.5:0/192744009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f006c3c0 0x7f14f015e8f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14f5600640 1 --2- 172.21.15.5:0/192744009 >> v2:172.21.15.117:3300/0 conn(0x7f14f0147dd0 0x7f14f00b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14f5600640 1 -- 172.21.15.5:0/192744009 >> 172.21.15.5:0/192744009 conn(0x7f14f00b65f0 msgr2=0x7f14f00b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:48.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14f5600640 1 -- 172.21.15.5:0/192744009 shutdown_connections 2024-08-18T22:23:48.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14f5600640 1 -- 172.21.15.5:0/192744009 wait complete. 2024-08-18T22:23:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14f5600640 1 Processor -- start 2024-08-18T22:23:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.378+0000 7f14f5600640 1 -- start start 2024-08-18T22:23:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14f5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14f006c3c0 0x7f14f009d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14f5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0147dd0 0x7f14f009bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14f5600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f015ee30 0x7f14f006fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14f5600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f14f00b5b30 con 0x7f14f0147dd0 2024-08-18T22:23:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14f5600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f14f015f9e0 con 0x7f14f015ee30 2024-08-18T22:23:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14f5600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f14f00b5cb0 con 0x7f14f006c3c0 2024-08-18T22:23:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0147dd0 0x7f14f009bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0147dd0 0x7f14f009bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45902/0 (socket says 172.21.15.5:45902) 2024-08-18T22:23:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e6000640 1 -- 172.21.15.5:0/523085736 learned_addr learned my addr 172.21.15.5:0/523085736 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14eea00640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14f006c3c0 0x7f14f009d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14ef400640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f015ee30 0x7f14f006fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e6000640 1 -- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14f006c3c0 msgr2=0x7f14f009d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e6000640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14f006c3c0 0x7f14f009d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e6000640 1 -- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f015ee30 msgr2=0x7f14f006fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e6000640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f015ee30 0x7f14f006fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e6000640 1 -- 172.21.15.5:0/523085736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f00b2300 con 0x7f14f0147dd0 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14ef400640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f015ee30 0x7f14f006fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e6000640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0147dd0 0x7f14f009bbd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f14d801a880 tx=0x7f14d801aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e7400640 1 -- 172.21.15.5:0/523085736 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80ba020 con 0x7f14f0147dd0 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e7400640 1 -- 172.21.15.5:0/523085736 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d80b6620 con 0x7f14f0147dd0 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14f5600640 1 -- 172.21.15.5:0/523085736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f009c670 con 0x7f14f0147dd0 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e7400640 1 -- 172.21.15.5:0/523085736 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d80b0040 con 0x7f14f0147dd0 2024-08-18T22:23:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14f5600640 1 -- 172.21.15.5:0/523085736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f009cc30 con 0x7f14f0147dd0 2024-08-18T22:23:48.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14f5600640 1 -- 172.21.15.5:0/523085736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f00b40d0 con 0x7f14f0147dd0 2024-08-18T22:23:48.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.382+0000 7f14e7400640 1 -- 172.21.15.5:0/523085736 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f14d80bd020 con 0x7f14f0147dd0 2024-08-18T22:23:48.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.386+0000 7f14e7400640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f14cc0678c0 0x7f14cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:48.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.386+0000 7f14e7400640 1 -- 172.21.15.5:0/523085736 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f14d811fdd0 con 0x7f14f0147dd0 2024-08-18T22:23:48.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.386+0000 7f14eea00640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f14cc0678c0 0x7f14cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:48.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.386+0000 7f14eea00640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f14cc0678c0 0x7f14cc069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f14f013b330 tx=0x7f14e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:48.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.390+0000 7f14e7400640 1 -- 172.21.15.5:0/523085736 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f14d80c4030 con 0x7f14f0147dd0 2024-08-18T22:23:48.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.554+0000 7f14f5600640 1 -- 172.21.15.5:0/523085736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f14f0160530 con 0x7f14f0147dd0 2024-08-18T22:23:48.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14e7400640 1 -- 172.21.15.5:0/523085736 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f14f006c850 con 0x7f14f0147dd0 2024-08-18T22:23:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 -- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f14cc0678c0 msgr2=0x7f14cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f14cc0678c0 0x7f14cc069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f14f013b330 tx=0x7f14e0008040 comp rx=0 tx=0).stop 2024-08-18T22:23:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 -- 172.21.15.5:0/523085736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0147dd0 msgr2=0x7f14f009bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0147dd0 0x7f14f009bbd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f14d801a880 tx=0x7f14d801aa10 comp rx=0 tx=0).stop 2024-08-18T22:23:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 -- 172.21.15.5:0/523085736 shutdown_connections 2024-08-18T22:23:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f14cc0678c0 0x7f14cc069d80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f015ee30 0x7f14f006fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14f0147dd0 0x7f14f009bbd0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 --2- 172.21.15.5:0/523085736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14f006c3c0 0x7f14f009d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 -- 172.21.15.5:0/523085736 >> 172.21.15.5:0/523085736 conn(0x7f14f00b65f0 msgr2=0x7f14f00ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 -- 172.21.15.5:0/523085736 shutdown_connections 2024-08-18T22:23:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:48.558+0000 7f14f5600640 1 -- 172.21.15.5:0/523085736 wait complete. 2024-08-18T22:23:48.580 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:23:48.581 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:23:48.675 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:23:48.779 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:23:48.779 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:23:48.779 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:48.789 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:23:48.789 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:23:48.789 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:48.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:23:48.799 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:23:48.799 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:48.845 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:23:48.845 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:23:48.845 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:23:48.854 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:23:48.854 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:23:48.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec96600640 1 Processor -- start 2024-08-18T22:23:49.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec96600640 1 -- start start 2024-08-18T22:23:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec96600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec90071580 0x7fec9006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec96600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec900cbed0 0x7fec900cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec96600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec90071c80 con 0x7fec900b54c0 2024-08-18T22:23:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec96600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fec900cba40 con 0x7fec90071580 2024-08-18T22:23:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec96600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fec90071f60 con 0x7fec900cbed0 2024-08-18T22:23:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec8ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec90071580 0x7fec9006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec8f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fec900b54c0 0x7fec900b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47934/0 (socket says 172.21.15.5:47934) 2024-08-18T22:23:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec8f400640 1 -- 172.21.15.5:0/3402490372 learned_addr learned my addr 172.21.15.5:0/3402490372 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec8fe00640 1 --2- 172.21.15.5:0/3402490372 >> v2:172.21.15.117:3300/0 conn(0x7fec900cbed0 0x7fec900cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec8ea00640 1 -- 172.21.15.5:0/3402490372 >> v2:172.21.15.117:3300/0 conn(0x7fec900cbed0 msgr2=0x7fec900cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec8ea00640 1 --2- 172.21.15.5:0/3402490372 >> v2:172.21.15.117:3300/0 conn(0x7fec900cbed0 0x7fec900cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec8ea00640 1 -- 172.21.15.5:0/3402490372 >> v1:172.21.15.5:6789/0 conn(0x7fec900b54c0 legacy=0x7fec900b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec8ea00640 1 -- 172.21.15.5:0/3402490372 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec900cb6d0 con 0x7fec90071580 2024-08-18T22:23:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec8e000640 1 -- 172.21.15.5:0/3402490372 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808340788 0 0) 0x7fec90071c80 con 0x7fec900b54c0 2024-08-18T22:23:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.030+0000 7fec8fe00640 1 --2- 172.21.15.5:0/3402490372 >> v2:172.21.15.117:3300/0 conn(0x7fec900cbed0 0x7fec900cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec8ea00640 1 --2- 172.21.15.5:0/3402490372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec90071580 0x7fec9006dd80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fec9006f4c0 tx=0x7fec7c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42bb79373965123 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec8e000640 1 -- 172.21.15.5:0/3402490372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0b5070 con 0x7fec90071580 2024-08-18T22:23:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec8e000640 1 -- 172.21.15.5:0/3402490372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec7c0a8970 con 0x7fec90071580 2024-08-18T22:23:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec8e000640 1 -- 172.21.15.5:0/3402490372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0a8d40 con 0x7fec90071580 2024-08-18T22:23:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec96600640 1 -- 172.21.15.5:0/3402490372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec90071580 msgr2=0x7fec9006dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec96600640 1 --2- 172.21.15.5:0/3402490372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec90071580 0x7fec9006dd80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fec9006f4c0 tx=0x7fec7c01ec70 comp rx=0 tx=0).stop 2024-08-18T22:23:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec96600640 1 -- 172.21.15.5:0/3402490372 shutdown_connections 2024-08-18T22:23:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec96600640 1 --2- 172.21.15.5:0/3402490372 >> v2:172.21.15.117:3300/0 conn(0x7fec900cbed0 0x7fec900cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec96600640 1 --2- 172.21.15.5:0/3402490372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec90071580 0x7fec9006dd80 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec96600640 1 -- 172.21.15.5:0/3402490372 >> 172.21.15.5:0/3402490372 conn(0x7fec900b3eb0 msgr2=0x7fec900b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec96600640 1 -- 172.21.15.5:0/3402490372 shutdown_connections 2024-08-18T22:23:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec96600640 1 -- 172.21.15.5:0/3402490372 wait complete. 2024-08-18T22:23:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec96600640 1 Processor -- start 2024-08-18T22:23:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.034+0000 7fec96600640 1 -- start start 2024-08-18T22:23:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec96600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec90071580 0x7fec90142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec96600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec900b54c0 0x7fec900d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec96600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec900cbed0 0x7fec9015db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec96600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec901481a0 con 0x7fec900cbed0 2024-08-18T22:23:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec96600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fec90148020 con 0x7fec900b54c0 2024-08-18T22:23:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec96600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fec900cc8a0 con 0x7fec90071580 2024-08-18T22:23:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec900cbed0 0x7fec9015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec900cbed0 0x7fec9015db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45926/0 (socket says 172.21.15.5:45926) 2024-08-18T22:23:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8fe00640 1 -- 172.21.15.5:0/3293686938 learned_addr learned my addr 172.21.15.5:0/3293686938 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8f400640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec90071580 0x7fec90142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8fe00640 1 -- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec90071580 msgr2=0x7fec90142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8ea00640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec900b54c0 0x7fec900d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8fe00640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec90071580 0x7fec90142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8fe00640 1 -- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec900b54c0 msgr2=0x7fec900d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8fe00640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec900b54c0 0x7fec900d1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8fe00640 1 -- 172.21.15.5:0/3293686938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec90143280 con 0x7fec900cbed0 2024-08-18T22:23:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8ea00640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec900b54c0 0x7fec900d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8f400640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec90071580 0x7fec90142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec8fe00640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec900cbed0 0x7fec9015db80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fec8800cd50 tx=0x7fec8800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec87400640 1 -- 172.21.15.5:0/3293686938 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8800f680 con 0x7fec900cbed0 2024-08-18T22:23:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec87400640 1 -- 172.21.15.5:0/3293686938 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8800f840 con 0x7fec900cbed0 2024-08-18T22:23:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec87400640 1 -- 172.21.15.5:0/3293686938 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8800fc30 con 0x7fec900cbed0 2024-08-18T22:23:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec96600640 1 -- 172.21.15.5:0/3293686938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec900a96f0 con 0x7fec900cbed0 2024-08-18T22:23:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec96600640 1 -- 172.21.15.5:0/3293686938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec900a9cb0 con 0x7fec900cbed0 2024-08-18T22:23:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec96600640 1 -- 172.21.15.5:0/3293686938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec90071c80 con 0x7fec900cbed0 2024-08-18T22:23:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.038+0000 7fec87400640 1 -- 172.21.15.5:0/3293686938 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec8800e3e0 con 0x7fec900cbed0 2024-08-18T22:23:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.042+0000 7fec87400640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec700678c0 0x7fec70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.042+0000 7fec87400640 1 -- 172.21.15.5:0/3293686938 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7fec88086950 con 0x7fec900cbed0 2024-08-18T22:23:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.042+0000 7fec8f400640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec700678c0 0x7fec70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.042+0000 7fec8f400640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec700678c0 0x7fec70069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fec80000f70 tx=0x7fec80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.046+0000 7fec87400640 1 -- 172.21.15.5:0/3293686938 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fec88014030 con 0x7fec900cbed0 2024-08-18T22:23:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.246+0000 7fec96600640 1 -- 172.21.15.5:0/3293686938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec90145f50 con 0x7fec900cbed0 2024-08-18T22:23:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec87400640 1 -- 172.21.15.5:0/3293686938 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3908 (secure 0 0 0) 0x7fec880575a0 con 0x7fec900cbed0 2024-08-18T22:23:49.249 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:49.249 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":49,"btime":"2024-08-18T22:23:41:834732+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3998000168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3998000168},{"type":"v1","addr":"172.21.15.117:6837","nonce":3998000168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1741701025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1741701025},{"type":"v1","addr":"172.21.15.117:6835","nonce":1741701025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/188037311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":188037311},{"type":"v1","addr":"172.21.15.5:6835","nonce":188037311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6687,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3537160908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3537160908},{"type":"v1","addr":"172.21.15.5:6833","nonce":3537160908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[]} 2024-08-18T22:23:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 49 2024-08-18T22:23:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 -- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec700678c0 msgr2=0x7fec70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec700678c0 0x7fec70069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fec80000f70 tx=0x7fec80009040 comp rx=0 tx=0).stop 2024-08-18T22:23:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 -- 172.21.15.5:0/3293686938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec900cbed0 msgr2=0x7fec9015db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec900cbed0 0x7fec9015db80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fec8800cd50 tx=0x7fec8800a650 comp rx=0 tx=0).stop 2024-08-18T22:23:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 -- 172.21.15.5:0/3293686938 shutdown_connections 2024-08-18T22:23:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec700678c0 0x7fec70069d80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec900cbed0 0x7fec9015db80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec900b54c0 0x7fec900d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 --2- 172.21.15.5:0/3293686938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec90071580 0x7fec90142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 -- 172.21.15.5:0/3293686938 >> 172.21.15.5:0/3293686938 conn(0x7fec900b3eb0 msgr2=0x7fec900b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 -- 172.21.15.5:0/3293686938 shutdown_connections 2024-08-18T22:23:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.250+0000 7fec96600640 1 -- 172.21.15.5:0/3293686938 wait complete. 2024-08-18T22:23:49.271 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:23:49.271 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:23:49.272 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:23:49.272 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:23:49.272 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:23:49.272 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:23:49.272 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:23:49.272 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:23:49.272 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:23:49.272 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:23:49.273 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:23:49.273 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:23:49.273 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:23:49.273 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:23:49.273 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:23:49.273 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:23:49.285 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:23:49.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:23:49.286 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:23:49.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:23:49.287 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:23:49.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:23:49.288 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:23:49.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:23:49.336 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:23:49.336 DEBUG:teuthology.parallel:result is None 2024-08-18T22:23:49.337 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:23:49.337 DEBUG:teuthology.parallel:result is None 2024-08-18T22:23:49.338 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:23:49.339 DEBUG:teuthology.parallel:result is None 2024-08-18T22:23:49.339 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:23:49.339 DEBUG:teuthology.parallel:result is None 2024-08-18T22:23:49.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:23:49.423 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:23:49.424 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:23:49.428 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:23:49.428 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:23:49.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.486+0000 7ff45f400640 1 Processor -- start 2024-08-18T22:23:49.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.486+0000 7ff45f400640 1 -- start start 2024-08-18T22:23:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.486+0000 7ff45f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff45809aca0 0x7ff4580afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45f400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff45809b080 0x7ff4580b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45f400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45806e8a0 con 0x7ff4580b1300 2024-08-18T22:23:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45f400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff45809bb80 con 0x7ff45809aca0 2024-08-18T22:23:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45f400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff4580d2e40 con 0x7ff45809b080 2024-08-18T22:23:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff45809aca0 0x7ff4580afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff45809aca0 0x7ff4580afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45964/0 (socket says 172.21.15.5:45964) 2024-08-18T22:23:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45ca00640 1 -- 172.21.15.5:0/2825980992 learned_addr learned my addr 172.21.15.5:0/2825980992 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:49.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45d400640 1 --2- 172.21.15.5:0/2825980992 >> v2:172.21.15.117:3300/0 conn(0x7ff45809b080 0x7ff4580b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45ca00640 1 -- 172.21.15.5:0/2825980992 >> v2:172.21.15.117:3300/0 conn(0x7ff45809b080 msgr2=0x7ff4580b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45ca00640 1 --2- 172.21.15.5:0/2825980992 >> v2:172.21.15.117:3300/0 conn(0x7ff45809b080 0x7ff4580b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45ca00640 1 -- 172.21.15.5:0/2825980992 >> v1:172.21.15.117:6789/0 conn(0x7ff4580b1300 legacy=0x7ff4580affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45ca00640 1 -- 172.21.15.5:0/2825980992 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45806cbd0 con 0x7ff45809aca0 2024-08-18T22:23:49.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff45ca00640 1 --2- 172.21.15.5:0/2825980992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff45809aca0 0x7ff4580afa90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff458073460 tx=0x7ff44801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88983b2a624a3171 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:49.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff457e00640 1 -- 172.21.15.5:0/2825980992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4480b1070 con 0x7ff45809aca0 2024-08-18T22:23:49.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff457e00640 1 -- 172.21.15.5:0/2825980992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4480ac630 con 0x7ff45809aca0 2024-08-18T22:23:49.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.490+0000 7ff457e00640 1 -- 172.21.15.5:0/2825980992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4480a8050 con 0x7ff45809aca0 2024-08-18T22:23:49.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 -- 172.21.15.5:0/2825980992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff45809aca0 msgr2=0x7ff4580afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:49.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 --2- 172.21.15.5:0/2825980992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff45809aca0 0x7ff4580afa90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff458073460 tx=0x7ff44801c520 comp rx=0 tx=0).stop 2024-08-18T22:23:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 -- 172.21.15.5:0/2825980992 shutdown_connections 2024-08-18T22:23:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 --2- 172.21.15.5:0/2825980992 >> v2:172.21.15.117:3300/0 conn(0x7ff45809b080 0x7ff4580b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 --2- 172.21.15.5:0/2825980992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff45809aca0 0x7ff4580afa90 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 -- 172.21.15.5:0/2825980992 >> 172.21.15.5:0/2825980992 conn(0x7ff4580d2180 msgr2=0x7ff4580d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 -- 172.21.15.5:0/2825980992 shutdown_connections 2024-08-18T22:23:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 -- 172.21.15.5:0/2825980992 wait complete. 2024-08-18T22:23:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 Processor -- start 2024-08-18T22:23:49.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 -- start start 2024-08-18T22:23:49.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff45809aca0 0x7ff4580b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff45809b080 0x7ff45813e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4580b1300 0x7ff4580b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff45816b6b0 con 0x7ff4580b1300 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff45816b530 con 0x7ff45809b080 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45f400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff45816b830 con 0x7ff45809aca0 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4580b1300 0x7ff4580b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4580b1300 0x7ff4580b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45966/0 (socket says 172.21.15.5:45966) 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45d400640 1 -- 172.21.15.5:0/3576722228 learned_addr learned my addr 172.21.15.5:0/3576722228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff44fe00640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff45809b080 0x7ff45813e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45ca00640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff45809aca0 0x7ff4580b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45d400640 1 -- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff45809aca0 msgr2=0x7ff4580b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45d400640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff45809aca0 0x7ff4580b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45d400640 1 -- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff45809b080 msgr2=0x7ff45813e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45d400640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff45809b080 0x7ff45813e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.494+0000 7ff45d400640 1 -- 172.21.15.5:0/3576722228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45813e670 con 0x7ff4580b1300 2024-08-18T22:23:49.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.498+0000 7ff45d400640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4580b1300 0x7ff4580b0340 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff45000efc0 tx=0x7ff45000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:49.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.498+0000 7ff455600640 1 -- 172.21.15.5:0/3576722228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450018020 con 0x7ff4580b1300 2024-08-18T22:23:49.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.498+0000 7ff455600640 1 -- 172.21.15.5:0/3576722228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff450014480 con 0x7ff4580b1300 2024-08-18T22:23:49.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.498+0000 7ff455600640 1 -- 172.21.15.5:0/3576722228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450014870 con 0x7ff4580b1300 2024-08-18T22:23:49.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.498+0000 7ff45f400640 1 -- 172.21.15.5:0/3576722228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4580b6900 con 0x7ff4580b1300 2024-08-18T22:23:49.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.498+0000 7ff45f400640 1 -- 172.21.15.5:0/3576722228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4580b6ec0 con 0x7ff4580b1300 2024-08-18T22:23:49.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.498+0000 7ff45f400640 1 -- 172.21.15.5:0/3576722228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff458161940 con 0x7ff4580b1300 2024-08-18T22:23:49.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.498+0000 7ff455600640 1 -- 172.21.15.5:0/3576722228 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff45001b020 con 0x7ff4580b1300 2024-08-18T22:23:49.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.498+0000 7ff455600640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff434067910 0x7ff434069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:49.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.498+0000 7ff455600640 1 -- 172.21.15.5:0/3576722228 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7ff450086520 con 0x7ff4580b1300 2024-08-18T22:23:49.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.498+0000 7ff45ca00640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff434067910 0x7ff434069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:49.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.502+0000 7ff45ca00640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff434067910 0x7ff434069dd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff4480ae000 tx=0x7ff4480a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:49.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.502+0000 7ff455600640 1 -- 172.21.15.5:0/3576722228 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff450022070 con 0x7ff4580b1300 2024-08-18T22:23:49.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:49.682+0000 7ff45f400640 1 -- 172.21.15.5:0/3576722228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff4580d1120 con 0x7ff4580b1300 2024-08-18T22:23:50.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff455600640 1 -- 172.21.15.5:0/3576722228 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v76) ==== 97+0+0 (secure 0 0 0) 0x7ff45813e670 con 0x7ff4580b1300 2024-08-18T22:23:50.213 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 -- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff434067910 msgr2=0x7ff434069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff434067910 0x7ff434069dd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff4480ae000 tx=0x7ff4480a7000 comp rx=0 tx=0).stop 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 -- 172.21.15.5:0/3576722228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4580b1300 msgr2=0x7ff4580b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4580b1300 0x7ff4580b0340 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff45000efc0 tx=0x7ff45000c490 comp rx=0 tx=0).stop 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 -- 172.21.15.5:0/3576722228 shutdown_connections 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff434067910 0x7ff434069dd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4580b1300 0x7ff4580b0340 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff45809b080 0x7ff45813e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 --2- 172.21.15.5:0/3576722228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff45809aca0 0x7ff4580b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 -- 172.21.15.5:0/3576722228 >> 172.21.15.5:0/3576722228 conn(0x7ff4580d2180 msgr2=0x7ff4580710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 -- 172.21.15.5:0/3576722228 shutdown_connections 2024-08-18T22:23:50.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.214+0000 7ff45f400640 1 -- 172.21.15.5:0/3576722228 wait complete. 2024-08-18T22:23:50.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:23:50.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.378+0000 7f7983000640 1 Processor -- start 2024-08-18T22:23:50.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.378+0000 7f7983000640 1 -- start start 2024-08-18T22:23:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7983000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f797c0cb390 0x7f797c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7983000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f797c06da70 0x7f797c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7983000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f797c073c80 con 0x7f797c15bed0 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7983000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f797c06e3e0 con 0x7f797c0cb390 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7983000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f797c0ca5d0 con 0x7f797c06da70 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7973400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f797c0cb390 0x7f797c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7973400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f797c0cb390 0x7f797c0735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45982/0 (socket says 172.21.15.5:45982) 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7973400640 1 -- 172.21.15.5:0/622101502 learned_addr learned my addr 172.21.15.5:0/622101502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f797be00640 1 --1- 172.21.15.5:0/622101502 >> v1:172.21.15.5:6789/0 conn(0x7f797c15bed0 0x7f797c071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47958/0 (socket says 172.21.15.5:47958) 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7981000640 1 --2- 172.21.15.5:0/622101502 >> v2:172.21.15.117:3300/0 conn(0x7f797c06da70 0x7f797c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7973400640 1 -- 172.21.15.5:0/622101502 >> v2:172.21.15.117:3300/0 conn(0x7f797c06da70 msgr2=0x7f797c06dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7973400640 1 --2- 172.21.15.5:0/622101502 >> v2:172.21.15.117:3300/0 conn(0x7f797c06da70 0x7f797c06dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7973400640 1 -- 172.21.15.5:0/622101502 >> v1:172.21.15.5:6789/0 conn(0x7f797c15bed0 legacy=0x7f797c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7973400640 1 -- 172.21.15.5:0/622101502 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c0ca8b0 con 0x7f797c0cb390 2024-08-18T22:23:50.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f797b400640 1 -- 172.21.15.5:0/622101502 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605121132 0 0) 0x7f797c073c80 con 0x7f797c15bed0 2024-08-18T22:23:50.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.382+0000 7f7973400640 1 --2- 172.21.15.5:0/622101502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797c0cb390 0x7f797c0735a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f797c0cfe50 tx=0x7f796401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2730eb4f5f364 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:50.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f797b400640 1 -- 172.21.15.5:0/622101502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640aa650 con 0x7f797c0cb390 2024-08-18T22:23:50.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f797b400640 1 -- 172.21.15.5:0/622101502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79640af070 con 0x7f797c0cb390 2024-08-18T22:23:50.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f797b400640 1 -- 172.21.15.5:0/622101502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640aaa10 con 0x7f797c0cb390 2024-08-18T22:23:50.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 -- 172.21.15.5:0/622101502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797c0cb390 msgr2=0x7f797c0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 --2- 172.21.15.5:0/622101502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797c0cb390 0x7f797c0735a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f797c0cfe50 tx=0x7f796401c4f0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 -- 172.21.15.5:0/622101502 shutdown_connections 2024-08-18T22:23:50.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 --2- 172.21.15.5:0/622101502 >> v2:172.21.15.117:3300/0 conn(0x7f797c06da70 0x7f797c06dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 --2- 172.21.15.5:0/622101502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797c0cb390 0x7f797c0735a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 -- 172.21.15.5:0/622101502 >> 172.21.15.5:0/622101502 conn(0x7f797c0b1c50 msgr2=0x7f797c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:50.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 -- 172.21.15.5:0/622101502 shutdown_connections 2024-08-18T22:23:50.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 -- 172.21.15.5:0/622101502 wait complete. 2024-08-18T22:23:50.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 Processor -- start 2024-08-18T22:23:50.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 -- start start 2024-08-18T22:23:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797c06da70 0x7f797c0ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797c0cb390 0x7f797c150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797c15bed0 0x7f797c150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f797c168520 con 0x7f797c15bed0 2024-08-18T22:23:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f797c1683a0 con 0x7f797c0cb390 2024-08-18T22:23:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7983000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f797c1686a0 con 0x7f797c06da70 2024-08-18T22:23:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7981000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797c15bed0 0x7f797c150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7981000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797c15bed0 0x7f797c150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45990/0 (socket says 172.21.15.5:45990) 2024-08-18T22:23:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7981000640 1 -- 172.21.15.5:0/2754853643 learned_addr learned my addr 172.21.15.5:0/2754853643 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f797be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797c06da70 0x7f797c0ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:50.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.386+0000 7f7973400640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797c0cb390 0x7f797c150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:50.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7981000640 1 -- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797c06da70 msgr2=0x7f797c0ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7981000640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797c06da70 0x7f797c0ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7981000640 1 -- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797c0cb390 msgr2=0x7f797c150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7981000640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797c0cb390 0x7f797c150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7981000640 1 -- 172.21.15.5:0/2754853643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c0adb70 con 0x7f797c15bed0 2024-08-18T22:23:50.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7981000640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797c15bed0 0x7f797c150bd0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7974009dd0 tx=0x7f797400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:50.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7978c00640 1 -- 172.21.15.5:0/2754853643 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974018020 con 0x7f797c15bed0 2024-08-18T22:23:50.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7978c00640 1 -- 172.21.15.5:0/2754853643 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7974014480 con 0x7f797c15bed0 2024-08-18T22:23:50.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7983000640 1 -- 172.21.15.5:0/2754853643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797c0ade50 con 0x7f797c15bed0 2024-08-18T22:23:50.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7978c00640 1 -- 172.21.15.5:0/2754853643 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974014870 con 0x7f797c15bed0 2024-08-18T22:23:50.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7983000640 1 -- 172.21.15.5:0/2754853643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797c0ae410 con 0x7f797c15bed0 2024-08-18T22:23:50.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7983000640 1 -- 172.21.15.5:0/2754853643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f797c06dea0 con 0x7f797c15bed0 2024-08-18T22:23:50.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.390+0000 7f7978c00640 1 -- 172.21.15.5:0/2754853643 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f797401b020 con 0x7f797c15bed0 2024-08-18T22:23:50.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.394+0000 7f7978c00640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79580678c0 0x7f7958069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.394+0000 7f7978c00640 1 -- 172.21.15.5:0/2754853643 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5249+0+0 (secure 0 0 0) 0x7f7974086500 con 0x7f797c15bed0 2024-08-18T22:23:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.394+0000 7f797be00640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79580678c0 0x7f7958069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:50.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.394+0000 7f797be00640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79580678c0 0x7f7958069d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f796c000f70 tx=0x7f796c007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:50.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.398+0000 7f7978c00640 1 -- 172.21.15.5:0/2754853643 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7974022070 con 0x7f797c15bed0 2024-08-18T22:23:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.618+0000 7f7983000640 1 -- 172.21.15.5:0/2754853643 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f797c0ae780 con 0x7f797c15bed0 2024-08-18T22:23:50.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.618+0000 7f7978c00640 1 -- 172.21.15.5:0/2754853643 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f7974010040 con 0x7f797c15bed0 2024-08-18T22:23:50.620 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:50.620 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:23:50.620 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:23:50.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.621 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:23:50.621 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:23:50.621 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.621 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:50.622 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:23:50.622 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:23:50.622 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.622 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:23:50.623 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:50.624 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:23:50.625 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:23:50.625 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.625 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.625 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:23:50.625 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:23:50.625 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.625 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:50.625 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:50.626 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.626 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.626 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:23:50.626 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:23:50.626 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.626 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:50.627 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:50.627 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.627 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.627 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:23:50.627 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:23:50.627 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.627 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:50.627 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:50.628 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.628 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.628 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:23:50.628 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:23:50.628 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.629 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:50.629 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:50.629 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.629 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.629 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:23:50.629 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:23:50.629 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:50.630 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.631 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.632 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:50.633 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:23:50.633 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:23:50.633 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.633 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:23:50.633 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:23:50.633 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.633 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:50.633 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:23:50.633 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:23:50.634 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:23:50.634 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.634 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:23:50.634 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:23:50.634 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.634 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:50.634 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:23:50.635 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:23:50.635 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:23:50.635 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.635 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:23:50.635 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:23:50.635 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.635 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:23:50.636 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:23:50.636 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:23:50.636 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:23:50.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.636 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:23:50.636 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:23:50.636 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:23:50.637 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.638 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:23:50.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.638 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:23:50.638 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:23:50.638 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:23:50.639 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:23:50.639 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:23:50.639 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:23:50.639 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.639 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.639 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:23:50.639 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:23:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 -- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79580678c0 msgr2=0x7f7958069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79580678c0 0x7f7958069d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f796c000f70 tx=0x7f796c007df0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 -- 172.21.15.5:0/2754853643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797c15bed0 msgr2=0x7f797c150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797c15bed0 0x7f797c150bd0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7974009dd0 tx=0x7f797400c490 comp rx=0 tx=0).stop 2024-08-18T22:23:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 -- 172.21.15.5:0/2754853643 shutdown_connections 2024-08-18T22:23:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79580678c0 0x7f7958069d80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797c15bed0 0x7f797c150bd0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797c0cb390 0x7f797c150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 --2- 172.21.15.5:0/2754853643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797c06da70 0x7f797c0ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 -- 172.21.15.5:0/2754853643 >> 172.21.15.5:0/2754853643 conn(0x7f797c0b1c50 msgr2=0x7f797c0cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 -- 172.21.15.5:0/2754853643 shutdown_connections 2024-08-18T22:23:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.622+0000 7f7983000640 1 -- 172.21.15.5:0/2754853643 wait complete. 2024-08-18T22:23:50.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:23:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.782+0000 7ff75a800640 1 Processor -- start 2024-08-18T22:23:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.782+0000 7ff75a800640 1 -- start start 2024-08-18T22:23:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff75a800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75406f290 0x7ff7540ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff75a800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7540cee20 con 0x7ff7540cd3a0 2024-08-18T22:23:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff75a800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7540cf100 con 0x7ff75415b010 2024-08-18T22:23:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff75a800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff7540cfa30 con 0x7ff75406f290 2024-08-18T22:23:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff753e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff7540cd3a0 0x7ff754072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47964/0 (socket says 172.21.15.5:47964) 2024-08-18T22:23:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff753e00640 1 -- 172.21.15.5:0/147232411 learned_addr learned my addr 172.21.15.5:0/147232411 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff752a00640 1 --2- 172.21.15.5:0/147232411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75406f290 0x7ff7540ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff752000640 1 -- 172.21.15.5:0/147232411 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865263687 0 0) 0x7ff7540cee20 con 0x7ff7540cd3a0 2024-08-18T22:23:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff752000640 1 -- 172.21.15.5:0/147232411 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff738003530 con 0x7ff7540cd3a0 2024-08-18T22:23:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff752000640 1 -- 172.21.15.5:0/147232411 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738387799 0 0) 0x7ff7540cf100 con 0x7ff75415b010 2024-08-18T22:23:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff752000640 1 -- 172.21.15.5:0/147232411 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7540cee20 con 0x7ff75415b010 2024-08-18T22:23:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff752a00640 1 -- 172.21.15.5:0/147232411 >> v1:172.21.15.117:6789/0 conn(0x7ff75415b010 legacy=0x7ff75406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff752a00640 1 -- 172.21.15.5:0/147232411 >> v1:172.21.15.5:6789/0 conn(0x7ff7540cd3a0 legacy=0x7ff754072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.786+0000 7ff752a00640 1 -- 172.21.15.5:0/147232411 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7540cf3e0 con 0x7ff75406f290 2024-08-18T22:23:50.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff752a00640 1 --2- 172.21.15.5:0/147232411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75406f290 0x7ff7540ce840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff7400097f0 tx=0x7ff74001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a1e9d3cd7511e15 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:50.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff752000640 1 -- 172.21.15.5:0/147232411 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7400ab610 con 0x7ff75406f290 2024-08-18T22:23:50.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff752000640 1 -- 172.21.15.5:0/147232411 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7400b0070 con 0x7ff75406f290 2024-08-18T22:23:50.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff752000640 1 -- 172.21.15.5:0/147232411 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7400ab9b0 con 0x7ff75406f290 2024-08-18T22:23:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff75a800640 1 -- 172.21.15.5:0/147232411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75406f290 msgr2=0x7ff7540ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff75a800640 1 --2- 172.21.15.5:0/147232411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75406f290 0x7ff7540ce840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff7400097f0 tx=0x7ff74001c4b0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff75a800640 1 -- 172.21.15.5:0/147232411 shutdown_connections 2024-08-18T22:23:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff75a800640 1 --2- 172.21.15.5:0/147232411 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75406f290 0x7ff7540ce840 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff75a800640 1 -- 172.21.15.5:0/147232411 >> 172.21.15.5:0/147232411 conn(0x7ff7540b1c50 msgr2=0x7ff7540b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff75a800640 1 -- 172.21.15.5:0/147232411 shutdown_connections 2024-08-18T22:23:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff75a800640 1 -- 172.21.15.5:0/147232411 wait complete. 2024-08-18T22:23:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff75a800640 1 Processor -- start 2024-08-18T22:23:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.790+0000 7ff75a800640 1 -- start start 2024-08-18T22:23:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff75a800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75406f290 0x7ff75414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff75a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7540cd3a0 0x7ff7540b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff75a800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff75415b010 0x7ff7540b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff75a800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff7540736c0 con 0x7ff7540cd3a0 2024-08-18T22:23:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff75a800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff754073540 con 0x7ff75415b010 2024-08-18T22:23:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff75a800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff754073840 con 0x7ff75406f290 2024-08-18T22:23:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff752a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7540cd3a0 0x7ff7540b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff752a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7540cd3a0 0x7ff7540b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46002/0 (socket says 172.21.15.5:46002) 2024-08-18T22:23:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff752a00640 1 -- 172.21.15.5:0/1803877482 learned_addr learned my addr 172.21.15.5:0/1803877482 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff753400640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75406f290 0x7ff75414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff753e00640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff75415b010 0x7ff7540b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:50.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff752a00640 1 -- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75406f290 msgr2=0x7ff75414ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff752a00640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75406f290 0x7ff75414ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff752a00640 1 -- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff75415b010 msgr2=0x7ff7540b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff752a00640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff75415b010 0x7ff7540b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff752a00640 1 -- 172.21.15.5:0/1803877482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7540b4650 con 0x7ff7540cd3a0 2024-08-18T22:23:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff752a00640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7540cd3a0 0x7ff7540b4110 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff7400ad040 tx=0x7ff740019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff74b400640 1 -- 172.21.15.5:0/1803877482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740003820 con 0x7ff7540cd3a0 2024-08-18T22:23:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff74b400640 1 -- 172.21.15.5:0/1803877482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7400039c0 con 0x7ff7540cd3a0 2024-08-18T22:23:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff74b400640 1 -- 172.21.15.5:0/1803877482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740003d90 con 0x7ff7540cd3a0 2024-08-18T22:23:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff75a800640 1 -- 172.21.15.5:0/1803877482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7540b4eb0 con 0x7ff7540cd3a0 2024-08-18T22:23:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff75a800640 1 -- 172.21.15.5:0/1803877482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7540b4bd0 con 0x7ff7540cd3a0 2024-08-18T22:23:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.794+0000 7ff75a800640 1 -- 172.21.15.5:0/1803877482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7540ce840 con 0x7ff7540cd3a0 2024-08-18T22:23:50.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.798+0000 7ff74b400640 1 -- 172.21.15.5:0/1803877482 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7400c3060 con 0x7ff7540cd3a0 2024-08-18T22:23:50.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.798+0000 7ff74b400640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7340678f0 0x7ff734069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:50.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.798+0000 7ff74b400640 1 -- 172.21.15.5:0/1803877482 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5249+0+0 (secure 0 0 0) 0x7ff74011f830 con 0x7ff7540cd3a0 2024-08-18T22:23:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.798+0000 7ff753400640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7340678f0 0x7ff734069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.798+0000 7ff753400640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7340678f0 0x7ff734069db0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff7440011f0 tx=0x7ff744009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.802+0000 7ff74b400640 1 -- 172.21.15.5:0/1803877482 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff7400a8050 con 0x7ff7540cd3a0 2024-08-18T22:23:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.966+0000 7ff75a800640 1 -- 172.21.15.5:0/1803877482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff7540af940 con 0x7ff7540cd3a0 2024-08-18T22:23:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.966+0000 7ff74b400640 1 -- 172.21.15.5:0/1803877482 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) ==== 84+0+65 (secure 0 0 0) 0x7ff7400160d0 con 0x7ff7540cd3a0 2024-08-18T22:23:50.968 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:50.968 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:23:50.968 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:23:50.968 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:23:50.968 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:23:50.969 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:23:50.969 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:23:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 -- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7340678f0 msgr2=0x7ff734069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7340678f0 0x7ff734069db0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff7440011f0 tx=0x7ff744009040 comp rx=0 tx=0).stop 2024-08-18T22:23:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 -- 172.21.15.5:0/1803877482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7540cd3a0 msgr2=0x7ff7540b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7540cd3a0 0x7ff7540b4110 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff7400ad040 tx=0x7ff740019250 comp rx=0 tx=0).stop 2024-08-18T22:23:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 -- 172.21.15.5:0/1803877482 shutdown_connections 2024-08-18T22:23:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7340678f0 0x7ff734069db0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff75415b010 0x7ff7540b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7540cd3a0 0x7ff7540b4110 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 --2- 172.21.15.5:0/1803877482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75406f290 0x7ff75414ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:50.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 -- 172.21.15.5:0/1803877482 >> 172.21.15.5:0/1803877482 conn(0x7ff7540b1c50 msgr2=0x7ff7540b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:50.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 -- 172.21.15.5:0/1803877482 shutdown_connections 2024-08-18T22:23:50.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:50.970+0000 7ff75a800640 1 -- 172.21.15.5:0/1803877482 wait complete. 2024-08-18T22:23:50.991 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:23:50.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:23:51.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.134+0000 7f9709c00640 1 Processor -- start 2024-08-18T22:23:51.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.134+0000 7f9709c00640 1 -- start start 2024-08-18T22:23:51.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9709c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f97041625a0 0x7f9704162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:51.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9709c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f970409b150 0x7f97040b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:51.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9709c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97040b6500 con 0x7f97040b5ab0 2024-08-18T22:23:51.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9709c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f97040b67e0 con 0x7f970409b150 2024-08-18T22:23:51.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9709c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f97040b6ac0 con 0x7f97041625a0 2024-08-18T22:23:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9703400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f970409b150 0x7f97040b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9703400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f970409b150 0x7f97040b5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46004/0 (socket says 172.21.15.5:46004) 2024-08-18T22:23:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9703400640 1 -- 172.21.15.5:0/2214138363 learned_addr learned my addr 172.21.15.5:0/2214138363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9702000640 1 --1- 172.21.15.5:0/2214138363 >> v1:172.21.15.5:6789/0 conn(0x7f97040b5ab0 0x7f970409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47966/0 (socket says 172.21.15.5:47966) 2024-08-18T22:23:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9702a00640 1 --2- 172.21.15.5:0/2214138363 >> v2:172.21.15.117:3300/0 conn(0x7f97041625a0 0x7f9704162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9703400640 1 -- 172.21.15.5:0/2214138363 >> v2:172.21.15.117:3300/0 conn(0x7f97041625a0 msgr2=0x7f9704162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9703400640 1 --2- 172.21.15.5:0/2214138363 >> v2:172.21.15.117:3300/0 conn(0x7f97041625a0 0x7f9704162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9703400640 1 -- 172.21.15.5:0/2214138363 >> v1:172.21.15.5:6789/0 conn(0x7f97040b5ab0 legacy=0x7f970409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9703400640 1 -- 172.21.15.5:0/2214138363 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97040b6da0 con 0x7f970409b150 2024-08-18T22:23:51.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.138+0000 7f9703400640 1 --2- 172.21.15.5:0/2214138363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f970409b150 0x7f97040b5f20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f970406fcc0 tx=0x7f96fc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc05227d7a26056c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:51.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9701600640 1 -- 172.21.15.5:0/2214138363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0a5730 con 0x7f970409b150 2024-08-18T22:23:51.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9701600640 1 -- 172.21.15.5:0/2214138363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96fc0a58d0 con 0x7f970409b150 2024-08-18T22:23:51.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9701600640 1 -- 172.21.15.5:0/2214138363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0a5ca0 con 0x7f970409b150 2024-08-18T22:23:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 -- 172.21.15.5:0/2214138363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f970409b150 msgr2=0x7f97040b5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 --2- 172.21.15.5:0/2214138363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f970409b150 0x7f97040b5f20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f970406fcc0 tx=0x7f96fc01c960 comp rx=0 tx=0).stop 2024-08-18T22:23:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 -- 172.21.15.5:0/2214138363 shutdown_connections 2024-08-18T22:23:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 --2- 172.21.15.5:0/2214138363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f970409b150 0x7f97040b5f20 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 --2- 172.21.15.5:0/2214138363 >> v2:172.21.15.117:3300/0 conn(0x7f97041625a0 0x7f9704162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 -- 172.21.15.5:0/2214138363 >> 172.21.15.5:0/2214138363 conn(0x7f97040b3d60 msgr2=0x7f97040b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 -- 172.21.15.5:0/2214138363 shutdown_connections 2024-08-18T22:23:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 -- 172.21.15.5:0/2214138363 wait complete. 2024-08-18T22:23:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 Processor -- start 2024-08-18T22:23:51.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 -- start start 2024-08-18T22:23:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f970409b150 0x7f97041fa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97040b5ab0 0x7f97041fa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97041625a0 0x7f9704146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9704070b10 con 0x7f970409b150 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9704070990 con 0x7f97041625a0 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9709c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9704070c90 con 0x7f97040b5ab0 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9702a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f970409b150 0x7f97041fa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9702a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f970409b150 0x7f97041fa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46016/0 (socket says 172.21.15.5:46016) 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9702a00640 1 -- 172.21.15.5:0/3394149296 learned_addr learned my addr 172.21.15.5:0/3394149296 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9703400640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97041625a0 0x7f9704146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9702a00640 1 -- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97040b5ab0 msgr2=0x7f97041fa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.142+0000 7f9702a00640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97040b5ab0 0x7f97041fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f9702a00640 1 -- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97041625a0 msgr2=0x7f9704146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f9702a00640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97041625a0 0x7f9704146320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f9702a00640 1 -- 172.21.15.5:0/3394149296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97041601c0 con 0x7f970409b150 2024-08-18T22:23:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f9702a00640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f970409b150 0x7f97041fa980 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f96f400d5f0 tx=0x7f96f400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f96faa00640 1 -- 172.21.15.5:0/3394149296 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f40125f0 con 0x7f970409b150 2024-08-18T22:23:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f96faa00640 1 -- 172.21.15.5:0/3394149296 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f4019070 con 0x7f970409b150 2024-08-18T22:23:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f96faa00640 1 -- 172.21.15.5:0/3394149296 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f40129b0 con 0x7f970409b150 2024-08-18T22:23:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f9709c00640 1 -- 172.21.15.5:0/3394149296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97041604a0 con 0x7f970409b150 2024-08-18T22:23:51.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f9709c00640 1 -- 172.21.15.5:0/3394149296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9704160a60 con 0x7f970409b150 2024-08-18T22:23:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f9709c00640 1 -- 172.21.15.5:0/3394149296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9704071050 con 0x7f970409b150 2024-08-18T22:23:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f96faa00640 1 -- 172.21.15.5:0/3394149296 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96f4012b50 con 0x7f970409b150 2024-08-18T22:23:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f96faa00640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e40678c0 0x7f96e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f96faa00640 1 -- 172.21.15.5:0/3394149296 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5249+0+0 (secure 0 0 0) 0x7f96f4085f20 con 0x7f970409b150 2024-08-18T22:23:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.146+0000 7f9702000640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e40678c0 0x7f96e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:51.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.150+0000 7f9702000640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e40678c0 0x7f96e4069d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f96f0000f70 tx=0x7f96f0007a10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:51.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.150+0000 7f96faa00640 1 -- 172.21.15.5:0/3394149296 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f96f4056c10 con 0x7f970409b150 2024-08-18T22:23:51.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:51.322+0000 7f9709c00640 1 -- 172.21.15.5:0/3394149296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f970409bd20 con 0x7f970409b150 2024-08-18T22:23:52.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.218+0000 7f96faa00640 1 -- 172.21.15.5:0/3394149296 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) ==== 138+0+0 (secure 0 0 0) 0x7f96f4056510 con 0x7f970409b150 2024-08-18T22:23:52.220 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:23:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 -- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e40678c0 msgr2=0x7f96e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e40678c0 0x7f96e4069d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f96f0000f70 tx=0x7f96f0007a10 comp rx=0 tx=0).stop 2024-08-18T22:23:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 -- 172.21.15.5:0/3394149296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f970409b150 msgr2=0x7f97041fa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f970409b150 0x7f97041fa980 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f96f400d5f0 tx=0x7f96f400dab0 comp rx=0 tx=0).stop 2024-08-18T22:23:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 -- 172.21.15.5:0/3394149296 shutdown_connections 2024-08-18T22:23:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e40678c0 0x7f96e4069d80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97041625a0 0x7f9704146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97040b5ab0 0x7f97041fa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 --2- 172.21.15.5:0/3394149296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f970409b150 0x7f97041fa980 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 -- 172.21.15.5:0/3394149296 >> 172.21.15.5:0/3394149296 conn(0x7f97040b3d60 msgr2=0x7f97041577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 -- 172.21.15.5:0/3394149296 shutdown_connections 2024-08-18T22:23:52.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.222+0000 7f9709c00640 1 -- 172.21.15.5:0/3394149296 wait complete. 2024-08-18T22:23:52.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:23:52.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:23:52.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:23:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca74600640 1 Processor -- start 2024-08-18T22:23:52.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca74600640 1 -- start start 2024-08-18T22:23:52.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca74600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6c0b1300 0x7fca6c162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:52.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca74600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca6c09b080 0x7fca6c0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:52.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca74600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca6c06e8a0 con 0x7fca6c09aca0 2024-08-18T22:23:52.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca74600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fca6c09bb80 con 0x7fca6c09b080 2024-08-18T22:23:52.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca74600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fca6c0d2e40 con 0x7fca6c0b1300 2024-08-18T22:23:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca72600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca6c09b080 0x7fca6c0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca72600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca6c09b080 0x7fca6c0b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46026/0 (socket says 172.21.15.5:46026) 2024-08-18T22:23:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca72600640 1 -- 172.21.15.5:0/3232790685 learned_addr learned my addr 172.21.15.5:0/3232790685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca71200640 1 --2- 172.21.15.5:0/3232790685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6c0b1300 0x7fca6c162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca72600640 1 -- 172.21.15.5:0/3232790685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6c0b1300 msgr2=0x7fca6c162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca72600640 1 --2- 172.21.15.5:0/3232790685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6c0b1300 0x7fca6c162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:52.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca72600640 1 -- 172.21.15.5:0/3232790685 >> v1:172.21.15.117:6789/0 conn(0x7fca6c09aca0 legacy=0x7fca6c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:52.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.482+0000 7fca72600640 1 -- 172.21.15.5:0/3232790685 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6c06cbd0 con 0x7fca6c09b080 2024-08-18T22:23:52.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca72600640 1 --2- 172.21.15.5:0/3232790685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c09b080 0x7fca6c0b01a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fca64009870 tx=0x7fca6401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cab243afd267e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca6be00640 1 -- 172.21.15.5:0/3232790685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca640a7070 con 0x7fca6c09b080 2024-08-18T22:23:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca6be00640 1 -- 172.21.15.5:0/3232790685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca640b0070 con 0x7fca6c09b080 2024-08-18T22:23:52.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca6be00640 1 -- 172.21.15.5:0/3232790685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca640ab890 con 0x7fca6c09b080 2024-08-18T22:23:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca74600640 1 -- 172.21.15.5:0/3232790685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c09b080 msgr2=0x7fca6c0b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca74600640 1 --2- 172.21.15.5:0/3232790685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c09b080 0x7fca6c0b01a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fca64009870 tx=0x7fca6401c560 comp rx=0 tx=0).stop 2024-08-18T22:23:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca74600640 1 -- 172.21.15.5:0/3232790685 shutdown_connections 2024-08-18T22:23:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca74600640 1 --2- 172.21.15.5:0/3232790685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c09b080 0x7fca6c0b01a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca74600640 1 --2- 172.21.15.5:0/3232790685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6c0b1300 0x7fca6c162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca74600640 1 -- 172.21.15.5:0/3232790685 >> 172.21.15.5:0/3232790685 conn(0x7fca6c0d2180 msgr2=0x7fca6c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca74600640 1 -- 172.21.15.5:0/3232790685 shutdown_connections 2024-08-18T22:23:52.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca74600640 1 -- 172.21.15.5:0/3232790685 wait complete. 2024-08-18T22:23:52.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca74600640 1 Processor -- start 2024-08-18T22:23:52.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.486+0000 7fca74600640 1 -- start start 2024-08-18T22:23:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca74600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c09aca0 0x7fca6c160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca74600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6c09b080 0x7fca6c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca74600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6c0b1300 0x7fca6c0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca74600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c16bcb0 con 0x7fca6c09aca0 2024-08-18T22:23:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca74600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c16bb30 con 0x7fca6c0b1300 2024-08-18T22:23:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca74600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fca6c16be30 con 0x7fca6c09b080 2024-08-18T22:23:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca71c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c09aca0 0x7fca6c160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca71c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c09aca0 0x7fca6c160020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46030/0 (socket says 172.21.15.5:46030) 2024-08-18T22:23:52.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca71c00640 1 -- 172.21.15.5:0/3853546320 learned_addr learned my addr 172.21.15.5:0/3853546320 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca72600640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6c0b1300 0x7fca6c0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca71200640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6c09b080 0x7fca6c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca71c00640 1 -- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6c09b080 msgr2=0x7fca6c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca71c00640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6c09b080 0x7fca6c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca71c00640 1 -- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6c0b1300 msgr2=0x7fca6c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca71c00640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6c0b1300 0x7fca6c0b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca71c00640 1 -- 172.21.15.5:0/3853546320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6c0b7380 con 0x7fca6c09aca0 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca72600640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6c0b1300 0x7fca6c0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca71c00640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c09aca0 0x7fca6c160020 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c790 tx=0x7fca6000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca69600640 1 -- 172.21.15.5:0/3853546320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60016020 con 0x7fca6c09aca0 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca69600640 1 -- 172.21.15.5:0/3853546320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca60006d60 con 0x7fca6c09aca0 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca69600640 1 -- 172.21.15.5:0/3853546320 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60003bc0 con 0x7fca6c09aca0 2024-08-18T22:23:52.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca74600640 1 -- 172.21.15.5:0/3853546320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6c0b6dc0 con 0x7fca6c09aca0 2024-08-18T22:23:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca74600640 1 -- 172.21.15.5:0/3853546320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca6c0b1d20 con 0x7fca6c09aca0 2024-08-18T22:23:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.490+0000 7fca74600640 1 -- 172.21.15.5:0/3853546320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca6c0afa90 con 0x7fca6c09aca0 2024-08-18T22:23:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.494+0000 7fca69600640 1 -- 172.21.15.5:0/3853546320 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fca6000a850 con 0x7fca6c09aca0 2024-08-18T22:23:52.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.494+0000 7fca69600640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fca4c0678c0 0x7fca4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:52.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.494+0000 7fca69600640 1 -- 172.21.15.5:0/3853546320 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5619+0+0 (secure 0 0 0) 0x7fca60085880 con 0x7fca6c09aca0 2024-08-18T22:23:52.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.494+0000 7fca71200640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fca4c0678c0 0x7fca4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:52.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.494+0000 7fca71200640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fca4c0678c0 0x7fca4c069d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0b3970 tx=0x7fca58009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.498+0000 7fca69600640 1 -- 172.21.15.5:0/3853546320 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fca60020020 con 0x7fca6c09aca0 2024-08-18T22:23:52.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:52.666+0000 7fca74600640 1 -- 172.21.15.5:0/3853546320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fca6c0af170 con 0x7fca6c09aca0 2024-08-18T22:23:53.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.222+0000 7fca69600640 1 -- 172.21.15.5:0/3853546320 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) ==== 170+0+0 (secure 0 0 0) 0x7fca60055d30 con 0x7fca6c09aca0 2024-08-18T22:23:53.222 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:23:53.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.222+0000 7fca74600640 1 -- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fca4c0678c0 msgr2=0x7fca4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:53.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.222+0000 7fca74600640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fca4c0678c0 0x7fca4c069d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0b3970 tx=0x7fca58009190 comp rx=0 tx=0).stop 2024-08-18T22:23:53.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.222+0000 7fca74600640 1 -- 172.21.15.5:0/3853546320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c09aca0 msgr2=0x7fca6c160020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:53.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.222+0000 7fca74600640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c09aca0 0x7fca6c160020 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c790 tx=0x7fca6000cc50 comp rx=0 tx=0).stop 2024-08-18T22:23:53.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.226+0000 7fca74600640 1 -- 172.21.15.5:0/3853546320 shutdown_connections 2024-08-18T22:23:53.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.226+0000 7fca74600640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fca4c0678c0 0x7fca4c069d80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:53.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.226+0000 7fca74600640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca6c0b1300 0x7fca6c0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:53.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.226+0000 7fca74600640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca6c09b080 0x7fca6c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:53.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.226+0000 7fca74600640 1 --2- 172.21.15.5:0/3853546320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca6c09aca0 0x7fca6c160020 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:53.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.226+0000 7fca74600640 1 -- 172.21.15.5:0/3853546320 >> 172.21.15.5:0/3853546320 conn(0x7fca6c0d2180 msgr2=0x7fca6c0cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:53.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.226+0000 7fca74600640 1 -- 172.21.15.5:0/3853546320 shutdown_connections 2024-08-18T22:23:53.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.226+0000 7fca74600640 1 -- 172.21.15.5:0/3853546320 wait complete. 2024-08-18T22:23:53.263 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:23:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.406+0000 7ff347400640 1 Processor -- start 2024-08-18T22:23:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.406+0000 7ff347400640 1 -- start start 2024-08-18T22:23:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff347400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff34009b080 0x7ff3400b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff347400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34006e8a0 con 0x7ff3400b1300 2024-08-18T22:23:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff347400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34009bb80 con 0x7ff34009aca0 2024-08-18T22:23:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff347400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff3400d2e40 con 0x7ff34009b080 2024-08-18T22:23:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff33fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff3400b1300 0x7ff340162950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47968/0 (socket says 172.21.15.5:47968) 2024-08-18T22:23:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff33fe00640 1 -- 172.21.15.5:0/4076618197 learned_addr learned my addr 172.21.15.5:0/4076618197 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff345400640 1 --2- 172.21.15.5:0/4076618197 >> v2:172.21.15.117:3300/0 conn(0x7ff34009b080 0x7ff3400b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff33f400640 1 -- 172.21.15.5:0/4076618197 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539590011 0 0) 0x7ff34006e8a0 con 0x7ff3400b1300 2024-08-18T22:23:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff33f400640 1 -- 172.21.15.5:0/4076618197 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff324003530 con 0x7ff3400b1300 2024-08-18T22:23:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff33f400640 1 -- 172.21.15.5:0/4076618197 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3943094667 0 0) 0x7ff324003530 con 0x7ff3400b1300 2024-08-18T22:23:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff345400640 1 -- 172.21.15.5:0/4076618197 >> v1:172.21.15.117:6789/0 conn(0x7ff34009aca0 legacy=0x7ff3400afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff345400640 1 -- 172.21.15.5:0/4076618197 >> v1:172.21.15.5:6789/0 conn(0x7ff3400b1300 legacy=0x7ff340162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.410+0000 7ff345400640 1 -- 172.21.15.5:0/4076618197 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34006cbd0 con 0x7ff34009b080 2024-08-18T22:23:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff345400640 1 --2- 172.21.15.5:0/4076618197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff34009b080 0x7ff3400b01a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff3380097c0 tx=0x7ff33801c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2af4dfc3b9732e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff33f400640 1 -- 172.21.15.5:0/4076618197 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3380b0070 con 0x7ff34009b080 2024-08-18T22:23:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff33f400640 1 -- 172.21.15.5:0/4076618197 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3380ab400 con 0x7ff34009b080 2024-08-18T22:23:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff33f400640 1 -- 172.21.15.5:0/4076618197 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c001680 con 0x7ff34009b080 2024-08-18T22:23:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff347400640 1 -- 172.21.15.5:0/4076618197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff34009b080 msgr2=0x7ff3400b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff347400640 1 --2- 172.21.15.5:0/4076618197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff34009b080 0x7ff3400b01a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff3380097c0 tx=0x7ff33801c270 comp rx=0 tx=0).stop 2024-08-18T22:23:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff347400640 1 -- 172.21.15.5:0/4076618197 shutdown_connections 2024-08-18T22:23:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff347400640 1 --2- 172.21.15.5:0/4076618197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff34009b080 0x7ff3400b01a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff347400640 1 -- 172.21.15.5:0/4076618197 >> 172.21.15.5:0/4076618197 conn(0x7ff3400d2180 msgr2=0x7ff3400d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff347400640 1 -- 172.21.15.5:0/4076618197 shutdown_connections 2024-08-18T22:23:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff347400640 1 -- 172.21.15.5:0/4076618197 wait complete. 2024-08-18T22:23:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff347400640 1 Processor -- start 2024-08-18T22:23:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.414+0000 7ff347400640 1 -- start start 2024-08-18T22:23:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff347400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34009aca0 0x7ff3401f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff347400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34009b080 0x7ff3401574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff347400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3400b1300 0x7ff340161710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff347400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3400b1960 con 0x7ff34009b080 2024-08-18T22:23:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff347400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff3400b17e0 con 0x7ff3400b1300 2024-08-18T22:23:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff347400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff3400b1ae0 con 0x7ff34009aca0 2024-08-18T22:23:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34009b080 0x7ff3401574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34009b080 0x7ff3401574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46040/0 (socket says 172.21.15.5:46040) 2024-08-18T22:23:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33fe00640 1 -- 172.21.15.5:0/2502844659 learned_addr learned my addr 172.21.15.5:0/2502844659 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff345400640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3400b1300 0x7ff340161710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff344a00640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34009aca0 0x7ff3401f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33fe00640 1 -- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34009aca0 msgr2=0x7ff3401f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33fe00640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34009aca0 0x7ff3401f3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33fe00640 1 -- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3400b1300 msgr2=0x7ff340161710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33fe00640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3400b1300 0x7ff340161710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33fe00640 1 -- 172.21.15.5:0/2502844659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34015ccb0 con 0x7ff34009b080 2024-08-18T22:23:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff345400640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3400b1300 0x7ff340161710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff344a00640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34009aca0 0x7ff3401f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33fe00640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34009b080 0x7ff3401574f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00c4e0 tx=0x7ff32c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33cc00640 1 -- 172.21.15.5:0/2502844659 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c018070 con 0x7ff34009b080 2024-08-18T22:23:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33cc00640 1 -- 172.21.15.5:0/2502844659 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c007500 con 0x7ff34009b080 2024-08-18T22:23:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff347400640 1 -- 172.21.15.5:0/2502844659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff34015cf90 con 0x7ff34009b080 2024-08-18T22:23:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff33cc00640 1 -- 172.21.15.5:0/2502844659 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c004a30 con 0x7ff34009b080 2024-08-18T22:23:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff347400640 1 -- 172.21.15.5:0/2502844659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3400b5290 con 0x7ff34009b080 2024-08-18T22:23:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.418+0000 7ff347400640 1 -- 172.21.15.5:0/2502844659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3400b5490 con 0x7ff34009b080 2024-08-18T22:23:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.422+0000 7ff33cc00640 1 -- 172.21.15.5:0/2502844659 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff32c004bd0 con 0x7ff34009b080 2024-08-18T22:23:53.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.422+0000 7ff33cc00640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3200678c0 0x7ff320069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:53.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.422+0000 7ff33cc00640 1 -- 172.21.15.5:0/2502844659 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6001+0+0 (secure 0 0 0) 0x7ff32c085780 con 0x7ff34009b080 2024-08-18T22:23:53.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.422+0000 7ff344a00640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3200678c0 0x7ff320069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:53.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.422+0000 7ff344a00640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3200678c0 0x7ff320069d80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff3300012f0 tx=0x7ff33000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:53.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.426+0000 7ff33cc00640 1 -- 172.21.15.5:0/2502844659 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff3400b5490 con 0x7ff34009b080 2024-08-18T22:23:53.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:53.626+0000 7ff347400640 1 -- 172.21.15.5:0/2502844659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff3400afa90 con 0x7ff34009b080 2024-08-18T22:23:54.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.250+0000 7ff33cc00640 1 -- 172.21.15.5:0/2502844659 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v52) ==== 174+0+0 (secure 0 0 0) 0x7ff32c021020 con 0x7ff34009b080 2024-08-18T22:23:54.254 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 11 and data pool 12 2024-08-18T22:23:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.262+0000 7ff347400640 1 -- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3200678c0 msgr2=0x7ff320069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.262+0000 7ff347400640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3200678c0 0x7ff320069d80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff3300012f0 tx=0x7ff33000b040 comp rx=0 tx=0).stop 2024-08-18T22:23:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.262+0000 7ff347400640 1 -- 172.21.15.5:0/2502844659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34009b080 msgr2=0x7ff3401574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.262+0000 7ff347400640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34009b080 0x7ff3401574f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00c4e0 tx=0x7ff32c00c9a0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.266+0000 7ff347400640 1 -- 172.21.15.5:0/2502844659 shutdown_connections 2024-08-18T22:23:54.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.266+0000 7ff347400640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3200678c0 0x7ff320069d80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.266+0000 7ff347400640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3400b1300 0x7ff340161710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.266+0000 7ff347400640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff34009b080 0x7ff3401574f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.266+0000 7ff347400640 1 --2- 172.21.15.5:0/2502844659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34009aca0 0x7ff3401f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.266+0000 7ff347400640 1 -- 172.21.15.5:0/2502844659 >> 172.21.15.5:0/2502844659 conn(0x7ff3400d2180 msgr2=0x7ff3400d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:54.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.266+0000 7ff347400640 1 -- 172.21.15.5:0/2502844659 shutdown_connections 2024-08-18T22:23:54.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.266+0000 7ff347400640 1 -- 172.21.15.5:0/2502844659 wait complete. 2024-08-18T22:23:54.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:23:54.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.450+0000 7f573ea00640 1 Processor -- start 2024-08-18T22:23:54.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.450+0000 7f573ea00640 1 -- start start 2024-08-18T22:23:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f573ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57380ce520 0x7f57381453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f573ea00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57380b1c50 0x7f57380b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f573ea00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57380b0bd0 con 0x7f573806b9b0 2024-08-18T22:23:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f573ea00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f57380b0e90 con 0x7f57380ce520 2024-08-18T22:23:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f573ea00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f57380b1170 con 0x7f57380b1c50 2024-08-18T22:23:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f5737e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f573806b9b0 0x7f573806bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45554/0 (socket says 172.21.15.5:45554) 2024-08-18T22:23:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f5737e00640 1 -- 172.21.15.5:0/3108531897 learned_addr learned my addr 172.21.15.5:0/3108531897 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:54.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f572f400640 1 --2- 172.21.15.5:0/3108531897 >> v2:172.21.15.5:3300/0 conn(0x7f57380ce520 0x7f57381453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f573ca00640 1 --2- 172.21.15.5:0/3108531897 >> v2:172.21.15.117:3300/0 conn(0x7f57380b1c50 0x7f57380b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f572f400640 1 -- 172.21.15.5:0/3108531897 >> v2:172.21.15.117:3300/0 conn(0x7f57380b1c50 msgr2=0x7f57380b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f5737400640 1 -- 172.21.15.5:0/3108531897 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2638442459 0 0) 0x7f57380b0bd0 con 0x7f573806b9b0 2024-08-18T22:23:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f572f400640 1 --2- 172.21.15.5:0/3108531897 >> v2:172.21.15.117:3300/0 conn(0x7f57380b1c50 0x7f57380b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f572f400640 1 -- 172.21.15.5:0/3108531897 >> v1:172.21.15.5:6789/0 conn(0x7f573806b9b0 legacy=0x7f573806bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f572f400640 1 -- 172.21.15.5:0/3108531897 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57380b1450 con 0x7f57380ce520 2024-08-18T22:23:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f573ca00640 1 --2- 172.21.15.5:0/3108531897 >> v2:172.21.15.117:3300/0 conn(0x7f57380b1c50 0x7f57380b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.454+0000 7f572f400640 1 --2- 172.21.15.5:0/3108531897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57380ce520 0x7f57381453d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5738072980 tx=0x7f572001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30148e086aa01c93 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f5737400640 1 -- 172.21.15.5:0/3108531897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57200a7070 con 0x7f57380ce520 2024-08-18T22:23:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f5737400640 1 -- 172.21.15.5:0/3108531897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57200b0070 con 0x7f57380ce520 2024-08-18T22:23:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f5737400640 1 -- 172.21.15.5:0/3108531897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57200ab890 con 0x7f57380ce520 2024-08-18T22:23:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 -- 172.21.15.5:0/3108531897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57380ce520 msgr2=0x7f57381453d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 --2- 172.21.15.5:0/3108531897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57380ce520 0x7f57381453d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5738072980 tx=0x7f572001c450 comp rx=0 tx=0).stop 2024-08-18T22:23:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 -- 172.21.15.5:0/3108531897 shutdown_connections 2024-08-18T22:23:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 --2- 172.21.15.5:0/3108531897 >> v2:172.21.15.117:3300/0 conn(0x7f57380b1c50 0x7f57380b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 --2- 172.21.15.5:0/3108531897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57380ce520 0x7f57381453d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 -- 172.21.15.5:0/3108531897 >> 172.21.15.5:0/3108531897 conn(0x7f573809aa40 msgr2=0x7f57380b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 -- 172.21.15.5:0/3108531897 shutdown_connections 2024-08-18T22:23:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 -- 172.21.15.5:0/3108531897 wait complete. 2024-08-18T22:23:54.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 Processor -- start 2024-08-18T22:23:54.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 -- start start 2024-08-18T22:23:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573806b9b0 0x7f573815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57380b1c50 0x7f57381f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57380ce520 0x7f57380b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f57380b2bb0 con 0x7f573806b9b0 2024-08-18T22:23:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f57380b2a30 con 0x7f57380b1c50 2024-08-18T22:23:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f57380ae040 con 0x7f57380ce520 2024-08-18T22:23:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f5737e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573806b9b0 0x7f573815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f5737e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573806b9b0 0x7f573815bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45130/0 (socket says 172.21.15.5:45130) 2024-08-18T22:23:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f5737e00640 1 -- 172.21.15.5:0/112938125 learned_addr learned my addr 172.21.15.5:0/112938125 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f572f400640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57380b1c50 0x7f57381f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.458+0000 7f573ca00640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57380ce520 0x7f57380b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5737e00640 1 -- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57380ce520 msgr2=0x7f57380b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5737e00640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57380ce520 0x7f57380b6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5737e00640 1 -- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57380b1c50 msgr2=0x7f57381f4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5737e00640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57380b1c50 0x7f57381f4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5737e00640 1 -- 172.21.15.5:0/112938125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57380b42b0 con 0x7f573806b9b0 2024-08-18T22:23:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f572f400640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57380b1c50 0x7f57381f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:54.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5737e00640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573806b9b0 0x7f573815bed0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f572800c480 tx=0x7f572800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5734c00640 1 -- 172.21.15.5:0/112938125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728018070 con 0x7f573806b9b0 2024-08-18T22:23:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5734c00640 1 -- 172.21.15.5:0/112938125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5728007500 con 0x7f573806b9b0 2024-08-18T22:23:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5734c00640 1 -- 172.21.15.5:0/112938125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728004a30 con 0x7f573806b9b0 2024-08-18T22:23:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f573ea00640 1 -- 172.21.15.5:0/112938125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57380b4590 con 0x7f573806b9b0 2024-08-18T22:23:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f573ea00640 1 -- 172.21.15.5:0/112938125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57380b4b50 con 0x7f573806b9b0 2024-08-18T22:23:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f573ea00640 1 -- 172.21.15.5:0/112938125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5738068ca0 con 0x7f573806b9b0 2024-08-18T22:23:54.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5734c00640 1 -- 172.21.15.5:0/112938125 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5728004bd0 con 0x7f573806b9b0 2024-08-18T22:23:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5734c00640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57140678c0 0x7f5714069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.462+0000 7f5734c00640 1 -- 172.21.15.5:0/112938125 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7f57280850a0 con 0x7f573806b9b0 2024-08-18T22:23:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.466+0000 7f572f400640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57140678c0 0x7f5714069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.466+0000 7f572f400640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57140678c0 0x7f5714069d80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f57200af000 tx=0x7f57200a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:54.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.466+0000 7f5734c00640 1 -- 172.21.15.5:0/112938125 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f57280553f0 con 0x7f573806b9b0 2024-08-18T22:23:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.638+0000 7f573ea00640 1 -- 172.21.15.5:0/112938125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f573815c410 con 0x7f573806b9b0 2024-08-18T22:23:54.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.638+0000 7f5734c00640 1 -- 172.21.15.5:0/112938125 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16886 (secure 0 0 0) 0x7f57280596f0 con 0x7f573806b9b0 2024-08-18T22:23:54.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:54.639 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:23:53.630408+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:23:51.370291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-08-18T22:23:52.711969+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:23:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.638+0000 7f573ea00640 1 -- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57140678c0 msgr2=0x7f5714069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.638+0000 7f573ea00640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57140678c0 0x7f5714069d80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f57200af000 tx=0x7f57200a7000 comp rx=0 tx=0).stop 2024-08-18T22:23:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.638+0000 7f573ea00640 1 -- 172.21.15.5:0/112938125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573806b9b0 msgr2=0x7f573815bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.638+0000 7f573ea00640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573806b9b0 0x7f573815bed0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f572800c480 tx=0x7f572800c940 comp rx=0 tx=0).stop 2024-08-18T22:23:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.642+0000 7f573ea00640 1 -- 172.21.15.5:0/112938125 shutdown_connections 2024-08-18T22:23:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.642+0000 7f573ea00640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57140678c0 0x7f5714069d80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.642+0000 7f573ea00640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57380ce520 0x7f57380b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.642+0000 7f573ea00640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57380b1c50 0x7f57381f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.642+0000 7f573ea00640 1 --2- 172.21.15.5:0/112938125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573806b9b0 0x7f573815bed0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.642+0000 7f573ea00640 1 -- 172.21.15.5:0/112938125 >> 172.21.15.5:0/112938125 conn(0x7f573809aa40 msgr2=0x7f5738142030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:54.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.642+0000 7f573ea00640 1 -- 172.21.15.5:0/112938125 shutdown_connections 2024-08-18T22:23:54.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.642+0000 7f573ea00640 1 -- 172.21.15.5:0/112938125 wait complete. 2024-08-18T22:23:54.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:23:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd004800640 1 Processor -- start 2024-08-18T22:23:54.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd004800640 1 -- start start 2024-08-18T22:23:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd004800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcffc15c180 0x7fcffc0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd004800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcffc071c90 0x7fcffc15c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd004800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcffc0b5e30 con 0x7fcffc06fad0 2024-08-18T22:23:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd004800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcffc15caa0 con 0x7fcffc15c180 2024-08-18T22:23:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd004800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcffc0b6110 con 0x7fcffc071c90 2024-08-18T22:23:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd001e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcffc15c180 0x7fcffc0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd001e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcffc15c180 0x7fcffc0b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45146/0 (socket says 172.21.15.5:45146) 2024-08-18T22:23:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd001e00640 1 -- 172.21.15.5:0/2842039690 learned_addr learned my addr 172.21.15.5:0/2842039690 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd002800640 1 --2- 172.21.15.5:0/2842039690 >> v2:172.21.15.117:3300/0 conn(0x7fcffc071c90 0x7fcffc15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd001e00640 1 -- 172.21.15.5:0/2842039690 >> v2:172.21.15.117:3300/0 conn(0x7fcffc071c90 msgr2=0x7fcffc15c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd001e00640 1 --2- 172.21.15.5:0/2842039690 >> v2:172.21.15.117:3300/0 conn(0x7fcffc071c90 0x7fcffc15c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd001e00640 1 -- 172.21.15.5:0/2842039690 >> v1:172.21.15.117:6789/0 conn(0x7fcffc06fad0 legacy=0x7fcffc071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.802+0000 7fd001e00640 1 -- 172.21.15.5:0/2842039690 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc0b63f0 con 0x7fcffc15c180 2024-08-18T22:23:54.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd001e00640 1 --2- 172.21.15.5:0/2842039690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc15c180 0x7fcffc0b57c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0b7650 tx=0x7fcff001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b5864334312936 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd000a00640 1 -- 172.21.15.5:0/2842039690 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff00b1070 con 0x7fcffc15c180 2024-08-18T22:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd000a00640 1 -- 172.21.15.5:0/2842039690 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff00ac5f0 con 0x7fcffc15c180 2024-08-18T22:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd000a00640 1 -- 172.21.15.5:0/2842039690 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff00ac9c0 con 0x7fcffc15c180 2024-08-18T22:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd004800640 1 -- 172.21.15.5:0/2842039690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc15c180 msgr2=0x7fcffc0b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd004800640 1 --2- 172.21.15.5:0/2842039690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc15c180 0x7fcffc0b57c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0b7650 tx=0x7fcff001c3d0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd004800640 1 -- 172.21.15.5:0/2842039690 shutdown_connections 2024-08-18T22:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd004800640 1 --2- 172.21.15.5:0/2842039690 >> v2:172.21.15.117:3300/0 conn(0x7fcffc071c90 0x7fcffc15c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd004800640 1 --2- 172.21.15.5:0/2842039690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc15c180 0x7fcffc0b57c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd004800640 1 -- 172.21.15.5:0/2842039690 >> 172.21.15.5:0/2842039690 conn(0x7fcffc0b3eb0 msgr2=0x7fcffc0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd004800640 1 -- 172.21.15.5:0/2842039690 shutdown_connections 2024-08-18T22:23:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.806+0000 7fd004800640 1 -- 172.21.15.5:0/2842039690 wait complete. 2024-08-18T22:23:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd004800640 1 Processor -- start 2024-08-18T22:23:54.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd004800640 1 -- start start 2024-08-18T22:23:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd004800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc06fad0 0x7fcffc165f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd004800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcffc071c90 0x7fcffc159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd004800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcffc15c180 0x7fcffc159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd004800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc0d1c30 con 0x7fcffc06fad0 2024-08-18T22:23:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd004800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc0d1ab0 con 0x7fcffc15c180 2024-08-18T22:23:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd004800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc0d1db0 con 0x7fcffc071c90 2024-08-18T22:23:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd001e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc06fad0 0x7fcffc165f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd001e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc06fad0 0x7fcffc165f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45158/0 (socket says 172.21.15.5:45158) 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd001e00640 1 -- 172.21.15.5:0/1414625016 learned_addr learned my addr 172.21.15.5:0/1414625016 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd001400640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcffc071c90 0x7fcffc159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd002800640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcffc15c180 0x7fcffc159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd001e00640 1 -- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcffc071c90 msgr2=0x7fcffc159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd001e00640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcffc071c90 0x7fcffc159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd001e00640 1 -- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcffc15c180 msgr2=0x7fcffc159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd001e00640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcffc15c180 0x7fcffc159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd001e00640 1 -- 172.21.15.5:0/1414625016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc15a510 con 0x7fcffc06fad0 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd001e00640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc06fad0 0x7fcffc165f40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcff001aa80 tx=0x7fcff0019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fcff6000640 1 -- 172.21.15.5:0/1414625016 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff00b9020 con 0x7fcffc06fad0 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fcff6000640 1 -- 172.21.15.5:0/1414625016 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff00b5410 con 0x7fcffc06fad0 2024-08-18T22:23:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fcff6000640 1 -- 172.21.15.5:0/1414625016 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff00b1040 con 0x7fcffc06fad0 2024-08-18T22:23:54.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd004800640 1 -- 172.21.15.5:0/1414625016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc15aaa0 con 0x7fcffc06fad0 2024-08-18T22:23:54.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.810+0000 7fd004800640 1 -- 172.21.15.5:0/1414625016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc15b060 con 0x7fcffc06fad0 2024-08-18T22:23:54.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.814+0000 7fd004800640 1 -- 172.21.15.5:0/1414625016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcffc15c560 con 0x7fcffc06fad0 2024-08-18T22:23:54.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.814+0000 7fcff6000640 1 -- 172.21.15.5:0/1414625016 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcff00bc020 con 0x7fcffc06fad0 2024-08-18T22:23:54.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.814+0000 7fcff6000640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe00678c0 0x7fcfe0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:54.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.814+0000 7fcff6000640 1 -- 172.21.15.5:0/1414625016 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7fcff011f660 con 0x7fcffc06fad0 2024-08-18T22:23:54.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.814+0000 7fd001400640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe00678c0 0x7fcfe0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.814+0000 7fd001400640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe00678c0 0x7fcfe0069d80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcffc156470 tx=0x7fcfec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:54.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.818+0000 7fcff6000640 1 -- 172.21.15.5:0/1414625016 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcff00c3030 con 0x7fcffc06fad0 2024-08-18T22:23:54.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.982+0000 7fd004800640 1 -- 172.21.15.5:0/1414625016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcffc0725e0 con 0x7fcffc06fad0 2024-08-18T22:23:54.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fcff6000640 1 -- 172.21.15.5:0/1414625016 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16886 (secure 0 0 0) 0x7fcff00a9070 con 0x7fcffc06fad0 2024-08-18T22:23:54.986 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:54.986 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:23:53.630408+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:23:51.370291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-08-18T22:23:52.711969+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:23:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 -- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe00678c0 msgr2=0x7fcfe0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe00678c0 0x7fcfe0069d80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcffc156470 tx=0x7fcfec009040 comp rx=0 tx=0).stop 2024-08-18T22:23:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 -- 172.21.15.5:0/1414625016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc06fad0 msgr2=0x7fcffc165f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc06fad0 0x7fcffc165f40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcff001aa80 tx=0x7fcff0019170 comp rx=0 tx=0).stop 2024-08-18T22:23:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 -- 172.21.15.5:0/1414625016 shutdown_connections 2024-08-18T22:23:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe00678c0 0x7fcfe0069d80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcffc15c180 0x7fcffc159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcffc071c90 0x7fcffc159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 --2- 172.21.15.5:0/1414625016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcffc06fad0 0x7fcffc165f40 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 -- 172.21.15.5:0/1414625016 >> 172.21.15.5:0/1414625016 conn(0x7fcffc0b3eb0 msgr2=0x7fcffc15ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 -- 172.21.15.5:0/1414625016 shutdown_connections 2024-08-18T22:23:54.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:54.986+0000 7fd004800640 1 -- 172.21.15.5:0/1414625016 wait complete. 2024-08-18T22:23:55.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:23:55.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf4dc00640 1 Processor -- start 2024-08-18T22:23:55.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf4dc00640 1 -- start start 2024-08-18T22:23:55.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf4dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf480b40c0 0x7faf480b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:55.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf4dc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf480ce280 0x7faf480ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:55.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf4dc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf480b31f0 con 0x7faf4815b0c0 2024-08-18T22:23:55.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf4dc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7faf480b3d70 con 0x7faf480ce280 2024-08-18T22:23:55.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf4dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf480b4a40 con 0x7faf480b40c0 2024-08-18T22:23:55.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf47400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf480ce280 0x7faf480ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:55.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf47400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf480ce280 0x7faf480ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45164/0 (socket says 172.21.15.5:45164) 2024-08-18T22:23:55.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf47400640 1 -- 172.21.15.5:0/934153674 learned_addr learned my addr 172.21.15.5:0/934153674 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:55.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf46a00640 1 --1- 172.21.15.5:0/934153674 >> v1:172.21.15.5:6789/0 conn(0x7faf4815b0c0 0x7faf4806db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45564/0 (socket says 172.21.15.5:45564) 2024-08-18T22:23:55.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf3e000640 1 --2- 172.21.15.5:0/934153674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf480b40c0 0x7faf480b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:55.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf47400640 1 -- 172.21.15.5:0/934153674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf480b40c0 msgr2=0x7faf480b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:55.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf47400640 1 --2- 172.21.15.5:0/934153674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf480b40c0 0x7faf480b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:55.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf47400640 1 -- 172.21.15.5:0/934153674 >> v1:172.21.15.5:6789/0 conn(0x7faf4815b0c0 legacy=0x7faf4806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:55.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.150+0000 7faf47400640 1 -- 172.21.15.5:0/934153674 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf480b34d0 con 0x7faf480ce280 2024-08-18T22:23:55.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf47400640 1 --2- 172.21.15.5:0/934153674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf480ce280 0x7faf480ce6d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7faf40009e50 tx=0x7faf4001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0d1f6252ddec2e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:55.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf46000640 1 -- 172.21.15.5:0/934153674 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf400a56c0 con 0x7faf480ce280 2024-08-18T22:23:55.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf46000640 1 -- 172.21.15.5:0/934153674 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf400a5860 con 0x7faf480ce280 2024-08-18T22:23:55.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf46000640 1 -- 172.21.15.5:0/934153674 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf400a5c30 con 0x7faf480ce280 2024-08-18T22:23:55.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf4dc00640 1 -- 172.21.15.5:0/934153674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf480ce280 msgr2=0x7faf480ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:55.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf4dc00640 1 --2- 172.21.15.5:0/934153674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf480ce280 0x7faf480ce6d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7faf40009e50 tx=0x7faf4001c910 comp rx=0 tx=0).stop 2024-08-18T22:23:55.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf4dc00640 1 -- 172.21.15.5:0/934153674 shutdown_connections 2024-08-18T22:23:55.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf4dc00640 1 --2- 172.21.15.5:0/934153674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf480ce280 0x7faf480ce6d0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:55.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf4dc00640 1 --2- 172.21.15.5:0/934153674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf480b40c0 0x7faf480b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:55.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf4dc00640 1 -- 172.21.15.5:0/934153674 >> 172.21.15.5:0/934153674 conn(0x7faf480b1dc0 msgr2=0x7faf480b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:55.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf4dc00640 1 -- 172.21.15.5:0/934153674 shutdown_connections 2024-08-18T22:23:55.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.154+0000 7faf4dc00640 1 -- 172.21.15.5:0/934153674 wait complete. 2024-08-18T22:23:55.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf4dc00640 1 Processor -- start 2024-08-18T22:23:55.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf4dc00640 1 -- start start 2024-08-18T22:23:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf4dc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf480b40c0 0x7faf48099a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf4dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf480ce280 0x7faf480ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:55.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf4dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4815b0c0 0x7faf4806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf4dc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faf4806f7f0 con 0x7faf4815b0c0 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf4dc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faf4806f670 con 0x7faf480b40c0 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf4dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf48165d00 con 0x7faf480ce280 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4815b0c0 0x7faf4806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4815b0c0 0x7faf4806e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45168/0 (socket says 172.21.15.5:45168) 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf47400640 1 -- 172.21.15.5:0/2671404216 learned_addr learned my addr 172.21.15.5:0/2671404216 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf46a00640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf480b40c0 0x7faf48099a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf3e000640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf480ce280 0x7faf480ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf47400640 1 -- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf480ce280 msgr2=0x7faf480ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf47400640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf480ce280 0x7faf480ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf47400640 1 -- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf480b40c0 msgr2=0x7faf48099a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:55.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf47400640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf480b40c0 0x7faf48099a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:55.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf47400640 1 -- 172.21.15.5:0/2671404216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf480ad1d0 con 0x7faf4815b0c0 2024-08-18T22:23:55.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf46a00640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf480b40c0 0x7faf48099a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:55.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf47400640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4815b0c0 0x7faf4806e3c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7faf4001a540 tx=0x7faf400196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:55.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf3f400640 1 -- 172.21.15.5:0/2671404216 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf400bc030 con 0x7faf4815b0c0 2024-08-18T22:23:55.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf3f400640 1 -- 172.21.15.5:0/2671404216 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf400b8470 con 0x7faf4815b0c0 2024-08-18T22:23:55.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf4dc00640 1 -- 172.21.15.5:0/2671404216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf480ad4b0 con 0x7faf4815b0c0 2024-08-18T22:23:55.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf3f400640 1 -- 172.21.15.5:0/2671404216 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf400b88a0 con 0x7faf4815b0c0 2024-08-18T22:23:55.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.158+0000 7faf4dc00640 1 -- 172.21.15.5:0/2671404216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf480ada70 con 0x7faf4815b0c0 2024-08-18T22:23:55.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.162+0000 7faf4dc00640 1 -- 172.21.15.5:0/2671404216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf480b4500 con 0x7faf4815b0c0 2024-08-18T22:23:55.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.162+0000 7faf3f400640 1 -- 172.21.15.5:0/2671404216 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf400bf070 con 0x7faf4815b0c0 2024-08-18T22:23:55.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.162+0000 7faf3f400640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf240678c0 0x7faf24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:55.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.162+0000 7faf3f400640 1 -- 172.21.15.5:0/2671404216 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6101+0+0 (secure 0 0 0) 0x7faf40120ff0 con 0x7faf4815b0c0 2024-08-18T22:23:55.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.162+0000 7faf46a00640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf240678c0 0x7faf24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:55.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.162+0000 7faf46a00640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf240678c0 0x7faf24069d80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faf481fa860 tx=0x7faf38007d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:55.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.166+0000 7faf3f400640 1 -- 172.21.15.5:0/2671404216 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7faf40016620 con 0x7faf4815b0c0 2024-08-18T22:23:55.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:55.370+0000 7faf4dc00640 1 -- 172.21.15.5:0/2671404216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7faf480af280 con 0x7faf4815b0c0 2024-08-18T22:23:56.220 INFO:tasks.ceph.mds.b.smithi117.stderr:2024-08-18T22:23:56.216+0000 7fb849a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:23:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.262+0000 7faf3f400640 1 -- 172.21.15.5:0/2671404216 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) ==== 118+0+0 (secure 0 0 0) 0x7faf400f1b20 con 0x7faf4815b0c0 2024-08-18T22:23:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.262+0000 7faf4dc00640 1 -- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf240678c0 msgr2=0x7faf24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.262+0000 7faf4dc00640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf240678c0 0x7faf24069d80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faf481fa860 tx=0x7faf38007d90 comp rx=0 tx=0).stop 2024-08-18T22:23:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.262+0000 7faf4dc00640 1 -- 172.21.15.5:0/2671404216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4815b0c0 msgr2=0x7faf4806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.262+0000 7faf4dc00640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4815b0c0 0x7faf4806e3c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7faf4001a540 tx=0x7faf400196b0 comp rx=0 tx=0).stop 2024-08-18T22:23:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.262+0000 7faf4dc00640 1 -- 172.21.15.5:0/2671404216 shutdown_connections 2024-08-18T22:23:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.262+0000 7faf4dc00640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf240678c0 0x7faf24069d80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.262+0000 7faf4dc00640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf4815b0c0 0x7faf4806e3c0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.262+0000 7faf4dc00640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf480ce280 0x7faf480ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.266+0000 7faf4dc00640 1 --2- 172.21.15.5:0/2671404216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf480b40c0 0x7faf48099a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.266+0000 7faf4dc00640 1 -- 172.21.15.5:0/2671404216 >> 172.21.15.5:0/2671404216 conn(0x7faf480b1dc0 msgr2=0x7faf4806db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.266+0000 7faf4dc00640 1 -- 172.21.15.5:0/2671404216 shutdown_connections 2024-08-18T22:23:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.266+0000 7faf4dc00640 1 -- 172.21.15.5:0/2671404216 wait complete. 2024-08-18T22:23:56.288 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:23:56.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:23:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.442+0000 7fa139800640 1 Processor -- start 2024-08-18T22:23:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa139800640 1 -- start start 2024-08-18T22:23:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa139800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa13415e060 0x7fa134071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa139800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340b55f0 0x7fa1340b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa139800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13406eae0 con 0x7fa1340b3fe0 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa139800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa1340b4990 con 0x7fa13415e060 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa139800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa134071440 con 0x7fa1340b55f0 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa133e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa13415e060 0x7fa134071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa133e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa13415e060 0x7fa134071ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45182/0 (socket says 172.21.15.5:45182) 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa133e00640 1 -- 172.21.15.5:0/3453336309 learned_addr learned my addr 172.21.15.5:0/3453336309 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa12b400640 1 --1- 172.21.15.5:0/3453336309 >> v1:172.21.15.5:6789/0 conn(0x7fa1340b3fe0 0x7fa1340b4ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45570/0 (socket says 172.21.15.5:45570) 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa138e00640 1 --2- 172.21.15.5:0/3453336309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340b55f0 0x7fa1340b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa133e00640 1 -- 172.21.15.5:0/3453336309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340b55f0 msgr2=0x7fa1340b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa133e00640 1 --2- 172.21.15.5:0/3453336309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340b55f0 0x7fa1340b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa133e00640 1 -- 172.21.15.5:0/3453336309 >> v1:172.21.15.5:6789/0 conn(0x7fa1340b3fe0 legacy=0x7fa1340b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa133e00640 1 -- 172.21.15.5:0/3453336309 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13406e800 con 0x7fa13415e060 2024-08-18T22:23:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.446+0000 7fa133400640 1 -- 172.21.15.5:0/3453336309 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996198741 0 0) 0x7fa13406eae0 con 0x7fa1340b3fe0 2024-08-18T22:23:56.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa133e00640 1 --2- 172.21.15.5:0/3453336309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa13415e060 0x7fa134071ee0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa124009870 tx=0x7fa12401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2040d2da7ea32565 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:56.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa133400640 1 -- 172.21.15.5:0/3453336309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1240aa650 con 0x7fa13415e060 2024-08-18T22:23:56.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa133400640 1 -- 172.21.15.5:0/3453336309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1240af070 con 0x7fa13415e060 2024-08-18T22:23:56.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa133400640 1 -- 172.21.15.5:0/3453336309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1240aaa10 con 0x7fa13415e060 2024-08-18T22:23:56.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa139800640 1 -- 172.21.15.5:0/3453336309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa13415e060 msgr2=0x7fa134071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:56.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa139800640 1 --2- 172.21.15.5:0/3453336309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa13415e060 0x7fa134071ee0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa124009870 tx=0x7fa12401c4d0 comp rx=0 tx=0).stop 2024-08-18T22:23:56.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa139800640 1 -- 172.21.15.5:0/3453336309 shutdown_connections 2024-08-18T22:23:56.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa139800640 1 --2- 172.21.15.5:0/3453336309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340b55f0 0x7fa1340b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:56.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa139800640 1 --2- 172.21.15.5:0/3453336309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa13415e060 0x7fa134071ee0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:56.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa139800640 1 -- 172.21.15.5:0/3453336309 >> 172.21.15.5:0/3453336309 conn(0x7fa134067a70 msgr2=0x7fa134067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:56.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa139800640 1 -- 172.21.15.5:0/3453336309 shutdown_connections 2024-08-18T22:23:56.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa139800640 1 -- 172.21.15.5:0/3453336309 wait complete. 2024-08-18T22:23:56.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa139800640 1 Processor -- start 2024-08-18T22:23:56.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.450+0000 7fa139800640 1 -- start start 2024-08-18T22:23:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa139800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1340b3fe0 0x7fa13413aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa139800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340b55f0 0x7fa13414f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa139800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa13415e060 0x7fa134161180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa139800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa13406e270 con 0x7fa13415e060 2024-08-18T22:23:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa139800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa134072420 con 0x7fa1340b3fe0 2024-08-18T22:23:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa139800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa13406e3f0 con 0x7fa1340b55f0 2024-08-18T22:23:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa138e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa13415e060 0x7fa134161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa138e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa13415e060 0x7fa134161180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45190/0 (socket says 172.21.15.5:45190) 2024-08-18T22:23:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa138e00640 1 -- 172.21.15.5:0/150320035 learned_addr learned my addr 172.21.15.5:0/150320035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa12b400640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340b55f0 0x7fa13414f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa133e00640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1340b3fe0 0x7fa13413aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa138e00640 1 -- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340b55f0 msgr2=0x7fa13414f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa138e00640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340b55f0 0x7fa13414f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa138e00640 1 -- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1340b3fe0 msgr2=0x7fa13413aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa138e00640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1340b3fe0 0x7fa13413aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa138e00640 1 -- 172.21.15.5:0/150320035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13414f8d0 con 0x7fa13415e060 2024-08-18T22:23:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa138e00640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa13415e060 0x7fa134161180 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa12c007e60 tx=0x7fa12c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa130c00640 1 -- 172.21.15.5:0/150320035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c014420 con 0x7fa13415e060 2024-08-18T22:23:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa130c00640 1 -- 172.21.15.5:0/150320035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12c019070 con 0x7fa13415e060 2024-08-18T22:23:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa130c00640 1 -- 172.21.15.5:0/150320035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c014820 con 0x7fa13415e060 2024-08-18T22:23:56.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa139800640 1 -- 172.21.15.5:0/150320035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa134151cd0 con 0x7fa13415e060 2024-08-18T22:23:56.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa139800640 1 -- 172.21.15.5:0/150320035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa134152290 con 0x7fa13415e060 2024-08-18T22:23:56.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa139800640 1 -- 172.21.15.5:0/150320035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1341616c0 con 0x7fa13415e060 2024-08-18T22:23:56.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.454+0000 7fa130c00640 1 -- 172.21.15.5:0/150320035 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa12c0149c0 con 0x7fa13415e060 2024-08-18T22:23:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.458+0000 7fa130c00640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa1100678c0 0x7fa110069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.458+0000 7fa130c00640 1 -- 172.21.15.5:0/150320035 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7fa12c0866c0 con 0x7fa13415e060 2024-08-18T22:23:56.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.458+0000 7fa133e00640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa1100678c0 0x7fa110069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:56.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.458+0000 7fa133e00640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa1100678c0 0x7fa110069d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa1240ae000 tx=0x7fa1240a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.462+0000 7fa130c00640 1 -- 172.21.15.5:0/150320035 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa12c057060 con 0x7fa13415e060 2024-08-18T22:23:56.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:56.662+0000 7fa139800640 1 -- 172.21.15.5:0/150320035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa1340b3840 con 0x7fa13415e060 2024-08-18T22:23:57.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.262+0000 7fa130c00640 1 -- 172.21.15.5:0/150320035 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7fa12c056960 con 0x7fa13415e060 2024-08-18T22:23:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 -- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa1100678c0 msgr2=0x7fa110069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa1100678c0 0x7fa110069d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa1240ae000 tx=0x7fa1240a7000 comp rx=0 tx=0).stop 2024-08-18T22:23:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 -- 172.21.15.5:0/150320035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa13415e060 msgr2=0x7fa134161180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa13415e060 0x7fa134161180 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa12c007e60 tx=0x7fa12c00e4b0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 -- 172.21.15.5:0/150320035 shutdown_connections 2024-08-18T22:23:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa1100678c0 0x7fa110069d80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa13415e060 0x7fa134161180 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340b55f0 0x7fa13414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 --2- 172.21.15.5:0/150320035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1340b3fe0 0x7fa13413aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 -- 172.21.15.5:0/150320035 >> 172.21.15.5:0/150320035 conn(0x7fa134067a70 msgr2=0x7fa1340d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:57.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 -- 172.21.15.5:0/150320035 shutdown_connections 2024-08-18T22:23:57.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.266+0000 7fa139800640 1 -- 172.21.15.5:0/150320035 wait complete. 2024-08-18T22:23:57.287 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:23:57.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:23:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b8200640 1 Processor -- start 2024-08-18T22:23:57.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b8200640 1 -- start start 2024-08-18T22:23:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b8200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5b00b54c0 0x7fd5b0071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b8200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b006dd80 0x7fd5b00b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b8200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd5b006fad0 0x7fd5b006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b8200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b00cba40 con 0x7fd5b00b54c0 2024-08-18T22:23:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b8200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b00b5de0 con 0x7fd5b006fad0 2024-08-18T22:23:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b8200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b0071c80 con 0x7fd5b006dd80 2024-08-18T22:23:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b5800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5b00b54c0 0x7fd5b0071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b5800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5b00b54c0 0x7fd5b0071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45202/0 (socket says 172.21.15.5:45202) 2024-08-18T22:23:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b5800640 1 -- 172.21.15.5:0/664039062 learned_addr learned my addr 172.21.15.5:0/664039062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b5800640 1 -- 172.21.15.5:0/664039062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b006dd80 msgr2=0x7fd5b00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:57.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b4e00640 1 --2- 172.21.15.5:0/664039062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b006dd80 0x7fd5b00b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b6200640 1 --2- 172.21.15.5:0/664039062 >> v2:172.21.15.117:3300/0 conn(0x7fd5b006fad0 0x7fd5b006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b5800640 1 --2- 172.21.15.5:0/664039062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b006dd80 0x7fd5b00b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b5800640 1 -- 172.21.15.5:0/664039062 >> v2:172.21.15.117:3300/0 conn(0x7fd5b006fad0 msgr2=0x7fd5b006ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b5800640 1 --2- 172.21.15.5:0/664039062 >> v2:172.21.15.117:3300/0 conn(0x7fd5b006fad0 0x7fd5b006ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b5800640 1 -- 172.21.15.5:0/664039062 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b0071f60 con 0x7fd5b00b54c0 2024-08-18T22:23:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b6200640 1 --2- 172.21.15.5:0/664039062 >> v2:172.21.15.117:3300/0 conn(0x7fd5b006fad0 0x7fd5b006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:57.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.430+0000 7fd5b4e00640 1 --2- 172.21.15.5:0/664039062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b006dd80 0x7fd5b00b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5b5800640 1 --2- 172.21.15.5:0/664039062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5b00b54c0 0x7fd5b0071580 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0071180 tx=0x7fd5a401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d3d5a34990d30b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5afe00640 1 -- 172.21.15.5:0/664039062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40b5070 con 0x7fd5b00b54c0 2024-08-18T22:23:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5afe00640 1 -- 172.21.15.5:0/664039062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a40a89d0 con 0x7fd5b00b54c0 2024-08-18T22:23:57.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5afe00640 1 -- 172.21.15.5:0/664039062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40a8da0 con 0x7fd5b00b54c0 2024-08-18T22:23:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5b8200640 1 -- 172.21.15.5:0/664039062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5b00b54c0 msgr2=0x7fd5b0071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5b8200640 1 --2- 172.21.15.5:0/664039062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5b00b54c0 0x7fd5b0071580 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0071180 tx=0x7fd5a401ed10 comp rx=0 tx=0).stop 2024-08-18T22:23:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5b8200640 1 -- 172.21.15.5:0/664039062 shutdown_connections 2024-08-18T22:23:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5b8200640 1 --2- 172.21.15.5:0/664039062 >> v2:172.21.15.117:3300/0 conn(0x7fd5b006fad0 0x7fd5b006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5b8200640 1 --2- 172.21.15.5:0/664039062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b006dd80 0x7fd5b00b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5b8200640 1 --2- 172.21.15.5:0/664039062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5b00b54c0 0x7fd5b0071580 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5b8200640 1 -- 172.21.15.5:0/664039062 >> 172.21.15.5:0/664039062 conn(0x7fd5b00b3eb0 msgr2=0x7fd5b00b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5b8200640 1 -- 172.21.15.5:0/664039062 shutdown_connections 2024-08-18T22:23:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.434+0000 7fd5b8200640 1 -- 172.21.15.5:0/664039062 wait complete. 2024-08-18T22:23:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b8200640 1 Processor -- start 2024-08-18T22:23:57.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b8200640 1 -- start start 2024-08-18T22:23:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b8200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5b006dd80 0x7fd5b01f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b8200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b006fad0 0x7fd5b015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b8200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5b00b54c0 0x7fd5b00ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b8200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0148020 con 0x7fd5b006dd80 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b8200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b006e1a0 con 0x7fd5b00b54c0 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b8200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b01481a0 con 0x7fd5b006fad0 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5b006dd80 0x7fd5b01f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5b006dd80 0x7fd5b01f4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45210/0 (socket says 172.21.15.5:45210) 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b5800640 1 -- 172.21.15.5:0/270114104 learned_addr learned my addr 172.21.15.5:0/270114104 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b6200640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5b00b54c0 0x7fd5b00ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b4e00640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b006fad0 0x7fd5b015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b5800640 1 -- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b006fad0 msgr2=0x7fd5b015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b5800640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b006fad0 0x7fd5b015dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b5800640 1 -- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5b00b54c0 msgr2=0x7fd5b00ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b5800640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5b00b54c0 0x7fd5b00ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b5800640 1 -- 172.21.15.5:0/270114104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b00ccac0 con 0x7fd5b006dd80 2024-08-18T22:23:57.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b5800640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5b006dd80 0x7fd5b01f4960 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40097c0 tx=0x7fd5a401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5ad600640 1 -- 172.21.15.5:0/270114104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40b5040 con 0x7fd5b006dd80 2024-08-18T22:23:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5ad600640 1 -- 172.21.15.5:0/270114104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a40be070 con 0x7fd5b006dd80 2024-08-18T22:23:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5ad600640 1 -- 172.21.15.5:0/270114104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40b0bb0 con 0x7fd5b006dd80 2024-08-18T22:23:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b8200640 1 -- 172.21.15.5:0/270114104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b00ccda0 con 0x7fd5b006dd80 2024-08-18T22:23:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.438+0000 7fd5b8200640 1 -- 172.21.15.5:0/270114104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b00cd360 con 0x7fd5b006dd80 2024-08-18T22:23:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.442+0000 7fd5b8200640 1 -- 172.21.15.5:0/270114104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b00b58a0 con 0x7fd5b006dd80 2024-08-18T22:23:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.442+0000 7fd5ad600640 1 -- 172.21.15.5:0/270114104 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5a40c3460 con 0x7fd5b006dd80 2024-08-18T22:23:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.442+0000 7fd5ad600640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5900678c0 0x7fd590069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.442+0000 7fd5ad600640 1 -- 172.21.15.5:0/270114104 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7fd5a4123480 con 0x7fd5b006dd80 2024-08-18T22:23:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.442+0000 7fd5b4e00640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5900678c0 0x7fd590069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.442+0000 7fd5b4e00640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5900678c0 0x7fd590069d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd59c006fd0 tx=0x7fd59c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:57.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.446+0000 7fd5ad600640 1 -- 172.21.15.5:0/270114104 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd5a4018870 con 0x7fd5b006dd80 2024-08-18T22:23:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.646+0000 7fd5b8200640 1 -- 172.21.15.5:0/270114104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5b0146a70 con 0x7fd5b006dd80 2024-08-18T22:23:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.646+0000 7fd5ad600640 1 -- 172.21.15.5:0/270114104 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5222 (secure 0 0 0) 0x7fd5a40a89a0 con 0x7fd5b006dd80 2024-08-18T22:23:57.647 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:57.647 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"btime":"2024-08-18T22:23:57:263294+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6409,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4073781288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4073781288},{"type":"v1","addr":"172.21.15.5:6835","nonce":4073781288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6415,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2559910862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2559910862},{"type":"v1","addr":"172.21.15.117:6837","nonce":2559910862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6792,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3108112673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3108112673},{"type":"v1","addr":"172.21.15.5:6834","nonce":3108112673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:53.630789+0000","modified":"2024-08-18T22:23:56.664654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6798},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6798":{"gid":6798,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6836/116443176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":116443176},{"type":"v1","addr":"172.21.15.117:6836","nonce":116443176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6798,"qdb_cluster":[6798]},"id":5}]} 2024-08-18T22:23:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 56 2024-08-18T22:23:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.646+0000 7fd5b8200640 1 -- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5900678c0 msgr2=0x7fd590069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.646+0000 7fd5b8200640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5900678c0 0x7fd590069d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd59c006fd0 tx=0x7fd59c008040 comp rx=0 tx=0).stop 2024-08-18T22:23:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.646+0000 7fd5b8200640 1 -- 172.21.15.5:0/270114104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5b006dd80 msgr2=0x7fd5b01f4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.646+0000 7fd5b8200640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5b006dd80 0x7fd5b01f4960 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40097c0 tx=0x7fd5a401bab0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.650+0000 7fd5b8200640 1 -- 172.21.15.5:0/270114104 shutdown_connections 2024-08-18T22:23:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.650+0000 7fd5b8200640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd5900678c0 0x7fd590069d80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.650+0000 7fd5b8200640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5b00b54c0 0x7fd5b00ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.650+0000 7fd5b8200640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b006fad0 0x7fd5b015dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.650+0000 7fd5b8200640 1 --2- 172.21.15.5:0/270114104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5b006dd80 0x7fd5b01f4960 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.650+0000 7fd5b8200640 1 -- 172.21.15.5:0/270114104 >> 172.21.15.5:0/270114104 conn(0x7fd5b00b3eb0 msgr2=0x7fd5b00b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:57.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.650+0000 7fd5b8200640 1 -- 172.21.15.5:0/270114104 shutdown_connections 2024-08-18T22:23:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.650+0000 7fd5b8200640 1 -- 172.21.15.5:0/270114104 wait complete. 2024-08-18T22:23:57.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:23:57.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff15b600640 1 Processor -- start 2024-08-18T22:23:57.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff15b600640 1 -- start start 2024-08-18T22:23:57.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff15b600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15415b010 0x7ff1540ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff15b600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff15406f290 0x7ff154072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff15b600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1540cee20 con 0x7ff1540cd3a0 2024-08-18T22:23:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff15b600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff1540cfa30 con 0x7ff15406f290 2024-08-18T22:23:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff15b600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff1540cf100 con 0x7ff15415b010 2024-08-18T22:23:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff159600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff15406f290 0x7ff154072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff153e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff1540cd3a0 0x7ff15406eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45578/0 (socket says 172.21.15.5:45578) 2024-08-18T22:23:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff153e00640 1 -- 172.21.15.5:0/2573334330 learned_addr learned my addr 172.21.15.5:0/2573334330 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff158c00640 1 --2- 172.21.15.5:0/2573334330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15415b010 0x7ff1540ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff159600640 1 -- 172.21.15.5:0/2573334330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15415b010 msgr2=0x7ff1540ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff159600640 1 --2- 172.21.15.5:0/2573334330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15415b010 0x7ff1540ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff159600640 1 -- 172.21.15.5:0/2573334330 >> v1:172.21.15.5:6789/0 conn(0x7ff1540cd3a0 legacy=0x7ff15406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff159600640 1 -- 172.21.15.5:0/2573334330 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1540cf3e0 con 0x7ff15406f290 2024-08-18T22:23:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.810+0000 7ff153400640 1 -- 172.21.15.5:0/2573334330 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188323338 0 0) 0x7ff1540cee20 con 0x7ff1540cd3a0 2024-08-18T22:23:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff159600640 1 --2- 172.21.15.5:0/2573334330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff15406f290 0x7ff154072620 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009d90 tx=0x7ff14c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620fb2b6e0feb915 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff153400640 1 -- 172.21.15.5:0/2573334330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0b2070 con 0x7ff15406f290 2024-08-18T22:23:57.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff153400640 1 -- 172.21.15.5:0/2573334330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff14c0a5a20 con 0x7ff15406f290 2024-08-18T22:23:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff153400640 1 -- 172.21.15.5:0/2573334330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0a5df0 con 0x7ff15406f290 2024-08-18T22:23:57.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff15b600640 1 -- 172.21.15.5:0/2573334330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff15406f290 msgr2=0x7ff154072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff15b600640 1 --2- 172.21.15.5:0/2573334330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff15406f290 0x7ff154072620 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009d90 tx=0x7ff14c01c940 comp rx=0 tx=0).stop 2024-08-18T22:23:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff15b600640 1 -- 172.21.15.5:0/2573334330 shutdown_connections 2024-08-18T22:23:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff15b600640 1 --2- 172.21.15.5:0/2573334330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff15406f290 0x7ff154072620 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff15b600640 1 --2- 172.21.15.5:0/2573334330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15415b010 0x7ff1540ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff15b600640 1 -- 172.21.15.5:0/2573334330 >> 172.21.15.5:0/2573334330 conn(0x7ff1540b1c50 msgr2=0x7ff1540b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff15b600640 1 -- 172.21.15.5:0/2573334330 shutdown_connections 2024-08-18T22:23:57.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff15b600640 1 -- 172.21.15.5:0/2573334330 wait complete. 2024-08-18T22:23:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.814+0000 7ff15b600640 1 Processor -- start 2024-08-18T22:23:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff15b600640 1 -- start start 2024-08-18T22:23:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff15b600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15406f290 0x7ff1540cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff15b600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1540cd3a0 0x7ff1540b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff15b600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff15415b010 0x7ff15414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff15b600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1540734f0 con 0x7ff15415b010 2024-08-18T22:23:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff15b600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff154073370 con 0x7ff1540cd3a0 2024-08-18T22:23:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff15b600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff154073670 con 0x7ff15406f290 2024-08-18T22:23:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff159600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff15415b010 0x7ff15414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff159600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff15415b010 0x7ff15414d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45214/0 (socket says 172.21.15.5:45214) 2024-08-18T22:23:57.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff159600640 1 -- 172.21.15.5:0/3163789072 learned_addr learned my addr 172.21.15.5:0/3163789072 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff158c00640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15406f290 0x7ff1540cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff153e00640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1540cd3a0 0x7ff1540b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff159600640 1 -- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15406f290 msgr2=0x7ff1540cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff159600640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15406f290 0x7ff1540cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff159600640 1 -- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1540cd3a0 msgr2=0x7ff1540b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff159600640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1540cd3a0 0x7ff1540b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff159600640 1 -- 172.21.15.5:0/3163789072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15415b6a0 con 0x7ff15415b010 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff153e00640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1540cd3a0 0x7ff1540b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff159600640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff15415b010 0x7ff15414d380 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0b0040 tx=0x7ff14c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff150c00640 1 -- 172.21.15.5:0/3163789072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0b2050 con 0x7ff15415b010 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff150c00640 1 -- 172.21.15.5:0/3163789072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff14c0be070 con 0x7ff15415b010 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff150c00640 1 -- 172.21.15.5:0/3163789072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0ada90 con 0x7ff15415b010 2024-08-18T22:23:57.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff15b600640 1 -- 172.21.15.5:0/3163789072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15415d390 con 0x7ff15415b010 2024-08-18T22:23:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff15b600640 1 -- 172.21.15.5:0/3163789072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff15415bc20 con 0x7ff15415b010 2024-08-18T22:23:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.818+0000 7ff15b600640 1 -- 172.21.15.5:0/3163789072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff154072620 con 0x7ff15415b010 2024-08-18T22:23:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.822+0000 7ff150c00640 1 -- 172.21.15.5:0/3163789072 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff14c0adc30 con 0x7ff15415b010 2024-08-18T22:23:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.822+0000 7ff150c00640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1340678f0 0x7ff134069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:57.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.822+0000 7ff150c00640 1 -- 172.21.15.5:0/3163789072 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7ff14c120ff0 con 0x7ff15415b010 2024-08-18T22:23:57.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.822+0000 7ff158c00640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1340678f0 0x7ff134069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:57.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.822+0000 7ff158c00640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1340678f0 0x7ff134069db0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff148009ac0 tx=0x7ff148009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:57.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.826+0000 7ff150c00640 1 -- 172.21.15.5:0/3163789072 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff14c016560 con 0x7ff15415b010 2024-08-18T22:23:57.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.994+0000 7ff15b600640 1 -- 172.21.15.5:0/3163789072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1541588e0 con 0x7ff15415b010 2024-08-18T22:23:57.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.994+0000 7ff150c00640 1 -- 172.21.15.5:0/3163789072 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16873 (secure 0 0 0) 0x7ff14c0f1960 con 0x7ff15415b010 2024-08-18T22:23:57.995 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:57.995 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:23:55.249146+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:23:51.370291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-08-18T22:23:52.711969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:23:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 -- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1340678f0 msgr2=0x7ff134069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1340678f0 0x7ff134069db0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff148009ac0 tx=0x7ff148009190 comp rx=0 tx=0).stop 2024-08-18T22:23:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 -- 172.21.15.5:0/3163789072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff15415b010 msgr2=0x7ff15414d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff15415b010 0x7ff15414d380 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0b0040 tx=0x7ff14c0196e0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 -- 172.21.15.5:0/3163789072 shutdown_connections 2024-08-18T22:23:57.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1340678f0 0x7ff134069db0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff15415b010 0x7ff15414d380 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1540cd3a0 0x7ff1540b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 --2- 172.21.15.5:0/3163789072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15406f290 0x7ff1540cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:57.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 -- 172.21.15.5:0/3163789072 >> 172.21.15.5:0/3163789072 conn(0x7ff1540b1c50 msgr2=0x7ff154159440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:57.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 -- 172.21.15.5:0/3163789072 shutdown_connections 2024-08-18T22:23:57.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:57.998+0000 7ff15b600640 1 -- 172.21.15.5:0/3163789072 wait complete. 2024-08-18T22:23:58.017 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:23:58.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:23:58.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7b4e00640 1 Processor -- start 2024-08-18T22:23:58.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7b4e00640 1 -- start start 2024-08-18T22:23:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7b4e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b0071580 0x7fa7b006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7b4e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b0071c80 con 0x7fa7b00b54c0 2024-08-18T22:23:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7b4e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b0071f60 con 0x7fa7b00cbed0 2024-08-18T22:23:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7b4e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b00cba40 con 0x7fa7b0071580 2024-08-18T22:23:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ade00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa7b00b54c0 0x7fa7b00b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45592/0 (socket says 172.21.15.5:45592) 2024-08-18T22:23:58.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ade00640 1 -- 172.21.15.5:0/3941010565 learned_addr learned my addr 172.21.15.5:0/3941010565 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7a7e00640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b0071580 0x7fa7b006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3160116159 0 0) 0x7fa7b0071c80 con 0x7fa7b00b54c0 2024-08-18T22:23:58.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa794003530 con 0x7fa7b00b54c0 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4099695268 0 0) 0x7fa794003530 con 0x7fa7b00b54c0 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b0071580 msgr2=0x7fa7b006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b0071580 0x7fa7b006dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 >> v1:172.21.15.117:6789/0 conn(0x7fa7b00cbed0 legacy=0x7fa7b00cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b00cb6d0 con 0x7fa7b00b54c0 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fa7a0001680 con 0x7fa7b00b54c0 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 >> v1:172.21.15.5:6789/0 conn(0x7fa7b00b54c0 legacy=0x7fa7b00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7940039f0 0x7fa794003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa794004810 0x7fa794004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b0071580 0x7fa7940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b00cba40 con 0x7fa7940039f0 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa79400bb40 con 0x7fa794004810 2024-08-18T22:23:58.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa79400bd40 con 0x7fa7b0071580 2024-08-18T22:23:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ade00640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7940039f0 0x7fa794003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7a7e00640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa794004810 0x7fa794004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ae800640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b0071580 0x7fa7940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ade00640 1 -- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b0071580 msgr2=0x7fa7940051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ade00640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b0071580 0x7fa7940051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ade00640 1 -- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa794004810 msgr2=0x7fa794004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ade00640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa794004810 0x7fa794004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7ade00640 1 -- 172.21.15.5:0/3941010565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa794003530 con 0x7fa7940039f0 2024-08-18T22:23:58.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.158+0000 7fa7a7e00640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa794004810 0x7fa794004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:58.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.162+0000 7fa7ade00640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7940039f0 0x7fa794003e10 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000c160 tx=0x7fa7a001f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94dc02ad1cf9b13e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:58.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.162+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0007c70 con 0x7fa7940039f0 2024-08-18T22:23:58.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.162+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a0005ae0 con 0x7fa7940039f0 2024-08-18T22:23:58.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.162+0000 7fa7ad400640 1 -- 172.21.15.5:0/3941010565 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0007070 con 0x7fa7940039f0 2024-08-18T22:23:58.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.162+0000 7fa7b4e00640 1 -- 172.21.15.5:0/3941010565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7940039f0 msgr2=0x7fa794003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.162+0000 7fa7b4e00640 1 --2- 172.21.15.5:0/3941010565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7940039f0 0x7fa794003e10 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000c160 tx=0x7fa7a001f2f0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.162+0000 7fa7ae800640 1 -- 172.21.15.5:0/3941010565 reap_dead start 2024-08-18T22:23:58.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.162+0000 7fa7b4e00640 1 -- 172.21.15.5:0/3941010565 shutdown_connections 2024-08-18T22:23:58.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.162+0000 7fa7b4e00640 1 -- 172.21.15.5:0/3941010565 >> 172.21.15.5:0/3941010565 conn(0x7fa7b00b3eb0 msgr2=0x7fa7b00b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:58.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.162+0000 7fa7b4e00640 1 -- 172.21.15.5:0/3941010565 shutdown_connections 2024-08-18T22:23:58.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.162+0000 7fa7b4e00640 1 -- 172.21.15.5:0/3941010565 wait complete. 2024-08-18T22:23:58.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7b4e00640 1 Processor -- start 2024-08-18T22:23:58.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7b4e00640 1 -- start start 2024-08-18T22:23:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7b4e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7940039f0 0x7fa7b01f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7b4e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b01f4ee0 0x7fa7b00d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7b4e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b00d18e0 0x7fa7b00cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7b4e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b01481a0 con 0x7fa7b00d18e0 2024-08-18T22:23:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7b4e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b0148020 con 0x7fa7940039f0 2024-08-18T22:23:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7b4e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b006dd80 con 0x7fa7b01f4ee0 2024-08-18T22:23:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7ae800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b00d18e0 0x7fa7b00cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7ae800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b00d18e0 0x7fa7b00cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45228/0 (socket says 172.21.15.5:45228) 2024-08-18T22:23:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7ae800640 1 -- 172.21.15.5:0/1398376465 learned_addr learned my addr 172.21.15.5:0/1398376465 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7ade00640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7940039f0 0x7fa7b01f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7a7e00640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b01f4ee0 0x7fa7b00d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7ae800640 1 -- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b01f4ee0 msgr2=0x7fa7b00d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7ae800640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b01f4ee0 0x7fa7b00d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7ae800640 1 -- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7940039f0 msgr2=0x7fa7b01f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7ae800640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7940039f0 0x7fa7b01f6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7ae800640 1 -- 172.21.15.5:0/1398376465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b01f7180 con 0x7fa7b00d18e0 2024-08-18T22:23:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7ae800640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b00d18e0 0x7fa7b00cd1c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800e700 tx=0x7fa7a800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7a6000640 1 -- 172.21.15.5:0/1398376465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8003980 con 0x7fa7b00d18e0 2024-08-18T22:23:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7a6000640 1 -- 172.21.15.5:0/1398376465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a8018070 con 0x7fa7b00d18e0 2024-08-18T22:23:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7b4e00640 1 -- 172.21.15.5:0/1398376465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b00ced90 con 0x7fa7b00d18e0 2024-08-18T22:23:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7a6000640 1 -- 172.21.15.5:0/1398376465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8003d60 con 0x7fa7b00d18e0 2024-08-18T22:23:58.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.166+0000 7fa7b4e00640 1 -- 172.21.15.5:0/1398376465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b00cf310 con 0x7fa7b00d18e0 2024-08-18T22:23:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.170+0000 7fa7b4e00640 1 -- 172.21.15.5:0/1398376465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b0071c80 con 0x7fa7b00d18e0 2024-08-18T22:23:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.170+0000 7fa7a6000640 1 -- 172.21.15.5:0/1398376465 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7a80050d0 con 0x7fa7b00d18e0 2024-08-18T22:23:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.170+0000 7fa7a6000640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa78c0678f0 0x7fa78c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.170+0000 7fa7a6000640 1 -- 172.21.15.5:0/1398376465 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7fa7a8085990 con 0x7fa7b00d18e0 2024-08-18T22:23:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.170+0000 7fa7ade00640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa78c0678f0 0x7fa78c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.170+0000 7fa7ade00640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa78c0678f0 0x7fa78c069db0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa7940057f0 tx=0x7fa7a00b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:58.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.174+0000 7fa7a6000640 1 -- 172.21.15.5:0/1398376465 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa7a8055c50 con 0x7fa7b00d18e0 2024-08-18T22:23:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.342+0000 7fa7b4e00640 1 -- 172.21.15.5:0/1398376465 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7b0160da0 con 0x7fa78c0678f0 2024-08-18T22:23:58.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.350+0000 7fa7a6000640 1 -- 172.21.15.5:0/1398376465 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248184 (secure 0 0 0) 0x7fa7b0160da0 con 0x7fa78c0678f0 2024-08-18T22:23:58.352 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:58.353 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:23:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.350+0000 7fa7b4e00640 1 -- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa78c0678f0 msgr2=0x7fa78c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.350+0000 7fa7b4e00640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa78c0678f0 0x7fa78c069db0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa7940057f0 tx=0x7fa7a00b2040 comp rx=0 tx=0).stop 2024-08-18T22:23:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.350+0000 7fa7b4e00640 1 -- 172.21.15.5:0/1398376465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b00d18e0 msgr2=0x7fa7b00cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.350+0000 7fa7b4e00640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b00d18e0 0x7fa7b00cd1c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800e700 tx=0x7fa7a800ebc0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.354+0000 7fa7b4e00640 1 -- 172.21.15.5:0/1398376465 shutdown_connections 2024-08-18T22:23:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.354+0000 7fa7b4e00640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa78c0678f0 0x7fa78c069db0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.354+0000 7fa7b4e00640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7b00d18e0 0x7fa7b00cd1c0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.354+0000 7fa7b4e00640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7b01f4ee0 0x7fa7b00d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.354+0000 7fa7b4e00640 1 --2- 172.21.15.5:0/1398376465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7940039f0 0x7fa7b01f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.354+0000 7fa7b4e00640 1 -- 172.21.15.5:0/1398376465 >> 172.21.15.5:0/1398376465 conn(0x7fa7b00b3eb0 msgr2=0x7fa7b0146d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.354+0000 7fa7b4e00640 1 -- 172.21.15.5:0/1398376465 shutdown_connections 2024-08-18T22:23:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.354+0000 7fa7b4e00640 1 -- 172.21.15.5:0/1398376465 wait complete. 2024-08-18T22:23:58.372 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-08-18T22:23:57.686563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":308168,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754666552,"statfs":{"total":773094113280,"available":772778549248,"internally_reserved":0,"allocated":8986624,"data_stored":4735708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.465341"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.230493+0000","last_change":"2024-08-18T22:23:53.230493+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.230493+0000","last_undegraded":"2024-08-18T22:23:53.230493+0000","last_fullsized":"2024-08-18T22:23:53.230493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.241252+0000","last_change":"2024-08-18T22:23:53.241252+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.241252+0000","last_undegraded":"2024-08-18T22:23:53.241252+0000","last_fullsized":"2024-08-18T22:23:53.241252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240562+0000","last_change":"2024-08-18T22:23:53.240562+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240562+0000","last_undegraded":"2024-08-18T22:23:53.240562+0000","last_fullsized":"2024-08-18T22:23:53.240562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236364+0000","last_change":"2024-08-18T22:23:53.236364+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236364+0000","last_undegraded":"2024-08-18T22:23:53.236364+0000","last_fullsized":"2024-08-18T22:23:53.236364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264328+0000","last_change":"2024-08-18T22:23:54.255429+0000","last_active":"2024-08-18T22:23:55.264328+0000","last_peered":"2024-08-18T22:23:55.264328+0000","last_clean":"2024-08-18T22:23:55.264328+0000","last_became_active":"2024-08-18T22:23:54.254830+0000","last_became_peered":"2024-08-18T22:23:54.254830+0000","last_unstale":"2024-08-18T22:23:55.264328+0000","last_undegraded":"2024-08-18T22:23:55.264328+0000","last_fullsized":"2024-08-18T22:23:55.264328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:49.556352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233225+0000","last_change":"2024-08-18T22:23:53.233225+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233225+0000","last_undegraded":"2024-08-18T22:23:53.233225+0000","last_fullsized":"2024-08-18T22:23:53.233225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232999+0000","last_change":"2024-08-18T22:23:53.232999+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232999+0000","last_undegraded":"2024-08-18T22:23:53.232999+0000","last_fullsized":"2024-08-18T22:23:53.232999+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.263983+0000","last_change":"2024-08-18T22:23:54.253390+0000","last_active":"2024-08-18T22:23:55.263983+0000","last_peered":"2024-08-18T22:23:55.263983+0000","last_clean":"2024-08-18T22:23:55.263983+0000","last_became_active":"2024-08-18T22:23:54.253085+0000","last_became_peered":"2024-08-18T22:23:54.253085+0000","last_unstale":"2024-08-18T22:23:55.263983+0000","last_undegraded":"2024-08-18T22:23:55.263983+0000","last_fullsized":"2024-08-18T22:23:55.263983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:14.303897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261466+0000","last_change":"2024-08-18T22:23:54.258688+0000","last_active":"2024-08-18T22:23:55.261466+0000","last_peered":"2024-08-18T22:23:55.261466+0000","last_clean":"2024-08-18T22:23:55.261466+0000","last_became_active":"2024-08-18T22:23:54.258436+0000","last_became_peered":"2024-08-18T22:23:54.258436+0000","last_unstale":"2024-08-18T22:23:55.261466+0000","last_undegraded":"2024-08-18T22:23:55.261466+0000","last_fullsized":"2024-08-18T22:23:55.261466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:10.210409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236519+0000","last_change":"2024-08-18T22:23:53.236519+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236519+0000","last_undegraded":"2024-08-18T22:23:53.236519+0000","last_fullsized":"2024-08-18T22:23:53.236519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236929+0000","last_change":"2024-08-18T22:23:53.236929+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236929+0000","last_undegraded":"2024-08-18T22:23:53.236929+0000","last_fullsized":"2024-08-18T22:23:53.236929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.235970+0000","last_change":"2024-08-18T22:23:53.235970+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.235970+0000","last_undegraded":"2024-08-18T22:23:53.235970+0000","last_fullsized":"2024-08-18T22:23:53.235970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264361+0000","last_change":"2024-08-18T22:23:54.254445+0000","last_active":"2024-08-18T22:23:55.264361+0000","last_peered":"2024-08-18T22:23:55.264361+0000","last_clean":"2024-08-18T22:23:55.264361+0000","last_became_active":"2024-08-18T22:23:54.254125+0000","last_became_peered":"2024-08-18T22:23:54.254125+0000","last_unstale":"2024-08-18T22:23:55.264361+0000","last_undegraded":"2024-08-18T22:23:55.264361+0000","last_fullsized":"2024-08-18T22:23:55.264361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:07.096296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232663+0000","last_change":"2024-08-18T22:23:53.232663+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232663+0000","last_undegraded":"2024-08-18T22:23:53.232663+0000","last_fullsized":"2024-08-18T22:23:53.232663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.239293+0000","last_change":"2024-08-18T22:23:53.239293+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.239293+0000","last_undegraded":"2024-08-18T22:23:53.239293+0000","last_fullsized":"2024-08-18T22:23:53.239293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.229183+0000","last_change":"2024-08-18T22:23:53.229183+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.229183+0000","last_undegraded":"2024-08-18T22:23:53.229183+0000","last_fullsized":"2024-08-18T22:23:53.229183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264661+0000","last_change":"2024-08-18T22:23:54.259132+0000","last_active":"2024-08-18T22:23:55.264661+0000","last_peered":"2024-08-18T22:23:55.264661+0000","last_clean":"2024-08-18T22:23:55.264661+0000","last_became_active":"2024-08-18T22:23:54.258811+0000","last_became_peered":"2024-08-18T22:23:54.258811+0000","last_unstale":"2024-08-18T22:23:55.264661+0000","last_undegraded":"2024-08-18T22:23:55.264661+0000","last_fullsized":"2024-08-18T22:23:55.264661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:48.771970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240676+0000","last_change":"2024-08-18T22:23:53.240676+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240676+0000","last_undegraded":"2024-08-18T22:23:53.240676+0000","last_fullsized":"2024-08-18T22:23:53.240676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231041+0000","last_change":"2024-08-18T22:23:53.231041+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231041+0000","last_undegraded":"2024-08-18T22:23:53.231041+0000","last_fullsized":"2024-08-18T22:23:53.231041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264433+0000","last_change":"2024-08-18T22:23:54.262936+0000","last_active":"2024-08-18T22:23:55.264433+0000","last_peered":"2024-08-18T22:23:55.264433+0000","last_clean":"2024-08-18T22:23:55.264433+0000","last_became_active":"2024-08-18T22:23:54.262665+0000","last_became_peered":"2024-08-18T22:23:54.262665+0000","last_unstale":"2024-08-18T22:23:55.264433+0000","last_undegraded":"2024-08-18T22:23:55.264433+0000","last_fullsized":"2024-08-18T22:23:55.264433+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:34.017166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261382+0000","last_change":"2024-08-18T22:23:54.267084+0000","last_active":"2024-08-18T22:23:55.261382+0000","last_peered":"2024-08-18T22:23:55.261382+0000","last_clean":"2024-08-18T22:23:55.261382+0000","last_became_active":"2024-08-18T22:23:54.266792+0000","last_became_peered":"2024-08-18T22:23:54.266792+0000","last_unstale":"2024-08-18T22:23:55.261382+0000","last_undegraded":"2024-08-18T22:23:55.261382+0000","last_fullsized":"2024-08-18T22:23:55.261382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:27:37.035990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264190+0000","last_change":"2024-08-18T22:23:54.262252+0000","last_active":"2024-08-18T22:23:55.264190+0000","last_peered":"2024-08-18T22:23:55.264190+0000","last_clean":"2024-08-18T22:23:55.264190+0000","last_became_active":"2024-08-18T22:23:54.261976+0000","last_became_peered":"2024-08-18T22:23:54.261976+0000","last_unstale":"2024-08-18T22:23:55.264190+0000","last_undegraded":"2024-08-18T22:23:55.264190+0000","last_fullsized":"2024-08-18T22:23:55.264190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:27.688388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261229+0000","last_change":"2024-08-18T22:23:54.269243+0000","last_active":"2024-08-18T22:23:55.261229+0000","last_peered":"2024-08-18T22:23:55.261229+0000","last_clean":"2024-08-18T22:23:55.261229+0000","last_became_active":"2024-08-18T22:23:54.268935+0000","last_became_peered":"2024-08-18T22:23:54.268935+0000","last_unstale":"2024-08-18T22:23:55.261229+0000","last_undegraded":"2024-08-18T22:23:55.261229+0000","last_fullsized":"2024-08-18T22:23:55.261229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:56:07.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236717+0000","last_change":"2024-08-18T22:23:53.236717+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236717+0000","last_undegraded":"2024-08-18T22:23:53.236717+0000","last_fullsized":"2024-08-18T22:23:53.236717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.237012+0000","last_change":"2024-08-18T22:23:53.237012+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.237012+0000","last_undegraded":"2024-08-18T22:23:53.237012+0000","last_fullsized":"2024-08-18T22:23:53.237012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233949+0000","last_change":"2024-08-18T22:23:53.233949+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233949+0000","last_undegraded":"2024-08-18T22:23:53.233949+0000","last_fullsized":"2024-08-18T22:23:53.233949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.229370+0000","last_change":"2024-08-18T22:23:53.229370+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.229370+0000","last_undegraded":"2024-08-18T22:23:53.229370+0000","last_fullsized":"2024-08-18T22:23:53.229370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264452+0000","last_change":"2024-08-18T22:23:54.269533+0000","last_active":"2024-08-18T22:23:55.264452+0000","last_peered":"2024-08-18T22:23:55.264452+0000","last_clean":"2024-08-18T22:23:55.264452+0000","last_became_active":"2024-08-18T22:23:54.269250+0000","last_became_peered":"2024-08-18T22:23:54.269250+0000","last_unstale":"2024-08-18T22:23:55.264452+0000","last_undegraded":"2024-08-18T22:23:55.264452+0000","last_fullsized":"2024-08-18T22:23:55.264452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:38:29.318017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234548+0000","last_change":"2024-08-18T22:23:53.234548+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234548+0000","last_undegraded":"2024-08-18T22:23:53.234548+0000","last_fullsized":"2024-08-18T22:23:53.234548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.227692+0000","last_change":"2024-08-18T22:23:53.227692+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.227692+0000","last_undegraded":"2024-08-18T22:23:53.227692+0000","last_fullsized":"2024-08-18T22:23:53.227692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240371+0000","last_change":"2024-08-18T22:23:53.240371+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240371+0000","last_undegraded":"2024-08-18T22:23:53.240371+0000","last_fullsized":"2024-08-18T22:23:53.240371+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.227548+0000","last_change":"2024-08-18T22:23:53.227548+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.227548+0000","last_undegraded":"2024-08-18T22:23:53.227548+0000","last_fullsized":"2024-08-18T22:23:53.227548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.241056+0000","last_change":"2024-08-18T22:23:53.241056+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.241056+0000","last_undegraded":"2024-08-18T22:23:53.241056+0000","last_fullsized":"2024-08-18T22:23:53.241056+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264673+0000","last_change":"2024-08-18T22:23:53.251250+0000","last_active":"2024-08-18T22:23:55.264673+0000","last_peered":"2024-08-18T22:23:55.264673+0000","last_clean":"2024-08-18T22:23:55.264673+0000","last_became_active":"2024-08-18T22:23:53.250935+0000","last_became_peered":"2024-08-18T22:23:53.250935+0000","last_unstale":"2024-08-18T22:23:55.264673+0000","last_undegraded":"2024-08-18T22:23:55.264673+0000","last_fullsized":"2024-08-18T22:23:55.264673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:44.891601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234357+0000","last_change":"2024-08-18T22:23:53.234357+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234357+0000","last_undegraded":"2024-08-18T22:23:53.234357+0000","last_fullsized":"2024-08-18T22:23:53.234357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249647+0000","last_change":"2024-08-18T22:23:53.245851+0000","last_active":"2024-08-18T22:23:53.249647+0000","last_peered":"2024-08-18T22:23:53.249647+0000","last_clean":"2024-08-18T22:23:53.249647+0000","last_became_active":"2024-08-18T22:23:53.245598+0000","last_became_peered":"2024-08-18T22:23:53.245598+0000","last_unstale":"2024-08-18T22:23:53.249647+0000","last_undegraded":"2024-08-18T22:23:53.249647+0000","last_fullsized":"2024-08-18T22:23:53.249647+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:08.045334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261043+0000","last_change":"2024-08-18T22:23:54.264243+0000","last_active":"2024-08-18T22:23:55.261043+0000","last_peered":"2024-08-18T22:23:55.261043+0000","last_clean":"2024-08-18T22:23:55.261043+0000","last_became_active":"2024-08-18T22:23:54.263437+0000","last_became_peered":"2024-08-18T22:23:54.263437+0000","last_unstale":"2024-08-18T22:23:55.261043+0000","last_undegraded":"2024-08-18T22:23:55.261043+0000","last_fullsized":"2024-08-18T22:23:55.261043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:02.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.251861+0000","last_change":"2024-08-18T22:23:53.249485+0000","last_active":"2024-08-18T22:23:53.251861+0000","last_peered":"2024-08-18T22:23:53.251861+0000","last_clean":"2024-08-18T22:23:53.251861+0000","last_became_active":"2024-08-18T22:23:53.248070+0000","last_became_peered":"2024-08-18T22:23:53.248070+0000","last_unstale":"2024-08-18T22:23:53.251861+0000","last_undegraded":"2024-08-18T22:23:53.251861+0000","last_fullsized":"2024-08-18T22:23:53.251861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:12.820159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261499+0000","last_change":"2024-08-18T22:23:54.266316+0000","last_active":"2024-08-18T22:23:55.261499+0000","last_peered":"2024-08-18T22:23:55.261499+0000","last_clean":"2024-08-18T22:23:55.261499+0000","last_became_active":"2024-08-18T22:23:54.265936+0000","last_became_peered":"2024-08-18T22:23:54.265936+0000","last_unstale":"2024-08-18T22:23:55.261499+0000","last_undegraded":"2024-08-18T22:23:55.261499+0000","last_fullsized":"2024-08-18T22:23:55.261499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:00:03.812617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248331+0000","last_change":"2024-08-18T22:23:53.243356+0000","last_active":"2024-08-18T22:23:53.248331+0000","last_peered":"2024-08-18T22:23:53.248331+0000","last_clean":"2024-08-18T22:23:53.248331+0000","last_became_active":"2024-08-18T22:23:53.243055+0000","last_became_peered":"2024-08-18T22:23:53.243055+0000","last_unstale":"2024-08-18T22:23:53.248331+0000","last_undegraded":"2024-08-18T22:23:53.248331+0000","last_fullsized":"2024-08-18T22:23:53.248331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:47.749438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234746+0000","last_change":"2024-08-18T22:23:53.234746+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234746+0000","last_undegraded":"2024-08-18T22:23:53.234746+0000","last_fullsized":"2024-08-18T22:23:53.234746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261622+0000","last_change":"2024-08-18T22:23:53.240275+0000","last_active":"2024-08-18T22:23:55.261622+0000","last_peered":"2024-08-18T22:23:55.261622+0000","last_clean":"2024-08-18T22:23:55.261622+0000","last_became_active":"2024-08-18T22:23:53.239803+0000","last_became_peered":"2024-08-18T22:23:53.239803+0000","last_unstale":"2024-08-18T22:23:55.261622+0000","last_undegraded":"2024-08-18T22:23:55.261622+0000","last_fullsized":"2024-08-18T22:23:55.261622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:22.345962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.235853+0000","last_change":"2024-08-18T22:23:53.235853+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.235853+0000","last_undegraded":"2024-08-18T22:23:53.235853+0000","last_fullsized":"2024-08-18T22:23:53.235853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249762+0000","last_change":"2024-08-18T22:23:53.247955+0000","last_active":"2024-08-18T22:23:53.249762+0000","last_peered":"2024-08-18T22:23:53.249762+0000","last_clean":"2024-08-18T22:23:53.249762+0000","last_became_active":"2024-08-18T22:23:53.246744+0000","last_became_peered":"2024-08-18T22:23:53.246744+0000","last_unstale":"2024-08-18T22:23:53.249762+0000","last_undegraded":"2024-08-18T22:23:53.249762+0000","last_fullsized":"2024-08-18T22:23:53.249762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:14:00.588346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261582+0000","last_change":"2024-08-18T22:23:54.257636+0000","last_active":"2024-08-18T22:23:55.261582+0000","last_peered":"2024-08-18T22:23:55.261582+0000","last_clean":"2024-08-18T22:23:55.261582+0000","last_became_active":"2024-08-18T22:23:54.257280+0000","last_became_peered":"2024-08-18T22:23:54.257280+0000","last_unstale":"2024-08-18T22:23:55.261582+0000","last_undegraded":"2024-08-18T22:23:55.261582+0000","last_fullsized":"2024-08-18T22:23:55.261582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:50.911549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.246752+0000","last_change":"2024-08-18T22:23:53.245559+0000","last_active":"2024-08-18T22:23:53.246752+0000","last_peered":"2024-08-18T22:23:53.246752+0000","last_clean":"2024-08-18T22:23:53.246752+0000","last_became_active":"2024-08-18T22:23:53.245269+0000","last_became_peered":"2024-08-18T22:23:53.245269+0000","last_unstale":"2024-08-18T22:23:53.246752+0000","last_undegraded":"2024-08-18T22:23:53.246752+0000","last_fullsized":"2024-08-18T22:23:53.246752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:17.284982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232457+0000","last_change":"2024-08-18T22:23:53.232457+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232457+0000","last_undegraded":"2024-08-18T22:23:53.232457+0000","last_fullsized":"2024-08-18T22:23:53.232457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264053+0000","last_change":"2024-08-18T22:23:53.246914+0000","last_active":"2024-08-18T22:23:55.264053+0000","last_peered":"2024-08-18T22:23:55.264053+0000","last_clean":"2024-08-18T22:23:55.264053+0000","last_became_active":"2024-08-18T22:23:53.246609+0000","last_became_peered":"2024-08-18T22:23:53.246609+0000","last_unstale":"2024-08-18T22:23:55.264053+0000","last_undegraded":"2024-08-18T22:23:55.264053+0000","last_fullsized":"2024-08-18T22:23:55.264053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:49.756736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233504+0000","last_change":"2024-08-18T22:23:53.233504+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233504+0000","last_undegraded":"2024-08-18T22:23:53.233504+0000","last_fullsized":"2024-08-18T22:23:53.233504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249317+0000","last_change":"2024-08-18T22:23:53.242509+0000","last_active":"2024-08-18T22:23:53.249317+0000","last_peered":"2024-08-18T22:23:53.249317+0000","last_clean":"2024-08-18T22:23:53.249317+0000","last_became_active":"2024-08-18T22:23:53.242205+0000","last_became_peered":"2024-08-18T22:23:53.242205+0000","last_unstale":"2024-08-18T22:23:53.249317+0000","last_undegraded":"2024-08-18T22:23:53.249317+0000","last_fullsized":"2024-08-18T22:23:53.249317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:11:00.515699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232617+0000","last_change":"2024-08-18T22:23:53.232617+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232617+0000","last_undegraded":"2024-08-18T22:23:53.232617+0000","last_fullsized":"2024-08-18T22:23:53.232617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249198+0000","last_change":"2024-08-18T22:23:53.245330+0000","last_active":"2024-08-18T22:23:53.249198+0000","last_peered":"2024-08-18T22:23:53.249198+0000","last_clean":"2024-08-18T22:23:53.249198+0000","last_became_active":"2024-08-18T22:23:53.243674+0000","last_became_peered":"2024-08-18T22:23:53.243674+0000","last_unstale":"2024-08-18T22:23:53.249198+0000","last_undegraded":"2024-08-18T22:23:53.249198+0000","last_fullsized":"2024-08-18T22:23:53.249198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:36.794334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.230747+0000","last_change":"2024-08-18T22:23:53.230747+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.230747+0000","last_undegraded":"2024-08-18T22:23:53.230747+0000","last_fullsized":"2024-08-18T22:23:53.230747+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264611+0000","last_change":"2024-08-18T22:23:53.249062+0000","last_active":"2024-08-18T22:23:55.264611+0000","last_peered":"2024-08-18T22:23:55.264611+0000","last_clean":"2024-08-18T22:23:55.264611+0000","last_became_active":"2024-08-18T22:23:53.248766+0000","last_became_peered":"2024-08-18T22:23:53.248766+0000","last_unstale":"2024-08-18T22:23:55.264611+0000","last_undegraded":"2024-08-18T22:23:55.264611+0000","last_fullsized":"2024-08-18T22:23:55.264611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:51.713170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240393+0000","last_change":"2024-08-18T22:23:53.240393+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240393+0000","last_undegraded":"2024-08-18T22:23:53.240393+0000","last_fullsized":"2024-08-18T22:23:53.240393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249672+0000","last_change":"2024-08-18T22:23:53.245872+0000","last_active":"2024-08-18T22:23:53.249672+0000","last_peered":"2024-08-18T22:23:53.249672+0000","last_clean":"2024-08-18T22:23:53.249672+0000","last_became_active":"2024-08-18T22:23:53.245598+0000","last_became_peered":"2024-08-18T22:23:53.245598+0000","last_unstale":"2024-08-18T22:23:53.249672+0000","last_undegraded":"2024-08-18T22:23:53.249672+0000","last_fullsized":"2024-08-18T22:23:53.249672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:37:37.435949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233341+0000","last_change":"2024-08-18T22:23:53.233341+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233341+0000","last_undegraded":"2024-08-18T22:23:53.233341+0000","last_fullsized":"2024-08-18T22:23:53.233341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249779+0000","last_change":"2024-08-18T22:23:53.247110+0000","last_active":"2024-08-18T22:23:53.249779+0000","last_peered":"2024-08-18T22:23:53.249779+0000","last_clean":"2024-08-18T22:23:53.249779+0000","last_became_active":"2024-08-18T22:23:53.245877+0000","last_became_peered":"2024-08-18T22:23:53.245877+0000","last_unstale":"2024-08-18T22:23:53.249779+0000","last_undegraded":"2024-08-18T22:23:53.249779+0000","last_fullsized":"2024-08-18T22:23:53.249779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:44:37.965015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232323+0000","last_change":"2024-08-18T22:23:53.232323+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232323+0000","last_undegraded":"2024-08-18T22:23:53.232323+0000","last_fullsized":"2024-08-18T22:23:53.232323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249279+0000","last_change":"2024-08-18T22:23:53.241741+0000","last_active":"2024-08-18T22:23:53.249279+0000","last_peered":"2024-08-18T22:23:53.249279+0000","last_clean":"2024-08-18T22:23:53.249279+0000","last_became_active":"2024-08-18T22:23:53.241388+0000","last_became_peered":"2024-08-18T22:23:53.241388+0000","last_unstale":"2024-08-18T22:23:53.249279+0000","last_undegraded":"2024-08-18T22:23:53.249279+0000","last_fullsized":"2024-08-18T22:23:53.249279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:14:00.588346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.237680+0000","last_change":"2024-08-18T22:23:53.237680+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.237680+0000","last_undegraded":"2024-08-18T22:23:53.237680+0000","last_fullsized":"2024-08-18T22:23:53.237680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264098+0000","last_change":"2024-08-18T22:23:53.251780+0000","last_active":"2024-08-18T22:23:55.264098+0000","last_peered":"2024-08-18T22:23:55.264098+0000","last_clean":"2024-08-18T22:23:55.264098+0000","last_became_active":"2024-08-18T22:23:53.251524+0000","last_became_peered":"2024-08-18T22:23:53.251524+0000","last_unstale":"2024-08-18T22:23:55.264098+0000","last_undegraded":"2024-08-18T22:23:55.264098+0000","last_fullsized":"2024-08-18T22:23:55.264098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:01.049290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231938+0000","last_change":"2024-08-18T22:23:53.231938+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231938+0000","last_undegraded":"2024-08-18T22:23:53.231938+0000","last_fullsized":"2024-08-18T22:23:53.231938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.252580+0000","last_change":"2024-08-18T22:23:53.250165+0000","last_active":"2024-08-18T22:23:53.252580+0000","last_peered":"2024-08-18T22:23:53.252580+0000","last_clean":"2024-08-18T22:23:53.252580+0000","last_became_active":"2024-08-18T22:23:53.249889+0000","last_became_peered":"2024-08-18T22:23:53.249889+0000","last_unstale":"2024-08-18T22:23:53.252580+0000","last_undegraded":"2024-08-18T22:23:53.252580+0000","last_fullsized":"2024-08-18T22:23:53.252580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:19:45.657386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231460+0000","last_change":"2024-08-18T22:23:53.231460+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231460+0000","last_undegraded":"2024-08-18T22:23:53.231460+0000","last_fullsized":"2024-08-18T22:23:53.231460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249372+0000","last_change":"2024-08-18T22:23:53.243095+0000","last_active":"2024-08-18T22:23:53.249372+0000","last_peered":"2024-08-18T22:23:53.249372+0000","last_clean":"2024-08-18T22:23:53.249372+0000","last_became_active":"2024-08-18T22:23:53.242833+0000","last_became_peered":"2024-08-18T22:23:53.242833+0000","last_unstale":"2024-08-18T22:23:53.249372+0000","last_undegraded":"2024-08-18T22:23:53.249372+0000","last_fullsized":"2024-08-18T22:23:53.249372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:17.284982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264113+0000","last_change":"2024-08-18T22:23:54.259286+0000","last_active":"2024-08-18T22:23:55.264113+0000","last_peered":"2024-08-18T22:23:55.264113+0000","last_clean":"2024-08-18T22:23:55.264113+0000","last_became_active":"2024-08-18T22:23:54.258960+0000","last_became_peered":"2024-08-18T22:23:54.258960+0000","last_unstale":"2024-08-18T22:23:55.264113+0000","last_undegraded":"2024-08-18T22:23:55.264113+0000","last_fullsized":"2024-08-18T22:23:55.264113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:48.497587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261682+0000","last_change":"2024-08-18T22:23:53.241158+0000","last_active":"2024-08-18T22:23:55.261682+0000","last_peered":"2024-08-18T22:23:55.261682+0000","last_clean":"2024-08-18T22:23:55.261682+0000","last_became_active":"2024-08-18T22:23:53.240859+0000","last_became_peered":"2024-08-18T22:23:53.240859+0000","last_unstale":"2024-08-18T22:23:55.261682+0000","last_undegraded":"2024-08-18T22:23:55.261682+0000","last_fullsized":"2024-08-18T22:23:55.261682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:41.985620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264192+0000","last_change":"2024-08-18T22:23:54.271013+0000","last_active":"2024-08-18T22:23:55.264192+0000","last_peered":"2024-08-18T22:23:55.264192+0000","last_clean":"2024-08-18T22:23:55.264192+0000","last_became_active":"2024-08-18T22:23:54.270715+0000","last_became_peered":"2024-08-18T22:23:54.270715+0000","last_unstale":"2024-08-18T22:23:55.264192+0000","last_undegraded":"2024-08-18T22:23:55.264192+0000","last_fullsized":"2024-08-18T22:23:55.264192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:18:11.045700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264616+0000","last_change":"2024-08-18T22:23:53.246903+0000","last_active":"2024-08-18T22:23:55.264616+0000","last_peered":"2024-08-18T22:23:55.264616+0000","last_clean":"2024-08-18T22:23:55.264616+0000","last_became_active":"2024-08-18T22:23:53.246619+0000","last_became_peered":"2024-08-18T22:23:53.246619+0000","last_unstale":"2024-08-18T22:23:55.264616+0000","last_undegraded":"2024-08-18T22:23:55.264616+0000","last_fullsized":"2024-08-18T22:23:55.264616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:33:39.529484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.230795+0000","last_change":"2024-08-18T22:23:53.230795+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.230795+0000","last_undegraded":"2024-08-18T22:23:53.230795+0000","last_fullsized":"2024-08-18T22:23:53.230795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.251325+0000","last_change":"2024-08-18T22:23:53.250046+0000","last_active":"2024-08-18T22:23:53.251325+0000","last_peered":"2024-08-18T22:23:53.251325+0000","last_clean":"2024-08-18T22:23:53.251325+0000","last_became_active":"2024-08-18T22:23:53.246620+0000","last_became_peered":"2024-08-18T22:23:53.246620+0000","last_unstale":"2024-08-18T22:23:53.251325+0000","last_undegraded":"2024-08-18T22:23:53.251325+0000","last_fullsized":"2024-08-18T22:23:53.251325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:38:26.142335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234215+0000","last_change":"2024-08-18T22:23:53.234215+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234215+0000","last_undegraded":"2024-08-18T22:23:53.234215+0000","last_fullsized":"2024-08-18T22:23:53.234215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.246712+0000","last_change":"2024-08-18T22:23:53.242322+0000","last_active":"2024-08-18T22:23:53.246712+0000","last_peered":"2024-08-18T22:23:53.246712+0000","last_clean":"2024-08-18T22:23:53.246712+0000","last_became_active":"2024-08-18T22:23:53.241981+0000","last_became_peered":"2024-08-18T22:23:53.241981+0000","last_unstale":"2024-08-18T22:23:53.246712+0000","last_undegraded":"2024-08-18T22:23:53.246712+0000","last_fullsized":"2024-08-18T22:23:53.246712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:35:24.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236584+0000","last_change":"2024-08-18T22:23:53.236584+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236584+0000","last_undegraded":"2024-08-18T22:23:53.236584+0000","last_fullsized":"2024-08-18T22:23:53.236584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249057+0000","last_change":"2024-08-18T22:23:53.239454+0000","last_active":"2024-08-18T22:23:53.249057+0000","last_peered":"2024-08-18T22:23:53.249057+0000","last_clean":"2024-08-18T22:23:53.249057+0000","last_became_active":"2024-08-18T22:23:53.239189+0000","last_became_peered":"2024-08-18T22:23:53.239189+0000","last_unstale":"2024-08-18T22:23:53.249057+0000","last_undegraded":"2024-08-18T22:23:53.249057+0000","last_fullsized":"2024-08-18T22:23:53.249057+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:33:00.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231336+0000","last_change":"2024-08-18T22:23:53.231336+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231336+0000","last_undegraded":"2024-08-18T22:23:53.231336+0000","last_fullsized":"2024-08-18T22:23:53.231336+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248159+0000","last_change":"2024-08-18T22:23:53.247190+0000","last_active":"2024-08-18T22:23:53.248159+0000","last_peered":"2024-08-18T22:23:53.248159+0000","last_clean":"2024-08-18T22:23:53.248159+0000","last_became_active":"2024-08-18T22:23:53.244049+0000","last_became_peered":"2024-08-18T22:23:53.244049+0000","last_unstale":"2024-08-18T22:23:53.248159+0000","last_undegraded":"2024-08-18T22:23:53.248159+0000","last_fullsized":"2024-08-18T22:23:53.248159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:21.605699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260839+0000","last_change":"2024-08-18T22:23:54.259872+0000","last_active":"2024-08-18T22:23:55.260839+0000","last_peered":"2024-08-18T22:23:55.260839+0000","last_clean":"2024-08-18T22:23:55.260839+0000","last_became_active":"2024-08-18T22:23:54.259633+0000","last_became_peered":"2024-08-18T22:23:54.259633+0000","last_unstale":"2024-08-18T22:23:55.260839+0000","last_undegraded":"2024-08-18T22:23:55.260839+0000","last_fullsized":"2024-08-18T22:23:55.260839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:12.200171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248944+0000","last_change":"2024-08-18T22:23:53.246134+0000","last_active":"2024-08-18T22:23:53.248944+0000","last_peered":"2024-08-18T22:23:53.248944+0000","last_clean":"2024-08-18T22:23:53.248944+0000","last_became_active":"2024-08-18T22:23:53.245585+0000","last_became_peered":"2024-08-18T22:23:53.245585+0000","last_unstale":"2024-08-18T22:23:53.248944+0000","last_undegraded":"2024-08-18T22:23:53.248944+0000","last_fullsized":"2024-08-18T22:23:53.248944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:48.980834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232242+0000","last_change":"2024-08-18T22:23:53.232242+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232242+0000","last_undegraded":"2024-08-18T22:23:53.232242+0000","last_fullsized":"2024-08-18T22:23:53.232242+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.255640+0000","last_change":"2024-08-18T22:23:53.255034+0000","last_active":"2024-08-18T22:23:53.255640+0000","last_peered":"2024-08-18T22:23:53.255640+0000","last_clean":"2024-08-18T22:23:53.255640+0000","last_became_active":"2024-08-18T22:23:53.254449+0000","last_became_peered":"2024-08-18T22:23:53.254449+0000","last_unstale":"2024-08-18T22:23:53.255640+0000","last_undegraded":"2024-08-18T22:23:53.255640+0000","last_fullsized":"2024-08-18T22:23:53.255640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:08.045334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261122+0000","last_change":"2024-08-18T22:23:54.263284+0000","last_active":"2024-08-18T22:23:55.261122+0000","last_peered":"2024-08-18T22:23:55.261122+0000","last_clean":"2024-08-18T22:23:55.261122+0000","last_became_active":"2024-08-18T22:23:54.262747+0000","last_became_peered":"2024-08-18T22:23:54.262747+0000","last_unstale":"2024-08-18T22:23:55.261122+0000","last_undegraded":"2024-08-18T22:23:55.261122+0000","last_fullsized":"2024-08-18T22:23:55.261122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:51:52.385446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249815+0000","last_change":"2024-08-18T22:23:53.240247+0000","last_active":"2024-08-18T22:23:53.249815+0000","last_peered":"2024-08-18T22:23:53.249815+0000","last_clean":"2024-08-18T22:23:53.249815+0000","last_became_active":"2024-08-18T22:23:53.239551+0000","last_became_peered":"2024-08-18T22:23:53.239551+0000","last_unstale":"2024-08-18T22:23:53.249815+0000","last_undegraded":"2024-08-18T22:23:53.249815+0000","last_fullsized":"2024-08-18T22:23:53.249815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:44:37.965015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234138+0000","last_change":"2024-08-18T22:23:53.234138+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234138+0000","last_undegraded":"2024-08-18T22:23:53.234138+0000","last_fullsized":"2024-08-18T22:23:53.234138+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249533+0000","last_change":"2024-08-18T22:23:53.244792+0000","last_active":"2024-08-18T22:23:53.249533+0000","last_peered":"2024-08-18T22:23:53.249533+0000","last_clean":"2024-08-18T22:23:53.249533+0000","last_became_active":"2024-08-18T22:23:53.244310+0000","last_became_peered":"2024-08-18T22:23:53.244310+0000","last_unstale":"2024-08-18T22:23:53.249533+0000","last_undegraded":"2024-08-18T22:23:53.249533+0000","last_fullsized":"2024-08-18T22:23:53.249533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:19:45.657386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.235045+0000","last_change":"2024-08-18T22:23:53.235045+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.235045+0000","last_undegraded":"2024-08-18T22:23:53.235045+0000","last_fullsized":"2024-08-18T22:23:53.235045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248747+0000","last_change":"2024-08-18T22:23:53.244540+0000","last_active":"2024-08-18T22:23:53.248747+0000","last_peered":"2024-08-18T22:23:53.248747+0000","last_clean":"2024-08-18T22:23:53.248747+0000","last_became_active":"2024-08-18T22:23:53.243417+0000","last_became_peered":"2024-08-18T22:23:53.243417+0000","last_unstale":"2024-08-18T22:23:53.248747+0000","last_undegraded":"2024-08-18T22:23:53.248747+0000","last_fullsized":"2024-08-18T22:23:53.248747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:30.730795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231799+0000","last_change":"2024-08-18T22:23:53.231799+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231799+0000","last_undegraded":"2024-08-18T22:23:53.231799+0000","last_fullsized":"2024-08-18T22:23:53.231799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264370+0000","last_change":"2024-08-18T22:23:53.252271+0000","last_active":"2024-08-18T22:23:55.264370+0000","last_peered":"2024-08-18T22:23:55.264370+0000","last_clean":"2024-08-18T22:23:55.264370+0000","last_became_active":"2024-08-18T22:23:53.252030+0000","last_became_peered":"2024-08-18T22:23:53.252030+0000","last_unstale":"2024-08-18T22:23:55.264370+0000","last_undegraded":"2024-08-18T22:23:55.264370+0000","last_fullsized":"2024-08-18T22:23:55.264370+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:19.534699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232202+0000","last_change":"2024-08-18T22:23:53.232202+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232202+0000","last_undegraded":"2024-08-18T22:23:53.232202+0000","last_fullsized":"2024-08-18T22:23:53.232202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.250134+0000","last_change":"2024-08-18T22:23:53.249008+0000","last_active":"2024-08-18T22:23:53.250134+0000","last_peered":"2024-08-18T22:23:53.250134+0000","last_clean":"2024-08-18T22:23:53.250134+0000","last_became_active":"2024-08-18T22:23:53.248747+0000","last_became_peered":"2024-08-18T22:23:53.248747+0000","last_unstale":"2024-08-18T22:23:53.250134+0000","last_undegraded":"2024-08-18T22:23:53.250134+0000","last_fullsized":"2024-08-18T22:23:53.250134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:38:26.142335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231519+0000","last_change":"2024-08-18T22:23:53.231519+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231519+0000","last_undegraded":"2024-08-18T22:23:53.231519+0000","last_fullsized":"2024-08-18T22:23:53.231519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.253729+0000","last_change":"2024-08-18T22:23:53.253204+0000","last_active":"2024-08-18T22:23:53.253729+0000","last_peered":"2024-08-18T22:23:53.253729+0000","last_clean":"2024-08-18T22:23:53.253729+0000","last_became_active":"2024-08-18T22:23:53.252957+0000","last_became_peered":"2024-08-18T22:23:53.252957+0000","last_unstale":"2024-08-18T22:23:53.253729+0000","last_undegraded":"2024-08-18T22:23:53.253729+0000","last_fullsized":"2024-08-18T22:23:53.253729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:56.158170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.228814+0000","last_change":"2024-08-18T22:23:53.228814+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.228814+0000","last_undegraded":"2024-08-18T22:23:53.228814+0000","last_fullsized":"2024-08-18T22:23:53.228814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.246744+0000","last_change":"2024-08-18T22:23:53.242215+0000","last_active":"2024-08-18T22:23:53.246744+0000","last_peered":"2024-08-18T22:23:53.246744+0000","last_clean":"2024-08-18T22:23:53.246744+0000","last_became_active":"2024-08-18T22:23:53.241900+0000","last_became_peered":"2024-08-18T22:23:53.241900+0000","last_unstale":"2024-08-18T22:23:53.246744+0000","last_undegraded":"2024-08-18T22:23:53.246744+0000","last_fullsized":"2024-08-18T22:23:53.246744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:17:30.070215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":290,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.229413+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:23:53.229413+0000","last_peered":"2024-08-18T22:23:53.229413+0000","last_clean":"2024-08-18T22:23:53.229413+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:23:53.229413+0000","last_undegraded":"2024-08-18T22:23:53.229413+0000","last_fullsized":"2024-08-18T22:23:53.229413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1564672,"data_stored":1034301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":958464,"data_stored":437266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":958464,"data_stored":437266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40452,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331388,"statfs":{"total":96636764160,"available":96595341312,"internally_reserved":0,"allocated":970752,"data_stored":443933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40440,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331400,"statfs":{"total":96636764160,"available":96595353600,"internally_reserved":0,"allocated":958464,"data_stored":437266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41020,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330820,"statfs":{"total":96636764160,"available":96594759680,"internally_reserved":0,"allocated":1552384,"data_stored":1027634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1015808,"data_stored":459508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1007616,"data_stored":458534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:23:58.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:23:58.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.554+0000 7fa0bc800640 1 Processor -- start 2024-08-18T22:23:58.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.554+0000 7fa0bc800640 1 -- start start 2024-08-18T22:23:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0bc800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0b415b010 0x7fa0b40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0bc800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0b406f290 0x7fa0b4072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0bc800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b40cee20 con 0x7fa0b40cd3a0 2024-08-18T22:23:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0bc800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b40cfa30 con 0x7fa0b415b010 2024-08-18T22:23:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0bc800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b40cf100 con 0x7fa0b406f290 2024-08-18T22:23:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0b9e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0b415b010 0x7fa0b40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0b9400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa0b40cd3a0 0x7fa0b406eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45600/0 (socket says 172.21.15.5:45600) 2024-08-18T22:23:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0b9e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0b415b010 0x7fa0b40ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45230/0 (socket says 172.21.15.5:45230) 2024-08-18T22:23:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0b9400640 1 -- 172.21.15.5:0/757442694 learned_addr learned my addr 172.21.15.5:0/757442694 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:23:58.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0b9e00640 1 -- 172.21.15.5:0/757442694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0b406f290 msgr2=0x7fa0b4072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:58.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0ba800640 1 --2- 172.21.15.5:0/757442694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0b406f290 0x7fa0b4072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0b9e00640 1 --2- 172.21.15.5:0/757442694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0b406f290 0x7fa0b4072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0b9e00640 1 -- 172.21.15.5:0/757442694 >> v1:172.21.15.5:6789/0 conn(0x7fa0b40cd3a0 legacy=0x7fa0b406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0b8a00640 1 -- 172.21.15.5:0/757442694 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087793726 0 0) 0x7fa0b40cee20 con 0x7fa0b40cd3a0 2024-08-18T22:23:58.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.558+0000 7fa0b9e00640 1 -- 172.21.15.5:0/757442694 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b40cf3e0 con 0x7fa0b415b010 2024-08-18T22:23:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0b9e00640 1 --2- 172.21.15.5:0/757442694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b415b010 0x7fa0b40ce840 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80097c0 tx=0x7fa0a801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3fdb4e23b1ae7e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0b8a00640 1 -- 172.21.15.5:0/757442694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80aa5f0 con 0x7fa0b415b010 2024-08-18T22:23:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0b8a00640 1 -- 172.21.15.5:0/757442694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a80af070 con 0x7fa0b415b010 2024-08-18T22:23:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0b8a00640 1 -- 172.21.15.5:0/757442694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80aa9b0 con 0x7fa0b415b010 2024-08-18T22:23:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 -- 172.21.15.5:0/757442694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b415b010 msgr2=0x7fa0b40ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 --2- 172.21.15.5:0/757442694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b415b010 0x7fa0b40ce840 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80097c0 tx=0x7fa0a801c470 comp rx=0 tx=0).stop 2024-08-18T22:23:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 -- 172.21.15.5:0/757442694 shutdown_connections 2024-08-18T22:23:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 --2- 172.21.15.5:0/757442694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0b406f290 0x7fa0b4072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 --2- 172.21.15.5:0/757442694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b415b010 0x7fa0b40ce840 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 -- 172.21.15.5:0/757442694 >> 172.21.15.5:0/757442694 conn(0x7fa0b40b1c50 msgr2=0x7fa0b40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 -- 172.21.15.5:0/757442694 shutdown_connections 2024-08-18T22:23:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 -- 172.21.15.5:0/757442694 wait complete. 2024-08-18T22:23:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 Processor -- start 2024-08-18T22:23:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 -- start start 2024-08-18T22:23:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b406f290 0x7fa0b40aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b40cd3a0 0x7fa0b4143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0b415b010 0x7fa0b40c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b40734f0 con 0x7fa0b406f290 2024-08-18T22:23:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.562+0000 7fa0bc800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4073370 con 0x7fa0b40cd3a0 2024-08-18T22:23:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0bc800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b4073670 con 0x7fa0b415b010 2024-08-18T22:23:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0b9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b406f290 0x7fa0b40aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0b9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b406f290 0x7fa0b40aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45232/0 (socket says 172.21.15.5:45232) 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0b9e00640 1 -- 172.21.15.5:0/2193170885 learned_addr learned my addr 172.21.15.5:0/2193170885 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0b9400640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b40cd3a0 0x7fa0b4143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0ba800640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0b415b010 0x7fa0b40c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0b9e00640 1 -- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0b415b010 msgr2=0x7fa0b40c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0b9e00640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0b415b010 0x7fa0b40c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0b9e00640 1 -- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b40cd3a0 msgr2=0x7fa0b4143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0b9e00640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b40cd3a0 0x7fa0b4143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0b9e00640 1 -- 172.21.15.5:0/2193170885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b4159e70 con 0x7fa0b406f290 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0ba800640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0b415b010 0x7fa0b40c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0b9400640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b40cd3a0 0x7fa0b4143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0b9e00640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b406f290 0x7fa0b40aee40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80ac040 tx=0x7fa0a801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0ae000640 1 -- 172.21.15.5:0/2193170885 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80be610 con 0x7fa0b406f290 2024-08-18T22:23:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0ae000640 1 -- 172.21.15.5:0/2193170885 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a80be7f0 con 0x7fa0b406f290 2024-08-18T22:23:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0ae000640 1 -- 172.21.15.5:0/2193170885 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80bebe0 con 0x7fa0b406f290 2024-08-18T22:23:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0bc800640 1 -- 172.21.15.5:0/2193170885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b415a110 con 0x7fa0b406f290 2024-08-18T22:23:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0bc800640 1 -- 172.21.15.5:0/2193170885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b4143e70 con 0x7fa0b406f290 2024-08-18T22:23:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0bc800640 1 -- 172.21.15.5:0/2193170885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b4072620 con 0x7fa0b406f290 2024-08-18T22:23:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.566+0000 7fa0ae000640 1 -- 172.21.15.5:0/2193170885 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0a80bc020 con 0x7fa0b406f290 2024-08-18T22:23:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.570+0000 7fa0ae000640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0980678c0 0x7fa098069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.570+0000 7fa0ae000640 1 -- 172.21.15.5:0/2193170885 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7fa0a81201c0 con 0x7fa0b406f290 2024-08-18T22:23:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.570+0000 7fa0b9400640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0980678c0 0x7fa098069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.570+0000 7fa0b9400640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0980678c0 0x7fa098069d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa0b41fa4a0 tx=0x7fa0a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:58.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.574+0000 7fa0ae000640 1 -- 172.21.15.5:0/2193170885 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa0a80c5030 con 0x7fa0b406f290 2024-08-18T22:23:58.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.734+0000 7fa0bc800640 1 -- 172.21.15.5:0/2193170885 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0b40b1320 con 0x7fa0980678c0 2024-08-18T22:23:58.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.738+0000 7fa0ae000640 1 -- 172.21.15.5:0/2193170885 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248184 (secure 0 0 0) 0x7fa0b40b1320 con 0x7fa0980678c0 2024-08-18T22:23:58.742 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:58.743 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:23:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 -- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0980678c0 msgr2=0x7fa098069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0980678c0 0x7fa098069d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa0b41fa4a0 tx=0x7fa0a4009040 comp rx=0 tx=0).stop 2024-08-18T22:23:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 -- 172.21.15.5:0/2193170885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b406f290 msgr2=0x7fa0b40aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b406f290 0x7fa0b40aee40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80ac040 tx=0x7fa0a801acb0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 -- 172.21.15.5:0/2193170885 shutdown_connections 2024-08-18T22:23:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0980678c0 0x7fa098069d80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0b415b010 0x7fa0b40c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0b40cd3a0 0x7fa0b4143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 --2- 172.21.15.5:0/2193170885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b406f290 0x7fa0b40aee40 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 -- 172.21.15.5:0/2193170885 >> 172.21.15.5:0/2193170885 conn(0x7fa0b40b1c50 msgr2=0x7fa0b406da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:58.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 -- 172.21.15.5:0/2193170885 shutdown_connections 2024-08-18T22:23:58.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.742+0000 7fa0bc800640 1 -- 172.21.15.5:0/2193170885 wait complete. 2024-08-18T22:23:58.763 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-08-18T22:23:57.686563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":308168,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754666552,"statfs":{"total":773094113280,"available":772778549248,"internally_reserved":0,"allocated":8986624,"data_stored":4735708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.465341"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.230493+0000","last_change":"2024-08-18T22:23:53.230493+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.230493+0000","last_undegraded":"2024-08-18T22:23:53.230493+0000","last_fullsized":"2024-08-18T22:23:53.230493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.241252+0000","last_change":"2024-08-18T22:23:53.241252+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.241252+0000","last_undegraded":"2024-08-18T22:23:53.241252+0000","last_fullsized":"2024-08-18T22:23:53.241252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240562+0000","last_change":"2024-08-18T22:23:53.240562+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240562+0000","last_undegraded":"2024-08-18T22:23:53.240562+0000","last_fullsized":"2024-08-18T22:23:53.240562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236364+0000","last_change":"2024-08-18T22:23:53.236364+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236364+0000","last_undegraded":"2024-08-18T22:23:53.236364+0000","last_fullsized":"2024-08-18T22:23:53.236364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264328+0000","last_change":"2024-08-18T22:23:54.255429+0000","last_active":"2024-08-18T22:23:55.264328+0000","last_peered":"2024-08-18T22:23:55.264328+0000","last_clean":"2024-08-18T22:23:55.264328+0000","last_became_active":"2024-08-18T22:23:54.254830+0000","last_became_peered":"2024-08-18T22:23:54.254830+0000","last_unstale":"2024-08-18T22:23:55.264328+0000","last_undegraded":"2024-08-18T22:23:55.264328+0000","last_fullsized":"2024-08-18T22:23:55.264328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:49.556352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233225+0000","last_change":"2024-08-18T22:23:53.233225+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233225+0000","last_undegraded":"2024-08-18T22:23:53.233225+0000","last_fullsized":"2024-08-18T22:23:53.233225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232999+0000","last_change":"2024-08-18T22:23:53.232999+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232999+0000","last_undegraded":"2024-08-18T22:23:53.232999+0000","last_fullsized":"2024-08-18T22:23:53.232999+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.263983+0000","last_change":"2024-08-18T22:23:54.253390+0000","last_active":"2024-08-18T22:23:55.263983+0000","last_peered":"2024-08-18T22:23:55.263983+0000","last_clean":"2024-08-18T22:23:55.263983+0000","last_became_active":"2024-08-18T22:23:54.253085+0000","last_became_peered":"2024-08-18T22:23:54.253085+0000","last_unstale":"2024-08-18T22:23:55.263983+0000","last_undegraded":"2024-08-18T22:23:55.263983+0000","last_fullsized":"2024-08-18T22:23:55.263983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:14.303897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261466+0000","last_change":"2024-08-18T22:23:54.258688+0000","last_active":"2024-08-18T22:23:55.261466+0000","last_peered":"2024-08-18T22:23:55.261466+0000","last_clean":"2024-08-18T22:23:55.261466+0000","last_became_active":"2024-08-18T22:23:54.258436+0000","last_became_peered":"2024-08-18T22:23:54.258436+0000","last_unstale":"2024-08-18T22:23:55.261466+0000","last_undegraded":"2024-08-18T22:23:55.261466+0000","last_fullsized":"2024-08-18T22:23:55.261466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:10.210409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236519+0000","last_change":"2024-08-18T22:23:53.236519+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236519+0000","last_undegraded":"2024-08-18T22:23:53.236519+0000","last_fullsized":"2024-08-18T22:23:53.236519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236929+0000","last_change":"2024-08-18T22:23:53.236929+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236929+0000","last_undegraded":"2024-08-18T22:23:53.236929+0000","last_fullsized":"2024-08-18T22:23:53.236929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.235970+0000","last_change":"2024-08-18T22:23:53.235970+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.235970+0000","last_undegraded":"2024-08-18T22:23:53.235970+0000","last_fullsized":"2024-08-18T22:23:53.235970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264361+0000","last_change":"2024-08-18T22:23:54.254445+0000","last_active":"2024-08-18T22:23:55.264361+0000","last_peered":"2024-08-18T22:23:55.264361+0000","last_clean":"2024-08-18T22:23:55.264361+0000","last_became_active":"2024-08-18T22:23:54.254125+0000","last_became_peered":"2024-08-18T22:23:54.254125+0000","last_unstale":"2024-08-18T22:23:55.264361+0000","last_undegraded":"2024-08-18T22:23:55.264361+0000","last_fullsized":"2024-08-18T22:23:55.264361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:07.096296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232663+0000","last_change":"2024-08-18T22:23:53.232663+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232663+0000","last_undegraded":"2024-08-18T22:23:53.232663+0000","last_fullsized":"2024-08-18T22:23:53.232663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.239293+0000","last_change":"2024-08-18T22:23:53.239293+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.239293+0000","last_undegraded":"2024-08-18T22:23:53.239293+0000","last_fullsized":"2024-08-18T22:23:53.239293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.229183+0000","last_change":"2024-08-18T22:23:53.229183+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.229183+0000","last_undegraded":"2024-08-18T22:23:53.229183+0000","last_fullsized":"2024-08-18T22:23:53.229183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264661+0000","last_change":"2024-08-18T22:23:54.259132+0000","last_active":"2024-08-18T22:23:55.264661+0000","last_peered":"2024-08-18T22:23:55.264661+0000","last_clean":"2024-08-18T22:23:55.264661+0000","last_became_active":"2024-08-18T22:23:54.258811+0000","last_became_peered":"2024-08-18T22:23:54.258811+0000","last_unstale":"2024-08-18T22:23:55.264661+0000","last_undegraded":"2024-08-18T22:23:55.264661+0000","last_fullsized":"2024-08-18T22:23:55.264661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:48.771970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240676+0000","last_change":"2024-08-18T22:23:53.240676+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240676+0000","last_undegraded":"2024-08-18T22:23:53.240676+0000","last_fullsized":"2024-08-18T22:23:53.240676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231041+0000","last_change":"2024-08-18T22:23:53.231041+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231041+0000","last_undegraded":"2024-08-18T22:23:53.231041+0000","last_fullsized":"2024-08-18T22:23:53.231041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264433+0000","last_change":"2024-08-18T22:23:54.262936+0000","last_active":"2024-08-18T22:23:55.264433+0000","last_peered":"2024-08-18T22:23:55.264433+0000","last_clean":"2024-08-18T22:23:55.264433+0000","last_became_active":"2024-08-18T22:23:54.262665+0000","last_became_peered":"2024-08-18T22:23:54.262665+0000","last_unstale":"2024-08-18T22:23:55.264433+0000","last_undegraded":"2024-08-18T22:23:55.264433+0000","last_fullsized":"2024-08-18T22:23:55.264433+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:34.017166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261382+0000","last_change":"2024-08-18T22:23:54.267084+0000","last_active":"2024-08-18T22:23:55.261382+0000","last_peered":"2024-08-18T22:23:55.261382+0000","last_clean":"2024-08-18T22:23:55.261382+0000","last_became_active":"2024-08-18T22:23:54.266792+0000","last_became_peered":"2024-08-18T22:23:54.266792+0000","last_unstale":"2024-08-18T22:23:55.261382+0000","last_undegraded":"2024-08-18T22:23:55.261382+0000","last_fullsized":"2024-08-18T22:23:55.261382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:27:37.035990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264190+0000","last_change":"2024-08-18T22:23:54.262252+0000","last_active":"2024-08-18T22:23:55.264190+0000","last_peered":"2024-08-18T22:23:55.264190+0000","last_clean":"2024-08-18T22:23:55.264190+0000","last_became_active":"2024-08-18T22:23:54.261976+0000","last_became_peered":"2024-08-18T22:23:54.261976+0000","last_unstale":"2024-08-18T22:23:55.264190+0000","last_undegraded":"2024-08-18T22:23:55.264190+0000","last_fullsized":"2024-08-18T22:23:55.264190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:27.688388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261229+0000","last_change":"2024-08-18T22:23:54.269243+0000","last_active":"2024-08-18T22:23:55.261229+0000","last_peered":"2024-08-18T22:23:55.261229+0000","last_clean":"2024-08-18T22:23:55.261229+0000","last_became_active":"2024-08-18T22:23:54.268935+0000","last_became_peered":"2024-08-18T22:23:54.268935+0000","last_unstale":"2024-08-18T22:23:55.261229+0000","last_undegraded":"2024-08-18T22:23:55.261229+0000","last_fullsized":"2024-08-18T22:23:55.261229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:56:07.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236717+0000","last_change":"2024-08-18T22:23:53.236717+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236717+0000","last_undegraded":"2024-08-18T22:23:53.236717+0000","last_fullsized":"2024-08-18T22:23:53.236717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.237012+0000","last_change":"2024-08-18T22:23:53.237012+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.237012+0000","last_undegraded":"2024-08-18T22:23:53.237012+0000","last_fullsized":"2024-08-18T22:23:53.237012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233949+0000","last_change":"2024-08-18T22:23:53.233949+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233949+0000","last_undegraded":"2024-08-18T22:23:53.233949+0000","last_fullsized":"2024-08-18T22:23:53.233949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.229370+0000","last_change":"2024-08-18T22:23:53.229370+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.229370+0000","last_undegraded":"2024-08-18T22:23:53.229370+0000","last_fullsized":"2024-08-18T22:23:53.229370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264452+0000","last_change":"2024-08-18T22:23:54.269533+0000","last_active":"2024-08-18T22:23:55.264452+0000","last_peered":"2024-08-18T22:23:55.264452+0000","last_clean":"2024-08-18T22:23:55.264452+0000","last_became_active":"2024-08-18T22:23:54.269250+0000","last_became_peered":"2024-08-18T22:23:54.269250+0000","last_unstale":"2024-08-18T22:23:55.264452+0000","last_undegraded":"2024-08-18T22:23:55.264452+0000","last_fullsized":"2024-08-18T22:23:55.264452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:38:29.318017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234548+0000","last_change":"2024-08-18T22:23:53.234548+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234548+0000","last_undegraded":"2024-08-18T22:23:53.234548+0000","last_fullsized":"2024-08-18T22:23:53.234548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.227692+0000","last_change":"2024-08-18T22:23:53.227692+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.227692+0000","last_undegraded":"2024-08-18T22:23:53.227692+0000","last_fullsized":"2024-08-18T22:23:53.227692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240371+0000","last_change":"2024-08-18T22:23:53.240371+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240371+0000","last_undegraded":"2024-08-18T22:23:53.240371+0000","last_fullsized":"2024-08-18T22:23:53.240371+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.227548+0000","last_change":"2024-08-18T22:23:53.227548+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.227548+0000","last_undegraded":"2024-08-18T22:23:53.227548+0000","last_fullsized":"2024-08-18T22:23:53.227548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.241056+0000","last_change":"2024-08-18T22:23:53.241056+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.241056+0000","last_undegraded":"2024-08-18T22:23:53.241056+0000","last_fullsized":"2024-08-18T22:23:53.241056+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264673+0000","last_change":"2024-08-18T22:23:53.251250+0000","last_active":"2024-08-18T22:23:55.264673+0000","last_peered":"2024-08-18T22:23:55.264673+0000","last_clean":"2024-08-18T22:23:55.264673+0000","last_became_active":"2024-08-18T22:23:53.250935+0000","last_became_peered":"2024-08-18T22:23:53.250935+0000","last_unstale":"2024-08-18T22:23:55.264673+0000","last_undegraded":"2024-08-18T22:23:55.264673+0000","last_fullsized":"2024-08-18T22:23:55.264673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:44.891601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234357+0000","last_change":"2024-08-18T22:23:53.234357+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234357+0000","last_undegraded":"2024-08-18T22:23:53.234357+0000","last_fullsized":"2024-08-18T22:23:53.234357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249647+0000","last_change":"2024-08-18T22:23:53.245851+0000","last_active":"2024-08-18T22:23:53.249647+0000","last_peered":"2024-08-18T22:23:53.249647+0000","last_clean":"2024-08-18T22:23:53.249647+0000","last_became_active":"2024-08-18T22:23:53.245598+0000","last_became_peered":"2024-08-18T22:23:53.245598+0000","last_unstale":"2024-08-18T22:23:53.249647+0000","last_undegraded":"2024-08-18T22:23:53.249647+0000","last_fullsized":"2024-08-18T22:23:53.249647+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:08.045334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261043+0000","last_change":"2024-08-18T22:23:54.264243+0000","last_active":"2024-08-18T22:23:55.261043+0000","last_peered":"2024-08-18T22:23:55.261043+0000","last_clean":"2024-08-18T22:23:55.261043+0000","last_became_active":"2024-08-18T22:23:54.263437+0000","last_became_peered":"2024-08-18T22:23:54.263437+0000","last_unstale":"2024-08-18T22:23:55.261043+0000","last_undegraded":"2024-08-18T22:23:55.261043+0000","last_fullsized":"2024-08-18T22:23:55.261043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:02.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.251861+0000","last_change":"2024-08-18T22:23:53.249485+0000","last_active":"2024-08-18T22:23:53.251861+0000","last_peered":"2024-08-18T22:23:53.251861+0000","last_clean":"2024-08-18T22:23:53.251861+0000","last_became_active":"2024-08-18T22:23:53.248070+0000","last_became_peered":"2024-08-18T22:23:53.248070+0000","last_unstale":"2024-08-18T22:23:53.251861+0000","last_undegraded":"2024-08-18T22:23:53.251861+0000","last_fullsized":"2024-08-18T22:23:53.251861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:12.820159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261499+0000","last_change":"2024-08-18T22:23:54.266316+0000","last_active":"2024-08-18T22:23:55.261499+0000","last_peered":"2024-08-18T22:23:55.261499+0000","last_clean":"2024-08-18T22:23:55.261499+0000","last_became_active":"2024-08-18T22:23:54.265936+0000","last_became_peered":"2024-08-18T22:23:54.265936+0000","last_unstale":"2024-08-18T22:23:55.261499+0000","last_undegraded":"2024-08-18T22:23:55.261499+0000","last_fullsized":"2024-08-18T22:23:55.261499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:00:03.812617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248331+0000","last_change":"2024-08-18T22:23:53.243356+0000","last_active":"2024-08-18T22:23:53.248331+0000","last_peered":"2024-08-18T22:23:53.248331+0000","last_clean":"2024-08-18T22:23:53.248331+0000","last_became_active":"2024-08-18T22:23:53.243055+0000","last_became_peered":"2024-08-18T22:23:53.243055+0000","last_unstale":"2024-08-18T22:23:53.248331+0000","last_undegraded":"2024-08-18T22:23:53.248331+0000","last_fullsized":"2024-08-18T22:23:53.248331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:47.749438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234746+0000","last_change":"2024-08-18T22:23:53.234746+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234746+0000","last_undegraded":"2024-08-18T22:23:53.234746+0000","last_fullsized":"2024-08-18T22:23:53.234746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261622+0000","last_change":"2024-08-18T22:23:53.240275+0000","last_active":"2024-08-18T22:23:55.261622+0000","last_peered":"2024-08-18T22:23:55.261622+0000","last_clean":"2024-08-18T22:23:55.261622+0000","last_became_active":"2024-08-18T22:23:53.239803+0000","last_became_peered":"2024-08-18T22:23:53.239803+0000","last_unstale":"2024-08-18T22:23:55.261622+0000","last_undegraded":"2024-08-18T22:23:55.261622+0000","last_fullsized":"2024-08-18T22:23:55.261622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:22.345962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.235853+0000","last_change":"2024-08-18T22:23:53.235853+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.235853+0000","last_undegraded":"2024-08-18T22:23:53.235853+0000","last_fullsized":"2024-08-18T22:23:53.235853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249762+0000","last_change":"2024-08-18T22:23:53.247955+0000","last_active":"2024-08-18T22:23:53.249762+0000","last_peered":"2024-08-18T22:23:53.249762+0000","last_clean":"2024-08-18T22:23:53.249762+0000","last_became_active":"2024-08-18T22:23:53.246744+0000","last_became_peered":"2024-08-18T22:23:53.246744+0000","last_unstale":"2024-08-18T22:23:53.249762+0000","last_undegraded":"2024-08-18T22:23:53.249762+0000","last_fullsized":"2024-08-18T22:23:53.249762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:14:00.588346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261582+0000","last_change":"2024-08-18T22:23:54.257636+0000","last_active":"2024-08-18T22:23:55.261582+0000","last_peered":"2024-08-18T22:23:55.261582+0000","last_clean":"2024-08-18T22:23:55.261582+0000","last_became_active":"2024-08-18T22:23:54.257280+0000","last_became_peered":"2024-08-18T22:23:54.257280+0000","last_unstale":"2024-08-18T22:23:55.261582+0000","last_undegraded":"2024-08-18T22:23:55.261582+0000","last_fullsized":"2024-08-18T22:23:55.261582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:50.911549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.246752+0000","last_change":"2024-08-18T22:23:53.245559+0000","last_active":"2024-08-18T22:23:53.246752+0000","last_peered":"2024-08-18T22:23:53.246752+0000","last_clean":"2024-08-18T22:23:53.246752+0000","last_became_active":"2024-08-18T22:23:53.245269+0000","last_became_peered":"2024-08-18T22:23:53.245269+0000","last_unstale":"2024-08-18T22:23:53.246752+0000","last_undegraded":"2024-08-18T22:23:53.246752+0000","last_fullsized":"2024-08-18T22:23:53.246752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:17.284982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232457+0000","last_change":"2024-08-18T22:23:53.232457+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232457+0000","last_undegraded":"2024-08-18T22:23:53.232457+0000","last_fullsized":"2024-08-18T22:23:53.232457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264053+0000","last_change":"2024-08-18T22:23:53.246914+0000","last_active":"2024-08-18T22:23:55.264053+0000","last_peered":"2024-08-18T22:23:55.264053+0000","last_clean":"2024-08-18T22:23:55.264053+0000","last_became_active":"2024-08-18T22:23:53.246609+0000","last_became_peered":"2024-08-18T22:23:53.246609+0000","last_unstale":"2024-08-18T22:23:55.264053+0000","last_undegraded":"2024-08-18T22:23:55.264053+0000","last_fullsized":"2024-08-18T22:23:55.264053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:49.756736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233504+0000","last_change":"2024-08-18T22:23:53.233504+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233504+0000","last_undegraded":"2024-08-18T22:23:53.233504+0000","last_fullsized":"2024-08-18T22:23:53.233504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249317+0000","last_change":"2024-08-18T22:23:53.242509+0000","last_active":"2024-08-18T22:23:53.249317+0000","last_peered":"2024-08-18T22:23:53.249317+0000","last_clean":"2024-08-18T22:23:53.249317+0000","last_became_active":"2024-08-18T22:23:53.242205+0000","last_became_peered":"2024-08-18T22:23:53.242205+0000","last_unstale":"2024-08-18T22:23:53.249317+0000","last_undegraded":"2024-08-18T22:23:53.249317+0000","last_fullsized":"2024-08-18T22:23:53.249317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:11:00.515699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232617+0000","last_change":"2024-08-18T22:23:53.232617+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232617+0000","last_undegraded":"2024-08-18T22:23:53.232617+0000","last_fullsized":"2024-08-18T22:23:53.232617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249198+0000","last_change":"2024-08-18T22:23:53.245330+0000","last_active":"2024-08-18T22:23:53.249198+0000","last_peered":"2024-08-18T22:23:53.249198+0000","last_clean":"2024-08-18T22:23:53.249198+0000","last_became_active":"2024-08-18T22:23:53.243674+0000","last_became_peered":"2024-08-18T22:23:53.243674+0000","last_unstale":"2024-08-18T22:23:53.249198+0000","last_undegraded":"2024-08-18T22:23:53.249198+0000","last_fullsized":"2024-08-18T22:23:53.249198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:36.794334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.230747+0000","last_change":"2024-08-18T22:23:53.230747+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.230747+0000","last_undegraded":"2024-08-18T22:23:53.230747+0000","last_fullsized":"2024-08-18T22:23:53.230747+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264611+0000","last_change":"2024-08-18T22:23:53.249062+0000","last_active":"2024-08-18T22:23:55.264611+0000","last_peered":"2024-08-18T22:23:55.264611+0000","last_clean":"2024-08-18T22:23:55.264611+0000","last_became_active":"2024-08-18T22:23:53.248766+0000","last_became_peered":"2024-08-18T22:23:53.248766+0000","last_unstale":"2024-08-18T22:23:55.264611+0000","last_undegraded":"2024-08-18T22:23:55.264611+0000","last_fullsized":"2024-08-18T22:23:55.264611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:51.713170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240393+0000","last_change":"2024-08-18T22:23:53.240393+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240393+0000","last_undegraded":"2024-08-18T22:23:53.240393+0000","last_fullsized":"2024-08-18T22:23:53.240393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249672+0000","last_change":"2024-08-18T22:23:53.245872+0000","last_active":"2024-08-18T22:23:53.249672+0000","last_peered":"2024-08-18T22:23:53.249672+0000","last_clean":"2024-08-18T22:23:53.249672+0000","last_became_active":"2024-08-18T22:23:53.245598+0000","last_became_peered":"2024-08-18T22:23:53.245598+0000","last_unstale":"2024-08-18T22:23:53.249672+0000","last_undegraded":"2024-08-18T22:23:53.249672+0000","last_fullsized":"2024-08-18T22:23:53.249672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:37:37.435949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233341+0000","last_change":"2024-08-18T22:23:53.233341+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233341+0000","last_undegraded":"2024-08-18T22:23:53.233341+0000","last_fullsized":"2024-08-18T22:23:53.233341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249779+0000","last_change":"2024-08-18T22:23:53.247110+0000","last_active":"2024-08-18T22:23:53.249779+0000","last_peered":"2024-08-18T22:23:53.249779+0000","last_clean":"2024-08-18T22:23:53.249779+0000","last_became_active":"2024-08-18T22:23:53.245877+0000","last_became_peered":"2024-08-18T22:23:53.245877+0000","last_unstale":"2024-08-18T22:23:53.249779+0000","last_undegraded":"2024-08-18T22:23:53.249779+0000","last_fullsized":"2024-08-18T22:23:53.249779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:44:37.965015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232323+0000","last_change":"2024-08-18T22:23:53.232323+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232323+0000","last_undegraded":"2024-08-18T22:23:53.232323+0000","last_fullsized":"2024-08-18T22:23:53.232323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249279+0000","last_change":"2024-08-18T22:23:53.241741+0000","last_active":"2024-08-18T22:23:53.249279+0000","last_peered":"2024-08-18T22:23:53.249279+0000","last_clean":"2024-08-18T22:23:53.249279+0000","last_became_active":"2024-08-18T22:23:53.241388+0000","last_became_peered":"2024-08-18T22:23:53.241388+0000","last_unstale":"2024-08-18T22:23:53.249279+0000","last_undegraded":"2024-08-18T22:23:53.249279+0000","last_fullsized":"2024-08-18T22:23:53.249279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:14:00.588346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.237680+0000","last_change":"2024-08-18T22:23:53.237680+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.237680+0000","last_undegraded":"2024-08-18T22:23:53.237680+0000","last_fullsized":"2024-08-18T22:23:53.237680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264098+0000","last_change":"2024-08-18T22:23:53.251780+0000","last_active":"2024-08-18T22:23:55.264098+0000","last_peered":"2024-08-18T22:23:55.264098+0000","last_clean":"2024-08-18T22:23:55.264098+0000","last_became_active":"2024-08-18T22:23:53.251524+0000","last_became_peered":"2024-08-18T22:23:53.251524+0000","last_unstale":"2024-08-18T22:23:55.264098+0000","last_undegraded":"2024-08-18T22:23:55.264098+0000","last_fullsized":"2024-08-18T22:23:55.264098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:01.049290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231938+0000","last_change":"2024-08-18T22:23:53.231938+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231938+0000","last_undegraded":"2024-08-18T22:23:53.231938+0000","last_fullsized":"2024-08-18T22:23:53.231938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.252580+0000","last_change":"2024-08-18T22:23:53.250165+0000","last_active":"2024-08-18T22:23:53.252580+0000","last_peered":"2024-08-18T22:23:53.252580+0000","last_clean":"2024-08-18T22:23:53.252580+0000","last_became_active":"2024-08-18T22:23:53.249889+0000","last_became_peered":"2024-08-18T22:23:53.249889+0000","last_unstale":"2024-08-18T22:23:53.252580+0000","last_undegraded":"2024-08-18T22:23:53.252580+0000","last_fullsized":"2024-08-18T22:23:53.252580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:19:45.657386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231460+0000","last_change":"2024-08-18T22:23:53.231460+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231460+0000","last_undegraded":"2024-08-18T22:23:53.231460+0000","last_fullsized":"2024-08-18T22:23:53.231460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249372+0000","last_change":"2024-08-18T22:23:53.243095+0000","last_active":"2024-08-18T22:23:53.249372+0000","last_peered":"2024-08-18T22:23:53.249372+0000","last_clean":"2024-08-18T22:23:53.249372+0000","last_became_active":"2024-08-18T22:23:53.242833+0000","last_became_peered":"2024-08-18T22:23:53.242833+0000","last_unstale":"2024-08-18T22:23:53.249372+0000","last_undegraded":"2024-08-18T22:23:53.249372+0000","last_fullsized":"2024-08-18T22:23:53.249372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:17.284982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264113+0000","last_change":"2024-08-18T22:23:54.259286+0000","last_active":"2024-08-18T22:23:55.264113+0000","last_peered":"2024-08-18T22:23:55.264113+0000","last_clean":"2024-08-18T22:23:55.264113+0000","last_became_active":"2024-08-18T22:23:54.258960+0000","last_became_peered":"2024-08-18T22:23:54.258960+0000","last_unstale":"2024-08-18T22:23:55.264113+0000","last_undegraded":"2024-08-18T22:23:55.264113+0000","last_fullsized":"2024-08-18T22:23:55.264113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:48.497587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261682+0000","last_change":"2024-08-18T22:23:53.241158+0000","last_active":"2024-08-18T22:23:55.261682+0000","last_peered":"2024-08-18T22:23:55.261682+0000","last_clean":"2024-08-18T22:23:55.261682+0000","last_became_active":"2024-08-18T22:23:53.240859+0000","last_became_peered":"2024-08-18T22:23:53.240859+0000","last_unstale":"2024-08-18T22:23:55.261682+0000","last_undegraded":"2024-08-18T22:23:55.261682+0000","last_fullsized":"2024-08-18T22:23:55.261682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:41.985620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264192+0000","last_change":"2024-08-18T22:23:54.271013+0000","last_active":"2024-08-18T22:23:55.264192+0000","last_peered":"2024-08-18T22:23:55.264192+0000","last_clean":"2024-08-18T22:23:55.264192+0000","last_became_active":"2024-08-18T22:23:54.270715+0000","last_became_peered":"2024-08-18T22:23:54.270715+0000","last_unstale":"2024-08-18T22:23:55.264192+0000","last_undegraded":"2024-08-18T22:23:55.264192+0000","last_fullsized":"2024-08-18T22:23:55.264192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:18:11.045700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264616+0000","last_change":"2024-08-18T22:23:53.246903+0000","last_active":"2024-08-18T22:23:55.264616+0000","last_peered":"2024-08-18T22:23:55.264616+0000","last_clean":"2024-08-18T22:23:55.264616+0000","last_became_active":"2024-08-18T22:23:53.246619+0000","last_became_peered":"2024-08-18T22:23:53.246619+0000","last_unstale":"2024-08-18T22:23:55.264616+0000","last_undegraded":"2024-08-18T22:23:55.264616+0000","last_fullsized":"2024-08-18T22:23:55.264616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:33:39.529484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.230795+0000","last_change":"2024-08-18T22:23:53.230795+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.230795+0000","last_undegraded":"2024-08-18T22:23:53.230795+0000","last_fullsized":"2024-08-18T22:23:53.230795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.251325+0000","last_change":"2024-08-18T22:23:53.250046+0000","last_active":"2024-08-18T22:23:53.251325+0000","last_peered":"2024-08-18T22:23:53.251325+0000","last_clean":"2024-08-18T22:23:53.251325+0000","last_became_active":"2024-08-18T22:23:53.246620+0000","last_became_peered":"2024-08-18T22:23:53.246620+0000","last_unstale":"2024-08-18T22:23:53.251325+0000","last_undegraded":"2024-08-18T22:23:53.251325+0000","last_fullsized":"2024-08-18T22:23:53.251325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:38:26.142335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234215+0000","last_change":"2024-08-18T22:23:53.234215+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234215+0000","last_undegraded":"2024-08-18T22:23:53.234215+0000","last_fullsized":"2024-08-18T22:23:53.234215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.246712+0000","last_change":"2024-08-18T22:23:53.242322+0000","last_active":"2024-08-18T22:23:53.246712+0000","last_peered":"2024-08-18T22:23:53.246712+0000","last_clean":"2024-08-18T22:23:53.246712+0000","last_became_active":"2024-08-18T22:23:53.241981+0000","last_became_peered":"2024-08-18T22:23:53.241981+0000","last_unstale":"2024-08-18T22:23:53.246712+0000","last_undegraded":"2024-08-18T22:23:53.246712+0000","last_fullsized":"2024-08-18T22:23:53.246712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:35:24.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236584+0000","last_change":"2024-08-18T22:23:53.236584+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236584+0000","last_undegraded":"2024-08-18T22:23:53.236584+0000","last_fullsized":"2024-08-18T22:23:53.236584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249057+0000","last_change":"2024-08-18T22:23:53.239454+0000","last_active":"2024-08-18T22:23:53.249057+0000","last_peered":"2024-08-18T22:23:53.249057+0000","last_clean":"2024-08-18T22:23:53.249057+0000","last_became_active":"2024-08-18T22:23:53.239189+0000","last_became_peered":"2024-08-18T22:23:53.239189+0000","last_unstale":"2024-08-18T22:23:53.249057+0000","last_undegraded":"2024-08-18T22:23:53.249057+0000","last_fullsized":"2024-08-18T22:23:53.249057+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:33:00.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231336+0000","last_change":"2024-08-18T22:23:53.231336+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231336+0000","last_undegraded":"2024-08-18T22:23:53.231336+0000","last_fullsized":"2024-08-18T22:23:53.231336+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248159+0000","last_change":"2024-08-18T22:23:53.247190+0000","last_active":"2024-08-18T22:23:53.248159+0000","last_peered":"2024-08-18T22:23:53.248159+0000","last_clean":"2024-08-18T22:23:53.248159+0000","last_became_active":"2024-08-18T22:23:53.244049+0000","last_became_peered":"2024-08-18T22:23:53.244049+0000","last_unstale":"2024-08-18T22:23:53.248159+0000","last_undegraded":"2024-08-18T22:23:53.248159+0000","last_fullsized":"2024-08-18T22:23:53.248159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:21.605699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260839+0000","last_change":"2024-08-18T22:23:54.259872+0000","last_active":"2024-08-18T22:23:55.260839+0000","last_peered":"2024-08-18T22:23:55.260839+0000","last_clean":"2024-08-18T22:23:55.260839+0000","last_became_active":"2024-08-18T22:23:54.259633+0000","last_became_peered":"2024-08-18T22:23:54.259633+0000","last_unstale":"2024-08-18T22:23:55.260839+0000","last_undegraded":"2024-08-18T22:23:55.260839+0000","last_fullsized":"2024-08-18T22:23:55.260839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:12.200171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248944+0000","last_change":"2024-08-18T22:23:53.246134+0000","last_active":"2024-08-18T22:23:53.248944+0000","last_peered":"2024-08-18T22:23:53.248944+0000","last_clean":"2024-08-18T22:23:53.248944+0000","last_became_active":"2024-08-18T22:23:53.245585+0000","last_became_peered":"2024-08-18T22:23:53.245585+0000","last_unstale":"2024-08-18T22:23:53.248944+0000","last_undegraded":"2024-08-18T22:23:53.248944+0000","last_fullsized":"2024-08-18T22:23:53.248944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:48.980834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232242+0000","last_change":"2024-08-18T22:23:53.232242+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232242+0000","last_undegraded":"2024-08-18T22:23:53.232242+0000","last_fullsized":"2024-08-18T22:23:53.232242+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.255640+0000","last_change":"2024-08-18T22:23:53.255034+0000","last_active":"2024-08-18T22:23:53.255640+0000","last_peered":"2024-08-18T22:23:53.255640+0000","last_clean":"2024-08-18T22:23:53.255640+0000","last_became_active":"2024-08-18T22:23:53.254449+0000","last_became_peered":"2024-08-18T22:23:53.254449+0000","last_unstale":"2024-08-18T22:23:53.255640+0000","last_undegraded":"2024-08-18T22:23:53.255640+0000","last_fullsized":"2024-08-18T22:23:53.255640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:08.045334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261122+0000","last_change":"2024-08-18T22:23:54.263284+0000","last_active":"2024-08-18T22:23:55.261122+0000","last_peered":"2024-08-18T22:23:55.261122+0000","last_clean":"2024-08-18T22:23:55.261122+0000","last_became_active":"2024-08-18T22:23:54.262747+0000","last_became_peered":"2024-08-18T22:23:54.262747+0000","last_unstale":"2024-08-18T22:23:55.261122+0000","last_undegraded":"2024-08-18T22:23:55.261122+0000","last_fullsized":"2024-08-18T22:23:55.261122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:51:52.385446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249815+0000","last_change":"2024-08-18T22:23:53.240247+0000","last_active":"2024-08-18T22:23:53.249815+0000","last_peered":"2024-08-18T22:23:53.249815+0000","last_clean":"2024-08-18T22:23:53.249815+0000","last_became_active":"2024-08-18T22:23:53.239551+0000","last_became_peered":"2024-08-18T22:23:53.239551+0000","last_unstale":"2024-08-18T22:23:53.249815+0000","last_undegraded":"2024-08-18T22:23:53.249815+0000","last_fullsized":"2024-08-18T22:23:53.249815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:44:37.965015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234138+0000","last_change":"2024-08-18T22:23:53.234138+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234138+0000","last_undegraded":"2024-08-18T22:23:53.234138+0000","last_fullsized":"2024-08-18T22:23:53.234138+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249533+0000","last_change":"2024-08-18T22:23:53.244792+0000","last_active":"2024-08-18T22:23:53.249533+0000","last_peered":"2024-08-18T22:23:53.249533+0000","last_clean":"2024-08-18T22:23:53.249533+0000","last_became_active":"2024-08-18T22:23:53.244310+0000","last_became_peered":"2024-08-18T22:23:53.244310+0000","last_unstale":"2024-08-18T22:23:53.249533+0000","last_undegraded":"2024-08-18T22:23:53.249533+0000","last_fullsized":"2024-08-18T22:23:53.249533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:19:45.657386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.235045+0000","last_change":"2024-08-18T22:23:53.235045+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.235045+0000","last_undegraded":"2024-08-18T22:23:53.235045+0000","last_fullsized":"2024-08-18T22:23:53.235045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248747+0000","last_change":"2024-08-18T22:23:53.244540+0000","last_active":"2024-08-18T22:23:53.248747+0000","last_peered":"2024-08-18T22:23:53.248747+0000","last_clean":"2024-08-18T22:23:53.248747+0000","last_became_active":"2024-08-18T22:23:53.243417+0000","last_became_peered":"2024-08-18T22:23:53.243417+0000","last_unstale":"2024-08-18T22:23:53.248747+0000","last_undegraded":"2024-08-18T22:23:53.248747+0000","last_fullsized":"2024-08-18T22:23:53.248747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:30.730795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231799+0000","last_change":"2024-08-18T22:23:53.231799+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231799+0000","last_undegraded":"2024-08-18T22:23:53.231799+0000","last_fullsized":"2024-08-18T22:23:53.231799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264370+0000","last_change":"2024-08-18T22:23:53.252271+0000","last_active":"2024-08-18T22:23:55.264370+0000","last_peered":"2024-08-18T22:23:55.264370+0000","last_clean":"2024-08-18T22:23:55.264370+0000","last_became_active":"2024-08-18T22:23:53.252030+0000","last_became_peered":"2024-08-18T22:23:53.252030+0000","last_unstale":"2024-08-18T22:23:55.264370+0000","last_undegraded":"2024-08-18T22:23:55.264370+0000","last_fullsized":"2024-08-18T22:23:55.264370+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:19.534699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232202+0000","last_change":"2024-08-18T22:23:53.232202+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232202+0000","last_undegraded":"2024-08-18T22:23:53.232202+0000","last_fullsized":"2024-08-18T22:23:53.232202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.250134+0000","last_change":"2024-08-18T22:23:53.249008+0000","last_active":"2024-08-18T22:23:53.250134+0000","last_peered":"2024-08-18T22:23:53.250134+0000","last_clean":"2024-08-18T22:23:53.250134+0000","last_became_active":"2024-08-18T22:23:53.248747+0000","last_became_peered":"2024-08-18T22:23:53.248747+0000","last_unstale":"2024-08-18T22:23:53.250134+0000","last_undegraded":"2024-08-18T22:23:53.250134+0000","last_fullsized":"2024-08-18T22:23:53.250134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:38:26.142335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231519+0000","last_change":"2024-08-18T22:23:53.231519+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231519+0000","last_undegraded":"2024-08-18T22:23:53.231519+0000","last_fullsized":"2024-08-18T22:23:53.231519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.253729+0000","last_change":"2024-08-18T22:23:53.253204+0000","last_active":"2024-08-18T22:23:53.253729+0000","last_peered":"2024-08-18T22:23:53.253729+0000","last_clean":"2024-08-18T22:23:53.253729+0000","last_became_active":"2024-08-18T22:23:53.252957+0000","last_became_peered":"2024-08-18T22:23:53.252957+0000","last_unstale":"2024-08-18T22:23:53.253729+0000","last_undegraded":"2024-08-18T22:23:53.253729+0000","last_fullsized":"2024-08-18T22:23:53.253729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:56.158170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.228814+0000","last_change":"2024-08-18T22:23:53.228814+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.228814+0000","last_undegraded":"2024-08-18T22:23:53.228814+0000","last_fullsized":"2024-08-18T22:23:53.228814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.246744+0000","last_change":"2024-08-18T22:23:53.242215+0000","last_active":"2024-08-18T22:23:53.246744+0000","last_peered":"2024-08-18T22:23:53.246744+0000","last_clean":"2024-08-18T22:23:53.246744+0000","last_became_active":"2024-08-18T22:23:53.241900+0000","last_became_peered":"2024-08-18T22:23:53.241900+0000","last_unstale":"2024-08-18T22:23:53.246744+0000","last_undegraded":"2024-08-18T22:23:53.246744+0000","last_fullsized":"2024-08-18T22:23:53.246744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:17:30.070215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":290,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.229413+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:23:53.229413+0000","last_peered":"2024-08-18T22:23:53.229413+0000","last_clean":"2024-08-18T22:23:53.229413+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:23:53.229413+0000","last_undegraded":"2024-08-18T22:23:53.229413+0000","last_fullsized":"2024-08-18T22:23:53.229413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1564672,"data_stored":1034301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":958464,"data_stored":437266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":958464,"data_stored":437266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40452,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331388,"statfs":{"total":96636764160,"available":96595341312,"internally_reserved":0,"allocated":970752,"data_stored":443933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40440,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331400,"statfs":{"total":96636764160,"available":96595353600,"internally_reserved":0,"allocated":958464,"data_stored":437266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41020,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330820,"statfs":{"total":96636764160,"available":96594759680,"internally_reserved":0,"allocated":1552384,"data_stored":1027634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1015808,"data_stored":459508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1007616,"data_stored":458534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:23:58.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:23:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.942+0000 7f0ebae00640 1 Processor -- start 2024-08-18T22:23:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.942+0000 7f0ebae00640 1 -- start start 2024-08-18T22:23:58.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0ebae00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0eb415e7a0 0x7f0eb406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0ebae00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0eb406ef30 0x7f0eb415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0ebae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb415f0c0 0x7f0eb4160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0ebae00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb41600a0 con 0x7f0eb415e7a0 2024-08-18T22:23:58.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0ebae00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb406f950 con 0x7f0eb406ef30 2024-08-18T22:23:58.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0ebae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb406f3c0 con 0x7f0eb415f0c0 2024-08-18T22:23:58.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eb3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0eb415e7a0 0x7f0eb406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eb3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0eb415e7a0 0x7f0eb406e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45240/0 (socket says 172.21.15.5:45240) 2024-08-18T22:23:58.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eb3e00640 1 -- 172.21.15.5:0/2083545123 learned_addr learned my addr 172.21.15.5:0/2083545123 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eb8e00640 1 --2- 172.21.15.5:0/2083545123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb415f0c0 0x7f0eb4160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eab400640 1 --2- 172.21.15.5:0/2083545123 >> v2:172.21.15.117:3300/0 conn(0x7f0eb406ef30 0x7f0eb415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eb3e00640 1 -- 172.21.15.5:0/2083545123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb415f0c0 msgr2=0x7f0eb4160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eb3e00640 1 --2- 172.21.15.5:0/2083545123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb415f0c0 0x7f0eb4160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eb3e00640 1 -- 172.21.15.5:0/2083545123 >> v2:172.21.15.117:3300/0 conn(0x7f0eb406ef30 msgr2=0x7f0eb415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eb3e00640 1 --2- 172.21.15.5:0/2083545123 >> v2:172.21.15.117:3300/0 conn(0x7f0eb406ef30 0x7f0eb415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eb3e00640 1 -- 172.21.15.5:0/2083545123 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb406f670 con 0x7f0eb415e7a0 2024-08-18T22:23:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eb8e00640 1 --2- 172.21.15.5:0/2083545123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb415f0c0 0x7f0eb4160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.946+0000 7f0eab400640 1 --2- 172.21.15.5:0/2083545123 >> v2:172.21.15.117:3300/0 conn(0x7f0eb406ef30 0x7f0eb415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0eb3e00640 1 --2- 172.21.15.5:0/2083545123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0eb415e7a0 0x7f0eb406e9f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40c9f10 tx=0x7f0ea401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a937c0fa71e698a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0eb3400640 1 -- 172.21.15.5:0/2083545123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40b0070 con 0x7f0eb415e7a0 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0eb3400640 1 -- 172.21.15.5:0/2083545123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea40ab600 con 0x7f0eb415e7a0 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0eb3400640 1 -- 172.21.15.5:0/2083545123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40ab9d0 con 0x7f0eb415e7a0 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 -- 172.21.15.5:0/2083545123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0eb415e7a0 msgr2=0x7f0eb406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 --2- 172.21.15.5:0/2083545123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0eb415e7a0 0x7f0eb406e9f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40c9f10 tx=0x7f0ea401c520 comp rx=0 tx=0).stop 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 -- 172.21.15.5:0/2083545123 shutdown_connections 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 --2- 172.21.15.5:0/2083545123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb415f0c0 0x7f0eb4160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 --2- 172.21.15.5:0/2083545123 >> v2:172.21.15.117:3300/0 conn(0x7f0eb406ef30 0x7f0eb415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 --2- 172.21.15.5:0/2083545123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0eb415e7a0 0x7f0eb406e9f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 -- 172.21.15.5:0/2083545123 >> 172.21.15.5:0/2083545123 conn(0x7f0eb4070190 msgr2=0x7f0eb406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 -- 172.21.15.5:0/2083545123 shutdown_connections 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 -- 172.21.15.5:0/2083545123 wait complete. 2024-08-18T22:23:58.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 Processor -- start 2024-08-18T22:23:58.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 -- start start 2024-08-18T22:23:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0eb406ef30 0x7f0eb414c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb415e7a0 0x7f0eb4154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0eb415f0c0 0x7f0eb41564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb4161400 con 0x7f0eb406ef30 2024-08-18T22:23:58.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb4161280 con 0x7f0eb415f0c0 2024-08-18T22:23:58.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0ebae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb4161580 con 0x7f0eb415e7a0 2024-08-18T22:23:58.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0eb3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0eb406ef30 0x7f0eb414c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0eb3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0eb406ef30 0x7f0eb414c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45254/0 (socket says 172.21.15.5:45254) 2024-08-18T22:23:58.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0eb3e00640 1 -- 172.21.15.5:0/3041377838 learned_addr learned my addr 172.21.15.5:0/3041377838 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:58.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.950+0000 7f0eab400640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb415e7a0 0x7f0eb4154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb8e00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0eb415f0c0 0x7f0eb41564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb3e00640 1 -- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb415e7a0 msgr2=0x7f0eb4154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb3e00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb415e7a0 0x7f0eb4154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb3e00640 1 -- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0eb415f0c0 msgr2=0x7f0eb41564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb3e00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0eb415f0c0 0x7f0eb41564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb3e00640 1 -- 172.21.15.5:0/3041377838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb414ceb0 con 0x7f0eb406ef30 2024-08-18T22:23:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb8e00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0eb415f0c0 0x7f0eb41564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb3e00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0eb406ef30 0x7f0eb414c970 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40ae040 tx=0x7f0ea401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb0c00640 1 -- 172.21.15.5:0/3041377838 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40b0040 con 0x7f0eb406ef30 2024-08-18T22:23:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb0c00640 1 -- 172.21.15.5:0/3041377838 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea40bc070 con 0x7f0eb406ef30 2024-08-18T22:23:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb0c00640 1 -- 172.21.15.5:0/3041377838 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40b6880 con 0x7f0eb406ef30 2024-08-18T22:23:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0ebae00640 1 -- 172.21.15.5:0/3041377838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb4154270 con 0x7f0eb406ef30 2024-08-18T22:23:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0ebae00640 1 -- 172.21.15.5:0/3041377838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb40cad90 con 0x7f0eb406ef30 2024-08-18T22:23:58.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0ebae00640 1 -- 172.21.15.5:0/3041377838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb40cab80 con 0x7f0eb406ef30 2024-08-18T22:23:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb0c00640 1 -- 172.21.15.5:0/3041377838 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ea40ab4c0 con 0x7f0eb406ef30 2024-08-18T22:23:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb0c00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0e900678f0 0x7f0e90069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.954+0000 7f0eb0c00640 1 -- 172.21.15.5:0/3041377838 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f0ea41202d0 con 0x7f0eb406ef30 2024-08-18T22:23:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.958+0000 7f0eab400640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0e900678f0 0x7f0e90069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:58.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.958+0000 7f0eab400640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0e900678f0 0x7f0e90069db0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0eb41fa220 tx=0x7f0e9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:58.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:58.958+0000 7f0eb0c00640 1 -- 172.21.15.5:0/3041377838 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0ea4016110 con 0x7f0eb406ef30 2024-08-18T22:23:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.122+0000 7f0ebae00640 1 -- 172.21.15.5:0/3041377838 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0eb40d03d0 con 0x7f0e900678f0 2024-08-18T22:23:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.126+0000 7f0eb0c00640 1 -- 172.21.15.5:0/3041377838 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248184 (secure 0 0 0) 0x7f0eb40d03d0 con 0x7f0e900678f0 2024-08-18T22:23:59.131 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:59.132 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:23:59.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 -- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0e900678f0 msgr2=0x7f0e90069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0e900678f0 0x7f0e90069db0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0eb41fa220 tx=0x7f0e9c008040 comp rx=0 tx=0).stop 2024-08-18T22:23:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 -- 172.21.15.5:0/3041377838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0eb406ef30 msgr2=0x7f0eb414c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0eb406ef30 0x7f0eb414c970 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40ae040 tx=0x7f0ea401ad60 comp rx=0 tx=0).stop 2024-08-18T22:23:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 -- 172.21.15.5:0/3041377838 shutdown_connections 2024-08-18T22:23:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0e900678f0 0x7f0e90069db0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0eb415f0c0 0x7f0eb41564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eb415e7a0 0x7f0eb4154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 --2- 172.21.15.5:0/3041377838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0eb406ef30 0x7f0eb414c970 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 -- 172.21.15.5:0/3041377838 >> 172.21.15.5:0/3041377838 conn(0x7f0eb4070190 msgr2=0x7f0eb40b50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 -- 172.21.15.5:0/3041377838 shutdown_connections 2024-08-18T22:23:59.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.130+0000 7f0ebae00640 1 -- 172.21.15.5:0/3041377838 wait complete. 2024-08-18T22:23:59.151 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-08-18T22:23:57.686563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":308168,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754666552,"statfs":{"total":773094113280,"available":772778549248,"internally_reserved":0,"allocated":8986624,"data_stored":4735708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.465341"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.230493+0000","last_change":"2024-08-18T22:23:53.230493+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.230493+0000","last_undegraded":"2024-08-18T22:23:53.230493+0000","last_fullsized":"2024-08-18T22:23:53.230493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.241252+0000","last_change":"2024-08-18T22:23:53.241252+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.241252+0000","last_undegraded":"2024-08-18T22:23:53.241252+0000","last_fullsized":"2024-08-18T22:23:53.241252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240562+0000","last_change":"2024-08-18T22:23:53.240562+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240562+0000","last_undegraded":"2024-08-18T22:23:53.240562+0000","last_fullsized":"2024-08-18T22:23:53.240562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236364+0000","last_change":"2024-08-18T22:23:53.236364+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236364+0000","last_undegraded":"2024-08-18T22:23:53.236364+0000","last_fullsized":"2024-08-18T22:23:53.236364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264328+0000","last_change":"2024-08-18T22:23:54.255429+0000","last_active":"2024-08-18T22:23:55.264328+0000","last_peered":"2024-08-18T22:23:55.264328+0000","last_clean":"2024-08-18T22:23:55.264328+0000","last_became_active":"2024-08-18T22:23:54.254830+0000","last_became_peered":"2024-08-18T22:23:54.254830+0000","last_unstale":"2024-08-18T22:23:55.264328+0000","last_undegraded":"2024-08-18T22:23:55.264328+0000","last_fullsized":"2024-08-18T22:23:55.264328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:49.556352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233225+0000","last_change":"2024-08-18T22:23:53.233225+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233225+0000","last_undegraded":"2024-08-18T22:23:53.233225+0000","last_fullsized":"2024-08-18T22:23:53.233225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232999+0000","last_change":"2024-08-18T22:23:53.232999+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232999+0000","last_undegraded":"2024-08-18T22:23:53.232999+0000","last_fullsized":"2024-08-18T22:23:53.232999+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.263983+0000","last_change":"2024-08-18T22:23:54.253390+0000","last_active":"2024-08-18T22:23:55.263983+0000","last_peered":"2024-08-18T22:23:55.263983+0000","last_clean":"2024-08-18T22:23:55.263983+0000","last_became_active":"2024-08-18T22:23:54.253085+0000","last_became_peered":"2024-08-18T22:23:54.253085+0000","last_unstale":"2024-08-18T22:23:55.263983+0000","last_undegraded":"2024-08-18T22:23:55.263983+0000","last_fullsized":"2024-08-18T22:23:55.263983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:14.303897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261466+0000","last_change":"2024-08-18T22:23:54.258688+0000","last_active":"2024-08-18T22:23:55.261466+0000","last_peered":"2024-08-18T22:23:55.261466+0000","last_clean":"2024-08-18T22:23:55.261466+0000","last_became_active":"2024-08-18T22:23:54.258436+0000","last_became_peered":"2024-08-18T22:23:54.258436+0000","last_unstale":"2024-08-18T22:23:55.261466+0000","last_undegraded":"2024-08-18T22:23:55.261466+0000","last_fullsized":"2024-08-18T22:23:55.261466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:10.210409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236519+0000","last_change":"2024-08-18T22:23:53.236519+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236519+0000","last_undegraded":"2024-08-18T22:23:53.236519+0000","last_fullsized":"2024-08-18T22:23:53.236519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236929+0000","last_change":"2024-08-18T22:23:53.236929+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236929+0000","last_undegraded":"2024-08-18T22:23:53.236929+0000","last_fullsized":"2024-08-18T22:23:53.236929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.235970+0000","last_change":"2024-08-18T22:23:53.235970+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.235970+0000","last_undegraded":"2024-08-18T22:23:53.235970+0000","last_fullsized":"2024-08-18T22:23:53.235970+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264361+0000","last_change":"2024-08-18T22:23:54.254445+0000","last_active":"2024-08-18T22:23:55.264361+0000","last_peered":"2024-08-18T22:23:55.264361+0000","last_clean":"2024-08-18T22:23:55.264361+0000","last_became_active":"2024-08-18T22:23:54.254125+0000","last_became_peered":"2024-08-18T22:23:54.254125+0000","last_unstale":"2024-08-18T22:23:55.264361+0000","last_undegraded":"2024-08-18T22:23:55.264361+0000","last_fullsized":"2024-08-18T22:23:55.264361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:07.096296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232663+0000","last_change":"2024-08-18T22:23:53.232663+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232663+0000","last_undegraded":"2024-08-18T22:23:53.232663+0000","last_fullsized":"2024-08-18T22:23:53.232663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.239293+0000","last_change":"2024-08-18T22:23:53.239293+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.239293+0000","last_undegraded":"2024-08-18T22:23:53.239293+0000","last_fullsized":"2024-08-18T22:23:53.239293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.229183+0000","last_change":"2024-08-18T22:23:53.229183+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.229183+0000","last_undegraded":"2024-08-18T22:23:53.229183+0000","last_fullsized":"2024-08-18T22:23:53.229183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264661+0000","last_change":"2024-08-18T22:23:54.259132+0000","last_active":"2024-08-18T22:23:55.264661+0000","last_peered":"2024-08-18T22:23:55.264661+0000","last_clean":"2024-08-18T22:23:55.264661+0000","last_became_active":"2024-08-18T22:23:54.258811+0000","last_became_peered":"2024-08-18T22:23:54.258811+0000","last_unstale":"2024-08-18T22:23:55.264661+0000","last_undegraded":"2024-08-18T22:23:55.264661+0000","last_fullsized":"2024-08-18T22:23:55.264661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:48.771970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240676+0000","last_change":"2024-08-18T22:23:53.240676+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240676+0000","last_undegraded":"2024-08-18T22:23:53.240676+0000","last_fullsized":"2024-08-18T22:23:53.240676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231041+0000","last_change":"2024-08-18T22:23:53.231041+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231041+0000","last_undegraded":"2024-08-18T22:23:53.231041+0000","last_fullsized":"2024-08-18T22:23:53.231041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264433+0000","last_change":"2024-08-18T22:23:54.262936+0000","last_active":"2024-08-18T22:23:55.264433+0000","last_peered":"2024-08-18T22:23:55.264433+0000","last_clean":"2024-08-18T22:23:55.264433+0000","last_became_active":"2024-08-18T22:23:54.262665+0000","last_became_peered":"2024-08-18T22:23:54.262665+0000","last_unstale":"2024-08-18T22:23:55.264433+0000","last_undegraded":"2024-08-18T22:23:55.264433+0000","last_fullsized":"2024-08-18T22:23:55.264433+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:34.017166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261382+0000","last_change":"2024-08-18T22:23:54.267084+0000","last_active":"2024-08-18T22:23:55.261382+0000","last_peered":"2024-08-18T22:23:55.261382+0000","last_clean":"2024-08-18T22:23:55.261382+0000","last_became_active":"2024-08-18T22:23:54.266792+0000","last_became_peered":"2024-08-18T22:23:54.266792+0000","last_unstale":"2024-08-18T22:23:55.261382+0000","last_undegraded":"2024-08-18T22:23:55.261382+0000","last_fullsized":"2024-08-18T22:23:55.261382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:27:37.035990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264190+0000","last_change":"2024-08-18T22:23:54.262252+0000","last_active":"2024-08-18T22:23:55.264190+0000","last_peered":"2024-08-18T22:23:55.264190+0000","last_clean":"2024-08-18T22:23:55.264190+0000","last_became_active":"2024-08-18T22:23:54.261976+0000","last_became_peered":"2024-08-18T22:23:54.261976+0000","last_unstale":"2024-08-18T22:23:55.264190+0000","last_undegraded":"2024-08-18T22:23:55.264190+0000","last_fullsized":"2024-08-18T22:23:55.264190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:27.688388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261229+0000","last_change":"2024-08-18T22:23:54.269243+0000","last_active":"2024-08-18T22:23:55.261229+0000","last_peered":"2024-08-18T22:23:55.261229+0000","last_clean":"2024-08-18T22:23:55.261229+0000","last_became_active":"2024-08-18T22:23:54.268935+0000","last_became_peered":"2024-08-18T22:23:54.268935+0000","last_unstale":"2024-08-18T22:23:55.261229+0000","last_undegraded":"2024-08-18T22:23:55.261229+0000","last_fullsized":"2024-08-18T22:23:55.261229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:56:07.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236717+0000","last_change":"2024-08-18T22:23:53.236717+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236717+0000","last_undegraded":"2024-08-18T22:23:53.236717+0000","last_fullsized":"2024-08-18T22:23:53.236717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.237012+0000","last_change":"2024-08-18T22:23:53.237012+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.237012+0000","last_undegraded":"2024-08-18T22:23:53.237012+0000","last_fullsized":"2024-08-18T22:23:53.237012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233949+0000","last_change":"2024-08-18T22:23:53.233949+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233949+0000","last_undegraded":"2024-08-18T22:23:53.233949+0000","last_fullsized":"2024-08-18T22:23:53.233949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.229370+0000","last_change":"2024-08-18T22:23:53.229370+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.229370+0000","last_undegraded":"2024-08-18T22:23:53.229370+0000","last_fullsized":"2024-08-18T22:23:53.229370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264452+0000","last_change":"2024-08-18T22:23:54.269533+0000","last_active":"2024-08-18T22:23:55.264452+0000","last_peered":"2024-08-18T22:23:55.264452+0000","last_clean":"2024-08-18T22:23:55.264452+0000","last_became_active":"2024-08-18T22:23:54.269250+0000","last_became_peered":"2024-08-18T22:23:54.269250+0000","last_unstale":"2024-08-18T22:23:55.264452+0000","last_undegraded":"2024-08-18T22:23:55.264452+0000","last_fullsized":"2024-08-18T22:23:55.264452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:38:29.318017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234548+0000","last_change":"2024-08-18T22:23:53.234548+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234548+0000","last_undegraded":"2024-08-18T22:23:53.234548+0000","last_fullsized":"2024-08-18T22:23:53.234548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.227692+0000","last_change":"2024-08-18T22:23:53.227692+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.227692+0000","last_undegraded":"2024-08-18T22:23:53.227692+0000","last_fullsized":"2024-08-18T22:23:53.227692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240371+0000","last_change":"2024-08-18T22:23:53.240371+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240371+0000","last_undegraded":"2024-08-18T22:23:53.240371+0000","last_fullsized":"2024-08-18T22:23:53.240371+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.227548+0000","last_change":"2024-08-18T22:23:53.227548+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.227548+0000","last_undegraded":"2024-08-18T22:23:53.227548+0000","last_fullsized":"2024-08-18T22:23:53.227548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.241056+0000","last_change":"2024-08-18T22:23:53.241056+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.241056+0000","last_undegraded":"2024-08-18T22:23:53.241056+0000","last_fullsized":"2024-08-18T22:23:53.241056+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264673+0000","last_change":"2024-08-18T22:23:53.251250+0000","last_active":"2024-08-18T22:23:55.264673+0000","last_peered":"2024-08-18T22:23:55.264673+0000","last_clean":"2024-08-18T22:23:55.264673+0000","last_became_active":"2024-08-18T22:23:53.250935+0000","last_became_peered":"2024-08-18T22:23:53.250935+0000","last_unstale":"2024-08-18T22:23:55.264673+0000","last_undegraded":"2024-08-18T22:23:55.264673+0000","last_fullsized":"2024-08-18T22:23:55.264673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:44.891601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234357+0000","last_change":"2024-08-18T22:23:53.234357+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234357+0000","last_undegraded":"2024-08-18T22:23:53.234357+0000","last_fullsized":"2024-08-18T22:23:53.234357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249647+0000","last_change":"2024-08-18T22:23:53.245851+0000","last_active":"2024-08-18T22:23:53.249647+0000","last_peered":"2024-08-18T22:23:53.249647+0000","last_clean":"2024-08-18T22:23:53.249647+0000","last_became_active":"2024-08-18T22:23:53.245598+0000","last_became_peered":"2024-08-18T22:23:53.245598+0000","last_unstale":"2024-08-18T22:23:53.249647+0000","last_undegraded":"2024-08-18T22:23:53.249647+0000","last_fullsized":"2024-08-18T22:23:53.249647+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:08.045334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261043+0000","last_change":"2024-08-18T22:23:54.264243+0000","last_active":"2024-08-18T22:23:55.261043+0000","last_peered":"2024-08-18T22:23:55.261043+0000","last_clean":"2024-08-18T22:23:55.261043+0000","last_became_active":"2024-08-18T22:23:54.263437+0000","last_became_peered":"2024-08-18T22:23:54.263437+0000","last_unstale":"2024-08-18T22:23:55.261043+0000","last_undegraded":"2024-08-18T22:23:55.261043+0000","last_fullsized":"2024-08-18T22:23:55.261043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:02.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.251861+0000","last_change":"2024-08-18T22:23:53.249485+0000","last_active":"2024-08-18T22:23:53.251861+0000","last_peered":"2024-08-18T22:23:53.251861+0000","last_clean":"2024-08-18T22:23:53.251861+0000","last_became_active":"2024-08-18T22:23:53.248070+0000","last_became_peered":"2024-08-18T22:23:53.248070+0000","last_unstale":"2024-08-18T22:23:53.251861+0000","last_undegraded":"2024-08-18T22:23:53.251861+0000","last_fullsized":"2024-08-18T22:23:53.251861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:12.820159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261499+0000","last_change":"2024-08-18T22:23:54.266316+0000","last_active":"2024-08-18T22:23:55.261499+0000","last_peered":"2024-08-18T22:23:55.261499+0000","last_clean":"2024-08-18T22:23:55.261499+0000","last_became_active":"2024-08-18T22:23:54.265936+0000","last_became_peered":"2024-08-18T22:23:54.265936+0000","last_unstale":"2024-08-18T22:23:55.261499+0000","last_undegraded":"2024-08-18T22:23:55.261499+0000","last_fullsized":"2024-08-18T22:23:55.261499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:00:03.812617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248331+0000","last_change":"2024-08-18T22:23:53.243356+0000","last_active":"2024-08-18T22:23:53.248331+0000","last_peered":"2024-08-18T22:23:53.248331+0000","last_clean":"2024-08-18T22:23:53.248331+0000","last_became_active":"2024-08-18T22:23:53.243055+0000","last_became_peered":"2024-08-18T22:23:53.243055+0000","last_unstale":"2024-08-18T22:23:53.248331+0000","last_undegraded":"2024-08-18T22:23:53.248331+0000","last_fullsized":"2024-08-18T22:23:53.248331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:47.749438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234746+0000","last_change":"2024-08-18T22:23:53.234746+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234746+0000","last_undegraded":"2024-08-18T22:23:53.234746+0000","last_fullsized":"2024-08-18T22:23:53.234746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261622+0000","last_change":"2024-08-18T22:23:53.240275+0000","last_active":"2024-08-18T22:23:55.261622+0000","last_peered":"2024-08-18T22:23:55.261622+0000","last_clean":"2024-08-18T22:23:55.261622+0000","last_became_active":"2024-08-18T22:23:53.239803+0000","last_became_peered":"2024-08-18T22:23:53.239803+0000","last_unstale":"2024-08-18T22:23:55.261622+0000","last_undegraded":"2024-08-18T22:23:55.261622+0000","last_fullsized":"2024-08-18T22:23:55.261622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:22.345962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.235853+0000","last_change":"2024-08-18T22:23:53.235853+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.235853+0000","last_undegraded":"2024-08-18T22:23:53.235853+0000","last_fullsized":"2024-08-18T22:23:53.235853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249762+0000","last_change":"2024-08-18T22:23:53.247955+0000","last_active":"2024-08-18T22:23:53.249762+0000","last_peered":"2024-08-18T22:23:53.249762+0000","last_clean":"2024-08-18T22:23:53.249762+0000","last_became_active":"2024-08-18T22:23:53.246744+0000","last_became_peered":"2024-08-18T22:23:53.246744+0000","last_unstale":"2024-08-18T22:23:53.249762+0000","last_undegraded":"2024-08-18T22:23:53.249762+0000","last_fullsized":"2024-08-18T22:23:53.249762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:14:00.588346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261582+0000","last_change":"2024-08-18T22:23:54.257636+0000","last_active":"2024-08-18T22:23:55.261582+0000","last_peered":"2024-08-18T22:23:55.261582+0000","last_clean":"2024-08-18T22:23:55.261582+0000","last_became_active":"2024-08-18T22:23:54.257280+0000","last_became_peered":"2024-08-18T22:23:54.257280+0000","last_unstale":"2024-08-18T22:23:55.261582+0000","last_undegraded":"2024-08-18T22:23:55.261582+0000","last_fullsized":"2024-08-18T22:23:55.261582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:50.911549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.246752+0000","last_change":"2024-08-18T22:23:53.245559+0000","last_active":"2024-08-18T22:23:53.246752+0000","last_peered":"2024-08-18T22:23:53.246752+0000","last_clean":"2024-08-18T22:23:53.246752+0000","last_became_active":"2024-08-18T22:23:53.245269+0000","last_became_peered":"2024-08-18T22:23:53.245269+0000","last_unstale":"2024-08-18T22:23:53.246752+0000","last_undegraded":"2024-08-18T22:23:53.246752+0000","last_fullsized":"2024-08-18T22:23:53.246752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:17.284982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232457+0000","last_change":"2024-08-18T22:23:53.232457+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232457+0000","last_undegraded":"2024-08-18T22:23:53.232457+0000","last_fullsized":"2024-08-18T22:23:53.232457+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264053+0000","last_change":"2024-08-18T22:23:53.246914+0000","last_active":"2024-08-18T22:23:55.264053+0000","last_peered":"2024-08-18T22:23:55.264053+0000","last_clean":"2024-08-18T22:23:55.264053+0000","last_became_active":"2024-08-18T22:23:53.246609+0000","last_became_peered":"2024-08-18T22:23:53.246609+0000","last_unstale":"2024-08-18T22:23:55.264053+0000","last_undegraded":"2024-08-18T22:23:55.264053+0000","last_fullsized":"2024-08-18T22:23:55.264053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:49.756736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233504+0000","last_change":"2024-08-18T22:23:53.233504+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233504+0000","last_undegraded":"2024-08-18T22:23:53.233504+0000","last_fullsized":"2024-08-18T22:23:53.233504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249317+0000","last_change":"2024-08-18T22:23:53.242509+0000","last_active":"2024-08-18T22:23:53.249317+0000","last_peered":"2024-08-18T22:23:53.249317+0000","last_clean":"2024-08-18T22:23:53.249317+0000","last_became_active":"2024-08-18T22:23:53.242205+0000","last_became_peered":"2024-08-18T22:23:53.242205+0000","last_unstale":"2024-08-18T22:23:53.249317+0000","last_undegraded":"2024-08-18T22:23:53.249317+0000","last_fullsized":"2024-08-18T22:23:53.249317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:11:00.515699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232617+0000","last_change":"2024-08-18T22:23:53.232617+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232617+0000","last_undegraded":"2024-08-18T22:23:53.232617+0000","last_fullsized":"2024-08-18T22:23:53.232617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249198+0000","last_change":"2024-08-18T22:23:53.245330+0000","last_active":"2024-08-18T22:23:53.249198+0000","last_peered":"2024-08-18T22:23:53.249198+0000","last_clean":"2024-08-18T22:23:53.249198+0000","last_became_active":"2024-08-18T22:23:53.243674+0000","last_became_peered":"2024-08-18T22:23:53.243674+0000","last_unstale":"2024-08-18T22:23:53.249198+0000","last_undegraded":"2024-08-18T22:23:53.249198+0000","last_fullsized":"2024-08-18T22:23:53.249198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:36.794334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.230747+0000","last_change":"2024-08-18T22:23:53.230747+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.230747+0000","last_undegraded":"2024-08-18T22:23:53.230747+0000","last_fullsized":"2024-08-18T22:23:53.230747+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264611+0000","last_change":"2024-08-18T22:23:53.249062+0000","last_active":"2024-08-18T22:23:55.264611+0000","last_peered":"2024-08-18T22:23:55.264611+0000","last_clean":"2024-08-18T22:23:55.264611+0000","last_became_active":"2024-08-18T22:23:53.248766+0000","last_became_peered":"2024-08-18T22:23:53.248766+0000","last_unstale":"2024-08-18T22:23:55.264611+0000","last_undegraded":"2024-08-18T22:23:55.264611+0000","last_fullsized":"2024-08-18T22:23:55.264611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:51.713170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.240393+0000","last_change":"2024-08-18T22:23:53.240393+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.240393+0000","last_undegraded":"2024-08-18T22:23:53.240393+0000","last_fullsized":"2024-08-18T22:23:53.240393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249672+0000","last_change":"2024-08-18T22:23:53.245872+0000","last_active":"2024-08-18T22:23:53.249672+0000","last_peered":"2024-08-18T22:23:53.249672+0000","last_clean":"2024-08-18T22:23:53.249672+0000","last_became_active":"2024-08-18T22:23:53.245598+0000","last_became_peered":"2024-08-18T22:23:53.245598+0000","last_unstale":"2024-08-18T22:23:53.249672+0000","last_undegraded":"2024-08-18T22:23:53.249672+0000","last_fullsized":"2024-08-18T22:23:53.249672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:37:37.435949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.233341+0000","last_change":"2024-08-18T22:23:53.233341+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.233341+0000","last_undegraded":"2024-08-18T22:23:53.233341+0000","last_fullsized":"2024-08-18T22:23:53.233341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249779+0000","last_change":"2024-08-18T22:23:53.247110+0000","last_active":"2024-08-18T22:23:53.249779+0000","last_peered":"2024-08-18T22:23:53.249779+0000","last_clean":"2024-08-18T22:23:53.249779+0000","last_became_active":"2024-08-18T22:23:53.245877+0000","last_became_peered":"2024-08-18T22:23:53.245877+0000","last_unstale":"2024-08-18T22:23:53.249779+0000","last_undegraded":"2024-08-18T22:23:53.249779+0000","last_fullsized":"2024-08-18T22:23:53.249779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:44:37.965015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232323+0000","last_change":"2024-08-18T22:23:53.232323+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232323+0000","last_undegraded":"2024-08-18T22:23:53.232323+0000","last_fullsized":"2024-08-18T22:23:53.232323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249279+0000","last_change":"2024-08-18T22:23:53.241741+0000","last_active":"2024-08-18T22:23:53.249279+0000","last_peered":"2024-08-18T22:23:53.249279+0000","last_clean":"2024-08-18T22:23:53.249279+0000","last_became_active":"2024-08-18T22:23:53.241388+0000","last_became_peered":"2024-08-18T22:23:53.241388+0000","last_unstale":"2024-08-18T22:23:53.249279+0000","last_undegraded":"2024-08-18T22:23:53.249279+0000","last_fullsized":"2024-08-18T22:23:53.249279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:14:00.588346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.237680+0000","last_change":"2024-08-18T22:23:53.237680+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.237680+0000","last_undegraded":"2024-08-18T22:23:53.237680+0000","last_fullsized":"2024-08-18T22:23:53.237680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264098+0000","last_change":"2024-08-18T22:23:53.251780+0000","last_active":"2024-08-18T22:23:55.264098+0000","last_peered":"2024-08-18T22:23:55.264098+0000","last_clean":"2024-08-18T22:23:55.264098+0000","last_became_active":"2024-08-18T22:23:53.251524+0000","last_became_peered":"2024-08-18T22:23:53.251524+0000","last_unstale":"2024-08-18T22:23:55.264098+0000","last_undegraded":"2024-08-18T22:23:55.264098+0000","last_fullsized":"2024-08-18T22:23:55.264098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:01.049290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231938+0000","last_change":"2024-08-18T22:23:53.231938+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231938+0000","last_undegraded":"2024-08-18T22:23:53.231938+0000","last_fullsized":"2024-08-18T22:23:53.231938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.252580+0000","last_change":"2024-08-18T22:23:53.250165+0000","last_active":"2024-08-18T22:23:53.252580+0000","last_peered":"2024-08-18T22:23:53.252580+0000","last_clean":"2024-08-18T22:23:53.252580+0000","last_became_active":"2024-08-18T22:23:53.249889+0000","last_became_peered":"2024-08-18T22:23:53.249889+0000","last_unstale":"2024-08-18T22:23:53.252580+0000","last_undegraded":"2024-08-18T22:23:53.252580+0000","last_fullsized":"2024-08-18T22:23:53.252580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:19:45.657386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231460+0000","last_change":"2024-08-18T22:23:53.231460+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231460+0000","last_undegraded":"2024-08-18T22:23:53.231460+0000","last_fullsized":"2024-08-18T22:23:53.231460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249372+0000","last_change":"2024-08-18T22:23:53.243095+0000","last_active":"2024-08-18T22:23:53.249372+0000","last_peered":"2024-08-18T22:23:53.249372+0000","last_clean":"2024-08-18T22:23:53.249372+0000","last_became_active":"2024-08-18T22:23:53.242833+0000","last_became_peered":"2024-08-18T22:23:53.242833+0000","last_unstale":"2024-08-18T22:23:53.249372+0000","last_undegraded":"2024-08-18T22:23:53.249372+0000","last_fullsized":"2024-08-18T22:23:53.249372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:17.284982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264113+0000","last_change":"2024-08-18T22:23:54.259286+0000","last_active":"2024-08-18T22:23:55.264113+0000","last_peered":"2024-08-18T22:23:55.264113+0000","last_clean":"2024-08-18T22:23:55.264113+0000","last_became_active":"2024-08-18T22:23:54.258960+0000","last_became_peered":"2024-08-18T22:23:54.258960+0000","last_unstale":"2024-08-18T22:23:55.264113+0000","last_undegraded":"2024-08-18T22:23:55.264113+0000","last_fullsized":"2024-08-18T22:23:55.264113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:48.497587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261682+0000","last_change":"2024-08-18T22:23:53.241158+0000","last_active":"2024-08-18T22:23:55.261682+0000","last_peered":"2024-08-18T22:23:55.261682+0000","last_clean":"2024-08-18T22:23:55.261682+0000","last_became_active":"2024-08-18T22:23:53.240859+0000","last_became_peered":"2024-08-18T22:23:53.240859+0000","last_unstale":"2024-08-18T22:23:55.261682+0000","last_undegraded":"2024-08-18T22:23:55.261682+0000","last_fullsized":"2024-08-18T22:23:55.261682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:41.985620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264192+0000","last_change":"2024-08-18T22:23:54.271013+0000","last_active":"2024-08-18T22:23:55.264192+0000","last_peered":"2024-08-18T22:23:55.264192+0000","last_clean":"2024-08-18T22:23:55.264192+0000","last_became_active":"2024-08-18T22:23:54.270715+0000","last_became_peered":"2024-08-18T22:23:54.270715+0000","last_unstale":"2024-08-18T22:23:55.264192+0000","last_undegraded":"2024-08-18T22:23:55.264192+0000","last_fullsized":"2024-08-18T22:23:55.264192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:18:11.045700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264616+0000","last_change":"2024-08-18T22:23:53.246903+0000","last_active":"2024-08-18T22:23:55.264616+0000","last_peered":"2024-08-18T22:23:55.264616+0000","last_clean":"2024-08-18T22:23:55.264616+0000","last_became_active":"2024-08-18T22:23:53.246619+0000","last_became_peered":"2024-08-18T22:23:53.246619+0000","last_unstale":"2024-08-18T22:23:55.264616+0000","last_undegraded":"2024-08-18T22:23:55.264616+0000","last_fullsized":"2024-08-18T22:23:55.264616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:33:39.529484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.230795+0000","last_change":"2024-08-18T22:23:53.230795+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.230795+0000","last_undegraded":"2024-08-18T22:23:53.230795+0000","last_fullsized":"2024-08-18T22:23:53.230795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.251325+0000","last_change":"2024-08-18T22:23:53.250046+0000","last_active":"2024-08-18T22:23:53.251325+0000","last_peered":"2024-08-18T22:23:53.251325+0000","last_clean":"2024-08-18T22:23:53.251325+0000","last_became_active":"2024-08-18T22:23:53.246620+0000","last_became_peered":"2024-08-18T22:23:53.246620+0000","last_unstale":"2024-08-18T22:23:53.251325+0000","last_undegraded":"2024-08-18T22:23:53.251325+0000","last_fullsized":"2024-08-18T22:23:53.251325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:38:26.142335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234215+0000","last_change":"2024-08-18T22:23:53.234215+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234215+0000","last_undegraded":"2024-08-18T22:23:53.234215+0000","last_fullsized":"2024-08-18T22:23:53.234215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.246712+0000","last_change":"2024-08-18T22:23:53.242322+0000","last_active":"2024-08-18T22:23:53.246712+0000","last_peered":"2024-08-18T22:23:53.246712+0000","last_clean":"2024-08-18T22:23:53.246712+0000","last_became_active":"2024-08-18T22:23:53.241981+0000","last_became_peered":"2024-08-18T22:23:53.241981+0000","last_unstale":"2024-08-18T22:23:53.246712+0000","last_undegraded":"2024-08-18T22:23:53.246712+0000","last_fullsized":"2024-08-18T22:23:53.246712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:35:24.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.236584+0000","last_change":"2024-08-18T22:23:53.236584+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.236584+0000","last_undegraded":"2024-08-18T22:23:53.236584+0000","last_fullsized":"2024-08-18T22:23:53.236584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249057+0000","last_change":"2024-08-18T22:23:53.239454+0000","last_active":"2024-08-18T22:23:53.249057+0000","last_peered":"2024-08-18T22:23:53.249057+0000","last_clean":"2024-08-18T22:23:53.249057+0000","last_became_active":"2024-08-18T22:23:53.239189+0000","last_became_peered":"2024-08-18T22:23:53.239189+0000","last_unstale":"2024-08-18T22:23:53.249057+0000","last_undegraded":"2024-08-18T22:23:53.249057+0000","last_fullsized":"2024-08-18T22:23:53.249057+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:33:00.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231336+0000","last_change":"2024-08-18T22:23:53.231336+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231336+0000","last_undegraded":"2024-08-18T22:23:53.231336+0000","last_fullsized":"2024-08-18T22:23:53.231336+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248159+0000","last_change":"2024-08-18T22:23:53.247190+0000","last_active":"2024-08-18T22:23:53.248159+0000","last_peered":"2024-08-18T22:23:53.248159+0000","last_clean":"2024-08-18T22:23:53.248159+0000","last_became_active":"2024-08-18T22:23:53.244049+0000","last_became_peered":"2024-08-18T22:23:53.244049+0000","last_unstale":"2024-08-18T22:23:53.248159+0000","last_undegraded":"2024-08-18T22:23:53.248159+0000","last_fullsized":"2024-08-18T22:23:53.248159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:21.605699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260839+0000","last_change":"2024-08-18T22:23:54.259872+0000","last_active":"2024-08-18T22:23:55.260839+0000","last_peered":"2024-08-18T22:23:55.260839+0000","last_clean":"2024-08-18T22:23:55.260839+0000","last_became_active":"2024-08-18T22:23:54.259633+0000","last_became_peered":"2024-08-18T22:23:54.259633+0000","last_unstale":"2024-08-18T22:23:55.260839+0000","last_undegraded":"2024-08-18T22:23:55.260839+0000","last_fullsized":"2024-08-18T22:23:55.260839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:12.200171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248944+0000","last_change":"2024-08-18T22:23:53.246134+0000","last_active":"2024-08-18T22:23:53.248944+0000","last_peered":"2024-08-18T22:23:53.248944+0000","last_clean":"2024-08-18T22:23:53.248944+0000","last_became_active":"2024-08-18T22:23:53.245585+0000","last_became_peered":"2024-08-18T22:23:53.245585+0000","last_unstale":"2024-08-18T22:23:53.248944+0000","last_undegraded":"2024-08-18T22:23:53.248944+0000","last_fullsized":"2024-08-18T22:23:53.248944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:48.980834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232242+0000","last_change":"2024-08-18T22:23:53.232242+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232242+0000","last_undegraded":"2024-08-18T22:23:53.232242+0000","last_fullsized":"2024-08-18T22:23:53.232242+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.255640+0000","last_change":"2024-08-18T22:23:53.255034+0000","last_active":"2024-08-18T22:23:53.255640+0000","last_peered":"2024-08-18T22:23:53.255640+0000","last_clean":"2024-08-18T22:23:53.255640+0000","last_became_active":"2024-08-18T22:23:53.254449+0000","last_became_peered":"2024-08-18T22:23:53.254449+0000","last_unstale":"2024-08-18T22:23:53.255640+0000","last_undegraded":"2024-08-18T22:23:53.255640+0000","last_fullsized":"2024-08-18T22:23:53.255640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:08.045334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261122+0000","last_change":"2024-08-18T22:23:54.263284+0000","last_active":"2024-08-18T22:23:55.261122+0000","last_peered":"2024-08-18T22:23:55.261122+0000","last_clean":"2024-08-18T22:23:55.261122+0000","last_became_active":"2024-08-18T22:23:54.262747+0000","last_became_peered":"2024-08-18T22:23:54.262747+0000","last_unstale":"2024-08-18T22:23:55.261122+0000","last_undegraded":"2024-08-18T22:23:55.261122+0000","last_fullsized":"2024-08-18T22:23:55.261122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:51:52.385446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249815+0000","last_change":"2024-08-18T22:23:53.240247+0000","last_active":"2024-08-18T22:23:53.249815+0000","last_peered":"2024-08-18T22:23:53.249815+0000","last_clean":"2024-08-18T22:23:53.249815+0000","last_became_active":"2024-08-18T22:23:53.239551+0000","last_became_peered":"2024-08-18T22:23:53.239551+0000","last_unstale":"2024-08-18T22:23:53.249815+0000","last_undegraded":"2024-08-18T22:23:53.249815+0000","last_fullsized":"2024-08-18T22:23:53.249815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:44:37.965015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.234138+0000","last_change":"2024-08-18T22:23:53.234138+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.234138+0000","last_undegraded":"2024-08-18T22:23:53.234138+0000","last_fullsized":"2024-08-18T22:23:53.234138+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.249533+0000","last_change":"2024-08-18T22:23:53.244792+0000","last_active":"2024-08-18T22:23:53.249533+0000","last_peered":"2024-08-18T22:23:53.249533+0000","last_clean":"2024-08-18T22:23:53.249533+0000","last_became_active":"2024-08-18T22:23:53.244310+0000","last_became_peered":"2024-08-18T22:23:53.244310+0000","last_unstale":"2024-08-18T22:23:53.249533+0000","last_undegraded":"2024-08-18T22:23:53.249533+0000","last_fullsized":"2024-08-18T22:23:53.249533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:19:45.657386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.235045+0000","last_change":"2024-08-18T22:23:53.235045+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.235045+0000","last_undegraded":"2024-08-18T22:23:53.235045+0000","last_fullsized":"2024-08-18T22:23:53.235045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.248747+0000","last_change":"2024-08-18T22:23:53.244540+0000","last_active":"2024-08-18T22:23:53.248747+0000","last_peered":"2024-08-18T22:23:53.248747+0000","last_clean":"2024-08-18T22:23:53.248747+0000","last_became_active":"2024-08-18T22:23:53.243417+0000","last_became_peered":"2024-08-18T22:23:53.243417+0000","last_unstale":"2024-08-18T22:23:53.248747+0000","last_undegraded":"2024-08-18T22:23:53.248747+0000","last_fullsized":"2024-08-18T22:23:53.248747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:30.730795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231799+0000","last_change":"2024-08-18T22:23:53.231799+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231799+0000","last_undegraded":"2024-08-18T22:23:53.231799+0000","last_fullsized":"2024-08-18T22:23:53.231799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264370+0000","last_change":"2024-08-18T22:23:53.252271+0000","last_active":"2024-08-18T22:23:55.264370+0000","last_peered":"2024-08-18T22:23:55.264370+0000","last_clean":"2024-08-18T22:23:55.264370+0000","last_became_active":"2024-08-18T22:23:53.252030+0000","last_became_peered":"2024-08-18T22:23:53.252030+0000","last_unstale":"2024-08-18T22:23:55.264370+0000","last_undegraded":"2024-08-18T22:23:55.264370+0000","last_fullsized":"2024-08-18T22:23:55.264370+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:19.534699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.232202+0000","last_change":"2024-08-18T22:23:53.232202+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.232202+0000","last_undegraded":"2024-08-18T22:23:53.232202+0000","last_fullsized":"2024-08-18T22:23:53.232202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.250134+0000","last_change":"2024-08-18T22:23:53.249008+0000","last_active":"2024-08-18T22:23:53.250134+0000","last_peered":"2024-08-18T22:23:53.250134+0000","last_clean":"2024-08-18T22:23:53.250134+0000","last_became_active":"2024-08-18T22:23:53.248747+0000","last_became_peered":"2024-08-18T22:23:53.248747+0000","last_unstale":"2024-08-18T22:23:53.250134+0000","last_undegraded":"2024-08-18T22:23:53.250134+0000","last_fullsized":"2024-08-18T22:23:53.250134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:38:26.142335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.231519+0000","last_change":"2024-08-18T22:23:53.231519+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.231519+0000","last_undegraded":"2024-08-18T22:23:53.231519+0000","last_fullsized":"2024-08-18T22:23:53.231519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.253729+0000","last_change":"2024-08-18T22:23:53.253204+0000","last_active":"2024-08-18T22:23:53.253729+0000","last_peered":"2024-08-18T22:23:53.253729+0000","last_clean":"2024-08-18T22:23:53.253729+0000","last_became_active":"2024-08-18T22:23:53.252957+0000","last_became_peered":"2024-08-18T22:23:53.252957+0000","last_unstale":"2024-08-18T22:23:53.253729+0000","last_undegraded":"2024-08-18T22:23:53.253729+0000","last_fullsized":"2024-08-18T22:23:53.253729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:56.158170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":80,"state":"creating+peering","last_fresh":"2024-08-18T22:23:53.228814+0000","last_change":"2024-08-18T22:23:53.228814+0000","last_active":"2024-08-18T22:23:53.220736+0000","last_peered":"2024-08-18T22:23:53.220736+0000","last_clean":"2024-08-18T22:23:53.220736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:23:53.228814+0000","last_undegraded":"2024-08-18T22:23:53.228814+0000","last_fullsized":"2024-08-18T22:23:53.228814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.246744+0000","last_change":"2024-08-18T22:23:53.242215+0000","last_active":"2024-08-18T22:23:53.246744+0000","last_peered":"2024-08-18T22:23:53.246744+0000","last_clean":"2024-08-18T22:23:53.246744+0000","last_became_active":"2024-08-18T22:23:53.241900+0000","last_became_peered":"2024-08-18T22:23:53.241900+0000","last_unstale":"2024-08-18T22:23:53.246744+0000","last_undegraded":"2024-08-18T22:23:53.246744+0000","last_fullsized":"2024-08-18T22:23:53.246744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:17:30.070215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":290,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-08-18T22:23:53.229413+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:23:53.229413+0000","last_peered":"2024-08-18T22:23:53.229413+0000","last_clean":"2024-08-18T22:23:53.229413+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:23:53.229413+0000","last_undegraded":"2024-08-18T22:23:53.229413+0000","last_fullsized":"2024-08-18T22:23:53.229413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1564672,"data_stored":1034301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":958464,"data_stored":437266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":958464,"data_stored":437266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40452,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331388,"statfs":{"total":96636764160,"available":96595341312,"internally_reserved":0,"allocated":970752,"data_stored":443933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40440,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331400,"statfs":{"total":96636764160,"available":96595353600,"internally_reserved":0,"allocated":958464,"data_stored":437266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41020,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330820,"statfs":{"total":96636764160,"available":96594759680,"internally_reserved":0,"allocated":1552384,"data_stored":1027634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1015808,"data_stored":459508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1007616,"data_stored":458534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:23:59.155 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3f is not active+clean 2024-08-18T22:23:59.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.230493+0000', 'last_change': '2024-08-18T22:23:53.230493+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.230493+0000', 'last_undegraded': '2024-08-18T22:23:53.230493+0000', 'last_fullsized': '2024-08-18T22:23:53.230493+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:59.155 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3e is not active+clean 2024-08-18T22:23:59.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.241252+0000', 'last_change': '2024-08-18T22:23:53.241252+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.241252+0000', 'last_undegraded': '2024-08-18T22:23:53.241252+0000', 'last_fullsized': '2024-08-18T22:23:53.241252+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.155 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3d is not active+clean 2024-08-18T22:23:59.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.240562+0000', 'last_change': '2024-08-18T22:23:53.240562+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.240562+0000', 'last_undegraded': '2024-08-18T22:23:53.240562+0000', 'last_fullsized': '2024-08-18T22:23:53.240562+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:59.155 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3c is not active+clean 2024-08-18T22:23:59.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.236364+0000', 'last_change': '2024-08-18T22:23:53.236364+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.236364+0000', 'last_undegraded': '2024-08-18T22:23:53.236364+0000', 'last_fullsized': '2024-08-18T22:23:53.236364+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:59.155 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3a is not active+clean 2024-08-18T22:23:59.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.233225+0000', 'last_change': '2024-08-18T22:23:53.233225+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.233225+0000', 'last_undegraded': '2024-08-18T22:23:53.233225+0000', 'last_fullsized': '2024-08-18T22:23:53.233225+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:23:59.156 INFO:tasks.ceph.ceph_manager.ceph:PG 12.39 is not active+clean 2024-08-18T22:23:59.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.232999+0000', 'last_change': '2024-08-18T22:23:53.232999+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.232999+0000', 'last_undegraded': '2024-08-18T22:23:53.232999+0000', 'last_fullsized': '2024-08-18T22:23:53.232999+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:59.156 INFO:tasks.ceph.ceph_manager.ceph:PG 12.36 is not active+clean 2024-08-18T22:23:59.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.236519+0000', 'last_change': '2024-08-18T22:23:53.236519+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.236519+0000', 'last_undegraded': '2024-08-18T22:23:53.236519+0000', 'last_fullsized': '2024-08-18T22:23:53.236519+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:59.156 INFO:tasks.ceph.ceph_manager.ceph:PG 12.35 is not active+clean 2024-08-18T22:23:59.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.236929+0000', 'last_change': '2024-08-18T22:23:53.236929+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.236929+0000', 'last_undegraded': '2024-08-18T22:23:53.236929+0000', 'last_fullsized': '2024-08-18T22:23:53.236929+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.156 INFO:tasks.ceph.ceph_manager.ceph:PG 12.34 is not active+clean 2024-08-18T22:23:59.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.235970+0000', 'last_change': '2024-08-18T22:23:53.235970+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.235970+0000', 'last_undegraded': '2024-08-18T22:23:53.235970+0000', 'last_fullsized': '2024-08-18T22:23:53.235970+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:59.156 INFO:tasks.ceph.ceph_manager.ceph:PG 12.32 is not active+clean 2024-08-18T22:23:59.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.232663+0000', 'last_change': '2024-08-18T22:23:53.232663+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.232663+0000', 'last_undegraded': '2024-08-18T22:23:53.232663+0000', 'last_fullsized': '2024-08-18T22:23:53.232663+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:23:59.157 INFO:tasks.ceph.ceph_manager.ceph:PG 12.31 is not active+clean 2024-08-18T22:23:59.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.239293+0000', 'last_change': '2024-08-18T22:23:53.239293+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.239293+0000', 'last_undegraded': '2024-08-18T22:23:53.239293+0000', 'last_fullsized': '2024-08-18T22:23:53.239293+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.157 INFO:tasks.ceph.ceph_manager.ceph:PG 12.30 is not active+clean 2024-08-18T22:23:59.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.229183+0000', 'last_change': '2024-08-18T22:23:53.229183+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.229183+0000', 'last_undegraded': '2024-08-18T22:23:53.229183+0000', 'last_fullsized': '2024-08-18T22:23:53.229183+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:59.157 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2e is not active+clean 2024-08-18T22:23:59.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.240676+0000', 'last_change': '2024-08-18T22:23:53.240676+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.240676+0000', 'last_undegraded': '2024-08-18T22:23:53.240676+0000', 'last_fullsized': '2024-08-18T22:23:53.240676+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:59.157 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2d is not active+clean 2024-08-18T22:23:59.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.231041+0000', 'last_change': '2024-08-18T22:23:53.231041+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.231041+0000', 'last_undegraded': '2024-08-18T22:23:53.231041+0000', 'last_fullsized': '2024-08-18T22:23:53.231041+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:23:59.157 INFO:tasks.ceph.ceph_manager.ceph:PG 12.28 is not active+clean 2024-08-18T22:23:59.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.236717+0000', 'last_change': '2024-08-18T22:23:53.236717+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.236717+0000', 'last_undegraded': '2024-08-18T22:23:53.236717+0000', 'last_fullsized': '2024-08-18T22:23:53.236717+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.157 INFO:tasks.ceph.ceph_manager.ceph:PG 12.27 is not active+clean 2024-08-18T22:23:59.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.237012+0000', 'last_change': '2024-08-18T22:23:53.237012+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.237012+0000', 'last_undegraded': '2024-08-18T22:23:53.237012+0000', 'last_fullsized': '2024-08-18T22:23:53.237012+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.158 INFO:tasks.ceph.ceph_manager.ceph:PG 12.26 is not active+clean 2024-08-18T22:23:59.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.233949+0000', 'last_change': '2024-08-18T22:23:53.233949+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.233949+0000', 'last_undegraded': '2024-08-18T22:23:53.233949+0000', 'last_fullsized': '2024-08-18T22:23:53.233949+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:59.158 INFO:tasks.ceph.ceph_manager.ceph:PG 12.25 is not active+clean 2024-08-18T22:23:59.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.229370+0000', 'last_change': '2024-08-18T22:23:53.229370+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.229370+0000', 'last_undegraded': '2024-08-18T22:23:53.229370+0000', 'last_fullsized': '2024-08-18T22:23:53.229370+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:59.158 INFO:tasks.ceph.ceph_manager.ceph:PG 12.23 is not active+clean 2024-08-18T22:23:59.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.234548+0000', 'last_change': '2024-08-18T22:23:53.234548+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.234548+0000', 'last_undegraded': '2024-08-18T22:23:53.234548+0000', 'last_fullsized': '2024-08-18T22:23:53.234548+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.158 INFO:tasks.ceph.ceph_manager.ceph:PG 12.22 is not active+clean 2024-08-18T22:23:59.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.227692+0000', 'last_change': '2024-08-18T22:23:53.227692+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.227692+0000', 'last_undegraded': '2024-08-18T22:23:53.227692+0000', 'last_fullsized': '2024-08-18T22:23:53.227692+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:59.158 INFO:tasks.ceph.ceph_manager.ceph:PG 12.21 is not active+clean 2024-08-18T22:23:59.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.240371+0000', 'last_change': '2024-08-18T22:23:53.240371+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.240371+0000', 'last_undegraded': '2024-08-18T22:23:53.240371+0000', 'last_fullsized': '2024-08-18T22:23:53.240371+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:59.159 INFO:tasks.ceph.ceph_manager.ceph:PG 12.20 is not active+clean 2024-08-18T22:23:59.159 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.227548+0000', 'last_change': '2024-08-18T22:23:53.227548+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.227548+0000', 'last_undegraded': '2024-08-18T22:23:53.227548+0000', 'last_fullsized': '2024-08-18T22:23:53.227548+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:59.159 INFO:tasks.ceph.ceph_manager.ceph:PG 12.18 is not active+clean 2024-08-18T22:23:59.159 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.241056+0000', 'last_change': '2024-08-18T22:23:53.241056+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.241056+0000', 'last_undegraded': '2024-08-18T22:23:53.241056+0000', 'last_fullsized': '2024-08-18T22:23:53.241056+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:59.159 INFO:tasks.ceph.ceph_manager.ceph:PG 12.19 is not active+clean 2024-08-18T22:23:59.159 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.234357+0000', 'last_change': '2024-08-18T22:23:53.234357+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.234357+0000', 'last_undegraded': '2024-08-18T22:23:53.234357+0000', 'last_fullsized': '2024-08-18T22:23:53.234357+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.159 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1c is not active+clean 2024-08-18T22:23:59.159 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.234746+0000', 'last_change': '2024-08-18T22:23:53.234746+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.234746+0000', 'last_undegraded': '2024-08-18T22:23:53.234746+0000', 'last_fullsized': '2024-08-18T22:23:53.234746+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.159 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1d is not active+clean 2024-08-18T22:23:59.159 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.235853+0000', 'last_change': '2024-08-18T22:23:53.235853+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.235853+0000', 'last_undegraded': '2024-08-18T22:23:53.235853+0000', 'last_fullsized': '2024-08-18T22:23:53.235853+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.160 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-08-18T22:23:59.160 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.232457+0000', 'last_change': '2024-08-18T22:23:53.232457+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.232457+0000', 'last_undegraded': '2024-08-18T22:23:53.232457+0000', 'last_fullsized': '2024-08-18T22:23:53.232457+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:59.160 INFO:tasks.ceph.ceph_manager.ceph:PG 12.10 is not active+clean 2024-08-18T22:23:59.160 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.233504+0000', 'last_change': '2024-08-18T22:23:53.233504+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.233504+0000', 'last_undegraded': '2024-08-18T22:23:53.233504+0000', 'last_fullsized': '2024-08-18T22:23:53.233504+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.160 INFO:tasks.ceph.ceph_manager.ceph:PG 12.11 is not active+clean 2024-08-18T22:23:59.160 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.232617+0000', 'last_change': '2024-08-18T22:23:53.232617+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.232617+0000', 'last_undegraded': '2024-08-18T22:23:53.232617+0000', 'last_fullsized': '2024-08-18T22:23:53.232617+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:59.160 INFO:tasks.ceph.ceph_manager.ceph:PG 12.12 is not active+clean 2024-08-18T22:23:59.160 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.230747+0000', 'last_change': '2024-08-18T22:23:53.230747+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.230747+0000', 'last_undegraded': '2024-08-18T22:23:53.230747+0000', 'last_fullsized': '2024-08-18T22:23:53.230747+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:23:59.160 INFO:tasks.ceph.ceph_manager.ceph:PG 12.13 is not active+clean 2024-08-18T22:23:59.160 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.240393+0000', 'last_change': '2024-08-18T22:23:53.240393+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.240393+0000', 'last_undegraded': '2024-08-18T22:23:53.240393+0000', 'last_fullsized': '2024-08-18T22:23:53.240393+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:59.161 INFO:tasks.ceph.ceph_manager.ceph:PG 12.14 is not active+clean 2024-08-18T22:23:59.161 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.233341+0000', 'last_change': '2024-08-18T22:23:53.233341+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.233341+0000', 'last_undegraded': '2024-08-18T22:23:53.233341+0000', 'last_fullsized': '2024-08-18T22:23:53.233341+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:23:59.161 INFO:tasks.ceph.ceph_manager.ceph:PG 12.15 is not active+clean 2024-08-18T22:23:59.161 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.232323+0000', 'last_change': '2024-08-18T22:23:53.232323+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.232323+0000', 'last_undegraded': '2024-08-18T22:23:53.232323+0000', 'last_fullsized': '2024-08-18T22:23:53.232323+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:59.161 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-08-18T22:23:59.161 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.237680+0000', 'last_change': '2024-08-18T22:23:53.237680+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.237680+0000', 'last_undegraded': '2024-08-18T22:23:53.237680+0000', 'last_fullsized': '2024-08-18T22:23:53.237680+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:59.161 INFO:tasks.ceph.ceph_manager.ceph:PG 12.17 is not active+clean 2024-08-18T22:23:59.161 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.231938+0000', 'last_change': '2024-08-18T22:23:53.231938+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.231938+0000', 'last_undegraded': '2024-08-18T22:23:53.231938+0000', 'last_fullsized': '2024-08-18T22:23:53.231938+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:59.161 INFO:tasks.ceph.ceph_manager.ceph:PG 12.8 is not active+clean 2024-08-18T22:23:59.161 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.231460+0000', 'last_change': '2024-08-18T22:23:53.231460+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.231460+0000', 'last_undegraded': '2024-08-18T22:23:53.231460+0000', 'last_fullsized': '2024-08-18T22:23:53.231460+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:23:59.162 INFO:tasks.ceph.ceph_manager.ceph:PG 12.b is not active+clean 2024-08-18T22:23:59.162 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.230795+0000', 'last_change': '2024-08-18T22:23:53.230795+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.230795+0000', 'last_undegraded': '2024-08-18T22:23:53.230795+0000', 'last_fullsized': '2024-08-18T22:23:53.230795+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:23:59.162 INFO:tasks.ceph.ceph_manager.ceph:PG 12.c is not active+clean 2024-08-18T22:23:59.162 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.234215+0000', 'last_change': '2024-08-18T22:23:53.234215+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.234215+0000', 'last_undegraded': '2024-08-18T22:23:53.234215+0000', 'last_fullsized': '2024-08-18T22:23:53.234215+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.162 INFO:tasks.ceph.ceph_manager.ceph:PG 12.e is not active+clean 2024-08-18T22:23:59.162 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.236584+0000', 'last_change': '2024-08-18T22:23:53.236584+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.236584+0000', 'last_undegraded': '2024-08-18T22:23:53.236584+0000', 'last_fullsized': '2024-08-18T22:23:53.236584+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.162 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-08-18T22:23:59.162 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.231336+0000', 'last_change': '2024-08-18T22:23:53.231336+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.231336+0000', 'last_undegraded': '2024-08-18T22:23:53.231336+0000', 'last_fullsized': '2024-08-18T22:23:53.231336+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:59.162 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1 is not active+clean 2024-08-18T22:23:59.162 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.232242+0000', 'last_change': '2024-08-18T22:23:53.232242+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.232242+0000', 'last_undegraded': '2024-08-18T22:23:53.232242+0000', 'last_fullsized': '2024-08-18T22:23:53.232242+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:59.162 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3 is not active+clean 2024-08-18T22:23:59.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.234138+0000', 'last_change': '2024-08-18T22:23:53.234138+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.234138+0000', 'last_undegraded': '2024-08-18T22:23:53.234138+0000', 'last_fullsized': '2024-08-18T22:23:53.234138+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:23:59.163 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-08-18T22:23:59.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.235045+0000', 'last_change': '2024-08-18T22:23:53.235045+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.235045+0000', 'last_undegraded': '2024-08-18T22:23:53.235045+0000', 'last_fullsized': '2024-08-18T22:23:53.235045+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:59.163 INFO:tasks.ceph.ceph_manager.ceph:PG 12.5 is not active+clean 2024-08-18T22:23:59.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.231799+0000', 'last_change': '2024-08-18T22:23:53.231799+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.231799+0000', 'last_undegraded': '2024-08-18T22:23:53.231799+0000', 'last_fullsized': '2024-08-18T22:23:53.231799+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:23:59.163 INFO:tasks.ceph.ceph_manager.ceph:PG 12.6 is not active+clean 2024-08-18T22:23:59.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.232202+0000', 'last_change': '2024-08-18T22:23:53.232202+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.232202+0000', 'last_undegraded': '2024-08-18T22:23:53.232202+0000', 'last_fullsized': '2024-08-18T22:23:53.232202+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:59.163 INFO:tasks.ceph.ceph_manager.ceph:PG 12.7 is not active+clean 2024-08-18T22:23:59.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.231519+0000', 'last_change': '2024-08-18T22:23:53.231519+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.231519+0000', 'last_undegraded': '2024-08-18T22:23:53.231519+0000', 'last_fullsized': '2024-08-18T22:23:53.231519+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:23:59.163 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-08-18T22:23:59.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 80, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:23:53.228814+0000', 'last_change': '2024-08-18T22:23:53.228814+0000', 'last_active': '2024-08-18T22:23:53.220736+0000', 'last_peered': '2024-08-18T22:23:53.220736+0000', 'last_clean': '2024-08-18T22:23:53.220736+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:23:53.228814+0000', 'last_undegraded': '2024-08-18T22:23:53.228814+0000', 'last_fullsized': '2024-08-18T22:23:53.228814+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'last_clean_scrub_stamp': '2024-08-18T22:23:53.220736+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:23:59.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:23:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.334+0000 7ffa06c00640 1 Processor -- start 2024-08-18T22:23:59.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.334+0000 7ffa06c00640 1 -- start start 2024-08-18T22:23:59.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ffa06c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa000700b0 0x7ffa0006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ffa06c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa0015c3c0 0x7ffa00070490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ffa06c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa000c78a0 0x7ffa0006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ffa06c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ffa0006c900 con 0x7ffa000700b0 2024-08-18T22:23:59.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ffa06c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ffa00072bb0 con 0x7ffa0015c3c0 2024-08-18T22:23:59.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ffa06c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffa000d1df0 con 0x7ffa000c78a0 2024-08-18T22:23:59.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ff9ffe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa000700b0 0x7ffa0006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ff9ffe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa000700b0 0x7ffa0006c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45268/0 (socket says 172.21.15.5:45268) 2024-08-18T22:23:59.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ff9ffe00640 1 -- 172.21.15.5:0/1072434910 learned_addr learned my addr 172.21.15.5:0/1072434910 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:59.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ff9f7400640 1 --2- 172.21.15.5:0/1072434910 >> v2:172.21.15.117:3300/0 conn(0x7ffa0015c3c0 0x7ffa00070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ffa04c00640 1 --2- 172.21.15.5:0/1072434910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa000c78a0 0x7ffa0006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ff9ffe00640 1 -- 172.21.15.5:0/1072434910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa000c78a0 msgr2=0x7ffa0006ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ff9ffe00640 1 --2- 172.21.15.5:0/1072434910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa000c78a0 0x7ffa0006ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ff9ffe00640 1 -- 172.21.15.5:0/1072434910 >> v2:172.21.15.117:3300/0 conn(0x7ffa0015c3c0 msgr2=0x7ffa00070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ff9ffe00640 1 --2- 172.21.15.5:0/1072434910 >> v2:172.21.15.117:3300/0 conn(0x7ffa0015c3c0 0x7ffa00070490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.338+0000 7ff9ffe00640 1 -- 172.21.15.5:0/1072434910 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa000709d0 con 0x7ffa000700b0 2024-08-18T22:23:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ff9ffe00640 1 --2- 172.21.15.5:0/1072434910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa000700b0 0x7ffa0006c3c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009e80 tx=0x7ff9f001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e8bdca82692bb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ff9ff400640 1 -- 172.21.15.5:0/1072434910 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00a5560 con 0x7ffa000700b0 2024-08-18T22:23:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ff9ff400640 1 -- 172.21.15.5:0/1072434910 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f00a5700 con 0x7ffa000700b0 2024-08-18T22:23:59.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ff9ff400640 1 -- 172.21.15.5:0/1072434910 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00a5ad0 con 0x7ffa000700b0 2024-08-18T22:23:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 -- 172.21.15.5:0/1072434910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa000700b0 msgr2=0x7ffa0006c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 --2- 172.21.15.5:0/1072434910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa000700b0 0x7ffa0006c3c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009e80 tx=0x7ff9f001c6e0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 -- 172.21.15.5:0/1072434910 shutdown_connections 2024-08-18T22:23:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 --2- 172.21.15.5:0/1072434910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa000c78a0 0x7ffa0006ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 --2- 172.21.15.5:0/1072434910 >> v2:172.21.15.117:3300/0 conn(0x7ffa0015c3c0 0x7ffa00070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 --2- 172.21.15.5:0/1072434910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa000700b0 0x7ffa0006c3c0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 -- 172.21.15.5:0/1072434910 >> 172.21.15.5:0/1072434910 conn(0x7ffa000d1010 msgr2=0x7ffa000d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:59.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 -- 172.21.15.5:0/1072434910 shutdown_connections 2024-08-18T22:23:59.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 -- 172.21.15.5:0/1072434910 wait complete. 2024-08-18T22:23:59.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 Processor -- start 2024-08-18T22:23:59.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 -- start start 2024-08-18T22:23:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa000700b0 0x7ffa00148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa000c78a0 0x7ffa0015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0015c3c0 0x7ffa000cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00073900 con 0x7ffa000700b0 2024-08-18T22:23:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa000c7e10 con 0x7ffa0015c3c0 2024-08-18T22:23:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.342+0000 7ffa06c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffa00073a80 con 0x7ffa000c78a0 2024-08-18T22:23:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa000700b0 0x7ffa00148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa000700b0 0x7ffa00148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45276/0 (socket says 172.21.15.5:45276) 2024-08-18T22:23:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9ffe00640 1 -- 172.21.15.5:0/2036128336 learned_addr learned my addr 172.21.15.5:0/2036128336 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9f7400640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa000c78a0 0x7ffa0015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ffa04c00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0015c3c0 0x7ffa000cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9ffe00640 1 -- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa000c78a0 msgr2=0x7ffa0015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9ffe00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa000c78a0 0x7ffa0015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9ffe00640 1 -- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0015c3c0 msgr2=0x7ffa000cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9ffe00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0015c3c0 0x7ffa000cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9ffe00640 1 -- 172.21.15.5:0/2036128336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0015cd00 con 0x7ffa000700b0 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ffa04c00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0015c3c0 0x7ffa000cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9ffe00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa000700b0 0x7ffa00148b00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00af040 tx=0x7ff9f0019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9fcc00640 1 -- 172.21.15.5:0/2036128336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00bc020 con 0x7ffa000700b0 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9fcc00640 1 -- 172.21.15.5:0/2036128336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f00b8670 con 0x7ffa000700b0 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ffa06c00640 1 -- 172.21.15.5:0/2036128336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0015cfe0 con 0x7ffa000700b0 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9fcc00640 1 -- 172.21.15.5:0/2036128336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00a5560 con 0x7ffa000700b0 2024-08-18T22:23:59.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ffa06c00640 1 -- 172.21.15.5:0/2036128336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa0015d5a0 con 0x7ffa000700b0 2024-08-18T22:23:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ffa06c00640 1 -- 172.21.15.5:0/2036128336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa0006ead0 con 0x7ffa000700b0 2024-08-18T22:23:59.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.346+0000 7ff9fcc00640 1 -- 172.21.15.5:0/2036128336 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff9f00bf020 con 0x7ffa000700b0 2024-08-18T22:23:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.350+0000 7ff9fcc00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9dc0678f0 0x7ff9dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.350+0000 7ff9fcc00640 1 -- 172.21.15.5:0/2036128336 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7ff9f01203a0 con 0x7ffa000700b0 2024-08-18T22:23:59.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.350+0000 7ff9f7400640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9dc0678f0 0x7ff9dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.350+0000 7ff9f7400640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9dc0678f0 0x7ff9dc069db0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffa000c89a0 tx=0x7ff9e8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:59.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.354+0000 7ff9fcc00640 1 -- 172.21.15.5:0/2036128336 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff9f00c7020 con 0x7ffa000700b0 2024-08-18T22:23:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 -- 172.21.15.5:0/2036128336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ffa000d0a50 con 0x7ffa000700b0 2024-08-18T22:23:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ff9fcc00640 1 -- 172.21.15.5:0/2036128336 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1559 (secure 0 0 0) 0x7ff9f00165c0 con 0x7ffa000700b0 2024-08-18T22:23:59.578 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:59.578 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":303,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":82,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":50},{"state_name":"creating+peering","count":47}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":591110,"bytes_used":315564032,"bytes_avail":772778549248,"bytes_total":773094113280,"inactive_pgs_ratio":0.48453608155250549,"write_bytes_sec":562,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":56,"btime":"2024-08-18T22:23:57:263294+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":6798}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-08-18T22:23:41.682965+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:23:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 -- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9dc0678f0 msgr2=0x7ff9dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9dc0678f0 0x7ff9dc069db0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffa000c89a0 tx=0x7ff9e8009190 comp rx=0 tx=0).stop 2024-08-18T22:23:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 -- 172.21.15.5:0/2036128336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa000700b0 msgr2=0x7ffa00148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa000700b0 0x7ffa00148b00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00af040 tx=0x7ff9f0019480 comp rx=0 tx=0).stop 2024-08-18T22:23:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 -- 172.21.15.5:0/2036128336 shutdown_connections 2024-08-18T22:23:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9dc0678f0 0x7ff9dc069db0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa0015c3c0 0x7ffa000cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa000c78a0 0x7ffa0015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 --2- 172.21.15.5:0/2036128336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa000700b0 0x7ffa00148b00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 -- 172.21.15.5:0/2036128336 >> 172.21.15.5:0/2036128336 conn(0x7ffa000d1010 msgr2=0x7ffa0006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 -- 172.21.15.5:0/2036128336 shutdown_connections 2024-08-18T22:23:59.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.578+0000 7ffa06c00640 1 -- 172.21.15.5:0/2036128336 wait complete. 2024-08-18T22:23:59.600 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-18T22:23:59.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:23:59.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8f2600640 1 Processor -- start 2024-08-18T22:23:59.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8f2600640 1 -- start start 2024-08-18T22:23:59.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8f2600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8ec0b54c0 0x7fb8ec071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8f2600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb8ec0cbed0 0x7fb8ec0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8f2600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ec071c80 con 0x7fb8ec06dd80 2024-08-18T22:23:59.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8f2600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb8ec0cba40 con 0x7fb8ec0b54c0 2024-08-18T22:23:59.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8f2600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb8ec071f60 con 0x7fb8ec0cbed0 2024-08-18T22:23:59.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8eb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8ec0b54c0 0x7fb8ec071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8eb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8ec0b54c0 0x7fb8ec071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45286/0 (socket says 172.21.15.5:45286) 2024-08-18T22:23:59.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8eb400640 1 -- 172.21.15.5:0/1328070741 learned_addr learned my addr 172.21.15.5:0/1328070741 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:59.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8ebe00640 1 --2- 172.21.15.5:0/1328070741 >> v2:172.21.15.117:3300/0 conn(0x7fb8ec0cbed0 0x7fb8ec0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8eb400640 1 -- 172.21.15.5:0/1328070741 >> v2:172.21.15.117:3300/0 conn(0x7fb8ec0cbed0 msgr2=0x7fb8ec0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:59.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8eb400640 1 --2- 172.21.15.5:0/1328070741 >> v2:172.21.15.117:3300/0 conn(0x7fb8ec0cbed0 0x7fb8ec0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8eb400640 1 -- 172.21.15.5:0/1328070741 >> v1:172.21.15.117:6789/0 conn(0x7fb8ec06dd80 legacy=0x7fb8ec0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:23:59.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.742+0000 7fb8eb400640 1 -- 172.21.15.5:0/1328070741 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec0cb6d0 con 0x7fb8ec0b54c0 2024-08-18T22:23:59.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8eb400640 1 --2- 172.21.15.5:0/1328070741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ec0b54c0 0x7fb8ec071580 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec06f4c0 tx=0x7fb8dc01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e28c347d3b81477 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8ea000640 1 -- 172.21.15.5:0/1328070741 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0b5070 con 0x7fb8ec0b54c0 2024-08-18T22:23:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8ea000640 1 -- 172.21.15.5:0/1328070741 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8dc0a89d0 con 0x7fb8ec0b54c0 2024-08-18T22:23:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8ea000640 1 -- 172.21.15.5:0/1328070741 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0a8da0 con 0x7fb8ec0b54c0 2024-08-18T22:23:59.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8f2600640 1 -- 172.21.15.5:0/1328070741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ec0b54c0 msgr2=0x7fb8ec071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8f2600640 1 --2- 172.21.15.5:0/1328070741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ec0b54c0 0x7fb8ec071580 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec06f4c0 tx=0x7fb8dc01ecd0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8f2600640 1 -- 172.21.15.5:0/1328070741 shutdown_connections 2024-08-18T22:23:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8f2600640 1 --2- 172.21.15.5:0/1328070741 >> v2:172.21.15.117:3300/0 conn(0x7fb8ec0cbed0 0x7fb8ec0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8f2600640 1 --2- 172.21.15.5:0/1328070741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ec0b54c0 0x7fb8ec071580 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8f2600640 1 -- 172.21.15.5:0/1328070741 >> 172.21.15.5:0/1328070741 conn(0x7fb8ec0b3eb0 msgr2=0x7fb8ec0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8f2600640 1 -- 172.21.15.5:0/1328070741 shutdown_connections 2024-08-18T22:23:59.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.746+0000 7fb8f2600640 1 -- 172.21.15.5:0/1328070741 wait complete. 2024-08-18T22:23:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8f2600640 1 Processor -- start 2024-08-18T22:23:59.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8f2600640 1 -- start start 2024-08-18T22:23:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8f2600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ec06dd80 0x7fb8ec15d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8f2600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8ec0b54c0 0x7fb8ec15d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8f2600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8ec0cbed0 0x7fb8ec1f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8f2600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec1481a0 con 0x7fb8ec06dd80 2024-08-18T22:23:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8f2600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec148020 con 0x7fb8ec0b54c0 2024-08-18T22:23:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8f2600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb8ec0cc8a0 con 0x7fb8ec0cbed0 2024-08-18T22:23:59.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8eb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ec06dd80 0x7fb8ec15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8eb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ec06dd80 0x7fb8ec15d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45288/0 (socket says 172.21.15.5:45288) 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8eb400640 1 -- 172.21.15.5:0/2996805280 learned_addr learned my addr 172.21.15.5:0/2996805280 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8eaa00640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8ec0b54c0 0x7fb8ec15d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8ebe00640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8ec0cbed0 0x7fb8ec1f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8eb400640 1 -- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8ec0cbed0 msgr2=0x7fb8ec1f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8eb400640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8ec0cbed0 0x7fb8ec1f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8eb400640 1 -- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8ec0b54c0 msgr2=0x7fb8ec15d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8eb400640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8ec0b54c0 0x7fb8ec15d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8eb400640 1 -- 172.21.15.5:0/2996805280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec13f360 con 0x7fb8ec06dd80 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8eb400640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ec06dd80 0x7fb8ec15d060 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc01c900 tx=0x7fb8dc01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8e3400640 1 -- 172.21.15.5:0/2996805280 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0b5070 con 0x7fb8ec06dd80 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8e3400640 1 -- 172.21.15.5:0/2996805280 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8dc0b0a70 con 0x7fb8ec06dd80 2024-08-18T22:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8e3400640 1 -- 172.21.15.5:0/2996805280 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0b0e60 con 0x7fb8ec06dd80 2024-08-18T22:23:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8f2600640 1 -- 172.21.15.5:0/2996805280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ec13f640 con 0x7fb8ec06dd80 2024-08-18T22:23:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8f2600640 1 -- 172.21.15.5:0/2996805280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ec15fb10 con 0x7fb8ec06dd80 2024-08-18T22:23:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.750+0000 7fb8f2600640 1 -- 172.21.15.5:0/2996805280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ec0cc360 con 0x7fb8ec06dd80 2024-08-18T22:23:59.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.754+0000 7fb8e3400640 1 -- 172.21.15.5:0/2996805280 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb8dc0c2060 con 0x7fb8ec06dd80 2024-08-18T22:23:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.754+0000 7fb8e3400640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8cc0678c0 0x7fb8cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:23:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.754+0000 7fb8e3400640 1 -- 172.21.15.5:0/2996805280 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7fb8dc122f90 con 0x7fb8ec06dd80 2024-08-18T22:23:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.754+0000 7fb8eaa00640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8cc0678c0 0x7fb8cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:23:59.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.754+0000 7fb8eaa00640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8cc0678c0 0x7fb8cc069d80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0b1c70 tx=0x7fb8d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:23:59.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.758+0000 7fb8e3400640 1 -- 172.21.15.5:0/2996805280 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb8dc018830 con 0x7fb8ec06dd80 2024-08-18T22:23:59.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.922+0000 7fb8f2600640 1 -- 172.21.15.5:0/2996805280 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8ec15e510 con 0x7fb8cc0678c0 2024-08-18T22:23:59.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.930+0000 7fb8e3400640 1 -- 172.21.15.5:0/2996805280 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252077 (secure 0 0 0) 0x7fb8ec15e510 con 0x7fb8cc0678c0 2024-08-18T22:23:59.931 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:23:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:23:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 -- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8cc0678c0 msgr2=0x7fb8cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8cc0678c0 0x7fb8cc069d80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0b1c70 tx=0x7fb8d8009040 comp rx=0 tx=0).stop 2024-08-18T22:23:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 -- 172.21.15.5:0/2996805280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ec06dd80 msgr2=0x7fb8ec15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:23:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ec06dd80 0x7fb8ec15d060 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc01c900 tx=0x7fb8dc01ba70 comp rx=0 tx=0).stop 2024-08-18T22:23:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 -- 172.21.15.5:0/2996805280 shutdown_connections 2024-08-18T22:23:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb8cc0678c0 0x7fb8cc069d80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8ec0cbed0 0x7fb8ec1f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8ec0b54c0 0x7fb8ec15d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 --2- 172.21.15.5:0/2996805280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8ec06dd80 0x7fb8ec15d060 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:23:59.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 -- 172.21.15.5:0/2996805280 >> 172.21.15.5:0/2996805280 conn(0x7fb8ec0b3eb0 msgr2=0x7fb8ec0b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:23:59.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 -- 172.21.15.5:0/2996805280 shutdown_connections 2024-08-18T22:23:59.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:23:59.934+0000 7fb8f2600640 1 -- 172.21.15.5:0/2996805280 wait complete. 2024-08-18T22:23:59.952 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-08-18T22:23:59.687012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":308388,"kb_used_data":9000,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754666332,"statfs":{"total":773094113280,"available":772778323968,"internally_reserved":0,"allocated":9216000,"data_stored":4847892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.462130"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260758+0000","last_change":"2024-08-18T22:23:54.263562+0000","last_active":"2024-08-18T22:23:55.260758+0000","last_peered":"2024-08-18T22:23:55.260758+0000","last_clean":"2024-08-18T22:23:55.260758+0000","last_became_active":"2024-08-18T22:23:54.261605+0000","last_became_peered":"2024-08-18T22:23:54.261605+0000","last_unstale":"2024-08-18T22:23:55.260758+0000","last_undegraded":"2024-08-18T22:23:55.260758+0000","last_fullsized":"2024-08-18T22:23:55.260758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:43.369108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261789+0000","last_change":"2024-08-18T22:23:54.255025+0000","last_active":"2024-08-18T22:23:55.261789+0000","last_peered":"2024-08-18T22:23:55.261789+0000","last_clean":"2024-08-18T22:23:55.261789+0000","last_became_active":"2024-08-18T22:23:54.254764+0000","last_became_peered":"2024-08-18T22:23:54.254764+0000","last_unstale":"2024-08-18T22:23:55.261789+0000","last_undegraded":"2024-08-18T22:23:55.261789+0000","last_fullsized":"2024-08-18T22:23:55.261789+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:19.685937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731861+0000","last_change":"2024-08-18T22:23:54.272417+0000","last_active":"2024-08-18T22:23:55.731861+0000","last_peered":"2024-08-18T22:23:55.731861+0000","last_clean":"2024-08-18T22:23:55.731861+0000","last_became_active":"2024-08-18T22:23:54.272149+0000","last_became_peered":"2024-08-18T22:23:54.272149+0000","last_unstale":"2024-08-18T22:23:55.731861+0000","last_undegraded":"2024-08-18T22:23:55.731861+0000","last_fullsized":"2024-08-18T22:23:55.731861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:43:05.105997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729802+0000","last_change":"2024-08-18T22:23:54.261667+0000","last_active":"2024-08-18T22:23:55.729802+0000","last_peered":"2024-08-18T22:23:55.729802+0000","last_clean":"2024-08-18T22:23:55.729802+0000","last_became_active":"2024-08-18T22:23:54.261354+0000","last_became_peered":"2024-08-18T22:23:54.261354+0000","last_unstale":"2024-08-18T22:23:55.729802+0000","last_undegraded":"2024-08-18T22:23:55.729802+0000","last_fullsized":"2024-08-18T22:23:55.729802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:22.612174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264328+0000","last_change":"2024-08-18T22:23:54.255429+0000","last_active":"2024-08-18T22:23:55.264328+0000","last_peered":"2024-08-18T22:23:55.264328+0000","last_clean":"2024-08-18T22:23:55.264328+0000","last_became_active":"2024-08-18T22:23:54.254830+0000","last_became_peered":"2024-08-18T22:23:54.254830+0000","last_unstale":"2024-08-18T22:23:55.264328+0000","last_undegraded":"2024-08-18T22:23:55.264328+0000","last_fullsized":"2024-08-18T22:23:55.264328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:49.556352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730936+0000","last_change":"2024-08-18T22:23:54.269136+0000","last_active":"2024-08-18T22:23:55.730936+0000","last_peered":"2024-08-18T22:23:55.730936+0000","last_clean":"2024-08-18T22:23:55.730936+0000","last_became_active":"2024-08-18T22:23:54.268506+0000","last_became_peered":"2024-08-18T22:23:54.268506+0000","last_unstale":"2024-08-18T22:23:55.730936+0000","last_undegraded":"2024-08-18T22:23:55.730936+0000","last_fullsized":"2024-08-18T22:23:55.730936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:48:08.804440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.258655+0000","last_change":"2024-08-18T22:23:54.263617+0000","last_active":"2024-08-18T22:23:55.258655+0000","last_peered":"2024-08-18T22:23:55.258655+0000","last_clean":"2024-08-18T22:23:55.258655+0000","last_became_active":"2024-08-18T22:23:54.261981+0000","last_became_peered":"2024-08-18T22:23:54.261981+0000","last_unstale":"2024-08-18T22:23:55.258655+0000","last_undegraded":"2024-08-18T22:23:55.258655+0000","last_fullsized":"2024-08-18T22:23:55.258655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:50:57.847238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.263983+0000","last_change":"2024-08-18T22:23:54.253390+0000","last_active":"2024-08-18T22:23:55.263983+0000","last_peered":"2024-08-18T22:23:55.263983+0000","last_clean":"2024-08-18T22:23:55.263983+0000","last_became_active":"2024-08-18T22:23:54.253085+0000","last_became_peered":"2024-08-18T22:23:54.253085+0000","last_unstale":"2024-08-18T22:23:55.263983+0000","last_undegraded":"2024-08-18T22:23:55.263983+0000","last_fullsized":"2024-08-18T22:23:55.263983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:14.303897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261466+0000","last_change":"2024-08-18T22:23:54.258688+0000","last_active":"2024-08-18T22:23:55.261466+0000","last_peered":"2024-08-18T22:23:55.261466+0000","last_clean":"2024-08-18T22:23:55.261466+0000","last_became_active":"2024-08-18T22:23:54.258436+0000","last_became_peered":"2024-08-18T22:23:54.258436+0000","last_unstale":"2024-08-18T22:23:55.261466+0000","last_undegraded":"2024-08-18T22:23:55.261466+0000","last_fullsized":"2024-08-18T22:23:55.261466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:10.210409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729902+0000","last_change":"2024-08-18T22:23:54.250886+0000","last_active":"2024-08-18T22:23:55.729902+0000","last_peered":"2024-08-18T22:23:55.729902+0000","last_clean":"2024-08-18T22:23:55.729902+0000","last_became_active":"2024-08-18T22:23:54.250614+0000","last_became_peered":"2024-08-18T22:23:54.250614+0000","last_unstale":"2024-08-18T22:23:55.729902+0000","last_undegraded":"2024-08-18T22:23:55.729902+0000","last_fullsized":"2024-08-18T22:23:55.729902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:21.059579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261535+0000","last_change":"2024-08-18T22:23:54.266206+0000","last_active":"2024-08-18T22:23:55.261535+0000","last_peered":"2024-08-18T22:23:55.261535+0000","last_clean":"2024-08-18T22:23:55.261535+0000","last_became_active":"2024-08-18T22:23:54.265612+0000","last_became_peered":"2024-08-18T22:23:54.265612+0000","last_unstale":"2024-08-18T22:23:55.261535+0000","last_undegraded":"2024-08-18T22:23:55.261535+0000","last_fullsized":"2024-08-18T22:23:55.261535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:14.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729805+0000","last_change":"2024-08-18T22:23:54.254425+0000","last_active":"2024-08-18T22:23:55.729805+0000","last_peered":"2024-08-18T22:23:55.729805+0000","last_clean":"2024-08-18T22:23:55.729805+0000","last_became_active":"2024-08-18T22:23:54.252961+0000","last_became_peered":"2024-08-18T22:23:54.252961+0000","last_unstale":"2024-08-18T22:23:55.729805+0000","last_undegraded":"2024-08-18T22:23:55.729805+0000","last_fullsized":"2024-08-18T22:23:55.729805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:43.819630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264361+0000","last_change":"2024-08-18T22:23:54.254445+0000","last_active":"2024-08-18T22:23:55.264361+0000","last_peered":"2024-08-18T22:23:55.264361+0000","last_clean":"2024-08-18T22:23:55.264361+0000","last_became_active":"2024-08-18T22:23:54.254125+0000","last_became_peered":"2024-08-18T22:23:54.254125+0000","last_unstale":"2024-08-18T22:23:55.264361+0000","last_undegraded":"2024-08-18T22:23:55.264361+0000","last_fullsized":"2024-08-18T22:23:55.264361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:07.096296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731202+0000","last_change":"2024-08-18T22:23:54.268915+0000","last_active":"2024-08-18T22:23:55.731202+0000","last_peered":"2024-08-18T22:23:55.731202+0000","last_clean":"2024-08-18T22:23:55.731202+0000","last_became_active":"2024-08-18T22:23:54.268094+0000","last_became_peered":"2024-08-18T22:23:54.268094+0000","last_unstale":"2024-08-18T22:23:55.731202+0000","last_undegraded":"2024-08-18T22:23:55.731202+0000","last_fullsized":"2024-08-18T22:23:55.731202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:11.384499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261334+0000","last_change":"2024-08-18T22:23:54.261811+0000","last_active":"2024-08-18T22:23:55.261334+0000","last_peered":"2024-08-18T22:23:55.261334+0000","last_clean":"2024-08-18T22:23:55.261334+0000","last_became_active":"2024-08-18T22:23:54.257343+0000","last_became_peered":"2024-08-18T22:23:54.257343+0000","last_unstale":"2024-08-18T22:23:55.261334+0000","last_undegraded":"2024-08-18T22:23:55.261334+0000","last_fullsized":"2024-08-18T22:23:55.261334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:14.751154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259728+0000","last_change":"2024-08-18T22:23:54.262341+0000","last_active":"2024-08-18T22:23:55.259728+0000","last_peered":"2024-08-18T22:23:55.259728+0000","last_clean":"2024-08-18T22:23:55.259728+0000","last_became_active":"2024-08-18T22:23:54.262029+0000","last_became_peered":"2024-08-18T22:23:54.262029+0000","last_unstale":"2024-08-18T22:23:55.259728+0000","last_undegraded":"2024-08-18T22:23:55.259728+0000","last_fullsized":"2024-08-18T22:23:55.259728+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:01.834571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264661+0000","last_change":"2024-08-18T22:23:54.259132+0000","last_active":"2024-08-18T22:23:55.264661+0000","last_peered":"2024-08-18T22:23:55.264661+0000","last_clean":"2024-08-18T22:23:55.264661+0000","last_became_active":"2024-08-18T22:23:54.258811+0000","last_became_peered":"2024-08-18T22:23:54.258811+0000","last_unstale":"2024-08-18T22:23:55.264661+0000","last_undegraded":"2024-08-18T22:23:55.264661+0000","last_fullsized":"2024-08-18T22:23:55.264661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:48.771970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731547+0000","last_change":"2024-08-18T22:23:54.270366+0000","last_active":"2024-08-18T22:23:55.731547+0000","last_peered":"2024-08-18T22:23:55.731547+0000","last_clean":"2024-08-18T22:23:55.731547+0000","last_became_active":"2024-08-18T22:23:54.270118+0000","last_became_peered":"2024-08-18T22:23:54.270118+0000","last_unstale":"2024-08-18T22:23:55.731547+0000","last_undegraded":"2024-08-18T22:23:55.731547+0000","last_fullsized":"2024-08-18T22:23:55.731547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:48.305326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731492+0000","last_change":"2024-08-18T22:23:54.264485+0000","last_active":"2024-08-18T22:23:55.731492+0000","last_peered":"2024-08-18T22:23:55.731492+0000","last_clean":"2024-08-18T22:23:55.731492+0000","last_became_active":"2024-08-18T22:23:54.262893+0000","last_became_peered":"2024-08-18T22:23:54.262893+0000","last_unstale":"2024-08-18T22:23:55.731492+0000","last_undegraded":"2024-08-18T22:23:55.731492+0000","last_fullsized":"2024-08-18T22:23:55.731492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:34.989767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264433+0000","last_change":"2024-08-18T22:23:54.262936+0000","last_active":"2024-08-18T22:23:55.264433+0000","last_peered":"2024-08-18T22:23:55.264433+0000","last_clean":"2024-08-18T22:23:55.264433+0000","last_became_active":"2024-08-18T22:23:54.262665+0000","last_became_peered":"2024-08-18T22:23:54.262665+0000","last_unstale":"2024-08-18T22:23:55.264433+0000","last_undegraded":"2024-08-18T22:23:55.264433+0000","last_fullsized":"2024-08-18T22:23:55.264433+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:34.017166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261382+0000","last_change":"2024-08-18T22:23:54.267084+0000","last_active":"2024-08-18T22:23:55.261382+0000","last_peered":"2024-08-18T22:23:55.261382+0000","last_clean":"2024-08-18T22:23:55.261382+0000","last_became_active":"2024-08-18T22:23:54.266792+0000","last_became_peered":"2024-08-18T22:23:54.266792+0000","last_unstale":"2024-08-18T22:23:55.261382+0000","last_undegraded":"2024-08-18T22:23:55.261382+0000","last_fullsized":"2024-08-18T22:23:55.261382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:27:37.035990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264190+0000","last_change":"2024-08-18T22:23:54.262252+0000","last_active":"2024-08-18T22:23:55.264190+0000","last_peered":"2024-08-18T22:23:55.264190+0000","last_clean":"2024-08-18T22:23:55.264190+0000","last_became_active":"2024-08-18T22:23:54.261976+0000","last_became_peered":"2024-08-18T22:23:54.261976+0000","last_unstale":"2024-08-18T22:23:55.264190+0000","last_undegraded":"2024-08-18T22:23:55.264190+0000","last_fullsized":"2024-08-18T22:23:55.264190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:27.688388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261229+0000","last_change":"2024-08-18T22:23:54.269243+0000","last_active":"2024-08-18T22:23:55.261229+0000","last_peered":"2024-08-18T22:23:55.261229+0000","last_clean":"2024-08-18T22:23:55.261229+0000","last_became_active":"2024-08-18T22:23:54.268935+0000","last_became_peered":"2024-08-18T22:23:54.268935+0000","last_unstale":"2024-08-18T22:23:55.261229+0000","last_undegraded":"2024-08-18T22:23:55.261229+0000","last_fullsized":"2024-08-18T22:23:55.261229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:56:07.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261254+0000","last_change":"2024-08-18T22:23:54.265593+0000","last_active":"2024-08-18T22:23:55.261254+0000","last_peered":"2024-08-18T22:23:55.261254+0000","last_clean":"2024-08-18T22:23:55.261254+0000","last_became_active":"2024-08-18T22:23:54.265327+0000","last_became_peered":"2024-08-18T22:23:54.265327+0000","last_unstale":"2024-08-18T22:23:55.261254+0000","last_undegraded":"2024-08-18T22:23:55.261254+0000","last_fullsized":"2024-08-18T22:23:55.261254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:56.919160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261633+0000","last_change":"2024-08-18T22:23:54.267642+0000","last_active":"2024-08-18T22:23:55.261633+0000","last_peered":"2024-08-18T22:23:55.261633+0000","last_clean":"2024-08-18T22:23:55.261633+0000","last_became_active":"2024-08-18T22:23:54.266065+0000","last_became_peered":"2024-08-18T22:23:54.266065+0000","last_unstale":"2024-08-18T22:23:55.261633+0000","last_undegraded":"2024-08-18T22:23:55.261633+0000","last_fullsized":"2024-08-18T22:23:55.261633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:34.989767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729917+0000","last_change":"2024-08-18T22:23:54.264840+0000","last_active":"2024-08-18T22:23:55.729917+0000","last_peered":"2024-08-18T22:23:55.729917+0000","last_clean":"2024-08-18T22:23:55.729917+0000","last_became_active":"2024-08-18T22:23:54.264556+0000","last_became_peered":"2024-08-18T22:23:54.264556+0000","last_unstale":"2024-08-18T22:23:55.729917+0000","last_undegraded":"2024-08-18T22:23:55.729917+0000","last_fullsized":"2024-08-18T22:23:55.729917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:37:54.237863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260038+0000","last_change":"2024-08-18T22:23:54.262238+0000","last_active":"2024-08-18T22:23:55.260038+0000","last_peered":"2024-08-18T22:23:55.260038+0000","last_clean":"2024-08-18T22:23:55.260038+0000","last_became_active":"2024-08-18T22:23:54.261912+0000","last_became_peered":"2024-08-18T22:23:54.261912+0000","last_unstale":"2024-08-18T22:23:55.260038+0000","last_undegraded":"2024-08-18T22:23:55.260038+0000","last_fullsized":"2024-08-18T22:23:55.260038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:43.557492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264452+0000","last_change":"2024-08-18T22:23:54.269533+0000","last_active":"2024-08-18T22:23:55.264452+0000","last_peered":"2024-08-18T22:23:55.264452+0000","last_clean":"2024-08-18T22:23:55.264452+0000","last_became_active":"2024-08-18T22:23:54.269250+0000","last_became_peered":"2024-08-18T22:23:54.269250+0000","last_unstale":"2024-08-18T22:23:55.264452+0000","last_undegraded":"2024-08-18T22:23:55.264452+0000","last_fullsized":"2024-08-18T22:23:55.264452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:38:29.318017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261579+0000","last_change":"2024-08-18T22:23:54.254134+0000","last_active":"2024-08-18T22:23:55.261579+0000","last_peered":"2024-08-18T22:23:55.261579+0000","last_clean":"2024-08-18T22:23:55.261579+0000","last_became_active":"2024-08-18T22:23:54.251553+0000","last_became_peered":"2024-08-18T22:23:54.251553+0000","last_unstale":"2024-08-18T22:23:55.261579+0000","last_undegraded":"2024-08-18T22:23:55.261579+0000","last_fullsized":"2024-08-18T22:23:55.261579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:43:49.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260197+0000","last_change":"2024-08-18T22:23:54.252115+0000","last_active":"2024-08-18T22:23:55.260197+0000","last_peered":"2024-08-18T22:23:55.260197+0000","last_clean":"2024-08-18T22:23:55.260197+0000","last_became_active":"2024-08-18T22:23:54.251338+0000","last_became_peered":"2024-08-18T22:23:54.251338+0000","last_unstale":"2024-08-18T22:23:55.260197+0000","last_undegraded":"2024-08-18T22:23:55.260197+0000","last_fullsized":"2024-08-18T22:23:55.260197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:56.919160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731125+0000","last_change":"2024-08-18T22:23:54.263663+0000","last_active":"2024-08-18T22:23:55.731125+0000","last_peered":"2024-08-18T22:23:55.731125+0000","last_clean":"2024-08-18T22:23:55.731125+0000","last_became_active":"2024-08-18T22:23:54.263393+0000","last_became_peered":"2024-08-18T22:23:54.263393+0000","last_unstale":"2024-08-18T22:23:55.731125+0000","last_undegraded":"2024-08-18T22:23:55.731125+0000","last_fullsized":"2024-08-18T22:23:55.731125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:35:05.822021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259902+0000","last_change":"2024-08-18T22:23:54.258891+0000","last_active":"2024-08-18T22:23:55.259902+0000","last_peered":"2024-08-18T22:23:55.259902+0000","last_clean":"2024-08-18T22:23:55.259902+0000","last_became_active":"2024-08-18T22:23:54.258211+0000","last_became_peered":"2024-08-18T22:23:54.258211+0000","last_unstale":"2024-08-18T22:23:55.259902+0000","last_undegraded":"2024-08-18T22:23:55.259902+0000","last_fullsized":"2024-08-18T22:23:55.259902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:10.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730899+0000","last_change":"2024-08-18T22:23:54.272076+0000","last_active":"2024-08-18T22:23:55.730899+0000","last_peered":"2024-08-18T22:23:55.730899+0000","last_clean":"2024-08-18T22:23:55.730899+0000","last_became_active":"2024-08-18T22:23:54.269764+0000","last_became_peered":"2024-08-18T22:23:54.269764+0000","last_unstale":"2024-08-18T22:23:55.730899+0000","last_undegraded":"2024-08-18T22:23:55.730899+0000","last_fullsized":"2024-08-18T22:23:55.730899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:43:00.817444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264673+0000","last_change":"2024-08-18T22:23:53.251250+0000","last_active":"2024-08-18T22:23:55.264673+0000","last_peered":"2024-08-18T22:23:55.264673+0000","last_clean":"2024-08-18T22:23:55.264673+0000","last_became_active":"2024-08-18T22:23:53.250935+0000","last_became_peered":"2024-08-18T22:23:53.250935+0000","last_unstale":"2024-08-18T22:23:55.264673+0000","last_undegraded":"2024-08-18T22:23:55.264673+0000","last_fullsized":"2024-08-18T22:23:55.264673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:44.891601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261370+0000","last_change":"2024-08-18T22:23:54.250589+0000","last_active":"2024-08-18T22:23:55.261370+0000","last_peered":"2024-08-18T22:23:55.261370+0000","last_clean":"2024-08-18T22:23:55.261370+0000","last_became_active":"2024-08-18T22:23:54.249729+0000","last_became_peered":"2024-08-18T22:23:54.249729+0000","last_unstale":"2024-08-18T22:23:55.261370+0000","last_undegraded":"2024-08-18T22:23:55.261370+0000","last_fullsized":"2024-08-18T22:23:55.261370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:43.369108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259963+0000","last_change":"2024-08-18T22:23:53.245851+0000","last_active":"2024-08-18T22:23:55.259963+0000","last_peered":"2024-08-18T22:23:55.259963+0000","last_clean":"2024-08-18T22:23:55.259963+0000","last_became_active":"2024-08-18T22:23:53.245598+0000","last_became_peered":"2024-08-18T22:23:53.245598+0000","last_unstale":"2024-08-18T22:23:55.259963+0000","last_undegraded":"2024-08-18T22:23:55.259963+0000","last_fullsized":"2024-08-18T22:23:55.259963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:03:46.748213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261043+0000","last_change":"2024-08-18T22:23:54.264243+0000","last_active":"2024-08-18T22:23:55.261043+0000","last_peered":"2024-08-18T22:23:55.261043+0000","last_clean":"2024-08-18T22:23:55.261043+0000","last_became_active":"2024-08-18T22:23:54.263437+0000","last_became_peered":"2024-08-18T22:23:54.263437+0000","last_unstale":"2024-08-18T22:23:55.261043+0000","last_undegraded":"2024-08-18T22:23:55.261043+0000","last_fullsized":"2024-08-18T22:23:55.261043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:02.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260139+0000","last_change":"2024-08-18T22:23:53.249485+0000","last_active":"2024-08-18T22:23:55.260139+0000","last_peered":"2024-08-18T22:23:55.260139+0000","last_clean":"2024-08-18T22:23:55.260139+0000","last_became_active":"2024-08-18T22:23:53.248070+0000","last_became_peered":"2024-08-18T22:23:53.248070+0000","last_unstale":"2024-08-18T22:23:55.260139+0000","last_undegraded":"2024-08-18T22:23:55.260139+0000","last_fullsized":"2024-08-18T22:23:55.260139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:44:28.117828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261499+0000","last_change":"2024-08-18T22:23:54.266316+0000","last_active":"2024-08-18T22:23:55.261499+0000","last_peered":"2024-08-18T22:23:55.261499+0000","last_clean":"2024-08-18T22:23:55.261499+0000","last_became_active":"2024-08-18T22:23:54.265936+0000","last_became_peered":"2024-08-18T22:23:54.265936+0000","last_unstale":"2024-08-18T22:23:55.261499+0000","last_undegraded":"2024-08-18T22:23:55.261499+0000","last_fullsized":"2024-08-18T22:23:55.261499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:00:03.812617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259483+0000","last_change":"2024-08-18T22:23:53.243356+0000","last_active":"2024-08-18T22:23:55.259483+0000","last_peered":"2024-08-18T22:23:55.259483+0000","last_clean":"2024-08-18T22:23:55.259483+0000","last_became_active":"2024-08-18T22:23:53.243055+0000","last_became_peered":"2024-08-18T22:23:53.243055+0000","last_unstale":"2024-08-18T22:23:55.259483+0000","last_undegraded":"2024-08-18T22:23:55.259483+0000","last_fullsized":"2024-08-18T22:23:55.259483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:14:48.702864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261610+0000","last_change":"2024-08-18T22:23:54.263909+0000","last_active":"2024-08-18T22:23:55.261610+0000","last_peered":"2024-08-18T22:23:55.261610+0000","last_clean":"2024-08-18T22:23:55.261610+0000","last_became_active":"2024-08-18T22:23:54.261699+0000","last_became_peered":"2024-08-18T22:23:54.261699+0000","last_unstale":"2024-08-18T22:23:55.261610+0000","last_undegraded":"2024-08-18T22:23:55.261610+0000","last_fullsized":"2024-08-18T22:23:55.261610+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:53.384493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261622+0000","last_change":"2024-08-18T22:23:53.240275+0000","last_active":"2024-08-18T22:23:55.261622+0000","last_peered":"2024-08-18T22:23:55.261622+0000","last_clean":"2024-08-18T22:23:55.261622+0000","last_became_active":"2024-08-18T22:23:53.239803+0000","last_became_peered":"2024-08-18T22:23:53.239803+0000","last_unstale":"2024-08-18T22:23:55.261622+0000","last_undegraded":"2024-08-18T22:23:55.261622+0000","last_fullsized":"2024-08-18T22:23:55.261622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:22.345962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261620+0000","last_change":"2024-08-18T22:23:54.265879+0000","last_active":"2024-08-18T22:23:55.261620+0000","last_peered":"2024-08-18T22:23:55.261620+0000","last_clean":"2024-08-18T22:23:55.261620+0000","last_became_active":"2024-08-18T22:23:54.265273+0000","last_became_peered":"2024-08-18T22:23:54.265273+0000","last_unstale":"2024-08-18T22:23:55.261620+0000","last_undegraded":"2024-08-18T22:23:55.261620+0000","last_fullsized":"2024-08-18T22:23:55.261620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:11.384499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729837+0000","last_change":"2024-08-18T22:23:53.247955+0000","last_active":"2024-08-18T22:23:55.729837+0000","last_peered":"2024-08-18T22:23:55.729837+0000","last_clean":"2024-08-18T22:23:55.729837+0000","last_became_active":"2024-08-18T22:23:53.246744+0000","last_became_peered":"2024-08-18T22:23:53.246744+0000","last_unstale":"2024-08-18T22:23:55.729837+0000","last_undegraded":"2024-08-18T22:23:55.729837+0000","last_fullsized":"2024-08-18T22:23:55.729837+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:11:00.515699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261582+0000","last_change":"2024-08-18T22:23:54.257636+0000","last_active":"2024-08-18T22:23:55.261582+0000","last_peered":"2024-08-18T22:23:55.261582+0000","last_clean":"2024-08-18T22:23:55.261582+0000","last_became_active":"2024-08-18T22:23:54.257280+0000","last_became_peered":"2024-08-18T22:23:54.257280+0000","last_unstale":"2024-08-18T22:23:55.261582+0000","last_undegraded":"2024-08-18T22:23:55.261582+0000","last_fullsized":"2024-08-18T22:23:55.261582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:50.911549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261426+0000","last_change":"2024-08-18T22:23:53.245559+0000","last_active":"2024-08-18T22:23:55.261426+0000","last_peered":"2024-08-18T22:23:55.261426+0000","last_clean":"2024-08-18T22:23:55.261426+0000","last_became_active":"2024-08-18T22:23:53.245269+0000","last_became_peered":"2024-08-18T22:23:53.245269+0000","last_unstale":"2024-08-18T22:23:55.261426+0000","last_undegraded":"2024-08-18T22:23:55.261426+0000","last_fullsized":"2024-08-18T22:23:55.261426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:24.173939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261804+0000","last_change":"2024-08-18T22:23:54.263906+0000","last_active":"2024-08-18T22:23:55.261804+0000","last_peered":"2024-08-18T22:23:55.261804+0000","last_clean":"2024-08-18T22:23:55.261804+0000","last_became_active":"2024-08-18T22:23:54.262997+0000","last_became_peered":"2024-08-18T22:23:54.262997+0000","last_unstale":"2024-08-18T22:23:55.261804+0000","last_undegraded":"2024-08-18T22:23:55.261804+0000","last_fullsized":"2024-08-18T22:23:55.261804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:49.987310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264053+0000","last_change":"2024-08-18T22:23:53.246914+0000","last_active":"2024-08-18T22:23:55.264053+0000","last_peered":"2024-08-18T22:23:55.264053+0000","last_clean":"2024-08-18T22:23:55.264053+0000","last_became_active":"2024-08-18T22:23:53.246609+0000","last_became_peered":"2024-08-18T22:23:53.246609+0000","last_unstale":"2024-08-18T22:23:55.264053+0000","last_undegraded":"2024-08-18T22:23:55.264053+0000","last_fullsized":"2024-08-18T22:23:55.264053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:49.756736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261281+0000","last_change":"2024-08-18T22:23:54.250695+0000","last_active":"2024-08-18T22:23:55.261281+0000","last_peered":"2024-08-18T22:23:55.261281+0000","last_clean":"2024-08-18T22:23:55.261281+0000","last_became_active":"2024-08-18T22:23:54.250388+0000","last_became_peered":"2024-08-18T22:23:54.250388+0000","last_unstale":"2024-08-18T22:23:55.261281+0000","last_undegraded":"2024-08-18T22:23:55.261281+0000","last_fullsized":"2024-08-18T22:23:55.261281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:48:08.804440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260854+0000","last_change":"2024-08-18T22:23:53.242509+0000","last_active":"2024-08-18T22:23:55.260854+0000","last_peered":"2024-08-18T22:23:55.260854+0000","last_clean":"2024-08-18T22:23:55.260854+0000","last_became_active":"2024-08-18T22:23:53.242205+0000","last_became_peered":"2024-08-18T22:23:53.242205+0000","last_unstale":"2024-08-18T22:23:55.260854+0000","last_undegraded":"2024-08-18T22:23:55.260854+0000","last_fullsized":"2024-08-18T22:23:55.260854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:17:30.070215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729753+0000","last_change":"2024-08-18T22:23:54.268447+0000","last_active":"2024-08-18T22:23:55.729753+0000","last_peered":"2024-08-18T22:23:55.729753+0000","last_clean":"2024-08-18T22:23:55.729753+0000","last_became_active":"2024-08-18T22:23:54.268120+0000","last_became_peered":"2024-08-18T22:23:54.268120+0000","last_unstale":"2024-08-18T22:23:55.729753+0000","last_undegraded":"2024-08-18T22:23:55.729753+0000","last_fullsized":"2024-08-18T22:23:55.729753+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:35:25.612886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730048+0000","last_change":"2024-08-18T22:23:53.245330+0000","last_active":"2024-08-18T22:23:55.730048+0000","last_peered":"2024-08-18T22:23:55.730048+0000","last_clean":"2024-08-18T22:23:55.730048+0000","last_became_active":"2024-08-18T22:23:53.243674+0000","last_became_peered":"2024-08-18T22:23:53.243674+0000","last_unstale":"2024-08-18T22:23:55.730048+0000","last_undegraded":"2024-08-18T22:23:55.730048+0000","last_fullsized":"2024-08-18T22:23:55.730048+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:19:45.657386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731327+0000","last_change":"2024-08-18T22:23:54.262074+0000","last_active":"2024-08-18T22:23:55.731327+0000","last_peered":"2024-08-18T22:23:55.731327+0000","last_clean":"2024-08-18T22:23:55.731327+0000","last_became_active":"2024-08-18T22:23:54.259828+0000","last_became_peered":"2024-08-18T22:23:54.259828+0000","last_unstale":"2024-08-18T22:23:55.731327+0000","last_undegraded":"2024-08-18T22:23:55.731327+0000","last_fullsized":"2024-08-18T22:23:55.731327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:53.384493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264611+0000","last_change":"2024-08-18T22:23:53.249062+0000","last_active":"2024-08-18T22:23:55.264611+0000","last_peered":"2024-08-18T22:23:55.264611+0000","last_clean":"2024-08-18T22:23:55.264611+0000","last_became_active":"2024-08-18T22:23:53.248766+0000","last_became_peered":"2024-08-18T22:23:53.248766+0000","last_unstale":"2024-08-18T22:23:55.264611+0000","last_undegraded":"2024-08-18T22:23:55.264611+0000","last_fullsized":"2024-08-18T22:23:55.264611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:51.713170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731298+0000","last_change":"2024-08-18T22:23:54.270564+0000","last_active":"2024-08-18T22:23:55.731298+0000","last_peered":"2024-08-18T22:23:55.731298+0000","last_clean":"2024-08-18T22:23:55.731298+0000","last_became_active":"2024-08-18T22:23:54.270270+0000","last_became_peered":"2024-08-18T22:23:54.270270+0000","last_unstale":"2024-08-18T22:23:55.731298+0000","last_undegraded":"2024-08-18T22:23:55.731298+0000","last_fullsized":"2024-08-18T22:23:55.731298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:38.075480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"81'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260957+0000","last_change":"2024-08-18T22:23:53.245872+0000","last_active":"2024-08-18T22:23:55.260957+0000","last_peered":"2024-08-18T22:23:55.260957+0000","last_clean":"2024-08-18T22:23:55.260957+0000","last_became_active":"2024-08-18T22:23:53.245598+0000","last_became_peered":"2024-08-18T22:23:53.245598+0000","last_unstale":"2024-08-18T22:23:55.260957+0000","last_undegraded":"2024-08-18T22:23:55.260957+0000","last_fullsized":"2024-08-18T22:23:55.260957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:13.600410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729998+0000","last_change":"2024-08-18T22:23:54.254659+0000","last_active":"2024-08-18T22:23:55.729998+0000","last_peered":"2024-08-18T22:23:55.729998+0000","last_clean":"2024-08-18T22:23:55.729998+0000","last_became_active":"2024-08-18T22:23:54.254151+0000","last_became_peered":"2024-08-18T22:23:54.254151+0000","last_unstale":"2024-08-18T22:23:55.729998+0000","last_undegraded":"2024-08-18T22:23:55.729998+0000","last_fullsized":"2024-08-18T22:23:55.729998+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:01:57.523388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729535+0000","last_change":"2024-08-18T22:23:53.247110+0000","last_active":"2024-08-18T22:23:55.729535+0000","last_peered":"2024-08-18T22:23:55.729535+0000","last_clean":"2024-08-18T22:23:55.729535+0000","last_became_active":"2024-08-18T22:23:53.245877+0000","last_became_peered":"2024-08-18T22:23:53.245877+0000","last_unstale":"2024-08-18T22:23:55.729535+0000","last_undegraded":"2024-08-18T22:23:55.729535+0000","last_fullsized":"2024-08-18T22:23:55.729535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:08.045334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259694+0000","last_change":"2024-08-18T22:23:54.260477+0000","last_active":"2024-08-18T22:23:55.259694+0000","last_peered":"2024-08-18T22:23:55.259694+0000","last_clean":"2024-08-18T22:23:55.259694+0000","last_became_active":"2024-08-18T22:23:54.260194+0000","last_became_peered":"2024-08-18T22:23:54.260194+0000","last_unstale":"2024-08-18T22:23:55.259694+0000","last_undegraded":"2024-08-18T22:23:55.259694+0000","last_fullsized":"2024-08-18T22:23:55.259694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:53.087509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259761+0000","last_change":"2024-08-18T22:23:53.241741+0000","last_active":"2024-08-18T22:23:55.259761+0000","last_peered":"2024-08-18T22:23:55.259761+0000","last_clean":"2024-08-18T22:23:55.259761+0000","last_became_active":"2024-08-18T22:23:53.241388+0000","last_became_peered":"2024-08-18T22:23:53.241388+0000","last_unstale":"2024-08-18T22:23:55.259761+0000","last_undegraded":"2024-08-18T22:23:55.259761+0000","last_fullsized":"2024-08-18T22:23:55.259761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:24.173939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261570+0000","last_change":"2024-08-18T22:23:54.258016+0000","last_active":"2024-08-18T22:23:55.261570+0000","last_peered":"2024-08-18T22:23:55.261570+0000","last_clean":"2024-08-18T22:23:55.261570+0000","last_became_active":"2024-08-18T22:23:54.257738+0000","last_became_peered":"2024-08-18T22:23:54.257738+0000","last_unstale":"2024-08-18T22:23:55.261570+0000","last_undegraded":"2024-08-18T22:23:55.261570+0000","last_fullsized":"2024-08-18T22:23:55.261570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:37.800810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264098+0000","last_change":"2024-08-18T22:23:53.251780+0000","last_active":"2024-08-18T22:23:55.264098+0000","last_peered":"2024-08-18T22:23:55.264098+0000","last_clean":"2024-08-18T22:23:55.264098+0000","last_became_active":"2024-08-18T22:23:53.251524+0000","last_became_peered":"2024-08-18T22:23:53.251524+0000","last_unstale":"2024-08-18T22:23:55.264098+0000","last_undegraded":"2024-08-18T22:23:55.264098+0000","last_fullsized":"2024-08-18T22:23:55.264098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:01.049290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261884+0000","last_change":"2024-08-18T22:23:54.263262+0000","last_active":"2024-08-18T22:23:55.261884+0000","last_peered":"2024-08-18T22:23:55.261884+0000","last_clean":"2024-08-18T22:23:55.261884+0000","last_became_active":"2024-08-18T22:23:54.262506+0000","last_became_peered":"2024-08-18T22:23:54.262506+0000","last_unstale":"2024-08-18T22:23:55.261884+0000","last_undegraded":"2024-08-18T22:23:55.261884+0000","last_fullsized":"2024-08-18T22:23:55.261884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:44:38.971490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"81'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261360+0000","last_change":"2024-08-18T22:23:53.250165+0000","last_active":"2024-08-18T22:23:55.261360+0000","last_peered":"2024-08-18T22:23:55.261360+0000","last_clean":"2024-08-18T22:23:55.261360+0000","last_became_active":"2024-08-18T22:23:53.249889+0000","last_became_peered":"2024-08-18T22:23:53.249889+0000","last_unstale":"2024-08-18T22:23:55.261360+0000","last_undegraded":"2024-08-18T22:23:55.261360+0000","last_fullsized":"2024-08-18T22:23:55.261360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:53.267001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730950+0000","last_change":"2024-08-18T22:23:54.265098+0000","last_active":"2024-08-18T22:23:55.730950+0000","last_peered":"2024-08-18T22:23:55.730950+0000","last_clean":"2024-08-18T22:23:55.730950+0000","last_became_active":"2024-08-18T22:23:54.264840+0000","last_became_peered":"2024-08-18T22:23:54.264840+0000","last_unstale":"2024-08-18T22:23:55.730950+0000","last_undegraded":"2024-08-18T22:23:55.730950+0000","last_fullsized":"2024-08-18T22:23:55.730950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:14.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260957+0000","last_change":"2024-08-18T22:23:53.243095+0000","last_active":"2024-08-18T22:23:55.260957+0000","last_peered":"2024-08-18T22:23:55.260957+0000","last_clean":"2024-08-18T22:23:55.260957+0000","last_became_active":"2024-08-18T22:23:53.242833+0000","last_became_peered":"2024-08-18T22:23:53.242833+0000","last_unstale":"2024-08-18T22:23:55.260957+0000","last_undegraded":"2024-08-18T22:23:55.260957+0000","last_fullsized":"2024-08-18T22:23:55.260957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:35:24.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264113+0000","last_change":"2024-08-18T22:23:54.259286+0000","last_active":"2024-08-18T22:23:55.264113+0000","last_peered":"2024-08-18T22:23:55.264113+0000","last_clean":"2024-08-18T22:23:55.264113+0000","last_became_active":"2024-08-18T22:23:54.258960+0000","last_became_peered":"2024-08-18T22:23:54.258960+0000","last_unstale":"2024-08-18T22:23:55.264113+0000","last_undegraded":"2024-08-18T22:23:55.264113+0000","last_fullsized":"2024-08-18T22:23:55.264113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:48.497587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261682+0000","last_change":"2024-08-18T22:23:53.241158+0000","last_active":"2024-08-18T22:23:55.261682+0000","last_peered":"2024-08-18T22:23:55.261682+0000","last_clean":"2024-08-18T22:23:55.261682+0000","last_became_active":"2024-08-18T22:23:53.240859+0000","last_became_peered":"2024-08-18T22:23:53.240859+0000","last_unstale":"2024-08-18T22:23:55.261682+0000","last_undegraded":"2024-08-18T22:23:55.261682+0000","last_fullsized":"2024-08-18T22:23:55.261682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:41.985620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264192+0000","last_change":"2024-08-18T22:23:54.271013+0000","last_active":"2024-08-18T22:23:55.264192+0000","last_peered":"2024-08-18T22:23:55.264192+0000","last_clean":"2024-08-18T22:23:55.264192+0000","last_became_active":"2024-08-18T22:23:54.270715+0000","last_became_peered":"2024-08-18T22:23:54.270715+0000","last_unstale":"2024-08-18T22:23:55.264192+0000","last_undegraded":"2024-08-18T22:23:55.264192+0000","last_fullsized":"2024-08-18T22:23:55.264192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:18:11.045700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264616+0000","last_change":"2024-08-18T22:23:53.246903+0000","last_active":"2024-08-18T22:23:55.264616+0000","last_peered":"2024-08-18T22:23:55.264616+0000","last_clean":"2024-08-18T22:23:55.264616+0000","last_became_active":"2024-08-18T22:23:53.246619+0000","last_became_peered":"2024-08-18T22:23:53.246619+0000","last_unstale":"2024-08-18T22:23:55.264616+0000","last_undegraded":"2024-08-18T22:23:55.264616+0000","last_fullsized":"2024-08-18T22:23:55.264616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:33:39.529484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731279+0000","last_change":"2024-08-18T22:23:54.259110+0000","last_active":"2024-08-18T22:23:55.731279+0000","last_peered":"2024-08-18T22:23:55.731279+0000","last_clean":"2024-08-18T22:23:55.731279+0000","last_became_active":"2024-08-18T22:23:54.258829+0000","last_became_peered":"2024-08-18T22:23:54.258829+0000","last_unstale":"2024-08-18T22:23:55.731279+0000","last_undegraded":"2024-08-18T22:23:55.731279+0000","last_fullsized":"2024-08-18T22:23:55.731279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:43:49.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731563+0000","last_change":"2024-08-18T22:23:53.250046+0000","last_active":"2024-08-18T22:23:55.731563+0000","last_peered":"2024-08-18T22:23:55.731563+0000","last_clean":"2024-08-18T22:23:55.731563+0000","last_became_active":"2024-08-18T22:23:53.246620+0000","last_became_peered":"2024-08-18T22:23:53.246620+0000","last_unstale":"2024-08-18T22:23:55.731563+0000","last_undegraded":"2024-08-18T22:23:55.731563+0000","last_fullsized":"2024-08-18T22:23:55.731563+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:35.536263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261775+0000","last_change":"2024-08-18T22:23:54.268706+0000","last_active":"2024-08-18T22:23:55.261775+0000","last_peered":"2024-08-18T22:23:55.261775+0000","last_clean":"2024-08-18T22:23:55.261775+0000","last_became_active":"2024-08-18T22:23:54.268415+0000","last_became_peered":"2024-08-18T22:23:54.268415+0000","last_unstale":"2024-08-18T22:23:55.261775+0000","last_undegraded":"2024-08-18T22:23:55.261775+0000","last_fullsized":"2024-08-18T22:23:55.261775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:51:00.060488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731278+0000","last_change":"2024-08-18T22:23:53.242322+0000","last_active":"2024-08-18T22:23:55.731278+0000","last_peered":"2024-08-18T22:23:55.731278+0000","last_clean":"2024-08-18T22:23:55.731278+0000","last_became_active":"2024-08-18T22:23:53.241981+0000","last_became_peered":"2024-08-18T22:23:53.241981+0000","last_unstale":"2024-08-18T22:23:55.731278+0000","last_undegraded":"2024-08-18T22:23:55.731278+0000","last_fullsized":"2024-08-18T22:23:55.731278+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:37:53.231387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261851+0000","last_change":"2024-08-18T22:23:54.269337+0000","last_active":"2024-08-18T22:23:55.261851+0000","last_peered":"2024-08-18T22:23:55.261851+0000","last_clean":"2024-08-18T22:23:55.261851+0000","last_became_active":"2024-08-18T22:23:54.269044+0000","last_became_peered":"2024-08-18T22:23:54.269044+0000","last_unstale":"2024-08-18T22:23:55.261851+0000","last_undegraded":"2024-08-18T22:23:55.261851+0000","last_fullsized":"2024-08-18T22:23:55.261851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:39:55.201722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730930+0000","last_change":"2024-08-18T22:23:53.239454+0000","last_active":"2024-08-18T22:23:55.730930+0000","last_peered":"2024-08-18T22:23:55.730930+0000","last_clean":"2024-08-18T22:23:55.730930+0000","last_became_active":"2024-08-18T22:23:53.239189+0000","last_became_peered":"2024-08-18T22:23:53.239189+0000","last_unstale":"2024-08-18T22:23:55.730930+0000","last_undegraded":"2024-08-18T22:23:55.730930+0000","last_fullsized":"2024-08-18T22:23:55.730930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:57.696273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261945+0000","last_change":"2024-08-18T22:23:54.265426+0000","last_active":"2024-08-18T22:23:55.261945+0000","last_peered":"2024-08-18T22:23:55.261945+0000","last_clean":"2024-08-18T22:23:55.261945+0000","last_became_active":"2024-08-18T22:23:54.263577+0000","last_became_peered":"2024-08-18T22:23:54.263577+0000","last_unstale":"2024-08-18T22:23:55.261945+0000","last_undegraded":"2024-08-18T22:23:55.261945+0000","last_fullsized":"2024-08-18T22:23:55.261945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:14:01.594821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730959+0000","last_change":"2024-08-18T22:23:53.247190+0000","last_active":"2024-08-18T22:23:55.730959+0000","last_peered":"2024-08-18T22:23:55.730959+0000","last_clean":"2024-08-18T22:23:55.730959+0000","last_became_active":"2024-08-18T22:23:53.244049+0000","last_became_peered":"2024-08-18T22:23:53.244049+0000","last_unstale":"2024-08-18T22:23:55.730959+0000","last_undegraded":"2024-08-18T22:23:55.730959+0000","last_fullsized":"2024-08-18T22:23:55.730959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:20.053104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260839+0000","last_change":"2024-08-18T22:23:54.259872+0000","last_active":"2024-08-18T22:23:55.260839+0000","last_peered":"2024-08-18T22:23:55.260839+0000","last_clean":"2024-08-18T22:23:55.260839+0000","last_became_active":"2024-08-18T22:23:54.259633+0000","last_became_peered":"2024-08-18T22:23:54.259633+0000","last_unstale":"2024-08-18T22:23:55.260839+0000","last_undegraded":"2024-08-18T22:23:55.260839+0000","last_fullsized":"2024-08-18T22:23:55.260839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:12.200171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729900+0000","last_change":"2024-08-18T22:23:53.246134+0000","last_active":"2024-08-18T22:23:55.729900+0000","last_peered":"2024-08-18T22:23:55.729900+0000","last_clean":"2024-08-18T22:23:55.729900+0000","last_became_active":"2024-08-18T22:23:53.245585+0000","last_became_peered":"2024-08-18T22:23:53.245585+0000","last_unstale":"2024-08-18T22:23:55.729900+0000","last_undegraded":"2024-08-18T22:23:55.729900+0000","last_fullsized":"2024-08-18T22:23:55.729900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:17.284982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.258804+0000","last_change":"2024-08-18T22:23:54.263977+0000","last_active":"2024-08-18T22:23:55.258804+0000","last_peered":"2024-08-18T22:23:55.258804+0000","last_clean":"2024-08-18T22:23:55.258804+0000","last_became_active":"2024-08-18T22:23:54.263253+0000","last_became_peered":"2024-08-18T22:23:54.263253+0000","last_unstale":"2024-08-18T22:23:55.258804+0000","last_undegraded":"2024-08-18T22:23:55.258804+0000","last_fullsized":"2024-08-18T22:23:55.258804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:19:53.032372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261890+0000","last_change":"2024-08-18T22:23:53.255034+0000","last_active":"2024-08-18T22:23:55.261890+0000","last_peered":"2024-08-18T22:23:55.261890+0000","last_clean":"2024-08-18T22:23:55.261890+0000","last_became_active":"2024-08-18T22:23:53.254449+0000","last_became_peered":"2024-08-18T22:23:53.254449+0000","last_unstale":"2024-08-18T22:23:55.261890+0000","last_undegraded":"2024-08-18T22:23:55.261890+0000","last_fullsized":"2024-08-18T22:23:55.261890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:03:46.748213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261122+0000","last_change":"2024-08-18T22:23:54.263284+0000","last_active":"2024-08-18T22:23:55.261122+0000","last_peered":"2024-08-18T22:23:55.261122+0000","last_clean":"2024-08-18T22:23:55.261122+0000","last_became_active":"2024-08-18T22:23:54.262747+0000","last_became_peered":"2024-08-18T22:23:54.262747+0000","last_unstale":"2024-08-18T22:23:55.261122+0000","last_undegraded":"2024-08-18T22:23:55.261122+0000","last_fullsized":"2024-08-18T22:23:55.261122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:51:52.385446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260396+0000","last_change":"2024-08-18T22:23:53.240247+0000","last_active":"2024-08-18T22:23:55.260396+0000","last_peered":"2024-08-18T22:23:55.260396+0000","last_clean":"2024-08-18T22:23:55.260396+0000","last_became_active":"2024-08-18T22:23:53.239551+0000","last_became_peered":"2024-08-18T22:23:53.239551+0000","last_unstale":"2024-08-18T22:23:55.260396+0000","last_undegraded":"2024-08-18T22:23:55.260396+0000","last_fullsized":"2024-08-18T22:23:55.260396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:33:00.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261742+0000","last_change":"2024-08-18T22:23:54.251015+0000","last_active":"2024-08-18T22:23:55.261742+0000","last_peered":"2024-08-18T22:23:55.261742+0000","last_clean":"2024-08-18T22:23:55.261742+0000","last_became_active":"2024-08-18T22:23:54.250667+0000","last_became_peered":"2024-08-18T22:23:54.250667+0000","last_unstale":"2024-08-18T22:23:55.261742+0000","last_undegraded":"2024-08-18T22:23:55.261742+0000","last_fullsized":"2024-08-18T22:23:55.261742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:01.758578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259882+0000","last_change":"2024-08-18T22:23:53.244792+0000","last_active":"2024-08-18T22:23:55.259882+0000","last_peered":"2024-08-18T22:23:55.259882+0000","last_clean":"2024-08-18T22:23:55.259882+0000","last_became_active":"2024-08-18T22:23:53.244310+0000","last_became_peered":"2024-08-18T22:23:53.244310+0000","last_unstale":"2024-08-18T22:23:55.259882+0000","last_undegraded":"2024-08-18T22:23:55.259882+0000","last_fullsized":"2024-08-18T22:23:55.259882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:53.267001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259392+0000","last_change":"2024-08-18T22:23:54.260015+0000","last_active":"2024-08-18T22:23:55.259392+0000","last_peered":"2024-08-18T22:23:55.259392+0000","last_clean":"2024-08-18T22:23:55.259392+0000","last_became_active":"2024-08-18T22:23:54.259757+0000","last_became_peered":"2024-08-18T22:23:54.259757+0000","last_unstale":"2024-08-18T22:23:55.259392+0000","last_undegraded":"2024-08-18T22:23:55.259392+0000","last_fullsized":"2024-08-18T22:23:55.259392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:43:05.105997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259301+0000","last_change":"2024-08-18T22:23:53.244540+0000","last_active":"2024-08-18T22:23:55.259301+0000","last_peered":"2024-08-18T22:23:55.259301+0000","last_clean":"2024-08-18T22:23:55.259301+0000","last_became_active":"2024-08-18T22:23:53.243417+0000","last_became_peered":"2024-08-18T22:23:53.243417+0000","last_unstale":"2024-08-18T22:23:55.259301+0000","last_undegraded":"2024-08-18T22:23:55.259301+0000","last_fullsized":"2024-08-18T22:23:55.259301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:59.166810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260613+0000","last_change":"2024-08-18T22:23:54.258841+0000","last_active":"2024-08-18T22:23:55.260613+0000","last_peered":"2024-08-18T22:23:55.260613+0000","last_clean":"2024-08-18T22:23:55.260613+0000","last_became_active":"2024-08-18T22:23:54.258582+0000","last_became_peered":"2024-08-18T22:23:54.258582+0000","last_unstale":"2024-08-18T22:23:55.260613+0000","last_undegraded":"2024-08-18T22:23:55.260613+0000","last_fullsized":"2024-08-18T22:23:55.260613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:59.090642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264370+0000","last_change":"2024-08-18T22:23:53.252271+0000","last_active":"2024-08-18T22:23:55.264370+0000","last_peered":"2024-08-18T22:23:55.264370+0000","last_clean":"2024-08-18T22:23:55.264370+0000","last_became_active":"2024-08-18T22:23:53.252030+0000","last_became_peered":"2024-08-18T22:23:53.252030+0000","last_unstale":"2024-08-18T22:23:55.264370+0000","last_undegraded":"2024-08-18T22:23:55.264370+0000","last_fullsized":"2024-08-18T22:23:55.264370+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:19.534699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731647+0000","last_change":"2024-08-18T22:23:54.272594+0000","last_active":"2024-08-18T22:23:55.731647+0000","last_peered":"2024-08-18T22:23:55.731647+0000","last_clean":"2024-08-18T22:23:55.731647+0000","last_became_active":"2024-08-18T22:23:54.272324+0000","last_became_peered":"2024-08-18T22:23:54.272324+0000","last_unstale":"2024-08-18T22:23:55.731647+0000","last_undegraded":"2024-08-18T22:23:55.731647+0000","last_fullsized":"2024-08-18T22:23:55.731647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:50:57.847238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259063+0000","last_change":"2024-08-18T22:23:53.249008+0000","last_active":"2024-08-18T22:23:55.259063+0000","last_peered":"2024-08-18T22:23:55.259063+0000","last_clean":"2024-08-18T22:23:55.259063+0000","last_became_active":"2024-08-18T22:23:53.248747+0000","last_became_peered":"2024-08-18T22:23:53.248747+0000","last_unstale":"2024-08-18T22:23:55.259063+0000","last_undegraded":"2024-08-18T22:23:55.259063+0000","last_fullsized":"2024-08-18T22:23:55.259063+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:35.536263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731723+0000","last_change":"2024-08-18T22:23:54.267073+0000","last_active":"2024-08-18T22:23:55.731723+0000","last_peered":"2024-08-18T22:23:55.731723+0000","last_clean":"2024-08-18T22:23:55.731723+0000","last_became_active":"2024-08-18T22:23:54.266802+0000","last_became_peered":"2024-08-18T22:23:54.266802+0000","last_unstale":"2024-08-18T22:23:55.731723+0000","last_undegraded":"2024-08-18T22:23:55.731723+0000","last_fullsized":"2024-08-18T22:23:55.731723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:19:53.032372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730908+0000","last_change":"2024-08-18T22:23:53.253204+0000","last_active":"2024-08-18T22:23:55.730908+0000","last_peered":"2024-08-18T22:23:55.730908+0000","last_clean":"2024-08-18T22:23:55.730908+0000","last_became_active":"2024-08-18T22:23:53.252957+0000","last_became_peered":"2024-08-18T22:23:53.252957+0000","last_unstale":"2024-08-18T22:23:55.730908+0000","last_undegraded":"2024-08-18T22:23:55.730908+0000","last_fullsized":"2024-08-18T22:23:55.730908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:59.166810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260290+0000","last_change":"2024-08-18T22:23:54.258499+0000","last_active":"2024-08-18T22:23:55.260290+0000","last_peered":"2024-08-18T22:23:55.260290+0000","last_clean":"2024-08-18T22:23:55.260290+0000","last_became_active":"2024-08-18T22:23:54.258187+0000","last_became_peered":"2024-08-18T22:23:54.258187+0000","last_unstale":"2024-08-18T22:23:55.260290+0000","last_undegraded":"2024-08-18T22:23:55.260290+0000","last_fullsized":"2024-08-18T22:23:55.260290+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:14.751154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731711+0000","last_change":"2024-08-18T22:23:53.242215+0000","last_active":"2024-08-18T22:23:55.731711+0000","last_peered":"2024-08-18T22:23:55.731711+0000","last_clean":"2024-08-18T22:23:55.731711+0000","last_became_active":"2024-08-18T22:23:53.241900+0000","last_became_peered":"2024-08-18T22:23:53.241900+0000","last_unstale":"2024-08-18T22:23:55.731711+0000","last_undegraded":"2024-08-18T22:23:55.731711+0000","last_fullsized":"2024-08-18T22:23:55.731711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:01:56.516913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":294,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259903+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:23:55.259903+0000","last_peered":"2024-08-18T22:23:55.259903+0000","last_clean":"2024-08-18T22:23:55.259903+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:23:55.259903+0000","last_undegraded":"2024-08-18T22:23:55.259903+0000","last_fullsized":"2024-08-18T22:23:55.259903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509501,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36900,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334940,"statfs":{"total":96636764160,"available":96598978560,"internally_reserved":0,"allocated":1593344,"data_stored":1048182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335512,"statfs":{"total":96636764160,"available":96599564288,"internally_reserved":0,"allocated":1007616,"data_stored":459404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":999424,"data_stored":457826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":999424,"data_stored":458374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1003520,"data_stored":457904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509502,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41052,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330788,"statfs":{"total":96636764160,"available":96594726912,"internally_reserved":0,"allocated":1589248,"data_stored":1048160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1015808,"data_stored":459508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1007616,"data_stored":458534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:24:02.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:24:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.110+0000 7f77db800640 1 Processor -- start 2024-08-18T22:24:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.110+0000 7f77db800640 1 -- start start 2024-08-18T22:24:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.110+0000 7f77db800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77d415a800 0x7f77d40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77db800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77d40ce280 0x7f77d406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77db800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d40cb5d0 con 0x7f77d40ce6c0 2024-08-18T22:24:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77db800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f77d4072e60 con 0x7f77d40ce280 2024-08-18T22:24:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77db800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f77d4073140 con 0x7f77d415a800 2024-08-18T22:24:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77d3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77d40ce280 0x7f77d406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77d3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77d40ce280 0x7f77d406ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45292/0 (socket says 172.21.15.5:45292) 2024-08-18T22:24:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77d3e00640 1 -- 172.21.15.5:0/2158257072 learned_addr learned my addr 172.21.15.5:0/2158257072 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77d8e00640 1 --2- 172.21.15.5:0/2158257072 >> v2:172.21.15.117:3300/0 conn(0x7f77d415a800 0x7f77d40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77d3e00640 1 -- 172.21.15.5:0/2158257072 >> v2:172.21.15.117:3300/0 conn(0x7f77d415a800 msgr2=0x7f77d40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77d3e00640 1 --2- 172.21.15.5:0/2158257072 >> v2:172.21.15.117:3300/0 conn(0x7f77d415a800 0x7f77d40caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77d3e00640 1 -- 172.21.15.5:0/2158257072 >> v1:172.21.15.117:6789/0 conn(0x7f77d40ce6c0 legacy=0x7f77d415e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77d3e00640 1 -- 172.21.15.5:0/2158257072 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d4073420 con 0x7f77d40ce280 2024-08-18T22:24:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77d3e00640 1 --2- 172.21.15.5:0/2158257072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40ce280 0x7f77d406ea40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f77d40d0fd0 tx=0x7f77c001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0a15b31808f71b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.114+0000 7f77d3400640 1 -- 172.21.15.5:0/2158257072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c00b0070 con 0x7f77d40ce280 2024-08-18T22:24:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77d3400640 1 -- 172.21.15.5:0/2158257072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c00ab600 con 0x7f77d40ce280 2024-08-18T22:24:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77d3400640 1 -- 172.21.15.5:0/2158257072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c00ab9d0 con 0x7f77d40ce280 2024-08-18T22:24:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 -- 172.21.15.5:0/2158257072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40ce280 msgr2=0x7f77d406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 --2- 172.21.15.5:0/2158257072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40ce280 0x7f77d406ea40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f77d40d0fd0 tx=0x7f77c001c520 comp rx=0 tx=0).stop 2024-08-18T22:24:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 -- 172.21.15.5:0/2158257072 shutdown_connections 2024-08-18T22:24:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 --2- 172.21.15.5:0/2158257072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40ce280 0x7f77d406ea40 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 --2- 172.21.15.5:0/2158257072 >> v2:172.21.15.117:3300/0 conn(0x7f77d415a800 0x7f77d40caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 -- 172.21.15.5:0/2158257072 >> 172.21.15.5:0/2158257072 conn(0x7f77d40b1c50 msgr2=0x7f77d40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 -- 172.21.15.5:0/2158257072 shutdown_connections 2024-08-18T22:24:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 -- 172.21.15.5:0/2158257072 wait complete. 2024-08-18T22:24:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 Processor -- start 2024-08-18T22:24:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 -- start start 2024-08-18T22:24:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40ce280 0x7f77d4152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77d40ce6c0 0x7f77d415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77d415a800 0x7f77d4158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77d415ecb0 con 0x7f77d40ce280 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f77d415eb30 con 0x7f77d415a800 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77db800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f77d415ee30 con 0x7f77d40ce6c0 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77d8e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40ce280 0x7f77d4152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77d8e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40ce280 0x7f77d4152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45296/0 (socket says 172.21.15.5:45296) 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77d8e00640 1 -- 172.21.15.5:0/3773254144 learned_addr learned my addr 172.21.15.5:0/3773254144 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77d9800640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77d415a800 0x7f77d4158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.118+0000 7f77d3e00640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77d40ce6c0 0x7f77d415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d8e00640 1 -- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77d40ce6c0 msgr2=0x7f77d415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d8e00640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77d40ce6c0 0x7f77d415c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d8e00640 1 -- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77d415a800 msgr2=0x7f77d4158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d8e00640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77d415a800 0x7f77d4158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d8e00640 1 -- 172.21.15.5:0/3773254144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d41596a0 con 0x7f77d40ce280 2024-08-18T22:24:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d9800640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77d415a800 0x7f77d4158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d8e00640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40ce280 0x7f77d4152c40 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f77c400e870 tx=0x7f77c400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d0c00640 1 -- 172.21.15.5:0/3773254144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c4017070 con 0x7f77d40ce280 2024-08-18T22:24:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d0c00640 1 -- 172.21.15.5:0/3773254144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c400c940 con 0x7f77d40ce280 2024-08-18T22:24:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d0c00640 1 -- 172.21.15.5:0/3773254144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c400ccf0 con 0x7f77d40ce280 2024-08-18T22:24:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77db800640 1 -- 172.21.15.5:0/3773254144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d415bcb0 con 0x7f77d40ce280 2024-08-18T22:24:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77db800640 1 -- 172.21.15.5:0/3773254144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d415b8d0 con 0x7f77d40ce280 2024-08-18T22:24:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77db800640 1 -- 172.21.15.5:0/3773254144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d406ea40 con 0x7f77d40ce280 2024-08-18T22:24:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d0c00640 1 -- 172.21.15.5:0/3773254144 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77c401a070 con 0x7f77d40ce280 2024-08-18T22:24:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d0c00640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b40678c0 0x7f77b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d0c00640 1 -- 172.21.15.5:0/3773254144 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f77c4086090 con 0x7f77d40ce280 2024-08-18T22:24:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.122+0000 7f77d3e00640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b40678c0 0x7f77b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.126+0000 7f77d3e00640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b40678c0 0x7f77b4069d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f77c00ad000 tx=0x7f77c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:03.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.126+0000 7f77d0c00640 1 -- 172.21.15.5:0/3773254144 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f77c4056350 con 0x7f77d40ce280 2024-08-18T22:24:03.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.290+0000 7f77db800640 1 -- 172.21.15.5:0/3773254144 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77d40cd910 con 0x7f77b40678c0 2024-08-18T22:24:03.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.298+0000 7f77d0c00640 1 -- 172.21.15.5:0/3773254144 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252053 (secure 0 0 0) 0x7f77d40cd910 con 0x7f77b40678c0 2024-08-18T22:24:03.300 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:24:03.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 -- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b40678c0 msgr2=0x7f77b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b40678c0 0x7f77b4069d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f77c00ad000 tx=0x7f77c0008040 comp rx=0 tx=0).stop 2024-08-18T22:24:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 -- 172.21.15.5:0/3773254144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40ce280 msgr2=0x7f77d4152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40ce280 0x7f77d4152c40 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f77c400e870 tx=0x7f77c400ec70 comp rx=0 tx=0).stop 2024-08-18T22:24:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 -- 172.21.15.5:0/3773254144 shutdown_connections 2024-08-18T22:24:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b40678c0 0x7f77b4069d80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77d415a800 0x7f77d4158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77d40ce6c0 0x7f77d415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 --2- 172.21.15.5:0/3773254144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d40ce280 0x7f77d4152c40 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 -- 172.21.15.5:0/3773254144 >> 172.21.15.5:0/3773254144 conn(0x7f77d40b1c50 msgr2=0x7f77d41560f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 -- 172.21.15.5:0/3773254144 shutdown_connections 2024-08-18T22:24:03.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.302+0000 7f77db800640 1 -- 172.21.15.5:0/3773254144 wait complete. 2024-08-18T22:24:03.320 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2024-08-18T22:24:01.687611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":308388,"kb_used_data":9000,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754666332,"statfs":{"total":773094113280,"available":772778323968,"internally_reserved":0,"allocated":9216000,"data_stored":4847892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001934"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260758+0000","last_change":"2024-08-18T22:23:54.263562+0000","last_active":"2024-08-18T22:23:55.260758+0000","last_peered":"2024-08-18T22:23:55.260758+0000","last_clean":"2024-08-18T22:23:55.260758+0000","last_became_active":"2024-08-18T22:23:54.261605+0000","last_became_peered":"2024-08-18T22:23:54.261605+0000","last_unstale":"2024-08-18T22:23:55.260758+0000","last_undegraded":"2024-08-18T22:23:55.260758+0000","last_fullsized":"2024-08-18T22:23:55.260758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:43.369108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261789+0000","last_change":"2024-08-18T22:23:54.255025+0000","last_active":"2024-08-18T22:23:55.261789+0000","last_peered":"2024-08-18T22:23:55.261789+0000","last_clean":"2024-08-18T22:23:55.261789+0000","last_became_active":"2024-08-18T22:23:54.254764+0000","last_became_peered":"2024-08-18T22:23:54.254764+0000","last_unstale":"2024-08-18T22:23:55.261789+0000","last_undegraded":"2024-08-18T22:23:55.261789+0000","last_fullsized":"2024-08-18T22:23:55.261789+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:19.685937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731861+0000","last_change":"2024-08-18T22:23:54.272417+0000","last_active":"2024-08-18T22:23:55.731861+0000","last_peered":"2024-08-18T22:23:55.731861+0000","last_clean":"2024-08-18T22:23:55.731861+0000","last_became_active":"2024-08-18T22:23:54.272149+0000","last_became_peered":"2024-08-18T22:23:54.272149+0000","last_unstale":"2024-08-18T22:23:55.731861+0000","last_undegraded":"2024-08-18T22:23:55.731861+0000","last_fullsized":"2024-08-18T22:23:55.731861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:43:05.105997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729802+0000","last_change":"2024-08-18T22:23:54.261667+0000","last_active":"2024-08-18T22:23:55.729802+0000","last_peered":"2024-08-18T22:23:55.729802+0000","last_clean":"2024-08-18T22:23:55.729802+0000","last_became_active":"2024-08-18T22:23:54.261354+0000","last_became_peered":"2024-08-18T22:23:54.261354+0000","last_unstale":"2024-08-18T22:23:55.729802+0000","last_undegraded":"2024-08-18T22:23:55.729802+0000","last_fullsized":"2024-08-18T22:23:55.729802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:22.612174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264328+0000","last_change":"2024-08-18T22:23:54.255429+0000","last_active":"2024-08-18T22:23:55.264328+0000","last_peered":"2024-08-18T22:23:55.264328+0000","last_clean":"2024-08-18T22:23:55.264328+0000","last_became_active":"2024-08-18T22:23:54.254830+0000","last_became_peered":"2024-08-18T22:23:54.254830+0000","last_unstale":"2024-08-18T22:23:55.264328+0000","last_undegraded":"2024-08-18T22:23:55.264328+0000","last_fullsized":"2024-08-18T22:23:55.264328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:27:49.556352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730936+0000","last_change":"2024-08-18T22:23:54.269136+0000","last_active":"2024-08-18T22:23:55.730936+0000","last_peered":"2024-08-18T22:23:55.730936+0000","last_clean":"2024-08-18T22:23:55.730936+0000","last_became_active":"2024-08-18T22:23:54.268506+0000","last_became_peered":"2024-08-18T22:23:54.268506+0000","last_unstale":"2024-08-18T22:23:55.730936+0000","last_undegraded":"2024-08-18T22:23:55.730936+0000","last_fullsized":"2024-08-18T22:23:55.730936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:48:08.804440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.258655+0000","last_change":"2024-08-18T22:23:54.263617+0000","last_active":"2024-08-18T22:23:55.258655+0000","last_peered":"2024-08-18T22:23:55.258655+0000","last_clean":"2024-08-18T22:23:55.258655+0000","last_became_active":"2024-08-18T22:23:54.261981+0000","last_became_peered":"2024-08-18T22:23:54.261981+0000","last_unstale":"2024-08-18T22:23:55.258655+0000","last_undegraded":"2024-08-18T22:23:55.258655+0000","last_fullsized":"2024-08-18T22:23:55.258655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:50:57.847238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.263983+0000","last_change":"2024-08-18T22:23:54.253390+0000","last_active":"2024-08-18T22:23:55.263983+0000","last_peered":"2024-08-18T22:23:55.263983+0000","last_clean":"2024-08-18T22:23:55.263983+0000","last_became_active":"2024-08-18T22:23:54.253085+0000","last_became_peered":"2024-08-18T22:23:54.253085+0000","last_unstale":"2024-08-18T22:23:55.263983+0000","last_undegraded":"2024-08-18T22:23:55.263983+0000","last_fullsized":"2024-08-18T22:23:55.263983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:14.303897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261466+0000","last_change":"2024-08-18T22:23:54.258688+0000","last_active":"2024-08-18T22:23:55.261466+0000","last_peered":"2024-08-18T22:23:55.261466+0000","last_clean":"2024-08-18T22:23:55.261466+0000","last_became_active":"2024-08-18T22:23:54.258436+0000","last_became_peered":"2024-08-18T22:23:54.258436+0000","last_unstale":"2024-08-18T22:23:55.261466+0000","last_undegraded":"2024-08-18T22:23:55.261466+0000","last_fullsized":"2024-08-18T22:23:55.261466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:10.210409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729902+0000","last_change":"2024-08-18T22:23:54.250886+0000","last_active":"2024-08-18T22:23:55.729902+0000","last_peered":"2024-08-18T22:23:55.729902+0000","last_clean":"2024-08-18T22:23:55.729902+0000","last_became_active":"2024-08-18T22:23:54.250614+0000","last_became_peered":"2024-08-18T22:23:54.250614+0000","last_unstale":"2024-08-18T22:23:55.729902+0000","last_undegraded":"2024-08-18T22:23:55.729902+0000","last_fullsized":"2024-08-18T22:23:55.729902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:21.059579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261535+0000","last_change":"2024-08-18T22:23:54.266206+0000","last_active":"2024-08-18T22:23:55.261535+0000","last_peered":"2024-08-18T22:23:55.261535+0000","last_clean":"2024-08-18T22:23:55.261535+0000","last_became_active":"2024-08-18T22:23:54.265612+0000","last_became_peered":"2024-08-18T22:23:54.265612+0000","last_unstale":"2024-08-18T22:23:55.261535+0000","last_undegraded":"2024-08-18T22:23:55.261535+0000","last_fullsized":"2024-08-18T22:23:55.261535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:14.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729805+0000","last_change":"2024-08-18T22:23:54.254425+0000","last_active":"2024-08-18T22:23:55.729805+0000","last_peered":"2024-08-18T22:23:55.729805+0000","last_clean":"2024-08-18T22:23:55.729805+0000","last_became_active":"2024-08-18T22:23:54.252961+0000","last_became_peered":"2024-08-18T22:23:54.252961+0000","last_unstale":"2024-08-18T22:23:55.729805+0000","last_undegraded":"2024-08-18T22:23:55.729805+0000","last_fullsized":"2024-08-18T22:23:55.729805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:43.819630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264361+0000","last_change":"2024-08-18T22:23:54.254445+0000","last_active":"2024-08-18T22:23:55.264361+0000","last_peered":"2024-08-18T22:23:55.264361+0000","last_clean":"2024-08-18T22:23:55.264361+0000","last_became_active":"2024-08-18T22:23:54.254125+0000","last_became_peered":"2024-08-18T22:23:54.254125+0000","last_unstale":"2024-08-18T22:23:55.264361+0000","last_undegraded":"2024-08-18T22:23:55.264361+0000","last_fullsized":"2024-08-18T22:23:55.264361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:26:07.096296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731202+0000","last_change":"2024-08-18T22:23:54.268915+0000","last_active":"2024-08-18T22:23:55.731202+0000","last_peered":"2024-08-18T22:23:55.731202+0000","last_clean":"2024-08-18T22:23:55.731202+0000","last_became_active":"2024-08-18T22:23:54.268094+0000","last_became_peered":"2024-08-18T22:23:54.268094+0000","last_unstale":"2024-08-18T22:23:55.731202+0000","last_undegraded":"2024-08-18T22:23:55.731202+0000","last_fullsized":"2024-08-18T22:23:55.731202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:11.384499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261334+0000","last_change":"2024-08-18T22:23:54.261811+0000","last_active":"2024-08-18T22:23:55.261334+0000","last_peered":"2024-08-18T22:23:55.261334+0000","last_clean":"2024-08-18T22:23:55.261334+0000","last_became_active":"2024-08-18T22:23:54.257343+0000","last_became_peered":"2024-08-18T22:23:54.257343+0000","last_unstale":"2024-08-18T22:23:55.261334+0000","last_undegraded":"2024-08-18T22:23:55.261334+0000","last_fullsized":"2024-08-18T22:23:55.261334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:14.751154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259728+0000","last_change":"2024-08-18T22:23:54.262341+0000","last_active":"2024-08-18T22:23:55.259728+0000","last_peered":"2024-08-18T22:23:55.259728+0000","last_clean":"2024-08-18T22:23:55.259728+0000","last_became_active":"2024-08-18T22:23:54.262029+0000","last_became_peered":"2024-08-18T22:23:54.262029+0000","last_unstale":"2024-08-18T22:23:55.259728+0000","last_undegraded":"2024-08-18T22:23:55.259728+0000","last_fullsized":"2024-08-18T22:23:55.259728+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:01.834571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264661+0000","last_change":"2024-08-18T22:23:54.259132+0000","last_active":"2024-08-18T22:23:55.264661+0000","last_peered":"2024-08-18T22:23:55.264661+0000","last_clean":"2024-08-18T22:23:55.264661+0000","last_became_active":"2024-08-18T22:23:54.258811+0000","last_became_peered":"2024-08-18T22:23:54.258811+0000","last_unstale":"2024-08-18T22:23:55.264661+0000","last_undegraded":"2024-08-18T22:23:55.264661+0000","last_fullsized":"2024-08-18T22:23:55.264661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:48.771970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731547+0000","last_change":"2024-08-18T22:23:54.270366+0000","last_active":"2024-08-18T22:23:55.731547+0000","last_peered":"2024-08-18T22:23:55.731547+0000","last_clean":"2024-08-18T22:23:55.731547+0000","last_became_active":"2024-08-18T22:23:54.270118+0000","last_became_peered":"2024-08-18T22:23:54.270118+0000","last_unstale":"2024-08-18T22:23:55.731547+0000","last_undegraded":"2024-08-18T22:23:55.731547+0000","last_fullsized":"2024-08-18T22:23:55.731547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:48.305326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731492+0000","last_change":"2024-08-18T22:23:54.264485+0000","last_active":"2024-08-18T22:23:55.731492+0000","last_peered":"2024-08-18T22:23:55.731492+0000","last_clean":"2024-08-18T22:23:55.731492+0000","last_became_active":"2024-08-18T22:23:54.262893+0000","last_became_peered":"2024-08-18T22:23:54.262893+0000","last_unstale":"2024-08-18T22:23:55.731492+0000","last_undegraded":"2024-08-18T22:23:55.731492+0000","last_fullsized":"2024-08-18T22:23:55.731492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:34.989767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264433+0000","last_change":"2024-08-18T22:23:54.262936+0000","last_active":"2024-08-18T22:23:55.264433+0000","last_peered":"2024-08-18T22:23:55.264433+0000","last_clean":"2024-08-18T22:23:55.264433+0000","last_became_active":"2024-08-18T22:23:54.262665+0000","last_became_peered":"2024-08-18T22:23:54.262665+0000","last_unstale":"2024-08-18T22:23:55.264433+0000","last_undegraded":"2024-08-18T22:23:55.264433+0000","last_fullsized":"2024-08-18T22:23:55.264433+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:34.017166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261382+0000","last_change":"2024-08-18T22:23:54.267084+0000","last_active":"2024-08-18T22:23:55.261382+0000","last_peered":"2024-08-18T22:23:55.261382+0000","last_clean":"2024-08-18T22:23:55.261382+0000","last_became_active":"2024-08-18T22:23:54.266792+0000","last_became_peered":"2024-08-18T22:23:54.266792+0000","last_unstale":"2024-08-18T22:23:55.261382+0000","last_undegraded":"2024-08-18T22:23:55.261382+0000","last_fullsized":"2024-08-18T22:23:55.261382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:27:37.035990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264190+0000","last_change":"2024-08-18T22:23:54.262252+0000","last_active":"2024-08-18T22:23:55.264190+0000","last_peered":"2024-08-18T22:23:55.264190+0000","last_clean":"2024-08-18T22:23:55.264190+0000","last_became_active":"2024-08-18T22:23:54.261976+0000","last_became_peered":"2024-08-18T22:23:54.261976+0000","last_unstale":"2024-08-18T22:23:55.264190+0000","last_undegraded":"2024-08-18T22:23:55.264190+0000","last_fullsized":"2024-08-18T22:23:55.264190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:27.688388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261229+0000","last_change":"2024-08-18T22:23:54.269243+0000","last_active":"2024-08-18T22:23:55.261229+0000","last_peered":"2024-08-18T22:23:55.261229+0000","last_clean":"2024-08-18T22:23:55.261229+0000","last_became_active":"2024-08-18T22:23:54.268935+0000","last_became_peered":"2024-08-18T22:23:54.268935+0000","last_unstale":"2024-08-18T22:23:55.261229+0000","last_undegraded":"2024-08-18T22:23:55.261229+0000","last_fullsized":"2024-08-18T22:23:55.261229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:56:07.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261254+0000","last_change":"2024-08-18T22:23:54.265593+0000","last_active":"2024-08-18T22:23:55.261254+0000","last_peered":"2024-08-18T22:23:55.261254+0000","last_clean":"2024-08-18T22:23:55.261254+0000","last_became_active":"2024-08-18T22:23:54.265327+0000","last_became_peered":"2024-08-18T22:23:54.265327+0000","last_unstale":"2024-08-18T22:23:55.261254+0000","last_undegraded":"2024-08-18T22:23:55.261254+0000","last_fullsized":"2024-08-18T22:23:55.261254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:56.919160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261633+0000","last_change":"2024-08-18T22:23:54.267642+0000","last_active":"2024-08-18T22:23:55.261633+0000","last_peered":"2024-08-18T22:23:55.261633+0000","last_clean":"2024-08-18T22:23:55.261633+0000","last_became_active":"2024-08-18T22:23:54.266065+0000","last_became_peered":"2024-08-18T22:23:54.266065+0000","last_unstale":"2024-08-18T22:23:55.261633+0000","last_undegraded":"2024-08-18T22:23:55.261633+0000","last_fullsized":"2024-08-18T22:23:55.261633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:34.989767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729917+0000","last_change":"2024-08-18T22:23:54.264840+0000","last_active":"2024-08-18T22:23:55.729917+0000","last_peered":"2024-08-18T22:23:55.729917+0000","last_clean":"2024-08-18T22:23:55.729917+0000","last_became_active":"2024-08-18T22:23:54.264556+0000","last_became_peered":"2024-08-18T22:23:54.264556+0000","last_unstale":"2024-08-18T22:23:55.729917+0000","last_undegraded":"2024-08-18T22:23:55.729917+0000","last_fullsized":"2024-08-18T22:23:55.729917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:37:54.237863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260038+0000","last_change":"2024-08-18T22:23:54.262238+0000","last_active":"2024-08-18T22:23:55.260038+0000","last_peered":"2024-08-18T22:23:55.260038+0000","last_clean":"2024-08-18T22:23:55.260038+0000","last_became_active":"2024-08-18T22:23:54.261912+0000","last_became_peered":"2024-08-18T22:23:54.261912+0000","last_unstale":"2024-08-18T22:23:55.260038+0000","last_undegraded":"2024-08-18T22:23:55.260038+0000","last_fullsized":"2024-08-18T22:23:55.260038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:43.557492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264452+0000","last_change":"2024-08-18T22:23:54.269533+0000","last_active":"2024-08-18T22:23:55.264452+0000","last_peered":"2024-08-18T22:23:55.264452+0000","last_clean":"2024-08-18T22:23:55.264452+0000","last_became_active":"2024-08-18T22:23:54.269250+0000","last_became_peered":"2024-08-18T22:23:54.269250+0000","last_unstale":"2024-08-18T22:23:55.264452+0000","last_undegraded":"2024-08-18T22:23:55.264452+0000","last_fullsized":"2024-08-18T22:23:55.264452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:38:29.318017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261579+0000","last_change":"2024-08-18T22:23:54.254134+0000","last_active":"2024-08-18T22:23:55.261579+0000","last_peered":"2024-08-18T22:23:55.261579+0000","last_clean":"2024-08-18T22:23:55.261579+0000","last_became_active":"2024-08-18T22:23:54.251553+0000","last_became_peered":"2024-08-18T22:23:54.251553+0000","last_unstale":"2024-08-18T22:23:55.261579+0000","last_undegraded":"2024-08-18T22:23:55.261579+0000","last_fullsized":"2024-08-18T22:23:55.261579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:43:49.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260197+0000","last_change":"2024-08-18T22:23:54.252115+0000","last_active":"2024-08-18T22:23:55.260197+0000","last_peered":"2024-08-18T22:23:55.260197+0000","last_clean":"2024-08-18T22:23:55.260197+0000","last_became_active":"2024-08-18T22:23:54.251338+0000","last_became_peered":"2024-08-18T22:23:54.251338+0000","last_unstale":"2024-08-18T22:23:55.260197+0000","last_undegraded":"2024-08-18T22:23:55.260197+0000","last_fullsized":"2024-08-18T22:23:55.260197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:56.919160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731125+0000","last_change":"2024-08-18T22:23:54.263663+0000","last_active":"2024-08-18T22:23:55.731125+0000","last_peered":"2024-08-18T22:23:55.731125+0000","last_clean":"2024-08-18T22:23:55.731125+0000","last_became_active":"2024-08-18T22:23:54.263393+0000","last_became_peered":"2024-08-18T22:23:54.263393+0000","last_unstale":"2024-08-18T22:23:55.731125+0000","last_undegraded":"2024-08-18T22:23:55.731125+0000","last_fullsized":"2024-08-18T22:23:55.731125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:35:05.822021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259902+0000","last_change":"2024-08-18T22:23:54.258891+0000","last_active":"2024-08-18T22:23:55.259902+0000","last_peered":"2024-08-18T22:23:55.259902+0000","last_clean":"2024-08-18T22:23:55.259902+0000","last_became_active":"2024-08-18T22:23:54.258211+0000","last_became_peered":"2024-08-18T22:23:54.258211+0000","last_unstale":"2024-08-18T22:23:55.259902+0000","last_undegraded":"2024-08-18T22:23:55.259902+0000","last_fullsized":"2024-08-18T22:23:55.259902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:10.124652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730899+0000","last_change":"2024-08-18T22:23:54.272076+0000","last_active":"2024-08-18T22:23:55.730899+0000","last_peered":"2024-08-18T22:23:55.730899+0000","last_clean":"2024-08-18T22:23:55.730899+0000","last_became_active":"2024-08-18T22:23:54.269764+0000","last_became_peered":"2024-08-18T22:23:54.269764+0000","last_unstale":"2024-08-18T22:23:55.730899+0000","last_undegraded":"2024-08-18T22:23:55.730899+0000","last_fullsized":"2024-08-18T22:23:55.730899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:43:00.817444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264673+0000","last_change":"2024-08-18T22:23:53.251250+0000","last_active":"2024-08-18T22:23:55.264673+0000","last_peered":"2024-08-18T22:23:55.264673+0000","last_clean":"2024-08-18T22:23:55.264673+0000","last_became_active":"2024-08-18T22:23:53.250935+0000","last_became_peered":"2024-08-18T22:23:53.250935+0000","last_unstale":"2024-08-18T22:23:55.264673+0000","last_undegraded":"2024-08-18T22:23:55.264673+0000","last_fullsized":"2024-08-18T22:23:55.264673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:21:44.891601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261370+0000","last_change":"2024-08-18T22:23:54.250589+0000","last_active":"2024-08-18T22:23:55.261370+0000","last_peered":"2024-08-18T22:23:55.261370+0000","last_clean":"2024-08-18T22:23:55.261370+0000","last_became_active":"2024-08-18T22:23:54.249729+0000","last_became_peered":"2024-08-18T22:23:54.249729+0000","last_unstale":"2024-08-18T22:23:55.261370+0000","last_undegraded":"2024-08-18T22:23:55.261370+0000","last_fullsized":"2024-08-18T22:23:55.261370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:43.369108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259963+0000","last_change":"2024-08-18T22:23:53.245851+0000","last_active":"2024-08-18T22:23:55.259963+0000","last_peered":"2024-08-18T22:23:55.259963+0000","last_clean":"2024-08-18T22:23:55.259963+0000","last_became_active":"2024-08-18T22:23:53.245598+0000","last_became_peered":"2024-08-18T22:23:53.245598+0000","last_unstale":"2024-08-18T22:23:55.259963+0000","last_undegraded":"2024-08-18T22:23:55.259963+0000","last_fullsized":"2024-08-18T22:23:55.259963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:03:46.748213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261043+0000","last_change":"2024-08-18T22:23:54.264243+0000","last_active":"2024-08-18T22:23:55.261043+0000","last_peered":"2024-08-18T22:23:55.261043+0000","last_clean":"2024-08-18T22:23:55.261043+0000","last_became_active":"2024-08-18T22:23:54.263437+0000","last_became_peered":"2024-08-18T22:23:54.263437+0000","last_unstale":"2024-08-18T22:23:55.261043+0000","last_undegraded":"2024-08-18T22:23:55.261043+0000","last_fullsized":"2024-08-18T22:23:55.261043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:02.568338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260139+0000","last_change":"2024-08-18T22:23:53.249485+0000","last_active":"2024-08-18T22:23:55.260139+0000","last_peered":"2024-08-18T22:23:55.260139+0000","last_clean":"2024-08-18T22:23:55.260139+0000","last_became_active":"2024-08-18T22:23:53.248070+0000","last_became_peered":"2024-08-18T22:23:53.248070+0000","last_unstale":"2024-08-18T22:23:55.260139+0000","last_undegraded":"2024-08-18T22:23:55.260139+0000","last_fullsized":"2024-08-18T22:23:55.260139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:44:28.117828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261499+0000","last_change":"2024-08-18T22:23:54.266316+0000","last_active":"2024-08-18T22:23:55.261499+0000","last_peered":"2024-08-18T22:23:55.261499+0000","last_clean":"2024-08-18T22:23:55.261499+0000","last_became_active":"2024-08-18T22:23:54.265936+0000","last_became_peered":"2024-08-18T22:23:54.265936+0000","last_unstale":"2024-08-18T22:23:55.261499+0000","last_undegraded":"2024-08-18T22:23:55.261499+0000","last_fullsized":"2024-08-18T22:23:55.261499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:00:03.812617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259483+0000","last_change":"2024-08-18T22:23:53.243356+0000","last_active":"2024-08-18T22:23:55.259483+0000","last_peered":"2024-08-18T22:23:55.259483+0000","last_clean":"2024-08-18T22:23:55.259483+0000","last_became_active":"2024-08-18T22:23:53.243055+0000","last_became_peered":"2024-08-18T22:23:53.243055+0000","last_unstale":"2024-08-18T22:23:55.259483+0000","last_undegraded":"2024-08-18T22:23:55.259483+0000","last_fullsized":"2024-08-18T22:23:55.259483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:14:48.702864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261610+0000","last_change":"2024-08-18T22:23:54.263909+0000","last_active":"2024-08-18T22:23:55.261610+0000","last_peered":"2024-08-18T22:23:55.261610+0000","last_clean":"2024-08-18T22:23:55.261610+0000","last_became_active":"2024-08-18T22:23:54.261699+0000","last_became_peered":"2024-08-18T22:23:54.261699+0000","last_unstale":"2024-08-18T22:23:55.261610+0000","last_undegraded":"2024-08-18T22:23:55.261610+0000","last_fullsized":"2024-08-18T22:23:55.261610+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:53.384493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261622+0000","last_change":"2024-08-18T22:23:53.240275+0000","last_active":"2024-08-18T22:23:55.261622+0000","last_peered":"2024-08-18T22:23:55.261622+0000","last_clean":"2024-08-18T22:23:55.261622+0000","last_became_active":"2024-08-18T22:23:53.239803+0000","last_became_peered":"2024-08-18T22:23:53.239803+0000","last_unstale":"2024-08-18T22:23:55.261622+0000","last_undegraded":"2024-08-18T22:23:55.261622+0000","last_fullsized":"2024-08-18T22:23:55.261622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:22.345962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261620+0000","last_change":"2024-08-18T22:23:54.265879+0000","last_active":"2024-08-18T22:23:55.261620+0000","last_peered":"2024-08-18T22:23:55.261620+0000","last_clean":"2024-08-18T22:23:55.261620+0000","last_became_active":"2024-08-18T22:23:54.265273+0000","last_became_peered":"2024-08-18T22:23:54.265273+0000","last_unstale":"2024-08-18T22:23:55.261620+0000","last_undegraded":"2024-08-18T22:23:55.261620+0000","last_fullsized":"2024-08-18T22:23:55.261620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:11.384499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729837+0000","last_change":"2024-08-18T22:23:53.247955+0000","last_active":"2024-08-18T22:23:55.729837+0000","last_peered":"2024-08-18T22:23:55.729837+0000","last_clean":"2024-08-18T22:23:55.729837+0000","last_became_active":"2024-08-18T22:23:53.246744+0000","last_became_peered":"2024-08-18T22:23:53.246744+0000","last_unstale":"2024-08-18T22:23:55.729837+0000","last_undegraded":"2024-08-18T22:23:55.729837+0000","last_fullsized":"2024-08-18T22:23:55.729837+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:11:00.515699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261582+0000","last_change":"2024-08-18T22:23:54.257636+0000","last_active":"2024-08-18T22:23:55.261582+0000","last_peered":"2024-08-18T22:23:55.261582+0000","last_clean":"2024-08-18T22:23:55.261582+0000","last_became_active":"2024-08-18T22:23:54.257280+0000","last_became_peered":"2024-08-18T22:23:54.257280+0000","last_unstale":"2024-08-18T22:23:55.261582+0000","last_undegraded":"2024-08-18T22:23:55.261582+0000","last_fullsized":"2024-08-18T22:23:55.261582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:29:50.911549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261426+0000","last_change":"2024-08-18T22:23:53.245559+0000","last_active":"2024-08-18T22:23:55.261426+0000","last_peered":"2024-08-18T22:23:55.261426+0000","last_clean":"2024-08-18T22:23:55.261426+0000","last_became_active":"2024-08-18T22:23:53.245269+0000","last_became_peered":"2024-08-18T22:23:53.245269+0000","last_unstale":"2024-08-18T22:23:55.261426+0000","last_undegraded":"2024-08-18T22:23:55.261426+0000","last_fullsized":"2024-08-18T22:23:55.261426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:24.173939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261804+0000","last_change":"2024-08-18T22:23:54.263906+0000","last_active":"2024-08-18T22:23:55.261804+0000","last_peered":"2024-08-18T22:23:55.261804+0000","last_clean":"2024-08-18T22:23:55.261804+0000","last_became_active":"2024-08-18T22:23:54.262997+0000","last_became_peered":"2024-08-18T22:23:54.262997+0000","last_unstale":"2024-08-18T22:23:55.261804+0000","last_undegraded":"2024-08-18T22:23:55.261804+0000","last_fullsized":"2024-08-18T22:23:55.261804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:49.987310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264053+0000","last_change":"2024-08-18T22:23:53.246914+0000","last_active":"2024-08-18T22:23:55.264053+0000","last_peered":"2024-08-18T22:23:55.264053+0000","last_clean":"2024-08-18T22:23:55.264053+0000","last_became_active":"2024-08-18T22:23:53.246609+0000","last_became_peered":"2024-08-18T22:23:53.246609+0000","last_unstale":"2024-08-18T22:23:55.264053+0000","last_undegraded":"2024-08-18T22:23:55.264053+0000","last_fullsized":"2024-08-18T22:23:55.264053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:49.756736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261281+0000","last_change":"2024-08-18T22:23:54.250695+0000","last_active":"2024-08-18T22:23:55.261281+0000","last_peered":"2024-08-18T22:23:55.261281+0000","last_clean":"2024-08-18T22:23:55.261281+0000","last_became_active":"2024-08-18T22:23:54.250388+0000","last_became_peered":"2024-08-18T22:23:54.250388+0000","last_unstale":"2024-08-18T22:23:55.261281+0000","last_undegraded":"2024-08-18T22:23:55.261281+0000","last_fullsized":"2024-08-18T22:23:55.261281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:48:08.804440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260854+0000","last_change":"2024-08-18T22:23:53.242509+0000","last_active":"2024-08-18T22:23:55.260854+0000","last_peered":"2024-08-18T22:23:55.260854+0000","last_clean":"2024-08-18T22:23:55.260854+0000","last_became_active":"2024-08-18T22:23:53.242205+0000","last_became_peered":"2024-08-18T22:23:53.242205+0000","last_unstale":"2024-08-18T22:23:55.260854+0000","last_undegraded":"2024-08-18T22:23:55.260854+0000","last_fullsized":"2024-08-18T22:23:55.260854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:17:30.070215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729753+0000","last_change":"2024-08-18T22:23:54.268447+0000","last_active":"2024-08-18T22:23:55.729753+0000","last_peered":"2024-08-18T22:23:55.729753+0000","last_clean":"2024-08-18T22:23:55.729753+0000","last_became_active":"2024-08-18T22:23:54.268120+0000","last_became_peered":"2024-08-18T22:23:54.268120+0000","last_unstale":"2024-08-18T22:23:55.729753+0000","last_undegraded":"2024-08-18T22:23:55.729753+0000","last_fullsized":"2024-08-18T22:23:55.729753+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:35:25.612886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730048+0000","last_change":"2024-08-18T22:23:53.245330+0000","last_active":"2024-08-18T22:23:55.730048+0000","last_peered":"2024-08-18T22:23:55.730048+0000","last_clean":"2024-08-18T22:23:55.730048+0000","last_became_active":"2024-08-18T22:23:53.243674+0000","last_became_peered":"2024-08-18T22:23:53.243674+0000","last_unstale":"2024-08-18T22:23:55.730048+0000","last_undegraded":"2024-08-18T22:23:55.730048+0000","last_fullsized":"2024-08-18T22:23:55.730048+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:19:45.657386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731327+0000","last_change":"2024-08-18T22:23:54.262074+0000","last_active":"2024-08-18T22:23:55.731327+0000","last_peered":"2024-08-18T22:23:55.731327+0000","last_clean":"2024-08-18T22:23:55.731327+0000","last_became_active":"2024-08-18T22:23:54.259828+0000","last_became_peered":"2024-08-18T22:23:54.259828+0000","last_unstale":"2024-08-18T22:23:55.731327+0000","last_undegraded":"2024-08-18T22:23:55.731327+0000","last_fullsized":"2024-08-18T22:23:55.731327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:53.384493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264611+0000","last_change":"2024-08-18T22:23:53.249062+0000","last_active":"2024-08-18T22:23:55.264611+0000","last_peered":"2024-08-18T22:23:55.264611+0000","last_clean":"2024-08-18T22:23:55.264611+0000","last_became_active":"2024-08-18T22:23:53.248766+0000","last_became_peered":"2024-08-18T22:23:53.248766+0000","last_unstale":"2024-08-18T22:23:55.264611+0000","last_undegraded":"2024-08-18T22:23:55.264611+0000","last_fullsized":"2024-08-18T22:23:55.264611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:51.713170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731298+0000","last_change":"2024-08-18T22:23:54.270564+0000","last_active":"2024-08-18T22:23:55.731298+0000","last_peered":"2024-08-18T22:23:55.731298+0000","last_clean":"2024-08-18T22:23:55.731298+0000","last_became_active":"2024-08-18T22:23:54.270270+0000","last_became_peered":"2024-08-18T22:23:54.270270+0000","last_unstale":"2024-08-18T22:23:55.731298+0000","last_undegraded":"2024-08-18T22:23:55.731298+0000","last_fullsized":"2024-08-18T22:23:55.731298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:38.075480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"81'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260957+0000","last_change":"2024-08-18T22:23:53.245872+0000","last_active":"2024-08-18T22:23:55.260957+0000","last_peered":"2024-08-18T22:23:55.260957+0000","last_clean":"2024-08-18T22:23:55.260957+0000","last_became_active":"2024-08-18T22:23:53.245598+0000","last_became_peered":"2024-08-18T22:23:53.245598+0000","last_unstale":"2024-08-18T22:23:55.260957+0000","last_undegraded":"2024-08-18T22:23:55.260957+0000","last_fullsized":"2024-08-18T22:23:55.260957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:13.600410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729998+0000","last_change":"2024-08-18T22:23:54.254659+0000","last_active":"2024-08-18T22:23:55.729998+0000","last_peered":"2024-08-18T22:23:55.729998+0000","last_clean":"2024-08-18T22:23:55.729998+0000","last_became_active":"2024-08-18T22:23:54.254151+0000","last_became_peered":"2024-08-18T22:23:54.254151+0000","last_unstale":"2024-08-18T22:23:55.729998+0000","last_undegraded":"2024-08-18T22:23:55.729998+0000","last_fullsized":"2024-08-18T22:23:55.729998+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:01:57.523388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729535+0000","last_change":"2024-08-18T22:23:53.247110+0000","last_active":"2024-08-18T22:23:55.729535+0000","last_peered":"2024-08-18T22:23:55.729535+0000","last_clean":"2024-08-18T22:23:55.729535+0000","last_became_active":"2024-08-18T22:23:53.245877+0000","last_became_peered":"2024-08-18T22:23:53.245877+0000","last_unstale":"2024-08-18T22:23:55.729535+0000","last_undegraded":"2024-08-18T22:23:55.729535+0000","last_fullsized":"2024-08-18T22:23:55.729535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:37:08.045334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259694+0000","last_change":"2024-08-18T22:23:54.260477+0000","last_active":"2024-08-18T22:23:55.259694+0000","last_peered":"2024-08-18T22:23:55.259694+0000","last_clean":"2024-08-18T22:23:55.259694+0000","last_became_active":"2024-08-18T22:23:54.260194+0000","last_became_peered":"2024-08-18T22:23:54.260194+0000","last_unstale":"2024-08-18T22:23:55.259694+0000","last_undegraded":"2024-08-18T22:23:55.259694+0000","last_fullsized":"2024-08-18T22:23:55.259694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:53.087509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259761+0000","last_change":"2024-08-18T22:23:53.241741+0000","last_active":"2024-08-18T22:23:55.259761+0000","last_peered":"2024-08-18T22:23:55.259761+0000","last_clean":"2024-08-18T22:23:55.259761+0000","last_became_active":"2024-08-18T22:23:53.241388+0000","last_became_peered":"2024-08-18T22:23:53.241388+0000","last_unstale":"2024-08-18T22:23:55.259761+0000","last_undegraded":"2024-08-18T22:23:55.259761+0000","last_fullsized":"2024-08-18T22:23:55.259761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:24.173939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261570+0000","last_change":"2024-08-18T22:23:54.258016+0000","last_active":"2024-08-18T22:23:55.261570+0000","last_peered":"2024-08-18T22:23:55.261570+0000","last_clean":"2024-08-18T22:23:55.261570+0000","last_became_active":"2024-08-18T22:23:54.257738+0000","last_became_peered":"2024-08-18T22:23:54.257738+0000","last_unstale":"2024-08-18T22:23:55.261570+0000","last_undegraded":"2024-08-18T22:23:55.261570+0000","last_fullsized":"2024-08-18T22:23:55.261570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:37.800810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264098+0000","last_change":"2024-08-18T22:23:53.251780+0000","last_active":"2024-08-18T22:23:55.264098+0000","last_peered":"2024-08-18T22:23:55.264098+0000","last_clean":"2024-08-18T22:23:55.264098+0000","last_became_active":"2024-08-18T22:23:53.251524+0000","last_became_peered":"2024-08-18T22:23:53.251524+0000","last_unstale":"2024-08-18T22:23:55.264098+0000","last_undegraded":"2024-08-18T22:23:55.264098+0000","last_fullsized":"2024-08-18T22:23:55.264098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:01.049290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261884+0000","last_change":"2024-08-18T22:23:54.263262+0000","last_active":"2024-08-18T22:23:55.261884+0000","last_peered":"2024-08-18T22:23:55.261884+0000","last_clean":"2024-08-18T22:23:55.261884+0000","last_became_active":"2024-08-18T22:23:54.262506+0000","last_became_peered":"2024-08-18T22:23:54.262506+0000","last_unstale":"2024-08-18T22:23:55.261884+0000","last_undegraded":"2024-08-18T22:23:55.261884+0000","last_fullsized":"2024-08-18T22:23:55.261884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:44:38.971490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"81'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261360+0000","last_change":"2024-08-18T22:23:53.250165+0000","last_active":"2024-08-18T22:23:55.261360+0000","last_peered":"2024-08-18T22:23:55.261360+0000","last_clean":"2024-08-18T22:23:55.261360+0000","last_became_active":"2024-08-18T22:23:53.249889+0000","last_became_peered":"2024-08-18T22:23:53.249889+0000","last_unstale":"2024-08-18T22:23:55.261360+0000","last_undegraded":"2024-08-18T22:23:55.261360+0000","last_fullsized":"2024-08-18T22:23:55.261360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:53.267001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730950+0000","last_change":"2024-08-18T22:23:54.265098+0000","last_active":"2024-08-18T22:23:55.730950+0000","last_peered":"2024-08-18T22:23:55.730950+0000","last_clean":"2024-08-18T22:23:55.730950+0000","last_became_active":"2024-08-18T22:23:54.264840+0000","last_became_peered":"2024-08-18T22:23:54.264840+0000","last_unstale":"2024-08-18T22:23:55.730950+0000","last_undegraded":"2024-08-18T22:23:55.730950+0000","last_fullsized":"2024-08-18T22:23:55.730950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:14.617926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260957+0000","last_change":"2024-08-18T22:23:53.243095+0000","last_active":"2024-08-18T22:23:55.260957+0000","last_peered":"2024-08-18T22:23:55.260957+0000","last_clean":"2024-08-18T22:23:55.260957+0000","last_became_active":"2024-08-18T22:23:53.242833+0000","last_became_peered":"2024-08-18T22:23:53.242833+0000","last_unstale":"2024-08-18T22:23:55.260957+0000","last_undegraded":"2024-08-18T22:23:55.260957+0000","last_fullsized":"2024-08-18T22:23:55.260957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:35:24.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264113+0000","last_change":"2024-08-18T22:23:54.259286+0000","last_active":"2024-08-18T22:23:55.264113+0000","last_peered":"2024-08-18T22:23:55.264113+0000","last_clean":"2024-08-18T22:23:55.264113+0000","last_became_active":"2024-08-18T22:23:54.258960+0000","last_became_peered":"2024-08-18T22:23:54.258960+0000","last_unstale":"2024-08-18T22:23:55.264113+0000","last_undegraded":"2024-08-18T22:23:55.264113+0000","last_fullsized":"2024-08-18T22:23:55.264113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:48.497587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261682+0000","last_change":"2024-08-18T22:23:53.241158+0000","last_active":"2024-08-18T22:23:55.261682+0000","last_peered":"2024-08-18T22:23:55.261682+0000","last_clean":"2024-08-18T22:23:55.261682+0000","last_became_active":"2024-08-18T22:23:53.240859+0000","last_became_peered":"2024-08-18T22:23:53.240859+0000","last_unstale":"2024-08-18T22:23:55.261682+0000","last_undegraded":"2024-08-18T22:23:55.261682+0000","last_fullsized":"2024-08-18T22:23:55.261682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:49:41.985620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264192+0000","last_change":"2024-08-18T22:23:54.271013+0000","last_active":"2024-08-18T22:23:55.264192+0000","last_peered":"2024-08-18T22:23:55.264192+0000","last_clean":"2024-08-18T22:23:55.264192+0000","last_became_active":"2024-08-18T22:23:54.270715+0000","last_became_peered":"2024-08-18T22:23:54.270715+0000","last_unstale":"2024-08-18T22:23:55.264192+0000","last_undegraded":"2024-08-18T22:23:55.264192+0000","last_fullsized":"2024-08-18T22:23:55.264192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:18:11.045700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264616+0000","last_change":"2024-08-18T22:23:53.246903+0000","last_active":"2024-08-18T22:23:55.264616+0000","last_peered":"2024-08-18T22:23:55.264616+0000","last_clean":"2024-08-18T22:23:55.264616+0000","last_became_active":"2024-08-18T22:23:53.246619+0000","last_became_peered":"2024-08-18T22:23:53.246619+0000","last_unstale":"2024-08-18T22:23:55.264616+0000","last_undegraded":"2024-08-18T22:23:55.264616+0000","last_fullsized":"2024-08-18T22:23:55.264616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:33:39.529484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731279+0000","last_change":"2024-08-18T22:23:54.259110+0000","last_active":"2024-08-18T22:23:55.731279+0000","last_peered":"2024-08-18T22:23:55.731279+0000","last_clean":"2024-08-18T22:23:55.731279+0000","last_became_active":"2024-08-18T22:23:54.258829+0000","last_became_peered":"2024-08-18T22:23:54.258829+0000","last_unstale":"2024-08-18T22:23:55.731279+0000","last_undegraded":"2024-08-18T22:23:55.731279+0000","last_fullsized":"2024-08-18T22:23:55.731279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:43:49.239013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731563+0000","last_change":"2024-08-18T22:23:53.250046+0000","last_active":"2024-08-18T22:23:55.731563+0000","last_peered":"2024-08-18T22:23:55.731563+0000","last_clean":"2024-08-18T22:23:55.731563+0000","last_became_active":"2024-08-18T22:23:53.246620+0000","last_became_peered":"2024-08-18T22:23:53.246620+0000","last_unstale":"2024-08-18T22:23:55.731563+0000","last_undegraded":"2024-08-18T22:23:55.731563+0000","last_fullsized":"2024-08-18T22:23:55.731563+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:35.536263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261775+0000","last_change":"2024-08-18T22:23:54.268706+0000","last_active":"2024-08-18T22:23:55.261775+0000","last_peered":"2024-08-18T22:23:55.261775+0000","last_clean":"2024-08-18T22:23:55.261775+0000","last_became_active":"2024-08-18T22:23:54.268415+0000","last_became_peered":"2024-08-18T22:23:54.268415+0000","last_unstale":"2024-08-18T22:23:55.261775+0000","last_undegraded":"2024-08-18T22:23:55.261775+0000","last_fullsized":"2024-08-18T22:23:55.261775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:51:00.060488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731278+0000","last_change":"2024-08-18T22:23:53.242322+0000","last_active":"2024-08-18T22:23:55.731278+0000","last_peered":"2024-08-18T22:23:55.731278+0000","last_clean":"2024-08-18T22:23:55.731278+0000","last_became_active":"2024-08-18T22:23:53.241981+0000","last_became_peered":"2024-08-18T22:23:53.241981+0000","last_unstale":"2024-08-18T22:23:55.731278+0000","last_undegraded":"2024-08-18T22:23:55.731278+0000","last_fullsized":"2024-08-18T22:23:55.731278+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:37:53.231387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261851+0000","last_change":"2024-08-18T22:23:54.269337+0000","last_active":"2024-08-18T22:23:55.261851+0000","last_peered":"2024-08-18T22:23:55.261851+0000","last_clean":"2024-08-18T22:23:55.261851+0000","last_became_active":"2024-08-18T22:23:54.269044+0000","last_became_peered":"2024-08-18T22:23:54.269044+0000","last_unstale":"2024-08-18T22:23:55.261851+0000","last_undegraded":"2024-08-18T22:23:55.261851+0000","last_fullsized":"2024-08-18T22:23:55.261851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:39:55.201722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730930+0000","last_change":"2024-08-18T22:23:53.239454+0000","last_active":"2024-08-18T22:23:55.730930+0000","last_peered":"2024-08-18T22:23:55.730930+0000","last_clean":"2024-08-18T22:23:55.730930+0000","last_became_active":"2024-08-18T22:23:53.239189+0000","last_became_peered":"2024-08-18T22:23:53.239189+0000","last_unstale":"2024-08-18T22:23:55.730930+0000","last_undegraded":"2024-08-18T22:23:55.730930+0000","last_fullsized":"2024-08-18T22:23:55.730930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:57.696273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261945+0000","last_change":"2024-08-18T22:23:54.265426+0000","last_active":"2024-08-18T22:23:55.261945+0000","last_peered":"2024-08-18T22:23:55.261945+0000","last_clean":"2024-08-18T22:23:55.261945+0000","last_became_active":"2024-08-18T22:23:54.263577+0000","last_became_peered":"2024-08-18T22:23:54.263577+0000","last_unstale":"2024-08-18T22:23:55.261945+0000","last_undegraded":"2024-08-18T22:23:55.261945+0000","last_fullsized":"2024-08-18T22:23:55.261945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:14:01.594821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730959+0000","last_change":"2024-08-18T22:23:53.247190+0000","last_active":"2024-08-18T22:23:55.730959+0000","last_peered":"2024-08-18T22:23:55.730959+0000","last_clean":"2024-08-18T22:23:55.730959+0000","last_became_active":"2024-08-18T22:23:53.244049+0000","last_became_peered":"2024-08-18T22:23:53.244049+0000","last_unstale":"2024-08-18T22:23:55.730959+0000","last_undegraded":"2024-08-18T22:23:55.730959+0000","last_fullsized":"2024-08-18T22:23:55.730959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:20.053104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260839+0000","last_change":"2024-08-18T22:23:54.259872+0000","last_active":"2024-08-18T22:23:55.260839+0000","last_peered":"2024-08-18T22:23:55.260839+0000","last_clean":"2024-08-18T22:23:55.260839+0000","last_became_active":"2024-08-18T22:23:54.259633+0000","last_became_peered":"2024-08-18T22:23:54.259633+0000","last_unstale":"2024-08-18T22:23:55.260839+0000","last_undegraded":"2024-08-18T22:23:55.260839+0000","last_fullsized":"2024-08-18T22:23:55.260839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:12.200171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.729900+0000","last_change":"2024-08-18T22:23:53.246134+0000","last_active":"2024-08-18T22:23:55.729900+0000","last_peered":"2024-08-18T22:23:55.729900+0000","last_clean":"2024-08-18T22:23:55.729900+0000","last_became_active":"2024-08-18T22:23:53.245585+0000","last_became_peered":"2024-08-18T22:23:53.245585+0000","last_unstale":"2024-08-18T22:23:55.729900+0000","last_undegraded":"2024-08-18T22:23:55.729900+0000","last_fullsized":"2024-08-18T22:23:55.729900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:10:17.284982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.258804+0000","last_change":"2024-08-18T22:23:54.263977+0000","last_active":"2024-08-18T22:23:55.258804+0000","last_peered":"2024-08-18T22:23:55.258804+0000","last_clean":"2024-08-18T22:23:55.258804+0000","last_became_active":"2024-08-18T22:23:54.263253+0000","last_became_peered":"2024-08-18T22:23:54.263253+0000","last_unstale":"2024-08-18T22:23:55.258804+0000","last_undegraded":"2024-08-18T22:23:55.258804+0000","last_fullsized":"2024-08-18T22:23:55.258804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:19:53.032372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261890+0000","last_change":"2024-08-18T22:23:53.255034+0000","last_active":"2024-08-18T22:23:55.261890+0000","last_peered":"2024-08-18T22:23:55.261890+0000","last_clean":"2024-08-18T22:23:55.261890+0000","last_became_active":"2024-08-18T22:23:53.254449+0000","last_became_peered":"2024-08-18T22:23:53.254449+0000","last_unstale":"2024-08-18T22:23:55.261890+0000","last_undegraded":"2024-08-18T22:23:55.261890+0000","last_fullsized":"2024-08-18T22:23:55.261890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:03:46.748213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261122+0000","last_change":"2024-08-18T22:23:54.263284+0000","last_active":"2024-08-18T22:23:55.261122+0000","last_peered":"2024-08-18T22:23:55.261122+0000","last_clean":"2024-08-18T22:23:55.261122+0000","last_became_active":"2024-08-18T22:23:54.262747+0000","last_became_peered":"2024-08-18T22:23:54.262747+0000","last_unstale":"2024-08-18T22:23:55.261122+0000","last_undegraded":"2024-08-18T22:23:55.261122+0000","last_fullsized":"2024-08-18T22:23:55.261122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:51:52.385446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260396+0000","last_change":"2024-08-18T22:23:53.240247+0000","last_active":"2024-08-18T22:23:55.260396+0000","last_peered":"2024-08-18T22:23:55.260396+0000","last_clean":"2024-08-18T22:23:55.260396+0000","last_became_active":"2024-08-18T22:23:53.239551+0000","last_became_peered":"2024-08-18T22:23:53.239551+0000","last_unstale":"2024-08-18T22:23:55.260396+0000","last_undegraded":"2024-08-18T22:23:55.260396+0000","last_fullsized":"2024-08-18T22:23:55.260396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:33:00.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.261742+0000","last_change":"2024-08-18T22:23:54.251015+0000","last_active":"2024-08-18T22:23:55.261742+0000","last_peered":"2024-08-18T22:23:55.261742+0000","last_clean":"2024-08-18T22:23:55.261742+0000","last_became_active":"2024-08-18T22:23:54.250667+0000","last_became_peered":"2024-08-18T22:23:54.250667+0000","last_unstale":"2024-08-18T22:23:55.261742+0000","last_undegraded":"2024-08-18T22:23:55.261742+0000","last_fullsized":"2024-08-18T22:23:55.261742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:01.758578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259882+0000","last_change":"2024-08-18T22:23:53.244792+0000","last_active":"2024-08-18T22:23:55.259882+0000","last_peered":"2024-08-18T22:23:55.259882+0000","last_clean":"2024-08-18T22:23:55.259882+0000","last_became_active":"2024-08-18T22:23:53.244310+0000","last_became_peered":"2024-08-18T22:23:53.244310+0000","last_unstale":"2024-08-18T22:23:55.259882+0000","last_undegraded":"2024-08-18T22:23:55.259882+0000","last_fullsized":"2024-08-18T22:23:55.259882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:53.267001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259392+0000","last_change":"2024-08-18T22:23:54.260015+0000","last_active":"2024-08-18T22:23:55.259392+0000","last_peered":"2024-08-18T22:23:55.259392+0000","last_clean":"2024-08-18T22:23:55.259392+0000","last_became_active":"2024-08-18T22:23:54.259757+0000","last_became_peered":"2024-08-18T22:23:54.259757+0000","last_unstale":"2024-08-18T22:23:55.259392+0000","last_undegraded":"2024-08-18T22:23:55.259392+0000","last_fullsized":"2024-08-18T22:23:55.259392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:43:05.105997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259301+0000","last_change":"2024-08-18T22:23:53.244540+0000","last_active":"2024-08-18T22:23:55.259301+0000","last_peered":"2024-08-18T22:23:55.259301+0000","last_clean":"2024-08-18T22:23:55.259301+0000","last_became_active":"2024-08-18T22:23:53.243417+0000","last_became_peered":"2024-08-18T22:23:53.243417+0000","last_unstale":"2024-08-18T22:23:55.259301+0000","last_undegraded":"2024-08-18T22:23:55.259301+0000","last_fullsized":"2024-08-18T22:23:55.259301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:59.166810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260613+0000","last_change":"2024-08-18T22:23:54.258841+0000","last_active":"2024-08-18T22:23:55.260613+0000","last_peered":"2024-08-18T22:23:55.260613+0000","last_clean":"2024-08-18T22:23:55.260613+0000","last_became_active":"2024-08-18T22:23:54.258582+0000","last_became_peered":"2024-08-18T22:23:54.258582+0000","last_unstale":"2024-08-18T22:23:55.260613+0000","last_undegraded":"2024-08-18T22:23:55.260613+0000","last_fullsized":"2024-08-18T22:23:55.260613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:59.090642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.264370+0000","last_change":"2024-08-18T22:23:53.252271+0000","last_active":"2024-08-18T22:23:55.264370+0000","last_peered":"2024-08-18T22:23:55.264370+0000","last_clean":"2024-08-18T22:23:55.264370+0000","last_became_active":"2024-08-18T22:23:53.252030+0000","last_became_peered":"2024-08-18T22:23:53.252030+0000","last_unstale":"2024-08-18T22:23:55.264370+0000","last_undegraded":"2024-08-18T22:23:55.264370+0000","last_fullsized":"2024-08-18T22:23:55.264370+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:19.534699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731647+0000","last_change":"2024-08-18T22:23:54.272594+0000","last_active":"2024-08-18T22:23:55.731647+0000","last_peered":"2024-08-18T22:23:55.731647+0000","last_clean":"2024-08-18T22:23:55.731647+0000","last_became_active":"2024-08-18T22:23:54.272324+0000","last_became_peered":"2024-08-18T22:23:54.272324+0000","last_unstale":"2024-08-18T22:23:55.731647+0000","last_undegraded":"2024-08-18T22:23:55.731647+0000","last_fullsized":"2024-08-18T22:23:55.731647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:50:57.847238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259063+0000","last_change":"2024-08-18T22:23:53.249008+0000","last_active":"2024-08-18T22:23:55.259063+0000","last_peered":"2024-08-18T22:23:55.259063+0000","last_clean":"2024-08-18T22:23:55.259063+0000","last_became_active":"2024-08-18T22:23:53.248747+0000","last_became_peered":"2024-08-18T22:23:53.248747+0000","last_unstale":"2024-08-18T22:23:55.259063+0000","last_undegraded":"2024-08-18T22:23:55.259063+0000","last_fullsized":"2024-08-18T22:23:55.259063+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:37:35.536263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731723+0000","last_change":"2024-08-18T22:23:54.267073+0000","last_active":"2024-08-18T22:23:55.731723+0000","last_peered":"2024-08-18T22:23:55.731723+0000","last_clean":"2024-08-18T22:23:55.731723+0000","last_became_active":"2024-08-18T22:23:54.266802+0000","last_became_peered":"2024-08-18T22:23:54.266802+0000","last_unstale":"2024-08-18T22:23:55.731723+0000","last_undegraded":"2024-08-18T22:23:55.731723+0000","last_fullsized":"2024-08-18T22:23:55.731723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:19:53.032372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.730908+0000","last_change":"2024-08-18T22:23:53.253204+0000","last_active":"2024-08-18T22:23:55.730908+0000","last_peered":"2024-08-18T22:23:55.730908+0000","last_clean":"2024-08-18T22:23:55.730908+0000","last_became_active":"2024-08-18T22:23:53.252957+0000","last_became_peered":"2024-08-18T22:23:53.252957+0000","last_unstale":"2024-08-18T22:23:55.730908+0000","last_undegraded":"2024-08-18T22:23:55.730908+0000","last_fullsized":"2024-08-18T22:23:55.730908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:59.166810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.260290+0000","last_change":"2024-08-18T22:23:54.258499+0000","last_active":"2024-08-18T22:23:55.260290+0000","last_peered":"2024-08-18T22:23:55.260290+0000","last_clean":"2024-08-18T22:23:55.260290+0000","last_became_active":"2024-08-18T22:23:54.258187+0000","last_became_peered":"2024-08-18T22:23:54.258187+0000","last_unstale":"2024-08-18T22:23:55.260290+0000","last_undegraded":"2024-08-18T22:23:55.260290+0000","last_fullsized":"2024-08-18T22:23:55.260290+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:53.220736+0000","last_clean_scrub_stamp":"2024-08-18T22:23:53.220736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:14.751154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.731711+0000","last_change":"2024-08-18T22:23:53.242215+0000","last_active":"2024-08-18T22:23:55.731711+0000","last_peered":"2024-08-18T22:23:55.731711+0000","last_clean":"2024-08-18T22:23:55.731711+0000","last_became_active":"2024-08-18T22:23:53.241900+0000","last_became_peered":"2024-08-18T22:23:53.241900+0000","last_unstale":"2024-08-18T22:23:55.731711+0000","last_undegraded":"2024-08-18T22:23:55.731711+0000","last_fullsized":"2024-08-18T22:23:55.731711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:23:52.214261+0000","last_clean_scrub_stamp":"2024-08-18T22:23:52.214261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:01:56.516913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":294,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-18T22:23:55.259903+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:23:55.259903+0000","last_peered":"2024-08-18T22:23:55.259903+0000","last_clean":"2024-08-18T22:23:55.259903+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:23:55.259903+0000","last_undegraded":"2024-08-18T22:23:55.259903+0000","last_fullsized":"2024-08-18T22:23:55.259903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509501,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36900,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334940,"statfs":{"total":96636764160,"available":96598978560,"internally_reserved":0,"allocated":1593344,"data_stored":1048182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335512,"statfs":{"total":96636764160,"available":96599564288,"internally_reserved":0,"allocated":1007616,"data_stored":459404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":999424,"data_stored":457826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":999424,"data_stored":458374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1003520,"data_stored":457904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509502,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41052,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330788,"statfs":{"total":96636764160,"available":96594726912,"internally_reserved":0,"allocated":1589248,"data_stored":1048160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1015808,"data_stored":459508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1007616,"data_stored":458534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:24:03.324 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:24:03.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:24:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.510+0000 7fb74be00640 1 Processor -- start 2024-08-18T22:24:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.510+0000 7fb74be00640 1 -- start start 2024-08-18T22:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74be00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb74c145420 0x7fb74c072de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb74c06c0c0 0x7fb74c0cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74be00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb74c160000 con 0x7fb74c15fb20 2024-08-18T22:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74be00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb74c1602e0 con 0x7fb74c06c0c0 2024-08-18T22:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74be00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb74c1605c0 con 0x7fb74c145420 2024-08-18T22:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb74c06c0c0 0x7fb74c0cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb74c06c0c0 0x7fb74c0cff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45306/0 (socket says 172.21.15.5:45306) 2024-08-18T22:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74b400640 1 -- 172.21.15.5:0/1096385193 learned_addr learned my addr 172.21.15.5:0/1096385193 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74aa00640 1 --2- 172.21.15.5:0/1096385193 >> v2:172.21.15.117:3300/0 conn(0x7fb74c145420 0x7fb74c072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74b400640 1 -- 172.21.15.5:0/1096385193 >> v2:172.21.15.117:3300/0 conn(0x7fb74c145420 msgr2=0x7fb74c072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74b400640 1 --2- 172.21.15.5:0/1096385193 >> v2:172.21.15.117:3300/0 conn(0x7fb74c145420 0x7fb74c072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74b400640 1 -- 172.21.15.5:0/1096385193 >> v1:172.21.15.117:6789/0 conn(0x7fb74c15fb20 legacy=0x7fb74c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.514+0000 7fb74b400640 1 -- 172.21.15.5:0/1096385193 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74c1608a0 con 0x7fb74c06c0c0 2024-08-18T22:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74b400640 1 --2- 172.21.15.5:0/1096385193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74c06c0c0 0x7fb74c0cff90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb74c0d1f20 tx=0x7fb74401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94875b4432d6d333 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb749600640 1 -- 172.21.15.5:0/1096385193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440a5810 con 0x7fb74c06c0c0 2024-08-18T22:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb749600640 1 -- 172.21.15.5:0/1096385193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7440a59b0 con 0x7fb74c06c0c0 2024-08-18T22:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb749600640 1 -- 172.21.15.5:0/1096385193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440a5d80 con 0x7fb74c06c0c0 2024-08-18T22:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 -- 172.21.15.5:0/1096385193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74c06c0c0 msgr2=0x7fb74c0cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 --2- 172.21.15.5:0/1096385193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74c06c0c0 0x7fb74c0cff90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb74c0d1f20 tx=0x7fb74401c990 comp rx=0 tx=0).stop 2024-08-18T22:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 -- 172.21.15.5:0/1096385193 shutdown_connections 2024-08-18T22:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 --2- 172.21.15.5:0/1096385193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74c06c0c0 0x7fb74c0cff90 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 --2- 172.21.15.5:0/1096385193 >> v2:172.21.15.117:3300/0 conn(0x7fb74c145420 0x7fb74c072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 -- 172.21.15.5:0/1096385193 >> 172.21.15.5:0/1096385193 conn(0x7fb74c0d1000 msgr2=0x7fb74c0d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 -- 172.21.15.5:0/1096385193 shutdown_connections 2024-08-18T22:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 -- 172.21.15.5:0/1096385193 wait complete. 2024-08-18T22:24:03.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 Processor -- start 2024-08-18T22:24:03.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 -- start start 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb74c06c0c0 0x7fb74c13e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb74c145420 0x7fb74c140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74c15fb20 0x7fb74c0aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb74c168e30 con 0x7fb74c15fb20 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb74c168cb0 con 0x7fb74c06c0c0 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74be00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb74c168fb0 con 0x7fb74c145420 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.518+0000 7fb74b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74c15fb20 0x7fb74c0aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74c15fb20 0x7fb74c0aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45308/0 (socket says 172.21.15.5:45308) 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74b400640 1 -- 172.21.15.5:0/3639920679 learned_addr learned my addr 172.21.15.5:0/3639920679 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74a000640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb74c145420 0x7fb74c140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74aa00640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb74c06c0c0 0x7fb74c13e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74b400640 1 -- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb74c145420 msgr2=0x7fb74c140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74b400640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb74c145420 0x7fb74c140550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74b400640 1 -- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb74c06c0c0 msgr2=0x7fb74c13e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74b400640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb74c06c0c0 0x7fb74c13e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74b400640 1 -- 172.21.15.5:0/3639920679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74c1432c0 con 0x7fb74c15fb20 2024-08-18T22:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74b400640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74c15fb20 0x7fb74c0aa100 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb7440af040 tx=0x7fb744019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb742a00640 1 -- 172.21.15.5:0/3639920679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440bc020 con 0x7fb74c15fb20 2024-08-18T22:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb742a00640 1 -- 172.21.15.5:0/3639920679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7440b8670 con 0x7fb74c15fb20 2024-08-18T22:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb742a00640 1 -- 172.21.15.5:0/3639920679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440b8a60 con 0x7fb74c15fb20 2024-08-18T22:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74be00640 1 -- 172.21.15.5:0/3639920679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74c0a9780 con 0x7fb74c15fb20 2024-08-18T22:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74be00640 1 -- 172.21.15.5:0/3639920679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb74c143530 con 0x7fb74c15fb20 2024-08-18T22:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb74be00640 1 -- 172.21.15.5:0/3639920679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb74c0cff90 con 0x7fb74c15fb20 2024-08-18T22:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb742a00640 1 -- 172.21.15.5:0/3639920679 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7440bf020 con 0x7fb74c15fb20 2024-08-18T22:24:03.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb742a00640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb72c0678c0 0x7fb72c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.522+0000 7fb742a00640 1 -- 172.21.15.5:0/3639920679 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7fb744120e10 con 0x7fb74c15fb20 2024-08-18T22:24:03.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.526+0000 7fb74aa00640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb72c0678c0 0x7fb72c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.526+0000 7fb74aa00640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb72c0678c0 0x7fb72c069d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009b60 tx=0x7fb73c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.530+0000 7fb742a00640 1 -- 172.21.15.5:0/3639920679 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb744124030 con 0x7fb74c15fb20 2024-08-18T22:24:03.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.754+0000 7fb74be00640 1 -- 172.21.15.5:0/3639920679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb74c0cdda0 con 0x7fb74c15fb20 2024-08-18T22:24:03.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.758+0000 7fb742a00640 1 -- 172.21.15.5:0/3639920679 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fb7440c6030 con 0x7fb74c15fb20 2024-08-18T22:24:03.759 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:24:03.759 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:24:03.759 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:24:03.759 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:24:03.759 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:24:03.759 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:24:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 -- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb72c0678c0 msgr2=0x7fb72c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb72c0678c0 0x7fb72c069d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009b60 tx=0x7fb73c009190 comp rx=0 tx=0).stop 2024-08-18T22:24:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 -- 172.21.15.5:0/3639920679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74c15fb20 msgr2=0x7fb74c0aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74c15fb20 0x7fb74c0aa100 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb7440af040 tx=0x7fb744019790 comp rx=0 tx=0).stop 2024-08-18T22:24:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 -- 172.21.15.5:0/3639920679 shutdown_connections 2024-08-18T22:24:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb72c0678c0 0x7fb72c069d80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74c15fb20 0x7fb74c0aa100 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb74c145420 0x7fb74c140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 --2- 172.21.15.5:0/3639920679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb74c06c0c0 0x7fb74c13e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 -- 172.21.15.5:0/3639920679 >> 172.21.15.5:0/3639920679 conn(0x7fb74c0d1000 msgr2=0x7fb74c0cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 -- 172.21.15.5:0/3639920679 shutdown_connections 2024-08-18T22:24:03.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.762+0000 7fb74be00640 1 -- 172.21.15.5:0/3639920679 wait complete. 2024-08-18T22:24:03.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac9000640 1 Processor -- start 2024-08-18T22:24:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac9000640 1 -- start start 2024-08-18T22:24:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac9000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ac409aa40 0x7f6ac415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40cde30 0x7f6ac409ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac9000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac409b360 con 0x7f6ac40b4510 2024-08-18T22:24:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac9000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac40ce770 con 0x7f6ac409aa40 2024-08-18T22:24:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac9000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac415d520 con 0x7f6ac40cde30 2024-08-18T22:24:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ac409aa40 0x7f6ac415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ac409aa40 0x7f6ac415cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45932/0 (socket says 172.21.15.5:45932) 2024-08-18T22:24:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac3400640 1 -- 172.21.15.5:0/1276345932 learned_addr learned my addr 172.21.15.5:0/1276345932 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac3400640 1 -- 172.21.15.5:0/1276345932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40cde30 msgr2=0x7f6ac409ae20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T22:24:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac3400640 1 --2- 172.21.15.5:0/1276345932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40cde30 0x7f6ac409ae20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac3400640 1 -- 172.21.15.5:0/1276345932 >> v1:172.21.15.117:6789/0 conn(0x7f6ac40b4510 legacy=0x7f6ac415fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.922+0000 7f6ac3400640 1 -- 172.21.15.5:0/1276345932 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac40ccd90 con 0x7f6ac409aa40 2024-08-18T22:24:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac3400640 1 --2- 172.21.15.5:0/1276345932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ac409aa40 0x7f6ac415cfe0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40098a0 tx=0x7f6ab401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a52f8fff19da3c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac2000640 1 -- 172.21.15.5:0/1276345932 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40b1070 con 0x7f6ac409aa40 2024-08-18T22:24:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac2000640 1 -- 172.21.15.5:0/1276345932 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab40ac630 con 0x7f6ac409aa40 2024-08-18T22:24:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac2000640 1 -- 172.21.15.5:0/1276345932 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40a8050 con 0x7f6ac409aa40 2024-08-18T22:24:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac9000640 1 -- 172.21.15.5:0/1276345932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ac409aa40 msgr2=0x7f6ac415cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac9000640 1 --2- 172.21.15.5:0/1276345932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ac409aa40 0x7f6ac415cfe0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40098a0 tx=0x7f6ab401c4f0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac9000640 1 -- 172.21.15.5:0/1276345932 shutdown_connections 2024-08-18T22:24:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac9000640 1 --2- 172.21.15.5:0/1276345932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40cde30 0x7f6ac409ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac9000640 1 --2- 172.21.15.5:0/1276345932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ac409aa40 0x7f6ac415cfe0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac9000640 1 -- 172.21.15.5:0/1276345932 >> 172.21.15.5:0/1276345932 conn(0x7f6ac40b3a20 msgr2=0x7f6ac40b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac9000640 1 -- 172.21.15.5:0/1276345932 shutdown_connections 2024-08-18T22:24:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac9000640 1 -- 172.21.15.5:0/1276345932 wait complete. 2024-08-18T22:24:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac9000640 1 Processor -- start 2024-08-18T22:24:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.926+0000 7f6ac9000640 1 -- start start 2024-08-18T22:24:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ac409aa40 0x7f6ac4159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac9000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac40b4510 0x7f6ac40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40cde30 0x7f6ac4165210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac9000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac415c230 con 0x7f6ac409aa40 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac9000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac40cd910 con 0x7f6ac40b4510 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac9000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac415c3b0 con 0x7f6ac40cde30 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ac409aa40 0x7f6ac4159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ac409aa40 0x7f6ac4159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45934/0 (socket says 172.21.15.5:45934) 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac3400640 1 -- 172.21.15.5:0/3538082475 learned_addr learned my addr 172.21.15.5:0/3538082475 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac3e00640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40cde30 0x7f6ac4165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac2a00640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac40b4510 0x7f6ac40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac3400640 1 -- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40cde30 msgr2=0x7f6ac4165210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac3400640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40cde30 0x7f6ac4165210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac3400640 1 -- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac40b4510 msgr2=0x7f6ac40b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac3400640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac40b4510 0x7f6ac40b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac3400640 1 -- 172.21.15.5:0/3538082475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac406fba0 con 0x7f6ac409aa40 2024-08-18T22:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac3400640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ac409aa40 0x7f6ac4159850 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6ab401aba0 tx=0x7f6ab4019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6abb400640 1 -- 172.21.15.5:0/3538082475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40b1040 con 0x7f6ac409aa40 2024-08-18T22:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6abb400640 1 -- 172.21.15.5:0/3538082475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab40ba070 con 0x7f6ac409aa40 2024-08-18T22:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6abb400640 1 -- 172.21.15.5:0/3538082475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40a8040 con 0x7f6ac409aa40 2024-08-18T22:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac9000640 1 -- 172.21.15.5:0/3538082475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac40b58b0 con 0x7f6ac409aa40 2024-08-18T22:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac9000640 1 -- 172.21.15.5:0/3538082475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac40af790 con 0x7f6ac409aa40 2024-08-18T22:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6ac9000640 1 -- 172.21.15.5:0/3538082475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac415cfe0 con 0x7f6ac409aa40 2024-08-18T22:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.930+0000 7f6abb400640 1 -- 172.21.15.5:0/3538082475 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6ab40b5880 con 0x7f6ac409aa40 2024-08-18T22:24:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.934+0000 7f6abb400640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6aa40678f0 0x7f6aa4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.934+0000 7f6abb400640 1 -- 172.21.15.5:0/3538082475 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f6ab411fce0 con 0x7f6ac409aa40 2024-08-18T22:24:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.934+0000 7f6ac2a00640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6aa40678f0 0x7f6aa4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:03.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.934+0000 7f6ac2a00640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6aa40678f0 0x7f6aa4069db0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6ac406e250 tx=0x7f6ab0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:03.938+0000 7f6abb400640 1 -- 172.21.15.5:0/3538082475 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6ab4016110 con 0x7f6ac409aa40 2024-08-18T22:24:04.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 -- 172.21.15.5:0/3538082475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ac4073d40 con 0x7f6ac409aa40 2024-08-18T22:24:04.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6abb400640 1 -- 172.21.15.5:0/3538082475 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5222 (secure 0 0 0) 0x7f6ab40f0680 con 0x7f6ac409aa40 2024-08-18T22:24:04.142 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:04.142 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"btime":"2024-08-18T22:23:57:263294+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6409,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4073781288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4073781288},{"type":"v1","addr":"172.21.15.5:6835","nonce":4073781288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6415,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2559910862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2559910862},{"type":"v1","addr":"172.21.15.117:6837","nonce":2559910862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6792,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3108112673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3108112673},{"type":"v1","addr":"172.21.15.5:6834","nonce":3108112673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:53.630789+0000","modified":"2024-08-18T22:23:56.664654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6798},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6798":{"gid":6798,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6836/116443176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":116443176},{"type":"v1","addr":"172.21.15.117:6836","nonce":116443176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6798,"qdb_cluster":[6798]},"id":5}]} 2024-08-18T22:24:04.143 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 56 2024-08-18T22:24:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 -- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6aa40678f0 msgr2=0x7f6aa4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6aa40678f0 0x7f6aa4069db0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6ac406e250 tx=0x7f6ab0008040 comp rx=0 tx=0).stop 2024-08-18T22:24:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 -- 172.21.15.5:0/3538082475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ac409aa40 msgr2=0x7f6ac4159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ac409aa40 0x7f6ac4159850 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6ab401aba0 tx=0x7f6ab4019290 comp rx=0 tx=0).stop 2024-08-18T22:24:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 -- 172.21.15.5:0/3538082475 shutdown_connections 2024-08-18T22:24:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6aa40678f0 0x7f6aa4069db0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40cde30 0x7f6ac4165210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac40b4510 0x7f6ac40b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 --2- 172.21.15.5:0/3538082475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ac409aa40 0x7f6ac4159850 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 -- 172.21.15.5:0/3538082475 >> 172.21.15.5:0/3538082475 conn(0x7f6ac40b3a20 msgr2=0x7f6ac406fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 -- 172.21.15.5:0/3538082475 shutdown_connections 2024-08-18T22:24:04.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.142+0000 7f6ac9000640 1 -- 172.21.15.5:0/3538082475 wait complete. 2024-08-18T22:24:04.566 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:23:53.630789+0000', 'modified': '2024-08-18T22:23:56.664654+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6798}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6798': {'gid': 6798, 'name': 'b', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6836/116443176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 116443176}, {'type': 'v1', 'addr': '172.21.15.117:6836', 'nonce': 116443176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6798, 'qdb_cluster': [6798]} 2024-08-18T22:24:04.566 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:24:04.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-18T22:24:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f061d000640 1 Processor -- start 2024-08-18T22:24:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f061d000640 1 -- start start 2024-08-18T22:24:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f061d000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06180d15e0 0x7f06180b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f061d000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06180d30b0 con 0x7f061815fb80 2024-08-18T22:24:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f061d000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06180d1bd0 con 0x7f06180d1090 2024-08-18T22:24:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f061d000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0618071c60 con 0x7f06180d15e0 2024-08-18T22:24:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f0615e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f061815fb80 0x7f061806fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56754/0 (socket says 172.21.15.5:56754) 2024-08-18T22:24:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f0615e00640 1 -- 172.21.15.5:0/4166020505 learned_addr learned my addr 172.21.15.5:0/4166020505 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f0616800640 1 --2- 172.21.15.5:0/4166020505 >> v2:172.21.15.5:3300/0 conn(0x7f06180d15e0 0x7f06180b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f0616800640 1 -- 172.21.15.5:0/4166020505 >> v1:172.21.15.117:6789/0 conn(0x7f06180d1090 legacy=0x7f0618071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f0616800640 1 -- 172.21.15.5:0/4166020505 >> v1:172.21.15.5:6789/0 conn(0x7f061815fb80 legacy=0x7f061806fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.710+0000 7f0616800640 1 -- 172.21.15.5:0/4166020505 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06180d2dd0 con 0x7f06180d15e0 2024-08-18T22:24:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.714+0000 7f0616800640 1 --2- 172.21.15.5:0/4166020505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06180d15e0 0x7f06180b5ad0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0610009d90 tx=0x7f061001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549e9e07a0b8e210 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.714+0000 7f0614a00640 1 -- 172.21.15.5:0/4166020505 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06100a66e0 con 0x7f06180d15e0 2024-08-18T22:24:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.714+0000 7f0614a00640 1 -- 172.21.15.5:0/4166020505 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06100a6880 con 0x7f06180d15e0 2024-08-18T22:24:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.714+0000 7f0614a00640 1 -- 172.21.15.5:0/4166020505 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06100a6c50 con 0x7f06180d15e0 2024-08-18T22:24:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.714+0000 7f061d000640 1 -- 172.21.15.5:0/4166020505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06180d15e0 msgr2=0x7f06180b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.714+0000 7f061d000640 1 --2- 172.21.15.5:0/4166020505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06180d15e0 0x7f06180b5ad0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0610009d90 tx=0x7f061001c810 comp rx=0 tx=0).stop 2024-08-18T22:24:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.714+0000 7f061d000640 1 -- 172.21.15.5:0/4166020505 shutdown_connections 2024-08-18T22:24:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.714+0000 7f061d000640 1 --2- 172.21.15.5:0/4166020505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06180d15e0 0x7f06180b5ad0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.714+0000 7f061d000640 1 -- 172.21.15.5:0/4166020505 >> 172.21.15.5:0/4166020505 conn(0x7f06180d2180 msgr2=0x7f06180d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.714+0000 7f061d000640 1 -- 172.21.15.5:0/4166020505 shutdown_connections 2024-08-18T22:24:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.714+0000 7f061d000640 1 -- 172.21.15.5:0/4166020505 wait complete. 2024-08-18T22:24:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f061d000640 1 Processor -- start 2024-08-18T22:24:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f061d000640 1 -- start start 2024-08-18T22:24:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f061d000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06180d1090 0x7f061806e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f061d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06180d15e0 0x7f0618149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f061d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061815fb80 0x7f061814cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f061d000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f061816a490 con 0x7f061815fb80 2024-08-18T22:24:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f061d000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f061816a310 con 0x7f06180d1090 2024-08-18T22:24:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f061d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f061816a610 con 0x7f06180d15e0 2024-08-18T22:24:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0616800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061815fb80 0x7f061814cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0616800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061815fb80 0x7f061814cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45958/0 (socket says 172.21.15.5:45958) 2024-08-18T22:24:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0616800640 1 -- 172.21.15.5:0/3521833440 learned_addr learned my addr 172.21.15.5:0/3521833440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0615400640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06180d15e0 0x7f0618149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0615e00640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06180d1090 0x7f061806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0616800640 1 -- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06180d15e0 msgr2=0x7f0618149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0616800640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06180d15e0 0x7f0618149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0616800640 1 -- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06180d1090 msgr2=0x7f061806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0616800640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06180d1090 0x7f061806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0616800640 1 -- 172.21.15.5:0/3521833440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0618149a90 con 0x7f061815fb80 2024-08-18T22:24:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0615400640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06180d15e0 0x7f0618149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f0616800640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061815fb80 0x7f061814cb10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f06100b0040 tx=0x7f06100195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f060e000640 1 -- 172.21.15.5:0/3521833440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06100be070 con 0x7f061815fb80 2024-08-18T22:24:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f060e000640 1 -- 172.21.15.5:0/3521833440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06100b8840 con 0x7f061815fb80 2024-08-18T22:24:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f060e000640 1 -- 172.21.15.5:0/3521833440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06100b8c30 con 0x7f061815fb80 2024-08-18T22:24:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f061d000640 1 -- 172.21.15.5:0/3521833440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f061806da30 con 0x7f061815fb80 2024-08-18T22:24:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.718+0000 7f061d000640 1 -- 172.21.15.5:0/3521833440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f061814c640 con 0x7f061815fb80 2024-08-18T22:24:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.722+0000 7f060e000640 1 -- 172.21.15.5:0/3521833440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06100c1070 con 0x7f061815fb80 2024-08-18T22:24:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.722+0000 7f060e000640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05f80678f0 0x7f05f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.722+0000 7f060e000640 1 -- 172.21.15.5:0/3521833440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f06101212b0 con 0x7f061815fb80 2024-08-18T22:24:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.722+0000 7f0615e00640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05f80678f0 0x7f05f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.722+0000 7f06205c2000 1 Processor -- start 2024-08-18T22:24:04.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.722+0000 7f06205c2000 1 -- start start 2024-08-18T22:24:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.722+0000 7f0615e00640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05f80678f0 0x7f05f8069db0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0608000f70 tx=0x7f0608009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.722+0000 7f06205c2000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0e4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.722+0000 7f06205c2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e4670 0x556cba09a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.722+0000 7f06205c2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba09a990 0x556cba09ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.722+0000 7f06205c2000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556cb9f80fd0 con 0x556cba0e3d50 2024-08-18T22:24:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556cb9ee73c0 con 0x556cba09a990 2024-08-18T22:24:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x556cb9e8cf70 con 0x556cba0e4670 2024-08-18T22:24:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0615e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0615e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0e4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45974/0 (socket says 172.21.15.5:45974) 2024-08-18T22:24:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0615e00640 1 -- 172.21.15.5:0/2744586706 learned_addr learned my addr 172.21.15.5:0/2744586706 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0615400640 1 --2- 172.21.15.5:0/2744586706 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e4670 0x556cba09a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0616800640 1 --2- 172.21.15.5:0/2744586706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba09a990 0x556cba09ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0615e00640 1 -- 172.21.15.5:0/2744586706 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e4670 msgr2=0x556cba09a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0615e00640 1 --2- 172.21.15.5:0/2744586706 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e4670 0x556cba09a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0615e00640 1 -- 172.21.15.5:0/2744586706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba09a990 msgr2=0x556cba09ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0615e00640 1 --2- 172.21.15.5:0/2744586706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba09a990 0x556cba09ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0615e00640 1 -- 172.21.15.5:0/2744586706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cb9e812e0 con 0x556cba0e3d50 2024-08-18T22:24:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0615400640 1 --2- 172.21.15.5:0/2744586706 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e4670 0x556cba09a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0615e00640 1 --2- 172.21.15.5:0/2744586706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0e4130 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0608005aa0 tx=0x7f0608011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e38a67979cc8d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0602a00640 1 -- 172.21.15.5:0/2744586706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608007710 con 0x556cba0e3d50 2024-08-18T22:24:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0602a00640 1 -- 172.21.15.5:0/2744586706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060800e6c0 con 0x556cba0e3d50 2024-08-18T22:24:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0602a00640 1 -- 172.21.15.5:0/2744586706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060800ea90 con 0x556cba0e3d50 2024-08-18T22:24:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 -- 172.21.15.5:0/2744586706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 msgr2=0x556cba0e4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 --2- 172.21.15.5:0/2744586706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0e4130 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0608005aa0 tx=0x7f0608011000 comp rx=0 tx=0).stop 2024-08-18T22:24:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 -- 172.21.15.5:0/2744586706 shutdown_connections 2024-08-18T22:24:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 --2- 172.21.15.5:0/2744586706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba09a990 0x556cba09ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 --2- 172.21.15.5:0/2744586706 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e4670 0x556cba09a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 --2- 172.21.15.5:0/2744586706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0e4130 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 -- 172.21.15.5:0/2744586706 >> 172.21.15.5:0/2744586706 conn(0x556cba096910 msgr2=0x556cba098d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:04.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 -- 172.21.15.5:0/2744586706 shutdown_connections 2024-08-18T22:24:04.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 -- 172.21.15.5:0/2744586706 wait complete. 2024-08-18T22:24:04.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 -- start start 2024-08-18T22:24:04.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 Processor -- start 2024-08-18T22:24:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba09a990 0x556cba0d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e3d50 0x556cba09fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e4670 0x556cba0a0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556cb9e8ee40 con 0x556cba0e4670 2024-08-18T22:24:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556cb9fa4af0 con 0x556cba09a990 2024-08-18T22:24:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x556cb9f49450 con 0x556cba0e3d50 2024-08-18T22:24:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f06205c2000 10 client.0 _ll_register_callbacks cb 0x556cba085630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:24:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0616800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e4670 0x556cba0a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0616800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e4670 0x556cba0a0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45978/0 (socket says 172.21.15.5:45978) 2024-08-18T22:24:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.726+0000 7f0616800640 1 -- 172.21.15.5:0/2126218589 learned_addr learned my addr 172.21.15.5:0/2126218589 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:04.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f0615400640 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e3d50 0x556cba09fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f0615e00640 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba09a990 0x556cba0d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f0616800640 1 -- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e3d50 msgr2=0x556cba09fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f0616800640 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e3d50 0x556cba09fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f0616800640 1 -- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba09a990 msgr2=0x556cba0d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f0616800640 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba09a990 0x556cba0d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f0616800640 1 -- 172.21.15.5:0/2126218589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cb9e6efd0 con 0x556cba0e4670 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f0615400640 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e3d50 0x556cba09fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f0616800640 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e4670 0x556cba0a0090 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f06100981f0 tx=0x7f06100f1610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7206f186839b6196 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f05f7400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f05f7400640 1 -- 172.21.15.5:0/2126218589 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06100c8040 con 0x556cba0e4670 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f05f7400640 1 -- 172.21.15.5:0/2126218589 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f06100f6b50 con 0x556cba0e4670 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 -- 172.21.15.5:0/2126218589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f060800e6c0 con 0x556cba0e4670 2024-08-18T22:24:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f05f7400640 1 -- 172.21.15.5:0/2126218589 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f061011f330 con 0x556cba0e4670 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 10 client.6957 fetch_fsmap learned FSMap version 56 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 -- 172.21.15.5:0/2126218589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x556cb9f6a4d0 con 0x556cba0e4670 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f05f7400640 1 -- 172.21.15.5:0/2126218589 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060800e6c0 con 0x556cba0e4670 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f05f7400640 1 -- 172.21.15.5:0/2126218589 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f061809b250 con 0x556cba0e4670 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 10 client.6957 fetch_fsmap finished waiting for FSMap version 56 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 10 client.6957 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 20 client.6957 populate_metadata read hostname 'smithi005' 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:6834/116443176,v1:172.21.15.117:6836/116443176] conn(0x556cba0d24f0 0x556cba0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 4 client.6957 mds_command: new command op to 6798 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 -- 172.21.15.5:0/2126218589 --> [v2:172.21.15.117:6834/116443176,v1:172.21.15.117:6836/116443176] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cb9e81c00 con 0x556cba0d24f0 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f0615e00640 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:6834/116443176,v1:172.21.15.117:6836/116443176] conn(0x556cba0d24f0 0x556cba0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f0615e00640 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:6834/116443176,v1:172.21.15.117:6836/116443176] conn(0x556cba0d24f0 0x556cba0d28d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=501af04370bd56c7 server_cookie=5f90c3aa33fa3769 in_seq=0 out_seq=0 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f05f7400640 10 client.6957 ms_handle_connect on v2:172.21.15.117:6834/116443176 2024-08-18T22:24:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f05f7400640 1 -- 172.21.15.5:0/2126218589 <== mds.0 v2:172.21.15.117:6834/116443176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556cb9e81c00 con 0x556cba0d24f0 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f05f7400640 10 client.6957 handle_command_reply: tid=0 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 client.6957 shutdown 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 -- 172.21.15.5:0/2126218589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e4670 msgr2=0x556cba0a0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e4670 0x556cba0a0090 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f06100981f0 tx=0x7f06100f1610 comp rx=0 tx=0).stop 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 -- 172.21.15.5:0/2126218589 shutdown_connections 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:6834/116443176,v1:172.21.15.117:6836/116443176] conn(0x556cba0d24f0 0x556cba0d28d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e4670 0x556cba0a0090 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e3d50 0x556cba09fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 --2- 172.21.15.5:0/2126218589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba09a990 0x556cba0d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f05f7400640 0 client.6957 ms_handle_reset on v2:172.21.15.117:6834/116443176 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.730+0000 7f06205c2000 1 -- 172.21.15.5:0/2126218589 >> 172.21.15.5:0/2126218589 conn(0x556cba096910 msgr2=0x556cba099520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.734+0000 7f06205c2000 1 -- 172.21.15.5:0/2126218589 shutdown_connections 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.734+0000 7f06205c2000 1 -- 172.21.15.5:0/2126218589 wait complete. 2024-08-18T22:24:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.734+0000 7f06205c2000 20 client.6957 trim_cache size 0 max 16384 2024-08-18T22:24:04.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.750+0000 7f06205c2000 1 Processor -- start 2024-08-18T22:24:04.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.750+0000 7f06205c2000 1 -- start start 2024-08-18T22:24:04.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.750+0000 7f06205c2000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba09a990 0x556cba0e3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.750+0000 7f06205c2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e3d50 0x556cba0e35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.750+0000 7f06205c2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba0e4670 0x556cba0fb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.750+0000 7f06205c2000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0618203220 con 0x556cba09a990 2024-08-18T22:24:04.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.750+0000 7f06205c2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f061814ec00 con 0x556cba0e4670 2024-08-18T22:24:04.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.750+0000 7f06205c2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f061814f250 con 0x556cba0e3d50 2024-08-18T22:24:04.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.750+0000 7f0615e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba09a990 0x556cba0e3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.750+0000 7f0615e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba09a990 0x556cba0e3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45986/0 (socket says 172.21.15.5:45986) 2024-08-18T22:24:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.750+0000 7f0615e00640 1 -- 172.21.15.5:0/901813045 learned_addr learned my addr 172.21.15.5:0/901813045 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0616800640 1 --2- 172.21.15.5:0/901813045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba0e4670 0x556cba0fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615400640 1 --2- 172.21.15.5:0/901813045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e3d50 0x556cba0e35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615e00640 1 -- 172.21.15.5:0/901813045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e3d50 msgr2=0x556cba0e35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615e00640 1 --2- 172.21.15.5:0/901813045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e3d50 0x556cba0e35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615e00640 1 -- 172.21.15.5:0/901813045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba0e4670 msgr2=0x556cba0fb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615e00640 1 --2- 172.21.15.5:0/901813045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba0e4670 0x556cba0fb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615e00640 1 -- 172.21.15.5:0/901813045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cba0e44a0 con 0x556cba09a990 2024-08-18T22:24:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0616800640 1 --2- 172.21.15.5:0/901813045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba0e4670 0x556cba0fb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:04.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615e00640 1 --2- 172.21.15.5:0/901813045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba09a990 0x556cba0e3060 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0608015040 tx=0x7f0608007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d21406f0faba93 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:04.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0602000640 1 -- 172.21.15.5:0/901813045 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060800e970 con 0x556cba09a990 2024-08-18T22:24:04.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0602000640 1 -- 172.21.15.5:0/901813045 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060800eb10 con 0x556cba09a990 2024-08-18T22:24:04.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0602000640 1 -- 172.21.15.5:0/901813045 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060802e3d0 con 0x556cba09a990 2024-08-18T22:24:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 -- 172.21.15.5:0/901813045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba09a990 msgr2=0x556cba0e3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 --2- 172.21.15.5:0/901813045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba09a990 0x556cba0e3060 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0608015040 tx=0x7f0608007000 comp rx=0 tx=0).stop 2024-08-18T22:24:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 -- 172.21.15.5:0/901813045 shutdown_connections 2024-08-18T22:24:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 --2- 172.21.15.5:0/901813045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba0e4670 0x556cba0fb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 --2- 172.21.15.5:0/901813045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba0e3d50 0x556cba0e35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 --2- 172.21.15.5:0/901813045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba09a990 0x556cba0e3060 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 -- 172.21.15.5:0/901813045 >> 172.21.15.5:0/901813045 conn(0x556cba096910 msgr2=0x556cba0e2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 -- 172.21.15.5:0/901813045 shutdown_connections 2024-08-18T22:24:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 -- 172.21.15.5:0/901813045 wait complete. 2024-08-18T22:24:04.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 -- start start 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 Processor -- start 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba09a990 0x556cba0f8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0f8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba0e4670 0x556cba0f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556cb9ea01d0 con 0x556cba0e3d50 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556cb9e7e900 con 0x556cba0e4670 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x556cb9ee66d0 con 0x556cba09a990 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f06205c2000 10 client.0 _ll_register_callbacks cb 0x7f06100f13e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0f8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45998/0 (socket says 172.21.15.5:45998) 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615400640 1 -- 172.21.15.5:0/2443131479 learned_addr learned my addr 172.21.15.5:0/2443131479 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0616800640 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba0e4670 0x556cba0f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615e00640 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba09a990 0x556cba0f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615400640 1 -- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba09a990 msgr2=0x556cba0f8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615400640 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba09a990 0x556cba0f8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615400640 1 -- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba0e4670 msgr2=0x556cba0f8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615400640 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba0e4670 0x556cba0f8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615400640 1 -- 172.21.15.5:0/2443131479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cb9ee0b30 con 0x556cba0e3d50 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.754+0000 7f0615e00640 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba09a990 0x556cba0f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f0615400640 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0f8890 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f06181680c0 tx=0x7f0604005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ab7e2bbb235393 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f05f7400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f05f7400640 1 -- 172.21.15.5:0/2443131479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060401b030 con 0x556cba0e3d50 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f05f7400640 1 -- 172.21.15.5:0/2443131479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f0604010040 con 0x556cba0e3d50 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 -- 172.21.15.5:0/2443131479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f060800eb10 con 0x556cba0e3d50 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f05f7400640 1 -- 172.21.15.5:0/2443131479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f0604027050 con 0x556cba0e3d50 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 10 client.6963 fetch_fsmap learned FSMap version 56 2024-08-18T22:24:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 -- 172.21.15.5:0/2443131479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x556cb9e98810 con 0x556cba0e3d50 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f05f7400640 1 -- 172.21.15.5:0/2443131479 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060800eb10 con 0x556cba0e3d50 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f05f7400640 1 -- 172.21.15.5:0/2443131479 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f060402a020 con 0x556cba0e3d50 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 10 client.6963 fetch_fsmap finished waiting for FSMap version 56 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 10 client.6963 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 20 client.6963 populate_metadata read hostname 'smithi005' 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:6834/116443176,v1:172.21.15.117:6836/116443176] conn(0x556cba15d210 0x556cba15f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 4 client.6963 mds_command: new command op to 6798 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 -- 172.21.15.5:0/2443131479 --> [v2:172.21.15.117:6834/116443176,v1:172.21.15.117:6836/116443176] -- command(tid 0: {"prefix": "status"}) -- 0x556cb9ef4af0 con 0x556cba15d210 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f0615e00640 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:6834/116443176,v1:172.21.15.117:6836/116443176] conn(0x556cba15d210 0x556cba15f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f0615e00640 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:6834/116443176,v1:172.21.15.117:6836/116443176] conn(0x556cba15d210 0x556cba15f600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca8c6ed0e9505bab server_cookie=ddb2f7f7aaa30996 in_seq=0 out_seq=0 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f05f7400640 10 client.6963 ms_handle_connect on v2:172.21.15.117:6834/116443176 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f05f7400640 1 -- 172.21.15.5:0/2443131479 <== mds.0 v2:172.21.15.117:6834/116443176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x556cb9ef4af0 con 0x556cba15d210 2024-08-18T22:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f05f7400640 10 client.6963 handle_command_reply: tid=0 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 client.6963 shutdown 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 -- 172.21.15.5:0/2443131479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 msgr2=0x556cba0f8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0f8890 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f06181680c0 tx=0x7f0604005560 comp rx=0 tx=0).stop 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 -- 172.21.15.5:0/2443131479 shutdown_connections 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:6834/116443176,v1:172.21.15.117:6836/116443176] conn(0x556cba15d210 0x556cba15f600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556cba0e4670 0x556cba0f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cba0e3d50 0x556cba0f8890 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f05f7400640 0 client.6963 ms_handle_reset on v2:172.21.15.117:6834/116443176 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 --2- 172.21.15.5:0/2443131479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x556cba09a990 0x556cba0f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 -- 172.21.15.5:0/2443131479 >> 172.21.15.5:0/2443131479 conn(0x556cba096910 msgr2=0x556cba0d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 -- 172.21.15.5:0/2443131479 shutdown_connections 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 1 -- 172.21.15.5:0/2443131479 wait complete. 2024-08-18T22:24:04.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f06205c2000 20 client.6963 trim_cache size 0 max 16384 2024-08-18T22:24:04.765 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:24:04.765 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:24:04.765 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:24:04.765 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6798, 2024-08-18T22:24:04.765 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:24:04.765 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:24:04.765 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:24:04.765 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.509759130999999, 2024-08-18T22:24:04.765 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 56, 2024-08-18T22:24:04.765 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 82, 2024-08-18T22:24:04.765 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 82, 2024-08-18T22:24:04.766 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15.327669636 2024-08-18T22:24:04.766 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:24:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f061d000640 1 -- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05f80678f0 msgr2=0x7f05f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f061d000640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05f80678f0 0x7f05f8069db0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0608000f70 tx=0x7f0608009040 comp rx=0 tx=0).stop 2024-08-18T22:24:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f061d000640 1 -- 172.21.15.5:0/3521833440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061815fb80 msgr2=0x7f061814cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.758+0000 7f061d000640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061815fb80 0x7f061814cb10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f06100b0040 tx=0x7f06100195b0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.762+0000 7f061d000640 1 -- 172.21.15.5:0/3521833440 shutdown_connections 2024-08-18T22:24:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.762+0000 7f061d000640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05f80678f0 0x7f05f8069db0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.762+0000 7f061d000640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061815fb80 0x7f061814cb10 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.762+0000 7f061d000640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06180d15e0 0x7f0618149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.762+0000 7f061d000640 1 --2- 172.21.15.5:0/3521833440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06180d1090 0x7f061806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.762+0000 7f061d000640 1 -- 172.21.15.5:0/3521833440 >> 172.21.15.5:0/3521833440 conn(0x7f06180d2180 msgr2=0x7f0618153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.762+0000 7f061d000640 1 -- 172.21.15.5:0/3521833440 shutdown_connections 2024-08-18T22:24:04.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.762+0000 7f061d000640 1 -- 172.21.15.5:0/3521833440 wait complete. 2024-08-18T22:24:04.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:24:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.918+0000 7f6f82600640 1 Processor -- start 2024-08-18T22:24:04.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.918+0000 7f6f82600640 1 -- start start 2024-08-18T22:24:04.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f82600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f7c161960 0x7f6f7c06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f82600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f7c070730 0x7f6f7c070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f82600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7c15eb60 con 0x7f6f7c15dda0 2024-08-18T22:24:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f82600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6f7c15fcc0 con 0x7f6f7c070730 2024-08-18T22:24:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f82600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7c0710b0 con 0x7f6f7c161960 2024-08-18T22:24:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f7aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f7c070730 0x7f6f7c070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f7aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f7c070730 0x7f6f7c070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46014/0 (socket says 172.21.15.5:46014) 2024-08-18T22:24:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f7aa00640 1 -- 172.21.15.5:0/4172626639 learned_addr learned my addr 172.21.15.5:0/4172626639 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f7be00640 1 --1- 172.21.15.5:0/4172626639 >> v1:172.21.15.5:6789/0 conn(0x7f6f7c15dda0 0x7f6f7c15e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56768/0 (socket says 172.21.15.5:56768) 2024-08-18T22:24:04.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f7b400640 1 --2- 172.21.15.5:0/4172626639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f7c161960 0x7f6f7c06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f7aa00640 1 -- 172.21.15.5:0/4172626639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f7c161960 msgr2=0x7f6f7c06fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f7aa00640 1 --2- 172.21.15.5:0/4172626639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f7c161960 0x7f6f7c06fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f7aa00640 1 -- 172.21.15.5:0/4172626639 >> v1:172.21.15.5:6789/0 conn(0x7f6f7c15dda0 legacy=0x7f6f7c15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.922+0000 7f6f7aa00640 1 -- 172.21.15.5:0/4172626639 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c15ee40 con 0x7f6f7c070730 2024-08-18T22:24:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f7aa00640 1 --2- 172.21.15.5:0/4172626639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f7c070730 0x7f6f7c070b70 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009870 tx=0x7f6f6801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6026872f82865d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f7a000640 1 -- 172.21.15.5:0/4172626639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f680b2070 con 0x7f6f7c070730 2024-08-18T22:24:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f7a000640 1 -- 172.21.15.5:0/4172626639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f680a9070 con 0x7f6f7c070730 2024-08-18T22:24:04.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f7a000640 1 -- 172.21.15.5:0/4172626639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f680ad880 con 0x7f6f7c070730 2024-08-18T22:24:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f82600640 1 -- 172.21.15.5:0/4172626639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f7c070730 msgr2=0x7f6f7c070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f82600640 1 --2- 172.21.15.5:0/4172626639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f7c070730 0x7f6f7c070b70 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009870 tx=0x7f6f6801c560 comp rx=0 tx=0).stop 2024-08-18T22:24:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f82600640 1 -- 172.21.15.5:0/4172626639 shutdown_connections 2024-08-18T22:24:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f82600640 1 --2- 172.21.15.5:0/4172626639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f7c070730 0x7f6f7c070b70 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f82600640 1 --2- 172.21.15.5:0/4172626639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f7c161960 0x7f6f7c06fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f82600640 1 -- 172.21.15.5:0/4172626639 >> 172.21.15.5:0/4172626639 conn(0x7f6f7c0d2130 msgr2=0x7f6f7c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f82600640 1 -- 172.21.15.5:0/4172626639 shutdown_connections 2024-08-18T22:24:04.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f82600640 1 -- 172.21.15.5:0/4172626639 wait complete. 2024-08-18T22:24:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f82600640 1 Processor -- start 2024-08-18T22:24:04.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.926+0000 7f6f82600640 1 -- start start 2024-08-18T22:24:04.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f82600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f7c070730 0x7f6f7c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f82600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f7c15dda0 0x7f6f7c0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f82600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f7c161960 0x7f6f7c0b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f82600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c09ba30 con 0x7f6f7c161960 2024-08-18T22:24:04.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f82600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c070260 con 0x7f6f7c15dda0 2024-08-18T22:24:04.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f82600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7c0b6950 con 0x7f6f7c070730 2024-08-18T22:24:04.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f7c161960 0x7f6f7c0b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f7c161960 0x7f6f7c0b7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46018/0 (socket says 172.21.15.5:46018) 2024-08-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7be00640 1 -- 172.21.15.5:0/3638605315 learned_addr learned my addr 172.21.15.5:0/3638605315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7b400640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f7c070730 0x7f6f7c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7aa00640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f7c15dda0 0x7f6f7c0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7be00640 1 -- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f7c070730 msgr2=0x7f6f7c15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7be00640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f7c070730 0x7f6f7c15a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7be00640 1 -- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f7c15dda0 msgr2=0x7f6f7c0b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7be00640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f7c15dda0 0x7f6f7c0b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7be00640 1 -- 172.21.15.5:0/3638605315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c0b58b0 con 0x7f6f7c161960 2024-08-18T22:24:04.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7aa00640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f7c15dda0 0x7f6f7c0b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f7be00640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f7c161960 0x7f6f7c0b7240 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c700 tx=0x7f6f7400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f73400640 1 -- 172.21.15.5:0/3638605315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74017070 con 0x7f6f7c161960 2024-08-18T22:24:04.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f73400640 1 -- 172.21.15.5:0/3638605315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7400ce10 con 0x7f6f7c161960 2024-08-18T22:24:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f82600640 1 -- 172.21.15.5:0/3638605315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7c0b5b90 con 0x7f6f7c161960 2024-08-18T22:24:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f73400640 1 -- 172.21.15.5:0/3638605315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7400a840 con 0x7f6f7c161960 2024-08-18T22:24:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f82600640 1 -- 172.21.15.5:0/3638605315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f7c0b6150 con 0x7f6f7c161960 2024-08-18T22:24:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f82600640 1 -- 172.21.15.5:0/3638605315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f7c0b6640 con 0x7f6f7c161960 2024-08-18T22:24:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.930+0000 7f6f73400640 1 -- 172.21.15.5:0/3638605315 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f7401a070 con 0x7f6f7c161960 2024-08-18T22:24:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.934+0000 7f6f73400640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f5c0678c0 0x7f6f5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.934+0000 7f6f73400640 1 -- 172.21.15.5:0/3638605315 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f6f74085340 con 0x7f6f7c161960 2024-08-18T22:24:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.934+0000 7f6f7b400640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f5c0678c0 0x7f6f5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.934+0000 7f6f7b400640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f5c0678c0 0x7f6f5c069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009af0 tx=0x7f6f6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:04.938+0000 7f6f73400640 1 -- 172.21.15.5:0/3638605315 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6f740556a0 con 0x7f6f7c161960 2024-08-18T22:24:05.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.134+0000 7f6f82600640 1 -- 172.21.15.5:0/3638605315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6f7c070b70 con 0x7f6f7c161960 2024-08-18T22:24:05.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.134+0000 7f6f73400640 1 -- 172.21.15.5:0/3638605315 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7f6f740599a0 con 0x7f6f7c161960 2024-08-18T22:24:05.135 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:24:05.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 -- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f5c0678c0 msgr2=0x7f6f5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:05.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f5c0678c0 0x7f6f5c069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009af0 tx=0x7f6f6c008040 comp rx=0 tx=0).stop 2024-08-18T22:24:05.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 -- 172.21.15.5:0/3638605315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f7c161960 msgr2=0x7f6f7c0b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:05.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f7c161960 0x7f6f7c0b7240 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c700 tx=0x7f6f7400cbc0 comp rx=0 tx=0).stop 2024-08-18T22:24:05.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 -- 172.21.15.5:0/3638605315 shutdown_connections 2024-08-18T22:24:05.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6f5c0678c0 0x7f6f5c069d80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:05.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f7c161960 0x7f6f7c0b7240 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f7c15dda0 0x7f6f7c0b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 --2- 172.21.15.5:0/3638605315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f7c070730 0x7f6f7c15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 -- 172.21.15.5:0/3638605315 >> 172.21.15.5:0/3638605315 conn(0x7f6f7c0d2130 msgr2=0x7f6f7c15fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 -- 172.21.15.5:0/3638605315 shutdown_connections 2024-08-18T22:24:05.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05.138+0000 7f6f82600640 1 -- 172.21.15.5:0/3638605315 wait complete. 2024-08-18T22:24:05.157 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:24:05.157 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:24:05.157 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:24:05.157 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:24:05.157 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:05.157 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:24:05.157 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:24:05.157 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:24:05.158 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:24:05.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:05.158 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:24:05.168 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:24:05.168 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:24:05.168 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:24:05.168 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:05.168 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:24:05.168 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:05.168 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:24:05.168 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:05.168 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:24:05.168 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:24:05.168 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42156sec preferred_lft 42156sec 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:24:05.169 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:05.170 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:24:05.171 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:24:05.172 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:24:05.172 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:05.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:05.172 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:24:05.230 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:24:05.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:05.232 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:24:05.289 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:24:05.289 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:24:05.290 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:24:05.290 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:24:05.290 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:24:05.290 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:24:05.290 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:24:05.290 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:24:05.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:24:05.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:24:05.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:24:05.290 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:24:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:24:05.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:24:05.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:05.432 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:24:05.441 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:24:05.441 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:24:05.442 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:24:05.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:05.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:24:05.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:24:05.504 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:05.562 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:24:05.563 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:24:05.563 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:05.611 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:24:05.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:05.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:05.701 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:05.701 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:24:05.701 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:24:05.716 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:05.717 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:24:05.717 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:24:05.717 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:24:05.717 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:24:05.727 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:05.727 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:24:05.727 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:24:05.727 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:24:05.727 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:24:05.727 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:24:05.728 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:24:05.728 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:24:05.732 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:24:05.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:05.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:05.753 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:24:05.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:24:05.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:24:05.869 INFO:teuthology.orchestra.run.smithi005.stdout:client6113 2024-08-18T22:24:05.869 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:05.870 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:05.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:05.878 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-08-18T22:24:05.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:05.936 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-08-18T22:24:05.990 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:24:05.990 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:24:05.990 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-08-18T22:24:05.991 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:24:05.991 DEBUG:teuthology.orchestra.run.smithi005:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-08-18T22:24:05.991 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:24:06.097 INFO:teuthology.orchestra.run.smithi005.stdout:1099511627776 2024-08-18T22:24:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:24:06.106 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:06.106 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:06.157 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:06.157 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:06.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:24:06.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.398+0000 7fe432800640 1 Processor -- start 2024-08-18T22:24:06.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.398+0000 7fe432800640 1 -- start start 2024-08-18T22:24:06.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.398+0000 7fe432800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe42c09aca0 0x7fe42c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.398+0000 7fe432800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe42c09b080 0x7fe42c0b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.398+0000 7fe432800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42c06e8a0 con 0x7fe42c0b1300 2024-08-18T22:24:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.398+0000 7fe432800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe42c09bb80 con 0x7fe42c09aca0 2024-08-18T22:24:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.398+0000 7fe432800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe42c0d2e40 con 0x7fe42c09b080 2024-08-18T22:24:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.398+0000 7fe42b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe42c09aca0 0x7fe42c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.398+0000 7fe42b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe42c09aca0 0x7fe42c0afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46020/0 (socket says 172.21.15.5:46020) 2024-08-18T22:24:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.398+0000 7fe42b400640 1 -- 172.21.15.5:0/731441152 learned_addr learned my addr 172.21.15.5:0/731441152 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe42be00640 1 --2- 172.21.15.5:0/731441152 >> v2:172.21.15.117:3300/0 conn(0x7fe42c09b080 0x7fe42c0b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe42b400640 1 -- 172.21.15.5:0/731441152 >> v2:172.21.15.117:3300/0 conn(0x7fe42c09b080 msgr2=0x7fe42c0b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe42b400640 1 --2- 172.21.15.5:0/731441152 >> v2:172.21.15.117:3300/0 conn(0x7fe42c09b080 0x7fe42c0b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe42b400640 1 -- 172.21.15.5:0/731441152 >> v1:172.21.15.117:6789/0 conn(0x7fe42c0b1300 legacy=0x7fe42c0affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:06.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe42b400640 1 -- 172.21.15.5:0/731441152 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c06cbd0 con 0x7fe42c09aca0 2024-08-18T22:24:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe42b400640 1 --2- 172.21.15.5:0/731441152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c09aca0 0x7fe42c0afa90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe42c073460 tx=0x7fe41c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5dca3efd9aff7f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:06.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe42a000640 1 -- 172.21.15.5:0/731441152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0a5720 con 0x7fe42c09aca0 2024-08-18T22:24:06.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe42a000640 1 -- 172.21.15.5:0/731441152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41c0a58c0 con 0x7fe42c09aca0 2024-08-18T22:24:06.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe42a000640 1 -- 172.21.15.5:0/731441152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0a5c90 con 0x7fe42c09aca0 2024-08-18T22:24:06.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe432800640 1 -- 172.21.15.5:0/731441152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c09aca0 msgr2=0x7fe42c0afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:06.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe432800640 1 --2- 172.21.15.5:0/731441152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c09aca0 0x7fe42c0afa90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe42c073460 tx=0x7fe41c01c9b0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe432800640 1 -- 172.21.15.5:0/731441152 shutdown_connections 2024-08-18T22:24:06.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe432800640 1 --2- 172.21.15.5:0/731441152 >> v2:172.21.15.117:3300/0 conn(0x7fe42c09b080 0x7fe42c0b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe432800640 1 --2- 172.21.15.5:0/731441152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c09aca0 0x7fe42c0afa90 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.402+0000 7fe432800640 1 -- 172.21.15.5:0/731441152 >> 172.21.15.5:0/731441152 conn(0x7fe42c0d2180 msgr2=0x7fe42c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:06.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe432800640 1 -- 172.21.15.5:0/731441152 shutdown_connections 2024-08-18T22:24:06.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe432800640 1 -- 172.21.15.5:0/731441152 wait complete. 2024-08-18T22:24:06.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe432800640 1 Processor -- start 2024-08-18T22:24:06.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe432800640 1 -- start start 2024-08-18T22:24:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe432800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c09aca0 0x7fe42c150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe432800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c09b080 0x7fe42c14ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe432800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0b1300 0x7fe42c0cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe432800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c16b6b0 con 0x7fe42c0b1300 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe432800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c16b530 con 0x7fe42c09aca0 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe432800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c16b830 con 0x7fe42c09b080 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe42be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0b1300 0x7fe42c0cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe42be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0b1300 0x7fe42c0cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46028/0 (socket says 172.21.15.5:46028) 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe42be00640 1 -- 172.21.15.5:0/1750371142 learned_addr learned my addr 172.21.15.5:0/1750371142 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe42b400640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c09aca0 0x7fe42c150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe42aa00640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c09b080 0x7fe42c14ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe42be00640 1 -- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c09b080 msgr2=0x7fe42c14ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe42be00640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c09b080 0x7fe42c14ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe42be00640 1 -- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c09aca0 msgr2=0x7fe42c150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:06.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe42be00640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c09aca0 0x7fe42c150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe42be00640 1 -- 172.21.15.5:0/1750371142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c14f270 con 0x7fe42c0b1300 2024-08-18T22:24:06.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe42be00640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0b1300 0x7fe42c0cd3b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe42400d830 tx=0x7fe42400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:06.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe423400640 1 -- 172.21.15.5:0/1750371142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42400b6c0 con 0x7fe42c0b1300 2024-08-18T22:24:06.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe423400640 1 -- 172.21.15.5:0/1750371142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe424019070 con 0x7fe42c0b1300 2024-08-18T22:24:06.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.406+0000 7fe423400640 1 -- 172.21.15.5:0/1750371142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42400baa0 con 0x7fe42c0b1300 2024-08-18T22:24:06.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.410+0000 7fe432800640 1 -- 172.21.15.5:0/1750371142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c0ce1c0 con 0x7fe42c0b1300 2024-08-18T22:24:06.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.410+0000 7fe432800640 1 -- 172.21.15.5:0/1750371142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c150620 con 0x7fe42c0b1300 2024-08-18T22:24:06.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.410+0000 7fe432800640 1 -- 172.21.15.5:0/1750371142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c0cbe50 con 0x7fe42c0b1300 2024-08-18T22:24:06.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.410+0000 7fe423400640 1 -- 172.21.15.5:0/1750371142 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe42401e460 con 0x7fe42c0b1300 2024-08-18T22:24:06.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.410+0000 7fe423400640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe40c0678f0 0x7fe40c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.410+0000 7fe423400640 1 -- 172.21.15.5:0/1750371142 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7fe424086400 con 0x7fe42c0b1300 2024-08-18T22:24:06.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.410+0000 7fe42b400640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe40c0678f0 0x7fe40c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.410+0000 7fe42b400640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe40c0678f0 0x7fe40c069db0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0ae000 tx=0x7fe41c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:06.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.414+0000 7fe423400640 1 -- 172.21.15.5:0/1750371142 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe4240566c0 con 0x7fe42c0b1300 2024-08-18T22:24:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 -- 172.21.15.5:0/1750371142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe42c161940 con 0x7fe42c0b1300 2024-08-18T22:24:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe423400640 1 -- 172.21.15.5:0/1750371142 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v82) ==== 80+0+0 (secure 0 0 0) 0x7fe42405a9c0 con 0x7fe42c0b1300 2024-08-18T22:24:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:24:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 -- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe40c0678f0 msgr2=0x7fe40c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe40c0678f0 0x7fe40c069db0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0ae000 tx=0x7fe41c0a7070 comp rx=0 tx=0).stop 2024-08-18T22:24:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 -- 172.21.15.5:0/1750371142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0b1300 msgr2=0x7fe42c0cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0b1300 0x7fe42c0cd3b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe42400d830 tx=0x7fe42400dcf0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 -- 172.21.15.5:0/1750371142 shutdown_connections 2024-08-18T22:24:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe40c0678f0 0x7fe40c069db0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe42c0b1300 0x7fe42c0cd3b0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42c09b080 0x7fe42c14ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 --2- 172.21.15.5:0/1750371142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c09aca0 0x7fe42c150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 -- 172.21.15.5:0/1750371142 >> 172.21.15.5:0/1750371142 conn(0x7fe42c0d2180 msgr2=0x7fe42c0710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.594+0000 7fe432800640 1 -- 172.21.15.5:0/1750371142 shutdown_connections 2024-08-18T22:24:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.598+0000 7fe432800640 1 -- 172.21.15.5:0/1750371142 wait complete. 2024-08-18T22:24:06.616 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:24:06.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:06.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:06.697 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:24:06.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:06.698 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:24:06.727 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.918+0000 7fc967e00640 1 Processor -- start 2024-08-18T22:24:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.918+0000 7fc967e00640 1 -- start start 2024-08-18T22:24:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc967e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc96809aa40 0x7fc96815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc967e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9680ccd90 con 0x7fc9680cde30 2024-08-18T22:24:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc967e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9680cd070 con 0x7fc9680b4510 2024-08-18T22:24:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc967e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc9680ce770 con 0x7fc96809aa40 2024-08-18T22:24:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc9680cde30 0x7fc96809ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56784/0 (socket says 172.21.15.5:56784) 2024-08-18T22:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966000640 1 -- 172.21.15.5:0/1817895533 learned_addr learned my addr 172.21.15.5:0/1817895533 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966a00640 1 --2- 172.21.15.5:0/1817895533 >> v2:172.21.15.117:3300/0 conn(0x7fc96809aa40 0x7fc96815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423761750 0 0) 0x7fc9680ccd90 con 0x7fc9680cde30 2024-08-18T22:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc94c003530 con 0x7fc9680cde30 2024-08-18T22:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4225685470 0 0) 0x7fc9680cd070 con 0x7fc9680b4510 2024-08-18T22:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9680ccd90 con 0x7fc9680b4510 2024-08-18T22:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1867538701 0 0) 0x7fc94c003530 con 0x7fc9680cde30 2024-08-18T22:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 >> v2:172.21.15.117:3300/0 conn(0x7fc96809aa40 msgr2=0x7fc96815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 --2- 172.21.15.5:0/1817895533 >> v2:172.21.15.117:3300/0 conn(0x7fc96809aa40 0x7fc96815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 >> v1:172.21.15.117:6789/0 conn(0x7fc9680b4510 legacy=0x7fc9680cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9680cd350 con 0x7fc9680cde30 2024-08-18T22:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fc954001680 con 0x7fc9680cde30 2024-08-18T22:24:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 >> v1:172.21.15.5:6789/0 conn(0x7fc9680cde30 legacy=0x7fc96809ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc94c003ba0 0x7fc94c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc94c004810 0x7fc94c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc94c0051d0 0x7fc94c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc9680ce770 con 0x7fc94c004810 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c00c0a0 con 0x7fc94c0051d0 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc94c00c2a0 con 0x7fc94c003ba0 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966a00640 1 --2- 172.21.15.5:0/1817895533 >> v2:172.21.15.117:3300/0 conn(0x7fc96809aa40 0x7fc96815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966000640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc94c004810 0x7fc94c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc967400640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc94c0051d0 0x7fc94c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966a00640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc94c003ba0 0x7fc94c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966000640 1 -- 172.21.15.5:0/1817895533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc94c003ba0 msgr2=0x7fc94c003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966000640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc94c003ba0 0x7fc94c003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966000640 1 -- 172.21.15.5:0/1817895533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc94c0051d0 msgr2=0x7fc94c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966000640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc94c0051d0 0x7fc94c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966000640 1 -- 172.21.15.5:0/1817895533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94c003530 con 0x7fc94c004810 2024-08-18T22:24:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc967400640 1 -- 172.21.15.5:0/1817895533 reap_dead start 2024-08-18T22:24:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.922+0000 7fc966a00640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc94c003ba0 0x7fc94c003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc966000640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc94c004810 0x7fc94c004c90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc954007fc0 tx=0x7fc95401cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fccd3c9a1b072e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954007c10 con 0x7fc94c004810 2024-08-18T22:24:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9540a9070 con 0x7fc94c004810 2024-08-18T22:24:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc965600640 1 -- 172.21.15.5:0/1817895533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954005d80 con 0x7fc94c004810 2024-08-18T22:24:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc967e00640 1 -- 172.21.15.5:0/1817895533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc94c004810 msgr2=0x7fc94c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc967e00640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc94c004810 0x7fc94c004c90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc954007fc0 tx=0x7fc95401cb60 comp rx=0 tx=0).stop 2024-08-18T22:24:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc967e00640 1 -- 172.21.15.5:0/1817895533 shutdown_connections 2024-08-18T22:24:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc967e00640 1 --2- 172.21.15.5:0/1817895533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc94c004810 0x7fc94c004c90 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc967e00640 1 -- 172.21.15.5:0/1817895533 >> 172.21.15.5:0/1817895533 conn(0x7fc9680b3a20 msgr2=0x7fc9680b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc967e00640 1 -- 172.21.15.5:0/1817895533 shutdown_connections 2024-08-18T22:24:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc967e00640 1 -- 172.21.15.5:0/1817895533 wait complete. 2024-08-18T22:24:06.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc967e00640 1 Processor -- start 2024-08-18T22:24:06.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.926+0000 7fc967e00640 1 -- start start 2024-08-18T22:24:06.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc94c004810 0x7fc9681f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815b450 0x7fc9680b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b04e0 0x7fc9680b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc96815c230 con 0x7fc9680b04e0 2024-08-18T22:24:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc9680cd910 con 0x7fc94c004810 2024-08-18T22:24:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc96815c3b0 con 0x7fc96815b450 2024-08-18T22:24:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b04e0 0x7fc9680b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b04e0 0x7fc9680b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46046/0 (socket says 172.21.15.5:46046) 2024-08-18T22:24:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967400640 1 -- 172.21.15.5:0/3053788745 learned_addr learned my addr 172.21.15.5:0/3053788745 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc966a00640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc94c004810 0x7fc9681f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc966000640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815b450 0x7fc9680b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967400640 1 -- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815b450 msgr2=0x7fc9680b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:06.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967400640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815b450 0x7fc9680b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967400640 1 -- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc94c004810 msgr2=0x7fc9681f3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:06.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967400640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc94c004810 0x7fc9681f3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:06.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967400640 1 -- 172.21.15.5:0/3053788745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9680b6b30 con 0x7fc9680b04e0 2024-08-18T22:24:06.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967400640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b04e0 0x7fc9680b0940 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc960005630 tx=0x7fc96000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc95ea00640 1 -- 172.21.15.5:0/3053788745 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960010040 con 0x7fc9680b04e0 2024-08-18T22:24:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc95ea00640 1 -- 172.21.15.5:0/3053788745 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc96001a070 con 0x7fc9680b04e0 2024-08-18T22:24:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc95ea00640 1 -- 172.21.15.5:0/3053788745 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960015890 con 0x7fc9680b04e0 2024-08-18T22:24:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967e00640 1 -- 172.21.15.5:0/3053788745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9680b6e10 con 0x7fc9680b04e0 2024-08-18T22:24:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967e00640 1 -- 172.21.15.5:0/3053788745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9680b73d0 con 0x7fc9680b04e0 2024-08-18T22:24:06.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc967e00640 1 -- 172.21.15.5:0/3053788745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc96815cfe0 con 0x7fc9680b04e0 2024-08-18T22:24:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.930+0000 7fc95ea00640 1 -- 172.21.15.5:0/3053788745 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc960015a30 con 0x7fc9680b04e0 2024-08-18T22:24:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.934+0000 7fc95ea00640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9480678f0 0x7fc948069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.934+0000 7fc95ea00640 1 -- 172.21.15.5:0/3053788745 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7fc960088640 con 0x7fc9680b04e0 2024-08-18T22:24:06.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.934+0000 7fc966a00640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9480678f0 0x7fc948069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:06.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.934+0000 7fc966a00640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9480678f0 0x7fc948069db0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc968051690 tx=0x7fc95800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:06.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:06.938+0000 7fc95ea00640 1 -- 172.21.15.5:0/3053788745 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc960058900 con 0x7fc9680b04e0 2024-08-18T22:24:07.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.138+0000 7fc967e00640 1 -- 172.21.15.5:0/3053788745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc968073d40 con 0x7fc9680b04e0 2024-08-18T22:24:07.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.138+0000 7fc95ea00640 1 -- 172.21.15.5:0/3053788745 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5222 (secure 0 0 0) 0x7fc96005cc00 con 0x7fc9680b04e0 2024-08-18T22:24:07.140 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:07.141 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"btime":"2024-08-18T22:23:57:263294+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6409,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4073781288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4073781288},{"type":"v1","addr":"172.21.15.5:6835","nonce":4073781288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6415,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2559910862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2559910862},{"type":"v1","addr":"172.21.15.117:6837","nonce":2559910862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6792,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3108112673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3108112673},{"type":"v1","addr":"172.21.15.5:6834","nonce":3108112673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:53.630789+0000","modified":"2024-08-18T22:23:56.664654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6798},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6798":{"gid":6798,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6836/116443176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":116443176},{"type":"v1","addr":"172.21.15.117:6836","nonce":116443176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6798,"qdb_cluster":[6798]},"id":5}]} 2024-08-18T22:24:07.141 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 56 2024-08-18T22:24:07.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 -- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9480678f0 msgr2=0x7fc948069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9480678f0 0x7fc948069db0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc968051690 tx=0x7fc95800b040 comp rx=0 tx=0).stop 2024-08-18T22:24:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 -- 172.21.15.5:0/3053788745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b04e0 msgr2=0x7fc9680b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b04e0 0x7fc9680b0940 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc960005630 tx=0x7fc96000f850 comp rx=0 tx=0).stop 2024-08-18T22:24:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 -- 172.21.15.5:0/3053788745 shutdown_connections 2024-08-18T22:24:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9480678f0 0x7fc948069db0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9680b04e0 0x7fc9680b0940 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc96815b450 0x7fc9680b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 --2- 172.21.15.5:0/3053788745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc94c004810 0x7fc9681f3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 -- 172.21.15.5:0/3053788745 >> 172.21.15.5:0/3053788745 conn(0x7fc9680b3a20 msgr2=0x7fc96806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 -- 172.21.15.5:0/3053788745 shutdown_connections 2024-08-18T22:24:07.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.142+0000 7fc967e00640 1 -- 172.21.15.5:0/3053788745 wait complete. 2024-08-18T22:24:07.163 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-08-18T22:24:07.336 INFO:teuthology.orchestra.run.smithi117.stdout:{"message":"","return_code":0} 2024-08-18T22:24:07.337 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-08-18T22:24:07.337 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:24:07.337 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:07.338 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:24:07.338 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:07.338 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:24:07.338 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:07.339 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:24:07.339 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:07.351 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:24:07.351 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:07.352 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:24:07.352 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:07.353 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:24:07.353 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:07.355 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:24:07.355 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:07.355 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-08-18T22:24:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab45433080 1 Processor -- start 2024-08-18T22:24:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab45433080 1 -- start start 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab45433080 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5653cc831b90 0x5653cc8bcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab45433080 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5653cc833dc0 0x5653cc818980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab45433080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 0x5653cc952660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab45433080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5653cc737aa0 con 0x5653cc8bd950 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab45433080 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5653cc7911f0 con 0x5653cc831b90 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab45433080 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5653cc81a620 con 0x5653cc833dc0 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab43000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 0x5653cc952660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab43000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 0x5653cc952660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46058/0 (socket says 172.21.15.5:46058) 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab43000640 1 -- 172.21.15.5:0/1120494351 learned_addr learned my addr 172.21.15.5:0/1120494351 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab42600640 1 --2- 172.21.15.5:0/1120494351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5653cc831b90 0x5653cc8bcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab41c00640 1 --2- 172.21.15.5:0/1120494351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5653cc833dc0 0x5653cc818980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab43000640 1 -- 172.21.15.5:0/1120494351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5653cc833dc0 msgr2=0x5653cc818980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab43000640 1 --2- 172.21.15.5:0/1120494351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5653cc833dc0 0x5653cc818980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab43000640 1 -- 172.21.15.5:0/1120494351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5653cc831b90 msgr2=0x5653cc8bcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab43000640 1 --2- 172.21.15.5:0/1120494351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5653cc831b90 0x5653cc8bcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab43000640 1 -- 172.21.15.5:0/1120494351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653cc8162e0 con 0x5653cc8bd950 2024-08-18T22:24:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab43000640 1 --2- 172.21.15.5:0/1120494351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 0x5653cc952660 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0016c0 tx=0x7fab3c001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ce0cfd2a358e19 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab3be00640 1 -- 172.21.15.5:0/1120494351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c016070 con 0x5653cc8bd950 2024-08-18T22:24:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab3be00640 1 -- 172.21.15.5:0/1120494351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c00f710 con 0x5653cc8bd950 2024-08-18T22:24:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.438+0000 7fab3be00640 1 -- 172.21.15.5:0/1120494351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00fb00 con 0x5653cc8bd950 2024-08-18T22:24:07.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 -- 172.21.15.5:0/1120494351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 msgr2=0x5653cc952660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 --2- 172.21.15.5:0/1120494351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 0x5653cc952660 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0016c0 tx=0x7fab3c001b80 comp rx=0 tx=0).stop 2024-08-18T22:24:07.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 -- 172.21.15.5:0/1120494351 shutdown_connections 2024-08-18T22:24:07.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 --2- 172.21.15.5:0/1120494351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 0x5653cc952660 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 --2- 172.21.15.5:0/1120494351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5653cc833dc0 0x5653cc818980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 --2- 172.21.15.5:0/1120494351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5653cc831b90 0x5653cc8bcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 -- 172.21.15.5:0/1120494351 >> 172.21.15.5:0/1120494351 conn(0x5653cc7e6980 msgr2=0x5653cc8c0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:07.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 -- 172.21.15.5:0/1120494351 shutdown_connections 2024-08-18T22:24:07.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 -- 172.21.15.5:0/1120494351 wait complete. 2024-08-18T22:24:07.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 Processor -- start 2024-08-18T22:24:07.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 -- start start 2024-08-18T22:24:07.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5653cc831b90 0x5653cc8a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5653cc833dc0 0x5653cc8b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 0x5653cc8b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5653cc816820 con 0x5653cc8bd950 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5653cc816580 con 0x5653cc831b90 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5653cc816ac0 con 0x5653cc833dc0 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab43000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 0x5653cc8b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab43000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 0x5653cc8b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46060/0 (socket says 172.21.15.5:46060) 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab43000640 1 -- 172.21.15.5:0/750468937 learned_addr learned my addr 172.21.15.5:0/750468937 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab42600640 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5653cc831b90 0x5653cc8a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab41c00640 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5653cc833dc0 0x5653cc8b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab43000640 1 -- 172.21.15.5:0/750468937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5653cc833dc0 msgr2=0x5653cc8b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab43000640 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5653cc833dc0 0x5653cc8b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab43000640 1 -- 172.21.15.5:0/750468937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5653cc831b90 msgr2=0x5653cc8a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab43000640 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5653cc831b90 0x5653cc8a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab43000640 1 -- 172.21.15.5:0/750468937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653cc8b6de0 con 0x5653cc8bd950 2024-08-18T22:24:07.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab43000640 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 0x5653cc8b2b50 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fab3c007fd0 tx=0x7fab3c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab3aa00640 1 -- 172.21.15.5:0/750468937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c020030 con 0x5653cc8bd950 2024-08-18T22:24:07.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab3aa00640 1 -- 172.21.15.5:0/750468937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c0064f0 con 0x5653cc8bd950 2024-08-18T22:24:07.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab3aa00640 1 -- 172.21.15.5:0/750468937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c016040 con 0x5653cc8bd950 2024-08-18T22:24:07.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 -- 172.21.15.5:0/750468937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653cc8b7080 con 0x5653cc8bd950 2024-08-18T22:24:07.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.442+0000 7fab45433080 1 -- 172.21.15.5:0/750468937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653cc8b75c0 con 0x5653cc8bd950 2024-08-18T22:24:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.446+0000 7fab3aa00640 1 -- 172.21.15.5:0/750468937 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fab3c023030 con 0x5653cc8bd950 2024-08-18T22:24:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.446+0000 7fab3aa00640 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fab240662d0 0x7fab24068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.446+0000 7fab3aa00640 1 -- 172.21.15.5:0/750468937 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7fab3c085d30 con 0x5653cc8bd950 2024-08-18T22:24:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.446+0000 7fab42600640 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fab240662d0 0x7fab24068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.446+0000 7fab45433080 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x5653cc8b7a60 0x5653cc8b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.446+0000 7fab45433080 1 -- 172.21.15.5:0/750468937 --> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82) -- 0x5653cc8b8380 con 0x5653cc8b7a60 2024-08-18T22:24:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.446+0000 7fab41c00640 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x5653cc8b7a60 0x5653cc8b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.446+0000 7fab42600640 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fab240662d0 0x7fab24068790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fab340ad000 tx=0x7fab340a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.446+0000 7fab41c00640 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x5653cc8b7a60 0x5653cc8b7e40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab41c00640 1 -- 172.21.15.5:0/750468937 <== osd.0 v2:172.21.15.5:6816/1731152634 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v82'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fab30008040 con 0x5653cc8b7a60 2024-08-18T22:24:07.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab45433080 1 -- 172.21.15.5:0/750468937 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x5653cc8b7a60 msgr2=0x5653cc8b7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab45433080 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x5653cc8b7a60 0x5653cc8b7e40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab45433080 1 -- 172.21.15.5:0/750468937 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fab240662d0 msgr2=0x7fab24068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab45433080 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fab240662d0 0x7fab24068790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fab340ad000 tx=0x7fab340a6000 comp rx=0 tx=0).stop 2024-08-18T22:24:07.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab45433080 1 -- 172.21.15.5:0/750468937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 msgr2=0x5653cc8b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab45433080 1 --2- 172.21.15.5:0/750468937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cc8bd950 0x5653cc8b2b50 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fab3c007fd0 tx=0x7fab3c001260 comp rx=0 tx=0).stop 2024-08-18T22:24:07.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab43000640 1 -- 172.21.15.5:0/750468937 reap_dead start 2024-08-18T22:24:07.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab45433080 1 -- 172.21.15.5:0/750468937 shutdown_connections 2024-08-18T22:24:07.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab45433080 1 -- 172.21.15.5:0/750468937 >> 172.21.15.5:0/750468937 conn(0x5653cc7e6980 msgr2=0x5653cc8189f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:07.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab45433080 1 -- 172.21.15.5:0/750468937 shutdown_connections 2024-08-18T22:24:07.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.450+0000 7fab45433080 1 -- 172.21.15.5:0/750468937 wait complete. 2024-08-18T22:24:07.455 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-08-18T22:24:07.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-08-18T22:24:07.455 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-08-18T22:24:07.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-08-18T22:24:07.456 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-08-18T22:24:07.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-08-18T22:24:07.456 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-08-18T22:24:07.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-08-18T22:24:07.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.602+0000 7f5eae600640 1 Processor -- start 2024-08-18T22:24:07.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.602+0000 7f41ec000640 1 Processor -- start 2024-08-18T22:24:07.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.602+0000 7f5eae600640 1 -- start start 2024-08-18T22:24:07.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.602+0000 7f41ec000640 1 -- start start 2024-08-18T22:24:07.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.602+0000 7f1e87400640 1 Processor -- start 2024-08-18T22:24:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.602+0000 7f1e87400640 1 -- start start 2024-08-18T22:24:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.602+0000 7f41ec000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41e4147dd0 0x7f41e40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41ec000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 0x7f41e40d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41ec000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e406c850 con 0x7f41e406c3c0 2024-08-18T22:24:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41ec000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f41e415f7c0 con 0x7f41e4147dd0 2024-08-18T22:24:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41ec000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41e40b6410 con 0x7f41e415f000 2024-08-18T22:24:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41ea000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 0x7f41e40d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41e8c00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f41e406c3c0 0x7f41e415e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:54492/0 (socket says 172.21.15.5:54492) 2024-08-18T22:24:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41e8c00640 1 -- 172.21.15.5:0/648539811 learned_addr learned my addr 172.21.15.5:0/648539811 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41e9600640 1 --2- 172.21.15.5:0/648539811 >> v2:172.21.15.117:3300/0 conn(0x7f41e4147dd0 0x7f41e40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41ea000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 0x7f41e40d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:33232/0 (socket says 172.21.15.5:33232) 2024-08-18T22:24:07.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5eae600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ea815d120 0x7f5ea80b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5eae600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ea80b4650 0x7f5ea80d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5eae600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea815d5b0 con 0x7f5ea8156770 2024-08-18T22:24:07.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5eae600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea80b4ac0 con 0x7f5ea815d120 2024-08-18T22:24:07.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5eae600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea8156b50 con 0x7f5ea80b4650 2024-08-18T22:24:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e87400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e8015bfc0 0x7f1e8015c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e87400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e800b6520 0x7f1e8006fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e87400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e8006ea60 con 0x7f1e800ce320 2024-08-18T22:24:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e87400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1e8006f670 con 0x7f1e800b6520 2024-08-18T22:24:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e87400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1e8006ed40 con 0x7f1e8015bfc0 2024-08-18T22:24:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5ead200640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5ea8156770 0x7f5ea80b6020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:54502/0 (socket says 172.21.15.5:54502) 2024-08-18T22:24:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5ead200640 1 -- 172.21.15.5:0/544974998 learned_addr learned my addr 172.21.15.5:0/544974998 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:07.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41e3e00640 1 -- 172.21.15.5:0/648539811 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 342891169 0 0) 0x7f41d0001120 con 0x7f41e406c3c0 2024-08-18T22:24:07.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e84a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e8015bfc0 0x7f1e8015c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41e3e00640 1 -- 172.21.15.5:0/648539811 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41cc003530 con 0x7f41e406c3c0 2024-08-18T22:24:07.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e84a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e8015bfc0 0x7f1e8015c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:33248/0 (socket says 172.21.15.5:33248) 2024-08-18T22:24:07.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e84a00640 1 -- 172.21.15.5:0/1575902766 learned_addr learned my addr 172.21.15.5:0/1575902766 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:07.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5ea7e00640 1 --2- 172.21.15.5:0/544974998 >> v2:172.21.15.5:3300/0 conn(0x7f5ea815d120 0x7f5ea80b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5eadc00640 1 --2- 172.21.15.5:0/544974998 >> v2:172.21.15.117:3300/0 conn(0x7f5ea80b4650 0x7f5ea80d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e85400640 1 --2- 172.21.15.5:0/1575902766 >> v2:172.21.15.5:3300/0 conn(0x7f1e800b6520 0x7f1e8006fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5ea7400640 1 -- 172.21.15.5:0/544974998 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622625261 0 0) 0x7f5ea815d5b0 con 0x7f5ea8156770 2024-08-18T22:24:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5ea7400640 1 -- 172.21.15.5:0/544974998 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e90003530 con 0x7f5ea8156770 2024-08-18T22:24:07.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41ea000640 1 -- 172.21.15.5:0/648539811 >> v2:172.21.15.117:3300/0 conn(0x7f41e4147dd0 msgr2=0x7f41e40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41ea000640 1 --2- 172.21.15.5:0/648539811 >> v2:172.21.15.117:3300/0 conn(0x7f41e4147dd0 0x7f41e40b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41ea000640 1 -- 172.21.15.5:0/648539811 >> v1:172.21.15.117:6789/0 conn(0x7f41e406c3c0 legacy=0x7f41e415e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f41ea000640 1 -- 172.21.15.5:0/648539811 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e40b46b0 con 0x7f41e415f000 2024-08-18T22:24:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5eadc00640 1 -- 172.21.15.5:0/544974998 >> v2:172.21.15.5:3300/0 conn(0x7f5ea815d120 msgr2=0x7f5ea80b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5eadc00640 1 --2- 172.21.15.5:0/544974998 >> v2:172.21.15.5:3300/0 conn(0x7f5ea815d120 0x7f5ea80b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5eadc00640 1 -- 172.21.15.5:0/544974998 >> v1:172.21.15.117:6789/0 conn(0x7f5ea8156770 legacy=0x7f5ea80b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f5eadc00640 1 -- 172.21.15.5:0/544974998 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea80b67e0 con 0x7f5ea80b4650 2024-08-18T22:24:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e84a00640 1 -- 172.21.15.5:0/1575902766 >> v2:172.21.15.5:3300/0 conn(0x7f1e800b6520 msgr2=0x7f1e8006fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e84a00640 1 --2- 172.21.15.5:0/1575902766 >> v2:172.21.15.5:3300/0 conn(0x7f1e800b6520 0x7f1e8006fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e84a00640 1 -- 172.21.15.5:0/1575902766 >> v1:172.21.15.5:6789/0 conn(0x7f1e800ce320 legacy=0x7f1e800b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e84a00640 1 -- 172.21.15.5:0/1575902766 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8006f020 con 0x7f1e8015bfc0 2024-08-18T22:24:07.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f1e85400640 1 --2- 172.21.15.5:0/1575902766 >> v2:172.21.15.5:3300/0 conn(0x7f1e800b6520 0x7f1e8006fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f9c1f200640 1 Processor -- start 2024-08-18T22:24:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.606+0000 7f9c1f200640 1 -- start start 2024-08-18T22:24:07.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41ea000640 1 --2- 172.21.15.5:0/648539811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 0x7f41e40d0f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009d90 tx=0x7f41dc01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=560788d139321fe7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5eadc00640 1 --2- 172.21.15.5:0/544974998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ea80b4650 0x7f5ea80d01b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5ea815c5e0 tx=0x7f5ea001c200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c6f2526982517b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41e3e00640 1 -- 172.21.15.5:0/648539811 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0b2070 con 0x7f41e415f000 2024-08-18T22:24:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41e3e00640 1 -- 172.21.15.5:0/648539811 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc0a5970 con 0x7f41e415f000 2024-08-18T22:24:07.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41e3e00640 1 -- 172.21.15.5:0/648539811 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0a5d40 con 0x7f41e415f000 2024-08-18T22:24:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5ea7400640 1 -- 172.21.15.5:0/544974998 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00b0070 con 0x7f5ea80b4650 2024-08-18T22:24:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5ea7400640 1 -- 172.21.15.5:0/544974998 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea00a4e50 con 0x7f5ea80b4650 2024-08-18T22:24:07.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5ea7400640 1 -- 172.21.15.5:0/544974998 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c001a00 con 0x7f5ea80b4650 2024-08-18T22:24:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c1f200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c20159bb0 0x7f9c2015c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c1f200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c200ae100 0x7f9c2006e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c1f200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2015cb10 con 0x7f9c200cc220 2024-08-18T22:24:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c1f200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2006dfc0 con 0x7f9c200ae100 2024-08-18T22:24:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c1f200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2015d370 con 0x7f9c20159bb0 2024-08-18T22:24:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41ec000640 1 -- 172.21.15.5:0/648539811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 msgr2=0x7f41e40d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41ec000640 1 --2- 172.21.15.5:0/648539811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 0x7f41e40d0f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009d90 tx=0x7f41dc01c8b0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c1e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c200ae100 0x7f9c2006e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c17e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9c200cc220 0x7f9c200ad9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56818/0 (socket says 172.21.15.5:56818) 2024-08-18T22:24:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c17e00640 1 -- 172.21.15.5:0/2562243357 learned_addr learned my addr 172.21.15.5:0/2562243357 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c1de00640 1 --2- 172.21.15.5:0/2562243357 >> v2:172.21.15.117:3300/0 conn(0x7f9c20159bb0 0x7f9c2015c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5eae600640 1 -- 172.21.15.5:0/544974998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ea80b4650 msgr2=0x7f5ea80d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5eae600640 1 --2- 172.21.15.5:0/544974998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ea80b4650 0x7f5ea80d01b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5ea815c5e0 tx=0x7f5ea001c200 comp rx=0 tx=0).stop 2024-08-18T22:24:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41ec000640 1 -- 172.21.15.5:0/648539811 shutdown_connections 2024-08-18T22:24:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41ec000640 1 --2- 172.21.15.5:0/648539811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 0x7f41e40d0f70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41ec000640 1 --2- 172.21.15.5:0/648539811 >> v2:172.21.15.117:3300/0 conn(0x7f41e4147dd0 0x7f41e40b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41ec000640 1 -- 172.21.15.5:0/648539811 >> 172.21.15.5:0/648539811 conn(0x7f41e40b65f0 msgr2=0x7f41e40b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:07.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5eae600640 1 -- 172.21.15.5:0/544974998 shutdown_connections 2024-08-18T22:24:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5eae600640 1 --2- 172.21.15.5:0/544974998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ea80b4650 0x7f5ea80d01b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5eae600640 1 --2- 172.21.15.5:0/544974998 >> v2:172.21.15.5:3300/0 conn(0x7f5ea815d120 0x7f5ea80b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5eae600640 1 -- 172.21.15.5:0/544974998 >> 172.21.15.5:0/544974998 conn(0x7f5ea8067a70 msgr2=0x7f5ea8067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41ec000640 1 -- 172.21.15.5:0/648539811 shutdown_connections 2024-08-18T22:24:07.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f41ec000640 1 -- 172.21.15.5:0/648539811 wait complete. 2024-08-18T22:24:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f1e84a00640 1 --2- 172.21.15.5:0/1575902766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e8015bfc0 0x7f1e8015c3a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009870 tx=0x7f1e7401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b0397414571b1cd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c1de00640 1 -- 172.21.15.5:0/2562243357 >> v2:172.21.15.5:3300/0 conn(0x7f9c200ae100 msgr2=0x7f9c2006e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c1de00640 1 --2- 172.21.15.5:0/2562243357 >> v2:172.21.15.5:3300/0 conn(0x7f9c200ae100 0x7f9c2006e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c1de00640 1 -- 172.21.15.5:0/2562243357 >> v1:172.21.15.5:6789/0 conn(0x7f9c200cc220 legacy=0x7f9c200ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5eae600640 1 -- 172.21.15.5:0/544974998 shutdown_connections 2024-08-18T22:24:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f5eae600640 1 -- 172.21.15.5:0/544974998 wait complete. 2024-08-18T22:24:07.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f9c1de00640 1 -- 172.21.15.5:0/2562243357 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2015cdb0 con 0x7f9c20159bb0 2024-08-18T22:24:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f1e7f400640 1 -- 172.21.15.5:0/1575902766 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e740b2070 con 0x7f1e8015bfc0 2024-08-18T22:24:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f1e7f400640 1 -- 172.21.15.5:0/1575902766 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e740a9070 con 0x7f1e8015bfc0 2024-08-18T22:24:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f1e7f400640 1 -- 172.21.15.5:0/1575902766 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e740ad880 con 0x7f1e8015bfc0 2024-08-18T22:24:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f1e87400640 1 -- 172.21.15.5:0/1575902766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e8015bfc0 msgr2=0x7f1e8015c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.610+0000 7f1e87400640 1 --2- 172.21.15.5:0/1575902766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e8015bfc0 0x7f1e8015c3a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009870 tx=0x7f1e7401c560 comp rx=0 tx=0).stop 2024-08-18T22:24:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 -- 172.21.15.5:0/1575902766 shutdown_connections 2024-08-18T22:24:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 --2- 172.21.15.5:0/1575902766 >> v2:172.21.15.5:3300/0 conn(0x7f1e800b6520 0x7f1e8006fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 --2- 172.21.15.5:0/1575902766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e8015bfc0 0x7f1e8015c3a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 -- 172.21.15.5:0/1575902766 >> 172.21.15.5:0/1575902766 conn(0x7f1e80073340 msgr2=0x7f1e8006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 -- 172.21.15.5:0/1575902766 shutdown_connections 2024-08-18T22:24:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 -- 172.21.15.5:0/1575902766 wait complete. 2024-08-18T22:24:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ec000640 1 Processor -- start 2024-08-18T22:24:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ec000640 1 -- start start 2024-08-18T22:24:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5eae600640 1 Processor -- start 2024-08-18T22:24:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5eae600640 1 -- start start 2024-08-18T22:24:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ec000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41e406c3c0 0x7f41e415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ec000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e4147dd0 0x7f41e415c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ec000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 0x7f41e415fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ec000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f41e40b5b30 con 0x7f41e406c3c0 2024-08-18T22:24:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ec000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f41e415f9e0 con 0x7f41e4147dd0 2024-08-18T22:24:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ec000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41e40b5cb0 con 0x7f41e415f000 2024-08-18T22:24:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5eae600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ea80b4650 0x7f5ea81f9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e9600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41e406c3c0 0x7f41e415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e4147dd0 0x7f41e415c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e9600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41e406c3c0 0x7f41e415d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46074/0 (socket says 172.21.15.5:46074) 2024-08-18T22:24:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e9600640 1 -- 172.21.15.5:0/2332976106 learned_addr learned my addr 172.21.15.5:0/2332976106 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ea000640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 0x7f41e415fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5eae600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ea8156770 0x7f5ea8158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5eae600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ea815d120 0x7f5ea81532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5eae600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea80d0f00 con 0x7f5ea815d120 2024-08-18T22:24:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5eae600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea80b7360 con 0x7f5ea8156770 2024-08-18T22:24:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5eae600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea80d1080 con 0x7f5ea80b4650 2024-08-18T22:24:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 Processor -- start 2024-08-18T22:24:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ead200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ea80b4650 0x7f5ea81f9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ead200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ea80b4650 0x7f5ea81f9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:33264/0 (socket says 172.21.15.5:33264) 2024-08-18T22:24:07.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ead200640 1 -- 172.21.15.5:0/898497842 learned_addr learned my addr 172.21.15.5:0/898497842 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:07.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ea7e00640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ea8156770 0x7f5ea8158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f9c1de00640 1 --2- 172.21.15.5:0/2562243357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c20159bb0 0x7f9c2015c470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9c20073d40 tx=0x7f9c1001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36ed9fed79877ecb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e8c00640 1 -- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 msgr2=0x7f41e415fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e8c00640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 0x7f41e415fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e8c00640 1 -- 172.21.15.5:0/2332976106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41e406c3c0 msgr2=0x7f41e415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e8c00640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41e406c3c0 0x7f41e415d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e8c00640 1 -- 172.21.15.5:0/2332976106 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e40b13f0 con 0x7f41e4147dd0 2024-08-18T22:24:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e9600640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41e406c3c0 0x7f41e415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ea000640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 0x7f41e415fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5eadc00640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ea815d120 0x7f5ea81532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 -- start start 2024-08-18T22:24:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f9c1d400640 1 -- 172.21.15.5:0/2562243357 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c100b1070 con 0x7f9c20159bb0 2024-08-18T22:24:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ead200640 1 -- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ea8156770 msgr2=0x7f5ea8158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e8c00640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e4147dd0 0x7f41e415c1f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c760 tx=0x7f41d000cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ead200640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ea8156770 0x7f5ea8158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f9c1d400640 1 -- 172.21.15.5:0/2562243357 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c100a8050 con 0x7f9c20159bb0 2024-08-18T22:24:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f9c1d400640 1 -- 172.21.15.5:0/2562243357 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c100ac860 con 0x7f9c20159bb0 2024-08-18T22:24:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ead200640 1 -- 172.21.15.5:0/898497842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ea815d120 msgr2=0x7f5ea81532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ead200640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ea815d120 0x7f5ea81532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ead200640 1 -- 172.21.15.5:0/898497842 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea80cb300 con 0x7f5ea80b4650 2024-08-18T22:24:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ea7e00640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ea8156770 0x7f5ea8158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5eadc00640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ea815d120 0x7f5ea81532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e1600640 1 -- 172.21.15.5:0/2332976106 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0017070 con 0x7f41e4147dd0 2024-08-18T22:24:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e1600640 1 -- 172.21.15.5:0/2332976106 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d0005ac0 con 0x7f41e4147dd0 2024-08-18T22:24:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41e1600640 1 -- 172.21.15.5:0/2332976106 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d000ce10 con 0x7f41e4147dd0 2024-08-18T22:24:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ec000640 1 -- 172.21.15.5:0/2332976106 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e415cb70 con 0x7f41e4147dd0 2024-08-18T22:24:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ead200640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ea80b4650 0x7f5ea81f9d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00cbe0 tx=0x7f5e9c00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f41ec000640 1 -- 172.21.15.5:0/2332976106 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e415ce10 con 0x7f41e4147dd0 2024-08-18T22:24:07.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e800b6520 0x7f1e801534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e800ce320 0x7f1e8015ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8015bfc0 0x7f1e80164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1e80167060 con 0x7f1e8015bfc0 2024-08-18T22:24:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1e80166ee0 con 0x7f1e800ce320 2024-08-18T22:24:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f1e87400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1e801671e0 con 0x7f1e800b6520 2024-08-18T22:24:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ea4c00640 1 -- 172.21.15.5:0/898497842 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c018070 con 0x7f5ea80b4650 2024-08-18T22:24:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5ea4c00640 1 -- 172.21.15.5:0/898497842 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9c004d70 con 0x7f5ea80b4650 2024-08-18T22:24:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f5eae600640 1 -- 172.21.15.5:0/898497842 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea81fa360 con 0x7f5ea80b4650 2024-08-18T22:24:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f5ea4c00640 1 -- 172.21.15.5:0/898497842 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00ad60 con 0x7f5ea80b4650 2024-08-18T22:24:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f5eae600640 1 -- 172.21.15.5:0/898497842 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea81fa920 con 0x7f5ea80b4650 2024-08-18T22:24:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f9c1f200640 1 -- 172.21.15.5:0/2562243357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c20159bb0 msgr2=0x7f9c2015c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.614+0000 7f9c1f200640 1 --2- 172.21.15.5:0/2562243357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c20159bb0 0x7f9c2015c470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9c20073d40 tx=0x7f9c1001c3c0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e85400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8015bfc0 0x7f1e80164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e85400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8015bfc0 0x7f1e80164bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46102/0 (socket says 172.21.15.5:46102) 2024-08-18T22:24:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e85400640 1 -- 172.21.15.5:0/2161402964 learned_addr learned my addr 172.21.15.5:0/2161402964 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e7fe00640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e800ce320 0x7f1e8015ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e84a00640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e800b6520 0x7f1e801534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f9c1f200640 1 -- 172.21.15.5:0/2562243357 shutdown_connections 2024-08-18T22:24:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f9c1f200640 1 --2- 172.21.15.5:0/2562243357 >> v2:172.21.15.5:3300/0 conn(0x7f9c200ae100 0x7f9c2006e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f9c1f200640 1 --2- 172.21.15.5:0/2562243357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c20159bb0 0x7f9c2015c470 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f9c1f200640 1 -- 172.21.15.5:0/2562243357 >> 172.21.15.5:0/2562243357 conn(0x7f9c2006bdb0 msgr2=0x7f9c2006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f9c1f200640 1 -- 172.21.15.5:0/2562243357 shutdown_connections 2024-08-18T22:24:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f9c1f200640 1 -- 172.21.15.5:0/2562243357 wait complete. 2024-08-18T22:24:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e85400640 1 -- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e800b6520 msgr2=0x7f1e801534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e85400640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e800b6520 0x7f1e801534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e85400640 1 -- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e800ce320 msgr2=0x7f1e8015ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f5eae600640 1 -- 172.21.15.5:0/898497842 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea80d1410 con 0x7f5ea80b4650 2024-08-18T22:24:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e85400640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e800ce320 0x7f1e8015ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e85400640 1 -- 172.21.15.5:0/2161402964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e800af660 con 0x7f1e8015bfc0 2024-08-18T22:24:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f41ec000640 1 -- 172.21.15.5:0/2332976106 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e40b40d0 con 0x7f41e4147dd0 2024-08-18T22:24:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e85400640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8015bfc0 0x7f1e80164bb0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800efc0 tx=0x7f1e7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e7cc00640 1 -- 172.21.15.5:0/2161402964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e78018020 con 0x7f1e8015bfc0 2024-08-18T22:24:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e7cc00640 1 -- 172.21.15.5:0/2161402964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e78014480 con 0x7f1e8015bfc0 2024-08-18T22:24:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e87400640 1 -- 172.21.15.5:0/2161402964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e80154240 con 0x7f1e8015bfc0 2024-08-18T22:24:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e7cc00640 1 -- 172.21.15.5:0/2161402964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e78014870 con 0x7f1e8015bfc0 2024-08-18T22:24:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e87400640 1 -- 172.21.15.5:0/2161402964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e80154800 con 0x7f1e8015bfc0 2024-08-18T22:24:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f41e1600640 1 -- 172.21.15.5:0/2332976106 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f41d001a070 con 0x7f41e4147dd0 2024-08-18T22:24:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f5ea4c00640 1 -- 172.21.15.5:0/898497842 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e9c01b070 con 0x7f5ea80b4650 2024-08-18T22:24:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f9c1f200640 1 Processor -- start 2024-08-18T22:24:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f1e87400640 1 -- 172.21.15.5:0/2161402964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e8006fae0 con 0x7f1e8015bfc0 2024-08-18T22:24:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f9c1f200640 1 -- start start 2024-08-18T22:24:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f5ea4c00640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e88067910 0x7f5e88069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f5ea4c00640 1 -- 172.21.15.5:0/898497842 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f5e9c0858e0 con 0x7f5ea80b4650 2024-08-18T22:24:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f41e1600640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41c40678c0 0x7f41c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.618+0000 7f41e1600640 1 -- 172.21.15.5:0/2332976106 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f41d0084ff0 con 0x7f41e4147dd0 2024-08-18T22:24:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f5ea7e00640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e88067910 0x7f5e88069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f41e9600640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41c40678c0 0x7f41c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c200ae100 0x7f9c201584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c200cc220 0x7f9c2014d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f1e7cc00640 1 -- 172.21.15.5:0/2161402964 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e7801b020 con 0x7f1e8015bfc0 2024-08-18T22:24:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c20159bb0 0x7f9c20072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2006f530 con 0x7f9c20159bb0 2024-08-18T22:24:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2006f3b0 con 0x7f9c200cc220 2024-08-18T22:24:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2006f6b0 con 0x7f9c200ae100 2024-08-18T22:24:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1de00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c200ae100 0x7f9c201584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c20159bb0 0x7f9c20072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1de00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c200ae100 0x7f9c201584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:33274/0 (socket says 172.21.15.5:33274) 2024-08-18T22:24:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c20159bb0 0x7f9c20072430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46114/0 (socket says 172.21.15.5:46114) 2024-08-18T22:24:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1de00640 1 -- 172.21.15.5:0/88589247 learned_addr learned my addr 172.21.15.5:0/88589247 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f5ea7e00640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e88067910 0x7f5e88069dd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80cc840 tx=0x7f5e94009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c17e00640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c200cc220 0x7f9c2014d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f41e9600640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41c40678c0 0x7f41c4069d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f41e4144270 tx=0x7f41d8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1de00640 1 -- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c200cc220 msgr2=0x7f9c2014d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1de00640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c200cc220 0x7f9c2014d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1de00640 1 -- 172.21.15.5:0/88589247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c20159bb0 msgr2=0x7f9c20072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1de00640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c20159bb0 0x7f9c20072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1de00640 1 -- 172.21.15.5:0/88589247 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c200ccc40 con 0x7f9c200ae100 2024-08-18T22:24:07.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f1e7cc00640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1e600678c0 0x7f1e60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f1e7cc00640 1 -- 172.21.15.5:0/2161402964 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f1e78086c30 con 0x7f1e8015bfc0 2024-08-18T22:24:07.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1de00640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c200ae100 0x7f9c201584e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c100af040 tx=0x7f9c10019160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f1e84a00640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1e600678c0 0x7f1e60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f1e84a00640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1e600678c0 0x7f1e60069d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1e740af000 tx=0x7f1e740a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c16000640 1 -- 172.21.15.5:0/88589247 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c100b9070 con 0x7f9c200ae100 2024-08-18T22:24:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c16000640 1 -- 172.21.15.5:0/88589247 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c100acdf0 con 0x7f9c200ae100 2024-08-18T22:24:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c16000640 1 -- 172.21.15.5:0/88589247 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c100b1040 con 0x7f9c200ae100 2024-08-18T22:24:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.622+0000 7f9c1f200640 1 -- 172.21.15.5:0/88589247 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c200ccf20 con 0x7f9c200ae100 2024-08-18T22:24:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.626+0000 7f9c1f200640 1 -- 172.21.15.5:0/88589247 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c200cd4e0 con 0x7f9c200ae100 2024-08-18T22:24:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.626+0000 7f5ea4c00640 1 -- 172.21.15.5:0/898497842 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5e9c055c20 con 0x7f5ea80b4650 2024-08-18T22:24:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.626+0000 7f41e1600640 1 -- 172.21.15.5:0/2332976106 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f41e406c850 con 0x7f41e4147dd0 2024-08-18T22:24:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.626+0000 7f9c1f200640 1 -- 172.21.15.5:0/88589247 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2006e450 con 0x7f9c200ae100 2024-08-18T22:24:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.626+0000 7f9c16000640 1 -- 172.21.15.5:0/88589247 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c100bc070 con 0x7f9c200ae100 2024-08-18T22:24:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.626+0000 7f9c16000640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9bfc0678f0 0x7f9bfc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.626+0000 7f1e7cc00640 1 -- 172.21.15.5:0/2161402964 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1e78022030 con 0x7f1e8015bfc0 2024-08-18T22:24:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.626+0000 7f9c16000640 1 -- 172.21.15.5:0/88589247 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f9c1011f9f0 con 0x7f9c200ae100 2024-08-18T22:24:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.626+0000 7f9c17e00640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9bfc0678f0 0x7f9bfc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.630+0000 7f9c17e00640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9bfc0678f0 0x7f9bfc069db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9c200ce8a0 tx=0x7f9c08007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.630+0000 7f9c16000640 1 -- 172.21.15.5:0/88589247 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9c10016070 con 0x7f9c200ae100 2024-08-18T22:24:07.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.858+0000 7f1e87400640 1 -- 172.21.15.5:0/2161402964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f1e8006c790 con 0x7f1e8015bfc0 2024-08-18T22:24:07.857 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:24:07.858+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:24:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.858+0000 7f9c1f200640 1 -- 172.21.15.5:0/88589247 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f9c200b1800 con 0x7f9c200ae100 2024-08-18T22:24:07.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.858+0000 7f1e7cc00640 1 -- 172.21.15.5:0/2161402964 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6798 v57) ==== 95+0+0 (secure 0 0 0) 0x7f1e78010040 con 0x7f1e8015bfc0 2024-08-18T22:24:07.860 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 6798 2024-08-18T22:24:07.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 -- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1e600678c0 msgr2=0x7f1e60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1e600678c0 0x7f1e60069d80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1e740af000 tx=0x7f1e740a7000 comp rx=0 tx=0).stop 2024-08-18T22:24:07.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 -- 172.21.15.5:0/2161402964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8015bfc0 msgr2=0x7f1e80164bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:07.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8015bfc0 0x7f1e80164bb0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800efc0 tx=0x7f1e7800c490 comp rx=0 tx=0).stop 2024-08-18T22:24:07.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 -- 172.21.15.5:0/2161402964 shutdown_connections 2024-08-18T22:24:07.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1e600678c0 0x7f1e60069d80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8015bfc0 0x7f1e80164bb0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e800ce320 0x7f1e8015ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 --2- 172.21.15.5:0/2161402964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e800b6520 0x7f1e801534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:07.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 -- 172.21.15.5:0/2161402964 >> 172.21.15.5:0/2161402964 conn(0x7f1e80073340 msgr2=0x7f1e8006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:07.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 -- 172.21.15.5:0/2161402964 shutdown_connections 2024-08-18T22:24:07.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.862+0000 7f1e87400640 1 -- 172.21.15.5:0/2161402964 wait complete. 2024-08-18T22:24:07.885 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:24:07.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:24:07.888 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:24:07.889 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:07.970 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:24:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.994+0000 7f41ec000640 1 -- 172.21.15.5:0/2332976106 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f41e4070740 con 0x7f41e4147dd0 2024-08-18T22:24:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:07.994+0000 7f5eae600640 1 -- 172.21.15.5:0/898497842 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f5ea815c8b0 con 0x7f5ea80b4650 2024-08-18T22:24:08.306 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:24:08.306+0000 7fc7ef000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:24:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.310+0000 7f41e1600640 1 -- 172.21.15.5:0/2332976106 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6409 v59) ==== 95+0+0 (secure 0 0 0) 0x7f41d0055360 con 0x7f41e4147dd0 2024-08-18T22:24:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 6409 2024-08-18T22:24:08.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.310+0000 7f5ea4c00640 1 -- 172.21.15.5:0/898497842 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6792 v59) ==== 95+0+0 (secure 0 0 0) 0x7f5e9c059f20 con 0x7f5ea80b4650 2024-08-18T22:24:08.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.310+0000 7f9c16000640 1 -- 172.21.15.5:0/88589247 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6415 v59) ==== 95+0+0 (secure 0 0 0) 0x7f9c100efd40 con 0x7f9c200ae100 2024-08-18T22:24:08.313 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 6792 2024-08-18T22:24:08.313 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 6415 2024-08-18T22:24:08.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 -- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41c40678c0 msgr2=0x7f41c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41c40678c0 0x7f41c4069d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f41e4144270 tx=0x7f41d8009190 comp rx=0 tx=0).stop 2024-08-18T22:24:08.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 -- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e4147dd0 msgr2=0x7f41e415c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e4147dd0 0x7f41e415c1f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c760 tx=0x7f41d000cc20 comp rx=0 tx=0).stop 2024-08-18T22:24:08.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 -- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9bfc0678f0 msgr2=0x7f9bfc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9bfc0678f0 0x7f9bfc069db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9c200ce8a0 tx=0x7f9c08007e90 comp rx=0 tx=0).stop 2024-08-18T22:24:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 -- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c200ae100 msgr2=0x7f9c201584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c200ae100 0x7f9c201584e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c100af040 tx=0x7f9c10019160 comp rx=0 tx=0).stop 2024-08-18T22:24:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 -- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e88067910 msgr2=0x7f5e88069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e88067910 0x7f5e88069dd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80cc840 tx=0x7f5e94009190 comp rx=0 tx=0).stop 2024-08-18T22:24:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 -- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ea80b4650 msgr2=0x7f5ea81f9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ea80b4650 0x7f5ea81f9d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00cbe0 tx=0x7f5e9c00a430 comp rx=0 tx=0).stop 2024-08-18T22:24:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 -- 172.21.15.5:0/2332976106 shutdown_connections 2024-08-18T22:24:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41c40678c0 0x7f41c4069d80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e415f000 0x7f41e415fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e4147dd0 0x7f41e415c1f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 --2- 172.21.15.5:0/2332976106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41e406c3c0 0x7f41e415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 -- 172.21.15.5:0/2332976106 >> 172.21.15.5:0/2332976106 conn(0x7f41e40b65f0 msgr2=0x7f41e40b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 -- 172.21.15.5:0/88589247 shutdown_connections 2024-08-18T22:24:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9bfc0678f0 0x7f9bfc069db0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c20159bb0 0x7f9c20072430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c200cc220 0x7f9c2014d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 --2- 172.21.15.5:0/88589247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c200ae100 0x7f9c201584e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 -- 172.21.15.5:0/898497842 shutdown_connections 2024-08-18T22:24:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e88067910 0x7f5e88069dd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ea815d120 0x7f5ea81532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 -- 172.21.15.5:0/88589247 >> 172.21.15.5:0/88589247 conn(0x7f9c2006bdb0 msgr2=0x7f9c200afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ea8156770 0x7f5ea8158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 --2- 172.21.15.5:0/898497842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ea80b4650 0x7f5ea81f9d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 -- 172.21.15.5:0/898497842 >> 172.21.15.5:0/898497842 conn(0x7f5ea8067a70 msgr2=0x7f5ea8067e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 -- 172.21.15.5:0/2332976106 shutdown_connections 2024-08-18T22:24:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 -- 172.21.15.5:0/88589247 shutdown_connections 2024-08-18T22:24:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f41ec000640 1 -- 172.21.15.5:0/2332976106 wait complete. 2024-08-18T22:24:08.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f9c1f200640 1 -- 172.21.15.5:0/88589247 wait complete. 2024-08-18T22:24:08.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 -- 172.21.15.5:0/898497842 shutdown_connections 2024-08-18T22:24:08.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.314+0000 7f5eae600640 1 -- 172.21.15.5:0/898497842 wait complete. 2024-08-18T22:24:08.347 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:24:08.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:24:08.348 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:24:08.348 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:24:08.349 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:24:08.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:24:08.352 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:24:08.352 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:08.394 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:24:08.395 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:08.396 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:24:08.397 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:08.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:08.434 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:24:08.482 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:24:08.483 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:24:08.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d3b800640 1 Processor -- start 2024-08-18T22:24:08.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d3b800640 1 -- start start 2024-08-18T22:24:08.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d3b800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d340b54c0 0x7f6d34071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:08.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d3b800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d34071c80 con 0x7f6d3406dd80 2024-08-18T22:24:08.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d3b800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d34071f60 con 0x7f6d340cbed0 2024-08-18T22:24:08.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d3b800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6d340cba40 con 0x7f6d340b54c0 2024-08-18T22:24:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d33e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6d3406dd80 0x7f6d340b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56858/0 (socket says 172.21.15.5:56858) 2024-08-18T22:24:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d33e00640 1 -- 172.21.15.5:0/3983096641 learned_addr learned my addr 172.21.15.5:0/3983096641 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d38e00640 1 --2- 172.21.15.5:0/3983096641 >> v2:172.21.15.5:3300/0 conn(0x7f6d340b54c0 0x7f6d34071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d33400640 1 -- 172.21.15.5:0/3983096641 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1299683392 0 0) 0x7f6d34071f60 con 0x7f6d340cbed0 2024-08-18T22:24:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d38e00640 1 -- 172.21.15.5:0/3983096641 >> v1:172.21.15.117:6789/0 conn(0x7f6d340cbed0 legacy=0x7f6d340cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d38e00640 1 -- 172.21.15.5:0/3983096641 >> v1:172.21.15.5:6789/0 conn(0x7f6d3406dd80 legacy=0x7f6d340b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.542+0000 7f6d38e00640 1 -- 172.21.15.5:0/3983096641 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d340cb6d0 con 0x7f6d340b54c0 2024-08-18T22:24:08.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.546+0000 7f6d38e00640 1 --2- 172.21.15.5:0/3983096641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d340b54c0 0x7f6d34071580 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f6d240097c0 tx=0x7f6d2401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd56949a491577b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:08.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.546+0000 7f6d33400640 1 -- 172.21.15.5:0/3983096641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d240b2070 con 0x7f6d340b54c0 2024-08-18T22:24:08.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.546+0000 7f6d33400640 1 -- 172.21.15.5:0/3983096641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d240a9070 con 0x7f6d340b54c0 2024-08-18T22:24:08.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.546+0000 7f6d33400640 1 -- 172.21.15.5:0/3983096641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d240ad880 con 0x7f6d340b54c0 2024-08-18T22:24:08.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.546+0000 7f6d3b800640 1 -- 172.21.15.5:0/3983096641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d340b54c0 msgr2=0x7f6d34071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.546+0000 7f6d3b800640 1 --2- 172.21.15.5:0/3983096641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d340b54c0 0x7f6d34071580 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f6d240097c0 tx=0x7f6d2401c3c0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.546+0000 7f6d3b800640 1 -- 172.21.15.5:0/3983096641 shutdown_connections 2024-08-18T22:24:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.546+0000 7f6d3b800640 1 --2- 172.21.15.5:0/3983096641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d340b54c0 0x7f6d34071580 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.546+0000 7f6d3b800640 1 -- 172.21.15.5:0/3983096641 >> 172.21.15.5:0/3983096641 conn(0x7f6d340b3eb0 msgr2=0x7f6d340b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.546+0000 7f6d3b800640 1 -- 172.21.15.5:0/3983096641 shutdown_connections 2024-08-18T22:24:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.546+0000 7f6d3b800640 1 -- 172.21.15.5:0/3983096641 wait complete. 2024-08-18T22:24:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d3b800640 1 Processor -- start 2024-08-18T22:24:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d3b800640 1 -- start start 2024-08-18T22:24:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d3b800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d3406dd80 0x7f6d3415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d3b800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d340b54c0 0x7f6d340cf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d3b800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d340cbed0 0x7f6d340d0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d3b800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6d341481a0 con 0x7f6d3406dd80 2024-08-18T22:24:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d3b800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d34148020 con 0x7f6d340b54c0 2024-08-18T22:24:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d3b800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6d340cca70 con 0x7f6d340cbed0 2024-08-18T22:24:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d38e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d3406dd80 0x7f6d3415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d38e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d3406dd80 0x7f6d3415dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46140/0 (socket says 172.21.15.5:46140) 2024-08-18T22:24:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d38e00640 1 -- 172.21.15.5:0/3103330887 learned_addr learned my addr 172.21.15.5:0/3103330887 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d33e00640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d340b54c0 0x7f6d340cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d39800640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d340cbed0 0x7f6d340d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d38e00640 1 -- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d340cbed0 msgr2=0x7f6d340d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d38e00640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d340cbed0 0x7f6d340d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d38e00640 1 -- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d340b54c0 msgr2=0x7f6d340cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d38e00640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d340b54c0 0x7f6d340cf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d38e00640 1 -- 172.21.15.5:0/3103330887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d340ceba0 con 0x7f6d3406dd80 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d38e00640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d3406dd80 0x7f6d3415dcc0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6d240b0040 tx=0x7f6d2401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d30c00640 1 -- 172.21.15.5:0/3103330887 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d240b2050 con 0x7f6d3406dd80 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d30c00640 1 -- 172.21.15.5:0/3103330887 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d240b3040 con 0x7f6d3406dd80 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d30c00640 1 -- 172.21.15.5:0/3103330887 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24004420 con 0x7f6d3406dd80 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d3b800640 1 -- 172.21.15.5:0/3103330887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d340cee80 con 0x7f6d3406dd80 2024-08-18T22:24:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.550+0000 7f6d3b800640 1 -- 172.21.15.5:0/3103330887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d340cf440 con 0x7f6d3406dd80 2024-08-18T22:24:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.554+0000 7f6d3b800640 1 -- 172.21.15.5:0/3103330887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d34071f60 con 0x7f6d3406dd80 2024-08-18T22:24:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.554+0000 7f6d30c00640 1 -- 172.21.15.5:0/3103330887 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6d240c0060 con 0x7f6d3406dd80 2024-08-18T22:24:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.554+0000 7f6d30c00640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6d140678c0 0x7f6d14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.554+0000 7f6d30c00640 1 -- 172.21.15.5:0/3103330887 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7f6d2411fd80 con 0x7f6d3406dd80 2024-08-18T22:24:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.554+0000 7f6d33e00640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6d140678c0 0x7f6d14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.558+0000 7f6d33e00640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6d140678c0 0x7f6d14069d80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6d341e99a0 tx=0x7f6d2000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:08.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.558+0000 7f6d30c00640 1 -- 172.21.15.5:0/3103330887 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6d24015fb0 con 0x7f6d3406dd80 2024-08-18T22:24:08.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.758+0000 7f6d3b800640 1 -- 172.21.15.5:0/3103330887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d340cc400 con 0x7f6d3406dd80 2024-08-18T22:24:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.758+0000 7f6d30c00640 1 -- 172.21.15.5:0/3103330887 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+2745 (secure 0 0 0) 0x7f6d240eff90 con 0x7f6d3406dd80 2024-08-18T22:24:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:08.760 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":60,"btime":"2024-08-18T22:24:08:312771+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:53.630789+0000","modified":"2024-08-18T22:24:08.312756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6589":{"gid":6589,"name":"b","rank":0,"incarnation":60,"state":"up:replay","state_seq":1,"addr":"172.21.15.117:6835/349592920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":349592920},{"type":"v1","addr":"172.21.15.117:6835","nonce":349592920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-08-18T22:24:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 60 2024-08-18T22:24:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 -- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6d140678c0 msgr2=0x7f6d14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6d140678c0 0x7f6d14069d80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6d341e99a0 tx=0x7f6d2000b040 comp rx=0 tx=0).stop 2024-08-18T22:24:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 -- 172.21.15.5:0/3103330887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d3406dd80 msgr2=0x7f6d3415dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d3406dd80 0x7f6d3415dcc0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6d240b0040 tx=0x7f6d2401ac00 comp rx=0 tx=0).stop 2024-08-18T22:24:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 -- 172.21.15.5:0/3103330887 shutdown_connections 2024-08-18T22:24:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6d140678c0 0x7f6d14069d80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d340cbed0 0x7f6d340d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d340b54c0 0x7f6d340cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 --2- 172.21.15.5:0/3103330887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d3406dd80 0x7f6d3415dcc0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:08.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 -- 172.21.15.5:0/3103330887 >> 172.21.15.5:0/3103330887 conn(0x7f6d340b3eb0 msgr2=0x7f6d3406cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:08.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 -- 172.21.15.5:0/3103330887 shutdown_connections 2024-08-18T22:24:08.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:08.762+0000 7f6d3b800640 1 -- 172.21.15.5:0/3103330887 wait complete. 2024-08-18T22:24:09.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:23:53.630789+0000', 'modified': '2024-08-18T22:24:08.312756+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6589}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6589': {'gid': 6589, 'name': 'b', 'rank': 0, 'incarnation': 60, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.117:6835/349592920', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 349592920}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 349592920}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-18T22:24:09.185 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6589:up:replay 2024-08-18T22:24:10.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:10.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.342+0000 7f4267200640 1 Processor -- start 2024-08-18T22:24:10.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.342+0000 7f4267200640 1 -- start start 2024-08-18T22:24:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.342+0000 7f4267200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4260071c90 0x7f42600b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.342+0000 7f4267200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42600b5e30 con 0x7f426015c180 2024-08-18T22:24:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.342+0000 7f4267200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42600b6110 con 0x7f426006fad0 2024-08-18T22:24:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.342+0000 7f4267200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f42600b63f0 con 0x7f4260071c90 2024-08-18T22:24:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.342+0000 7f425fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f426015c180 0x7f4260071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56864/0 (socket says 172.21.15.5:56864) 2024-08-18T22:24:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.342+0000 7f4257400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4260071c90 0x7f42600b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.342+0000 7f425fe00640 1 -- 172.21.15.5:0/3598990601 learned_addr learned my addr 172.21.15.5:0/3598990601 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f4257400640 1 -- 172.21.15.5:0/3598990601 >> v1:172.21.15.117:6789/0 conn(0x7f426006fad0 legacy=0x7f42600d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f4257400640 1 -- 172.21.15.5:0/3598990601 >> v1:172.21.15.5:6789/0 conn(0x7f426015c180 legacy=0x7f4260071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f4257400640 1 -- 172.21.15.5:0/3598990601 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42600b66d0 con 0x7f4260071c90 2024-08-18T22:24:10.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f4257400640 1 --2- 172.21.15.5:0/3598990601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4260071c90 0x7f42600b57c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f42480097c0 tx=0x7f424801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae70d8382b48fc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:10.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f425f400640 1 -- 172.21.15.5:0/3598990601 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42480b0070 con 0x7f4260071c90 2024-08-18T22:24:10.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f425f400640 1 -- 172.21.15.5:0/3598990601 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42480ab600 con 0x7f4260071c90 2024-08-18T22:24:10.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f425f400640 1 -- 172.21.15.5:0/3598990601 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42480ab9d0 con 0x7f4260071c90 2024-08-18T22:24:10.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f4267200640 1 -- 172.21.15.5:0/3598990601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4260071c90 msgr2=0x7f42600b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:10.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f4267200640 1 --2- 172.21.15.5:0/3598990601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4260071c90 0x7f42600b57c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f42480097c0 tx=0x7f424801c2e0 comp rx=0 tx=0).stop 2024-08-18T22:24:10.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f4267200640 1 -- 172.21.15.5:0/3598990601 shutdown_connections 2024-08-18T22:24:10.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f4267200640 1 --2- 172.21.15.5:0/3598990601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4260071c90 0x7f42600b57c0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:10.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.346+0000 7f4267200640 1 -- 172.21.15.5:0/3598990601 >> 172.21.15.5:0/3598990601 conn(0x7f42600b3eb0 msgr2=0x7f42600b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:10.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4267200640 1 -- 172.21.15.5:0/3598990601 shutdown_connections 2024-08-18T22:24:10.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4267200640 1 -- 172.21.15.5:0/3598990601 wait complete. 2024-08-18T22:24:10.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4267200640 1 Processor -- start 2024-08-18T22:24:10.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4267200640 1 -- start start 2024-08-18T22:24:10.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4267200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426006fad0 0x7f4260159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:10.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4267200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4260071c90 0x7f42601fae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:10.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4267200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426015c180 0x7f42601fb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:10.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4267200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f426016a160 con 0x7f4260071c90 2024-08-18T22:24:10.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4267200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4260169fe0 con 0x7f426015c180 2024-08-18T22:24:10.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4267200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f426016a2e0 con 0x7f426006fad0 2024-08-18T22:24:10.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4257400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4260071c90 0x7f42601fae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4257400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4260071c90 0x7f42601fae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46168/0 (socket says 172.21.15.5:46168) 2024-08-18T22:24:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4257400640 1 -- 172.21.15.5:0/1289904734 learned_addr learned my addr 172.21.15.5:0/1289904734 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f425fe00640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426006fad0 0x7f4260159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4265200640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426015c180 0x7f42601fb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4257400640 1 -- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426006fad0 msgr2=0x7f4260159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4257400640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426006fad0 0x7f4260159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4257400640 1 -- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426015c180 msgr2=0x7f42601fb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4257400640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426015c180 0x7f42601fb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4257400640 1 -- 172.21.15.5:0/1289904734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426014ec50 con 0x7f4260071c90 2024-08-18T22:24:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f4257400640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4260071c90 0x7f42601fae10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f4248018f50 tx=0x7f42480190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:10.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.350+0000 7f425cc00640 1 -- 172.21.15.5:0/1289904734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42480b0040 con 0x7f4260071c90 2024-08-18T22:24:10.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.354+0000 7f425cc00640 1 -- 172.21.15.5:0/1289904734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42480ba070 con 0x7f4260071c90 2024-08-18T22:24:10.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.354+0000 7f425cc00640 1 -- 172.21.15.5:0/1289904734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42480b4870 con 0x7f4260071c90 2024-08-18T22:24:10.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.354+0000 7f4267200640 1 -- 172.21.15.5:0/1289904734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f426014ef30 con 0x7f4260071c90 2024-08-18T22:24:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.354+0000 7f4267200640 1 -- 172.21.15.5:0/1289904734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f426015a750 con 0x7f4260071c90 2024-08-18T22:24:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.354+0000 7f4267200640 1 -- 172.21.15.5:0/1289904734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4260151900 con 0x7f4260071c90 2024-08-18T22:24:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.354+0000 7f425cc00640 1 -- 172.21.15.5:0/1289904734 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42480ab480 con 0x7f4260071c90 2024-08-18T22:24:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.354+0000 7f425cc00640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f423c0678f0 0x7f423c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.354+0000 7f425cc00640 1 -- 172.21.15.5:0/1289904734 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7f424811fc20 con 0x7f4260071c90 2024-08-18T22:24:10.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.354+0000 7f425fe00640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f423c0678f0 0x7f423c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:10.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.354+0000 7f425fe00640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f423c0678f0 0x7f423c069db0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4250000f70 tx=0x7f4250007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.358+0000 7f425cc00640 1 -- 172.21.15.5:0/1289904734 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4248016050 con 0x7f4260071c90 2024-08-18T22:24:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 -- 172.21.15.5:0/1289904734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42600b5740 con 0x7f4260071c90 2024-08-18T22:24:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f425cc00640 1 -- 172.21.15.5:0/1289904734 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5210 (secure 0 0 0) 0x7f42480efe20 con 0x7f4260071c90 2024-08-18T22:24:10.562 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:10.562 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":62,"btime":"2024-08-18T22:24:10:317092+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/625897913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":625897913},{"type":"v1","addr":"172.21.15.117:6837","nonce":625897913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/128531097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":128531097},{"type":"v1","addr":"172.21.15.5:6835","nonce":128531097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3673408015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3673408015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3673408015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:53.630789+0000","modified":"2024-08-18T22:24:09.319486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6589":{"gid":6589,"name":"b","rank":0,"incarnation":60,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.117:6835/349592920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":349592920},{"type":"v1","addr":"172.21.15.117:6835","nonce":349592920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-08-18T22:24:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 62 2024-08-18T22:24:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 -- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f423c0678f0 msgr2=0x7f423c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f423c0678f0 0x7f423c069db0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4250000f70 tx=0x7f4250007e90 comp rx=0 tx=0).stop 2024-08-18T22:24:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 -- 172.21.15.5:0/1289904734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4260071c90 msgr2=0x7f42601fae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4260071c90 0x7f42601fae10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f4248018f50 tx=0x7f42480190e0 comp rx=0 tx=0).stop 2024-08-18T22:24:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 -- 172.21.15.5:0/1289904734 shutdown_connections 2024-08-18T22:24:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f423c0678f0 0x7f423c069db0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426015c180 0x7f42601fb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4260071c90 0x7f42601fae10 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 --2- 172.21.15.5:0/1289904734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426006fad0 0x7f4260159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 -- 172.21.15.5:0/1289904734 >> 172.21.15.5:0/1289904734 conn(0x7f42600b3eb0 msgr2=0x7f42600b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 -- 172.21.15.5:0/1289904734 shutdown_connections 2024-08-18T22:24:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:10.562+0000 7f4267200640 1 -- 172.21.15.5:0/1289904734 wait complete. 2024-08-18T22:24:10.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:23:53.630789+0000', 'modified': '2024-08-18T22:24:09.319486+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6589}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6589': {'gid': 6589, 'name': 'b', 'rank': 0, 'incarnation': 60, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.117:6835/349592920', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 349592920}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 349592920}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-18T22:24:10.988 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6589:up:rejoin 2024-08-18T22:24:11.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:12.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.142+0000 7fbfe7c00640 1 Processor -- start 2024-08-18T22:24:12.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.142+0000 7fbfe7c00640 1 -- start start 2024-08-18T22:24:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.142+0000 7fbfe7c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe00ce840 0x7fbfe00cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.142+0000 7fbfe7c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe00cee20 con 0x7fbfe006f290 2024-08-18T22:24:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.142+0000 7fbfe7c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe00cf100 con 0x7fbfe015b010 2024-08-18T22:24:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.142+0000 7fbfe7c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe00cd8e0 con 0x7fbfe00ce840 2024-08-18T22:24:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.142+0000 7fbfd7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbfe006f290 0x7fbfe0072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56880/0 (socket says 172.21.15.5:56880) 2024-08-18T22:24:12.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.142+0000 7fbfd7e00640 1 -- 172.21.15.5:0/3289944751 learned_addr learned my addr 172.21.15.5:0/3289944751 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.142+0000 7fbfe5c00640 1 --2- 172.21.15.5:0/3289944751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe00ce840 0x7fbfe00cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.142+0000 7fbfdfe00640 1 -- 172.21.15.5:0/3289944751 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876489592 0 0) 0x7fbfe00cee20 con 0x7fbfe006f290 2024-08-18T22:24:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.142+0000 7fbfdfe00640 1 -- 172.21.15.5:0/3289944751 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfc4003530 con 0x7fbfe006f290 2024-08-18T22:24:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.146+0000 7fbfdfe00640 1 -- 172.21.15.5:0/3289944751 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233346444 0 0) 0x7fbfe00cf100 con 0x7fbfe015b010 2024-08-18T22:24:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.146+0000 7fbfdfe00640 1 -- 172.21.15.5:0/3289944751 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfe00cee20 con 0x7fbfe015b010 2024-08-18T22:24:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.146+0000 7fbfe5c00640 1 -- 172.21.15.5:0/3289944751 >> v1:172.21.15.117:6789/0 conn(0x7fbfe015b010 legacy=0x7fbfe006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.146+0000 7fbfe5c00640 1 -- 172.21.15.5:0/3289944751 >> v1:172.21.15.5:6789/0 conn(0x7fbfe006f290 legacy=0x7fbfe0072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.146+0000 7fbfe5c00640 1 -- 172.21.15.5:0/3289944751 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe00cf3e0 con 0x7fbfe00ce840 2024-08-18T22:24:12.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.146+0000 7fbfe5c00640 1 --2- 172.21.15.5:0/3289944751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe00ce840 0x7fbfe00cd3a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009dc0 tx=0x7fbfd801c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953ffe9763c982ee server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.146+0000 7fbfdfe00640 1 -- 172.21.15.5:0/3289944751 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80b2070 con 0x7fbfe00ce840 2024-08-18T22:24:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.146+0000 7fbfdfe00640 1 -- 172.21.15.5:0/3289944751 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd80a57d0 con 0x7fbfe00ce840 2024-08-18T22:24:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.146+0000 7fbfdfe00640 1 -- 172.21.15.5:0/3289944751 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80a5ba0 con 0x7fbfe00ce840 2024-08-18T22:24:12.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 -- 172.21.15.5:0/3289944751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe00ce840 msgr2=0x7fbfe00cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 --2- 172.21.15.5:0/3289944751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe00ce840 0x7fbfe00cd3a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009dc0 tx=0x7fbfd801c900 comp rx=0 tx=0).stop 2024-08-18T22:24:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 -- 172.21.15.5:0/3289944751 shutdown_connections 2024-08-18T22:24:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 --2- 172.21.15.5:0/3289944751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe00ce840 0x7fbfe00cd3a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 -- 172.21.15.5:0/3289944751 >> 172.21.15.5:0/3289944751 conn(0x7fbfe00b1c50 msgr2=0x7fbfe00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 -- 172.21.15.5:0/3289944751 shutdown_connections 2024-08-18T22:24:12.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 -- 172.21.15.5:0/3289944751 wait complete. 2024-08-18T22:24:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 Processor -- start 2024-08-18T22:24:12.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 -- start start 2024-08-18T22:24:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe006f290 0x7fbfe014fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe00ce840 0x7fbfe00c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfe015b010 0x7fbfe00c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0073910 con 0x7fbfe00ce840 2024-08-18T22:24:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0073790 con 0x7fbfe015b010 2024-08-18T22:24:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe7c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe006da70 con 0x7fbfe006f290 2024-08-18T22:24:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfd7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe00ce840 0x7fbfe00c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfd7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe00ce840 0x7fbfe00c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46184/0 (socket says 172.21.15.5:46184) 2024-08-18T22:24:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfd7e00640 1 -- 172.21.15.5:0/2826941887 learned_addr learned my addr 172.21.15.5:0/2826941887 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:12.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe5c00640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfe015b010 0x7fbfe00c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe5200640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe006f290 0x7fbfe014fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfd7e00640 1 -- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe006f290 msgr2=0x7fbfe014fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfd7e00640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe006f290 0x7fbfe014fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfd7e00640 1 -- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfe015b010 msgr2=0x7fbfe00c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfd7e00640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfe015b010 0x7fbfe00c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfd7e00640 1 -- 172.21.15.5:0/2826941887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe00b30f0 con 0x7fbfe00ce840 2024-08-18T22:24:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.150+0000 7fbfe5200640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe006f290 0x7fbfe014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.154+0000 7fbfd7e00640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe00ce840 0x7fbfe00c92d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800c4f0 tx=0x7fbfc800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.154+0000 7fbfdd600640 1 -- 172.21.15.5:0/2826941887 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8017070 con 0x7fbfe00ce840 2024-08-18T22:24:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.154+0000 7fbfdd600640 1 -- 172.21.15.5:0/2826941887 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc8005cf0 con 0x7fbfe00ce840 2024-08-18T22:24:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.154+0000 7fbfe7c00640 1 -- 172.21.15.5:0/2826941887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe00b33d0 con 0x7fbfe00ce840 2024-08-18T22:24:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.154+0000 7fbfdd600640 1 -- 172.21.15.5:0/2826941887 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8007270 con 0x7fbfe00ce840 2024-08-18T22:24:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.154+0000 7fbfe7c00640 1 -- 172.21.15.5:0/2826941887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe00b3990 con 0x7fbfe00ce840 2024-08-18T22:24:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.154+0000 7fbfe7c00640 1 -- 172.21.15.5:0/2826941887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe00cd3a0 con 0x7fbfe00ce840 2024-08-18T22:24:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.154+0000 7fbfdd600640 1 -- 172.21.15.5:0/2826941887 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbfc801a070 con 0x7fbfe00ce840 2024-08-18T22:24:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.154+0000 7fbfdd600640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbfbc0678c0 0x7fbfbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.154+0000 7fbfdd600640 1 -- 172.21.15.5:0/2826941887 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7fbfc8085290 con 0x7fbfe00ce840 2024-08-18T22:24:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.154+0000 7fbfe5200640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbfbc0678c0 0x7fbfbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.158+0000 7fbfe5200640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbfbc0678c0 0x7fbfbc069d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00011f0 tx=0x7fbfd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:12.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.158+0000 7fbfdd600640 1 -- 172.21.15.5:0/2826941887 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbfc80554a0 con 0x7fbfe00ce840 2024-08-18T22:24:12.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.358+0000 7fbfe7c00640 1 -- 172.21.15.5:0/2826941887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfe0072af0 con 0x7fbfe00ce840 2024-08-18T22:24:12.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.358+0000 7fbfdd600640 1 -- 172.21.15.5:0/2826941887 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5217 (secure 0 0 0) 0x7fbfc80597a0 con 0x7fbfe00ce840 2024-08-18T22:24:12.360 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:12.360 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"btime":"2024-08-18T22:24:11:322415+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/625897913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":625897913},{"type":"v1","addr":"172.21.15.117:6837","nonce":625897913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/128531097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":128531097},{"type":"v1","addr":"172.21.15.5:6835","nonce":128531097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3673408015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3673408015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3673408015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:53.630789+0000","modified":"2024-08-18T22:24:11.322406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6589":{"gid":6589,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6835/349592920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":349592920},{"type":"v1","addr":"172.21.15.117:6835","nonce":349592920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6589,"qdb_cluster":[6589]},"id":5}]} 2024-08-18T22:24:12.361 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-08-18T22:24:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 -- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbfbc0678c0 msgr2=0x7fbfbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbfbc0678c0 0x7fbfbc069d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00011f0 tx=0x7fbfd0009040 comp rx=0 tx=0).stop 2024-08-18T22:24:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 -- 172.21.15.5:0/2826941887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe00ce840 msgr2=0x7fbfe00c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe00ce840 0x7fbfe00c92d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800c4f0 tx=0x7fbfc800c9b0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 -- 172.21.15.5:0/2826941887 shutdown_connections 2024-08-18T22:24:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbfbc0678c0 0x7fbfbc069d80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfe015b010 0x7fbfe00c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfe00ce840 0x7fbfe00c92d0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 --2- 172.21.15.5:0/2826941887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfe006f290 0x7fbfe014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 -- 172.21.15.5:0/2826941887 >> 172.21.15.5:0/2826941887 conn(0x7fbfe00b1c50 msgr2=0x7fbfe0159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:12.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 -- 172.21.15.5:0/2826941887 shutdown_connections 2024-08-18T22:24:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.362+0000 7fbfe7c00640 1 -- 172.21.15.5:0/2826941887 wait complete. 2024-08-18T22:24:12.784 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:23:53.630789+0000', 'modified': '2024-08-18T22:24:11.322406+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6589}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6589': {'gid': 6589, 'name': 'b', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.117:6835/349592920', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 349592920}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 349592920}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6589, 'qdb_cluster': [6589]} 2024-08-18T22:24:12.785 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:24:12.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-18T22:24:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.930+0000 7fee5f600640 1 Processor -- start 2024-08-18T22:24:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.930+0000 7fee5f600640 1 -- start start 2024-08-18T22:24:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5f600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fee5815c180 0x7fee580cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815d4d0 0x7fee5806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5f600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee580cfb00 con 0x7fee5815c560 2024-08-18T22:24:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5f600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fee5815d040 con 0x7fee5815c180 2024-08-18T22:24:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fee5815c9f0 con 0x7fee5815d4d0 2024-08-18T22:24:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee4fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fee5815c560 0x7fee580ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56884/0 (socket says 172.21.15.5:56884) 2024-08-18T22:24:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee4fe00640 1 -- 172.21.15.5:0/3223097136 learned_addr learned my addr 172.21.15.5:0/3223097136 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5d600640 1 --2- 172.21.15.5:0/3223097136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815d4d0 0x7fee5806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5cc00640 1 --2- 172.21.15.5:0/3223097136 >> v2:172.21.15.117:3300/0 conn(0x7fee5815c180 0x7fee580cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee57e00640 1 -- 172.21.15.5:0/3223097136 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688151152 0 0) 0x7fee580cfb00 con 0x7fee5815c560 2024-08-18T22:24:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee57e00640 1 -- 172.21.15.5:0/3223097136 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee3c003530 con 0x7fee5815c560 2024-08-18T22:24:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee57e00640 1 -- 172.21.15.5:0/3223097136 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 175810447 0 0) 0x7fee3c003530 con 0x7fee5815c560 2024-08-18T22:24:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5cc00640 1 -- 172.21.15.5:0/3223097136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815d4d0 msgr2=0x7fee5806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5cc00640 1 --2- 172.21.15.5:0/3223097136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815d4d0 0x7fee5806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5cc00640 1 -- 172.21.15.5:0/3223097136 >> v1:172.21.15.5:6789/0 conn(0x7fee5815c560 legacy=0x7fee580ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5cc00640 1 -- 172.21.15.5:0/3223097136 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5815ccd0 con 0x7fee5815c180 2024-08-18T22:24:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.934+0000 7fee5d600640 1 --2- 172.21.15.5:0/3223097136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815d4d0 0x7fee5806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee5cc00640 1 --2- 172.21.15.5:0/3223097136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee5815c180 0x7fee580cdf10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fee480097c0 tx=0x7fee4801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8baa517906eed2c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee57e00640 1 -- 172.21.15.5:0/3223097136 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480b0070 con 0x7fee5815c180 2024-08-18T22:24:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee57e00640 1 -- 172.21.15.5:0/3223097136 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee580ced70 con 0x7fee5815c180 2024-08-18T22:24:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee57e00640 1 -- 172.21.15.5:0/3223097136 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40001680 con 0x7fee5815c180 2024-08-18T22:24:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee5f600640 1 -- 172.21.15.5:0/3223097136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee5815c180 msgr2=0x7fee580cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee5f600640 1 --2- 172.21.15.5:0/3223097136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee5815c180 0x7fee580cdf10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fee480097c0 tx=0x7fee4801c330 comp rx=0 tx=0).stop 2024-08-18T22:24:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee5f600640 1 -- 172.21.15.5:0/3223097136 shutdown_connections 2024-08-18T22:24:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee5f600640 1 --2- 172.21.15.5:0/3223097136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815d4d0 0x7fee5806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee5f600640 1 --2- 172.21.15.5:0/3223097136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee5815c180 0x7fee580cdf10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee5f600640 1 -- 172.21.15.5:0/3223097136 >> 172.21.15.5:0/3223097136 conn(0x7fee580b1dc0 msgr2=0x7fee580b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee5f600640 1 -- 172.21.15.5:0/3223097136 shutdown_connections 2024-08-18T22:24:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee5f600640 1 -- 172.21.15.5:0/3223097136 wait complete. 2024-08-18T22:24:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee5f600640 1 Processor -- start 2024-08-18T22:24:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.938+0000 7fee5f600640 1 -- start start 2024-08-18T22:24:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5f600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee5815c180 0x7fee5814e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815d4d0 0x7fee5814ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5f600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5814b1d0 0x7fee58158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5f600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fee581692b0 con 0x7fee5814b1d0 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5f600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fee58169130 con 0x7fee5815c180 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fee58169430 con 0x7fee5815d4d0 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5814b1d0 0x7fee58158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5814b1d0 0x7fee58158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46192/0 (socket says 172.21.15.5:46192) 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5d600640 1 -- 172.21.15.5:0/1243584154 learned_addr learned my addr 172.21.15.5:0/1243584154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5cc00640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee5815c180 0x7fee5814e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee4fe00640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815d4d0 0x7fee5814ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5d600640 1 -- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815d4d0 msgr2=0x7fee5814ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5d600640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815d4d0 0x7fee5814ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5d600640 1 -- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee5815c180 msgr2=0x7fee5814e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5d600640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee5815c180 0x7fee5814e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5d600640 1 -- 172.21.15.5:0/1243584154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5814e8f0 con 0x7fee5814b1d0 2024-08-18T22:24:12.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5d600640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5814b1d0 0x7fee58158bd0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fee5000ef90 tx=0x7fee5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee55600640 1 -- 172.21.15.5:0/1243584154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50018020 con 0x7fee5814b1d0 2024-08-18T22:24:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee55600640 1 -- 172.21.15.5:0/1243584154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee50014480 con 0x7fee5814b1d0 2024-08-18T22:24:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee55600640 1 -- 172.21.15.5:0/1243584154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50014850 con 0x7fee5814b1d0 2024-08-18T22:24:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5f600640 1 -- 172.21.15.5:0/1243584154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5814ebd0 con 0x7fee5814b1d0 2024-08-18T22:24:12.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee5f600640 1 -- 172.21.15.5:0/1243584154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5814f190 con 0x7fee5814b1d0 2024-08-18T22:24:12.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.942+0000 7fee55600640 1 -- 172.21.15.5:0/1243584154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee5001b020 con 0x7fee5814b1d0 2024-08-18T22:24:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee55600640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 0x7fee34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee55600640 1 -- 172.21.15.5:0/1243584154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7fee50086d60 con 0x7fee5814b1d0 2024-08-18T22:24:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 Processor -- start 2024-08-18T22:24:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee5cc00640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 0x7fee34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 -- start start 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee5cc00640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 0x7fee34069d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fee480ad000 tx=0x7fee48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbce31fa0 0x55fdbce32380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce328c0 0x55fdbcde8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbcde8da0 0x55fdbcde9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fdbcccafd0 con 0x55fdbce328c0 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fdbcc313c0 con 0x55fdbce31fa0 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fdbcbd6f70 con 0x55fdbcde8da0 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce328c0 0x55fdbcde8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce328c0 0x55fdbcde8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46206/0 (socket says 172.21.15.5:46206) 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4fe00640 1 -- 172.21.15.5:0/2861746218 learned_addr learned my addr 172.21.15.5:0/2861746218 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee5cc00640 1 --2- 172.21.15.5:0/2861746218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbce31fa0 0x55fdbce32380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee5d600640 1 --2- 172.21.15.5:0/2861746218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbcde8da0 0x55fdbcde9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4fe00640 1 -- 172.21.15.5:0/2861746218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbcde8da0 msgr2=0x55fdbcde9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4fe00640 1 --2- 172.21.15.5:0/2861746218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbcde8da0 0x55fdbcde9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4fe00640 1 -- 172.21.15.5:0/2861746218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbce31fa0 msgr2=0x55fdbce32380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4fe00640 1 --2- 172.21.15.5:0/2861746218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbce31fa0 0x55fdbce32380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4fe00640 1 -- 172.21.15.5:0/2861746218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbcbcb2e0 con 0x55fdbce328c0 2024-08-18T22:24:12.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4fe00640 1 --2- 172.21.15.5:0/2861746218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce328c0 0x55fdbcde8860 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fee40001390 tx=0x7fee40007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442358f748bf68e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:12.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4d600640 1 -- 172.21.15.5:0/2861746218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40019070 con 0x55fdbce328c0 2024-08-18T22:24:12.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4d600640 1 -- 172.21.15.5:0/2861746218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40005af0 con 0x55fdbce328c0 2024-08-18T22:24:12.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee4d600640 1 -- 172.21.15.5:0/2861746218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee400070d0 con 0x55fdbce328c0 2024-08-18T22:24:12.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 -- 172.21.15.5:0/2861746218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce328c0 msgr2=0x55fdbcde8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 --2- 172.21.15.5:0/2861746218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce328c0 0x55fdbcde8860 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fee40001390 tx=0x7fee40007d90 comp rx=0 tx=0).stop 2024-08-18T22:24:12.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 -- 172.21.15.5:0/2861746218 shutdown_connections 2024-08-18T22:24:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 --2- 172.21.15.5:0/2861746218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbcde8da0 0x55fdbcde9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 --2- 172.21.15.5:0/2861746218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce328c0 0x55fdbcde8860 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 --2- 172.21.15.5:0/2861746218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbce31fa0 0x55fdbce32380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 -- 172.21.15.5:0/2861746218 >> 172.21.15.5:0/2861746218 conn(0x55fdbcde0910 msgr2=0x55fdbcde2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 -- 172.21.15.5:0/2861746218 shutdown_connections 2024-08-18T22:24:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.946+0000 7fee62b56000 1 -- 172.21.15.5:0/2861746218 wait complete. 2024-08-18T22:24:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 -- start start 2024-08-18T22:24:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 Processor -- start 2024-08-18T22:24:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde8da0 0x55fdbce1c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce31fa0 0x55fdbce1cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce328c0 0x55fdbce1d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fdbcbd8e40 con 0x55fdbce31fa0 2024-08-18T22:24:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fdbcceeaf0 con 0x55fdbcde8da0 2024-08-18T22:24:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fdbcc93450 con 0x55fdbce328c0 2024-08-18T22:24:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 10 client.0 _ll_register_callbacks cb 0x55fdbcdcf630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:24:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce31fa0 0x55fdbce1cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce31fa0 0x55fdbce1cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46220/0 (socket says 172.21.15.5:46220) 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee4fe00640 1 -- 172.21.15.5:0/3250932237 learned_addr learned my addr 172.21.15.5:0/3250932237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee5d600640 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce328c0 0x55fdbce1d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee5cc00640 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde8da0 0x55fdbce1c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee4fe00640 1 -- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce328c0 msgr2=0x55fdbce1d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee4fe00640 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce328c0 0x55fdbce1d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee4fe00640 1 -- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde8da0 msgr2=0x55fdbce1c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee4fe00640 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde8da0 0x55fdbce1c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee4fe00640 1 -- 172.21.15.5:0/3250932237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdbcbb8fd0 con 0x55fdbce31fa0 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee5cc00640 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde8da0 0x55fdbce1c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee5d600640 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce328c0 0x55fdbce1d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee4fe00640 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce31fa0 0x55fdbce1cae0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fee40017040 tx=0x7fee40000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f622ee1605f1e2f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee46000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee46000640 1 -- 172.21.15.5:0/3250932237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40019040 con 0x55fdbce31fa0 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee46000640 1 -- 172.21.15.5:0/3250932237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7fee40007480 con 0x55fdbce31fa0 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 -- 172.21.15.5:0/3250932237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee40005af0 con 0x55fdbce31fa0 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee46000640 1 -- 172.21.15.5:0/3250932237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fee4002c050 con 0x55fdbce31fa0 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 10 client.7080 fetch_fsmap learned FSMap version 63 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 -- 172.21.15.5:0/3250932237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x55fdbccb44d0 con 0x55fdbce31fa0 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee46000640 1 -- 172.21.15.5:0/3250932237 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40005af0 con 0x55fdbce31fa0 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee46000640 1 -- 172.21.15.5:0/3250932237 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7fee4002f020 con 0x55fdbce31fa0 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 10 client.7080 fetch_fsmap finished waiting for FSMap version 63 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 10 client.7080 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 20 client.7080 populate_metadata read hostname 'smithi005' 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x55fdbce1da30 0x55fdbce43250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 4 client.7080 mds_command: new command op to 6589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:24:12.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.950+0000 7fee62b56000 1 -- 172.21.15.5:0/3250932237 --> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdbcbcbc00 con 0x55fdbce1da30 2024-08-18T22:24:12.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee5cc00640 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x55fdbce1da30 0x55fdbce43250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee5cc00640 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x55fdbce1da30 0x55fdbce43250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bf36ac704030d9f server_cookie=171c1e3211977c0 in_seq=0 out_seq=0 2024-08-18T22:24:12.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee46000640 10 client.7080 ms_handle_connect on v2:172.21.15.117:6834/349592920 2024-08-18T22:24:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee46000640 1 -- 172.21.15.5:0/3250932237 <== mds.0 v2:172.21.15.117:6834/349592920 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fdbcbcbc00 con 0x55fdbce1da30 2024-08-18T22:24:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee46000640 10 client.7080 handle_command_reply: tid=0 2024-08-18T22:24:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 1 client.7080 shutdown 2024-08-18T22:24:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 1 -- 172.21.15.5:0/3250932237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce31fa0 msgr2=0x55fdbce1cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce31fa0 0x55fdbce1cae0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fee40017040 tx=0x7fee40000ee0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 1 -- 172.21.15.5:0/3250932237 shutdown_connections 2024-08-18T22:24:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce328c0 0x55fdbce1d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbce31fa0 0x55fdbce1cae0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x55fdbce1da30 0x55fdbce43250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 1 --2- 172.21.15.5:0/3250932237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde8da0 0x55fdbce1c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 1 -- 172.21.15.5:0/3250932237 >> 172.21.15.5:0/3250932237 conn(0x55fdbcde0910 msgr2=0x55fdbcde99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee46000640 0 client.7080 ms_handle_reset on v2:172.21.15.117:6834/349592920 2024-08-18T22:24:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 1 -- 172.21.15.5:0/3250932237 shutdown_connections 2024-08-18T22:24:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 1 -- 172.21.15.5:0/3250932237 wait complete. 2024-08-18T22:24:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.954+0000 7fee62b56000 20 client.7080 trim_cache size 0 max 16384 2024-08-18T22:24:12.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 Processor -- start 2024-08-18T22:24:12.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 -- start start 2024-08-18T22:24:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde0910 0x55fdbcdefb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbcdf0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce31fa0 0x55fdbce43250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fee58073380 con 0x55fdbcde8da0 2024-08-18T22:24:12.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fee581572c0 con 0x55fdbcde0910 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fee58072d30 con 0x55fdbce31fa0 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbcdf0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbcdf0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46230/0 (socket says 172.21.15.5:46230) 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4fe00640 1 -- 172.21.15.5:0/2803199002 learned_addr learned my addr 172.21.15.5:0/2803199002 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee5d600640 1 --2- 172.21.15.5:0/2803199002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce31fa0 0x55fdbce43250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee5cc00640 1 --2- 172.21.15.5:0/2803199002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde0910 0x55fdbcdefb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4fe00640 1 -- 172.21.15.5:0/2803199002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce31fa0 msgr2=0x55fdbce43250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4fe00640 1 --2- 172.21.15.5:0/2803199002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce31fa0 0x55fdbce43250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4fe00640 1 -- 172.21.15.5:0/2803199002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde0910 msgr2=0x55fdbcdefb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4fe00640 1 --2- 172.21.15.5:0/2803199002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde0910 0x55fdbcdefb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4fe00640 1 -- 172.21.15.5:0/2803199002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbcc2ab30 con 0x55fdbcde8da0 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee5cc00640 1 --2- 172.21.15.5:0/2803199002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde0910 0x55fdbcdefb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:12.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee5d600640 1 --2- 172.21.15.5:0/2803199002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce31fa0 0x55fdbce43250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4fe00640 1 --2- 172.21.15.5:0/2803199002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbcdf0050 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fee40000eb0 tx=0x7fee4001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969742e4eef6eb35 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4cc00640 1 -- 172.21.15.5:0/2803199002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40019070 con 0x55fdbcde8da0 2024-08-18T22:24:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4cc00640 1 -- 172.21.15.5:0/2803199002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40005af0 con 0x55fdbcde8da0 2024-08-18T22:24:12.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee4cc00640 1 -- 172.21.15.5:0/2803199002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40007500 con 0x55fdbcde8da0 2024-08-18T22:24:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 -- 172.21.15.5:0/2803199002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 msgr2=0x55fdbcdf0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 --2- 172.21.15.5:0/2803199002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbcdf0050 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fee40000eb0 tx=0x7fee4001d000 comp rx=0 tx=0).stop 2024-08-18T22:24:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 -- 172.21.15.5:0/2803199002 shutdown_connections 2024-08-18T22:24:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 --2- 172.21.15.5:0/2803199002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbce31fa0 0x55fdbce43250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 --2- 172.21.15.5:0/2803199002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbcdf0050 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 --2- 172.21.15.5:0/2803199002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbcde0910 0x55fdbcdefb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 -- 172.21.15.5:0/2803199002 >> 172.21.15.5:0/2803199002 conn(0x55fdbcde9a90 msgr2=0x55fdbcde3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 -- 172.21.15.5:0/2803199002 shutdown_connections 2024-08-18T22:24:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.974+0000 7fee62b56000 1 -- 172.21.15.5:0/2803199002 wait complete. 2024-08-18T22:24:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 -- start start 2024-08-18T22:24:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 Processor -- start 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbcde0910 0x55fdbce46680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbce61540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbce31fa0 0x55fdbce61a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fdbcbc8900 con 0x55fdbcde8da0 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fdbcc359f0 con 0x55fdbce31fa0 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55fdbcbea1d0 con 0x55fdbcde0910 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 10 client.0 _ll_register_callbacks cb 0x7fee40017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbce61540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbce61540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46244/0 (socket says 172.21.15.5:46244) 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee4fe00640 1 -- 172.21.15.5:0/1704604527 learned_addr learned my addr 172.21.15.5:0/1704604527 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee5cc00640 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbcde0910 0x55fdbce46680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee5d600640 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbce31fa0 0x55fdbce61a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee4fe00640 1 -- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbcde0910 msgr2=0x55fdbce46680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:12.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee4fe00640 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbcde0910 0x55fdbce46680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee4fe00640 1 -- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbce31fa0 msgr2=0x55fdbce61a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee4fe00640 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbce31fa0 0x55fdbce61a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee4fe00640 1 -- 172.21.15.5:0/1704604527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdbcbe2810 con 0x55fdbcde8da0 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee5d600640 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbce31fa0 0x55fdbce61a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee4fe00640 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbce61540 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fee40007820 tx=0x7fee40009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5be58f9d091226a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee46000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee46000640 1 -- 172.21.15.5:0/1704604527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40034020 con 0x55fdbcde8da0 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee46000640 1 -- 172.21.15.5:0/1704604527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7fee4000e630 con 0x55fdbcde8da0 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 -- 172.21.15.5:0/1704604527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee40005af0 con 0x55fdbcde8da0 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee46000640 1 -- 172.21.15.5:0/1704604527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fee4003e050 con 0x55fdbcde8da0 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 10 client.7086 fetch_fsmap learned FSMap version 63 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 -- 172.21.15.5:0/1704604527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x55fdbcbc7d30 con 0x55fdbcde8da0 2024-08-18T22:24:12.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee46000640 1 -- 172.21.15.5:0/1704604527 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40005af0 con 0x55fdbcde8da0 2024-08-18T22:24:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee46000640 1 -- 172.21.15.5:0/1704604527 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7fee40041020 con 0x55fdbcde8da0 2024-08-18T22:24:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 10 client.7086 fetch_fsmap finished waiting for FSMap version 63 2024-08-18T22:24:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 10 client.7086 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:24:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 20 client.7086 populate_metadata read hostname 'smithi005' 2024-08-18T22:24:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x55fdbce328c0 0x55fdbce61fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 4 client.7086 mds_command: new command op to 6589 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:24:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee62b56000 1 -- 172.21.15.5:0/1704604527 --> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] -- command(tid 0: {"prefix": "status"}) -- 0x55fdbcc3eaf0 con 0x55fdbce328c0 2024-08-18T22:24:12.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.978+0000 7fee5cc00640 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x55fdbce328c0 0x55fdbce61fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5cc00640 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x55fdbce328c0 0x55fdbce61fc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=647f9d2bda526067 server_cookie=d26a17d21cdec106 in_seq=0 out_seq=0 2024-08-18T22:24:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee46000640 10 client.7086 ms_handle_connect on v2:172.21.15.117:6834/349592920 2024-08-18T22:24:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee46000640 1 -- 172.21.15.5:0/1704604527 <== mds.0 v2:172.21.15.117:6834/349592920 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55fdbcc3eaf0 con 0x55fdbce328c0 2024-08-18T22:24:12.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee46000640 10 client.7086 handle_command_reply: tid=0 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 1 client.7086 shutdown 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 1 -- 172.21.15.5:0/1704604527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 msgr2=0x55fdbce61540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbce61540 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fee40007820 tx=0x7fee40009040 comp rx=0 tx=0).stop 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 1 -- 172.21.15.5:0/1704604527 shutdown_connections 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x55fdbce328c0 0x55fdbce61fc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fdbce31fa0 0x55fdbce61a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fdbcde8da0 0x55fdbce61540 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 1 --2- 172.21.15.5:0/1704604527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55fdbcde0910 0x55fdbce46680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee46000640 0 client.7086 ms_handle_reset on v2:172.21.15.117:6834/349592920 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 1 -- 172.21.15.5:0/1704604527 >> 172.21.15.5:0/1704604527 conn(0x55fdbcde9a90 msgr2=0x55fdbcdeeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 1 -- 172.21.15.5:0/1704604527 shutdown_connections 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 1 -- 172.21.15.5:0/1704604527 wait complete. 2024-08-18T22:24:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee62b56000 20 client.7086 trim_cache size 0 max 16384 2024-08-18T22:24:12.986 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:24:12.986 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:24:12.986 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:24:12.986 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6589, 2024-08-18T22:24:12.986 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:24:12.986 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:24:12.986 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:24:12.986 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 4.6637372880000001, 2024-08-18T22:24:12.986 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 63, 2024-08-18T22:24:12.986 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 86, 2024-08-18T22:24:12.986 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2024-08-18T22:24:12.987 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 5.0082670589999996 2024-08-18T22:24:12.987 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:24:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 -- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 msgr2=0x7fee34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 0x7fee34069d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fee480ad000 tx=0x7fee48008040 comp rx=0 tx=0).stop 2024-08-18T22:24:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 -- 172.21.15.5:0/1243584154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5814b1d0 msgr2=0x7fee58158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5814b1d0 0x7fee58158bd0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fee5000ef90 tx=0x7fee5000c490 comp rx=0 tx=0).stop 2024-08-18T22:24:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 -- 172.21.15.5:0/1243584154 shutdown_connections 2024-08-18T22:24:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 0x7fee34069d80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5814b1d0 0x7fee58158bd0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815d4d0 0x7fee5814ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 --2- 172.21.15.5:0/1243584154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee5815c180 0x7fee5814e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 -- 172.21.15.5:0/1243584154 >> 172.21.15.5:0/1243584154 conn(0x7fee580b1dc0 msgr2=0x7fee5814bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 -- 172.21.15.5:0/1243584154 shutdown_connections 2024-08-18T22:24:12.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:12.982+0000 7fee5f600640 1 -- 172.21.15.5:0/1243584154 wait complete. 2024-08-18T22:24:13.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:24:13.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb53400640 1 Processor -- start 2024-08-18T22:24:13.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb53400640 1 -- start start 2024-08-18T22:24:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb53400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb4c15a800 0x7feb4c0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb53400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4c0ce280 0x7feb4c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb53400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feb4c0ce6c0 0x7feb4c06ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb53400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7feb4c0cb5d0 con 0x7feb4c15a800 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb53400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7feb4c072e60 con 0x7feb4c0ce6c0 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb53400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb4c073140 con 0x7feb4c0ce280 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb50a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb4c15a800 0x7feb4c0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb50a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb4c15a800 0x7feb4c0caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46260/0 (socket says 172.21.15.5:46260) 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb50a00640 1 -- 172.21.15.5:0/3303137262 learned_addr learned my addr 172.21.15.5:0/3303137262 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb43e00640 1 --2- 172.21.15.5:0/3303137262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4c0ce280 0x7feb4c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb51400640 1 --2- 172.21.15.5:0/3303137262 >> v2:172.21.15.117:3300/0 conn(0x7feb4c0ce6c0 0x7feb4c06ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb50a00640 1 -- 172.21.15.5:0/3303137262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4c0ce280 msgr2=0x7feb4c06ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb50a00640 1 --2- 172.21.15.5:0/3303137262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4c0ce280 0x7feb4c06ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb50a00640 1 -- 172.21.15.5:0/3303137262 >> v2:172.21.15.117:3300/0 conn(0x7feb4c0ce6c0 msgr2=0x7feb4c06ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb50a00640 1 --2- 172.21.15.5:0/3303137262 >> v2:172.21.15.117:3300/0 conn(0x7feb4c0ce6c0 0x7feb4c06ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb50a00640 1 -- 172.21.15.5:0/3303137262 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c073420 con 0x7feb4c15a800 2024-08-18T22:24:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb43e00640 1 --2- 172.21.15.5:0/3303137262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4c0ce280 0x7feb4c06ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.142+0000 7feb51400640 1 --2- 172.21.15.5:0/3303137262 >> v2:172.21.15.117:3300/0 conn(0x7feb4c0ce6c0 0x7feb4c06ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:13.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb50a00640 1 --2- 172.21.15.5:0/3303137262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb4c15a800 0x7feb4c0caec0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0cff30 tx=0x7feb3c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866984875953b970 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:13.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb4be00640 1 -- 172.21.15.5:0/3303137262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0b0070 con 0x7feb4c15a800 2024-08-18T22:24:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb4be00640 1 -- 172.21.15.5:0/3303137262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb3c0ab600 con 0x7feb4c15a800 2024-08-18T22:24:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb4be00640 1 -- 172.21.15.5:0/3303137262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0ab9d0 con 0x7feb4c15a800 2024-08-18T22:24:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb53400640 1 -- 172.21.15.5:0/3303137262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb4c15a800 msgr2=0x7feb4c0caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb53400640 1 --2- 172.21.15.5:0/3303137262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb4c15a800 0x7feb4c0caec0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0cff30 tx=0x7feb3c01c520 comp rx=0 tx=0).stop 2024-08-18T22:24:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb53400640 1 -- 172.21.15.5:0/3303137262 shutdown_connections 2024-08-18T22:24:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb53400640 1 --2- 172.21.15.5:0/3303137262 >> v2:172.21.15.117:3300/0 conn(0x7feb4c0ce6c0 0x7feb4c06ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb53400640 1 --2- 172.21.15.5:0/3303137262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4c0ce280 0x7feb4c06ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb53400640 1 --2- 172.21.15.5:0/3303137262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb4c15a800 0x7feb4c0caec0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb53400640 1 -- 172.21.15.5:0/3303137262 >> 172.21.15.5:0/3303137262 conn(0x7feb4c0b1c50 msgr2=0x7feb4c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb53400640 1 -- 172.21.15.5:0/3303137262 shutdown_connections 2024-08-18T22:24:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.146+0000 7feb53400640 1 -- 172.21.15.5:0/3303137262 wait complete. 2024-08-18T22:24:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb53400640 1 Processor -- start 2024-08-18T22:24:13.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb53400640 1 -- start start 2024-08-18T22:24:13.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb53400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb4c0ce280 0x7feb4c157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:13.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb53400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb4c0ce6c0 0x7feb4c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:13.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb53400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4c15a800 0x7feb4c0aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb53400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c0726c0 con 0x7feb4c0ce280 2024-08-18T22:24:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb53400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c072540 con 0x7feb4c0ce6c0 2024-08-18T22:24:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb53400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb4c072840 con 0x7feb4c15a800 2024-08-18T22:24:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb50a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb4c0ce280 0x7feb4c157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb50a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb4c0ce280 0x7feb4c157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46264/0 (socket says 172.21.15.5:46264) 2024-08-18T22:24:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb50a00640 1 -- 172.21.15.5:0/3953762038 learned_addr learned my addr 172.21.15.5:0/3953762038 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb43e00640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb4c0ce6c0 0x7feb4c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb51400640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4c15a800 0x7feb4c0aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:13.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb50a00640 1 -- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4c15a800 msgr2=0x7feb4c0aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb50a00640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4c15a800 0x7feb4c0aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb50a00640 1 -- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb4c0ce6c0 msgr2=0x7feb4c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb50a00640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb4c0ce6c0 0x7feb4c09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb50a00640 1 -- 172.21.15.5:0/3953762038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c09b340 con 0x7feb4c0ce280 2024-08-18T22:24:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb50a00640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb4c0ce280 0x7feb4c157dc0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0ae040 tx=0x7feb3c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb49600640 1 -- 172.21.15.5:0/3953762038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0b0040 con 0x7feb4c0ce280 2024-08-18T22:24:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb49600640 1 -- 172.21.15.5:0/3953762038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb3c0b9070 con 0x7feb4c0ce280 2024-08-18T22:24:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb53400640 1 -- 172.21.15.5:0/3953762038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4c09b620 con 0x7feb4c0ce280 2024-08-18T22:24:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb49600640 1 -- 172.21.15.5:0/3953762038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0aab10 con 0x7feb4c0ce280 2024-08-18T22:24:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.150+0000 7feb53400640 1 -- 172.21.15.5:0/3953762038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c148510 con 0x7feb4c0ce280 2024-08-18T22:24:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.154+0000 7feb53400640 1 -- 172.21.15.5:0/3953762038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4c0caec0 con 0x7feb4c0ce280 2024-08-18T22:24:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.154+0000 7feb49600640 1 -- 172.21.15.5:0/3953762038 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb3c0ab4c0 con 0x7feb4c0ce280 2024-08-18T22:24:13.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.154+0000 7feb49600640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb280678c0 0x7feb28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:13.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.154+0000 7feb49600640 1 -- 172.21.15.5:0/3953762038 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7feb3c120850 con 0x7feb4c0ce280 2024-08-18T22:24:13.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.154+0000 7feb43e00640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb280678c0 0x7feb28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:13.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.154+0000 7feb43e00640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb280678c0 0x7feb28069d80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0ca210 tx=0x7feb34012040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:13.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.158+0000 7feb49600640 1 -- 172.21.15.5:0/3953762038 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7feb3c016110 con 0x7feb4c0ce280 2024-08-18T22:24:13.319 INFO:tasks.ceph.mds.b.smithi117.stderr:2024-08-18T22:24:13.316+0000 7fb397e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:24:13.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.358+0000 7feb53400640 1 -- 172.21.15.5:0/3953762038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7feb4c0cd910 con 0x7feb4c0ce280 2024-08-18T22:24:13.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.358+0000 7feb49600640 1 -- 172.21.15.5:0/3953762038 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) ==== 53+0+73 (secure 0 0 0) 0x7feb3c0f0c90 con 0x7feb4c0ce280 2024-08-18T22:24:13.360 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:24:13.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 -- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb280678c0 msgr2=0x7feb28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:13.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb280678c0 0x7feb28069d80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0ca210 tx=0x7feb34012040 comp rx=0 tx=0).stop 2024-08-18T22:24:13.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 -- 172.21.15.5:0/3953762038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb4c0ce280 msgr2=0x7feb4c157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:13.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb4c0ce280 0x7feb4c157dc0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0ae040 tx=0x7feb3c0192c0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 -- 172.21.15.5:0/3953762038 shutdown_connections 2024-08-18T22:24:13.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb280678c0 0x7feb28069d80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4c15a800 0x7feb4c0aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb4c0ce6c0 0x7feb4c09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 --2- 172.21.15.5:0/3953762038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb4c0ce280 0x7feb4c157dc0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 -- 172.21.15.5:0/3953762038 >> 172.21.15.5:0/3953762038 conn(0x7feb4c0b1c50 msgr2=0x7feb4c06e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 -- 172.21.15.5:0/3953762038 shutdown_connections 2024-08-18T22:24:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13.362+0000 7feb53400640 1 -- 172.21.15.5:0/3953762038 wait complete. 2024-08-18T22:24:13.381 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:24:13.381 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:24:13.381 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:24:13.381 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:24:13.381 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:13.381 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:24:13.382 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:24:13.382 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:24:13.382 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:24:13.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:13.382 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:24:13.391 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:24:13.391 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:24:13.391 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:24:13.391 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:13.391 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:24:13.391 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:13.391 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:24:13.391 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:13.391 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:24:13.391 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:24:13.391 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42148sec preferred_lft 42148sec 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:13.392 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:24:13.393 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:24:13.394 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:13.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:13.395 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:24:13.454 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:24:13.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:13.456 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:24:13.510 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:24:13.510 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:24:13.510 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:24:13.510 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:24:13.511 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:24:13.511 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:24:13.511 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:24:13.511 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:24:13.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:24:13.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:24:13.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:24:13.511 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:24:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:24:13.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:24:13.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:13.649 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:24:13.659 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:24:13.659 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:24:13.659 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:24:13.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:13.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:24:13.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:24:13.720 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:13.776 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:24:13.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:24:13.777 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:13.828 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:24:13.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:13.828 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:13.921 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:13.921 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:24:13.921 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:24:13.936 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:13.936 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:24:13.936 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:24:13.937 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:24:13.937 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:24:13.946 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:13.946 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:24:13.946 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:24:13.947 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:24:13.947 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:24:13.947 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:24:13.947 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:24:13.947 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:24:13.951 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:24:13.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:13.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:13.971 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:24:14.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:24:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:24:14.070 INFO:teuthology.orchestra.run.smithi005.stdout:client6643 2024-08-18T22:24:14.070 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:14.070 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:14.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:14.121 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-08-18T22:24:14.173 INFO:teuthology.orchestra.run.smithi005.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-08-18T22:24:14.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:24:14.175 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-08-18T22:24:14.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /scrub_repair_path repair 2024-08-18T22:24:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.362+0000 7fb30f600640 1 Processor -- start 2024-08-18T22:24:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.362+0000 7fb30f600640 1 -- start start 2024-08-18T22:24:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.362+0000 7fb30f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3080b6330 0x7fb30806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.362+0000 7fb30f600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3080b4210 con 0x7fb3080b2800 2024-08-18T22:24:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.362+0000 7fb30f600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3080b44f0 con 0x7fb30815e470 2024-08-18T22:24:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.362+0000 7fb30f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb30806c900 con 0x7fb3080b6330 2024-08-18T22:24:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.362+0000 7fb2ffe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3080b2800 0x7fb30815f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50914/0 (socket says 172.21.15.5:50914) 2024-08-18T22:24:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.362+0000 7fb2ffe00640 1 -- 172.21.15.5:0/2540658508 learned_addr learned my addr 172.21.15.5:0/2540658508 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.362+0000 7fb30d600640 1 --2- 172.21.15.5:0/2540658508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3080b6330 0x7fb30806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb307e00640 1 -- 172.21.15.5:0/2540658508 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528086653 0 0) 0x7fb3080b44f0 con 0x7fb30815e470 2024-08-18T22:24:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb307e00640 1 -- 172.21.15.5:0/2540658508 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2ec003530 con 0x7fb30815e470 2024-08-18T22:24:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb307e00640 1 -- 172.21.15.5:0/2540658508 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1433994334 0 0) 0x7fb3080b4210 con 0x7fb3080b2800 2024-08-18T22:24:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb30d600640 1 -- 172.21.15.5:0/2540658508 >> v1:172.21.15.117:6789/0 conn(0x7fb30815e470 legacy=0x7fb3080b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb30d600640 1 -- 172.21.15.5:0/2540658508 >> v1:172.21.15.5:6789/0 conn(0x7fb3080b2800 legacy=0x7fb30815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb30d600640 1 -- 172.21.15.5:0/2540658508 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30815ec80 con 0x7fb3080b6330 2024-08-18T22:24:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb30d600640 1 --2- 172.21.15.5:0/2540658508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3080b6330 0x7fb30806c3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb300009dc0 tx=0x7fb30001c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9ac37a2cc48ee1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb307e00640 1 -- 172.21.15.5:0/2540658508 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3000b2070 con 0x7fb3080b6330 2024-08-18T22:24:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb307e00640 1 -- 172.21.15.5:0/2540658508 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3000a58d0 con 0x7fb3080b6330 2024-08-18T22:24:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb307e00640 1 -- 172.21.15.5:0/2540658508 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3000a5ca0 con 0x7fb3080b6330 2024-08-18T22:24:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb30f600640 1 -- 172.21.15.5:0/2540658508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3080b6330 msgr2=0x7fb30806c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.366+0000 7fb30f600640 1 --2- 172.21.15.5:0/2540658508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3080b6330 0x7fb30806c3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb300009dc0 tx=0x7fb30001c900 comp rx=0 tx=0).stop 2024-08-18T22:24:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 -- 172.21.15.5:0/2540658508 shutdown_connections 2024-08-18T22:24:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 --2- 172.21.15.5:0/2540658508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3080b6330 0x7fb30806c3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 -- 172.21.15.5:0/2540658508 >> 172.21.15.5:0/2540658508 conn(0x7fb3080732a0 msgr2=0x7fb3080b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 -- 172.21.15.5:0/2540658508 shutdown_connections 2024-08-18T22:24:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 -- 172.21.15.5:0/2540658508 wait complete. 2024-08-18T22:24:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 Processor -- start 2024-08-18T22:24:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 -- start start 2024-08-18T22:24:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3080b2800 0x7fb30814d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3080b6330 0x7fb30814d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb30815e470 0x7fb3081552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb308160770 con 0x7fb3080b2800 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081605f0 con 0x7fb3080b6330 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb30816c330 con 0x7fb30815e470 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3080b2800 0x7fb30814d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3080b2800 0x7fb30814d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39168/0 (socket says 172.21.15.5:39168) 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30cc00640 1 -- 172.21.15.5:0/3764889943 learned_addr learned my addr 172.21.15.5:0/3764889943 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb2ffe00640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3080b6330 0x7fb30814d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30d600640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb30815e470 0x7fb3081552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30cc00640 1 -- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb30815e470 msgr2=0x7fb3081552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30cc00640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb30815e470 0x7fb3081552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30cc00640 1 -- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3080b6330 msgr2=0x7fb30814d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30cc00640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3080b6330 0x7fb30814d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30cc00640 1 -- 172.21.15.5:0/3764889943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb308161c00 con 0x7fb3080b2800 2024-08-18T22:24:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.370+0000 7fb30cc00640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3080b2800 0x7fb30814d970 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800c490 tx=0x7fb2f800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.374+0000 7fb305600640 1 -- 172.21.15.5:0/3764889943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80052d0 con 0x7fb3080b2800 2024-08-18T22:24:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.374+0000 7fb305600640 1 -- 172.21.15.5:0/3764889943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f8005470 con 0x7fb3080b2800 2024-08-18T22:24:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.374+0000 7fb30f600640 1 -- 172.21.15.5:0/3764889943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30814ef90 con 0x7fb3080b2800 2024-08-18T22:24:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.374+0000 7fb305600640 1 -- 172.21.15.5:0/3764889943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8012870 con 0x7fb3080b2800 2024-08-18T22:24:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.374+0000 7fb30f600640 1 -- 172.21.15.5:0/3764889943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30814f230 con 0x7fb3080b2800 2024-08-18T22:24:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.374+0000 7fb305600640 1 -- 172.21.15.5:0/3764889943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb2f8012a10 con 0x7fb3080b2800 2024-08-18T22:24:14.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.374+0000 7fb305600640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2e40678c0 0x7fb2e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.374+0000 7fb305600640 1 -- 172.21.15.5:0/3764889943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7fb2f8085a00 con 0x7fb3080b2800 2024-08-18T22:24:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.374+0000 7fb2ffe00640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2e40678c0 0x7fb2e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.374+0000 7fb312b83000 1 Processor -- start 2024-08-18T22:24:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.374+0000 7fb312b83000 1 -- start start 2024-08-18T22:24:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb2ffe00640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2e40678c0 0x7fb2e4069d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb308070c40 tx=0x7fb2f0007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa8dcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dd050 0x559afa88f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa890220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559afa779750 con 0x559afa8dc730 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559afa6e0630 con 0x559afa88fe40 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559afa69aad0 con 0x559afa8dd050 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb30cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa8dcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb30cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa8dcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39176/0 (socket says 172.21.15.5:39176) 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb30cc00640 1 -- 172.21.15.5:0/4087411998 learned_addr learned my addr 172.21.15.5:0/4087411998 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb30d600640 1 --2- 172.21.15.5:0/4087411998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa890220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb2ffe00640 1 --2- 172.21.15.5:0/4087411998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dd050 0x559afa88f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb30cc00640 1 -- 172.21.15.5:0/4087411998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dd050 msgr2=0x559afa88f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb30cc00640 1 --2- 172.21.15.5:0/4087411998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dd050 0x559afa88f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb30cc00640 1 -- 172.21.15.5:0/4087411998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 msgr2=0x559afa890220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb30cc00640 1 --2- 172.21.15.5:0/4087411998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa890220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb30cc00640 1 -- 172.21.15.5:0/4087411998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559afa6bdc20 con 0x559afa8dc730 2024-08-18T22:24:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb30cc00640 1 --2- 172.21.15.5:0/4087411998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa8dcb10 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8052100 tx=0x7fb2f8059fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9699c3b438d22b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb2fd600640 1 -- 172.21.15.5:0/4087411998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8082070 con 0x559afa8dc730 2024-08-18T22:24:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb2fd600640 1 -- 172.21.15.5:0/4087411998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f806d070 con 0x559afa8dc730 2024-08-18T22:24:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb2fd600640 1 -- 172.21.15.5:0/4087411998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8012d00 con 0x559afa8dc730 2024-08-18T22:24:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 -- 172.21.15.5:0/4087411998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 msgr2=0x559afa8dcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 --2- 172.21.15.5:0/4087411998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa8dcb10 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8052100 tx=0x7fb2f8059fa0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 -- 172.21.15.5:0/4087411998 shutdown_connections 2024-08-18T22:24:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 --2- 172.21.15.5:0/4087411998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa890220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 --2- 172.21.15.5:0/4087411998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dd050 0x559afa88f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 --2- 172.21.15.5:0/4087411998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa8dcb10 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 -- 172.21.15.5:0/4087411998 >> 172.21.15.5:0/4087411998 conn(0x559afa8bd5b0 msgr2=0x559afa8bf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 -- 172.21.15.5:0/4087411998 shutdown_connections 2024-08-18T22:24:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 -- 172.21.15.5:0/4087411998 wait complete. 2024-08-18T22:24:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 -- start start 2024-08-18T22:24:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.378+0000 7fb312b83000 1 Processor -- start 2024-08-18T22:24:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa895a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dc730 0x559afa895f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8964b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559afa681c80 con 0x559afa8dd050 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559afa6dc5f0 con 0x559afa88fe40 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559afa6ab770 con 0x559afa8dc730 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 10 client.0 _ll_register_callbacks cb 0x559afa87dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39192/0 (socket says 172.21.15.5:39192) 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30d600640 1 -- 172.21.15.5:0/3538606230 learned_addr learned my addr 172.21.15.5:0/3538606230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30cc00640 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa895a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb2ffe00640 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dc730 0x559afa895f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30d600640 1 -- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dc730 msgr2=0x559afa895f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30d600640 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dc730 0x559afa895f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30d600640 1 -- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 msgr2=0x559afa895a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30d600640 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa895a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30d600640 1 -- 172.21.15.5:0/3538606230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559afa7267b0 con 0x559afa8dd050 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30d600640 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8964b0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb30001c940 tx=0x7fb30001b140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41e538b758844f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb2f6000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb2f6000640 1 -- 172.21.15.5:0/3538606230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3000b2040 con 0x559afa8dd050 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 1 -- 172.21.15.5:0/3538606230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2f806d070 con 0x559afa8dd050 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb2f6000640 1 -- 172.21.15.5:0/3538606230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7fb3000c4d20 con 0x559afa8dd050 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb2f6000640 1 -- 172.21.15.5:0/3538606230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fb3000a56d0 con 0x559afa8dd050 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 10 client.7104 fetch_fsmap learned FSMap version 63 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 1 -- 172.21.15.5:0/3538606230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x559afa6ba290 con 0x559afa8dd050 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb2f6000640 1 -- 172.21.15.5:0/3538606230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f806d070 con 0x559afa8dd050 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb2f6000640 1 -- 172.21.15.5:0/3538606230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7fb3000cb050 con 0x559afa8dd050 2024-08-18T22:24:14.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 10 client.7104 fetch_fsmap finished waiting for FSMap version 63 2024-08-18T22:24:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 10 client.7104 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-08-18T22:24:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 20 client.7104 populate_metadata read hostname 'smithi005' 2024-08-18T22:24:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x559afa8ec7d0 0x559afa8eebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 4 client.7104 mds_command: new command op to 6589 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:24:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb312b83000 1 -- 172.21.15.5:0/3538606230 --> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559afa67af20 con 0x559afa8ec7d0 2024-08-18T22:24:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30cc00640 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x559afa8ec7d0 0x559afa8eebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb30cc00640 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x559afa8ec7d0 0x559afa8eebc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a005ce1b3a4e8d7 server_cookie=1e1df55a09392cc in_seq=0 out_seq=0 2024-08-18T22:24:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.382+0000 7fb2f6000640 10 client.7104 ms_handle_connect on v2:172.21.15.117:6834/349592920 2024-08-18T22:24:14.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb2f6000640 1 -- 172.21.15.5:0/3538606230 <== mds.0 v2:172.21.15.117:6834/349592920 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559afa67af20 con 0x559afa8ec7d0 2024-08-18T22:24:14.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb2f6000640 10 client.7104 handle_command_reply: tid=0 2024-08-18T22:24:14.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 1 client.7104 shutdown 2024-08-18T22:24:14.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 1 -- 172.21.15.5:0/3538606230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 msgr2=0x559afa8964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8964b0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb30001c940 tx=0x7fb30001b140 comp rx=0 tx=0).stop 2024-08-18T22:24:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 1 -- 172.21.15.5:0/3538606230 shutdown_connections 2024-08-18T22:24:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8964b0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dc730 0x559afa895f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x559afa8ec7d0 0x559afa8eebc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 1 --2- 172.21.15.5:0/3538606230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa895a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb2f6000640 0 client.7104 ms_handle_reset on v2:172.21.15.117:6834/349592920 2024-08-18T22:24:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 1 -- 172.21.15.5:0/3538606230 >> 172.21.15.5:0/3538606230 conn(0x559afa8bd5b0 msgr2=0x559afa88f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 1 -- 172.21.15.5:0/3538606230 shutdown_connections 2024-08-18T22:24:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 1 -- 172.21.15.5:0/3538606230 wait complete. 2024-08-18T22:24:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.386+0000 7fb312b83000 20 client.7104 trim_cache size 0 max 16384 2024-08-18T22:24:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.402+0000 7fb312b83000 1 Processor -- start 2024-08-18T22:24:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.402+0000 7fb312b83000 1 -- start start 2024-08-18T22:24:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.402+0000 7fb312b83000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa88f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.402+0000 7fb312b83000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dc730 0x559afa8bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.402+0000 7fb312b83000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.402+0000 7fb312b83000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb308203c30 con 0x559afa8dd050 2024-08-18T22:24:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.402+0000 7fb312b83000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb308202c10 con 0x559afa88fe40 2024-08-18T22:24:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.402+0000 7fb312b83000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb3081503f0 con 0x559afa8dc730 2024-08-18T22:24:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.402+0000 7fb30d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.402+0000 7fb30d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39206/0 (socket says 172.21.15.5:39206) 2024-08-18T22:24:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.402+0000 7fb30d600640 1 -- 172.21.15.5:0/3260053201 learned_addr learned my addr 172.21.15.5:0/3260053201 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb30cc00640 1 --2- 172.21.15.5:0/3260053201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa88f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2ffe00640 1 --2- 172.21.15.5:0/3260053201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dc730 0x559afa8bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb30d600640 1 -- 172.21.15.5:0/3260053201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dc730 msgr2=0x559afa8bf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb30d600640 1 --2- 172.21.15.5:0/3260053201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dc730 0x559afa8bf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb30d600640 1 -- 172.21.15.5:0/3260053201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 msgr2=0x559afa88f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb30d600640 1 --2- 172.21.15.5:0/3260053201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa88f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb30d600640 1 -- 172.21.15.5:0/3260053201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559afa8932b0 con 0x559afa8dd050 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2ffe00640 1 --2- 172.21.15.5:0/3260053201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dc730 0x559afa8bf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb30d600640 1 --2- 172.21.15.5:0/3260053201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8bfee0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb3000b0040 tx=0x7fb3000bc070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e339ce38434147b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2fcc00640 1 -- 172.21.15.5:0/3260053201 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3000b2040 con 0x559afa8dd050 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2fcc00640 1 -- 172.21.15.5:0/3260053201 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3000a5a50 con 0x559afa8dd050 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2fcc00640 1 -- 172.21.15.5:0/3260053201 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3000a5e40 con 0x559afa8dd050 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 -- 172.21.15.5:0/3260053201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 msgr2=0x559afa8bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 --2- 172.21.15.5:0/3260053201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8bfee0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb3000b0040 tx=0x7fb3000bc070 comp rx=0 tx=0).stop 2024-08-18T22:24:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 -- 172.21.15.5:0/3260053201 shutdown_connections 2024-08-18T22:24:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 --2- 172.21.15.5:0/3260053201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dd050 0x559afa8bfee0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 --2- 172.21.15.5:0/3260053201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dc730 0x559afa8bf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 --2- 172.21.15.5:0/3260053201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa88f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 -- 172.21.15.5:0/3260053201 >> 172.21.15.5:0/3260053201 conn(0x559afa8bd5b0 msgr2=0x559afa8dbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 -- 172.21.15.5:0/3260053201 shutdown_connections 2024-08-18T22:24:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 -- 172.21.15.5:0/3260053201 wait complete. 2024-08-18T22:24:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 -- start start 2024-08-18T22:24:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 Processor -- start 2024-08-18T22:24:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa950900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa950e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dd050 0x559afa951380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559afa79ca10 con 0x559afa8dc730 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb30815a2d0 con 0x559afa88fe40 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559afa6df940 con 0x559afa8dd050 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb312b83000 10 client.0 _ll_register_callbacks cb 0x7fb2ec003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa950e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa950e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39222/0 (socket says 172.21.15.5:39222) 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2ffe00640 1 -- 172.21.15.5:0/4253036802 learned_addr learned my addr 172.21.15.5:0/4253036802 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb30cc00640 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa950900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb30d600640 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dd050 0x559afa951380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2ffe00640 1 -- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dd050 msgr2=0x559afa951380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2ffe00640 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dd050 0x559afa951380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2ffe00640 1 -- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 msgr2=0x559afa950900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2ffe00640 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa950900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.406+0000 7fb2ffe00640 1 -- 172.21.15.5:0/4253036802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559afa7394d0 con 0x559afa8dc730 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb2ffe00640 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa950e40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0013740 tx=0x7fb2f0007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be2638dc8648a6e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb2f6000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb2f6000640 1 -- 172.21.15.5:0/4253036802 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f00227a0 con 0x559afa8dc730 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb2f6000640 1 -- 172.21.15.5:0/4253036802 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7fb2f0022940 con 0x559afa8dc730 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 -- 172.21.15.5:0/4253036802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3000a5a50 con 0x559afa8dc730 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb2f6000640 1 -- 172.21.15.5:0/4253036802 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7fb2f0033050 con 0x559afa8dc730 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 10 client.7110 fetch_fsmap learned FSMap version 63 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 -- 172.21.15.5:0/4253036802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x559afa673fa0 con 0x559afa8dc730 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb2f6000640 1 -- 172.21.15.5:0/4253036802 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3000a5a50 con 0x559afa8dc730 2024-08-18T22:24:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb2f6000640 1 -- 172.21.15.5:0/4253036802 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7fb2f0036020 con 0x559afa8dc730 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 10 client.7110 fetch_fsmap finished waiting for FSMap version 63 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 10 client.7110 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 20 client.7110 populate_metadata read hostname 'smithi005' 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x559afa8f0520 0x559afa8f0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 4 client.7110 mds_command: new command op to 6589 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 -- 172.21.15.5:0/4253036802 --> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) -- 0x559afa6edd60 con 0x559afa8f0520 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30cc00640 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x559afa8f0520 0x559afa8f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30cc00640 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x559afa8f0520 0x559afa8f0930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87d55db972a6e4f server_cookie=26a32de0aba924d in_seq=0 out_seq=0 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb2f6000640 10 client.7110 ms_handle_connect on v2:172.21.15.117:6834/349592920 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb2f6000640 1 -- 172.21.15.5:0/4253036802 <== mds.0 v2:172.21.15.117:6834/349592920 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559afa6edd60 con 0x559afa8f0520 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb2f6000640 10 client.7110 handle_command_reply: tid=0 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 client.7110 shutdown 2024-08-18T22:24:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 -- 172.21.15.5:0/4253036802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 msgr2=0x559afa950e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa950e40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0013740 tx=0x7fb2f0007e50 comp rx=0 tx=0).stop 2024-08-18T22:24:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 -- 172.21.15.5:0/4253036802 shutdown_connections 2024-08-18T22:24:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559afa8dd050 0x559afa951380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559afa8dc730 0x559afa950e40 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:6834/349592920,v1:172.21.15.117:6835/349592920] conn(0x559afa8f0520 0x559afa8f0930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 --2- 172.21.15.5:0/4253036802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559afa88fe40 0x559afa950900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 -- 172.21.15.5:0/4253036802 >> 172.21.15.5:0/4253036802 conn(0x559afa8bd5b0 msgr2=0x559afa897250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb2f6000640 0 client.7110 ms_handle_reset on v2:172.21.15.117:6834/349592920 2024-08-18T22:24:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 -- 172.21.15.5:0/4253036802 shutdown_connections 2024-08-18T22:24:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 1 -- 172.21.15.5:0/4253036802 wait complete. 2024-08-18T22:24:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb312b83000 20 client.7110 trim_cache size 0 max 16384 2024-08-18T22:24:14.416 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:24:14.416 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:24:14.416 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "9168bf75-30db-43e9-8218-637804d3e428", 2024-08-18T22:24:14.416 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:24:14.416 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30f600640 1 -- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2e40678c0 msgr2=0x7fb2e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30f600640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2e40678c0 0x7fb2e4069d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb308070c40 tx=0x7fb2f0007240 comp rx=0 tx=0).stop 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30f600640 1 -- 172.21.15.5:0/3764889943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3080b2800 msgr2=0x7fb30814d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30f600640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3080b2800 0x7fb30814d970 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800c490 tx=0x7fb2f800c950 comp rx=0 tx=0).stop 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30f600640 1 -- 172.21.15.5:0/3764889943 shutdown_connections 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30f600640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2e40678c0 0x7fb2e4069d80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30f600640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb30815e470 0x7fb3081552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30f600640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3080b6330 0x7fb30814d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30f600640 1 --2- 172.21.15.5:0/3764889943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3080b2800 0x7fb30814d970 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.410+0000 7fb30f600640 1 -- 172.21.15.5:0/3764889943 >> 172.21.15.5:0/3764889943 conn(0x7fb3080732a0 msgr2=0x7fb30815bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.414+0000 7fb30f600640 1 -- 172.21.15.5:0/3764889943 shutdown_connections 2024-08-18T22:24:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:14.414+0000 7fb30f600640 1 -- 172.21.15.5:0/3764889943 wait complete. 2024-08-18T22:24:14.431 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '9168bf75-30db-43e9-8218-637804d3e428', 'mode': 'asynchronous'}' 2024-08-18T22:24:22.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:24:22.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:24:24.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:24.433 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-08-18T22:24:24.447 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:24:24.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:24:24.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:24:24.702 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:24:24.702 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:24:24.702 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:24.702 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:24.712 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:24.712 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:24.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:24:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb54c00640 1 Processor -- start 2024-08-18T22:24:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb54c00640 1 -- start start 2024-08-18T22:24:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb54c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb500d3680 0x7fcb500d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb54c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb500d3fe0 con 0x7fcb5015e2b0 2024-08-18T22:24:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb54c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb500d2110 con 0x7fcb500b71d0 2024-08-18T22:24:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb54c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb500d2d20 con 0x7fcb500d3680 2024-08-18T22:24:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcb5015e2b0 0x7fcb500b5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44974/0 (socket says 172.21.15.5:44974) 2024-08-18T22:24:24.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4f400640 1 -- 172.21.15.5:0/1151095592 learned_addr learned my addr 172.21.15.5:0/1151095592 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4ea00640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb500d3680 0x7fcb500d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767558458 0 0) 0x7fcb500d3fe0 con 0x7fcb5015e2b0 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb34003530 con 0x7fcb5015e2b0 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211111028 0 0) 0x7fcb500d2110 con 0x7fcb500b71d0 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb500d3fe0 con 0x7fcb500b71d0 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3000294602 0 0) 0x7fcb34003530 con 0x7fcb5015e2b0 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb500d3680 msgr2=0x7fcb500d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb500d3680 0x7fcb500d3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 >> v1:172.21.15.117:6789/0 conn(0x7fcb500b71d0 legacy=0x7fcb500b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb500d23f0 con 0x7fcb5015e2b0 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fcb40001680 con 0x7fcb5015e2b0 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 >> v1:172.21.15.5:6789/0 conn(0x7fcb5015e2b0 legacy=0x7fcb500b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:24.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb34003b80 0x7fcb34003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 0x7fcb34004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb500d3680 0x7fcb340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcb500d2d20 con 0x7fcb34004810 2024-08-18T22:24:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3400bb00 con 0x7fcb34003b80 2024-08-18T22:24:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb3400bd00 con 0x7fcb500d3680 2024-08-18T22:24:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4ea00640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 0x7fcb34004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4f400640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb34003b80 0x7fcb34003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:24.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4fe00640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb500d3680 0x7fcb340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4ea00640 1 -- 172.21.15.5:0/1151095592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb500d3680 msgr2=0x7fcb340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.962+0000 7fcb4ea00640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb500d3680 0x7fcb340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb4ea00640 1 -- 172.21.15.5:0/1151095592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb34003b80 msgr2=0x7fcb34003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb4ea00640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb34003b80 0x7fcb34003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb4ea00640 1 -- 172.21.15.5:0/1151095592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb34003530 con 0x7fcb34004810 2024-08-18T22:24:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb4ea00640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 0x7fcb34004c90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009ab0 tx=0x7fcb3c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935a4f1bce9894c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:24.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0b2070 con 0x7fcb34004810 2024-08-18T22:24:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c0a5560 con 0x7fcb34004810 2024-08-18T22:24:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb4e000640 1 -- 172.21.15.5:0/1151095592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0096b0 con 0x7fcb34004810 2024-08-18T22:24:24.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb54c00640 1 -- 172.21.15.5:0/1151095592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 msgr2=0x7fcb34004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb54c00640 1 --2- 172.21.15.5:0/1151095592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 0x7fcb34004c90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009ab0 tx=0x7fcb3c01ca50 comp rx=0 tx=0).stop 2024-08-18T22:24:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb4fe00640 1 -- 172.21.15.5:0/1151095592 reap_dead start 2024-08-18T22:24:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb54c00640 1 -- 172.21.15.5:0/1151095592 shutdown_connections 2024-08-18T22:24:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb54c00640 1 -- 172.21.15.5:0/1151095592 >> 172.21.15.5:0/1151095592 conn(0x7fcb50067c70 msgr2=0x7fcb500d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb54c00640 1 -- 172.21.15.5:0/1151095592 shutdown_connections 2024-08-18T22:24:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.966+0000 7fcb54c00640 1 -- 172.21.15.5:0/1151095592 wait complete. 2024-08-18T22:24:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb54c00640 1 Processor -- start 2024-08-18T22:24:24.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb54c00640 1 -- start start 2024-08-18T22:24:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb54c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 0x7fcb50154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb54c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb50154790 0x7fcb5015e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb54c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb50153230 0x7fcb5015c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb54c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcb500d31b0 con 0x7fcb34004810 2024-08-18T22:24:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb54c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcb500d29b0 con 0x7fcb50153230 2024-08-18T22:24:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb54c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcb500d1da0 con 0x7fcb50154790 2024-08-18T22:24:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 0x7fcb50154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 0x7fcb50154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35276/0 (socket says 172.21.15.5:35276) 2024-08-18T22:24:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4f400640 1 -- 172.21.15.5:0/2344983441 learned_addr learned my addr 172.21.15.5:0/2344983441 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4ea00640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb50154790 0x7fcb5015e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:24.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4fe00640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb50153230 0x7fcb5015c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:24.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4f400640 1 -- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb50154790 msgr2=0x7fcb5015e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4f400640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb50154790 0x7fcb5015e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4f400640 1 -- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb50153230 msgr2=0x7fcb5015c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4f400640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb50153230 0x7fcb5015c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4f400640 1 -- 172.21.15.5:0/2344983441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb501614e0 con 0x7fcb34004810 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4fe00640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb50153230 0x7fcb5015c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb4f400640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 0x7fcb50154140 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fcb400011f0 tx=0x7fcb40007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb47400640 1 -- 172.21.15.5:0/2344983441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40001630 con 0x7fcb34004810 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb47400640 1 -- 172.21.15.5:0/2344983441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb40018070 con 0x7fcb34004810 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb47400640 1 -- 172.21.15.5:0/2344983441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000fc20 con 0x7fcb34004810 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb54c00640 1 -- 172.21.15.5:0/2344983441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5015ed90 con 0x7fcb34004810 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.970+0000 7fcb54c00640 1 -- 172.21.15.5:0/2344983441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb5015f350 con 0x7fcb34004810 2024-08-18T22:24:24.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.974+0000 7fcb54c00640 1 -- 172.21.15.5:0/2344983441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb500d3aa0 con 0x7fcb34004810 2024-08-18T22:24:24.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.974+0000 7fcb47400640 1 -- 172.21.15.5:0/2344983441 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcb4001d460 con 0x7fcb34004810 2024-08-18T22:24:24.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.974+0000 7fcb47400640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcb300678f0 0x7fcb30069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:24.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.974+0000 7fcb47400640 1 -- 172.21.15.5:0/2344983441 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7fcb40085ec0 con 0x7fcb34004810 2024-08-18T22:24:24.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.974+0000 7fcb4ea00640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcb300678f0 0x7fcb30069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:24.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.974+0000 7fcb4ea00640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcb300678f0 0x7fcb30069db0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0af000 tx=0x7fcb3c0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:24.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:24.978+0000 7fcb47400640 1 -- 172.21.15.5:0/2344983441 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcb501614e0 con 0x7fcb34004810 2024-08-18T22:24:25.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 -- 172.21.15.5:0/2344983441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcb5015db70 con 0x7fcb34004810 2024-08-18T22:24:25.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb47400640 1 -- 172.21.15.5:0/2344983441 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v86) ==== 80+0+242 (secure 0 0 0) 0x7fcb40056720 con 0x7fcb34004810 2024-08-18T22:24:25.158 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6832/3108112673 2024-08-19T22:24:08.307602+0000 2024-08-18T22:24:25.158 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.117:6836/116443176 2024-08-19T22:24:07.859535+0000 2024-08-18T22:24:25.158 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6834/3108112673 2024-08-19T22:24:08.307602+0000 2024-08-18T22:24:25.158 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.117:6834/116443176 2024-08-19T22:24:07.859535+0000 2024-08-18T22:24:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:listed 4 entries 2024-08-18T22:24:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 -- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcb300678f0 msgr2=0x7fcb30069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcb300678f0 0x7fcb30069db0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0af000 tx=0x7fcb3c0046d0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 -- 172.21.15.5:0/2344983441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 msgr2=0x7fcb50154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 0x7fcb50154140 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fcb400011f0 tx=0x7fcb40007720 comp rx=0 tx=0).stop 2024-08-18T22:24:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 -- 172.21.15.5:0/2344983441 shutdown_connections 2024-08-18T22:24:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcb300678f0 0x7fcb30069db0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb50153230 0x7fcb5015c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb50154790 0x7fcb5015e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 --2- 172.21.15.5:0/2344983441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb34004810 0x7fcb50154140 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 -- 172.21.15.5:0/2344983441 >> 172.21.15.5:0/2344983441 conn(0x7fcb50067c70 msgr2=0x7fcb500b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:25.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 -- 172.21.15.5:0/2344983441 shutdown_connections 2024-08-18T22:24:25.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.158+0000 7fcb54c00640 1 -- 172.21.15.5:0/2344983441 wait complete. 2024-08-18T22:24:25.179 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:24:25.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:25.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:25.209 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:24:25.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:25.210 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:24:25.264 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:24:25.264 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:24:25.265 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:25.274 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:24:25.274 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:24:25.274 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:25.274 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:25.320 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:24:25.320 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:24:25.320 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:24:25.320 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:25.329 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:24:25.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79ef000640 1 Processor -- start 2024-08-18T22:24:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79ef000640 1 -- start start 2024-08-18T22:24:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79ef000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79e806b9b0 0x7f79e8070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79ef000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e8161e20 con 0x7f79e815e6d0 2024-08-18T22:24:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79ef000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e80708e0 con 0x7f79e80d1b30 2024-08-18T22:24:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79ef000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f79e80706b0 con 0x7f79e806b9b0 2024-08-18T22:24:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79e7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79e806b9b0 0x7f79e8070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79ed000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f79e815e6d0 0x7f79e815eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44984/0 (socket says 172.21.15.5:44984) 2024-08-18T22:24:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79ed000640 1 -- 172.21.15.5:0/1237899523 learned_addr learned my addr 172.21.15.5:0/1237899523 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79e7e00640 1 -- 172.21.15.5:0/1237899523 >> v1:172.21.15.117:6789/0 conn(0x7f79e80d1b30 legacy=0x7f79e806bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79e7e00640 1 -- 172.21.15.5:0/1237899523 >> v1:172.21.15.5:6789/0 conn(0x7f79e815e6d0 legacy=0x7f79e815eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79e7400640 1 -- 172.21.15.5:0/1237899523 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864302952 0 0) 0x7f79e8161e20 con 0x7f79e815e6d0 2024-08-18T22:24:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.506+0000 7f79e7e00640 1 -- 172.21.15.5:0/1237899523 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e81620c0 con 0x7f79e806b9b0 2024-08-18T22:24:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.510+0000 7f79e7e00640 1 --2- 172.21.15.5:0/1237899523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e806b9b0 0x7f79e8070170 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f79d80097c0 tx=0x7f79d801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939f92c0d43b91c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.510+0000 7f79e7400640 1 -- 172.21.15.5:0/1237899523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d80b0070 con 0x7f79e806b9b0 2024-08-18T22:24:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.510+0000 7f79e7400640 1 -- 172.21.15.5:0/1237899523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d80ab600 con 0x7f79e806b9b0 2024-08-18T22:24:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.510+0000 7f79e7400640 1 -- 172.21.15.5:0/1237899523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d80ab9d0 con 0x7f79e806b9b0 2024-08-18T22:24:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.510+0000 7f79ef000640 1 -- 172.21.15.5:0/1237899523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e806b9b0 msgr2=0x7f79e8070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.510+0000 7f79ef000640 1 --2- 172.21.15.5:0/1237899523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e806b9b0 0x7f79e8070170 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f79d80097c0 tx=0x7f79d801c4a0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.510+0000 7f79ef000640 1 -- 172.21.15.5:0/1237899523 shutdown_connections 2024-08-18T22:24:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.510+0000 7f79ef000640 1 --2- 172.21.15.5:0/1237899523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e806b9b0 0x7f79e8070170 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.510+0000 7f79ef000640 1 -- 172.21.15.5:0/1237899523 >> 172.21.15.5:0/1237899523 conn(0x7f79e80d1010 msgr2=0x7f79e80d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.510+0000 7f79ef000640 1 -- 172.21.15.5:0/1237899523 shutdown_connections 2024-08-18T22:24:25.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.510+0000 7f79ef000640 1 -- 172.21.15.5:0/1237899523 wait complete. 2024-08-18T22:24:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ef000640 1 Processor -- start 2024-08-18T22:24:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ef000640 1 -- start start 2024-08-18T22:24:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ef000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e806b9b0 0x7f79e8156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ef000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79e80d1b30 0x7f79e8154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ef000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e815e6d0 0x7f79e8153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ef000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79e8162ba0 con 0x7f79e815e6d0 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ef000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f79e80b0810 con 0x7f79e80d1b30 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ef000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f79e8160020 con 0x7f79e806b9b0 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ed000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e815e6d0 0x7f79e8153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ed000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e815e6d0 0x7f79e8153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35300/0 (socket says 172.21.15.5:35300) 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ed000640 1 -- 172.21.15.5:0/736626480 learned_addr learned my addr 172.21.15.5:0/736626480 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79df400640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79e80d1b30 0x7f79e8154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79e7e00640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e806b9b0 0x7f79e8156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ed000640 1 -- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e806b9b0 msgr2=0x7f79e8156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ed000640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e806b9b0 0x7f79e8156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ed000640 1 -- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79e80d1b30 msgr2=0x7f79e8154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ed000640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79e80d1b30 0x7f79e8154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ed000640 1 -- 172.21.15.5:0/736626480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e8160300 con 0x7f79e815e6d0 2024-08-18T22:24:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ed000640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e815e6d0 0x7f79e8153df0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c7a0 tx=0x7f79e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79e4c00640 1 -- 172.21.15.5:0/736626480 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0018070 con 0x7f79e815e6d0 2024-08-18T22:24:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79e4c00640 1 -- 172.21.15.5:0/736626480 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e000a640 con 0x7f79e815e6d0 2024-08-18T22:24:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ef000640 1 -- 172.21.15.5:0/736626480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e81605e0 con 0x7f79e815e6d0 2024-08-18T22:24:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79e4c00640 1 -- 172.21.15.5:0/736626480 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e000aab0 con 0x7f79e815e6d0 2024-08-18T22:24:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ef000640 1 -- 172.21.15.5:0/736626480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e8160ba0 con 0x7f79e815e6d0 2024-08-18T22:24:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.514+0000 7f79ef000640 1 -- 172.21.15.5:0/736626480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e8070170 con 0x7f79e815e6d0 2024-08-18T22:24:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.518+0000 7f79e4c00640 1 -- 172.21.15.5:0/736626480 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f79e001b070 con 0x7f79e815e6d0 2024-08-18T22:24:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.518+0000 7f79e4c00640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79c4067910 0x7f79c4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.518+0000 7f79e4c00640 1 -- 172.21.15.5:0/736626480 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7f79e0085630 con 0x7f79e815e6d0 2024-08-18T22:24:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.518+0000 7f79e7e00640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79c4067910 0x7f79c4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.518+0000 7f79e7e00640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79c4067910 0x7f79c4069dd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f79d80ad000 tx=0x7f79d80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:25.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.522+0000 7f79e4c00640 1 -- 172.21.15.5:0/736626480 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f79e0055f10 con 0x7f79e815e6d0 2024-08-18T22:24:25.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 -- 172.21.15.5:0/736626480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79e8162d20 con 0x7f79e815e6d0 2024-08-18T22:24:25.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79e4c00640 1 -- 172.21.15.5:0/736626480 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5217 (secure 0 0 0) 0x7f79e0055810 con 0x7f79e815e6d0 2024-08-18T22:24:25.722 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:25.722 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"btime":"2024-08-18T22:24:11:322415+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/625897913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":625897913},{"type":"v1","addr":"172.21.15.117:6837","nonce":625897913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/128531097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":128531097},{"type":"v1","addr":"172.21.15.5:6835","nonce":128531097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3673408015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3673408015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3673408015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:53.630789+0000","modified":"2024-08-18T22:24:11.322406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6589":{"gid":6589,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6835/349592920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":349592920},{"type":"v1","addr":"172.21.15.117:6835","nonce":349592920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6589,"qdb_cluster":[6589]},"id":5}]} 2024-08-18T22:24:25.722 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-08-18T22:24:25.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 -- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79c4067910 msgr2=0x7f79c4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79c4067910 0x7f79c4069dd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f79d80ad000 tx=0x7f79d80a6000 comp rx=0 tx=0).stop 2024-08-18T22:24:25.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 -- 172.21.15.5:0/736626480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e815e6d0 msgr2=0x7f79e8153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e815e6d0 0x7f79e8153df0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c7a0 tx=0x7f79e000cc60 comp rx=0 tx=0).stop 2024-08-18T22:24:25.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 -- 172.21.15.5:0/736626480 shutdown_connections 2024-08-18T22:24:25.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79c4067910 0x7f79c4069dd0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79e815e6d0 0x7f79e8153df0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79e80d1b30 0x7f79e8154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 --2- 172.21.15.5:0/736626480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79e806b9b0 0x7f79e8156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 -- 172.21.15.5:0/736626480 >> 172.21.15.5:0/736626480 conn(0x7f79e80d1010 msgr2=0x7f79e80d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:25.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 -- 172.21.15.5:0/736626480 shutdown_connections 2024-08-18T22:24:25.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.722+0000 7f79ef000640 1 -- 172.21.15.5:0/736626480 wait complete. 2024-08-18T22:24:25.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6ba400640 1 Processor -- start 2024-08-18T22:24:25.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6ba400640 1 -- start start 2024-08-18T22:24:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6ba400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6b409aa40 0x7fb6b415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6ba400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b40b4510 0x7fb6b40cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6ba400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b40ccd90 con 0x7fb6b40cde30 2024-08-18T22:24:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6ba400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b40ce770 con 0x7fb6b409aa40 2024-08-18T22:24:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6ba400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b415d520 con 0x7fb6b40b4510 2024-08-18T22:24:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6b9000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6b409aa40 0x7fb6b415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6b9000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6b409aa40 0x7fb6b415cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35310/0 (socket says 172.21.15.5:35310) 2024-08-18T22:24:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6b9000640 1 -- 172.21.15.5:0/2350371679 learned_addr learned my addr 172.21.15.5:0/2350371679 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6b9a00640 1 --2- 172.21.15.5:0/2350371679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b40b4510 0x7fb6b40cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:25.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6b9000640 1 -- 172.21.15.5:0/2350371679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b40b4510 msgr2=0x7fb6b40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:25.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6b9000640 1 --2- 172.21.15.5:0/2350371679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b40b4510 0x7fb6b40cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6b9000640 1 -- 172.21.15.5:0/2350371679 >> v1:172.21.15.117:6789/0 conn(0x7fb6b40cde30 legacy=0x7fb6b409ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6b9000640 1 -- 172.21.15.5:0/2350371679 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b40cd070 con 0x7fb6b409aa40 2024-08-18T22:24:25.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.886+0000 7fb6b9a00640 1 --2- 172.21.15.5:0/2350371679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b40b4510 0x7fb6b40cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:25.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6b9000640 1 --2- 172.21.15.5:0/2350371679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b409aa40 0x7fb6b415cfe0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009870 tx=0x7fb6a401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce3855426ffdbbf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:25.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6b3e00640 1 -- 172.21.15.5:0/2350371679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40a95f0 con 0x7fb6b409aa40 2024-08-18T22:24:25.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6b3e00640 1 -- 172.21.15.5:0/2350371679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a40a9790 con 0x7fb6b409aa40 2024-08-18T22:24:25.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6b3e00640 1 -- 172.21.15.5:0/2350371679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40a9b60 con 0x7fb6b409aa40 2024-08-18T22:24:25.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6ba400640 1 -- 172.21.15.5:0/2350371679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b409aa40 msgr2=0x7fb6b415cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6ba400640 1 --2- 172.21.15.5:0/2350371679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b409aa40 0x7fb6b415cfe0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009870 tx=0x7fb6a401c530 comp rx=0 tx=0).stop 2024-08-18T22:24:25.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6ba400640 1 -- 172.21.15.5:0/2350371679 shutdown_connections 2024-08-18T22:24:25.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6ba400640 1 --2- 172.21.15.5:0/2350371679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b40b4510 0x7fb6b40cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6ba400640 1 --2- 172.21.15.5:0/2350371679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b409aa40 0x7fb6b415cfe0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6ba400640 1 -- 172.21.15.5:0/2350371679 >> 172.21.15.5:0/2350371679 conn(0x7fb6b40b3a20 msgr2=0x7fb6b40b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:25.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6ba400640 1 -- 172.21.15.5:0/2350371679 shutdown_connections 2024-08-18T22:24:25.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6ba400640 1 -- 172.21.15.5:0/2350371679 wait complete. 2024-08-18T22:24:25.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6ba400640 1 Processor -- start 2024-08-18T22:24:25.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.890+0000 7fb6ba400640 1 -- start start 2024-08-18T22:24:25.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6ba400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b409aa40 0x7fb6b415a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:25.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6ba400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b40b4510 0x7fb6b415e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:25.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6ba400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b40cde30 0x7fb6b415ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:25.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6ba400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b415c3b0 con 0x7fb6b409aa40 2024-08-18T22:24:25.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6ba400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b415c230 con 0x7fb6b40cde30 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6ba400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b4168e40 con 0x7fb6b40b4510 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b409aa40 0x7fb6b415a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b409aa40 0x7fb6b415a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35326/0 (socket says 172.21.15.5:35326) 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b9000640 1 -- 172.21.15.5:0/1024817142 learned_addr learned my addr 172.21.15.5:0/1024817142 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b9a00640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b40cde30 0x7fb6b415ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6abe00640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b40b4510 0x7fb6b415e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b9000640 1 -- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b40b4510 msgr2=0x7fb6b415e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b9000640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b40b4510 0x7fb6b415e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b9000640 1 -- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b40cde30 msgr2=0x7fb6b415ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b9000640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b40cde30 0x7fb6b415ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b9000640 1 -- 172.21.15.5:0/1024817142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b40b1050 con 0x7fb6b409aa40 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b9000640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b409aa40 0x7fb6b415a5d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40ab040 tx=0x7fb6a401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:25.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b1600640 1 -- 172.21.15.5:0/1024817142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40b1800 con 0x7fb6b409aa40 2024-08-18T22:24:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b1600640 1 -- 172.21.15.5:0/1024817142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a40b19c0 con 0x7fb6b409aa40 2024-08-18T22:24:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6ba400640 1 -- 172.21.15.5:0/1024817142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b40b5910 con 0x7fb6b409aa40 2024-08-18T22:24:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b1600640 1 -- 172.21.15.5:0/1024817142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40b1db0 con 0x7fb6b409aa40 2024-08-18T22:24:25.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6ba400640 1 -- 172.21.15.5:0/1024817142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b40b5ed0 con 0x7fb6b409aa40 2024-08-18T22:24:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6ba400640 1 -- 172.21.15.5:0/1024817142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b4073d40 con 0x7fb6b409aa40 2024-08-18T22:24:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.894+0000 7fb6b1600640 1 -- 172.21.15.5:0/1024817142 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb6a40bc450 con 0x7fb6b409aa40 2024-08-18T22:24:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.898+0000 7fb6b1600640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb6900678c0 0x7fb690069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.898+0000 7fb6b1600640 1 -- 172.21.15.5:0/1024817142 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7fb6a4120a50 con 0x7fb6b409aa40 2024-08-18T22:24:25.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.898+0000 7fb6abe00640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb6900678c0 0x7fb690069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:25.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.898+0000 7fb6abe00640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb6900678c0 0x7fb690069d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40b3260 tx=0x7fb69c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:25.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:25.902+0000 7fb6b1600640 1 -- 172.21.15.5:0/1024817142 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb6a40ad020 con 0x7fb6b409aa40 2024-08-18T22:24:26.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.102+0000 7fb6ba400640 1 -- 172.21.15.5:0/1024817142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6b40b7eb0 con 0x7fb6b409aa40 2024-08-18T22:24:26.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.102+0000 7fb6b1600640 1 -- 172.21.15.5:0/1024817142 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5217 (secure 0 0 0) 0x7fb6a4016150 con 0x7fb6b409aa40 2024-08-18T22:24:26.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:26.103 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"btime":"2024-08-18T22:24:11:322415+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/625897913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":625897913},{"type":"v1","addr":"172.21.15.117:6837","nonce":625897913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/128531097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":128531097},{"type":"v1","addr":"172.21.15.5:6835","nonce":128531097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3673408015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3673408015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3673408015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:53.630789+0000","modified":"2024-08-18T22:24:11.322406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6589":{"gid":6589,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6835/349592920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":349592920},{"type":"v1","addr":"172.21.15.117:6835","nonce":349592920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6589,"qdb_cluster":[6589]},"id":5}]} 2024-08-18T22:24:26.103 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-08-18T22:24:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 -- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb6900678c0 msgr2=0x7fb690069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb6900678c0 0x7fb690069d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40b3260 tx=0x7fb69c009040 comp rx=0 tx=0).stop 2024-08-18T22:24:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 -- 172.21.15.5:0/1024817142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b409aa40 msgr2=0x7fb6b415a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b409aa40 0x7fb6b415a5d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40ab040 tx=0x7fb6a401ad70 comp rx=0 tx=0).stop 2024-08-18T22:24:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 -- 172.21.15.5:0/1024817142 shutdown_connections 2024-08-18T22:24:26.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb6900678c0 0x7fb690069d80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b40cde30 0x7fb6b415ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6b40b4510 0x7fb6b415e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 --2- 172.21.15.5:0/1024817142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b409aa40 0x7fb6b415a5d0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 -- 172.21.15.5:0/1024817142 >> 172.21.15.5:0/1024817142 conn(0x7fb6b40b3a20 msgr2=0x7fb6b406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 -- 172.21.15.5:0/1024817142 shutdown_connections 2024-08-18T22:24:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.106+0000 7fb6ba400640 1 -- 172.21.15.5:0/1024817142 wait complete. 2024-08-18T22:24:26.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:24:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.266+0000 7f318a800640 1 Processor -- start 2024-08-18T22:24:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.266+0000 7f318a800640 1 -- start start 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f318a800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f31840afe50 0x7f31840b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f318a800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31840b5e60 0x7f318406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f318a800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31840b65d0 con 0x7f318415e140 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f318a800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f318406e560 con 0x7f31840afe50 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f318a800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f31840b68b0 con 0x7f31840b5e60 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f3182a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f31840afe50 0x7f31840b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f3182a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f31840afe50 0x7f31840b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35338/0 (socket says 172.21.15.5:35338) 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f3182a00640 1 -- 172.21.15.5:0/680367369 learned_addr learned my addr 172.21.15.5:0/680367369 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f3183400640 1 --1- 172.21.15.5:0/680367369 >> v1:172.21.15.117:6789/0 conn(0x7f318415e140 0x7f31840af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:39232/0 (socket says 172.21.15.5:39232) 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f3183e00640 1 --2- 172.21.15.5:0/680367369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31840b5e60 0x7f318406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f3182a00640 1 -- 172.21.15.5:0/680367369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31840b5e60 msgr2=0x7f318406efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f3182a00640 1 --2- 172.21.15.5:0/680367369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31840b5e60 0x7f318406efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f3182a00640 1 -- 172.21.15.5:0/680367369 >> v1:172.21.15.117:6789/0 conn(0x7f318415e140 legacy=0x7f31840af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.270+0000 7f3182a00640 1 -- 172.21.15.5:0/680367369 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318406e7b0 con 0x7f31840afe50 2024-08-18T22:24:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f3182a00640 1 --2- 172.21.15.5:0/680367369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31840afe50 0x7f31840b4e40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3170009870 tx=0x7f317001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb8c7e439b666a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f3182000640 1 -- 172.21.15.5:0/680367369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31700aa650 con 0x7f31840afe50 2024-08-18T22:24:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f3182000640 1 -- 172.21.15.5:0/680367369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31700af070 con 0x7f31840afe50 2024-08-18T22:24:26.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f3182000640 1 -- 172.21.15.5:0/680367369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31700aaa10 con 0x7f31840afe50 2024-08-18T22:24:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 -- 172.21.15.5:0/680367369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31840afe50 msgr2=0x7f31840b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 --2- 172.21.15.5:0/680367369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31840afe50 0x7f31840b4e40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3170009870 tx=0x7f317001c4d0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 -- 172.21.15.5:0/680367369 shutdown_connections 2024-08-18T22:24:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 --2- 172.21.15.5:0/680367369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31840b5e60 0x7f318406efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 --2- 172.21.15.5:0/680367369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31840afe50 0x7f31840b4e40 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 -- 172.21.15.5:0/680367369 >> 172.21.15.5:0/680367369 conn(0x7f318406b9b0 msgr2=0x7f318406bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 -- 172.21.15.5:0/680367369 shutdown_connections 2024-08-18T22:24:26.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 -- 172.21.15.5:0/680367369 wait complete. 2024-08-18T22:24:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 Processor -- start 2024-08-18T22:24:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 -- start start 2024-08-18T22:24:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31840afe50 0x7f3184155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31840b5e60 0x7f318406c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318415e140 0x7f31840cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f318406fe80 con 0x7f318415e140 2024-08-18T22:24:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f318406fd00 con 0x7f31840afe50 2024-08-18T22:24:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.274+0000 7f318a800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3184070000 con 0x7f31840b5e60 2024-08-18T22:24:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f3183e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318415e140 0x7f31840cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f3183e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318415e140 0x7f31840cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35342/0 (socket says 172.21.15.5:35342) 2024-08-18T22:24:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f3183e00640 1 -- 172.21.15.5:0/600959485 learned_addr learned my addr 172.21.15.5:0/600959485 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f3183400640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31840afe50 0x7f3184155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f3182a00640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31840b5e60 0x7f318406c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f3183e00640 1 -- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31840b5e60 msgr2=0x7f318406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f3183e00640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31840b5e60 0x7f318406c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f3183e00640 1 -- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31840afe50 msgr2=0x7f3184155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f3183e00640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31840afe50 0x7f3184155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f3183e00640 1 -- 172.21.15.5:0/600959485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3184156710 con 0x7f318415e140 2024-08-18T22:24:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f3183e00640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318415e140 0x7f31840cdc10 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f317c00efc0 tx=0x7f317c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f317b400640 1 -- 172.21.15.5:0/600959485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c018020 con 0x7f318415e140 2024-08-18T22:24:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f317b400640 1 -- 172.21.15.5:0/600959485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c014480 con 0x7f318415e140 2024-08-18T22:24:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f317b400640 1 -- 172.21.15.5:0/600959485 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c014870 con 0x7f318415e140 2024-08-18T22:24:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f318a800640 1 -- 172.21.15.5:0/600959485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31841569f0 con 0x7f318415e140 2024-08-18T22:24:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f318a800640 1 -- 172.21.15.5:0/600959485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3184156190 con 0x7f318415e140 2024-08-18T22:24:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f318a800640 1 -- 172.21.15.5:0/600959485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31840b4e40 con 0x7f318415e140 2024-08-18T22:24:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.278+0000 7f317b400640 1 -- 172.21.15.5:0/600959485 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f317c01b020 con 0x7f318415e140 2024-08-18T22:24:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.282+0000 7f317b400640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31640678c0 0x7f3164069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.282+0000 7f317b400640 1 -- 172.21.15.5:0/600959485 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7f317c086b60 con 0x7f318415e140 2024-08-18T22:24:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.282+0000 7f3183400640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31640678c0 0x7f3164069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.282+0000 7f3183400640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31640678c0 0x7f3164069d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3174000f70 tx=0x7f3174007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.286+0000 7f317b400640 1 -- 172.21.15.5:0/600959485 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f317c022030 con 0x7f318415e140 2024-08-18T22:24:26.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.450+0000 7f318a800640 1 -- 172.21.15.5:0/600959485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3184158da0 con 0x7f318415e140 2024-08-18T22:24:26.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.450+0000 7f317b400640 1 -- 172.21.15.5:0/600959485 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+17130 (secure 0 0 0) 0x7f317c010040 con 0x7f318415e140 2024-08-18T22:24:26.452 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:26.452 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:24:08.307631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:23:51.370291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-08-18T22:23:52.711969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6832/3108112673":"2024-08-19T22:24:08.307602+0000","172.21.15.117:6836/116443176":"2024-08-19T22:24:07.859535+0000","172.21.15.5:6834/3108112673":"2024-08-19T22:24:08.307602+0000","172.21.15.117:6834/116443176":"2024-08-19T22:24:07.859535+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:24:26.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 -- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31640678c0 msgr2=0x7f3164069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31640678c0 0x7f3164069d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3174000f70 tx=0x7f3174007e50 comp rx=0 tx=0).stop 2024-08-18T22:24:26.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 -- 172.21.15.5:0/600959485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318415e140 msgr2=0x7f31840cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318415e140 0x7f31840cdc10 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f317c00efc0 tx=0x7f317c00c490 comp rx=0 tx=0).stop 2024-08-18T22:24:26.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 -- 172.21.15.5:0/600959485 shutdown_connections 2024-08-18T22:24:26.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31640678c0 0x7f3164069d80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f318415e140 0x7f31840cdc10 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31840b5e60 0x7f318406c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 --2- 172.21.15.5:0/600959485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31840afe50 0x7f3184155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 -- 172.21.15.5:0/600959485 >> 172.21.15.5:0/600959485 conn(0x7f318406b9b0 msgr2=0x7f318414ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:26.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 -- 172.21.15.5:0/600959485 shutdown_connections 2024-08-18T22:24:26.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.454+0000 7f318a800640 1 -- 172.21.15.5:0/600959485 wait complete. 2024-08-18T22:24:26.474 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:24:26.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:26.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f7aa00640 1 Processor -- start 2024-08-18T22:24:26.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f7aa00640 1 -- start start 2024-08-18T22:24:26.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f7aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7415bed0 0x7f5f740735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f7aa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f740cb390 0x7f5f74071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f7aa00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f74072060 con 0x7f5f7406da70 2024-08-18T22:24:26.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f7aa00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5f74073c80 con 0x7f5f740cb390 2024-08-18T22:24:26.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f7aa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5f740ca5d0 con 0x7f5f7415bed0 2024-08-18T22:24:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f73400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f740cb390 0x7f5f74071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f73e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7415bed0 0x7f5f740735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f73400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f740cb390 0x7f5f74071b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:57954/0 (socket says 172.21.15.5:57954) 2024-08-18T22:24:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f73400640 1 -- 172.21.15.5:0/304006911 learned_addr learned my addr 172.21.15.5:0/304006911 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f73e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7415bed0 0x7f5f740735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:44468/0 (socket says 172.21.15.5:44468) 2024-08-18T22:24:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f73400640 1 -- 172.21.15.5:0/304006911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7415bed0 msgr2=0x7f5f740735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f73400640 1 --2- 172.21.15.5:0/304006911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7415bed0 0x7f5f740735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f73400640 1 -- 172.21.15.5:0/304006911 >> v1:172.21.15.117:6789/0 conn(0x7f5f7406da70 legacy=0x7f5f740cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.614+0000 7f5f73400640 1 -- 172.21.15.5:0/304006911 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f740ca8b0 con 0x7f5f740cb390 2024-08-18T22:24:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f73400640 1 --2- 172.21.15.5:0/304006911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f740cb390 0x7f5f74071b20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009870 tx=0x7f5f6001c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bdb1d79ad6c517e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f72a00640 1 -- 172.21.15.5:0/304006911 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f600a95f0 con 0x7f5f740cb390 2024-08-18T22:24:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f72a00640 1 -- 172.21.15.5:0/304006911 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f600a9790 con 0x7f5f740cb390 2024-08-18T22:24:26.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f72a00640 1 -- 172.21.15.5:0/304006911 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f600a9b60 con 0x7f5f740cb390 2024-08-18T22:24:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f7aa00640 1 -- 172.21.15.5:0/304006911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f740cb390 msgr2=0x7f5f74071b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f7aa00640 1 --2- 172.21.15.5:0/304006911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f740cb390 0x7f5f74071b20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009870 tx=0x7f5f6001c530 comp rx=0 tx=0).stop 2024-08-18T22:24:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f7aa00640 1 -- 172.21.15.5:0/304006911 shutdown_connections 2024-08-18T22:24:26.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f7aa00640 1 --2- 172.21.15.5:0/304006911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f740cb390 0x7f5f74071b20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f7aa00640 1 --2- 172.21.15.5:0/304006911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7415bed0 0x7f5f740735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f7aa00640 1 -- 172.21.15.5:0/304006911 >> 172.21.15.5:0/304006911 conn(0x7f5f740b1c50 msgr2=0x7f5f740b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:26.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f7aa00640 1 -- 172.21.15.5:0/304006911 shutdown_connections 2024-08-18T22:24:26.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.618+0000 7f5f7aa00640 1 -- 172.21.15.5:0/304006911 wait complete. 2024-08-18T22:24:26.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f7aa00640 1 Processor -- start 2024-08-18T22:24:26.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f7aa00640 1 -- start start 2024-08-18T22:24:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f7aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7406da70 0x7f5f74148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f7aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f740cb390 0x7f5f741564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f7aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7415bed0 0x7f5f740c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f7aa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7415c430 con 0x7f5f7406da70 2024-08-18T22:24:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f7aa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7415c2b0 con 0x7f5f740cb390 2024-08-18T22:24:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f7aa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5f74168ba0 con 0x7f5f7415bed0 2024-08-18T22:24:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f73e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7406da70 0x7f5f74148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f73e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7406da70 0x7f5f74148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35358/0 (socket says 172.21.15.5:35358) 2024-08-18T22:24:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f73e00640 1 -- 172.21.15.5:0/242241749 learned_addr learned my addr 172.21.15.5:0/242241749 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f73400640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f740cb390 0x7f5f741564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f78a00640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7415bed0 0x7f5f740c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f73e00640 1 -- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7415bed0 msgr2=0x7f5f740c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f73e00640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7415bed0 0x7f5f740c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f73e00640 1 -- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f740cb390 msgr2=0x7f5f741564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f73e00640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f740cb390 0x7f5f741564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f73e00640 1 -- 172.21.15.5:0/242241749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f74149050 con 0x7f5f7406da70 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f73e00640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7406da70 0x7f5f74148b10 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400e870 tx=0x7f5f6400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f6be00640 1 -- 172.21.15.5:0/242241749 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f64017070 con 0x7f5f7406da70 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f6be00640 1 -- 172.21.15.5:0/242241749 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f6400c940 con 0x7f5f7406da70 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f7aa00640 1 -- 172.21.15.5:0/242241749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f74156d80 con 0x7f5f7406da70 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f6be00640 1 -- 172.21.15.5:0/242241749 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6400ccf0 con 0x7f5f7406da70 2024-08-18T22:24:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.622+0000 7f5f7aa00640 1 -- 172.21.15.5:0/242241749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f74157340 con 0x7f5f7406da70 2024-08-18T22:24:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.626+0000 7f5f7aa00640 1 -- 172.21.15.5:0/242241749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f74071b20 con 0x7f5f7406da70 2024-08-18T22:24:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.626+0000 7f5f6be00640 1 -- 172.21.15.5:0/242241749 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f6401a070 con 0x7f5f7406da70 2024-08-18T22:24:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.626+0000 7f5f6be00640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f540678c0 0x7f5f54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.626+0000 7f5f6be00640 1 -- 172.21.15.5:0/242241749 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7f5f64085d20 con 0x7f5f7406da70 2024-08-18T22:24:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.626+0000 7f5f73400640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f540678c0 0x7f5f54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.626+0000 7f5f73400640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f540678c0 0x7f5f54069d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5f600ae000 tx=0x7f5f600b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:26.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.630+0000 7f5f6be00640 1 -- 172.21.15.5:0/242241749 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5f64055fc0 con 0x7f5f7406da70 2024-08-18T22:24:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.826+0000 7f5f7aa00640 1 -- 172.21.15.5:0/242241749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f740b16c0 con 0x7f5f7406da70 2024-08-18T22:24:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f6be00640 1 -- 172.21.15.5:0/242241749 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5217 (secure 0 0 0) 0x7f5f6405a2c0 con 0x7f5f7406da70 2024-08-18T22:24:26.829 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:26.829 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"btime":"2024-08-18T22:24:11:322415+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/625897913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":625897913},{"type":"v1","addr":"172.21.15.117:6837","nonce":625897913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/128531097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":128531097},{"type":"v1","addr":"172.21.15.5:6835","nonce":128531097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3673408015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3673408015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3673408015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:53.630789+0000","modified":"2024-08-18T22:24:11.322406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6589":{"gid":6589,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6835/349592920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":349592920},{"type":"v1","addr":"172.21.15.117:6835","nonce":349592920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6589,"qdb_cluster":[6589]},"id":5}]} 2024-08-18T22:24:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-08-18T22:24:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 -- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f540678c0 msgr2=0x7f5f54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f540678c0 0x7f5f54069d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5f600ae000 tx=0x7f5f600b3040 comp rx=0 tx=0).stop 2024-08-18T22:24:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 -- 172.21.15.5:0/242241749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7406da70 msgr2=0x7f5f74148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7406da70 0x7f5f74148b10 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400e870 tx=0x7f5f6400ec70 comp rx=0 tx=0).stop 2024-08-18T22:24:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 -- 172.21.15.5:0/242241749 shutdown_connections 2024-08-18T22:24:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f540678c0 0x7f5f54069d80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7415bed0 0x7f5f740c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f740cb390 0x7f5f741564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 --2- 172.21.15.5:0/242241749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7406da70 0x7f5f74148b10 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 -- 172.21.15.5:0/242241749 >> 172.21.15.5:0/242241749 conn(0x7f5f740b1c50 msgr2=0x7f5f740ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 -- 172.21.15.5:0/242241749 shutdown_connections 2024-08-18T22:24:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.830+0000 7f5f7aa00640 1 -- 172.21.15.5:0/242241749 wait complete. 2024-08-18T22:24:26.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:26.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.990+0000 7f75c2800640 1 Processor -- start 2024-08-18T22:24:26.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.990+0000 7f75c2800640 1 -- start start 2024-08-18T22:24:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.990+0000 7f75c2800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75bc15bed0 0x7f75bc0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.990+0000 7f75c2800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75bc073c80 con 0x7f75bc0cb390 2024-08-18T22:24:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.990+0000 7f75c2800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75bc0ca5d0 con 0x7f75bc06da70 2024-08-18T22:24:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.990+0000 7f75c2800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75bc0ca8b0 con 0x7f75bc15bed0 2024-08-18T22:24:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75baa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f75bc0cb390 0x7f75bc071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44990/0 (socket says 172.21.15.5:44990) 2024-08-18T22:24:26.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75baa00640 1 -- 172.21.15.5:0/2557195493 learned_addr learned my addr 172.21.15.5:0/2557195493 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75bb400640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75bc15bed0 0x7f75bc0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704547269 0 0) 0x7f75bc073c80 con 0x7f75bc0cb390 2024-08-18T22:24:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75a0003530 con 0x7f75bc0cb390 2024-08-18T22:24:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754042957 0 0) 0x7f75bc0ca5d0 con 0x7f75bc06da70 2024-08-18T22:24:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75bc073c80 con 0x7f75bc06da70 2024-08-18T22:24:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1414335018 0 0) 0x7f75a0003530 con 0x7f75bc0cb390 2024-08-18T22:24:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75bc15bed0 msgr2=0x7f75bc0735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75bc15bed0 0x7f75bc0735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 >> v1:172.21.15.117:6789/0 conn(0x7f75bc06da70 legacy=0x7f75bc165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc0cab90 con 0x7f75bc0cb390 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f75a8001680 con 0x7f75bc0cb390 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75bb400640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75bc15bed0 0x7f75bc0735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 >> v1:172.21.15.5:6789/0 conn(0x7f75bc0cb390 legacy=0x7f75bc071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a0003b80 0x7f75a0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75bc15bed0 0x7f75a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a0004d50 0x7f75a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc0ca8b0 con 0x7f75a0003b80 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75a000ba80 con 0x7f75a0004d50 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75a000bc80 con 0x7f75bc15bed0 2024-08-18T22:24:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75bb400640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a0003b80 0x7f75a0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75baa00640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75bc15bed0 0x7f75a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75bbe00640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a0004d50 0x7f75a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75bb400640 1 -- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75bc15bed0 msgr2=0x7f75a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75bb400640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75bc15bed0 0x7f75a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75bb400640 1 -- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a0004d50 msgr2=0x7f75a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75bb400640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a0004d50 0x7f75a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.994+0000 7f75bb400640 1 -- 172.21.15.5:0/2557195493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a0003530 con 0x7f75a0003b80 2024-08-18T22:24:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75bb400640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a0003b80 0x7f75a0003f80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009cb0 tx=0x7f75ac01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2605f118084c76e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:26.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0b2070 con 0x7f75a0003b80 2024-08-18T22:24:26.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ac0a5880 con 0x7f75a0003b80 2024-08-18T22:24:26.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75ba000640 1 -- 172.21.15.5:0/2557195493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac009880 con 0x7f75a0003b80 2024-08-18T22:24:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75c2800640 1 -- 172.21.15.5:0/2557195493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a0003b80 msgr2=0x7f75a0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75c2800640 1 --2- 172.21.15.5:0/2557195493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a0003b80 0x7f75a0003f80 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009cb0 tx=0x7f75ac01cbe0 comp rx=0 tx=0).stop 2024-08-18T22:24:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75bbe00640 1 -- 172.21.15.5:0/2557195493 reap_dead start 2024-08-18T22:24:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75c2800640 1 -- 172.21.15.5:0/2557195493 shutdown_connections 2024-08-18T22:24:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75c2800640 1 -- 172.21.15.5:0/2557195493 >> 172.21.15.5:0/2557195493 conn(0x7f75bc0b1c50 msgr2=0x7f75bc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75c2800640 1 -- 172.21.15.5:0/2557195493 shutdown_connections 2024-08-18T22:24:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75c2800640 1 -- 172.21.15.5:0/2557195493 wait complete. 2024-08-18T22:24:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75c2800640 1 Processor -- start 2024-08-18T22:24:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:26.998+0000 7f75c2800640 1 -- start start 2024-08-18T22:24:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75c2800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a0003b80 0x7f75bc151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75c2800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75bc1568a0 0x7f75bc0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75c2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75bc156d20 0x7f75bc0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75c2800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc15c430 con 0x7f75bc156d20 2024-08-18T22:24:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75c2800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc15c2b0 con 0x7f75bc1568a0 2024-08-18T22:24:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75c2800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75bc167ab0 con 0x7f75a0003b80 2024-08-18T22:24:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75bbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75bc156d20 0x7f75bc0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75bbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75bc156d20 0x7f75bc0c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35366/0 (socket says 172.21.15.5:35366) 2024-08-18T22:24:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75bbe00640 1 -- 172.21.15.5:0/1868997768 learned_addr learned my addr 172.21.15.5:0/1868997768 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75baa00640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75bc1568a0 0x7f75bc0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75bb400640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a0003b80 0x7f75bc151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75bbe00640 1 -- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a0003b80 msgr2=0x7f75bc151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75bbe00640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a0003b80 0x7f75bc151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75bbe00640 1 -- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75bc1568a0 msgr2=0x7f75bc0c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75bbe00640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75bc1568a0 0x7f75bc0c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75bbe00640 1 -- 172.21.15.5:0/1868997768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc0ceb20 con 0x7f75bc156d20 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75baa00640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75bc1568a0 0x7f75bc0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75bbe00640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75bc156d20 0x7f75bc0c9810 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f75b400fae0 tx=0x7f75b4002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75b3400640 1 -- 172.21.15.5:0/1868997768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4019070 con 0x7f75bc156d20 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75b3400640 1 -- 172.21.15.5:0/1868997768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b4006e30 con 0x7f75bc156d20 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75b3400640 1 -- 172.21.15.5:0/1868997768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4003ba0 con 0x7f75bc156d20 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75c2800640 1 -- 172.21.15.5:0/1868997768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75bc0cee00 con 0x7f75bc156d20 2024-08-18T22:24:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75c2800640 1 -- 172.21.15.5:0/1868997768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75bc0cf3c0 con 0x7f75bc156d20 2024-08-18T22:24:27.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75c2800640 1 -- 172.21.15.5:0/1868997768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75bc071b20 con 0x7f75bc156d20 2024-08-18T22:24:27.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.002+0000 7f75b3400640 1 -- 172.21.15.5:0/1868997768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f75b400d7d0 con 0x7f75bc156d20 2024-08-18T22:24:27.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.006+0000 7f75b3400640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f759c0678f0 0x7f759c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.006+0000 7f75b3400640 1 -- 172.21.15.5:0/1868997768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7f75b4085180 con 0x7f75bc156d20 2024-08-18T22:24:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.006+0000 7f75bb400640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f759c0678f0 0x7f759c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.006+0000 7f75bb400640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f759c0678f0 0x7f759c069db0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0af000 tx=0x7f75ac0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:27.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.010+0000 7f75b3400640 1 -- 172.21.15.5:0/1868997768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f75b4055b10 con 0x7f75bc156d20 2024-08-18T22:24:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.206+0000 7f75c2800640 1 -- 172.21.15.5:0/1868997768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75bc0b2190 con 0x7f75bc156d20 2024-08-18T22:24:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.206+0000 7f75b3400640 1 -- 172.21.15.5:0/1868997768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5217 (secure 0 0 0) 0x7f75b4055410 con 0x7f75bc156d20 2024-08-18T22:24:27.209 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:27.209 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":63,"btime":"2024-08-18T22:24:11:322415+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/625897913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":625897913},{"type":"v1","addr":"172.21.15.117:6837","nonce":625897913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/128531097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":128531097},{"type":"v1","addr":"172.21.15.5:6835","nonce":128531097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3673408015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3673408015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3673408015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:23:53.630789+0000","modified":"2024-08-18T22:24:11.322406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6589},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6589":{"gid":6589,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6835/349592920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":349592920},{"type":"v1","addr":"172.21.15.117:6835","nonce":349592920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6589,"qdb_cluster":[6589]},"id":5}]} 2024-08-18T22:24:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 63 2024-08-18T22:24:27.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 -- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f759c0678f0 msgr2=0x7f759c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f759c0678f0 0x7f759c069db0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0af000 tx=0x7f75ac0046d0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 -- 172.21.15.5:0/1868997768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75bc156d20 msgr2=0x7f75bc0c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75bc156d20 0x7f75bc0c9810 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f75b400fae0 tx=0x7f75b4002190 comp rx=0 tx=0).stop 2024-08-18T22:24:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 -- 172.21.15.5:0/1868997768 shutdown_connections 2024-08-18T22:24:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f759c0678f0 0x7f759c069db0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75bc156d20 0x7f75bc0c9810 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75bc1568a0 0x7f75bc0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 --2- 172.21.15.5:0/1868997768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a0003b80 0x7f75bc151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 -- 172.21.15.5:0/1868997768 >> 172.21.15.5:0/1868997768 conn(0x7f75bc0b1c50 msgr2=0x7f75bc0b11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 -- 172.21.15.5:0/1868997768 shutdown_connections 2024-08-18T22:24:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.210+0000 7f75c2800640 1 -- 172.21.15.5:0/1868997768 wait complete. 2024-08-18T22:24:27.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:24:27.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.370+0000 7f08e6000640 1 Processor -- start 2024-08-18T22:24:27.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.370+0000 7f08e6000640 1 -- start start 2024-08-18T22:24:27.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.370+0000 7f08e6000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f08e015bed0 0x7f08e00735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.370+0000 7f08e6000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e00cb390 0x7f08e0071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.370+0000 7f08e6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08e006da70 0x7f08e006df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.370+0000 7f08e6000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f08e0072060 con 0x7f08e006da70 2024-08-18T22:24:27.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.370+0000 7f08e6000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f08e0073c80 con 0x7f08e015bed0 2024-08-18T22:24:27.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.370+0000 7f08e6000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f08e00ca5d0 con 0x7f08e00cb390 2024-08-18T22:24:27.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.374+0000 7f08dfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08e006da70 0x7f08e006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.374+0000 7f08dfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08e006da70 0x7f08e006df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35380/0 (socket says 172.21.15.5:35380) 2024-08-18T22:24:27.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.374+0000 7f08dfe00640 1 -- 172.21.15.5:0/2244904198 learned_addr learned my addr 172.21.15.5:0/2244904198 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:27.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.374+0000 7f08d7e00640 1 --2- 172.21.15.5:0/2244904198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e00cb390 0x7f08e0071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.374+0000 7f08df400640 1 --2- 172.21.15.5:0/2244904198 >> v2:172.21.15.117:3300/0 conn(0x7f08e015bed0 0x7f08e00735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.374+0000 7f08dfe00640 1 -- 172.21.15.5:0/2244904198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e00cb390 msgr2=0x7f08e0071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:27.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.374+0000 7f08dfe00640 1 --2- 172.21.15.5:0/2244904198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e00cb390 0x7f08e0071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.374+0000 7f08dfe00640 1 -- 172.21.15.5:0/2244904198 >> v2:172.21.15.117:3300/0 conn(0x7f08e015bed0 msgr2=0x7f08e00735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:27.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.374+0000 7f08dfe00640 1 --2- 172.21.15.5:0/2244904198 >> v2:172.21.15.117:3300/0 conn(0x7f08e015bed0 0x7f08e00735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.374+0000 7f08dfe00640 1 -- 172.21.15.5:0/2244904198 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e00ca8b0 con 0x7f08e006da70 2024-08-18T22:24:27.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.374+0000 7f08dfe00640 1 --2- 172.21.15.5:0/2244904198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e006da70 0x7f08e006df00 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f08e00b2cc0 tx=0x7f08d801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7236922f70964da1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:27.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08dea00640 1 -- 172.21.15.5:0/2244904198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d80a5760 con 0x7f08e006da70 2024-08-18T22:24:27.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08dea00640 1 -- 172.21.15.5:0/2244904198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d80a5900 con 0x7f08e006da70 2024-08-18T22:24:27.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08dea00640 1 -- 172.21.15.5:0/2244904198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d80a5cd0 con 0x7f08e006da70 2024-08-18T22:24:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 -- 172.21.15.5:0/2244904198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e006da70 msgr2=0x7f08e006df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 --2- 172.21.15.5:0/2244904198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e006da70 0x7f08e006df00 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f08e00b2cc0 tx=0x7f08d801c9f0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 -- 172.21.15.5:0/2244904198 shutdown_connections 2024-08-18T22:24:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 --2- 172.21.15.5:0/2244904198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e006da70 0x7f08e006df00 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 --2- 172.21.15.5:0/2244904198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e00cb390 0x7f08e0071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 --2- 172.21.15.5:0/2244904198 >> v2:172.21.15.117:3300/0 conn(0x7f08e015bed0 0x7f08e00735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 -- 172.21.15.5:0/2244904198 >> 172.21.15.5:0/2244904198 conn(0x7f08e00b1c50 msgr2=0x7f08e00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 -- 172.21.15.5:0/2244904198 shutdown_connections 2024-08-18T22:24:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 -- 172.21.15.5:0/2244904198 wait complete. 2024-08-18T22:24:27.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 Processor -- start 2024-08-18T22:24:27.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 -- start start 2024-08-18T22:24:27.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e006da70 0x7f08e014f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e00cb390 0x7f08e00b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e015bed0 0x7f08e00c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f08e00ccc40 con 0x7f08e015bed0 2024-08-18T22:24:27.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f08e00ccac0 con 0x7f08e00cb390 2024-08-18T22:24:27.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08e6000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f08e00ccdc0 con 0x7f08e006da70 2024-08-18T22:24:27.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08dfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e015bed0 0x7f08e00c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08dfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e015bed0 0x7f08e00c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35382/0 (socket says 172.21.15.5:35382) 2024-08-18T22:24:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.378+0000 7f08dfe00640 1 -- 172.21.15.5:0/3253682809 learned_addr learned my addr 172.21.15.5:0/3253682809 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08d7e00640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e00cb390 0x7f08e00b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08df400640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e006da70 0x7f08e014f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08dfe00640 1 -- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e006da70 msgr2=0x7f08e014f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08dfe00640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e006da70 0x7f08e014f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08dfe00640 1 -- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e00cb390 msgr2=0x7f08e00b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08dfe00640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e00cb390 0x7f08e00b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08dfe00640 1 -- 172.21.15.5:0/3253682809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e014fb70 con 0x7f08e015bed0 2024-08-18T22:24:27.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08d7e00640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e00cb390 0x7f08e00b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08df400640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e006da70 0x7f08e014f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08dfe00640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e015bed0 0x7f08e00c92d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f08d80af040 tx=0x7f08d8019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08d7400640 1 -- 172.21.15.5:0/3253682809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d8009510 con 0x7f08e015bed0 2024-08-18T22:24:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08d7400640 1 -- 172.21.15.5:0/3253682809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d80be070 con 0x7f08e015bed0 2024-08-18T22:24:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08e6000640 1 -- 172.21.15.5:0/3253682809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e00b09b0 con 0x7f08e015bed0 2024-08-18T22:24:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08d7400640 1 -- 172.21.15.5:0/3253682809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d80b88b0 con 0x7f08e015bed0 2024-08-18T22:24:27.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08e6000640 1 -- 172.21.15.5:0/3253682809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e00b0f70 con 0x7f08e015bed0 2024-08-18T22:24:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08e6000640 1 -- 172.21.15.5:0/3253682809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e006df00 con 0x7f08e015bed0 2024-08-18T22:24:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08d7400640 1 -- 172.21.15.5:0/3253682809 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f08d80b8a50 con 0x7f08e015bed0 2024-08-18T22:24:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08d7400640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08bc0678c0 0x7f08bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.382+0000 7f08d7400640 1 -- 172.21.15.5:0/3253682809 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7f08d8120f40 con 0x7f08e015bed0 2024-08-18T22:24:27.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.386+0000 7f08df400640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08bc0678c0 0x7f08bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.386+0000 7f08df400640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08bc0678c0 0x7f08bc069d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f08e015b5c0 tx=0x7f08d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:27.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.386+0000 7f08d7400640 1 -- 172.21.15.5:0/3253682809 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f08d80165e0 con 0x7f08e015bed0 2024-08-18T22:24:27.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.554+0000 7f08e6000640 1 -- 172.21.15.5:0/3253682809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08e01565e0 con 0x7f08e015bed0 2024-08-18T22:24:27.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.554+0000 7f08d7400640 1 -- 172.21.15.5:0/3253682809 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+17130 (secure 0 0 0) 0x7f08d80f18f0 con 0x7f08e015bed0 2024-08-18T22:24:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:27.556 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:24:08.307631+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:23:51.370291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-08-18T22:23:52.711969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6832/3108112673":"2024-08-19T22:24:08.307602+0000","172.21.15.117:6836/116443176":"2024-08-19T22:24:07.859535+0000","172.21.15.5:6834/3108112673":"2024-08-19T22:24:08.307602+0000","172.21.15.117:6834/116443176":"2024-08-19T22:24:07.859535+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:24:27.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 -- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08bc0678c0 msgr2=0x7f08bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08bc0678c0 0x7f08bc069d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f08e015b5c0 tx=0x7f08d0008040 comp rx=0 tx=0).stop 2024-08-18T22:24:27.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 -- 172.21.15.5:0/3253682809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e015bed0 msgr2=0x7f08e00c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e015bed0 0x7f08e00c92d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f08d80af040 tx=0x7f08d8019790 comp rx=0 tx=0).stop 2024-08-18T22:24:27.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 -- 172.21.15.5:0/3253682809 shutdown_connections 2024-08-18T22:24:27.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08bc0678c0 0x7f08bc069d80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08e015bed0 0x7f08e00c92d0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e00cb390 0x7f08e00b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 --2- 172.21.15.5:0/3253682809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e006da70 0x7f08e014f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 -- 172.21.15.5:0/3253682809 >> 172.21.15.5:0/3253682809 conn(0x7f08e00b1c50 msgr2=0x7f08e015a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 -- 172.21.15.5:0/3253682809 shutdown_connections 2024-08-18T22:24:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.558+0000 7f08e6000640 1 -- 172.21.15.5:0/3253682809 wait complete. 2024-08-18T22:24:27.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:24:27.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.718+0000 7f1398200640 1 Processor -- start 2024-08-18T22:24:27.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.718+0000 7f1398200640 1 -- start start 2024-08-18T22:24:27.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1398200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1390147dd0 0x7f13900b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1398200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f139006c3c0 0x7f139015e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1398200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f139015ee30 0x7f1390161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1398200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f139015f7c0 con 0x7f139015ee30 2024-08-18T22:24:27.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1398200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f13900b6410 con 0x7f1390147dd0 2024-08-18T22:24:27.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1398200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f139015f2c0 con 0x7f139006c3c0 2024-08-18T22:24:27.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1396200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f139015ee30 0x7f1390161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1396200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f139015ee30 0x7f1390161ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35394/0 (socket says 172.21.15.5:35394) 2024-08-18T22:24:27.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1396200640 1 -- 172.21.15.5:0/354995797 learned_addr learned my addr 172.21.15.5:0/354995797 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:27.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1394e00640 1 --2- 172.21.15.5:0/354995797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f139006c3c0 0x7f139015e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1396200640 1 -- 172.21.15.5:0/354995797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f139006c3c0 msgr2=0x7f139015e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:27.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1396200640 1 --2- 172.21.15.5:0/354995797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f139006c3c0 0x7f139015e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1396200640 1 -- 172.21.15.5:0/354995797 >> v2:172.21.15.117:3300/0 conn(0x7f1390147dd0 msgr2=0x7f13900b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:27.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1395800640 1 --2- 172.21.15.5:0/354995797 >> v2:172.21.15.117:3300/0 conn(0x7f1390147dd0 0x7f13900b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1396200640 1 --2- 172.21.15.5:0/354995797 >> v2:172.21.15.117:3300/0 conn(0x7f1390147dd0 0x7f13900b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1396200640 1 -- 172.21.15.5:0/354995797 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13900b46b0 con 0x7f139015ee30 2024-08-18T22:24:27.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1394e00640 1 --2- 172.21.15.5:0/354995797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f139006c3c0 0x7f139015e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:27.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.722+0000 7f1395800640 1 --2- 172.21.15.5:0/354995797 >> v2:172.21.15.117:3300/0 conn(0x7f1390147dd0 0x7f13900b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:27.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1396200640 1 --2- 172.21.15.5:0/354995797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139015ee30 0x7f1390161ec0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f13900d20a0 tx=0x7f138801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854bce275269e08b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:27.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f138fe00640 1 -- 172.21.15.5:0/354995797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13880a5520 con 0x7f139015ee30 2024-08-18T22:24:27.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f138fe00640 1 -- 172.21.15.5:0/354995797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13880a56c0 con 0x7f139015ee30 2024-08-18T22:24:27.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f138fe00640 1 -- 172.21.15.5:0/354995797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13880a5a90 con 0x7f139015ee30 2024-08-18T22:24:27.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 -- 172.21.15.5:0/354995797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139015ee30 msgr2=0x7f1390161ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 --2- 172.21.15.5:0/354995797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139015ee30 0x7f1390161ec0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f13900d20a0 tx=0x7f138801c6a0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 -- 172.21.15.5:0/354995797 shutdown_connections 2024-08-18T22:24:27.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 --2- 172.21.15.5:0/354995797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139015ee30 0x7f1390161ec0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 --2- 172.21.15.5:0/354995797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f139006c3c0 0x7f139015e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 --2- 172.21.15.5:0/354995797 >> v2:172.21.15.117:3300/0 conn(0x7f1390147dd0 0x7f13900b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 -- 172.21.15.5:0/354995797 >> 172.21.15.5:0/354995797 conn(0x7f13900b65f0 msgr2=0x7f13900b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:27.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 -- 172.21.15.5:0/354995797 shutdown_connections 2024-08-18T22:24:27.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 -- 172.21.15.5:0/354995797 wait complete. 2024-08-18T22:24:27.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 Processor -- start 2024-08-18T22:24:27.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 -- start start 2024-08-18T22:24:27.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139006c3c0 0x7f139013f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1390147dd0 0x7f1390137220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f139015ee30 0x7f1390134b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f139015f9e0 con 0x7f139006c3c0 2024-08-18T22:24:27.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f13900b5ef0 con 0x7f139015ee30 2024-08-18T22:24:27.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1398200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f13900b5b30 con 0x7f1390147dd0 2024-08-18T22:24:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1395800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139006c3c0 0x7f139013f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1395800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139006c3c0 0x7f139013f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35406/0 (socket says 172.21.15.5:35406) 2024-08-18T22:24:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.726+0000 7f1395800640 1 -- 172.21.15.5:0/2273878029 learned_addr learned my addr 172.21.15.5:0/2273878029 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1396200640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f139015ee30 0x7f1390134b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1394e00640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1390147dd0 0x7f1390137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1395800640 1 -- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1390147dd0 msgr2=0x7f1390137220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1395800640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1390147dd0 0x7f1390137220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1395800640 1 -- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f139015ee30 msgr2=0x7f1390134b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1395800640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f139015ee30 0x7f1390134b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1395800640 1 -- 172.21.15.5:0/2273878029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1390137b70 con 0x7f139006c3c0 2024-08-18T22:24:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1395800640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139006c3c0 0x7f139013f240 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f138400c7f0 tx=0x7f138400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f138d600640 1 -- 172.21.15.5:0/2273878029 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384007a30 con 0x7f139006c3c0 2024-08-18T22:24:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f138d600640 1 -- 172.21.15.5:0/2273878029 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1384007bd0 con 0x7f139006c3c0 2024-08-18T22:24:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f138d600640 1 -- 172.21.15.5:0/2273878029 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13840113f0 con 0x7f139006c3c0 2024-08-18T22:24:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1398200640 1 -- 172.21.15.5:0/2273878029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1390139180 con 0x7f139006c3c0 2024-08-18T22:24:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1398200640 1 -- 172.21.15.5:0/2273878029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1390139740 con 0x7f139006c3c0 2024-08-18T22:24:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1398200640 1 -- 172.21.15.5:0/2273878029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13900b40d0 con 0x7f139006c3c0 2024-08-18T22:24:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f138d600640 1 -- 172.21.15.5:0/2273878029 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1384011590 con 0x7f139006c3c0 2024-08-18T22:24:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f138d600640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13700678f0 0x7f1370069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f138d600640 1 -- 172.21.15.5:0/2273878029 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6273+0+0 (secure 0 0 0) 0x7f13840860c0 con 0x7f139006c3c0 2024-08-18T22:24:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.730+0000 7f1394e00640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13700678f0 0x7f1370069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.734+0000 7f1394e00640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13700678f0 0x7f1370069db0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f137c006fd0 tx=0x7f137c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.734+0000 7f138d600640 1 -- 172.21.15.5:0/2273878029 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1384015020 con 0x7f139006c3c0 2024-08-18T22:24:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.938+0000 7f1398200640 1 -- 172.21.15.5:0/2273878029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f13900706d0 con 0x7f139006c3c0 2024-08-18T22:24:27.938 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:24:27.938+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:24:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.938+0000 7f138d600640 1 -- 172.21.15.5:0/2273878029 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) ==== 161+0+0 (secure 0 0 0) 0x7f1384056920 con 0x7f139006c3c0 2024-08-18T22:24:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 -- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13700678f0 msgr2=0x7f1370069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13700678f0 0x7f1370069db0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f137c006fd0 tx=0x7f137c008040 comp rx=0 tx=0).stop 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 -- 172.21.15.5:0/2273878029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139006c3c0 msgr2=0x7f139013f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139006c3c0 0x7f139013f240 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f138400c7f0 tx=0x7f138400ccb0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 -- 172.21.15.5:0/2273878029 shutdown_connections 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13700678f0 0x7f1370069db0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f139015ee30 0x7f1390134b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1390147dd0 0x7f1390137220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 --2- 172.21.15.5:0/2273878029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f139006c3c0 0x7f139013f240 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 -- 172.21.15.5:0/2273878029 >> 172.21.15.5:0/2273878029 conn(0x7f13900b65f0 msgr2=0x7f1390147060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 -- 172.21.15.5:0/2273878029 shutdown_connections 2024-08-18T22:24:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:27.942+0000 7f1398200640 1 -- 172.21.15.5:0/2273878029 wait complete. 2024-08-18T22:24:27.952 INFO:tasks.ceph.mds.b.smithi117.stderr: -2356> 2024-08-18T22:24:13.316+0000 7fb397e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:24:27.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:24:28.000 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:24:28.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88fd000640 1 Processor -- start 2024-08-18T22:24:28.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88fd000640 1 -- start start 2024-08-18T22:24:28.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88fd000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88f80d15e0 0x7f88f80b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:28.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88fd000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f80d30b0 con 0x7f88f815fb80 2024-08-18T22:24:28.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88fd000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f80d1bd0 con 0x7f88f80d1090 2024-08-18T22:24:28.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88fd000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f88f8071c60 con 0x7f88f80d15e0 2024-08-18T22:24:28.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88f5e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f88f815fb80 0x7f88f806fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44996/0 (socket says 172.21.15.5:44996) 2024-08-18T22:24:28.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88f5e00640 1 -- 172.21.15.5:0/612544852 learned_addr learned my addr 172.21.15.5:0/612544852 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:28.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88f6800640 1 --2- 172.21.15.5:0/612544852 >> v2:172.21.15.5:3300/0 conn(0x7f88f80d15e0 0x7f88f80b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:28.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88f5400640 1 -- 172.21.15.5:0/612544852 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3860342771 0 0) 0x7f88f80d30b0 con 0x7f88f815fb80 2024-08-18T22:24:28.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88f5400640 1 -- 172.21.15.5:0/612544852 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88dc003530 con 0x7f88f815fb80 2024-08-18T22:24:28.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88f6800640 1 -- 172.21.15.5:0/612544852 >> v1:172.21.15.117:6789/0 conn(0x7f88f80d1090 legacy=0x7f88f8071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:28.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88f6800640 1 -- 172.21.15.5:0/612544852 >> v1:172.21.15.5:6789/0 conn(0x7f88f815fb80 legacy=0x7f88f806fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:28.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.106+0000 7f88f6800640 1 -- 172.21.15.5:0/612544852 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f80d2dd0 con 0x7f88f80d15e0 2024-08-18T22:24:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.110+0000 7f88f6800640 1 --2- 172.21.15.5:0/612544852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f80d15e0 0x7f88f80b5ad0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f88f00097c0 tx=0x7f88f0020790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fad858973b2ea6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.110+0000 7f88f5400640 1 -- 172.21.15.5:0/612544852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f00ad460 con 0x7f88f80d15e0 2024-08-18T22:24:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.110+0000 7f88f5400640 1 -- 172.21.15.5:0/612544852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f00ad600 con 0x7f88f80d15e0 2024-08-18T22:24:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.110+0000 7f88f5400640 1 -- 172.21.15.5:0/612544852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f00ad9b0 con 0x7f88f80d15e0 2024-08-18T22:24:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.110+0000 7f88fd000640 1 -- 172.21.15.5:0/612544852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f80d15e0 msgr2=0x7f88f80b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.110+0000 7f88fd000640 1 --2- 172.21.15.5:0/612544852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f80d15e0 0x7f88f80b5ad0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f88f00097c0 tx=0x7f88f0020790 comp rx=0 tx=0).stop 2024-08-18T22:24:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.110+0000 7f88fd000640 1 -- 172.21.15.5:0/612544852 shutdown_connections 2024-08-18T22:24:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.110+0000 7f88fd000640 1 --2- 172.21.15.5:0/612544852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f80d15e0 0x7f88f80b5ad0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.110+0000 7f88fd000640 1 -- 172.21.15.5:0/612544852 >> 172.21.15.5:0/612544852 conn(0x7f88f80d2180 msgr2=0x7f88f80d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.110+0000 7f88fd000640 1 -- 172.21.15.5:0/612544852 shutdown_connections 2024-08-18T22:24:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.110+0000 7f88fd000640 1 -- 172.21.15.5:0/612544852 wait complete. 2024-08-18T22:24:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88fd000640 1 Processor -- start 2024-08-18T22:24:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88fd000640 1 -- start start 2024-08-18T22:24:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88fd000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80d1090 0x7f88f815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88fd000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80d15e0 0x7f88f814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88fd000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f815fb80 0x7f88f814c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88fd000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f88f8168300 con 0x7f88f815fb80 2024-08-18T22:24:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88fd000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f88f80d1eb0 con 0x7f88f80d1090 2024-08-18T22:24:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88fd000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f88f8168480 con 0x7f88f80d15e0 2024-08-18T22:24:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88f6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f815fb80 0x7f88f814c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88f6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f815fb80 0x7f88f814c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35428/0 (socket says 172.21.15.5:35428) 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88f6800640 1 -- 172.21.15.5:0/2272722372 learned_addr learned my addr 172.21.15.5:0/2272722372 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88ed400640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80d15e0 0x7f88f814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88f5e00640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80d1090 0x7f88f815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88f6800640 1 -- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80d15e0 msgr2=0x7f88f814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88f6800640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80d15e0 0x7f88f814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88f6800640 1 -- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80d1090 msgr2=0x7f88f815a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88f6800640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80d1090 0x7f88f815a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88f6800640 1 -- 172.21.15.5:0/2272722372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f80afb80 con 0x7f88f815fb80 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88ed400640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80d15e0 0x7f88f814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88f5e00640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80d1090 0x7f88f815a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88f6800640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f815fb80 0x7f88f814c1e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f88f00097c0 tx=0x7f88f001efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88eea00640 1 -- 172.21.15.5:0/2272722372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f00adbc0 con 0x7f88f815fb80 2024-08-18T22:24:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88eea00640 1 -- 172.21.15.5:0/2272722372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f00c2070 con 0x7f88f815fb80 2024-08-18T22:24:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88eea00640 1 -- 172.21.15.5:0/2272722372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0003620 con 0x7f88f815fb80 2024-08-18T22:24:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88fd000640 1 -- 172.21.15.5:0/2272722372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f80d07f0 con 0x7f88f815fb80 2024-08-18T22:24:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.114+0000 7f88fd000640 1 -- 172.21.15.5:0/2272722372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f814cfb0 con 0x7f88f815fb80 2024-08-18T22:24:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.118+0000 7f88fd000640 1 -- 172.21.15.5:0/2272722372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f80b5ad0 con 0x7f88f815fb80 2024-08-18T22:24:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.118+0000 7f88eea00640 1 -- 172.21.15.5:0/2272722372 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88f00037c0 con 0x7f88f815fb80 2024-08-18T22:24:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.118+0000 7f88eea00640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88d40678f0 0x7f88d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.118+0000 7f88eea00640 1 -- 172.21.15.5:0/2272722372 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6359+0+0 (secure 0 0 0) 0x7f88f0124e00 con 0x7f88f815fb80 2024-08-18T22:24:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.118+0000 7f88f5e00640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88d40678f0 0x7f88d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.118+0000 7f88f5e00640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88d40678f0 0x7f88d4069db0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f88e80011f0 tx=0x7f88e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.122+0000 7f88eea00640 1 -- 172.21.15.5:0/2272722372 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f88f00b1020 con 0x7f88f815fb80 2024-08-18T22:24:28.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.322+0000 7f88fd000640 1 -- 172.21.15.5:0/2272722372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f88f80ce0d0 con 0x7f88f815fb80 2024-08-18T22:24:28.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.942+0000 7f88eea00640 1 -- 172.21.15.5:0/2272722372 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) ==== 104+0+0 (secure 0 0 0) 0x7f88f001a4a0 con 0x7f88f815fb80 2024-08-18T22:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 -- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88d40678f0 msgr2=0x7f88d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88d40678f0 0x7f88d4069db0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f88e80011f0 tx=0x7f88e8009040 comp rx=0 tx=0).stop 2024-08-18T22:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 -- 172.21.15.5:0/2272722372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f815fb80 msgr2=0x7f88f814c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f815fb80 0x7f88f814c1e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f88f00097c0 tx=0x7f88f001efd0 comp rx=0 tx=0).stop 2024-08-18T22:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 -- 172.21.15.5:0/2272722372 shutdown_connections 2024-08-18T22:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88d40678f0 0x7f88d4069db0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f815fb80 0x7f88f814c1e0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80d15e0 0x7f88f814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 --2- 172.21.15.5:0/2272722372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80d1090 0x7f88f815a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 -- 172.21.15.5:0/2272722372 >> 172.21.15.5:0/2272722372 conn(0x7f88f80d2180 msgr2=0x7f88f8071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 -- 172.21.15.5:0/2272722372 shutdown_connections 2024-08-18T22:24:28.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:28.946+0000 7f88fd000640 1 -- 172.21.15.5:0/2272722372 wait complete. 2024-08-18T22:24:28.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:24:29.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40eca00640 1 Processor -- start 2024-08-18T22:24:29.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40eca00640 1 -- start start 2024-08-18T22:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40eca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e80ccaa0 0x7f40e80cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40eca00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40e806dc60 0x7f40e806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40eca00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e80b3260 con 0x7f40e815d1d0 2024-08-18T22:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40eca00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f40e80cfe90 con 0x7f40e806dc60 2024-08-18T22:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40eca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f40e80b37e0 con 0x7f40e80ccaa0 2024-08-18T22:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40dd400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f40e815d1d0 0x7f40e80cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45008/0 (socket says 172.21.15.5:45008) 2024-08-18T22:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40dd400640 1 -- 172.21.15.5:0/3787745004 learned_addr learned my addr 172.21.15.5:0/3787745004 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40e5e00640 1 --2- 172.21.15.5:0/3787745004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e80ccaa0 0x7f40e80cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40e6800640 1 --2- 172.21.15.5:0/3787745004 >> v2:172.21.15.117:3300/0 conn(0x7f40e806dc60 0x7f40e806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40e5400640 1 -- 172.21.15.5:0/3787745004 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620990619 0 0) 0x7f40e80b3260 con 0x7f40e815d1d0 2024-08-18T22:24:29.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40e5400640 1 -- 172.21.15.5:0/3787745004 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40cc003530 con 0x7f40e815d1d0 2024-08-18T22:24:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40e5e00640 1 -- 172.21.15.5:0/3787745004 >> v2:172.21.15.117:3300/0 conn(0x7f40e806dc60 msgr2=0x7f40e806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40e5e00640 1 --2- 172.21.15.5:0/3787745004 >> v2:172.21.15.117:3300/0 conn(0x7f40e806dc60 0x7f40e806e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40e5e00640 1 -- 172.21.15.5:0/3787745004 >> v1:172.21.15.5:6789/0 conn(0x7f40e815d1d0 legacy=0x7f40e80cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.118+0000 7f40e5e00640 1 -- 172.21.15.5:0/3787745004 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e815d630 con 0x7f40e80ccaa0 2024-08-18T22:24:29.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40e5e00640 1 --2- 172.21.15.5:0/3787745004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e80ccaa0 0x7f40e80cf760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40d80097c0 tx=0x7f40d801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1a6bf264e070a1c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40e5400640 1 -- 172.21.15.5:0/3787745004 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80b0070 con 0x7f40e80ccaa0 2024-08-18T22:24:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40e5400640 1 -- 172.21.15.5:0/3787745004 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d80ab600 con 0x7f40e80ccaa0 2024-08-18T22:24:29.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40e5400640 1 -- 172.21.15.5:0/3787745004 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80ab9b0 con 0x7f40e80ccaa0 2024-08-18T22:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40eca00640 1 -- 172.21.15.5:0/3787745004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e80ccaa0 msgr2=0x7f40e80cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40eca00640 1 --2- 172.21.15.5:0/3787745004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e80ccaa0 0x7f40e80cf760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40d80097c0 tx=0x7f40d801c410 comp rx=0 tx=0).stop 2024-08-18T22:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40eca00640 1 -- 172.21.15.5:0/3787745004 shutdown_connections 2024-08-18T22:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40eca00640 1 --2- 172.21.15.5:0/3787745004 >> v2:172.21.15.117:3300/0 conn(0x7f40e806dc60 0x7f40e806e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40eca00640 1 --2- 172.21.15.5:0/3787745004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e80ccaa0 0x7f40e80cf760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40eca00640 1 -- 172.21.15.5:0/3787745004 >> 172.21.15.5:0/3787745004 conn(0x7f40e806b9b0 msgr2=0x7f40e806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40eca00640 1 -- 172.21.15.5:0/3787745004 shutdown_connections 2024-08-18T22:24:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.122+0000 7f40eca00640 1 -- 172.21.15.5:0/3787745004 wait complete. 2024-08-18T22:24:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40eca00640 1 Processor -- start 2024-08-18T22:24:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40eca00640 1 -- start start 2024-08-18T22:24:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40eca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e806dc60 0x7f40e8157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40eca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e80ccaa0 0x7f40e81f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40eca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e815d1d0 0x7f40e81f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40eca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f40e806ebe0 con 0x7f40e80ccaa0 2024-08-18T22:24:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40eca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f40e806ea60 con 0x7f40e815d1d0 2024-08-18T22:24:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40eca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f40e8169510 con 0x7f40e806dc60 2024-08-18T22:24:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dd400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e80ccaa0 0x7f40e81f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dd400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e80ccaa0 0x7f40e81f6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35442/0 (socket says 172.21.15.5:35442) 2024-08-18T22:24:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dd400640 1 -- 172.21.15.5:0/108152150 learned_addr learned my addr 172.21.15.5:0/108152150 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40e5e00640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e806dc60 0x7f40e8157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40e6800640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e815d1d0 0x7f40e81f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dd400640 1 -- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e806dc60 msgr2=0x7f40e8157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dd400640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e806dc60 0x7f40e8157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dd400640 1 -- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e815d1d0 msgr2=0x7f40e81f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dd400640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e815d1d0 0x7f40e81f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dd400640 1 -- 172.21.15.5:0/108152150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e815aa00 con 0x7f40e80ccaa0 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dd400640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e80ccaa0 0x7f40e81f6f80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f40d000c390 tx=0x7f40d000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dea00640 1 -- 172.21.15.5:0/108152150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0017070 con 0x7f40e80ccaa0 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dea00640 1 -- 172.21.15.5:0/108152150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d0005d10 con 0x7f40e80ccaa0 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40dea00640 1 -- 172.21.15.5:0/108152150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0007310 con 0x7f40e80ccaa0 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40eca00640 1 -- 172.21.15.5:0/108152150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e815ace0 con 0x7f40e80ccaa0 2024-08-18T22:24:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.126+0000 7f40eca00640 1 -- 172.21.15.5:0/108152150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e815b2a0 con 0x7f40e80ccaa0 2024-08-18T22:24:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.130+0000 7f40eca00640 1 -- 172.21.15.5:0/108152150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e80cf760 con 0x7f40e80ccaa0 2024-08-18T22:24:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.130+0000 7f40dea00640 1 -- 172.21.15.5:0/108152150 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f40d001a070 con 0x7f40e80ccaa0 2024-08-18T22:24:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.130+0000 7f40dea00640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40c40678c0 0x7f40c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.130+0000 7f40dea00640 1 -- 172.21.15.5:0/108152150 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6359+0+0 (secure 0 0 0) 0x7f40d00852a0 con 0x7f40e80ccaa0 2024-08-18T22:24:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.130+0000 7f40e5e00640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40c40678c0 0x7f40c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.130+0000 7f40e5e00640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40c40678c0 0x7f40c4069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f40d80ad000 tx=0x7f40d80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.134+0000 7f40dea00640 1 -- 172.21.15.5:0/108152150 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f40d00555b0 con 0x7f40e80ccaa0 2024-08-18T22:24:29.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.298+0000 7f40eca00640 1 -- 172.21.15.5:0/108152150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f40e80b08a0 con 0x7f40e80ccaa0 2024-08-18T22:24:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.942+0000 7f40dea00640 1 -- 172.21.15.5:0/108152150 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) ==== 181+0+0 (secure 0 0 0) 0x7f40d00598b0 con 0x7f40e80ccaa0 2024-08-18T22:24:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:24:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 -- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40c40678c0 msgr2=0x7f40c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40c40678c0 0x7f40c4069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f40d80ad000 tx=0x7f40d80a6000 comp rx=0 tx=0).stop 2024-08-18T22:24:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 -- 172.21.15.5:0/108152150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e80ccaa0 msgr2=0x7f40e81f6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e80ccaa0 0x7f40e81f6f80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f40d000c390 tx=0x7f40d000c850 comp rx=0 tx=0).stop 2024-08-18T22:24:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 -- 172.21.15.5:0/108152150 shutdown_connections 2024-08-18T22:24:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40c40678c0 0x7f40c4069d80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e815d1d0 0x7f40e81f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e80ccaa0 0x7f40e81f6f80 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 --2- 172.21.15.5:0/108152150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e806dc60 0x7f40e8157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:29.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 -- 172.21.15.5:0/108152150 >> 172.21.15.5:0/108152150 conn(0x7f40e806b9b0 msgr2=0x7f40e80ad0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:29.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 -- 172.21.15.5:0/108152150 shutdown_connections 2024-08-18T22:24:29.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:29.946+0000 7f40eca00640 1 -- 172.21.15.5:0/108152150 wait complete. 2024-08-18T22:24:29.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:24:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04df600640 1 Processor -- start 2024-08-18T22:24:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04df600640 1 -- start start 2024-08-18T22:24:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04df600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80b0ee0 0x7f04d80b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04df600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04d80ae040 0x7f04d80cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04df600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d80d1a10 con 0x7f04d80b0410 2024-08-18T22:24:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04df600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f04d80b0b10 con 0x7f04d80ae040 2024-08-18T22:24:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04df600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04d80d1cf0 con 0x7f04d80b0ee0 2024-08-18T22:24:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04cfe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f04d80b0410 0x7f04d80b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45024/0 (socket says 172.21.15.5:45024) 2024-08-18T22:24:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04cfe00640 1 -- 172.21.15.5:0/1087323164 learned_addr learned my addr 172.21.15.5:0/1087323164 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04dd600640 1 --2- 172.21.15.5:0/1087323164 >> v2:172.21.15.117:3300/0 conn(0x7f04d80ae040 0x7f04d80cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04dcc00640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80b0ee0 0x7f04d80b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456066081 0 0) 0x7f04d80d1a10 con 0x7f04d80b0410 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04bc003530 con 0x7f04d80b0410 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3595822553 0 0) 0x7f04bc003530 con 0x7f04d80b0410 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80b0ee0 msgr2=0x7f04d80b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80b0ee0 0x7f04d80b6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 >> v2:172.21.15.117:3300/0 conn(0x7f04d80ae040 msgr2=0x7f04d80cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 --2- 172.21.15.5:0/1087323164 >> v2:172.21.15.117:3300/0 conn(0x7f04d80ae040 0x7f04d80cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d80cf690 con 0x7f04d80b0410 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f04c0001680 con 0x7f04d80b0410 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 >> v1:172.21.15.5:6789/0 conn(0x7f04d80b0410 legacy=0x7f04d80b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04bc0039c0 0x7f04bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:30.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80b0ee0 0x7f04bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04bc004d50 0x7f04bc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80b0b10 con 0x7f04bc004d50 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80d1cf0 con 0x7f04bc0039c0 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04bc00b9d0 con 0x7f04d80b0ee0 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04dd600640 1 --2- 172.21.15.5:0/1087323164 >> v2:172.21.15.117:3300/0 conn(0x7f04d80ae040 0x7f04d80cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04dd600640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04bc004d50 0x7f04bc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04dcc00640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04bc0039c0 0x7f04bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04cfe00640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80b0ee0 0x7f04bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04dd600640 1 -- 172.21.15.5:0/1087323164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80b0ee0 msgr2=0x7f04bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04dd600640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80b0ee0 0x7f04bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04dd600640 1 -- 172.21.15.5:0/1087323164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04bc0039c0 msgr2=0x7f04bc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04dd600640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04bc0039c0 0x7f04bc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.122+0000 7f04dd600640 1 -- 172.21.15.5:0/1087323164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04bc003530 con 0x7f04bc004d50 2024-08-18T22:24:30.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.126+0000 7f04dd600640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04bc004d50 0x7f04bc0051d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f04d000e350 tx=0x7f04d001ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07b7dd6551a37c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.126+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0009dc0 con 0x7f04bc004d50 2024-08-18T22:24:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.126+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d00039a0 con 0x7f04bc004d50 2024-08-18T22:24:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.126+0000 7f04d7e00640 1 -- 172.21.15.5:0/1087323164 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0003d90 con 0x7f04bc004d50 2024-08-18T22:24:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.126+0000 7f04df600640 1 -- 172.21.15.5:0/1087323164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04bc004d50 msgr2=0x7f04bc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.126+0000 7f04df600640 1 --2- 172.21.15.5:0/1087323164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04bc004d50 0x7f04bc0051d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f04d000e350 tx=0x7f04d001ce60 comp rx=0 tx=0).stop 2024-08-18T22:24:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.126+0000 7f04dd600640 1 -- 172.21.15.5:0/1087323164 reap_dead start 2024-08-18T22:24:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.126+0000 7f04df600640 1 -- 172.21.15.5:0/1087323164 shutdown_connections 2024-08-18T22:24:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.126+0000 7f04df600640 1 -- 172.21.15.5:0/1087323164 >> 172.21.15.5:0/1087323164 conn(0x7f04d809aa40 msgr2=0x7f04d80b6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.126+0000 7f04df600640 1 -- 172.21.15.5:0/1087323164 shutdown_connections 2024-08-18T22:24:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.126+0000 7f04df600640 1 -- 172.21.15.5:0/1087323164 wait complete. 2024-08-18T22:24:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04df600640 1 Processor -- start 2024-08-18T22:24:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04df600640 1 -- start start 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04df600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04bc004d50 0x7f04d81e9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04df600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04d80ce2a0 0x7f04d80b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04df600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80ce6e0 0x7f04d8155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04df600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80ae4f0 con 0x7f04d80ce2a0 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04df600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80cf340 con 0x7f04bc004d50 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04df600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04d80ae670 con 0x7f04d80ce6e0 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04cfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04d80ce2a0 0x7f04d80b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04cfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04d80ce2a0 0x7f04d80b67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35468/0 (socket says 172.21.15.5:35468) 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04cfe00640 1 -- 172.21.15.5:0/757384012 learned_addr learned my addr 172.21.15.5:0/757384012 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04dd600640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80ce6e0 0x7f04d8155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04dcc00640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04bc004d50 0x7f04d81e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04cfe00640 1 -- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80ce6e0 msgr2=0x7f04d8155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04cfe00640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80ce6e0 0x7f04d8155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:30.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04cfe00640 1 -- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04bc004d50 msgr2=0x7f04d81e9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:30.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04cfe00640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04bc004d50 0x7f04d81e9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:30.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04cfe00640 1 -- 172.21.15.5:0/757384012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d80cd200 con 0x7f04d80ce2a0 2024-08-18T22:24:30.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04cfe00640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04d80ce2a0 0x7f04d80b67c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f04c000e7e0 tx=0x7f04c000ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:30.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04d5600640 1 -- 172.21.15.5:0/757384012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c000c6c0 con 0x7f04d80ce2a0 2024-08-18T22:24:30.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04d5600640 1 -- 172.21.15.5:0/757384012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c0018070 con 0x7f04d80ce2a0 2024-08-18T22:24:30.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04d5600640 1 -- 172.21.15.5:0/757384012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c000caa0 con 0x7f04d80ce2a0 2024-08-18T22:24:30.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04df600640 1 -- 172.21.15.5:0/757384012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d80cd4e0 con 0x7f04d80ce2a0 2024-08-18T22:24:30.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.130+0000 7f04df600640 1 -- 172.21.15.5:0/757384012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d80cdaa0 con 0x7f04d80ce2a0 2024-08-18T22:24:30.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.134+0000 7f04df600640 1 -- 172.21.15.5:0/757384012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d815c5d0 con 0x7f04d80ce2a0 2024-08-18T22:24:30.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.134+0000 7f04d5600640 1 -- 172.21.15.5:0/757384012 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04c000cc40 con 0x7f04d80ce2a0 2024-08-18T22:24:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.134+0000 7f04d5600640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04b40678c0 0x7f04b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.134+0000 7f04d5600640 1 -- 172.21.15.5:0/757384012 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5921+0+0 (secure 0 0 0) 0x7f04c0085b40 con 0x7f04d80ce2a0 2024-08-18T22:24:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.134+0000 7f04dcc00640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04b40678c0 0x7f04b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.134+0000 7f04dcc00640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04b40678c0 0x7f04b4069d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009be0 tx=0x7f04c8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.138+0000 7f04d5600640 1 -- 172.21.15.5:0/757384012 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f04c0056500 con 0x7f04d80ce2a0 2024-08-18T22:24:30.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.302+0000 7f04df600640 1 -- 172.21.15.5:0/757384012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f04d81ea280 con 0x7f04d80ce2a0 2024-08-18T22:24:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.946+0000 7f04d5600640 1 -- 172.21.15.5:0/757384012 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) ==== 169+0+0 (secure 0 0 0) 0x7f04c0055e00 con 0x7f04d80ce2a0 2024-08-18T22:24:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:24:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 -- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04b40678c0 msgr2=0x7f04b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04b40678c0 0x7f04b4069d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009be0 tx=0x7f04c8009190 comp rx=0 tx=0).stop 2024-08-18T22:24:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 -- 172.21.15.5:0/757384012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04d80ce2a0 msgr2=0x7f04d80b67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04d80ce2a0 0x7f04d80b67c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f04c000e7e0 tx=0x7f04c000ebe0 comp rx=0 tx=0).stop 2024-08-18T22:24:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 -- 172.21.15.5:0/757384012 shutdown_connections 2024-08-18T22:24:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04b40678c0 0x7f04b4069d80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80ce6e0 0x7f04d8155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04d80ce2a0 0x7f04d80b67c0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 --2- 172.21.15.5:0/757384012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04bc004d50 0x7f04d81e9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 -- 172.21.15.5:0/757384012 >> 172.21.15.5:0/757384012 conn(0x7f04d809aa40 msgr2=0x7f04d80ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 -- 172.21.15.5:0/757384012 shutdown_connections 2024-08-18T22:24:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:30.950+0000 7f04df600640 1 -- 172.21.15.5:0/757384012 wait complete. 2024-08-18T22:24:30.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:24:31.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e4000640 1 Processor -- start 2024-08-18T22:24:31.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e4000640 1 -- start start 2024-08-18T22:24:31.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e4000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54dc09aca0 0x7f54dc0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e4000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f54dc0b1300 0x7f54dc0affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e4000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54dc09b080 0x7f54dc0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e4000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f54dc06e8a0 con 0x7f54dc09b080 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e4000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f54dc09bb80 con 0x7f54dc0b1300 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e4000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f54dc0d2e40 con 0x7f54dc09aca0 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e2000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54dc09b080 0x7f54dc0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e2000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54dc09b080 0x7f54dc0b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35474/0 (socket says 172.21.15.5:35474) 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e2000640 1 -- 172.21.15.5:0/626159249 learned_addr learned my addr 172.21.15.5:0/626159249 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e1600640 1 --2- 172.21.15.5:0/626159249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54dc09aca0 0x7f54dc0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e0c00640 1 --2- 172.21.15.5:0/626159249 >> v2:172.21.15.117:3300/0 conn(0x7f54dc0b1300 0x7f54dc0affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e2000640 1 -- 172.21.15.5:0/626159249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54dc09aca0 msgr2=0x7f54dc0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e2000640 1 --2- 172.21.15.5:0/626159249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54dc09aca0 0x7f54dc0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e2000640 1 -- 172.21.15.5:0/626159249 >> v2:172.21.15.117:3300/0 conn(0x7f54dc0b1300 msgr2=0x7f54dc0affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e2000640 1 --2- 172.21.15.5:0/626159249 >> v2:172.21.15.117:3300/0 conn(0x7f54dc0b1300 0x7f54dc0affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.134+0000 7f54e2000640 1 -- 172.21.15.5:0/626159249 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc06cbd0 con 0x7f54dc09b080 2024-08-18T22:24:31.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e2000640 1 --2- 172.21.15.5:0/626159249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc09b080 0x7f54dc0b0510 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009e50 tx=0x7f54d401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ef29664753cb57 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54dbe00640 1 -- 172.21.15.5:0/626159249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40a5780 con 0x7f54dc09b080 2024-08-18T22:24:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54dbe00640 1 -- 172.21.15.5:0/626159249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d40a5920 con 0x7f54dc09b080 2024-08-18T22:24:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54dbe00640 1 -- 172.21.15.5:0/626159249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40a5cf0 con 0x7f54dc09b080 2024-08-18T22:24:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e4000640 1 -- 172.21.15.5:0/626159249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc09b080 msgr2=0x7f54dc0b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e4000640 1 --2- 172.21.15.5:0/626159249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc09b080 0x7f54dc0b0510 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009e50 tx=0x7f54d401c9f0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e4000640 1 -- 172.21.15.5:0/626159249 shutdown_connections 2024-08-18T22:24:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e4000640 1 --2- 172.21.15.5:0/626159249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc09b080 0x7f54dc0b0510 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e4000640 1 --2- 172.21.15.5:0/626159249 >> v2:172.21.15.117:3300/0 conn(0x7f54dc0b1300 0x7f54dc0affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e4000640 1 --2- 172.21.15.5:0/626159249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54dc09aca0 0x7f54dc0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e4000640 1 -- 172.21.15.5:0/626159249 >> 172.21.15.5:0/626159249 conn(0x7f54dc0d2180 msgr2=0x7f54dc0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:31.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e4000640 1 -- 172.21.15.5:0/626159249 shutdown_connections 2024-08-18T22:24:31.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e4000640 1 -- 172.21.15.5:0/626159249 wait complete. 2024-08-18T22:24:31.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e4000640 1 Processor -- start 2024-08-18T22:24:31.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.138+0000 7f54e4000640 1 -- start start 2024-08-18T22:24:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e4000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc09aca0 0x7f54dc140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e4000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54dc09b080 0x7f54dc142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e4000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54dc0b1300 0x7f54dc1577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e4000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc1624e0 con 0x7f54dc09aca0 2024-08-18T22:24:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e4000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc162360 con 0x7f54dc09b080 2024-08-18T22:24:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e4000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f54dc162660 con 0x7f54dc0b1300 2024-08-18T22:24:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e1600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc09aca0 0x7f54dc140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e1600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc09aca0 0x7f54dc140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35486/0 (socket says 172.21.15.5:35486) 2024-08-18T22:24:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e1600640 1 -- 172.21.15.5:0/3237483064 learned_addr learned my addr 172.21.15.5:0/3237483064 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e0c00640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54dc09b080 0x7f54dc142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e2000640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54dc0b1300 0x7f54dc1577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e1600640 1 -- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54dc0b1300 msgr2=0x7f54dc1577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e1600640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54dc0b1300 0x7f54dc1577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e1600640 1 -- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54dc09b080 msgr2=0x7f54dc142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e1600640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54dc09b080 0x7f54dc142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e1600640 1 -- 172.21.15.5:0/3237483064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc143e30 con 0x7f54dc09aca0 2024-08-18T22:24:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e0c00640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54dc09b080 0x7f54dc142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e1600640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc09aca0 0x7f54dc140720 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f54d000d830 tx=0x7f54d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54d9600640 1 -- 172.21.15.5:0/3237483064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0018020 con 0x7f54dc09aca0 2024-08-18T22:24:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54d9600640 1 -- 172.21.15.5:0/3237483064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d00096a0 con 0x7f54dc09aca0 2024-08-18T22:24:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54d9600640 1 -- 172.21.15.5:0/3237483064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0009a50 con 0x7f54dc09aca0 2024-08-18T22:24:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e4000640 1 -- 172.21.15.5:0/3237483064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54dc143870 con 0x7f54dc09aca0 2024-08-18T22:24:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e4000640 1 -- 172.21.15.5:0/3237483064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54dc140fa0 con 0x7f54dc09aca0 2024-08-18T22:24:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.142+0000 7f54e4000640 1 -- 172.21.15.5:0/3237483064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54dc162900 con 0x7f54dc09aca0 2024-08-18T22:24:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.146+0000 7f54d9600640 1 -- 172.21.15.5:0/3237483064 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54d001b020 con 0x7f54dc09aca0 2024-08-18T22:24:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.146+0000 7f54d9600640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54bc067910 0x7f54bc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.146+0000 7f54d9600640 1 -- 172.21.15.5:0/3237483064 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5507+0+0 (secure 0 0 0) 0x7f54d00862b0 con 0x7f54dc09aca0 2024-08-18T22:24:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.146+0000 7f54e0c00640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54bc067910 0x7f54bc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.146+0000 7f54e0c00640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54bc067910 0x7f54bc069dd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f54dc156490 tx=0x7f54c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.150+0000 7f54d9600640 1 -- 172.21.15.5:0/3237483064 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f54d0022020 con 0x7f54dc09aca0 2024-08-18T22:24:31.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.314+0000 7f54e4000640 1 -- 172.21.15.5:0/3237483064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f54dc074820 con 0x7f54dc09aca0 2024-08-18T22:24:31.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.318+0000 7f54d9600640 1 -- 172.21.15.5:0/3237483064 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f54d0011340 con 0x7f54dc09aca0 2024-08-18T22:24:31.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 -- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54bc067910 msgr2=0x7f54bc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:31.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54bc067910 0x7f54bc069dd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f54dc156490 tx=0x7f54c8008040 comp rx=0 tx=0).stop 2024-08-18T22:24:31.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 -- 172.21.15.5:0/3237483064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc09aca0 msgr2=0x7f54dc140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:31.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc09aca0 0x7f54dc140720 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f54d000d830 tx=0x7f54d000dcf0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 -- 172.21.15.5:0/3237483064 shutdown_connections 2024-08-18T22:24:31.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54bc067910 0x7f54bc069dd0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54dc0b1300 0x7f54dc1577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54dc09b080 0x7f54dc142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 --2- 172.21.15.5:0/3237483064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54dc09aca0 0x7f54dc140720 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 -- 172.21.15.5:0/3237483064 >> 172.21.15.5:0/3237483064 conn(0x7f54dc0d2180 msgr2=0x7f54dc070fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 -- 172.21.15.5:0/3237483064 shutdown_connections 2024-08-18T22:24:31.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.322+0000 7f54e4000640 1 -- 172.21.15.5:0/3237483064 wait complete. 2024-08-18T22:24:31.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-08-18T22:24:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.482+0000 7fe950e00640 1 Processor -- start 2024-08-18T22:24:31.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.482+0000 7fe950e00640 1 -- start start 2024-08-18T22:24:31.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe950e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe94c15b010 0x7fe94c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe950e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe94c06f290 0x7fe94c072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe950e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe94c0cee20 con 0x7fe94c0cd3a0 2024-08-18T22:24:31.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe950e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe94c0cfa30 con 0x7fe94c06f290 2024-08-18T22:24:31.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe950e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe94c0cf100 con 0x7fe94c15b010 2024-08-18T22:24:31.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe94a800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe94c06f290 0x7fe94c072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe94a800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe94c06f290 0x7fe94c072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35500/0 (socket says 172.21.15.5:35500) 2024-08-18T22:24:31.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe94a800640 1 -- 172.21.15.5:0/4259103480 learned_addr learned my addr 172.21.15.5:0/4259103480 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:31.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe949e00640 1 --2- 172.21.15.5:0/4259103480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe94c15b010 0x7fe94c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe94a800640 1 -- 172.21.15.5:0/4259103480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe94c15b010 msgr2=0x7fe94c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:31.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe94a800640 1 --2- 172.21.15.5:0/4259103480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe94c15b010 0x7fe94c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe94a800640 1 -- 172.21.15.5:0/4259103480 >> v1:172.21.15.117:6789/0 conn(0x7fe94c0cd3a0 legacy=0x7fe94c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:31.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.486+0000 7fe94a800640 1 -- 172.21.15.5:0/4259103480 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94c0cf3e0 con 0x7fe94c06f290 2024-08-18T22:24:31.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe94a800640 1 --2- 172.21.15.5:0/4259103480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94c06f290 0x7fe94c072620 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fe944009e50 tx=0x7fe94401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fdc37b94655e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:31.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe949400640 1 -- 172.21.15.5:0/4259103480 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9440a5800 con 0x7fe94c06f290 2024-08-18T22:24:31.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe949400640 1 -- 172.21.15.5:0/4259103480 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9440a59a0 con 0x7fe94c06f290 2024-08-18T22:24:31.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe949400640 1 -- 172.21.15.5:0/4259103480 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9440a5d70 con 0x7fe94c06f290 2024-08-18T22:24:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe950e00640 1 -- 172.21.15.5:0/4259103480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94c06f290 msgr2=0x7fe94c072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe950e00640 1 --2- 172.21.15.5:0/4259103480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94c06f290 0x7fe94c072620 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fe944009e50 tx=0x7fe94401ca00 comp rx=0 tx=0).stop 2024-08-18T22:24:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe950e00640 1 -- 172.21.15.5:0/4259103480 shutdown_connections 2024-08-18T22:24:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe950e00640 1 --2- 172.21.15.5:0/4259103480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94c06f290 0x7fe94c072620 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe950e00640 1 --2- 172.21.15.5:0/4259103480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe94c15b010 0x7fe94c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe950e00640 1 -- 172.21.15.5:0/4259103480 >> 172.21.15.5:0/4259103480 conn(0x7fe94c0b1c50 msgr2=0x7fe94c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe950e00640 1 -- 172.21.15.5:0/4259103480 shutdown_connections 2024-08-18T22:24:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe950e00640 1 -- 172.21.15.5:0/4259103480 wait complete. 2024-08-18T22:24:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe950e00640 1 Processor -- start 2024-08-18T22:24:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.490+0000 7fe950e00640 1 -- start start 2024-08-18T22:24:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe950e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe94c06f290 0x7fe94c0afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe950e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe94c0cd3a0 0x7fe94c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe950e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94c15b010 0x7fe94c0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe950e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c0734f0 con 0x7fe94c15b010 2024-08-18T22:24:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe950e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c073370 con 0x7fe94c06f290 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe950e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe94c073670 con 0x7fe94c0cd3a0 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe94a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94c15b010 0x7fe94c0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe94a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94c15b010 0x7fe94c0b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35510/0 (socket says 172.21.15.5:35510) 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe94a800640 1 -- 172.21.15.5:0/2052411792 learned_addr learned my addr 172.21.15.5:0/2052411792 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe941400640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe94c0cd3a0 0x7fe94c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe949e00640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe94c06f290 0x7fe94c0afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe94a800640 1 -- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe94c0cd3a0 msgr2=0x7fe94c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe94a800640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe94c0cd3a0 0x7fe94c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe94a800640 1 -- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe94c06f290 msgr2=0x7fe94c0afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe94a800640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe94c06f290 0x7fe94c0afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe94a800640 1 -- 172.21.15.5:0/2052411792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94c0b0430 con 0x7fe94c15b010 2024-08-18T22:24:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe949e00640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe94c06f290 0x7fe94c0afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:31.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe941400640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe94c0cd3a0 0x7fe94c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:31.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe94a800640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94c15b010 0x7fe94c0b39a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fe94401a630 tx=0x7fe9440197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe942a00640 1 -- 172.21.15.5:0/2052411792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9440bc020 con 0x7fe94c15b010 2024-08-18T22:24:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe942a00640 1 -- 172.21.15.5:0/2052411792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9440b8670 con 0x7fe94c15b010 2024-08-18T22:24:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe950e00640 1 -- 172.21.15.5:0/2052411792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe94c0b5de0 con 0x7fe94c15b010 2024-08-18T22:24:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe942a00640 1 -- 172.21.15.5:0/2052411792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9440b8a60 con 0x7fe94c15b010 2024-08-18T22:24:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe950e00640 1 -- 172.21.15.5:0/2052411792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe94c0b09b0 con 0x7fe94c15b010 2024-08-18T22:24:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.494+0000 7fe950e00640 1 -- 172.21.15.5:0/2052411792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe94c072620 con 0x7fe94c15b010 2024-08-18T22:24:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.498+0000 7fe942a00640 1 -- 172.21.15.5:0/2052411792 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9440bf020 con 0x7fe94c15b010 2024-08-18T22:24:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.498+0000 7fe942a00640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9280678c0 0x7fe928069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.498+0000 7fe942a00640 1 -- 172.21.15.5:0/2052411792 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5507+0+0 (secure 0 0 0) 0x7fe944120c40 con 0x7fe94c15b010 2024-08-18T22:24:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.498+0000 7fe949e00640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9280678c0 0x7fe928069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.498+0000 7fe949e00640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9280678c0 0x7fe928069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009b10 tx=0x7fe93c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.502+0000 7fe942a00640 1 -- 172.21.15.5:0/2052411792 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe9440c6030 con 0x7fe94c15b010 2024-08-18T22:24:31.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.726+0000 7fe950e00640 1 -- 172.21.15.5:0/2052411792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7fe94c0af160 con 0x7fe94c15b010 2024-08-18T22:24:31.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.954+0000 7fe942a00640 1 -- 172.21.15.5:0/2052411792 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v270) ==== 143+0+0 (secure 0 0 0) 0x7fe944016620 con 0x7fe94c15b010 2024-08-18T22:24:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 -- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9280678c0 msgr2=0x7fe928069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9280678c0 0x7fe928069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009b10 tx=0x7fe93c008040 comp rx=0 tx=0).stop 2024-08-18T22:24:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 -- 172.21.15.5:0/2052411792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94c15b010 msgr2=0x7fe94c0b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94c15b010 0x7fe94c0b39a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fe94401a630 tx=0x7fe9440197a0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 -- 172.21.15.5:0/2052411792 shutdown_connections 2024-08-18T22:24:31.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9280678c0 0x7fe928069d80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94c15b010 0x7fe94c0b39a0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe94c0cd3a0 0x7fe94c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 --2- 172.21.15.5:0/2052411792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe94c06f290 0x7fe94c0afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 -- 172.21.15.5:0/2052411792 >> 172.21.15.5:0/2052411792 conn(0x7fe94c0b1c50 msgr2=0x7fe94c1519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 -- 172.21.15.5:0/2052411792 shutdown_connections 2024-08-18T22:24:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:31.958+0000 7fe950e00640 1 -- 172.21.15.5:0/2052411792 wait complete. 2024-08-18T22:24:31.979 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-08-18T22:24:31.979 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is split during scrub. 2024-08-18T22:24:31.979 INFO:tasks.cephfs_test_runner:test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-08-18T22:24:31.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:24:32.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a3400640 1 Processor -- start 2024-08-18T22:24:32.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a3400640 1 -- start start 2024-08-18T22:24:32.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a3400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f099c0cee40 0x7f099c06c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099c0ca3e0 0x7f099c0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a3400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f099c15e840 con 0x7f099c15e460 2024-08-18T22:24:32.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a3400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f099c0ae750 con 0x7f099c0cee40 2024-08-18T22:24:32.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a3400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f099c06c900 con 0x7f099c0ca3e0 2024-08-18T22:24:32.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a0a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f099c15e460 0x7f099c0ae040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45030/0 (socket says 172.21.15.5:45030) 2024-08-18T22:24:32.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a0a00640 1 -- 172.21.15.5:0/3337011644 learned_addr learned my addr 172.21.15.5:0/3337011644 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:32.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a1400640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099c0ca3e0 0x7f099c0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099be00640 1 --2- 172.21.15.5:0/3337011644 >> v2:172.21.15.117:3300/0 conn(0x7f099c0cee40 0x7f099c06c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1743361511 0 0) 0x7f099c15e840 con 0x7f099c15e460 2024-08-18T22:24:32.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0980003530 con 0x7f099c15e460 2024-08-18T22:24:32.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3434970297 0 0) 0x7f0980003530 con 0x7f099c15e460 2024-08-18T22:24:32.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099c0ca3e0 msgr2=0x7f099c0ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:32.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099c0ca3e0 0x7f099c0ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 >> v2:172.21.15.117:3300/0 conn(0x7f099c0cee40 msgr2=0x7f099c06c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:32.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 --2- 172.21.15.5:0/3337011644 >> v2:172.21.15.117:3300/0 conn(0x7f099c0cee40 0x7f099c06c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c0cf320 con 0x7f099c15e460 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f098c001680 con 0x7f099c15e460 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 >> v1:172.21.15.5:6789/0 conn(0x7f099c15e460 legacy=0x7f099c0ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09800039c0 0x7f0980003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099c0ca3e0 0x7f0980004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0980004d50 0x7f09800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f099c0ae750 con 0x7f09800039c0 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f099c06c900 con 0x7f0980004d50 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f098000b9d0 con 0x7f099c0ca3e0 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a0a00640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09800039c0 0x7f0980003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f099be00640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099c0ca3e0 0x7f0980004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a1400640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0980004d50 0x7f09800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a0a00640 1 -- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099c0ca3e0 msgr2=0x7f0980004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:32.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a0a00640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f099c0ca3e0 0x7f0980004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a0a00640 1 -- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0980004d50 msgr2=0x7f09800051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:32.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a0a00640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0980004d50 0x7f09800051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a0a00640 1 -- 172.21.15.5:0/3337011644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0980003530 con 0x7f09800039c0 2024-08-18T22:24:32.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.122+0000 7f09a1400640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0980004d50 0x7f09800051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:32.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.126+0000 7f09a0a00640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09800039c0 0x7f0980003de0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f098c00c2c0 tx=0x7f098c01f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15da1bb5ed3a7cad server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:32.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.126+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c007d60 con 0x7f09800039c0 2024-08-18T22:24:32.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.126+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f098c005ae0 con 0x7f09800039c0 2024-08-18T22:24:32.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.126+0000 7f099b400640 1 -- 172.21.15.5:0/3337011644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c007070 con 0x7f09800039c0 2024-08-18T22:24:32.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.126+0000 7f09a3400640 1 -- 172.21.15.5:0/3337011644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09800039c0 msgr2=0x7f0980003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.126+0000 7f09a3400640 1 --2- 172.21.15.5:0/3337011644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09800039c0 0x7f0980003de0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f098c00c2c0 tx=0x7f098c01f4b0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.126+0000 7f09a1400640 1 -- 172.21.15.5:0/3337011644 reap_dead start 2024-08-18T22:24:32.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.126+0000 7f09a3400640 1 -- 172.21.15.5:0/3337011644 shutdown_connections 2024-08-18T22:24:32.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.126+0000 7f09a3400640 1 -- 172.21.15.5:0/3337011644 >> 172.21.15.5:0/3337011644 conn(0x7f099c09aa40 msgr2=0x7f099c0b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:32.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.126+0000 7f09a3400640 1 -- 172.21.15.5:0/3337011644 shutdown_connections 2024-08-18T22:24:32.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.126+0000 7f09a3400640 1 -- 172.21.15.5:0/3337011644 wait complete. 2024-08-18T22:24:32.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f09a3400640 1 Processor -- start 2024-08-18T22:24:32.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f09a3400640 1 -- start start 2024-08-18T22:24:32.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f09a3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09800039c0 0x7f099c14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f09a3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f099c09dea0 0x7f099c0b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f09a3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f099c0b6090 0x7f099c09b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f09a3400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f099c0cfbc0 con 0x7f099c09dea0 2024-08-18T22:24:32.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f09a3400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f099c0cf8e0 con 0x7f099c0b6090 2024-08-18T22:24:32.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f09a3400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f099c0cfea0 con 0x7f09800039c0 2024-08-18T22:24:32.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f099be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f099c09dea0 0x7f099c0b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f099be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f099c09dea0 0x7f099c0b5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35524/0 (socket says 172.21.15.5:35524) 2024-08-18T22:24:32.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f099be00640 1 -- 172.21.15.5:0/212853621 learned_addr learned my addr 172.21.15.5:0/212853621 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:32.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f099be00640 1 -- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09800039c0 msgr2=0x7f099c14db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f099be00640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09800039c0 0x7f099c14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f099be00640 1 -- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f099c0b6090 msgr2=0x7f099c09b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f099be00640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f099c0b6090 0x7f099c09b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f099be00640 1 -- 172.21.15.5:0/212853621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c09e430 con 0x7f099c09dea0 2024-08-18T22:24:32.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f099be00640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f099c09dea0 0x7f099c0b5b50 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0988011ad0 tx=0x7f0988011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f0998c00640 1 -- 172.21.15.5:0/212853621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098800fb30 con 0x7f099c09dea0 2024-08-18T22:24:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f0998c00640 1 -- 172.21.15.5:0/212853621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f098800fcd0 con 0x7f099c09dea0 2024-08-18T22:24:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f0998c00640 1 -- 172.21.15.5:0/212853621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988014680 con 0x7f099c09dea0 2024-08-18T22:24:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f09a3400640 1 -- 172.21.15.5:0/212853621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c09e710 con 0x7f099c09dea0 2024-08-18T22:24:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.130+0000 7f09a3400640 1 -- 172.21.15.5:0/212853621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c09ecd0 con 0x7f099c09dea0 2024-08-18T22:24:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.134+0000 7f09a3400640 1 -- 172.21.15.5:0/212853621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099c0b3620 con 0x7f099c09dea0 2024-08-18T22:24:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.134+0000 7f0998c00640 1 -- 172.21.15.5:0/212853621 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0988012040 con 0x7f099c09dea0 2024-08-18T22:24:32.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.134+0000 7f0998c00640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f097c0678c0 0x7f097c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.134+0000 7f0998c00640 1 -- 172.21.15.5:0/212853621 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5507+0+0 (secure 0 0 0) 0x7f0988086220 con 0x7f099c09dea0 2024-08-18T22:24:32.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.134+0000 7f09a0a00640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f097c0678c0 0x7f097c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.134+0000 7f09a0a00640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f097c0678c0 0x7f097c069d80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f098c0ae000 tx=0x7f099c0ced90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.138+0000 7f0998c00640 1 -- 172.21.15.5:0/212853621 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0988019030 con 0x7f099c09dea0 2024-08-18T22:24:32.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.306+0000 7f09a3400640 1 -- 172.21.15.5:0/212853621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f099c0b06e0 con 0x7f099c09dea0 2024-08-18T22:24:32.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.306+0000 7f0998c00640 1 -- 172.21.15.5:0/212853621 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+13480 (secure 0 0 0) 0x7f0988056e10 con 0x7f099c09dea0 2024-08-18T22:24:32.307 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:32.307 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":89,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:24:30.946329+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6834/349592920":"2024-08-19T22:24:27.940020+0000","172.21.15.5:6832/3108112673":"2024-08-19T22:24:08.307602+0000","172.21.15.117:6836/116443176":"2024-08-19T22:24:07.859535+0000","172.21.15.117:6835/349592920":"2024-08-19T22:24:27.940020+0000","172.21.15.5:6834/3108112673":"2024-08-19T22:24:08.307602+0000","172.21.15.117:6834/116443176":"2024-08-19T22:24:07.859535+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:24:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 -- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f097c0678c0 msgr2=0x7f097c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f097c0678c0 0x7f097c069d80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f098c0ae000 tx=0x7f099c0ced90 comp rx=0 tx=0).stop 2024-08-18T22:24:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 -- 172.21.15.5:0/212853621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f099c09dea0 msgr2=0x7f099c0b5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f099c09dea0 0x7f099c0b5b50 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0988011ad0 tx=0x7f0988011f90 comp rx=0 tx=0).stop 2024-08-18T22:24:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 -- 172.21.15.5:0/212853621 shutdown_connections 2024-08-18T22:24:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f097c0678c0 0x7f097c069d80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f099c0b6090 0x7f099c09b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f099c09dea0 0x7f099c0b5b50 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 --2- 172.21.15.5:0/212853621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09800039c0 0x7f099c14db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 -- 172.21.15.5:0/212853621 >> 172.21.15.5:0/212853621 conn(0x7f099c09aa40 msgr2=0x7f099c0ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:32.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 -- 172.21.15.5:0/212853621 shutdown_connections 2024-08-18T22:24:32.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.310+0000 7f09a3400640 1 -- 172.21.15.5:0/212853621 wait complete. 2024-08-18T22:24:32.329 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:24:32.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:24:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a3a200640 1 Processor -- start 2024-08-18T22:24:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a3a200640 1 -- start start 2024-08-18T22:24:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a3a200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a3409aca0 0x7f9a340afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a3a200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a340b1300 0x7f9a340affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a3a200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a3409b080 0x7f9a340b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a3a200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9a3406e8a0 con 0x7f9a3409aca0 2024-08-18T22:24:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a3a200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9a3409bb80 con 0x7f9a3409b080 2024-08-18T22:24:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a3a200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9a340d2e40 con 0x7f9a340b1300 2024-08-18T22:24:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a33400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a3409aca0 0x7f9a340afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a33400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a3409aca0 0x7f9a340afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35540/0 (socket says 172.21.15.5:35540) 2024-08-18T22:24:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a33400640 1 -- 172.21.15.5:0/2968720797 learned_addr learned my addr 172.21.15.5:0/2968720797 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a2aa00640 1 --2- 172.21.15.5:0/2968720797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a340b1300 0x7f9a340affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a33e00640 1 --2- 172.21.15.5:0/2968720797 >> v2:172.21.15.117:3300/0 conn(0x7f9a3409b080 0x7f9a340b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a33400640 1 -- 172.21.15.5:0/2968720797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a340b1300 msgr2=0x7f9a340affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a33400640 1 --2- 172.21.15.5:0/2968720797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a340b1300 0x7f9a340affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a33400640 1 -- 172.21.15.5:0/2968720797 >> v2:172.21.15.117:3300/0 conn(0x7f9a3409b080 msgr2=0x7f9a340b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a33400640 1 --2- 172.21.15.5:0/2968720797 >> v2:172.21.15.117:3300/0 conn(0x7f9a3409b080 0x7f9a340b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a33400640 1 -- 172.21.15.5:0/2968720797 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3406cbd0 con 0x7f9a3409aca0 2024-08-18T22:24:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.474+0000 7f9a2aa00640 1 --2- 172.21.15.5:0/2968720797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a340b1300 0x7f9a340affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:32.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a33400640 1 --2- 172.21.15.5:0/2968720797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a3409aca0 0x7f9a340afa90 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f9a3406f830 tx=0x7f9a2401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc5a0d7fc6fc919 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:32.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a32a00640 1 -- 172.21.15.5:0/2968720797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a240ab5f0 con 0x7f9a3409aca0 2024-08-18T22:24:32.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a32a00640 1 -- 172.21.15.5:0/2968720797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a240b0070 con 0x7f9a3409aca0 2024-08-18T22:24:32.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a32a00640 1 -- 172.21.15.5:0/2968720797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a240ab9b0 con 0x7f9a3409aca0 2024-08-18T22:24:32.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a3a200640 1 -- 172.21.15.5:0/2968720797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a3409aca0 msgr2=0x7f9a340afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a3a200640 1 --2- 172.21.15.5:0/2968720797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a3409aca0 0x7f9a340afa90 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f9a3406f830 tx=0x7f9a2401c520 comp rx=0 tx=0).stop 2024-08-18T22:24:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a3a200640 1 -- 172.21.15.5:0/2968720797 shutdown_connections 2024-08-18T22:24:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a3a200640 1 --2- 172.21.15.5:0/2968720797 >> v2:172.21.15.117:3300/0 conn(0x7f9a3409b080 0x7f9a340b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a3a200640 1 --2- 172.21.15.5:0/2968720797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a340b1300 0x7f9a340affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a3a200640 1 --2- 172.21.15.5:0/2968720797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a3409aca0 0x7f9a340afa90 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a3a200640 1 -- 172.21.15.5:0/2968720797 >> 172.21.15.5:0/2968720797 conn(0x7f9a340d2180 msgr2=0x7f9a340d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a3a200640 1 -- 172.21.15.5:0/2968720797 shutdown_connections 2024-08-18T22:24:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.478+0000 7f9a3a200640 1 -- 172.21.15.5:0/2968720797 wait complete. 2024-08-18T22:24:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a3a200640 1 Processor -- start 2024-08-18T22:24:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a3a200640 1 -- start start 2024-08-18T22:24:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a3a200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3409aca0 0x7f9a34153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a3a200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3409b080 0x7f9a34160d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a3a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a340b1300 0x7f9a340cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a3a200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9a341624e0 con 0x7f9a340b1300 2024-08-18T22:24:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a3a200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9a34162360 con 0x7f9a3409b080 2024-08-18T22:24:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a3a200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9a34162660 con 0x7f9a3409aca0 2024-08-18T22:24:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a33e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a340b1300 0x7f9a340cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a33e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a340b1300 0x7f9a340cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35554/0 (socket says 172.21.15.5:35554) 2024-08-18T22:24:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a33400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3409aca0 0x7f9a34153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a33e00640 1 -- 172.21.15.5:0/1697905583 learned_addr learned my addr 172.21.15.5:0/1697905583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a2aa00640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3409b080 0x7f9a34160d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a33e00640 1 -- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3409aca0 msgr2=0x7f9a34153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a33e00640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3409aca0 0x7f9a34153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a33e00640 1 -- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3409b080 msgr2=0x7f9a34160d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a33e00640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3409b080 0x7f9a34160d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a33e00640 1 -- 172.21.15.5:0/1697905583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a340b5290 con 0x7f9a340b1300 2024-08-18T22:24:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a33e00640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a340b1300 0x7f9a340cb470 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c007e90 tx=0x7f9a2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a2be00640 1 -- 172.21.15.5:0/1697905583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c014420 con 0x7f9a340b1300 2024-08-18T22:24:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a2be00640 1 -- 172.21.15.5:0/1697905583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2c019070 con 0x7f9a340b1300 2024-08-18T22:24:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a2be00640 1 -- 172.21.15.5:0/1697905583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c014820 con 0x7f9a340b1300 2024-08-18T22:24:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a3a200640 1 -- 172.21.15.5:0/1697905583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a340b5570 con 0x7f9a340b1300 2024-08-18T22:24:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a3a200640 1 -- 172.21.15.5:0/1697905583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a340b5b30 con 0x7f9a340b1300 2024-08-18T22:24:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.482+0000 7f9a3a200640 1 -- 172.21.15.5:0/1697905583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a34162990 con 0x7f9a340b1300 2024-08-18T22:24:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.486+0000 7f9a2be00640 1 -- 172.21.15.5:0/1697905583 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a2c0149c0 con 0x7f9a340b1300 2024-08-18T22:24:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.486+0000 7f9a2be00640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a100678c0 0x7f9a10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.486+0000 7f9a2be00640 1 -- 172.21.15.5:0/1697905583 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5507+0+0 (secure 0 0 0) 0x7f9a2c0863a0 con 0x7f9a340b1300 2024-08-18T22:24:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.486+0000 7f9a33400640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a100678c0 0x7f9a10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.486+0000 7f9a33400640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a100678c0 0x7f9a10069d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9a240af000 tx=0x7f9a240a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.490+0000 7f9a2be00640 1 -- 172.21.15.5:0/1697905583 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9a2c0568b0 con 0x7f9a340b1300 2024-08-18T22:24:32.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 -- 172.21.15.5:0/1697905583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9a340b00c0 con 0x7f9a340b1300 2024-08-18T22:24:32.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a2be00640 1 -- 172.21.15.5:0/1697905583 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f9a2c05abb0 con 0x7f9a340b1300 2024-08-18T22:24:32.664 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:24:32.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 -- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a100678c0 msgr2=0x7f9a10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a100678c0 0x7f9a10069d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9a240af000 tx=0x7f9a240a7000 comp rx=0 tx=0).stop 2024-08-18T22:24:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 -- 172.21.15.5:0/1697905583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a340b1300 msgr2=0x7f9a340cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a340b1300 0x7f9a340cb470 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c007e90 tx=0x7f9a2c00e4b0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 -- 172.21.15.5:0/1697905583 shutdown_connections 2024-08-18T22:24:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a100678c0 0x7f9a10069d80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a340b1300 0x7f9a340cb470 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3409b080 0x7f9a34160d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 --2- 172.21.15.5:0/1697905583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3409aca0 0x7f9a34153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 -- 172.21.15.5:0/1697905583 >> 172.21.15.5:0/1697905583 conn(0x7f9a340d2180 msgr2=0x7f9a340d1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 -- 172.21.15.5:0/1697905583 shutdown_connections 2024-08-18T22:24:32.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.658+0000 7f9a3a200640 1 -- 172.21.15.5:0/1697905583 wait complete. 2024-08-18T22:24:32.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-08-18T22:24:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.826+0000 7f8b51800640 1 Processor -- start 2024-08-18T22:24:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.826+0000 7f8b51800640 1 -- start start 2024-08-18T22:24:32.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b51800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8b4c15bed0 0x7f8b4c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b51800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c0cb390 0x7f8b4c071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b51800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b4c06da70 0x7f8b4c06df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b51800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8b4c072060 con 0x7f8b4c06da70 2024-08-18T22:24:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b51800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8b4c073c80 con 0x7f8b4c15bed0 2024-08-18T22:24:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b51800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4c0ca5d0 con 0x7f8b4c0cb390 2024-08-18T22:24:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b4c06da70 0x7f8b4c06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b4c06da70 0x7f8b4c06df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35560/0 (socket says 172.21.15.5:35560) 2024-08-18T22:24:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4b400640 1 -- 172.21.15.5:0/3933953834 learned_addr learned my addr 172.21.15.5:0/3933953834 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4aa00640 1 --2- 172.21.15.5:0/3933953834 >> v2:172.21.15.117:3300/0 conn(0x7f8b4c15bed0 0x7f8b4c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4a000640 1 --2- 172.21.15.5:0/3933953834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c0cb390 0x7f8b4c071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4b400640 1 -- 172.21.15.5:0/3933953834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c0cb390 msgr2=0x7f8b4c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4b400640 1 --2- 172.21.15.5:0/3933953834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c0cb390 0x7f8b4c071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4b400640 1 -- 172.21.15.5:0/3933953834 >> v2:172.21.15.117:3300/0 conn(0x7f8b4c15bed0 msgr2=0x7f8b4c0735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4b400640 1 --2- 172.21.15.5:0/3933953834 >> v2:172.21.15.117:3300/0 conn(0x7f8b4c15bed0 0x7f8b4c0735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4b400640 1 -- 172.21.15.5:0/3933953834 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4c0ca8b0 con 0x7f8b4c06da70 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4a000640 1 --2- 172.21.15.5:0/3933953834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c0cb390 0x7f8b4c071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.830+0000 7f8b4b400640 1 --2- 172.21.15.5:0/3933953834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c06da70 0x7f8b4c06df00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0b2cc0 tx=0x7f8b4401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcce537ca85fe7fe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b49600640 1 -- 172.21.15.5:0/3933953834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b440a5760 con 0x7f8b4c06da70 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b49600640 1 -- 172.21.15.5:0/3933953834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b440a5900 con 0x7f8b4c06da70 2024-08-18T22:24:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b49600640 1 -- 172.21.15.5:0/3933953834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b440a5cd0 con 0x7f8b4c06da70 2024-08-18T22:24:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 -- 172.21.15.5:0/3933953834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c06da70 msgr2=0x7f8b4c06df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 --2- 172.21.15.5:0/3933953834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c06da70 0x7f8b4c06df00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0b2cc0 tx=0x7f8b4401c9f0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 -- 172.21.15.5:0/3933953834 shutdown_connections 2024-08-18T22:24:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 --2- 172.21.15.5:0/3933953834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c06da70 0x7f8b4c06df00 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 --2- 172.21.15.5:0/3933953834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c0cb390 0x7f8b4c071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 --2- 172.21.15.5:0/3933953834 >> v2:172.21.15.117:3300/0 conn(0x7f8b4c15bed0 0x7f8b4c0735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 -- 172.21.15.5:0/3933953834 >> 172.21.15.5:0/3933953834 conn(0x7f8b4c0b1c50 msgr2=0x7f8b4c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 -- 172.21.15.5:0/3933953834 shutdown_connections 2024-08-18T22:24:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 -- 172.21.15.5:0/3933953834 wait complete. 2024-08-18T22:24:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 Processor -- start 2024-08-18T22:24:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 -- start start 2024-08-18T22:24:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b4c06da70 0x7f8b4c14a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c0cb390 0x7f8b4c14b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c15bed0 0x7f8b4c14fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4c0ccc40 con 0x7f8b4c0cb390 2024-08-18T22:24:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4c0ccac0 con 0x7f8b4c06da70 2024-08-18T22:24:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b51800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4c0ccdc0 con 0x7f8b4c15bed0 2024-08-18T22:24:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b4a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c0cb390 0x7f8b4c14b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b4a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c0cb390 0x7f8b4c14b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35562/0 (socket says 172.21.15.5:35562) 2024-08-18T22:24:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b4a000640 1 -- 172.21.15.5:0/1420521245 learned_addr learned my addr 172.21.15.5:0/1420521245 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b4aa00640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b4c06da70 0x7f8b4c14a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.834+0000 7f8b4b400640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c15bed0 0x7f8b4c14fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b4a000640 1 -- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c15bed0 msgr2=0x7f8b4c14fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b4a000640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c15bed0 0x7f8b4c14fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b4a000640 1 -- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b4c06da70 msgr2=0x7f8b4c14a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b4a000640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b4c06da70 0x7f8b4c14a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b4a000640 1 -- 172.21.15.5:0/1420521245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4c0ce3a0 con 0x7f8b4c0cb390 2024-08-18T22:24:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b4a000640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c0cb390 0x7f8b4c14b040 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800e840 tx=0x7f8b3800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b42a00640 1 -- 172.21.15.5:0/1420521245 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38017070 con 0x7f8b4c0cb390 2024-08-18T22:24:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b42a00640 1 -- 172.21.15.5:0/1420521245 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3800c8d0 con 0x7f8b4c0cb390 2024-08-18T22:24:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b42a00640 1 -- 172.21.15.5:0/1420521245 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800f040 con 0x7f8b4c0cb390 2024-08-18T22:24:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b51800640 1 -- 172.21.15.5:0/1420521245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b4c0cf690 con 0x7f8b4c0cb390 2024-08-18T22:24:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b51800640 1 -- 172.21.15.5:0/1420521245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b4c159c60 con 0x7f8b4c0cb390 2024-08-18T22:24:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b51800640 1 -- 172.21.15.5:0/1420521245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b4c06df00 con 0x7f8b4c0cb390 2024-08-18T22:24:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b42a00640 1 -- 172.21.15.5:0/1420521245 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b3801a070 con 0x7f8b4c0cb390 2024-08-18T22:24:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b42a00640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 0x7f8b2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.838+0000 7f8b42a00640 1 -- 172.21.15.5:0/1420521245 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5507+0+0 (secure 0 0 0) 0x7f8b38085720 con 0x7f8b4c0cb390 2024-08-18T22:24:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.842+0000 7f8b4aa00640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 0x7f8b2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:32.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.842+0000 7f8b4aa00640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 0x7f8b2c069d80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c09df00 tx=0x7f8b3c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:32.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:32.842+0000 7f8b42a00640 1 -- 172.21.15.5:0/1420521245 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8b38055cd0 con 0x7f8b4c0cb390 2024-08-18T22:24:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.074+0000 7f8b51800640 1 -- 172.21.15.5:0/1420521245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f8b4c0afe70 con 0x7f8b4c0cb390 2024-08-18T22:24:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.962+0000 7f8b42a00640 1 -- 172.21.15.5:0/1420521245 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v272) ==== 154+0+0 (secure 0 0 0) 0x7f8b38059fd0 con 0x7f8b4c0cb390 2024-08-18T22:24:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 -- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 msgr2=0x7f8b2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 0x7f8b2c069d80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c09df00 tx=0x7f8b3c009190 comp rx=0 tx=0).stop 2024-08-18T22:24:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 -- 172.21.15.5:0/1420521245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c0cb390 msgr2=0x7f8b4c14b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c0cb390 0x7f8b4c14b040 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800e840 tx=0x7f8b3800ed00 comp rx=0 tx=0).stop 2024-08-18T22:24:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 -- 172.21.15.5:0/1420521245 shutdown_connections 2024-08-18T22:24:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b2c0678c0 0x7f8b2c069d80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b4c15bed0 0x7f8b4c14fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:33.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b4c0cb390 0x7f8b4c14b040 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:33.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 --2- 172.21.15.5:0/1420521245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b4c06da70 0x7f8b4c14a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:33.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 -- 172.21.15.5:0/1420521245 >> 172.21.15.5:0/1420521245 conn(0x7f8b4c0b1c50 msgr2=0x7f8b4c072320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:33.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 -- 172.21.15.5:0/1420521245 shutdown_connections 2024-08-18T22:24:33.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:33.966+0000 7f8b51800640 1 -- 172.21.15.5:0/1420521245 wait complete. 2024-08-18T22:24:33.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:24:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.138+0000 7f5c3d600640 1 Processor -- start 2024-08-18T22:24:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.138+0000 7f5c3d600640 1 -- start start 2024-08-18T22:24:34.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3d600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5c3815fb20 0x7f5c3806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3d600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c38160000 con 0x7f5c3806fe60 2024-08-18T22:24:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3d600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c381602e0 con 0x7f5c38145420 2024-08-18T22:24:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3d600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5c381605c0 con 0x7f5c3815fb20 2024-08-18T22:24:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3cc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5c3806fe60 0x7f5c380cff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33054/0 (socket says 172.21.15.5:33054) 2024-08-18T22:24:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3cc00640 1 -- 172.21.15.5:0/712070003 learned_addr learned my addr 172.21.15.5:0/712070003 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c2f400640 1 --2- 172.21.15.5:0/712070003 >> v2:172.21.15.117:3300/0 conn(0x7f5c3815fb20 0x7f5c3806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422775142 0 0) 0x7f5c38160000 con 0x7f5c3806fe60 2024-08-18T22:24:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c1c003530 con 0x7f5c3806fe60 2024-08-18T22:24:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1206520240 0 0) 0x7f5c1c003530 con 0x7f5c3806fe60 2024-08-18T22:24:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 >> v2:172.21.15.117:3300/0 conn(0x7f5c3815fb20 msgr2=0x7f5c3806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 --2- 172.21.15.5:0/712070003 >> v2:172.21.15.117:3300/0 conn(0x7f5c3815fb20 0x7f5c3806b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 >> v1:172.21.15.117:6789/0 conn(0x7f5c38145420 legacy=0x7f5c38072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c381608a0 con 0x7f5c3806fe60 2024-08-18T22:24:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f5c30001a00 con 0x7f5c3806fe60 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 >> v1:172.21.15.5:6789/0 conn(0x7f5c3806fe60 legacy=0x7f5c380cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c1c0039c0 0x7f5c1c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c1c004810 0x7f5c1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c1c0051d0 0x7f5c1c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5c381605c0 con 0x7f5c1c0051d0 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c00c070 con 0x7f5c1c004810 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1c00c270 con 0x7f5c1c0039c0 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c2f400640 1 --2- 172.21.15.5:0/712070003 >> v2:172.21.15.117:3300/0 conn(0x7f5c3815fb20 0x7f5c3806b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3cc00640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c1c0051d0 0x7f5c1c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37e00640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c1c0039c0 0x7f5c1c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c2f400640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c1c004810 0x7f5c1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3cc00640 1 -- 172.21.15.5:0/712070003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c1c0039c0 msgr2=0x7f5c1c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3cc00640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c1c0039c0 0x7f5c1c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3cc00640 1 -- 172.21.15.5:0/712070003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c1c004810 msgr2=0x7f5c1c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3cc00640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c1c004810 0x7f5c1c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c3cc00640 1 -- 172.21.15.5:0/712070003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c003530 con 0x7f5c1c0051d0 2024-08-18T22:24:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c37e00640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c1c0039c0 0x7f5c1c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.142+0000 7f5c2f400640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c1c004810 0x7f5c1c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:34.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c3cc00640 1 -- 172.21.15.5:0/712070003 reap_dead start 2024-08-18T22:24:34.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c3cc00640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c1c0051d0 0x7f5c1c00b9d0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f5c380b4160 tx=0x7f5c3001d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb7f2e78c7cc781 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:34.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000a480 con 0x7f5c1c0051d0 2024-08-18T22:24:34.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c300ad630 con 0x7f5c1c0051d0 2024-08-18T22:24:34.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c37400640 1 -- 172.21.15.5:0/712070003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c300ada00 con 0x7f5c1c0051d0 2024-08-18T22:24:34.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c3d600640 1 -- 172.21.15.5:0/712070003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c1c0051d0 msgr2=0x7f5c1c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c3d600640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c1c0051d0 0x7f5c1c00b9d0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f5c380b4160 tx=0x7f5c3001d320 comp rx=0 tx=0).stop 2024-08-18T22:24:34.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c3d600640 1 -- 172.21.15.5:0/712070003 shutdown_connections 2024-08-18T22:24:34.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c3d600640 1 --2- 172.21.15.5:0/712070003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c1c0051d0 0x7f5c1c00b9d0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c3d600640 1 -- 172.21.15.5:0/712070003 >> 172.21.15.5:0/712070003 conn(0x7f5c380d1000 msgr2=0x7f5c380d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:34.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c3d600640 1 -- 172.21.15.5:0/712070003 shutdown_connections 2024-08-18T22:24:34.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c3d600640 1 -- 172.21.15.5:0/712070003 wait complete. 2024-08-18T22:24:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c3d600640 1 Processor -- start 2024-08-18T22:24:34.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.146+0000 7f5c3d600640 1 -- start start 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c3d600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c1c0051d0 0x7f5c3815e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c3d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c38141370 0x7f5c380c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c3d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c381417d0 0x7f5c380c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c3d600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5c38072de0 con 0x7f5c38141370 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c3d600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5c380cfa40 con 0x7f5c1c0051d0 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c3d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5c38072f60 con 0x7f5c381417d0 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c2f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c38141370 0x7f5c380c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c2f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c38141370 0x7f5c380c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59266/0 (socket says 172.21.15.5:59266) 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c2f400640 1 -- 172.21.15.5:0/519230156 learned_addr learned my addr 172.21.15.5:0/519230156 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c37e00640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c1c0051d0 0x7f5c3815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c3cc00640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c381417d0 0x7f5c380c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c2f400640 1 -- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c381417d0 msgr2=0x7f5c380c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c2f400640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c381417d0 0x7f5c380c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c2f400640 1 -- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c1c0051d0 msgr2=0x7f5c3815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c2f400640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c1c0051d0 0x7f5c3815e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c2f400640 1 -- 172.21.15.5:0/519230156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c38141da0 con 0x7f5c38141370 2024-08-18T22:24:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c37e00640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c1c0051d0 0x7f5c3815e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c2f400640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c38141370 0x7f5c380c7a80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5c20004660 tx=0x7f5c20011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c34c00640 1 -- 172.21.15.5:0/519230156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20009e60 con 0x7f5c38141370 2024-08-18T22:24:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c34c00640 1 -- 172.21.15.5:0/519230156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2000fbd0 con 0x7f5c38141370 2024-08-18T22:24:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c34c00640 1 -- 172.21.15.5:0/519230156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20015460 con 0x7f5c38141370 2024-08-18T22:24:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c3d600640 1 -- 172.21.15.5:0/519230156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c38142080 con 0x7f5c38141370 2024-08-18T22:24:34.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c3d600640 1 -- 172.21.15.5:0/519230156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c38142640 con 0x7f5c38141370 2024-08-18T22:24:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.150+0000 7f5c3d600640 1 -- 172.21.15.5:0/519230156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c3815ff60 con 0x7f5c38141370 2024-08-18T22:24:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.154+0000 7f5c34c00640 1 -- 172.21.15.5:0/519230156 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5c20015600 con 0x7f5c38141370 2024-08-18T22:24:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.154+0000 7f5c34c00640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5c140678c0 0x7f5c14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.154+0000 7f5c34c00640 1 -- 172.21.15.5:0/519230156 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5507+0+0 (secure 0 0 0) 0x7f5c20086610 con 0x7f5c38141370 2024-08-18T22:24:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.154+0000 7f5c37e00640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5c140678c0 0x7f5c14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.154+0000 7f5c37e00640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5c140678c0 0x7f5c14069d80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5c28005510 tx=0x7f5c28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:34.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.158+0000 7f5c34c00640 1 -- 172.21.15.5:0/519230156 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5c20019030 con 0x7f5c38141370 2024-08-18T22:24:34.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.322+0000 7f5c3d600640 1 -- 172.21.15.5:0/519230156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5c380cd640 con 0x7f5c38141370 2024-08-18T22:24:34.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.326+0000 7f5c34c00640 1 -- 172.21.15.5:0/519230156 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f5c20057180 con 0x7f5c38141370 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 -- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5c140678c0 msgr2=0x7f5c14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5c140678c0 0x7f5c14069d80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5c28005510 tx=0x7f5c28009040 comp rx=0 tx=0).stop 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 -- 172.21.15.5:0/519230156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c38141370 msgr2=0x7f5c380c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c38141370 0x7f5c380c7a80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5c20004660 tx=0x7f5c20011d60 comp rx=0 tx=0).stop 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 -- 172.21.15.5:0/519230156 shutdown_connections 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5c140678c0 0x7f5c14069d80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c381417d0 0x7f5c380c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c38141370 0x7f5c380c7a80 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 --2- 172.21.15.5:0/519230156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c1c0051d0 0x7f5c3815e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 -- 172.21.15.5:0/519230156 >> 172.21.15.5:0/519230156 conn(0x7f5c380d1000 msgr2=0x7f5c380b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 -- 172.21.15.5:0/519230156 shutdown_connections 2024-08-18T22:24:34.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.330+0000 7f5c3d600640 1 -- 172.21.15.5:0/519230156 wait complete. 2024-08-18T22:24:34.348 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:24:34.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:24:34.431 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:24:34.530 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:24:34.530 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:34.530 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:34.539 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:24:34.539 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:24:34.539 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:34.549 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:24:34.549 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:34.549 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:34.589 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:24:34.589 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:24:34.589 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:34.599 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:24:34.599 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:24:34.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907e00640 1 Processor -- start 2024-08-18T22:24:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907e00640 1 -- start start 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f590815ace0 0x7f590806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5908072c50 0x7f590806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59080af9a0 0x7f59080b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f590815e8a0 con 0x7f59080af9a0 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f590815c130 con 0x7f590815ace0 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f590815eb40 con 0x7f5908072c50 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59080af9a0 0x7f59080b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59080af9a0 0x7f59080b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59280/0 (socket says 172.21.15.5:59280) 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907400640 1 -- 172.21.15.5:0/2514781061 learned_addr learned my addr 172.21.15.5:0/2514781061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5906a00640 1 --2- 172.21.15.5:0/2514781061 >> v2:172.21.15.117:3300/0 conn(0x7f590815ace0 0x7f590806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f58fe000640 1 --2- 172.21.15.5:0/2514781061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5908072c50 0x7f590806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907400640 1 -- 172.21.15.5:0/2514781061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5908072c50 msgr2=0x7f590806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:34.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907400640 1 --2- 172.21.15.5:0/2514781061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5908072c50 0x7f590806cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907400640 1 -- 172.21.15.5:0/2514781061 >> v2:172.21.15.117:3300/0 conn(0x7f590815ace0 msgr2=0x7f590806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:34.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907400640 1 --2- 172.21.15.5:0/2514781061 >> v2:172.21.15.117:3300/0 conn(0x7f590815ace0 0x7f590806c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.774+0000 7f5907400640 1 -- 172.21.15.5:0/2514781061 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590815ee20 con 0x7f59080af9a0 2024-08-18T22:24:34.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5907400640 1 --2- 172.21.15.5:0/2514781061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59080af9a0 0x7f59080b4900 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5908071e00 tx=0x7f590001e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74030aad17595c40 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5906000640 1 -- 172.21.15.5:0/2514781061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59000a7730 con 0x7f59080af9a0 2024-08-18T22:24:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5906000640 1 -- 172.21.15.5:0/2514781061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59000a78d0 con 0x7f59080af9a0 2024-08-18T22:24:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5906000640 1 -- 172.21.15.5:0/2514781061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59000a7ca0 con 0x7f59080af9a0 2024-08-18T22:24:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5907e00640 1 -- 172.21.15.5:0/2514781061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59080af9a0 msgr2=0x7f59080b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5907e00640 1 --2- 172.21.15.5:0/2514781061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59080af9a0 0x7f59080b4900 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5908071e00 tx=0x7f590001e910 comp rx=0 tx=0).stop 2024-08-18T22:24:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5907e00640 1 -- 172.21.15.5:0/2514781061 shutdown_connections 2024-08-18T22:24:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5907e00640 1 --2- 172.21.15.5:0/2514781061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59080af9a0 0x7f59080b4900 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5907e00640 1 --2- 172.21.15.5:0/2514781061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5908072c50 0x7f590806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5907e00640 1 --2- 172.21.15.5:0/2514781061 >> v2:172.21.15.117:3300/0 conn(0x7f590815ace0 0x7f590806c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5907e00640 1 -- 172.21.15.5:0/2514781061 >> 172.21.15.5:0/2514781061 conn(0x7f5908072130 msgr2=0x7f5908072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:34.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5907e00640 1 -- 172.21.15.5:0/2514781061 shutdown_connections 2024-08-18T22:24:34.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.778+0000 7f5907e00640 1 -- 172.21.15.5:0/2514781061 wait complete. 2024-08-18T22:24:34.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907e00640 1 Processor -- start 2024-08-18T22:24:34.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907e00640 1 -- start start 2024-08-18T22:24:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5908072c50 0x7f59080cea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59080af9a0 0x7f5908155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f590815ace0 0x7f5908156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f590815f7a0 con 0x7f59080af9a0 2024-08-18T22:24:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f590815f620 con 0x7f590815ace0 2024-08-18T22:24:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f59080b37f0 con 0x7f5908072c50 2024-08-18T22:24:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58fe000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59080af9a0 0x7f5908155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58fe000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59080af9a0 0x7f5908155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59282/0 (socket says 172.21.15.5:59282) 2024-08-18T22:24:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58fe000640 1 -- 172.21.15.5:0/2376561067 learned_addr learned my addr 172.21.15.5:0/2376561067 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5906a00640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5908072c50 0x7f59080cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907400640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f590815ace0 0x7f5908156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58fe000640 1 -- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5908072c50 msgr2=0x7f59080cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58fe000640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5908072c50 0x7f59080cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58fe000640 1 -- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f590815ace0 msgr2=0x7f5908156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58fe000640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f590815ace0 0x7f5908156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58fe000640 1 -- 172.21.15.5:0/2376561067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59080cf350 con 0x7f59080af9a0 2024-08-18T22:24:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58fe000640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59080af9a0 0x7f5908155dc0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f58f000d830 tx=0x7f58f000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58ff400640 1 -- 172.21.15.5:0/2376561067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f000b6c0 con 0x7f59080af9a0 2024-08-18T22:24:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58ff400640 1 -- 172.21.15.5:0/2376561067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f0019070 con 0x7f59080af9a0 2024-08-18T22:24:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f58ff400640 1 -- 172.21.15.5:0/2376561067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f000ba60 con 0x7f59080af9a0 2024-08-18T22:24:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907e00640 1 -- 172.21.15.5:0/2376561067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59081fa660 con 0x7f59080af9a0 2024-08-18T22:24:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907e00640 1 -- 172.21.15.5:0/2376561067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59081fac20 con 0x7f59080af9a0 2024-08-18T22:24:34.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.782+0000 7f5907e00640 1 -- 172.21.15.5:0/2376561067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f590806c9c0 con 0x7f59080af9a0 2024-08-18T22:24:34.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.786+0000 7f58ff400640 1 -- 172.21.15.5:0/2376561067 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58f001e460 con 0x7f59080af9a0 2024-08-18T22:24:34.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.786+0000 7f58ff400640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58e40678c0 0x7f58e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:34.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.786+0000 7f58ff400640 1 -- 172.21.15.5:0/2376561067 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5507+0+0 (secure 0 0 0) 0x7f58f00861c0 con 0x7f59080af9a0 2024-08-18T22:24:34.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.786+0000 7f5906a00640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58e40678c0 0x7f58e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:34.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.786+0000 7f5906a00640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58e40678c0 0x7f58e4069d80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f58f8007940 tx=0x7f58f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:34.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.790+0000 7f58ff400640 1 -- 172.21.15.5:0/2376561067 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f58f00566d0 con 0x7f59080af9a0 2024-08-18T22:24:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 -- 172.21.15.5:0/2376561067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5908067b50 con 0x7f59080af9a0 2024-08-18T22:24:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f58ff400640 1 -- 172.21.15.5:0/2376561067 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+3902 (secure 0 0 0) 0x7f58f005a9d0 con 0x7f59080af9a0 2024-08-18T22:24:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:34.989 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":65,"btime":"2024-08-18T22:24:28:942199+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/336617384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":336617384},{"type":"v1","addr":"172.21.15.117:6835","nonce":336617384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/625897913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":625897913},{"type":"v1","addr":"172.21.15.117:6837","nonce":625897913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/128531097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":128531097},{"type":"v1","addr":"172.21.15.5:6835","nonce":128531097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3673408015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3673408015},{"type":"v1","addr":"172.21.15.5:6834","nonce":3673408015}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[]} 2024-08-18T22:24:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 65 2024-08-18T22:24:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 -- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58e40678c0 msgr2=0x7f58e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58e40678c0 0x7f58e4069d80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f58f8007940 tx=0x7f58f8008040 comp rx=0 tx=0).stop 2024-08-18T22:24:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 -- 172.21.15.5:0/2376561067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59080af9a0 msgr2=0x7f5908155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59080af9a0 0x7f5908155dc0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f58f000d830 tx=0x7f58f000dcf0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 -- 172.21.15.5:0/2376561067 shutdown_connections 2024-08-18T22:24:34.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f58e40678c0 0x7f58e4069d80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f590815ace0 0x7f5908156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59080af9a0 0x7f5908155dc0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 --2- 172.21.15.5:0/2376561067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5908072c50 0x7f59080cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 -- 172.21.15.5:0/2376561067 >> 172.21.15.5:0/2376561067 conn(0x7f5908072130 msgr2=0x7f59080b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 -- 172.21.15.5:0/2376561067 shutdown_connections 2024-08-18T22:24:34.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:34.990+0000 7f5907e00640 1 -- 172.21.15.5:0/2376561067 wait complete. 2024-08-18T22:24:35.011 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:24:35.011 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:24:35.011 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:24:35.011 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:35.011 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:24:35.011 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:24:35.012 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:24:35.012 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:35.012 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:24:35.012 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:24:35.012 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:24:35.012 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:35.012 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:24:35.013 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:24:35.013 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:24:35.013 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:35.024 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:24:35.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:24:35.025 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:24:35.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:24:35.032 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:24:35.032 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:24:35.033 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:24:35.033 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:24:35.075 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:24:35.075 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:35.076 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:24:35.076 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:35.078 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:24:35.078 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:35.079 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:24:35.080 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:35.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:24:35.160 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:24:35.162 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:24:35.168 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:24:35.169 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:24:35.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9247200640 1 Processor -- start 2024-08-18T22:24:35.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9247200640 1 -- start start 2024-08-18T22:24:35.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9247200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924009aca0 0x7f92400afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:35.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9247200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f924009b080 0x7f92400b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:35.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9247200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f924006e8a0 con 0x7f92400b1300 2024-08-18T22:24:35.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9247200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f924009bb80 con 0x7f924009b080 2024-08-18T22:24:35.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9247200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f92400d2e40 con 0x7f924009aca0 2024-08-18T22:24:35.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9245200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f924009b080 0x7f92400b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:35.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9245200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f924009b080 0x7f92400b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59316/0 (socket says 172.21.15.5:59316) 2024-08-18T22:24:35.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9245200640 1 -- 172.21.15.5:0/125433971 learned_addr learned my addr 172.21.15.5:0/125433971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:35.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f923fe00640 1 --2- 172.21.15.5:0/125433971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924009aca0 0x7f92400afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:35.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9245200640 1 -- 172.21.15.5:0/125433971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924009aca0 msgr2=0x7f92400afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:35.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9245200640 1 --2- 172.21.15.5:0/125433971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924009aca0 0x7f92400afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:35.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9245200640 1 -- 172.21.15.5:0/125433971 >> v1:172.21.15.117:6789/0 conn(0x7f92400b1300 legacy=0x7f92400affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:35.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.230+0000 7f9245200640 1 -- 172.21.15.5:0/125433971 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924006cbd0 con 0x7f924009b080 2024-08-18T22:24:35.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f9245200640 1 --2- 172.21.15.5:0/125433971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f924009b080 0x7f92400b06e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f92380098a0 tx=0x7f923801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221caf6b0a0f1c38 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:35.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f923ea00640 1 -- 172.21.15.5:0/125433971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92380ab5f0 con 0x7f924009b080 2024-08-18T22:24:35.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f923ea00640 1 -- 172.21.15.5:0/125433971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92380b0070 con 0x7f924009b080 2024-08-18T22:24:35.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f923ea00640 1 -- 172.21.15.5:0/125433971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92380ab9b0 con 0x7f924009b080 2024-08-18T22:24:35.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f9247200640 1 -- 172.21.15.5:0/125433971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f924009b080 msgr2=0x7f92400b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:35.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f9247200640 1 --2- 172.21.15.5:0/125433971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f924009b080 0x7f92400b06e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f92380098a0 tx=0x7f923801c540 comp rx=0 tx=0).stop 2024-08-18T22:24:35.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f9247200640 1 -- 172.21.15.5:0/125433971 shutdown_connections 2024-08-18T22:24:35.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f9247200640 1 --2- 172.21.15.5:0/125433971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f924009b080 0x7f92400b06e0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:35.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f9247200640 1 --2- 172.21.15.5:0/125433971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f924009aca0 0x7f92400afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:35.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f9247200640 1 -- 172.21.15.5:0/125433971 >> 172.21.15.5:0/125433971 conn(0x7f92400d2180 msgr2=0x7f92400d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:35.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f9247200640 1 -- 172.21.15.5:0/125433971 shutdown_connections 2024-08-18T22:24:35.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f9247200640 1 -- 172.21.15.5:0/125433971 wait complete. 2024-08-18T22:24:35.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f9247200640 1 Processor -- start 2024-08-18T22:24:35.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.234+0000 7f9247200640 1 -- start start 2024-08-18T22:24:35.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9247200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f924009aca0 0x7f92401586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9247200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f924009b080 0x7f9240155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9247200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92400b1300 0x7f92401564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9247200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f924016b6b0 con 0x7f924009b080 2024-08-18T22:24:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9247200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f924016b530 con 0x7f924009aca0 2024-08-18T22:24:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9247200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f924016b830 con 0x7f92400b1300 2024-08-18T22:24:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f923f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f924009b080 0x7f9240155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f923fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f924009aca0 0x7f92401586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f923f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f924009b080 0x7f9240155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59322/0 (socket says 172.21.15.5:59322) 2024-08-18T22:24:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f923f400640 1 -- 172.21.15.5:0/3302884658 learned_addr learned my addr 172.21.15.5:0/3302884658 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9245200640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92400b1300 0x7f92401564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:35.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f923f400640 1 -- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92400b1300 msgr2=0x7f92401564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:35.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f923f400640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92400b1300 0x7f92401564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:35.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f923f400640 1 -- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f924009aca0 msgr2=0x7f92401586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:35.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f923f400640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f924009aca0 0x7f92401586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:35.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f923f400640 1 -- 172.21.15.5:0/3302884658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9240156300 con 0x7f924009b080 2024-08-18T22:24:35.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f923f400640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f924009b080 0x7f9240155dc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f922c00c340 tx=0x7f922c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9237e00640 1 -- 172.21.15.5:0/3302884658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c0052d0 con 0x7f924009b080 2024-08-18T22:24:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9237e00640 1 -- 172.21.15.5:0/3302884658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c005470 con 0x7f924009b080 2024-08-18T22:24:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9247200640 1 -- 172.21.15.5:0/3302884658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924015bcc0 con 0x7f924009b080 2024-08-18T22:24:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9237e00640 1 -- 172.21.15.5:0/3302884658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c007260 con 0x7f924009b080 2024-08-18T22:24:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9247200640 1 -- 172.21.15.5:0/3302884658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9240160ad0 con 0x7f924009b080 2024-08-18T22:24:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.238+0000 7f9247200640 1 -- 172.21.15.5:0/3302884658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9240161940 con 0x7f924009b080 2024-08-18T22:24:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.242+0000 7f9237e00640 1 -- 172.21.15.5:0/3302884658 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f922c007400 con 0x7f924009b080 2024-08-18T22:24:35.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.242+0000 7f9237e00640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92200678f0 0x7f9220069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:35.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.242+0000 7f9237e00640 1 -- 172.21.15.5:0/3302884658 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5507+0+0 (secure 0 0 0) 0x7f922c084f40 con 0x7f924009b080 2024-08-18T22:24:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.242+0000 7f923fe00640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92200678f0 0x7f9220069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.242+0000 7f923fe00640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92200678f0 0x7f9220069db0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f92400d1190 tx=0x7f923000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.246+0000 7f9237e00640 1 -- 172.21.15.5:0/3302884658 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f922c0554e0 con 0x7f924009b080 2024-08-18T22:24:35.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.422+0000 7f9247200640 1 -- 172.21.15.5:0/3302884658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f92400b0740 con 0x7f924009b080 2024-08-18T22:24:35.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.978+0000 7f9237e00640 1 -- 172.21.15.5:0/3302884658 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v91) ==== 97+0+0 (secure 0 0 0) 0x7f922c0597e0 con 0x7f924009b080 2024-08-18T22:24:35.979 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:24:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 -- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92200678f0 msgr2=0x7f9220069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92200678f0 0x7f9220069db0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f92400d1190 tx=0x7f923000b040 comp rx=0 tx=0).stop 2024-08-18T22:24:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 -- 172.21.15.5:0/3302884658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f924009b080 msgr2=0x7f9240155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f924009b080 0x7f9240155dc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f922c00c340 tx=0x7f922c00c800 comp rx=0 tx=0).stop 2024-08-18T22:24:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 -- 172.21.15.5:0/3302884658 shutdown_connections 2024-08-18T22:24:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92200678f0 0x7f9220069db0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92400b1300 0x7f92401564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f924009b080 0x7f9240155dc0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 --2- 172.21.15.5:0/3302884658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f924009aca0 0x7f92401586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 -- 172.21.15.5:0/3302884658 >> 172.21.15.5:0/3302884658 conn(0x7f92400d2180 msgr2=0x7f92400d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 -- 172.21.15.5:0/3302884658 shutdown_connections 2024-08-18T22:24:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:35.982+0000 7f9247200640 1 -- 172.21.15.5:0/3302884658 wait complete. 2024-08-18T22:24:36.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:24:36.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.150+0000 7f7522c00640 1 Processor -- start 2024-08-18T22:24:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.150+0000 7f7522c00640 1 -- start start 2024-08-18T22:24:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.150+0000 7f7522c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f751c06f290 0x7f751c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.150+0000 7f7522c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f751c0cd850 con 0x7f751c15b010 2024-08-18T22:24:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.150+0000 7f7522c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f751c0cee20 con 0x7f751c0cd3a0 2024-08-18T22:24:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.150+0000 7f7522c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f751c0cfa30 con 0x7f751c06f290 2024-08-18T22:24:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.150+0000 7f751be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f751c15b010 0x7f751c06eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33064/0 (socket says 172.21.15.5:33064) 2024-08-18T22:24:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.150+0000 7f751be00640 1 -- 172.21.15.5:0/1207467127 learned_addr learned my addr 172.21.15.5:0/1207467127 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.150+0000 7f7513400640 1 --2- 172.21.15.5:0/1207467127 >> v2:172.21.15.5:3300/0 conn(0x7f751c06f290 0x7f751c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.154+0000 7f751b400640 1 -- 172.21.15.5:0/1207467127 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444013876 0 0) 0x7f751c0cd850 con 0x7f751c15b010 2024-08-18T22:24:36.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.154+0000 7f7513400640 1 -- 172.21.15.5:0/1207467127 >> v1:172.21.15.117:6789/0 conn(0x7f751c0cd3a0 legacy=0x7f751c072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:36.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.154+0000 7f7513400640 1 -- 172.21.15.5:0/1207467127 >> v1:172.21.15.5:6789/0 conn(0x7f751c15b010 legacy=0x7f751c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.154+0000 7f7513400640 1 -- 172.21.15.5:0/1207467127 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c0cf100 con 0x7f751c06f290 2024-08-18T22:24:36.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.154+0000 7f7513400640 1 --2- 172.21.15.5:0/1207467127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c06f290 0x7f751c0ce840 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f75040097c0 tx=0x7f750401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cfaa9ce8592393 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:36.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.154+0000 7f751b400640 1 -- 172.21.15.5:0/1207467127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75040ab430 con 0x7f751c06f290 2024-08-18T22:24:36.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.154+0000 7f751b400640 1 -- 172.21.15.5:0/1207467127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75040b0070 con 0x7f751c06f290 2024-08-18T22:24:36.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.154+0000 7f751b400640 1 -- 172.21.15.5:0/1207467127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75040ab7f0 con 0x7f751c06f290 2024-08-18T22:24:36.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.154+0000 7f7522c00640 1 -- 172.21.15.5:0/1207467127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c06f290 msgr2=0x7f751c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.154+0000 7f7522c00640 1 --2- 172.21.15.5:0/1207467127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c06f290 0x7f751c0ce840 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f75040097c0 tx=0x7f750401c430 comp rx=0 tx=0).stop 2024-08-18T22:24:36.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 -- 172.21.15.5:0/1207467127 shutdown_connections 2024-08-18T22:24:36.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 --2- 172.21.15.5:0/1207467127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c06f290 0x7f751c0ce840 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 -- 172.21.15.5:0/1207467127 >> 172.21.15.5:0/1207467127 conn(0x7f751c0b1c50 msgr2=0x7f751c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:36.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 -- 172.21.15.5:0/1207467127 shutdown_connections 2024-08-18T22:24:36.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 -- 172.21.15.5:0/1207467127 wait complete. 2024-08-18T22:24:36.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 Processor -- start 2024-08-18T22:24:36.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 -- start start 2024-08-18T22:24:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c06f290 0x7f751c1488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c0cd3a0 0x7f751c159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c15b010 0x7f751c15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f751c0736c0 con 0x7f751c0cd3a0 2024-08-18T22:24:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f751c073540 con 0x7f751c15b010 2024-08-18T22:24:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7522c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f751c073840 con 0x7f751c06f290 2024-08-18T22:24:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7513400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c0cd3a0 0x7f751c159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7513400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c0cd3a0 0x7f751c159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59344/0 (socket says 172.21.15.5:59344) 2024-08-18T22:24:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7513400640 1 -- 172.21.15.5:0/6687646 learned_addr learned my addr 172.21.15.5:0/6687646 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f751be00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c06f290 0x7f751c1488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7520c00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c15b010 0x7f751c15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7513400640 1 -- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c06f290 msgr2=0x7f751c1488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7513400640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c06f290 0x7f751c1488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7513400640 1 -- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c15b010 msgr2=0x7f751c15a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7513400640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c15b010 0x7f751c15a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7513400640 1 -- 172.21.15.5:0/6687646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c158e40 con 0x7f751c0cd3a0 2024-08-18T22:24:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f751be00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c06f290 0x7f751c1488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.158+0000 7f7513400640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c0cd3a0 0x7f751c159c00 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f7504019040 tx=0x7f750401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.162+0000 7f7518c00640 1 -- 172.21.15.5:0/6687646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504004220 con 0x7f751c0cd3a0 2024-08-18T22:24:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.162+0000 7f7518c00640 1 -- 172.21.15.5:0/6687646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75040043c0 con 0x7f751c0cd3a0 2024-08-18T22:24:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.162+0000 7f7518c00640 1 -- 172.21.15.5:0/6687646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504003820 con 0x7f751c0cd3a0 2024-08-18T22:24:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.162+0000 7f7522c00640 1 -- 172.21.15.5:0/6687646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751c159120 con 0x7f751c0cd3a0 2024-08-18T22:24:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.162+0000 7f7522c00640 1 -- 172.21.15.5:0/6687646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751c148e20 con 0x7f751c0cd3a0 2024-08-18T22:24:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.162+0000 7f7522c00640 1 -- 172.21.15.5:0/6687646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751c0ce840 con 0x7f751c0cd3a0 2024-08-18T22:24:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.162+0000 7f7518c00640 1 -- 172.21.15.5:0/6687646 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f75040039c0 con 0x7f751c0cd3a0 2024-08-18T22:24:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.162+0000 7f7518c00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f74f80678c0 0x7f74f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.162+0000 7f7518c00640 1 -- 172.21.15.5:0/6687646 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5249+0+0 (secure 0 0 0) 0x7f75040a8020 con 0x7f751c0cd3a0 2024-08-18T22:24:36.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.162+0000 7f751be00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f74f80678c0 0x7f74f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.166+0000 7f751be00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f74f80678c0 0x7f74f8069d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f750c000f70 tx=0x7f750c007c40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.166+0000 7f7518c00640 1 -- 172.21.15.5:0/6687646 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f75040c4030 con 0x7f751c0cd3a0 2024-08-18T22:24:36.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.386+0000 7f7522c00640 1 -- 172.21.15.5:0/6687646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f751c06f750 con 0x7f751c0cd3a0 2024-08-18T22:24:36.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.386+0000 7f7518c00640 1 -- 172.21.15.5:0/6687646 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f7504016050 con 0x7f751c0cd3a0 2024-08-18T22:24:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:36.387 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:24:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:24:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:24:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:24:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:24:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:24:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:24:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:24:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:24:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:24:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:24:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:24:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:24:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:24:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:24:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:24:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:24:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:24:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:24:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:24:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:24:36.401 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:24:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 -- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f74f80678c0 msgr2=0x7f74f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f74f80678c0 0x7f74f8069d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f750c000f70 tx=0x7f750c007c40 comp rx=0 tx=0).stop 2024-08-18T22:24:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 -- 172.21.15.5:0/6687646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c0cd3a0 msgr2=0x7f751c159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c0cd3a0 0x7f751c159c00 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f7504019040 tx=0x7f750401ac70 comp rx=0 tx=0).stop 2024-08-18T22:24:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 -- 172.21.15.5:0/6687646 shutdown_connections 2024-08-18T22:24:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f74f80678c0 0x7f74f8069d80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f751c15b010 0x7f751c15a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c0cd3a0 0x7f751c159c00 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 --2- 172.21.15.5:0/6687646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f751c06f290 0x7f751c1488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 -- 172.21.15.5:0/6687646 >> 172.21.15.5:0/6687646 conn(0x7f751c0b1c50 msgr2=0x7f751c15c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 -- 172.21.15.5:0/6687646 shutdown_connections 2024-08-18T22:24:36.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.390+0000 7f7522c00640 1 -- 172.21.15.5:0/6687646 wait complete. 2024-08-18T22:24:36.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:24:36.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7fedace00640 1 Processor -- start 2024-08-18T22:24:36.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7fedace00640 1 -- start start 2024-08-18T22:24:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7fedace00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feda815c180 0x7feda80b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7fedace00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feda806fad0 0x7feda815c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7fedace00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda80b5e30 con 0x7feda8071580 2024-08-18T22:24:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7fedace00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7feda815caa0 con 0x7feda806fad0 2024-08-18T22:24:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7fedace00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7feda80b6110 con 0x7feda815c180 2024-08-18T22:24:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7feda5400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feda806fad0 0x7feda815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7feda5400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feda806fad0 0x7feda815c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59348/0 (socket says 172.21.15.5:59348) 2024-08-18T22:24:36.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7feda5400640 1 -- 172.21.15.5:0/4104560511 learned_addr learned my addr 172.21.15.5:0/4104560511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7feda5e00640 1 --2- 172.21.15.5:0/4104560511 >> v2:172.21.15.117:3300/0 conn(0x7feda815c180 0x7feda80b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7feda5400640 1 -- 172.21.15.5:0/4104560511 >> v2:172.21.15.117:3300/0 conn(0x7feda815c180 msgr2=0x7feda80b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7feda5400640 1 --2- 172.21.15.5:0/4104560511 >> v2:172.21.15.117:3300/0 conn(0x7feda815c180 0x7feda80b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7feda5400640 1 -- 172.21.15.5:0/4104560511 >> v1:172.21.15.117:6789/0 conn(0x7feda8071580 legacy=0x7feda80d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7feda5400640 1 -- 172.21.15.5:0/4104560511 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda80b63f0 con 0x7feda806fad0 2024-08-18T22:24:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.550+0000 7feda4a00640 1 -- 172.21.15.5:0/4104560511 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 645212987 0 0) 0x7feda80b5e30 con 0x7feda8071580 2024-08-18T22:24:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7feda5400640 1 --2- 172.21.15.5:0/4104560511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feda806fad0 0x7feda815c560 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7feda8050430 tx=0x7fed9401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59de991162ad9657 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7feda4a00640 1 -- 172.21.15.5:0/4104560511 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed940b2070 con 0x7feda806fad0 2024-08-18T22:24:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7feda4a00640 1 -- 172.21.15.5:0/4104560511 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed940a9070 con 0x7feda806fad0 2024-08-18T22:24:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7feda4a00640 1 -- 172.21.15.5:0/4104560511 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed940ad880 con 0x7feda806fad0 2024-08-18T22:24:36.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7fedace00640 1 -- 172.21.15.5:0/4104560511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feda806fad0 msgr2=0x7feda815c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7fedace00640 1 --2- 172.21.15.5:0/4104560511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feda806fad0 0x7feda815c560 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7feda8050430 tx=0x7fed9401c3d0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7fedace00640 1 -- 172.21.15.5:0/4104560511 shutdown_connections 2024-08-18T22:24:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7fedace00640 1 --2- 172.21.15.5:0/4104560511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feda806fad0 0x7feda815c560 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7fedace00640 1 --2- 172.21.15.5:0/4104560511 >> v2:172.21.15.117:3300/0 conn(0x7feda815c180 0x7feda80b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7fedace00640 1 -- 172.21.15.5:0/4104560511 >> 172.21.15.5:0/4104560511 conn(0x7feda80b3eb0 msgr2=0x7feda80b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7fedace00640 1 -- 172.21.15.5:0/4104560511 shutdown_connections 2024-08-18T22:24:36.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.554+0000 7fedace00640 1 -- 172.21.15.5:0/4104560511 wait complete. 2024-08-18T22:24:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fedace00640 1 Processor -- start 2024-08-18T22:24:36.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fedace00640 1 -- start start 2024-08-18T22:24:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fedace00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda806fad0 0x7feda8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fedace00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda8071580 0x7feda814fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fedace00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feda815c180 0x7feda814bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fedace00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feda8168fd0 con 0x7feda815c180 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fedace00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feda8071de0 con 0x7feda806fad0 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fedace00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feda8169150 con 0x7feda8071580 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7feda6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feda815c180 0x7feda814bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7feda6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feda815c180 0x7feda814bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59352/0 (socket says 172.21.15.5:59352) 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7feda6800640 1 -- 172.21.15.5:0/2301043080 learned_addr learned my addr 172.21.15.5:0/2301043080 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7feda5e00640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda806fad0 0x7feda8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7feda5400640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda8071580 0x7feda814fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7feda6800640 1 -- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda8071580 msgr2=0x7feda814fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7feda6800640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda8071580 0x7feda814fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7feda6800640 1 -- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda806fad0 msgr2=0x7feda8157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7feda6800640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda806fad0 0x7feda8157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7feda6800640 1 -- 172.21.15.5:0/2301043080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda8150280 con 0x7feda815c180 2024-08-18T22:24:36.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7feda6800640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feda815c180 0x7feda814bcb0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7feda000c780 tx=0x7feda000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:36.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fed9e000640 1 -- 172.21.15.5:0/2301043080 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0003db0 con 0x7feda815c180 2024-08-18T22:24:36.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fed9e000640 1 -- 172.21.15.5:0/2301043080 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda000ce30 con 0x7feda815c180 2024-08-18T22:24:36.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fed9e000640 1 -- 172.21.15.5:0/2301043080 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0005290 con 0x7feda815c180 2024-08-18T22:24:36.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fedace00640 1 -- 172.21.15.5:0/2301043080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda8150560 con 0x7feda815c180 2024-08-18T22:24:36.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.558+0000 7fedace00640 1 -- 172.21.15.5:0/2301043080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda8150b20 con 0x7feda815c180 2024-08-18T22:24:36.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.562+0000 7fedace00640 1 -- 172.21.15.5:0/2301043080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda815c560 con 0x7feda815c180 2024-08-18T22:24:36.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.562+0000 7fed9e000640 1 -- 172.21.15.5:0/2301043080 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feda0005430 con 0x7feda815c180 2024-08-18T22:24:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.562+0000 7fed9e000640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed880678c0 0x7fed88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.562+0000 7fed9e000640 1 -- 172.21.15.5:0/2301043080 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5249+0+0 (secure 0 0 0) 0x7feda0085960 con 0x7feda815c180 2024-08-18T22:24:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.562+0000 7feda5e00640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed880678c0 0x7fed88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.562+0000 7feda5e00640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed880678c0 0x7fed88069d80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fed98009ac0 tx=0x7fed98009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.566+0000 7fed9e000640 1 -- 172.21.15.5:0/2301043080 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7feda0055f60 con 0x7feda815c180 2024-08-18T22:24:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.734+0000 7fedace00640 1 -- 172.21.15.5:0/2301043080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7feda80725e0 con 0x7feda815c180 2024-08-18T22:24:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.734+0000 7fed9e000640 1 -- 172.21.15.5:0/2301043080 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v93) ==== 84+0+65 (secure 0 0 0) 0x7feda005a260 con 0x7feda815c180 2024-08-18T22:24:36.735 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:36.736 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:24:36.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:24:36.736 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:24:36.736 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:24:36.736 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:24:36.736 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:24:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 -- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed880678c0 msgr2=0x7fed88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed880678c0 0x7fed88069d80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fed98009ac0 tx=0x7fed98009190 comp rx=0 tx=0).stop 2024-08-18T22:24:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 -- 172.21.15.5:0/2301043080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feda815c180 msgr2=0x7feda814bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feda815c180 0x7feda814bcb0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7feda000c780 tx=0x7feda000cc40 comp rx=0 tx=0).stop 2024-08-18T22:24:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 -- 172.21.15.5:0/2301043080 shutdown_connections 2024-08-18T22:24:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed880678c0 0x7fed88069d80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feda815c180 0x7feda814bcb0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda8071580 0x7feda814fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 --2- 172.21.15.5:0/2301043080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda806fad0 0x7feda8157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 -- 172.21.15.5:0/2301043080 >> 172.21.15.5:0/2301043080 conn(0x7feda80b3eb0 msgr2=0x7feda80d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 -- 172.21.15.5:0/2301043080 shutdown_connections 2024-08-18T22:24:36.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.738+0000 7fedace00640 1 -- 172.21.15.5:0/2301043080 wait complete. 2024-08-18T22:24:36.756 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:24:36.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:24:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a21400640 1 Processor -- start 2024-08-18T22:24:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a21400640 1 -- start start 2024-08-18T22:24:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a21400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a1c0b71c0 0x7f6a1c0af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a21400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a1c06ff20 con 0x7f6a1c15e560 2024-08-18T22:24:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a21400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a1c0701c0 con 0x7f6a1c06d440 2024-08-18T22:24:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a21400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1c070dd0 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a1a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6a1c15e560 0x7f6a1c0b6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33076/0 (socket says 172.21.15.5:33076) 2024-08-18T22:24:36.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a1a800640 1 -- 172.21.15.5:0/3911269982 learned_addr learned my addr 172.21.15.5:0/3911269982 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a11e00640 1 --2- 172.21.15.5:0/3911269982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a1c0b71c0 0x7f6a1c0af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a19e00640 1 -- 172.21.15.5:0/3911269982 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069124135 0 0) 0x7f6a1c06ff20 con 0x7f6a1c15e560 2024-08-18T22:24:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a19e00640 1 -- 172.21.15.5:0/3911269982 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a00003530 con 0x7f6a1c15e560 2024-08-18T22:24:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a11e00640 1 -- 172.21.15.5:0/3911269982 >> v1:172.21.15.117:6789/0 conn(0x7f6a1c06d440 legacy=0x7f6a1c071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a19e00640 1 -- 172.21.15.5:0/3911269982 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 451642624 0 0) 0x7f6a1c0701c0 con 0x7f6a1c06d440 2024-08-18T22:24:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a11e00640 1 -- 172.21.15.5:0/3911269982 >> v1:172.21.15.5:6789/0 conn(0x7f6a1c15e560 legacy=0x7f6a1c0b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.902+0000 7f6a11e00640 1 -- 172.21.15.5:0/3911269982 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c0704a0 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.906+0000 7f6a11e00640 1 --2- 172.21.15.5:0/3911269982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a1c0b71c0 0x7f6a1c0af040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097f0 tx=0x7f6a0401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfb172c47709303e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.906+0000 7f6a19e00640 1 -- 172.21.15.5:0/3911269982 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a040aa5f0 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.906+0000 7f6a19e00640 1 -- 172.21.15.5:0/3911269982 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a040af070 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.906+0000 7f6a19e00640 1 -- 172.21.15.5:0/3911269982 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a040aa990 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.906+0000 7f6a21400640 1 -- 172.21.15.5:0/3911269982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a1c0b71c0 msgr2=0x7f6a1c0af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.906+0000 7f6a21400640 1 --2- 172.21.15.5:0/3911269982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a1c0b71c0 0x7f6a1c0af040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097f0 tx=0x7f6a0401c4b0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.906+0000 7f6a21400640 1 -- 172.21.15.5:0/3911269982 shutdown_connections 2024-08-18T22:24:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.906+0000 7f6a21400640 1 --2- 172.21.15.5:0/3911269982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a1c0b71c0 0x7f6a1c0af040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.906+0000 7f6a21400640 1 -- 172.21.15.5:0/3911269982 >> 172.21.15.5:0/3911269982 conn(0x7f6a1c0b3dd0 msgr2=0x7f6a1c0b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.906+0000 7f6a21400640 1 -- 172.21.15.5:0/3911269982 shutdown_connections 2024-08-18T22:24:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.906+0000 7f6a21400640 1 -- 172.21.15.5:0/3911269982 wait complete. 2024-08-18T22:24:36.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a21400640 1 Processor -- start 2024-08-18T22:24:36.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a21400640 1 -- start start 2024-08-18T22:24:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a21400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a1c06d440 0x7f6a1c161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a21400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a1c0b71c0 0x7f6a1c09c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a21400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a1c15e560 0x7f6a1c09dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a21400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c16c0d0 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a21400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c16bf50 con 0x7f6a1c15e560 2024-08-18T22:24:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a21400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1c16c250 con 0x7f6a1c06d440 2024-08-18T22:24:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a11e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a1c0b71c0 0x7f6a1c09c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a11e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a1c0b71c0 0x7f6a1c09c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59354/0 (socket says 172.21.15.5:59354) 2024-08-18T22:24:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a11e00640 1 -- 172.21.15.5:0/3450559500 learned_addr learned my addr 172.21.15.5:0/3450559500 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a1a800640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a1c06d440 0x7f6a1c161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a1b200640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a1c15e560 0x7f6a1c09dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a11e00640 1 -- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a1c06d440 msgr2=0x7f6a1c161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a11e00640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a1c06d440 0x7f6a1c161290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a11e00640 1 -- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a1c15e560 msgr2=0x7f6a1c09dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a11e00640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a1c15e560 0x7f6a1c09dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a11e00640 1 -- 172.21.15.5:0/3450559500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c1527b0 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a11e00640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a1c0b71c0 0x7f6a1c09c1c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097f0 tx=0x7f6a0401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:36.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a13400640 1 -- 172.21.15.5:0/3450559500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04006e20 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a13400640 1 -- 172.21.15.5:0/3450559500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a040be610 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a13400640 1 -- 172.21.15.5:0/3450559500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a040be9c0 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a21400640 1 -- 172.21.15.5:0/3450559500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1c152a90 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.910+0000 7f6a21400640 1 -- 172.21.15.5:0/3450559500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1c153050 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.914+0000 7f6a21400640 1 -- 172.21.15.5:0/3450559500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a1c0af040 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.914+0000 7f6a13400640 1 -- 172.21.15.5:0/3450559500 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a040bc020 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.914+0000 7f6a13400640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69f80678f0 0x7f69f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:36.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.914+0000 7f6a13400640 1 -- 172.21.15.5:0/3450559500 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5249+0+0 (secure 0 0 0) 0x7f6a0411ffe0 con 0x7f6a1c0b71c0 2024-08-18T22:24:36.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.914+0000 7f6a1a800640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69f80678f0 0x7f69f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:36.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.914+0000 7f6a1a800640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69f80678f0 0x7f69f8069db0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c007fd0 tx=0x7f6a0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:36.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:36.918+0000 7f6a13400640 1 -- 172.21.15.5:0/3450559500 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6a040160d0 con 0x7f6a1c0b71c0 2024-08-18T22:24:37.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.086+0000 7f6a21400640 1 -- 172.21.15.5:0/3450559500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6a1c1542b0 con 0x7f6a1c0b71c0 2024-08-18T22:24:37.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.986+0000 7f6a13400640 1 -- 172.21.15.5:0/3450559500 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v94) ==== 138+0+0 (secure 0 0 0) 0x7f6a040f05f0 con 0x7f6a1c0b71c0 2024-08-18T22:24:37.986 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:24:37.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 -- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69f80678f0 msgr2=0x7f69f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:37.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69f80678f0 0x7f69f8069db0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c007fd0 tx=0x7f6a0c009040 comp rx=0 tx=0).stop 2024-08-18T22:24:37.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 -- 172.21.15.5:0/3450559500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a1c0b71c0 msgr2=0x7f6a1c09c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:37.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a1c0b71c0 0x7f6a1c09c1c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097f0 tx=0x7f6a0401acf0 comp rx=0 tx=0).stop 2024-08-18T22:24:37.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 -- 172.21.15.5:0/3450559500 shutdown_connections 2024-08-18T22:24:37.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69f80678f0 0x7f69f8069db0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:37.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a1c15e560 0x7f6a1c09dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:37.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a1c0b71c0 0x7f6a1c09c1c0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:37.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 --2- 172.21.15.5:0/3450559500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a1c06d440 0x7f6a1c161290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:37.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 -- 172.21.15.5:0/3450559500 >> 172.21.15.5:0/3450559500 conn(0x7f6a1c0b3dd0 msgr2=0x7f6a1c0af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:37.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 -- 172.21.15.5:0/3450559500 shutdown_connections 2024-08-18T22:24:37.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:37.990+0000 7f6a21400640 1 -- 172.21.15.5:0/3450559500 wait complete. 2024-08-18T22:24:38.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:24:38.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0057800640 1 Processor -- start 2024-08-18T22:24:38.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0057800640 1 -- start start 2024-08-18T22:24:38.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0057800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f005015c180 0x7f00500cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:38.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0057800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f005015c560 0x7f00500ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:38.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0057800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00500cfb00 con 0x7f005015d4d0 2024-08-18T22:24:38.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0057800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f005015d040 con 0x7f005015c180 2024-08-18T22:24:38.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0057800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f005015c9f0 con 0x7f005015c560 2024-08-18T22:24:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0054e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f005015c180 0x7f00500cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0054e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f005015c180 0x7f00500cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59356/0 (socket says 172.21.15.5:59356) 2024-08-18T22:24:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0054e00640 1 -- 172.21.15.5:0/3338746611 learned_addr learned my addr 172.21.15.5:0/3338746611 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0047e00640 1 --2- 172.21.15.5:0/3338746611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f005015c560 0x7f00500ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0054e00640 1 -- 172.21.15.5:0/3338746611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f005015c560 msgr2=0x7f00500ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0054e00640 1 --2- 172.21.15.5:0/3338746611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f005015c560 0x7f00500ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.170+0000 7f0054e00640 1 -- 172.21.15.5:0/3338746611 >> v1:172.21.15.117:6789/0 conn(0x7f005015d4d0 legacy=0x7f005015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f0054e00640 1 -- 172.21.15.5:0/3338746611 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005015ccd0 con 0x7f005015c180 2024-08-18T22:24:38.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f0047e00640 1 --2- 172.21.15.5:0/3338746611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f005015c560 0x7f00500ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f0054e00640 1 --2- 172.21.15.5:0/3338746611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005015c180 0x7f00500cdf10 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f0040009870 tx=0x7f004001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfa6a72a4dc0e08 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f004fe00640 1 -- 172.21.15.5:0/3338746611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00400aa650 con 0x7f005015c180 2024-08-18T22:24:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f004fe00640 1 -- 172.21.15.5:0/3338746611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00400af070 con 0x7f005015c180 2024-08-18T22:24:38.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f004fe00640 1 -- 172.21.15.5:0/3338746611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00400aaa10 con 0x7f005015c180 2024-08-18T22:24:38.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f0057800640 1 -- 172.21.15.5:0/3338746611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005015c180 msgr2=0x7f00500cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:38.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f0057800640 1 --2- 172.21.15.5:0/3338746611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005015c180 0x7f00500cdf10 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f0040009870 tx=0x7f004001c4d0 comp rx=0 tx=0).stop 2024-08-18T22:24:38.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f0057800640 1 -- 172.21.15.5:0/3338746611 shutdown_connections 2024-08-18T22:24:38.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f0057800640 1 --2- 172.21.15.5:0/3338746611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f005015c560 0x7f00500ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:38.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f0057800640 1 --2- 172.21.15.5:0/3338746611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005015c180 0x7f00500cdf10 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:38.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f0057800640 1 -- 172.21.15.5:0/3338746611 >> 172.21.15.5:0/3338746611 conn(0x7f00500b1dc0 msgr2=0x7f00500b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:38.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f0057800640 1 -- 172.21.15.5:0/3338746611 shutdown_connections 2024-08-18T22:24:38.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.174+0000 7f0057800640 1 -- 172.21.15.5:0/3338746611 wait complete. 2024-08-18T22:24:38.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0057800640 1 Processor -- start 2024-08-18T22:24:38.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0057800640 1 -- start start 2024-08-18T22:24:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0057800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f005015c180 0x7f0050158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0057800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f005015d4d0 0x7f0050154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0057800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00501563c0 0x7f0050154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0057800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f00501692b0 con 0x7f00501563c0 2024-08-18T22:24:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0057800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0050169130 con 0x7f005015d4d0 2024-08-18T22:24:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0057800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0050169430 con 0x7f005015c180 2024-08-18T22:24:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0047e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f005015d4d0 0x7f0050154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0054e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f005015c180 0x7f0050158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0055800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00501563c0 0x7f0050154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0047e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f005015d4d0 0x7f0050154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:54848/0 (socket says 172.21.15.5:54848) 2024-08-18T22:24:38.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0047e00640 1 -- 172.21.15.5:0/855021554 learned_addr learned my addr 172.21.15.5:0/855021554 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0055800640 1 -- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f005015c180 msgr2=0x7f0050158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:38.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0055800640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f005015c180 0x7f0050158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0055800640 1 -- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f005015d4d0 msgr2=0x7f0050154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0055800640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f005015d4d0 0x7f0050154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0055800640 1 -- 172.21.15.5:0/855021554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005009c4a0 con 0x7f00501563c0 2024-08-18T22:24:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0055800640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00501563c0 0x7f0050154550 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f00500b5280 tx=0x7f004800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f004d600640 1 -- 172.21.15.5:0/855021554 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048003b80 con 0x7f00501563c0 2024-08-18T22:24:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f004d600640 1 -- 172.21.15.5:0/855021554 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0048003d20 con 0x7f00501563c0 2024-08-18T22:24:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f0057800640 1 -- 172.21.15.5:0/855021554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0050150240 con 0x7f00501563c0 2024-08-18T22:24:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.178+0000 7f004d600640 1 -- 172.21.15.5:0/855021554 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048005310 con 0x7f00501563c0 2024-08-18T22:24:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.182+0000 7f0057800640 1 -- 172.21.15.5:0/855021554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f005009c0a0 con 0x7f00501563c0 2024-08-18T22:24:38.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.182+0000 7f0057800640 1 -- 172.21.15.5:0/855021554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f005009c920 con 0x7f00501563c0 2024-08-18T22:24:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.182+0000 7f004d600640 1 -- 172.21.15.5:0/855021554 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00480056c0 con 0x7f00501563c0 2024-08-18T22:24:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.182+0000 7f004d600640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f002c0678c0 0x7f002c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.182+0000 7f004d600640 1 -- 172.21.15.5:0/855021554 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5619+0+0 (secure 0 0 0) 0x7f0048085b90 con 0x7f00501563c0 2024-08-18T22:24:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.182+0000 7f0054e00640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f002c0678c0 0x7f002c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.182+0000 7f0054e00640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f002c0678c0 0x7f002c069d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f00400ae000 tx=0x7f00400a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:38.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.186+0000 7f004d600640 1 -- 172.21.15.5:0/855021554 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0048056030 con 0x7f00501563c0 2024-08-18T22:24:38.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.354+0000 7f0057800640 1 -- 172.21.15.5:0/855021554 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0050150030 con 0x7f00501563c0 2024-08-18T22:24:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.994+0000 7f004d600640 1 -- 172.21.15.5:0/855021554 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v95) ==== 170+0+0 (secure 0 0 0) 0x7f004805a330 con 0x7f00501563c0 2024-08-18T22:24:38.994 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:24:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 -- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f002c0678c0 msgr2=0x7f002c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f002c0678c0 0x7f002c069d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f00400ae000 tx=0x7f00400a7000 comp rx=0 tx=0).stop 2024-08-18T22:24:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 -- 172.21.15.5:0/855021554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00501563c0 msgr2=0x7f0050154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:38.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00501563c0 0x7f0050154550 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f00500b5280 tx=0x7f004800cb90 comp rx=0 tx=0).stop 2024-08-18T22:24:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 -- 172.21.15.5:0/855021554 shutdown_connections 2024-08-18T22:24:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f002c0678c0 0x7f002c069d80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00501563c0 0x7f0050154550 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f005015d4d0 0x7f0050154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 --2- 172.21.15.5:0/855021554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f005015c180 0x7f0050158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 -- 172.21.15.5:0/855021554 >> 172.21.15.5:0/855021554 conn(0x7f00500b1dc0 msgr2=0x7f005006e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:38.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 -- 172.21.15.5:0/855021554 shutdown_connections 2024-08-18T22:24:38.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:38.998+0000 7f0057800640 1 -- 172.21.15.5:0/855021554 wait complete. 2024-08-18T22:24:39.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:24:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff772800640 1 Processor -- start 2024-08-18T22:24:39.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff772800640 1 -- start start 2024-08-18T22:24:39.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff772800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff76c09aca0 0x7ff76c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:39.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff772800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff76c09b080 0x7ff76c0b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:39.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff772800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff76c06e8a0 con 0x7ff76c0b1300 2024-08-18T22:24:39.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff772800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff76c09bb80 con 0x7ff76c09b080 2024-08-18T22:24:39.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff772800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff76c0d2e40 con 0x7ff76c09aca0 2024-08-18T22:24:39.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff76be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff76c09b080 0x7ff76c0b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:39.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff76be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff76c09b080 0x7ff76c0b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59376/0 (socket says 172.21.15.5:59376) 2024-08-18T22:24:39.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff76be00640 1 -- 172.21.15.5:0/3915205258 learned_addr learned my addr 172.21.15.5:0/3915205258 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff762a00640 1 --1- 172.21.15.5:0/3915205258 >> v1:172.21.15.5:6789/0 conn(0x7ff76c0b1300 0x7ff76c0affd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33086/0 (socket says 172.21.15.5:33086) 2024-08-18T22:24:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff76b400640 1 --2- 172.21.15.5:0/3915205258 >> v2:172.21.15.117:3300/0 conn(0x7ff76c09aca0 0x7ff76c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff76be00640 1 -- 172.21.15.5:0/3915205258 >> v2:172.21.15.117:3300/0 conn(0x7ff76c09aca0 msgr2=0x7ff76c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff76be00640 1 --2- 172.21.15.5:0/3915205258 >> v2:172.21.15.117:3300/0 conn(0x7ff76c09aca0 0x7ff76c0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff76be00640 1 -- 172.21.15.5:0/3915205258 >> v1:172.21.15.5:6789/0 conn(0x7ff76c0b1300 legacy=0x7ff76c0affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:39.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff76aa00640 1 -- 172.21.15.5:0/3915205258 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3010793529 0 0) 0x7ff76c06e8a0 con 0x7ff76c0b1300 2024-08-18T22:24:39.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.186+0000 7ff76be00640 1 -- 172.21.15.5:0/3915205258 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c06cbd0 con 0x7ff76c09b080 2024-08-18T22:24:39.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff76be00640 1 --2- 172.21.15.5:0/3915205258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76c09b080 0x7ff76c0b06e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff76c06f260 tx=0x7ff76401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e6155fbd740ce1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff76aa00640 1 -- 172.21.15.5:0/3915205258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7640b1070 con 0x7ff76c09b080 2024-08-18T22:24:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff76aa00640 1 -- 172.21.15.5:0/3915205258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7640ac630 con 0x7ff76c09b080 2024-08-18T22:24:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff76aa00640 1 -- 172.21.15.5:0/3915205258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7640a8050 con 0x7ff76c09b080 2024-08-18T22:24:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff772800640 1 -- 172.21.15.5:0/3915205258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76c09b080 msgr2=0x7ff76c0b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:39.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff772800640 1 --2- 172.21.15.5:0/3915205258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76c09b080 0x7ff76c0b06e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff76c06f260 tx=0x7ff76401c520 comp rx=0 tx=0).stop 2024-08-18T22:24:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff772800640 1 -- 172.21.15.5:0/3915205258 shutdown_connections 2024-08-18T22:24:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff772800640 1 --2- 172.21.15.5:0/3915205258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76c09b080 0x7ff76c0b06e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff772800640 1 --2- 172.21.15.5:0/3915205258 >> v2:172.21.15.117:3300/0 conn(0x7ff76c09aca0 0x7ff76c0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff772800640 1 -- 172.21.15.5:0/3915205258 >> 172.21.15.5:0/3915205258 conn(0x7ff76c0d2180 msgr2=0x7ff76c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff772800640 1 -- 172.21.15.5:0/3915205258 shutdown_connections 2024-08-18T22:24:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.190+0000 7ff772800640 1 -- 172.21.15.5:0/3915205258 wait complete. 2024-08-18T22:24:39.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff772800640 1 Processor -- start 2024-08-18T22:24:39.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff772800640 1 -- start start 2024-08-18T22:24:39.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff772800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76c09aca0 0x7ff76c14dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:39.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff772800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c09b080 0x7ff76c14eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:39.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff772800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c0b1300 0x7ff76c14f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:39.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff772800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c16b6b0 con 0x7ff76c09aca0 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff772800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c16b530 con 0x7ff76c0b1300 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff772800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff76c16b830 con 0x7ff76c09b080 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff76b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76c09aca0 0x7ff76c14dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff76b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76c09aca0 0x7ff76c14dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59378/0 (socket says 172.21.15.5:59378) 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff76b400640 1 -- 172.21.15.5:0/255807507 learned_addr learned my addr 172.21.15.5:0/255807507 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff76b400640 1 -- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c09b080 msgr2=0x7ff76c14eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff76b400640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c09b080 0x7ff76c14eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff76b400640 1 -- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c0b1300 msgr2=0x7ff76c14f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff76b400640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c0b1300 0x7ff76c14f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff76b400640 1 -- 172.21.15.5:0/255807507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c0b1e40 con 0x7ff76c09aca0 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff76b400640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76c09aca0 0x7ff76c14dcd0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e960 tx=0x7ff75c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff763e00640 1 -- 172.21.15.5:0/255807507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c017070 con 0x7ff76c09aca0 2024-08-18T22:24:39.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff763e00640 1 -- 172.21.15.5:0/255807507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75c00ca00 con 0x7ff76c09aca0 2024-08-18T22:24:39.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff763e00640 1 -- 172.21.15.5:0/255807507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00cdb0 con 0x7ff76c09aca0 2024-08-18T22:24:39.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff772800640 1 -- 172.21.15.5:0/255807507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c0b2120 con 0x7ff76c09aca0 2024-08-18T22:24:39.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.194+0000 7ff772800640 1 -- 172.21.15.5:0/255807507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c0b50f0 con 0x7ff76c09aca0 2024-08-18T22:24:39.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.198+0000 7ff772800640 1 -- 172.21.15.5:0/255807507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76c161940 con 0x7ff76c09aca0 2024-08-18T22:24:39.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.198+0000 7ff763e00640 1 -- 172.21.15.5:0/255807507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff75c01a070 con 0x7ff76c09aca0 2024-08-18T22:24:39.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.198+0000 7ff763e00640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7480678f0 0x7ff748069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:39.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.198+0000 7ff763e00640 1 -- 172.21.15.5:0/255807507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6001+0+0 (secure 0 0 0) 0x7ff75c086520 con 0x7ff76c09aca0 2024-08-18T22:24:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.198+0000 7ff762a00640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7480678f0 0x7ff748069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.198+0000 7ff762a00640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7480678f0 0x7ff748069db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff76c1fa230 tx=0x7ff754007cf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:39.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.202+0000 7ff763e00640 1 -- 172.21.15.5:0/255807507 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff75c056fa0 con 0x7ff76c09aca0 2024-08-18T22:24:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:39.402+0000 7ff772800640 1 -- 172.21.15.5:0/255807507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff76c0d1890 con 0x7ff76c09aca0 2024-08-18T22:24:40.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.010+0000 7ff763e00640 1 -- 172.21.15.5:0/255807507 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v68) ==== 174+0+0 (secure 0 0 0) 0x7ff75c0568a0 con 0x7ff76c09aca0 2024-08-18T22:24:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 13 and data pool 14 2024-08-18T22:24:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.022+0000 7ff772800640 1 -- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7480678f0 msgr2=0x7ff748069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.022+0000 7ff772800640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7480678f0 0x7ff748069db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff76c1fa230 tx=0x7ff754007cf0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.022+0000 7ff772800640 1 -- 172.21.15.5:0/255807507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76c09aca0 msgr2=0x7ff76c14dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.022+0000 7ff772800640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76c09aca0 0x7ff76c14dcd0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e960 tx=0x7ff75c00ee20 comp rx=0 tx=0).stop 2024-08-18T22:24:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.026+0000 7ff772800640 1 -- 172.21.15.5:0/255807507 shutdown_connections 2024-08-18T22:24:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.026+0000 7ff772800640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7480678f0 0x7ff748069db0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.026+0000 7ff772800640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff76c0b1300 0x7ff76c14f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.026+0000 7ff772800640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff76c09b080 0x7ff76c14eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.026+0000 7ff772800640 1 --2- 172.21.15.5:0/255807507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff76c09aca0 0x7ff76c14dcd0 secure :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e960 tx=0x7ff75c00ee20 comp rx=0 tx=0).stop 2024-08-18T22:24:40.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.026+0000 7ff772800640 1 -- 172.21.15.5:0/255807507 >> 172.21.15.5:0/255807507 conn(0x7ff76c0d2180 msgr2=0x7ff76c15a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:40.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.026+0000 7ff772800640 1 -- 172.21.15.5:0/255807507 shutdown_connections 2024-08-18T22:24:40.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.034+0000 7ff772800640 1 -- 172.21.15.5:0/255807507 wait complete. 2024-08-18T22:24:40.061 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:24:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.202+0000 7ff97cc00640 1 Processor -- start 2024-08-18T22:24:40.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.202+0000 7ff97cc00640 1 -- start start 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff97cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9780cb390 0x7ff9780735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff97cc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff97806da70 0x7ff97806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff97cc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff978073c80 con 0x7ff97815bed0 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff97cc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff97806e420 con 0x7ff9780cb390 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff97cc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff9780ca5d0 con 0x7ff97806da70 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff96d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9780cb390 0x7ff9780735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff96d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9780cb390 0x7ff9780735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59382/0 (socket says 172.21.15.5:59382) 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff96d400640 1 -- 172.21.15.5:0/4012565748 learned_addr learned my addr 172.21.15.5:0/4012565748 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff976800640 1 --2- 172.21.15.5:0/4012565748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff97806da70 0x7ff97806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff96d400640 1 -- 172.21.15.5:0/4012565748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff97806da70 msgr2=0x7ff97806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff96d400640 1 --2- 172.21.15.5:0/4012565748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff97806da70 0x7ff97806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff96d400640 1 -- 172.21.15.5:0/4012565748 >> v1:172.21.15.117:6789/0 conn(0x7ff97815bed0 legacy=0x7ff978071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff96d400640 1 -- 172.21.15.5:0/4012565748 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9780ca8b0 con 0x7ff9780cb390 2024-08-18T22:24:40.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff96d400640 1 --2- 172.21.15.5:0/4012565748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9780cb390 0x7ff9780735a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff960009870 tx=0x7ff96001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd177a9aec8a352 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.206+0000 7ff975400640 1 -- 172.21.15.5:0/4012565748 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9600a95f0 con 0x7ff9780cb390 2024-08-18T22:24:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff975400640 1 -- 172.21.15.5:0/4012565748 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9600a9790 con 0x7ff9780cb390 2024-08-18T22:24:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff975400640 1 -- 172.21.15.5:0/4012565748 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9600a9b60 con 0x7ff9780cb390 2024-08-18T22:24:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 -- 172.21.15.5:0/4012565748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9780cb390 msgr2=0x7ff9780735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 --2- 172.21.15.5:0/4012565748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9780cb390 0x7ff9780735a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff960009870 tx=0x7ff96001c530 comp rx=0 tx=0).stop 2024-08-18T22:24:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 -- 172.21.15.5:0/4012565748 shutdown_connections 2024-08-18T22:24:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 --2- 172.21.15.5:0/4012565748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff97806da70 0x7ff97806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 --2- 172.21.15.5:0/4012565748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9780cb390 0x7ff9780735a0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 -- 172.21.15.5:0/4012565748 >> 172.21.15.5:0/4012565748 conn(0x7ff9780b1c50 msgr2=0x7ff9780b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 -- 172.21.15.5:0/4012565748 shutdown_connections 2024-08-18T22:24:40.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 -- 172.21.15.5:0/4012565748 wait complete. 2024-08-18T22:24:40.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 Processor -- start 2024-08-18T22:24:40.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 -- start start 2024-08-18T22:24:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff97806da70 0x7ff978156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9780cb390 0x7ff9780cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff97815bed0 0x7ff978155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff978168520 con 0x7ff97815bed0 2024-08-18T22:24:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff9781683a0 con 0x7ff9780cb390 2024-08-18T22:24:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff97cc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff9781686a0 con 0x7ff97806da70 2024-08-18T22:24:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff976800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff97815bed0 0x7ff978155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff976800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff97815bed0 0x7ff978155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59392/0 (socket says 172.21.15.5:59392) 2024-08-18T22:24:40.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff976800640 1 -- 172.21.15.5:0/3343754993 learned_addr learned my addr 172.21.15.5:0/3343754993 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff96d400640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9780cb390 0x7ff9780cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff975e00640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff97806da70 0x7ff978156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff976800640 1 -- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff97806da70 msgr2=0x7ff978156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff976800640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff97806da70 0x7ff978156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff976800640 1 -- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9780cb390 msgr2=0x7ff9780cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff976800640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9780cb390 0x7ff9780cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.210+0000 7ff976800640 1 -- 172.21.15.5:0/3343754993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9780ce670 con 0x7ff97815bed0 2024-08-18T22:24:40.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.214+0000 7ff976800640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff97815bed0 0x7ff978155730 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff970007e60 tx=0x7ff97000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.214+0000 7ff96ea00640 1 -- 172.21.15.5:0/3343754993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970014420 con 0x7ff97815bed0 2024-08-18T22:24:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.214+0000 7ff96ea00640 1 -- 172.21.15.5:0/3343754993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff970019070 con 0x7ff97815bed0 2024-08-18T22:24:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.214+0000 7ff96ea00640 1 -- 172.21.15.5:0/3343754993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970014820 con 0x7ff97815bed0 2024-08-18T22:24:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.214+0000 7ff97cc00640 1 -- 172.21.15.5:0/3343754993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9780ce950 con 0x7ff97815bed0 2024-08-18T22:24:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.214+0000 7ff97cc00640 1 -- 172.21.15.5:0/3343754993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9780cef10 con 0x7ff97815bed0 2024-08-18T22:24:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.214+0000 7ff97cc00640 1 -- 172.21.15.5:0/3343754993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff97806dee0 con 0x7ff97815bed0 2024-08-18T22:24:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.214+0000 7ff96ea00640 1 -- 172.21.15.5:0/3343754993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff9700149c0 con 0x7ff97815bed0 2024-08-18T22:24:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.214+0000 7ff96ea00640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9540678c0 0x7ff954069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.214+0000 7ff96ea00640 1 -- 172.21.15.5:0/3343754993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6101+0+0 (secure 0 0 0) 0x7ff970086740 con 0x7ff97815bed0 2024-08-18T22:24:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.214+0000 7ff975e00640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9540678c0 0x7ff954069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.218+0000 7ff975e00640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9540678c0 0x7ff954069d80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff968001650 tx=0x7ff968009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.218+0000 7ff96ea00640 1 -- 172.21.15.5:0/3343754993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff970057060 con 0x7ff97815bed0 2024-08-18T22:24:40.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 -- 172.21.15.5:0/3343754993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9780b2140 con 0x7ff97815bed0 2024-08-18T22:24:40.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff96ea00640 1 -- 172.21.15.5:0/3343754993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+16826 (secure 0 0 0) 0x7ff970056960 con 0x7ff97815bed0 2024-08-18T22:24:40.386 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:40.386 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":96,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:24:39.405155+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:24:37.136051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-08-18T22:24:38.401283+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:24:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 -- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9540678c0 msgr2=0x7ff954069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9540678c0 0x7ff954069d80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff968001650 tx=0x7ff968009040 comp rx=0 tx=0).stop 2024-08-18T22:24:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 -- 172.21.15.5:0/3343754993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff97815bed0 msgr2=0x7ff978155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff97815bed0 0x7ff978155730 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff970007e60 tx=0x7ff97000e4b0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 -- 172.21.15.5:0/3343754993 shutdown_connections 2024-08-18T22:24:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9540678c0 0x7ff954069d80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff97815bed0 0x7ff978155730 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9780cb390 0x7ff9780cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 --2- 172.21.15.5:0/3343754993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff97806da70 0x7ff978156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 -- 172.21.15.5:0/3343754993 >> 172.21.15.5:0/3343754993 conn(0x7ff9780b1c50 msgr2=0x7ff9780cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 -- 172.21.15.5:0/3343754993 shutdown_connections 2024-08-18T22:24:40.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.386+0000 7ff97cc00640 1 -- 172.21.15.5:0/3343754993 wait complete. 2024-08-18T22:24:40.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:24:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0132a00640 1 Processor -- start 2024-08-18T22:24:40.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0132a00640 1 -- start start 2024-08-18T22:24:40.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0132a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c06f290 0x7f012c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0132a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f012c0cd3a0 0x7f012c072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0132a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f012c0cee20 con 0x7f012c15b010 2024-08-18T22:24:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0132a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f012c0cfa30 con 0x7f012c0cd3a0 2024-08-18T22:24:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0132a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f012c0cf100 con 0x7f012c06f290 2024-08-18T22:24:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f012be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f012c15b010 0x7f012c06eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33094/0 (socket says 172.21.15.5:33094) 2024-08-18T22:24:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f012be00640 1 -- 172.21.15.5:0/3291338537 learned_addr learned my addr 172.21.15.5:0/3291338537 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:40.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0130a00640 1 --2- 172.21.15.5:0/3291338537 >> v2:172.21.15.5:3300/0 conn(0x7f012c0cd3a0 0x7f012c072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0130a00640 1 -- 172.21.15.5:0/3291338537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c06f290 msgr2=0x7f012c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0130a00640 1 --2- 172.21.15.5:0/3291338537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c06f290 0x7f012c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0130a00640 1 -- 172.21.15.5:0/3291338537 >> v1:172.21.15.5:6789/0 conn(0x7f012c15b010 legacy=0x7f012c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f0130a00640 1 -- 172.21.15.5:0/3291338537 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c0cf3e0 con 0x7f012c0cd3a0 2024-08-18T22:24:40.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.550+0000 7f012aa00640 1 -- 172.21.15.5:0/3291338537 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146484174 0 0) 0x7f012c0cee20 con 0x7f012c15b010 2024-08-18T22:24:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f0130a00640 1 --2- 172.21.15.5:0/3291338537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c0cd3a0 0x7f012c072620 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f0124009d90 tx=0x7f012401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cb28c4e09962b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f012aa00640 1 -- 172.21.15.5:0/3291338537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01240b2070 con 0x7f012c0cd3a0 2024-08-18T22:24:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f012aa00640 1 -- 172.21.15.5:0/3291338537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01240a5a00 con 0x7f012c0cd3a0 2024-08-18T22:24:40.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f012aa00640 1 -- 172.21.15.5:0/3291338537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01240a5dd0 con 0x7f012c0cd3a0 2024-08-18T22:24:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f0132a00640 1 -- 172.21.15.5:0/3291338537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c0cd3a0 msgr2=0x7f012c072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f0132a00640 1 --2- 172.21.15.5:0/3291338537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c0cd3a0 0x7f012c072620 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f0124009d90 tx=0x7f012401c960 comp rx=0 tx=0).stop 2024-08-18T22:24:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f0132a00640 1 -- 172.21.15.5:0/3291338537 shutdown_connections 2024-08-18T22:24:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f0132a00640 1 --2- 172.21.15.5:0/3291338537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c0cd3a0 0x7f012c072620 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f0132a00640 1 --2- 172.21.15.5:0/3291338537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c06f290 0x7f012c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f0132a00640 1 -- 172.21.15.5:0/3291338537 >> 172.21.15.5:0/3291338537 conn(0x7f012c0b1c50 msgr2=0x7f012c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f0132a00640 1 -- 172.21.15.5:0/3291338537 shutdown_connections 2024-08-18T22:24:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.554+0000 7f0132a00640 1 -- 172.21.15.5:0/3291338537 wait complete. 2024-08-18T22:24:40.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0132a00640 1 Processor -- start 2024-08-18T22:24:40.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0132a00640 1 -- start start 2024-08-18T22:24:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0132a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c06f290 0x7f012c14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0132a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f012c0cd3a0 0x7f012c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0132a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c15b010 0x7f012c15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0132a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f012c0734f0 con 0x7f012c15b010 2024-08-18T22:24:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0132a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f012c073370 con 0x7f012c0cd3a0 2024-08-18T22:24:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0132a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f012c073670 con 0x7f012c06f290 2024-08-18T22:24:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0130a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c15b010 0x7f012c15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0130a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c15b010 0x7f012c15d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59410/0 (socket says 172.21.15.5:59410) 2024-08-18T22:24:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0130a00640 1 -- 172.21.15.5:0/936299272 learned_addr learned my addr 172.21.15.5:0/936299272 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f012be00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c06f290 0x7f012c14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f012b400640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f012c0cd3a0 0x7f012c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0130a00640 1 -- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c06f290 msgr2=0x7f012c14fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0130a00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c06f290 0x7f012c14fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0130a00640 1 -- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f012c0cd3a0 msgr2=0x7f012c0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0130a00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f012c0cd3a0 0x7f012c0b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0130a00640 1 -- 172.21.15.5:0/936299272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c150040 con 0x7f012c15b010 2024-08-18T22:24:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0130a00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c15b010 0x7f012c15d080 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f01240b0040 tx=0x7f0124019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0123e00640 1 -- 172.21.15.5:0/936299272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01240b2040 con 0x7f012c15b010 2024-08-18T22:24:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0123e00640 1 -- 172.21.15.5:0/936299272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01240ad700 con 0x7f012c15b010 2024-08-18T22:24:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0123e00640 1 -- 172.21.15.5:0/936299272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01240adad0 con 0x7f012c15b010 2024-08-18T22:24:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0132a00640 1 -- 172.21.15.5:0/936299272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012c15dbf0 con 0x7f012c15b010 2024-08-18T22:24:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.558+0000 7f0132a00640 1 -- 172.21.15.5:0/936299272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012c0b4120 con 0x7f012c15b010 2024-08-18T22:24:40.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.562+0000 7f0132a00640 1 -- 172.21.15.5:0/936299272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f012c0ce840 con 0x7f012c15b010 2024-08-18T22:24:40.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.562+0000 7f0123e00640 1 -- 172.21.15.5:0/936299272 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f01240c1020 con 0x7f012c15b010 2024-08-18T22:24:40.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.562+0000 7f0123e00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f010c0678c0 0x7f010c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.562+0000 7f0123e00640 1 -- 172.21.15.5:0/936299272 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6101+0+0 (secure 0 0 0) 0x7f01241209c0 con 0x7f012c15b010 2024-08-18T22:24:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.562+0000 7f012be00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f010c0678c0 0x7f010c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.562+0000 7f012be00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f010c0678c0 0x7f010c069d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f011c000f70 tx=0x7f011c007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.566+0000 7f0123e00640 1 -- 172.21.15.5:0/936299272 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f01240c8020 con 0x7f012c15b010 2024-08-18T22:24:40.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.734+0000 7f0132a00640 1 -- 172.21.15.5:0/936299272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f012c152e80 con 0x7f012c15b010 2024-08-18T22:24:40.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.734+0000 7f0123e00640 1 -- 172.21.15.5:0/936299272 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+16826 (secure 0 0 0) 0x7f012c150040 con 0x7f012c15b010 2024-08-18T22:24:40.734 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:40.735 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":96,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:24:39.405155+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:24:37.136051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-08-18T22:24:38.401283+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:24:40.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 -- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f010c0678c0 msgr2=0x7f010c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f010c0678c0 0x7f010c069d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f011c000f70 tx=0x7f011c007df0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 -- 172.21.15.5:0/936299272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c15b010 msgr2=0x7f012c15d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c15b010 0x7f012c15d080 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f01240b0040 tx=0x7f0124019700 comp rx=0 tx=0).stop 2024-08-18T22:24:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 -- 172.21.15.5:0/936299272 shutdown_connections 2024-08-18T22:24:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f010c0678c0 0x7f010c069d80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f012c15b010 0x7f012c15d080 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f012c0cd3a0 0x7f012c0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 --2- 172.21.15.5:0/936299272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012c06f290 0x7f012c14fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 -- 172.21.15.5:0/936299272 >> 172.21.15.5:0/936299272 conn(0x7f012c0b1c50 msgr2=0x7f012c0b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 -- 172.21.15.5:0/936299272 shutdown_connections 2024-08-18T22:24:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.738+0000 7f0132a00640 1 -- 172.21.15.5:0/936299272 wait complete. 2024-08-18T22:24:40.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:24:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c8200640 1 Processor -- start 2024-08-18T22:24:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c8200640 1 -- start start 2024-08-18T22:24:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c8200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97c015e4b0 0x7f97c00ada40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c8200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97c00ce620 0x7f97c00b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c8200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c00b32f0 con 0x7f97c00adf80 2024-08-18T22:24:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c8200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f97c00ae500 con 0x7f97c015e4b0 2024-08-18T22:24:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c8200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f97c00ae7e0 con 0x7f97c00ce620 2024-08-18T22:24:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c5800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97c015e4b0 0x7f97c00ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c4e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f97c00adf80 0x7f97c00cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33108/0 (socket says 172.21.15.5:33108) 2024-08-18T22:24:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c4e00640 1 -- 172.21.15.5:0/254436674 learned_addr learned my addr 172.21.15.5:0/254436674 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c6200640 1 --2- 172.21.15.5:0/254436674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97c00ce620 0x7f97c00b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c5800640 1 -- 172.21.15.5:0/254436674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97c00ce620 msgr2=0x7f97c00b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c5800640 1 --2- 172.21.15.5:0/254436674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97c00ce620 0x7f97c00b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c5800640 1 -- 172.21.15.5:0/254436674 >> v1:172.21.15.5:6789/0 conn(0x7f97c00adf80 legacy=0x7f97c00cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97c5800640 1 -- 172.21.15.5:0/254436674 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c00aeac0 con 0x7f97c015e4b0 2024-08-18T22:24:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.902+0000 7f97bfe00640 1 -- 172.21.15.5:0/254436674 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306603478 0 0) 0x7f97c00b32f0 con 0x7f97c00adf80 2024-08-18T22:24:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97c5800640 1 --2- 172.21.15.5:0/254436674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c015e4b0 0x7f97c00ada40 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f97b40097c0 tx=0x7f97b401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2c64f8b28108ea server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97bfe00640 1 -- 172.21.15.5:0/254436674 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b40b0070 con 0x7f97c015e4b0 2024-08-18T22:24:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97bfe00640 1 -- 172.21.15.5:0/254436674 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b40ab600 con 0x7f97c015e4b0 2024-08-18T22:24:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97bfe00640 1 -- 172.21.15.5:0/254436674 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b40ab9d0 con 0x7f97c015e4b0 2024-08-18T22:24:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97c8200640 1 -- 172.21.15.5:0/254436674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c015e4b0 msgr2=0x7f97c00ada40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97c8200640 1 --2- 172.21.15.5:0/254436674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c015e4b0 0x7f97c00ada40 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f97b40097c0 tx=0x7f97b401c410 comp rx=0 tx=0).stop 2024-08-18T22:24:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97c8200640 1 -- 172.21.15.5:0/254436674 shutdown_connections 2024-08-18T22:24:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97c8200640 1 --2- 172.21.15.5:0/254436674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97c00ce620 0x7f97c00b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97c8200640 1 --2- 172.21.15.5:0/254436674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c015e4b0 0x7f97c00ada40 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97c8200640 1 -- 172.21.15.5:0/254436674 >> 172.21.15.5:0/254436674 conn(0x7f97c00b5800 msgr2=0x7f97c0072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97c8200640 1 -- 172.21.15.5:0/254436674 shutdown_connections 2024-08-18T22:24:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97c8200640 1 -- 172.21.15.5:0/254436674 wait complete. 2024-08-18T22:24:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97c8200640 1 Processor -- start 2024-08-18T22:24:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.906+0000 7f97c8200640 1 -- start start 2024-08-18T22:24:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c8200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97c00adf80 0x7f97c01509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c8200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97c00ce620 0x7f97c01547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c8200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c015e4b0 0x7f97c015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c8200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f97c00b4670 con 0x7f97c015e4b0 2024-08-18T22:24:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c8200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f97c00b44f0 con 0x7f97c00adf80 2024-08-18T22:24:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c8200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f97c00b47f0 con 0x7f97c00ce620 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c015e4b0 0x7f97c015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c015e4b0 0x7f97c015eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59424/0 (socket says 172.21.15.5:59424) 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c6200640 1 -- 172.21.15.5:0/553999303 learned_addr learned my addr 172.21.15.5:0/553999303 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c5800640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97c00adf80 0x7f97c01509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c4e00640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97c00ce620 0x7f97c01547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c6200640 1 -- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97c00ce620 msgr2=0x7f97c01547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c6200640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97c00ce620 0x7f97c01547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c6200640 1 -- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97c00adf80 msgr2=0x7f97c01509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c6200640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97c00adf80 0x7f97c01509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c6200640 1 -- 172.21.15.5:0/553999303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c00b02d0 con 0x7f97c015e4b0 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c4e00640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97c00ce620 0x7f97c01547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c6200640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c015e4b0 0x7f97c015eaa0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f97b8007e60 tx=0x7f97b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97bd600640 1 -- 172.21.15.5:0/553999303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8014620 con 0x7f97c015e4b0 2024-08-18T22:24:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97bd600640 1 -- 172.21.15.5:0/553999303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b8019070 con 0x7f97c015e4b0 2024-08-18T22:24:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c8200640 1 -- 172.21.15.5:0/553999303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c0152ea0 con 0x7f97c015e4b0 2024-08-18T22:24:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97bd600640 1 -- 172.21.15.5:0/553999303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8014a00 con 0x7f97c015e4b0 2024-08-18T22:24:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c8200640 1 -- 172.21.15.5:0/553999303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c00b0590 con 0x7f97c015e4b0 2024-08-18T22:24:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97c8200640 1 -- 172.21.15.5:0/553999303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c00b37a0 con 0x7f97c015e4b0 2024-08-18T22:24:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.910+0000 7f97bd600640 1 -- 172.21.15.5:0/553999303 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97b8014ba0 con 0x7f97c015e4b0 2024-08-18T22:24:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.914+0000 7f97bd600640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97a00678c0 0x7f97a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.914+0000 7f97bd600640 1 -- 172.21.15.5:0/553999303 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6101+0+0 (secure 0 0 0) 0x7f97b8086760 con 0x7f97c015e4b0 2024-08-18T22:24:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.914+0000 7f97c5800640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97a00678c0 0x7f97a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.914+0000 7f97c5800640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97a00678c0 0x7f97a0069d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f97b40ad000 tx=0x7f97b40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:40.918+0000 7f97bd600640 1 -- 172.21.15.5:0/553999303 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f97b8057070 con 0x7f97c015e4b0 2024-08-18T22:24:41.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:41.121+0000 7f97c8200640 1 -- 172.21.15.5:0/553999303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f97c0072420 con 0x7f97c015e4b0 2024-08-18T22:24:41.981 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-08-18T22:24:41.981+0000 7fe3e8000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:24:42.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.017+0000 7f97bd600640 1 -- 172.21.15.5:0/553999303 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) ==== 118+0+0 (secure 0 0 0) 0x7f97b8056970 con 0x7f97c015e4b0 2024-08-18T22:24:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 -- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97a00678c0 msgr2=0x7f97a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97a00678c0 0x7f97a0069d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f97b40ad000 tx=0x7f97b40a6000 comp rx=0 tx=0).stop 2024-08-18T22:24:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 -- 172.21.15.5:0/553999303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c015e4b0 msgr2=0x7f97c015eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c015e4b0 0x7f97c015eaa0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f97b8007e60 tx=0x7f97b800e4b0 comp rx=0 tx=0).stop 2024-08-18T22:24:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 -- 172.21.15.5:0/553999303 shutdown_connections 2024-08-18T22:24:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97a00678c0 0x7f97a0069d80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97c015e4b0 0x7f97c015eaa0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97c00ce620 0x7f97c01547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 --2- 172.21.15.5:0/553999303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97c00adf80 0x7f97c01509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 -- 172.21.15.5:0/553999303 >> 172.21.15.5:0/553999303 conn(0x7f97c00b5800 msgr2=0x7f97c00cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 -- 172.21.15.5:0/553999303 shutdown_connections 2024-08-18T22:24:42.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.021+0000 7f97c8200640 1 -- 172.21.15.5:0/553999303 wait complete. 2024-08-18T22:24:42.043 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:24:42.044 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:24:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d8600640 1 Processor -- start 2024-08-18T22:24:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d8600640 1 -- start start 2024-08-18T22:24:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d8600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb3d015c180 0x7fb3d00cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d8600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3d015c560 0x7fb3d00ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d8600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3d00cfb00 con 0x7fb3d015d4d0 2024-08-18T22:24:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d8600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d015d040 con 0x7fb3d015c180 2024-08-18T22:24:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d8600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d015c9f0 con 0x7fb3d015c560 2024-08-18T22:24:42.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d6600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3d015d4d0 0x7fb3d015fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33114/0 (socket says 172.21.15.5:33114) 2024-08-18T22:24:42.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d6600640 1 -- 172.21.15.5:0/3269744064 learned_addr learned my addr 172.21.15.5:0/3269744064 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:42.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d5c00640 1 --2- 172.21.15.5:0/3269744064 >> v2:172.21.15.117:3300/0 conn(0x7fb3d015c180 0x7fb3d00cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d5200640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3d015c560 0x7fb3d00ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579659747 0 0) 0x7fb3d00cfb00 con 0x7fb3d015d4d0 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3b8003530 con 0x7fb3d015d4d0 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1659363808 0 0) 0x7fb3b8003530 con 0x7fb3d015d4d0 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3d015c560 msgr2=0x7fb3d00ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3d015c560 0x7fb3d00ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 >> v2:172.21.15.117:3300/0 conn(0x7fb3d015c180 msgr2=0x7fb3d00cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 --2- 172.21.15.5:0/3269744064 >> v2:172.21.15.117:3300/0 conn(0x7fb3d015c180 0x7fb3d00cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d015ccd0 con 0x7fb3d015d4d0 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fb3c8001a00 con 0x7fb3d015d4d0 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 >> v1:172.21.15.5:6789/0 conn(0x7fb3d015d4d0 legacy=0x7fb3d015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80039c0 0x7fb3b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:42.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b8004810 0x7fb3b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80051d0 0x7fb3b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d015d040 con 0x7fb3b80039c0 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d015c9f0 con 0x7fb3b8004810 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b800bf10 con 0x7fb3b80051d0 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d5c00640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80039c0 0x7fb3b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d5200640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b8004810 0x7fb3b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.193+0000 7fb3d6600640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80051d0 0x7fb3b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3d5c00640 1 -- 172.21.15.5:0/3269744064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80051d0 msgr2=0x7fb3b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3d5c00640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80051d0 0x7fb3b800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3d5c00640 1 -- 172.21.15.5:0/3269744064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b8004810 msgr2=0x7fb3b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3d5c00640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b8004810 0x7fb3b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:42.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3d5c00640 1 -- 172.21.15.5:0/3269744064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b8003530 con 0x7fb3b80039c0 2024-08-18T22:24:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3d5c00640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80039c0 0x7fb3b8003de0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009ae0 tx=0x7fb3c401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53f16222c93db2c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40b2070 con 0x7fb3b80039c0 2024-08-18T22:24:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c40a56a0 con 0x7fb3b80039c0 2024-08-18T22:24:42.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3cfe00640 1 -- 172.21.15.5:0/3269744064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40096b0 con 0x7fb3b80039c0 2024-08-18T22:24:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3d8600640 1 -- 172.21.15.5:0/3269744064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80039c0 msgr2=0x7fb3b8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3d8600640 1 --2- 172.21.15.5:0/3269744064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80039c0 0x7fb3b8003de0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009ae0 tx=0x7fb3c401ca50 comp rx=0 tx=0).stop 2024-08-18T22:24:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3d6600640 1 -- 172.21.15.5:0/3269744064 reap_dead start 2024-08-18T22:24:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3d8600640 1 -- 172.21.15.5:0/3269744064 shutdown_connections 2024-08-18T22:24:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.197+0000 7fb3d8600640 1 -- 172.21.15.5:0/3269744064 >> 172.21.15.5:0/3269744064 conn(0x7fb3d00b1dc0 msgr2=0x7fb3d00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d8600640 1 -- 172.21.15.5:0/3269744064 shutdown_connections 2024-08-18T22:24:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d8600640 1 -- 172.21.15.5:0/3269744064 wait complete. 2024-08-18T22:24:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d8600640 1 Processor -- start 2024-08-18T22:24:42.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d8600640 1 -- start start 2024-08-18T22:24:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d8600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80039c0 0x7fb3d009dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d8600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3d015ea10 0x7fb3d01522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d8600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d00c9440 0x7fb3d00c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d8600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d00ce7e0 con 0x7fb3d00c9440 2024-08-18T22:24:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d8600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d00ce660 con 0x7fb3d015ea10 2024-08-18T22:24:42.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d8600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d00ce960 con 0x7fb3b80039c0 2024-08-18T22:24:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d6600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d00c9440 0x7fb3d00c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d5c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80039c0 0x7fb3d009dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d6600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d00c9440 0x7fb3d00c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59434/0 (socket says 172.21.15.5:59434) 2024-08-18T22:24:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d5200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3d015ea10 0x7fb3d01522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:42.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d6600640 1 -- 172.21.15.5:0/993869834 learned_addr learned my addr 172.21.15.5:0/993869834 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d6600640 1 -- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80039c0 msgr2=0x7fb3d009dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d6600640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80039c0 0x7fb3d009dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d6600640 1 -- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3d015ea10 msgr2=0x7fb3d01522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d6600640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3d015ea10 0x7fb3d01522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d6600640 1 -- 172.21.15.5:0/993869834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d00cc210 con 0x7fb3d00c9440 2024-08-18T22:24:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.201+0000 7fb3d6600640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d00c9440 0x7fb3d00c98c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0071390 tx=0x7fb3c8007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.205+0000 7fb3cd600640 1 -- 172.21.15.5:0/993869834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8017020 con 0x7fb3d00c9440 2024-08-18T22:24:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.205+0000 7fb3cd600640 1 -- 172.21.15.5:0/993869834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c800aa90 con 0x7fb3d00c9440 2024-08-18T22:24:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.205+0000 7fb3cd600640 1 -- 172.21.15.5:0/993869834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c800ae60 con 0x7fb3d00c9440 2024-08-18T22:24:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.205+0000 7fb3d8600640 1 -- 172.21.15.5:0/993869834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d00cc4f0 con 0x7fb3d00c9440 2024-08-18T22:24:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.205+0000 7fb3d8600640 1 -- 172.21.15.5:0/993869834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d00af830 con 0x7fb3d00c9440 2024-08-18T22:24:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.205+0000 7fb3d8600640 1 -- 172.21.15.5:0/993869834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d015c560 con 0x7fb3d00c9440 2024-08-18T22:24:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.205+0000 7fb3cd600640 1 -- 172.21.15.5:0/993869834 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3c801a020 con 0x7fb3d00c9440 2024-08-18T22:24:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.205+0000 7fb3cd600640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3b00678f0 0x7fb3b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.205+0000 7fb3cd600640 1 -- 172.21.15.5:0/993869834 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fb3c8086400 con 0x7fb3d00c9440 2024-08-18T22:24:42.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.205+0000 7fb3d5c00640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3b00678f0 0x7fb3b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:42.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.205+0000 7fb3d5c00640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3b00678f0 0x7fb3b0069db0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40af000 tx=0x7fb3c40046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:42.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.209+0000 7fb3cd600640 1 -- 172.21.15.5:0/993869834 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb3c8021020 con 0x7fb3d00c9440 2024-08-18T22:24:42.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:42.409+0000 7fb3d8600640 1 -- 172.21.15.5:0/993869834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb3d015a3b0 con 0x7fb3d00c9440 2024-08-18T22:24:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3cd600640 1 -- 172.21.15.5:0/993869834 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) ==== 122+0+0 (secure 0 0 0) 0x7fb3c8056da0 con 0x7fb3d00c9440 2024-08-18T22:24:43.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 -- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3b00678f0 msgr2=0x7fb3b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3b00678f0 0x7fb3b0069db0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40af000 tx=0x7fb3c40046d0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 -- 172.21.15.5:0/993869834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d00c9440 msgr2=0x7fb3d00c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d00c9440 0x7fb3d00c98c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0071390 tx=0x7fb3c8007b10 comp rx=0 tx=0).stop 2024-08-18T22:24:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 -- 172.21.15.5:0/993869834 shutdown_connections 2024-08-18T22:24:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3b00678f0 0x7fb3b0069db0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3d00c9440 0x7fb3d00c98c0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3d015ea10 0x7fb3d01522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 --2- 172.21.15.5:0/993869834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80039c0 0x7fb3d009dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 -- 172.21.15.5:0/993869834 >> 172.21.15.5:0/993869834 conn(0x7fb3d00b1dc0 msgr2=0x7fb3d015fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:43.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 -- 172.21.15.5:0/993869834 shutdown_connections 2024-08-18T22:24:43.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.021+0000 7fb3d8600640 1 -- 172.21.15.5:0/993869834 wait complete. 2024-08-18T22:24:43.049 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:24:43.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:43.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.193+0000 7fe881e00640 1 Processor -- start 2024-08-18T22:24:43.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.193+0000 7fe881e00640 1 -- start start 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe881e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe87c15b010 0x7fe87c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe881e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe87c0cd3a0 0x7fe87c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe881e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c0cee20 con 0x7fe87c06f0c0 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe881e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe87c0cfa30 con 0x7fe87c15b010 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe881e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe87c0cf100 con 0x7fe87c0cd3a0 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe87aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe87c15b010 0x7fe87c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe87b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe87c06f0c0 0x7fe87c0caf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33122/0 (socket says 172.21.15.5:33122) 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe87aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe87c15b010 0x7fe87c0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59442/0 (socket says 172.21.15.5:59442) 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe87b400640 1 -- 172.21.15.5:0/4108220086 learned_addr learned my addr 172.21.15.5:0/4108220086 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe872000640 1 --2- 172.21.15.5:0/4108220086 >> v2:172.21.15.117:3300/0 conn(0x7fe87c0cd3a0 0x7fe87c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe87aa00640 1 -- 172.21.15.5:0/4108220086 >> v2:172.21.15.117:3300/0 conn(0x7fe87c0cd3a0 msgr2=0x7fe87c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe87aa00640 1 --2- 172.21.15.5:0/4108220086 >> v2:172.21.15.117:3300/0 conn(0x7fe87c0cd3a0 0x7fe87c06eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe87aa00640 1 -- 172.21.15.5:0/4108220086 >> v1:172.21.15.5:6789/0 conn(0x7fe87c06f0c0 legacy=0x7fe87c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.197+0000 7fe87aa00640 1 -- 172.21.15.5:0/4108220086 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c0cf3e0 con 0x7fe87c15b010 2024-08-18T22:24:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe87aa00640 1 --2- 172.21.15.5:0/4108220086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87c15b010 0x7fe87c0ce840 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0ca580 tx=0x7fe86c01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334f12eb4b8ab281 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe87a000640 1 -- 172.21.15.5:0/4108220086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c0b4070 con 0x7fe87c15b010 2024-08-18T22:24:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe87a000640 1 -- 172.21.15.5:0/4108220086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe86c0a7a40 con 0x7fe87c15b010 2024-08-18T22:24:43.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe87a000640 1 -- 172.21.15.5:0/4108220086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c0a7e10 con 0x7fe87c15b010 2024-08-18T22:24:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe881e00640 1 -- 172.21.15.5:0/4108220086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87c15b010 msgr2=0x7fe87c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe881e00640 1 --2- 172.21.15.5:0/4108220086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87c15b010 0x7fe87c0ce840 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0ca580 tx=0x7fe86c01eb50 comp rx=0 tx=0).stop 2024-08-18T22:24:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe881e00640 1 -- 172.21.15.5:0/4108220086 shutdown_connections 2024-08-18T22:24:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe881e00640 1 --2- 172.21.15.5:0/4108220086 >> v2:172.21.15.117:3300/0 conn(0x7fe87c0cd3a0 0x7fe87c06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe881e00640 1 --2- 172.21.15.5:0/4108220086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87c15b010 0x7fe87c0ce840 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe881e00640 1 -- 172.21.15.5:0/4108220086 >> 172.21.15.5:0/4108220086 conn(0x7fe87c0b1c50 msgr2=0x7fe87c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe881e00640 1 -- 172.21.15.5:0/4108220086 shutdown_connections 2024-08-18T22:24:43.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe881e00640 1 -- 172.21.15.5:0/4108220086 wait complete. 2024-08-18T22:24:43.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe881e00640 1 Processor -- start 2024-08-18T22:24:43.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.201+0000 7fe881e00640 1 -- start start 2024-08-18T22:24:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe881e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe87c06f0c0 0x7fe87c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe881e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe87c0cd3a0 0x7fe87c156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe881e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87c15b010 0x7fe87c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe881e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c06dbf0 con 0x7fe87c15b010 2024-08-18T22:24:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe881e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c06da70 con 0x7fe87c0cd3a0 2024-08-18T22:24:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe881e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c06dd70 con 0x7fe87c06f0c0 2024-08-18T22:24:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe87b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87c15b010 0x7fe87c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe87b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87c15b010 0x7fe87c14b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59446/0 (socket says 172.21.15.5:59446) 2024-08-18T22:24:43.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe87b400640 1 -- 172.21.15.5:0/3046159538 learned_addr learned my addr 172.21.15.5:0/3046159538 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe872000640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe87c0cd3a0 0x7fe87c156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe87aa00640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe87c06f0c0 0x7fe87c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe87b400640 1 -- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe87c06f0c0 msgr2=0x7fe87c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe87b400640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe87c06f0c0 0x7fe87c15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe87b400640 1 -- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe87c0cd3a0 msgr2=0x7fe87c156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe87b400640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe87c0cd3a0 0x7fe87c156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe87b400640 1 -- 172.21.15.5:0/3046159538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c15c110 con 0x7fe87c15b010 2024-08-18T22:24:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe87b400640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87c15b010 0x7fe87c14b6b0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fe87400cbc0 tx=0x7fe87400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe873e00640 1 -- 172.21.15.5:0/3046159538 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874017070 con 0x7fe87c15b010 2024-08-18T22:24:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe873e00640 1 -- 172.21.15.5:0/3046159538 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87400ad40 con 0x7fe87c15b010 2024-08-18T22:24:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe873e00640 1 -- 172.21.15.5:0/3046159538 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874012600 con 0x7fe87c15b010 2024-08-18T22:24:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe881e00640 1 -- 172.21.15.5:0/3046159538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87c15c3f0 con 0x7fe87c15b010 2024-08-18T22:24:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe881e00640 1 -- 172.21.15.5:0/3046159538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87c15c9b0 con 0x7fe87c15b010 2024-08-18T22:24:43.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe881e00640 1 -- 172.21.15.5:0/3046159538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87c0ce840 con 0x7fe87c15b010 2024-08-18T22:24:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.205+0000 7fe873e00640 1 -- 172.21.15.5:0/3046159538 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe87401a070 con 0x7fe87c15b010 2024-08-18T22:24:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.209+0000 7fe873e00640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8580678c0 0x7fe858069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.209+0000 7fe873e00640 1 -- 172.21.15.5:0/3046159538 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fe874085b20 con 0x7fe87c15b010 2024-08-18T22:24:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.209+0000 7fe87aa00640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8580678c0 0x7fe858069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.209+0000 7fe87aa00640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8580678c0 0x7fe858069d80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0b1000 tx=0x7fe86c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:43.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.213+0000 7fe873e00640 1 -- 172.21.15.5:0/3046159538 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe874055de0 con 0x7fe87c15b010 2024-08-18T22:24:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.413+0000 7fe881e00640 1 -- 172.21.15.5:0/3046159538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe87c0ad6f0 con 0x7fe87c15b010 2024-08-18T22:24:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.413+0000 7fe873e00640 1 -- 172.21.15.5:0/3046159538 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5219 (secure 0 0 0) 0x7fe87405a0e0 con 0x7fe87c15b010 2024-08-18T22:24:43.414 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:43.414 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"btime":"2024-08-18T22:24:43:020654+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/932174441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":932174441},{"type":"v1","addr":"172.21.15.117:6836","nonce":932174441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/314902070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":314902070},{"type":"v1","addr":"172.21.15.117:6837","nonce":314902070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3843758754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3843758754},{"type":"v1","addr":"172.21.15.5:6833","nonce":3843758754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:24:42.414435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7242":{"gid":7242,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3668199286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3668199286},{"type":"v1","addr":"172.21.15.5:6835","nonce":3668199286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7242,"qdb_cluster":[7242]},"id":6}]} 2024-08-18T22:24:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 72 2024-08-18T22:24:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 -- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8580678c0 msgr2=0x7fe858069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8580678c0 0x7fe858069d80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0b1000 tx=0x7fe86c008040 comp rx=0 tx=0).stop 2024-08-18T22:24:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 -- 172.21.15.5:0/3046159538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87c15b010 msgr2=0x7fe87c14b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87c15b010 0x7fe87c14b6b0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fe87400cbc0 tx=0x7fe87400a430 comp rx=0 tx=0).stop 2024-08-18T22:24:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 -- 172.21.15.5:0/3046159538 shutdown_connections 2024-08-18T22:24:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8580678c0 0x7fe858069d80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe87c15b010 0x7fe87c14b6b0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe87c0cd3a0 0x7fe87c156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 --2- 172.21.15.5:0/3046159538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe87c06f0c0 0x7fe87c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 -- 172.21.15.5:0/3046159538 >> 172.21.15.5:0/3046159538 conn(0x7fe87c0b1c50 msgr2=0x7fe87c155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 -- 172.21.15.5:0/3046159538 shutdown_connections 2024-08-18T22:24:43.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.417+0000 7fe881e00640 1 -- 172.21.15.5:0/3046159538 wait complete. 2024-08-18T22:24:43.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:24:43.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d2200640 1 Processor -- start 2024-08-18T22:24:43.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d2200640 1 -- start start 2024-08-18T22:24:43.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d2200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09cc147c40 0x7f09cc06cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d2200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09cc0b59d0 0x7f09cc0d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d2200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09cc0d27e0 0x7f09cc0b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d2200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f09cc0d2c10 con 0x7f09cc147c40 2024-08-18T22:24:43.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d2200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f09cc072290 con 0x7f09cc0b59d0 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d2200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f09cc0b5e40 con 0x7f09cc0d27e0 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d0e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09cc147c40 0x7f09cc06cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d0e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09cc147c40 0x7f09cc06cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53504/0 (socket says 172.21.15.5:53504) 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d0e00640 1 -- 172.21.15.5:0/1454105835 learned_addr learned my addr 172.21.15.5:0/1454105835 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d1800640 1 --2- 172.21.15.5:0/1454105835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09cc0d27e0 0x7f09cc0b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09c3e00640 1 --2- 172.21.15.5:0/1454105835 >> v2:172.21.15.117:3300/0 conn(0x7f09cc0b59d0 0x7f09cc0d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d0e00640 1 -- 172.21.15.5:0/1454105835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09cc0d27e0 msgr2=0x7f09cc0b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d0e00640 1 --2- 172.21.15.5:0/1454105835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09cc0d27e0 0x7f09cc0b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d0e00640 1 -- 172.21.15.5:0/1454105835 >> v2:172.21.15.117:3300/0 conn(0x7f09cc0b59d0 msgr2=0x7f09cc0d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d0e00640 1 --2- 172.21.15.5:0/1454105835 >> v2:172.21.15.117:3300/0 conn(0x7f09cc0b59d0 0x7f09cc0d22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09d0e00640 1 -- 172.21.15.5:0/1454105835 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09cc06d660 con 0x7f09cc147c40 2024-08-18T22:24:43.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.577+0000 7f09c3e00640 1 --2- 172.21.15.5:0/1454105835 >> v2:172.21.15.117:3300/0 conn(0x7f09cc0b59d0 0x7f09cc0d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09d0e00640 1 --2- 172.21.15.5:0/1454105835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09cc147c40 0x7f09cc06cfd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f09cc072640 tx=0x7f09bc01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffedf937c1558ad8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09cbe00640 1 -- 172.21.15.5:0/1454105835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0b0070 con 0x7f09cc147c40 2024-08-18T22:24:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09cbe00640 1 -- 172.21.15.5:0/1454105835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09bc0ab600 con 0x7f09cc147c40 2024-08-18T22:24:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09cbe00640 1 -- 172.21.15.5:0/1454105835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0ab9d0 con 0x7f09cc147c40 2024-08-18T22:24:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09d2200640 1 -- 172.21.15.5:0/1454105835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09cc147c40 msgr2=0x7f09cc06cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09d2200640 1 --2- 172.21.15.5:0/1454105835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09cc147c40 0x7f09cc06cfd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f09cc072640 tx=0x7f09bc01c260 comp rx=0 tx=0).stop 2024-08-18T22:24:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09d2200640 1 -- 172.21.15.5:0/1454105835 shutdown_connections 2024-08-18T22:24:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09d2200640 1 --2- 172.21.15.5:0/1454105835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09cc0d27e0 0x7f09cc0b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09d2200640 1 --2- 172.21.15.5:0/1454105835 >> v2:172.21.15.117:3300/0 conn(0x7f09cc0b59d0 0x7f09cc0d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09d2200640 1 --2- 172.21.15.5:0/1454105835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09cc147c40 0x7f09cc06cfd0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09d2200640 1 -- 172.21.15.5:0/1454105835 >> 172.21.15.5:0/1454105835 conn(0x7f09cc067840 msgr2=0x7f09cc067c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09d2200640 1 -- 172.21.15.5:0/1454105835 shutdown_connections 2024-08-18T22:24:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.581+0000 7f09d2200640 1 -- 172.21.15.5:0/1454105835 wait complete. 2024-08-18T22:24:43.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d2200640 1 Processor -- start 2024-08-18T22:24:43.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d2200640 1 -- start start 2024-08-18T22:24:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d2200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09cc0b59d0 0x7f09cc15dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d2200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09cc0d27e0 0x7f09cc146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d2200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09cc147c40 0x7f09cc15c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d2200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc15ec90 con 0x7f09cc0d27e0 2024-08-18T22:24:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d2200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc15eb10 con 0x7f09cc0b59d0 2024-08-18T22:24:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d2200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f09cc15ee10 con 0x7f09cc147c40 2024-08-18T22:24:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09cc0d27e0 0x7f09cc146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09cc0d27e0 0x7f09cc146100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53516/0 (socket says 172.21.15.5:53516) 2024-08-18T22:24:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c3e00640 1 -- 172.21.15.5:0/392616304 learned_addr learned my addr 172.21.15.5:0/392616304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d0e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09cc0b59d0 0x7f09cc15dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d1800640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09cc147c40 0x7f09cc15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c3e00640 1 -- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09cc147c40 msgr2=0x7f09cc15c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c3e00640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09cc147c40 0x7f09cc15c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c3e00640 1 -- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09cc0b59d0 msgr2=0x7f09cc15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c3e00640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09cc0b59d0 0x7f09cc15dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c3e00640 1 -- 172.21.15.5:0/392616304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09cc146810 con 0x7f09cc0d27e0 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d1800640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09cc147c40 0x7f09cc15c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c3e00640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09cc0d27e0 0x7f09cc146100 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c7c0 tx=0x7f09b400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c9600640 1 -- 172.21.15.5:0/392616304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4007a30 con 0x7f09cc0d27e0 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c9600640 1 -- 172.21.15.5:0/392616304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b4007bd0 con 0x7f09cc0d27e0 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09c9600640 1 -- 172.21.15.5:0/392616304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b40113f0 con 0x7f09cc0d27e0 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d2200640 1 -- 172.21.15.5:0/392616304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09cc146af0 con 0x7f09cc0d27e0 2024-08-18T22:24:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d2200640 1 -- 172.21.15.5:0/392616304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09cc0cdbd0 con 0x7f09cc0d27e0 2024-08-18T22:24:43.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.585+0000 7f09d2200640 1 -- 172.21.15.5:0/392616304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09cc0d22a0 con 0x7f09cc0d27e0 2024-08-18T22:24:43.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.589+0000 7f09c9600640 1 -- 172.21.15.5:0/392616304 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09b4011590 con 0x7f09cc0d27e0 2024-08-18T22:24:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.589+0000 7f09c9600640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09a80678f0 0x7f09a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.589+0000 7f09c9600640 1 -- 172.21.15.5:0/392616304 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f09b4085f80 con 0x7f09cc0d27e0 2024-08-18T22:24:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.589+0000 7f09d0e00640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09a80678f0 0x7f09a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.589+0000 7f09d0e00640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09a80678f0 0x7f09a8069db0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0ad000 tx=0x7f09bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:43.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.593+0000 7f09c9600640 1 -- 172.21.15.5:0/392616304 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f09b4015020 con 0x7f09cc0d27e0 2024-08-18T22:24:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.761+0000 7f09d2200640 1 -- 172.21.15.5:0/392616304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09cc067dc0 con 0x7f09cc0d27e0 2024-08-18T22:24:43.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.761+0000 7f09c9600640 1 -- 172.21.15.5:0/392616304 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16813 (secure 0 0 0) 0x7f09b40562d0 con 0x7f09cc0d27e0 2024-08-18T22:24:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:43.763 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":97,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:24:41.008519+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:24:37.136051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-08-18T22:24:38.401283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:24:43.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 -- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09a80678f0 msgr2=0x7f09a8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09a80678f0 0x7f09a8069db0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0ad000 tx=0x7f09bc008040 comp rx=0 tx=0).stop 2024-08-18T22:24:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 -- 172.21.15.5:0/392616304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09cc0d27e0 msgr2=0x7f09cc146100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09cc0d27e0 0x7f09cc146100 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c7c0 tx=0x7f09b400cc80 comp rx=0 tx=0).stop 2024-08-18T22:24:43.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 -- 172.21.15.5:0/392616304 shutdown_connections 2024-08-18T22:24:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09a80678f0 0x7f09a8069db0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09cc147c40 0x7f09cc15c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09cc0d27e0 0x7f09cc146100 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 --2- 172.21.15.5:0/392616304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09cc0b59d0 0x7f09cc15dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 -- 172.21.15.5:0/392616304 >> 172.21.15.5:0/392616304 conn(0x7f09cc067840 msgr2=0x7f09cc0ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 -- 172.21.15.5:0/392616304 shutdown_connections 2024-08-18T22:24:43.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.765+0000 7f09d2200640 1 -- 172.21.15.5:0/392616304 wait complete. 2024-08-18T22:24:43.785 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:24:43.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:24:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9742600640 1 Processor -- start 2024-08-18T22:24:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9742600640 1 -- start start 2024-08-18T22:24:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9742600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f973c071c90 0x7f973c0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9742600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f973c06fad0 0x7f973c15c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9742600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f973c0b5e30 con 0x7f973c15c180 2024-08-18T22:24:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9742600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f973c15caa0 con 0x7f973c071c90 2024-08-18T22:24:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9742600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f973c0b6110 con 0x7f973c06fad0 2024-08-18T22:24:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f973b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f973c15c180 0x7f973c071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52200/0 (socket says 172.21.15.5:52200) 2024-08-18T22:24:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f973b400640 1 -- 172.21.15.5:0/3862292446 learned_addr learned my addr 172.21.15.5:0/3862292446 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9732a00640 1 --2- 172.21.15.5:0/3862292446 >> v2:172.21.15.5:3300/0 conn(0x7f973c071c90 0x7f973c0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f973be00640 1 --2- 172.21.15.5:0/3862292446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f973c06fad0 0x7f973c15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9732a00640 1 -- 172.21.15.5:0/3862292446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f973c06fad0 msgr2=0x7f973c15c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9732a00640 1 --2- 172.21.15.5:0/3862292446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f973c06fad0 0x7f973c15c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9732a00640 1 -- 172.21.15.5:0/3862292446 >> v1:172.21.15.5:6789/0 conn(0x7f973c15c180 legacy=0x7f973c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.925+0000 7f9732a00640 1 -- 172.21.15.5:0/3862292446 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c0b63f0 con 0x7f973c071c90 2024-08-18T22:24:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f9732a00640 1 --2- 172.21.15.5:0/3862292446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f973c071c90 0x7f973c0b57c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f97240097c0 tx=0x7f972401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5849c713465c2a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f973aa00640 1 -- 172.21.15.5:0/3862292446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97240b1070 con 0x7f973c071c90 2024-08-18T22:24:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f973aa00640 1 -- 172.21.15.5:0/3862292446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97240ac640 con 0x7f973c071c90 2024-08-18T22:24:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f973aa00640 1 -- 172.21.15.5:0/3862292446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97240aca10 con 0x7f973c071c90 2024-08-18T22:24:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f9742600640 1 -- 172.21.15.5:0/3862292446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f973c071c90 msgr2=0x7f973c0b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f9742600640 1 --2- 172.21.15.5:0/3862292446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f973c071c90 0x7f973c0b57c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f97240097c0 tx=0x7f972401c350 comp rx=0 tx=0).stop 2024-08-18T22:24:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f9742600640 1 -- 172.21.15.5:0/3862292446 shutdown_connections 2024-08-18T22:24:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f9742600640 1 --2- 172.21.15.5:0/3862292446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f973c06fad0 0x7f973c15c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f9742600640 1 --2- 172.21.15.5:0/3862292446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f973c071c90 0x7f973c0b57c0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f9742600640 1 -- 172.21.15.5:0/3862292446 >> 172.21.15.5:0/3862292446 conn(0x7f973c0b3eb0 msgr2=0x7f973c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f9742600640 1 -- 172.21.15.5:0/3862292446 shutdown_connections 2024-08-18T22:24:43.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.929+0000 7f9742600640 1 -- 172.21.15.5:0/3862292446 wait complete. 2024-08-18T22:24:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9742600640 1 Processor -- start 2024-08-18T22:24:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9742600640 1 -- start start 2024-08-18T22:24:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9742600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f973c06fad0 0x7f973c158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9742600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f973c071c90 0x7f973c156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9742600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f973c15c180 0x7f973c13cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9742600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f973c0d1c30 con 0x7f973c06fad0 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9742600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f973c0d1ab0 con 0x7f973c15c180 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9742600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f973c0d1db0 con 0x7f973c071c90 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f973b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f973c06fad0 0x7f973c158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f973b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f973c06fad0 0x7f973c158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53524/0 (socket says 172.21.15.5:53524) 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f973b400640 1 -- 172.21.15.5:0/2007914527 learned_addr learned my addr 172.21.15.5:0/2007914527 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f973be00640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f973c15c180 0x7f973c13cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9732a00640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f973c071c90 0x7f973c156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f973b400640 1 -- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f973c071c90 msgr2=0x7f973c156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f973b400640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f973c071c90 0x7f973c156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f973b400640 1 -- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f973c15c180 msgr2=0x7f973c13cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f973b400640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f973c15c180 0x7f973c13cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f973b400640 1 -- 172.21.15.5:0/2007914527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c156a90 con 0x7f973c06fad0 2024-08-18T22:24:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f973be00640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f973c15c180 0x7f973c13cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9732a00640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f973c071c90 0x7f973c156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f973b400640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f973c06fad0 0x7f973c158cc0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f972c00c370 tx=0x7f972c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9733e00640 1 -- 172.21.15.5:0/2007914527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c017070 con 0x7f973c06fad0 2024-08-18T22:24:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9733e00640 1 -- 172.21.15.5:0/2007914527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f972c005cf0 con 0x7f973c06fad0 2024-08-18T22:24:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9733e00640 1 -- 172.21.15.5:0/2007914527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0072f0 con 0x7f973c06fad0 2024-08-18T22:24:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9742600640 1 -- 172.21.15.5:0/2007914527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973c156d70 con 0x7f973c06fad0 2024-08-18T22:24:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.933+0000 7f9742600640 1 -- 172.21.15.5:0/2007914527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973c157330 con 0x7f973c06fad0 2024-08-18T22:24:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.937+0000 7f9742600640 1 -- 172.21.15.5:0/2007914527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f973c15c560 con 0x7f973c06fad0 2024-08-18T22:24:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.937+0000 7f9733e00640 1 -- 172.21.15.5:0/2007914527 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f972c01a070 con 0x7f973c06fad0 2024-08-18T22:24:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.937+0000 7f9733e00640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97180678c0 0x7f9718069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.937+0000 7f9733e00640 1 -- 172.21.15.5:0/2007914527 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f972c085320 con 0x7f973c06fad0 2024-08-18T22:24:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.937+0000 7f9732a00640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97180678c0 0x7f9718069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.937+0000 7f9732a00640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97180678c0 0x7f9718069d80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f97240ae000 tx=0x7f9724008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:43.941+0000 7f9733e00640 1 -- 172.21.15.5:0/2007914527 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f972c055ba0 con 0x7f973c06fad0 2024-08-18T22:24:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.105+0000 7f9742600640 1 -- 172.21.15.5:0/2007914527 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f973c0cf7d0 con 0x7f97180678c0 2024-08-18T22:24:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.113+0000 7f9733e00640 1 -- 172.21.15.5:0/2007914527 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243362 (secure 0 0 0) 0x7f973c0cf7d0 con 0x7f97180678c0 2024-08-18T22:24:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:24:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 -- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97180678c0 msgr2=0x7f9718069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97180678c0 0x7f9718069d80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f97240ae000 tx=0x7f9724008040 comp rx=0 tx=0).stop 2024-08-18T22:24:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 -- 172.21.15.5:0/2007914527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f973c06fad0 msgr2=0x7f973c158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f973c06fad0 0x7f973c158cc0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f972c00c370 tx=0x7f972c00c830 comp rx=0 tx=0).stop 2024-08-18T22:24:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 -- 172.21.15.5:0/2007914527 shutdown_connections 2024-08-18T22:24:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f97180678c0 0x7f9718069d80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f973c15c180 0x7f973c13cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f973c071c90 0x7f973c156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 --2- 172.21.15.5:0/2007914527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f973c06fad0 0x7f973c158cc0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 -- 172.21.15.5:0/2007914527 >> 172.21.15.5:0/2007914527 conn(0x7f973c0b3eb0 msgr2=0x7f973c0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 -- 172.21.15.5:0/2007914527 shutdown_connections 2024-08-18T22:24:44.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.117+0000 7f9742600640 1 -- 172.21.15.5:0/2007914527 wait complete. 2024-08-18T22:24:44.136 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-08-18T22:24:43.699418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309600,"kb_used_data":10196,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754665120,"statfs":{"total":773094113280,"available":772777082880,"internally_reserved":0,"allocated":10440704,"data_stored":5453651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.711146"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022551+0000","last_change":"2024-08-18T22:24:40.016890+0000","last_active":"2024-08-18T22:24:40.022551+0000","last_peered":"2024-08-18T22:24:40.022551+0000","last_clean":"2024-08-18T22:24:40.022551+0000","last_became_active":"2024-08-18T22:24:40.016624+0000","last_became_peered":"2024-08-18T22:24:40.016624+0000","last_unstale":"2024-08-18T22:24:40.022551+0000","last_undegraded":"2024-08-18T22:24:40.022551+0000","last_fullsized":"2024-08-18T22:24:40.022551+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:41:24.595641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022923+0000","last_change":"2024-08-18T22:24:40.020616+0000","last_active":"2024-08-18T22:24:40.022923+0000","last_peered":"2024-08-18T22:24:40.022923+0000","last_clean":"2024-08-18T22:24:40.022923+0000","last_became_active":"2024-08-18T22:24:40.020258+0000","last_became_peered":"2024-08-18T22:24:40.020258+0000","last_unstale":"2024-08-18T22:24:40.022923+0000","last_undegraded":"2024-08-18T22:24:40.022923+0000","last_fullsized":"2024-08-18T22:24:40.022923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:11.395179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.033562+0000","last_change":"2024-08-18T22:24:40.028865+0000","last_active":"2024-08-18T22:24:40.033562+0000","last_peered":"2024-08-18T22:24:40.033562+0000","last_clean":"2024-08-18T22:24:40.033562+0000","last_became_active":"2024-08-18T22:24:40.028545+0000","last_became_peered":"2024-08-18T22:24:40.028545+0000","last_unstale":"2024-08-18T22:24:40.033562+0000","last_undegraded":"2024-08-18T22:24:40.033562+0000","last_fullsized":"2024-08-18T22:24:40.033562+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:57.967896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.018444+0000","last_change":"2024-08-18T22:24:40.014360+0000","last_active":"2024-08-18T22:24:40.018444+0000","last_peered":"2024-08-18T22:24:40.018444+0000","last_clean":"2024-08-18T22:24:40.018444+0000","last_became_active":"2024-08-18T22:24:40.014017+0000","last_became_peered":"2024-08-18T22:24:40.014017+0000","last_unstale":"2024-08-18T22:24:40.018444+0000","last_undegraded":"2024-08-18T22:24:40.018444+0000","last_fullsized":"2024-08-18T22:24:40.018444+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:19:07.605988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.031405+0000","last_change":"2024-08-18T22:24:40.020506+0000","last_active":"2024-08-18T22:24:40.031405+0000","last_peered":"2024-08-18T22:24:40.031405+0000","last_clean":"2024-08-18T22:24:40.031405+0000","last_became_active":"2024-08-18T22:24:40.020225+0000","last_became_peered":"2024-08-18T22:24:40.020225+0000","last_unstale":"2024-08-18T22:24:40.031405+0000","last_undegraded":"2024-08-18T22:24:40.031405+0000","last_fullsized":"2024-08-18T22:24:40.031405+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:28:17.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035507+0000","last_change":"2024-08-18T22:24:40.032145+0000","last_active":"2024-08-18T22:24:40.035507+0000","last_peered":"2024-08-18T22:24:40.035507+0000","last_clean":"2024-08-18T22:24:40.035507+0000","last_became_active":"2024-08-18T22:24:40.031866+0000","last_became_peered":"2024-08-18T22:24:40.031866+0000","last_unstale":"2024-08-18T22:24:40.035507+0000","last_undegraded":"2024-08-18T22:24:40.035507+0000","last_fullsized":"2024-08-18T22:24:40.035507+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:06:57.730808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.032492+0000","last_change":"2024-08-18T22:24:40.027430+0000","last_active":"2024-08-18T22:24:40.032492+0000","last_peered":"2024-08-18T22:24:40.032492+0000","last_clean":"2024-08-18T22:24:40.032492+0000","last_became_active":"2024-08-18T22:24:40.027160+0000","last_became_peered":"2024-08-18T22:24:40.027160+0000","last_unstale":"2024-08-18T22:24:40.032492+0000","last_undegraded":"2024-08-18T22:24:40.032492+0000","last_fullsized":"2024-08-18T22:24:40.032492+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:58.084319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022530+0000","last_change":"2024-08-18T22:24:40.016741+0000","last_active":"2024-08-18T22:24:40.022530+0000","last_peered":"2024-08-18T22:24:40.022530+0000","last_clean":"2024-08-18T22:24:40.022530+0000","last_became_active":"2024-08-18T22:24:40.016175+0000","last_became_peered":"2024-08-18T22:24:40.016175+0000","last_unstale":"2024-08-18T22:24:40.022530+0000","last_undegraded":"2024-08-18T22:24:40.022530+0000","last_fullsized":"2024-08-18T22:24:40.022530+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:37.399428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035486+0000","last_change":"2024-08-18T22:24:40.031981+0000","last_active":"2024-08-18T22:24:40.035486+0000","last_peered":"2024-08-18T22:24:40.035486+0000","last_clean":"2024-08-18T22:24:40.035486+0000","last_became_active":"2024-08-18T22:24:40.031692+0000","last_became_peered":"2024-08-18T22:24:40.031692+0000","last_unstale":"2024-08-18T22:24:40.035486+0000","last_undegraded":"2024-08-18T22:24:40.035486+0000","last_fullsized":"2024-08-18T22:24:40.035486+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:41.451094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.031162+0000","last_change":"2024-08-18T22:24:40.028117+0000","last_active":"2024-08-18T22:24:40.031162+0000","last_peered":"2024-08-18T22:24:40.031162+0000","last_clean":"2024-08-18T22:24:40.031162+0000","last_became_active":"2024-08-18T22:24:40.027844+0000","last_became_peered":"2024-08-18T22:24:40.027844+0000","last_unstale":"2024-08-18T22:24:40.031162+0000","last_undegraded":"2024-08-18T22:24:40.031162+0000","last_fullsized":"2024-08-18T22:24:40.031162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:19:28.332247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.021634+0000","last_change":"2024-08-18T22:24:40.013826+0000","last_active":"2024-08-18T22:24:40.021634+0000","last_peered":"2024-08-18T22:24:40.021634+0000","last_clean":"2024-08-18T22:24:40.021634+0000","last_became_active":"2024-08-18T22:24:40.011508+0000","last_became_peered":"2024-08-18T22:24:40.011508+0000","last_unstale":"2024-08-18T22:24:40.021634+0000","last_undegraded":"2024-08-18T22:24:40.021634+0000","last_fullsized":"2024-08-18T22:24:40.021634+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:20:06.666487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022955+0000","last_change":"2024-08-18T22:24:40.021109+0000","last_active":"2024-08-18T22:24:40.022955+0000","last_peered":"2024-08-18T22:24:40.022955+0000","last_clean":"2024-08-18T22:24:40.022955+0000","last_became_active":"2024-08-18T22:24:40.020810+0000","last_became_peered":"2024-08-18T22:24:40.020810+0000","last_unstale":"2024-08-18T22:24:40.022955+0000","last_undegraded":"2024-08-18T22:24:40.022955+0000","last_fullsized":"2024-08-18T22:24:40.022955+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:32:35.090221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990989+0000","last_change":"2024-08-18T22:24:37.990989+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990989+0000","last_undegraded":"2024-08-18T22:24:37.990989+0000","last_fullsized":"2024-08-18T22:24:37.990989+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.033242+0000","last_change":"2024-08-18T22:24:39.012924+0000","last_active":"2024-08-18T22:24:40.033242+0000","last_peered":"2024-08-18T22:24:40.033242+0000","last_clean":"2024-08-18T22:24:40.033242+0000","last_became_active":"2024-08-18T22:24:39.012605+0000","last_became_peered":"2024-08-18T22:24:39.012605+0000","last_unstale":"2024-08-18T22:24:40.033242+0000","last_undegraded":"2024-08-18T22:24:40.033242+0000","last_fullsized":"2024-08-18T22:24:40.033242+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:45.539213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.992059+0000","last_change":"2024-08-18T22:24:37.992059+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.992059+0000","last_undegraded":"2024-08-18T22:24:37.992059+0000","last_fullsized":"2024-08-18T22:24:37.992059+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990927+0000","last_change":"2024-08-18T22:24:37.990927+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990927+0000","last_undegraded":"2024-08-18T22:24:37.990927+0000","last_fullsized":"2024-08-18T22:24:37.990927+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.034212+0000","last_change":"2024-08-18T22:24:39.017797+0000","last_active":"2024-08-18T22:24:40.034212+0000","last_peered":"2024-08-18T22:24:40.034212+0000","last_clean":"2024-08-18T22:24:40.034212+0000","last_became_active":"2024-08-18T22:24:39.017473+0000","last_became_peered":"2024-08-18T22:24:39.017473+0000","last_unstale":"2024-08-18T22:24:40.034212+0000","last_undegraded":"2024-08-18T22:24:40.034212+0000","last_fullsized":"2024-08-18T22:24:40.034212+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:03:37.813619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995694+0000","last_change":"2024-08-18T22:24:37.995694+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995694+0000","last_undegraded":"2024-08-18T22:24:37.995694+0000","last_fullsized":"2024-08-18T22:24:37.995694+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:38.000038+0000","last_change":"2024-08-18T22:24:38.000038+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.000038+0000","last_undegraded":"2024-08-18T22:24:38.000038+0000","last_fullsized":"2024-08-18T22:24:38.000038+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991887+0000","last_change":"2024-08-18T22:24:37.991887+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991887+0000","last_undegraded":"2024-08-18T22:24:37.991887+0000","last_fullsized":"2024-08-18T22:24:37.991887+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.029145+0000","last_change":"2024-08-18T22:24:40.024058+0000","last_active":"2024-08-18T22:24:40.029145+0000","last_peered":"2024-08-18T22:24:40.029145+0000","last_clean":"2024-08-18T22:24:40.029145+0000","last_became_active":"2024-08-18T22:24:40.023645+0000","last_became_peered":"2024-08-18T22:24:40.023645+0000","last_unstale":"2024-08-18T22:24:40.029145+0000","last_undegraded":"2024-08-18T22:24:40.029145+0000","last_fullsized":"2024-08-18T22:24:40.029145+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:22.381723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.997531+0000","last_change":"2024-08-18T22:24:37.997531+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.997531+0000","last_undegraded":"2024-08-18T22:24:37.997531+0000","last_fullsized":"2024-08-18T22:24:37.997531+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:38.000053+0000","last_change":"2024-08-18T22:24:38.000053+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.000053+0000","last_undegraded":"2024-08-18T22:24:38.000053+0000","last_fullsized":"2024-08-18T22:24:38.000053+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"96'3","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.042941+0000","last_change":"2024-08-18T22:24:39.014524+0000","last_active":"2024-08-18T22:24:40.042941+0000","last_peered":"2024-08-18T22:24:40.042941+0000","last_clean":"2024-08-18T22:24:40.042941+0000","last_became_active":"2024-08-18T22:24:39.014226+0000","last_became_peered":"2024-08-18T22:24:39.014226+0000","last_unstale":"2024-08-18T22:24:40.042941+0000","last_undegraded":"2024-08-18T22:24:40.042941+0000","last_fullsized":"2024-08-18T22:24:40.042941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:20:26.559799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.994780+0000","last_change":"2024-08-18T22:24:37.994780+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.994780+0000","last_undegraded":"2024-08-18T22:24:37.994780+0000","last_fullsized":"2024-08-18T22:24:37.994780+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991232+0000","last_change":"2024-08-18T22:24:37.991232+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991232+0000","last_undegraded":"2024-08-18T22:24:37.991232+0000","last_fullsized":"2024-08-18T22:24:37.991232+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022552+0000","last_change":"2024-08-18T22:24:40.014669+0000","last_active":"2024-08-18T22:24:40.022552+0000","last_peered":"2024-08-18T22:24:40.022552+0000","last_clean":"2024-08-18T22:24:40.022552+0000","last_became_active":"2024-08-18T22:24:40.014366+0000","last_became_peered":"2024-08-18T22:24:40.014366+0000","last_unstale":"2024-08-18T22:24:40.022552+0000","last_undegraded":"2024-08-18T22:24:40.022552+0000","last_fullsized":"2024-08-18T22:24:40.022552+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:00.803298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.994852+0000","last_change":"2024-08-18T22:24:37.994852+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.994852+0000","last_undegraded":"2024-08-18T22:24:37.994852+0000","last_fullsized":"2024-08-18T22:24:37.994852+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035788+0000","last_change":"2024-08-18T22:24:40.032806+0000","last_active":"2024-08-18T22:24:40.035788+0000","last_peered":"2024-08-18T22:24:40.035788+0000","last_clean":"2024-08-18T22:24:40.035788+0000","last_became_active":"2024-08-18T22:24:40.032402+0000","last_became_peered":"2024-08-18T22:24:40.032402+0000","last_unstale":"2024-08-18T22:24:40.035788+0000","last_undegraded":"2024-08-18T22:24:40.035788+0000","last_fullsized":"2024-08-18T22:24:40.035788+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:48.336063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996218+0000","last_change":"2024-08-18T22:24:37.996218+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996218+0000","last_undegraded":"2024-08-18T22:24:37.996218+0000","last_fullsized":"2024-08-18T22:24:37.996218+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.030155+0000","last_change":"2024-08-18T22:24:40.019334+0000","last_active":"2024-08-18T22:24:40.030155+0000","last_peered":"2024-08-18T22:24:40.030155+0000","last_clean":"2024-08-18T22:24:40.030155+0000","last_became_active":"2024-08-18T22:24:40.019013+0000","last_became_peered":"2024-08-18T22:24:40.019013+0000","last_unstale":"2024-08-18T22:24:40.030155+0000","last_undegraded":"2024-08-18T22:24:40.030155+0000","last_fullsized":"2024-08-18T22:24:40.030155+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:44.403615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995608+0000","last_change":"2024-08-18T22:24:37.995608+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995608+0000","last_undegraded":"2024-08-18T22:24:37.995608+0000","last_fullsized":"2024-08-18T22:24:37.995608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990388+0000","last_change":"2024-08-18T22:24:37.990388+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990388+0000","last_undegraded":"2024-08-18T22:24:37.990388+0000","last_fullsized":"2024-08-18T22:24:37.990388+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991568+0000","last_change":"2024-08-18T22:24:37.991568+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991568+0000","last_undegraded":"2024-08-18T22:24:37.991568+0000","last_fullsized":"2024-08-18T22:24:37.991568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.013978+0000","last_change":"2024-08-18T22:24:40.008819+0000","last_active":"2024-08-18T22:24:40.013978+0000","last_peered":"2024-08-18T22:24:40.013978+0000","last_clean":"2024-08-18T22:24:40.013978+0000","last_became_active":"2024-08-18T22:24:40.008536+0000","last_became_peered":"2024-08-18T22:24:40.008536+0000","last_unstale":"2024-08-18T22:24:40.013978+0000","last_undegraded":"2024-08-18T22:24:40.013978+0000","last_fullsized":"2024-08-18T22:24:40.013978+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:22:53.584195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.036751+0000","last_change":"2024-08-18T22:24:39.018385+0000","last_active":"2024-08-18T22:24:40.036751+0000","last_peered":"2024-08-18T22:24:40.036751+0000","last_clean":"2024-08-18T22:24:40.036751+0000","last_became_active":"2024-08-18T22:24:39.018097+0000","last_became_peered":"2024-08-18T22:24:39.018097+0000","last_unstale":"2024-08-18T22:24:40.036751+0000","last_undegraded":"2024-08-18T22:24:40.036751+0000","last_fullsized":"2024-08-18T22:24:40.036751+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:52:43.228773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.997105+0000","last_change":"2024-08-18T22:24:37.997105+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.997105+0000","last_undegraded":"2024-08-18T22:24:37.997105+0000","last_fullsized":"2024-08-18T22:24:37.997105+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.004284+0000","last_change":"2024-08-18T22:24:39.018757+0000","last_active":"2024-08-18T22:24:40.004284+0000","last_peered":"2024-08-18T22:24:40.004284+0000","last_clean":"2024-08-18T22:24:40.004284+0000","last_became_active":"2024-08-18T22:24:39.018297+0000","last_became_peered":"2024-08-18T22:24:39.018297+0000","last_unstale":"2024-08-18T22:24:40.004284+0000","last_undegraded":"2024-08-18T22:24:40.004284+0000","last_fullsized":"2024-08-18T22:24:40.004284+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:51:06.563873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996369+0000","last_change":"2024-08-18T22:24:37.996369+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996369+0000","last_undegraded":"2024-08-18T22:24:37.996369+0000","last_fullsized":"2024-08-18T22:24:37.996369+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.003853+0000","last_change":"2024-08-18T22:24:39.015304+0000","last_active":"2024-08-18T22:24:40.003853+0000","last_peered":"2024-08-18T22:24:40.003853+0000","last_clean":"2024-08-18T22:24:40.003853+0000","last_became_active":"2024-08-18T22:24:39.015013+0000","last_became_peered":"2024-08-18T22:24:39.015013+0000","last_unstale":"2024-08-18T22:24:40.003853+0000","last_undegraded":"2024-08-18T22:24:40.003853+0000","last_fullsized":"2024-08-18T22:24:40.003853+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:34.344259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991638+0000","last_change":"2024-08-18T22:24:37.991638+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991638+0000","last_undegraded":"2024-08-18T22:24:37.991638+0000","last_fullsized":"2024-08-18T22:24:37.991638+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.004328+0000","last_change":"2024-08-18T22:24:39.015360+0000","last_active":"2024-08-18T22:24:40.004328+0000","last_peered":"2024-08-18T22:24:40.004328+0000","last_clean":"2024-08-18T22:24:40.004328+0000","last_became_active":"2024-08-18T22:24:39.014376+0000","last_became_peered":"2024-08-18T22:24:39.014376+0000","last_unstale":"2024-08-18T22:24:40.004328+0000","last_undegraded":"2024-08-18T22:24:40.004328+0000","last_fullsized":"2024-08-18T22:24:40.004328+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:29.351930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.005116+0000","last_change":"2024-08-18T22:24:39.014437+0000","last_active":"2024-08-18T22:24:40.005116+0000","last_peered":"2024-08-18T22:24:40.005116+0000","last_clean":"2024-08-18T22:24:40.005116+0000","last_became_active":"2024-08-18T22:24:39.014115+0000","last_became_peered":"2024-08-18T22:24:39.014115+0000","last_unstale":"2024-08-18T22:24:40.005116+0000","last_undegraded":"2024-08-18T22:24:40.005116+0000","last_fullsized":"2024-08-18T22:24:40.005116+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:07.433459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990354+0000","last_change":"2024-08-18T22:24:37.990354+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990354+0000","last_undegraded":"2024-08-18T22:24:37.990354+0000","last_fullsized":"2024-08-18T22:24:37.990354+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.026280+0000","last_change":"2024-08-18T22:24:40.017509+0000","last_active":"2024-08-18T22:24:40.026280+0000","last_peered":"2024-08-18T22:24:40.026280+0000","last_clean":"2024-08-18T22:24:40.026280+0000","last_became_active":"2024-08-18T22:24:40.017236+0000","last_became_peered":"2024-08-18T22:24:40.017236+0000","last_unstale":"2024-08-18T22:24:40.026280+0000","last_undegraded":"2024-08-18T22:24:40.026280+0000","last_fullsized":"2024-08-18T22:24:40.026280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:57.184672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995592+0000","last_change":"2024-08-18T22:24:37.995592+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995592+0000","last_undegraded":"2024-08-18T22:24:37.995592+0000","last_fullsized":"2024-08-18T22:24:37.995592+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996364+0000","last_change":"2024-08-18T22:24:37.996364+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996364+0000","last_undegraded":"2024-08-18T22:24:37.996364+0000","last_fullsized":"2024-08-18T22:24:37.996364+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990347+0000","last_change":"2024-08-18T22:24:37.990347+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990347+0000","last_undegraded":"2024-08-18T22:24:37.990347+0000","last_fullsized":"2024-08-18T22:24:37.990347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991219+0000","last_change":"2024-08-18T22:24:37.991219+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991219+0000","last_undegraded":"2024-08-18T22:24:37.991219+0000","last_fullsized":"2024-08-18T22:24:37.991219+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996188+0000","last_change":"2024-08-18T22:24:37.996188+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996188+0000","last_undegraded":"2024-08-18T22:24:37.996188+0000","last_fullsized":"2024-08-18T22:24:37.996188+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":318,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-08-18T22:24:37.992561+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:24:37.992561+0000","last_peered":"2024-08-18T22:24:37.992561+0000","last_clean":"2024-08-18T22:24:37.992561+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:24:37.992561+0000","last_undegraded":"2024-08-18T22:24:37.992561+0000","last_fullsized":"2024-08-18T22:24:37.992561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334780,"statfs":{"total":96636764160,"available":96598814720,"internally_reserved":0,"allocated":1744896,"data_stored":1121780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36464,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335376,"statfs":{"total":96636764160,"available":96599425024,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40624,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331216,"statfs":{"total":96636764160,"available":96595165184,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40616,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331224,"statfs":{"total":96636764160,"available":96595173376,"internally_reserved":0,"allocated":1138688,"data_stored":525203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41208,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330632,"statfs":{"total":96636764160,"available":96594567168,"internally_reserved":0,"allocated":1744896,"data_stored":1121780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40664,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331176,"statfs":{"total":96636764160,"available":96595124224,"internally_reserved":0,"allocated":1183744,"data_stored":545406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1175552,"data_stored":545246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:24:44.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:24:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.321+0000 7f8f74e00640 1 Processor -- start 2024-08-18T22:24:44.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.321+0000 7f8f74e00640 1 -- start start 2024-08-18T22:24:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f74e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f700cb390 0x7f8f700735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f74e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f70073c80 con 0x7f8f7006da70 2024-08-18T22:24:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f74e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f700ca5d0 con 0x7f8f7015bed0 2024-08-18T22:24:44.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f74e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8f700ca8b0 con 0x7f8f700cb390 2024-08-18T22:24:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f6e800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8f7006da70 0x7f8f70165b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52214/0 (socket says 172.21.15.5:52214) 2024-08-18T22:24:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f6e800640 1 -- 172.21.15.5:0/2246487985 learned_addr learned my addr 172.21.15.5:0/2246487985 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:44.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f6d400640 1 --2- 172.21.15.5:0/2246487985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f700cb390 0x7f8f700735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f6ca00640 1 -- 172.21.15.5:0/2246487985 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2954040755 0 0) 0x7f8f70073c80 con 0x7f8f7006da70 2024-08-18T22:24:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f6ca00640 1 -- 172.21.15.5:0/2246487985 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f54003530 con 0x7f8f7006da70 2024-08-18T22:24:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f6ca00640 1 -- 172.21.15.5:0/2246487985 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130577837 0 0) 0x7f8f700ca5d0 con 0x7f8f7015bed0 2024-08-18T22:24:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f6ca00640 1 -- 172.21.15.5:0/2246487985 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f70073c80 con 0x7f8f7015bed0 2024-08-18T22:24:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f6d400640 1 -- 172.21.15.5:0/2246487985 >> v1:172.21.15.117:6789/0 conn(0x7f8f7015bed0 legacy=0x7f8f70071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f6ca00640 1 -- 172.21.15.5:0/2246487985 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 217168153 0 0) 0x7f8f54003530 con 0x7f8f7006da70 2024-08-18T22:24:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f6d400640 1 -- 172.21.15.5:0/2246487985 >> v1:172.21.15.5:6789/0 conn(0x7f8f7006da70 legacy=0x7f8f70165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.325+0000 7f8f6d400640 1 -- 172.21.15.5:0/2246487985 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f700cab90 con 0x7f8f700cb390 2024-08-18T22:24:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f6d400640 1 --2- 172.21.15.5:0/2246487985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f700cb390 0x7f8f700735a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0097f0 tx=0x7f8f5c01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4306b1404ca447d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f6ca00640 1 -- 172.21.15.5:0/2246487985 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0b0070 con 0x7f8f700cb390 2024-08-18T22:24:44.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f6ca00640 1 -- 172.21.15.5:0/2246487985 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0ab400 con 0x7f8f700cb390 2024-08-18T22:24:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f6ca00640 1 -- 172.21.15.5:0/2246487985 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f68001680 con 0x7f8f700cb390 2024-08-18T22:24:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f74e00640 1 -- 172.21.15.5:0/2246487985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f700cb390 msgr2=0x7f8f700735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f74e00640 1 --2- 172.21.15.5:0/2246487985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f700cb390 0x7f8f700735a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0097f0 tx=0x7f8f5c01c3d0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f74e00640 1 -- 172.21.15.5:0/2246487985 shutdown_connections 2024-08-18T22:24:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f74e00640 1 --2- 172.21.15.5:0/2246487985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f700cb390 0x7f8f700735a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f74e00640 1 -- 172.21.15.5:0/2246487985 >> 172.21.15.5:0/2246487985 conn(0x7f8f700b1c50 msgr2=0x7f8f700b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f74e00640 1 -- 172.21.15.5:0/2246487985 shutdown_connections 2024-08-18T22:24:44.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f74e00640 1 -- 172.21.15.5:0/2246487985 wait complete. 2024-08-18T22:24:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.329+0000 7f8f74e00640 1 Processor -- start 2024-08-18T22:24:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f74e00640 1 -- start start 2024-08-18T22:24:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f74e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f7006da70 0x7f8f700c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f74e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f700cb390 0x7f8f7009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f74e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7015bed0 0x7f8f7009d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f74e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70169c40 con 0x7f8f700cb390 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f74e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70169ac0 con 0x7f8f7006da70 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f74e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8f70169dc0 con 0x7f8f7015bed0 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f6d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f700cb390 0x7f8f7009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f6d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f700cb390 0x7f8f7009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53530/0 (socket says 172.21.15.5:53530) 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f6d400640 1 -- 172.21.15.5:0/3106077419 learned_addr learned my addr 172.21.15.5:0/3106077419 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f6de00640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f7006da70 0x7f8f700c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f6e800640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7015bed0 0x7f8f7009d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f6d400640 1 -- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7015bed0 msgr2=0x7f8f7009d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f6d400640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7015bed0 0x7f8f7009d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f6d400640 1 -- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f7006da70 msgr2=0x7f8f700c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f6d400640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f7006da70 0x7f8f700c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f6d400640 1 -- 172.21.15.5:0/3106077419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f700c6970 con 0x7f8f700cb390 2024-08-18T22:24:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f6d400640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f700cb390 0x7f8f7009aa40 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0ae040 tx=0x7f8f5c019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f66000640 1 -- 172.21.15.5:0/3106077419 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0b0040 con 0x7f8f700cb390 2024-08-18T22:24:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f66000640 1 -- 172.21.15.5:0/3106077419 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5c003620 con 0x7f8f700cb390 2024-08-18T22:24:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f66000640 1 -- 172.21.15.5:0/3106077419 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0039d0 con 0x7f8f700cb390 2024-08-18T22:24:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f74e00640 1 -- 172.21.15.5:0/3106077419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f70158ba0 con 0x7f8f700cb390 2024-08-18T22:24:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f74e00640 1 -- 172.21.15.5:0/3106077419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f700c9190 con 0x7f8f700cb390 2024-08-18T22:24:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.333+0000 7f8f74e00640 1 -- 172.21.15.5:0/3106077419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f700735a0 con 0x7f8f700cb390 2024-08-18T22:24:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.337+0000 7f8f66000640 1 -- 172.21.15.5:0/3106077419 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f5c0bb030 con 0x7f8f700cb390 2024-08-18T22:24:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.337+0000 7f8f66000640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f500678c0 0x7f8f50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.337+0000 7f8f66000640 1 -- 172.21.15.5:0/3106077419 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f8f5c11f250 con 0x7f8f700cb390 2024-08-18T22:24:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.337+0000 7f8f6de00640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f500678c0 0x7f8f50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.337+0000 7f8f6de00640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f500678c0 0x7f8f50069d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8f60007fd0 tx=0x7f8f60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.341+0000 7f8f66000640 1 -- 172.21.15.5:0/3106077419 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8f5c0c2020 con 0x7f8f700cb390 2024-08-18T22:24:44.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.501+0000 7f8f74e00640 1 -- 172.21.15.5:0/3106077419 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f700719a0 con 0x7f8f500678c0 2024-08-18T22:24:44.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.509+0000 7f8f66000640 1 -- 172.21.15.5:0/3106077419 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243362 (secure 0 0 0) 0x7f8f700719a0 con 0x7f8f500678c0 2024-08-18T22:24:44.511 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:24:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 -- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f500678c0 msgr2=0x7f8f50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f500678c0 0x7f8f50069d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8f60007fd0 tx=0x7f8f60009040 comp rx=0 tx=0).stop 2024-08-18T22:24:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 -- 172.21.15.5:0/3106077419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f700cb390 msgr2=0x7f8f7009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f700cb390 0x7f8f7009aa40 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0ae040 tx=0x7f8f5c019170 comp rx=0 tx=0).stop 2024-08-18T22:24:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 -- 172.21.15.5:0/3106077419 shutdown_connections 2024-08-18T22:24:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8f500678c0 0x7f8f50069d80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f7015bed0 0x7f8f7009d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f700cb390 0x7f8f7009aa40 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 --2- 172.21.15.5:0/3106077419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f7006da70 0x7f8f700c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 -- 172.21.15.5:0/3106077419 >> 172.21.15.5:0/3106077419 conn(0x7f8f700b1c50 msgr2=0x7f8f700cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 -- 172.21.15.5:0/3106077419 shutdown_connections 2024-08-18T22:24:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.513+0000 7f8f74e00640 1 -- 172.21.15.5:0/3106077419 wait complete. 2024-08-18T22:24:44.532 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-08-18T22:24:43.699418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309600,"kb_used_data":10196,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754665120,"statfs":{"total":773094113280,"available":772777082880,"internally_reserved":0,"allocated":10440704,"data_stored":5453651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.711146"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022551+0000","last_change":"2024-08-18T22:24:40.016890+0000","last_active":"2024-08-18T22:24:40.022551+0000","last_peered":"2024-08-18T22:24:40.022551+0000","last_clean":"2024-08-18T22:24:40.022551+0000","last_became_active":"2024-08-18T22:24:40.016624+0000","last_became_peered":"2024-08-18T22:24:40.016624+0000","last_unstale":"2024-08-18T22:24:40.022551+0000","last_undegraded":"2024-08-18T22:24:40.022551+0000","last_fullsized":"2024-08-18T22:24:40.022551+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:41:24.595641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022923+0000","last_change":"2024-08-18T22:24:40.020616+0000","last_active":"2024-08-18T22:24:40.022923+0000","last_peered":"2024-08-18T22:24:40.022923+0000","last_clean":"2024-08-18T22:24:40.022923+0000","last_became_active":"2024-08-18T22:24:40.020258+0000","last_became_peered":"2024-08-18T22:24:40.020258+0000","last_unstale":"2024-08-18T22:24:40.022923+0000","last_undegraded":"2024-08-18T22:24:40.022923+0000","last_fullsized":"2024-08-18T22:24:40.022923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:11.395179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.033562+0000","last_change":"2024-08-18T22:24:40.028865+0000","last_active":"2024-08-18T22:24:40.033562+0000","last_peered":"2024-08-18T22:24:40.033562+0000","last_clean":"2024-08-18T22:24:40.033562+0000","last_became_active":"2024-08-18T22:24:40.028545+0000","last_became_peered":"2024-08-18T22:24:40.028545+0000","last_unstale":"2024-08-18T22:24:40.033562+0000","last_undegraded":"2024-08-18T22:24:40.033562+0000","last_fullsized":"2024-08-18T22:24:40.033562+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:57.967896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.018444+0000","last_change":"2024-08-18T22:24:40.014360+0000","last_active":"2024-08-18T22:24:40.018444+0000","last_peered":"2024-08-18T22:24:40.018444+0000","last_clean":"2024-08-18T22:24:40.018444+0000","last_became_active":"2024-08-18T22:24:40.014017+0000","last_became_peered":"2024-08-18T22:24:40.014017+0000","last_unstale":"2024-08-18T22:24:40.018444+0000","last_undegraded":"2024-08-18T22:24:40.018444+0000","last_fullsized":"2024-08-18T22:24:40.018444+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:19:07.605988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.031405+0000","last_change":"2024-08-18T22:24:40.020506+0000","last_active":"2024-08-18T22:24:40.031405+0000","last_peered":"2024-08-18T22:24:40.031405+0000","last_clean":"2024-08-18T22:24:40.031405+0000","last_became_active":"2024-08-18T22:24:40.020225+0000","last_became_peered":"2024-08-18T22:24:40.020225+0000","last_unstale":"2024-08-18T22:24:40.031405+0000","last_undegraded":"2024-08-18T22:24:40.031405+0000","last_fullsized":"2024-08-18T22:24:40.031405+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:28:17.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035507+0000","last_change":"2024-08-18T22:24:40.032145+0000","last_active":"2024-08-18T22:24:40.035507+0000","last_peered":"2024-08-18T22:24:40.035507+0000","last_clean":"2024-08-18T22:24:40.035507+0000","last_became_active":"2024-08-18T22:24:40.031866+0000","last_became_peered":"2024-08-18T22:24:40.031866+0000","last_unstale":"2024-08-18T22:24:40.035507+0000","last_undegraded":"2024-08-18T22:24:40.035507+0000","last_fullsized":"2024-08-18T22:24:40.035507+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:06:57.730808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.032492+0000","last_change":"2024-08-18T22:24:40.027430+0000","last_active":"2024-08-18T22:24:40.032492+0000","last_peered":"2024-08-18T22:24:40.032492+0000","last_clean":"2024-08-18T22:24:40.032492+0000","last_became_active":"2024-08-18T22:24:40.027160+0000","last_became_peered":"2024-08-18T22:24:40.027160+0000","last_unstale":"2024-08-18T22:24:40.032492+0000","last_undegraded":"2024-08-18T22:24:40.032492+0000","last_fullsized":"2024-08-18T22:24:40.032492+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:58.084319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022530+0000","last_change":"2024-08-18T22:24:40.016741+0000","last_active":"2024-08-18T22:24:40.022530+0000","last_peered":"2024-08-18T22:24:40.022530+0000","last_clean":"2024-08-18T22:24:40.022530+0000","last_became_active":"2024-08-18T22:24:40.016175+0000","last_became_peered":"2024-08-18T22:24:40.016175+0000","last_unstale":"2024-08-18T22:24:40.022530+0000","last_undegraded":"2024-08-18T22:24:40.022530+0000","last_fullsized":"2024-08-18T22:24:40.022530+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:37.399428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035486+0000","last_change":"2024-08-18T22:24:40.031981+0000","last_active":"2024-08-18T22:24:40.035486+0000","last_peered":"2024-08-18T22:24:40.035486+0000","last_clean":"2024-08-18T22:24:40.035486+0000","last_became_active":"2024-08-18T22:24:40.031692+0000","last_became_peered":"2024-08-18T22:24:40.031692+0000","last_unstale":"2024-08-18T22:24:40.035486+0000","last_undegraded":"2024-08-18T22:24:40.035486+0000","last_fullsized":"2024-08-18T22:24:40.035486+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:41.451094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.031162+0000","last_change":"2024-08-18T22:24:40.028117+0000","last_active":"2024-08-18T22:24:40.031162+0000","last_peered":"2024-08-18T22:24:40.031162+0000","last_clean":"2024-08-18T22:24:40.031162+0000","last_became_active":"2024-08-18T22:24:40.027844+0000","last_became_peered":"2024-08-18T22:24:40.027844+0000","last_unstale":"2024-08-18T22:24:40.031162+0000","last_undegraded":"2024-08-18T22:24:40.031162+0000","last_fullsized":"2024-08-18T22:24:40.031162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:19:28.332247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.021634+0000","last_change":"2024-08-18T22:24:40.013826+0000","last_active":"2024-08-18T22:24:40.021634+0000","last_peered":"2024-08-18T22:24:40.021634+0000","last_clean":"2024-08-18T22:24:40.021634+0000","last_became_active":"2024-08-18T22:24:40.011508+0000","last_became_peered":"2024-08-18T22:24:40.011508+0000","last_unstale":"2024-08-18T22:24:40.021634+0000","last_undegraded":"2024-08-18T22:24:40.021634+0000","last_fullsized":"2024-08-18T22:24:40.021634+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:20:06.666487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022955+0000","last_change":"2024-08-18T22:24:40.021109+0000","last_active":"2024-08-18T22:24:40.022955+0000","last_peered":"2024-08-18T22:24:40.022955+0000","last_clean":"2024-08-18T22:24:40.022955+0000","last_became_active":"2024-08-18T22:24:40.020810+0000","last_became_peered":"2024-08-18T22:24:40.020810+0000","last_unstale":"2024-08-18T22:24:40.022955+0000","last_undegraded":"2024-08-18T22:24:40.022955+0000","last_fullsized":"2024-08-18T22:24:40.022955+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:32:35.090221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990989+0000","last_change":"2024-08-18T22:24:37.990989+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990989+0000","last_undegraded":"2024-08-18T22:24:37.990989+0000","last_fullsized":"2024-08-18T22:24:37.990989+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.033242+0000","last_change":"2024-08-18T22:24:39.012924+0000","last_active":"2024-08-18T22:24:40.033242+0000","last_peered":"2024-08-18T22:24:40.033242+0000","last_clean":"2024-08-18T22:24:40.033242+0000","last_became_active":"2024-08-18T22:24:39.012605+0000","last_became_peered":"2024-08-18T22:24:39.012605+0000","last_unstale":"2024-08-18T22:24:40.033242+0000","last_undegraded":"2024-08-18T22:24:40.033242+0000","last_fullsized":"2024-08-18T22:24:40.033242+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:45.539213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.992059+0000","last_change":"2024-08-18T22:24:37.992059+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.992059+0000","last_undegraded":"2024-08-18T22:24:37.992059+0000","last_fullsized":"2024-08-18T22:24:37.992059+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990927+0000","last_change":"2024-08-18T22:24:37.990927+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990927+0000","last_undegraded":"2024-08-18T22:24:37.990927+0000","last_fullsized":"2024-08-18T22:24:37.990927+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.034212+0000","last_change":"2024-08-18T22:24:39.017797+0000","last_active":"2024-08-18T22:24:40.034212+0000","last_peered":"2024-08-18T22:24:40.034212+0000","last_clean":"2024-08-18T22:24:40.034212+0000","last_became_active":"2024-08-18T22:24:39.017473+0000","last_became_peered":"2024-08-18T22:24:39.017473+0000","last_unstale":"2024-08-18T22:24:40.034212+0000","last_undegraded":"2024-08-18T22:24:40.034212+0000","last_fullsized":"2024-08-18T22:24:40.034212+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:03:37.813619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995694+0000","last_change":"2024-08-18T22:24:37.995694+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995694+0000","last_undegraded":"2024-08-18T22:24:37.995694+0000","last_fullsized":"2024-08-18T22:24:37.995694+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:38.000038+0000","last_change":"2024-08-18T22:24:38.000038+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.000038+0000","last_undegraded":"2024-08-18T22:24:38.000038+0000","last_fullsized":"2024-08-18T22:24:38.000038+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991887+0000","last_change":"2024-08-18T22:24:37.991887+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991887+0000","last_undegraded":"2024-08-18T22:24:37.991887+0000","last_fullsized":"2024-08-18T22:24:37.991887+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.029145+0000","last_change":"2024-08-18T22:24:40.024058+0000","last_active":"2024-08-18T22:24:40.029145+0000","last_peered":"2024-08-18T22:24:40.029145+0000","last_clean":"2024-08-18T22:24:40.029145+0000","last_became_active":"2024-08-18T22:24:40.023645+0000","last_became_peered":"2024-08-18T22:24:40.023645+0000","last_unstale":"2024-08-18T22:24:40.029145+0000","last_undegraded":"2024-08-18T22:24:40.029145+0000","last_fullsized":"2024-08-18T22:24:40.029145+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:22.381723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.997531+0000","last_change":"2024-08-18T22:24:37.997531+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.997531+0000","last_undegraded":"2024-08-18T22:24:37.997531+0000","last_fullsized":"2024-08-18T22:24:37.997531+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:38.000053+0000","last_change":"2024-08-18T22:24:38.000053+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.000053+0000","last_undegraded":"2024-08-18T22:24:38.000053+0000","last_fullsized":"2024-08-18T22:24:38.000053+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"96'3","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.042941+0000","last_change":"2024-08-18T22:24:39.014524+0000","last_active":"2024-08-18T22:24:40.042941+0000","last_peered":"2024-08-18T22:24:40.042941+0000","last_clean":"2024-08-18T22:24:40.042941+0000","last_became_active":"2024-08-18T22:24:39.014226+0000","last_became_peered":"2024-08-18T22:24:39.014226+0000","last_unstale":"2024-08-18T22:24:40.042941+0000","last_undegraded":"2024-08-18T22:24:40.042941+0000","last_fullsized":"2024-08-18T22:24:40.042941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:20:26.559799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.994780+0000","last_change":"2024-08-18T22:24:37.994780+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.994780+0000","last_undegraded":"2024-08-18T22:24:37.994780+0000","last_fullsized":"2024-08-18T22:24:37.994780+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991232+0000","last_change":"2024-08-18T22:24:37.991232+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991232+0000","last_undegraded":"2024-08-18T22:24:37.991232+0000","last_fullsized":"2024-08-18T22:24:37.991232+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022552+0000","last_change":"2024-08-18T22:24:40.014669+0000","last_active":"2024-08-18T22:24:40.022552+0000","last_peered":"2024-08-18T22:24:40.022552+0000","last_clean":"2024-08-18T22:24:40.022552+0000","last_became_active":"2024-08-18T22:24:40.014366+0000","last_became_peered":"2024-08-18T22:24:40.014366+0000","last_unstale":"2024-08-18T22:24:40.022552+0000","last_undegraded":"2024-08-18T22:24:40.022552+0000","last_fullsized":"2024-08-18T22:24:40.022552+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:00.803298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.994852+0000","last_change":"2024-08-18T22:24:37.994852+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.994852+0000","last_undegraded":"2024-08-18T22:24:37.994852+0000","last_fullsized":"2024-08-18T22:24:37.994852+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035788+0000","last_change":"2024-08-18T22:24:40.032806+0000","last_active":"2024-08-18T22:24:40.035788+0000","last_peered":"2024-08-18T22:24:40.035788+0000","last_clean":"2024-08-18T22:24:40.035788+0000","last_became_active":"2024-08-18T22:24:40.032402+0000","last_became_peered":"2024-08-18T22:24:40.032402+0000","last_unstale":"2024-08-18T22:24:40.035788+0000","last_undegraded":"2024-08-18T22:24:40.035788+0000","last_fullsized":"2024-08-18T22:24:40.035788+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:48.336063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996218+0000","last_change":"2024-08-18T22:24:37.996218+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996218+0000","last_undegraded":"2024-08-18T22:24:37.996218+0000","last_fullsized":"2024-08-18T22:24:37.996218+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.030155+0000","last_change":"2024-08-18T22:24:40.019334+0000","last_active":"2024-08-18T22:24:40.030155+0000","last_peered":"2024-08-18T22:24:40.030155+0000","last_clean":"2024-08-18T22:24:40.030155+0000","last_became_active":"2024-08-18T22:24:40.019013+0000","last_became_peered":"2024-08-18T22:24:40.019013+0000","last_unstale":"2024-08-18T22:24:40.030155+0000","last_undegraded":"2024-08-18T22:24:40.030155+0000","last_fullsized":"2024-08-18T22:24:40.030155+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:44.403615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995608+0000","last_change":"2024-08-18T22:24:37.995608+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995608+0000","last_undegraded":"2024-08-18T22:24:37.995608+0000","last_fullsized":"2024-08-18T22:24:37.995608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990388+0000","last_change":"2024-08-18T22:24:37.990388+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990388+0000","last_undegraded":"2024-08-18T22:24:37.990388+0000","last_fullsized":"2024-08-18T22:24:37.990388+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991568+0000","last_change":"2024-08-18T22:24:37.991568+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991568+0000","last_undegraded":"2024-08-18T22:24:37.991568+0000","last_fullsized":"2024-08-18T22:24:37.991568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.013978+0000","last_change":"2024-08-18T22:24:40.008819+0000","last_active":"2024-08-18T22:24:40.013978+0000","last_peered":"2024-08-18T22:24:40.013978+0000","last_clean":"2024-08-18T22:24:40.013978+0000","last_became_active":"2024-08-18T22:24:40.008536+0000","last_became_peered":"2024-08-18T22:24:40.008536+0000","last_unstale":"2024-08-18T22:24:40.013978+0000","last_undegraded":"2024-08-18T22:24:40.013978+0000","last_fullsized":"2024-08-18T22:24:40.013978+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:22:53.584195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.036751+0000","last_change":"2024-08-18T22:24:39.018385+0000","last_active":"2024-08-18T22:24:40.036751+0000","last_peered":"2024-08-18T22:24:40.036751+0000","last_clean":"2024-08-18T22:24:40.036751+0000","last_became_active":"2024-08-18T22:24:39.018097+0000","last_became_peered":"2024-08-18T22:24:39.018097+0000","last_unstale":"2024-08-18T22:24:40.036751+0000","last_undegraded":"2024-08-18T22:24:40.036751+0000","last_fullsized":"2024-08-18T22:24:40.036751+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:52:43.228773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.997105+0000","last_change":"2024-08-18T22:24:37.997105+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.997105+0000","last_undegraded":"2024-08-18T22:24:37.997105+0000","last_fullsized":"2024-08-18T22:24:37.997105+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.004284+0000","last_change":"2024-08-18T22:24:39.018757+0000","last_active":"2024-08-18T22:24:40.004284+0000","last_peered":"2024-08-18T22:24:40.004284+0000","last_clean":"2024-08-18T22:24:40.004284+0000","last_became_active":"2024-08-18T22:24:39.018297+0000","last_became_peered":"2024-08-18T22:24:39.018297+0000","last_unstale":"2024-08-18T22:24:40.004284+0000","last_undegraded":"2024-08-18T22:24:40.004284+0000","last_fullsized":"2024-08-18T22:24:40.004284+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:51:06.563873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996369+0000","last_change":"2024-08-18T22:24:37.996369+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996369+0000","last_undegraded":"2024-08-18T22:24:37.996369+0000","last_fullsized":"2024-08-18T22:24:37.996369+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.003853+0000","last_change":"2024-08-18T22:24:39.015304+0000","last_active":"2024-08-18T22:24:40.003853+0000","last_peered":"2024-08-18T22:24:40.003853+0000","last_clean":"2024-08-18T22:24:40.003853+0000","last_became_active":"2024-08-18T22:24:39.015013+0000","last_became_peered":"2024-08-18T22:24:39.015013+0000","last_unstale":"2024-08-18T22:24:40.003853+0000","last_undegraded":"2024-08-18T22:24:40.003853+0000","last_fullsized":"2024-08-18T22:24:40.003853+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:34.344259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991638+0000","last_change":"2024-08-18T22:24:37.991638+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991638+0000","last_undegraded":"2024-08-18T22:24:37.991638+0000","last_fullsized":"2024-08-18T22:24:37.991638+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.004328+0000","last_change":"2024-08-18T22:24:39.015360+0000","last_active":"2024-08-18T22:24:40.004328+0000","last_peered":"2024-08-18T22:24:40.004328+0000","last_clean":"2024-08-18T22:24:40.004328+0000","last_became_active":"2024-08-18T22:24:39.014376+0000","last_became_peered":"2024-08-18T22:24:39.014376+0000","last_unstale":"2024-08-18T22:24:40.004328+0000","last_undegraded":"2024-08-18T22:24:40.004328+0000","last_fullsized":"2024-08-18T22:24:40.004328+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:29.351930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.005116+0000","last_change":"2024-08-18T22:24:39.014437+0000","last_active":"2024-08-18T22:24:40.005116+0000","last_peered":"2024-08-18T22:24:40.005116+0000","last_clean":"2024-08-18T22:24:40.005116+0000","last_became_active":"2024-08-18T22:24:39.014115+0000","last_became_peered":"2024-08-18T22:24:39.014115+0000","last_unstale":"2024-08-18T22:24:40.005116+0000","last_undegraded":"2024-08-18T22:24:40.005116+0000","last_fullsized":"2024-08-18T22:24:40.005116+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:07.433459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990354+0000","last_change":"2024-08-18T22:24:37.990354+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990354+0000","last_undegraded":"2024-08-18T22:24:37.990354+0000","last_fullsized":"2024-08-18T22:24:37.990354+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.026280+0000","last_change":"2024-08-18T22:24:40.017509+0000","last_active":"2024-08-18T22:24:40.026280+0000","last_peered":"2024-08-18T22:24:40.026280+0000","last_clean":"2024-08-18T22:24:40.026280+0000","last_became_active":"2024-08-18T22:24:40.017236+0000","last_became_peered":"2024-08-18T22:24:40.017236+0000","last_unstale":"2024-08-18T22:24:40.026280+0000","last_undegraded":"2024-08-18T22:24:40.026280+0000","last_fullsized":"2024-08-18T22:24:40.026280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:57.184672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995592+0000","last_change":"2024-08-18T22:24:37.995592+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995592+0000","last_undegraded":"2024-08-18T22:24:37.995592+0000","last_fullsized":"2024-08-18T22:24:37.995592+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996364+0000","last_change":"2024-08-18T22:24:37.996364+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996364+0000","last_undegraded":"2024-08-18T22:24:37.996364+0000","last_fullsized":"2024-08-18T22:24:37.996364+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990347+0000","last_change":"2024-08-18T22:24:37.990347+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990347+0000","last_undegraded":"2024-08-18T22:24:37.990347+0000","last_fullsized":"2024-08-18T22:24:37.990347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991219+0000","last_change":"2024-08-18T22:24:37.991219+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991219+0000","last_undegraded":"2024-08-18T22:24:37.991219+0000","last_fullsized":"2024-08-18T22:24:37.991219+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996188+0000","last_change":"2024-08-18T22:24:37.996188+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996188+0000","last_undegraded":"2024-08-18T22:24:37.996188+0000","last_fullsized":"2024-08-18T22:24:37.996188+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":318,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-08-18T22:24:37.992561+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:24:37.992561+0000","last_peered":"2024-08-18T22:24:37.992561+0000","last_clean":"2024-08-18T22:24:37.992561+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:24:37.992561+0000","last_undegraded":"2024-08-18T22:24:37.992561+0000","last_fullsized":"2024-08-18T22:24:37.992561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334780,"statfs":{"total":96636764160,"available":96598814720,"internally_reserved":0,"allocated":1744896,"data_stored":1121780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36464,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335376,"statfs":{"total":96636764160,"available":96599425024,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40624,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331216,"statfs":{"total":96636764160,"available":96595165184,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40616,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331224,"statfs":{"total":96636764160,"available":96595173376,"internally_reserved":0,"allocated":1138688,"data_stored":525203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41208,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330632,"statfs":{"total":96636764160,"available":96594567168,"internally_reserved":0,"allocated":1744896,"data_stored":1121780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40664,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331176,"statfs":{"total":96636764160,"available":96595124224,"internally_reserved":0,"allocated":1183744,"data_stored":545406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1175552,"data_stored":545246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:24:44.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:24:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.713+0000 7f141dc00640 1 Processor -- start 2024-08-18T22:24:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.713+0000 7f141dc00640 1 -- start start 2024-08-18T22:24:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f141dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141815e4b0 0x7f1418070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f141dc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1418070430 con 0x7f1418070730 2024-08-18T22:24:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f141dc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141815eb60 con 0x7f1418161960 2024-08-18T22:24:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f141dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f141815e940 con 0x7f141815e4b0 2024-08-18T22:24:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f1416000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1418070730 0x7f141815dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52218/0 (socket says 172.21.15.5:52218) 2024-08-18T22:24:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f1416000640 1 -- 172.21.15.5:0/1122927331 learned_addr learned my addr 172.21.15.5:0/1122927331 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f1417400640 1 --2- 172.21.15.5:0/1122927331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141815e4b0 0x7f1418070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f1415600640 1 -- 172.21.15.5:0/1122927331 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519621577 0 0) 0x7f1418070430 con 0x7f1418070730 2024-08-18T22:24:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f1415600640 1 -- 172.21.15.5:0/1122927331 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13fc003530 con 0x7f1418070730 2024-08-18T22:24:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f1415600640 1 -- 172.21.15.5:0/1122927331 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668322621 0 0) 0x7f141815eb60 con 0x7f1418161960 2024-08-18T22:24:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f1415600640 1 -- 172.21.15.5:0/1122927331 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1418070430 con 0x7f1418161960 2024-08-18T22:24:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f1415600640 1 -- 172.21.15.5:0/1122927331 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2954539106 0 0) 0x7f13fc003530 con 0x7f1418070730 2024-08-18T22:24:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f1417400640 1 -- 172.21.15.5:0/1122927331 >> v1:172.21.15.117:6789/0 conn(0x7f1418161960 legacy=0x7f141806fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f1417400640 1 -- 172.21.15.5:0/1122927331 >> v1:172.21.15.5:6789/0 conn(0x7f1418070730 legacy=0x7f141815dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.717+0000 7f1417400640 1 -- 172.21.15.5:0/1122927331 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141815ee40 con 0x7f141815e4b0 2024-08-18T22:24:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f1417400640 1 --2- 172.21.15.5:0/1122927331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141815e4b0 0x7f1418070ba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1410009dc0 tx=0x7f141001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10a27b35740450ae server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f1415600640 1 -- 172.21.15.5:0/1122927331 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404001680 con 0x7f141815e4b0 2024-08-18T22:24:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f1415600640 1 -- 172.21.15.5:0/1122927331 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14100a6500 con 0x7f141815e4b0 2024-08-18T22:24:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f1415600640 1 -- 172.21.15.5:0/1122927331 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14100a68d0 con 0x7f141815e4b0 2024-08-18T22:24:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f141dc00640 1 -- 172.21.15.5:0/1122927331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141815e4b0 msgr2=0x7f1418070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f141dc00640 1 --2- 172.21.15.5:0/1122927331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141815e4b0 0x7f1418070ba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1410009dc0 tx=0x7f141001c8b0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f141dc00640 1 -- 172.21.15.5:0/1122927331 shutdown_connections 2024-08-18T22:24:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f141dc00640 1 --2- 172.21.15.5:0/1122927331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141815e4b0 0x7f1418070ba0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f141dc00640 1 -- 172.21.15.5:0/1122927331 >> 172.21.15.5:0/1122927331 conn(0x7f14180d2130 msgr2=0x7f14180d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f141dc00640 1 -- 172.21.15.5:0/1122927331 shutdown_connections 2024-08-18T22:24:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f141dc00640 1 -- 172.21.15.5:0/1122927331 wait complete. 2024-08-18T22:24:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f141dc00640 1 Processor -- start 2024-08-18T22:24:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.721+0000 7f141dc00640 1 -- start start 2024-08-18T22:24:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f141dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1418070730 0x7f141815cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f141dc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f141815e4b0 0x7f14180cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f141dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418161960 0x7f141815a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f141dc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f141809ba30 con 0x7f1418161960 2024-08-18T22:24:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f141dc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f14180710e0 con 0x7f141815e4b0 2024-08-18T22:24:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f141dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f14180c5b90 con 0x7f1418070730 2024-08-18T22:24:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1417400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418161960 0x7f141815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1417400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418161960 0x7f141815a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53546/0 (socket says 172.21.15.5:53546) 2024-08-18T22:24:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1417400640 1 -- 172.21.15.5:0/2069824438 learned_addr learned my addr 172.21.15.5:0/2069824438 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1416a00640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1418070730 0x7f141815cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1416000640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f141815e4b0 0x7f14180cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1417400640 1 -- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1418070730 msgr2=0x7f141815cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1417400640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1418070730 0x7f141815cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1417400640 1 -- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f141815e4b0 msgr2=0x7f14180cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1417400640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f141815e4b0 0x7f14180cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1417400640 1 -- 172.21.15.5:0/2069824438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141815d480 con 0x7f1418161960 2024-08-18T22:24:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1416000640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f141815e4b0 0x7f14180cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f1417400640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418161960 0x7f141815a220 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f141001cd90 tx=0x7f1410019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f140ea00640 1 -- 172.21.15.5:0/2069824438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410009450 con 0x7f1418161960 2024-08-18T22:24:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f140ea00640 1 -- 172.21.15.5:0/2069824438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14100c0070 con 0x7f1418161960 2024-08-18T22:24:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f140ea00640 1 -- 172.21.15.5:0/2069824438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14100ba8d0 con 0x7f1418161960 2024-08-18T22:24:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f141dc00640 1 -- 172.21.15.5:0/2069824438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141815d760 con 0x7f1418161960 2024-08-18T22:24:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f141dc00640 1 -- 172.21.15.5:0/2069824438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14180c9430 con 0x7f1418161960 2024-08-18T22:24:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f141dc00640 1 -- 172.21.15.5:0/2069824438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f141809bbb0 con 0x7f1418161960 2024-08-18T22:24:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.725+0000 7f140ea00640 1 -- 172.21.15.5:0/2069824438 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f14100baa70 con 0x7f1418161960 2024-08-18T22:24:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.729+0000 7f140ea00640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13f80678c0 0x7f13f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.729+0000 7f140ea00640 1 -- 172.21.15.5:0/2069824438 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f14101212b0 con 0x7f1418161960 2024-08-18T22:24:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.729+0000 7f1416a00640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13f80678c0 0x7f13f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.729+0000 7f1416a00640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13f80678c0 0x7f13f8069d80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f14080011f0 tx=0x7f1408009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:44.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.733+0000 7f140ea00640 1 -- 172.21.15.5:0/2069824438 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f14100164a0 con 0x7f1418161960 2024-08-18T22:24:44.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.893+0000 7f141dc00640 1 -- 172.21.15.5:0/2069824438 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14180d3010 con 0x7f13f80678c0 2024-08-18T22:24:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f140ea00640 1 -- 172.21.15.5:0/2069824438 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243362 (secure 0 0 0) 0x7f14180d3010 con 0x7f13f80678c0 2024-08-18T22:24:44.904 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:44.905 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:24:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f141dc00640 1 -- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13f80678c0 msgr2=0x7f13f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f141dc00640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13f80678c0 0x7f13f8069d80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f14080011f0 tx=0x7f1408009040 comp rx=0 tx=0).stop 2024-08-18T22:24:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f141dc00640 1 -- 172.21.15.5:0/2069824438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418161960 msgr2=0x7f141815a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f141dc00640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418161960 0x7f141815a220 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f141001cd90 tx=0x7f1410019650 comp rx=0 tx=0).stop 2024-08-18T22:24:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f141dc00640 1 -- 172.21.15.5:0/2069824438 shutdown_connections 2024-08-18T22:24:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f141dc00640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f13f80678c0 0x7f13f8069d80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f141dc00640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1418161960 0x7f141815a220 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f141dc00640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f141815e4b0 0x7f14180cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f141dc00640 1 --2- 172.21.15.5:0/2069824438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1418070730 0x7f141815cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f141dc00640 1 -- 172.21.15.5:0/2069824438 >> 172.21.15.5:0/2069824438 conn(0x7f14180d2130 msgr2=0x7f14180b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.901+0000 7f141dc00640 1 -- 172.21.15.5:0/2069824438 shutdown_connections 2024-08-18T22:24:44.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:44.905+0000 7f141dc00640 1 -- 172.21.15.5:0/2069824438 wait complete. 2024-08-18T22:24:44.924 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-08-18T22:24:43.699418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309600,"kb_used_data":10196,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754665120,"statfs":{"total":773094113280,"available":772777082880,"internally_reserved":0,"allocated":10440704,"data_stored":5453651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.711146"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022551+0000","last_change":"2024-08-18T22:24:40.016890+0000","last_active":"2024-08-18T22:24:40.022551+0000","last_peered":"2024-08-18T22:24:40.022551+0000","last_clean":"2024-08-18T22:24:40.022551+0000","last_became_active":"2024-08-18T22:24:40.016624+0000","last_became_peered":"2024-08-18T22:24:40.016624+0000","last_unstale":"2024-08-18T22:24:40.022551+0000","last_undegraded":"2024-08-18T22:24:40.022551+0000","last_fullsized":"2024-08-18T22:24:40.022551+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:41:24.595641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022923+0000","last_change":"2024-08-18T22:24:40.020616+0000","last_active":"2024-08-18T22:24:40.022923+0000","last_peered":"2024-08-18T22:24:40.022923+0000","last_clean":"2024-08-18T22:24:40.022923+0000","last_became_active":"2024-08-18T22:24:40.020258+0000","last_became_peered":"2024-08-18T22:24:40.020258+0000","last_unstale":"2024-08-18T22:24:40.022923+0000","last_undegraded":"2024-08-18T22:24:40.022923+0000","last_fullsized":"2024-08-18T22:24:40.022923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:11.395179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.033562+0000","last_change":"2024-08-18T22:24:40.028865+0000","last_active":"2024-08-18T22:24:40.033562+0000","last_peered":"2024-08-18T22:24:40.033562+0000","last_clean":"2024-08-18T22:24:40.033562+0000","last_became_active":"2024-08-18T22:24:40.028545+0000","last_became_peered":"2024-08-18T22:24:40.028545+0000","last_unstale":"2024-08-18T22:24:40.033562+0000","last_undegraded":"2024-08-18T22:24:40.033562+0000","last_fullsized":"2024-08-18T22:24:40.033562+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:57.967896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.018444+0000","last_change":"2024-08-18T22:24:40.014360+0000","last_active":"2024-08-18T22:24:40.018444+0000","last_peered":"2024-08-18T22:24:40.018444+0000","last_clean":"2024-08-18T22:24:40.018444+0000","last_became_active":"2024-08-18T22:24:40.014017+0000","last_became_peered":"2024-08-18T22:24:40.014017+0000","last_unstale":"2024-08-18T22:24:40.018444+0000","last_undegraded":"2024-08-18T22:24:40.018444+0000","last_fullsized":"2024-08-18T22:24:40.018444+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:19:07.605988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.031405+0000","last_change":"2024-08-18T22:24:40.020506+0000","last_active":"2024-08-18T22:24:40.031405+0000","last_peered":"2024-08-18T22:24:40.031405+0000","last_clean":"2024-08-18T22:24:40.031405+0000","last_became_active":"2024-08-18T22:24:40.020225+0000","last_became_peered":"2024-08-18T22:24:40.020225+0000","last_unstale":"2024-08-18T22:24:40.031405+0000","last_undegraded":"2024-08-18T22:24:40.031405+0000","last_fullsized":"2024-08-18T22:24:40.031405+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:28:17.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035507+0000","last_change":"2024-08-18T22:24:40.032145+0000","last_active":"2024-08-18T22:24:40.035507+0000","last_peered":"2024-08-18T22:24:40.035507+0000","last_clean":"2024-08-18T22:24:40.035507+0000","last_became_active":"2024-08-18T22:24:40.031866+0000","last_became_peered":"2024-08-18T22:24:40.031866+0000","last_unstale":"2024-08-18T22:24:40.035507+0000","last_undegraded":"2024-08-18T22:24:40.035507+0000","last_fullsized":"2024-08-18T22:24:40.035507+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:06:57.730808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.032492+0000","last_change":"2024-08-18T22:24:40.027430+0000","last_active":"2024-08-18T22:24:40.032492+0000","last_peered":"2024-08-18T22:24:40.032492+0000","last_clean":"2024-08-18T22:24:40.032492+0000","last_became_active":"2024-08-18T22:24:40.027160+0000","last_became_peered":"2024-08-18T22:24:40.027160+0000","last_unstale":"2024-08-18T22:24:40.032492+0000","last_undegraded":"2024-08-18T22:24:40.032492+0000","last_fullsized":"2024-08-18T22:24:40.032492+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:58.084319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022530+0000","last_change":"2024-08-18T22:24:40.016741+0000","last_active":"2024-08-18T22:24:40.022530+0000","last_peered":"2024-08-18T22:24:40.022530+0000","last_clean":"2024-08-18T22:24:40.022530+0000","last_became_active":"2024-08-18T22:24:40.016175+0000","last_became_peered":"2024-08-18T22:24:40.016175+0000","last_unstale":"2024-08-18T22:24:40.022530+0000","last_undegraded":"2024-08-18T22:24:40.022530+0000","last_fullsized":"2024-08-18T22:24:40.022530+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:37.399428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035486+0000","last_change":"2024-08-18T22:24:40.031981+0000","last_active":"2024-08-18T22:24:40.035486+0000","last_peered":"2024-08-18T22:24:40.035486+0000","last_clean":"2024-08-18T22:24:40.035486+0000","last_became_active":"2024-08-18T22:24:40.031692+0000","last_became_peered":"2024-08-18T22:24:40.031692+0000","last_unstale":"2024-08-18T22:24:40.035486+0000","last_undegraded":"2024-08-18T22:24:40.035486+0000","last_fullsized":"2024-08-18T22:24:40.035486+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:41.451094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.031162+0000","last_change":"2024-08-18T22:24:40.028117+0000","last_active":"2024-08-18T22:24:40.031162+0000","last_peered":"2024-08-18T22:24:40.031162+0000","last_clean":"2024-08-18T22:24:40.031162+0000","last_became_active":"2024-08-18T22:24:40.027844+0000","last_became_peered":"2024-08-18T22:24:40.027844+0000","last_unstale":"2024-08-18T22:24:40.031162+0000","last_undegraded":"2024-08-18T22:24:40.031162+0000","last_fullsized":"2024-08-18T22:24:40.031162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:19:28.332247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.021634+0000","last_change":"2024-08-18T22:24:40.013826+0000","last_active":"2024-08-18T22:24:40.021634+0000","last_peered":"2024-08-18T22:24:40.021634+0000","last_clean":"2024-08-18T22:24:40.021634+0000","last_became_active":"2024-08-18T22:24:40.011508+0000","last_became_peered":"2024-08-18T22:24:40.011508+0000","last_unstale":"2024-08-18T22:24:40.021634+0000","last_undegraded":"2024-08-18T22:24:40.021634+0000","last_fullsized":"2024-08-18T22:24:40.021634+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:20:06.666487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022955+0000","last_change":"2024-08-18T22:24:40.021109+0000","last_active":"2024-08-18T22:24:40.022955+0000","last_peered":"2024-08-18T22:24:40.022955+0000","last_clean":"2024-08-18T22:24:40.022955+0000","last_became_active":"2024-08-18T22:24:40.020810+0000","last_became_peered":"2024-08-18T22:24:40.020810+0000","last_unstale":"2024-08-18T22:24:40.022955+0000","last_undegraded":"2024-08-18T22:24:40.022955+0000","last_fullsized":"2024-08-18T22:24:40.022955+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:32:35.090221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990989+0000","last_change":"2024-08-18T22:24:37.990989+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990989+0000","last_undegraded":"2024-08-18T22:24:37.990989+0000","last_fullsized":"2024-08-18T22:24:37.990989+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.033242+0000","last_change":"2024-08-18T22:24:39.012924+0000","last_active":"2024-08-18T22:24:40.033242+0000","last_peered":"2024-08-18T22:24:40.033242+0000","last_clean":"2024-08-18T22:24:40.033242+0000","last_became_active":"2024-08-18T22:24:39.012605+0000","last_became_peered":"2024-08-18T22:24:39.012605+0000","last_unstale":"2024-08-18T22:24:40.033242+0000","last_undegraded":"2024-08-18T22:24:40.033242+0000","last_fullsized":"2024-08-18T22:24:40.033242+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:45.539213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.992059+0000","last_change":"2024-08-18T22:24:37.992059+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.992059+0000","last_undegraded":"2024-08-18T22:24:37.992059+0000","last_fullsized":"2024-08-18T22:24:37.992059+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990927+0000","last_change":"2024-08-18T22:24:37.990927+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990927+0000","last_undegraded":"2024-08-18T22:24:37.990927+0000","last_fullsized":"2024-08-18T22:24:37.990927+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.034212+0000","last_change":"2024-08-18T22:24:39.017797+0000","last_active":"2024-08-18T22:24:40.034212+0000","last_peered":"2024-08-18T22:24:40.034212+0000","last_clean":"2024-08-18T22:24:40.034212+0000","last_became_active":"2024-08-18T22:24:39.017473+0000","last_became_peered":"2024-08-18T22:24:39.017473+0000","last_unstale":"2024-08-18T22:24:40.034212+0000","last_undegraded":"2024-08-18T22:24:40.034212+0000","last_fullsized":"2024-08-18T22:24:40.034212+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:03:37.813619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995694+0000","last_change":"2024-08-18T22:24:37.995694+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995694+0000","last_undegraded":"2024-08-18T22:24:37.995694+0000","last_fullsized":"2024-08-18T22:24:37.995694+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:38.000038+0000","last_change":"2024-08-18T22:24:38.000038+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.000038+0000","last_undegraded":"2024-08-18T22:24:38.000038+0000","last_fullsized":"2024-08-18T22:24:38.000038+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991887+0000","last_change":"2024-08-18T22:24:37.991887+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991887+0000","last_undegraded":"2024-08-18T22:24:37.991887+0000","last_fullsized":"2024-08-18T22:24:37.991887+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.029145+0000","last_change":"2024-08-18T22:24:40.024058+0000","last_active":"2024-08-18T22:24:40.029145+0000","last_peered":"2024-08-18T22:24:40.029145+0000","last_clean":"2024-08-18T22:24:40.029145+0000","last_became_active":"2024-08-18T22:24:40.023645+0000","last_became_peered":"2024-08-18T22:24:40.023645+0000","last_unstale":"2024-08-18T22:24:40.029145+0000","last_undegraded":"2024-08-18T22:24:40.029145+0000","last_fullsized":"2024-08-18T22:24:40.029145+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:22.381723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.997531+0000","last_change":"2024-08-18T22:24:37.997531+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.997531+0000","last_undegraded":"2024-08-18T22:24:37.997531+0000","last_fullsized":"2024-08-18T22:24:37.997531+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:38.000053+0000","last_change":"2024-08-18T22:24:38.000053+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.000053+0000","last_undegraded":"2024-08-18T22:24:38.000053+0000","last_fullsized":"2024-08-18T22:24:38.000053+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"96'3","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.042941+0000","last_change":"2024-08-18T22:24:39.014524+0000","last_active":"2024-08-18T22:24:40.042941+0000","last_peered":"2024-08-18T22:24:40.042941+0000","last_clean":"2024-08-18T22:24:40.042941+0000","last_became_active":"2024-08-18T22:24:39.014226+0000","last_became_peered":"2024-08-18T22:24:39.014226+0000","last_unstale":"2024-08-18T22:24:40.042941+0000","last_undegraded":"2024-08-18T22:24:40.042941+0000","last_fullsized":"2024-08-18T22:24:40.042941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:20:26.559799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.994780+0000","last_change":"2024-08-18T22:24:37.994780+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.994780+0000","last_undegraded":"2024-08-18T22:24:37.994780+0000","last_fullsized":"2024-08-18T22:24:37.994780+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991232+0000","last_change":"2024-08-18T22:24:37.991232+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991232+0000","last_undegraded":"2024-08-18T22:24:37.991232+0000","last_fullsized":"2024-08-18T22:24:37.991232+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022552+0000","last_change":"2024-08-18T22:24:40.014669+0000","last_active":"2024-08-18T22:24:40.022552+0000","last_peered":"2024-08-18T22:24:40.022552+0000","last_clean":"2024-08-18T22:24:40.022552+0000","last_became_active":"2024-08-18T22:24:40.014366+0000","last_became_peered":"2024-08-18T22:24:40.014366+0000","last_unstale":"2024-08-18T22:24:40.022552+0000","last_undegraded":"2024-08-18T22:24:40.022552+0000","last_fullsized":"2024-08-18T22:24:40.022552+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:00.803298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.994852+0000","last_change":"2024-08-18T22:24:37.994852+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.994852+0000","last_undegraded":"2024-08-18T22:24:37.994852+0000","last_fullsized":"2024-08-18T22:24:37.994852+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035788+0000","last_change":"2024-08-18T22:24:40.032806+0000","last_active":"2024-08-18T22:24:40.035788+0000","last_peered":"2024-08-18T22:24:40.035788+0000","last_clean":"2024-08-18T22:24:40.035788+0000","last_became_active":"2024-08-18T22:24:40.032402+0000","last_became_peered":"2024-08-18T22:24:40.032402+0000","last_unstale":"2024-08-18T22:24:40.035788+0000","last_undegraded":"2024-08-18T22:24:40.035788+0000","last_fullsized":"2024-08-18T22:24:40.035788+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:48.336063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996218+0000","last_change":"2024-08-18T22:24:37.996218+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996218+0000","last_undegraded":"2024-08-18T22:24:37.996218+0000","last_fullsized":"2024-08-18T22:24:37.996218+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.030155+0000","last_change":"2024-08-18T22:24:40.019334+0000","last_active":"2024-08-18T22:24:40.030155+0000","last_peered":"2024-08-18T22:24:40.030155+0000","last_clean":"2024-08-18T22:24:40.030155+0000","last_became_active":"2024-08-18T22:24:40.019013+0000","last_became_peered":"2024-08-18T22:24:40.019013+0000","last_unstale":"2024-08-18T22:24:40.030155+0000","last_undegraded":"2024-08-18T22:24:40.030155+0000","last_fullsized":"2024-08-18T22:24:40.030155+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:44.403615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995608+0000","last_change":"2024-08-18T22:24:37.995608+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995608+0000","last_undegraded":"2024-08-18T22:24:37.995608+0000","last_fullsized":"2024-08-18T22:24:37.995608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990388+0000","last_change":"2024-08-18T22:24:37.990388+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990388+0000","last_undegraded":"2024-08-18T22:24:37.990388+0000","last_fullsized":"2024-08-18T22:24:37.990388+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991568+0000","last_change":"2024-08-18T22:24:37.991568+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991568+0000","last_undegraded":"2024-08-18T22:24:37.991568+0000","last_fullsized":"2024-08-18T22:24:37.991568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.013978+0000","last_change":"2024-08-18T22:24:40.008819+0000","last_active":"2024-08-18T22:24:40.013978+0000","last_peered":"2024-08-18T22:24:40.013978+0000","last_clean":"2024-08-18T22:24:40.013978+0000","last_became_active":"2024-08-18T22:24:40.008536+0000","last_became_peered":"2024-08-18T22:24:40.008536+0000","last_unstale":"2024-08-18T22:24:40.013978+0000","last_undegraded":"2024-08-18T22:24:40.013978+0000","last_fullsized":"2024-08-18T22:24:40.013978+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:22:53.584195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.036751+0000","last_change":"2024-08-18T22:24:39.018385+0000","last_active":"2024-08-18T22:24:40.036751+0000","last_peered":"2024-08-18T22:24:40.036751+0000","last_clean":"2024-08-18T22:24:40.036751+0000","last_became_active":"2024-08-18T22:24:39.018097+0000","last_became_peered":"2024-08-18T22:24:39.018097+0000","last_unstale":"2024-08-18T22:24:40.036751+0000","last_undegraded":"2024-08-18T22:24:40.036751+0000","last_fullsized":"2024-08-18T22:24:40.036751+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:52:43.228773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.997105+0000","last_change":"2024-08-18T22:24:37.997105+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.997105+0000","last_undegraded":"2024-08-18T22:24:37.997105+0000","last_fullsized":"2024-08-18T22:24:37.997105+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.004284+0000","last_change":"2024-08-18T22:24:39.018757+0000","last_active":"2024-08-18T22:24:40.004284+0000","last_peered":"2024-08-18T22:24:40.004284+0000","last_clean":"2024-08-18T22:24:40.004284+0000","last_became_active":"2024-08-18T22:24:39.018297+0000","last_became_peered":"2024-08-18T22:24:39.018297+0000","last_unstale":"2024-08-18T22:24:40.004284+0000","last_undegraded":"2024-08-18T22:24:40.004284+0000","last_fullsized":"2024-08-18T22:24:40.004284+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:51:06.563873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996369+0000","last_change":"2024-08-18T22:24:37.996369+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996369+0000","last_undegraded":"2024-08-18T22:24:37.996369+0000","last_fullsized":"2024-08-18T22:24:37.996369+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.003853+0000","last_change":"2024-08-18T22:24:39.015304+0000","last_active":"2024-08-18T22:24:40.003853+0000","last_peered":"2024-08-18T22:24:40.003853+0000","last_clean":"2024-08-18T22:24:40.003853+0000","last_became_active":"2024-08-18T22:24:39.015013+0000","last_became_peered":"2024-08-18T22:24:39.015013+0000","last_unstale":"2024-08-18T22:24:40.003853+0000","last_undegraded":"2024-08-18T22:24:40.003853+0000","last_fullsized":"2024-08-18T22:24:40.003853+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:34.344259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991638+0000","last_change":"2024-08-18T22:24:37.991638+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991638+0000","last_undegraded":"2024-08-18T22:24:37.991638+0000","last_fullsized":"2024-08-18T22:24:37.991638+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.004328+0000","last_change":"2024-08-18T22:24:39.015360+0000","last_active":"2024-08-18T22:24:40.004328+0000","last_peered":"2024-08-18T22:24:40.004328+0000","last_clean":"2024-08-18T22:24:40.004328+0000","last_became_active":"2024-08-18T22:24:39.014376+0000","last_became_peered":"2024-08-18T22:24:39.014376+0000","last_unstale":"2024-08-18T22:24:40.004328+0000","last_undegraded":"2024-08-18T22:24:40.004328+0000","last_fullsized":"2024-08-18T22:24:40.004328+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:29.351930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.005116+0000","last_change":"2024-08-18T22:24:39.014437+0000","last_active":"2024-08-18T22:24:40.005116+0000","last_peered":"2024-08-18T22:24:40.005116+0000","last_clean":"2024-08-18T22:24:40.005116+0000","last_became_active":"2024-08-18T22:24:39.014115+0000","last_became_peered":"2024-08-18T22:24:39.014115+0000","last_unstale":"2024-08-18T22:24:40.005116+0000","last_undegraded":"2024-08-18T22:24:40.005116+0000","last_fullsized":"2024-08-18T22:24:40.005116+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:07.433459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990354+0000","last_change":"2024-08-18T22:24:37.990354+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990354+0000","last_undegraded":"2024-08-18T22:24:37.990354+0000","last_fullsized":"2024-08-18T22:24:37.990354+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.026280+0000","last_change":"2024-08-18T22:24:40.017509+0000","last_active":"2024-08-18T22:24:40.026280+0000","last_peered":"2024-08-18T22:24:40.026280+0000","last_clean":"2024-08-18T22:24:40.026280+0000","last_became_active":"2024-08-18T22:24:40.017236+0000","last_became_peered":"2024-08-18T22:24:40.017236+0000","last_unstale":"2024-08-18T22:24:40.026280+0000","last_undegraded":"2024-08-18T22:24:40.026280+0000","last_fullsized":"2024-08-18T22:24:40.026280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:57.184672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995592+0000","last_change":"2024-08-18T22:24:37.995592+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995592+0000","last_undegraded":"2024-08-18T22:24:37.995592+0000","last_fullsized":"2024-08-18T22:24:37.995592+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996364+0000","last_change":"2024-08-18T22:24:37.996364+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996364+0000","last_undegraded":"2024-08-18T22:24:37.996364+0000","last_fullsized":"2024-08-18T22:24:37.996364+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990347+0000","last_change":"2024-08-18T22:24:37.990347+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990347+0000","last_undegraded":"2024-08-18T22:24:37.990347+0000","last_fullsized":"2024-08-18T22:24:37.990347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991219+0000","last_change":"2024-08-18T22:24:37.991219+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991219+0000","last_undegraded":"2024-08-18T22:24:37.991219+0000","last_fullsized":"2024-08-18T22:24:37.991219+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996188+0000","last_change":"2024-08-18T22:24:37.996188+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996188+0000","last_undegraded":"2024-08-18T22:24:37.996188+0000","last_fullsized":"2024-08-18T22:24:37.996188+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":318,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-08-18T22:24:37.992561+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:24:37.992561+0000","last_peered":"2024-08-18T22:24:37.992561+0000","last_clean":"2024-08-18T22:24:37.992561+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:24:37.992561+0000","last_undegraded":"2024-08-18T22:24:37.992561+0000","last_fullsized":"2024-08-18T22:24:37.992561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334780,"statfs":{"total":96636764160,"available":96598814720,"internally_reserved":0,"allocated":1744896,"data_stored":1121780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36464,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335376,"statfs":{"total":96636764160,"available":96599425024,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40624,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331216,"statfs":{"total":96636764160,"available":96595165184,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40616,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331224,"statfs":{"total":96636764160,"available":96595173376,"internally_reserved":0,"allocated":1138688,"data_stored":525203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41208,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330632,"statfs":{"total":96636764160,"available":96594567168,"internally_reserved":0,"allocated":1744896,"data_stored":1121780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40664,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331176,"statfs":{"total":96636764160,"available":96595124224,"internally_reserved":0,"allocated":1183744,"data_stored":545406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1175552,"data_stored":545246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:24:44.928 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3f is not active+clean 2024-08-18T22:24:44.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.928 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3e is not active+clean 2024-08-18T22:24:44.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.928 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3d is not active+clean 2024-08-18T22:24:44.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3c is not active+clean 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3a is not active+clean 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:PG 14.39 is not active+clean 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:PG 14.38 is not active+clean 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:PG 14.33 is not active+clean 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:PG 14.31 is not active+clean 2024-08-18T22:24:44.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.930 INFO:tasks.ceph.ceph_manager.ceph:PG 14.30 is not active+clean 2024-08-18T22:24:44.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.930 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2f is not active+clean 2024-08-18T22:24:44.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.930 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2e is not active+clean 2024-08-18T22:24:44.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.930 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2c is not active+clean 2024-08-18T22:24:44.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.930 INFO:tasks.ceph.ceph_manager.ceph:PG 14.29 is not active+clean 2024-08-18T22:24:44.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.930 INFO:tasks.ceph.ceph_manager.ceph:PG 14.28 is not active+clean 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:PG 14.27 is not active+clean 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:PG 14.24 is not active+clean 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:PG 14.23 is not active+clean 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:PG 14.21 is not active+clean 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:PG 14.20 is not active+clean 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.931 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1c is not active+clean 2024-08-18T22:24:44.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.932 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1f is not active+clean 2024-08-18T22:24:44.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.990989+0000', 'last_change': '2024-08-18T22:24:37.990989+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.990989+0000', 'last_undegraded': '2024-08-18T22:24:37.990989+0000', 'last_fullsized': '2024-08-18T22:24:37.990989+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:24:44.932 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1d is not active+clean 2024-08-18T22:24:44.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.932 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1e is not active+clean 2024-08-18T22:24:44.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.932 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1d is not active+clean 2024-08-18T22:24:44.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.992059+0000', 'last_change': '2024-08-18T22:24:37.992059+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.992059+0000', 'last_undegraded': '2024-08-18T22:24:37.992059+0000', 'last_fullsized': '2024-08-18T22:24:37.992059+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:24:44.932 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1f is not active+clean 2024-08-18T22:24:44.932 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.933 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1c is not active+clean 2024-08-18T22:24:44.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.990927+0000', 'last_change': '2024-08-18T22:24:37.990927+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.990927+0000', 'last_undegraded': '2024-08-18T22:24:37.990927+0000', 'last_fullsized': '2024-08-18T22:24:37.990927+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:24:44.933 INFO:tasks.ceph.ceph_manager.ceph:PG 14.18 is not active+clean 2024-08-18T22:24:44.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.933 INFO:tasks.ceph.ceph_manager.ceph:PG 14.19 is not active+clean 2024-08-18T22:24:44.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.933 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1a is not active+clean 2024-08-18T22:24:44.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.995694+0000', 'last_change': '2024-08-18T22:24:37.995694+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.995694+0000', 'last_undegraded': '2024-08-18T22:24:37.995694+0000', 'last_fullsized': '2024-08-18T22:24:37.995694+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:24:44.933 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1a is not active+clean 2024-08-18T22:24:44.933 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.933 INFO:tasks.ceph.ceph_manager.ceph:PG 13.19 is not active+clean 2024-08-18T22:24:44.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:38.000038+0000', 'last_change': '2024-08-18T22:24:38.000038+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.000038+0000', 'last_undegraded': '2024-08-18T22:24:38.000038+0000', 'last_fullsized': '2024-08-18T22:24:38.000038+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:24:44.934 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1b is not active+clean 2024-08-18T22:24:44.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.934 INFO:tasks.ceph.ceph_manager.ceph:PG 13.18 is not active+clean 2024-08-18T22:24:44.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.991887+0000', 'last_change': '2024-08-18T22:24:37.991887+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.991887+0000', 'last_undegraded': '2024-08-18T22:24:37.991887+0000', 'last_fullsized': '2024-08-18T22:24:37.991887+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:24:44.934 INFO:tasks.ceph.ceph_manager.ceph:PG 13.17 is not active+clean 2024-08-18T22:24:44.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.997531+0000', 'last_change': '2024-08-18T22:24:37.997531+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.997531+0000', 'last_undegraded': '2024-08-18T22:24:37.997531+0000', 'last_fullsized': '2024-08-18T22:24:37.997531+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:24:44.934 INFO:tasks.ceph.ceph_manager.ceph:PG 14.15 is not active+clean 2024-08-18T22:24:44.934 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.934 INFO:tasks.ceph.ceph_manager.ceph:PG 13.16 is not active+clean 2024-08-18T22:24:44.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:38.000053+0000', 'last_change': '2024-08-18T22:24:38.000053+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.000053+0000', 'last_undegraded': '2024-08-18T22:24:38.000053+0000', 'last_fullsized': '2024-08-18T22:24:38.000053+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:24:44.935 INFO:tasks.ceph.ceph_manager.ceph:PG 14.16 is not active+clean 2024-08-18T22:24:44.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.935 INFO:tasks.ceph.ceph_manager.ceph:PG 14.17 is not active+clean 2024-08-18T22:24:44.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.935 INFO:tasks.ceph.ceph_manager.ceph:PG 13.14 is not active+clean 2024-08-18T22:24:44.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.994780+0000', 'last_change': '2024-08-18T22:24:37.994780+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.994780+0000', 'last_undegraded': '2024-08-18T22:24:37.994780+0000', 'last_fullsized': '2024-08-18T22:24:37.994780+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:24:44.935 INFO:tasks.ceph.ceph_manager.ceph:PG 14.10 is not active+clean 2024-08-18T22:24:44.935 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.935 INFO:tasks.ceph.ceph_manager.ceph:PG 13.13 is not active+clean 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.991232+0000', 'last_change': '2024-08-18T22:24:37.991232+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.991232+0000', 'last_undegraded': '2024-08-18T22:24:37.991232+0000', 'last_fullsized': '2024-08-18T22:24:37.991232+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:PG 13.12 is not active+clean 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.994852+0000', 'last_change': '2024-08-18T22:24:37.994852+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.994852+0000', 'last_undegraded': '2024-08-18T22:24:37.994852+0000', 'last_fullsized': '2024-08-18T22:24:37.994852+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:PG 13.11 is not active+clean 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.996218+0000', 'last_change': '2024-08-18T22:24:37.996218+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.996218+0000', 'last_undegraded': '2024-08-18T22:24:37.996218+0000', 'last_fullsized': '2024-08-18T22:24:37.996218+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:PG 13.10 is not active+clean 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.995608+0000', 'last_change': '2024-08-18T22:24:37.995608+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.995608+0000', 'last_undegraded': '2024-08-18T22:24:37.995608+0000', 'last_fullsized': '2024-08-18T22:24:37.995608+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:PG 14.c is not active+clean 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:PG 13.f is not active+clean 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.990388+0000', 'last_change': '2024-08-18T22:24:37.990388+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.990388+0000', 'last_undegraded': '2024-08-18T22:24:37.990388+0000', 'last_fullsized': '2024-08-18T22:24:37.990388+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:24:44.936 INFO:tasks.ceph.ceph_manager.ceph:PG 14.d is not active+clean 2024-08-18T22:24:44.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.937 INFO:tasks.ceph.ceph_manager.ceph:PG 13.e is not active+clean 2024-08-18T22:24:44.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.991568+0000', 'last_change': '2024-08-18T22:24:37.991568+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.991568+0000', 'last_undegraded': '2024-08-18T22:24:37.991568+0000', 'last_fullsized': '2024-08-18T22:24:37.991568+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:24:44.937 INFO:tasks.ceph.ceph_manager.ceph:PG 14.8 is not active+clean 2024-08-18T22:24:44.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.937 INFO:tasks.ceph.ceph_manager.ceph:PG 13.b is not active+clean 2024-08-18T22:24:44.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.997105+0000', 'last_change': '2024-08-18T22:24:37.997105+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.997105+0000', 'last_undegraded': '2024-08-18T22:24:37.997105+0000', 'last_fullsized': '2024-08-18T22:24:37.997105+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:24:44.937 INFO:tasks.ceph.ceph_manager.ceph:PG 14.9 is not active+clean 2024-08-18T22:24:44.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.937 INFO:tasks.ceph.ceph_manager.ceph:PG 14.a is not active+clean 2024-08-18T22:24:44.937 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.938 INFO:tasks.ceph.ceph_manager.ceph:PG 13.9 is not active+clean 2024-08-18T22:24:44.938 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.996369+0000', 'last_change': '2024-08-18T22:24:37.996369+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.996369+0000', 'last_undegraded': '2024-08-18T22:24:37.996369+0000', 'last_fullsized': '2024-08-18T22:24:37.996369+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:24:44.938 INFO:tasks.ceph.ceph_manager.ceph:PG 14.b is not active+clean 2024-08-18T22:24:44.938 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.938 INFO:tasks.ceph.ceph_manager.ceph:PG 14.4 is not active+clean 2024-08-18T22:24:44.938 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.938 INFO:tasks.ceph.ceph_manager.ceph:PG 13.7 is not active+clean 2024-08-18T22:24:44.938 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.991638+0000', 'last_change': '2024-08-18T22:24:37.991638+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.991638+0000', 'last_undegraded': '2024-08-18T22:24:37.991638+0000', 'last_fullsized': '2024-08-18T22:24:37.991638+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:24:44.938 INFO:tasks.ceph.ceph_manager.ceph:PG 14.5 is not active+clean 2024-08-18T22:24:44.938 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.939 INFO:tasks.ceph.ceph_manager.ceph:PG 14.6 is not active+clean 2024-08-18T22:24:44.939 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.939 INFO:tasks.ceph.ceph_manager.ceph:PG 14.7 is not active+clean 2024-08-18T22:24:44.939 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.939 INFO:tasks.ceph.ceph_manager.ceph:PG 13.4 is not active+clean 2024-08-18T22:24:44.939 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.990354+0000', 'last_change': '2024-08-18T22:24:37.990354+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.990354+0000', 'last_undegraded': '2024-08-18T22:24:37.990354+0000', 'last_fullsized': '2024-08-18T22:24:37.990354+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:24:44.939 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3 is not active+clean 2024-08-18T22:24:44.939 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.995592+0000', 'last_change': '2024-08-18T22:24:37.995592+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.995592+0000', 'last_undegraded': '2024-08-18T22:24:37.995592+0000', 'last_fullsized': '2024-08-18T22:24:37.995592+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:24:44.939 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1 is not active+clean 2024-08-18T22:24:44.939 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.940 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2 is not active+clean 2024-08-18T22:24:44.940 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.996364+0000', 'last_change': '2024-08-18T22:24:37.996364+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.996364+0000', 'last_undegraded': '2024-08-18T22:24:37.996364+0000', 'last_fullsized': '2024-08-18T22:24:37.996364+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:24:44.940 INFO:tasks.ceph.ceph_manager.ceph:PG 14.2 is not active+clean 2024-08-18T22:24:44.940 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.940 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1 is not active+clean 2024-08-18T22:24:44.940 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.990347+0000', 'last_change': '2024-08-18T22:24:37.990347+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.990347+0000', 'last_undegraded': '2024-08-18T22:24:37.990347+0000', 'last_fullsized': '2024-08-18T22:24:37.990347+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:24:44.940 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3 is not active+clean 2024-08-18T22:24:44.940 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.940 INFO:tasks.ceph.ceph_manager.ceph:PG 13.0 is not active+clean 2024-08-18T22:24:44.940 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.991219+0000', 'last_change': '2024-08-18T22:24:37.991219+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.991219+0000', 'last_undegraded': '2024-08-18T22:24:37.991219+0000', 'last_fullsized': '2024-08-18T22:24:37.991219+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:24:44.941 INFO:tasks.ceph.ceph_manager.ceph:PG 14.f is not active+clean 2024-08-18T22:24:44.941 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-18T22:24:38.988461+0000', 'last_change': '2024-08-18T22:24:38.988461+0000', 'last_active': '2024-08-18T22:24:38.988461+0000', 'last_peered': '2024-08-18T22:24:38.988461+0000', 'last_clean': '2024-08-18T22:24:38.988461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:38.988461+0000', 'last_undegraded': '2024-08-18T22:24:38.988461+0000', 'last_fullsized': '2024-08-18T22:24:38.988461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:38.988461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-18T22:24:44.941 INFO:tasks.ceph.ceph_manager.ceph:PG 13.c is not active+clean 2024-08-18T22:24:44.941 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:24:37.996188+0000', 'last_change': '2024-08-18T22:24:37.996188+0000', 'last_active': '2024-08-18T22:24:37.980641+0000', 'last_peered': '2024-08-18T22:24:37.980641+0000', 'last_clean': '2024-08-18T22:24:37.980641+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:24:37.996188+0000', 'last_undegraded': '2024-08-18T22:24:37.996188+0000', 'last_fullsized': '2024-08-18T22:24:37.996188+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'last_clean_scrub_stamp': '2024-08-18T22:24:37.980641+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:24:44.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:24:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.109+0000 7fb175800640 1 Processor -- start 2024-08-18T22:24:45.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.109+0000 7fb175800640 1 -- start start 2024-08-18T22:24:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.109+0000 7fb175800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 0x7fb17006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb175800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb1700cee40 0x7fb1700ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb175800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb17015e840 con 0x7fb1700ca3e0 2024-08-18T22:24:45.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb175800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb17006c900 con 0x7fb1700cee40 2024-08-18T22:24:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb175800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb1700cf320 con 0x7fb17015e460 2024-08-18T22:24:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb16ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 0x7fb17006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb16e000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb1700cee40 0x7fb1700ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb16ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 0x7fb17006c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:53252/0 (socket says 172.21.15.5:53252) 2024-08-18T22:24:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb16ea00640 1 -- 172.21.15.5:0/2754726833 learned_addr learned my addr 172.21.15.5:0/2754726833 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb16ea00640 1 -- 172.21.15.5:0/2754726833 >> v2:172.21.15.117:3300/0 conn(0x7fb1700cee40 msgr2=0x7fb1700ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb16ea00640 1 --2- 172.21.15.5:0/2754726833 >> v2:172.21.15.117:3300/0 conn(0x7fb1700cee40 0x7fb1700ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb16ea00640 1 -- 172.21.15.5:0/2754726833 >> v1:172.21.15.117:6789/0 conn(0x7fb1700ca3e0 legacy=0x7fb1700d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb16ea00640 1 -- 172.21.15.5:0/2754726833 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1700cf600 con 0x7fb17015e460 2024-08-18T22:24:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb16d600640 1 -- 172.21.15.5:0/2754726833 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091176263 0 0) 0x7fb17015e840 con 0x7fb1700ca3e0 2024-08-18T22:24:45.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb16e000640 1 --2- 172.21.15.5:0/2754726833 >> v2:172.21.15.117:3300/0 conn(0x7fb1700cee40 0x7fb1700ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.113+0000 7fb16ea00640 1 --2- 172.21.15.5:0/2754726833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 0x7fb17006c3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb160009870 tx=0x7fb16001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16fc50a0c2320ac5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb16d600640 1 -- 172.21.15.5:0/2754726833 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1600b5070 con 0x7fb17015e460 2024-08-18T22:24:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb16d600640 1 -- 172.21.15.5:0/2754726833 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1600a8a50 con 0x7fb17015e460 2024-08-18T22:24:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb16d600640 1 -- 172.21.15.5:0/2754726833 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1600a8e20 con 0x7fb17015e460 2024-08-18T22:24:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 -- 172.21.15.5:0/2754726833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 msgr2=0x7fb17006c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 --2- 172.21.15.5:0/2754726833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 0x7fb17006c3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb160009870 tx=0x7fb16001ed50 comp rx=0 tx=0).stop 2024-08-18T22:24:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 -- 172.21.15.5:0/2754726833 shutdown_connections 2024-08-18T22:24:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 --2- 172.21.15.5:0/2754726833 >> v2:172.21.15.117:3300/0 conn(0x7fb1700cee40 0x7fb1700ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 --2- 172.21.15.5:0/2754726833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 0x7fb17006c3c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 -- 172.21.15.5:0/2754726833 >> 172.21.15.5:0/2754726833 conn(0x7fb17009aa40 msgr2=0x7fb1700b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 -- 172.21.15.5:0/2754726833 shutdown_connections 2024-08-18T22:24:45.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 -- 172.21.15.5:0/2754726833 wait complete. 2024-08-18T22:24:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 Processor -- start 2024-08-18T22:24:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 -- start start 2024-08-18T22:24:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1700ca3e0 0x7fb1700b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1700cee40 0x7fb1701f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 0x7fb1701f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700cfea0 con 0x7fb1700cee40 2024-08-18T22:24:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700cfbc0 con 0x7fb1700ca3e0 2024-08-18T22:24:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb175800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb1700b3620 con 0x7fb17015e460 2024-08-18T22:24:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb16e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1700cee40 0x7fb1701f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb16e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1700cee40 0x7fb1701f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53554/0 (socket says 172.21.15.5:53554) 2024-08-18T22:24:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.117+0000 7fb16e000640 1 -- 172.21.15.5:0/1400621625 learned_addr learned my addr 172.21.15.5:0/1400621625 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb16ea00640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1700ca3e0 0x7fb1700b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb16f400640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 0x7fb1701f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb16e000640 1 -- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 msgr2=0x7fb1701f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb16e000640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 0x7fb1701f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb16e000640 1 -- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1700ca3e0 msgr2=0x7fb1700b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb16e000640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1700ca3e0 0x7fb1700b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb16e000640 1 -- 172.21.15.5:0/1400621625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1700b41e0 con 0x7fb1700cee40 2024-08-18T22:24:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb16e000640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1700cee40 0x7fb1701f7420 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00e9b0 tx=0x7fb15c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb166a00640 1 -- 172.21.15.5:0/1400621625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c017070 con 0x7fb1700cee40 2024-08-18T22:24:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb166a00640 1 -- 172.21.15.5:0/1400621625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15c00ca00 con 0x7fb1700cee40 2024-08-18T22:24:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb175800640 1 -- 172.21.15.5:0/1400621625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb170160a50 con 0x7fb1700cee40 2024-08-18T22:24:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb166a00640 1 -- 172.21.15.5:0/1400621625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00cdb0 con 0x7fb1700cee40 2024-08-18T22:24:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb175800640 1 -- 172.21.15.5:0/1400621625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb170161010 con 0x7fb1700cee40 2024-08-18T22:24:45.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb175800640 1 -- 172.21.15.5:0/1400621625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb170161210 con 0x7fb1700cee40 2024-08-18T22:24:45.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb166a00640 1 -- 172.21.15.5:0/1400621625 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb15c01a070 con 0x7fb1700cee40 2024-08-18T22:24:45.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb166a00640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1500678c0 0x7fb150069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.121+0000 7fb166a00640 1 -- 172.21.15.5:0/1400621625 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fb15c085bd0 con 0x7fb1700cee40 2024-08-18T22:24:45.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.125+0000 7fb16ea00640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1500678c0 0x7fb150069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.125+0000 7fb16ea00640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1500678c0 0x7fb150069d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb1600b2000 tx=0x7fb1600aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:45.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.125+0000 7fb166a00640 1 -- 172.21.15.5:0/1400621625 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb15c055fc0 con 0x7fb1700cee40 2024-08-18T22:24:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.349+0000 7fb175800640 1 -- 172.21.15.5:0/1400621625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb17006c3c0 con 0x7fb1700cee40 2024-08-18T22:24:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.349+0000 7fb166a00640 1 -- 172.21.15.5:0/1400621625 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1764 (secure 0 0 0) 0x7fb15c05a2c0 con 0x7fb1700cee40 2024-08-18T22:24:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:45.351 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":348,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":97,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":46},{"state_name":"active+clean","count":27},{"state_name":"creating+peering","count":24}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590528,"bytes_used":317030400,"bytes_avail":772777082880,"bytes_total":773094113280,"unknown_pgs_ratio":0.47422680258750916,"inactive_pgs_ratio":0.24742268025875092,"write_bytes_sec":358,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":72,"btime":"2024-08-18T22:24:43:020654+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7242}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-08-18T22:24:29.695867+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:24:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 -- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1500678c0 msgr2=0x7fb150069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1500678c0 0x7fb150069d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb1600b2000 tx=0x7fb1600aa070 comp rx=0 tx=0).stop 2024-08-18T22:24:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 -- 172.21.15.5:0/1400621625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1700cee40 msgr2=0x7fb1701f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1700cee40 0x7fb1701f7420 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00e9b0 tx=0x7fb15c00ee70 comp rx=0 tx=0).stop 2024-08-18T22:24:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 -- 172.21.15.5:0/1400621625 shutdown_connections 2024-08-18T22:24:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb1500678c0 0x7fb150069d80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb17015e460 0x7fb1701f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1700cee40 0x7fb1701f7420 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 --2- 172.21.15.5:0/1400621625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1700ca3e0 0x7fb1700b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 -- 172.21.15.5:0/1400621625 >> 172.21.15.5:0/1400621625 conn(0x7fb17009aa40 msgr2=0x7fb1700b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 -- 172.21.15.5:0/1400621625 shutdown_connections 2024-08-18T22:24:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.353+0000 7fb175800640 1 -- 172.21.15.5:0/1400621625 wait complete. 2024-08-18T22:24:45.373 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-18T22:24:45.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:24:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ea00640 1 Processor -- start 2024-08-18T22:24:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ea00640 1 -- start start 2024-08-18T22:24:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16181618d0 0x7f161815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16180c92d0 0x7f16180c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ea00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1618162300 con 0x7f1618161d40 2024-08-18T22:24:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ea00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f16180c9c80 con 0x7f16180c92d0 2024-08-18T22:24:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f16181625e0 con 0x7f16181618d0 2024-08-18T22:24:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16180c92d0 0x7f16180c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16180c92d0 0x7f16180c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53564/0 (socket says 172.21.15.5:53564) 2024-08-18T22:24:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ca00640 1 -- 172.21.15.5:0/4209568868 learned_addr learned my addr 172.21.15.5:0/4209568868 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f1617e00640 1 --2- 172.21.15.5:0/4209568868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16181618d0 0x7f161815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ca00640 1 -- 172.21.15.5:0/4209568868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16181618d0 msgr2=0x7f161815f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ca00640 1 --2- 172.21.15.5:0/4209568868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16181618d0 0x7f161815f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ca00640 1 -- 172.21.15.5:0/4209568868 >> v1:172.21.15.5:6789/0 conn(0x7f1618161d40 legacy=0x7f161815f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f1616a00640 1 -- 172.21.15.5:0/4209568868 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1724085635 0 0) 0x7f1618162300 con 0x7f1618161d40 2024-08-18T22:24:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f161ca00640 1 -- 172.21.15.5:0/4209568868 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16181628c0 con 0x7f16180c92d0 2024-08-18T22:24:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.513+0000 7f1617e00640 1 --2- 172.21.15.5:0/4209568868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16181618d0 0x7f161815f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f161ca00640 1 --2- 172.21.15.5:0/4209568868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16180c92d0 0x7f16180c9740 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f1610009e50 tx=0x7f161001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd315d1c3324924 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f1616a00640 1 -- 172.21.15.5:0/4209568868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16100a5700 con 0x7f16180c92d0 2024-08-18T22:24:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f1616a00640 1 -- 172.21.15.5:0/4209568868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16100a58a0 con 0x7f16180c92d0 2024-08-18T22:24:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f1616a00640 1 -- 172.21.15.5:0/4209568868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16100a5c70 con 0x7f16180c92d0 2024-08-18T22:24:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f161ea00640 1 -- 172.21.15.5:0/4209568868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16180c92d0 msgr2=0x7f16180c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f161ea00640 1 --2- 172.21.15.5:0/4209568868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16180c92d0 0x7f16180c9740 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f1610009e50 tx=0x7f161001ca30 comp rx=0 tx=0).stop 2024-08-18T22:24:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f161ea00640 1 -- 172.21.15.5:0/4209568868 shutdown_connections 2024-08-18T22:24:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f161ea00640 1 --2- 172.21.15.5:0/4209568868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16180c92d0 0x7f16180c9740 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f161ea00640 1 --2- 172.21.15.5:0/4209568868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16181618d0 0x7f161815f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f161ea00640 1 -- 172.21.15.5:0/4209568868 >> 172.21.15.5:0/4209568868 conn(0x7f16180b1c50 msgr2=0x7f16180b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f161ea00640 1 -- 172.21.15.5:0/4209568868 shutdown_connections 2024-08-18T22:24:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.517+0000 7f161ea00640 1 -- 172.21.15.5:0/4209568868 wait complete. 2024-08-18T22:24:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ea00640 1 Processor -- start 2024-08-18T22:24:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ea00640 1 -- start start 2024-08-18T22:24:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16180c92d0 0x7f1618152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16181618d0 0x7f161815c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1618161d40 0x7f161815db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ea00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f161816b0e0 con 0x7f16181618d0 2024-08-18T22:24:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ea00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16180cf2c0 con 0x7f1618161d40 2024-08-18T22:24:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f161816b260 con 0x7f16180c92d0 2024-08-18T22:24:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f1617400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16181618d0 0x7f161815c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f1617400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16181618d0 0x7f161815c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53574/0 (socket says 172.21.15.5:53574) 2024-08-18T22:24:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f1617400640 1 -- 172.21.15.5:0/3211911320 learned_addr learned my addr 172.21.15.5:0/3211911320 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ca00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1618161d40 0x7f161815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f1617e00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16180c92d0 0x7f1618152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f1617400640 1 -- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16180c92d0 msgr2=0x7f1618152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f1617400640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16180c92d0 0x7f1618152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f1617400640 1 -- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1618161d40 msgr2=0x7f161815db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f1617400640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1618161d40 0x7f161815db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f1617400640 1 -- 172.21.15.5:0/3211911320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161815c5a0 con 0x7f16181618d0 2024-08-18T22:24:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f1617e00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16180c92d0 0x7f1618152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f1617400640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16181618d0 0x7f161815c060 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f160400c550 tx=0x7f160400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f160fe00640 1 -- 172.21.15.5:0/3211911320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1604017070 con 0x7f16181618d0 2024-08-18T22:24:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f160fe00640 1 -- 172.21.15.5:0/3211911320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1604003600 con 0x7f16181618d0 2024-08-18T22:24:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ea00640 1 -- 172.21.15.5:0/3211911320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1618156f30 con 0x7f16181618d0 2024-08-18T22:24:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f160fe00640 1 -- 172.21.15.5:0/3211911320 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16040039f0 con 0x7f16181618d0 2024-08-18T22:24:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ea00640 1 -- 172.21.15.5:0/3211911320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16181571d0 con 0x7f16181618d0 2024-08-18T22:24:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.521+0000 7f161ea00640 1 -- 172.21.15.5:0/3211911320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16180c9740 con 0x7f16181618d0 2024-08-18T22:24:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.525+0000 7f160fe00640 1 -- 172.21.15.5:0/3211911320 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f160401a070 con 0x7f16181618d0 2024-08-18T22:24:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.525+0000 7f160fe00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15f80678c0 0x7f15f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.525+0000 7f160fe00640 1 -- 172.21.15.5:0/3211911320 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f16040851d0 con 0x7f16181618d0 2024-08-18T22:24:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.525+0000 7f1617e00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15f80678c0 0x7f15f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.525+0000 7f1617e00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15f80678c0 0x7f15f8069d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1608006fd0 tx=0x7f1608008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.529+0000 7f160fe00640 1 -- 172.21.15.5:0/3211911320 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1604055520 con 0x7f16181618d0 2024-08-18T22:24:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.697+0000 7f161ea00640 1 -- 172.21.15.5:0/3211911320 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1618152f60 con 0x7f15f80678c0 2024-08-18T22:24:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.701+0000 7f160fe00640 1 -- 172.21.15.5:0/3211911320 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243362 (secure 0 0 0) 0x7f1618152f60 con 0x7f15f80678c0 2024-08-18T22:24:45.705 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:24:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 -- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15f80678c0 msgr2=0x7f15f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15f80678c0 0x7f15f8069d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1608006fd0 tx=0x7f1608008040 comp rx=0 tx=0).stop 2024-08-18T22:24:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 -- 172.21.15.5:0/3211911320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16181618d0 msgr2=0x7f161815c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16181618d0 0x7f161815c060 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f160400c550 tx=0x7f160400ca10 comp rx=0 tx=0).stop 2024-08-18T22:24:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 -- 172.21.15.5:0/3211911320 shutdown_connections 2024-08-18T22:24:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f15f80678c0 0x7f15f8069d80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1618161d40 0x7f161815db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16181618d0 0x7f161815c060 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 --2- 172.21.15.5:0/3211911320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16180c92d0 0x7f1618152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 -- 172.21.15.5:0/3211911320 >> 172.21.15.5:0/3211911320 conn(0x7f16180b1c50 msgr2=0x7f16180b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 -- 172.21.15.5:0/3211911320 shutdown_connections 2024-08-18T22:24:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:45.705+0000 7f161ea00640 1 -- 172.21.15.5:0/3211911320 wait complete. 2024-08-18T22:24:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-08-18T22:24:43.699418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":164,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309600,"kb_used_data":10196,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754665120,"statfs":{"total":773094113280,"available":772777082880,"internally_reserved":0,"allocated":10440704,"data_stored":5453651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.711146"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022551+0000","last_change":"2024-08-18T22:24:40.016890+0000","last_active":"2024-08-18T22:24:40.022551+0000","last_peered":"2024-08-18T22:24:40.022551+0000","last_clean":"2024-08-18T22:24:40.022551+0000","last_became_active":"2024-08-18T22:24:40.016624+0000","last_became_peered":"2024-08-18T22:24:40.016624+0000","last_unstale":"2024-08-18T22:24:40.022551+0000","last_undegraded":"2024-08-18T22:24:40.022551+0000","last_fullsized":"2024-08-18T22:24:40.022551+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:41:24.595641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022923+0000","last_change":"2024-08-18T22:24:40.020616+0000","last_active":"2024-08-18T22:24:40.022923+0000","last_peered":"2024-08-18T22:24:40.022923+0000","last_clean":"2024-08-18T22:24:40.022923+0000","last_became_active":"2024-08-18T22:24:40.020258+0000","last_became_peered":"2024-08-18T22:24:40.020258+0000","last_unstale":"2024-08-18T22:24:40.022923+0000","last_undegraded":"2024-08-18T22:24:40.022923+0000","last_fullsized":"2024-08-18T22:24:40.022923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:11.395179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.033562+0000","last_change":"2024-08-18T22:24:40.028865+0000","last_active":"2024-08-18T22:24:40.033562+0000","last_peered":"2024-08-18T22:24:40.033562+0000","last_clean":"2024-08-18T22:24:40.033562+0000","last_became_active":"2024-08-18T22:24:40.028545+0000","last_became_peered":"2024-08-18T22:24:40.028545+0000","last_unstale":"2024-08-18T22:24:40.033562+0000","last_undegraded":"2024-08-18T22:24:40.033562+0000","last_fullsized":"2024-08-18T22:24:40.033562+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:57.967896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.018444+0000","last_change":"2024-08-18T22:24:40.014360+0000","last_active":"2024-08-18T22:24:40.018444+0000","last_peered":"2024-08-18T22:24:40.018444+0000","last_clean":"2024-08-18T22:24:40.018444+0000","last_became_active":"2024-08-18T22:24:40.014017+0000","last_became_peered":"2024-08-18T22:24:40.014017+0000","last_unstale":"2024-08-18T22:24:40.018444+0000","last_undegraded":"2024-08-18T22:24:40.018444+0000","last_fullsized":"2024-08-18T22:24:40.018444+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:19:07.605988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.031405+0000","last_change":"2024-08-18T22:24:40.020506+0000","last_active":"2024-08-18T22:24:40.031405+0000","last_peered":"2024-08-18T22:24:40.031405+0000","last_clean":"2024-08-18T22:24:40.031405+0000","last_became_active":"2024-08-18T22:24:40.020225+0000","last_became_peered":"2024-08-18T22:24:40.020225+0000","last_unstale":"2024-08-18T22:24:40.031405+0000","last_undegraded":"2024-08-18T22:24:40.031405+0000","last_fullsized":"2024-08-18T22:24:40.031405+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:28:17.070010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035507+0000","last_change":"2024-08-18T22:24:40.032145+0000","last_active":"2024-08-18T22:24:40.035507+0000","last_peered":"2024-08-18T22:24:40.035507+0000","last_clean":"2024-08-18T22:24:40.035507+0000","last_became_active":"2024-08-18T22:24:40.031866+0000","last_became_peered":"2024-08-18T22:24:40.031866+0000","last_unstale":"2024-08-18T22:24:40.035507+0000","last_undegraded":"2024-08-18T22:24:40.035507+0000","last_fullsized":"2024-08-18T22:24:40.035507+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:06:57.730808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.032492+0000","last_change":"2024-08-18T22:24:40.027430+0000","last_active":"2024-08-18T22:24:40.032492+0000","last_peered":"2024-08-18T22:24:40.032492+0000","last_clean":"2024-08-18T22:24:40.032492+0000","last_became_active":"2024-08-18T22:24:40.027160+0000","last_became_peered":"2024-08-18T22:24:40.027160+0000","last_unstale":"2024-08-18T22:24:40.032492+0000","last_undegraded":"2024-08-18T22:24:40.032492+0000","last_fullsized":"2024-08-18T22:24:40.032492+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:58.084319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022530+0000","last_change":"2024-08-18T22:24:40.016741+0000","last_active":"2024-08-18T22:24:40.022530+0000","last_peered":"2024-08-18T22:24:40.022530+0000","last_clean":"2024-08-18T22:24:40.022530+0000","last_became_active":"2024-08-18T22:24:40.016175+0000","last_became_peered":"2024-08-18T22:24:40.016175+0000","last_unstale":"2024-08-18T22:24:40.022530+0000","last_undegraded":"2024-08-18T22:24:40.022530+0000","last_fullsized":"2024-08-18T22:24:40.022530+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:37.399428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035486+0000","last_change":"2024-08-18T22:24:40.031981+0000","last_active":"2024-08-18T22:24:40.035486+0000","last_peered":"2024-08-18T22:24:40.035486+0000","last_clean":"2024-08-18T22:24:40.035486+0000","last_became_active":"2024-08-18T22:24:40.031692+0000","last_became_peered":"2024-08-18T22:24:40.031692+0000","last_unstale":"2024-08-18T22:24:40.035486+0000","last_undegraded":"2024-08-18T22:24:40.035486+0000","last_fullsized":"2024-08-18T22:24:40.035486+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:41.451094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.031162+0000","last_change":"2024-08-18T22:24:40.028117+0000","last_active":"2024-08-18T22:24:40.031162+0000","last_peered":"2024-08-18T22:24:40.031162+0000","last_clean":"2024-08-18T22:24:40.031162+0000","last_became_active":"2024-08-18T22:24:40.027844+0000","last_became_peered":"2024-08-18T22:24:40.027844+0000","last_unstale":"2024-08-18T22:24:40.031162+0000","last_undegraded":"2024-08-18T22:24:40.031162+0000","last_fullsized":"2024-08-18T22:24:40.031162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:19:28.332247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.021634+0000","last_change":"2024-08-18T22:24:40.013826+0000","last_active":"2024-08-18T22:24:40.021634+0000","last_peered":"2024-08-18T22:24:40.021634+0000","last_clean":"2024-08-18T22:24:40.021634+0000","last_became_active":"2024-08-18T22:24:40.011508+0000","last_became_peered":"2024-08-18T22:24:40.011508+0000","last_unstale":"2024-08-18T22:24:40.021634+0000","last_undegraded":"2024-08-18T22:24:40.021634+0000","last_fullsized":"2024-08-18T22:24:40.021634+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:20:06.666487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022955+0000","last_change":"2024-08-18T22:24:40.021109+0000","last_active":"2024-08-18T22:24:40.022955+0000","last_peered":"2024-08-18T22:24:40.022955+0000","last_clean":"2024-08-18T22:24:40.022955+0000","last_became_active":"2024-08-18T22:24:40.020810+0000","last_became_peered":"2024-08-18T22:24:40.020810+0000","last_unstale":"2024-08-18T22:24:40.022955+0000","last_undegraded":"2024-08-18T22:24:40.022955+0000","last_fullsized":"2024-08-18T22:24:40.022955+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:32:35.090221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990989+0000","last_change":"2024-08-18T22:24:37.990989+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990989+0000","last_undegraded":"2024-08-18T22:24:37.990989+0000","last_fullsized":"2024-08-18T22:24:37.990989+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.033242+0000","last_change":"2024-08-18T22:24:39.012924+0000","last_active":"2024-08-18T22:24:40.033242+0000","last_peered":"2024-08-18T22:24:40.033242+0000","last_clean":"2024-08-18T22:24:40.033242+0000","last_became_active":"2024-08-18T22:24:39.012605+0000","last_became_peered":"2024-08-18T22:24:39.012605+0000","last_unstale":"2024-08-18T22:24:40.033242+0000","last_undegraded":"2024-08-18T22:24:40.033242+0000","last_fullsized":"2024-08-18T22:24:40.033242+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:45.539213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.992059+0000","last_change":"2024-08-18T22:24:37.992059+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.992059+0000","last_undegraded":"2024-08-18T22:24:37.992059+0000","last_fullsized":"2024-08-18T22:24:37.992059+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990927+0000","last_change":"2024-08-18T22:24:37.990927+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990927+0000","last_undegraded":"2024-08-18T22:24:37.990927+0000","last_fullsized":"2024-08-18T22:24:37.990927+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.034212+0000","last_change":"2024-08-18T22:24:39.017797+0000","last_active":"2024-08-18T22:24:40.034212+0000","last_peered":"2024-08-18T22:24:40.034212+0000","last_clean":"2024-08-18T22:24:40.034212+0000","last_became_active":"2024-08-18T22:24:39.017473+0000","last_became_peered":"2024-08-18T22:24:39.017473+0000","last_unstale":"2024-08-18T22:24:40.034212+0000","last_undegraded":"2024-08-18T22:24:40.034212+0000","last_fullsized":"2024-08-18T22:24:40.034212+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:03:37.813619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995694+0000","last_change":"2024-08-18T22:24:37.995694+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995694+0000","last_undegraded":"2024-08-18T22:24:37.995694+0000","last_fullsized":"2024-08-18T22:24:37.995694+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:38.000038+0000","last_change":"2024-08-18T22:24:38.000038+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.000038+0000","last_undegraded":"2024-08-18T22:24:38.000038+0000","last_fullsized":"2024-08-18T22:24:38.000038+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991887+0000","last_change":"2024-08-18T22:24:37.991887+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991887+0000","last_undegraded":"2024-08-18T22:24:37.991887+0000","last_fullsized":"2024-08-18T22:24:37.991887+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.029145+0000","last_change":"2024-08-18T22:24:40.024058+0000","last_active":"2024-08-18T22:24:40.029145+0000","last_peered":"2024-08-18T22:24:40.029145+0000","last_clean":"2024-08-18T22:24:40.029145+0000","last_became_active":"2024-08-18T22:24:40.023645+0000","last_became_peered":"2024-08-18T22:24:40.023645+0000","last_unstale":"2024-08-18T22:24:40.029145+0000","last_undegraded":"2024-08-18T22:24:40.029145+0000","last_fullsized":"2024-08-18T22:24:40.029145+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:22.381723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.997531+0000","last_change":"2024-08-18T22:24:37.997531+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.997531+0000","last_undegraded":"2024-08-18T22:24:37.997531+0000","last_fullsized":"2024-08-18T22:24:37.997531+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:38.000053+0000","last_change":"2024-08-18T22:24:38.000053+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.000053+0000","last_undegraded":"2024-08-18T22:24:38.000053+0000","last_fullsized":"2024-08-18T22:24:38.000053+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"96'3","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.042941+0000","last_change":"2024-08-18T22:24:39.014524+0000","last_active":"2024-08-18T22:24:40.042941+0000","last_peered":"2024-08-18T22:24:40.042941+0000","last_clean":"2024-08-18T22:24:40.042941+0000","last_became_active":"2024-08-18T22:24:39.014226+0000","last_became_peered":"2024-08-18T22:24:39.014226+0000","last_unstale":"2024-08-18T22:24:40.042941+0000","last_undegraded":"2024-08-18T22:24:40.042941+0000","last_fullsized":"2024-08-18T22:24:40.042941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:20:26.559799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.994780+0000","last_change":"2024-08-18T22:24:37.994780+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.994780+0000","last_undegraded":"2024-08-18T22:24:37.994780+0000","last_fullsized":"2024-08-18T22:24:37.994780+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991232+0000","last_change":"2024-08-18T22:24:37.991232+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991232+0000","last_undegraded":"2024-08-18T22:24:37.991232+0000","last_fullsized":"2024-08-18T22:24:37.991232+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.022552+0000","last_change":"2024-08-18T22:24:40.014669+0000","last_active":"2024-08-18T22:24:40.022552+0000","last_peered":"2024-08-18T22:24:40.022552+0000","last_clean":"2024-08-18T22:24:40.022552+0000","last_became_active":"2024-08-18T22:24:40.014366+0000","last_became_peered":"2024-08-18T22:24:40.014366+0000","last_unstale":"2024-08-18T22:24:40.022552+0000","last_undegraded":"2024-08-18T22:24:40.022552+0000","last_fullsized":"2024-08-18T22:24:40.022552+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:00.803298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.994852+0000","last_change":"2024-08-18T22:24:37.994852+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.994852+0000","last_undegraded":"2024-08-18T22:24:37.994852+0000","last_fullsized":"2024-08-18T22:24:37.994852+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.035788+0000","last_change":"2024-08-18T22:24:40.032806+0000","last_active":"2024-08-18T22:24:40.035788+0000","last_peered":"2024-08-18T22:24:40.035788+0000","last_clean":"2024-08-18T22:24:40.035788+0000","last_became_active":"2024-08-18T22:24:40.032402+0000","last_became_peered":"2024-08-18T22:24:40.032402+0000","last_unstale":"2024-08-18T22:24:40.035788+0000","last_undegraded":"2024-08-18T22:24:40.035788+0000","last_fullsized":"2024-08-18T22:24:40.035788+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:48.336063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996218+0000","last_change":"2024-08-18T22:24:37.996218+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996218+0000","last_undegraded":"2024-08-18T22:24:37.996218+0000","last_fullsized":"2024-08-18T22:24:37.996218+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.030155+0000","last_change":"2024-08-18T22:24:40.019334+0000","last_active":"2024-08-18T22:24:40.030155+0000","last_peered":"2024-08-18T22:24:40.030155+0000","last_clean":"2024-08-18T22:24:40.030155+0000","last_became_active":"2024-08-18T22:24:40.019013+0000","last_became_peered":"2024-08-18T22:24:40.019013+0000","last_unstale":"2024-08-18T22:24:40.030155+0000","last_undegraded":"2024-08-18T22:24:40.030155+0000","last_fullsized":"2024-08-18T22:24:40.030155+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:44.403615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995608+0000","last_change":"2024-08-18T22:24:37.995608+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995608+0000","last_undegraded":"2024-08-18T22:24:37.995608+0000","last_fullsized":"2024-08-18T22:24:37.995608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990388+0000","last_change":"2024-08-18T22:24:37.990388+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990388+0000","last_undegraded":"2024-08-18T22:24:37.990388+0000","last_fullsized":"2024-08-18T22:24:37.990388+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991568+0000","last_change":"2024-08-18T22:24:37.991568+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991568+0000","last_undegraded":"2024-08-18T22:24:37.991568+0000","last_fullsized":"2024-08-18T22:24:37.991568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.013978+0000","last_change":"2024-08-18T22:24:40.008819+0000","last_active":"2024-08-18T22:24:40.013978+0000","last_peered":"2024-08-18T22:24:40.013978+0000","last_clean":"2024-08-18T22:24:40.013978+0000","last_became_active":"2024-08-18T22:24:40.008536+0000","last_became_peered":"2024-08-18T22:24:40.008536+0000","last_unstale":"2024-08-18T22:24:40.013978+0000","last_undegraded":"2024-08-18T22:24:40.013978+0000","last_fullsized":"2024-08-18T22:24:40.013978+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:22:53.584195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"96'1","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.036751+0000","last_change":"2024-08-18T22:24:39.018385+0000","last_active":"2024-08-18T22:24:40.036751+0000","last_peered":"2024-08-18T22:24:40.036751+0000","last_clean":"2024-08-18T22:24:40.036751+0000","last_became_active":"2024-08-18T22:24:39.018097+0000","last_became_peered":"2024-08-18T22:24:39.018097+0000","last_unstale":"2024-08-18T22:24:40.036751+0000","last_undegraded":"2024-08-18T22:24:40.036751+0000","last_fullsized":"2024-08-18T22:24:40.036751+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:52:43.228773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.997105+0000","last_change":"2024-08-18T22:24:37.997105+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.997105+0000","last_undegraded":"2024-08-18T22:24:37.997105+0000","last_fullsized":"2024-08-18T22:24:37.997105+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.004284+0000","last_change":"2024-08-18T22:24:39.018757+0000","last_active":"2024-08-18T22:24:40.004284+0000","last_peered":"2024-08-18T22:24:40.004284+0000","last_clean":"2024-08-18T22:24:40.004284+0000","last_became_active":"2024-08-18T22:24:39.018297+0000","last_became_peered":"2024-08-18T22:24:39.018297+0000","last_unstale":"2024-08-18T22:24:40.004284+0000","last_undegraded":"2024-08-18T22:24:40.004284+0000","last_fullsized":"2024-08-18T22:24:40.004284+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:51:06.563873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996369+0000","last_change":"2024-08-18T22:24:37.996369+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996369+0000","last_undegraded":"2024-08-18T22:24:37.996369+0000","last_fullsized":"2024-08-18T22:24:37.996369+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.003853+0000","last_change":"2024-08-18T22:24:39.015304+0000","last_active":"2024-08-18T22:24:40.003853+0000","last_peered":"2024-08-18T22:24:40.003853+0000","last_clean":"2024-08-18T22:24:40.003853+0000","last_became_active":"2024-08-18T22:24:39.015013+0000","last_became_peered":"2024-08-18T22:24:39.015013+0000","last_unstale":"2024-08-18T22:24:40.003853+0000","last_undegraded":"2024-08-18T22:24:40.003853+0000","last_fullsized":"2024-08-18T22:24:40.003853+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:34.344259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991638+0000","last_change":"2024-08-18T22:24:37.991638+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991638+0000","last_undegraded":"2024-08-18T22:24:37.991638+0000","last_fullsized":"2024-08-18T22:24:37.991638+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.004328+0000","last_change":"2024-08-18T22:24:39.015360+0000","last_active":"2024-08-18T22:24:40.004328+0000","last_peered":"2024-08-18T22:24:40.004328+0000","last_clean":"2024-08-18T22:24:40.004328+0000","last_became_active":"2024-08-18T22:24:39.014376+0000","last_became_peered":"2024-08-18T22:24:39.014376+0000","last_unstale":"2024-08-18T22:24:40.004328+0000","last_undegraded":"2024-08-18T22:24:40.004328+0000","last_fullsized":"2024-08-18T22:24:40.004328+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:29.351930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.005116+0000","last_change":"2024-08-18T22:24:39.014437+0000","last_active":"2024-08-18T22:24:40.005116+0000","last_peered":"2024-08-18T22:24:40.005116+0000","last_clean":"2024-08-18T22:24:40.005116+0000","last_became_active":"2024-08-18T22:24:39.014115+0000","last_became_peered":"2024-08-18T22:24:39.014115+0000","last_unstale":"2024-08-18T22:24:40.005116+0000","last_undegraded":"2024-08-18T22:24:40.005116+0000","last_fullsized":"2024-08-18T22:24:40.005116+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:07.433459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990354+0000","last_change":"2024-08-18T22:24:37.990354+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990354+0000","last_undegraded":"2024-08-18T22:24:37.990354+0000","last_fullsized":"2024-08-18T22:24:37.990354+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-08-18T22:24:40.026280+0000","last_change":"2024-08-18T22:24:40.017509+0000","last_active":"2024-08-18T22:24:40.026280+0000","last_peered":"2024-08-18T22:24:40.026280+0000","last_clean":"2024-08-18T22:24:40.026280+0000","last_became_active":"2024-08-18T22:24:40.017236+0000","last_became_peered":"2024-08-18T22:24:40.017236+0000","last_unstale":"2024-08-18T22:24:40.026280+0000","last_undegraded":"2024-08-18T22:24:40.026280+0000","last_fullsized":"2024-08-18T22:24:40.026280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:11:57.184672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.995592+0000","last_change":"2024-08-18T22:24:37.995592+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.995592+0000","last_undegraded":"2024-08-18T22:24:37.995592+0000","last_fullsized":"2024-08-18T22:24:37.995592+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996364+0000","last_change":"2024-08-18T22:24:37.996364+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996364+0000","last_undegraded":"2024-08-18T22:24:37.996364+0000","last_fullsized":"2024-08-18T22:24:37.996364+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.990347+0000","last_change":"2024-08-18T22:24:37.990347+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.990347+0000","last_undegraded":"2024-08-18T22:24:37.990347+0000","last_fullsized":"2024-08-18T22:24:37.990347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.991219+0000","last_change":"2024-08-18T22:24:37.991219+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.991219+0000","last_undegraded":"2024-08-18T22:24:37.991219+0000","last_fullsized":"2024-08-18T22:24:37.991219+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-18T22:24:38.988461+0000","last_change":"2024-08-18T22:24:38.988461+0000","last_active":"2024-08-18T22:24:38.988461+0000","last_peered":"2024-08-18T22:24:38.988461+0000","last_clean":"2024-08-18T22:24:38.988461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:38.988461+0000","last_undegraded":"2024-08-18T22:24:38.988461+0000","last_fullsized":"2024-08-18T22:24:38.988461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-08-18T22:24:37.996188+0000","last_change":"2024-08-18T22:24:37.996188+0000","last_active":"2024-08-18T22:24:37.980641+0000","last_peered":"2024-08-18T22:24:37.980641+0000","last_clean":"2024-08-18T22:24:37.980641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:24:37.996188+0000","last_undegraded":"2024-08-18T22:24:37.996188+0000","last_fullsized":"2024-08-18T22:24:37.996188+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":318,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-08-18T22:24:37.992561+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:24:37.992561+0000","last_peered":"2024-08-18T22:24:37.992561+0000","last_clean":"2024-08-18T22:24:37.992561+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:24:37.992561+0000","last_undegraded":"2024-08-18T22:24:37.992561+0000","last_fullsized":"2024-08-18T22:24:37.992561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334780,"statfs":{"total":96636764160,"available":96598814720,"internally_reserved":0,"allocated":1744896,"data_stored":1121780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36464,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335376,"statfs":{"total":96636764160,"available":96599425024,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40624,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331216,"statfs":{"total":96636764160,"available":96595165184,"internally_reserved":0,"allocated":1150976,"data_stored":531412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40616,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331224,"statfs":{"total":96636764160,"available":96595173376,"internally_reserved":0,"allocated":1138688,"data_stored":525203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41208,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330632,"statfs":{"total":96636764160,"available":96594567168,"internally_reserved":0,"allocated":1744896,"data_stored":1121780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40664,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331176,"statfs":{"total":96636764160,"available":96595124224,"internally_reserved":0,"allocated":1183744,"data_stored":545406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1175552,"data_stored":545246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:24:48.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:24:48.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.881+0000 7f0f4c600640 1 Processor -- start 2024-08-18T22:24:48.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.881+0000 7f0f4c600640 1 -- start start 2024-08-18T22:24:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f4c600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0f4415b010 0x7f0f440ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f4c600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f440cee20 con 0x7f0f4406f290 2024-08-18T22:24:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f4c600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f440cf100 con 0x7f0f440cd3a0 2024-08-18T22:24:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f4c600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0f440cfa30 con 0x7f0f4415b010 2024-08-18T22:24:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f4a600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0f4406f290 0x7f0f44072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52228/0 (socket says 172.21.15.5:52228) 2024-08-18T22:24:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f4a600640 1 -- 172.21.15.5:0/2577918963 learned_addr learned my addr 172.21.15.5:0/2577918963 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:48.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f49c00640 1 --2- 172.21.15.5:0/2577918963 >> v2:172.21.15.117:3300/0 conn(0x7f0f4415b010 0x7f0f440ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:48.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2530339562 0 0) 0x7f0f440cee20 con 0x7f0f4406f290 2024-08-18T22:24:48.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f2c003530 con 0x7f0f4406f290 2024-08-18T22:24:48.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2884752610 0 0) 0x7f0f2c003530 con 0x7f0f4406f290 2024-08-18T22:24:48.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 >> v2:172.21.15.117:3300/0 conn(0x7f0f4415b010 msgr2=0x7f0f440ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 --2- 172.21.15.5:0/2577918963 >> v2:172.21.15.117:3300/0 conn(0x7f0f4415b010 0x7f0f440ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 >> v1:172.21.15.117:6789/0 conn(0x7f0f440cd3a0 legacy=0x7f0f4406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f440cf3e0 con 0x7f0f4406f290 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f0f3c001a00 con 0x7f0f4406f290 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 >> v1:172.21.15.5:6789/0 conn(0x7f0f4406f290 legacy=0x7f0f44072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 --2- 172.21.15.5:0/2577918963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f2c0039c0 0x7f0f2c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 --2- 172.21.15.5:0/2577918963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2c0043c0 0x7f0f2c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 --2- 172.21.15.5:0/2577918963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f2c005090 0x7f0f2c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0f440cfa30 con 0x7f0f2c0043c0 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c00bff0 con 0x7f0f2c0039c0 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2c00c1f0 con 0x7f0f2c005090 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f49200640 1 --2- 172.21.15.5:0/2577918963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2c0043c0 0x7f0f2c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:48.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f49c00640 1 --2- 172.21.15.5:0/2577918963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f2c0039c0 0x7f0f2c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:48.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f4a600640 1 --2- 172.21.15.5:0/2577918963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f2c005090 0x7f0f2c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:48.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f49200640 1 -- 172.21.15.5:0/2577918963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f2c005090 msgr2=0x7f0f2c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:48.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f49200640 1 --2- 172.21.15.5:0/2577918963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f2c005090 0x7f0f2c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:48.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f49200640 1 -- 172.21.15.5:0/2577918963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f2c0039c0 msgr2=0x7f0f2c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:48.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f49200640 1 --2- 172.21.15.5:0/2577918963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f2c0039c0 0x7f0f2c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:48.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f49200640 1 -- 172.21.15.5:0/2577918963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2c003530 con 0x7f0f2c0043c0 2024-08-18T22:24:48.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.885+0000 7f0f4a600640 1 -- 172.21.15.5:0/2577918963 reap_dead start 2024-08-18T22:24:48.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.889+0000 7f0f49200640 1 --2- 172.21.15.5:0/2577918963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2c0043c0 0x7f0f2c004890 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0f30001860 tx=0x7f0f3001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aec43a62eea1ee6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:48.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.889+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f300b0070 con 0x7f0f2c0043c0 2024-08-18T22:24:48.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.889+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f300ab600 con 0x7f0f2c0043c0 2024-08-18T22:24:48.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.889+0000 7f0f43e00640 1 -- 172.21.15.5:0/2577918963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30001460 con 0x7f0f2c0043c0 2024-08-18T22:24:48.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.889+0000 7f0f4c600640 1 -- 172.21.15.5:0/2577918963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2c0043c0 msgr2=0x7f0f2c004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:48.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.889+0000 7f0f4c600640 1 --2- 172.21.15.5:0/2577918963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2c0043c0 0x7f0f2c004890 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f0f30001860 tx=0x7f0f3001c4b0 comp rx=0 tx=0).stop 2024-08-18T22:24:48.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.889+0000 7f0f4c600640 1 -- 172.21.15.5:0/2577918963 shutdown_connections 2024-08-18T22:24:48.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.889+0000 7f0f4c600640 1 --2- 172.21.15.5:0/2577918963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f2c0043c0 0x7f0f2c004890 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:48.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.889+0000 7f0f4c600640 1 -- 172.21.15.5:0/2577918963 >> 172.21.15.5:0/2577918963 conn(0x7f0f440b1c50 msgr2=0x7f0f440b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:48.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.889+0000 7f0f4c600640 1 -- 172.21.15.5:0/2577918963 shutdown_connections 2024-08-18T22:24:48.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.889+0000 7f0f4c600640 1 -- 172.21.15.5:0/2577918963 wait complete. 2024-08-18T22:24:48.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4c600640 1 Processor -- start 2024-08-18T22:24:48.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4c600640 1 -- start start 2024-08-18T22:24:48.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4c600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f2c0043c0 0x7f0f4414fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:48.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4c600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f440b4f10 0x7f0f440b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:48.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4c600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f441f7040 0x7f0f441f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:48.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4c600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0f440cb8d0 con 0x7f0f440b4f10 2024-08-18T22:24:48.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4c600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0f440cb750 con 0x7f0f441f7040 2024-08-18T22:24:48.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4c600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0f440cba50 con 0x7f0f2c0043c0 2024-08-18T22:24:48.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f49200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f440b4f10 0x7f0f440b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:48.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f49200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f440b4f10 0x7f0f440b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53586/0 (socket says 172.21.15.5:53586) 2024-08-18T22:24:48.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f49200640 1 -- 172.21.15.5:0/2258780061 learned_addr learned my addr 172.21.15.5:0/2258780061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:48.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4a600640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f441f7040 0x7f0f441f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:48.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f49c00640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f2c0043c0 0x7f0f4414fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:48.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f49200640 1 -- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f2c0043c0 msgr2=0x7f0f4414fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f49200640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f2c0043c0 0x7f0f4414fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f49200640 1 -- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f441f7040 msgr2=0x7f0f441f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f49200640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f441f7040 0x7f0f441f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f49200640 1 -- 172.21.15.5:0/2258780061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4415d190 con 0x7f0f440b4f10 2024-08-18T22:24:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f49200640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f440b4f10 0x7f0f440b5390 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f0f300ae040 tx=0x7f0f2c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f41600640 1 -- 172.21.15.5:0/2258780061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f300b9020 con 0x7f0f440b4f10 2024-08-18T22:24:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f41600640 1 -- 172.21.15.5:0/2258780061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f30001440 con 0x7f0f440b4f10 2024-08-18T22:24:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f41600640 1 -- 172.21.15.5:0/2258780061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f300b0040 con 0x7f0f440b4f10 2024-08-18T22:24:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4c600640 1 -- 172.21.15.5:0/2258780061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4415d470 con 0x7f0f440b4f10 2024-08-18T22:24:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4c600640 1 -- 172.21.15.5:0/2258780061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4415da30 con 0x7f0f440b4f10 2024-08-18T22:24:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.893+0000 7f0f4c600640 1 -- 172.21.15.5:0/2258780061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f44072600 con 0x7f0f440b4f10 2024-08-18T22:24:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.897+0000 7f0f41600640 1 -- 172.21.15.5:0/2258780061 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f300bc020 con 0x7f0f440b4f10 2024-08-18T22:24:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.897+0000 7f0f41600640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f240678f0 0x7f0f24069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.897+0000 7f0f41600640 1 -- 172.21.15.5:0/2258780061 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f0f3011fac0 con 0x7f0f440b4f10 2024-08-18T22:24:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.897+0000 7f0f49c00640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f240678f0 0x7f0f24069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.897+0000 7f0f49c00640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f240678f0 0x7f0f24069db0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0f44069120 tx=0x7f0f3800b3a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:48.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:48.901+0000 7f0f41600640 1 -- 172.21.15.5:0/2258780061 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0f300c3030 con 0x7f0f440b4f10 2024-08-18T22:24:49.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.061+0000 7f0f4c600640 1 -- 172.21.15.5:0/2258780061 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f44157b50 con 0x7f0f240678f0 2024-08-18T22:24:49.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.069+0000 7f0f41600640 1 -- 172.21.15.5:0/2258780061 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252076 (secure 0 0 0) 0x7f0f44157b50 con 0x7f0f240678f0 2024-08-18T22:24:49.072 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:49.074 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:24:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 -- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f240678f0 msgr2=0x7f0f24069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f240678f0 0x7f0f24069db0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0f44069120 tx=0x7f0f3800b3a0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 -- 172.21.15.5:0/2258780061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f440b4f10 msgr2=0x7f0f440b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f440b4f10 0x7f0f440b5390 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f0f300ae040 tx=0x7f0f2c005840 comp rx=0 tx=0).stop 2024-08-18T22:24:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 -- 172.21.15.5:0/2258780061 shutdown_connections 2024-08-18T22:24:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f240678f0 0x7f0f24069db0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f441f7040 0x7f0f441f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f440b4f10 0x7f0f440b5390 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 --2- 172.21.15.5:0/2258780061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f2c0043c0 0x7f0f4414fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 -- 172.21.15.5:0/2258780061 >> 172.21.15.5:0/2258780061 conn(0x7f0f440b1c50 msgr2=0x7f0f44156960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 -- 172.21.15.5:0/2258780061 shutdown_connections 2024-08-18T22:24:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.073+0000 7f0f4c600640 1 -- 172.21.15.5:0/2258780061 wait complete. 2024-08-18T22:24:49.092 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-08-18T22:24:47.704044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309900,"kb_used_data":10504,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754664820,"statfs":{"total":773094113280,"available":772776775680,"internally_reserved":0,"allocated":10756096,"data_stored":5601060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.005747"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040637+0000","last_change":"2024-08-18T22:24:40.020064+0000","last_active":"2024-08-18T22:24:41.040637+0000","last_peered":"2024-08-18T22:24:41.040637+0000","last_clean":"2024-08-18T22:24:41.040637+0000","last_became_active":"2024-08-18T22:24:40.019639+0000","last_became_peered":"2024-08-18T22:24:40.019639+0000","last_unstale":"2024-08-18T22:24:41.040637+0000","last_undegraded":"2024-08-18T22:24:41.040637+0000","last_fullsized":"2024-08-18T22:24:41.040637+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:59:51.720807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.023389+0000","last_change":"2024-08-18T22:24:40.027959+0000","last_active":"2024-08-18T22:24:41.023389+0000","last_peered":"2024-08-18T22:24:41.023389+0000","last_clean":"2024-08-18T22:24:41.023389+0000","last_became_active":"2024-08-18T22:24:40.027665+0000","last_became_peered":"2024-08-18T22:24:40.027665+0000","last_unstale":"2024-08-18T22:24:41.023389+0000","last_undegraded":"2024-08-18T22:24:41.023389+0000","last_fullsized":"2024-08-18T22:24:41.023389+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:09.365141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040162+0000","last_change":"2024-08-18T22:24:40.024779+0000","last_active":"2024-08-18T22:24:41.040162+0000","last_peered":"2024-08-18T22:24:41.040162+0000","last_clean":"2024-08-18T22:24:41.040162+0000","last_became_active":"2024-08-18T22:24:40.024528+0000","last_became_peered":"2024-08-18T22:24:40.024528+0000","last_unstale":"2024-08-18T22:24:41.040162+0000","last_undegraded":"2024-08-18T22:24:41.040162+0000","last_fullsized":"2024-08-18T22:24:41.040162+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:30:33.557044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040339+0000","last_change":"2024-08-18T22:24:40.027610+0000","last_active":"2024-08-18T22:24:41.040339+0000","last_peered":"2024-08-18T22:24:41.040339+0000","last_clean":"2024-08-18T22:24:41.040339+0000","last_became_active":"2024-08-18T22:24:40.027030+0000","last_became_peered":"2024-08-18T22:24:40.027030+0000","last_unstale":"2024-08-18T22:24:41.040339+0000","last_undegraded":"2024-08-18T22:24:41.040339+0000","last_fullsized":"2024-08-18T22:24:41.040339+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:47.526303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018021+0000","last_change":"2024-08-18T22:24:40.016890+0000","last_active":"2024-08-18T22:24:41.018021+0000","last_peered":"2024-08-18T22:24:41.018021+0000","last_clean":"2024-08-18T22:24:41.018021+0000","last_became_active":"2024-08-18T22:24:40.016624+0000","last_became_peered":"2024-08-18T22:24:40.016624+0000","last_unstale":"2024-08-18T22:24:41.018021+0000","last_undegraded":"2024-08-18T22:24:41.018021+0000","last_fullsized":"2024-08-18T22:24:41.018021+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:32.954339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039052+0000","last_change":"2024-08-18T22:24:40.034907+0000","last_active":"2024-08-18T22:24:41.039052+0000","last_peered":"2024-08-18T22:24:41.039052+0000","last_clean":"2024-08-18T22:24:41.039052+0000","last_became_active":"2024-08-18T22:24:40.034499+0000","last_became_peered":"2024-08-18T22:24:40.034499+0000","last_unstale":"2024-08-18T22:24:41.039052+0000","last_undegraded":"2024-08-18T22:24:41.039052+0000","last_fullsized":"2024-08-18T22:24:41.039052+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:23.114625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.017150+0000","last_change":"2024-08-18T22:24:40.028169+0000","last_active":"2024-08-18T22:24:41.017150+0000","last_peered":"2024-08-18T22:24:41.017150+0000","last_clean":"2024-08-18T22:24:41.017150+0000","last_became_active":"2024-08-18T22:24:40.027602+0000","last_became_peered":"2024-08-18T22:24:40.027602+0000","last_unstale":"2024-08-18T22:24:41.017150+0000","last_undegraded":"2024-08-18T22:24:41.017150+0000","last_fullsized":"2024-08-18T22:24:41.017150+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:30:33.557044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038516+0000","last_change":"2024-08-18T22:24:40.030846+0000","last_active":"2024-08-18T22:24:41.038516+0000","last_peered":"2024-08-18T22:24:41.038516+0000","last_clean":"2024-08-18T22:24:41.038516+0000","last_became_active":"2024-08-18T22:24:40.026881+0000","last_became_peered":"2024-08-18T22:24:40.026881+0000","last_unstale":"2024-08-18T22:24:41.038516+0000","last_undegraded":"2024-08-18T22:24:41.038516+0000","last_fullsized":"2024-08-18T22:24:41.038516+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:48:54.572165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018676+0000","last_change":"2024-08-18T22:24:40.020616+0000","last_active":"2024-08-18T22:24:41.018676+0000","last_peered":"2024-08-18T22:24:41.018676+0000","last_clean":"2024-08-18T22:24:41.018676+0000","last_became_active":"2024-08-18T22:24:40.020258+0000","last_became_peered":"2024-08-18T22:24:40.020258+0000","last_unstale":"2024-08-18T22:24:41.018676+0000","last_undegraded":"2024-08-18T22:24:41.018676+0000","last_fullsized":"2024-08-18T22:24:41.018676+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:55:29.099944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038905+0000","last_change":"2024-08-18T22:24:40.028865+0000","last_active":"2024-08-18T22:24:41.038905+0000","last_peered":"2024-08-18T22:24:41.038905+0000","last_clean":"2024-08-18T22:24:41.038905+0000","last_became_active":"2024-08-18T22:24:40.028545+0000","last_became_peered":"2024-08-18T22:24:40.028545+0000","last_unstale":"2024-08-18T22:24:41.038905+0000","last_undegraded":"2024-08-18T22:24:41.038905+0000","last_fullsized":"2024-08-18T22:24:41.038905+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:00:49.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018078+0000","last_change":"2024-08-18T22:24:40.014360+0000","last_active":"2024-08-18T22:24:41.018078+0000","last_peered":"2024-08-18T22:24:41.018078+0000","last_clean":"2024-08-18T22:24:41.018078+0000","last_became_active":"2024-08-18T22:24:40.014017+0000","last_became_peered":"2024-08-18T22:24:40.014017+0000","last_unstale":"2024-08-18T22:24:41.018078+0000","last_undegraded":"2024-08-18T22:24:41.018078+0000","last_fullsized":"2024-08-18T22:24:41.018078+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:30.635824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038823+0000","last_change":"2024-08-18T22:24:40.020506+0000","last_active":"2024-08-18T22:24:41.038823+0000","last_peered":"2024-08-18T22:24:41.038823+0000","last_clean":"2024-08-18T22:24:41.038823+0000","last_became_active":"2024-08-18T22:24:40.020225+0000","last_became_peered":"2024-08-18T22:24:40.020225+0000","last_unstale":"2024-08-18T22:24:41.038823+0000","last_undegraded":"2024-08-18T22:24:41.038823+0000","last_fullsized":"2024-08-18T22:24:41.038823+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:55.978134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040140+0000","last_change":"2024-08-18T22:24:40.031170+0000","last_active":"2024-08-18T22:24:41.040140+0000","last_peered":"2024-08-18T22:24:41.040140+0000","last_clean":"2024-08-18T22:24:41.040140+0000","last_became_active":"2024-08-18T22:24:40.029952+0000","last_became_peered":"2024-08-18T22:24:40.029952+0000","last_unstale":"2024-08-18T22:24:41.040140+0000","last_undegraded":"2024-08-18T22:24:41.040140+0000","last_fullsized":"2024-08-18T22:24:41.040140+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:57.152224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.017806+0000","last_change":"2024-08-18T22:24:40.032145+0000","last_active":"2024-08-18T22:24:41.017806+0000","last_peered":"2024-08-18T22:24:41.017806+0000","last_clean":"2024-08-18T22:24:41.017806+0000","last_became_active":"2024-08-18T22:24:40.031866+0000","last_became_peered":"2024-08-18T22:24:40.031866+0000","last_unstale":"2024-08-18T22:24:41.017806+0000","last_undegraded":"2024-08-18T22:24:41.017806+0000","last_fullsized":"2024-08-18T22:24:41.017806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:23:45.794468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040052+0000","last_change":"2024-08-18T22:24:40.029113+0000","last_active":"2024-08-18T22:24:41.040052+0000","last_peered":"2024-08-18T22:24:41.040052+0000","last_clean":"2024-08-18T22:24:41.040052+0000","last_became_active":"2024-08-18T22:24:40.027633+0000","last_became_peered":"2024-08-18T22:24:40.027633+0000","last_unstale":"2024-08-18T22:24:41.040052+0000","last_undegraded":"2024-08-18T22:24:41.040052+0000","last_fullsized":"2024-08-18T22:24:41.040052+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:54:39.152218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038123+0000","last_change":"2024-08-18T22:24:40.021024+0000","last_active":"2024-08-18T22:24:41.038123+0000","last_peered":"2024-08-18T22:24:41.038123+0000","last_clean":"2024-08-18T22:24:41.038123+0000","last_became_active":"2024-08-18T22:24:40.020753+0000","last_became_peered":"2024-08-18T22:24:40.020753+0000","last_unstale":"2024-08-18T22:24:41.038123+0000","last_undegraded":"2024-08-18T22:24:41.038123+0000","last_fullsized":"2024-08-18T22:24:41.038123+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:47.103493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039123+0000","last_change":"2024-08-18T22:24:40.024582+0000","last_active":"2024-08-18T22:24:41.039123+0000","last_peered":"2024-08-18T22:24:41.039123+0000","last_clean":"2024-08-18T22:24:41.039123+0000","last_became_active":"2024-08-18T22:24:40.023186+0000","last_became_peered":"2024-08-18T22:24:40.023186+0000","last_unstale":"2024-08-18T22:24:41.039123+0000","last_undegraded":"2024-08-18T22:24:41.039123+0000","last_fullsized":"2024-08-18T22:24:41.039123+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:48:35.185535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040247+0000","last_change":"2024-08-18T22:24:40.023855+0000","last_active":"2024-08-18T22:24:41.040247+0000","last_peered":"2024-08-18T22:24:41.040247+0000","last_clean":"2024-08-18T22:24:41.040247+0000","last_became_active":"2024-08-18T22:24:40.023347+0000","last_became_peered":"2024-08-18T22:24:40.023347+0000","last_unstale":"2024-08-18T22:24:41.040247+0000","last_undegraded":"2024-08-18T22:24:41.040247+0000","last_fullsized":"2024-08-18T22:24:41.040247+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:31.049040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018175+0000","last_change":"2024-08-18T22:24:40.027430+0000","last_active":"2024-08-18T22:24:41.018175+0000","last_peered":"2024-08-18T22:24:41.018175+0000","last_clean":"2024-08-18T22:24:41.018175+0000","last_became_active":"2024-08-18T22:24:40.027160+0000","last_became_peered":"2024-08-18T22:24:40.027160+0000","last_unstale":"2024-08-18T22:24:41.018175+0000","last_undegraded":"2024-08-18T22:24:41.018175+0000","last_fullsized":"2024-08-18T22:24:41.018175+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:20:50.245891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040477+0000","last_change":"2024-08-18T22:24:40.039562+0000","last_active":"2024-08-18T22:24:41.040477+0000","last_peered":"2024-08-18T22:24:41.040477+0000","last_clean":"2024-08-18T22:24:41.040477+0000","last_became_active":"2024-08-18T22:24:40.039306+0000","last_became_peered":"2024-08-18T22:24:40.039306+0000","last_unstale":"2024-08-18T22:24:41.040477+0000","last_undegraded":"2024-08-18T22:24:41.040477+0000","last_fullsized":"2024-08-18T22:24:41.040477+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:05.453662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018311+0000","last_change":"2024-08-18T22:24:40.016741+0000","last_active":"2024-08-18T22:24:41.018311+0000","last_peered":"2024-08-18T22:24:41.018311+0000","last_clean":"2024-08-18T22:24:41.018311+0000","last_became_active":"2024-08-18T22:24:40.016175+0000","last_became_peered":"2024-08-18T22:24:40.016175+0000","last_unstale":"2024-08-18T22:24:41.018311+0000","last_undegraded":"2024-08-18T22:24:41.018311+0000","last_fullsized":"2024-08-18T22:24:41.018311+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:20.090229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.017976+0000","last_change":"2024-08-18T22:24:40.031981+0000","last_active":"2024-08-18T22:24:41.017976+0000","last_peered":"2024-08-18T22:24:41.017976+0000","last_clean":"2024-08-18T22:24:41.017976+0000","last_became_active":"2024-08-18T22:24:40.031692+0000","last_became_peered":"2024-08-18T22:24:40.031692+0000","last_unstale":"2024-08-18T22:24:41.017976+0000","last_undegraded":"2024-08-18T22:24:41.017976+0000","last_fullsized":"2024-08-18T22:24:41.017976+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:41.094809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.016093+0000","last_change":"2024-08-18T22:24:40.028288+0000","last_active":"2024-08-18T22:24:41.016093+0000","last_peered":"2024-08-18T22:24:41.016093+0000","last_clean":"2024-08-18T22:24:41.016093+0000","last_became_active":"2024-08-18T22:24:40.027964+0000","last_became_peered":"2024-08-18T22:24:40.027964+0000","last_unstale":"2024-08-18T22:24:41.016093+0000","last_undegraded":"2024-08-18T22:24:41.016093+0000","last_fullsized":"2024-08-18T22:24:41.016093+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:40.969447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039397+0000","last_change":"2024-08-18T22:24:40.027249+0000","last_active":"2024-08-18T22:24:41.039397+0000","last_peered":"2024-08-18T22:24:41.039397+0000","last_clean":"2024-08-18T22:24:41.039397+0000","last_became_active":"2024-08-18T22:24:40.026845+0000","last_became_peered":"2024-08-18T22:24:40.026845+0000","last_unstale":"2024-08-18T22:24:41.039397+0000","last_undegraded":"2024-08-18T22:24:41.039397+0000","last_fullsized":"2024-08-18T22:24:41.039397+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:39:35.030763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.023385+0000","last_change":"2024-08-18T22:24:40.021059+0000","last_active":"2024-08-18T22:24:41.023385+0000","last_peered":"2024-08-18T22:24:41.023385+0000","last_clean":"2024-08-18T22:24:41.023385+0000","last_became_active":"2024-08-18T22:24:40.020793+0000","last_became_peered":"2024-08-18T22:24:40.020793+0000","last_unstale":"2024-08-18T22:24:41.023385+0000","last_undegraded":"2024-08-18T22:24:41.023385+0000","last_fullsized":"2024-08-18T22:24:41.023385+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:54.545676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.017869+0000","last_change":"2024-08-18T22:24:40.028117+0000","last_active":"2024-08-18T22:24:41.017869+0000","last_peered":"2024-08-18T22:24:41.017869+0000","last_clean":"2024-08-18T22:24:41.017869+0000","last_became_active":"2024-08-18T22:24:40.027844+0000","last_became_peered":"2024-08-18T22:24:40.027844+0000","last_unstale":"2024-08-18T22:24:41.017869+0000","last_undegraded":"2024-08-18T22:24:41.017869+0000","last_fullsized":"2024-08-18T22:24:41.017869+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:45.636306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038822+0000","last_change":"2024-08-18T22:24:40.013826+0000","last_active":"2024-08-18T22:24:41.038822+0000","last_peered":"2024-08-18T22:24:41.038822+0000","last_clean":"2024-08-18T22:24:41.038822+0000","last_became_active":"2024-08-18T22:24:40.011508+0000","last_became_peered":"2024-08-18T22:24:40.011508+0000","last_unstale":"2024-08-18T22:24:41.038822+0000","last_undegraded":"2024-08-18T22:24:41.038822+0000","last_fullsized":"2024-08-18T22:24:41.038822+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:30:36.679274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040617+0000","last_change":"2024-08-18T22:24:40.027342+0000","last_active":"2024-08-18T22:24:41.040617+0000","last_peered":"2024-08-18T22:24:41.040617+0000","last_clean":"2024-08-18T22:24:41.040617+0000","last_became_active":"2024-08-18T22:24:40.026607+0000","last_became_peered":"2024-08-18T22:24:40.026607+0000","last_unstale":"2024-08-18T22:24:41.040617+0000","last_undegraded":"2024-08-18T22:24:41.040617+0000","last_fullsized":"2024-08-18T22:24:41.040617+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:51:45.828213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.017166+0000","last_change":"2024-08-18T22:24:40.018529+0000","last_active":"2024-08-18T22:24:41.017166+0000","last_peered":"2024-08-18T22:24:41.017166+0000","last_clean":"2024-08-18T22:24:41.017166+0000","last_became_active":"2024-08-18T22:24:40.018287+0000","last_became_peered":"2024-08-18T22:24:40.018287+0000","last_unstale":"2024-08-18T22:24:41.017166+0000","last_undegraded":"2024-08-18T22:24:41.017166+0000","last_fullsized":"2024-08-18T22:24:41.017166+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:31.049040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018205+0000","last_change":"2024-08-18T22:24:40.021109+0000","last_active":"2024-08-18T22:24:41.018205+0000","last_peered":"2024-08-18T22:24:41.018205+0000","last_clean":"2024-08-18T22:24:41.018205+0000","last_became_active":"2024-08-18T22:24:40.020810+0000","last_became_peered":"2024-08-18T22:24:40.020810+0000","last_unstale":"2024-08-18T22:24:41.018205+0000","last_undegraded":"2024-08-18T22:24:41.018205+0000","last_fullsized":"2024-08-18T22:24:41.018205+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:28:05.406701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.022946+0000","last_change":"2024-08-18T22:24:40.031957+0000","last_active":"2024-08-18T22:24:41.022946+0000","last_peered":"2024-08-18T22:24:41.022946+0000","last_clean":"2024-08-18T22:24:41.022946+0000","last_became_active":"2024-08-18T22:24:40.031586+0000","last_became_peered":"2024-08-18T22:24:40.031586+0000","last_unstale":"2024-08-18T22:24:41.022946+0000","last_undegraded":"2024-08-18T22:24:41.022946+0000","last_fullsized":"2024-08-18T22:24:41.022946+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:19:29.422890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038173+0000","last_change":"2024-08-18T22:24:40.023431+0000","last_active":"2024-08-18T22:24:41.038173+0000","last_peered":"2024-08-18T22:24:41.038173+0000","last_clean":"2024-08-18T22:24:41.038173+0000","last_became_active":"2024-08-18T22:24:40.020582+0000","last_became_peered":"2024-08-18T22:24:40.020582+0000","last_unstale":"2024-08-18T22:24:41.038173+0000","last_undegraded":"2024-08-18T22:24:41.038173+0000","last_fullsized":"2024-08-18T22:24:41.038173+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:13.270435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039958+0000","last_change":"2024-08-18T22:24:40.022873+0000","last_active":"2024-08-18T22:24:41.039958+0000","last_peered":"2024-08-18T22:24:41.039958+0000","last_clean":"2024-08-18T22:24:41.039958+0000","last_became_active":"2024-08-18T22:24:40.021321+0000","last_became_peered":"2024-08-18T22:24:40.021321+0000","last_unstale":"2024-08-18T22:24:41.039958+0000","last_undegraded":"2024-08-18T22:24:41.039958+0000","last_fullsized":"2024-08-18T22:24:41.039958+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:15.426167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"96'4","reported_seq":18,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.016069+0000","last_change":"2024-08-18T22:24:39.012805+0000","last_active":"2024-08-18T22:24:41.016069+0000","last_peered":"2024-08-18T22:24:41.016069+0000","last_clean":"2024-08-18T22:24:41.016069+0000","last_became_active":"2024-08-18T22:24:39.012523+0000","last_became_peered":"2024-08-18T22:24:39.012523+0000","last_unstale":"2024-08-18T22:24:41.016069+0000","last_undegraded":"2024-08-18T22:24:41.016069+0000","last_fullsized":"2024-08-18T22:24:41.016069+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:17:28.129013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040330+0000","last_change":"2024-08-18T22:24:40.022369+0000","last_active":"2024-08-18T22:24:41.040330+0000","last_peered":"2024-08-18T22:24:41.040330+0000","last_clean":"2024-08-18T22:24:41.040330+0000","last_became_active":"2024-08-18T22:24:40.022087+0000","last_became_peered":"2024-08-18T22:24:40.022087+0000","last_unstale":"2024-08-18T22:24:41.040330+0000","last_undegraded":"2024-08-18T22:24:41.040330+0000","last_fullsized":"2024-08-18T22:24:41.040330+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:25:54.090079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018276+0000","last_change":"2024-08-18T22:24:39.012924+0000","last_active":"2024-08-18T22:24:41.018276+0000","last_peered":"2024-08-18T22:24:41.018276+0000","last_clean":"2024-08-18T22:24:41.018276+0000","last_became_active":"2024-08-18T22:24:39.012605+0000","last_became_peered":"2024-08-18T22:24:39.012605+0000","last_unstale":"2024-08-18T22:24:41.018276+0000","last_undegraded":"2024-08-18T22:24:41.018276+0000","last_fullsized":"2024-08-18T22:24:41.018276+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:45.539213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.016898+0000","last_change":"2024-08-18T22:24:40.028822+0000","last_active":"2024-08-18T22:24:41.016898+0000","last_peered":"2024-08-18T22:24:41.016898+0000","last_clean":"2024-08-18T22:24:41.016898+0000","last_became_active":"2024-08-18T22:24:40.028553+0000","last_became_peered":"2024-08-18T22:24:40.028553+0000","last_unstale":"2024-08-18T22:24:41.016898+0000","last_undegraded":"2024-08-18T22:24:41.016898+0000","last_fullsized":"2024-08-18T22:24:41.016898+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:28.647227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.017066+0000","last_change":"2024-08-18T22:24:39.016713+0000","last_active":"2024-08-18T22:24:41.017066+0000","last_peered":"2024-08-18T22:24:41.017066+0000","last_clean":"2024-08-18T22:24:41.017066+0000","last_became_active":"2024-08-18T22:24:39.016446+0000","last_became_peered":"2024-08-18T22:24:39.016446+0000","last_unstale":"2024-08-18T22:24:41.017066+0000","last_undegraded":"2024-08-18T22:24:41.017066+0000","last_fullsized":"2024-08-18T22:24:41.017066+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:32.717701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039266+0000","last_change":"2024-08-18T22:24:40.018208+0000","last_active":"2024-08-18T22:24:41.039266+0000","last_peered":"2024-08-18T22:24:41.039266+0000","last_clean":"2024-08-18T22:24:41.039266+0000","last_became_active":"2024-08-18T22:24:40.017777+0000","last_became_peered":"2024-08-18T22:24:40.017777+0000","last_unstale":"2024-08-18T22:24:41.039266+0000","last_undegraded":"2024-08-18T22:24:41.039266+0000","last_fullsized":"2024-08-18T22:24:41.039266+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:59.353019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.015772+0000","last_change":"2024-08-18T22:24:39.018389+0000","last_active":"2024-08-18T22:24:41.015772+0000","last_peered":"2024-08-18T22:24:41.015772+0000","last_clean":"2024-08-18T22:24:41.015772+0000","last_became_active":"2024-08-18T22:24:39.018122+0000","last_became_peered":"2024-08-18T22:24:39.018122+0000","last_unstale":"2024-08-18T22:24:41.015772+0000","last_undegraded":"2024-08-18T22:24:41.015772+0000","last_fullsized":"2024-08-18T22:24:41.015772+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:29:41.679065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039768+0000","last_change":"2024-08-18T22:24:40.037302+0000","last_active":"2024-08-18T22:24:41.039768+0000","last_peered":"2024-08-18T22:24:41.039768+0000","last_clean":"2024-08-18T22:24:41.039768+0000","last_became_active":"2024-08-18T22:24:40.036745+0000","last_became_peered":"2024-08-18T22:24:40.036745+0000","last_unstale":"2024-08-18T22:24:41.039768+0000","last_undegraded":"2024-08-18T22:24:41.039768+0000","last_fullsized":"2024-08-18T22:24:41.039768+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:44:35.006738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018431+0000","last_change":"2024-08-18T22:24:39.017797+0000","last_active":"2024-08-18T22:24:41.018431+0000","last_peered":"2024-08-18T22:24:41.018431+0000","last_clean":"2024-08-18T22:24:41.018431+0000","last_became_active":"2024-08-18T22:24:39.017473+0000","last_became_peered":"2024-08-18T22:24:39.017473+0000","last_unstale":"2024-08-18T22:24:41.018431+0000","last_undegraded":"2024-08-18T22:24:41.018431+0000","last_fullsized":"2024-08-18T22:24:41.018431+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:03:37.813619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.015828+0000","last_change":"2024-08-18T22:24:40.013580+0000","last_active":"2024-08-18T22:24:41.015828+0000","last_peered":"2024-08-18T22:24:41.015828+0000","last_clean":"2024-08-18T22:24:41.015828+0000","last_became_active":"2024-08-18T22:24:40.012475+0000","last_became_peered":"2024-08-18T22:24:40.012475+0000","last_unstale":"2024-08-18T22:24:41.015828+0000","last_undegraded":"2024-08-18T22:24:41.015828+0000","last_fullsized":"2024-08-18T22:24:41.015828+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:44:47.526303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040574+0000","last_change":"2024-08-18T22:24:39.027179+0000","last_active":"2024-08-18T22:24:41.040574+0000","last_peered":"2024-08-18T22:24:41.040574+0000","last_clean":"2024-08-18T22:24:41.040574+0000","last_became_active":"2024-08-18T22:24:39.026874+0000","last_became_peered":"2024-08-18T22:24:39.026874+0000","last_unstale":"2024-08-18T22:24:41.040574+0000","last_undegraded":"2024-08-18T22:24:41.040574+0000","last_fullsized":"2024-08-18T22:24:41.040574+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:38.997767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039190+0000","last_change":"2024-08-18T22:24:40.034300+0000","last_active":"2024-08-18T22:24:41.039190+0000","last_peered":"2024-08-18T22:24:41.039190+0000","last_clean":"2024-08-18T22:24:41.039190+0000","last_became_active":"2024-08-18T22:24:40.033992+0000","last_became_peered":"2024-08-18T22:24:40.033992+0000","last_unstale":"2024-08-18T22:24:41.039190+0000","last_undegraded":"2024-08-18T22:24:41.039190+0000","last_fullsized":"2024-08-18T22:24:41.039190+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:05.350964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039683+0000","last_change":"2024-08-18T22:24:39.023622+0000","last_active":"2024-08-18T22:24:41.039683+0000","last_peered":"2024-08-18T22:24:41.039683+0000","last_clean":"2024-08-18T22:24:41.039683+0000","last_became_active":"2024-08-18T22:24:39.020892+0000","last_became_peered":"2024-08-18T22:24:39.020892+0000","last_unstale":"2024-08-18T22:24:41.039683+0000","last_undegraded":"2024-08-18T22:24:41.039683+0000","last_fullsized":"2024-08-18T22:24:41.039683+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:32.717701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040288+0000","last_change":"2024-08-18T22:24:40.031899+0000","last_active":"2024-08-18T22:24:41.040288+0000","last_peered":"2024-08-18T22:24:41.040288+0000","last_clean":"2024-08-18T22:24:41.040288+0000","last_became_active":"2024-08-18T22:24:40.031544+0000","last_became_peered":"2024-08-18T22:24:40.031544+0000","last_unstale":"2024-08-18T22:24:41.040288+0000","last_undegraded":"2024-08-18T22:24:41.040288+0000","last_fullsized":"2024-08-18T22:24:41.040288+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:20.757492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.016673+0000","last_change":"2024-08-18T22:24:39.010722+0000","last_active":"2024-08-18T22:24:41.016673+0000","last_peered":"2024-08-18T22:24:41.016673+0000","last_clean":"2024-08-18T22:24:41.016673+0000","last_became_active":"2024-08-18T22:24:39.010401+0000","last_became_peered":"2024-08-18T22:24:39.010401+0000","last_unstale":"2024-08-18T22:24:41.016673+0000","last_undegraded":"2024-08-18T22:24:41.016673+0000","last_fullsized":"2024-08-18T22:24:41.016673+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:19:28.415070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018631+0000","last_change":"2024-08-18T22:24:40.024058+0000","last_active":"2024-08-18T22:24:41.018631+0000","last_peered":"2024-08-18T22:24:41.018631+0000","last_clean":"2024-08-18T22:24:41.018631+0000","last_became_active":"2024-08-18T22:24:40.023645+0000","last_became_peered":"2024-08-18T22:24:40.023645+0000","last_unstale":"2024-08-18T22:24:41.018631+0000","last_undegraded":"2024-08-18T22:24:41.018631+0000","last_fullsized":"2024-08-18T22:24:41.018631+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:33:21.495637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.023405+0000","last_change":"2024-08-18T22:24:39.022445+0000","last_active":"2024-08-18T22:24:41.023405+0000","last_peered":"2024-08-18T22:24:41.023405+0000","last_clean":"2024-08-18T22:24:41.023405+0000","last_became_active":"2024-08-18T22:24:39.022139+0000","last_became_peered":"2024-08-18T22:24:39.022139+0000","last_unstale":"2024-08-18T22:24:41.023405+0000","last_undegraded":"2024-08-18T22:24:41.023405+0000","last_fullsized":"2024-08-18T22:24:41.023405+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:21.329634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.017216+0000","last_change":"2024-08-18T22:24:40.015701+0000","last_active":"2024-08-18T22:24:41.017216+0000","last_peered":"2024-08-18T22:24:41.017216+0000","last_clean":"2024-08-18T22:24:41.017216+0000","last_became_active":"2024-08-18T22:24:40.015413+0000","last_became_peered":"2024-08-18T22:24:40.015413+0000","last_unstale":"2024-08-18T22:24:41.017216+0000","last_undegraded":"2024-08-18T22:24:41.017216+0000","last_fullsized":"2024-08-18T22:24:41.017216+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:48:28.810984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040427+0000","last_change":"2024-08-18T22:24:39.022428+0000","last_active":"2024-08-18T22:24:41.040427+0000","last_peered":"2024-08-18T22:24:41.040427+0000","last_clean":"2024-08-18T22:24:41.040427+0000","last_became_active":"2024-08-18T22:24:39.020527+0000","last_became_peered":"2024-08-18T22:24:39.020527+0000","last_unstale":"2024-08-18T22:24:41.040427+0000","last_undegraded":"2024-08-18T22:24:41.040427+0000","last_fullsized":"2024-08-18T22:24:41.040427+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:15:59.743487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040347+0000","last_change":"2024-08-18T22:24:40.023619+0000","last_active":"2024-08-18T22:24:41.040347+0000","last_peered":"2024-08-18T22:24:41.040347+0000","last_clean":"2024-08-18T22:24:41.040347+0000","last_became_active":"2024-08-18T22:24:40.022938+0000","last_became_peered":"2024-08-18T22:24:40.022938+0000","last_unstale":"2024-08-18T22:24:41.040347+0000","last_undegraded":"2024-08-18T22:24:41.040347+0000","last_fullsized":"2024-08-18T22:24:41.040347+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:48:28.810984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"96'3","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018318+0000","last_change":"2024-08-18T22:24:39.014524+0000","last_active":"2024-08-18T22:24:41.018318+0000","last_peered":"2024-08-18T22:24:41.018318+0000","last_clean":"2024-08-18T22:24:41.018318+0000","last_became_active":"2024-08-18T22:24:39.014226+0000","last_became_peered":"2024-08-18T22:24:39.014226+0000","last_unstale":"2024-08-18T22:24:41.018318+0000","last_undegraded":"2024-08-18T22:24:41.018318+0000","last_fullsized":"2024-08-18T22:24:41.018318+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:20:26.559799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040968+0000","last_change":"2024-08-18T22:24:40.037336+0000","last_active":"2024-08-18T22:24:41.040968+0000","last_peered":"2024-08-18T22:24:41.040968+0000","last_clean":"2024-08-18T22:24:41.040968+0000","last_became_active":"2024-08-18T22:24:40.036921+0000","last_became_peered":"2024-08-18T22:24:40.036921+0000","last_unstale":"2024-08-18T22:24:41.040968+0000","last_undegraded":"2024-08-18T22:24:41.040968+0000","last_fullsized":"2024-08-18T22:24:41.040968+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:40.969447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"96'6","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040007+0000","last_change":"2024-08-18T22:24:39.023326+0000","last_active":"2024-08-18T22:24:41.040007+0000","last_peered":"2024-08-18T22:24:41.040007+0000","last_clean":"2024-08-18T22:24:41.040007+0000","last_became_active":"2024-08-18T22:24:39.018835+0000","last_became_peered":"2024-08-18T22:24:39.018835+0000","last_unstale":"2024-08-18T22:24:41.040007+0000","last_undegraded":"2024-08-18T22:24:41.040007+0000","last_fullsized":"2024-08-18T22:24:41.040007+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:08.357321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039543+0000","last_change":"2024-08-18T22:24:40.035471+0000","last_active":"2024-08-18T22:24:41.039543+0000","last_peered":"2024-08-18T22:24:41.039543+0000","last_clean":"2024-08-18T22:24:41.039543+0000","last_became_active":"2024-08-18T22:24:40.026531+0000","last_became_peered":"2024-08-18T22:24:40.026531+0000","last_unstale":"2024-08-18T22:24:41.039543+0000","last_undegraded":"2024-08-18T22:24:41.039543+0000","last_fullsized":"2024-08-18T22:24:41.039543+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:52:00.385651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.017263+0000","last_change":"2024-08-18T22:24:39.017795+0000","last_active":"2024-08-18T22:24:41.017263+0000","last_peered":"2024-08-18T22:24:41.017263+0000","last_clean":"2024-08-18T22:24:41.017263+0000","last_became_active":"2024-08-18T22:24:39.017461+0000","last_became_peered":"2024-08-18T22:24:39.017461+0000","last_unstale":"2024-08-18T22:24:41.017263+0000","last_undegraded":"2024-08-18T22:24:41.017263+0000","last_fullsized":"2024-08-18T22:24:41.017263+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:08.357321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.017659+0000","last_change":"2024-08-18T22:24:40.014669+0000","last_active":"2024-08-18T22:24:41.017659+0000","last_peered":"2024-08-18T22:24:41.017659+0000","last_clean":"2024-08-18T22:24:41.017659+0000","last_became_active":"2024-08-18T22:24:40.014366+0000","last_became_peered":"2024-08-18T22:24:40.014366+0000","last_unstale":"2024-08-18T22:24:41.017659+0000","last_undegraded":"2024-08-18T22:24:41.017659+0000","last_fullsized":"2024-08-18T22:24:41.017659+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:35.014881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039244+0000","last_change":"2024-08-18T22:24:39.012511+0000","last_active":"2024-08-18T22:24:41.039244+0000","last_peered":"2024-08-18T22:24:41.039244+0000","last_clean":"2024-08-18T22:24:41.039244+0000","last_became_active":"2024-08-18T22:24:39.012234+0000","last_became_peered":"2024-08-18T22:24:39.012234+0000","last_unstale":"2024-08-18T22:24:41.039244+0000","last_undegraded":"2024-08-18T22:24:41.039244+0000","last_fullsized":"2024-08-18T22:24:41.039244+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:43.874592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038549+0000","last_change":"2024-08-18T22:24:40.032806+0000","last_active":"2024-08-18T22:24:41.038549+0000","last_peered":"2024-08-18T22:24:41.038549+0000","last_clean":"2024-08-18T22:24:41.038549+0000","last_became_active":"2024-08-18T22:24:40.032402+0000","last_became_peered":"2024-08-18T22:24:40.032402+0000","last_unstale":"2024-08-18T22:24:41.038549+0000","last_undegraded":"2024-08-18T22:24:41.038549+0000","last_fullsized":"2024-08-18T22:24:41.038549+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:56:53.244726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040111+0000","last_change":"2024-08-18T22:24:39.016731+0000","last_active":"2024-08-18T22:24:41.040111+0000","last_peered":"2024-08-18T22:24:41.040111+0000","last_clean":"2024-08-18T22:24:41.040111+0000","last_became_active":"2024-08-18T22:24:39.016434+0000","last_became_peered":"2024-08-18T22:24:39.016434+0000","last_unstale":"2024-08-18T22:24:41.040111+0000","last_undegraded":"2024-08-18T22:24:41.040111+0000","last_fullsized":"2024-08-18T22:24:41.040111+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:36:10.372791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038783+0000","last_change":"2024-08-18T22:24:40.019334+0000","last_active":"2024-08-18T22:24:41.038783+0000","last_peered":"2024-08-18T22:24:41.038783+0000","last_clean":"2024-08-18T22:24:41.038783+0000","last_became_active":"2024-08-18T22:24:40.019013+0000","last_became_peered":"2024-08-18T22:24:40.019013+0000","last_unstale":"2024-08-18T22:24:41.038783+0000","last_undegraded":"2024-08-18T22:24:41.038783+0000","last_fullsized":"2024-08-18T22:24:41.038783+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:28:22.803715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"96'8","reported_seq":22,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039593+0000","last_change":"2024-08-18T22:24:39.026987+0000","last_active":"2024-08-18T22:24:41.039593+0000","last_peered":"2024-08-18T22:24:41.039593+0000","last_clean":"2024-08-18T22:24:41.039593+0000","last_became_active":"2024-08-18T22:24:39.026698+0000","last_became_peered":"2024-08-18T22:24:39.026698+0000","last_unstale":"2024-08-18T22:24:41.039593+0000","last_undegraded":"2024-08-18T22:24:41.039593+0000","last_fullsized":"2024-08-18T22:24:41.039593+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:15.836595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040003+0000","last_change":"2024-08-18T22:24:40.021421+0000","last_active":"2024-08-18T22:24:41.040003+0000","last_peered":"2024-08-18T22:24:41.040003+0000","last_clean":"2024-08-18T22:24:41.040003+0000","last_became_active":"2024-08-18T22:24:40.020975+0000","last_became_peered":"2024-08-18T22:24:40.020975+0000","last_unstale":"2024-08-18T22:24:41.040003+0000","last_undegraded":"2024-08-18T22:24:41.040003+0000","last_fullsized":"2024-08-18T22:24:41.040003+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:17.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.016156+0000","last_change":"2024-08-18T22:24:39.012168+0000","last_active":"2024-08-18T22:24:41.016156+0000","last_peered":"2024-08-18T22:24:41.016156+0000","last_clean":"2024-08-18T22:24:41.016156+0000","last_became_active":"2024-08-18T22:24:39.011588+0000","last_became_peered":"2024-08-18T22:24:39.011588+0000","last_unstale":"2024-08-18T22:24:41.016156+0000","last_undegraded":"2024-08-18T22:24:41.016156+0000","last_fullsized":"2024-08-18T22:24:41.016156+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:48:53.564345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.015851+0000","last_change":"2024-08-18T22:24:40.020080+0000","last_active":"2024-08-18T22:24:41.015851+0000","last_peered":"2024-08-18T22:24:41.015851+0000","last_clean":"2024-08-18T22:24:41.015851+0000","last_became_active":"2024-08-18T22:24:40.019706+0000","last_became_peered":"2024-08-18T22:24:40.019706+0000","last_unstale":"2024-08-18T22:24:41.015851+0000","last_undegraded":"2024-08-18T22:24:41.015851+0000","last_fullsized":"2024-08-18T22:24:41.015851+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:05.453662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.016962+0000","last_change":"2024-08-18T22:24:39.014554+0000","last_active":"2024-08-18T22:24:41.016962+0000","last_peered":"2024-08-18T22:24:41.016962+0000","last_clean":"2024-08-18T22:24:41.016962+0000","last_became_active":"2024-08-18T22:24:39.014021+0000","last_became_peered":"2024-08-18T22:24:39.014021+0000","last_unstale":"2024-08-18T22:24:41.016962+0000","last_undegraded":"2024-08-18T22:24:41.016962+0000","last_fullsized":"2024-08-18T22:24:41.016962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:15:59.743487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018165+0000","last_change":"2024-08-18T22:24:40.008819+0000","last_active":"2024-08-18T22:24:41.018165+0000","last_peered":"2024-08-18T22:24:41.018165+0000","last_clean":"2024-08-18T22:24:41.018165+0000","last_became_active":"2024-08-18T22:24:40.008536+0000","last_became_peered":"2024-08-18T22:24:40.008536+0000","last_unstale":"2024-08-18T22:24:41.018165+0000","last_undegraded":"2024-08-18T22:24:41.018165+0000","last_fullsized":"2024-08-18T22:24:41.018165+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:25:46.070920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"96'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018331+0000","last_change":"2024-08-18T22:24:39.018385+0000","last_active":"2024-08-18T22:24:41.018331+0000","last_peered":"2024-08-18T22:24:41.018331+0000","last_clean":"2024-08-18T22:24:41.018331+0000","last_became_active":"2024-08-18T22:24:39.018097+0000","last_became_peered":"2024-08-18T22:24:39.018097+0000","last_unstale":"2024-08-18T22:24:41.018331+0000","last_undegraded":"2024-08-18T22:24:41.018331+0000","last_fullsized":"2024-08-18T22:24:41.018331+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:52:43.228773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038315+0000","last_change":"2024-08-18T22:24:40.036729+0000","last_active":"2024-08-18T22:24:41.038315+0000","last_peered":"2024-08-18T22:24:41.038315+0000","last_clean":"2024-08-18T22:24:41.038315+0000","last_became_active":"2024-08-18T22:24:40.036483+0000","last_became_peered":"2024-08-18T22:24:40.036483+0000","last_unstale":"2024-08-18T22:24:41.038315+0000","last_undegraded":"2024-08-18T22:24:41.038315+0000","last_fullsized":"2024-08-18T22:24:41.038315+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:42:43.831253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.023019+0000","last_change":"2024-08-18T22:24:39.023174+0000","last_active":"2024-08-18T22:24:41.023019+0000","last_peered":"2024-08-18T22:24:41.023019+0000","last_clean":"2024-08-18T22:24:41.023019+0000","last_became_active":"2024-08-18T22:24:39.022855+0000","last_became_peered":"2024-08-18T22:24:39.022855+0000","last_unstale":"2024-08-18T22:24:41.023019+0000","last_undegraded":"2024-08-18T22:24:41.023019+0000","last_fullsized":"2024-08-18T22:24:41.023019+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:20.276894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.022966+0000","last_change":"2024-08-18T22:24:40.024075+0000","last_active":"2024-08-18T22:24:41.022966+0000","last_peered":"2024-08-18T22:24:41.022966+0000","last_clean":"2024-08-18T22:24:41.022966+0000","last_became_active":"2024-08-18T22:24:40.023816+0000","last_became_peered":"2024-08-18T22:24:40.023816+0000","last_unstale":"2024-08-18T22:24:41.022966+0000","last_undegraded":"2024-08-18T22:24:41.022966+0000","last_fullsized":"2024-08-18T22:24:41.022966+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:49.063664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038664+0000","last_change":"2024-08-18T22:24:39.018757+0000","last_active":"2024-08-18T22:24:41.038664+0000","last_peered":"2024-08-18T22:24:41.038664+0000","last_clean":"2024-08-18T22:24:41.038664+0000","last_became_active":"2024-08-18T22:24:39.018297+0000","last_became_peered":"2024-08-18T22:24:39.018297+0000","last_unstale":"2024-08-18T22:24:41.038664+0000","last_undegraded":"2024-08-18T22:24:41.038664+0000","last_fullsized":"2024-08-18T22:24:41.038664+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:51:06.563873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.023049+0000","last_change":"2024-08-18T22:24:40.033925+0000","last_active":"2024-08-18T22:24:41.023049+0000","last_peered":"2024-08-18T22:24:41.023049+0000","last_clean":"2024-08-18T22:24:41.023049+0000","last_became_active":"2024-08-18T22:24:40.033623+0000","last_became_peered":"2024-08-18T22:24:40.033623+0000","last_unstale":"2024-08-18T22:24:41.023049+0000","last_undegraded":"2024-08-18T22:24:41.023049+0000","last_fullsized":"2024-08-18T22:24:41.023049+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:16:00.751307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.023042+0000","last_change":"2024-08-18T22:24:39.017928+0000","last_active":"2024-08-18T22:24:41.023042+0000","last_peered":"2024-08-18T22:24:41.023042+0000","last_clean":"2024-08-18T22:24:41.023042+0000","last_became_active":"2024-08-18T22:24:39.017657+0000","last_became_peered":"2024-08-18T22:24:39.017657+0000","last_unstale":"2024-08-18T22:24:41.023042+0000","last_undegraded":"2024-08-18T22:24:41.023042+0000","last_fullsized":"2024-08-18T22:24:41.023042+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:28:11.921285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039138+0000","last_change":"2024-08-18T22:24:40.022079+0000","last_active":"2024-08-18T22:24:41.039138+0000","last_peered":"2024-08-18T22:24:41.039138+0000","last_clean":"2024-08-18T22:24:41.039138+0000","last_became_active":"2024-08-18T22:24:40.021785+0000","last_became_peered":"2024-08-18T22:24:40.021785+0000","last_unstale":"2024-08-18T22:24:41.039138+0000","last_undegraded":"2024-08-18T22:24:41.039138+0000","last_fullsized":"2024-08-18T22:24:41.039138+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:08.918610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038532+0000","last_change":"2024-08-18T22:24:39.015304+0000","last_active":"2024-08-18T22:24:41.038532+0000","last_peered":"2024-08-18T22:24:41.038532+0000","last_clean":"2024-08-18T22:24:41.038532+0000","last_became_active":"2024-08-18T22:24:39.015013+0000","last_became_peered":"2024-08-18T22:24:39.015013+0000","last_unstale":"2024-08-18T22:24:41.038532+0000","last_undegraded":"2024-08-18T22:24:41.038532+0000","last_fullsized":"2024-08-18T22:24:41.038532+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:34.344259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.016100+0000","last_change":"2024-08-18T22:24:40.013302+0000","last_active":"2024-08-18T22:24:41.016100+0000","last_peered":"2024-08-18T22:24:41.016100+0000","last_clean":"2024-08-18T22:24:41.016100+0000","last_became_active":"2024-08-18T22:24:40.012987+0000","last_became_peered":"2024-08-18T22:24:40.012987+0000","last_unstale":"2024-08-18T22:24:41.016100+0000","last_undegraded":"2024-08-18T22:24:41.016100+0000","last_fullsized":"2024-08-18T22:24:41.016100+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:21.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"96'2","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.017389+0000","last_change":"2024-08-18T22:24:39.014436+0000","last_active":"2024-08-18T22:24:41.017389+0000","last_peered":"2024-08-18T22:24:41.017389+0000","last_clean":"2024-08-18T22:24:41.017389+0000","last_became_active":"2024-08-18T22:24:39.014168+0000","last_became_peered":"2024-08-18T22:24:39.014168+0000","last_unstale":"2024-08-18T22:24:41.017389+0000","last_undegraded":"2024-08-18T22:24:41.017389+0000","last_fullsized":"2024-08-18T22:24:41.017389+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:53.537856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040521+0000","last_change":"2024-08-18T22:24:40.016684+0000","last_active":"2024-08-18T22:24:41.040521+0000","last_peered":"2024-08-18T22:24:41.040521+0000","last_clean":"2024-08-18T22:24:41.040521+0000","last_became_active":"2024-08-18T22:24:40.016385+0000","last_became_peered":"2024-08-18T22:24:40.016385+0000","last_unstale":"2024-08-18T22:24:41.040521+0000","last_undegraded":"2024-08-18T22:24:41.040521+0000","last_fullsized":"2024-08-18T22:24:41.040521+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:32:30.983362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"97'1","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018535+0000","last_change":"2024-08-18T22:24:39.015360+0000","last_active":"2024-08-18T22:24:41.018535+0000","last_peered":"2024-08-18T22:24:41.018535+0000","last_clean":"2024-08-18T22:24:41.018535+0000","last_became_active":"2024-08-18T22:24:39.014376+0000","last_became_peered":"2024-08-18T22:24:39.014376+0000","last_unstale":"2024-08-18T22:24:41.018535+0000","last_undegraded":"2024-08-18T22:24:41.018535+0000","last_fullsized":"2024-08-18T22:24:41.018535+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:29.351930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039007+0000","last_change":"2024-08-18T22:24:40.036612+0000","last_active":"2024-08-18T22:24:41.039007+0000","last_peered":"2024-08-18T22:24:41.039007+0000","last_clean":"2024-08-18T22:24:41.039007+0000","last_became_active":"2024-08-18T22:24:40.036283+0000","last_became_peered":"2024-08-18T22:24:40.036283+0000","last_unstale":"2024-08-18T22:24:41.039007+0000","last_undegraded":"2024-08-18T22:24:41.039007+0000","last_fullsized":"2024-08-18T22:24:41.039007+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:09.083075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.018459+0000","last_change":"2024-08-18T22:24:39.014437+0000","last_active":"2024-08-18T22:24:41.018459+0000","last_peered":"2024-08-18T22:24:41.018459+0000","last_clean":"2024-08-18T22:24:41.018459+0000","last_became_active":"2024-08-18T22:24:39.014115+0000","last_became_peered":"2024-08-18T22:24:39.014115+0000","last_unstale":"2024-08-18T22:24:41.018459+0000","last_undegraded":"2024-08-18T22:24:41.018459+0000","last_fullsized":"2024-08-18T22:24:41.018459+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:07.433459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.023366+0000","last_change":"2024-08-18T22:24:40.018908+0000","last_active":"2024-08-18T22:24:41.023366+0000","last_peered":"2024-08-18T22:24:41.023366+0000","last_clean":"2024-08-18T22:24:41.023366+0000","last_became_active":"2024-08-18T22:24:40.018280+0000","last_became_peered":"2024-08-18T22:24:40.018280+0000","last_unstale":"2024-08-18T22:24:41.023366+0000","last_undegraded":"2024-08-18T22:24:41.023366+0000","last_fullsized":"2024-08-18T22:24:41.023366+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:33.725522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.015906+0000","last_change":"2024-08-18T22:24:39.017335+0000","last_active":"2024-08-18T22:24:41.015906+0000","last_peered":"2024-08-18T22:24:41.015906+0000","last_clean":"2024-08-18T22:24:41.015906+0000","last_became_active":"2024-08-18T22:24:39.017034+0000","last_became_peered":"2024-08-18T22:24:39.017034+0000","last_unstale":"2024-08-18T22:24:41.015906+0000","last_undegraded":"2024-08-18T22:24:41.015906+0000","last_fullsized":"2024-08-18T22:24:41.015906+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:59.511058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.038437+0000","last_change":"2024-08-18T22:24:40.017509+0000","last_active":"2024-08-18T22:24:41.038437+0000","last_peered":"2024-08-18T22:24:41.038437+0000","last_clean":"2024-08-18T22:24:41.038437+0000","last_became_active":"2024-08-18T22:24:40.017236+0000","last_became_peered":"2024-08-18T22:24:40.017236+0000","last_unstale":"2024-08-18T22:24:41.038437+0000","last_undegraded":"2024-08-18T22:24:41.038437+0000","last_fullsized":"2024-08-18T22:24:41.038437+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:52:38.153171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039300+0000","last_change":"2024-08-18T22:24:39.015123+0000","last_active":"2024-08-18T22:24:41.039300+0000","last_peered":"2024-08-18T22:24:41.039300+0000","last_clean":"2024-08-18T22:24:41.039300+0000","last_became_active":"2024-08-18T22:24:39.014449+0000","last_became_peered":"2024-08-18T22:24:39.014449+0000","last_unstale":"2024-08-18T22:24:41.039300+0000","last_undegraded":"2024-08-18T22:24:41.039300+0000","last_fullsized":"2024-08-18T22:24:41.039300+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:46:49.621637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039593+0000","last_change":"2024-08-18T22:24:40.030756+0000","last_active":"2024-08-18T22:24:41.039593+0000","last_peered":"2024-08-18T22:24:41.039593+0000","last_clean":"2024-08-18T22:24:41.039593+0000","last_became_active":"2024-08-18T22:24:40.030557+0000","last_became_peered":"2024-08-18T22:24:40.030557+0000","last_unstale":"2024-08-18T22:24:41.039593+0000","last_undegraded":"2024-08-18T22:24:41.039593+0000","last_fullsized":"2024-08-18T22:24:41.039593+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:18:28.647227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.023031+0000","last_change":"2024-08-18T22:24:39.023190+0000","last_active":"2024-08-18T22:24:41.023031+0000","last_peered":"2024-08-18T22:24:41.023031+0000","last_clean":"2024-08-18T22:24:41.023031+0000","last_became_active":"2024-08-18T22:24:39.022849+0000","last_became_peered":"2024-08-18T22:24:39.022849+0000","last_unstale":"2024-08-18T22:24:41.023031+0000","last_undegraded":"2024-08-18T22:24:41.023031+0000","last_fullsized":"2024-08-18T22:24:41.023031+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:17:05.426271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.015980+0000","last_change":"2024-08-18T22:24:40.030789+0000","last_active":"2024-08-18T22:24:41.015980+0000","last_peered":"2024-08-18T22:24:41.015980+0000","last_clean":"2024-08-18T22:24:41.015980+0000","last_became_active":"2024-08-18T22:24:40.030527+0000","last_became_peered":"2024-08-18T22:24:40.030527+0000","last_unstale":"2024-08-18T22:24:41.015980+0000","last_undegraded":"2024-08-18T22:24:41.015980+0000","last_fullsized":"2024-08-18T22:24:41.015980+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:51:45.828213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.015891+0000","last_change":"2024-08-18T22:24:39.022394+0000","last_active":"2024-08-18T22:24:41.015891+0000","last_peered":"2024-08-18T22:24:41.015891+0000","last_clean":"2024-08-18T22:24:41.015891+0000","last_became_active":"2024-08-18T22:24:39.022112+0000","last_became_peered":"2024-08-18T22:24:39.022112+0000","last_unstale":"2024-08-18T22:24:41.015891+0000","last_undegraded":"2024-08-18T22:24:41.015891+0000","last_fullsized":"2024-08-18T22:24:41.015891+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:28.317397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.039252+0000","last_change":"2024-08-18T22:24:40.019389+0000","last_active":"2024-08-18T22:24:41.039252+0000","last_peered":"2024-08-18T22:24:41.039252+0000","last_clean":"2024-08-18T22:24:41.039252+0000","last_became_active":"2024-08-18T22:24:40.019129+0000","last_became_peered":"2024-08-18T22:24:40.019129+0000","last_unstale":"2024-08-18T22:24:41.039252+0000","last_undegraded":"2024-08-18T22:24:41.039252+0000","last_fullsized":"2024-08-18T22:24:41.039252+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:25:55.931214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.016679+0000","last_change":"2024-08-18T22:24:39.018484+0000","last_active":"2024-08-18T22:24:41.016679+0000","last_peered":"2024-08-18T22:24:41.016679+0000","last_clean":"2024-08-18T22:24:41.016679+0000","last_became_active":"2024-08-18T22:24:39.018171+0000","last_became_peered":"2024-08-18T22:24:39.018171+0000","last_unstale":"2024-08-18T22:24:41.016679+0000","last_undegraded":"2024-08-18T22:24:41.016679+0000","last_fullsized":"2024-08-18T22:24:41.016679+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:03:48.055844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.017476+0000","last_change":"2024-08-18T22:24:40.024235+0000","last_active":"2024-08-18T22:24:41.017476+0000","last_peered":"2024-08-18T22:24:41.017476+0000","last_clean":"2024-08-18T22:24:41.017476+0000","last_became_active":"2024-08-18T22:24:40.023929+0000","last_became_peered":"2024-08-18T22:24:40.023929+0000","last_unstale":"2024-08-18T22:24:41.017476+0000","last_undegraded":"2024-08-18T22:24:41.017476+0000","last_fullsized":"2024-08-18T22:24:41.017476+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:38.988461+0000","last_clean_scrub_stamp":"2024-08-18T22:24:38.988461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:59:51.720807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.040767+0000","last_change":"2024-08-18T22:24:39.020024+0000","last_active":"2024-08-18T22:24:41.040767+0000","last_peered":"2024-08-18T22:24:41.040767+0000","last_clean":"2024-08-18T22:24:41.040767+0000","last_became_active":"2024-08-18T22:24:39.019744+0000","last_became_peered":"2024-08-18T22:24:39.019744+0000","last_unstale":"2024-08-18T22:24:41.040767+0000","last_undegraded":"2024-08-18T22:24:41.040767+0000","last_fullsized":"2024-08-18T22:24:41.040767+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:24:37.980641+0000","last_clean_scrub_stamp":"2024-08-18T22:24:37.980641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:02:42.283293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":324,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-08-18T22:24:41.016826+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:24:41.016826+0000","last_peered":"2024-08-18T22:24:41.016826+0000","last_clean":"2024-08-18T22:24:41.016826+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:24:41.016826+0000","last_undegraded":"2024-08-18T22:24:41.016826+0000","last_fullsized":"2024-08-18T22:24:41.016826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509510,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1789952,"data_stored":1142362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36528,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335312,"statfs":{"total":96636764160,"available":96599359488,"internally_reserved":0,"allocated":1208320,"data_stored":554154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509510,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36504,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335336,"statfs":{"total":96636764160,"available":96599384064,"internally_reserved":0,"allocated":1187840,"data_stored":551938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509511,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40664,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331176,"statfs":{"total":96636764160,"available":96595124224,"internally_reserved":0,"allocated":1187840,"data_stored":551938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509510,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40672,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331168,"statfs":{"total":96636764160,"available":96595116032,"internally_reserved":0,"allocated":1191936,"data_stored":552008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509511,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41268,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330572,"statfs":{"total":96636764160,"available":96594505728,"internally_reserved":0,"allocated":1806336,"data_stored":1144624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40668,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331172,"statfs":{"total":96636764160,"available":96595120128,"internally_reserved":0,"allocated":1196032,"data_stored":552098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1187840,"data_stored":551938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:24:49.097 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:24:49.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:24:49.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.281+0000 7f6b41a00640 1 Processor -- start 2024-08-18T22:24:49.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.281+0000 7f6b41a00640 1 -- start start 2024-08-18T22:24:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b41a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b3c15c560 0x7f6b3c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b41a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b3c15d4d0 0x7f6b3c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b41a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b3c0cfb00 con 0x7f6b3c15c180 2024-08-18T22:24:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b41a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6b3c15d040 con 0x7f6b3c15d4d0 2024-08-18T22:24:49.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b41a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6b3c15c9f0 con 0x7f6b3c15c560 2024-08-18T22:24:49.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6b3c15c180 0x7f6b3c0cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52244/0 (socket says 172.21.15.5:52244) 2024-08-18T22:24:49.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3aa00640 1 -- 172.21.15.5:0/3829741720 learned_addr learned my addr 172.21.15.5:0/3829741720 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:49.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b32000640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b3c15c560 0x7f6b3c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3b400640 1 --2- 172.21.15.5:0/3829741720 >> v2:172.21.15.117:3300/0 conn(0x7f6b3c15d4d0 0x7f6b3c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332714863 0 0) 0x7f6b3c0cfb00 con 0x7f6b3c15c180 2024-08-18T22:24:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b20003530 con 0x7f6b3c15c180 2024-08-18T22:24:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 663447028 0 0) 0x7f6b20003530 con 0x7f6b3c15c180 2024-08-18T22:24:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b3c15c560 msgr2=0x7f6b3c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b3c15c560 0x7f6b3c0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 >> v2:172.21.15.117:3300/0 conn(0x7f6b3c15d4d0 msgr2=0x7f6b3c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 --2- 172.21.15.5:0/3829741720 >> v2:172.21.15.117:3300/0 conn(0x7f6b3c15d4d0 0x7f6b3c06db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3c15ccd0 con 0x7f6b3c15c180 2024-08-18T22:24:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f6b2c001680 con 0x7f6b3c15c180 2024-08-18T22:24:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 >> v1:172.21.15.5:6789/0 conn(0x7f6b3c15c180 legacy=0x7f6b3c0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b200039c0 0x7f6b20003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b20004810 0x7f6b20004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b200051d0 0x7f6b2000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c15d040 con 0x7f6b200039c0 2024-08-18T22:24:49.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c15c9f0 con 0x7f6b20004810 2024-08-18T22:24:49.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2000bf10 con 0x7f6b200051d0 2024-08-18T22:24:49.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3aa00640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b200039c0 0x7f6b20003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b32000640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b20004810 0x7f6b20004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3b400640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b200051d0 0x7f6b2000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3aa00640 1 -- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b200051d0 msgr2=0x7f6b2000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:49.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3aa00640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b200051d0 0x7f6b2000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3aa00640 1 -- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b20004810 msgr2=0x7f6b20004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:49.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3aa00640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b20004810 0x7f6b20004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b3aa00640 1 -- 172.21.15.5:0/3829741720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b20003530 con 0x7f6b200039c0 2024-08-18T22:24:49.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.285+0000 7f6b32000640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b20004810 0x7f6b20004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:49.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b3aa00640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b200039c0 0x7f6b20003de0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00c240 tx=0x7f6b2c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9610cbb9fb885 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:49.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c007d40 con 0x7f6b200039c0 2024-08-18T22:24:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b2c0a9020 con 0x7f6b200039c0 2024-08-18T22:24:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b3a000640 1 -- 172.21.15.5:0/3829741720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0a5bc0 con 0x7f6b200039c0 2024-08-18T22:24:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b41a00640 1 -- 172.21.15.5:0/3829741720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b200039c0 msgr2=0x7f6b20003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b41a00640 1 --2- 172.21.15.5:0/3829741720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b200039c0 0x7f6b20003de0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00c240 tx=0x7f6b2c01cca0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b3b400640 1 -- 172.21.15.5:0/3829741720 reap_dead start 2024-08-18T22:24:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b41a00640 1 -- 172.21.15.5:0/3829741720 shutdown_connections 2024-08-18T22:24:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b41a00640 1 -- 172.21.15.5:0/3829741720 >> 172.21.15.5:0/3829741720 conn(0x7f6b3c0b1dc0 msgr2=0x7f6b3c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b41a00640 1 -- 172.21.15.5:0/3829741720 shutdown_connections 2024-08-18T22:24:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b41a00640 1 -- 172.21.15.5:0/3829741720 wait complete. 2024-08-18T22:24:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b41a00640 1 Processor -- start 2024-08-18T22:24:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.289+0000 7f6b41a00640 1 -- start start 2024-08-18T22:24:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b41a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b200039c0 0x7f6b3c152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b41a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b3c14f340 0x7f6b3c14f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b41a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b3c155180 0x7f6b3c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b41a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c06e450 con 0x7f6b3c14f340 2024-08-18T22:24:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b41a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c06e2d0 con 0x7f6b200039c0 2024-08-18T22:24:49.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b41a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6b3c06e5d0 con 0x7f6b3c155180 2024-08-18T22:24:49.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b32000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b3c14f340 0x7f6b3c14f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b32000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b3c14f340 0x7f6b3c14f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53616/0 (socket says 172.21.15.5:53616) 2024-08-18T22:24:49.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b32000640 1 -- 172.21.15.5:0/2522596588 learned_addr learned my addr 172.21.15.5:0/2522596588 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:49.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b3b400640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b3c155180 0x7f6b3c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b3aa00640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b200039c0 0x7f6b3c152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b32000640 1 -- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b3c155180 msgr2=0x7f6b3c155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b32000640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b3c155180 0x7f6b3c155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b32000640 1 -- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b200039c0 msgr2=0x7f6b3c152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b32000640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b200039c0 0x7f6b3c152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b32000640 1 -- 172.21.15.5:0/2522596588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3c156030 con 0x7f6b3c14f340 2024-08-18T22:24:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b32000640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b3c14f340 0x7f6b3c14f7c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009fd0 tx=0x7f6b24011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b33400640 1 -- 172.21.15.5:0/2522596588 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24004220 con 0x7f6b3c14f340 2024-08-18T22:24:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b33400640 1 -- 172.21.15.5:0/2522596588 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b240043c0 con 0x7f6b3c14f340 2024-08-18T22:24:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b33400640 1 -- 172.21.15.5:0/2522596588 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24015890 con 0x7f6b3c14f340 2024-08-18T22:24:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b41a00640 1 -- 172.21.15.5:0/2522596588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b3c156310 con 0x7f6b3c14f340 2024-08-18T22:24:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b41a00640 1 -- 172.21.15.5:0/2522596588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b3c1506a0 con 0x7f6b3c14f340 2024-08-18T22:24:49.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b41a00640 1 -- 172.21.15.5:0/2522596588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b3c06e9c0 con 0x7f6b3c14f340 2024-08-18T22:24:49.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.293+0000 7f6b33400640 1 -- 172.21.15.5:0/2522596588 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b24015a30 con 0x7f6b3c14f340 2024-08-18T22:24:49.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.297+0000 7f6b33400640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6b180678c0 0x7f6b18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.297+0000 7f6b33400640 1 -- 172.21.15.5:0/2522596588 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f6b24086380 con 0x7f6b3c14f340 2024-08-18T22:24:49.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.297+0000 7f6b3aa00640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6b180678c0 0x7f6b18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.297+0000 7f6b3aa00640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6b180678c0 0x7f6b18069d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0aa000 tx=0x7f6b3c0cfcd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:49.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.301+0000 7f6b33400640 1 -- 172.21.15.5:0/2522596588 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6b24019030 con 0x7f6b3c14f340 2024-08-18T22:24:49.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.525+0000 7f6b41a00640 1 -- 172.21.15.5:0/2522596588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6b3c0ce400 con 0x7f6b3c14f340 2024-08-18T22:24:49.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b33400640 1 -- 172.21.15.5:0/2522596588 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f6b240566d0 con 0x7f6b3c14f340 2024-08-18T22:24:49.530 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:24:49.530 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:24:49.530 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:24:49.530 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:24:49.530 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:24:49.530 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:24:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 -- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6b180678c0 msgr2=0x7f6b18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6b180678c0 0x7f6b18069d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0aa000 tx=0x7f6b3c0cfcd0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 -- 172.21.15.5:0/2522596588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b3c14f340 msgr2=0x7f6b3c14f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b3c14f340 0x7f6b3c14f7c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009fd0 tx=0x7f6b24011a60 comp rx=0 tx=0).stop 2024-08-18T22:24:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 -- 172.21.15.5:0/2522596588 shutdown_connections 2024-08-18T22:24:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6b180678c0 0x7f6b18069d80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b3c155180 0x7f6b3c155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b3c14f340 0x7f6b3c14f7c0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 --2- 172.21.15.5:0/2522596588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b200039c0 0x7f6b3c152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 -- 172.21.15.5:0/2522596588 >> 172.21.15.5:0/2522596588 conn(0x7f6b3c0b1dc0 msgr2=0x7f6b3c15ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 -- 172.21.15.5:0/2522596588 shutdown_connections 2024-08-18T22:24:49.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.529+0000 7f6b41a00640 1 -- 172.21.15.5:0/2522596588 wait complete. 2024-08-18T22:24:49.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18ac200640 1 Processor -- start 2024-08-18T22:24:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18ac200640 1 -- start start 2024-08-18T22:24:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18ac200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18a415c180 0x7f18a40b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18ac200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18a406fad0 0x7f18a415c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18ac200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a40b5e30 con 0x7f18a4071580 2024-08-18T22:24:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18ac200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f18a415caa0 con 0x7f18a406fad0 2024-08-18T22:24:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18ac200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18a40b6110 con 0x7f18a415c180 2024-08-18T22:24:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18a8e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18a406fad0 0x7f18a415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18a8e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18a406fad0 0x7f18a415c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53630/0 (socket says 172.21.15.5:53630) 2024-08-18T22:24:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18a8e00640 1 -- 172.21.15.5:0/3317398685 learned_addr learned my addr 172.21.15.5:0/3317398685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18a9800640 1 --2- 172.21.15.5:0/3317398685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18a415c180 0x7f18a40b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18a8e00640 1 -- 172.21.15.5:0/3317398685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18a415c180 msgr2=0x7f18a40b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18a8e00640 1 --2- 172.21.15.5:0/3317398685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18a415c180 0x7f18a40b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18a8e00640 1 -- 172.21.15.5:0/3317398685 >> v1:172.21.15.5:6789/0 conn(0x7f18a4071580 legacy=0x7f18a40d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18a8e00640 1 -- 172.21.15.5:0/3317398685 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a40b63f0 con 0x7f18a406fad0 2024-08-18T22:24:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.693+0000 7f18a3e00640 1 -- 172.21.15.5:0/3317398685 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045376256 0 0) 0x7f18a40b5e30 con 0x7f18a4071580 2024-08-18T22:24:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18a8e00640 1 --2- 172.21.15.5:0/3317398685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a406fad0 0x7f18a415c560 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f1890009870 tx=0x7f189001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc69755d0d8de60c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18a3e00640 1 -- 172.21.15.5:0/3317398685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18900b1070 con 0x7f18a406fad0 2024-08-18T22:24:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18a3e00640 1 -- 172.21.15.5:0/3317398685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18900ac600 con 0x7f18a406fad0 2024-08-18T22:24:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18a3e00640 1 -- 172.21.15.5:0/3317398685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18900ac9d0 con 0x7f18a406fad0 2024-08-18T22:24:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18ac200640 1 -- 172.21.15.5:0/3317398685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a406fad0 msgr2=0x7f18a415c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18ac200640 1 --2- 172.21.15.5:0/3317398685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a406fad0 0x7f18a415c560 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f1890009870 tx=0x7f189001c410 comp rx=0 tx=0).stop 2024-08-18T22:24:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18ac200640 1 -- 172.21.15.5:0/3317398685 shutdown_connections 2024-08-18T22:24:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18ac200640 1 --2- 172.21.15.5:0/3317398685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a406fad0 0x7f18a415c560 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18ac200640 1 --2- 172.21.15.5:0/3317398685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18a415c180 0x7f18a40b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18ac200640 1 -- 172.21.15.5:0/3317398685 >> 172.21.15.5:0/3317398685 conn(0x7f18a40b3eb0 msgr2=0x7f18a40b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18ac200640 1 -- 172.21.15.5:0/3317398685 shutdown_connections 2024-08-18T22:24:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18ac200640 1 -- 172.21.15.5:0/3317398685 wait complete. 2024-08-18T22:24:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.697+0000 7f18ac200640 1 Processor -- start 2024-08-18T22:24:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18ac200640 1 -- start start 2024-08-18T22:24:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18ac200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18a406fad0 0x7f18a413d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18ac200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18a4071580 0x7f18a4153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18ac200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a415c180 0x7f18a41584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18ac200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4168fd0 con 0x7f18a415c180 2024-08-18T22:24:49.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18ac200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4071e00 con 0x7f18a406fad0 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18ac200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18a4169150 con 0x7f18a4071580 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18aa200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a415c180 0x7f18a41584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18aa200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a415c180 0x7f18a41584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53642/0 (socket says 172.21.15.5:53642) 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18aa200640 1 -- 172.21.15.5:0/4068890339 learned_addr learned my addr 172.21.15.5:0/4068890339 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18a8e00640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18a4071580 0x7f18a4153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18a9800640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18a406fad0 0x7f18a413d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18aa200640 1 -- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18a4071580 msgr2=0x7f18a4153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18aa200640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18a4071580 0x7f18a4153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18aa200640 1 -- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18a406fad0 msgr2=0x7f18a413d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18aa200640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18a406fad0 0x7f18a413d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18aa200640 1 -- 172.21.15.5:0/4068890339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a4152680 con 0x7f18a415c180 2024-08-18T22:24:49.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18aa200640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a415c180 0x7f18a41584a0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f189c00c750 tx=0x7f189c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:49.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18a1600640 1 -- 172.21.15.5:0/4068890339 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c017070 con 0x7f18a415c180 2024-08-18T22:24:49.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18a1600640 1 -- 172.21.15.5:0/4068890339 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f189c003db0 con 0x7f18a415c180 2024-08-18T22:24:49.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18a1600640 1 -- 172.21.15.5:0/4068890339 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c00ce60 con 0x7f18a415c180 2024-08-18T22:24:49.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18ac200640 1 -- 172.21.15.5:0/4068890339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a4152960 con 0x7f18a415c180 2024-08-18T22:24:49.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18ac200640 1 -- 172.21.15.5:0/4068890339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a4152f20 con 0x7f18a415c180 2024-08-18T22:24:49.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.701+0000 7f18ac200640 1 -- 172.21.15.5:0/4068890339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a4153120 con 0x7f18a415c180 2024-08-18T22:24:49.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.705+0000 7f18a1600640 1 -- 172.21.15.5:0/4068890339 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f189c01a070 con 0x7f18a415c180 2024-08-18T22:24:49.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.705+0000 7f18a1600640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18840678c0 0x7f1884069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:49.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.705+0000 7f18a1600640 1 -- 172.21.15.5:0/4068890339 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f189c085370 con 0x7f18a415c180 2024-08-18T22:24:49.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.705+0000 7f18a9800640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18840678c0 0x7f1884069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:49.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.705+0000 7f18a9800640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18840678c0 0x7f1884069d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f18a41524e0 tx=0x7f1898008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:49.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.709+0000 7f18a1600640 1 -- 172.21.15.5:0/4068890339 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f18a4153120 con 0x7f18a415c180 2024-08-18T22:24:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.913+0000 7f18ac200640 1 -- 172.21.15.5:0/4068890339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18a415c560 con 0x7f18a415c180 2024-08-18T22:24:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.913+0000 7f18a1600640 1 -- 172.21.15.5:0/4068890339 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5219 (secure 0 0 0) 0x7f189c0556c0 con 0x7f18a415c180 2024-08-18T22:24:49.914 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:49.915 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"btime":"2024-08-18T22:24:43:020654+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/932174441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":932174441},{"type":"v1","addr":"172.21.15.117:6836","nonce":932174441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/314902070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":314902070},{"type":"v1","addr":"172.21.15.117:6837","nonce":314902070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3843758754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3843758754},{"type":"v1","addr":"172.21.15.5:6833","nonce":3843758754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:24:42.414435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7242":{"gid":7242,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3668199286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3668199286},{"type":"v1","addr":"172.21.15.5:6835","nonce":3668199286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7242,"qdb_cluster":[7242]},"id":6}]} 2024-08-18T22:24:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 72 2024-08-18T22:24:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 -- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18840678c0 msgr2=0x7f1884069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18840678c0 0x7f1884069d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f18a41524e0 tx=0x7f1898008040 comp rx=0 tx=0).stop 2024-08-18T22:24:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 -- 172.21.15.5:0/4068890339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a415c180 msgr2=0x7f18a41584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a415c180 0x7f18a41584a0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f189c00c750 tx=0x7f189c00cc10 comp rx=0 tx=0).stop 2024-08-18T22:24:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 -- 172.21.15.5:0/4068890339 shutdown_connections 2024-08-18T22:24:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18840678c0 0x7f1884069d80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18a415c180 0x7f18a41584a0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18a4071580 0x7f18a4153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 --2- 172.21.15.5:0/4068890339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18a406fad0 0x7f18a413d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 -- 172.21.15.5:0/4068890339 >> 172.21.15.5:0/4068890339 conn(0x7f18a40b3eb0 msgr2=0x7f18a40d2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 -- 172.21.15.5:0/4068890339 shutdown_connections 2024-08-18T22:24:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:49.917+0000 7f18ac200640 1 -- 172.21.15.5:0/4068890339 wait complete. 2024-08-18T22:24:50.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:24:39.405470+0000', 'modified': '2024-08-18T22:24:42.414435+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7242}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7242': {'gid': 7242, 'name': 'c', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/3668199286', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 3668199286}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 3668199286}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7242, 'qdb_cluster': [7242]} 2024-08-18T22:24:50.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:24:50.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-18T22:24:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.481+0000 7f2e1f000640 1 Processor -- start 2024-08-18T22:24:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.481+0000 7f2e1f000640 1 -- start start 2024-08-18T22:24:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e1f000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e18147dd0 0x7f2e180b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e1f000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e1806c3c0 0x7f2e1815e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e1f000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1806c850 con 0x7f2e1815ee30 2024-08-18T22:24:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e1f000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2e1815f7c0 con 0x7f2e1806c3c0 2024-08-18T22:24:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e1f000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2e180b6410 con 0x7f2e18147dd0 2024-08-18T22:24:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e0f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e1806c3c0 0x7f2e1815e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e0f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e1806c3c0 0x7f2e1815e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53652/0 (socket says 172.21.15.5:53652) 2024-08-18T22:24:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e0f400640 1 -- 172.21.15.5:0/3963751896 learned_addr learned my addr 172.21.15.5:0/3963751896 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e17e00640 1 --2- 172.21.15.5:0/3963751896 >> v2:172.21.15.117:3300/0 conn(0x7f2e18147dd0 0x7f2e180b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e0f400640 1 -- 172.21.15.5:0/3963751896 >> v2:172.21.15.117:3300/0 conn(0x7f2e18147dd0 msgr2=0x7f2e180b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e0f400640 1 --2- 172.21.15.5:0/3963751896 >> v2:172.21.15.117:3300/0 conn(0x7f2e18147dd0 0x7f2e180b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e0f400640 1 -- 172.21.15.5:0/3963751896 >> v1:172.21.15.5:6789/0 conn(0x7f2e1815ee30 legacy=0x7f2e18161ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.485+0000 7f2e0f400640 1 -- 172.21.15.5:0/3963751896 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1815f2a0 con 0x7f2e1806c3c0 2024-08-18T22:24:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e0f400640 1 --2- 172.21.15.5:0/3963751896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1806c3c0 0x7f2e1815e8f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f2e180d20a0 tx=0x7f2e0001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ed9bf2377e91f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:50.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e17400640 1 -- 172.21.15.5:0/3963751896 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e000b0070 con 0x7f2e1806c3c0 2024-08-18T22:24:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e17400640 1 -- 172.21.15.5:0/3963751896 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e000ab600 con 0x7f2e1806c3c0 2024-08-18T22:24:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e17400640 1 -- 172.21.15.5:0/3963751896 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e000ab9d0 con 0x7f2e1806c3c0 2024-08-18T22:24:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 -- 172.21.15.5:0/3963751896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1806c3c0 msgr2=0x7f2e1815e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 --2- 172.21.15.5:0/3963751896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1806c3c0 0x7f2e1815e8f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f2e180d20a0 tx=0x7f2e0001c490 comp rx=0 tx=0).stop 2024-08-18T22:24:50.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 -- 172.21.15.5:0/3963751896 shutdown_connections 2024-08-18T22:24:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 --2- 172.21.15.5:0/3963751896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1806c3c0 0x7f2e1815e8f0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 --2- 172.21.15.5:0/3963751896 >> v2:172.21.15.117:3300/0 conn(0x7f2e18147dd0 0x7f2e180b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 -- 172.21.15.5:0/3963751896 >> 172.21.15.5:0/3963751896 conn(0x7f2e180b65f0 msgr2=0x7f2e180b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 -- 172.21.15.5:0/3963751896 shutdown_connections 2024-08-18T22:24:50.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 -- 172.21.15.5:0/3963751896 wait complete. 2024-08-18T22:24:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 Processor -- start 2024-08-18T22:24:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 -- start start 2024-08-18T22:24:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e1806c3c0 0x7f2e18141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e18147dd0 0x7f2e18143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1815ee30 0x7f2e18147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2e180b5b30 con 0x7f2e1815ee30 2024-08-18T22:24:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1815f9e0 con 0x7f2e1806c3c0 2024-08-18T22:24:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1f000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2e180b5cb0 con 0x7f2e18147dd0 2024-08-18T22:24:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.489+0000 7f2e1d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1815ee30 0x7f2e18147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e1d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1815ee30 0x7f2e18147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53666/0 (socket says 172.21.15.5:53666) 2024-08-18T22:24:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e1d000640 1 -- 172.21.15.5:0/1932261397 learned_addr learned my addr 172.21.15.5:0/1932261397 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e0f400640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e18147dd0 0x7f2e18143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e17e00640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e1806c3c0 0x7f2e18141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e1d000640 1 -- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e18147dd0 msgr2=0x7f2e18143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e1d000640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e18147dd0 0x7f2e18143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e1d000640 1 -- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e1806c3c0 msgr2=0x7f2e18141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e1d000640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e1806c3c0 0x7f2e18141ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e1d000640 1 -- 172.21.15.5:0/1932261397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1815c620 con 0x7f2e1815ee30 2024-08-18T22:24:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e1d000640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1815ee30 0x7f2e18147120 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c730 tx=0x7f2e1000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e14c00640 1 -- 172.21.15.5:0/1932261397 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e10003b80 con 0x7f2e1815ee30 2024-08-18T22:24:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e14c00640 1 -- 172.21.15.5:0/1932261397 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e10003d20 con 0x7f2e1815ee30 2024-08-18T22:24:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e14c00640 1 -- 172.21.15.5:0/1932261397 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000aa30 con 0x7f2e1815ee30 2024-08-18T22:24:50.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e1f000640 1 -- 172.21.15.5:0/1932261397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e181424c0 con 0x7f2e1815ee30 2024-08-18T22:24:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e1f000640 1 -- 172.21.15.5:0/1932261397 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e18142a80 con 0x7f2e1815ee30 2024-08-18T22:24:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e14c00640 1 -- 172.21.15.5:0/1932261397 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e1000abd0 con 0x7f2e1815ee30 2024-08-18T22:24:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.493+0000 7f2e14c00640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2df40678f0 0x7f2df4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e14c00640 1 -- 172.21.15.5:0/1932261397 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f2e10085bf0 con 0x7f2e1815ee30 2024-08-18T22:24:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e17e00640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2df40678f0 0x7f2df4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 Processor -- start 2024-08-18T22:24:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 -- start start 2024-08-18T22:24:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e17e00640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2df40678f0 0x7f2df4069db0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2e08007a60 tx=0x7f2e08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873e2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e2670 0x55f687398450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 0x55f687398d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f68727efd0 con 0x55f6873e1d50 2024-08-18T22:24:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f6871e53c0 con 0x55f6873e2670 2024-08-18T22:24:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f68718af70 con 0x55f687398990 2024-08-18T22:24:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e17e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873e2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e17e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873e2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53668/0 (socket says 172.21.15.5:53668) 2024-08-18T22:24:50.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e17e00640 1 -- 172.21.15.5:0/81870459 learned_addr learned my addr 172.21.15.5:0/81870459 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e0f400640 1 --2- 172.21.15.5:0/81870459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e2670 0x55f687398450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e17e00640 1 -- 172.21.15.5:0/81870459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 msgr2=0x55f687398d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e17e00640 1 --2- 172.21.15.5:0/81870459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 0x55f687398d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e17e00640 1 -- 172.21.15.5:0/81870459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e2670 msgr2=0x55f687398450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e17e00640 1 --2- 172.21.15.5:0/81870459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e2670 0x55f687398450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e17e00640 1 -- 172.21.15.5:0/81870459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f68717f2e0 con 0x55f6873e1d50 2024-08-18T22:24:50.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e0f400640 1 --2- 172.21.15.5:0/81870459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e2670 0x55f687398450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:50.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e17e00640 1 --2- 172.21.15.5:0/81870459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873e2130 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f2e08007fd0 tx=0x7f2e08013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d685cf567d9d99 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:50.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e0cc00640 1 -- 172.21.15.5:0/81870459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0801c050 con 0x55f6873e1d50 2024-08-18T22:24:50.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e0cc00640 1 -- 172.21.15.5:0/81870459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e08026070 con 0x55f6873e1d50 2024-08-18T22:24:50.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e0cc00640 1 -- 172.21.15.5:0/81870459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08021640 con 0x55f6873e1d50 2024-08-18T22:24:50.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 -- 172.21.15.5:0/81870459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 msgr2=0x55f6873e2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 --2- 172.21.15.5:0/81870459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873e2130 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f2e08007fd0 tx=0x7f2e08013000 comp rx=0 tx=0).stop 2024-08-18T22:24:50.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 -- 172.21.15.5:0/81870459 shutdown_connections 2024-08-18T22:24:50.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 --2- 172.21.15.5:0/81870459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 0x55f687398d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 --2- 172.21.15.5:0/81870459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e2670 0x55f687398450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 --2- 172.21.15.5:0/81870459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873e2130 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 -- 172.21.15.5:0/81870459 >> 172.21.15.5:0/81870459 conn(0x55f687394910 msgr2=0x55f687396d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 -- 172.21.15.5:0/81870459 shutdown_connections 2024-08-18T22:24:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.497+0000 7f2e224ec000 1 -- 172.21.15.5:0/81870459 wait complete. 2024-08-18T22:24:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 -- start start 2024-08-18T22:24:50.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 Processor -- start 2024-08-18T22:24:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 0x55f6873cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f68739dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e2670 0x55f68739e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f68718ce40 con 0x55f6873e1d50 2024-08-18T22:24:50.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f6872a2af0 con 0x55f6873e2670 2024-08-18T22:24:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f687247450 con 0x55f687398990 2024-08-18T22:24:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 10 client.0 _ll_register_callbacks cb 0x55f687383630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:24:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e0f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f68739dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e0f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f68739dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53678/0 (socket says 172.21.15.5:53678) 2024-08-18T22:24:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e0f400640 1 -- 172.21.15.5:0/3442974806 learned_addr learned my addr 172.21.15.5:0/3442974806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e17e00640 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 0x55f6873cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e1d000640 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e2670 0x55f68739e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e0f400640 1 -- 172.21.15.5:0/3442974806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 msgr2=0x55f6873cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e0f400640 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 0x55f6873cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e0f400640 1 -- 172.21.15.5:0/3442974806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e2670 msgr2=0x55f68739e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:50.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e0f400640 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e2670 0x55f68739e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e0f400640 1 -- 172.21.15.5:0/3442974806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f68716cfd0 con 0x55f6873e1d50 2024-08-18T22:24:50.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e0f400640 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f68739dba0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f2e000097f0 tx=0x7f2e000046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f76633a8d35053 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:50.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e05600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:24:50.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e05600640 1 -- 172.21.15.5:0/3442974806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e000b0040 con 0x55f6873e1d50 2024-08-18T22:24:50.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 -- 172.21.15.5:0/3442974806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e08026070 con 0x55f6873e1d50 2024-08-18T22:24:50.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e05600640 1 -- 172.21.15.5:0/3442974806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f2e000abaa0 con 0x55f6873e1d50 2024-08-18T22:24:50.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e05600640 1 -- 172.21.15.5:0/3442974806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f2e000c2050 con 0x55f6873e1d50 2024-08-18T22:24:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 10 client.7404 fetch_fsmap learned FSMap version 72 2024-08-18T22:24:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 -- 172.21.15.5:0/3442974806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55f6872684d0 con 0x55f6873e1d50 2024-08-18T22:24:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e05600640 1 -- 172.21.15.5:0/3442974806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e08026070 con 0x55f6873e1d50 2024-08-18T22:24:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e05600640 1 -- 172.21.15.5:0/3442974806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7f2e000c5020 con 0x55f6873e1d50 2024-08-18T22:24:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 10 client.7404 fetch_fsmap finished waiting for FSMap version 72 2024-08-18T22:24:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 10 client.7404 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:24:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 20 client.7404 populate_metadata read hostname 'smithi005' 2024-08-18T22:24:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x55f6873d04f0 0x55f6873d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 4 client.7404 mds_command: new command op to 7242 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:24:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e224ec000 1 -- 172.21.15.5:0/3442974806 --> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f68717fc00 con 0x55f6873d04f0 2024-08-18T22:24:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.501+0000 7f2e17e00640 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x55f6873d04f0 0x55f6873d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e17e00640 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x55f6873d04f0 0x55f6873d08d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72469ccaaaa6af7f server_cookie=3a9627e945d4c564 in_seq=0 out_seq=0 2024-08-18T22:24:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e05600640 10 client.7404 ms_handle_connect on v2:172.21.15.5:6834/3668199286 2024-08-18T22:24:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e05600640 1 -- 172.21.15.5:0/3442974806 <== mds.0 v2:172.21.15.5:6834/3668199286 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f68717fc00 con 0x55f6873d04f0 2024-08-18T22:24:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e05600640 10 client.7404 handle_command_reply: tid=0 2024-08-18T22:24:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 1 client.7404 shutdown 2024-08-18T22:24:50.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 1 -- 172.21.15.5:0/3442974806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 msgr2=0x55f68739dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f68739dba0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f2e000097f0 tx=0x7f2e000046d0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 1 -- 172.21.15.5:0/3442974806 shutdown_connections 2024-08-18T22:24:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x55f6873d04f0 0x55f6873d08d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e2670 0x55f68739e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f68739dba0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 1 --2- 172.21.15.5:0/3442974806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 0x55f6873cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 1 -- 172.21.15.5:0/3442974806 >> 172.21.15.5:0/3442974806 conn(0x55f687394910 msgr2=0x55f687397520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e05600640 0 client.7404 ms_handle_reset on v2:172.21.15.5:6834/3668199286 2024-08-18T22:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 1 -- 172.21.15.5:0/3442974806 shutdown_connections 2024-08-18T22:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 1 -- 172.21.15.5:0/3442974806 wait complete. 2024-08-18T22:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.505+0000 7f2e224ec000 20 client.7404 trim_cache size 0 max 16384 2024-08-18T22:24:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 Processor -- start 2024-08-18T22:24:50.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 -- start start 2024-08-18T22:24:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687394910 0x55f6873e1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f687398990 0x55f6873e15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e1d50 0x55f6873f9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2e18202ef0 con 0x55f687398990 2024-08-18T22:24:50.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2e18145ce0 con 0x55f6873e1d50 2024-08-18T22:24:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2e18202a60 con 0x55f687394910 2024-08-18T22:24:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e0f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f687398990 0x55f6873e15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e0f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f687398990 0x55f6873e15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53682/0 (socket says 172.21.15.5:53682) 2024-08-18T22:24:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e0f400640 1 -- 172.21.15.5:0/1233924200 learned_addr learned my addr 172.21.15.5:0/1233924200 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e17e00640 1 --2- 172.21.15.5:0/1233924200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687394910 0x55f6873e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e1d000640 1 --2- 172.21.15.5:0/1233924200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e1d50 0x55f6873f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e0f400640 1 -- 172.21.15.5:0/1233924200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687394910 msgr2=0x55f6873e1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e0f400640 1 --2- 172.21.15.5:0/1233924200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687394910 0x55f6873e1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e0f400640 1 -- 172.21.15.5:0/1233924200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e1d50 msgr2=0x55f6873f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e0f400640 1 --2- 172.21.15.5:0/1233924200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e1d50 0x55f6873f9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e0f400640 1 -- 172.21.15.5:0/1233924200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6871deb30 con 0x55f687398990 2024-08-18T22:24:50.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e0f400640 1 --2- 172.21.15.5:0/1233924200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f687398990 0x55f6873e15a0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2e0001c4d0 tx=0x7f2e000a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10487f1acdffe129 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e07e00640 1 -- 172.21.15.5:0/1233924200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e000b0040 con 0x55f687398990 2024-08-18T22:24:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e07e00640 1 -- 172.21.15.5:0/1233924200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e00004230 con 0x55f687398990 2024-08-18T22:24:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e07e00640 1 -- 172.21.15.5:0/1233924200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00003620 con 0x55f687398990 2024-08-18T22:24:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 -- 172.21.15.5:0/1233924200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f687398990 msgr2=0x55f6873e15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 --2- 172.21.15.5:0/1233924200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f687398990 0x55f6873e15a0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2e0001c4d0 tx=0x7f2e000a8000 comp rx=0 tx=0).stop 2024-08-18T22:24:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 -- 172.21.15.5:0/1233924200 shutdown_connections 2024-08-18T22:24:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 --2- 172.21.15.5:0/1233924200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f6873e1d50 0x55f6873f9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 --2- 172.21.15.5:0/1233924200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f687398990 0x55f6873e15a0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 --2- 172.21.15.5:0/1233924200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687394910 0x55f6873e1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 -- 172.21.15.5:0/1233924200 >> 172.21.15.5:0/1233924200 conn(0x55f6873cf450 msgr2=0x55f6873e0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 -- 172.21.15.5:0/1233924200 shutdown_connections 2024-08-18T22:24:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 -- 172.21.15.5:0/1233924200 wait complete. 2024-08-18T22:24:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 -- start start 2024-08-18T22:24:50.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.525+0000 7f2e224ec000 1 Processor -- start 2024-08-18T22:24:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f687394910 0x55f6873f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 0x55f6873f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f68719e1d0 con 0x55f6873e1d50 2024-08-18T22:24:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f68717c900 con 0x55f687394910 2024-08-18T22:24:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f6871e46d0 con 0x55f687398990 2024-08-18T22:24:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 10 client.0 _ll_register_callbacks cb 0x7f2e000096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:24:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e1d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e1d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873f74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53692/0 (socket says 172.21.15.5:53692) 2024-08-18T22:24:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e1d000640 1 -- 172.21.15.5:0/416693390 learned_addr learned my addr 172.21.15.5:0/416693390 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e17e00640 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f687394910 0x55f6873f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e0f400640 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 0x55f6873f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e1d000640 1 -- 172.21.15.5:0/416693390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 msgr2=0x55f6873f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:50.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e1d000640 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 0x55f6873f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e1d000640 1 -- 172.21.15.5:0/416693390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f687394910 msgr2=0x55f6873f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:50.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e1d000640 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f687394910 0x55f6873f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e1d000640 1 -- 172.21.15.5:0/416693390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f687196810 con 0x55f6873e1d50 2024-08-18T22:24:50.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e1d000640 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873f74c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2e10001340 tx=0x7f2e1000ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da35ec532b887af5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:50.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e05600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:24:50.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e05600640 1 -- 172.21.15.5:0/416693390 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e10072070 con 0x55f6873e1d50 2024-08-18T22:24:50.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e05600640 1 -- 172.21.15.5:0/416693390 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f2e10052520 con 0x55f6873e1d50 2024-08-18T22:24:50.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 1 -- 172.21.15.5:0/416693390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e00004230 con 0x55f6873e1d50 2024-08-18T22:24:50.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e05600640 1 -- 172.21.15.5:0/416693390 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f2e1005e9e0 con 0x55f6873e1d50 2024-08-18T22:24:50.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 10 client.7410 fetch_fsmap learned FSMap version 72 2024-08-18T22:24:50.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 1 -- 172.21.15.5:0/416693390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55f68717bd30 con 0x55f6873e1d50 2024-08-18T22:24:50.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e05600640 1 -- 172.21.15.5:0/416693390 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e00004230 con 0x55f6873e1d50 2024-08-18T22:24:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e05600640 1 -- 172.21.15.5:0/416693390 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7f2e10055300 con 0x55f6873e1d50 2024-08-18T22:24:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 10 client.7410 fetch_fsmap finished waiting for FSMap version 72 2024-08-18T22:24:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 10 client.7410 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:24:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 20 client.7410 populate_metadata read hostname 'smithi005' 2024-08-18T22:24:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x55f6873e2670 0x55f68745d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 4 client.7410 mds_command: new command op to 7242 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:24:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 1 -- 172.21.15.5:0/416693390 --> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] -- command(tid 0: {"prefix": "status"}) -- 0x55f6871f2af0 con 0x55f6873e2670 2024-08-18T22:24:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e17e00640 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x55f6873e2670 0x55f68745d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e17e00640 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x55f6873e2670 0x55f68745d220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d12bbd21d87723c server_cookie=a3e1ed3dfbb80337 in_seq=0 out_seq=0 2024-08-18T22:24:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e05600640 10 client.7410 ms_handle_connect on v2:172.21.15.5:6834/3668199286 2024-08-18T22:24:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e05600640 1 -- 172.21.15.5:0/416693390 <== mds.0 v2:172.21.15.5:6834/3668199286 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f6871f2af0 con 0x55f6873e2670 2024-08-18T22:24:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e05600640 10 client.7410 handle_command_reply: tid=0 2024-08-18T22:24:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.529+0000 7f2e224ec000 1 client.7410 shutdown 2024-08-18T22:24:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e224ec000 1 -- 172.21.15.5:0/416693390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 msgr2=0x55f6873f74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e224ec000 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873f74c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2e10001340 tx=0x7f2e1000ce40 comp rx=0 tx=0).stop 2024-08-18T22:24:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e224ec000 1 -- 172.21.15.5:0/416693390 shutdown_connections 2024-08-18T22:24:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e224ec000 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x55f6873e2670 0x55f68745d220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e224ec000 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f6873e1d50 0x55f6873f74c0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e224ec000 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f687398990 0x55f6873f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e224ec000 1 --2- 172.21.15.5:0/416693390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f687394910 0x55f6873f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e224ec000 1 -- 172.21.15.5:0/416693390 >> 172.21.15.5:0/416693390 conn(0x55f6873cf450 msgr2=0x55f6873e1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:50.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e05600640 0 client.7410 ms_handle_reset on v2:172.21.15.5:6834/3668199286 2024-08-18T22:24:50.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e224ec000 1 -- 172.21.15.5:0/416693390 shutdown_connections 2024-08-18T22:24:50.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e224ec000 1 -- 172.21.15.5:0/416693390 wait complete. 2024-08-18T22:24:50.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e224ec000 20 client.7410 trim_cache size 0 max 16384 2024-08-18T22:24:50.550 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:24:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:24:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:24:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7242, 2024-08-18T22:24:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:24:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:24:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:24:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.524063914999999, 2024-08-18T22:24:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 72, 2024-08-18T22:24:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 97, 2024-08-18T22:24:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 97, 2024-08-18T22:24:50.551 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15.365801845 2024-08-18T22:24:50.551 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:24:50.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 -- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2df40678f0 msgr2=0x7f2df4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2df40678f0 0x7f2df4069db0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2e08007a60 tx=0x7f2e08008040 comp rx=0 tx=0).stop 2024-08-18T22:24:50.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 -- 172.21.15.5:0/1932261397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1815ee30 msgr2=0x7f2e18147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1815ee30 0x7f2e18147120 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c730 tx=0x7f2e1000cbf0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 -- 172.21.15.5:0/1932261397 shutdown_connections 2024-08-18T22:24:50.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2df40678f0 0x7f2df4069db0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1815ee30 0x7f2e18147120 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e18147dd0 0x7f2e18143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 --2- 172.21.15.5:0/1932261397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e1806c3c0 0x7f2e18141ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 -- 172.21.15.5:0/1932261397 >> 172.21.15.5:0/1932261397 conn(0x7f2e180b65f0 msgr2=0x7f2e180b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:50.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 -- 172.21.15.5:0/1932261397 shutdown_connections 2024-08-18T22:24:50.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.533+0000 7f2e1f000640 1 -- 172.21.15.5:0/1932261397 wait complete. 2024-08-18T22:24:50.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:24:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6f6800640 1 Processor -- start 2024-08-18T22:24:50.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6f6800640 1 -- start start 2024-08-18T22:24:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6f6800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6f015c180 0x7fd6f00b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6f6800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 0x7fd6f015c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6f6800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f00b5e30 con 0x7fd6f0071580 2024-08-18T22:24:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6f6800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f015caa0 con 0x7fd6f015c180 2024-08-18T22:24:50.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6f6800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f00b6110 con 0x7fd6f006fad0 2024-08-18T22:24:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6ef400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6f015c180 0x7fd6f00b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6e6a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 0x7fd6f015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6ef400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6f015c180 0x7fd6f00b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:55908/0 (socket says 172.21.15.5:55908) 2024-08-18T22:24:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6ef400640 1 -- 172.21.15.5:0/3498528839 learned_addr learned my addr 172.21.15.5:0/3498528839 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6efe00640 1 --1- 172.21.15.5:0/3498528839 >> v1:172.21.15.117:6789/0 conn(0x7fd6f0071580 0x7fd6f00d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:35804/0 (socket says 172.21.15.5:35804) 2024-08-18T22:24:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6ef400640 1 -- 172.21.15.5:0/3498528839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 msgr2=0x7fd6f015c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6ef400640 1 --2- 172.21.15.5:0/3498528839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 0x7fd6f015c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6ef400640 1 -- 172.21.15.5:0/3498528839 >> v1:172.21.15.117:6789/0 conn(0x7fd6f0071580 legacy=0x7fd6f00d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.697+0000 7fd6ef400640 1 -- 172.21.15.5:0/3498528839 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f00b63f0 con 0x7fd6f015c180 2024-08-18T22:24:50.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6ef400640 1 --2- 172.21.15.5:0/3498528839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f015c180 0x7fd6f00b57c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009870 tx=0x7fd6e001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce634b67f84d6841 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:50.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6eea00640 1 -- 172.21.15.5:0/3498528839 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00b1070 con 0x7fd6f015c180 2024-08-18T22:24:50.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6eea00640 1 -- 172.21.15.5:0/3498528839 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e00ac600 con 0x7fd6f015c180 2024-08-18T22:24:50.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6eea00640 1 -- 172.21.15.5:0/3498528839 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00ac9d0 con 0x7fd6f015c180 2024-08-18T22:24:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6f6800640 1 -- 172.21.15.5:0/3498528839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f015c180 msgr2=0x7fd6f00b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6f6800640 1 --2- 172.21.15.5:0/3498528839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f015c180 0x7fd6f00b57c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009870 tx=0x7fd6e001c410 comp rx=0 tx=0).stop 2024-08-18T22:24:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6f6800640 1 -- 172.21.15.5:0/3498528839 shutdown_connections 2024-08-18T22:24:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6f6800640 1 --2- 172.21.15.5:0/3498528839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 0x7fd6f015c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6f6800640 1 --2- 172.21.15.5:0/3498528839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f015c180 0x7fd6f00b57c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6f6800640 1 -- 172.21.15.5:0/3498528839 >> 172.21.15.5:0/3498528839 conn(0x7fd6f00b3eb0 msgr2=0x7fd6f00b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6f6800640 1 -- 172.21.15.5:0/3498528839 shutdown_connections 2024-08-18T22:24:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.701+0000 7fd6f6800640 1 -- 172.21.15.5:0/3498528839 wait complete. 2024-08-18T22:24:50.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6f6800640 1 Processor -- start 2024-08-18T22:24:50.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6f6800640 1 -- start start 2024-08-18T22:24:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6f6800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 0x7fd6f015ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6f6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6f0071580 0x7fd6f015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6f6800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f015c180 0x7fd6f01548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6f6800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0071da0 con 0x7fd6f0071580 2024-08-18T22:24:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6f6800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0168fd0 con 0x7fd6f015c180 2024-08-18T22:24:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6f6800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f006cc60 con 0x7fd6f006fad0 2024-08-18T22:24:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6f0071580 0x7fd6f015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6ef400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 0x7fd6f015ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6ef400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 0x7fd6f015ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:53416/0 (socket says 172.21.15.5:53416) 2024-08-18T22:24:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6ef400640 1 -- 172.21.15.5:0/1146641726 learned_addr learned my addr 172.21.15.5:0/1146641726 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6f0071580 0x7fd6f015b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53702/0 (socket says 172.21.15.5:53702) 2024-08-18T22:24:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6efe00640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f015c180 0x7fd6f01548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6ef400640 1 -- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f015c180 msgr2=0x7fd6f01548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6ef400640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f015c180 0x7fd6f01548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6ef400640 1 -- 172.21.15.5:0/1146641726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6f0071580 msgr2=0x7fd6f015b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6ef400640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6f0071580 0x7fd6f015b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6ef400640 1 -- 172.21.15.5:0/1146641726 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f006cf40 con 0x7fd6f006fad0 2024-08-18T22:24:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6e6a00640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6f0071580 0x7fd6f015b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6ef400640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 0x7fd6f015ab90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd6e001a040 tx=0x7fd6e001ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6e7e00640 1 -- 172.21.15.5:0/1146641726 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00b1040 con 0x7fd6f006fad0 2024-08-18T22:24:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6e7e00640 1 -- 172.21.15.5:0/1146641726 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e00bc070 con 0x7fd6f006fad0 2024-08-18T22:24:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6e7e00640 1 -- 172.21.15.5:0/1146641726 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00b7690 con 0x7fd6f006fad0 2024-08-18T22:24:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6f6800640 1 -- 172.21.15.5:0/1146641726 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f006d220 con 0x7fd6f006fad0 2024-08-18T22:24:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.705+0000 7fd6f6800640 1 -- 172.21.15.5:0/1146641726 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f006d7e0 con 0x7fd6f006fad0 2024-08-18T22:24:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.709+0000 7fd6f6800640 1 -- 172.21.15.5:0/1146641726 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f015c560 con 0x7fd6f006fad0 2024-08-18T22:24:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.709+0000 7fd6e7e00640 1 -- 172.21.15.5:0/1146641726 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6e00b7830 con 0x7fd6f006fad0 2024-08-18T22:24:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.709+0000 7fd6e7e00640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6cc0678c0 0x7fd6cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.709+0000 7fd6e7e00640 1 -- 172.21.15.5:0/1146641726 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fd6e0120a20 con 0x7fd6f006fad0 2024-08-18T22:24:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.709+0000 7fd6e6a00640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6cc0678c0 0x7fd6cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:50.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.709+0000 7fd6e6a00640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6cc0678c0 0x7fd6cc069d80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0160b00 tx=0x7fd6d8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:50.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.713+0000 7fd6e7e00640 1 -- 172.21.15.5:0/1146641726 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd6e0016150 con 0x7fd6f006fad0 2024-08-18T22:24:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.913+0000 7fd6f6800640 1 -- 172.21.15.5:0/1146641726 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd6f00cf7d0 con 0x7fd6f006fad0 2024-08-18T22:24:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6e7e00640 1 -- 172.21.15.5:0/1146641726 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) ==== 53+0+73 (secure 0 0 0) 0x7fd6e00f0df0 con 0x7fd6f006fad0 2024-08-18T22:24:50.917 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:24:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 -- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6cc0678c0 msgr2=0x7fd6cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6cc0678c0 0x7fd6cc069d80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0160b00 tx=0x7fd6d8009190 comp rx=0 tx=0).stop 2024-08-18T22:24:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 -- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 msgr2=0x7fd6f015ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 0x7fd6f015ab90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd6e001a040 tx=0x7fd6e001ac50 comp rx=0 tx=0).stop 2024-08-18T22:24:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 -- 172.21.15.5:0/1146641726 shutdown_connections 2024-08-18T22:24:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6cc0678c0 0x7fd6cc069d80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6f015c180 0x7fd6f01548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6f0071580 0x7fd6f015b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 --2- 172.21.15.5:0/1146641726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f006fad0 0x7fd6f015ab90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 -- 172.21.15.5:0/1146641726 >> 172.21.15.5:0/1146641726 conn(0x7fd6f00b3eb0 msgr2=0x7fd6f00d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 -- 172.21.15.5:0/1146641726 shutdown_connections 2024-08-18T22:24:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:50.917+0000 7fd6f6800640 1 -- 172.21.15.5:0/1146641726 wait complete. 2024-08-18T22:24:50.939 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:24:50.939 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:24:50.939 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:24:50.939 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:24:50.939 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:50.939 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:24:50.940 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:24:50.940 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:24:50.940 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:24:50.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:50.940 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:24:50.949 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:24:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:24:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:24:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:50.949 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:24:50.950 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42110sec preferred_lft 42110sec 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:50.951 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:24:50.952 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:50.952 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:24:50.952 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:24:50.952 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:24:50.952 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:50.952 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:24:50.952 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:24:50.952 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:24:50.952 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:24:50.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:50.953 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:24:51.017 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:24:51.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:51.019 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:24:51.073 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:24:51.073 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:24:51.073 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:24:51.073 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:24:51.073 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:24:51.074 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:24:51.074 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:24:51.074 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:24:51.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:24:51.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:24:51.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:24:51.074 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:24:51.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:24:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:24:51.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:51.212 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:24:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:24:51.264 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:24:51.264 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:24:51.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:51.265 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:24:51.331 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:24:51.332 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:51.384 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:24:51.384 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:24:51.384 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:51.435 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:24:51.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:51.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:51.525 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:51.525 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:24:51.525 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:24:51.542 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:51.542 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:24:51.542 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:24:51.542 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:24:51.542 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:24:51.550 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:24:51.550 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:24:51.550 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:24:51.550 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:24:51.550 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:24:51.551 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:24:51.551 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:24:51.551 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:24:51.554 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:24:51.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:51.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:51.575 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:24:51.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:24:51.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:24:51.684 INFO:teuthology.orchestra.run.smithi005.stdout:client7416 2024-08-18T22:24:51.684 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:51.684 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:51.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:51.693 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-08-18T22:24:51.754 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:24:51.755 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:24:51.755 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-08-18T22:24:51.755 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:24:51.755 DEBUG:teuthology.orchestra.run.smithi005:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-08-18T22:24:51.755 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:24:51.861 INFO:teuthology.orchestra.run.smithi005.stdout:1099511627776 2024-08-18T22:24:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:24:51.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:24:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9709400640 1 Processor -- start 2024-08-18T22:24:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9709400640 1 -- start start 2024-08-18T22:24:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9709400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9704161960 0x7f970406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9709400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9704070730 0x7f9704070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9709400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f970415dda0 0x7f970415e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9709400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f97040710e0 con 0x7f9704161960 2024-08-18T22:24:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9709400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f970415fcc0 con 0x7f9704070730 2024-08-18T22:24:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9709400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f970415eb60 con 0x7f970415dda0 2024-08-18T22:24:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9702800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9704161960 0x7f970406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9702800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9704161960 0x7f970406fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53716/0 (socket says 172.21.15.5:53716) 2024-08-18T22:24:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9702800640 1 -- 172.21.15.5:0/2737803583 learned_addr learned my addr 172.21.15.5:0/2737803583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9702800640 1 -- 172.21.15.5:0/2737803583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f970415dda0 msgr2=0x7f970415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9702800640 1 --2- 172.21.15.5:0/2737803583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f970415dda0 0x7f970415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9702800640 1 -- 172.21.15.5:0/2737803583 >> v2:172.21.15.117:3300/0 conn(0x7f9704070730 msgr2=0x7f9704070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9702800640 1 --2- 172.21.15.5:0/2737803583 >> v2:172.21.15.117:3300/0 conn(0x7f9704070730 0x7f9704070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.053+0000 7f9702800640 1 -- 172.21.15.5:0/2737803583 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970415ee40 con 0x7f9704161960 2024-08-18T22:24:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9702800640 1 --2- 172.21.15.5:0/2737803583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9704161960 0x7f970406fd20 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f9704071d80 tx=0x7f96f401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f8824cb083c9de server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9701e00640 1 -- 172.21.15.5:0/2737803583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f40b1070 con 0x7f9704161960 2024-08-18T22:24:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9701e00640 1 -- 172.21.15.5:0/2737803583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f40ac630 con 0x7f9704161960 2024-08-18T22:24:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9701e00640 1 -- 172.21.15.5:0/2737803583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f40a8050 con 0x7f9704161960 2024-08-18T22:24:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9709400640 1 -- 172.21.15.5:0/2737803583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9704161960 msgr2=0x7f970406fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9709400640 1 --2- 172.21.15.5:0/2737803583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9704161960 0x7f970406fd20 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f9704071d80 tx=0x7f96f401c520 comp rx=0 tx=0).stop 2024-08-18T22:24:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9709400640 1 -- 172.21.15.5:0/2737803583 shutdown_connections 2024-08-18T22:24:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9709400640 1 --2- 172.21.15.5:0/2737803583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f970415dda0 0x7f970415e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9709400640 1 --2- 172.21.15.5:0/2737803583 >> v2:172.21.15.117:3300/0 conn(0x7f9704070730 0x7f9704070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9709400640 1 --2- 172.21.15.5:0/2737803583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9704161960 0x7f970406fd20 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9709400640 1 -- 172.21.15.5:0/2737803583 >> 172.21.15.5:0/2737803583 conn(0x7f97040d2130 msgr2=0x7f97040d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9709400640 1 -- 172.21.15.5:0/2737803583 shutdown_connections 2024-08-18T22:24:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9709400640 1 -- 172.21.15.5:0/2737803583 wait complete. 2024-08-18T22:24:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.057+0000 7f9709400640 1 Processor -- start 2024-08-18T22:24:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9709400640 1 -- start start 2024-08-18T22:24:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9709400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9704070730 0x7f9704157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9709400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f970415dda0 0x7f9704169540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9709400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9704161960 0x7f9704169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9709400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f970409ba30 con 0x7f9704070730 2024-08-18T22:24:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9709400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f970415e770 con 0x7f970415dda0 2024-08-18T22:24:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9709400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f97040b7930 con 0x7f9704161960 2024-08-18T22:24:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9702800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9704070730 0x7f9704157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9702800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9704070730 0x7f9704157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53718/0 (socket says 172.21.15.5:53718) 2024-08-18T22:24:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9702800640 1 -- 172.21.15.5:0/4044523842 learned_addr learned my addr 172.21.15.5:0/4044523842 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9702800640 1 -- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9704161960 msgr2=0x7f9704169a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9702800640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9704161960 0x7f9704169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9702800640 1 -- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f970415dda0 msgr2=0x7f9704169540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9702800640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f970415dda0 0x7f9704169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9702800640 1 -- 172.21.15.5:0/4044523842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97040b7c10 con 0x7f9704070730 2024-08-18T22:24:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9702800640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9704070730 0x7f9704157510 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f96f401cdc0 tx=0x7f96f40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f96fb400640 1 -- 172.21.15.5:0/4044523842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f40b1040 con 0x7f9704070730 2024-08-18T22:24:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f96fb400640 1 -- 172.21.15.5:0/4044523842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f40ba070 con 0x7f9704070730 2024-08-18T22:24:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f96fb400640 1 -- 172.21.15.5:0/4044523842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f40a8040 con 0x7f9704070730 2024-08-18T22:24:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9709400640 1 -- 172.21.15.5:0/4044523842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97040b7ef0 con 0x7f9704070730 2024-08-18T22:24:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9709400640 1 -- 172.21.15.5:0/4044523842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97040b5300 con 0x7f9704070730 2024-08-18T22:24:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.061+0000 7f9709400640 1 -- 172.21.15.5:0/4044523842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9704070ba0 con 0x7f9704070730 2024-08-18T22:24:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.065+0000 7f96fb400640 1 -- 172.21.15.5:0/4044523842 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96f40b56a0 con 0x7f9704070730 2024-08-18T22:24:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.065+0000 7f96fb400640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e00678f0 0x7f96e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.065+0000 7f96fb400640 1 -- 172.21.15.5:0/4044523842 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f96f411fd70 con 0x7f9704070730 2024-08-18T22:24:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.065+0000 7f96f9e00640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e00678f0 0x7f96e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.065+0000 7f96f9e00640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e00678f0 0x7f96e0069db0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f97040cc440 tx=0x7f96ec006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.069+0000 7f96fb400640 1 -- 172.21.15.5:0/4044523842 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f96f4016110 con 0x7f9704070730 2024-08-18T22:24:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 -- 172.21.15.5:0/4044523842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97040d3010 con 0x7f9704070730 2024-08-18T22:24:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f96fb400640 1 -- 172.21.15.5:0/4044523842 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5219 (secure 0 0 0) 0x7f96f40f05f0 con 0x7f9704070730 2024-08-18T22:24:52.273 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:24:52.273 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"btime":"2024-08-18T22:24:43:020654+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/932174441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":932174441},{"type":"v1","addr":"172.21.15.117:6836","nonce":932174441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/314902070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":314902070},{"type":"v1","addr":"172.21.15.117:6837","nonce":314902070}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3843758754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3843758754},{"type":"v1","addr":"172.21.15.5:6833","nonce":3843758754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:24:42.414435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7242":{"gid":7242,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3668199286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3668199286},{"type":"v1","addr":"172.21.15.5:6835","nonce":3668199286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7242,"qdb_cluster":[7242]},"id":6}]} 2024-08-18T22:24:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 72 2024-08-18T22:24:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 -- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e00678f0 msgr2=0x7f96e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e00678f0 0x7f96e0069db0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f97040cc440 tx=0x7f96ec006ca0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 -- 172.21.15.5:0/4044523842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9704070730 msgr2=0x7f9704157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9704070730 0x7f9704157510 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f96f401cdc0 tx=0x7f96f40192c0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 -- 172.21.15.5:0/4044523842 shutdown_connections 2024-08-18T22:24:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96e00678f0 0x7f96e0069db0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9704161960 0x7f9704169a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f970415dda0 0x7f9704169540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 --2- 172.21.15.5:0/4044523842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9704070730 0x7f9704157510 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 -- 172.21.15.5:0/4044523842 >> 172.21.15.5:0/4044523842 conn(0x7f97040d2130 msgr2=0x7f97040b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 -- 172.21.15.5:0/4044523842 shutdown_connections 2024-08-18T22:24:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.273+0000 7f9709400640 1 -- 172.21.15.5:0/4044523842 wait complete. 2024-08-18T22:24:52.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-08-18T22:24:52.350 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:24:52.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:24:52.457 INFO:teuthology.orchestra.run.smithi005.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-08-18T22:24:51.749891+0000","btime":"2024-08-18T22:24:51.749891+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-08-18T22:24:51.749891+0000","atime":"2024-08-18T22:24:51.749891+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":7416,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":7416,"want_loner":7416,"mds_caps_wanted":[],"is_subvolume":false} 2024-08-18T22:24:52.458 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-08-18T22:24:51.749891+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-08-18T22:24:51.749891+0000", "change_attr": 0, "client_caps": [ { "client_id": 7416, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-08-18T22:24:51.749891+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 7416, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-08-18T22:24:51.749891+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 7416, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [] } 2024-08-18T22:24:52.458 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:52.458 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:52.509 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:24:52.509 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:24:52.509 DEBUG:teuthology.orchestra.run.smithi005:> import uuid 2024-08-18T22:24:52.509 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:24:52.509 DEBUG:teuthology.orchestra.run.smithi005:> n = 21 2024-08-18T22:24:52.509 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = False 2024-08-18T22:24:52.509 DEBUG:teuthology.orchestra.run.smithi005:> if 0 > 0: 2024-08-18T22:24:52.509 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = True 2024-08-18T22:24:52.509 DEBUG:teuthology.orchestra.run.smithi005:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-08-18T22:24:52.509 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> dpath = os.path.dirname(path) 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> fnameprefix = os.path.basename(path) 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> os.makedirs(dpath, exist_ok=True) 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> for i in range(n): 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> with open(fpath, '"'"'w'"'"') as f: 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> f.write(f"{i}") 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> f.flush() 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(f.fileno()) 2024-08-18T22:24:52.510 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:24:52.511 DEBUG:teuthology.orchestra.run.smithi005:> os.unlink(fpath) 2024-08-18T22:24:52.511 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:24:52.511 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-08-18T22:24:52.511 DEBUG:teuthology.orchestra.run.smithi005:> if create_hard_links: 2024-08-18T22:24:52.511 DEBUG:teuthology.orchestra.run.smithi005:> for j in range(0): 2024-08-18T22:24:52.511 DEBUG:teuthology.orchestra.run.smithi005:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-08-18T22:24:52.511 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:24:52.511 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-08-18T22:24:52.511 DEBUG:teuthology.orchestra.run.smithi005:> finally: 2024-08-18T22:24:52.511 DEBUG:teuthology.orchestra.run.smithi005:> os.close(dirfd) 2024-08-18T22:24:52.511 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:24:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:24:52.662 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:52.662 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:52.712 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:24:52.713 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:24:52.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:24:52.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a66400640 1 Processor -- start 2024-08-18T22:24:52.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a66400640 1 -- start start 2024-08-18T22:24:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a66400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a6015bd80 0x7f8a600aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a66400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a600af000 0x7f8a6015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a66400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a6015b140 con 0x7f8a6015ad60 2024-08-18T22:24:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a66400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8a60073990 con 0x7f8a600af000 2024-08-18T22:24:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a66400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8a600acf60 con 0x7f8a6015bd80 2024-08-18T22:24:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a65a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a600af000 0x7f8a6015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a65a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a600af000 0x7f8a6015eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53730/0 (socket says 172.21.15.5:53730) 2024-08-18T22:24:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a65a00640 1 -- 172.21.15.5:0/3572433372 learned_addr learned my addr 172.21.15.5:0/3572433372 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a5fe00640 1 --2- 172.21.15.5:0/3572433372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a6015bd80 0x7f8a600aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a65a00640 1 -- 172.21.15.5:0/3572433372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a6015bd80 msgr2=0x7f8a600aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a65a00640 1 --2- 172.21.15.5:0/3572433372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a6015bd80 0x7f8a600aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a65a00640 1 -- 172.21.15.5:0/3572433372 >> v1:172.21.15.117:6789/0 conn(0x7f8a6015ad60 legacy=0x7f8a60071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a65a00640 1 -- 172.21.15.5:0/3572433372 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a600ad240 con 0x7f8a600af000 2024-08-18T22:24:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.949+0000 7f8a5fe00640 1 --2- 172.21.15.5:0/3572433372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a6015bd80 0x7f8a600aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:52.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a65a00640 1 --2- 172.21.15.5:0/3572433372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a600af000 0x7f8a6015eb90 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009e50 tx=0x7f8a5801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979a6d2f58854548 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:52.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a5f400640 1 -- 172.21.15.5:0/3572433372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a580a5720 con 0x7f8a600af000 2024-08-18T22:24:52.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a5f400640 1 -- 172.21.15.5:0/3572433372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a580a58c0 con 0x7f8a600af000 2024-08-18T22:24:52.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a5f400640 1 -- 172.21.15.5:0/3572433372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a580a5c90 con 0x7f8a600af000 2024-08-18T22:24:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a66400640 1 -- 172.21.15.5:0/3572433372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a600af000 msgr2=0x7f8a6015eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a66400640 1 --2- 172.21.15.5:0/3572433372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a600af000 0x7f8a6015eb90 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009e50 tx=0x7f8a5801c900 comp rx=0 tx=0).stop 2024-08-18T22:24:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a66400640 1 -- 172.21.15.5:0/3572433372 shutdown_connections 2024-08-18T22:24:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a66400640 1 --2- 172.21.15.5:0/3572433372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a600af000 0x7f8a6015eb90 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a66400640 1 --2- 172.21.15.5:0/3572433372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a6015bd80 0x7f8a600aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a66400640 1 -- 172.21.15.5:0/3572433372 >> 172.21.15.5:0/3572433372 conn(0x7f8a6006bdb0 msgr2=0x7f8a6006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a66400640 1 -- 172.21.15.5:0/3572433372 shutdown_connections 2024-08-18T22:24:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a66400640 1 -- 172.21.15.5:0/3572433372 wait complete. 2024-08-18T22:24:52.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.953+0000 7f8a66400640 1 Processor -- start 2024-08-18T22:24:52.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a66400640 1 -- start start 2024-08-18T22:24:52.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a66400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a600af000 0x7f8a6015e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a66400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a6015ad60 0x7f8a6014cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a66400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a6015bd80 0x7f8a6015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a66400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600ad520 con 0x7f8a6015ad60 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a66400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6015c160 con 0x7f8a6015bd80 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a66400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8a600ad6a0 con 0x7f8a600af000 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a6015ad60 0x7f8a6014cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a6015ad60 0x7f8a6014cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53732/0 (socket says 172.21.15.5:53732) 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5fe00640 1 -- 172.21.15.5:0/3728609636 learned_addr learned my addr 172.21.15.5:0/3728609636 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a65a00640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a6015bd80 0x7f8a6015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a65000640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a600af000 0x7f8a6015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5fe00640 1 -- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a600af000 msgr2=0x7f8a6015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5fe00640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a600af000 0x7f8a6015e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5fe00640 1 -- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a6015bd80 msgr2=0x7f8a6015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5fe00640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a6015bd80 0x7f8a6015cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5fe00640 1 -- 172.21.15.5:0/3728609636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a60159e80 con 0x7f8a6015ad60 2024-08-18T22:24:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5fe00640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a6015ad60 0x7f8a6014cd80 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00c7f0 tx=0x7f8a4c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5cc00640 1 -- 172.21.15.5:0/3728609636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c015070 con 0x7f8a6015ad60 2024-08-18T22:24:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5cc00640 1 -- 172.21.15.5:0/3728609636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c007820 con 0x7f8a6015ad60 2024-08-18T22:24:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a5cc00640 1 -- 172.21.15.5:0/3728609636 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c007c10 con 0x7f8a6015ad60 2024-08-18T22:24:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a66400640 1 -- 172.21.15.5:0/3728609636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6014ddb0 con 0x7f8a6015ad60 2024-08-18T22:24:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a66400640 1 -- 172.21.15.5:0/3728609636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a600afe20 con 0x7f8a6015ad60 2024-08-18T22:24:52.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.957+0000 7f8a66400640 1 -- 172.21.15.5:0/3728609636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a600b5020 con 0x7f8a6015ad60 2024-08-18T22:24:52.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.961+0000 7f8a5cc00640 1 -- 172.21.15.5:0/3728609636 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a4c018070 con 0x7f8a6015ad60 2024-08-18T22:24:52.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.961+0000 7f8a5cc00640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a400678c0 0x7f8a40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:52.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.961+0000 7f8a5cc00640 1 -- 172.21.15.5:0/3728609636 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f8a4c085eb0 con 0x7f8a6015ad60 2024-08-18T22:24:52.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.961+0000 7f8a65000640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a400678c0 0x7f8a40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:52.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.961+0000 7f8a65000640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a400678c0 0x7f8a40069d80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8a54004e30 tx=0x7f8a54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:52.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:52.965+0000 7f8a5cc00640 1 -- 172.21.15.5:0/3728609636 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8a60159e80 con 0x7f8a6015ad60 2024-08-18T22:24:53.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.141+0000 7f8a66400640 1 -- 172.21.15.5:0/3728609636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8a6006c3e0 con 0x7f8a6015ad60 2024-08-18T22:24:53.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.141+0000 7f8a5cc00640 1 -- 172.21.15.5:0/3728609636 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v97) ==== 80+0+0 (secure 0 0 0) 0x7f8a4c056200 con 0x7f8a6015ad60 2024-08-18T22:24:53.143 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:24:53.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 -- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a400678c0 msgr2=0x7f8a40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a400678c0 0x7f8a40069d80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8a54004e30 tx=0x7f8a54009040 comp rx=0 tx=0).stop 2024-08-18T22:24:53.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 -- 172.21.15.5:0/3728609636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a6015ad60 msgr2=0x7f8a6014cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a6015ad60 0x7f8a6014cd80 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00c7f0 tx=0x7f8a4c00ccb0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 -- 172.21.15.5:0/3728609636 shutdown_connections 2024-08-18T22:24:53.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a400678c0 0x7f8a40069d80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a6015bd80 0x7f8a6015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a6015ad60 0x7f8a6014cd80 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 --2- 172.21.15.5:0/3728609636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a600af000 0x7f8a6015e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 -- 172.21.15.5:0/3728609636 >> 172.21.15.5:0/3728609636 conn(0x7f8a6006bdb0 msgr2=0x7f8a601647b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:53.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 -- 172.21.15.5:0/3728609636 shutdown_connections 2024-08-18T22:24:53.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.145+0000 7f8a66400640 1 -- 172.21.15.5:0/3728609636 wait complete. 2024-08-18T22:24:53.165 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:24:53.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:53.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:24:53.241 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:24:53.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:24:53.242 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:24:53.259 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-08-18T22:24:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.441+0000 7f3313c00640 1 Processor -- start 2024-08-18T22:24:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.441+0000 7f3313c00640 1 -- start start 2024-08-18T22:24:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.441+0000 7f3313c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f330c144050 0x7f330c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.441+0000 7f3313c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c06f3b0 0x7f330c144430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.441+0000 7f3313c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f330c06ddd0 con 0x7f330c147860 2024-08-18T22:24:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.441+0000 7f3313c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f330c06db80 con 0x7f330c144050 2024-08-18T22:24:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.441+0000 7f3313c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f330c06e9e0 con 0x7f330c06f3b0 2024-08-18T22:24:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f3311c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f330c147860 0x7f330c0b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52268/0 (socket says 172.21.15.5:52268) 2024-08-18T22:24:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f3311c00640 1 -- 172.21.15.5:0/3702990246 learned_addr learned my addr 172.21.15.5:0/3702990246 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f3311200640 1 --2- 172.21.15.5:0/3702990246 >> v2:172.21.15.117:3300/0 conn(0x7f330c144050 0x7f330c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f330be00640 1 --2- 172.21.15.5:0/3702990246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c06f3b0 0x7f330c144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f330b400640 1 -- 172.21.15.5:0/3702990246 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909364724 0 0) 0x7f330c06ddd0 con 0x7f330c147860 2024-08-18T22:24:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f330b400640 1 -- 172.21.15.5:0/3702990246 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32f0003530 con 0x7f330c147860 2024-08-18T22:24:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f3311200640 1 -- 172.21.15.5:0/3702990246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c06f3b0 msgr2=0x7f330c144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:53.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f3311200640 1 --2- 172.21.15.5:0/3702990246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c06f3b0 0x7f330c144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f3311200640 1 -- 172.21.15.5:0/3702990246 >> v1:172.21.15.5:6789/0 conn(0x7f330c147860 legacy=0x7f330c0b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f3311200640 1 -- 172.21.15.5:0/3702990246 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c06e0b0 con 0x7f330c144050 2024-08-18T22:24:53.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f3311200640 1 --2- 172.21.15.5:0/3702990246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c144050 0x7f330c06ee70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0097c0 tx=0x7f32fc01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c6706006ddb6306 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.445+0000 7f330b400640 1 -- 172.21.15.5:0/3702990246 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0b1070 con 0x7f330c144050 2024-08-18T22:24:53.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f330b400640 1 -- 172.21.15.5:0/3702990246 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc0a8050 con 0x7f330c144050 2024-08-18T22:24:53.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f330b400640 1 -- 172.21.15.5:0/3702990246 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0ac860 con 0x7f330c144050 2024-08-18T22:24:53.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 -- 172.21.15.5:0/3702990246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c144050 msgr2=0x7f330c06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 --2- 172.21.15.5:0/3702990246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c144050 0x7f330c06ee70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0097c0 tx=0x7f32fc01c3e0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 -- 172.21.15.5:0/3702990246 shutdown_connections 2024-08-18T22:24:53.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 --2- 172.21.15.5:0/3702990246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c06f3b0 0x7f330c144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 --2- 172.21.15.5:0/3702990246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c144050 0x7f330c06ee70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 -- 172.21.15.5:0/3702990246 >> 172.21.15.5:0/3702990246 conn(0x7f330c0b1dc0 msgr2=0x7f330c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:53.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 -- 172.21.15.5:0/3702990246 shutdown_connections 2024-08-18T22:24:53.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 -- 172.21.15.5:0/3702990246 wait complete. 2024-08-18T22:24:53.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 Processor -- start 2024-08-18T22:24:53.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 -- start start 2024-08-18T22:24:53.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c06f3b0 0x7f330c0cf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c144050 0x7f330c15e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c147860 0x7f330c156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f330c0b3950 con 0x7f330c147860 2024-08-18T22:24:53.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f330c0b37d0 con 0x7f330c144050 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3313c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f330c144970 con 0x7f330c06f3b0 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3311c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c147860 0x7f330c156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3311c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c147860 0x7f330c156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53746/0 (socket says 172.21.15.5:53746) 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3311c00640 1 -- 172.21.15.5:0/1245144351 learned_addr learned my addr 172.21.15.5:0/1245144351 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f330be00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c144050 0x7f330c15e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.449+0000 7f3311200640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c06f3b0 0x7f330c0cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3311c00640 1 -- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c06f3b0 msgr2=0x7f330c0cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3311c00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c06f3b0 0x7f330c0cf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3311c00640 1 -- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c144050 msgr2=0x7f330c15e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3311c00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c144050 0x7f330c15e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3311c00640 1 -- 172.21.15.5:0/1245144351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c0afa50 con 0x7f330c147860 2024-08-18T22:24:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f330be00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c144050 0x7f330c15e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:53.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3311c00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c147860 0x7f330c156100 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f330400cbe0 tx=0x7f330400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3308c00640 1 -- 172.21.15.5:0/1245144351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304017070 con 0x7f330c147860 2024-08-18T22:24:53.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3308c00640 1 -- 172.21.15.5:0/1245144351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330400ad40 con 0x7f330c147860 2024-08-18T22:24:53.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3308c00640 1 -- 172.21.15.5:0/1245144351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304012600 con 0x7f330c147860 2024-08-18T22:24:53.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3313c00640 1 -- 172.21.15.5:0/1245144351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330c0ce7d0 con 0x7f330c147860 2024-08-18T22:24:53.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3313c00640 1 -- 172.21.15.5:0/1245144351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330c157cf0 con 0x7f330c147860 2024-08-18T22:24:53.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3308c00640 1 -- 172.21.15.5:0/1245144351 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f330401a070 con 0x7f330c147860 2024-08-18T22:24:53.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.453+0000 7f3308c00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678f0 0x7f32ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3308c00640 1 -- 172.21.15.5:0/1245144351 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f3304085ac0 con 0x7f330c147860 2024-08-18T22:24:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311200640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678f0 0x7f32ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 Processor -- start 2024-08-18T22:24:53.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 -- start start 2024-08-18T22:24:53.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311200640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678f0 0x7f32ec069db0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0ae000 tx=0x7f32fc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea9219a0 0x558aea921d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9222c0 0x558aea8d4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea8d5500 0x558aea8d58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558aea7beae0 con 0x558aea9219a0 2024-08-18T22:24:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558aea7aaba0 con 0x558aea9222c0 2024-08-18T22:24:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558aea7254f0 con 0x558aea8d5500 2024-08-18T22:24:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea9219a0 0x558aea921d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea9219a0 0x558aea921d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53760/0 (socket says 172.21.15.5:53760) 2024-08-18T22:24:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311200640 1 -- 172.21.15.5:0/567557531 learned_addr learned my addr 172.21.15.5:0/567557531 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311c00640 1 --2- 172.21.15.5:0/567557531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea8d5500 0x558aea8d58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f330be00640 1 --2- 172.21.15.5:0/567557531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9222c0 0x558aea8d4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311200640 1 -- 172.21.15.5:0/567557531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea8d5500 msgr2=0x558aea8d58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311200640 1 --2- 172.21.15.5:0/567557531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea8d5500 0x558aea8d58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311200640 1 -- 172.21.15.5:0/567557531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9222c0 msgr2=0x558aea8d4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311200640 1 --2- 172.21.15.5:0/567557531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9222c0 0x558aea8d4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311200640 1 -- 172.21.15.5:0/567557531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aea6c5a90 con 0x558aea9219a0 2024-08-18T22:24:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f330be00640 1 --2- 172.21.15.5:0/567557531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9222c0 0x558aea8d4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:24:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3311200640 1 --2- 172.21.15.5:0/567557531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea9219a0 0x558aea921d80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f32fc01a010 tx=0x7f32fc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23354de3f444d752 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3301600640 1 -- 172.21.15.5:0/567557531 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0b1040 con 0x558aea9219a0 2024-08-18T22:24:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3301600640 1 -- 172.21.15.5:0/567557531 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc0c8070 con 0x558aea9219a0 2024-08-18T22:24:53.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f3301600640 1 -- 172.21.15.5:0/567557531 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0b8a80 con 0x558aea9219a0 2024-08-18T22:24:53.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 -- 172.21.15.5:0/567557531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea9219a0 msgr2=0x558aea921d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 --2- 172.21.15.5:0/567557531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea9219a0 0x558aea921d80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f32fc01a010 tx=0x7f32fc004740 comp rx=0 tx=0).stop 2024-08-18T22:24:53.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 -- 172.21.15.5:0/567557531 shutdown_connections 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 --2- 172.21.15.5:0/567557531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea8d5500 0x558aea8d58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 --2- 172.21.15.5:0/567557531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9222c0 0x558aea8d4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 --2- 172.21.15.5:0/567557531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea9219a0 0x558aea921d80 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 -- 172.21.15.5:0/567557531 >> 172.21.15.5:0/567557531 conn(0x558aea8cf010 msgr2=0x558aea904820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 -- 172.21.15.5:0/567557531 shutdown_connections 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.457+0000 7f331706a000 1 -- 172.21.15.5:0/567557531 wait complete. 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 -- start start 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 Processor -- start 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea901e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9219a0 0x558aea8dd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9222c0 0x558aea8dd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558aea7214b0 con 0x558aea8d5500 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558aea6dfb50 con 0x558aea9222c0 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558aea6c6d00 con 0x558aea9219a0 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 10 client.0 _ll_register_callbacks cb 0x558aea8c2f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f3311200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea901e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f3311200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea901e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53776/0 (socket says 172.21.15.5:53776) 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f3311200640 1 -- 172.21.15.5:0/3311077541 learned_addr learned my addr 172.21.15.5:0/3311077541 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f3311c00640 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9222c0 0x558aea8dd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f330be00640 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9219a0 0x558aea8dd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f3311200640 1 -- 172.21.15.5:0/3311077541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9219a0 msgr2=0x558aea8dd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f3311200640 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9219a0 0x558aea8dd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f3311200640 1 -- 172.21.15.5:0/3311077541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9222c0 msgr2=0x558aea8dd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:53.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f3311200640 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9222c0 0x558aea8dd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f3311200640 1 -- 172.21.15.5:0/3311077541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aea6de060 con 0x558aea8d5500 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f3311200640 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea901e30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f32fc01c8c0 tx=0x7f32fc01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d689f2269ea00 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f32f6000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f32f6000640 1 -- 172.21.15.5:0/3311077541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0b1040 con 0x558aea8d5500 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f32f6000640 1 -- 172.21.15.5:0/3311077541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f32fc0b88c0 con 0x558aea8d5500 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 -- 172.21.15.5:0/3311077541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32fc0c8070 con 0x558aea8d5500 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f32f6000640 1 -- 172.21.15.5:0/3311077541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f32fc0dc050 con 0x558aea8d5500 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 10 client.7440 fetch_fsmap learned FSMap version 72 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 -- 172.21.15.5:0/3311077541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x558aea6f1f50 con 0x558aea8d5500 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f32f6000640 1 -- 172.21.15.5:0/3311077541 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc0c8070 con 0x558aea8d5500 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f32f6000640 1 -- 172.21.15.5:0/3311077541 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7f32fc0df020 con 0x558aea8d5500 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 10 client.7440 fetch_fsmap finished waiting for FSMap version 72 2024-08-18T22:24:53.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 10 client.7440 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-08-18T22:24:53.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 20 client.7440 populate_metadata read hostname 'smithi005' 2024-08-18T22:24:53.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x558aea903d30 0x558aea904110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 4 client.7440 mds_command: new command op to 7242 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:24:53.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f331706a000 1 -- 172.21.15.5:0/3311077541 --> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558aea6bfe10 con 0x558aea903d30 2024-08-18T22:24:53.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.461+0000 7f330be00640 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x558aea903d30 0x558aea904110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f32f6000640 10 client.7440 ms_handle_connect on v2:172.21.15.5:6834/3668199286 2024-08-18T22:24:53.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f330be00640 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x558aea903d30 0x558aea904110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54f978ccb8ef3005 server_cookie=bed1132c2541dfb in_seq=0 out_seq=0 2024-08-18T22:24:53.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f32f6000640 1 -- 172.21.15.5:0/3311077541 <== mds.0 v2:172.21.15.5:6834/3668199286 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558aea6bfe10 con 0x558aea903d30 2024-08-18T22:24:53.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f32f6000640 10 client.7440 handle_command_reply: tid=0 2024-08-18T22:24:53.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 1 client.7440 shutdown 2024-08-18T22:24:53.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 1 -- 172.21.15.5:0/3311077541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 msgr2=0x558aea901e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea901e30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f32fc01c8c0 tx=0x7f32fc01ac20 comp rx=0 tx=0).stop 2024-08-18T22:24:53.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 1 -- 172.21.15.5:0/3311077541 shutdown_connections 2024-08-18T22:24:53.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x558aea903d30 0x558aea904110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9222c0 0x558aea8dd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9219a0 0x558aea8dd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 1 --2- 172.21.15.5:0/3311077541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea901e30 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 1 -- 172.21.15.5:0/3311077541 >> 172.21.15.5:0/3311077541 conn(0x558aea8cf010 msgr2=0x558aea8d46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:53.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f32f6000640 0 client.7440 ms_handle_reset on v2:172.21.15.5:6834/3668199286 2024-08-18T22:24:53.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 1 -- 172.21.15.5:0/3311077541 shutdown_connections 2024-08-18T22:24:53.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 1 -- 172.21.15.5:0/3311077541 wait complete. 2024-08-18T22:24:53.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.465+0000 7f331706a000 20 client.7440 trim_cache size 0 max 16384 2024-08-18T22:24:53.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 Processor -- start 2024-08-18T22:24:53.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 -- start start 2024-08-18T22:24:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea991200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9219a0 0x558aea991740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9222c0 0x558aea991c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f330c203870 con 0x558aea8d5500 2024-08-18T22:24:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f330c2028c0 con 0x558aea9219a0 2024-08-18T22:24:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f330c145830 con 0x558aea9222c0 2024-08-18T22:24:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3311200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea991200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3311200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea991200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53786/0 (socket says 172.21.15.5:53786) 2024-08-18T22:24:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3311200640 1 -- 172.21.15.5:0/1864842150 learned_addr learned my addr 172.21.15.5:0/1864842150 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3311c00640 1 --2- 172.21.15.5:0/1864842150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9222c0 0x558aea991c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f330be00640 1 --2- 172.21.15.5:0/1864842150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9219a0 0x558aea991740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3311200640 1 -- 172.21.15.5:0/1864842150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9222c0 msgr2=0x558aea991c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3311200640 1 --2- 172.21.15.5:0/1864842150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9222c0 0x558aea991c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3311200640 1 -- 172.21.15.5:0/1864842150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9219a0 msgr2=0x558aea991740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3311200640 1 --2- 172.21.15.5:0/1864842150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9219a0 0x558aea991740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3311200640 1 -- 172.21.15.5:0/1864842150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aea7a7dd0 con 0x558aea8d5500 2024-08-18T22:24:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3311200640 1 --2- 172.21.15.5:0/1864842150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea991200 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00b0b0 tx=0x7f32fc0d0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862a316adf7e1d72 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3300c00640 1 -- 172.21.15.5:0/1864842150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0b1070 con 0x558aea8d5500 2024-08-18T22:24:53.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3300c00640 1 -- 172.21.15.5:0/1864842150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc0c8070 con 0x558aea8d5500 2024-08-18T22:24:53.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f3300c00640 1 -- 172.21.15.5:0/1864842150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0b9810 con 0x558aea8d5500 2024-08-18T22:24:53.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 -- 172.21.15.5:0/1864842150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 msgr2=0x558aea991200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 --2- 172.21.15.5:0/1864842150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea991200 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00b0b0 tx=0x7f32fc0d0000 comp rx=0 tx=0).stop 2024-08-18T22:24:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 -- 172.21.15.5:0/1864842150 shutdown_connections 2024-08-18T22:24:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 --2- 172.21.15.5:0/1864842150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9222c0 0x558aea991c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 --2- 172.21.15.5:0/1864842150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9219a0 0x558aea991740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 --2- 172.21.15.5:0/1864842150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea991200 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 -- 172.21.15.5:0/1864842150 >> 172.21.15.5:0/1864842150 conn(0x558aea8cf010 msgr2=0x558aea903030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 -- 172.21.15.5:0/1864842150 shutdown_connections 2024-08-18T22:24:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 -- 172.21.15.5:0/1864842150 wait complete. 2024-08-18T22:24:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 -- start start 2024-08-18T22:24:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.481+0000 7f331706a000 1 Processor -- start 2024-08-18T22:24:53.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea995030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9219a0 0x558aea995570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9222c0 0x558aea995ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558aea724800 con 0x558aea8d5500 2024-08-18T22:24:53.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558aea6f07f0 con 0x558aea9219a0 2024-08-18T22:24:53.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558aea7aaba0 con 0x558aea9222c0 2024-08-18T22:24:53.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 10 client.0 _ll_register_callbacks cb 0x7f32f80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:24:53.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f3311200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea995030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f3311200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea995030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53796/0 (socket says 172.21.15.5:53796) 2024-08-18T22:24:53.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f3311200640 1 -- 172.21.15.5:0/2002534627 learned_addr learned my addr 172.21.15.5:0/2002534627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f330be00640 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9219a0 0x558aea995570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f3311c00640 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9222c0 0x558aea995ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f3311200640 1 -- 172.21.15.5:0/2002534627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9222c0 msgr2=0x558aea995ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f3311200640 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9222c0 0x558aea995ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f3311200640 1 -- 172.21.15.5:0/2002534627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9219a0 msgr2=0x558aea995570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f3311200640 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9219a0 0x558aea995570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f3311200640 1 -- 172.21.15.5:0/2002534627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aea6b8cd0 con 0x558aea8d5500 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f3311200640 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea995030 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0097c0 tx=0x7f32fc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02b40ba4ea3cd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f32f6000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f32f6000640 1 -- 172.21.15.5:0/2002534627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0b1040 con 0x558aea8d5500 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f32f6000640 1 -- 172.21.15.5:0/2002534627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f32fc0d7800 con 0x558aea8d5500 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 1 -- 172.21.15.5:0/2002534627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32fc0c8070 con 0x558aea8d5500 2024-08-18T22:24:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f32f6000640 1 -- 172.21.15.5:0/2002534627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f32fc0d7a00 con 0x558aea8d5500 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 10 client.7446 fetch_fsmap learned FSMap version 72 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 1 -- 172.21.15.5:0/2002534627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x558aea6cb320 con 0x558aea8d5500 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f32f6000640 1 -- 172.21.15.5:0/2002534627 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc0c8070 con 0x558aea8d5500 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f32f6000640 1 -- 172.21.15.5:0/2002534627 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7f32fc0df040 con 0x558aea8d5500 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 10 client.7446 fetch_fsmap finished waiting for FSMap version 72 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 10 client.7446 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 20 client.7446 populate_metadata read hostname 'smithi005' 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x558aea934410 0x558aea934820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 4 client.7446 mds_command: new command op to 7242 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f331706a000 1 -- 172.21.15.5:0/2002534627 --> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558aea732c20 con 0x558aea934410 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f330be00640 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x558aea934410 0x558aea934820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f32f6000640 10 client.7446 ms_handle_connect on v2:172.21.15.5:6834/3668199286 2024-08-18T22:24:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.485+0000 7f330be00640 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x558aea934410 0x558aea934820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=699fce7ecede20a7 server_cookie=17f9c229bc8df863 in_seq=0 out_seq=0 2024-08-18T22:24:53.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.497+0000 7f32f6000640 1 -- 172.21.15.5:0/2002534627 <== mds.0 v2:172.21.15.5:6834/3668199286 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558aea732c20 con 0x558aea934410 2024-08-18T22:24:53.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.497+0000 7f32f6000640 10 client.7446 handle_command_reply: tid=0 2024-08-18T22:24:53.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.497+0000 7f331706a000 1 client.7446 shutdown 2024-08-18T22:24:53.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f331706a000 1 -- 172.21.15.5:0/2002534627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 msgr2=0x558aea995030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f331706a000 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea995030 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0097c0 tx=0x7f32fc009190 comp rx=0 tx=0).stop 2024-08-18T22:24:53.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f331706a000 1 -- 172.21.15.5:0/2002534627 shutdown_connections 2024-08-18T22:24:53.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f331706a000 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.5:6834/3668199286,v1:172.21.15.5:6835/3668199286] conn(0x558aea934410 0x558aea934820 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f331706a000 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558aea9222c0 0x558aea995ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f331706a000 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558aea9219a0 0x558aea995570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f32f6000640 0 client.7446 ms_handle_reset on v2:172.21.15.5:6834/3668199286 2024-08-18T22:24:53.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f331706a000 1 --2- 172.21.15.5:0/2002534627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558aea8d5500 0x558aea995030 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f331706a000 1 -- 172.21.15.5:0/2002534627 >> 172.21.15.5:0/2002534627 conn(0x558aea8cf010 msgr2=0x558aea920f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:53.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f331706a000 1 -- 172.21.15.5:0/2002534627 shutdown_connections 2024-08-18T22:24:53.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f331706a000 1 -- 172.21.15.5:0/2002534627 wait complete. 2024-08-18T22:24:53.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f331706a000 20 client.7446 trim_cache size 0 max 16384 2024-08-18T22:24:53.505 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:24:53.505 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:24:53.505 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:24:53.506 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:24:53.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 -- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678f0 msgr2=0x7f32ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678f0 0x7f32ec069db0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0ae000 tx=0x7f32fc0a7000 comp rx=0 tx=0).stop 2024-08-18T22:24:53.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 -- 172.21.15.5:0/1245144351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c147860 msgr2=0x7f330c156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c147860 0x7f330c156100 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f330400cbe0 tx=0x7f330400a430 comp rx=0 tx=0).stop 2024-08-18T22:24:53.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 -- 172.21.15.5:0/1245144351 shutdown_connections 2024-08-18T22:24:53.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32ec0678f0 0x7f32ec069db0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f330c147860 0x7f330c156100 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f330c144050 0x7f330c15e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 --2- 172.21.15.5:0/1245144351 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f330c06f3b0 0x7f330c0cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 -- 172.21.15.5:0/1245144351 >> 172.21.15.5:0/1245144351 conn(0x7f330c0b1dc0 msgr2=0x7f330c0b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:53.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 -- 172.21.15.5:0/1245144351 shutdown_connections 2024-08-18T22:24:53.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.501+0000 7f3313c00640 1 -- 172.21.15.5:0/1245144351 wait complete. 2024-08-18T22:24:53.523 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:24:53.523 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:53.524 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:24:53.524 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:53.524 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:24:53.524 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:53.525 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:24:53.525 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:24:53.539 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:24:53.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-08-18T22:24:53.541 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:24:53.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-08-18T22:24:53.543 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:24:53.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-08-18T22:24:53.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce8a200640 1 Processor -- start 2024-08-18T22:24:53.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce8a200640 1 -- start start 2024-08-18T22:24:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce8a200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce84158710 0x7fce8406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce8a200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce8415e7b0 0x7fce8406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce8a200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce8415f780 con 0x7fce8406cf00 2024-08-18T22:24:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce8a200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fce8406d370 con 0x7fce8415e7b0 2024-08-18T22:24:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce8a200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fce8415ec10 con 0x7fce84158710 2024-08-18T22:24:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce83400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce84158710 0x7fce8406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce83400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce84158710 0x7fce8406ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:38990/0 (socket says 172.21.15.5:38990) 2024-08-18T22:24:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce83400640 1 -- 172.21.15.5:0/4114312285 learned_addr learned my addr 172.21.15.5:0/4114312285 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce83e00640 1 --1- 172.21.15.5:0/4114312285 >> v1:172.21.15.117:6789/0 conn(0x7fce8406cf00 0x7fce840ad8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:50482/0 (socket says 172.21.15.5:50482) 2024-08-18T22:24:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce82a00640 1 --2- 172.21.15.5:0/4114312285 >> v2:172.21.15.117:3300/0 conn(0x7fce8415e7b0 0x7fce8406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce83400640 1 -- 172.21.15.5:0/4114312285 >> v2:172.21.15.117:3300/0 conn(0x7fce8415e7b0 msgr2=0x7fce8406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce83400640 1 --2- 172.21.15.5:0/4114312285 >> v2:172.21.15.117:3300/0 conn(0x7fce8415e7b0 0x7fce8406c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce83400640 1 -- 172.21.15.5:0/4114312285 >> v1:172.21.15.117:6789/0 conn(0x7fce8406cf00 legacy=0x7fce840ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce83400640 1 -- 172.21.15.5:0/4114312285 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8415eee0 con 0x7fce84158710 2024-08-18T22:24:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce82000640 1 -- 172.21.15.5:0/4114312285 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390736091 0 0) 0x7fce8415f780 con 0x7fce8406cf00 2024-08-18T22:24:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.737+0000 7fce82a00640 1 --2- 172.21.15.5:0/4114312285 >> v2:172.21.15.117:3300/0 conn(0x7fce8415e7b0 0x7fce8406c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:24:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce83400640 1 --2- 172.21.15.5:0/4114312285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce84158710 0x7fce8406ef60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fce74009e50 tx=0x7fce7401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1013620d10c750e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce82000640 1 -- 172.21.15.5:0/4114312285 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce740a5700 con 0x7fce84158710 2024-08-18T22:24:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce82000640 1 -- 172.21.15.5:0/4114312285 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce740a58a0 con 0x7fce84158710 2024-08-18T22:24:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce82000640 1 -- 172.21.15.5:0/4114312285 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce740a5c70 con 0x7fce84158710 2024-08-18T22:24:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce8a200640 1 -- 172.21.15.5:0/4114312285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce84158710 msgr2=0x7fce8406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce8a200640 1 --2- 172.21.15.5:0/4114312285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce84158710 0x7fce8406ef60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fce74009e50 tx=0x7fce7401ca30 comp rx=0 tx=0).stop 2024-08-18T22:24:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce8a200640 1 -- 172.21.15.5:0/4114312285 shutdown_connections 2024-08-18T22:24:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce8a200640 1 --2- 172.21.15.5:0/4114312285 >> v2:172.21.15.117:3300/0 conn(0x7fce8415e7b0 0x7fce8406c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce8a200640 1 --2- 172.21.15.5:0/4114312285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce84158710 0x7fce8406ef60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce8a200640 1 -- 172.21.15.5:0/4114312285 >> 172.21.15.5:0/4114312285 conn(0x7fce84072350 msgr2=0x7fce84072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce8a200640 1 -- 172.21.15.5:0/4114312285 shutdown_connections 2024-08-18T22:24:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.741+0000 7fce8a200640 1 -- 172.21.15.5:0/4114312285 wait complete. 2024-08-18T22:24:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce8a200640 1 Processor -- start 2024-08-18T22:24:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce8a200640 1 -- start start 2024-08-18T22:24:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce8a200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce8406cf00 0x7fce8414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce8a200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce84158710 0x7fce84157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce8a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce8415e7b0 0x7fce84157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce8a200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fce84158af0 con 0x7fce8415e7b0 2024-08-18T22:24:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce8a200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fce840b03a0 con 0x7fce84158710 2024-08-18T22:24:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce8a200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fce84158c70 con 0x7fce8406cf00 2024-08-18T22:24:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce83e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce8415e7b0 0x7fce84157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce82a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce84158710 0x7fce84157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce83400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce8406cf00 0x7fce8414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce82a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce84158710 0x7fce84157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:45732/0 (socket says 172.21.15.5:45732) 2024-08-18T22:24:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce82a00640 1 -- 172.21.15.5:0/1350172830 learned_addr learned my addr 172.21.15.5:0/1350172830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce82a00640 1 -- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce8406cf00 msgr2=0x7fce8414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce82a00640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce8406cf00 0x7fce8414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce82a00640 1 -- 172.21.15.5:0/1350172830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce8415e7b0 msgr2=0x7fce84157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce82a00640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce8415e7b0 0x7fce84157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce82a00640 1 -- 172.21.15.5:0/1350172830 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce840cf870 con 0x7fce84158710 2024-08-18T22:24:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce82a00640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce84158710 0x7fce84157340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fce7000e980 tx=0x7fce7000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fe4afa00640 1 Processor -- start 2024-08-18T22:24:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fc7c0e00640 1 Processor -- start 2024-08-18T22:24:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fe4afa00640 1 -- start start 2024-08-18T22:24:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce7b400640 1 -- 172.21.15.5:0/1350172830 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70017070 con 0x7fce84158710 2024-08-18T22:24:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fc7c0e00640 1 -- start start 2024-08-18T22:24:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce7b400640 1 -- 172.21.15.5:0/1350172830 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce7000ca00 con 0x7fce84158710 2024-08-18T22:24:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce8a200640 1 -- 172.21.15.5:0/1350172830 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce840cfb50 con 0x7fce84158710 2024-08-18T22:24:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce7b400640 1 -- 172.21.15.5:0/1350172830 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7000cdd0 con 0x7fce84158710 2024-08-18T22:24:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.745+0000 7fce8a200640 1 -- 172.21.15.5:0/1350172830 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce840d0110 con 0x7fce84158710 2024-08-18T22:24:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fce8a200640 1 -- 172.21.15.5:0/1350172830 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce840b60e0 con 0x7fce84158710 2024-08-18T22:24:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fe4afa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe4a815c180 0x7fe4a80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7c0e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c360 0x7fc7bc160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7c0e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc7bc15d290 0x7fc7bc15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7c0e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7bc15d9e0 con 0x7fc7bc15c740 2024-08-18T22:24:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7c0e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc7bc15dcc0 con 0x7fc7bc15d290 2024-08-18T22:24:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7c0e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc7bc15dfa0 con 0x7fc7bc15c360 2024-08-18T22:24:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fe4afa00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a80cfb00 con 0x7fe4a815c560 2024-08-18T22:24:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fe4afa00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a815c9f0 con 0x7fe4a815d4d0 2024-08-18T22:24:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fe4afa00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a815d040 con 0x7fe4a815c180 2024-08-18T22:24:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fe4ad000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe4a815c180 0x7fe4a80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fe4a7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe4a815c560 0x7fe4a80ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39924/0 (socket says 172.21.15.5:39924) 2024-08-18T22:24:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fe4a7e00640 1 -- 172.21.15.5:0/1673438576 learned_addr learned my addr 172.21.15.5:0/1673438576 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:24:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7b9e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c360 0x7fc7bc160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7b9e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c360 0x7fc7bc160680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:39010/0 (socket says 172.21.15.5:39010) 2024-08-18T22:24:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7b9e00640 1 -- 172.21.15.5:0/2255160725 learned_addr learned my addr 172.21.15.5:0/2255160725 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7ba800640 1 --2- 172.21.15.5:0/2255160725 >> v2:172.21.15.5:3300/0 conn(0x7fc7bc15d290 0x7fc7bc15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fce7b400640 1 -- 172.21.15.5:0/1350172830 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fce7001a070 con 0x7fce84158710 2024-08-18T22:24:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fe4ad000640 1 -- 172.21.15.5:0/1673438576 >> v1:172.21.15.117:6789/0 conn(0x7fe4a815d4d0 legacy=0x7fe4a806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fe4ad000640 1 -- 172.21.15.5:0/1673438576 >> v1:172.21.15.5:6789/0 conn(0x7fe4a815c560 legacy=0x7fe4a80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fe4ad000640 1 -- 172.21.15.5:0/1673438576 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a815ccd0 con 0x7fe4a815c180 2024-08-18T22:24:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7b9e00640 1 -- 172.21.15.5:0/2255160725 >> v2:172.21.15.5:3300/0 conn(0x7fc7bc15d290 msgr2=0x7fc7bc15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7b9e00640 1 --2- 172.21.15.5:0/2255160725 >> v2:172.21.15.5:3300/0 conn(0x7fc7bc15d290 0x7fc7bc15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7b9e00640 1 -- 172.21.15.5:0/2255160725 >> v1:172.21.15.5:6789/0 conn(0x7fc7bc15c740 legacy=0x7fc7bc15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fc7b9e00640 1 -- 172.21.15.5:0/2255160725 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7bc15e280 con 0x7fc7bc15c360 2024-08-18T22:24:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fce7b400640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fce640678c0 0x7fce64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fce7b400640 1 -- 172.21.15.5:0/1350172830 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fce700860c0 con 0x7fce84158710 2024-08-18T22:24:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.749+0000 7fce83400640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fce640678c0 0x7fce64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fce83400640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fce640678c0 0x7fce64069d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fce740ae000 tx=0x7fce740a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7b9e00640 1 --2- 172.21.15.5:0/2255160725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c360 0x7fc7bc160680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009870 tx=0x7fc7a401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc03e511175b9dbb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fe4ad000640 1 --2- 172.21.15.5:0/1673438576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a815c180 0x7fe4a80cdf10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0097c0 tx=0x7fe49c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=881faf939003924f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7b8a00640 1 -- 172.21.15.5:0/2255160725 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40b2070 con 0x7fc7bc15c360 2024-08-18T22:24:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7b8a00640 1 -- 172.21.15.5:0/2255160725 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a40a9070 con 0x7fc7bc15c360 2024-08-18T22:24:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7b8a00640 1 -- 172.21.15.5:0/2255160725 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40ad880 con 0x7fc7bc15c360 2024-08-18T22:24:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7c0e00640 1 -- 172.21.15.5:0/2255160725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c360 msgr2=0x7fc7bc160680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7c0e00640 1 --2- 172.21.15.5:0/2255160725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c360 0x7fc7bc160680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009870 tx=0x7fc7a401c560 comp rx=0 tx=0).stop 2024-08-18T22:24:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7c0e00640 1 -- 172.21.15.5:0/2255160725 shutdown_connections 2024-08-18T22:24:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7c0e00640 1 --2- 172.21.15.5:0/2255160725 >> v2:172.21.15.5:3300/0 conn(0x7fc7bc15d290 0x7fc7bc15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7c0e00640 1 --2- 172.21.15.5:0/2255160725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c360 0x7fc7bc160680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7c0e00640 1 -- 172.21.15.5:0/2255160725 >> 172.21.15.5:0/2255160725 conn(0x7fc7bc0b65f0 msgr2=0x7fc7bc0b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7c0e00640 1 -- 172.21.15.5:0/2255160725 shutdown_connections 2024-08-18T22:24:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fc7c0e00640 1 -- 172.21.15.5:0/2255160725 wait complete. 2024-08-18T22:24:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.753+0000 7fe4a7400640 1 -- 172.21.15.5:0/1673438576 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0ab430 con 0x7fe4a815c180 2024-08-18T22:24:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fe4a7400640 1 -- 172.21.15.5:0/1673438576 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe49c0b0070 con 0x7fe4a815c180 2024-08-18T22:24:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fe4a7400640 1 -- 172.21.15.5:0/1673438576 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0ab7f0 con 0x7fe4a815c180 2024-08-18T22:24:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fce7b400640 1 -- 172.21.15.5:0/1350172830 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fce70056380 con 0x7fce84158710 2024-08-18T22:24:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7c0e00640 1 Processor -- start 2024-08-18T22:24:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fe4afa00640 1 -- 172.21.15.5:0/1673438576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a815c180 msgr2=0x7fe4a80cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fe4afa00640 1 --2- 172.21.15.5:0/1673438576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a815c180 0x7fe4a80cdf10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0097c0 tx=0x7fe49c01c410 comp rx=0 tx=0).stop 2024-08-18T22:24:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7c0e00640 1 -- start start 2024-08-18T22:24:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fe4afa00640 1 -- 172.21.15.5:0/1673438576 shutdown_connections 2024-08-18T22:24:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fe4afa00640 1 --2- 172.21.15.5:0/1673438576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a815c180 0x7fe4a80cdf10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fe4afa00640 1 -- 172.21.15.5:0/1673438576 >> 172.21.15.5:0/1673438576 conn(0x7fe4a80b1dc0 msgr2=0x7fe4a80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fe4afa00640 1 -- 172.21.15.5:0/1673438576 shutdown_connections 2024-08-18T22:24:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fe4afa00640 1 -- 172.21.15.5:0/1673438576 wait complete. 2024-08-18T22:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7c0e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7bc15c360 0x7fc7bc09eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7c0e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c740 0x7fc7bc148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7c0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7bc15d290 0x7fc7bc09ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7c0e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc15f880 con 0x7fc7bc15d290 2024-08-18T22:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7c0e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc15f700 con 0x7fc7bc15c360 2024-08-18T22:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7c0e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc7bc15fa00 con 0x7fc7bc15c740 2024-08-18T22:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7ba800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7bc15d290 0x7fc7bc09ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7b9400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c740 0x7fc7bc148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7b9e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7bc15c360 0x7fc7bc09eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7b9400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c740 0x7fc7bc148ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:39014/0 (socket says 172.21.15.5:39014) 2024-08-18T22:24:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7b9400640 1 -- 172.21.15.5:0/1367378469 learned_addr learned my addr 172.21.15.5:0/1367378469 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7ba800640 1 -- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c740 msgr2=0x7fc7bc148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7ba800640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c740 0x7fc7bc148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7ba800640 1 -- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7bc15c360 msgr2=0x7fc7bc09eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7ba800640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7bc15c360 0x7fc7bc09eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7ba800640 1 -- 172.21.15.5:0/1367378469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7bc14f370 con 0x7fc7bc15d290 2024-08-18T22:24:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fe4afa00640 1 Processor -- start 2024-08-18T22:24:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fe4afa00640 1 -- start start 2024-08-18T22:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7ba800640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7bc15d290 0x7fc7bc09ca50 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400eba0 tx=0x7fc7b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7b2000640 1 -- 172.21.15.5:0/1367378469 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4018020 con 0x7fc7bc15d290 2024-08-18T22:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7b2000640 1 -- 172.21.15.5:0/1367378469 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b400cd20 con 0x7fc7bc15d290 2024-08-18T22:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7c0e00640 1 -- 172.21.15.5:0/1367378469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7bc14f650 con 0x7fc7bc15d290 2024-08-18T22:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7b2000640 1 -- 172.21.15.5:0/1367378469 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40146c0 con 0x7fc7bc15d290 2024-08-18T22:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.757+0000 7fc7c0e00640 1 -- 172.21.15.5:0/1367378469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7bc15b9c0 con 0x7fc7bc15d290 2024-08-18T22:24:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4afa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a815c180 0x7fe4a8155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4afa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a815d4d0 0x7fe4a8155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4afa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4a8149c90 0x7fe4a809d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4afa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a816a2c0 con 0x7fe4a815d4d0 2024-08-18T22:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4afa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a816a140 con 0x7fe4a815c180 2024-08-18T22:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4afa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a816a440 con 0x7fe4a8149c90 2024-08-18T22:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a815d4d0 0x7fe4a8155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4ad000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a815c180 0x7fe4a8155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a815d4d0 0x7fe4a8155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40332/0 (socket says 172.21.15.5:40332) 2024-08-18T22:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4ad000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a815c180 0x7fe4a8155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:45740/0 (socket says 172.21.15.5:45740) 2024-08-18T22:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4a7e00640 1 -- 172.21.15.5:0/2416480955 learned_addr learned my addr 172.21.15.5:0/2416480955 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4ada00640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4a8149c90 0x7fe4a809d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fc7c0e00640 1 -- 172.21.15.5:0/1367378469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7bc160680 con 0x7fc7bc15d290 2024-08-18T22:24:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4ad000640 1 -- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4a8149c90 msgr2=0x7fe4a809d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4ad000640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4a8149c90 0x7fe4a809d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4ad000640 1 -- 172.21.15.5:0/2416480955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a815d4d0 msgr2=0x7fe4a8155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4ad000640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a815d4d0 0x7fe4a8155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4ad000640 1 -- 172.21.15.5:0/2416480955 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a8159640 con 0x7fe4a815c180 2024-08-18T22:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4ad000640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a815c180 0x7fe4a8155630 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0ac000 tx=0x7fe49c01ac50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4a4c00640 1 -- 172.21.15.5:0/2416480955 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0bf610 con 0x7fe4a815c180 2024-08-18T22:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4a4c00640 1 -- 172.21.15.5:0/2416480955 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a80ced70 con 0x7fe4a815c180 2024-08-18T22:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4afa00640 1 -- 172.21.15.5:0/2416480955 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a814a200 con 0x7fe4a815c180 2024-08-18T22:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4a4c00640 1 -- 172.21.15.5:0/2416480955 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0bf9f0 con 0x7fe4a815c180 2024-08-18T22:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4afa00640 1 -- 172.21.15.5:0/2416480955 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a814a7c0 con 0x7fe4a815c180 2024-08-18T22:24:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fc7b2000640 1 -- 172.21.15.5:0/1367378469 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7b401b020 con 0x7fc7bc15d290 2024-08-18T22:24:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fc7b2000640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7980678f0 0x7fc798069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fc7b2000640 1 -- 172.21.15.5:0/1367378469 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fc7b4086a00 con 0x7fc7bc15d290 2024-08-18T22:24:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fe4afa00640 1 -- 172.21.15.5:0/2416480955 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a8159810 con 0x7fe4a815c180 2024-08-18T22:24:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.761+0000 7fc7b9e00640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7980678f0 0x7fc798069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.765+0000 7fc7b9e00640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7980678f0 0x7fc798069db0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40af000 tx=0x7fc7a40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.765+0000 7fe4a4c00640 1 -- 172.21.15.5:0/2416480955 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe49c0bd020 con 0x7fe4a815c180 2024-08-18T22:24:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.765+0000 7fe4a4c00640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4880678c0 0x7fe488069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.765+0000 7fe4a4c00640 1 -- 172.21.15.5:0/2416480955 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fe49c0a8030 con 0x7fe4a815c180 2024-08-18T22:24:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.765+0000 7fe4a7e00640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4880678c0 0x7fe488069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.765+0000 7fe4a7e00640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4880678c0 0x7fe488069d80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe4a809e3d0 tx=0x7fe494009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.765+0000 7fc7b2000640 1 -- 172.21.15.5:0/1367378469 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc7b4022030 con 0x7fc7bc15d290 2024-08-18T22:24:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.769+0000 7fe4a4c00640 1 -- 172.21.15.5:0/2416480955 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe49c016090 con 0x7fe4a815c180 2024-08-18T22:24:53.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.989+0000 7fce8a200640 1 -- 172.21.15.5:0/1350172830 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fce8415ff60 con 0x7fce84158710 2024-08-18T22:24:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.997+0000 7fc7c0e00640 1 -- 172.21.15.5:0/1367378469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7fc7bc0cd890 con 0x7fc7bc15d290 2024-08-18T22:24:53.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:53.997+0000 7fe4afa00640 1 -- 172.21.15.5:0/2416480955 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7fe4a80ae150 con 0x7fe4a815c180 2024-08-18T22:24:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.557+0000 7fce7b400640 1 -- 172.21.15.5:0/1350172830 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7239 v73) ==== 95+0+0 (secure 0 0 0) 0x7fce7005a680 con 0x7fce84158710 2024-08-18T22:24:54.557 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 7239 2024-08-18T22:24:54.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.557+0000 7fce8a200640 1 -- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fce640678c0 msgr2=0x7fce64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:54.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.557+0000 7fce8a200640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fce640678c0 0x7fce64069d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fce740ae000 tx=0x7fce740a7070 comp rx=0 tx=0).stop 2024-08-18T22:24:54.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.557+0000 7fce8a200640 1 -- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce84158710 msgr2=0x7fce84157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.557+0000 7fce8a200640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce84158710 0x7fce84157340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fce7000e980 tx=0x7fce7000ee40 comp rx=0 tx=0).stop 2024-08-18T22:24:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.557+0000 7fce8a200640 1 -- 172.21.15.5:0/1350172830 shutdown_connections 2024-08-18T22:24:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.557+0000 7fce8a200640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fce640678c0 0x7fce64069d80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.557+0000 7fce8a200640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce8415e7b0 0x7fce84157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.557+0000 7fce8a200640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce84158710 0x7fce84157340 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.557+0000 7fce8a200640 1 --2- 172.21.15.5:0/1350172830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce8406cf00 0x7fce8414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.557+0000 7fce8a200640 1 -- 172.21.15.5:0/1350172830 >> 172.21.15.5:0/1350172830 conn(0x7fce84072350 msgr2=0x7fce8406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:54.561 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:24:54.561+0000 7fc7ef000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:24:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.561+0000 7fce8a200640 1 -- 172.21.15.5:0/1350172830 shutdown_connections 2024-08-18T22:24:54.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.561+0000 7fce8a200640 1 -- 172.21.15.5:0/1350172830 wait complete. 2024-08-18T22:24:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.561+0000 7fc7b2000640 1 -- 172.21.15.5:0/1367378469 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6802 v74) ==== 95+0+0 (secure 0 0 0) 0x7fc7b4010040 con 0x7fc7bc15d290 2024-08-18T22:24:54.564 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 6802 2024-08-18T22:24:54.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 -- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7980678f0 msgr2=0x7fc798069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:54.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7980678f0 0x7fc798069db0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40af000 tx=0x7fc7a40a7000 comp rx=0 tx=0).stop 2024-08-18T22:24:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 -- 172.21.15.5:0/1367378469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7bc15d290 msgr2=0x7fc7bc09ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7bc15d290 0x7fc7bc09ca50 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400eba0 tx=0x7fc7b400c490 comp rx=0 tx=0).stop 2024-08-18T22:24:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 -- 172.21.15.5:0/1367378469 shutdown_connections 2024-08-18T22:24:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7980678f0 0x7fc798069db0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7bc15d290 0x7fc7bc09ca50 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7bc15c740 0x7fc7bc148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 --2- 172.21.15.5:0/1367378469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7bc15c360 0x7fc7bc09eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 -- 172.21.15.5:0/1367378469 >> 172.21.15.5:0/1367378469 conn(0x7fc7bc0b65f0 msgr2=0x7fc7bc0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 -- 172.21.15.5:0/1367378469 shutdown_connections 2024-08-18T22:24:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fc7c0e00640 1 -- 172.21.15.5:0/1367378469 wait complete. 2024-08-18T22:24:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.565+0000 7fe4a4c00640 1 -- 172.21.15.5:0/2416480955 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7242 v74) ==== 95+0+0 (secure 0 0 0) 0x7fe49c0f08f0 con 0x7fe4a815c180 2024-08-18T22:24:54.568 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 7242 2024-08-18T22:24:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 -- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4880678c0 msgr2=0x7fe488069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4880678c0 0x7fe488069d80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe4a809e3d0 tx=0x7fe494009040 comp rx=0 tx=0).stop 2024-08-18T22:24:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 -- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a815c180 msgr2=0x7fe4a8155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a815c180 0x7fe4a8155630 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0ac000 tx=0x7fe49c01ac50 comp rx=0 tx=0).stop 2024-08-18T22:24:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 -- 172.21.15.5:0/2416480955 shutdown_connections 2024-08-18T22:24:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4880678c0 0x7fe488069d80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4a8149c90 0x7fe4a809d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a815d4d0 0x7fe4a8155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 --2- 172.21.15.5:0/2416480955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a815c180 0x7fe4a8155630 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 -- 172.21.15.5:0/2416480955 >> 172.21.15.5:0/2416480955 conn(0x7fe4a80b1dc0 msgr2=0x7fe4a80aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 -- 172.21.15.5:0/2416480955 shutdown_connections 2024-08-18T22:24:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:54.569+0000 7fe4afa00640 1 -- 172.21.15.5:0/2416480955 wait complete. 2024-08-18T22:24:54.596 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:24:54.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:24:54.597 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:24:54.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:24:54.599 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:24:54.600 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:24:54.602 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:24:54.602 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:54.604 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:24:54.604 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:54.604 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:24:54.604 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:54.687 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:24:54.689 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:24:54.694 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:24:59.543 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:24:59.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-08-18T22:24:59.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.697+0000 7fc80e800640 1 Processor -- start 2024-08-18T22:24:59.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.697+0000 7fc80e800640 1 -- start start 2024-08-18T22:24:59.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc80e800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc80815c180 0x7fc8080cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:59.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc80e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc80815c560 0x7fc8080ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:59.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc80e800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8080cfb00 con 0x7fc80815d4d0 2024-08-18T22:24:59.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc80e800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc80815d040 con 0x7fc80815c560 2024-08-18T22:24:59.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc80e800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc80815c9f0 con 0x7fc80815c180 2024-08-18T22:24:59.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc7fea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc80815c560 0x7fc8080ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:59.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc7fea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc80815c560 0x7fc8080ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40380/0 (socket says 172.21.15.5:40380) 2024-08-18T22:24:59.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc7fea00640 1 -- 172.21.15.5:0/3274846970 learned_addr learned my addr 172.21.15.5:0/3274846970 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:59.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc7fea00640 1 -- 172.21.15.5:0/3274846970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc80815c180 msgr2=0x7fc8080cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:59.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc807400640 1 --2- 172.21.15.5:0/3274846970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc80815c180 0x7fc8080cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:59.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc7fea00640 1 --2- 172.21.15.5:0/3274846970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc80815c180 0x7fc8080cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:59.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc7fea00640 1 -- 172.21.15.5:0/3274846970 >> v1:172.21.15.117:6789/0 conn(0x7fc80815d4d0 legacy=0x7fc80815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:24:59.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc7fea00640 1 -- 172.21.15.5:0/3274846970 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80815ccd0 con 0x7fc80815c560 2024-08-18T22:24:59.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.701+0000 7fc807400640 1 --2- 172.21.15.5:0/3274846970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc80815c180 0x7fc8080cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:24:59.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc7fea00640 1 --2- 172.21.15.5:0/3274846970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc80815c560 0x7fc8080ce450 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009870 tx=0x7fc7f001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47120ff04961badf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc806a00640 1 -- 172.21.15.5:0/3274846970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00a7070 con 0x7fc80815c560 2024-08-18T22:24:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc806a00640 1 -- 172.21.15.5:0/3274846970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f00b0070 con 0x7fc80815c560 2024-08-18T22:24:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc806a00640 1 -- 172.21.15.5:0/3274846970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00ab890 con 0x7fc80815c560 2024-08-18T22:24:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 -- 172.21.15.5:0/3274846970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc80815c560 msgr2=0x7fc8080ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 --2- 172.21.15.5:0/3274846970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc80815c560 0x7fc8080ce450 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009870 tx=0x7fc7f001c490 comp rx=0 tx=0).stop 2024-08-18T22:24:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 -- 172.21.15.5:0/3274846970 shutdown_connections 2024-08-18T22:24:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 --2- 172.21.15.5:0/3274846970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc80815c560 0x7fc8080ce450 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 --2- 172.21.15.5:0/3274846970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc80815c180 0x7fc8080cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 -- 172.21.15.5:0/3274846970 >> 172.21.15.5:0/3274846970 conn(0x7fc8080b1dc0 msgr2=0x7fc8080b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 -- 172.21.15.5:0/3274846970 shutdown_connections 2024-08-18T22:24:59.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 -- 172.21.15.5:0/3274846970 wait complete. 2024-08-18T22:24:59.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 Processor -- start 2024-08-18T22:24:59.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 -- start start 2024-08-18T22:24:59.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc80815c180 0x7fc8081503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:59.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc80815d4d0 0x7fc808156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:59.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc808152dd0 0x7fc80814fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:59.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc8081692b0 con 0x7fc80815d4d0 2024-08-18T22:24:59.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc808169130 con 0x7fc808152dd0 2024-08-18T22:24:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.705+0000 7fc80e800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc808169430 con 0x7fc80815c180 2024-08-18T22:24:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7fea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc80815d4d0 0x7fc808156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7fea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc80815d4d0 0x7fc808156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40392/0 (socket says 172.21.15.5:40392) 2024-08-18T22:24:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7fea00640 1 -- 172.21.15.5:0/3923110406 learned_addr learned my addr 172.21.15.5:0/3923110406 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:24:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc807e00640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc808152dd0 0x7fc80814fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc807400640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc80815c180 0x7fc8081503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7fea00640 1 -- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc80815c180 msgr2=0x7fc8081503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7fea00640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc80815c180 0x7fc8081503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7fea00640 1 -- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc808152dd0 msgr2=0x7fc80814fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7fea00640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc808152dd0 0x7fc80814fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7fea00640 1 -- 172.21.15.5:0/3923110406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc808153620 con 0x7fc80815d4d0 2024-08-18T22:24:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7fea00640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc80815d4d0 0x7fc808156350 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00ad040 tx=0x7fc7f001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7ffe00640 1 -- 172.21.15.5:0/3923110406 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00abe60 con 0x7fc80815d4d0 2024-08-18T22:24:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7ffe00640 1 -- 172.21.15.5:0/3923110406 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f00b4820 con 0x7fc80815d4d0 2024-08-18T22:24:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7ffe00640 1 -- 172.21.15.5:0/3923110406 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00b4c10 con 0x7fc80815d4d0 2024-08-18T22:24:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc80e800640 1 -- 172.21.15.5:0/3923110406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80809db20 con 0x7fc80815d4d0 2024-08-18T22:24:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc80e800640 1 -- 172.21.15.5:0/3923110406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc80809e0e0 con 0x7fc80815d4d0 2024-08-18T22:24:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc80e800640 1 -- 172.21.15.5:0/3923110406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc80815fd90 con 0x7fc80815d4d0 2024-08-18T22:24:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7ffe00640 1 -- 172.21.15.5:0/3923110406 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7f00c7390 con 0x7fc80815d4d0 2024-08-18T22:24:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.709+0000 7fc7ffe00640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7e40678c0 0x7fc7e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:24:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.713+0000 7fc7ffe00640 1 -- 172.21.15.5:0/3923110406 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6187+0+0 (secure 0 0 0) 0x7fc7f01207a0 con 0x7fc80815d4d0 2024-08-18T22:24:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.713+0000 7fc807400640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7e40678c0 0x7fc7e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:24:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.713+0000 7fc807400640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7e40678c0 0x7fc7e4069d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc8081585e0 tx=0x7fc7f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:24:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.717+0000 7fc7ffe00640 1 -- 172.21.15.5:0/3923110406 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc7f00c4060 con 0x7fc80815d4d0 2024-08-18T22:24:59.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.941+0000 7fc80e800640 1 -- 172.21.15.5:0/3923110406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fc80809e2b0 con 0x7fc80815d4d0 2024-08-18T22:24:59.942 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:24:59.941+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:24:59.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc7ffe00640 1 -- 172.21.15.5:0/3923110406 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6805 v77) ==== 95+0+0 (secure 0 0 0) 0x7fc7f0016110 con 0x7fc80815d4d0 2024-08-18T22:24:59.944 INFO:teuthology.orchestra.run.smithi005.stderr:failed mds gid 6805 2024-08-18T22:24:59.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 -- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7e40678c0 msgr2=0x7fc7e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:59.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7e40678c0 0x7fc7e4069d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc8081585e0 tx=0x7fc7f8008040 comp rx=0 tx=0).stop 2024-08-18T22:24:59.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 -- 172.21.15.5:0/3923110406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc80815d4d0 msgr2=0x7fc808156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:24:59.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc80815d4d0 0x7fc808156350 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00ad040 tx=0x7fc7f001acd0 comp rx=0 tx=0).stop 2024-08-18T22:24:59.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 -- 172.21.15.5:0/3923110406 shutdown_connections 2024-08-18T22:24:59.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7e40678c0 0x7fc7e4069d80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:59.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc808152dd0 0x7fc80814fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:59.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc80815d4d0 0x7fc808156350 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:59.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 --2- 172.21.15.5:0/3923110406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc80815c180 0x7fc8081503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:24:59.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 -- 172.21.15.5:0/3923110406 >> 172.21.15.5:0/3923110406 conn(0x7fc8080b1dc0 msgr2=0x7fc80809aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:24:59.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 -- 172.21.15.5:0/3923110406 shutdown_connections 2024-08-18T22:24:59.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:24:59.945+0000 7fc80e800640 1 -- 172.21.15.5:0/3923110406 wait complete. 2024-08-18T22:24:59.971 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:24:59.971 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:24:59.975 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:24:59.975 DEBUG:teuthology.parallel:result is None 2024-08-18T22:24:59.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:00.062 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:25:00.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.113+0000 7fedf1000640 1 Processor -- start 2024-08-18T22:25:00.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.113+0000 7fedf1000640 1 -- start start 2024-08-18T22:25:00.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fedf1000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fedec0ce840 0x7fedec0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fedf1000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0cee20 con 0x7fedec06f290 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fedf1000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0cf100 con 0x7fedec15b010 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fedf1000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fedec0cd8e0 con 0x7fedec0ce840 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fede1400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fedec06f290 0x7fedec072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39966/0 (socket says 172.21.15.5:39966) 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fede1400640 1 -- 172.21.15.5:0/174948696 learned_addr learned my addr 172.21.15.5:0/174948696 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fedea800640 1 --2- 172.21.15.5:0/174948696 >> v2:172.21.15.117:3300/0 conn(0x7fedec0ce840 0x7fedec0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fede9400640 1 -- 172.21.15.5:0/174948696 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2773936345 0 0) 0x7fedec0cee20 con 0x7fedec06f290 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fede9400640 1 -- 172.21.15.5:0/174948696 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedd0005740 con 0x7fedec06f290 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fede9400640 1 -- 172.21.15.5:0/174948696 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1692283255 0 0) 0x7fedec0cf100 con 0x7fedec15b010 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fede9400640 1 -- 172.21.15.5:0/174948696 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedec0cee20 con 0x7fedec15b010 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fedea800640 1 -- 172.21.15.5:0/174948696 >> v1:172.21.15.117:6789/0 conn(0x7fedec15b010 legacy=0x7fedec06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fedea800640 1 -- 172.21.15.5:0/174948696 >> v1:172.21.15.5:6789/0 conn(0x7fedec06f290 legacy=0x7fedec072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:00.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.117+0000 7fedea800640 1 -- 172.21.15.5:0/174948696 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec0cf3e0 con 0x7fedec0ce840 2024-08-18T22:25:00.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fedea800640 1 --2- 172.21.15.5:0/174948696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedec0ce840 0x7fedec0cd3a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fede4009d90 tx=0x7fede401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9300b32a59e4ec1e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:00.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fede9400640 1 -- 172.21.15.5:0/174948696 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede40b2070 con 0x7fedec0ce840 2024-08-18T22:25:00.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fede9400640 1 -- 172.21.15.5:0/174948696 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede40a57b0 con 0x7fedec0ce840 2024-08-18T22:25:00.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fede9400640 1 -- 172.21.15.5:0/174948696 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede40a5b80 con 0x7fedec0ce840 2024-08-18T22:25:00.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fedf1000640 1 -- 172.21.15.5:0/174948696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedec0ce840 msgr2=0x7fedec0cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:00.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fedf1000640 1 --2- 172.21.15.5:0/174948696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedec0ce840 0x7fedec0cd3a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fede4009d90 tx=0x7fede401c8e0 comp rx=0 tx=0).stop 2024-08-18T22:25:00.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fedf1000640 1 -- 172.21.15.5:0/174948696 shutdown_connections 2024-08-18T22:25:00.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fedf1000640 1 --2- 172.21.15.5:0/174948696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedec0ce840 0x7fedec0cd3a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:00.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fedf1000640 1 -- 172.21.15.5:0/174948696 >> 172.21.15.5:0/174948696 conn(0x7fedec0b1c50 msgr2=0x7fedec0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:00.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fedf1000640 1 -- 172.21.15.5:0/174948696 shutdown_connections 2024-08-18T22:25:00.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fedf1000640 1 -- 172.21.15.5:0/174948696 wait complete. 2024-08-18T22:25:00.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fedf1000640 1 Processor -- start 2024-08-18T22:25:00.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.121+0000 7fedf1000640 1 -- start start 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fedf1000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedec06f290 0x7fedec1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fedf1000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedec0ce840 0x7fedec151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fedf1000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedec15b010 0x7fedec15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fedf1000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fedec0738d0 con 0x7fedec06f290 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fedf1000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fedec073750 con 0x7fedec15b010 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fedf1000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fedec06da70 con 0x7fedec0ce840 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedec06f290 0x7fedec1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedec06f290 0x7fedec1550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40408/0 (socket says 172.21.15.5:40408) 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede9e00640 1 -- 172.21.15.5:0/17680287 learned_addr learned my addr 172.21.15.5:0/17680287 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fedea800640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedec15b010 0x7fedec15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede1400640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedec0ce840 0x7fedec151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede9e00640 1 -- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedec0ce840 msgr2=0x7fedec151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:00.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede9e00640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedec0ce840 0x7fedec151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:00.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede9e00640 1 -- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedec15b010 msgr2=0x7fedec15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:00.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede9e00640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedec15b010 0x7fedec15c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:00.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede9e00640 1 -- 172.21.15.5:0/17680287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec0b5d50 con 0x7fedec06f290 2024-08-18T22:25:00.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fedea800640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedec15b010 0x7fedec15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:00.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede9e00640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedec06f290 0x7fedec1550c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c430 tx=0x7feddc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede2a00640 1 -- 172.21.15.5:0/17680287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc017070 con 0x7fedec06f290 2024-08-18T22:25:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede2a00640 1 -- 172.21.15.5:0/17680287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feddc0052f0 con 0x7fedec06f290 2024-08-18T22:25:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede2a00640 1 -- 172.21.15.5:0/17680287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc003840 con 0x7fedec06f290 2024-08-18T22:25:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fedf1000640 1 -- 172.21.15.5:0/17680287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedec0ad920 con 0x7fedec06f290 2024-08-18T22:25:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fedf1000640 1 -- 172.21.15.5:0/17680287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedec0adee0 con 0x7fedec06f290 2024-08-18T22:25:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fedf1000640 1 -- 172.21.15.5:0/17680287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedec0cd3a0 con 0x7fedec06f290 2024-08-18T22:25:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.125+0000 7fede2a00640 1 -- 172.21.15.5:0/17680287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feddc01a070 con 0x7fedec06f290 2024-08-18T22:25:00.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.129+0000 7fede2a00640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fedc80678f0 0x7fedc8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:00.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.129+0000 7fede2a00640 1 -- 172.21.15.5:0/17680287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6273+0+0 (secure 0 0 0) 0x7feddc0852f0 con 0x7fedec06f290 2024-08-18T22:25:00.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.129+0000 7fede1400640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fedc80678f0 0x7fedc8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:00.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.129+0000 7fede1400640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fedc80678f0 0x7fedc8069db0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fedec0af570 tx=0x7fedd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:00.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.133+0000 7fede2a00640 1 -- 172.21.15.5:0/17680287 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7feddc055bd0 con 0x7fedec06f290 2024-08-18T22:25:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.329+0000 7fedf1000640 1 -- 172.21.15.5:0/17680287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedec1597b0 con 0x7fedec06f290 2024-08-18T22:25:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fede2a00640 1 -- 172.21.15.5:0/17680287 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+4389 (secure 0 0 0) 0x7feddc0554d0 con 0x7fedec06f290 2024-08-18T22:25:00.332 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:00.332 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"btime":"2024-08-18T22:24:59:949336+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1436391401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1436391401},{"type":"v1","addr":"172.21.15.117:6835","nonce":1436391401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2830021009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2830021009},{"type":"v1","addr":"172.21.15.5:6833","nonce":2830021009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:24:59.949320+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":78,"state":"up:replay","state_seq":1,"addr":"172.21.15.5:6835/580352313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":580352313},{"type":"v1","addr":"172.21.15.5:6835","nonce":580352313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-18T22:25:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 78 2024-08-18T22:25:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 -- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fedc80678f0 msgr2=0x7fedc8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fedc80678f0 0x7fedc8069db0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fedec0af570 tx=0x7fedd4009040 comp rx=0 tx=0).stop 2024-08-18T22:25:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 -- 172.21.15.5:0/17680287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedec06f290 msgr2=0x7fedec1550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedec06f290 0x7fedec1550c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c430 tx=0x7feddc00c8f0 comp rx=0 tx=0).stop 2024-08-18T22:25:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 -- 172.21.15.5:0/17680287 shutdown_connections 2024-08-18T22:25:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fedc80678f0 0x7fedc8069db0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedec15b010 0x7fedec15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedec0ce840 0x7fedec151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 --2- 172.21.15.5:0/17680287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fedec06f290 0x7fedec1550c0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 -- 172.21.15.5:0/17680287 >> 172.21.15.5:0/17680287 conn(0x7fedec0b1c50 msgr2=0x7fedec159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 -- 172.21.15.5:0/17680287 shutdown_connections 2024-08-18T22:25:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:00.333+0000 7fedf1000640 1 -- 172.21.15.5:0/17680287 wait complete. 2024-08-18T22:25:00.756 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:24:39.405470+0000', 'modified': '2024-08-18T22:24:59.949320+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7485': {'gid': 7485, 'name': 'c', 'rank': 0, 'incarnation': 78, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.5:6835/580352313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 580352313}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 580352313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-18T22:25:00.756 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7485:up:replay 2024-08-18T22:25:01.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae4e200640 1 Processor -- start 2024-08-18T22:25:01.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae4e200640 1 -- start start 2024-08-18T22:25:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae4e200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae48161960 0x7fae4806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae4e200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae48070730 0x7fae48070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae4e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae4815dda0 0x7fae4815e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae4e200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fae4815fcc0 con 0x7fae4815dda0 2024-08-18T22:25:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae4e200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fae480710b0 con 0x7fae48070730 2024-08-18T22:25:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae4e200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fae4815eb60 con 0x7fae48161960 2024-08-18T22:25:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae47e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae4815dda0 0x7fae4815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae47e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae4815dda0 0x7fae4815e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40418/0 (socket says 172.21.15.5:40418) 2024-08-18T22:25:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae47e00640 1 -- 172.21.15.5:0/3289246632 learned_addr learned my addr 172.21.15.5:0/3289246632 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae47400640 1 --2- 172.21.15.5:0/3289246632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae48161960 0x7fae4806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:01.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae46a00640 1 --2- 172.21.15.5:0/3289246632 >> v2:172.21.15.117:3300/0 conn(0x7fae48070730 0x7fae48070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae47e00640 1 -- 172.21.15.5:0/3289246632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae48161960 msgr2=0x7fae4806fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.909+0000 7fae47e00640 1 --2- 172.21.15.5:0/3289246632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae48161960 0x7fae4806fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae47e00640 1 -- 172.21.15.5:0/3289246632 >> v2:172.21.15.117:3300/0 conn(0x7fae48070730 msgr2=0x7fae48070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae47e00640 1 --2- 172.21.15.5:0/3289246632 >> v2:172.21.15.117:3300/0 conn(0x7fae48070730 0x7fae48070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae47e00640 1 -- 172.21.15.5:0/3289246632 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4815ee40 con 0x7fae4815dda0 2024-08-18T22:25:01.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae47e00640 1 --2- 172.21.15.5:0/3289246632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae4815dda0 0x7fae4815e250 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fae48073680 tx=0x7fae4001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711499febac37b4d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:01.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae46000640 1 -- 172.21.15.5:0/3289246632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae400a5760 con 0x7fae4815dda0 2024-08-18T22:25:01.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae46000640 1 -- 172.21.15.5:0/3289246632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae400a5900 con 0x7fae4815dda0 2024-08-18T22:25:01.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae46000640 1 -- 172.21.15.5:0/3289246632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae400a5cd0 con 0x7fae4815dda0 2024-08-18T22:25:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae4e200640 1 -- 172.21.15.5:0/3289246632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae4815dda0 msgr2=0x7fae4815e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae4e200640 1 --2- 172.21.15.5:0/3289246632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae4815dda0 0x7fae4815e250 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fae48073680 tx=0x7fae4001c9f0 comp rx=0 tx=0).stop 2024-08-18T22:25:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae4e200640 1 -- 172.21.15.5:0/3289246632 shutdown_connections 2024-08-18T22:25:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae4e200640 1 --2- 172.21.15.5:0/3289246632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae4815dda0 0x7fae4815e250 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae4e200640 1 --2- 172.21.15.5:0/3289246632 >> v2:172.21.15.117:3300/0 conn(0x7fae48070730 0x7fae48070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae4e200640 1 --2- 172.21.15.5:0/3289246632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae48161960 0x7fae4806fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae4e200640 1 -- 172.21.15.5:0/3289246632 >> 172.21.15.5:0/3289246632 conn(0x7fae480d2130 msgr2=0x7fae480d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:01.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae4e200640 1 -- 172.21.15.5:0/3289246632 shutdown_connections 2024-08-18T22:25:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.913+0000 7fae4e200640 1 -- 172.21.15.5:0/3289246632 wait complete. 2024-08-18T22:25:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae4e200640 1 Processor -- start 2024-08-18T22:25:01.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae4e200640 1 -- start start 2024-08-18T22:25:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae4e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae48070730 0x7fae480b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae4e200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae4815dda0 0x7fae481506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae4e200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae48161960 0x7fae480b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae4e200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fae4809ba30 con 0x7fae48070730 2024-08-18T22:25:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae4e200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fae4815e790 con 0x7fae48161960 2024-08-18T22:25:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae4e200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fae480b7fe0 con 0x7fae4815dda0 2024-08-18T22:25:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae48070730 0x7fae480b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae48070730 0x7fae480b6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40432/0 (socket says 172.21.15.5:40432) 2024-08-18T22:25:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae47400640 1 -- 172.21.15.5:0/132290867 learned_addr learned my addr 172.21.15.5:0/132290867 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:01.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae46a00640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae4815dda0 0x7fae481506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae47e00640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae48161960 0x7fae480b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae47400640 1 -- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae4815dda0 msgr2=0x7fae481506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae47400640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae4815dda0 0x7fae481506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae47400640 1 -- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae48161960 msgr2=0x7fae480b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae47400640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae48161960 0x7fae480b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae47400640 1 -- 172.21.15.5:0/132290867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae480b5d70 con 0x7fae48070730 2024-08-18T22:25:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae47400640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae48070730 0x7fae480b6dd0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fae3800e870 tx=0x7fae3800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae3f400640 1 -- 172.21.15.5:0/132290867 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38017070 con 0x7fae48070730 2024-08-18T22:25:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae3f400640 1 -- 172.21.15.5:0/132290867 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae3800c940 con 0x7fae48070730 2024-08-18T22:25:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae4e200640 1 -- 172.21.15.5:0/132290867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae480b6010 con 0x7fae48070730 2024-08-18T22:25:01.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae3f400640 1 -- 172.21.15.5:0/132290867 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3800ccf0 con 0x7fae48070730 2024-08-18T22:25:01.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.917+0000 7fae4e200640 1 -- 172.21.15.5:0/132290867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae480b65d0 con 0x7fae48070730 2024-08-18T22:25:01.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.921+0000 7fae4e200640 1 -- 172.21.15.5:0/132290867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae48070b70 con 0x7fae48070730 2024-08-18T22:25:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.921+0000 7fae3f400640 1 -- 172.21.15.5:0/132290867 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae3801a070 con 0x7fae48070730 2024-08-18T22:25:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.921+0000 7fae3f400640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae280678c0 0x7fae28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.921+0000 7fae3f400640 1 -- 172.21.15.5:0/132290867 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6273+0+0 (secure 0 0 0) 0x7fae38085de0 con 0x7fae48070730 2024-08-18T22:25:01.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.921+0000 7fae46a00640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae280678c0 0x7fae28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.921+0000 7fae46a00640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae280678c0 0x7fae28069d80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fae48071d80 tx=0x7fae34009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:01.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:01.925+0000 7fae3f400640 1 -- 172.21.15.5:0/132290867 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fae38055ff0 con 0x7fae48070730 2024-08-18T22:25:02.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.125+0000 7fae4e200640 1 -- 172.21.15.5:0/132290867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae4809bbb0 con 0x7fae48070730 2024-08-18T22:25:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.125+0000 7fae3f400640 1 -- 172.21.15.5:0/132290867 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5214 (secure 0 0 0) 0x7fae3805a2f0 con 0x7fae48070730 2024-08-18T22:25:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:02.127 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":80,"btime":"2024-08-18T22:25:01:954029+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1436391401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1436391401},{"type":"v1","addr":"172.21.15.117:6835","nonce":1436391401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/643889741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":643889741},{"type":"v1","addr":"172.21.15.117:6837","nonce":643889741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2830021009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2830021009},{"type":"v1","addr":"172.21.15.5:6833","nonce":2830021009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:25:00.956117+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":78,"state":"up:rejoin","state_seq":4,"addr":"172.21.15.5:6835/580352313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":580352313},{"type":"v1","addr":"172.21.15.5:6835","nonce":580352313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-08-18T22:25:02.127 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 80 2024-08-18T22:25:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 -- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae280678c0 msgr2=0x7fae28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae280678c0 0x7fae28069d80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fae48071d80 tx=0x7fae34009190 comp rx=0 tx=0).stop 2024-08-18T22:25:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 -- 172.21.15.5:0/132290867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae48070730 msgr2=0x7fae480b6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae48070730 0x7fae480b6dd0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fae3800e870 tx=0x7fae3800ec70 comp rx=0 tx=0).stop 2024-08-18T22:25:02.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 -- 172.21.15.5:0/132290867 shutdown_connections 2024-08-18T22:25:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae280678c0 0x7fae28069d80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae48161960 0x7fae480b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae4815dda0 0x7fae481506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 --2- 172.21.15.5:0/132290867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae48070730 0x7fae480b6dd0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 -- 172.21.15.5:0/132290867 >> 172.21.15.5:0/132290867 conn(0x7fae480d2130 msgr2=0x7fae4815acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 -- 172.21.15.5:0/132290867 shutdown_connections 2024-08-18T22:25:02.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:02.129+0000 7fae4e200640 1 -- 172.21.15.5:0/132290867 wait complete. 2024-08-18T22:25:02.552 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:24:39.405470+0000', 'modified': '2024-08-18T22:25:00.956117+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7485': {'gid': 7485, 'name': 'c', 'rank': 0, 'incarnation': 78, 'state': 'up:rejoin', 'state_seq': 4, 'addr': '172.21.15.5:6835/580352313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 580352313}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 580352313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-08-18T22:25:02.552 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7485:up:rejoin 2024-08-18T22:25:03.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.709+0000 7f22b3200640 1 Processor -- start 2024-08-18T22:25:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22b3200640 1 -- start start 2024-08-18T22:25:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22b3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac15b280 0x7f22ac0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:03.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22b3200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22ac0b35a0 con 0x7f22ac0b2560 2024-08-18T22:25:03.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22b3200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22ac0b3880 con 0x7f22ac0cdf40 2024-08-18T22:25:03.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22b3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22ac0cbdd0 con 0x7f22ac15b280 2024-08-18T22:25:03.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22ab400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f22ac0b2560 0x7f22ac0cd830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49800/0 (socket says 172.21.15.5:49800) 2024-08-18T22:25:03.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22ab400640 1 -- 172.21.15.5:0/3920553341 learned_addr learned my addr 172.21.15.5:0/3920553341 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:03.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22abe00640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac15b280 0x7f22ac0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:03.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 461464679 0 0) 0x7f22ac0b35a0 con 0x7f22ac0b2560 2024-08-18T22:25:03.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2290003530 con 0x7f22ac0b2560 2024-08-18T22:25:03.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2304387286 0 0) 0x7f2290003530 con 0x7f22ac0b2560 2024-08-18T22:25:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac15b280 msgr2=0x7f22ac0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac15b280 0x7f22ac0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 >> v1:172.21.15.117:6789/0 conn(0x7f22ac0cdf40 legacy=0x7f22ac0cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac0b3b60 con 0x7f22ac0b2560 2024-08-18T22:25:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f2298001680 con 0x7f22ac0b2560 2024-08-18T22:25:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 >> v1:172.21.15.5:6789/0 conn(0x7f22ac0b2560 legacy=0x7f22ac0cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22900039f0 0x7f2290003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 0x7f2290004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac15b280 0x7f2290005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac0cbdd0 con 0x7f22900043a0 2024-08-18T22:25:03.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f229000dc90 con 0x7f22900039f0 2024-08-18T22:25:03.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f229000de90 con 0x7f22ac15b280 2024-08-18T22:25:03.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22ab400640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 0x7f2290004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:03.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22abe00640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22900039f0 0x7f2290003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:03.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22b1200640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac15b280 0x7f2290005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:03.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22ab400640 1 -- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac15b280 msgr2=0x7f2290005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:03.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22ab400640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac15b280 0x7f2290005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:03.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22ab400640 1 -- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22900039f0 msgr2=0x7f2290003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:03.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22ab400640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22900039f0 0x7f2290003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:03.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22ab400640 1 -- 172.21.15.5:0/3920553341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2290003530 con 0x7f22900043a0 2024-08-18T22:25:03.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.713+0000 7f22abe00640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22900039f0 0x7f2290003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:03.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.717+0000 7f22ab400640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 0x7f2290004870 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06e920 tx=0x7f229801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4f2ea9b1c6fa82 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.717+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298007cb0 con 0x7f22900043a0 2024-08-18T22:25:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.717+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22980a9020 con 0x7f22900043a0 2024-08-18T22:25:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.717+0000 7f22aaa00640 1 -- 172.21.15.5:0/3920553341 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298005b20 con 0x7f22900043a0 2024-08-18T22:25:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.717+0000 7f22b3200640 1 -- 172.21.15.5:0/3920553341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 msgr2=0x7f2290004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.717+0000 7f22b3200640 1 --2- 172.21.15.5:0/3920553341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 0x7f2290004870 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06e920 tx=0x7f229801cbc0 comp rx=0 tx=0).stop 2024-08-18T22:25:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.717+0000 7f22b1200640 1 -- 172.21.15.5:0/3920553341 reap_dead start 2024-08-18T22:25:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.717+0000 7f22b3200640 1 -- 172.21.15.5:0/3920553341 shutdown_connections 2024-08-18T22:25:03.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.717+0000 7f22b3200640 1 -- 172.21.15.5:0/3920553341 >> 172.21.15.5:0/3920553341 conn(0x7f22ac09aa40 msgr2=0x7f22ac0b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.717+0000 7f22b3200640 1 -- 172.21.15.5:0/3920553341 shutdown_connections 2024-08-18T22:25:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.717+0000 7f22b3200640 1 -- 172.21.15.5:0/3920553341 wait complete. 2024-08-18T22:25:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22b3200640 1 Processor -- start 2024-08-18T22:25:03.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22b3200640 1 -- start start 2024-08-18T22:25:03.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22b3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 0x7f22ac0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22b3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0af240 0x7f22ac0b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22b3200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22ac0b6d70 0x7f22ac1f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22b3200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac0b2b40 con 0x7f22900043a0 2024-08-18T22:25:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22b3200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac0b29c0 con 0x7f22ac0b6d70 2024-08-18T22:25:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22b3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22ac15b660 con 0x7f22ac0af240 2024-08-18T22:25:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22abe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 0x7f22ac0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22abe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 0x7f22ac0b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40224/0 (socket says 172.21.15.5:40224) 2024-08-18T22:25:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22abe00640 1 -- 172.21.15.5:0/2356778333 learned_addr learned my addr 172.21.15.5:0/2356778333 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22ab400640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0af240 0x7f22ac0b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22b1200640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22ac0b6d70 0x7f22ac1f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22abe00640 1 -- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0af240 msgr2=0x7f22ac0b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22abe00640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0af240 0x7f22ac0b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22abe00640 1 -- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22ac0b6d70 msgr2=0x7f22ac1f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22abe00640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22ac0b6d70 0x7f22ac1f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22abe00640 1 -- 172.21.15.5:0/2356778333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac0ae1e0 con 0x7f22900043a0 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22abe00640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 0x7f22ac0b0180 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f229c0101f0 tx=0x7f229c0105f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22a3e00640 1 -- 172.21.15.5:0/2356778333 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c01a030 con 0x7f22900043a0 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22a3e00640 1 -- 172.21.15.5:0/2356778333 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229c0039a0 con 0x7f22900043a0 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22a3e00640 1 -- 172.21.15.5:0/2356778333 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c003d70 con 0x7f22900043a0 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22b3200640 1 -- 172.21.15.5:0/2356778333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ac0ae480 con 0x7f22900043a0 2024-08-18T22:25:03.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.721+0000 7f22b3200640 1 -- 172.21.15.5:0/2356778333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ac0aea40 con 0x7f22900043a0 2024-08-18T22:25:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.725+0000 7f22b3200640 1 -- 172.21.15.5:0/2356778333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ac0cf9a0 con 0x7f22900043a0 2024-08-18T22:25:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.725+0000 7f22a3e00640 1 -- 172.21.15.5:0/2356778333 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f229c01d070 con 0x7f22900043a0 2024-08-18T22:25:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.725+0000 7f22a3e00640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f228c0678c0 0x7f228c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:03.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.725+0000 7f22a3e00640 1 -- 172.21.15.5:0/2356778333 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6389+0+0 (secure 0 0 0) 0x7f229c086f20 con 0x7f22900043a0 2024-08-18T22:25:03.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.725+0000 7f22ab400640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f228c0678c0 0x7f228c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:03.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.725+0000 7f22ab400640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f228c0678c0 0x7f228c069d80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f22980aa000 tx=0x7f22ac0cbd40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:03.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.729+0000 7f22a3e00640 1 -- 172.21.15.5:0/2356778333 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f229c024070 con 0x7f22900043a0 2024-08-18T22:25:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 -- 172.21.15.5:0/2356778333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22ac0ccff0 con 0x7f22900043a0 2024-08-18T22:25:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22a3e00640 1 -- 172.21.15.5:0/2356778333 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5221 (secure 0 0 0) 0x7f229c0577a0 con 0x7f22900043a0 2024-08-18T22:25:03.933 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"btime":"2024-08-18T22:25:02:956485+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1436391401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1436391401},{"type":"v1","addr":"172.21.15.117:6835","nonce":1436391401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/643889741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":643889741},{"type":"v1","addr":"172.21.15.117:6837","nonce":643889741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2830021009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2830021009},{"type":"v1","addr":"172.21.15.5:6833","nonce":2830021009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:25:02.956480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/580352313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":580352313},{"type":"v1","addr":"172.21.15.5:6835","nonce":580352313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7485,"qdb_cluster":[7485]},"id":6}]} 2024-08-18T22:25:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 81 2024-08-18T22:25:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 -- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f228c0678c0 msgr2=0x7f228c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f228c0678c0 0x7f228c069d80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f22980aa000 tx=0x7f22ac0cbd40 comp rx=0 tx=0).stop 2024-08-18T22:25:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 -- 172.21.15.5:0/2356778333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 msgr2=0x7f22ac0b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 0x7f22ac0b0180 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f229c0101f0 tx=0x7f229c0105f0 comp rx=0 tx=0).stop 2024-08-18T22:25:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 -- 172.21.15.5:0/2356778333 shutdown_connections 2024-08-18T22:25:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f228c0678c0 0x7f228c069d80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22ac0b6d70 0x7f22ac1f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0af240 0x7f22ac0b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 --2- 172.21.15.5:0/2356778333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22900043a0 0x7f22ac0b0180 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 -- 172.21.15.5:0/2356778333 >> 172.21.15.5:0/2356778333 conn(0x7f22ac09aa40 msgr2=0x7f22ac06fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 -- 172.21.15.5:0/2356778333 shutdown_connections 2024-08-18T22:25:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:03.933+0000 7f22b3200640 1 -- 172.21.15.5:0/2356778333 wait complete. 2024-08-18T22:25:04.358 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:24:39.405470+0000', 'modified': '2024-08-18T22:25:02.956480+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7485': {'gid': 7485, 'name': 'c', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.5:6835/580352313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 580352313}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 580352313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7485, 'qdb_cluster': [7485]} 2024-08-18T22:25:04.358 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:25:04.358 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-18T22:25:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.501+0000 7fd171c00640 1 Processor -- start 2024-08-18T22:25:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.501+0000 7fd171c00640 1 -- start start 2024-08-18T22:25:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd171c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd16c0b40c0 0x7fd16c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd171c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c0b31f0 con 0x7fd16c0ce280 2024-08-18T22:25:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd171c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c0b34d0 con 0x7fd16c15b0c0 2024-08-18T22:25:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd171c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd16c0b4a70 con 0x7fd16c0b40c0 2024-08-18T22:25:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd162000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd16c0b40c0 0x7fd16c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd162000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd16c0b40c0 0x7fd16c0b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40226/0 (socket says 172.21.15.5:40226) 2024-08-18T22:25:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd162000640 1 -- 172.21.15.5:0/972739836 learned_addr learned my addr 172.21.15.5:0/972739836 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd16b400640 1 --1- 172.21.15.5:0/972739836 >> v1:172.21.15.5:6789/0 conn(0x7fd16c0ce280 0x7fd16c0ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49806/0 (socket says 172.21.15.5:49806) 2024-08-18T22:25:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd162000640 1 -- 172.21.15.5:0/972739836 >> v1:172.21.15.117:6789/0 conn(0x7fd16c15b0c0 legacy=0x7fd16c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd162000640 1 -- 172.21.15.5:0/972739836 >> v1:172.21.15.5:6789/0 conn(0x7fd16c0ce280 legacy=0x7fd16c0ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd162000640 1 -- 172.21.15.5:0/972739836 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c0b37b0 con 0x7fd16c0b40c0 2024-08-18T22:25:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.505+0000 7fd162000640 1 --2- 172.21.15.5:0/972739836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd16c0b40c0 0x7fd16c0b4530 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fd154009870 tx=0x7fd15401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e6d6e2acb255c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd16a000640 1 -- 172.21.15.5:0/972739836 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1540b0070 con 0x7fd16c0b40c0 2024-08-18T22:25:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd16a000640 1 -- 172.21.15.5:0/972739836 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1540ab600 con 0x7fd16c0b40c0 2024-08-18T22:25:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd16a000640 1 -- 172.21.15.5:0/972739836 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1540ab9d0 con 0x7fd16c0b40c0 2024-08-18T22:25:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 -- 172.21.15.5:0/972739836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd16c0b40c0 msgr2=0x7fd16c0b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 --2- 172.21.15.5:0/972739836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd16c0b40c0 0x7fd16c0b4530 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fd154009870 tx=0x7fd15401c440 comp rx=0 tx=0).stop 2024-08-18T22:25:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 -- 172.21.15.5:0/972739836 shutdown_connections 2024-08-18T22:25:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 --2- 172.21.15.5:0/972739836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd16c0b40c0 0x7fd16c0b4530 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 -- 172.21.15.5:0/972739836 >> 172.21.15.5:0/972739836 conn(0x7fd16c0b1dc0 msgr2=0x7fd16c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 -- 172.21.15.5:0/972739836 shutdown_connections 2024-08-18T22:25:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 -- 172.21.15.5:0/972739836 wait complete. 2024-08-18T22:25:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 Processor -- start 2024-08-18T22:25:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 -- start start 2024-08-18T22:25:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd16c0b40c0 0x7fd16c149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd16c0ce280 0x7fd16c15b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd16c15b0c0 0x7fd16c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c06e410 con 0x7fd16c15b0c0 2024-08-18T22:25:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c06f880 con 0x7fd16c0b40c0 2024-08-18T22:25:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd171c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd16c06e590 con 0x7fd16c0ce280 2024-08-18T22:25:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd16b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd16c15b0c0 0x7fd16c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd16b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd16c15b0c0 0x7fd16c159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40240/0 (socket says 172.21.15.5:40240) 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd16b400640 1 -- 172.21.15.5:0/3466573918 learned_addr learned my addr 172.21.15.5:0/3466573918 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd16aa00640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd16c0b40c0 0x7fd16c149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.509+0000 7fd162000640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd16c0ce280 0x7fd16c15b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd16b400640 1 -- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd16c0ce280 msgr2=0x7fd16c15b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd16b400640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd16c0ce280 0x7fd16c15b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd16b400640 1 -- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd16c0b40c0 msgr2=0x7fd16c149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd16b400640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd16c0b40c0 0x7fd16c149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd16b400640 1 -- 172.21.15.5:0/3466573918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c15e120 con 0x7fd16c15b0c0 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd16b400640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd16c15b0c0 0x7fd16c159e90 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fd16400caa0 tx=0x7fd16400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd163400640 1 -- 172.21.15.5:0/3466573918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd164017070 con 0x7fd16c15b0c0 2024-08-18T22:25:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd163400640 1 -- 172.21.15.5:0/3466573918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16400a6d0 con 0x7fd16c15b0c0 2024-08-18T22:25:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd171c00640 1 -- 172.21.15.5:0/3466573918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16c15e400 con 0x7fd16c15b0c0 2024-08-18T22:25:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd163400640 1 -- 172.21.15.5:0/3466573918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16400aa80 con 0x7fd16c15b0c0 2024-08-18T22:25:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd171c00640 1 -- 172.21.15.5:0/3466573918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd16c0c98a0 con 0x7fd16c15b0c0 2024-08-18T22:25:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd163400640 1 -- 172.21.15.5:0/3466573918 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd16401a070 con 0x7fd16c15b0c0 2024-08-18T22:25:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd163400640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1480678c0 0x7fd148069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd163400640 1 -- 172.21.15.5:0/3466573918 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6389+0+0 (secure 0 0 0) 0x7fd164085730 con 0x7fd16c15b0c0 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.513+0000 7fd16aa00640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1480678c0 0x7fd148069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 Processor -- start 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 -- start start 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd16aa00640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1480678c0 0x7fd148069d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0015b0 tx=0x7fd15c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78ad50 0x561f1f78b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f78b670 0x561f1f741450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f741990 0x561f1f741d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561f1f627fd0 con 0x561f1f78b670 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561f1f58e3c0 con 0x561f1f78ad50 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561f1f533f70 con 0x561f1f741990 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd162000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f78b670 0x561f1f741450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd162000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f78b670 0x561f1f741450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40248/0 (socket says 172.21.15.5:40248) 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd162000640 1 -- 172.21.15.5:0/3175089128 learned_addr learned my addr 172.21.15.5:0/3175089128 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd16aa00640 1 --2- 172.21.15.5:0/3175089128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78ad50 0x561f1f78b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd16b400640 1 --2- 172.21.15.5:0/3175089128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f741990 0x561f1f741d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd162000640 1 -- 172.21.15.5:0/3175089128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f741990 msgr2=0x561f1f741d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd162000640 1 --2- 172.21.15.5:0/3175089128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f741990 0x561f1f741d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd162000640 1 -- 172.21.15.5:0/3175089128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78ad50 msgr2=0x561f1f78b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd162000640 1 --2- 172.21.15.5:0/3175089128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78ad50 0x561f1f78b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd162000640 1 -- 172.21.15.5:0/3175089128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f1f5282e0 con 0x561f1f78b670 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd16b400640 1 --2- 172.21.15.5:0/3175089128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f741990 0x561f1f741d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd16aa00640 1 --2- 172.21.15.5:0/3175089128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78ad50 0x561f1f78b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd162000640 1 --2- 172.21.15.5:0/3175089128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f78b670 0x561f1f741450 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd154019050 tx=0x7fd1540a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1884d7b710c95ab3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd15b400640 1 -- 172.21.15.5:0/3175089128 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1540b0040 con 0x561f1f78b670 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd15b400640 1 -- 172.21.15.5:0/3175089128 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1540bb070 con 0x561f1f78b670 2024-08-18T22:25:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd15b400640 1 -- 172.21.15.5:0/3175089128 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1540abc20 con 0x561f1f78b670 2024-08-18T22:25:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 -- 172.21.15.5:0/3175089128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f78b670 msgr2=0x561f1f741450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 --2- 172.21.15.5:0/3175089128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f78b670 0x561f1f741450 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd154019050 tx=0x7fd1540a6000 comp rx=0 tx=0).stop 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 -- 172.21.15.5:0/3175089128 shutdown_connections 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 --2- 172.21.15.5:0/3175089128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f741990 0x561f1f741d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 --2- 172.21.15.5:0/3175089128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f78b670 0x561f1f741450 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 --2- 172.21.15.5:0/3175089128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78ad50 0x561f1f78b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 -- 172.21.15.5:0/3175089128 >> 172.21.15.5:0/3175089128 conn(0x561f1f73d910 msgr2=0x561f1f73fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 -- 172.21.15.5:0/3175089128 shutdown_connections 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 -- 172.21.15.5:0/3175089128 wait complete. 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.517+0000 7fd1750cd000 1 -- start start 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 1 Processor -- start 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f778640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78ad50 0x561f1f746b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78b670 0x561f1f7470d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561f1f535e40 con 0x561f1f741990 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561f1f64baf0 con 0x561f1f78ad50 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561f1f5f0450 con 0x561f1f78b670 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 10 client.0 _ll_register_callbacks cb 0x561f1f72c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd16aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f778640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd16aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f778640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40254/0 (socket says 172.21.15.5:40254) 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd16aa00640 1 -- 172.21.15.5:0/2633474794 learned_addr learned my addr 172.21.15.5:0/2633474794 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd162000640 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78ad50 0x561f1f746b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd16b400640 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78b670 0x561f1f7470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd16aa00640 1 -- 172.21.15.5:0/2633474794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78b670 msgr2=0x561f1f7470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd16aa00640 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78b670 0x561f1f7470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd16aa00640 1 -- 172.21.15.5:0/2633474794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78ad50 msgr2=0x561f1f746b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd16aa00640 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78ad50 0x561f1f746b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd16aa00640 1 -- 172.21.15.5:0/2633474794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f1f515fd0 con 0x561f1f741990 2024-08-18T22:25:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd16aa00640 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f778640 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd15c007f30 tx=0x7fd15c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195e6a22a59af2cb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd14fe00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:25:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd14fe00640 1 -- 172.21.15.5:0/2633474794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c027060 con 0x561f1f741990 2024-08-18T22:25:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd14fe00640 1 -- 172.21.15.5:0/2633474794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 6389+0+0 (secure 0 0 0) 0x7fd15c010040 con 0x561f1f741990 2024-08-18T22:25:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 1 -- 172.21.15.5:0/2633474794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1540bb070 con 0x561f1f741990 2024-08-18T22:25:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd14fe00640 1 -- 172.21.15.5:0/2633474794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fd15c00ec40 con 0x561f1f741990 2024-08-18T22:25:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 10 client.7533 fetch_fsmap learned FSMap version 81 2024-08-18T22:25:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 1 -- 172.21.15.5:0/2633474794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x561f1f6114d0 con 0x561f1f741990 2024-08-18T22:25:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd14fe00640 1 -- 172.21.15.5:0/2633474794 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1540bb070 con 0x561f1f741990 2024-08-18T22:25:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd14fe00640 1 -- 172.21.15.5:0/2633474794 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 81) ==== 3502+0+0 (secure 0 0 0) 0x7fd15c013420 con 0x561f1f741990 2024-08-18T22:25:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 10 client.7533 fetch_fsmap finished waiting for FSMap version 81 2024-08-18T22:25:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 10 client.7533 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:25:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 20 client.7533 populate_metadata read hostname 'smithi005' 2024-08-18T22:25:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x561f1f7794f0 0x561f1f7798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 4 client.7533 mds_command: new command op to 7485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:25:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd1750cd000 1 -- 172.21.15.5:0/2633474794 --> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f1f528c00 con 0x561f1f7794f0 2024-08-18T22:25:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd162000640 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x561f1f7794f0 0x561f1f7798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd162000640 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x561f1f7794f0 0x561f1f7798d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac2e1c0eddb28724 server_cookie=3260e76fa671abb4 in_seq=0 out_seq=0 2024-08-18T22:25:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.521+0000 7fd14fe00640 10 client.7533 ms_handle_connect on v2:172.21.15.5:6834/580352313 2024-08-18T22:25:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd14fe00640 1 -- 172.21.15.5:0/2633474794 <== mds.0 v2:172.21.15.5:6834/580352313 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f1f528c00 con 0x561f1f7794f0 2024-08-18T22:25:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd14fe00640 10 client.7533 handle_command_reply: tid=0 2024-08-18T22:25:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 1 client.7533 shutdown 2024-08-18T22:25:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 1 -- 172.21.15.5:0/2633474794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 msgr2=0x561f1f778640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f778640 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd15c007f30 tx=0x7fd15c000bd0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 1 -- 172.21.15.5:0/2633474794 shutdown_connections 2024-08-18T22:25:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x561f1f7794f0 0x561f1f7798d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78b670 0x561f1f7470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78ad50 0x561f1f746b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd14fe00640 0 client.7533 ms_handle_reset on v2:172.21.15.5:6834/580352313 2024-08-18T22:25:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 1 --2- 172.21.15.5:0/2633474794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f778640 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 1 -- 172.21.15.5:0/2633474794 >> 172.21.15.5:0/2633474794 conn(0x561f1f73d910 msgr2=0x561f1f740520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 1 -- 172.21.15.5:0/2633474794 shutdown_connections 2024-08-18T22:25:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 1 -- 172.21.15.5:0/2633474794 wait complete. 2024-08-18T22:25:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.525+0000 7fd1750cd000 20 client.7533 trim_cache size 0 max 16384 2024-08-18T22:25:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 Processor -- start 2024-08-18T22:25:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 -- start start 2024-08-18T22:25:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f78a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78ad50 0x561f1f78a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78b670 0x561f1f7a2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c2031d0 con 0x561f1f741990 2024-08-18T22:25:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c0cad60 con 0x561f1f78b670 2024-08-18T22:25:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd16c202b80 con 0x561f1f78ad50 2024-08-18T22:25:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd16aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f78a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd16aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f78a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40260/0 (socket says 172.21.15.5:40260) 2024-08-18T22:25:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd16aa00640 1 -- 172.21.15.5:0/1506799327 learned_addr learned my addr 172.21.15.5:0/1506799327 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd16aa00640 1 -- 172.21.15.5:0/1506799327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78ad50 msgr2=0x561f1f78a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd16aa00640 1 --2- 172.21.15.5:0/1506799327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78ad50 0x561f1f78a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd16aa00640 1 -- 172.21.15.5:0/1506799327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78b670 msgr2=0x561f1f7a2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd16aa00640 1 --2- 172.21.15.5:0/1506799327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78b670 0x561f1f7a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd16aa00640 1 -- 172.21.15.5:0/1506799327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f1f78b4a0 con 0x561f1f741990 2024-08-18T22:25:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd16aa00640 1 --2- 172.21.15.5:0/1506799327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f78a060 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd15c001e40 tx=0x7fd15c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a98ddec89c1e173 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd15aa00640 1 -- 172.21.15.5:0/1506799327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c005180 con 0x561f1f741990 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd15aa00640 1 -- 172.21.15.5:0/1506799327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15c00ede0 con 0x561f1f741990 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd15aa00640 1 -- 172.21.15.5:0/1506799327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c013420 con 0x561f1f741990 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 -- 172.21.15.5:0/1506799327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 msgr2=0x561f1f78a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 --2- 172.21.15.5:0/1506799327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f78a060 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd15c001e40 tx=0x7fd15c01f000 comp rx=0 tx=0).stop 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 -- 172.21.15.5:0/1506799327 shutdown_connections 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 --2- 172.21.15.5:0/1506799327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78b670 0x561f1f7a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 --2- 172.21.15.5:0/1506799327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78ad50 0x561f1f78a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 --2- 172.21.15.5:0/1506799327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f78a060 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 -- 172.21.15.5:0/1506799327 >> 172.21.15.5:0/1506799327 conn(0x561f1f73d910 msgr2=0x561f1f789950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 -- 172.21.15.5:0/1506799327 shutdown_connections 2024-08-18T22:25:04.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 -- 172.21.15.5:0/1506799327 wait complete. 2024-08-18T22:25:04.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 -- start start 2024-08-18T22:25:04.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.545+0000 7fd1750cd000 1 Processor -- start 2024-08-18T22:25:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f79f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78ad50 0x561f1f79f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78b670 0x561f1f79fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561f1f5471d0 con 0x561f1f741990 2024-08-18T22:25:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561f1f525900 con 0x561f1f78b670 2024-08-18T22:25:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561f1f58d6d0 con 0x561f1f78ad50 2024-08-18T22:25:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 10 client.0 _ll_register_callbacks cb 0x7fd15c0050d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:25:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd16aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f79f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd16aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f79f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40266/0 (socket says 172.21.15.5:40266) 2024-08-18T22:25:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd16aa00640 1 -- 172.21.15.5:0/109382385 learned_addr learned my addr 172.21.15.5:0/109382385 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd162000640 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78ad50 0x561f1f79f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd16b400640 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78b670 0x561f1f79fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd16aa00640 1 -- 172.21.15.5:0/109382385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78ad50 msgr2=0x561f1f79f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd16aa00640 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78ad50 0x561f1f79f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd16aa00640 1 -- 172.21.15.5:0/109382385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78b670 msgr2=0x561f1f79fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd16aa00640 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78b670 0x561f1f79fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd16aa00640 1 -- 172.21.15.5:0/109382385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f1f587b30 con 0x561f1f741990 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd16aa00640 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f79f350 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009010 tx=0x7fd15c005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635c0e9ed419037a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd14fe00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd14fe00640 1 -- 172.21.15.5:0/109382385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c03b060 con 0x561f1f741990 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd14fe00640 1 -- 172.21.15.5:0/109382385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 6389+0+0 (secure 0 0 0) 0x7fd15c010070 con 0x561f1f741990 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 -- 172.21.15.5:0/109382385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd15c00ede0 con 0x561f1f741990 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd14fe00640 1 -- 172.21.15.5:0/109382385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fd15c041050 con 0x561f1f741990 2024-08-18T22:25:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 10 client.7539 fetch_fsmap learned FSMap version 81 2024-08-18T22:25:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 -- 172.21.15.5:0/109382385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x561f1f53f810 con 0x561f1f741990 2024-08-18T22:25:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd14fe00640 1 -- 172.21.15.5:0/109382385 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15c00ede0 con 0x561f1f741990 2024-08-18T22:25:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd14fe00640 1 -- 172.21.15.5:0/109382385 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 81) ==== 3502+0+0 (secure 0 0 0) 0x7fd15c044020 con 0x561f1f741990 2024-08-18T22:25:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 10 client.7539 fetch_fsmap finished waiting for FSMap version 81 2024-08-18T22:25:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 10 client.7539 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-18T22:25:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 20 client.7539 populate_metadata read hostname 'smithi005' 2024-08-18T22:25:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x561f1f7a0730 0x561f1f806220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 4 client.7539 mds_command: new command op to 7485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:25:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 -- 172.21.15.5:0/109382385 --> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] -- command(tid 0: {"prefix": "status"}) -- 0x561f1f59baf0 con 0x561f1f7a0730 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd162000640 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x561f1f7a0730 0x561f1f806220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd162000640 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x561f1f7a0730 0x561f1f806220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21a13797380cfc71 server_cookie=d7203c7cae48e04a in_seq=0 out_seq=0 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd14fe00640 10 client.7539 ms_handle_connect on v2:172.21.15.5:6834/580352313 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd14fe00640 1 -- 172.21.15.5:0/109382385 <== mds.0 v2:172.21.15.5:6834/580352313 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x561f1f59baf0 con 0x561f1f7a0730 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd14fe00640 10 client.7539 handle_command_reply: tid=0 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 client.7539 shutdown 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 -- 172.21.15.5:0/109382385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 msgr2=0x561f1f79f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f79f350 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009010 tx=0x7fd15c005000 comp rx=0 tx=0).stop 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 -- 172.21.15.5:0/109382385 shutdown_connections 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x561f1f7a0730 0x561f1f806220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561f1f78b670 0x561f1f79fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561f1f78ad50 0x561f1f79f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 --2- 172.21.15.5:0/109382385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561f1f741990 0x561f1f79f350 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd14fe00640 0 client.7539 ms_handle_reset on v2:172.21.15.5:6834/580352313 2024-08-18T22:25:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 -- 172.21.15.5:0/109382385 >> 172.21.15.5:0/109382385 conn(0x561f1f73d910 msgr2=0x561f1f778310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 -- 172.21.15.5:0/109382385 shutdown_connections 2024-08-18T22:25:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.549+0000 7fd1750cd000 1 -- 172.21.15.5:0/109382385 wait complete. 2024-08-18T22:25:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd1750cd000 20 client.7539 trim_cache size 0 max 16384 2024-08-18T22:25:04.557 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:25:04.557 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:25:04.557 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:25:04.557 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7485, 2024-08-18T22:25:04.557 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:25:04.557 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:25:04.557 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:25:04.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 4.6010251350000004, 2024-08-18T22:25:04.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 81, 2024-08-18T22:25:04.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 102, 2024-08-18T22:25:04.558 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 101, 2024-08-18T22:25:04.558 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 9.8574704569999998 2024-08-18T22:25:04.558 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:25:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 -- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1480678c0 msgr2=0x7fd148069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1480678c0 0x7fd148069d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0015b0 tx=0x7fd15c009040 comp rx=0 tx=0).stop 2024-08-18T22:25:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 -- 172.21.15.5:0/3466573918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd16c15b0c0 msgr2=0x7fd16c159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd16c15b0c0 0x7fd16c159e90 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fd16400caa0 tx=0x7fd16400cea0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 -- 172.21.15.5:0/3466573918 shutdown_connections 2024-08-18T22:25:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1480678c0 0x7fd148069d80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd16c15b0c0 0x7fd16c159e90 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd16c0ce280 0x7fd16c15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 --2- 172.21.15.5:0/3466573918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd16c0b40c0 0x7fd16c149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 -- 172.21.15.5:0/3466573918 >> 172.21.15.5:0/3466573918 conn(0x7fd16c0b1dc0 msgr2=0x7fd16c06db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:04.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 -- 172.21.15.5:0/3466573918 shutdown_connections 2024-08-18T22:25:04.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.553+0000 7fd171c00640 1 -- 172.21.15.5:0/3466573918 wait complete. 2024-08-18T22:25:04.571 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-08-18T22:25:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60f0800640 1 Processor -- start 2024-08-18T22:25:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60f0800640 1 -- start start 2024-08-18T22:25:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60f0800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60e815c180 0x7f60e80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60f0800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60e80cfb00 con 0x7f60e815c560 2024-08-18T22:25:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60f0800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60e815c9f0 con 0x7f60e815d4d0 2024-08-18T22:25:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60f0800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f60e815d040 con 0x7f60e815c180 2024-08-18T22:25:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60ede00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60e815c180 0x7f60e80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60ed400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f60e815c560 0x7f60e80ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49818/0 (socket says 172.21.15.5:49818) 2024-08-18T22:25:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60ed400640 1 -- 172.21.15.5:0/4199302972 learned_addr learned my addr 172.21.15.5:0/4199302972 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60ede00640 1 -- 172.21.15.5:0/4199302972 >> v1:172.21.15.117:6789/0 conn(0x7f60e815d4d0 legacy=0x7f60e806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60ede00640 1 -- 172.21.15.5:0/4199302972 >> v1:172.21.15.5:6789/0 conn(0x7f60e815c560 legacy=0x7f60e80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60ede00640 1 -- 172.21.15.5:0/4199302972 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e815ccd0 con 0x7f60e815c180 2024-08-18T22:25:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.721+0000 7f60eca00640 1 -- 172.21.15.5:0/4199302972 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812146120 0 0) 0x7f60e80cfb00 con 0x7f60e815c560 2024-08-18T22:25:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.725+0000 7f60ede00640 1 --2- 172.21.15.5:0/4199302972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e815c180 0x7f60e80cdf10 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0097c0 tx=0x7f60dc01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e7f6717e2c1810 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.725+0000 7f60eca00640 1 -- 172.21.15.5:0/4199302972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0ab5f0 con 0x7f60e815c180 2024-08-18T22:25:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.725+0000 7f60eca00640 1 -- 172.21.15.5:0/4199302972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60dc0b0070 con 0x7f60e815c180 2024-08-18T22:25:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.725+0000 7f60eca00640 1 -- 172.21.15.5:0/4199302972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0ab9b0 con 0x7f60e815c180 2024-08-18T22:25:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.725+0000 7f60f0800640 1 -- 172.21.15.5:0/4199302972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e815c180 msgr2=0x7f60e80cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.725+0000 7f60f0800640 1 --2- 172.21.15.5:0/4199302972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e815c180 0x7f60e80cdf10 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0097c0 tx=0x7f60dc01c3d0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.725+0000 7f60f0800640 1 -- 172.21.15.5:0/4199302972 shutdown_connections 2024-08-18T22:25:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.725+0000 7f60f0800640 1 --2- 172.21.15.5:0/4199302972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e815c180 0x7f60e80cdf10 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.725+0000 7f60f0800640 1 -- 172.21.15.5:0/4199302972 >> 172.21.15.5:0/4199302972 conn(0x7f60e80b1dc0 msgr2=0x7f60e80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.725+0000 7f60f0800640 1 -- 172.21.15.5:0/4199302972 shutdown_connections 2024-08-18T22:25:04.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.725+0000 7f60f0800640 1 -- 172.21.15.5:0/4199302972 wait complete. 2024-08-18T22:25:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60f0800640 1 Processor -- start 2024-08-18T22:25:04.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60f0800640 1 -- start start 2024-08-18T22:25:04.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60f0800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60e815c180 0x7f60e814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60f0800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60e815d4d0 0x7f60e80b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60f0800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b0d80 0x7f60e80ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60f0800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f60e816a2c0 con 0x7f60e80b0d80 2024-08-18T22:25:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60f0800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f60e816a140 con 0x7f60e815c180 2024-08-18T22:25:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60f0800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f60e816a440 con 0x7f60e815d4d0 2024-08-18T22:25:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ee800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b0d80 0x7f60e80ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ee800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b0d80 0x7f60e80ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40294/0 (socket says 172.21.15.5:40294) 2024-08-18T22:25:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ee800640 1 -- 172.21.15.5:0/4001585253 learned_addr learned my addr 172.21.15.5:0/4001585253 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:04.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ede00640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60e815c180 0x7f60e814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ed400640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60e815d4d0 0x7f60e80b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ee800640 1 -- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60e815d4d0 msgr2=0x7f60e80b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ee800640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60e815d4d0 0x7f60e80b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ee800640 1 -- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60e815c180 msgr2=0x7f60e814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ee800640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60e815c180 0x7f60e814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ee800640 1 -- 172.21.15.5:0/4001585253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e806e0c0 con 0x7f60e80b0d80 2024-08-18T22:25:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ed400640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60e815d4d0 0x7f60e80b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60ee800640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b0d80 0x7f60e80ae7e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f60e400b9c0 tx=0x7f60e400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60e2000640 1 -- 172.21.15.5:0/4001585253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4019070 con 0x7f60e80b0d80 2024-08-18T22:25:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60e2000640 1 -- 172.21.15.5:0/4001585253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e400cba0 con 0x7f60e80b0d80 2024-08-18T22:25:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60e2000640 1 -- 172.21.15.5:0/4001585253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4014440 con 0x7f60e80b0d80 2024-08-18T22:25:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60f0800640 1 -- 172.21.15.5:0/4001585253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e8154000 con 0x7f60e80b0d80 2024-08-18T22:25:04.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60f0800640 1 -- 172.21.15.5:0/4001585253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e81545c0 con 0x7f60e80b0d80 2024-08-18T22:25:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.729+0000 7f60f0800640 1 -- 172.21.15.5:0/4001585253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e8156f30 con 0x7f60e80b0d80 2024-08-18T22:25:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.733+0000 7f60e2000640 1 -- 172.21.15.5:0/4001585253 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f60e401c070 con 0x7f60e80b0d80 2024-08-18T22:25:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.733+0000 7f60e2000640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60cc0678c0 0x7f60cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.733+0000 7f60e2000640 1 -- 172.21.15.5:0/4001585253 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f60e4085b30 con 0x7f60e80b0d80 2024-08-18T22:25:04.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.733+0000 7f60ede00640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60cc0678c0 0x7f60cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:04.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.733+0000 7f60ede00640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60cc0678c0 0x7f60cc069d80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0af000 tx=0x7f60dc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:04.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.737+0000 7f60e2000640 1 -- 172.21.15.5:0/4001585253 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f60e4055e00 con 0x7f60e80b0d80 2024-08-18T22:25:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.901+0000 7f60f0800640 1 -- 172.21.15.5:0/4001585253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f60e8156c50 con 0x7f60e80b0d80 2024-08-18T22:25:04.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.905+0000 7f60e2000640 1 -- 172.21.15.5:0/4001585253 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) ==== 117+0+0 (secure 0 0 0) 0x7f60e405a100 con 0x7f60e80b0d80 2024-08-18T22:25:04.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 -- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60cc0678c0 msgr2=0x7f60cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60cc0678c0 0x7f60cc069d80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0af000 tx=0x7f60dc0a7000 comp rx=0 tx=0).stop 2024-08-18T22:25:04.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 -- 172.21.15.5:0/4001585253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b0d80 msgr2=0x7f60e80ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b0d80 0x7f60e80ae7e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f60e400b9c0 tx=0x7f60e400be80 comp rx=0 tx=0).stop 2024-08-18T22:25:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 -- 172.21.15.5:0/4001585253 shutdown_connections 2024-08-18T22:25:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60cc0678c0 0x7f60cc069d80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80b0d80 0x7f60e80ae7e0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60e815d4d0 0x7f60e80b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 --2- 172.21.15.5:0/4001585253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60e815c180 0x7f60e814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 -- 172.21.15.5:0/4001585253 >> 172.21.15.5:0/4001585253 conn(0x7f60e80b1dc0 msgr2=0x7f60e8073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 -- 172.21.15.5:0/4001585253 shutdown_connections 2024-08-18T22:25:04.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:04.909+0000 7f60f0800640 1 -- 172.21.15.5:0/4001585253 wait complete. 2024-08-18T22:25:04.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-08-18T22:25:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6150c00640 1 Processor -- start 2024-08-18T22:25:05.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6150c00640 1 -- start start 2024-08-18T22:25:05.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6150c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c0d1090 0x7f614c0d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6150c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614c0d30b0 con 0x7f614c15fb80 2024-08-18T22:25:05.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6150c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614c0d1bd0 con 0x7f614c0b5ad0 2024-08-18T22:25:05.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6150c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f614c071c60 con 0x7f614c0d1090 2024-08-18T22:25:05.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6149e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f614c15fb80 0x7f614c06fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49824/0 (socket says 172.21.15.5:49824) 2024-08-18T22:25:05.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6149e00640 1 -- 172.21.15.5:0/629931645 learned_addr learned my addr 172.21.15.5:0/629931645 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6149400640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c0d1090 0x7f614c0d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1442928013 0 0) 0x7f614c0d30b0 con 0x7f614c15fb80 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6130003530 con 0x7f614c15fb80 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1256687420 0 0) 0x7f614c0d1bd0 con 0x7f614c0b5ad0 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f614c0d30b0 con 0x7f614c0b5ad0 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 539027514 0 0) 0x7f6130003530 con 0x7f614c15fb80 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c0d1090 msgr2=0x7f614c0d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c0d1090 0x7f614c0d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 >> v1:172.21.15.117:6789/0 conn(0x7f614c0b5ad0 legacy=0x7f614c071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c0d2dd0 con 0x7f614c15fb80 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f613c001680 con 0x7f614c15fb80 2024-08-18T22:25:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 >> v1:172.21.15.5:6789/0 conn(0x7f614c15fb80 legacy=0x7f614c06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6130003b80 0x7f6130003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6130004810 0x7f6130004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6130005220 0x7f613000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f614c071c60 con 0x7f6130005220 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f613000c150 con 0x7f6130003b80 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f613000c350 con 0x7f6130004810 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.073+0000 7f6149400640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c0d1090 0x7f614c0d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f614a800640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6130005220 0x7f613000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f6149e00640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6130003b80 0x7f6130003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f6149400640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6130004810 0x7f6130004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f614a800640 1 -- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6130004810 msgr2=0x7f6130004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:05.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f614a800640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6130004810 0x7f6130004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f614a800640 1 -- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6130003b80 msgr2=0x7f6130003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f614a800640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6130003b80 0x7f6130003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f614a800640 1 -- 172.21.15.5:0/629931645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6130003530 con 0x7f6130005220 2024-08-18T22:25:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f614a800640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6130005220 0x7f613000b9d0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f6144001fd0 tx=0x7f614401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ceab620770ba635 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6144001c20 con 0x7f6130005220 2024-08-18T22:25:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6144003ba0 con 0x7f6130005220 2024-08-18T22:25:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.077+0000 7f6148a00640 1 -- 172.21.15.5:0/629931645 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61440050d0 con 0x7f6130005220 2024-08-18T22:25:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 -- 172.21.15.5:0/629931645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6130005220 msgr2=0x7f613000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 --2- 172.21.15.5:0/629931645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6130005220 0x7f613000b9d0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f6144001fd0 tx=0x7f614401c900 comp rx=0 tx=0).stop 2024-08-18T22:25:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f614a800640 1 -- 172.21.15.5:0/629931645 reap_dead start 2024-08-18T22:25:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 -- 172.21.15.5:0/629931645 shutdown_connections 2024-08-18T22:25:05.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 -- 172.21.15.5:0/629931645 >> 172.21.15.5:0/629931645 conn(0x7f614c0d2180 msgr2=0x7f614c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 -- 172.21.15.5:0/629931645 shutdown_connections 2024-08-18T22:25:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 -- 172.21.15.5:0/629931645 wait complete. 2024-08-18T22:25:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 Processor -- start 2024-08-18T22:25:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 -- start start 2024-08-18T22:25:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c148d80 0x7f614c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f614c0af0d0 0x7f614c1607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c06cac0 0x7f614c06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f614c0d1eb0 con 0x7f614c0af0d0 2024-08-18T22:25:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f614c0b5f00 con 0x7f614c06cac0 2024-08-18T22:25:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6150c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f614c168300 con 0x7f614c148d80 2024-08-18T22:25:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6149400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f614c0af0d0 0x7f614c1607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6149400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f614c0af0d0 0x7f614c1607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40298/0 (socket says 172.21.15.5:40298) 2024-08-18T22:25:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6149400640 1 -- 172.21.15.5:0/3775712428 learned_addr learned my addr 172.21.15.5:0/3775712428 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6149e00640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c148d80 0x7f614c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f614a800640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c06cac0 0x7f614c06cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6149400640 1 -- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c148d80 msgr2=0x7f614c15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6149400640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c148d80 0x7f614c15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6149400640 1 -- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c06cac0 msgr2=0x7f614c06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6149400640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c06cac0 0x7f614c06cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6149400640 1 -- 172.21.15.5:0/3775712428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c160d10 con 0x7f614c0af0d0 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f614a800640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c06cac0 0x7f614c06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.081+0000 7f6149400640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f614c0af0d0 0x7f614c1607d0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f61380119d0 tx=0x7f6138011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.085+0000 7f6142000640 1 -- 172.21.15.5:0/3775712428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613800fb50 con 0x7f614c0af0d0 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.085+0000 7f6142000640 1 -- 172.21.15.5:0/3775712428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f613800fcf0 con 0x7f614c0af0d0 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.085+0000 7f6142000640 1 -- 172.21.15.5:0/3775712428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613800fea0 con 0x7f614c0af0d0 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.085+0000 7f6150c00640 1 -- 172.21.15.5:0/3775712428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614c160fd0 con 0x7f614c0af0d0 2024-08-18T22:25:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.085+0000 7f6150c00640 1 -- 172.21.15.5:0/3775712428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614c161590 con 0x7f614c0af0d0 2024-08-18T22:25:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.085+0000 7f6150c00640 1 -- 172.21.15.5:0/3775712428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614c071550 con 0x7f614c0af0d0 2024-08-18T22:25:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.085+0000 7f6142000640 1 -- 172.21.15.5:0/3775712428 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6138012040 con 0x7f614c0af0d0 2024-08-18T22:25:05.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.085+0000 7f6142000640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f612c0678c0 0x7f612c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.085+0000 7f6142000640 1 -- 172.21.15.5:0/3775712428 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f6138086540 con 0x7f614c0af0d0 2024-08-18T22:25:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.085+0000 7f6149e00640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f612c0678c0 0x7f612c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.085+0000 7f6149e00640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f612c0678c0 0x7f612c069d80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f614c0b2830 tx=0x7f613c001010 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:05.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.089+0000 7f6142000640 1 -- 172.21.15.5:0/3775712428 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6138019030 con 0x7f614c0af0d0 2024-08-18T22:25:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.257+0000 7f6150c00640 1 -- 172.21.15.5:0/3775712428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f614c0ce0d0 con 0x7f614c0af0d0 2024-08-18T22:25:05.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.261+0000 7f6142000640 1 -- 172.21.15.5:0/3775712428 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v28)=0 v28) ==== 116+0+0 (secure 0 0 0) 0x7f6138056e60 con 0x7f614c0af0d0 2024-08-18T22:25:05.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 -- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f612c0678c0 msgr2=0x7f612c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f612c0678c0 0x7f612c069d80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f614c0b2830 tx=0x7f613c001010 comp rx=0 tx=0).stop 2024-08-18T22:25:05.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 -- 172.21.15.5:0/3775712428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f614c0af0d0 msgr2=0x7f614c1607d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f614c0af0d0 0x7f614c1607d0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f61380119d0 tx=0x7f6138011e90 comp rx=0 tx=0).stop 2024-08-18T22:25:05.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 -- 172.21.15.5:0/3775712428 shutdown_connections 2024-08-18T22:25:05.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f612c0678c0 0x7f612c069d80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c06cac0 0x7f614c06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f614c0af0d0 0x7f614c1607d0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 --2- 172.21.15.5:0/3775712428 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614c148d80 0x7f614c15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 -- 172.21.15.5:0/3775712428 >> 172.21.15.5:0/3775712428 conn(0x7f614c0d2180 msgr2=0x7f614c1678b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:05.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 -- 172.21.15.5:0/3775712428 shutdown_connections 2024-08-18T22:25:05.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.265+0000 7f6150c00640 1 -- 172.21.15.5:0/3775712428 wait complete. 2024-08-18T22:25:05.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-08-18T22:25:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.425+0000 7f1f8b400640 1 Processor -- start 2024-08-18T22:25:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.425+0000 7f1f8b400640 1 -- start start 2024-08-18T22:25:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f8b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f8415b0c0 0x7f1f8406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f8b400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1f840b40c0 0x7f1f840b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f8b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f84072a30 0x7f1f84072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f8b400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1f840b3d70 con 0x7f1f84072a30 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f8b400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1f840b4a40 con 0x7f1f840b40c0 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f8b400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f840b31f0 con 0x7f1f8415b0c0 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f89400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f84072a30 0x7f1f84072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f89400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f84072a30 0x7f1f84072ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40306/0 (socket says 172.21.15.5:40306) 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f89400640 1 -- 172.21.15.5:0/631087558 learned_addr learned my addr 172.21.15.5:0/631087558 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f88a00640 1 --2- 172.21.15.5:0/631087558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f8415b0c0 0x7f1f8406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f7be00640 1 --2- 172.21.15.5:0/631087558 >> v2:172.21.15.117:3300/0 conn(0x7f1f840b40c0 0x7f1f840b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f89400640 1 -- 172.21.15.5:0/631087558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f8415b0c0 msgr2=0x7f1f8406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f89400640 1 --2- 172.21.15.5:0/631087558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f8415b0c0 0x7f1f8406db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f89400640 1 -- 172.21.15.5:0/631087558 >> v2:172.21.15.117:3300/0 conn(0x7f1f840b40c0 msgr2=0x7f1f840b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:05.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f89400640 1 --2- 172.21.15.5:0/631087558 >> v2:172.21.15.117:3300/0 conn(0x7f1f840b40c0 0x7f1f840b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f89400640 1 -- 172.21.15.5:0/631087558 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f840b34d0 con 0x7f1f84072a30 2024-08-18T22:25:05.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.429+0000 7f1f7be00640 1 --2- 172.21.15.5:0/631087558 >> v2:172.21.15.117:3300/0 conn(0x7f1f840b40c0 0x7f1f840b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:05.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f89400640 1 --2- 172.21.15.5:0/631087558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f84072a30 0x7f1f84072ea0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1f8406d330 tx=0x7f1f7c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef08eb66a96164 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:05.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f83e00640 1 -- 172.21.15.5:0/631087558 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0a5720 con 0x7f1f84072a30 2024-08-18T22:25:05.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f83e00640 1 -- 172.21.15.5:0/631087558 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c0a58c0 con 0x7f1f84072a30 2024-08-18T22:25:05.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f83e00640 1 -- 172.21.15.5:0/631087558 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0a5c90 con 0x7f1f84072a30 2024-08-18T22:25:05.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 -- 172.21.15.5:0/631087558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f84072a30 msgr2=0x7f1f84072ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 --2- 172.21.15.5:0/631087558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f84072a30 0x7f1f84072ea0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1f8406d330 tx=0x7f1f7c01c8a0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 -- 172.21.15.5:0/631087558 shutdown_connections 2024-08-18T22:25:05.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 --2- 172.21.15.5:0/631087558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f84072a30 0x7f1f84072ea0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 --2- 172.21.15.5:0/631087558 >> v2:172.21.15.117:3300/0 conn(0x7f1f840b40c0 0x7f1f840b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 --2- 172.21.15.5:0/631087558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f8415b0c0 0x7f1f8406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 -- 172.21.15.5:0/631087558 >> 172.21.15.5:0/631087558 conn(0x7f1f840b1dc0 msgr2=0x7f1f840b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:05.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 -- 172.21.15.5:0/631087558 shutdown_connections 2024-08-18T22:25:05.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 -- 172.21.15.5:0/631087558 wait complete. 2024-08-18T22:25:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 Processor -- start 2024-08-18T22:25:05.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 -- start start 2024-08-18T22:25:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f84072a30 0x7f1f8415e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f840b40c0 0x7f1f840b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8415b0c0 0x7f1f84151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.433+0000 7f1f8b400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8415b620 con 0x7f1f8415b0c0 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f8b400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8415b4a0 con 0x7f1f840b40c0 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f8b400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f840737f0 con 0x7f1f84072a30 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f89400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8415b0c0 0x7f1f84151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f89400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8415b0c0 0x7f1f84151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40322/0 (socket says 172.21.15.5:40322) 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f89400640 1 -- 172.21.15.5:0/2757816065 learned_addr learned my addr 172.21.15.5:0/2757816065 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f88a00640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f84072a30 0x7f1f8415e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f7be00640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f840b40c0 0x7f1f840b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f89400640 1 -- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f84072a30 msgr2=0x7f1f8415e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f89400640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f84072a30 0x7f1f8415e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f89400640 1 -- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f840b40c0 msgr2=0x7f1f840b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f89400640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f840b40c0 0x7f1f840b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f89400640 1 -- 172.21.15.5:0/2757816065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f840cfb10 con 0x7f1f8415b0c0 2024-08-18T22:25:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f7be00640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f840b40c0 0x7f1f840b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f89400640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8415b0c0 0x7f1f84151d90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0af040 tx=0x7f1f7c019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f81600640 1 -- 172.21.15.5:0/2757816065 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0bc020 con 0x7f1f8415b0c0 2024-08-18T22:25:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f81600640 1 -- 172.21.15.5:0/2757816065 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c0b8670 con 0x7f1f8415b0c0 2024-08-18T22:25:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f8b400640 1 -- 172.21.15.5:0/2757816065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f840cf550 con 0x7f1f8415b0c0 2024-08-18T22:25:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f81600640 1 -- 172.21.15.5:0/2757816065 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0b8a60 con 0x7f1f8415b0c0 2024-08-18T22:25:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f8b400640 1 -- 172.21.15.5:0/2757816065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8415c300 con 0x7f1f8415b0c0 2024-08-18T22:25:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f8b400640 1 -- 172.21.15.5:0/2757816065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8406f670 con 0x7f1f8415b0c0 2024-08-18T22:25:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.437+0000 7f1f81600640 1 -- 172.21.15.5:0/2757816065 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f7c0bf020 con 0x7f1f8415b0c0 2024-08-18T22:25:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.441+0000 7f1f81600640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f600678c0 0x7f1f60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.441+0000 7f1f81600640 1 -- 172.21.15.5:0/2757816065 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f1f7c1211d0 con 0x7f1f8415b0c0 2024-08-18T22:25:05.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.441+0000 7f1f88a00640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f600678c0 0x7f1f60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.441+0000 7f1f88a00640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f600678c0 0x7f1f60069d80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1f84156c50 tx=0x7f1f74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:05.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.445+0000 7f1f81600640 1 -- 172.21.15.5:0/2757816065 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1f7c0165e0 con 0x7f1f8415b0c0 2024-08-18T22:25:05.579 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-08-18T22:25:05.577+0000 7f9f10000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:25:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.613+0000 7f1f8b400640 1 -- 172.21.15.5:0/2757816065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f1f84158130 con 0x7f1f8415b0c0 2024-08-18T22:25:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.613+0000 7f1f81600640 1 -- 172.21.15.5:0/2757816065 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v29)=0 v29) ==== 116+0+0 (secure 0 0 0) 0x7f1f7c0f1cd0 con 0x7f1f8415b0c0 2024-08-18T22:25:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 -- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f600678c0 msgr2=0x7f1f60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f600678c0 0x7f1f60069d80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1f84156c50 tx=0x7f1f74008040 comp rx=0 tx=0).stop 2024-08-18T22:25:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 -- 172.21.15.5:0/2757816065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8415b0c0 msgr2=0x7f1f84151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8415b0c0 0x7f1f84151d90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0af040 tx=0x7f1f7c019640 comp rx=0 tx=0).stop 2024-08-18T22:25:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 -- 172.21.15.5:0/2757816065 shutdown_connections 2024-08-18T22:25:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f600678c0 0x7f1f60069d80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f8415b0c0 0x7f1f84151d90 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f840b40c0 0x7f1f840b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 --2- 172.21.15.5:0/2757816065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f84072a30 0x7f1f8415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 -- 172.21.15.5:0/2757816065 >> 172.21.15.5:0/2757816065 conn(0x7f1f840b1dc0 msgr2=0x7f1f840b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 -- 172.21.15.5:0/2757816065 shutdown_connections 2024-08-18T22:25:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.617+0000 7f1f8b400640 1 -- 172.21.15.5:0/2757816065 wait complete. 2024-08-18T22:25:05.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:05.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0380c00640 1 Processor -- start 2024-08-18T22:25:05.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0380c00640 1 -- start start 2024-08-18T22:25:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0380c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f037c15b010 0x7f037c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0380c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f037c0cd3a0 0x7f037c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0380c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037c06f0c0 0x7f037c0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0380c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f037c0cfa30 con 0x7f037c15b010 2024-08-18T22:25:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0380c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f037c0cee20 con 0x7f037c0cd3a0 2024-08-18T22:25:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0380c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f037c0cf100 con 0x7f037c06f0c0 2024-08-18T22:25:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0379e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f037c15b010 0x7f037c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0379e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f037c15b010 0x7f037c0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40334/0 (socket says 172.21.15.5:40334) 2024-08-18T22:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0379e00640 1 -- 172.21.15.5:0/3172602390 learned_addr learned my addr 172.21.15.5:0/3172602390 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0371400640 1 --2- 172.21.15.5:0/3172602390 >> v2:172.21.15.117:3300/0 conn(0x7f037c0cd3a0 0x7f037c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f037a800640 1 --2- 172.21.15.5:0/3172602390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037c06f0c0 0x7f037c0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.777+0000 7f0379e00640 1 -- 172.21.15.5:0/3172602390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037c06f0c0 msgr2=0x7f037c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0379e00640 1 --2- 172.21.15.5:0/3172602390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037c06f0c0 0x7f037c0caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0379e00640 1 -- 172.21.15.5:0/3172602390 >> v2:172.21.15.117:3300/0 conn(0x7f037c0cd3a0 msgr2=0x7f037c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0379e00640 1 --2- 172.21.15.5:0/3172602390 >> v2:172.21.15.117:3300/0 conn(0x7f037c0cd3a0 0x7f037c06eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0379e00640 1 -- 172.21.15.5:0/3172602390 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037c0cf3e0 con 0x7f037c15b010 2024-08-18T22:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0371400640 1 --2- 172.21.15.5:0/3172602390 >> v2:172.21.15.117:3300/0 conn(0x7f037c0cd3a0 0x7f037c06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f037a800640 1 --2- 172.21.15.5:0/3172602390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037c06f0c0 0x7f037c0caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0379e00640 1 --2- 172.21.15.5:0/3172602390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037c15b010 0x7f037c0ce840 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ca580 tx=0x7f036c01e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446b16d413a4620f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0379400640 1 -- 172.21.15.5:0/3172602390 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c0b4070 con 0x7f037c15b010 2024-08-18T22:25:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0379400640 1 -- 172.21.15.5:0/3172602390 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c0a77e0 con 0x7f037c15b010 2024-08-18T22:25:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0379400640 1 -- 172.21.15.5:0/3172602390 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c0a7bb0 con 0x7f037c15b010 2024-08-18T22:25:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0380c00640 1 -- 172.21.15.5:0/3172602390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037c15b010 msgr2=0x7f037c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0380c00640 1 --2- 172.21.15.5:0/3172602390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037c15b010 0x7f037c0ce840 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ca580 tx=0x7f036c01e930 comp rx=0 tx=0).stop 2024-08-18T22:25:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0380c00640 1 -- 172.21.15.5:0/3172602390 shutdown_connections 2024-08-18T22:25:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0380c00640 1 --2- 172.21.15.5:0/3172602390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037c06f0c0 0x7f037c0caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0380c00640 1 --2- 172.21.15.5:0/3172602390 >> v2:172.21.15.117:3300/0 conn(0x7f037c0cd3a0 0x7f037c06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0380c00640 1 --2- 172.21.15.5:0/3172602390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037c15b010 0x7f037c0ce840 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0380c00640 1 -- 172.21.15.5:0/3172602390 >> 172.21.15.5:0/3172602390 conn(0x7f037c0b1c50 msgr2=0x7f037c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0380c00640 1 -- 172.21.15.5:0/3172602390 shutdown_connections 2024-08-18T22:25:05.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.781+0000 7f0380c00640 1 -- 172.21.15.5:0/3172602390 wait complete. 2024-08-18T22:25:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0380c00640 1 Processor -- start 2024-08-18T22:25:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0380c00640 1 -- start start 2024-08-18T22:25:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0380c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f037c06f0c0 0x7f037c14ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0380c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037c0cd3a0 0x7f037c150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0380c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037c15b010 0x7f037c150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0380c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f037c06dbf0 con 0x7f037c0cd3a0 2024-08-18T22:25:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0380c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f037c06da70 con 0x7f037c06f0c0 2024-08-18T22:25:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0380c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f037c06dd70 con 0x7f037c15b010 2024-08-18T22:25:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0371400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037c0cd3a0 0x7f037c150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0371400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037c0cd3a0 0x7f037c150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40344/0 (socket says 172.21.15.5:40344) 2024-08-18T22:25:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0371400640 1 -- 172.21.15.5:0/1725385454 learned_addr learned my addr 172.21.15.5:0/1725385454 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0379e00640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f037c06f0c0 0x7f037c14ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f037a800640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037c15b010 0x7f037c150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0371400640 1 -- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037c15b010 msgr2=0x7f037c150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0371400640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037c15b010 0x7f037c150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0371400640 1 -- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f037c06f0c0 msgr2=0x7f037c14ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0371400640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f037c06f0c0 0x7f037c14ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0371400640 1 -- 172.21.15.5:0/1725385454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037c15bba0 con 0x7f037c0cd3a0 2024-08-18T22:25:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0379e00640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f037c06f0c0 0x7f037c14ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:25:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0371400640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037c0cd3a0 0x7f037c150110 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f036400c7c0 tx=0x7f036400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0372a00640 1 -- 172.21.15.5:0/1725385454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364007a30 con 0x7f037c0cd3a0 2024-08-18T22:25:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0372a00640 1 -- 172.21.15.5:0/1725385454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0364007bd0 con 0x7f037c0cd3a0 2024-08-18T22:25:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0372a00640 1 -- 172.21.15.5:0/1725385454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03640113f0 con 0x7f037c0cd3a0 2024-08-18T22:25:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0380c00640 1 -- 172.21.15.5:0/1725385454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037c15be80 con 0x7f037c0cd3a0 2024-08-18T22:25:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.785+0000 7f0380c00640 1 -- 172.21.15.5:0/1725385454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037c15c440 con 0x7f037c0cd3a0 2024-08-18T22:25:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.789+0000 7f0380c00640 1 -- 172.21.15.5:0/1725385454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f037c0caf40 con 0x7f037c0cd3a0 2024-08-18T22:25:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.789+0000 7f0372a00640 1 -- 172.21.15.5:0/1725385454 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0364011590 con 0x7f037c0cd3a0 2024-08-18T22:25:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.789+0000 7f0372a00640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03580678c0 0x7f0358069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.789+0000 7f0372a00640 1 -- 172.21.15.5:0/1725385454 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f03640860c0 con 0x7f037c0cd3a0 2024-08-18T22:25:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.789+0000 7f0379e00640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03580678c0 0x7f0358069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.793+0000 7f0379e00640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03580678c0 0x7f0358069d80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f036c0b1000 tx=0x7f036c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:05.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.793+0000 7f0372a00640 1 -- 172.21.15.5:0/1725385454 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0364015020 con 0x7f037c0cd3a0 2024-08-18T22:25:05.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 -- 172.21.15.5:0/1725385454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f037c0b1060 con 0x7f037c0cd3a0 2024-08-18T22:25:05.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0372a00640 1 -- 172.21.15.5:0/1725385454 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5221 (secure 0 0 0) 0x7f0364056260 con 0x7f037c0cd3a0 2024-08-18T22:25:05.992 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:05.993 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"btime":"2024-08-18T22:25:02:956485+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1436391401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1436391401},{"type":"v1","addr":"172.21.15.117:6835","nonce":1436391401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/643889741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":643889741},{"type":"v1","addr":"172.21.15.117:6837","nonce":643889741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2830021009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2830021009},{"type":"v1","addr":"172.21.15.5:6833","nonce":2830021009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:25:02.956480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/580352313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":580352313},{"type":"v1","addr":"172.21.15.5:6835","nonce":580352313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7485,"qdb_cluster":[7485]},"id":6}]} 2024-08-18T22:25:05.993 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 81 2024-08-18T22:25:05.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 -- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03580678c0 msgr2=0x7f0358069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03580678c0 0x7f0358069d80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f036c0b1000 tx=0x7f036c008040 comp rx=0 tx=0).stop 2024-08-18T22:25:05.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 -- 172.21.15.5:0/1725385454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037c0cd3a0 msgr2=0x7f037c150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:05.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037c0cd3a0 0x7f037c150110 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f036400c7c0 tx=0x7f036400cc80 comp rx=0 tx=0).stop 2024-08-18T22:25:05.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 -- 172.21.15.5:0/1725385454 shutdown_connections 2024-08-18T22:25:05.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03580678c0 0x7f0358069d80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f037c15b010 0x7f037c150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037c0cd3a0 0x7f037c150110 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 --2- 172.21.15.5:0/1725385454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f037c06f0c0 0x7f037c14ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:05.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 -- 172.21.15.5:0/1725385454 >> 172.21.15.5:0/1725385454 conn(0x7f037c0b1c50 msgr2=0x7f037c150de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:05.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 -- 172.21.15.5:0/1725385454 shutdown_connections 2024-08-18T22:25:05.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:05.993+0000 7f0380c00640 1 -- 172.21.15.5:0/1725385454 wait complete. 2024-08-18T22:25:06.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-08-18T22:25:06.175 INFO:teuthology.orchestra.run.smithi005.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-08-18T22:24:52.649881+0000","btime":"2024-08-18T22:24:51.749891+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-08-18T22:24:52.649881+0000","atime":"2024-08-18T22:24:51.749891+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-08-18T22:24:52.649881+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:24:52.649881+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:24:52.649881+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-08-18T22:25:06.175 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-08-18T22:24:52.649881+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-08-18T22:24:51.749891+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-08-18T22:24:51.749891+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-08-18T22:24:52.649881+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-08-18T22:24:52.649881+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-08-18T22:24:52.649881+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-08-18T22:24:52.649881+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-08-18T22:25:06.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:25:06.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /testdir recursive 2024-08-18T22:25:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f806b000640 1 Processor -- start 2024-08-18T22:25:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f806b000640 1 -- start start 2024-08-18T22:25:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f806b000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f806415e470 0x7f806406c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f806b000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80640b2800 0x7f80640b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f806b000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640b6160 0x7f8064161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f806b000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f806406c900 con 0x7f80640b2800 2024-08-18T22:25:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f806b000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f806409ac70 con 0x7f806415e470 2024-08-18T22:25:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f806b000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f80640b4210 con 0x7f80640b6160 2024-08-18T22:25:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f805be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80640b2800 0x7f80640b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f805be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80640b2800 0x7f80640b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40360/0 (socket says 172.21.15.5:40360) 2024-08-18T22:25:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f805be00640 1 -- 172.21.15.5:0/449170814 learned_addr learned my addr 172.21.15.5:0/449170814 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f8063e00640 1 --2- 172.21.15.5:0/449170814 >> v2:172.21.15.117:3300/0 conn(0x7f806415e470 0x7f806406c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f8069000640 1 --2- 172.21.15.5:0/449170814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640b6160 0x7f8064161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f805be00640 1 -- 172.21.15.5:0/449170814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640b6160 msgr2=0x7f8064161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:06.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f805be00640 1 --2- 172.21.15.5:0/449170814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640b6160 0x7f8064161fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f805be00640 1 -- 172.21.15.5:0/449170814 >> v2:172.21.15.117:3300/0 conn(0x7f806415e470 msgr2=0x7f806406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:06.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f805be00640 1 --2- 172.21.15.5:0/449170814 >> v2:172.21.15.117:3300/0 conn(0x7f806415e470 0x7f806406c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.321+0000 7f805be00640 1 -- 172.21.15.5:0/449170814 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80640b44f0 con 0x7f80640b2800 2024-08-18T22:25:06.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f805be00640 1 --2- 172.21.15.5:0/449170814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80640b2800 0x7f80640b5c20 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f806409b090 tx=0x7f804c01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3b089c887bf5be server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:06.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f8063400640 1 -- 172.21.15.5:0/449170814 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c0b0070 con 0x7f80640b2800 2024-08-18T22:25:06.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f8063400640 1 -- 172.21.15.5:0/449170814 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c0ab600 con 0x7f80640b2800 2024-08-18T22:25:06.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f8063400640 1 -- 172.21.15.5:0/449170814 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c0ab9d0 con 0x7f80640b2800 2024-08-18T22:25:06.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f806b000640 1 -- 172.21.15.5:0/449170814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80640b2800 msgr2=0x7f80640b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f806b000640 1 --2- 172.21.15.5:0/449170814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80640b2800 0x7f80640b5c20 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f806409b090 tx=0x7f804c01c230 comp rx=0 tx=0).stop 2024-08-18T22:25:06.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f806b000640 1 -- 172.21.15.5:0/449170814 shutdown_connections 2024-08-18T22:25:06.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f806b000640 1 --2- 172.21.15.5:0/449170814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640b6160 0x7f8064161fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f806b000640 1 --2- 172.21.15.5:0/449170814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80640b2800 0x7f80640b5c20 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f806b000640 1 --2- 172.21.15.5:0/449170814 >> v2:172.21.15.117:3300/0 conn(0x7f806415e470 0x7f806406c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f806b000640 1 -- 172.21.15.5:0/449170814 >> 172.21.15.5:0/449170814 conn(0x7f80640732a0 msgr2=0x7f80640b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:06.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f806b000640 1 -- 172.21.15.5:0/449170814 shutdown_connections 2024-08-18T22:25:06.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.325+0000 7f806b000640 1 -- 172.21.15.5:0/449170814 wait complete. 2024-08-18T22:25:06.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f806b000640 1 Processor -- start 2024-08-18T22:25:06.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f806b000640 1 -- start start 2024-08-18T22:25:06.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f806b000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640b2800 0x7f8064160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f806b000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640b6160 0x7f806414c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f806b000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806415e470 0x7f80641facc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f806b000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f806415e9d0 con 0x7f806415e470 2024-08-18T22:25:06.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f806b000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f806415e850 con 0x7f80640b6160 2024-08-18T22:25:06.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f806b000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f806415f480 con 0x7f80640b2800 2024-08-18T22:25:06.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8069000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806415e470 0x7f80641facc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8069000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806415e470 0x7f80641facc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40378/0 (socket says 172.21.15.5:40378) 2024-08-18T22:25:06.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8063e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640b2800 0x7f8064160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8069000640 1 -- 172.21.15.5:0/2409186094 learned_addr learned my addr 172.21.15.5:0/2409186094 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:06.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f805be00640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640b6160 0x7f806414c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8069000640 1 -- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640b2800 msgr2=0x7f8064160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8069000640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640b2800 0x7f8064160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8069000640 1 -- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640b6160 msgr2=0x7f806414c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8069000640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640b6160 0x7f806414c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8069000640 1 -- 172.21.15.5:0/2409186094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806414ce90 con 0x7f806415e470 2024-08-18T22:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8069000640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806415e470 0x7f80641facc0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f805c007d10 tx=0x7f805c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8060c00640 1 -- 172.21.15.5:0/2409186094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c014420 con 0x7f806415e470 2024-08-18T22:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8060c00640 1 -- 172.21.15.5:0/2409186094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f805c019070 con 0x7f806415e470 2024-08-18T22:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f8060c00640 1 -- 172.21.15.5:0/2409186094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c014820 con 0x7f806415e470 2024-08-18T22:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f806b000640 1 -- 172.21.15.5:0/2409186094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8064153ae0 con 0x7f806415e470 2024-08-18T22:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.329+0000 7f806b000640 1 -- 172.21.15.5:0/2409186094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80641540a0 con 0x7f806415e470 2024-08-18T22:25:06.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.333+0000 7f8060c00640 1 -- 172.21.15.5:0/2409186094 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f805c0149c0 con 0x7f806415e470 2024-08-18T22:25:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.333+0000 7f8060c00640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80400678c0 0x7f8040069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.333+0000 7f8060c00640 1 -- 172.21.15.5:0/2409186094 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f805c086700 con 0x7f806415e470 2024-08-18T22:25:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.333+0000 7f806e3e8000 1 Processor -- start 2024-08-18T22:25:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.333+0000 7f8063e00640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80400678c0 0x7f8040069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.333+0000 7f806e3e8000 1 -- start start 2024-08-18T22:25:06.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8063e00640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80400678c0 0x7f8040069d80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f80540079c0 tx=0x7f8054008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:06.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a897d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a89d10 0x5599c9a3fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a402c0 0x5599c9a406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5599c9947c80 con 0x5599c9a893f0 2024-08-18T22:25:06.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5599c9926c30 con 0x5599c9a89d10 2024-08-18T22:25:06.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5599c988d2b0 con 0x5599c9a402c0 2024-08-18T22:25:06.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8063e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8063e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a897d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40388/0 (socket says 172.21.15.5:40388) 2024-08-18T22:25:06.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8063e00640 1 -- 172.21.15.5:0/514265840 learned_addr learned my addr 172.21.15.5:0/514265840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:06.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f805be00640 1 --2- 172.21.15.5:0/514265840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a89d10 0x5599c9a3fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8069000640 1 --2- 172.21.15.5:0/514265840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a402c0 0x5599c9a406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8063e00640 1 -- 172.21.15.5:0/514265840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a402c0 msgr2=0x5599c9a406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:06.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8063e00640 1 --2- 172.21.15.5:0/514265840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a402c0 0x5599c9a406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8063e00640 1 -- 172.21.15.5:0/514265840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a89d10 msgr2=0x5599c9a3fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:06.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8063e00640 1 --2- 172.21.15.5:0/514265840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a89d10 0x5599c9a3fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8063e00640 1 -- 172.21.15.5:0/514265840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c9936070 con 0x5599c9a893f0 2024-08-18T22:25:06.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8063e00640 1 --2- 172.21.15.5:0/514265840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a897d0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f8054010ac0 tx=0x7f8054013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcff7301d9db4fe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8058c00640 1 -- 172.21.15.5:0/514265840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805401c050 con 0x5599c9a893f0 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8058c00640 1 -- 172.21.15.5:0/514265840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8054026070 con 0x5599c9a893f0 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f8058c00640 1 -- 172.21.15.5:0/514265840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8054016e10 con 0x5599c9a893f0 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 -- 172.21.15.5:0/514265840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 msgr2=0x5599c9a897d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 --2- 172.21.15.5:0/514265840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a897d0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f8054010ac0 tx=0x7f8054013000 comp rx=0 tx=0).stop 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 -- 172.21.15.5:0/514265840 shutdown_connections 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 --2- 172.21.15.5:0/514265840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a402c0 0x5599c9a406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 --2- 172.21.15.5:0/514265840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a89d10 0x5599c9a3fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 --2- 172.21.15.5:0/514265840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a897d0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 -- 172.21.15.5:0/514265840 >> 172.21.15.5:0/514265840 conn(0x5599c9a3c270 msgr2=0x5599c9a3e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 -- 172.21.15.5:0/514265840 shutdown_connections 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 -- 172.21.15.5:0/514265840 wait complete. 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 -- start start 2024-08-18T22:25:06.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.337+0000 7f806e3e8000 1 Processor -- start 2024-08-18T22:25:06.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a402c0 0x5599c9a88b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a4b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a89d10 0x5599c9a4b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5599c9889270 con 0x5599c9a893f0 2024-08-18T22:25:06.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5599c98479b0 con 0x5599c9a89d10 2024-08-18T22:25:06.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5599c982ed10 con 0x5599c9a402c0 2024-08-18T22:25:06.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 10 client.0 _ll_register_callbacks cb 0x5599c986ad80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:25:06.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f805be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a4b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f805be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a4b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40394/0 (socket says 172.21.15.5:40394) 2024-08-18T22:25:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f805be00640 1 -- 172.21.15.5:0/2038118314 learned_addr learned my addr 172.21.15.5:0/2038118314 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f8063e00640 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a402c0 0x5599c9a88b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f8069000640 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a89d10 0x5599c9a4b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f805be00640 1 -- 172.21.15.5:0/2038118314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a402c0 msgr2=0x5599c9a88b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f805be00640 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a402c0 0x5599c9a88b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f805be00640 1 -- 172.21.15.5:0/2038118314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a89d10 msgr2=0x5599c9a4b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f805be00640 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a89d10 0x5599c9a4b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f805be00640 1 -- 172.21.15.5:0/2038118314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c986a3b0 con 0x5599c9a893f0 2024-08-18T22:25:06.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f805be00640 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a4b400 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f804c000c10 tx=0x7f804c01aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eab08c2e2edb912 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f8051600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f8051600640 1 -- 172.21.15.5:0/2038118314 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c0bc020 con 0x5599c9a893f0 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f8051600640 1 -- 172.21.15.5:0/2038118314 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f804c0abca0 con 0x5599c9a893f0 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 1 -- 172.21.15.5:0/2038118314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8054026070 con 0x5599c9a893f0 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f8051600640 1 -- 172.21.15.5:0/2038118314 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f804c0c6050 con 0x5599c9a893f0 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 10 client.7578 fetch_fsmap learned FSMap version 81 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 1 -- 172.21.15.5:0/2038118314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x5599c98d3860 con 0x5599c9a893f0 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f8051600640 1 -- 172.21.15.5:0/2038118314 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8054026070 con 0x5599c9a893f0 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f8051600640 1 -- 172.21.15.5:0/2038118314 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 81) ==== 3502+0+0 (secure 0 0 0) 0x7f804c0c9020 con 0x5599c9a893f0 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 10 client.7578 fetch_fsmap finished waiting for FSMap version 81 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 10 client.7578 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 20 client.7578 populate_metadata read hostname 'smithi005' 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x5599c9a4c350 0x5599c9a4c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 4 client.7578 mds_command: new command op to 7485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:25:06.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f806e3e8000 1 -- 172.21.15.5:0/2038118314 --> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599c9827e30 con 0x5599c9a4c350 2024-08-18T22:25:06.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f8063e00640 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x5599c9a4c350 0x5599c9a4c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f8051600640 10 client.7578 ms_handle_connect on v2:172.21.15.5:6834/580352313 2024-08-18T22:25:06.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.341+0000 7f8063e00640 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x5599c9a4c350 0x5599c9a4c730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1131759a477a6173 server_cookie=a67582263f93c8eb in_seq=0 out_seq=0 2024-08-18T22:25:06.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f8051600640 1 -- 172.21.15.5:0/2038118314 <== mds.0 v2:172.21.15.5:6834/580352313 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599c9827e30 con 0x5599c9a4c350 2024-08-18T22:25:06.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f8051600640 10 client.7578 handle_command_reply: tid=0 2024-08-18T22:25:06.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 1 client.7578 shutdown 2024-08-18T22:25:06.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 1 -- 172.21.15.5:0/2038118314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 msgr2=0x5599c9a4b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a4b400 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f804c000c10 tx=0x7f804c01aa70 comp rx=0 tx=0).stop 2024-08-18T22:25:06.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 1 -- 172.21.15.5:0/2038118314 shutdown_connections 2024-08-18T22:25:06.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x5599c9a4c350 0x5599c9a4c730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a89d10 0x5599c9a4b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a4b400 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 1 --2- 172.21.15.5:0/2038118314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a402c0 0x5599c9a88b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f8051600640 0 client.7578 ms_handle_reset on v2:172.21.15.5:6834/580352313 2024-08-18T22:25:06.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 1 -- 172.21.15.5:0/2038118314 >> 172.21.15.5:0/2038118314 conn(0x5599c9a3c270 msgr2=0x5599c9a3ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:06.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 1 -- 172.21.15.5:0/2038118314 shutdown_connections 2024-08-18T22:25:06.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 1 -- 172.21.15.5:0/2038118314 wait complete. 2024-08-18T22:25:06.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.345+0000 7f806e3e8000 20 client.7578 trim_cache size 0 max 16384 2024-08-18T22:25:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.361+0000 7f806e3e8000 1 Processor -- start 2024-08-18T22:25:06.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.361+0000 7f806e3e8000 1 -- start start 2024-08-18T22:25:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.361+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a402c0 0x5599c9a3f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.361+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a3fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.361+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a89d10 0x5599c9a9b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.361+0000 7f806e3e8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f80642041b0 con 0x5599c9a893f0 2024-08-18T22:25:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.361+0000 7f806e3e8000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8064203190 con 0x5599c9a402c0 2024-08-18T22:25:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.361+0000 7f806e3e8000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8064159150 con 0x5599c9a89d10 2024-08-18T22:25:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.361+0000 7f805be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a3fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.361+0000 7f805be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a3fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40404/0 (socket says 172.21.15.5:40404) 2024-08-18T22:25:06.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f805be00640 1 -- 172.21.15.5:0/3839563259 learned_addr learned my addr 172.21.15.5:0/3839563259 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:06.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f8069000640 1 --2- 172.21.15.5:0/3839563259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a89d10 0x5599c9a9b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f8063e00640 1 --2- 172.21.15.5:0/3839563259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a402c0 0x5599c9a3f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f805be00640 1 -- 172.21.15.5:0/3839563259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a89d10 msgr2=0x5599c9a9b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:06.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f805be00640 1 --2- 172.21.15.5:0/3839563259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a89d10 0x5599c9a9b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f805be00640 1 -- 172.21.15.5:0/3839563259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a402c0 msgr2=0x5599c9a3f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:06.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f805be00640 1 --2- 172.21.15.5:0/3839563259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a402c0 0x5599c9a3f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f805be00640 1 -- 172.21.15.5:0/3839563259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c982dab0 con 0x5599c9a893f0 2024-08-18T22:25:06.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f8063e00640 1 --2- 172.21.15.5:0/3839563259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a402c0 0x5599c9a3f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:06.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f805be00640 1 --2- 172.21.15.5:0/3839563259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a3fbb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f804c0c4040 tx=0x7f804c0b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306f17a559373b52 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:06.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f8053e00640 1 -- 172.21.15.5:0/3839563259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c0bc020 con 0x5599c9a893f0 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f8053e00640 1 -- 172.21.15.5:0/3839563259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c000e50 con 0x5599c9a893f0 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f8053e00640 1 -- 172.21.15.5:0/3839563259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c0b0040 con 0x5599c9a893f0 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 -- 172.21.15.5:0/3839563259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 msgr2=0x5599c9a3fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 --2- 172.21.15.5:0/3839563259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a3fbb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f804c0c4040 tx=0x7f804c0b8000 comp rx=0 tx=0).stop 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 -- 172.21.15.5:0/3839563259 shutdown_connections 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 --2- 172.21.15.5:0/3839563259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a89d10 0x5599c9a9b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 --2- 172.21.15.5:0/3839563259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a893f0 0x5599c9a3fbb0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 --2- 172.21.15.5:0/3839563259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a402c0 0x5599c9a3f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 -- 172.21.15.5:0/3839563259 >> 172.21.15.5:0/3839563259 conn(0x5599c9a3c270 msgr2=0x5599c9a4b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 -- 172.21.15.5:0/3839563259 shutdown_connections 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 -- 172.21.15.5:0/3839563259 wait complete. 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 -- start start 2024-08-18T22:25:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 Processor -- start 2024-08-18T22:25:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a402c0 0x5599c9a9e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a893f0 0x5599c9a9ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a89d10 0x5599c9a9f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5599c990fab0 con 0x5599c9a402c0 2024-08-18T22:25:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5599c98918e0 con 0x5599c9a893f0 2024-08-18T22:25:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5599c9855180 con 0x5599c9a89d10 2024-08-18T22:25:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f806e3e8000 10 client.0 _ll_register_callbacks cb 0x7f804c006ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:25:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f8063e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a402c0 0x5599c9a9e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f8063e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a402c0 0x5599c9a9e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40420/0 (socket says 172.21.15.5:40420) 2024-08-18T22:25:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f8063e00640 1 -- 172.21.15.5:0/773232059 learned_addr learned my addr 172.21.15.5:0/773232059 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f8069000640 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a89d10 0x5599c9a9f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.365+0000 7f805be00640 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a893f0 0x5599c9a9ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8063e00640 1 -- 172.21.15.5:0/773232059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a89d10 msgr2=0x5599c9a9f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8063e00640 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a89d10 0x5599c9a9f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8063e00640 1 -- 172.21.15.5:0/773232059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a893f0 msgr2=0x5599c9a9ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8063e00640 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a893f0 0x5599c9a9ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8063e00640 1 -- 172.21.15.5:0/773232059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c990ff40 con 0x5599c9a402c0 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8069000640 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a89d10 0x5599c9a9f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8063e00640 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a402c0 0x5599c9a9e790 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8054010a90 tx=0x7f8054004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462f9c8426dc18bf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8051600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8051600640 1 -- 172.21.15.5:0/773232059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805403c060 con 0x5599c9a402c0 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 -- 172.21.15.5:0/773232059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f804c000e50 con 0x5599c9a402c0 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8051600640 1 -- 172.21.15.5:0/773232059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f8054036450 con 0x5599c9a402c0 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8051600640 1 -- 172.21.15.5:0/773232059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f8054042050 con 0x5599c9a402c0 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 10 client.7584 fetch_fsmap learned FSMap version 81 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 -- 172.21.15.5:0/773232059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x5599c98e6a20 con 0x5599c9a402c0 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8051600640 1 -- 172.21.15.5:0/773232059 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c000e50 con 0x5599c9a402c0 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8051600640 1 -- 172.21.15.5:0/773232059 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 81) ==== 3502+0+0 (secure 0 0 0) 0x7f8054045020 con 0x5599c9a402c0 2024-08-18T22:25:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 10 client.7584 fetch_fsmap finished waiting for FSMap version 81 2024-08-18T22:25:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 10 client.7584 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-08-18T22:25:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 20 client.7584 populate_metadata read hostname 'smithi005' 2024-08-18T22:25:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x5599c9a9f750 0x5599c9a9fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 4 client.7584 mds_command: new command op to 7485 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-08-18T22:25:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 -- 172.21.15.5:0/773232059 --> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x5599c989a9e0 con 0x5599c9a9f750 2024-08-18T22:25:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f805be00640 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x5599c9a9f750 0x5599c9a9fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8051600640 10 client.7584 ms_handle_connect on v2:172.21.15.5:6834/580352313 2024-08-18T22:25:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f805be00640 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x5599c9a9f750 0x5599c9a9fb60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ade02019f339550f server_cookie=56dc8bfff765d7b2 in_seq=0 out_seq=0 2024-08-18T22:25:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8051600640 1 -- 172.21.15.5:0/773232059 <== mds.0 v2:172.21.15.5:6834/580352313 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5599c989a9e0 con 0x5599c9a9f750 2024-08-18T22:25:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8051600640 10 client.7584 handle_command_reply: tid=0 2024-08-18T22:25:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 client.7584 shutdown 2024-08-18T22:25:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 -- 172.21.15.5:0/773232059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a402c0 msgr2=0x5599c9a9e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a402c0 0x5599c9a9e790 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8054010a90 tx=0x7f8054004740 comp rx=0 tx=0).stop 2024-08-18T22:25:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 -- 172.21.15.5:0/773232059 shutdown_connections 2024-08-18T22:25:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.5:6834/580352313,v1:172.21.15.5:6835/580352313] conn(0x5599c9a9f750 0x5599c9a9fb60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599c9a89d10 0x5599c9a9f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599c9a893f0 0x5599c9a9ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 --2- 172.21.15.5:0/773232059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599c9a402c0 0x5599c9a9e790 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 -- 172.21.15.5:0/773232059 >> 172.21.15.5:0/773232059 conn(0x5599c9a3c270 msgr2=0x5599c9a3e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f8051600640 0 client.7584 ms_handle_reset on v2:172.21.15.5:6834/580352313 2024-08-18T22:25:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 -- 172.21.15.5:0/773232059 shutdown_connections 2024-08-18T22:25:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 1 -- 172.21.15.5:0/773232059 wait complete. 2024-08-18T22:25:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806e3e8000 20 client.7584 trim_cache size 0 max 16384 2024-08-18T22:25:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:25:06.379 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:25:06.379 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "6ff9a19e-c054-49e0-9293-6cf45919a187", 2024-08-18T22:25:06.379 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:25:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806b000640 1 -- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80400678c0 msgr2=0x7f8040069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806b000640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80400678c0 0x7f8040069d80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f80540079c0 tx=0x7f8054008040 comp rx=0 tx=0).stop 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806b000640 1 -- 172.21.15.5:0/2409186094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806415e470 msgr2=0x7f80641facc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.369+0000 7f806b000640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806415e470 0x7f80641facc0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f805c007d10 tx=0x7f805c00e4b0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.373+0000 7f806b000640 1 -- 172.21.15.5:0/2409186094 shutdown_connections 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.373+0000 7f806b000640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80400678c0 0x7f8040069d80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.373+0000 7f806b000640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f806415e470 0x7f80641facc0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.373+0000 7f806b000640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640b6160 0x7f806414c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.373+0000 7f806b000640 1 --2- 172.21.15.5:0/2409186094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640b2800 0x7f8064160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.373+0000 7f806b000640 1 -- 172.21.15.5:0/2409186094 >> 172.21.15.5:0/2409186094 conn(0x7f80640732a0 msgr2=0x7f80640d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.373+0000 7f806b000640 1 -- 172.21.15.5:0/2409186094 shutdown_connections 2024-08-18T22:25:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.373+0000 7f806b000640 1 -- 172.21.15.5:0/2409186094 wait complete. 2024-08-18T22:25:06.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:06.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe562200640 1 Processor -- start 2024-08-18T22:25:06.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe562200640 1 -- start start 2024-08-18T22:25:06.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe562200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe55c0cb390 0x7fe55c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe562200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55c073c80 con 0x7fe55c15bed0 2024-08-18T22:25:06.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe562200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55c0ca5d0 con 0x7fe55c06da70 2024-08-18T22:25:06.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe562200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe55c0ca8b0 con 0x7fe55c0cb390 2024-08-18T22:25:06.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe55b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe55c15bed0 0x7fe55c071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49830/0 (socket says 172.21.15.5:49830) 2024-08-18T22:25:06.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe55b400640 1 -- 172.21.15.5:0/3400446784 learned_addr learned my addr 172.21.15.5:0/3400446784 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:06.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe55aa00640 1 --2- 172.21.15.5:0/3400446784 >> v2:172.21.15.117:3300/0 conn(0x7fe55c0cb390 0x7fe55c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe55a000640 1 -- 172.21.15.5:0/3400446784 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3573147569 0 0) 0x7fe55c073c80 con 0x7fe55c15bed0 2024-08-18T22:25:06.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe55a000640 1 -- 172.21.15.5:0/3400446784 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe540003530 con 0x7fe55c15bed0 2024-08-18T22:25:06.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe55a000640 1 -- 172.21.15.5:0/3400446784 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3523253622 0 0) 0x7fe540003530 con 0x7fe55c15bed0 2024-08-18T22:25:06.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe55aa00640 1 -- 172.21.15.5:0/3400446784 >> v1:172.21.15.117:6789/0 conn(0x7fe55c06da70 legacy=0x7fe55c165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe55aa00640 1 -- 172.21.15.5:0/3400446784 >> v1:172.21.15.5:6789/0 conn(0x7fe55c15bed0 legacy=0x7fe55c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.533+0000 7fe55aa00640 1 -- 172.21.15.5:0/3400446784 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c0cab90 con 0x7fe55c0cb390 2024-08-18T22:25:06.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.537+0000 7fe55aa00640 1 --2- 172.21.15.5:0/3400446784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe55c0cb390 0x7fe55c0735a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe5480097c0 tx=0x7fe54801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a529d61226b21cf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:06.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.537+0000 7fe55a000640 1 -- 172.21.15.5:0/3400446784 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5480b0070 con 0x7fe55c0cb390 2024-08-18T22:25:06.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.537+0000 7fe55a000640 1 -- 172.21.15.5:0/3400446784 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5480ab400 con 0x7fe55c0cb390 2024-08-18T22:25:06.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.537+0000 7fe55a000640 1 -- 172.21.15.5:0/3400446784 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c001680 con 0x7fe55c0cb390 2024-08-18T22:25:06.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.537+0000 7fe562200640 1 -- 172.21.15.5:0/3400446784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe55c0cb390 msgr2=0x7fe55c0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.537+0000 7fe562200640 1 --2- 172.21.15.5:0/3400446784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe55c0cb390 0x7fe55c0735a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe5480097c0 tx=0x7fe54801c390 comp rx=0 tx=0).stop 2024-08-18T22:25:06.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.537+0000 7fe562200640 1 -- 172.21.15.5:0/3400446784 shutdown_connections 2024-08-18T22:25:06.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.537+0000 7fe562200640 1 --2- 172.21.15.5:0/3400446784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe55c0cb390 0x7fe55c0735a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.537+0000 7fe562200640 1 -- 172.21.15.5:0/3400446784 >> 172.21.15.5:0/3400446784 conn(0x7fe55c0b1c50 msgr2=0x7fe55c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:06.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.537+0000 7fe562200640 1 -- 172.21.15.5:0/3400446784 shutdown_connections 2024-08-18T22:25:06.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.537+0000 7fe562200640 1 -- 172.21.15.5:0/3400446784 wait complete. 2024-08-18T22:25:06.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe562200640 1 Processor -- start 2024-08-18T22:25:06.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe562200640 1 -- start start 2024-08-18T22:25:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe562200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe55c06da70 0x7fe55c158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe562200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe55c0cb390 0x7fe55c1f7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe562200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c15bed0 0x7fe55c0b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe562200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c169c40 con 0x7fe55c15bed0 2024-08-18T22:25:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe562200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c169ac0 con 0x7fe55c0cb390 2024-08-18T22:25:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe562200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe55c169dc0 con 0x7fe55c06da70 2024-08-18T22:25:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c15bed0 0x7fe55c0b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c15bed0 0x7fe55c0b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40424/0 (socket says 172.21.15.5:40424) 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55be00640 1 -- 172.21.15.5:0/1116103125 learned_addr learned my addr 172.21.15.5:0/1116103125 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55aa00640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe55c0cb390 0x7fe55c1f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55b400640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe55c06da70 0x7fe55c158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55be00640 1 -- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe55c06da70 msgr2=0x7fe55c158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55be00640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe55c06da70 0x7fe55c158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55be00640 1 -- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe55c0cb390 msgr2=0x7fe55c1f7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55be00640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe55c0cb390 0x7fe55c1f7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55be00640 1 -- 172.21.15.5:0/1116103125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c0b31a0 con 0x7fe55c15bed0 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55b400640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe55c06da70 0x7fe55c158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe55be00640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c15bed0 0x7fe55c0b3f60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c7a0 tx=0x7fe55400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe553400640 1 -- 172.21.15.5:0/1116103125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554003b80 con 0x7fe55c15bed0 2024-08-18T22:25:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe553400640 1 -- 172.21.15.5:0/1116103125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe554003d20 con 0x7fe55c15bed0 2024-08-18T22:25:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe562200640 1 -- 172.21.15.5:0/1116103125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55c0b3480 con 0x7fe55c15bed0 2024-08-18T22:25:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe553400640 1 -- 172.21.15.5:0/1116103125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55400aa90 con 0x7fe55c15bed0 2024-08-18T22:25:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.541+0000 7fe562200640 1 -- 172.21.15.5:0/1116103125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55c0b3a40 con 0x7fe55c15bed0 2024-08-18T22:25:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.545+0000 7fe562200640 1 -- 172.21.15.5:0/1116103125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55c0735a0 con 0x7fe55c15bed0 2024-08-18T22:25:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.545+0000 7fe553400640 1 -- 172.21.15.5:0/1116103125 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe55400ac30 con 0x7fe55c15bed0 2024-08-18T22:25:06.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.545+0000 7fe553400640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe53c0678c0 0x7fe53c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:06.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.545+0000 7fe553400640 1 -- 172.21.15.5:0/1116103125 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7fe554085dd0 con 0x7fe55c15bed0 2024-08-18T22:25:06.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.545+0000 7fe55b400640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe53c0678c0 0x7fe53c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:06.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.545+0000 7fe55b400640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe53c0678c0 0x7fe53c069d80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0017f0 tx=0x7fe54c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:06.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.549+0000 7fe553400640 1 -- 172.21.15.5:0/1116103125 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe5540566f0 con 0x7fe55c15bed0 2024-08-18T22:25:06.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.753+0000 7fe562200640 1 -- 172.21.15.5:0/1116103125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe55c0b0540 con 0x7fe55c15bed0 2024-08-18T22:25:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe553400640 1 -- 172.21.15.5:0/1116103125 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5221 (secure 0 0 0) 0x7fe554087070 con 0x7fe55c15bed0 2024-08-18T22:25:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:06.756 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"btime":"2024-08-18T22:25:02:956485+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1436391401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1436391401},{"type":"v1","addr":"172.21.15.117:6835","nonce":1436391401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/643889741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":643889741},{"type":"v1","addr":"172.21.15.117:6837","nonce":643889741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2830021009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2830021009},{"type":"v1","addr":"172.21.15.5:6833","nonce":2830021009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:25:02.956480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/580352313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":580352313},{"type":"v1","addr":"172.21.15.5:6835","nonce":580352313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7485,"qdb_cluster":[7485]},"id":6}]} 2024-08-18T22:25:06.756 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 81 2024-08-18T22:25:06.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 -- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe53c0678c0 msgr2=0x7fe53c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe53c0678c0 0x7fe53c069d80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0017f0 tx=0x7fe54c009040 comp rx=0 tx=0).stop 2024-08-18T22:25:06.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 -- 172.21.15.5:0/1116103125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c15bed0 msgr2=0x7fe55c0b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:06.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c15bed0 0x7fe55c0b3f60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c7a0 tx=0x7fe55400cc60 comp rx=0 tx=0).stop 2024-08-18T22:25:06.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 -- 172.21.15.5:0/1116103125 shutdown_connections 2024-08-18T22:25:06.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe53c0678c0 0x7fe53c069d80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c15bed0 0x7fe55c0b3f60 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe55c0cb390 0x7fe55c1f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 --2- 172.21.15.5:0/1116103125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe55c06da70 0x7fe55c158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:06.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 -- 172.21.15.5:0/1116103125 >> 172.21.15.5:0/1116103125 conn(0x7fe55c0b1c50 msgr2=0x7fe55c0b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:06.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 -- 172.21.15.5:0/1116103125 shutdown_connections 2024-08-18T22:25:06.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:06.757+0000 7fe562200640 1 -- 172.21.15.5:0/1116103125 wait complete. 2024-08-18T22:25:06.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-08-18T22:25:06.942 INFO:teuthology.orchestra.run.smithi005.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-08-18T22:24:52.649881+0000","btime":"2024-08-18T22:24:51.749891+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-08-18T22:24:52.649881+0000","atime":"2024-08-18T22:24:51.749891+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-08-18T22:24:52.649881+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:24:52.649881+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:24:52.649881+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":1,"authpin":0,"scrubqueue":0},"nref":1,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-08-18T22:25:06.943 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-08-18T22:24:52.649881+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-08-18T22:24:51.749891+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-08-18T22:24:51.749891+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-08-18T22:24:52.649881+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-08-18T22:24:52.649881+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-08-18T22:24:52.649881+0000", "nestlock": {}, "nlink": 1, "nref": 1, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-08-18T22:24:52.649881+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-08-18T22:25:06.943 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-08-18T22:25:11.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47cfc00640 1 Processor -- start 2024-08-18T22:25:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47cfc00640 1 -- start start 2024-08-18T22:25:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47cfc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47c8071580 0x7f47c806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47cfc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47c80cbed0 0x7f47c80cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47cfc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c8071c80 con 0x7f47c80b54c0 2024-08-18T22:25:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47cfc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f47c80cba40 con 0x7f47c8071580 2024-08-18T22:25:12.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47cfc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f47c8071f60 con 0x7f47c80cbed0 2024-08-18T22:25:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47c7e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47c8071580 0x7f47c806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47c7e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47c8071580 0x7f47c806dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:51372/0 (socket says 172.21.15.5:51372) 2024-08-18T22:25:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47c7e00640 1 -- 172.21.15.5:0/2246035632 learned_addr learned my addr 172.21.15.5:0/2246035632 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47cdc00640 1 --2- 172.21.15.5:0/2246035632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47c80cbed0 0x7f47c80cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47c7e00640 1 -- 172.21.15.5:0/2246035632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47c80cbed0 msgr2=0x7f47c80cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47c7e00640 1 --2- 172.21.15.5:0/2246035632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47c80cbed0 0x7f47c80cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47c7e00640 1 -- 172.21.15.5:0/2246035632 >> v1:172.21.15.117:6789/0 conn(0x7f47c80b54c0 legacy=0x7f47c80b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.101+0000 7f47c7e00640 1 -- 172.21.15.5:0/2246035632 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c80cb6d0 con 0x7f47c8071580 2024-08-18T22:25:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47c7e00640 1 --2- 172.21.15.5:0/2246035632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47c8071580 0x7f47c806dd80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009870 tx=0x7f47b401ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c47258e8cc9006b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47c7400640 1 -- 172.21.15.5:0/2246035632 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b40b5070 con 0x7f47c8071580 2024-08-18T22:25:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47c7400640 1 -- 172.21.15.5:0/2246035632 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b40a8a50 con 0x7f47c8071580 2024-08-18T22:25:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47c7400640 1 -- 172.21.15.5:0/2246035632 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b40a8e20 con 0x7f47c8071580 2024-08-18T22:25:12.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47cfc00640 1 -- 172.21.15.5:0/2246035632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47c8071580 msgr2=0x7f47c806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47cfc00640 1 --2- 172.21.15.5:0/2246035632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47c8071580 0x7f47c806dd80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009870 tx=0x7f47b401ed50 comp rx=0 tx=0).stop 2024-08-18T22:25:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47cfc00640 1 -- 172.21.15.5:0/2246035632 shutdown_connections 2024-08-18T22:25:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47cfc00640 1 --2- 172.21.15.5:0/2246035632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47c80cbed0 0x7f47c80cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47cfc00640 1 --2- 172.21.15.5:0/2246035632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47c8071580 0x7f47c806dd80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47cfc00640 1 -- 172.21.15.5:0/2246035632 >> 172.21.15.5:0/2246035632 conn(0x7f47c80b3eb0 msgr2=0x7f47c80b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47cfc00640 1 -- 172.21.15.5:0/2246035632 shutdown_connections 2024-08-18T22:25:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.105+0000 7f47cfc00640 1 -- 172.21.15.5:0/2246035632 wait complete. 2024-08-18T22:25:12.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cfc00640 1 Processor -- start 2024-08-18T22:25:12.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cfc00640 1 -- start start 2024-08-18T22:25:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cfc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47c8071580 0x7f47c8142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cfc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c80b54c0 0x7f47c81f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cfc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47c80cbed0 0x7f47c8153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cfc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f47c81481a0 con 0x7f47c80b54c0 2024-08-18T22:25:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cfc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47c8148020 con 0x7f47c80cbed0 2024-08-18T22:25:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cfc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f47c80cc8a0 con 0x7f47c8071580 2024-08-18T22:25:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c80b54c0 0x7f47c81f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c80b54c0 0x7f47c81f79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40440/0 (socket says 172.21.15.5:40440) 2024-08-18T22:25:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c7e00640 1 -- 172.21.15.5:0/2388150242 learned_addr learned my addr 172.21.15.5:0/2388150242 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cdc00640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47c80cbed0 0x7f47c8153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cd200640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47c8071580 0x7f47c8142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c7e00640 1 -- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47c8071580 msgr2=0x7f47c8142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c7e00640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47c8071580 0x7f47c8142a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c7e00640 1 -- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47c80cbed0 msgr2=0x7f47c8153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c7e00640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47c80cbed0 0x7f47c8153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c7e00640 1 -- 172.21.15.5:0/2388150242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c81f84b0 con 0x7f47c80b54c0 2024-08-18T22:25:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c7e00640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c80b54c0 0x7f47c81f79f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f47b40097c0 tx=0x7f47b401baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c4c00640 1 -- 172.21.15.5:0/2388150242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b40c0070 con 0x7f47c80b54c0 2024-08-18T22:25:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c4c00640 1 -- 172.21.15.5:0/2388150242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b40ae550 con 0x7f47c80b54c0 2024-08-18T22:25:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47c4c00640 1 -- 172.21.15.5:0/2388150242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b40b5070 con 0x7f47c80b54c0 2024-08-18T22:25:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cfc00640 1 -- 172.21.15.5:0/2388150242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c81f8790 con 0x7f47c80b54c0 2024-08-18T22:25:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.109+0000 7f47cfc00640 1 -- 172.21.15.5:0/2388150242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c813d8d0 con 0x7f47c80b54c0 2024-08-18T22:25:12.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.113+0000 7f47cfc00640 1 -- 172.21.15.5:0/2388150242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c80cc360 con 0x7f47c80b54c0 2024-08-18T22:25:12.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.113+0000 7f47c4c00640 1 -- 172.21.15.5:0/2388150242 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47b40b9070 con 0x7f47c80b54c0 2024-08-18T22:25:12.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.113+0000 7f47c4c00640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47a80678c0 0x7f47a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.113+0000 7f47c4c00640 1 -- 172.21.15.5:0/2388150242 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f47b4123670 con 0x7f47c80b54c0 2024-08-18T22:25:12.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.113+0000 7f47cd200640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47a80678c0 0x7f47a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.113+0000 7f47cd200640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47a80678c0 0x7f47a8069d80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f47bc001810 tx=0x7f47bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:12.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.117+0000 7f47c4c00640 1 -- 172.21.15.5:0/2388150242 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f47b40188b0 con 0x7f47c80b54c0 2024-08-18T22:25:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.313+0000 7f47cfc00640 1 -- 172.21.15.5:0/2388150242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47c815e510 con 0x7f47c80b54c0 2024-08-18T22:25:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47c4c00640 1 -- 172.21.15.5:0/2388150242 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5221 (secure 0 0 0) 0x7f47b40f3810 con 0x7f47c80b54c0 2024-08-18T22:25:12.317 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:12.317 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"btime":"2024-08-18T22:25:02:956485+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1436391401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1436391401},{"type":"v1","addr":"172.21.15.117:6835","nonce":1436391401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/643889741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":643889741},{"type":"v1","addr":"172.21.15.117:6837","nonce":643889741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2830021009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2830021009},{"type":"v1","addr":"172.21.15.5:6833","nonce":2830021009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:25:02.956480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/580352313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":580352313},{"type":"v1","addr":"172.21.15.5:6835","nonce":580352313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7485,"qdb_cluster":[7485]},"id":6}]} 2024-08-18T22:25:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 81 2024-08-18T22:25:12.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 -- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47a80678c0 msgr2=0x7f47a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47a80678c0 0x7f47a8069d80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f47bc001810 tx=0x7f47bc009040 comp rx=0 tx=0).stop 2024-08-18T22:25:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 -- 172.21.15.5:0/2388150242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c80b54c0 msgr2=0x7f47c81f79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c80b54c0 0x7f47c81f79f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f47b40097c0 tx=0x7f47b401baf0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 -- 172.21.15.5:0/2388150242 shutdown_connections 2024-08-18T22:25:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47a80678c0 0x7f47a8069d80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47c80cbed0 0x7f47c8153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c80b54c0 0x7f47c81f79f0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 --2- 172.21.15.5:0/2388150242 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47c8071580 0x7f47c8142a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 -- 172.21.15.5:0/2388150242 >> 172.21.15.5:0/2388150242 conn(0x7f47c80b3eb0 msgr2=0x7f47c80b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 -- 172.21.15.5:0/2388150242 shutdown_connections 2024-08-18T22:25:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.317+0000 7f47cfc00640 1 -- 172.21.15.5:0/2388150242 wait complete. 2024-08-18T22:25:12.338 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-08-18T22:25:12.499 INFO:teuthology.orchestra.run.smithi005.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-08-18T22:24:52.649881+0000","btime":"2024-08-18T22:24:51.749891+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-08-18T22:24:52.649881+0000","atime":"2024-08-18T22:24:51.749891+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-08-18T22:24:52.649881+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:24:52.649881+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-08-18T22:24:52.649881+0000"},"version":131,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-08-18T22:25:06.374074+0000","last_scrub_version":128,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-08-18T22:25:12.499 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-08-18T22:24:52.649881+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-08-18T22:24:51.749891+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-08-18T22:24:51.749891+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-08-18T22:24:52.649881+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-08-18T22:24:52.649881+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-08-18T22:25:06.374074+0000", "last_scrub_version": 128, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-08-18T22:24:52.649881+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-08-18T22:24:52.649881+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 131, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-08-18T22:25:12.500 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-08-18T22:25:12.500 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:25:12.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:25:12.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:25:12.677 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:25:12.677 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:25:12.678 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:25:12.678 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:25:12.687 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:25:12.687 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:25:12.687 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:25:12.687 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:25:12.696 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:25:12.697 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:25:12.697 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:25:12.697 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:25:12.739 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:25:12.740 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:25:12.740 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:25:12.740 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:25:12.748 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:25:12.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.925+0000 7f7218c00640 1 Processor -- start 2024-08-18T22:25:12.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.925+0000 7f7218c00640 1 -- start start 2024-08-18T22:25:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7218c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7214071580 0x7f721406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7218c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72140cbed0 0x7f72140cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7218c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7214071c80 con 0x7f72140b54c0 2024-08-18T22:25:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7218c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f72140cba40 con 0x7f7214071580 2024-08-18T22:25:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7218c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7214071f60 con 0x7f72140cbed0 2024-08-18T22:25:12.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7209400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7214071580 0x7f721406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7209400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7214071580 0x7f721406dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40442/0 (socket says 172.21.15.5:40442) 2024-08-18T22:25:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7209400640 1 -- 172.21.15.5:0/4032473535 learned_addr learned my addr 172.21.15.5:0/4032473535 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7212800640 1 --2- 172.21.15.5:0/4032473535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72140cbed0 0x7f72140cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7209400640 1 -- 172.21.15.5:0/4032473535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72140cbed0 msgr2=0x7f72140cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7209400640 1 --2- 172.21.15.5:0/4032473535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72140cbed0 0x7f72140cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7209400640 1 -- 172.21.15.5:0/4032473535 >> v1:172.21.15.117:6789/0 conn(0x7f72140b54c0 legacy=0x7f72140b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:12.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.929+0000 7f7209400640 1 -- 172.21.15.5:0/4032473535 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72140cb6d0 con 0x7f7214071580 2024-08-18T22:25:12.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7209400640 1 --2- 172.21.15.5:0/4032473535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7214071580 0x7f721406dd80 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009870 tx=0x7f71fc01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67aa8b803cdb58e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7211400640 1 -- 172.21.15.5:0/4032473535 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0b5070 con 0x7f7214071580 2024-08-18T22:25:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7211400640 1 -- 172.21.15.5:0/4032473535 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71fc0a8a50 con 0x7f7214071580 2024-08-18T22:25:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7211400640 1 -- 172.21.15.5:0/4032473535 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0a8e20 con 0x7f7214071580 2024-08-18T22:25:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7218c00640 1 -- 172.21.15.5:0/4032473535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7214071580 msgr2=0x7f721406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:12.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7218c00640 1 --2- 172.21.15.5:0/4032473535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7214071580 0x7f721406dd80 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009870 tx=0x7f71fc01ed50 comp rx=0 tx=0).stop 2024-08-18T22:25:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7218c00640 1 -- 172.21.15.5:0/4032473535 shutdown_connections 2024-08-18T22:25:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7218c00640 1 --2- 172.21.15.5:0/4032473535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72140cbed0 0x7f72140cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7218c00640 1 --2- 172.21.15.5:0/4032473535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7214071580 0x7f721406dd80 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7218c00640 1 -- 172.21.15.5:0/4032473535 >> 172.21.15.5:0/4032473535 conn(0x7f72140b3eb0 msgr2=0x7f72140b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7218c00640 1 -- 172.21.15.5:0/4032473535 shutdown_connections 2024-08-18T22:25:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7218c00640 1 -- 172.21.15.5:0/4032473535 wait complete. 2024-08-18T22:25:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7218c00640 1 Processor -- start 2024-08-18T22:25:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.933+0000 7f7218c00640 1 -- start start 2024-08-18T22:25:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7218c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7214071580 0x7f72141f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7218c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72140b54c0 0x7f72140a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7218c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72140cbed0 0x7f72140aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7218c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f72141481a0 con 0x7f7214071580 2024-08-18T22:25:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7218c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7214148020 con 0x7f72140b54c0 2024-08-18T22:25:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7218c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f72140cc8a0 con 0x7f72140cbed0 2024-08-18T22:25:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7211e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7214071580 0x7f72141f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7211e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7214071580 0x7f72141f4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40450/0 (socket says 172.21.15.5:40450) 2024-08-18T22:25:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7211e00640 1 -- 172.21.15.5:0/2859710376 learned_addr learned my addr 172.21.15.5:0/2859710376 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7209400640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72140b54c0 0x7f72140a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7212800640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72140cbed0 0x7f72140aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7211e00640 1 -- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72140cbed0 msgr2=0x7f72140aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7211e00640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72140cbed0 0x7f72140aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7211e00640 1 -- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72140b54c0 msgr2=0x7f72140a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7211e00640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72140b54c0 0x7f72140a9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7211e00640 1 -- 172.21.15.5:0/2859710376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72140cfa60 con 0x7f7214071580 2024-08-18T22:25:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7211e00640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7214071580 0x7f72141f4b50 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f720400c500 tx=0x7f720400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f720aa00640 1 -- 172.21.15.5:0/2859710376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204016020 con 0x7f7214071580 2024-08-18T22:25:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f720aa00640 1 -- 172.21.15.5:0/2859710376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7204005220 con 0x7f7214071580 2024-08-18T22:25:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f720aa00640 1 -- 172.21.15.5:0/2859710376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204007030 con 0x7f7214071580 2024-08-18T22:25:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7218c00640 1 -- 172.21.15.5:0/2859710376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72140cfd40 con 0x7f7214071580 2024-08-18T22:25:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7218c00640 1 -- 172.21.15.5:0/2859710376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72140d0300 con 0x7f7214071580 2024-08-18T22:25:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f7218c00640 1 -- 172.21.15.5:0/2859710376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72140cc360 con 0x7f7214071580 2024-08-18T22:25:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.937+0000 7f720aa00640 1 -- 172.21.15.5:0/2859710376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72040071f0 con 0x7f7214071580 2024-08-18T22:25:12.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.941+0000 7f720aa00640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71f00678c0 0x7f71f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.941+0000 7f720aa00640 1 -- 172.21.15.5:0/2859710376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f7204085850 con 0x7f7214071580 2024-08-18T22:25:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.941+0000 7f7209400640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71f00678c0 0x7f71f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:12.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.941+0000 7f7209400640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71f00678c0 0x7f71f0069d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0b2000 tx=0x7f71fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:12.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:12.945+0000 7f720aa00640 1 -- 172.21.15.5:0/2859710376 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7204020020 con 0x7f7214071580 2024-08-18T22:25:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 -- 172.21.15.5:0/2859710376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72140b47b0 con 0x7f7214071580 2024-08-18T22:25:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f720aa00640 1 -- 172.21.15.5:0/2859710376 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5221 (secure 0 0 0) 0x7f7204055a40 con 0x7f7214071580 2024-08-18T22:25:13.145 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:13.145 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"btime":"2024-08-18T22:25:02:956485+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1436391401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1436391401},{"type":"v1","addr":"172.21.15.117:6835","nonce":1436391401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/643889741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":643889741},{"type":"v1","addr":"172.21.15.117:6837","nonce":643889741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2830021009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2830021009},{"type":"v1","addr":"172.21.15.5:6833","nonce":2830021009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:25:02.956480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/580352313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":580352313},{"type":"v1","addr":"172.21.15.5:6835","nonce":580352313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7485,"qdb_cluster":[7485]},"id":6}]} 2024-08-18T22:25:13.146 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 81 2024-08-18T22:25:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 -- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71f00678c0 msgr2=0x7f71f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71f00678c0 0x7f71f0069d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0b2000 tx=0x7f71fc009040 comp rx=0 tx=0).stop 2024-08-18T22:25:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 -- 172.21.15.5:0/2859710376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7214071580 msgr2=0x7f72141f4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7214071580 0x7f72141f4b50 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f720400c500 tx=0x7f720400c9c0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 -- 172.21.15.5:0/2859710376 shutdown_connections 2024-08-18T22:25:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71f00678c0 0x7f71f0069d80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72140cbed0 0x7f72140aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72140b54c0 0x7f72140a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 --2- 172.21.15.5:0/2859710376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7214071580 0x7f72141f4b50 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 -- 172.21.15.5:0/2859710376 >> 172.21.15.5:0/2859710376 conn(0x7f72140b3eb0 msgr2=0x7f7214144b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 -- 172.21.15.5:0/2859710376 shutdown_connections 2024-08-18T22:25:13.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.145+0000 7f7218c00640 1 -- 172.21.15.5:0/2859710376 wait complete. 2024-08-18T22:25:13.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.305+0000 7f96aae00640 1 Processor -- start 2024-08-18T22:25:13.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.305+0000 7f96aae00640 1 -- start start 2024-08-18T22:25:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f96aae00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f96a415b010 0x7f96a40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f96aae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a40cd3a0 0x7f96a406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f96aae00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a40cee20 con 0x7f96a406f0c0 2024-08-18T22:25:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f96aae00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f96a40cfa30 con 0x7f96a415b010 2024-08-18T22:25:13.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f96aae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f96a40cf100 con 0x7f96a40cd3a0 2024-08-18T22:25:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f969b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a40cd3a0 0x7f96a406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f96a3e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f96a415b010 0x7f96a40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f96a8e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f96a406f0c0 0x7f96a40caf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:36110/0 (socket says 172.21.15.5:36110) 2024-08-18T22:25:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f96a8e00640 1 -- 172.21.15.5:0/514842630 learned_addr learned my addr 172.21.15.5:0/514842630 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f969b400640 1 -- 172.21.15.5:0/514842630 >> v2:172.21.15.117:3300/0 conn(0x7f96a415b010 msgr2=0x7f96a40ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:13.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f969b400640 1 --2- 172.21.15.5:0/514842630 >> v2:172.21.15.117:3300/0 conn(0x7f96a415b010 0x7f96a40ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f969b400640 1 -- 172.21.15.5:0/514842630 >> v1:172.21.15.117:6789/0 conn(0x7f96a406f0c0 legacy=0x7f96a40caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f969b400640 1 -- 172.21.15.5:0/514842630 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a40cf3e0 con 0x7f96a40cd3a0 2024-08-18T22:25:13.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.309+0000 7f96a3e00640 1 --2- 172.21.15.5:0/514842630 >> v2:172.21.15.117:3300/0 conn(0x7f96a415b010 0x7f96a40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:25:13.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f969b400640 1 --2- 172.21.15.5:0/514842630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a40cd3a0 0x7f96a406eb80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f968c0097c0 tx=0x7f968c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1868b7dca45b9793 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:13.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96a3400640 1 -- 172.21.15.5:0/514842630 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c0b0070 con 0x7f96a40cd3a0 2024-08-18T22:25:13.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96a3400640 1 -- 172.21.15.5:0/514842630 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968c0ab600 con 0x7f96a40cd3a0 2024-08-18T22:25:13.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96a3400640 1 -- 172.21.15.5:0/514842630 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c0ab9d0 con 0x7f96a40cd3a0 2024-08-18T22:25:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 -- 172.21.15.5:0/514842630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a40cd3a0 msgr2=0x7f96a406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 --2- 172.21.15.5:0/514842630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a40cd3a0 0x7f96a406eb80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f968c0097c0 tx=0x7f968c01c4a0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 -- 172.21.15.5:0/514842630 shutdown_connections 2024-08-18T22:25:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 --2- 172.21.15.5:0/514842630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a40cd3a0 0x7f96a406eb80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 --2- 172.21.15.5:0/514842630 >> v2:172.21.15.117:3300/0 conn(0x7f96a415b010 0x7f96a40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 -- 172.21.15.5:0/514842630 >> 172.21.15.5:0/514842630 conn(0x7f96a40b1c50 msgr2=0x7f96a40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:13.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 -- 172.21.15.5:0/514842630 shutdown_connections 2024-08-18T22:25:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 -- 172.21.15.5:0/514842630 wait complete. 2024-08-18T22:25:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 Processor -- start 2024-08-18T22:25:13.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 -- start start 2024-08-18T22:25:13.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a406f0c0 0x7f96a40b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a40cd3a0 0x7f96a40d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a415b010 0x7f96a415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f96a406dbf0 con 0x7f96a406f0c0 2024-08-18T22:25:13.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96a406da70 con 0x7f96a40cd3a0 2024-08-18T22:25:13.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96aae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f96a406dd70 con 0x7f96a415b010 2024-08-18T22:25:13.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.313+0000 7f96a3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a406f0c0 0x7f96a40b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a406f0c0 0x7f96a40b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40462/0 (socket says 172.21.15.5:40462) 2024-08-18T22:25:13.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a3e00640 1 -- 172.21.15.5:0/1594321435 learned_addr learned my addr 172.21.15.5:0/1594321435 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:13.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a8e00640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a415b010 0x7f96a415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f969b400640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a40cd3a0 0x7f96a40d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a3e00640 1 -- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a415b010 msgr2=0x7f96a415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a3e00640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a415b010 0x7f96a415c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a3e00640 1 -- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a40cd3a0 msgr2=0x7f96a40d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a3e00640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a40cd3a0 0x7f96a40d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a3e00640 1 -- 172.21.15.5:0/1594321435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a40b10e0 con 0x7f96a406f0c0 2024-08-18T22:25:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a3e00640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a406f0c0 0x7f96a40b0ba0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f969400e980 tx=0x7f969400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a0c00640 1 -- 172.21.15.5:0/1594321435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694017070 con 0x7f96a406f0c0 2024-08-18T22:25:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a0c00640 1 -- 172.21.15.5:0/1594321435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969400ca00 con 0x7f96a406f0c0 2024-08-18T22:25:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96aae00640 1 -- 172.21.15.5:0/1594321435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a40afb00 con 0x7f96a406f0c0 2024-08-18T22:25:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a0c00640 1 -- 172.21.15.5:0/1594321435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969400cdd0 con 0x7f96a406f0c0 2024-08-18T22:25:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96aae00640 1 -- 172.21.15.5:0/1594321435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a40b00c0 con 0x7f96a406f0c0 2024-08-18T22:25:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96aae00640 1 -- 172.21.15.5:0/1594321435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a40ce840 con 0x7f96a406f0c0 2024-08-18T22:25:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.317+0000 7f96a0c00640 1 -- 172.21.15.5:0/1594321435 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f969401a070 con 0x7f96a406f0c0 2024-08-18T22:25:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.321+0000 7f96a0c00640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96800678c0 0x7f9680069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.321+0000 7f96a0c00640 1 -- 172.21.15.5:0/1594321435 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f9694086190 con 0x7f96a406f0c0 2024-08-18T22:25:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.321+0000 7f969b400640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96800678c0 0x7f9680069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.321+0000 7f969b400640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96800678c0 0x7f9680069d80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f968c0ad000 tx=0x7f968c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:13.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.325+0000 7f96a0c00640 1 -- 172.21.15.5:0/1594321435 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f96940563d0 con 0x7f96a406f0c0 2024-08-18T22:25:13.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.521+0000 7f96aae00640 1 -- 172.21.15.5:0/1594321435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96a4165a20 con 0x7f96a406f0c0 2024-08-18T22:25:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.521+0000 7f96a0c00640 1 -- 172.21.15.5:0/1594321435 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5221 (secure 0 0 0) 0x7f969405a6d0 con 0x7f96a406f0c0 2024-08-18T22:25:13.523 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:13.523 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"btime":"2024-08-18T22:25:02:956485+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1436391401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1436391401},{"type":"v1","addr":"172.21.15.117:6835","nonce":1436391401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/643889741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":643889741},{"type":"v1","addr":"172.21.15.117:6837","nonce":643889741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2830021009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2830021009},{"type":"v1","addr":"172.21.15.5:6833","nonce":2830021009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:25:02.956480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/580352313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":580352313},{"type":"v1","addr":"172.21.15.5:6835","nonce":580352313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7485,"qdb_cluster":[7485]},"id":6}]} 2024-08-18T22:25:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 81 2024-08-18T22:25:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 -- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96800678c0 msgr2=0x7f9680069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96800678c0 0x7f9680069d80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f968c0ad000 tx=0x7f968c008040 comp rx=0 tx=0).stop 2024-08-18T22:25:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 -- 172.21.15.5:0/1594321435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a406f0c0 msgr2=0x7f96a40b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a406f0c0 0x7f96a40b0ba0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f969400e980 tx=0x7f969400ee40 comp rx=0 tx=0).stop 2024-08-18T22:25:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 -- 172.21.15.5:0/1594321435 shutdown_connections 2024-08-18T22:25:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96800678c0 0x7f9680069d80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a415b010 0x7f96a415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a40cd3a0 0x7f96a40d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 --2- 172.21.15.5:0/1594321435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a406f0c0 0x7f96a40b0ba0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 -- 172.21.15.5:0/1594321435 >> 172.21.15.5:0/1594321435 conn(0x7f96a40b1c50 msgr2=0x7f96a40caf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 -- 172.21.15.5:0/1594321435 shutdown_connections 2024-08-18T22:25:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.525+0000 7f96aae00640 1 -- 172.21.15.5:0/1594321435 wait complete. 2024-08-18T22:25:13.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:25:13.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.685+0000 7f10af800640 1 Processor -- start 2024-08-18T22:25:13.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.685+0000 7f10af800640 1 -- start start 2024-08-18T22:25:13.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.685+0000 7f10af800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10a80ce610 0x7f10a809b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.685+0000 7f10af800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10a809b8b0 0x7f10a80ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.685+0000 7f10af800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a80cff50 con 0x7f10a815ff60 2024-08-18T22:25:13.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.685+0000 7f10af800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f10a80cfd00 con 0x7f10a809b8b0 2024-08-18T22:25:13.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.685+0000 7f10af800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10a80d0230 con 0x7f10a80ce610 2024-08-18T22:25:13.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10ad800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10a809b8b0 0x7f10a80ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f109fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10a80ce610 0x7f10a809b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10ad800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10a809b8b0 0x7f10a80ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37248/0 (socket says 172.21.15.5:37248) 2024-08-18T22:25:13.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10ad800640 1 -- 172.21.15.5:0/2955222479 learned_addr learned my addr 172.21.15.5:0/2955222479 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:13.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10ad800640 1 -- 172.21.15.5:0/2955222479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10a80ce610 msgr2=0x7f10a809b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:13.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10ad800640 1 --2- 172.21.15.5:0/2955222479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10a80ce610 0x7f10a809b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10ad800640 1 -- 172.21.15.5:0/2955222479 >> v1:172.21.15.117:6789/0 conn(0x7f10a815ff60 legacy=0x7f10a8160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10ad800640 1 -- 172.21.15.5:0/2955222479 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a809ab70 con 0x7f10a809b8b0 2024-08-18T22:25:13.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10a7e00640 1 -- 172.21.15.5:0/2955222479 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011828471 0 0) 0x7f10a80cff50 con 0x7f10a815ff60 2024-08-18T22:25:13.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10ad800640 1 --2- 172.21.15.5:0/2955222479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a809b8b0 0x7f10a80ccc10 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009e50 tx=0x7f10a001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae17768b54746697 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:13.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10a7e00640 1 -- 172.21.15.5:0/2955222479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a00a55d0 con 0x7f10a809b8b0 2024-08-18T22:25:13.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10a7e00640 1 -- 172.21.15.5:0/2955222479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a00a5770 con 0x7f10a809b8b0 2024-08-18T22:25:13.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.689+0000 7f10a7e00640 1 -- 172.21.15.5:0/2955222479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a00a5b40 con 0x7f10a809b8b0 2024-08-18T22:25:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 -- 172.21.15.5:0/2955222479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a809b8b0 msgr2=0x7f10a80ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 --2- 172.21.15.5:0/2955222479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a809b8b0 0x7f10a80ccc10 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009e50 tx=0x7f10a001c910 comp rx=0 tx=0).stop 2024-08-18T22:25:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 -- 172.21.15.5:0/2955222479 shutdown_connections 2024-08-18T22:25:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 --2- 172.21.15.5:0/2955222479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a809b8b0 0x7f10a80ccc10 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 --2- 172.21.15.5:0/2955222479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10a80ce610 0x7f10a809b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 -- 172.21.15.5:0/2955222479 >> 172.21.15.5:0/2955222479 conn(0x7f10a80d2130 msgr2=0x7f10a80d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 -- 172.21.15.5:0/2955222479 shutdown_connections 2024-08-18T22:25:13.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 -- 172.21.15.5:0/2955222479 wait complete. 2024-08-18T22:25:13.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 Processor -- start 2024-08-18T22:25:13.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 -- start start 2024-08-18T22:25:13.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10a809b8b0 0x7f10a81577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a80ce610 0x7f10a80b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10a815ff60 0x7f10a80b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f10a8169850 con 0x7f10a80ce610 2024-08-18T22:25:13.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f10a80cd560 con 0x7f10a815ff60 2024-08-18T22:25:13.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10af800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10a81699d0 con 0x7f10a809b8b0 2024-08-18T22:25:13.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f109fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a80ce610 0x7f10a80b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f109fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a80ce610 0x7f10a80b3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37262/0 (socket says 172.21.15.5:37262) 2024-08-18T22:25:13.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f109fe00640 1 -- 172.21.15.5:0/1914673178 learned_addr learned my addr 172.21.15.5:0/1914673178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:13.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10ad800640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10a815ff60 0x7f10a80b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f10ace00640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10a809b8b0 0x7f10a81577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f109fe00640 1 -- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10a809b8b0 msgr2=0x7f10a81577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f109fe00640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10a809b8b0 0x7f10a81577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f109fe00640 1 -- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10a815ff60 msgr2=0x7f10a80b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f109fe00640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10a815ff60 0x7f10a80b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f109fe00640 1 -- 172.21.15.5:0/1914673178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a8157ce0 con 0x7f10a80ce610 2024-08-18T22:25:13.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.693+0000 7f109fe00640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a80ce610 0x7f10a80b3390 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f109000e870 tx=0x7f109000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:13.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.697+0000 7f10a5600640 1 -- 172.21.15.5:0/1914673178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090017070 con 0x7f10a80ce610 2024-08-18T22:25:13.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.697+0000 7f10a5600640 1 -- 172.21.15.5:0/1914673178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109000c940 con 0x7f10a80ce610 2024-08-18T22:25:13.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.697+0000 7f10a5600640 1 -- 172.21.15.5:0/1914673178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109000cd10 con 0x7f10a80ce610 2024-08-18T22:25:13.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.697+0000 7f10af800640 1 -- 172.21.15.5:0/1914673178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a80b2f50 con 0x7f10a80ce610 2024-08-18T22:25:13.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.697+0000 7f10af800640 1 -- 172.21.15.5:0/1914673178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a80b2c70 con 0x7f10a80ce610 2024-08-18T22:25:13.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.697+0000 7f10af800640 1 -- 172.21.15.5:0/1914673178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a80cff50 con 0x7f10a80ce610 2024-08-18T22:25:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.697+0000 7f10a5600640 1 -- 172.21.15.5:0/1914673178 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f109001a070 con 0x7f10a80ce610 2024-08-18T22:25:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.697+0000 7f10a5600640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10840678c0 0x7f1084069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.697+0000 7f10a5600640 1 -- 172.21.15.5:0/1914673178 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f1090085e20 con 0x7f10a80ce610 2024-08-18T22:25:13.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.697+0000 7f10ace00640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10840678c0 0x7f1084069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:13.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.701+0000 7f10ace00640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10840678c0 0x7f1084069d80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1098007fd0 tx=0x7f1098009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:13.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.701+0000 7f10a5600640 1 -- 172.21.15.5:0/1914673178 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1090055fc0 con 0x7f10a80ce610 2024-08-18T22:25:13.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.873+0000 7f10af800640 1 -- 172.21.15.5:0/1914673178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10a80d0f90 con 0x7f10a80ce610 2024-08-18T22:25:13.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.873+0000 7f10a5600640 1 -- 172.21.15.5:0/1914673178 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+17268 (secure 0 0 0) 0x7f109005a2c0 con 0x7f10a80ce610 2024-08-18T22:25:13.874 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:13.874 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":103,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:25:04.596732+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:24:37.136051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-08-18T22:24:38.401283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.a","mappings":[{"from":1,"to":7}]},{"pgid":"14.18","mappings":[{"from":1,"to":2}]},{"pgid":"14.32","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6837/314902070":"2024-08-19T22:24:59.944539+0000","172.21.15.117:6835/314902070":"2024-08-19T22:24:59.944539+0000","172.21.15.5:6835/3668199286":"2024-08-19T22:24:54.562505+0000","172.21.15.5:6834/3668199286":"2024-08-19T22:24:54.562505+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:25:13.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 -- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10840678c0 msgr2=0x7f1084069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10840678c0 0x7f1084069d80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1098007fd0 tx=0x7f1098009040 comp rx=0 tx=0).stop 2024-08-18T22:25:13.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 -- 172.21.15.5:0/1914673178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a80ce610 msgr2=0x7f10a80b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:13.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a80ce610 0x7f10a80b3390 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f109000e870 tx=0x7f109000ec70 comp rx=0 tx=0).stop 2024-08-18T22:25:13.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 -- 172.21.15.5:0/1914673178 shutdown_connections 2024-08-18T22:25:13.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10840678c0 0x7f1084069d80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10a815ff60 0x7f10a80b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a80ce610 0x7f10a80b3390 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 --2- 172.21.15.5:0/1914673178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10a809b8b0 0x7f10a81577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:13.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 -- 172.21.15.5:0/1914673178 >> 172.21.15.5:0/1914673178 conn(0x7f10a80d2130 msgr2=0x7f10a815c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:13.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 -- 172.21.15.5:0/1914673178 shutdown_connections 2024-08-18T22:25:13.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:13.877+0000 7f10af800640 1 -- 172.21.15.5:0/1914673178 wait complete. 2024-08-18T22:25:13.896 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:25:13.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be3800640 1 Processor -- start 2024-08-18T22:25:14.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be3800640 1 -- start start 2024-08-18T22:25:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be3800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0b54c0 0x7f7bdc071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be3800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7bdc0cbed0 0x7f7bdc0cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be3800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc071c80 con 0x7f7bdc06dd80 2024-08-18T22:25:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be3800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7bdc0cba40 con 0x7f7bdc0cbed0 2024-08-18T22:25:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be3800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc071f60 con 0x7f7bdc0b54c0 2024-08-18T22:25:14.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be0e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0b54c0 0x7f7bdc071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be1800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7bdc0cbed0 0x7f7bdc0cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be0e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0b54c0 0x7f7bdc071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:39234/0 (socket says 172.21.15.5:39234) 2024-08-18T22:25:14.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be0e00640 1 -- 172.21.15.5:0/2311228440 learned_addr learned my addr 172.21.15.5:0/2311228440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:14.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be0e00640 1 -- 172.21.15.5:0/2311228440 >> v2:172.21.15.117:3300/0 conn(0x7f7bdc0cbed0 msgr2=0x7f7bdc0cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:14.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be0e00640 1 --2- 172.21.15.5:0/2311228440 >> v2:172.21.15.117:3300/0 conn(0x7f7bdc0cbed0 0x7f7bdc0cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be0e00640 1 -- 172.21.15.5:0/2311228440 >> v1:172.21.15.117:6789/0 conn(0x7f7bdc06dd80 legacy=0x7f7bdc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7be0e00640 1 -- 172.21.15.5:0/2311228440 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc0cb6d0 con 0x7f7bdc0b54c0 2024-08-18T22:25:14.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.037+0000 7f7bdb400640 1 -- 172.21.15.5:0/2311228440 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3455627732 0 0) 0x7f7bdc071c80 con 0x7f7bdc06dd80 2024-08-18T22:25:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7be0e00640 1 --2- 172.21.15.5:0/2311228440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0b54c0 0x7f7bdc071580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009870 tx=0x7f7bcc01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=532dc332f61ee1a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:14.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7bdb400640 1 -- 172.21.15.5:0/2311228440 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0b5070 con 0x7f7bdc0b54c0 2024-08-18T22:25:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7bdb400640 1 -- 172.21.15.5:0/2311228440 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bcc0a8a50 con 0x7f7bdc0b54c0 2024-08-18T22:25:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7bdb400640 1 -- 172.21.15.5:0/2311228440 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0a8e20 con 0x7f7bdc0b54c0 2024-08-18T22:25:14.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7be3800640 1 -- 172.21.15.5:0/2311228440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0b54c0 msgr2=0x7f7bdc071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7be3800640 1 --2- 172.21.15.5:0/2311228440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0b54c0 0x7f7bdc071580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009870 tx=0x7f7bcc01ed50 comp rx=0 tx=0).stop 2024-08-18T22:25:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7be3800640 1 -- 172.21.15.5:0/2311228440 shutdown_connections 2024-08-18T22:25:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7be3800640 1 --2- 172.21.15.5:0/2311228440 >> v2:172.21.15.117:3300/0 conn(0x7f7bdc0cbed0 0x7f7bdc0cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7be3800640 1 --2- 172.21.15.5:0/2311228440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0b54c0 0x7f7bdc071580 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7be3800640 1 -- 172.21.15.5:0/2311228440 >> 172.21.15.5:0/2311228440 conn(0x7f7bdc0b3eb0 msgr2=0x7f7bdc0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7be3800640 1 -- 172.21.15.5:0/2311228440 shutdown_connections 2024-08-18T22:25:14.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.041+0000 7f7be3800640 1 -- 172.21.15.5:0/2311228440 wait complete. 2024-08-18T22:25:14.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be3800640 1 Processor -- start 2024-08-18T22:25:14.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be3800640 1 -- start start 2024-08-18T22:25:14.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be3800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bdc06dd80 0x7f7bdc15d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be3800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc0b54c0 0x7f7bdc13eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be3800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0cbed0 0x7f7bdc140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be3800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc1481a0 con 0x7f7bdc06dd80 2024-08-18T22:25:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be3800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc148020 con 0x7f7bdc0b54c0 2024-08-18T22:25:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be3800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc0cc8c0 con 0x7f7bdc0cbed0 2024-08-18T22:25:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bdc06dd80 0x7f7bdc15d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bdc06dd80 0x7f7bdc15d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37264/0 (socket says 172.21.15.5:37264) 2024-08-18T22:25:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be0e00640 1 -- 172.21.15.5:0/1682095532 learned_addr learned my addr 172.21.15.5:0/1682095532 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be1800640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0cbed0 0x7f7bdc140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7bdbe00640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc0b54c0 0x7f7bdc13eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be0e00640 1 -- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0cbed0 msgr2=0x7f7bdc140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be0e00640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0cbed0 0x7f7bdc140ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be0e00640 1 -- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc0b54c0 msgr2=0x7f7bdc13eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be0e00640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc0b54c0 0x7f7bdc13eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be0e00640 1 -- 172.21.15.5:0/1682095532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc140770 con 0x7f7bdc06dd80 2024-08-18T22:25:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be0e00640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bdc06dd80 0x7f7bdc15d6b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0b3040 tx=0x7f7bcc01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7bd8c00640 1 -- 172.21.15.5:0/1682095532 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0b5040 con 0x7f7bdc06dd80 2024-08-18T22:25:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7bd8c00640 1 -- 172.21.15.5:0/1682095532 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bcc0b0af0 con 0x7f7bdc06dd80 2024-08-18T22:25:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be3800640 1 -- 172.21.15.5:0/1682095532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc13e160 con 0x7f7bdc06dd80 2024-08-18T22:25:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7bd8c00640 1 -- 172.21.15.5:0/1682095532 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc004020 con 0x7f7bdc06dd80 2024-08-18T22:25:14.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be3800640 1 -- 172.21.15.5:0/1682095532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc13e720 con 0x7f7bdc06dd80 2024-08-18T22:25:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.045+0000 7f7be3800640 1 -- 172.21.15.5:0/1682095532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bdc071c80 con 0x7f7bdc06dd80 2024-08-18T22:25:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.049+0000 7f7bd8c00640 1 -- 172.21.15.5:0/1682095532 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7bcc0041c0 con 0x7f7bdc06dd80 2024-08-18T22:25:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.049+0000 7f7bd8c00640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678f0 0x7f7bbc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.049+0000 7f7bd8c00640 1 -- 172.21.15.5:0/1682095532 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f7bcc122de0 con 0x7f7bdc06dd80 2024-08-18T22:25:14.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.049+0000 7f7bdbe00640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678f0 0x7f7bbc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.049+0000 7f7bdbe00640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678f0 0x7f7bbc069db0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0d3150 tx=0x7f7bc8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.053+0000 7f7bd8c00640 1 -- 172.21.15.5:0/1682095532 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7bdc140770 con 0x7f7bdc06dd80 2024-08-18T22:25:14.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.249+0000 7f7be3800640 1 -- 172.21.15.5:0/1682095532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bdc0b6b50 con 0x7f7bdc06dd80 2024-08-18T22:25:14.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.249+0000 7f7bd8c00640 1 -- 172.21.15.5:0/1682095532 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5221 (secure 0 0 0) 0x7f7bcc0188b0 con 0x7f7bdc06dd80 2024-08-18T22:25:14.251 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:14.252 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"btime":"2024-08-18T22:25:02:956485+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1436391401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1436391401},{"type":"v1","addr":"172.21.15.117:6835","nonce":1436391401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/643889741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":643889741},{"type":"v1","addr":"172.21.15.117:6837","nonce":643889741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2830021009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2830021009},{"type":"v1","addr":"172.21.15.5:6833","nonce":2830021009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:25:02.956480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/580352313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":580352313},{"type":"v1","addr":"172.21.15.5:6835","nonce":580352313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7485,"qdb_cluster":[7485]},"id":6}]} 2024-08-18T22:25:14.252 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 81 2024-08-18T22:25:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 -- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678f0 msgr2=0x7f7bbc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678f0 0x7f7bbc069db0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0d3150 tx=0x7f7bc8009040 comp rx=0 tx=0).stop 2024-08-18T22:25:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 -- 172.21.15.5:0/1682095532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bdc06dd80 msgr2=0x7f7bdc15d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bdc06dd80 0x7f7bdc15d6b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0b3040 tx=0x7f7bcc01baf0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 -- 172.21.15.5:0/1682095532 shutdown_connections 2024-08-18T22:25:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7bbc0678f0 0x7f7bbc069db0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bdc0cbed0 0x7f7bdc140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc0b54c0 0x7f7bdc13eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 --2- 172.21.15.5:0/1682095532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bdc06dd80 0x7f7bdc15d6b0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 -- 172.21.15.5:0/1682095532 >> 172.21.15.5:0/1682095532 conn(0x7f7bdc0b3eb0 msgr2=0x7f7bdc146890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:14.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 -- 172.21.15.5:0/1682095532 shutdown_connections 2024-08-18T22:25:14.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.253+0000 7f7be3800640 1 -- 172.21.15.5:0/1682095532 wait complete. 2024-08-18T22:25:14.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f418ca00640 1 Processor -- start 2024-08-18T22:25:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f418ca00640 1 -- start start 2024-08-18T22:25:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f418ca00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f418815b010 0x7f41880ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f418ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f418806f290 0x7f4188072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f418ca00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41880cee20 con 0x7f41880cd3a0 2024-08-18T22:25:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f418ca00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f41880cfa30 con 0x7f418806f290 2024-08-18T22:25:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f418ca00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f41880cf100 con 0x7f418815b010 2024-08-18T22:25:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f4186800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f418806f290 0x7f4188072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f4186800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f418806f290 0x7f4188072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37280/0 (socket says 172.21.15.5:37280) 2024-08-18T22:25:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f4186800640 1 -- 172.21.15.5:0/1375111950 learned_addr learned my addr 172.21.15.5:0/1375111950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f4185e00640 1 --2- 172.21.15.5:0/1375111950 >> v2:172.21.15.117:3300/0 conn(0x7f418815b010 0x7f41880ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f4186800640 1 -- 172.21.15.5:0/1375111950 >> v2:172.21.15.117:3300/0 conn(0x7f418815b010 msgr2=0x7f41880ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f4186800640 1 --2- 172.21.15.5:0/1375111950 >> v2:172.21.15.117:3300/0 conn(0x7f418815b010 0x7f41880ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f4186800640 1 -- 172.21.15.5:0/1375111950 >> v1:172.21.15.117:6789/0 conn(0x7f41880cd3a0 legacy=0x7f418806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f4186800640 1 -- 172.21.15.5:0/1375111950 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41880cf3e0 con 0x7f418806f290 2024-08-18T22:25:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.413+0000 7f4185e00640 1 --2- 172.21.15.5:0/1375111950 >> v2:172.21.15.117:3300/0 conn(0x7f418815b010 0x7f41880ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f4186800640 1 --2- 172.21.15.5:0/1375111950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f418806f290 0x7f4188072620 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f41880cfbb0 tx=0x7f418001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef7d8f4c7aa773d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f4185400640 1 -- 172.21.15.5:0/1375111950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800a57b0 con 0x7f418806f290 2024-08-18T22:25:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f4185400640 1 -- 172.21.15.5:0/1375111950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41800a5950 con 0x7f418806f290 2024-08-18T22:25:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f4185400640 1 -- 172.21.15.5:0/1375111950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800a5d20 con 0x7f418806f290 2024-08-18T22:25:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f418ca00640 1 -- 172.21.15.5:0/1375111950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f418806f290 msgr2=0x7f4188072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f418ca00640 1 --2- 172.21.15.5:0/1375111950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f418806f290 0x7f4188072620 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f41880cfbb0 tx=0x7f418001c9c0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f418ca00640 1 -- 172.21.15.5:0/1375111950 shutdown_connections 2024-08-18T22:25:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f418ca00640 1 --2- 172.21.15.5:0/1375111950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f418806f290 0x7f4188072620 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f418ca00640 1 --2- 172.21.15.5:0/1375111950 >> v2:172.21.15.117:3300/0 conn(0x7f418815b010 0x7f41880ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f418ca00640 1 -- 172.21.15.5:0/1375111950 >> 172.21.15.5:0/1375111950 conn(0x7f41880b1c50 msgr2=0x7f41880b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f418ca00640 1 -- 172.21.15.5:0/1375111950 shutdown_connections 2024-08-18T22:25:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.417+0000 7f418ca00640 1 -- 172.21.15.5:0/1375111950 wait complete. 2024-08-18T22:25:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f418ca00640 1 Processor -- start 2024-08-18T22:25:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f418ca00640 1 -- start start 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f418ca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f418806f290 0x7f41880ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f418ca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41880cd3a0 0x7f4188151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f418ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f418815b010 0x7f418809cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f418ca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f41880734f0 con 0x7f418815b010 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f418ca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4188073370 con 0x7f41880cd3a0 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f418ca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4188073670 con 0x7f418806f290 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f4186800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f418815b010 0x7f418809cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f4186800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f418815b010 0x7f418809cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37294/0 (socket says 172.21.15.5:37294) 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f4186800640 1 -- 172.21.15.5:0/1026362321 learned_addr learned my addr 172.21.15.5:0/1026362321 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f4185e00640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f418806f290 0x7f41880ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f417d400640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41880cd3a0 0x7f4188151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f4186800640 1 -- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f418806f290 msgr2=0x7f41880ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f4186800640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f418806f290 0x7f41880ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f4186800640 1 -- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41880cd3a0 msgr2=0x7f4188151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f4186800640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41880cd3a0 0x7f4188151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f4186800640 1 -- 172.21.15.5:0/1026362321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41880ae780 con 0x7f418815b010 2024-08-18T22:25:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f417d400640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41880cd3a0 0x7f4188151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f4186800640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f418815b010 0x7f418809cc50 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f41800195d0 tx=0x7f4180019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f417ea00640 1 -- 172.21.15.5:0/1026362321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800bc020 con 0x7f418815b010 2024-08-18T22:25:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f417ea00640 1 -- 172.21.15.5:0/1026362321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41800b8670 con 0x7f418815b010 2024-08-18T22:25:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f417ea00640 1 -- 172.21.15.5:0/1026362321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800b8a40 con 0x7f418815b010 2024-08-18T22:25:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f418ca00640 1 -- 172.21.15.5:0/1026362321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41880b34f0 con 0x7f418815b010 2024-08-18T22:25:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.421+0000 7f418ca00640 1 -- 172.21.15.5:0/1026362321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41880b3ab0 con 0x7f418815b010 2024-08-18T22:25:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.425+0000 7f418ca00640 1 -- 172.21.15.5:0/1026362321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4188072620 con 0x7f418815b010 2024-08-18T22:25:14.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.425+0000 7f417ea00640 1 -- 172.21.15.5:0/1026362321 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f41800bf020 con 0x7f418815b010 2024-08-18T22:25:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.425+0000 7f417ea00640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41640678c0 0x7f4164069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.425+0000 7f417ea00640 1 -- 172.21.15.5:0/1026362321 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f41801210f0 con 0x7f418815b010 2024-08-18T22:25:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.425+0000 7f4185e00640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41640678c0 0x7f4164069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.425+0000 7f4185e00640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41640678c0 0x7f4164069d80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f41880b1780 tx=0x7f4178008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:14.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.429+0000 7f417ea00640 1 -- 172.21.15.5:0/1026362321 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f41800c6030 con 0x7f418815b010 2024-08-18T22:25:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.633+0000 7f418ca00640 1 -- 172.21.15.5:0/1026362321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f418814eff0 con 0x7f418815b010 2024-08-18T22:25:14.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.633+0000 7f417ea00640 1 -- 172.21.15.5:0/1026362321 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5221 (secure 0 0 0) 0x7f41880ae780 con 0x7f418815b010 2024-08-18T22:25:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:14.635 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"btime":"2024-08-18T22:25:02:956485+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1436391401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1436391401},{"type":"v1","addr":"172.21.15.117:6835","nonce":1436391401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/643889741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":643889741},{"type":"v1","addr":"172.21.15.117:6837","nonce":643889741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2830021009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2830021009},{"type":"v1","addr":"172.21.15.5:6833","nonce":2830021009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:24:39.405470+0000","modified":"2024-08-18T22:25:02.956480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/580352313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":580352313},{"type":"v1","addr":"172.21.15.5:6835","nonce":580352313}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7485,"qdb_cluster":[7485]},"id":6}]} 2024-08-18T22:25:14.636 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 81 2024-08-18T22:25:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 -- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41640678c0 msgr2=0x7f4164069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41640678c0 0x7f4164069d80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f41880b1780 tx=0x7f4178008040 comp rx=0 tx=0).stop 2024-08-18T22:25:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 -- 172.21.15.5:0/1026362321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f418815b010 msgr2=0x7f418809cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f418815b010 0x7f418809cc50 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f41800195d0 tx=0x7f4180019760 comp rx=0 tx=0).stop 2024-08-18T22:25:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 -- 172.21.15.5:0/1026362321 shutdown_connections 2024-08-18T22:25:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41640678c0 0x7f4164069d80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f418815b010 0x7f418809cc50 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41880cd3a0 0x7f4188151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 --2- 172.21.15.5:0/1026362321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f418806f290 0x7f41880ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 -- 172.21.15.5:0/1026362321 >> 172.21.15.5:0/1026362321 conn(0x7f41880b1c50 msgr2=0x7f418814f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:14.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 -- 172.21.15.5:0/1026362321 shutdown_connections 2024-08-18T22:25:14.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.637+0000 7f418ca00640 1 -- 172.21.15.5:0/1026362321 wait complete. 2024-08-18T22:25:14.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:25:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.801+0000 7f971fc00640 1 Processor -- start 2024-08-18T22:25:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.801+0000 7f971fc00640 1 -- start start 2024-08-18T22:25:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.801+0000 7f971fc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f97180b4e40 0x7f97180b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.801+0000 7f971fc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97180b65d0 con 0x7f971815e140 2024-08-18T22:25:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.801+0000 7f971fc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97180b68b0 con 0x7f97180afe50 2024-08-18T22:25:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.801+0000 7f971fc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f97180b52a0 con 0x7f97180b4e40 2024-08-18T22:25:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.801+0000 7f971d200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f971815e140 0x7f97180af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46660/0 (socket says 172.21.15.5:46660) 2024-08-18T22:25:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.801+0000 7f971d200640 1 -- 172.21.15.5:0/2376289746 learned_addr learned my addr 172.21.15.5:0/2376289746 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.801+0000 7f971dc00640 1 --2- 172.21.15.5:0/2376289746 >> v2:172.21.15.117:3300/0 conn(0x7f97180b4e40 0x7f97180b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.801+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161496015 0 0) 0x7f97180b65d0 con 0x7f971815e140 2024-08-18T22:25:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.801+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96fc003530 con 0x7f971815e140 2024-08-18T22:25:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4079136592 0 0) 0x7f96fc003530 con 0x7f971815e140 2024-08-18T22:25:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 >> v2:172.21.15.117:3300/0 conn(0x7f97180b4e40 msgr2=0x7f97180b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 --2- 172.21.15.5:0/2376289746 >> v2:172.21.15.117:3300/0 conn(0x7f97180b4e40 0x7f97180b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 >> v1:172.21.15.117:6789/0 conn(0x7f97180afe50 legacy=0x7f971806efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971806e7b0 con 0x7f971815e140 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f9708001680 con 0x7f971815e140 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 >> v1:172.21.15.5:6789/0 conn(0x7f971815e140 legacy=0x7f97180af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 --2- 172.21.15.5:0/2376289746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96fc0039c0 0x7f96fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 --2- 172.21.15.5:0/2376289746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96fc004810 0x7f96fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 --2- 172.21.15.5:0/2376289746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96fc0051d0 0x7f96fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f97180b52a0 con 0x7f96fc0051d0 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc00c170 con 0x7f96fc0039c0 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f96fc00c370 con 0x7f96fc004810 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f971dc00640 1 --2- 172.21.15.5:0/2376289746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96fc0051d0 0x7f96fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f971d200640 1 --2- 172.21.15.5:0/2376289746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96fc0039c0 0x7f96fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f9717e00640 1 --2- 172.21.15.5:0/2376289746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96fc004810 0x7f96fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f971dc00640 1 -- 172.21.15.5:0/2376289746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96fc004810 msgr2=0x7f96fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f971dc00640 1 --2- 172.21.15.5:0/2376289746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96fc004810 0x7f96fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f971dc00640 1 -- 172.21.15.5:0/2376289746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96fc0039c0 msgr2=0x7f96fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f971dc00640 1 --2- 172.21.15.5:0/2376289746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96fc0039c0 0x7f96fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f971dc00640 1 -- 172.21.15.5:0/2376289746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96fc003530 con 0x7f96fc0051d0 2024-08-18T22:25:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f971dc00640 1 -- 172.21.15.5:0/2376289746 reap_dead start 2024-08-18T22:25:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.805+0000 7f971dc00640 1 --2- 172.21.15.5:0/2376289746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96fc0051d0 0x7f96fc00b9d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f9710009fc0 tx=0x7f971001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0e352e5755fe99 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710009c10 con 0x7f96fc0051d0 2024-08-18T22:25:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97100a5c30 con 0x7f96fc0051d0 2024-08-18T22:25:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f9717400640 1 -- 172.21.15.5:0/2376289746 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97100039a0 con 0x7f96fc0051d0 2024-08-18T22:25:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 -- 172.21.15.5:0/2376289746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96fc0051d0 msgr2=0x7f96fc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 --2- 172.21.15.5:0/2376289746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96fc0051d0 0x7f96fc00b9d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f9710009fc0 tx=0x7f971001ccc0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 -- 172.21.15.5:0/2376289746 shutdown_connections 2024-08-18T22:25:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 --2- 172.21.15.5:0/2376289746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96fc0051d0 0x7f96fc00b9d0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 -- 172.21.15.5:0/2376289746 >> 172.21.15.5:0/2376289746 conn(0x7f971806b9b0 msgr2=0x7f971806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 -- 172.21.15.5:0/2376289746 shutdown_connections 2024-08-18T22:25:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 -- 172.21.15.5:0/2376289746 wait complete. 2024-08-18T22:25:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 Processor -- start 2024-08-18T22:25:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 -- start start 2024-08-18T22:25:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96fc0051d0 0x7f971815f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f971814cf40 0x7f9718160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97181e9ea0 0x7f97181ea320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f971815e520 con 0x7f97181e9ea0 2024-08-18T22:25:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f971806e560 con 0x7f96fc0051d0 2024-08-18T22:25:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971fc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f971815e6a0 con 0x7f971814cf40 2024-08-18T22:25:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97181e9ea0 0x7f97181ea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97181e9ea0 0x7f97181ea320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37308/0 (socket says 172.21.15.5:37308) 2024-08-18T22:25:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971dc00640 1 -- 172.21.15.5:0/3910575969 learned_addr learned my addr 172.21.15.5:0/3910575969 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f9717e00640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f971814cf40 0x7f9718160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.809+0000 7f971d200640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96fc0051d0 0x7f971815f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f971dc00640 1 -- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f971814cf40 msgr2=0x7f9718160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f971dc00640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f971814cf40 0x7f9718160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f971dc00640 1 -- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96fc0051d0 msgr2=0x7f971815f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f971dc00640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96fc0051d0 0x7f971815f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f971dc00640 1 -- 172.21.15.5:0/3910575969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971814d7e0 con 0x7f97181e9ea0 2024-08-18T22:25:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f971d200640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96fc0051d0 0x7f971815f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f971dc00640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97181e9ea0 0x7f97181ea320 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9710098710 tx=0x7f9710009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f9714c00640 1 -- 172.21.15.5:0/3910575969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97100039a0 con 0x7f97181e9ea0 2024-08-18T22:25:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f9714c00640 1 -- 172.21.15.5:0/3910575969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97100bd070 con 0x7f97181e9ea0 2024-08-18T22:25:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f9714c00640 1 -- 172.21.15.5:0/3910575969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710003d40 con 0x7f97181e9ea0 2024-08-18T22:25:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f971fc00640 1 -- 172.21.15.5:0/3910575969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97181610d0 con 0x7f97181e9ea0 2024-08-18T22:25:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f971fc00640 1 -- 172.21.15.5:0/3910575969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9718161690 con 0x7f97181e9ea0 2024-08-18T22:25:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f971fc00640 1 -- 172.21.15.5:0/3910575969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97180af7d0 con 0x7f97181e9ea0 2024-08-18T22:25:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f9714c00640 1 -- 172.21.15.5:0/3910575969 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97100ae930 con 0x7f97181e9ea0 2024-08-18T22:25:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f9714c00640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96f80678f0 0x7f96f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f9714c00640 1 -- 172.21.15.5:0/3910575969 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7f9710121510 con 0x7f97181e9ea0 2024-08-18T22:25:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.813+0000 7f971d200640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96f80678f0 0x7f96f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.817+0000 7f971d200640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96f80678f0 0x7f96f8069db0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9708000c10 tx=0x7f9708009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.817+0000 7f9714c00640 1 -- 172.21.15.5:0/3910575969 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f971814d7e0 con 0x7f97181e9ea0 2024-08-18T22:25:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.985+0000 7f971fc00640 1 -- 172.21.15.5:0/3910575969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97180b5ed0 con 0x7f97181e9ea0 2024-08-18T22:25:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.985+0000 7f9714c00640 1 -- 172.21.15.5:0/3910575969 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+17268 (secure 0 0 0) 0x7f97100169d0 con 0x7f97181e9ea0 2024-08-18T22:25:14.988 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:14.988 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":103,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:25:04.596732+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:24:37.136051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-08-18T22:24:38.401283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.a","mappings":[{"from":1,"to":7}]},{"pgid":"14.18","mappings":[{"from":1,"to":2}]},{"pgid":"14.32","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6837/314902070":"2024-08-19T22:24:59.944539+0000","172.21.15.117:6835/314902070":"2024-08-19T22:24:59.944539+0000","172.21.15.5:6835/3668199286":"2024-08-19T22:24:54.562505+0000","172.21.15.5:6834/3668199286":"2024-08-19T22:24:54.562505+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:25:14.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 -- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96f80678f0 msgr2=0x7f96f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96f80678f0 0x7f96f8069db0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9708000c10 tx=0x7f9708009040 comp rx=0 tx=0).stop 2024-08-18T22:25:14.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 -- 172.21.15.5:0/3910575969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97181e9ea0 msgr2=0x7f97181ea320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:14.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97181e9ea0 0x7f97181ea320 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9710098710 tx=0x7f9710009750 comp rx=0 tx=0).stop 2024-08-18T22:25:14.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 -- 172.21.15.5:0/3910575969 shutdown_connections 2024-08-18T22:25:14.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96f80678f0 0x7f96f8069db0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97181e9ea0 0x7f97181ea320 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f971814cf40 0x7f9718160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 --2- 172.21.15.5:0/3910575969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96fc0051d0 0x7f971815f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:14.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 -- 172.21.15.5:0/3910575969 >> 172.21.15.5:0/3910575969 conn(0x7f971806b9b0 msgr2=0x7f97180ae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:14.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 -- 172.21.15.5:0/3910575969 shutdown_connections 2024-08-18T22:25:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:14.989+0000 7f971fc00640 1 -- 172.21.15.5:0/3910575969 wait complete. 2024-08-18T22:25:15.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:25:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.149+0000 7ff55f600640 1 Processor -- start 2024-08-18T22:25:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.149+0000 7ff55f600640 1 -- start start 2024-08-18T22:25:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55815b0c0 0x7ff55806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55f600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5580cf290 0x7ff5580b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55f600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5580b31f0 con 0x7ff5580b40c0 2024-08-18T22:25:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55f600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff5580b3d70 con 0x7ff5580cf290 2024-08-18T22:25:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff5580b4a40 con 0x7ff55815b0c0 2024-08-18T22:25:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55d600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5580cf290 0x7ff5580b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55d600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5580cf290 0x7ff5580b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37320/0 (socket says 172.21.15.5:37320) 2024-08-18T22:25:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55d600640 1 -- 172.21.15.5:0/3605574982 learned_addr learned my addr 172.21.15.5:0/3605574982 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55cc00640 1 --2- 172.21.15.5:0/3605574982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55815b0c0 0x7ff55806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55d600640 1 -- 172.21.15.5:0/3605574982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55815b0c0 msgr2=0x7ff55806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55d600640 1 --2- 172.21.15.5:0/3605574982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55815b0c0 0x7ff55806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55d600640 1 -- 172.21.15.5:0/3605574982 >> v1:172.21.15.117:6789/0 conn(0x7ff5580b40c0 legacy=0x7ff558072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.153+0000 7ff55d600640 1 -- 172.21.15.5:0/3605574982 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5580b34d0 con 0x7ff5580cf290 2024-08-18T22:25:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55d600640 1 --2- 172.21.15.5:0/3605574982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5580cf290 0x7ff5580b4500 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff550009e50 tx=0x7ff55001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bf79e0c4b7b600 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff557e00640 1 -- 172.21.15.5:0/3605574982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5500a5720 con 0x7ff5580cf290 2024-08-18T22:25:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff557e00640 1 -- 172.21.15.5:0/3605574982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5500a58c0 con 0x7ff5580cf290 2024-08-18T22:25:15.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff557e00640 1 -- 172.21.15.5:0/3605574982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5500a5c90 con 0x7ff5580cf290 2024-08-18T22:25:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 -- 172.21.15.5:0/3605574982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5580cf290 msgr2=0x7ff5580b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 --2- 172.21.15.5:0/3605574982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5580cf290 0x7ff5580b4500 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff550009e50 tx=0x7ff55001c8a0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 -- 172.21.15.5:0/3605574982 shutdown_connections 2024-08-18T22:25:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 --2- 172.21.15.5:0/3605574982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5580cf290 0x7ff5580b4500 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 --2- 172.21.15.5:0/3605574982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55815b0c0 0x7ff55806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 -- 172.21.15.5:0/3605574982 >> 172.21.15.5:0/3605574982 conn(0x7ff5580b1dc0 msgr2=0x7ff5580b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 -- 172.21.15.5:0/3605574982 shutdown_connections 2024-08-18T22:25:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 -- 172.21.15.5:0/3605574982 wait complete. 2024-08-18T22:25:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 Processor -- start 2024-08-18T22:25:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 -- start start 2024-08-18T22:25:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5580b40c0 0x7ff55814fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5580cf290 0x7ff558150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55815b0c0 0x7ff55809d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff55815b620 con 0x7ff55815b0c0 2024-08-18T22:25:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff55815b4a0 con 0x7ff5580b40c0 2024-08-18T22:25:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff55806f670 con 0x7ff5580cf290 2024-08-18T22:25:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.157+0000 7ff55d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55815b0c0 0x7ff55809d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55815b0c0 0x7ff55809d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37334/0 (socket says 172.21.15.5:37334) 2024-08-18T22:25:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55d600640 1 -- 172.21.15.5:0/846079821 learned_addr learned my addr 172.21.15.5:0/846079821 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55cc00640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5580b40c0 0x7ff55814fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff54fe00640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5580cf290 0x7ff558150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55d600640 1 -- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5580cf290 msgr2=0x7ff558150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55d600640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5580cf290 0x7ff558150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55d600640 1 -- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5580b40c0 msgr2=0x7ff55814fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55d600640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5580b40c0 0x7ff55814fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55d600640 1 -- 172.21.15.5:0/846079821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff558152690 con 0x7ff55815b0c0 2024-08-18T22:25:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55d600640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55815b0c0 0x7ff55809d150 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff5500af040 tx=0x7ff550019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff555600640 1 -- 172.21.15.5:0/846079821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5500bc020 con 0x7ff55815b0c0 2024-08-18T22:25:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff555600640 1 -- 172.21.15.5:0/846079821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5500b8670 con 0x7ff55815b0c0 2024-08-18T22:25:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff555600640 1 -- 172.21.15.5:0/846079821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5500b8a60 con 0x7ff55815b0c0 2024-08-18T22:25:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55f600640 1 -- 172.21.15.5:0/846079821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5581523b0 con 0x7ff55815b0c0 2024-08-18T22:25:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55f600640 1 -- 172.21.15.5:0/846079821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff55809cc30 con 0x7ff55815b0c0 2024-08-18T22:25:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff55f600640 1 -- 172.21.15.5:0/846079821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5580b4500 con 0x7ff55815b0c0 2024-08-18T22:25:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff555600640 1 -- 172.21.15.5:0/846079821 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5500bf020 con 0x7ff55815b0c0 2024-08-18T22:25:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.161+0000 7ff555600640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5340678c0 0x7ff534069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.165+0000 7ff555600640 1 -- 172.21.15.5:0/846079821 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6389+0+0 (secure 0 0 0) 0x7ff550120f30 con 0x7ff55815b0c0 2024-08-18T22:25:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.165+0000 7ff55cc00640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5340678c0 0x7ff534069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.165+0000 7ff55cc00640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5340678c0 0x7ff534069d80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff5480079c0 tx=0x7ff548008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.165+0000 7ff555600640 1 -- 172.21.15.5:0/846079821 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff5500c6030 con 0x7ff55815b0c0 2024-08-18T22:25:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.365+0000 7ff55f600640 1 -- 172.21.15.5:0/846079821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff55809ce00 con 0x7ff55815b0c0 2024-08-18T22:25:15.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:25:15.365+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:25:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.369+0000 7ff555600640 1 -- 172.21.15.5:0/846079821 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v82) ==== 161+0+0 (secure 0 0 0) 0x7ff5500165e0 con 0x7ff55815b0c0 2024-08-18T22:25:15.370 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:25:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 -- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5340678c0 msgr2=0x7ff534069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5340678c0 0x7ff534069d80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff5480079c0 tx=0x7ff548008040 comp rx=0 tx=0).stop 2024-08-18T22:25:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 -- 172.21.15.5:0/846079821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55815b0c0 msgr2=0x7ff55809d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55815b0c0 0x7ff55809d150 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff5500af040 tx=0x7ff550019640 comp rx=0 tx=0).stop 2024-08-18T22:25:15.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 -- 172.21.15.5:0/846079821 shutdown_connections 2024-08-18T22:25:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5340678c0 0x7ff534069d80 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55815b0c0 0x7ff55809d150 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5580cf290 0x7ff558150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 --2- 172.21.15.5:0/846079821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5580b40c0 0x7ff55814fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 -- 172.21.15.5:0/846079821 >> 172.21.15.5:0/846079821 conn(0x7ff5580b1dc0 msgr2=0x7ff5580ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 -- 172.21.15.5:0/846079821 shutdown_connections 2024-08-18T22:25:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.373+0000 7ff55f600640 1 -- 172.21.15.5:0/846079821 wait complete. 2024-08-18T22:25:15.378 INFO:tasks.ceph.mds.c.smithi005.stderr: -1456> 2024-08-18T22:25:05.577+0000 7f9f10000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:25:15.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:25:15.421 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:25:15.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.537+0000 7f4802800640 1 Processor -- start 2024-08-18T22:25:15.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.537+0000 7f4802800640 1 -- start start 2024-08-18T22:25:15.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f4802800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47fc09aca0 0x7f47fc0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f4802800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47fc09b080 0x7f47fc0b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f4802800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47fc06e8a0 con 0x7f47fc0b1300 2024-08-18T22:25:15.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f4802800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f47fc09bb80 con 0x7f47fc09aca0 2024-08-18T22:25:15.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f4802800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f47fc0d2e40 con 0x7f47fc09b080 2024-08-18T22:25:15.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f47fb400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47fc09aca0 0x7f47fc0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f47fbe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47fc09b080 0x7f47fc0b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f47f2a00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f47fc0b1300 0x7f47fc0affd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:42434/0 (socket says 172.21.15.5:42434) 2024-08-18T22:25:15.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f47f2a00640 1 -- 172.21.15.5:0/3192521088 learned_addr learned my addr 172.21.15.5:0/3192521088 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:15.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f47fbe00640 1 -- 172.21.15.5:0/3192521088 >> v2:172.21.15.117:3300/0 conn(0x7f47fc09aca0 msgr2=0x7f47fc0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:15.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f47fbe00640 1 --2- 172.21.15.5:0/3192521088 >> v2:172.21.15.117:3300/0 conn(0x7f47fc09aca0 0x7f47fc0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f47fbe00640 1 -- 172.21.15.5:0/3192521088 >> v1:172.21.15.117:6789/0 conn(0x7f47fc0b1300 legacy=0x7f47fc0affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:15.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f47fbe00640 1 -- 172.21.15.5:0/3192521088 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc06cbd0 con 0x7f47fc09b080 2024-08-18T22:25:15.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.541+0000 7f47fb400640 1 --2- 172.21.15.5:0/3192521088 >> v2:172.21.15.117:3300/0 conn(0x7f47fc09aca0 0x7f47fc0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:25:15.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f47fbe00640 1 --2- 172.21.15.5:0/3192521088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47fc09b080 0x7f47fc0b06e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009d90 tx=0x7f47f401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34fafbc5bf63d2e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:15.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f47faa00640 1 -- 172.21.15.5:0/3192521088 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f40b2070 con 0x7f47fc09b080 2024-08-18T22:25:15.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f47faa00640 1 -- 172.21.15.5:0/3192521088 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f40a58e0 con 0x7f47fc09b080 2024-08-18T22:25:15.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f47faa00640 1 -- 172.21.15.5:0/3192521088 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f40a5cb0 con 0x7f47fc09b080 2024-08-18T22:25:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f4802800640 1 -- 172.21.15.5:0/3192521088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47fc09b080 msgr2=0x7f47fc0b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f4802800640 1 --2- 172.21.15.5:0/3192521088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47fc09b080 0x7f47fc0b06e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009d90 tx=0x7f47f401c970 comp rx=0 tx=0).stop 2024-08-18T22:25:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f4802800640 1 -- 172.21.15.5:0/3192521088 shutdown_connections 2024-08-18T22:25:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f4802800640 1 --2- 172.21.15.5:0/3192521088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47fc09b080 0x7f47fc0b06e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f4802800640 1 --2- 172.21.15.5:0/3192521088 >> v2:172.21.15.117:3300/0 conn(0x7f47fc09aca0 0x7f47fc0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f4802800640 1 -- 172.21.15.5:0/3192521088 >> 172.21.15.5:0/3192521088 conn(0x7f47fc0d2180 msgr2=0x7f47fc0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f4802800640 1 -- 172.21.15.5:0/3192521088 shutdown_connections 2024-08-18T22:25:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f4802800640 1 -- 172.21.15.5:0/3192521088 wait complete. 2024-08-18T22:25:15.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f4802800640 1 Processor -- start 2024-08-18T22:25:15.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.545+0000 7f4802800640 1 -- start start 2024-08-18T22:25:15.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f4802800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47fc09aca0 0x7f47fc0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f4802800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47fc09b080 0x7f47fc161db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f4802800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47fc0b1300 0x7f47fc0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f4802800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc16b6b0 con 0x7f47fc0b1300 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f4802800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc16b530 con 0x7f47fc09b080 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f4802800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f47fc16b830 con 0x7f47fc09aca0 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47fbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47fc0b1300 0x7f47fc0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47fbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47fc0b1300 0x7f47fc0b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37356/0 (socket says 172.21.15.5:37356) 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47fbe00640 1 -- 172.21.15.5:0/1624839409 learned_addr learned my addr 172.21.15.5:0/1624839409 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47f2a00640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47fc09b080 0x7f47fc161db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47fb400640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47fc09aca0 0x7f47fc0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47fbe00640 1 -- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47fc09aca0 msgr2=0x7f47fc0b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47fbe00640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47fc09aca0 0x7f47fc0b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47fbe00640 1 -- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47fc09b080 msgr2=0x7f47fc161db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47fbe00640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47fc09b080 0x7f47fc161db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47fbe00640 1 -- 172.21.15.5:0/1624839409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc1579e0 con 0x7f47fc0b1300 2024-08-18T22:25:15.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47fbe00640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47fc0b1300 0x7f47fc0b21f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f47f401b020 tx=0x7f47f4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:15.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47f3e00640 1 -- 172.21.15.5:0/1624839409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f40b2050 con 0x7f47fc0b1300 2024-08-18T22:25:15.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47f3e00640 1 -- 172.21.15.5:0/1624839409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f40be070 con 0x7f47fc0b1300 2024-08-18T22:25:15.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f4802800640 1 -- 172.21.15.5:0/1624839409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47fc0b34d0 con 0x7f47fc0b1300 2024-08-18T22:25:15.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47f3e00640 1 -- 172.21.15.5:0/1624839409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4009450 con 0x7f47fc0b1300 2024-08-18T22:25:15.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f4802800640 1 -- 172.21.15.5:0/1624839409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47fc0b3770 con 0x7f47fc0b1300 2024-08-18T22:25:15.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f4802800640 1 -- 172.21.15.5:0/1624839409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47fc161940 con 0x7f47fc0b1300 2024-08-18T22:25:15.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.549+0000 7f47f3e00640 1 -- 172.21.15.5:0/1624839409 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47f40adc00 con 0x7f47fc0b1300 2024-08-18T22:25:15.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.553+0000 7f47f3e00640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47d80678c0 0x7f47d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:15.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.553+0000 7f47f3e00640 1 -- 172.21.15.5:0/1624839409 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6475+0+0 (secure 0 0 0) 0x7f47f4121240 con 0x7f47fc0b1300 2024-08-18T22:25:15.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.553+0000 7f47fb400640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47d80678c0 0x7f47d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:15.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.553+0000 7f47fb400640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47d80678c0 0x7f47d8069d80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009580 tx=0x7f47ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:15.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.557+0000 7f47f3e00640 1 -- 172.21.15.5:0/1624839409 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f47f4016560 con 0x7f47fc0b1300 2024-08-18T22:25:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:15.757+0000 7f4802800640 1 -- 172.21.15.5:0/1624839409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f47fc0cecf0 con 0x7f47fc0b1300 2024-08-18T22:25:16.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f47f3e00640 1 -- 172.21.15.5:0/1624839409 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v83) ==== 104+0+0 (secure 0 0 0) 0x7f47f40f19e0 con 0x7f47fc0b1300 2024-08-18T22:25:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 -- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47d80678c0 msgr2=0x7f47d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47d80678c0 0x7f47d8069d80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009580 tx=0x7f47ec008040 comp rx=0 tx=0).stop 2024-08-18T22:25:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 -- 172.21.15.5:0/1624839409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47fc0b1300 msgr2=0x7f47fc0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47fc0b1300 0x7f47fc0b21f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f47f401b020 tx=0x7f47f4019710 comp rx=0 tx=0).stop 2024-08-18T22:25:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 -- 172.21.15.5:0/1624839409 shutdown_connections 2024-08-18T22:25:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47d80678c0 0x7f47d8069d80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47fc0b1300 0x7f47fc0b21f0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47fc09b080 0x7f47fc161db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 --2- 172.21.15.5:0/1624839409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47fc09aca0 0x7f47fc0b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 -- 172.21.15.5:0/1624839409 >> 172.21.15.5:0/1624839409 conn(0x7f47fc0d2180 msgr2=0x7f47fc151c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:16.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 -- 172.21.15.5:0/1624839409 shutdown_connections 2024-08-18T22:25:16.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.373+0000 7f4802800640 1 -- 172.21.15.5:0/1624839409 wait complete. 2024-08-18T22:25:16.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:25:16.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.589+0000 7fbbb4c00640 1 Processor -- start 2024-08-18T22:25:16.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.589+0000 7fbbb4c00640 1 -- start start 2024-08-18T22:25:16.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbb4c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbbb00cf020 0x7fbbb00cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:16.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbb4c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb0072e80 0x7fbbb006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:16.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbb4c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbb00cf940 con 0x7fbbb0072a20 2024-08-18T22:25:16.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbb4c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbbb00b4c30 con 0x7fbbb00cf020 2024-08-18T22:25:16.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbb4c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb0073310 con 0x7fbbb0072e80 2024-08-18T22:25:16.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbade00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbbb00cf020 0x7fbbb00cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:16.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbade00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbbb00cf020 0x7fbbb00cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37368/0 (socket says 172.21.15.5:37368) 2024-08-18T22:25:16.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbade00640 1 -- 172.21.15.5:0/4121811700 learned_addr learned my addr 172.21.15.5:0/4121811700 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:16.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbae800640 1 --2- 172.21.15.5:0/4121811700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb0072e80 0x7fbbb006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:16.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbade00640 1 -- 172.21.15.5:0/4121811700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb0072e80 msgr2=0x7fbbb006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:16.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbade00640 1 --2- 172.21.15.5:0/4121811700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb0072e80 0x7fbbb006f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:16.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbade00640 1 -- 172.21.15.5:0/4121811700 >> v1:172.21.15.117:6789/0 conn(0x7fbbb0072a20 legacy=0x7fbbb006ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:16.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbade00640 1 -- 172.21.15.5:0/4121811700 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb00735e0 con 0x7fbbb00cf020 2024-08-18T22:25:16.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbae800640 1 --2- 172.21.15.5:0/4121811700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb0072e80 0x7fbbb006f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:16.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.593+0000 7fbbade00640 1 --2- 172.21.15.5:0/4121811700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb00cf020 0x7fbbb00cf400 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fbba00098a0 tx=0x7fbba001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a97365fb0adf0e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:16.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbaca00640 1 -- 172.21.15.5:0/4121811700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba00aa5f0 con 0x7fbbb00cf020 2024-08-18T22:25:16.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbaca00640 1 -- 172.21.15.5:0/4121811700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba00af070 con 0x7fbbb00cf020 2024-08-18T22:25:16.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbaca00640 1 -- 172.21.15.5:0/4121811700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba00aa9b0 con 0x7fbbb00cf020 2024-08-18T22:25:16.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 -- 172.21.15.5:0/4121811700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb00cf020 msgr2=0x7fbbb00cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:16.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 --2- 172.21.15.5:0/4121811700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb00cf020 0x7fbbb00cf400 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fbba00098a0 tx=0x7fbba001c4d0 comp rx=0 tx=0).stop 2024-08-18T22:25:16.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 -- 172.21.15.5:0/4121811700 shutdown_connections 2024-08-18T22:25:16.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 --2- 172.21.15.5:0/4121811700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb0072e80 0x7fbbb006f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:16.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 --2- 172.21.15.5:0/4121811700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb00cf020 0x7fbbb00cf400 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:16.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 -- 172.21.15.5:0/4121811700 >> 172.21.15.5:0/4121811700 conn(0x7fbbb006b9b0 msgr2=0x7fbbb006bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:16.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 -- 172.21.15.5:0/4121811700 shutdown_connections 2024-08-18T22:25:16.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 -- 172.21.15.5:0/4121811700 wait complete. 2024-08-18T22:25:16.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 Processor -- start 2024-08-18T22:25:16.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 -- start start 2024-08-18T22:25:16.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb0072a20 0x7fbbb00b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb0072e80 0x7fbbb009dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb00cf020 0x7fbbb0158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb006e3e0 con 0x7fbbb0072e80 2024-08-18T22:25:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb0073e80 con 0x7fbbb0072a20 2024-08-18T22:25:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbb4c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb01558e0 con 0x7fbbb00cf020 2024-08-18T22:25:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbad400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb0072e80 0x7fbbb009dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbad400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb0072e80 0x7fbbb009dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37374/0 (socket says 172.21.15.5:37374) 2024-08-18T22:25:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbad400640 1 -- 172.21.15.5:0/1156406570 learned_addr learned my addr 172.21.15.5:0/1156406570 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbade00640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb0072a20 0x7fbbb00b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:16.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbae800640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb00cf020 0x7fbbb0158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbad400640 1 -- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb00cf020 msgr2=0x7fbbb0158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbad400640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb00cf020 0x7fbbb0158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbad400640 1 -- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb0072a20 msgr2=0x7fbbb00b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbad400640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb0072a20 0x7fbbb00b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.597+0000 7fbbad400640 1 -- 172.21.15.5:0/1156406570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb0168630 con 0x7fbbb0072e80 2024-08-18T22:25:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.601+0000 7fbbad400640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb0072e80 0x7fbbb009dcc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00c450 tx=0x7fbb9c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.601+0000 7fbba6000640 1 -- 172.21.15.5:0/1156406570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c012830 con 0x7fbbb0072e80 2024-08-18T22:25:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.601+0000 7fbba6000640 1 -- 172.21.15.5:0/1156406570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c017070 con 0x7fbbb0072e80 2024-08-18T22:25:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.601+0000 7fbba6000640 1 -- 172.21.15.5:0/1156406570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c012c30 con 0x7fbbb0072e80 2024-08-18T22:25:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.601+0000 7fbbb4c00640 1 -- 172.21.15.5:0/1156406570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb0147740 con 0x7fbbb0072e80 2024-08-18T22:25:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.601+0000 7fbbb4c00640 1 -- 172.21.15.5:0/1156406570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb0168b80 con 0x7fbbb0072e80 2024-08-18T22:25:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.601+0000 7fbbb4c00640 1 -- 172.21.15.5:0/1156406570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb015c760 con 0x7fbbb0072e80 2024-08-18T22:25:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.601+0000 7fbba6000640 1 -- 172.21.15.5:0/1156406570 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbb9c01c460 con 0x7fbbb0072e80 2024-08-18T22:25:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.601+0000 7fbba6000640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb90067910 0x7fbb90069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.601+0000 7fbba6000640 1 -- 172.21.15.5:0/1156406570 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6475+0+0 (secure 0 0 0) 0x7fbb9c085be0 con 0x7fbbb0072e80 2024-08-18T22:25:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.601+0000 7fbbade00640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb90067910 0x7fbb90069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.605+0000 7fbbade00640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb90067910 0x7fbb90069dd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbba00ae000 tx=0x7fbba00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.605+0000 7fbba6000640 1 -- 172.21.15.5:0/1156406570 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbb9c056490 con 0x7fbbb0072e80 2024-08-18T22:25:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:16.773+0000 7fbbb4c00640 1 -- 172.21.15.5:0/1156406570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbbb0154840 con 0x7fbbb0072e80 2024-08-18T22:25:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.661+0000 7fbba6000640 1 -- 172.21.15.5:0/1156406570 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) ==== 181+0+0 (secure 0 0 0) 0x7fbb9c055d90 con 0x7fbbb0072e80 2024-08-18T22:25:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:25:17.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 -- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb90067910 msgr2=0x7fbb90069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:17.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb90067910 0x7fbb90069dd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbba00ae000 tx=0x7fbba00a7000 comp rx=0 tx=0).stop 2024-08-18T22:25:17.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 -- 172.21.15.5:0/1156406570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb0072e80 msgr2=0x7fbbb009dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:17.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb0072e80 0x7fbbb009dcc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00c450 tx=0x7fbb9c00c910 comp rx=0 tx=0).stop 2024-08-18T22:25:17.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 -- 172.21.15.5:0/1156406570 shutdown_connections 2024-08-18T22:25:17.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb90067910 0x7fbb90069dd0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:17.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb00cf020 0x7fbbb0158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:17.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb0072e80 0x7fbbb009dcc0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:17.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 --2- 172.21.15.5:0/1156406570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb0072a20 0x7fbbb00b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:17.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 -- 172.21.15.5:0/1156406570 >> 172.21.15.5:0/1156406570 conn(0x7fbbb006b9b0 msgr2=0x7fbbb006ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:17.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 -- 172.21.15.5:0/1156406570 shutdown_connections 2024-08-18T22:25:17.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.665+0000 7fbbb4c00640 1 -- 172.21.15.5:0/1156406570 wait complete. 2024-08-18T22:25:17.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:25:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.837+0000 7fe5e5600640 1 Processor -- start 2024-08-18T22:25:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.837+0000 7fe5e5600640 1 -- start start 2024-08-18T22:25:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5e5600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe5e00cf760 0x7fe5e015d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5e5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e006dc60 0x7fe5e006e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5e5600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e00b3260 con 0x7fe5e00ccaa0 2024-08-18T22:25:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5e5600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e00cfe90 con 0x7fe5e00cf760 2024-08-18T22:25:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5e5600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e00b37e0 con 0x7fe5e006dc60 2024-08-18T22:25:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5df400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e006dc60 0x7fe5e006e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5de000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe5e00cf760 0x7fe5e015d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5df400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e006dc60 0x7fe5e006e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:39332/0 (socket says 172.21.15.5:39332) 2024-08-18T22:25:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5df400640 1 -- 172.21.15.5:0/4199662831 learned_addr learned my addr 172.21.15.5:0/4199662831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5de000640 1 -- 172.21.15.5:0/4199662831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e006dc60 msgr2=0x7fe5e006e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5de000640 1 --2- 172.21.15.5:0/4199662831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e006dc60 0x7fe5e006e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5de000640 1 -- 172.21.15.5:0/4199662831 >> v1:172.21.15.117:6789/0 conn(0x7fe5e00ccaa0 legacy=0x7fe5e00cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5de000640 1 -- 172.21.15.5:0/4199662831 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e00cfbc0 con 0x7fe5e00cf760 2024-08-18T22:25:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5df400640 1 --2- 172.21.15.5:0/4199662831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e006dc60 0x7fe5e006e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:25:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.841+0000 7fe5dd600640 1 -- 172.21.15.5:0/4199662831 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 341917212 0 0) 0x7fe5e00b3260 con 0x7fe5e00ccaa0 2024-08-18T22:25:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5de000640 1 --2- 172.21.15.5:0/4199662831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e00cf760 0x7fe5e015d1d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0097c0 tx=0x7fe5cc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f06e4e2671e41363 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5dd600640 1 -- 172.21.15.5:0/4199662831 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0b0070 con 0x7fe5e00cf760 2024-08-18T22:25:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5dd600640 1 -- 172.21.15.5:0/4199662831 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc0ab600 con 0x7fe5e00cf760 2024-08-18T22:25:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5dd600640 1 -- 172.21.15.5:0/4199662831 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0ab9d0 con 0x7fe5e00cf760 2024-08-18T22:25:17.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5e5600640 1 -- 172.21.15.5:0/4199662831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e00cf760 msgr2=0x7fe5e015d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:17.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5e5600640 1 --2- 172.21.15.5:0/4199662831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e00cf760 0x7fe5e015d1d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0097c0 tx=0x7fe5cc01c410 comp rx=0 tx=0).stop 2024-08-18T22:25:17.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5e5600640 1 -- 172.21.15.5:0/4199662831 shutdown_connections 2024-08-18T22:25:17.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5e5600640 1 --2- 172.21.15.5:0/4199662831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e006dc60 0x7fe5e006e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:17.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5e5600640 1 --2- 172.21.15.5:0/4199662831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e00cf760 0x7fe5e015d1d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:17.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5e5600640 1 -- 172.21.15.5:0/4199662831 >> 172.21.15.5:0/4199662831 conn(0x7fe5e006b9b0 msgr2=0x7fe5e006bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:17.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5e5600640 1 -- 172.21.15.5:0/4199662831 shutdown_connections 2024-08-18T22:25:17.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5e5600640 1 -- 172.21.15.5:0/4199662831 wait complete. 2024-08-18T22:25:17.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5e5600640 1 Processor -- start 2024-08-18T22:25:17.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.845+0000 7fe5e5600640 1 -- start start 2024-08-18T22:25:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5e5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e006dc60 0x7fe5e0150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5e5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e00ccaa0 0x7fe5e0150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5e5600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e00cf760 0x7fe5e0154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5e5600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0168e80 con 0x7fe5e006dc60 2024-08-18T22:25:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5e5600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0168d00 con 0x7fe5e00cf760 2024-08-18T22:25:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5e5600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e0169000 con 0x7fe5e00ccaa0 2024-08-18T22:25:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5dea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e006dc60 0x7fe5e0150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5dea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e006dc60 0x7fe5e0150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37378/0 (socket says 172.21.15.5:37378) 2024-08-18T22:25:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5dea00640 1 -- 172.21.15.5:0/3137466125 learned_addr learned my addr 172.21.15.5:0/3137466125 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5df400640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e00cf760 0x7fe5e0154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5de000640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e00ccaa0 0x7fe5e0150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5dea00640 1 -- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e00ccaa0 msgr2=0x7fe5e0150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5dea00640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e00ccaa0 0x7fe5e0150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5dea00640 1 -- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e00cf760 msgr2=0x7fe5e0154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5dea00640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e00cf760 0x7fe5e0154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5dea00640 1 -- 172.21.15.5:0/3137466125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e0150bc0 con 0x7fe5e006dc60 2024-08-18T22:25:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5de000640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e00ccaa0 0x7fe5e0150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5dea00640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e006dc60 0x7fe5e0150de0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0001ec0 tx=0x7fe5d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:17.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5d6a00640 1 -- 172.21.15.5:0/3137466125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0017070 con 0x7fe5e006dc60 2024-08-18T22:25:17.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5d6a00640 1 -- 172.21.15.5:0/3137466125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d0003600 con 0x7fe5e006dc60 2024-08-18T22:25:17.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5d6a00640 1 -- 172.21.15.5:0/3137466125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00039f0 con 0x7fe5e006dc60 2024-08-18T22:25:17.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5e5600640 1 -- 172.21.15.5:0/3137466125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e009c360 con 0x7fe5e006dc60 2024-08-18T22:25:17.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5e5600640 1 -- 172.21.15.5:0/3137466125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e009c920 con 0x7fe5e006dc60 2024-08-18T22:25:17.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.849+0000 7fe5e5600640 1 -- 172.21.15.5:0/3137466125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e015d1d0 con 0x7fe5e006dc60 2024-08-18T22:25:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.853+0000 7fe5d6a00640 1 -- 172.21.15.5:0/3137466125 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe5d001a070 con 0x7fe5e006dc60 2024-08-18T22:25:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.853+0000 7fe5d6a00640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5c00678f0 0x7fe5c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.853+0000 7fe5d6a00640 1 -- 172.21.15.5:0/3137466125 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6037+0+0 (secure 0 0 0) 0x7fe5d0085100 con 0x7fe5e006dc60 2024-08-18T22:25:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.853+0000 7fe5de000640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5c00678f0 0x7fe5c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.853+0000 7fe5de000640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5c00678f0 0x7fe5c0069db0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0ad000 tx=0x7fe5cc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:17.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:17.857+0000 7fe5d6a00640 1 -- 172.21.15.5:0/3137466125 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe5d00554a0 con 0x7fe5e006dc60 2024-08-18T22:25:18.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.029+0000 7fe5e5600640 1 -- 172.21.15.5:0/3137466125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe5e00b1370 con 0x7fe5e006dc60 2024-08-18T22:25:18.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.661+0000 7fe5d6a00640 1 -- 172.21.15.5:0/3137466125 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) ==== 169+0+0 (secure 0 0 0) 0x7fe5d00597a0 con 0x7fe5e006dc60 2024-08-18T22:25:18.663 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:25:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 -- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5c00678f0 msgr2=0x7fe5c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5c00678f0 0x7fe5c0069db0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0ad000 tx=0x7fe5cc0a6000 comp rx=0 tx=0).stop 2024-08-18T22:25:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 -- 172.21.15.5:0/3137466125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e006dc60 msgr2=0x7fe5e0150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e006dc60 0x7fe5e0150de0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0001ec0 tx=0x7fe5d000c8e0 comp rx=0 tx=0).stop 2024-08-18T22:25:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 -- 172.21.15.5:0/3137466125 shutdown_connections 2024-08-18T22:25:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5c00678f0 0x7fe5c0069db0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e00cf760 0x7fe5e0154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e00ccaa0 0x7fe5e0150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 --2- 172.21.15.5:0/3137466125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5e006dc60 0x7fe5e0150de0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 -- 172.21.15.5:0/3137466125 >> 172.21.15.5:0/3137466125 conn(0x7fe5e006b9b0 msgr2=0x7fe5e00cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 -- 172.21.15.5:0/3137466125 shutdown_connections 2024-08-18T22:25:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.665+0000 7fe5e5600640 1 -- 172.21.15.5:0/3137466125 wait complete. 2024-08-18T22:25:18.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-08-18T22:25:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18cb000640 1 Processor -- start 2024-08-18T22:25:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18cb000640 1 -- start start 2024-08-18T22:25:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18cb000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18c4156770 0x7f18c415d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18cb000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18c40b6020 0x7f18c40b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18cb000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c40b67e0 con 0x7f18c40b4650 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18cb000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f18c40b4ac0 con 0x7f18c40b6020 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18cb000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18c4156b50 con 0x7f18c4156770 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18c9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18c40b6020 0x7f18c40b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18ca600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f18c40b4650 0x7f18c406fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46674/0 (socket says 172.21.15.5:46674) 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18ca600640 1 -- 172.21.15.5:0/2133083014 learned_addr learned my addr 172.21.15.5:0/2133083014 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18c9c00640 1 --2- 172.21.15.5:0/2133083014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18c4156770 0x7f18c415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18c9200640 1 -- 172.21.15.5:0/2133083014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18c4156770 msgr2=0x7f18c415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18c9200640 1 --2- 172.21.15.5:0/2133083014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18c4156770 0x7f18c415d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18c9200640 1 -- 172.21.15.5:0/2133083014 >> v1:172.21.15.5:6789/0 conn(0x7f18c40b4650 legacy=0x7f18c406fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.841+0000 7f18c9200640 1 -- 172.21.15.5:0/2133083014 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c40b6ac0 con 0x7f18c40b6020 2024-08-18T22:25:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18c9200640 1 --2- 172.21.15.5:0/2133083014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40b6020 0x7f18c40b4110 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f18b00097c0 tx=0x7f18b001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63387ff097cebb0a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18c3e00640 1 -- 172.21.15.5:0/2133083014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00b0070 con 0x7f18c40b6020 2024-08-18T22:25:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18c3e00640 1 -- 172.21.15.5:0/2133083014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b00ab600 con 0x7f18c40b6020 2024-08-18T22:25:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18c3e00640 1 -- 172.21.15.5:0/2133083014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00ab9d0 con 0x7f18c40b6020 2024-08-18T22:25:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18cb000640 1 -- 172.21.15.5:0/2133083014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40b6020 msgr2=0x7f18c40b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18cb000640 1 --2- 172.21.15.5:0/2133083014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40b6020 0x7f18c40b4110 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f18b00097c0 tx=0x7f18b001c410 comp rx=0 tx=0).stop 2024-08-18T22:25:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18cb000640 1 -- 172.21.15.5:0/2133083014 shutdown_connections 2024-08-18T22:25:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18cb000640 1 --2- 172.21.15.5:0/2133083014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40b6020 0x7f18c40b4110 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18cb000640 1 --2- 172.21.15.5:0/2133083014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18c4156770 0x7f18c415d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18cb000640 1 -- 172.21.15.5:0/2133083014 >> 172.21.15.5:0/2133083014 conn(0x7f18c4067a70 msgr2=0x7f18c4067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18cb000640 1 -- 172.21.15.5:0/2133083014 shutdown_connections 2024-08-18T22:25:18.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.845+0000 7f18cb000640 1 -- 172.21.15.5:0/2133083014 wait complete. 2024-08-18T22:25:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18cb000640 1 Processor -- start 2024-08-18T22:25:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18cb000640 1 -- start start 2024-08-18T22:25:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18cb000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c40b4650 0x7f18c4153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18cb000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40b6020 0x7f18c41f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18cb000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18c4156770 0x7f18c4156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18cb000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18c4168c70 con 0x7f18c40b6020 2024-08-18T22:25:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18cb000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18c40b6480 con 0x7f18c40b4650 2024-08-18T22:25:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18cb000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18c4168df0 con 0x7f18c4156770 2024-08-18T22:25:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c9200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40b6020 0x7f18c41f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c9200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40b6020 0x7f18c41f7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37398/0 (socket says 172.21.15.5:37398) 2024-08-18T22:25:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c9200640 1 -- 172.21.15.5:0/3330772754 learned_addr learned my addr 172.21.15.5:0/3330772754 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18ca600640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18c4156770 0x7f18c4156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:18.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c9c00640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c40b4650 0x7f18c4153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c9200640 1 -- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18c4156770 msgr2=0x7f18c4156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c9200640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18c4156770 0x7f18c4156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c9200640 1 -- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c40b4650 msgr2=0x7f18c4153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c9200640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c40b4650 0x7f18c4153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c9200640 1 -- 172.21.15.5:0/3330772754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c41f7b40 con 0x7f18c40b6020 2024-08-18T22:25:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c9200640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40b6020 0x7f18c41f7600 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f18b001a040 tx=0x7f18b00191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c1600640 1 -- 172.21.15.5:0/3330772754 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00b8030 con 0x7f18c40b6020 2024-08-18T22:25:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c1600640 1 -- 172.21.15.5:0/3330772754 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b00ab400 con 0x7f18c40b6020 2024-08-18T22:25:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18cb000640 1 -- 172.21.15.5:0/3330772754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c4164ac0 con 0x7f18c40b6020 2024-08-18T22:25:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18c1600640 1 -- 172.21.15.5:0/3330772754 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00b0040 con 0x7f18c40b6020 2024-08-18T22:25:18.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.849+0000 7f18cb000640 1 -- 172.21.15.5:0/3330772754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c4165080 con 0x7f18c40b6020 2024-08-18T22:25:18.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.853+0000 7f18cb000640 1 -- 172.21.15.5:0/3330772754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c415c100 con 0x7f18c40b6020 2024-08-18T22:25:18.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.853+0000 7f18c1600640 1 -- 172.21.15.5:0/3330772754 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f18b00bb070 con 0x7f18c40b6020 2024-08-18T22:25:18.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.853+0000 7f18c1600640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a40678c0 0x7f18a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:18.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.853+0000 7f18c1600640 1 -- 172.21.15.5:0/3330772754 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5507+0+0 (secure 0 0 0) 0x7f18b011efe0 con 0x7f18c40b6020 2024-08-18T22:25:18.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.853+0000 7f18c9c00640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a40678c0 0x7f18a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:18.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.853+0000 7f18c9c00640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a40678c0 0x7f18a4069d80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f18b800b930 tx=0x7f18b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:18.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:18.857+0000 7f18c1600640 1 -- 172.21.15.5:0/3330772754 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f18b00c3020 con 0x7f18c40b6020 2024-08-18T22:25:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.025+0000 7f18cb000640 1 -- 172.21.15.5:0/3330772754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7f18c4067e50 con 0x7f18c40b6020 2024-08-18T22:25:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18c1600640 1 -- 172.21.15.5:0/3330772754 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v30) ==== 101+0+0 (secure 0 0 0) 0x7f18b0016090 con 0x7f18c40b6020 2024-08-18T22:25:19.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 -- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a40678c0 msgr2=0x7f18a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a40678c0 0x7f18a4069d80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f18b800b930 tx=0x7f18b8008040 comp rx=0 tx=0).stop 2024-08-18T22:25:19.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 -- 172.21.15.5:0/3330772754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40b6020 msgr2=0x7f18c41f7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40b6020 0x7f18c41f7600 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f18b001a040 tx=0x7f18b00191b0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 -- 172.21.15.5:0/3330772754 shutdown_connections 2024-08-18T22:25:19.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a40678c0 0x7f18a4069d80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18c4156770 0x7f18c4156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18c40b6020 0x7f18c41f7600 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 --2- 172.21.15.5:0/3330772754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c40b4650 0x7f18c4153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 -- 172.21.15.5:0/3330772754 >> 172.21.15.5:0/3330772754 conn(0x7f18c4067a70 msgr2=0x7f18c40d1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:19.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 -- 172.21.15.5:0/3330772754 shutdown_connections 2024-08-18T22:25:19.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.029+0000 7f18cb000640 1 -- 172.21.15.5:0/3330772754 wait complete. 2024-08-18T22:25:19.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:25:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7ab1000640 1 Processor -- start 2024-08-18T22:25:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7ab1000640 1 -- start start 2024-08-18T22:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7ab1000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aac147dd0 0x7f7aac0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7ab1000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aac15f000 0x7f7aac0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7ab1000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aac06c850 con 0x7f7aac06c3c0 2024-08-18T22:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7ab1000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7aac15f7c0 con 0x7f7aac147dd0 2024-08-18T22:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7ab1000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7aac0b6410 con 0x7f7aac15f000 2024-08-18T22:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7aa9e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aac147dd0 0x7f7aac0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7aa9e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aac147dd0 0x7f7aac0b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37412/0 (socket says 172.21.15.5:37412) 2024-08-18T22:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7aa9e00640 1 -- 172.21.15.5:0/4112287545 learned_addr learned my addr 172.21.15.5:0/4112287545 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7aa9e00640 1 -- 172.21.15.5:0/4112287545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aac15f000 msgr2=0x7f7aac0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7aa9e00640 1 --2- 172.21.15.5:0/4112287545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aac15f000 0x7f7aac0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7aa9e00640 1 -- 172.21.15.5:0/4112287545 >> v1:172.21.15.117:6789/0 conn(0x7f7aac06c3c0 legacy=0x7f7aac15e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:19.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.201+0000 7f7aa9e00640 1 -- 172.21.15.5:0/4112287545 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aac0b46b0 con 0x7f7aac147dd0 2024-08-18T22:25:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7aa9e00640 1 --2- 172.21.15.5:0/4112287545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac147dd0 0x7f7aac0b40d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0098a0 tx=0x7f7a9c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db47332f51c98ba5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:19.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7aa9400640 1 -- 172.21.15.5:0/4112287545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c0b0070 con 0x7f7aac147dd0 2024-08-18T22:25:19.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7aa9400640 1 -- 172.21.15.5:0/4112287545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9c0ab600 con 0x7f7aac147dd0 2024-08-18T22:25:19.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7aa9400640 1 -- 172.21.15.5:0/4112287545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c0ab9d0 con 0x7f7aac147dd0 2024-08-18T22:25:19.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7ab1000640 1 -- 172.21.15.5:0/4112287545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac147dd0 msgr2=0x7f7aac0b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7ab1000640 1 --2- 172.21.15.5:0/4112287545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac147dd0 0x7f7aac0b40d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0098a0 tx=0x7f7a9c01c260 comp rx=0 tx=0).stop 2024-08-18T22:25:19.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7ab1000640 1 -- 172.21.15.5:0/4112287545 shutdown_connections 2024-08-18T22:25:19.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7ab1000640 1 --2- 172.21.15.5:0/4112287545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aac15f000 0x7f7aac0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7ab1000640 1 --2- 172.21.15.5:0/4112287545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac147dd0 0x7f7aac0b40d0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7ab1000640 1 -- 172.21.15.5:0/4112287545 >> 172.21.15.5:0/4112287545 conn(0x7f7aac0b65f0 msgr2=0x7f7aac0b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:19.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7ab1000640 1 -- 172.21.15.5:0/4112287545 shutdown_connections 2024-08-18T22:25:19.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.205+0000 7f7ab1000640 1 -- 172.21.15.5:0/4112287545 wait complete. 2024-08-18T22:25:19.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7ab1000640 1 Processor -- start 2024-08-18T22:25:19.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7ab1000640 1 -- start start 2024-08-18T22:25:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7ab1000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aac06c3c0 0x7f7aac140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7ab1000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aac147dd0 0x7f7aac0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7ab1000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac15f000 0x7f7aac160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7ab1000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac0b5b30 con 0x7f7aac15f000 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7ab1000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac15f9e0 con 0x7f7aac147dd0 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7ab1000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7aac0b5cb0 con 0x7f7aac06c3c0 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aaa800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac15f000 0x7f7aac160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aa9e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aac06c3c0 0x7f7aac140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aa1400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aac147dd0 0x7f7aac0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aa9e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aac06c3c0 0x7f7aac140350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:39380/0 (socket says 172.21.15.5:39380) 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aaa800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac15f000 0x7f7aac160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37422/0 (socket says 172.21.15.5:37422) 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aa1400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aac147dd0 0x7f7aac0b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:52858/0 (socket says 172.21.15.5:52858) 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aaa800640 1 -- 172.21.15.5:0/138013132 learned_addr learned my addr 172.21.15.5:0/138013132 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aaa800640 1 -- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aac06c3c0 msgr2=0x7f7aac140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aaa800640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aac06c3c0 0x7f7aac140350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aaa800640 1 -- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aac147dd0 msgr2=0x7f7aac0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aaa800640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aac147dd0 0x7f7aac0b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aaa800640 1 -- 172.21.15.5:0/138013132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aac09df50 con 0x7f7aac15f000 2024-08-18T22:25:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aaa800640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac15f000 0x7f7aac160bf0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400b390 tx=0x7f7aa400b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aa2a00640 1 -- 172.21.15.5:0/138013132 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4015020 con 0x7f7aac15f000 2024-08-18T22:25:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aa2a00640 1 -- 172.21.15.5:0/138013132 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4011830 con 0x7f7aac15f000 2024-08-18T22:25:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7aa2a00640 1 -- 172.21.15.5:0/138013132 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4011c20 con 0x7f7aac15f000 2024-08-18T22:25:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7ab1000640 1 -- 172.21.15.5:0/138013132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aac09e230 con 0x7f7aac15f000 2024-08-18T22:25:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.209+0000 7f7ab1000640 1 -- 172.21.15.5:0/138013132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aac09e7f0 con 0x7f7aac15f000 2024-08-18T22:25:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.213+0000 7f7ab1000640 1 -- 172.21.15.5:0/138013132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aac0b40d0 con 0x7f7aac15f000 2024-08-18T22:25:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.213+0000 7f7aa2a00640 1 -- 172.21.15.5:0/138013132 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7aa4018020 con 0x7f7aac15f000 2024-08-18T22:25:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.213+0000 7f7aa2a00640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 0x7f7a88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.213+0000 7f7aa2a00640 1 -- 172.21.15.5:0/138013132 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5507+0+0 (secure 0 0 0) 0x7f7aa40858f0 con 0x7f7aac15f000 2024-08-18T22:25:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.213+0000 7f7aa9e00640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 0x7f7a88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.213+0000 7f7aa9e00640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 0x7f7a88069d80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0ad000 tx=0x7f7a9c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:19.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.217+0000 7f7aa2a00640 1 -- 172.21.15.5:0/138013132 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7aa401f020 con 0x7f7aac15f000 2024-08-18T22:25:19.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.381+0000 7f7ab1000640 1 -- 172.21.15.5:0/138013132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f7aac070060 con 0x7f7aac15f000 2024-08-18T22:25:19.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.385+0000 7f7aa2a00640 1 -- 172.21.15.5:0/138013132 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f7aa4055f30 con 0x7f7aac15f000 2024-08-18T22:25:19.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 -- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 msgr2=0x7f7a88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 0x7f7a88069d80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0ad000 tx=0x7f7a9c0a6000 comp rx=0 tx=0).stop 2024-08-18T22:25:19.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 -- 172.21.15.5:0/138013132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac15f000 msgr2=0x7f7aac160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac15f000 0x7f7aac160bf0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400b390 tx=0x7f7aa400b850 comp rx=0 tx=0).stop 2024-08-18T22:25:19.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 -- 172.21.15.5:0/138013132 shutdown_connections 2024-08-18T22:25:19.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 0x7f7a88069d80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac15f000 0x7f7aac160bf0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aac147dd0 0x7f7aac0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 --2- 172.21.15.5:0/138013132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aac06c3c0 0x7f7aac140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 -- 172.21.15.5:0/138013132 >> 172.21.15.5:0/138013132 conn(0x7f7aac0b65f0 msgr2=0x7f7aac0b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:19.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 -- 172.21.15.5:0/138013132 shutdown_connections 2024-08-18T22:25:19.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.389+0000 7f7ab1000640 1 -- 172.21.15.5:0/138013132 wait complete. 2024-08-18T22:25:19.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-08-18T22:25:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.549+0000 7f45afc00640 1 Processor -- start 2024-08-18T22:25:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.549+0000 7f45afc00640 1 -- start start 2024-08-18T22:25:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45afc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45a815fb80 0x7f45a80d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45afc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45a80b5ad0 0x7f45a806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45afc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a80d30b0 con 0x7f45a8071550 2024-08-18T22:25:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45afc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f45a80d1eb0 con 0x7f45a815fb80 2024-08-18T22:25:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45afc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f45a80d1bd0 con 0x7f45a80b5ad0 2024-08-18T22:25:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45ad200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45a815fb80 0x7f45a80d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45adc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f45a8071550 0x7f45a809aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46682/0 (socket says 172.21.15.5:46682) 2024-08-18T22:25:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45adc00640 1 -- 172.21.15.5:0/1355854008 learned_addr learned my addr 172.21.15.5:0/1355854008 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45a7e00640 1 --2- 172.21.15.5:0/1355854008 >> v2:172.21.15.117:3300/0 conn(0x7f45a80b5ad0 0x7f45a806fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45ad200640 1 -- 172.21.15.5:0/1355854008 >> v2:172.21.15.117:3300/0 conn(0x7f45a80b5ad0 msgr2=0x7f45a806fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45ad200640 1 --2- 172.21.15.5:0/1355854008 >> v2:172.21.15.117:3300/0 conn(0x7f45a80b5ad0 0x7f45a806fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45ad200640 1 -- 172.21.15.5:0/1355854008 >> v1:172.21.15.5:6789/0 conn(0x7f45a8071550 legacy=0x7f45a809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45ad200640 1 -- 172.21.15.5:0/1355854008 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a80d2dd0 con 0x7f45a815fb80 2024-08-18T22:25:19.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.553+0000 7f45a7400640 1 -- 172.21.15.5:0/1355854008 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483915589 0 0) 0x7f45a80d30b0 con 0x7f45a8071550 2024-08-18T22:25:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45ad200640 1 --2- 172.21.15.5:0/1355854008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a815fb80 0x7f45a80d15e0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f45a8074220 tx=0x7f459801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2699f09a6e9f470e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45a7400640 1 -- 172.21.15.5:0/1355854008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45980b0070 con 0x7f45a815fb80 2024-08-18T22:25:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45a7400640 1 -- 172.21.15.5:0/1355854008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45980ab600 con 0x7f45a815fb80 2024-08-18T22:25:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45a7400640 1 -- 172.21.15.5:0/1355854008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45980ab9d0 con 0x7f45a815fb80 2024-08-18T22:25:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45afc00640 1 -- 172.21.15.5:0/1355854008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a815fb80 msgr2=0x7f45a80d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45afc00640 1 --2- 172.21.15.5:0/1355854008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a815fb80 0x7f45a80d15e0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f45a8074220 tx=0x7f459801c360 comp rx=0 tx=0).stop 2024-08-18T22:25:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45afc00640 1 -- 172.21.15.5:0/1355854008 shutdown_connections 2024-08-18T22:25:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45afc00640 1 --2- 172.21.15.5:0/1355854008 >> v2:172.21.15.117:3300/0 conn(0x7f45a80b5ad0 0x7f45a806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45afc00640 1 --2- 172.21.15.5:0/1355854008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a815fb80 0x7f45a80d15e0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45afc00640 1 -- 172.21.15.5:0/1355854008 >> 172.21.15.5:0/1355854008 conn(0x7f45a80d2180 msgr2=0x7f45a80d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45afc00640 1 -- 172.21.15.5:0/1355854008 shutdown_connections 2024-08-18T22:25:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45afc00640 1 -- 172.21.15.5:0/1355854008 wait complete. 2024-08-18T22:25:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45afc00640 1 Processor -- start 2024-08-18T22:25:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.557+0000 7f45afc00640 1 -- start start 2024-08-18T22:25:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45afc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a8071550 0x7f45a8141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45afc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80b5ad0 0x7f45a809eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45afc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a815fb80 0x7f45a809f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45afc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f45a809b2d0 con 0x7f45a815fb80 2024-08-18T22:25:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45afc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f45a809b150 con 0x7f45a8071550 2024-08-18T22:25:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45afc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f45a80719a0 con 0x7f45a80b5ad0 2024-08-18T22:25:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45adc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a815fb80 0x7f45a809f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45adc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a815fb80 0x7f45a809f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37442/0 (socket says 172.21.15.5:37442) 2024-08-18T22:25:19.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45adc00640 1 -- 172.21.15.5:0/2689956527 learned_addr learned my addr 172.21.15.5:0/2689956527 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:19.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45ad200640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a8071550 0x7f45a8141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45a7e00640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80b5ad0 0x7f45a809eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45adc00640 1 -- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80b5ad0 msgr2=0x7f45a809eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45adc00640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80b5ad0 0x7f45a809eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45adc00640 1 -- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a8071550 msgr2=0x7f45a8141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45adc00640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a8071550 0x7f45a8141b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45adc00640 1 -- 172.21.15.5:0/2689956527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a809c3e0 con 0x7f45a815fb80 2024-08-18T22:25:19.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45adc00640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a815fb80 0x7f45a809f0e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f45a0001570 tx=0x7f45a000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:19.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45a4c00640 1 -- 172.21.15.5:0/2689956527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0018070 con 0x7f45a815fb80 2024-08-18T22:25:19.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45a4c00640 1 -- 172.21.15.5:0/2689956527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a000a640 con 0x7f45a815fb80 2024-08-18T22:25:19.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45a4c00640 1 -- 172.21.15.5:0/2689956527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a000aa30 con 0x7f45a815fb80 2024-08-18T22:25:19.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45afc00640 1 -- 172.21.15.5:0/2689956527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a809c680 con 0x7f45a815fb80 2024-08-18T22:25:19.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45afc00640 1 -- 172.21.15.5:0/2689956527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a809cc40 con 0x7f45a815fb80 2024-08-18T22:25:19.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45afc00640 1 -- 172.21.15.5:0/2689956527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a806fad0 con 0x7f45a815fb80 2024-08-18T22:25:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.561+0000 7f45a4c00640 1 -- 172.21.15.5:0/2689956527 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f45a001b070 con 0x7f45a815fb80 2024-08-18T22:25:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.565+0000 7f45a4c00640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45880678c0 0x7f4588069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.565+0000 7f45a4c00640 1 -- 172.21.15.5:0/2689956527 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5507+0+0 (secure 0 0 0) 0x7f45a0085230 con 0x7f45a815fb80 2024-08-18T22:25:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.565+0000 7f45ad200640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45880678c0 0x7f4588069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.565+0000 7f45ad200640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45880678c0 0x7f4588069d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f45980ad000 tx=0x7f45980a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:19.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.569+0000 7f45a4c00640 1 -- 172.21.15.5:0/2689956527 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f45a0055740 con 0x7f45a815fb80 2024-08-18T22:25:19.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.737+0000 7f45afc00640 1 -- 172.21.15.5:0/2689956527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7f45a80ce0d0 con 0x7f45a815fb80 2024-08-18T22:25:19.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45a4c00640 1 -- 172.21.15.5:0/2689956527 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v32) ==== 101+0+0 (secure 0 0 0) 0x7f45a0059a40 con 0x7f45a815fb80 2024-08-18T22:25:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45afc00640 1 -- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45880678c0 msgr2=0x7f4588069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45afc00640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45880678c0 0x7f4588069d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f45980ad000 tx=0x7f45980a6000 comp rx=0 tx=0).stop 2024-08-18T22:25:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45afc00640 1 -- 172.21.15.5:0/2689956527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a815fb80 msgr2=0x7f45a809f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45afc00640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a815fb80 0x7f45a809f0e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f45a0001570 tx=0x7f45a000cca0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45afc00640 1 -- 172.21.15.5:0/2689956527 shutdown_connections 2024-08-18T22:25:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45afc00640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45880678c0 0x7f4588069d80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45afc00640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45a815fb80 0x7f45a809f0e0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45afc00640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80b5ad0 0x7f45a809eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45afc00640 1 --2- 172.21.15.5:0/2689956527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a8071550 0x7f45a8141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45afc00640 1 -- 172.21.15.5:0/2689956527 >> 172.21.15.5:0/2689956527 conn(0x7f45a80d2180 msgr2=0x7f45a8156b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.741+0000 7f45afc00640 1 -- 172.21.15.5:0/2689956527 shutdown_connections 2024-08-18T22:25:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.745+0000 7f45afc00640 1 -- 172.21.15.5:0/2689956527 wait complete. 2024-08-18T22:25:19.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-08-18T22:25:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c72800640 1 Processor -- start 2024-08-18T22:25:19.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c72800640 1 -- start start 2024-08-18T22:25:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c72800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c0b40c0 0x7f3c6c0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c72800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c6c0b31f0 con 0x7f3c6c0ce280 2024-08-18T22:25:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c72800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c6c0b34d0 con 0x7f3c6c15b0c0 2024-08-18T22:25:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c72800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3c6c0b3d70 con 0x7f3c6c0b40c0 2024-08-18T22:25:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c6be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c6c0ce280 0x7f3c6c0ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46688/0 (socket says 172.21.15.5:46688) 2024-08-18T22:25:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c6be00640 1 -- 172.21.15.5:0/1700907973 learned_addr learned my addr 172.21.15.5:0/1700907973 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c6aa00640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c0b40c0 0x7f3c6c0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197370364 0 0) 0x7f3c6c0b31f0 con 0x7f3c6c0ce280 2024-08-18T22:25:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c50003530 con 0x7f3c6c0ce280 2024-08-18T22:25:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3637761319 0 0) 0x7f3c6c0b34d0 con 0x7f3c6c15b0c0 2024-08-18T22:25:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.905+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c6c0b31f0 con 0x7f3c6c15b0c0 2024-08-18T22:25:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 343496628 0 0) 0x7f3c50003530 con 0x7f3c6c0ce280 2024-08-18T22:25:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c0b40c0 msgr2=0x7f3c6c0b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c0b40c0 0x7f3c6c0b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 >> v1:172.21.15.117:6789/0 conn(0x7f3c6c15b0c0 legacy=0x7f3c6c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c0b37b0 con 0x7f3c6c0ce280 2024-08-18T22:25:19.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f3c64001a00 con 0x7f3c6c0ce280 2024-08-18T22:25:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 >> v1:172.21.15.5:6789/0 conn(0x7f3c6c0ce280 legacy=0x7f3c6c0ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c50003b80 0x7f3c50003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c0b40c0 0x7f3c50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c0b3d70 con 0x7f3c50004d50 2024-08-18T22:25:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5000bb60 con 0x7f3c50003b80 2024-08-18T22:25:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5000bd60 con 0x7f3c6c0b40c0 2024-08-18T22:25:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6be00640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6b400640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c50003b80 0x7f3c50003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6aa00640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c0b40c0 0x7f3c50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6be00640 1 -- 172.21.15.5:0/1700907973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c0b40c0 msgr2=0x7f3c50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6be00640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c0b40c0 0x7f3c50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6be00640 1 -- 172.21.15.5:0/1700907973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c50003b80 msgr2=0x7f3c50003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6be00640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c50003b80 0x7f3c50003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6be00640 1 -- 172.21.15.5:0/1700907973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c0b37b0 con 0x7f3c50004d50 2024-08-18T22:25:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6be00640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400a970 tx=0x7f3c6401d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c71afaf45c5b130 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400a540 con 0x7f3c50004d50 2024-08-18T22:25:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c640ad650 con 0x7f3c50004d50 2024-08-18T22:25:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.909+0000 7f3c6a000640 1 -- 172.21.15.5:0/1700907973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c640ada40 con 0x7f3c50004d50 2024-08-18T22:25:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 -- 172.21.15.5:0/1700907973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c50004d50 msgr2=0x7f3c500051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 --2- 172.21.15.5:0/1700907973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400a970 tx=0x7f3c6401d400 comp rx=0 tx=0).stop 2024-08-18T22:25:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c6be00640 1 -- 172.21.15.5:0/1700907973 reap_dead start 2024-08-18T22:25:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 -- 172.21.15.5:0/1700907973 shutdown_connections 2024-08-18T22:25:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 -- 172.21.15.5:0/1700907973 >> 172.21.15.5:0/1700907973 conn(0x7f3c6c0b1dc0 msgr2=0x7f3c6c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 -- 172.21.15.5:0/1700907973 shutdown_connections 2024-08-18T22:25:19.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 -- 172.21.15.5:0/1700907973 wait complete. 2024-08-18T22:25:19.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 Processor -- start 2024-08-18T22:25:19.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 -- start start 2024-08-18T22:25:19.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c50004d50 0x7f3c6c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c6c152230 0x7f3c6c148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c160e60 0x7f3c6c1612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c06f7f0 con 0x7f3c6c152230 2024-08-18T22:25:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c06f670 con 0x7f3c50004d50 2024-08-18T22:25:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c72800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3c6c06e410 con 0x7f3c6c160e60 2024-08-18T22:25:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c6aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c6c152230 0x7f3c6c148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c6aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c6c152230 0x7f3c6c148ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37468/0 (socket says 172.21.15.5:37468) 2024-08-18T22:25:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c6aa00640 1 -- 172.21.15.5:0/3020892438 learned_addr learned my addr 172.21.15.5:0/3020892438 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c6b400640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c50004d50 0x7f3c6c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.913+0000 7f3c6be00640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c160e60 0x7f3c6c1612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c6aa00640 1 -- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c160e60 msgr2=0x7f3c6c1612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c6aa00640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c160e60 0x7f3c6c1612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c6aa00640 1 -- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c50004d50 msgr2=0x7f3c6c15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c6aa00640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c50004d50 0x7f3c6c15d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c6aa00640 1 -- 172.21.15.5:0/3020892438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c14ca90 con 0x7f3c6c152230 2024-08-18T22:25:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c6aa00640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c6c152230 0x7f3c6c148ae0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f3c580119d0 tx=0x7f3c58011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c63400640 1 -- 172.21.15.5:0/3020892438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800faf0 con 0x7f3c6c152230 2024-08-18T22:25:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c63400640 1 -- 172.21.15.5:0/3020892438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c5800fc90 con 0x7f3c6c152230 2024-08-18T22:25:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c63400640 1 -- 172.21.15.5:0/3020892438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58014440 con 0x7f3c6c152230 2024-08-18T22:25:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c72800640 1 -- 172.21.15.5:0/3020892438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c6c15db10 con 0x7f3c6c152230 2024-08-18T22:25:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c72800640 1 -- 172.21.15.5:0/3020892438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c6c157150 con 0x7f3c6c152230 2024-08-18T22:25:19.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c72800640 1 -- 172.21.15.5:0/3020892438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6c15e010 con 0x7f3c6c152230 2024-08-18T22:25:19.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c63400640 1 -- 172.21.15.5:0/3020892438 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c58012040 con 0x7f3c6c152230 2024-08-18T22:25:19.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c63400640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c4c0678c0 0x7f3c4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:19.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c63400640 1 -- 172.21.15.5:0/3020892438 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5507+0+0 (secure 0 0 0) 0x7f3c58086160 con 0x7f3c6c152230 2024-08-18T22:25:19.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.917+0000 7f3c6b400640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c4c0678c0 0x7f3c4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:19.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.921+0000 7f3c6b400640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c4c0678c0 0x7f3c4c069d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c000c10 tx=0x7f3c5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:19.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:19.921+0000 7f3c63400640 1 -- 172.21.15.5:0/3020892438 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f3c58019030 con 0x7f3c6c152230 2024-08-18T22:25:20.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.089+0000 7f3c72800640 1 -- 172.21.15.5:0/3020892438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7f3c6c0ce6d0 con 0x7f3c6c152230 2024-08-18T22:25:20.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c63400640 1 -- 172.21.15.5:0/3020892438 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v33) ==== 101+0+0 (secure 0 0 0) 0x7f3c58056e10 con 0x7f3c6c152230 2024-08-18T22:25:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 -- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c4c0678c0 msgr2=0x7f3c4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c4c0678c0 0x7f3c4c069d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c000c10 tx=0x7f3c5c009040 comp rx=0 tx=0).stop 2024-08-18T22:25:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 -- 172.21.15.5:0/3020892438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c6c152230 msgr2=0x7f3c6c148ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c6c152230 0x7f3c6c148ae0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f3c580119d0 tx=0x7f3c58011e90 comp rx=0 tx=0).stop 2024-08-18T22:25:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 -- 172.21.15.5:0/3020892438 shutdown_connections 2024-08-18T22:25:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c4c0678c0 0x7f3c4c069d80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c6c160e60 0x7f3c6c1612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c6c152230 0x7f3c6c148ae0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 --2- 172.21.15.5:0/3020892438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c50004d50 0x7f3c6c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 -- 172.21.15.5:0/3020892438 >> 172.21.15.5:0/3020892438 conn(0x7f3c6c0b1dc0 msgr2=0x7f3c6c06ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 -- 172.21.15.5:0/3020892438 shutdown_connections 2024-08-18T22:25:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.093+0000 7f3c72800640 1 -- 172.21.15.5:0/3020892438 wait complete. 2024-08-18T22:25:20.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-08-18T22:25:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.253+0000 7f6e2f800640 1 Processor -- start 2024-08-18T22:25:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.253+0000 7f6e2f800640 1 -- start start 2024-08-18T22:25:20.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.253+0000 7f6e2f800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2815b010 0x7f6e280ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.253+0000 7f6e2f800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6e280cd3a0 0x7f6e2806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.253+0000 7f6e2f800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e280cee20 con 0x7f6e2806f0c0 2024-08-18T22:25:20.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.253+0000 7f6e2f800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6e280cfa30 con 0x7f6e280cd3a0 2024-08-18T22:25:20.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.253+0000 7f6e2f800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6e280cf100 con 0x7f6e2815b010 2024-08-18T22:25:20.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e1fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6e280cd3a0 0x7f6e2806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e1fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6e280cd3a0 0x7f6e2806eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37484/0 (socket says 172.21.15.5:37484) 2024-08-18T22:25:20.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e2d800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6e2806f0c0 0x7f6e280caf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46702/0 (socket says 172.21.15.5:46702) 2024-08-18T22:25:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e1fe00640 1 -- 172.21.15.5:0/2196088502 learned_addr learned my addr 172.21.15.5:0/2196088502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e2ce00640 1 --2- 172.21.15.5:0/2196088502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2815b010 0x7f6e280ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e1fe00640 1 -- 172.21.15.5:0/2196088502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2815b010 msgr2=0x7f6e280ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e1fe00640 1 --2- 172.21.15.5:0/2196088502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2815b010 0x7f6e280ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e1fe00640 1 -- 172.21.15.5:0/2196088502 >> v1:172.21.15.5:6789/0 conn(0x7f6e2806f0c0 legacy=0x7f6e280caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e27e00640 1 -- 172.21.15.5:0/2196088502 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526930064 0 0) 0x7f6e280cee20 con 0x7f6e2806f0c0 2024-08-18T22:25:20.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e1fe00640 1 -- 172.21.15.5:0/2196088502 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e280cf3e0 con 0x7f6e280cd3a0 2024-08-18T22:25:20.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e1fe00640 1 --2- 172.21.15.5:0/2196088502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e280cd3a0 0x7f6e2806eb80 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000bb10 tx=0x7f6e1001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e90339be046280 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:20.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e27e00640 1 -- 172.21.15.5:0/2196088502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e100b4070 con 0x7f6e280cd3a0 2024-08-18T22:25:20.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e27e00640 1 -- 172.21.15.5:0/2196088502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e100a7b80 con 0x7f6e280cd3a0 2024-08-18T22:25:20.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.257+0000 7f6e27e00640 1 -- 172.21.15.5:0/2196088502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e100af440 con 0x7f6e280cd3a0 2024-08-18T22:25:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 -- 172.21.15.5:0/2196088502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e280cd3a0 msgr2=0x7f6e2806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 --2- 172.21.15.5:0/2196088502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e280cd3a0 0x7f6e2806eb80 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000bb10 tx=0x7f6e1001ec30 comp rx=0 tx=0).stop 2024-08-18T22:25:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 -- 172.21.15.5:0/2196088502 shutdown_connections 2024-08-18T22:25:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 --2- 172.21.15.5:0/2196088502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e280cd3a0 0x7f6e2806eb80 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 --2- 172.21.15.5:0/2196088502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2815b010 0x7f6e280ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 -- 172.21.15.5:0/2196088502 >> 172.21.15.5:0/2196088502 conn(0x7f6e280b1c50 msgr2=0x7f6e280b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 -- 172.21.15.5:0/2196088502 shutdown_connections 2024-08-18T22:25:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 -- 172.21.15.5:0/2196088502 wait complete. 2024-08-18T22:25:20.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 Processor -- start 2024-08-18T22:25:20.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 -- start start 2024-08-18T22:25:20.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2806f0c0 0x7f6e2815d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e280cd3a0 0x7f6e28153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e2815b010 0x7f6e280c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2806dbf0 con 0x7f6e280cd3a0 2024-08-18T22:25:20.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2806da70 con 0x7f6e2815b010 2024-08-18T22:25:20.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2f800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6e2806dd70 con 0x7f6e2806f0c0 2024-08-18T22:25:20.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e1fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e280cd3a0 0x7f6e28153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e1fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e280cd3a0 0x7f6e28153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37488/0 (socket says 172.21.15.5:37488) 2024-08-18T22:25:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e1fe00640 1 -- 172.21.15.5:0/1741307149 learned_addr learned my addr 172.21.15.5:0/1741307149 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2d800640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e2815b010 0x7f6e280c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2ce00640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2806f0c0 0x7f6e2815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e1fe00640 1 -- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2806f0c0 msgr2=0x7f6e2815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e1fe00640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2806f0c0 0x7f6e2815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e1fe00640 1 -- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e2815b010 msgr2=0x7f6e280c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e1fe00640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e2815b010 0x7f6e280c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e1fe00640 1 -- 172.21.15.5:0/1741307149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2815d6d0 con 0x7f6e280cd3a0 2024-08-18T22:25:20.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.261+0000 7f6e2d800640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e2815b010 0x7f6e280c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:20.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.265+0000 7f6e1fe00640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e280cd3a0 0x7f6e28153fa0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f6e1001d2e0 tx=0x7f6e1001d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:20.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.265+0000 7f6e25600640 1 -- 172.21.15.5:0/1741307149 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e100b4070 con 0x7f6e280cd3a0 2024-08-18T22:25:20.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.265+0000 7f6e25600640 1 -- 172.21.15.5:0/1741307149 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e10004020 con 0x7f6e280cd3a0 2024-08-18T22:25:20.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.265+0000 7f6e25600640 1 -- 172.21.15.5:0/1741307149 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e100043d0 con 0x7f6e280cd3a0 2024-08-18T22:25:20.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.265+0000 7f6e2f800640 1 -- 172.21.15.5:0/1741307149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e281571d0 con 0x7f6e280cd3a0 2024-08-18T22:25:20.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.265+0000 7f6e2f800640 1 -- 172.21.15.5:0/1741307149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e28157790 con 0x7f6e280cd3a0 2024-08-18T22:25:20.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.265+0000 7f6e2f800640 1 -- 172.21.15.5:0/1741307149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e280ce840 con 0x7f6e280cd3a0 2024-08-18T22:25:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.265+0000 7f6e25600640 1 -- 172.21.15.5:0/1741307149 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e100c1060 con 0x7f6e280cd3a0 2024-08-18T22:25:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.265+0000 7f6e25600640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6e040678c0 0x7f6e04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.265+0000 7f6e25600640 1 -- 172.21.15.5:0/1741307149 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5507+0+0 (secure 0 0 0) 0x7f6e101202c0 con 0x7f6e280cd3a0 2024-08-18T22:25:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.265+0000 7f6e2ce00640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6e040678c0 0x7f6e04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.269+0000 7f6e2ce00640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6e040678c0 0x7f6e04069d80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6e281fb520 tx=0x7f6e18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:20.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.269+0000 7f6e25600640 1 -- 172.21.15.5:0/1741307149 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6e10018820 con 0x7f6e280cd3a0 2024-08-18T22:25:20.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.493+0000 7f6e2f800640 1 -- 172.21.15.5:0/1741307149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f6e281598c0 con 0x7f6e280cd3a0 2024-08-18T22:25:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e25600640 1 -- 172.21.15.5:0/1741307149 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v313) ==== 151+0+0 (secure 0 0 0) 0x7f6e100f0e20 con 0x7f6e280cd3a0 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e2f800640 1 -- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6e040678c0 msgr2=0x7f6e04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e2f800640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6e040678c0 0x7f6e04069d80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6e281fb520 tx=0x7f6e18008040 comp rx=0 tx=0).stop 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e2f800640 1 -- 172.21.15.5:0/1741307149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e280cd3a0 msgr2=0x7f6e28153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e2f800640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e280cd3a0 0x7f6e28153fa0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f6e1001d2e0 tx=0x7f6e1001d470 comp rx=0 tx=0).stop 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e2f800640 1 -- 172.21.15.5:0/1741307149 shutdown_connections 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e2f800640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6e040678c0 0x7f6e04069d80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e2f800640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e2815b010 0x7f6e280c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e2f800640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e280cd3a0 0x7f6e28153fa0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e2f800640 1 --2- 172.21.15.5:0/1741307149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2806f0c0 0x7f6e2815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e2f800640 1 -- 172.21.15.5:0/1741307149 >> 172.21.15.5:0/1741307149 conn(0x7f6e280b1c50 msgr2=0x7f6e28072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.677+0000 7f6e2f800640 1 -- 172.21.15.5:0/1741307149 shutdown_connections 2024-08-18T22:25:20.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.681+0000 7f6e2f800640 1 -- 172.21.15.5:0/1741307149 wait complete. 2024-08-18T22:25:20.700 INFO:tasks.cephfs_test_runner:That a directory is split during scrub. ... ok 2024-08-18T22:25:20.700 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-08-18T22:25:20.700 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-08-18T22:25:20.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:25:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7590c00640 1 Processor -- start 2024-08-18T22:25:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7590c00640 1 -- start start 2024-08-18T22:25:20.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7590c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f758c06b9b0 0x7f758c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7590c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f758c0b1c50 0x7f758c0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7590c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758c0b0bd0 con 0x7f758c06bd90 2024-08-18T22:25:20.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7590c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f758c0b0e90 con 0x7f758c0b1c50 2024-08-18T22:25:20.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7590c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f758c0b1170 con 0x7f758c06b9b0 2024-08-18T22:25:20.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7589400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f758c06bd90 0x7f758c1453d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46716/0 (socket says 172.21.15.5:46716) 2024-08-18T22:25:20.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7589400640 1 -- 172.21.15.5:0/3786136487 learned_addr learned my addr 172.21.15.5:0/3786136487 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:20.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f758a800640 1 --2- 172.21.15.5:0/3786136487 >> v2:172.21.15.5:3300/0 conn(0x7f758c0b1c50 0x7f758c0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7589e00640 1 --2- 172.21.15.5:0/3786136487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f758c06b9b0 0x7f758c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7588a00640 1 -- 172.21.15.5:0/3786136487 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365098497 0 0) 0x7f758c0b0bd0 con 0x7f758c06bd90 2024-08-18T22:25:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7588a00640 1 -- 172.21.15.5:0/3786136487 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7570003530 con 0x7f758c06bd90 2024-08-18T22:25:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f758a800640 1 -- 172.21.15.5:0/3786136487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f758c06b9b0 msgr2=0x7f758c0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f758a800640 1 --2- 172.21.15.5:0/3786136487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f758c06b9b0 0x7f758c0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f758a800640 1 -- 172.21.15.5:0/3786136487 >> v1:172.21.15.5:6789/0 conn(0x7f758c06bd90 legacy=0x7f758c1453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f758a800640 1 -- 172.21.15.5:0/3786136487 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758c0b1450 con 0x7f758c0b1c50 2024-08-18T22:25:20.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.841+0000 7f7589e00640 1 --2- 172.21.15.5:0/3786136487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f758c06b9b0 0x7f758c0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:20.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f758a800640 1 --2- 172.21.15.5:0/3786136487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f758c0b1c50 0x7f758c0b2100 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f7584009d90 tx=0x7f758401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d76f844a570dbe3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f7588a00640 1 -- 172.21.15.5:0/3786136487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75840b2070 con 0x7f758c0b1c50 2024-08-18T22:25:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f7588a00640 1 -- 172.21.15.5:0/3786136487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75840a5960 con 0x7f758c0b1c50 2024-08-18T22:25:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f7588a00640 1 -- 172.21.15.5:0/3786136487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75840a5d10 con 0x7f758c0b1c50 2024-08-18T22:25:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f7590c00640 1 -- 172.21.15.5:0/3786136487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f758c0b1c50 msgr2=0x7f758c0b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f7590c00640 1 --2- 172.21.15.5:0/3786136487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f758c0b1c50 0x7f758c0b2100 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f7584009d90 tx=0x7f758401c970 comp rx=0 tx=0).stop 2024-08-18T22:25:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f7590c00640 1 -- 172.21.15.5:0/3786136487 shutdown_connections 2024-08-18T22:25:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f7590c00640 1 --2- 172.21.15.5:0/3786136487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f758c0b1c50 0x7f758c0b2100 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f7590c00640 1 --2- 172.21.15.5:0/3786136487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f758c06b9b0 0x7f758c0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f7590c00640 1 -- 172.21.15.5:0/3786136487 >> 172.21.15.5:0/3786136487 conn(0x7f758c09aa40 msgr2=0x7f758c0b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f7590c00640 1 -- 172.21.15.5:0/3786136487 shutdown_connections 2024-08-18T22:25:20.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.845+0000 7f7590c00640 1 -- 172.21.15.5:0/3786136487 wait complete. 2024-08-18T22:25:20.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7590c00640 1 Processor -- start 2024-08-18T22:25:20.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7590c00640 1 -- start start 2024-08-18T22:25:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7590c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f758c06b9b0 0x7f758c0cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7590c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f758c06bd90 0x7f758c0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7590c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f758c0b1c50 0x7f758c0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7590c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f758c06c2f0 con 0x7f758c0b1c50 2024-08-18T22:25:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7590c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f758c06c170 con 0x7f758c06bd90 2024-08-18T22:25:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7590c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f758c0ae040 con 0x7f758c06b9b0 2024-08-18T22:25:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f758a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f758c0b1c50 0x7f758c0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f758a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f758c0b1c50 0x7f758c0ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37504/0 (socket says 172.21.15.5:37504) 2024-08-18T22:25:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f758a800640 1 -- 172.21.15.5:0/1765978224 learned_addr learned my addr 172.21.15.5:0/1765978224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7589e00640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f758c06b9b0 0x7f758c0cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7589400640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f758c06bd90 0x7f758c0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f758a800640 1 -- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f758c06b9b0 msgr2=0x7f758c0cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f758a800640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f758c06b9b0 0x7f758c0cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f758a800640 1 -- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f758c06bd90 msgr2=0x7f758c0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f758a800640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f758c06bd90 0x7f758c0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f758a800640 1 -- 172.21.15.5:0/1765978224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758c070ae0 con 0x7f758c0b1c50 2024-08-18T22:25:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f758a800640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f758c0b1c50 0x7f758c0ca920 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f758401a5a0 tx=0x7f7584019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7582000640 1 -- 172.21.15.5:0/1765978224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75840b2050 con 0x7f758c0b1c50 2024-08-18T22:25:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7582000640 1 -- 172.21.15.5:0/1765978224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75840be070 con 0x7f758c0b1c50 2024-08-18T22:25:20.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7582000640 1 -- 172.21.15.5:0/1765978224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584004040 con 0x7f758c0b1c50 2024-08-18T22:25:20.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7590c00640 1 -- 172.21.15.5:0/1765978224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758c1568f0 con 0x7f758c0b1c50 2024-08-18T22:25:20.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7590c00640 1 -- 172.21.15.5:0/1765978224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f758c0d0a50 con 0x7f758c0b1c50 2024-08-18T22:25:20.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.849+0000 7f7590c00640 1 -- 172.21.15.5:0/1765978224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f758c0d05a0 con 0x7f758c0b1c50 2024-08-18T22:25:20.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.853+0000 7f7582000640 1 -- 172.21.15.5:0/1765978224 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f75840041e0 con 0x7f758c0b1c50 2024-08-18T22:25:20.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.853+0000 7f7582000640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f756c0678f0 0x7f756c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:20.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.853+0000 7f7582000640 1 -- 172.21.15.5:0/1765978224 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5507+0+0 (secure 0 0 0) 0x7f7584120d40 con 0x7f758c0b1c50 2024-08-18T22:25:20.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.853+0000 7f7589e00640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f756c0678f0 0x7f756c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:20.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.853+0000 7f7589e00640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f756c0678f0 0x7f756c069db0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f758c0b09b0 tx=0x7f757c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:20.857+0000 7f7582000640 1 -- 172.21.15.5:0/1765978224 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7584016560 con 0x7f758c0b1c50 2024-08-18T22:25:21.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.021+0000 7f7590c00640 1 -- 172.21.15.5:0/1765978224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f758c0d0c90 con 0x7f758c0b1c50 2024-08-18T22:25:21.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7582000640 1 -- 172.21.15.5:0/1765978224 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+13481 (secure 0 0 0) 0x7f758c0d0c90 con 0x7f758c0b1c50 2024-08-18T22:25:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:21.024 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":106,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:25:18.663158+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/580352313":"2024-08-19T22:25:15.370169+0000","172.21.15.5:6834/580352313":"2024-08-19T22:25:15.370169+0000","172.21.15.117:6837/314902070":"2024-08-19T22:24:59.944539+0000","172.21.15.117:6835/314902070":"2024-08-19T22:24:59.944539+0000","172.21.15.5:6835/3668199286":"2024-08-19T22:24:54.562505+0000","172.21.15.5:6834/3668199286":"2024-08-19T22:24:54.562505+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:25:21.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 -- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f756c0678f0 msgr2=0x7f756c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:21.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f756c0678f0 0x7f756c069db0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f758c0b09b0 tx=0x7f757c008040 comp rx=0 tx=0).stop 2024-08-18T22:25:21.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 -- 172.21.15.5:0/1765978224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f758c0b1c50 msgr2=0x7f758c0ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:21.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f758c0b1c50 0x7f758c0ca920 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f758401a5a0 tx=0x7f7584019710 comp rx=0 tx=0).stop 2024-08-18T22:25:21.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 -- 172.21.15.5:0/1765978224 shutdown_connections 2024-08-18T22:25:21.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f756c0678f0 0x7f756c069db0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f758c0b1c50 0x7f758c0ca920 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f758c06bd90 0x7f758c0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 --2- 172.21.15.5:0/1765978224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f758c06b9b0 0x7f758c0cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 -- 172.21.15.5:0/1765978224 >> 172.21.15.5:0/1765978224 conn(0x7f758c09aa40 msgr2=0x7f758c0cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:21.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 -- 172.21.15.5:0/1765978224 shutdown_connections 2024-08-18T22:25:21.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.025+0000 7f7590c00640 1 -- 172.21.15.5:0/1765978224 wait complete. 2024-08-18T22:25:21.045 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:25:21.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:25:21.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f739d200640 1 Processor -- start 2024-08-18T22:25:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f739d200640 1 -- start start 2024-08-18T22:25:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f739d200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f739809aca0 0x7f73980afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f739d200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f739809b080 0x7f73980b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f739d200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f739806e8a0 con 0x7f73980b1300 2024-08-18T22:25:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f739d200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f739809bb80 con 0x7f739809aca0 2024-08-18T22:25:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f739d200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f73980d2e40 con 0x7f739809b080 2024-08-18T22:25:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f7395e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f739809aca0 0x7f73980afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f7395e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f739809aca0 0x7f73980afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37510/0 (socket says 172.21.15.5:37510) 2024-08-18T22:25:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f7395e00640 1 -- 172.21.15.5:0/3580529934 learned_addr learned my addr 172.21.15.5:0/3580529934 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f7396800640 1 --2- 172.21.15.5:0/3580529934 >> v2:172.21.15.117:3300/0 conn(0x7f739809b080 0x7f73980b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f7395e00640 1 -- 172.21.15.5:0/3580529934 >> v2:172.21.15.117:3300/0 conn(0x7f739809b080 msgr2=0x7f73980b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f7395e00640 1 --2- 172.21.15.5:0/3580529934 >> v2:172.21.15.117:3300/0 conn(0x7f739809b080 0x7f73980b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f7395e00640 1 -- 172.21.15.5:0/3580529934 >> v1:172.21.15.117:6789/0 conn(0x7f73980b1300 legacy=0x7f73980affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.189+0000 7f7395e00640 1 -- 172.21.15.5:0/3580529934 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739806cbd0 con 0x7f739809aca0 2024-08-18T22:25:21.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f7395e00640 1 --2- 172.21.15.5:0/3580529934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739809aca0 0x7f73980afa90 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f7398073460 tx=0x7f738801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f0ed39b50caed server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:21.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f7394a00640 1 -- 172.21.15.5:0/3580529934 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73880b2070 con 0x7f739809aca0 2024-08-18T22:25:21.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f7394a00640 1 -- 172.21.15.5:0/3580529934 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73880ad640 con 0x7f739809aca0 2024-08-18T22:25:21.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f7394a00640 1 -- 172.21.15.5:0/3580529934 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73880ada10 con 0x7f739809aca0 2024-08-18T22:25:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f739d200640 1 -- 172.21.15.5:0/3580529934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739809aca0 msgr2=0x7f73980afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f739d200640 1 --2- 172.21.15.5:0/3580529934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739809aca0 0x7f73980afa90 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f7398073460 tx=0x7f738801c4e0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f739d200640 1 -- 172.21.15.5:0/3580529934 shutdown_connections 2024-08-18T22:25:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f739d200640 1 --2- 172.21.15.5:0/3580529934 >> v2:172.21.15.117:3300/0 conn(0x7f739809b080 0x7f73980b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f739d200640 1 --2- 172.21.15.5:0/3580529934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739809aca0 0x7f73980afa90 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f739d200640 1 -- 172.21.15.5:0/3580529934 >> 172.21.15.5:0/3580529934 conn(0x7f73980d2180 msgr2=0x7f73980d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f739d200640 1 -- 172.21.15.5:0/3580529934 shutdown_connections 2024-08-18T22:25:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.193+0000 7f739d200640 1 -- 172.21.15.5:0/3580529934 wait complete. 2024-08-18T22:25:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f739d200640 1 Processor -- start 2024-08-18T22:25:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f739d200640 1 -- start start 2024-08-18T22:25:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f739d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739809aca0 0x7f7398160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f739d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f739809b080 0x7f73980b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f739d200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73980b1300 0x7f73980b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f739d200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f739816b6b0 con 0x7f739809aca0 2024-08-18T22:25:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f739d200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f739816b530 con 0x7f73980b1300 2024-08-18T22:25:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f739d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f739816b830 con 0x7f739809b080 2024-08-18T22:25:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f7395e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739809aca0 0x7f7398160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f7395e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739809aca0 0x7f7398160050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37516/0 (socket says 172.21.15.5:37516) 2024-08-18T22:25:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f7395e00640 1 -- 172.21.15.5:0/780906987 learned_addr learned my addr 172.21.15.5:0/780906987 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f7395400640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f739809b080 0x7f73980b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f7396800640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73980b1300 0x7f73980b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f7395e00640 1 -- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f739809b080 msgr2=0x7f73980b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f7395e00640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f739809b080 0x7f73980b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f7395e00640 1 -- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73980b1300 msgr2=0x7f73980b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f7395e00640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73980b1300 0x7f73980b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f7395e00640 1 -- 172.21.15.5:0/780906987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7398157d00 con 0x7f739809aca0 2024-08-18T22:25:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f7395e00640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739809aca0 0x7f7398160050 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f73880b0040 tx=0x7f7388019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f738e000640 1 -- 172.21.15.5:0/780906987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73880bd070 con 0x7f739809aca0 2024-08-18T22:25:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f738e000640 1 -- 172.21.15.5:0/780906987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73880ade10 con 0x7f739809aca0 2024-08-18T22:25:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f738e000640 1 -- 172.21.15.5:0/780906987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73880b2040 con 0x7f739809aca0 2024-08-18T22:25:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f739d200640 1 -- 172.21.15.5:0/780906987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7398157fe0 con 0x7f739809aca0 2024-08-18T22:25:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.197+0000 7f739d200640 1 -- 172.21.15.5:0/780906987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73980cb6c0 con 0x7f739809aca0 2024-08-18T22:25:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.201+0000 7f739d200640 1 -- 172.21.15.5:0/780906987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7398162100 con 0x7f739809aca0 2024-08-18T22:25:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.201+0000 7f738e000640 1 -- 172.21.15.5:0/780906987 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73880ab950 con 0x7f739809aca0 2024-08-18T22:25:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.201+0000 7f738e000640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73780678f0 0x7f7378069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.201+0000 7f738e000640 1 -- 172.21.15.5:0/780906987 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5507+0+0 (secure 0 0 0) 0x7f738811f760 con 0x7f739809aca0 2024-08-18T22:25:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.201+0000 7f7395400640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73780678f0 0x7f7378069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.201+0000 7f7395400640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73780678f0 0x7f7378069db0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f73981f8230 tx=0x7f7384009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.205+0000 7f738e000640 1 -- 172.21.15.5:0/780906987 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f73880160d0 con 0x7f739809aca0 2024-08-18T22:25:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.369+0000 7f739d200640 1 -- 172.21.15.5:0/780906987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f73981524c0 con 0x7f739809aca0 2024-08-18T22:25:21.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.369+0000 7f738e000640 1 -- 172.21.15.5:0/780906987 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) ==== 93+0+10 (secure 0 0 0) 0x7f73880efe20 con 0x7f739809aca0 2024-08-18T22:25:21.371 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:25:21.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 -- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73780678f0 msgr2=0x7f7378069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73780678f0 0x7f7378069db0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f73981f8230 tx=0x7f7384009060 comp rx=0 tx=0).stop 2024-08-18T22:25:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 -- 172.21.15.5:0/780906987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739809aca0 msgr2=0x7f7398160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739809aca0 0x7f7398160050 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f73880b0040 tx=0x7f7388019280 comp rx=0 tx=0).stop 2024-08-18T22:25:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 -- 172.21.15.5:0/780906987 shutdown_connections 2024-08-18T22:25:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73780678f0 0x7f7378069db0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73980b1300 0x7f73980b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f739809b080 0x7f73980b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 --2- 172.21.15.5:0/780906987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f739809aca0 0x7f7398160050 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 -- 172.21.15.5:0/780906987 >> 172.21.15.5:0/780906987 conn(0x7f73980d2180 msgr2=0x7f73980d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 -- 172.21.15.5:0/780906987 shutdown_connections 2024-08-18T22:25:21.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.373+0000 7f739d200640 1 -- 172.21.15.5:0/780906987 wait complete. 2024-08-18T22:25:21.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-08-18T22:25:21.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa617200640 1 Processor -- start 2024-08-18T22:25:21.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa617200640 1 -- start start 2024-08-18T22:25:21.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa617200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6100cde30 0x7fa61015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa617200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6100b4510 0x7fa6100cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa617200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6100ccd90 con 0x7fa61009aa40 2024-08-18T22:25:21.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa617200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa6100ce770 con 0x7fa6100cde30 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa617200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa61015d520 con 0x7fa6100b4510 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa615400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6100cde30 0x7fa61015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa615e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa61009aa40 0x7fa61009ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46722/0 (socket says 172.21.15.5:46722) 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa615400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6100cde30 0x7fa61015cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37532/0 (socket says 172.21.15.5:37532) 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa615e00640 1 -- 172.21.15.5:0/2345438989 learned_addr learned my addr 172.21.15.5:0/2345438989 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa616800640 1 --2- 172.21.15.5:0/2345438989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6100b4510 0x7fa6100cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa615400640 1 -- 172.21.15.5:0/2345438989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6100b4510 msgr2=0x7fa6100cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa615400640 1 --2- 172.21.15.5:0/2345438989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6100b4510 0x7fa6100cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa615400640 1 -- 172.21.15.5:0/2345438989 >> v1:172.21.15.5:6789/0 conn(0x7fa61009aa40 legacy=0x7fa61009ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa615400640 1 -- 172.21.15.5:0/2345438989 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6100cd070 con 0x7fa6100cde30 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa616800640 1 --2- 172.21.15.5:0/2345438989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6100b4510 0x7fa6100cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.533+0000 7fa614a00640 1 -- 172.21.15.5:0/2345438989 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062851761 0 0) 0x7fa6100ccd90 con 0x7fa61009aa40 2024-08-18T22:25:21.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa615400640 1 --2- 172.21.15.5:0/2345438989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6100cde30 0x7fa61015cfe0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa6000097c0 tx=0x7fa60001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d93defc97db00a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:21.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa614a00640 1 -- 172.21.15.5:0/2345438989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6000a7070 con 0x7fa6100cde30 2024-08-18T22:25:21.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa614a00640 1 -- 172.21.15.5:0/2345438989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6000b0070 con 0x7fa6100cde30 2024-08-18T22:25:21.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa614a00640 1 -- 172.21.15.5:0/2345438989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6000ab890 con 0x7fa6100cde30 2024-08-18T22:25:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa617200640 1 -- 172.21.15.5:0/2345438989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6100cde30 msgr2=0x7fa61015cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa617200640 1 --2- 172.21.15.5:0/2345438989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6100cde30 0x7fa61015cfe0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa6000097c0 tx=0x7fa60001c470 comp rx=0 tx=0).stop 2024-08-18T22:25:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa617200640 1 -- 172.21.15.5:0/2345438989 shutdown_connections 2024-08-18T22:25:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa617200640 1 --2- 172.21.15.5:0/2345438989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6100b4510 0x7fa6100cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa617200640 1 --2- 172.21.15.5:0/2345438989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6100cde30 0x7fa61015cfe0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa617200640 1 -- 172.21.15.5:0/2345438989 >> 172.21.15.5:0/2345438989 conn(0x7fa6100b3a20 msgr2=0x7fa6100b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa617200640 1 -- 172.21.15.5:0/2345438989 shutdown_connections 2024-08-18T22:25:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa617200640 1 -- 172.21.15.5:0/2345438989 wait complete. 2024-08-18T22:25:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa617200640 1 Processor -- start 2024-08-18T22:25:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.537+0000 7fa617200640 1 -- start start 2024-08-18T22:25:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa617200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61009aa40 0x7fa6101fa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa617200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6100b4510 0x7fa610159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa617200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6100cde30 0x7fa610151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa617200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa61015c3b0 con 0x7fa6100cde30 2024-08-18T22:25:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa617200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa61015c230 con 0x7fa6100b4510 2024-08-18T22:25:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa617200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa610168e40 con 0x7fa61009aa40 2024-08-18T22:25:21.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa616800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6100cde30 0x7fa610151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa616800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6100cde30 0x7fa610151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37540/0 (socket says 172.21.15.5:37540) 2024-08-18T22:25:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa616800640 1 -- 172.21.15.5:0/493018936 learned_addr learned my addr 172.21.15.5:0/493018936 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa615e00640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61009aa40 0x7fa6101fa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa615400640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6100b4510 0x7fa610159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa616800640 1 -- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61009aa40 msgr2=0x7fa6101fa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa616800640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61009aa40 0x7fa6101fa810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa616800640 1 -- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6100b4510 msgr2=0x7fa610159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa616800640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6100b4510 0x7fa610159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa616800640 1 -- 172.21.15.5:0/493018936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6101fb6d0 con 0x7fa6100cde30 2024-08-18T22:25:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa616800640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6100cde30 0x7fa610151250 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009fd0 tx=0x7fa60c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:21.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa60a000640 1 -- 172.21.15.5:0/493018936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c01a070 con 0x7fa6100cde30 2024-08-18T22:25:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa60a000640 1 -- 172.21.15.5:0/493018936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa60c003bc0 con 0x7fa6100cde30 2024-08-18T22:25:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa60a000640 1 -- 172.21.15.5:0/493018936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c004030 con 0x7fa6100cde30 2024-08-18T22:25:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa617200640 1 -- 172.21.15.5:0/493018936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6101fb110 con 0x7fa6100cde30 2024-08-18T22:25:21.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa617200640 1 -- 172.21.15.5:0/493018936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa610155520 con 0x7fa6100cde30 2024-08-18T22:25:21.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.541+0000 7fa617200640 1 -- 172.21.15.5:0/493018936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6100cfb00 con 0x7fa6100cde30 2024-08-18T22:25:21.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.545+0000 7fa60a000640 1 -- 172.21.15.5:0/493018936 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa60c01d070 con 0x7fa6100cde30 2024-08-18T22:25:21.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.545+0000 7fa60a000640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5f40678c0 0x7fa5f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:21.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.545+0000 7fa60a000640 1 -- 172.21.15.5:0/493018936 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5507+0+0 (secure 0 0 0) 0x7fa60c085fb0 con 0x7fa6100cde30 2024-08-18T22:25:21.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.545+0000 7fa615e00640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5f40678c0 0x7fa5f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:21.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.545+0000 7fa615e00640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5f40678c0 0x7fa5f4069d80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa604000f70 tx=0x7fa604007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:21.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.549+0000 7fa60a000640 1 -- 172.21.15.5:0/493018936 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa60c010070 con 0x7fa6100cde30 2024-08-18T22:25:21.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:21.777+0000 7fa617200640 1 -- 172.21.15.5:0/493018936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7fa610073d40 con 0x7fa6100cde30 2024-08-18T22:25:22.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:25:22.415 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:25:22.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.685+0000 7fa60a000640 1 -- 172.21.15.5:0/493018936 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v315) ==== 161+0+0 (secure 0 0 0) 0x7fa60c056b10 con 0x7fa6100cde30 2024-08-18T22:25:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.685+0000 7fa617200640 1 -- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5f40678c0 msgr2=0x7fa5f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.685+0000 7fa617200640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5f40678c0 0x7fa5f4069d80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa604000f70 tx=0x7fa604007b60 comp rx=0 tx=0).stop 2024-08-18T22:25:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.685+0000 7fa617200640 1 -- 172.21.15.5:0/493018936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6100cde30 msgr2=0x7fa610151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.685+0000 7fa617200640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6100cde30 0x7fa610151250 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009fd0 tx=0x7fa60c00d560 comp rx=0 tx=0).stop 2024-08-18T22:25:22.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.685+0000 7fa617200640 1 -- 172.21.15.5:0/493018936 shutdown_connections 2024-08-18T22:25:22.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.685+0000 7fa617200640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5f40678c0 0x7fa5f4069d80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:22.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.685+0000 7fa617200640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6100cde30 0x7fa610151250 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:22.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.685+0000 7fa617200640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6100b4510 0x7fa610159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:22.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.685+0000 7fa617200640 1 --2- 172.21.15.5:0/493018936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61009aa40 0x7fa6101fa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:22.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.685+0000 7fa617200640 1 -- 172.21.15.5:0/493018936 >> 172.21.15.5:0/493018936 conn(0x7fa6100b3a20 msgr2=0x7fa610159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:22.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.689+0000 7fa617200640 1 -- 172.21.15.5:0/493018936 shutdown_connections 2024-08-18T22:25:22.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.689+0000 7fa617200640 1 -- 172.21.15.5:0/493018936 wait complete. 2024-08-18T22:25:22.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:25:22.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7de00640 1 Processor -- start 2024-08-18T22:25:22.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7de00640 1 -- start start 2024-08-18T22:25:22.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec7815bd70 0x7fec780d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:22.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7de00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec780d2420 0x7fec78071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:22.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7de00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec780d1980 con 0x7fec780719d0 2024-08-18T22:25:22.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7de00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fec780722f0 con 0x7fec7815bd70 2024-08-18T22:25:22.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7de00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fec780d1f90 con 0x7fec780d2420 2024-08-18T22:25:22.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec7815bd70 0x7fec780d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:22.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec7815bd70 0x7fec780d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37550/0 (socket says 172.21.15.5:37550) 2024-08-18T22:25:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7ca00640 1 -- 172.21.15.5:0/2461954226 learned_addr learned my addr 172.21.15.5:0/2461954226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec6fe00640 1 --2- 172.21.15.5:0/2461954226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec780d2420 0x7fec78071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7ca00640 1 -- 172.21.15.5:0/2461954226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec780d2420 msgr2=0x7fec78071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7ca00640 1 --2- 172.21.15.5:0/2461954226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec780d2420 0x7fec78071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7ca00640 1 -- 172.21.15.5:0/2461954226 >> v1:172.21.15.117:6789/0 conn(0x7fec780719d0 legacy=0x7fec780b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:22.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec7ca00640 1 -- 172.21.15.5:0/2461954226 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec780b5480 con 0x7fec7815bd70 2024-08-18T22:25:22.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.861+0000 7fec6fe00640 1 --2- 172.21.15.5:0/2461954226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec780d2420 0x7fec78071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:22.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec7ca00640 1 --2- 172.21.15.5:0/2461954226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7815bd70 0x7fec780d0610 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fec68009870 tx=0x7fec6801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0eb8853ab0c638 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec77e00640 1 -- 172.21.15.5:0/2461954226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec680b0070 con 0x7fec7815bd70 2024-08-18T22:25:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec77e00640 1 -- 172.21.15.5:0/2461954226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec680ab600 con 0x7fec7815bd70 2024-08-18T22:25:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec77e00640 1 -- 172.21.15.5:0/2461954226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec680ab9d0 con 0x7fec7815bd70 2024-08-18T22:25:22.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec7de00640 1 -- 172.21.15.5:0/2461954226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7815bd70 msgr2=0x7fec780d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:22.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec7de00640 1 --2- 172.21.15.5:0/2461954226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7815bd70 0x7fec780d0610 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fec68009870 tx=0x7fec6801c490 comp rx=0 tx=0).stop 2024-08-18T22:25:22.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec7de00640 1 -- 172.21.15.5:0/2461954226 shutdown_connections 2024-08-18T22:25:22.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec7de00640 1 --2- 172.21.15.5:0/2461954226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec780d2420 0x7fec78071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:22.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec7de00640 1 --2- 172.21.15.5:0/2461954226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7815bd70 0x7fec780d0610 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:22.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec7de00640 1 -- 172.21.15.5:0/2461954226 >> 172.21.15.5:0/2461954226 conn(0x7fec780b3da0 msgr2=0x7fec780b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:22.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec7de00640 1 -- 172.21.15.5:0/2461954226 shutdown_connections 2024-08-18T22:25:22.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.865+0000 7fec7de00640 1 -- 172.21.15.5:0/2461954226 wait complete. 2024-08-18T22:25:22.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7de00640 1 Processor -- start 2024-08-18T22:25:22.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7de00640 1 -- start start 2024-08-18T22:25:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec780719d0 0x7fec78152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7de00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec780d2420 0x7fec78154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7de00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815bd70 0x7fec78155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7de00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec780d0b50 con 0x7fec780719d0 2024-08-18T22:25:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7de00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fec780b5760 con 0x7fec780d2420 2024-08-18T22:25:22.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7de00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fec780b50a0 con 0x7fec7815bd70 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec780719d0 0x7fec78152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec780719d0 0x7fec78152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37566/0 (socket says 172.21.15.5:37566) 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7ca00640 1 -- 172.21.15.5:0/4078796630 learned_addr learned my addr 172.21.15.5:0/4078796630 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec6fe00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec780d2420 0x7fec78154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7d400640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815bd70 0x7fec78155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7ca00640 1 -- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815bd70 msgr2=0x7fec78155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7ca00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815bd70 0x7fec78155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7ca00640 1 -- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec780d2420 msgr2=0x7fec78154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7ca00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec780d2420 0x7fec78154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7ca00640 1 -- 172.21.15.5:0/4078796630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec78151b50 con 0x7fec780719d0 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7d400640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815bd70 0x7fec78155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7ca00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec780719d0 0x7fec78152ed0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fec6801ab40 tx=0x7fec68019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec75600640 1 -- 172.21.15.5:0/4078796630 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec680b0040 con 0x7fec780719d0 2024-08-18T22:25:22.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec75600640 1 -- 172.21.15.5:0/4078796630 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec680b4620 con 0x7fec780719d0 2024-08-18T22:25:22.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec75600640 1 -- 172.21.15.5:0/4078796630 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec680b4a10 con 0x7fec780719d0 2024-08-18T22:25:22.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7de00640 1 -- 172.21.15.5:0/4078796630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec78151e30 con 0x7fec780719d0 2024-08-18T22:25:22.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7de00640 1 -- 172.21.15.5:0/4078796630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec781523f0 con 0x7fec780719d0 2024-08-18T22:25:22.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.869+0000 7fec7de00640 1 -- 172.21.15.5:0/4078796630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec78071490 con 0x7fec780719d0 2024-08-18T22:25:22.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.873+0000 7fec75600640 1 -- 172.21.15.5:0/4078796630 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec680ab4c0 con 0x7fec780719d0 2024-08-18T22:25:22.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.873+0000 7fec75600640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec540678f0 0x7fec54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:22.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.873+0000 7fec75600640 1 -- 172.21.15.5:0/4078796630 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5507+0+0 (secure 0 0 0) 0x7fec6811f840 con 0x7fec780719d0 2024-08-18T22:25:22.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.873+0000 7fec6fe00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec540678f0 0x7fec54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:22.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.873+0000 7fec6fe00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec540678f0 0x7fec54069db0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fec780b8030 tx=0x7fec60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:22.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:22.877+0000 7fec75600640 1 -- 172.21.15.5:0/4078796630 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fec68016110 con 0x7fec780719d0 2024-08-18T22:25:23.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.041+0000 7fec7de00640 1 -- 172.21.15.5:0/4078796630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fec78070a80 con 0x7fec780719d0 2024-08-18T22:25:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.045+0000 7fec75600640 1 -- 172.21.15.5:0/4078796630 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7fec6811f070 con 0x7fec780719d0 2024-08-18T22:25:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 -- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec540678f0 msgr2=0x7fec54069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec540678f0 0x7fec54069db0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fec780b8030 tx=0x7fec60008040 comp rx=0 tx=0).stop 2024-08-18T22:25:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 -- 172.21.15.5:0/4078796630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec780719d0 msgr2=0x7fec78152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec780719d0 0x7fec78152ed0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fec6801ab40 tx=0x7fec68019230 comp rx=0 tx=0).stop 2024-08-18T22:25:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 -- 172.21.15.5:0/4078796630 shutdown_connections 2024-08-18T22:25:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fec540678f0 0x7fec54069db0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7815bd70 0x7fec78155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec780d2420 0x7fec78154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 --2- 172.21.15.5:0/4078796630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec780719d0 0x7fec78152ed0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 -- 172.21.15.5:0/4078796630 >> 172.21.15.5:0/4078796630 conn(0x7fec780b3da0 msgr2=0x7fec7806fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 -- 172.21.15.5:0/4078796630 shutdown_connections 2024-08-18T22:25:23.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.049+0000 7fec7de00640 1 -- 172.21.15.5:0/4078796630 wait complete. 2024-08-18T22:25:23.069 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:25:23.069 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:25:23.150 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:25:23.249 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:25:23.249 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:25:23.249 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:25:23.258 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:25:23.258 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:25:23.258 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:25:23.267 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:25:23.267 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:25:23.267 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:25:23.307 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:25:23.307 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:25:23.307 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:25:23.317 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:25:23.318 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:25:23.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.489+0000 7f4b28c00640 1 Processor -- start 2024-08-18T22:25:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.489+0000 7f4b28c00640 1 -- start start 2024-08-18T22:25:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b28c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b2415bed0 0x7f4b240735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b28c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b240cb390 0x7f4b24071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b28c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b24072060 con 0x7f4b2406da70 2024-08-18T22:25:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b28c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4b24073c80 con 0x7f4b2415bed0 2024-08-18T22:25:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b28c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4b240ca5d0 con 0x7f4b240cb390 2024-08-18T22:25:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b21e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b2415bed0 0x7f4b240735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b21e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b2415bed0 0x7f4b240735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37570/0 (socket says 172.21.15.5:37570) 2024-08-18T22:25:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b22800640 1 --1- 172.21.15.5:0/4090334567 >> v1:172.21.15.5:6789/0 conn(0x7f4b2406da70 0x7f4b240cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46726/0 (socket says 172.21.15.5:46726) 2024-08-18T22:25:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b21e00640 1 -- 172.21.15.5:0/4090334567 learned_addr learned my addr 172.21.15.5:0/4090334567 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b19400640 1 --2- 172.21.15.5:0/4090334567 >> v2:172.21.15.117:3300/0 conn(0x7f4b240cb390 0x7f4b24071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b21e00640 1 -- 172.21.15.5:0/4090334567 >> v2:172.21.15.117:3300/0 conn(0x7f4b240cb390 msgr2=0x7f4b24071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b21e00640 1 --2- 172.21.15.5:0/4090334567 >> v2:172.21.15.117:3300/0 conn(0x7f4b240cb390 0x7f4b24071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b21e00640 1 -- 172.21.15.5:0/4090334567 >> v1:172.21.15.5:6789/0 conn(0x7f4b2406da70 legacy=0x7f4b240cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b21e00640 1 -- 172.21.15.5:0/4090334567 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b240ca8b0 con 0x7f4b2415bed0 2024-08-18T22:25:23.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.493+0000 7f4b21400640 1 -- 172.21.15.5:0/4090334567 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194880969 0 0) 0x7f4b24072060 con 0x7f4b2406da70 2024-08-18T22:25:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b21e00640 1 --2- 172.21.15.5:0/4090334567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2415bed0 0x7f4b240735a0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f4b2406ee10 tx=0x7f4b1401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5ca12fad4288ac server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b21400640 1 -- 172.21.15.5:0/4090334567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b140aa650 con 0x7f4b2415bed0 2024-08-18T22:25:23.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b21400640 1 -- 172.21.15.5:0/4090334567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b140af070 con 0x7f4b2415bed0 2024-08-18T22:25:23.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b21400640 1 -- 172.21.15.5:0/4090334567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b140aaa10 con 0x7f4b2415bed0 2024-08-18T22:25:23.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b28c00640 1 -- 172.21.15.5:0/4090334567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2415bed0 msgr2=0x7f4b240735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b28c00640 1 --2- 172.21.15.5:0/4090334567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2415bed0 0x7f4b240735a0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f4b2406ee10 tx=0x7f4b1401c4f0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b28c00640 1 -- 172.21.15.5:0/4090334567 shutdown_connections 2024-08-18T22:25:23.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b28c00640 1 --2- 172.21.15.5:0/4090334567 >> v2:172.21.15.117:3300/0 conn(0x7f4b240cb390 0x7f4b24071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b28c00640 1 --2- 172.21.15.5:0/4090334567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2415bed0 0x7f4b240735a0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b28c00640 1 -- 172.21.15.5:0/4090334567 >> 172.21.15.5:0/4090334567 conn(0x7f4b240b1c50 msgr2=0x7f4b240b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:23.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b28c00640 1 -- 172.21.15.5:0/4090334567 shutdown_connections 2024-08-18T22:25:23.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b28c00640 1 -- 172.21.15.5:0/4090334567 wait complete. 2024-08-18T22:25:23.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b28c00640 1 Processor -- start 2024-08-18T22:25:23.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.497+0000 7f4b28c00640 1 -- start start 2024-08-18T22:25:23.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b28c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2406da70 0x7f4b241f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b28c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b240cb390 0x7f4b2409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b28c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2415bed0 0x7f4b2414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b28c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2415c430 con 0x7f4b2415bed0 2024-08-18T22:25:23.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b28c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2415c2b0 con 0x7f4b240cb390 2024-08-18T22:25:23.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b28c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4b24168ba0 con 0x7f4b2406da70 2024-08-18T22:25:23.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b22800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2415bed0 0x7f4b2414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:23.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b22800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2415bed0 0x7f4b2414a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37576/0 (socket says 172.21.15.5:37576) 2024-08-18T22:25:23.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b22800640 1 -- 172.21.15.5:0/2398096624 learned_addr learned my addr 172.21.15.5:0/2398096624 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:23.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b22800640 1 -- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2406da70 msgr2=0x7f4b241f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b22800640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2406da70 0x7f4b241f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b22800640 1 -- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b240cb390 msgr2=0x7f4b2409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b22800640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b240cb390 0x7f4b2409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b22800640 1 -- 172.21.15.5:0/2398096624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2409b340 con 0x7f4b2415bed0 2024-08-18T22:25:23.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b22800640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2415bed0 0x7f4b2414a5e0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c7a0 tx=0x7f4b1c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:23.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b1aa00640 1 -- 172.21.15.5:0/2398096624 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c018070 con 0x7f4b2415bed0 2024-08-18T22:25:23.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b1aa00640 1 -- 172.21.15.5:0/2398096624 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c00a640 con 0x7f4b2415bed0 2024-08-18T22:25:23.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b1aa00640 1 -- 172.21.15.5:0/2398096624 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00aab0 con 0x7f4b2415bed0 2024-08-18T22:25:23.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b28c00640 1 -- 172.21.15.5:0/2398096624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2409b620 con 0x7f4b2415bed0 2024-08-18T22:25:23.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b28c00640 1 -- 172.21.15.5:0/2398096624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b240b33e0 con 0x7f4b2415bed0 2024-08-18T22:25:23.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b28c00640 1 -- 172.21.15.5:0/2398096624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b240735a0 con 0x7f4b2415bed0 2024-08-18T22:25:23.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.501+0000 7f4b1aa00640 1 -- 172.21.15.5:0/2398096624 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b1c01b070 con 0x7f4b2415bed0 2024-08-18T22:25:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.505+0000 7f4b1aa00640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b000678c0 0x7f4b00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.505+0000 7f4b1aa00640 1 -- 172.21.15.5:0/2398096624 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5507+0+0 (secure 0 0 0) 0x7f4b1c085260 con 0x7f4b2415bed0 2024-08-18T22:25:23.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.505+0000 7f4b21e00640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b000678c0 0x7f4b00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:23.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.505+0000 7f4b21e00640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b000678c0 0x7f4b00069d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4b140ae000 tx=0x7f4b14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:23.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.509+0000 7f4b1aa00640 1 -- 172.21.15.5:0/2398096624 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4b1c055e50 con 0x7f4b2415bed0 2024-08-18T22:25:23.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.709+0000 7f4b28c00640 1 -- 172.21.15.5:0/2398096624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b240ca3b0 con 0x7f4b2415bed0 2024-08-18T22:25:23.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.709+0000 7f4b1aa00640 1 -- 172.21.15.5:0/2398096624 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+3908 (secure 0 0 0) 0x7f4b1c055750 con 0x7f4b2415bed0 2024-08-18T22:25:23.711 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:23.711 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"btime":"2024-08-18T22:25:16:372548+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6482,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1436391401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1436391401},{"type":"v1","addr":"172.21.15.117:6835","nonce":1436391401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/643889741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":643889741},{"type":"v1","addr":"172.21.15.117:6837","nonce":643889741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/2830021009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2830021009},{"type":"v1","addr":"172.21.15.5:6833","nonce":2830021009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7635,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2264334285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2264334285},{"type":"v1","addr":"172.21.15.5:6835","nonce":2264334285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[]} 2024-08-18T22:25:23.711 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 83 2024-08-18T22:25:23.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 -- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b000678c0 msgr2=0x7f4b00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b000678c0 0x7f4b00069d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4b140ae000 tx=0x7f4b14008040 comp rx=0 tx=0).stop 2024-08-18T22:25:23.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 -- 172.21.15.5:0/2398096624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2415bed0 msgr2=0x7f4b2414a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2415bed0 0x7f4b2414a5e0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c7a0 tx=0x7f4b1c00cc60 comp rx=0 tx=0).stop 2024-08-18T22:25:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 -- 172.21.15.5:0/2398096624 shutdown_connections 2024-08-18T22:25:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b000678c0 0x7f4b00069d80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b2415bed0 0x7f4b2414a5e0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b240cb390 0x7f4b2409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 --2- 172.21.15.5:0/2398096624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2406da70 0x7f4b241f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 -- 172.21.15.5:0/2398096624 >> 172.21.15.5:0/2398096624 conn(0x7f4b240b1c50 msgr2=0x7f4b240ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 -- 172.21.15.5:0/2398096624 shutdown_connections 2024-08-18T22:25:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.713+0000 7f4b28c00640 1 -- 172.21.15.5:0/2398096624 wait complete. 2024-08-18T22:25:23.734 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:25:23.734 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:25:23.734 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:25:23.734 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:25:23.735 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:25:23.735 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:25:23.735 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:25:23.735 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:25:23.735 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:25:23.735 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:25:23.735 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:25:23.735 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:25:23.736 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:25:23.736 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:25:23.736 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:25:23.736 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:25:23.746 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:25:23.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:25:23.748 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:25:23.748 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:25:23.752 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:25:23.752 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:25:23.753 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:25:23.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:25:23.793 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:25:23.794 DEBUG:teuthology.parallel:result is None 2024-08-18T22:25:23.795 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:25:23.796 DEBUG:teuthology.parallel:result is None 2024-08-18T22:25:23.801 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:25:23.801 DEBUG:teuthology.parallel:result is None 2024-08-18T22:25:23.802 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:25:23.802 DEBUG:teuthology.parallel:result is None 2024-08-18T22:25:23.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:25:23.881 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:25:23.881 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:25:23.892 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:25:23.892 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:25:23.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.949+0000 7f01c8200640 1 Processor -- start 2024-08-18T22:25:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.949+0000 7f01c8200640 1 -- start start 2024-08-18T22:25:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.949+0000 7f01c8200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01c015b0c0 0x7f01c006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.949+0000 7f01c8200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01c00cf290 0x7f01c00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.949+0000 7f01c8200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c00b31f0 con 0x7f01c00b40c0 2024-08-18T22:25:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.949+0000 7f01c8200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f01c00b4a70 con 0x7f01c00cf290 2024-08-18T22:25:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.949+0000 7f01c8200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f01c00b3d70 con 0x7f01c015b0c0 2024-08-18T22:25:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.949+0000 7f01c6200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01c00cf290 0x7f01c00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:23.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.949+0000 7f01c6200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01c00cf290 0x7f01c00b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37942/0 (socket says 172.21.15.5:37942) 2024-08-18T22:25:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.949+0000 7f01c6200640 1 -- 172.21.15.5:0/3000013261 learned_addr learned my addr 172.21.15.5:0/3000013261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.949+0000 7f01c5800640 1 --2- 172.21.15.5:0/3000013261 >> v2:172.21.15.117:3300/0 conn(0x7f01c015b0c0 0x7f01c006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c6200640 1 -- 172.21.15.5:0/3000013261 >> v2:172.21.15.117:3300/0 conn(0x7f01c015b0c0 msgr2=0x7f01c006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c6200640 1 --2- 172.21.15.5:0/3000013261 >> v2:172.21.15.117:3300/0 conn(0x7f01c015b0c0 0x7f01c006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c6200640 1 -- 172.21.15.5:0/3000013261 >> v1:172.21.15.117:6789/0 conn(0x7f01c00b40c0 legacy=0x7f01c0072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c6200640 1 -- 172.21.15.5:0/3000013261 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c00b34d0 con 0x7f01c00cf290 2024-08-18T22:25:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c5800640 1 --2- 172.21.15.5:0/3000013261 >> v2:172.21.15.117:3300/0 conn(0x7f01c015b0c0 0x7f01c006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:23.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c6200640 1 --2- 172.21.15.5:0/3000013261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c00cf290 0x7f01c00b4530 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f01c0070ba0 tx=0x7f01b801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9572b4d8e5de7cb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01bfe00640 1 -- 172.21.15.5:0/3000013261 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80a5760 con 0x7f01c00cf290 2024-08-18T22:25:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01bfe00640 1 -- 172.21.15.5:0/3000013261 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b80a5900 con 0x7f01c00cf290 2024-08-18T22:25:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01bfe00640 1 -- 172.21.15.5:0/3000013261 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80a5cd0 con 0x7f01c00cf290 2024-08-18T22:25:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c8200640 1 -- 172.21.15.5:0/3000013261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c00cf290 msgr2=0x7f01c00b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c8200640 1 --2- 172.21.15.5:0/3000013261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c00cf290 0x7f01c00b4530 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f01c0070ba0 tx=0x7f01b801c8a0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c8200640 1 -- 172.21.15.5:0/3000013261 shutdown_connections 2024-08-18T22:25:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c8200640 1 --2- 172.21.15.5:0/3000013261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c00cf290 0x7f01c00b4530 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c8200640 1 --2- 172.21.15.5:0/3000013261 >> v2:172.21.15.117:3300/0 conn(0x7f01c015b0c0 0x7f01c006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.953+0000 7f01c8200640 1 -- 172.21.15.5:0/3000013261 >> 172.21.15.5:0/3000013261 conn(0x7f01c00b1dc0 msgr2=0x7f01c00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c8200640 1 -- 172.21.15.5:0/3000013261 shutdown_connections 2024-08-18T22:25:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c8200640 1 -- 172.21.15.5:0/3000013261 wait complete. 2024-08-18T22:25:23.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c8200640 1 Processor -- start 2024-08-18T22:25:23.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c8200640 1 -- start start 2024-08-18T22:25:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c8200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c00b40c0 0x7f01c0156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c8200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00cf290 0x7f01c0154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c8200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c015b0c0 0x7f01c0143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c8200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f01c015b620 con 0x7f01c00b40c0 2024-08-18T22:25:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c8200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f01c015b4a0 con 0x7f01c015b0c0 2024-08-18T22:25:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c8200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f01c006f670 con 0x7f01c00cf290 2024-08-18T22:25:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c00b40c0 0x7f01c0156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c5800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c00b40c0 0x7f01c0156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37950/0 (socket says 172.21.15.5:37950) 2024-08-18T22:25:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c5800640 1 -- 172.21.15.5:0/859984201 learned_addr learned my addr 172.21.15.5:0/859984201 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c6200640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c015b0c0 0x7f01c0143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c4e00640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00cf290 0x7f01c0154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c5800640 1 -- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00cf290 msgr2=0x7f01c0154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c5800640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00cf290 0x7f01c0154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c5800640 1 -- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c015b0c0 msgr2=0x7f01c0143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c5800640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c015b0c0 0x7f01c0143160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c5800640 1 -- 172.21.15.5:0/859984201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c0158270 con 0x7f01c00b40c0 2024-08-18T22:25:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c6200640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c015b0c0 0x7f01c0143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:25:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.957+0000 7f01c5800640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c00b40c0 0x7f01c0156b60 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f01b400d830 tx=0x7f01b400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.961+0000 7f01bd600640 1 -- 172.21.15.5:0/859984201 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b4018020 con 0x7f01c00b40c0 2024-08-18T22:25:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.961+0000 7f01bd600640 1 -- 172.21.15.5:0/859984201 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b40096c0 con 0x7f01c00b40c0 2024-08-18T22:25:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.961+0000 7f01bd600640 1 -- 172.21.15.5:0/859984201 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b4009ab0 con 0x7f01c00b40c0 2024-08-18T22:25:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.961+0000 7f01c8200640 1 -- 172.21.15.5:0/859984201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c01571d0 con 0x7f01c00b40c0 2024-08-18T22:25:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.961+0000 7f01c8200640 1 -- 172.21.15.5:0/859984201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c0157790 con 0x7f01c00b40c0 2024-08-18T22:25:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.961+0000 7f01c8200640 1 -- 172.21.15.5:0/859984201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c00b4530 con 0x7f01c00b40c0 2024-08-18T22:25:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.961+0000 7f01bd600640 1 -- 172.21.15.5:0/859984201 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f01b401b020 con 0x7f01c00b40c0 2024-08-18T22:25:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.961+0000 7f01bd600640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01a00678c0 0x7f01a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.961+0000 7f01bd600640 1 -- 172.21.15.5:0/859984201 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5507+0+0 (secure 0 0 0) 0x7f01b40861c0 con 0x7f01c00b40c0 2024-08-18T22:25:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.961+0000 7f01c4e00640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01a00678c0 0x7f01a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.965+0000 7f01c4e00640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01a00678c0 0x7f01a0069d80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f01c01fa380 tx=0x7f01ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:23.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:23.965+0000 7f01bd600640 1 -- 172.21.15.5:0/859984201 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f01b4022020 con 0x7f01c00b40c0 2024-08-18T22:25:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.145+0000 7f01c8200640 1 -- 172.21.15.5:0/859984201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f01c01436a0 con 0x7f01c00b40c0 2024-08-18T22:25:24.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.697+0000 7f01bd600640 1 -- 172.21.15.5:0/859984201 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v108) ==== 97+0+0 (secure 0 0 0) 0x7f01b4056760 con 0x7f01c00b40c0 2024-08-18T22:25:24.699 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:25:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 -- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01a00678c0 msgr2=0x7f01a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01a00678c0 0x7f01a0069d80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f01c01fa380 tx=0x7f01ac009040 comp rx=0 tx=0).stop 2024-08-18T22:25:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 -- 172.21.15.5:0/859984201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c00b40c0 msgr2=0x7f01c0156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c00b40c0 0x7f01c0156b60 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f01b400d830 tx=0x7f01b400dcf0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 -- 172.21.15.5:0/859984201 shutdown_connections 2024-08-18T22:25:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f01a00678c0 0x7f01a0069d80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01c015b0c0 0x7f01c0143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01c00cf290 0x7f01c0154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 --2- 172.21.15.5:0/859984201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c00b40c0 0x7f01c0156b60 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 -- 172.21.15.5:0/859984201 >> 172.21.15.5:0/859984201 conn(0x7f01c00b1dc0 msgr2=0x7f01c00af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:24.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 -- 172.21.15.5:0/859984201 shutdown_connections 2024-08-18T22:25:24.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.701+0000 7f01c8200640 1 -- 172.21.15.5:0/859984201 wait complete. 2024-08-18T22:25:24.725 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:25:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.869+0000 7fe979400640 1 Processor -- start 2024-08-18T22:25:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.869+0000 7fe979400640 1 -- start start 2024-08-18T22:25:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.869+0000 7fe979400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe97415b010 0x7fe9740ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.869+0000 7fe979400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe9740cd3a0 0x7fe97406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.869+0000 7fe979400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97406f0c0 0x7fe9740caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe979400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe9740cfa30 con 0x7fe97415b010 2024-08-18T22:25:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe979400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe9740cee20 con 0x7fe9740cd3a0 2024-08-18T22:25:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe979400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe9740cf100 con 0x7fe97406f0c0 2024-08-18T22:25:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe972800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe97415b010 0x7fe9740ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe972800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe97415b010 0x7fe9740ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37966/0 (socket says 172.21.15.5:37966) 2024-08-18T22:25:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe972800640 1 -- 172.21.15.5:0/1957429065 learned_addr learned my addr 172.21.15.5:0/1957429065 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:24.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe971e00640 1 --2- 172.21.15.5:0/1957429065 >> v2:172.21.15.117:3300/0 conn(0x7fe9740cd3a0 0x7fe97406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:24.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe973200640 1 --2- 172.21.15.5:0/1957429065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97406f0c0 0x7fe9740caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:24.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe972800640 1 -- 172.21.15.5:0/1957429065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97406f0c0 msgr2=0x7fe9740caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:24.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe972800640 1 --2- 172.21.15.5:0/1957429065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97406f0c0 0x7fe9740caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe972800640 1 -- 172.21.15.5:0/1957429065 >> v2:172.21.15.117:3300/0 conn(0x7fe9740cd3a0 msgr2=0x7fe97406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:24.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe972800640 1 --2- 172.21.15.5:0/1957429065 >> v2:172.21.15.117:3300/0 conn(0x7fe9740cd3a0 0x7fe97406eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe972800640 1 -- 172.21.15.5:0/1957429065 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9740cf3e0 con 0x7fe97415b010 2024-08-18T22:25:24.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe973200640 1 --2- 172.21.15.5:0/1957429065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97406f0c0 0x7fe9740caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:24.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe972800640 1 --2- 172.21.15.5:0/1957429065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe97415b010 0x7fe9740ce840 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fe9740ca580 tx=0x7fe96401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6dff7aad8a96fa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:24.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.873+0000 7fe971400640 1 -- 172.21.15.5:0/1957429065 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9640b0070 con 0x7fe97415b010 2024-08-18T22:25:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe971400640 1 -- 172.21.15.5:0/1957429065 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9640ab600 con 0x7fe97415b010 2024-08-18T22:25:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe971400640 1 -- 172.21.15.5:0/1957429065 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9640ab9d0 con 0x7fe97415b010 2024-08-18T22:25:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 -- 172.21.15.5:0/1957429065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe97415b010 msgr2=0x7fe9740ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 --2- 172.21.15.5:0/1957429065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe97415b010 0x7fe9740ce840 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fe9740ca580 tx=0x7fe96401c260 comp rx=0 tx=0).stop 2024-08-18T22:25:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 -- 172.21.15.5:0/1957429065 shutdown_connections 2024-08-18T22:25:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 --2- 172.21.15.5:0/1957429065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe97406f0c0 0x7fe9740caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 --2- 172.21.15.5:0/1957429065 >> v2:172.21.15.117:3300/0 conn(0x7fe9740cd3a0 0x7fe97406eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 --2- 172.21.15.5:0/1957429065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe97415b010 0x7fe9740ce840 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 -- 172.21.15.5:0/1957429065 >> 172.21.15.5:0/1957429065 conn(0x7fe9740b1c50 msgr2=0x7fe9740b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 -- 172.21.15.5:0/1957429065 shutdown_connections 2024-08-18T22:25:24.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 -- 172.21.15.5:0/1957429065 wait complete. 2024-08-18T22:25:24.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 Processor -- start 2024-08-18T22:25:24.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 -- start start 2024-08-18T22:25:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe97406f0c0 0x7fe974159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9740cd3a0 0x7fe974072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe97415b010 0x7fe9741495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe9740727a0 con 0x7fe97415b010 2024-08-18T22:25:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe974072620 con 0x7fe97406f0c0 2024-08-18T22:25:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe979400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe974072920 con 0x7fe9740cd3a0 2024-08-18T22:25:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe973200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe97415b010 0x7fe9741495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe973200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe97415b010 0x7fe9741495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37974/0 (socket says 172.21.15.5:37974) 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe973200640 1 -- 172.21.15.5:0/3816495961 learned_addr learned my addr 172.21.15.5:0/3816495961 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe972800640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe97406f0c0 0x7fe974159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.877+0000 7fe971e00640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9740cd3a0 0x7fe974072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe973200640 1 -- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9740cd3a0 msgr2=0x7fe974072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe973200640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9740cd3a0 0x7fe974072f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe973200640 1 -- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe97406f0c0 msgr2=0x7fe974159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe973200640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe97406f0c0 0x7fe974159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe973200640 1 -- 172.21.15.5:0/3816495961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9741549a0 con 0x7fe97415b010 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe972800640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe97406f0c0 0x7fe974159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe973200640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe97415b010 0x7fe9741495e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009fa0 tx=0x7fe96c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe96aa00640 1 -- 172.21.15.5:0/3816495961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c01a070 con 0x7fe97415b010 2024-08-18T22:25:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe96aa00640 1 -- 172.21.15.5:0/3816495961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c003bc0 con 0x7fe97415b010 2024-08-18T22:25:24.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe96aa00640 1 -- 172.21.15.5:0/3816495961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c004030 con 0x7fe97415b010 2024-08-18T22:25:24.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe979400640 1 -- 172.21.15.5:0/3816495961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe974154f60 con 0x7fe97415b010 2024-08-18T22:25:24.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe979400640 1 -- 172.21.15.5:0/3816495961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe974155520 con 0x7fe97415b010 2024-08-18T22:25:24.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe979400640 1 -- 172.21.15.5:0/3816495961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe97406eb80 con 0x7fe97415b010 2024-08-18T22:25:24.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe96aa00640 1 -- 172.21.15.5:0/3816495961 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe96c01d070 con 0x7fe97415b010 2024-08-18T22:25:24.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe96aa00640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9540678c0 0x7fe954069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:24.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe96aa00640 1 -- 172.21.15.5:0/3816495961 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5249+0+0 (secure 0 0 0) 0x7fe96c085ed0 con 0x7fe97415b010 2024-08-18T22:25:24.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.881+0000 7fe972800640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9540678c0 0x7fe954069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:24.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.885+0000 7fe972800640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9540678c0 0x7fe954069d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe9640ad000 tx=0x7fe964008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:24.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:24.885+0000 7fe96aa00640 1 -- 172.21.15.5:0/3816495961 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe96c010070 con 0x7fe97415b010 2024-08-18T22:25:25.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 -- 172.21.15.5:0/3816495961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe9741556f0 con 0x7fe97415b010 2024-08-18T22:25:25.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe96aa00640 1 -- 172.21.15.5:0/3816495961 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fe96c056b30 con 0x7fe97415b010 2024-08-18T22:25:25.108 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:25.109 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:25:25.109 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:25:25.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.109 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:25:25.109 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:25:25.110 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.110 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:25:25.110 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:25:25.110 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:25:25.110 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.110 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.110 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:25:25.110 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:25:25.110 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.111 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:25:25.111 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:25:25.111 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:25:25.111 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.111 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.111 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:25:25.111 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:25:25.112 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.112 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:25:25.112 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:25:25.112 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:25:25.112 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.112 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.112 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:25:25.112 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:25:25.112 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.113 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:25:25.113 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:25:25.113 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:25:25.113 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.113 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:25:25.113 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:25:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:25:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:25:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:25:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:25:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.114 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:25:25.115 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:25:25.115 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.115 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.115 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:25:25.115 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:25:25.115 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.115 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:25:25.115 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:25:25.116 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.116 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:25:25.116 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:25:25.116 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.116 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:25:25.117 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:25:25.117 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.117 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.117 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:25:25.117 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:25:25.117 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.117 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:25:25.117 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:25:25.117 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.118 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.118 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:25:25.118 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:25:25.118 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.118 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:25:25.118 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:25:25.118 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.118 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.119 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:25:25.119 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:25:25.119 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.119 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:25:25.119 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:25:25.119 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.119 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.120 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.122 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:25:25.122 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:25:25.122 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.122 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:25:25.122 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:25:25.122 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:25:25.122 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:25:25.122 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.123 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:25:25.123 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:25:25.123 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.123 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:25:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:25:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:25:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:25:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:25:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:25:25.124 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:25:25.125 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:25:25.126 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:25:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 -- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9540678c0 msgr2=0x7fe954069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9540678c0 0x7fe954069d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe9640ad000 tx=0x7fe964008040 comp rx=0 tx=0).stop 2024-08-18T22:25:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 -- 172.21.15.5:0/3816495961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe97415b010 msgr2=0x7fe9741495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe97415b010 0x7fe9741495e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009fa0 tx=0x7fe96c00d560 comp rx=0 tx=0).stop 2024-08-18T22:25:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 -- 172.21.15.5:0/3816495961 shutdown_connections 2024-08-18T22:25:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe9540678c0 0x7fe954069d80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe97415b010 0x7fe9741495e0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9740cd3a0 0x7fe974072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 --2- 172.21.15.5:0/3816495961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe97406f0c0 0x7fe974159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 -- 172.21.15.5:0/3816495961 >> 172.21.15.5:0/3816495961 conn(0x7fe9740b1c50 msgr2=0x7fe9740b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 -- 172.21.15.5:0/3816495961 shutdown_connections 2024-08-18T22:25:25.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.109+0000 7fe979400640 1 -- 172.21.15.5:0/3816495961 wait complete. 2024-08-18T22:25:25.129 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:25:25.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.269+0000 7f2b79800640 1 Processor -- start 2024-08-18T22:25:25.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.269+0000 7f2b79800640 1 -- start start 2024-08-18T22:25:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.269+0000 7f2b79800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2b7415bed0 0x7f2b740735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.269+0000 7f2b79800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b74073c80 con 0x7f2b740cb390 2024-08-18T22:25:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.269+0000 7f2b79800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b740ca5d0 con 0x7f2b7406da70 2024-08-18T22:25:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.269+0000 7f2b79800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2b740ca8b0 con 0x7f2b7415bed0 2024-08-18T22:25:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.269+0000 7f2b72000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2b740cb390 0x7f2b74071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56128/0 (socket says 172.21.15.5:56128) 2024-08-18T22:25:25.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.269+0000 7f2b72000640 1 -- 172.21.15.5:0/3443996163 learned_addr learned my addr 172.21.15.5:0/3443996163 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:25.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b72a00640 1 --2- 172.21.15.5:0/3443996163 >> v2:172.21.15.117:3300/0 conn(0x7f2b7415bed0 0x7f2b740735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 20114811 0 0) 0x7f2b74073c80 con 0x7f2b740cb390 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b58003530 con 0x7f2b740cb390 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786213920 0 0) 0x7f2b740ca5d0 con 0x7f2b7406da70 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b74073c80 con 0x7f2b7406da70 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1509897738 0 0) 0x7f2b58003530 con 0x7f2b740cb390 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 >> v2:172.21.15.117:3300/0 conn(0x7f2b7415bed0 msgr2=0x7f2b740735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 --2- 172.21.15.5:0/3443996163 >> v2:172.21.15.117:3300/0 conn(0x7f2b7415bed0 0x7f2b740735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 >> v1:172.21.15.117:6789/0 conn(0x7f2b7406da70 legacy=0x7f2b74165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b740cab90 con 0x7f2b740cb390 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f2b60001600 con 0x7f2b740cb390 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b72a00640 1 --2- 172.21.15.5:0/3443996163 >> v2:172.21.15.117:3300/0 conn(0x7f2b7415bed0 0x7f2b740735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 >> v1:172.21.15.5:6789/0 conn(0x7f2b740cb390 legacy=0x7f2b74071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 --2- 172.21.15.5:0/3443996163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 0x7f2b58003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 --2- 172.21.15.5:0/3443996163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b58004810 0x7f2b58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 --2- 172.21.15.5:0/3443996163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b580051d0 0x7f2b5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b740ca8b0 con 0x7f2b58003ba0 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5800c0a0 con 0x7f2b580051d0 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2b5800c2a0 con 0x7f2b58004810 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b72a00640 1 --2- 172.21.15.5:0/3443996163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 0x7f2b58003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b72000640 1 --2- 172.21.15.5:0/3443996163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b58004810 0x7f2b58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b73400640 1 --2- 172.21.15.5:0/3443996163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b580051d0 0x7f2b5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b72a00640 1 -- 172.21.15.5:0/3443996163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b58004810 msgr2=0x7f2b58004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b72a00640 1 --2- 172.21.15.5:0/3443996163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b58004810 0x7f2b58004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b72a00640 1 -- 172.21.15.5:0/3443996163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b580051d0 msgr2=0x7f2b5800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b72a00640 1 --2- 172.21.15.5:0/3443996163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b580051d0 0x7f2b5800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b72a00640 1 -- 172.21.15.5:0/3443996163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b58003530 con 0x7f2b58003ba0 2024-08-18T22:25:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.273+0000 7f2b73400640 1 -- 172.21.15.5:0/3443996163 reap_dead start 2024-08-18T22:25:25.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b72a00640 1 --2- 172.21.15.5:0/3443996163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 0x7f2b58003fa0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009cb0 tx=0x7f2b6401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985699f5d9d3caea server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b640b2070 con 0x7f2b58003ba0 2024-08-18T22:25:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b640a5840 con 0x7f2b58003ba0 2024-08-18T22:25:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b71600640 1 -- 172.21.15.5:0/3443996163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b64009880 con 0x7f2b58003ba0 2024-08-18T22:25:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 -- 172.21.15.5:0/3443996163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 msgr2=0x7f2b58003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 --2- 172.21.15.5:0/3443996163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 0x7f2b58003fa0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009cb0 tx=0x7f2b6401cbe0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 -- 172.21.15.5:0/3443996163 shutdown_connections 2024-08-18T22:25:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 --2- 172.21.15.5:0/3443996163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 0x7f2b58003fa0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 -- 172.21.15.5:0/3443996163 >> 172.21.15.5:0/3443996163 conn(0x7f2b740b1c50 msgr2=0x7f2b740b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 -- 172.21.15.5:0/3443996163 shutdown_connections 2024-08-18T22:25:25.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 -- 172.21.15.5:0/3443996163 wait complete. 2024-08-18T22:25:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 Processor -- start 2024-08-18T22:25:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 -- start start 2024-08-18T22:25:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 0x7f2b741e80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b741e8770 0x7f2b7415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b741577b0 0x7f2b740b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7415c430 con 0x7f2b58003ba0 2024-08-18T22:25:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7415c2b0 con 0x7f2b741577b0 2024-08-18T22:25:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.277+0000 7f2b79800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7406de50 con 0x7f2b741e8770 2024-08-18T22:25:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b72a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 0x7f2b741e80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b72a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 0x7f2b741e80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37990/0 (socket says 172.21.15.5:37990) 2024-08-18T22:25:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b72a00640 1 -- 172.21.15.5:0/2346847271 learned_addr learned my addr 172.21.15.5:0/2346847271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b72000640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b741e8770 0x7f2b7415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b73400640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b741577b0 0x7f2b740b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b72a00640 1 -- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b741e8770 msgr2=0x7f2b7415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b72a00640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b741e8770 0x7f2b7415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b72a00640 1 -- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b741577b0 msgr2=0x7f2b740b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b72a00640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b741577b0 0x7f2b740b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b72a00640 1 -- 172.21.15.5:0/2346847271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7415d700 con 0x7f2b58003ba0 2024-08-18T22:25:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b72000640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b741e8770 0x7f2b7415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:25.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b72a00640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 0x7f2b741e80f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009cb0 tx=0x7f2b58005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b6aa00640 1 -- 172.21.15.5:0/2346847271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b640b2040 con 0x7f2b58003ba0 2024-08-18T22:25:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b6aa00640 1 -- 172.21.15.5:0/2346847271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6400f000 con 0x7f2b58003ba0 2024-08-18T22:25:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b79800640 1 -- 172.21.15.5:0/2346847271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7415e6e0 con 0x7f2b58003ba0 2024-08-18T22:25:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b6aa00640 1 -- 172.21.15.5:0/2346847271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b64004260 con 0x7f2b58003ba0 2024-08-18T22:25:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b79800640 1 -- 172.21.15.5:0/2346847271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7415d9a0 con 0x7f2b58003ba0 2024-08-18T22:25:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b79800640 1 -- 172.21.15.5:0/2346847271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b7406e180 con 0x7f2b58003ba0 2024-08-18T22:25:25.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b6aa00640 1 -- 172.21.15.5:0/2346847271 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b640c0020 con 0x7f2b58003ba0 2024-08-18T22:25:25.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b6aa00640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b540678c0 0x7f2b54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.281+0000 7f2b6aa00640 1 -- 172.21.15.5:0/2346847271 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5249+0+0 (secure 0 0 0) 0x7f2b6411fdc0 con 0x7f2b58003ba0 2024-08-18T22:25:25.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.285+0000 7f2b72000640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b540678c0 0x7f2b54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.285+0000 7f2b72000640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b540678c0 0x7f2b54069d80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2b60001060 tx=0x7f2b60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.285+0000 7f2b6aa00640 1 -- 172.21.15.5:0/2346847271 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2b64016920 con 0x7f2b58003ba0 2024-08-18T22:25:25.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.453+0000 7f2b79800640 1 -- 172.21.15.5:0/2346847271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2b740ca2d0 con 0x7f2b58003ba0 2024-08-18T22:25:25.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.453+0000 7f2b6aa00640 1 -- 172.21.15.5:0/2346847271 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v110) ==== 84+0+65 (secure 0 0 0) 0x7f2b640f0a30 con 0x7f2b58003ba0 2024-08-18T22:25:25.454 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:25.454 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:25:25.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:25:25.454 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:25:25.454 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:25:25.454 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:25:25.455 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:25:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 -- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b540678c0 msgr2=0x7f2b54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b540678c0 0x7f2b54069d80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2b60001060 tx=0x7f2b60009040 comp rx=0 tx=0).stop 2024-08-18T22:25:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 -- 172.21.15.5:0/2346847271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 msgr2=0x7f2b741e80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 0x7f2b741e80f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009cb0 tx=0x7f2b58005840 comp rx=0 tx=0).stop 2024-08-18T22:25:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 -- 172.21.15.5:0/2346847271 shutdown_connections 2024-08-18T22:25:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b540678c0 0x7f2b54069d80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b741577b0 0x7f2b740b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b741e8770 0x7f2b7415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 --2- 172.21.15.5:0/2346847271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b58003ba0 0x7f2b741e80f0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 -- 172.21.15.5:0/2346847271 >> 172.21.15.5:0/2346847271 conn(0x7f2b740b1c50 msgr2=0x7f2b740afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 -- 172.21.15.5:0/2346847271 shutdown_connections 2024-08-18T22:25:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.457+0000 7f2b79800640 1 -- 172.21.15.5:0/2346847271 wait complete. 2024-08-18T22:25:25.475 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:25:25.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:25:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f797aa00640 1 Processor -- start 2024-08-18T22:25:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f797aa00640 1 -- start start 2024-08-18T22:25:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f797aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7974156530 0x7f7974071470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f797aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797415d0f0 0x7f79740719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f797aa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f797415f9d0 0x7f797415fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f797aa00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f797415c370 con 0x7f7974156530 2024-08-18T22:25:25.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f797aa00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7974160700 con 0x7f797415f9d0 2024-08-18T22:25:25.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f797aa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f797415c610 con 0x7f797415d0f0 2024-08-18T22:25:25.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f7979600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7974156530 0x7f7974071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f7979600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7974156530 0x7f7974071470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37996/0 (socket says 172.21.15.5:37996) 2024-08-18T22:25:25.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f7979600640 1 -- 172.21.15.5:0/2406564024 learned_addr learned my addr 172.21.15.5:0/2406564024 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:25.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f7978c00640 1 --2- 172.21.15.5:0/2406564024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797415d0f0 0x7f79740719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f797a000640 1 --2- 172.21.15.5:0/2406564024 >> v2:172.21.15.117:3300/0 conn(0x7f797415f9d0 0x7f797415fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f7979600640 1 -- 172.21.15.5:0/2406564024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797415d0f0 msgr2=0x7f79740719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:25.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f7979600640 1 --2- 172.21.15.5:0/2406564024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797415d0f0 0x7f79740719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f7979600640 1 -- 172.21.15.5:0/2406564024 >> v2:172.21.15.117:3300/0 conn(0x7f797415f9d0 msgr2=0x7f797415fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:25.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f7979600640 1 --2- 172.21.15.5:0/2406564024 >> v2:172.21.15.117:3300/0 conn(0x7f797415f9d0 0x7f797415fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f7979600640 1 -- 172.21.15.5:0/2406564024 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797415c8f0 con 0x7f7974156530 2024-08-18T22:25:25.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.621+0000 7f797a000640 1 --2- 172.21.15.5:0/2406564024 >> v2:172.21.15.117:3300/0 conn(0x7f797415f9d0 0x7f797415fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:25.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f7979600640 1 --2- 172.21.15.5:0/2406564024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7974156530 0x7f7974071470 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f7974142650 tx=0x7f796801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179fd4919dfa4071 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f7973e00640 1 -- 172.21.15.5:0/2406564024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79680aa660 con 0x7f7974156530 2024-08-18T22:25:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f7973e00640 1 -- 172.21.15.5:0/2406564024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79680af070 con 0x7f7974156530 2024-08-18T22:25:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f7973e00640 1 -- 172.21.15.5:0/2406564024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79680aaa20 con 0x7f7974156530 2024-08-18T22:25:25.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f797aa00640 1 -- 172.21.15.5:0/2406564024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7974156530 msgr2=0x7f7974071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f797aa00640 1 --2- 172.21.15.5:0/2406564024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7974156530 0x7f7974071470 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f7974142650 tx=0x7f796801c520 comp rx=0 tx=0).stop 2024-08-18T22:25:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f797aa00640 1 -- 172.21.15.5:0/2406564024 shutdown_connections 2024-08-18T22:25:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f797aa00640 1 --2- 172.21.15.5:0/2406564024 >> v2:172.21.15.117:3300/0 conn(0x7f797415f9d0 0x7f797415fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f797aa00640 1 --2- 172.21.15.5:0/2406564024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797415d0f0 0x7f79740719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f797aa00640 1 --2- 172.21.15.5:0/2406564024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7974156530 0x7f7974071470 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f797aa00640 1 -- 172.21.15.5:0/2406564024 >> 172.21.15.5:0/2406564024 conn(0x7f79740b3da0 msgr2=0x7f79740b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f797aa00640 1 -- 172.21.15.5:0/2406564024 shutdown_connections 2024-08-18T22:25:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.625+0000 7f797aa00640 1 -- 172.21.15.5:0/2406564024 wait complete. 2024-08-18T22:25:25.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797aa00640 1 Processor -- start 2024-08-18T22:25:25.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797aa00640 1 -- start start 2024-08-18T22:25:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7974156530 0x7f797413f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797415d0f0 0x7f79741660f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797415f9d0 0x7f7974140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797aa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7974142150 con 0x7f797415f9d0 2024-08-18T22:25:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797aa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7974141fd0 con 0x7f797415d0f0 2024-08-18T22:25:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797aa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f79741422d0 con 0x7f7974156530 2024-08-18T22:25:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797415f9d0 0x7f7974140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797415f9d0 0x7f7974140970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38012/0 (socket says 172.21.15.5:38012) 2024-08-18T22:25:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797a000640 1 -- 172.21.15.5:0/866328936 learned_addr learned my addr 172.21.15.5:0/866328936 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f7978c00640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797415d0f0 0x7f79741660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f7979600640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7974156530 0x7f797413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797a000640 1 -- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7974156530 msgr2=0x7f797413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797a000640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7974156530 0x7f797413f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797a000640 1 -- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797415d0f0 msgr2=0x7f79741660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797a000640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797415d0f0 0x7f79741660f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797a000640 1 -- 172.21.15.5:0/866328936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797415ef70 con 0x7f797415f9d0 2024-08-18T22:25:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797a000640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797415f9d0 0x7f7974140970 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f796c009fa0 tx=0x7f796c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f7971600640 1 -- 172.21.15.5:0/866328936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c01a070 con 0x7f797415f9d0 2024-08-18T22:25:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f7971600640 1 -- 172.21.15.5:0/866328936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796c003bc0 con 0x7f797415f9d0 2024-08-18T22:25:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797aa00640 1 -- 172.21.15.5:0/866328936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797415f250 con 0x7f797415f9d0 2024-08-18T22:25:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f7971600640 1 -- 172.21.15.5:0/866328936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c004030 con 0x7f797415f9d0 2024-08-18T22:25:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797aa00640 1 -- 172.21.15.5:0/866328936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7974166630 con 0x7f797415f9d0 2024-08-18T22:25:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.629+0000 7f797aa00640 1 -- 172.21.15.5:0/866328936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79740b26e0 con 0x7f797415f9d0 2024-08-18T22:25:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.633+0000 7f7971600640 1 -- 172.21.15.5:0/866328936 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f796c01d070 con 0x7f797415f9d0 2024-08-18T22:25:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.633+0000 7f7971600640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79540678c0 0x7f7954069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.633+0000 7f7971600640 1 -- 172.21.15.5:0/866328936 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5249+0+0 (secure 0 0 0) 0x7f796c085d90 con 0x7f797415f9d0 2024-08-18T22:25:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.633+0000 7f7979600640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79540678c0 0x7f7954069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.633+0000 7f7979600640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79540678c0 0x7f7954069d80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f79680ae000 tx=0x7f79680a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:25.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.637+0000 7f7971600640 1 -- 172.21.15.5:0/866328936 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f796c010070 con 0x7f797415f9d0 2024-08-18T22:25:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:25.805+0000 7f797aa00640 1 -- 172.21.15.5:0/866328936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f797413ee60 con 0x7f797415f9d0 2024-08-18T22:25:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f7971600640 1 -- 172.21.15.5:0/866328936 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v111) ==== 138+0+0 (secure 0 0 0) 0x7f796c056a80 con 0x7f797415f9d0 2024-08-18T22:25:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:25:26.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 -- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79540678c0 msgr2=0x7f7954069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:26.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79540678c0 0x7f7954069d80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f79680ae000 tx=0x7f79680a7000 comp rx=0 tx=0).stop 2024-08-18T22:25:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 -- 172.21.15.5:0/866328936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797415f9d0 msgr2=0x7f7974140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797415f9d0 0x7f7974140970 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f796c009fa0 tx=0x7f796c00d560 comp rx=0 tx=0).stop 2024-08-18T22:25:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 -- 172.21.15.5:0/866328936 shutdown_connections 2024-08-18T22:25:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f79540678c0 0x7f7954069d80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f797415f9d0 0x7f7974140970 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f797415d0f0 0x7f79741660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 --2- 172.21.15.5:0/866328936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7974156530 0x7f797413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 -- 172.21.15.5:0/866328936 >> 172.21.15.5:0/866328936 conn(0x7f79740b3da0 msgr2=0x7f797415b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 -- 172.21.15.5:0/866328936 shutdown_connections 2024-08-18T22:25:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.709+0000 7f797aa00640 1 -- 172.21.15.5:0/866328936 wait complete. 2024-08-18T22:25:26.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:25:26.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57ffe00640 1 Processor -- start 2024-08-18T22:25:26.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57ffe00640 1 -- start start 2024-08-18T22:25:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57ffe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58000b3fe0 0x7f58000b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57ffe00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f580006eae0 con 0x7f580015e060 2024-08-18T22:25:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57ffe00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5800071440 con 0x7f58000b4ee0 2024-08-18T22:25:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57ffe00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f58000b4990 con 0x7f58000b3fe0 2024-08-18T22:25:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57fea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f580015e060 0x7f5800071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56144/0 (socket says 172.21.15.5:56144) 2024-08-18T22:25:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57fea00640 1 -- 172.21.15.5:0/1548334717 learned_addr learned my addr 172.21.15.5:0/1548334717 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57fe000640 1 --2- 172.21.15.5:0/1548334717 >> v2:172.21.15.117:3300/0 conn(0x7f58000b3fe0 0x7f58000b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57fd600640 1 -- 172.21.15.5:0/1548334717 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1855117186 0 0) 0x7f580006eae0 con 0x7f580015e060 2024-08-18T22:25:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57fd600640 1 -- 172.21.15.5:0/1548334717 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57e4003530 con 0x7f580015e060 2024-08-18T22:25:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57fd600640 1 -- 172.21.15.5:0/1548334717 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3839143200 0 0) 0x7f5800071440 con 0x7f58000b4ee0 2024-08-18T22:25:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57fd600640 1 -- 172.21.15.5:0/1548334717 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f580006eae0 con 0x7f58000b4ee0 2024-08-18T22:25:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57fd600640 1 -- 172.21.15.5:0/1548334717 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1590192757 0 0) 0x7f57e4003530 con 0x7f580015e060 2024-08-18T22:25:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57fe000640 1 -- 172.21.15.5:0/1548334717 >> v1:172.21.15.117:6789/0 conn(0x7f58000b4ee0 legacy=0x7f58000b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57fe000640 1 -- 172.21.15.5:0/1548334717 >> v1:172.21.15.5:6789/0 conn(0x7f580015e060 legacy=0x7f5800071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:26.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.893+0000 7f57fe000640 1 -- 172.21.15.5:0/1548334717 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580006e800 con 0x7f58000b3fe0 2024-08-18T22:25:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.897+0000 7f57fe000640 1 --2- 172.21.15.5:0/1548334717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58000b3fe0 0x7f58000b4450 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0097c0 tx=0x7f57ec01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf1f58a9c9717060 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.897+0000 7f57fd600640 1 -- 172.21.15.5:0/1548334717 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0b0070 con 0x7f58000b3fe0 2024-08-18T22:25:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.897+0000 7f57fd600640 1 -- 172.21.15.5:0/1548334717 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ec0ab400 con 0x7f58000b3fe0 2024-08-18T22:25:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.897+0000 7f57fd600640 1 -- 172.21.15.5:0/1548334717 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0001680 con 0x7f58000b3fe0 2024-08-18T22:25:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.897+0000 7f57ffe00640 1 -- 172.21.15.5:0/1548334717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58000b3fe0 msgr2=0x7f58000b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.897+0000 7f57ffe00640 1 --2- 172.21.15.5:0/1548334717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58000b3fe0 0x7f58000b4450 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0097c0 tx=0x7f57ec01c330 comp rx=0 tx=0).stop 2024-08-18T22:25:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.897+0000 7f57ffe00640 1 -- 172.21.15.5:0/1548334717 shutdown_connections 2024-08-18T22:25:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.897+0000 7f57ffe00640 1 --2- 172.21.15.5:0/1548334717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58000b3fe0 0x7f58000b4450 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.897+0000 7f57ffe00640 1 -- 172.21.15.5:0/1548334717 >> 172.21.15.5:0/1548334717 conn(0x7f5800067a70 msgr2=0x7f5800067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.897+0000 7f57ffe00640 1 -- 172.21.15.5:0/1548334717 shutdown_connections 2024-08-18T22:25:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.897+0000 7f57ffe00640 1 -- 172.21.15.5:0/1548334717 wait complete. 2024-08-18T22:25:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ffe00640 1 Processor -- start 2024-08-18T22:25:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ffe00640 1 -- start start 2024-08-18T22:25:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ffe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58000b3fe0 0x7f58001606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ffe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58000b4ee0 0x7f58001543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580015e060 0x7f580014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ffe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f580006e3f0 con 0x7f580015e060 2024-08-18T22:25:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ffe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f580006e270 con 0x7f58000b3fe0 2024-08-18T22:25:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ffe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f580006e570 con 0x7f58000b4ee0 2024-08-18T22:25:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580015e060 0x7f580014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580015e060 0x7f580014d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38022/0 (socket says 172.21.15.5:38022) 2024-08-18T22:25:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ff400640 1 -- 172.21.15.5:0/2418208499 learned_addr learned my addr 172.21.15.5:0/2418208499 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57fea00640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58000b3fe0 0x7f58001606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ff400640 1 -- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58000b4ee0 msgr2=0x7f58001543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ff400640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58000b4ee0 0x7f58001543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ff400640 1 -- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58000b3fe0 msgr2=0x7f58001606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ff400640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58000b3fe0 0x7f58001606b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ff400640 1 -- 172.21.15.5:0/2418208499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5800068660 con 0x7f580015e060 2024-08-18T22:25:26.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57fea00640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58000b3fe0 0x7f58001606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ff400640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580015e060 0x7f580014d6f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f57f800c790 tx=0x7f57f800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57f6a00640 1 -- 172.21.15.5:0/2418208499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8003b80 con 0x7f580015e060 2024-08-18T22:25:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57f6a00640 1 -- 172.21.15.5:0/2418208499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f8003d20 con 0x7f580015e060 2024-08-18T22:25:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57f6a00640 1 -- 172.21.15.5:0/2418208499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f800aa50 con 0x7f580015e060 2024-08-18T22:25:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ffe00640 1 -- 172.21.15.5:0/2418208499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5800152370 con 0x7f580015e060 2024-08-18T22:25:26.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ffe00640 1 -- 172.21.15.5:0/2418208499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5800152930 con 0x7f580015e060 2024-08-18T22:25:26.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.901+0000 7f57ffe00640 1 -- 172.21.15.5:0/2418208499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58000b4450 con 0x7f580015e060 2024-08-18T22:25:26.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.905+0000 7f57f6a00640 1 -- 172.21.15.5:0/2418208499 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57f800abf0 con 0x7f580015e060 2024-08-18T22:25:26.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.905+0000 7f57f6a00640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57e00678c0 0x7f57e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:26.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.905+0000 7f57f6a00640 1 -- 172.21.15.5:0/2418208499 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5619+0+0 (secure 0 0 0) 0x7f57f8085c50 con 0x7f580015e060 2024-08-18T22:25:26.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.905+0000 7f57fea00640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57e00678c0 0x7f57e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:26.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.905+0000 7f57fea00640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57e00678c0 0x7f57e0069d80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f57f00011f0 tx=0x7f57f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:26.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:26.909+0000 7f57f6a00640 1 -- 172.21.15.5:0/2418208499 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f57f80567d0 con 0x7f580015e060 2024-08-18T22:25:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.077+0000 7f57ffe00640 1 -- 172.21.15.5:0/2418208499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5800157d60 con 0x7f580015e060 2024-08-18T22:25:27.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.709+0000 7f57f6a00640 1 -- 172.21.15.5:0/2418208499 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v112) ==== 170+0+0 (secure 0 0 0) 0x7f57f80560d0 con 0x7f580015e060 2024-08-18T22:25:27.712 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:25:27.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 -- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57e00678c0 msgr2=0x7f57e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:27.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57e00678c0 0x7f57e0069d80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f57f00011f0 tx=0x7f57f0009040 comp rx=0 tx=0).stop 2024-08-18T22:25:27.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 -- 172.21.15.5:0/2418208499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580015e060 msgr2=0x7f580014d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:27.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580015e060 0x7f580014d6f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f57f800c790 tx=0x7f57f800cc50 comp rx=0 tx=0).stop 2024-08-18T22:25:27.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 -- 172.21.15.5:0/2418208499 shutdown_connections 2024-08-18T22:25:27.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57e00678c0 0x7f57e0069d80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:27.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f580015e060 0x7f580014d6f0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:27.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58000b4ee0 0x7f58001543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:27.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 --2- 172.21.15.5:0/2418208499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58000b3fe0 0x7f58001606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:27.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 -- 172.21.15.5:0/2418208499 >> 172.21.15.5:0/2418208499 conn(0x7f5800067a70 msgr2=0x7f58000b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:27.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 -- 172.21.15.5:0/2418208499 shutdown_connections 2024-08-18T22:25:27.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.713+0000 7f57ffe00640 1 -- 172.21.15.5:0/2418208499 wait complete. 2024-08-18T22:25:27.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:25:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.897+0000 7f0677e00640 1 Processor -- start 2024-08-18T22:25:27.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.897+0000 7f0677e00640 1 -- start start 2024-08-18T22:25:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f0677e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f067815d120 0x7f06780b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f0677e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f067815d5b0 con 0x7f0678156770 2024-08-18T22:25:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f0677e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06780b67e0 con 0x7f06780b4650 2024-08-18T22:25:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f0677e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f06780b4ac0 con 0x7f067815d120 2024-08-18T22:25:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f0676a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0678156770 0x7f06780b6020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56150/0 (socket says 172.21.15.5:56150) 2024-08-18T22:25:27.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f0676a00640 1 -- 172.21.15.5:0/636224719 learned_addr learned my addr 172.21.15.5:0/636224719 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:27.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f066e000640 1 --2- 172.21.15.5:0/636224719 >> v2:172.21.15.117:3300/0 conn(0x7f067815d120 0x7f06780b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:27.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f0676000640 1 -- 172.21.15.5:0/636224719 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000174958 0 0) 0x7f067815d5b0 con 0x7f0678156770 2024-08-18T22:25:27.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f0676000640 1 -- 172.21.15.5:0/636224719 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f065c003530 con 0x7f0678156770 2024-08-18T22:25:27.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f066e000640 1 -- 172.21.15.5:0/636224719 >> v1:172.21.15.117:6789/0 conn(0x7f06780b4650 legacy=0x7f06780d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:27.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f066e000640 1 -- 172.21.15.5:0/636224719 >> v1:172.21.15.5:6789/0 conn(0x7f0678156770 legacy=0x7f06780b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:27.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.901+0000 7f066e000640 1 -- 172.21.15.5:0/636224719 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06780b6ac0 con 0x7f067815d120 2024-08-18T22:25:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f066e000640 1 --2- 172.21.15.5:0/636224719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067815d120 0x7f06780b4110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f06600097c0 tx=0x7f066001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfe3d7148eeebd18 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0676000640 1 -- 172.21.15.5:0/636224719 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06600b0070 con 0x7f067815d120 2024-08-18T22:25:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0676000640 1 -- 172.21.15.5:0/636224719 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06600ab600 con 0x7f067815d120 2024-08-18T22:25:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0676000640 1 -- 172.21.15.5:0/636224719 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06600ab9d0 con 0x7f067815d120 2024-08-18T22:25:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 -- 172.21.15.5:0/636224719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067815d120 msgr2=0x7f06780b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 --2- 172.21.15.5:0/636224719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067815d120 0x7f06780b4110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f06600097c0 tx=0x7f066001c410 comp rx=0 tx=0).stop 2024-08-18T22:25:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 -- 172.21.15.5:0/636224719 shutdown_connections 2024-08-18T22:25:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 --2- 172.21.15.5:0/636224719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f067815d120 0x7f06780b4110 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 -- 172.21.15.5:0/636224719 >> 172.21.15.5:0/636224719 conn(0x7f0678067a70 msgr2=0x7f0678067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 -- 172.21.15.5:0/636224719 shutdown_connections 2024-08-18T22:25:27.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 -- 172.21.15.5:0/636224719 wait complete. 2024-08-18T22:25:27.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 Processor -- start 2024-08-18T22:25:27.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 -- start start 2024-08-18T22:25:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06780b4650 0x7f067814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0678156770 0x7f06781572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.905+0000 7f0677e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f067815d120 0x7f067814b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f06780d1250 con 0x7f067815d120 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f06780d10d0 con 0x7f06780b4650 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f06780d13d0 con 0x7f0678156770 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f067815d120 0x7f067814b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f067815d120 0x7f067814b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38034/0 (socket says 172.21.15.5:38034) 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677400640 1 -- 172.21.15.5:0/450896344 learned_addr learned my addr 172.21.15.5:0/450896344 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0676a00640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06780b4650 0x7f067814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f066e000640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0678156770 0x7f06781572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677400640 1 -- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0678156770 msgr2=0x7f06781572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677400640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0678156770 0x7f06781572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677400640 1 -- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06780b4650 msgr2=0x7f067814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677400640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06780b4650 0x7f067814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677400640 1 -- 172.21.15.5:0/450896344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067814df90 con 0x7f067815d120 2024-08-18T22:25:27.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0676a00640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06780b4650 0x7f067814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677400640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f067815d120 0x7f067814b210 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f067000c760 tx=0x7f067000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f066f400640 1 -- 172.21.15.5:0/450896344 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0670003b80 con 0x7f067815d120 2024-08-18T22:25:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f066f400640 1 -- 172.21.15.5:0/450896344 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0670003d20 con 0x7f067815d120 2024-08-18T22:25:27.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f066f400640 1 -- 172.21.15.5:0/450896344 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067000aa30 con 0x7f067815d120 2024-08-18T22:25:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677e00640 1 -- 172.21.15.5:0/450896344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067814d5a0 con 0x7f067815d120 2024-08-18T22:25:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677e00640 1 -- 172.21.15.5:0/450896344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0678157830 con 0x7f067815d120 2024-08-18T22:25:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f0677e00640 1 -- 172.21.15.5:0/450896344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f067814e400 con 0x7f067815d120 2024-08-18T22:25:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.909+0000 7f066f400640 1 -- 172.21.15.5:0/450896344 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f067000abd0 con 0x7f067815d120 2024-08-18T22:25:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.913+0000 7f066f400640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06540678f0 0x7f0654069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.913+0000 7f066f400640 1 -- 172.21.15.5:0/450896344 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 6001+0+0 (secure 0 0 0) 0x7f0670086770 con 0x7f067815d120 2024-08-18T22:25:27.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.913+0000 7f0676a00640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06540678f0 0x7f0654069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.913+0000 7f0676a00640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06540678f0 0x7f0654069db0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f06680011f0 tx=0x7f0668009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:27.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:27.917+0000 7f066f400640 1 -- 172.21.15.5:0/450896344 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0670057160 con 0x7f067815d120 2024-08-18T22:25:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.113+0000 7f0677e00640 1 -- 172.21.15.5:0/450896344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f06780b62a0 con 0x7f067815d120 2024-08-18T22:25:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.741+0000 7f066f400640 1 -- 172.21.15.5:0/450896344 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v86) ==== 174+0+0 (secure 0 0 0) 0x7f0670056a60 con 0x7f067815d120 2024-08-18T22:25:28.743 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 15 and data pool 16 2024-08-18T22:25:28.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 -- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06540678f0 msgr2=0x7f0654069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:28.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06540678f0 0x7f0654069db0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f06680011f0 tx=0x7f0668009040 comp rx=0 tx=0).stop 2024-08-18T22:25:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 -- 172.21.15.5:0/450896344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f067815d120 msgr2=0x7f067814b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f067815d120 0x7f067814b210 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f067000c760 tx=0x7f067000cc20 comp rx=0 tx=0).stop 2024-08-18T22:25:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 -- 172.21.15.5:0/450896344 shutdown_connections 2024-08-18T22:25:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f06540678f0 0x7f0654069db0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f067815d120 0x7f067814b210 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0678156770 0x7f06781572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 --2- 172.21.15.5:0/450896344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06780b4650 0x7f067814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 -- 172.21.15.5:0/450896344 >> 172.21.15.5:0/450896344 conn(0x7f0678067a70 msgr2=0x7f0678067e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 -- 172.21.15.5:0/450896344 shutdown_connections 2024-08-18T22:25:28.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.745+0000 7f0677e00640 1 -- 172.21.15.5:0/450896344 wait complete. 2024-08-18T22:25:28.773 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:25:28.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.913+0000 7fb4f9a00640 1 Processor -- start 2024-08-18T22:25:28.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.913+0000 7fb4f9a00640 1 -- start start 2024-08-18T22:25:28.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.913+0000 7fb4f9a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4f415e4b0 0x7fb4f4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:28.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.913+0000 7fb4f9a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f4070430 con 0x7fb4f4070730 2024-08-18T22:25:28.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.913+0000 7fb4f9a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f415eb60 con 0x7fb4f4161960 2024-08-18T22:25:28.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.913+0000 7fb4f9a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f415e940 con 0x7fb4f415e4b0 2024-08-18T22:25:28.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.913+0000 7fb4f3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4f415e4b0 0x7fb4f4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:28.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.913+0000 7fb4ea000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb4f4070730 0x7fb4f415dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56156/0 (socket says 172.21.15.5:56156) 2024-08-18T22:25:28.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.913+0000 7fb4ea000640 1 -- 172.21.15.5:0/433314938 learned_addr learned my addr 172.21.15.5:0/433314938 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:28.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.917+0000 7fb4f3400640 1 -- 172.21.15.5:0/433314938 >> v1:172.21.15.117:6789/0 conn(0x7fb4f4161960 legacy=0x7fb4f406fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:28.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.917+0000 7fb4f2000640 1 -- 172.21.15.5:0/433314938 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768676743 0 0) 0x7fb4f4070430 con 0x7fb4f4070730 2024-08-18T22:25:28.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.917+0000 7fb4f3400640 1 -- 172.21.15.5:0/433314938 >> v1:172.21.15.5:6789/0 conn(0x7fb4f4070730 legacy=0x7fb4f415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:28.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.917+0000 7fb4f3400640 1 -- 172.21.15.5:0/433314938 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f415ee40 con 0x7fb4f415e4b0 2024-08-18T22:25:28.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.917+0000 7fb4f3400640 1 --2- 172.21.15.5:0/433314938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415e4b0 0x7fb4f4070ba0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009d90 tx=0x7fb4ec01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54604ff82cc462d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:28.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.917+0000 7fb4f2000640 1 -- 172.21.15.5:0/433314938 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0b2070 con 0x7fb4f415e4b0 2024-08-18T22:25:28.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.917+0000 7fb4f2000640 1 -- 172.21.15.5:0/433314938 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ec0a5830 con 0x7fb4f415e4b0 2024-08-18T22:25:28.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.917+0000 7fb4f2000640 1 -- 172.21.15.5:0/433314938 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0a5c00 con 0x7fb4f415e4b0 2024-08-18T22:25:28.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.917+0000 7fb4f9a00640 1 -- 172.21.15.5:0/433314938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415e4b0 msgr2=0x7fb4f4070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:28.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.917+0000 7fb4f9a00640 1 --2- 172.21.15.5:0/433314938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415e4b0 0x7fb4f4070ba0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009d90 tx=0x7fb4ec01c970 comp rx=0 tx=0).stop 2024-08-18T22:25:28.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 -- 172.21.15.5:0/433314938 shutdown_connections 2024-08-18T22:25:28.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 --2- 172.21.15.5:0/433314938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415e4b0 0x7fb4f4070ba0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:28.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 -- 172.21.15.5:0/433314938 >> 172.21.15.5:0/433314938 conn(0x7fb4f40d2130 msgr2=0x7fb4f40d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:28.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 -- 172.21.15.5:0/433314938 shutdown_connections 2024-08-18T22:25:28.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 -- 172.21.15.5:0/433314938 wait complete. 2024-08-18T22:25:28.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 Processor -- start 2024-08-18T22:25:28.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 -- start start 2024-08-18T22:25:28.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4f4070730 0x7fb4f4159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:28.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415e4b0 0x7fb4f415c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:28.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4f4161960 0x7fb4f415c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:28.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f409ba30 con 0x7fb4f415e4b0 2024-08-18T22:25:28.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f40710e0 con 0x7fb4f4161960 2024-08-18T22:25:28.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f9a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f415a8f0 con 0x7fb4f4070730 2024-08-18T22:25:28.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4ea000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415e4b0 0x7fb4f415c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4ea000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415e4b0 0x7fb4f415c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38064/0 (socket says 172.21.15.5:38064) 2024-08-18T22:25:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4ea000640 1 -- 172.21.15.5:0/11448275 learned_addr learned my addr 172.21.15.5:0/11448275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f2a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4f4070730 0x7fb4f4159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4f3400640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4f4161960 0x7fb4f415c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4ea000640 1 -- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4f4070730 msgr2=0x7fb4f4159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4ea000640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4f4070730 0x7fb4f4159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4ea000640 1 -- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4f4161960 msgr2=0x7fb4f415c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4ea000640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4f4161960 0x7fb4f415c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4ea000640 1 -- 172.21.15.5:0/11448275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f415d3e0 con 0x7fb4f415e4b0 2024-08-18T22:25:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.921+0000 7fb4ea000640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415e4b0 0x7fb4f415c0a0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00c410 tx=0x7fb4dc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.925+0000 7fb4eb400640 1 -- 172.21.15.5:0/11448275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0074e0 con 0x7fb4f415e4b0 2024-08-18T22:25:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.925+0000 7fb4eb400640 1 -- 172.21.15.5:0/11448275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4dc0047f0 con 0x7fb4f415e4b0 2024-08-18T22:25:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.925+0000 7fb4eb400640 1 -- 172.21.15.5:0/11448275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc007680 con 0x7fb4f415e4b0 2024-08-18T22:25:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.925+0000 7fb4f9a00640 1 -- 172.21.15.5:0/11448275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f415d6c0 con 0x7fb4f415e4b0 2024-08-18T22:25:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.925+0000 7fb4f9a00640 1 -- 172.21.15.5:0/11448275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f40b5020 con 0x7fb4f415e4b0 2024-08-18T22:25:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.925+0000 7fb4f9a00640 1 -- 172.21.15.5:0/11448275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f409bbb0 con 0x7fb4f415e4b0 2024-08-18T22:25:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.925+0000 7fb4eb400640 1 -- 172.21.15.5:0/11448275 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb4dc011070 con 0x7fb4f415e4b0 2024-08-18T22:25:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.925+0000 7fb4eb400640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4d00678c0 0x7fb4d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.925+0000 7fb4eb400640 1 -- 172.21.15.5:0/11448275 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fb4dc085950 con 0x7fb4f415e4b0 2024-08-18T22:25:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.925+0000 7fb4f2a00640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4d00678c0 0x7fb4d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.929+0000 7fb4f2a00640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4d00678c0 0x7fb4d0069d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40b16b0 tx=0x7fb4e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:28.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:28.929+0000 7fb4eb400640 1 -- 172.21.15.5:0/11448275 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb4dc055ca0 con 0x7fb4f415e4b0 2024-08-18T22:25:29.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.097+0000 7fb4f9a00640 1 -- 172.21.15.5:0/11448275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4f4169fe0 con 0x7fb4f415e4b0 2024-08-18T22:25:29.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.097+0000 7fb4eb400640 1 -- 172.21.15.5:0/11448275 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16825 (secure 0 0 0) 0x7fb4dc059fa0 con 0x7fb4f415e4b0 2024-08-18T22:25:29.097 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:29.098 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:25:28.118443+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:25:25.852979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-08-18T22:25:27.124603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:25:29.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.097+0000 7fb4f9a00640 1 -- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4d00678c0 msgr2=0x7fb4d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.097+0000 7fb4f9a00640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4d00678c0 0x7fb4d0069d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40b16b0 tx=0x7fb4e4009040 comp rx=0 tx=0).stop 2024-08-18T22:25:29.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.097+0000 7fb4f9a00640 1 -- 172.21.15.5:0/11448275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415e4b0 msgr2=0x7fb4f415c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.097+0000 7fb4f9a00640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415e4b0 0x7fb4f415c0a0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00c410 tx=0x7fb4dc00c8d0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.097+0000 7fb4f9a00640 1 -- 172.21.15.5:0/11448275 shutdown_connections 2024-08-18T22:25:29.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.097+0000 7fb4f9a00640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4d00678c0 0x7fb4d0069d80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.097+0000 7fb4f9a00640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4f4161960 0x7fb4f415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.097+0000 7fb4f9a00640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4f415e4b0 0x7fb4f415c0a0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.101+0000 7fb4f9a00640 1 --2- 172.21.15.5:0/11448275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4f4070730 0x7fb4f4159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.101+0000 7fb4f9a00640 1 -- 172.21.15.5:0/11448275 >> 172.21.15.5:0/11448275 conn(0x7fb4f40d2130 msgr2=0x7fb4f406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:29.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.101+0000 7fb4f9a00640 1 -- 172.21.15.5:0/11448275 shutdown_connections 2024-08-18T22:25:29.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.101+0000 7fb4f9a00640 1 -- 172.21.15.5:0/11448275 wait complete. 2024-08-18T22:25:29.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:25:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.257+0000 7fbaaf000640 1 Processor -- start 2024-08-18T22:25:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaaf000640 1 -- start start 2024-08-18T22:25:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaaf000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbaa809b520 0x7fbaa815f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaaf000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa809b9b0 con 0x7fbaa8070510 2024-08-18T22:25:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaaf000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa806fe70 con 0x7fbaa80d02a0 2024-08-18T22:25:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaaf000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa815f670 con 0x7fbaa809b520 2024-08-18T22:25:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaad200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbaa809b520 0x7fbaa815f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaadc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbaa8070510 0x7fbaa80708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56168/0 (socket says 172.21.15.5:56168) 2024-08-18T22:25:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaadc00640 1 -- 172.21.15.5:0/3181926325 learned_addr learned my addr 172.21.15.5:0/3181926325 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaad200640 1 -- 172.21.15.5:0/3181926325 >> v1:172.21.15.117:6789/0 conn(0x7fbaa80d02a0 legacy=0x7fbaa80d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaad200640 1 -- 172.21.15.5:0/3181926325 >> v1:172.21.15.5:6789/0 conn(0x7fbaa8070510 legacy=0x7fbaa80708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaa7e00640 1 -- 172.21.15.5:0/3181926325 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036351105 0 0) 0x7fbaa809b9b0 con 0x7fbaa8070510 2024-08-18T22:25:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.261+0000 7fbaad200640 1 -- 172.21.15.5:0/3181926325 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa8070150 con 0x7fbaa809b520 2024-08-18T22:25:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaad200640 1 --2- 172.21.15.5:0/3181926325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa809b520 0x7fbaa815f130 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fba94009740 tx=0x7fba9401c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477b1552257e6f9f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaa7e00640 1 -- 172.21.15.5:0/3181926325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940b0070 con 0x7fbaa809b520 2024-08-18T22:25:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaa7e00640 1 -- 172.21.15.5:0/3181926325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba940a4e50 con 0x7fbaa809b520 2024-08-18T22:25:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaa7e00640 1 -- 172.21.15.5:0/3181926325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940ab820 con 0x7fbaa809b520 2024-08-18T22:25:29.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaaf000640 1 -- 172.21.15.5:0/3181926325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa809b520 msgr2=0x7fbaa815f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaaf000640 1 --2- 172.21.15.5:0/3181926325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa809b520 0x7fbaa815f130 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fba94009740 tx=0x7fba9401c2d0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaaf000640 1 -- 172.21.15.5:0/3181926325 shutdown_connections 2024-08-18T22:25:29.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaaf000640 1 --2- 172.21.15.5:0/3181926325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa809b520 0x7fbaa815f130 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaaf000640 1 -- 172.21.15.5:0/3181926325 >> 172.21.15.5:0/3181926325 conn(0x7fbaa80b3a20 msgr2=0x7fbaa80b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:29.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaaf000640 1 -- 172.21.15.5:0/3181926325 shutdown_connections 2024-08-18T22:25:29.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaaf000640 1 -- 172.21.15.5:0/3181926325 wait complete. 2024-08-18T22:25:29.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaaf000640 1 Processor -- start 2024-08-18T22:25:29.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.265+0000 7fbaaf000640 1 -- start start 2024-08-18T22:25:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaaf000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa8070510 0x7fbaa8151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaaf000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa809b520 0x7fbaa8157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaaf000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80d02a0 0x7fbaa80b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaaf000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa80b46d0 con 0x7fbaa809b520 2024-08-18T22:25:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaaf000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa806fb00 con 0x7fbaa80d02a0 2024-08-18T22:25:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaaf000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa80b4850 con 0x7fbaa8070510 2024-08-18T22:25:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaad200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa809b520 0x7fbaa8157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaad200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa809b520 0x7fbaa8157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38084/0 (socket says 172.21.15.5:38084) 2024-08-18T22:25:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaad200640 1 -- 172.21.15.5:0/474603355 learned_addr learned my addr 172.21.15.5:0/474603355 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaadc00640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa8070510 0x7fbaa8151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaae600640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80d02a0 0x7fbaa80b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaad200640 1 -- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa8070510 msgr2=0x7fbaa8151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaad200640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa8070510 0x7fbaa8151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaad200640 1 -- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80d02a0 msgr2=0x7fbaa80b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaad200640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80d02a0 0x7fbaa80b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaad200640 1 -- 172.21.15.5:0/474603355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa8152ca0 con 0x7fbaa809b520 2024-08-18T22:25:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaadc00640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa8070510 0x7fbaa8151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:29.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaae600640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80d02a0 0x7fbaa80b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:29.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaad200640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa809b520 0x7fbaa8157590 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fba94009740 tx=0x7fba9401ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaa5600640 1 -- 172.21.15.5:0/474603355 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940bb070 con 0x7fbaa809b520 2024-08-18T22:25:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaa5600640 1 -- 172.21.15.5:0/474603355 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba940abe20 con 0x7fbaa809b520 2024-08-18T22:25:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaa5600640 1 -- 172.21.15.5:0/474603355 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940b0040 con 0x7fbaa809b520 2024-08-18T22:25:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaaf000640 1 -- 172.21.15.5:0/474603355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa8152f80 con 0x7fbaa809b520 2024-08-18T22:25:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaaf000640 1 -- 172.21.15.5:0/474603355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa8153540 con 0x7fbaa809b520 2024-08-18T22:25:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.269+0000 7fbaaf000640 1 -- 172.21.15.5:0/474603355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa815f130 con 0x7fbaa809b520 2024-08-18T22:25:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.273+0000 7fbaa5600640 1 -- 172.21.15.5:0/474603355 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba94004260 con 0x7fbaa809b520 2024-08-18T22:25:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.273+0000 7fbaa5600640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba880678c0 0x7fba88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.273+0000 7fbaa5600640 1 -- 172.21.15.5:0/474603355 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fba94120440 con 0x7fbaa809b520 2024-08-18T22:25:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.273+0000 7fbaadc00640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba880678c0 0x7fba88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.273+0000 7fbaadc00640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba880678c0 0x7fba88069d80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fba9c000f70 tx=0x7fba9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:29.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.277+0000 7fbaa5600640 1 -- 172.21.15.5:0/474603355 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fba94015f50 con 0x7fbaa809b520 2024-08-18T22:25:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.441+0000 7fbaaf000640 1 -- 172.21.15.5:0/474603355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbaa80b7eb0 con 0x7fbaa809b520 2024-08-18T22:25:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.441+0000 7fbaa5600640 1 -- 172.21.15.5:0/474603355 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16825 (secure 0 0 0) 0x7fba940f0de0 con 0x7fbaa809b520 2024-08-18T22:25:29.442 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:29.442 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":113,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:25:28.118443+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:25:25.852979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-08-18T22:25:27.124603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:25:29.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 -- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba880678c0 msgr2=0x7fba88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba880678c0 0x7fba88069d80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fba9c000f70 tx=0x7fba9c009040 comp rx=0 tx=0).stop 2024-08-18T22:25:29.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 -- 172.21.15.5:0/474603355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa809b520 msgr2=0x7fbaa8157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa809b520 0x7fbaa8157590 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fba94009740 tx=0x7fba9401ab10 comp rx=0 tx=0).stop 2024-08-18T22:25:29.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 -- 172.21.15.5:0/474603355 shutdown_connections 2024-08-18T22:25:29.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba880678c0 0x7fba88069d80 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaa80d02a0 0x7fbaa80b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaa809b520 0x7fbaa8157590 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 --2- 172.21.15.5:0/474603355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaa8070510 0x7fbaa8151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 -- 172.21.15.5:0/474603355 >> 172.21.15.5:0/474603355 conn(0x7fbaa80b3a20 msgr2=0x7fbaa806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:29.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 -- 172.21.15.5:0/474603355 shutdown_connections 2024-08-18T22:25:29.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.445+0000 7fbaaf000640 1 -- 172.21.15.5:0/474603355 wait complete. 2024-08-18T22:25:29.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:25:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.605+0000 7f08f5e00640 1 Processor -- start 2024-08-18T22:25:29.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.605+0000 7f08f5e00640 1 -- start start 2024-08-18T22:25:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.605+0000 7f08f5e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f08f015c180 0x7f08f00cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.605+0000 7f08f5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08f015c560 0x7f08f00ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.605+0000 7f08f5e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f00cfb00 con 0x7f08f015d4d0 2024-08-18T22:25:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.605+0000 7f08f5e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f08f015d040 con 0x7f08f015c560 2024-08-18T22:25:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.605+0000 7f08f5e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f08f015c9f0 con 0x7f08f015c180 2024-08-18T22:25:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08ee000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08f015c560 0x7f08f00ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08ee000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08f015c560 0x7f08f00ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38098/0 (socket says 172.21.15.5:38098) 2024-08-18T22:25:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08ee000640 1 -- 172.21.15.5:0/839650023 learned_addr learned my addr 172.21.15.5:0/839650023 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08eea00640 1 --2- 172.21.15.5:0/839650023 >> v2:172.21.15.117:3300/0 conn(0x7f08f015c180 0x7f08f00cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08ee000640 1 -- 172.21.15.5:0/839650023 >> v2:172.21.15.117:3300/0 conn(0x7f08f015c180 msgr2=0x7f08f00cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08ee000640 1 --2- 172.21.15.5:0/839650023 >> v2:172.21.15.117:3300/0 conn(0x7f08f015c180 0x7f08f00cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08ee000640 1 -- 172.21.15.5:0/839650023 >> v1:172.21.15.117:6789/0 conn(0x7f08f015d4d0 legacy=0x7f08f015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08ee000640 1 -- 172.21.15.5:0/839650023 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f015ccd0 con 0x7f08f015c560 2024-08-18T22:25:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08ee000640 1 --2- 172.21.15.5:0/839650023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08f015c560 0x7f08f00ce450 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f08f006d8a0 tx=0x7f08dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96354f00b2d8bee9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08ed600640 1 -- 172.21.15.5:0/839650023 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0aa610 con 0x7f08f015c560 2024-08-18T22:25:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08ed600640 1 -- 172.21.15.5:0/839650023 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc0af070 con 0x7f08f015c560 2024-08-18T22:25:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.609+0000 7f08ed600640 1 -- 172.21.15.5:0/839650023 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0aa9d0 con 0x7f08f015c560 2024-08-18T22:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 -- 172.21.15.5:0/839650023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08f015c560 msgr2=0x7f08f00ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 --2- 172.21.15.5:0/839650023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08f015c560 0x7f08f00ce450 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f08f006d8a0 tx=0x7f08dc01c490 comp rx=0 tx=0).stop 2024-08-18T22:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 -- 172.21.15.5:0/839650023 shutdown_connections 2024-08-18T22:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 --2- 172.21.15.5:0/839650023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08f015c560 0x7f08f00ce450 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 --2- 172.21.15.5:0/839650023 >> v2:172.21.15.117:3300/0 conn(0x7f08f015c180 0x7f08f00cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 -- 172.21.15.5:0/839650023 >> 172.21.15.5:0/839650023 conn(0x7f08f00b1dc0 msgr2=0x7f08f00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 -- 172.21.15.5:0/839650023 shutdown_connections 2024-08-18T22:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 -- 172.21.15.5:0/839650023 wait complete. 2024-08-18T22:25:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 Processor -- start 2024-08-18T22:25:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 -- start start 2024-08-18T22:25:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08f015c180 0x7f08f0144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f015d4d0 0x7f08f00ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08f00adc90 0x7f08f00ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f08f01692b0 con 0x7f08f00adc90 2024-08-18T22:25:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f08f0169130 con 0x7f08f015c180 2024-08-18T22:25:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08f5e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f08f0169430 con 0x7f08f015d4d0 2024-08-18T22:25:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08f00adc90 0x7f08f00ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08f00adc90 0x7f08f00ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38110/0 (socket says 172.21.15.5:38110) 2024-08-18T22:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08ef400640 1 -- 172.21.15.5:0/3396261614 learned_addr learned my addr 172.21.15.5:0/3396261614 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08ee000640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f015d4d0 0x7f08f00ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08eea00640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08f015c180 0x7f08f0144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08ef400640 1 -- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f015d4d0 msgr2=0x7f08f00ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08ef400640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f015d4d0 0x7f08f00ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08ef400640 1 -- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08f015c180 msgr2=0x7f08f0144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08ef400640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08f015c180 0x7f08f0144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.613+0000 7f08ef400640 1 -- 172.21.15.5:0/3396261614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f00b0b50 con 0x7f08f00adc90 2024-08-18T22:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.617+0000 7f08ef400640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08f00adc90 0x7f08f00ae140 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f08e800c730 tx=0x7f08e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.617+0000 7f08e7400640 1 -- 172.21.15.5:0/3396261614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8003b80 con 0x7f08f00adc90 2024-08-18T22:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.617+0000 7f08e7400640 1 -- 172.21.15.5:0/3396261614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e8003d20 con 0x7f08f00adc90 2024-08-18T22:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.617+0000 7f08e7400640 1 -- 172.21.15.5:0/3396261614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8005310 con 0x7f08f00adc90 2024-08-18T22:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.617+0000 7f08f5e00640 1 -- 172.21.15.5:0/3396261614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f00b0e30 con 0x7f08f00adc90 2024-08-18T22:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.617+0000 7f08f5e00640 1 -- 172.21.15.5:0/3396261614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f015db00 con 0x7f08f00adc90 2024-08-18T22:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.617+0000 7f08f5e00640 1 -- 172.21.15.5:0/3396261614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f015fd90 con 0x7f08f00adc90 2024-08-18T22:25:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.617+0000 7f08e7400640 1 -- 172.21.15.5:0/3396261614 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f08e80056c0 con 0x7f08f00adc90 2024-08-18T22:25:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.617+0000 7f08e7400640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08d00678f0 0x7f08d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.617+0000 7f08e7400640 1 -- 172.21.15.5:0/3396261614 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f08e8085c50 con 0x7f08f00adc90 2024-08-18T22:25:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.617+0000 7f08eea00640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08d00678f0 0x7f08d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.621+0000 7f08eea00640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08d00678f0 0x7f08d0069db0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f08e0006aa0 tx=0x7f08e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.621+0000 7f08e7400640 1 -- 172.21.15.5:0/3396261614 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f08e808b020 con 0x7f08f00adc90 2024-08-18T22:25:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:29.829+0000 7f08f5e00640 1 -- 172.21.15.5:0/3396261614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f08f00b1ba0 con 0x7f08f00adc90 2024-08-18T22:25:30.709 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-08-18T22:25:30.707+0000 7f4721800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:25:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.765+0000 7f08e7400640 1 -- 172.21.15.5:0/3396261614 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v89) ==== 118+0+0 (secure 0 0 0) 0x7f08e8056040 con 0x7f08f00adc90 2024-08-18T22:25:30.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 -- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08d00678f0 msgr2=0x7f08d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08d00678f0 0x7f08d0069db0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f08e0006aa0 tx=0x7f08e0008040 comp rx=0 tx=0).stop 2024-08-18T22:25:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 -- 172.21.15.5:0/3396261614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08f00adc90 msgr2=0x7f08f00ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08f00adc90 0x7f08f00ae140 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f08e800c730 tx=0x7f08e800cbf0 comp rx=0 tx=0).stop 2024-08-18T22:25:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 -- 172.21.15.5:0/3396261614 shutdown_connections 2024-08-18T22:25:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f08d00678f0 0x7f08d0069db0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08f00adc90 0x7f08f00ae140 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08f015d4d0 0x7f08f00ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 --2- 172.21.15.5:0/3396261614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08f015c180 0x7f08f0144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 -- 172.21.15.5:0/3396261614 >> 172.21.15.5:0/3396261614 conn(0x7f08f00b1dc0 msgr2=0x7f08f009af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 -- 172.21.15.5:0/3396261614 shutdown_connections 2024-08-18T22:25:30.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.769+0000 7f08f5e00640 1 -- 172.21.15.5:0/3396261614 wait complete. 2024-08-18T22:25:30.792 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:25:30.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:25:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc908600640 1 Processor -- start 2024-08-18T22:25:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc908600640 1 -- start start 2024-08-18T22:25:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc908600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc90015b0c0 0x7fc90006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc908600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9000b40c0 0x7fc9000b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc908600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9000b31f0 con 0x7fc900072a30 2024-08-18T22:25:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc908600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc9000b4a70 con 0x7fc9000b40c0 2024-08-18T22:25:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc908600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc9000b3d70 con 0x7fc90015b0c0 2024-08-18T22:25:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc905200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9000b40c0 0x7fc9000b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc906600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc900072a30 0x7fc900072e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56178/0 (socket says 172.21.15.5:56178) 2024-08-18T22:25:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc906600640 1 -- 172.21.15.5:0/2331739442 learned_addr learned my addr 172.21.15.5:0/2331739442 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc905c00640 1 --2- 172.21.15.5:0/2331739442 >> v2:172.21.15.117:3300/0 conn(0x7fc90015b0c0 0x7fc90006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc905200640 1 -- 172.21.15.5:0/2331739442 >> v2:172.21.15.117:3300/0 conn(0x7fc90015b0c0 msgr2=0x7fc90006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc905200640 1 --2- 172.21.15.5:0/2331739442 >> v2:172.21.15.117:3300/0 conn(0x7fc90015b0c0 0x7fc90006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc905200640 1 -- 172.21.15.5:0/2331739442 >> v1:172.21.15.5:6789/0 conn(0x7fc900072a30 legacy=0x7fc900072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.941+0000 7fc905200640 1 -- 172.21.15.5:0/2331739442 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9000b34d0 con 0x7fc9000b40c0 2024-08-18T22:25:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc905200640 1 --2- 172.21.15.5:0/2331739442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9000b40c0 0x7fc9000b4530 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc900070ba0 tx=0x7fc8ec01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8360c2a97d9753cd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc8ffe00640 1 -- 172.21.15.5:0/2331739442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0b0070 con 0x7fc9000b40c0 2024-08-18T22:25:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc8ffe00640 1 -- 172.21.15.5:0/2331739442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ec0ab600 con 0x7fc9000b40c0 2024-08-18T22:25:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc8ffe00640 1 -- 172.21.15.5:0/2331739442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0ab9d0 con 0x7fc9000b40c0 2024-08-18T22:25:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc908600640 1 -- 172.21.15.5:0/2331739442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9000b40c0 msgr2=0x7fc9000b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc908600640 1 --2- 172.21.15.5:0/2331739442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9000b40c0 0x7fc9000b4530 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc900070ba0 tx=0x7fc8ec01c330 comp rx=0 tx=0).stop 2024-08-18T22:25:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc908600640 1 -- 172.21.15.5:0/2331739442 shutdown_connections 2024-08-18T22:25:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc908600640 1 --2- 172.21.15.5:0/2331739442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9000b40c0 0x7fc9000b4530 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc908600640 1 --2- 172.21.15.5:0/2331739442 >> v2:172.21.15.117:3300/0 conn(0x7fc90015b0c0 0x7fc90006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc908600640 1 -- 172.21.15.5:0/2331739442 >> 172.21.15.5:0/2331739442 conn(0x7fc9000b1dc0 msgr2=0x7fc9000b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc908600640 1 -- 172.21.15.5:0/2331739442 shutdown_connections 2024-08-18T22:25:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc908600640 1 -- 172.21.15.5:0/2331739442 wait complete. 2024-08-18T22:25:30.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc908600640 1 Processor -- start 2024-08-18T22:25:30.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.945+0000 7fc908600640 1 -- start start 2024-08-18T22:25:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc908600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc900072a30 0x7fc900150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc908600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9000b40c0 0x7fc900154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc908600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc90015b0c0 0x7fc900155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc908600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc90015b4a0 con 0x7fc900072a30 2024-08-18T22:25:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc908600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc9000739a0 con 0x7fc9000b40c0 2024-08-18T22:25:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc908600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc90015b620 con 0x7fc90015b0c0 2024-08-18T22:25:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc905c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc900072a30 0x7fc900150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc905c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc900072a30 0x7fc900150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38126/0 (socket says 172.21.15.5:38126) 2024-08-18T22:25:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc905c00640 1 -- 172.21.15.5:0/1795438812 learned_addr learned my addr 172.21.15.5:0/1795438812 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc905200640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9000b40c0 0x7fc900154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc906600640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc90015b0c0 0x7fc900155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc905c00640 1 -- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc90015b0c0 msgr2=0x7fc900155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc905c00640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc90015b0c0 0x7fc900155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc905c00640 1 -- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9000b40c0 msgr2=0x7fc900154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc905c00640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9000b40c0 0x7fc900154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc905c00640 1 -- 172.21.15.5:0/1795438812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9000c9690 con 0x7fc900072a30 2024-08-18T22:25:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc906600640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc90015b0c0 0x7fc900155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc905c00640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc900072a30 0x7fc900150130 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fc8f400d5f0 tx=0x7fc8f400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc8fd600640 1 -- 172.21.15.5:0/1795438812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f40125f0 con 0x7fc900072a30 2024-08-18T22:25:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc8fd600640 1 -- 172.21.15.5:0/1795438812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f4019070 con 0x7fc900072a30 2024-08-18T22:25:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc908600640 1 -- 172.21.15.5:0/1795438812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9000c9970 con 0x7fc900072a30 2024-08-18T22:25:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc8fd600640 1 -- 172.21.15.5:0/1795438812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f40129b0 con 0x7fc900072a30 2024-08-18T22:25:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc908600640 1 -- 172.21.15.5:0/1795438812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9000c9f30 con 0x7fc900072a30 2024-08-18T22:25:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.949+0000 7fc908600640 1 -- 172.21.15.5:0/1795438812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc90006f700 con 0x7fc900072a30 2024-08-18T22:25:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.953+0000 7fc8fd600640 1 -- 172.21.15.5:0/1795438812 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc8f4012b50 con 0x7fc900072a30 2024-08-18T22:25:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.953+0000 7fc8fd600640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8e00678c0 0x7fc8e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.953+0000 7fc8fd600640 1 -- 172.21.15.5:0/1795438812 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7fc8f40862e0 con 0x7fc900072a30 2024-08-18T22:25:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.953+0000 7fc905200640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8e00678c0 0x7fc8e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.953+0000 7fc905200640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8e00678c0 0x7fc8e0069d80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec0ad000 tx=0x7fc8ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:30.957+0000 7fc8fd600640 1 -- 172.21.15.5:0/1795438812 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc8f4056bf0 con 0x7fc900072a30 2024-08-18T22:25:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.157+0000 7fc908600640 1 -- 172.21.15.5:0/1795438812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc9000afdd0 con 0x7fc900072a30 2024-08-18T22:25:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc8fd600640 1 -- 172.21.15.5:0/1795438812 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v90) ==== 122+0+0 (secure 0 0 0) 0x7fc8f40564f0 con 0x7fc900072a30 2024-08-18T22:25:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 -- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8e00678c0 msgr2=0x7fc8e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8e00678c0 0x7fc8e0069d80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec0ad000 tx=0x7fc8ec008040 comp rx=0 tx=0).stop 2024-08-18T22:25:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 -- 172.21.15.5:0/1795438812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc900072a30 msgr2=0x7fc900150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc900072a30 0x7fc900150130 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fc8f400d5f0 tx=0x7fc8f400dab0 comp rx=0 tx=0).stop 2024-08-18T22:25:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 -- 172.21.15.5:0/1795438812 shutdown_connections 2024-08-18T22:25:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8e00678c0 0x7fc8e0069d80 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc90015b0c0 0x7fc900155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9000b40c0 0x7fc900154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 --2- 172.21.15.5:0/1795438812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc900072a30 0x7fc900150130 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 -- 172.21.15.5:0/1795438812 >> 172.21.15.5:0/1795438812 conn(0x7fc9000b1dc0 msgr2=0x7fc900072e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 -- 172.21.15.5:0/1795438812 shutdown_connections 2024-08-18T22:25:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.773+0000 7fc908600640 1 -- 172.21.15.5:0/1795438812 wait complete. 2024-08-18T22:25:31.797 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:25:31.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.937+0000 7f758fa00640 1 Processor -- start 2024-08-18T22:25:31.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.937+0000 7f758fa00640 1 -- start start 2024-08-18T22:25:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.941+0000 7f758fa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75881618d0 0x7f758815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.941+0000 7f758fa00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7588162300 con 0x7f7588161d40 2024-08-18T22:25:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.941+0000 7f758fa00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75881625e0 con 0x7f75880c92d0 2024-08-18T22:25:31.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.941+0000 7f758fa00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f75881628c0 con 0x7f75881618d0 2024-08-18T22:25:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.941+0000 7f758d000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75881618d0 0x7f758815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.941+0000 7f757fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7588161d40 0x7f758815f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56188/0 (socket says 172.21.15.5:56188) 2024-08-18T22:25:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.941+0000 7f757fe00640 1 -- 172.21.15.5:0/3739433454 learned_addr learned my addr 172.21.15.5:0/3739433454 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.941+0000 7f758d000640 1 -- 172.21.15.5:0/3739433454 >> v1:172.21.15.117:6789/0 conn(0x7f75880c92d0 legacy=0x7f75880c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:31.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.941+0000 7f758d000640 1 -- 172.21.15.5:0/3739433454 >> v1:172.21.15.5:6789/0 conn(0x7f7588161d40 legacy=0x7f758815f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.941+0000 7f758d000640 1 -- 172.21.15.5:0/3739433454 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7588162ba0 con 0x7f75881618d0 2024-08-18T22:25:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.941+0000 7f7587e00640 1 -- 172.21.15.5:0/3739433454 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677634335 0 0) 0x7f7588162300 con 0x7f7588161d40 2024-08-18T22:25:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758d000640 1 --2- 172.21.15.5:0/3739433454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75881618d0 0x7f758815f1d0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f75780097c0 tx=0x7f757801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7907ce057ab0227b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f7587e00640 1 -- 172.21.15.5:0/3739433454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75780b0070 con 0x7f75881618d0 2024-08-18T22:25:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f7587e00640 1 -- 172.21.15.5:0/3739433454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75780ab600 con 0x7f75881618d0 2024-08-18T22:25:31.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f7587e00640 1 -- 172.21.15.5:0/3739433454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75780ab9d0 con 0x7f75881618d0 2024-08-18T22:25:31.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 -- 172.21.15.5:0/3739433454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75881618d0 msgr2=0x7f758815f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:31.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 --2- 172.21.15.5:0/3739433454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75881618d0 0x7f758815f1d0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f75780097c0 tx=0x7f757801c4a0 comp rx=0 tx=0).stop 2024-08-18T22:25:31.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 -- 172.21.15.5:0/3739433454 shutdown_connections 2024-08-18T22:25:31.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 --2- 172.21.15.5:0/3739433454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75881618d0 0x7f758815f1d0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:31.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 -- 172.21.15.5:0/3739433454 >> 172.21.15.5:0/3739433454 conn(0x7f75880b1c50 msgr2=0x7f75880b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:31.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 -- 172.21.15.5:0/3739433454 shutdown_connections 2024-08-18T22:25:31.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 -- 172.21.15.5:0/3739433454 wait complete. 2024-08-18T22:25:31.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 Processor -- start 2024-08-18T22:25:31.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 -- start start 2024-08-18T22:25:31.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75880c92d0 0x7f75880b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75881618d0 0x7f7588072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7588161d40 0x7f7588073020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f758816c0f0 con 0x7f75880c92d0 2024-08-18T22:25:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75880cf300 con 0x7f75881618d0 2024-08-18T22:25:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.945+0000 7f758fa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f758816c270 con 0x7f7588161d40 2024-08-18T22:25:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75880c92d0 0x7f75880b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75880c92d0 0x7f75880b5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38148/0 (socket says 172.21.15.5:38148) 2024-08-18T22:25:31.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758d000640 1 -- 172.21.15.5:0/2749858710 learned_addr learned my addr 172.21.15.5:0/2749858710 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:31.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f757fe00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75881618d0 0x7f7588072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:31.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758da00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7588161d40 0x7f7588073020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:31.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758d000640 1 -- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7588161d40 msgr2=0x7f7588073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:31.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758d000640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7588161d40 0x7f7588073020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:31.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758d000640 1 -- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75881618d0 msgr2=0x7f7588072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:31.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758d000640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75881618d0 0x7f7588072ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:31.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758d000640 1 -- 172.21.15.5:0/2749858710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75880b3e40 con 0x7f75880c92d0 2024-08-18T22:25:31.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f757fe00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75881618d0 0x7f7588072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:31.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758da00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7588161d40 0x7f7588073020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:31.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758d000640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75880c92d0 0x7f75880b5b50 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f75780097c0 tx=0x7f757801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f7585600640 1 -- 172.21.15.5:0/2749858710 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75780bd070 con 0x7f75880c92d0 2024-08-18T22:25:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f7585600640 1 -- 172.21.15.5:0/2749858710 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7578004230 con 0x7f75880c92d0 2024-08-18T22:25:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f7585600640 1 -- 172.21.15.5:0/2749858710 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75780b0040 con 0x7f75880c92d0 2024-08-18T22:25:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758fa00640 1 -- 172.21.15.5:0/2749858710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75880b3b60 con 0x7f75880c92d0 2024-08-18T22:25:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758fa00640 1 -- 172.21.15.5:0/2749858710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7588141a00 con 0x7f75880c92d0 2024-08-18T22:25:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f758fa00640 1 -- 172.21.15.5:0/2749858710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f758815f1d0 con 0x7f75880c92d0 2024-08-18T22:25:31.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.949+0000 7f7585600640 1 -- 172.21.15.5:0/2749858710 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f75780c0070 con 0x7f75880c92d0 2024-08-18T22:25:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.953+0000 7f7585600640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75640678c0 0x7f7564069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.953+0000 7f7585600640 1 -- 172.21.15.5:0/2749858710 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f757811fbf0 con 0x7f75880c92d0 2024-08-18T22:25:31.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.953+0000 7f757fe00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75640678c0 0x7f7564069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.953+0000 7f757fe00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75640678c0 0x7f7564069d80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f75880af080 tx=0x7f7570009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:31.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:31.957+0000 7f7585600640 1 -- 172.21.15.5:0/2749858710 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7578016090 con 0x7f75880c92d0 2024-08-18T22:25:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.157+0000 7f758fa00640 1 -- 172.21.15.5:0/2749858710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75880738b0 con 0x7f75880c92d0 2024-08-18T22:25:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.157+0000 7f7585600640 1 -- 172.21.15.5:0/2749858710 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5222 (secure 0 0 0) 0x7f75780f0500 con 0x7f75880c92d0 2024-08-18T22:25:32.158 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:32.158 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":90,"btime":"2024-08-18T22:25:31:768933+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6680,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3271513219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3271513219},{"type":"v1","addr":"172.21.15.117:6836","nonce":3271513219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7210,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1577791873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1577791873},{"type":"v1","addr":"172.21.15.5:6835","nonce":1577791873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/704276311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":704276311},{"type":"v1","addr":"172.21.15.5:6834","nonce":704276311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:25:28.118793+0000","modified":"2024-08-18T22:25:31.161516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7752":{"gid":7752,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/1147270411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1147270411},{"type":"v1","addr":"172.21.15.117:6837","nonce":1147270411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7752,"qdb_cluster":[7752]},"id":7}]} 2024-08-18T22:25:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 90 2024-08-18T22:25:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 -- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75640678c0 msgr2=0x7f7564069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75640678c0 0x7f7564069d80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f75880af080 tx=0x7f7570009040 comp rx=0 tx=0).stop 2024-08-18T22:25:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 -- 172.21.15.5:0/2749858710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75880c92d0 msgr2=0x7f75880b5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75880c92d0 0x7f75880b5b50 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f75780097c0 tx=0x7f757801ace0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 -- 172.21.15.5:0/2749858710 shutdown_connections 2024-08-18T22:25:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75640678c0 0x7f7564069d80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7588161d40 0x7f7588073020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75881618d0 0x7f7588072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 --2- 172.21.15.5:0/2749858710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75880c92d0 0x7f75880b5b50 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 -- 172.21.15.5:0/2749858710 >> 172.21.15.5:0/2749858710 conn(0x7f75880b1c50 msgr2=0x7f7588160bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 -- 172.21.15.5:0/2749858710 shutdown_connections 2024-08-18T22:25:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.161+0000 7f758fa00640 1 -- 172.21.15.5:0/2749858710 wait complete. 2024-08-18T22:25:32.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:25:32.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f56800640 1 Processor -- start 2024-08-18T22:25:32.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f56800640 1 -- start start 2024-08-18T22:25:32.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f56800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1f5015f130 0x7f1f500d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f56800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5009b9b0 con 0x7f1f5009b520 2024-08-18T22:25:32.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f56800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5006fe70 con 0x7f1f50070510 2024-08-18T22:25:32.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f56800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1f50070150 con 0x7f1f5015f130 2024-08-18T22:25:32.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f54a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1f5009b520 0x7f1f500d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56196/0 (socket says 172.21.15.5:56196) 2024-08-18T22:25:32.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f54a00640 1 -- 172.21.15.5:0/2955841756 learned_addr learned my addr 172.21.15.5:0/2955841756 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:32.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f55e00640 1 --2- 172.21.15.5:0/2955841756 >> v2:172.21.15.117:3300/0 conn(0x7f1f5015f130 0x7f1f500d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131472317 0 0) 0x7f1f5009b9b0 con 0x7f1f5009b520 2024-08-18T22:25:32.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f38003530 con 0x7f1f5009b520 2024-08-18T22:25:32.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187503818 0 0) 0x7f1f5006fe70 con 0x7f1f50070510 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f5009b9b0 con 0x7f1f50070510 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1092088089 0 0) 0x7f1f38003530 con 0x7f1f5009b520 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 >> v2:172.21.15.117:3300/0 conn(0x7f1f5015f130 msgr2=0x7f1f500d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 --2- 172.21.15.5:0/2955841756 >> v2:172.21.15.117:3300/0 conn(0x7f1f5015f130 0x7f1f500d09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 >> v1:172.21.15.117:6789/0 conn(0x7f1f50070510 legacy=0x7f1f500708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5009aa40 con 0x7f1f5009b520 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f1f3c001680 con 0x7f1f5009b520 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 >> v1:172.21.15.5:6789/0 conn(0x7f1f5009b520 legacy=0x7f1f500d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f38003ba0 0x7f1f38003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f38004810 0x7f1f38004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f380051d0 0x7f1f3800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f50070150 con 0x7f1f380051d0 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3800c0a0 con 0x7f1f38004810 2024-08-18T22:25:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3800c2a0 con 0x7f1f38003ba0 2024-08-18T22:25:32.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f55e00640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f380051d0 0x7f1f3800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f55400640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f38003ba0 0x7f1f38003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f54a00640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f38004810 0x7f1f38004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f55e00640 1 -- 172.21.15.5:0/2955841756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f38003ba0 msgr2=0x7f1f38003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:32.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f55e00640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f38003ba0 0x7f1f38003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f55e00640 1 -- 172.21.15.5:0/2955841756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f38004810 msgr2=0x7f1f38004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:32.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f55e00640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f38004810 0x7f1f38004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f55e00640 1 -- 172.21.15.5:0/2955841756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f38003530 con 0x7f1f380051d0 2024-08-18T22:25:32.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.321+0000 7f1f54a00640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f38004810 0x7f1f38004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:32.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f55e00640 1 -- 172.21.15.5:0/2955841756 reap_dead start 2024-08-18T22:25:32.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f55e00640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f380051d0 0x7f1f3800b9d0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009fc0 tx=0x7f1f4801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b864b461556cd304 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:32.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48009c10 con 0x7f1f380051d0 2024-08-18T22:25:32.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f480a5cd0 con 0x7f1f380051d0 2024-08-18T22:25:32.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f4fe00640 1 -- 172.21.15.5:0/2955841756 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48003be0 con 0x7f1f380051d0 2024-08-18T22:25:32.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f56800640 1 -- 172.21.15.5:0/2955841756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f380051d0 msgr2=0x7f1f3800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f56800640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f380051d0 0x7f1f3800b9d0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009fc0 tx=0x7f1f4801ccc0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f56800640 1 -- 172.21.15.5:0/2955841756 shutdown_connections 2024-08-18T22:25:32.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f56800640 1 --2- 172.21.15.5:0/2955841756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f380051d0 0x7f1f3800b9d0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f56800640 1 -- 172.21.15.5:0/2955841756 >> 172.21.15.5:0/2955841756 conn(0x7f1f500b3a20 msgr2=0x7f1f500b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:32.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f56800640 1 -- 172.21.15.5:0/2955841756 shutdown_connections 2024-08-18T22:25:32.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.325+0000 7f1f56800640 1 -- 172.21.15.5:0/2955841756 wait complete. 2024-08-18T22:25:32.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f56800640 1 Processor -- start 2024-08-18T22:25:32.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f56800640 1 -- start start 2024-08-18T22:25:32.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f56800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f380051d0 0x7f1f5014a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f56800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f50159e00 0x7f1f500b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f56800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50161f80 0x7f1f50162400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f56800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5015f580 con 0x7f1f50159e00 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f56800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5009b000 con 0x7f1f50161f80 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f56800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f500b46d0 con 0x7f1f380051d0 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f54a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f50159e00 0x7f1f500b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f54a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f50159e00 0x7f1f500b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38162/0 (socket says 172.21.15.5:38162) 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f54a00640 1 -- 172.21.15.5:0/285823263 learned_addr learned my addr 172.21.15.5:0/285823263 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f55400640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f380051d0 0x7f1f5014a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f55e00640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50161f80 0x7f1f50162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f54a00640 1 -- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f380051d0 msgr2=0x7f1f5014a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f54a00640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f380051d0 0x7f1f5014a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f54a00640 1 -- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50161f80 msgr2=0x7f1f50162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f54a00640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50161f80 0x7f1f50162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f54a00640 1 -- 172.21.15.5:0/285823263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f50162940 con 0x7f1f50159e00 2024-08-18T22:25:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f55e00640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50161f80 0x7f1f50162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f54a00640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f50159e00 0x7f1f500b64c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0117c0 tx=0x7f1f3c011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f4d600640 1 -- 172.21.15.5:0/285823263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c010040 con 0x7f1f50159e00 2024-08-18T22:25:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f4d600640 1 -- 172.21.15.5:0/285823263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c01a070 con 0x7f1f50159e00 2024-08-18T22:25:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f56800640 1 -- 172.21.15.5:0/285823263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5015a2f0 con 0x7f1f50159e00 2024-08-18T22:25:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f4d600640 1 -- 172.21.15.5:0/285823263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00fd60 con 0x7f1f50159e00 2024-08-18T22:25:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f56800640 1 -- 172.21.15.5:0/285823263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5015a8b0 con 0x7f1f50159e00 2024-08-18T22:25:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.329+0000 7f1f56800640 1 -- 172.21.15.5:0/285823263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5006fb00 con 0x7f1f50159e00 2024-08-18T22:25:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.333+0000 7f1f4d600640 1 -- 172.21.15.5:0/285823263 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f3c01f460 con 0x7f1f50159e00 2024-08-18T22:25:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.333+0000 7f1f4d600640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 0x7f1f30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.333+0000 7f1f4d600640 1 -- 172.21.15.5:0/285823263 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f1f3c089140 con 0x7f1f50159e00 2024-08-18T22:25:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.333+0000 7f1f55400640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 0x7f1f30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.333+0000 7f1f55400640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 0x7f1f30069d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000c10 tx=0x7f1f44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:32.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.337+0000 7f1f4d600640 1 -- 172.21.15.5:0/285823263 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1f3c059a50 con 0x7f1f50159e00 2024-08-18T22:25:32.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f56800640 1 -- 172.21.15.5:0/285823263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f50073d40 con 0x7f1f50159e00 2024-08-18T22:25:32.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f4d600640 1 -- 172.21.15.5:0/285823263 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16812 (secure 0 0 0) 0x7f1f3c059350 con 0x7f1f50159e00 2024-08-18T22:25:32.505 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:32.506 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":114,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:25:29.716296+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:25:25.852979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-08-18T22:25:27.124603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f56800640 1 -- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 msgr2=0x7f1f30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f56800640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 0x7f1f30069d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000c10 tx=0x7f1f44009040 comp rx=0 tx=0).stop 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f56800640 1 -- 172.21.15.5:0/285823263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f50159e00 msgr2=0x7f1f500b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f56800640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f50159e00 0x7f1f500b64c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0117c0 tx=0x7f1f3c011c80 comp rx=0 tx=0).stop 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f56800640 1 -- 172.21.15.5:0/285823263 shutdown_connections 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f56800640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f300678c0 0x7f1f30069d80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f56800640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f50161f80 0x7f1f50162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f56800640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f50159e00 0x7f1f500b64c0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f56800640 1 --2- 172.21.15.5:0/285823263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f380051d0 0x7f1f5014a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.505+0000 7f1f56800640 1 -- 172.21.15.5:0/285823263 >> 172.21.15.5:0/285823263 conn(0x7f1f500b3a20 msgr2=0x7f1f500d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.509+0000 7f1f56800640 1 -- 172.21.15.5:0/285823263 shutdown_connections 2024-08-18T22:25:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.509+0000 7f1f56800640 1 -- 172.21.15.5:0/285823263 wait complete. 2024-08-18T22:25:32.528 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:25:32.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:25:32.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe651c00640 1 Processor -- start 2024-08-18T22:25:32.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe651c00640 1 -- start start 2024-08-18T22:25:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe651c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 0x7fe64c0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe651c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe64c0b5e30 con 0x7fe64c06fad0 2024-08-18T22:25:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe651c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe64c0b6110 con 0x7fe64c071c90 2024-08-18T22:25:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe651c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe64c0b63f0 con 0x7fe64c15c180 2024-08-18T22:25:32.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe643e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe64c06fad0 0x7fe64c071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56206/0 (socket says 172.21.15.5:56206) 2024-08-18T22:25:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe643e00640 1 -- 172.21.15.5:0/1103431895 learned_addr learned my addr 172.21.15.5:0/1103431895 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe64aa00640 1 --2- 172.21.15.5:0/1103431895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 0x7fe64c0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe64a000640 1 -- 172.21.15.5:0/1103431895 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3102785285 0 0) 0x7fe64c0b5e30 con 0x7fe64c06fad0 2024-08-18T22:25:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe64a000640 1 -- 172.21.15.5:0/1103431895 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe630003530 con 0x7fe64c06fad0 2024-08-18T22:25:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe64a000640 1 -- 172.21.15.5:0/1103431895 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996277399 0 0) 0x7fe64c0b6110 con 0x7fe64c071c90 2024-08-18T22:25:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe64a000640 1 -- 172.21.15.5:0/1103431895 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe64c0b5e30 con 0x7fe64c071c90 2024-08-18T22:25:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe64aa00640 1 -- 172.21.15.5:0/1103431895 >> v1:172.21.15.117:6789/0 conn(0x7fe64c071c90 legacy=0x7fe64c0d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe64aa00640 1 -- 172.21.15.5:0/1103431895 >> v1:172.21.15.5:6789/0 conn(0x7fe64c06fad0 legacy=0x7fe64c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.669+0000 7fe64aa00640 1 -- 172.21.15.5:0/1103431895 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c0b66d0 con 0x7fe64c15c180 2024-08-18T22:25:32.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.673+0000 7fe64aa00640 1 --2- 172.21.15.5:0/1103431895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 0x7fe64c0b57c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0097f0 tx=0x7fe63c01c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f0e51b30df33c5e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:32.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.673+0000 7fe64a000640 1 -- 172.21.15.5:0/1103431895 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0b0070 con 0x7fe64c15c180 2024-08-18T22:25:32.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.673+0000 7fe64a000640 1 -- 172.21.15.5:0/1103431895 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63c004230 con 0x7fe64c15c180 2024-08-18T22:25:32.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.673+0000 7fe64a000640 1 -- 172.21.15.5:0/1103431895 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c003620 con 0x7fe64c15c180 2024-08-18T22:25:32.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.673+0000 7fe651c00640 1 -- 172.21.15.5:0/1103431895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 msgr2=0x7fe64c0b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.673+0000 7fe651c00640 1 --2- 172.21.15.5:0/1103431895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 0x7fe64c0b57c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0097f0 tx=0x7fe63c01c360 comp rx=0 tx=0).stop 2024-08-18T22:25:32.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.673+0000 7fe651c00640 1 -- 172.21.15.5:0/1103431895 shutdown_connections 2024-08-18T22:25:32.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.673+0000 7fe651c00640 1 --2- 172.21.15.5:0/1103431895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 0x7fe64c0b57c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.673+0000 7fe651c00640 1 -- 172.21.15.5:0/1103431895 >> 172.21.15.5:0/1103431895 conn(0x7fe64c0b3eb0 msgr2=0x7fe64c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:32.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.673+0000 7fe651c00640 1 -- 172.21.15.5:0/1103431895 shutdown_connections 2024-08-18T22:25:32.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.673+0000 7fe651c00640 1 -- 172.21.15.5:0/1103431895 wait complete. 2024-08-18T22:25:32.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe651c00640 1 Processor -- start 2024-08-18T22:25:32.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe651c00640 1 -- start start 2024-08-18T22:25:32.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe651c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64c06fad0 0x7fe64c156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe651c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c071c90 0x7fe64c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe651c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 0x7fe64c15af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe651c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c16a160 con 0x7fe64c06fad0 2024-08-18T22:25:32.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe651c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c169fe0 con 0x7fe64c071c90 2024-08-18T22:25:32.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe651c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe64c16a2e0 con 0x7fe64c15c180 2024-08-18T22:25:32.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe64aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64c06fad0 0x7fe64c156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe64aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64c06fad0 0x7fe64c156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38178/0 (socket says 172.21.15.5:38178) 2024-08-18T22:25:32.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe64aa00640 1 -- 172.21.15.5:0/3739420106 learned_addr learned my addr 172.21.15.5:0/3739420106 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:32.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe643e00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c071c90 0x7fe64c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe64b400640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 0x7fe64c15af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe64aa00640 1 -- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 msgr2=0x7fe64c15af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe64aa00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 0x7fe64c15af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe64aa00640 1 -- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c071c90 msgr2=0x7fe64c0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe64aa00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c071c90 0x7fe64c0ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe64aa00640 1 -- 172.21.15.5:0/3739420106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c15e430 con 0x7fe64c06fad0 2024-08-18T22:25:32.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe64b400640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 0x7fe64c15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:32.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe64aa00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64c06fad0 0x7fe64c156ef0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009740 tx=0x7fe63c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:32.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe642a00640 1 -- 172.21.15.5:0/3739420106 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0bb070 con 0x7fe64c06fad0 2024-08-18T22:25:32.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe642a00640 1 -- 172.21.15.5:0/3739420106 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63c003d60 con 0x7fe64c06fad0 2024-08-18T22:25:32.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe642a00640 1 -- 172.21.15.5:0/3739420106 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0b0040 con 0x7fe64c06fad0 2024-08-18T22:25:32.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe651c00640 1 -- 172.21.15.5:0/3739420106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64c15de70 con 0x7fe64c06fad0 2024-08-18T22:25:32.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.677+0000 7fe651c00640 1 -- 172.21.15.5:0/3739420106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe64c0c71c0 con 0x7fe64c06fad0 2024-08-18T22:25:32.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.681+0000 7fe651c00640 1 -- 172.21.15.5:0/3739420106 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe64c0cf7d0 con 0x7fe64c06fad0 2024-08-18T22:25:32.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.681+0000 7fe642a00640 1 -- 172.21.15.5:0/3739420106 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe63c0be070 con 0x7fe64c06fad0 2024-08-18T22:25:32.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.681+0000 7fe642a00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6280678c0 0x7fe628069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:32.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.681+0000 7fe642a00640 1 -- 172.21.15.5:0/3739420106 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7fe63c120230 con 0x7fe64c06fad0 2024-08-18T22:25:32.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.681+0000 7fe643e00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6280678c0 0x7fe628069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:32.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.681+0000 7fe643e00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6280678c0 0x7fe628069d80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe64c070870 tx=0x7fe634007d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:32.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.685+0000 7fe642a00640 1 -- 172.21.15.5:0/3739420106 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe63c0160d0 con 0x7fe64c06fad0 2024-08-18T22:25:32.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.849+0000 7fe651c00640 1 -- 172.21.15.5:0/3739420106 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe64c0d15b0 con 0x7fe6280678c0 2024-08-18T22:25:32.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.857+0000 7fe642a00640 1 -- 172.21.15.5:0/3739420106 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248767 (secure 0 0 0) 0x7fe64c0d15b0 con 0x7fe6280678c0 2024-08-18T22:25:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:32.863 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:25:32.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 -- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6280678c0 msgr2=0x7fe628069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6280678c0 0x7fe628069d80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe64c070870 tx=0x7fe634007d80 comp rx=0 tx=0).stop 2024-08-18T22:25:32.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 -- 172.21.15.5:0/3739420106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64c06fad0 msgr2=0x7fe64c156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:32.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64c06fad0 0x7fe64c156ef0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009740 tx=0x7fe63c019160 comp rx=0 tx=0).stop 2024-08-18T22:25:32.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 -- 172.21.15.5:0/3739420106 shutdown_connections 2024-08-18T22:25:32.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6280678c0 0x7fe628069d80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64c15c180 0x7fe64c15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c071c90 0x7fe64c0ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 --2- 172.21.15.5:0/3739420106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64c06fad0 0x7fe64c156ef0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:32.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 -- 172.21.15.5:0/3739420106 >> 172.21.15.5:0/3739420106 conn(0x7fe64c0b3eb0 msgr2=0x7fe64c06cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:32.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 -- 172.21.15.5:0/3739420106 shutdown_connections 2024-08-18T22:25:32.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:32.861+0000 7fe651c00640 1 -- 172.21.15.5:0/3739420106 wait complete. 2024-08-18T22:25:32.881 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-08-18T22:25:31.714297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315532,"kb_used_data":11992,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754659188,"statfs":{"total":773094113280,"available":772771008512,"internally_reserved":0,"allocated":12279808,"data_stored":6367320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.002651"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719829+0000","last_change":"2024-08-18T22:25:28.719829+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719829+0000","last_undegraded":"2024-08-18T22:25:28.719829+0000","last_fullsized":"2024-08-18T22:25:28.719829+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726659+0000","last_change":"2024-08-18T22:25:27.726659+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726659+0000","last_undegraded":"2024-08-18T22:25:27.726659+0000","last_fullsized":"2024-08-18T22:25:27.726659+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719007+0000","last_change":"2024-08-18T22:25:28.719007+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719007+0000","last_undegraded":"2024-08-18T22:25:28.719007+0000","last_fullsized":"2024-08-18T22:25:28.719007+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725301+0000","last_change":"2024-08-18T22:25:27.725301+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725301+0000","last_undegraded":"2024-08-18T22:25:27.725301+0000","last_fullsized":"2024-08-18T22:25:27.725301+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.727488+0000","last_change":"2024-08-18T22:25:27.727488+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.727488+0000","last_undegraded":"2024-08-18T22:25:27.727488+0000","last_fullsized":"2024-08-18T22:25:27.727488+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725863+0000","last_change":"2024-08-18T22:25:27.725863+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725863+0000","last_undegraded":"2024-08-18T22:25:27.725863+0000","last_fullsized":"2024-08-18T22:25:27.725863+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724743+0000","last_change":"2024-08-18T22:25:27.724743+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724743+0000","last_undegraded":"2024-08-18T22:25:27.724743+0000","last_fullsized":"2024-08-18T22:25:27.724743+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.746487+0000","last_change":"2024-08-18T22:25:28.744499+0000","last_active":"2024-08-18T22:25:28.746487+0000","last_peered":"2024-08-18T22:25:28.746487+0000","last_clean":"2024-08-18T22:25:28.746487+0000","last_became_active":"2024-08-18T22:25:28.743063+0000","last_became_peered":"2024-08-18T22:25:28.743063+0000","last_unstale":"2024-08-18T22:25:28.746487+0000","last_undegraded":"2024-08-18T22:25:28.746487+0000","last_fullsized":"2024-08-18T22:25:28.746487+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:24:21.676787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725309+0000","last_change":"2024-08-18T22:25:27.725309+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725309+0000","last_undegraded":"2024-08-18T22:25:27.725309+0000","last_fullsized":"2024-08-18T22:25:27.725309+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.728172+0000","last_change":"2024-08-18T22:25:27.728172+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.728172+0000","last_undegraded":"2024-08-18T22:25:27.728172+0000","last_fullsized":"2024-08-18T22:25:27.728172+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725169+0000","last_change":"2024-08-18T22:25:27.725169+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725169+0000","last_undegraded":"2024-08-18T22:25:27.725169+0000","last_fullsized":"2024-08-18T22:25:27.725169+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721628+0000","last_change":"2024-08-18T22:25:28.727214+0000","last_active":"2024-08-18T22:25:29.721628+0000","last_peered":"2024-08-18T22:25:29.721628+0000","last_clean":"2024-08-18T22:25:29.721628+0000","last_became_active":"2024-08-18T22:25:28.726957+0000","last_became_peered":"2024-08-18T22:25:28.726957+0000","last_unstale":"2024-08-18T22:25:29.721628+0000","last_undegraded":"2024-08-18T22:25:29.721628+0000","last_fullsized":"2024-08-18T22:25:29.721628+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:14:19.239308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.722578+0000","last_change":"2024-08-18T22:25:27.722578+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.722578+0000","last_undegraded":"2024-08-18T22:25:27.722578+0000","last_fullsized":"2024-08-18T22:25:27.722578+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.724142+0000","last_change":"2024-08-18T22:25:28.724142+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.724142+0000","last_undegraded":"2024-08-18T22:25:28.724142+0000","last_fullsized":"2024-08-18T22:25:28.724142+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.721265+0000","last_change":"2024-08-18T22:25:28.721265+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.721265+0000","last_undegraded":"2024-08-18T22:25:28.721265+0000","last_fullsized":"2024-08-18T22:25:28.721265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720510+0000","last_change":"2024-08-18T22:25:28.720510+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720510+0000","last_undegraded":"2024-08-18T22:25:28.720510+0000","last_fullsized":"2024-08-18T22:25:28.720510+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719867+0000","last_change":"2024-08-18T22:25:28.719867+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719867+0000","last_undegraded":"2024-08-18T22:25:28.719867+0000","last_fullsized":"2024-08-18T22:25:28.719867+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725108+0000","last_change":"2024-08-18T22:25:27.725108+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725108+0000","last_undegraded":"2024-08-18T22:25:27.725108+0000","last_fullsized":"2024-08-18T22:25:27.725108+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719417+0000","last_change":"2024-08-18T22:25:28.719417+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719417+0000","last_undegraded":"2024-08-18T22:25:28.719417+0000","last_fullsized":"2024-08-18T22:25:28.719417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721622+0000","last_change":"2024-08-18T22:25:28.732094+0000","last_active":"2024-08-18T22:25:29.721622+0000","last_peered":"2024-08-18T22:25:29.721622+0000","last_clean":"2024-08-18T22:25:29.721622+0000","last_became_active":"2024-08-18T22:25:28.731793+0000","last_became_peered":"2024-08-18T22:25:28.731793+0000","last_unstale":"2024-08-18T22:25:29.721622+0000","last_undegraded":"2024-08-18T22:25:29.721622+0000","last_fullsized":"2024-08-18T22:25:29.721622+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:14.636263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741550+0000","last_change":"2024-08-18T22:25:28.738637+0000","last_active":"2024-08-18T22:25:28.741550+0000","last_peered":"2024-08-18T22:25:28.741550+0000","last_clean":"2024-08-18T22:25:28.741550+0000","last_became_active":"2024-08-18T22:25:28.738343+0000","last_became_peered":"2024-08-18T22:25:28.738343+0000","last_unstale":"2024-08-18T22:25:28.741550+0000","last_undegraded":"2024-08-18T22:25:28.741550+0000","last_fullsized":"2024-08-18T22:25:28.741550+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:23.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.722602+0000","last_change":"2024-08-18T22:25:27.722602+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.722602+0000","last_undegraded":"2024-08-18T22:25:27.722602+0000","last_fullsized":"2024-08-18T22:25:27.722602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718940+0000","last_change":"2024-08-18T22:25:28.718940+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718940+0000","last_undegraded":"2024-08-18T22:25:28.718940+0000","last_fullsized":"2024-08-18T22:25:28.718940+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723134+0000","last_change":"2024-08-18T22:25:27.723134+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723134+0000","last_undegraded":"2024-08-18T22:25:27.723134+0000","last_fullsized":"2024-08-18T22:25:27.723134+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721661+0000","last_change":"2024-08-18T22:25:28.737468+0000","last_active":"2024-08-18T22:25:29.721661+0000","last_peered":"2024-08-18T22:25:29.721661+0000","last_clean":"2024-08-18T22:25:29.721661+0000","last_became_active":"2024-08-18T22:25:28.734632+0000","last_became_peered":"2024-08-18T22:25:28.734632+0000","last_unstale":"2024-08-18T22:25:29.721661+0000","last_undegraded":"2024-08-18T22:25:29.721661+0000","last_fullsized":"2024-08-18T22:25:29.721661+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:05.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721571+0000","last_change":"2024-08-18T22:25:28.735178+0000","last_active":"2024-08-18T22:25:29.721571+0000","last_peered":"2024-08-18T22:25:29.721571+0000","last_clean":"2024-08-18T22:25:29.721571+0000","last_became_active":"2024-08-18T22:25:28.734914+0000","last_became_peered":"2024-08-18T22:25:28.734914+0000","last_unstale":"2024-08-18T22:25:29.721571+0000","last_undegraded":"2024-08-18T22:25:29.721571+0000","last_fullsized":"2024-08-18T22:25:29.721571+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:03:03.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724715+0000","last_change":"2024-08-18T22:25:27.724715+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724715+0000","last_undegraded":"2024-08-18T22:25:27.724715+0000","last_fullsized":"2024-08-18T22:25:27.724715+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724171+0000","last_change":"2024-08-18T22:25:27.724171+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724171+0000","last_undegraded":"2024-08-18T22:25:27.724171+0000","last_fullsized":"2024-08-18T22:25:27.724171+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741567+0000","last_change":"2024-08-18T22:25:28.738595+0000","last_active":"2024-08-18T22:25:28.741567+0000","last_peered":"2024-08-18T22:25:28.741567+0000","last_clean":"2024-08-18T22:25:28.741567+0000","last_became_active":"2024-08-18T22:25:28.738274+0000","last_became_peered":"2024-08-18T22:25:28.738274+0000","last_unstale":"2024-08-18T22:25:28.741567+0000","last_undegraded":"2024-08-18T22:25:28.741567+0000","last_fullsized":"2024-08-18T22:25:28.741567+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:46.453256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721136+0000","last_change":"2024-08-18T22:25:28.732585+0000","last_active":"2024-08-18T22:25:29.721136+0000","last_peered":"2024-08-18T22:25:29.721136+0000","last_clean":"2024-08-18T22:25:29.721136+0000","last_became_active":"2024-08-18T22:25:28.731808+0000","last_became_peered":"2024-08-18T22:25:28.731808+0000","last_unstale":"2024-08-18T22:25:29.721136+0000","last_undegraded":"2024-08-18T22:25:29.721136+0000","last_fullsized":"2024-08-18T22:25:29.721136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:42:03.700694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721317+0000","last_change":"2024-08-18T22:25:27.721317+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721317+0000","last_undegraded":"2024-08-18T22:25:27.721317+0000","last_fullsized":"2024-08-18T22:25:27.721317+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.744420+0000","last_change":"2024-08-18T22:25:28.738517+0000","last_active":"2024-08-18T22:25:28.744420+0000","last_peered":"2024-08-18T22:25:28.744420+0000","last_clean":"2024-08-18T22:25:28.744420+0000","last_became_active":"2024-08-18T22:25:28.738224+0000","last_became_peered":"2024-08-18T22:25:28.738224+0000","last_unstale":"2024-08-18T22:25:28.744420+0000","last_undegraded":"2024-08-18T22:25:28.744420+0000","last_fullsized":"2024-08-18T22:25:28.744420+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:12:30.173542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719070+0000","last_change":"2024-08-18T22:25:28.719070+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719070+0000","last_undegraded":"2024-08-18T22:25:28.719070+0000","last_fullsized":"2024-08-18T22:25:28.719070+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739789+0000","last_change":"2024-08-18T22:25:27.738154+0000","last_active":"2024-08-18T22:25:27.739789+0000","last_peered":"2024-08-18T22:25:27.739789+0000","last_clean":"2024-08-18T22:25:27.739789+0000","last_became_active":"2024-08-18T22:25:27.737885+0000","last_became_peered":"2024-08-18T22:25:27.737885+0000","last_unstale":"2024-08-18T22:25:27.739789+0000","last_undegraded":"2024-08-18T22:25:27.739789+0000","last_fullsized":"2024-08-18T22:25:27.739789+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:05.409913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.740290+0000","last_change":"2024-08-18T22:25:28.736655+0000","last_active":"2024-08-18T22:25:28.740290+0000","last_peered":"2024-08-18T22:25:28.740290+0000","last_clean":"2024-08-18T22:25:28.740290+0000","last_became_active":"2024-08-18T22:25:28.736388+0000","last_became_peered":"2024-08-18T22:25:28.736388+0000","last_unstale":"2024-08-18T22:25:28.740290+0000","last_undegraded":"2024-08-18T22:25:28.740290+0000","last_fullsized":"2024-08-18T22:25:28.740290+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:07:46.806767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"113'1","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.762168+0000","last_change":"2024-08-18T22:25:27.744782+0000","last_active":"2024-08-18T22:25:28.762168+0000","last_peered":"2024-08-18T22:25:28.762168+0000","last_clean":"2024-08-18T22:25:28.762168+0000","last_became_active":"2024-08-18T22:25:27.744174+0000","last_became_peered":"2024-08-18T22:25:27.744174+0000","last_unstale":"2024-08-18T22:25:28.762168+0000","last_undegraded":"2024-08-18T22:25:28.762168+0000","last_fullsized":"2024-08-18T22:25:28.762168+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:59.111032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721203+0000","last_change":"2024-08-18T22:25:28.729447+0000","last_active":"2024-08-18T22:25:29.721203+0000","last_peered":"2024-08-18T22:25:29.721203+0000","last_clean":"2024-08-18T22:25:29.721203+0000","last_became_active":"2024-08-18T22:25:28.727894+0000","last_became_peered":"2024-08-18T22:25:28.727894+0000","last_unstale":"2024-08-18T22:25:29.721203+0000","last_undegraded":"2024-08-18T22:25:29.721203+0000","last_fullsized":"2024-08-18T22:25:29.721203+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:49:11.616903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721307+0000","last_change":"2024-08-18T22:25:27.733672+0000","last_active":"2024-08-18T22:25:29.721307+0000","last_peered":"2024-08-18T22:25:29.721307+0000","last_clean":"2024-08-18T22:25:29.721307+0000","last_became_active":"2024-08-18T22:25:27.733366+0000","last_became_peered":"2024-08-18T22:25:27.733366+0000","last_unstale":"2024-08-18T22:25:29.721307+0000","last_undegraded":"2024-08-18T22:25:29.721307+0000","last_fullsized":"2024-08-18T22:25:29.721307+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:13.034285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726086+0000","last_change":"2024-08-18T22:25:27.726086+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726086+0000","last_undegraded":"2024-08-18T22:25:27.726086+0000","last_fullsized":"2024-08-18T22:25:27.726086+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739683+0000","last_change":"2024-08-18T22:25:27.737506+0000","last_active":"2024-08-18T22:25:27.739683+0000","last_peered":"2024-08-18T22:25:27.739683+0000","last_clean":"2024-08-18T22:25:27.739683+0000","last_became_active":"2024-08-18T22:25:27.737232+0000","last_became_peered":"2024-08-18T22:25:27.737232+0000","last_unstale":"2024-08-18T22:25:27.739683+0000","last_undegraded":"2024-08-18T22:25:27.739683+0000","last_fullsized":"2024-08-18T22:25:27.739683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:21.441375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724880+0000","last_change":"2024-08-18T22:25:27.724880+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724880+0000","last_undegraded":"2024-08-18T22:25:27.724880+0000","last_fullsized":"2024-08-18T22:25:27.724880+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724102+0000","last_change":"2024-08-18T22:25:27.734402+0000","last_active":"2024-08-18T22:25:28.724102+0000","last_peered":"2024-08-18T22:25:28.724102+0000","last_clean":"2024-08-18T22:25:28.724102+0000","last_became_active":"2024-08-18T22:25:27.733634+0000","last_became_peered":"2024-08-18T22:25:27.733634+0000","last_unstale":"2024-08-18T22:25:28.724102+0000","last_undegraded":"2024-08-18T22:25:28.724102+0000","last_fullsized":"2024-08-18T22:25:28.724102+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:18.699215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720476+0000","last_change":"2024-08-18T22:25:28.720476+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720476+0000","last_undegraded":"2024-08-18T22:25:28.720476+0000","last_fullsized":"2024-08-18T22:25:28.720476+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.735298+0000","last_change":"2024-08-18T22:25:27.731859+0000","last_active":"2024-08-18T22:25:27.735298+0000","last_peered":"2024-08-18T22:25:27.735298+0000","last_clean":"2024-08-18T22:25:27.735298+0000","last_became_active":"2024-08-18T22:25:27.731366+0000","last_became_peered":"2024-08-18T22:25:27.731366+0000","last_unstale":"2024-08-18T22:25:27.735298+0000","last_undegraded":"2024-08-18T22:25:27.735298+0000","last_fullsized":"2024-08-18T22:25:27.735298+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:00.986288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721343+0000","last_change":"2024-08-18T22:25:27.721343+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721343+0000","last_undegraded":"2024-08-18T22:25:27.721343+0000","last_fullsized":"2024-08-18T22:25:27.721343+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720400+0000","last_change":"2024-08-18T22:25:27.738161+0000","last_active":"2024-08-18T22:25:29.720400+0000","last_peered":"2024-08-18T22:25:29.720400+0000","last_clean":"2024-08-18T22:25:29.720400+0000","last_became_active":"2024-08-18T22:25:27.737855+0000","last_became_peered":"2024-08-18T22:25:27.737855+0000","last_unstale":"2024-08-18T22:25:29.720400+0000","last_undegraded":"2024-08-18T22:25:29.720400+0000","last_fullsized":"2024-08-18T22:25:29.720400+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:42:10.877593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726107+0000","last_change":"2024-08-18T22:25:27.726107+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726107+0000","last_undegraded":"2024-08-18T22:25:27.726107+0000","last_fullsized":"2024-08-18T22:25:27.726107+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739758+0000","last_change":"2024-08-18T22:25:27.736484+0000","last_active":"2024-08-18T22:25:27.739758+0000","last_peered":"2024-08-18T22:25:27.739758+0000","last_clean":"2024-08-18T22:25:27.739758+0000","last_became_active":"2024-08-18T22:25:27.736159+0000","last_became_peered":"2024-08-18T22:25:27.736159+0000","last_unstale":"2024-08-18T22:25:27.739758+0000","last_undegraded":"2024-08-18T22:25:27.739758+0000","last_fullsized":"2024-08-18T22:25:27.739758+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:47.068872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718749+0000","last_change":"2024-08-18T22:25:28.718749+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718749+0000","last_undegraded":"2024-08-18T22:25:28.718749+0000","last_fullsized":"2024-08-18T22:25:28.718749+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721458+0000","last_change":"2024-08-18T22:25:27.736398+0000","last_active":"2024-08-18T22:25:29.721458+0000","last_peered":"2024-08-18T22:25:29.721458+0000","last_clean":"2024-08-18T22:25:29.721458+0000","last_became_active":"2024-08-18T22:25:27.735991+0000","last_became_peered":"2024-08-18T22:25:27.735991+0000","last_unstale":"2024-08-18T22:25:29.721458+0000","last_undegraded":"2024-08-18T22:25:29.721458+0000","last_fullsized":"2024-08-18T22:25:29.721458+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.681647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723136+0000","last_change":"2024-08-18T22:25:27.723136+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723136+0000","last_undegraded":"2024-08-18T22:25:27.723136+0000","last_fullsized":"2024-08-18T22:25:27.723136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.719184+0000","last_change":"2024-08-18T22:25:27.740411+0000","last_active":"2024-08-18T22:25:28.719184+0000","last_peered":"2024-08-18T22:25:28.719184+0000","last_clean":"2024-08-18T22:25:28.719184+0000","last_became_active":"2024-08-18T22:25:27.740044+0000","last_became_peered":"2024-08-18T22:25:27.740044+0000","last_unstale":"2024-08-18T22:25:28.719184+0000","last_undegraded":"2024-08-18T22:25:28.719184+0000","last_fullsized":"2024-08-18T22:25:28.719184+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:26:05.404663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.743068+0000","last_change":"2024-08-18T22:25:28.740188+0000","last_active":"2024-08-18T22:25:28.743068+0000","last_peered":"2024-08-18T22:25:28.743068+0000","last_clean":"2024-08-18T22:25:28.743068+0000","last_became_active":"2024-08-18T22:25:28.739904+0000","last_became_peered":"2024-08-18T22:25:28.739904+0000","last_unstale":"2024-08-18T22:25:28.743068+0000","last_undegraded":"2024-08-18T22:25:28.743068+0000","last_fullsized":"2024-08-18T22:25:28.743068+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:14:29.817257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724154+0000","last_change":"2024-08-18T22:25:27.737622+0000","last_active":"2024-08-18T22:25:28.724154+0000","last_peered":"2024-08-18T22:25:28.724154+0000","last_clean":"2024-08-18T22:25:28.724154+0000","last_became_active":"2024-08-18T22:25:27.737354+0000","last_became_peered":"2024-08-18T22:25:27.737354+0000","last_unstale":"2024-08-18T22:25:28.724154+0000","last_undegraded":"2024-08-18T22:25:28.724154+0000","last_fullsized":"2024-08-18T22:25:28.724154+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:35.786573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723893+0000","last_change":"2024-08-18T22:25:27.723893+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723893+0000","last_undegraded":"2024-08-18T22:25:27.723893+0000","last_fullsized":"2024-08-18T22:25:27.723893+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.741090+0000","last_change":"2024-08-18T22:25:27.738707+0000","last_active":"2024-08-18T22:25:27.741090+0000","last_peered":"2024-08-18T22:25:27.741090+0000","last_clean":"2024-08-18T22:25:27.741090+0000","last_became_active":"2024-08-18T22:25:27.738399+0000","last_became_peered":"2024-08-18T22:25:27.738399+0000","last_unstale":"2024-08-18T22:25:27.741090+0000","last_undegraded":"2024-08-18T22:25:27.741090+0000","last_fullsized":"2024-08-18T22:25:27.741090+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:59.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723792+0000","last_change":"2024-08-18T22:25:27.723792+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723792+0000","last_undegraded":"2024-08-18T22:25:27.723792+0000","last_fullsized":"2024-08-18T22:25:27.723792+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.744713+0000","last_change":"2024-08-18T22:25:27.743973+0000","last_active":"2024-08-18T22:25:27.744713+0000","last_peered":"2024-08-18T22:25:27.744713+0000","last_clean":"2024-08-18T22:25:27.744713+0000","last_became_active":"2024-08-18T22:25:27.743650+0000","last_became_peered":"2024-08-18T22:25:27.743650+0000","last_unstale":"2024-08-18T22:25:27.744713+0000","last_undegraded":"2024-08-18T22:25:27.744713+0000","last_fullsized":"2024-08-18T22:25:27.744713+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:57.080994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721308+0000","last_change":"2024-08-18T22:25:27.721308+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721308+0000","last_undegraded":"2024-08-18T22:25:27.721308+0000","last_fullsized":"2024-08-18T22:25:27.721308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739723+0000","last_change":"2024-08-18T22:25:27.736833+0000","last_active":"2024-08-18T22:25:27.739723+0000","last_peered":"2024-08-18T22:25:27.739723+0000","last_clean":"2024-08-18T22:25:27.739723+0000","last_became_active":"2024-08-18T22:25:27.736456+0000","last_became_peered":"2024-08-18T22:25:27.736456+0000","last_unstale":"2024-08-18T22:25:27.739723+0000","last_undegraded":"2024-08-18T22:25:27.739723+0000","last_fullsized":"2024-08-18T22:25:27.739723+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:03.142020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.743792+0000","last_change":"2024-08-18T22:25:28.739981+0000","last_active":"2024-08-18T22:25:28.743792+0000","last_peered":"2024-08-18T22:25:28.743792+0000","last_clean":"2024-08-18T22:25:28.743792+0000","last_became_active":"2024-08-18T22:25:28.738317+0000","last_became_peered":"2024-08-18T22:25:28.738317+0000","last_unstale":"2024-08-18T22:25:28.743792+0000","last_undegraded":"2024-08-18T22:25:28.743792+0000","last_fullsized":"2024-08-18T22:25:28.743792+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:34.358754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.729238+0000","last_change":"2024-08-18T22:25:27.743028+0000","last_active":"2024-08-18T22:25:28.729238+0000","last_peered":"2024-08-18T22:25:28.729238+0000","last_clean":"2024-08-18T22:25:28.729238+0000","last_became_active":"2024-08-18T22:25:27.742106+0000","last_became_peered":"2024-08-18T22:25:27.742106+0000","last_unstale":"2024-08-18T22:25:28.729238+0000","last_undegraded":"2024-08-18T22:25:28.729238+0000","last_fullsized":"2024-08-18T22:25:28.729238+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:56.157132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720145+0000","last_change":"2024-08-18T22:25:28.720145+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720145+0000","last_undegraded":"2024-08-18T22:25:28.720145+0000","last_fullsized":"2024-08-18T22:25:28.720145+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720737+0000","last_change":"2024-08-18T22:25:27.738551+0000","last_active":"2024-08-18T22:25:29.720737+0000","last_peered":"2024-08-18T22:25:29.720737+0000","last_clean":"2024-08-18T22:25:29.720737+0000","last_became_active":"2024-08-18T22:25:27.737360+0000","last_became_peered":"2024-08-18T22:25:27.737360+0000","last_unstale":"2024-08-18T22:25:29.720737+0000","last_undegraded":"2024-08-18T22:25:29.720737+0000","last_fullsized":"2024-08-18T22:25:29.720737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:54:38.492348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.744395+0000","last_change":"2024-08-18T22:25:28.737712+0000","last_active":"2024-08-18T22:25:28.744395+0000","last_peered":"2024-08-18T22:25:28.744395+0000","last_clean":"2024-08-18T22:25:28.744395+0000","last_became_active":"2024-08-18T22:25:28.737443+0000","last_became_peered":"2024-08-18T22:25:28.737443+0000","last_unstale":"2024-08-18T22:25:28.744395+0000","last_undegraded":"2024-08-18T22:25:28.744395+0000","last_fullsized":"2024-08-18T22:25:28.744395+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:17.054695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.734543+0000","last_change":"2024-08-18T22:25:27.728904+0000","last_active":"2024-08-18T22:25:27.734543+0000","last_peered":"2024-08-18T22:25:27.734543+0000","last_clean":"2024-08-18T22:25:27.734543+0000","last_became_active":"2024-08-18T22:25:27.728636+0000","last_became_peered":"2024-08-18T22:25:27.728636+0000","last_unstale":"2024-08-18T22:25:27.734543+0000","last_undegraded":"2024-08-18T22:25:27.734543+0000","last_fullsized":"2024-08-18T22:25:27.734543+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:57.080994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721301+0000","last_change":"2024-08-18T22:25:27.721301+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721301+0000","last_undegraded":"2024-08-18T22:25:27.721301+0000","last_fullsized":"2024-08-18T22:25:27.721301+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724314+0000","last_change":"2024-08-18T22:25:27.729731+0000","last_active":"2024-08-18T22:25:28.724314+0000","last_peered":"2024-08-18T22:25:28.724314+0000","last_clean":"2024-08-18T22:25:28.724314+0000","last_became_active":"2024-08-18T22:25:27.729336+0000","last_became_peered":"2024-08-18T22:25:27.729336+0000","last_unstale":"2024-08-18T22:25:28.724314+0000","last_undegraded":"2024-08-18T22:25:28.724314+0000","last_fullsized":"2024-08-18T22:25:28.724314+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:53.446928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.727065+0000","last_change":"2024-08-18T22:25:27.727065+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.727065+0000","last_undegraded":"2024-08-18T22:25:27.727065+0000","last_fullsized":"2024-08-18T22:25:27.727065+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.738837+0000","last_change":"2024-08-18T22:25:27.735677+0000","last_active":"2024-08-18T22:25:27.738837+0000","last_peered":"2024-08-18T22:25:27.738837+0000","last_clean":"2024-08-18T22:25:27.738837+0000","last_became_active":"2024-08-18T22:25:27.735124+0000","last_became_peered":"2024-08-18T22:25:27.735124+0000","last_unstale":"2024-08-18T22:25:27.738837+0000","last_undegraded":"2024-08-18T22:25:27.738837+0000","last_fullsized":"2024-08-18T22:25:27.738837+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:31.547107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718796+0000","last_change":"2024-08-18T22:25:28.718796+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718796+0000","last_undegraded":"2024-08-18T22:25:28.718796+0000","last_fullsized":"2024-08-18T22:25:28.718796+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"113'2","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.758597+0000","last_change":"2024-08-18T22:25:27.740165+0000","last_active":"2024-08-18T22:25:28.758597+0000","last_peered":"2024-08-18T22:25:28.758597+0000","last_clean":"2024-08-18T22:25:28.758597+0000","last_became_active":"2024-08-18T22:25:27.736854+0000","last_became_peered":"2024-08-18T22:25:27.736854+0000","last_unstale":"2024-08-18T22:25:28.758597+0000","last_undegraded":"2024-08-18T22:25:28.758597+0000","last_fullsized":"2024-08-18T22:25:28.758597+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:42:12.311494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719780+0000","last_change":"2024-08-18T22:25:28.719780+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719780+0000","last_undegraded":"2024-08-18T22:25:28.719780+0000","last_fullsized":"2024-08-18T22:25:28.719780+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.730023+0000","last_change":"2024-08-18T22:25:27.743195+0000","last_active":"2024-08-18T22:25:28.730023+0000","last_peered":"2024-08-18T22:25:28.730023+0000","last_clean":"2024-08-18T22:25:28.730023+0000","last_became_active":"2024-08-18T22:25:27.742876+0000","last_became_peered":"2024-08-18T22:25:27.742876+0000","last_unstale":"2024-08-18T22:25:28.730023+0000","last_undegraded":"2024-08-18T22:25:28.730023+0000","last_fullsized":"2024-08-18T22:25:28.730023+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:34.262887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724420+0000","last_change":"2024-08-18T22:25:27.724420+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724420+0000","last_undegraded":"2024-08-18T22:25:27.724420+0000","last_fullsized":"2024-08-18T22:25:27.724420+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.737580+0000","last_change":"2024-08-18T22:25:27.729602+0000","last_active":"2024-08-18T22:25:27.737580+0000","last_peered":"2024-08-18T22:25:27.737580+0000","last_clean":"2024-08-18T22:25:27.737580+0000","last_became_active":"2024-08-18T22:25:27.729342+0000","last_became_peered":"2024-08-18T22:25:27.729342+0000","last_unstale":"2024-08-18T22:25:27.737580+0000","last_undegraded":"2024-08-18T22:25:27.737580+0000","last_fullsized":"2024-08-18T22:25:27.737580+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:38.345310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.739416+0000","last_change":"2024-08-18T22:25:28.735821+0000","last_active":"2024-08-18T22:25:28.739416+0000","last_peered":"2024-08-18T22:25:28.739416+0000","last_clean":"2024-08-18T22:25:28.739416+0000","last_became_active":"2024-08-18T22:25:28.735547+0000","last_became_peered":"2024-08-18T22:25:28.735547+0000","last_unstale":"2024-08-18T22:25:28.739416+0000","last_undegraded":"2024-08-18T22:25:28.739416+0000","last_fullsized":"2024-08-18T22:25:28.739416+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:11.104170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.731246+0000","last_change":"2024-08-18T22:25:27.739921+0000","last_active":"2024-08-18T22:25:28.731246+0000","last_peered":"2024-08-18T22:25:28.731246+0000","last_clean":"2024-08-18T22:25:28.731246+0000","last_became_active":"2024-08-18T22:25:27.739634+0000","last_became_peered":"2024-08-18T22:25:27.739634+0000","last_unstale":"2024-08-18T22:25:28.731246+0000","last_undegraded":"2024-08-18T22:25:28.731246+0000","last_fullsized":"2024-08-18T22:25:28.731246+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:48.519152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718694+0000","last_change":"2024-08-18T22:25:28.718694+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718694+0000","last_undegraded":"2024-08-18T22:25:28.718694+0000","last_fullsized":"2024-08-18T22:25:28.718694+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.745206+0000","last_change":"2024-08-18T22:25:27.744272+0000","last_active":"2024-08-18T22:25:27.745206+0000","last_peered":"2024-08-18T22:25:27.745206+0000","last_clean":"2024-08-18T22:25:27.745206+0000","last_became_active":"2024-08-18T22:25:27.744026+0000","last_became_peered":"2024-08-18T22:25:27.744026+0000","last_unstale":"2024-08-18T22:25:27.745206+0000","last_undegraded":"2024-08-18T22:25:27.745206+0000","last_fullsized":"2024-08-18T22:25:27.745206+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:38.345310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720287+0000","last_change":"2024-08-18T22:25:28.728579+0000","last_active":"2024-08-18T22:25:29.720287+0000","last_peered":"2024-08-18T22:25:29.720287+0000","last_clean":"2024-08-18T22:25:29.720287+0000","last_became_active":"2024-08-18T22:25:28.728302+0000","last_became_peered":"2024-08-18T22:25:28.728302+0000","last_unstale":"2024-08-18T22:25:29.720287+0000","last_undegraded":"2024-08-18T22:25:29.720287+0000","last_fullsized":"2024-08-18T22:25:29.720287+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:15.603682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.719343+0000","last_change":"2024-08-18T22:25:27.738515+0000","last_active":"2024-08-18T22:25:28.719343+0000","last_peered":"2024-08-18T22:25:28.719343+0000","last_clean":"2024-08-18T22:25:28.719343+0000","last_became_active":"2024-08-18T22:25:27.738233+0000","last_became_peered":"2024-08-18T22:25:27.738233+0000","last_unstale":"2024-08-18T22:25:28.719343+0000","last_undegraded":"2024-08-18T22:25:28.719343+0000","last_fullsized":"2024-08-18T22:25:28.719343+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:06.452774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723453+0000","last_change":"2024-08-18T22:25:27.723453+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723453+0000","last_undegraded":"2024-08-18T22:25:27.723453+0000","last_fullsized":"2024-08-18T22:25:27.723453+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.740920+0000","last_change":"2024-08-18T22:25:27.736974+0000","last_active":"2024-08-18T22:25:27.740920+0000","last_peered":"2024-08-18T22:25:27.740920+0000","last_clean":"2024-08-18T22:25:27.740920+0000","last_became_active":"2024-08-18T22:25:27.736651+0000","last_became_peered":"2024-08-18T22:25:27.736651+0000","last_unstale":"2024-08-18T22:25:27.740920+0000","last_undegraded":"2024-08-18T22:25:27.740920+0000","last_fullsized":"2024-08-18T22:25:27.740920+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:55:00.779397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726523+0000","last_change":"2024-08-18T22:25:27.726523+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726523+0000","last_undegraded":"2024-08-18T22:25:27.726523+0000","last_fullsized":"2024-08-18T22:25:27.726523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.742177+0000","last_change":"2024-08-18T22:25:27.741264+0000","last_active":"2024-08-18T22:25:27.742177+0000","last_peered":"2024-08-18T22:25:27.742177+0000","last_clean":"2024-08-18T22:25:27.742177+0000","last_became_active":"2024-08-18T22:25:27.740478+0000","last_became_peered":"2024-08-18T22:25:27.740478+0000","last_unstale":"2024-08-18T22:25:27.742177+0000","last_undegraded":"2024-08-18T22:25:27.742177+0000","last_fullsized":"2024-08-18T22:25:27.742177+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:42.261529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741656+0000","last_change":"2024-08-18T22:25:28.739269+0000","last_active":"2024-08-18T22:25:28.741656+0000","last_peered":"2024-08-18T22:25:28.741656+0000","last_clean":"2024-08-18T22:25:28.741656+0000","last_became_active":"2024-08-18T22:25:28.738998+0000","last_became_peered":"2024-08-18T22:25:28.738998+0000","last_unstale":"2024-08-18T22:25:28.741656+0000","last_undegraded":"2024-08-18T22:25:28.741656+0000","last_fullsized":"2024-08-18T22:25:28.741656+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:34.516916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721212+0000","last_change":"2024-08-18T22:25:27.729754+0000","last_active":"2024-08-18T22:25:29.721212+0000","last_peered":"2024-08-18T22:25:29.721212+0000","last_clean":"2024-08-18T22:25:29.721212+0000","last_became_active":"2024-08-18T22:25:27.729444+0000","last_became_peered":"2024-08-18T22:25:27.729444+0000","last_unstale":"2024-08-18T22:25:29.721212+0000","last_undegraded":"2024-08-18T22:25:29.721212+0000","last_fullsized":"2024-08-18T22:25:29.721212+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:44.526490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.736249+0000","last_change":"2024-08-18T22:25:28.735227+0000","last_active":"2024-08-18T22:25:28.736249+0000","last_peered":"2024-08-18T22:25:28.736249+0000","last_clean":"2024-08-18T22:25:28.736249+0000","last_became_active":"2024-08-18T22:25:28.734944+0000","last_became_peered":"2024-08-18T22:25:28.734944+0000","last_unstale":"2024-08-18T22:25:28.736249+0000","last_undegraded":"2024-08-18T22:25:28.736249+0000","last_fullsized":"2024-08-18T22:25:28.736249+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:23.812669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.730204+0000","last_change":"2024-08-18T22:25:27.742531+0000","last_active":"2024-08-18T22:25:28.730204+0000","last_peered":"2024-08-18T22:25:28.730204+0000","last_clean":"2024-08-18T22:25:28.730204+0000","last_became_active":"2024-08-18T22:25:27.741977+0000","last_became_peered":"2024-08-18T22:25:27.741977+0000","last_unstale":"2024-08-18T22:25:28.730204+0000","last_undegraded":"2024-08-18T22:25:28.730204+0000","last_fullsized":"2024-08-18T22:25:28.730204+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:19:55.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.724635+0000","last_change":"2024-08-18T22:25:28.724635+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.724635+0000","last_undegraded":"2024-08-18T22:25:28.724635+0000","last_fullsized":"2024-08-18T22:25:28.724635+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.740032+0000","last_change":"2024-08-18T22:25:27.733640+0000","last_active":"2024-08-18T22:25:27.740032+0000","last_peered":"2024-08-18T22:25:27.740032+0000","last_clean":"2024-08-18T22:25:27.740032+0000","last_became_active":"2024-08-18T22:25:27.733277+0000","last_became_peered":"2024-08-18T22:25:27.733277+0000","last_unstale":"2024-08-18T22:25:27.740032+0000","last_undegraded":"2024-08-18T22:25:27.740032+0000","last_fullsized":"2024-08-18T22:25:27.740032+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:47:32.598265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725469+0000","last_change":"2024-08-18T22:25:27.725469+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725469+0000","last_undegraded":"2024-08-18T22:25:27.725469+0000","last_fullsized":"2024-08-18T22:25:27.725469+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.731395+0000","last_change":"2024-08-18T22:25:27.743464+0000","last_active":"2024-08-18T22:25:28.731395+0000","last_peered":"2024-08-18T22:25:28.731395+0000","last_clean":"2024-08-18T22:25:28.731395+0000","last_became_active":"2024-08-18T22:25:27.742955+0000","last_became_peered":"2024-08-18T22:25:27.742955+0000","last_unstale":"2024-08-18T22:25:28.731395+0000","last_undegraded":"2024-08-18T22:25:28.731395+0000","last_fullsized":"2024-08-18T22:25:28.731395+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:27:25.115281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725858+0000","last_change":"2024-08-18T22:25:27.725858+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725858+0000","last_undegraded":"2024-08-18T22:25:27.725858+0000","last_fullsized":"2024-08-18T22:25:27.725858+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"113'2","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.758528+0000","last_change":"2024-08-18T22:25:27.744925+0000","last_active":"2024-08-18T22:25:28.758528+0000","last_peered":"2024-08-18T22:25:28.758528+0000","last_clean":"2024-08-18T22:25:28.758528+0000","last_became_active":"2024-08-18T22:25:27.744534+0000","last_became_peered":"2024-08-18T22:25:27.744534+0000","last_unstale":"2024-08-18T22:25:28.758528+0000","last_undegraded":"2024-08-18T22:25:28.758528+0000","last_fullsized":"2024-08-18T22:25:28.758528+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:41.300048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":357,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.720940+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:25:28.720940+0000","last_peered":"2024-08-18T22:25:28.720940+0000","last_clean":"2024-08-18T22:25:28.720940+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:25:28.720940+0000","last_undegraded":"2024-08-18T22:25:28.720940+0000","last_fullsized":"2024-08-18T22:25:28.720940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37268,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334572,"statfs":{"total":96636764160,"available":96598601728,"internally_reserved":0,"allocated":1974272,"data_stored":1236047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36688,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335152,"statfs":{"total":96636764160,"available":96599195648,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509519,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36696,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335144,"statfs":{"total":96636764160,"available":96599187456,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40848,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330992,"statfs":{"total":96636764160,"available":96594935808,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509520,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":1974272,"data_stored":1236047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":1413120,"data_stored":659630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40864,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330976,"statfs":{"total":96636764160,"available":96594919424,"internally_reserved":0,"allocated":1396736,"data_stored":652880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:25:32.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:25:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe6a2200640 1 Processor -- start 2024-08-18T22:25:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe6a2200640 1 -- start start 2024-08-18T22:25:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe6a2200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe69c15bed0 0x7fe69c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe6a2200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe69c06da70 0x7fe69c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe6a2200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe69c073c80 con 0x7fe69c0cb390 2024-08-18T22:25:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe6a2200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe69c06e420 con 0x7fe69c15bed0 2024-08-18T22:25:33.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe6a2200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe69c0ca5d0 con 0x7fe69c06da70 2024-08-18T22:25:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe69b400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe69c15bed0 0x7fe69c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe69be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe69c06da70 0x7fe69c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe693e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe69c0cb390 0x7fe69c071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:43578/0 (socket says 172.21.15.5:43578) 2024-08-18T22:25:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe693e00640 1 -- 172.21.15.5:0/1808368184 learned_addr learned my addr 172.21.15.5:0/1808368184 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe69aa00640 1 -- 172.21.15.5:0/1808368184 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547072406 0 0) 0x7fe69c073c80 con 0x7fe69c0cb390 2024-08-18T22:25:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe69aa00640 1 -- 172.21.15.5:0/1808368184 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe680003530 con 0x7fe69c0cb390 2024-08-18T22:25:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe69be00640 1 -- 172.21.15.5:0/1808368184 >> v2:172.21.15.117:3300/0 conn(0x7fe69c15bed0 msgr2=0x7fe69c0735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe69be00640 1 --2- 172.21.15.5:0/1808368184 >> v2:172.21.15.117:3300/0 conn(0x7fe69c15bed0 0x7fe69c0735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe69be00640 1 -- 172.21.15.5:0/1808368184 >> v1:172.21.15.117:6789/0 conn(0x7fe69c0cb390 legacy=0x7fe69c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe69be00640 1 -- 172.21.15.5:0/1808368184 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69c0ca8b0 con 0x7fe69c06da70 2024-08-18T22:25:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.065+0000 7fe69b400640 1 --2- 172.21.15.5:0/1808368184 >> v2:172.21.15.117:3300/0 conn(0x7fe69c15bed0 0x7fe69c0735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:25:33.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe69be00640 1 --2- 172.21.15.5:0/1808368184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe69c06da70 0x7fe69c06dee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe694009d90 tx=0x7fe69401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74645594fccdbbb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe69aa00640 1 -- 172.21.15.5:0/1808368184 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6940b2070 con 0x7fe69c06da70 2024-08-18T22:25:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe69aa00640 1 -- 172.21.15.5:0/1808368184 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6940a5a00 con 0x7fe69c06da70 2024-08-18T22:25:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe69aa00640 1 -- 172.21.15.5:0/1808368184 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6940a5dd0 con 0x7fe69c06da70 2024-08-18T22:25:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe6a2200640 1 -- 172.21.15.5:0/1808368184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe69c06da70 msgr2=0x7fe69c06dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe6a2200640 1 --2- 172.21.15.5:0/1808368184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe69c06da70 0x7fe69c06dee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe694009d90 tx=0x7fe69401c940 comp rx=0 tx=0).stop 2024-08-18T22:25:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe6a2200640 1 -- 172.21.15.5:0/1808368184 shutdown_connections 2024-08-18T22:25:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe6a2200640 1 --2- 172.21.15.5:0/1808368184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe69c06da70 0x7fe69c06dee0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe6a2200640 1 --2- 172.21.15.5:0/1808368184 >> v2:172.21.15.117:3300/0 conn(0x7fe69c15bed0 0x7fe69c0735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe6a2200640 1 -- 172.21.15.5:0/1808368184 >> 172.21.15.5:0/1808368184 conn(0x7fe69c0b1c50 msgr2=0x7fe69c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe6a2200640 1 -- 172.21.15.5:0/1808368184 shutdown_connections 2024-08-18T22:25:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.069+0000 7fe6a2200640 1 -- 172.21.15.5:0/1808368184 wait complete. 2024-08-18T22:25:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe6a2200640 1 Processor -- start 2024-08-18T22:25:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe6a2200640 1 -- start start 2024-08-18T22:25:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe6a2200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe69c06da70 0x7fe69c0ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe6a2200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c0cb390 0x7fe69c0adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe6a2200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe69c15bed0 0x7fe69c1f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe6a2200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c168520 con 0x7fe69c06da70 2024-08-18T22:25:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe6a2200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c1683a0 con 0x7fe69c0cb390 2024-08-18T22:25:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe6a2200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe69c1686a0 con 0x7fe69c15bed0 2024-08-18T22:25:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe69b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe69c06da70 0x7fe69c0ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe69b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe69c06da70 0x7fe69c0ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38190/0 (socket says 172.21.15.5:38190) 2024-08-18T22:25:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe69b400640 1 -- 172.21.15.5:0/14836082 learned_addr learned my addr 172.21.15.5:0/14836082 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe693e00640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c0cb390 0x7fe69c0adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe69be00640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe69c15bed0 0x7fe69c1f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe69b400640 1 -- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe69c15bed0 msgr2=0x7fe69c1f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe69b400640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe69c15bed0 0x7fe69c1f6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe69b400640 1 -- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c0cb390 msgr2=0x7fe69c0adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe69b400640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c0cb390 0x7fe69c0adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe69b400640 1 -- 172.21.15.5:0/14836082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69c15a250 con 0x7fe69c06da70 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe693e00640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c0cb390 0x7fe69c0adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe69b400640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe69c06da70 0x7fe69c0ad7a0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00ebe0 tx=0x7fe68c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe693400640 1 -- 172.21.15.5:0/14836082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c017070 con 0x7fe69c06da70 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe693400640 1 -- 172.21.15.5:0/14836082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe68c00cbd0 con 0x7fe69c06da70 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe6a2200640 1 -- 172.21.15.5:0/14836082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69c15a530 con 0x7fe69c06da70 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe693400640 1 -- 172.21.15.5:0/14836082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c013470 con 0x7fe69c06da70 2024-08-18T22:25:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe6a2200640 1 -- 172.21.15.5:0/14836082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe69c15aaf0 con 0x7fe69c06da70 2024-08-18T22:25:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.073+0000 7fe6a2200640 1 -- 172.21.15.5:0/14836082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe69c06dee0 con 0x7fe69c06da70 2024-08-18T22:25:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.077+0000 7fe693400640 1 -- 172.21.15.5:0/14836082 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe68c01a070 con 0x7fe69c06da70 2024-08-18T22:25:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.077+0000 7fe693400640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6780678c0 0x7fe678069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.077+0000 7fe693400640 1 -- 172.21.15.5:0/14836082 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7fe68c0860f0 con 0x7fe69c06da70 2024-08-18T22:25:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.077+0000 7fe693e00640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6780678c0 0x7fe678069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.077+0000 7fe693e00640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6780678c0 0x7fe678069d80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe69c09deb0 tx=0x7fe684009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.081+0000 7fe693400640 1 -- 172.21.15.5:0/14836082 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe68c0563c0 con 0x7fe69c06da70 2024-08-18T22:25:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.245+0000 7fe6a2200640 1 -- 172.21.15.5:0/14836082 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe69c0b5f80 con 0x7fe6780678c0 2024-08-18T22:25:33.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.253+0000 7fe693400640 1 -- 172.21.15.5:0/14836082 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248767 (secure 0 0 0) 0x7fe69c0b5f80 con 0x7fe6780678c0 2024-08-18T22:25:33.255 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:25:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 -- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6780678c0 msgr2=0x7fe678069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6780678c0 0x7fe678069d80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe69c09deb0 tx=0x7fe684009040 comp rx=0 tx=0).stop 2024-08-18T22:25:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 -- 172.21.15.5:0/14836082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe69c06da70 msgr2=0x7fe69c0ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe69c06da70 0x7fe69c0ad7a0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00ebe0 tx=0x7fe68c00c520 comp rx=0 tx=0).stop 2024-08-18T22:25:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 -- 172.21.15.5:0/14836082 shutdown_connections 2024-08-18T22:25:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe6780678c0 0x7fe678069d80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe69c15bed0 0x7fe69c1f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe69c0cb390 0x7fe69c0adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 --2- 172.21.15.5:0/14836082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe69c06da70 0x7fe69c0ad7a0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 -- 172.21.15.5:0/14836082 >> 172.21.15.5:0/14836082 conn(0x7fe69c0b1c50 msgr2=0x7fe69c0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 -- 172.21.15.5:0/14836082 shutdown_connections 2024-08-18T22:25:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.257+0000 7fe6a2200640 1 -- 172.21.15.5:0/14836082 wait complete. 2024-08-18T22:25:33.275 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-08-18T22:25:31.714297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315532,"kb_used_data":11992,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754659188,"statfs":{"total":773094113280,"available":772771008512,"internally_reserved":0,"allocated":12279808,"data_stored":6367320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.002651"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719829+0000","last_change":"2024-08-18T22:25:28.719829+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719829+0000","last_undegraded":"2024-08-18T22:25:28.719829+0000","last_fullsized":"2024-08-18T22:25:28.719829+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726659+0000","last_change":"2024-08-18T22:25:27.726659+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726659+0000","last_undegraded":"2024-08-18T22:25:27.726659+0000","last_fullsized":"2024-08-18T22:25:27.726659+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719007+0000","last_change":"2024-08-18T22:25:28.719007+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719007+0000","last_undegraded":"2024-08-18T22:25:28.719007+0000","last_fullsized":"2024-08-18T22:25:28.719007+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725301+0000","last_change":"2024-08-18T22:25:27.725301+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725301+0000","last_undegraded":"2024-08-18T22:25:27.725301+0000","last_fullsized":"2024-08-18T22:25:27.725301+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.727488+0000","last_change":"2024-08-18T22:25:27.727488+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.727488+0000","last_undegraded":"2024-08-18T22:25:27.727488+0000","last_fullsized":"2024-08-18T22:25:27.727488+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725863+0000","last_change":"2024-08-18T22:25:27.725863+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725863+0000","last_undegraded":"2024-08-18T22:25:27.725863+0000","last_fullsized":"2024-08-18T22:25:27.725863+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724743+0000","last_change":"2024-08-18T22:25:27.724743+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724743+0000","last_undegraded":"2024-08-18T22:25:27.724743+0000","last_fullsized":"2024-08-18T22:25:27.724743+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.746487+0000","last_change":"2024-08-18T22:25:28.744499+0000","last_active":"2024-08-18T22:25:28.746487+0000","last_peered":"2024-08-18T22:25:28.746487+0000","last_clean":"2024-08-18T22:25:28.746487+0000","last_became_active":"2024-08-18T22:25:28.743063+0000","last_became_peered":"2024-08-18T22:25:28.743063+0000","last_unstale":"2024-08-18T22:25:28.746487+0000","last_undegraded":"2024-08-18T22:25:28.746487+0000","last_fullsized":"2024-08-18T22:25:28.746487+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:24:21.676787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725309+0000","last_change":"2024-08-18T22:25:27.725309+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725309+0000","last_undegraded":"2024-08-18T22:25:27.725309+0000","last_fullsized":"2024-08-18T22:25:27.725309+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.728172+0000","last_change":"2024-08-18T22:25:27.728172+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.728172+0000","last_undegraded":"2024-08-18T22:25:27.728172+0000","last_fullsized":"2024-08-18T22:25:27.728172+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725169+0000","last_change":"2024-08-18T22:25:27.725169+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725169+0000","last_undegraded":"2024-08-18T22:25:27.725169+0000","last_fullsized":"2024-08-18T22:25:27.725169+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721628+0000","last_change":"2024-08-18T22:25:28.727214+0000","last_active":"2024-08-18T22:25:29.721628+0000","last_peered":"2024-08-18T22:25:29.721628+0000","last_clean":"2024-08-18T22:25:29.721628+0000","last_became_active":"2024-08-18T22:25:28.726957+0000","last_became_peered":"2024-08-18T22:25:28.726957+0000","last_unstale":"2024-08-18T22:25:29.721628+0000","last_undegraded":"2024-08-18T22:25:29.721628+0000","last_fullsized":"2024-08-18T22:25:29.721628+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:14:19.239308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.722578+0000","last_change":"2024-08-18T22:25:27.722578+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.722578+0000","last_undegraded":"2024-08-18T22:25:27.722578+0000","last_fullsized":"2024-08-18T22:25:27.722578+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.724142+0000","last_change":"2024-08-18T22:25:28.724142+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.724142+0000","last_undegraded":"2024-08-18T22:25:28.724142+0000","last_fullsized":"2024-08-18T22:25:28.724142+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.721265+0000","last_change":"2024-08-18T22:25:28.721265+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.721265+0000","last_undegraded":"2024-08-18T22:25:28.721265+0000","last_fullsized":"2024-08-18T22:25:28.721265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720510+0000","last_change":"2024-08-18T22:25:28.720510+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720510+0000","last_undegraded":"2024-08-18T22:25:28.720510+0000","last_fullsized":"2024-08-18T22:25:28.720510+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719867+0000","last_change":"2024-08-18T22:25:28.719867+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719867+0000","last_undegraded":"2024-08-18T22:25:28.719867+0000","last_fullsized":"2024-08-18T22:25:28.719867+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725108+0000","last_change":"2024-08-18T22:25:27.725108+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725108+0000","last_undegraded":"2024-08-18T22:25:27.725108+0000","last_fullsized":"2024-08-18T22:25:27.725108+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719417+0000","last_change":"2024-08-18T22:25:28.719417+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719417+0000","last_undegraded":"2024-08-18T22:25:28.719417+0000","last_fullsized":"2024-08-18T22:25:28.719417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721622+0000","last_change":"2024-08-18T22:25:28.732094+0000","last_active":"2024-08-18T22:25:29.721622+0000","last_peered":"2024-08-18T22:25:29.721622+0000","last_clean":"2024-08-18T22:25:29.721622+0000","last_became_active":"2024-08-18T22:25:28.731793+0000","last_became_peered":"2024-08-18T22:25:28.731793+0000","last_unstale":"2024-08-18T22:25:29.721622+0000","last_undegraded":"2024-08-18T22:25:29.721622+0000","last_fullsized":"2024-08-18T22:25:29.721622+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:14.636263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741550+0000","last_change":"2024-08-18T22:25:28.738637+0000","last_active":"2024-08-18T22:25:28.741550+0000","last_peered":"2024-08-18T22:25:28.741550+0000","last_clean":"2024-08-18T22:25:28.741550+0000","last_became_active":"2024-08-18T22:25:28.738343+0000","last_became_peered":"2024-08-18T22:25:28.738343+0000","last_unstale":"2024-08-18T22:25:28.741550+0000","last_undegraded":"2024-08-18T22:25:28.741550+0000","last_fullsized":"2024-08-18T22:25:28.741550+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:23.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.722602+0000","last_change":"2024-08-18T22:25:27.722602+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.722602+0000","last_undegraded":"2024-08-18T22:25:27.722602+0000","last_fullsized":"2024-08-18T22:25:27.722602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718940+0000","last_change":"2024-08-18T22:25:28.718940+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718940+0000","last_undegraded":"2024-08-18T22:25:28.718940+0000","last_fullsized":"2024-08-18T22:25:28.718940+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723134+0000","last_change":"2024-08-18T22:25:27.723134+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723134+0000","last_undegraded":"2024-08-18T22:25:27.723134+0000","last_fullsized":"2024-08-18T22:25:27.723134+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721661+0000","last_change":"2024-08-18T22:25:28.737468+0000","last_active":"2024-08-18T22:25:29.721661+0000","last_peered":"2024-08-18T22:25:29.721661+0000","last_clean":"2024-08-18T22:25:29.721661+0000","last_became_active":"2024-08-18T22:25:28.734632+0000","last_became_peered":"2024-08-18T22:25:28.734632+0000","last_unstale":"2024-08-18T22:25:29.721661+0000","last_undegraded":"2024-08-18T22:25:29.721661+0000","last_fullsized":"2024-08-18T22:25:29.721661+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:05.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721571+0000","last_change":"2024-08-18T22:25:28.735178+0000","last_active":"2024-08-18T22:25:29.721571+0000","last_peered":"2024-08-18T22:25:29.721571+0000","last_clean":"2024-08-18T22:25:29.721571+0000","last_became_active":"2024-08-18T22:25:28.734914+0000","last_became_peered":"2024-08-18T22:25:28.734914+0000","last_unstale":"2024-08-18T22:25:29.721571+0000","last_undegraded":"2024-08-18T22:25:29.721571+0000","last_fullsized":"2024-08-18T22:25:29.721571+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:03:03.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724715+0000","last_change":"2024-08-18T22:25:27.724715+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724715+0000","last_undegraded":"2024-08-18T22:25:27.724715+0000","last_fullsized":"2024-08-18T22:25:27.724715+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724171+0000","last_change":"2024-08-18T22:25:27.724171+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724171+0000","last_undegraded":"2024-08-18T22:25:27.724171+0000","last_fullsized":"2024-08-18T22:25:27.724171+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741567+0000","last_change":"2024-08-18T22:25:28.738595+0000","last_active":"2024-08-18T22:25:28.741567+0000","last_peered":"2024-08-18T22:25:28.741567+0000","last_clean":"2024-08-18T22:25:28.741567+0000","last_became_active":"2024-08-18T22:25:28.738274+0000","last_became_peered":"2024-08-18T22:25:28.738274+0000","last_unstale":"2024-08-18T22:25:28.741567+0000","last_undegraded":"2024-08-18T22:25:28.741567+0000","last_fullsized":"2024-08-18T22:25:28.741567+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:46.453256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721136+0000","last_change":"2024-08-18T22:25:28.732585+0000","last_active":"2024-08-18T22:25:29.721136+0000","last_peered":"2024-08-18T22:25:29.721136+0000","last_clean":"2024-08-18T22:25:29.721136+0000","last_became_active":"2024-08-18T22:25:28.731808+0000","last_became_peered":"2024-08-18T22:25:28.731808+0000","last_unstale":"2024-08-18T22:25:29.721136+0000","last_undegraded":"2024-08-18T22:25:29.721136+0000","last_fullsized":"2024-08-18T22:25:29.721136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:42:03.700694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721317+0000","last_change":"2024-08-18T22:25:27.721317+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721317+0000","last_undegraded":"2024-08-18T22:25:27.721317+0000","last_fullsized":"2024-08-18T22:25:27.721317+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.744420+0000","last_change":"2024-08-18T22:25:28.738517+0000","last_active":"2024-08-18T22:25:28.744420+0000","last_peered":"2024-08-18T22:25:28.744420+0000","last_clean":"2024-08-18T22:25:28.744420+0000","last_became_active":"2024-08-18T22:25:28.738224+0000","last_became_peered":"2024-08-18T22:25:28.738224+0000","last_unstale":"2024-08-18T22:25:28.744420+0000","last_undegraded":"2024-08-18T22:25:28.744420+0000","last_fullsized":"2024-08-18T22:25:28.744420+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:12:30.173542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719070+0000","last_change":"2024-08-18T22:25:28.719070+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719070+0000","last_undegraded":"2024-08-18T22:25:28.719070+0000","last_fullsized":"2024-08-18T22:25:28.719070+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739789+0000","last_change":"2024-08-18T22:25:27.738154+0000","last_active":"2024-08-18T22:25:27.739789+0000","last_peered":"2024-08-18T22:25:27.739789+0000","last_clean":"2024-08-18T22:25:27.739789+0000","last_became_active":"2024-08-18T22:25:27.737885+0000","last_became_peered":"2024-08-18T22:25:27.737885+0000","last_unstale":"2024-08-18T22:25:27.739789+0000","last_undegraded":"2024-08-18T22:25:27.739789+0000","last_fullsized":"2024-08-18T22:25:27.739789+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:05.409913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.740290+0000","last_change":"2024-08-18T22:25:28.736655+0000","last_active":"2024-08-18T22:25:28.740290+0000","last_peered":"2024-08-18T22:25:28.740290+0000","last_clean":"2024-08-18T22:25:28.740290+0000","last_became_active":"2024-08-18T22:25:28.736388+0000","last_became_peered":"2024-08-18T22:25:28.736388+0000","last_unstale":"2024-08-18T22:25:28.740290+0000","last_undegraded":"2024-08-18T22:25:28.740290+0000","last_fullsized":"2024-08-18T22:25:28.740290+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:07:46.806767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"113'1","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.762168+0000","last_change":"2024-08-18T22:25:27.744782+0000","last_active":"2024-08-18T22:25:28.762168+0000","last_peered":"2024-08-18T22:25:28.762168+0000","last_clean":"2024-08-18T22:25:28.762168+0000","last_became_active":"2024-08-18T22:25:27.744174+0000","last_became_peered":"2024-08-18T22:25:27.744174+0000","last_unstale":"2024-08-18T22:25:28.762168+0000","last_undegraded":"2024-08-18T22:25:28.762168+0000","last_fullsized":"2024-08-18T22:25:28.762168+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:59.111032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721203+0000","last_change":"2024-08-18T22:25:28.729447+0000","last_active":"2024-08-18T22:25:29.721203+0000","last_peered":"2024-08-18T22:25:29.721203+0000","last_clean":"2024-08-18T22:25:29.721203+0000","last_became_active":"2024-08-18T22:25:28.727894+0000","last_became_peered":"2024-08-18T22:25:28.727894+0000","last_unstale":"2024-08-18T22:25:29.721203+0000","last_undegraded":"2024-08-18T22:25:29.721203+0000","last_fullsized":"2024-08-18T22:25:29.721203+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:49:11.616903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721307+0000","last_change":"2024-08-18T22:25:27.733672+0000","last_active":"2024-08-18T22:25:29.721307+0000","last_peered":"2024-08-18T22:25:29.721307+0000","last_clean":"2024-08-18T22:25:29.721307+0000","last_became_active":"2024-08-18T22:25:27.733366+0000","last_became_peered":"2024-08-18T22:25:27.733366+0000","last_unstale":"2024-08-18T22:25:29.721307+0000","last_undegraded":"2024-08-18T22:25:29.721307+0000","last_fullsized":"2024-08-18T22:25:29.721307+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:13.034285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726086+0000","last_change":"2024-08-18T22:25:27.726086+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726086+0000","last_undegraded":"2024-08-18T22:25:27.726086+0000","last_fullsized":"2024-08-18T22:25:27.726086+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739683+0000","last_change":"2024-08-18T22:25:27.737506+0000","last_active":"2024-08-18T22:25:27.739683+0000","last_peered":"2024-08-18T22:25:27.739683+0000","last_clean":"2024-08-18T22:25:27.739683+0000","last_became_active":"2024-08-18T22:25:27.737232+0000","last_became_peered":"2024-08-18T22:25:27.737232+0000","last_unstale":"2024-08-18T22:25:27.739683+0000","last_undegraded":"2024-08-18T22:25:27.739683+0000","last_fullsized":"2024-08-18T22:25:27.739683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:21.441375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724880+0000","last_change":"2024-08-18T22:25:27.724880+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724880+0000","last_undegraded":"2024-08-18T22:25:27.724880+0000","last_fullsized":"2024-08-18T22:25:27.724880+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724102+0000","last_change":"2024-08-18T22:25:27.734402+0000","last_active":"2024-08-18T22:25:28.724102+0000","last_peered":"2024-08-18T22:25:28.724102+0000","last_clean":"2024-08-18T22:25:28.724102+0000","last_became_active":"2024-08-18T22:25:27.733634+0000","last_became_peered":"2024-08-18T22:25:27.733634+0000","last_unstale":"2024-08-18T22:25:28.724102+0000","last_undegraded":"2024-08-18T22:25:28.724102+0000","last_fullsized":"2024-08-18T22:25:28.724102+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:18.699215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720476+0000","last_change":"2024-08-18T22:25:28.720476+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720476+0000","last_undegraded":"2024-08-18T22:25:28.720476+0000","last_fullsized":"2024-08-18T22:25:28.720476+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.735298+0000","last_change":"2024-08-18T22:25:27.731859+0000","last_active":"2024-08-18T22:25:27.735298+0000","last_peered":"2024-08-18T22:25:27.735298+0000","last_clean":"2024-08-18T22:25:27.735298+0000","last_became_active":"2024-08-18T22:25:27.731366+0000","last_became_peered":"2024-08-18T22:25:27.731366+0000","last_unstale":"2024-08-18T22:25:27.735298+0000","last_undegraded":"2024-08-18T22:25:27.735298+0000","last_fullsized":"2024-08-18T22:25:27.735298+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:00.986288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721343+0000","last_change":"2024-08-18T22:25:27.721343+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721343+0000","last_undegraded":"2024-08-18T22:25:27.721343+0000","last_fullsized":"2024-08-18T22:25:27.721343+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720400+0000","last_change":"2024-08-18T22:25:27.738161+0000","last_active":"2024-08-18T22:25:29.720400+0000","last_peered":"2024-08-18T22:25:29.720400+0000","last_clean":"2024-08-18T22:25:29.720400+0000","last_became_active":"2024-08-18T22:25:27.737855+0000","last_became_peered":"2024-08-18T22:25:27.737855+0000","last_unstale":"2024-08-18T22:25:29.720400+0000","last_undegraded":"2024-08-18T22:25:29.720400+0000","last_fullsized":"2024-08-18T22:25:29.720400+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:42:10.877593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726107+0000","last_change":"2024-08-18T22:25:27.726107+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726107+0000","last_undegraded":"2024-08-18T22:25:27.726107+0000","last_fullsized":"2024-08-18T22:25:27.726107+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739758+0000","last_change":"2024-08-18T22:25:27.736484+0000","last_active":"2024-08-18T22:25:27.739758+0000","last_peered":"2024-08-18T22:25:27.739758+0000","last_clean":"2024-08-18T22:25:27.739758+0000","last_became_active":"2024-08-18T22:25:27.736159+0000","last_became_peered":"2024-08-18T22:25:27.736159+0000","last_unstale":"2024-08-18T22:25:27.739758+0000","last_undegraded":"2024-08-18T22:25:27.739758+0000","last_fullsized":"2024-08-18T22:25:27.739758+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:47.068872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718749+0000","last_change":"2024-08-18T22:25:28.718749+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718749+0000","last_undegraded":"2024-08-18T22:25:28.718749+0000","last_fullsized":"2024-08-18T22:25:28.718749+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721458+0000","last_change":"2024-08-18T22:25:27.736398+0000","last_active":"2024-08-18T22:25:29.721458+0000","last_peered":"2024-08-18T22:25:29.721458+0000","last_clean":"2024-08-18T22:25:29.721458+0000","last_became_active":"2024-08-18T22:25:27.735991+0000","last_became_peered":"2024-08-18T22:25:27.735991+0000","last_unstale":"2024-08-18T22:25:29.721458+0000","last_undegraded":"2024-08-18T22:25:29.721458+0000","last_fullsized":"2024-08-18T22:25:29.721458+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.681647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723136+0000","last_change":"2024-08-18T22:25:27.723136+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723136+0000","last_undegraded":"2024-08-18T22:25:27.723136+0000","last_fullsized":"2024-08-18T22:25:27.723136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.719184+0000","last_change":"2024-08-18T22:25:27.740411+0000","last_active":"2024-08-18T22:25:28.719184+0000","last_peered":"2024-08-18T22:25:28.719184+0000","last_clean":"2024-08-18T22:25:28.719184+0000","last_became_active":"2024-08-18T22:25:27.740044+0000","last_became_peered":"2024-08-18T22:25:27.740044+0000","last_unstale":"2024-08-18T22:25:28.719184+0000","last_undegraded":"2024-08-18T22:25:28.719184+0000","last_fullsized":"2024-08-18T22:25:28.719184+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:26:05.404663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.743068+0000","last_change":"2024-08-18T22:25:28.740188+0000","last_active":"2024-08-18T22:25:28.743068+0000","last_peered":"2024-08-18T22:25:28.743068+0000","last_clean":"2024-08-18T22:25:28.743068+0000","last_became_active":"2024-08-18T22:25:28.739904+0000","last_became_peered":"2024-08-18T22:25:28.739904+0000","last_unstale":"2024-08-18T22:25:28.743068+0000","last_undegraded":"2024-08-18T22:25:28.743068+0000","last_fullsized":"2024-08-18T22:25:28.743068+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:14:29.817257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724154+0000","last_change":"2024-08-18T22:25:27.737622+0000","last_active":"2024-08-18T22:25:28.724154+0000","last_peered":"2024-08-18T22:25:28.724154+0000","last_clean":"2024-08-18T22:25:28.724154+0000","last_became_active":"2024-08-18T22:25:27.737354+0000","last_became_peered":"2024-08-18T22:25:27.737354+0000","last_unstale":"2024-08-18T22:25:28.724154+0000","last_undegraded":"2024-08-18T22:25:28.724154+0000","last_fullsized":"2024-08-18T22:25:28.724154+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:35.786573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723893+0000","last_change":"2024-08-18T22:25:27.723893+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723893+0000","last_undegraded":"2024-08-18T22:25:27.723893+0000","last_fullsized":"2024-08-18T22:25:27.723893+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.741090+0000","last_change":"2024-08-18T22:25:27.738707+0000","last_active":"2024-08-18T22:25:27.741090+0000","last_peered":"2024-08-18T22:25:27.741090+0000","last_clean":"2024-08-18T22:25:27.741090+0000","last_became_active":"2024-08-18T22:25:27.738399+0000","last_became_peered":"2024-08-18T22:25:27.738399+0000","last_unstale":"2024-08-18T22:25:27.741090+0000","last_undegraded":"2024-08-18T22:25:27.741090+0000","last_fullsized":"2024-08-18T22:25:27.741090+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:59.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723792+0000","last_change":"2024-08-18T22:25:27.723792+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723792+0000","last_undegraded":"2024-08-18T22:25:27.723792+0000","last_fullsized":"2024-08-18T22:25:27.723792+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.744713+0000","last_change":"2024-08-18T22:25:27.743973+0000","last_active":"2024-08-18T22:25:27.744713+0000","last_peered":"2024-08-18T22:25:27.744713+0000","last_clean":"2024-08-18T22:25:27.744713+0000","last_became_active":"2024-08-18T22:25:27.743650+0000","last_became_peered":"2024-08-18T22:25:27.743650+0000","last_unstale":"2024-08-18T22:25:27.744713+0000","last_undegraded":"2024-08-18T22:25:27.744713+0000","last_fullsized":"2024-08-18T22:25:27.744713+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:57.080994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721308+0000","last_change":"2024-08-18T22:25:27.721308+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721308+0000","last_undegraded":"2024-08-18T22:25:27.721308+0000","last_fullsized":"2024-08-18T22:25:27.721308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739723+0000","last_change":"2024-08-18T22:25:27.736833+0000","last_active":"2024-08-18T22:25:27.739723+0000","last_peered":"2024-08-18T22:25:27.739723+0000","last_clean":"2024-08-18T22:25:27.739723+0000","last_became_active":"2024-08-18T22:25:27.736456+0000","last_became_peered":"2024-08-18T22:25:27.736456+0000","last_unstale":"2024-08-18T22:25:27.739723+0000","last_undegraded":"2024-08-18T22:25:27.739723+0000","last_fullsized":"2024-08-18T22:25:27.739723+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:03.142020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.743792+0000","last_change":"2024-08-18T22:25:28.739981+0000","last_active":"2024-08-18T22:25:28.743792+0000","last_peered":"2024-08-18T22:25:28.743792+0000","last_clean":"2024-08-18T22:25:28.743792+0000","last_became_active":"2024-08-18T22:25:28.738317+0000","last_became_peered":"2024-08-18T22:25:28.738317+0000","last_unstale":"2024-08-18T22:25:28.743792+0000","last_undegraded":"2024-08-18T22:25:28.743792+0000","last_fullsized":"2024-08-18T22:25:28.743792+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:34.358754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.729238+0000","last_change":"2024-08-18T22:25:27.743028+0000","last_active":"2024-08-18T22:25:28.729238+0000","last_peered":"2024-08-18T22:25:28.729238+0000","last_clean":"2024-08-18T22:25:28.729238+0000","last_became_active":"2024-08-18T22:25:27.742106+0000","last_became_peered":"2024-08-18T22:25:27.742106+0000","last_unstale":"2024-08-18T22:25:28.729238+0000","last_undegraded":"2024-08-18T22:25:28.729238+0000","last_fullsized":"2024-08-18T22:25:28.729238+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:56.157132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720145+0000","last_change":"2024-08-18T22:25:28.720145+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720145+0000","last_undegraded":"2024-08-18T22:25:28.720145+0000","last_fullsized":"2024-08-18T22:25:28.720145+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720737+0000","last_change":"2024-08-18T22:25:27.738551+0000","last_active":"2024-08-18T22:25:29.720737+0000","last_peered":"2024-08-18T22:25:29.720737+0000","last_clean":"2024-08-18T22:25:29.720737+0000","last_became_active":"2024-08-18T22:25:27.737360+0000","last_became_peered":"2024-08-18T22:25:27.737360+0000","last_unstale":"2024-08-18T22:25:29.720737+0000","last_undegraded":"2024-08-18T22:25:29.720737+0000","last_fullsized":"2024-08-18T22:25:29.720737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:54:38.492348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.744395+0000","last_change":"2024-08-18T22:25:28.737712+0000","last_active":"2024-08-18T22:25:28.744395+0000","last_peered":"2024-08-18T22:25:28.744395+0000","last_clean":"2024-08-18T22:25:28.744395+0000","last_became_active":"2024-08-18T22:25:28.737443+0000","last_became_peered":"2024-08-18T22:25:28.737443+0000","last_unstale":"2024-08-18T22:25:28.744395+0000","last_undegraded":"2024-08-18T22:25:28.744395+0000","last_fullsized":"2024-08-18T22:25:28.744395+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:17.054695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.734543+0000","last_change":"2024-08-18T22:25:27.728904+0000","last_active":"2024-08-18T22:25:27.734543+0000","last_peered":"2024-08-18T22:25:27.734543+0000","last_clean":"2024-08-18T22:25:27.734543+0000","last_became_active":"2024-08-18T22:25:27.728636+0000","last_became_peered":"2024-08-18T22:25:27.728636+0000","last_unstale":"2024-08-18T22:25:27.734543+0000","last_undegraded":"2024-08-18T22:25:27.734543+0000","last_fullsized":"2024-08-18T22:25:27.734543+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:57.080994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721301+0000","last_change":"2024-08-18T22:25:27.721301+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721301+0000","last_undegraded":"2024-08-18T22:25:27.721301+0000","last_fullsized":"2024-08-18T22:25:27.721301+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724314+0000","last_change":"2024-08-18T22:25:27.729731+0000","last_active":"2024-08-18T22:25:28.724314+0000","last_peered":"2024-08-18T22:25:28.724314+0000","last_clean":"2024-08-18T22:25:28.724314+0000","last_became_active":"2024-08-18T22:25:27.729336+0000","last_became_peered":"2024-08-18T22:25:27.729336+0000","last_unstale":"2024-08-18T22:25:28.724314+0000","last_undegraded":"2024-08-18T22:25:28.724314+0000","last_fullsized":"2024-08-18T22:25:28.724314+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:53.446928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.727065+0000","last_change":"2024-08-18T22:25:27.727065+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.727065+0000","last_undegraded":"2024-08-18T22:25:27.727065+0000","last_fullsized":"2024-08-18T22:25:27.727065+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.738837+0000","last_change":"2024-08-18T22:25:27.735677+0000","last_active":"2024-08-18T22:25:27.738837+0000","last_peered":"2024-08-18T22:25:27.738837+0000","last_clean":"2024-08-18T22:25:27.738837+0000","last_became_active":"2024-08-18T22:25:27.735124+0000","last_became_peered":"2024-08-18T22:25:27.735124+0000","last_unstale":"2024-08-18T22:25:27.738837+0000","last_undegraded":"2024-08-18T22:25:27.738837+0000","last_fullsized":"2024-08-18T22:25:27.738837+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:31.547107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718796+0000","last_change":"2024-08-18T22:25:28.718796+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718796+0000","last_undegraded":"2024-08-18T22:25:28.718796+0000","last_fullsized":"2024-08-18T22:25:28.718796+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"113'2","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.758597+0000","last_change":"2024-08-18T22:25:27.740165+0000","last_active":"2024-08-18T22:25:28.758597+0000","last_peered":"2024-08-18T22:25:28.758597+0000","last_clean":"2024-08-18T22:25:28.758597+0000","last_became_active":"2024-08-18T22:25:27.736854+0000","last_became_peered":"2024-08-18T22:25:27.736854+0000","last_unstale":"2024-08-18T22:25:28.758597+0000","last_undegraded":"2024-08-18T22:25:28.758597+0000","last_fullsized":"2024-08-18T22:25:28.758597+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:42:12.311494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719780+0000","last_change":"2024-08-18T22:25:28.719780+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719780+0000","last_undegraded":"2024-08-18T22:25:28.719780+0000","last_fullsized":"2024-08-18T22:25:28.719780+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.730023+0000","last_change":"2024-08-18T22:25:27.743195+0000","last_active":"2024-08-18T22:25:28.730023+0000","last_peered":"2024-08-18T22:25:28.730023+0000","last_clean":"2024-08-18T22:25:28.730023+0000","last_became_active":"2024-08-18T22:25:27.742876+0000","last_became_peered":"2024-08-18T22:25:27.742876+0000","last_unstale":"2024-08-18T22:25:28.730023+0000","last_undegraded":"2024-08-18T22:25:28.730023+0000","last_fullsized":"2024-08-18T22:25:28.730023+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:34.262887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724420+0000","last_change":"2024-08-18T22:25:27.724420+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724420+0000","last_undegraded":"2024-08-18T22:25:27.724420+0000","last_fullsized":"2024-08-18T22:25:27.724420+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.737580+0000","last_change":"2024-08-18T22:25:27.729602+0000","last_active":"2024-08-18T22:25:27.737580+0000","last_peered":"2024-08-18T22:25:27.737580+0000","last_clean":"2024-08-18T22:25:27.737580+0000","last_became_active":"2024-08-18T22:25:27.729342+0000","last_became_peered":"2024-08-18T22:25:27.729342+0000","last_unstale":"2024-08-18T22:25:27.737580+0000","last_undegraded":"2024-08-18T22:25:27.737580+0000","last_fullsized":"2024-08-18T22:25:27.737580+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:38.345310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.739416+0000","last_change":"2024-08-18T22:25:28.735821+0000","last_active":"2024-08-18T22:25:28.739416+0000","last_peered":"2024-08-18T22:25:28.739416+0000","last_clean":"2024-08-18T22:25:28.739416+0000","last_became_active":"2024-08-18T22:25:28.735547+0000","last_became_peered":"2024-08-18T22:25:28.735547+0000","last_unstale":"2024-08-18T22:25:28.739416+0000","last_undegraded":"2024-08-18T22:25:28.739416+0000","last_fullsized":"2024-08-18T22:25:28.739416+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:11.104170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.731246+0000","last_change":"2024-08-18T22:25:27.739921+0000","last_active":"2024-08-18T22:25:28.731246+0000","last_peered":"2024-08-18T22:25:28.731246+0000","last_clean":"2024-08-18T22:25:28.731246+0000","last_became_active":"2024-08-18T22:25:27.739634+0000","last_became_peered":"2024-08-18T22:25:27.739634+0000","last_unstale":"2024-08-18T22:25:28.731246+0000","last_undegraded":"2024-08-18T22:25:28.731246+0000","last_fullsized":"2024-08-18T22:25:28.731246+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:48.519152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718694+0000","last_change":"2024-08-18T22:25:28.718694+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718694+0000","last_undegraded":"2024-08-18T22:25:28.718694+0000","last_fullsized":"2024-08-18T22:25:28.718694+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.745206+0000","last_change":"2024-08-18T22:25:27.744272+0000","last_active":"2024-08-18T22:25:27.745206+0000","last_peered":"2024-08-18T22:25:27.745206+0000","last_clean":"2024-08-18T22:25:27.745206+0000","last_became_active":"2024-08-18T22:25:27.744026+0000","last_became_peered":"2024-08-18T22:25:27.744026+0000","last_unstale":"2024-08-18T22:25:27.745206+0000","last_undegraded":"2024-08-18T22:25:27.745206+0000","last_fullsized":"2024-08-18T22:25:27.745206+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:38.345310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720287+0000","last_change":"2024-08-18T22:25:28.728579+0000","last_active":"2024-08-18T22:25:29.720287+0000","last_peered":"2024-08-18T22:25:29.720287+0000","last_clean":"2024-08-18T22:25:29.720287+0000","last_became_active":"2024-08-18T22:25:28.728302+0000","last_became_peered":"2024-08-18T22:25:28.728302+0000","last_unstale":"2024-08-18T22:25:29.720287+0000","last_undegraded":"2024-08-18T22:25:29.720287+0000","last_fullsized":"2024-08-18T22:25:29.720287+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:15.603682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.719343+0000","last_change":"2024-08-18T22:25:27.738515+0000","last_active":"2024-08-18T22:25:28.719343+0000","last_peered":"2024-08-18T22:25:28.719343+0000","last_clean":"2024-08-18T22:25:28.719343+0000","last_became_active":"2024-08-18T22:25:27.738233+0000","last_became_peered":"2024-08-18T22:25:27.738233+0000","last_unstale":"2024-08-18T22:25:28.719343+0000","last_undegraded":"2024-08-18T22:25:28.719343+0000","last_fullsized":"2024-08-18T22:25:28.719343+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:06.452774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723453+0000","last_change":"2024-08-18T22:25:27.723453+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723453+0000","last_undegraded":"2024-08-18T22:25:27.723453+0000","last_fullsized":"2024-08-18T22:25:27.723453+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.740920+0000","last_change":"2024-08-18T22:25:27.736974+0000","last_active":"2024-08-18T22:25:27.740920+0000","last_peered":"2024-08-18T22:25:27.740920+0000","last_clean":"2024-08-18T22:25:27.740920+0000","last_became_active":"2024-08-18T22:25:27.736651+0000","last_became_peered":"2024-08-18T22:25:27.736651+0000","last_unstale":"2024-08-18T22:25:27.740920+0000","last_undegraded":"2024-08-18T22:25:27.740920+0000","last_fullsized":"2024-08-18T22:25:27.740920+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:55:00.779397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726523+0000","last_change":"2024-08-18T22:25:27.726523+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726523+0000","last_undegraded":"2024-08-18T22:25:27.726523+0000","last_fullsized":"2024-08-18T22:25:27.726523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.742177+0000","last_change":"2024-08-18T22:25:27.741264+0000","last_active":"2024-08-18T22:25:27.742177+0000","last_peered":"2024-08-18T22:25:27.742177+0000","last_clean":"2024-08-18T22:25:27.742177+0000","last_became_active":"2024-08-18T22:25:27.740478+0000","last_became_peered":"2024-08-18T22:25:27.740478+0000","last_unstale":"2024-08-18T22:25:27.742177+0000","last_undegraded":"2024-08-18T22:25:27.742177+0000","last_fullsized":"2024-08-18T22:25:27.742177+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:42.261529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741656+0000","last_change":"2024-08-18T22:25:28.739269+0000","last_active":"2024-08-18T22:25:28.741656+0000","last_peered":"2024-08-18T22:25:28.741656+0000","last_clean":"2024-08-18T22:25:28.741656+0000","last_became_active":"2024-08-18T22:25:28.738998+0000","last_became_peered":"2024-08-18T22:25:28.738998+0000","last_unstale":"2024-08-18T22:25:28.741656+0000","last_undegraded":"2024-08-18T22:25:28.741656+0000","last_fullsized":"2024-08-18T22:25:28.741656+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:34.516916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721212+0000","last_change":"2024-08-18T22:25:27.729754+0000","last_active":"2024-08-18T22:25:29.721212+0000","last_peered":"2024-08-18T22:25:29.721212+0000","last_clean":"2024-08-18T22:25:29.721212+0000","last_became_active":"2024-08-18T22:25:27.729444+0000","last_became_peered":"2024-08-18T22:25:27.729444+0000","last_unstale":"2024-08-18T22:25:29.721212+0000","last_undegraded":"2024-08-18T22:25:29.721212+0000","last_fullsized":"2024-08-18T22:25:29.721212+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:44.526490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.736249+0000","last_change":"2024-08-18T22:25:28.735227+0000","last_active":"2024-08-18T22:25:28.736249+0000","last_peered":"2024-08-18T22:25:28.736249+0000","last_clean":"2024-08-18T22:25:28.736249+0000","last_became_active":"2024-08-18T22:25:28.734944+0000","last_became_peered":"2024-08-18T22:25:28.734944+0000","last_unstale":"2024-08-18T22:25:28.736249+0000","last_undegraded":"2024-08-18T22:25:28.736249+0000","last_fullsized":"2024-08-18T22:25:28.736249+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:23.812669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.730204+0000","last_change":"2024-08-18T22:25:27.742531+0000","last_active":"2024-08-18T22:25:28.730204+0000","last_peered":"2024-08-18T22:25:28.730204+0000","last_clean":"2024-08-18T22:25:28.730204+0000","last_became_active":"2024-08-18T22:25:27.741977+0000","last_became_peered":"2024-08-18T22:25:27.741977+0000","last_unstale":"2024-08-18T22:25:28.730204+0000","last_undegraded":"2024-08-18T22:25:28.730204+0000","last_fullsized":"2024-08-18T22:25:28.730204+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:19:55.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.724635+0000","last_change":"2024-08-18T22:25:28.724635+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.724635+0000","last_undegraded":"2024-08-18T22:25:28.724635+0000","last_fullsized":"2024-08-18T22:25:28.724635+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.740032+0000","last_change":"2024-08-18T22:25:27.733640+0000","last_active":"2024-08-18T22:25:27.740032+0000","last_peered":"2024-08-18T22:25:27.740032+0000","last_clean":"2024-08-18T22:25:27.740032+0000","last_became_active":"2024-08-18T22:25:27.733277+0000","last_became_peered":"2024-08-18T22:25:27.733277+0000","last_unstale":"2024-08-18T22:25:27.740032+0000","last_undegraded":"2024-08-18T22:25:27.740032+0000","last_fullsized":"2024-08-18T22:25:27.740032+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:47:32.598265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725469+0000","last_change":"2024-08-18T22:25:27.725469+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725469+0000","last_undegraded":"2024-08-18T22:25:27.725469+0000","last_fullsized":"2024-08-18T22:25:27.725469+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.731395+0000","last_change":"2024-08-18T22:25:27.743464+0000","last_active":"2024-08-18T22:25:28.731395+0000","last_peered":"2024-08-18T22:25:28.731395+0000","last_clean":"2024-08-18T22:25:28.731395+0000","last_became_active":"2024-08-18T22:25:27.742955+0000","last_became_peered":"2024-08-18T22:25:27.742955+0000","last_unstale":"2024-08-18T22:25:28.731395+0000","last_undegraded":"2024-08-18T22:25:28.731395+0000","last_fullsized":"2024-08-18T22:25:28.731395+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:27:25.115281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725858+0000","last_change":"2024-08-18T22:25:27.725858+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725858+0000","last_undegraded":"2024-08-18T22:25:27.725858+0000","last_fullsized":"2024-08-18T22:25:27.725858+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"113'2","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.758528+0000","last_change":"2024-08-18T22:25:27.744925+0000","last_active":"2024-08-18T22:25:28.758528+0000","last_peered":"2024-08-18T22:25:28.758528+0000","last_clean":"2024-08-18T22:25:28.758528+0000","last_became_active":"2024-08-18T22:25:27.744534+0000","last_became_peered":"2024-08-18T22:25:27.744534+0000","last_unstale":"2024-08-18T22:25:28.758528+0000","last_undegraded":"2024-08-18T22:25:28.758528+0000","last_fullsized":"2024-08-18T22:25:28.758528+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:41.300048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":357,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.720940+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:25:28.720940+0000","last_peered":"2024-08-18T22:25:28.720940+0000","last_clean":"2024-08-18T22:25:28.720940+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:25:28.720940+0000","last_undegraded":"2024-08-18T22:25:28.720940+0000","last_fullsized":"2024-08-18T22:25:28.720940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37268,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334572,"statfs":{"total":96636764160,"available":96598601728,"internally_reserved":0,"allocated":1974272,"data_stored":1236047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36688,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335152,"statfs":{"total":96636764160,"available":96599195648,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509519,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36696,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335144,"statfs":{"total":96636764160,"available":96599187456,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40848,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330992,"statfs":{"total":96636764160,"available":96594935808,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509520,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":1974272,"data_stored":1236047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":1413120,"data_stored":659630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40864,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330976,"statfs":{"total":96636764160,"available":96594919424,"internally_reserved":0,"allocated":1396736,"data_stored":652880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:25:33.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:25:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.461+0000 7f473e400640 1 Processor -- start 2024-08-18T22:25:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.461+0000 7f473e400640 1 -- start start 2024-08-18T22:25:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f473e400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4738161960 0x7f473806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f473e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4738070730 0x7f4738070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f473e400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f473815dda0 0x7f473815e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f473e400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f473815fcc0 con 0x7f4738161960 2024-08-18T22:25:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f473e400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f47380710b0 con 0x7f473815dda0 2024-08-18T22:25:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f473e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f473815eb60 con 0x7f4738070730 2024-08-18T22:25:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f4737400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4738161960 0x7f473806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f4737400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4738161960 0x7f473806fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38198/0 (socket says 172.21.15.5:38198) 2024-08-18T22:25:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f4737400640 1 -- 172.21.15.5:0/1938062681 learned_addr learned my addr 172.21.15.5:0/1938062681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f4736a00640 1 --2- 172.21.15.5:0/1938062681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4738070730 0x7f4738070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f4737e00640 1 --2- 172.21.15.5:0/1938062681 >> v2:172.21.15.117:3300/0 conn(0x7f473815dda0 0x7f473815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f4737400640 1 -- 172.21.15.5:0/1938062681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4738070730 msgr2=0x7f4738070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f4737400640 1 --2- 172.21.15.5:0/1938062681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4738070730 0x7f4738070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f4737400640 1 -- 172.21.15.5:0/1938062681 >> v2:172.21.15.117:3300/0 conn(0x7f473815dda0 msgr2=0x7f473815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f4737400640 1 --2- 172.21.15.5:0/1938062681 >> v2:172.21.15.117:3300/0 conn(0x7f473815dda0 0x7f473815e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.465+0000 7f4737400640 1 -- 172.21.15.5:0/1938062681 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473815ee40 con 0x7f4738161960 2024-08-18T22:25:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f4737400640 1 --2- 172.21.15.5:0/1938062681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738161960 0x7f473806fd20 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f473806c960 tx=0x7f472801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0f3799c5dd426 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f4736000640 1 -- 172.21.15.5:0/1938062681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47280b1070 con 0x7f4738161960 2024-08-18T22:25:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f4736000640 1 -- 172.21.15.5:0/1938062681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47280ac630 con 0x7f4738161960 2024-08-18T22:25:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f4736000640 1 -- 172.21.15.5:0/1938062681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47280a8050 con 0x7f4738161960 2024-08-18T22:25:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 -- 172.21.15.5:0/1938062681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738161960 msgr2=0x7f473806fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 --2- 172.21.15.5:0/1938062681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738161960 0x7f473806fd20 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f473806c960 tx=0x7f472801c520 comp rx=0 tx=0).stop 2024-08-18T22:25:33.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 -- 172.21.15.5:0/1938062681 shutdown_connections 2024-08-18T22:25:33.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 --2- 172.21.15.5:0/1938062681 >> v2:172.21.15.117:3300/0 conn(0x7f473815dda0 0x7f473815e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 --2- 172.21.15.5:0/1938062681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4738070730 0x7f4738070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 --2- 172.21.15.5:0/1938062681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738161960 0x7f473806fd20 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 -- 172.21.15.5:0/1938062681 >> 172.21.15.5:0/1938062681 conn(0x7f47380d2130 msgr2=0x7f47380d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:33.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 -- 172.21.15.5:0/1938062681 shutdown_connections 2024-08-18T22:25:33.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 -- 172.21.15.5:0/1938062681 wait complete. 2024-08-18T22:25:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 Processor -- start 2024-08-18T22:25:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 -- start start 2024-08-18T22:25:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4738070730 0x7f47380cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.469+0000 7f473e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f473815dda0 0x7f47380cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f473e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4738161960 0x7f473814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f473e400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f473809ba30 con 0x7f473815dda0 2024-08-18T22:25:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f473e400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f473815e790 con 0x7f4738070730 2024-08-18T22:25:33.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f473e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f473814aaf0 con 0x7f4738161960 2024-08-18T22:25:33.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f4736a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f473815dda0 0x7f47380cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f4736a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f473815dda0 0x7f47380cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38210/0 (socket says 172.21.15.5:38210) 2024-08-18T22:25:33.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f4736a00640 1 -- 172.21.15.5:0/1910595735 learned_addr learned my addr 172.21.15.5:0/1910595735 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:33.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f4737400640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4738070730 0x7f47380cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f4737e00640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4738161960 0x7f473814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f4736a00640 1 -- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4738161960 msgr2=0x7f473814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f4736a00640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4738161960 0x7f473814a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f4736a00640 1 -- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4738070730 msgr2=0x7f47380cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f4736a00640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4738070730 0x7f47380cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f4736a00640 1 -- 172.21.15.5:0/1910595735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473815d330 con 0x7f473815dda0 2024-08-18T22:25:33.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f4736a00640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f473815dda0 0x7f47380cc4a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f472400d5f0 tx=0x7f472400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:33.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f472f400640 1 -- 172.21.15.5:0/1910595735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724004240 con 0x7f473815dda0 2024-08-18T22:25:33.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f472f400640 1 -- 172.21.15.5:0/1910595735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47240043e0 con 0x7f473815dda0 2024-08-18T22:25:33.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f472f400640 1 -- 172.21.15.5:0/1910595735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724003620 con 0x7f473815dda0 2024-08-18T22:25:33.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f473e400640 1 -- 172.21.15.5:0/1910595735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47380cccb0 con 0x7f473815dda0 2024-08-18T22:25:33.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f473e400640 1 -- 172.21.15.5:0/1910595735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47380cd270 con 0x7f473815dda0 2024-08-18T22:25:33.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f473e400640 1 -- 172.21.15.5:0/1910595735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4738070b70 con 0x7f473815dda0 2024-08-18T22:25:33.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.473+0000 7f472f400640 1 -- 172.21.15.5:0/1910595735 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f472401b020 con 0x7f473815dda0 2024-08-18T22:25:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.477+0000 7f472f400640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47180678f0 0x7f4718069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.477+0000 7f472f400640 1 -- 172.21.15.5:0/1910595735 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f4724085a90 con 0x7f473815dda0 2024-08-18T22:25:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.477+0000 7f4737400640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47180678f0 0x7f4718069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.477+0000 7f4737400640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47180678f0 0x7f4718069db0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f47280ae000 tx=0x7f4728008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:33.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.481+0000 7f472f400640 1 -- 172.21.15.5:0/1910595735 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4724056430 con 0x7f473815dda0 2024-08-18T22:25:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.641+0000 7f473e400640 1 -- 172.21.15.5:0/1910595735 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f473809bbb0 con 0x7f47180678f0 2024-08-18T22:25:33.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.649+0000 7f472f400640 1 -- 172.21.15.5:0/1910595735 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248767 (secure 0 0 0) 0x7f473809bbb0 con 0x7f47180678f0 2024-08-18T22:25:33.651 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:25:33.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 -- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47180678f0 msgr2=0x7f4718069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47180678f0 0x7f4718069db0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f47280ae000 tx=0x7f4728008040 comp rx=0 tx=0).stop 2024-08-18T22:25:33.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 -- 172.21.15.5:0/1910595735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f473815dda0 msgr2=0x7f47380cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f473815dda0 0x7f47380cc4a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f472400d5f0 tx=0x7f472400dab0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 -- 172.21.15.5:0/1910595735 shutdown_connections 2024-08-18T22:25:33.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47180678f0 0x7f4718069db0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4738161960 0x7f473814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f473815dda0 0x7f47380cc4a0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 --2- 172.21.15.5:0/1910595735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4738070730 0x7f47380cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 -- 172.21.15.5:0/1910595735 >> 172.21.15.5:0/1910595735 conn(0x7f47380d2130 msgr2=0x7f47380b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:33.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 -- 172.21.15.5:0/1910595735 shutdown_connections 2024-08-18T22:25:33.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.653+0000 7f473e400640 1 -- 172.21.15.5:0/1910595735 wait complete. 2024-08-18T22:25:33.672 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-08-18T22:25:31.714297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315532,"kb_used_data":11992,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754659188,"statfs":{"total":773094113280,"available":772771008512,"internally_reserved":0,"allocated":12279808,"data_stored":6367320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.002651"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719829+0000","last_change":"2024-08-18T22:25:28.719829+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719829+0000","last_undegraded":"2024-08-18T22:25:28.719829+0000","last_fullsized":"2024-08-18T22:25:28.719829+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726659+0000","last_change":"2024-08-18T22:25:27.726659+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726659+0000","last_undegraded":"2024-08-18T22:25:27.726659+0000","last_fullsized":"2024-08-18T22:25:27.726659+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719007+0000","last_change":"2024-08-18T22:25:28.719007+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719007+0000","last_undegraded":"2024-08-18T22:25:28.719007+0000","last_fullsized":"2024-08-18T22:25:28.719007+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725301+0000","last_change":"2024-08-18T22:25:27.725301+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725301+0000","last_undegraded":"2024-08-18T22:25:27.725301+0000","last_fullsized":"2024-08-18T22:25:27.725301+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.727488+0000","last_change":"2024-08-18T22:25:27.727488+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.727488+0000","last_undegraded":"2024-08-18T22:25:27.727488+0000","last_fullsized":"2024-08-18T22:25:27.727488+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725863+0000","last_change":"2024-08-18T22:25:27.725863+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725863+0000","last_undegraded":"2024-08-18T22:25:27.725863+0000","last_fullsized":"2024-08-18T22:25:27.725863+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724743+0000","last_change":"2024-08-18T22:25:27.724743+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724743+0000","last_undegraded":"2024-08-18T22:25:27.724743+0000","last_fullsized":"2024-08-18T22:25:27.724743+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.746487+0000","last_change":"2024-08-18T22:25:28.744499+0000","last_active":"2024-08-18T22:25:28.746487+0000","last_peered":"2024-08-18T22:25:28.746487+0000","last_clean":"2024-08-18T22:25:28.746487+0000","last_became_active":"2024-08-18T22:25:28.743063+0000","last_became_peered":"2024-08-18T22:25:28.743063+0000","last_unstale":"2024-08-18T22:25:28.746487+0000","last_undegraded":"2024-08-18T22:25:28.746487+0000","last_fullsized":"2024-08-18T22:25:28.746487+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:24:21.676787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725309+0000","last_change":"2024-08-18T22:25:27.725309+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725309+0000","last_undegraded":"2024-08-18T22:25:27.725309+0000","last_fullsized":"2024-08-18T22:25:27.725309+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.728172+0000","last_change":"2024-08-18T22:25:27.728172+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.728172+0000","last_undegraded":"2024-08-18T22:25:27.728172+0000","last_fullsized":"2024-08-18T22:25:27.728172+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725169+0000","last_change":"2024-08-18T22:25:27.725169+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725169+0000","last_undegraded":"2024-08-18T22:25:27.725169+0000","last_fullsized":"2024-08-18T22:25:27.725169+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721628+0000","last_change":"2024-08-18T22:25:28.727214+0000","last_active":"2024-08-18T22:25:29.721628+0000","last_peered":"2024-08-18T22:25:29.721628+0000","last_clean":"2024-08-18T22:25:29.721628+0000","last_became_active":"2024-08-18T22:25:28.726957+0000","last_became_peered":"2024-08-18T22:25:28.726957+0000","last_unstale":"2024-08-18T22:25:29.721628+0000","last_undegraded":"2024-08-18T22:25:29.721628+0000","last_fullsized":"2024-08-18T22:25:29.721628+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:14:19.239308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.722578+0000","last_change":"2024-08-18T22:25:27.722578+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.722578+0000","last_undegraded":"2024-08-18T22:25:27.722578+0000","last_fullsized":"2024-08-18T22:25:27.722578+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.724142+0000","last_change":"2024-08-18T22:25:28.724142+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.724142+0000","last_undegraded":"2024-08-18T22:25:28.724142+0000","last_fullsized":"2024-08-18T22:25:28.724142+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.721265+0000","last_change":"2024-08-18T22:25:28.721265+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.721265+0000","last_undegraded":"2024-08-18T22:25:28.721265+0000","last_fullsized":"2024-08-18T22:25:28.721265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720510+0000","last_change":"2024-08-18T22:25:28.720510+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720510+0000","last_undegraded":"2024-08-18T22:25:28.720510+0000","last_fullsized":"2024-08-18T22:25:28.720510+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719867+0000","last_change":"2024-08-18T22:25:28.719867+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719867+0000","last_undegraded":"2024-08-18T22:25:28.719867+0000","last_fullsized":"2024-08-18T22:25:28.719867+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725108+0000","last_change":"2024-08-18T22:25:27.725108+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725108+0000","last_undegraded":"2024-08-18T22:25:27.725108+0000","last_fullsized":"2024-08-18T22:25:27.725108+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719417+0000","last_change":"2024-08-18T22:25:28.719417+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719417+0000","last_undegraded":"2024-08-18T22:25:28.719417+0000","last_fullsized":"2024-08-18T22:25:28.719417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721622+0000","last_change":"2024-08-18T22:25:28.732094+0000","last_active":"2024-08-18T22:25:29.721622+0000","last_peered":"2024-08-18T22:25:29.721622+0000","last_clean":"2024-08-18T22:25:29.721622+0000","last_became_active":"2024-08-18T22:25:28.731793+0000","last_became_peered":"2024-08-18T22:25:28.731793+0000","last_unstale":"2024-08-18T22:25:29.721622+0000","last_undegraded":"2024-08-18T22:25:29.721622+0000","last_fullsized":"2024-08-18T22:25:29.721622+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:14.636263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741550+0000","last_change":"2024-08-18T22:25:28.738637+0000","last_active":"2024-08-18T22:25:28.741550+0000","last_peered":"2024-08-18T22:25:28.741550+0000","last_clean":"2024-08-18T22:25:28.741550+0000","last_became_active":"2024-08-18T22:25:28.738343+0000","last_became_peered":"2024-08-18T22:25:28.738343+0000","last_unstale":"2024-08-18T22:25:28.741550+0000","last_undegraded":"2024-08-18T22:25:28.741550+0000","last_fullsized":"2024-08-18T22:25:28.741550+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:23.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.722602+0000","last_change":"2024-08-18T22:25:27.722602+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.722602+0000","last_undegraded":"2024-08-18T22:25:27.722602+0000","last_fullsized":"2024-08-18T22:25:27.722602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718940+0000","last_change":"2024-08-18T22:25:28.718940+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718940+0000","last_undegraded":"2024-08-18T22:25:28.718940+0000","last_fullsized":"2024-08-18T22:25:28.718940+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723134+0000","last_change":"2024-08-18T22:25:27.723134+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723134+0000","last_undegraded":"2024-08-18T22:25:27.723134+0000","last_fullsized":"2024-08-18T22:25:27.723134+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721661+0000","last_change":"2024-08-18T22:25:28.737468+0000","last_active":"2024-08-18T22:25:29.721661+0000","last_peered":"2024-08-18T22:25:29.721661+0000","last_clean":"2024-08-18T22:25:29.721661+0000","last_became_active":"2024-08-18T22:25:28.734632+0000","last_became_peered":"2024-08-18T22:25:28.734632+0000","last_unstale":"2024-08-18T22:25:29.721661+0000","last_undegraded":"2024-08-18T22:25:29.721661+0000","last_fullsized":"2024-08-18T22:25:29.721661+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:05.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721571+0000","last_change":"2024-08-18T22:25:28.735178+0000","last_active":"2024-08-18T22:25:29.721571+0000","last_peered":"2024-08-18T22:25:29.721571+0000","last_clean":"2024-08-18T22:25:29.721571+0000","last_became_active":"2024-08-18T22:25:28.734914+0000","last_became_peered":"2024-08-18T22:25:28.734914+0000","last_unstale":"2024-08-18T22:25:29.721571+0000","last_undegraded":"2024-08-18T22:25:29.721571+0000","last_fullsized":"2024-08-18T22:25:29.721571+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:03:03.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724715+0000","last_change":"2024-08-18T22:25:27.724715+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724715+0000","last_undegraded":"2024-08-18T22:25:27.724715+0000","last_fullsized":"2024-08-18T22:25:27.724715+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724171+0000","last_change":"2024-08-18T22:25:27.724171+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724171+0000","last_undegraded":"2024-08-18T22:25:27.724171+0000","last_fullsized":"2024-08-18T22:25:27.724171+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741567+0000","last_change":"2024-08-18T22:25:28.738595+0000","last_active":"2024-08-18T22:25:28.741567+0000","last_peered":"2024-08-18T22:25:28.741567+0000","last_clean":"2024-08-18T22:25:28.741567+0000","last_became_active":"2024-08-18T22:25:28.738274+0000","last_became_peered":"2024-08-18T22:25:28.738274+0000","last_unstale":"2024-08-18T22:25:28.741567+0000","last_undegraded":"2024-08-18T22:25:28.741567+0000","last_fullsized":"2024-08-18T22:25:28.741567+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:46.453256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721136+0000","last_change":"2024-08-18T22:25:28.732585+0000","last_active":"2024-08-18T22:25:29.721136+0000","last_peered":"2024-08-18T22:25:29.721136+0000","last_clean":"2024-08-18T22:25:29.721136+0000","last_became_active":"2024-08-18T22:25:28.731808+0000","last_became_peered":"2024-08-18T22:25:28.731808+0000","last_unstale":"2024-08-18T22:25:29.721136+0000","last_undegraded":"2024-08-18T22:25:29.721136+0000","last_fullsized":"2024-08-18T22:25:29.721136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:42:03.700694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721317+0000","last_change":"2024-08-18T22:25:27.721317+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721317+0000","last_undegraded":"2024-08-18T22:25:27.721317+0000","last_fullsized":"2024-08-18T22:25:27.721317+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.744420+0000","last_change":"2024-08-18T22:25:28.738517+0000","last_active":"2024-08-18T22:25:28.744420+0000","last_peered":"2024-08-18T22:25:28.744420+0000","last_clean":"2024-08-18T22:25:28.744420+0000","last_became_active":"2024-08-18T22:25:28.738224+0000","last_became_peered":"2024-08-18T22:25:28.738224+0000","last_unstale":"2024-08-18T22:25:28.744420+0000","last_undegraded":"2024-08-18T22:25:28.744420+0000","last_fullsized":"2024-08-18T22:25:28.744420+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:12:30.173542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719070+0000","last_change":"2024-08-18T22:25:28.719070+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719070+0000","last_undegraded":"2024-08-18T22:25:28.719070+0000","last_fullsized":"2024-08-18T22:25:28.719070+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739789+0000","last_change":"2024-08-18T22:25:27.738154+0000","last_active":"2024-08-18T22:25:27.739789+0000","last_peered":"2024-08-18T22:25:27.739789+0000","last_clean":"2024-08-18T22:25:27.739789+0000","last_became_active":"2024-08-18T22:25:27.737885+0000","last_became_peered":"2024-08-18T22:25:27.737885+0000","last_unstale":"2024-08-18T22:25:27.739789+0000","last_undegraded":"2024-08-18T22:25:27.739789+0000","last_fullsized":"2024-08-18T22:25:27.739789+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:05.409913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.740290+0000","last_change":"2024-08-18T22:25:28.736655+0000","last_active":"2024-08-18T22:25:28.740290+0000","last_peered":"2024-08-18T22:25:28.740290+0000","last_clean":"2024-08-18T22:25:28.740290+0000","last_became_active":"2024-08-18T22:25:28.736388+0000","last_became_peered":"2024-08-18T22:25:28.736388+0000","last_unstale":"2024-08-18T22:25:28.740290+0000","last_undegraded":"2024-08-18T22:25:28.740290+0000","last_fullsized":"2024-08-18T22:25:28.740290+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:07:46.806767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"113'1","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.762168+0000","last_change":"2024-08-18T22:25:27.744782+0000","last_active":"2024-08-18T22:25:28.762168+0000","last_peered":"2024-08-18T22:25:28.762168+0000","last_clean":"2024-08-18T22:25:28.762168+0000","last_became_active":"2024-08-18T22:25:27.744174+0000","last_became_peered":"2024-08-18T22:25:27.744174+0000","last_unstale":"2024-08-18T22:25:28.762168+0000","last_undegraded":"2024-08-18T22:25:28.762168+0000","last_fullsized":"2024-08-18T22:25:28.762168+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:59.111032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721203+0000","last_change":"2024-08-18T22:25:28.729447+0000","last_active":"2024-08-18T22:25:29.721203+0000","last_peered":"2024-08-18T22:25:29.721203+0000","last_clean":"2024-08-18T22:25:29.721203+0000","last_became_active":"2024-08-18T22:25:28.727894+0000","last_became_peered":"2024-08-18T22:25:28.727894+0000","last_unstale":"2024-08-18T22:25:29.721203+0000","last_undegraded":"2024-08-18T22:25:29.721203+0000","last_fullsized":"2024-08-18T22:25:29.721203+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:49:11.616903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721307+0000","last_change":"2024-08-18T22:25:27.733672+0000","last_active":"2024-08-18T22:25:29.721307+0000","last_peered":"2024-08-18T22:25:29.721307+0000","last_clean":"2024-08-18T22:25:29.721307+0000","last_became_active":"2024-08-18T22:25:27.733366+0000","last_became_peered":"2024-08-18T22:25:27.733366+0000","last_unstale":"2024-08-18T22:25:29.721307+0000","last_undegraded":"2024-08-18T22:25:29.721307+0000","last_fullsized":"2024-08-18T22:25:29.721307+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:13.034285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726086+0000","last_change":"2024-08-18T22:25:27.726086+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726086+0000","last_undegraded":"2024-08-18T22:25:27.726086+0000","last_fullsized":"2024-08-18T22:25:27.726086+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739683+0000","last_change":"2024-08-18T22:25:27.737506+0000","last_active":"2024-08-18T22:25:27.739683+0000","last_peered":"2024-08-18T22:25:27.739683+0000","last_clean":"2024-08-18T22:25:27.739683+0000","last_became_active":"2024-08-18T22:25:27.737232+0000","last_became_peered":"2024-08-18T22:25:27.737232+0000","last_unstale":"2024-08-18T22:25:27.739683+0000","last_undegraded":"2024-08-18T22:25:27.739683+0000","last_fullsized":"2024-08-18T22:25:27.739683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:21.441375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724880+0000","last_change":"2024-08-18T22:25:27.724880+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724880+0000","last_undegraded":"2024-08-18T22:25:27.724880+0000","last_fullsized":"2024-08-18T22:25:27.724880+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724102+0000","last_change":"2024-08-18T22:25:27.734402+0000","last_active":"2024-08-18T22:25:28.724102+0000","last_peered":"2024-08-18T22:25:28.724102+0000","last_clean":"2024-08-18T22:25:28.724102+0000","last_became_active":"2024-08-18T22:25:27.733634+0000","last_became_peered":"2024-08-18T22:25:27.733634+0000","last_unstale":"2024-08-18T22:25:28.724102+0000","last_undegraded":"2024-08-18T22:25:28.724102+0000","last_fullsized":"2024-08-18T22:25:28.724102+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:18.699215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720476+0000","last_change":"2024-08-18T22:25:28.720476+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720476+0000","last_undegraded":"2024-08-18T22:25:28.720476+0000","last_fullsized":"2024-08-18T22:25:28.720476+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.735298+0000","last_change":"2024-08-18T22:25:27.731859+0000","last_active":"2024-08-18T22:25:27.735298+0000","last_peered":"2024-08-18T22:25:27.735298+0000","last_clean":"2024-08-18T22:25:27.735298+0000","last_became_active":"2024-08-18T22:25:27.731366+0000","last_became_peered":"2024-08-18T22:25:27.731366+0000","last_unstale":"2024-08-18T22:25:27.735298+0000","last_undegraded":"2024-08-18T22:25:27.735298+0000","last_fullsized":"2024-08-18T22:25:27.735298+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:00.986288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721343+0000","last_change":"2024-08-18T22:25:27.721343+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721343+0000","last_undegraded":"2024-08-18T22:25:27.721343+0000","last_fullsized":"2024-08-18T22:25:27.721343+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720400+0000","last_change":"2024-08-18T22:25:27.738161+0000","last_active":"2024-08-18T22:25:29.720400+0000","last_peered":"2024-08-18T22:25:29.720400+0000","last_clean":"2024-08-18T22:25:29.720400+0000","last_became_active":"2024-08-18T22:25:27.737855+0000","last_became_peered":"2024-08-18T22:25:27.737855+0000","last_unstale":"2024-08-18T22:25:29.720400+0000","last_undegraded":"2024-08-18T22:25:29.720400+0000","last_fullsized":"2024-08-18T22:25:29.720400+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:42:10.877593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726107+0000","last_change":"2024-08-18T22:25:27.726107+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726107+0000","last_undegraded":"2024-08-18T22:25:27.726107+0000","last_fullsized":"2024-08-18T22:25:27.726107+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739758+0000","last_change":"2024-08-18T22:25:27.736484+0000","last_active":"2024-08-18T22:25:27.739758+0000","last_peered":"2024-08-18T22:25:27.739758+0000","last_clean":"2024-08-18T22:25:27.739758+0000","last_became_active":"2024-08-18T22:25:27.736159+0000","last_became_peered":"2024-08-18T22:25:27.736159+0000","last_unstale":"2024-08-18T22:25:27.739758+0000","last_undegraded":"2024-08-18T22:25:27.739758+0000","last_fullsized":"2024-08-18T22:25:27.739758+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:47.068872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718749+0000","last_change":"2024-08-18T22:25:28.718749+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718749+0000","last_undegraded":"2024-08-18T22:25:28.718749+0000","last_fullsized":"2024-08-18T22:25:28.718749+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721458+0000","last_change":"2024-08-18T22:25:27.736398+0000","last_active":"2024-08-18T22:25:29.721458+0000","last_peered":"2024-08-18T22:25:29.721458+0000","last_clean":"2024-08-18T22:25:29.721458+0000","last_became_active":"2024-08-18T22:25:27.735991+0000","last_became_peered":"2024-08-18T22:25:27.735991+0000","last_unstale":"2024-08-18T22:25:29.721458+0000","last_undegraded":"2024-08-18T22:25:29.721458+0000","last_fullsized":"2024-08-18T22:25:29.721458+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.681647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723136+0000","last_change":"2024-08-18T22:25:27.723136+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723136+0000","last_undegraded":"2024-08-18T22:25:27.723136+0000","last_fullsized":"2024-08-18T22:25:27.723136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.719184+0000","last_change":"2024-08-18T22:25:27.740411+0000","last_active":"2024-08-18T22:25:28.719184+0000","last_peered":"2024-08-18T22:25:28.719184+0000","last_clean":"2024-08-18T22:25:28.719184+0000","last_became_active":"2024-08-18T22:25:27.740044+0000","last_became_peered":"2024-08-18T22:25:27.740044+0000","last_unstale":"2024-08-18T22:25:28.719184+0000","last_undegraded":"2024-08-18T22:25:28.719184+0000","last_fullsized":"2024-08-18T22:25:28.719184+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:26:05.404663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.743068+0000","last_change":"2024-08-18T22:25:28.740188+0000","last_active":"2024-08-18T22:25:28.743068+0000","last_peered":"2024-08-18T22:25:28.743068+0000","last_clean":"2024-08-18T22:25:28.743068+0000","last_became_active":"2024-08-18T22:25:28.739904+0000","last_became_peered":"2024-08-18T22:25:28.739904+0000","last_unstale":"2024-08-18T22:25:28.743068+0000","last_undegraded":"2024-08-18T22:25:28.743068+0000","last_fullsized":"2024-08-18T22:25:28.743068+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:14:29.817257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724154+0000","last_change":"2024-08-18T22:25:27.737622+0000","last_active":"2024-08-18T22:25:28.724154+0000","last_peered":"2024-08-18T22:25:28.724154+0000","last_clean":"2024-08-18T22:25:28.724154+0000","last_became_active":"2024-08-18T22:25:27.737354+0000","last_became_peered":"2024-08-18T22:25:27.737354+0000","last_unstale":"2024-08-18T22:25:28.724154+0000","last_undegraded":"2024-08-18T22:25:28.724154+0000","last_fullsized":"2024-08-18T22:25:28.724154+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:35.786573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723893+0000","last_change":"2024-08-18T22:25:27.723893+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723893+0000","last_undegraded":"2024-08-18T22:25:27.723893+0000","last_fullsized":"2024-08-18T22:25:27.723893+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.741090+0000","last_change":"2024-08-18T22:25:27.738707+0000","last_active":"2024-08-18T22:25:27.741090+0000","last_peered":"2024-08-18T22:25:27.741090+0000","last_clean":"2024-08-18T22:25:27.741090+0000","last_became_active":"2024-08-18T22:25:27.738399+0000","last_became_peered":"2024-08-18T22:25:27.738399+0000","last_unstale":"2024-08-18T22:25:27.741090+0000","last_undegraded":"2024-08-18T22:25:27.741090+0000","last_fullsized":"2024-08-18T22:25:27.741090+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:59.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723792+0000","last_change":"2024-08-18T22:25:27.723792+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723792+0000","last_undegraded":"2024-08-18T22:25:27.723792+0000","last_fullsized":"2024-08-18T22:25:27.723792+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.744713+0000","last_change":"2024-08-18T22:25:27.743973+0000","last_active":"2024-08-18T22:25:27.744713+0000","last_peered":"2024-08-18T22:25:27.744713+0000","last_clean":"2024-08-18T22:25:27.744713+0000","last_became_active":"2024-08-18T22:25:27.743650+0000","last_became_peered":"2024-08-18T22:25:27.743650+0000","last_unstale":"2024-08-18T22:25:27.744713+0000","last_undegraded":"2024-08-18T22:25:27.744713+0000","last_fullsized":"2024-08-18T22:25:27.744713+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:57.080994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721308+0000","last_change":"2024-08-18T22:25:27.721308+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721308+0000","last_undegraded":"2024-08-18T22:25:27.721308+0000","last_fullsized":"2024-08-18T22:25:27.721308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739723+0000","last_change":"2024-08-18T22:25:27.736833+0000","last_active":"2024-08-18T22:25:27.739723+0000","last_peered":"2024-08-18T22:25:27.739723+0000","last_clean":"2024-08-18T22:25:27.739723+0000","last_became_active":"2024-08-18T22:25:27.736456+0000","last_became_peered":"2024-08-18T22:25:27.736456+0000","last_unstale":"2024-08-18T22:25:27.739723+0000","last_undegraded":"2024-08-18T22:25:27.739723+0000","last_fullsized":"2024-08-18T22:25:27.739723+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:03.142020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.743792+0000","last_change":"2024-08-18T22:25:28.739981+0000","last_active":"2024-08-18T22:25:28.743792+0000","last_peered":"2024-08-18T22:25:28.743792+0000","last_clean":"2024-08-18T22:25:28.743792+0000","last_became_active":"2024-08-18T22:25:28.738317+0000","last_became_peered":"2024-08-18T22:25:28.738317+0000","last_unstale":"2024-08-18T22:25:28.743792+0000","last_undegraded":"2024-08-18T22:25:28.743792+0000","last_fullsized":"2024-08-18T22:25:28.743792+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:34.358754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.729238+0000","last_change":"2024-08-18T22:25:27.743028+0000","last_active":"2024-08-18T22:25:28.729238+0000","last_peered":"2024-08-18T22:25:28.729238+0000","last_clean":"2024-08-18T22:25:28.729238+0000","last_became_active":"2024-08-18T22:25:27.742106+0000","last_became_peered":"2024-08-18T22:25:27.742106+0000","last_unstale":"2024-08-18T22:25:28.729238+0000","last_undegraded":"2024-08-18T22:25:28.729238+0000","last_fullsized":"2024-08-18T22:25:28.729238+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:56.157132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720145+0000","last_change":"2024-08-18T22:25:28.720145+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720145+0000","last_undegraded":"2024-08-18T22:25:28.720145+0000","last_fullsized":"2024-08-18T22:25:28.720145+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720737+0000","last_change":"2024-08-18T22:25:27.738551+0000","last_active":"2024-08-18T22:25:29.720737+0000","last_peered":"2024-08-18T22:25:29.720737+0000","last_clean":"2024-08-18T22:25:29.720737+0000","last_became_active":"2024-08-18T22:25:27.737360+0000","last_became_peered":"2024-08-18T22:25:27.737360+0000","last_unstale":"2024-08-18T22:25:29.720737+0000","last_undegraded":"2024-08-18T22:25:29.720737+0000","last_fullsized":"2024-08-18T22:25:29.720737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:54:38.492348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.744395+0000","last_change":"2024-08-18T22:25:28.737712+0000","last_active":"2024-08-18T22:25:28.744395+0000","last_peered":"2024-08-18T22:25:28.744395+0000","last_clean":"2024-08-18T22:25:28.744395+0000","last_became_active":"2024-08-18T22:25:28.737443+0000","last_became_peered":"2024-08-18T22:25:28.737443+0000","last_unstale":"2024-08-18T22:25:28.744395+0000","last_undegraded":"2024-08-18T22:25:28.744395+0000","last_fullsized":"2024-08-18T22:25:28.744395+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:17.054695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.734543+0000","last_change":"2024-08-18T22:25:27.728904+0000","last_active":"2024-08-18T22:25:27.734543+0000","last_peered":"2024-08-18T22:25:27.734543+0000","last_clean":"2024-08-18T22:25:27.734543+0000","last_became_active":"2024-08-18T22:25:27.728636+0000","last_became_peered":"2024-08-18T22:25:27.728636+0000","last_unstale":"2024-08-18T22:25:27.734543+0000","last_undegraded":"2024-08-18T22:25:27.734543+0000","last_fullsized":"2024-08-18T22:25:27.734543+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:57.080994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721301+0000","last_change":"2024-08-18T22:25:27.721301+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721301+0000","last_undegraded":"2024-08-18T22:25:27.721301+0000","last_fullsized":"2024-08-18T22:25:27.721301+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724314+0000","last_change":"2024-08-18T22:25:27.729731+0000","last_active":"2024-08-18T22:25:28.724314+0000","last_peered":"2024-08-18T22:25:28.724314+0000","last_clean":"2024-08-18T22:25:28.724314+0000","last_became_active":"2024-08-18T22:25:27.729336+0000","last_became_peered":"2024-08-18T22:25:27.729336+0000","last_unstale":"2024-08-18T22:25:28.724314+0000","last_undegraded":"2024-08-18T22:25:28.724314+0000","last_fullsized":"2024-08-18T22:25:28.724314+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:53.446928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.727065+0000","last_change":"2024-08-18T22:25:27.727065+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.727065+0000","last_undegraded":"2024-08-18T22:25:27.727065+0000","last_fullsized":"2024-08-18T22:25:27.727065+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.738837+0000","last_change":"2024-08-18T22:25:27.735677+0000","last_active":"2024-08-18T22:25:27.738837+0000","last_peered":"2024-08-18T22:25:27.738837+0000","last_clean":"2024-08-18T22:25:27.738837+0000","last_became_active":"2024-08-18T22:25:27.735124+0000","last_became_peered":"2024-08-18T22:25:27.735124+0000","last_unstale":"2024-08-18T22:25:27.738837+0000","last_undegraded":"2024-08-18T22:25:27.738837+0000","last_fullsized":"2024-08-18T22:25:27.738837+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:31.547107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718796+0000","last_change":"2024-08-18T22:25:28.718796+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718796+0000","last_undegraded":"2024-08-18T22:25:28.718796+0000","last_fullsized":"2024-08-18T22:25:28.718796+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"113'2","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.758597+0000","last_change":"2024-08-18T22:25:27.740165+0000","last_active":"2024-08-18T22:25:28.758597+0000","last_peered":"2024-08-18T22:25:28.758597+0000","last_clean":"2024-08-18T22:25:28.758597+0000","last_became_active":"2024-08-18T22:25:27.736854+0000","last_became_peered":"2024-08-18T22:25:27.736854+0000","last_unstale":"2024-08-18T22:25:28.758597+0000","last_undegraded":"2024-08-18T22:25:28.758597+0000","last_fullsized":"2024-08-18T22:25:28.758597+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:42:12.311494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719780+0000","last_change":"2024-08-18T22:25:28.719780+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719780+0000","last_undegraded":"2024-08-18T22:25:28.719780+0000","last_fullsized":"2024-08-18T22:25:28.719780+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.730023+0000","last_change":"2024-08-18T22:25:27.743195+0000","last_active":"2024-08-18T22:25:28.730023+0000","last_peered":"2024-08-18T22:25:28.730023+0000","last_clean":"2024-08-18T22:25:28.730023+0000","last_became_active":"2024-08-18T22:25:27.742876+0000","last_became_peered":"2024-08-18T22:25:27.742876+0000","last_unstale":"2024-08-18T22:25:28.730023+0000","last_undegraded":"2024-08-18T22:25:28.730023+0000","last_fullsized":"2024-08-18T22:25:28.730023+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:34.262887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724420+0000","last_change":"2024-08-18T22:25:27.724420+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724420+0000","last_undegraded":"2024-08-18T22:25:27.724420+0000","last_fullsized":"2024-08-18T22:25:27.724420+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.737580+0000","last_change":"2024-08-18T22:25:27.729602+0000","last_active":"2024-08-18T22:25:27.737580+0000","last_peered":"2024-08-18T22:25:27.737580+0000","last_clean":"2024-08-18T22:25:27.737580+0000","last_became_active":"2024-08-18T22:25:27.729342+0000","last_became_peered":"2024-08-18T22:25:27.729342+0000","last_unstale":"2024-08-18T22:25:27.737580+0000","last_undegraded":"2024-08-18T22:25:27.737580+0000","last_fullsized":"2024-08-18T22:25:27.737580+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:38.345310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.739416+0000","last_change":"2024-08-18T22:25:28.735821+0000","last_active":"2024-08-18T22:25:28.739416+0000","last_peered":"2024-08-18T22:25:28.739416+0000","last_clean":"2024-08-18T22:25:28.739416+0000","last_became_active":"2024-08-18T22:25:28.735547+0000","last_became_peered":"2024-08-18T22:25:28.735547+0000","last_unstale":"2024-08-18T22:25:28.739416+0000","last_undegraded":"2024-08-18T22:25:28.739416+0000","last_fullsized":"2024-08-18T22:25:28.739416+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:11.104170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.731246+0000","last_change":"2024-08-18T22:25:27.739921+0000","last_active":"2024-08-18T22:25:28.731246+0000","last_peered":"2024-08-18T22:25:28.731246+0000","last_clean":"2024-08-18T22:25:28.731246+0000","last_became_active":"2024-08-18T22:25:27.739634+0000","last_became_peered":"2024-08-18T22:25:27.739634+0000","last_unstale":"2024-08-18T22:25:28.731246+0000","last_undegraded":"2024-08-18T22:25:28.731246+0000","last_fullsized":"2024-08-18T22:25:28.731246+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:48.519152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718694+0000","last_change":"2024-08-18T22:25:28.718694+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718694+0000","last_undegraded":"2024-08-18T22:25:28.718694+0000","last_fullsized":"2024-08-18T22:25:28.718694+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.745206+0000","last_change":"2024-08-18T22:25:27.744272+0000","last_active":"2024-08-18T22:25:27.745206+0000","last_peered":"2024-08-18T22:25:27.745206+0000","last_clean":"2024-08-18T22:25:27.745206+0000","last_became_active":"2024-08-18T22:25:27.744026+0000","last_became_peered":"2024-08-18T22:25:27.744026+0000","last_unstale":"2024-08-18T22:25:27.745206+0000","last_undegraded":"2024-08-18T22:25:27.745206+0000","last_fullsized":"2024-08-18T22:25:27.745206+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:38.345310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720287+0000","last_change":"2024-08-18T22:25:28.728579+0000","last_active":"2024-08-18T22:25:29.720287+0000","last_peered":"2024-08-18T22:25:29.720287+0000","last_clean":"2024-08-18T22:25:29.720287+0000","last_became_active":"2024-08-18T22:25:28.728302+0000","last_became_peered":"2024-08-18T22:25:28.728302+0000","last_unstale":"2024-08-18T22:25:29.720287+0000","last_undegraded":"2024-08-18T22:25:29.720287+0000","last_fullsized":"2024-08-18T22:25:29.720287+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:15.603682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.719343+0000","last_change":"2024-08-18T22:25:27.738515+0000","last_active":"2024-08-18T22:25:28.719343+0000","last_peered":"2024-08-18T22:25:28.719343+0000","last_clean":"2024-08-18T22:25:28.719343+0000","last_became_active":"2024-08-18T22:25:27.738233+0000","last_became_peered":"2024-08-18T22:25:27.738233+0000","last_unstale":"2024-08-18T22:25:28.719343+0000","last_undegraded":"2024-08-18T22:25:28.719343+0000","last_fullsized":"2024-08-18T22:25:28.719343+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:06.452774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723453+0000","last_change":"2024-08-18T22:25:27.723453+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723453+0000","last_undegraded":"2024-08-18T22:25:27.723453+0000","last_fullsized":"2024-08-18T22:25:27.723453+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.740920+0000","last_change":"2024-08-18T22:25:27.736974+0000","last_active":"2024-08-18T22:25:27.740920+0000","last_peered":"2024-08-18T22:25:27.740920+0000","last_clean":"2024-08-18T22:25:27.740920+0000","last_became_active":"2024-08-18T22:25:27.736651+0000","last_became_peered":"2024-08-18T22:25:27.736651+0000","last_unstale":"2024-08-18T22:25:27.740920+0000","last_undegraded":"2024-08-18T22:25:27.740920+0000","last_fullsized":"2024-08-18T22:25:27.740920+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:55:00.779397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726523+0000","last_change":"2024-08-18T22:25:27.726523+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726523+0000","last_undegraded":"2024-08-18T22:25:27.726523+0000","last_fullsized":"2024-08-18T22:25:27.726523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.742177+0000","last_change":"2024-08-18T22:25:27.741264+0000","last_active":"2024-08-18T22:25:27.742177+0000","last_peered":"2024-08-18T22:25:27.742177+0000","last_clean":"2024-08-18T22:25:27.742177+0000","last_became_active":"2024-08-18T22:25:27.740478+0000","last_became_peered":"2024-08-18T22:25:27.740478+0000","last_unstale":"2024-08-18T22:25:27.742177+0000","last_undegraded":"2024-08-18T22:25:27.742177+0000","last_fullsized":"2024-08-18T22:25:27.742177+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:42.261529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741656+0000","last_change":"2024-08-18T22:25:28.739269+0000","last_active":"2024-08-18T22:25:28.741656+0000","last_peered":"2024-08-18T22:25:28.741656+0000","last_clean":"2024-08-18T22:25:28.741656+0000","last_became_active":"2024-08-18T22:25:28.738998+0000","last_became_peered":"2024-08-18T22:25:28.738998+0000","last_unstale":"2024-08-18T22:25:28.741656+0000","last_undegraded":"2024-08-18T22:25:28.741656+0000","last_fullsized":"2024-08-18T22:25:28.741656+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:34.516916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721212+0000","last_change":"2024-08-18T22:25:27.729754+0000","last_active":"2024-08-18T22:25:29.721212+0000","last_peered":"2024-08-18T22:25:29.721212+0000","last_clean":"2024-08-18T22:25:29.721212+0000","last_became_active":"2024-08-18T22:25:27.729444+0000","last_became_peered":"2024-08-18T22:25:27.729444+0000","last_unstale":"2024-08-18T22:25:29.721212+0000","last_undegraded":"2024-08-18T22:25:29.721212+0000","last_fullsized":"2024-08-18T22:25:29.721212+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:44.526490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.736249+0000","last_change":"2024-08-18T22:25:28.735227+0000","last_active":"2024-08-18T22:25:28.736249+0000","last_peered":"2024-08-18T22:25:28.736249+0000","last_clean":"2024-08-18T22:25:28.736249+0000","last_became_active":"2024-08-18T22:25:28.734944+0000","last_became_peered":"2024-08-18T22:25:28.734944+0000","last_unstale":"2024-08-18T22:25:28.736249+0000","last_undegraded":"2024-08-18T22:25:28.736249+0000","last_fullsized":"2024-08-18T22:25:28.736249+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:23.812669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.730204+0000","last_change":"2024-08-18T22:25:27.742531+0000","last_active":"2024-08-18T22:25:28.730204+0000","last_peered":"2024-08-18T22:25:28.730204+0000","last_clean":"2024-08-18T22:25:28.730204+0000","last_became_active":"2024-08-18T22:25:27.741977+0000","last_became_peered":"2024-08-18T22:25:27.741977+0000","last_unstale":"2024-08-18T22:25:28.730204+0000","last_undegraded":"2024-08-18T22:25:28.730204+0000","last_fullsized":"2024-08-18T22:25:28.730204+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:19:55.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.724635+0000","last_change":"2024-08-18T22:25:28.724635+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.724635+0000","last_undegraded":"2024-08-18T22:25:28.724635+0000","last_fullsized":"2024-08-18T22:25:28.724635+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.740032+0000","last_change":"2024-08-18T22:25:27.733640+0000","last_active":"2024-08-18T22:25:27.740032+0000","last_peered":"2024-08-18T22:25:27.740032+0000","last_clean":"2024-08-18T22:25:27.740032+0000","last_became_active":"2024-08-18T22:25:27.733277+0000","last_became_peered":"2024-08-18T22:25:27.733277+0000","last_unstale":"2024-08-18T22:25:27.740032+0000","last_undegraded":"2024-08-18T22:25:27.740032+0000","last_fullsized":"2024-08-18T22:25:27.740032+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:47:32.598265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725469+0000","last_change":"2024-08-18T22:25:27.725469+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725469+0000","last_undegraded":"2024-08-18T22:25:27.725469+0000","last_fullsized":"2024-08-18T22:25:27.725469+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.731395+0000","last_change":"2024-08-18T22:25:27.743464+0000","last_active":"2024-08-18T22:25:28.731395+0000","last_peered":"2024-08-18T22:25:28.731395+0000","last_clean":"2024-08-18T22:25:28.731395+0000","last_became_active":"2024-08-18T22:25:27.742955+0000","last_became_peered":"2024-08-18T22:25:27.742955+0000","last_unstale":"2024-08-18T22:25:28.731395+0000","last_undegraded":"2024-08-18T22:25:28.731395+0000","last_fullsized":"2024-08-18T22:25:28.731395+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:27:25.115281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725858+0000","last_change":"2024-08-18T22:25:27.725858+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725858+0000","last_undegraded":"2024-08-18T22:25:27.725858+0000","last_fullsized":"2024-08-18T22:25:27.725858+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"113'2","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.758528+0000","last_change":"2024-08-18T22:25:27.744925+0000","last_active":"2024-08-18T22:25:28.758528+0000","last_peered":"2024-08-18T22:25:28.758528+0000","last_clean":"2024-08-18T22:25:28.758528+0000","last_became_active":"2024-08-18T22:25:27.744534+0000","last_became_peered":"2024-08-18T22:25:27.744534+0000","last_unstale":"2024-08-18T22:25:28.758528+0000","last_undegraded":"2024-08-18T22:25:28.758528+0000","last_fullsized":"2024-08-18T22:25:28.758528+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:41.300048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":357,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.720940+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:25:28.720940+0000","last_peered":"2024-08-18T22:25:28.720940+0000","last_clean":"2024-08-18T22:25:28.720940+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:25:28.720940+0000","last_undegraded":"2024-08-18T22:25:28.720940+0000","last_fullsized":"2024-08-18T22:25:28.720940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37268,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334572,"statfs":{"total":96636764160,"available":96598601728,"internally_reserved":0,"allocated":1974272,"data_stored":1236047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36688,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335152,"statfs":{"total":96636764160,"available":96599195648,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509519,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36696,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335144,"statfs":{"total":96636764160,"available":96599187456,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40848,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330992,"statfs":{"total":96636764160,"available":96594935808,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509520,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":1974272,"data_stored":1236047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":1413120,"data_stored":659630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40864,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330976,"statfs":{"total":96636764160,"available":96594919424,"internally_reserved":0,"allocated":1396736,"data_stored":652880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:25:33.677 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3f is not active+clean 2024-08-18T22:25:33.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.719829+0000', 'last_change': '2024-08-18T22:25:28.719829+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.719829+0000', 'last_undegraded': '2024-08-18T22:25:28.719829+0000', 'last_fullsized': '2024-08-18T22:25:28.719829+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.677 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3e is not active+clean 2024-08-18T22:25:33.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.726659+0000', 'last_change': '2024-08-18T22:25:27.726659+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.726659+0000', 'last_undegraded': '2024-08-18T22:25:27.726659+0000', 'last_fullsized': '2024-08-18T22:25:27.726659+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:25:33.677 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3d is not active+clean 2024-08-18T22:25:33.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.719007+0000', 'last_change': '2024-08-18T22:25:28.719007+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.719007+0000', 'last_undegraded': '2024-08-18T22:25:28.719007+0000', 'last_fullsized': '2024-08-18T22:25:28.719007+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.678 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3c is not active+clean 2024-08-18T22:25:33.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.725301+0000', 'last_change': '2024-08-18T22:25:27.725301+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.725301+0000', 'last_undegraded': '2024-08-18T22:25:27.725301+0000', 'last_fullsized': '2024-08-18T22:25:27.725301+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:25:33.678 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3b is not active+clean 2024-08-18T22:25:33.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.727488+0000', 'last_change': '2024-08-18T22:25:27.727488+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.727488+0000', 'last_undegraded': '2024-08-18T22:25:27.727488+0000', 'last_fullsized': '2024-08-18T22:25:27.727488+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:25:33.679 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3a is not active+clean 2024-08-18T22:25:33.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.725863+0000', 'last_change': '2024-08-18T22:25:27.725863+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.725863+0000', 'last_undegraded': '2024-08-18T22:25:27.725863+0000', 'last_fullsized': '2024-08-18T22:25:27.725863+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:25:33.679 INFO:tasks.ceph.ceph_manager.ceph:PG 16.39 is not active+clean 2024-08-18T22:25:33.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.724743+0000', 'last_change': '2024-08-18T22:25:27.724743+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.724743+0000', 'last_undegraded': '2024-08-18T22:25:27.724743+0000', 'last_fullsized': '2024-08-18T22:25:27.724743+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:25:33.679 INFO:tasks.ceph.ceph_manager.ceph:PG 16.37 is not active+clean 2024-08-18T22:25:33.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.725309+0000', 'last_change': '2024-08-18T22:25:27.725309+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.725309+0000', 'last_undegraded': '2024-08-18T22:25:27.725309+0000', 'last_fullsized': '2024-08-18T22:25:27.725309+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:25:33.680 INFO:tasks.ceph.ceph_manager.ceph:PG 16.36 is not active+clean 2024-08-18T22:25:33.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.728172+0000', 'last_change': '2024-08-18T22:25:27.728172+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.728172+0000', 'last_undegraded': '2024-08-18T22:25:27.728172+0000', 'last_fullsized': '2024-08-18T22:25:27.728172+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:25:33.680 INFO:tasks.ceph.ceph_manager.ceph:PG 16.35 is not active+clean 2024-08-18T22:25:33.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.725169+0000', 'last_change': '2024-08-18T22:25:27.725169+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.725169+0000', 'last_undegraded': '2024-08-18T22:25:27.725169+0000', 'last_fullsized': '2024-08-18T22:25:27.725169+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:25:33.680 INFO:tasks.ceph.ceph_manager.ceph:PG 16.33 is not active+clean 2024-08-18T22:25:33.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.722578+0000', 'last_change': '2024-08-18T22:25:27.722578+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.722578+0000', 'last_undegraded': '2024-08-18T22:25:27.722578+0000', 'last_fullsized': '2024-08-18T22:25:27.722578+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:25:33.680 INFO:tasks.ceph.ceph_manager.ceph:PG 16.32 is not active+clean 2024-08-18T22:25:33.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.724142+0000', 'last_change': '2024-08-18T22:25:28.724142+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.724142+0000', 'last_undegraded': '2024-08-18T22:25:28.724142+0000', 'last_fullsized': '2024-08-18T22:25:28.724142+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:25:33.681 INFO:tasks.ceph.ceph_manager.ceph:PG 16.31 is not active+clean 2024-08-18T22:25:33.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.721265+0000', 'last_change': '2024-08-18T22:25:28.721265+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.721265+0000', 'last_undegraded': '2024-08-18T22:25:28.721265+0000', 'last_fullsized': '2024-08-18T22:25:28.721265+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:25:33.681 INFO:tasks.ceph.ceph_manager.ceph:PG 16.30 is not active+clean 2024-08-18T22:25:33.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.720510+0000', 'last_change': '2024-08-18T22:25:28.720510+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.720510+0000', 'last_undegraded': '2024-08-18T22:25:28.720510+0000', 'last_fullsized': '2024-08-18T22:25:28.720510+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:25:33.681 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2f is not active+clean 2024-08-18T22:25:33.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.719867+0000', 'last_change': '2024-08-18T22:25:28.719867+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.719867+0000', 'last_undegraded': '2024-08-18T22:25:28.719867+0000', 'last_fullsized': '2024-08-18T22:25:28.719867+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.681 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2e is not active+clean 2024-08-18T22:25:33.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.725108+0000', 'last_change': '2024-08-18T22:25:27.725108+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.725108+0000', 'last_undegraded': '2024-08-18T22:25:27.725108+0000', 'last_fullsized': '2024-08-18T22:25:27.725108+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:25:33.682 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2d is not active+clean 2024-08-18T22:25:33.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.719417+0000', 'last_change': '2024-08-18T22:25:28.719417+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.719417+0000', 'last_undegraded': '2024-08-18T22:25:28.719417+0000', 'last_fullsized': '2024-08-18T22:25:28.719417+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.682 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2a is not active+clean 2024-08-18T22:25:33.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.722602+0000', 'last_change': '2024-08-18T22:25:27.722602+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.722602+0000', 'last_undegraded': '2024-08-18T22:25:27.722602+0000', 'last_fullsized': '2024-08-18T22:25:27.722602+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:25:33.682 INFO:tasks.ceph.ceph_manager.ceph:PG 16.29 is not active+clean 2024-08-18T22:25:33.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.718940+0000', 'last_change': '2024-08-18T22:25:28.718940+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.718940+0000', 'last_undegraded': '2024-08-18T22:25:28.718940+0000', 'last_fullsized': '2024-08-18T22:25:28.718940+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.683 INFO:tasks.ceph.ceph_manager.ceph:PG 16.28 is not active+clean 2024-08-18T22:25:33.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.723134+0000', 'last_change': '2024-08-18T22:25:27.723134+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.723134+0000', 'last_undegraded': '2024-08-18T22:25:27.723134+0000', 'last_fullsized': '2024-08-18T22:25:27.723134+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:25:33.683 INFO:tasks.ceph.ceph_manager.ceph:PG 16.25 is not active+clean 2024-08-18T22:25:33.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.724715+0000', 'last_change': '2024-08-18T22:25:27.724715+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.724715+0000', 'last_undegraded': '2024-08-18T22:25:27.724715+0000', 'last_fullsized': '2024-08-18T22:25:27.724715+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:25:33.683 INFO:tasks.ceph.ceph_manager.ceph:PG 16.24 is not active+clean 2024-08-18T22:25:33.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.724171+0000', 'last_change': '2024-08-18T22:25:27.724171+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.724171+0000', 'last_undegraded': '2024-08-18T22:25:27.724171+0000', 'last_fullsized': '2024-08-18T22:25:27.724171+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:25:33.683 INFO:tasks.ceph.ceph_manager.ceph:PG 16.21 is not active+clean 2024-08-18T22:25:33.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.721317+0000', 'last_change': '2024-08-18T22:25:27.721317+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.721317+0000', 'last_undegraded': '2024-08-18T22:25:27.721317+0000', 'last_fullsized': '2024-08-18T22:25:27.721317+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:25:33.684 INFO:tasks.ceph.ceph_manager.ceph:PG 16.0 is not active+clean 2024-08-18T22:25:33.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.719070+0000', 'last_change': '2024-08-18T22:25:28.719070+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.719070+0000', 'last_undegraded': '2024-08-18T22:25:28.719070+0000', 'last_fullsized': '2024-08-18T22:25:28.719070+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.684 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3 is not active+clean 2024-08-18T22:25:33.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.726086+0000', 'last_change': '2024-08-18T22:25:27.726086+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.726086+0000', 'last_undegraded': '2024-08-18T22:25:27.726086+0000', 'last_fullsized': '2024-08-18T22:25:27.726086+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:25:33.684 INFO:tasks.ceph.ceph_manager.ceph:PG 16.4 is not active+clean 2024-08-18T22:25:33.684 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.724880+0000', 'last_change': '2024-08-18T22:25:27.724880+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.724880+0000', 'last_undegraded': '2024-08-18T22:25:27.724880+0000', 'last_fullsized': '2024-08-18T22:25:27.724880+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:25:33.685 INFO:tasks.ceph.ceph_manager.ceph:PG 16.5 is not active+clean 2024-08-18T22:25:33.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.720476+0000', 'last_change': '2024-08-18T22:25:28.720476+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.720476+0000', 'last_undegraded': '2024-08-18T22:25:28.720476+0000', 'last_fullsized': '2024-08-18T22:25:28.720476+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.685 INFO:tasks.ceph.ceph_manager.ceph:PG 16.6 is not active+clean 2024-08-18T22:25:33.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.721343+0000', 'last_change': '2024-08-18T22:25:27.721343+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.721343+0000', 'last_undegraded': '2024-08-18T22:25:27.721343+0000', 'last_fullsized': '2024-08-18T22:25:27.721343+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:25:33.685 INFO:tasks.ceph.ceph_manager.ceph:PG 16.7 is not active+clean 2024-08-18T22:25:33.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.726107+0000', 'last_change': '2024-08-18T22:25:27.726107+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.726107+0000', 'last_undegraded': '2024-08-18T22:25:27.726107+0000', 'last_fullsized': '2024-08-18T22:25:27.726107+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:25:33.685 INFO:tasks.ceph.ceph_manager.ceph:PG 16.8 is not active+clean 2024-08-18T22:25:33.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.718749+0000', 'last_change': '2024-08-18T22:25:28.718749+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.718749+0000', 'last_undegraded': '2024-08-18T22:25:28.718749+0000', 'last_fullsized': '2024-08-18T22:25:28.718749+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.685 INFO:tasks.ceph.ceph_manager.ceph:PG 16.9 is not active+clean 2024-08-18T22:25:33.685 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.723136+0000', 'last_change': '2024-08-18T22:25:27.723136+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.723136+0000', 'last_undegraded': '2024-08-18T22:25:27.723136+0000', 'last_fullsized': '2024-08-18T22:25:27.723136+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:25:33.685 INFO:tasks.ceph.ceph_manager.ceph:PG 16.b is not active+clean 2024-08-18T22:25:33.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.723893+0000', 'last_change': '2024-08-18T22:25:27.723893+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.723893+0000', 'last_undegraded': '2024-08-18T22:25:27.723893+0000', 'last_fullsized': '2024-08-18T22:25:27.723893+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:25:33.686 INFO:tasks.ceph.ceph_manager.ceph:PG 16.c is not active+clean 2024-08-18T22:25:33.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.723792+0000', 'last_change': '2024-08-18T22:25:27.723792+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.723792+0000', 'last_undegraded': '2024-08-18T22:25:27.723792+0000', 'last_fullsized': '2024-08-18T22:25:27.723792+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:25:33.686 INFO:tasks.ceph.ceph_manager.ceph:PG 16.d is not active+clean 2024-08-18T22:25:33.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.721308+0000', 'last_change': '2024-08-18T22:25:27.721308+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.721308+0000', 'last_undegraded': '2024-08-18T22:25:27.721308+0000', 'last_fullsized': '2024-08-18T22:25:27.721308+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:25:33.686 INFO:tasks.ceph.ceph_manager.ceph:PG 16.f is not active+clean 2024-08-18T22:25:33.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.720145+0000', 'last_change': '2024-08-18T22:25:28.720145+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.720145+0000', 'last_undegraded': '2024-08-18T22:25:28.720145+0000', 'last_fullsized': '2024-08-18T22:25:28.720145+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.686 INFO:tasks.ceph.ceph_manager.ceph:PG 16.12 is not active+clean 2024-08-18T22:25:33.686 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.721301+0000', 'last_change': '2024-08-18T22:25:27.721301+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.721301+0000', 'last_undegraded': '2024-08-18T22:25:27.721301+0000', 'last_fullsized': '2024-08-18T22:25:27.721301+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:25:33.686 INFO:tasks.ceph.ceph_manager.ceph:PG 16.13 is not active+clean 2024-08-18T22:25:33.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.727065+0000', 'last_change': '2024-08-18T22:25:27.727065+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.727065+0000', 'last_undegraded': '2024-08-18T22:25:27.727065+0000', 'last_fullsized': '2024-08-18T22:25:27.727065+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:25:33.687 INFO:tasks.ceph.ceph_manager.ceph:PG 16.14 is not active+clean 2024-08-18T22:25:33.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.718796+0000', 'last_change': '2024-08-18T22:25:28.718796+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.718796+0000', 'last_undegraded': '2024-08-18T22:25:28.718796+0000', 'last_fullsized': '2024-08-18T22:25:28.718796+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.687 INFO:tasks.ceph.ceph_manager.ceph:PG 16.15 is not active+clean 2024-08-18T22:25:33.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.719780+0000', 'last_change': '2024-08-18T22:25:28.719780+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.719780+0000', 'last_undegraded': '2024-08-18T22:25:28.719780+0000', 'last_fullsized': '2024-08-18T22:25:28.719780+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.687 INFO:tasks.ceph.ceph_manager.ceph:PG 16.16 is not active+clean 2024-08-18T22:25:33.687 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.724420+0000', 'last_change': '2024-08-18T22:25:27.724420+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.724420+0000', 'last_undegraded': '2024-08-18T22:25:27.724420+0000', 'last_fullsized': '2024-08-18T22:25:27.724420+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:25:33.687 INFO:tasks.ceph.ceph_manager.ceph:PG 16.18 is not active+clean 2024-08-18T22:25:33.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.718694+0000', 'last_change': '2024-08-18T22:25:28.718694+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.718694+0000', 'last_undegraded': '2024-08-18T22:25:28.718694+0000', 'last_fullsized': '2024-08-18T22:25:28.718694+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:25:33.688 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1a is not active+clean 2024-08-18T22:25:33.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.723453+0000', 'last_change': '2024-08-18T22:25:27.723453+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.723453+0000', 'last_undegraded': '2024-08-18T22:25:27.723453+0000', 'last_fullsized': '2024-08-18T22:25:27.723453+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:25:33.688 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1b is not active+clean 2024-08-18T22:25:33.688 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.726523+0000', 'last_change': '2024-08-18T22:25:27.726523+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.726523+0000', 'last_undegraded': '2024-08-18T22:25:27.726523+0000', 'last_fullsized': '2024-08-18T22:25:27.726523+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:25:33.689 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1e is not active+clean 2024-08-18T22:25:33.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 113, 'state': 'creating+activating', 'last_fresh': '2024-08-18T22:25:28.724635+0000', 'last_change': '2024-08-18T22:25:28.724635+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:28.724635+0000', 'last_undegraded': '2024-08-18T22:25:28.724635+0000', 'last_fullsized': '2024-08-18T22:25:28.724635+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:25:33.689 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1f is not active+clean 2024-08-18T22:25:33.689 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.725469+0000', 'last_change': '2024-08-18T22:25:27.725469+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.725469+0000', 'last_undegraded': '2024-08-18T22:25:27.725469+0000', 'last_fullsized': '2024-08-18T22:25:27.725469+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:25:33.689 INFO:tasks.ceph.ceph_manager.ceph:PG 16.11 is not active+clean 2024-08-18T22:25:33.690 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:25:27.725858+0000', 'last_change': '2024-08-18T22:25:27.725858+0000', 'last_active': '2024-08-18T22:25:27.710909+0000', 'last_peered': '2024-08-18T22:25:27.710909+0000', 'last_clean': '2024-08-18T22:25:27.710909+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:25:27.725858+0000', 'last_undegraded': '2024-08-18T22:25:27.725858+0000', 'last_fullsized': '2024-08-18T22:25:27.725858+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'last_clean_scrub_stamp': '2024-08-18T22:25:27.710909+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:25:33.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:25:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb3d600640 1 Processor -- start 2024-08-18T22:25:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb3d600640 1 -- start start 2024-08-18T22:25:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb3d600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffb38161960 0x7ffb3806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb3d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb38070730 0x7ffb38070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb3d600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb3815dda0 0x7ffb3815e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb3d600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ffb3815fcc0 con 0x7ffb3815dda0 2024-08-18T22:25:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb3d600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ffb380710b0 con 0x7ffb38161960 2024-08-18T22:25:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb3d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb3815eb60 con 0x7ffb38070730 2024-08-18T22:25:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb37400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb3815dda0 0x7ffb3815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb37400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffb3815dda0 0x7ffb3815e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47432/0 (socket says 172.21.15.5:47432) 2024-08-18T22:25:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb37400640 1 -- 172.21.15.5:0/3603230542 learned_addr learned my addr 172.21.15.5:0/3603230542 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb36a00640 1 --2- 172.21.15.5:0/3603230542 >> v2:172.21.15.117:3300/0 conn(0x7ffb38161960 0x7ffb3806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.857+0000 7ffb2e000640 1 --2- 172.21.15.5:0/3603230542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb38070730 0x7ffb38070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb37400640 1 -- 172.21.15.5:0/3603230542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb38070730 msgr2=0x7ffb38070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:33.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb37400640 1 --2- 172.21.15.5:0/3603230542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb38070730 0x7ffb38070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb37400640 1 -- 172.21.15.5:0/3603230542 >> v2:172.21.15.117:3300/0 conn(0x7ffb38161960 msgr2=0x7ffb3806fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb37400640 1 --2- 172.21.15.5:0/3603230542 >> v2:172.21.15.117:3300/0 conn(0x7ffb38161960 0x7ffb3806fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb37400640 1 -- 172.21.15.5:0/3603230542 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3815ee40 con 0x7ffb3815dda0 2024-08-18T22:25:33.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb36a00640 1 --2- 172.21.15.5:0/3603230542 >> v2:172.21.15.117:3300/0 conn(0x7ffb38161960 0x7ffb3806fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb37400640 1 --2- 172.21.15.5:0/3603230542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3815dda0 0x7ffb3815e250 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ffb38073070 tx=0x7ffb3001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc7f9c844a4295 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb36000640 1 -- 172.21.15.5:0/3603230542 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb300a5760 con 0x7ffb3815dda0 2024-08-18T22:25:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb36000640 1 -- 172.21.15.5:0/3603230542 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb300a5900 con 0x7ffb3815dda0 2024-08-18T22:25:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb36000640 1 -- 172.21.15.5:0/3603230542 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb300a5cd0 con 0x7ffb3815dda0 2024-08-18T22:25:33.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb3d600640 1 -- 172.21.15.5:0/3603230542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3815dda0 msgr2=0x7ffb3815e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb3d600640 1 --2- 172.21.15.5:0/3603230542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3815dda0 0x7ffb3815e250 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ffb38073070 tx=0x7ffb3001c9f0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb3d600640 1 -- 172.21.15.5:0/3603230542 shutdown_connections 2024-08-18T22:25:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb3d600640 1 --2- 172.21.15.5:0/3603230542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3815dda0 0x7ffb3815e250 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb3d600640 1 --2- 172.21.15.5:0/3603230542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb38070730 0x7ffb38070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb3d600640 1 --2- 172.21.15.5:0/3603230542 >> v2:172.21.15.117:3300/0 conn(0x7ffb38161960 0x7ffb3806fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb3d600640 1 -- 172.21.15.5:0/3603230542 >> 172.21.15.5:0/3603230542 conn(0x7ffb380d2130 msgr2=0x7ffb380d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb3d600640 1 -- 172.21.15.5:0/3603230542 shutdown_connections 2024-08-18T22:25:33.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.861+0000 7ffb3d600640 1 -- 172.21.15.5:0/3603230542 wait complete. 2024-08-18T22:25:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb3d600640 1 Processor -- start 2024-08-18T22:25:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb3d600640 1 -- start start 2024-08-18T22:25:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb3d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38070730 0x7ffb3809c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb3d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb3815dda0 0x7ffb380b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb3d600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38161960 0x7ffb380b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb3d600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3809ba30 con 0x7ffb38070730 2024-08-18T22:25:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb3d600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3815e790 con 0x7ffb38161960 2024-08-18T22:25:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb3d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb380b7d20 con 0x7ffb3815dda0 2024-08-18T22:25:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb36a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38070730 0x7ffb3809c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb36a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38070730 0x7ffb3809c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47442/0 (socket says 172.21.15.5:47442) 2024-08-18T22:25:33.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb36a00640 1 -- 172.21.15.5:0/1210386944 learned_addr learned my addr 172.21.15.5:0/1210386944 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:33.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb2e000640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb3815dda0 0x7ffb380b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb37400640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38161960 0x7ffb380b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb36a00640 1 -- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb3815dda0 msgr2=0x7ffb380b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb36a00640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb3815dda0 0x7ffb380b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb36a00640 1 -- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38161960 msgr2=0x7ffb380b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb36a00640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38161960 0x7ffb380b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb36a00640 1 -- 172.21.15.5:0/1210386944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3809f570 con 0x7ffb38070730 2024-08-18T22:25:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb37400640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38161960 0x7ffb380b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb36a00640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38070730 0x7ffb3809c2d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800d830 tx=0x7ffb2800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb2f400640 1 -- 172.21.15.5:0/1210386944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28018020 con 0x7ffb38070730 2024-08-18T22:25:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb2f400640 1 -- 172.21.15.5:0/1210386944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb280096c0 con 0x7ffb38070730 2024-08-18T22:25:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb2f400640 1 -- 172.21.15.5:0/1210386944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28009ab0 con 0x7ffb38070730 2024-08-18T22:25:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb3d600640 1 -- 172.21.15.5:0/1210386944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb380b7760 con 0x7ffb38070730 2024-08-18T22:25:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.865+0000 7ffb3d600640 1 -- 172.21.15.5:0/1210386944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb380c6d00 con 0x7ffb38070730 2024-08-18T22:25:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.869+0000 7ffb3d600640 1 -- 172.21.15.5:0/1210386944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb38070b70 con 0x7ffb38070730 2024-08-18T22:25:33.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.869+0000 7ffb2f400640 1 -- 172.21.15.5:0/1210386944 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb2801b020 con 0x7ffb38070730 2024-08-18T22:25:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.869+0000 7ffb2f400640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb140678c0 0x7ffb14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.869+0000 7ffb2f400640 1 -- 172.21.15.5:0/1210386944 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7ffb28086510 con 0x7ffb38070730 2024-08-18T22:25:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.869+0000 7ffb2e000640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb140678c0 0x7ffb14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.869+0000 7ffb2e000640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb140678c0 0x7ffb14069d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffb380b3b70 tx=0x7ffb20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:33.873+0000 7ffb2f400640 1 -- 172.21.15.5:0/1210386944 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ffb28022020 con 0x7ffb38070730 2024-08-18T22:25:34.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.097+0000 7ffb3d600640 1 -- 172.21.15.5:0/1210386944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ffb3809bbb0 con 0x7ffb38070730 2024-08-18T22:25:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb2f400640 1 -- 172.21.15.5:0/1210386944 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1606 (secure 0 0 0) 0x7ffb28056e60 con 0x7ffb38070730 2024-08-18T22:25:34.100 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:34.100 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":397,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":114,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":51},{"state_name":"creating+peering","count":30},{"state_name":"creating+activating","count":16}],"num_pgs":97,"num_pools":3,"num_objects":9,"data_bytes":590368,"bytes_used":323104768,"bytes_avail":772771008512,"bytes_total":773094113280,"inactive_pgs_ratio":0.47422680258750916,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":90,"btime":"2024-08-18T22:25:31:768933+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7752}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-08-18T22:25:15.710824+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:25:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 -- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb140678c0 msgr2=0x7ffb14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb140678c0 0x7ffb14069d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffb380b3b70 tx=0x7ffb20008040 comp rx=0 tx=0).stop 2024-08-18T22:25:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 -- 172.21.15.5:0/1210386944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38070730 msgr2=0x7ffb3809c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38070730 0x7ffb3809c2d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800d830 tx=0x7ffb2800dcf0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 -- 172.21.15.5:0/1210386944 shutdown_connections 2024-08-18T22:25:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb140678c0 0x7ffb14069d80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38161960 0x7ffb380b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb3815dda0 0x7ffb380b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 --2- 172.21.15.5:0/1210386944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb38070730 0x7ffb3809c2d0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 -- 172.21.15.5:0/1210386944 >> 172.21.15.5:0/1210386944 conn(0x7ffb380d2130 msgr2=0x7ffb3806fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 -- 172.21.15.5:0/1210386944 shutdown_connections 2024-08-18T22:25:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.101+0000 7ffb3d600640 1 -- 172.21.15.5:0/1210386944 wait complete. 2024-08-18T22:25:34.122 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-18T22:25:34.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:25:34.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.261+0000 7efc0a000640 1 Processor -- start 2024-08-18T22:25:34.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.261+0000 7efc0a000640 1 -- start start 2024-08-18T22:25:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc0a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc0415ff60 0x7efc040ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc0a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc04160780 0x7efc040ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc0a000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc040cff50 con 0x7efc04160340 2024-08-18T22:25:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc0a000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7efc040cfd00 con 0x7efc0415ff60 2024-08-18T22:25:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc0a000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efc040d0230 con 0x7efc04160780 2024-08-18T22:25:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc03400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc0415ff60 0x7efc040ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc03400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc0415ff60 0x7efc040ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47444/0 (socket says 172.21.15.5:47444) 2024-08-18T22:25:34.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc03400640 1 -- 172.21.15.5:0/366910729 learned_addr learned my addr 172.21.15.5:0/366910729 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:34.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc03e00640 1 --2- 172.21.15.5:0/366910729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc04160780 0x7efc040ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:34.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc03400640 1 -- 172.21.15.5:0/366910729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc04160780 msgr2=0x7efc040ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:34.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc03400640 1 --2- 172.21.15.5:0/366910729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc04160780 0x7efc040ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc03400640 1 -- 172.21.15.5:0/366910729 >> v1:172.21.15.117:6789/0 conn(0x7efc04160340 legacy=0x7efc0409b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:34.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc03400640 1 -- 172.21.15.5:0/366910729 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0409ab70 con 0x7efc0415ff60 2024-08-18T22:25:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.265+0000 7efc03400640 1 --2- 172.21.15.5:0/366910729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc0415ff60 0x7efc040ce610 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009870 tx=0x7efbf401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3345755a5d21f38d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc02a00640 1 -- 172.21.15.5:0/366910729 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf40b0070 con 0x7efc0415ff60 2024-08-18T22:25:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc02a00640 1 -- 172.21.15.5:0/366910729 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf40ab600 con 0x7efc0415ff60 2024-08-18T22:25:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc02a00640 1 -- 172.21.15.5:0/366910729 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf40ab9d0 con 0x7efc0415ff60 2024-08-18T22:25:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 -- 172.21.15.5:0/366910729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc0415ff60 msgr2=0x7efc040ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 --2- 172.21.15.5:0/366910729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc0415ff60 0x7efc040ce610 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009870 tx=0x7efbf401c440 comp rx=0 tx=0).stop 2024-08-18T22:25:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 -- 172.21.15.5:0/366910729 shutdown_connections 2024-08-18T22:25:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 --2- 172.21.15.5:0/366910729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc04160780 0x7efc040ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 --2- 172.21.15.5:0/366910729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc0415ff60 0x7efc040ce610 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 -- 172.21.15.5:0/366910729 >> 172.21.15.5:0/366910729 conn(0x7efc040d2130 msgr2=0x7efc040d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 -- 172.21.15.5:0/366910729 shutdown_connections 2024-08-18T22:25:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 -- 172.21.15.5:0/366910729 wait complete. 2024-08-18T22:25:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 Processor -- start 2024-08-18T22:25:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 -- start start 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc0415ff60 0x7efc04153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc04160340 0x7efc0415ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04160780 0x7efc0406e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efc041699d0 con 0x7efc04160780 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efc04169850 con 0x7efc0415ff60 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc0a000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efc04169b50 con 0x7efc04160340 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc03e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04160780 0x7efc0406e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc03e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04160780 0x7efc0406e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47458/0 (socket says 172.21.15.5:47458) 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.269+0000 7efc03e00640 1 -- 172.21.15.5:0/196814474 learned_addr learned my addr 172.21.15.5:0/196814474 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efc03400640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc0415ff60 0x7efc04153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efbfaa00640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc04160340 0x7efc0415ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efc03e00640 1 -- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc04160340 msgr2=0x7efc0415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efc03e00640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc04160340 0x7efc0415ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efc03e00640 1 -- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc0415ff60 msgr2=0x7efc04153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efc03e00640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc0415ff60 0x7efc04153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efc03e00640 1 -- 172.21.15.5:0/196814474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0415fb10 con 0x7efc04160780 2024-08-18T22:25:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efc03e00640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04160780 0x7efc0406e460 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7efbfc007e60 tx=0x7efbfc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efbfbe00640 1 -- 172.21.15.5:0/196814474 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc014420 con 0x7efc04160780 2024-08-18T22:25:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efbfbe00640 1 -- 172.21.15.5:0/196814474 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbfc019070 con 0x7efc04160780 2024-08-18T22:25:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efbfbe00640 1 -- 172.21.15.5:0/196814474 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc014820 con 0x7efc04160780 2024-08-18T22:25:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efc0a000640 1 -- 172.21.15.5:0/196814474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0406dca0 con 0x7efc04160780 2024-08-18T22:25:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efc0a000640 1 -- 172.21.15.5:0/196814474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0415f550 con 0x7efc04160780 2024-08-18T22:25:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efc0a000640 1 -- 172.21.15.5:0/196814474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc040ccc10 con 0x7efc04160780 2024-08-18T22:25:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.273+0000 7efbfbe00640 1 -- 172.21.15.5:0/196814474 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efbfc0149c0 con 0x7efc04160780 2024-08-18T22:25:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.277+0000 7efbfbe00640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efbe00678c0 0x7efbe0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.277+0000 7efbfbe00640 1 -- 172.21.15.5:0/196814474 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7efbfc086500 con 0x7efc04160780 2024-08-18T22:25:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.277+0000 7efc03400640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efbe00678c0 0x7efbe0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.277+0000 7efc03400640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efbe00678c0 0x7efbe0069d80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efbf40ad000 tx=0x7efbf40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.277+0000 7efbfbe00640 1 -- 172.21.15.5:0/196814474 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7efbfc056850 con 0x7efc04160780 2024-08-18T22:25:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.441+0000 7efc0a000640 1 -- 172.21.15.5:0/196814474 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc040d3010 con 0x7efbe00678c0 2024-08-18T22:25:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.445+0000 7efbfbe00640 1 -- 172.21.15.5:0/196814474 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248767 (secure 0 0 0) 0x7efc040d3010 con 0x7efbe00678c0 2024-08-18T22:25:34.449 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:25:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 -- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efbe00678c0 msgr2=0x7efbe0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efbe00678c0 0x7efbe0069d80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efbf40ad000 tx=0x7efbf40a6000 comp rx=0 tx=0).stop 2024-08-18T22:25:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 -- 172.21.15.5:0/196814474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04160780 msgr2=0x7efc0406e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04160780 0x7efc0406e460 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7efbfc007e60 tx=0x7efbfc00e4b0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 -- 172.21.15.5:0/196814474 shutdown_connections 2024-08-18T22:25:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efbe00678c0 0x7efbe0069d80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04160780 0x7efc0406e460 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc04160340 0x7efc0415ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 --2- 172.21.15.5:0/196814474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc0415ff60 0x7efc04153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 -- 172.21.15.5:0/196814474 >> 172.21.15.5:0/196814474 conn(0x7efc040d2130 msgr2=0x7efc0409b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 -- 172.21.15.5:0/196814474 shutdown_connections 2024-08-18T22:25:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:34.449+0000 7efc0a000640 1 -- 172.21.15.5:0/196814474 wait complete. 2024-08-18T22:25:34.470 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2024-08-18T22:25:33.714785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315532,"kb_used_data":11992,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754659188,"statfs":{"total":773094113280,"available":772771008512,"internally_reserved":0,"allocated":12279808,"data_stored":6367320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001504"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719829+0000","last_change":"2024-08-18T22:25:28.719829+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719829+0000","last_undegraded":"2024-08-18T22:25:28.719829+0000","last_fullsized":"2024-08-18T22:25:28.719829+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726659+0000","last_change":"2024-08-18T22:25:27.726659+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726659+0000","last_undegraded":"2024-08-18T22:25:27.726659+0000","last_fullsized":"2024-08-18T22:25:27.726659+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719007+0000","last_change":"2024-08-18T22:25:28.719007+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719007+0000","last_undegraded":"2024-08-18T22:25:28.719007+0000","last_fullsized":"2024-08-18T22:25:28.719007+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725301+0000","last_change":"2024-08-18T22:25:27.725301+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725301+0000","last_undegraded":"2024-08-18T22:25:27.725301+0000","last_fullsized":"2024-08-18T22:25:27.725301+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.727488+0000","last_change":"2024-08-18T22:25:27.727488+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.727488+0000","last_undegraded":"2024-08-18T22:25:27.727488+0000","last_fullsized":"2024-08-18T22:25:27.727488+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725863+0000","last_change":"2024-08-18T22:25:27.725863+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725863+0000","last_undegraded":"2024-08-18T22:25:27.725863+0000","last_fullsized":"2024-08-18T22:25:27.725863+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724743+0000","last_change":"2024-08-18T22:25:27.724743+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724743+0000","last_undegraded":"2024-08-18T22:25:27.724743+0000","last_fullsized":"2024-08-18T22:25:27.724743+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.746487+0000","last_change":"2024-08-18T22:25:28.744499+0000","last_active":"2024-08-18T22:25:28.746487+0000","last_peered":"2024-08-18T22:25:28.746487+0000","last_clean":"2024-08-18T22:25:28.746487+0000","last_became_active":"2024-08-18T22:25:28.743063+0000","last_became_peered":"2024-08-18T22:25:28.743063+0000","last_unstale":"2024-08-18T22:25:28.746487+0000","last_undegraded":"2024-08-18T22:25:28.746487+0000","last_fullsized":"2024-08-18T22:25:28.746487+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:24:21.676787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725309+0000","last_change":"2024-08-18T22:25:27.725309+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725309+0000","last_undegraded":"2024-08-18T22:25:27.725309+0000","last_fullsized":"2024-08-18T22:25:27.725309+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.728172+0000","last_change":"2024-08-18T22:25:27.728172+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.728172+0000","last_undegraded":"2024-08-18T22:25:27.728172+0000","last_fullsized":"2024-08-18T22:25:27.728172+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725169+0000","last_change":"2024-08-18T22:25:27.725169+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725169+0000","last_undegraded":"2024-08-18T22:25:27.725169+0000","last_fullsized":"2024-08-18T22:25:27.725169+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721628+0000","last_change":"2024-08-18T22:25:28.727214+0000","last_active":"2024-08-18T22:25:29.721628+0000","last_peered":"2024-08-18T22:25:29.721628+0000","last_clean":"2024-08-18T22:25:29.721628+0000","last_became_active":"2024-08-18T22:25:28.726957+0000","last_became_peered":"2024-08-18T22:25:28.726957+0000","last_unstale":"2024-08-18T22:25:29.721628+0000","last_undegraded":"2024-08-18T22:25:29.721628+0000","last_fullsized":"2024-08-18T22:25:29.721628+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:14:19.239308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.722578+0000","last_change":"2024-08-18T22:25:27.722578+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.722578+0000","last_undegraded":"2024-08-18T22:25:27.722578+0000","last_fullsized":"2024-08-18T22:25:27.722578+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.724142+0000","last_change":"2024-08-18T22:25:28.724142+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.724142+0000","last_undegraded":"2024-08-18T22:25:28.724142+0000","last_fullsized":"2024-08-18T22:25:28.724142+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.721265+0000","last_change":"2024-08-18T22:25:28.721265+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.721265+0000","last_undegraded":"2024-08-18T22:25:28.721265+0000","last_fullsized":"2024-08-18T22:25:28.721265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720510+0000","last_change":"2024-08-18T22:25:28.720510+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720510+0000","last_undegraded":"2024-08-18T22:25:28.720510+0000","last_fullsized":"2024-08-18T22:25:28.720510+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719867+0000","last_change":"2024-08-18T22:25:28.719867+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719867+0000","last_undegraded":"2024-08-18T22:25:28.719867+0000","last_fullsized":"2024-08-18T22:25:28.719867+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725108+0000","last_change":"2024-08-18T22:25:27.725108+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725108+0000","last_undegraded":"2024-08-18T22:25:27.725108+0000","last_fullsized":"2024-08-18T22:25:27.725108+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719417+0000","last_change":"2024-08-18T22:25:28.719417+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719417+0000","last_undegraded":"2024-08-18T22:25:28.719417+0000","last_fullsized":"2024-08-18T22:25:28.719417+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721622+0000","last_change":"2024-08-18T22:25:28.732094+0000","last_active":"2024-08-18T22:25:29.721622+0000","last_peered":"2024-08-18T22:25:29.721622+0000","last_clean":"2024-08-18T22:25:29.721622+0000","last_became_active":"2024-08-18T22:25:28.731793+0000","last_became_peered":"2024-08-18T22:25:28.731793+0000","last_unstale":"2024-08-18T22:25:29.721622+0000","last_undegraded":"2024-08-18T22:25:29.721622+0000","last_fullsized":"2024-08-18T22:25:29.721622+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:14.636263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741550+0000","last_change":"2024-08-18T22:25:28.738637+0000","last_active":"2024-08-18T22:25:28.741550+0000","last_peered":"2024-08-18T22:25:28.741550+0000","last_clean":"2024-08-18T22:25:28.741550+0000","last_became_active":"2024-08-18T22:25:28.738343+0000","last_became_peered":"2024-08-18T22:25:28.738343+0000","last_unstale":"2024-08-18T22:25:28.741550+0000","last_undegraded":"2024-08-18T22:25:28.741550+0000","last_fullsized":"2024-08-18T22:25:28.741550+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:23.737329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.722602+0000","last_change":"2024-08-18T22:25:27.722602+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.722602+0000","last_undegraded":"2024-08-18T22:25:27.722602+0000","last_fullsized":"2024-08-18T22:25:27.722602+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718940+0000","last_change":"2024-08-18T22:25:28.718940+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718940+0000","last_undegraded":"2024-08-18T22:25:28.718940+0000","last_fullsized":"2024-08-18T22:25:28.718940+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723134+0000","last_change":"2024-08-18T22:25:27.723134+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723134+0000","last_undegraded":"2024-08-18T22:25:27.723134+0000","last_fullsized":"2024-08-18T22:25:27.723134+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721661+0000","last_change":"2024-08-18T22:25:28.737468+0000","last_active":"2024-08-18T22:25:29.721661+0000","last_peered":"2024-08-18T22:25:29.721661+0000","last_clean":"2024-08-18T22:25:29.721661+0000","last_became_active":"2024-08-18T22:25:28.734632+0000","last_became_peered":"2024-08-18T22:25:28.734632+0000","last_unstale":"2024-08-18T22:25:29.721661+0000","last_undegraded":"2024-08-18T22:25:29.721661+0000","last_fullsized":"2024-08-18T22:25:29.721661+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:05.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721571+0000","last_change":"2024-08-18T22:25:28.735178+0000","last_active":"2024-08-18T22:25:29.721571+0000","last_peered":"2024-08-18T22:25:29.721571+0000","last_clean":"2024-08-18T22:25:29.721571+0000","last_became_active":"2024-08-18T22:25:28.734914+0000","last_became_peered":"2024-08-18T22:25:28.734914+0000","last_unstale":"2024-08-18T22:25:29.721571+0000","last_undegraded":"2024-08-18T22:25:29.721571+0000","last_fullsized":"2024-08-18T22:25:29.721571+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:03:03.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724715+0000","last_change":"2024-08-18T22:25:27.724715+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724715+0000","last_undegraded":"2024-08-18T22:25:27.724715+0000","last_fullsized":"2024-08-18T22:25:27.724715+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724171+0000","last_change":"2024-08-18T22:25:27.724171+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724171+0000","last_undegraded":"2024-08-18T22:25:27.724171+0000","last_fullsized":"2024-08-18T22:25:27.724171+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741567+0000","last_change":"2024-08-18T22:25:28.738595+0000","last_active":"2024-08-18T22:25:28.741567+0000","last_peered":"2024-08-18T22:25:28.741567+0000","last_clean":"2024-08-18T22:25:28.741567+0000","last_became_active":"2024-08-18T22:25:28.738274+0000","last_became_peered":"2024-08-18T22:25:28.738274+0000","last_unstale":"2024-08-18T22:25:28.741567+0000","last_undegraded":"2024-08-18T22:25:28.741567+0000","last_fullsized":"2024-08-18T22:25:28.741567+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:07:46.453256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721136+0000","last_change":"2024-08-18T22:25:28.732585+0000","last_active":"2024-08-18T22:25:29.721136+0000","last_peered":"2024-08-18T22:25:29.721136+0000","last_clean":"2024-08-18T22:25:29.721136+0000","last_became_active":"2024-08-18T22:25:28.731808+0000","last_became_peered":"2024-08-18T22:25:28.731808+0000","last_unstale":"2024-08-18T22:25:29.721136+0000","last_undegraded":"2024-08-18T22:25:29.721136+0000","last_fullsized":"2024-08-18T22:25:29.721136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:42:03.700694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721317+0000","last_change":"2024-08-18T22:25:27.721317+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721317+0000","last_undegraded":"2024-08-18T22:25:27.721317+0000","last_fullsized":"2024-08-18T22:25:27.721317+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.744420+0000","last_change":"2024-08-18T22:25:28.738517+0000","last_active":"2024-08-18T22:25:28.744420+0000","last_peered":"2024-08-18T22:25:28.744420+0000","last_clean":"2024-08-18T22:25:28.744420+0000","last_became_active":"2024-08-18T22:25:28.738224+0000","last_became_peered":"2024-08-18T22:25:28.738224+0000","last_unstale":"2024-08-18T22:25:28.744420+0000","last_undegraded":"2024-08-18T22:25:28.744420+0000","last_fullsized":"2024-08-18T22:25:28.744420+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:12:30.173542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719070+0000","last_change":"2024-08-18T22:25:28.719070+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719070+0000","last_undegraded":"2024-08-18T22:25:28.719070+0000","last_fullsized":"2024-08-18T22:25:28.719070+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739789+0000","last_change":"2024-08-18T22:25:27.738154+0000","last_active":"2024-08-18T22:25:27.739789+0000","last_peered":"2024-08-18T22:25:27.739789+0000","last_clean":"2024-08-18T22:25:27.739789+0000","last_became_active":"2024-08-18T22:25:27.737885+0000","last_became_peered":"2024-08-18T22:25:27.737885+0000","last_unstale":"2024-08-18T22:25:27.739789+0000","last_undegraded":"2024-08-18T22:25:27.739789+0000","last_fullsized":"2024-08-18T22:25:27.739789+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:05.409913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.740290+0000","last_change":"2024-08-18T22:25:28.736655+0000","last_active":"2024-08-18T22:25:28.740290+0000","last_peered":"2024-08-18T22:25:28.740290+0000","last_clean":"2024-08-18T22:25:28.740290+0000","last_became_active":"2024-08-18T22:25:28.736388+0000","last_became_peered":"2024-08-18T22:25:28.736388+0000","last_unstale":"2024-08-18T22:25:28.740290+0000","last_undegraded":"2024-08-18T22:25:28.740290+0000","last_fullsized":"2024-08-18T22:25:28.740290+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:07:46.806767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"113'1","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.762168+0000","last_change":"2024-08-18T22:25:27.744782+0000","last_active":"2024-08-18T22:25:28.762168+0000","last_peered":"2024-08-18T22:25:28.762168+0000","last_clean":"2024-08-18T22:25:28.762168+0000","last_became_active":"2024-08-18T22:25:27.744174+0000","last_became_peered":"2024-08-18T22:25:27.744174+0000","last_unstale":"2024-08-18T22:25:28.762168+0000","last_undegraded":"2024-08-18T22:25:28.762168+0000","last_fullsized":"2024-08-18T22:25:28.762168+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:59.111032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721203+0000","last_change":"2024-08-18T22:25:28.729447+0000","last_active":"2024-08-18T22:25:29.721203+0000","last_peered":"2024-08-18T22:25:29.721203+0000","last_clean":"2024-08-18T22:25:29.721203+0000","last_became_active":"2024-08-18T22:25:28.727894+0000","last_became_peered":"2024-08-18T22:25:28.727894+0000","last_unstale":"2024-08-18T22:25:29.721203+0000","last_undegraded":"2024-08-18T22:25:29.721203+0000","last_fullsized":"2024-08-18T22:25:29.721203+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:49:11.616903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721307+0000","last_change":"2024-08-18T22:25:27.733672+0000","last_active":"2024-08-18T22:25:29.721307+0000","last_peered":"2024-08-18T22:25:29.721307+0000","last_clean":"2024-08-18T22:25:29.721307+0000","last_became_active":"2024-08-18T22:25:27.733366+0000","last_became_peered":"2024-08-18T22:25:27.733366+0000","last_unstale":"2024-08-18T22:25:29.721307+0000","last_undegraded":"2024-08-18T22:25:29.721307+0000","last_fullsized":"2024-08-18T22:25:29.721307+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:13.034285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726086+0000","last_change":"2024-08-18T22:25:27.726086+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726086+0000","last_undegraded":"2024-08-18T22:25:27.726086+0000","last_fullsized":"2024-08-18T22:25:27.726086+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739683+0000","last_change":"2024-08-18T22:25:27.737506+0000","last_active":"2024-08-18T22:25:27.739683+0000","last_peered":"2024-08-18T22:25:27.739683+0000","last_clean":"2024-08-18T22:25:27.739683+0000","last_became_active":"2024-08-18T22:25:27.737232+0000","last_became_peered":"2024-08-18T22:25:27.737232+0000","last_unstale":"2024-08-18T22:25:27.739683+0000","last_undegraded":"2024-08-18T22:25:27.739683+0000","last_fullsized":"2024-08-18T22:25:27.739683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:21.441375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724880+0000","last_change":"2024-08-18T22:25:27.724880+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724880+0000","last_undegraded":"2024-08-18T22:25:27.724880+0000","last_fullsized":"2024-08-18T22:25:27.724880+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724102+0000","last_change":"2024-08-18T22:25:27.734402+0000","last_active":"2024-08-18T22:25:28.724102+0000","last_peered":"2024-08-18T22:25:28.724102+0000","last_clean":"2024-08-18T22:25:28.724102+0000","last_became_active":"2024-08-18T22:25:27.733634+0000","last_became_peered":"2024-08-18T22:25:27.733634+0000","last_unstale":"2024-08-18T22:25:28.724102+0000","last_undegraded":"2024-08-18T22:25:28.724102+0000","last_fullsized":"2024-08-18T22:25:28.724102+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:18.699215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720476+0000","last_change":"2024-08-18T22:25:28.720476+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720476+0000","last_undegraded":"2024-08-18T22:25:28.720476+0000","last_fullsized":"2024-08-18T22:25:28.720476+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.735298+0000","last_change":"2024-08-18T22:25:27.731859+0000","last_active":"2024-08-18T22:25:27.735298+0000","last_peered":"2024-08-18T22:25:27.735298+0000","last_clean":"2024-08-18T22:25:27.735298+0000","last_became_active":"2024-08-18T22:25:27.731366+0000","last_became_peered":"2024-08-18T22:25:27.731366+0000","last_unstale":"2024-08-18T22:25:27.735298+0000","last_undegraded":"2024-08-18T22:25:27.735298+0000","last_fullsized":"2024-08-18T22:25:27.735298+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:00.986288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721343+0000","last_change":"2024-08-18T22:25:27.721343+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721343+0000","last_undegraded":"2024-08-18T22:25:27.721343+0000","last_fullsized":"2024-08-18T22:25:27.721343+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720400+0000","last_change":"2024-08-18T22:25:27.738161+0000","last_active":"2024-08-18T22:25:29.720400+0000","last_peered":"2024-08-18T22:25:29.720400+0000","last_clean":"2024-08-18T22:25:29.720400+0000","last_became_active":"2024-08-18T22:25:27.737855+0000","last_became_peered":"2024-08-18T22:25:27.737855+0000","last_unstale":"2024-08-18T22:25:29.720400+0000","last_undegraded":"2024-08-18T22:25:29.720400+0000","last_fullsized":"2024-08-18T22:25:29.720400+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:42:10.877593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726107+0000","last_change":"2024-08-18T22:25:27.726107+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726107+0000","last_undegraded":"2024-08-18T22:25:27.726107+0000","last_fullsized":"2024-08-18T22:25:27.726107+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739758+0000","last_change":"2024-08-18T22:25:27.736484+0000","last_active":"2024-08-18T22:25:27.739758+0000","last_peered":"2024-08-18T22:25:27.739758+0000","last_clean":"2024-08-18T22:25:27.739758+0000","last_became_active":"2024-08-18T22:25:27.736159+0000","last_became_peered":"2024-08-18T22:25:27.736159+0000","last_unstale":"2024-08-18T22:25:27.739758+0000","last_undegraded":"2024-08-18T22:25:27.739758+0000","last_fullsized":"2024-08-18T22:25:27.739758+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:47.068872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718749+0000","last_change":"2024-08-18T22:25:28.718749+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718749+0000","last_undegraded":"2024-08-18T22:25:28.718749+0000","last_fullsized":"2024-08-18T22:25:28.718749+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721458+0000","last_change":"2024-08-18T22:25:27.736398+0000","last_active":"2024-08-18T22:25:29.721458+0000","last_peered":"2024-08-18T22:25:29.721458+0000","last_clean":"2024-08-18T22:25:29.721458+0000","last_became_active":"2024-08-18T22:25:27.735991+0000","last_became_peered":"2024-08-18T22:25:27.735991+0000","last_unstale":"2024-08-18T22:25:29.721458+0000","last_undegraded":"2024-08-18T22:25:29.721458+0000","last_fullsized":"2024-08-18T22:25:29.721458+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.681647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723136+0000","last_change":"2024-08-18T22:25:27.723136+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723136+0000","last_undegraded":"2024-08-18T22:25:27.723136+0000","last_fullsized":"2024-08-18T22:25:27.723136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.719184+0000","last_change":"2024-08-18T22:25:27.740411+0000","last_active":"2024-08-18T22:25:28.719184+0000","last_peered":"2024-08-18T22:25:28.719184+0000","last_clean":"2024-08-18T22:25:28.719184+0000","last_became_active":"2024-08-18T22:25:27.740044+0000","last_became_peered":"2024-08-18T22:25:27.740044+0000","last_unstale":"2024-08-18T22:25:28.719184+0000","last_undegraded":"2024-08-18T22:25:28.719184+0000","last_fullsized":"2024-08-18T22:25:28.719184+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:26:05.404663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.743068+0000","last_change":"2024-08-18T22:25:28.740188+0000","last_active":"2024-08-18T22:25:28.743068+0000","last_peered":"2024-08-18T22:25:28.743068+0000","last_clean":"2024-08-18T22:25:28.743068+0000","last_became_active":"2024-08-18T22:25:28.739904+0000","last_became_peered":"2024-08-18T22:25:28.739904+0000","last_unstale":"2024-08-18T22:25:28.743068+0000","last_undegraded":"2024-08-18T22:25:28.743068+0000","last_fullsized":"2024-08-18T22:25:28.743068+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:14:29.817257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724154+0000","last_change":"2024-08-18T22:25:27.737622+0000","last_active":"2024-08-18T22:25:28.724154+0000","last_peered":"2024-08-18T22:25:28.724154+0000","last_clean":"2024-08-18T22:25:28.724154+0000","last_became_active":"2024-08-18T22:25:27.737354+0000","last_became_peered":"2024-08-18T22:25:27.737354+0000","last_unstale":"2024-08-18T22:25:28.724154+0000","last_undegraded":"2024-08-18T22:25:28.724154+0000","last_fullsized":"2024-08-18T22:25:28.724154+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:35.786573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723893+0000","last_change":"2024-08-18T22:25:27.723893+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723893+0000","last_undegraded":"2024-08-18T22:25:27.723893+0000","last_fullsized":"2024-08-18T22:25:27.723893+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.741090+0000","last_change":"2024-08-18T22:25:27.738707+0000","last_active":"2024-08-18T22:25:27.741090+0000","last_peered":"2024-08-18T22:25:27.741090+0000","last_clean":"2024-08-18T22:25:27.741090+0000","last_became_active":"2024-08-18T22:25:27.738399+0000","last_became_peered":"2024-08-18T22:25:27.738399+0000","last_unstale":"2024-08-18T22:25:27.741090+0000","last_undegraded":"2024-08-18T22:25:27.741090+0000","last_fullsized":"2024-08-18T22:25:27.741090+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:59.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723792+0000","last_change":"2024-08-18T22:25:27.723792+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723792+0000","last_undegraded":"2024-08-18T22:25:27.723792+0000","last_fullsized":"2024-08-18T22:25:27.723792+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.744713+0000","last_change":"2024-08-18T22:25:27.743973+0000","last_active":"2024-08-18T22:25:27.744713+0000","last_peered":"2024-08-18T22:25:27.744713+0000","last_clean":"2024-08-18T22:25:27.744713+0000","last_became_active":"2024-08-18T22:25:27.743650+0000","last_became_peered":"2024-08-18T22:25:27.743650+0000","last_unstale":"2024-08-18T22:25:27.744713+0000","last_undegraded":"2024-08-18T22:25:27.744713+0000","last_fullsized":"2024-08-18T22:25:27.744713+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:57.080994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721308+0000","last_change":"2024-08-18T22:25:27.721308+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721308+0000","last_undegraded":"2024-08-18T22:25:27.721308+0000","last_fullsized":"2024-08-18T22:25:27.721308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.739723+0000","last_change":"2024-08-18T22:25:27.736833+0000","last_active":"2024-08-18T22:25:27.739723+0000","last_peered":"2024-08-18T22:25:27.739723+0000","last_clean":"2024-08-18T22:25:27.739723+0000","last_became_active":"2024-08-18T22:25:27.736456+0000","last_became_peered":"2024-08-18T22:25:27.736456+0000","last_unstale":"2024-08-18T22:25:27.739723+0000","last_undegraded":"2024-08-18T22:25:27.739723+0000","last_fullsized":"2024-08-18T22:25:27.739723+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:03.142020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.743792+0000","last_change":"2024-08-18T22:25:28.739981+0000","last_active":"2024-08-18T22:25:28.743792+0000","last_peered":"2024-08-18T22:25:28.743792+0000","last_clean":"2024-08-18T22:25:28.743792+0000","last_became_active":"2024-08-18T22:25:28.738317+0000","last_became_peered":"2024-08-18T22:25:28.738317+0000","last_unstale":"2024-08-18T22:25:28.743792+0000","last_undegraded":"2024-08-18T22:25:28.743792+0000","last_fullsized":"2024-08-18T22:25:28.743792+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:34.358754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.729238+0000","last_change":"2024-08-18T22:25:27.743028+0000","last_active":"2024-08-18T22:25:28.729238+0000","last_peered":"2024-08-18T22:25:28.729238+0000","last_clean":"2024-08-18T22:25:28.729238+0000","last_became_active":"2024-08-18T22:25:27.742106+0000","last_became_peered":"2024-08-18T22:25:27.742106+0000","last_unstale":"2024-08-18T22:25:28.729238+0000","last_undegraded":"2024-08-18T22:25:28.729238+0000","last_fullsized":"2024-08-18T22:25:28.729238+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:56.157132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.720145+0000","last_change":"2024-08-18T22:25:28.720145+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.720145+0000","last_undegraded":"2024-08-18T22:25:28.720145+0000","last_fullsized":"2024-08-18T22:25:28.720145+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720737+0000","last_change":"2024-08-18T22:25:27.738551+0000","last_active":"2024-08-18T22:25:29.720737+0000","last_peered":"2024-08-18T22:25:29.720737+0000","last_clean":"2024-08-18T22:25:29.720737+0000","last_became_active":"2024-08-18T22:25:27.737360+0000","last_became_peered":"2024-08-18T22:25:27.737360+0000","last_unstale":"2024-08-18T22:25:29.720737+0000","last_undegraded":"2024-08-18T22:25:29.720737+0000","last_fullsized":"2024-08-18T22:25:29.720737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:54:38.492348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.744395+0000","last_change":"2024-08-18T22:25:28.737712+0000","last_active":"2024-08-18T22:25:28.744395+0000","last_peered":"2024-08-18T22:25:28.744395+0000","last_clean":"2024-08-18T22:25:28.744395+0000","last_became_active":"2024-08-18T22:25:28.737443+0000","last_became_peered":"2024-08-18T22:25:28.737443+0000","last_unstale":"2024-08-18T22:25:28.744395+0000","last_undegraded":"2024-08-18T22:25:28.744395+0000","last_fullsized":"2024-08-18T22:25:28.744395+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:17.054695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.734543+0000","last_change":"2024-08-18T22:25:27.728904+0000","last_active":"2024-08-18T22:25:27.734543+0000","last_peered":"2024-08-18T22:25:27.734543+0000","last_clean":"2024-08-18T22:25:27.734543+0000","last_became_active":"2024-08-18T22:25:27.728636+0000","last_became_peered":"2024-08-18T22:25:27.728636+0000","last_unstale":"2024-08-18T22:25:27.734543+0000","last_undegraded":"2024-08-18T22:25:27.734543+0000","last_fullsized":"2024-08-18T22:25:27.734543+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:49:57.080994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.721301+0000","last_change":"2024-08-18T22:25:27.721301+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.721301+0000","last_undegraded":"2024-08-18T22:25:27.721301+0000","last_fullsized":"2024-08-18T22:25:27.721301+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.724314+0000","last_change":"2024-08-18T22:25:27.729731+0000","last_active":"2024-08-18T22:25:28.724314+0000","last_peered":"2024-08-18T22:25:28.724314+0000","last_clean":"2024-08-18T22:25:28.724314+0000","last_became_active":"2024-08-18T22:25:27.729336+0000","last_became_peered":"2024-08-18T22:25:27.729336+0000","last_unstale":"2024-08-18T22:25:28.724314+0000","last_undegraded":"2024-08-18T22:25:28.724314+0000","last_fullsized":"2024-08-18T22:25:28.724314+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:53.446928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.727065+0000","last_change":"2024-08-18T22:25:27.727065+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.727065+0000","last_undegraded":"2024-08-18T22:25:27.727065+0000","last_fullsized":"2024-08-18T22:25:27.727065+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.738837+0000","last_change":"2024-08-18T22:25:27.735677+0000","last_active":"2024-08-18T22:25:27.738837+0000","last_peered":"2024-08-18T22:25:27.738837+0000","last_clean":"2024-08-18T22:25:27.738837+0000","last_became_active":"2024-08-18T22:25:27.735124+0000","last_became_peered":"2024-08-18T22:25:27.735124+0000","last_unstale":"2024-08-18T22:25:27.738837+0000","last_undegraded":"2024-08-18T22:25:27.738837+0000","last_fullsized":"2024-08-18T22:25:27.738837+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:31.547107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718796+0000","last_change":"2024-08-18T22:25:28.718796+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718796+0000","last_undegraded":"2024-08-18T22:25:28.718796+0000","last_fullsized":"2024-08-18T22:25:28.718796+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"113'2","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.758597+0000","last_change":"2024-08-18T22:25:27.740165+0000","last_active":"2024-08-18T22:25:28.758597+0000","last_peered":"2024-08-18T22:25:28.758597+0000","last_clean":"2024-08-18T22:25:28.758597+0000","last_became_active":"2024-08-18T22:25:27.736854+0000","last_became_peered":"2024-08-18T22:25:27.736854+0000","last_unstale":"2024-08-18T22:25:28.758597+0000","last_undegraded":"2024-08-18T22:25:28.758597+0000","last_fullsized":"2024-08-18T22:25:28.758597+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:42:12.311494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.719780+0000","last_change":"2024-08-18T22:25:28.719780+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.719780+0000","last_undegraded":"2024-08-18T22:25:28.719780+0000","last_fullsized":"2024-08-18T22:25:28.719780+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.730023+0000","last_change":"2024-08-18T22:25:27.743195+0000","last_active":"2024-08-18T22:25:28.730023+0000","last_peered":"2024-08-18T22:25:28.730023+0000","last_clean":"2024-08-18T22:25:28.730023+0000","last_became_active":"2024-08-18T22:25:27.742876+0000","last_became_peered":"2024-08-18T22:25:27.742876+0000","last_unstale":"2024-08-18T22:25:28.730023+0000","last_undegraded":"2024-08-18T22:25:28.730023+0000","last_fullsized":"2024-08-18T22:25:28.730023+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:34.262887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.724420+0000","last_change":"2024-08-18T22:25:27.724420+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.724420+0000","last_undegraded":"2024-08-18T22:25:27.724420+0000","last_fullsized":"2024-08-18T22:25:27.724420+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.737580+0000","last_change":"2024-08-18T22:25:27.729602+0000","last_active":"2024-08-18T22:25:27.737580+0000","last_peered":"2024-08-18T22:25:27.737580+0000","last_clean":"2024-08-18T22:25:27.737580+0000","last_became_active":"2024-08-18T22:25:27.729342+0000","last_became_peered":"2024-08-18T22:25:27.729342+0000","last_unstale":"2024-08-18T22:25:27.737580+0000","last_undegraded":"2024-08-18T22:25:27.737580+0000","last_fullsized":"2024-08-18T22:25:27.737580+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:38.345310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.739416+0000","last_change":"2024-08-18T22:25:28.735821+0000","last_active":"2024-08-18T22:25:28.739416+0000","last_peered":"2024-08-18T22:25:28.739416+0000","last_clean":"2024-08-18T22:25:28.739416+0000","last_became_active":"2024-08-18T22:25:28.735547+0000","last_became_peered":"2024-08-18T22:25:28.735547+0000","last_unstale":"2024-08-18T22:25:28.739416+0000","last_undegraded":"2024-08-18T22:25:28.739416+0000","last_fullsized":"2024-08-18T22:25:28.739416+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:11.104170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.731246+0000","last_change":"2024-08-18T22:25:27.739921+0000","last_active":"2024-08-18T22:25:28.731246+0000","last_peered":"2024-08-18T22:25:28.731246+0000","last_clean":"2024-08-18T22:25:28.731246+0000","last_became_active":"2024-08-18T22:25:27.739634+0000","last_became_peered":"2024-08-18T22:25:27.739634+0000","last_unstale":"2024-08-18T22:25:28.731246+0000","last_undegraded":"2024-08-18T22:25:28.731246+0000","last_fullsized":"2024-08-18T22:25:28.731246+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:48.519152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.718694+0000","last_change":"2024-08-18T22:25:28.718694+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.718694+0000","last_undegraded":"2024-08-18T22:25:28.718694+0000","last_fullsized":"2024-08-18T22:25:28.718694+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.745206+0000","last_change":"2024-08-18T22:25:27.744272+0000","last_active":"2024-08-18T22:25:27.745206+0000","last_peered":"2024-08-18T22:25:27.745206+0000","last_clean":"2024-08-18T22:25:27.745206+0000","last_became_active":"2024-08-18T22:25:27.744026+0000","last_became_peered":"2024-08-18T22:25:27.744026+0000","last_unstale":"2024-08-18T22:25:27.745206+0000","last_undegraded":"2024-08-18T22:25:27.745206+0000","last_fullsized":"2024-08-18T22:25:27.745206+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:38.345310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720287+0000","last_change":"2024-08-18T22:25:28.728579+0000","last_active":"2024-08-18T22:25:29.720287+0000","last_peered":"2024-08-18T22:25:29.720287+0000","last_clean":"2024-08-18T22:25:29.720287+0000","last_became_active":"2024-08-18T22:25:28.728302+0000","last_became_peered":"2024-08-18T22:25:28.728302+0000","last_unstale":"2024-08-18T22:25:29.720287+0000","last_undegraded":"2024-08-18T22:25:29.720287+0000","last_fullsized":"2024-08-18T22:25:29.720287+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:15.603682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.719343+0000","last_change":"2024-08-18T22:25:27.738515+0000","last_active":"2024-08-18T22:25:28.719343+0000","last_peered":"2024-08-18T22:25:28.719343+0000","last_clean":"2024-08-18T22:25:28.719343+0000","last_became_active":"2024-08-18T22:25:27.738233+0000","last_became_peered":"2024-08-18T22:25:27.738233+0000","last_unstale":"2024-08-18T22:25:28.719343+0000","last_undegraded":"2024-08-18T22:25:28.719343+0000","last_fullsized":"2024-08-18T22:25:28.719343+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:06.452774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.723453+0000","last_change":"2024-08-18T22:25:27.723453+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.723453+0000","last_undegraded":"2024-08-18T22:25:27.723453+0000","last_fullsized":"2024-08-18T22:25:27.723453+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.740920+0000","last_change":"2024-08-18T22:25:27.736974+0000","last_active":"2024-08-18T22:25:27.740920+0000","last_peered":"2024-08-18T22:25:27.740920+0000","last_clean":"2024-08-18T22:25:27.740920+0000","last_became_active":"2024-08-18T22:25:27.736651+0000","last_became_peered":"2024-08-18T22:25:27.736651+0000","last_unstale":"2024-08-18T22:25:27.740920+0000","last_undegraded":"2024-08-18T22:25:27.740920+0000","last_fullsized":"2024-08-18T22:25:27.740920+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:55:00.779397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.726523+0000","last_change":"2024-08-18T22:25:27.726523+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.726523+0000","last_undegraded":"2024-08-18T22:25:27.726523+0000","last_fullsized":"2024-08-18T22:25:27.726523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.742177+0000","last_change":"2024-08-18T22:25:27.741264+0000","last_active":"2024-08-18T22:25:27.742177+0000","last_peered":"2024-08-18T22:25:27.742177+0000","last_clean":"2024-08-18T22:25:27.742177+0000","last_became_active":"2024-08-18T22:25:27.740478+0000","last_became_peered":"2024-08-18T22:25:27.740478+0000","last_unstale":"2024-08-18T22:25:27.742177+0000","last_undegraded":"2024-08-18T22:25:27.742177+0000","last_fullsized":"2024-08-18T22:25:27.742177+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:42.261529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.741656+0000","last_change":"2024-08-18T22:25:28.739269+0000","last_active":"2024-08-18T22:25:28.741656+0000","last_peered":"2024-08-18T22:25:28.741656+0000","last_clean":"2024-08-18T22:25:28.741656+0000","last_became_active":"2024-08-18T22:25:28.738998+0000","last_became_peered":"2024-08-18T22:25:28.738998+0000","last_unstale":"2024-08-18T22:25:28.741656+0000","last_undegraded":"2024-08-18T22:25:28.741656+0000","last_fullsized":"2024-08-18T22:25:28.741656+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:34.516916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721212+0000","last_change":"2024-08-18T22:25:27.729754+0000","last_active":"2024-08-18T22:25:29.721212+0000","last_peered":"2024-08-18T22:25:29.721212+0000","last_clean":"2024-08-18T22:25:29.721212+0000","last_became_active":"2024-08-18T22:25:27.729444+0000","last_became_peered":"2024-08-18T22:25:27.729444+0000","last_unstale":"2024-08-18T22:25:29.721212+0000","last_undegraded":"2024-08-18T22:25:29.721212+0000","last_fullsized":"2024-08-18T22:25:29.721212+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:44.526490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.736249+0000","last_change":"2024-08-18T22:25:28.735227+0000","last_active":"2024-08-18T22:25:28.736249+0000","last_peered":"2024-08-18T22:25:28.736249+0000","last_clean":"2024-08-18T22:25:28.736249+0000","last_became_active":"2024-08-18T22:25:28.734944+0000","last_became_peered":"2024-08-18T22:25:28.734944+0000","last_unstale":"2024-08-18T22:25:28.736249+0000","last_undegraded":"2024-08-18T22:25:28.736249+0000","last_fullsized":"2024-08-18T22:25:28.736249+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:23.812669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.730204+0000","last_change":"2024-08-18T22:25:27.742531+0000","last_active":"2024-08-18T22:25:28.730204+0000","last_peered":"2024-08-18T22:25:28.730204+0000","last_clean":"2024-08-18T22:25:28.730204+0000","last_became_active":"2024-08-18T22:25:27.741977+0000","last_became_peered":"2024-08-18T22:25:27.741977+0000","last_unstale":"2024-08-18T22:25:28.730204+0000","last_undegraded":"2024-08-18T22:25:28.730204+0000","last_fullsized":"2024-08-18T22:25:28.730204+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:19:55.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":3,"reported_epoch":113,"state":"creating+activating","last_fresh":"2024-08-18T22:25:28.724635+0000","last_change":"2024-08-18T22:25:28.724635+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:28.724635+0000","last_undegraded":"2024-08-18T22:25:28.724635+0000","last_fullsized":"2024-08-18T22:25:28.724635+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-08-18T22:25:27.740032+0000","last_change":"2024-08-18T22:25:27.733640+0000","last_active":"2024-08-18T22:25:27.740032+0000","last_peered":"2024-08-18T22:25:27.740032+0000","last_clean":"2024-08-18T22:25:27.740032+0000","last_became_active":"2024-08-18T22:25:27.733277+0000","last_became_peered":"2024-08-18T22:25:27.733277+0000","last_unstale":"2024-08-18T22:25:27.740032+0000","last_undegraded":"2024-08-18T22:25:27.740032+0000","last_fullsized":"2024-08-18T22:25:27.740032+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:47:32.598265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725469+0000","last_change":"2024-08-18T22:25:27.725469+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725469+0000","last_undegraded":"2024-08-18T22:25:27.725469+0000","last_fullsized":"2024-08-18T22:25:27.725469+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.731395+0000","last_change":"2024-08-18T22:25:27.743464+0000","last_active":"2024-08-18T22:25:28.731395+0000","last_peered":"2024-08-18T22:25:28.731395+0000","last_clean":"2024-08-18T22:25:28.731395+0000","last_became_active":"2024-08-18T22:25:27.742955+0000","last_became_peered":"2024-08-18T22:25:27.742955+0000","last_unstale":"2024-08-18T22:25:28.731395+0000","last_undegraded":"2024-08-18T22:25:28.731395+0000","last_fullsized":"2024-08-18T22:25:28.731395+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:27:25.115281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-08-18T22:25:27.725858+0000","last_change":"2024-08-18T22:25:27.725858+0000","last_active":"2024-08-18T22:25:27.710909+0000","last_peered":"2024-08-18T22:25:27.710909+0000","last_clean":"2024-08-18T22:25:27.710909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:25:27.725858+0000","last_undegraded":"2024-08-18T22:25:27.725858+0000","last_fullsized":"2024-08-18T22:25:27.725858+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"113'2","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.758528+0000","last_change":"2024-08-18T22:25:27.744925+0000","last_active":"2024-08-18T22:25:28.758528+0000","last_peered":"2024-08-18T22:25:28.758528+0000","last_clean":"2024-08-18T22:25:28.758528+0000","last_became_active":"2024-08-18T22:25:27.744534+0000","last_became_peered":"2024-08-18T22:25:27.744534+0000","last_unstale":"2024-08-18T22:25:28.758528+0000","last_undegraded":"2024-08-18T22:25:28.758528+0000","last_fullsized":"2024-08-18T22:25:28.758528+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:41.300048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":357,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-08-18T22:25:28.720940+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:25:28.720940+0000","last_peered":"2024-08-18T22:25:28.720940+0000","last_clean":"2024-08-18T22:25:28.720940+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:25:28.720940+0000","last_undegraded":"2024-08-18T22:25:28.720940+0000","last_fullsized":"2024-08-18T22:25:28.720940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37268,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334572,"statfs":{"total":96636764160,"available":96598601728,"internally_reserved":0,"allocated":1974272,"data_stored":1236047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36688,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335152,"statfs":{"total":96636764160,"available":96599195648,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509519,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36696,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335144,"statfs":{"total":96636764160,"available":96599187456,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40848,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330992,"statfs":{"total":96636764160,"available":96594935808,"internally_reserved":0,"allocated":1380352,"data_stored":645679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509520,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":1974272,"data_stored":1236047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":1413120,"data_stored":659630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40864,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330976,"statfs":{"total":96636764160,"available":96594919424,"internally_reserved":0,"allocated":1396736,"data_stored":652880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:25:37.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:25:37.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39c600640 1 Processor -- start 2024-08-18T22:25:37.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39c600640 1 -- start start 2024-08-18T22:25:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39c600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa39415bed0 0x7fa3940735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39c600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa39406da70 0x7fa39406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39c600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa394073c80 con 0x7fa3940cb390 2024-08-18T22:25:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39c600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa39406e3e0 con 0x7fa39406da70 2024-08-18T22:25:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39c600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa3940ca5d0 con 0x7fa39415bed0 2024-08-18T22:25:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39a600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa39406da70 0x7fa39406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39a600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa39406da70 0x7fa39406dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47474/0 (socket says 172.21.15.5:47474) 2024-08-18T22:25:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39a600640 1 -- 172.21.15.5:0/3740156791 learned_addr learned my addr 172.21.15.5:0/3740156791 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa399c00640 1 --2- 172.21.15.5:0/3740156791 >> v2:172.21.15.117:3300/0 conn(0x7fa39415bed0 0x7fa3940735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39a600640 1 -- 172.21.15.5:0/3740156791 >> v2:172.21.15.117:3300/0 conn(0x7fa39415bed0 msgr2=0x7fa3940735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39a600640 1 --2- 172.21.15.5:0/3740156791 >> v2:172.21.15.117:3300/0 conn(0x7fa39415bed0 0x7fa3940735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39a600640 1 -- 172.21.15.5:0/3740156791 >> v1:172.21.15.117:6789/0 conn(0x7fa3940cb390 legacy=0x7fa394071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:37.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.629+0000 7fa39a600640 1 -- 172.21.15.5:0/3740156791 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3940ca8b0 con 0x7fa39406da70 2024-08-18T22:25:37.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa39a600640 1 --2- 172.21.15.5:0/3740156791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39406da70 0x7fa39406dea0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa3940b2cc0 tx=0x7fa38c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea09ccbaaac35a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:37.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa393e00640 1 -- 172.21.15.5:0/3740156791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0a5880 con 0x7fa39406da70 2024-08-18T22:25:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa393e00640 1 -- 172.21.15.5:0/3740156791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa38c0a5a20 con 0x7fa39406da70 2024-08-18T22:25:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa393e00640 1 -- 172.21.15.5:0/3740156791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0a5df0 con 0x7fa39406da70 2024-08-18T22:25:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa39c600640 1 -- 172.21.15.5:0/3740156791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39406da70 msgr2=0x7fa39406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa39c600640 1 --2- 172.21.15.5:0/3740156791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39406da70 0x7fa39406dea0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa3940b2cc0 tx=0x7fa38c01c9c0 comp rx=0 tx=0).stop 2024-08-18T22:25:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa39c600640 1 -- 172.21.15.5:0/3740156791 shutdown_connections 2024-08-18T22:25:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa39c600640 1 --2- 172.21.15.5:0/3740156791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39406da70 0x7fa39406dea0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa39c600640 1 --2- 172.21.15.5:0/3740156791 >> v2:172.21.15.117:3300/0 conn(0x7fa39415bed0 0x7fa3940735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa39c600640 1 -- 172.21.15.5:0/3740156791 >> 172.21.15.5:0/3740156791 conn(0x7fa3940b1c50 msgr2=0x7fa3940b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa39c600640 1 -- 172.21.15.5:0/3740156791 shutdown_connections 2024-08-18T22:25:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.633+0000 7fa39c600640 1 -- 172.21.15.5:0/3740156791 wait complete. 2024-08-18T22:25:37.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa39c600640 1 Processor -- start 2024-08-18T22:25:37.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa39c600640 1 -- start start 2024-08-18T22:25:37.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa39c600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39406da70 0x7fa3940b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:37.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa39c600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3940cb390 0x7fa394152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:37.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa39c600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa39415bed0 0x7fa3940cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:37.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa39c600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa394168520 con 0x7fa39406da70 2024-08-18T22:25:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa39c600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941683a0 con 0x7fa3940cb390 2024-08-18T22:25:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa39c600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa3941686a0 con 0x7fa39415bed0 2024-08-18T22:25:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa399c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39406da70 0x7fa3940b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa399c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39406da70 0x7fa3940b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47482/0 (socket says 172.21.15.5:47482) 2024-08-18T22:25:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa399c00640 1 -- 172.21.15.5:0/1218575280 learned_addr learned my addr 172.21.15.5:0/1218575280 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa39a600640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa39415bed0 0x7fa3940cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa399200640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3940cb390 0x7fa394152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa399c00640 1 -- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa39415bed0 msgr2=0x7fa3940cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa399c00640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa39415bed0 0x7fa3940cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa399c00640 1 -- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3940cb390 msgr2=0x7fa394152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa399c00640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3940cb390 0x7fa394152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa399c00640 1 -- 172.21.15.5:0/1218575280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3940b3360 con 0x7fa39406da70 2024-08-18T22:25:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa399200640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3940cb390 0x7fa394152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa399c00640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39406da70 0x7fa3940b3f90 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fa38800d830 tx=0x7fa38800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa391600640 1 -- 172.21.15.5:0/1218575280 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38800b6c0 con 0x7fa39406da70 2024-08-18T22:25:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa391600640 1 -- 172.21.15.5:0/1218575280 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa388019070 con 0x7fa39406da70 2024-08-18T22:25:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa391600640 1 -- 172.21.15.5:0/1218575280 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38800bae0 con 0x7fa39406da70 2024-08-18T22:25:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa39c600640 1 -- 172.21.15.5:0/1218575280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3940b4ff0 con 0x7fa39406da70 2024-08-18T22:25:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.637+0000 7fa39c600640 1 -- 172.21.15.5:0/1218575280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3940b55b0 con 0x7fa39406da70 2024-08-18T22:25:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.641+0000 7fa39c600640 1 -- 172.21.15.5:0/1218575280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa39406dea0 con 0x7fa39406da70 2024-08-18T22:25:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.641+0000 7fa391600640 1 -- 172.21.15.5:0/1218575280 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa38801e460 con 0x7fa39406da70 2024-08-18T22:25:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.641+0000 7fa391600640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678c0 0x7fa374069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.641+0000 7fa391600640 1 -- 172.21.15.5:0/1218575280 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7fa3880864e0 con 0x7fa39406da70 2024-08-18T22:25:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.641+0000 7fa399200640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678c0 0x7fa374069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.641+0000 7fa399200640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678c0 0x7fa374069d80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa3941583b0 tx=0x7fa380009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:37.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.645+0000 7fa391600640 1 -- 172.21.15.5:0/1218575280 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa388056e80 con 0x7fa39406da70 2024-08-18T22:25:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.809+0000 7fa39c600640 1 -- 172.21.15.5:0/1218575280 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3940b2310 con 0x7fa3740678c0 2024-08-18T22:25:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.817+0000 7fa391600640 1 -- 172.21.15.5:0/1218575280 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252474 (secure 0 0 0) 0x7fa3940b2310 con 0x7fa3740678c0 2024-08-18T22:25:37.819 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:25:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 -- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678c0 msgr2=0x7fa374069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678c0 0x7fa374069d80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa3941583b0 tx=0x7fa380009040 comp rx=0 tx=0).stop 2024-08-18T22:25:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 -- 172.21.15.5:0/1218575280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39406da70 msgr2=0x7fa3940b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39406da70 0x7fa3940b3f90 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fa38800d830 tx=0x7fa38800dcf0 comp rx=0 tx=0).stop 2024-08-18T22:25:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 -- 172.21.15.5:0/1218575280 shutdown_connections 2024-08-18T22:25:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678c0 0x7fa374069d80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa39415bed0 0x7fa3940cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3940cb390 0x7fa394152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 --2- 172.21.15.5:0/1218575280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39406da70 0x7fa3940b3f90 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 -- 172.21.15.5:0/1218575280 >> 172.21.15.5:0/1218575280 conn(0x7fa3940b1c50 msgr2=0x7fa3941532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 -- 172.21.15.5:0/1218575280 shutdown_connections 2024-08-18T22:25:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:37.821+0000 7fa39c600640 1 -- 172.21.15.5:0/1218575280 wait complete. 2024-08-18T22:25:37.839 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-08-18T22:25:37.715816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315744,"kb_used_data":12200,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754658976,"statfs":{"total":773094113280,"available":772770791424,"internally_reserved":0,"allocated":12492800,"data_stored":6461860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.998895"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.758046+0000","last_change":"2024-08-18T22:25:28.735608+0000","last_active":"2024-08-18T22:25:30.758046+0000","last_peered":"2024-08-18T22:25:30.758046+0000","last_clean":"2024-08-18T22:25:30.758046+0000","last_became_active":"2024-08-18T22:25:28.729321+0000","last_became_peered":"2024-08-18T22:25:28.729321+0000","last_unstale":"2024-08-18T22:25:30.758046+0000","last_undegraded":"2024-08-18T22:25:30.758046+0000","last_fullsized":"2024-08-18T22:25:30.758046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:59.887516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545767+0000","last_change":"2024-08-18T22:25:28.739322+0000","last_active":"2024-08-18T22:25:30.545767+0000","last_peered":"2024-08-18T22:25:30.545767+0000","last_clean":"2024-08-18T22:25:30.545767+0000","last_became_active":"2024-08-18T22:25:28.738918+0000","last_became_peered":"2024-08-18T22:25:28.738918+0000","last_unstale":"2024-08-18T22:25:30.545767+0000","last_undegraded":"2024-08-18T22:25:30.545767+0000","last_fullsized":"2024-08-18T22:25:30.545767+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:06.416508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.757738+0000","last_change":"2024-08-18T22:25:28.731773+0000","last_active":"2024-08-18T22:25:30.757738+0000","last_peered":"2024-08-18T22:25:30.757738+0000","last_clean":"2024-08-18T22:25:30.757738+0000","last_became_active":"2024-08-18T22:25:28.731444+0000","last_became_peered":"2024-08-18T22:25:28.731444+0000","last_unstale":"2024-08-18T22:25:30.757738+0000","last_undegraded":"2024-08-18T22:25:30.757738+0000","last_fullsized":"2024-08-18T22:25:30.757738+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:32.946730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720343+0000","last_change":"2024-08-18T22:25:28.735731+0000","last_active":"2024-08-18T22:25:29.720343+0000","last_peered":"2024-08-18T22:25:29.720343+0000","last_clean":"2024-08-18T22:25:29.720343+0000","last_became_active":"2024-08-18T22:25:28.735454+0000","last_became_peered":"2024-08-18T22:25:28.735454+0000","last_unstale":"2024-08-18T22:25:29.720343+0000","last_undegraded":"2024-08-18T22:25:29.720343+0000","last_fullsized":"2024-08-18T22:25:29.720343+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:34.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291619+0000","last_change":"2024-08-18T22:25:28.737289+0000","last_active":"2024-08-18T22:25:31.291619+0000","last_peered":"2024-08-18T22:25:31.291619+0000","last_clean":"2024-08-18T22:25:31.291619+0000","last_became_active":"2024-08-18T22:25:28.736887+0000","last_became_peered":"2024-08-18T22:25:28.736887+0000","last_unstale":"2024-08-18T22:25:31.291619+0000","last_undegraded":"2024-08-18T22:25:31.291619+0000","last_fullsized":"2024-08-18T22:25:31.291619+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:49.204708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545260+0000","last_change":"2024-08-18T22:25:28.744569+0000","last_active":"2024-08-18T22:25:30.545260+0000","last_peered":"2024-08-18T22:25:30.545260+0000","last_clean":"2024-08-18T22:25:30.545260+0000","last_became_active":"2024-08-18T22:25:28.744203+0000","last_became_peered":"2024-08-18T22:25:28.744203+0000","last_unstale":"2024-08-18T22:25:30.545260+0000","last_undegraded":"2024-08-18T22:25:30.545260+0000","last_fullsized":"2024-08-18T22:25:30.545260+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:54.073412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545191+0000","last_change":"2024-08-18T22:25:28.734578+0000","last_active":"2024-08-18T22:25:30.545191+0000","last_peered":"2024-08-18T22:25:30.545191+0000","last_clean":"2024-08-18T22:25:30.545191+0000","last_became_active":"2024-08-18T22:25:28.734042+0000","last_became_peered":"2024-08-18T22:25:28.734042+0000","last_unstale":"2024-08-18T22:25:30.545191+0000","last_undegraded":"2024-08-18T22:25:30.545191+0000","last_fullsized":"2024-08-18T22:25:30.545191+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:23.907983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.290728+0000","last_change":"2024-08-18T22:25:28.744499+0000","last_active":"2024-08-18T22:25:31.290728+0000","last_peered":"2024-08-18T22:25:31.290728+0000","last_clean":"2024-08-18T22:25:31.290728+0000","last_became_active":"2024-08-18T22:25:28.743063+0000","last_became_peered":"2024-08-18T22:25:28.743063+0000","last_unstale":"2024-08-18T22:25:31.290728+0000","last_undegraded":"2024-08-18T22:25:31.290728+0000","last_fullsized":"2024-08-18T22:25:31.290728+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:19:09.193660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545809+0000","last_change":"2024-08-18T22:25:28.744807+0000","last_active":"2024-08-18T22:25:30.545809+0000","last_peered":"2024-08-18T22:25:30.545809+0000","last_clean":"2024-08-18T22:25:30.545809+0000","last_became_active":"2024-08-18T22:25:28.744573+0000","last_became_peered":"2024-08-18T22:25:28.744573+0000","last_unstale":"2024-08-18T22:25:30.545809+0000","last_undegraded":"2024-08-18T22:25:30.545809+0000","last_fullsized":"2024-08-18T22:25:30.545809+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:19.705810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291865+0000","last_change":"2024-08-18T22:25:28.734936+0000","last_active":"2024-08-18T22:25:31.291865+0000","last_peered":"2024-08-18T22:25:31.291865+0000","last_clean":"2024-08-18T22:25:31.291865+0000","last_became_active":"2024-08-18T22:25:28.734492+0000","last_became_peered":"2024-08-18T22:25:28.734492+0000","last_unstale":"2024-08-18T22:25:31.291865+0000","last_undegraded":"2024-08-18T22:25:31.291865+0000","last_fullsized":"2024-08-18T22:25:31.291865+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:43:32.553701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.764464+0000","last_change":"2024-08-18T22:25:28.742734+0000","last_active":"2024-08-18T22:25:30.764464+0000","last_peered":"2024-08-18T22:25:30.764464+0000","last_clean":"2024-08-18T22:25:30.764464+0000","last_became_active":"2024-08-18T22:25:28.742482+0000","last_became_peered":"2024-08-18T22:25:28.742482+0000","last_unstale":"2024-08-18T22:25:30.764464+0000","last_undegraded":"2024-08-18T22:25:30.764464+0000","last_fullsized":"2024-08-18T22:25:30.764464+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:55:25.599740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721628+0000","last_change":"2024-08-18T22:25:28.727214+0000","last_active":"2024-08-18T22:25:29.721628+0000","last_peered":"2024-08-18T22:25:29.721628+0000","last_clean":"2024-08-18T22:25:29.721628+0000","last_became_active":"2024-08-18T22:25:28.726957+0000","last_became_peered":"2024-08-18T22:25:28.726957+0000","last_unstale":"2024-08-18T22:25:29.721628+0000","last_undegraded":"2024-08-18T22:25:29.721628+0000","last_fullsized":"2024-08-18T22:25:29.721628+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:14:19.239308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720089+0000","last_change":"2024-08-18T22:25:28.740324+0000","last_active":"2024-08-18T22:25:29.720089+0000","last_peered":"2024-08-18T22:25:29.720089+0000","last_clean":"2024-08-18T22:25:29.720089+0000","last_became_active":"2024-08-18T22:25:28.740070+0000","last_became_peered":"2024-08-18T22:25:28.740070+0000","last_unstale":"2024-08-18T22:25:29.720089+0000","last_undegraded":"2024-08-18T22:25:29.720089+0000","last_fullsized":"2024-08-18T22:25:29.720089+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:45:13.702641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720348+0000","last_change":"2024-08-18T22:25:28.731150+0000","last_active":"2024-08-18T22:25:29.720348+0000","last_peered":"2024-08-18T22:25:29.720348+0000","last_clean":"2024-08-18T22:25:29.720348+0000","last_became_active":"2024-08-18T22:25:28.730805+0000","last_became_peered":"2024-08-18T22:25:28.730805+0000","last_unstale":"2024-08-18T22:25:29.720348+0000","last_undegraded":"2024-08-18T22:25:29.720348+0000","last_fullsized":"2024-08-18T22:25:29.720348+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:33:22.193498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720677+0000","last_change":"2024-08-18T22:25:28.738719+0000","last_active":"2024-08-18T22:25:29.720677+0000","last_peered":"2024-08-18T22:25:29.720677+0000","last_clean":"2024-08-18T22:25:29.720677+0000","last_became_active":"2024-08-18T22:25:28.737983+0000","last_became_peered":"2024-08-18T22:25:28.737983+0000","last_unstale":"2024-08-18T22:25:29.720677+0000","last_undegraded":"2024-08-18T22:25:29.720677+0000","last_fullsized":"2024-08-18T22:25:29.720677+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:45:13.702641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720243+0000","last_change":"2024-08-18T22:25:28.736249+0000","last_active":"2024-08-18T22:25:29.720243+0000","last_peered":"2024-08-18T22:25:29.720243+0000","last_clean":"2024-08-18T22:25:29.720243+0000","last_became_active":"2024-08-18T22:25:28.735872+0000","last_became_peered":"2024-08-18T22:25:28.735872+0000","last_unstale":"2024-08-18T22:25:29.720243+0000","last_undegraded":"2024-08-18T22:25:29.720243+0000","last_fullsized":"2024-08-18T22:25:29.720243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:00.527036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.758011+0000","last_change":"2024-08-18T22:25:28.740782+0000","last_active":"2024-08-18T22:25:30.758011+0000","last_peered":"2024-08-18T22:25:30.758011+0000","last_clean":"2024-08-18T22:25:30.758011+0000","last_became_active":"2024-08-18T22:25:28.740526+0000","last_became_peered":"2024-08-18T22:25:28.740526+0000","last_unstale":"2024-08-18T22:25:30.758011+0000","last_undegraded":"2024-08-18T22:25:30.758011+0000","last_fullsized":"2024-08-18T22:25:30.758011+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:40.161644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545781+0000","last_change":"2024-08-18T22:25:28.734205+0000","last_active":"2024-08-18T22:25:30.545781+0000","last_peered":"2024-08-18T22:25:30.545781+0000","last_clean":"2024-08-18T22:25:30.545781+0000","last_became_active":"2024-08-18T22:25:28.733901+0000","last_became_peered":"2024-08-18T22:25:28.733901+0000","last_unstale":"2024-08-18T22:25:30.545781+0000","last_undegraded":"2024-08-18T22:25:30.545781+0000","last_fullsized":"2024-08-18T22:25:30.545781+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:26:42.812527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.757952+0000","last_change":"2024-08-18T22:25:28.734972+0000","last_active":"2024-08-18T22:25:30.757952+0000","last_peered":"2024-08-18T22:25:30.757952+0000","last_clean":"2024-08-18T22:25:30.757952+0000","last_became_active":"2024-08-18T22:25:28.734425+0000","last_became_peered":"2024-08-18T22:25:28.734425+0000","last_unstale":"2024-08-18T22:25:30.757952+0000","last_undegraded":"2024-08-18T22:25:30.757952+0000","last_fullsized":"2024-08-18T22:25:30.757952+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:20:26.574104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721622+0000","last_change":"2024-08-18T22:25:28.732094+0000","last_active":"2024-08-18T22:25:29.721622+0000","last_peered":"2024-08-18T22:25:29.721622+0000","last_clean":"2024-08-18T22:25:29.721622+0000","last_became_active":"2024-08-18T22:25:28.731793+0000","last_became_peered":"2024-08-18T22:25:28.731793+0000","last_unstale":"2024-08-18T22:25:29.721622+0000","last_undegraded":"2024-08-18T22:25:29.721622+0000","last_fullsized":"2024-08-18T22:25:29.721622+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:14.636263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.290982+0000","last_change":"2024-08-18T22:25:28.738637+0000","last_active":"2024-08-18T22:25:31.290982+0000","last_peered":"2024-08-18T22:25:31.290982+0000","last_clean":"2024-08-18T22:25:31.290982+0000","last_became_active":"2024-08-18T22:25:28.738343+0000","last_became_peered":"2024-08-18T22:25:28.738343+0000","last_unstale":"2024-08-18T22:25:31.290982+0000","last_undegraded":"2024-08-18T22:25:31.290982+0000","last_fullsized":"2024-08-18T22:25:31.290982+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:28:54.129149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291584+0000","last_change":"2024-08-18T22:25:28.737921+0000","last_active":"2024-08-18T22:25:31.291584+0000","last_peered":"2024-08-18T22:25:31.291584+0000","last_clean":"2024-08-18T22:25:31.291584+0000","last_became_active":"2024-08-18T22:25:28.737622+0000","last_became_peered":"2024-08-18T22:25:28.737622+0000","last_unstale":"2024-08-18T22:25:31.291584+0000","last_undegraded":"2024-08-18T22:25:31.291584+0000","last_fullsized":"2024-08-18T22:25:31.291584+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:28.052259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.757708+0000","last_change":"2024-08-18T22:25:28.731622+0000","last_active":"2024-08-18T22:25:30.757708+0000","last_peered":"2024-08-18T22:25:30.757708+0000","last_clean":"2024-08-18T22:25:30.757708+0000","last_became_active":"2024-08-18T22:25:28.731349+0000","last_became_peered":"2024-08-18T22:25:28.731349+0000","last_unstale":"2024-08-18T22:25:30.757708+0000","last_undegraded":"2024-08-18T22:25:30.757708+0000","last_fullsized":"2024-08-18T22:25:30.757708+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:41:57.361092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291025+0000","last_change":"2024-08-18T22:25:28.736127+0000","last_active":"2024-08-18T22:25:31.291025+0000","last_peered":"2024-08-18T22:25:31.291025+0000","last_clean":"2024-08-18T22:25:31.291025+0000","last_became_active":"2024-08-18T22:25:28.734491+0000","last_became_peered":"2024-08-18T22:25:28.734491+0000","last_unstale":"2024-08-18T22:25:31.291025+0000","last_undegraded":"2024-08-18T22:25:31.291025+0000","last_fullsized":"2024-08-18T22:25:31.291025+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:17:06.908455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721661+0000","last_change":"2024-08-18T22:25:28.737468+0000","last_active":"2024-08-18T22:25:29.721661+0000","last_peered":"2024-08-18T22:25:29.721661+0000","last_clean":"2024-08-18T22:25:29.721661+0000","last_became_active":"2024-08-18T22:25:28.734632+0000","last_became_peered":"2024-08-18T22:25:28.734632+0000","last_unstale":"2024-08-18T22:25:29.721661+0000","last_undegraded":"2024-08-18T22:25:29.721661+0000","last_fullsized":"2024-08-18T22:25:29.721661+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:05.375947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721571+0000","last_change":"2024-08-18T22:25:28.735178+0000","last_active":"2024-08-18T22:25:29.721571+0000","last_peered":"2024-08-18T22:25:29.721571+0000","last_clean":"2024-08-18T22:25:29.721571+0000","last_became_active":"2024-08-18T22:25:28.734914+0000","last_became_peered":"2024-08-18T22:25:28.734914+0000","last_unstale":"2024-08-18T22:25:29.721571+0000","last_undegraded":"2024-08-18T22:25:29.721571+0000","last_fullsized":"2024-08-18T22:25:29.721571+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:03:03.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.764675+0000","last_change":"2024-08-18T22:25:28.740434+0000","last_active":"2024-08-18T22:25:30.764675+0000","last_peered":"2024-08-18T22:25:30.764675+0000","last_clean":"2024-08-18T22:25:30.764675+0000","last_became_active":"2024-08-18T22:25:28.740006+0000","last_became_peered":"2024-08-18T22:25:28.740006+0000","last_unstale":"2024-08-18T22:25:30.764675+0000","last_undegraded":"2024-08-18T22:25:30.764675+0000","last_fullsized":"2024-08-18T22:25:30.764675+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:27:27.624915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545510+0000","last_change":"2024-08-18T22:25:28.740112+0000","last_active":"2024-08-18T22:25:30.545510+0000","last_peered":"2024-08-18T22:25:30.545510+0000","last_clean":"2024-08-18T22:25:30.545510+0000","last_became_active":"2024-08-18T22:25:28.739831+0000","last_became_peered":"2024-08-18T22:25:28.739831+0000","last_unstale":"2024-08-18T22:25:30.545510+0000","last_undegraded":"2024-08-18T22:25:30.545510+0000","last_fullsized":"2024-08-18T22:25:30.545510+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:53:48.075467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291132+0000","last_change":"2024-08-18T22:25:28.738595+0000","last_active":"2024-08-18T22:25:31.291132+0000","last_peered":"2024-08-18T22:25:31.291132+0000","last_clean":"2024-08-18T22:25:31.291132+0000","last_became_active":"2024-08-18T22:25:28.738274+0000","last_became_peered":"2024-08-18T22:25:28.738274+0000","last_unstale":"2024-08-18T22:25:31.291132+0000","last_undegraded":"2024-08-18T22:25:31.291132+0000","last_fullsized":"2024-08-18T22:25:31.291132+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:17.822391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721136+0000","last_change":"2024-08-18T22:25:28.732585+0000","last_active":"2024-08-18T22:25:29.721136+0000","last_peered":"2024-08-18T22:25:29.721136+0000","last_clean":"2024-08-18T22:25:29.721136+0000","last_became_active":"2024-08-18T22:25:28.731808+0000","last_became_peered":"2024-08-18T22:25:28.731808+0000","last_unstale":"2024-08-18T22:25:29.721136+0000","last_undegraded":"2024-08-18T22:25:29.721136+0000","last_fullsized":"2024-08-18T22:25:29.721136+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:42:03.700694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545213+0000","last_change":"2024-08-18T22:25:28.734355+0000","last_active":"2024-08-18T22:25:30.545213+0000","last_peered":"2024-08-18T22:25:30.545213+0000","last_clean":"2024-08-18T22:25:30.545213+0000","last_became_active":"2024-08-18T22:25:28.733553+0000","last_became_peered":"2024-08-18T22:25:28.733553+0000","last_unstale":"2024-08-18T22:25:30.545213+0000","last_undegraded":"2024-08-18T22:25:30.545213+0000","last_fullsized":"2024-08-18T22:25:30.545213+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:57.641058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291041+0000","last_change":"2024-08-18T22:25:28.738517+0000","last_active":"2024-08-18T22:25:31.291041+0000","last_peered":"2024-08-18T22:25:31.291041+0000","last_clean":"2024-08-18T22:25:31.291041+0000","last_became_active":"2024-08-18T22:25:28.738224+0000","last_became_peered":"2024-08-18T22:25:28.738224+0000","last_unstale":"2024-08-18T22:25:31.291041+0000","last_undegraded":"2024-08-18T22:25:31.291041+0000","last_fullsized":"2024-08-18T22:25:31.291041+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:03:08.812677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.757798+0000","last_change":"2024-08-18T22:25:28.733456+0000","last_active":"2024-08-18T22:25:30.757798+0000","last_peered":"2024-08-18T22:25:30.757798+0000","last_clean":"2024-08-18T22:25:30.757798+0000","last_became_active":"2024-08-18T22:25:28.730685+0000","last_became_peered":"2024-08-18T22:25:28.730685+0000","last_unstale":"2024-08-18T22:25:30.757798+0000","last_undegraded":"2024-08-18T22:25:30.757798+0000","last_fullsized":"2024-08-18T22:25:30.757798+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:13:40.066154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"113'4","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720469+0000","last_change":"2024-08-18T22:25:27.738154+0000","last_active":"2024-08-18T22:25:29.720469+0000","last_peered":"2024-08-18T22:25:29.720469+0000","last_clean":"2024-08-18T22:25:29.720469+0000","last_became_active":"2024-08-18T22:25:27.737885+0000","last_became_peered":"2024-08-18T22:25:27.737885+0000","last_unstale":"2024-08-18T22:25:29.720469+0000","last_undegraded":"2024-08-18T22:25:29.720469+0000","last_fullsized":"2024-08-18T22:25:29.720469+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:18.699215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.290863+0000","last_change":"2024-08-18T22:25:28.736655+0000","last_active":"2024-08-18T22:25:31.290863+0000","last_peered":"2024-08-18T22:25:31.290863+0000","last_clean":"2024-08-18T22:25:31.290863+0000","last_became_active":"2024-08-18T22:25:28.736388+0000","last_became_peered":"2024-08-18T22:25:28.736388+0000","last_unstale":"2024-08-18T22:25:31.290863+0000","last_undegraded":"2024-08-18T22:25:31.290863+0000","last_fullsized":"2024-08-18T22:25:31.290863+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:35:19.358272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291093+0000","last_change":"2024-08-18T22:25:27.744782+0000","last_active":"2024-08-18T22:25:31.291093+0000","last_peered":"2024-08-18T22:25:31.291093+0000","last_clean":"2024-08-18T22:25:31.291093+0000","last_became_active":"2024-08-18T22:25:27.744174+0000","last_became_peered":"2024-08-18T22:25:27.744174+0000","last_unstale":"2024-08-18T22:25:31.291093+0000","last_undegraded":"2024-08-18T22:25:31.291093+0000","last_fullsized":"2024-08-18T22:25:31.291093+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:16:59.111032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721203+0000","last_change":"2024-08-18T22:25:28.729447+0000","last_active":"2024-08-18T22:25:29.721203+0000","last_peered":"2024-08-18T22:25:29.721203+0000","last_clean":"2024-08-18T22:25:29.721203+0000","last_became_active":"2024-08-18T22:25:28.727894+0000","last_became_peered":"2024-08-18T22:25:28.727894+0000","last_unstale":"2024-08-18T22:25:29.721203+0000","last_undegraded":"2024-08-18T22:25:29.721203+0000","last_fullsized":"2024-08-18T22:25:29.721203+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:49:11.616903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721307+0000","last_change":"2024-08-18T22:25:27.733672+0000","last_active":"2024-08-18T22:25:29.721307+0000","last_peered":"2024-08-18T22:25:29.721307+0000","last_clean":"2024-08-18T22:25:29.721307+0000","last_became_active":"2024-08-18T22:25:27.733366+0000","last_became_peered":"2024-08-18T22:25:27.733366+0000","last_unstale":"2024-08-18T22:25:29.721307+0000","last_undegraded":"2024-08-18T22:25:29.721307+0000","last_fullsized":"2024-08-18T22:25:29.721307+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:13.034285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.764553+0000","last_change":"2024-08-18T22:25:28.738165+0000","last_active":"2024-08-18T22:25:30.764553+0000","last_peered":"2024-08-18T22:25:30.764553+0000","last_clean":"2024-08-18T22:25:30.764553+0000","last_became_active":"2024-08-18T22:25:28.737865+0000","last_became_peered":"2024-08-18T22:25:28.737865+0000","last_unstale":"2024-08-18T22:25:30.764553+0000","last_undegraded":"2024-08-18T22:25:30.764553+0000","last_fullsized":"2024-08-18T22:25:30.764553+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:10.868270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291732+0000","last_change":"2024-08-18T22:25:27.737506+0000","last_active":"2024-08-18T22:25:31.291732+0000","last_peered":"2024-08-18T22:25:31.291732+0000","last_clean":"2024-08-18T22:25:31.291732+0000","last_became_active":"2024-08-18T22:25:27.737232+0000","last_became_peered":"2024-08-18T22:25:27.737232+0000","last_unstale":"2024-08-18T22:25:31.291732+0000","last_undegraded":"2024-08-18T22:25:31.291732+0000","last_fullsized":"2024-08-18T22:25:31.291732+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:47:32.598265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720435+0000","last_change":"2024-08-18T22:25:28.728993+0000","last_active":"2024-08-18T22:25:29.720435+0000","last_peered":"2024-08-18T22:25:29.720435+0000","last_clean":"2024-08-18T22:25:29.720435+0000","last_became_active":"2024-08-18T22:25:28.728610+0000","last_became_peered":"2024-08-18T22:25:28.728610+0000","last_unstale":"2024-08-18T22:25:29.720435+0000","last_undegraded":"2024-08-18T22:25:29.720435+0000","last_fullsized":"2024-08-18T22:25:29.720435+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:00:47.532251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720744+0000","last_change":"2024-08-18T22:25:27.734402+0000","last_active":"2024-08-18T22:25:29.720744+0000","last_peered":"2024-08-18T22:25:29.720744+0000","last_clean":"2024-08-18T22:25:29.720744+0000","last_became_active":"2024-08-18T22:25:27.733634+0000","last_became_peered":"2024-08-18T22:25:27.733634+0000","last_unstale":"2024-08-18T22:25:29.720744+0000","last_undegraded":"2024-08-18T22:25:29.720744+0000","last_fullsized":"2024-08-18T22:25:29.720744+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:18.699215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.758257+0000","last_change":"2024-08-18T22:25:28.734087+0000","last_active":"2024-08-18T22:25:30.758257+0000","last_peered":"2024-08-18T22:25:30.758257+0000","last_clean":"2024-08-18T22:25:30.758257+0000","last_became_active":"2024-08-18T22:25:28.733822+0000","last_became_peered":"2024-08-18T22:25:28.733822+0000","last_unstale":"2024-08-18T22:25:30.758257+0000","last_undegraded":"2024-08-18T22:25:30.758257+0000","last_fullsized":"2024-08-18T22:25:30.758257+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:23:02.339078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.764193+0000","last_change":"2024-08-18T22:25:27.731859+0000","last_active":"2024-08-18T22:25:30.764193+0000","last_peered":"2024-08-18T22:25:30.764193+0000","last_clean":"2024-08-18T22:25:30.764193+0000","last_became_active":"2024-08-18T22:25:27.731366+0000","last_became_peered":"2024-08-18T22:25:27.731366+0000","last_unstale":"2024-08-18T22:25:30.764193+0000","last_undegraded":"2024-08-18T22:25:30.764193+0000","last_fullsized":"2024-08-18T22:25:30.764193+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:22.901388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545953+0000","last_change":"2024-08-18T22:25:28.740310+0000","last_active":"2024-08-18T22:25:30.545953+0000","last_peered":"2024-08-18T22:25:30.545953+0000","last_clean":"2024-08-18T22:25:30.545953+0000","last_became_active":"2024-08-18T22:25:28.739996+0000","last_became_peered":"2024-08-18T22:25:28.739996+0000","last_unstale":"2024-08-18T22:25:30.545953+0000","last_undegraded":"2024-08-18T22:25:30.545953+0000","last_fullsized":"2024-08-18T22:25:30.545953+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:36.793167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720400+0000","last_change":"2024-08-18T22:25:27.738161+0000","last_active":"2024-08-18T22:25:29.720400+0000","last_peered":"2024-08-18T22:25:29.720400+0000","last_clean":"2024-08-18T22:25:29.720400+0000","last_became_active":"2024-08-18T22:25:27.737855+0000","last_became_peered":"2024-08-18T22:25:27.737855+0000","last_unstale":"2024-08-18T22:25:29.720400+0000","last_undegraded":"2024-08-18T22:25:29.720400+0000","last_fullsized":"2024-08-18T22:25:29.720400+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:42:10.877593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720482+0000","last_change":"2024-08-18T22:25:28.741234+0000","last_active":"2024-08-18T22:25:29.720482+0000","last_peered":"2024-08-18T22:25:29.720482+0000","last_clean":"2024-08-18T22:25:29.720482+0000","last_became_active":"2024-08-18T22:25:28.740987+0000","last_became_peered":"2024-08-18T22:25:28.740987+0000","last_unstale":"2024-08-18T22:25:29.720482+0000","last_undegraded":"2024-08-18T22:25:29.720482+0000","last_fullsized":"2024-08-18T22:25:29.720482+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:14.123390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720020+0000","last_change":"2024-08-18T22:25:27.736484+0000","last_active":"2024-08-18T22:25:29.720020+0000","last_peered":"2024-08-18T22:25:29.720020+0000","last_clean":"2024-08-18T22:25:29.720020+0000","last_became_active":"2024-08-18T22:25:27.736159+0000","last_became_peered":"2024-08-18T22:25:27.736159+0000","last_unstale":"2024-08-18T22:25:29.720020+0000","last_undegraded":"2024-08-18T22:25:29.720020+0000","last_fullsized":"2024-08-18T22:25:29.720020+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:35.786573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.757643+0000","last_change":"2024-08-18T22:25:28.733175+0000","last_active":"2024-08-18T22:25:30.757643+0000","last_peered":"2024-08-18T22:25:30.757643+0000","last_clean":"2024-08-18T22:25:30.757643+0000","last_became_active":"2024-08-18T22:25:28.730341+0000","last_became_peered":"2024-08-18T22:25:28.730341+0000","last_unstale":"2024-08-18T22:25:30.757643+0000","last_undegraded":"2024-08-18T22:25:30.757643+0000","last_fullsized":"2024-08-18T22:25:30.757643+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:53:54.074442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721458+0000","last_change":"2024-08-18T22:25:27.736398+0000","last_active":"2024-08-18T22:25:29.721458+0000","last_peered":"2024-08-18T22:25:29.721458+0000","last_clean":"2024-08-18T22:25:29.721458+0000","last_became_active":"2024-08-18T22:25:27.735991+0000","last_became_peered":"2024-08-18T22:25:27.735991+0000","last_unstale":"2024-08-18T22:25:29.721458+0000","last_undegraded":"2024-08-18T22:25:29.721458+0000","last_fullsized":"2024-08-18T22:25:29.721458+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.681647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291405+0000","last_change":"2024-08-18T22:25:28.743288+0000","last_active":"2024-08-18T22:25:31.291405+0000","last_peered":"2024-08-18T22:25:31.291405+0000","last_clean":"2024-08-18T22:25:31.291405+0000","last_became_active":"2024-08-18T22:25:28.742954+0000","last_became_peered":"2024-08-18T22:25:28.742954+0000","last_unstale":"2024-08-18T22:25:31.291405+0000","last_undegraded":"2024-08-18T22:25:31.291405+0000","last_fullsized":"2024-08-18T22:25:31.291405+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:08:08.380291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.757993+0000","last_change":"2024-08-18T22:25:27.740411+0000","last_active":"2024-08-18T22:25:30.757993+0000","last_peered":"2024-08-18T22:25:30.757993+0000","last_clean":"2024-08-18T22:25:30.757993+0000","last_became_active":"2024-08-18T22:25:27.740044+0000","last_became_peered":"2024-08-18T22:25:27.740044+0000","last_unstale":"2024-08-18T22:25:30.757993+0000","last_undegraded":"2024-08-18T22:25:30.757993+0000","last_fullsized":"2024-08-18T22:25:30.757993+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:26:05.404663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.290922+0000","last_change":"2024-08-18T22:25:28.740188+0000","last_active":"2024-08-18T22:25:31.290922+0000","last_peered":"2024-08-18T22:25:31.290922+0000","last_clean":"2024-08-18T22:25:31.290922+0000","last_became_active":"2024-08-18T22:25:28.739904+0000","last_became_peered":"2024-08-18T22:25:28.739904+0000","last_unstale":"2024-08-18T22:25:31.290922+0000","last_undegraded":"2024-08-18T22:25:31.290922+0000","last_fullsized":"2024-08-18T22:25:31.290922+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:27.774743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"113'3","reported_seq":17,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720517+0000","last_change":"2024-08-18T22:25:27.737622+0000","last_active":"2024-08-18T22:25:29.720517+0000","last_peered":"2024-08-18T22:25:29.720517+0000","last_clean":"2024-08-18T22:25:29.720517+0000","last_became_active":"2024-08-18T22:25:27.737354+0000","last_became_peered":"2024-08-18T22:25:27.737354+0000","last_unstale":"2024-08-18T22:25:29.720517+0000","last_undegraded":"2024-08-18T22:25:29.720517+0000","last_fullsized":"2024-08-18T22:25:29.720517+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:35.786573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291805+0000","last_change":"2024-08-18T22:25:28.741572+0000","last_active":"2024-08-18T22:25:31.291805+0000","last_peered":"2024-08-18T22:25:31.291805+0000","last_clean":"2024-08-18T22:25:31.291805+0000","last_became_active":"2024-08-18T22:25:28.741292+0000","last_became_peered":"2024-08-18T22:25:28.741292+0000","last_unstale":"2024-08-18T22:25:31.291805+0000","last_undegraded":"2024-08-18T22:25:31.291805+0000","last_fullsized":"2024-08-18T22:25:31.291805+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:29:01.992883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"113'6","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545489+0000","last_change":"2024-08-18T22:25:27.738707+0000","last_active":"2024-08-18T22:25:30.545489+0000","last_peered":"2024-08-18T22:25:30.545489+0000","last_clean":"2024-08-18T22:25:30.545489+0000","last_became_active":"2024-08-18T22:25:27.738399+0000","last_became_peered":"2024-08-18T22:25:27.738399+0000","last_unstale":"2024-08-18T22:25:30.545489+0000","last_undegraded":"2024-08-18T22:25:30.545489+0000","last_fullsized":"2024-08-18T22:25:30.545489+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:31:21.272897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.764716+0000","last_change":"2024-08-18T22:25:28.742160+0000","last_active":"2024-08-18T22:25:30.764716+0000","last_peered":"2024-08-18T22:25:30.764716+0000","last_clean":"2024-08-18T22:25:30.764716+0000","last_became_active":"2024-08-18T22:25:28.741739+0000","last_became_peered":"2024-08-18T22:25:28.741739+0000","last_unstale":"2024-08-18T22:25:30.764716+0000","last_undegraded":"2024-08-18T22:25:30.764716+0000","last_fullsized":"2024-08-18T22:25:30.764716+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:21.642062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291805+0000","last_change":"2024-08-18T22:25:27.743973+0000","last_active":"2024-08-18T22:25:31.291805+0000","last_peered":"2024-08-18T22:25:31.291805+0000","last_clean":"2024-08-18T22:25:31.291805+0000","last_became_active":"2024-08-18T22:25:27.743650+0000","last_became_peered":"2024-08-18T22:25:27.743650+0000","last_unstale":"2024-08-18T22:25:31.291805+0000","last_undegraded":"2024-08-18T22:25:31.291805+0000","last_fullsized":"2024-08-18T22:25:31.291805+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:40:22.746617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545674+0000","last_change":"2024-08-18T22:25:28.738077+0000","last_active":"2024-08-18T22:25:30.545674+0000","last_peered":"2024-08-18T22:25:30.545674+0000","last_clean":"2024-08-18T22:25:30.545674+0000","last_became_active":"2024-08-18T22:25:28.737610+0000","last_became_peered":"2024-08-18T22:25:28.737610+0000","last_unstale":"2024-08-18T22:25:30.545674+0000","last_undegraded":"2024-08-18T22:25:30.545674+0000","last_fullsized":"2024-08-18T22:25:30.545674+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:04.148615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720080+0000","last_change":"2024-08-18T22:25:27.736833+0000","last_active":"2024-08-18T22:25:29.720080+0000","last_peered":"2024-08-18T22:25:29.720080+0000","last_clean":"2024-08-18T22:25:29.720080+0000","last_became_active":"2024-08-18T22:25:27.736456+0000","last_became_peered":"2024-08-18T22:25:27.736456+0000","last_unstale":"2024-08-18T22:25:29.720080+0000","last_undegraded":"2024-08-18T22:25:29.720080+0000","last_fullsized":"2024-08-18T22:25:29.720080+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:53.446928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291065+0000","last_change":"2024-08-18T22:25:28.739981+0000","last_active":"2024-08-18T22:25:31.291065+0000","last_peered":"2024-08-18T22:25:31.291065+0000","last_clean":"2024-08-18T22:25:31.291065+0000","last_became_active":"2024-08-18T22:25:28.738317+0000","last_became_peered":"2024-08-18T22:25:28.738317+0000","last_unstale":"2024-08-18T22:25:31.291065+0000","last_undegraded":"2024-08-18T22:25:31.291065+0000","last_fullsized":"2024-08-18T22:25:31.291065+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:34:10.218085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.290976+0000","last_change":"2024-08-18T22:25:27.743028+0000","last_active":"2024-08-18T22:25:31.290976+0000","last_peered":"2024-08-18T22:25:31.290976+0000","last_clean":"2024-08-18T22:25:31.290976+0000","last_became_active":"2024-08-18T22:25:27.742106+0000","last_became_peered":"2024-08-18T22:25:27.742106+0000","last_unstale":"2024-08-18T22:25:31.290976+0000","last_undegraded":"2024-08-18T22:25:31.290976+0000","last_fullsized":"2024-08-18T22:25:31.290976+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:51:56.157132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.758190+0000","last_change":"2024-08-18T22:25:28.739625+0000","last_active":"2024-08-18T22:25:30.758190+0000","last_peered":"2024-08-18T22:25:30.758190+0000","last_clean":"2024-08-18T22:25:30.758190+0000","last_became_active":"2024-08-18T22:25:28.739371+0000","last_became_peered":"2024-08-18T22:25:28.739371+0000","last_unstale":"2024-08-18T22:25:30.758190+0000","last_undegraded":"2024-08-18T22:25:30.758190+0000","last_fullsized":"2024-08-18T22:25:30.758190+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:07:00.378239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720737+0000","last_change":"2024-08-18T22:25:27.738551+0000","last_active":"2024-08-18T22:25:29.720737+0000","last_peered":"2024-08-18T22:25:29.720737+0000","last_clean":"2024-08-18T22:25:29.720737+0000","last_became_active":"2024-08-18T22:25:27.737360+0000","last_became_peered":"2024-08-18T22:25:27.737360+0000","last_unstale":"2024-08-18T22:25:29.720737+0000","last_undegraded":"2024-08-18T22:25:29.720737+0000","last_fullsized":"2024-08-18T22:25:29.720737+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:54:38.492348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291181+0000","last_change":"2024-08-18T22:25:28.737712+0000","last_active":"2024-08-18T22:25:31.291181+0000","last_peered":"2024-08-18T22:25:31.291181+0000","last_clean":"2024-08-18T22:25:31.291181+0000","last_became_active":"2024-08-18T22:25:28.737443+0000","last_became_peered":"2024-08-18T22:25:28.737443+0000","last_unstale":"2024-08-18T22:25:31.291181+0000","last_undegraded":"2024-08-18T22:25:31.291181+0000","last_fullsized":"2024-08-18T22:25:31.291181+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:10.051063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545809+0000","last_change":"2024-08-18T22:25:27.728904+0000","last_active":"2024-08-18T22:25:30.545809+0000","last_peered":"2024-08-18T22:25:30.545809+0000","last_clean":"2024-08-18T22:25:30.545809+0000","last_became_active":"2024-08-18T22:25:27.728636+0000","last_became_peered":"2024-08-18T22:25:27.728636+0000","last_unstale":"2024-08-18T22:25:30.545809+0000","last_undegraded":"2024-08-18T22:25:30.545809+0000","last_fullsized":"2024-08-18T22:25:30.545809+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:17:05.901861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545357+0000","last_change":"2024-08-18T22:25:28.741719+0000","last_active":"2024-08-18T22:25:30.545357+0000","last_peered":"2024-08-18T22:25:30.545357+0000","last_clean":"2024-08-18T22:25:30.545357+0000","last_became_active":"2024-08-18T22:25:28.741452+0000","last_became_peered":"2024-08-18T22:25:28.741452+0000","last_unstale":"2024-08-18T22:25:30.545357+0000","last_undegraded":"2024-08-18T22:25:30.545357+0000","last_fullsized":"2024-08-18T22:25:30.545357+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:26:44.653662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720562+0000","last_change":"2024-08-18T22:25:27.729731+0000","last_active":"2024-08-18T22:25:29.720562+0000","last_peered":"2024-08-18T22:25:29.720562+0000","last_clean":"2024-08-18T22:25:29.720562+0000","last_became_active":"2024-08-18T22:25:27.729336+0000","last_became_peered":"2024-08-18T22:25:27.729336+0000","last_unstale":"2024-08-18T22:25:29.720562+0000","last_undegraded":"2024-08-18T22:25:29.720562+0000","last_fullsized":"2024-08-18T22:25:29.720562+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:53.446928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291693+0000","last_change":"2024-08-18T22:25:28.736778+0000","last_active":"2024-08-18T22:25:31.291693+0000","last_peered":"2024-08-18T22:25:31.291693+0000","last_clean":"2024-08-18T22:25:31.291693+0000","last_became_active":"2024-08-18T22:25:28.733528+0000","last_became_peered":"2024-08-18T22:25:28.733528+0000","last_unstale":"2024-08-18T22:25:31.291693+0000","last_undegraded":"2024-08-18T22:25:31.291693+0000","last_fullsized":"2024-08-18T22:25:31.291693+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:00:35.825941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.764692+0000","last_change":"2024-08-18T22:25:27.735677+0000","last_active":"2024-08-18T22:25:30.764692+0000","last_peered":"2024-08-18T22:25:30.764692+0000","last_clean":"2024-08-18T22:25:30.764692+0000","last_became_active":"2024-08-18T22:25:27.735124+0000","last_became_peered":"2024-08-18T22:25:27.735124+0000","last_unstale":"2024-08-18T22:25:30.764692+0000","last_undegraded":"2024-08-18T22:25:30.764692+0000","last_fullsized":"2024-08-18T22:25:30.764692+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:53:10.830478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.757854+0000","last_change":"2024-08-18T22:25:28.729658+0000","last_active":"2024-08-18T22:25:30.757854+0000","last_peered":"2024-08-18T22:25:30.757854+0000","last_clean":"2024-08-18T22:25:30.757854+0000","last_became_active":"2024-08-18T22:25:28.729359+0000","last_became_peered":"2024-08-18T22:25:28.729359+0000","last_unstale":"2024-08-18T22:25:30.757854+0000","last_undegraded":"2024-08-18T22:25:30.757854+0000","last_fullsized":"2024-08-18T22:25:30.757854+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:46:19.999742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291224+0000","last_change":"2024-08-18T22:25:27.740165+0000","last_active":"2024-08-18T22:25:31.291224+0000","last_peered":"2024-08-18T22:25:31.291224+0000","last_clean":"2024-08-18T22:25:31.291224+0000","last_became_active":"2024-08-18T22:25:27.736854+0000","last_became_peered":"2024-08-18T22:25:27.736854+0000","last_unstale":"2024-08-18T22:25:31.291224+0000","last_undegraded":"2024-08-18T22:25:31.291224+0000","last_fullsized":"2024-08-18T22:25:31.291224+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:42:12.311494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.757931+0000","last_change":"2024-08-18T22:25:28.726798+0000","last_active":"2024-08-18T22:25:30.757931+0000","last_peered":"2024-08-18T22:25:30.757931+0000","last_clean":"2024-08-18T22:25:30.757931+0000","last_became_active":"2024-08-18T22:25:28.726022+0000","last_became_peered":"2024-08-18T22:25:28.726022+0000","last_unstale":"2024-08-18T22:25:30.757931+0000","last_undegraded":"2024-08-18T22:25:30.757931+0000","last_fullsized":"2024-08-18T22:25:30.757931+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:34:40.998735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.290721+0000","last_change":"2024-08-18T22:25:27.743195+0000","last_active":"2024-08-18T22:25:31.290721+0000","last_peered":"2024-08-18T22:25:31.290721+0000","last_clean":"2024-08-18T22:25:31.290721+0000","last_became_active":"2024-08-18T22:25:27.742876+0000","last_became_peered":"2024-08-18T22:25:27.742876+0000","last_unstale":"2024-08-18T22:25:31.290721+0000","last_undegraded":"2024-08-18T22:25:31.290721+0000","last_fullsized":"2024-08-18T22:25:31.290721+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:08:34.262887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720449+0000","last_change":"2024-08-18T22:25:28.740987+0000","last_active":"2024-08-18T22:25:29.720449+0000","last_peered":"2024-08-18T22:25:29.720449+0000","last_clean":"2024-08-18T22:25:29.720449+0000","last_became_active":"2024-08-18T22:25:28.740686+0000","last_became_peered":"2024-08-18T22:25:28.740686+0000","last_unstale":"2024-08-18T22:25:29.720449+0000","last_undegraded":"2024-08-18T22:25:29.720449+0000","last_fullsized":"2024-08-18T22:25:29.720449+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:48.709923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545360+0000","last_change":"2024-08-18T22:25:27.729602+0000","last_active":"2024-08-18T22:25:30.545360+0000","last_peered":"2024-08-18T22:25:30.545360+0000","last_clean":"2024-08-18T22:25:30.545360+0000","last_became_active":"2024-08-18T22:25:27.729342+0000","last_became_peered":"2024-08-18T22:25:27.729342+0000","last_unstale":"2024-08-18T22:25:30.545360+0000","last_undegraded":"2024-08-18T22:25:30.545360+0000","last_fullsized":"2024-08-18T22:25:30.545360+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:40:22.746617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291157+0000","last_change":"2024-08-18T22:25:28.735821+0000","last_active":"2024-08-18T22:25:31.291157+0000","last_peered":"2024-08-18T22:25:31.291157+0000","last_clean":"2024-08-18T22:25:31.291157+0000","last_became_active":"2024-08-18T22:25:28.735547+0000","last_became_peered":"2024-08-18T22:25:28.735547+0000","last_unstale":"2024-08-18T22:25:31.291157+0000","last_undegraded":"2024-08-18T22:25:31.291157+0000","last_fullsized":"2024-08-18T22:25:31.291157+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:39.195584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291273+0000","last_change":"2024-08-18T22:25:27.739921+0000","last_active":"2024-08-18T22:25:31.291273+0000","last_peered":"2024-08-18T22:25:31.291273+0000","last_clean":"2024-08-18T22:25:31.291273+0000","last_became_active":"2024-08-18T22:25:27.739634+0000","last_became_peered":"2024-08-18T22:25:27.739634+0000","last_unstale":"2024-08-18T22:25:31.291273+0000","last_undegraded":"2024-08-18T22:25:31.291273+0000","last_fullsized":"2024-08-18T22:25:31.291273+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:48.519152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.757562+0000","last_change":"2024-08-18T22:25:28.734458+0000","last_active":"2024-08-18T22:25:30.757562+0000","last_peered":"2024-08-18T22:25:30.757562+0000","last_clean":"2024-08-18T22:25:30.757562+0000","last_became_active":"2024-08-18T22:25:28.734188+0000","last_became_peered":"2024-08-18T22:25:28.734188+0000","last_unstale":"2024-08-18T22:25:30.757562+0000","last_undegraded":"2024-08-18T22:25:30.757562+0000","last_fullsized":"2024-08-18T22:25:30.757562+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:38.464141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291843+0000","last_change":"2024-08-18T22:25:27.744272+0000","last_active":"2024-08-18T22:25:31.291843+0000","last_peered":"2024-08-18T22:25:31.291843+0000","last_clean":"2024-08-18T22:25:31.291843+0000","last_became_active":"2024-08-18T22:25:27.744026+0000","last_became_peered":"2024-08-18T22:25:27.744026+0000","last_unstale":"2024-08-18T22:25:31.291843+0000","last_undegraded":"2024-08-18T22:25:31.291843+0000","last_fullsized":"2024-08-18T22:25:31.291843+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:55:00.779397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720287+0000","last_change":"2024-08-18T22:25:28.728579+0000","last_active":"2024-08-18T22:25:29.720287+0000","last_peered":"2024-08-18T22:25:29.720287+0000","last_clean":"2024-08-18T22:25:29.720287+0000","last_became_active":"2024-08-18T22:25:28.728302+0000","last_became_peered":"2024-08-18T22:25:28.728302+0000","last_unstale":"2024-08-18T22:25:29.720287+0000","last_undegraded":"2024-08-18T22:25:29.720287+0000","last_fullsized":"2024-08-18T22:25:29.720287+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:15.603682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"114'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.757935+0000","last_change":"2024-08-18T22:25:27.738515+0000","last_active":"2024-08-18T22:25:30.757935+0000","last_peered":"2024-08-18T22:25:30.757935+0000","last_clean":"2024-08-18T22:25:30.757935+0000","last_became_active":"2024-08-18T22:25:27.738233+0000","last_became_peered":"2024-08-18T22:25:27.738233+0000","last_unstale":"2024-08-18T22:25:30.757935+0000","last_undegraded":"2024-08-18T22:25:30.757935+0000","last_fullsized":"2024-08-18T22:25:30.757935+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:45:06.452774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720109+0000","last_change":"2024-08-18T22:25:28.737314+0000","last_active":"2024-08-18T22:25:29.720109+0000","last_peered":"2024-08-18T22:25:29.720109+0000","last_clean":"2024-08-18T22:25:29.720109+0000","last_became_active":"2024-08-18T22:25:28.736110+0000","last_became_peered":"2024-08-18T22:25:28.736110+0000","last_unstale":"2024-08-18T22:25:29.720109+0000","last_undegraded":"2024-08-18T22:25:29.720109+0000","last_fullsized":"2024-08-18T22:25:29.720109+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:29:50.349559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545697+0000","last_change":"2024-08-18T22:25:27.736974+0000","last_active":"2024-08-18T22:25:30.545697+0000","last_peered":"2024-08-18T22:25:30.545697+0000","last_clean":"2024-08-18T22:25:30.545697+0000","last_became_active":"2024-08-18T22:25:27.736651+0000","last_became_peered":"2024-08-18T22:25:27.736651+0000","last_unstale":"2024-08-18T22:25:30.545697+0000","last_undegraded":"2024-08-18T22:25:30.545697+0000","last_fullsized":"2024-08-18T22:25:30.545697+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:41:00.533944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.764436+0000","last_change":"2024-08-18T22:25:28.743727+0000","last_active":"2024-08-18T22:25:30.764436+0000","last_peered":"2024-08-18T22:25:30.764436+0000","last_clean":"2024-08-18T22:25:30.764436+0000","last_became_active":"2024-08-18T22:25:28.743408+0000","last_became_peered":"2024-08-18T22:25:28.743408+0000","last_unstale":"2024-08-18T22:25:30.764436+0000","last_undegraded":"2024-08-18T22:25:30.764436+0000","last_fullsized":"2024-08-18T22:25:30.764436+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:48:54.453523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291851+0000","last_change":"2024-08-18T22:25:27.741264+0000","last_active":"2024-08-18T22:25:31.291851+0000","last_peered":"2024-08-18T22:25:31.291851+0000","last_clean":"2024-08-18T22:25:31.291851+0000","last_became_active":"2024-08-18T22:25:27.740478+0000","last_became_peered":"2024-08-18T22:25:27.740478+0000","last_unstale":"2024-08-18T22:25:31.291851+0000","last_undegraded":"2024-08-18T22:25:31.291851+0000","last_fullsized":"2024-08-18T22:25:31.291851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:59.875728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.290873+0000","last_change":"2024-08-18T22:25:28.739269+0000","last_active":"2024-08-18T22:25:31.290873+0000","last_peered":"2024-08-18T22:25:31.290873+0000","last_clean":"2024-08-18T22:25:31.290873+0000","last_became_active":"2024-08-18T22:25:28.738998+0000","last_became_peered":"2024-08-18T22:25:28.738998+0000","last_unstale":"2024-08-18T22:25:31.290873+0000","last_undegraded":"2024-08-18T22:25:31.290873+0000","last_fullsized":"2024-08-18T22:25:31.290873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:34.793367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.721212+0000","last_change":"2024-08-18T22:25:27.729754+0000","last_active":"2024-08-18T22:25:29.721212+0000","last_peered":"2024-08-18T22:25:29.721212+0000","last_clean":"2024-08-18T22:25:29.721212+0000","last_became_active":"2024-08-18T22:25:27.729444+0000","last_became_peered":"2024-08-18T22:25:27.729444+0000","last_unstale":"2024-08-18T22:25:29.721212+0000","last_undegraded":"2024-08-18T22:25:29.721212+0000","last_fullsized":"2024-08-18T22:25:29.721212+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:44.526490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.290909+0000","last_change":"2024-08-18T22:25:28.735227+0000","last_active":"2024-08-18T22:25:31.290909+0000","last_peered":"2024-08-18T22:25:31.290909+0000","last_clean":"2024-08-18T22:25:31.290909+0000","last_became_active":"2024-08-18T22:25:28.734944+0000","last_became_peered":"2024-08-18T22:25:28.734944+0000","last_unstale":"2024-08-18T22:25:31.290909+0000","last_undegraded":"2024-08-18T22:25:31.290909+0000","last_fullsized":"2024-08-18T22:25:31.290909+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:21:38.968339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291231+0000","last_change":"2024-08-18T22:25:27.742531+0000","last_active":"2024-08-18T22:25:31.291231+0000","last_peered":"2024-08-18T22:25:31.291231+0000","last_clean":"2024-08-18T22:25:31.291231+0000","last_became_active":"2024-08-18T22:25:27.741977+0000","last_became_peered":"2024-08-18T22:25:27.741977+0000","last_unstale":"2024-08-18T22:25:31.291231+0000","last_undegraded":"2024-08-18T22:25:31.291231+0000","last_fullsized":"2024-08-18T22:25:31.291231+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:19:55.321841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720726+0000","last_change":"2024-08-18T22:25:28.739929+0000","last_active":"2024-08-18T22:25:29.720726+0000","last_peered":"2024-08-18T22:25:29.720726+0000","last_clean":"2024-08-18T22:25:29.720726+0000","last_became_active":"2024-08-18T22:25:28.739609+0000","last_became_peered":"2024-08-18T22:25:28.739609+0000","last_unstale":"2024-08-18T22:25:29.720726+0000","last_undegraded":"2024-08-18T22:25:29.720726+0000","last_fullsized":"2024-08-18T22:25:29.720726+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:29:50.349559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.545355+0000","last_change":"2024-08-18T22:25:27.733640+0000","last_active":"2024-08-18T22:25:30.545355+0000","last_peered":"2024-08-18T22:25:30.545355+0000","last_clean":"2024-08-18T22:25:30.545355+0000","last_became_active":"2024-08-18T22:25:27.733277+0000","last_became_peered":"2024-08-18T22:25:27.733277+0000","last_unstale":"2024-08-18T22:25:30.545355+0000","last_undegraded":"2024-08-18T22:25:30.545355+0000","last_fullsized":"2024-08-18T22:25:30.545355+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:19:16.363081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.764792+0000","last_change":"2024-08-18T22:25:28.740648+0000","last_active":"2024-08-18T22:25:30.764792+0000","last_peered":"2024-08-18T22:25:30.764792+0000","last_clean":"2024-08-18T22:25:30.764792+0000","last_became_active":"2024-08-18T22:25:28.740145+0000","last_became_peered":"2024-08-18T22:25:28.740145+0000","last_unstale":"2024-08-18T22:25:30.764792+0000","last_undegraded":"2024-08-18T22:25:30.764792+0000","last_fullsized":"2024-08-18T22:25:30.764792+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:00.527036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.291329+0000","last_change":"2024-08-18T22:25:27.743464+0000","last_active":"2024-08-18T22:25:31.291329+0000","last_peered":"2024-08-18T22:25:31.291329+0000","last_clean":"2024-08-18T22:25:31.291329+0000","last_became_active":"2024-08-18T22:25:27.742955+0000","last_became_peered":"2024-08-18T22:25:27.742955+0000","last_unstale":"2024-08-18T22:25:31.291329+0000","last_undegraded":"2024-08-18T22:25:31.291329+0000","last_fullsized":"2024-08-18T22:25:31.291329+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:27:25.115281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:30.764194+0000","last_change":"2024-08-18T22:25:28.736476+0000","last_active":"2024-08-18T22:25:30.764194+0000","last_peered":"2024-08-18T22:25:30.764194+0000","last_clean":"2024-08-18T22:25:30.764194+0000","last_became_active":"2024-08-18T22:25:28.736160+0000","last_became_peered":"2024-08-18T22:25:28.736160+0000","last_unstale":"2024-08-18T22:25:30.764194+0000","last_undegraded":"2024-08-18T22:25:30.764194+0000","last_fullsized":"2024-08-18T22:25:30.764194+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:27.710909+0000","last_clean_scrub_stamp":"2024-08-18T22:25:27.710909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:36.793167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:31.290895+0000","last_change":"2024-08-18T22:25:27.744925+0000","last_active":"2024-08-18T22:25:31.290895+0000","last_peered":"2024-08-18T22:25:31.290895+0000","last_clean":"2024-08-18T22:25:31.290895+0000","last_became_active":"2024-08-18T22:25:27.744534+0000","last_became_peered":"2024-08-18T22:25:27.744534+0000","last_unstale":"2024-08-18T22:25:31.290895+0000","last_undegraded":"2024-08-18T22:25:31.290895+0000","last_fullsized":"2024-08-18T22:25:31.290895+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:25:26.704315+0000","last_clean_scrub_stamp":"2024-08-18T22:25:26.704315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:41.300048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":359,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-08-18T22:25:29.720181+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:25:29.720181+0000","last_peered":"2024-08-18T22:25:29.720181+0000","last_clean":"2024-08-18T22:25:29.720181+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:25:29.720181+0000","last_undegraded":"2024-08-18T22:25:29.720181+0000","last_fullsized":"2024-08-18T22:25:29.720181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509520,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37308,"kb_used_data":1960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334532,"statfs":{"total":96636764160,"available":96598560768,"internally_reserved":0,"allocated":2007040,"data_stored":1250066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509522,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1425408,"data_stored":661754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509520,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36716,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335124,"statfs":{"total":96636764160,"available":96599166976,"internally_reserved":0,"allocated":1404928,"data_stored":659538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509521,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":1409024,"data_stored":660120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509520,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40876,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330964,"statfs":{"total":96636764160,"available":96594907136,"internally_reserved":0,"allocated":1409024,"data_stored":659572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509521,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41472,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330368,"statfs":{"total":96636764160,"available":96594296832,"internally_reserved":0,"allocated":2015232,"data_stored":1251608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":1413120,"data_stored":659630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40880,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330960,"statfs":{"total":96636764160,"available":96594903040,"internally_reserved":0,"allocated":1409024,"data_stored":659572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:25:37.843 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:25:37.843 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:25:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.029+0000 7f9d01200640 1 Processor -- start 2024-08-18T22:25:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.029+0000 7f9d01200640 1 -- start start 2024-08-18T22:25:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.029+0000 7f9d01200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cfc0b1300 0x7f9cfc162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9d01200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cfc06e8a0 con 0x7f9cfc09aca0 2024-08-18T22:25:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9d01200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cfc09bb80 con 0x7f9cfc09b080 2024-08-18T22:25:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9d01200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9cfc0d2e40 con 0x7f9cfc0b1300 2024-08-18T22:25:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9cf9e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9cfc09aca0 0x7f9cfc0afa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54134/0 (socket says 172.21.15.5:54134) 2024-08-18T22:25:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9cf1400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cfc0b1300 0x7f9cfc162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9cf9e00640 1 -- 172.21.15.5:0/125841983 learned_addr learned my addr 172.21.15.5:0/125841983 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9cf1400640 1 -- 172.21.15.5:0/125841983 >> v1:172.21.15.117:6789/0 conn(0x7f9cfc09b080 legacy=0x7f9cfc0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9cf1400640 1 -- 172.21.15.5:0/125841983 >> v1:172.21.15.5:6789/0 conn(0x7f9cfc09aca0 legacy=0x7f9cfc0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9cf1400640 1 -- 172.21.15.5:0/125841983 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cfc06cbd0 con 0x7f9cfc0b1300 2024-08-18T22:25:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9cf9400640 1 -- 172.21.15.5:0/125841983 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1818145843 0 0) 0x7f9cfc06e8a0 con 0x7f9cfc09aca0 2024-08-18T22:25:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9cf1400640 1 --2- 172.21.15.5:0/125841983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc0b1300 0x7f9cfc162950 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40097c0 tx=0x7f9ce401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac785c3b71ffd9cd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9cf9400640 1 -- 172.21.15.5:0/125841983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40b1070 con 0x7f9cfc0b1300 2024-08-18T22:25:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9cf9400640 1 -- 172.21.15.5:0/125841983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce40ac410 con 0x7f9cfc0b1300 2024-08-18T22:25:38.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.033+0000 7f9cf9400640 1 -- 172.21.15.5:0/125841983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40ac7e0 con 0x7f9cfc0b1300 2024-08-18T22:25:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 -- 172.21.15.5:0/125841983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc0b1300 msgr2=0x7f9cfc162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 --2- 172.21.15.5:0/125841983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc0b1300 0x7f9cfc162950 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40097c0 tx=0x7f9ce401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 -- 172.21.15.5:0/125841983 shutdown_connections 2024-08-18T22:25:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 --2- 172.21.15.5:0/125841983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc0b1300 0x7f9cfc162950 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 -- 172.21.15.5:0/125841983 >> 172.21.15.5:0/125841983 conn(0x7f9cfc0d2180 msgr2=0x7f9cfc0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 -- 172.21.15.5:0/125841983 shutdown_connections 2024-08-18T22:25:38.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 -- 172.21.15.5:0/125841983 wait complete. 2024-08-18T22:25:38.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 Processor -- start 2024-08-18T22:25:38.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 -- start start 2024-08-18T22:25:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc09aca0 0x7f9cfc15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc09b080 0x7f9cfc1601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cfc0b1300 0x7f9cfc150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc16ced0 con 0x7f9cfc09aca0 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc16cd50 con 0x7f9cfc0b1300 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9d01200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9cfc16d050 con 0x7f9cfc09b080 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9cf9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc09aca0 0x7f9cfc15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9cf9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc09aca0 0x7f9cfc15c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47506/0 (socket says 172.21.15.5:47506) 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9cf9e00640 1 -- 172.21.15.5:0/2909349811 learned_addr learned my addr 172.21.15.5:0/2909349811 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9cfa800640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cfc0b1300 0x7f9cfc150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.037+0000 7f9cf1400640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc09b080 0x7f9cfc1601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf9e00640 1 -- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc09b080 msgr2=0x7f9cfc1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf9e00640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc09b080 0x7f9cfc1601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf9e00640 1 -- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cfc0b1300 msgr2=0x7f9cfc150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf9e00640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cfc0b1300 0x7f9cfc150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf9e00640 1 -- 172.21.15.5:0/2909349811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cfc160720 con 0x7f9cfc09aca0 2024-08-18T22:25:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf1400640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc09b080 0x7f9cfc1601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf9e00640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc09aca0 0x7f9cfc15c9e0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00c4a0 tx=0x7f9cec00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf2a00640 1 -- 172.21.15.5:0/2909349811 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec018070 con 0x7f9cfc09aca0 2024-08-18T22:25:38.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf2a00640 1 -- 172.21.15.5:0/2909349811 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cec0074e0 con 0x7f9cfc09aca0 2024-08-18T22:25:38.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9d01200640 1 -- 172.21.15.5:0/2909349811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cfc1609f0 con 0x7f9cfc09aca0 2024-08-18T22:25:38.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf2a00640 1 -- 172.21.15.5:0/2909349811 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec004a30 con 0x7f9cfc09aca0 2024-08-18T22:25:38.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9d01200640 1 -- 172.21.15.5:0/2909349811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cfc0b6550 con 0x7f9cfc09aca0 2024-08-18T22:25:38.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9d01200640 1 -- 172.21.15.5:0/2909349811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cfc0b0250 con 0x7f9cfc09aca0 2024-08-18T22:25:38.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf2a00640 1 -- 172.21.15.5:0/2909349811 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9cec01b070 con 0x7f9cfc09aca0 2024-08-18T22:25:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf2a00640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9cd80678c0 0x7f9cd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf2a00640 1 -- 172.21.15.5:0/2909349811 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f9cec084f70 con 0x7f9cfc09aca0 2024-08-18T22:25:38.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.041+0000 7f9cf1400640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9cd80678c0 0x7f9cd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:38.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.045+0000 7f9cf1400640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9cd80678c0 0x7f9cd8069d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ae000 tx=0x7f9ce40a6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:38.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.045+0000 7f9cf2a00640 1 -- 172.21.15.5:0/2909349811 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9cec055360 con 0x7f9cfc09aca0 2024-08-18T22:25:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.269+0000 7f9d01200640 1 -- 172.21.15.5:0/2909349811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9cfc0cf640 con 0x7f9cfc09aca0 2024-08-18T22:25:38.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9cf2a00640 1 -- 172.21.15.5:0/2909349811 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f9cec059660 con 0x7f9cfc09aca0 2024-08-18T22:25:38.272 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:25:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:25:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:25:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:25:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:25:38.273 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:25:38.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 -- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9cd80678c0 msgr2=0x7f9cd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9cd80678c0 0x7f9cd8069d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ae000 tx=0x7f9ce40a6040 comp rx=0 tx=0).stop 2024-08-18T22:25:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 -- 172.21.15.5:0/2909349811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc09aca0 msgr2=0x7f9cfc15c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc09aca0 0x7f9cfc15c9e0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00c4a0 tx=0x7f9cec00c960 comp rx=0 tx=0).stop 2024-08-18T22:25:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 -- 172.21.15.5:0/2909349811 shutdown_connections 2024-08-18T22:25:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9cd80678c0 0x7f9cd8069d80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cfc0b1300 0x7f9cfc150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc09b080 0x7f9cfc1601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 --2- 172.21.15.5:0/2909349811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc09aca0 0x7f9cfc15c9e0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 -- 172.21.15.5:0/2909349811 >> 172.21.15.5:0/2909349811 conn(0x7f9cfc0d2180 msgr2=0x7f9cfc0ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 -- 172.21.15.5:0/2909349811 shutdown_connections 2024-08-18T22:25:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.273+0000 7f9d01200640 1 -- 172.21.15.5:0/2909349811 wait complete. 2024-08-18T22:25:38.294 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:25:38.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe6b200640 1 Processor -- start 2024-08-18T22:25:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe6b200640 1 -- start start 2024-08-18T22:25:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe6b200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe6c09b520 0x7efe6c15f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe6b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe6c0d02a0 0x7efe6c0d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe6b200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe6c09b9b0 con 0x7efe6c070510 2024-08-18T22:25:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe6b200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7efe6c15f670 con 0x7efe6c09b520 2024-08-18T22:25:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe6b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efe6c06fe70 con 0x7efe6c0d02a0 2024-08-18T22:25:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe69400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe6c09b520 0x7efe6c15f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe69400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe6c09b520 0x7efe6c15f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47522/0 (socket says 172.21.15.5:47522) 2024-08-18T22:25:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe69400640 1 -- 172.21.15.5:0/709516940 learned_addr learned my addr 172.21.15.5:0/709516940 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe6a800640 1 --2- 172.21.15.5:0/709516940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe6c0d02a0 0x7efe6c0d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe69400640 1 -- 172.21.15.5:0/709516940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe6c0d02a0 msgr2=0x7efe6c0d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe69400640 1 --2- 172.21.15.5:0/709516940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe6c0d02a0 0x7efe6c0d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.433+0000 7efe69400640 1 -- 172.21.15.5:0/709516940 >> v1:172.21.15.117:6789/0 conn(0x7efe6c070510 legacy=0x7efe6c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe69400640 1 -- 172.21.15.5:0/709516940 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6c070150 con 0x7efe6c09b520 2024-08-18T22:25:38.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe6a800640 1 --2- 172.21.15.5:0/709516940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe6c0d02a0 0x7efe6c0d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:38.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe69400640 1 --2- 172.21.15.5:0/709516940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe6c09b520 0x7efe6c15f130 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7efe58009870 tx=0x7efe5801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a700c8bfacfa13d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe68a00640 1 -- 172.21.15.5:0/709516940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580b2070 con 0x7efe6c09b520 2024-08-18T22:25:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe68a00640 1 -- 172.21.15.5:0/709516940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe580a9070 con 0x7efe6c09b520 2024-08-18T22:25:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe68a00640 1 -- 172.21.15.5:0/709516940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580ad880 con 0x7efe6c09b520 2024-08-18T22:25:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe6b200640 1 -- 172.21.15.5:0/709516940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe6c09b520 msgr2=0x7efe6c15f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe6b200640 1 --2- 172.21.15.5:0/709516940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe6c09b520 0x7efe6c15f130 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7efe58009870 tx=0x7efe5801c560 comp rx=0 tx=0).stop 2024-08-18T22:25:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe6b200640 1 -- 172.21.15.5:0/709516940 shutdown_connections 2024-08-18T22:25:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe6b200640 1 --2- 172.21.15.5:0/709516940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe6c0d02a0 0x7efe6c0d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe6b200640 1 --2- 172.21.15.5:0/709516940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe6c09b520 0x7efe6c15f130 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe6b200640 1 -- 172.21.15.5:0/709516940 >> 172.21.15.5:0/709516940 conn(0x7efe6c0b3a20 msgr2=0x7efe6c0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:38.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe6b200640 1 -- 172.21.15.5:0/709516940 shutdown_connections 2024-08-18T22:25:38.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.437+0000 7efe6b200640 1 -- 172.21.15.5:0/709516940 wait complete. 2024-08-18T22:25:38.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe6b200640 1 Processor -- start 2024-08-18T22:25:38.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe6b200640 1 -- start start 2024-08-18T22:25:38.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe6b200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe6c070510 0x7efe6c0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:38.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe6b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe6c09b520 0x7efe6c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:38.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe6b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe6c0d02a0 0x7efe6c0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:38.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe6b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c0b46d0 con 0x7efe6c09b520 2024-08-18T22:25:38.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe6b200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c06fb00 con 0x7efe6c070510 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe6b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efe6c0b4850 con 0x7efe6c0d02a0 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe69400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe6c09b520 0x7efe6c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe69400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe6c09b520 0x7efe6c0b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47526/0 (socket says 172.21.15.5:47526) 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe69400640 1 -- 172.21.15.5:0/1048334067 learned_addr learned my addr 172.21.15.5:0/1048334067 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe6a800640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe6c0d02a0 0x7efe6c0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe69e00640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe6c070510 0x7efe6c0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe69400640 1 -- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe6c0d02a0 msgr2=0x7efe6c0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe69400640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe6c0d02a0 0x7efe6c0b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe69400640 1 -- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe6c070510 msgr2=0x7efe6c0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe69400640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe6c070510 0x7efe6c0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe69400640 1 -- 172.21.15.5:0/1048334067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6c0b2990 con 0x7efe6c09b520 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe69400640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe6c09b520 0x7efe6c0b00e0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7efe580b0040 tx=0x7efe58019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe62000640 1 -- 172.21.15.5:0/1048334067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580b2040 con 0x7efe6c09b520 2024-08-18T22:25:38.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe62000640 1 -- 172.21.15.5:0/1048334067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe580bb070 con 0x7efe6c09b520 2024-08-18T22:25:38.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe6b200640 1 -- 172.21.15.5:0/1048334067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6c0b2c70 con 0x7efe6c09b520 2024-08-18T22:25:38.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe62000640 1 -- 172.21.15.5:0/1048334067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580b6440 con 0x7efe6c09b520 2024-08-18T22:25:38.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.441+0000 7efe6b200640 1 -- 172.21.15.5:0/1048334067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6c0b2f50 con 0x7efe6c09b520 2024-08-18T22:25:38.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.445+0000 7efe6b200640 1 -- 172.21.15.5:0/1048334067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe6c15f130 con 0x7efe6c09b520 2024-08-18T22:25:38.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.445+0000 7efe62000640 1 -- 172.21.15.5:0/1048334067 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe580ab070 con 0x7efe6c09b520 2024-08-18T22:25:38.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.445+0000 7efe62000640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe4c0678c0 0x7efe4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:38.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.445+0000 7efe62000640 1 -- 172.21.15.5:0/1048334067 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7efe5811f7e0 con 0x7efe6c09b520 2024-08-18T22:25:38.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.445+0000 7efe69e00640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe4c0678c0 0x7efe4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:38.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.445+0000 7efe69e00640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe4c0678c0 0x7efe4c069d80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0015b0 tx=0x7efe5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:38.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.449+0000 7efe62000640 1 -- 172.21.15.5:0/1048334067 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7efe58016150 con 0x7efe6c09b520 2024-08-18T22:25:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 -- 172.21.15.5:0/1048334067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe6c073d40 con 0x7efe6c09b520 2024-08-18T22:25:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe62000640 1 -- 172.21.15.5:0/1048334067 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5222 (secure 0 0 0) 0x7efe580f0180 con 0x7efe6c09b520 2024-08-18T22:25:38.652 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:25:38.652 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":90,"btime":"2024-08-18T22:25:31:768933+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6680,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3271513219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3271513219},{"type":"v1","addr":"172.21.15.117:6836","nonce":3271513219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7210,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1577791873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1577791873},{"type":"v1","addr":"172.21.15.5:6835","nonce":1577791873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/704276311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":704276311},{"type":"v1","addr":"172.21.15.5:6834","nonce":704276311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:25:28.118793+0000","modified":"2024-08-18T22:25:31.161516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7752":{"gid":7752,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/1147270411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1147270411},{"type":"v1","addr":"172.21.15.117:6837","nonce":1147270411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7752,"qdb_cluster":[7752]},"id":7}]} 2024-08-18T22:25:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 90 2024-08-18T22:25:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 -- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe4c0678c0 msgr2=0x7efe4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe4c0678c0 0x7efe4c069d80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0015b0 tx=0x7efe5c009040 comp rx=0 tx=0).stop 2024-08-18T22:25:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 -- 172.21.15.5:0/1048334067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe6c09b520 msgr2=0x7efe6c0b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe6c09b520 0x7efe6c0b00e0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7efe580b0040 tx=0x7efe58019300 comp rx=0 tx=0).stop 2024-08-18T22:25:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 -- 172.21.15.5:0/1048334067 shutdown_connections 2024-08-18T22:25:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe4c0678c0 0x7efe4c069d80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe6c0d02a0 0x7efe6c0b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe6c09b520 0x7efe6c0b00e0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 --2- 172.21.15.5:0/1048334067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe6c070510 0x7efe6c0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 -- 172.21.15.5:0/1048334067 >> 172.21.15.5:0/1048334067 conn(0x7efe6c0b3a20 msgr2=0x7efe6c0708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 -- 172.21.15.5:0/1048334067 shutdown_connections 2024-08-18T22:25:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:38.653+0000 7efe6b200640 1 -- 172.21.15.5:0/1048334067 wait complete. 2024-08-18T22:25:39.076 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:25:28.118793+0000', 'modified': '2024-08-18T22:25:31.161516+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7752}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7752': {'gid': 7752, 'name': 'd', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6837/1147270411', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6835', 'nonce': 1147270411}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 1147270411}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7752, 'qdb_cluster': [7752]} 2024-08-18T22:25:39.077 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:25:39.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-18T22:25:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f3204a00640 1 Processor -- start 2024-08-18T22:25:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f3204a00640 1 -- start start 2024-08-18T22:25:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f3204a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f320015c180 0x7f32000cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f3204a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f320015c560 0x7f32000ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f3204a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32000cfb00 con 0x7f320015d4d0 2024-08-18T22:25:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f3204a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f320015d040 con 0x7f320015c180 2024-08-18T22:25:39.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f3204a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f320015c9f0 con 0x7f320015c560 2024-08-18T22:25:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f31fe800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f320015d4d0 0x7f320015fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54144/0 (socket says 172.21.15.5:54144) 2024-08-18T22:25:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f31fe800640 1 -- 172.21.15.5:0/3322270595 learned_addr learned my addr 172.21.15.5:0/3322270595 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f31fde00640 1 --2- 172.21.15.5:0/3322270595 >> v2:172.21.15.5:3300/0 conn(0x7f320015c180 0x7f32000cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f31f5400640 1 --2- 172.21.15.5:0/3322270595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f320015c560 0x7f32000ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f31fd400640 1 -- 172.21.15.5:0/3322270595 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1778427835 0 0) 0x7f32000cfb00 con 0x7f320015d4d0 2024-08-18T22:25:39.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f31fde00640 1 -- 172.21.15.5:0/3322270595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f320015c560 msgr2=0x7f32000ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:39.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f31fde00640 1 --2- 172.21.15.5:0/3322270595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f320015c560 0x7f32000ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f31fde00640 1 -- 172.21.15.5:0/3322270595 >> v1:172.21.15.5:6789/0 conn(0x7f320015d4d0 legacy=0x7f320015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.221+0000 7f31fde00640 1 -- 172.21.15.5:0/3322270595 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320015ccd0 con 0x7f320015c180 2024-08-18T22:25:39.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f31fde00640 1 --2- 172.21.15.5:0/3322270595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320015c180 0x7f32000cdf10 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f31f00097c0 tx=0x7f31f001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b77876e7adc0573 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:39.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f31fd400640 1 -- 172.21.15.5:0/3322270595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f00ab430 con 0x7f320015c180 2024-08-18T22:25:39.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f31fd400640 1 -- 172.21.15.5:0/3322270595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f00b0070 con 0x7f320015c180 2024-08-18T22:25:39.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f31fd400640 1 -- 172.21.15.5:0/3322270595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f00ab7f0 con 0x7f320015c180 2024-08-18T22:25:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f3204a00640 1 -- 172.21.15.5:0/3322270595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320015c180 msgr2=0x7f32000cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f3204a00640 1 --2- 172.21.15.5:0/3322270595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320015c180 0x7f32000cdf10 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f31f00097c0 tx=0x7f31f001c410 comp rx=0 tx=0).stop 2024-08-18T22:25:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f3204a00640 1 -- 172.21.15.5:0/3322270595 shutdown_connections 2024-08-18T22:25:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f3204a00640 1 --2- 172.21.15.5:0/3322270595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f320015c560 0x7f32000ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f3204a00640 1 --2- 172.21.15.5:0/3322270595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320015c180 0x7f32000cdf10 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f3204a00640 1 -- 172.21.15.5:0/3322270595 >> 172.21.15.5:0/3322270595 conn(0x7f32000b1dc0 msgr2=0x7f32000b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f3204a00640 1 -- 172.21.15.5:0/3322270595 shutdown_connections 2024-08-18T22:25:39.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.225+0000 7f3204a00640 1 -- 172.21.15.5:0/3322270595 wait complete. 2024-08-18T22:25:39.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f3204a00640 1 Processor -- start 2024-08-18T22:25:39.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f3204a00640 1 -- start start 2024-08-18T22:25:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f3204a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320015c180 0x7f320009c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f3204a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f320015d4d0 0x7f320015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f3204a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32001665b0 0x7f3200153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f3204a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f32001692b0 con 0x7f320015c180 2024-08-18T22:25:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f3204a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3200169130 con 0x7f32001665b0 2024-08-18T22:25:39.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f3204a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3200169430 con 0x7f320015d4d0 2024-08-18T22:25:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31fde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320015c180 0x7f320009c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31fde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320015c180 0x7f320009c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47542/0 (socket says 172.21.15.5:47542) 2024-08-18T22:25:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31fde00640 1 -- 172.21.15.5:0/2190390185 learned_addr learned my addr 172.21.15.5:0/2190390185 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31fe800640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32001665b0 0x7f3200153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31f5400640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f320015d4d0 0x7f320015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31fde00640 1 -- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f320015d4d0 msgr2=0x7f320015eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31fde00640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f320015d4d0 0x7f320015eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31fde00640 1 -- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32001665b0 msgr2=0x7f3200153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31fde00640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32001665b0 0x7f3200153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31fde00640 1 -- 172.21.15.5:0/2190390185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320006e9c0 con 0x7f320015c180 2024-08-18T22:25:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31fde00640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320015c180 0x7f320009c490 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f31f00ad040 tx=0x7f31f001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31f6a00640 1 -- 172.21.15.5:0/2190390185 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0006e20 con 0x7f320015c180 2024-08-18T22:25:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31f6a00640 1 -- 172.21.15.5:0/2190390185 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f0004020 con 0x7f320015c180 2024-08-18T22:25:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f31f6a00640 1 -- 172.21.15.5:0/2190390185 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f00043d0 con 0x7f320015c180 2024-08-18T22:25:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f3204a00640 1 -- 172.21.15.5:0/2190390185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3200166ab0 con 0x7f320015c180 2024-08-18T22:25:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.229+0000 7f3204a00640 1 -- 172.21.15.5:0/2190390185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320009bc90 con 0x7f320015c180 2024-08-18T22:25:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31f6a00640 1 -- 172.21.15.5:0/2190390185 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f31f00bd070 con 0x7f320015c180 2024-08-18T22:25:39.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31f6a00640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31dc0678c0 0x7f31dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31f6a00640 1 -- 172.21.15.5:0/2190390185 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f31f01201c0 con 0x7f320015c180 2024-08-18T22:25:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31f5400640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31dc0678c0 0x7f31dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f3207f55000 1 Processor -- start 2024-08-18T22:25:39.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f3207f55000 1 -- start start 2024-08-18T22:25:39.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31f5400640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31dc0678c0 0x7f31dc069d80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f320015f630 tx=0x7f31e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f3207f55000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd7a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f3207f55000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd7a670 0x56261dd30450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f3207f55000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd30990 0x56261dd30d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f3207f55000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56261dc16fd0 con 0x56261dd79d50 2024-08-18T22:25:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f3207f55000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56261db7d3c0 con 0x56261dd7a670 2024-08-18T22:25:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f3207f55000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56261db22f70 con 0x56261dd30990 2024-08-18T22:25:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31fde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd7a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31fde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd7a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47546/0 (socket says 172.21.15.5:47546) 2024-08-18T22:25:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31fde00640 1 -- 172.21.15.5:0/4241922280 learned_addr learned my addr 172.21.15.5:0/4241922280 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:39.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31f5400640 1 --2- 172.21.15.5:0/4241922280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd7a670 0x56261dd30450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31fe800640 1 --2- 172.21.15.5:0/4241922280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd30990 0x56261dd30d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31fde00640 1 -- 172.21.15.5:0/4241922280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd30990 msgr2=0x56261dd30d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31fde00640 1 --2- 172.21.15.5:0/4241922280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd30990 0x56261dd30d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31fde00640 1 -- 172.21.15.5:0/4241922280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd7a670 msgr2=0x56261dd30450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31fde00640 1 --2- 172.21.15.5:0/4241922280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd7a670 0x56261dd30450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31fde00640 1 -- 172.21.15.5:0/4241922280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56261db172e0 con 0x56261dd79d50 2024-08-18T22:25:39.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31fde00640 1 --2- 172.21.15.5:0/4241922280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd7a130 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f31f00f8ba0 tx=0x7f31f00191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07f4b216841428a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.233+0000 7f31eea00640 1 -- 172.21.15.5:0/4241922280 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f00c4070 con 0x56261dd79d50 2024-08-18T22:25:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31eea00640 1 -- 172.21.15.5:0/4241922280 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f00b0040 con 0x56261dd79d50 2024-08-18T22:25:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31eea00640 1 -- 172.21.15.5:0/4241922280 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f00f90d0 con 0x56261dd79d50 2024-08-18T22:25:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 -- 172.21.15.5:0/4241922280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 msgr2=0x56261dd7a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 --2- 172.21.15.5:0/4241922280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd7a130 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f31f00f8ba0 tx=0x7f31f00191b0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 -- 172.21.15.5:0/4241922280 shutdown_connections 2024-08-18T22:25:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 --2- 172.21.15.5:0/4241922280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd30990 0x56261dd30d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 --2- 172.21.15.5:0/4241922280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd7a670 0x56261dd30450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 --2- 172.21.15.5:0/4241922280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd7a130 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 -- 172.21.15.5:0/4241922280 >> 172.21.15.5:0/4241922280 conn(0x56261dd2c910 msgr2=0x56261dd2ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 -- 172.21.15.5:0/4241922280 shutdown_connections 2024-08-18T22:25:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 -- 172.21.15.5:0/4241922280 wait complete. 2024-08-18T22:25:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 -- start start 2024-08-18T22:25:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 Processor -- start 2024-08-18T22:25:39.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd30990 0x56261dd3ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd79d50 0x56261dd3b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd7a670 0x56261dd3b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56261db24e40 con 0x56261dd30990 2024-08-18T22:25:39.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56261dc3aaf0 con 0x56261dd7a670 2024-08-18T22:25:39.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56261dbdf450 con 0x56261dd79d50 2024-08-18T22:25:39.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 10 client.0 _ll_register_callbacks cb 0x56261dd1b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:25:39.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31fde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd30990 0x56261dd3ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31fde00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd30990 0x56261dd3ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47552/0 (socket says 172.21.15.5:47552) 2024-08-18T22:25:39.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31fde00640 1 -- 172.21.15.5:0/3948951819 learned_addr learned my addr 172.21.15.5:0/3948951819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:39.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31fe800640 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd7a670 0x56261dd3b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31f5400640 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd79d50 0x56261dd3b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31fde00640 1 -- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd79d50 msgr2=0x56261dd3b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31fde00640 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd79d50 0x56261dd3b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31fde00640 1 -- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd7a670 msgr2=0x56261dd3b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31fde00640 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd7a670 0x56261dd3b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31fde00640 1 -- 172.21.15.5:0/3948951819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56261db04fd0 con 0x56261dd30990 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31fde00640 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd30990 0x56261dd3ab00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f31f00f02a0 tx=0x7f31f0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdec052e4ce3aea8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31e3400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31e3400640 1 -- 172.21.15.5:0/3948951819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f00ef9f0 con 0x56261dd30990 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31e3400640 1 -- 172.21.15.5:0/3948951819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f31f00efb90 con 0x56261dd30990 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 1 -- 172.21.15.5:0/3948951819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31f00b0040 con 0x56261dd30990 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f31e3400640 1 -- 172.21.15.5:0/3948951819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f31f00ef460 con 0x56261dd30990 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.237+0000 7f3207f55000 10 client.7896 fetch_fsmap learned FSMap version 90 2024-08-18T22:25:39.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 -- 172.21.15.5:0/3948951819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x56261dc004d0 con 0x56261dd30990 2024-08-18T22:25:39.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f31e3400640 1 -- 172.21.15.5:0/3948951819 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f00b0040 con 0x56261dd30990 2024-08-18T22:25:39.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f31e3400640 1 -- 172.21.15.5:0/3948951819 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7f31f00aa070 con 0x56261dd30990 2024-08-18T22:25:39.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 10 client.7896 fetch_fsmap finished waiting for FSMap version 90 2024-08-18T22:25:39.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 10 client.7896 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-18T22:25:39.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 20 client.7896 populate_metadata read hostname 'smithi005' 2024-08-18T22:25:39.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x56261dd3bf90 0x56261dd8b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 4 client.7896 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:25:39.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 -- 172.21.15.5:0/3948951819 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56261db17c00 con 0x56261dd3bf90 2024-08-18T22:25:39.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f31f5400640 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x56261dd3bf90 0x56261dd8b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f31f5400640 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x56261dd3bf90 0x56261dd8b000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36a7f5863f3187be server_cookie=e78e7bea589c4f4b in_seq=0 out_seq=0 2024-08-18T22:25:39.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f31e3400640 10 client.7896 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:25:39.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f31e3400640 1 -- 172.21.15.5:0/3948951819 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56261db17c00 con 0x56261dd3bf90 2024-08-18T22:25:39.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f31e3400640 10 client.7896 handle_command_reply: tid=0 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 client.7896 shutdown 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 -- 172.21.15.5:0/3948951819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd30990 msgr2=0x56261dd3ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd30990 0x56261dd3ab00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f31f00f02a0 tx=0x7f31f0000bd0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 -- 172.21.15.5:0/3948951819 shutdown_connections 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x56261dd3bf90 0x56261dd8b000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd7a670 0x56261dd3b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd79d50 0x56261dd3b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 --2- 172.21.15.5:0/3948951819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd30990 0x56261dd3ab00 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f31e3400640 0 client.7896 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 -- 172.21.15.5:0/3948951819 >> 172.21.15.5:0/3948951819 conn(0x56261dd2c910 msgr2=0x56261dd2f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 -- 172.21.15.5:0/3948951819 shutdown_connections 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 1 -- 172.21.15.5:0/3948951819 wait complete. 2024-08-18T22:25:39.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.241+0000 7f3207f55000 20 client.7896 trim_cache size 0 max 16384 2024-08-18T22:25:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f3207f55000 1 Processor -- start 2024-08-18T22:25:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f3207f55000 1 -- start start 2024-08-18T22:25:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f3207f55000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd2c910 0x56261dd8e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f3207f55000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 0x56261dd35c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f3207f55000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd36160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f3207f55000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3200203340 con 0x56261dd79d50 2024-08-18T22:25:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f3207f55000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f32001fbae0 con 0x56261dd30990 2024-08-18T22:25:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f3207f55000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3200165cc0 con 0x56261dd2c910 2024-08-18T22:25:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31fe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd36160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31fe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd36160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47554/0 (socket says 172.21.15.5:47554) 2024-08-18T22:25:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31fe800640 1 -- 172.21.15.5:0/1187601061 learned_addr learned my addr 172.21.15.5:0/1187601061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31fde00640 1 --2- 172.21.15.5:0/1187601061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd2c910 0x56261dd8e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31f5400640 1 --2- 172.21.15.5:0/1187601061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 0x56261dd35c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31fe800640 1 -- 172.21.15.5:0/1187601061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd2c910 msgr2=0x56261dd8e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31fe800640 1 --2- 172.21.15.5:0/1187601061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd2c910 0x56261dd8e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31fe800640 1 -- 172.21.15.5:0/1187601061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 msgr2=0x56261dd35c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31fe800640 1 --2- 172.21.15.5:0/1187601061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 0x56261dd35c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31fe800640 1 -- 172.21.15.5:0/1187601061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56261db76b30 con 0x56261dd79d50 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31f5400640 1 --2- 172.21.15.5:0/1187601061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 0x56261dd35c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31fe800640 1 --2- 172.21.15.5:0/1187601061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd36160 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f31f8007260 tx=0x7f31f8007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8532ee4890aa4ea1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31ee000640 1 -- 172.21.15.5:0/1187601061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f8007970 con 0x56261dd79d50 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31ee000640 1 -- 172.21.15.5:0/1187601061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f801b070 con 0x56261dd79d50 2024-08-18T22:25:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.261+0000 7f31ee000640 1 -- 172.21.15.5:0/1187601061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f8001de0 con 0x56261dd79d50 2024-08-18T22:25:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 -- 172.21.15.5:0/1187601061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 msgr2=0x56261dd36160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 --2- 172.21.15.5:0/1187601061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd36160 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f31f8007260 tx=0x7f31f8007720 comp rx=0 tx=0).stop 2024-08-18T22:25:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 -- 172.21.15.5:0/1187601061 shutdown_connections 2024-08-18T22:25:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 --2- 172.21.15.5:0/1187601061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dd36160 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 --2- 172.21.15.5:0/1187601061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 0x56261dd35c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 --2- 172.21.15.5:0/1187601061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd2c910 0x56261dd8e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 -- 172.21.15.5:0/1187601061 >> 172.21.15.5:0/1187601061 conn(0x56261dd79490 msgr2=0x56261dd2fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 -- 172.21.15.5:0/1187601061 shutdown_connections 2024-08-18T22:25:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 -- 172.21.15.5:0/1187601061 wait complete. 2024-08-18T22:25:39.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 -- start start 2024-08-18T22:25:39.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 Processor -- start 2024-08-18T22:25:39.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd2c910 0x56261dd8dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 0x56261dda92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dda9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56261db361d0 con 0x56261dd79d50 2024-08-18T22:25:39.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56261db14900 con 0x56261dd30990 2024-08-18T22:25:39.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56261db7c6d0 con 0x56261dd2c910 2024-08-18T22:25:39.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 10 client.0 _ll_register_callbacks cb 0x7f31f00f00e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:25:39.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31fe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dda9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31fe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dda9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47568/0 (socket says 172.21.15.5:47568) 2024-08-18T22:25:39.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31fe800640 1 -- 172.21.15.5:0/2338735731 learned_addr learned my addr 172.21.15.5:0/2338735731 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:39.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31fe800640 1 -- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd2c910 msgr2=0x56261dd8dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:39.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31fde00640 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd2c910 0x56261dd8dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31f5400640 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 0x56261dda92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31fe800640 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd2c910 0x56261dd8dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31fe800640 1 -- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 msgr2=0x56261dda92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31fe800640 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 0x56261dda92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31fe800640 1 -- 172.21.15.5:0/2338735731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56261db2e810 con 0x56261dd79d50 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31fde00640 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd2c910 0x56261dd8dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31f5400640 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 0x56261dda92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31fe800640 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dda9830 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f31f80012f0 tx=0x7f31f8007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f51ab04182087a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31e3400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31e3400640 1 -- 172.21.15.5:0/2338735731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f802a680 con 0x56261dd79d50 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31e3400640 1 -- 172.21.15.5:0/2338735731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f31f802a820 con 0x56261dd79d50 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 -- 172.21.15.5:0/2338735731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31f801b070 con 0x56261dd79d50 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f31e3400640 1 -- 172.21.15.5:0/2338735731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f31f8032050 con 0x56261dd79d50 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 10 client.7902 fetch_fsmap learned FSMap version 90 2024-08-18T22:25:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.265+0000 7f3207f55000 1 -- 172.21.15.5:0/2338735731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x56261db13d30 con 0x56261dd79d50 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f31e3400640 1 -- 172.21.15.5:0/2338735731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f801b070 con 0x56261dd79d50 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f31e3400640 1 -- 172.21.15.5:0/2338735731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7f31f8035020 con 0x56261dd79d50 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 10 client.7902 fetch_fsmap finished waiting for FSMap version 90 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 10 client.7902 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 20 client.7902 populate_metadata read hostname 'smithi005' 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x56261dd7a670 0x56261dda9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 4 client.7902 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 -- 172.21.15.5:0/2338735731 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "status"}) -- 0x56261db8aaf0 con 0x56261dd7a670 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f31fde00640 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x56261dd7a670 0x56261dda9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f31fde00640 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x56261dd7a670 0x56261dda9d70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b1d9362d8fa9ddc server_cookie=3c89a6db702d4f58 in_seq=0 out_seq=0 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f31e3400640 10 client.7902 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f31e3400640 1 -- 172.21.15.5:0/2338735731 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x56261db8aaf0 con 0x56261dd7a670 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f31e3400640 10 client.7902 handle_command_reply: tid=0 2024-08-18T22:25:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 client.7902 shutdown 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 -- 172.21.15.5:0/2338735731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 msgr2=0x56261dda9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dda9830 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f31f80012f0 tx=0x7f31f8007da0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 -- 172.21.15.5:0/2338735731 shutdown_connections 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x56261dd7a670 0x56261dda9d70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56261dd79d50 0x56261dda9830 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56261dd30990 0x56261dda92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f31e3400640 0 client.7902 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 --2- 172.21.15.5:0/2338735731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56261dd2c910 0x56261dd8dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 -- 172.21.15.5:0/2338735731 >> 172.21.15.5:0/2338735731 conn(0x56261dd79490 msgr2=0x56261dd34c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 -- 172.21.15.5:0/2338735731 shutdown_connections 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 1 -- 172.21.15.5:0/2338735731 wait complete. 2024-08-18T22:25:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3207f55000 20 client.7902 trim_cache size 0 max 16384 2024-08-18T22:25:39.275 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:25:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:25:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:25:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7752, 2024-08-18T22:25:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:25:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:25:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:25:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.524636212000001, 2024-08-18T22:25:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 90, 2024-08-18T22:25:39.275 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 114, 2024-08-18T22:25:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 114, 2024-08-18T22:25:39.276 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15.37340401 2024-08-18T22:25:39.276 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:25:39.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 -- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31dc0678c0 msgr2=0x7f31dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31dc0678c0 0x7f31dc069d80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f320015f630 tx=0x7f31e8008040 comp rx=0 tx=0).stop 2024-08-18T22:25:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 -- 172.21.15.5:0/2190390185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320015c180 msgr2=0x7f320009c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320015c180 0x7f320009c490 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f31f00ad040 tx=0x7f31f001ac50 comp rx=0 tx=0).stop 2024-08-18T22:25:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 -- 172.21.15.5:0/2190390185 shutdown_connections 2024-08-18T22:25:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f31dc0678c0 0x7f31dc069d80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32001665b0 0x7f3200153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f320015d4d0 0x7f320015eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 --2- 172.21.15.5:0/2190390185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f320015c180 0x7f320009c490 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 -- 172.21.15.5:0/2190390185 >> 172.21.15.5:0/2190390185 conn(0x7f32000b1dc0 msgr2=0x7f32000b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 -- 172.21.15.5:0/2190390185 shutdown_connections 2024-08-18T22:25:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.269+0000 7f3204a00640 1 -- 172.21.15.5:0/2190390185 wait complete. 2024-08-18T22:25:39.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:25:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7f0001c00640 1 Processor -- start 2024-08-18T22:25:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7f0001c00640 1 -- start start 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7f0001c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efffc0b54c0 0x7efffc071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7f0001c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efffc06dd80 0x7efffc0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7f0001c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc06fad0 0x7efffc06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7f0001c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7efffc0cba40 con 0x7efffc06dd80 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7f0001c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7efffc0b5de0 con 0x7efffc0b54c0 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7f0001c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efffc071c80 con 0x7efffc06fad0 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7efffa000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efffc06dd80 0x7efffc0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7efffa000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efffc06dd80 0x7efffc0b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47576/0 (socket says 172.21.15.5:47576) 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7efffa000640 1 -- 172.21.15.5:0/874994462 learned_addr learned my addr 172.21.15.5:0/874994462 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7efffaa00640 1 --2- 172.21.15.5:0/874994462 >> v2:172.21.15.117:3300/0 conn(0x7efffc0b54c0 0x7efffc071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7efffb400640 1 --2- 172.21.15.5:0/874994462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc06fad0 0x7efffc06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7efffa000640 1 -- 172.21.15.5:0/874994462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc06fad0 msgr2=0x7efffc06ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7efffa000640 1 --2- 172.21.15.5:0/874994462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc06fad0 0x7efffc06ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7efffa000640 1 -- 172.21.15.5:0/874994462 >> v2:172.21.15.117:3300/0 conn(0x7efffc0b54c0 msgr2=0x7efffc071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:25:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7efffa000640 1 --2- 172.21.15.5:0/874994462 >> v2:172.21.15.117:3300/0 conn(0x7efffc0b54c0 0x7efffc071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.429+0000 7efffa000640 1 -- 172.21.15.5:0/874994462 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efffc071f60 con 0x7efffc06dd80 2024-08-18T22:25:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7efffa000640 1 --2- 172.21.15.5:0/874994462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc06dd80 0x7efffc0b58a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7efffc0502d0 tx=0x7effe801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c727423ba840f478 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7efff9600640 1 -- 172.21.15.5:0/874994462 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe80b5070 con 0x7efffc06dd80 2024-08-18T22:25:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7efff9600640 1 -- 172.21.15.5:0/874994462 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe80a89d0 con 0x7efffc06dd80 2024-08-18T22:25:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7efff9600640 1 -- 172.21.15.5:0/874994462 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe80a8da0 con 0x7efffc06dd80 2024-08-18T22:25:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7f0001c00640 1 -- 172.21.15.5:0/874994462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc06dd80 msgr2=0x7efffc0b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7f0001c00640 1 --2- 172.21.15.5:0/874994462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc06dd80 0x7efffc0b58a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7efffc0502d0 tx=0x7effe801ed10 comp rx=0 tx=0).stop 2024-08-18T22:25:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7f0001c00640 1 -- 172.21.15.5:0/874994462 shutdown_connections 2024-08-18T22:25:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7f0001c00640 1 --2- 172.21.15.5:0/874994462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc06fad0 0x7efffc06ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7f0001c00640 1 --2- 172.21.15.5:0/874994462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc06dd80 0x7efffc0b58a0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7f0001c00640 1 --2- 172.21.15.5:0/874994462 >> v2:172.21.15.117:3300/0 conn(0x7efffc0b54c0 0x7efffc071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7f0001c00640 1 -- 172.21.15.5:0/874994462 >> 172.21.15.5:0/874994462 conn(0x7efffc0b3eb0 msgr2=0x7efffc0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7f0001c00640 1 -- 172.21.15.5:0/874994462 shutdown_connections 2024-08-18T22:25:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.433+0000 7f0001c00640 1 -- 172.21.15.5:0/874994462 wait complete. 2024-08-18T22:25:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7f0001c00640 1 Processor -- start 2024-08-18T22:25:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7f0001c00640 1 -- start start 2024-08-18T22:25:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7f0001c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc06dd80 0x7efffc0d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7f0001c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc06fad0 0x7efffc0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7f0001c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc0b54c0 0x7efffc1f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7f0001c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efffc148020 con 0x7efffc0b54c0 2024-08-18T22:25:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7f0001c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efffc06e1a0 con 0x7efffc06dd80 2024-08-18T22:25:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7f0001c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efffc1481a0 con 0x7efffc06fad0 2024-08-18T22:25:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efffb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc0b54c0 0x7efffc1f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efffb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc0b54c0 0x7efffc1f3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47590/0 (socket says 172.21.15.5:47590) 2024-08-18T22:25:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efffb400640 1 -- 172.21.15.5:0/2242617021 learned_addr learned my addr 172.21.15.5:0/2242617021 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efffa000640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc06fad0 0x7efffc0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efffaa00640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc06dd80 0x7efffc0d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efffb400640 1 -- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc06fad0 msgr2=0x7efffc0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efffb400640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc06fad0 0x7efffc0cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efffb400640 1 -- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc06dd80 msgr2=0x7efffc0d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efffb400640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc06dd80 0x7efffc0d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efffb400640 1 -- 172.21.15.5:0/2242617021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efffc1f4c20 con 0x7efffc0b54c0 2024-08-18T22:25:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efffb400640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc0b54c0 0x7efffc1f3ef0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7efff400eed0 tx=0x7efff400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efff2a00640 1 -- 172.21.15.5:0/2242617021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4018020 con 0x7efffc0b54c0 2024-08-18T22:25:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efff2a00640 1 -- 172.21.15.5:0/2242617021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff4014400 con 0x7efffc0b54c0 2024-08-18T22:25:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7efff2a00640 1 -- 172.21.15.5:0/2242617021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff40147f0 con 0x7efffc0b54c0 2024-08-18T22:25:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7f0001c00640 1 -- 172.21.15.5:0/2242617021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efffc0d1340 con 0x7efffc0b54c0 2024-08-18T22:25:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.437+0000 7f0001c00640 1 -- 172.21.15.5:0/2242617021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efffc0d2360 con 0x7efffc0b54c0 2024-08-18T22:25:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.441+0000 7f0001c00640 1 -- 172.21.15.5:0/2242617021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efffc0d1130 con 0x7efffc0b54c0 2024-08-18T22:25:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.441+0000 7efff2a00640 1 -- 172.21.15.5:0/2242617021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efff401b020 con 0x7efffc0b54c0 2024-08-18T22:25:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.441+0000 7efff2a00640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effdc0678f0 0x7effdc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.441+0000 7efff2a00640 1 -- 172.21.15.5:0/2242617021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7efff40862c0 con 0x7efffc0b54c0 2024-08-18T22:25:39.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.441+0000 7efffaa00640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effdc0678f0 0x7effdc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.441+0000 7efffaa00640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effdc0678f0 0x7effdc069db0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7effec009b60 tx=0x7effec009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.445+0000 7efff2a00640 1 -- 172.21.15.5:0/2242617021 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7efff4022070 con 0x7efffc0b54c0 2024-08-18T22:25:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 -- 172.21.15.5:0/2242617021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efffc0b58a0 con 0x7efffc0b54c0 2024-08-18T22:25:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7efff2a00640 1 -- 172.21.15.5:0/2242617021 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) ==== 53+0+73 (secure 0 0 0) 0x7efff40566b0 con 0x7efffc0b54c0 2024-08-18T22:25:39.649 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:25:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 -- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effdc0678f0 msgr2=0x7effdc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effdc0678f0 0x7effdc069db0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7effec009b60 tx=0x7effec009190 comp rx=0 tx=0).stop 2024-08-18T22:25:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 -- 172.21.15.5:0/2242617021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc0b54c0 msgr2=0x7efffc1f3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc0b54c0 0x7efffc1f3ef0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7efff400eed0 tx=0x7efff400b480 comp rx=0 tx=0).stop 2024-08-18T22:25:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 -- 172.21.15.5:0/2242617021 shutdown_connections 2024-08-18T22:25:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effdc0678f0 0x7effdc069db0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc0b54c0 0x7efffc1f3ef0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc06fad0 0x7efffc0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 --2- 172.21.15.5:0/2242617021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc06dd80 0x7efffc0d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 -- 172.21.15.5:0/2242617021 >> 172.21.15.5:0/2242617021 conn(0x7efffc0b3eb0 msgr2=0x7efffc146e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 -- 172.21.15.5:0/2242617021 shutdown_connections 2024-08-18T22:25:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39.649+0000 7f0001c00640 1 -- 172.21.15.5:0/2242617021 wait complete. 2024-08-18T22:25:39.671 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:25:39.671 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:25:39.671 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:25:39.671 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:25:39.671 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:25:39.671 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:25:39.671 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:25:39.671 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:25:39.671 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:25:39.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:25:39.672 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:25:39.682 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:25:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:25:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:25:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:25:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:25:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:25:39.682 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:25:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:25:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42062sec preferred_lft 42062sec 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:25:39.683 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:25:39.684 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:25:39.685 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:25:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:25:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:25:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:25:39.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:25:39.685 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:25:39.745 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:25:39.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:25:39.747 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:25:39.800 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:25:39.800 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:25:39.800 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:25:39.800 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:25:39.800 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:25:39.800 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:25:39.801 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:25:39.801 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:25:39.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:25:39.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:25:39.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:25:39.801 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:25:39.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:25:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:25:39.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:25:39.944 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:25:39.952 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:25:39.953 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:25:39.953 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:25:39.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:25:39.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:25:40.015 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:25:40.015 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:25:40.067 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:25:40.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:25:40.068 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:25:40.119 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:25:40.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:25:40.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:25:40.212 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:25:40.212 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:25:40.212 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:25:40.227 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:25:40.227 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:25:40.227 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:25:40.227 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:25:40.227 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:25:40.237 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:25:40.237 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:25:40.237 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:25:40.237 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:25:40.238 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:25:40.238 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:25:40.238 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:25:40.238 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:25:40.242 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:25:40.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:25:40.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:25:40.263 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:25:40.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:25:40.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:25:40.379 INFO:teuthology.orchestra.run.smithi005.stdout:client6779 2024-08-18T22:25:40.379 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:25:40.379 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:25:40.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-08-18T22:25:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.577+0000 7f22ae000640 1 Processor -- start 2024-08-18T22:25:40.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.577+0000 7f22ae000640 1 -- start start 2024-08-18T22:25:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.581+0000 7f22ae000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22a80cf020 0x7f22a80cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.581+0000 7f22ae000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a806f870 con 0x7f22a8072e80 2024-08-18T22:25:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.581+0000 7f22ae000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a80cf940 con 0x7f22a8072a20 2024-08-18T22:25:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.581+0000 7f22ae000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f22a80b4c30 con 0x7f22a80cf020 2024-08-18T22:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.581+0000 7f22a7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f22a8072e80 0x7f22a806f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54146/0 (socket says 172.21.15.5:54146) 2024-08-18T22:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.581+0000 7f22a7e00640 1 -- 172.21.15.5:0/2590886836 learned_addr learned my addr 172.21.15.5:0/2590886836 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.581+0000 7f22a7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22a80cf020 0x7f22a80cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.581+0000 7f22a7400640 1 -- 172.21.15.5:0/2590886836 >> v1:172.21.15.117:6789/0 conn(0x7f22a8072a20 legacy=0x7f22a806ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.581+0000 7f22a7400640 1 -- 172.21.15.5:0/2590886836 >> v1:172.21.15.5:6789/0 conn(0x7f22a8072e80 legacy=0x7f22a806f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.581+0000 7f22a7400640 1 -- 172.21.15.5:0/2590886836 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a80735e0 con 0x7f22a80cf020 2024-08-18T22:25:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22a7400640 1 --2- 172.21.15.5:0/2590886836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a80cf020 0x7f22a80cf400 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f22980097c0 tx=0x7f229801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e3d58dc824c6d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22a6000640 1 -- 172.21.15.5:0/2590886836 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22980a7070 con 0x7f22a80cf020 2024-08-18T22:25:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22a6000640 1 -- 172.21.15.5:0/2590886836 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22980b0070 con 0x7f22a80cf020 2024-08-18T22:25:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22a6000640 1 -- 172.21.15.5:0/2590886836 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22980ab890 con 0x7f22a80cf020 2024-08-18T22:25:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 -- 172.21.15.5:0/2590886836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a80cf020 msgr2=0x7f22a80cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 --2- 172.21.15.5:0/2590886836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a80cf020 0x7f22a80cf400 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f22980097c0 tx=0x7f229801c470 comp rx=0 tx=0).stop 2024-08-18T22:25:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 -- 172.21.15.5:0/2590886836 shutdown_connections 2024-08-18T22:25:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 --2- 172.21.15.5:0/2590886836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a80cf020 0x7f22a80cf400 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 -- 172.21.15.5:0/2590886836 >> 172.21.15.5:0/2590886836 conn(0x7f22a806b9b0 msgr2=0x7f22a806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 -- 172.21.15.5:0/2590886836 shutdown_connections 2024-08-18T22:25:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 -- 172.21.15.5:0/2590886836 wait complete. 2024-08-18T22:25:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 Processor -- start 2024-08-18T22:25:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 -- start start 2024-08-18T22:25:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22a8072a20 0x7f22a80ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22a8072e80 0x7f22a8159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:40.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a80cf020 0x7f22a8157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f22a806e3e0 con 0x7f22a80cf020 2024-08-18T22:25:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f22a8073e80 con 0x7f22a8072a20 2024-08-18T22:25:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.585+0000 7f22ae000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22a8073290 con 0x7f22a8072e80 2024-08-18T22:25:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a80cf020 0x7f22a8157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a80cf020 0x7f22a8157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47620/0 (socket says 172.21.15.5:47620) 2024-08-18T22:25:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a7e00640 1 -- 172.21.15.5:0/4145925471 learned_addr learned my addr 172.21.15.5:0/4145925471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:25:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a6a00640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22a8072e80 0x7f22a8159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:40.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a7400640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22a8072a20 0x7f22a80ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a7e00640 1 -- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22a8072e80 msgr2=0x7f22a8159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a7e00640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22a8072e80 0x7f22a8159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a7e00640 1 -- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22a8072a20 msgr2=0x7f22a80ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a7e00640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22a8072a20 0x7f22a80ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a7e00640 1 -- 172.21.15.5:0/4145925471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a815a110 con 0x7f22a80cf020 2024-08-18T22:25:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a6a00640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22a8072e80 0x7f22a8159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a7400640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22a8072a20 0x7f22a80ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:25:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22a7e00640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a80cf020 0x7f22a8157cc0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f22a000cbc0 tx=0x7f22a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f229f400640 1 -- 172.21.15.5:0/4145925471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0017070 con 0x7f22a80cf020 2024-08-18T22:25:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f229f400640 1 -- 172.21.15.5:0/4145925471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a000ad40 con 0x7f22a80cf020 2024-08-18T22:25:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f229f400640 1 -- 172.21.15.5:0/4145925471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0012600 con 0x7f22a80cf020 2024-08-18T22:25:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22ae000640 1 -- 172.21.15.5:0/4145925471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a815b1d0 con 0x7f22a80cf020 2024-08-18T22:25:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22ae000640 1 -- 172.21.15.5:0/4145925471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a815b790 con 0x7f22a80cf020 2024-08-18T22:25:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f22ae000640 1 -- 172.21.15.5:0/4145925471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a8156a60 con 0x7f22a80cf020 2024-08-18T22:25:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f229f400640 1 -- 172.21.15.5:0/4145925471 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f22a001a070 con 0x7f22a80cf020 2024-08-18T22:25:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f229f400640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22880678f0 0x7f2288069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:25:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.589+0000 7f229f400640 1 -- 172.21.15.5:0/4145925471 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f22a0085a70 con 0x7f22a80cf020 2024-08-18T22:25:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.593+0000 7f22a7400640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22880678f0 0x7f2288069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:25:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.593+0000 7f22a7400640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22880678f0 0x7f2288069db0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f22980af000 tx=0x7f2298008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:25:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.597+0000 7f229f400640 1 -- 172.21.15.5:0/4145925471 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f22a0055dc0 con 0x7f22a80cf020 2024-08-18T22:25:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:40.797+0000 7f22ae000640 1 -- 172.21.15.5:0/4145925471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f22a806cc30 con 0x7f22a80cf020 2024-08-18T22:25:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.801+0000 7f229f400640 1 -- 172.21.15.5:0/4145925471 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v91) ==== 167+0+0 (secure 0 0 0) 0x7f22a005a0c0 con 0x7f22a80cf020 2024-08-18T22:25:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:enabled new snapshots 2024-08-18T22:25:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 -- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22880678f0 msgr2=0x7f2288069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22880678f0 0x7f2288069db0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f22980af000 tx=0x7f2298008040 comp rx=0 tx=0).stop 2024-08-18T22:25:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 -- 172.21.15.5:0/4145925471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a80cf020 msgr2=0x7f22a8157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:25:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a80cf020 0x7f22a8157cc0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f22a000cbc0 tx=0x7f22a000a430 comp rx=0 tx=0).stop 2024-08-18T22:25:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 -- 172.21.15.5:0/4145925471 shutdown_connections 2024-08-18T22:25:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22880678f0 0x7f2288069db0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a80cf020 0x7f22a8157cc0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22a8072e80 0x7f22a8159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 --2- 172.21.15.5:0/4145925471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22a8072a20 0x7f22a80ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:25:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 -- 172.21.15.5:0/4145925471 >> 172.21.15.5:0/4145925471 conn(0x7f22a806b9b0 msgr2=0x7f22a8145c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:25:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 -- 172.21.15.5:0/4145925471 shutdown_connections 2024-08-18T22:25:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:25:41.805+0000 7f22ae000640 1 -- 172.21.15.5:0/4145925471 wait complete. 2024-08-18T22:25:41.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:25:41.830 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-08-18T22:25:41.847 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:25:41.847 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:25:41.896 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:25:41.896 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:25:41.896 DEBUG:teuthology.orchestra.run.smithi005:> import uuid 2024-08-18T22:25:41.896 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:25:41.896 DEBUG:teuthology.orchestra.run.smithi005:> n = 2000 2024-08-18T22:25:41.896 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = False 2024-08-18T22:25:41.897 DEBUG:teuthology.orchestra.run.smithi005:> if 3 > 0: 2024-08-18T22:25:41.897 DEBUG:teuthology.orchestra.run.smithi005:> create_hard_links = True 2024-08-18T22:25:41.897 DEBUG:teuthology.orchestra.run.smithi005:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-08-18T22:25:41.897 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:25:41.897 DEBUG:teuthology.orchestra.run.smithi005:> dpath = os.path.dirname(path) 2024-08-18T22:25:41.898 DEBUG:teuthology.orchestra.run.smithi005:> fnameprefix = os.path.basename(path) 2024-08-18T22:25:41.898 DEBUG:teuthology.orchestra.run.smithi005:> os.makedirs(dpath, exist_ok=True) 2024-08-18T22:25:41.898 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:25:41.898 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-08-18T22:25:41.898 DEBUG:teuthology.orchestra.run.smithi005:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-08-18T22:25:41.899 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:25:41.899 DEBUG:teuthology.orchestra.run.smithi005:> for i in range(n): 2024-08-18T22:25:41.899 DEBUG:teuthology.orchestra.run.smithi005:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-08-18T22:25:41.899 DEBUG:teuthology.orchestra.run.smithi005:> with open(fpath, '"'"'w'"'"') as f: 2024-08-18T22:25:41.899 DEBUG:teuthology.orchestra.run.smithi005:> f.write(f"{i}") 2024-08-18T22:25:41.900 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:25:41.900 DEBUG:teuthology.orchestra.run.smithi005:> f.flush() 2024-08-18T22:25:41.900 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(f.fileno()) 2024-08-18T22:25:41.900 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:25:41.900 DEBUG:teuthology.orchestra.run.smithi005:> os.unlink(fpath) 2024-08-18T22:25:41.900 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:25:41.900 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-08-18T22:25:41.901 DEBUG:teuthology.orchestra.run.smithi005:> if create_hard_links: 2024-08-18T22:25:41.901 DEBUG:teuthology.orchestra.run.smithi005:> for j in range(3): 2024-08-18T22:25:41.901 DEBUG:teuthology.orchestra.run.smithi005:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-08-18T22:25:41.901 DEBUG:teuthology.orchestra.run.smithi005:> if False: 2024-08-18T22:25:41.901 DEBUG:teuthology.orchestra.run.smithi005:> os.fsync(dirfd) 2024-08-18T22:25:41.901 DEBUG:teuthology.orchestra.run.smithi005:> finally: 2024-08-18T22:25:41.901 DEBUG:teuthology.orchestra.run.smithi005:> os.close(dirfd) 2024-08-18T22:25:41.901 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:25:52.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:25:52.486 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:26:07.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:26:07.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:26:07.902 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-08-18T22:26:08.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:26:08.223 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-08-18T22:26:22.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:26:22.539 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:26:37.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:26:37.584 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-08-18T22:26:37.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-08-18T22:26:37.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25bf600640 1 Processor -- start 2024-08-18T22:26:37.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25bf600640 1 -- start start 2024-08-18T22:26:37.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25bf600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25b815b0c0 0x7f25b806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25bf600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25b80b31f0 con 0x7f25b80b40c0 2024-08-18T22:26:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25bf600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25b80b34d0 con 0x7f25b80cf290 2024-08-18T22:26:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25bf600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f25b80b3d70 con 0x7f25b815b0c0 2024-08-18T22:26:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25bcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25b815b0c0 0x7f25b806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25b7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f25b80b40c0 0x7f25b8072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35154/0 (socket says 172.21.15.5:35154) 2024-08-18T22:26:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25b7e00640 1 -- 172.21.15.5:0/117687139 learned_addr learned my addr 172.21.15.5:0/117687139 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:26:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25bcc00640 1 -- 172.21.15.5:0/117687139 >> v1:172.21.15.117:6789/0 conn(0x7f25b80cf290 legacy=0x7f25b8073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25bcc00640 1 -- 172.21.15.5:0/117687139 >> v1:172.21.15.5:6789/0 conn(0x7f25b80b40c0 legacy=0x7f25b8072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.800+0000 7f25bcc00640 1 -- 172.21.15.5:0/117687139 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b80b37b0 con 0x7f25b815b0c0 2024-08-18T22:26:37.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25bcc00640 1 --2- 172.21.15.5:0/117687139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b815b0c0 0x7f25b806db80 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0097c0 tx=0x7f25ac01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e61e79f41d4a7f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:37.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25b7400640 1 -- 172.21.15.5:0/117687139 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0b0070 con 0x7f25b815b0c0 2024-08-18T22:26:37.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25b7400640 1 -- 172.21.15.5:0/117687139 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ac0ab600 con 0x7f25b815b0c0 2024-08-18T22:26:37.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25b7400640 1 -- 172.21.15.5:0/117687139 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0ab9d0 con 0x7f25b815b0c0 2024-08-18T22:26:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25bf600640 1 -- 172.21.15.5:0/117687139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b815b0c0 msgr2=0x7f25b806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25bf600640 1 --2- 172.21.15.5:0/117687139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b815b0c0 0x7f25b806db80 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0097c0 tx=0x7f25ac01c350 comp rx=0 tx=0).stop 2024-08-18T22:26:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25bf600640 1 -- 172.21.15.5:0/117687139 shutdown_connections 2024-08-18T22:26:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25bf600640 1 --2- 172.21.15.5:0/117687139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b815b0c0 0x7f25b806db80 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25bf600640 1 -- 172.21.15.5:0/117687139 >> 172.21.15.5:0/117687139 conn(0x7f25b80b1dc0 msgr2=0x7f25b80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25bf600640 1 -- 172.21.15.5:0/117687139 shutdown_connections 2024-08-18T22:26:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25bf600640 1 -- 172.21.15.5:0/117687139 wait complete. 2024-08-18T22:26:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25bf600640 1 Processor -- start 2024-08-18T22:26:37.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.804+0000 7f25bf600640 1 -- start start 2024-08-18T22:26:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bf600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b80b40c0 0x7f25b815d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bf600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b80cf290 0x7f25b81518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bf600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b815b0c0 0x7f25b814d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bf600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f25b80b48e0 con 0x7f25b80b40c0 2024-08-18T22:26:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bf600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25b815b4a0 con 0x7f25b815b0c0 2024-08-18T22:26:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bf600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f25b814e250 con 0x7f25b80cf290 2024-08-18T22:26:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b80b40c0 0x7f25b815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b80b40c0 0x7f25b815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43170/0 (socket says 172.21.15.5:43170) 2024-08-18T22:26:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bcc00640 1 -- 172.21.15.5:0/3826512557 learned_addr learned my addr 172.21.15.5:0/3826512557 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25b7e00640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b80cf290 0x7f25b81518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bd600640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b815b0c0 0x7f25b814d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bcc00640 1 -- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b80cf290 msgr2=0x7f25b81518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bcc00640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b80cf290 0x7f25b81518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bcc00640 1 -- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b815b0c0 msgr2=0x7f25b814d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bcc00640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b815b0c0 0x7f25b814d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bcc00640 1 -- 172.21.15.5:0/3826512557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b8073b40 con 0x7f25b80b40c0 2024-08-18T22:26:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bcc00640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b80b40c0 0x7f25b815d030 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0ae040 tx=0x7f25ac01ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25b4c00640 1 -- 172.21.15.5:0/3826512557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0b0050 con 0x7f25b80b40c0 2024-08-18T22:26:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25b4c00640 1 -- 172.21.15.5:0/3826512557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ac0bc070 con 0x7f25b80b40c0 2024-08-18T22:26:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bf600640 1 -- 172.21.15.5:0/3826512557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b814e530 con 0x7f25b80b40c0 2024-08-18T22:26:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25b4c00640 1 -- 172.21.15.5:0/3826512557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0b5850 con 0x7f25b80b40c0 2024-08-18T22:26:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.808+0000 7f25bf600640 1 -- 172.21.15.5:0/3826512557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b815b950 con 0x7f25b80b40c0 2024-08-18T22:26:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25b4c00640 1 -- 172.21.15.5:0/3826512557 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f25ac0b59f0 con 0x7f25b80b40c0 2024-08-18T22:26:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25b4c00640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25980678c0 0x7f2598069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25b4c00640 1 -- 172.21.15.5:0/3826512557 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f25ac120600 con 0x7f25b80b40c0 2024-08-18T22:26:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25b7e00640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25980678c0 0x7f2598069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25c2b97000 1 Processor -- start 2024-08-18T22:26:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25c2b97000 1 -- start start 2024-08-18T22:26:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25b7e00640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25980678c0 0x7f2598069d80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f25b81f4b70 tx=0x7f25a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 0x55cedd474350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd474890 0x55cedd427630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd427b70 0x55cedd427f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25c2b97000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55cedd278470 con 0x55cedd474890 2024-08-18T22:26:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25c2b97000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cedd232ad0 con 0x55cedd427b70 2024-08-18T22:26:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25c2b97000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55cedd274430 con 0x55cedd473f70 2024-08-18T22:26:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25b7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd474890 0x55cedd427630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25bcc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 0x55cedd474350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25bd600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd427b70 0x55cedd427f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25b7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd474890 0x55cedd427630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43172/0 (socket says 172.21.15.5:43172) 2024-08-18T22:26:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25b7e00640 1 -- 172.21.15.5:0/2189653311 learned_addr learned my addr 172.21.15.5:0/2189653311 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25bcc00640 1 -- 172.21.15.5:0/2189653311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd427b70 msgr2=0x55cedd427f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25bcc00640 1 --2- 172.21.15.5:0/2189653311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd427b70 0x55cedd427f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25bcc00640 1 -- 172.21.15.5:0/2189653311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd474890 msgr2=0x55cedd427630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25bcc00640 1 --2- 172.21.15.5:0/2189653311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd474890 0x55cedd427630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.812+0000 7f25bcc00640 1 -- 172.21.15.5:0/2189653311 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cedd218a10 con 0x55cedd473f70 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25bcc00640 1 --2- 172.21.15.5:0/2189653311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 0x55cedd474350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f25ac11e970 tx=0x7f25ac0f0480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=828e7084a0c2a543 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25a9600640 1 -- 172.21.15.5:0/2189653311 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0f0880 con 0x55cedd473f70 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25a9600640 1 -- 172.21.15.5:0/2189653311 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ac0b1040 con 0x55cedd473f70 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25a9600640 1 -- 172.21.15.5:0/2189653311 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0f4c30 con 0x55cedd473f70 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 -- 172.21.15.5:0/2189653311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 msgr2=0x55cedd474350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 --2- 172.21.15.5:0/2189653311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 0x55cedd474350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f25ac11e970 tx=0x7f25ac0f0480 comp rx=0 tx=0).stop 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 -- 172.21.15.5:0/2189653311 shutdown_connections 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 --2- 172.21.15.5:0/2189653311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd427b70 0x55cedd427f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 --2- 172.21.15.5:0/2189653311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd474890 0x55cedd427630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 --2- 172.21.15.5:0/2189653311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 0x55cedd474350 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 -- 172.21.15.5:0/2189653311 >> 172.21.15.5:0/2189653311 conn(0x55cedd421680 msgr2=0x55cedd456df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 -- 172.21.15.5:0/2189653311 shutdown_connections 2024-08-18T22:26:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 -- 172.21.15.5:0/2189653311 wait complete. 2024-08-18T22:26:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 -- start start 2024-08-18T22:26:37.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 Processor -- start 2024-08-18T22:26:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd427b70 0x55cedd42e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd473f70 0x55cedd42e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd474890 0x55cedd42ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55cedd243770 con 0x55cedd473f70 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cedd219c80 con 0x55cedd474890 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55cedd2f9130 con 0x55cedd427b70 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25c2b97000 10 client.0 _ll_register_callbacks cb 0x55cedd4150e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25b7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd473f70 0x55cedd42e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25b7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd473f70 0x55cedd42e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43182/0 (socket says 172.21.15.5:43182) 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25b7e00640 1 -- 172.21.15.5:0/615813127 learned_addr learned my addr 172.21.15.5:0/615813127 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25bcc00640 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd427b70 0x55cedd42e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25bd600640 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd474890 0x55cedd42ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25b7e00640 1 -- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd427b70 msgr2=0x55cedd42e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25b7e00640 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd427b70 0x55cedd42e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25b7e00640 1 -- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd474890 msgr2=0x55cedd42ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25b7e00640 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd474890 0x55cedd42ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25b7e00640 1 -- 172.21.15.5:0/615813127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cedd230fe0 con 0x55cedd473f70 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25bd600640 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd474890 0x55cedd42ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f25b7e00640 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd473f70 0x55cedd42e930 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f25a4007b00 tx=0x7f25a4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389cb5b08e49e96 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.816+0000 7f259e000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f259e000640 1 -- 172.21.15.5:0/615813127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a4028060 con 0x55cedd473f70 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 -- 172.21.15.5:0/615813127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25ac0b1040 con 0x55cedd473f70 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f259e000640 1 -- 172.21.15.5:0/615813127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f25a4010040 con 0x55cedd473f70 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f259e000640 1 -- 172.21.15.5:0/615813127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f25a4007560 con 0x55cedd473f70 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 10 client.7932 fetch_fsmap learned FSMap version 91 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 -- 172.21.15.5:0/615813127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x55cedd244ed0 con 0x55cedd473f70 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f259e000640 1 -- 172.21.15.5:0/615813127 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ac0b1040 con 0x55cedd473f70 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f259e000640 1 -- 172.21.15.5:0/615813127 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f25a4013420 con 0x55cedd473f70 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 10 client.7932 fetch_fsmap finished waiting for FSMap version 91 2024-08-18T22:26:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 10 client.7932 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-08-18T22:26:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 20 client.7932 populate_metadata read hostname 'smithi005' 2024-08-18T22:26:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55cedd42f880 0x55cedd486020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 4 client.7932 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:26:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 -- 172.21.15.5:0/615813127 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cedd212d90 con 0x55cedd42f880 2024-08-18T22:26:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25bcc00640 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55cedd42f880 0x55cedd486020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25bcc00640 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55cedd42f880 0x55cedd486020 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7236ef9d208057c8 server_cookie=ecae6f16ad4864ea in_seq=0 out_seq=0 2024-08-18T22:26:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f259e000640 10 client.7932 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f259e000640 1 -- 172.21.15.5:0/615813127 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cedd212d90 con 0x55cedd42f880 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f259e000640 10 client.7932 handle_command_reply: tid=0 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 client.7932 shutdown 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 -- 172.21.15.5:0/615813127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd473f70 msgr2=0x55cedd42e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd473f70 0x55cedd42e930 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f25a4007b00 tx=0x7f25a4005800 comp rx=0 tx=0).stop 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 -- 172.21.15.5:0/615813127 shutdown_connections 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55cedd42f880 0x55cedd486020 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd474890 0x55cedd42ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd473f70 0x55cedd42e930 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 --2- 172.21.15.5:0/615813127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd427b70 0x55cedd42e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f259e000640 0 client.7932 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 -- 172.21.15.5:0/615813127 >> 172.21.15.5:0/615813127 conn(0x55cedd421680 msgr2=0x55cedd456df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 -- 172.21.15.5:0/615813127 shutdown_connections 2024-08-18T22:26:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 1 -- 172.21.15.5:0/615813127 wait complete. 2024-08-18T22:26:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.820+0000 7f25c2b97000 20 client.7932 trim_cache size 0 max 16384 2024-08-18T22:26:37.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.836+0000 7f25c2b97000 1 Processor -- start 2024-08-18T22:26:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.836+0000 7f25c2b97000 1 -- start start 2024-08-18T22:26:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4e3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd427b70 0x55cedd4e4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd473f70 0x55cedd4e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8204110 con 0x55cedd421680 2024-08-18T22:26:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25b82030f0 con 0x55cedd473f70 2024-08-18T22:26:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f25b81fb110 con 0x55cedd427b70 2024-08-18T22:26:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25bcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4e3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25bcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4e3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43188/0 (socket says 172.21.15.5:43188) 2024-08-18T22:26:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25bcc00640 1 -- 172.21.15.5:0/3565448656 learned_addr learned my addr 172.21.15.5:0/3565448656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25bcc00640 1 -- 172.21.15.5:0/3565448656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd427b70 msgr2=0x55cedd4e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25bcc00640 1 --2- 172.21.15.5:0/3565448656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd427b70 0x55cedd4e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25bcc00640 1 -- 172.21.15.5:0/3565448656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd473f70 msgr2=0x55cedd4e49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25bcc00640 1 --2- 172.21.15.5:0/3565448656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd473f70 0x55cedd4e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25bcc00640 1 -- 172.21.15.5:0/3565448656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cedd2f95c0 con 0x55cedd421680 2024-08-18T22:26:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25bcc00640 1 --2- 172.21.15.5:0/3565448656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4e3f50 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f25ac097e40 tx=0x7f25ac0c2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2523f22e223d9e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25a8c00640 1 -- 172.21.15.5:0/3565448656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0f0880 con 0x55cedd421680 2024-08-18T22:26:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25a8c00640 1 -- 172.21.15.5:0/3565448656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ac0b4e20 con 0x55cedd421680 2024-08-18T22:26:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25a8c00640 1 -- 172.21.15.5:0/3565448656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0f70b0 con 0x55cedd421680 2024-08-18T22:26:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 -- 172.21.15.5:0/3565448656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 msgr2=0x55cedd4e3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 --2- 172.21.15.5:0/3565448656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4e3f50 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f25ac097e40 tx=0x7f25ac0c2000 comp rx=0 tx=0).stop 2024-08-18T22:26:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 -- 172.21.15.5:0/3565448656 shutdown_connections 2024-08-18T22:26:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 --2- 172.21.15.5:0/3565448656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd473f70 0x55cedd4e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 --2- 172.21.15.5:0/3565448656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd427b70 0x55cedd4e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 --2- 172.21.15.5:0/3565448656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4e3f50 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 -- 172.21.15.5:0/3565448656 >> 172.21.15.5:0/3565448656 conn(0x55cedd457330 msgr2=0x55cedd4266b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 -- 172.21.15.5:0/3565448656 shutdown_connections 2024-08-18T22:26:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 -- 172.21.15.5:0/3565448656 wait complete. 2024-08-18T22:26:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 -- start start 2024-08-18T22:26:37.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.840+0000 7f25c2b97000 1 Processor -- start 2024-08-18T22:26:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4892d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd427b70 0x55cedd489810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 0x55cedd4a3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55cedd21fa10 con 0x55cedd421680 2024-08-18T22:26:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8202ad0 con 0x55cedd427b70 2024-08-18T22:26:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55cedd277780 con 0x55cedd473f70 2024-08-18T22:26:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 10 client.0 _ll_register_callbacks cb 0x7f25a4001d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:26:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25bcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4892d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25bcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4892d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43194/0 (socket says 172.21.15.5:43194) 2024-08-18T22:26:37.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25bcc00640 1 -- 172.21.15.5:0/2475293511 learned_addr learned my addr 172.21.15.5:0/2475293511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25b7e00640 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd427b70 0x55cedd489810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25bd600640 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 0x55cedd4a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25bcc00640 1 -- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 msgr2=0x55cedd4a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25bcc00640 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 0x55cedd4a3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25bcc00640 1 -- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd427b70 msgr2=0x55cedd489810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25bcc00640 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd427b70 0x55cedd489810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25bcc00640 1 -- 172.21.15.5:0/2475293511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cedd20bc50 con 0x55cedd421680 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25bd600640 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 0x55cedd4a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25bcc00640 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4892d0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0ecce0 tx=0x7f25ac0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb9d75886eb3a42 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f259e000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f259e000640 1 -- 172.21.15.5:0/2475293511 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac10e070 con 0x55cedd421680 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f259e000640 1 -- 172.21.15.5:0/2475293511 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f25ac115c70 con 0x55cedd421680 2024-08-18T22:26:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 -- 172.21.15.5:0/2475293511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25ac0b4e20 con 0x55cedd421680 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f259e000640 1 -- 172.21.15.5:0/2475293511 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f25ac0fe050 con 0x55cedd421680 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 10 client.7938 fetch_fsmap learned FSMap version 91 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 -- 172.21.15.5:0/2475293511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x55cedd21e2a0 con 0x55cedd421680 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f259e000640 1 -- 172.21.15.5:0/2475293511 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ac0b4e20 con 0x55cedd421680 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f259e000640 1 -- 172.21.15.5:0/2475293511 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f25ac101020 con 0x55cedd421680 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 10 client.7938 fetch_fsmap finished waiting for FSMap version 91 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 10 client.7938 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 20 client.7938 populate_metadata read hostname 'smithi005' 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55cedd474890 0x55cedd4a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 4 client.7938 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 -- 172.21.15.5:0/2475293511 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55cedd285ba0 con 0x55cedd474890 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25b7e00640 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55cedd474890 0x55cedd4a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25b7e00640 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55cedd474890 0x55cedd4a3d10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21be1f788b10683e server_cookie=725d730d60e4e7f5 in_seq=0 out_seq=0 2024-08-18T22:26:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f259e000640 10 client.7938 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f259e000640 1 -- 172.21.15.5:0/2475293511 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17990 (crc 0 0 0) 0x55cedd285ba0 con 0x55cedd474890 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f259e000640 10 client.7938 handle_command_reply: tid=0 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 client.7938 shutdown 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 -- 172.21.15.5:0/2475293511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 msgr2=0x55cedd4892d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4892d0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0ecce0 tx=0x7f25ac0190f0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 -- 172.21.15.5:0/2475293511 shutdown_connections 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55cedd474890 0x55cedd4a3d10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55cedd473f70 0x55cedd4a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cedd427b70 0x55cedd489810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 --2- 172.21.15.5:0/2475293511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cedd421680 0x55cedd4892d0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f259e000640 0 client.7938 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 -- 172.21.15.5:0/2475293511 >> 172.21.15.5:0/2475293511 conn(0x55cedd457330 msgr2=0x55cedd426ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 -- 172.21.15.5:0/2475293511 shutdown_connections 2024-08-18T22:26:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 1 -- 172.21.15.5:0/2475293511 wait complete. 2024-08-18T22:26:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.844+0000 7f25c2b97000 20 client.7938 trim_cache size 0 max 16384 2024-08-18T22:26:37.851 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:26:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:26:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 964, 2024-08-18T22:26:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 963, 2024-08-18T22:26:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 428013, 2024-08-18T22:26:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 17305417, 2024-08-18T22:26:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 9, 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 3, 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.148223211, 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.072596644, 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.031055494, 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.034143748, 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 962, 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.182714435, 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000189931 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2, 2024-08-18T22:26:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000140, 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000070 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1652, 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 1669, 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 415353, 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 22017694, 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 6, 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.179369057, 2024-08-18T22:26:37.853 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.083329935, 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.036211221, 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.045396624, 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1667, 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.208475396, 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000125060 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.854 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 113232 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 29191, 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 51471, 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 10145672, 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 66167300, 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 7, 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 2.834468303, 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 1.717317490, 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 1.561800469, 2024-08-18T22:26:37.855 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.064449298, 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 51471, 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.580166244, 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000030700 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 45596, 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.010875299, 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000238 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 116048, 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 20096 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.856 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1455, 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 14.025133197, 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.009639266 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-18T22:26:37.857 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1837, 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.551174912, 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000300040 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 26000, 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 26000, 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 26000, 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 251.381898471, 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.009668534 2024-08-18T22:26:37.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 12, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 19912, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 0, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 19912, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 0, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 19911, 2024-08-18T22:26:37.859 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 0, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 135, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 135, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 2, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 47387, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 46795, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 124, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2024-08-18T22:26:37.860 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 0, 2024-08-18T22:26:37.861 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 0, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 0, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 0, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 1191, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 4043, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 3193, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 2341, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 44, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 14171 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.862 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 2000, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 164, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 4154, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 1703, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 2215, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2024-08-18T22:26:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_path": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_inode": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.864 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 25340, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 25340, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 37, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 37, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 4, 2024-08-18T22:26:37.865 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 89728698, 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 0, 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2707, 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 72.773189609, 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.026883335 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 0 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 2014, 2024-08-18T22:26:37.866 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 2014, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 0, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 13, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 13, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 0, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 19912, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 19913, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 1, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 135, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 6381, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 6246, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 113840, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 231732 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.867 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 28990, 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 26000, 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 4, 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2000, 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.989603484, 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000994801 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 29, 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.005589617, 2024-08-18T22:26:37.868 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000192745 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 6000, 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 7.030964172, 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001171827 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 7742, 2024-08-18T22:26:37.869 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 5.165842604, 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000667249 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.870 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000086155, 2024-08-18T22:26:37.871 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000086155 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.003010281, 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.003010281 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2024-08-18T22:26:37.872 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.297052402, 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.297052402 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000112751, 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000112751 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.873 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8, 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.265936507, 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.033242063 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2215, 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 218.901839646, 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.098827015 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:26:37.875 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.061048502, 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.061048502 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000346106, 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000346106 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.876 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8000, 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 17.660466244, 2024-08-18T22:26:37.878 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002207558 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 1, 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 1, 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 0, 2024-08-18T22:26:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 1, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 18293, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 18293, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 53, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:26:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:26:37.881 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:26:37.882 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 18802292, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 4806, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 5520, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 78, 2024-08-18T22:26:37.883 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 20350050, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 800036, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2024-08-18T22:26:37.884 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 4646, 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 85991317, 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 31, 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 4646, 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 4646, 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 20.635815835, 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.004441630 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 4646, 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 4748 2024-08-18T22:26:37.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 4646, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 47, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 4599, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 0, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 11, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 47, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 2754, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 30, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 1703, 2024-08-18T22:26:37.886 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 32, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 22, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2024-08-18T22:26:37.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2024-08-18T22:26:37.888 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 116, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 3, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 8, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 8, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 0, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 117, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 0, 2024-08-18T22:26:37.889 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 32 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 1, 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2024-08-18T22:26:37.890 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 32, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 32, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed_ops": 1703, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 1703, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 31803, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 8555267, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:26:37.891 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 31803, 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 31803, 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 8555267, 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-18T22:26:37.892 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 4646, 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 86176944, 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 4646, 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 86176944, 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:26:37.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 4646, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 4646, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 4646, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 4646, 2024-08-18T22:26:37.894 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 1703, 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 185627, 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 1703, 2024-08-18T22:26:37.895 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 47, 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 185627, 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x5586b18ce780": { 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 84, 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 25340, 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 85534394, 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 25340, 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2707, 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 85534310, 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:26:37.897 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 -- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25980678c0 msgr2=0x7f2598069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25980678c0 0x7f2598069d80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f25b81f4b70 tx=0x7f25a4009040 comp rx=0 tx=0).stop 2024-08-18T22:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 -- 172.21.15.5:0/3826512557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b80b40c0 msgr2=0x7f25b815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b80b40c0 0x7f25b815d030 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0ae040 tx=0x7f25ac01ab90 comp rx=0 tx=0).stop 2024-08-18T22:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 -- 172.21.15.5:0/3826512557 shutdown_connections 2024-08-18T22:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f25980678c0 0x7f2598069d80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b815b0c0 0x7f25b814d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b80cf290 0x7f25b81518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 --2- 172.21.15.5:0/3826512557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25b80b40c0 0x7f25b815d030 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 -- 172.21.15.5:0/3826512557 >> 172.21.15.5:0/3826512557 conn(0x7f25b80b1dc0 msgr2=0x7f25b80ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 -- 172.21.15.5:0/3826512557 shutdown_connections 2024-08-18T22:26:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:37.848+0000 7f25bf600640 1 -- 172.21.15.5:0/3826512557 wait complete. 2024-08-18T22:26:37.900 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-08-18T22:26:37.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:26:37.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start '~mdsdir' recursive 2024-08-18T22:26:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.060+0000 7f5762600640 1 Processor -- start 2024-08-18T22:26:38.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.060+0000 7f5762600640 1 -- start start 2024-08-18T22:26:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f5762600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f575c147c40 0x7f575c0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f5762600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f575c0b6470 con 0x7f575c071470 2024-08-18T22:26:38.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f5762600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f575c0b6750 con 0x7f575c0b7e80 2024-08-18T22:26:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f5762600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f575c06d6b0 con 0x7f575c147c40 2024-08-18T22:26:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f5761c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f575c071470 0x7f575c06deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35166/0 (socket says 172.21.15.5:35166) 2024-08-18T22:26:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f5761c00640 1 -- 172.21.15.5:0/1435881760 learned_addr learned my addr 172.21.15.5:0/1435881760 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:26:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f5761200640 1 --2- 172.21.15.5:0/1435881760 >> v2:172.21.15.117:3300/0 conn(0x7f575c147c40 0x7f575c0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f575be00640 1 -- 172.21.15.5:0/1435881760 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668194398 0 0) 0x7f575c0b6470 con 0x7f575c071470 2024-08-18T22:26:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f575be00640 1 -- 172.21.15.5:0/1435881760 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5740003530 con 0x7f575c071470 2024-08-18T22:26:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f575be00640 1 -- 172.21.15.5:0/1435881760 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121958611 0 0) 0x7f575c0b6750 con 0x7f575c0b7e80 2024-08-18T22:26:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f575be00640 1 -- 172.21.15.5:0/1435881760 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f575c0b6470 con 0x7f575c0b7e80 2024-08-18T22:26:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f5761200640 1 -- 172.21.15.5:0/1435881760 >> v1:172.21.15.117:6789/0 conn(0x7f575c0b7e80 legacy=0x7f575c15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f5761200640 1 -- 172.21.15.5:0/1435881760 >> v1:172.21.15.5:6789/0 conn(0x7f575c071470 legacy=0x7f575c06deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.064+0000 7f5761200640 1 -- 172.21.15.5:0/1435881760 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c06d990 con 0x7f575c147c40 2024-08-18T22:26:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5761200640 1 --2- 172.21.15.5:0/1435881760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f575c147c40 0x7f575c0b5de0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f574c0097c0 tx=0x7f574c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5388919807fc3a38 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f575be00640 1 -- 172.21.15.5:0/1435881760 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c0b1070 con 0x7f575c147c40 2024-08-18T22:26:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f575be00640 1 -- 172.21.15.5:0/1435881760 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574c0ac410 con 0x7f575c147c40 2024-08-18T22:26:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f575be00640 1 -- 172.21.15.5:0/1435881760 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c0ac7c0 con 0x7f575c147c40 2024-08-18T22:26:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 -- 172.21.15.5:0/1435881760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f575c147c40 msgr2=0x7f575c0b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 --2- 172.21.15.5:0/1435881760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f575c147c40 0x7f575c0b5de0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f574c0097c0 tx=0x7f574c01c4a0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 -- 172.21.15.5:0/1435881760 shutdown_connections 2024-08-18T22:26:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 --2- 172.21.15.5:0/1435881760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f575c147c40 0x7f575c0b5de0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 -- 172.21.15.5:0/1435881760 >> 172.21.15.5:0/1435881760 conn(0x7f575c0b3da0 msgr2=0x7f575c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 -- 172.21.15.5:0/1435881760 shutdown_connections 2024-08-18T22:26:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 -- 172.21.15.5:0/1435881760 wait complete. 2024-08-18T22:26:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 Processor -- start 2024-08-18T22:26:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 -- start start 2024-08-18T22:26:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f575c071470 0x7f575c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f575c0b7e80 0x7f575c160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f575c147c40 0x7f575c1611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f575c16c640 con 0x7f575c147c40 2024-08-18T22:26:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f575c16c4c0 con 0x7f575c0b7e80 2024-08-18T22:26:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.068+0000 7f5762600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f575c16c7c0 con 0x7f575c071470 2024-08-18T22:26:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5761c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f575c147c40 0x7f575c1611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5761c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f575c147c40 0x7f575c1611d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43210/0 (socket says 172.21.15.5:43210) 2024-08-18T22:26:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5761c00640 1 -- 172.21.15.5:0/3456448202 learned_addr learned my addr 172.21.15.5:0/3456448202 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5753e00640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f575c0b7e80 0x7f575c160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5761200640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f575c071470 0x7f575c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5761c00640 1 -- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f575c071470 msgr2=0x7f575c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5761c00640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f575c071470 0x7f575c15d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5761c00640 1 -- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f575c0b7e80 msgr2=0x7f575c160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5761c00640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f575c0b7e80 0x7f575c160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5761c00640 1 -- 172.21.15.5:0/3456448202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c144ed0 con 0x7f575c147c40 2024-08-18T22:26:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5761200640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f575c071470 0x7f575c15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:26:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5761c00640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f575c147c40 0x7f575c1611d0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f575400cad0 tx=0x7f575400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5759600640 1 -- 172.21.15.5:0/3456448202 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754017070 con 0x7f575c147c40 2024-08-18T22:26:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5759600640 1 -- 172.21.15.5:0/3456448202 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f575400ac30 con 0x7f575c147c40 2024-08-18T22:26:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5762600640 1 -- 172.21.15.5:0/3456448202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c1451b0 con 0x7f575c147c40 2024-08-18T22:26:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5759600640 1 -- 172.21.15.5:0/3456448202 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754012400 con 0x7f575c147c40 2024-08-18T22:26:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5762600640 1 -- 172.21.15.5:0/3456448202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c15db70 con 0x7f575c147c40 2024-08-18T22:26:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5759600640 1 -- 172.21.15.5:0/3456448202 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f575401a070 con 0x7f575c147c40 2024-08-18T22:26:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5759600640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57380678c0 0x7f5738069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.072+0000 7f5759600640 1 -- 172.21.15.5:0/3456448202 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f5754085bb0 con 0x7f575c147c40 2024-08-18T22:26:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761200640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57380678c0 0x7f5738069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 Processor -- start 2024-08-18T22:26:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 -- start start 2024-08-18T22:26:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761200640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57380678c0 0x7f5738069d80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f574c0ae000 tx=0x7f574c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd38d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd343d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd3446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5599dd24bc80 con 0x5599dd38d3f0 2024-08-18T22:26:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5599dd22ac30 con 0x5599dd3442c0 2024-08-18T22:26:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5599dd1912b0 con 0x5599dd38dd10 2024-08-18T22:26:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd38d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd38d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43218/0 (socket says 172.21.15.5:43218) 2024-08-18T22:26:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761200640 1 -- 172.21.15.5:0/1932610131 learned_addr learned my addr 172.21.15.5:0/1932610131 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5753e00640 1 --2- 172.21.15.5:0/1932610131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd343d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761c00640 1 --2- 172.21.15.5:0/1932610131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd3446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761200640 1 -- 172.21.15.5:0/1932610131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 msgr2=0x5599dd343d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761200640 1 --2- 172.21.15.5:0/1932610131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd343d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761200640 1 -- 172.21.15.5:0/1932610131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 msgr2=0x5599dd3446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761200640 1 --2- 172.21.15.5:0/1932610131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd3446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761200640 1 -- 172.21.15.5:0/1932610131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599dd23a070 con 0x5599dd38d3f0 2024-08-18T22:26:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5761200640 1 --2- 172.21.15.5:0/1932610131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd38d7d0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f574c008010 tx=0x7f574c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7484a1af8d405ff server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5751600640 1 -- 172.21.15.5:0/1932610131 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c0c8070 con 0x5599dd38d3f0 2024-08-18T22:26:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5751600640 1 -- 172.21.15.5:0/1932610131 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574c0b7950 con 0x5599dd38d3f0 2024-08-18T22:26:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f5751600640 1 -- 172.21.15.5:0/1932610131 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c0b1040 con 0x5599dd38d3f0 2024-08-18T22:26:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 -- 172.21.15.5:0/1932610131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 msgr2=0x5599dd38d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 --2- 172.21.15.5:0/1932610131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd38d7d0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f574c008010 tx=0x7f574c004740 comp rx=0 tx=0).stop 2024-08-18T22:26:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 -- 172.21.15.5:0/1932610131 shutdown_connections 2024-08-18T22:26:38.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 --2- 172.21.15.5:0/1932610131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd3446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 --2- 172.21.15.5:0/1932610131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd343d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 --2- 172.21.15.5:0/1932610131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd38d7d0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 -- 172.21.15.5:0/1932610131 >> 172.21.15.5:0/1932610131 conn(0x5599dd340270 msgr2=0x5599dd342660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 -- 172.21.15.5:0/1932610131 shutdown_connections 2024-08-18T22:26:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.076+0000 7f57671c3000 1 -- 172.21.15.5:0/1932610131 wait complete. 2024-08-18T22:26:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 -- start start 2024-08-18T22:26:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 Processor -- start 2024-08-18T22:26:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd38cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd34f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd34f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5599dd18d270 con 0x5599dd38d3f0 2024-08-18T22:26:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5599dd14b9b0 con 0x5599dd3442c0 2024-08-18T22:26:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5599dd132d10 con 0x5599dd38dd10 2024-08-18T22:26:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 10 client.0 _ll_register_callbacks cb 0x5599dd16ed80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:26:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5753e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd34f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5753e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd34f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43228/0 (socket says 172.21.15.5:43228) 2024-08-18T22:26:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5761200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd38cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5753e00640 1 -- 172.21.15.5:0/2577903222 learned_addr learned my addr 172.21.15.5:0/2577903222 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5761c00640 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd34f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5753e00640 1 -- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 msgr2=0x5599dd34f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5753e00640 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd34f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5753e00640 1 -- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 msgr2=0x5599dd38cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5753e00640 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd38cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5753e00640 1 -- 172.21.15.5:0/2577903222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599dd16e3b0 con 0x5599dd38d3f0 2024-08-18T22:26:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5761c00640 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd34f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:26:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5761200640 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd38cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:26:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5753e00640 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd34f400 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f5744001ea0 tx=0x7f5744012750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b82bd3afaa093fc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f574a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:26:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f574a000640 1 -- 172.21.15.5:0/2577903222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744019020 con 0x5599dd38d3f0 2024-08-18T22:26:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f574a000640 1 -- 172.21.15.5:0/2577903222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f57440052e0 con 0x5599dd38d3f0 2024-08-18T22:26:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 -- 172.21.15.5:0/2577903222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f574c0b7950 con 0x5599dd38d3f0 2024-08-18T22:26:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f574a000640 1 -- 172.21.15.5:0/2577903222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f5744023050 con 0x5599dd38d3f0 2024-08-18T22:26:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 10 client.7950 fetch_fsmap learned FSMap version 91 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 -- 172.21.15.5:0/2577903222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x5599dd1d7860 con 0x5599dd38d3f0 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f574a000640 1 -- 172.21.15.5:0/2577903222 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574c0b7950 con 0x5599dd38d3f0 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f574a000640 1 -- 172.21.15.5:0/2577903222 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f5744026020 con 0x5599dd38d3f0 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 10 client.7950 fetch_fsmap finished waiting for FSMap version 91 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 10 client.7950 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 20 client.7950 populate_metadata read hostname 'smithi005' 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x5599dd350350 0x5599dd350730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 4 client.7950 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f57671c3000 1 -- 172.21.15.5:0/2577903222 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599dd12be30 con 0x5599dd350350 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.080+0000 7f5761200640 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x5599dd350350 0x5599dd350730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f5761200640 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x5599dd350350 0x5599dd350730 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4873ef15c4dc6da1 server_cookie=515f7ae3e17d8bf9 in_seq=0 out_seq=0 2024-08-18T22:26:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f574a000640 10 client.7950 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f574a000640 1 -- 172.21.15.5:0/2577903222 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599dd12be30 con 0x5599dd350350 2024-08-18T22:26:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f574a000640 10 client.7950 handle_command_reply: tid=0 2024-08-18T22:26:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 1 client.7950 shutdown 2024-08-18T22:26:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 1 -- 172.21.15.5:0/2577903222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 msgr2=0x5599dd34f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd34f400 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f5744001ea0 tx=0x7f5744012750 comp rx=0 tx=0).stop 2024-08-18T22:26:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 1 -- 172.21.15.5:0/2577903222 shutdown_connections 2024-08-18T22:26:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x5599dd350350 0x5599dd350730 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd34f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd34f400 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 1 --2- 172.21.15.5:0/2577903222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd38cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 1 -- 172.21.15.5:0/2577903222 >> 172.21.15.5:0/2577903222 conn(0x5599dd340270 msgr2=0x5599dd342e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f574a000640 0 client.7950 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:38.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 1 -- 172.21.15.5:0/2577903222 shutdown_connections 2024-08-18T22:26:38.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 1 -- 172.21.15.5:0/2577903222 wait complete. 2024-08-18T22:26:38.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.084+0000 7f57671c3000 20 client.7950 trim_cache size 0 max 16384 2024-08-18T22:26:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 Processor -- start 2024-08-18T22:26:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 -- start start 2024-08-18T22:26:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd3a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38d3f0 0x5599dd34f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38dd10 0x5599dd34f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f575c2040e0 con 0x5599dd38dd10 2024-08-18T22:26:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f575c203160 con 0x5599dd3442c0 2024-08-18T22:26:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f575c0cc140 con 0x5599dd38d3f0 2024-08-18T22:26:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5761c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38dd10 0x5599dd34f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5761c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38dd10 0x5599dd34f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43244/0 (socket says 172.21.15.5:43244) 2024-08-18T22:26:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5761c00640 1 -- 172.21.15.5:0/2867461311 learned_addr learned my addr 172.21.15.5:0/2867461311 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:38.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5753e00640 1 --2- 172.21.15.5:0/2867461311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38d3f0 0x5599dd34f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5761200640 1 --2- 172.21.15.5:0/2867461311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd3a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5761c00640 1 -- 172.21.15.5:0/2867461311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38d3f0 msgr2=0x5599dd34f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5761c00640 1 --2- 172.21.15.5:0/2867461311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38d3f0 0x5599dd34f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5761c00640 1 -- 172.21.15.5:0/2867461311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 msgr2=0x5599dd3a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5761c00640 1 --2- 172.21.15.5:0/2867461311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd3a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5761c00640 1 -- 172.21.15.5:0/2867461311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599dd131ab0 con 0x5599dd38dd10 2024-08-18T22:26:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5761c00640 1 --2- 172.21.15.5:0/2867461311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38dd10 0x5599dd34f820 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f575400caa0 tx=0x7f575405a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af8d1d81f4fd5ff server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5750c00640 1 -- 172.21.15.5:0/2867461311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754081070 con 0x5599dd38dd10 2024-08-18T22:26:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5750c00640 1 -- 172.21.15.5:0/2867461311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5754071070 con 0x5599dd38dd10 2024-08-18T22:26:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f5750c00640 1 -- 172.21.15.5:0/2867461311 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575405e580 con 0x5599dd38dd10 2024-08-18T22:26:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 -- 172.21.15.5:0/2867461311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38dd10 msgr2=0x5599dd34f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 --2- 172.21.15.5:0/2867461311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38dd10 0x5599dd34f820 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f575400caa0 tx=0x7f575405a2a0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 -- 172.21.15.5:0/2867461311 shutdown_connections 2024-08-18T22:26:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 --2- 172.21.15.5:0/2867461311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38dd10 0x5599dd34f820 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 --2- 172.21.15.5:0/2867461311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38d3f0 0x5599dd34f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 --2- 172.21.15.5:0/2867461311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd3a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 -- 172.21.15.5:0/2867461311 >> 172.21.15.5:0/2867461311 conn(0x5599dd340270 msgr2=0x5599dd34ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 -- 172.21.15.5:0/2867461311 shutdown_connections 2024-08-18T22:26:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 -- 172.21.15.5:0/2867461311 wait complete. 2024-08-18T22:26:38.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 -- start start 2024-08-18T22:26:38.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.104+0000 7f57671c3000 1 Processor -- start 2024-08-18T22:26:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd400eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd4013f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd401930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5599dd213ab0 con 0x5599dd38d3f0 2024-08-18T22:26:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5599dd1958e0 con 0x5599dd3442c0 2024-08-18T22:26:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5599dd159180 con 0x5599dd38dd10 2024-08-18T22:26:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 10 client.0 _ll_register_callbacks cb 0x7f5744001390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:26:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5753e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd4013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5753e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd4013f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43260/0 (socket says 172.21.15.5:43260) 2024-08-18T22:26:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5753e00640 1 -- 172.21.15.5:0/1101941318 learned_addr learned my addr 172.21.15.5:0/1101941318 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:38.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5761c00640 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd401930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5761200640 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd400eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5753e00640 1 -- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 msgr2=0x5599dd401930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5753e00640 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd401930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5753e00640 1 -- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 msgr2=0x5599dd400eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5753e00640 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd400eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5753e00640 1 -- 172.21.15.5:0/1101941318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599dd213f40 con 0x5599dd38d3f0 2024-08-18T22:26:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5753e00640 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd4013f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f57440038b0 tx=0x7f5744000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c37dcc1be1e7b45 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f574a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f574a000640 1 -- 172.21.15.5:0/1101941318 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744019070 con 0x5599dd38d3f0 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f574a000640 1 -- 172.21.15.5:0/1101941318 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f57440052e0 con 0x5599dd38d3f0 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 1 -- 172.21.15.5:0/1101941318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5754071070 con 0x5599dd38d3f0 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f574a000640 1 -- 172.21.15.5:0/1101941318 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f5744033050 con 0x5599dd38d3f0 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 10 client.7956 fetch_fsmap learned FSMap version 91 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 1 -- 172.21.15.5:0/1101941318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x5599dd1eaa20 con 0x5599dd38d3f0 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f574a000640 1 -- 172.21.15.5:0/1101941318 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5754071070 con 0x5599dd38d3f0 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f574a000640 1 -- 172.21.15.5:0/1101941318 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f5744036020 con 0x5599dd38d3f0 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 10 client.7956 fetch_fsmap finished waiting for FSMap version 91 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 10 client.7956 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 20 client.7956 populate_metadata read hostname 'smithi005' 2024-08-18T22:26:38.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x5599dd3a2430 0x5599dd3a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 4 client.7956 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-08-18T22:26:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f57671c3000 1 -- 172.21.15.5:0/1101941318 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x5599dd19e9e0 con 0x5599dd3a2430 2024-08-18T22:26:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5761200640 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x5599dd3a2430 0x5599dd3a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f5761200640 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x5599dd3a2430 0x5599dd3a2840 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50970aec96418720 server_cookie=b8681581911a4647 in_seq=0 out_seq=0 2024-08-18T22:26:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.108+0000 7f574a000640 10 client.7956 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:38.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f574a000640 1 -- 172.21.15.5:0/1101941318 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5599dd19e9e0 con 0x5599dd3a2430 2024-08-18T22:26:38.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f574a000640 10 client.7956 handle_command_reply: tid=0 2024-08-18T22:26:38.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 1 client.7956 shutdown 2024-08-18T22:26:38.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 1 -- 172.21.15.5:0/1101941318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 msgr2=0x5599dd4013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd4013f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f57440038b0 tx=0x7f5744000ee0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 1 -- 172.21.15.5:0/1101941318 shutdown_connections 2024-08-18T22:26:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x5599dd3a2430 0x5599dd3a2840 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5599dd38dd10 0x5599dd401930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599dd38d3f0 0x5599dd4013f0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 1 --2- 172.21.15.5:0/1101941318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599dd3442c0 0x5599dd400eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f574a000640 0 client.7956 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 1 -- 172.21.15.5:0/1101941318 >> 172.21.15.5:0/1101941318 conn(0x5599dd340270 msgr2=0x5599dd34f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 1 -- 172.21.15.5:0/1101941318 shutdown_connections 2024-08-18T22:26:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 1 -- 172.21.15.5:0/1101941318 wait complete. 2024-08-18T22:26:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f57671c3000 20 client.7956 trim_cache size 0 max 16384 2024-08-18T22:26:38.120 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:26:38.120 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:26:38.120 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "8bb4eba1-2f7c-4062-a46b-bb755dcde916", 2024-08-18T22:26:38.120 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:26:38.120 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:26:38.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f5762600640 1 -- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57380678c0 msgr2=0x7f5738069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f5762600640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57380678c0 0x7f5738069d80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f574c0ae000 tx=0x7f574c008040 comp rx=0 tx=0).stop 2024-08-18T22:26:38.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f5762600640 1 -- 172.21.15.5:0/3456448202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f575c147c40 msgr2=0x7f575c1611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.116+0000 7f5762600640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f575c147c40 0x7f575c1611d0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f575400cad0 tx=0x7f575400cf90 comp rx=0 tx=0).stop 2024-08-18T22:26:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.120+0000 7f5762600640 1 -- 172.21.15.5:0/3456448202 shutdown_connections 2024-08-18T22:26:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.120+0000 7f5762600640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57380678c0 0x7f5738069d80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.120+0000 7f5762600640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f575c147c40 0x7f575c1611d0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.120+0000 7f5762600640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f575c0b7e80 0x7f575c160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.120+0000 7f5762600640 1 --2- 172.21.15.5:0/3456448202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f575c071470 0x7f575c15d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.120+0000 7f5762600640 1 -- 172.21.15.5:0/3456448202 >> 172.21.15.5:0/3456448202 conn(0x7f575c0b3da0 msgr2=0x7f575c141810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.120+0000 7f5762600640 1 -- 172.21.15.5:0/3456448202 shutdown_connections 2024-08-18T22:26:38.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.120+0000 7f5762600640 1 -- 172.21.15.5:0/3456448202 wait complete. 2024-08-18T22:26:38.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:26:38.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-08-18T22:26:38.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c1d600640 1 Processor -- start 2024-08-18T22:26:38.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c1d600640 1 -- start start 2024-08-18T22:26:38.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c1d600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c180b55f0 0x7f1c180b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c1d600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c1806eae0 con 0x7f1c1815e060 2024-08-18T22:26:38.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c1d600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c18071440 con 0x7f1c180b3fe0 2024-08-18T22:26:38.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c1d600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1c180b4990 con 0x7f1c180b55f0 2024-08-18T22:26:38.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c17e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1c1815e060 0x7f1c18071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35172/0 (socket says 172.21.15.5:35172) 2024-08-18T22:26:38.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c1cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c180b55f0 0x7f1c180b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c17e00640 1 -- 172.21.15.5:0/2587542022 learned_addr learned my addr 172.21.15.5:0/2587542022 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:26:38.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c1cc00640 1 -- 172.21.15.5:0/2587542022 >> v1:172.21.15.117:6789/0 conn(0x7f1c180b3fe0 legacy=0x7f1c180b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c1cc00640 1 -- 172.21.15.5:0/2587542022 >> v1:172.21.15.5:6789/0 conn(0x7f1c1815e060 legacy=0x7f1c18071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.316+0000 7f1c1cc00640 1 -- 172.21.15.5:0/2587542022 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1806e800 con 0x7f1c180b55f0 2024-08-18T22:26:38.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.320+0000 7f1c1cc00640 1 --2- 172.21.15.5:0/2587542022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c180b55f0 0x7f1c180b4450 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009d90 tx=0x7f1c1001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bcb023deafaf3c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.320+0000 7f1c16a00640 1 -- 172.21.15.5:0/2587542022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c100b2070 con 0x7f1c180b55f0 2024-08-18T22:26:38.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.320+0000 7f1c16a00640 1 -- 172.21.15.5:0/2587542022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c100a59c0 con 0x7f1c180b55f0 2024-08-18T22:26:38.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.320+0000 7f1c16a00640 1 -- 172.21.15.5:0/2587542022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c100a5d90 con 0x7f1c180b55f0 2024-08-18T22:26:38.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.320+0000 7f1c1d600640 1 -- 172.21.15.5:0/2587542022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c180b55f0 msgr2=0x7f1c180b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.320+0000 7f1c1d600640 1 --2- 172.21.15.5:0/2587542022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c180b55f0 0x7f1c180b4450 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009d90 tx=0x7f1c1001c8e0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.320+0000 7f1c1d600640 1 -- 172.21.15.5:0/2587542022 shutdown_connections 2024-08-18T22:26:38.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.320+0000 7f1c1d600640 1 --2- 172.21.15.5:0/2587542022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c180b55f0 0x7f1c180b4450 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.320+0000 7f1c1d600640 1 -- 172.21.15.5:0/2587542022 >> 172.21.15.5:0/2587542022 conn(0x7f1c18067a70 msgr2=0x7f1c18067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.320+0000 7f1c1d600640 1 -- 172.21.15.5:0/2587542022 shutdown_connections 2024-08-18T22:26:38.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.320+0000 7f1c1d600640 1 -- 172.21.15.5:0/2587542022 wait complete. 2024-08-18T22:26:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c1d600640 1 Processor -- start 2024-08-18T22:26:38.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c1d600640 1 -- start start 2024-08-18T22:26:38.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c1d600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c180b3fe0 0x7f1c1815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c1d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c180b55f0 0x7f1c1815cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c1d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815e060 0x7f1c18159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c1d600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1806e3f0 con 0x7f1c180b55f0 2024-08-18T22:26:38.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c1d600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1806e270 con 0x7f1c180b3fe0 2024-08-18T22:26:38.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c1d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1806e570 con 0x7f1c1815e060 2024-08-18T22:26:38.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c180b55f0 0x7f1c1815cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c180b55f0 0x7f1c1815cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43276/0 (socket says 172.21.15.5:43276) 2024-08-18T22:26:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c17400640 1 -- 172.21.15.5:0/4112085907 learned_addr learned my addr 172.21.15.5:0/4112085907 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c1cc00640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815e060 0x7f1c18159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c17e00640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c180b3fe0 0x7f1c1815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c17400640 1 -- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815e060 msgr2=0x7f1c18159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c17400640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815e060 0x7f1c18159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c17400640 1 -- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c180b3fe0 msgr2=0x7f1c1815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.324+0000 7f1c17400640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c180b3fe0 0x7f1c1815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.328+0000 7f1c17400640 1 -- 172.21.15.5:0/4112085907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1815b360 con 0x7f1c180b55f0 2024-08-18T22:26:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.328+0000 7f1c17400640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c180b55f0 0x7f1c1815cbb0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400c3f0 tx=0x7f1c0400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.328+0000 7f1c0fe00640 1 -- 172.21.15.5:0/4112085907 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c04017070 con 0x7f1c180b55f0 2024-08-18T22:26:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.328+0000 7f1c0fe00640 1 -- 172.21.15.5:0/4112085907 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c040052d0 con 0x7f1c180b55f0 2024-08-18T22:26:38.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.328+0000 7f1c1d600640 1 -- 172.21.15.5:0/4112085907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c1815ada0 con 0x7f1c180b55f0 2024-08-18T22:26:38.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.328+0000 7f1c0fe00640 1 -- 172.21.15.5:0/4112085907 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c04003840 con 0x7f1c180b55f0 2024-08-18T22:26:38.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.328+0000 7f1c1d600640 1 -- 172.21.15.5:0/4112085907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c1815e7a0 con 0x7f1c180b55f0 2024-08-18T22:26:38.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.328+0000 7f1c0fe00640 1 -- 172.21.15.5:0/4112085907 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c0401a070 con 0x7f1c180b55f0 2024-08-18T22:26:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c0fe00640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1bf80678c0 0x7f1bf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c0fe00640 1 -- 172.21.15.5:0/4112085907 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f1c04085220 con 0x7f1c180b55f0 2024-08-18T22:26:38.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17e00640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1bf80678c0 0x7f1bf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 Processor -- start 2024-08-18T22:26:38.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 -- start start 2024-08-18T22:26:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17e00640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1bf80678c0 0x7f1bf8069d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1c08005890 tx=0x7f1c08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 0x55f100a99d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100a4cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a4d500 0x55f100a4d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f100936ae0 con 0x55f100a999a0 2024-08-18T22:26:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f100922ba0 con 0x55f100a9a2c0 2024-08-18T22:26:38.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f10089d4f0 con 0x55f100a4d500 2024-08-18T22:26:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 0x55f100a99d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 0x55f100a99d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43288/0 (socket says 172.21.15.5:43288) 2024-08-18T22:26:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17e00640 1 -- 172.21.15.5:0/1123357787 learned_addr learned my addr 172.21.15.5:0/1123357787 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c1cc00640 1 --2- 172.21.15.5:0/1123357787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a4d500 0x55f100a4d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17400640 1 --2- 172.21.15.5:0/1123357787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100a4cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17e00640 1 -- 172.21.15.5:0/1123357787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a4d500 msgr2=0x55f100a4d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17e00640 1 --2- 172.21.15.5:0/1123357787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a4d500 0x55f100a4d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17e00640 1 -- 172.21.15.5:0/1123357787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 msgr2=0x55f100a4cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17e00640 1 --2- 172.21.15.5:0/1123357787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100a4cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17e00640 1 -- 172.21.15.5:0/1123357787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f10083da90 con 0x55f100a999a0 2024-08-18T22:26:38.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c17e00640 1 --2- 172.21.15.5:0/1123357787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 0x55f100a99d80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800fb70 tx=0x7f1c08012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67316e361fe74b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c0cc00640 1 -- 172.21.15.5:0/1123357787 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08025070 con 0x55f100a999a0 2024-08-18T22:26:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c0cc00640 1 -- 172.21.15.5:0/1123357787 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0801b050 con 0x55f100a999a0 2024-08-18T22:26:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c0cc00640 1 -- 172.21.15.5:0/1123357787 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08020410 con 0x55f100a999a0 2024-08-18T22:26:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1123357787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 msgr2=0x55f100a99d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/1123357787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 0x55f100a99d80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800fb70 tx=0x7f1c08012000 comp rx=0 tx=0).stop 2024-08-18T22:26:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1123357787 shutdown_connections 2024-08-18T22:26:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/1123357787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a4d500 0x55f100a4d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/1123357787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100a4cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/1123357787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 0x55f100a99d80 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1123357787 >> 172.21.15.5:0/1123357787 conn(0x55f100a47010 msgr2=0x55f100a7c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1123357787 shutdown_connections 2024-08-18T22:26:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.332+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1123357787 wait complete. 2024-08-18T22:26:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 -- start start 2024-08-18T22:26:38.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 Processor -- start 2024-08-18T22:26:38.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a4d500 0x55f100a7a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a999a0 0x55f100a550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a9a2c0 0x55f100a555f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f1008994b0 con 0x55f100a9a2c0 2024-08-18T22:26:38.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f100857b50 con 0x55f100a4d500 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f10083ed00 con 0x55f100a999a0 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 10 client.0 _ll_register_callbacks cb 0x55f100a3af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c1cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a9a2c0 0x55f100a555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c1cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a9a2c0 0x55f100a555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43292/0 (socket says 172.21.15.5:43292) 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c1cc00640 1 -- 172.21.15.5:0/17093979 learned_addr learned my addr 172.21.15.5:0/17093979 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c17e00640 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a4d500 0x55f100a7a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c17400640 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a999a0 0x55f100a550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c1cc00640 1 -- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a999a0 msgr2=0x55f100a550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c1cc00640 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a999a0 0x55f100a550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c1cc00640 1 -- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a4d500 msgr2=0x55f100a7a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c1cc00640 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a4d500 0x55f100a7a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c1cc00640 1 -- 172.21.15.5:0/17093979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f100856060 con 0x55f100a9a2c0 2024-08-18T22:26:38.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c17e00640 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a4d500 0x55f100a7a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c1cc00640 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a9a2c0 0x55f100a555f0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f1c1001a510 tx=0x7f1c1001b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b256ab91e998aa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c01600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c01600640 1 -- 172.21.15.5:0/17093979 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c100b2040 con 0x55f100a9a2c0 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c01600640 1 -- 172.21.15.5:0/17093979 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f1c100a5df0 con 0x55f100a9a2c0 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 -- 172.21.15.5:0/17093979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c0801b050 con 0x55f100a9a2c0 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c01600640 1 -- 172.21.15.5:0/17093979 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f1c100cc050 con 0x55f100a9a2c0 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 10 client.7971 fetch_fsmap learned FSMap version 91 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 -- 172.21.15.5:0/17093979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x55f100869f50 con 0x55f100a9a2c0 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c01600640 1 -- 172.21.15.5:0/17093979 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0801b050 con 0x55f100a9a2c0 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c01600640 1 -- 172.21.15.5:0/17093979 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f1c100cf020 con 0x55f100a9a2c0 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 10 client.7971 fetch_fsmap finished waiting for FSMap version 91 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 10 client.7971 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 20 client.7971 populate_metadata read hostname 'smithi005' 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f100a7c090 0x55f100aabc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 4 client.7971 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:26:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c21fe2000 1 -- 172.21.15.5:0/17093979 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f100837e10 con 0x55f100a7c090 2024-08-18T22:26:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.336+0000 7f1c17e00640 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f100a7c090 0x55f100aabc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c17e00640 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f100a7c090 0x55f100aabc60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31d38b962794d1c4 server_cookie=bc751e1c6846183d in_seq=0 out_seq=0 2024-08-18T22:26:38.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c01600640 10 client.7971 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c01600640 1 -- 172.21.15.5:0/17093979 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f100837e10 con 0x55f100a7c090 2024-08-18T22:26:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c01600640 10 client.7971 handle_command_reply: tid=0 2024-08-18T22:26:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 1 client.7971 shutdown 2024-08-18T22:26:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 1 -- 172.21.15.5:0/17093979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a9a2c0 msgr2=0x55f100a555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a9a2c0 0x55f100a555f0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f1c1001a510 tx=0x7f1c1001b120 comp rx=0 tx=0).stop 2024-08-18T22:26:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 1 -- 172.21.15.5:0/17093979 shutdown_connections 2024-08-18T22:26:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f100a7c090 0x55f100aabc60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a9a2c0 0x55f100a555f0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a999a0 0x55f100a550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/17093979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a4d500 0x55f100a7a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c01600640 0 client.7971 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:38.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 1 -- 172.21.15.5:0/17093979 >> 172.21.15.5:0/17093979 conn(0x55f100a47010 msgr2=0x55f100a4c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 1 -- 172.21.15.5:0/17093979 shutdown_connections 2024-08-18T22:26:38.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 1 -- 172.21.15.5:0/17093979 wait complete. 2024-08-18T22:26:38.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.340+0000 7f1c21fe2000 20 client.7971 trim_cache size 0 max 16384 2024-08-18T22:26:38.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.356+0000 7f1c21fe2000 1 Processor -- start 2024-08-18T22:26:38.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.356+0000 7f1c21fe2000 1 -- start start 2024-08-18T22:26:38.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a4d500 0x55f100a4c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a999a0 0x55f100a4cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100aabc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1c18203bf0 con 0x55f100a4d500 2024-08-18T22:26:38.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c18202cc0 con 0x55f100a9a2c0 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1815fd10 con 0x55f100a999a0 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c17e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a4d500 0x55f100a4c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c17e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a4d500 0x55f100a4c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43300/0 (socket says 172.21.15.5:43300) 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c17e00640 1 -- 172.21.15.5:0/4147683478 learned_addr learned my addr 172.21.15.5:0/4147683478 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c1cc00640 1 --2- 172.21.15.5:0/4147683478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100aabc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c17400640 1 --2- 172.21.15.5:0/4147683478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a999a0 0x55f100a4cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c17e00640 1 -- 172.21.15.5:0/4147683478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a999a0 msgr2=0x55f100a4cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c17e00640 1 --2- 172.21.15.5:0/4147683478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a999a0 0x55f100a4cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c17e00640 1 -- 172.21.15.5:0/4147683478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 msgr2=0x55f100aabc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c17e00640 1 --2- 172.21.15.5:0/4147683478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100aabc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c17e00640 1 -- 172.21.15.5:0/4147683478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f10091fdd0 con 0x55f100a4d500 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c17400640 1 --2- 172.21.15.5:0/4147683478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a999a0 0x55f100a4cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:26:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c17e00640 1 --2- 172.21.15.5:0/4147683478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a4d500 0x55f100a4c7a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f1c08020000 tx=0x7f1c08015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b318f0938bb6d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c03e00640 1 -- 172.21.15.5:0/4147683478 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08025040 con 0x55f100a4d500 2024-08-18T22:26:38.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c03e00640 1 -- 172.21.15.5:0/4147683478 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c08031030 con 0x55f100a4d500 2024-08-18T22:26:38.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c03e00640 1 -- 172.21.15.5:0/4147683478 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c080336f0 con 0x55f100a4d500 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 -- 172.21.15.5:0/4147683478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a4d500 msgr2=0x55f100a4c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/4147683478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a4d500 0x55f100a4c7a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f1c08020000 tx=0x7f1c08015000 comp rx=0 tx=0).stop 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 -- 172.21.15.5:0/4147683478 shutdown_connections 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/4147683478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100aabc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/4147683478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a999a0 0x55f100a4cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/4147683478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a4d500 0x55f100a4c7a0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 -- 172.21.15.5:0/4147683478 >> 172.21.15.5:0/4147683478 conn(0x55f100a47010 msgr2=0x55f100a7a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 -- 172.21.15.5:0/4147683478 shutdown_connections 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 -- 172.21.15.5:0/4147683478 wait complete. 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 -- start start 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.360+0000 7f1c21fe2000 1 Processor -- start 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a4d500 0x55f100aae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 0x55f100aae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100ac9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f10095a240 con 0x55f100a999a0 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f10089c800 con 0x55f100a9a2c0 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f1008687f0 con 0x55f100a4d500 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 10 client.0 _ll_register_callbacks cb 0x7f1c100a5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 0x55f100aae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a4d500 0x55f100aae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a4d500 0x55f100aae400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:43998/0 (socket says 172.21.15.5:43998) 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17e00640 1 -- 172.21.15.5:0/1433490135 learned_addr learned my addr 172.21.15.5:0/1433490135 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c1cc00640 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100ac9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17400640 1 -- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a4d500 msgr2=0x55f100aae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17400640 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a4d500 0x55f100aae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17400640 1 -- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 msgr2=0x55f100ac9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17400640 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100ac9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17400640 1 -- 172.21.15.5:0/1433490135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f100830cd0 con 0x55f100a999a0 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c1cc00640 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100ac9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17400640 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 0x55f100aae940 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f1c040834d0 tx=0x7f1c04085050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d756cb10a903d34a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c01600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c01600640 1 -- 172.21.15.5:0/1433490135 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0407ce60 con 0x55f100a999a0 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c01600640 1 -- 172.21.15.5:0/1433490135 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f1c0406d1d0 con 0x55f100a999a0 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1433490135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c08031030 con 0x55f100a999a0 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c01600640 1 -- 172.21.15.5:0/1433490135 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f1c0405dff0 con 0x55f100a999a0 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 10 client.7977 fetch_fsmap learned FSMap version 91 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1433490135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x55f100843320 con 0x55f100a999a0 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c01600640 1 -- 172.21.15.5:0/1433490135 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c08031030 con 0x55f100a999a0 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c01600640 1 -- 172.21.15.5:0/1433490135 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f1c04054880 con 0x55f100a999a0 2024-08-18T22:26:38.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 10 client.7977 fetch_fsmap finished waiting for FSMap version 91 2024-08-18T22:26:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 10 client.7977 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-08-18T22:26:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 20 client.7977 populate_metadata read hostname 'smithi005' 2024-08-18T22:26:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f100aca910 0x55f100b0d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:26:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 4 client.7977 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:26:38.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1433490135 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f1008aac20 con 0x55f100aca910 2024-08-18T22:26:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17e00640 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f100aca910 0x55f100b0d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:26:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c17e00640 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f100aca910 0x55f100b0d7a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=369864bec39b9783 server_cookie=37262412757ca0b7 in_seq=0 out_seq=0 2024-08-18T22:26:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c01600640 10 client.7977 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c01600640 1 -- 172.21.15.5:0/1433490135 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+257 (crc 0 0 0) 0x55f1008aac20 con 0x55f100aca910 2024-08-18T22:26:38.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c01600640 10 client.7977 handle_command_reply: tid=0 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 client.7977 shutdown 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1433490135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 msgr2=0x55f100aae940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 0x55f100aae940 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f1c040834d0 tx=0x7f1c04085050 comp rx=0 tx=0).stop 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1433490135 shutdown_connections 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f100aca910 0x55f100b0d7a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f100a9a2c0 0x55f100ac9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f100a999a0 0x55f100aae940 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 --2- 172.21.15.5:0/1433490135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f100a4d500 0x55f100aae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c01600640 0 client.7977 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1433490135 >> 172.21.15.5:0/1433490135 conn(0x55f100a47010 msgr2=0x55f100a7ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1433490135 shutdown_connections 2024-08-18T22:26:38.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 1 -- 172.21.15.5:0/1433490135 wait complete. 2024-08-18T22:26:38.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.364+0000 7f1c21fe2000 20 client.7977 trim_cache size 0 max 16384 2024-08-18T22:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-18T22:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-18T22:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout: "8bb4eba1-2f7c-4062-a46b-bb755dcde916": { 2024-08-18T22:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "~mds0", 2024-08-18T22:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "8bb4eba1-2f7c-4062-a46b-bb755dcde916", 2024-08-18T22:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive" 2024-08-18T22:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:26:38.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 -- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1bf80678c0 msgr2=0x7f1bf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1bf80678c0 0x7f1bf8069d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1c08005890 tx=0x7f1c08009040 comp rx=0 tx=0).stop 2024-08-18T22:26:38.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 -- 172.21.15.5:0/4112085907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c180b55f0 msgr2=0x7f1c1815cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:26:38.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c180b55f0 0x7f1c1815cbb0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400c3f0 tx=0x7f1c0400c8b0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 -- 172.21.15.5:0/4112085907 shutdown_connections 2024-08-18T22:26:38.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1bf80678c0 0x7f1bf8069d80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815e060 0x7f1c18159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c180b55f0 0x7f1c1815cbb0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 --2- 172.21.15.5:0/4112085907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c180b3fe0 0x7f1c1815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:26:38.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 -- 172.21.15.5:0/4112085907 >> 172.21.15.5:0/4112085907 conn(0x7f1c18067a70 msgr2=0x7f1c180d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:26:38.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 -- 172.21.15.5:0/4112085907 shutdown_connections 2024-08-18T22:26:38.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:26:38.368+0000 7f1c1d600640 1 -- 172.21.15.5:0/4112085907 wait complete. 2024-08-18T22:26:38.387 INFO:tasks.cephfs.filesystem:scrub status for tag:8bb4eba1-2f7c-4062-a46b-bb755dcde916 - {'path': '~mds0', 'tag': '8bb4eba1-2f7c-4062-a46b-bb755dcde916', 'options': 'recursive'} 2024-08-18T22:26:52.686 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:26:52.698 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:27:08.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:08.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-08-18T22:27:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6ff5400640 1 Processor -- start 2024-08-18T22:27:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6ff5400640 1 -- start start 2024-08-18T22:27:08.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6ff5400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ff015fb80 0x7f6ff00d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6ff5400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ff00d1090 0x7f6ff0071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6ff5400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff00d30b0 con 0x7f6ff00b5ad0 2024-08-18T22:27:08.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6ff5400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff00d1eb0 con 0x7f6ff00d1090 2024-08-18T22:27:08.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6ff5400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff00d1bd0 con 0x7f6ff015fb80 2024-08-18T22:27:08.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6fef200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ff00d1090 0x7f6ff0071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6fef200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6ff00d1090 0x7f6ff0071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50690/0 (socket says 172.21.15.5:50690) 2024-08-18T22:27:08.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6fef200640 1 -- 172.21.15.5:0/42745524 learned_addr learned my addr 172.21.15.5:0/42745524 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6fee800640 1 --2- 172.21.15.5:0/42745524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ff015fb80 0x7f6ff00d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6fef200640 1 -- 172.21.15.5:0/42745524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ff015fb80 msgr2=0x7f6ff00d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6fef200640 1 --2- 172.21.15.5:0/42745524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ff015fb80 0x7f6ff00d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6fef200640 1 -- 172.21.15.5:0/42745524 >> v1:172.21.15.117:6789/0 conn(0x7f6ff00b5ad0 legacy=0x7f6ff006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.544+0000 7f6fef200640 1 -- 172.21.15.5:0/42745524 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff00d2dd0 con 0x7f6ff00d1090 2024-08-18T22:27:08.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6fef200640 1 --2- 172.21.15.5:0/42745524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1090 0x7f6ff0071550 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009e50 tx=0x7f6fe801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b67f9df60ed5fef server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6fed400640 1 -- 172.21.15.5:0/42745524 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80a55d0 con 0x7f6ff00d1090 2024-08-18T22:27:08.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6fed400640 1 -- 172.21.15.5:0/42745524 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe80a5770 con 0x7f6ff00d1090 2024-08-18T22:27:08.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6fed400640 1 -- 172.21.15.5:0/42745524 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80a5b40 con 0x7f6ff00d1090 2024-08-18T22:27:08.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6ff5400640 1 -- 172.21.15.5:0/42745524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1090 msgr2=0x7f6ff0071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6ff5400640 1 --2- 172.21.15.5:0/42745524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1090 0x7f6ff0071550 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009e50 tx=0x7f6fe801c910 comp rx=0 tx=0).stop 2024-08-18T22:27:08.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6ff5400640 1 -- 172.21.15.5:0/42745524 shutdown_connections 2024-08-18T22:27:08.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6ff5400640 1 --2- 172.21.15.5:0/42745524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1090 0x7f6ff0071550 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6ff5400640 1 --2- 172.21.15.5:0/42745524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ff015fb80 0x7f6ff00d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6ff5400640 1 -- 172.21.15.5:0/42745524 >> 172.21.15.5:0/42745524 conn(0x7f6ff00d2180 msgr2=0x7f6ff00d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6ff5400640 1 -- 172.21.15.5:0/42745524 shutdown_connections 2024-08-18T22:27:08.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.548+0000 7f6ff5400640 1 -- 172.21.15.5:0/42745524 wait complete. 2024-08-18T22:27:08.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6ff5400640 1 Processor -- start 2024-08-18T22:27:08.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6ff5400640 1 -- start start 2024-08-18T22:27:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6ff5400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ff00b5ad0 0x7f6ff0148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6ff5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1090 0x7f6ff00b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6ff5400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ff015fb80 0x7f6ff00b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6ff5400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff0169270 con 0x7f6ff00d1090 2024-08-18T22:27:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6ff5400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff01690f0 con 0x7f6ff015fb80 2024-08-18T22:27:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6ff5400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff01693f0 con 0x7f6ff00b5ad0 2024-08-18T22:27:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fede00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1090 0x7f6ff00b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fede00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1090 0x7f6ff00b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50698/0 (socket says 172.21.15.5:50698) 2024-08-18T22:27:08.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fede00640 1 -- 172.21.15.5:0/1982567391 learned_addr learned my addr 172.21.15.5:0/1982567391 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fee800640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ff00b5ad0 0x7f6ff0148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fef200640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ff015fb80 0x7f6ff00b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fede00640 1 -- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ff00b5ad0 msgr2=0x7f6ff0148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fede00640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ff00b5ad0 0x7f6ff0148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fede00640 1 -- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ff015fb80 msgr2=0x7f6ff00b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fede00640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ff015fb80 0x7f6ff00b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fede00640 1 -- 172.21.15.5:0/1982567391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff00af420 con 0x7f6ff00d1090 2024-08-18T22:27:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fede00640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1090 0x7f6ff00b0bc0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c460 tx=0x7f6fdc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fe6a00640 1 -- 172.21.15.5:0/1982567391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc016020 con 0x7f6ff00d1090 2024-08-18T22:27:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fe6a00640 1 -- 172.21.15.5:0/1982567391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc0052d0 con 0x7f6ff00d1090 2024-08-18T22:27:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6fe6a00640 1 -- 172.21.15.5:0/1982567391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc007260 con 0x7f6ff00d1090 2024-08-18T22:27:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6ff5400640 1 -- 172.21.15.5:0/1982567391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff00af700 con 0x7f6ff00d1090 2024-08-18T22:27:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.552+0000 7f6ff5400640 1 -- 172.21.15.5:0/1982567391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff0156d80 con 0x7f6ff00d1090 2024-08-18T22:27:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.556+0000 7f6fe6a00640 1 -- 172.21.15.5:0/1982567391 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6fdc007400 con 0x7f6ff00d1090 2024-08-18T22:27:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.556+0000 7f6fe6a00640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fd00678c0 0x7f6fd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.556+0000 7f6fe6a00640 1 -- 172.21.15.5:0/1982567391 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f6fdc0856b0 con 0x7f6ff00d1090 2024-08-18T22:27:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.556+0000 7f6ff8981000 1 Processor -- start 2024-08-18T22:27:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.556+0000 7f6ff8981000 1 -- start start 2024-08-18T22:27:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.556+0000 7f6fee800640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fd00678c0 0x7f6fd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fee800640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fd00678c0 0x7f6fd0069d80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00079c0 tx=0x7f6fe0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 0x55ae03d2e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2e7f0 0x55ae03ce13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03ce1910 0x55ae03ce1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ae03bc6ae0 con 0x55ae03d2e7f0 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ae03bb2ba0 con 0x55ae03d2ded0 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ae03b2d4f0 con 0x55ae03ce1910 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fede00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2e7f0 0x55ae03ce13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fede00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2e7f0 0x55ae03ce13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50714/0 (socket says 172.21.15.5:50714) 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fede00640 1 -- 172.21.15.5:0/2935377021 learned_addr learned my addr 172.21.15.5:0/2935377021 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fede00640 1 -- 172.21.15.5:0/2935377021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03ce1910 msgr2=0x55ae03ce1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fef200640 1 --2- 172.21.15.5:0/2935377021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03ce1910 0x55ae03ce1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fee800640 1 --2- 172.21.15.5:0/2935377021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 0x55ae03d2e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fede00640 1 --2- 172.21.15.5:0/2935377021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03ce1910 0x55ae03ce1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fede00640 1 -- 172.21.15.5:0/2935377021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 msgr2=0x55ae03d2e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fede00640 1 --2- 172.21.15.5:0/2935377021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 0x55ae03d2e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fede00640 1 -- 172.21.15.5:0/2935377021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae03acda90 con 0x55ae03d2e7f0 2024-08-18T22:27:08.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fee800640 1 --2- 172.21.15.5:0/2935377021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 0x55ae03d2e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:08.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fef200640 1 --2- 172.21.15.5:0/2935377021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03ce1910 0x55ae03ce1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:08.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fede00640 1 --2- 172.21.15.5:0/2935377021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2e7f0 0x55ae03ce13d0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc083980 tx=0x7f6fdc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee55f1fc5fafef19 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fdb400640 1 -- 172.21.15.5:0/2935377021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc05ae60 con 0x55ae03d2e7f0 2024-08-18T22:27:08.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fdb400640 1 -- 172.21.15.5:0/2935377021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc05e500 con 0x55ae03d2e7f0 2024-08-18T22:27:08.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6fdb400640 1 -- 172.21.15.5:0/2935377021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc052040 con 0x55ae03d2e7f0 2024-08-18T22:27:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 -- 172.21.15.5:0/2935377021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2e7f0 msgr2=0x55ae03ce13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 --2- 172.21.15.5:0/2935377021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2e7f0 0x55ae03ce13d0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc083980 tx=0x7f6fdc011000 comp rx=0 tx=0).stop 2024-08-18T22:27:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 -- 172.21.15.5:0/2935377021 shutdown_connections 2024-08-18T22:27:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 --2- 172.21.15.5:0/2935377021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03ce1910 0x55ae03ce1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 --2- 172.21.15.5:0/2935377021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2e7f0 0x55ae03ce13d0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 --2- 172.21.15.5:0/2935377021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 0x55ae03d2e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 -- 172.21.15.5:0/2935377021 >> 172.21.15.5:0/2935377021 conn(0x55ae03cd7010 msgr2=0x55ae03d0c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 -- 172.21.15.5:0/2935377021 shutdown_connections 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 -- 172.21.15.5:0/2935377021 wait complete. 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 -- start start 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.560+0000 7f6ff8981000 1 Processor -- start 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03ce1910 0x55ae03d0e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 0x55ae03d0e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03d2e7f0 0x55ae03d0ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ae03b294b0 con 0x55ae03ce1910 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ae03ae7b50 con 0x55ae03d2ded0 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ae03aced00 con 0x55ae03d2e7f0 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 10 client.0 _ll_register_callbacks cb 0x55ae03ccaf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fee800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03ce1910 0x55ae03d0e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fee800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03ce1910 0x55ae03d0e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50720/0 (socket says 172.21.15.5:50720) 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fee800640 1 -- 172.21.15.5:0/3017092707 learned_addr learned my addr 172.21.15.5:0/3017092707 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fee800640 1 -- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03d2e7f0 msgr2=0x55ae03d0ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fef200640 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03d2e7f0 0x55ae03d0ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fede00640 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 0x55ae03d0e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fee800640 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03d2e7f0 0x55ae03d0ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fee800640 1 -- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 msgr2=0x55ae03d0e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fee800640 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 0x55ae03d0e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fee800640 1 -- 172.21.15.5:0/3017092707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae03ae6060 con 0x55ae03ce1910 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fede00640 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 0x55ae03d0e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fef200640 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03d2e7f0 0x55ae03d0ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fee800640 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03ce1910 0x55ae03d0e3a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0016a00 tx=0x7f6fe0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbffab1c2caff5a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fcfe00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fcfe00640 1 -- 172.21.15.5:0/3017092707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0010e40 con 0x55ae03ce1910 2024-08-18T22:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fcfe00640 1 -- 172.21.15.5:0/3017092707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f6fe0014bc0 con 0x55ae03ce1910 2024-08-18T22:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 1 -- 172.21.15.5:0/3017092707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fdc05e500 con 0x55ae03ce1910 2024-08-18T22:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fcfe00640 1 -- 172.21.15.5:0/3017092707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f6fe002f050 con 0x55ae03ce1910 2024-08-18T22:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 10 client.7989 fetch_fsmap learned FSMap version 91 2024-08-18T22:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 1 -- 172.21.15.5:0/3017092707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x55ae03af9f50 con 0x55ae03ce1910 2024-08-18T22:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fcfe00640 1 -- 172.21.15.5:0/3017092707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc05e500 con 0x55ae03ce1910 2024-08-18T22:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fcfe00640 1 -- 172.21.15.5:0/3017092707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f6fe0032020 con 0x55ae03ce1910 2024-08-18T22:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 10 client.7989 fetch_fsmap finished waiting for FSMap version 91 2024-08-18T22:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 10 client.7989 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-08-18T22:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 20 client.7989 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55ae03d0f830 0x55ae03d3f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 4 client.7989 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6ff8981000 1 -- 172.21.15.5:0/3017092707 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae03ac7e10 con 0x55ae03d0f830 2024-08-18T22:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fede00640 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55ae03d0f830 0x55ae03d3f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fede00640 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55ae03d0f830 0x55ae03d3f180 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8f7f1e6d877ecb2 server_cookie=b84571364d046776 in_seq=0 out_seq=0 2024-08-18T22:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.564+0000 7f6fcfe00640 10 client.7989 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:27:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6fcfe00640 1 -- 172.21.15.5:0/3017092707 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae03ac7e10 con 0x55ae03d0f830 2024-08-18T22:27:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6fcfe00640 10 client.7989 handle_command_reply: tid=0 2024-08-18T22:27:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 1 client.7989 shutdown 2024-08-18T22:27:08.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 1 -- 172.21.15.5:0/3017092707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03ce1910 msgr2=0x55ae03d0e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03ce1910 0x55ae03d0e3a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0016a00 tx=0x7f6fe0004740 comp rx=0 tx=0).stop 2024-08-18T22:27:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 1 -- 172.21.15.5:0/3017092707 shutdown_connections 2024-08-18T22:27:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55ae03d0f830 0x55ae03d3f180 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03d2e7f0 0x55ae03d0ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03d2ded0 0x55ae03d0e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 1 --2- 172.21.15.5:0/3017092707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03ce1910 0x55ae03d0e3a0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6fcfe00640 0 client.7989 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:27:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 1 -- 172.21.15.5:0/3017092707 >> 172.21.15.5:0/3017092707 conn(0x55ae03cd7010 msgr2=0x55ae03cdc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 1 -- 172.21.15.5:0/3017092707 shutdown_connections 2024-08-18T22:27:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 1 -- 172.21.15.5:0/3017092707 wait complete. 2024-08-18T22:27:08.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.568+0000 7f6ff8981000 20 client.7989 trim_cache size 0 max 16384 2024-08-18T22:27:08.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.584+0000 7f6ff8981000 1 Processor -- start 2024-08-18T22:27:08.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.584+0000 7f6ff8981000 1 -- start start 2024-08-18T22:27:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.584+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03cd7010 0x55ae03d2bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.584+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03ce1910 0x55ae03d2c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.584+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2ded0 0x55ae03d3f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.584+0000 7f6ff8981000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff01ffda0 con 0x55ae03d2ded0 2024-08-18T22:27:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.584+0000 7f6ff8981000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff006e600 con 0x55ae03cd7010 2024-08-18T22:27:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.584+0000 7f6ff8981000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff01563a0 con 0x55ae03ce1910 2024-08-18T22:27:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.584+0000 7f6fef200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2ded0 0x55ae03d3f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.584+0000 7f6fef200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2ded0 0x55ae03d3f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50724/0 (socket says 172.21.15.5:50724) 2024-08-18T22:27:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.584+0000 7f6fef200640 1 -- 172.21.15.5:0/1451232368 learned_addr learned my addr 172.21.15.5:0/1451232368 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fee800640 1 --2- 172.21.15.5:0/1451232368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03cd7010 0x55ae03d2bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fede00640 1 --2- 172.21.15.5:0/1451232368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03ce1910 0x55ae03d2c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fef200640 1 -- 172.21.15.5:0/1451232368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03ce1910 msgr2=0x55ae03d2c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fef200640 1 --2- 172.21.15.5:0/1451232368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03ce1910 0x55ae03d2c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fef200640 1 -- 172.21.15.5:0/1451232368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03cd7010 msgr2=0x55ae03d2bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fef200640 1 --2- 172.21.15.5:0/1451232368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03cd7010 0x55ae03d2bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fef200640 1 -- 172.21.15.5:0/1451232368 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae03bafdd0 con 0x55ae03d2ded0 2024-08-18T22:27:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fef200640 1 --2- 172.21.15.5:0/1451232368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2ded0 0x55ae03d3f180 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f6fe801a540 tx=0x7f6fe8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947134fad6d8255d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fdaa00640 1 -- 172.21.15.5:0/1451232368 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80a57d0 con 0x55ae03d2ded0 2024-08-18T22:27:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fdaa00640 1 -- 172.21.15.5:0/1451232368 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe80a5990 con 0x55ae03d2ded0 2024-08-18T22:27:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fdaa00640 1 -- 172.21.15.5:0/1451232368 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80a5d80 con 0x55ae03d2ded0 2024-08-18T22:27:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 -- 172.21.15.5:0/1451232368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2ded0 msgr2=0x55ae03d3f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 --2- 172.21.15.5:0/1451232368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2ded0 0x55ae03d3f180 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f6fe801a540 tx=0x7f6fe8004ac0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 -- 172.21.15.5:0/1451232368 shutdown_connections 2024-08-18T22:27:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 --2- 172.21.15.5:0/1451232368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03d2ded0 0x55ae03d3f180 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 --2- 172.21.15.5:0/1451232368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03ce1910 0x55ae03d2c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 --2- 172.21.15.5:0/1451232368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03cd7010 0x55ae03d2bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 -- 172.21.15.5:0/1451232368 >> 172.21.15.5:0/1451232368 conn(0x55ae03ce4070 msgr2=0x55ae03d2d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 -- 172.21.15.5:0/1451232368 shutdown_connections 2024-08-18T22:27:08.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 -- 172.21.15.5:0/1451232368 wait complete. 2024-08-18T22:27:08.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 -- start start 2024-08-18T22:27:08.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 Processor -- start 2024-08-18T22:27:08.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03cd7010 0x55ae03da58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03ce1910 0x55ae03da5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03d2ded0 0x55ae03da6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ae03af87f0 con 0x55ae03cd7010 2024-08-18T22:27:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff006dfb0 con 0x55ae03ce1910 2024-08-18T22:27:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ae03b31b20 con 0x55ae03d2ded0 2024-08-18T22:27:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6ff8981000 10 client.0 _ll_register_callbacks cb 0x7f6fe00166b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fee800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03cd7010 0x55ae03da58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fee800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03cd7010 0x55ae03da58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50732/0 (socket says 172.21.15.5:50732) 2024-08-18T22:27:08.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fee800640 1 -- 172.21.15.5:0/1183203299 learned_addr learned my addr 172.21.15.5:0/1183203299 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fef200640 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03d2ded0 0x55ae03da6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fede00640 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03ce1910 0x55ae03da5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fee800640 1 -- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03d2ded0 msgr2=0x55ae03da6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fee800640 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03d2ded0 0x55ae03da6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fee800640 1 -- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03ce1910 msgr2=0x55ae03da5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fee800640 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03ce1910 0x55ae03da5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fee800640 1 -- 172.21.15.5:0/1183203299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae03ac0cd0 con 0x55ae03cd7010 2024-08-18T22:27:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.588+0000 7f6fede00640 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03ce1910 0x55ae03da5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fee800640 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03cd7010 0x55ae03da58b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0016a00 tx=0x7f6fe0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde37864ca5f4c2a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fcfe00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fcfe00640 1 -- 172.21.15.5:0/1183203299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00106a0 con 0x55ae03cd7010 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fcfe00640 1 -- 172.21.15.5:0/1183203299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f6fe00248e0 con 0x55ae03cd7010 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 -- 172.21.15.5:0/1183203299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fe80a5990 con 0x55ae03cd7010 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fcfe00640 1 -- 172.21.15.5:0/1183203299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f6fe00223e0 con 0x55ae03cd7010 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 10 client.7995 fetch_fsmap learned FSMap version 91 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 -- 172.21.15.5:0/1183203299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x55ae03ad3320 con 0x55ae03cd7010 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fcfe00640 1 -- 172.21.15.5:0/1183203299 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe80a5990 con 0x55ae03cd7010 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fcfe00640 1 -- 172.21.15.5:0/1183203299 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f6fe0045080 con 0x55ae03cd7010 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 10 client.7995 fetch_fsmap finished waiting for FSMap version 91 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 10 client.7995 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-08-18T22:27:08.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 20 client.7995 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55ae03d2e7f0 0x55ae03d3ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 4 client.7995 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:27:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 -- 172.21.15.5:0/1183203299 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ae03b3ac20 con 0x55ae03d2e7f0 2024-08-18T22:27:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fede00640 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55ae03d2e7f0 0x55ae03d3ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fede00640 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55ae03d2e7f0 0x55ae03d3ea00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b7655e33e2a0526 server_cookie=86fe499ca52eb2c0 in_seq=0 out_seq=0 2024-08-18T22:27:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fcfe00640 10 client.7995 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:27:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fcfe00640 1 -- 172.21.15.5:0/1183203299 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ae03b3ac20 con 0x55ae03d2e7f0 2024-08-18T22:27:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fcfe00640 10 client.7995 handle_command_reply: tid=0 2024-08-18T22:27:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 client.7995 shutdown 2024-08-18T22:27:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 -- 172.21.15.5:0/1183203299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03cd7010 msgr2=0x55ae03da58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03cd7010 0x55ae03da58b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0016a00 tx=0x7f6fe0015000 comp rx=0 tx=0).stop 2024-08-18T22:27:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 -- 172.21.15.5:0/1183203299 shutdown_connections 2024-08-18T22:27:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55ae03d2e7f0 0x55ae03d3ea00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ae03d2ded0 0x55ae03da6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ae03ce1910 0x55ae03da5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 --2- 172.21.15.5:0/1183203299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ae03cd7010 0x55ae03da58b0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6fcfe00640 0 client.7995 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:27:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 -- 172.21.15.5:0/1183203299 >> 172.21.15.5:0/1183203299 conn(0x55ae03ce4070 msgr2=0x55ae03d2c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 -- 172.21.15.5:0/1183203299 shutdown_connections 2024-08-18T22:27:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 1 -- 172.21.15.5:0/1183203299 wait complete. 2024-08-18T22:27:08.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff8981000 20 client.7995 trim_cache size 0 max 16384 2024-08-18T22:27:08.602 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:27:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-18T22:27:08.602 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-08-18T22:27:08.602 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:27:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 -- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fd00678c0 msgr2=0x7f6fd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fd00678c0 0x7f6fd0069d80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00079c0 tx=0x7f6fe0008040 comp rx=0 tx=0).stop 2024-08-18T22:27:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 -- 172.21.15.5:0/1982567391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1090 msgr2=0x7f6ff00b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1090 0x7f6ff00b0bc0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c460 tx=0x7f6fdc00c920 comp rx=0 tx=0).stop 2024-08-18T22:27:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 -- 172.21.15.5:0/1982567391 shutdown_connections 2024-08-18T22:27:08.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fd00678c0 0x7f6fd0069d80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ff015fb80 0x7f6ff00b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ff00d1090 0x7f6ff00b0bc0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 --2- 172.21.15.5:0/1982567391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ff00b5ad0 0x7f6ff0148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 -- 172.21.15.5:0/1982567391 >> 172.21.15.5:0/1982567391 conn(0x7f6ff00d2180 msgr2=0x7f6ff015e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 -- 172.21.15.5:0/1982567391 shutdown_connections 2024-08-18T22:27:08.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.592+0000 7f6ff5400640 1 -- 172.21.15.5:0/1982567391 wait complete. 2024-08-18T22:27:08.612 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:27:08.613 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-08-18T22:27:08.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e12e00640 1 Processor -- start 2024-08-18T22:27:08.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e12e00640 1 -- start start 2024-08-18T22:27:08.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e12e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e0c15e060 0x7f9e0c071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e12e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e0c0b3fe0 0x7f9e0c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e12e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e0c0b4ee0 0x7f9e0c0b5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e12e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9e0c0b4990 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e12e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9e0c06eae0 con 0x7f9e0c15e060 2024-08-18T22:27:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e12e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0c071440 con 0x7f9e0c0b4ee0 2024-08-18T22:27:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e11000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e0c0b3fe0 0x7f9e0c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e11a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e0c15e060 0x7f9e0c071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e11a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e0c15e060 0x7f9e0c071ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:50280/0 (socket says 172.21.15.5:50280) 2024-08-18T22:27:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e11a00640 1 -- 172.21.15.5:0/3298670424 learned_addr learned my addr 172.21.15.5:0/3298670424 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e12400640 1 --2- 172.21.15.5:0/3298670424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e0c0b4ee0 0x7f9e0c0b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e11000640 1 -- 172.21.15.5:0/3298670424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e0c0b4ee0 msgr2=0x7f9e0c0b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e11000640 1 --2- 172.21.15.5:0/3298670424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e0c0b4ee0 0x7f9e0c0b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e11000640 1 -- 172.21.15.5:0/3298670424 >> v2:172.21.15.117:3300/0 conn(0x7f9e0c15e060 msgr2=0x7f9e0c071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e11000640 1 --2- 172.21.15.5:0/3298670424 >> v2:172.21.15.117:3300/0 conn(0x7f9e0c15e060 0x7f9e0c071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.756+0000 7f9e11000640 1 -- 172.21.15.5:0/3298670424 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c06e800 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e11000640 1 --2- 172.21.15.5:0/3298670424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e0c0b3fe0 0x7f9e0c0b4450 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c068630 tx=0x7f9df801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c0cd1510aecb2d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e0be00640 1 -- 172.21.15.5:0/3298670424 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80b1070 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e0be00640 1 -- 172.21.15.5:0/3298670424 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df80ac410 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e0be00640 1 -- 172.21.15.5:0/3298670424 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80ac7e0 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e12e00640 1 -- 172.21.15.5:0/3298670424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e0c0b3fe0 msgr2=0x7f9e0c0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e12e00640 1 --2- 172.21.15.5:0/3298670424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e0c0b3fe0 0x7f9e0c0b4450 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c068630 tx=0x7f9df801c3f0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e12e00640 1 -- 172.21.15.5:0/3298670424 shutdown_connections 2024-08-18T22:27:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e12e00640 1 --2- 172.21.15.5:0/3298670424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e0c0b4ee0 0x7f9e0c0b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e12e00640 1 --2- 172.21.15.5:0/3298670424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e0c0b3fe0 0x7f9e0c0b4450 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e12e00640 1 --2- 172.21.15.5:0/3298670424 >> v2:172.21.15.117:3300/0 conn(0x7f9e0c15e060 0x7f9e0c071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e12e00640 1 -- 172.21.15.5:0/3298670424 >> 172.21.15.5:0/3298670424 conn(0x7f9e0c067a70 msgr2=0x7f9e0c067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e12e00640 1 -- 172.21.15.5:0/3298670424 shutdown_connections 2024-08-18T22:27:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e12e00640 1 -- 172.21.15.5:0/3298670424 wait complete. 2024-08-18T22:27:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.760+0000 7f9e12e00640 1 Processor -- start 2024-08-18T22:27:08.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e12e00640 1 -- start start 2024-08-18T22:27:08.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e12e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e0c0b3fe0 0x7f9e0c15a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e12e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e0c0b4ee0 0x7f9e0c1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e12e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e0c15e060 0x7f9e0c158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e12e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c072420 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e12e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c15e440 con 0x7f9e0c0b4ee0 2024-08-18T22:27:08.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e12e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0c06e270 con 0x7f9e0c15e060 2024-08-18T22:27:08.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e11a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e0c0b3fe0 0x7f9e0c15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e11a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e0c0b3fe0 0x7f9e0c15a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50746/0 (socket says 172.21.15.5:50746) 2024-08-18T22:27:08.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e11a00640 1 -- 172.21.15.5:0/445961564 learned_addr learned my addr 172.21.15.5:0/445961564 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e12400640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e0c15e060 0x7f9e0c158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e11000640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e0c0b4ee0 0x7f9e0c1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e11a00640 1 -- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e0c15e060 msgr2=0x7f9e0c158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e11a00640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e0c15e060 0x7f9e0c158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e11a00640 1 -- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e0c0b4ee0 msgr2=0x7f9e0c1583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e11a00640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e0c0b4ee0 0x7f9e0c1583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e11a00640 1 -- 172.21.15.5:0/445961564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c15ae50 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e11a00640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e0c0b3fe0 0x7f9e0c15a470 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000e7f0 tx=0x7f9e0000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e09600640 1 -- 172.21.15.5:0/445961564 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00017070 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e09600640 1 -- 172.21.15.5:0/445961564 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e0000c940 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e09600640 1 -- 172.21.15.5:0/445961564 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0000cd30 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e12e00640 1 -- 172.21.15.5:0/445961564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0c15b130 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.764+0000 7f9e12e00640 1 -- 172.21.15.5:0/445961564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e0c15b6f0 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e09600640 1 -- 172.21.15.5:0/445961564 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e0001a070 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e09600640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678f0 0x7f9dec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e09600640 1 -- 172.21.15.5:0/445961564 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f9e00085ff0 con 0x7f9e0c0b3fe0 2024-08-18T22:27:08.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11000640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678f0 0x7f9dec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e178de000 1 Processor -- start 2024-08-18T22:27:08.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e178de000 1 -- start start 2024-08-18T22:27:08.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11000640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678f0 0x7f9dec069db0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9df80ae000 tx=0x7f9df8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e178de000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c060350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e178de000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 0x55f05c013630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e178de000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c013b70 0x55f05c013f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e178de000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f05be64470 con 0x55f05c060890 2024-08-18T22:27:08.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e178de000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f05be1ead0 con 0x55f05c05ff70 2024-08-18T22:27:08.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e178de000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f05be60430 con 0x55f05c013b70 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 0x55f05c013630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c060350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c060350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:50284/0 (socket says 172.21.15.5:50284) 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11a00640 1 -- 172.21.15.5:0/4140273337 learned_addr learned my addr 172.21.15.5:0/4140273337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e12400640 1 --2- 172.21.15.5:0/4140273337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c013b70 0x55f05c013f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11000640 1 -- 172.21.15.5:0/4140273337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c013b70 msgr2=0x55f05c013f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11000640 1 --2- 172.21.15.5:0/4140273337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c013b70 0x55f05c013f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11000640 1 -- 172.21.15.5:0/4140273337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 msgr2=0x55f05c060350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11000640 1 --2- 172.21.15.5:0/4140273337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c060350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11000640 1 -- 172.21.15.5:0/4140273337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05be04a10 con 0x55f05c060890 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.768+0000 7f9e11000640 1 --2- 172.21.15.5:0/4140273337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 0x55f05c013630 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9df80ac000 tx=0x7f9df8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8043e1a3d01832df server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9dfe000640 1 -- 172.21.15.5:0/4140273337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80c8070 con 0x55f05c060890 2024-08-18T22:27:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9dfe000640 1 -- 172.21.15.5:0/4140273337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df80b2040 con 0x55f05c060890 2024-08-18T22:27:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9dfe000640 1 -- 172.21.15.5:0/4140273337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80b84f0 con 0x55f05c060890 2024-08-18T22:27:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 -- 172.21.15.5:0/4140273337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 msgr2=0x55f05c013630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 --2- 172.21.15.5:0/4140273337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 0x55f05c013630 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9df80ac000 tx=0x7f9df8004740 comp rx=0 tx=0).stop 2024-08-18T22:27:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 -- 172.21.15.5:0/4140273337 shutdown_connections 2024-08-18T22:27:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 --2- 172.21.15.5:0/4140273337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c013b70 0x55f05c013f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 --2- 172.21.15.5:0/4140273337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 0x55f05c013630 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 --2- 172.21.15.5:0/4140273337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c060350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 -- 172.21.15.5:0/4140273337 >> 172.21.15.5:0/4140273337 conn(0x55f05c00d680 msgr2=0x55f05c042df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 -- 172.21.15.5:0/4140273337 shutdown_connections 2024-08-18T22:27:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 -- 172.21.15.5:0/4140273337 wait complete. 2024-08-18T22:27:08.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 -- start start 2024-08-18T22:27:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 Processor -- start 2024-08-18T22:27:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c013b70 0x55f05c01a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c05ff70 0x55f05c01a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c060890 0x55f05c01aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f05be2f770 con 0x55f05c05ff70 2024-08-18T22:27:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f05be05c80 con 0x55f05c013b70 2024-08-18T22:27:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f05bee5130 con 0x55f05c060890 2024-08-18T22:27:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 10 client.0 _ll_register_callbacks cb 0x55f05c0010e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e11000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c05ff70 0x55f05c01a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e11000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c05ff70 0x55f05c01a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50762/0 (socket says 172.21.15.5:50762) 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e11000640 1 -- 172.21.15.5:0/1577429410 learned_addr learned my addr 172.21.15.5:0/1577429410 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e11a00640 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c013b70 0x55f05c01a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e12400640 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c060890 0x55f05c01aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e11000640 1 -- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c060890 msgr2=0x55f05c01aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e11000640 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c060890 0x55f05c01aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e11000640 1 -- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c013b70 msgr2=0x55f05c01a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e11000640 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c013b70 0x55f05c01a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e11000640 1 -- 172.21.15.5:0/1577429410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f05be1cfe0 con 0x55f05c05ff70 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e11000640 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c05ff70 0x55f05c01a970 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f9df8008010 tx=0x7f9df801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd0f246d663bf14 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9df2a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9df2a00640 1 -- 172.21.15.5:0/1577429410 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80c8040 con 0x55f05c05ff70 2024-08-18T22:27:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9df2a00640 1 -- 172.21.15.5:0/1577429410 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f9df80cfca0 con 0x55f05c05ff70 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.772+0000 7f9e178de000 1 -- 172.21.15.5:0/1577429410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9df80b2040 con 0x55f05c05ff70 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9df2a00640 1 -- 172.21.15.5:0/1577429410 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f9df80cfec0 con 0x55f05c05ff70 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 10 client.8007 fetch_fsmap learned FSMap version 91 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 -- 172.21.15.5:0/1577429410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x55f05be30ed0 con 0x55f05c05ff70 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9df2a00640 1 -- 172.21.15.5:0/1577429410 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df80b2040 con 0x55f05c05ff70 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9df2a00640 1 -- 172.21.15.5:0/1577429410 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f9df80b8b80 con 0x55f05c05ff70 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 10 client.8007 fetch_fsmap finished waiting for FSMap version 91 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 10 client.8007 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 20 client.8007 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f05c01b8c0 0x55f05c072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 4 client.8007 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 -- 172.21.15.5:0/1577429410 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f05bdfed90 con 0x55f05c01b8c0 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e11a00640 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f05c01b8c0 0x55f05c072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e11a00640 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f05c01b8c0 0x55f05c072020 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b758cf0771db39 server_cookie=4e6455ae00da254e in_seq=0 out_seq=0 2024-08-18T22:27:08.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9df2a00640 10 client.8007 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:27:08.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9df2a00640 1 -- 172.21.15.5:0/1577429410 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f05bdfed90 con 0x55f05c01b8c0 2024-08-18T22:27:08.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9df2a00640 10 client.8007 handle_command_reply: tid=0 2024-08-18T22:27:08.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 client.8007 shutdown 2024-08-18T22:27:08.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 -- 172.21.15.5:0/1577429410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c05ff70 msgr2=0x55f05c01a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c05ff70 0x55f05c01a970 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f9df8008010 tx=0x7f9df801ac30 comp rx=0 tx=0).stop 2024-08-18T22:27:08.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 -- 172.21.15.5:0/1577429410 shutdown_connections 2024-08-18T22:27:08.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f05c01b8c0 0x55f05c072020 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c060890 0x55f05c01aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c05ff70 0x55f05c01a970 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 --2- 172.21.15.5:0/1577429410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c013b70 0x55f05c01a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 -- 172.21.15.5:0/1577429410 >> 172.21.15.5:0/1577429410 conn(0x55f05c00d680 msgr2=0x55f05c042df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9df2a00640 0 client.8007 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:27:08.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 -- 172.21.15.5:0/1577429410 shutdown_connections 2024-08-18T22:27:08.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 1 -- 172.21.15.5:0/1577429410 wait complete. 2024-08-18T22:27:08.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.776+0000 7f9e178de000 20 client.8007 trim_cache size 0 max 16384 2024-08-18T22:27:08.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.792+0000 7f9e178de000 1 Processor -- start 2024-08-18T22:27:08.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.792+0000 7f9e178de000 1 -- start start 2024-08-18T22:27:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c013b70 0x55f05c0cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c060890 0x55f05c0cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c203b10 con 0x55f05c013b70 2024-08-18T22:27:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c202b90 con 0x55f05c05ff70 2024-08-18T22:27:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0c14e160 con 0x55f05c060890 2024-08-18T22:27:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e11a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c013b70 0x55f05c0cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e11a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c013b70 0x55f05c0cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50766/0 (socket says 172.21.15.5:50766) 2024-08-18T22:27:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e11a00640 1 -- 172.21.15.5:0/2778272425 learned_addr learned my addr 172.21.15.5:0/2778272425 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e11000640 1 --2- 172.21.15.5:0/2778272425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e12400640 1 --2- 172.21.15.5:0/2778272425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c060890 0x55f05c0cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e11a00640 1 -- 172.21.15.5:0/2778272425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c060890 msgr2=0x55f05c0cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e11a00640 1 --2- 172.21.15.5:0/2778272425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c060890 0x55f05c0cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e11a00640 1 -- 172.21.15.5:0/2778272425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 msgr2=0x55f05c0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e11a00640 1 --2- 172.21.15.5:0/2778272425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c0cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e11a00640 1 -- 172.21.15.5:0/2778272425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05bee55c0 con 0x55f05c013b70 2024-08-18T22:27:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e11000640 1 --2- 172.21.15.5:0/2778272425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e11a00640 1 --2- 172.21.15.5:0/2778272425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c013b70 0x55f05c0cef40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000c520 tx=0x7f9e00059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e33a596e8b66ff server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9dfd600640 1 -- 172.21.15.5:0/2778272425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00021040 con 0x55f05c013b70 2024-08-18T22:27:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9dfd600640 1 -- 172.21.15.5:0/2778272425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e0005ee80 con 0x55f05c013b70 2024-08-18T22:27:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9dfd600640 1 -- 172.21.15.5:0/2778272425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e000545a0 con 0x55f05c013b70 2024-08-18T22:27:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- 172.21.15.5:0/2778272425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c013b70 msgr2=0x55f05c0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 --2- 172.21.15.5:0/2778272425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c013b70 0x55f05c0cef40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000c520 tx=0x7f9e00059040 comp rx=0 tx=0).stop 2024-08-18T22:27:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- 172.21.15.5:0/2778272425 shutdown_connections 2024-08-18T22:27:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 --2- 172.21.15.5:0/2778272425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c060890 0x55f05c0cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 --2- 172.21.15.5:0/2778272425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 --2- 172.21.15.5:0/2778272425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c013b70 0x55f05c0cef40 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- 172.21.15.5:0/2778272425 >> 172.21.15.5:0/2778272425 conn(0x55f05c00d680 msgr2=0x55f05c06d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- 172.21.15.5:0/2778272425 shutdown_connections 2024-08-18T22:27:08.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- 172.21.15.5:0/2778272425 wait complete. 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- start start 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 Processor -- start 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c013b70 0x55f05c0d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c0d3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 0x55f05c0d3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f05be0ba10 con 0x55f05c060890 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c14e7b0 con 0x55f05c05ff70 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f05be63780 con 0x55f05c013b70 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.796+0000 7f9e178de000 10 client.0 _ll_register_callbacks cb 0x7f9df80c6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e12400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 0x55f05c0d3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e12400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 0x55f05c0d3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50774/0 (socket says 172.21.15.5:50774) 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e12400640 1 -- 172.21.15.5:0/2249180740 learned_addr learned my addr 172.21.15.5:0/2249180740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e11a00640 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c013b70 0x55f05c0d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e11000640 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c0d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e12400640 1 -- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c013b70 msgr2=0x55f05c0d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e12400640 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c013b70 0x55f05c0d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e12400640 1 -- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 msgr2=0x55f05c0d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e12400640 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c0d3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e12400640 1 -- 172.21.15.5:0/2249180740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f05bdf7c50 con 0x55f05c060890 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e12400640 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 0x55f05c0d3940 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f9e04018fb0 tx=0x7f9e04016810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5116eefbaced20f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9df2a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9df2a00640 1 -- 172.21.15.5:0/2249180740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e040194f0 con 0x55f05c060890 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9df2a00640 1 -- 172.21.15.5:0/2249180740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f9e04019690 con 0x55f05c060890 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 -- 172.21.15.5:0/2249180740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e0005ee80 con 0x55f05c060890 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9df2a00640 1 -- 172.21.15.5:0/2249180740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f9e0402a050 con 0x55f05c060890 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 10 client.8013 fetch_fsmap learned FSMap version 91 2024-08-18T22:27:08.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 -- 172.21.15.5:0/2249180740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) -- 0x55f05be0a2a0 con 0x55f05c060890 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9df2a00640 1 -- 172.21.15.5:0/2249180740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e0005ee80 con 0x55f05c060890 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9df2a00640 1 -- 172.21.15.5:0/2249180740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 91) ==== 3502+0+0 (secure 0 0 0) 0x7f9e0402d020 con 0x55f05c060890 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 10 client.8013 fetch_fsmap finished waiting for FSMap version 91 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 10 client.8013 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 20 client.8013 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f05c08ec80 0x55f05c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 4 client.8013 mds_command: new command op to 7752 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 -- 172.21.15.5:0/2249180740 --> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55f05be71ba0 con 0x55f05c08ec80 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e11a00640 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f05c08ec80 0x55f05c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e11a00640 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f05c08ec80 0x55f05c08f090 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9925a9f88b09c25 server_cookie=d8a813aaa2a99f28 in_seq=0 out_seq=0 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9df2a00640 10 client.8013 ms_handle_connect on v2:172.21.15.117:6835/1147270411 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9df2a00640 1 -- 172.21.15.5:0/2249180740 <== mds.0 v2:172.21.15.117:6835/1147270411 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18000 (crc 0 0 0) 0x55f05be71ba0 con 0x55f05c08ec80 2024-08-18T22:27:08.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9df2a00640 10 client.8013 handle_command_reply: tid=0 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 client.8013 shutdown 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 -- 172.21.15.5:0/2249180740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 msgr2=0x55f05c0d3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 0x55f05c0d3940 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f9e04018fb0 tx=0x7f9e04016810 comp rx=0 tx=0).stop 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 -- 172.21.15.5:0/2249180740 shutdown_connections 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:6835/1147270411,v1:172.21.15.117:6837/1147270411] conn(0x55f05c08ec80 0x55f05c08f090 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f05c060890 0x55f05c0d3940 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05c05ff70 0x55f05c0d3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 --2- 172.21.15.5:0/2249180740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f05c013b70 0x55f05c0d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 -- 172.21.15.5:0/2249180740 >> 172.21.15.5:0/2249180740 conn(0x55f05c00d680 msgr2=0x55f05c0126b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9df2a00640 0 client.8013 ms_handle_reset on v2:172.21.15.117:6835/1147270411 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 -- 172.21.15.5:0/2249180740 shutdown_connections 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.800+0000 7f9e178de000 1 -- 172.21.15.5:0/2249180740 wait complete. 2024-08-18T22:27:08.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e178de000 20 client.8013 trim_cache size 0 max 16384 2024-08-18T22:27:08.808 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:27:08.808 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-08-18T22:27:08.808 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 2311, 2024-08-18T22:27:08.808 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2310, 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 971261, 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 18063791, 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 17, 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 6, 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.276333584, 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.130397187, 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.060170876, 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.065101270, 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2309, 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.419280336, 2024-08-18T22:27:08.809 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000181585 2024-08-18T22:27:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:27:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 10, 2024-08-18T22:27:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000798, 2024-08-18T22:27:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000079 2024-08-18T22:27:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-08-18T22:27:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2024-08-18T22:27:08.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 3124, 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 3147, 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 790027, 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 22513094, 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 6, 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.295770870, 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.120373914, 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.063836469, 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.080477725, 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:27:08.811 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3145, 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.475193654, 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000151094 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 124128 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-08-18T22:27:08.812 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 30306, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 52554, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 10437394, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 67733252, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 7, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 2.935289706, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 1.759929630, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 1.585281090, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.092106401, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 52554, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.771130947, 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000033701 2024-08-18T22:27:08.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 45598, 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.010876437, 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000238 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 120192, 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 27088 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-08-18T22:27:08.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2024-08-18T22:27:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-18T22:27:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-18T22:27:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2924, 2024-08-18T22:27:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 14.305745575, 2024-08-18T22:27:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.004892525 2024-08-18T22:27:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:08.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3574, 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.832289815, 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000232873 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 26000, 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 26000, 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2024-08-18T22:27:08.816 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 26000, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 251.381898471, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.009668534 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 12, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 17912, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 0, 2024-08-18T22:27:08.817 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 17912, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 0, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 17911, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 0, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 2, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 2, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 2, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 47388, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 46796, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 124, 2024-08-18T22:27:08.818 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 1847, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 1847, 2024-08-18T22:27:08.819 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 11, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 1, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 10, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 1836, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 1191, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 4043, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 3193, 2024-08-18T22:27:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 2341, 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 45, 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 14171 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 0, 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2024-08-18T22:27:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2024-08-18T22:27:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 4154, 2024-08-18T22:27:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 3703, 2024-08-18T22:27:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 2215, 2024-08-18T22:27:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2024-08-18T22:27:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2024-08-18T22:27:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2024-08-18T22:27:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2024-08-18T22:27:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2024-08-18T22:27:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2024-08-18T22:27:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_path": 0, 2024-08-18T22:27:08.822 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_inode": 0, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 1, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 27347, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 27347, 2024-08-18T22:27:08.823 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 39, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 39, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 4, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 90936558, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 0, 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2024-08-18T22:27:08.824 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2711, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 72.797252634, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.026852546 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 0 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 14, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 2015, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 2001, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 13, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 13, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 0, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 17912, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 19913, 2024-08-18T22:27:08.825 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 2001, 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 2, 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 6381, 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 6379, 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 98296, 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 231732 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 28990, 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 26000, 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 6, 2024-08-18T22:27:08.826 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2024-08-18T22:27:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2024-08-18T22:27:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2000, 2024-08-18T22:27:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 1.989603484, 2024-08-18T22:27:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000994801 2024-08-18T22:27:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2024-08-18T22:27:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 29, 2024-08-18T22:27:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.005589617, 2024-08-18T22:27:08.827 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000192745 2024-08-18T22:27:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2024-08-18T22:27:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2024-08-18T22:27:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 6000, 2024-08-18T22:27:08.828 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 7.030964172, 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001171827 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 7742, 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 5.165842604, 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000667249 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2024-08-18T22:27:08.829 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.830 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2024-08-18T22:27:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:27:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000086155, 2024-08-18T22:27:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000086155 2024-08-18T22:27:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2024-08-18T22:27:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.831 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.003010281, 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.003010281 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.832 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.297052402, 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.297052402 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000112751, 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000112751 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8, 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.265936507, 2024-08-18T22:27:08.833 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.033242063 2024-08-18T22:27:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2024-08-18T22:27:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2215, 2024-08-18T22:27:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 218.901839646, 2024-08-18T22:27:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.098827015 2024-08-18T22:27:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2024-08-18T22:27:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2024-08-18T22:27:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2024-08-18T22:27:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.836 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2024-08-18T22:27:08.836 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:27:08.836 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.061048502, 2024-08-18T22:27:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.061048502 2024-08-18T22:27:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2024-08-18T22:27:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.837 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1, 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000346106, 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000346106 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2024-08-18T22:27:08.838 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2024-08-18T22:27:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2024-08-18T22:27:08.839 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8000, 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 17.660466244, 2024-08-18T22:27:08.840 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.002207558 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 1, 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 1, 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 0, 2024-08-18T22:27:08.841 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 1, 2024-08-18T22:27:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2024-08-18T22:27:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 18293, 2024-08-18T22:27:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 18293, 2024-08-18T22:27:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 83, 2024-08-18T22:27:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2024-08-18T22:27:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-08-18T22:27:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-08-18T22:27:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-08-18T22:27:08.842 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-08-18T22:27:08.843 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-08-18T22:27:08.844 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-08-18T22:27:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-08-18T22:27:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-08-18T22:27:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-08-18T22:27:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-08-18T22:27:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-08-18T22:27:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-08-18T22:27:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 250671, 2024-08-18T22:27:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 86, 2024-08-18T22:27:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-08-18T22:27:08.845 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 5624, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 80, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-08-18T22:27:08.846 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-08-18T22:27:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 13491044, 2024-08-18T22:27:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 661836, 2024-08-18T22:27:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-08-18T22:27:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-08-18T22:27:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-08-18T22:27:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-08-18T22:27:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2024-08-18T22:27:08.847 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2024-08-18T22:27:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2024-08-18T22:27:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 8524, 2024-08-18T22:27:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 87413037, 2024-08-18T22:27:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 31, 2024-08-18T22:27:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 8524, 2024-08-18T22:27:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2024-08-18T22:27:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8524, 2024-08-18T22:27:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 38.687654563, 2024-08-18T22:27:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.004538673 2024-08-18T22:27:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.848 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 8524, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 8629 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 8524, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 1905, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 6619, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 0, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 11, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 57, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 2767, 2024-08-18T22:27:08.849 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 34, 2024-08-18T22:27:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2024-08-18T22:27:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2024-08-18T22:27:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 1703, 2024-08-18T22:27:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2024-08-18T22:27:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 2032, 2024-08-18T22:27:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2024-08-18T22:27:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2024-08-18T22:27:08.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 1848, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 22, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2024-08-18T22:27:08.851 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2024-08-18T22:27:08.852 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 118, 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 5, 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 8, 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 8, 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 0, 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 121, 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 0, 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 34 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2024-08-18T22:27:08.853 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 1, 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "osd-slow-ops": { 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 32, 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 32, 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed_ops": 3703, 2024-08-18T22:27:08.854 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 3703, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 35737, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 9410722, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 35737, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 35737, 2024-08-18T22:27:08.855 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 9410722, 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-18T22:27:08.856 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 8524, 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 87800664, 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 8524, 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 87800664, 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:27:08.857 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 8524, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 8524, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 8524, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 8524, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.858 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 3703, 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 387627, 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 3703, 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 56, 2024-08-18T22:27:08.859 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 387627, 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x5586b18ce780": { 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 27347, 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 86742254, 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-18T22:27:08.860 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 27347, 2024-08-18T22:27:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-18T22:27:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-18T22:27:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2711, 2024-08-18T22:27:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 86742254, 2024-08-18T22:27:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-18T22:27:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-18T22:27:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-18T22:27:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-18T22:27:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:08.861 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:08.861 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 -- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678f0 msgr2=0x7f9dec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678f0 0x7f9dec069db0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9df80ae000 tx=0x7f9df8008040 comp rx=0 tx=0).stop 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 -- 172.21.15.5:0/445961564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e0c0b3fe0 msgr2=0x7f9e0c15a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e0c0b3fe0 0x7f9e0c15a470 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000e7f0 tx=0x7f9e0000ecb0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 -- 172.21.15.5:0/445961564 shutdown_connections 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9dec0678f0 0x7f9dec069db0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e0c15e060 0x7f9e0c158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e0c0b4ee0 0x7f9e0c1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 --2- 172.21.15.5:0/445961564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e0c0b3fe0 0x7f9e0c15a470 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 -- 172.21.15.5:0/445961564 >> 172.21.15.5:0/445961564 conn(0x7f9e0c067a70 msgr2=0x7f9e0c155630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 -- 172.21.15.5:0/445961564 shutdown_connections 2024-08-18T22:27:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:08.804+0000 7f9e12e00640 1 -- 172.21.15.5:0/445961564 wait complete. 2024-08-18T22:27:08.864 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:27:08.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:27:08.981 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:27:09.068 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:27:09.068 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:27:09.068 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:27:09.068 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:27:09.077 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:27:09.077 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:27:09.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:27:09.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a1ae00640 1 Processor -- start 2024-08-18T22:27:09.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a1ae00640 1 -- start start 2024-08-18T22:27:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a1ae00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a1415c180 0x7f8a140cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a1ae00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8a1415c560 0x7f8a140ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a1ae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a1415d4d0 0x7f8a140ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a1ae00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8a1415d040 con 0x7f8a1415c180 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a1ae00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8a140cfb00 con 0x7f8a1415c560 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a1ae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8a1415c9f0 con 0x7f8a1415d4d0 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a13e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a1415c180 0x7f8a140cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a13e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a1415c180 0x7f8a140cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50784/0 (socket says 172.21.15.5:50784) 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a13e00640 1 -- 172.21.15.5:0/1729501044 learned_addr learned my addr 172.21.15.5:0/1729501044 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a13400640 1 --2- 172.21.15.5:0/1729501044 >> v2:172.21.15.117:3300/0 conn(0x7f8a1415c560 0x7f8a140ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a18e00640 1 --2- 172.21.15.5:0/1729501044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a1415d4d0 0x7f8a140ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a13e00640 1 -- 172.21.15.5:0/1729501044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a1415d4d0 msgr2=0x7f8a140ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a13e00640 1 --2- 172.21.15.5:0/1729501044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a1415d4d0 0x7f8a140ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a13e00640 1 -- 172.21.15.5:0/1729501044 >> v2:172.21.15.117:3300/0 conn(0x7f8a1415c560 msgr2=0x7f8a140ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a13e00640 1 --2- 172.21.15.5:0/1729501044 >> v2:172.21.15.117:3300/0 conn(0x7f8a1415c560 0x7f8a140ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.316+0000 7f8a13e00640 1 -- 172.21.15.5:0/1729501044 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1415ccd0 con 0x7f8a1415c180 2024-08-18T22:27:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a13e00640 1 --2- 172.21.15.5:0/1729501044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a1415c180 0x7f8a140cdf10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f8a140b5260 tx=0x7f8a0401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1827aa0747795719 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a12a00640 1 -- 172.21.15.5:0/1729501044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a040a7070 con 0x7f8a1415c180 2024-08-18T22:27:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a12a00640 1 -- 172.21.15.5:0/1729501044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a040b0070 con 0x7f8a1415c180 2024-08-18T22:27:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a12a00640 1 -- 172.21.15.5:0/1729501044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a040ab890 con 0x7f8a1415c180 2024-08-18T22:27:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a1ae00640 1 -- 172.21.15.5:0/1729501044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a1415c180 msgr2=0x7f8a140cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a1ae00640 1 --2- 172.21.15.5:0/1729501044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a1415c180 0x7f8a140cdf10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f8a140b5260 tx=0x7f8a0401c490 comp rx=0 tx=0).stop 2024-08-18T22:27:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a1ae00640 1 -- 172.21.15.5:0/1729501044 shutdown_connections 2024-08-18T22:27:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a1ae00640 1 --2- 172.21.15.5:0/1729501044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a1415d4d0 0x7f8a140ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a1ae00640 1 --2- 172.21.15.5:0/1729501044 >> v2:172.21.15.117:3300/0 conn(0x7f8a1415c560 0x7f8a140ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a1ae00640 1 --2- 172.21.15.5:0/1729501044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a1415c180 0x7f8a140cdf10 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a1ae00640 1 -- 172.21.15.5:0/1729501044 >> 172.21.15.5:0/1729501044 conn(0x7f8a140b1dc0 msgr2=0x7f8a140b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a1ae00640 1 -- 172.21.15.5:0/1729501044 shutdown_connections 2024-08-18T22:27:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.320+0000 7f8a1ae00640 1 -- 172.21.15.5:0/1729501044 wait complete. 2024-08-18T22:27:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a1ae00640 1 Processor -- start 2024-08-18T22:27:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a1ae00640 1 -- start start 2024-08-18T22:27:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a1ae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a1415c180 0x7f8a140b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a1ae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a1415d4d0 0x7f8a14156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a1ae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a141565b0 0x7f8a140ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a1ae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8a14160930 con 0x7f8a1415c180 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a1ae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8a141607b0 con 0x7f8a141565b0 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a1ae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8a14160ab0 con 0x7f8a1415d4d0 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a13e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a1415c180 0x7f8a140b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a13e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a1415c180 0x7f8a140b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50800/0 (socket says 172.21.15.5:50800) 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a13e00640 1 -- 172.21.15.5:0/3683022104 learned_addr learned my addr 172.21.15.5:0/3683022104 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a13400640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a1415d4d0 0x7f8a14156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a18e00640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a141565b0 0x7f8a140ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a13e00640 1 -- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a1415d4d0 msgr2=0x7f8a14156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a13e00640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a1415d4d0 0x7f8a14156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a13e00640 1 -- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a141565b0 msgr2=0x7f8a140ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a13e00640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a141565b0 0x7f8a140ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a13e00640 1 -- 172.21.15.5:0/3683022104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a140ae110 con 0x7f8a1415c180 2024-08-18T22:27:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a13e00640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a1415c180 0x7f8a140b1210 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f8a0401ab40 tx=0x7f8a0401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a0be00640 1 -- 172.21.15.5:0/3683022104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a040b4800 con 0x7f8a1415c180 2024-08-18T22:27:09.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a0be00640 1 -- 172.21.15.5:0/3683022104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a040b49a0 con 0x7f8a1415c180 2024-08-18T22:27:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a0be00640 1 -- 172.21.15.5:0/3683022104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a040b4d90 con 0x7f8a1415c180 2024-08-18T22:27:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a1ae00640 1 -- 172.21.15.5:0/3683022104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a14140fa0 con 0x7f8a1415c180 2024-08-18T22:27:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a1ae00640 1 -- 172.21.15.5:0/3683022104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a14141560 con 0x7f8a1415c180 2024-08-18T22:27:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.324+0000 7f8a1ae00640 1 -- 172.21.15.5:0/3683022104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a141569c0 con 0x7f8a1415c180 2024-08-18T22:27:09.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.328+0000 7f8a0be00640 1 -- 172.21.15.5:0/3683022104 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a040c83a0 con 0x7f8a1415c180 2024-08-18T22:27:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.328+0000 7f8a0be00640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89f40678c0 0x7f89f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.328+0000 7f8a0be00640 1 -- 172.21.15.5:0/3683022104 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f8a041208f0 con 0x7f8a1415c180 2024-08-18T22:27:09.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.328+0000 7f8a13400640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89f40678c0 0x7f89f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.328+0000 7f8a13400640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89f40678c0 0x7f89f4069d80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8a1415b2c0 tx=0x7f8a00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:09.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.332+0000 7f8a0be00640 1 -- 172.21.15.5:0/3683022104 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8a141569c0 con 0x7f8a1415c180 2024-08-18T22:27:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 -- 172.21.15.5:0/3683022104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8a140cdf10 con 0x7f8a1415c180 2024-08-18T22:27:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a0be00640 1 -- 172.21.15.5:0/3683022104 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) ==== 80+0+0 (secure 0 0 0) 0x7f8a04016110 con 0x7f8a1415c180 2024-08-18T22:27:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:27:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 -- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89f40678c0 msgr2=0x7f89f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89f40678c0 0x7f89f4069d80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8a1415b2c0 tx=0x7f8a00008040 comp rx=0 tx=0).stop 2024-08-18T22:27:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 -- 172.21.15.5:0/3683022104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a1415c180 msgr2=0x7f8a140b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a1415c180 0x7f8a140b1210 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f8a0401ab40 tx=0x7f8a0401acd0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 -- 172.21.15.5:0/3683022104 shutdown_connections 2024-08-18T22:27:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89f40678c0 0x7f89f4069d80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a141565b0 0x7f8a140ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a1415d4d0 0x7f8a14156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 --2- 172.21.15.5:0/3683022104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a1415c180 0x7f8a140b1210 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 -- 172.21.15.5:0/3683022104 >> 172.21.15.5:0/3683022104 conn(0x7f8a140b1dc0 msgr2=0x7f8a14072fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 -- 172.21.15.5:0/3683022104 shutdown_connections 2024-08-18T22:27:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.512+0000 7f8a1ae00640 1 -- 172.21.15.5:0/3683022104 wait complete. 2024-08-18T22:27:09.532 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:27:09.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:09.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:27:09.584 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:27:09.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:09.584 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:27:09.606 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:27:09.606 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:27:09.607 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:27:09.617 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:27:09.617 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:27:09.617 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:27:09.617 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:27:09.659 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:27:09.659 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:27:09.659 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:27:09.659 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:27:09.669 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:27:09.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:27:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f409a000640 1 Processor -- start 2024-08-18T22:27:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f409a000640 1 -- start start 2024-08-18T22:27:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f409a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40940b54c0 0x7f4094071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f409a000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f409406dd80 0x7f40940b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f409a000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40940b5de0 con 0x7f409406fad0 2024-08-18T22:27:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f409a000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f40940cba40 con 0x7f409406dd80 2024-08-18T22:27:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f409a000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4094071c80 con 0x7f40940b54c0 2024-08-18T22:27:09.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f4093e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f409406fad0 0x7f409406ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41504/0 (socket says 172.21.15.5:41504) 2024-08-18T22:27:09.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f4093e00640 1 -- 172.21.15.5:0/3557799160 learned_addr learned my addr 172.21.15.5:0/3557799160 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f408be00640 1 --2- 172.21.15.5:0/3557799160 >> v2:172.21.15.117:3300/0 conn(0x7f409406dd80 0x7f40940b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f4093400640 1 --2- 172.21.15.5:0/3557799160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40940b54c0 0x7f4094071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f4092a00640 1 -- 172.21.15.5:0/3557799160 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876689532 0 0) 0x7f40940b5de0 con 0x7f409406fad0 2024-08-18T22:27:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f4092a00640 1 -- 172.21.15.5:0/3557799160 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4078003530 con 0x7f409406fad0 2024-08-18T22:27:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f408be00640 1 -- 172.21.15.5:0/3557799160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40940b54c0 msgr2=0x7f4094071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f408be00640 1 --2- 172.21.15.5:0/3557799160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40940b54c0 0x7f4094071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f408be00640 1 -- 172.21.15.5:0/3557799160 >> v1:172.21.15.5:6789/0 conn(0x7f409406fad0 legacy=0x7f409406ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.844+0000 7f408be00640 1 -- 172.21.15.5:0/3557799160 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4094071f60 con 0x7f409406dd80 2024-08-18T22:27:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f408be00640 1 --2- 172.21.15.5:0/3557799160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f409406dd80 0x7f40940b58a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f407c0097c0 tx=0x7f407c01ead0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f2d192496e79554 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f4092a00640 1 -- 172.21.15.5:0/3557799160 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c0b5070 con 0x7f409406dd80 2024-08-18T22:27:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f4092a00640 1 -- 172.21.15.5:0/3557799160 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f407c0a8550 con 0x7f409406dd80 2024-08-18T22:27:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f4092a00640 1 -- 172.21.15.5:0/3557799160 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c001a00 con 0x7f409406dd80 2024-08-18T22:27:09.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f409a000640 1 -- 172.21.15.5:0/3557799160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f409406dd80 msgr2=0x7f40940b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:09.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f409a000640 1 --2- 172.21.15.5:0/3557799160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f409406dd80 0x7f40940b58a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f407c0097c0 tx=0x7f407c01ead0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f409a000640 1 -- 172.21.15.5:0/3557799160 shutdown_connections 2024-08-18T22:27:09.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f409a000640 1 --2- 172.21.15.5:0/3557799160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f409406dd80 0x7f40940b58a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f409a000640 1 --2- 172.21.15.5:0/3557799160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40940b54c0 0x7f4094071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f409a000640 1 -- 172.21.15.5:0/3557799160 >> 172.21.15.5:0/3557799160 conn(0x7f40940b3eb0 msgr2=0x7f40940b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f409a000640 1 -- 172.21.15.5:0/3557799160 shutdown_connections 2024-08-18T22:27:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.848+0000 7f409a000640 1 -- 172.21.15.5:0/3557799160 wait complete. 2024-08-18T22:27:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f409a000640 1 Processor -- start 2024-08-18T22:27:09.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f409a000640 1 -- start start 2024-08-18T22:27:09.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f409a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f409406dd80 0x7f409413e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f409a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f409406fad0 0x7f40941406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f409a000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40940b54c0 0x7f409415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f409a000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4094148020 con 0x7f409406dd80 2024-08-18T22:27:09.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f409a000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f409406e1a0 con 0x7f40940b54c0 2024-08-18T22:27:09.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f409a000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f40941481a0 con 0x7f409406fad0 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f4093400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f409406dd80 0x7f409413e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f4093400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f409406dd80 0x7f409413e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50804/0 (socket says 172.21.15.5:50804) 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f4093400640 1 -- 172.21.15.5:0/2235456077 learned_addr learned my addr 172.21.15.5:0/2235456077 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f408be00640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f409406fad0 0x7f40941406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f4093e00640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40940b54c0 0x7f409415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f4093400640 1 -- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f409406fad0 msgr2=0x7f40941406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f4093400640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f409406fad0 0x7f40941406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f4093400640 1 -- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40940b54c0 msgr2=0x7f409415d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f4093400640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40940b54c0 0x7f409415d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f4093400640 1 -- 172.21.15.5:0/2235456077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409413d610 con 0x7f409406dd80 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f4093400640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f409406dd80 0x7f409413e6b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f408400e870 tx=0x7f408400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f408b400640 1 -- 172.21.15.5:0/2235456077 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084017070 con 0x7f409406dd80 2024-08-18T22:27:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f408b400640 1 -- 172.21.15.5:0/2235456077 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408400c940 con 0x7f409406dd80 2024-08-18T22:27:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f408b400640 1 -- 172.21.15.5:0/2235456077 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408400ccf0 con 0x7f409406dd80 2024-08-18T22:27:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f409a000640 1 -- 172.21.15.5:0/2235456077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409413d8f0 con 0x7f409406dd80 2024-08-18T22:27:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f409a000640 1 -- 172.21.15.5:0/2235456077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f409413deb0 con 0x7f409406dd80 2024-08-18T22:27:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.852+0000 7f409a000640 1 -- 172.21.15.5:0/2235456077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409413e2f0 con 0x7f409406dd80 2024-08-18T22:27:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.856+0000 7f408b400640 1 -- 172.21.15.5:0/2235456077 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f408401a070 con 0x7f409406dd80 2024-08-18T22:27:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.856+0000 7f408b400640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40700678c0 0x7f4070069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.856+0000 7f408b400640 1 -- 172.21.15.5:0/2235456077 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f4084085dc0 con 0x7f409406dd80 2024-08-18T22:27:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.856+0000 7f408be00640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40700678c0 0x7f4070069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:09.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.856+0000 7f408be00640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40700678c0 0x7f4070069d80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f407c0b2000 tx=0x7f407c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:09.860+0000 7f408b400640 1 -- 172.21.15.5:0/2235456077 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4084055fc0 con 0x7f409406dd80 2024-08-18T22:27:10.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 -- 172.21.15.5:0/2235456077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4094071580 con 0x7f409406dd80 2024-08-18T22:27:10.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f408b400640 1 -- 172.21.15.5:0/2235456077 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5222 (secure 0 0 0) 0x7f408405a2c0 con 0x7f409406dd80 2024-08-18T22:27:10.064 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:10.064 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"btime":"2024-08-18T22:25:41:799624+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6680,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3271513219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3271513219},{"type":"v1","addr":"172.21.15.117:6836","nonce":3271513219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7210,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1577791873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1577791873},{"type":"v1","addr":"172.21.15.5:6835","nonce":1577791873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/704276311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":704276311},{"type":"v1","addr":"172.21.15.5:6834","nonce":704276311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-08-18T22:25:28.118793+0000","modified":"2024-08-18T22:25:40.801365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7752":{"gid":7752,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/1147270411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1147270411},{"type":"v1","addr":"172.21.15.117:6837","nonce":1147270411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7752,"qdb_cluster":[7752]},"id":7}]} 2024-08-18T22:27:10.065 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 91 2024-08-18T22:27:10.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 -- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40700678c0 msgr2=0x7f4070069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40700678c0 0x7f4070069d80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f407c0b2000 tx=0x7f407c008040 comp rx=0 tx=0).stop 2024-08-18T22:27:10.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 -- 172.21.15.5:0/2235456077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f409406dd80 msgr2=0x7f409413e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f409406dd80 0x7f409413e6b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f408400e870 tx=0x7f408400ec70 comp rx=0 tx=0).stop 2024-08-18T22:27:10.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 -- 172.21.15.5:0/2235456077 shutdown_connections 2024-08-18T22:27:10.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40700678c0 0x7f4070069d80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40940b54c0 0x7f409415d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f409406fad0 0x7f40941406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 --2- 172.21.15.5:0/2235456077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f409406dd80 0x7f409413e6b0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 -- 172.21.15.5:0/2235456077 >> 172.21.15.5:0/2235456077 conn(0x7f40940b3eb0 msgr2=0x7f4094147260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:10.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 -- 172.21.15.5:0/2235456077 shutdown_connections 2024-08-18T22:27:10.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.064+0000 7f409a000640 1 -- 172.21.15.5:0/2235456077 wait complete. 2024-08-18T22:27:10.086 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:27:10.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.224+0000 7fa398a00640 1 Processor -- start 2024-08-18T22:27:10.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.224+0000 7fa398a00640 1 -- start start 2024-08-18T22:27:10.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa398a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa39415bed0 0x7fa3940735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa398a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3940cb390 0x7fa394071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa398a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa394072060 con 0x7fa39406da70 2024-08-18T22:27:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa398a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa394073c80 con 0x7fa3940cb390 2024-08-18T22:27:10.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa398a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa3940ca5d0 con 0x7fa39415bed0 2024-08-18T22:27:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa391400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3940cb390 0x7fa394071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa392800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa39406da70 0x7fa3940cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41512/0 (socket says 172.21.15.5:41512) 2024-08-18T22:27:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa392800640 1 -- 172.21.15.5:0/3485504071 learned_addr learned my addr 172.21.15.5:0/3485504071 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa391e00640 1 --2- 172.21.15.5:0/3485504071 >> v2:172.21.15.117:3300/0 conn(0x7fa39415bed0 0x7fa3940735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa391400640 1 -- 172.21.15.5:0/3485504071 >> v2:172.21.15.117:3300/0 conn(0x7fa39415bed0 msgr2=0x7fa3940735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa391400640 1 --2- 172.21.15.5:0/3485504071 >> v2:172.21.15.117:3300/0 conn(0x7fa39415bed0 0x7fa3940735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa391400640 1 -- 172.21.15.5:0/3485504071 >> v1:172.21.15.5:6789/0 conn(0x7fa39406da70 legacy=0x7fa3940cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa391400640 1 -- 172.21.15.5:0/3485504071 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3940ca8b0 con 0x7fa3940cb390 2024-08-18T22:27:10.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.228+0000 7fa391e00640 1 --2- 172.21.15.5:0/3485504071 >> v2:172.21.15.117:3300/0 conn(0x7fa39415bed0 0x7fa3940735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:10.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa391400640 1 --2- 172.21.15.5:0/3485504071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3940cb390 0x7fa394071b20 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fa3940b2cc0 tx=0x7fa38001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03e93e5d7c8e8fe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:10.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa390a00640 1 -- 172.21.15.5:0/3485504071 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3800ab650 con 0x7fa3940cb390 2024-08-18T22:27:10.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa390a00640 1 -- 172.21.15.5:0/3485504071 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3800b0070 con 0x7fa3940cb390 2024-08-18T22:27:10.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa390a00640 1 -- 172.21.15.5:0/3485504071 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3800aba10 con 0x7fa3940cb390 2024-08-18T22:27:10.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa398a00640 1 -- 172.21.15.5:0/3485504071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3940cb390 msgr2=0x7fa394071b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa398a00640 1 --2- 172.21.15.5:0/3485504071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3940cb390 0x7fa394071b20 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fa3940b2cc0 tx=0x7fa38001c450 comp rx=0 tx=0).stop 2024-08-18T22:27:10.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa398a00640 1 -- 172.21.15.5:0/3485504071 shutdown_connections 2024-08-18T22:27:10.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa398a00640 1 --2- 172.21.15.5:0/3485504071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3940cb390 0x7fa394071b20 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa398a00640 1 --2- 172.21.15.5:0/3485504071 >> v2:172.21.15.117:3300/0 conn(0x7fa39415bed0 0x7fa3940735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa398a00640 1 -- 172.21.15.5:0/3485504071 >> 172.21.15.5:0/3485504071 conn(0x7fa3940b1c50 msgr2=0x7fa3940b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:10.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa398a00640 1 -- 172.21.15.5:0/3485504071 shutdown_connections 2024-08-18T22:27:10.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa398a00640 1 -- 172.21.15.5:0/3485504071 wait complete. 2024-08-18T22:27:10.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa398a00640 1 Processor -- start 2024-08-18T22:27:10.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.232+0000 7fa398a00640 1 -- start start 2024-08-18T22:27:10.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa398a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa39406da70 0x7fa394156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa398a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3940cb390 0x7fa3940ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa398a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39415bed0 0x7fa394140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa398a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa39415c430 con 0x7fa39415bed0 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa398a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa39415c2b0 con 0x7fa3940cb390 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa398a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa394168ba0 con 0x7fa39406da70 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa392800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39415bed0 0x7fa394140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa392800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39415bed0 0x7fa394140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50820/0 (socket says 172.21.15.5:50820) 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa392800640 1 -- 172.21.15.5:0/2772009942 learned_addr learned my addr 172.21.15.5:0/2772009942 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa391400640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3940cb390 0x7fa3940ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa391e00640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa39406da70 0x7fa394156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa392800640 1 -- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa39406da70 msgr2=0x7fa394156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa392800640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa39406da70 0x7fa394156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa392800640 1 -- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3940cb390 msgr2=0x7fa3940ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa392800640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3940cb390 0x7fa3940ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa392800640 1 -- 172.21.15.5:0/2772009942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3940cea70 con 0x7fa39415bed0 2024-08-18T22:27:10.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa392800640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39415bed0 0x7fa394140310 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00c430 tx=0x7fa38c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:10.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa38a000640 1 -- 172.21.15.5:0/2772009942 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c017070 con 0x7fa39415bed0 2024-08-18T22:27:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa38a000640 1 -- 172.21.15.5:0/2772009942 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa38c005cf0 con 0x7fa39415bed0 2024-08-18T22:27:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa398a00640 1 -- 172.21.15.5:0/2772009942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3940b30d0 con 0x7fa39415bed0 2024-08-18T22:27:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa38a000640 1 -- 172.21.15.5:0/2772009942 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0072d0 con 0x7fa39415bed0 2024-08-18T22:27:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa398a00640 1 -- 172.21.15.5:0/2772009942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3940ced20 con 0x7fa39415bed0 2024-08-18T22:27:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa398a00640 1 -- 172.21.15.5:0/2772009942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa394071b20 con 0x7fa39415bed0 2024-08-18T22:27:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.236+0000 7fa38a000640 1 -- 172.21.15.5:0/2772009942 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa38c01a070 con 0x7fa39415bed0 2024-08-18T22:27:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.240+0000 7fa38a000640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678f0 0x7fa374069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.240+0000 7fa38a000640 1 -- 172.21.15.5:0/2772009942 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7fa38c085180 con 0x7fa39415bed0 2024-08-18T22:27:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.240+0000 7fa391e00640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678f0 0x7fa374069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.240+0000 7fa391e00640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678f0 0x7fa374069db0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa3941fa770 tx=0x7fa3840039a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.244+0000 7fa38a000640 1 -- 172.21.15.5:0/2772009942 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa38c055410 con 0x7fa39415bed0 2024-08-18T22:27:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.440+0000 7fa398a00640 1 -- 172.21.15.5:0/2772009942 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3940b32a0 con 0x7fa39415bed0 2024-08-18T22:27:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa38a000640 1 -- 172.21.15.5:0/2772009942 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5222 (secure 0 0 0) 0x7fa38c059710 con 0x7fa39415bed0 2024-08-18T22:27:10.444 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:10.444 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"btime":"2024-08-18T22:25:41:799624+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6680,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3271513219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3271513219},{"type":"v1","addr":"172.21.15.117:6836","nonce":3271513219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7210,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1577791873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1577791873},{"type":"v1","addr":"172.21.15.5:6835","nonce":1577791873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/704276311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":704276311},{"type":"v1","addr":"172.21.15.5:6834","nonce":704276311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-08-18T22:25:28.118793+0000","modified":"2024-08-18T22:25:40.801365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7752":{"gid":7752,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/1147270411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1147270411},{"type":"v1","addr":"172.21.15.117:6837","nonce":1147270411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7752,"qdb_cluster":[7752]},"id":7}]} 2024-08-18T22:27:10.446 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 91 2024-08-18T22:27:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 -- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678f0 msgr2=0x7fa374069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678f0 0x7fa374069db0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa3941fa770 tx=0x7fa3840039a0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 -- 172.21.15.5:0/2772009942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39415bed0 msgr2=0x7fa394140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39415bed0 0x7fa394140310 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00c430 tx=0x7fa38c00c8f0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 -- 172.21.15.5:0/2772009942 shutdown_connections 2024-08-18T22:27:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3740678f0 0x7fa374069db0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa39415bed0 0x7fa394140310 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3940cb390 0x7fa3940ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 --2- 172.21.15.5:0/2772009942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa39406da70 0x7fa394156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 -- 172.21.15.5:0/2772009942 >> 172.21.15.5:0/2772009942 conn(0x7fa3940b1c50 msgr2=0x7fa3940afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 -- 172.21.15.5:0/2772009942 shutdown_connections 2024-08-18T22:27:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.444+0000 7fa398a00640 1 -- 172.21.15.5:0/2772009942 wait complete. 2024-08-18T22:27:10.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:27:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc693e00640 1 Processor -- start 2024-08-18T22:27:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc693e00640 1 -- start start 2024-08-18T22:27:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc693e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc694070510 0x7fc69409b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc693e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc6940d02a0 0x7fc6940d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc693e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69406fe70 con 0x7fc69415f130 2024-08-18T22:27:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc693e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc694070150 con 0x7fc6940d02a0 2024-08-18T22:27:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc693e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc69409aa40 con 0x7fc694070510 2024-08-18T22:27:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc692000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc69415f130 0x7fc6940708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41514/0 (socket says 172.21.15.5:41514) 2024-08-18T22:27:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc692000640 1 -- 172.21.15.5:0/2589129764 learned_addr learned my addr 172.21.15.5:0/2589129764 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc692a00640 1 --2- 172.21.15.5:0/2589129764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc694070510 0x7fc69409b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc693400640 1 --2- 172.21.15.5:0/2589129764 >> v2:172.21.15.117:3300/0 conn(0x7fc6940d02a0 0x7fc6940d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.608+0000 7fc691600640 1 -- 172.21.15.5:0/2589129764 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507346918 0 0) 0x7fc69406fe70 con 0x7fc69415f130 2024-08-18T22:27:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc691600640 1 -- 172.21.15.5:0/2589129764 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc678003530 con 0x7fc69415f130 2024-08-18T22:27:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc692a00640 1 -- 172.21.15.5:0/2589129764 >> v2:172.21.15.117:3300/0 conn(0x7fc6940d02a0 msgr2=0x7fc6940d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc692a00640 1 --2- 172.21.15.5:0/2589129764 >> v2:172.21.15.117:3300/0 conn(0x7fc6940d02a0 0x7fc6940d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc692a00640 1 -- 172.21.15.5:0/2589129764 >> v1:172.21.15.5:6789/0 conn(0x7fc69415f130 legacy=0x7fc6940708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc692a00640 1 -- 172.21.15.5:0/2589129764 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69409ad20 con 0x7fc694070510 2024-08-18T22:27:10.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc693400640 1 --2- 172.21.15.5:0/2589129764 >> v2:172.21.15.117:3300/0 conn(0x7fc6940d02a0 0x7fc6940d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:10.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc692a00640 1 --2- 172.21.15.5:0/2589129764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc694070510 0x7fc69409b520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc6840097c0 tx=0x7fc68401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d43c74fe49755dc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc691600640 1 -- 172.21.15.5:0/2589129764 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6840b0070 con 0x7fc694070510 2024-08-18T22:27:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc691600640 1 -- 172.21.15.5:0/2589129764 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6840ab600 con 0x7fc694070510 2024-08-18T22:27:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc691600640 1 -- 172.21.15.5:0/2589129764 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6840ab9d0 con 0x7fc694070510 2024-08-18T22:27:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc693e00640 1 -- 172.21.15.5:0/2589129764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc694070510 msgr2=0x7fc69409b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc693e00640 1 --2- 172.21.15.5:0/2589129764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc694070510 0x7fc69409b520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc6840097c0 tx=0x7fc68401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc693e00640 1 -- 172.21.15.5:0/2589129764 shutdown_connections 2024-08-18T22:27:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc693e00640 1 --2- 172.21.15.5:0/2589129764 >> v2:172.21.15.117:3300/0 conn(0x7fc6940d02a0 0x7fc6940d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc693e00640 1 --2- 172.21.15.5:0/2589129764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc694070510 0x7fc69409b520 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.612+0000 7fc693e00640 1 -- 172.21.15.5:0/2589129764 >> 172.21.15.5:0/2589129764 conn(0x7fc6940b3a20 msgr2=0x7fc6940b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc693e00640 1 -- 172.21.15.5:0/2589129764 shutdown_connections 2024-08-18T22:27:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc693e00640 1 -- 172.21.15.5:0/2589129764 wait complete. 2024-08-18T22:27:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc693e00640 1 Processor -- start 2024-08-18T22:27:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc693e00640 1 -- start start 2024-08-18T22:27:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc693e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc694070510 0x7fc69415b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc693e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6940d02a0 0x7fc69415f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc693e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc69415f130 0x7fc69415fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc693e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc6940b46d0 con 0x7fc694070510 2024-08-18T22:27:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc693e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc6940b4850 con 0x7fc69415f130 2024-08-18T22:27:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc693e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc69416b7d0 con 0x7fc6940d02a0 2024-08-18T22:27:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc692a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc694070510 0x7fc69415b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc692a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc694070510 0x7fc69415b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50828/0 (socket says 172.21.15.5:50828) 2024-08-18T22:27:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc692a00640 1 -- 172.21.15.5:0/473115995 learned_addr learned my addr 172.21.15.5:0/473115995 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc692000640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6940d02a0 0x7fc69415f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc693400640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc69415f130 0x7fc69415fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc692a00640 1 -- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6940d02a0 msgr2=0x7fc69415f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc692a00640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6940d02a0 0x7fc69415f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc692a00640 1 -- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc69415f130 msgr2=0x7fc69415fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc692a00640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc69415f130 0x7fc69415fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc692a00640 1 -- 172.21.15.5:0/473115995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc694162450 con 0x7fc694070510 2024-08-18T22:27:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc692a00640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc694070510 0x7fc69415b000 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fc68401a0d0 tx=0x7fc68401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.616+0000 7fc68b400640 1 -- 172.21.15.5:0/473115995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6840b0050 con 0x7fc694070510 2024-08-18T22:27:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.620+0000 7fc68b400640 1 -- 172.21.15.5:0/473115995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6840bc070 con 0x7fc694070510 2024-08-18T22:27:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.620+0000 7fc68b400640 1 -- 172.21.15.5:0/473115995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684006e20 con 0x7fc694070510 2024-08-18T22:27:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.620+0000 7fc693e00640 1 -- 172.21.15.5:0/473115995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc694162730 con 0x7fc694070510 2024-08-18T22:27:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.620+0000 7fc693e00640 1 -- 172.21.15.5:0/473115995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69415ba10 con 0x7fc694070510 2024-08-18T22:27:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.620+0000 7fc693e00640 1 -- 172.21.15.5:0/473115995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69409b520 con 0x7fc694070510 2024-08-18T22:27:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.620+0000 7fc68b400640 1 -- 172.21.15.5:0/473115995 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6840b5830 con 0x7fc694070510 2024-08-18T22:27:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.620+0000 7fc68b400640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6740678c0 0x7fc674069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.620+0000 7fc68b400640 1 -- 172.21.15.5:0/473115995 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7fc684120360 con 0x7fc694070510 2024-08-18T22:27:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.620+0000 7fc692000640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6740678c0 0x7fc674069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.624+0000 7fc692000640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6740678c0 0x7fc674069d80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc680007fd0 tx=0x7fc680009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.624+0000 7fc68b400640 1 -- 172.21.15.5:0/473115995 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc684016090 con 0x7fc694070510 2024-08-18T22:27:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.792+0000 7fc693e00640 1 -- 172.21.15.5:0/473115995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6940c57f0 con 0x7fc694070510 2024-08-18T22:27:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.792+0000 7fc68b400640 1 -- 172.21.15.5:0/473115995 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16929 (secure 0 0 0) 0x7fc6840f0cd0 con 0x7fc694070510 2024-08-18T22:27:10.794 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:10.794 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":118,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:26:46.400406+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:25:25.852979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-08-18T22:25:27.124603+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:27:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 -- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6740678c0 msgr2=0x7fc674069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6740678c0 0x7fc674069d80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc680007fd0 tx=0x7fc680009040 comp rx=0 tx=0).stop 2024-08-18T22:27:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 -- 172.21.15.5:0/473115995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc694070510 msgr2=0x7fc69415b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc694070510 0x7fc69415b000 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fc68401a0d0 tx=0x7fc68401ace0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 -- 172.21.15.5:0/473115995 shutdown_connections 2024-08-18T22:27:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc6740678c0 0x7fc674069d80 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc69415f130 0x7fc69415fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6940d02a0 0x7fc69415f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 --2- 172.21.15.5:0/473115995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc694070510 0x7fc69415b000 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 -- 172.21.15.5:0/473115995 >> 172.21.15.5:0/473115995 conn(0x7fc6940b3a20 msgr2=0x7fc69406d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 -- 172.21.15.5:0/473115995 shutdown_connections 2024-08-18T22:27:10.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.796+0000 7fc693e00640 1 -- 172.21.15.5:0/473115995 wait complete. 2024-08-18T22:27:10.816 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:27:10.816 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:27:10.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddcc200640 1 Processor -- start 2024-08-18T22:27:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddcc200640 1 -- start start 2024-08-18T22:27:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddcc200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fddc415b010 0x7fddc40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddcc200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fddc406f290 0x7fddc4072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddcc200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddc40cee20 con 0x7fddc40cd3a0 2024-08-18T22:27:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddcc200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fddc40cfa30 con 0x7fddc406f290 2024-08-18T22:27:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddcc200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fddc40cf100 con 0x7fddc415b010 2024-08-18T22:27:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddca200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fddc406f290 0x7fddc4072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddc8e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fddc40cd3a0 0x7fddc406eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41516/0 (socket says 172.21.15.5:41516) 2024-08-18T22:27:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddc8e00640 1 -- 172.21.15.5:0/2039924895 learned_addr learned my addr 172.21.15.5:0/2039924895 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddc9800640 1 --2- 172.21.15.5:0/2039924895 >> v2:172.21.15.117:3300/0 conn(0x7fddc415b010 0x7fddc40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddca200640 1 -- 172.21.15.5:0/2039924895 >> v2:172.21.15.117:3300/0 conn(0x7fddc415b010 msgr2=0x7fddc40ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddca200640 1 --2- 172.21.15.5:0/2039924895 >> v2:172.21.15.117:3300/0 conn(0x7fddc415b010 0x7fddc40ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddca200640 1 -- 172.21.15.5:0/2039924895 >> v1:172.21.15.5:6789/0 conn(0x7fddc40cd3a0 legacy=0x7fddc406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddca200640 1 -- 172.21.15.5:0/2039924895 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc40cf3e0 con 0x7fddc406f290 2024-08-18T22:27:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.956+0000 7fddc9800640 1 --2- 172.21.15.5:0/2039924895 >> v2:172.21.15.117:3300/0 conn(0x7fddc415b010 0x7fddc40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddca200640 1 --2- 172.21.15.5:0/2039924895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc406f290 0x7fddc4072620 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fddc40cfbb0 tx=0x7fddbc01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be95b964b52916e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddc3e00640 1 -- 172.21.15.5:0/2039924895 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0b2070 con 0x7fddc406f290 2024-08-18T22:27:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddc3e00640 1 -- 172.21.15.5:0/2039924895 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddbc0a58f0 con 0x7fddc406f290 2024-08-18T22:27:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddc3e00640 1 -- 172.21.15.5:0/2039924895 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0a5cc0 con 0x7fddc406f290 2024-08-18T22:27:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddcc200640 1 -- 172.21.15.5:0/2039924895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc406f290 msgr2=0x7fddc4072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddcc200640 1 --2- 172.21.15.5:0/2039924895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc406f290 0x7fddc4072620 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fddc40cfbb0 tx=0x7fddbc01c900 comp rx=0 tx=0).stop 2024-08-18T22:27:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddcc200640 1 -- 172.21.15.5:0/2039924895 shutdown_connections 2024-08-18T22:27:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddcc200640 1 --2- 172.21.15.5:0/2039924895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc406f290 0x7fddc4072620 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddcc200640 1 --2- 172.21.15.5:0/2039924895 >> v2:172.21.15.117:3300/0 conn(0x7fddc415b010 0x7fddc40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddcc200640 1 -- 172.21.15.5:0/2039924895 >> 172.21.15.5:0/2039924895 conn(0x7fddc40b1c50 msgr2=0x7fddc40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddcc200640 1 -- 172.21.15.5:0/2039924895 shutdown_connections 2024-08-18T22:27:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.960+0000 7fddcc200640 1 -- 172.21.15.5:0/2039924895 wait complete. 2024-08-18T22:27:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddcc200640 1 Processor -- start 2024-08-18T22:27:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddcc200640 1 -- start start 2024-08-18T22:27:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddcc200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddc406f290 0x7fddc414e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddcc200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc40cd3a0 0x7fddc40aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddcc200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddc415b010 0x7fddc40caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddcc200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fddc40734f0 con 0x7fddc40cd3a0 2024-08-18T22:27:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddcc200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4073370 con 0x7fddc406f290 2024-08-18T22:27:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddcc200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fddc4073670 con 0x7fddc415b010 2024-08-18T22:27:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc8e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc40cd3a0 0x7fddc40aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc8e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc40cd3a0 0x7fddc40aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50842/0 (socket says 172.21.15.5:50842) 2024-08-18T22:27:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc8e00640 1 -- 172.21.15.5:0/2065170203 learned_addr learned my addr 172.21.15.5:0/2065170203 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc9800640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddc406f290 0x7fddc414e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddca200640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddc415b010 0x7fddc40caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc8e00640 1 -- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddc415b010 msgr2=0x7fddc40caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc8e00640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddc415b010 0x7fddc40caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc8e00640 1 -- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddc406f290 msgr2=0x7fddc414e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc8e00640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddc406f290 0x7fddc414e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc8e00640 1 -- 172.21.15.5:0/2065170203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc415bbc0 con 0x7fddc40cd3a0 2024-08-18T22:27:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddca200640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddc415b010 0x7fddc40caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc8e00640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc40cd3a0 0x7fddc40aeea0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c450 tx=0x7fddb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc1600640 1 -- 172.21.15.5:0/2065170203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb0017070 con 0x7fddc40cd3a0 2024-08-18T22:27:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc1600640 1 -- 172.21.15.5:0/2065170203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb0005cf0 con 0x7fddc40cd3a0 2024-08-18T22:27:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddcc200640 1 -- 172.21.15.5:0/2065170203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc414ed80 con 0x7fddc40cd3a0 2024-08-18T22:27:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddc1600640 1 -- 172.21.15.5:0/2065170203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb0007290 con 0x7fddc40cd3a0 2024-08-18T22:27:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.964+0000 7fddcc200640 1 -- 172.21.15.5:0/2065170203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc40addc0 con 0x7fddc40cd3a0 2024-08-18T22:27:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.968+0000 7fddcc200640 1 -- 172.21.15.5:0/2065170203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc40adf90 con 0x7fddc40cd3a0 2024-08-18T22:27:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.968+0000 7fddc1600640 1 -- 172.21.15.5:0/2065170203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fddb001a070 con 0x7fddc40cd3a0 2024-08-18T22:27:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.968+0000 7fddc1600640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdda40678c0 0x7fdda4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.968+0000 7fddc1600640 1 -- 172.21.15.5:0/2065170203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7fddb0085200 con 0x7fddc40cd3a0 2024-08-18T22:27:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.968+0000 7fddc9800640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdda40678c0 0x7fdda4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.972+0000 7fddc9800640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdda40678c0 0x7fdda4069d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fddc415e700 tx=0x7fddb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:10.972+0000 7fddc1600640 1 -- 172.21.15.5:0/2065170203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fddc40adf90 con 0x7fddc40cd3a0 2024-08-18T22:27:11.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.172+0000 7fddcc200640 1 -- 172.21.15.5:0/2065170203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddc4072620 con 0x7fddc40cd3a0 2024-08-18T22:27:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.172+0000 7fddc1600640 1 -- 172.21.15.5:0/2065170203 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5222 (secure 0 0 0) 0x7fddb0055ae0 con 0x7fddc40cd3a0 2024-08-18T22:27:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:11.173 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"btime":"2024-08-18T22:25:41:799624+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6680,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3271513219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3271513219},{"type":"v1","addr":"172.21.15.117:6836","nonce":3271513219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7210,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1577791873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1577791873},{"type":"v1","addr":"172.21.15.5:6835","nonce":1577791873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/704276311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":704276311},{"type":"v1","addr":"172.21.15.5:6834","nonce":704276311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-08-18T22:25:28.118793+0000","modified":"2024-08-18T22:25:40.801365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7752":{"gid":7752,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/1147270411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1147270411},{"type":"v1","addr":"172.21.15.117:6837","nonce":1147270411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7752,"qdb_cluster":[7752]},"id":7}]} 2024-08-18T22:27:11.173 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 91 2024-08-18T22:27:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 -- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdda40678c0 msgr2=0x7fdda4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdda40678c0 0x7fdda4069d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fddc415e700 tx=0x7fddb8008040 comp rx=0 tx=0).stop 2024-08-18T22:27:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 -- 172.21.15.5:0/2065170203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc40cd3a0 msgr2=0x7fddc40aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc40cd3a0 0x7fddc40aeea0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c450 tx=0x7fddb000c910 comp rx=0 tx=0).stop 2024-08-18T22:27:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 -- 172.21.15.5:0/2065170203 shutdown_connections 2024-08-18T22:27:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdda40678c0 0x7fdda4069d80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddc415b010 0x7fddc40caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddc40cd3a0 0x7fddc40aeea0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 --2- 172.21.15.5:0/2065170203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddc406f290 0x7fddc414e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 -- 172.21.15.5:0/2065170203 >> 172.21.15.5:0/2065170203 conn(0x7fddc40b1c50 msgr2=0x7fddc40b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:11.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 -- 172.21.15.5:0/2065170203 shutdown_connections 2024-08-18T22:27:11.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.176+0000 7fddcc200640 1 -- 172.21.15.5:0/2065170203 wait complete. 2024-08-18T22:27:11.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:27:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.332+0000 7fa32be00640 1 Processor -- start 2024-08-18T22:27:11.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.332+0000 7fa32be00640 1 -- start start 2024-08-18T22:27:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa32be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa32415bed0 0x7fa3240735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa32be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa32406da70 0x7fa32406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa32be00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa324073c80 con 0x7fa3240cb390 2024-08-18T22:27:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa32be00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa32406e420 con 0x7fa32415bed0 2024-08-18T22:27:11.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa32be00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa3240ca5d0 con 0x7fa32406da70 2024-08-18T22:27:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa329400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa32415bed0 0x7fa3240735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa329400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa32415bed0 0x7fa3240735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50850/0 (socket says 172.21.15.5:50850) 2024-08-18T22:27:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa329400640 1 -- 172.21.15.5:0/2394076002 learned_addr learned my addr 172.21.15.5:0/2394076002 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa329e00640 1 --2- 172.21.15.5:0/2394076002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa32406da70 0x7fa32406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa329400640 1 -- 172.21.15.5:0/2394076002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa32406da70 msgr2=0x7fa32406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa329400640 1 --2- 172.21.15.5:0/2394076002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa32406da70 0x7fa32406dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa329400640 1 -- 172.21.15.5:0/2394076002 >> v1:172.21.15.117:6789/0 conn(0x7fa3240cb390 legacy=0x7fa324071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.336+0000 7fa329400640 1 -- 172.21.15.5:0/2394076002 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3240ca8b0 con 0x7fa32415bed0 2024-08-18T22:27:11.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa329400640 1 --2- 172.21.15.5:0/2394076002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa32415bed0 0x7fa3240735a0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa318009e50 tx=0x7fa31801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b47bdec98ef9855 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa323e00640 1 -- 172.21.15.5:0/2394076002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3180a58d0 con 0x7fa32415bed0 2024-08-18T22:27:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa323e00640 1 -- 172.21.15.5:0/2394076002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3180a5a70 con 0x7fa32415bed0 2024-08-18T22:27:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa323e00640 1 -- 172.21.15.5:0/2394076002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3180a5e40 con 0x7fa32415bed0 2024-08-18T22:27:11.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa32be00640 1 -- 172.21.15.5:0/2394076002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa32415bed0 msgr2=0x7fa3240735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa32be00640 1 --2- 172.21.15.5:0/2394076002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa32415bed0 0x7fa3240735a0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa318009e50 tx=0x7fa31801ca00 comp rx=0 tx=0).stop 2024-08-18T22:27:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa32be00640 1 -- 172.21.15.5:0/2394076002 shutdown_connections 2024-08-18T22:27:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa32be00640 1 --2- 172.21.15.5:0/2394076002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa32406da70 0x7fa32406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa32be00640 1 --2- 172.21.15.5:0/2394076002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa32415bed0 0x7fa3240735a0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa32be00640 1 -- 172.21.15.5:0/2394076002 >> 172.21.15.5:0/2394076002 conn(0x7fa3240b1c50 msgr2=0x7fa3240b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:11.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa32be00640 1 -- 172.21.15.5:0/2394076002 shutdown_connections 2024-08-18T22:27:11.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa32be00640 1 -- 172.21.15.5:0/2394076002 wait complete. 2024-08-18T22:27:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa32be00640 1 Processor -- start 2024-08-18T22:27:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.340+0000 7fa32be00640 1 -- start start 2024-08-18T22:27:11.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa32be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa32406da70 0x7fa32409d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa32be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3240cb390 0x7fa3240b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa32be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32415bed0 0x7fa324151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa32be00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa324168520 con 0x7fa32406da70 2024-08-18T22:27:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa32be00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3241683a0 con 0x7fa32415bed0 2024-08-18T22:27:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa32be00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa3241686a0 con 0x7fa3240cb390 2024-08-18T22:27:11.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa329400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa32406da70 0x7fa32409d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa329400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa32406da70 0x7fa32409d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50858/0 (socket says 172.21.15.5:50858) 2024-08-18T22:27:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa329400640 1 -- 172.21.15.5:0/1205532383 learned_addr learned my addr 172.21.15.5:0/1205532383 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa329e00640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32415bed0 0x7fa324151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa328a00640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3240cb390 0x7fa3240b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa329400640 1 -- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3240cb390 msgr2=0x7fa3240b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa329400640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3240cb390 0x7fa3240b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa329400640 1 -- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32415bed0 msgr2=0x7fa324151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa329400640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32415bed0 0x7fa324151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa329400640 1 -- 172.21.15.5:0/1205532383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3240b57d0 con 0x7fa32406da70 2024-08-18T22:27:11.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa329400640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa32406da70 0x7fa32409d980 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa3180af040 tx=0x7fa3180197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:11.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa321600640 1 -- 172.21.15.5:0/1205532383 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3180a58d0 con 0x7fa32406da70 2024-08-18T22:27:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa321600640 1 -- 172.21.15.5:0/1205532383 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3180090d0 con 0x7fa32406da70 2024-08-18T22:27:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa321600640 1 -- 172.21.15.5:0/1205532383 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318009510 con 0x7fa32406da70 2024-08-18T22:27:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa32be00640 1 -- 172.21.15.5:0/1205532383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32409df60 con 0x7fa32406da70 2024-08-18T22:27:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa32be00640 1 -- 172.21.15.5:0/1205532383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa32409c740 con 0x7fa32406da70 2024-08-18T22:27:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa32be00640 1 -- 172.21.15.5:0/1205532383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32406dee0 con 0x7fa32406da70 2024-08-18T22:27:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.344+0000 7fa321600640 1 -- 172.21.15.5:0/1205532383 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3180c0020 con 0x7fa32406da70 2024-08-18T22:27:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.348+0000 7fa321600640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3040678c0 0x7fa304069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.348+0000 7fa321600640 1 -- 172.21.15.5:0/1205532383 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7fa318120b10 con 0x7fa32406da70 2024-08-18T22:27:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.348+0000 7fa328a00640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3040678c0 0x7fa304069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.348+0000 7fa328a00640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3040678c0 0x7fa304069d80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa32415b8f0 tx=0x7fa310009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.352+0000 7fa321600640 1 -- 172.21.15.5:0/1205532383 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa3180c7020 con 0x7fa32406da70 2024-08-18T22:27:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.548+0000 7fa32be00640 1 -- 172.21.15.5:0/1205532383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3241f4960 con 0x7fa32406da70 2024-08-18T22:27:11.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.548+0000 7fa321600640 1 -- 172.21.15.5:0/1205532383 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5222 (secure 0 0 0) 0x7fa318016620 con 0x7fa32406da70 2024-08-18T22:27:11.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:11.549 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":91,"btime":"2024-08-18T22:25:41:799624+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6680,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3271513219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3271513219},{"type":"v1","addr":"172.21.15.117:6836","nonce":3271513219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7210,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1577791873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1577791873},{"type":"v1","addr":"172.21.15.5:6835","nonce":1577791873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/704276311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":704276311},{"type":"v1","addr":"172.21.15.5:6834","nonce":704276311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-08-18T22:25:28.118793+0000","modified":"2024-08-18T22:25:40.801365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7752},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7752":{"gid":7752,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/1147270411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1147270411},{"type":"v1","addr":"172.21.15.117:6837","nonce":1147270411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7752,"qdb_cluster":[7752]},"id":7}]} 2024-08-18T22:27:11.550 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 91 2024-08-18T22:27:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 -- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3040678c0 msgr2=0x7fa304069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3040678c0 0x7fa304069d80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa32415b8f0 tx=0x7fa310009040 comp rx=0 tx=0).stop 2024-08-18T22:27:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 -- 172.21.15.5:0/1205532383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa32406da70 msgr2=0x7fa32409d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa32406da70 0x7fa32409d980 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa3180af040 tx=0x7fa3180197a0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 -- 172.21.15.5:0/1205532383 shutdown_connections 2024-08-18T22:27:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3040678c0 0x7fa304069d80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32415bed0 0x7fa324151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3240cb390 0x7fa3240b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 --2- 172.21.15.5:0/1205532383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa32406da70 0x7fa32409d980 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 -- 172.21.15.5:0/1205532383 >> 172.21.15.5:0/1205532383 conn(0x7fa3240b1c50 msgr2=0x7fa3240ad1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 -- 172.21.15.5:0/1205532383 shutdown_connections 2024-08-18T22:27:11.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.552+0000 7fa32be00640 1 -- 172.21.15.5:0/1205532383 wait complete. 2024-08-18T22:27:11.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:27:11.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.708+0000 7fa23a200640 1 Processor -- start 2024-08-18T22:27:11.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa23a200640 1 -- start start 2024-08-18T22:27:11.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa23a200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa234070510 0x7fa23409b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa23a200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2340d02a0 0x7fa2340d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa23a200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23406fe70 con 0x7fa23415f130 2024-08-18T22:27:11.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa23a200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa234070150 con 0x7fa2340d02a0 2024-08-18T22:27:11.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa23a200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa23409aa40 con 0x7fa234070510 2024-08-18T22:27:11.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa239800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2340d02a0 0x7fa2340d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa22be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa23415f130 0x7fa2340708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41530/0 (socket says 172.21.15.5:41530) 2024-08-18T22:27:11.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa22be00640 1 -- 172.21.15.5:0/2631104625 learned_addr learned my addr 172.21.15.5:0/2631104625 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:11.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa238e00640 1 --2- 172.21.15.5:0/2631104625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa234070510 0x7fa23409b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa239800640 1 -- 172.21.15.5:0/2631104625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa234070510 msgr2=0x7fa23409b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:11.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa239800640 1 --2- 172.21.15.5:0/2631104625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa234070510 0x7fa23409b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa239800640 1 -- 172.21.15.5:0/2631104625 >> v1:172.21.15.5:6789/0 conn(0x7fa23415f130 legacy=0x7fa2340708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa239800640 1 -- 172.21.15.5:0/2631104625 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23409ad20 con 0x7fa2340d02a0 2024-08-18T22:27:11.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.712+0000 7fa233e00640 1 -- 172.21.15.5:0/2631104625 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821869987 0 0) 0x7fa23406fe70 con 0x7fa23415f130 2024-08-18T22:27:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa239800640 1 --2- 172.21.15.5:0/2631104625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2340d02a0 0x7fa2340d0750 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009d90 tx=0x7fa22c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f81f05dd9b7d78 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa233e00640 1 -- 172.21.15.5:0/2631104625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0b2070 con 0x7fa2340d02a0 2024-08-18T22:27:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa233e00640 1 -- 172.21.15.5:0/2631104625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c0a5830 con 0x7fa2340d02a0 2024-08-18T22:27:11.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa233e00640 1 -- 172.21.15.5:0/2631104625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0a5c00 con 0x7fa2340d02a0 2024-08-18T22:27:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa23a200640 1 -- 172.21.15.5:0/2631104625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2340d02a0 msgr2=0x7fa2340d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa23a200640 1 --2- 172.21.15.5:0/2631104625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2340d02a0 0x7fa2340d0750 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009d90 tx=0x7fa22c01c970 comp rx=0 tx=0).stop 2024-08-18T22:27:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa23a200640 1 -- 172.21.15.5:0/2631104625 shutdown_connections 2024-08-18T22:27:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa23a200640 1 --2- 172.21.15.5:0/2631104625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2340d02a0 0x7fa2340d0750 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa23a200640 1 --2- 172.21.15.5:0/2631104625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa234070510 0x7fa23409b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa23a200640 1 -- 172.21.15.5:0/2631104625 >> 172.21.15.5:0/2631104625 conn(0x7fa2340b3a20 msgr2=0x7fa2340b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa23a200640 1 -- 172.21.15.5:0/2631104625 shutdown_connections 2024-08-18T22:27:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa23a200640 1 -- 172.21.15.5:0/2631104625 wait complete. 2024-08-18T22:27:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa23a200640 1 Processor -- start 2024-08-18T22:27:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.716+0000 7fa23a200640 1 -- start start 2024-08-18T22:27:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa23a200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa234070510 0x7fa2340c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa23a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2340d02a0 0x7fa23415f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa23a200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa23415f130 0x7fa23415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa23a200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa2340b46d0 con 0x7fa2340d02a0 2024-08-18T22:27:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa23a200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa2340b4850 con 0x7fa23415f130 2024-08-18T22:27:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa23a200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa23416b7d0 con 0x7fa234070510 2024-08-18T22:27:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa22be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2340d02a0 0x7fa23415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa22be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2340d02a0 0x7fa23415f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50882/0 (socket says 172.21.15.5:50882) 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa22be00640 1 -- 172.21.15.5:0/1792511502 learned_addr learned my addr 172.21.15.5:0/1792511502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa238e00640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa234070510 0x7fa2340c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa239800640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa23415f130 0x7fa23415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa22be00640 1 -- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa234070510 msgr2=0x7fa2340c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa22be00640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa234070510 0x7fa2340c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa22be00640 1 -- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa23415f130 msgr2=0x7fa23415fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa22be00640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa23415f130 0x7fa23415fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa22be00640 1 -- 172.21.15.5:0/1792511502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2340c7cf0 con 0x7fa2340d02a0 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa239800640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa23415f130 0x7fa23415fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa22be00640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2340d02a0 0x7fa23415f810 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c480 tx=0x7fa21c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa231600640 1 -- 172.21.15.5:0/1792511502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c018070 con 0x7fa2340d02a0 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa231600640 1 -- 172.21.15.5:0/1792511502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21c0074e0 con 0x7fa2340d02a0 2024-08-18T22:27:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa231600640 1 -- 172.21.15.5:0/1792511502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c0049f0 con 0x7fa2340d02a0 2024-08-18T22:27:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa23a200640 1 -- 172.21.15.5:0/1792511502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2340c7fd0 con 0x7fa2340d02a0 2024-08-18T22:27:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa23a200640 1 -- 172.21.15.5:0/1792511502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2340b57c0 con 0x7fa2340d02a0 2024-08-18T22:27:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa23a200640 1 -- 172.21.15.5:0/1792511502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2340b55d0 con 0x7fa2340d02a0 2024-08-18T22:27:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.720+0000 7fa231600640 1 -- 172.21.15.5:0/1792511502 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa21c01b070 con 0x7fa2340d02a0 2024-08-18T22:27:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.724+0000 7fa231600640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2100678c0 0x7fa210069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.724+0000 7fa231600640 1 -- 172.21.15.5:0/1792511502 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7fa21c085230 con 0x7fa2340d02a0 2024-08-18T22:27:11.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.724+0000 7fa238e00640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2100678c0 0x7fa210069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:11.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.724+0000 7fa238e00640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2100678c0 0x7fa210069d80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa2340ce780 tx=0x7fa224009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.728+0000 7fa231600640 1 -- 172.21.15.5:0/1792511502 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa21c055550 con 0x7fa2340d02a0 2024-08-18T22:27:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.896+0000 7fa23a200640 1 -- 172.21.15.5:0/1792511502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa23409b520 con 0x7fa2340d02a0 2024-08-18T22:27:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.896+0000 7fa231600640 1 -- 172.21.15.5:0/1792511502 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16929 (secure 0 0 0) 0x7fa21c059850 con 0x7fa2340d02a0 2024-08-18T22:27:11.898 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:11.898 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":118,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:26:46.400406+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:25:25.852979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-08-18T22:25:27.124603+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:27:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 -- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2100678c0 msgr2=0x7fa210069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2100678c0 0x7fa210069d80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa2340ce780 tx=0x7fa224009190 comp rx=0 tx=0).stop 2024-08-18T22:27:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 -- 172.21.15.5:0/1792511502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2340d02a0 msgr2=0x7fa23415f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2340d02a0 0x7fa23415f810 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c480 tx=0x7fa21c00c940 comp rx=0 tx=0).stop 2024-08-18T22:27:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 -- 172.21.15.5:0/1792511502 shutdown_connections 2024-08-18T22:27:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa2100678c0 0x7fa210069d80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa23415f130 0x7fa23415fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2340d02a0 0x7fa23415f810 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 --2- 172.21.15.5:0/1792511502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa234070510 0x7fa2340c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 -- 172.21.15.5:0/1792511502 >> 172.21.15.5:0/1792511502 conn(0x7fa2340b3a20 msgr2=0x7fa23406d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 -- 172.21.15.5:0/1792511502 shutdown_connections 2024-08-18T22:27:11.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:11.900+0000 7fa23a200640 1 -- 172.21.15.5:0/1792511502 wait complete. 2024-08-18T22:27:11.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:27:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd514c00640 1 Processor -- start 2024-08-18T22:27:12.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd514c00640 1 -- start start 2024-08-18T22:27:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd514c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51015fb80 0x7fd5100d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd514c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5100d1090 0x7fd510071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd514c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5100d30b0 con 0x7fd5100b5ad0 2024-08-18T22:27:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd514c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd5100d1eb0 con 0x7fd5100d1090 2024-08-18T22:27:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd514c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5100d1bd0 con 0x7fd51015fb80 2024-08-18T22:27:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd50e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5100d1090 0x7fd510071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd50e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5100d1090 0x7fd510071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50898/0 (socket says 172.21.15.5:50898) 2024-08-18T22:27:12.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd50e800640 1 -- 172.21.15.5:0/1143445165 learned_addr learned my addr 172.21.15.5:0/1143445165 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd50de00640 1 --2- 172.21.15.5:0/1143445165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51015fb80 0x7fd5100d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd50e800640 1 -- 172.21.15.5:0/1143445165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51015fb80 msgr2=0x7fd5100d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd50e800640 1 --2- 172.21.15.5:0/1143445165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51015fb80 0x7fd5100d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd50e800640 1 -- 172.21.15.5:0/1143445165 >> v1:172.21.15.117:6789/0 conn(0x7fd5100b5ad0 legacy=0x7fd51006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd50e800640 1 -- 172.21.15.5:0/1143445165 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5100d2dd0 con 0x7fd5100d1090 2024-08-18T22:27:12.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.060+0000 7fd50de00640 1 --2- 172.21.15.5:0/1143445165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51015fb80 0x7fd5100d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd50e800640 1 --2- 172.21.15.5:0/1143445165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5100d1090 0x7fd510071550 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fd508009e50 tx=0x7fd50801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fb45fee3750925 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd50d400640 1 -- 172.21.15.5:0/1143445165 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5080a5550 con 0x7fd5100d1090 2024-08-18T22:27:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd50d400640 1 -- 172.21.15.5:0/1143445165 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5080a56f0 con 0x7fd5100d1090 2024-08-18T22:27:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd50d400640 1 -- 172.21.15.5:0/1143445165 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5080a5ac0 con 0x7fd5100d1090 2024-08-18T22:27:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd514c00640 1 -- 172.21.15.5:0/1143445165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5100d1090 msgr2=0x7fd510071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd514c00640 1 --2- 172.21.15.5:0/1143445165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5100d1090 0x7fd510071550 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fd508009e50 tx=0x7fd50801c8d0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd514c00640 1 -- 172.21.15.5:0/1143445165 shutdown_connections 2024-08-18T22:27:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd514c00640 1 --2- 172.21.15.5:0/1143445165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5100d1090 0x7fd510071550 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd514c00640 1 --2- 172.21.15.5:0/1143445165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51015fb80 0x7fd5100d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd514c00640 1 -- 172.21.15.5:0/1143445165 >> 172.21.15.5:0/1143445165 conn(0x7fd5100d2180 msgr2=0x7fd5100d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd514c00640 1 -- 172.21.15.5:0/1143445165 shutdown_connections 2024-08-18T22:27:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.064+0000 7fd514c00640 1 -- 172.21.15.5:0/1143445165 wait complete. 2024-08-18T22:27:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd514c00640 1 Processor -- start 2024-08-18T22:27:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd514c00640 1 -- start start 2024-08-18T22:27:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd514c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5100b5ad0 0x7fd51014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd514c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5100d1090 0x7fd51014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd514c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51015fb80 0x7fd510156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd514c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd510169270 con 0x7fd5100b5ad0 2024-08-18T22:27:12.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd514c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd5101690f0 con 0x7fd5100d1090 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd514c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5101693f0 con 0x7fd51015fb80 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd50de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5100b5ad0 0x7fd51014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd50de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5100b5ad0 0x7fd51014f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50914/0 (socket says 172.21.15.5:50914) 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd50de00640 1 -- 172.21.15.5:0/1098931888 learned_addr learned my addr 172.21.15.5:0/1098931888 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd50e800640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51015fb80 0x7fd510156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd505400640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5100d1090 0x7fd51014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd50de00640 1 -- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51015fb80 msgr2=0x7fd510156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd50de00640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51015fb80 0x7fd510156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd50de00640 1 -- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5100d1090 msgr2=0x7fd51014ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd50de00640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5100d1090 0x7fd51014ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd50de00640 1 -- 172.21.15.5:0/1098931888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51014f980 con 0x7fd5100b5ad0 2024-08-18T22:27:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd50de00640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5100b5ad0 0x7fd51014f360 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c7f0 tx=0x7fd50000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd506a00640 1 -- 172.21.15.5:0/1098931888 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500015070 con 0x7fd5100b5ad0 2024-08-18T22:27:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd506a00640 1 -- 172.21.15.5:0/1098931888 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd500007820 con 0x7fd5100b5ad0 2024-08-18T22:27:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd514c00640 1 -- 172.21.15.5:0/1098931888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5100af530 con 0x7fd5100b5ad0 2024-08-18T22:27:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd506a00640 1 -- 172.21.15.5:0/1098931888 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500007c10 con 0x7fd5100b5ad0 2024-08-18T22:27:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.068+0000 7fd514c00640 1 -- 172.21.15.5:0/1098931888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd510156980 con 0x7fd5100b5ad0 2024-08-18T22:27:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.072+0000 7fd514c00640 1 -- 172.21.15.5:0/1098931888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd510071550 con 0x7fd5100b5ad0 2024-08-18T22:27:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.072+0000 7fd506a00640 1 -- 172.21.15.5:0/1098931888 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd500018070 con 0x7fd5100b5ad0 2024-08-18T22:27:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.072+0000 7fd506a00640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4ec0678c0 0x7fd4ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.072+0000 7fd506a00640 1 -- 172.21.15.5:0/1098931888 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7fd5000862e0 con 0x7fd5100b5ad0 2024-08-18T22:27:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.072+0000 7fd505400640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4ec0678c0 0x7fd4ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.072+0000 7fd505400640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4ec0678c0 0x7fd4ec069d80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd5100b6670 tx=0x7fd4f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.076+0000 7fd506a00640 1 -- 172.21.15.5:0/1098931888 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd500056dd0 con 0x7fd5100b5ad0 2024-08-18T22:27:12.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.272+0000 7fd514c00640 1 -- 172.21.15.5:0/1098931888 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd510151590 con 0x7fd5100b5ad0 2024-08-18T22:27:12.274 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:27:12.276+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:27:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.276+0000 7fd506a00640 1 -- 172.21.15.5:0/1098931888 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v92) ==== 161+0+0 (secure 0 0 0) 0x7fd5000860e0 con 0x7fd5100b5ad0 2024-08-18T22:27:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:27:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 -- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4ec0678c0 msgr2=0x7fd4ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4ec0678c0 0x7fd4ec069d80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd5100b6670 tx=0x7fd4f8009040 comp rx=0 tx=0).stop 2024-08-18T22:27:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 -- 172.21.15.5:0/1098931888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5100b5ad0 msgr2=0x7fd51014f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5100b5ad0 0x7fd51014f360 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c7f0 tx=0x7fd50000ccb0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 -- 172.21.15.5:0/1098931888 shutdown_connections 2024-08-18T22:27:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4ec0678c0 0x7fd4ec069d80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51015fb80 0x7fd510156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5100d1090 0x7fd51014ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 --2- 172.21.15.5:0/1098931888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5100b5ad0 0x7fd51014f360 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 -- 172.21.15.5:0/1098931888 >> 172.21.15.5:0/1098931888 conn(0x7fd5100d2180 msgr2=0x7fd510150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 -- 172.21.15.5:0/1098931888 shutdown_connections 2024-08-18T22:27:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.280+0000 7fd514c00640 1 -- 172.21.15.5:0/1098931888 wait complete. 2024-08-18T22:27:12.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:27:12.352 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:27:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.444+0000 7fb3eb200640 1 Processor -- start 2024-08-18T22:27:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.444+0000 7fb3eb200640 1 -- start start 2024-08-18T22:27:12.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.444+0000 7fb3eb200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb3e415b0c0 0x7fb3e406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.444+0000 7fb3eb200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3e40b40c0 0x7fb3e40b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3eb200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3e4072a30 0x7fb3e4072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3eb200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb3e40b4a70 con 0x7fb3e40b40c0 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3eb200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb3e40b3d70 con 0x7fb3e415b0c0 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3eb200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e40b31f0 con 0x7fb3e4072a30 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3db400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3e40b40c0 0x7fb3e40b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3e3e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb3e415b0c0 0x7fb3e406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3db400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3e40b40c0 0x7fb3e40b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50928/0 (socket says 172.21.15.5:50928) 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3e3e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb3e415b0c0 0x7fb3e406db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:50414/0 (socket says 172.21.15.5:50414) 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3db400640 1 -- 172.21.15.5:0/2054024922 learned_addr learned my addr 172.21.15.5:0/2054024922 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3e9200640 1 --2- 172.21.15.5:0/2054024922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3e4072a30 0x7fb3e4072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3e3e00640 1 -- 172.21.15.5:0/2054024922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3e4072a30 msgr2=0x7fb3e4072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:12.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3e3e00640 1 --2- 172.21.15.5:0/2054024922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3e4072a30 0x7fb3e4072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3e3e00640 1 -- 172.21.15.5:0/2054024922 >> v2:172.21.15.5:3300/0 conn(0x7fb3e40b40c0 msgr2=0x7fb3e40b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:12.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3e3e00640 1 --2- 172.21.15.5:0/2054024922 >> v2:172.21.15.5:3300/0 conn(0x7fb3e40b40c0 0x7fb3e40b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3e3e00640 1 -- 172.21.15.5:0/2054024922 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e40b34d0 con 0x7fb3e415b0c0 2024-08-18T22:27:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3e3e00640 1 --2- 172.21.15.5:0/2054024922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3e415b0c0 0x7fb3e406db80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4070ba0 tx=0x7fb3d401ea00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f62d4a42561b4d60 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.448+0000 7fb3e3400640 1 -- 172.21.15.5:0/2054024922 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40b4070 con 0x7fb3e415b0c0 2024-08-18T22:27:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3e3400640 1 -- 172.21.15.5:0/2054024922 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d40a7990 con 0x7fb3e415b0c0 2024-08-18T22:27:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3e3400640 1 -- 172.21.15.5:0/2054024922 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40a7d60 con 0x7fb3e415b0c0 2024-08-18T22:27:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3eb200640 1 -- 172.21.15.5:0/2054024922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3e415b0c0 msgr2=0x7fb3e406db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3eb200640 1 --2- 172.21.15.5:0/2054024922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3e415b0c0 0x7fb3e406db80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4070ba0 tx=0x7fb3d401ea00 comp rx=0 tx=0).stop 2024-08-18T22:27:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3eb200640 1 -- 172.21.15.5:0/2054024922 shutdown_connections 2024-08-18T22:27:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3eb200640 1 --2- 172.21.15.5:0/2054024922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3e4072a30 0x7fb3e4072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3eb200640 1 --2- 172.21.15.5:0/2054024922 >> v2:172.21.15.5:3300/0 conn(0x7fb3e40b40c0 0x7fb3e40b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3eb200640 1 --2- 172.21.15.5:0/2054024922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3e415b0c0 0x7fb3e406db80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3eb200640 1 -- 172.21.15.5:0/2054024922 >> 172.21.15.5:0/2054024922 conn(0x7fb3e40b1dc0 msgr2=0x7fb3e40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3eb200640 1 -- 172.21.15.5:0/2054024922 shutdown_connections 2024-08-18T22:27:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3eb200640 1 -- 172.21.15.5:0/2054024922 wait complete. 2024-08-18T22:27:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3eb200640 1 Processor -- start 2024-08-18T22:27:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.452+0000 7fb3eb200640 1 -- start start 2024-08-18T22:27:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3eb200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3e4072a30 0x7fb3e409b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3eb200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3e40b40c0 0x7fb3e409baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3eb200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e415b0c0 0x7fb3e415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3eb200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e415b620 con 0x7fb3e415b0c0 2024-08-18T22:27:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3eb200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e415b4a0 con 0x7fb3e40b40c0 2024-08-18T22:27:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3eb200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e40737d0 con 0x7fb3e4072a30 2024-08-18T22:27:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3e9200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e415b0c0 0x7fb3e415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3db400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3e40b40c0 0x7fb3e409baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3e3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3e4072a30 0x7fb3e409b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3db400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3e40b40c0 0x7fb3e409baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:50418/0 (socket says 172.21.15.5:50418) 2024-08-18T22:27:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3db400640 1 -- 172.21.15.5:0/871799954 learned_addr learned my addr 172.21.15.5:0/871799954 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3db400640 1 -- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3e4072a30 msgr2=0x7fb3e409b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3db400640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3e4072a30 0x7fb3e409b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3db400640 1 -- 172.21.15.5:0/871799954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e415b0c0 msgr2=0x7fb3e415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3db400640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e415b0c0 0x7fb3e415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3db400640 1 -- 172.21.15.5:0/871799954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e415bbc0 con 0x7fb3e40b40c0 2024-08-18T22:27:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3e3e00640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3e4072a30 0x7fb3e409b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3e9200640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e415b0c0 0x7fb3e415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3db400640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3e40b40c0 0x7fb3e409baf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00e8c0 tx=0x7fb3cc00ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3e0c00640 1 -- 172.21.15.5:0/871799954 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc017070 con 0x7fb3e40b40c0 2024-08-18T22:27:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3e0c00640 1 -- 172.21.15.5:0/871799954 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3cc00c940 con 0x7fb3e40b40c0 2024-08-18T22:27:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3eb200640 1 -- 172.21.15.5:0/871799954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e415bea0 con 0x7fb3e40b40c0 2024-08-18T22:27:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3e0c00640 1 -- 172.21.15.5:0/871799954 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00cd30 con 0x7fb3e40b40c0 2024-08-18T22:27:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3eb200640 1 -- 172.21.15.5:0/871799954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e415c460 con 0x7fb3e40b40c0 2024-08-18T22:27:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.456+0000 7fb3eb200640 1 -- 172.21.15.5:0/871799954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e406f670 con 0x7fb3e40b40c0 2024-08-18T22:27:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.460+0000 7fb3e0c00640 1 -- 172.21.15.5:0/871799954 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3cc01a070 con 0x7fb3e40b40c0 2024-08-18T22:27:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.460+0000 7fb3e0c00640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3c00678f0 0x7fb3c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.460+0000 7fb3e0c00640 1 -- 172.21.15.5:0/871799954 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6216+0+0 (secure 0 0 0) 0x7fb3cc0860b0 con 0x7fb3e40b40c0 2024-08-18T22:27:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.460+0000 7fb3e3e00640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3c00678f0 0x7fb3c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.460+0000 7fb3e3e00640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3c00678f0 0x7fb3c0069db0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40b1000 tx=0x7fb3d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.464+0000 7fb3e0c00640 1 -- 172.21.15.5:0/871799954 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb3cc056390 con 0x7fb3e40b40c0 2024-08-18T22:27:12.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:12.664+0000 7fb3eb200640 1 -- 172.21.15.5:0/871799954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb3e40b4800 con 0x7fb3e40b40c0 2024-08-18T22:27:13.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.280+0000 7fb3e0c00640 1 -- 172.21.15.5:0/871799954 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v93) ==== 104+0+0 (secure 0 0 0) 0x7fb3cc05a690 con 0x7fb3e40b40c0 2024-08-18T22:27:13.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 -- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3c00678f0 msgr2=0x7fb3c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:13.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3c00678f0 0x7fb3c0069db0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40b1000 tx=0x7fb3d4008040 comp rx=0 tx=0).stop 2024-08-18T22:27:13.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 -- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3e40b40c0 msgr2=0x7fb3e409baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3e40b40c0 0x7fb3e409baf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00e8c0 tx=0x7fb3cc00ed80 comp rx=0 tx=0).stop 2024-08-18T22:27:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 -- 172.21.15.5:0/871799954 shutdown_connections 2024-08-18T22:27:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3c00678f0 0x7fb3c0069db0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3e415b0c0 0x7fb3e415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3e40b40c0 0x7fb3e409baf0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 --2- 172.21.15.5:0/871799954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3e4072a30 0x7fb3e409b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 -- 172.21.15.5:0/871799954 >> 172.21.15.5:0/871799954 conn(0x7fb3e40b1dc0 msgr2=0x7fb3e40b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:13.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 -- 172.21.15.5:0/871799954 shutdown_connections 2024-08-18T22:27:13.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.284+0000 7fb3eb200640 1 -- 172.21.15.5:0/871799954 wait complete. 2024-08-18T22:27:13.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:27:13.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e93e00640 1 Processor -- start 2024-08-18T22:27:13.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e93e00640 1 -- start start 2024-08-18T22:27:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e93e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5e940d0580 0x7f5e940d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:13.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e93e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9415bf80 con 0x7f5e941555d0 2024-08-18T22:27:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e93e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e940cfaa0 con 0x7f5e940cda40 2024-08-18T22:27:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e93e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5e9406f9f0 con 0x7f5e940d0580 2024-08-18T22:27:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5e941555d0 0x7f5e9415c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41538/0 (socket says 172.21.15.5:41538) 2024-08-18T22:27:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92a00640 1 -- 172.21.15.5:0/1717877257 learned_addr learned my addr 172.21.15.5:0/1717877257 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024308865 0 0) 0x7f5e9415bf80 con 0x7f5e941555d0 2024-08-18T22:27:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e78003530 con 0x7f5e941555d0 2024-08-18T22:27:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e8be00640 1 --2- 172.21.15.5:0/1717877257 >> v2:172.21.15.117:3300/0 conn(0x7f5e940d0580 0x7f5e940d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3668010038 0 0) 0x7f5e78003530 con 0x7f5e941555d0 2024-08-18T22:27:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 >> v2:172.21.15.117:3300/0 conn(0x7f5e940d0580 msgr2=0x7f5e940d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 --2- 172.21.15.5:0/1717877257 >> v2:172.21.15.117:3300/0 conn(0x7f5e940d0580 0x7f5e940d09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 >> v1:172.21.15.117:6789/0 conn(0x7f5e940cda40 legacy=0x7f5e9415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e940cfd80 con 0x7f5e941555d0 2024-08-18T22:27:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f5e84001680 con 0x7f5e941555d0 2024-08-18T22:27:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 >> v1:172.21.15.5:6789/0 conn(0x7f5e941555d0 legacy=0x7f5e9415c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 --2- 172.21.15.5:0/1717877257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e78003a30 0x7f5e78003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 --2- 172.21.15.5:0/1717877257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e78004810 0x7f5e78004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 --2- 172.21.15.5:0/1717877257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e78005240 0x7f5e7800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7800c170 con 0x7f5e78003a30 2024-08-18T22:27:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7800c320 con 0x7f5e78004810 2024-08-18T22:27:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5e7800c520 con 0x7f5e78005240 2024-08-18T22:27:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92a00640 1 --2- 172.21.15.5:0/1717877257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e78003a30 0x7f5e78003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e8be00640 1 --2- 172.21.15.5:0/1717877257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e78004810 0x7f5e78004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e93400640 1 --2- 172.21.15.5:0/1717877257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e78005240 0x7f5e7800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92a00640 1 -- 172.21.15.5:0/1717877257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e78005240 msgr2=0x7f5e7800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92a00640 1 --2- 172.21.15.5:0/1717877257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e78005240 0x7f5e7800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92a00640 1 -- 172.21.15.5:0/1717877257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e78004810 msgr2=0x7f5e78004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92a00640 1 --2- 172.21.15.5:0/1717877257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e78004810 0x7f5e78004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e92a00640 1 -- 172.21.15.5:0/1717877257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e78003530 con 0x7f5e78003a30 2024-08-18T22:27:13.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.480+0000 7f5e93400640 1 -- 172.21.15.5:0/1717877257 reap_dead start 2024-08-18T22:27:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.484+0000 7f5e92a00640 1 --2- 172.21.15.5:0/1717877257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e78003a30 0x7f5e78003e50 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400c240 tx=0x7f5e8401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9fb7e7f749aeb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.484+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84007d20 con 0x7f5e78003a30 2024-08-18T22:27:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.484+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e840a9070 con 0x7f5e78003a30 2024-08-18T22:27:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.484+0000 7f5e92000640 1 -- 172.21.15.5:0/1717877257 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84005da0 con 0x7f5e78003a30 2024-08-18T22:27:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.484+0000 7f5e93e00640 1 -- 172.21.15.5:0/1717877257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e78003a30 msgr2=0x7f5e78003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.484+0000 7f5e93e00640 1 --2- 172.21.15.5:0/1717877257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e78003a30 0x7f5e78003e50 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400c240 tx=0x7f5e8401cc80 comp rx=0 tx=0).stop 2024-08-18T22:27:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.484+0000 7f5e93e00640 1 -- 172.21.15.5:0/1717877257 shutdown_connections 2024-08-18T22:27:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.484+0000 7f5e93e00640 1 --2- 172.21.15.5:0/1717877257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e78003a30 0x7f5e78003e50 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.484+0000 7f5e93e00640 1 -- 172.21.15.5:0/1717877257 >> 172.21.15.5:0/1717877257 conn(0x7f5e9406e970 msgr2=0x7f5e9406ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.484+0000 7f5e93e00640 1 -- 172.21.15.5:0/1717877257 shutdown_connections 2024-08-18T22:27:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.484+0000 7f5e93e00640 1 -- 172.21.15.5:0/1717877257 wait complete. 2024-08-18T22:27:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93e00640 1 Processor -- start 2024-08-18T22:27:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93e00640 1 -- start start 2024-08-18T22:27:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e78003a30 0x7f5e941ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e94141eb0 0x7f5e941537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e94153cf0 0x7f5e94140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5e940ce230 con 0x7f5e94153cf0 2024-08-18T22:27:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e940d0d70 con 0x7f5e94141eb0 2024-08-18T22:27:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5e940ce3b0 con 0x7f5e78003a30 2024-08-18T22:27:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e94153cf0 0x7f5e94140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e94153cf0 0x7f5e94140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50972/0 (socket says 172.21.15.5:50972) 2024-08-18T22:27:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93400640 1 -- 172.21.15.5:0/3770539453 learned_addr learned my addr 172.21.15.5:0/3770539453 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e8be00640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e94141eb0 0x7f5e941537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e92a00640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e78003a30 0x7f5e941ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93400640 1 -- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e78003a30 msgr2=0x7f5e941ec100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93400640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e78003a30 0x7f5e941ec100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93400640 1 -- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e94141eb0 msgr2=0x7f5e941537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:13.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93400640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e94141eb0 0x7f5e941537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:13.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93400640 1 -- 172.21.15.5:0/3770539453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9413f640 con 0x7f5e94153cf0 2024-08-18T22:27:13.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93400640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e94153cf0 0x7f5e94140230 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f5e9406daa0 tx=0x7f5e8c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:13.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e8aa00640 1 -- 172.21.15.5:0/3770539453 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c003980 con 0x7f5e94153cf0 2024-08-18T22:27:13.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e8aa00640 1 -- 172.21.15.5:0/3770539453 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8c018070 con 0x7f5e94153cf0 2024-08-18T22:27:13.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e8aa00640 1 -- 172.21.15.5:0/3770539453 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c003d80 con 0x7f5e94153cf0 2024-08-18T22:27:13.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93e00640 1 -- 172.21.15.5:0/3770539453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e94140e10 con 0x7f5e94153cf0 2024-08-18T22:27:13.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.488+0000 7f5e93e00640 1 -- 172.21.15.5:0/3770539453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e941413d0 con 0x7f5e94153cf0 2024-08-18T22:27:13.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.492+0000 7f5e93e00640 1 -- 172.21.15.5:0/3770539453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e9415b2e0 con 0x7f5e94153cf0 2024-08-18T22:27:13.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.492+0000 7f5e8aa00640 1 -- 172.21.15.5:0/3770539453 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e8c0050d0 con 0x7f5e94153cf0 2024-08-18T22:27:13.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.492+0000 7f5e8aa00640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e700678c0 0x7f5e70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:13.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.492+0000 7f5e8aa00640 1 -- 172.21.15.5:0/3770539453 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6216+0+0 (secure 0 0 0) 0x7f5e8c085a80 con 0x7f5e94153cf0 2024-08-18T22:27:13.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.492+0000 7f5e92a00640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e700678c0 0x7f5e70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:13.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.492+0000 7f5e92a00640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e700678c0 0x7f5e70069d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5e840ab000 tx=0x7f5e840a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:13.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.496+0000 7f5e8aa00640 1 -- 172.21.15.5:0/3770539453 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5e8c087e20 con 0x7f5e94153cf0 2024-08-18T22:27:13.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:13.664+0000 7f5e93e00640 1 -- 172.21.15.5:0/3770539453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5e940b1000 con 0x7f5e94153cf0 2024-08-18T22:27:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.464+0000 7f5e8aa00640 1 -- 172.21.15.5:0/3770539453 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) ==== 181+0+0 (secure 0 0 0) 0x7f5e9413f640 con 0x7f5e94153cf0 2024-08-18T22:27:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:27:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.468+0000 7f5e93e00640 1 -- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e700678c0 msgr2=0x7f5e70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.468+0000 7f5e93e00640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e700678c0 0x7f5e70069d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5e840ab000 tx=0x7f5e840a7070 comp rx=0 tx=0).stop 2024-08-18T22:27:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.468+0000 7f5e93e00640 1 -- 172.21.15.5:0/3770539453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e94153cf0 msgr2=0x7f5e94140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.468+0000 7f5e93e00640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e94153cf0 0x7f5e94140230 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f5e9406daa0 tx=0x7f5e8c00eb90 comp rx=0 tx=0).stop 2024-08-18T22:27:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.472+0000 7f5e93e00640 1 -- 172.21.15.5:0/3770539453 shutdown_connections 2024-08-18T22:27:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.472+0000 7f5e93e00640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5e700678c0 0x7f5e70069d80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.472+0000 7f5e93e00640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e94153cf0 0x7f5e94140230 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.472+0000 7f5e93e00640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e94141eb0 0x7f5e941537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:14.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.472+0000 7f5e93e00640 1 --2- 172.21.15.5:0/3770539453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e78003a30 0x7f5e941ec100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.472+0000 7f5e93e00640 1 -- 172.21.15.5:0/3770539453 >> 172.21.15.5:0/3770539453 conn(0x7f5e9406e970 msgr2=0x7f5e94072e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.472+0000 7f5e93e00640 1 -- 172.21.15.5:0/3770539453 shutdown_connections 2024-08-18T22:27:14.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.472+0000 7f5e93e00640 1 -- 172.21.15.5:0/3770539453 wait complete. 2024-08-18T22:27:14.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:27:14.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.648+0000 7f432c800640 1 Processor -- start 2024-08-18T22:27:14.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.648+0000 7f432c800640 1 -- start start 2024-08-18T22:27:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f432c800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432415e510 0x7f43240b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f432c800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43240b5d10 con 0x7f432409b150 2024-08-18T22:27:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f432c800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43240b2c00 con 0x7f432409b970 2024-08-18T22:27:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f432c800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f432415e8f0 con 0x7f432415e510 2024-08-18T22:27:14.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f432a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f432409b150 0x7f43240b64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60134/0 (socket says 172.21.15.5:60134) 2024-08-18T22:27:14.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f432a800640 1 -- 172.21.15.5:0/4112803007 learned_addr learned my addr 172.21.15.5:0/4112803007 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:14.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f4329e00640 1 --2- 172.21.15.5:0/4112803007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432415e510 0x7f43240b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:14.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f4328a00640 1 -- 172.21.15.5:0/4112803007 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2005659900 0 0) 0x7f43240b5d10 con 0x7f432409b150 2024-08-18T22:27:14.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f4328a00640 1 -- 172.21.15.5:0/4112803007 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f430c003530 con 0x7f432409b150 2024-08-18T22:27:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f4328a00640 1 -- 172.21.15.5:0/4112803007 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292522237 0 0) 0x7f43240b2c00 con 0x7f432409b970 2024-08-18T22:27:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f4328a00640 1 -- 172.21.15.5:0/4112803007 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43240b5d10 con 0x7f432409b970 2024-08-18T22:27:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f4329e00640 1 -- 172.21.15.5:0/4112803007 >> v1:172.21.15.117:6789/0 conn(0x7f432409b970 legacy=0x7f432409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f4329e00640 1 -- 172.21.15.5:0/4112803007 >> v1:172.21.15.5:6789/0 conn(0x7f432409b150 legacy=0x7f43240b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f4328a00640 1 -- 172.21.15.5:0/4112803007 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3639980397 0 0) 0x7f430c003530 con 0x7f432409b150 2024-08-18T22:27:14.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.652+0000 7f4329e00640 1 -- 172.21.15.5:0/4112803007 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43240b2ea0 con 0x7f432415e510 2024-08-18T22:27:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f4329e00640 1 --2- 172.21.15.5:0/4112803007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432415e510 0x7f43240b3450 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f43180097f0 tx=0x7f431801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64504682134a96b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f4328a00640 1 -- 172.21.15.5:0/4112803007 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43180b0070 con 0x7f432415e510 2024-08-18T22:27:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f4328a00640 1 -- 172.21.15.5:0/4112803007 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43180ab600 con 0x7f432415e510 2024-08-18T22:27:14.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f4328a00640 1 -- 172.21.15.5:0/4112803007 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43180ab9b0 con 0x7f432415e510 2024-08-18T22:27:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f432c800640 1 -- 172.21.15.5:0/4112803007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432415e510 msgr2=0x7f43240b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f432c800640 1 --2- 172.21.15.5:0/4112803007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432415e510 0x7f43240b3450 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f43180097f0 tx=0x7f431801c450 comp rx=0 tx=0).stop 2024-08-18T22:27:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f432c800640 1 -- 172.21.15.5:0/4112803007 shutdown_connections 2024-08-18T22:27:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f432c800640 1 --2- 172.21.15.5:0/4112803007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432415e510 0x7f43240b3450 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f432c800640 1 -- 172.21.15.5:0/4112803007 >> 172.21.15.5:0/4112803007 conn(0x7f43240b7830 msgr2=0x7f43240b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f432c800640 1 -- 172.21.15.5:0/4112803007 shutdown_connections 2024-08-18T22:27:14.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f432c800640 1 -- 172.21.15.5:0/4112803007 wait complete. 2024-08-18T22:27:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f432c800640 1 Processor -- start 2024-08-18T22:27:14.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.656+0000 7f432c800640 1 -- start start 2024-08-18T22:27:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432c800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432409b150 0x7f432414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432c800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432409b970 0x7f43240cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432c800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f432415e510 0x7f43240cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432c800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f432416bfe0 con 0x7f432415e510 2024-08-18T22:27:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432c800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f43240b75d0 con 0x7f432409b970 2024-08-18T22:27:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432c800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f432416c160 con 0x7f432409b150 2024-08-18T22:27:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f432415e510 0x7f43240cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f432415e510 0x7f43240cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33652/0 (socket says 172.21.15.5:33652) 2024-08-18T22:27:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432a800640 1 -- 172.21.15.5:0/443488047 learned_addr learned my addr 172.21.15.5:0/443488047 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f4329e00640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432409b150 0x7f432414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f4329400640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432409b970 0x7f43240cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432a800640 1 -- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432409b150 msgr2=0x7f432414f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432a800640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432409b150 0x7f432414f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432a800640 1 -- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432409b970 msgr2=0x7f43240cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432a800640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432409b970 0x7f43240cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432a800640 1 -- 172.21.15.5:0/443488047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43240cc710 con 0x7f432415e510 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432a800640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f432415e510 0x7f43240cbfa0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f432000caf0 tx=0x7f4320002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f431e000640 1 -- 172.21.15.5:0/443488047 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4320017070 con 0x7f432415e510 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f431e000640 1 -- 172.21.15.5:0/443488047 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432000abf0 con 0x7f432415e510 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f431e000640 1 -- 172.21.15.5:0/443488047 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4320012640 con 0x7f432415e510 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432c800640 1 -- 172.21.15.5:0/443488047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432414d6c0 con 0x7f432415e510 2024-08-18T22:27:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432c800640 1 -- 172.21.15.5:0/443488047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f432414dc80 con 0x7f432415e510 2024-08-18T22:27:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f432c800640 1 -- 172.21.15.5:0/443488047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43240b3450 con 0x7f432415e510 2024-08-18T22:27:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.660+0000 7f431e000640 1 -- 172.21.15.5:0/443488047 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f432001a070 con 0x7f432415e510 2024-08-18T22:27:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.664+0000 7f431e000640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f43080678c0 0x7f4308069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.664+0000 7f431e000640 1 -- 172.21.15.5:0/443488047 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5778+0+0 (secure 0 0 0) 0x7f4320085a20 con 0x7f432415e510 2024-08-18T22:27:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.664+0000 7f4329e00640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f43080678c0 0x7f4308069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.664+0000 7f4329e00640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f43080678c0 0x7f4308069d80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f43180ad000 tx=0x7f43180a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.668+0000 7f431e000640 1 -- 172.21.15.5:0/443488047 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f432000ae20 con 0x7f432415e510 2024-08-18T22:27:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:14.832+0000 7f432c800640 1 -- 172.21.15.5:0/443488047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f432414de50 con 0x7f432415e510 2024-08-18T22:27:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.468+0000 7f431e000640 1 -- 172.21.15.5:0/443488047 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) ==== 169+0+0 (secure 0 0 0) 0x7f4320055e20 con 0x7f432415e510 2024-08-18T22:27:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:27:15.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 -- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f43080678c0 msgr2=0x7f4308069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:15.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f43080678c0 0x7f4308069d80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f43180ad000 tx=0x7f43180a6000 comp rx=0 tx=0).stop 2024-08-18T22:27:15.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 -- 172.21.15.5:0/443488047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f432415e510 msgr2=0x7f43240cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:15.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f432415e510 0x7f43240cbfa0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f432000caf0 tx=0x7f4320002190 comp rx=0 tx=0).stop 2024-08-18T22:27:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 -- 172.21.15.5:0/443488047 shutdown_connections 2024-08-18T22:27:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f43080678c0 0x7f4308069d80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f432415e510 0x7f43240cbfa0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432409b970 0x7f43240cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 --2- 172.21.15.5:0/443488047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432409b150 0x7f432414f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 -- 172.21.15.5:0/443488047 >> 172.21.15.5:0/443488047 conn(0x7f43240b7830 msgr2=0x7f4324160ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 -- 172.21.15.5:0/443488047 shutdown_connections 2024-08-18T22:27:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.472+0000 7f432c800640 1 -- 172.21.15.5:0/443488047 wait complete. 2024-08-18T22:27:15.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:27:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.644+0000 7f2b9d000640 1 Processor -- start 2024-08-18T22:27:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.644+0000 7f2b9d000640 1 -- start start 2024-08-18T22:27:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.644+0000 7f2b9d000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2b98071ad0 0x7f2b980b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.644+0000 7f2b9d000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b980d1c90 con 0x7f2b980716f0 2024-08-18T22:27:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.644+0000 7f2b9d000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b980d1f70 con 0x7f2b980b7600 2024-08-18T22:27:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.644+0000 7f2b9d000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2b980d2250 con 0x7f2b98071ad0 2024-08-18T22:27:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.644+0000 7f2b97400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2b980716f0 0x7f2b980cfeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60144/0 (socket says 172.21.15.5:60144) 2024-08-18T22:27:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.644+0000 7f2b97400640 1 -- 172.21.15.5:0/3214155210 learned_addr learned my addr 172.21.15.5:0/3214155210 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.648+0000 7f2b8ea00640 1 --2- 172.21.15.5:0/3214155210 >> v2:172.21.15.117:3300/0 conn(0x7f2b98071ad0 0x7f2b980b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.648+0000 7f2b96a00640 1 -- 172.21.15.5:0/3214155210 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606927463 0 0) 0x7f2b980d1c90 con 0x7f2b980716f0 2024-08-18T22:27:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.648+0000 7f2b96a00640 1 -- 172.21.15.5:0/3214155210 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b7c003530 con 0x7f2b980716f0 2024-08-18T22:27:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.648+0000 7f2b96a00640 1 -- 172.21.15.5:0/3214155210 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168297369 0 0) 0x7f2b980d1f70 con 0x7f2b980b7600 2024-08-18T22:27:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.648+0000 7f2b96a00640 1 -- 172.21.15.5:0/3214155210 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b980d1c90 con 0x7f2b980b7600 2024-08-18T22:27:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.648+0000 7f2b8ea00640 1 -- 172.21.15.5:0/3214155210 >> v1:172.21.15.117:6789/0 conn(0x7f2b980b7600 legacy=0x7f2b981432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.648+0000 7f2b8ea00640 1 -- 172.21.15.5:0/3214155210 >> v1:172.21.15.5:6789/0 conn(0x7f2b980716f0 legacy=0x7f2b980cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.648+0000 7f2b8ea00640 1 -- 172.21.15.5:0/3214155210 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b980d2530 con 0x7f2b98071ad0 2024-08-18T22:27:15.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.648+0000 7f2b8ea00640 1 --2- 172.21.15.5:0/3214155210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b98071ad0 0x7f2b980b70c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2b800097c0 tx=0x7f2b8001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7f2c03a648d50e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:15.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.648+0000 7f2b96a00640 1 -- 172.21.15.5:0/3214155210 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b800b0070 con 0x7f2b98071ad0 2024-08-18T22:27:15.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b96a00640 1 -- 172.21.15.5:0/3214155210 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b800ab600 con 0x7f2b98071ad0 2024-08-18T22:27:15.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b96a00640 1 -- 172.21.15.5:0/3214155210 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b800ab9b0 con 0x7f2b98071ad0 2024-08-18T22:27:15.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 -- 172.21.15.5:0/3214155210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b98071ad0 msgr2=0x7f2b980b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:15.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 --2- 172.21.15.5:0/3214155210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b98071ad0 0x7f2b980b70c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2b800097c0 tx=0x7f2b8001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 -- 172.21.15.5:0/3214155210 shutdown_connections 2024-08-18T22:27:15.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 --2- 172.21.15.5:0/3214155210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b98071ad0 0x7f2b980b70c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 -- 172.21.15.5:0/3214155210 >> 172.21.15.5:0/3214155210 conn(0x7f2b980b3da0 msgr2=0x7f2b980b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 -- 172.21.15.5:0/3214155210 shutdown_connections 2024-08-18T22:27:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 -- 172.21.15.5:0/3214155210 wait complete. 2024-08-18T22:27:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 Processor -- start 2024-08-18T22:27:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 -- start start 2024-08-18T22:27:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b980716f0 0x7f2b98154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b98071ad0 0x7f2b98141430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980b7600 0x7f2b980b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b980d2eb0 con 0x7f2b980716f0 2024-08-18T22:27:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2b980d2d30 con 0x7f2b98071ad0 2024-08-18T22:27:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b9d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2b980720e0 con 0x7f2b980b7600 2024-08-18T22:27:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b97400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b980716f0 0x7f2b98154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b97400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b980716f0 0x7f2b98154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33662/0 (socket says 172.21.15.5:33662) 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b97400640 1 -- 172.21.15.5:0/1653731454 learned_addr learned my addr 172.21.15.5:0/1653731454 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b97400640 1 -- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980b7600 msgr2=0x7f2b980b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b97400640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980b7600 0x7f2b980b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b97400640 1 -- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b98071ad0 msgr2=0x7f2b98141430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b97400640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b98071ad0 0x7f2b98141430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.652+0000 7f2b97400640 1 -- 172.21.15.5:0/1653731454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9815e880 con 0x7f2b980716f0 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.656+0000 7f2b97400640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b980716f0 0x7f2b98154710 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c4f0 tx=0x7f2b8800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.656+0000 7f2b8fe00640 1 -- 172.21.15.5:0/1653731454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88017070 con 0x7f2b980716f0 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.656+0000 7f2b8fe00640 1 -- 172.21.15.5:0/1653731454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b88005cf0 con 0x7f2b980716f0 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.656+0000 7f2b9d000640 1 -- 172.21.15.5:0/1653731454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9815eb60 con 0x7f2b980716f0 2024-08-18T22:27:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.656+0000 7f2b8fe00640 1 -- 172.21.15.5:0/1653731454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88007270 con 0x7f2b980716f0 2024-08-18T22:27:15.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.656+0000 7f2b9d000640 1 -- 172.21.15.5:0/1653731454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b9815f120 con 0x7f2b980716f0 2024-08-18T22:27:15.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.656+0000 7f2b9d000640 1 -- 172.21.15.5:0/1653731454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b9806e6a0 con 0x7f2b980716f0 2024-08-18T22:27:15.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.656+0000 7f2b8fe00640 1 -- 172.21.15.5:0/1653731454 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b8801a070 con 0x7f2b980716f0 2024-08-18T22:27:15.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.656+0000 7f2b8fe00640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b740678c0 0x7f2b74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:15.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.656+0000 7f2b8fe00640 1 -- 172.21.15.5:0/1653731454 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f2b88084f40 con 0x7f2b980716f0 2024-08-18T22:27:15.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.656+0000 7f2b8ea00640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b740678c0 0x7f2b74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:15.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.660+0000 7f2b8ea00640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b740678c0 0x7f2b74069d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2b800ad000 tx=0x7f2b80004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:15.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.660+0000 7f2b8fe00640 1 -- 172.21.15.5:0/1653731454 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2b88055500 con 0x7f2b980716f0 2024-08-18T22:27:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.844+0000 7f2b9d000640 1 -- 172.21.15.5:0/1653731454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f2b98069df0 con 0x7f2b980716f0 2024-08-18T22:27:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.848+0000 7f2b8fe00640 1 -- 172.21.15.5:0/1653731454 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7f2b88059800 con 0x7f2b980716f0 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 -- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b740678c0 msgr2=0x7f2b74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b740678c0 0x7f2b74069d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2b800ad000 tx=0x7f2b80004740 comp rx=0 tx=0).stop 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 -- 172.21.15.5:0/1653731454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b980716f0 msgr2=0x7f2b98154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b980716f0 0x7f2b98154710 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c4f0 tx=0x7f2b8800c9b0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 -- 172.21.15.5:0/1653731454 shutdown_connections 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b740678c0 0x7f2b74069d80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980b7600 0x7f2b980b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b98071ad0 0x7f2b98141430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 --2- 172.21.15.5:0/1653731454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b980716f0 0x7f2b98154710 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 -- 172.21.15.5:0/1653731454 >> 172.21.15.5:0/1653731454 conn(0x7f2b980b3da0 msgr2=0x7f2b9815dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 -- 172.21.15.5:0/1653731454 shutdown_connections 2024-08-18T22:27:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:15.852+0000 7f2b9d000640 1 -- 172.21.15.5:0/1653731454 wait complete. 2024-08-18T22:27:15.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-08-18T22:27:16.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8598800640 1 Processor -- start 2024-08-18T22:27:16.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8598800640 1 -- start start 2024-08-18T22:27:16.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8598800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859015bed0 0x7f85900735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:16.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8598800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8590073c80 con 0x7f859006da70 2024-08-18T22:27:16.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8598800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85900ca5d0 con 0x7f85900cb390 2024-08-18T22:27:16.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8598800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f85900ca8b0 con 0x7f859015bed0 2024-08-18T22:27:16.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8596800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f859006da70 0x7f8590165b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60158/0 (socket says 172.21.15.5:60158) 2024-08-18T22:27:16.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8596800640 1 -- 172.21.15.5:0/1093731108 learned_addr learned my addr 172.21.15.5:0/1093731108 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:16.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8595e00640 1 --2- 172.21.15.5:0/1093731108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859015bed0 0x7f85900735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:16.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8594a00640 1 -- 172.21.15.5:0/1093731108 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231818695 0 0) 0x7f8590073c80 con 0x7f859006da70 2024-08-18T22:27:16.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8594a00640 1 -- 172.21.15.5:0/1093731108 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8578003530 con 0x7f859006da70 2024-08-18T22:27:16.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8594a00640 1 -- 172.21.15.5:0/1093731108 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2616500794 0 0) 0x7f85900ca5d0 con 0x7f85900cb390 2024-08-18T22:27:16.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8594a00640 1 -- 172.21.15.5:0/1093731108 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8590073c80 con 0x7f85900cb390 2024-08-18T22:27:16.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8595e00640 1 -- 172.21.15.5:0/1093731108 >> v1:172.21.15.117:6789/0 conn(0x7f85900cb390 legacy=0x7f8590071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8595e00640 1 -- 172.21.15.5:0/1093731108 >> v1:172.21.15.5:6789/0 conn(0x7f859006da70 legacy=0x7f8590165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.012+0000 7f8595e00640 1 -- 172.21.15.5:0/1093731108 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85900cab90 con 0x7f859015bed0 2024-08-18T22:27:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.016+0000 7f8595e00640 1 --2- 172.21.15.5:0/1093731108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859015bed0 0x7f85900735a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f85840097f0 tx=0x7f858401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9434ec5fec6e275 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.016+0000 7f8594a00640 1 -- 172.21.15.5:0/1093731108 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85840aa430 con 0x7f859015bed0 2024-08-18T22:27:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.016+0000 7f8594a00640 1 -- 172.21.15.5:0/1093731108 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85840af070 con 0x7f859015bed0 2024-08-18T22:27:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.016+0000 7f8594a00640 1 -- 172.21.15.5:0/1093731108 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85840aa7f0 con 0x7f859015bed0 2024-08-18T22:27:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.016+0000 7f8598800640 1 -- 172.21.15.5:0/1093731108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859015bed0 msgr2=0x7f85900735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.016+0000 7f8598800640 1 --2- 172.21.15.5:0/1093731108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859015bed0 0x7f85900735a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f85840097f0 tx=0x7f858401c4b0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.016+0000 7f8598800640 1 -- 172.21.15.5:0/1093731108 shutdown_connections 2024-08-18T22:27:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.016+0000 7f8598800640 1 --2- 172.21.15.5:0/1093731108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859015bed0 0x7f85900735a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.016+0000 7f8598800640 1 -- 172.21.15.5:0/1093731108 >> 172.21.15.5:0/1093731108 conn(0x7f85900b1c50 msgr2=0x7f85900b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:16.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.016+0000 7f8598800640 1 -- 172.21.15.5:0/1093731108 shutdown_connections 2024-08-18T22:27:16.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.016+0000 7f8598800640 1 -- 172.21.15.5:0/1093731108 wait complete. 2024-08-18T22:27:16.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8598800640 1 Processor -- start 2024-08-18T22:27:16.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8598800640 1 -- start start 2024-08-18T22:27:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8598800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859006da70 0x7f85900b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8598800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85900cb390 0x7f859014cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8598800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f859015bed0 0x7f85900c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8598800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8590169c40 con 0x7f85900cb390 2024-08-18T22:27:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8598800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8590169ac0 con 0x7f859015bed0 2024-08-18T22:27:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8598800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8590169dc0 con 0x7f859006da70 2024-08-18T22:27:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8595400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85900cb390 0x7f859014cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8595400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85900cb390 0x7f859014cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33674/0 (socket says 172.21.15.5:33674) 2024-08-18T22:27:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8595400640 1 -- 172.21.15.5:0/1024444359 learned_addr learned my addr 172.21.15.5:0/1024444359 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8595e00640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859006da70 0x7f85900b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8596800640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f859015bed0 0x7f85900c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8595400640 1 -- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859006da70 msgr2=0x7f85900b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8595400640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859006da70 0x7f85900b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8595400640 1 -- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f859015bed0 msgr2=0x7f85900c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8595400640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f859015bed0 0x7f85900c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8595400640 1 -- 172.21.15.5:0/1024444359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8590152650 con 0x7f85900cb390 2024-08-18T22:27:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8595e00640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859006da70 0x7f85900b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8596800640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f859015bed0 0x7f85900c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8595400640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85900cb390 0x7f859014cd70 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f858000c410 tx=0x7f858000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f858a000640 1 -- 172.21.15.5:0/1024444359 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580017070 con 0x7f85900cb390 2024-08-18T22:27:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f858a000640 1 -- 172.21.15.5:0/1024444359 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85800052f0 con 0x7f85900cb390 2024-08-18T22:27:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8598800640 1 -- 172.21.15.5:0/1024444359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8590152370 con 0x7f85900cb390 2024-08-18T22:27:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f858a000640 1 -- 172.21.15.5:0/1024444359 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580003840 con 0x7f85900cb390 2024-08-18T22:27:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.020+0000 7f8598800640 1 -- 172.21.15.5:0/1024444359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85900aebe0 con 0x7f85900cb390 2024-08-18T22:27:16.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.024+0000 7f8598800640 1 -- 172.21.15.5:0/1024444359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85900735a0 con 0x7f85900cb390 2024-08-18T22:27:16.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.024+0000 7f858a000640 1 -- 172.21.15.5:0/1024444359 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f858001a070 con 0x7f85900cb390 2024-08-18T22:27:16.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.024+0000 7f858a000640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85740678f0 0x7f8574069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:16.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.024+0000 7f858a000640 1 -- 172.21.15.5:0/1024444359 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f8580084eb0 con 0x7f85900cb390 2024-08-18T22:27:16.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.024+0000 7f8595e00640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85740678f0 0x7f8574069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:16.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.024+0000 7f8595e00640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85740678f0 0x7f8574069db0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f85840ae000 tx=0x7f85840b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:16.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.028+0000 7f858a000640 1 -- 172.21.15.5:0/1024444359 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8580055b50 con 0x7f85900cb390 2024-08-18T22:27:16.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.256+0000 7f8598800640 1 -- 172.21.15.5:0/1024444359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f8590150aa0 con 0x7f85900cb390 2024-08-18T22:27:16.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f858a000640 1 -- 172.21.15.5:0/1024444359 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v386) ==== 158+0+0 (secure 0 0 0) 0x7f8580055450 con 0x7f85900cb390 2024-08-18T22:27:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 -- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85740678f0 msgr2=0x7f8574069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85740678f0 0x7f8574069db0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f85840ae000 tx=0x7f85840b5040 comp rx=0 tx=0).stop 2024-08-18T22:27:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 -- 172.21.15.5:0/1024444359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85900cb390 msgr2=0x7f859014cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85900cb390 0x7f859014cd70 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f858000c410 tx=0x7f858000c8d0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 -- 172.21.15.5:0/1024444359 shutdown_connections 2024-08-18T22:27:16.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85740678f0 0x7f8574069db0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f859015bed0 0x7f85900c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85900cb390 0x7f859014cd70 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 --2- 172.21.15.5:0/1024444359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f859006da70 0x7f85900b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 -- 172.21.15.5:0/1024444359 >> 172.21.15.5:0/1024444359 conn(0x7f85900b1c50 msgr2=0x7f85900b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 -- 172.21.15.5:0/1024444359 shutdown_connections 2024-08-18T22:27:16.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.484+0000 7f8598800640 1 -- 172.21.15.5:0/1024444359 wait complete. 2024-08-18T22:27:16.507 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-08-18T22:27:16.507 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-08-18T22:27:16.508 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:27:16.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f1aa00640 1 Processor -- start 2024-08-18T22:27:16.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f1aa00640 1 -- start start 2024-08-18T22:27:16.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f1aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f1415c2b0 0x7f6f1409aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:16.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f1aa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6f140b1930 0x7f6f140cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:16.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f1aa00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1406c4f0 con 0x7f6f1415c690 2024-08-18T22:27:16.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f1aa00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6f140cd890 con 0x7f6f1415c2b0 2024-08-18T22:27:16.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f1aa00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6f140b3b30 con 0x7f6f140b1930 2024-08-18T22:27:16.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f13e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f1415c2b0 0x7f6f1409aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:16.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f13e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6f1415c2b0 0x7f6f1409aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33684/0 (socket says 172.21.15.5:33684) 2024-08-18T22:27:16.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f13e00640 1 -- 172.21.15.5:0/2553224801 learned_addr learned my addr 172.21.15.5:0/2553224801 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:16.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f18a00640 1 --2- 172.21.15.5:0/2553224801 >> v2:172.21.15.117:3300/0 conn(0x7f6f140b1930 0x7f6f140cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:16.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f13e00640 1 -- 172.21.15.5:0/2553224801 >> v2:172.21.15.117:3300/0 conn(0x7f6f140b1930 msgr2=0x7f6f140cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:16.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f13e00640 1 --2- 172.21.15.5:0/2553224801 >> v2:172.21.15.117:3300/0 conn(0x7f6f140b1930 0x7f6f140cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f13e00640 1 -- 172.21.15.5:0/2553224801 >> v1:172.21.15.117:6789/0 conn(0x7f6f1415c690 legacy=0x7f6f140b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.648+0000 7f6f13e00640 1 -- 172.21.15.5:0/2553224801 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1406c7d0 con 0x7f6f1415c2b0 2024-08-18T22:27:16.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f13e00640 1 --2- 172.21.15.5:0/2553224801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f1415c2b0 0x7f6f1409aab0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f6f14073850 tx=0x7f6f0401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb86d6ccb4e7cbce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:16.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f13400640 1 -- 172.21.15.5:0/2553224801 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f040a57f0 con 0x7f6f1415c2b0 2024-08-18T22:27:16.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f13400640 1 -- 172.21.15.5:0/2553224801 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f040a5990 con 0x7f6f1415c2b0 2024-08-18T22:27:16.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f13400640 1 -- 172.21.15.5:0/2553224801 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f040a5d60 con 0x7f6f1415c2b0 2024-08-18T22:27:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f1aa00640 1 -- 172.21.15.5:0/2553224801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f1415c2b0 msgr2=0x7f6f1409aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f1aa00640 1 --2- 172.21.15.5:0/2553224801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f1415c2b0 0x7f6f1409aab0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f6f14073850 tx=0x7f6f0401c930 comp rx=0 tx=0).stop 2024-08-18T22:27:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f1aa00640 1 -- 172.21.15.5:0/2553224801 shutdown_connections 2024-08-18T22:27:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f1aa00640 1 --2- 172.21.15.5:0/2553224801 >> v2:172.21.15.117:3300/0 conn(0x7f6f140b1930 0x7f6f140cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f1aa00640 1 --2- 172.21.15.5:0/2553224801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f1415c2b0 0x7f6f1409aab0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f1aa00640 1 -- 172.21.15.5:0/2553224801 >> 172.21.15.5:0/2553224801 conn(0x7f6f140b6810 msgr2=0x7f6f140b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f1aa00640 1 -- 172.21.15.5:0/2553224801 shutdown_connections 2024-08-18T22:27:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.652+0000 7f6f1aa00640 1 -- 172.21.15.5:0/2553224801 wait complete. 2024-08-18T22:27:16.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f1aa00640 1 Processor -- start 2024-08-18T22:27:16.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f1aa00640 1 -- start start 2024-08-18T22:27:16.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f1aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f140b1930 0x7f6f1415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:16.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f1aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f1415c2b0 0x7f6f14159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:16.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f1aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f1415c690 0x7f6f1415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:16.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f1aa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140d00b0 con 0x7f6f1415c2b0 2024-08-18T22:27:16.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f1aa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140cff30 con 0x7f6f140b1930 2024-08-18T22:27:16.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f1aa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6f140d0230 con 0x7f6f1415c690 2024-08-18T22:27:16.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f0b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f1415c2b0 0x7f6f14159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:16.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f13e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f140b1930 0x7f6f1415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:16.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f0b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f1415c2b0 0x7f6f14159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33692/0 (socket says 172.21.15.5:33692) 2024-08-18T22:27:16.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f0b400640 1 -- 172.21.15.5:0/132875040 learned_addr learned my addr 172.21.15.5:0/132875040 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:16.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f13e00640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f140b1930 0x7f6f1415eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:41688/0 (socket says 172.21.15.5:41688) 2024-08-18T22:27:16.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f18a00640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f1415c690 0x7f6f1415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:16.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f0b400640 1 -- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f1415c690 msgr2=0x7f6f1415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f0b400640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f1415c690 0x7f6f1415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f0b400640 1 -- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f140b1930 msgr2=0x7f6f1415eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f0b400640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f140b1930 0x7f6f1415eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f0b400640 1 -- 172.21.15.5:0/132875040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1415ac80 con 0x7f6f1415c2b0 2024-08-18T22:27:16.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f0b400640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f1415c2b0 0x7f6f14159fb0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00c370 tx=0x7f6efc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:16.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f10c00640 1 -- 172.21.15.5:0/132875040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0052d0 con 0x7f6f1415c2b0 2024-08-18T22:27:16.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f10c00640 1 -- 172.21.15.5:0/132875040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc005470 con 0x7f6f1415c2b0 2024-08-18T22:27:16.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f10c00640 1 -- 172.21.15.5:0/132875040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc007260 con 0x7f6f1415c2b0 2024-08-18T22:27:16.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f1aa00640 1 -- 172.21.15.5:0/132875040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1415af60 con 0x7f6f1415c2b0 2024-08-18T22:27:16.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f1aa00640 1 -- 172.21.15.5:0/132875040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1415b520 con 0x7f6f1415c2b0 2024-08-18T22:27:16.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.656+0000 7f6f1aa00640 1 -- 172.21.15.5:0/132875040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f140cd350 con 0x7f6f1415c2b0 2024-08-18T22:27:16.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.660+0000 7f6f10c00640 1 -- 172.21.15.5:0/132875040 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6efc007400 con 0x7f6f1415c2b0 2024-08-18T22:27:16.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.660+0000 7f6f10c00640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ef00678c0 0x7f6ef0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:16.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.660+0000 7f6f10c00640 1 -- 172.21.15.5:0/132875040 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f6efc084ef0 con 0x7f6f1415c2b0 2024-08-18T22:27:16.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.660+0000 7f6f13e00640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ef00678c0 0x7f6ef0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:16.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.660+0000 7f6f13e00640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ef00678c0 0x7f6ef0069d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6f040ae000 tx=0x7f6f040a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:16.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.664+0000 7f6f10c00640 1 -- 172.21.15.5:0/132875040 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6efc055550 con 0x7f6f1415c2b0 2024-08-18T22:27:16.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.828+0000 7f6f1aa00640 1 -- 172.21.15.5:0/132875040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f1415cb00 con 0x7f6f1415c2b0 2024-08-18T22:27:16.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.828+0000 7f6f10c00640 1 -- 172.21.15.5:0/132875040 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+13233 (secure 0 0 0) 0x7f6efc059850 con 0x7f6f1415c2b0 2024-08-18T22:27:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:16.831 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":121,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:27:15.470365+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6837/1147270411":"2024-08-19T22:27:12.278481+0000","172.21.15.117:6835/1147270411":"2024-08-19T22:27:12.278481+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:27:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 -- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ef00678c0 msgr2=0x7f6ef0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ef00678c0 0x7f6ef0069d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6f040ae000 tx=0x7f6f040a7070 comp rx=0 tx=0).stop 2024-08-18T22:27:16.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 -- 172.21.15.5:0/132875040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f1415c2b0 msgr2=0x7f6f14159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f1415c2b0 0x7f6f14159fb0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00c370 tx=0x7f6efc00c830 comp rx=0 tx=0).stop 2024-08-18T22:27:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 -- 172.21.15.5:0/132875040 shutdown_connections 2024-08-18T22:27:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6ef00678c0 0x7f6ef0069d80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f1415c690 0x7f6f1415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f1415c2b0 0x7f6f14159fb0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 --2- 172.21.15.5:0/132875040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f140b1930 0x7f6f1415eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:16.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 -- 172.21.15.5:0/132875040 >> 172.21.15.5:0/132875040 conn(0x7f6f140b6810 msgr2=0x7f6f140700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:16.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 -- 172.21.15.5:0/132875040 shutdown_connections 2024-08-18T22:27:16.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.832+0000 7f6f1aa00640 1 -- 172.21.15.5:0/132875040 wait complete. 2024-08-18T22:27:16.852 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:27:16.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:27:16.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.996+0000 7f5958000640 1 Processor -- start 2024-08-18T22:27:16.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:16.996+0000 7f5958000640 1 -- start start 2024-08-18T22:27:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5958000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f59500d1090 0x7f59500d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5958000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59500b5ad0 0x7f5950071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5958000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59500d30b0 con 0x7f595015fb80 2024-08-18T22:27:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5958000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f59500d1eb0 con 0x7f59500d1090 2024-08-18T22:27:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5958000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f59500d1bd0 con 0x7f59500b5ad0 2024-08-18T22:27:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5955600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f595015fb80 0x7f595006fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60174/0 (socket says 172.21.15.5:60174) 2024-08-18T22:27:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5955600640 1 -- 172.21.15.5:0/1388434380 learned_addr learned my addr 172.21.15.5:0/1388434380 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5954c00640 1 --2- 172.21.15.5:0/1388434380 >> v2:172.21.15.5:3300/0 conn(0x7f59500d1090 0x7f59500d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5956000640 1 --2- 172.21.15.5:0/1388434380 >> v2:172.21.15.117:3300/0 conn(0x7f59500b5ad0 0x7f5950071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f594fe00640 1 -- 172.21.15.5:0/1388434380 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373507920 0 0) 0x7f59500d30b0 con 0x7f595015fb80 2024-08-18T22:27:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f594fe00640 1 -- 172.21.15.5:0/1388434380 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5938003530 con 0x7f595015fb80 2024-08-18T22:27:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5954c00640 1 -- 172.21.15.5:0/1388434380 >> v2:172.21.15.117:3300/0 conn(0x7f59500b5ad0 msgr2=0x7f5950071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5954c00640 1 --2- 172.21.15.5:0/1388434380 >> v2:172.21.15.117:3300/0 conn(0x7f59500b5ad0 0x7f5950071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5954c00640 1 -- 172.21.15.5:0/1388434380 >> v1:172.21.15.5:6789/0 conn(0x7f595015fb80 legacy=0x7f595006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:17.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5954c00640 1 -- 172.21.15.5:0/1388434380 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59500d2dd0 con 0x7f59500d1090 2024-08-18T22:27:17.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.000+0000 7f5954c00640 1 --2- 172.21.15.5:0/1388434380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59500d1090 0x7f59500d15e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f5950073ce0 tx=0x7f593c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282d099228eb26b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:17.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f594fe00640 1 -- 172.21.15.5:0/1388434380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c0b0070 con 0x7f59500d1090 2024-08-18T22:27:17.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f594fe00640 1 -- 172.21.15.5:0/1388434380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593c0ab600 con 0x7f59500d1090 2024-08-18T22:27:17.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f594fe00640 1 -- 172.21.15.5:0/1388434380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c0ab9b0 con 0x7f59500d1090 2024-08-18T22:27:17.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 -- 172.21.15.5:0/1388434380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59500d1090 msgr2=0x7f59500d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:17.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 --2- 172.21.15.5:0/1388434380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59500d1090 0x7f59500d15e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f5950073ce0 tx=0x7f593c01c360 comp rx=0 tx=0).stop 2024-08-18T22:27:17.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 -- 172.21.15.5:0/1388434380 shutdown_connections 2024-08-18T22:27:17.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 --2- 172.21.15.5:0/1388434380 >> v2:172.21.15.117:3300/0 conn(0x7f59500b5ad0 0x7f5950071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 --2- 172.21.15.5:0/1388434380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59500d1090 0x7f59500d15e0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 -- 172.21.15.5:0/1388434380 >> 172.21.15.5:0/1388434380 conn(0x7f59500d2180 msgr2=0x7f59500d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:17.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 -- 172.21.15.5:0/1388434380 shutdown_connections 2024-08-18T22:27:17.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 -- 172.21.15.5:0/1388434380 wait complete. 2024-08-18T22:27:17.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 Processor -- start 2024-08-18T22:27:17.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 -- start start 2024-08-18T22:27:17.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59500b5ad0 0x7f5950157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:17.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59500d1090 0x7f59501580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:17.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f595015fb80 0x7f59500b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:17.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5950169270 con 0x7f59500d1090 2024-08-18T22:27:17.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f59501690f0 con 0x7f59500b5ad0 2024-08-18T22:27:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5958000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f59501693f0 con 0x7f595015fb80 2024-08-18T22:27:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5954c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59500d1090 0x7f59501580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5954c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59500d1090 0x7f59501580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33698/0 (socket says 172.21.15.5:33698) 2024-08-18T22:27:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.004+0000 7f5954c00640 1 -- 172.21.15.5:0/3725675088 learned_addr learned my addr 172.21.15.5:0/3725675088 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5956000640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f595015fb80 0x7f59500b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5955600640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59500b5ad0 0x7f5950157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:17.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5954c00640 1 -- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f595015fb80 msgr2=0x7f59500b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:17.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5954c00640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f595015fb80 0x7f59500b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5954c00640 1 -- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59500b5ad0 msgr2=0x7f5950157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:17.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5954c00640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59500b5ad0 0x7f5950157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5954c00640 1 -- 172.21.15.5:0/3725675088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5950152700 con 0x7f59500d1090 2024-08-18T22:27:17.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5956000640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f595015fb80 0x7f59500b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:17.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5955600640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59500b5ad0 0x7f5950157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:17.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5954c00640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59500d1090 0x7f59501580e0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f593c0ae040 tx=0x7f593c019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:17.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f594d600640 1 -- 172.21.15.5:0/3725675088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c0b0040 con 0x7f59500d1090 2024-08-18T22:27:17.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f594d600640 1 -- 172.21.15.5:0/3725675088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593c0b9070 con 0x7f59500d1090 2024-08-18T22:27:17.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f594d600640 1 -- 172.21.15.5:0/3725675088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c0b4630 con 0x7f59500d1090 2024-08-18T22:27:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5958000640 1 -- 172.21.15.5:0/3725675088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59501529e0 con 0x7f59500d1090 2024-08-18T22:27:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5958000640 1 -- 172.21.15.5:0/3725675088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5950152fa0 con 0x7f59500d1090 2024-08-18T22:27:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5958000640 1 -- 172.21.15.5:0/3725675088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5950071550 con 0x7f59500d1090 2024-08-18T22:27:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f594d600640 1 -- 172.21.15.5:0/3725675088 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f593c0b47d0 con 0x7f59500d1090 2024-08-18T22:27:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f594d600640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59300678c0 0x7f5930069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:17.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f594d600640 1 -- 172.21.15.5:0/3725675088 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f593c11f7f0 con 0x7f59500d1090 2024-08-18T22:27:17.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.008+0000 7f5955600640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59300678c0 0x7f5930069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:17.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.012+0000 7f5955600640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59300678c0 0x7f5930069d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5944005890 tx=0x7f5944009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:17.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.012+0000 7f594d600640 1 -- 172.21.15.5:0/3725675088 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f593c016070 con 0x7f59500d1090 2024-08-18T22:27:17.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.176+0000 7f5958000640 1 -- 172.21.15.5:0/3725675088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f59500ce0d0 con 0x7f59500d1090 2024-08-18T22:27:17.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f594d600640 1 -- 172.21.15.5:0/3725675088 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) ==== 93+0+10 (secure 0 0 0) 0x7f593c0f0530 con 0x7f59500d1090 2024-08-18T22:27:17.180 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:27:17.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 -- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59300678c0 msgr2=0x7f5930069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59300678c0 0x7f5930069d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5944005890 tx=0x7f5944009040 comp rx=0 tx=0).stop 2024-08-18T22:27:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 -- 172.21.15.5:0/3725675088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59500d1090 msgr2=0x7f59501580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59500d1090 0x7f59501580e0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f593c0ae040 tx=0x7f593c019100 comp rx=0 tx=0).stop 2024-08-18T22:27:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 -- 172.21.15.5:0/3725675088 shutdown_connections 2024-08-18T22:27:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f59300678c0 0x7f5930069d80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f595015fb80 0x7f59500b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59500d1090 0x7f59501580e0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 --2- 172.21.15.5:0/3725675088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59500b5ad0 0x7f5950157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 -- 172.21.15.5:0/3725675088 >> 172.21.15.5:0/3725675088 conn(0x7f59500d2180 msgr2=0x7f59500d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:17.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 -- 172.21.15.5:0/3725675088 shutdown_connections 2024-08-18T22:27:17.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.180+0000 7f5958000640 1 -- 172.21.15.5:0/3725675088 wait complete. 2024-08-18T22:27:17.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-08-18T22:27:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.340+0000 7f1d37800640 1 Processor -- start 2024-08-18T22:27:17.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.340+0000 7f1d37800640 1 -- start start 2024-08-18T22:27:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.344+0000 7f1d37800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d3015e4b0 0x7f1d30070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.344+0000 7f1d37800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d30070430 con 0x7f1d30070730 2024-08-18T22:27:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.344+0000 7f1d37800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3015eb60 con 0x7f1d30161960 2024-08-18T22:27:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.344+0000 7f1d37800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1d3015e940 con 0x7f1d3015e4b0 2024-08-18T22:27:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.344+0000 7f1d35800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d3015e4b0 0x7f1d30070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:17.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.344+0000 7f1d2fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1d30070730 0x7f1d3015dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60180/0 (socket says 172.21.15.5:60180) 2024-08-18T22:27:17.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.344+0000 7f1d2fe00640 1 -- 172.21.15.5:0/2647143137 learned_addr learned my addr 172.21.15.5:0/2647143137 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:17.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.344+0000 7f1d35800640 1 -- 172.21.15.5:0/2647143137 >> v1:172.21.15.117:6789/0 conn(0x7f1d30161960 legacy=0x7f1d3006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:17.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.344+0000 7f1d35800640 1 -- 172.21.15.5:0/2647143137 >> v1:172.21.15.5:6789/0 conn(0x7f1d30070730 legacy=0x7f1d3015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:17.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.344+0000 7f1d35800640 1 -- 172.21.15.5:0/2647143137 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3015ee40 con 0x7f1d3015e4b0 2024-08-18T22:27:17.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.344+0000 7f1d2f400640 1 -- 172.21.15.5:0/2647143137 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078934607 0 0) 0x7f1d30070430 con 0x7f1d30070730 2024-08-18T22:27:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d35800640 1 --2- 172.21.15.5:0/2647143137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d3015e4b0 0x7f1d30070ba0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009d90 tx=0x7f1d2801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223a5f62c3afa061 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d2f400640 1 -- 172.21.15.5:0/2647143137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d280b2070 con 0x7f1d3015e4b0 2024-08-18T22:27:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d2f400640 1 -- 172.21.15.5:0/2647143137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d280a5830 con 0x7f1d3015e4b0 2024-08-18T22:27:17.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d2f400640 1 -- 172.21.15.5:0/2647143137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d280a5c00 con 0x7f1d3015e4b0 2024-08-18T22:27:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d37800640 1 -- 172.21.15.5:0/2647143137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d3015e4b0 msgr2=0x7f1d30070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d37800640 1 --2- 172.21.15.5:0/2647143137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d3015e4b0 0x7f1d30070ba0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009d90 tx=0x7f1d2801c970 comp rx=0 tx=0).stop 2024-08-18T22:27:17.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d37800640 1 -- 172.21.15.5:0/2647143137 shutdown_connections 2024-08-18T22:27:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d37800640 1 --2- 172.21.15.5:0/2647143137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d3015e4b0 0x7f1d30070ba0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d37800640 1 -- 172.21.15.5:0/2647143137 >> 172.21.15.5:0/2647143137 conn(0x7f1d300d2130 msgr2=0x7f1d300d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d37800640 1 -- 172.21.15.5:0/2647143137 shutdown_connections 2024-08-18T22:27:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d37800640 1 -- 172.21.15.5:0/2647143137 wait complete. 2024-08-18T22:27:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d37800640 1 Processor -- start 2024-08-18T22:27:17.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.348+0000 7f1d37800640 1 -- start start 2024-08-18T22:27:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d37800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d30070730 0x7f1d3015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d37800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d3015e4b0 0x7f1d3015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d37800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d30161960 0x7f1d300c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d37800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3009ba30 con 0x7f1d30070730 2024-08-18T22:27:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d37800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1d300710e0 con 0x7f1d30161960 2024-08-18T22:27:17.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d37800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1d300b6660 con 0x7f1d3015e4b0 2024-08-18T22:27:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d34e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d30070730 0x7f1d3015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d34e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d30070730 0x7f1d3015ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33722/0 (socket says 172.21.15.5:33722) 2024-08-18T22:27:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d34e00640 1 -- 172.21.15.5:0/2997079840 learned_addr learned my addr 172.21.15.5:0/2997079840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d2fe00640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d3015e4b0 0x7f1d3015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d35800640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d30161960 0x7f1d300c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:17.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d34e00640 1 -- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d3015e4b0 msgr2=0x7f1d3015a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d34e00640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d3015e4b0 0x7f1d3015a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d34e00640 1 -- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d30161960 msgr2=0x7f1d300c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d34e00640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d30161960 0x7f1d300c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d34e00640 1 -- 172.21.15.5:0/2997079840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d300b6940 con 0x7f1d30070730 2024-08-18T22:27:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d34e00640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d30070730 0x7f1d3015ba20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000c500 tx=0x7f1d2000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d2cc00640 1 -- 172.21.15.5:0/2997079840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d20016020 con 0x7f1d30070730 2024-08-18T22:27:17.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d2cc00640 1 -- 172.21.15.5:0/2997079840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d20005220 con 0x7f1d30070730 2024-08-18T22:27:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d37800640 1 -- 172.21.15.5:0/2997079840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d300b6c20 con 0x7f1d30070730 2024-08-18T22:27:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d2cc00640 1 -- 172.21.15.5:0/2997079840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d20007030 con 0x7f1d30070730 2024-08-18T22:27:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d37800640 1 -- 172.21.15.5:0/2997079840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d300b71e0 con 0x7f1d30070730 2024-08-18T22:27:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d37800640 1 -- 172.21.15.5:0/2997079840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3009bbb0 con 0x7f1d30070730 2024-08-18T22:27:17.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.352+0000 7f1d2cc00640 1 -- 172.21.15.5:0/2997079840 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d200071f0 con 0x7f1d30070730 2024-08-18T22:27:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.356+0000 7f1d2cc00640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1d100678c0 0x7f1d10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.356+0000 7f1d2cc00640 1 -- 172.21.15.5:0/2997079840 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f1d200855e0 con 0x7f1d30070730 2024-08-18T22:27:17.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.356+0000 7f1d2fe00640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1d100678c0 0x7f1d10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.356+0000 7f1d2fe00640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1d100678c0 0x7f1d10069d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1d300c7ea0 tx=0x7f1d1c007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:17.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.360+0000 7f1d2cc00640 1 -- 172.21.15.5:0/2997079840 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1d20020020 con 0x7f1d30070730 2024-08-18T22:27:17.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:17.588+0000 7f1d37800640 1 -- 172.21.15.5:0/2997079840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7f1d300d3010 con 0x7f1d30070730 2024-08-18T22:27:18.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d2cc00640 1 -- 172.21.15.5:0/2997079840 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v388) ==== 147+0+0 (secure 0 0 0) 0x7f1d20056200 con 0x7f1d30070730 2024-08-18T22:27:18.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 -- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1d100678c0 msgr2=0x7f1d10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:18.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1d100678c0 0x7f1d10069d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1d300c7ea0 tx=0x7f1d1c007d30 comp rx=0 tx=0).stop 2024-08-18T22:27:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 -- 172.21.15.5:0/2997079840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d30070730 msgr2=0x7f1d3015ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d30070730 0x7f1d3015ba20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000c500 tx=0x7f1d2000c9c0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 -- 172.21.15.5:0/2997079840 shutdown_connections 2024-08-18T22:27:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1d100678c0 0x7f1d10069d80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d30161960 0x7f1d300c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d3015e4b0 0x7f1d3015a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 --2- 172.21.15.5:0/2997079840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d30070730 0x7f1d3015ba20 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 -- 172.21.15.5:0/2997079840 >> 172.21.15.5:0/2997079840 conn(0x7f1d300d2130 msgr2=0x7f1d300b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 -- 172.21.15.5:0/2997079840 shutdown_connections 2024-08-18T22:27:18.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.492+0000 7f1d37800640 1 -- 172.21.15.5:0/2997079840 wait complete. 2024-08-18T22:27:18.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:27:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.688+0000 7ff954e00640 1 Processor -- start 2024-08-18T22:27:18.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.688+0000 7ff954e00640 1 -- start start 2024-08-18T22:27:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.688+0000 7ff954e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff95015c180 0x7ff9500cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.688+0000 7ff954e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9500cfb00 con 0x7ff95015d4d0 2024-08-18T22:27:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.688+0000 7ff954e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff95015c9f0 con 0x7ff95015c560 2024-08-18T22:27:18.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.688+0000 7ff954e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff95015d040 con 0x7ff95015c180 2024-08-18T22:27:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.688+0000 7ff94e800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff95015d4d0 0x7ff95006db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60182/0 (socket says 172.21.15.5:60182) 2024-08-18T22:27:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.688+0000 7ff94e800640 1 -- 172.21.15.5:0/3369208776 learned_addr learned my addr 172.21.15.5:0/3369208776 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.688+0000 7ff94de00640 1 --2- 172.21.15.5:0/3369208776 >> v2:172.21.15.5:3300/0 conn(0x7ff95015c180 0x7ff9500cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.692+0000 7ff94de00640 1 -- 172.21.15.5:0/3369208776 >> v1:172.21.15.117:6789/0 conn(0x7ff95015c560 legacy=0x7ff9500ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.692+0000 7ff94de00640 1 -- 172.21.15.5:0/3369208776 >> v1:172.21.15.5:6789/0 conn(0x7ff95015d4d0 legacy=0x7ff95006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.692+0000 7ff94de00640 1 -- 172.21.15.5:0/3369208776 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95015ccd0 con 0x7ff95015c180 2024-08-18T22:27:18.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.692+0000 7ff94ca00640 1 -- 172.21.15.5:0/3369208776 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720475098 0 0) 0x7ff9500cfb00 con 0x7ff95015d4d0 2024-08-18T22:27:18.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.692+0000 7ff94de00640 1 --2- 172.21.15.5:0/3369208776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff95015c180 0x7ff9500cdf10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff940009d90 tx=0x7ff94001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c633ce1e4d764a77 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:18.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.692+0000 7ff94ca00640 1 -- 172.21.15.5:0/3369208776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9400b2070 con 0x7ff95015c180 2024-08-18T22:27:18.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.692+0000 7ff94ca00640 1 -- 172.21.15.5:0/3369208776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9500ced70 con 0x7ff95015c180 2024-08-18T22:27:18.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.692+0000 7ff94ca00640 1 -- 172.21.15.5:0/3369208776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9400a5be0 con 0x7ff95015c180 2024-08-18T22:27:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 -- 172.21.15.5:0/3369208776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff95015c180 msgr2=0x7ff9500cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 --2- 172.21.15.5:0/3369208776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff95015c180 0x7ff9500cdf10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff940009d90 tx=0x7ff94001c8e0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 -- 172.21.15.5:0/3369208776 shutdown_connections 2024-08-18T22:27:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 --2- 172.21.15.5:0/3369208776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff95015c180 0x7ff9500cdf10 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 -- 172.21.15.5:0/3369208776 >> 172.21.15.5:0/3369208776 conn(0x7ff9500b1dc0 msgr2=0x7ff9500b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 -- 172.21.15.5:0/3369208776 shutdown_connections 2024-08-18T22:27:18.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 -- 172.21.15.5:0/3369208776 wait complete. 2024-08-18T22:27:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 Processor -- start 2024-08-18T22:27:18.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 -- start start 2024-08-18T22:27:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff95015c180 0x7ff95014da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff95015d4d0 0x7ff95014eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff95014c4d0 0x7ff950147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff95016a2c0 con 0x7ff95015d4d0 2024-08-18T22:27:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff95016a140 con 0x7ff95015c180 2024-08-18T22:27:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff954e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff95016a440 con 0x7ff95014c4d0 2024-08-18T22:27:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff94d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff95015d4d0 0x7ff95014eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff94d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff95015d4d0 0x7ff95014eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33726/0 (socket says 172.21.15.5:33726) 2024-08-18T22:27:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff94d400640 1 -- 172.21.15.5:0/3001610269 learned_addr learned my addr 172.21.15.5:0/3001610269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff94de00640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff95015c180 0x7ff95014da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff94e800640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff95014c4d0 0x7ff950147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff94d400640 1 -- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff95014c4d0 msgr2=0x7ff950147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff94d400640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff95014c4d0 0x7ff950147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff94d400640 1 -- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff95015c180 msgr2=0x7ff95014da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff94d400640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff95015c180 0x7ff95014da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff94d400640 1 -- 172.21.15.5:0/3001610269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9500b1bf0 con 0x7ff95015d4d0 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.696+0000 7ff94e800640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff95014c4d0 0x7ff950147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.700+0000 7ff94d400640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff95015d4d0 0x7ff95014eae0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00c500 tx=0x7ff93c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.700+0000 7ff946000640 1 -- 172.21.15.5:0/3001610269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c016020 con 0x7ff95015d4d0 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.700+0000 7ff946000640 1 -- 172.21.15.5:0/3001610269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff93c005220 con 0x7ff95015d4d0 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.700+0000 7ff954e00640 1 -- 172.21.15.5:0/3001610269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff95014ca70 con 0x7ff95015d4d0 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.700+0000 7ff946000640 1 -- 172.21.15.5:0/3001610269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c007030 con 0x7ff95015d4d0 2024-08-18T22:27:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.700+0000 7ff954e00640 1 -- 172.21.15.5:0/3001610269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff95014d030 con 0x7ff95015d4d0 2024-08-18T22:27:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.700+0000 7ff954e00640 1 -- 172.21.15.5:0/3001610269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9500cfb00 con 0x7ff95015d4d0 2024-08-18T22:27:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.700+0000 7ff946000640 1 -- 172.21.15.5:0/3001610269 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff93c0071d0 con 0x7ff95015d4d0 2024-08-18T22:27:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.700+0000 7ff946000640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9300678f0 0x7ff930069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.700+0000 7ff946000640 1 -- 172.21.15.5:0/3001610269 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7ff93c085530 con 0x7ff95015d4d0 2024-08-18T22:27:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.700+0000 7ff94de00640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9300678f0 0x7ff930069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.704+0000 7ff94de00640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9300678f0 0x7ff930069db0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff9400af000 tx=0x7ff9400a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:18.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.704+0000 7ff946000640 1 -- 172.21.15.5:0/3001610269 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff93c020020 con 0x7ff95015d4d0 2024-08-18T22:27:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.872+0000 7ff954e00640 1 -- 172.21.15.5:0/3001610269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff950154dc0 con 0x7ff95015d4d0 2024-08-18T22:27:18.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff946000640 1 -- 172.21.15.5:0/3001610269 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7ff93c0074c0 con 0x7ff95015d4d0 2024-08-18T22:27:18.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 -- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9300678f0 msgr2=0x7ff930069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9300678f0 0x7ff930069db0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff9400af000 tx=0x7ff9400a7070 comp rx=0 tx=0).stop 2024-08-18T22:27:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 -- 172.21.15.5:0/3001610269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff95015d4d0 msgr2=0x7ff95014eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff95015d4d0 0x7ff95014eae0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00c500 tx=0x7ff93c00c9c0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 -- 172.21.15.5:0/3001610269 shutdown_connections 2024-08-18T22:27:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9300678f0 0x7ff930069db0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff95014c4d0 0x7ff950147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff95015d4d0 0x7ff95014eae0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 --2- 172.21.15.5:0/3001610269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff95015c180 0x7ff95014da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 -- 172.21.15.5:0/3001610269 >> 172.21.15.5:0/3001610269 conn(0x7ff9500b1dc0 msgr2=0x7ff95006eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 -- 172.21.15.5:0/3001610269 shutdown_connections 2024-08-18T22:27:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:18.876+0000 7ff954e00640 1 -- 172.21.15.5:0/3001610269 wait complete. 2024-08-18T22:27:18.897 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:27:18.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:27:19.033 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:27:19.120 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:27:19.120 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:27:19.120 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:27:19.129 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:27:19.129 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:27:19.129 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:27:19.139 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:27:19.139 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:27:19.139 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:27:19.179 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:27:19.180 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:27:19.180 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:27:19.193 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:27:19.193 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:27:19.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:27:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4916e00640 1 Processor -- start 2024-08-18T22:27:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4916e00640 1 -- start start 2024-08-18T22:27:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4916e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4910071580 0x7f491006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4916e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49100cbed0 0x7f49100cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4916e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4910071c80 con 0x7f49100b54c0 2024-08-18T22:27:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4916e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f49100cba40 con 0x7f4910071580 2024-08-18T22:27:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4916e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4910071f60 con 0x7f49100cbed0 2024-08-18T22:27:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f490fe00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f49100b54c0 0x7f49100b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:53224/0 (socket says 172.21.15.5:53224) 2024-08-18T22:27:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f490fe00640 1 -- 172.21.15.5:0/1114128039 learned_addr learned my addr 172.21.15.5:0/1114128039 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4914e00640 1 --2- 172.21.15.5:0/1114128039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49100cbed0 0x7f49100cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4907e00640 1 --2- 172.21.15.5:0/1114128039 >> v2:172.21.15.117:3300/0 conn(0x7f4910071580 0x7f491006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4914e00640 1 -- 172.21.15.5:0/1114128039 >> v2:172.21.15.117:3300/0 conn(0x7f4910071580 msgr2=0x7f491006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4914e00640 1 --2- 172.21.15.5:0/1114128039 >> v2:172.21.15.117:3300/0 conn(0x7f4910071580 0x7f491006dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4914e00640 1 -- 172.21.15.5:0/1114128039 >> v1:172.21.15.117:6789/0 conn(0x7f49100b54c0 legacy=0x7f49100b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f4914e00640 1 -- 172.21.15.5:0/1114128039 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49100cb6d0 con 0x7f49100cbed0 2024-08-18T22:27:19.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.364+0000 7f490f400640 1 -- 172.21.15.5:0/1114128039 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863682819 0 0) 0x7f4910071c80 con 0x7f49100b54c0 2024-08-18T22:27:19.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f4914e00640 1 --2- 172.21.15.5:0/1114128039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49100cbed0 0x7f49100cc360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4908009d90 tx=0x7f490801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=136df1fce09cbfb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:19.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f490f400640 1 -- 172.21.15.5:0/1114128039 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49080b4070 con 0x7f49100cbed0 2024-08-18T22:27:19.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f490f400640 1 -- 172.21.15.5:0/1114128039 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49080af600 con 0x7f49100cbed0 2024-08-18T22:27:19.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f490f400640 1 -- 172.21.15.5:0/1114128039 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49080af9d0 con 0x7f49100cbed0 2024-08-18T22:27:19.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f4916e00640 1 -- 172.21.15.5:0/1114128039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49100cbed0 msgr2=0x7f49100cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:19.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f4916e00640 1 --2- 172.21.15.5:0/1114128039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49100cbed0 0x7f49100cc360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4908009d90 tx=0x7f490801f150 comp rx=0 tx=0).stop 2024-08-18T22:27:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f4916e00640 1 -- 172.21.15.5:0/1114128039 shutdown_connections 2024-08-18T22:27:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f4916e00640 1 --2- 172.21.15.5:0/1114128039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49100cbed0 0x7f49100cc360 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f4916e00640 1 --2- 172.21.15.5:0/1114128039 >> v2:172.21.15.117:3300/0 conn(0x7f4910071580 0x7f491006dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f4916e00640 1 -- 172.21.15.5:0/1114128039 >> 172.21.15.5:0/1114128039 conn(0x7f49100b3eb0 msgr2=0x7f49100b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f4916e00640 1 -- 172.21.15.5:0/1114128039 shutdown_connections 2024-08-18T22:27:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.368+0000 7f4916e00640 1 -- 172.21.15.5:0/1114128039 wait complete. 2024-08-18T22:27:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4916e00640 1 Processor -- start 2024-08-18T22:27:19.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4916e00640 1 -- start start 2024-08-18T22:27:19.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4916e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910071580 0x7f4910141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4916e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49100b54c0 0x7f4910141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4916e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49100cbed0 0x7f4910146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4916e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49101481a0 con 0x7f4910071580 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4916e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4910148020 con 0x7f49100b54c0 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4916e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49100cc8a0 con 0x7f49100cbed0 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910071580 0x7f4910141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910071580 0x7f4910141170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33734/0 (socket says 172.21.15.5:33734) 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490fe00640 1 -- 172.21.15.5:0/1210014710 learned_addr learned my addr 172.21.15.5:0/1210014710 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4907e00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49100b54c0 0x7f4910141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4914e00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49100cbed0 0x7f4910146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490fe00640 1 -- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49100cbed0 msgr2=0x7f4910146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:19.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490fe00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49100cbed0 0x7f4910146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490fe00640 1 -- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49100b54c0 msgr2=0x7f4910141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:19.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490fe00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49100b54c0 0x7f4910141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490fe00640 1 -- 172.21.15.5:0/1210014710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4910142110 con 0x7f4910071580 2024-08-18T22:27:19.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490fe00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910071580 0x7f4910141170 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f49000011f0 tx=0x7f490000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:19.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490cc00640 1 -- 172.21.15.5:0/1210014710 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4900018070 con 0x7f4910071580 2024-08-18T22:27:19.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490cc00640 1 -- 172.21.15.5:0/1210014710 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49000074e0 con 0x7f4910071580 2024-08-18T22:27:19.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f490cc00640 1 -- 172.21.15.5:0/1210014710 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4900004a10 con 0x7f4910071580 2024-08-18T22:27:19.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4916e00640 1 -- 172.21.15.5:0/1210014710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49101423c0 con 0x7f4910071580 2024-08-18T22:27:19.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4916e00640 1 -- 172.21.15.5:0/1210014710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4910142980 con 0x7f4910071580 2024-08-18T22:27:19.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.372+0000 7f4916e00640 1 -- 172.21.15.5:0/1210014710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4910143090 con 0x7f4910071580 2024-08-18T22:27:19.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.376+0000 7f490cc00640 1 -- 172.21.15.5:0/1210014710 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4900004bb0 con 0x7f4910071580 2024-08-18T22:27:19.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.376+0000 7f490cc00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48ec0678c0 0x7f48ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.376+0000 7f490cc00640 1 -- 172.21.15.5:0/1210014710 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f4900084eb0 con 0x7f4910071580 2024-08-18T22:27:19.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.376+0000 7f4907e00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48ec0678c0 0x7f48ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.376+0000 7f4907e00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48ec0678c0 0x7f48ec069d80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f49100cd8c0 tx=0x7f48f8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:19.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.380+0000 7f490cc00640 1 -- 172.21.15.5:0/1210014710 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4900055470 con 0x7f4910071580 2024-08-18T22:27:19.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.580+0000 7f4916e00640 1 -- 172.21.15.5:0/1210014710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49100cc360 con 0x7f4910071580 2024-08-18T22:27:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.580+0000 7f490cc00640 1 -- 172.21.15.5:0/1210014710 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+3908 (secure 0 0 0) 0x7f4900059770 con 0x7f4910071580 2024-08-18T22:27:19.581 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:19.581 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":93,"btime":"2024-08-18T22:27:13:280902+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6680,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3271513219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3271513219},{"type":"v1","addr":"172.21.15.117:6836","nonce":3271513219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":6893,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1267798734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1267798734},{"type":"v1","addr":"172.21.15.117:6837","nonce":1267798734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7210,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1577791873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1577791873},{"type":"v1","addr":"172.21.15.5:6835","nonce":1577791873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7734,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/704276311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":704276311},{"type":"v1","addr":"172.21.15.5:6834","nonce":704276311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[]} 2024-08-18T22:27:19.581 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 93 2024-08-18T22:27:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 -- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48ec0678c0 msgr2=0x7f48ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48ec0678c0 0x7f48ec069d80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f49100cd8c0 tx=0x7f48f8009190 comp rx=0 tx=0).stop 2024-08-18T22:27:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 -- 172.21.15.5:0/1210014710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910071580 msgr2=0x7f4910141170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910071580 0x7f4910141170 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f49000011f0 tx=0x7f490000c9b0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 -- 172.21.15.5:0/1210014710 shutdown_connections 2024-08-18T22:27:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48ec0678c0 0x7f48ec069d80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49100cbed0 0x7f4910146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49100b54c0 0x7f4910141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 --2- 172.21.15.5:0/1210014710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910071580 0x7f4910141170 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 -- 172.21.15.5:0/1210014710 >> 172.21.15.5:0/1210014710 conn(0x7f49100b3eb0 msgr2=0x7f49100b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 -- 172.21.15.5:0/1210014710 shutdown_connections 2024-08-18T22:27:19.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.584+0000 7f4916e00640 1 -- 172.21.15.5:0/1210014710 wait complete. 2024-08-18T22:27:19.602 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:27:19.602 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:27:19.602 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:27:19.602 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:27:19.603 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:27:19.603 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:27:19.603 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:27:19.603 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:27:19.603 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:27:19.604 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:27:19.604 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:27:19.604 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:27:19.604 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:27:19.604 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:27:19.604 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:27:19.604 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:27:19.616 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:27:19.617 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:27:19.618 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:27:19.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:27:19.620 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:27:19.620 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:27:19.621 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:27:19.621 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:27:19.668 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:27:19.668 DEBUG:teuthology.parallel:result is None 2024-08-18T22:27:19.669 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:27:19.669 DEBUG:teuthology.parallel:result is None 2024-08-18T22:27:19.670 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:27:19.670 DEBUG:teuthology.parallel:result is None 2024-08-18T22:27:19.671 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:27:19.671 DEBUG:teuthology.parallel:result is None 2024-08-18T22:27:19.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:27:19.757 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:27:19.757 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:27:19.762 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:27:19.763 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:27:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.816+0000 7f41ad800640 1 Processor -- start 2024-08-18T22:27:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.816+0000 7f41ad800640 1 -- start start 2024-08-18T22:27:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f41ad800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41a815b0c0 0x7f41a806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f41ad800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41a80b40c0 0x7f41a80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f41ad800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a80b31f0 con 0x7f41a8072a30 2024-08-18T22:27:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f41ad800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f41a80b4a70 con 0x7f41a80b40c0 2024-08-18T22:27:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f41ad800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f41a80b3d70 con 0x7f41a815b0c0 2024-08-18T22:27:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f419e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41a80b40c0 0x7f41a80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f419e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41a80b40c0 0x7f41a80b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33772/0 (socket says 172.21.15.5:33772) 2024-08-18T22:27:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f419e000640 1 -- 172.21.15.5:0/1660422950 learned_addr learned my addr 172.21.15.5:0/1660422950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f41a6a00640 1 --2- 172.21.15.5:0/1660422950 >> v2:172.21.15.117:3300/0 conn(0x7f41a815b0c0 0x7f41a806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f419e000640 1 -- 172.21.15.5:0/1660422950 >> v2:172.21.15.117:3300/0 conn(0x7f41a815b0c0 msgr2=0x7f41a806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f419e000640 1 --2- 172.21.15.5:0/1660422950 >> v2:172.21.15.117:3300/0 conn(0x7f41a815b0c0 0x7f41a806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f419e000640 1 -- 172.21.15.5:0/1660422950 >> v1:172.21.15.5:6789/0 conn(0x7f41a8072a30 legacy=0x7f41a8072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f419e000640 1 -- 172.21.15.5:0/1660422950 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a80b34d0 con 0x7f41a80b40c0 2024-08-18T22:27:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f41a6000640 1 -- 172.21.15.5:0/1660422950 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373144408 0 0) 0x7f41a80b31f0 con 0x7f41a8072a30 2024-08-18T22:27:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.820+0000 7f419e000640 1 --2- 172.21.15.5:0/1660422950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a80b40c0 0x7f41a80b4530 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f41a8070ba0 tx=0x7f419001eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e051a252a024ba server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41a6000640 1 -- 172.21.15.5:0/1660422950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41900b4070 con 0x7f41a80b40c0 2024-08-18T22:27:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41a6000640 1 -- 172.21.15.5:0/1660422950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41900a7a70 con 0x7f41a80b40c0 2024-08-18T22:27:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41a6000640 1 -- 172.21.15.5:0/1660422950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41900a7e40 con 0x7f41a80b40c0 2024-08-18T22:27:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 -- 172.21.15.5:0/1660422950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a80b40c0 msgr2=0x7f41a80b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 --2- 172.21.15.5:0/1660422950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a80b40c0 0x7f41a80b4530 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f41a8070ba0 tx=0x7f419001eaa0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 -- 172.21.15.5:0/1660422950 shutdown_connections 2024-08-18T22:27:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 --2- 172.21.15.5:0/1660422950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a80b40c0 0x7f41a80b4530 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 --2- 172.21.15.5:0/1660422950 >> v2:172.21.15.117:3300/0 conn(0x7f41a815b0c0 0x7f41a806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 -- 172.21.15.5:0/1660422950 >> 172.21.15.5:0/1660422950 conn(0x7f41a80b1dc0 msgr2=0x7f41a80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 -- 172.21.15.5:0/1660422950 shutdown_connections 2024-08-18T22:27:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 -- 172.21.15.5:0/1660422950 wait complete. 2024-08-18T22:27:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 Processor -- start 2024-08-18T22:27:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 -- start start 2024-08-18T22:27:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a8072a30 0x7f41a81fb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a80b40c0 0x7f41a814d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41a815b0c0 0x7f41a814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f41a815b4a0 con 0x7f41a80b40c0 2024-08-18T22:27:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f41a80739a0 con 0x7f41a815b0c0 2024-08-18T22:27:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f41ad800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f41a815b620 con 0x7f41a8072a30 2024-08-18T22:27:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f419e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a80b40c0 0x7f41a814d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f419e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a80b40c0 0x7f41a814d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33786/0 (socket says 172.21.15.5:33786) 2024-08-18T22:27:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.824+0000 7f419e000640 1 -- 172.21.15.5:0/3347335000 learned_addr learned my addr 172.21.15.5:0/3347335000 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f41a6a00640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a8072a30 0x7f41a81fb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f41a7400640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41a815b0c0 0x7f41a814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419e000640 1 -- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a8072a30 msgr2=0x7f41a81fb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419e000640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a8072a30 0x7f41a81fb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419e000640 1 -- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41a815b0c0 msgr2=0x7f41a814fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419e000640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41a815b0c0 0x7f41a814fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419e000640 1 -- 172.21.15.5:0/3347335000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a815bf20 con 0x7f41a80b40c0 2024-08-18T22:27:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f41a7400640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41a815b0c0 0x7f41a814fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419e000640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a80b40c0 0x7f41a814d4a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f41900b2040 tx=0x7f419001d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419f400640 1 -- 172.21.15.5:0/3347335000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41900b4070 con 0x7f41a80b40c0 2024-08-18T22:27:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419f400640 1 -- 172.21.15.5:0/3347335000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4190004020 con 0x7f41a80b40c0 2024-08-18T22:27:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419f400640 1 -- 172.21.15.5:0/3347335000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190004210 con 0x7f41a80b40c0 2024-08-18T22:27:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f41ad800640 1 -- 172.21.15.5:0/3347335000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a815c200 con 0x7f41a80b40c0 2024-08-18T22:27:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f41ad800640 1 -- 172.21.15.5:0/3347335000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a81fadc0 con 0x7f41a80b40c0 2024-08-18T22:27:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f41ad800640 1 -- 172.21.15.5:0/3347335000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a806f700 con 0x7f41a80b40c0 2024-08-18T22:27:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419f400640 1 -- 172.21.15.5:0/3347335000 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f41900c1060 con 0x7f41a80b40c0 2024-08-18T22:27:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419f400640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41840678c0 0x7f4184069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.828+0000 7f419f400640 1 -- 172.21.15.5:0/3347335000 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f4190120180 con 0x7f41a80b40c0 2024-08-18T22:27:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.832+0000 7f41a6a00640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41840678c0 0x7f4184069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.832+0000 7f41a6a00640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41840678c0 0x7f4184069d80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4198009a50 tx=0x7f4198008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:19.832+0000 7f419f400640 1 -- 172.21.15.5:0/3347335000 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f41900187e0 con 0x7f41a80b40c0 2024-08-18T22:27:20.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.012+0000 7f41ad800640 1 -- 172.21.15.5:0/3347335000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f41a8073dc0 con 0x7f41a80b40c0 2024-08-18T22:27:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f419f400640 1 -- 172.21.15.5:0/3347335000 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v123) ==== 97+0+0 (secure 0 0 0) 0x7f41900f0d90 con 0x7f41a80b40c0 2024-08-18T22:27:20.507 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:27:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 -- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41840678c0 msgr2=0x7f4184069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41840678c0 0x7f4184069d80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4198009a50 tx=0x7f4198008040 comp rx=0 tx=0).stop 2024-08-18T22:27:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 -- 172.21.15.5:0/3347335000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a80b40c0 msgr2=0x7f41a814d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a80b40c0 0x7f41a814d4a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f41900b2040 tx=0x7f419001d2e0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 -- 172.21.15.5:0/3347335000 shutdown_connections 2024-08-18T22:27:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41840678c0 0x7f4184069d80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41a815b0c0 0x7f41a814fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41a80b40c0 0x7f41a814d4a0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 --2- 172.21.15.5:0/3347335000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41a8072a30 0x7f41a81fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 -- 172.21.15.5:0/3347335000 >> 172.21.15.5:0/3347335000 conn(0x7f41a80b1dc0 msgr2=0x7f41a8152440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:20.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 -- 172.21.15.5:0/3347335000 shutdown_connections 2024-08-18T22:27:20.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.508+0000 7f41ad800640 1 -- 172.21.15.5:0/3347335000 wait complete. 2024-08-18T22:27:20.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:27:20.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9fa400640 1 Processor -- start 2024-08-18T22:27:20.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9fa400640 1 -- start start 2024-08-18T22:27:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9fa400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9f40b54c0 0x7fb9f4071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9fa400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9f406dd80 0x7fb9f40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9fa400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f40b5de0 con 0x7fb9f406fad0 2024-08-18T22:27:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9fa400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb9f40cba40 con 0x7fb9f40b54c0 2024-08-18T22:27:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9fa400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f4071c80 con 0x7fb9f406dd80 2024-08-18T22:27:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9f3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9f40b54c0 0x7fb9f4071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9f3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9f40b54c0 0x7fb9f4071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33788/0 (socket says 172.21.15.5:33788) 2024-08-18T22:27:20.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9f3400640 1 -- 172.21.15.5:0/1426711664 learned_addr learned my addr 172.21.15.5:0/1426711664 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9f3e00640 1 --1- 172.21.15.5:0/1426711664 >> v1:172.21.15.5:6789/0 conn(0x7fb9f406fad0 0x7fb9f406ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60204/0 (socket says 172.21.15.5:60204) 2024-08-18T22:27:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9ebe00640 1 --2- 172.21.15.5:0/1426711664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9f406dd80 0x7fb9f40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:20.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9f3400640 1 -- 172.21.15.5:0/1426711664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9f406dd80 msgr2=0x7fb9f40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9f3400640 1 --2- 172.21.15.5:0/1426711664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9f406dd80 0x7fb9f40b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9f3400640 1 -- 172.21.15.5:0/1426711664 >> v1:172.21.15.5:6789/0 conn(0x7fb9f406fad0 legacy=0x7fb9f406ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9f3400640 1 -- 172.21.15.5:0/1426711664 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f4071f60 con 0x7fb9f40b54c0 2024-08-18T22:27:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9ebe00640 1 --2- 172.21.15.5:0/1426711664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9f406dd80 0x7fb9f40b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.676+0000 7fb9f2a00640 1 -- 172.21.15.5:0/1426711664 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767913961 0 0) 0x7fb9f40b5de0 con 0x7fb9f406fad0 2024-08-18T22:27:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9f3400640 1 --2- 172.21.15.5:0/1426711664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f40b54c0 0x7fb9f4071580 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4009870 tx=0x7fb9e401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6481c261776ef2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9f2a00640 1 -- 172.21.15.5:0/1426711664 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40b5070 con 0x7fb9f40b54c0 2024-08-18T22:27:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9f2a00640 1 -- 172.21.15.5:0/1426711664 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e40a8a50 con 0x7fb9f40b54c0 2024-08-18T22:27:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9f2a00640 1 -- 172.21.15.5:0/1426711664 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40a8e20 con 0x7fb9f40b54c0 2024-08-18T22:27:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9fa400640 1 -- 172.21.15.5:0/1426711664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f40b54c0 msgr2=0x7fb9f4071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9fa400640 1 --2- 172.21.15.5:0/1426711664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f40b54c0 0x7fb9f4071580 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4009870 tx=0x7fb9e401ed50 comp rx=0 tx=0).stop 2024-08-18T22:27:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9fa400640 1 -- 172.21.15.5:0/1426711664 shutdown_connections 2024-08-18T22:27:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9fa400640 1 --2- 172.21.15.5:0/1426711664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9f406dd80 0x7fb9f40b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9fa400640 1 --2- 172.21.15.5:0/1426711664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f40b54c0 0x7fb9f4071580 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9fa400640 1 -- 172.21.15.5:0/1426711664 >> 172.21.15.5:0/1426711664 conn(0x7fb9f40b3eb0 msgr2=0x7fb9f40b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9fa400640 1 -- 172.21.15.5:0/1426711664 shutdown_connections 2024-08-18T22:27:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.680+0000 7fb9fa400640 1 -- 172.21.15.5:0/1426711664 wait complete. 2024-08-18T22:27:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9fa400640 1 Processor -- start 2024-08-18T22:27:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9fa400640 1 -- start start 2024-08-18T22:27:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9fa400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9f406dd80 0x7fb9f40d2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9fa400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9f406fad0 0x7fb9f40aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9fa400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f40b54c0 0x7fb9f41f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9fa400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f4148020 con 0x7fb9f40b54c0 2024-08-18T22:27:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9fa400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f406e1a0 con 0x7fb9f406fad0 2024-08-18T22:27:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9fa400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f41481a0 con 0x7fb9f406dd80 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9f3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f40b54c0 0x7fb9f41f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9f3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f40b54c0 0x7fb9f41f3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33790/0 (socket says 172.21.15.5:33790) 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9f3e00640 1 -- 172.21.15.5:0/2099503459 learned_addr learned my addr 172.21.15.5:0/2099503459 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9f3e00640 1 -- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9f406dd80 msgr2=0x7fb9f40d2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9f3e00640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9f406dd80 0x7fb9f40d2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9f3e00640 1 -- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9f406fad0 msgr2=0x7fb9f40aa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9f3e00640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9f406fad0 0x7fb9f40aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9f3e00640 1 -- 172.21.15.5:0/2099503459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f40d2e40 con 0x7fb9f40b54c0 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9f3e00640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f40b54c0 0x7fb9f41f3b90 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00c7a0 tx=0x7fb9ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9eb400640 1 -- 172.21.15.5:0/2099503459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec018070 con 0x7fb9f40b54c0 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9eb400640 1 -- 172.21.15.5:0/2099503459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ec00a640 con 0x7fb9f40b54c0 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9eb400640 1 -- 172.21.15.5:0/2099503459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00aab0 con 0x7fb9f40b54c0 2024-08-18T22:27:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9fa400640 1 -- 172.21.15.5:0/2099503459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f40d1860 con 0x7fb9f40b54c0 2024-08-18T22:27:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9fa400640 1 -- 172.21.15.5:0/2099503459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f40d1e20 con 0x7fb9f40b54c0 2024-08-18T22:27:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.684+0000 7fb9fa400640 1 -- 172.21.15.5:0/2099503459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f4071580 con 0x7fb9f40b54c0 2024-08-18T22:27:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.688+0000 7fb9eb400640 1 -- 172.21.15.5:0/2099503459 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb9ec00ac50 con 0x7fb9f40b54c0 2024-08-18T22:27:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.688+0000 7fb9eb400640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9d00678c0 0x7fb9d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.688+0000 7fb9eb400640 1 -- 172.21.15.5:0/2099503459 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5249+0+0 (secure 0 0 0) 0x7fb9ec085200 con 0x7fb9f40b54c0 2024-08-18T22:27:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.688+0000 7fb9f3400640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9d00678c0 0x7fb9d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.688+0000 7fb9f3400640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9d00678c0 0x7fb9d0069d80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40b2000 tx=0x7fb9e4004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:20.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.692+0000 7fb9eb400640 1 -- 172.21.15.5:0/2099503459 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb9ec055e60 con 0x7fb9f40b54c0 2024-08-18T22:27:20.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 -- 172.21.15.5:0/2099503459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb9f4071920 con 0x7fb9f40b54c0 2024-08-18T22:27:20.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9eb400640 1 -- 172.21.15.5:0/2099503459 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7fb9ec055760 con 0x7fb9f40b54c0 2024-08-18T22:27:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:20.915 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:27:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:27:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:27:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:27:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:27:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:27:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:27:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:27:20.923 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.923 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:27:20.923 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:27:20.923 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.923 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.923 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:27:20.923 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:27:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:27:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:27:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:27:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:27:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:27:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:27:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:27:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:27:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:27:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:27:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:27:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:27:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:27:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:27:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:27:20.930 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:27:20.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 -- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9d00678c0 msgr2=0x7fb9d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:20.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9d00678c0 0x7fb9d0069d80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40b2000 tx=0x7fb9e4004740 comp rx=0 tx=0).stop 2024-08-18T22:27:20.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 -- 172.21.15.5:0/2099503459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f40b54c0 msgr2=0x7fb9f41f3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:20.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f40b54c0 0x7fb9f41f3b90 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00c7a0 tx=0x7fb9ec00cc60 comp rx=0 tx=0).stop 2024-08-18T22:27:20.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 -- 172.21.15.5:0/2099503459 shutdown_connections 2024-08-18T22:27:20.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9d00678c0 0x7fb9d0069d80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f40b54c0 0x7fb9f41f3b90 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9f406fad0 0x7fb9f40aa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 --2- 172.21.15.5:0/2099503459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9f406dd80 0x7fb9f40d2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:20.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 -- 172.21.15.5:0/2099503459 >> 172.21.15.5:0/2099503459 conn(0x7fb9f40b3eb0 msgr2=0x7fb9f4146f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:20.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 -- 172.21.15.5:0/2099503459 shutdown_connections 2024-08-18T22:27:20.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:20.916+0000 7fb9fa400640 1 -- 172.21.15.5:0/2099503459 wait complete. 2024-08-18T22:27:20.936 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:27:21.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f3442600640 1 Processor -- start 2024-08-18T22:27:21.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f3442600640 1 -- start start 2024-08-18T22:27:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f3442600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f343c0d4fa0 0x7f343c0d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f3442600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f343c0d1920 0x7f343c0d2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f3442600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f343c0cee10 con 0x7f343c15c320 2024-08-18T22:27:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f3442600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f343c0cfa20 con 0x7f343c0d1920 2024-08-18T22:27:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f3442600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f343c0cf0f0 con 0x7f343c0d4fa0 2024-08-18T22:27:21.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f343be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f343c0d1920 0x7f343c0d2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f343be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f343c0d1920 0x7f343c0d2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33800/0 (socket says 172.21.15.5:33800) 2024-08-18T22:27:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f343be00640 1 -- 172.21.15.5:0/586969490 learned_addr learned my addr 172.21.15.5:0/586969490 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f343b400640 1 --1- 172.21.15.5:0/586969490 >> v1:172.21.15.5:6789/0 conn(0x7f343c15c320 0x7f343c15f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60212/0 (socket says 172.21.15.5:60212) 2024-08-18T22:27:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f3433e00640 1 --2- 172.21.15.5:0/586969490 >> v2:172.21.15.117:3300/0 conn(0x7f343c0d4fa0 0x7f343c0d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f343be00640 1 -- 172.21.15.5:0/586969490 >> v2:172.21.15.117:3300/0 conn(0x7f343c0d4fa0 msgr2=0x7f343c0d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f343be00640 1 --2- 172.21.15.5:0/586969490 >> v2:172.21.15.117:3300/0 conn(0x7f343c0d4fa0 0x7f343c0d13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f343be00640 1 -- 172.21.15.5:0/586969490 >> v1:172.21.15.5:6789/0 conn(0x7f343c15c320 legacy=0x7f343c15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:21.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.080+0000 7f343be00640 1 -- 172.21.15.5:0/586969490 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c0cf3d0 con 0x7f343c0d1920 2024-08-18T22:27:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f343be00640 1 --2- 172.21.15.5:0/586969490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0d1920 0x7f343c0d2390 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f343c0c7dc0 tx=0x7f343401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1687d0ac830af020 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f343aa00640 1 -- 172.21.15.5:0/586969490 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34340a57d0 con 0x7f343c0d1920 2024-08-18T22:27:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f343aa00640 1 -- 172.21.15.5:0/586969490 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34340a5970 con 0x7f343c0d1920 2024-08-18T22:27:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f343aa00640 1 -- 172.21.15.5:0/586969490 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34340a5d40 con 0x7f343c0d1920 2024-08-18T22:27:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f3442600640 1 -- 172.21.15.5:0/586969490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0d1920 msgr2=0x7f343c0d2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f3442600640 1 --2- 172.21.15.5:0/586969490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0d1920 0x7f343c0d2390 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f343c0c7dc0 tx=0x7f343401c9f0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f3442600640 1 -- 172.21.15.5:0/586969490 shutdown_connections 2024-08-18T22:27:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f3442600640 1 --2- 172.21.15.5:0/586969490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0d1920 0x7f343c0d2390 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f3442600640 1 --2- 172.21.15.5:0/586969490 >> v2:172.21.15.117:3300/0 conn(0x7f343c0d4fa0 0x7f343c0d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f3442600640 1 -- 172.21.15.5:0/586969490 >> 172.21.15.5:0/586969490 conn(0x7f343c067aa0 msgr2=0x7f343c067eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f3442600640 1 -- 172.21.15.5:0/586969490 shutdown_connections 2024-08-18T22:27:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f3442600640 1 -- 172.21.15.5:0/586969490 wait complete. 2024-08-18T22:27:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f3442600640 1 Processor -- start 2024-08-18T22:27:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.084+0000 7f3442600640 1 -- start start 2024-08-18T22:27:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3442600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0d1920 0x7f343c1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3442600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343c0d4fa0 0x7f343c0b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3442600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c15c320 0x7f343c0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3442600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f343c16b420 con 0x7f343c0d1920 2024-08-18T22:27:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3442600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f343c0d32f0 con 0x7f343c0d4fa0 2024-08-18T22:27:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3442600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f343c16b5a0 con 0x7f343c15c320 2024-08-18T22:27:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f343b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0d1920 0x7f343c1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f343b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0d1920 0x7f343c1533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33814/0 (socket says 172.21.15.5:33814) 2024-08-18T22:27:21.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f343b400640 1 -- 172.21.15.5:0/1376582829 learned_addr learned my addr 172.21.15.5:0/1376582829 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3433e00640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343c0d4fa0 0x7f343c0b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f343be00640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c15c320 0x7f343c0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f343b400640 1 -- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c15c320 msgr2=0x7f343c0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f343b400640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c15c320 0x7f343c0b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f343b400640 1 -- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343c0d4fa0 msgr2=0x7f343c0b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f343b400640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343c0d4fa0 0x7f343c0b5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f343b400640 1 -- 172.21.15.5:0/1376582829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c074930 con 0x7f343c0d1920 2024-08-18T22:27:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f343b400640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0d1920 0x7f343c1533d0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f342c00c3a0 tx=0x7f342c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:21.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3433400640 1 -- 172.21.15.5:0/1376582829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0074e0 con 0x7f343c0d1920 2024-08-18T22:27:21.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3433400640 1 -- 172.21.15.5:0/1376582829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342c007680 con 0x7f343c0d1920 2024-08-18T22:27:21.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3433400640 1 -- 172.21.15.5:0/1376582829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c004a30 con 0x7f343c0d1920 2024-08-18T22:27:21.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3442600640 1 -- 172.21.15.5:0/1376582829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c1531d0 con 0x7f343c0d1920 2024-08-18T22:27:21.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3442600640 1 -- 172.21.15.5:0/1376582829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c158ac0 con 0x7f343c0d1920 2024-08-18T22:27:21.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.088+0000 7f3442600640 1 -- 172.21.15.5:0/1376582829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343c0b5d20 con 0x7f343c0d1920 2024-08-18T22:27:21.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.092+0000 7f3433400640 1 -- 172.21.15.5:0/1376582829 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f342c01a020 con 0x7f343c0d1920 2024-08-18T22:27:21.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.092+0000 7f3433400640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 0x7f3418069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.092+0000 7f3433400640 1 -- 172.21.15.5:0/1376582829 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5249+0+0 (secure 0 0 0) 0x7f342c085300 con 0x7f343c0d1920 2024-08-18T22:27:21.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.092+0000 7f3433e00640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 0x7f3418069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.092+0000 7f3433e00640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 0x7f3418069d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f343c0cea40 tx=0x7f3424008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.096+0000 7f3433400640 1 -- 172.21.15.5:0/1376582829 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f343c1531d0 con 0x7f343c0d1920 2024-08-18T22:27:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.260+0000 7f3442600640 1 -- 172.21.15.5:0/1376582829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f343c0d2390 con 0x7f343c0d1920 2024-08-18T22:27:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.260+0000 7f3433400640 1 -- 172.21.15.5:0/1376582829 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v125) ==== 84+0+65 (secure 0 0 0) 0x7f342c055f60 con 0x7f343c0d1920 2024-08-18T22:27:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:21.262 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:27:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:27:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:27:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:27:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:21.262 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:27:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 -- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 msgr2=0x7f3418069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 0x7f3418069d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f343c0cea40 tx=0x7f3424008040 comp rx=0 tx=0).stop 2024-08-18T22:27:21.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 -- 172.21.15.5:0/1376582829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0d1920 msgr2=0x7f343c1533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0d1920 0x7f343c1533d0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f342c00c3a0 tx=0x7f342c00c860 comp rx=0 tx=0).stop 2024-08-18T22:27:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 -- 172.21.15.5:0/1376582829 shutdown_connections 2024-08-18T22:27:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 0x7f3418069d80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c15c320 0x7f343c0b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343c0d4fa0 0x7f343c0b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 --2- 172.21.15.5:0/1376582829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0d1920 0x7f343c1533d0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 -- 172.21.15.5:0/1376582829 >> 172.21.15.5:0/1376582829 conn(0x7f343c067aa0 msgr2=0x7f343c160820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 -- 172.21.15.5:0/1376582829 shutdown_connections 2024-08-18T22:27:21.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.264+0000 7f3442600640 1 -- 172.21.15.5:0/1376582829 wait complete. 2024-08-18T22:27:21.282 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:27:21.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:27:21.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd519a00640 1 Processor -- start 2024-08-18T22:27:21.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd519a00640 1 -- start start 2024-08-18T22:27:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd519a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd51409b150 0x7fd5141691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd519a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5140b6500 con 0x7fd5141625a0 2024-08-18T22:27:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd519a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5140b67e0 con 0x7fd514162980 2024-08-18T22:27:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd519a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd514162df0 con 0x7fd51409b150 2024-08-18T22:27:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd5141625a0 0x7fd5140b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60220/0 (socket says 172.21.15.5:60220) 2024-08-18T22:27:21.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512a00640 1 -- 172.21.15.5:0/2306647828 learned_addr learned my addr 172.21.15.5:0/2306647828 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:21.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd513400640 1 --2- 172.21.15.5:0/2306647828 >> v2:172.21.15.117:3300/0 conn(0x7fd51409b150 0x7fd5141691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73980650 0 0) 0x7fd5140b6500 con 0x7fd5141625a0 2024-08-18T22:27:21.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4f8003530 con 0x7fd5141625a0 2024-08-18T22:27:21.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2166041588 0 0) 0x7fd4f8003530 con 0x7fd5141625a0 2024-08-18T22:27:21.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 >> v2:172.21.15.117:3300/0 conn(0x7fd51409b150 msgr2=0x7fd5141691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:21.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 --2- 172.21.15.5:0/2306647828 >> v2:172.21.15.117:3300/0 conn(0x7fd51409b150 0x7fd5141691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 >> v1:172.21.15.117:6789/0 conn(0x7fd514162980 legacy=0x7fd51409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5140b6ac0 con 0x7fd5141625a0 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fd504001680 con 0x7fd5141625a0 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 >> v1:172.21.15.5:6789/0 conn(0x7fd5141625a0 legacy=0x7fd5140b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f80039c0 0x7fd4f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f80043c0 0x7fd4f8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 0x7fd4f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f800c040 con 0x7fd4f8005130 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f800c1f0 con 0x7fd4f80043c0 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f800c3f0 con 0x7fd4f80039c0 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd513400640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 0x7fd4f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd512a00640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f80039c0 0x7fd4f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd50a000640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f80043c0 0x7fd4f8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd513400640 1 -- 172.21.15.5:0/2306647828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f80039c0 msgr2=0x7fd4f8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd513400640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4f80039c0 0x7fd4f8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd513400640 1 -- 172.21.15.5:0/2306647828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f80043c0 msgr2=0x7fd4f8004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd513400640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f80043c0 0x7fd4f8004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd513400640 1 -- 172.21.15.5:0/2306647828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f8003530 con 0x7fd4f8005130 2024-08-18T22:27:21.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.428+0000 7fd50a000640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4f80043c0 0x7fd4f8004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:21.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd513400640 1 -- 172.21.15.5:0/2306647828 reap_dead start 2024-08-18T22:27:21.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd513400640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 0x7fd4f800b9d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009fc0 tx=0x7fd50c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c719c03b3ad31ec5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:21.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c009c10 con 0x7fd4f8005130 2024-08-18T22:27:21.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c0a5d10 con 0x7fd4f8005130 2024-08-18T22:27:21.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd512000640 1 -- 172.21.15.5:0/2306647828 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c003be0 con 0x7fd4f8005130 2024-08-18T22:27:21.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd519a00640 1 -- 172.21.15.5:0/2306647828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 msgr2=0x7fd4f800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:21.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd519a00640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 0x7fd4f800b9d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009fc0 tx=0x7fd50c01ccc0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd519a00640 1 -- 172.21.15.5:0/2306647828 shutdown_connections 2024-08-18T22:27:21.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd519a00640 1 --2- 172.21.15.5:0/2306647828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 0x7fd4f800b9d0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd519a00640 1 -- 172.21.15.5:0/2306647828 >> 172.21.15.5:0/2306647828 conn(0x7fd5140b3d60 msgr2=0x7fd5140b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:21.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd519a00640 1 -- 172.21.15.5:0/2306647828 shutdown_connections 2024-08-18T22:27:21.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.432+0000 7fd519a00640 1 -- 172.21.15.5:0/2306647828 wait complete. 2024-08-18T22:27:21.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd519a00640 1 Processor -- start 2024-08-18T22:27:21.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd519a00640 1 -- start start 2024-08-18T22:27:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd519a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 0x7fd51415f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd519a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd51409fdc0 0x7fd5140d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd519a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51409d0e0 0x7fd51415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd519a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd51409abc0 con 0x7fd4f8005130 2024-08-18T22:27:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd519a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd51409aa40 con 0x7fd51409fdc0 2024-08-18T22:27:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd519a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd51409ad40 con 0x7fd51409d0e0 2024-08-18T22:27:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd512a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 0x7fd51415f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd512a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 0x7fd51415f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33834/0 (socket says 172.21.15.5:33834) 2024-08-18T22:27:21.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd512a00640 1 -- 172.21.15.5:0/2742271794 learned_addr learned my addr 172.21.15.5:0/2742271794 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd50a000640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd51409fdc0 0x7fd5140d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd513400640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51409d0e0 0x7fd51415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd512a00640 1 -- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51409d0e0 msgr2=0x7fd51415b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd512a00640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51409d0e0 0x7fd51415b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd512a00640 1 -- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd51409fdc0 msgr2=0x7fd5140d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd512a00640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd51409fdc0 0x7fd5140d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd512a00640 1 -- 172.21.15.5:0/2742271794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51409d910 con 0x7fd4f8005130 2024-08-18T22:27:21.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd512a00640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 0x7fd51415f1e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fd504001210 tx=0x7fd504004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:21.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd50b400640 1 -- 172.21.15.5:0/2742271794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50400f6b0 con 0x7fd4f8005130 2024-08-18T22:27:21.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd50b400640 1 -- 172.21.15.5:0/2742271794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd504018070 con 0x7fd4f8005130 2024-08-18T22:27:21.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd50b400640 1 -- 172.21.15.5:0/2742271794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50400fab0 con 0x7fd4f8005130 2024-08-18T22:27:21.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd519a00640 1 -- 172.21.15.5:0/2742271794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51409f2e0 con 0x7fd4f8005130 2024-08-18T22:27:21.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.436+0000 7fd519a00640 1 -- 172.21.15.5:0/2742271794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd51409dbf0 con 0x7fd4f8005130 2024-08-18T22:27:21.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.440+0000 7fd519a00640 1 -- 172.21.15.5:0/2742271794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd51409f0d0 con 0x7fd4f8005130 2024-08-18T22:27:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.440+0000 7fd50b400640 1 -- 172.21.15.5:0/2742271794 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd50400fc50 con 0x7fd4f8005130 2024-08-18T22:27:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.440+0000 7fd50b400640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4f00678f0 0x7fd4f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.440+0000 7fd50b400640 1 -- 172.21.15.5:0/2742271794 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5249+0+0 (secure 0 0 0) 0x7fd504086250 con 0x7fd4f8005130 2024-08-18T22:27:21.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.440+0000 7fd50a000640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4f00678f0 0x7fd4f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:21.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.444+0000 7fd50a000640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4f00678f0 0x7fd4f0069db0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd51415c190 tx=0x7fd4fc00aa10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.444+0000 7fd50b400640 1 -- 172.21.15.5:0/2742271794 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd504056a70 con 0x7fd4f8005130 2024-08-18T22:27:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:21.616+0000 7fd519a00640 1 -- 172.21.15.5:0/2742271794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd5140b5ab0 con 0x7fd4f8005130 2024-08-18T22:27:22.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.516+0000 7fd50b400640 1 -- 172.21.15.5:0/2742271794 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v126) ==== 138+0+0 (secure 0 0 0) 0x7fd50405ad70 con 0x7fd4f8005130 2024-08-18T22:27:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:27:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 -- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4f00678f0 msgr2=0x7fd4f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4f00678f0 0x7fd4f0069db0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd51415c190 tx=0x7fd4fc00aa10 comp rx=0 tx=0).stop 2024-08-18T22:27:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 -- 172.21.15.5:0/2742271794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 msgr2=0x7fd51415f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 0x7fd51415f1e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fd504001210 tx=0x7fd504004f90 comp rx=0 tx=0).stop 2024-08-18T22:27:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 -- 172.21.15.5:0/2742271794 shutdown_connections 2024-08-18T22:27:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4f00678f0 0x7fd4f0069db0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd51409d0e0 0x7fd51415b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd51409fdc0 0x7fd5140d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 --2- 172.21.15.5:0/2742271794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f8005130 0x7fd51415f1e0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 -- 172.21.15.5:0/2742271794 >> 172.21.15.5:0/2742271794 conn(0x7fd5140b3d60 msgr2=0x7fd5140b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 -- 172.21.15.5:0/2742271794 shutdown_connections 2024-08-18T22:27:22.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.520+0000 7fd519a00640 1 -- 172.21.15.5:0/2742271794 wait complete. 2024-08-18T22:27:22.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:27:22.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.700+0000 7f788f000640 1 Processor -- start 2024-08-18T22:27:22.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.700+0000 7f788f000640 1 -- start start 2024-08-18T22:27:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.700+0000 7f788f000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f788815d120 0x7f78880b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.700+0000 7f788f000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 0x7f78880d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.700+0000 7f788f000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788815d5b0 con 0x7f7888156770 2024-08-18T22:27:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.700+0000 7f788f000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f78880b4ac0 con 0x7f788815d120 2024-08-18T22:27:22.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.700+0000 7f788f000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7888156b50 con 0x7f78880b4650 2024-08-18T22:27:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.700+0000 7f788e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 0x7f78880d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.704+0000 7f788e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 0x7f78880d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:35990/0 (socket says 172.21.15.5:35990) 2024-08-18T22:27:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.704+0000 7f788e600640 1 -- 172.21.15.5:0/1984679337 learned_addr learned my addr 172.21.15.5:0/1984679337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.704+0000 7f788d200640 1 --2- 172.21.15.5:0/1984679337 >> v2:172.21.15.117:3300/0 conn(0x7f788815d120 0x7f78880b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.704+0000 7f788e600640 1 -- 172.21.15.5:0/1984679337 >> v2:172.21.15.117:3300/0 conn(0x7f788815d120 msgr2=0x7f78880b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.704+0000 7f788e600640 1 --2- 172.21.15.5:0/1984679337 >> v2:172.21.15.117:3300/0 conn(0x7f788815d120 0x7f78880b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:22.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.704+0000 7f788e600640 1 -- 172.21.15.5:0/1984679337 >> v1:172.21.15.117:6789/0 conn(0x7f7888156770 legacy=0x7f78880b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:22.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.704+0000 7f788e600640 1 -- 172.21.15.5:0/1984679337 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78880b67e0 con 0x7f78880b4650 2024-08-18T22:27:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.704+0000 7f788e600640 1 --2- 172.21.15.5:0/1984679337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 0x7f78880d01b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7880009e50 tx=0x7f788001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13cc084f213b29cb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.704+0000 7f7887e00640 1 -- 172.21.15.5:0/1984679337 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78800a5830 con 0x7f78880b4650 2024-08-18T22:27:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.704+0000 7f7887e00640 1 -- 172.21.15.5:0/1984679337 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78800a59d0 con 0x7f78880b4650 2024-08-18T22:27:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.704+0000 7f7887e00640 1 -- 172.21.15.5:0/1984679337 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78800a5da0 con 0x7f78880b4650 2024-08-18T22:27:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 -- 172.21.15.5:0/1984679337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 msgr2=0x7f78880d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 --2- 172.21.15.5:0/1984679337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 0x7f78880d01b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7880009e50 tx=0x7f788001c970 comp rx=0 tx=0).stop 2024-08-18T22:27:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 -- 172.21.15.5:0/1984679337 shutdown_connections 2024-08-18T22:27:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 --2- 172.21.15.5:0/1984679337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 0x7f78880d01b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 --2- 172.21.15.5:0/1984679337 >> v2:172.21.15.117:3300/0 conn(0x7f788815d120 0x7f78880b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 -- 172.21.15.5:0/1984679337 >> 172.21.15.5:0/1984679337 conn(0x7f7888067a70 msgr2=0x7f7888067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 -- 172.21.15.5:0/1984679337 shutdown_connections 2024-08-18T22:27:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 -- 172.21.15.5:0/1984679337 wait complete. 2024-08-18T22:27:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 Processor -- start 2024-08-18T22:27:22.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 -- start start 2024-08-18T22:27:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 0x7f788815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7888156770 0x7f788806d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788815d120 0x7f788815e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f78880d0f00 con 0x7f788815d120 2024-08-18T22:27:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f78880b7360 con 0x7f7888156770 2024-08-18T22:27:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788f000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f78880d1080 con 0x7f78880b4650 2024-08-18T22:27:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788e600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788815d120 0x7f788815e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788e600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788815d120 0x7f788815e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33842/0 (socket says 172.21.15.5:33842) 2024-08-18T22:27:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788e600640 1 -- 172.21.15.5:0/808526060 learned_addr learned my addr 172.21.15.5:0/808526060 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788dc00640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 0x7f788815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788d200640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7888156770 0x7f788806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788e600640 1 -- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 msgr2=0x7f788815bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788e600640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 0x7f788815bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788e600640 1 -- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7888156770 msgr2=0x7f788806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788e600640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7888156770 0x7f788806d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:22.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.708+0000 7f788e600640 1 -- 172.21.15.5:0/808526060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7888158320 con 0x7f788815d120 2024-08-18T22:27:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.712+0000 7f788e600640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788815d120 0x7f788815e820 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f788001a5a0 tx=0x7f7880019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.712+0000 7f7885600640 1 -- 172.21.15.5:0/808526060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78800bc020 con 0x7f788815d120 2024-08-18T22:27:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.712+0000 7f7885600640 1 -- 172.21.15.5:0/808526060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78800b8670 con 0x7f788815d120 2024-08-18T22:27:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.712+0000 7f7885600640 1 -- 172.21.15.5:0/808526060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78800b8a40 con 0x7f788815d120 2024-08-18T22:27:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.712+0000 7f788f000640 1 -- 172.21.15.5:0/808526060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78881585e0 con 0x7f788815d120 2024-08-18T22:27:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.712+0000 7f788f000640 1 -- 172.21.15.5:0/808526060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7888158ba0 con 0x7f788815d120 2024-08-18T22:27:22.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.712+0000 7f788f000640 1 -- 172.21.15.5:0/808526060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7888068680 con 0x7f788815d120 2024-08-18T22:27:22.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.712+0000 7f7885600640 1 -- 172.21.15.5:0/808526060 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78800bf020 con 0x7f788815d120 2024-08-18T22:27:22.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.712+0000 7f7885600640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f78680678f0 0x7f7868069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:22.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.712+0000 7f7885600640 1 -- 172.21.15.5:0/808526060 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5619+0+0 (secure 0 0 0) 0x7f7880120cb0 con 0x7f788815d120 2024-08-18T22:27:22.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.712+0000 7f788dc00640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f78680678f0 0x7f7868069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:22.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.716+0000 7f788dc00640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f78680678f0 0x7f7868069db0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f788815f860 tx=0x7f787c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:22.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.720+0000 7f7885600640 1 -- 172.21.15.5:0/808526060 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f78800c6030 con 0x7f788815d120 2024-08-18T22:27:22.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:27:22.772 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:27:22.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:22.888+0000 7f788f000640 1 -- 172.21.15.5:0/808526060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f78880d2f00 con 0x7f788815d120 2024-08-18T22:27:23.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.520+0000 7f7885600640 1 -- 172.21.15.5:0/808526060 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v127) ==== 170+0+0 (secure 0 0 0) 0x7f7880016620 con 0x7f788815d120 2024-08-18T22:27:23.520 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:27:23.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.520+0000 7f788f000640 1 -- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f78680678f0 msgr2=0x7f7868069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.520+0000 7f788f000640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f78680678f0 0x7f7868069db0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f788815f860 tx=0x7f787c009040 comp rx=0 tx=0).stop 2024-08-18T22:27:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.520+0000 7f788f000640 1 -- 172.21.15.5:0/808526060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788815d120 msgr2=0x7f788815e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.520+0000 7f788f000640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788815d120 0x7f788815e820 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f788001a5a0 tx=0x7f7880019710 comp rx=0 tx=0).stop 2024-08-18T22:27:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.524+0000 7f788f000640 1 -- 172.21.15.5:0/808526060 shutdown_connections 2024-08-18T22:27:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.524+0000 7f788f000640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f78680678f0 0x7f7868069db0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.524+0000 7f788f000640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f788815d120 0x7f788815e820 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.524+0000 7f788f000640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7888156770 0x7f788806d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.524+0000 7f788f000640 1 --2- 172.21.15.5:0/808526060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78880b4650 0x7f788815bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.524+0000 7f788f000640 1 -- 172.21.15.5:0/808526060 >> 172.21.15.5:0/808526060 conn(0x7f7888067a70 msgr2=0x7f7888071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.524+0000 7f788f000640 1 -- 172.21.15.5:0/808526060 shutdown_connections 2024-08-18T22:27:23.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.524+0000 7f788f000640 1 -- 172.21.15.5:0/808526060 wait complete. 2024-08-18T22:27:23.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:27:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.756+0000 7f67b1c00640 1 Processor -- start 2024-08-18T22:27:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.756+0000 7f67b1c00640 1 -- start start 2024-08-18T22:27:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67b1c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67ac15b0c0 0x7f67ac06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67b1c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67ac0b31f0 con 0x7f67ac0b40c0 2024-08-18T22:27:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67b1c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67ac0b34d0 con 0x7f67ac0cf290 2024-08-18T22:27:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67b1c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f67ac0b3d70 con 0x7f67ac15b0c0 2024-08-18T22:27:23.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67a2000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f67ac0b40c0 0x7f67ac072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53078/0 (socket says 172.21.15.5:53078) 2024-08-18T22:27:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67a2000640 1 -- 172.21.15.5:0/3273387752 learned_addr learned my addr 172.21.15.5:0/3273387752 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67aaa00640 1 --2- 172.21.15.5:0/3273387752 >> v2:172.21.15.117:3300/0 conn(0x7f67ac15b0c0 0x7f67ac06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67aa000640 1 -- 172.21.15.5:0/3273387752 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293228509 0 0) 0x7f67ac0b31f0 con 0x7f67ac0b40c0 2024-08-18T22:27:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67aa000640 1 -- 172.21.15.5:0/3273387752 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6790005740 con 0x7f67ac0b40c0 2024-08-18T22:27:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67aa000640 1 -- 172.21.15.5:0/3273387752 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1927735765 0 0) 0x7f67ac0b34d0 con 0x7f67ac0cf290 2024-08-18T22:27:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67aa000640 1 -- 172.21.15.5:0/3273387752 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67ac0b31f0 con 0x7f67ac0cf290 2024-08-18T22:27:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67aaa00640 1 -- 172.21.15.5:0/3273387752 >> v1:172.21.15.117:6789/0 conn(0x7f67ac0cf290 legacy=0x7f67ac073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67aaa00640 1 -- 172.21.15.5:0/3273387752 >> v1:172.21.15.5:6789/0 conn(0x7f67ac0b40c0 legacy=0x7f67ac072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.760+0000 7f67aaa00640 1 -- 172.21.15.5:0/3273387752 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ac0b37b0 con 0x7f67ac15b0c0 2024-08-18T22:27:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67aaa00640 1 --2- 172.21.15.5:0/3273387752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67ac15b0c0 0x7f67ac06db80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f679c0097c0 tx=0x7f679c01c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af4af195854c16b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67aa000640 1 -- 172.21.15.5:0/3273387752 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c0b0070 con 0x7f67ac15b0c0 2024-08-18T22:27:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67aa000640 1 -- 172.21.15.5:0/3273387752 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c0ab600 con 0x7f67ac15b0c0 2024-08-18T22:27:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67aa000640 1 -- 172.21.15.5:0/3273387752 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c0ab9b0 con 0x7f67ac15b0c0 2024-08-18T22:27:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67b1c00640 1 -- 172.21.15.5:0/3273387752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67ac15b0c0 msgr2=0x7f67ac06db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67b1c00640 1 --2- 172.21.15.5:0/3273387752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67ac15b0c0 0x7f67ac06db80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f679c0097c0 tx=0x7f679c01c350 comp rx=0 tx=0).stop 2024-08-18T22:27:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67b1c00640 1 -- 172.21.15.5:0/3273387752 shutdown_connections 2024-08-18T22:27:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67b1c00640 1 --2- 172.21.15.5:0/3273387752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67ac15b0c0 0x7f67ac06db80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67b1c00640 1 -- 172.21.15.5:0/3273387752 >> 172.21.15.5:0/3273387752 conn(0x7f67ac0b1dc0 msgr2=0x7f67ac0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67b1c00640 1 -- 172.21.15.5:0/3273387752 shutdown_connections 2024-08-18T22:27:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67b1c00640 1 -- 172.21.15.5:0/3273387752 wait complete. 2024-08-18T22:27:23.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67b1c00640 1 Processor -- start 2024-08-18T22:27:23.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.764+0000 7f67b1c00640 1 -- start start 2024-08-18T22:27:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67b1c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67ac0b40c0 0x7f67ac158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67b1c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67ac0cf290 0x7f67ac153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67b1c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67ac15b0c0 0x7f67ac15bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67b1c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac0b48e0 con 0x7f67ac15b0c0 2024-08-18T22:27:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67b1c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac15b4a0 con 0x7f67ac0b40c0 2024-08-18T22:27:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67b1c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f67ac152060 con 0x7f67ac0cf290 2024-08-18T22:27:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67ab400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67ac15b0c0 0x7f67ac15bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67ab400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67ac15b0c0 0x7f67ac15bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53396/0 (socket says 172.21.15.5:53396) 2024-08-18T22:27:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67ab400640 1 -- 172.21.15.5:0/3763292339 learned_addr learned my addr 172.21.15.5:0/3763292339 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67aaa00640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67ac0b40c0 0x7f67ac158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67a2000640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67ac0cf290 0x7f67ac153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67ab400640 1 -- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67ac0cf290 msgr2=0x7f67ac153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67ab400640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67ac0cf290 0x7f67ac153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67ab400640 1 -- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67ac0b40c0 msgr2=0x7f67ac158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67ab400640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67ac0b40c0 0x7f67ac158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67ab400640 1 -- 172.21.15.5:0/3763292339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ac153590 con 0x7f67ac15b0c0 2024-08-18T22:27:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67ab400640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67ac15b0c0 0x7f67ac15bf90 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f67a400c7c0 tx=0x7f67a400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67a3400640 1 -- 172.21.15.5:0/3763292339 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4003b80 con 0x7f67ac15b0c0 2024-08-18T22:27:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67a3400640 1 -- 172.21.15.5:0/3763292339 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a4003d20 con 0x7f67ac15b0c0 2024-08-18T22:27:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67b1c00640 1 -- 172.21.15.5:0/3763292339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ac1522d0 con 0x7f67ac15b0c0 2024-08-18T22:27:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67a3400640 1 -- 172.21.15.5:0/3763292339 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a400aa50 con 0x7f67ac15b0c0 2024-08-18T22:27:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67b1c00640 1 -- 172.21.15.5:0/3763292339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ac152890 con 0x7f67ac15b0c0 2024-08-18T22:27:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.768+0000 7f67b1c00640 1 -- 172.21.15.5:0/3763292339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67ac152a90 con 0x7f67ac15b0c0 2024-08-18T22:27:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.772+0000 7f67a3400640 1 -- 172.21.15.5:0/3763292339 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f67a400abf0 con 0x7f67ac15b0c0 2024-08-18T22:27:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.772+0000 7f67a3400640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f67880678c0 0x7f6788069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.772+0000 7f67a3400640 1 -- 172.21.15.5:0/3763292339 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 6001+0+0 (secure 0 0 0) 0x7f67a4085c60 con 0x7f67ac15b0c0 2024-08-18T22:27:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.772+0000 7f67aaa00640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f67880678c0 0x7f6788069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:23.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.772+0000 7f67aaa00640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f67880678c0 0x7f6788069d80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f679c0ad000 tx=0x7f679c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:23.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.776+0000 7f67a3400640 1 -- 172.21.15.5:0/3763292339 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f67ac152a90 con 0x7f67ac15b0c0 2024-08-18T22:27:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:23.976+0000 7f67b1c00640 1 -- 172.21.15.5:0/3763292339 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f67ac06f670 con 0x7f67ac15b0c0 2024-08-18T22:27:24.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.552+0000 7f67a3400640 1 -- 172.21.15.5:0/3763292339 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v96) ==== 174+0+0 (secure 0 0 0) 0x7f67a4056010 con 0x7f67ac15b0c0 2024-08-18T22:27:24.552 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 17 and data pool 18 2024-08-18T22:27:24.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 -- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f67880678c0 msgr2=0x7f6788069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f67880678c0 0x7f6788069d80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f679c0ad000 tx=0x7f679c0a6000 comp rx=0 tx=0).stop 2024-08-18T22:27:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 -- 172.21.15.5:0/3763292339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67ac15b0c0 msgr2=0x7f67ac15bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67ac15b0c0 0x7f67ac15bf90 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f67a400c7c0 tx=0x7f67a400cc80 comp rx=0 tx=0).stop 2024-08-18T22:27:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 -- 172.21.15.5:0/3763292339 shutdown_connections 2024-08-18T22:27:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f67880678c0 0x7f6788069d80 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67ac15b0c0 0x7f67ac15bf90 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67ac0cf290 0x7f67ac153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 --2- 172.21.15.5:0/3763292339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67ac0b40c0 0x7f67ac158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 -- 172.21.15.5:0/3763292339 >> 172.21.15.5:0/3763292339 conn(0x7f67ac0b1dc0 msgr2=0x7f67ac0b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:24.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 -- 172.21.15.5:0/3763292339 shutdown_connections 2024-08-18T22:27:24.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.560+0000 7f67b1c00640 1 -- 172.21.15.5:0/3763292339 wait complete. 2024-08-18T22:27:24.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:27:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.744+0000 7feb44e00640 1 Processor -- start 2024-08-18T22:27:24.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.744+0000 7feb44e00640 1 -- start start 2024-08-18T22:27:24.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.744+0000 7feb44e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb400ce520 0x7feb401453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:24.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.744+0000 7feb44e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feb400b1c50 0x7feb400b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.744+0000 7feb44e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb400b0bd0 con 0x7feb4006b9b0 2024-08-18T22:27:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.744+0000 7feb44e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7feb400b0e90 con 0x7feb400ce520 2024-08-18T22:27:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.744+0000 7feb44e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7feb400b1170 con 0x7feb400b1c50 2024-08-18T22:27:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.748+0000 7feb3d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb400ce520 0x7feb401453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.748+0000 7feb3d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb400ce520 0x7feb401453d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53408/0 (socket says 172.21.15.5:53408) 2024-08-18T22:27:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.748+0000 7feb3d400640 1 -- 172.21.15.5:0/2139738529 learned_addr learned my addr 172.21.15.5:0/2139738529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:24.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.748+0000 7feb3e800640 1 --2- 172.21.15.5:0/2139738529 >> v2:172.21.15.117:3300/0 conn(0x7feb400b1c50 0x7feb400b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:24.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.748+0000 7feb3d400640 1 -- 172.21.15.5:0/2139738529 >> v2:172.21.15.117:3300/0 conn(0x7feb400b1c50 msgr2=0x7feb400b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:24.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.748+0000 7feb3d400640 1 --2- 172.21.15.5:0/2139738529 >> v2:172.21.15.117:3300/0 conn(0x7feb400b1c50 0x7feb400b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.748+0000 7feb3d400640 1 -- 172.21.15.5:0/2139738529 >> v1:172.21.15.117:6789/0 conn(0x7feb4006b9b0 legacy=0x7feb4006bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:24.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.748+0000 7feb3d400640 1 -- 172.21.15.5:0/2139738529 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb400b1450 con 0x7feb400ce520 2024-08-18T22:27:24.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.748+0000 7feb3e800640 1 --2- 172.21.15.5:0/2139738529 >> v2:172.21.15.117:3300/0 conn(0x7feb400b1c50 0x7feb400b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.748+0000 7feb3d400640 1 --2- 172.21.15.5:0/2139738529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb400ce520 0x7feb401453d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7feb40072980 tx=0x7feb2c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7fd50510f5d46a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb3ca00640 1 -- 172.21.15.5:0/2139738529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c0aa430 con 0x7feb400ce520 2024-08-18T22:27:24.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb3ca00640 1 -- 172.21.15.5:0/2139738529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2c0af070 con 0x7feb400ce520 2024-08-18T22:27:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb3ca00640 1 -- 172.21.15.5:0/2139738529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c0aa7f0 con 0x7feb400ce520 2024-08-18T22:27:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 -- 172.21.15.5:0/2139738529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb400ce520 msgr2=0x7feb401453d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 --2- 172.21.15.5:0/2139738529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb400ce520 0x7feb401453d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7feb40072980 tx=0x7feb2c01c4b0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 -- 172.21.15.5:0/2139738529 shutdown_connections 2024-08-18T22:27:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 --2- 172.21.15.5:0/2139738529 >> v2:172.21.15.117:3300/0 conn(0x7feb400b1c50 0x7feb400b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 --2- 172.21.15.5:0/2139738529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb400ce520 0x7feb401453d0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 -- 172.21.15.5:0/2139738529 >> 172.21.15.5:0/2139738529 conn(0x7feb4009aa40 msgr2=0x7feb400b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 -- 172.21.15.5:0/2139738529 shutdown_connections 2024-08-18T22:27:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 -- 172.21.15.5:0/2139738529 wait complete. 2024-08-18T22:27:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 Processor -- start 2024-08-18T22:27:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 -- start start 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4006b9b0 0x7feb4013c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400b1c50 0x7feb400b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb400ce520 0x7feb400b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb400b2bb0 con 0x7feb400ce520 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feb400b2a30 con 0x7feb400b1c50 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb44e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb400ae040 con 0x7feb4006b9b0 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb3e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb400ce520 0x7feb400b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb3e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb400ce520 0x7feb400b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53410/0 (socket says 172.21.15.5:53410) 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb3e800640 1 -- 172.21.15.5:0/754530153 learned_addr learned my addr 172.21.15.5:0/754530153 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb3de00640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4006b9b0 0x7feb4013c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.752+0000 7feb3d400640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400b1c50 0x7feb400b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb3e800640 1 -- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4006b9b0 msgr2=0x7feb4013c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb3e800640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4006b9b0 0x7feb4013c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb3e800640 1 -- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400b1c50 msgr2=0x7feb400b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb3e800640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400b1c50 0x7feb400b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb3e800640 1 -- 172.21.15.5:0/754530153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb401f7b50 con 0x7feb400ce520 2024-08-18T22:27:24.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb3e800640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb400ce520 0x7feb400b6670 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7feb3800cd80 tx=0x7feb3800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb36000640 1 -- 172.21.15.5:0/754530153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3800f680 con 0x7feb400ce520 2024-08-18T22:27:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb36000640 1 -- 172.21.15.5:0/754530153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb3800f840 con 0x7feb400ce520 2024-08-18T22:27:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb36000640 1 -- 172.21.15.5:0/754530153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3800fc30 con 0x7feb400ce520 2024-08-18T22:27:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb44e00640 1 -- 172.21.15.5:0/754530153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb401f7e30 con 0x7feb400ce520 2024-08-18T22:27:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb44e00640 1 -- 172.21.15.5:0/754530153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4015a320 con 0x7feb400ce520 2024-08-18T22:27:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb44e00640 1 -- 172.21.15.5:0/754530153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb401453d0 con 0x7feb400ce520 2024-08-18T22:27:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb36000640 1 -- 172.21.15.5:0/754530153 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb3800e3e0 con 0x7feb400ce520 2024-08-18T22:27:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb36000640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb200678c0 0x7feb20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb36000640 1 -- 172.21.15.5:0/754530153 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 6101+0+0 (secure 0 0 0) 0x7feb38086b60 con 0x7feb400ce520 2024-08-18T22:27:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.756+0000 7feb3de00640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb200678c0 0x7feb20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.760+0000 7feb3de00640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb200678c0 0x7feb20069d80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7feb400cdc80 tx=0x7feb30009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:24.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.764+0000 7feb36000640 1 -- 172.21.15.5:0/754530153 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7feb38014030 con 0x7feb400ce520 2024-08-18T22:27:24.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.928+0000 7feb44e00640 1 -- 172.21.15.5:0/754530153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb400cde40 con 0x7feb400ce520 2024-08-18T22:27:24.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.928+0000 7feb36000640 1 -- 172.21.15.5:0/754530153 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16893 (secure 0 0 0) 0x7feb38056e20 con 0x7feb400ce520 2024-08-18T22:27:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:24.930 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":128,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:27:23.980476+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:27:21.667014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-08-18T22:27:22.938200+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:27:24.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 -- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb200678c0 msgr2=0x7feb20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:24.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb200678c0 0x7feb20069d80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7feb400cdc80 tx=0x7feb30009060 comp rx=0 tx=0).stop 2024-08-18T22:27:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 -- 172.21.15.5:0/754530153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb400ce520 msgr2=0x7feb400b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb400ce520 0x7feb400b6670 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7feb3800cd80 tx=0x7feb3800a650 comp rx=0 tx=0).stop 2024-08-18T22:27:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 -- 172.21.15.5:0/754530153 shutdown_connections 2024-08-18T22:27:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb200678c0 0x7feb20069d80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb400ce520 0x7feb400b6670 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb400b1c50 0x7feb400b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 --2- 172.21.15.5:0/754530153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb4006b9b0 0x7feb4013c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 -- 172.21.15.5:0/754530153 >> 172.21.15.5:0/754530153 conn(0x7feb4009aa40 msgr2=0x7feb400cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 -- 172.21.15.5:0/754530153 shutdown_connections 2024-08-18T22:27:24.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:24.932+0000 7feb44e00640 1 -- 172.21.15.5:0/754530153 wait complete. 2024-08-18T22:27:24.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:27:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.092+0000 7f29ada00640 1 Processor -- start 2024-08-18T22:27:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.092+0000 7f29ada00640 1 -- start start 2024-08-18T22:27:25.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29ada00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29a806f290 0x7f29a80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29ada00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a80cd850 con 0x7f29a815b010 2024-08-18T22:27:25.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29ada00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a80cee20 con 0x7f29a80cd3a0 2024-08-18T22:27:25.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29ada00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f29a80cfa30 con 0x7f29a806f290 2024-08-18T22:27:25.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a6a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f29a815b010 0x7f29a806eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53088/0 (socket says 172.21.15.5:53088) 2024-08-18T22:27:25.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a6a00640 1 -- 172.21.15.5:0/2419984760 learned_addr learned my addr 172.21.15.5:0/2419984760 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:25.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a6000640 1 --2- 172.21.15.5:0/2419984760 >> v2:172.21.15.117:3300/0 conn(0x7f29a806f290 0x7f29a80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341387417 0 0) 0x7f29a80cd850 con 0x7f29a815b010 2024-08-18T22:27:25.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f298c003530 con 0x7f29a815b010 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1215676996 0 0) 0x7f298c003530 con 0x7f29a815b010 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 >> v2:172.21.15.117:3300/0 conn(0x7f29a806f290 msgr2=0x7f29a80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 --2- 172.21.15.5:0/2419984760 >> v2:172.21.15.117:3300/0 conn(0x7f29a806f290 0x7f29a80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 >> v1:172.21.15.117:6789/0 conn(0x7f29a80cd3a0 legacy=0x7f29a8072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a80cf100 con 0x7f29a815b010 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f2998001680 con 0x7f29a815b010 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 >> v1:172.21.15.5:6789/0 conn(0x7f29a815b010 legacy=0x7f29a806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 --2- 172.21.15.5:0/2419984760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f298c0039c0 0x7f298c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 --2- 172.21.15.5:0/2419984760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f298c004810 0x7f298c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 --2- 172.21.15.5:0/2419984760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f298c0051d0 0x7f298c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29a80cfa30 con 0x7f298c004810 2024-08-18T22:27:25.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f298c00e280 con 0x7f298c0051d0 2024-08-18T22:27:25.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f298c00e480 con 0x7f298c0039c0 2024-08-18T22:27:25.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a6000640 1 --2- 172.21.15.5:0/2419984760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f298c004810 0x7f298c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a6a00640 1 --2- 172.21.15.5:0/2419984760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f298c0039c0 0x7f298c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a7400640 1 --2- 172.21.15.5:0/2419984760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f298c0051d0 0x7f298c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a6000640 1 -- 172.21.15.5:0/2419984760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f298c0039c0 msgr2=0x7f298c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:25.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a6000640 1 --2- 172.21.15.5:0/2419984760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f298c0039c0 0x7f298c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a6000640 1 -- 172.21.15.5:0/2419984760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f298c0051d0 msgr2=0x7f298c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:25.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a6000640 1 --2- 172.21.15.5:0/2419984760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f298c0051d0 0x7f298c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a6000640 1 -- 172.21.15.5:0/2419984760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c003530 con 0x7f298c004810 2024-08-18T22:27:25.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.096+0000 7f29a7400640 1 -- 172.21.15.5:0/2419984760 reap_dead start 2024-08-18T22:27:25.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29a6000640 1 --2- 172.21.15.5:0/2419984760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f298c004810 0x7f298c004c90 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f2994009ae0 tx=0x7f299401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b54521cec65e740 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:25.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29940b2070 con 0x7f298c004810 2024-08-18T22:27:25.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29940a5550 con 0x7f298c004810 2024-08-18T22:27:25.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29a5600640 1 -- 172.21.15.5:0/2419984760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29940096b0 con 0x7f298c004810 2024-08-18T22:27:25.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29ada00640 1 -- 172.21.15.5:0/2419984760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f298c004810 msgr2=0x7f298c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:25.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29ada00640 1 --2- 172.21.15.5:0/2419984760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f298c004810 0x7f298c004c90 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f2994009ae0 tx=0x7f299401ca70 comp rx=0 tx=0).stop 2024-08-18T22:27:25.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29ada00640 1 -- 172.21.15.5:0/2419984760 shutdown_connections 2024-08-18T22:27:25.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29ada00640 1 --2- 172.21.15.5:0/2419984760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f298c004810 0x7f298c004c90 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29ada00640 1 -- 172.21.15.5:0/2419984760 >> 172.21.15.5:0/2419984760 conn(0x7f29a80b1c50 msgr2=0x7f29a80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:25.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29ada00640 1 -- 172.21.15.5:0/2419984760 shutdown_connections 2024-08-18T22:27:25.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29ada00640 1 -- 172.21.15.5:0/2419984760 wait complete. 2024-08-18T22:27:25.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29ada00640 1 Processor -- start 2024-08-18T22:27:25.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.100+0000 7f29ada00640 1 -- start start 2024-08-18T22:27:25.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29ada00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f298c004810 0x7f29a8150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29ada00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a81f0a20 0x7f29a80ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29ada00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80aeec0 0x7f29a8155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29ada00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29a815b3f0 con 0x7f29a81f0a20 2024-08-18T22:27:25.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29ada00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f29a80cf6c0 con 0x7f29a80aeec0 2024-08-18T22:27:25.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29ada00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29a815bae0 con 0x7f298c004810 2024-08-18T22:27:25.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29a6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a81f0a20 0x7f29a80ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29a6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a81f0a20 0x7f29a80ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53438/0 (socket says 172.21.15.5:53438) 2024-08-18T22:27:25.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29a6000640 1 -- 172.21.15.5:0/2046101651 learned_addr learned my addr 172.21.15.5:0/2046101651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:25.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29a7400640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80aeec0 0x7f29a8155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29a6a00640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f298c004810 0x7f29a8150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29a6000640 1 -- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f298c004810 msgr2=0x7f29a8150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:25.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29a6000640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f298c004810 0x7f29a8150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29a6000640 1 -- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80aeec0 msgr2=0x7f29a8155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:25.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29a6000640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80aeec0 0x7f29a8155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29a6000640 1 -- 172.21.15.5:0/2046101651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a815bdc0 con 0x7f29a81f0a20 2024-08-18T22:27:25.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29a6000640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a81f0a20 0x7f29a80ae980 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f29940b0040 tx=0x7f2994019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:25.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f299ea00640 1 -- 172.21.15.5:0/2046101651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29940b2040 con 0x7f29a81f0a20 2024-08-18T22:27:25.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f299ea00640 1 -- 172.21.15.5:0/2046101651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2994004020 con 0x7f29a81f0a20 2024-08-18T22:27:25.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f299ea00640 1 -- 172.21.15.5:0/2046101651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994004410 con 0x7f29a81f0a20 2024-08-18T22:27:25.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29ada00640 1 -- 172.21.15.5:0/2046101651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a815c0a0 con 0x7f29a81f0a20 2024-08-18T22:27:25.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29ada00640 1 -- 172.21.15.5:0/2046101651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a8150ea0 con 0x7f29a81f0a20 2024-08-18T22:27:25.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.104+0000 7f29ada00640 1 -- 172.21.15.5:0/2046101651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a80ce840 con 0x7f29a81f0a20 2024-08-18T22:27:25.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.108+0000 7f299ea00640 1 -- 172.21.15.5:0/2046101651 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2994003620 con 0x7f29a81f0a20 2024-08-18T22:27:25.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.108+0000 7f299ea00640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29880678c0 0x7f2988069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.108+0000 7f299ea00640 1 -- 172.21.15.5:0/2046101651 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 6101+0+0 (secure 0 0 0) 0x7f2994120560 con 0x7f29a81f0a20 2024-08-18T22:27:25.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.108+0000 7f29a6a00640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29880678c0 0x7f2988069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.108+0000 7f29a6a00640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29880678c0 0x7f2988069d80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2998000c10 tx=0x7f2998009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:25.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.112+0000 7f299ea00640 1 -- 172.21.15.5:0/2046101651 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2994016780 con 0x7f29a81f0a20 2024-08-18T22:27:25.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.276+0000 7f29ada00640 1 -- 172.21.15.5:0/2046101651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29a81587b0 con 0x7f29a81f0a20 2024-08-18T22:27:25.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f299ea00640 1 -- 172.21.15.5:0/2046101651 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16893 (secure 0 0 0) 0x7f29940f09c0 con 0x7f29a81f0a20 2024-08-18T22:27:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:25.280 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":128,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:27:23.980476+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:27:21.667014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-08-18T22:27:22.938200+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:27:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 -- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29880678c0 msgr2=0x7f2988069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29880678c0 0x7f2988069d80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2998000c10 tx=0x7f2998009040 comp rx=0 tx=0).stop 2024-08-18T22:27:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 -- 172.21.15.5:0/2046101651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a81f0a20 msgr2=0x7f29a80ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a81f0a20 0x7f29a80ae980 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f29940b0040 tx=0x7f2994019810 comp rx=0 tx=0).stop 2024-08-18T22:27:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 -- 172.21.15.5:0/2046101651 shutdown_connections 2024-08-18T22:27:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29880678c0 0x7f2988069d80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29a80aeec0 0x7f29a8155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29a81f0a20 0x7f29a80ae980 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 --2- 172.21.15.5:0/2046101651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f298c004810 0x7f29a8150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 -- 172.21.15.5:0/2046101651 >> 172.21.15.5:0/2046101651 conn(0x7f29a80b1c50 msgr2=0x7f29a80735d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:25.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 -- 172.21.15.5:0/2046101651 shutdown_connections 2024-08-18T22:27:25.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.280+0000 7f29ada00640 1 -- 172.21.15.5:0/2046101651 wait complete. 2024-08-18T22:27:25.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:27:25.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.444+0000 7f77d8600640 1 Processor -- start 2024-08-18T22:27:25.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.444+0000 7f77d8600640 1 -- start start 2024-08-18T22:27:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d8600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77d00b40c0 0x7f77d00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d8600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77d00ce280 0x7f77d00ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d8600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d00b31f0 con 0x7f77d015b0c0 2024-08-18T22:27:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d8600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f77d00b4a70 con 0x7f77d00ce280 2024-08-18T22:27:25.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d8600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f77d00b3d70 con 0x7f77d00b40c0 2024-08-18T22:27:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d6600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77d00ce280 0x7f77d00ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d6600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77d00ce280 0x7f77d00ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53446/0 (socket says 172.21.15.5:53446) 2024-08-18T22:27:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d6600640 1 -- 172.21.15.5:0/2434234869 learned_addr learned my addr 172.21.15.5:0/2434234869 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d5200640 1 --2- 172.21.15.5:0/2434234869 >> v2:172.21.15.117:3300/0 conn(0x7f77d00b40c0 0x7f77d00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d6600640 1 -- 172.21.15.5:0/2434234869 >> v2:172.21.15.117:3300/0 conn(0x7f77d00b40c0 msgr2=0x7f77d00b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d6600640 1 --2- 172.21.15.5:0/2434234869 >> v2:172.21.15.117:3300/0 conn(0x7f77d00b40c0 0x7f77d00b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d6600640 1 -- 172.21.15.5:0/2434234869 >> v1:172.21.15.117:6789/0 conn(0x7f77d015b0c0 legacy=0x7f77d006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:25.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d6600640 1 -- 172.21.15.5:0/2434234869 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d00b34d0 con 0x7f77d00ce280 2024-08-18T22:27:25.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77d6600640 1 --2- 172.21.15.5:0/2434234869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d00ce280 0x7f77d00ce6d0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f77d0073f90 tx=0x7f77c801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24162394429bad18 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77cfe00640 1 -- 172.21.15.5:0/2434234869 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c80a5680 con 0x7f77d00ce280 2024-08-18T22:27:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.448+0000 7f77cfe00640 1 -- 172.21.15.5:0/2434234869 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c80a5820 con 0x7f77d00ce280 2024-08-18T22:27:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77cfe00640 1 -- 172.21.15.5:0/2434234869 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c80a5bf0 con 0x7f77d00ce280 2024-08-18T22:27:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 -- 172.21.15.5:0/2434234869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d00ce280 msgr2=0x7f77d00ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 --2- 172.21.15.5:0/2434234869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d00ce280 0x7f77d00ce6d0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f77d0073f90 tx=0x7f77c801c8d0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 -- 172.21.15.5:0/2434234869 shutdown_connections 2024-08-18T22:27:25.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 --2- 172.21.15.5:0/2434234869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d00ce280 0x7f77d00ce6d0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 --2- 172.21.15.5:0/2434234869 >> v2:172.21.15.117:3300/0 conn(0x7f77d00b40c0 0x7f77d00b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 -- 172.21.15.5:0/2434234869 >> 172.21.15.5:0/2434234869 conn(0x7f77d00b1dc0 msgr2=0x7f77d00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 -- 172.21.15.5:0/2434234869 shutdown_connections 2024-08-18T22:27:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 -- 172.21.15.5:0/2434234869 wait complete. 2024-08-18T22:27:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 Processor -- start 2024-08-18T22:27:25.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 -- start start 2024-08-18T22:27:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d00b40c0 0x7f77d014f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77d00ce280 0x7f77d00ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77d015b0c0 0x7f77d00adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77d006f7f0 con 0x7f77d00b40c0 2024-08-18T22:27:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f77d006f670 con 0x7f77d00ce280 2024-08-18T22:27:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d8600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f77d006e410 con 0x7f77d015b0c0 2024-08-18T22:27:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d5c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d00b40c0 0x7f77d014f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d5c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d00b40c0 0x7f77d014f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53452/0 (socket says 172.21.15.5:53452) 2024-08-18T22:27:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d5c00640 1 -- 172.21.15.5:0/4103100360 learned_addr learned my addr 172.21.15.5:0/4103100360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:25.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d5200640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77d00ce280 0x7f77d00ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d6600640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77d015b0c0 0x7f77d00adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d5c00640 1 -- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77d015b0c0 msgr2=0x7f77d00adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d5c00640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77d015b0c0 0x7f77d00adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d5c00640 1 -- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77d00ce280 msgr2=0x7f77d00ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.452+0000 7f77d5c00640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77d00ce280 0x7f77d00ad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.456+0000 7f77d5c00640 1 -- 172.21.15.5:0/4103100360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d014f5d0 con 0x7f77d00b40c0 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.456+0000 7f77d5c00640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d00b40c0 0x7f77d014f090 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f77c400c370 tx=0x7f77c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.456+0000 7f77cd600640 1 -- 172.21.15.5:0/4103100360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c40052d0 con 0x7f77d00b40c0 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.456+0000 7f77cd600640 1 -- 172.21.15.5:0/4103100360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c4005470 con 0x7f77d00b40c0 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.456+0000 7f77d8600640 1 -- 172.21.15.5:0/4103100360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d00adc90 con 0x7f77d00b40c0 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.456+0000 7f77cd600640 1 -- 172.21.15.5:0/4103100360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c4007260 con 0x7f77d00b40c0 2024-08-18T22:27:25.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.456+0000 7f77d8600640 1 -- 172.21.15.5:0/4103100360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d00ca770 con 0x7f77d00b40c0 2024-08-18T22:27:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.456+0000 7f77d8600640 1 -- 172.21.15.5:0/4103100360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d00b4530 con 0x7f77d00b40c0 2024-08-18T22:27:25.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.456+0000 7f77cd600640 1 -- 172.21.15.5:0/4103100360 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77c4007400 con 0x7f77d00b40c0 2024-08-18T22:27:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.456+0000 7f77cd600640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b00678f0 0x7f77b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.456+0000 7f77cd600640 1 -- 172.21.15.5:0/4103100360 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 6101+0+0 (secure 0 0 0) 0x7f77c40852e0 con 0x7f77d00b40c0 2024-08-18T22:27:25.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.460+0000 7f77d5200640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b00678f0 0x7f77b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:25.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.460+0000 7f77d5200640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b00678f0 0x7f77b0069db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f77d00b2470 tx=0x7f77bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:25.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.464+0000 7f77cd600640 1 -- 172.21.15.5:0/4103100360 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f77c4055510 con 0x7f77d00b40c0 2024-08-18T22:27:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:25.668+0000 7f77d8600640 1 -- 172.21.15.5:0/4103100360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f77d006ddd0 con 0x7f77d00b40c0 2024-08-18T22:27:26.516 INFO:tasks.ceph.mds.b.smithi117.stderr:2024-08-18T22:27:26.514+0000 7f1aa7a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:27:26.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.568+0000 7f77cd600640 1 -- 172.21.15.5:0/4103100360 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v99) ==== 118+0+0 (secure 0 0 0) 0x7f77c4059810 con 0x7f77d00b40c0 2024-08-18T22:27:26.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 -- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b00678f0 msgr2=0x7f77b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:26.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b00678f0 0x7f77b0069db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f77d00b2470 tx=0x7f77bc008040 comp rx=0 tx=0).stop 2024-08-18T22:27:26.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 -- 172.21.15.5:0/4103100360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d00b40c0 msgr2=0x7f77d014f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d00b40c0 0x7f77d014f090 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f77c400c370 tx=0x7f77c400c830 comp rx=0 tx=0).stop 2024-08-18T22:27:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 -- 172.21.15.5:0/4103100360 shutdown_connections 2024-08-18T22:27:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77b00678f0 0x7f77b0069db0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77d015b0c0 0x7f77d00adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77d00ce280 0x7f77d00ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 --2- 172.21.15.5:0/4103100360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d00b40c0 0x7f77d014f090 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 -- 172.21.15.5:0/4103100360 >> 172.21.15.5:0/4103100360 conn(0x7f77d00b1dc0 msgr2=0x7f77d00cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 -- 172.21.15.5:0/4103100360 shutdown_connections 2024-08-18T22:27:26.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.572+0000 7f77d8600640 1 -- 172.21.15.5:0/4103100360 wait complete. 2024-08-18T22:27:26.595 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:27:26.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:27:26.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05aa000640 1 Processor -- start 2024-08-18T22:27:26.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05aa000640 1 -- start start 2024-08-18T22:27:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05aa000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05a415d4d0 0x7f05a4166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:26.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05aa000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05a40ced30 con 0x7f05a415c560 2024-08-18T22:27:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05aa000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05a40cfb00 con 0x7f05a415c180 2024-08-18T22:27:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05aa000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f05a415d040 con 0x7f05a415d4d0 2024-08-18T22:27:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05a2a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f05a415c560 0x7f05a40ce620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53092/0 (socket says 172.21.15.5:53092) 2024-08-18T22:27:26.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05a2a00640 1 -- 172.21.15.5:0/3183036223 learned_addr learned my addr 172.21.15.5:0/3183036223 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:26.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05a3e00640 1 --2- 172.21.15.5:0/3183036223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05a415d4d0 0x7f05a4166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:26.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05a2000640 1 -- 172.21.15.5:0/3183036223 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372464663 0 0) 0x7f05a40ced30 con 0x7f05a415c560 2024-08-18T22:27:26.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05a2000640 1 -- 172.21.15.5:0/3183036223 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0588003530 con 0x7f05a415c560 2024-08-18T22:27:26.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.744+0000 7f05a2000640 1 -- 172.21.15.5:0/3183036223 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675031125 0 0) 0x7f05a40cfb00 con 0x7f05a415c180 2024-08-18T22:27:26.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05a2000640 1 -- 172.21.15.5:0/3183036223 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a40ced30 con 0x7f05a415c180 2024-08-18T22:27:26.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05a3e00640 1 -- 172.21.15.5:0/3183036223 >> v1:172.21.15.117:6789/0 conn(0x7f05a415c180 legacy=0x7f05a40cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:26.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05a3e00640 1 -- 172.21.15.5:0/3183036223 >> v1:172.21.15.5:6789/0 conn(0x7f05a415c560 legacy=0x7f05a40ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:26.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05a3e00640 1 -- 172.21.15.5:0/3183036223 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a415c9f0 con 0x7f05a415d4d0 2024-08-18T22:27:26.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05a3e00640 1 --2- 172.21.15.5:0/3183036223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05a415d4d0 0x7f05a4166f10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f059c0097f0 tx=0x7f059c01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b31d2664b1154b77 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:26.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05a2000640 1 -- 172.21.15.5:0/3183036223 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c0ab640 con 0x7f05a415d4d0 2024-08-18T22:27:26.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05a2000640 1 -- 172.21.15.5:0/3183036223 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c0b0070 con 0x7f05a415d4d0 2024-08-18T22:27:26.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05a2000640 1 -- 172.21.15.5:0/3183036223 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c0aba00 con 0x7f05a415d4d0 2024-08-18T22:27:26.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05aa000640 1 -- 172.21.15.5:0/3183036223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05a415d4d0 msgr2=0x7f05a4166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:26.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05aa000640 1 --2- 172.21.15.5:0/3183036223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05a415d4d0 0x7f05a4166f10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f059c0097f0 tx=0x7f059c01c420 comp rx=0 tx=0).stop 2024-08-18T22:27:26.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05aa000640 1 -- 172.21.15.5:0/3183036223 shutdown_connections 2024-08-18T22:27:26.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.748+0000 7f05aa000640 1 --2- 172.21.15.5:0/3183036223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05a415d4d0 0x7f05a4166f10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:26.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05aa000640 1 -- 172.21.15.5:0/3183036223 >> 172.21.15.5:0/3183036223 conn(0x7f05a40b1dc0 msgr2=0x7f05a40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:26.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05aa000640 1 -- 172.21.15.5:0/3183036223 shutdown_connections 2024-08-18T22:27:26.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05aa000640 1 -- 172.21.15.5:0/3183036223 wait complete. 2024-08-18T22:27:26.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05aa000640 1 Processor -- start 2024-08-18T22:27:26.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05aa000640 1 -- start start 2024-08-18T22:27:26.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05aa000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05a415c180 0x7f05a409b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05aa000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a415d4d0 0x7f05a409c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05aa000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05a4151370 0x7f05a4155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05aa000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f05a416a000 con 0x7f05a415d4d0 2024-08-18T22:27:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05aa000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f05a4169e80 con 0x7f05a4151370 2024-08-18T22:27:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05aa000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f05a416a180 con 0x7f05a415c180 2024-08-18T22:27:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a415d4d0 0x7f05a409c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a415d4d0 0x7f05a409c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53464/0 (socket says 172.21.15.5:53464) 2024-08-18T22:27:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05a2a00640 1 -- 172.21.15.5:0/558135564 learned_addr learned my addr 172.21.15.5:0/558135564 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05a3400640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05a415c180 0x7f05a409b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:26.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05a3e00640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05a4151370 0x7f05a4155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05a2a00640 1 -- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05a415c180 msgr2=0x7f05a409b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05a2a00640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05a415c180 0x7f05a409b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05a2a00640 1 -- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05a4151370 msgr2=0x7f05a4155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05a2a00640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05a4151370 0x7f05a4155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05a2a00640 1 -- 172.21.15.5:0/558135564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a409c940 con 0x7f05a415d4d0 2024-08-18T22:27:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f05a2a00640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a415d4d0 0x7f05a409c210 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f059000c420 tx=0x7f059000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.752+0000 7f059b400640 1 -- 172.21.15.5:0/558135564 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590017070 con 0x7f05a415d4d0 2024-08-18T22:27:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.756+0000 7f059b400640 1 -- 172.21.15.5:0/558135564 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0590005cf0 con 0x7f05a415d4d0 2024-08-18T22:27:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.756+0000 7f059b400640 1 -- 172.21.15.5:0/558135564 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590007310 con 0x7f05a415d4d0 2024-08-18T22:27:26.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.756+0000 7f05aa000640 1 -- 172.21.15.5:0/558135564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a409cc20 con 0x7f05a415d4d0 2024-08-18T22:27:26.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.756+0000 7f05aa000640 1 -- 172.21.15.5:0/558135564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a409d1e0 con 0x7f05a415d4d0 2024-08-18T22:27:26.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.756+0000 7f05aa000640 1 -- 172.21.15.5:0/558135564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a40cdf10 con 0x7f05a415d4d0 2024-08-18T22:27:26.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.756+0000 7f059b400640 1 -- 172.21.15.5:0/558135564 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f059001a070 con 0x7f05a415d4d0 2024-08-18T22:27:26.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.756+0000 7f059b400640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05840678c0 0x7f0584069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:26.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.756+0000 7f059b400640 1 -- 172.21.15.5:0/558135564 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f0590085230 con 0x7f05a415d4d0 2024-08-18T22:27:26.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.756+0000 7f05a3400640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05840678c0 0x7f0584069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:26.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.756+0000 7f05a3400640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05840678c0 0x7f0584069d80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0594007fd0 tx=0x7f0594009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:26.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.760+0000 7f059b400640 1 -- 172.21.15.5:0/558135564 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f05900554f0 con 0x7f05a415d4d0 2024-08-18T22:27:26.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:26.964+0000 7f05aa000640 1 -- 172.21.15.5:0/558135564 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f05a40b1150 con 0x7f05a415d4d0 2024-08-18T22:27:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.568+0000 7f059b400640 1 -- 172.21.15.5:0/558135564 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v100) ==== 122+0+0 (secure 0 0 0) 0x7f05900597f0 con 0x7f05a415d4d0 2024-08-18T22:27:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 -- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05840678c0 msgr2=0x7f0584069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05840678c0 0x7f0584069d80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0594007fd0 tx=0x7f0594009040 comp rx=0 tx=0).stop 2024-08-18T22:27:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 -- 172.21.15.5:0/558135564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a415d4d0 msgr2=0x7f05a409c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a415d4d0 0x7f05a409c210 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f059000c420 tx=0x7f059000c8e0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 -- 172.21.15.5:0/558135564 shutdown_connections 2024-08-18T22:27:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f05840678c0 0x7f0584069d80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05a4151370 0x7f05a4155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a415d4d0 0x7f05a409c210 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 --2- 172.21.15.5:0/558135564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05a415c180 0x7f05a409b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 -- 172.21.15.5:0/558135564 >> 172.21.15.5:0/558135564 conn(0x7f05a40b1dc0 msgr2=0x7f05a4154080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 -- 172.21.15.5:0/558135564 shutdown_connections 2024-08-18T22:27:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.572+0000 7f05aa000640 1 -- 172.21.15.5:0/558135564 wait complete. 2024-08-18T22:27:27.595 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:27:27.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:27:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d3b200640 1 Processor -- start 2024-08-18T22:27:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d3b200640 1 -- start start 2024-08-18T22:27:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d3b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0aea40 0x7f0d3c0aee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d3b200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d3c0ace90 0x7f0d3c15ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d3b200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3c0af360 con 0x7f0d3c15d5e0 2024-08-18T22:27:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d3b200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0d3c06da20 con 0x7f0d3c0ace90 2024-08-18T22:27:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d3b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c15d390 con 0x7f0d3c0aea40 2024-08-18T22:27:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d3a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0d3c15d5e0 0x7f0d3c06ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53098/0 (socket says 172.21.15.5:53098) 2024-08-18T22:27:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d3a800640 1 -- 172.21.15.5:0/1819661872 learned_addr learned my addr 172.21.15.5:0/1819661872 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d39e00640 1 --2- 172.21.15.5:0/1819661872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0aea40 0x7f0d3c0aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d39400640 1 --2- 172.21.15.5:0/1819661872 >> v2:172.21.15.117:3300/0 conn(0x7f0d3c0ace90 0x7f0d3c15ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d38a00640 1 -- 172.21.15.5:0/1819661872 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3593643692 0 0) 0x7f0d3c0af360 con 0x7f0d3c15d5e0 2024-08-18T22:27:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d38a00640 1 -- 172.21.15.5:0/1819661872 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d20003530 con 0x7f0d3c15d5e0 2024-08-18T22:27:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d39e00640 1 -- 172.21.15.5:0/1819661872 >> v2:172.21.15.117:3300/0 conn(0x7f0d3c0ace90 msgr2=0x7f0d3c15ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d39e00640 1 --2- 172.21.15.5:0/1819661872 >> v2:172.21.15.117:3300/0 conn(0x7f0d3c0ace90 0x7f0d3c15ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d39e00640 1 -- 172.21.15.5:0/1819661872 >> v1:172.21.15.5:6789/0 conn(0x7f0d3c15d5e0 legacy=0x7f0d3c06ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d39e00640 1 -- 172.21.15.5:0/1819661872 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c06dc70 con 0x7f0d3c0aea40 2024-08-18T22:27:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.740+0000 7f0d39400640 1 --2- 172.21.15.5:0/1819661872 >> v2:172.21.15.117:3300/0 conn(0x7f0d3c0ace90 0x7f0d3c15ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d39e00640 1 --2- 172.21.15.5:0/1819661872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0aea40 0x7f0d3c0aee20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097c0 tx=0x7f0d2c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85f532db31e9de4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d38a00640 1 -- 172.21.15.5:0/1819661872 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0a7070 con 0x7f0d3c0aea40 2024-08-18T22:27:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d38a00640 1 -- 172.21.15.5:0/1819661872 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0b0070 con 0x7f0d3c0aea40 2024-08-18T22:27:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d38a00640 1 -- 172.21.15.5:0/1819661872 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0ab890 con 0x7f0d3c0aea40 2024-08-18T22:27:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d3b200640 1 -- 172.21.15.5:0/1819661872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0aea40 msgr2=0x7f0d3c0aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d3b200640 1 --2- 172.21.15.5:0/1819661872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0aea40 0x7f0d3c0aee20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097c0 tx=0x7f0d2c01c470 comp rx=0 tx=0).stop 2024-08-18T22:27:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d3b200640 1 -- 172.21.15.5:0/1819661872 shutdown_connections 2024-08-18T22:27:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d3b200640 1 --2- 172.21.15.5:0/1819661872 >> v2:172.21.15.117:3300/0 conn(0x7f0d3c0ace90 0x7f0d3c15ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d3b200640 1 --2- 172.21.15.5:0/1819661872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c0aea40 0x7f0d3c0aee20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d3b200640 1 -- 172.21.15.5:0/1819661872 >> 172.21.15.5:0/1819661872 conn(0x7f0d3c0b1b00 msgr2=0x7f0d3c0b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d3b200640 1 -- 172.21.15.5:0/1819661872 shutdown_connections 2024-08-18T22:27:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.744+0000 7f0d3b200640 1 -- 172.21.15.5:0/1819661872 wait complete. 2024-08-18T22:27:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d3b200640 1 Processor -- start 2024-08-18T22:27:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d3b200640 1 -- start start 2024-08-18T22:27:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d3b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d3c0ace90 0x7f0d3c15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d3b200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3c0aea40 0x7f0d3c1f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d3b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c15d5e0 0x7f0d3c15aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d3b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c15f730 con 0x7f0d3c0ace90 2024-08-18T22:27:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d3b200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c06e7f0 con 0x7f0d3c0aea40 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d3b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c06f830 con 0x7f0d3c15d5e0 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d39e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d3c0ace90 0x7f0d3c15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d39e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d3c0ace90 0x7f0d3c15bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53466/0 (socket says 172.21.15.5:53466) 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d39e00640 1 -- 172.21.15.5:0/3221446245 learned_addr learned my addr 172.21.15.5:0/3221446245 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d39e00640 1 -- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c15d5e0 msgr2=0x7f0d3c15aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d39e00640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c15d5e0 0x7f0d3c15aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d39e00640 1 -- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3c0aea40 msgr2=0x7f0d3c1f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d39400640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3c0aea40 0x7f0d3c1f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d39e00640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3c0aea40 0x7f0d3c1f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d39e00640 1 -- 172.21.15.5:0/3221446245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c164b40 con 0x7f0d3c0ace90 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d39400640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3c0aea40 0x7f0d3c1f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d39e00640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d3c0ace90 0x7f0d3c15bae0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097c0 tx=0x7f0d2c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d32000640 1 -- 172.21.15.5:0/3221446245 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0bf610 con 0x7f0d3c0ace90 2024-08-18T22:27:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d32000640 1 -- 172.21.15.5:0/3221446245 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0abe50 con 0x7f0d3c0ace90 2024-08-18T22:27:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d32000640 1 -- 172.21.15.5:0/3221446245 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0bfa10 con 0x7f0d3c0ace90 2024-08-18T22:27:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d3b200640 1 -- 172.21.15.5:0/3221446245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3c164e20 con 0x7f0d3c0ace90 2024-08-18T22:27:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d3b200640 1 -- 172.21.15.5:0/3221446245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d3c1653e0 con 0x7f0d3c0ace90 2024-08-18T22:27:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.748+0000 7f0d3b200640 1 -- 172.21.15.5:0/3221446245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d3c15d9f0 con 0x7f0d3c0ace90 2024-08-18T22:27:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.752+0000 7f0d32000640 1 -- 172.21.15.5:0/3221446245 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d2c0bd020 con 0x7f0d3c0ace90 2024-08-18T22:27:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.752+0000 7f0d32000640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d1c0678c0 0x7f0d1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.752+0000 7f0d32000640 1 -- 172.21.15.5:0/3221446245 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f0d2c120120 con 0x7f0d3c0ace90 2024-08-18T22:27:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.752+0000 7f0d39400640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d1c0678c0 0x7f0d1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.752+0000 7f0d39400640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d1c0678c0 0x7f0d1c069d80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0cc170 tx=0x7f0d28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:27.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.756+0000 7f0d32000640 1 -- 172.21.15.5:0/3221446245 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0d2c0c6030 con 0x7f0d3c0ace90 2024-08-18T22:27:27.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 -- 172.21.15.5:0/3221446245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d3c0b41a0 con 0x7f0d3c0ace90 2024-08-18T22:27:27.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d32000640 1 -- 172.21.15.5:0/3221446245 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5224 (secure 0 0 0) 0x7f0d2c016090 con 0x7f0d3c0ace90 2024-08-18T22:27:27.956 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:27.956 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":100,"btime":"2024-08-18T22:27:27:572472+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1632895454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1632895454},{"type":"v1","addr":"172.21.15.117:6836","nonce":1632895454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/932399139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":932399139},{"type":"v1","addr":"172.21.15.5:6835","nonce":932399139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3229011054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3229011054},{"type":"v1","addr":"172.21.15.5:6834","nonce":3229011054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:27:23.980938+0000","modified":"2024-08-18T22:27:26.969472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2108480966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2108480966},{"type":"v1","addr":"172.21.15.117:6837","nonce":2108480966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8166,"qdb_cluster":[8166]},"id":8}]} 2024-08-18T22:27:27.956 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 100 2024-08-18T22:27:27.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 -- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d1c0678c0 msgr2=0x7f0d1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:27.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d1c0678c0 0x7f0d1c069d80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0cc170 tx=0x7f0d28008040 comp rx=0 tx=0).stop 2024-08-18T22:27:27.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 -- 172.21.15.5:0/3221446245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d3c0ace90 msgr2=0x7f0d3c15bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d3c0ace90 0x7f0d3c15bae0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097c0 tx=0x7f0d2c01acb0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 -- 172.21.15.5:0/3221446245 shutdown_connections 2024-08-18T22:27:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d1c0678c0 0x7f0d1c069d80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3c15d5e0 0x7f0d3c15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3c0aea40 0x7f0d3c1f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 --2- 172.21.15.5:0/3221446245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d3c0ace90 0x7f0d3c15bae0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 -- 172.21.15.5:0/3221446245 >> 172.21.15.5:0/3221446245 conn(0x7f0d3c0b1b00 msgr2=0x7f0d3c072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 -- 172.21.15.5:0/3221446245 shutdown_connections 2024-08-18T22:27:27.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:27.956+0000 7f0d3b200640 1 -- 172.21.15.5:0/3221446245 wait complete. 2024-08-18T22:27:27.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:27:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.116+0000 7fd503200640 1 Processor -- start 2024-08-18T22:27:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.116+0000 7fd503200640 1 -- start start 2024-08-18T22:27:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd503200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd504072c10 0x7fd50406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd503200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5040ad820 con 0x7fd50415ade0 2024-08-18T22:27:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd503200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5040731e0 con 0x7fd50406f3c0 2024-08-18T22:27:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd503200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd504072030 con 0x7fd504072c10 2024-08-18T22:27:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd4f9400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd504072c10 0x7fd50406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd4f9400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd504072c10 0x7fd50406dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53474/0 (socket says 172.21.15.5:53474) 2024-08-18T22:27:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd4f9400640 1 -- 172.21.15.5:0/1282031220 learned_addr learned my addr 172.21.15.5:0/1282031220 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd4f9400640 1 -- 172.21.15.5:0/1282031220 >> v1:172.21.15.117:6789/0 conn(0x7fd50406f3c0 legacy=0x7fd5040b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd4f9400640 1 -- 172.21.15.5:0/1282031220 >> v1:172.21.15.5:6789/0 conn(0x7fd50415ade0 legacy=0x7fd5040ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd4f9400640 1 -- 172.21.15.5:0/1282031220 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5040adae0 con 0x7fd504072c10 2024-08-18T22:27:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd501400640 1 -- 172.21.15.5:0/1282031220 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697014963 0 0) 0x7fd5040ad820 con 0x7fd50415ade0 2024-08-18T22:27:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.120+0000 7fd4f9400640 1 --2- 172.21.15.5:0/1282031220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd504072c10 0x7fd50406dad0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009870 tx=0x7fd4ec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d4e7cccc2bb0fd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd501400640 1 -- 172.21.15.5:0/1282031220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0b0070 con 0x7fd504072c10 2024-08-18T22:27:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd501400640 1 -- 172.21.15.5:0/1282031220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec0ab600 con 0x7fd504072c10 2024-08-18T22:27:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd501400640 1 -- 172.21.15.5:0/1282031220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0ab9d0 con 0x7fd504072c10 2024-08-18T22:27:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 -- 172.21.15.5:0/1282031220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd504072c10 msgr2=0x7fd50406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 --2- 172.21.15.5:0/1282031220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd504072c10 0x7fd50406dad0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009870 tx=0x7fd4ec01c520 comp rx=0 tx=0).stop 2024-08-18T22:27:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 -- 172.21.15.5:0/1282031220 shutdown_connections 2024-08-18T22:27:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 --2- 172.21.15.5:0/1282031220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd504072c10 0x7fd50406dad0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 -- 172.21.15.5:0/1282031220 >> 172.21.15.5:0/1282031220 conn(0x7fd5040b1b00 msgr2=0x7fd5040b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 -- 172.21.15.5:0/1282031220 shutdown_connections 2024-08-18T22:27:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 -- 172.21.15.5:0/1282031220 wait complete. 2024-08-18T22:27:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 Processor -- start 2024-08-18T22:27:28.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 -- start start 2024-08-18T22:27:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd50406f3c0 0x7fd50415faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd504072c10 0x7fd50409b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd50415ade0 0x7fd504154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd5040734c0 con 0x7fd50406f3c0 2024-08-18T22:27:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd5040aecd0 con 0x7fd50415ade0 2024-08-18T22:27:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd503200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd504169560 con 0x7fd504072c10 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd501e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd50406f3c0 0x7fd50415faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd501e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd50406f3c0 0x7fd50415faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53490/0 (socket says 172.21.15.5:53490) 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.124+0000 7fd501e00640 1 -- 172.21.15.5:0/1113598255 learned_addr learned my addr 172.21.15.5:0/1113598255 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd501e00640 1 -- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd504072c10 msgr2=0x7fd50409b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd502800640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd50415ade0 0x7fd504154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd4f9400640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd504072c10 0x7fd50409b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd501e00640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd504072c10 0x7fd50409b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd501e00640 1 -- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd50415ade0 msgr2=0x7fd504154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd501e00640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd50415ade0 0x7fd504154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd501e00640 1 -- 172.21.15.5:0/1113598255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd504141850 con 0x7fd50406f3c0 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd4f9400640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd504072c10 0x7fd50409b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd502800640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd50415ade0 0x7fd504154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd501e00640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd50406f3c0 0x7fd50415faf0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400c4d0 tx=0x7fd4f400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:28.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd4faa00640 1 -- 172.21.15.5:0/1113598255 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4017070 con 0x7fd50406f3c0 2024-08-18T22:27:28.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd4faa00640 1 -- 172.21.15.5:0/1113598255 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f4005480 con 0x7fd50406f3c0 2024-08-18T22:27:28.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd503200640 1 -- 172.21.15.5:0/1113598255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd504141b30 con 0x7fd50406f3c0 2024-08-18T22:27:28.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd4faa00640 1 -- 172.21.15.5:0/1113598255 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4003840 con 0x7fd50406f3c0 2024-08-18T22:27:28.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd503200640 1 -- 172.21.15.5:0/1113598255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5041423d0 con 0x7fd50406f3c0 2024-08-18T22:27:28.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd503200640 1 -- 172.21.15.5:0/1113598255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd504141f20 con 0x7fd50406f3c0 2024-08-18T22:27:28.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd4faa00640 1 -- 172.21.15.5:0/1113598255 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd4f401a070 con 0x7fd50406f3c0 2024-08-18T22:27:28.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd4faa00640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4e00678c0 0x7fd4e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd4faa00640 1 -- 172.21.15.5:0/1113598255 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fd4f4085300 con 0x7fd50406f3c0 2024-08-18T22:27:28.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.128+0000 7fd4f9400640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4e00678c0 0x7fd4e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.132+0000 7fd4f9400640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4e00678c0 0x7fd4e0069d80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0ad000 tx=0x7fd4ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:28.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.132+0000 7fd4faa00640 1 -- 172.21.15.5:0/1113598255 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd4f4055cd0 con 0x7fd50406f3c0 2024-08-18T22:27:28.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 -- 172.21.15.5:0/1113598255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd50406dad0 con 0x7fd50406f3c0 2024-08-18T22:27:28.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd4faa00640 1 -- 172.21.15.5:0/1113598255 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16880 (secure 0 0 0) 0x7fd4f40555d0 con 0x7fd50406f3c0 2024-08-18T22:27:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:28.300 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":129,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:27:25.555095+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:27:21.667014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-08-18T22:27:22.938200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:27:28.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 -- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4e00678c0 msgr2=0x7fd4e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4e00678c0 0x7fd4e0069d80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0ad000 tx=0x7fd4ec008040 comp rx=0 tx=0).stop 2024-08-18T22:27:28.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 -- 172.21.15.5:0/1113598255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd50406f3c0 msgr2=0x7fd50415faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd50406f3c0 0x7fd50415faf0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400c4d0 tx=0x7fd4f400c990 comp rx=0 tx=0).stop 2024-08-18T22:27:28.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 -- 172.21.15.5:0/1113598255 shutdown_connections 2024-08-18T22:27:28.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4e00678c0 0x7fd4e0069d80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd50415ade0 0x7fd504154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd504072c10 0x7fd50409b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 --2- 172.21.15.5:0/1113598255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd50406f3c0 0x7fd50415faf0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 -- 172.21.15.5:0/1113598255 >> 172.21.15.5:0/1113598255 conn(0x7fd5040b1b00 msgr2=0x7fd5040b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:28.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 -- 172.21.15.5:0/1113598255 shutdown_connections 2024-08-18T22:27:28.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.300+0000 7fd503200640 1 -- 172.21.15.5:0/1113598255 wait complete. 2024-08-18T22:27:28.322 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:27:28.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:27:28.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a2ee00640 1 Processor -- start 2024-08-18T22:27:28.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a2ee00640 1 -- start start 2024-08-18T22:27:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a2ee00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a280cb390 0x7f7a280735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a2ee00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7a2806da70 0x7f7a2806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a2ee00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a28073c80 con 0x7f7a2815bed0 2024-08-18T22:27:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a2ee00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7a2806e3e0 con 0x7f7a280cb390 2024-08-18T22:27:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a2ee00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7a280ca5d0 con 0x7f7a2806da70 2024-08-18T22:27:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a27400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a280cb390 0x7f7a280735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a27400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a280cb390 0x7f7a280735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53504/0 (socket says 172.21.15.5:53504) 2024-08-18T22:27:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a27400640 1 -- 172.21.15.5:0/2287880211 learned_addr learned my addr 172.21.15.5:0/2287880211 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:28.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a2ce00640 1 --2- 172.21.15.5:0/2287880211 >> v2:172.21.15.117:3300/0 conn(0x7f7a2806da70 0x7f7a2806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a27400640 1 -- 172.21.15.5:0/2287880211 >> v2:172.21.15.117:3300/0 conn(0x7f7a2806da70 msgr2=0x7f7a2806dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:28.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a27400640 1 --2- 172.21.15.5:0/2287880211 >> v2:172.21.15.117:3300/0 conn(0x7f7a2806da70 0x7f7a2806dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a27400640 1 -- 172.21.15.5:0/2287880211 >> v1:172.21.15.117:6789/0 conn(0x7f7a2815bed0 legacy=0x7f7a28071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.464+0000 7f7a27400640 1 -- 172.21.15.5:0/2287880211 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a280ca8b0 con 0x7f7a280cb390 2024-08-18T22:27:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a27400640 1 --2- 172.21.15.5:0/2287880211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a280cb390 0x7f7a280735a0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f7a280cfe50 tx=0x7f7a1401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd6522197fc3692 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a26a00640 1 -- 172.21.15.5:0/2287880211 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a140aa650 con 0x7f7a280cb390 2024-08-18T22:27:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a26a00640 1 -- 172.21.15.5:0/2287880211 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a140af070 con 0x7f7a280cb390 2024-08-18T22:27:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a26a00640 1 -- 172.21.15.5:0/2287880211 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a140aaa10 con 0x7f7a280cb390 2024-08-18T22:27:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a2ee00640 1 -- 172.21.15.5:0/2287880211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a280cb390 msgr2=0x7f7a280735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a2ee00640 1 --2- 172.21.15.5:0/2287880211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a280cb390 0x7f7a280735a0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f7a280cfe50 tx=0x7f7a1401c4f0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a2ee00640 1 -- 172.21.15.5:0/2287880211 shutdown_connections 2024-08-18T22:27:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a2ee00640 1 --2- 172.21.15.5:0/2287880211 >> v2:172.21.15.117:3300/0 conn(0x7f7a2806da70 0x7f7a2806dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a2ee00640 1 --2- 172.21.15.5:0/2287880211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a280cb390 0x7f7a280735a0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a2ee00640 1 -- 172.21.15.5:0/2287880211 >> 172.21.15.5:0/2287880211 conn(0x7f7a280b1c50 msgr2=0x7f7a280b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a2ee00640 1 -- 172.21.15.5:0/2287880211 shutdown_connections 2024-08-18T22:27:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.468+0000 7f7a2ee00640 1 -- 172.21.15.5:0/2287880211 wait complete. 2024-08-18T22:27:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ee00640 1 Processor -- start 2024-08-18T22:27:28.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ee00640 1 -- start start 2024-08-18T22:27:28.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ee00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a2806da70 0x7f7a28145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ee00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a280cb390 0x7f7a280ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2815bed0 0x7f7a280ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7a28168520 con 0x7f7a2815bed0 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ee00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7a281683a0 con 0x7f7a280cb390 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ee00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7a281686a0 con 0x7f7a2806da70 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2815bed0 0x7f7a280ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2815bed0 0x7f7a280ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53508/0 (socket says 172.21.15.5:53508) 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ce00640 1 -- 172.21.15.5:0/854314296 learned_addr learned my addr 172.21.15.5:0/854314296 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a27e00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a2806da70 0x7f7a28145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a27400640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a280cb390 0x7f7a280ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ce00640 1 -- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a2806da70 msgr2=0x7f7a28145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ce00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a2806da70 0x7f7a28145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ce00640 1 -- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a280cb390 msgr2=0x7f7a280ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ce00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a280cb390 0x7f7a280ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ce00640 1 -- 172.21.15.5:0/854314296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2809d590 con 0x7f7a2815bed0 2024-08-18T22:27:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ce00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2815bed0 0x7f7a280ad910 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000efc0 tx=0x7f7a2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a1fe00640 1 -- 172.21.15.5:0/854314296 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20018020 con 0x7f7a2815bed0 2024-08-18T22:27:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a1fe00640 1 -- 172.21.15.5:0/854314296 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a20014480 con 0x7f7a2815bed0 2024-08-18T22:27:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ee00640 1 -- 172.21.15.5:0/854314296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a2809d870 con 0x7f7a2815bed0 2024-08-18T22:27:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a1fe00640 1 -- 172.21.15.5:0/854314296 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20014870 con 0x7f7a2815bed0 2024-08-18T22:27:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ee00640 1 -- 172.21.15.5:0/854314296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a280b33d0 con 0x7f7a2815bed0 2024-08-18T22:27:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.472+0000 7f7a2ee00640 1 -- 172.21.15.5:0/854314296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a2806dea0 con 0x7f7a2815bed0 2024-08-18T22:27:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.476+0000 7f7a1fe00640 1 -- 172.21.15.5:0/854314296 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a2001b020 con 0x7f7a2815bed0 2024-08-18T22:27:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.476+0000 7f7a1fe00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a080678c0 0x7f7a08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.476+0000 7f7a1fe00640 1 -- 172.21.15.5:0/854314296 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f7a200868d0 con 0x7f7a2815bed0 2024-08-18T22:27:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.476+0000 7f7a27e00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a080678c0 0x7f7a08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.476+0000 7f7a27e00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a080678c0 0x7f7a08069d80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7a18007fd0 tx=0x7f7a18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.480+0000 7f7a1fe00640 1 -- 172.21.15.5:0/854314296 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7a20022070 con 0x7f7a2815bed0 2024-08-18T22:27:28.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.644+0000 7f7a2ee00640 1 -- 172.21.15.5:0/854314296 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a2809da40 con 0x7f7a080678c0 2024-08-18T22:27:28.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.648+0000 7f7a1fe00640 1 -- 172.21.15.5:0/854314296 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248083 (secure 0 0 0) 0x7f7a2809da40 con 0x7f7a080678c0 2024-08-18T22:27:28.652 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:28.654 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:27:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 -- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a080678c0 msgr2=0x7f7a08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a080678c0 0x7f7a08069d80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7a18007fd0 tx=0x7f7a18009040 comp rx=0 tx=0).stop 2024-08-18T22:27:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 -- 172.21.15.5:0/854314296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2815bed0 msgr2=0x7f7a280ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2815bed0 0x7f7a280ad910 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000efc0 tx=0x7f7a2000c490 comp rx=0 tx=0).stop 2024-08-18T22:27:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 -- 172.21.15.5:0/854314296 shutdown_connections 2024-08-18T22:27:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a080678c0 0x7f7a08069d80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a2815bed0 0x7f7a280ad910 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a280cb390 0x7f7a280ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 --2- 172.21.15.5:0/854314296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a2806da70 0x7f7a28145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 -- 172.21.15.5:0/854314296 >> 172.21.15.5:0/854314296 conn(0x7f7a280b1c50 msgr2=0x7f7a280b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:28.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 -- 172.21.15.5:0/854314296 shutdown_connections 2024-08-18T22:27:28.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.652+0000 7f7a2ee00640 1 -- 172.21.15.5:0/854314296 wait complete. 2024-08-18T22:27:28.673 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-08-18T22:27:27.740585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":378072,"kb_used_data":13424,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754596648,"statfs":{"total":773094113280,"available":772706967552,"internally_reserved":0,"allocated":13746176,"data_stored":7076579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.220077"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.562162+0000","last_change":"2024-08-18T22:27:24.555768+0000","last_active":"2024-08-18T22:27:24.562162+0000","last_peered":"2024-08-18T22:27:24.562162+0000","last_clean":"2024-08-18T22:27:24.562162+0000","last_became_active":"2024-08-18T22:27:24.555457+0000","last_became_peered":"2024-08-18T22:27:24.555457+0000","last_unstale":"2024-08-18T22:27:24.562162+0000","last_undegraded":"2024-08-18T22:27:24.562162+0000","last_fullsized":"2024-08-18T22:27:24.562162+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:42.103828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538940+0000","last_change":"2024-08-18T22:27:23.538940+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538940+0000","last_undegraded":"2024-08-18T22:27:23.538940+0000","last_fullsized":"2024-08-18T22:27:23.538940+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537621+0000","last_change":"2024-08-18T22:27:23.537621+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537621+0000","last_undegraded":"2024-08-18T22:27:23.537621+0000","last_fullsized":"2024-08-18T22:27:23.537621+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530993+0000","last_change":"2024-08-18T22:27:23.530993+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530993+0000","last_undegraded":"2024-08-18T22:27:23.530993+0000","last_fullsized":"2024-08-18T22:27:23.530993+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.574253+0000","last_change":"2024-08-18T22:27:24.566222+0000","last_active":"2024-08-18T22:27:24.574253+0000","last_peered":"2024-08-18T22:27:24.574253+0000","last_clean":"2024-08-18T22:27:24.574253+0000","last_became_active":"2024-08-18T22:27:24.565894+0000","last_became_peered":"2024-08-18T22:27:24.565894+0000","last_unstale":"2024-08-18T22:27:24.574253+0000","last_undegraded":"2024-08-18T22:27:24.574253+0000","last_fullsized":"2024-08-18T22:27:24.574253+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:47.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.544293+0000","last_change":"2024-08-18T22:27:23.544293+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.544293+0000","last_undegraded":"2024-08-18T22:27:23.544293+0000","last_fullsized":"2024-08-18T22:27:23.544293+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.544786+0000","last_change":"2024-08-18T22:27:23.544786+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.544786+0000","last_undegraded":"2024-08-18T22:27:23.544786+0000","last_fullsized":"2024-08-18T22:27:23.544786+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.535383+0000","last_change":"2024-08-18T22:27:23.535383+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.535383+0000","last_undegraded":"2024-08-18T22:27:23.535383+0000","last_fullsized":"2024-08-18T22:27:23.535383+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532994+0000","last_change":"2024-08-18T22:27:23.532994+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532994+0000","last_undegraded":"2024-08-18T22:27:23.532994+0000","last_fullsized":"2024-08-18T22:27:23.532994+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.534184+0000","last_change":"2024-08-18T22:27:23.534184+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.534184+0000","last_undegraded":"2024-08-18T22:27:23.534184+0000","last_fullsized":"2024-08-18T22:27:23.534184+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.581951+0000","last_change":"2024-08-18T22:27:24.577512+0000","last_active":"2024-08-18T22:27:24.581951+0000","last_peered":"2024-08-18T22:27:24.581951+0000","last_clean":"2024-08-18T22:27:24.581951+0000","last_became_active":"2024-08-18T22:27:24.577167+0000","last_became_peered":"2024-08-18T22:27:24.577167+0000","last_unstale":"2024-08-18T22:27:24.581951+0000","last_undegraded":"2024-08-18T22:27:24.581951+0000","last_fullsized":"2024-08-18T22:27:24.581951+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:41:25.724936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.544304+0000","last_change":"2024-08-18T22:27:23.544304+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.544304+0000","last_undegraded":"2024-08-18T22:27:23.544304+0000","last_fullsized":"2024-08-18T22:27:23.544304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537892+0000","last_change":"2024-08-18T22:27:23.537892+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537892+0000","last_undegraded":"2024-08-18T22:27:23.537892+0000","last_fullsized":"2024-08-18T22:27:23.537892+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.542936+0000","last_change":"2024-08-18T22:27:23.542936+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.542936+0000","last_undegraded":"2024-08-18T22:27:23.542936+0000","last_fullsized":"2024-08-18T22:27:23.542936+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.587114+0000","last_change":"2024-08-18T22:27:24.586295+0000","last_active":"2024-08-18T22:27:24.587114+0000","last_peered":"2024-08-18T22:27:24.587114+0000","last_clean":"2024-08-18T22:27:24.587114+0000","last_became_active":"2024-08-18T22:27:24.585876+0000","last_became_peered":"2024-08-18T22:27:24.585876+0000","last_unstale":"2024-08-18T22:27:24.587114+0000","last_undegraded":"2024-08-18T22:27:24.587114+0000","last_fullsized":"2024-08-18T22:27:24.587114+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:06:20.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541489+0000","last_change":"2024-08-18T22:27:23.541489+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541489+0000","last_undegraded":"2024-08-18T22:27:23.541489+0000","last_fullsized":"2024-08-18T22:27:23.541489+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533559+0000","last_change":"2024-08-18T22:27:23.533559+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533559+0000","last_undegraded":"2024-08-18T22:27:23.533559+0000","last_fullsized":"2024-08-18T22:27:23.533559+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538539+0000","last_change":"2024-08-18T22:27:23.538539+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538539+0000","last_undegraded":"2024-08-18T22:27:23.538539+0000","last_fullsized":"2024-08-18T22:27:23.538539+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.531879+0000","last_change":"2024-08-18T22:27:23.531879+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.531879+0000","last_undegraded":"2024-08-18T22:27:23.531879+0000","last_fullsized":"2024-08-18T22:27:23.531879+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.576321+0000","last_change":"2024-08-18T22:27:24.572897+0000","last_active":"2024-08-18T22:27:24.576321+0000","last_peered":"2024-08-18T22:27:24.576321+0000","last_clean":"2024-08-18T22:27:24.576321+0000","last_became_active":"2024-08-18T22:27:24.572530+0000","last_became_peered":"2024-08-18T22:27:24.572530+0000","last_unstale":"2024-08-18T22:27:24.576321+0000","last_undegraded":"2024-08-18T22:27:24.576321+0000","last_fullsized":"2024-08-18T22:27:24.576321+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:30:27.384406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532332+0000","last_change":"2024-08-18T22:27:23.532332+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532332+0000","last_undegraded":"2024-08-18T22:27:23.532332+0000","last_fullsized":"2024-08-18T22:27:23.532332+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.572238+0000","last_change":"2024-08-18T22:27:24.560726+0000","last_active":"2024-08-18T22:27:24.572238+0000","last_peered":"2024-08-18T22:27:24.572238+0000","last_clean":"2024-08-18T22:27:24.572238+0000","last_became_active":"2024-08-18T22:27:24.560454+0000","last_became_peered":"2024-08-18T22:27:24.560454+0000","last_unstale":"2024-08-18T22:27:24.572238+0000","last_undegraded":"2024-08-18T22:27:24.572238+0000","last_fullsized":"2024-08-18T22:27:24.572238+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:34.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533002+0000","last_change":"2024-08-18T22:27:23.533002+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533002+0000","last_undegraded":"2024-08-18T22:27:23.533002+0000","last_fullsized":"2024-08-18T22:27:23.533002+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538758+0000","last_change":"2024-08-18T22:27:23.538758+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538758+0000","last_undegraded":"2024-08-18T22:27:23.538758+0000","last_fullsized":"2024-08-18T22:27:23.538758+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540721+0000","last_change":"2024-08-18T22:27:23.540721+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540721+0000","last_undegraded":"2024-08-18T22:27:23.540721+0000","last_fullsized":"2024-08-18T22:27:23.540721+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570882+0000","last_change":"2024-08-18T22:27:24.567510+0000","last_active":"2024-08-18T22:27:24.570882+0000","last_peered":"2024-08-18T22:27:24.570882+0000","last_clean":"2024-08-18T22:27:24.570882+0000","last_became_active":"2024-08-18T22:27:24.565899+0000","last_became_peered":"2024-08-18T22:27:24.565899+0000","last_unstale":"2024-08-18T22:27:24.570882+0000","last_undegraded":"2024-08-18T22:27:24.570882+0000","last_fullsized":"2024-08-18T22:27:24.570882+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:11.259055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530226+0000","last_change":"2024-08-18T22:27:23.530226+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530226+0000","last_undegraded":"2024-08-18T22:27:23.530226+0000","last_fullsized":"2024-08-18T22:27:23.530226+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.539759+0000","last_change":"2024-08-18T22:27:23.539759+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.539759+0000","last_undegraded":"2024-08-18T22:27:23.539759+0000","last_fullsized":"2024-08-18T22:27:23.539759+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570845+0000","last_change":"2024-08-18T22:27:24.569829+0000","last_active":"2024-08-18T22:27:24.570845+0000","last_peered":"2024-08-18T22:27:24.570845+0000","last_clean":"2024-08-18T22:27:24.570845+0000","last_became_active":"2024-08-18T22:27:24.569543+0000","last_became_peered":"2024-08-18T22:27:24.569543+0000","last_unstale":"2024-08-18T22:27:24.570845+0000","last_undegraded":"2024-08-18T22:27:24.570845+0000","last_fullsized":"2024-08-18T22:27:24.570845+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:02.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537507+0000","last_change":"2024-08-18T22:27:23.537507+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537507+0000","last_undegraded":"2024-08-18T22:27:23.537507+0000","last_fullsized":"2024-08-18T22:27:23.537507+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538695+0000","last_change":"2024-08-18T22:27:23.538695+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538695+0000","last_undegraded":"2024-08-18T22:27:23.538695+0000","last_fullsized":"2024-08-18T22:27:23.538695+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538264+0000","last_change":"2024-08-18T22:27:23.538264+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538264+0000","last_undegraded":"2024-08-18T22:27:23.538264+0000","last_fullsized":"2024-08-18T22:27:23.538264+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533281+0000","last_change":"2024-08-18T22:27:23.533281+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533281+0000","last_undegraded":"2024-08-18T22:27:23.533281+0000","last_fullsized":"2024-08-18T22:27:23.533281+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.537770+0000","last_change":"2024-08-18T22:27:23.536418+0000","last_active":"2024-08-18T22:27:23.537770+0000","last_peered":"2024-08-18T22:27:23.537770+0000","last_clean":"2024-08-18T22:27:23.537770+0000","last_became_active":"2024-08-18T22:27:23.536127+0000","last_became_peered":"2024-08-18T22:27:23.536127+0000","last_unstale":"2024-08-18T22:27:23.537770+0000","last_undegraded":"2024-08-18T22:27:23.537770+0000","last_fullsized":"2024-08-18T22:27:23.537770+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:03.786373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.539741+0000","last_change":"2024-08-18T22:27:23.539741+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.539741+0000","last_undegraded":"2024-08-18T22:27:23.539741+0000","last_fullsized":"2024-08-18T22:27:23.539741+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.550328+0000","last_change":"2024-08-18T22:27:23.544340+0000","last_active":"2024-08-18T22:27:23.550328+0000","last_peered":"2024-08-18T22:27:23.550328+0000","last_clean":"2024-08-18T22:27:23.550328+0000","last_became_active":"2024-08-18T22:27:23.543926+0000","last_became_peered":"2024-08-18T22:27:23.543926+0000","last_unstale":"2024-08-18T22:27:23.550328+0000","last_undegraded":"2024-08-18T22:27:23.550328+0000","last_fullsized":"2024-08-18T22:27:23.550328+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:33.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540478+0000","last_change":"2024-08-18T22:27:23.540478+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540478+0000","last_undegraded":"2024-08-18T22:27:23.540478+0000","last_fullsized":"2024-08-18T22:27:23.540478+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551665+0000","last_change":"2024-08-18T22:27:23.544721+0000","last_active":"2024-08-18T22:27:23.551665+0000","last_peered":"2024-08-18T22:27:23.551665+0000","last_clean":"2024-08-18T22:27:23.551665+0000","last_became_active":"2024-08-18T22:27:23.544394+0000","last_became_peered":"2024-08-18T22:27:23.544394+0000","last_unstale":"2024-08-18T22:27:23.551665+0000","last_undegraded":"2024-08-18T22:27:23.551665+0000","last_fullsized":"2024-08-18T22:27:23.551665+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:42.486701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.531968+0000","last_change":"2024-08-18T22:27:23.531968+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.531968+0000","last_undegraded":"2024-08-18T22:27:23.531968+0000","last_fullsized":"2024-08-18T22:27:23.531968+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.550528+0000","last_change":"2024-08-18T22:27:23.547814+0000","last_active":"2024-08-18T22:27:23.550528+0000","last_peered":"2024-08-18T22:27:23.550528+0000","last_clean":"2024-08-18T22:27:23.550528+0000","last_became_active":"2024-08-18T22:27:23.547540+0000","last_became_peered":"2024-08-18T22:27:23.547540+0000","last_unstale":"2024-08-18T22:27:23.550528+0000","last_undegraded":"2024-08-18T22:27:23.550528+0000","last_fullsized":"2024-08-18T22:27:23.550528+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:54.945688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532861+0000","last_change":"2024-08-18T22:27:23.532861+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532861+0000","last_undegraded":"2024-08-18T22:27:23.532861+0000","last_fullsized":"2024-08-18T22:27:23.532861+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.583668+0000","last_change":"2024-08-18T22:27:23.546555+0000","last_active":"2024-08-18T22:27:24.583668+0000","last_peered":"2024-08-18T22:27:24.583668+0000","last_clean":"2024-08-18T22:27:24.583668+0000","last_became_active":"2024-08-18T22:27:23.544681+0000","last_became_peered":"2024-08-18T22:27:23.544681+0000","last_unstale":"2024-08-18T22:27:24.583668+0000","last_undegraded":"2024-08-18T22:27:24.583668+0000","last_fullsized":"2024-08-18T22:27:24.583668+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:57.484511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.569480+0000","last_change":"2024-08-18T22:27:24.559554+0000","last_active":"2024-08-18T22:27:24.569480+0000","last_peered":"2024-08-18T22:27:24.569480+0000","last_clean":"2024-08-18T22:27:24.569480+0000","last_became_active":"2024-08-18T22:27:24.559262+0000","last_became_peered":"2024-08-18T22:27:24.559262+0000","last_unstale":"2024-08-18T22:27:24.569480+0000","last_undegraded":"2024-08-18T22:27:24.569480+0000","last_fullsized":"2024-08-18T22:27:24.569480+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:36.984658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556274+0000","last_change":"2024-08-18T22:27:23.553332+0000","last_active":"2024-08-18T22:27:23.556274+0000","last_peered":"2024-08-18T22:27:23.556274+0000","last_clean":"2024-08-18T22:27:23.556274+0000","last_became_active":"2024-08-18T22:27:23.550173+0000","last_became_peered":"2024-08-18T22:27:23.550173+0000","last_unstale":"2024-08-18T22:27:23.556274+0000","last_undegraded":"2024-08-18T22:27:23.556274+0000","last_fullsized":"2024-08-18T22:27:23.556274+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:02.994973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537101+0000","last_change":"2024-08-18T22:27:23.537101+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537101+0000","last_undegraded":"2024-08-18T22:27:23.537101+0000","last_fullsized":"2024-08-18T22:27:23.537101+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.549080+0000","last_change":"2024-08-18T22:27:23.544298+0000","last_active":"2024-08-18T22:27:23.549080+0000","last_peered":"2024-08-18T22:27:23.549080+0000","last_clean":"2024-08-18T22:27:23.549080+0000","last_became_active":"2024-08-18T22:27:23.543996+0000","last_became_peered":"2024-08-18T22:27:23.543996+0000","last_unstale":"2024-08-18T22:27:23.549080+0000","last_undegraded":"2024-08-18T22:27:23.549080+0000","last_fullsized":"2024-08-18T22:27:23.549080+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:03.786373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533962+0000","last_change":"2024-08-18T22:27:23.533962+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533962+0000","last_undegraded":"2024-08-18T22:27:23.533962+0000","last_fullsized":"2024-08-18T22:27:23.533962+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.555766+0000","last_change":"2024-08-18T22:27:23.547406+0000","last_active":"2024-08-18T22:27:23.555766+0000","last_peered":"2024-08-18T22:27:23.555766+0000","last_clean":"2024-08-18T22:27:23.555766+0000","last_became_active":"2024-08-18T22:27:23.547152+0000","last_became_peered":"2024-08-18T22:27:23.547152+0000","last_unstale":"2024-08-18T22:27:23.555766+0000","last_undegraded":"2024-08-18T22:27:23.555766+0000","last_fullsized":"2024-08-18T22:27:23.555766+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:47.679456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530449+0000","last_change":"2024-08-18T22:27:23.530449+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530449+0000","last_undegraded":"2024-08-18T22:27:23.530449+0000","last_fullsized":"2024-08-18T22:27:23.530449+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.541235+0000","last_change":"2024-08-18T22:27:23.538603+0000","last_active":"2024-08-18T22:27:23.541235+0000","last_peered":"2024-08-18T22:27:23.541235+0000","last_clean":"2024-08-18T22:27:23.541235+0000","last_became_active":"2024-08-18T22:27:23.538343+0000","last_became_peered":"2024-08-18T22:27:23.538343+0000","last_unstale":"2024-08-18T22:27:23.541235+0000","last_undegraded":"2024-08-18T22:27:23.541235+0000","last_fullsized":"2024-08-18T22:27:23.541235+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:52.763753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540469+0000","last_change":"2024-08-18T22:27:23.540469+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540469+0000","last_undegraded":"2024-08-18T22:27:23.540469+0000","last_fullsized":"2024-08-18T22:27:23.540469+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551913+0000","last_change":"2024-08-18T22:27:23.548166+0000","last_active":"2024-08-18T22:27:23.551913+0000","last_peered":"2024-08-18T22:27:23.551913+0000","last_clean":"2024-08-18T22:27:23.551913+0000","last_became_active":"2024-08-18T22:27:23.547899+0000","last_became_peered":"2024-08-18T22:27:23.547899+0000","last_unstale":"2024-08-18T22:27:23.551913+0000","last_undegraded":"2024-08-18T22:27:23.551913+0000","last_fullsized":"2024-08-18T22:27:23.551913+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:52.763753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538116+0000","last_change":"2024-08-18T22:27:23.538116+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538116+0000","last_undegraded":"2024-08-18T22:27:23.538116+0000","last_fullsized":"2024-08-18T22:27:23.538116+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.554849+0000","last_change":"2024-08-18T22:27:23.549127+0000","last_active":"2024-08-18T22:27:23.554849+0000","last_peered":"2024-08-18T22:27:23.554849+0000","last_clean":"2024-08-18T22:27:23.554849+0000","last_became_active":"2024-08-18T22:27:23.548778+0000","last_became_peered":"2024-08-18T22:27:23.548778+0000","last_unstale":"2024-08-18T22:27:23.554849+0000","last_undegraded":"2024-08-18T22:27:23.554849+0000","last_fullsized":"2024-08-18T22:27:23.554849+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:42.031794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540281+0000","last_change":"2024-08-18T22:27:23.540281+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540281+0000","last_undegraded":"2024-08-18T22:27:23.540281+0000","last_fullsized":"2024-08-18T22:27:23.540281+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.552961+0000","last_change":"2024-08-18T22:27:23.551420+0000","last_active":"2024-08-18T22:27:23.552961+0000","last_peered":"2024-08-18T22:27:23.552961+0000","last_clean":"2024-08-18T22:27:23.552961+0000","last_became_active":"2024-08-18T22:27:23.551146+0000","last_became_peered":"2024-08-18T22:27:23.551146+0000","last_unstale":"2024-08-18T22:27:23.552961+0000","last_undegraded":"2024-08-18T22:27:23.552961+0000","last_fullsized":"2024-08-18T22:27:23.552961+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:43:04.208784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530192+0000","last_change":"2024-08-18T22:27:23.530192+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530192+0000","last_undegraded":"2024-08-18T22:27:23.530192+0000","last_fullsized":"2024-08-18T22:27:23.530192+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.555448+0000","last_change":"2024-08-18T22:27:23.554557+0000","last_active":"2024-08-18T22:27:23.555448+0000","last_peered":"2024-08-18T22:27:23.555448+0000","last_clean":"2024-08-18T22:27:23.555448+0000","last_became_active":"2024-08-18T22:27:23.554293+0000","last_became_peered":"2024-08-18T22:27:23.554293+0000","last_unstale":"2024-08-18T22:27:23.555448+0000","last_undegraded":"2024-08-18T22:27:23.555448+0000","last_fullsized":"2024-08-18T22:27:23.555448+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:28.147793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532488+0000","last_change":"2024-08-18T22:27:23.532488+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532488+0000","last_undegraded":"2024-08-18T22:27:23.532488+0000","last_fullsized":"2024-08-18T22:27:23.532488+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.553883+0000","last_change":"2024-08-18T22:27:23.552723+0000","last_active":"2024-08-18T22:27:23.553883+0000","last_peered":"2024-08-18T22:27:23.553883+0000","last_clean":"2024-08-18T22:27:23.553883+0000","last_became_active":"2024-08-18T22:27:23.552457+0000","last_became_peered":"2024-08-18T22:27:23.552457+0000","last_unstale":"2024-08-18T22:27:23.553883+0000","last_undegraded":"2024-08-18T22:27:23.553883+0000","last_fullsized":"2024-08-18T22:27:23.553883+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:35.137950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.576445+0000","last_change":"2024-08-18T22:27:24.573855+0000","last_active":"2024-08-18T22:27:24.576445+0000","last_peered":"2024-08-18T22:27:24.576445+0000","last_clean":"2024-08-18T22:27:24.576445+0000","last_became_active":"2024-08-18T22:27:24.573562+0000","last_became_peered":"2024-08-18T22:27:24.573562+0000","last_unstale":"2024-08-18T22:27:24.576445+0000","last_undegraded":"2024-08-18T22:27:24.576445+0000","last_fullsized":"2024-08-18T22:27:24.576445+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:15.654628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.553077+0000","last_change":"2024-08-18T22:27:23.552008+0000","last_active":"2024-08-18T22:27:23.553077+0000","last_peered":"2024-08-18T22:27:23.553077+0000","last_clean":"2024-08-18T22:27:23.553077+0000","last_became_active":"2024-08-18T22:27:23.551740+0000","last_became_peered":"2024-08-18T22:27:23.551740+0000","last_unstale":"2024-08-18T22:27:23.553077+0000","last_undegraded":"2024-08-18T22:27:23.553077+0000","last_fullsized":"2024-08-18T22:27:23.553077+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:18:55.715413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541586+0000","last_change":"2024-08-18T22:27:23.541586+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541586+0000","last_undegraded":"2024-08-18T22:27:23.541586+0000","last_fullsized":"2024-08-18T22:27:23.541586+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.552032+0000","last_change":"2024-08-18T22:27:23.548589+0000","last_active":"2024-08-18T22:27:23.552032+0000","last_peered":"2024-08-18T22:27:23.552032+0000","last_clean":"2024-08-18T22:27:23.552032+0000","last_became_active":"2024-08-18T22:27:23.546800+0000","last_became_peered":"2024-08-18T22:27:23.546800+0000","last_unstale":"2024-08-18T22:27:23.552032+0000","last_undegraded":"2024-08-18T22:27:23.552032+0000","last_fullsized":"2024-08-18T22:27:23.552032+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:03:19.347344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570084+0000","last_change":"2024-08-18T22:27:24.560518+0000","last_active":"2024-08-18T22:27:24.570084+0000","last_peered":"2024-08-18T22:27:24.570084+0000","last_clean":"2024-08-18T22:27:24.570084+0000","last_became_active":"2024-08-18T22:27:24.560227+0000","last_became_peered":"2024-08-18T22:27:24.560227+0000","last_unstale":"2024-08-18T22:27:24.570084+0000","last_undegraded":"2024-08-18T22:27:24.570084+0000","last_fullsized":"2024-08-18T22:27:24.570084+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:16.308159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.582468+0000","last_change":"2024-08-18T22:27:23.545359+0000","last_active":"2024-08-18T22:27:24.582468+0000","last_peered":"2024-08-18T22:27:24.582468+0000","last_clean":"2024-08-18T22:27:24.582468+0000","last_became_active":"2024-08-18T22:27:23.545080+0000","last_became_peered":"2024-08-18T22:27:23.545080+0000","last_unstale":"2024-08-18T22:27:24.582468+0000","last_undegraded":"2024-08-18T22:27:24.582468+0000","last_fullsized":"2024-08-18T22:27:24.582468+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:05:03.331984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.535471+0000","last_change":"2024-08-18T22:27:23.535471+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.535471+0000","last_undegraded":"2024-08-18T22:27:23.535471+0000","last_fullsized":"2024-08-18T22:27:23.535471+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551886+0000","last_change":"2024-08-18T22:27:23.546608+0000","last_active":"2024-08-18T22:27:23.551886+0000","last_peered":"2024-08-18T22:27:23.551886+0000","last_clean":"2024-08-18T22:27:23.551886+0000","last_became_active":"2024-08-18T22:27:23.546365+0000","last_became_peered":"2024-08-18T22:27:23.546365+0000","last_unstale":"2024-08-18T22:27:23.551886+0000","last_undegraded":"2024-08-18T22:27:23.551886+0000","last_fullsized":"2024-08-18T22:27:23.551886+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:32.512213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.539776+0000","last_change":"2024-08-18T22:27:23.539776+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.539776+0000","last_undegraded":"2024-08-18T22:27:23.539776+0000","last_fullsized":"2024-08-18T22:27:23.539776+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.545115+0000","last_change":"2024-08-18T22:27:23.542231+0000","last_active":"2024-08-18T22:27:23.545115+0000","last_peered":"2024-08-18T22:27:23.545115+0000","last_clean":"2024-08-18T22:27:23.545115+0000","last_became_active":"2024-08-18T22:27:23.541939+0000","last_became_peered":"2024-08-18T22:27:23.541939+0000","last_unstale":"2024-08-18T22:27:23.545115+0000","last_undegraded":"2024-08-18T22:27:23.545115+0000","last_fullsized":"2024-08-18T22:27:23.545115+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:42.031794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.534771+0000","last_change":"2024-08-18T22:27:23.534771+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.534771+0000","last_undegraded":"2024-08-18T22:27:23.534771+0000","last_fullsized":"2024-08-18T22:27:23.534771+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.555480+0000","last_change":"2024-08-18T22:27:23.545503+0000","last_active":"2024-08-18T22:27:23.555480+0000","last_peered":"2024-08-18T22:27:23.555480+0000","last_clean":"2024-08-18T22:27:23.555480+0000","last_became_active":"2024-08-18T22:27:23.545228+0000","last_became_peered":"2024-08-18T22:27:23.545228+0000","last_unstale":"2024-08-18T22:27:23.555480+0000","last_undegraded":"2024-08-18T22:27:23.555480+0000","last_fullsized":"2024-08-18T22:27:23.555480+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.677848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541397+0000","last_change":"2024-08-18T22:27:23.541397+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541397+0000","last_undegraded":"2024-08-18T22:27:23.541397+0000","last_fullsized":"2024-08-18T22:27:23.541397+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.541051+0000","last_change":"2024-08-18T22:27:23.539599+0000","last_active":"2024-08-18T22:27:23.541051+0000","last_peered":"2024-08-18T22:27:23.541051+0000","last_clean":"2024-08-18T22:27:23.541051+0000","last_became_active":"2024-08-18T22:27:23.539322+0000","last_became_peered":"2024-08-18T22:27:23.539322+0000","last_unstale":"2024-08-18T22:27:23.541051+0000","last_undegraded":"2024-08-18T22:27:23.541051+0000","last_fullsized":"2024-08-18T22:27:23.541051+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:52.763753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.536728+0000","last_change":"2024-08-18T22:27:23.536728+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.536728+0000","last_undegraded":"2024-08-18T22:27:23.536728+0000","last_fullsized":"2024-08-18T22:27:23.536728+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.548225+0000","last_change":"2024-08-18T22:27:23.544336+0000","last_active":"2024-08-18T22:27:23.548225+0000","last_peered":"2024-08-18T22:27:23.548225+0000","last_clean":"2024-08-18T22:27:23.548225+0000","last_became_active":"2024-08-18T22:27:23.544058+0000","last_became_peered":"2024-08-18T22:27:23.544058+0000","last_unstale":"2024-08-18T22:27:23.548225+0000","last_undegraded":"2024-08-18T22:27:23.548225+0000","last_fullsized":"2024-08-18T22:27:23.548225+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:21.461235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541359+0000","last_change":"2024-08-18T22:27:23.541359+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541359+0000","last_undegraded":"2024-08-18T22:27:23.541359+0000","last_fullsized":"2024-08-18T22:27:23.541359+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551988+0000","last_change":"2024-08-18T22:27:23.547090+0000","last_active":"2024-08-18T22:27:23.551988+0000","last_peered":"2024-08-18T22:27:23.551988+0000","last_clean":"2024-08-18T22:27:23.551988+0000","last_became_active":"2024-08-18T22:27:23.546820+0000","last_became_peered":"2024-08-18T22:27:23.546820+0000","last_unstale":"2024-08-18T22:27:23.551988+0000","last_undegraded":"2024-08-18T22:27:23.551988+0000","last_fullsized":"2024-08-18T22:27:23.551988+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:50.977899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533300+0000","last_change":"2024-08-18T22:27:23.533300+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533300+0000","last_undegraded":"2024-08-18T22:27:23.533300+0000","last_fullsized":"2024-08-18T22:27:23.533300+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556194+0000","last_change":"2024-08-18T22:27:23.551796+0000","last_active":"2024-08-18T22:27:23.556194+0000","last_peered":"2024-08-18T22:27:23.556194+0000","last_clean":"2024-08-18T22:27:23.556194+0000","last_became_active":"2024-08-18T22:27:23.551536+0000","last_became_peered":"2024-08-18T22:27:23.551536+0000","last_unstale":"2024-08-18T22:27:23.556194+0000","last_undegraded":"2024-08-18T22:27:23.556194+0000","last_fullsized":"2024-08-18T22:27:23.556194+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:25.201562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532481+0000","last_change":"2024-08-18T22:27:23.532481+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532481+0000","last_undegraded":"2024-08-18T22:27:23.532481+0000","last_fullsized":"2024-08-18T22:27:23.532481+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.549202+0000","last_change":"2024-08-18T22:27:23.547122+0000","last_active":"2024-08-18T22:27:23.549202+0000","last_peered":"2024-08-18T22:27:23.549202+0000","last_clean":"2024-08-18T22:27:23.549202+0000","last_became_active":"2024-08-18T22:27:23.546628+0000","last_became_peered":"2024-08-18T22:27:23.546628+0000","last_unstale":"2024-08-18T22:27:23.549202+0000","last_undegraded":"2024-08-18T22:27:23.549202+0000","last_fullsized":"2024-08-18T22:27:23.549202+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:42.486701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533486+0000","last_change":"2024-08-18T22:27:23.533486+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533486+0000","last_undegraded":"2024-08-18T22:27:23.533486+0000","last_fullsized":"2024-08-18T22:27:23.533486+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.541267+0000","last_change":"2024-08-18T22:27:23.539274+0000","last_active":"2024-08-18T22:27:23.541267+0000","last_peered":"2024-08-18T22:27:23.541267+0000","last_clean":"2024-08-18T22:27:23.541267+0000","last_became_active":"2024-08-18T22:27:23.538927+0000","last_became_peered":"2024-08-18T22:27:23.538927+0000","last_unstale":"2024-08-18T22:27:23.541267+0000","last_undegraded":"2024-08-18T22:27:23.541267+0000","last_fullsized":"2024-08-18T22:27:23.541267+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:42.031794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.588902+0000","last_change":"2024-08-18T22:27:24.588134+0000","last_active":"2024-08-18T22:27:24.588902+0000","last_peered":"2024-08-18T22:27:24.588902+0000","last_clean":"2024-08-18T22:27:24.588902+0000","last_became_active":"2024-08-18T22:27:24.587781+0000","last_became_peered":"2024-08-18T22:27:24.587781+0000","last_unstale":"2024-08-18T22:27:24.588902+0000","last_undegraded":"2024-08-18T22:27:24.588902+0000","last_fullsized":"2024-08-18T22:27:24.588902+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:34.370960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556100+0000","last_change":"2024-08-18T22:27:23.549252+0000","last_active":"2024-08-18T22:27:23.556100+0000","last_peered":"2024-08-18T22:27:23.556100+0000","last_clean":"2024-08-18T22:27:23.556100+0000","last_became_active":"2024-08-18T22:27:23.548968+0000","last_became_peered":"2024-08-18T22:27:23.548968+0000","last_unstale":"2024-08-18T22:27:23.556100+0000","last_undegraded":"2024-08-18T22:27:23.556100+0000","last_fullsized":"2024-08-18T22:27:23.556100+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:31.597239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.534325+0000","last_change":"2024-08-18T22:27:23.534325+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.534325+0000","last_undegraded":"2024-08-18T22:27:23.534325+0000","last_fullsized":"2024-08-18T22:27:23.534325+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.549661+0000","last_change":"2024-08-18T22:27:23.550306+0000","last_active":"2024-08-18T22:27:24.549661+0000","last_peered":"2024-08-18T22:27:24.549661+0000","last_clean":"2024-08-18T22:27:24.549661+0000","last_became_active":"2024-08-18T22:27:23.549975+0000","last_became_peered":"2024-08-18T22:27:23.549975+0000","last_unstale":"2024-08-18T22:27:24.549661+0000","last_undegraded":"2024-08-18T22:27:24.549661+0000","last_fullsized":"2024-08-18T22:27:24.549661+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:01:11.437061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540847+0000","last_change":"2024-08-18T22:27:23.540847+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540847+0000","last_undegraded":"2024-08-18T22:27:23.540847+0000","last_fullsized":"2024-08-18T22:27:23.540847+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.548932+0000","last_change":"2024-08-18T22:27:23.545190+0000","last_active":"2024-08-18T22:27:24.548932+0000","last_peered":"2024-08-18T22:27:24.548932+0000","last_clean":"2024-08-18T22:27:24.548932+0000","last_became_active":"2024-08-18T22:27:23.544813+0000","last_became_peered":"2024-08-18T22:27:23.544813+0000","last_unstale":"2024-08-18T22:27:24.548932+0000","last_undegraded":"2024-08-18T22:27:24.548932+0000","last_fullsized":"2024-08-18T22:27:24.548932+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:53.358060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530918+0000","last_change":"2024-08-18T22:27:23.530918+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530918+0000","last_undegraded":"2024-08-18T22:27:23.530918+0000","last_fullsized":"2024-08-18T22:27:23.530918+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556254+0000","last_change":"2024-08-18T22:27:23.553339+0000","last_active":"2024-08-18T22:27:23.556254+0000","last_peered":"2024-08-18T22:27:23.556254+0000","last_clean":"2024-08-18T22:27:23.556254+0000","last_became_active":"2024-08-18T22:27:23.548574+0000","last_became_peered":"2024-08-18T22:27:23.548574+0000","last_unstale":"2024-08-18T22:27:23.556254+0000","last_undegraded":"2024-08-18T22:27:23.556254+0000","last_fullsized":"2024-08-18T22:27:23.556254+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:32.032718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.531793+0000","last_change":"2024-08-18T22:27:23.531793+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.531793+0000","last_undegraded":"2024-08-18T22:27:23.531793+0000","last_fullsized":"2024-08-18T22:27:23.531793+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.540628+0000","last_change":"2024-08-18T22:27:23.536731+0000","last_active":"2024-08-18T22:27:23.540628+0000","last_peered":"2024-08-18T22:27:23.540628+0000","last_clean":"2024-08-18T22:27:23.540628+0000","last_became_active":"2024-08-18T22:27:23.536418+0000","last_became_peered":"2024-08-18T22:27:23.536418+0000","last_unstale":"2024-08-18T22:27:23.540628+0000","last_undegraded":"2024-08-18T22:27:23.540628+0000","last_fullsized":"2024-08-18T22:27:23.540628+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:03.786373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530872+0000","last_change":"2024-08-18T22:27:23.530872+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530872+0000","last_undegraded":"2024-08-18T22:27:23.530872+0000","last_fullsized":"2024-08-18T22:27:23.530872+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.554404+0000","last_change":"2024-08-18T22:27:23.553624+0000","last_active":"2024-08-18T22:27:23.554404+0000","last_peered":"2024-08-18T22:27:23.554404+0000","last_clean":"2024-08-18T22:27:23.554404+0000","last_became_active":"2024-08-18T22:27:23.553355+0000","last_became_peered":"2024-08-18T22:27:23.553355+0000","last_unstale":"2024-08-18T22:27:23.554404+0000","last_undegraded":"2024-08-18T22:27:23.554404+0000","last_fullsized":"2024-08-18T22:27:23.554404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:15.048010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":386,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.531668+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:27:23.531668+0000","last_peered":"2024-08-18T22:27:23.531668+0000","last_clean":"2024-08-18T22:27:23.531668+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:27:23.531668+0000","last_undegraded":"2024-08-18T22:27:23.531668+0000","last_fullsized":"2024-08-18T22:27:23.531668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41604,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330236,"statfs":{"total":96636764160,"available":96594161664,"internally_reserved":0,"allocated":2154496,"data_stored":1322855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509544,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41024,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330816,"statfs":{"total":96636764160,"available":96594755584,"internally_reserved":0,"allocated":1560576,"data_stored":732487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41024,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330816,"statfs":{"total":96636764160,"available":96594755584,"internally_reserved":0,"allocated":1560576,"data_stored":732487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509543,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50752,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321088,"statfs":{"total":96636764160,"available":96584794112,"internally_reserved":0,"allocated":1560576,"data_stored":732487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50768,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321072,"statfs":{"total":96636764160,"available":96584777728,"internally_reserved":0,"allocated":1572864,"data_stored":739154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51332,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320508,"statfs":{"total":96636764160,"available":96584200192,"internally_reserved":0,"allocated":2154496,"data_stored":1322855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50788,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321052,"statfs":{"total":96636764160,"available":96584757248,"internally_reserved":0,"allocated":1597440,"data_stored":747933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574951,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50780,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321060,"statfs":{"total":96636764160,"available":96584765440,"internally_reserved":0,"allocated":1585152,"data_stored":746321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:27:28.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:27:28.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.856+0000 7f9650200640 1 Processor -- start 2024-08-18T22:27:28.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.856+0000 7f9650200640 1 -- start start 2024-08-18T22:27:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f9650200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f964815c180 0x7f96480b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f9650200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9648071c90 0x7f964815c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f9650200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96480b5e30 con 0x7f964806fad0 2024-08-18T22:27:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f9650200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f964815caa0 con 0x7f9648071c90 2024-08-18T22:27:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f9650200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f96480b6110 con 0x7f964815c180 2024-08-18T22:27:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f964e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9648071c90 0x7f964815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f964ce00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f964806fad0 0x7f9648071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53122/0 (socket says 172.21.15.5:53122) 2024-08-18T22:27:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f964ce00640 1 -- 172.21.15.5:0/3749803798 learned_addr learned my addr 172.21.15.5:0/3749803798 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f964d800640 1 --2- 172.21.15.5:0/3749803798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f964815c180 0x7f96480b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f964e200640 1 -- 172.21.15.5:0/3749803798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f964815c180 msgr2=0x7f96480b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f964e200640 1 --2- 172.21.15.5:0/3749803798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f964815c180 0x7f96480b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f964e200640 1 -- 172.21.15.5:0/3749803798 >> v1:172.21.15.5:6789/0 conn(0x7f964806fad0 legacy=0x7f9648071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f964e200640 1 -- 172.21.15.5:0/3749803798 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96480b63f0 con 0x7f9648071c90 2024-08-18T22:27:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.860+0000 7f9647e00640 1 -- 172.21.15.5:0/3749803798 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3234922541 0 0) 0x7f96480b5e30 con 0x7f964806fad0 2024-08-18T22:27:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f964e200640 1 --2- 172.21.15.5:0/3749803798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9648071c90 0x7f964815c560 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f9640009d90 tx=0x7f964001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac43cbfc7d03d05 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9647e00640 1 -- 172.21.15.5:0/3749803798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96400b2070 con 0x7f9648071c90 2024-08-18T22:27:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9647e00640 1 -- 172.21.15.5:0/3749803798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96400a58a0 con 0x7f9648071c90 2024-08-18T22:27:28.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9647e00640 1 -- 172.21.15.5:0/3749803798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96400a5c70 con 0x7f9648071c90 2024-08-18T22:27:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9650200640 1 -- 172.21.15.5:0/3749803798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9648071c90 msgr2=0x7f964815c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9650200640 1 --2- 172.21.15.5:0/3749803798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9648071c90 0x7f964815c560 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f9640009d90 tx=0x7f964001c820 comp rx=0 tx=0).stop 2024-08-18T22:27:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9650200640 1 -- 172.21.15.5:0/3749803798 shutdown_connections 2024-08-18T22:27:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9650200640 1 --2- 172.21.15.5:0/3749803798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9648071c90 0x7f964815c560 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9650200640 1 --2- 172.21.15.5:0/3749803798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f964815c180 0x7f96480b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9650200640 1 -- 172.21.15.5:0/3749803798 >> 172.21.15.5:0/3749803798 conn(0x7f96480b3eb0 msgr2=0x7f96480b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:28.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9650200640 1 -- 172.21.15.5:0/3749803798 shutdown_connections 2024-08-18T22:27:28.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9650200640 1 -- 172.21.15.5:0/3749803798 wait complete. 2024-08-18T22:27:28.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9650200640 1 Processor -- start 2024-08-18T22:27:28.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.864+0000 7f9650200640 1 -- start start 2024-08-18T22:27:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9650200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f964806fad0 0x7f964814b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9650200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9648071c90 0x7f964814a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9650200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964815c180 0x7f964814aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9650200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f96480d1c30 con 0x7f964815c180 2024-08-18T22:27:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9650200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96480d1ab0 con 0x7f964806fad0 2024-08-18T22:27:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9650200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f96480d1db0 con 0x7f9648071c90 2024-08-18T22:27:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964815c180 0x7f964814aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964815c180 0x7f964814aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53522/0 (socket says 172.21.15.5:53522) 2024-08-18T22:27:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964e200640 1 -- 172.21.15.5:0/3579236849 learned_addr learned my addr 172.21.15.5:0/3579236849 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964d800640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f964806fad0 0x7f964814b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964ce00640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9648071c90 0x7f964814a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964e200640 1 -- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9648071c90 msgr2=0x7f964814a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964e200640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9648071c90 0x7f964814a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964e200640 1 -- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f964806fad0 msgr2=0x7f964814b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964e200640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f964806fad0 0x7f964814b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964e200640 1 -- 172.21.15.5:0/3579236849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964814e1e0 con 0x7f964815c180 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964d800640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f964806fad0 0x7f964814b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f964e200640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964815c180 0x7f964814aee0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f96400b0040 tx=0x7f96400195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9645600640 1 -- 172.21.15.5:0/3579236849 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96400bd020 con 0x7f964815c180 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9645600640 1 -- 172.21.15.5:0/3579236849 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96400b8670 con 0x7f964815c180 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9645600640 1 -- 172.21.15.5:0/3579236849 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96400b2040 con 0x7f964815c180 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9650200640 1 -- 172.21.15.5:0/3579236849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964814e460 con 0x7f964815c180 2024-08-18T22:27:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9650200640 1 -- 172.21.15.5:0/3579236849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964814ea20 con 0x7f964815c180 2024-08-18T22:27:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9650200640 1 -- 172.21.15.5:0/3579236849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96480cf7d0 con 0x7f964815c180 2024-08-18T22:27:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.868+0000 7f9645600640 1 -- 172.21.15.5:0/3579236849 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96400c0020 con 0x7f964815c180 2024-08-18T22:27:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.872+0000 7f9645600640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96280678c0 0x7f9628069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.872+0000 7f9645600640 1 -- 172.21.15.5:0/3579236849 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f9640120e60 con 0x7f964815c180 2024-08-18T22:27:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.872+0000 7f964d800640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96280678c0 0x7f9628069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:28.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.872+0000 7f964d800640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96280678c0 0x7f9628069d80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f963c00b9f0 tx=0x7f963c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:28.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:28.876+0000 7f9645600640 1 -- 172.21.15.5:0/3579236849 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f96400c7030 con 0x7f964815c180 2024-08-18T22:27:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.036+0000 7f9650200640 1 -- 172.21.15.5:0/3579236849 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f96480725e0 con 0x7f96280678c0 2024-08-18T22:27:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.044+0000 7f9645600640 1 -- 172.21.15.5:0/3579236849 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248083 (secure 0 0 0) 0x7f96480725e0 con 0x7f96280678c0 2024-08-18T22:27:29.046 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:29.048 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:27:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 -- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96280678c0 msgr2=0x7f9628069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96280678c0 0x7f9628069d80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f963c00b9f0 tx=0x7f963c008040 comp rx=0 tx=0).stop 2024-08-18T22:27:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 -- 172.21.15.5:0/3579236849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964815c180 msgr2=0x7f964814aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964815c180 0x7f964814aee0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f96400b0040 tx=0x7f96400195c0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 -- 172.21.15.5:0/3579236849 shutdown_connections 2024-08-18T22:27:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96280678c0 0x7f9628069d80 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f964815c180 0x7f964814aee0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9648071c90 0x7f964814a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 --2- 172.21.15.5:0/3579236849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f964806fad0 0x7f964814b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 -- 172.21.15.5:0/3579236849 >> 172.21.15.5:0/3579236849 conn(0x7f96480b3eb0 msgr2=0x7f96480b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 -- 172.21.15.5:0/3579236849 shutdown_connections 2024-08-18T22:27:29.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.048+0000 7f9650200640 1 -- 172.21.15.5:0/3579236849 wait complete. 2024-08-18T22:27:29.067 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-08-18T22:27:27.740585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":378072,"kb_used_data":13424,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754596648,"statfs":{"total":773094113280,"available":772706967552,"internally_reserved":0,"allocated":13746176,"data_stored":7076579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.220077"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.562162+0000","last_change":"2024-08-18T22:27:24.555768+0000","last_active":"2024-08-18T22:27:24.562162+0000","last_peered":"2024-08-18T22:27:24.562162+0000","last_clean":"2024-08-18T22:27:24.562162+0000","last_became_active":"2024-08-18T22:27:24.555457+0000","last_became_peered":"2024-08-18T22:27:24.555457+0000","last_unstale":"2024-08-18T22:27:24.562162+0000","last_undegraded":"2024-08-18T22:27:24.562162+0000","last_fullsized":"2024-08-18T22:27:24.562162+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:42.103828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538940+0000","last_change":"2024-08-18T22:27:23.538940+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538940+0000","last_undegraded":"2024-08-18T22:27:23.538940+0000","last_fullsized":"2024-08-18T22:27:23.538940+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537621+0000","last_change":"2024-08-18T22:27:23.537621+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537621+0000","last_undegraded":"2024-08-18T22:27:23.537621+0000","last_fullsized":"2024-08-18T22:27:23.537621+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530993+0000","last_change":"2024-08-18T22:27:23.530993+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530993+0000","last_undegraded":"2024-08-18T22:27:23.530993+0000","last_fullsized":"2024-08-18T22:27:23.530993+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.574253+0000","last_change":"2024-08-18T22:27:24.566222+0000","last_active":"2024-08-18T22:27:24.574253+0000","last_peered":"2024-08-18T22:27:24.574253+0000","last_clean":"2024-08-18T22:27:24.574253+0000","last_became_active":"2024-08-18T22:27:24.565894+0000","last_became_peered":"2024-08-18T22:27:24.565894+0000","last_unstale":"2024-08-18T22:27:24.574253+0000","last_undegraded":"2024-08-18T22:27:24.574253+0000","last_fullsized":"2024-08-18T22:27:24.574253+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:47.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.544293+0000","last_change":"2024-08-18T22:27:23.544293+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.544293+0000","last_undegraded":"2024-08-18T22:27:23.544293+0000","last_fullsized":"2024-08-18T22:27:23.544293+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.544786+0000","last_change":"2024-08-18T22:27:23.544786+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.544786+0000","last_undegraded":"2024-08-18T22:27:23.544786+0000","last_fullsized":"2024-08-18T22:27:23.544786+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.535383+0000","last_change":"2024-08-18T22:27:23.535383+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.535383+0000","last_undegraded":"2024-08-18T22:27:23.535383+0000","last_fullsized":"2024-08-18T22:27:23.535383+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532994+0000","last_change":"2024-08-18T22:27:23.532994+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532994+0000","last_undegraded":"2024-08-18T22:27:23.532994+0000","last_fullsized":"2024-08-18T22:27:23.532994+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.534184+0000","last_change":"2024-08-18T22:27:23.534184+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.534184+0000","last_undegraded":"2024-08-18T22:27:23.534184+0000","last_fullsized":"2024-08-18T22:27:23.534184+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.581951+0000","last_change":"2024-08-18T22:27:24.577512+0000","last_active":"2024-08-18T22:27:24.581951+0000","last_peered":"2024-08-18T22:27:24.581951+0000","last_clean":"2024-08-18T22:27:24.581951+0000","last_became_active":"2024-08-18T22:27:24.577167+0000","last_became_peered":"2024-08-18T22:27:24.577167+0000","last_unstale":"2024-08-18T22:27:24.581951+0000","last_undegraded":"2024-08-18T22:27:24.581951+0000","last_fullsized":"2024-08-18T22:27:24.581951+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:41:25.724936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.544304+0000","last_change":"2024-08-18T22:27:23.544304+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.544304+0000","last_undegraded":"2024-08-18T22:27:23.544304+0000","last_fullsized":"2024-08-18T22:27:23.544304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537892+0000","last_change":"2024-08-18T22:27:23.537892+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537892+0000","last_undegraded":"2024-08-18T22:27:23.537892+0000","last_fullsized":"2024-08-18T22:27:23.537892+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.542936+0000","last_change":"2024-08-18T22:27:23.542936+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.542936+0000","last_undegraded":"2024-08-18T22:27:23.542936+0000","last_fullsized":"2024-08-18T22:27:23.542936+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.587114+0000","last_change":"2024-08-18T22:27:24.586295+0000","last_active":"2024-08-18T22:27:24.587114+0000","last_peered":"2024-08-18T22:27:24.587114+0000","last_clean":"2024-08-18T22:27:24.587114+0000","last_became_active":"2024-08-18T22:27:24.585876+0000","last_became_peered":"2024-08-18T22:27:24.585876+0000","last_unstale":"2024-08-18T22:27:24.587114+0000","last_undegraded":"2024-08-18T22:27:24.587114+0000","last_fullsized":"2024-08-18T22:27:24.587114+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:06:20.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541489+0000","last_change":"2024-08-18T22:27:23.541489+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541489+0000","last_undegraded":"2024-08-18T22:27:23.541489+0000","last_fullsized":"2024-08-18T22:27:23.541489+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533559+0000","last_change":"2024-08-18T22:27:23.533559+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533559+0000","last_undegraded":"2024-08-18T22:27:23.533559+0000","last_fullsized":"2024-08-18T22:27:23.533559+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538539+0000","last_change":"2024-08-18T22:27:23.538539+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538539+0000","last_undegraded":"2024-08-18T22:27:23.538539+0000","last_fullsized":"2024-08-18T22:27:23.538539+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.531879+0000","last_change":"2024-08-18T22:27:23.531879+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.531879+0000","last_undegraded":"2024-08-18T22:27:23.531879+0000","last_fullsized":"2024-08-18T22:27:23.531879+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.576321+0000","last_change":"2024-08-18T22:27:24.572897+0000","last_active":"2024-08-18T22:27:24.576321+0000","last_peered":"2024-08-18T22:27:24.576321+0000","last_clean":"2024-08-18T22:27:24.576321+0000","last_became_active":"2024-08-18T22:27:24.572530+0000","last_became_peered":"2024-08-18T22:27:24.572530+0000","last_unstale":"2024-08-18T22:27:24.576321+0000","last_undegraded":"2024-08-18T22:27:24.576321+0000","last_fullsized":"2024-08-18T22:27:24.576321+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:30:27.384406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532332+0000","last_change":"2024-08-18T22:27:23.532332+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532332+0000","last_undegraded":"2024-08-18T22:27:23.532332+0000","last_fullsized":"2024-08-18T22:27:23.532332+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.572238+0000","last_change":"2024-08-18T22:27:24.560726+0000","last_active":"2024-08-18T22:27:24.572238+0000","last_peered":"2024-08-18T22:27:24.572238+0000","last_clean":"2024-08-18T22:27:24.572238+0000","last_became_active":"2024-08-18T22:27:24.560454+0000","last_became_peered":"2024-08-18T22:27:24.560454+0000","last_unstale":"2024-08-18T22:27:24.572238+0000","last_undegraded":"2024-08-18T22:27:24.572238+0000","last_fullsized":"2024-08-18T22:27:24.572238+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:34.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533002+0000","last_change":"2024-08-18T22:27:23.533002+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533002+0000","last_undegraded":"2024-08-18T22:27:23.533002+0000","last_fullsized":"2024-08-18T22:27:23.533002+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538758+0000","last_change":"2024-08-18T22:27:23.538758+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538758+0000","last_undegraded":"2024-08-18T22:27:23.538758+0000","last_fullsized":"2024-08-18T22:27:23.538758+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540721+0000","last_change":"2024-08-18T22:27:23.540721+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540721+0000","last_undegraded":"2024-08-18T22:27:23.540721+0000","last_fullsized":"2024-08-18T22:27:23.540721+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570882+0000","last_change":"2024-08-18T22:27:24.567510+0000","last_active":"2024-08-18T22:27:24.570882+0000","last_peered":"2024-08-18T22:27:24.570882+0000","last_clean":"2024-08-18T22:27:24.570882+0000","last_became_active":"2024-08-18T22:27:24.565899+0000","last_became_peered":"2024-08-18T22:27:24.565899+0000","last_unstale":"2024-08-18T22:27:24.570882+0000","last_undegraded":"2024-08-18T22:27:24.570882+0000","last_fullsized":"2024-08-18T22:27:24.570882+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:11.259055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530226+0000","last_change":"2024-08-18T22:27:23.530226+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530226+0000","last_undegraded":"2024-08-18T22:27:23.530226+0000","last_fullsized":"2024-08-18T22:27:23.530226+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.539759+0000","last_change":"2024-08-18T22:27:23.539759+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.539759+0000","last_undegraded":"2024-08-18T22:27:23.539759+0000","last_fullsized":"2024-08-18T22:27:23.539759+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570845+0000","last_change":"2024-08-18T22:27:24.569829+0000","last_active":"2024-08-18T22:27:24.570845+0000","last_peered":"2024-08-18T22:27:24.570845+0000","last_clean":"2024-08-18T22:27:24.570845+0000","last_became_active":"2024-08-18T22:27:24.569543+0000","last_became_peered":"2024-08-18T22:27:24.569543+0000","last_unstale":"2024-08-18T22:27:24.570845+0000","last_undegraded":"2024-08-18T22:27:24.570845+0000","last_fullsized":"2024-08-18T22:27:24.570845+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:02.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537507+0000","last_change":"2024-08-18T22:27:23.537507+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537507+0000","last_undegraded":"2024-08-18T22:27:23.537507+0000","last_fullsized":"2024-08-18T22:27:23.537507+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538695+0000","last_change":"2024-08-18T22:27:23.538695+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538695+0000","last_undegraded":"2024-08-18T22:27:23.538695+0000","last_fullsized":"2024-08-18T22:27:23.538695+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538264+0000","last_change":"2024-08-18T22:27:23.538264+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538264+0000","last_undegraded":"2024-08-18T22:27:23.538264+0000","last_fullsized":"2024-08-18T22:27:23.538264+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533281+0000","last_change":"2024-08-18T22:27:23.533281+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533281+0000","last_undegraded":"2024-08-18T22:27:23.533281+0000","last_fullsized":"2024-08-18T22:27:23.533281+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.537770+0000","last_change":"2024-08-18T22:27:23.536418+0000","last_active":"2024-08-18T22:27:23.537770+0000","last_peered":"2024-08-18T22:27:23.537770+0000","last_clean":"2024-08-18T22:27:23.537770+0000","last_became_active":"2024-08-18T22:27:23.536127+0000","last_became_peered":"2024-08-18T22:27:23.536127+0000","last_unstale":"2024-08-18T22:27:23.537770+0000","last_undegraded":"2024-08-18T22:27:23.537770+0000","last_fullsized":"2024-08-18T22:27:23.537770+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:03.786373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.539741+0000","last_change":"2024-08-18T22:27:23.539741+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.539741+0000","last_undegraded":"2024-08-18T22:27:23.539741+0000","last_fullsized":"2024-08-18T22:27:23.539741+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.550328+0000","last_change":"2024-08-18T22:27:23.544340+0000","last_active":"2024-08-18T22:27:23.550328+0000","last_peered":"2024-08-18T22:27:23.550328+0000","last_clean":"2024-08-18T22:27:23.550328+0000","last_became_active":"2024-08-18T22:27:23.543926+0000","last_became_peered":"2024-08-18T22:27:23.543926+0000","last_unstale":"2024-08-18T22:27:23.550328+0000","last_undegraded":"2024-08-18T22:27:23.550328+0000","last_fullsized":"2024-08-18T22:27:23.550328+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:33.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540478+0000","last_change":"2024-08-18T22:27:23.540478+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540478+0000","last_undegraded":"2024-08-18T22:27:23.540478+0000","last_fullsized":"2024-08-18T22:27:23.540478+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551665+0000","last_change":"2024-08-18T22:27:23.544721+0000","last_active":"2024-08-18T22:27:23.551665+0000","last_peered":"2024-08-18T22:27:23.551665+0000","last_clean":"2024-08-18T22:27:23.551665+0000","last_became_active":"2024-08-18T22:27:23.544394+0000","last_became_peered":"2024-08-18T22:27:23.544394+0000","last_unstale":"2024-08-18T22:27:23.551665+0000","last_undegraded":"2024-08-18T22:27:23.551665+0000","last_fullsized":"2024-08-18T22:27:23.551665+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:42.486701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.531968+0000","last_change":"2024-08-18T22:27:23.531968+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.531968+0000","last_undegraded":"2024-08-18T22:27:23.531968+0000","last_fullsized":"2024-08-18T22:27:23.531968+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.550528+0000","last_change":"2024-08-18T22:27:23.547814+0000","last_active":"2024-08-18T22:27:23.550528+0000","last_peered":"2024-08-18T22:27:23.550528+0000","last_clean":"2024-08-18T22:27:23.550528+0000","last_became_active":"2024-08-18T22:27:23.547540+0000","last_became_peered":"2024-08-18T22:27:23.547540+0000","last_unstale":"2024-08-18T22:27:23.550528+0000","last_undegraded":"2024-08-18T22:27:23.550528+0000","last_fullsized":"2024-08-18T22:27:23.550528+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:54.945688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532861+0000","last_change":"2024-08-18T22:27:23.532861+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532861+0000","last_undegraded":"2024-08-18T22:27:23.532861+0000","last_fullsized":"2024-08-18T22:27:23.532861+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.583668+0000","last_change":"2024-08-18T22:27:23.546555+0000","last_active":"2024-08-18T22:27:24.583668+0000","last_peered":"2024-08-18T22:27:24.583668+0000","last_clean":"2024-08-18T22:27:24.583668+0000","last_became_active":"2024-08-18T22:27:23.544681+0000","last_became_peered":"2024-08-18T22:27:23.544681+0000","last_unstale":"2024-08-18T22:27:24.583668+0000","last_undegraded":"2024-08-18T22:27:24.583668+0000","last_fullsized":"2024-08-18T22:27:24.583668+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:57.484511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.569480+0000","last_change":"2024-08-18T22:27:24.559554+0000","last_active":"2024-08-18T22:27:24.569480+0000","last_peered":"2024-08-18T22:27:24.569480+0000","last_clean":"2024-08-18T22:27:24.569480+0000","last_became_active":"2024-08-18T22:27:24.559262+0000","last_became_peered":"2024-08-18T22:27:24.559262+0000","last_unstale":"2024-08-18T22:27:24.569480+0000","last_undegraded":"2024-08-18T22:27:24.569480+0000","last_fullsized":"2024-08-18T22:27:24.569480+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:36.984658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556274+0000","last_change":"2024-08-18T22:27:23.553332+0000","last_active":"2024-08-18T22:27:23.556274+0000","last_peered":"2024-08-18T22:27:23.556274+0000","last_clean":"2024-08-18T22:27:23.556274+0000","last_became_active":"2024-08-18T22:27:23.550173+0000","last_became_peered":"2024-08-18T22:27:23.550173+0000","last_unstale":"2024-08-18T22:27:23.556274+0000","last_undegraded":"2024-08-18T22:27:23.556274+0000","last_fullsized":"2024-08-18T22:27:23.556274+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:02.994973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537101+0000","last_change":"2024-08-18T22:27:23.537101+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537101+0000","last_undegraded":"2024-08-18T22:27:23.537101+0000","last_fullsized":"2024-08-18T22:27:23.537101+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.549080+0000","last_change":"2024-08-18T22:27:23.544298+0000","last_active":"2024-08-18T22:27:23.549080+0000","last_peered":"2024-08-18T22:27:23.549080+0000","last_clean":"2024-08-18T22:27:23.549080+0000","last_became_active":"2024-08-18T22:27:23.543996+0000","last_became_peered":"2024-08-18T22:27:23.543996+0000","last_unstale":"2024-08-18T22:27:23.549080+0000","last_undegraded":"2024-08-18T22:27:23.549080+0000","last_fullsized":"2024-08-18T22:27:23.549080+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:03.786373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533962+0000","last_change":"2024-08-18T22:27:23.533962+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533962+0000","last_undegraded":"2024-08-18T22:27:23.533962+0000","last_fullsized":"2024-08-18T22:27:23.533962+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.555766+0000","last_change":"2024-08-18T22:27:23.547406+0000","last_active":"2024-08-18T22:27:23.555766+0000","last_peered":"2024-08-18T22:27:23.555766+0000","last_clean":"2024-08-18T22:27:23.555766+0000","last_became_active":"2024-08-18T22:27:23.547152+0000","last_became_peered":"2024-08-18T22:27:23.547152+0000","last_unstale":"2024-08-18T22:27:23.555766+0000","last_undegraded":"2024-08-18T22:27:23.555766+0000","last_fullsized":"2024-08-18T22:27:23.555766+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:47.679456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530449+0000","last_change":"2024-08-18T22:27:23.530449+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530449+0000","last_undegraded":"2024-08-18T22:27:23.530449+0000","last_fullsized":"2024-08-18T22:27:23.530449+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.541235+0000","last_change":"2024-08-18T22:27:23.538603+0000","last_active":"2024-08-18T22:27:23.541235+0000","last_peered":"2024-08-18T22:27:23.541235+0000","last_clean":"2024-08-18T22:27:23.541235+0000","last_became_active":"2024-08-18T22:27:23.538343+0000","last_became_peered":"2024-08-18T22:27:23.538343+0000","last_unstale":"2024-08-18T22:27:23.541235+0000","last_undegraded":"2024-08-18T22:27:23.541235+0000","last_fullsized":"2024-08-18T22:27:23.541235+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:52.763753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540469+0000","last_change":"2024-08-18T22:27:23.540469+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540469+0000","last_undegraded":"2024-08-18T22:27:23.540469+0000","last_fullsized":"2024-08-18T22:27:23.540469+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551913+0000","last_change":"2024-08-18T22:27:23.548166+0000","last_active":"2024-08-18T22:27:23.551913+0000","last_peered":"2024-08-18T22:27:23.551913+0000","last_clean":"2024-08-18T22:27:23.551913+0000","last_became_active":"2024-08-18T22:27:23.547899+0000","last_became_peered":"2024-08-18T22:27:23.547899+0000","last_unstale":"2024-08-18T22:27:23.551913+0000","last_undegraded":"2024-08-18T22:27:23.551913+0000","last_fullsized":"2024-08-18T22:27:23.551913+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:52.763753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538116+0000","last_change":"2024-08-18T22:27:23.538116+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538116+0000","last_undegraded":"2024-08-18T22:27:23.538116+0000","last_fullsized":"2024-08-18T22:27:23.538116+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.554849+0000","last_change":"2024-08-18T22:27:23.549127+0000","last_active":"2024-08-18T22:27:23.554849+0000","last_peered":"2024-08-18T22:27:23.554849+0000","last_clean":"2024-08-18T22:27:23.554849+0000","last_became_active":"2024-08-18T22:27:23.548778+0000","last_became_peered":"2024-08-18T22:27:23.548778+0000","last_unstale":"2024-08-18T22:27:23.554849+0000","last_undegraded":"2024-08-18T22:27:23.554849+0000","last_fullsized":"2024-08-18T22:27:23.554849+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:42.031794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540281+0000","last_change":"2024-08-18T22:27:23.540281+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540281+0000","last_undegraded":"2024-08-18T22:27:23.540281+0000","last_fullsized":"2024-08-18T22:27:23.540281+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.552961+0000","last_change":"2024-08-18T22:27:23.551420+0000","last_active":"2024-08-18T22:27:23.552961+0000","last_peered":"2024-08-18T22:27:23.552961+0000","last_clean":"2024-08-18T22:27:23.552961+0000","last_became_active":"2024-08-18T22:27:23.551146+0000","last_became_peered":"2024-08-18T22:27:23.551146+0000","last_unstale":"2024-08-18T22:27:23.552961+0000","last_undegraded":"2024-08-18T22:27:23.552961+0000","last_fullsized":"2024-08-18T22:27:23.552961+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:43:04.208784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530192+0000","last_change":"2024-08-18T22:27:23.530192+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530192+0000","last_undegraded":"2024-08-18T22:27:23.530192+0000","last_fullsized":"2024-08-18T22:27:23.530192+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.555448+0000","last_change":"2024-08-18T22:27:23.554557+0000","last_active":"2024-08-18T22:27:23.555448+0000","last_peered":"2024-08-18T22:27:23.555448+0000","last_clean":"2024-08-18T22:27:23.555448+0000","last_became_active":"2024-08-18T22:27:23.554293+0000","last_became_peered":"2024-08-18T22:27:23.554293+0000","last_unstale":"2024-08-18T22:27:23.555448+0000","last_undegraded":"2024-08-18T22:27:23.555448+0000","last_fullsized":"2024-08-18T22:27:23.555448+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:28.147793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532488+0000","last_change":"2024-08-18T22:27:23.532488+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532488+0000","last_undegraded":"2024-08-18T22:27:23.532488+0000","last_fullsized":"2024-08-18T22:27:23.532488+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.553883+0000","last_change":"2024-08-18T22:27:23.552723+0000","last_active":"2024-08-18T22:27:23.553883+0000","last_peered":"2024-08-18T22:27:23.553883+0000","last_clean":"2024-08-18T22:27:23.553883+0000","last_became_active":"2024-08-18T22:27:23.552457+0000","last_became_peered":"2024-08-18T22:27:23.552457+0000","last_unstale":"2024-08-18T22:27:23.553883+0000","last_undegraded":"2024-08-18T22:27:23.553883+0000","last_fullsized":"2024-08-18T22:27:23.553883+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:35.137950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.576445+0000","last_change":"2024-08-18T22:27:24.573855+0000","last_active":"2024-08-18T22:27:24.576445+0000","last_peered":"2024-08-18T22:27:24.576445+0000","last_clean":"2024-08-18T22:27:24.576445+0000","last_became_active":"2024-08-18T22:27:24.573562+0000","last_became_peered":"2024-08-18T22:27:24.573562+0000","last_unstale":"2024-08-18T22:27:24.576445+0000","last_undegraded":"2024-08-18T22:27:24.576445+0000","last_fullsized":"2024-08-18T22:27:24.576445+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:15.654628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.553077+0000","last_change":"2024-08-18T22:27:23.552008+0000","last_active":"2024-08-18T22:27:23.553077+0000","last_peered":"2024-08-18T22:27:23.553077+0000","last_clean":"2024-08-18T22:27:23.553077+0000","last_became_active":"2024-08-18T22:27:23.551740+0000","last_became_peered":"2024-08-18T22:27:23.551740+0000","last_unstale":"2024-08-18T22:27:23.553077+0000","last_undegraded":"2024-08-18T22:27:23.553077+0000","last_fullsized":"2024-08-18T22:27:23.553077+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:18:55.715413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541586+0000","last_change":"2024-08-18T22:27:23.541586+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541586+0000","last_undegraded":"2024-08-18T22:27:23.541586+0000","last_fullsized":"2024-08-18T22:27:23.541586+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.552032+0000","last_change":"2024-08-18T22:27:23.548589+0000","last_active":"2024-08-18T22:27:23.552032+0000","last_peered":"2024-08-18T22:27:23.552032+0000","last_clean":"2024-08-18T22:27:23.552032+0000","last_became_active":"2024-08-18T22:27:23.546800+0000","last_became_peered":"2024-08-18T22:27:23.546800+0000","last_unstale":"2024-08-18T22:27:23.552032+0000","last_undegraded":"2024-08-18T22:27:23.552032+0000","last_fullsized":"2024-08-18T22:27:23.552032+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:03:19.347344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570084+0000","last_change":"2024-08-18T22:27:24.560518+0000","last_active":"2024-08-18T22:27:24.570084+0000","last_peered":"2024-08-18T22:27:24.570084+0000","last_clean":"2024-08-18T22:27:24.570084+0000","last_became_active":"2024-08-18T22:27:24.560227+0000","last_became_peered":"2024-08-18T22:27:24.560227+0000","last_unstale":"2024-08-18T22:27:24.570084+0000","last_undegraded":"2024-08-18T22:27:24.570084+0000","last_fullsized":"2024-08-18T22:27:24.570084+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:16.308159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.582468+0000","last_change":"2024-08-18T22:27:23.545359+0000","last_active":"2024-08-18T22:27:24.582468+0000","last_peered":"2024-08-18T22:27:24.582468+0000","last_clean":"2024-08-18T22:27:24.582468+0000","last_became_active":"2024-08-18T22:27:23.545080+0000","last_became_peered":"2024-08-18T22:27:23.545080+0000","last_unstale":"2024-08-18T22:27:24.582468+0000","last_undegraded":"2024-08-18T22:27:24.582468+0000","last_fullsized":"2024-08-18T22:27:24.582468+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:05:03.331984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.535471+0000","last_change":"2024-08-18T22:27:23.535471+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.535471+0000","last_undegraded":"2024-08-18T22:27:23.535471+0000","last_fullsized":"2024-08-18T22:27:23.535471+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551886+0000","last_change":"2024-08-18T22:27:23.546608+0000","last_active":"2024-08-18T22:27:23.551886+0000","last_peered":"2024-08-18T22:27:23.551886+0000","last_clean":"2024-08-18T22:27:23.551886+0000","last_became_active":"2024-08-18T22:27:23.546365+0000","last_became_peered":"2024-08-18T22:27:23.546365+0000","last_unstale":"2024-08-18T22:27:23.551886+0000","last_undegraded":"2024-08-18T22:27:23.551886+0000","last_fullsized":"2024-08-18T22:27:23.551886+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:32.512213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.539776+0000","last_change":"2024-08-18T22:27:23.539776+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.539776+0000","last_undegraded":"2024-08-18T22:27:23.539776+0000","last_fullsized":"2024-08-18T22:27:23.539776+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.545115+0000","last_change":"2024-08-18T22:27:23.542231+0000","last_active":"2024-08-18T22:27:23.545115+0000","last_peered":"2024-08-18T22:27:23.545115+0000","last_clean":"2024-08-18T22:27:23.545115+0000","last_became_active":"2024-08-18T22:27:23.541939+0000","last_became_peered":"2024-08-18T22:27:23.541939+0000","last_unstale":"2024-08-18T22:27:23.545115+0000","last_undegraded":"2024-08-18T22:27:23.545115+0000","last_fullsized":"2024-08-18T22:27:23.545115+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:42.031794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.534771+0000","last_change":"2024-08-18T22:27:23.534771+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.534771+0000","last_undegraded":"2024-08-18T22:27:23.534771+0000","last_fullsized":"2024-08-18T22:27:23.534771+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.555480+0000","last_change":"2024-08-18T22:27:23.545503+0000","last_active":"2024-08-18T22:27:23.555480+0000","last_peered":"2024-08-18T22:27:23.555480+0000","last_clean":"2024-08-18T22:27:23.555480+0000","last_became_active":"2024-08-18T22:27:23.545228+0000","last_became_peered":"2024-08-18T22:27:23.545228+0000","last_unstale":"2024-08-18T22:27:23.555480+0000","last_undegraded":"2024-08-18T22:27:23.555480+0000","last_fullsized":"2024-08-18T22:27:23.555480+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.677848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541397+0000","last_change":"2024-08-18T22:27:23.541397+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541397+0000","last_undegraded":"2024-08-18T22:27:23.541397+0000","last_fullsized":"2024-08-18T22:27:23.541397+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.541051+0000","last_change":"2024-08-18T22:27:23.539599+0000","last_active":"2024-08-18T22:27:23.541051+0000","last_peered":"2024-08-18T22:27:23.541051+0000","last_clean":"2024-08-18T22:27:23.541051+0000","last_became_active":"2024-08-18T22:27:23.539322+0000","last_became_peered":"2024-08-18T22:27:23.539322+0000","last_unstale":"2024-08-18T22:27:23.541051+0000","last_undegraded":"2024-08-18T22:27:23.541051+0000","last_fullsized":"2024-08-18T22:27:23.541051+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:52.763753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.536728+0000","last_change":"2024-08-18T22:27:23.536728+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.536728+0000","last_undegraded":"2024-08-18T22:27:23.536728+0000","last_fullsized":"2024-08-18T22:27:23.536728+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.548225+0000","last_change":"2024-08-18T22:27:23.544336+0000","last_active":"2024-08-18T22:27:23.548225+0000","last_peered":"2024-08-18T22:27:23.548225+0000","last_clean":"2024-08-18T22:27:23.548225+0000","last_became_active":"2024-08-18T22:27:23.544058+0000","last_became_peered":"2024-08-18T22:27:23.544058+0000","last_unstale":"2024-08-18T22:27:23.548225+0000","last_undegraded":"2024-08-18T22:27:23.548225+0000","last_fullsized":"2024-08-18T22:27:23.548225+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:21.461235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541359+0000","last_change":"2024-08-18T22:27:23.541359+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541359+0000","last_undegraded":"2024-08-18T22:27:23.541359+0000","last_fullsized":"2024-08-18T22:27:23.541359+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551988+0000","last_change":"2024-08-18T22:27:23.547090+0000","last_active":"2024-08-18T22:27:23.551988+0000","last_peered":"2024-08-18T22:27:23.551988+0000","last_clean":"2024-08-18T22:27:23.551988+0000","last_became_active":"2024-08-18T22:27:23.546820+0000","last_became_peered":"2024-08-18T22:27:23.546820+0000","last_unstale":"2024-08-18T22:27:23.551988+0000","last_undegraded":"2024-08-18T22:27:23.551988+0000","last_fullsized":"2024-08-18T22:27:23.551988+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:50.977899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533300+0000","last_change":"2024-08-18T22:27:23.533300+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533300+0000","last_undegraded":"2024-08-18T22:27:23.533300+0000","last_fullsized":"2024-08-18T22:27:23.533300+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556194+0000","last_change":"2024-08-18T22:27:23.551796+0000","last_active":"2024-08-18T22:27:23.556194+0000","last_peered":"2024-08-18T22:27:23.556194+0000","last_clean":"2024-08-18T22:27:23.556194+0000","last_became_active":"2024-08-18T22:27:23.551536+0000","last_became_peered":"2024-08-18T22:27:23.551536+0000","last_unstale":"2024-08-18T22:27:23.556194+0000","last_undegraded":"2024-08-18T22:27:23.556194+0000","last_fullsized":"2024-08-18T22:27:23.556194+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:25.201562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532481+0000","last_change":"2024-08-18T22:27:23.532481+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532481+0000","last_undegraded":"2024-08-18T22:27:23.532481+0000","last_fullsized":"2024-08-18T22:27:23.532481+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.549202+0000","last_change":"2024-08-18T22:27:23.547122+0000","last_active":"2024-08-18T22:27:23.549202+0000","last_peered":"2024-08-18T22:27:23.549202+0000","last_clean":"2024-08-18T22:27:23.549202+0000","last_became_active":"2024-08-18T22:27:23.546628+0000","last_became_peered":"2024-08-18T22:27:23.546628+0000","last_unstale":"2024-08-18T22:27:23.549202+0000","last_undegraded":"2024-08-18T22:27:23.549202+0000","last_fullsized":"2024-08-18T22:27:23.549202+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:42.486701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533486+0000","last_change":"2024-08-18T22:27:23.533486+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533486+0000","last_undegraded":"2024-08-18T22:27:23.533486+0000","last_fullsized":"2024-08-18T22:27:23.533486+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.541267+0000","last_change":"2024-08-18T22:27:23.539274+0000","last_active":"2024-08-18T22:27:23.541267+0000","last_peered":"2024-08-18T22:27:23.541267+0000","last_clean":"2024-08-18T22:27:23.541267+0000","last_became_active":"2024-08-18T22:27:23.538927+0000","last_became_peered":"2024-08-18T22:27:23.538927+0000","last_unstale":"2024-08-18T22:27:23.541267+0000","last_undegraded":"2024-08-18T22:27:23.541267+0000","last_fullsized":"2024-08-18T22:27:23.541267+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:42.031794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.588902+0000","last_change":"2024-08-18T22:27:24.588134+0000","last_active":"2024-08-18T22:27:24.588902+0000","last_peered":"2024-08-18T22:27:24.588902+0000","last_clean":"2024-08-18T22:27:24.588902+0000","last_became_active":"2024-08-18T22:27:24.587781+0000","last_became_peered":"2024-08-18T22:27:24.587781+0000","last_unstale":"2024-08-18T22:27:24.588902+0000","last_undegraded":"2024-08-18T22:27:24.588902+0000","last_fullsized":"2024-08-18T22:27:24.588902+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:34.370960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556100+0000","last_change":"2024-08-18T22:27:23.549252+0000","last_active":"2024-08-18T22:27:23.556100+0000","last_peered":"2024-08-18T22:27:23.556100+0000","last_clean":"2024-08-18T22:27:23.556100+0000","last_became_active":"2024-08-18T22:27:23.548968+0000","last_became_peered":"2024-08-18T22:27:23.548968+0000","last_unstale":"2024-08-18T22:27:23.556100+0000","last_undegraded":"2024-08-18T22:27:23.556100+0000","last_fullsized":"2024-08-18T22:27:23.556100+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:31.597239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.534325+0000","last_change":"2024-08-18T22:27:23.534325+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.534325+0000","last_undegraded":"2024-08-18T22:27:23.534325+0000","last_fullsized":"2024-08-18T22:27:23.534325+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.549661+0000","last_change":"2024-08-18T22:27:23.550306+0000","last_active":"2024-08-18T22:27:24.549661+0000","last_peered":"2024-08-18T22:27:24.549661+0000","last_clean":"2024-08-18T22:27:24.549661+0000","last_became_active":"2024-08-18T22:27:23.549975+0000","last_became_peered":"2024-08-18T22:27:23.549975+0000","last_unstale":"2024-08-18T22:27:24.549661+0000","last_undegraded":"2024-08-18T22:27:24.549661+0000","last_fullsized":"2024-08-18T22:27:24.549661+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:01:11.437061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540847+0000","last_change":"2024-08-18T22:27:23.540847+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540847+0000","last_undegraded":"2024-08-18T22:27:23.540847+0000","last_fullsized":"2024-08-18T22:27:23.540847+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.548932+0000","last_change":"2024-08-18T22:27:23.545190+0000","last_active":"2024-08-18T22:27:24.548932+0000","last_peered":"2024-08-18T22:27:24.548932+0000","last_clean":"2024-08-18T22:27:24.548932+0000","last_became_active":"2024-08-18T22:27:23.544813+0000","last_became_peered":"2024-08-18T22:27:23.544813+0000","last_unstale":"2024-08-18T22:27:24.548932+0000","last_undegraded":"2024-08-18T22:27:24.548932+0000","last_fullsized":"2024-08-18T22:27:24.548932+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:53.358060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530918+0000","last_change":"2024-08-18T22:27:23.530918+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530918+0000","last_undegraded":"2024-08-18T22:27:23.530918+0000","last_fullsized":"2024-08-18T22:27:23.530918+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556254+0000","last_change":"2024-08-18T22:27:23.553339+0000","last_active":"2024-08-18T22:27:23.556254+0000","last_peered":"2024-08-18T22:27:23.556254+0000","last_clean":"2024-08-18T22:27:23.556254+0000","last_became_active":"2024-08-18T22:27:23.548574+0000","last_became_peered":"2024-08-18T22:27:23.548574+0000","last_unstale":"2024-08-18T22:27:23.556254+0000","last_undegraded":"2024-08-18T22:27:23.556254+0000","last_fullsized":"2024-08-18T22:27:23.556254+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:32.032718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.531793+0000","last_change":"2024-08-18T22:27:23.531793+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.531793+0000","last_undegraded":"2024-08-18T22:27:23.531793+0000","last_fullsized":"2024-08-18T22:27:23.531793+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.540628+0000","last_change":"2024-08-18T22:27:23.536731+0000","last_active":"2024-08-18T22:27:23.540628+0000","last_peered":"2024-08-18T22:27:23.540628+0000","last_clean":"2024-08-18T22:27:23.540628+0000","last_became_active":"2024-08-18T22:27:23.536418+0000","last_became_peered":"2024-08-18T22:27:23.536418+0000","last_unstale":"2024-08-18T22:27:23.540628+0000","last_undegraded":"2024-08-18T22:27:23.540628+0000","last_fullsized":"2024-08-18T22:27:23.540628+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:03.786373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530872+0000","last_change":"2024-08-18T22:27:23.530872+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530872+0000","last_undegraded":"2024-08-18T22:27:23.530872+0000","last_fullsized":"2024-08-18T22:27:23.530872+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.554404+0000","last_change":"2024-08-18T22:27:23.553624+0000","last_active":"2024-08-18T22:27:23.554404+0000","last_peered":"2024-08-18T22:27:23.554404+0000","last_clean":"2024-08-18T22:27:23.554404+0000","last_became_active":"2024-08-18T22:27:23.553355+0000","last_became_peered":"2024-08-18T22:27:23.553355+0000","last_unstale":"2024-08-18T22:27:23.554404+0000","last_undegraded":"2024-08-18T22:27:23.554404+0000","last_fullsized":"2024-08-18T22:27:23.554404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:15.048010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":386,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.531668+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:27:23.531668+0000","last_peered":"2024-08-18T22:27:23.531668+0000","last_clean":"2024-08-18T22:27:23.531668+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:27:23.531668+0000","last_undegraded":"2024-08-18T22:27:23.531668+0000","last_fullsized":"2024-08-18T22:27:23.531668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41604,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330236,"statfs":{"total":96636764160,"available":96594161664,"internally_reserved":0,"allocated":2154496,"data_stored":1322855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509544,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41024,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330816,"statfs":{"total":96636764160,"available":96594755584,"internally_reserved":0,"allocated":1560576,"data_stored":732487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41024,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330816,"statfs":{"total":96636764160,"available":96594755584,"internally_reserved":0,"allocated":1560576,"data_stored":732487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509543,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50752,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321088,"statfs":{"total":96636764160,"available":96584794112,"internally_reserved":0,"allocated":1560576,"data_stored":732487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50768,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321072,"statfs":{"total":96636764160,"available":96584777728,"internally_reserved":0,"allocated":1572864,"data_stored":739154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51332,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320508,"statfs":{"total":96636764160,"available":96584200192,"internally_reserved":0,"allocated":2154496,"data_stored":1322855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50788,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321052,"statfs":{"total":96636764160,"available":96584757248,"internally_reserved":0,"allocated":1597440,"data_stored":747933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574951,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50780,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321060,"statfs":{"total":96636764160,"available":96584765440,"internally_reserved":0,"allocated":1585152,"data_stored":746321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:27:29.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:27:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.256+0000 7f62a6600640 1 Processor -- start 2024-08-18T22:27:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.256+0000 7f62a6600640 1 -- start start 2024-08-18T22:27:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.256+0000 7f62a6600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62a0161960 0x7f62a006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.256+0000 7f62a6600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62a015e4b0 0x7f62a0070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.256+0000 7f62a6600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62a015eb60 con 0x7f62a0070730 2024-08-18T22:27:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.256+0000 7f62a6600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f62a015fcc0 con 0x7f62a015e4b0 2024-08-18T22:27:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.256+0000 7f62a6600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f62a00710b0 con 0x7f62a0161960 2024-08-18T22:27:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.256+0000 7f629fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62a015e4b0 0x7f62a0070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.256+0000 7f629ea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f62a0070730 0x7f62a015dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53132/0 (socket says 172.21.15.5:53132) 2024-08-18T22:27:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.256+0000 7f629ea00640 1 -- 172.21.15.5:0/2613869195 learned_addr learned my addr 172.21.15.5:0/2613869195 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.256+0000 7f629f400640 1 --2- 172.21.15.5:0/2613869195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62a0161960 0x7f62a006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f629fe00640 1 -- 172.21.15.5:0/2613869195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62a0161960 msgr2=0x7f62a006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f629fe00640 1 --2- 172.21.15.5:0/2613869195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62a0161960 0x7f62a006fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f629fe00640 1 -- 172.21.15.5:0/2613869195 >> v1:172.21.15.5:6789/0 conn(0x7f62a0070730 legacy=0x7f62a015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f629fe00640 1 -- 172.21.15.5:0/2613869195 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a015ee40 con 0x7f62a015e4b0 2024-08-18T22:27:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f629f400640 1 --2- 172.21.15.5:0/2613869195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62a0161960 0x7f62a006fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f629fe00640 1 --2- 172.21.15.5:0/2613869195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a015e4b0 0x7f62a0070b70 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6298009d90 tx=0x7f629801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382e4b9cee13ef4f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f629e000640 1 -- 172.21.15.5:0/2613869195 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62980b2070 con 0x7f62a015e4b0 2024-08-18T22:27:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f629e000640 1 -- 172.21.15.5:0/2613869195 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62980a5830 con 0x7f62a015e4b0 2024-08-18T22:27:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f629e000640 1 -- 172.21.15.5:0/2613869195 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62980a5c00 con 0x7f62a015e4b0 2024-08-18T22:27:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f62a6600640 1 -- 172.21.15.5:0/2613869195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a015e4b0 msgr2=0x7f62a0070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f62a6600640 1 --2- 172.21.15.5:0/2613869195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a015e4b0 0x7f62a0070b70 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6298009d90 tx=0x7f629801c970 comp rx=0 tx=0).stop 2024-08-18T22:27:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f62a6600640 1 -- 172.21.15.5:0/2613869195 shutdown_connections 2024-08-18T22:27:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f62a6600640 1 --2- 172.21.15.5:0/2613869195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a015e4b0 0x7f62a0070b70 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f62a6600640 1 --2- 172.21.15.5:0/2613869195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62a0161960 0x7f62a006fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f62a6600640 1 -- 172.21.15.5:0/2613869195 >> 172.21.15.5:0/2613869195 conn(0x7f62a00d2130 msgr2=0x7f62a00d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:29.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f62a6600640 1 -- 172.21.15.5:0/2613869195 shutdown_connections 2024-08-18T22:27:29.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.260+0000 7f62a6600640 1 -- 172.21.15.5:0/2613869195 wait complete. 2024-08-18T22:27:29.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f62a6600640 1 Processor -- start 2024-08-18T22:27:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f62a6600640 1 -- start start 2024-08-18T22:27:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f62a6600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a0070730 0x7f62a00b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f62a6600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a015e4b0 0x7f62a00b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f62a6600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62a0161960 0x7f62a00af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f62a6600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f62a009ba30 con 0x7f62a015e4b0 2024-08-18T22:27:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f62a6600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62a0070260 con 0x7f62a0070730 2024-08-18T22:27:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f62a6600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f62a00b50b0 con 0x7f62a0161960 2024-08-18T22:27:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a015e4b0 0x7f62a00b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a015e4b0 0x7f62a00b7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53550/0 (socket says 172.21.15.5:53550) 2024-08-18T22:27:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629ea00640 1 -- 172.21.15.5:0/1519546358 learned_addr learned my addr 172.21.15.5:0/1519546358 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629fe00640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62a0161960 0x7f62a00af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629f400640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a0070730 0x7f62a00b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629ea00640 1 -- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62a0161960 msgr2=0x7f62a00af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629ea00640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62a0161960 0x7f62a00af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629ea00640 1 -- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a0070730 msgr2=0x7f62a00b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629ea00640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a0070730 0x7f62a00b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629ea00640 1 -- 172.21.15.5:0/1519546358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a00b5350 con 0x7f62a015e4b0 2024-08-18T22:27:29.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629f400640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a0070730 0x7f62a00b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:27:29.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f629ea00640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a015e4b0 0x7f62a00b7270 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c340 tx=0x7f628c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:29.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f6297400640 1 -- 172.21.15.5:0/1519546358 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c017070 con 0x7f62a015e4b0 2024-08-18T22:27:29.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f6297400640 1 -- 172.21.15.5:0/1519546358 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c005cf0 con 0x7f62a015e4b0 2024-08-18T22:27:29.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f62a6600640 1 -- 172.21.15.5:0/1519546358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a00b5630 con 0x7f62a015e4b0 2024-08-18T22:27:29.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f6297400640 1 -- 172.21.15.5:0/1519546358 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c0072f0 con 0x7f62a015e4b0 2024-08-18T22:27:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.264+0000 7f62a6600640 1 -- 172.21.15.5:0/1519546358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a00b5bf0 con 0x7f62a015e4b0 2024-08-18T22:27:29.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.268+0000 7f62a6600640 1 -- 172.21.15.5:0/1519546358 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a0070b70 con 0x7f62a015e4b0 2024-08-18T22:27:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.268+0000 7f6297400640 1 -- 172.21.15.5:0/1519546358 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f628c01a070 con 0x7f62a015e4b0 2024-08-18T22:27:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.268+0000 7f6297400640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62800678c0 0x7f6280069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.268+0000 7f6297400640 1 -- 172.21.15.5:0/1519546358 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f628c085110 con 0x7f62a015e4b0 2024-08-18T22:27:29.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.268+0000 7f629f400640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62800678c0 0x7f6280069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:29.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.272+0000 7f629f400640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62800678c0 0x7f6280069d80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f62a0169e00 tx=0x7f6290008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:29.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.272+0000 7f6297400640 1 -- 172.21.15.5:0/1519546358 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f628c055ab0 con 0x7f62a015e4b0 2024-08-18T22:27:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.436+0000 7f62a6600640 1 -- 172.21.15.5:0/1519546358 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f62a009bbb0 con 0x7f62800678c0 2024-08-18T22:27:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.444+0000 7f6297400640 1 -- 172.21.15.5:0/1519546358 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248083 (secure 0 0 0) 0x7f62a009bbb0 con 0x7f62800678c0 2024-08-18T22:27:29.446 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:27:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 -- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62800678c0 msgr2=0x7f6280069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62800678c0 0x7f6280069d80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f62a0169e00 tx=0x7f6290008040 comp rx=0 tx=0).stop 2024-08-18T22:27:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 -- 172.21.15.5:0/1519546358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a015e4b0 msgr2=0x7f62a00b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a015e4b0 0x7f62a00b7270 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c340 tx=0x7f628c00c800 comp rx=0 tx=0).stop 2024-08-18T22:27:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 -- 172.21.15.5:0/1519546358 shutdown_connections 2024-08-18T22:27:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62800678c0 0x7f6280069d80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62a0161960 0x7f62a00af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a015e4b0 0x7f62a00b7270 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 --2- 172.21.15.5:0/1519546358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a0070730 0x7f62a00b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 -- 172.21.15.5:0/1519546358 >> 172.21.15.5:0/1519546358 conn(0x7f62a00d2130 msgr2=0x7f62a006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 -- 172.21.15.5:0/1519546358 shutdown_connections 2024-08-18T22:27:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.448+0000 7f62a6600640 1 -- 172.21.15.5:0/1519546358 wait complete. 2024-08-18T22:27:29.467 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-08-18T22:27:27.740585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":378072,"kb_used_data":13424,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754596648,"statfs":{"total":773094113280,"available":772706967552,"internally_reserved":0,"allocated":13746176,"data_stored":7076579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.220077"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.562162+0000","last_change":"2024-08-18T22:27:24.555768+0000","last_active":"2024-08-18T22:27:24.562162+0000","last_peered":"2024-08-18T22:27:24.562162+0000","last_clean":"2024-08-18T22:27:24.562162+0000","last_became_active":"2024-08-18T22:27:24.555457+0000","last_became_peered":"2024-08-18T22:27:24.555457+0000","last_unstale":"2024-08-18T22:27:24.562162+0000","last_undegraded":"2024-08-18T22:27:24.562162+0000","last_fullsized":"2024-08-18T22:27:24.562162+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:42.103828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538940+0000","last_change":"2024-08-18T22:27:23.538940+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538940+0000","last_undegraded":"2024-08-18T22:27:23.538940+0000","last_fullsized":"2024-08-18T22:27:23.538940+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537621+0000","last_change":"2024-08-18T22:27:23.537621+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537621+0000","last_undegraded":"2024-08-18T22:27:23.537621+0000","last_fullsized":"2024-08-18T22:27:23.537621+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530993+0000","last_change":"2024-08-18T22:27:23.530993+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530993+0000","last_undegraded":"2024-08-18T22:27:23.530993+0000","last_fullsized":"2024-08-18T22:27:23.530993+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.574253+0000","last_change":"2024-08-18T22:27:24.566222+0000","last_active":"2024-08-18T22:27:24.574253+0000","last_peered":"2024-08-18T22:27:24.574253+0000","last_clean":"2024-08-18T22:27:24.574253+0000","last_became_active":"2024-08-18T22:27:24.565894+0000","last_became_peered":"2024-08-18T22:27:24.565894+0000","last_unstale":"2024-08-18T22:27:24.574253+0000","last_undegraded":"2024-08-18T22:27:24.574253+0000","last_fullsized":"2024-08-18T22:27:24.574253+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:47.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.544293+0000","last_change":"2024-08-18T22:27:23.544293+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.544293+0000","last_undegraded":"2024-08-18T22:27:23.544293+0000","last_fullsized":"2024-08-18T22:27:23.544293+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.544786+0000","last_change":"2024-08-18T22:27:23.544786+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.544786+0000","last_undegraded":"2024-08-18T22:27:23.544786+0000","last_fullsized":"2024-08-18T22:27:23.544786+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.535383+0000","last_change":"2024-08-18T22:27:23.535383+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.535383+0000","last_undegraded":"2024-08-18T22:27:23.535383+0000","last_fullsized":"2024-08-18T22:27:23.535383+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532994+0000","last_change":"2024-08-18T22:27:23.532994+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532994+0000","last_undegraded":"2024-08-18T22:27:23.532994+0000","last_fullsized":"2024-08-18T22:27:23.532994+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.534184+0000","last_change":"2024-08-18T22:27:23.534184+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.534184+0000","last_undegraded":"2024-08-18T22:27:23.534184+0000","last_fullsized":"2024-08-18T22:27:23.534184+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.581951+0000","last_change":"2024-08-18T22:27:24.577512+0000","last_active":"2024-08-18T22:27:24.581951+0000","last_peered":"2024-08-18T22:27:24.581951+0000","last_clean":"2024-08-18T22:27:24.581951+0000","last_became_active":"2024-08-18T22:27:24.577167+0000","last_became_peered":"2024-08-18T22:27:24.577167+0000","last_unstale":"2024-08-18T22:27:24.581951+0000","last_undegraded":"2024-08-18T22:27:24.581951+0000","last_fullsized":"2024-08-18T22:27:24.581951+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:41:25.724936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.544304+0000","last_change":"2024-08-18T22:27:23.544304+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.544304+0000","last_undegraded":"2024-08-18T22:27:23.544304+0000","last_fullsized":"2024-08-18T22:27:23.544304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537892+0000","last_change":"2024-08-18T22:27:23.537892+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537892+0000","last_undegraded":"2024-08-18T22:27:23.537892+0000","last_fullsized":"2024-08-18T22:27:23.537892+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.542936+0000","last_change":"2024-08-18T22:27:23.542936+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.542936+0000","last_undegraded":"2024-08-18T22:27:23.542936+0000","last_fullsized":"2024-08-18T22:27:23.542936+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.587114+0000","last_change":"2024-08-18T22:27:24.586295+0000","last_active":"2024-08-18T22:27:24.587114+0000","last_peered":"2024-08-18T22:27:24.587114+0000","last_clean":"2024-08-18T22:27:24.587114+0000","last_became_active":"2024-08-18T22:27:24.585876+0000","last_became_peered":"2024-08-18T22:27:24.585876+0000","last_unstale":"2024-08-18T22:27:24.587114+0000","last_undegraded":"2024-08-18T22:27:24.587114+0000","last_fullsized":"2024-08-18T22:27:24.587114+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:06:20.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541489+0000","last_change":"2024-08-18T22:27:23.541489+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541489+0000","last_undegraded":"2024-08-18T22:27:23.541489+0000","last_fullsized":"2024-08-18T22:27:23.541489+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533559+0000","last_change":"2024-08-18T22:27:23.533559+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533559+0000","last_undegraded":"2024-08-18T22:27:23.533559+0000","last_fullsized":"2024-08-18T22:27:23.533559+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538539+0000","last_change":"2024-08-18T22:27:23.538539+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538539+0000","last_undegraded":"2024-08-18T22:27:23.538539+0000","last_fullsized":"2024-08-18T22:27:23.538539+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.531879+0000","last_change":"2024-08-18T22:27:23.531879+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.531879+0000","last_undegraded":"2024-08-18T22:27:23.531879+0000","last_fullsized":"2024-08-18T22:27:23.531879+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.576321+0000","last_change":"2024-08-18T22:27:24.572897+0000","last_active":"2024-08-18T22:27:24.576321+0000","last_peered":"2024-08-18T22:27:24.576321+0000","last_clean":"2024-08-18T22:27:24.576321+0000","last_became_active":"2024-08-18T22:27:24.572530+0000","last_became_peered":"2024-08-18T22:27:24.572530+0000","last_unstale":"2024-08-18T22:27:24.576321+0000","last_undegraded":"2024-08-18T22:27:24.576321+0000","last_fullsized":"2024-08-18T22:27:24.576321+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:30:27.384406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532332+0000","last_change":"2024-08-18T22:27:23.532332+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532332+0000","last_undegraded":"2024-08-18T22:27:23.532332+0000","last_fullsized":"2024-08-18T22:27:23.532332+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.572238+0000","last_change":"2024-08-18T22:27:24.560726+0000","last_active":"2024-08-18T22:27:24.572238+0000","last_peered":"2024-08-18T22:27:24.572238+0000","last_clean":"2024-08-18T22:27:24.572238+0000","last_became_active":"2024-08-18T22:27:24.560454+0000","last_became_peered":"2024-08-18T22:27:24.560454+0000","last_unstale":"2024-08-18T22:27:24.572238+0000","last_undegraded":"2024-08-18T22:27:24.572238+0000","last_fullsized":"2024-08-18T22:27:24.572238+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:34.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533002+0000","last_change":"2024-08-18T22:27:23.533002+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533002+0000","last_undegraded":"2024-08-18T22:27:23.533002+0000","last_fullsized":"2024-08-18T22:27:23.533002+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538758+0000","last_change":"2024-08-18T22:27:23.538758+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538758+0000","last_undegraded":"2024-08-18T22:27:23.538758+0000","last_fullsized":"2024-08-18T22:27:23.538758+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540721+0000","last_change":"2024-08-18T22:27:23.540721+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540721+0000","last_undegraded":"2024-08-18T22:27:23.540721+0000","last_fullsized":"2024-08-18T22:27:23.540721+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570882+0000","last_change":"2024-08-18T22:27:24.567510+0000","last_active":"2024-08-18T22:27:24.570882+0000","last_peered":"2024-08-18T22:27:24.570882+0000","last_clean":"2024-08-18T22:27:24.570882+0000","last_became_active":"2024-08-18T22:27:24.565899+0000","last_became_peered":"2024-08-18T22:27:24.565899+0000","last_unstale":"2024-08-18T22:27:24.570882+0000","last_undegraded":"2024-08-18T22:27:24.570882+0000","last_fullsized":"2024-08-18T22:27:24.570882+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:11.259055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530226+0000","last_change":"2024-08-18T22:27:23.530226+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530226+0000","last_undegraded":"2024-08-18T22:27:23.530226+0000","last_fullsized":"2024-08-18T22:27:23.530226+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.539759+0000","last_change":"2024-08-18T22:27:23.539759+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.539759+0000","last_undegraded":"2024-08-18T22:27:23.539759+0000","last_fullsized":"2024-08-18T22:27:23.539759+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570845+0000","last_change":"2024-08-18T22:27:24.569829+0000","last_active":"2024-08-18T22:27:24.570845+0000","last_peered":"2024-08-18T22:27:24.570845+0000","last_clean":"2024-08-18T22:27:24.570845+0000","last_became_active":"2024-08-18T22:27:24.569543+0000","last_became_peered":"2024-08-18T22:27:24.569543+0000","last_unstale":"2024-08-18T22:27:24.570845+0000","last_undegraded":"2024-08-18T22:27:24.570845+0000","last_fullsized":"2024-08-18T22:27:24.570845+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:02.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537507+0000","last_change":"2024-08-18T22:27:23.537507+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537507+0000","last_undegraded":"2024-08-18T22:27:23.537507+0000","last_fullsized":"2024-08-18T22:27:23.537507+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538695+0000","last_change":"2024-08-18T22:27:23.538695+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538695+0000","last_undegraded":"2024-08-18T22:27:23.538695+0000","last_fullsized":"2024-08-18T22:27:23.538695+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538264+0000","last_change":"2024-08-18T22:27:23.538264+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538264+0000","last_undegraded":"2024-08-18T22:27:23.538264+0000","last_fullsized":"2024-08-18T22:27:23.538264+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533281+0000","last_change":"2024-08-18T22:27:23.533281+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533281+0000","last_undegraded":"2024-08-18T22:27:23.533281+0000","last_fullsized":"2024-08-18T22:27:23.533281+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.537770+0000","last_change":"2024-08-18T22:27:23.536418+0000","last_active":"2024-08-18T22:27:23.537770+0000","last_peered":"2024-08-18T22:27:23.537770+0000","last_clean":"2024-08-18T22:27:23.537770+0000","last_became_active":"2024-08-18T22:27:23.536127+0000","last_became_peered":"2024-08-18T22:27:23.536127+0000","last_unstale":"2024-08-18T22:27:23.537770+0000","last_undegraded":"2024-08-18T22:27:23.537770+0000","last_fullsized":"2024-08-18T22:27:23.537770+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:03.786373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.539741+0000","last_change":"2024-08-18T22:27:23.539741+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.539741+0000","last_undegraded":"2024-08-18T22:27:23.539741+0000","last_fullsized":"2024-08-18T22:27:23.539741+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.550328+0000","last_change":"2024-08-18T22:27:23.544340+0000","last_active":"2024-08-18T22:27:23.550328+0000","last_peered":"2024-08-18T22:27:23.550328+0000","last_clean":"2024-08-18T22:27:23.550328+0000","last_became_active":"2024-08-18T22:27:23.543926+0000","last_became_peered":"2024-08-18T22:27:23.543926+0000","last_unstale":"2024-08-18T22:27:23.550328+0000","last_undegraded":"2024-08-18T22:27:23.550328+0000","last_fullsized":"2024-08-18T22:27:23.550328+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:33.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540478+0000","last_change":"2024-08-18T22:27:23.540478+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540478+0000","last_undegraded":"2024-08-18T22:27:23.540478+0000","last_fullsized":"2024-08-18T22:27:23.540478+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551665+0000","last_change":"2024-08-18T22:27:23.544721+0000","last_active":"2024-08-18T22:27:23.551665+0000","last_peered":"2024-08-18T22:27:23.551665+0000","last_clean":"2024-08-18T22:27:23.551665+0000","last_became_active":"2024-08-18T22:27:23.544394+0000","last_became_peered":"2024-08-18T22:27:23.544394+0000","last_unstale":"2024-08-18T22:27:23.551665+0000","last_undegraded":"2024-08-18T22:27:23.551665+0000","last_fullsized":"2024-08-18T22:27:23.551665+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:42.486701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.531968+0000","last_change":"2024-08-18T22:27:23.531968+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.531968+0000","last_undegraded":"2024-08-18T22:27:23.531968+0000","last_fullsized":"2024-08-18T22:27:23.531968+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.550528+0000","last_change":"2024-08-18T22:27:23.547814+0000","last_active":"2024-08-18T22:27:23.550528+0000","last_peered":"2024-08-18T22:27:23.550528+0000","last_clean":"2024-08-18T22:27:23.550528+0000","last_became_active":"2024-08-18T22:27:23.547540+0000","last_became_peered":"2024-08-18T22:27:23.547540+0000","last_unstale":"2024-08-18T22:27:23.550528+0000","last_undegraded":"2024-08-18T22:27:23.550528+0000","last_fullsized":"2024-08-18T22:27:23.550528+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:54.945688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532861+0000","last_change":"2024-08-18T22:27:23.532861+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532861+0000","last_undegraded":"2024-08-18T22:27:23.532861+0000","last_fullsized":"2024-08-18T22:27:23.532861+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.583668+0000","last_change":"2024-08-18T22:27:23.546555+0000","last_active":"2024-08-18T22:27:24.583668+0000","last_peered":"2024-08-18T22:27:24.583668+0000","last_clean":"2024-08-18T22:27:24.583668+0000","last_became_active":"2024-08-18T22:27:23.544681+0000","last_became_peered":"2024-08-18T22:27:23.544681+0000","last_unstale":"2024-08-18T22:27:24.583668+0000","last_undegraded":"2024-08-18T22:27:24.583668+0000","last_fullsized":"2024-08-18T22:27:24.583668+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:57.484511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.569480+0000","last_change":"2024-08-18T22:27:24.559554+0000","last_active":"2024-08-18T22:27:24.569480+0000","last_peered":"2024-08-18T22:27:24.569480+0000","last_clean":"2024-08-18T22:27:24.569480+0000","last_became_active":"2024-08-18T22:27:24.559262+0000","last_became_peered":"2024-08-18T22:27:24.559262+0000","last_unstale":"2024-08-18T22:27:24.569480+0000","last_undegraded":"2024-08-18T22:27:24.569480+0000","last_fullsized":"2024-08-18T22:27:24.569480+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:36.984658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556274+0000","last_change":"2024-08-18T22:27:23.553332+0000","last_active":"2024-08-18T22:27:23.556274+0000","last_peered":"2024-08-18T22:27:23.556274+0000","last_clean":"2024-08-18T22:27:23.556274+0000","last_became_active":"2024-08-18T22:27:23.550173+0000","last_became_peered":"2024-08-18T22:27:23.550173+0000","last_unstale":"2024-08-18T22:27:23.556274+0000","last_undegraded":"2024-08-18T22:27:23.556274+0000","last_fullsized":"2024-08-18T22:27:23.556274+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:08:02.994973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.537101+0000","last_change":"2024-08-18T22:27:23.537101+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.537101+0000","last_undegraded":"2024-08-18T22:27:23.537101+0000","last_fullsized":"2024-08-18T22:27:23.537101+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.549080+0000","last_change":"2024-08-18T22:27:23.544298+0000","last_active":"2024-08-18T22:27:23.549080+0000","last_peered":"2024-08-18T22:27:23.549080+0000","last_clean":"2024-08-18T22:27:23.549080+0000","last_became_active":"2024-08-18T22:27:23.543996+0000","last_became_peered":"2024-08-18T22:27:23.543996+0000","last_unstale":"2024-08-18T22:27:23.549080+0000","last_undegraded":"2024-08-18T22:27:23.549080+0000","last_fullsized":"2024-08-18T22:27:23.549080+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:03.786373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533962+0000","last_change":"2024-08-18T22:27:23.533962+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533962+0000","last_undegraded":"2024-08-18T22:27:23.533962+0000","last_fullsized":"2024-08-18T22:27:23.533962+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.555766+0000","last_change":"2024-08-18T22:27:23.547406+0000","last_active":"2024-08-18T22:27:23.555766+0000","last_peered":"2024-08-18T22:27:23.555766+0000","last_clean":"2024-08-18T22:27:23.555766+0000","last_became_active":"2024-08-18T22:27:23.547152+0000","last_became_peered":"2024-08-18T22:27:23.547152+0000","last_unstale":"2024-08-18T22:27:23.555766+0000","last_undegraded":"2024-08-18T22:27:23.555766+0000","last_fullsized":"2024-08-18T22:27:23.555766+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:47.679456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530449+0000","last_change":"2024-08-18T22:27:23.530449+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530449+0000","last_undegraded":"2024-08-18T22:27:23.530449+0000","last_fullsized":"2024-08-18T22:27:23.530449+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.541235+0000","last_change":"2024-08-18T22:27:23.538603+0000","last_active":"2024-08-18T22:27:23.541235+0000","last_peered":"2024-08-18T22:27:23.541235+0000","last_clean":"2024-08-18T22:27:23.541235+0000","last_became_active":"2024-08-18T22:27:23.538343+0000","last_became_peered":"2024-08-18T22:27:23.538343+0000","last_unstale":"2024-08-18T22:27:23.541235+0000","last_undegraded":"2024-08-18T22:27:23.541235+0000","last_fullsized":"2024-08-18T22:27:23.541235+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:52.763753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540469+0000","last_change":"2024-08-18T22:27:23.540469+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540469+0000","last_undegraded":"2024-08-18T22:27:23.540469+0000","last_fullsized":"2024-08-18T22:27:23.540469+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551913+0000","last_change":"2024-08-18T22:27:23.548166+0000","last_active":"2024-08-18T22:27:23.551913+0000","last_peered":"2024-08-18T22:27:23.551913+0000","last_clean":"2024-08-18T22:27:23.551913+0000","last_became_active":"2024-08-18T22:27:23.547899+0000","last_became_peered":"2024-08-18T22:27:23.547899+0000","last_unstale":"2024-08-18T22:27:23.551913+0000","last_undegraded":"2024-08-18T22:27:23.551913+0000","last_fullsized":"2024-08-18T22:27:23.551913+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:52.763753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.538116+0000","last_change":"2024-08-18T22:27:23.538116+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.538116+0000","last_undegraded":"2024-08-18T22:27:23.538116+0000","last_fullsized":"2024-08-18T22:27:23.538116+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.554849+0000","last_change":"2024-08-18T22:27:23.549127+0000","last_active":"2024-08-18T22:27:23.554849+0000","last_peered":"2024-08-18T22:27:23.554849+0000","last_clean":"2024-08-18T22:27:23.554849+0000","last_became_active":"2024-08-18T22:27:23.548778+0000","last_became_peered":"2024-08-18T22:27:23.548778+0000","last_unstale":"2024-08-18T22:27:23.554849+0000","last_undegraded":"2024-08-18T22:27:23.554849+0000","last_fullsized":"2024-08-18T22:27:23.554849+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:42.031794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540281+0000","last_change":"2024-08-18T22:27:23.540281+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540281+0000","last_undegraded":"2024-08-18T22:27:23.540281+0000","last_fullsized":"2024-08-18T22:27:23.540281+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.552961+0000","last_change":"2024-08-18T22:27:23.551420+0000","last_active":"2024-08-18T22:27:23.552961+0000","last_peered":"2024-08-18T22:27:23.552961+0000","last_clean":"2024-08-18T22:27:23.552961+0000","last_became_active":"2024-08-18T22:27:23.551146+0000","last_became_peered":"2024-08-18T22:27:23.551146+0000","last_unstale":"2024-08-18T22:27:23.552961+0000","last_undegraded":"2024-08-18T22:27:23.552961+0000","last_fullsized":"2024-08-18T22:27:23.552961+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:43:04.208784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530192+0000","last_change":"2024-08-18T22:27:23.530192+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530192+0000","last_undegraded":"2024-08-18T22:27:23.530192+0000","last_fullsized":"2024-08-18T22:27:23.530192+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.555448+0000","last_change":"2024-08-18T22:27:23.554557+0000","last_active":"2024-08-18T22:27:23.555448+0000","last_peered":"2024-08-18T22:27:23.555448+0000","last_clean":"2024-08-18T22:27:23.555448+0000","last_became_active":"2024-08-18T22:27:23.554293+0000","last_became_peered":"2024-08-18T22:27:23.554293+0000","last_unstale":"2024-08-18T22:27:23.555448+0000","last_undegraded":"2024-08-18T22:27:23.555448+0000","last_fullsized":"2024-08-18T22:27:23.555448+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:28.147793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532488+0000","last_change":"2024-08-18T22:27:23.532488+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532488+0000","last_undegraded":"2024-08-18T22:27:23.532488+0000","last_fullsized":"2024-08-18T22:27:23.532488+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.553883+0000","last_change":"2024-08-18T22:27:23.552723+0000","last_active":"2024-08-18T22:27:23.553883+0000","last_peered":"2024-08-18T22:27:23.553883+0000","last_clean":"2024-08-18T22:27:23.553883+0000","last_became_active":"2024-08-18T22:27:23.552457+0000","last_became_peered":"2024-08-18T22:27:23.552457+0000","last_unstale":"2024-08-18T22:27:23.553883+0000","last_undegraded":"2024-08-18T22:27:23.553883+0000","last_fullsized":"2024-08-18T22:27:23.553883+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:35.137950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.576445+0000","last_change":"2024-08-18T22:27:24.573855+0000","last_active":"2024-08-18T22:27:24.576445+0000","last_peered":"2024-08-18T22:27:24.576445+0000","last_clean":"2024-08-18T22:27:24.576445+0000","last_became_active":"2024-08-18T22:27:24.573562+0000","last_became_peered":"2024-08-18T22:27:24.573562+0000","last_unstale":"2024-08-18T22:27:24.576445+0000","last_undegraded":"2024-08-18T22:27:24.576445+0000","last_fullsized":"2024-08-18T22:27:24.576445+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:15.654628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.553077+0000","last_change":"2024-08-18T22:27:23.552008+0000","last_active":"2024-08-18T22:27:23.553077+0000","last_peered":"2024-08-18T22:27:23.553077+0000","last_clean":"2024-08-18T22:27:23.553077+0000","last_became_active":"2024-08-18T22:27:23.551740+0000","last_became_peered":"2024-08-18T22:27:23.551740+0000","last_unstale":"2024-08-18T22:27:23.553077+0000","last_undegraded":"2024-08-18T22:27:23.553077+0000","last_fullsized":"2024-08-18T22:27:23.553077+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:18:55.715413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541586+0000","last_change":"2024-08-18T22:27:23.541586+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541586+0000","last_undegraded":"2024-08-18T22:27:23.541586+0000","last_fullsized":"2024-08-18T22:27:23.541586+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.552032+0000","last_change":"2024-08-18T22:27:23.548589+0000","last_active":"2024-08-18T22:27:23.552032+0000","last_peered":"2024-08-18T22:27:23.552032+0000","last_clean":"2024-08-18T22:27:23.552032+0000","last_became_active":"2024-08-18T22:27:23.546800+0000","last_became_peered":"2024-08-18T22:27:23.546800+0000","last_unstale":"2024-08-18T22:27:23.552032+0000","last_undegraded":"2024-08-18T22:27:23.552032+0000","last_fullsized":"2024-08-18T22:27:23.552032+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:03:19.347344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570084+0000","last_change":"2024-08-18T22:27:24.560518+0000","last_active":"2024-08-18T22:27:24.570084+0000","last_peered":"2024-08-18T22:27:24.570084+0000","last_clean":"2024-08-18T22:27:24.570084+0000","last_became_active":"2024-08-18T22:27:24.560227+0000","last_became_peered":"2024-08-18T22:27:24.560227+0000","last_unstale":"2024-08-18T22:27:24.570084+0000","last_undegraded":"2024-08-18T22:27:24.570084+0000","last_fullsized":"2024-08-18T22:27:24.570084+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:16.308159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.582468+0000","last_change":"2024-08-18T22:27:23.545359+0000","last_active":"2024-08-18T22:27:24.582468+0000","last_peered":"2024-08-18T22:27:24.582468+0000","last_clean":"2024-08-18T22:27:24.582468+0000","last_became_active":"2024-08-18T22:27:23.545080+0000","last_became_peered":"2024-08-18T22:27:23.545080+0000","last_unstale":"2024-08-18T22:27:24.582468+0000","last_undegraded":"2024-08-18T22:27:24.582468+0000","last_fullsized":"2024-08-18T22:27:24.582468+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:05:03.331984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.535471+0000","last_change":"2024-08-18T22:27:23.535471+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.535471+0000","last_undegraded":"2024-08-18T22:27:23.535471+0000","last_fullsized":"2024-08-18T22:27:23.535471+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551886+0000","last_change":"2024-08-18T22:27:23.546608+0000","last_active":"2024-08-18T22:27:23.551886+0000","last_peered":"2024-08-18T22:27:23.551886+0000","last_clean":"2024-08-18T22:27:23.551886+0000","last_became_active":"2024-08-18T22:27:23.546365+0000","last_became_peered":"2024-08-18T22:27:23.546365+0000","last_unstale":"2024-08-18T22:27:23.551886+0000","last_undegraded":"2024-08-18T22:27:23.551886+0000","last_fullsized":"2024-08-18T22:27:23.551886+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:32.512213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.539776+0000","last_change":"2024-08-18T22:27:23.539776+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.539776+0000","last_undegraded":"2024-08-18T22:27:23.539776+0000","last_fullsized":"2024-08-18T22:27:23.539776+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.545115+0000","last_change":"2024-08-18T22:27:23.542231+0000","last_active":"2024-08-18T22:27:23.545115+0000","last_peered":"2024-08-18T22:27:23.545115+0000","last_clean":"2024-08-18T22:27:23.545115+0000","last_became_active":"2024-08-18T22:27:23.541939+0000","last_became_peered":"2024-08-18T22:27:23.541939+0000","last_unstale":"2024-08-18T22:27:23.545115+0000","last_undegraded":"2024-08-18T22:27:23.545115+0000","last_fullsized":"2024-08-18T22:27:23.545115+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:42.031794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.534771+0000","last_change":"2024-08-18T22:27:23.534771+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.534771+0000","last_undegraded":"2024-08-18T22:27:23.534771+0000","last_fullsized":"2024-08-18T22:27:23.534771+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.555480+0000","last_change":"2024-08-18T22:27:23.545503+0000","last_active":"2024-08-18T22:27:23.555480+0000","last_peered":"2024-08-18T22:27:23.555480+0000","last_clean":"2024-08-18T22:27:23.555480+0000","last_became_active":"2024-08-18T22:27:23.545228+0000","last_became_peered":"2024-08-18T22:27:23.545228+0000","last_unstale":"2024-08-18T22:27:23.555480+0000","last_undegraded":"2024-08-18T22:27:23.555480+0000","last_fullsized":"2024-08-18T22:27:23.555480+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.677848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541397+0000","last_change":"2024-08-18T22:27:23.541397+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541397+0000","last_undegraded":"2024-08-18T22:27:23.541397+0000","last_fullsized":"2024-08-18T22:27:23.541397+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.541051+0000","last_change":"2024-08-18T22:27:23.539599+0000","last_active":"2024-08-18T22:27:23.541051+0000","last_peered":"2024-08-18T22:27:23.541051+0000","last_clean":"2024-08-18T22:27:23.541051+0000","last_became_active":"2024-08-18T22:27:23.539322+0000","last_became_peered":"2024-08-18T22:27:23.539322+0000","last_unstale":"2024-08-18T22:27:23.541051+0000","last_undegraded":"2024-08-18T22:27:23.541051+0000","last_fullsized":"2024-08-18T22:27:23.541051+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:52.763753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.536728+0000","last_change":"2024-08-18T22:27:23.536728+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.536728+0000","last_undegraded":"2024-08-18T22:27:23.536728+0000","last_fullsized":"2024-08-18T22:27:23.536728+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.548225+0000","last_change":"2024-08-18T22:27:23.544336+0000","last_active":"2024-08-18T22:27:23.548225+0000","last_peered":"2024-08-18T22:27:23.548225+0000","last_clean":"2024-08-18T22:27:23.548225+0000","last_became_active":"2024-08-18T22:27:23.544058+0000","last_became_peered":"2024-08-18T22:27:23.544058+0000","last_unstale":"2024-08-18T22:27:23.548225+0000","last_undegraded":"2024-08-18T22:27:23.548225+0000","last_fullsized":"2024-08-18T22:27:23.548225+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:21.461235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.541359+0000","last_change":"2024-08-18T22:27:23.541359+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.541359+0000","last_undegraded":"2024-08-18T22:27:23.541359+0000","last_fullsized":"2024-08-18T22:27:23.541359+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.551988+0000","last_change":"2024-08-18T22:27:23.547090+0000","last_active":"2024-08-18T22:27:23.551988+0000","last_peered":"2024-08-18T22:27:23.551988+0000","last_clean":"2024-08-18T22:27:23.551988+0000","last_became_active":"2024-08-18T22:27:23.546820+0000","last_became_peered":"2024-08-18T22:27:23.546820+0000","last_unstale":"2024-08-18T22:27:23.551988+0000","last_undegraded":"2024-08-18T22:27:23.551988+0000","last_fullsized":"2024-08-18T22:27:23.551988+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:50.977899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533300+0000","last_change":"2024-08-18T22:27:23.533300+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533300+0000","last_undegraded":"2024-08-18T22:27:23.533300+0000","last_fullsized":"2024-08-18T22:27:23.533300+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556194+0000","last_change":"2024-08-18T22:27:23.551796+0000","last_active":"2024-08-18T22:27:23.556194+0000","last_peered":"2024-08-18T22:27:23.556194+0000","last_clean":"2024-08-18T22:27:23.556194+0000","last_became_active":"2024-08-18T22:27:23.551536+0000","last_became_peered":"2024-08-18T22:27:23.551536+0000","last_unstale":"2024-08-18T22:27:23.556194+0000","last_undegraded":"2024-08-18T22:27:23.556194+0000","last_fullsized":"2024-08-18T22:27:23.556194+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:25.201562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.532481+0000","last_change":"2024-08-18T22:27:23.532481+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.532481+0000","last_undegraded":"2024-08-18T22:27:23.532481+0000","last_fullsized":"2024-08-18T22:27:23.532481+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.549202+0000","last_change":"2024-08-18T22:27:23.547122+0000","last_active":"2024-08-18T22:27:23.549202+0000","last_peered":"2024-08-18T22:27:23.549202+0000","last_clean":"2024-08-18T22:27:23.549202+0000","last_became_active":"2024-08-18T22:27:23.546628+0000","last_became_peered":"2024-08-18T22:27:23.546628+0000","last_unstale":"2024-08-18T22:27:23.549202+0000","last_undegraded":"2024-08-18T22:27:23.549202+0000","last_fullsized":"2024-08-18T22:27:23.549202+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:42.486701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.533486+0000","last_change":"2024-08-18T22:27:23.533486+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.533486+0000","last_undegraded":"2024-08-18T22:27:23.533486+0000","last_fullsized":"2024-08-18T22:27:23.533486+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.541267+0000","last_change":"2024-08-18T22:27:23.539274+0000","last_active":"2024-08-18T22:27:23.541267+0000","last_peered":"2024-08-18T22:27:23.541267+0000","last_clean":"2024-08-18T22:27:23.541267+0000","last_became_active":"2024-08-18T22:27:23.538927+0000","last_became_peered":"2024-08-18T22:27:23.538927+0000","last_unstale":"2024-08-18T22:27:23.541267+0000","last_undegraded":"2024-08-18T22:27:23.541267+0000","last_fullsized":"2024-08-18T22:27:23.541267+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:42.031794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.588902+0000","last_change":"2024-08-18T22:27:24.588134+0000","last_active":"2024-08-18T22:27:24.588902+0000","last_peered":"2024-08-18T22:27:24.588902+0000","last_clean":"2024-08-18T22:27:24.588902+0000","last_became_active":"2024-08-18T22:27:24.587781+0000","last_became_peered":"2024-08-18T22:27:24.587781+0000","last_unstale":"2024-08-18T22:27:24.588902+0000","last_undegraded":"2024-08-18T22:27:24.588902+0000","last_fullsized":"2024-08-18T22:27:24.588902+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:34.370960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556100+0000","last_change":"2024-08-18T22:27:23.549252+0000","last_active":"2024-08-18T22:27:23.556100+0000","last_peered":"2024-08-18T22:27:23.556100+0000","last_clean":"2024-08-18T22:27:23.556100+0000","last_became_active":"2024-08-18T22:27:23.548968+0000","last_became_peered":"2024-08-18T22:27:23.548968+0000","last_unstale":"2024-08-18T22:27:23.556100+0000","last_undegraded":"2024-08-18T22:27:23.556100+0000","last_fullsized":"2024-08-18T22:27:23.556100+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:31.597239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.534325+0000","last_change":"2024-08-18T22:27:23.534325+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.534325+0000","last_undegraded":"2024-08-18T22:27:23.534325+0000","last_fullsized":"2024-08-18T22:27:23.534325+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.549661+0000","last_change":"2024-08-18T22:27:23.550306+0000","last_active":"2024-08-18T22:27:24.549661+0000","last_peered":"2024-08-18T22:27:24.549661+0000","last_clean":"2024-08-18T22:27:24.549661+0000","last_became_active":"2024-08-18T22:27:23.549975+0000","last_became_peered":"2024-08-18T22:27:23.549975+0000","last_unstale":"2024-08-18T22:27:24.549661+0000","last_undegraded":"2024-08-18T22:27:24.549661+0000","last_fullsized":"2024-08-18T22:27:24.549661+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:01:11.437061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.540847+0000","last_change":"2024-08-18T22:27:23.540847+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.540847+0000","last_undegraded":"2024-08-18T22:27:23.540847+0000","last_fullsized":"2024-08-18T22:27:23.540847+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.548932+0000","last_change":"2024-08-18T22:27:23.545190+0000","last_active":"2024-08-18T22:27:24.548932+0000","last_peered":"2024-08-18T22:27:24.548932+0000","last_clean":"2024-08-18T22:27:24.548932+0000","last_became_active":"2024-08-18T22:27:23.544813+0000","last_became_peered":"2024-08-18T22:27:23.544813+0000","last_unstale":"2024-08-18T22:27:24.548932+0000","last_undegraded":"2024-08-18T22:27:24.548932+0000","last_fullsized":"2024-08-18T22:27:24.548932+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:53.358060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530918+0000","last_change":"2024-08-18T22:27:23.530918+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530918+0000","last_undegraded":"2024-08-18T22:27:23.530918+0000","last_fullsized":"2024-08-18T22:27:23.530918+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.556254+0000","last_change":"2024-08-18T22:27:23.553339+0000","last_active":"2024-08-18T22:27:23.556254+0000","last_peered":"2024-08-18T22:27:23.556254+0000","last_clean":"2024-08-18T22:27:23.556254+0000","last_became_active":"2024-08-18T22:27:23.548574+0000","last_became_peered":"2024-08-18T22:27:23.548574+0000","last_unstale":"2024-08-18T22:27:23.556254+0000","last_undegraded":"2024-08-18T22:27:23.556254+0000","last_fullsized":"2024-08-18T22:27:23.556254+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:32.032718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.531793+0000","last_change":"2024-08-18T22:27:23.531793+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.531793+0000","last_undegraded":"2024-08-18T22:27:23.531793+0000","last_fullsized":"2024-08-18T22:27:23.531793+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.540628+0000","last_change":"2024-08-18T22:27:23.536731+0000","last_active":"2024-08-18T22:27:23.540628+0000","last_peered":"2024-08-18T22:27:23.540628+0000","last_clean":"2024-08-18T22:27:23.540628+0000","last_became_active":"2024-08-18T22:27:23.536418+0000","last_became_peered":"2024-08-18T22:27:23.536418+0000","last_unstale":"2024-08-18T22:27:23.540628+0000","last_undegraded":"2024-08-18T22:27:23.540628+0000","last_fullsized":"2024-08-18T22:27:23.540628+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:03.786373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-08-18T22:27:23.530872+0000","last_change":"2024-08-18T22:27:23.530872+0000","last_active":"2024-08-18T22:27:23.520247+0000","last_peered":"2024-08-18T22:27:23.520247+0000","last_clean":"2024-08-18T22:27:23.520247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:27:23.530872+0000","last_undegraded":"2024-08-18T22:27:23.530872+0000","last_fullsized":"2024-08-18T22:27:23.530872+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.554404+0000","last_change":"2024-08-18T22:27:23.553624+0000","last_active":"2024-08-18T22:27:23.554404+0000","last_peered":"2024-08-18T22:27:23.554404+0000","last_clean":"2024-08-18T22:27:23.554404+0000","last_became_active":"2024-08-18T22:27:23.553355+0000","last_became_peered":"2024-08-18T22:27:23.553355+0000","last_unstale":"2024-08-18T22:27:23.554404+0000","last_undegraded":"2024-08-18T22:27:23.554404+0000","last_fullsized":"2024-08-18T22:27:23.554404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:15.048010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":386,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-08-18T22:27:23.531668+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:27:23.531668+0000","last_peered":"2024-08-18T22:27:23.531668+0000","last_clean":"2024-08-18T22:27:23.531668+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:27:23.531668+0000","last_undegraded":"2024-08-18T22:27:23.531668+0000","last_fullsized":"2024-08-18T22:27:23.531668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41604,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330236,"statfs":{"total":96636764160,"available":96594161664,"internally_reserved":0,"allocated":2154496,"data_stored":1322855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509544,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41024,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330816,"statfs":{"total":96636764160,"available":96594755584,"internally_reserved":0,"allocated":1560576,"data_stored":732487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41024,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330816,"statfs":{"total":96636764160,"available":96594755584,"internally_reserved":0,"allocated":1560576,"data_stored":732487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509543,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50752,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321088,"statfs":{"total":96636764160,"available":96584794112,"internally_reserved":0,"allocated":1560576,"data_stored":732487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50768,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321072,"statfs":{"total":96636764160,"available":96584777728,"internally_reserved":0,"allocated":1572864,"data_stored":739154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51332,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320508,"statfs":{"total":96636764160,"available":96584200192,"internally_reserved":0,"allocated":2154496,"data_stored":1322855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50788,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321052,"statfs":{"total":96636764160,"available":96584757248,"internally_reserved":0,"allocated":1597440,"data_stored":747933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574951,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50780,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321060,"statfs":{"total":96636764160,"available":96584765440,"internally_reserved":0,"allocated":1585152,"data_stored":746321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:27:29.471 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3e is not active+clean 2024-08-18T22:27:29.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.538940+0000', 'last_change': '2024-08-18T22:27:23.538940+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.538940+0000', 'last_undegraded': '2024-08-18T22:27:23.538940+0000', 'last_fullsized': '2024-08-18T22:27:23.538940+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:27:29.471 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3d is not active+clean 2024-08-18T22:27:29.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.537621+0000', 'last_change': '2024-08-18T22:27:23.537621+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.537621+0000', 'last_undegraded': '2024-08-18T22:27:23.537621+0000', 'last_fullsized': '2024-08-18T22:27:23.537621+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:27:29.472 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3c is not active+clean 2024-08-18T22:27:29.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.530993+0000', 'last_change': '2024-08-18T22:27:23.530993+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.530993+0000', 'last_undegraded': '2024-08-18T22:27:23.530993+0000', 'last_fullsized': '2024-08-18T22:27:23.530993+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:27:29.472 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3a is not active+clean 2024-08-18T22:27:29.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.544293+0000', 'last_change': '2024-08-18T22:27:23.544293+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.544293+0000', 'last_undegraded': '2024-08-18T22:27:23.544293+0000', 'last_fullsized': '2024-08-18T22:27:23.544293+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:27:29.472 INFO:tasks.ceph.ceph_manager.ceph:PG 18.39 is not active+clean 2024-08-18T22:27:29.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.544786+0000', 'last_change': '2024-08-18T22:27:23.544786+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.544786+0000', 'last_undegraded': '2024-08-18T22:27:23.544786+0000', 'last_fullsized': '2024-08-18T22:27:23.544786+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:27:29.472 INFO:tasks.ceph.ceph_manager.ceph:PG 18.38 is not active+clean 2024-08-18T22:27:29.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.535383+0000', 'last_change': '2024-08-18T22:27:23.535383+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.535383+0000', 'last_undegraded': '2024-08-18T22:27:23.535383+0000', 'last_fullsized': '2024-08-18T22:27:23.535383+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:27:29.472 INFO:tasks.ceph.ceph_manager.ceph:PG 18.37 is not active+clean 2024-08-18T22:27:29.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.532994+0000', 'last_change': '2024-08-18T22:27:23.532994+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.532994+0000', 'last_undegraded': '2024-08-18T22:27:23.532994+0000', 'last_fullsized': '2024-08-18T22:27:23.532994+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:27:29.473 INFO:tasks.ceph.ceph_manager.ceph:PG 18.36 is not active+clean 2024-08-18T22:27:29.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.534184+0000', 'last_change': '2024-08-18T22:27:23.534184+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.534184+0000', 'last_undegraded': '2024-08-18T22:27:23.534184+0000', 'last_fullsized': '2024-08-18T22:27:23.534184+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:27:29.473 INFO:tasks.ceph.ceph_manager.ceph:PG 18.34 is not active+clean 2024-08-18T22:27:29.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.544304+0000', 'last_change': '2024-08-18T22:27:23.544304+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.544304+0000', 'last_undegraded': '2024-08-18T22:27:23.544304+0000', 'last_fullsized': '2024-08-18T22:27:23.544304+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:27:29.473 INFO:tasks.ceph.ceph_manager.ceph:PG 18.33 is not active+clean 2024-08-18T22:27:29.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.537892+0000', 'last_change': '2024-08-18T22:27:23.537892+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.537892+0000', 'last_undegraded': '2024-08-18T22:27:23.537892+0000', 'last_fullsized': '2024-08-18T22:27:23.537892+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:27:29.473 INFO:tasks.ceph.ceph_manager.ceph:PG 18.32 is not active+clean 2024-08-18T22:27:29.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.542936+0000', 'last_change': '2024-08-18T22:27:23.542936+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.542936+0000', 'last_undegraded': '2024-08-18T22:27:23.542936+0000', 'last_fullsized': '2024-08-18T22:27:23.542936+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:27:29.473 INFO:tasks.ceph.ceph_manager.ceph:PG 18.30 is not active+clean 2024-08-18T22:27:29.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.541489+0000', 'last_change': '2024-08-18T22:27:23.541489+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.541489+0000', 'last_undegraded': '2024-08-18T22:27:23.541489+0000', 'last_fullsized': '2024-08-18T22:27:23.541489+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:27:29.474 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2f is not active+clean 2024-08-18T22:27:29.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.533559+0000', 'last_change': '2024-08-18T22:27:23.533559+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.533559+0000', 'last_undegraded': '2024-08-18T22:27:23.533559+0000', 'last_fullsized': '2024-08-18T22:27:23.533559+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:27:29.474 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2e is not active+clean 2024-08-18T22:27:29.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.538539+0000', 'last_change': '2024-08-18T22:27:23.538539+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.538539+0000', 'last_undegraded': '2024-08-18T22:27:23.538539+0000', 'last_fullsized': '2024-08-18T22:27:23.538539+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:27:29.474 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2d is not active+clean 2024-08-18T22:27:29.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.531879+0000', 'last_change': '2024-08-18T22:27:23.531879+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.531879+0000', 'last_undegraded': '2024-08-18T22:27:23.531879+0000', 'last_fullsized': '2024-08-18T22:27:23.531879+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:27:29.474 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2b is not active+clean 2024-08-18T22:27:29.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.532332+0000', 'last_change': '2024-08-18T22:27:23.532332+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.532332+0000', 'last_undegraded': '2024-08-18T22:27:23.532332+0000', 'last_fullsized': '2024-08-18T22:27:23.532332+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:27:29.474 INFO:tasks.ceph.ceph_manager.ceph:PG 18.29 is not active+clean 2024-08-18T22:27:29.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.533002+0000', 'last_change': '2024-08-18T22:27:23.533002+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.533002+0000', 'last_undegraded': '2024-08-18T22:27:23.533002+0000', 'last_fullsized': '2024-08-18T22:27:23.533002+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:27:29.475 INFO:tasks.ceph.ceph_manager.ceph:PG 18.28 is not active+clean 2024-08-18T22:27:29.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.538758+0000', 'last_change': '2024-08-18T22:27:23.538758+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.538758+0000', 'last_undegraded': '2024-08-18T22:27:23.538758+0000', 'last_fullsized': '2024-08-18T22:27:23.538758+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:27:29.475 INFO:tasks.ceph.ceph_manager.ceph:PG 18.27 is not active+clean 2024-08-18T22:27:29.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.540721+0000', 'last_change': '2024-08-18T22:27:23.540721+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.540721+0000', 'last_undegraded': '2024-08-18T22:27:23.540721+0000', 'last_fullsized': '2024-08-18T22:27:23.540721+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:27:29.475 INFO:tasks.ceph.ceph_manager.ceph:PG 18.25 is not active+clean 2024-08-18T22:27:29.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.530226+0000', 'last_change': '2024-08-18T22:27:23.530226+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.530226+0000', 'last_undegraded': '2024-08-18T22:27:23.530226+0000', 'last_fullsized': '2024-08-18T22:27:23.530226+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:27:29.475 INFO:tasks.ceph.ceph_manager.ceph:PG 18.24 is not active+clean 2024-08-18T22:27:29.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.539759+0000', 'last_change': '2024-08-18T22:27:23.539759+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.539759+0000', 'last_undegraded': '2024-08-18T22:27:23.539759+0000', 'last_fullsized': '2024-08-18T22:27:23.539759+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:27:29.475 INFO:tasks.ceph.ceph_manager.ceph:PG 18.22 is not active+clean 2024-08-18T22:27:29.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.537507+0000', 'last_change': '2024-08-18T22:27:23.537507+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.537507+0000', 'last_undegraded': '2024-08-18T22:27:23.537507+0000', 'last_fullsized': '2024-08-18T22:27:23.537507+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:27:29.475 INFO:tasks.ceph.ceph_manager.ceph:PG 18.21 is not active+clean 2024-08-18T22:27:29.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.538695+0000', 'last_change': '2024-08-18T22:27:23.538695+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.538695+0000', 'last_undegraded': '2024-08-18T22:27:23.538695+0000', 'last_fullsized': '2024-08-18T22:27:23.538695+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:27:29.476 INFO:tasks.ceph.ceph_manager.ceph:PG 18.20 is not active+clean 2024-08-18T22:27:29.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.538264+0000', 'last_change': '2024-08-18T22:27:23.538264+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.538264+0000', 'last_undegraded': '2024-08-18T22:27:23.538264+0000', 'last_fullsized': '2024-08-18T22:27:23.538264+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:27:29.476 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1c is not active+clean 2024-08-18T22:27:29.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.533281+0000', 'last_change': '2024-08-18T22:27:23.533281+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.533281+0000', 'last_undegraded': '2024-08-18T22:27:23.533281+0000', 'last_fullsized': '2024-08-18T22:27:23.533281+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:27:29.476 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1d is not active+clean 2024-08-18T22:27:29.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.539741+0000', 'last_change': '2024-08-18T22:27:23.539741+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.539741+0000', 'last_undegraded': '2024-08-18T22:27:23.539741+0000', 'last_fullsized': '2024-08-18T22:27:23.539741+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:27:29.476 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1e is not active+clean 2024-08-18T22:27:29.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.540478+0000', 'last_change': '2024-08-18T22:27:23.540478+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.540478+0000', 'last_undegraded': '2024-08-18T22:27:23.540478+0000', 'last_fullsized': '2024-08-18T22:27:23.540478+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:27:29.476 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1f is not active+clean 2024-08-18T22:27:29.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.531968+0000', 'last_change': '2024-08-18T22:27:23.531968+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.531968+0000', 'last_undegraded': '2024-08-18T22:27:23.531968+0000', 'last_fullsized': '2024-08-18T22:27:23.531968+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:27:29.477 INFO:tasks.ceph.ceph_manager.ceph:PG 18.18 is not active+clean 2024-08-18T22:27:29.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.532861+0000', 'last_change': '2024-08-18T22:27:23.532861+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.532861+0000', 'last_undegraded': '2024-08-18T22:27:23.532861+0000', 'last_fullsized': '2024-08-18T22:27:23.532861+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:27:29.477 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1a is not active+clean 2024-08-18T22:27:29.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.537101+0000', 'last_change': '2024-08-18T22:27:23.537101+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.537101+0000', 'last_undegraded': '2024-08-18T22:27:23.537101+0000', 'last_fullsized': '2024-08-18T22:27:23.537101+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:27:29.477 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1b is not active+clean 2024-08-18T22:27:29.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.533962+0000', 'last_change': '2024-08-18T22:27:23.533962+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.533962+0000', 'last_undegraded': '2024-08-18T22:27:23.533962+0000', 'last_fullsized': '2024-08-18T22:27:23.533962+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:27:29.477 INFO:tasks.ceph.ceph_manager.ceph:PG 18.14 is not active+clean 2024-08-18T22:27:29.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.530449+0000', 'last_change': '2024-08-18T22:27:23.530449+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.530449+0000', 'last_undegraded': '2024-08-18T22:27:23.530449+0000', 'last_fullsized': '2024-08-18T22:27:23.530449+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:27:29.477 INFO:tasks.ceph.ceph_manager.ceph:PG 18.15 is not active+clean 2024-08-18T22:27:29.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.540469+0000', 'last_change': '2024-08-18T22:27:23.540469+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.540469+0000', 'last_undegraded': '2024-08-18T22:27:23.540469+0000', 'last_fullsized': '2024-08-18T22:27:23.540469+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:27:29.478 INFO:tasks.ceph.ceph_manager.ceph:PG 18.16 is not active+clean 2024-08-18T22:27:29.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.538116+0000', 'last_change': '2024-08-18T22:27:23.538116+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.538116+0000', 'last_undegraded': '2024-08-18T22:27:23.538116+0000', 'last_fullsized': '2024-08-18T22:27:23.538116+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:27:29.478 INFO:tasks.ceph.ceph_manager.ceph:PG 18.17 is not active+clean 2024-08-18T22:27:29.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.540281+0000', 'last_change': '2024-08-18T22:27:23.540281+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.540281+0000', 'last_undegraded': '2024-08-18T22:27:23.540281+0000', 'last_fullsized': '2024-08-18T22:27:23.540281+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:27:29.478 INFO:tasks.ceph.ceph_manager.ceph:PG 18.10 is not active+clean 2024-08-18T22:27:29.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.530192+0000', 'last_change': '2024-08-18T22:27:23.530192+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.530192+0000', 'last_undegraded': '2024-08-18T22:27:23.530192+0000', 'last_fullsized': '2024-08-18T22:27:23.530192+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:27:29.478 INFO:tasks.ceph.ceph_manager.ceph:PG 18.11 is not active+clean 2024-08-18T22:27:29.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.532488+0000', 'last_change': '2024-08-18T22:27:23.532488+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.532488+0000', 'last_undegraded': '2024-08-18T22:27:23.532488+0000', 'last_fullsized': '2024-08-18T22:27:23.532488+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:27:29.478 INFO:tasks.ceph.ceph_manager.ceph:PG 18.c is not active+clean 2024-08-18T22:27:29.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.541586+0000', 'last_change': '2024-08-18T22:27:23.541586+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.541586+0000', 'last_undegraded': '2024-08-18T22:27:23.541586+0000', 'last_fullsized': '2024-08-18T22:27:23.541586+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:27:29.479 INFO:tasks.ceph.ceph_manager.ceph:PG 18.e is not active+clean 2024-08-18T22:27:29.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.535471+0000', 'last_change': '2024-08-18T22:27:23.535471+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.535471+0000', 'last_undegraded': '2024-08-18T22:27:23.535471+0000', 'last_fullsized': '2024-08-18T22:27:23.535471+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:27:29.479 INFO:tasks.ceph.ceph_manager.ceph:PG 18.f is not active+clean 2024-08-18T22:27:29.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.539776+0000', 'last_change': '2024-08-18T22:27:23.539776+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.539776+0000', 'last_undegraded': '2024-08-18T22:27:23.539776+0000', 'last_fullsized': '2024-08-18T22:27:23.539776+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:27:29.479 INFO:tasks.ceph.ceph_manager.ceph:PG 18.8 is not active+clean 2024-08-18T22:27:29.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.534771+0000', 'last_change': '2024-08-18T22:27:23.534771+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.534771+0000', 'last_undegraded': '2024-08-18T22:27:23.534771+0000', 'last_fullsized': '2024-08-18T22:27:23.534771+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:27:29.479 INFO:tasks.ceph.ceph_manager.ceph:PG 18.9 is not active+clean 2024-08-18T22:27:29.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.541397+0000', 'last_change': '2024-08-18T22:27:23.541397+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.541397+0000', 'last_undegraded': '2024-08-18T22:27:23.541397+0000', 'last_fullsized': '2024-08-18T22:27:23.541397+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:27:29.479 INFO:tasks.ceph.ceph_manager.ceph:PG 18.a is not active+clean 2024-08-18T22:27:29.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.536728+0000', 'last_change': '2024-08-18T22:27:23.536728+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.536728+0000', 'last_undegraded': '2024-08-18T22:27:23.536728+0000', 'last_fullsized': '2024-08-18T22:27:23.536728+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:27:29.479 INFO:tasks.ceph.ceph_manager.ceph:PG 18.b is not active+clean 2024-08-18T22:27:29.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.541359+0000', 'last_change': '2024-08-18T22:27:23.541359+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.541359+0000', 'last_undegraded': '2024-08-18T22:27:23.541359+0000', 'last_fullsized': '2024-08-18T22:27:23.541359+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:27:29.480 INFO:tasks.ceph.ceph_manager.ceph:PG 18.4 is not active+clean 2024-08-18T22:27:29.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.533300+0000', 'last_change': '2024-08-18T22:27:23.533300+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.533300+0000', 'last_undegraded': '2024-08-18T22:27:23.533300+0000', 'last_fullsized': '2024-08-18T22:27:23.533300+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:27:29.480 INFO:tasks.ceph.ceph_manager.ceph:PG 18.5 is not active+clean 2024-08-18T22:27:29.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.532481+0000', 'last_change': '2024-08-18T22:27:23.532481+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.532481+0000', 'last_undegraded': '2024-08-18T22:27:23.532481+0000', 'last_fullsized': '2024-08-18T22:27:23.532481+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:27:29.480 INFO:tasks.ceph.ceph_manager.ceph:PG 18.6 is not active+clean 2024-08-18T22:27:29.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.533486+0000', 'last_change': '2024-08-18T22:27:23.533486+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.533486+0000', 'last_undegraded': '2024-08-18T22:27:23.533486+0000', 'last_fullsized': '2024-08-18T22:27:23.533486+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:27:29.480 INFO:tasks.ceph.ceph_manager.ceph:PG 18.0 is not active+clean 2024-08-18T22:27:29.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.534325+0000', 'last_change': '2024-08-18T22:27:23.534325+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.534325+0000', 'last_undegraded': '2024-08-18T22:27:23.534325+0000', 'last_fullsized': '2024-08-18T22:27:23.534325+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:27:29.480 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1 is not active+clean 2024-08-18T22:27:29.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.540847+0000', 'last_change': '2024-08-18T22:27:23.540847+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.540847+0000', 'last_undegraded': '2024-08-18T22:27:23.540847+0000', 'last_fullsized': '2024-08-18T22:27:23.540847+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:27:29.481 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2 is not active+clean 2024-08-18T22:27:29.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.530918+0000', 'last_change': '2024-08-18T22:27:23.530918+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.530918+0000', 'last_undegraded': '2024-08-18T22:27:23.530918+0000', 'last_fullsized': '2024-08-18T22:27:23.530918+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:27:29.481 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3 is not active+clean 2024-08-18T22:27:29.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.531793+0000', 'last_change': '2024-08-18T22:27:23.531793+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.531793+0000', 'last_undegraded': '2024-08-18T22:27:23.531793+0000', 'last_fullsized': '2024-08-18T22:27:23.531793+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:27:29.481 INFO:tasks.ceph.ceph_manager.ceph:PG 18.13 is not active+clean 2024-08-18T22:27:29.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:27:23.530872+0000', 'last_change': '2024-08-18T22:27:23.530872+0000', 'last_active': '2024-08-18T22:27:23.520247+0000', 'last_peered': '2024-08-18T22:27:23.520247+0000', 'last_clean': '2024-08-18T22:27:23.520247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:27:23.530872+0000', 'last_undegraded': '2024-08-18T22:27:23.530872+0000', 'last_fullsized': '2024-08-18T22:27:23.530872+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'last_clean_scrub_stamp': '2024-08-18T22:27:23.520247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:27:29.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:27:29.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50e1200640 1 Processor -- start 2024-08-18T22:27:29.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50e1200640 1 -- start start 2024-08-18T22:27:29.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50e1200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50dc146f10 0x7f50dc06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50e1200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50dc06b9b0 0x7f50dc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50e1200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc161d70 0x7f50dc1621d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50e1200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f50dc0b4510 con 0x7f50dc146f10 2024-08-18T22:27:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50e1200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f50dc06c330 con 0x7f50dc06b9b0 2024-08-18T22:27:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50e1200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50dc071040 con 0x7f50dc161d70 2024-08-18T22:27:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50db400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50dc146f10 0x7f50dc06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50db400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50dc146f10 0x7f50dc06f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53558/0 (socket says 172.21.15.5:53558) 2024-08-18T22:27:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50db400640 1 -- 172.21.15.5:0/3637930127 learned_addr learned my addr 172.21.15.5:0/3637930127 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50db400640 1 -- 172.21.15.5:0/3637930127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc161d70 msgr2=0x7f50dc1621d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50db400640 1 --2- 172.21.15.5:0/3637930127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc161d70 0x7f50dc1621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50db400640 1 -- 172.21.15.5:0/3637930127 >> v2:172.21.15.117:3300/0 conn(0x7f50dc06b9b0 msgr2=0x7f50dc06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50db400640 1 --2- 172.21.15.5:0/3637930127 >> v2:172.21.15.117:3300/0 conn(0x7f50dc06b9b0 0x7f50dc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.652+0000 7f50db400640 1 -- 172.21.15.5:0/3637930127 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc0707e0 con 0x7f50dc146f10 2024-08-18T22:27:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50db400640 1 --2- 172.21.15.5:0/3637930127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50dc146f10 0x7f50dc06f3b0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f50dc06e410 tx=0x7f50cc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0954e9d52699b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50daa00640 1 -- 172.21.15.5:0/3637930127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0b0070 con 0x7f50dc146f10 2024-08-18T22:27:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50daa00640 1 -- 172.21.15.5:0/3637930127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50cc0ab600 con 0x7f50dc146f10 2024-08-18T22:27:29.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50daa00640 1 -- 172.21.15.5:0/3637930127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0ab9d0 con 0x7f50dc146f10 2024-08-18T22:27:29.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50e1200640 1 -- 172.21.15.5:0/3637930127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50dc146f10 msgr2=0x7f50dc06f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50e1200640 1 --2- 172.21.15.5:0/3637930127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50dc146f10 0x7f50dc06f3b0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f50dc06e410 tx=0x7f50cc01c490 comp rx=0 tx=0).stop 2024-08-18T22:27:29.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50e1200640 1 -- 172.21.15.5:0/3637930127 shutdown_connections 2024-08-18T22:27:29.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50e1200640 1 --2- 172.21.15.5:0/3637930127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc161d70 0x7f50dc1621d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50e1200640 1 --2- 172.21.15.5:0/3637930127 >> v2:172.21.15.117:3300/0 conn(0x7f50dc06b9b0 0x7f50dc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50e1200640 1 --2- 172.21.15.5:0/3637930127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50dc146f10 0x7f50dc06f3b0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50e1200640 1 -- 172.21.15.5:0/3637930127 >> 172.21.15.5:0/3637930127 conn(0x7f50dc06e890 msgr2=0x7f50dc06eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:29.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50e1200640 1 -- 172.21.15.5:0/3637930127 shutdown_connections 2024-08-18T22:27:29.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.656+0000 7f50e1200640 1 -- 172.21.15.5:0/3637930127 wait complete. 2024-08-18T22:27:29.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50e1200640 1 Processor -- start 2024-08-18T22:27:29.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50e1200640 1 -- start start 2024-08-18T22:27:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50e1200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc06b9b0 0x7f50dc144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50e1200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50dc146f10 0x7f50dc142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50e1200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50dc161d70 0x7f50dc0d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50e1200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc162b20 con 0x7f50dc146f10 2024-08-18T22:27:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50e1200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc06f8f0 con 0x7f50dc161d70 2024-08-18T22:27:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50e1200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50dc147c40 con 0x7f50dc06b9b0 2024-08-18T22:27:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50dc146f10 0x7f50dc142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50dc146f10 0x7f50dc142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53568/0 (socket says 172.21.15.5:53568) 2024-08-18T22:27:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3e00640 1 -- 172.21.15.5:0/2579602924 learned_addr learned my addr 172.21.15.5:0/2579602924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50db400640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc06b9b0 0x7f50dc144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:29.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50dbe00640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50dc161d70 0x7f50dc0d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3e00640 1 -- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc06b9b0 msgr2=0x7f50dc144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3e00640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc06b9b0 0x7f50dc144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3e00640 1 -- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50dc161d70 msgr2=0x7f50dc0d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3e00640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50dc161d70 0x7f50dc0d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3e00640 1 -- 172.21.15.5:0/2579602924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc142ac0 con 0x7f50dc146f10 2024-08-18T22:27:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50dbe00640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50dc161d70 0x7f50dc0d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50db400640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc06b9b0 0x7f50dc144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:29.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3e00640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50dc146f10 0x7f50dc142580 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f50c400b440 tx=0x7f50c400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3400640 1 -- 172.21.15.5:0/2579602924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4015020 con 0x7f50dc146f10 2024-08-18T22:27:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3400640 1 -- 172.21.15.5:0/2579602924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c40118b0 con 0x7f50dc146f10 2024-08-18T22:27:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50d3400640 1 -- 172.21.15.5:0/2579602924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4011ca0 con 0x7f50dc146f10 2024-08-18T22:27:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50e1200640 1 -- 172.21.15.5:0/2579602924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50dc142d60 con 0x7f50dc146f10 2024-08-18T22:27:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.660+0000 7f50e1200640 1 -- 172.21.15.5:0/2579602924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50dc143320 con 0x7f50dc146f10 2024-08-18T22:27:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.664+0000 7f50e1200640 1 -- 172.21.15.5:0/2579602924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50dc1f7330 con 0x7f50dc146f10 2024-08-18T22:27:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.664+0000 7f50d3400640 1 -- 172.21.15.5:0/2579602924 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f50c4018020 con 0x7f50dc146f10 2024-08-18T22:27:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.664+0000 7f50d3400640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50b80678c0 0x7f50b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.664+0000 7f50d3400640 1 -- 172.21.15.5:0/2579602924 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f50c4085e40 con 0x7f50dc146f10 2024-08-18T22:27:29.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.664+0000 7f50db400640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50b80678c0 0x7f50b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:29.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.664+0000 7f50db400640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50b80678c0 0x7f50b8069d80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f50dc069420 tx=0x7f50cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:29.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.668+0000 7f50d3400640 1 -- 172.21.15.5:0/2579602924 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f50c401f020 con 0x7f50dc146f10 2024-08-18T22:27:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 -- 172.21.15.5:0/2579602924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f50dc141430 con 0x7f50dc146f10 2024-08-18T22:27:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50d3400640 1 -- 172.21.15.5:0/2579602924 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1301 (secure 0 0 0) 0x7f50c400d040 con 0x7f50dc146f10 2024-08-18T22:27:29.900 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:29.900 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":513,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":129,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":52},{"state_name":"active+clean","count":45}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590368,"bytes_used":387145728,"bytes_avail":772706967552,"bytes_total":773094113280,"inactive_pgs_ratio":0.53608244657516479,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":100,"btime":"2024-08-18T22:27:27:572472+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"b","status":"up:active","gid":8166}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-08-18T22:26:45.730180+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:27:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 -- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50b80678c0 msgr2=0x7f50b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50b80678c0 0x7f50b8069d80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f50dc069420 tx=0x7f50cc009040 comp rx=0 tx=0).stop 2024-08-18T22:27:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 -- 172.21.15.5:0/2579602924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50dc146f10 msgr2=0x7f50dc142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50dc146f10 0x7f50dc142580 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f50c400b440 tx=0x7f50c400b900 comp rx=0 tx=0).stop 2024-08-18T22:27:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 -- 172.21.15.5:0/2579602924 shutdown_connections 2024-08-18T22:27:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50b80678c0 0x7f50b8069d80 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50dc161d70 0x7f50dc0d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50dc146f10 0x7f50dc142580 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 --2- 172.21.15.5:0/2579602924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc06b9b0 0x7f50dc144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 -- 172.21.15.5:0/2579602924 >> 172.21.15.5:0/2579602924 conn(0x7f50dc06e890 msgr2=0x7f50dc0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 -- 172.21.15.5:0/2579602924 shutdown_connections 2024-08-18T22:27:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:29.900+0000 7f50e1200640 1 -- 172.21.15.5:0/2579602924 wait complete. 2024-08-18T22:27:29.922 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-18T22:27:29.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:27:30.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.060+0000 7fa329a00640 1 Processor -- start 2024-08-18T22:27:30.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa329a00640 1 -- start start 2024-08-18T22:27:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa329a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3241618d0 0x7fa32415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa329a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa324161d40 0x7fa32415f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa329a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa324162300 con 0x7fa3240c92d0 2024-08-18T22:27:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa329a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa3241625e0 con 0x7fa324161d40 2024-08-18T22:27:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa329a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa3241628c0 con 0x7fa3241618d0 2024-08-18T22:27:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa31be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa324161d40 0x7fa32415f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa31be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa324161d40 0x7fa32415f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53572/0 (socket says 172.21.15.5:53572) 2024-08-18T22:27:30.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa31be00640 1 -- 172.21.15.5:0/3147531276 learned_addr learned my addr 172.21.15.5:0/3147531276 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa322a00640 1 --2- 172.21.15.5:0/3147531276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3241618d0 0x7fa32415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa31be00640 1 -- 172.21.15.5:0/3147531276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3241618d0 msgr2=0x7fa32415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa31be00640 1 --2- 172.21.15.5:0/3147531276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3241618d0 0x7fa32415f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa31be00640 1 -- 172.21.15.5:0/3147531276 >> v1:172.21.15.117:6789/0 conn(0x7fa3240c92d0 legacy=0x7fa3240ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:30.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.064+0000 7fa31be00640 1 -- 172.21.15.5:0/3147531276 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa324162ba0 con 0x7fa324161d40 2024-08-18T22:27:30.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa31be00640 1 --2- 172.21.15.5:0/3147531276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa324161d40 0x7fa32415f910 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009870 tx=0x7fa30c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3c2704e75b9681 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:30.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa322000640 1 -- 172.21.15.5:0/3147531276 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0b2070 con 0x7fa324161d40 2024-08-18T22:27:30.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa322000640 1 -- 172.21.15.5:0/3147531276 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa30c0a9070 con 0x7fa324161d40 2024-08-18T22:27:30.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa322000640 1 -- 172.21.15.5:0/3147531276 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0ad880 con 0x7fa324161d40 2024-08-18T22:27:30.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa329a00640 1 -- 172.21.15.5:0/3147531276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa324161d40 msgr2=0x7fa32415f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:30.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa329a00640 1 --2- 172.21.15.5:0/3147531276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa324161d40 0x7fa32415f910 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009870 tx=0x7fa30c01c560 comp rx=0 tx=0).stop 2024-08-18T22:27:30.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa329a00640 1 -- 172.21.15.5:0/3147531276 shutdown_connections 2024-08-18T22:27:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa329a00640 1 --2- 172.21.15.5:0/3147531276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa324161d40 0x7fa32415f910 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa329a00640 1 --2- 172.21.15.5:0/3147531276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3241618d0 0x7fa32415f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa329a00640 1 -- 172.21.15.5:0/3147531276 >> 172.21.15.5:0/3147531276 conn(0x7fa3240b1c50 msgr2=0x7fa3240b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa329a00640 1 -- 172.21.15.5:0/3147531276 shutdown_connections 2024-08-18T22:27:30.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa329a00640 1 -- 172.21.15.5:0/3147531276 wait complete. 2024-08-18T22:27:30.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa329a00640 1 Processor -- start 2024-08-18T22:27:30.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.068+0000 7fa329a00640 1 -- start start 2024-08-18T22:27:30.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa329a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240c92d0 0x7fa324146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:30.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa329a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3241618d0 0x7fa32409c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:30.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa329a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa324161d40 0x7fa32415d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:30.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa329a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa32416b8f0 con 0x7fa3240c92d0 2024-08-18T22:27:30.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa329a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3240cf380 con 0x7fa324161d40 2024-08-18T22:27:30.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa329a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa32416ba70 con 0x7fa3241618d0 2024-08-18T22:27:30.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa322a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240c92d0 0x7fa324146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa322a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240c92d0 0x7fa324146370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53578/0 (socket says 172.21.15.5:53578) 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa322a00640 1 -- 172.21.15.5:0/1404686436 learned_addr learned my addr 172.21.15.5:0/1404686436 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa31be00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3241618d0 0x7fa32409c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa323400640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa324161d40 0x7fa32415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa322a00640 1 -- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3241618d0 msgr2=0x7fa32409c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa322a00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3241618d0 0x7fa32409c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa322a00640 1 -- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa324161d40 msgr2=0x7fa32415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa322a00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa324161d40 0x7fa32415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa322a00640 1 -- 172.21.15.5:0/1404686436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32409d1d0 con 0x7fa3240c92d0 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa322a00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240c92d0 0x7fa324146370 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa31400d5f0 tx=0x7fa31400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa31aa00640 1 -- 172.21.15.5:0/1404686436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140125f0 con 0x7fa3240c92d0 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa31aa00640 1 -- 172.21.15.5:0/1404686436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa314019070 con 0x7fa3240c92d0 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa31aa00640 1 -- 172.21.15.5:0/1404686436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3140129b0 con 0x7fa3240c92d0 2024-08-18T22:27:30.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa329a00640 1 -- 172.21.15.5:0/1404686436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32409d4b0 con 0x7fa3240c92d0 2024-08-18T22:27:30.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa329a00640 1 -- 172.21.15.5:0/1404686436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa32409da70 con 0x7fa3240c92d0 2024-08-18T22:27:30.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa329a00640 1 -- 172.21.15.5:0/1404686436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32406df80 con 0x7fa3240c92d0 2024-08-18T22:27:30.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.072+0000 7fa31aa00640 1 -- 172.21.15.5:0/1404686436 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa314012b50 con 0x7fa3240c92d0 2024-08-18T22:27:30.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.076+0000 7fa31aa00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3000678c0 0x7fa300069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:30.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.076+0000 7fa31aa00640 1 -- 172.21.15.5:0/1404686436 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fa314086220 con 0x7fa3240c92d0 2024-08-18T22:27:30.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.076+0000 7fa31be00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3000678c0 0x7fa300069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:30.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.076+0000 7fa31be00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3000678c0 0x7fa300069d80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0af000 tx=0x7fa30c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:30.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.080+0000 7fa31aa00640 1 -- 172.21.15.5:0/1404686436 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa314056b30 con 0x7fa3240c92d0 2024-08-18T22:27:30.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.244+0000 7fa329a00640 1 -- 172.21.15.5:0/1404686436 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3240b2030 con 0x7fa3000678c0 2024-08-18T22:27:30.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.252+0000 7fa31aa00640 1 -- 172.21.15.5:0/1404686436 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252475 (secure 0 0 0) 0x7fa3240b2030 con 0x7fa3000678c0 2024-08-18T22:27:30.255 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:27:30.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 -- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3000678c0 msgr2=0x7fa300069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:30.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3000678c0 0x7fa300069d80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0af000 tx=0x7fa30c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:27:30.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 -- 172.21.15.5:0/1404686436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240c92d0 msgr2=0x7fa324146370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:30.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240c92d0 0x7fa324146370 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa31400d5f0 tx=0x7fa31400dab0 comp rx=0 tx=0).stop 2024-08-18T22:27:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 -- 172.21.15.5:0/1404686436 shutdown_connections 2024-08-18T22:27:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3000678c0 0x7fa300069d80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa324161d40 0x7fa32415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3241618d0 0x7fa32409c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 --2- 172.21.15.5:0/1404686436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240c92d0 0x7fa324146370 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 -- 172.21.15.5:0/1404686436 >> 172.21.15.5:0/1404686436 conn(0x7fa3240b1c50 msgr2=0x7fa3240cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 -- 172.21.15.5:0/1404686436 shutdown_connections 2024-08-18T22:27:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:30.256+0000 7fa329a00640 1 -- 172.21.15.5:0/1404686436 wait complete. 2024-08-18T22:27:30.275 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2024-08-18T22:27:29.741076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":378336,"kb_used_data":13680,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754596384,"statfs":{"total":773094113280,"available":772706697216,"internally_reserved":0,"allocated":14008320,"data_stored":7196276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.211771"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.562162+0000","last_change":"2024-08-18T22:27:24.555768+0000","last_active":"2024-08-18T22:27:24.562162+0000","last_peered":"2024-08-18T22:27:24.562162+0000","last_clean":"2024-08-18T22:27:24.562162+0000","last_became_active":"2024-08-18T22:27:24.555457+0000","last_became_peered":"2024-08-18T22:27:24.555457+0000","last_unstale":"2024-08-18T22:27:24.562162+0000","last_undegraded":"2024-08-18T22:27:24.562162+0000","last_fullsized":"2024-08-18T22:27:24.562162+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:42.103828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867242+0000","last_change":"2024-08-18T22:27:24.565807+0000","last_active":"2024-08-18T22:27:26.867242+0000","last_peered":"2024-08-18T22:27:26.867242+0000","last_clean":"2024-08-18T22:27:26.867242+0000","last_became_active":"2024-08-18T22:27:24.565296+0000","last_became_peered":"2024-08-18T22:27:24.565296+0000","last_unstale":"2024-08-18T22:27:26.867242+0000","last_undegraded":"2024-08-18T22:27:26.867242+0000","last_fullsized":"2024-08-18T22:27:26.867242+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:29:31.411919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867004+0000","last_change":"2024-08-18T22:27:24.575520+0000","last_active":"2024-08-18T22:27:26.867004+0000","last_peered":"2024-08-18T22:27:26.867004+0000","last_clean":"2024-08-18T22:27:26.867004+0000","last_became_active":"2024-08-18T22:27:24.575332+0000","last_became_peered":"2024-08-18T22:27:24.575332+0000","last_unstale":"2024-08-18T22:27:26.867004+0000","last_undegraded":"2024-08-18T22:27:26.867004+0000","last_fullsized":"2024-08-18T22:27:26.867004+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:37.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563933+0000","last_change":"2024-08-18T22:27:24.562537+0000","last_active":"2024-08-18T22:27:25.563933+0000","last_peered":"2024-08-18T22:27:25.563933+0000","last_clean":"2024-08-18T22:27:25.563933+0000","last_became_active":"2024-08-18T22:27:24.562094+0000","last_became_peered":"2024-08-18T22:27:24.562094+0000","last_unstale":"2024-08-18T22:27:25.563933+0000","last_undegraded":"2024-08-18T22:27:25.563933+0000","last_fullsized":"2024-08-18T22:27:25.563933+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:19:07.873529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.574253+0000","last_change":"2024-08-18T22:27:24.566222+0000","last_active":"2024-08-18T22:27:24.574253+0000","last_peered":"2024-08-18T22:27:24.574253+0000","last_clean":"2024-08-18T22:27:24.574253+0000","last_became_active":"2024-08-18T22:27:24.565894+0000","last_became_peered":"2024-08-18T22:27:24.565894+0000","last_unstale":"2024-08-18T22:27:24.574253+0000","last_undegraded":"2024-08-18T22:27:24.574253+0000","last_fullsized":"2024-08-18T22:27:24.574253+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:47.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568278+0000","last_change":"2024-08-18T22:27:24.567015+0000","last_active":"2024-08-18T22:27:25.568278+0000","last_peered":"2024-08-18T22:27:25.568278+0000","last_clean":"2024-08-18T22:27:25.568278+0000","last_became_active":"2024-08-18T22:27:24.566662+0000","last_became_peered":"2024-08-18T22:27:24.566662+0000","last_unstale":"2024-08-18T22:27:25.568278+0000","last_undegraded":"2024-08-18T22:27:25.568278+0000","last_fullsized":"2024-08-18T22:27:25.568278+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:14.666642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568007+0000","last_change":"2024-08-18T22:27:24.553498+0000","last_active":"2024-08-18T22:27:25.568007+0000","last_peered":"2024-08-18T22:27:25.568007+0000","last_clean":"2024-08-18T22:27:25.568007+0000","last_became_active":"2024-08-18T22:27:24.553175+0000","last_became_peered":"2024-08-18T22:27:24.553175+0000","last_unstale":"2024-08-18T22:27:25.568007+0000","last_undegraded":"2024-08-18T22:27:25.568007+0000","last_fullsized":"2024-08-18T22:27:25.568007+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:27.132996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866227+0000","last_change":"2024-08-18T22:27:24.575315+0000","last_active":"2024-08-18T22:27:26.866227+0000","last_peered":"2024-08-18T22:27:26.866227+0000","last_clean":"2024-08-18T22:27:26.866227+0000","last_became_active":"2024-08-18T22:27:24.574935+0000","last_became_peered":"2024-08-18T22:27:24.574935+0000","last_unstale":"2024-08-18T22:27:26.866227+0000","last_undegraded":"2024-08-18T22:27:26.866227+0000","last_fullsized":"2024-08-18T22:27:26.866227+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:30:23.083345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564844+0000","last_change":"2024-08-18T22:27:24.563740+0000","last_active":"2024-08-18T22:27:25.564844+0000","last_peered":"2024-08-18T22:27:25.564844+0000","last_clean":"2024-08-18T22:27:25.564844+0000","last_became_active":"2024-08-18T22:27:24.563441+0000","last_became_peered":"2024-08-18T22:27:24.563441+0000","last_unstale":"2024-08-18T22:27:25.564844+0000","last_undegraded":"2024-08-18T22:27:25.564844+0000","last_fullsized":"2024-08-18T22:27:25.564844+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:43.357911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866819+0000","last_change":"2024-08-18T22:27:24.571496+0000","last_active":"2024-08-18T22:27:26.866819+0000","last_peered":"2024-08-18T22:27:26.866819+0000","last_clean":"2024-08-18T22:27:26.866819+0000","last_became_active":"2024-08-18T22:27:24.570856+0000","last_became_peered":"2024-08-18T22:27:24.570856+0000","last_unstale":"2024-08-18T22:27:26.866819+0000","last_undegraded":"2024-08-18T22:27:26.866819+0000","last_fullsized":"2024-08-18T22:27:26.866819+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:52.124117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.581951+0000","last_change":"2024-08-18T22:27:24.577512+0000","last_active":"2024-08-18T22:27:24.581951+0000","last_peered":"2024-08-18T22:27:24.581951+0000","last_clean":"2024-08-18T22:27:24.581951+0000","last_became_active":"2024-08-18T22:27:24.577167+0000","last_became_peered":"2024-08-18T22:27:24.577167+0000","last_unstale":"2024-08-18T22:27:24.581951+0000","last_undegraded":"2024-08-18T22:27:24.581951+0000","last_fullsized":"2024-08-18T22:27:24.581951+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:41:25.724936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568577+0000","last_change":"2024-08-18T22:27:24.561165+0000","last_active":"2024-08-18T22:27:25.568577+0000","last_peered":"2024-08-18T22:27:25.568577+0000","last_clean":"2024-08-18T22:27:25.568577+0000","last_became_active":"2024-08-18T22:27:24.556827+0000","last_became_peered":"2024-08-18T22:27:24.556827+0000","last_unstale":"2024-08-18T22:27:25.568577+0000","last_undegraded":"2024-08-18T22:27:25.568577+0000","last_fullsized":"2024-08-18T22:27:25.568577+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:41.670375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866406+0000","last_change":"2024-08-18T22:27:24.586599+0000","last_active":"2024-08-18T22:27:26.866406+0000","last_peered":"2024-08-18T22:27:26.866406+0000","last_clean":"2024-08-18T22:27:26.866406+0000","last_became_active":"2024-08-18T22:27:24.586284+0000","last_became_peered":"2024-08-18T22:27:24.586284+0000","last_unstale":"2024-08-18T22:27:26.866406+0000","last_undegraded":"2024-08-18T22:27:26.866406+0000","last_fullsized":"2024-08-18T22:27:26.866406+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:53.770712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866207+0000","last_change":"2024-08-18T22:27:24.572012+0000","last_active":"2024-08-18T22:27:26.866207+0000","last_peered":"2024-08-18T22:27:26.866207+0000","last_clean":"2024-08-18T22:27:26.866207+0000","last_became_active":"2024-08-18T22:27:24.571741+0000","last_became_peered":"2024-08-18T22:27:24.571741+0000","last_unstale":"2024-08-18T22:27:26.866207+0000","last_undegraded":"2024-08-18T22:27:26.866207+0000","last_fullsized":"2024-08-18T22:27:26.866207+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:13.963922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.587114+0000","last_change":"2024-08-18T22:27:24.586295+0000","last_active":"2024-08-18T22:27:24.587114+0000","last_peered":"2024-08-18T22:27:24.587114+0000","last_clean":"2024-08-18T22:27:24.587114+0000","last_became_active":"2024-08-18T22:27:24.585876+0000","last_became_peered":"2024-08-18T22:27:24.585876+0000","last_unstale":"2024-08-18T22:27:24.587114+0000","last_undegraded":"2024-08-18T22:27:24.587114+0000","last_fullsized":"2024-08-18T22:27:24.587114+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:06:20.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.567976+0000","last_change":"2024-08-18T22:27:24.564072+0000","last_active":"2024-08-18T22:27:25.567976+0000","last_peered":"2024-08-18T22:27:25.567976+0000","last_clean":"2024-08-18T22:27:25.567976+0000","last_became_active":"2024-08-18T22:27:24.563797+0000","last_became_peered":"2024-08-18T22:27:24.563797+0000","last_unstale":"2024-08-18T22:27:25.567976+0000","last_undegraded":"2024-08-18T22:27:25.567976+0000","last_fullsized":"2024-08-18T22:27:25.567976+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:48:24.593145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866888+0000","last_change":"2024-08-18T22:27:24.586536+0000","last_active":"2024-08-18T22:27:26.866888+0000","last_peered":"2024-08-18T22:27:26.866888+0000","last_clean":"2024-08-18T22:27:26.866888+0000","last_became_active":"2024-08-18T22:27:24.586213+0000","last_became_peered":"2024-08-18T22:27:24.586213+0000","last_unstale":"2024-08-18T22:27:26.866888+0000","last_undegraded":"2024-08-18T22:27:26.866888+0000","last_fullsized":"2024-08-18T22:27:26.866888+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:59:39.630135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867410+0000","last_change":"2024-08-18T22:27:24.565579+0000","last_active":"2024-08-18T22:27:26.867410+0000","last_peered":"2024-08-18T22:27:26.867410+0000","last_clean":"2024-08-18T22:27:26.867410+0000","last_became_active":"2024-08-18T22:27:24.564907+0000","last_became_peered":"2024-08-18T22:27:24.564907+0000","last_unstale":"2024-08-18T22:27:26.867410+0000","last_undegraded":"2024-08-18T22:27:26.867410+0000","last_fullsized":"2024-08-18T22:27:26.867410+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:21.862152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565277+0000","last_change":"2024-08-18T22:27:24.565097+0000","last_active":"2024-08-18T22:27:25.565277+0000","last_peered":"2024-08-18T22:27:25.565277+0000","last_clean":"2024-08-18T22:27:25.565277+0000","last_became_active":"2024-08-18T22:27:24.564536+0000","last_became_peered":"2024-08-18T22:27:24.564536+0000","last_unstale":"2024-08-18T22:27:25.565277+0000","last_undegraded":"2024-08-18T22:27:25.565277+0000","last_fullsized":"2024-08-18T22:27:25.565277+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:16.054969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.576321+0000","last_change":"2024-08-18T22:27:24.572897+0000","last_active":"2024-08-18T22:27:24.576321+0000","last_peered":"2024-08-18T22:27:24.576321+0000","last_clean":"2024-08-18T22:27:24.576321+0000","last_became_active":"2024-08-18T22:27:24.572530+0000","last_became_peered":"2024-08-18T22:27:24.572530+0000","last_unstale":"2024-08-18T22:27:24.576321+0000","last_undegraded":"2024-08-18T22:27:24.576321+0000","last_fullsized":"2024-08-18T22:27:24.576321+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:30:27.384406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564339+0000","last_change":"2024-08-18T22:27:24.562567+0000","last_active":"2024-08-18T22:27:25.564339+0000","last_peered":"2024-08-18T22:27:25.564339+0000","last_clean":"2024-08-18T22:27:25.564339+0000","last_became_active":"2024-08-18T22:27:24.561170+0000","last_became_peered":"2024-08-18T22:27:24.561170+0000","last_unstale":"2024-08-18T22:27:25.564339+0000","last_undegraded":"2024-08-18T22:27:25.564339+0000","last_fullsized":"2024-08-18T22:27:25.564339+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:42:40.050115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.572238+0000","last_change":"2024-08-18T22:27:24.560726+0000","last_active":"2024-08-18T22:27:24.572238+0000","last_peered":"2024-08-18T22:27:24.572238+0000","last_clean":"2024-08-18T22:27:24.572238+0000","last_became_active":"2024-08-18T22:27:24.560454+0000","last_became_peered":"2024-08-18T22:27:24.560454+0000","last_unstale":"2024-08-18T22:27:24.572238+0000","last_undegraded":"2024-08-18T22:27:24.572238+0000","last_fullsized":"2024-08-18T22:27:24.572238+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:34.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563958+0000","last_change":"2024-08-18T22:27:24.560325+0000","last_active":"2024-08-18T22:27:25.563958+0000","last_peered":"2024-08-18T22:27:25.563958+0000","last_clean":"2024-08-18T22:27:25.563958+0000","last_became_active":"2024-08-18T22:27:24.559125+0000","last_became_peered":"2024-08-18T22:27:24.559125+0000","last_unstale":"2024-08-18T22:27:25.563958+0000","last_undegraded":"2024-08-18T22:27:25.563958+0000","last_fullsized":"2024-08-18T22:27:25.563958+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:54.917980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564790+0000","last_change":"2024-08-18T22:27:24.574623+0000","last_active":"2024-08-18T22:27:25.564790+0000","last_peered":"2024-08-18T22:27:25.564790+0000","last_clean":"2024-08-18T22:27:25.564790+0000","last_became_active":"2024-08-18T22:27:24.574333+0000","last_became_peered":"2024-08-18T22:27:24.574333+0000","last_unstale":"2024-08-18T22:27:25.564790+0000","last_undegraded":"2024-08-18T22:27:25.564790+0000","last_fullsized":"2024-08-18T22:27:25.564790+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:29.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.566076+0000","last_change":"2024-08-18T22:27:24.583617+0000","last_active":"2024-08-18T22:27:25.566076+0000","last_peered":"2024-08-18T22:27:25.566076+0000","last_clean":"2024-08-18T22:27:25.566076+0000","last_became_active":"2024-08-18T22:27:24.581849+0000","last_became_peered":"2024-08-18T22:27:24.581849+0000","last_unstale":"2024-08-18T22:27:25.566076+0000","last_undegraded":"2024-08-18T22:27:25.566076+0000","last_fullsized":"2024-08-18T22:27:25.566076+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:54.917980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570882+0000","last_change":"2024-08-18T22:27:24.567510+0000","last_active":"2024-08-18T22:27:24.570882+0000","last_peered":"2024-08-18T22:27:24.570882+0000","last_clean":"2024-08-18T22:27:24.570882+0000","last_became_active":"2024-08-18T22:27:24.565899+0000","last_became_peered":"2024-08-18T22:27:24.565899+0000","last_unstale":"2024-08-18T22:27:24.570882+0000","last_undegraded":"2024-08-18T22:27:24.570882+0000","last_fullsized":"2024-08-18T22:27:24.570882+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:11.259055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565277+0000","last_change":"2024-08-18T22:27:24.565295+0000","last_active":"2024-08-18T22:27:25.565277+0000","last_peered":"2024-08-18T22:27:25.565277+0000","last_clean":"2024-08-18T22:27:25.565277+0000","last_became_active":"2024-08-18T22:27:24.564861+0000","last_became_peered":"2024-08-18T22:27:24.564861+0000","last_unstale":"2024-08-18T22:27:25.565277+0000","last_undegraded":"2024-08-18T22:27:25.565277+0000","last_fullsized":"2024-08-18T22:27:25.565277+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:36.144908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568560+0000","last_change":"2024-08-18T22:27:24.583596+0000","last_active":"2024-08-18T22:27:25.568560+0000","last_peered":"2024-08-18T22:27:25.568560+0000","last_clean":"2024-08-18T22:27:25.568560+0000","last_became_active":"2024-08-18T22:27:24.580323+0000","last_became_peered":"2024-08-18T22:27:24.580323+0000","last_unstale":"2024-08-18T22:27:25.568560+0000","last_undegraded":"2024-08-18T22:27:25.568560+0000","last_fullsized":"2024-08-18T22:27:25.568560+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:07.834773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570845+0000","last_change":"2024-08-18T22:27:24.569829+0000","last_active":"2024-08-18T22:27:24.570845+0000","last_peered":"2024-08-18T22:27:24.570845+0000","last_clean":"2024-08-18T22:27:24.570845+0000","last_became_active":"2024-08-18T22:27:24.569543+0000","last_became_peered":"2024-08-18T22:27:24.569543+0000","last_unstale":"2024-08-18T22:27:24.570845+0000","last_undegraded":"2024-08-18T22:27:24.570845+0000","last_fullsized":"2024-08-18T22:27:24.570845+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:02.013455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866255+0000","last_change":"2024-08-18T22:27:24.574607+0000","last_active":"2024-08-18T22:27:26.866255+0000","last_peered":"2024-08-18T22:27:26.866255+0000","last_clean":"2024-08-18T22:27:26.866255+0000","last_became_active":"2024-08-18T22:27:24.574297+0000","last_became_peered":"2024-08-18T22:27:24.574297+0000","last_unstale":"2024-08-18T22:27:26.866255+0000","last_undegraded":"2024-08-18T22:27:26.866255+0000","last_fullsized":"2024-08-18T22:27:26.866255+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:11:38.110503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564921+0000","last_change":"2024-08-18T22:27:24.583267+0000","last_active":"2024-08-18T22:27:25.564921+0000","last_peered":"2024-08-18T22:27:25.564921+0000","last_clean":"2024-08-18T22:27:25.564921+0000","last_became_active":"2024-08-18T22:27:24.582852+0000","last_became_peered":"2024-08-18T22:27:24.582852+0000","last_unstale":"2024-08-18T22:27:25.564921+0000","last_undegraded":"2024-08-18T22:27:25.564921+0000","last_fullsized":"2024-08-18T22:27:25.564921+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:32.978984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565359+0000","last_change":"2024-08-18T22:27:24.579993+0000","last_active":"2024-08-18T22:27:25.565359+0000","last_peered":"2024-08-18T22:27:25.565359+0000","last_clean":"2024-08-18T22:27:25.565359+0000","last_became_active":"2024-08-18T22:27:24.579665+0000","last_became_peered":"2024-08-18T22:27:24.579665+0000","last_unstale":"2024-08-18T22:27:25.565359+0000","last_undegraded":"2024-08-18T22:27:25.565359+0000","last_fullsized":"2024-08-18T22:27:25.565359+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:39:26.808180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866979+0000","last_change":"2024-08-18T22:27:24.573428+0000","last_active":"2024-08-18T22:27:26.866979+0000","last_peered":"2024-08-18T22:27:26.866979+0000","last_clean":"2024-08-18T22:27:26.866979+0000","last_became_active":"2024-08-18T22:27:24.573166+0000","last_became_peered":"2024-08-18T22:27:24.573166+0000","last_unstale":"2024-08-18T22:27:26.866979+0000","last_undegraded":"2024-08-18T22:27:26.866979+0000","last_fullsized":"2024-08-18T22:27:26.866979+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.873736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"128'4","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564835+0000","last_change":"2024-08-18T22:27:23.536418+0000","last_active":"2024-08-18T22:27:25.564835+0000","last_peered":"2024-08-18T22:27:25.564835+0000","last_clean":"2024-08-18T22:27:25.564835+0000","last_became_active":"2024-08-18T22:27:23.536127+0000","last_became_peered":"2024-08-18T22:27:23.536127+0000","last_unstale":"2024-08-18T22:27:25.564835+0000","last_undegraded":"2024-08-18T22:27:25.564835+0000","last_fullsized":"2024-08-18T22:27:25.564835+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:59:38.623176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568113+0000","last_change":"2024-08-18T22:27:24.565059+0000","last_active":"2024-08-18T22:27:25.568113+0000","last_peered":"2024-08-18T22:27:25.568113+0000","last_clean":"2024-08-18T22:27:25.568113+0000","last_became_active":"2024-08-18T22:27:24.564781+0000","last_became_peered":"2024-08-18T22:27:24.564781+0000","last_unstale":"2024-08-18T22:27:25.568113+0000","last_undegraded":"2024-08-18T22:27:25.568113+0000","last_fullsized":"2024-08-18T22:27:25.568113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:58:51.179011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"128'1","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866926+0000","last_change":"2024-08-18T22:27:23.544340+0000","last_active":"2024-08-18T22:27:26.866926+0000","last_peered":"2024-08-18T22:27:26.866926+0000","last_clean":"2024-08-18T22:27:26.866926+0000","last_became_active":"2024-08-18T22:27:23.543926+0000","last_became_peered":"2024-08-18T22:27:23.543926+0000","last_unstale":"2024-08-18T22:27:26.866926+0000","last_undegraded":"2024-08-18T22:27:26.866926+0000","last_fullsized":"2024-08-18T22:27:26.866926+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:33.266520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565782+0000","last_change":"2024-08-18T22:27:24.577069+0000","last_active":"2024-08-18T22:27:25.565782+0000","last_peered":"2024-08-18T22:27:25.565782+0000","last_clean":"2024-08-18T22:27:25.565782+0000","last_became_active":"2024-08-18T22:27:24.576798+0000","last_became_peered":"2024-08-18T22:27:24.576798+0000","last_unstale":"2024-08-18T22:27:25.565782+0000","last_undegraded":"2024-08-18T22:27:25.565782+0000","last_fullsized":"2024-08-18T22:27:25.565782+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:30:55.518284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"128'2","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564403+0000","last_change":"2024-08-18T22:27:23.544721+0000","last_active":"2024-08-18T22:27:25.564403+0000","last_peered":"2024-08-18T22:27:25.564403+0000","last_clean":"2024-08-18T22:27:25.564403+0000","last_became_active":"2024-08-18T22:27:23.544394+0000","last_became_peered":"2024-08-18T22:27:23.544394+0000","last_unstale":"2024-08-18T22:27:25.564403+0000","last_undegraded":"2024-08-18T22:27:25.564403+0000","last_fullsized":"2024-08-18T22:27:25.564403+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:21.171844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565002+0000","last_change":"2024-08-18T22:27:24.563615+0000","last_active":"2024-08-18T22:27:25.565002+0000","last_peered":"2024-08-18T22:27:25.565002+0000","last_clean":"2024-08-18T22:27:25.565002+0000","last_became_active":"2024-08-18T22:27:24.563362+0000","last_became_peered":"2024-08-18T22:27:24.563362+0000","last_unstale":"2024-08-18T22:27:25.565002+0000","last_undegraded":"2024-08-18T22:27:25.565002+0000","last_fullsized":"2024-08-18T22:27:25.565002+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:12.717445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"128'2","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867078+0000","last_change":"2024-08-18T22:27:23.547814+0000","last_active":"2024-08-18T22:27:26.867078+0000","last_peered":"2024-08-18T22:27:26.867078+0000","last_clean":"2024-08-18T22:27:26.867078+0000","last_became_active":"2024-08-18T22:27:23.547540+0000","last_became_peered":"2024-08-18T22:27:23.547540+0000","last_unstale":"2024-08-18T22:27:26.867078+0000","last_undegraded":"2024-08-18T22:27:26.867078+0000","last_fullsized":"2024-08-18T22:27:26.867078+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:43:52.163471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866808+0000","last_change":"2024-08-18T22:27:24.566149+0000","last_active":"2024-08-18T22:27:26.866808+0000","last_peered":"2024-08-18T22:27:26.866808+0000","last_clean":"2024-08-18T22:27:26.866808+0000","last_became_active":"2024-08-18T22:27:24.565854+0000","last_became_peered":"2024-08-18T22:27:24.565854+0000","last_unstale":"2024-08-18T22:27:26.866808+0000","last_undegraded":"2024-08-18T22:27:26.866808+0000","last_fullsized":"2024-08-18T22:27:26.866808+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:51.984858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.583668+0000","last_change":"2024-08-18T22:27:23.546555+0000","last_active":"2024-08-18T22:27:24.583668+0000","last_peered":"2024-08-18T22:27:24.583668+0000","last_clean":"2024-08-18T22:27:24.583668+0000","last_became_active":"2024-08-18T22:27:23.544681+0000","last_became_peered":"2024-08-18T22:27:23.544681+0000","last_unstale":"2024-08-18T22:27:24.583668+0000","last_undegraded":"2024-08-18T22:27:24.583668+0000","last_fullsized":"2024-08-18T22:27:24.583668+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:57.484511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.569480+0000","last_change":"2024-08-18T22:27:24.559554+0000","last_active":"2024-08-18T22:27:24.569480+0000","last_peered":"2024-08-18T22:27:24.569480+0000","last_clean":"2024-08-18T22:27:24.569480+0000","last_became_active":"2024-08-18T22:27:24.559262+0000","last_became_peered":"2024-08-18T22:27:24.559262+0000","last_unstale":"2024-08-18T22:27:24.569480+0000","last_undegraded":"2024-08-18T22:27:24.569480+0000","last_fullsized":"2024-08-18T22:27:24.569480+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:36.984658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"128'1","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568362+0000","last_change":"2024-08-18T22:27:23.553332+0000","last_active":"2024-08-18T22:27:25.568362+0000","last_peered":"2024-08-18T22:27:25.568362+0000","last_clean":"2024-08-18T22:27:25.568362+0000","last_became_active":"2024-08-18T22:27:23.550173+0000","last_became_peered":"2024-08-18T22:27:23.550173+0000","last_unstale":"2024-08-18T22:27:25.568362+0000","last_undegraded":"2024-08-18T22:27:25.568362+0000","last_fullsized":"2024-08-18T22:27:25.568362+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:14:47.680532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866370+0000","last_change":"2024-08-18T22:27:24.563338+0000","last_active":"2024-08-18T22:27:26.866370+0000","last_peered":"2024-08-18T22:27:26.866370+0000","last_clean":"2024-08-18T22:27:26.866370+0000","last_became_active":"2024-08-18T22:27:24.562991+0000","last_became_peered":"2024-08-18T22:27:24.562991+0000","last_unstale":"2024-08-18T22:27:26.866370+0000","last_undegraded":"2024-08-18T22:27:26.866370+0000","last_fullsized":"2024-08-18T22:27:26.866370+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:39.193232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564852+0000","last_change":"2024-08-18T22:27:23.544298+0000","last_active":"2024-08-18T22:27:25.564852+0000","last_peered":"2024-08-18T22:27:25.564852+0000","last_clean":"2024-08-18T22:27:25.564852+0000","last_became_active":"2024-08-18T22:27:23.543996+0000","last_became_peered":"2024-08-18T22:27:23.543996+0000","last_unstale":"2024-08-18T22:27:25.564852+0000","last_undegraded":"2024-08-18T22:27:25.564852+0000","last_fullsized":"2024-08-18T22:27:25.564852+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:50.977899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866547+0000","last_change":"2024-08-18T22:27:24.569167+0000","last_active":"2024-08-18T22:27:26.866547+0000","last_peered":"2024-08-18T22:27:26.866547+0000","last_clean":"2024-08-18T22:27:26.866547+0000","last_became_active":"2024-08-18T22:27:24.568838+0000","last_became_peered":"2024-08-18T22:27:24.568838+0000","last_unstale":"2024-08-18T22:27:26.866547+0000","last_undegraded":"2024-08-18T22:27:26.866547+0000","last_fullsized":"2024-08-18T22:27:26.866547+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:43.038753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568219+0000","last_change":"2024-08-18T22:27:23.547406+0000","last_active":"2024-08-18T22:27:25.568219+0000","last_peered":"2024-08-18T22:27:25.568219+0000","last_clean":"2024-08-18T22:27:25.568219+0000","last_became_active":"2024-08-18T22:27:23.547152+0000","last_became_peered":"2024-08-18T22:27:23.547152+0000","last_unstale":"2024-08-18T22:27:25.568219+0000","last_undegraded":"2024-08-18T22:27:25.568219+0000","last_fullsized":"2024-08-18T22:27:25.568219+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:14:37.759783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563118+0000","last_change":"2024-08-18T22:27:24.562783+0000","last_active":"2024-08-18T22:27:25.563118+0000","last_peered":"2024-08-18T22:27:25.563118+0000","last_clean":"2024-08-18T22:27:25.563118+0000","last_became_active":"2024-08-18T22:27:24.562511+0000","last_became_peered":"2024-08-18T22:27:24.562511+0000","last_unstale":"2024-08-18T22:27:25.563118+0000","last_undegraded":"2024-08-18T22:27:25.563118+0000","last_fullsized":"2024-08-18T22:27:25.563118+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:43:05.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564971+0000","last_change":"2024-08-18T22:27:23.538603+0000","last_active":"2024-08-18T22:27:25.564971+0000","last_peered":"2024-08-18T22:27:25.564971+0000","last_clean":"2024-08-18T22:27:25.564971+0000","last_became_active":"2024-08-18T22:27:23.538343+0000","last_became_peered":"2024-08-18T22:27:23.538343+0000","last_unstale":"2024-08-18T22:27:25.564971+0000","last_undegraded":"2024-08-18T22:27:25.564971+0000","last_fullsized":"2024-08-18T22:27:25.564971+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:16.866778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565856+0000","last_change":"2024-08-18T22:27:24.579366+0000","last_active":"2024-08-18T22:27:25.565856+0000","last_peered":"2024-08-18T22:27:25.565856+0000","last_clean":"2024-08-18T22:27:25.565856+0000","last_became_active":"2024-08-18T22:27:24.579117+0000","last_became_peered":"2024-08-18T22:27:24.579117+0000","last_unstale":"2024-08-18T22:27:25.565856+0000","last_undegraded":"2024-08-18T22:27:25.565856+0000","last_fullsized":"2024-08-18T22:27:25.565856+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:02.629167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565888+0000","last_change":"2024-08-18T22:27:23.548166+0000","last_active":"2024-08-18T22:27:25.565888+0000","last_peered":"2024-08-18T22:27:25.565888+0000","last_clean":"2024-08-18T22:27:25.565888+0000","last_became_active":"2024-08-18T22:27:23.547899+0000","last_became_peered":"2024-08-18T22:27:23.547899+0000","last_unstale":"2024-08-18T22:27:25.565888+0000","last_undegraded":"2024-08-18T22:27:25.565888+0000","last_fullsized":"2024-08-18T22:27:25.565888+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:32.512213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867415+0000","last_change":"2024-08-18T22:27:24.574425+0000","last_active":"2024-08-18T22:27:26.867415+0000","last_peered":"2024-08-18T22:27:26.867415+0000","last_clean":"2024-08-18T22:27:26.867415+0000","last_became_active":"2024-08-18T22:27:24.574116+0000","last_became_peered":"2024-08-18T22:27:24.574116+0000","last_unstale":"2024-08-18T22:27:26.867415+0000","last_undegraded":"2024-08-18T22:27:26.867415+0000","last_fullsized":"2024-08-18T22:27:26.867415+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:11.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"128'3","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.566055+0000","last_change":"2024-08-18T22:27:23.549127+0000","last_active":"2024-08-18T22:27:25.566055+0000","last_peered":"2024-08-18T22:27:25.566055+0000","last_clean":"2024-08-18T22:27:25.566055+0000","last_became_active":"2024-08-18T22:27:23.548778+0000","last_became_peered":"2024-08-18T22:27:23.548778+0000","last_unstale":"2024-08-18T22:27:25.566055+0000","last_undegraded":"2024-08-18T22:27:25.566055+0000","last_fullsized":"2024-08-18T22:27:25.566055+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:42.486701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.566143+0000","last_change":"2024-08-18T22:27:24.583599+0000","last_active":"2024-08-18T22:27:25.566143+0000","last_peered":"2024-08-18T22:27:25.566143+0000","last_clean":"2024-08-18T22:27:25.566143+0000","last_became_active":"2024-08-18T22:27:24.583244+0000","last_became_peered":"2024-08-18T22:27:24.583244+0000","last_unstale":"2024-08-18T22:27:25.566143+0000","last_undegraded":"2024-08-18T22:27:25.566143+0000","last_fullsized":"2024-08-18T22:27:25.566143+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:36:44.494716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"128'6","reported_seq":20,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866639+0000","last_change":"2024-08-18T22:27:23.551420+0000","last_active":"2024-08-18T22:27:26.866639+0000","last_peered":"2024-08-18T22:27:26.866639+0000","last_clean":"2024-08-18T22:27:26.866639+0000","last_became_active":"2024-08-18T22:27:23.551146+0000","last_became_peered":"2024-08-18T22:27:23.551146+0000","last_unstale":"2024-08-18T22:27:26.866639+0000","last_undegraded":"2024-08-18T22:27:26.866639+0000","last_fullsized":"2024-08-18T22:27:26.866639+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:39:25.801221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563132+0000","last_change":"2024-08-18T22:27:24.567214+0000","last_active":"2024-08-18T22:27:25.563132+0000","last_peered":"2024-08-18T22:27:25.563132+0000","last_clean":"2024-08-18T22:27:25.563132+0000","last_became_active":"2024-08-18T22:27:24.566042+0000","last_became_peered":"2024-08-18T22:27:24.566042+0000","last_unstale":"2024-08-18T22:27:25.563132+0000","last_undegraded":"2024-08-18T22:27:25.563132+0000","last_fullsized":"2024-08-18T22:27:25.563132+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:18:56.722372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"128'2","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867090+0000","last_change":"2024-08-18T22:27:23.554557+0000","last_active":"2024-08-18T22:27:26.867090+0000","last_peered":"2024-08-18T22:27:26.867090+0000","last_clean":"2024-08-18T22:27:26.867090+0000","last_became_active":"2024-08-18T22:27:23.554293+0000","last_became_peered":"2024-08-18T22:27:23.554293+0000","last_unstale":"2024-08-18T22:27:26.867090+0000","last_undegraded":"2024-08-18T22:27:26.867090+0000","last_fullsized":"2024-08-18T22:27:26.867090+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:31.972026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.865994+0000","last_change":"2024-08-18T22:27:24.559695+0000","last_active":"2024-08-18T22:27:26.865994+0000","last_peered":"2024-08-18T22:27:26.865994+0000","last_clean":"2024-08-18T22:27:26.865994+0000","last_became_active":"2024-08-18T22:27:24.559423+0000","last_became_peered":"2024-08-18T22:27:24.559423+0000","last_unstale":"2024-08-18T22:27:26.865994+0000","last_undegraded":"2024-08-18T22:27:26.865994+0000","last_fullsized":"2024-08-18T22:27:26.865994+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:04.793332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866517+0000","last_change":"2024-08-18T22:27:23.552723+0000","last_active":"2024-08-18T22:27:26.866517+0000","last_peered":"2024-08-18T22:27:26.866517+0000","last_clean":"2024-08-18T22:27:26.866517+0000","last_became_active":"2024-08-18T22:27:23.552457+0000","last_became_peered":"2024-08-18T22:27:23.552457+0000","last_unstale":"2024-08-18T22:27:26.866517+0000","last_undegraded":"2024-08-18T22:27:26.866517+0000","last_fullsized":"2024-08-18T22:27:26.866517+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:19:06.866570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.576445+0000","last_change":"2024-08-18T22:27:24.573855+0000","last_active":"2024-08-18T22:27:24.576445+0000","last_peered":"2024-08-18T22:27:24.576445+0000","last_clean":"2024-08-18T22:27:24.576445+0000","last_became_active":"2024-08-18T22:27:24.573562+0000","last_became_peered":"2024-08-18T22:27:24.573562+0000","last_unstale":"2024-08-18T22:27:24.576445+0000","last_undegraded":"2024-08-18T22:27:24.576445+0000","last_fullsized":"2024-08-18T22:27:24.576445+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:15.654628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866504+0000","last_change":"2024-08-18T22:27:23.552008+0000","last_active":"2024-08-18T22:27:26.866504+0000","last_peered":"2024-08-18T22:27:26.866504+0000","last_clean":"2024-08-18T22:27:26.866504+0000","last_became_active":"2024-08-18T22:27:23.551740+0000","last_became_peered":"2024-08-18T22:27:23.551740+0000","last_unstale":"2024-08-18T22:27:26.866504+0000","last_undegraded":"2024-08-18T22:27:26.866504+0000","last_fullsized":"2024-08-18T22:27:26.866504+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:01.622209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565995+0000","last_change":"2024-08-18T22:27:24.577066+0000","last_active":"2024-08-18T22:27:25.565995+0000","last_peered":"2024-08-18T22:27:25.565995+0000","last_clean":"2024-08-18T22:27:25.565995+0000","last_became_active":"2024-08-18T22:27:24.576743+0000","last_became_peered":"2024-08-18T22:27:24.576743+0000","last_unstale":"2024-08-18T22:27:25.565995+0000","last_undegraded":"2024-08-18T22:27:25.565995+0000","last_fullsized":"2024-08-18T22:27:25.565995+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:32.043981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"128'1","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866929+0000","last_change":"2024-08-18T22:27:23.548589+0000","last_active":"2024-08-18T22:27:26.866929+0000","last_peered":"2024-08-18T22:27:26.866929+0000","last_clean":"2024-08-18T22:27:26.866929+0000","last_became_active":"2024-08-18T22:27:23.546800+0000","last_became_peered":"2024-08-18T22:27:23.546800+0000","last_unstale":"2024-08-18T22:27:26.866929+0000","last_undegraded":"2024-08-18T22:27:26.866929+0000","last_fullsized":"2024-08-18T22:27:26.866929+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:48.876821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.570084+0000","last_change":"2024-08-18T22:27:24.560518+0000","last_active":"2024-08-18T22:27:24.570084+0000","last_peered":"2024-08-18T22:27:24.570084+0000","last_clean":"2024-08-18T22:27:24.570084+0000","last_became_active":"2024-08-18T22:27:24.560227+0000","last_became_peered":"2024-08-18T22:27:24.560227+0000","last_unstale":"2024-08-18T22:27:24.570084+0000","last_undegraded":"2024-08-18T22:27:24.570084+0000","last_fullsized":"2024-08-18T22:27:24.570084+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:04:16.308159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.582468+0000","last_change":"2024-08-18T22:27:23.545359+0000","last_active":"2024-08-18T22:27:24.582468+0000","last_peered":"2024-08-18T22:27:24.582468+0000","last_clean":"2024-08-18T22:27:24.582468+0000","last_became_active":"2024-08-18T22:27:23.545080+0000","last_became_peered":"2024-08-18T22:27:23.545080+0000","last_unstale":"2024-08-18T22:27:24.582468+0000","last_undegraded":"2024-08-18T22:27:24.582468+0000","last_fullsized":"2024-08-18T22:27:24.582468+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:05:03.331984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568333+0000","last_change":"2024-08-18T22:27:24.570784+0000","last_active":"2024-08-18T22:27:25.568333+0000","last_peered":"2024-08-18T22:27:25.568333+0000","last_clean":"2024-08-18T22:27:25.568333+0000","last_became_active":"2024-08-18T22:27:24.570071+0000","last_became_peered":"2024-08-18T22:27:24.570071+0000","last_unstale":"2024-08-18T22:27:25.568333+0000","last_undegraded":"2024-08-18T22:27:25.568333+0000","last_fullsized":"2024-08-18T22:27:25.568333+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:11.695344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"128'1","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564514+0000","last_change":"2024-08-18T22:27:23.546608+0000","last_active":"2024-08-18T22:27:25.564514+0000","last_peered":"2024-08-18T22:27:25.564514+0000","last_clean":"2024-08-18T22:27:25.564514+0000","last_became_active":"2024-08-18T22:27:23.546365+0000","last_became_peered":"2024-08-18T22:27:23.546365+0000","last_unstale":"2024-08-18T22:27:25.564514+0000","last_undegraded":"2024-08-18T22:27:25.564514+0000","last_fullsized":"2024-08-18T22:27:25.564514+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:21.461235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.566221+0000","last_change":"2024-08-18T22:27:24.582966+0000","last_active":"2024-08-18T22:27:25.566221+0000","last_peered":"2024-08-18T22:27:25.566221+0000","last_clean":"2024-08-18T22:27:25.566221+0000","last_became_active":"2024-08-18T22:27:24.582623+0000","last_became_peered":"2024-08-18T22:27:24.582623+0000","last_unstale":"2024-08-18T22:27:25.566221+0000","last_undegraded":"2024-08-18T22:27:25.566221+0000","last_fullsized":"2024-08-18T22:27:25.566221+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:42:40.050115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564033+0000","last_change":"2024-08-18T22:27:23.542231+0000","last_active":"2024-08-18T22:27:25.564033+0000","last_peered":"2024-08-18T22:27:25.564033+0000","last_clean":"2024-08-18T22:27:25.564033+0000","last_became_active":"2024-08-18T22:27:23.541939+0000","last_became_peered":"2024-08-18T22:27:23.541939+0000","last_unstale":"2024-08-18T22:27:25.564033+0000","last_undegraded":"2024-08-18T22:27:25.564033+0000","last_fullsized":"2024-08-18T22:27:25.564033+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:59:38.623176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.567970+0000","last_change":"2024-08-18T22:27:24.568218+0000","last_active":"2024-08-18T22:27:25.567970+0000","last_peered":"2024-08-18T22:27:25.567970+0000","last_clean":"2024-08-18T22:27:25.567970+0000","last_became_active":"2024-08-18T22:27:24.567923+0000","last_became_peered":"2024-08-18T22:27:24.567923+0000","last_unstale":"2024-08-18T22:27:25.567970+0000","last_undegraded":"2024-08-18T22:27:25.567970+0000","last_fullsized":"2024-08-18T22:27:25.567970+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:35.374633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"128'2","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568464+0000","last_change":"2024-08-18T22:27:23.545503+0000","last_active":"2024-08-18T22:27:25.568464+0000","last_peered":"2024-08-18T22:27:25.568464+0000","last_clean":"2024-08-18T22:27:25.568464+0000","last_became_active":"2024-08-18T22:27:23.545228+0000","last_became_peered":"2024-08-18T22:27:23.545228+0000","last_unstale":"2024-08-18T22:27:25.568464+0000","last_undegraded":"2024-08-18T22:27:25.568464+0000","last_fullsized":"2024-08-18T22:27:25.568464+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:46.176010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866277+0000","last_change":"2024-08-18T22:27:24.585934+0000","last_active":"2024-08-18T22:27:26.866277+0000","last_peered":"2024-08-18T22:27:26.866277+0000","last_clean":"2024-08-18T22:27:26.866277+0000","last_became_active":"2024-08-18T22:27:24.585595+0000","last_became_peered":"2024-08-18T22:27:24.585595+0000","last_unstale":"2024-08-18T22:27:26.866277+0000","last_undegraded":"2024-08-18T22:27:26.866277+0000","last_fullsized":"2024-08-18T22:27:26.866277+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:43:42.567772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563883+0000","last_change":"2024-08-18T22:27:23.539599+0000","last_active":"2024-08-18T22:27:25.563883+0000","last_peered":"2024-08-18T22:27:25.563883+0000","last_clean":"2024-08-18T22:27:25.563883+0000","last_became_active":"2024-08-18T22:27:23.539322+0000","last_became_peered":"2024-08-18T22:27:23.539322+0000","last_unstale":"2024-08-18T22:27:25.563883+0000","last_undegraded":"2024-08-18T22:27:25.563883+0000","last_fullsized":"2024-08-18T22:27:25.563883+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:16.866778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866413+0000","last_change":"2024-08-18T22:27:24.571809+0000","last_active":"2024-08-18T22:27:26.866413+0000","last_peered":"2024-08-18T22:27:26.866413+0000","last_clean":"2024-08-18T22:27:26.866413+0000","last_became_active":"2024-08-18T22:27:24.571357+0000","last_became_peered":"2024-08-18T22:27:24.571357+0000","last_unstale":"2024-08-18T22:27:26.866413+0000","last_undegraded":"2024-08-18T22:27:26.866413+0000","last_fullsized":"2024-08-18T22:27:26.866413+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:40.166656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866604+0000","last_change":"2024-08-18T22:27:23.544336+0000","last_active":"2024-08-18T22:27:26.866604+0000","last_peered":"2024-08-18T22:27:26.866604+0000","last_clean":"2024-08-18T22:27:26.866604+0000","last_became_active":"2024-08-18T22:27:23.544058+0000","last_became_peered":"2024-08-18T22:27:23.544058+0000","last_unstale":"2024-08-18T22:27:26.866604+0000","last_undegraded":"2024-08-18T22:27:26.866604+0000","last_fullsized":"2024-08-18T22:27:26.866604+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:31.037022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.566048+0000","last_change":"2024-08-18T22:27:24.580039+0000","last_active":"2024-08-18T22:27:25.566048+0000","last_peered":"2024-08-18T22:27:25.566048+0000","last_clean":"2024-08-18T22:27:25.566048+0000","last_became_active":"2024-08-18T22:27:24.578348+0000","last_became_peered":"2024-08-18T22:27:24.578348+0000","last_unstale":"2024-08-18T22:27:25.566048+0000","last_undegraded":"2024-08-18T22:27:25.566048+0000","last_fullsized":"2024-08-18T22:27:25.566048+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:19:07.873529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563493+0000","last_change":"2024-08-18T22:27:23.547090+0000","last_active":"2024-08-18T22:27:25.563493+0000","last_peered":"2024-08-18T22:27:25.563493+0000","last_clean":"2024-08-18T22:27:25.563493+0000","last_became_active":"2024-08-18T22:27:23.546820+0000","last_became_peered":"2024-08-18T22:27:23.546820+0000","last_unstale":"2024-08-18T22:27:25.563493+0000","last_undegraded":"2024-08-18T22:27:25.563493+0000","last_fullsized":"2024-08-18T22:27:25.563493+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:39:20.112152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568687+0000","last_change":"2024-08-18T22:27:24.563182+0000","last_active":"2024-08-18T22:27:25.568687+0000","last_peered":"2024-08-18T22:27:25.568687+0000","last_clean":"2024-08-18T22:27:25.568687+0000","last_became_active":"2024-08-18T22:27:24.562289+0000","last_became_peered":"2024-08-18T22:27:24.562289+0000","last_unstale":"2024-08-18T22:27:25.568687+0000","last_undegraded":"2024-08-18T22:27:25.568687+0000","last_fullsized":"2024-08-18T22:27:25.568687+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:18.757685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"128'2","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568288+0000","last_change":"2024-08-18T22:27:23.551796+0000","last_active":"2024-08-18T22:27:25.568288+0000","last_peered":"2024-08-18T22:27:25.568288+0000","last_clean":"2024-08-18T22:27:25.568288+0000","last_became_active":"2024-08-18T22:27:23.551536+0000","last_became_peered":"2024-08-18T22:27:23.551536+0000","last_unstale":"2024-08-18T22:27:25.568288+0000","last_undegraded":"2024-08-18T22:27:25.568288+0000","last_fullsized":"2024-08-18T22:27:25.568288+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:06.013695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866547+0000","last_change":"2024-08-18T22:27:24.572217+0000","last_active":"2024-08-18T22:27:26.866547+0000","last_peered":"2024-08-18T22:27:26.866547+0000","last_clean":"2024-08-18T22:27:26.866547+0000","last_became_active":"2024-08-18T22:27:24.571247+0000","last_became_peered":"2024-08-18T22:27:24.571247+0000","last_unstale":"2024-08-18T22:27:26.866547+0000","last_undegraded":"2024-08-18T22:27:26.866547+0000","last_fullsized":"2024-08-18T22:27:26.866547+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:43.493660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"129'1","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565054+0000","last_change":"2024-08-18T22:27:23.547122+0000","last_active":"2024-08-18T22:27:25.565054+0000","last_peered":"2024-08-18T22:27:25.565054+0000","last_clean":"2024-08-18T22:27:25.565054+0000","last_became_active":"2024-08-18T22:27:23.546628+0000","last_became_peered":"2024-08-18T22:27:23.546628+0000","last_unstale":"2024-08-18T22:27:25.565054+0000","last_undegraded":"2024-08-18T22:27:25.565054+0000","last_fullsized":"2024-08-18T22:27:25.565054+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:32.512213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564182+0000","last_change":"2024-08-18T22:27:24.562308+0000","last_active":"2024-08-18T22:27:25.564182+0000","last_peered":"2024-08-18T22:27:25.564182+0000","last_clean":"2024-08-18T22:27:25.564182+0000","last_became_active":"2024-08-18T22:27:24.562025+0000","last_became_peered":"2024-08-18T22:27:24.562025+0000","last_unstale":"2024-08-18T22:27:25.564182+0000","last_undegraded":"2024-08-18T22:27:25.564182+0000","last_fullsized":"2024-08-18T22:27:25.564182+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:36:44.494716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565390+0000","last_change":"2024-08-18T22:27:23.539274+0000","last_active":"2024-08-18T22:27:25.565390+0000","last_peered":"2024-08-18T22:27:25.565390+0000","last_clean":"2024-08-18T22:27:25.565390+0000","last_became_active":"2024-08-18T22:27:23.538927+0000","last_became_peered":"2024-08-18T22:27:23.538927+0000","last_unstale":"2024-08-18T22:27:25.565390+0000","last_undegraded":"2024-08-18T22:27:25.565390+0000","last_fullsized":"2024-08-18T22:27:25.565390+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:50.977899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.588902+0000","last_change":"2024-08-18T22:27:24.588134+0000","last_active":"2024-08-18T22:27:24.588902+0000","last_peered":"2024-08-18T22:27:24.588902+0000","last_clean":"2024-08-18T22:27:24.588902+0000","last_became_active":"2024-08-18T22:27:24.587781+0000","last_became_peered":"2024-08-18T22:27:24.587781+0000","last_unstale":"2024-08-18T22:27:24.588902+0000","last_undegraded":"2024-08-18T22:27:24.588902+0000","last_fullsized":"2024-08-18T22:27:24.588902+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:34.370960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568676+0000","last_change":"2024-08-18T22:27:23.549252+0000","last_active":"2024-08-18T22:27:25.568676+0000","last_peered":"2024-08-18T22:27:25.568676+0000","last_clean":"2024-08-18T22:27:25.568676+0000","last_became_active":"2024-08-18T22:27:23.548968+0000","last_became_peered":"2024-08-18T22:27:23.548968+0000","last_unstale":"2024-08-18T22:27:25.568676+0000","last_undegraded":"2024-08-18T22:27:25.568676+0000","last_fullsized":"2024-08-18T22:27:25.568676+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:19:06.994240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568130+0000","last_change":"2024-08-18T22:27:24.554611+0000","last_active":"2024-08-18T22:27:25.568130+0000","last_peered":"2024-08-18T22:27:25.568130+0000","last_clean":"2024-08-18T22:27:25.568130+0000","last_became_active":"2024-08-18T22:27:24.554084+0000","last_became_peered":"2024-08-18T22:27:24.554084+0000","last_unstale":"2024-08-18T22:27:25.568130+0000","last_undegraded":"2024-08-18T22:27:25.568130+0000","last_fullsized":"2024-08-18T22:27:25.568130+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:33.716538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.549661+0000","last_change":"2024-08-18T22:27:23.550306+0000","last_active":"2024-08-18T22:27:24.549661+0000","last_peered":"2024-08-18T22:27:24.549661+0000","last_clean":"2024-08-18T22:27:24.549661+0000","last_became_active":"2024-08-18T22:27:23.549975+0000","last_became_peered":"2024-08-18T22:27:23.549975+0000","last_unstale":"2024-08-18T22:27:24.549661+0000","last_undegraded":"2024-08-18T22:27:24.549661+0000","last_fullsized":"2024-08-18T22:27:24.549661+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:01:11.437061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866419+0000","last_change":"2024-08-18T22:27:24.573091+0000","last_active":"2024-08-18T22:27:26.866419+0000","last_peered":"2024-08-18T22:27:26.866419+0000","last_clean":"2024-08-18T22:27:26.866419+0000","last_became_active":"2024-08-18T22:27:24.572809+0000","last_became_peered":"2024-08-18T22:27:24.572809+0000","last_unstale":"2024-08-18T22:27:26.866419+0000","last_undegraded":"2024-08-18T22:27:26.866419+0000","last_fullsized":"2024-08-18T22:27:26.866419+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:34:32.463973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-08-18T22:27:24.548932+0000","last_change":"2024-08-18T22:27:23.545190+0000","last_active":"2024-08-18T22:27:24.548932+0000","last_peered":"2024-08-18T22:27:24.548932+0000","last_clean":"2024-08-18T22:27:24.548932+0000","last_became_active":"2024-08-18T22:27:23.544813+0000","last_became_peered":"2024-08-18T22:27:23.544813+0000","last_unstale":"2024-08-18T22:27:24.548932+0000","last_undegraded":"2024-08-18T22:27:24.548932+0000","last_fullsized":"2024-08-18T22:27:24.548932+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:53.358060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563775+0000","last_change":"2024-08-18T22:27:24.561365+0000","last_active":"2024-08-18T22:27:25.563775+0000","last_peered":"2024-08-18T22:27:25.563775+0000","last_clean":"2024-08-18T22:27:25.563775+0000","last_became_active":"2024-08-18T22:27:24.561026+0000","last_became_peered":"2024-08-18T22:27:24.561026+0000","last_unstale":"2024-08-18T22:27:25.563775+0000","last_undegraded":"2024-08-18T22:27:25.563775+0000","last_fullsized":"2024-08-18T22:27:25.563775+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:32.043981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568029+0000","last_change":"2024-08-18T22:27:23.553339+0000","last_active":"2024-08-18T22:27:25.568029+0000","last_peered":"2024-08-18T22:27:25.568029+0000","last_clean":"2024-08-18T22:27:25.568029+0000","last_became_active":"2024-08-18T22:27:23.548574+0000","last_became_peered":"2024-08-18T22:27:23.548574+0000","last_unstale":"2024-08-18T22:27:25.568029+0000","last_undegraded":"2024-08-18T22:27:25.568029+0000","last_fullsized":"2024-08-18T22:27:25.568029+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:17:48.562586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866726+0000","last_change":"2024-08-18T22:27:24.560324+0000","last_active":"2024-08-18T22:27:26.866726+0000","last_peered":"2024-08-18T22:27:26.866726+0000","last_clean":"2024-08-18T22:27:26.866726+0000","last_became_active":"2024-08-18T22:27:24.560041+0000","last_became_peered":"2024-08-18T22:27:24.560041+0000","last_unstale":"2024-08-18T22:27:26.866726+0000","last_undegraded":"2024-08-18T22:27:26.866726+0000","last_fullsized":"2024-08-18T22:27:26.866726+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:33.519172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563604+0000","last_change":"2024-08-18T22:27:23.536731+0000","last_active":"2024-08-18T22:27:25.563604+0000","last_peered":"2024-08-18T22:27:25.563604+0000","last_clean":"2024-08-18T22:27:25.563604+0000","last_became_active":"2024-08-18T22:27:23.536418+0000","last_became_peered":"2024-08-18T22:27:23.536418+0000","last_unstale":"2024-08-18T22:27:25.563604+0000","last_undegraded":"2024-08-18T22:27:25.563604+0000","last_fullsized":"2024-08-18T22:27:25.563604+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:43:04.208784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564462+0000","last_change":"2024-08-18T22:27:24.564048+0000","last_active":"2024-08-18T22:27:25.564462+0000","last_peered":"2024-08-18T22:27:25.564462+0000","last_clean":"2024-08-18T22:27:25.564462+0000","last_became_active":"2024-08-18T22:27:24.561818+0000","last_became_peered":"2024-08-18T22:27:24.561818+0000","last_unstale":"2024-08-18T22:27:25.564462+0000","last_undegraded":"2024-08-18T22:27:25.564462+0000","last_fullsized":"2024-08-18T22:27:25.564462+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:34:08.205806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"128'8","reported_seq":22,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866335+0000","last_change":"2024-08-18T22:27:23.553624+0000","last_active":"2024-08-18T22:27:26.866335+0000","last_peered":"2024-08-18T22:27:26.866335+0000","last_clean":"2024-08-18T22:27:26.866335+0000","last_became_active":"2024-08-18T22:27:23.553355+0000","last_became_peered":"2024-08-18T22:27:23.553355+0000","last_unstale":"2024-08-18T22:27:26.866335+0000","last_undegraded":"2024-08-18T22:27:26.866335+0000","last_fullsized":"2024-08-18T22:27:26.866335+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:30:54.511325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":390,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564112+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:27:25.564112+0000","last_peered":"2024-08-18T22:27:25.564112+0000","last_clean":"2024-08-18T22:27:25.564112+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:27:25.564112+0000","last_undegraded":"2024-08-18T22:27:25.564112+0000","last_fullsized":"2024-08-18T22:27:25.564112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41656,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330184,"statfs":{"total":96636764160,"available":96594108416,"internally_reserved":0,"allocated":2207744,"data_stored":1344157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509545,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41068,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330772,"statfs":{"total":96636764160,"available":96594710528,"internally_reserved":0,"allocated":1601536,"data_stored":753595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509543,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41072,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330768,"statfs":{"total":96636764160,"available":96594706432,"internally_reserved":0,"allocated":1605632,"data_stored":753173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1613824,"data_stored":754659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509543,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50792,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1601536,"data_stored":753035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509544,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51372,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320468,"statfs":{"total":96636764160,"available":96584159232,"internally_reserved":0,"allocated":2195456,"data_stored":1343403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50788,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321052,"statfs":{"total":96636764160,"available":96584757248,"internally_reserved":0,"allocated":1597440,"data_stored":747933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574951,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50780,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321060,"statfs":{"total":96636764160,"available":96584765440,"internally_reserved":0,"allocated":1585152,"data_stored":746321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:27:33.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:27:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.436+0000 7f96ace00640 1 Processor -- start 2024-08-18T22:27:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.436+0000 7f96ace00640 1 -- start start 2024-08-18T22:27:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.436+0000 7f96ace00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a80cf120 0x7f96a80b6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.436+0000 7f96ace00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a80d0960 con 0x7f96a80b6b40 2024-08-18T22:27:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.436+0000 7f96ace00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a80b7210 con 0x7f96a815bb10 2024-08-18T22:27:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.436+0000 7f96ace00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f96a80b6fd0 con 0x7f96a80cf120 2024-08-18T22:27:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.440+0000 7f96a7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f96a80b6b40 0x7f96a80d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53146/0 (socket says 172.21.15.5:53146) 2024-08-18T22:27:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.440+0000 7f96a7e00640 1 -- 172.21.15.5:0/1093109809 learned_addr learned my addr 172.21.15.5:0/1093109809 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.440+0000 7f96a6a00640 1 --2- 172.21.15.5:0/1093109809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a80cf120 0x7f96a80b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.440+0000 7f96a6000640 1 -- 172.21.15.5:0/1093109809 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588314538 0 0) 0x7f96a80d0960 con 0x7f96a80b6b40 2024-08-18T22:27:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.440+0000 7f96a6000640 1 -- 172.21.15.5:0/1093109809 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f968c003530 con 0x7f96a80b6b40 2024-08-18T22:27:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.440+0000 7f96a6000640 1 -- 172.21.15.5:0/1093109809 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4144068153 0 0) 0x7f96a80b7210 con 0x7f96a815bb10 2024-08-18T22:27:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.440+0000 7f96a6000640 1 -- 172.21.15.5:0/1093109809 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96a80d0960 con 0x7f96a815bb10 2024-08-18T22:27:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.440+0000 7f96a6a00640 1 -- 172.21.15.5:0/1093109809 >> v1:172.21.15.117:6789/0 conn(0x7f96a815bb10 legacy=0x7f96a80cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.440+0000 7f96a6a00640 1 -- 172.21.15.5:0/1093109809 >> v1:172.21.15.5:6789/0 conn(0x7f96a80b6b40 legacy=0x7f96a80d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.440+0000 7f96a6a00640 1 -- 172.21.15.5:0/1093109809 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a80b74f0 con 0x7f96a80cf120 2024-08-18T22:27:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.440+0000 7f96a6a00640 1 --2- 172.21.15.5:0/1093109809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a80cf120 0x7f96a80b6600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f96940097f0 tx=0x7f969401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18dd6ae37db3ab6b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96a6000640 1 -- 172.21.15.5:0/1093109809 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96940b0070 con 0x7f96a80cf120 2024-08-18T22:27:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96a6000640 1 -- 172.21.15.5:0/1093109809 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96940ab600 con 0x7f96a80cf120 2024-08-18T22:27:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96a6000640 1 -- 172.21.15.5:0/1093109809 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96940ab9b0 con 0x7f96a80cf120 2024-08-18T22:27:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 -- 172.21.15.5:0/1093109809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a80cf120 msgr2=0x7f96a80b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 --2- 172.21.15.5:0/1093109809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a80cf120 0x7f96a80b6600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f96940097f0 tx=0x7f969401c4e0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 -- 172.21.15.5:0/1093109809 shutdown_connections 2024-08-18T22:27:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 --2- 172.21.15.5:0/1093109809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a80cf120 0x7f96a80b6600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 -- 172.21.15.5:0/1093109809 >> 172.21.15.5:0/1093109809 conn(0x7f96a806fca0 msgr2=0x7f96a80700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 -- 172.21.15.5:0/1093109809 shutdown_connections 2024-08-18T22:27:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 -- 172.21.15.5:0/1093109809 wait complete. 2024-08-18T22:27:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 Processor -- start 2024-08-18T22:27:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 -- start start 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a80b6b40 0x7f96a814f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a80cf120 0x7f96a8167300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a815bb10 0x7f96a80cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f96a815cad0 con 0x7f96a815bb10 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96a815c950 con 0x7f96a80cf120 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96ace00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f96a8169d60 con 0x7f96a80b6b40 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.444+0000 7f96a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a815bb10 0x7f96a80cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a815bb10 0x7f96a80cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53582/0 (socket says 172.21.15.5:53582) 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96a7e00640 1 -- 172.21.15.5:0/2283933640 learned_addr learned my addr 172.21.15.5:0/2283933640 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96a6a00640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a80cf120 0x7f96a8167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96a7400640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a80b6b40 0x7f96a814f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96a7e00640 1 -- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a80b6b40 msgr2=0x7f96a814f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96a7e00640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a80b6b40 0x7f96a814f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96a7e00640 1 -- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a80cf120 msgr2=0x7f96a8167300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96a7e00640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a80cf120 0x7f96a8167300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96a7e00640 1 -- 172.21.15.5:0/2283933640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a80cc7e0 con 0x7f96a815bb10 2024-08-18T22:27:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96a7e00640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a815bb10 0x7f96a80cc2a0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f96a000c3c0 tx=0x7f96a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f969f400640 1 -- 172.21.15.5:0/2283933640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0017070 con 0x7f96a815bb10 2024-08-18T22:27:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96ace00640 1 -- 172.21.15.5:0/2283933640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a80cca80 con 0x7f96a815bb10 2024-08-18T22:27:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f969f400640 1 -- 172.21.15.5:0/2283933640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a0005cf0 con 0x7f96a815bb10 2024-08-18T22:27:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f969f400640 1 -- 172.21.15.5:0/2283933640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a00072f0 con 0x7f96a815bb10 2024-08-18T22:27:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96ace00640 1 -- 172.21.15.5:0/2283933640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a80cd040 con 0x7f96a815bb10 2024-08-18T22:27:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f96ace00640 1 -- 172.21.15.5:0/2283933640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a80b6600 con 0x7f96a815bb10 2024-08-18T22:27:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.448+0000 7f969f400640 1 -- 172.21.15.5:0/2283933640 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96a001a070 con 0x7f96a815bb10 2024-08-18T22:27:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.452+0000 7f969f400640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96880678c0 0x7f9688069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.452+0000 7f969f400640 1 -- 172.21.15.5:0/2283933640 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f96a0085260 con 0x7f96a815bb10 2024-08-18T22:27:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.452+0000 7f96a7400640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96880678c0 0x7f9688069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.452+0000 7f96a7400640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96880678c0 0x7f9688069d80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f96a814cb70 tx=0x7f9698009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.456+0000 7f969f400640 1 -- 172.21.15.5:0/2283933640 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f96a00554a0 con 0x7f96a815bb10 2024-08-18T22:27:33.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.620+0000 7f96ace00640 1 -- 172.21.15.5:0/2283933640 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f96a814de50 con 0x7f96880678c0 2024-08-18T22:27:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.624+0000 7f969f400640 1 -- 172.21.15.5:0/2283933640 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252488 (secure 0 0 0) 0x7f96a814de50 con 0x7f96880678c0 2024-08-18T22:27:33.628 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:27:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 -- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96880678c0 msgr2=0x7f9688069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96880678c0 0x7f9688069d80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f96a814cb70 tx=0x7f9698009040 comp rx=0 tx=0).stop 2024-08-18T22:27:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 -- 172.21.15.5:0/2283933640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a815bb10 msgr2=0x7f96a80cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a815bb10 0x7f96a80cc2a0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f96a000c3c0 tx=0x7f96a000c880 comp rx=0 tx=0).stop 2024-08-18T22:27:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 -- 172.21.15.5:0/2283933640 shutdown_connections 2024-08-18T22:27:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96880678c0 0x7f9688069d80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96a815bb10 0x7f96a80cc2a0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a80cf120 0x7f96a8167300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 --2- 172.21.15.5:0/2283933640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a80b6b40 0x7f96a814f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 -- 172.21.15.5:0/2283933640 >> 172.21.15.5:0/2283933640 conn(0x7f96a806fca0 msgr2=0x7f96a80d1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 -- 172.21.15.5:0/2283933640 shutdown_connections 2024-08-18T22:27:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.628+0000 7f96ace00640 1 -- 172.21.15.5:0/2283933640 wait complete. 2024-08-18T22:27:33.649 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-08-18T22:27:31.741800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":378360,"kb_used_data":13704,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754596360,"statfs":{"total":773094113280,"available":772706672640,"internally_reserved":0,"allocated":14032896,"data_stored":7209660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002278"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866042+0000","last_change":"2024-08-18T22:27:24.555768+0000","last_active":"2024-08-18T22:27:26.866042+0000","last_peered":"2024-08-18T22:27:26.866042+0000","last_clean":"2024-08-18T22:27:26.866042+0000","last_became_active":"2024-08-18T22:27:24.555457+0000","last_became_peered":"2024-08-18T22:27:24.555457+0000","last_unstale":"2024-08-18T22:27:26.866042+0000","last_undegraded":"2024-08-18T22:27:26.866042+0000","last_fullsized":"2024-08-18T22:27:26.866042+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:04:51.254376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867242+0000","last_change":"2024-08-18T22:27:24.565807+0000","last_active":"2024-08-18T22:27:26.867242+0000","last_peered":"2024-08-18T22:27:26.867242+0000","last_clean":"2024-08-18T22:27:26.867242+0000","last_became_active":"2024-08-18T22:27:24.565296+0000","last_became_peered":"2024-08-18T22:27:24.565296+0000","last_unstale":"2024-08-18T22:27:26.867242+0000","last_undegraded":"2024-08-18T22:27:26.867242+0000","last_fullsized":"2024-08-18T22:27:26.867242+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:29:31.411919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867004+0000","last_change":"2024-08-18T22:27:24.575520+0000","last_active":"2024-08-18T22:27:26.867004+0000","last_peered":"2024-08-18T22:27:26.867004+0000","last_clean":"2024-08-18T22:27:26.867004+0000","last_became_active":"2024-08-18T22:27:24.575332+0000","last_became_peered":"2024-08-18T22:27:24.575332+0000","last_unstale":"2024-08-18T22:27:26.867004+0000","last_undegraded":"2024-08-18T22:27:26.867004+0000","last_fullsized":"2024-08-18T22:27:26.867004+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:40:37.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563933+0000","last_change":"2024-08-18T22:27:24.562537+0000","last_active":"2024-08-18T22:27:25.563933+0000","last_peered":"2024-08-18T22:27:25.563933+0000","last_clean":"2024-08-18T22:27:25.563933+0000","last_became_active":"2024-08-18T22:27:24.562094+0000","last_became_peered":"2024-08-18T22:27:24.562094+0000","last_unstale":"2024-08-18T22:27:25.563933+0000","last_undegraded":"2024-08-18T22:27:25.563933+0000","last_fullsized":"2024-08-18T22:27:25.563933+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:19:07.873529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.865600+0000","last_change":"2024-08-18T22:27:24.566222+0000","last_active":"2024-08-18T22:27:26.865600+0000","last_peered":"2024-08-18T22:27:26.865600+0000","last_clean":"2024-08-18T22:27:26.865600+0000","last_became_active":"2024-08-18T22:27:24.565894+0000","last_became_peered":"2024-08-18T22:27:24.565894+0000","last_unstale":"2024-08-18T22:27:26.865600+0000","last_undegraded":"2024-08-18T22:27:26.865600+0000","last_fullsized":"2024-08-18T22:27:26.865600+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:40:23.034466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568278+0000","last_change":"2024-08-18T22:27:24.567015+0000","last_active":"2024-08-18T22:27:25.568278+0000","last_peered":"2024-08-18T22:27:25.568278+0000","last_clean":"2024-08-18T22:27:25.568278+0000","last_became_active":"2024-08-18T22:27:24.566662+0000","last_became_peered":"2024-08-18T22:27:24.566662+0000","last_unstale":"2024-08-18T22:27:25.568278+0000","last_undegraded":"2024-08-18T22:27:25.568278+0000","last_fullsized":"2024-08-18T22:27:25.568278+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:14.666642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568007+0000","last_change":"2024-08-18T22:27:24.553498+0000","last_active":"2024-08-18T22:27:25.568007+0000","last_peered":"2024-08-18T22:27:25.568007+0000","last_clean":"2024-08-18T22:27:25.568007+0000","last_became_active":"2024-08-18T22:27:24.553175+0000","last_became_peered":"2024-08-18T22:27:24.553175+0000","last_unstale":"2024-08-18T22:27:25.568007+0000","last_undegraded":"2024-08-18T22:27:25.568007+0000","last_fullsized":"2024-08-18T22:27:25.568007+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:27.132996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866227+0000","last_change":"2024-08-18T22:27:24.575315+0000","last_active":"2024-08-18T22:27:26.866227+0000","last_peered":"2024-08-18T22:27:26.866227+0000","last_clean":"2024-08-18T22:27:26.866227+0000","last_became_active":"2024-08-18T22:27:24.574935+0000","last_became_peered":"2024-08-18T22:27:24.574935+0000","last_unstale":"2024-08-18T22:27:26.866227+0000","last_undegraded":"2024-08-18T22:27:26.866227+0000","last_fullsized":"2024-08-18T22:27:26.866227+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:30:23.083345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564844+0000","last_change":"2024-08-18T22:27:24.563740+0000","last_active":"2024-08-18T22:27:25.564844+0000","last_peered":"2024-08-18T22:27:25.564844+0000","last_clean":"2024-08-18T22:27:25.564844+0000","last_became_active":"2024-08-18T22:27:24.563441+0000","last_became_peered":"2024-08-18T22:27:24.563441+0000","last_unstale":"2024-08-18T22:27:25.564844+0000","last_undegraded":"2024-08-18T22:27:25.564844+0000","last_fullsized":"2024-08-18T22:27:25.564844+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:31:43.357911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866819+0000","last_change":"2024-08-18T22:27:24.571496+0000","last_active":"2024-08-18T22:27:26.866819+0000","last_peered":"2024-08-18T22:27:26.866819+0000","last_clean":"2024-08-18T22:27:26.866819+0000","last_became_active":"2024-08-18T22:27:24.570856+0000","last_became_peered":"2024-08-18T22:27:24.570856+0000","last_unstale":"2024-08-18T22:27:26.866819+0000","last_undegraded":"2024-08-18T22:27:26.866819+0000","last_fullsized":"2024-08-18T22:27:26.866819+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:52.124117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.865672+0000","last_change":"2024-08-18T22:27:24.577512+0000","last_active":"2024-08-18T22:27:26.865672+0000","last_peered":"2024-08-18T22:27:26.865672+0000","last_clean":"2024-08-18T22:27:26.865672+0000","last_became_active":"2024-08-18T22:27:24.577167+0000","last_became_peered":"2024-08-18T22:27:24.577167+0000","last_unstale":"2024-08-18T22:27:26.865672+0000","last_undegraded":"2024-08-18T22:27:26.865672+0000","last_fullsized":"2024-08-18T22:27:26.865672+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:22:21.127111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568577+0000","last_change":"2024-08-18T22:27:24.561165+0000","last_active":"2024-08-18T22:27:25.568577+0000","last_peered":"2024-08-18T22:27:25.568577+0000","last_clean":"2024-08-18T22:27:25.568577+0000","last_became_active":"2024-08-18T22:27:24.556827+0000","last_became_peered":"2024-08-18T22:27:24.556827+0000","last_unstale":"2024-08-18T22:27:25.568577+0000","last_undegraded":"2024-08-18T22:27:25.568577+0000","last_fullsized":"2024-08-18T22:27:25.568577+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:51:41.670375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866406+0000","last_change":"2024-08-18T22:27:24.586599+0000","last_active":"2024-08-18T22:27:26.866406+0000","last_peered":"2024-08-18T22:27:26.866406+0000","last_clean":"2024-08-18T22:27:26.866406+0000","last_became_active":"2024-08-18T22:27:24.586284+0000","last_became_peered":"2024-08-18T22:27:24.586284+0000","last_unstale":"2024-08-18T22:27:26.866406+0000","last_undegraded":"2024-08-18T22:27:26.866406+0000","last_fullsized":"2024-08-18T22:27:26.866406+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:53.770712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866207+0000","last_change":"2024-08-18T22:27:24.572012+0000","last_active":"2024-08-18T22:27:26.866207+0000","last_peered":"2024-08-18T22:27:26.866207+0000","last_clean":"2024-08-18T22:27:26.866207+0000","last_became_active":"2024-08-18T22:27:24.571741+0000","last_became_peered":"2024-08-18T22:27:24.571741+0000","last_unstale":"2024-08-18T22:27:26.866207+0000","last_undegraded":"2024-08-18T22:27:26.866207+0000","last_fullsized":"2024-08-18T22:27:26.866207+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:13.963922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.865485+0000","last_change":"2024-08-18T22:27:24.586295+0000","last_active":"2024-08-18T22:27:26.865485+0000","last_peered":"2024-08-18T22:27:26.865485+0000","last_clean":"2024-08-18T22:27:26.865485+0000","last_became_active":"2024-08-18T22:27:24.585876+0000","last_became_peered":"2024-08-18T22:27:24.585876+0000","last_unstale":"2024-08-18T22:27:26.865485+0000","last_undegraded":"2024-08-18T22:27:26.865485+0000","last_fullsized":"2024-08-18T22:27:26.865485+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:28:42.528224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.567976+0000","last_change":"2024-08-18T22:27:24.564072+0000","last_active":"2024-08-18T22:27:25.567976+0000","last_peered":"2024-08-18T22:27:25.567976+0000","last_clean":"2024-08-18T22:27:25.567976+0000","last_became_active":"2024-08-18T22:27:24.563797+0000","last_became_peered":"2024-08-18T22:27:24.563797+0000","last_unstale":"2024-08-18T22:27:25.567976+0000","last_undegraded":"2024-08-18T22:27:25.567976+0000","last_fullsized":"2024-08-18T22:27:25.567976+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:48:24.593145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866888+0000","last_change":"2024-08-18T22:27:24.586536+0000","last_active":"2024-08-18T22:27:26.866888+0000","last_peered":"2024-08-18T22:27:26.866888+0000","last_clean":"2024-08-18T22:27:26.866888+0000","last_became_active":"2024-08-18T22:27:24.586213+0000","last_became_peered":"2024-08-18T22:27:24.586213+0000","last_unstale":"2024-08-18T22:27:26.866888+0000","last_undegraded":"2024-08-18T22:27:26.866888+0000","last_fullsized":"2024-08-18T22:27:26.866888+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:59:39.630135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867410+0000","last_change":"2024-08-18T22:27:24.565579+0000","last_active":"2024-08-18T22:27:26.867410+0000","last_peered":"2024-08-18T22:27:26.867410+0000","last_clean":"2024-08-18T22:27:26.867410+0000","last_became_active":"2024-08-18T22:27:24.564907+0000","last_became_peered":"2024-08-18T22:27:24.564907+0000","last_unstale":"2024-08-18T22:27:26.867410+0000","last_undegraded":"2024-08-18T22:27:26.867410+0000","last_fullsized":"2024-08-18T22:27:26.867410+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:21.862152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565277+0000","last_change":"2024-08-18T22:27:24.565097+0000","last_active":"2024-08-18T22:27:25.565277+0000","last_peered":"2024-08-18T22:27:25.565277+0000","last_clean":"2024-08-18T22:27:25.565277+0000","last_became_active":"2024-08-18T22:27:24.564536+0000","last_became_peered":"2024-08-18T22:27:24.564536+0000","last_unstale":"2024-08-18T22:27:25.565277+0000","last_undegraded":"2024-08-18T22:27:25.565277+0000","last_fullsized":"2024-08-18T22:27:25.565277+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:10:16.054969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867447+0000","last_change":"2024-08-18T22:27:24.572897+0000","last_active":"2024-08-18T22:27:26.867447+0000","last_peered":"2024-08-18T22:27:26.867447+0000","last_clean":"2024-08-18T22:27:26.867447+0000","last_became_active":"2024-08-18T22:27:24.572530+0000","last_became_peered":"2024-08-18T22:27:24.572530+0000","last_unstale":"2024-08-18T22:27:26.867447+0000","last_undegraded":"2024-08-18T22:27:26.867447+0000","last_fullsized":"2024-08-18T22:27:26.867447+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:10.161642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564339+0000","last_change":"2024-08-18T22:27:24.562567+0000","last_active":"2024-08-18T22:27:25.564339+0000","last_peered":"2024-08-18T22:27:25.564339+0000","last_clean":"2024-08-18T22:27:25.564339+0000","last_became_active":"2024-08-18T22:27:24.561170+0000","last_became_peered":"2024-08-18T22:27:24.561170+0000","last_unstale":"2024-08-18T22:27:25.564339+0000","last_undegraded":"2024-08-18T22:27:25.564339+0000","last_fullsized":"2024-08-18T22:27:25.564339+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:42:40.050115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.865916+0000","last_change":"2024-08-18T22:27:24.560726+0000","last_active":"2024-08-18T22:27:26.865916+0000","last_peered":"2024-08-18T22:27:26.865916+0000","last_clean":"2024-08-18T22:27:26.865916+0000","last_became_active":"2024-08-18T22:27:24.560454+0000","last_became_peered":"2024-08-18T22:27:24.560454+0000","last_unstale":"2024-08-18T22:27:26.865916+0000","last_undegraded":"2024-08-18T22:27:26.865916+0000","last_fullsized":"2024-08-18T22:27:26.865916+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:05:53.067256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563958+0000","last_change":"2024-08-18T22:27:24.560325+0000","last_active":"2024-08-18T22:27:25.563958+0000","last_peered":"2024-08-18T22:27:25.563958+0000","last_clean":"2024-08-18T22:27:25.563958+0000","last_became_active":"2024-08-18T22:27:24.559125+0000","last_became_peered":"2024-08-18T22:27:24.559125+0000","last_unstale":"2024-08-18T22:27:25.563958+0000","last_undegraded":"2024-08-18T22:27:25.563958+0000","last_fullsized":"2024-08-18T22:27:25.563958+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:54.917980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564790+0000","last_change":"2024-08-18T22:27:24.574623+0000","last_active":"2024-08-18T22:27:25.564790+0000","last_peered":"2024-08-18T22:27:25.564790+0000","last_clean":"2024-08-18T22:27:25.564790+0000","last_became_active":"2024-08-18T22:27:24.574333+0000","last_became_peered":"2024-08-18T22:27:24.574333+0000","last_unstale":"2024-08-18T22:27:25.564790+0000","last_undegraded":"2024-08-18T22:27:25.564790+0000","last_fullsized":"2024-08-18T22:27:25.564790+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:29.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.566076+0000","last_change":"2024-08-18T22:27:24.583617+0000","last_active":"2024-08-18T22:27:25.566076+0000","last_peered":"2024-08-18T22:27:25.566076+0000","last_clean":"2024-08-18T22:27:25.566076+0000","last_became_active":"2024-08-18T22:27:24.581849+0000","last_became_peered":"2024-08-18T22:27:24.581849+0000","last_unstale":"2024-08-18T22:27:25.566076+0000","last_undegraded":"2024-08-18T22:27:25.566076+0000","last_fullsized":"2024-08-18T22:27:25.566076+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:54.917980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867817+0000","last_change":"2024-08-18T22:27:24.567510+0000","last_active":"2024-08-18T22:27:26.867817+0000","last_peered":"2024-08-18T22:27:26.867817+0000","last_clean":"2024-08-18T22:27:26.867817+0000","last_became_active":"2024-08-18T22:27:24.565899+0000","last_became_peered":"2024-08-18T22:27:24.565899+0000","last_unstale":"2024-08-18T22:27:26.867817+0000","last_undegraded":"2024-08-18T22:27:26.867817+0000","last_fullsized":"2024-08-18T22:27:26.867817+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:26:20.829797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565277+0000","last_change":"2024-08-18T22:27:24.565295+0000","last_active":"2024-08-18T22:27:25.565277+0000","last_peered":"2024-08-18T22:27:25.565277+0000","last_clean":"2024-08-18T22:27:25.565277+0000","last_became_active":"2024-08-18T22:27:24.564861+0000","last_became_peered":"2024-08-18T22:27:24.564861+0000","last_unstale":"2024-08-18T22:27:25.565277+0000","last_undegraded":"2024-08-18T22:27:25.565277+0000","last_fullsized":"2024-08-18T22:27:25.565277+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:11:36.144908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568560+0000","last_change":"2024-08-18T22:27:24.583596+0000","last_active":"2024-08-18T22:27:25.568560+0000","last_peered":"2024-08-18T22:27:25.568560+0000","last_clean":"2024-08-18T22:27:25.568560+0000","last_became_active":"2024-08-18T22:27:24.580323+0000","last_became_peered":"2024-08-18T22:27:24.580323+0000","last_unstale":"2024-08-18T22:27:25.568560+0000","last_undegraded":"2024-08-18T22:27:25.568560+0000","last_fullsized":"2024-08-18T22:27:25.568560+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:07.834773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867572+0000","last_change":"2024-08-18T22:27:24.569829+0000","last_active":"2024-08-18T22:27:26.867572+0000","last_peered":"2024-08-18T22:27:26.867572+0000","last_clean":"2024-08-18T22:27:26.867572+0000","last_became_active":"2024-08-18T22:27:24.569543+0000","last_became_peered":"2024-08-18T22:27:24.569543+0000","last_unstale":"2024-08-18T22:27:26.867572+0000","last_undegraded":"2024-08-18T22:27:26.867572+0000","last_fullsized":"2024-08-18T22:27:26.867572+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:18.213140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866255+0000","last_change":"2024-08-18T22:27:24.574607+0000","last_active":"2024-08-18T22:27:26.866255+0000","last_peered":"2024-08-18T22:27:26.866255+0000","last_clean":"2024-08-18T22:27:26.866255+0000","last_became_active":"2024-08-18T22:27:24.574297+0000","last_became_peered":"2024-08-18T22:27:24.574297+0000","last_unstale":"2024-08-18T22:27:26.866255+0000","last_undegraded":"2024-08-18T22:27:26.866255+0000","last_fullsized":"2024-08-18T22:27:26.866255+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:11:38.110503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564921+0000","last_change":"2024-08-18T22:27:24.583267+0000","last_active":"2024-08-18T22:27:25.564921+0000","last_peered":"2024-08-18T22:27:25.564921+0000","last_clean":"2024-08-18T22:27:25.564921+0000","last_became_active":"2024-08-18T22:27:24.582852+0000","last_became_peered":"2024-08-18T22:27:24.582852+0000","last_unstale":"2024-08-18T22:27:25.564921+0000","last_undegraded":"2024-08-18T22:27:25.564921+0000","last_fullsized":"2024-08-18T22:27:25.564921+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:32.978984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565359+0000","last_change":"2024-08-18T22:27:24.579993+0000","last_active":"2024-08-18T22:27:25.565359+0000","last_peered":"2024-08-18T22:27:25.565359+0000","last_clean":"2024-08-18T22:27:25.565359+0000","last_became_active":"2024-08-18T22:27:24.579665+0000","last_became_peered":"2024-08-18T22:27:24.579665+0000","last_unstale":"2024-08-18T22:27:25.565359+0000","last_undegraded":"2024-08-18T22:27:25.565359+0000","last_fullsized":"2024-08-18T22:27:25.565359+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:39:26.808180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866979+0000","last_change":"2024-08-18T22:27:24.573428+0000","last_active":"2024-08-18T22:27:26.866979+0000","last_peered":"2024-08-18T22:27:26.866979+0000","last_clean":"2024-08-18T22:27:26.866979+0000","last_became_active":"2024-08-18T22:27:24.573166+0000","last_became_peered":"2024-08-18T22:27:24.573166+0000","last_unstale":"2024-08-18T22:27:26.866979+0000","last_undegraded":"2024-08-18T22:27:26.866979+0000","last_fullsized":"2024-08-18T22:27:26.866979+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.873736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"128'4","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564835+0000","last_change":"2024-08-18T22:27:23.536418+0000","last_active":"2024-08-18T22:27:25.564835+0000","last_peered":"2024-08-18T22:27:25.564835+0000","last_clean":"2024-08-18T22:27:25.564835+0000","last_became_active":"2024-08-18T22:27:23.536127+0000","last_became_peered":"2024-08-18T22:27:23.536127+0000","last_unstale":"2024-08-18T22:27:25.564835+0000","last_undegraded":"2024-08-18T22:27:25.564835+0000","last_fullsized":"2024-08-18T22:27:25.564835+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:59:38.623176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568113+0000","last_change":"2024-08-18T22:27:24.565059+0000","last_active":"2024-08-18T22:27:25.568113+0000","last_peered":"2024-08-18T22:27:25.568113+0000","last_clean":"2024-08-18T22:27:25.568113+0000","last_became_active":"2024-08-18T22:27:24.564781+0000","last_became_peered":"2024-08-18T22:27:24.564781+0000","last_unstale":"2024-08-18T22:27:25.568113+0000","last_undegraded":"2024-08-18T22:27:25.568113+0000","last_fullsized":"2024-08-18T22:27:25.568113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:58:51.179011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"128'1","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866926+0000","last_change":"2024-08-18T22:27:23.544340+0000","last_active":"2024-08-18T22:27:26.866926+0000","last_peered":"2024-08-18T22:27:26.866926+0000","last_clean":"2024-08-18T22:27:26.866926+0000","last_became_active":"2024-08-18T22:27:23.543926+0000","last_became_peered":"2024-08-18T22:27:23.543926+0000","last_unstale":"2024-08-18T22:27:26.866926+0000","last_undegraded":"2024-08-18T22:27:26.866926+0000","last_fullsized":"2024-08-18T22:27:26.866926+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:33.266520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565782+0000","last_change":"2024-08-18T22:27:24.577069+0000","last_active":"2024-08-18T22:27:25.565782+0000","last_peered":"2024-08-18T22:27:25.565782+0000","last_clean":"2024-08-18T22:27:25.565782+0000","last_became_active":"2024-08-18T22:27:24.576798+0000","last_became_peered":"2024-08-18T22:27:24.576798+0000","last_unstale":"2024-08-18T22:27:25.565782+0000","last_undegraded":"2024-08-18T22:27:25.565782+0000","last_fullsized":"2024-08-18T22:27:25.565782+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:30:55.518284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"128'2","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564403+0000","last_change":"2024-08-18T22:27:23.544721+0000","last_active":"2024-08-18T22:27:25.564403+0000","last_peered":"2024-08-18T22:27:25.564403+0000","last_clean":"2024-08-18T22:27:25.564403+0000","last_became_active":"2024-08-18T22:27:23.544394+0000","last_became_peered":"2024-08-18T22:27:23.544394+0000","last_unstale":"2024-08-18T22:27:25.564403+0000","last_undegraded":"2024-08-18T22:27:25.564403+0000","last_fullsized":"2024-08-18T22:27:25.564403+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:05:21.171844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565002+0000","last_change":"2024-08-18T22:27:24.563615+0000","last_active":"2024-08-18T22:27:25.565002+0000","last_peered":"2024-08-18T22:27:25.565002+0000","last_clean":"2024-08-18T22:27:25.565002+0000","last_became_active":"2024-08-18T22:27:24.563362+0000","last_became_peered":"2024-08-18T22:27:24.563362+0000","last_unstale":"2024-08-18T22:27:25.565002+0000","last_undegraded":"2024-08-18T22:27:25.565002+0000","last_fullsized":"2024-08-18T22:27:25.565002+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:24:12.717445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"128'2","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867078+0000","last_change":"2024-08-18T22:27:23.547814+0000","last_active":"2024-08-18T22:27:26.867078+0000","last_peered":"2024-08-18T22:27:26.867078+0000","last_clean":"2024-08-18T22:27:26.867078+0000","last_became_active":"2024-08-18T22:27:23.547540+0000","last_became_peered":"2024-08-18T22:27:23.547540+0000","last_unstale":"2024-08-18T22:27:26.867078+0000","last_undegraded":"2024-08-18T22:27:26.867078+0000","last_fullsized":"2024-08-18T22:27:26.867078+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:43:52.163471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866808+0000","last_change":"2024-08-18T22:27:24.566149+0000","last_active":"2024-08-18T22:27:26.866808+0000","last_peered":"2024-08-18T22:27:26.866808+0000","last_clean":"2024-08-18T22:27:26.866808+0000","last_became_active":"2024-08-18T22:27:24.565854+0000","last_became_peered":"2024-08-18T22:27:24.565854+0000","last_unstale":"2024-08-18T22:27:26.866808+0000","last_undegraded":"2024-08-18T22:27:26.866808+0000","last_fullsized":"2024-08-18T22:27:26.866808+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:51.984858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"128'1","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.865622+0000","last_change":"2024-08-18T22:27:23.546555+0000","last_active":"2024-08-18T22:27:26.865622+0000","last_peered":"2024-08-18T22:27:26.865622+0000","last_clean":"2024-08-18T22:27:26.865622+0000","last_became_active":"2024-08-18T22:27:23.544681+0000","last_became_peered":"2024-08-18T22:27:23.544681+0000","last_unstale":"2024-08-18T22:27:26.865622+0000","last_undegraded":"2024-08-18T22:27:26.865622+0000","last_fullsized":"2024-08-18T22:27:26.865622+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:57.484511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.865638+0000","last_change":"2024-08-18T22:27:24.559554+0000","last_active":"2024-08-18T22:27:26.865638+0000","last_peered":"2024-08-18T22:27:26.865638+0000","last_clean":"2024-08-18T22:27:26.865638+0000","last_became_active":"2024-08-18T22:27:24.559262+0000","last_became_peered":"2024-08-18T22:27:24.559262+0000","last_unstale":"2024-08-18T22:27:26.865638+0000","last_undegraded":"2024-08-18T22:27:26.865638+0000","last_fullsized":"2024-08-18T22:27:26.865638+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:43.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"128'1","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568362+0000","last_change":"2024-08-18T22:27:23.553332+0000","last_active":"2024-08-18T22:27:25.568362+0000","last_peered":"2024-08-18T22:27:25.568362+0000","last_clean":"2024-08-18T22:27:25.568362+0000","last_became_active":"2024-08-18T22:27:23.550173+0000","last_became_peered":"2024-08-18T22:27:23.550173+0000","last_unstale":"2024-08-18T22:27:25.568362+0000","last_undegraded":"2024-08-18T22:27:25.568362+0000","last_fullsized":"2024-08-18T22:27:25.568362+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:14:47.680532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866370+0000","last_change":"2024-08-18T22:27:24.563338+0000","last_active":"2024-08-18T22:27:26.866370+0000","last_peered":"2024-08-18T22:27:26.866370+0000","last_clean":"2024-08-18T22:27:26.866370+0000","last_became_active":"2024-08-18T22:27:24.562991+0000","last_became_peered":"2024-08-18T22:27:24.562991+0000","last_unstale":"2024-08-18T22:27:26.866370+0000","last_undegraded":"2024-08-18T22:27:26.866370+0000","last_fullsized":"2024-08-18T22:27:26.866370+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:39.193232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564852+0000","last_change":"2024-08-18T22:27:23.544298+0000","last_active":"2024-08-18T22:27:25.564852+0000","last_peered":"2024-08-18T22:27:25.564852+0000","last_clean":"2024-08-18T22:27:25.564852+0000","last_became_active":"2024-08-18T22:27:23.543996+0000","last_became_peered":"2024-08-18T22:27:23.543996+0000","last_unstale":"2024-08-18T22:27:25.564852+0000","last_undegraded":"2024-08-18T22:27:25.564852+0000","last_fullsized":"2024-08-18T22:27:25.564852+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:50.977899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866547+0000","last_change":"2024-08-18T22:27:24.569167+0000","last_active":"2024-08-18T22:27:26.866547+0000","last_peered":"2024-08-18T22:27:26.866547+0000","last_clean":"2024-08-18T22:27:26.866547+0000","last_became_active":"2024-08-18T22:27:24.568838+0000","last_became_peered":"2024-08-18T22:27:24.568838+0000","last_unstale":"2024-08-18T22:27:26.866547+0000","last_undegraded":"2024-08-18T22:27:26.866547+0000","last_fullsized":"2024-08-18T22:27:26.866547+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:43.038753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568219+0000","last_change":"2024-08-18T22:27:23.547406+0000","last_active":"2024-08-18T22:27:25.568219+0000","last_peered":"2024-08-18T22:27:25.568219+0000","last_clean":"2024-08-18T22:27:25.568219+0000","last_became_active":"2024-08-18T22:27:23.547152+0000","last_became_peered":"2024-08-18T22:27:23.547152+0000","last_unstale":"2024-08-18T22:27:25.568219+0000","last_undegraded":"2024-08-18T22:27:25.568219+0000","last_fullsized":"2024-08-18T22:27:25.568219+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:14:37.759783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563118+0000","last_change":"2024-08-18T22:27:24.562783+0000","last_active":"2024-08-18T22:27:25.563118+0000","last_peered":"2024-08-18T22:27:25.563118+0000","last_clean":"2024-08-18T22:27:25.563118+0000","last_became_active":"2024-08-18T22:27:24.562511+0000","last_became_peered":"2024-08-18T22:27:24.562511+0000","last_unstale":"2024-08-18T22:27:25.563118+0000","last_undegraded":"2024-08-18T22:27:25.563118+0000","last_fullsized":"2024-08-18T22:27:25.563118+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:43:05.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564971+0000","last_change":"2024-08-18T22:27:23.538603+0000","last_active":"2024-08-18T22:27:25.564971+0000","last_peered":"2024-08-18T22:27:25.564971+0000","last_clean":"2024-08-18T22:27:25.564971+0000","last_became_active":"2024-08-18T22:27:23.538343+0000","last_became_peered":"2024-08-18T22:27:23.538343+0000","last_unstale":"2024-08-18T22:27:25.564971+0000","last_undegraded":"2024-08-18T22:27:25.564971+0000","last_fullsized":"2024-08-18T22:27:25.564971+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:16.866778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565856+0000","last_change":"2024-08-18T22:27:24.579366+0000","last_active":"2024-08-18T22:27:25.565856+0000","last_peered":"2024-08-18T22:27:25.565856+0000","last_clean":"2024-08-18T22:27:25.565856+0000","last_became_active":"2024-08-18T22:27:24.579117+0000","last_became_peered":"2024-08-18T22:27:24.579117+0000","last_unstale":"2024-08-18T22:27:25.565856+0000","last_undegraded":"2024-08-18T22:27:25.565856+0000","last_fullsized":"2024-08-18T22:27:25.565856+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:02.629167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565888+0000","last_change":"2024-08-18T22:27:23.548166+0000","last_active":"2024-08-18T22:27:25.565888+0000","last_peered":"2024-08-18T22:27:25.565888+0000","last_clean":"2024-08-18T22:27:25.565888+0000","last_became_active":"2024-08-18T22:27:23.547899+0000","last_became_peered":"2024-08-18T22:27:23.547899+0000","last_unstale":"2024-08-18T22:27:25.565888+0000","last_undegraded":"2024-08-18T22:27:25.565888+0000","last_fullsized":"2024-08-18T22:27:25.565888+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:32.512213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867415+0000","last_change":"2024-08-18T22:27:24.574425+0000","last_active":"2024-08-18T22:27:26.867415+0000","last_peered":"2024-08-18T22:27:26.867415+0000","last_clean":"2024-08-18T22:27:26.867415+0000","last_became_active":"2024-08-18T22:27:24.574116+0000","last_became_peered":"2024-08-18T22:27:24.574116+0000","last_unstale":"2024-08-18T22:27:26.867415+0000","last_undegraded":"2024-08-18T22:27:26.867415+0000","last_fullsized":"2024-08-18T22:27:26.867415+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:11.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"128'3","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.566055+0000","last_change":"2024-08-18T22:27:23.549127+0000","last_active":"2024-08-18T22:27:25.566055+0000","last_peered":"2024-08-18T22:27:25.566055+0000","last_clean":"2024-08-18T22:27:25.566055+0000","last_became_active":"2024-08-18T22:27:23.548778+0000","last_became_peered":"2024-08-18T22:27:23.548778+0000","last_unstale":"2024-08-18T22:27:25.566055+0000","last_undegraded":"2024-08-18T22:27:25.566055+0000","last_fullsized":"2024-08-18T22:27:25.566055+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:42.486701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.566143+0000","last_change":"2024-08-18T22:27:24.583599+0000","last_active":"2024-08-18T22:27:25.566143+0000","last_peered":"2024-08-18T22:27:25.566143+0000","last_clean":"2024-08-18T22:27:25.566143+0000","last_became_active":"2024-08-18T22:27:24.583244+0000","last_became_peered":"2024-08-18T22:27:24.583244+0000","last_unstale":"2024-08-18T22:27:25.566143+0000","last_undegraded":"2024-08-18T22:27:25.566143+0000","last_fullsized":"2024-08-18T22:27:25.566143+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:36:44.494716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"128'6","reported_seq":20,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866639+0000","last_change":"2024-08-18T22:27:23.551420+0000","last_active":"2024-08-18T22:27:26.866639+0000","last_peered":"2024-08-18T22:27:26.866639+0000","last_clean":"2024-08-18T22:27:26.866639+0000","last_became_active":"2024-08-18T22:27:23.551146+0000","last_became_peered":"2024-08-18T22:27:23.551146+0000","last_unstale":"2024-08-18T22:27:26.866639+0000","last_undegraded":"2024-08-18T22:27:26.866639+0000","last_fullsized":"2024-08-18T22:27:26.866639+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:39:25.801221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563132+0000","last_change":"2024-08-18T22:27:24.567214+0000","last_active":"2024-08-18T22:27:25.563132+0000","last_peered":"2024-08-18T22:27:25.563132+0000","last_clean":"2024-08-18T22:27:25.563132+0000","last_became_active":"2024-08-18T22:27:24.566042+0000","last_became_peered":"2024-08-18T22:27:24.566042+0000","last_unstale":"2024-08-18T22:27:25.563132+0000","last_undegraded":"2024-08-18T22:27:25.563132+0000","last_fullsized":"2024-08-18T22:27:25.563132+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:18:56.722372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"128'2","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867090+0000","last_change":"2024-08-18T22:27:23.554557+0000","last_active":"2024-08-18T22:27:26.867090+0000","last_peered":"2024-08-18T22:27:26.867090+0000","last_clean":"2024-08-18T22:27:26.867090+0000","last_became_active":"2024-08-18T22:27:23.554293+0000","last_became_peered":"2024-08-18T22:27:23.554293+0000","last_unstale":"2024-08-18T22:27:26.867090+0000","last_undegraded":"2024-08-18T22:27:26.867090+0000","last_fullsized":"2024-08-18T22:27:26.867090+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:31.972026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.865994+0000","last_change":"2024-08-18T22:27:24.559695+0000","last_active":"2024-08-18T22:27:26.865994+0000","last_peered":"2024-08-18T22:27:26.865994+0000","last_clean":"2024-08-18T22:27:26.865994+0000","last_became_active":"2024-08-18T22:27:24.559423+0000","last_became_peered":"2024-08-18T22:27:24.559423+0000","last_unstale":"2024-08-18T22:27:26.865994+0000","last_undegraded":"2024-08-18T22:27:26.865994+0000","last_fullsized":"2024-08-18T22:27:26.865994+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:02:04.793332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866517+0000","last_change":"2024-08-18T22:27:23.552723+0000","last_active":"2024-08-18T22:27:26.866517+0000","last_peered":"2024-08-18T22:27:26.866517+0000","last_clean":"2024-08-18T22:27:26.866517+0000","last_became_active":"2024-08-18T22:27:23.552457+0000","last_became_peered":"2024-08-18T22:27:23.552457+0000","last_unstale":"2024-08-18T22:27:26.866517+0000","last_undegraded":"2024-08-18T22:27:26.866517+0000","last_fullsized":"2024-08-18T22:27:26.866517+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:19:06.866570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866336+0000","last_change":"2024-08-18T22:27:24.573855+0000","last_active":"2024-08-18T22:27:26.866336+0000","last_peered":"2024-08-18T22:27:26.866336+0000","last_clean":"2024-08-18T22:27:26.866336+0000","last_became_active":"2024-08-18T22:27:24.573562+0000","last_became_peered":"2024-08-18T22:27:24.573562+0000","last_unstale":"2024-08-18T22:27:26.866336+0000","last_undegraded":"2024-08-18T22:27:26.866336+0000","last_fullsized":"2024-08-18T22:27:26.866336+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:32.937025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866504+0000","last_change":"2024-08-18T22:27:23.552008+0000","last_active":"2024-08-18T22:27:26.866504+0000","last_peered":"2024-08-18T22:27:26.866504+0000","last_clean":"2024-08-18T22:27:26.866504+0000","last_became_active":"2024-08-18T22:27:23.551740+0000","last_became_peered":"2024-08-18T22:27:23.551740+0000","last_unstale":"2024-08-18T22:27:26.866504+0000","last_undegraded":"2024-08-18T22:27:26.866504+0000","last_fullsized":"2024-08-18T22:27:26.866504+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:01.622209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565995+0000","last_change":"2024-08-18T22:27:24.577066+0000","last_active":"2024-08-18T22:27:25.565995+0000","last_peered":"2024-08-18T22:27:25.565995+0000","last_clean":"2024-08-18T22:27:25.565995+0000","last_became_active":"2024-08-18T22:27:24.576743+0000","last_became_peered":"2024-08-18T22:27:24.576743+0000","last_unstale":"2024-08-18T22:27:25.565995+0000","last_undegraded":"2024-08-18T22:27:25.565995+0000","last_fullsized":"2024-08-18T22:27:25.565995+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:32.043981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"128'1","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866929+0000","last_change":"2024-08-18T22:27:23.548589+0000","last_active":"2024-08-18T22:27:26.866929+0000","last_peered":"2024-08-18T22:27:26.866929+0000","last_clean":"2024-08-18T22:27:26.866929+0000","last_became_active":"2024-08-18T22:27:23.546800+0000","last_became_peered":"2024-08-18T22:27:23.546800+0000","last_unstale":"2024-08-18T22:27:26.866929+0000","last_undegraded":"2024-08-18T22:27:26.866929+0000","last_fullsized":"2024-08-18T22:27:26.866929+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:48.876821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.865873+0000","last_change":"2024-08-18T22:27:24.560518+0000","last_active":"2024-08-18T22:27:26.865873+0000","last_peered":"2024-08-18T22:27:26.865873+0000","last_clean":"2024-08-18T22:27:26.865873+0000","last_became_active":"2024-08-18T22:27:24.560227+0000","last_became_peered":"2024-08-18T22:27:24.560227+0000","last_unstale":"2024-08-18T22:27:26.865873+0000","last_undegraded":"2024-08-18T22:27:26.865873+0000","last_fullsized":"2024-08-18T22:27:26.865873+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:16:55.825075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"128'2","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867774+0000","last_change":"2024-08-18T22:27:23.545359+0000","last_active":"2024-08-18T22:27:26.867774+0000","last_peered":"2024-08-18T22:27:26.867774+0000","last_clean":"2024-08-18T22:27:26.867774+0000","last_became_active":"2024-08-18T22:27:23.545080+0000","last_became_peered":"2024-08-18T22:27:23.545080+0000","last_unstale":"2024-08-18T22:27:26.867774+0000","last_undegraded":"2024-08-18T22:27:26.867774+0000","last_fullsized":"2024-08-18T22:27:26.867774+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:05:03.331984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568333+0000","last_change":"2024-08-18T22:27:24.570784+0000","last_active":"2024-08-18T22:27:25.568333+0000","last_peered":"2024-08-18T22:27:25.568333+0000","last_clean":"2024-08-18T22:27:25.568333+0000","last_became_active":"2024-08-18T22:27:24.570071+0000","last_became_peered":"2024-08-18T22:27:24.570071+0000","last_unstale":"2024-08-18T22:27:25.568333+0000","last_undegraded":"2024-08-18T22:27:25.568333+0000","last_fullsized":"2024-08-18T22:27:25.568333+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:11.695344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"128'1","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564514+0000","last_change":"2024-08-18T22:27:23.546608+0000","last_active":"2024-08-18T22:27:25.564514+0000","last_peered":"2024-08-18T22:27:25.564514+0000","last_clean":"2024-08-18T22:27:25.564514+0000","last_became_active":"2024-08-18T22:27:23.546365+0000","last_became_peered":"2024-08-18T22:27:23.546365+0000","last_unstale":"2024-08-18T22:27:25.564514+0000","last_undegraded":"2024-08-18T22:27:25.564514+0000","last_fullsized":"2024-08-18T22:27:25.564514+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:21.461235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.566221+0000","last_change":"2024-08-18T22:27:24.582966+0000","last_active":"2024-08-18T22:27:25.566221+0000","last_peered":"2024-08-18T22:27:25.566221+0000","last_clean":"2024-08-18T22:27:25.566221+0000","last_became_active":"2024-08-18T22:27:24.582623+0000","last_became_peered":"2024-08-18T22:27:24.582623+0000","last_unstale":"2024-08-18T22:27:25.566221+0000","last_undegraded":"2024-08-18T22:27:25.566221+0000","last_fullsized":"2024-08-18T22:27:25.566221+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:42:40.050115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564033+0000","last_change":"2024-08-18T22:27:23.542231+0000","last_active":"2024-08-18T22:27:25.564033+0000","last_peered":"2024-08-18T22:27:25.564033+0000","last_clean":"2024-08-18T22:27:25.564033+0000","last_became_active":"2024-08-18T22:27:23.541939+0000","last_became_peered":"2024-08-18T22:27:23.541939+0000","last_unstale":"2024-08-18T22:27:25.564033+0000","last_undegraded":"2024-08-18T22:27:25.564033+0000","last_fullsized":"2024-08-18T22:27:25.564033+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:59:38.623176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.567970+0000","last_change":"2024-08-18T22:27:24.568218+0000","last_active":"2024-08-18T22:27:25.567970+0000","last_peered":"2024-08-18T22:27:25.567970+0000","last_clean":"2024-08-18T22:27:25.567970+0000","last_became_active":"2024-08-18T22:27:24.567923+0000","last_became_peered":"2024-08-18T22:27:24.567923+0000","last_unstale":"2024-08-18T22:27:25.567970+0000","last_undegraded":"2024-08-18T22:27:25.567970+0000","last_fullsized":"2024-08-18T22:27:25.567970+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:35.374633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"128'2","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568464+0000","last_change":"2024-08-18T22:27:23.545503+0000","last_active":"2024-08-18T22:27:25.568464+0000","last_peered":"2024-08-18T22:27:25.568464+0000","last_clean":"2024-08-18T22:27:25.568464+0000","last_became_active":"2024-08-18T22:27:23.545228+0000","last_became_peered":"2024-08-18T22:27:23.545228+0000","last_unstale":"2024-08-18T22:27:25.568464+0000","last_undegraded":"2024-08-18T22:27:25.568464+0000","last_fullsized":"2024-08-18T22:27:25.568464+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:46.176010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866277+0000","last_change":"2024-08-18T22:27:24.585934+0000","last_active":"2024-08-18T22:27:26.866277+0000","last_peered":"2024-08-18T22:27:26.866277+0000","last_clean":"2024-08-18T22:27:26.866277+0000","last_became_active":"2024-08-18T22:27:24.585595+0000","last_became_peered":"2024-08-18T22:27:24.585595+0000","last_unstale":"2024-08-18T22:27:26.866277+0000","last_undegraded":"2024-08-18T22:27:26.866277+0000","last_fullsized":"2024-08-18T22:27:26.866277+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:43:42.567772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563883+0000","last_change":"2024-08-18T22:27:23.539599+0000","last_active":"2024-08-18T22:27:25.563883+0000","last_peered":"2024-08-18T22:27:25.563883+0000","last_clean":"2024-08-18T22:27:25.563883+0000","last_became_active":"2024-08-18T22:27:23.539322+0000","last_became_peered":"2024-08-18T22:27:23.539322+0000","last_unstale":"2024-08-18T22:27:25.563883+0000","last_undegraded":"2024-08-18T22:27:25.563883+0000","last_fullsized":"2024-08-18T22:27:25.563883+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:16.866778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866413+0000","last_change":"2024-08-18T22:27:24.571809+0000","last_active":"2024-08-18T22:27:26.866413+0000","last_peered":"2024-08-18T22:27:26.866413+0000","last_clean":"2024-08-18T22:27:26.866413+0000","last_became_active":"2024-08-18T22:27:24.571357+0000","last_became_peered":"2024-08-18T22:27:24.571357+0000","last_unstale":"2024-08-18T22:27:26.866413+0000","last_undegraded":"2024-08-18T22:27:26.866413+0000","last_fullsized":"2024-08-18T22:27:26.866413+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:55:40.166656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866604+0000","last_change":"2024-08-18T22:27:23.544336+0000","last_active":"2024-08-18T22:27:26.866604+0000","last_peered":"2024-08-18T22:27:26.866604+0000","last_clean":"2024-08-18T22:27:26.866604+0000","last_became_active":"2024-08-18T22:27:23.544058+0000","last_became_peered":"2024-08-18T22:27:23.544058+0000","last_unstale":"2024-08-18T22:27:26.866604+0000","last_undegraded":"2024-08-18T22:27:26.866604+0000","last_fullsized":"2024-08-18T22:27:26.866604+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:31.037022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.566048+0000","last_change":"2024-08-18T22:27:24.580039+0000","last_active":"2024-08-18T22:27:25.566048+0000","last_peered":"2024-08-18T22:27:25.566048+0000","last_clean":"2024-08-18T22:27:25.566048+0000","last_became_active":"2024-08-18T22:27:24.578348+0000","last_became_peered":"2024-08-18T22:27:24.578348+0000","last_unstale":"2024-08-18T22:27:25.566048+0000","last_undegraded":"2024-08-18T22:27:25.566048+0000","last_fullsized":"2024-08-18T22:27:25.566048+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:19:07.873529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563493+0000","last_change":"2024-08-18T22:27:23.547090+0000","last_active":"2024-08-18T22:27:25.563493+0000","last_peered":"2024-08-18T22:27:25.563493+0000","last_clean":"2024-08-18T22:27:25.563493+0000","last_became_active":"2024-08-18T22:27:23.546820+0000","last_became_peered":"2024-08-18T22:27:23.546820+0000","last_unstale":"2024-08-18T22:27:25.563493+0000","last_undegraded":"2024-08-18T22:27:25.563493+0000","last_fullsized":"2024-08-18T22:27:25.563493+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:39:20.112152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568687+0000","last_change":"2024-08-18T22:27:24.563182+0000","last_active":"2024-08-18T22:27:25.568687+0000","last_peered":"2024-08-18T22:27:25.568687+0000","last_clean":"2024-08-18T22:27:25.568687+0000","last_became_active":"2024-08-18T22:27:24.562289+0000","last_became_peered":"2024-08-18T22:27:24.562289+0000","last_unstale":"2024-08-18T22:27:25.568687+0000","last_undegraded":"2024-08-18T22:27:25.568687+0000","last_fullsized":"2024-08-18T22:27:25.568687+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:18.757685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"128'2","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568288+0000","last_change":"2024-08-18T22:27:23.551796+0000","last_active":"2024-08-18T22:27:25.568288+0000","last_peered":"2024-08-18T22:27:25.568288+0000","last_clean":"2024-08-18T22:27:25.568288+0000","last_became_active":"2024-08-18T22:27:23.551536+0000","last_became_peered":"2024-08-18T22:27:23.551536+0000","last_unstale":"2024-08-18T22:27:25.568288+0000","last_undegraded":"2024-08-18T22:27:25.568288+0000","last_fullsized":"2024-08-18T22:27:25.568288+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:09:06.013695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866547+0000","last_change":"2024-08-18T22:27:24.572217+0000","last_active":"2024-08-18T22:27:26.866547+0000","last_peered":"2024-08-18T22:27:26.866547+0000","last_clean":"2024-08-18T22:27:26.866547+0000","last_became_active":"2024-08-18T22:27:24.571247+0000","last_became_peered":"2024-08-18T22:27:24.571247+0000","last_unstale":"2024-08-18T22:27:26.866547+0000","last_undegraded":"2024-08-18T22:27:26.866547+0000","last_fullsized":"2024-08-18T22:27:26.866547+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:43.493660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"129'1","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565054+0000","last_change":"2024-08-18T22:27:23.547122+0000","last_active":"2024-08-18T22:27:25.565054+0000","last_peered":"2024-08-18T22:27:25.565054+0000","last_clean":"2024-08-18T22:27:25.565054+0000","last_became_active":"2024-08-18T22:27:23.546628+0000","last_became_peered":"2024-08-18T22:27:23.546628+0000","last_unstale":"2024-08-18T22:27:25.565054+0000","last_undegraded":"2024-08-18T22:27:25.565054+0000","last_fullsized":"2024-08-18T22:27:25.565054+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:32.512213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564182+0000","last_change":"2024-08-18T22:27:24.562308+0000","last_active":"2024-08-18T22:27:25.564182+0000","last_peered":"2024-08-18T22:27:25.564182+0000","last_clean":"2024-08-18T22:27:25.564182+0000","last_became_active":"2024-08-18T22:27:24.562025+0000","last_became_peered":"2024-08-18T22:27:24.562025+0000","last_unstale":"2024-08-18T22:27:25.564182+0000","last_undegraded":"2024-08-18T22:27:25.564182+0000","last_fullsized":"2024-08-18T22:27:25.564182+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:36:44.494716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.565390+0000","last_change":"2024-08-18T22:27:23.539274+0000","last_active":"2024-08-18T22:27:25.565390+0000","last_peered":"2024-08-18T22:27:25.565390+0000","last_clean":"2024-08-18T22:27:25.565390+0000","last_became_active":"2024-08-18T22:27:23.538927+0000","last_became_peered":"2024-08-18T22:27:23.538927+0000","last_unstale":"2024-08-18T22:27:25.565390+0000","last_undegraded":"2024-08-18T22:27:25.565390+0000","last_fullsized":"2024-08-18T22:27:25.565390+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:10:50.977899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.867931+0000","last_change":"2024-08-18T22:27:24.588134+0000","last_active":"2024-08-18T22:27:26.867931+0000","last_peered":"2024-08-18T22:27:26.867931+0000","last_clean":"2024-08-18T22:27:26.867931+0000","last_became_active":"2024-08-18T22:27:24.587781+0000","last_became_peered":"2024-08-18T22:27:24.587781+0000","last_unstale":"2024-08-18T22:27:26.867931+0000","last_undegraded":"2024-08-18T22:27:26.867931+0000","last_fullsized":"2024-08-18T22:27:26.867931+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:38:46.151407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568676+0000","last_change":"2024-08-18T22:27:23.549252+0000","last_active":"2024-08-18T22:27:25.568676+0000","last_peered":"2024-08-18T22:27:25.568676+0000","last_clean":"2024-08-18T22:27:25.568676+0000","last_became_active":"2024-08-18T22:27:23.548968+0000","last_became_peered":"2024-08-18T22:27:23.548968+0000","last_unstale":"2024-08-18T22:27:25.568676+0000","last_undegraded":"2024-08-18T22:27:25.568676+0000","last_fullsized":"2024-08-18T22:27:25.568676+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:19:06.994240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568130+0000","last_change":"2024-08-18T22:27:24.554611+0000","last_active":"2024-08-18T22:27:25.568130+0000","last_peered":"2024-08-18T22:27:25.568130+0000","last_clean":"2024-08-18T22:27:25.568130+0000","last_became_active":"2024-08-18T22:27:24.554084+0000","last_became_peered":"2024-08-18T22:27:24.554084+0000","last_unstale":"2024-08-18T22:27:25.568130+0000","last_undegraded":"2024-08-18T22:27:25.568130+0000","last_fullsized":"2024-08-18T22:27:25.568130+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:33.716538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.865783+0000","last_change":"2024-08-18T22:27:23.550306+0000","last_active":"2024-08-18T22:27:26.865783+0000","last_peered":"2024-08-18T22:27:26.865783+0000","last_clean":"2024-08-18T22:27:26.865783+0000","last_became_active":"2024-08-18T22:27:23.549975+0000","last_became_peered":"2024-08-18T22:27:23.549975+0000","last_unstale":"2024-08-18T22:27:26.865783+0000","last_undegraded":"2024-08-18T22:27:26.865783+0000","last_fullsized":"2024-08-18T22:27:26.865783+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:01:11.437061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866419+0000","last_change":"2024-08-18T22:27:24.573091+0000","last_active":"2024-08-18T22:27:26.866419+0000","last_peered":"2024-08-18T22:27:26.866419+0000","last_clean":"2024-08-18T22:27:26.866419+0000","last_became_active":"2024-08-18T22:27:24.572809+0000","last_became_peered":"2024-08-18T22:27:24.572809+0000","last_unstale":"2024-08-18T22:27:26.866419+0000","last_undegraded":"2024-08-18T22:27:26.866419+0000","last_fullsized":"2024-08-18T22:27:26.866419+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:34:32.463973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.865694+0000","last_change":"2024-08-18T22:27:23.545190+0000","last_active":"2024-08-18T22:27:26.865694+0000","last_peered":"2024-08-18T22:27:26.865694+0000","last_clean":"2024-08-18T22:27:26.865694+0000","last_became_active":"2024-08-18T22:27:23.544813+0000","last_became_peered":"2024-08-18T22:27:23.544813+0000","last_unstale":"2024-08-18T22:27:26.865694+0000","last_undegraded":"2024-08-18T22:27:26.865694+0000","last_fullsized":"2024-08-18T22:27:26.865694+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:59:53.358060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563775+0000","last_change":"2024-08-18T22:27:24.561365+0000","last_active":"2024-08-18T22:27:25.563775+0000","last_peered":"2024-08-18T22:27:25.563775+0000","last_clean":"2024-08-18T22:27:25.563775+0000","last_became_active":"2024-08-18T22:27:24.561026+0000","last_became_peered":"2024-08-18T22:27:24.561026+0000","last_unstale":"2024-08-18T22:27:25.563775+0000","last_undegraded":"2024-08-18T22:27:25.563775+0000","last_fullsized":"2024-08-18T22:27:25.563775+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:32.043981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.568029+0000","last_change":"2024-08-18T22:27:23.553339+0000","last_active":"2024-08-18T22:27:25.568029+0000","last_peered":"2024-08-18T22:27:25.568029+0000","last_clean":"2024-08-18T22:27:25.568029+0000","last_became_active":"2024-08-18T22:27:23.548574+0000","last_became_peered":"2024-08-18T22:27:23.548574+0000","last_unstale":"2024-08-18T22:27:25.568029+0000","last_undegraded":"2024-08-18T22:27:25.568029+0000","last_fullsized":"2024-08-18T22:27:25.568029+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:17:48.562586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866726+0000","last_change":"2024-08-18T22:27:24.560324+0000","last_active":"2024-08-18T22:27:26.866726+0000","last_peered":"2024-08-18T22:27:26.866726+0000","last_clean":"2024-08-18T22:27:26.866726+0000","last_became_active":"2024-08-18T22:27:24.560041+0000","last_became_peered":"2024-08-18T22:27:24.560041+0000","last_unstale":"2024-08-18T22:27:26.866726+0000","last_undegraded":"2024-08-18T22:27:26.866726+0000","last_fullsized":"2024-08-18T22:27:26.866726+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:33.519172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.563604+0000","last_change":"2024-08-18T22:27:23.536731+0000","last_active":"2024-08-18T22:27:25.563604+0000","last_peered":"2024-08-18T22:27:25.563604+0000","last_clean":"2024-08-18T22:27:25.563604+0000","last_became_active":"2024-08-18T22:27:23.536418+0000","last_became_peered":"2024-08-18T22:27:23.536418+0000","last_unstale":"2024-08-18T22:27:25.563604+0000","last_undegraded":"2024-08-18T22:27:25.563604+0000","last_fullsized":"2024-08-18T22:27:25.563604+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:43:04.208784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564462+0000","last_change":"2024-08-18T22:27:24.564048+0000","last_active":"2024-08-18T22:27:25.564462+0000","last_peered":"2024-08-18T22:27:25.564462+0000","last_clean":"2024-08-18T22:27:25.564462+0000","last_became_active":"2024-08-18T22:27:24.561818+0000","last_became_peered":"2024-08-18T22:27:24.561818+0000","last_unstale":"2024-08-18T22:27:25.564462+0000","last_undegraded":"2024-08-18T22:27:25.564462+0000","last_fullsized":"2024-08-18T22:27:25.564462+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:23.520247+0000","last_clean_scrub_stamp":"2024-08-18T22:27:23.520247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:34:08.205806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"128'8","reported_seq":22,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:26.866335+0000","last_change":"2024-08-18T22:27:23.553624+0000","last_active":"2024-08-18T22:27:26.866335+0000","last_peered":"2024-08-18T22:27:26.866335+0000","last_clean":"2024-08-18T22:27:26.866335+0000","last_became_active":"2024-08-18T22:27:23.553355+0000","last_became_peered":"2024-08-18T22:27:23.553355+0000","last_unstale":"2024-08-18T22:27:26.866335+0000","last_undegraded":"2024-08-18T22:27:26.866335+0000","last_fullsized":"2024-08-18T22:27:26.866335+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:27:22.513288+0000","last_clean_scrub_stamp":"2024-08-18T22:27:22.513288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:30:54.511325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":390,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-08-18T22:27:25.564112+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:27:25.564112+0000","last_peered":"2024-08-18T22:27:25.564112+0000","last_clean":"2024-08-18T22:27:25.564112+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:27:25.564112+0000","last_undegraded":"2024-08-18T22:27:25.564112+0000","last_fullsized":"2024-08-18T22:27:25.564112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41656,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330184,"statfs":{"total":96636764160,"available":96594108416,"internally_reserved":0,"allocated":2207744,"data_stored":1344157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509545,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41068,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330772,"statfs":{"total":96636764160,"available":96594710528,"internally_reserved":0,"allocated":1601536,"data_stored":753595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509543,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41072,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330768,"statfs":{"total":96636764160,"available":96594706432,"internally_reserved":0,"allocated":1605632,"data_stored":753173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1613824,"data_stored":754659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509543,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50792,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1601536,"data_stored":753035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509544,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51372,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320468,"statfs":{"total":96636764160,"available":96584159232,"internally_reserved":0,"allocated":2195456,"data_stored":1343403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50804,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321036,"statfs":{"total":96636764160,"available":96584740864,"internally_reserved":0,"allocated":1609728,"data_stored":754625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574952,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50788,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321052,"statfs":{"total":96636764160,"available":96584757248,"internally_reserved":0,"allocated":1597440,"data_stored":753013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:27:33.653 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:27:33.653 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:27:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.836+0000 7f244d600640 1 Processor -- start 2024-08-18T22:27:33.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.836+0000 7f244d600640 1 -- start start 2024-08-18T22:27:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f244d600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f244815f000 0x7f24480b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f244d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f244806c3c0 0x7f24480d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:33.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f244d600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f244806c850 con 0x7f2448147dd0 2024-08-18T22:27:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f244d600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f244815f7c0 con 0x7f244815f000 2024-08-18T22:27:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f244d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f24480b6410 con 0x7f244806c3c0 2024-08-18T22:27:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f2446000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f244815f000 0x7f24480b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f2446a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2448147dd0 0x7f244815e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35610/0 (socket says 172.21.15.5:35610) 2024-08-18T22:27:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f2446a00640 1 -- 172.21.15.5:0/2138374824 learned_addr learned my addr 172.21.15.5:0/2138374824 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f2447400640 1 --2- 172.21.15.5:0/2138374824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f244806c3c0 0x7f24480d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f2446000640 1 -- 172.21.15.5:0/2138374824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f244806c3c0 msgr2=0x7f24480d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f2446000640 1 --2- 172.21.15.5:0/2138374824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f244806c3c0 0x7f24480d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f2446000640 1 -- 172.21.15.5:0/2138374824 >> v1:172.21.15.5:6789/0 conn(0x7f2448147dd0 legacy=0x7f244815e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f2446000640 1 -- 172.21.15.5:0/2138374824 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24480b46b0 con 0x7f244815f000 2024-08-18T22:27:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.840+0000 7f2446000640 1 --2- 172.21.15.5:0/2138374824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f244815f000 0x7f24480b40d0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f24340097f0 tx=0x7f243401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c56b6429089e91 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f2445600640 1 -- 172.21.15.5:0/2138374824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24340b1070 con 0x7f244815f000 2024-08-18T22:27:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f2445600640 1 -- 172.21.15.5:0/2138374824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24340a8050 con 0x7f244815f000 2024-08-18T22:27:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f2445600640 1 -- 172.21.15.5:0/2138374824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24340ac860 con 0x7f244815f000 2024-08-18T22:27:33.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 -- 172.21.15.5:0/2138374824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f244815f000 msgr2=0x7f24480b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 --2- 172.21.15.5:0/2138374824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f244815f000 0x7f24480b40d0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f24340097f0 tx=0x7f243401c3e0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 -- 172.21.15.5:0/2138374824 shutdown_connections 2024-08-18T22:27:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 --2- 172.21.15.5:0/2138374824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f244806c3c0 0x7f24480d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 --2- 172.21.15.5:0/2138374824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f244815f000 0x7f24480b40d0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 -- 172.21.15.5:0/2138374824 >> 172.21.15.5:0/2138374824 conn(0x7f24480b65f0 msgr2=0x7f24480b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 -- 172.21.15.5:0/2138374824 shutdown_connections 2024-08-18T22:27:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 -- 172.21.15.5:0/2138374824 wait complete. 2024-08-18T22:27:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 Processor -- start 2024-08-18T22:27:33.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 -- start start 2024-08-18T22:27:33.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f244806c3c0 0x7f244815c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:33.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2448147dd0 0x7f24481467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:33.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f244815f000 0x7f24480ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f24480b5b30 con 0x7f244815f000 2024-08-18T22:27:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f244815f9e0 con 0x7f2448147dd0 2024-08-18T22:27:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f244d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f24480b5cb0 con 0x7f244806c3c0 2024-08-18T22:27:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f2447400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f244815f000 0x7f24480ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f2447400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f244815f000 0x7f24480ae310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46346/0 (socket says 172.21.15.5:46346) 2024-08-18T22:27:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f2447400640 1 -- 172.21.15.5:0/3312933795 learned_addr learned my addr 172.21.15.5:0/3312933795 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:33.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f2446a00640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f244806c3c0 0x7f244815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.844+0000 7f2446000640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2448147dd0 0x7f24481467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f2447400640 1 -- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f244806c3c0 msgr2=0x7f244815c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f2447400640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f244806c3c0 0x7f244815c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f2447400640 1 -- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2448147dd0 msgr2=0x7f24481467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f2447400640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2448147dd0 0x7f24481467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f2447400640 1 -- 172.21.15.5:0/3312933795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2448145740 con 0x7f244815f000 2024-08-18T22:27:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f2447400640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f244815f000 0x7f24480ae310 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2440007e40 tx=0x7f244000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f243ea00640 1 -- 172.21.15.5:0/3312933795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2440014620 con 0x7f244815f000 2024-08-18T22:27:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f243ea00640 1 -- 172.21.15.5:0/3312933795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2440019070 con 0x7f244815f000 2024-08-18T22:27:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f243ea00640 1 -- 172.21.15.5:0/3312933795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2440014a20 con 0x7f244815f000 2024-08-18T22:27:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f244d600640 1 -- 172.21.15.5:0/3312933795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2448145a20 con 0x7f244815f000 2024-08-18T22:27:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f244d600640 1 -- 172.21.15.5:0/3312933795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24481462c0 con 0x7f244815f000 2024-08-18T22:27:33.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f244d600640 1 -- 172.21.15.5:0/3312933795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24480d0f70 con 0x7f244815f000 2024-08-18T22:27:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f243ea00640 1 -- 172.21.15.5:0/3312933795 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2440014bc0 con 0x7f244815f000 2024-08-18T22:27:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f243ea00640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24280678c0 0x7f2428069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.848+0000 7f243ea00640 1 -- 172.21.15.5:0/3312933795 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f2440086580 con 0x7f244815f000 2024-08-18T22:27:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.852+0000 7f2446a00640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24280678c0 0x7f2428069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:33.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.852+0000 7f2446a00640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24280678c0 0x7f2428069d80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2438000f70 tx=0x7f2438007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:33.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:33.852+0000 7f243ea00640 1 -- 172.21.15.5:0/3312933795 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f24400568c0 con 0x7f244815f000 2024-08-18T22:27:34.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.076+0000 7f244d600640 1 -- 172.21.15.5:0/3312933795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f24480749d0 con 0x7f244815f000 2024-08-18T22:27:34.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f243ea00640 1 -- 172.21.15.5:0/3312933795 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7f244005abc0 con 0x7f244815f000 2024-08-18T22:27:34.079 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:27:34.079 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:27:34.079 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:27:34.079 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:27:34.079 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:27:34.080 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:27:34.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 -- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24280678c0 msgr2=0x7f2428069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:34.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24280678c0 0x7f2428069d80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2438000f70 tx=0x7f2438007e90 comp rx=0 tx=0).stop 2024-08-18T22:27:34.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 -- 172.21.15.5:0/3312933795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f244815f000 msgr2=0x7f24480ae310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:34.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f244815f000 0x7f24480ae310 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2440007e40 tx=0x7f244000e4b0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 -- 172.21.15.5:0/3312933795 shutdown_connections 2024-08-18T22:27:34.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24280678c0 0x7f2428069d80 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f244815f000 0x7f24480ae310 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2448147dd0 0x7f24481467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 --2- 172.21.15.5:0/3312933795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f244806c3c0 0x7f244815c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 -- 172.21.15.5:0/3312933795 >> 172.21.15.5:0/3312933795 conn(0x7f24480b65f0 msgr2=0x7f2448160c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:34.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 -- 172.21.15.5:0/3312933795 shutdown_connections 2024-08-18T22:27:34.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.080+0000 7f244d600640 1 -- 172.21.15.5:0/3312933795 wait complete. 2024-08-18T22:27:34.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:27:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb13600640 1 Processor -- start 2024-08-18T22:27:34.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb13600640 1 -- start start 2024-08-18T22:27:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb13600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb0c15bed0 0x7fdb0c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb13600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb0c0cb390 0x7fdb0c071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb13600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb0c072060 con 0x7fdb0c06da70 2024-08-18T22:27:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb13600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdb0c073c80 con 0x7fdb0c0cb390 2024-08-18T22:27:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb13600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdb0c0ca5d0 con 0x7fdb0c15bed0 2024-08-18T22:27:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb0be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb0c0cb390 0x7fdb0c071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb0be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb0c0cb390 0x7fdb0c071b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46352/0 (socket says 172.21.15.5:46352) 2024-08-18T22:27:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb0be00640 1 -- 172.21.15.5:0/2906494265 learned_addr learned my addr 172.21.15.5:0/2906494265 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb11600640 1 --1- 172.21.15.5:0/2906494265 >> v1:172.21.15.5:6789/0 conn(0x7fdb0c06da70 0x7fdb0c0cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35616/0 (socket says 172.21.15.5:35616) 2024-08-18T22:27:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb10c00640 1 --2- 172.21.15.5:0/2906494265 >> v2:172.21.15.117:3300/0 conn(0x7fdb0c15bed0 0x7fdb0c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb0be00640 1 -- 172.21.15.5:0/2906494265 >> v2:172.21.15.117:3300/0 conn(0x7fdb0c15bed0 msgr2=0x7fdb0c0735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb0be00640 1 --2- 172.21.15.5:0/2906494265 >> v2:172.21.15.117:3300/0 conn(0x7fdb0c15bed0 0x7fdb0c0735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb0be00640 1 -- 172.21.15.5:0/2906494265 >> v1:172.21.15.5:6789/0 conn(0x7fdb0c06da70 legacy=0x7fdb0c0cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.240+0000 7fdb0be00640 1 -- 172.21.15.5:0/2906494265 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c0ca8b0 con 0x7fdb0c0cb390 2024-08-18T22:27:34.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb0be00640 1 --2- 172.21.15.5:0/2906494265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0cb390 0x7fdb0c071b20 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0b2cc0 tx=0x7fdaf801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c5d6959e01e20b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:34.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb0b400640 1 -- 172.21.15.5:0/2906494265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80aa650 con 0x7fdb0c0cb390 2024-08-18T22:27:34.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb0b400640 1 -- 172.21.15.5:0/2906494265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf80af070 con 0x7fdb0c0cb390 2024-08-18T22:27:34.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb0b400640 1 -- 172.21.15.5:0/2906494265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80aaa10 con 0x7fdb0c0cb390 2024-08-18T22:27:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb13600640 1 -- 172.21.15.5:0/2906494265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0cb390 msgr2=0x7fdb0c071b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb13600640 1 --2- 172.21.15.5:0/2906494265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0cb390 0x7fdb0c071b20 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0b2cc0 tx=0x7fdaf801c4f0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb13600640 1 -- 172.21.15.5:0/2906494265 shutdown_connections 2024-08-18T22:27:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb13600640 1 --2- 172.21.15.5:0/2906494265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0cb390 0x7fdb0c071b20 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb13600640 1 --2- 172.21.15.5:0/2906494265 >> v2:172.21.15.117:3300/0 conn(0x7fdb0c15bed0 0x7fdb0c0735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb13600640 1 -- 172.21.15.5:0/2906494265 >> 172.21.15.5:0/2906494265 conn(0x7fdb0c0b1c50 msgr2=0x7fdb0c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb13600640 1 -- 172.21.15.5:0/2906494265 shutdown_connections 2024-08-18T22:27:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.244+0000 7fdb13600640 1 -- 172.21.15.5:0/2906494265 wait complete. 2024-08-18T22:27:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb13600640 1 Processor -- start 2024-08-18T22:27:34.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb13600640 1 -- start start 2024-08-18T22:27:34.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb13600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c06da70 0x7fdb0c14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:34.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb13600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0cb390 0x7fdb0c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:34.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb13600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0c15bed0 0x7fdb0c0b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:34.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb13600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c15c430 con 0x7fdb0c06da70 2024-08-18T22:27:34.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb13600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c15c2b0 con 0x7fdb0c15bed0 2024-08-18T22:27:34.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb13600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0c168ba0 con 0x7fdb0c0cb390 2024-08-18T22:27:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb10c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c06da70 0x7fdb0c14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb10c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c06da70 0x7fdb0c14d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46366/0 (socket says 172.21.15.5:46366) 2024-08-18T22:27:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb10c00640 1 -- 172.21.15.5:0/3260951159 learned_addr learned my addr 172.21.15.5:0/3260951159 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb10c00640 1 -- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0cb390 msgr2=0x7fdb0c0b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb10c00640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0cb390 0x7fdb0c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb10c00640 1 -- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0c15bed0 msgr2=0x7fdb0c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb10c00640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0c15bed0 0x7fdb0c0b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb10c00640 1 -- 172.21.15.5:0/3260951159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c0b5df0 con 0x7fdb0c06da70 2024-08-18T22:27:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb10c00640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c06da70 0x7fdb0c14d610 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00e870 tx=0x7fdafc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb08c00640 1 -- 172.21.15.5:0/3260951159 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc017070 con 0x7fdb0c06da70 2024-08-18T22:27:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb08c00640 1 -- 172.21.15.5:0/3260951159 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc00c940 con 0x7fdb0c06da70 2024-08-18T22:27:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb08c00640 1 -- 172.21.15.5:0/3260951159 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc00ccf0 con 0x7fdb0c06da70 2024-08-18T22:27:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb13600640 1 -- 172.21.15.5:0/3260951159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0c09cef0 con 0x7fdb0c06da70 2024-08-18T22:27:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.248+0000 7fdb13600640 1 -- 172.21.15.5:0/3260951159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0c14db50 con 0x7fdb0c06da70 2024-08-18T22:27:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.252+0000 7fdb13600640 1 -- 172.21.15.5:0/3260951159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0c071b20 con 0x7fdb0c06da70 2024-08-18T22:27:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.252+0000 7fdb08c00640 1 -- 172.21.15.5:0/3260951159 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdafc01a070 con 0x7fdb0c06da70 2024-08-18T22:27:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.252+0000 7fdb08c00640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdaec0678f0 0x7fdaec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.252+0000 7fdb08c00640 1 -- 172.21.15.5:0/3260951159 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fdafc0861c0 con 0x7fdb0c06da70 2024-08-18T22:27:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.252+0000 7fdb0be00640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdaec0678f0 0x7fdaec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.252+0000 7fdb0be00640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdaec0678f0 0x7fdaec069db0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80ae000 tx=0x7fdaf8004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:34.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.256+0000 7fdb08c00640 1 -- 172.21.15.5:0/3260951159 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdafc056a40 con 0x7fdb0c06da70 2024-08-18T22:27:34.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 -- 172.21.15.5:0/3260951159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb0c0cfb40 con 0x7fdb0c06da70 2024-08-18T22:27:34.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb08c00640 1 -- 172.21.15.5:0/3260951159 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5224 (secure 0 0 0) 0x7fdafc056340 con 0x7fdb0c06da70 2024-08-18T22:27:34.460 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:27:34.460 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":100,"btime":"2024-08-18T22:27:27:572472+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1632895454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1632895454},{"type":"v1","addr":"172.21.15.117:6836","nonce":1632895454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/932399139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":932399139},{"type":"v1","addr":"172.21.15.5:6835","nonce":932399139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3229011054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3229011054},{"type":"v1","addr":"172.21.15.5:6834","nonce":3229011054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:27:23.980938+0000","modified":"2024-08-18T22:27:26.969472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2108480966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2108480966},{"type":"v1","addr":"172.21.15.117:6837","nonce":2108480966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8166,"qdb_cluster":[8166]},"id":8}]} 2024-08-18T22:27:34.461 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 100 2024-08-18T22:27:34.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 -- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdaec0678f0 msgr2=0x7fdaec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:34.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdaec0678f0 0x7fdaec069db0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80ae000 tx=0x7fdaf8004740 comp rx=0 tx=0).stop 2024-08-18T22:27:34.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 -- 172.21.15.5:0/3260951159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c06da70 msgr2=0x7fdb0c14d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:34.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c06da70 0x7fdb0c14d610 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00e870 tx=0x7fdafc00ec70 comp rx=0 tx=0).stop 2024-08-18T22:27:34.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 -- 172.21.15.5:0/3260951159 shutdown_connections 2024-08-18T22:27:34.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdaec0678f0 0x7fdaec069db0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0c15bed0 0x7fdb0c0b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0cb390 0x7fdb0c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 --2- 172.21.15.5:0/3260951159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c06da70 0x7fdb0c14d610 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:34.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 -- 172.21.15.5:0/3260951159 >> 172.21.15.5:0/3260951159 conn(0x7fdb0c0b1c50 msgr2=0x7fdb0c0ad2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:34.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 -- 172.21.15.5:0/3260951159 shutdown_connections 2024-08-18T22:27:34.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:34.460+0000 7fdb13600640 1 -- 172.21.15.5:0/3260951159 wait complete. 2024-08-18T22:27:34.885 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 100, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:27:23.980938+0000', 'modified': '2024-08-18T22:27:26.969472+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8166}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8166': {'gid': 8166, 'name': 'b', 'rank': 0, 'incarnation': 96, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6837/2108480966', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6835', 'nonce': 2108480966}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 2108480966}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8166, 'qdb_cluster': [8166]} 2024-08-18T22:27:34.885 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:27:34.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-18T22:27:35.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.028+0000 7f7fa8000640 1 Processor -- start 2024-08-18T22:27:35.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.028+0000 7f7fa8000640 1 -- start start 2024-08-18T22:27:35.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa8000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fa015b0c0 0x7f7fa006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa8000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7fa00cf290 0x7f7fa00b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa8000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa00b31f0 con 0x7f7fa00b40c0 2024-08-18T22:27:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa8000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7fa00b3d70 con 0x7f7fa00cf290 2024-08-18T22:27:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa8000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa00b4a40 con 0x7f7fa015b0c0 2024-08-18T22:27:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7fa00cf290 0x7f7fa00b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7fa00cf290 0x7f7fa00b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46380/0 (socket says 172.21.15.5:46380) 2024-08-18T22:27:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa6000640 1 -- 172.21.15.5:0/1667176813 learned_addr learned my addr 172.21.15.5:0/1667176813 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa4c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7fa00b40c0 0x7f7fa0072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35630/0 (socket says 172.21.15.5:35630) 2024-08-18T22:27:35.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa5600640 1 --2- 172.21.15.5:0/1667176813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fa015b0c0 0x7f7fa006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa6000640 1 -- 172.21.15.5:0/1667176813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fa015b0c0 msgr2=0x7f7fa006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa6000640 1 --2- 172.21.15.5:0/1667176813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fa015b0c0 0x7f7fa006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa6000640 1 -- 172.21.15.5:0/1667176813 >> v1:172.21.15.5:6789/0 conn(0x7f7fa00b40c0 legacy=0x7f7fa0072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7f9fe00640 1 -- 172.21.15.5:0/1667176813 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414568658 0 0) 0x7f7fa00b31f0 con 0x7f7fa00b40c0 2024-08-18T22:27:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa6000640 1 -- 172.21.15.5:0/1667176813 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa00b34d0 con 0x7f7fa00cf290 2024-08-18T22:27:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.032+0000 7f7fa6000640 1 --2- 172.21.15.5:0/1667176813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa00cf290 0x7f7fa00b4500 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009e50 tx=0x7f7f9801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f8ca8dcb9292c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7f9fe00640 1 -- 172.21.15.5:0/1667176813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f980a57a0 con 0x7f7fa00cf290 2024-08-18T22:27:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7f9fe00640 1 -- 172.21.15.5:0/1667176813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f980a5940 con 0x7f7fa00cf290 2024-08-18T22:27:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7f9fe00640 1 -- 172.21.15.5:0/1667176813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f980a5d10 con 0x7f7fa00cf290 2024-08-18T22:27:35.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 -- 172.21.15.5:0/1667176813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa00cf290 msgr2=0x7f7fa00b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 --2- 172.21.15.5:0/1667176813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa00cf290 0x7f7fa00b4500 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009e50 tx=0x7f7f9801c8e0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 -- 172.21.15.5:0/1667176813 shutdown_connections 2024-08-18T22:27:35.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 --2- 172.21.15.5:0/1667176813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa00cf290 0x7f7fa00b4500 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 --2- 172.21.15.5:0/1667176813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fa015b0c0 0x7f7fa006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 -- 172.21.15.5:0/1667176813 >> 172.21.15.5:0/1667176813 conn(0x7f7fa00b1dc0 msgr2=0x7f7fa00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:35.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 -- 172.21.15.5:0/1667176813 shutdown_connections 2024-08-18T22:27:35.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 -- 172.21.15.5:0/1667176813 wait complete. 2024-08-18T22:27:35.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 Processor -- start 2024-08-18T22:27:35.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 -- start start 2024-08-18T22:27:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa00b40c0 0x7f7fa00cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fa00cf290 0x7f7fa0151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa015b0c0 0x7f7fa01542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa015b620 con 0x7f7fa00b40c0 2024-08-18T22:27:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa015b4a0 con 0x7f7fa015b0c0 2024-08-18T22:27:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa8000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa006f670 con 0x7f7fa00cf290 2024-08-18T22:27:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa00b40c0 0x7f7fa00cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa00b40c0 0x7f7fa00cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46384/0 (socket says 172.21.15.5:46384) 2024-08-18T22:27:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa5600640 1 -- 172.21.15.5:0/1403845302 learned_addr learned my addr 172.21.15.5:0/1403845302 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa4c00640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fa00cf290 0x7f7fa0151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.036+0000 7f7fa6000640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa015b0c0 0x7f7fa01542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fa5600640 1 -- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fa00cf290 msgr2=0x7f7fa0151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fa5600640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fa00cf290 0x7f7fa0151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fa5600640 1 -- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa015b0c0 msgr2=0x7f7fa01542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fa5600640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa015b0c0 0x7f7fa01542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fa5600640 1 -- 172.21.15.5:0/1403845302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa01528c0 con 0x7f7fa00b40c0 2024-08-18T22:27:35.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fa4c00640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fa00cf290 0x7f7fa0151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:35.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fa5600640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa00b40c0 0x7f7fa00cacc0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400d800 tx=0x7f7f9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:35.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7f9d600640 1 -- 172.21.15.5:0/1403845302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9400b6c0 con 0x7f7fa00b40c0 2024-08-18T22:27:35.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7f9d600640 1 -- 172.21.15.5:0/1403845302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f94019070 con 0x7f7fa00b40c0 2024-08-18T22:27:35.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7f9d600640 1 -- 172.21.15.5:0/1403845302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9400ba60 con 0x7f7fa00b40c0 2024-08-18T22:27:35.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fa8000640 1 -- 172.21.15.5:0/1403845302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa00adae0 con 0x7f7fa00b40c0 2024-08-18T22:27:35.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fa8000640 1 -- 172.21.15.5:0/1403845302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa00ae0a0 con 0x7f7fa00b40c0 2024-08-18T22:27:35.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7f9d600640 1 -- 172.21.15.5:0/1403845302 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f9400bc00 con 0x7f7fa00b40c0 2024-08-18T22:27:35.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7f9d600640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f800678c0 0x7f7f80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7f9d600640 1 -- 172.21.15.5:0/1403845302 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f7f94086320 con 0x7f7fa00b40c0 2024-08-18T22:27:35.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fa4c00640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f800678c0 0x7f7f80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fab5c9000 1 Processor -- start 2024-08-18T22:27:35.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.040+0000 7f7fab5c9000 1 -- start start 2024-08-18T22:27:35.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa4c00640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f800678c0 0x7f7f80069d80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00b4d30 tx=0x7f7f8c007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:35.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484ac07d50 0x56484ac08130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484abbe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484abbe990 0x56484abbed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56484aaa4fd0 con 0x56484abbe990 2024-08-18T22:27:35.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56484aa0b3c0 con 0x56484ac07d50 2024-08-18T22:27:35.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56484a9b0f70 con 0x56484ac08670 2024-08-18T22:27:35.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484abbe990 0x56484abbed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484abbe990 0x56484abbed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46398/0 (socket says 172.21.15.5:46398) 2024-08-18T22:27:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa6000640 1 -- 172.21.15.5:0/1310239718 learned_addr learned my addr 172.21.15.5:0/1310239718 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa5600640 1 --2- 172.21.15.5:0/1310239718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484ac07d50 0x56484ac08130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa4c00640 1 --2- 172.21.15.5:0/1310239718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484abbe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa6000640 1 -- 172.21.15.5:0/1310239718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 msgr2=0x56484abbe450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa6000640 1 --2- 172.21.15.5:0/1310239718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484abbe450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa6000640 1 -- 172.21.15.5:0/1310239718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484ac07d50 msgr2=0x56484ac08130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa6000640 1 --2- 172.21.15.5:0/1310239718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484ac07d50 0x56484ac08130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa6000640 1 -- 172.21.15.5:0/1310239718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484a9a52e0 con 0x56484abbe990 2024-08-18T22:27:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fa6000640 1 --2- 172.21.15.5:0/1310239718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484abbe990 0x56484abbed70 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f7f980af040 tx=0x7f7f98004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c067be44345d2181 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7f92000640 1 -- 172.21.15.5:0/1310239718 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f980039a0 con 0x56484abbe990 2024-08-18T22:27:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7f92000640 1 -- 172.21.15.5:0/1310239718 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f98003b40 con 0x56484abbe990 2024-08-18T22:27:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7f92000640 1 -- 172.21.15.5:0/1310239718 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f980a57a0 con 0x56484abbe990 2024-08-18T22:27:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 -- 172.21.15.5:0/1310239718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484abbe990 msgr2=0x56484abbed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/1310239718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484abbe990 0x56484abbed70 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f7f980af040 tx=0x7f7f98004ac0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 -- 172.21.15.5:0/1310239718 shutdown_connections 2024-08-18T22:27:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/1310239718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484abbe990 0x56484abbed70 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/1310239718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484abbe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/1310239718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484ac07d50 0x56484ac08130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 -- 172.21.15.5:0/1310239718 >> 172.21.15.5:0/1310239718 conn(0x56484abba910 msgr2=0x56484abbcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 -- 172.21.15.5:0/1310239718 shutdown_connections 2024-08-18T22:27:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 -- 172.21.15.5:0/1310239718 wait complete. 2024-08-18T22:27:35.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 -- start start 2024-08-18T22:27:35.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.044+0000 7f7fab5c9000 1 Processor -- start 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484abbe990 0x56484abf5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484abc3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484abc40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56484a9b2e40 con 0x56484ac07d50 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56484aac8af0 con 0x56484abbe990 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56484aa6d450 con 0x56484ac08670 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 10 client.0 _ll_register_callbacks cb 0x56484aba9630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484abc3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484abc3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46400/0 (socket says 172.21.15.5:46400) 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa4c00640 1 -- 172.21.15.5:0/2158872855 learned_addr learned my addr 172.21.15.5:0/2158872855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa6000640 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484abc40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa5600640 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484abbe990 0x56484abf5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa4c00640 1 -- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 msgr2=0x56484abc40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:35.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa4c00640 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484abc40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa4c00640 1 -- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484abbe990 msgr2=0x56484abf5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:35.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa4c00640 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484abbe990 0x56484abf5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa4c00640 1 -- 172.21.15.5:0/2158872855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484a992fd0 con 0x56484ac07d50 2024-08-18T22:27:35.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa4c00640 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484abc3b60 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c001d30 tx=0x7f7f8c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ccddae82a9ae23 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:35.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7f86a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:27:35.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7f86a00640 1 -- 172.21.15.5:0/2158872855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c027060 con 0x56484ac07d50 2024-08-18T22:27:35.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7f86a00640 1 -- 172.21.15.5:0/2158872855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f7f8c010040 con 0x56484ac07d50 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2158872855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f98003b40 con 0x56484ac07d50 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7f86a00640 1 -- 172.21.15.5:0/2158872855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f7f8c015e50 con 0x56484ac07d50 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 10 client.8322 fetch_fsmap learned FSMap version 100 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2158872855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x56484aa8e4d0 con 0x56484ac07d50 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7f86a00640 1 -- 172.21.15.5:0/2158872855 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f98003b40 con 0x56484ac07d50 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7f86a00640 1 -- 172.21.15.5:0/2158872855 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f7f8c013420 con 0x56484ac07d50 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 10 client.8322 fetch_fsmap finished waiting for FSMap version 100 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 10 client.8322 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 20 client.8322 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x56484abf64f0 0x56484abf68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 4 client.8322 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2158872855 --> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56484a9a5c00 con 0x56484abf64f0 2024-08-18T22:27:35.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa5600640 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x56484abf64f0 0x56484abf68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7fa5600640 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x56484abf64f0 0x56484abf68d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7109e99f3f6be2cd server_cookie=3fc02bd843fd3ac6 in_seq=0 out_seq=0 2024-08-18T22:27:35.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.048+0000 7f7f86a00640 10 client.8322 ms_handle_connect on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:35.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7f86a00640 1 -- 172.21.15.5:0/2158872855 <== mds.0 v2:172.21.15.117:6835/2108480966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56484a9a5c00 con 0x56484abf64f0 2024-08-18T22:27:35.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7f86a00640 10 client.8322 handle_command_reply: tid=0 2024-08-18T22:27:35.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 1 client.8322 shutdown 2024-08-18T22:27:35.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2158872855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 msgr2=0x56484abc3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484abc3b60 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c001d30 tx=0x7f7f8c011000 comp rx=0 tx=0).stop 2024-08-18T22:27:35.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2158872855 shutdown_connections 2024-08-18T22:27:35.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x56484abf64f0 0x56484abf68d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484abc40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484abc3b60 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2158872855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484abbe990 0x56484abf5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7f86a00640 0 client.8322 ms_handle_reset on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:35.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2158872855 >> 172.21.15.5:0/2158872855 conn(0x56484abba910 msgr2=0x56484abbd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:35.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2158872855 shutdown_connections 2024-08-18T22:27:35.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2158872855 wait complete. 2024-08-18T22:27:35.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.052+0000 7f7fab5c9000 20 client.8322 trim_cache size 0 max 16384 2024-08-18T22:27:35.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.068+0000 7f7fab5c9000 1 Processor -- start 2024-08-18T22:27:35.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 -- start start 2024-08-18T22:27:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484abbe990 0x56484abbcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484ac07d50 0x56484abbd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac08670 0x56484abbda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa0202ac0 con 0x56484ac08670 2024-08-18T22:27:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01539e0 con 0x56484ac07d50 2024-08-18T22:27:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa0202590 con 0x56484abbe990 2024-08-18T22:27:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fa6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac08670 0x56484abbda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fa6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac08670 0x56484abbda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46404/0 (socket says 172.21.15.5:46404) 2024-08-18T22:27:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fa6000640 1 -- 172.21.15.5:0/4061211543 learned_addr learned my addr 172.21.15.5:0/4061211543 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fa5600640 1 --2- 172.21.15.5:0/4061211543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484abbe990 0x56484abbcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fa4c00640 1 --2- 172.21.15.5:0/4061211543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484ac07d50 0x56484abbd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fa6000640 1 -- 172.21.15.5:0/4061211543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484abbe990 msgr2=0x56484abbcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:35.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fa6000640 1 --2- 172.21.15.5:0/4061211543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484abbe990 0x56484abbcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fa6000640 1 -- 172.21.15.5:0/4061211543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484ac07d50 msgr2=0x56484abbd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:35.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fa6000640 1 --2- 172.21.15.5:0/4061211543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484ac07d50 0x56484abbd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fa6000640 1 -- 172.21.15.5:0/4061211543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484ac084a0 con 0x56484ac08670 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fa6000640 1 --2- 172.21.15.5:0/4061211543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac08670 0x56484abbda40 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f7f9801a510 tx=0x7f7f980a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1473f2533eecb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7f91600640 1 -- 172.21.15.5:0/4061211543 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f980ba040 con 0x56484ac08670 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7f91600640 1 -- 172.21.15.5:0/4061211543 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f980bb040 con 0x56484ac08670 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7f91600640 1 -- 172.21.15.5:0/4061211543 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f980a57a0 con 0x56484ac08670 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 -- 172.21.15.5:0/4061211543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac08670 msgr2=0x56484abbda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/4061211543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac08670 0x56484abbda40 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f7f9801a510 tx=0x7f7f980a7000 comp rx=0 tx=0).stop 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 -- 172.21.15.5:0/4061211543 shutdown_connections 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/4061211543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac08670 0x56484abbda40 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/4061211543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484ac07d50 0x56484abbd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/4061211543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484abbe990 0x56484abbcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 -- 172.21.15.5:0/4061211543 >> 172.21.15.5:0/4061211543 conn(0x56484abba910 msgr2=0x56484abc3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 -- 172.21.15.5:0/4061211543 shutdown_connections 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 -- 172.21.15.5:0/4061211543 wait complete. 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 -- start start 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.072+0000 7f7fab5c9000 1 Processor -- start 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484abbe990 0x56484ac7b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484ac7b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484ac7bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56484a9c41d0 con 0x56484ac07d50 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56484a9a2900 con 0x56484abbe990 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56484aa0a6d0 con 0x56484ac08670 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 10 client.0 _ll_register_callbacks cb 0x7f7f8c005c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484ac7b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484ac7b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46412/0 (socket says 172.21.15.5:46412) 2024-08-18T22:27:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa4c00640 1 -- 172.21.15.5:0/2542378136 learned_addr learned my addr 172.21.15.5:0/2542378136 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa6000640 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484ac7bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa5600640 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484abbe990 0x56484ac7b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa6000640 1 -- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484abbe990 msgr2=0x56484ac7b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa6000640 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484abbe990 0x56484ac7b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa6000640 1 -- 172.21.15.5:0/2542378136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 msgr2=0x56484ac7b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa6000640 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484ac7b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa6000640 1 -- 172.21.15.5:0/2542378136 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x56484aa04b30 con 0x56484ac08670 2024-08-18T22:27:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa4c00640 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484ac7b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa6000640 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484ac7bc60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7f98004b40 tx=0x7f7f9801b120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5bb02921a6331fc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7f86a00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3301/0 2024-08-18T22:27:35.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7f86a00640 1 -- 172.21.15.5:0/2542378136 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f980d1060 con 0x56484ac08670 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2542378136 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f980bb040 con 0x56484ac08670 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7f86a00640 1 -- 172.21.15.5:0/2542378136 <== mon.2 v2:172.21.15.117:3301/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f7f980c2480 con 0x56484ac08670 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7f86a00640 1 -- 172.21.15.5:0/2542378136 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f7f980c6070 con 0x56484ac08670 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 10 client.7040 fetch_fsmap learned FSMap version 100 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2542378136 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x56484a9bc810 con 0x56484ac08670 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7f86a00640 1 -- 172.21.15.5:0/2542378136 <== mon.2 v2:172.21.15.117:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f980bb040 con 0x56484ac08670 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7f86a00640 1 -- 172.21.15.5:0/2542378136 <== mon.2 v2:172.21.15.117:3301/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f7f98008040 con 0x56484ac08670 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 10 client.7040 fetch_fsmap finished waiting for FSMap version 100 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 10 client.7040 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 20 client.7040 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x56484ac1c7d0 0x56484ac1cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 4 client.7040 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2542378136 --> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] -- command(tid 0: {"prefix": "status"}) -- 0x56484abf59d0 con 0x56484ac1c7d0 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa5600640 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x56484ac1c7d0 0x56484ac1cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7fa5600640 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x56484ac1c7d0 0x56484ac1cbb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37b36e42eb4ae4cd server_cookie=40016913b92ea263 in_seq=0 out_seq=0 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.076+0000 7f7f86a00640 10 client.7040 ms_handle_connect on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7f86a00640 1 -- 172.21.15.5:0/2542378136 <== mds.0 v2:172.21.15.117:6835/2108480966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x56484abf59d0 con 0x56484ac1c7d0 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7f86a00640 10 client.7040 handle_command_reply: tid=0 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 1 client.7040 shutdown 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 msgr2=0x56484ac7bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484ac7bc60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7f98004b40 tx=0x7f7f9801b120 comp rx=0 tx=0).stop 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2542378136 shutdown_connections 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x56484ac1c7d0 0x56484ac1cbb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56484ac08670 0x56484ac7bc60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56484ac07d50 0x56484ac7b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 1 --2- 172.21.15.5:0/2542378136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56484abbe990 0x56484ac7b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7f86a00640 0 client.7040 ms_handle_reset on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:35.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2542378136 >> 172.21.15.5:0/2542378136 conn(0x56484abba910 msgr2=0x56484ac06950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:35.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2542378136 shutdown_connections 2024-08-18T22:27:35.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 1 -- 172.21.15.5:0/2542378136 wait complete. 2024-08-18T22:27:35.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fab5c9000 20 client.7040 trim_cache size 0 max 16384 2024-08-18T22:27:35.083 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:27:35.083 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:27:35.083 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:27:35.083 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8166, 2024-08-18T22:27:35.084 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:27:35.084 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:27:35.084 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:27:35.084 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.525755891999999, 2024-08-18T22:27:35.084 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 100, 2024-08-18T22:27:35.084 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 129, 2024-08-18T22:27:35.084 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 129, 2024-08-18T22:27:35.084 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15.310541263999999 2024-08-18T22:27:35.084 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:27:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 -- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f800678c0 msgr2=0x7f7f80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f800678c0 0x7f7f80069d80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00b4d30 tx=0x7f7f8c007cb0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 -- 172.21.15.5:0/1403845302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa00b40c0 msgr2=0x7f7fa00cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa00b40c0 0x7f7fa00cacc0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400d800 tx=0x7f7f9400dcc0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 -- 172.21.15.5:0/1403845302 shutdown_connections 2024-08-18T22:27:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f800678c0 0x7f7f80069d80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fa015b0c0 0x7f7fa01542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fa00cf290 0x7f7fa0151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 --2- 172.21.15.5:0/1403845302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa00b40c0 0x7f7fa00cacc0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 -- 172.21.15.5:0/1403845302 >> 172.21.15.5:0/1403845302 conn(0x7f7fa00b1dc0 msgr2=0x7f7fa006ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:35.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 -- 172.21.15.5:0/1403845302 shutdown_connections 2024-08-18T22:27:35.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.080+0000 7f7fa8000640 1 -- 172.21.15.5:0/1403845302 wait complete. 2024-08-18T22:27:35.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:27:35.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88ce400640 1 Processor -- start 2024-08-18T22:27:35.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88ce400640 1 -- start start 2024-08-18T22:27:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88ce400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88c80ce840 0x7f88c80cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88ce400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c80cee20 con 0x7f88c815b010 2024-08-18T22:27:35.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88ce400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c80cf100 con 0x7f88c806f290 2024-08-18T22:27:35.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88ce400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f88c80cd8e0 con 0x7f88c80ce840 2024-08-18T22:27:35.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88c7400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f88c815b010 0x7f88c806eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35642/0 (socket says 172.21.15.5:35642) 2024-08-18T22:27:35.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88c7400640 1 -- 172.21.15.5:0/3911589247 learned_addr learned my addr 172.21.15.5:0/3911589247 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:35.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88c7e00640 1 --2- 172.21.15.5:0/3911589247 >> v2:172.21.15.5:3300/0 conn(0x7f88c80ce840 0x7f88c80cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88c7e00640 1 -- 172.21.15.5:0/3911589247 >> v1:172.21.15.117:6789/0 conn(0x7f88c806f290 legacy=0x7f88c8072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88c7e00640 1 -- 172.21.15.5:0/3911589247 >> v1:172.21.15.5:6789/0 conn(0x7f88c815b010 legacy=0x7f88c806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88c7e00640 1 -- 172.21.15.5:0/3911589247 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c80cf3e0 con 0x7f88c80ce840 2024-08-18T22:27:35.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.240+0000 7f88c6a00640 1 -- 172.21.15.5:0/3911589247 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067584053 0 0) 0x7f88c80cee20 con 0x7f88c815b010 2024-08-18T22:27:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.244+0000 7f88c7e00640 1 --2- 172.21.15.5:0/3911589247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c80ce840 0x7f88c80cd3a0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009d90 tx=0x7f88c001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b3f9fae8f582bf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.244+0000 7f88c6a00640 1 -- 172.21.15.5:0/3911589247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c00b2070 con 0x7f88c80ce840 2024-08-18T22:27:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.244+0000 7f88c6a00640 1 -- 172.21.15.5:0/3911589247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c00a57b0 con 0x7f88c80ce840 2024-08-18T22:27:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.244+0000 7f88c6a00640 1 -- 172.21.15.5:0/3911589247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c00a5b80 con 0x7f88c80ce840 2024-08-18T22:27:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.244+0000 7f88ce400640 1 -- 172.21.15.5:0/3911589247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c80ce840 msgr2=0x7f88c80cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.244+0000 7f88ce400640 1 --2- 172.21.15.5:0/3911589247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c80ce840 0x7f88c80cd3a0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009d90 tx=0x7f88c001c8e0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.244+0000 7f88ce400640 1 -- 172.21.15.5:0/3911589247 shutdown_connections 2024-08-18T22:27:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.244+0000 7f88ce400640 1 --2- 172.21.15.5:0/3911589247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c80ce840 0x7f88c80cd3a0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.244+0000 7f88ce400640 1 -- 172.21.15.5:0/3911589247 >> 172.21.15.5:0/3911589247 conn(0x7f88c80b1c50 msgr2=0x7f88c80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.244+0000 7f88ce400640 1 -- 172.21.15.5:0/3911589247 shutdown_connections 2024-08-18T22:27:35.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.244+0000 7f88ce400640 1 -- 172.21.15.5:0/3911589247 wait complete. 2024-08-18T22:27:35.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88ce400640 1 Processor -- start 2024-08-18T22:27:35.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88ce400640 1 -- start start 2024-08-18T22:27:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88ce400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c806f290 0x7f88c814da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88ce400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c80ce840 0x7f88c80ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88ce400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c815b010 0x7f88c815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88ce400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f88c80738d0 con 0x7f88c815b010 2024-08-18T22:27:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88ce400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f88c8073750 con 0x7f88c80ce840 2024-08-18T22:27:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88ce400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f88c8168c60 con 0x7f88c806f290 2024-08-18T22:27:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88c7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c815b010 0x7f88c815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88c7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c815b010 0x7f88c815cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46436/0 (socket says 172.21.15.5:46436) 2024-08-18T22:27:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88c7e00640 1 -- 172.21.15.5:0/2018597215 learned_addr learned my addr 172.21.15.5:0/2018597215 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:35.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88c7400640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c806f290 0x7f88c814da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88bea00640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c80ce840 0x7f88c80ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88c7e00640 1 -- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c806f290 msgr2=0x7f88c814da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88c7e00640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c806f290 0x7f88c814da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88c7e00640 1 -- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c80ce840 msgr2=0x7f88c80ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88c7e00640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c80ce840 0x7f88c80ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88c7e00640 1 -- 172.21.15.5:0/2018597215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c815bc00 con 0x7f88c815b010 2024-08-18T22:27:35.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88c7e00640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c815b010 0x7f88c815cd90 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f88c00b0040 tx=0x7f88c0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:35.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88bfe00640 1 -- 172.21.15.5:0/2018597215 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c00b2050 con 0x7f88c815b010 2024-08-18T22:27:35.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88bfe00640 1 -- 172.21.15.5:0/2018597215 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c00be070 con 0x7f88c815b010 2024-08-18T22:27:35.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88ce400640 1 -- 172.21.15.5:0/2018597215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c815bee0 con 0x7f88c815b010 2024-08-18T22:27:35.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88bfe00640 1 -- 172.21.15.5:0/2018597215 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c00ada50 con 0x7f88c815b010 2024-08-18T22:27:35.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88ce400640 1 -- 172.21.15.5:0/2018597215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c815c4a0 con 0x7f88c815b010 2024-08-18T22:27:35.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.248+0000 7f88ce400640 1 -- 172.21.15.5:0/2018597215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c80cd3a0 con 0x7f88c815b010 2024-08-18T22:27:35.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.252+0000 7f88bfe00640 1 -- 172.21.15.5:0/2018597215 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88c00adbf0 con 0x7f88c815b010 2024-08-18T22:27:35.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.252+0000 7f88bfe00640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88a40678f0 0x7f88a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:35.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.252+0000 7f88bfe00640 1 -- 172.21.15.5:0/2018597215 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f88c01208d0 con 0x7f88c815b010 2024-08-18T22:27:35.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.252+0000 7f88c7400640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88a40678f0 0x7f88a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:35.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.252+0000 7f88c7400640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88a40678f0 0x7f88a4069db0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000f70 tx=0x7f88b8007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:35.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.256+0000 7f88bfe00640 1 -- 172.21.15.5:0/2018597215 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f88c00c7020 con 0x7f88c815b010 2024-08-18T22:27:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 -- 172.21.15.5:0/2018597215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f88c81548c0 con 0x7f88c815b010 2024-08-18T22:27:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88bfe00640 1 -- 172.21.15.5:0/2018597215 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v100) ==== 53+0+73 (secure 0 0 0) 0x7f88c0016560 con 0x7f88c815b010 2024-08-18T22:27:35.456 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:27:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 -- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88a40678f0 msgr2=0x7f88a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88a40678f0 0x7f88a4069db0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000f70 tx=0x7f88b8007240 comp rx=0 tx=0).stop 2024-08-18T22:27:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 -- 172.21.15.5:0/2018597215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c815b010 msgr2=0x7f88c815cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c815b010 0x7f88c815cd90 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f88c00b0040 tx=0x7f88c0019680 comp rx=0 tx=0).stop 2024-08-18T22:27:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 -- 172.21.15.5:0/2018597215 shutdown_connections 2024-08-18T22:27:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88a40678f0 0x7f88a4069db0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88c815b010 0x7f88c815cd90 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c80ce840 0x7f88c80ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 --2- 172.21.15.5:0/2018597215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c806f290 0x7f88c814da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 -- 172.21.15.5:0/2018597215 >> 172.21.15.5:0/2018597215 conn(0x7f88c80b1c50 msgr2=0x7f88c80b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 -- 172.21.15.5:0/2018597215 shutdown_connections 2024-08-18T22:27:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35.456+0000 7f88ce400640 1 -- 172.21.15.5:0/2018597215 wait complete. 2024-08-18T22:27:35.478 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:27:35.479 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:27:35.479 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:27:35.479 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:27:35.479 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:27:35.479 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:27:35.479 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:27:35.479 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:27:35.479 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:27:35.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:35.479 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:27:35.488 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:27:35.488 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:27:35.488 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:27:35.488 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:27:35.488 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41946sec preferred_lft 41946sec 2024-08-18T22:27:35.489 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:27:35.490 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:27:35.490 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:27:35.490 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:27:35.490 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:27:35.490 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:27:35.490 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:27:35.490 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:27:35.490 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:27:35.490 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:27:35.491 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:27:35.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:35.493 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:27:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:27:35.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:35.555 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:27:35.611 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:27:35.611 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:27:35.611 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:27:35.611 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:27:35.611 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:27:35.611 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:27:35.612 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:27:35.612 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:35.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:27:35.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:27:35.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:27:35.612 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:35.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:27:35.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:35.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:35.750 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:27:35.807 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:27:35.807 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:27:35.807 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:27:35.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:35.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:27:35.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:27:35.870 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:27:35.926 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:27:35.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:27:35.926 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:27:35.981 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:27:35.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:35.981 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:27:36.075 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:27:36.075 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:27:36.076 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:27:36.090 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:27:36.091 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:27:36.091 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:27:36.091 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:27:36.091 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:27:36.099 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:27:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:27:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:27:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:27:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:27:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:27:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:27:36.100 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:27:36.103 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:27:36.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:36.104 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:27:36.124 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:27:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:36.235 INFO:teuthology.orchestra.run.smithi005.stdout:client7046 2024-08-18T22:27:36.235 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:27:36.235 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:27:36.244 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:36.244 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:36.244 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.0 2024-08-18T22:27:36.244 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:36.244 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:36.244 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:36.244 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:36.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:36.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.379 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025349 s, 41.4 MB/s 2024-08-18T22:27:36.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203894 s, 51.4 MB/s 2024-08-18T22:27:36.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.424 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188444 s, 55.6 MB/s 2024-08-18T22:27:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149624 s, 70.1 MB/s 2024-08-18T22:27:36.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187719 s, 55.9 MB/s 2024-08-18T22:27:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267719 s, 39.2 MB/s 2024-08-18T22:27:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132736 s, 79.0 MB/s 2024-08-18T22:27:36.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203043 s, 51.6 MB/s 2024-08-18T22:27:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171584 s, 61.1 MB/s 2024-08-18T22:27:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160835 s, 65.2 MB/s 2024-08-18T22:27:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203013 s, 51.7 MB/s 2024-08-18T22:27:36.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.612 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015124 s, 69.3 MB/s 2024-08-18T22:27:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162513 s, 64.5 MB/s 2024-08-18T22:27:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172307 s, 60.9 MB/s 2024-08-18T22:27:36.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020114 s, 52.1 MB/s 2024-08-18T22:27:36.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203888 s, 51.4 MB/s 2024-08-18T22:27:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197261 s, 53.2 MB/s 2024-08-18T22:27:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152278 s, 68.9 MB/s 2024-08-18T22:27:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203263 s, 51.6 MB/s 2024-08-18T22:27:36.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149147 s, 70.3 MB/s 2024-08-18T22:27:36.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.798 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174516 s, 60.1 MB/s 2024-08-18T22:27:36.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165599 s, 63.3 MB/s 2024-08-18T22:27:36.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.841 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207701 s, 50.5 MB/s 2024-08-18T22:27:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170822 s, 61.4 MB/s 2024-08-18T22:27:36.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.881 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173975 s, 60.3 MB/s 2024-08-18T22:27:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219338 s, 47.8 MB/s 2024-08-18T22:27:36.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.925 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169062 s, 62.0 MB/s 2024-08-18T22:27:36.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172813 s, 60.7 MB/s 2024-08-18T22:27:36.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.963 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160821 s, 65.2 MB/s 2024-08-18T22:27:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218958 s, 47.9 MB/s 2024-08-18T22:27:37.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.008 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01803 s, 58.2 MB/s 2024-08-18T22:27:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170376 s, 61.5 MB/s 2024-08-18T22:27:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:37.036 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:37.036 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:37.036 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.1 2024-08-18T22:27:37.036 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:37.036 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:37.036 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:37.036 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:37.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:37.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.113 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219522 s, 47.8 MB/s 2024-08-18T22:27:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162242 s, 64.6 MB/s 2024-08-18T22:27:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154837 s, 67.7 MB/s 2024-08-18T22:27:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.171 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017958 s, 58.4 MB/s 2024-08-18T22:27:37.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158648 s, 66.1 MB/s 2024-08-18T22:27:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200894 s, 52.2 MB/s 2024-08-18T22:27:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159782 s, 65.6 MB/s 2024-08-18T22:27:37.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191593 s, 54.7 MB/s 2024-08-18T22:27:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.277 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021074 s, 49.8 MB/s 2024-08-18T22:27:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265448 s, 39.5 MB/s 2024-08-18T22:27:37.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.326 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164494 s, 63.7 MB/s 2024-08-18T22:27:37.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019266 s, 54.4 MB/s 2024-08-18T22:27:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188701 s, 55.6 MB/s 2024-08-18T22:27:37.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152987 s, 68.5 MB/s 2024-08-18T22:27:37.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020428 s, 51.3 MB/s 2024-08-18T22:27:37.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.431 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148607 s, 70.6 MB/s 2024-08-18T22:27:37.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.446 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146199 s, 71.7 MB/s 2024-08-18T22:27:37.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.473 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238214 s, 44.0 MB/s 2024-08-18T22:27:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199043 s, 52.7 MB/s 2024-08-18T22:27:37.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016747 s, 62.6 MB/s 2024-08-18T22:27:37.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.538 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212149 s, 49.4 MB/s 2024-08-18T22:27:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190059 s, 55.2 MB/s 2024-08-18T22:27:37.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.582 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192038 s, 54.6 MB/s 2024-08-18T22:27:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.601 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168004 s, 62.4 MB/s 2024-08-18T22:27:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.620 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015646 s, 67.0 MB/s 2024-08-18T22:27:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184026 s, 57.0 MB/s 2024-08-18T22:27:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.664 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201937 s, 51.9 MB/s 2024-08-18T22:27:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171132 s, 61.3 MB/s 2024-08-18T22:27:37.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.702 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160725 s, 65.2 MB/s 2024-08-18T22:27:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145752 s, 71.9 MB/s 2024-08-18T22:27:37.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153399 s, 68.4 MB/s 2024-08-18T22:27:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162446 s, 64.5 MB/s 2024-08-18T22:27:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:37.764 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:37.764 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:37.764 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.2 2024-08-18T22:27:37.764 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:37.764 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:37.764 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:37.765 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:37.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:37.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208399 s, 50.3 MB/s 2024-08-18T22:27:37.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.859 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166228 s, 63.1 MB/s 2024-08-18T22:27:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148463 s, 70.6 MB/s 2024-08-18T22:27:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.894 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151423 s, 69.2 MB/s 2024-08-18T22:27:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016747 s, 62.6 MB/s 2024-08-18T22:27:37.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151461 s, 69.2 MB/s 2024-08-18T22:27:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.952 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175403 s, 59.8 MB/s 2024-08-18T22:27:37.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150713 s, 69.6 MB/s 2024-08-18T22:27:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267442 s, 39.2 MB/s 2024-08-18T22:27:38.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016853 s, 62.2 MB/s 2024-08-18T22:27:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145075 s, 72.3 MB/s 2024-08-18T22:27:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.055 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165995 s, 63.2 MB/s 2024-08-18T22:27:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155631 s, 67.4 MB/s 2024-08-18T22:27:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152669 s, 68.7 MB/s 2024-08-18T22:27:38.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144296 s, 72.7 MB/s 2024-08-18T22:27:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171673 s, 61.1 MB/s 2024-08-18T22:27:38.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.147 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158671 s, 66.1 MB/s 2024-08-18T22:27:38.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012369 s, 84.8 MB/s 2024-08-18T22:27:38.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220933 s, 47.5 MB/s 2024-08-18T22:27:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161539 s, 64.9 MB/s 2024-08-18T22:27:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.224 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148143 s, 70.8 MB/s 2024-08-18T22:27:38.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.241 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143934 s, 72.9 MB/s 2024-08-18T22:27:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024599 s, 42.6 MB/s 2024-08-18T22:27:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153147 s, 68.5 MB/s 2024-08-18T22:27:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144957 s, 72.3 MB/s 2024-08-18T22:27:38.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204311 s, 51.3 MB/s 2024-08-18T22:27:38.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.345 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153434 s, 68.3 MB/s 2024-08-18T22:27:38.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156885 s, 66.8 MB/s 2024-08-18T22:27:38.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.385 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01942 s, 54.0 MB/s 2024-08-18T22:27:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140814 s, 74.5 MB/s 2024-08-18T22:27:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166085 s, 63.1 MB/s 2024-08-18T22:27:38.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.448 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235076 s, 44.6 MB/s 2024-08-18T22:27:38.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:38.455 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:38.455 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:38.455 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.3 2024-08-18T22:27:38.455 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:38.455 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:38.455 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:38.455 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:38.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170165 s, 61.6 MB/s 2024-08-18T22:27:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212165 s, 49.4 MB/s 2024-08-18T22:27:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015732 s, 66.7 MB/s 2024-08-18T22:27:38.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150325 s, 69.8 MB/s 2024-08-18T22:27:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164888 s, 63.6 MB/s 2024-08-18T22:27:38.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014929 s, 70.2 MB/s 2024-08-18T22:27:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149557 s, 70.1 MB/s 2024-08-18T22:27:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142982 s, 73.3 MB/s 2024-08-18T22:27:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174831 s, 60.0 MB/s 2024-08-18T22:27:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150961 s, 69.5 MB/s 2024-08-18T22:27:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164824 s, 63.6 MB/s 2024-08-18T22:27:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153645 s, 68.2 MB/s 2024-08-18T22:27:38.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144319 s, 72.7 MB/s 2024-08-18T22:27:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145222 s, 72.2 MB/s 2024-08-18T22:27:38.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.791 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162028 s, 64.7 MB/s 2024-08-18T22:27:38.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.810 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166591 s, 62.9 MB/s 2024-08-18T22:27:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014875 s, 70.5 MB/s 2024-08-18T22:27:38.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144312 s, 72.7 MB/s 2024-08-18T22:27:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147992 s, 70.9 MB/s 2024-08-18T22:27:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014331 s, 73.2 MB/s 2024-08-18T22:27:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202528 s, 51.8 MB/s 2024-08-18T22:27:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143031 s, 73.3 MB/s 2024-08-18T22:27:38.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.936 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141776 s, 74.0 MB/s 2024-08-18T22:27:38.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01413 s, 74.2 MB/s 2024-08-18T22:27:38.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155147 s, 67.6 MB/s 2024-08-18T22:27:38.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:38.988 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140769 s, 74.5 MB/s 2024-08-18T22:27:39.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151556 s, 69.2 MB/s 2024-08-18T22:27:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160106 s, 65.5 MB/s 2024-08-18T22:27:39.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.045 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176507 s, 59.4 MB/s 2024-08-18T22:27:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017858 s, 58.7 MB/s 2024-08-18T22:27:39.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.083 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146482 s, 71.6 MB/s 2024-08-18T22:27:39.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146523 s, 71.6 MB/s 2024-08-18T22:27:39.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:39.108 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:39.108 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:39.108 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.4 2024-08-18T22:27:39.108 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:39.108 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:39.108 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:39.108 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:39.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148553 s, 70.6 MB/s 2024-08-18T22:27:39.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.197 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160646 s, 65.3 MB/s 2024-08-18T22:27:39.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169848 s, 61.7 MB/s 2024-08-18T22:27:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.231 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119206 s, 88.0 MB/s 2024-08-18T22:27:39.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.251 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.251 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163711 s, 64.1 MB/s 2024-08-18T22:27:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160956 s, 65.1 MB/s 2024-08-18T22:27:39.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159422 s, 65.8 MB/s 2024-08-18T22:27:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163904 s, 64.0 MB/s 2024-08-18T22:27:39.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.326 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161787 s, 64.8 MB/s 2024-08-18T22:27:39.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207773 s, 50.5 MB/s 2024-08-18T22:27:39.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150309 s, 69.8 MB/s 2024-08-18T22:27:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152942 s, 68.6 MB/s 2024-08-18T22:27:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144653 s, 72.5 MB/s 2024-08-18T22:27:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165646 s, 63.3 MB/s 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146754 s, 71.5 MB/s 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164504 s, 63.7 MB/s 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201223 s, 52.1 MB/s 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188929 s, 55.5 MB/s 2024-08-18T22:27:39.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151701 s, 69.1 MB/s 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170361 s, 61.6 MB/s 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157479 s, 66.6 MB/s 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150189 s, 69.8 MB/s 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157287 s, 66.7 MB/s 2024-08-18T22:27:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248002 s, 42.3 MB/s 2024-08-18T22:27:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150571 s, 69.6 MB/s 2024-08-18T22:27:39.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165851 s, 63.2 MB/s 2024-08-18T22:27:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144921 s, 72.4 MB/s 2024-08-18T22:27:39.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142614 s, 73.5 MB/s 2024-08-18T22:27:39.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169973 s, 61.7 MB/s 2024-08-18T22:27:39.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176698 s, 59.3 MB/s 2024-08-18T22:27:39.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.761 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207302 s, 50.6 MB/s 2024-08-18T22:27:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177511 s, 59.1 MB/s 2024-08-18T22:27:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:39.790 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:39.790 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:39.790 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.5 2024-08-18T22:27:39.790 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:39.790 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:39.790 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:39.790 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:39.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144935 s, 72.3 MB/s 2024-08-18T22:27:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162141 s, 64.7 MB/s 2024-08-18T22:27:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169935 s, 61.7 MB/s 2024-08-18T22:27:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149278 s, 70.2 MB/s 2024-08-18T22:27:39.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.939 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167384 s, 62.6 MB/s 2024-08-18T22:27:39.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173836 s, 60.3 MB/s 2024-08-18T22:27:39.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.976 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151491 s, 69.2 MB/s 2024-08-18T22:27:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193643 s, 54.1 MB/s 2024-08-18T22:27:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016106 s, 65.1 MB/s 2024-08-18T22:27:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201031 s, 52.2 MB/s 2024-08-18T22:27:40.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173106 s, 60.6 MB/s 2024-08-18T22:27:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015342 s, 68.3 MB/s 2024-08-18T22:27:40.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.104 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237353 s, 44.2 MB/s 2024-08-18T22:27:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148158 s, 70.8 MB/s 2024-08-18T22:27:40.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154429 s, 67.9 MB/s 2024-08-18T22:27:40.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.162 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201138 s, 52.1 MB/s 2024-08-18T22:27:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149367 s, 70.2 MB/s 2024-08-18T22:27:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166476 s, 63.0 MB/s 2024-08-18T22:27:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162677 s, 64.5 MB/s 2024-08-18T22:27:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150249 s, 69.8 MB/s 2024-08-18T22:27:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149591 s, 70.1 MB/s 2024-08-18T22:27:40.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.277 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205646 s, 51.0 MB/s 2024-08-18T22:27:40.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.301 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214807 s, 48.8 MB/s 2024-08-18T22:27:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149061 s, 70.3 MB/s 2024-08-18T22:27:40.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.338 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170373 s, 61.5 MB/s 2024-08-18T22:27:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170008 s, 61.7 MB/s 2024-08-18T22:27:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219841 s, 47.7 MB/s 2024-08-18T22:27:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.403 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169287 s, 61.9 MB/s 2024-08-18T22:27:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157788 s, 66.5 MB/s 2024-08-18T22:27:40.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167898 s, 62.5 MB/s 2024-08-18T22:27:40.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.458 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150517 s, 69.7 MB/s 2024-08-18T22:27:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150185 s, 69.8 MB/s 2024-08-18T22:27:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:40.483 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:40.483 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:40.483 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.6 2024-08-18T22:27:40.483 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:40.483 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:40.483 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:40.483 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:40.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:40.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.556 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171741 s, 61.1 MB/s 2024-08-18T22:27:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185583 s, 56.5 MB/s 2024-08-18T22:27:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147842 s, 70.9 MB/s 2024-08-18T22:27:40.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.615 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170939 s, 61.3 MB/s 2024-08-18T22:27:40.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01509 s, 69.5 MB/s 2024-08-18T22:27:40.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235429 s, 44.5 MB/s 2024-08-18T22:27:40.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.677 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155865 s, 67.3 MB/s 2024-08-18T22:27:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143765 s, 72.9 MB/s 2024-08-18T22:27:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174377 s, 60.1 MB/s 2024-08-18T22:27:40.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.734 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169945 s, 61.7 MB/s 2024-08-18T22:27:40.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181247 s, 57.9 MB/s 2024-08-18T22:27:40.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.774 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163341 s, 64.2 MB/s 2024-08-18T22:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211884 s, 49.5 MB/s 2024-08-18T22:27:40.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144854 s, 72.4 MB/s 2024-08-18T22:27:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141415 s, 74.1 MB/s 2024-08-18T22:27:40.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154047 s, 68.1 MB/s 2024-08-18T22:27:40.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.872 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193393 s, 54.2 MB/s 2024-08-18T22:27:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149162 s, 70.3 MB/s 2024-08-18T22:27:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172679 s, 60.7 MB/s 2024-08-18T22:27:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148746 s, 70.5 MB/s 2024-08-18T22:27:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016993 s, 61.7 MB/s 2024-08-18T22:27:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212977 s, 49.2 MB/s 2024-08-18T22:27:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:40.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:40.991 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016729 s, 62.7 MB/s 2024-08-18T22:27:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189284 s, 55.4 MB/s 2024-08-18T22:27:41.029 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146492 s, 71.6 MB/s 2024-08-18T22:27:41.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.050 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174505 s, 60.1 MB/s 2024-08-18T22:27:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148491 s, 70.6 MB/s 2024-08-18T22:27:41.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.084 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140337 s, 74.7 MB/s 2024-08-18T22:27:41.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147205 s, 71.2 MB/s 2024-08-18T22:27:41.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183377 s, 57.2 MB/s 2024-08-18T22:27:41.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151929 s, 69.0 MB/s 2024-08-18T22:27:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144759 s, 72.4 MB/s 2024-08-18T22:27:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:41.165 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:41.165 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:41.165 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.7 2024-08-18T22:27:41.166 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:41.166 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:41.166 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:41.166 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:41.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116584 s, 89.9 MB/s 2024-08-18T22:27:41.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167708 s, 62.5 MB/s 2024-08-18T22:27:41.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.272 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174641 s, 60.0 MB/s 2024-08-18T22:27:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179065 s, 58.6 MB/s 2024-08-18T22:27:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146538 s, 71.6 MB/s 2024-08-18T22:27:41.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.329 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166552 s, 63.0 MB/s 2024-08-18T22:27:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155727 s, 67.3 MB/s 2024-08-18T22:27:41.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.366 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148994 s, 70.4 MB/s 2024-08-18T22:27:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151645 s, 69.1 MB/s 2024-08-18T22:27:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162357 s, 64.6 MB/s 2024-08-18T22:27:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021197 s, 49.5 MB/s 2024-08-18T22:27:41.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.444 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149993 s, 69.9 MB/s 2024-08-18T22:27:41.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199169 s, 52.6 MB/s 2024-08-18T22:27:41.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205656 s, 51.0 MB/s 2024-08-18T22:27:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.510 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173042 s, 60.6 MB/s 2024-08-18T22:27:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186711 s, 56.2 MB/s 2024-08-18T22:27:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014504 s, 72.3 MB/s 2024-08-18T22:27:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142934 s, 73.4 MB/s 2024-08-18T22:27:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155057 s, 67.6 MB/s 2024-08-18T22:27:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151892 s, 69.0 MB/s 2024-08-18T22:27:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193395 s, 54.2 MB/s 2024-08-18T22:27:41.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211739 s, 49.5 MB/s 2024-08-18T22:27:41.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174008 s, 60.3 MB/s 2024-08-18T22:27:41.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173309 s, 60.5 MB/s 2024-08-18T22:27:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148353 s, 70.7 MB/s 2024-08-18T22:27:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166663 s, 62.9 MB/s 2024-08-18T22:27:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203752 s, 51.5 MB/s 2024-08-18T22:27:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167489 s, 62.6 MB/s 2024-08-18T22:27:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148565 s, 70.6 MB/s 2024-08-18T22:27:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204104 s, 51.4 MB/s 2024-08-18T22:27:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.825 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138718 s, 75.6 MB/s 2024-08-18T22:27:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176738 s, 59.3 MB/s 2024-08-18T22:27:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:41.853 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:41.853 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:41.853 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.8 2024-08-18T22:27:41.853 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:41.853 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:41.853 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:41.853 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168021 s, 62.4 MB/s 2024-08-18T22:27:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161713 s, 64.8 MB/s 2024-08-18T22:27:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168252 s, 62.3 MB/s 2024-08-18T22:27:41.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150714 s, 69.6 MB/s 2024-08-18T22:27:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108852 s, 96.3 MB/s 2024-08-18T22:27:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014911 s, 70.3 MB/s 2024-08-18T22:27:42.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.030 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146102 s, 71.8 MB/s 2024-08-18T22:27:42.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.050 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176047 s, 59.6 MB/s 2024-08-18T22:27:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155013 s, 67.6 MB/s 2024-08-18T22:27:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147187 s, 71.2 MB/s 2024-08-18T22:27:42.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.106 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169705 s, 61.8 MB/s 2024-08-18T22:27:42.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169605 s, 61.8 MB/s 2024-08-18T22:27:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139724 s, 75.0 MB/s 2024-08-18T22:27:42.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.162 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173137 s, 60.6 MB/s 2024-08-18T22:27:42.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170632 s, 61.5 MB/s 2024-08-18T22:27:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.201 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015912 s, 65.9 MB/s 2024-08-18T22:27:42.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.218 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141817 s, 73.9 MB/s 2024-08-18T22:27:42.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.238 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174749 s, 60.0 MB/s 2024-08-18T22:27:42.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.255 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145586 s, 72.0 MB/s 2024-08-18T22:27:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150006 s, 69.9 MB/s 2024-08-18T22:27:42.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151305 s, 69.3 MB/s 2024-08-18T22:27:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150139 s, 69.8 MB/s 2024-08-18T22:27:42.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166353 s, 63.0 MB/s 2024-08-18T22:27:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208743 s, 50.2 MB/s 2024-08-18T22:27:42.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.369 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154951 s, 67.7 MB/s 2024-08-18T22:27:42.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165721 s, 63.3 MB/s 2024-08-18T22:27:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170986 s, 61.3 MB/s 2024-08-18T22:27:42.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.431 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199728 s, 52.5 MB/s 2024-08-18T22:27:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151616 s, 69.2 MB/s 2024-08-18T22:27:42.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.466 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148131 s, 70.8 MB/s 2024-08-18T22:27:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195019 s, 53.8 MB/s 2024-08-18T22:27:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172265 s, 60.9 MB/s 2024-08-18T22:27:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:42.516 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:42.516 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:42.516 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.9 2024-08-18T22:27:42.516 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:42.516 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:42.516 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:42.516 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:42.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150863 s, 69.5 MB/s 2024-08-18T22:27:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203685 s, 51.5 MB/s 2024-08-18T22:27:42.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.629 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162783 s, 64.4 MB/s 2024-08-18T22:27:42.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163095 s, 64.3 MB/s 2024-08-18T22:27:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149666 s, 70.1 MB/s 2024-08-18T22:27:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165446 s, 63.4 MB/s 2024-08-18T22:27:42.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.703 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147414 s, 71.1 MB/s 2024-08-18T22:27:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.726 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208638 s, 50.3 MB/s 2024-08-18T22:27:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147133 s, 71.3 MB/s 2024-08-18T22:27:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173843 s, 60.3 MB/s 2024-08-18T22:27:42.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170048 s, 61.7 MB/s 2024-08-18T22:27:42.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153751 s, 68.2 MB/s 2024-08-18T22:27:42.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.821 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167007 s, 62.8 MB/s 2024-08-18T22:27:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149445 s, 70.2 MB/s 2024-08-18T22:27:42.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.856 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142787 s, 73.4 MB/s 2024-08-18T22:27:42.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.881 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219701 s, 47.7 MB/s 2024-08-18T22:27:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.900 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166 s, 63.2 MB/s 2024-08-18T22:27:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218783 s, 47.9 MB/s 2024-08-18T22:27:42.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167569 s, 62.6 MB/s 2024-08-18T22:27:42.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166857 s, 62.8 MB/s 2024-08-18T22:27:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151756 s, 69.1 MB/s 2024-08-18T22:27:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206876 s, 50.7 MB/s 2024-08-18T22:27:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166074 s, 63.1 MB/s 2024-08-18T22:27:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158005 s, 66.4 MB/s 2024-08-18T22:27:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138848 s, 75.5 MB/s 2024-08-18T22:27:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164416 s, 63.8 MB/s 2024-08-18T22:27:43.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.095 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146596 s, 71.5 MB/s 2024-08-18T22:27:43.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162129 s, 64.7 MB/s 2024-08-18T22:27:43.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152809 s, 68.6 MB/s 2024-08-18T22:27:43.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148731 s, 70.5 MB/s 2024-08-18T22:27:43.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151282 s, 69.3 MB/s 2024-08-18T22:27:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014836 s, 70.7 MB/s 2024-08-18T22:27:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:43.193 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:43.194 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:43.194 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.10 2024-08-18T22:27:43.194 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:43.194 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:43.194 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:43.194 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:43.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174684 s, 60.0 MB/s 2024-08-18T22:27:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200608 s, 52.3 MB/s 2024-08-18T22:27:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157755 s, 66.5 MB/s 2024-08-18T22:27:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014869 s, 70.5 MB/s 2024-08-18T22:27:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195524 s, 53.6 MB/s 2024-08-18T22:27:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141575 s, 74.1 MB/s 2024-08-18T22:27:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.384 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167475 s, 62.6 MB/s 2024-08-18T22:27:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151143 s, 69.4 MB/s 2024-08-18T22:27:43.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.432 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274392 s, 38.2 MB/s 2024-08-18T22:27:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184184 s, 56.9 MB/s 2024-08-18T22:27:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137436 s, 76.3 MB/s 2024-08-18T22:27:43.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157652 s, 66.5 MB/s 2024-08-18T22:27:43.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.507 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154538 s, 67.9 MB/s 2024-08-18T22:27:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177973 s, 58.9 MB/s 2024-08-18T22:27:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122892 s, 85.3 MB/s 2024-08-18T22:27:43.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196663 s, 53.3 MB/s 2024-08-18T22:27:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143056 s, 73.3 MB/s 2024-08-18T22:27:43.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.601 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173393 s, 60.5 MB/s 2024-08-18T22:27:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.621 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169524 s, 61.9 MB/s 2024-08-18T22:27:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150384 s, 69.7 MB/s 2024-08-18T22:27:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149221 s, 70.3 MB/s 2024-08-18T22:27:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169651 s, 61.8 MB/s 2024-08-18T22:27:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012464 s, 84.1 MB/s 2024-08-18T22:27:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.713 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195239 s, 53.7 MB/s 2024-08-18T22:27:43.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169419 s, 61.9 MB/s 2024-08-18T22:27:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194474 s, 53.9 MB/s 2024-08-18T22:27:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166277 s, 63.1 MB/s 2024-08-18T22:27:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146413 s, 71.6 MB/s 2024-08-18T22:27:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147507 s, 71.1 MB/s 2024-08-18T22:27:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169173 s, 62.0 MB/s 2024-08-18T22:27:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015183 s, 69.1 MB/s 2024-08-18T22:27:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169434 s, 61.9 MB/s 2024-08-18T22:27:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:43.873 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:43.873 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:43.874 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.11 2024-08-18T22:27:43.874 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:43.874 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:43.874 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:43.874 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021179 s, 49.5 MB/s 2024-08-18T22:27:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145423 s, 72.1 MB/s 2024-08-18T22:27:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020288 s, 51.7 MB/s 2024-08-18T22:27:44.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.049 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166421 s, 63.0 MB/s 2024-08-18T22:27:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149575 s, 70.1 MB/s 2024-08-18T22:27:44.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.084 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144747 s, 72.4 MB/s 2024-08-18T22:27:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202197 s, 51.9 MB/s 2024-08-18T22:27:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196721 s, 53.3 MB/s 2024-08-18T22:27:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.147 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152275 s, 68.9 MB/s 2024-08-18T22:27:44.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.170 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201113 s, 52.1 MB/s 2024-08-18T22:27:44.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.188 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150153 s, 69.8 MB/s 2024-08-18T22:27:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024805 s, 42.3 MB/s 2024-08-18T22:27:44.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.232 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143576 s, 73.0 MB/s 2024-08-18T22:27:44.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146501 s, 71.6 MB/s 2024-08-18T22:27:44.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.269 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164081 s, 63.9 MB/s 2024-08-18T22:27:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150683 s, 69.6 MB/s 2024-08-18T22:27:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211654 s, 49.5 MB/s 2024-08-18T22:27:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.332 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018692 s, 56.1 MB/s 2024-08-18T22:27:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169352 s, 61.9 MB/s 2024-08-18T22:27:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119261 s, 87.9 MB/s 2024-08-18T22:27:44.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144127 s, 72.8 MB/s 2024-08-18T22:27:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144143 s, 72.7 MB/s 2024-08-18T22:27:44.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139084 s, 75.4 MB/s 2024-08-18T22:27:44.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.435 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014901 s, 70.4 MB/s 2024-08-18T22:27:44.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158539 s, 66.1 MB/s 2024-08-18T22:27:44.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.478 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214349 s, 48.9 MB/s 2024-08-18T22:27:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146198 s, 71.7 MB/s 2024-08-18T22:27:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210691 s, 49.8 MB/s 2024-08-18T22:27:44.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.539 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017425 s, 60.2 MB/s 2024-08-18T22:27:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190332 s, 55.1 MB/s 2024-08-18T22:27:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170114 s, 61.6 MB/s 2024-08-18T22:27:44.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024575 s, 42.7 MB/s 2024-08-18T22:27:44.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:44.615 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:44.615 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:44.615 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.12 2024-08-18T22:27:44.616 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:44.616 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:44.616 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:44.616 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153486 s, 68.3 MB/s 2024-08-18T22:27:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157698 s, 66.5 MB/s 2024-08-18T22:27:44.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.769 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172525 s, 60.8 MB/s 2024-08-18T22:27:44.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.790 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193131 s, 54.3 MB/s 2024-08-18T22:27:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.814 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195546 s, 53.6 MB/s 2024-08-18T22:27:44.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.833 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171513 s, 61.1 MB/s 2024-08-18T22:27:44.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.856 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198723 s, 52.8 MB/s 2024-08-18T22:27:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143492 s, 73.1 MB/s 2024-08-18T22:27:44.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.891 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145421 s, 72.1 MB/s 2024-08-18T22:27:44.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.911 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171378 s, 61.2 MB/s 2024-08-18T22:27:44.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.931 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169436 s, 61.9 MB/s 2024-08-18T22:27:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163414 s, 64.2 MB/s 2024-08-18T22:27:44.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242315 s, 43.3 MB/s 2024-08-18T22:27:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016136 s, 65.0 MB/s 2024-08-18T22:27:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143552 s, 73.0 MB/s 2024-08-18T22:27:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145644 s, 72.0 MB/s 2024-08-18T22:27:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139833 s, 75.0 MB/s 2024-08-18T22:27:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.065 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158585 s, 66.1 MB/s 2024-08-18T22:27:45.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.083 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150178 s, 69.8 MB/s 2024-08-18T22:27:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017445 s, 60.1 MB/s 2024-08-18T22:27:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151723 s, 69.1 MB/s 2024-08-18T22:27:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148285 s, 70.7 MB/s 2024-08-18T22:27:45.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.156 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149056 s, 70.3 MB/s 2024-08-18T22:27:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149785 s, 70.0 MB/s 2024-08-18T22:27:45.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219143 s, 47.8 MB/s 2024-08-18T22:27:45.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148473 s, 70.6 MB/s 2024-08-18T22:27:45.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.234 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150637 s, 69.6 MB/s 2024-08-18T22:27:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.257 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203019 s, 51.6 MB/s 2024-08-18T22:27:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156119 s, 67.2 MB/s 2024-08-18T22:27:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150782 s, 69.5 MB/s 2024-08-18T22:27:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152424 s, 68.8 MB/s 2024-08-18T22:27:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.329 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148198 s, 70.8 MB/s 2024-08-18T22:27:45.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:45.337 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:45.337 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:45.337 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.13 2024-08-18T22:27:45.337 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:45.337 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:45.337 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:45.337 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:45.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:45.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218564 s, 48.0 MB/s 2024-08-18T22:27:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141311 s, 74.2 MB/s 2024-08-18T22:27:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232573 s, 45.1 MB/s 2024-08-18T22:27:45.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.478 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166761 s, 62.9 MB/s 2024-08-18T22:27:45.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170928 s, 61.3 MB/s 2024-08-18T22:27:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014114 s, 74.3 MB/s 2024-08-18T22:27:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117801 s, 89.0 MB/s 2024-08-18T22:27:45.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165471 s, 63.4 MB/s 2024-08-18T22:27:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194441 s, 53.9 MB/s 2024-08-18T22:27:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156437 s, 67.0 MB/s 2024-08-18T22:27:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143651 s, 73.0 MB/s 2024-08-18T22:27:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168675 s, 62.2 MB/s 2024-08-18T22:27:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.644 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015837 s, 66.2 MB/s 2024-08-18T22:27:45.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148558 s, 70.6 MB/s 2024-08-18T22:27:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156351 s, 67.1 MB/s 2024-08-18T22:27:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198742 s, 52.8 MB/s 2024-08-18T22:27:45.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148036 s, 70.8 MB/s 2024-08-18T22:27:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148358 s, 70.7 MB/s 2024-08-18T22:27:45.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.757 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017118 s, 61.3 MB/s 2024-08-18T22:27:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.775 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149557 s, 70.1 MB/s 2024-08-18T22:27:45.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.793 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014822 s, 70.7 MB/s 2024-08-18T22:27:45.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172786 s, 60.7 MB/s 2024-08-18T22:27:45.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145055 s, 72.3 MB/s 2024-08-18T22:27:45.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.845 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120187 s, 87.2 MB/s 2024-08-18T22:27:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.863 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149025 s, 70.4 MB/s 2024-08-18T22:27:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.882 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156248 s, 67.1 MB/s 2024-08-18T22:27:45.899 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.899 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.900 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014567 s, 72.0 MB/s 2024-08-18T22:27:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168986 s, 62.1 MB/s 2024-08-18T22:27:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165015 s, 63.5 MB/s 2024-08-18T22:27:45.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209618 s, 50.0 MB/s 2024-08-18T22:27:45.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:45.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:45.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155269 s, 67.5 MB/s 2024-08-18T22:27:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016891 s, 62.1 MB/s 2024-08-18T22:27:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:46.009 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:46.009 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:46.009 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.14 2024-08-18T22:27:46.009 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:46.009 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:46.009 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:46.009 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:46.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:46.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204443 s, 51.3 MB/s 2024-08-18T22:27:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161149 s, 65.1 MB/s 2024-08-18T22:27:46.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.128 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211641 s, 49.5 MB/s 2024-08-18T22:27:46.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.146 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014768 s, 71.0 MB/s 2024-08-18T22:27:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249112 s, 42.1 MB/s 2024-08-18T22:27:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170084 s, 61.7 MB/s 2024-08-18T22:27:46.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.212 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143069 s, 73.3 MB/s 2024-08-18T22:27:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.231 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154132 s, 68.0 MB/s 2024-08-18T22:27:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.248 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144896 s, 72.4 MB/s 2024-08-18T22:27:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170478 s, 61.5 MB/s 2024-08-18T22:27:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166581 s, 62.9 MB/s 2024-08-18T22:27:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201172 s, 52.1 MB/s 2024-08-18T22:27:46.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166078 s, 63.1 MB/s 2024-08-18T22:27:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163801 s, 64.0 MB/s 2024-08-18T22:27:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204475 s, 51.3 MB/s 2024-08-18T22:27:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156443 s, 67.0 MB/s 2024-08-18T22:27:46.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.410 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148519 s, 70.6 MB/s 2024-08-18T22:27:46.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144391 s, 72.6 MB/s 2024-08-18T22:27:46.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145637 s, 72.0 MB/s 2024-08-18T22:27:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147397 s, 71.1 MB/s 2024-08-18T22:27:46.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.487 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208603 s, 50.3 MB/s 2024-08-18T22:27:46.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150525 s, 69.7 MB/s 2024-08-18T22:27:46.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.524 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167226 s, 62.7 MB/s 2024-08-18T22:27:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164461 s, 63.8 MB/s 2024-08-18T22:27:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144943 s, 72.3 MB/s 2024-08-18T22:27:46.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142051 s, 73.8 MB/s 2024-08-18T22:27:46.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.596 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156217 s, 67.1 MB/s 2024-08-18T22:27:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117648 s, 89.1 MB/s 2024-08-18T22:27:46.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151053 s, 69.4 MB/s 2024-08-18T22:27:46.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144295 s, 72.7 MB/s 2024-08-18T22:27:46.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169611 s, 61.8 MB/s 2024-08-18T22:27:46.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143803 s, 72.9 MB/s 2024-08-18T22:27:46.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:46.689 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:46.689 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:46.689 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.15 2024-08-18T22:27:46.689 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:46.689 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:46.689 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:46.689 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:46.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:46.800 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.800 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151791 s, 69.1 MB/s 2024-08-18T22:27:46.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151395 s, 69.3 MB/s 2024-08-18T22:27:46.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.841 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199266 s, 52.6 MB/s 2024-08-18T22:27:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.866 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215622 s, 48.6 MB/s 2024-08-18T22:27:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014641 s, 71.6 MB/s 2024-08-18T22:27:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167549 s, 62.6 MB/s 2024-08-18T22:27:46.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148813 s, 70.5 MB/s 2024-08-18T22:27:46.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203639 s, 51.5 MB/s 2024-08-18T22:27:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236197 s, 44.4 MB/s 2024-08-18T22:27:46.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:46.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:46.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168283 s, 62.3 MB/s 2024-08-18T22:27:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210247 s, 49.9 MB/s 2024-08-18T22:27:47.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195743 s, 53.6 MB/s 2024-08-18T22:27:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190574 s, 55.0 MB/s 2024-08-18T22:27:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.080 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197224 s, 53.2 MB/s 2024-08-18T22:27:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185107 s, 56.6 MB/s 2024-08-18T22:27:47.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.115 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115987 s, 90.4 MB/s 2024-08-18T22:27:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.136 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181817 s, 57.7 MB/s 2024-08-18T22:27:47.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.154 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145251 s, 72.2 MB/s 2024-08-18T22:27:47.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.173 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017024 s, 61.6 MB/s 2024-08-18T22:27:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01695 s, 61.9 MB/s 2024-08-18T22:27:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152323 s, 68.8 MB/s 2024-08-18T22:27:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198502 s, 52.8 MB/s 2024-08-18T22:27:47.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145515 s, 72.1 MB/s 2024-08-18T22:27:47.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.269 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157071 s, 66.8 MB/s 2024-08-18T22:27:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.287 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155666 s, 67.4 MB/s 2024-08-18T22:27:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176377 s, 59.5 MB/s 2024-08-18T22:27:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.332 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216548 s, 48.4 MB/s 2024-08-18T22:27:47.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163856 s, 64.0 MB/s 2024-08-18T22:27:47.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149681 s, 70.1 MB/s 2024-08-18T22:27:47.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.385 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141041 s, 74.3 MB/s 2024-08-18T22:27:47.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013892 s, 75.5 MB/s 2024-08-18T22:27:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162342 s, 64.6 MB/s 2024-08-18T22:27:47.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:47.428 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:47.428 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:47.428 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.16 2024-08-18T22:27:47.428 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:47.428 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:47.429 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:47.429 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:47.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207401 s, 50.6 MB/s 2024-08-18T22:27:47.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.523 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162921 s, 64.4 MB/s 2024-08-18T22:27:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.540 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143235 s, 73.2 MB/s 2024-08-18T22:27:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159477 s, 65.8 MB/s 2024-08-18T22:27:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.584 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219745 s, 47.7 MB/s 2024-08-18T22:27:47.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.601 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146523 s, 71.6 MB/s 2024-08-18T22:27:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155636 s, 67.4 MB/s 2024-08-18T22:27:47.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170164 s, 61.6 MB/s 2024-08-18T22:27:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012291 s, 85.3 MB/s 2024-08-18T22:27:47.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.671 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147845 s, 70.9 MB/s 2024-08-18T22:27:47.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146019 s, 71.8 MB/s 2024-08-18T22:27:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239551 s, 43.8 MB/s 2024-08-18T22:27:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.734 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156158 s, 67.1 MB/s 2024-08-18T22:27:47.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168022 s, 62.4 MB/s 2024-08-18T22:27:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.774 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179237 s, 58.5 MB/s 2024-08-18T22:27:47.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206248 s, 50.8 MB/s 2024-08-18T22:27:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143672 s, 73.0 MB/s 2024-08-18T22:27:47.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.836 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183645 s, 57.1 MB/s 2024-08-18T22:27:47.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141188 s, 74.3 MB/s 2024-08-18T22:27:47.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.870 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147619 s, 71.0 MB/s 2024-08-18T22:27:47.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.889 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165096 s, 63.5 MB/s 2024-08-18T22:27:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172914 s, 60.6 MB/s 2024-08-18T22:27:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014754 s, 71.1 MB/s 2024-08-18T22:27:47.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201437 s, 52.1 MB/s 2024-08-18T22:27:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170411 s, 61.5 MB/s 2024-08-18T22:27:47.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:47.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:47.988 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159871 s, 65.6 MB/s 2024-08-18T22:27:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168491 s, 62.2 MB/s 2024-08-18T22:27:48.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142203 s, 73.7 MB/s 2024-08-18T22:27:48.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.044 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172297 s, 60.9 MB/s 2024-08-18T22:27:48.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.061 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014132 s, 74.2 MB/s 2024-08-18T22:27:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154973 s, 67.7 MB/s 2024-08-18T22:27:48.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161174 s, 65.1 MB/s 2024-08-18T22:27:48.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:48.106 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:48.106 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:48.106 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.17 2024-08-18T22:27:48.106 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:48.106 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:48.106 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:48.106 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150589 s, 69.6 MB/s 2024-08-18T22:27:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191631 s, 54.7 MB/s 2024-08-18T22:27:48.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.216 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147677 s, 71.0 MB/s 2024-08-18T22:27:48.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.236 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178725 s, 58.7 MB/s 2024-08-18T22:27:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.254 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149829 s, 70.0 MB/s 2024-08-18T22:27:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153109 s, 68.5 MB/s 2024-08-18T22:27:48.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.290 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152712 s, 68.7 MB/s 2024-08-18T22:27:48.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017085 s, 61.4 MB/s 2024-08-18T22:27:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170579 s, 61.5 MB/s 2024-08-18T22:27:48.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201439 s, 52.1 MB/s 2024-08-18T22:27:48.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150849 s, 69.5 MB/s 2024-08-18T22:27:48.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.389 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160334 s, 65.4 MB/s 2024-08-18T22:27:48.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.407 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152965 s, 68.6 MB/s 2024-08-18T22:27:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154435 s, 67.9 MB/s 2024-08-18T22:27:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149042 s, 70.4 MB/s 2024-08-18T22:27:48.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.462 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168415 s, 62.3 MB/s 2024-08-18T22:27:48.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.480 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146944 s, 71.4 MB/s 2024-08-18T22:27:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.497 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139249 s, 75.3 MB/s 2024-08-18T22:27:48.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.515 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145702 s, 72.0 MB/s 2024-08-18T22:27:48.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181211 s, 57.9 MB/s 2024-08-18T22:27:48.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174591 s, 60.1 MB/s 2024-08-18T22:27:48.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170706 s, 61.4 MB/s 2024-08-18T22:27:48.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.595 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017274 s, 60.7 MB/s 2024-08-18T22:27:48.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.613 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147893 s, 70.9 MB/s 2024-08-18T22:27:48.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152049 s, 69.0 MB/s 2024-08-18T22:27:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.651 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179167 s, 58.5 MB/s 2024-08-18T22:27:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147279 s, 71.2 MB/s 2024-08-18T22:27:48.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.686 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146097 s, 71.8 MB/s 2024-08-18T22:27:48.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169894 s, 61.7 MB/s 2024-08-18T22:27:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.725 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166952 s, 62.8 MB/s 2024-08-18T22:27:48.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160726 s, 65.2 MB/s 2024-08-18T22:27:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163053 s, 64.3 MB/s 2024-08-18T22:27:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:48.770 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:48.770 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:48.770 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.18 2024-08-18T22:27:48.771 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:48.771 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:48.771 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:48.771 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167773 s, 62.5 MB/s 2024-08-18T22:27:48.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162638 s, 64.5 MB/s 2024-08-18T22:27:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153783 s, 68.2 MB/s 2024-08-18T22:27:48.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146223 s, 71.7 MB/s 2024-08-18T22:27:48.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.960 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171254 s, 61.2 MB/s 2024-08-18T22:27:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145733 s, 72.0 MB/s 2024-08-18T22:27:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:48.997 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177326 s, 59.1 MB/s 2024-08-18T22:27:49.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.025 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242439 s, 43.3 MB/s 2024-08-18T22:27:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01444 s, 72.6 MB/s 2024-08-18T22:27:49.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015328 s, 68.4 MB/s 2024-08-18T22:27:49.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.084 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207819 s, 50.5 MB/s 2024-08-18T22:27:49.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144068 s, 72.8 MB/s 2024-08-18T22:27:49.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.120 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01657 s, 63.3 MB/s 2024-08-18T22:27:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.138 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149715 s, 70.0 MB/s 2024-08-18T22:27:49.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.155 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138888 s, 75.5 MB/s 2024-08-18T22:27:49.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159767 s, 65.6 MB/s 2024-08-18T22:27:49.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.197 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211935 s, 49.5 MB/s 2024-08-18T22:27:49.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143507 s, 73.1 MB/s 2024-08-18T22:27:49.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.232 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144535 s, 72.5 MB/s 2024-08-18T22:27:49.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160586 s, 65.3 MB/s 2024-08-18T22:27:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154456 s, 67.9 MB/s 2024-08-18T22:27:49.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152378 s, 68.8 MB/s 2024-08-18T22:27:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.304 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150286 s, 69.8 MB/s 2024-08-18T22:27:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.321 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141954 s, 73.9 MB/s 2024-08-18T22:27:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155911 s, 67.3 MB/s 2024-08-18T22:27:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246405 s, 42.6 MB/s 2024-08-18T22:27:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153762 s, 68.2 MB/s 2024-08-18T22:27:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201168 s, 52.1 MB/s 2024-08-18T22:27:49.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146459 s, 71.6 MB/s 2024-08-18T22:27:49.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171552 s, 61.1 MB/s 2024-08-18T22:27:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158686 s, 66.1 MB/s 2024-08-18T22:27:49.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145068 s, 72.3 MB/s 2024-08-18T22:27:49.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:49.490 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:49.490 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:49.490 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.19 2024-08-18T22:27:49.490 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:49.490 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:49.490 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:49.491 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:49.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167447 s, 62.6 MB/s 2024-08-18T22:27:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157736 s, 66.5 MB/s 2024-08-18T22:27:49.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.644 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175391 s, 59.8 MB/s 2024-08-18T22:27:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168361 s, 62.3 MB/s 2024-08-18T22:27:49.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.681 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143596 s, 73.0 MB/s 2024-08-18T22:27:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016635 s, 63.0 MB/s 2024-08-18T22:27:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.728 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246611 s, 42.5 MB/s 2024-08-18T22:27:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169643 s, 61.8 MB/s 2024-08-18T22:27:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014457 s, 72.5 MB/s 2024-08-18T22:27:49.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213391 s, 49.1 MB/s 2024-08-18T22:27:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200602 s, 52.3 MB/s 2024-08-18T22:27:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194506 s, 53.9 MB/s 2024-08-18T22:27:49.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.852 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01497 s, 70.0 MB/s 2024-08-18T22:27:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.869 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146559 s, 71.5 MB/s 2024-08-18T22:27:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020419 s, 51.4 MB/s 2024-08-18T22:27:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188509 s, 55.6 MB/s 2024-08-18T22:27:49.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.940 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232868 s, 45.0 MB/s 2024-08-18T22:27:49.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164663 s, 63.7 MB/s 2024-08-18T22:27:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014253 s, 73.6 MB/s 2024-08-18T22:27:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:49.991 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105204 s, 99.7 MB/s 2024-08-18T22:27:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.008 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141814 s, 73.9 MB/s 2024-08-18T22:27:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156194 s, 67.1 MB/s 2024-08-18T22:27:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.045 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153107 s, 68.5 MB/s 2024-08-18T22:27:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199494 s, 52.6 MB/s 2024-08-18T22:27:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170257 s, 61.6 MB/s 2024-08-18T22:27:50.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.106 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141915 s, 73.9 MB/s 2024-08-18T22:27:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147841 s, 70.9 MB/s 2024-08-18T22:27:50.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158665 s, 66.1 MB/s 2024-08-18T22:27:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166585 s, 62.9 MB/s 2024-08-18T22:27:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.181 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149748 s, 70.0 MB/s 2024-08-18T22:27:50.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153605 s, 68.3 MB/s 2024-08-18T22:27:50.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150371 s, 69.7 MB/s 2024-08-18T22:27:50.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:50.224 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:50.225 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:50.225 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.20 2024-08-18T22:27:50.225 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:50.225 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:50.225 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:50.225 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:50.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161428 s, 65.0 MB/s 2024-08-18T22:27:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.362 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222962 s, 47.0 MB/s 2024-08-18T22:27:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155561 s, 67.4 MB/s 2024-08-18T22:27:50.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208995 s, 50.2 MB/s 2024-08-18T22:27:50.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.426 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177486 s, 59.1 MB/s 2024-08-18T22:27:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159278 s, 65.8 MB/s 2024-08-18T22:27:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200527 s, 52.3 MB/s 2024-08-18T22:27:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154168 s, 68.0 MB/s 2024-08-18T22:27:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.505 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151013 s, 69.4 MB/s 2024-08-18T22:27:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175773 s, 59.7 MB/s 2024-08-18T22:27:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.543 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144209 s, 72.7 MB/s 2024-08-18T22:27:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148874 s, 70.4 MB/s 2024-08-18T22:27:50.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163579 s, 64.1 MB/s 2024-08-18T22:27:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.604 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203444 s, 51.5 MB/s 2024-08-18T22:27:50.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.624 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160557 s, 65.3 MB/s 2024-08-18T22:27:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168723 s, 62.1 MB/s 2024-08-18T22:27:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01667 s, 62.9 MB/s 2024-08-18T22:27:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167036 s, 62.8 MB/s 2024-08-18T22:27:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145822 s, 71.9 MB/s 2024-08-18T22:27:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148283 s, 70.7 MB/s 2024-08-18T22:27:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215329 s, 48.7 MB/s 2024-08-18T22:27:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017313 s, 60.6 MB/s 2024-08-18T22:27:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165683 s, 63.3 MB/s 2024-08-18T22:27:50.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.803 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155052 s, 67.6 MB/s 2024-08-18T22:27:50.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151869 s, 69.0 MB/s 2024-08-18T22:27:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148685 s, 70.5 MB/s 2024-08-18T22:27:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148778 s, 70.5 MB/s 2024-08-18T22:27:50.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147153 s, 71.3 MB/s 2024-08-18T22:27:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168774 s, 62.1 MB/s 2024-08-18T22:27:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158491 s, 66.2 MB/s 2024-08-18T22:27:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236755 s, 44.3 MB/s 2024-08-18T22:27:50.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:50.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:50.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146727 s, 71.5 MB/s 2024-08-18T22:27:50.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:50.966 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:50.967 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:50.967 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.21 2024-08-18T22:27:50.967 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:50.967 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:50.967 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:50.967 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161697 s, 64.8 MB/s 2024-08-18T22:27:51.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.061 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198221 s, 52.9 MB/s 2024-08-18T22:27:51.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177757 s, 59.0 MB/s 2024-08-18T22:27:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145925 s, 71.9 MB/s 2024-08-18T22:27:51.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.119 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150218 s, 69.8 MB/s 2024-08-18T22:27:51.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.137 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152999 s, 68.5 MB/s 2024-08-18T22:27:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.164 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02396 s, 43.8 MB/s 2024-08-18T22:27:51.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.183 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016507 s, 63.5 MB/s 2024-08-18T22:27:51.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.201 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148876 s, 70.4 MB/s 2024-08-18T22:27:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210144 s, 49.9 MB/s 2024-08-18T22:27:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168193 s, 62.3 MB/s 2024-08-18T22:27:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144247 s, 72.7 MB/s 2024-08-18T22:27:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147217 s, 71.2 MB/s 2024-08-18T22:27:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213139 s, 49.2 MB/s 2024-08-18T22:27:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223718 s, 46.9 MB/s 2024-08-18T22:27:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151983 s, 69.0 MB/s 2024-08-18T22:27:51.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142642 s, 73.5 MB/s 2024-08-18T22:27:51.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144954 s, 72.3 MB/s 2024-08-18T22:27:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.401 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144878 s, 72.4 MB/s 2024-08-18T22:27:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119698 s, 87.6 MB/s 2024-08-18T22:27:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211185 s, 49.7 MB/s 2024-08-18T22:27:51.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174775 s, 60.0 MB/s 2024-08-18T22:27:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168722 s, 62.1 MB/s 2024-08-18T22:27:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.503 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196314 s, 53.4 MB/s 2024-08-18T22:27:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239906 s, 43.7 MB/s 2024-08-18T22:27:51.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.548 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148389 s, 70.7 MB/s 2024-08-18T22:27:51.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147202 s, 71.2 MB/s 2024-08-18T22:27:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016645 s, 63.0 MB/s 2024-08-18T22:27:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147415 s, 71.1 MB/s 2024-08-18T22:27:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150309 s, 69.8 MB/s 2024-08-18T22:27:51.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.643 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019112 s, 54.9 MB/s 2024-08-18T22:27:51.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158563 s, 66.1 MB/s 2024-08-18T22:27:51.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:51.668 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:51.668 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:51.668 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.22 2024-08-18T22:27:51.668 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:51.668 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:51.668 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:51.669 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:51.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175018 s, 59.9 MB/s 2024-08-18T22:27:51.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148989 s, 70.4 MB/s 2024-08-18T22:27:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.777 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153616 s, 68.3 MB/s 2024-08-18T22:27:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166878 s, 62.8 MB/s 2024-08-18T22:27:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145594 s, 72.0 MB/s 2024-08-18T22:27:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.832 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152981 s, 68.5 MB/s 2024-08-18T22:27:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014714 s, 71.3 MB/s 2024-08-18T22:27:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169978 s, 61.7 MB/s 2024-08-18T22:27:51.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.887 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148711 s, 70.5 MB/s 2024-08-18T22:27:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.906 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016941 s, 61.9 MB/s 2024-08-18T22:27:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165225 s, 63.5 MB/s 2024-08-18T22:27:51.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155336 s, 67.5 MB/s 2024-08-18T22:27:51.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147081 s, 71.3 MB/s 2024-08-18T22:27:51.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.979 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150925 s, 69.5 MB/s 2024-08-18T22:27:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143375 s, 73.1 MB/s 2024-08-18T22:27:52.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148865 s, 70.4 MB/s 2024-08-18T22:27:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145837 s, 71.9 MB/s 2024-08-18T22:27:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.048 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144038 s, 72.8 MB/s 2024-08-18T22:27:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213896 s, 49.0 MB/s 2024-08-18T22:27:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145647 s, 72.0 MB/s 2024-08-18T22:27:52.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.109 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167184 s, 62.7 MB/s 2024-08-18T22:27:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149884 s, 70.0 MB/s 2024-08-18T22:27:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148251 s, 70.7 MB/s 2024-08-18T22:27:52.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.164 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171727 s, 61.1 MB/s 2024-08-18T22:27:52.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.181 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143927 s, 72.9 MB/s 2024-08-18T22:27:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150455 s, 69.7 MB/s 2024-08-18T22:27:52.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.216 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147517 s, 71.1 MB/s 2024-08-18T22:27:52.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.239 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203986 s, 51.4 MB/s 2024-08-18T22:27:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167478 s, 62.6 MB/s 2024-08-18T22:27:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168257 s, 62.3 MB/s 2024-08-18T22:27:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208826 s, 50.2 MB/s 2024-08-18T22:27:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014975 s, 70.0 MB/s 2024-08-18T22:27:52.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:52.327 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:52.327 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:52.327 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.23 2024-08-18T22:27:52.327 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:52.327 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:52.327 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:52.327 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:52.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.396 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147522 s, 71.1 MB/s 2024-08-18T22:27:52.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175817 s, 59.6 MB/s 2024-08-18T22:27:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212785 s, 49.3 MB/s 2024-08-18T22:27:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166659 s, 62.9 MB/s 2024-08-18T22:27:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165029 s, 63.5 MB/s 2024-08-18T22:27:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014805 s, 70.8 MB/s 2024-08-18T22:27:52.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167386 s, 62.6 MB/s 2024-08-18T22:27:52.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148464 s, 70.6 MB/s 2024-08-18T22:27:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165725 s, 63.3 MB/s 2024-08-18T22:27:52.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.572 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155896 s, 67.3 MB/s 2024-08-18T22:27:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146745 s, 71.5 MB/s 2024-08-18T22:27:52.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142851 s, 73.4 MB/s 2024-08-18T22:27:52.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157338 s, 66.6 MB/s 2024-08-18T22:27:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171379 s, 61.2 MB/s 2024-08-18T22:27:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017757 s, 59.1 MB/s 2024-08-18T22:27:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207359 s, 50.6 MB/s 2024-08-18T22:27:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.708 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153902 s, 68.1 MB/s 2024-08-18T22:27:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145567 s, 72.0 MB/s 2024-08-18T22:27:52.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.742 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150715 s, 69.6 MB/s 2024-08-18T22:27:52.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.763 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151041 s, 69.4 MB/s 2024-08-18T22:27:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147017 s, 71.3 MB/s 2024-08-18T22:27:52.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143533 s, 73.1 MB/s 2024-08-18T22:27:52.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.813 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145813 s, 71.9 MB/s 2024-08-18T22:27:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.835 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196416 s, 53.4 MB/s 2024-08-18T22:27:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148107 s, 70.8 MB/s 2024-08-18T22:27:52.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.875 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019696 s, 53.2 MB/s 2024-08-18T22:27:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170455 s, 61.5 MB/s 2024-08-18T22:27:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157449 s, 66.6 MB/s 2024-08-18T22:27:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166045 s, 63.2 MB/s 2024-08-18T22:27:52.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237033 s, 44.2 MB/s 2024-08-18T22:27:52.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.978 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166529 s, 63.0 MB/s 2024-08-18T22:27:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152868 s, 68.6 MB/s 2024-08-18T22:27:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:53.003 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:53.003 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:53.003 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.24 2024-08-18T22:27:53.004 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:53.004 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:53.004 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:53.004 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.074 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151193 s, 69.4 MB/s 2024-08-18T22:27:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207039 s, 50.6 MB/s 2024-08-18T22:27:53.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170971 s, 61.3 MB/s 2024-08-18T22:27:53.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202656 s, 51.7 MB/s 2024-08-18T22:27:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218983 s, 47.9 MB/s 2024-08-18T22:27:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.183 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156314 s, 67.1 MB/s 2024-08-18T22:27:53.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143594 s, 73.0 MB/s 2024-08-18T22:27:53.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01413 s, 74.2 MB/s 2024-08-18T22:27:53.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220325 s, 47.6 MB/s 2024-08-18T22:27:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.262 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174652 s, 60.0 MB/s 2024-08-18T22:27:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148011 s, 70.8 MB/s 2024-08-18T22:27:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171989 s, 61.0 MB/s 2024-08-18T22:27:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174181 s, 60.2 MB/s 2024-08-18T22:27:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208012 s, 50.4 MB/s 2024-08-18T22:27:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173106 s, 60.6 MB/s 2024-08-18T22:27:53.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151589 s, 69.2 MB/s 2024-08-18T22:27:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148766 s, 70.5 MB/s 2024-08-18T22:27:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158713 s, 66.1 MB/s 2024-08-18T22:27:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016452 s, 63.7 MB/s 2024-08-18T22:27:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145163 s, 72.2 MB/s 2024-08-18T22:27:53.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148797 s, 70.5 MB/s 2024-08-18T22:27:53.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:27:53.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.492 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172836 s, 60.7 MB/s 2024-08-18T22:27:53.494 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:27:53.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.515 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211485 s, 49.6 MB/s 2024-08-18T22:27:53.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150126 s, 69.8 MB/s 2024-08-18T22:27:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.556 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214398 s, 48.9 MB/s 2024-08-18T22:27:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158515 s, 66.1 MB/s 2024-08-18T22:27:53.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.592 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143338 s, 73.2 MB/s 2024-08-18T22:27:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166735 s, 62.9 MB/s 2024-08-18T22:27:53.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.629 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152432 s, 68.8 MB/s 2024-08-18T22:27:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161393 s, 65.0 MB/s 2024-08-18T22:27:53.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166864 s, 62.8 MB/s 2024-08-18T22:27:53.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143899 s, 72.9 MB/s 2024-08-18T22:27:53.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:53.692 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:53.692 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:53.692 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.25 2024-08-18T22:27:53.692 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:53.693 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:53.693 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:53.693 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:53.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.808 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148565 s, 70.6 MB/s 2024-08-18T22:27:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177602 s, 59.0 MB/s 2024-08-18T22:27:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188872 s, 55.5 MB/s 2024-08-18T22:27:53.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.869 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163965 s, 64.0 MB/s 2024-08-18T22:27:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163123 s, 64.3 MB/s 2024-08-18T22:27:53.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.907 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170675 s, 61.4 MB/s 2024-08-18T22:27:53.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.927 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168353 s, 62.3 MB/s 2024-08-18T22:27:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144821 s, 72.4 MB/s 2024-08-18T22:27:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177126 s, 59.2 MB/s 2024-08-18T22:27:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:53.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152435 s, 68.8 MB/s 2024-08-18T22:27:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167219 s, 62.7 MB/s 2024-08-18T22:27:54.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146994 s, 71.3 MB/s 2024-08-18T22:27:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165142 s, 63.5 MB/s 2024-08-18T22:27:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150612 s, 69.6 MB/s 2024-08-18T22:27:54.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014304 s, 73.3 MB/s 2024-08-18T22:27:54.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017499 s, 59.9 MB/s 2024-08-18T22:27:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213854 s, 49.0 MB/s 2024-08-18T22:27:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161772 s, 64.8 MB/s 2024-08-18T22:27:54.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.154 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146908 s, 71.4 MB/s 2024-08-18T22:27:54.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150432 s, 69.7 MB/s 2024-08-18T22:27:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146948 s, 71.4 MB/s 2024-08-18T22:27:54.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.207 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151232 s, 69.3 MB/s 2024-08-18T22:27:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014397 s, 72.8 MB/s 2024-08-18T22:27:54.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.244 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169627 s, 61.8 MB/s 2024-08-18T22:27:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.261 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014187 s, 73.9 MB/s 2024-08-18T22:27:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015889 s, 66.0 MB/s 2024-08-18T22:27:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148024 s, 70.8 MB/s 2024-08-18T22:27:54.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.318 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177663 s, 59.0 MB/s 2024-08-18T22:27:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166243 s, 63.1 MB/s 2024-08-18T22:27:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145984 s, 71.8 MB/s 2024-08-18T22:27:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151694 s, 69.1 MB/s 2024-08-18T22:27:54.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.395 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208008 s, 50.4 MB/s 2024-08-18T22:27:54.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:54.402 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:54.402 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:54.403 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.26 2024-08-18T22:27:54.403 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:54.403 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:54.403 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:54.403 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:54.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:54.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.473 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015028 s, 69.8 MB/s 2024-08-18T22:27:54.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.491 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150962 s, 69.5 MB/s 2024-08-18T22:27:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144942 s, 72.3 MB/s 2024-08-18T22:27:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020806 s, 50.4 MB/s 2024-08-18T22:27:54.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151508 s, 69.2 MB/s 2024-08-18T22:27:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207843 s, 50.5 MB/s 2024-08-18T22:27:54.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174233 s, 60.2 MB/s 2024-08-18T22:27:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199004 s, 52.7 MB/s 2024-08-18T22:27:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.637 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186574 s, 56.2 MB/s 2024-08-18T22:27:54.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216423 s, 48.5 MB/s 2024-08-18T22:27:54.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178582 s, 58.7 MB/s 2024-08-18T22:27:54.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.700 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151347 s, 69.3 MB/s 2024-08-18T22:27:54.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.724 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211978 s, 49.5 MB/s 2024-08-18T22:27:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154537 s, 67.9 MB/s 2024-08-18T22:27:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159593 s, 65.7 MB/s 2024-08-18T22:27:54.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.785 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212904 s, 49.3 MB/s 2024-08-18T22:27:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.804 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165699 s, 63.3 MB/s 2024-08-18T22:27:54.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.822 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151507 s, 69.2 MB/s 2024-08-18T22:27:54.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153702 s, 68.2 MB/s 2024-08-18T22:27:54.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154134 s, 68.0 MB/s 2024-08-18T22:27:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165224 s, 63.5 MB/s 2024-08-18T22:27:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151191 s, 69.4 MB/s 2024-08-18T22:27:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168362 s, 62.3 MB/s 2024-08-18T22:27:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154792 s, 67.7 MB/s 2024-08-18T22:27:54.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228222 s, 45.9 MB/s 2024-08-18T22:27:54.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:54.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:54.980 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163522 s, 64.1 MB/s 2024-08-18T22:27:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.003 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198083 s, 52.9 MB/s 2024-08-18T22:27:55.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.021 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145793 s, 71.9 MB/s 2024-08-18T22:27:55.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.038 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146796 s, 71.4 MB/s 2024-08-18T22:27:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239842 s, 43.7 MB/s 2024-08-18T22:27:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170966 s, 61.3 MB/s 2024-08-18T22:27:55.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.105 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160724 s, 65.2 MB/s 2024-08-18T22:27:55.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:55.112 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:55.112 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:55.112 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.27 2024-08-18T22:27:55.113 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:55.113 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:55.113 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:55.113 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:55.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:55.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178965 s, 58.6 MB/s 2024-08-18T22:27:55.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.206 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01659 s, 63.2 MB/s 2024-08-18T22:27:55.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.225 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015547 s, 67.4 MB/s 2024-08-18T22:27:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154451 s, 67.9 MB/s 2024-08-18T22:27:55.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.269 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219262 s, 47.8 MB/s 2024-08-18T22:27:55.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.289 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173677 s, 60.4 MB/s 2024-08-18T22:27:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165107 s, 63.5 MB/s 2024-08-18T22:27:55.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159542 s, 65.7 MB/s 2024-08-18T22:27:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148727 s, 70.5 MB/s 2024-08-18T22:27:55.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240212 s, 43.7 MB/s 2024-08-18T22:27:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170759 s, 61.4 MB/s 2024-08-18T22:27:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014762 s, 71.0 MB/s 2024-08-18T22:27:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169984 s, 61.7 MB/s 2024-08-18T22:27:55.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150167 s, 69.8 MB/s 2024-08-18T22:27:55.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147778 s, 71.0 MB/s 2024-08-18T22:27:55.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204117 s, 51.4 MB/s 2024-08-18T22:27:55.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.508 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144097 s, 72.8 MB/s 2024-08-18T22:27:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173199 s, 60.5 MB/s 2024-08-18T22:27:55.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173636 s, 60.4 MB/s 2024-08-18T22:27:55.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.568 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154009 s, 68.1 MB/s 2024-08-18T22:27:55.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.585 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150561 s, 69.6 MB/s 2024-08-18T22:27:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143885 s, 72.9 MB/s 2024-08-18T22:27:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.624 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189458 s, 55.3 MB/s 2024-08-18T22:27:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149285 s, 70.2 MB/s 2024-08-18T22:27:55.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241776 s, 43.4 MB/s 2024-08-18T22:27:55.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.686 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143359 s, 73.1 MB/s 2024-08-18T22:27:55.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.703 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149845 s, 70.0 MB/s 2024-08-18T22:27:55.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168259 s, 62.3 MB/s 2024-08-18T22:27:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.741 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150047 s, 69.9 MB/s 2024-08-18T22:27:55.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168735 s, 62.1 MB/s 2024-08-18T22:27:55.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.779 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153056 s, 68.5 MB/s 2024-08-18T22:27:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015202 s, 69.0 MB/s 2024-08-18T22:27:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:55.804 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:55.804 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:55.805 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.28 2024-08-18T22:27:55.805 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:55.805 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:55.805 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:55.805 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:55.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:55.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.875 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148748 s, 70.5 MB/s 2024-08-18T22:27:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.894 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168902 s, 62.1 MB/s 2024-08-18T22:27:55.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228974 s, 45.8 MB/s 2024-08-18T22:27:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147229 s, 71.2 MB/s 2024-08-18T22:27:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141945 s, 73.9 MB/s 2024-08-18T22:27:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146447 s, 71.6 MB/s 2024-08-18T22:27:55.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:55.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:55.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148204 s, 70.8 MB/s 2024-08-18T22:27:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177075 s, 59.2 MB/s 2024-08-18T22:27:56.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.026 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143092 s, 73.3 MB/s 2024-08-18T22:27:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.043 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144681 s, 72.5 MB/s 2024-08-18T22:27:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.062 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155551 s, 67.4 MB/s 2024-08-18T22:27:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014604 s, 71.8 MB/s 2024-08-18T22:27:56.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.099 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172936 s, 60.6 MB/s 2024-08-18T22:27:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144987 s, 72.3 MB/s 2024-08-18T22:27:56.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147114 s, 71.3 MB/s 2024-08-18T22:27:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139598 s, 75.1 MB/s 2024-08-18T22:27:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141247 s, 74.2 MB/s 2024-08-18T22:27:56.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.189 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181024 s, 57.9 MB/s 2024-08-18T22:27:56.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151984 s, 69.0 MB/s 2024-08-18T22:27:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176535 s, 59.4 MB/s 2024-08-18T22:27:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167726 s, 62.5 MB/s 2024-08-18T22:27:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206857 s, 50.7 MB/s 2024-08-18T22:27:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169404 s, 61.9 MB/s 2024-08-18T22:27:56.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151135 s, 69.4 MB/s 2024-08-18T22:27:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207189 s, 50.6 MB/s 2024-08-18T22:27:56.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.350 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166963 s, 62.8 MB/s 2024-08-18T22:27:56.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196509 s, 53.4 MB/s 2024-08-18T22:27:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.395 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199603 s, 52.5 MB/s 2024-08-18T22:27:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169386 s, 61.9 MB/s 2024-08-18T22:27:56.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.434 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172046 s, 60.9 MB/s 2024-08-18T22:27:56.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.452 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152918 s, 68.6 MB/s 2024-08-18T22:27:56.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.470 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152063 s, 69.0 MB/s 2024-08-18T22:27:56.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:56.478 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:56.478 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:56.478 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.29 2024-08-18T22:27:56.478 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:56.478 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:56.478 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:56.478 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:56.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:56.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.550 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170117 s, 61.6 MB/s 2024-08-18T22:27:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.573 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206551 s, 50.8 MB/s 2024-08-18T22:27:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123599 s, 84.8 MB/s 2024-08-18T22:27:56.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143657 s, 73.0 MB/s 2024-08-18T22:27:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210187 s, 49.9 MB/s 2024-08-18T22:27:56.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151665 s, 69.1 MB/s 2024-08-18T22:27:56.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144136 s, 72.7 MB/s 2024-08-18T22:27:56.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014823 s, 70.7 MB/s 2024-08-18T22:27:56.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163365 s, 64.2 MB/s 2024-08-18T22:27:56.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152641 s, 68.7 MB/s 2024-08-18T22:27:56.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148622 s, 70.6 MB/s 2024-08-18T22:27:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141523 s, 74.1 MB/s 2024-08-18T22:27:56.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142188 s, 73.7 MB/s 2024-08-18T22:27:56.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145906 s, 71.9 MB/s 2024-08-18T22:27:56.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.813 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210398 s, 49.8 MB/s 2024-08-18T22:27:56.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014908 s, 70.3 MB/s 2024-08-18T22:27:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146279 s, 71.7 MB/s 2024-08-18T22:27:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.874 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240716 s, 43.6 MB/s 2024-08-18T22:27:56.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.891 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143827 s, 72.9 MB/s 2024-08-18T22:27:56.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151376 s, 69.3 MB/s 2024-08-18T22:27:56.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143159 s, 73.2 MB/s 2024-08-18T22:27:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143009 s, 73.3 MB/s 2024-08-18T22:27:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148523 s, 70.6 MB/s 2024-08-18T22:27:56.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145621 s, 72.0 MB/s 2024-08-18T22:27:56.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:56.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:56.994 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135381 s, 77.5 MB/s 2024-08-18T22:27:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196166 s, 53.5 MB/s 2024-08-18T22:27:57.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.033 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143025 s, 73.3 MB/s 2024-08-18T22:27:57.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.050 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144829 s, 72.4 MB/s 2024-08-18T22:27:57.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.069 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167045 s, 62.8 MB/s 2024-08-18T22:27:57.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.088 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159875 s, 65.6 MB/s 2024-08-18T22:27:57.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.105 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149857 s, 70.0 MB/s 2024-08-18T22:27:57.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143784 s, 72.9 MB/s 2024-08-18T22:27:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:57.130 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:57.130 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:57.130 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.30 2024-08-18T22:27:57.130 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:57.131 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:57.131 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:57.131 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:57.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.211 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242736 s, 43.2 MB/s 2024-08-18T22:27:57.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198672 s, 52.8 MB/s 2024-08-18T22:27:57.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.258 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217653 s, 48.2 MB/s 2024-08-18T22:27:57.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.276 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155776 s, 67.3 MB/s 2024-08-18T22:27:57.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015532 s, 67.5 MB/s 2024-08-18T22:27:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.317 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208219 s, 50.4 MB/s 2024-08-18T22:27:57.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.335 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148022 s, 70.8 MB/s 2024-08-18T22:27:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202138 s, 51.9 MB/s 2024-08-18T22:27:57.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.376 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152125 s, 68.9 MB/s 2024-08-18T22:27:57.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.393 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147317 s, 71.2 MB/s 2024-08-18T22:27:57.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148107 s, 70.8 MB/s 2024-08-18T22:27:57.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.431 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177101 s, 59.2 MB/s 2024-08-18T22:27:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152122 s, 68.9 MB/s 2024-08-18T22:27:57.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.468 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016191 s, 64.8 MB/s 2024-08-18T22:27:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211106 s, 49.7 MB/s 2024-08-18T22:27:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191544 s, 54.7 MB/s 2024-08-18T22:27:57.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.531 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147564 s, 71.1 MB/s 2024-08-18T22:27:57.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.548 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141254 s, 74.2 MB/s 2024-08-18T22:27:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015589 s, 67.3 MB/s 2024-08-18T22:27:57.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.583 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143191 s, 73.2 MB/s 2024-08-18T22:27:57.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193877 s, 54.1 MB/s 2024-08-18T22:27:57.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144359 s, 72.6 MB/s 2024-08-18T22:27:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175198 s, 59.9 MB/s 2024-08-18T22:27:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235263 s, 44.6 MB/s 2024-08-18T22:27:57.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167214 s, 62.7 MB/s 2024-08-18T22:27:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153909 s, 68.1 MB/s 2024-08-18T22:27:57.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.726 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169994 s, 61.7 MB/s 2024-08-18T22:27:57.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141096 s, 74.3 MB/s 2024-08-18T22:27:57.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128999 s, 81.3 MB/s 2024-08-18T22:27:57.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.775 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143755 s, 72.9 MB/s 2024-08-18T22:27:57.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168067 s, 62.4 MB/s 2024-08-18T22:27:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152554 s, 68.7 MB/s 2024-08-18T22:27:57.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:57.820 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:27:57.820 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:27:57.820 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.31 2024-08-18T22:27:57.820 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:27:57.820 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:27:57.820 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:27:57.820 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:27:57.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:27:57.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.891 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156188 s, 67.1 MB/s 2024-08-18T22:27:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.909 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161748 s, 64.8 MB/s 2024-08-18T22:27:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014867 s, 70.5 MB/s 2024-08-18T22:27:57.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143889 s, 72.9 MB/s 2024-08-18T22:27:57.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.969 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216456 s, 48.4 MB/s 2024-08-18T22:27:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:57.986 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147834 s, 70.9 MB/s 2024-08-18T22:27:58.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016223 s, 64.6 MB/s 2024-08-18T22:27:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015898 s, 66.0 MB/s 2024-08-18T22:27:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238584 s, 44.0 MB/s 2024-08-18T22:27:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.069 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161076 s, 65.1 MB/s 2024-08-18T22:27:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164202 s, 63.9 MB/s 2024-08-18T22:27:58.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.105 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147882 s, 70.9 MB/s 2024-08-18T22:27:58.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142565 s, 73.6 MB/s 2024-08-18T22:27:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146051 s, 71.8 MB/s 2024-08-18T22:27:58.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014636 s, 71.6 MB/s 2024-08-18T22:27:58.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147184 s, 71.2 MB/s 2024-08-18T22:27:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176765 s, 59.3 MB/s 2024-08-18T22:27:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.211 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140387 s, 74.7 MB/s 2024-08-18T22:27:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210671 s, 49.8 MB/s 2024-08-18T22:27:58.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.254 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157622 s, 66.5 MB/s 2024-08-18T22:27:58.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.273 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162338 s, 64.6 MB/s 2024-08-18T22:27:58.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154448 s, 67.9 MB/s 2024-08-18T22:27:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020394 s, 51.4 MB/s 2024-08-18T22:27:58.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.332 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148931 s, 70.4 MB/s 2024-08-18T22:27:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.351 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169633 s, 61.8 MB/s 2024-08-18T22:27:58.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139571 s, 75.1 MB/s 2024-08-18T22:27:58.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202515 s, 51.8 MB/s 2024-08-18T22:27:58.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.410 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167249 s, 62.7 MB/s 2024-08-18T22:27:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150965 s, 69.5 MB/s 2024-08-18T22:27:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142118 s, 73.8 MB/s 2024-08-18T22:27:58.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154551 s, 67.8 MB/s 2024-08-18T22:27:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:27:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:27:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015446 s, 67.9 MB/s 2024-08-18T22:27:58.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:27:58.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:58.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-08-18T22:27:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.631+0000 7fdd66600640 1 Processor -- start 2024-08-18T22:27:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd66600640 1 -- start start 2024-08-18T22:27:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd66600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd600ccaa0 0x7fdd600cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd66600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd6015d1d0 0x7fdd600cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd66600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6006ec70 con 0x7fdd600cdf10 2024-08-18T22:27:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd66600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdd600cfe90 con 0x7fdd600ccaa0 2024-08-18T22:27:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd66600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd600b37e0 con 0x7fdd6015d1d0 2024-08-18T22:27:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd5f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd600ccaa0 0x7fdd600cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd5f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd600ccaa0 0x7fdd600cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55630/0 (socket says 172.21.15.5:55630) 2024-08-18T22:27:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd5f400640 1 -- 172.21.15.5:0/1662192208 learned_addr learned my addr 172.21.15.5:0/1662192208 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd56a00640 1 --2- 172.21.15.5:0/1662192208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd6015d1d0 0x7fdd600cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd5f400640 1 -- 172.21.15.5:0/1662192208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd6015d1d0 msgr2=0x7fdd600cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd5f400640 1 --2- 172.21.15.5:0/1662192208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd6015d1d0 0x7fdd600cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd5f400640 1 -- 172.21.15.5:0/1662192208 >> v1:172.21.15.117:6789/0 conn(0x7fdd600cdf10 legacy=0x7fdd600ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.635+0000 7fdd5f400640 1 -- 172.21.15.5:0/1662192208 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd600b3260 con 0x7fdd600ccaa0 2024-08-18T22:27:58.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd5f400640 1 --2- 172.21.15.5:0/1662192208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd600ccaa0 0x7fdd600cf760 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009870 tx=0x7fdd5001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c47af825b88e1e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd5ea00640 1 -- 172.21.15.5:0/1662192208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd500b0070 con 0x7fdd600ccaa0 2024-08-18T22:27:58.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd5ea00640 1 -- 172.21.15.5:0/1662192208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd500ab600 con 0x7fdd600ccaa0 2024-08-18T22:27:58.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd5ea00640 1 -- 172.21.15.5:0/1662192208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd500ab9d0 con 0x7fdd600ccaa0 2024-08-18T22:27:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd66600640 1 -- 172.21.15.5:0/1662192208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd600ccaa0 msgr2=0x7fdd600cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd66600640 1 --2- 172.21.15.5:0/1662192208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd600ccaa0 0x7fdd600cf760 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009870 tx=0x7fdd5001c4d0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd66600640 1 -- 172.21.15.5:0/1662192208 shutdown_connections 2024-08-18T22:27:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd66600640 1 --2- 172.21.15.5:0/1662192208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd6015d1d0 0x7fdd600cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd66600640 1 --2- 172.21.15.5:0/1662192208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd600ccaa0 0x7fdd600cf760 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd66600640 1 -- 172.21.15.5:0/1662192208 >> 172.21.15.5:0/1662192208 conn(0x7fdd6006b9b0 msgr2=0x7fdd6006bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd66600640 1 -- 172.21.15.5:0/1662192208 shutdown_connections 2024-08-18T22:27:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd66600640 1 -- 172.21.15.5:0/1662192208 wait complete. 2024-08-18T22:27:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd66600640 1 Processor -- start 2024-08-18T22:27:58.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.639+0000 7fdd66600640 1 -- start start 2024-08-18T22:27:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd66600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd600ccaa0 0x7fdd60154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd66600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd600cdf10 0x7fdd60151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd66600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6015d1d0 0x7fdd6015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd66600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdd60156a10 con 0x7fdd6015d1d0 2024-08-18T22:27:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd66600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdd600afa50 con 0x7fdd600ccaa0 2024-08-18T22:27:58.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd66600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd60156b90 con 0x7fdd600cdf10 2024-08-18T22:27:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd5fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6015d1d0 0x7fdd6015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd5f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd600ccaa0 0x7fdd60154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd5fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6015d1d0 0x7fdd6015ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55644/0 (socket says 172.21.15.5:55644) 2024-08-18T22:27:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd5fe00640 1 -- 172.21.15.5:0/2882528117 learned_addr learned my addr 172.21.15.5:0/2882528117 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd56a00640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd600cdf10 0x7fdd60151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd5fe00640 1 -- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd600cdf10 msgr2=0x7fdd60151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd600cdf10 0x7fdd60151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd5fe00640 1 -- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd600ccaa0 msgr2=0x7fdd60154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd600ccaa0 0x7fdd60154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd5fe00640 1 -- 172.21.15.5:0/2882528117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6015f3e0 con 0x7fdd6015d1d0 2024-08-18T22:27:58.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd5f400640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd600ccaa0 0x7fdd60154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6015d1d0 0x7fdd6015ab80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c760 tx=0x7fdd5800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd57e00640 1 -- 172.21.15.5:0/2882528117 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58003b80 con 0x7fdd6015d1d0 2024-08-18T22:27:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd57e00640 1 -- 172.21.15.5:0/2882528117 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd58003d20 con 0x7fdd6015d1d0 2024-08-18T22:27:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd57e00640 1 -- 172.21.15.5:0/2882528117 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800aa30 con 0x7fdd6015d1d0 2024-08-18T22:27:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd66600640 1 -- 172.21.15.5:0/2882528117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6015f6c0 con 0x7fdd6015d1d0 2024-08-18T22:27:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd66600640 1 -- 172.21.15.5:0/2882528117 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6015a380 con 0x7fdd6015d1d0 2024-08-18T22:27:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.643+0000 7fdd57e00640 1 -- 172.21.15.5:0/2882528117 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdd5800abd0 con 0x7fdd6015d1d0 2024-08-18T22:27:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd57e00640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd3c0678c0 0x7fdd3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd57e00640 1 -- 172.21.15.5:0/2882528117 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fdd58085b60 con 0x7fdd6015d1d0 2024-08-18T22:27:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd5f400640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd3c0678c0 0x7fdd3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 Processor -- start 2024-08-18T22:27:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 -- start start 2024-08-18T22:27:58.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd5f400640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd3c0678c0 0x7fdd3c069d80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdd500ad000 tx=0x7fdd500a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562792032000 0x5627920323e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562791fe8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 0x562791fe9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562791e36340 con 0x562792032920 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562791df0ba0 con 0x562791fe90b0 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562791e32300 con 0x562792032000 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd56a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562791fe8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd5f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562792032000 0x5627920323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd56a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562791fe8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55652/0 (socket says 172.21.15.5:55652) 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd56a00640 1 -- 172.21.15.5:0/3265967035 learned_addr learned my addr 172.21.15.5:0/3265967035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/3265967035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 0x562791fe9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd56a00640 1 -- 172.21.15.5:0/3265967035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562792032000 msgr2=0x5627920323e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd56a00640 1 --2- 172.21.15.5:0/3265967035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562792032000 0x5627920323e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd56a00640 1 -- 172.21.15.5:0/3265967035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 msgr2=0x562791fe9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd56a00640 1 --2- 172.21.15.5:0/3265967035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 0x562791fe9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd56a00640 1 -- 172.21.15.5:0/3265967035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562791ee2a30 con 0x562792032920 2024-08-18T22:27:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd56a00640 1 --2- 172.21.15.5:0/3265967035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562791fe8b70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009b10 tx=0x7fdd480112c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e4d5a2f779ec51 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd4fe00640 1 -- 172.21.15.5:0/3265967035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48011d90 con 0x562792032920 2024-08-18T22:27:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd4fe00640 1 -- 172.21.15.5:0/3265967035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd48004030 con 0x562792032920 2024-08-18T22:27:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd4fe00640 1 -- 172.21.15.5:0/3265967035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48004420 con 0x562792032920 2024-08-18T22:27:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3265967035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 msgr2=0x562791fe8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/3265967035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562791fe8b70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009b10 tx=0x7fdd480112c0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3265967035 shutdown_connections 2024-08-18T22:27:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/3265967035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 0x562791fe9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/3265967035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562791fe8b70 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/3265967035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562792032000 0x5627920323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.647+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3265967035 >> 172.21.15.5:0/3265967035 conn(0x562791fe5030 msgr2=0x562791fe7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3265967035 shutdown_connections 2024-08-18T22:27:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3265967035 wait complete. 2024-08-18T22:27:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 -- start start 2024-08-18T22:27:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 Processor -- start 2024-08-18T22:27:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562791fe90b0 0x562792031950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x562791ff4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562792032920 0x562791ff4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562791e3a970 con 0x562792032000 2024-08-18T22:27:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562791dd7c00 con 0x562792032920 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562791de1f80 con 0x562791fe90b0 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 10 client.0 _ll_register_callbacks cb 0x562791fd3af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd56a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x562791ff4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd56a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x562791ff4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55662/0 (socket says 172.21.15.5:55662) 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd56a00640 1 -- 172.21.15.5:0/3061136008 learned_addr learned my addr 172.21.15.5:0/3061136008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562792032920 0x562791ff4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd5f400640 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562791fe90b0 0x562792031950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd56a00640 1 -- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562791fe90b0 msgr2=0x562792031950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd56a00640 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562791fe90b0 0x562792031950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd56a00640 1 -- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562792032920 msgr2=0x562791ff4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd56a00640 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562792032920 0x562791ff4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd56a00640 1 -- 172.21.15.5:0/3061136008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562791ede9e0 con 0x562792032000 2024-08-18T22:27:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562792032920 0x562791ff4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd56a00640 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x562791ff4010 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fdd48000c10 tx=0x7fdd48004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769f44f64a55d4ad server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd4cc00640 1 -- 172.21.15.5:0/3061136008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48004530 con 0x562792032000 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3061136008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd48004030 con 0x562792032000 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd4cc00640 1 -- 172.21.15.5:0/3061136008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fdd48003830 con 0x562792032000 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd4cc00640 1 -- 172.21.15.5:0/3061136008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fdd48032050 con 0x562792032000 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 10 client.8349 fetch_fsmap learned FSMap version 100 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3061136008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x562791e10520 con 0x562792032000 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd4cc00640 1 -- 172.21.15.5:0/3061136008 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd48004030 con 0x562792032000 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd4cc00640 1 -- 172.21.15.5:0/3061136008 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7fdd48035020 con 0x562792032000 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 10 client.8349 fetch_fsmap finished waiting for FSMap version 100 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 10 client.8349 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 20 client.8349 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x562791ff5290 0x5627920442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 4 client.8349 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:27:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.651+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3061136008 --> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562791ecee30 con 0x562791ff5290 2024-08-18T22:27:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd5f400640 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x562791ff5290 0x5627920442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd5f400640 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x562791ff5290 0x5627920442c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=491463c28ef2af48 server_cookie=d0939e47d4af893 in_seq=0 out_seq=0 2024-08-18T22:27:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd4cc00640 10 client.8349 ms_handle_connect on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd4cc00640 1 -- 172.21.15.5:0/3061136008 <== mds.0 v2:172.21.15.117:6835/2108480966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562791ecee30 con 0x562791ff5290 2024-08-18T22:27:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd4cc00640 10 client.8349 handle_command_reply: tid=0 2024-08-18T22:27:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 1 client.8349 shutdown 2024-08-18T22:27:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3061136008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 msgr2=0x562791ff4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x562791ff4010 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fdd48000c10 tx=0x7fdd48004740 comp rx=0 tx=0).stop 2024-08-18T22:27:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3061136008 shutdown_connections 2024-08-18T22:27:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x562791ff5290 0x5627920442c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562792032920 0x562791ff4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x562791ff4010 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/3061136008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562791fe90b0 0x562792031950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd4cc00640 0 client.8349 ms_handle_reset on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3061136008 >> 172.21.15.5:0/3061136008 conn(0x562791fe5030 msgr2=0x562791fe7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3061136008 shutdown_connections 2024-08-18T22:27:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 1 -- 172.21.15.5:0/3061136008 wait complete. 2024-08-18T22:27:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.655+0000 7fdd69a3a000 20 client.8349 trim_cache size 0 max 16384 2024-08-18T22:27:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 Processor -- start 2024-08-18T22:27:58.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 -- start start 2024-08-18T22:27:58.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562791fe90b0 0x562791fe8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562792032000 0x562791fe8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562792047500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdd60203380 con 0x562792032920 2024-08-18T22:27:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6015c420 con 0x562792032000 2024-08-18T22:27:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdd60202d30 con 0x562791fe90b0 2024-08-18T22:27:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd5fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562792047500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd5fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562792047500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55672/0 (socket says 172.21.15.5:55672) 2024-08-18T22:27:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd5fe00640 1 -- 172.21.15.5:0/2734987891 learned_addr learned my addr 172.21.15.5:0/2734987891 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd5f400640 1 --2- 172.21.15.5:0/2734987891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562791fe90b0 0x562791fe8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd56a00640 1 --2- 172.21.15.5:0/2734987891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562792032000 0x562791fe8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd5fe00640 1 -- 172.21.15.5:0/2734987891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562791fe90b0 msgr2=0x562791fe8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/2734987891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562791fe90b0 0x562791fe8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd5fe00640 1 -- 172.21.15.5:0/2734987891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562792032000 msgr2=0x562791fe8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/2734987891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562792032000 0x562791fe8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd5fe00640 1 -- 172.21.15.5:0/2734987891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562791e8f2f0 con 0x562792032920 2024-08-18T22:27:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/2734987891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562792047500 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800a430 tx=0x7fdd58005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedbd876cb54dc13 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd4f400640 1 -- 172.21.15.5:0/2734987891 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58081070 con 0x562792032920 2024-08-18T22:27:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd4f400640 1 -- 172.21.15.5:0/2734987891 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5805e9e0 con 0x562792032920 2024-08-18T22:27:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd4f400640 1 -- 172.21.15.5:0/2734987891 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58052520 con 0x562792032920 2024-08-18T22:27:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 -- 172.21.15.5:0/2734987891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 msgr2=0x562792047500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/2734987891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562792047500 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800a430 tx=0x7fdd58005040 comp rx=0 tx=0).stop 2024-08-18T22:27:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 -- 172.21.15.5:0/2734987891 shutdown_connections 2024-08-18T22:27:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/2734987891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032920 0x562792047500 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/2734987891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562792032000 0x562791fe8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/2734987891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562791fe90b0 0x562791fe8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 -- 172.21.15.5:0/2734987891 >> 172.21.15.5:0/2734987891 conn(0x562791fe5030 msgr2=0x562791ff37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 -- 172.21.15.5:0/2734987891 shutdown_connections 2024-08-18T22:27:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 -- 172.21.15.5:0/2734987891 wait complete. 2024-08-18T22:27:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.675+0000 7fdd69a3a000 1 -- start start 2024-08-18T22:27:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 1 Processor -- start 2024-08-18T22:27:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 0x562792046c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x5627920625b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562792032920 0x562792062af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562791dd2340 con 0x562792032000 2024-08-18T22:27:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562791e00fb0 con 0x562791fe90b0 2024-08-18T22:27:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x562791dbb8f0 con 0x562792032920 2024-08-18T22:27:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 10 client.0 _ll_register_callbacks cb 0x7fdd5800ce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd56a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x5627920625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd5f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 0x562792046c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd56a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x5627920625b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55686/0 (socket says 172.21.15.5:55686) 2024-08-18T22:27:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd56a00640 1 -- 172.21.15.5:0/573186736 learned_addr learned my addr 172.21.15.5:0/573186736 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd5f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 0x562792046c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:60546/0 (socket says 172.21.15.5:60546) 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562792032920 0x562792062af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd5f400640 1 -- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562792032920 msgr2=0x562792062af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd5f400640 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562792032920 0x562792062af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd5f400640 1 -- 172.21.15.5:0/573186736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 msgr2=0x5627920625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd5f400640 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x5627920625b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd5f400640 1 -- 172.21.15.5:0/573186736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562791dd29d0 con 0x562791fe90b0 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd56a00640 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x5627920625b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd5fe00640 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562792032920 0x562792062af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd5f400640 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 0x562792046c40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdd500ab000 tx=0x7fdd500046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6d13aa0897e7052 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd4cc00640 1 -- 172.21.15.5:0/573186736 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd500b0040 con 0x562791fe90b0 2024-08-18T22:27:58.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd4cc00640 1 -- 172.21.15.5:0/573186736 <== mon.1 v2:172.21.15.117:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fdd500b5900 con 0x562791fe90b0 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 1 -- 172.21.15.5:0/573186736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd5805e9e0 con 0x562791fe90b0 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd4cc00640 1 -- 172.21.15.5:0/573186736 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fdd500d7050 con 0x562791fe90b0 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 10 client.7714 fetch_fsmap learned FSMap version 100 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 1 -- 172.21.15.5:0/573186736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x562791af11a0 con 0x562791fe90b0 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd4cc00640 1 -- 172.21.15.5:0/573186736 <== mon.1 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5805e9e0 con 0x562791fe90b0 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd4cc00640 1 -- 172.21.15.5:0/573186736 <== mon.1 v2:172.21.15.117:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7fdd500da020 con 0x562791fe90b0 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 10 client.7714 fetch_fsmap finished waiting for FSMap version 100 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 10 client.7714 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 20 client.7714 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x562792063030 0x5627920a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 4 client.7714 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd69a3a000 1 -- 172.21.15.5:0/573186736 --> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x562791dd0bd0 con 0x562792063030 2024-08-18T22:27:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.679+0000 7fdd56a00640 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x562792063030 0x5627920a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd56a00640 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x562792063030 0x5627920a5e00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=368b50910e834c0 server_cookie=4c448f51a12976e3 in_seq=0 out_seq=0 2024-08-18T22:27:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd4cc00640 10 client.7714 ms_handle_connect on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd4cc00640 1 -- 172.21.15.5:0/573186736 <== mds.0 v2:172.21.15.117:6835/2108480966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562791dd0bd0 con 0x562792063030 2024-08-18T22:27:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd4cc00640 10 client.7714 handle_command_reply: tid=0 2024-08-18T22:27:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 1 client.7714 shutdown 2024-08-18T22:27:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 1 -- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 msgr2=0x562792046c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 0x562792046c40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdd500ab000 tx=0x7fdd500046d0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 1 -- 172.21.15.5:0/573186736 shutdown_connections 2024-08-18T22:27:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x562792063030 0x5627920a5e00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562792032920 0x562792062af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562792032000 0x5627920625b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 1 --2- 172.21.15.5:0/573186736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562791fe90b0 0x562792046c40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd4cc00640 0 client.7714 ms_handle_reset on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 1 -- 172.21.15.5:0/573186736 >> 172.21.15.5:0/573186736 conn(0x562791fe5030 msgr2=0x562791fe8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 1 -- 172.21.15.5:0/573186736 shutdown_connections 2024-08-18T22:27:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 1 -- 172.21.15.5:0/573186736 wait complete. 2024-08-18T22:27:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd69a3a000 20 client.7714 trim_cache size 0 max 16384 2024-08-18T22:27:58.687 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:27:58.687 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:27:58.687 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "06e86f15-82fe-4df4-80dc-696a144a1e00", 2024-08-18T22:27:58.688 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:27:58.688 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:27:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 -- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd3c0678c0 msgr2=0x7fdd3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd3c0678c0 0x7fdd3c069d80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdd500ad000 tx=0x7fdd500a6000 comp rx=0 tx=0).stop 2024-08-18T22:27:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 -- 172.21.15.5:0/2882528117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6015d1d0 msgr2=0x7fdd6015ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6015d1d0 0x7fdd6015ab80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c760 tx=0x7fdd5800cc20 comp rx=0 tx=0).stop 2024-08-18T22:27:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 -- 172.21.15.5:0/2882528117 shutdown_connections 2024-08-18T22:27:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdd3c0678c0 0x7fdd3c069d80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd6015d1d0 0x7fdd6015ab80 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd600cdf10 0x7fdd60151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 --2- 172.21.15.5:0/2882528117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd600ccaa0 0x7fdd60154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 -- 172.21.15.5:0/2882528117 >> 172.21.15.5:0/2882528117 conn(0x7fdd6006b9b0 msgr2=0x7fdd600b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 -- 172.21.15.5:0/2882528117 shutdown_connections 2024-08-18T22:27:58.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.683+0000 7fdd66600640 1 -- 172.21.15.5:0/2882528117 wait complete. 2024-08-18T22:27:58.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:27:58.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-08-18T22:27:58.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f9400640 1 Processor -- start 2024-08-18T22:27:58.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f9400640 1 -- start start 2024-08-18T22:27:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f9400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f40d1090 0x7f04f40d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f9400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f40d30b0 con 0x7f04f40b5ad0 2024-08-18T22:27:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f9400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f40d1bd0 con 0x7f04f415fb80 2024-08-18T22:27:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f9400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04f4071c60 con 0x7f04f40d1090 2024-08-18T22:27:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f3200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f04f40b5ad0 0x7f04f4071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34138/0 (socket says 172.21.15.5:34138) 2024-08-18T22:27:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f3200640 1 -- 172.21.15.5:0/381120319 learned_addr learned my addr 172.21.15.5:0/381120319 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f1e00640 1 --2- 172.21.15.5:0/381120319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f40d1090 0x7f04f40d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f1400640 1 -- 172.21.15.5:0/381120319 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650849228 0 0) 0x7f04f40d30b0 con 0x7f04f40b5ad0 2024-08-18T22:27:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f1400640 1 -- 172.21.15.5:0/381120319 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04d8003530 con 0x7f04f40b5ad0 2024-08-18T22:27:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f1400640 1 -- 172.21.15.5:0/381120319 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3443278240 0 0) 0x7f04f40d1bd0 con 0x7f04f415fb80 2024-08-18T22:27:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f1400640 1 -- 172.21.15.5:0/381120319 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04f40d30b0 con 0x7f04f415fb80 2024-08-18T22:27:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f1e00640 1 -- 172.21.15.5:0/381120319 >> v1:172.21.15.117:6789/0 conn(0x7f04f415fb80 legacy=0x7f04f406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f1e00640 1 -- 172.21.15.5:0/381120319 >> v1:172.21.15.5:6789/0 conn(0x7f04f40b5ad0 legacy=0x7f04f4071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.863+0000 7f04f1e00640 1 -- 172.21.15.5:0/381120319 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f40d2dd0 con 0x7f04f40d1090 2024-08-18T22:27:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.867+0000 7f04f1e00640 1 --2- 172.21.15.5:0/381120319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f40d1090 0x7f04f40d15e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04e00097f0 tx=0x7f04e001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfeb4eace34a170f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.867+0000 7f04f1400640 1 -- 172.21.15.5:0/381120319 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e00b0070 con 0x7f04f40d1090 2024-08-18T22:27:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.867+0000 7f04f1400640 1 -- 172.21.15.5:0/381120319 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e00a4e50 con 0x7f04f40d1090 2024-08-18T22:27:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.867+0000 7f04f1400640 1 -- 172.21.15.5:0/381120319 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e00ab800 con 0x7f04f40d1090 2024-08-18T22:27:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.867+0000 7f04f9400640 1 -- 172.21.15.5:0/381120319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f40d1090 msgr2=0x7f04f40d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.867+0000 7f04f9400640 1 --2- 172.21.15.5:0/381120319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f40d1090 0x7f04f40d15e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04e00097f0 tx=0x7f04e001c3c0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.867+0000 7f04f9400640 1 -- 172.21.15.5:0/381120319 shutdown_connections 2024-08-18T22:27:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.867+0000 7f04f9400640 1 --2- 172.21.15.5:0/381120319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f40d1090 0x7f04f40d15e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.867+0000 7f04f9400640 1 -- 172.21.15.5:0/381120319 >> 172.21.15.5:0/381120319 conn(0x7f04f40d2180 msgr2=0x7f04f40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.867+0000 7f04f9400640 1 -- 172.21.15.5:0/381120319 shutdown_connections 2024-08-18T22:27:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.867+0000 7f04f9400640 1 -- 172.21.15.5:0/381120319 wait complete. 2024-08-18T22:27:58.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f9400640 1 Processor -- start 2024-08-18T22:27:58.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f9400640 1 -- start start 2024-08-18T22:27:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f9400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f40b5ad0 0x7f04f414c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f9400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d1090 0x7f04f406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f415fb80 0x7f04f406d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f9400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f04f416a310 con 0x7f04f415fb80 2024-08-18T22:27:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f9400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f04f40d1eb0 con 0x7f04f40d1090 2024-08-18T22:27:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f9400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04f416a490 con 0x7f04f40b5ad0 2024-08-18T22:27:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f415fb80 0x7f04f406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f415fb80 0x7f04f406d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55688/0 (socket says 172.21.15.5:55688) 2024-08-18T22:27:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f3200640 1 -- 172.21.15.5:0/1406692497 learned_addr learned my addr 172.21.15.5:0/1406692497 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f2800640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f40b5ad0 0x7f04f414c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f1e00640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d1090 0x7f04f406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f3200640 1 -- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f40b5ad0 msgr2=0x7f04f414c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f3200640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f40b5ad0 0x7f04f414c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f3200640 1 -- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d1090 msgr2=0x7f04f406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f3200640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d1090 0x7f04f406cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f3200640 1 -- 172.21.15.5:0/1406692497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f414cd20 con 0x7f04f415fb80 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f1e00640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d1090 0x7f04f406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f3200640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f415fb80 0x7f04f406d000 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c480 tx=0x7f04ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04eaa00640 1 -- 172.21.15.5:0/1406692497 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec017070 con 0x7f04f415fb80 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04eaa00640 1 -- 172.21.15.5:0/1406692497 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ec005db0 con 0x7f04f415fb80 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f9400640 1 -- 172.21.15.5:0/1406692497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f40ccee0 con 0x7f04f415fb80 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04eaa00640 1 -- 172.21.15.5:0/1406692497 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec007290 con 0x7f04f415fb80 2024-08-18T22:27:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.871+0000 7f04f9400640 1 -- 172.21.15.5:0/1406692497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f4154c00 con 0x7f04f415fb80 2024-08-18T22:27:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04eaa00640 1 -- 172.21.15.5:0/1406692497 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04ec01a070 con 0x7f04f415fb80 2024-08-18T22:27:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04eaa00640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04d40678c0 0x7f04d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04eaa00640 1 -- 172.21.15.5:0/1406692497 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f04ec0851d0 con 0x7f04f415fb80 2024-08-18T22:27:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04f2800640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04d40678c0 0x7f04d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04fc86f000 1 Processor -- start 2024-08-18T22:27:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04fc86f000 1 -- start start 2024-08-18T22:27:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04f2800640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04d40678c0 0x7f04d4069d80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f04f40d0b40 tx=0x7f04e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc21f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc21f890 0x558bcc1d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1d2b70 0x558bcc1d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04fc86f000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558bcc023470 con 0x558bcc21ef70 2024-08-18T22:27:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04fc86f000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558bcbfddad0 con 0x558bcc21f890 2024-08-18T22:27:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.875+0000 7f04fc86f000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558bcc01f430 con 0x558bcc1d2b70 2024-08-18T22:27:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc21f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc21f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55694/0 (socket says 172.21.15.5:55694) 2024-08-18T22:27:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f2800640 1 -- 172.21.15.5:0/2134574477 learned_addr learned my addr 172.21.15.5:0/2134574477 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f3200640 1 --2- 172.21.15.5:0/2134574477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1d2b70 0x558bcc1d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f1e00640 1 --2- 172.21.15.5:0/2134574477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc21f890 0x558bcc1d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f2800640 1 -- 172.21.15.5:0/2134574477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1d2b70 msgr2=0x558bcc1d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f2800640 1 --2- 172.21.15.5:0/2134574477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1d2b70 0x558bcc1d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f2800640 1 -- 172.21.15.5:0/2134574477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc21f890 msgr2=0x558bcc1d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f2800640 1 --2- 172.21.15.5:0/2134574477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc21f890 0x558bcc1d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f2800640 1 -- 172.21.15.5:0/2134574477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bcbfc3a10 con 0x558bcc21ef70 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f2800640 1 --2- 172.21.15.5:0/2134574477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc21f350 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f04e400fd50 tx=0x7f04e4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea10f086d3fe1c9b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04df400640 1 -- 172.21.15.5:0/2134574477 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4025070 con 0x558bcc21ef70 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04df400640 1 -- 172.21.15.5:0/2134574477 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e401b050 con 0x558bcc21ef70 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04df400640 1 -- 172.21.15.5:0/2134574477 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4020630 con 0x558bcc21ef70 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 -- 172.21.15.5:0/2134574477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 msgr2=0x558bcc21f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 --2- 172.21.15.5:0/2134574477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc21f350 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f04e400fd50 tx=0x7f04e4012000 comp rx=0 tx=0).stop 2024-08-18T22:27:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 -- 172.21.15.5:0/2134574477 shutdown_connections 2024-08-18T22:27:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 --2- 172.21.15.5:0/2134574477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1d2b70 0x558bcc1d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 --2- 172.21.15.5:0/2134574477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc21f890 0x558bcc1d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 --2- 172.21.15.5:0/2134574477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc21f350 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 -- 172.21.15.5:0/2134574477 >> 172.21.15.5:0/2134574477 conn(0x558bcc1cc680 msgr2=0x558bcc201df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 -- 172.21.15.5:0/2134574477 shutdown_connections 2024-08-18T22:27:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 -- 172.21.15.5:0/2134574477 wait complete. 2024-08-18T22:27:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 -- start start 2024-08-18T22:27:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 Processor -- start 2024-08-18T22:27:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1d2b70 0x558bcc1d93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc21ef70 0x558bcc1d9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21f890 0x558bcc1d9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558bcbfee770 con 0x558bcc21f890 2024-08-18T22:27:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558bcbfc4c80 con 0x558bcc1d2b70 2024-08-18T22:27:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558bcc0a4130 con 0x558bcc21ef70 2024-08-18T22:27:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04fc86f000 10 client.0 _ll_register_callbacks cb 0x558bcc1c00e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:58.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21f890 0x558bcc1d9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21f890 0x558bcc1d9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55702/0 (socket says 172.21.15.5:55702) 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f3200640 1 -- 172.21.15.5:0/365732329 learned_addr learned my addr 172.21.15.5:0/365732329 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f1e00640 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc21ef70 0x558bcc1d9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.879+0000 7f04f2800640 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1d2b70 0x558bcc1d93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04f3200640 1 -- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc21ef70 msgr2=0x558bcc1d9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04f3200640 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc21ef70 0x558bcc1d9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04f3200640 1 -- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1d2b70 msgr2=0x558bcc1d93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04f3200640 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1d2b70 0x558bcc1d93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04f3200640 1 -- 172.21.15.5:0/365732329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bcbfdbfe0 con 0x558bcc21f890 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04f3200640 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21f890 0x558bcc1d9e70 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f04ec000f70 tx=0x7f04ec055660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c130d90f5734c1fd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04d3e00640 1 -- 172.21.15.5:0/365732329 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec06d020 con 0x558bcc21f890 2024-08-18T22:27:58.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04d3e00640 1 -- 172.21.15.5:0/365732329 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f04ec05ddc0 con 0x558bcc21f890 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 -- 172.21.15.5:0/365732329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e401b050 con 0x558bcc21f890 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04d3e00640 1 -- 172.21.15.5:0/365732329 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f04ec0830d0 con 0x558bcc21f890 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 10 client.8367 fetch_fsmap learned FSMap version 100 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 -- 172.21.15.5:0/365732329 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x558bcbfefed0 con 0x558bcc21f890 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04d3e00640 1 -- 172.21.15.5:0/365732329 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e401b050 con 0x558bcc21f890 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04d3e00640 1 -- 172.21.15.5:0/365732329 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f04ec06d1c0 con 0x558bcc21f890 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 10 client.8367 fetch_fsmap finished waiting for FSMap version 100 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 10 client.8367 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 20 client.8367 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558bcc1da880 0x558bcc231020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 4 client.8367 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 -- 172.21.15.5:0/365732329 --> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bcbfbdd90 con 0x558bcc1da880 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04f2800640 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558bcc1da880 0x558bcc231020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04f2800640 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558bcc1da880 0x558bcc231020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f09b62d590819b27 server_cookie=f4baf441690bec9a in_seq=0 out_seq=0 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04d3e00640 10 client.8367 ms_handle_connect on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04d3e00640 1 -- 172.21.15.5:0/365732329 <== mds.0 v2:172.21.15.117:6835/2108480966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558bcbfbdd90 con 0x558bcc1da880 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04d3e00640 10 client.8367 handle_command_reply: tid=0 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 client.8367 shutdown 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 -- 172.21.15.5:0/365732329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21f890 msgr2=0x558bcc1d9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21f890 0x558bcc1d9e70 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f04ec000f70 tx=0x7f04ec055660 comp rx=0 tx=0).stop 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 -- 172.21.15.5:0/365732329 shutdown_connections 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558bcc1da880 0x558bcc231020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21f890 0x558bcc1d9e70 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc21ef70 0x558bcc1d9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 --2- 172.21.15.5:0/365732329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1d2b70 0x558bcc1d93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04d3e00640 0 client.8367 ms_handle_reset on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 -- 172.21.15.5:0/365732329 >> 172.21.15.5:0/365732329 conn(0x558bcc1cc680 msgr2=0x558bcc201df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 -- 172.21.15.5:0/365732329 shutdown_connections 2024-08-18T22:27:58.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 1 -- 172.21.15.5:0/365732329 wait complete. 2024-08-18T22:27:58.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.883+0000 7f04fc86f000 20 client.8367 trim_cache size 0 max 16384 2024-08-18T22:27:58.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 Processor -- start 2024-08-18T22:27:58.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 -- start start 2024-08-18T22:27:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1cc680 0x558bcc28ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1d2b70 0x558bcc28f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc28f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f04f4203f90 con 0x558bcc21ef70 2024-08-18T22:27:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f04f4202f70 con 0x558bcc1cc680 2024-08-18T22:27:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04f41515f0 con 0x558bcc1d2b70 2024-08-18T22:27:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04f3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc28f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04f3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc28f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55716/0 (socket says 172.21.15.5:55716) 2024-08-18T22:27:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04f3200640 1 -- 172.21.15.5:0/3822465602 learned_addr learned my addr 172.21.15.5:0/3822465602 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:58.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04f3200640 1 -- 172.21.15.5:0/3822465602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1d2b70 msgr2=0x558bcc28f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04f3200640 1 --2- 172.21.15.5:0/3822465602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1d2b70 0x558bcc28f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04f3200640 1 -- 172.21.15.5:0/3822465602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1cc680 msgr2=0x558bcc28ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04f3200640 1 --2- 172.21.15.5:0/3822465602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1cc680 0x558bcc28ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04f3200640 1 -- 172.21.15.5:0/3822465602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bcc0a45c0 con 0x558bcc21ef70 2024-08-18T22:27:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04f3200640 1 --2- 172.21.15.5:0/3822465602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc28f9d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f04ec055460 tx=0x7f04ec058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c9a79a510f3eaf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04dea00640 1 -- 172.21.15.5:0/3822465602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec05ddc0 con 0x558bcc21ef70 2024-08-18T22:27:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04dea00640 1 -- 172.21.15.5:0/3822465602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ec06d310 con 0x558bcc21ef70 2024-08-18T22:27:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04dea00640 1 -- 172.21.15.5:0/3822465602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec007650 con 0x558bcc21ef70 2024-08-18T22:27:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 -- 172.21.15.5:0/3822465602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 msgr2=0x558bcc28f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 --2- 172.21.15.5:0/3822465602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc28f9d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f04ec055460 tx=0x7f04ec058000 comp rx=0 tx=0).stop 2024-08-18T22:27:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 -- 172.21.15.5:0/3822465602 shutdown_connections 2024-08-18T22:27:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 --2- 172.21.15.5:0/3822465602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc28f9d0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 --2- 172.21.15.5:0/3822465602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1d2b70 0x558bcc28f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 --2- 172.21.15.5:0/3822465602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1cc680 0x558bcc28ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 -- 172.21.15.5:0/3822465602 >> 172.21.15.5:0/3822465602 conn(0x558bcc202330 msgr2=0x558bcc1d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 -- 172.21.15.5:0/3822465602 shutdown_connections 2024-08-18T22:27:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.903+0000 7f04fc86f000 1 -- 172.21.15.5:0/3822465602 wait complete. 2024-08-18T22:27:58.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 -- start start 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 Processor -- start 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1cc680 0x558bcc2342d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1d2b70 0x558bcc234810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc24e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558bcbfcaa10 con 0x558bcc21ef70 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f04f4151c40 con 0x558bcc1d2b70 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558bcc022780 con 0x558bcc1cc680 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 10 client.0 _ll_register_callbacks cb 0x7f04ec054f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc24e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f2800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1cc680 0x558bcc2342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc24e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55720/0 (socket says 172.21.15.5:55720) 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f3200640 1 -- 172.21.15.5:0/3723305153 learned_addr learned my addr 172.21.15.5:0/3723305153 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f1e00640 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1d2b70 0x558bcc234810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f3200640 1 -- 172.21.15.5:0/3723305153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1cc680 msgr2=0x558bcc2342d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f3200640 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1cc680 0x558bcc2342d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f3200640 1 -- 172.21.15.5:0/3723305153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1d2b70 msgr2=0x558bcc234810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f3200640 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1d2b70 0x558bcc234810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f3200640 1 -- 172.21.15.5:0/3723305153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bcbfb6c50 con 0x558bcc21ef70 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f3200640 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc24e350 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c450 tx=0x7f04ec083430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f193822e527a69 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04d3e00640 1 -- 172.21.15.5:0/3723305153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec054b70 con 0x558bcc21ef70 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04d3e00640 1 -- 172.21.15.5:0/3723305153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f04ec051270 con 0x558bcc21ef70 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 -- 172.21.15.5:0/3723305153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04ec06d310 con 0x558bcc21ef70 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04d3e00640 1 -- 172.21.15.5:0/3723305153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f04ec078050 con 0x558bcc21ef70 2024-08-18T22:27:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 10 client.8373 fetch_fsmap learned FSMap version 100 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 -- 172.21.15.5:0/3723305153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x558bcbfc92a0 con 0x558bcc21ef70 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04d3e00640 1 -- 172.21.15.5:0/3723305153 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ec06d310 con 0x558bcc21ef70 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04d3e00640 1 -- 172.21.15.5:0/3723305153 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f04ec07b080 con 0x558bcc21ef70 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 10 client.8373 fetch_fsmap finished waiting for FSMap version 100 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 10 client.8373 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 20 client.8373 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558bcc21f890 0x558bcc24ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 4 client.8373 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04fc86f000 1 -- 172.21.15.5:0/3723305153 --> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x558bcc030ba0 con 0x558bcc21f890 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.907+0000 7f04f2800640 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558bcc21f890 0x558bcc24ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f2800640 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558bcc21f890 0x558bcc24ed40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8564993d0980d701 server_cookie=6452928b40de74a in_seq=0 out_seq=0 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04d3e00640 10 client.8373 ms_handle_connect on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04d3e00640 1 -- 172.21.15.5:0/3723305153 <== mds.0 v2:172.21.15.117:6835/2108480966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558bcc030ba0 con 0x558bcc21f890 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04d3e00640 10 client.8373 handle_command_reply: tid=0 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 1 client.8373 shutdown 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 1 -- 172.21.15.5:0/3723305153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 msgr2=0x558bcc24e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc24e350 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c450 tx=0x7f04ec083430 comp rx=0 tx=0).stop 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 1 -- 172.21.15.5:0/3723305153 shutdown_connections 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558bcc21f890 0x558bcc24ed40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bcc21ef70 0x558bcc24e350 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558bcc1d2b70 0x558bcc234810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 1 --2- 172.21.15.5:0/3723305153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558bcc1cc680 0x558bcc2342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04d3e00640 0 client.8373 ms_handle_reset on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 1 -- 172.21.15.5:0/3723305153 >> 172.21.15.5:0/3723305153 conn(0x558bcc202330 msgr2=0x558bcc1d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 1 -- 172.21.15.5:0/3723305153 shutdown_connections 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 1 -- 172.21.15.5:0/3723305153 wait complete. 2024-08-18T22:27:58.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04fc86f000 20 client.8373 trim_cache size 0 max 16384 2024-08-18T22:27:58.916 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:27:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:27:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:27:58.916 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:27:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 -- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04d40678c0 msgr2=0x7f04d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04d40678c0 0x7f04d4069d80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f04f40d0b40 tx=0x7f04e4009040 comp rx=0 tx=0).stop 2024-08-18T22:27:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 -- 172.21.15.5:0/1406692497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f415fb80 msgr2=0x7f04f406d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f415fb80 0x7f04f406d000 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c480 tx=0x7f04ec00c940 comp rx=0 tx=0).stop 2024-08-18T22:27:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 -- 172.21.15.5:0/1406692497 shutdown_connections 2024-08-18T22:27:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04d40678c0 0x7f04d4069d80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f415fb80 0x7f04f406d000 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f40d1090 0x7f04f406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 --2- 172.21.15.5:0/1406692497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f40b5ad0 0x7f04f414c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 -- 172.21.15.5:0/1406692497 >> 172.21.15.5:0/1406692497 conn(0x7f04f40d2180 msgr2=0x7f04f4071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 -- 172.21.15.5:0/1406692497 shutdown_connections 2024-08-18T22:27:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:58.911+0000 7f04f9400640 1 -- 172.21.15.5:0/1406692497 wait complete. 2024-08-18T22:27:58.930 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-18T22:27:58.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-08-18T22:27:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.071+0000 7f407fe00640 1 Processor -- start 2024-08-18T22:27:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.071+0000 7f407fe00640 1 -- start start 2024-08-18T22:27:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.071+0000 7f407fe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40800ae610 0x7f40800b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.071+0000 7f407fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40800aea50 0x7f40800b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.071+0000 7f407fe00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40800b4d00 con 0x7f408006b9b0 2024-08-18T22:27:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.071+0000 7f407fe00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f408006f7d0 con 0x7f40800ae610 2024-08-18T22:27:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.071+0000 7f407fe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f40800b52c0 con 0x7f40800aea50 2024-08-18T22:27:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.071+0000 7f407ea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f408006b9b0 0x7f408006bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34144/0 (socket says 172.21.15.5:34144) 2024-08-18T22:27:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.071+0000 7f407ea00640 1 -- 172.21.15.5:0/311841416 learned_addr learned my addr 172.21.15.5:0/311841416 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:27:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f4076000640 1 --2- 172.21.15.5:0/311841416 >> v2:172.21.15.117:3300/0 conn(0x7f40800ae610 0x7f40800b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407f400640 1 --2- 172.21.15.5:0/311841416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40800aea50 0x7f40800b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407e000640 1 -- 172.21.15.5:0/311841416 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810345613 0 0) 0x7f40800b4d00 con 0x7f408006b9b0 2024-08-18T22:27:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407e000640 1 -- 172.21.15.5:0/311841416 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4064003530 con 0x7f408006b9b0 2024-08-18T22:27:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407f400640 1 -- 172.21.15.5:0/311841416 >> v2:172.21.15.117:3300/0 conn(0x7f40800ae610 msgr2=0x7f40800b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407f400640 1 --2- 172.21.15.5:0/311841416 >> v2:172.21.15.117:3300/0 conn(0x7f40800ae610 0x7f40800b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407f400640 1 -- 172.21.15.5:0/311841416 >> v1:172.21.15.5:6789/0 conn(0x7f408006b9b0 legacy=0x7f408006bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407e000640 1 -- 172.21.15.5:0/311841416 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1722615754 0 0) 0x7f4064003530 con 0x7f408006b9b0 2024-08-18T22:27:59.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407f400640 1 -- 172.21.15.5:0/311841416 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40800b4fe0 con 0x7f40800aea50 2024-08-18T22:27:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407f400640 1 --2- 172.21.15.5:0/311841416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40800aea50 0x7f40800b45f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4078009d90 tx=0x7f407801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f42511400a8e8911 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407e000640 1 -- 172.21.15.5:0/311841416 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40780b2070 con 0x7f40800aea50 2024-08-18T22:27:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407e000640 1 -- 172.21.15.5:0/311841416 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40780a5580 con 0x7f40800aea50 2024-08-18T22:27:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.075+0000 7f407e000640 1 -- 172.21.15.5:0/311841416 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4070001680 con 0x7f40800aea50 2024-08-18T22:27:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 -- 172.21.15.5:0/311841416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40800aea50 msgr2=0x7f40800b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 --2- 172.21.15.5:0/311841416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40800aea50 0x7f40800b45f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4078009d90 tx=0x7f407801c890 comp rx=0 tx=0).stop 2024-08-18T22:27:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 -- 172.21.15.5:0/311841416 shutdown_connections 2024-08-18T22:27:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 --2- 172.21.15.5:0/311841416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40800aea50 0x7f40800b45f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 --2- 172.21.15.5:0/311841416 >> v2:172.21.15.117:3300/0 conn(0x7f40800ae610 0x7f40800b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 -- 172.21.15.5:0/311841416 >> 172.21.15.5:0/311841416 conn(0x7f408006e9b0 msgr2=0x7f408006ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 -- 172.21.15.5:0/311841416 shutdown_connections 2024-08-18T22:27:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 -- 172.21.15.5:0/311841416 wait complete. 2024-08-18T22:27:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 Processor -- start 2024-08-18T22:27:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 -- start start 2024-08-18T22:27:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f408006b9b0 0x7f40801464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40800ae610 0x7f4080146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40800aea50 0x7f408015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4080071220 con 0x7f408006b9b0 2024-08-18T22:27:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f40800710a0 con 0x7f40800aea50 2024-08-18T22:27:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407fe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f40800713a0 con 0x7f40800ae610 2024-08-18T22:27:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f408006b9b0 0x7f40801464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f408006b9b0 0x7f40801464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55734/0 (socket says 172.21.15.5:55734) 2024-08-18T22:27:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407ea00640 1 -- 172.21.15.5:0/2360567171 learned_addr learned my addr 172.21.15.5:0/2360567171 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407f400640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40800aea50 0x7f408015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f4076000640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40800ae610 0x7f4080146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407ea00640 1 -- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40800ae610 msgr2=0x7f4080146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407ea00640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40800ae610 0x7f4080146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407ea00640 1 -- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40800aea50 msgr2=0x7f408015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407ea00640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40800aea50 0x7f408015d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.079+0000 7f407ea00640 1 -- 172.21.15.5:0/2360567171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4080143e60 con 0x7f408006b9b0 2024-08-18T22:27:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.083+0000 7f407ea00640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f408006b9b0 0x7f40801464e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f407000c6d0 tx=0x7f407000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.083+0000 7f4077400640 1 -- 172.21.15.5:0/2360567171 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4070017070 con 0x7f408006b9b0 2024-08-18T22:27:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.083+0000 7f4077400640 1 -- 172.21.15.5:0/2360567171 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4070005ae0 con 0x7f408006b9b0 2024-08-18T22:27:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.083+0000 7f4077400640 1 -- 172.21.15.5:0/2360567171 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4070007070 con 0x7f408006b9b0 2024-08-18T22:27:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.083+0000 7f407fe00640 1 -- 172.21.15.5:0/2360567171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4080136f30 con 0x7f408006b9b0 2024-08-18T22:27:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.083+0000 7f407fe00640 1 -- 172.21.15.5:0/2360567171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4080136c50 con 0x7f408006b9b0 2024-08-18T22:27:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.083+0000 7f4077400640 1 -- 172.21.15.5:0/2360567171 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f407001a070 con 0x7f408006b9b0 2024-08-18T22:27:59.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.083+0000 7f4077400640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f405c0678c0 0x7f405c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.083+0000 7f4077400640 1 -- 172.21.15.5:0/2360567171 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f40700852f0 con 0x7f408006b9b0 2024-08-18T22:27:59.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.083+0000 7f4076000640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f405c0678c0 0x7f405c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.083+0000 7f4088c86000 1 Processor -- start 2024-08-18T22:27:59.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 -- start start 2024-08-18T22:27:59.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4076000640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f405c0678c0 0x7f405c069d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f40801fa2a0 tx=0x7f4068009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c289a0 0x558b62c28d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62c292c0 0x558b62bdbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62bdc500 0x558b62bdc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558b62ac5ae0 con 0x558b62bdc500 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558b62ab1ba0 con 0x558b62c289a0 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558b62a2c4f0 con 0x558b62c292c0 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f407f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62bdc500 0x558b62bdc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f407ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c289a0 0x558b62c28d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4076000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62c292c0 0x558b62bdbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f407f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62bdc500 0x558b62bdc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55746/0 (socket says 172.21.15.5:55746) 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f407f400640 1 -- 172.21.15.5:0/741328846 learned_addr learned my addr 172.21.15.5:0/741328846 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f407f400640 1 -- 172.21.15.5:0/741328846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62c292c0 msgr2=0x558b62bdbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f407f400640 1 --2- 172.21.15.5:0/741328846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62c292c0 0x558b62bdbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f407f400640 1 -- 172.21.15.5:0/741328846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c289a0 msgr2=0x558b62c28d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f407f400640 1 --2- 172.21.15.5:0/741328846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c289a0 0x558b62c28d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f407f400640 1 -- 172.21.15.5:0/741328846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b629cca90 con 0x558b62bdc500 2024-08-18T22:27:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f407f400640 1 --2- 172.21.15.5:0/741328846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62bdc500 0x558b62bdc8e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f40780b0040 tx=0x7f4078004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5dcf4d1232f6bb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f406f400640 1 -- 172.21.15.5:0/741328846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40780b2040 con 0x558b62bdc500 2024-08-18T22:27:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f406f400640 1 -- 172.21.15.5:0/741328846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40780b3040 con 0x558b62bdc500 2024-08-18T22:27:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f406f400640 1 -- 172.21.15.5:0/741328846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40780a5980 con 0x558b62bdc500 2024-08-18T22:27:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 -- 172.21.15.5:0/741328846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62bdc500 msgr2=0x558b62bdc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 --2- 172.21.15.5:0/741328846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62bdc500 0x558b62bdc8e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f40780b0040 tx=0x7f4078004ac0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 -- 172.21.15.5:0/741328846 shutdown_connections 2024-08-18T22:27:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 --2- 172.21.15.5:0/741328846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62bdc500 0x558b62bdc8e0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 --2- 172.21.15.5:0/741328846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62c292c0 0x558b62bdbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 --2- 172.21.15.5:0/741328846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c289a0 0x558b62c28d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 -- 172.21.15.5:0/741328846 >> 172.21.15.5:0/741328846 conn(0x558b62bd6010 msgr2=0x558b62c0b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 -- 172.21.15.5:0/741328846 shutdown_connections 2024-08-18T22:27:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 -- 172.21.15.5:0/741328846 wait complete. 2024-08-18T22:27:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 -- start start 2024-08-18T22:27:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.087+0000 7f4088c86000 1 Processor -- start 2024-08-18T22:27:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62bdc500 0x558b62c08e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62be4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c292c0 0x558b62be4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558b62a284b0 con 0x558b62c289a0 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558b629e6b50 con 0x558b62c292c0 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558b629cdd00 con 0x558b62bdc500 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 10 client.0 _ll_register_callbacks cb 0x558b62bc9f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4076000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62be4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4076000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62be4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55762/0 (socket says 172.21.15.5:55762) 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4076000640 1 -- 172.21.15.5:0/1439334 learned_addr learned my addr 172.21.15.5:0/1439334 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f407f400640 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c292c0 0x558b62be4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f407ea00640 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62bdc500 0x558b62c08e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4076000640 1 -- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62bdc500 msgr2=0x558b62c08e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4076000640 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62bdc500 0x558b62c08e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4076000640 1 -- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c292c0 msgr2=0x558b62be4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4076000640 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c292c0 0x558b62be4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4076000640 1 -- 172.21.15.5:0/1439334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b629e5060 con 0x558b62c289a0 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4076000640 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62be4030 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f4068011f30 tx=0x7f40680046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7041543de126884 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4063e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4063e00640 1 -- 172.21.15.5:0/1439334 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068027070 con 0x558b62c289a0 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 1 -- 172.21.15.5:0/1439334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40780b3040 con 0x558b62c289a0 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4063e00640 1 -- 172.21.15.5:0/1439334 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f40680178b0 con 0x558b62c289a0 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4063e00640 1 -- 172.21.15.5:0/1439334 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f4068031050 con 0x558b62c289a0 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 10 client.8385 fetch_fsmap learned FSMap version 100 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 1 -- 172.21.15.5:0/1439334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x558b629f8f50 con 0x558b62c289a0 2024-08-18T22:27:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4063e00640 1 -- 172.21.15.5:0/1439334 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40780b3040 con 0x558b62c289a0 2024-08-18T22:27:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4063e00640 1 -- 172.21.15.5:0/1439334 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f4068034020 con 0x558b62c289a0 2024-08-18T22:27:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 10 client.8385 fetch_fsmap finished waiting for FSMap version 100 2024-08-18T22:27:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 10 client.8385 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-08-18T22:27:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 20 client.8385 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558b62c0ad30 0x558b62c0b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 4 client.8385 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:27:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4088c86000 1 -- 172.21.15.5:0/1439334 --> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b629c6e10 con 0x558b62c0ad30 2024-08-18T22:27:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f407ea00640 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558b62c0ad30 0x558b62c0b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f407ea00640 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558b62c0ad30 0x558b62c0b110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2135c7389e7e2532 server_cookie=19534df772fa8bac in_seq=0 out_seq=0 2024-08-18T22:27:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.091+0000 7f4063e00640 10 client.8385 ms_handle_connect on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4063e00640 1 -- 172.21.15.5:0/1439334 <== mds.0 v2:172.21.15.117:6835/2108480966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b629c6e10 con 0x558b62c0ad30 2024-08-18T22:27:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4063e00640 10 client.8385 handle_command_reply: tid=0 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 1 client.8385 shutdown 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 1 -- 172.21.15.5:0/1439334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 msgr2=0x558b62be4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62be4030 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f4068011f30 tx=0x7f40680046d0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 1 -- 172.21.15.5:0/1439334 shutdown_connections 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558b62c0ad30 0x558b62c0b110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c292c0 0x558b62be4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62be4030 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4063e00640 0 client.8385 ms_handle_reset on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 1 --2- 172.21.15.5:0/1439334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62bdc500 0x558b62c08e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 1 -- 172.21.15.5:0/1439334 >> 172.21.15.5:0/1439334 conn(0x558b62bd6010 msgr2=0x558b62bdb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 1 -- 172.21.15.5:0/1439334 shutdown_connections 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 1 -- 172.21.15.5:0/1439334 wait complete. 2024-08-18T22:27:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.095+0000 7f4088c86000 20 client.8385 trim_cache size 0 max 16384 2024-08-18T22:27:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.111+0000 7f4088c86000 1 Processor -- start 2024-08-18T22:27:59.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.111+0000 7f4088c86000 1 -- start start 2024-08-18T22:27:59.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.111+0000 7f4088c86000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62bdc500 0x558b62bdb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.111+0000 7f4088c86000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62bdbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.111+0000 7f4088c86000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62c292c0 0x558b62c27900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.111+0000 7f4088c86000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4080203880 con 0x558b62c289a0 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.111+0000 7f4088c86000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f40802028c0 con 0x558b62bdc500 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.111+0000 7f4088c86000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f40801434a0 con 0x558b62c292c0 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.111+0000 7f4076000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62bdbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4076000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62bdbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55776/0 (socket says 172.21.15.5:55776) 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4076000640 1 -- 172.21.15.5:0/3453040062 learned_addr learned my addr 172.21.15.5:0/3453040062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f407f400640 1 --2- 172.21.15.5:0/3453040062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62c292c0 0x558b62c27900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f407ea00640 1 --2- 172.21.15.5:0/3453040062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62bdc500 0x558b62bdb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4076000640 1 -- 172.21.15.5:0/3453040062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62c292c0 msgr2=0x558b62c27900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4076000640 1 --2- 172.21.15.5:0/3453040062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62c292c0 0x558b62c27900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4076000640 1 -- 172.21.15.5:0/3453040062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62bdc500 msgr2=0x558b62bdb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4076000640 1 --2- 172.21.15.5:0/3453040062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62bdc500 0x558b62bdb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4076000640 1 -- 172.21.15.5:0/3453040062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b62aaedd0 con 0x558b62c289a0 2024-08-18T22:27:59.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4076000640 1 --2- 172.21.15.5:0/3453040062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62bdbce0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f4068011830 tx=0x7f4068024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a23b912d6099b8d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f406ea00640 1 -- 172.21.15.5:0/3453040062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068027070 con 0x558b62c289a0 2024-08-18T22:27:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f406ea00640 1 -- 172.21.15.5:0/3453040062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4068039020 con 0x558b62c289a0 2024-08-18T22:27:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f406ea00640 1 -- 172.21.15.5:0/3453040062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068017d80 con 0x558b62c289a0 2024-08-18T22:27:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 -- 172.21.15.5:0/3453040062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 msgr2=0x558b62bdbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 --2- 172.21.15.5:0/3453040062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62bdbce0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f4068011830 tx=0x7f4068024000 comp rx=0 tx=0).stop 2024-08-18T22:27:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 -- 172.21.15.5:0/3453040062 shutdown_connections 2024-08-18T22:27:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 --2- 172.21.15.5:0/3453040062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62c292c0 0x558b62c27900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 --2- 172.21.15.5:0/3453040062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c289a0 0x558b62bdbce0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 --2- 172.21.15.5:0/3453040062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62bdc500 0x558b62bdb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 -- 172.21.15.5:0/3453040062 >> 172.21.15.5:0/3453040062 conn(0x558b62bd6010 msgr2=0x558b62c271f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:59.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 -- 172.21.15.5:0/3453040062 shutdown_connections 2024-08-18T22:27:59.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 -- 172.21.15.5:0/3453040062 wait complete. 2024-08-18T22:27:59.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 -- start start 2024-08-18T22:27:59.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 Processor -- start 2024-08-18T22:27:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62bdc500 0x558b62c3af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c289a0 0x558b62c3b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c292c0 0x558b62c3ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4080143af0 con 0x558b62c292c0 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558b629f77f0 con 0x558b62c289a0 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x558b62aae940 con 0x558b62bdc500 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4088c86000 10 client.0 _ll_register_callbacks cb 0x7f4068004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f407f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c292c0 0x558b62c3ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f407f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c292c0 0x558b62c3ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55778/0 (socket says 172.21.15.5:55778) 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f407f400640 1 -- 172.21.15.5:0/522155559 learned_addr learned my addr 172.21.15.5:0/522155559 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f407ea00640 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62bdc500 0x558b62c3af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.115+0000 7f4076000640 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c289a0 0x558b62c3b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407f400640 1 -- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62bdc500 msgr2=0x558b62c3af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407f400640 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62bdc500 0x558b62c3af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407f400640 1 -- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c289a0 msgr2=0x558b62c3b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407f400640 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c289a0 0x558b62c3b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407f400640 1 -- 172.21.15.5:0/522155559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b629bfcd0 con 0x558b62c292c0 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407ea00640 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62bdc500 0x558b62c3af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407f400640 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c292c0 0x558b62c3ba10 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f4078009d90 tx=0x7f407801b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d84d92d838a762d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4063e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4063e00640 1 -- 172.21.15.5:0/522155559 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40780b2040 con 0x558b62c292c0 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4063e00640 1 -- 172.21.15.5:0/522155559 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f4078003cf0 con 0x558b62c292c0 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 -- 172.21.15.5:0/522155559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4068039020 con 0x558b62c292c0 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4063e00640 1 -- 172.21.15.5:0/522155559 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f40780cd050 con 0x558b62c292c0 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 10 client.8391 fetch_fsmap learned FSMap version 100 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 -- 172.21.15.5:0/522155559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x558b629d2320 con 0x558b62c292c0 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4063e00640 1 -- 172.21.15.5:0/522155559 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4068039020 con 0x558b62c292c0 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4063e00640 1 -- 172.21.15.5:0/522155559 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f40780d0020 con 0x558b62c292c0 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 10 client.8391 fetch_fsmap finished waiting for FSMap version 100 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 10 client.8391 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-08-18T22:27:59.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 20 client.8391 populate_metadata read hostname 'smithi005' 2024-08-18T22:27:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558b62ca1e50 0x558b62ca4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:27:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 4 client.8391 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:27:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 -- 172.21.15.5:0/522155559 --> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558b62a39c20 con 0x558b62ca1e50 2024-08-18T22:27:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407ea00640 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558b62ca1e50 0x558b62ca4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:27:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407ea00640 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558b62ca1e50 0x558b62ca4240 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a4926c7c7fe4ce6 server_cookie=ff6a88f6d8e5d487 in_seq=0 out_seq=0 2024-08-18T22:27:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4063e00640 10 client.8391 ms_handle_connect on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4063e00640 1 -- 172.21.15.5:0/522155559 <== mds.0 v2:172.21.15.117:6835/2108480966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x558b62a39c20 con 0x558b62ca1e50 2024-08-18T22:27:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4063e00640 10 client.8391 handle_command_reply: tid=0 2024-08-18T22:27:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 client.8391 shutdown 2024-08-18T22:27:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 -- 172.21.15.5:0/522155559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c292c0 msgr2=0x558b62c3ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c292c0 0x558b62c3ba10 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f4078009d90 tx=0x7f407801b0d0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 -- 172.21.15.5:0/522155559 shutdown_connections 2024-08-18T22:27:59.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x558b62ca1e50 0x558b62ca4240 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b62c292c0 0x558b62c3ba10 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558b62c289a0 0x558b62c3b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4063e00640 0 client.8391 ms_handle_reset on v2:172.21.15.117:6835/2108480966 2024-08-18T22:27:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 --2- 172.21.15.5:0/522155559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x558b62bdc500 0x558b62c3af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 -- 172.21.15.5:0/522155559 >> 172.21.15.5:0/522155559 conn(0x558b62bd6010 msgr2=0x558b62c09f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 -- 172.21.15.5:0/522155559 shutdown_connections 2024-08-18T22:27:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 1 -- 172.21.15.5:0/522155559 wait complete. 2024-08-18T22:27:59.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f4088c86000 20 client.8391 trim_cache size 0 max 16384 2024-08-18T22:27:59.126 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:27:59.126 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-18T22:27:59.126 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-18T22:27:59.126 INFO:teuthology.orchestra.run.smithi005.stdout: "06e86f15-82fe-4df4-80dc-696a144a1e00": { 2024-08-18T22:27:59.126 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_control_test_path", 2024-08-18T22:27:59.126 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "06e86f15-82fe-4df4-80dc-696a144a1e00", 2024-08-18T22:27:59.126 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive" 2024-08-18T22:27:59.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:59.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:27:59.126 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:27:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 -- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f405c0678c0 msgr2=0x7f405c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f405c0678c0 0x7f405c069d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f40801fa2a0 tx=0x7f4068009190 comp rx=0 tx=0).stop 2024-08-18T22:27:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 -- 172.21.15.5:0/2360567171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f408006b9b0 msgr2=0x7f40801464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:27:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f408006b9b0 0x7f40801464e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f407000c6d0 tx=0x7f407000cb90 comp rx=0 tx=0).stop 2024-08-18T22:27:59.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 -- 172.21.15.5:0/2360567171 shutdown_connections 2024-08-18T22:27:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f405c0678c0 0x7f405c069d80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40800aea50 0x7f408015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40800ae610 0x7f4080146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 --2- 172.21.15.5:0/2360567171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f408006b9b0 0x7f40801464e0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:27:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 -- 172.21.15.5:0/2360567171 >> 172.21.15.5:0/2360567171 conn(0x7f408006e9b0 msgr2=0x7f408006ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:27:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 -- 172.21.15.5:0/2360567171 shutdown_connections 2024-08-18T22:27:59.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:27:59.119+0000 7f407fe00640 1 -- 172.21.15.5:0/2360567171 wait complete. 2024-08-18T22:28:04.141 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-18T22:28:04.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-08-18T22:28:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72e1c00640 1 Processor -- start 2024-08-18T22:28:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72e1c00640 1 -- start start 2024-08-18T22:28:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72e1c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72dc0d1d20 0x7f72dc0ae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72e1c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72dc0b4850 0x7f72dc0b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72e1c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72dc0aec70 con 0x7f72dc15b1c0 2024-08-18T22:28:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72e1c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc0aef50 con 0x7f72dc0d1d20 2024-08-18T22:28:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72e1c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc0af230 con 0x7f72dc0b4850 2024-08-18T22:28:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72da000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72dc0d1d20 0x7f72dc0ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72da000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72dc0d1d20 0x7f72dc0ae670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40632/0 (socket says 172.21.15.5:40632) 2024-08-18T22:28:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72da000640 1 -- 172.21.15.5:0/3037362486 learned_addr learned my addr 172.21.15.5:0/3037362486 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72db400640 1 --2- 172.21.15.5:0/3037362486 >> v2:172.21.15.117:3300/0 conn(0x7f72dc0b4850 0x7f72dc0b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72da000640 1 -- 172.21.15.5:0/3037362486 >> v2:172.21.15.117:3300/0 conn(0x7f72dc0b4850 msgr2=0x7f72dc0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72da000640 1 --2- 172.21.15.5:0/3037362486 >> v2:172.21.15.117:3300/0 conn(0x7f72dc0b4850 0x7f72dc0b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72da000640 1 -- 172.21.15.5:0/3037362486 >> v1:172.21.15.117:6789/0 conn(0x7f72dc15b1c0 legacy=0x7f72dc15b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72da000640 1 -- 172.21.15.5:0/3037362486 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc0af510 con 0x7f72dc0d1d20 2024-08-18T22:28:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.295+0000 7f72db400640 1 --2- 172.21.15.5:0/3037362486 >> v2:172.21.15.117:3300/0 conn(0x7f72dc0b4850 0x7f72dc0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72da000640 1 --2- 172.21.15.5:0/3037362486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72dc0d1d20 0x7f72dc0ae670 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0d1c60 tx=0x7f72c801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cf5fdcea0180a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72d9600640 1 -- 172.21.15.5:0/3037362486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c80ab600 con 0x7f72dc0d1d20 2024-08-18T22:28:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72d9600640 1 -- 172.21.15.5:0/3037362486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c80b0070 con 0x7f72dc0d1d20 2024-08-18T22:28:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72d9600640 1 -- 172.21.15.5:0/3037362486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c80ab9c0 con 0x7f72dc0d1d20 2024-08-18T22:28:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72e1c00640 1 -- 172.21.15.5:0/3037362486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72dc0d1d20 msgr2=0x7f72dc0ae670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72e1c00640 1 --2- 172.21.15.5:0/3037362486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72dc0d1d20 0x7f72dc0ae670 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0d1c60 tx=0x7f72c801c4f0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72e1c00640 1 -- 172.21.15.5:0/3037362486 shutdown_connections 2024-08-18T22:28:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72e1c00640 1 --2- 172.21.15.5:0/3037362486 >> v2:172.21.15.117:3300/0 conn(0x7f72dc0b4850 0x7f72dc0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72e1c00640 1 --2- 172.21.15.5:0/3037362486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72dc0d1d20 0x7f72dc0ae670 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72e1c00640 1 -- 172.21.15.5:0/3037362486 >> 172.21.15.5:0/3037362486 conn(0x7f72dc0b65f0 msgr2=0x7f72dc0b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72e1c00640 1 -- 172.21.15.5:0/3037362486 shutdown_connections 2024-08-18T22:28:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.299+0000 7f72e1c00640 1 -- 172.21.15.5:0/3037362486 wait complete. 2024-08-18T22:28:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72e1c00640 1 Processor -- start 2024-08-18T22:28:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72e1c00640 1 -- start start 2024-08-18T22:28:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72e1c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72dc0b4850 0x7f72dc1489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72e1c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72dc15b1c0 0x7f72dc14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72e1c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72dc149180 0x7f72dc14cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72e1c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc0b08b0 con 0x7f72dc15b1c0 2024-08-18T22:28:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72e1c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc0b0730 con 0x7f72dc0b4850 2024-08-18T22:28:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72e1c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc1501d0 con 0x7f72dc149180 2024-08-18T22:28:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72da000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72dc15b1c0 0x7f72dc14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72daa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72dc0b4850 0x7f72dc1489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72da000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72dc15b1c0 0x7f72dc14c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40648/0 (socket says 172.21.15.5:40648) 2024-08-18T22:28:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72da000640 1 -- 172.21.15.5:0/487129158 learned_addr learned my addr 172.21.15.5:0/487129158 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72db400640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72dc149180 0x7f72dc14cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72da000640 1 -- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72dc149180 msgr2=0x7f72dc14cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72da000640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72dc149180 0x7f72dc14cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72da000640 1 -- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72dc0b4850 msgr2=0x7f72dc1489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72da000640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72dc0b4850 0x7f72dc1489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72da000640 1 -- 172.21.15.5:0/487129158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc150700 con 0x7f72dc15b1c0 2024-08-18T22:28:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72da000640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72dc15b1c0 0x7f72dc14c720 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f72c80ad040 tx=0x7f72c801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72d2a00640 1 -- 172.21.15.5:0/487129158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c80be5f0 con 0x7f72dc15b1c0 2024-08-18T22:28:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72d2a00640 1 -- 172.21.15.5:0/487129158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c80be790 con 0x7f72dc15b1c0 2024-08-18T22:28:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72e1c00640 1 -- 172.21.15.5:0/487129158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc150420 con 0x7f72dc15b1c0 2024-08-18T22:28:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72d2a00640 1 -- 172.21.15.5:0/487129158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c80beb60 con 0x7f72dc15b1c0 2024-08-18T22:28:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.303+0000 7f72e1c00640 1 -- 172.21.15.5:0/487129158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc1587d0 con 0x7f72dc15b1c0 2024-08-18T22:28:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72d2a00640 1 -- 172.21.15.5:0/487129158 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72c80aa070 con 0x7f72dc15b1c0 2024-08-18T22:28:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72d2a00640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72bc0678c0 0x7f72bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72d2a00640 1 -- 172.21.15.5:0/487129158 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f72c81206e0 con 0x7f72dc15b1c0 2024-08-18T22:28:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72daa00640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72bc0678c0 0x7f72bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72e51d9000 1 Processor -- start 2024-08-18T22:28:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72e51d9000 1 -- start start 2024-08-18T22:28:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72daa00640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72bc0678c0 0x7f72bc069d80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b12f0 tx=0x7f72cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f3828beed0 0x55f3828bf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828bf7f0 0x55f3828723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382872910 0x55f382872cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72e51d9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f382757ae0 con 0x55f382872910 2024-08-18T22:28:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72e51d9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f382743ba0 con 0x55f3828bf7f0 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.307+0000 7f72e51d9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f3826be4f0 con 0x55f3828beed0 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72db400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382872910 0x55f382872cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72db400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382872910 0x55f382872cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40658/0 (socket says 172.21.15.5:40658) 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72db400640 1 -- 172.21.15.5:0/1383219871 learned_addr learned my addr 172.21.15.5:0/1383219871 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72daa00640 1 --2- 172.21.15.5:0/1383219871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f3828beed0 0x55f3828bf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72da000640 1 --2- 172.21.15.5:0/1383219871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828bf7f0 0x55f3828723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72db400640 1 -- 172.21.15.5:0/1383219871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f3828beed0 msgr2=0x55f3828bf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72db400640 1 --2- 172.21.15.5:0/1383219871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f3828beed0 0x55f3828bf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72db400640 1 -- 172.21.15.5:0/1383219871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828bf7f0 msgr2=0x55f3828723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72db400640 1 --2- 172.21.15.5:0/1383219871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828bf7f0 0x55f3828723d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72db400640 1 -- 172.21.15.5:0/1383219871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f38265ea90 con 0x55f382872910 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72daa00640 1 --2- 172.21.15.5:0/1383219871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f3828beed0 0x55f3828bf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72da000640 1 --2- 172.21.15.5:0/1383219871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828bf7f0 0x55f3828723d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72db400640 1 --2- 172.21.15.5:0/1383219871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382872910 0x55f382872cf0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f72d4003b60 tx=0x7f72d4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76be938ad898893a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72c7400640 1 -- 172.21.15.5:0/1383219871 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d40147f0 con 0x55f382872910 2024-08-18T22:28:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72c7400640 1 -- 172.21.15.5:0/1383219871 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d401a070 con 0x55f382872910 2024-08-18T22:28:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72c7400640 1 -- 172.21.15.5:0/1383219871 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4014b90 con 0x55f382872910 2024-08-18T22:28:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 -- 172.21.15.5:0/1383219871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382872910 msgr2=0x55f382872cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 --2- 172.21.15.5:0/1383219871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382872910 0x55f382872cf0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f72d4003b60 tx=0x7f72d4004410 comp rx=0 tx=0).stop 2024-08-18T22:28:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 -- 172.21.15.5:0/1383219871 shutdown_connections 2024-08-18T22:28:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 --2- 172.21.15.5:0/1383219871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382872910 0x55f382872cf0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 --2- 172.21.15.5:0/1383219871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828bf7f0 0x55f3828723d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 --2- 172.21.15.5:0/1383219871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f3828beed0 0x55f3828bf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 -- 172.21.15.5:0/1383219871 >> 172.21.15.5:0/1383219871 conn(0x55f382868010 msgr2=0x55f38289d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 -- 172.21.15.5:0/1383219871 shutdown_connections 2024-08-18T22:28:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 -- 172.21.15.5:0/1383219871 wait complete. 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 -- start start 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 Processor -- start 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f382872910 0x55f38289f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f3828beed0 0x55f38289f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828bf7f0 0x55f38289fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f3826ba4b0 con 0x55f3828bf7f0 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f382678b50 con 0x55f382872910 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f38265fd00 con 0x55f3828beed0 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72e51d9000 10 client.0 _ll_register_callbacks cb 0x55f38285bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.311+0000 7f72db400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828bf7f0 0x55f38289fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72db400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828bf7f0 0x55f38289fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40666/0 (socket says 172.21.15.5:40666) 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72db400640 1 -- 172.21.15.5:0/3683047829 learned_addr learned my addr 172.21.15.5:0/3683047829 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72da000640 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f3828beed0 0x55f38289f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72daa00640 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f382872910 0x55f38289f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72db400640 1 -- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f3828beed0 msgr2=0x55f38289f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72db400640 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f3828beed0 0x55f38289f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72db400640 1 -- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f382872910 msgr2=0x55f38289f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72db400640 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f382872910 0x55f38289f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72db400640 1 -- 172.21.15.5:0/3683047829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f382677060 con 0x55f3828bf7f0 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72daa00640 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f382872910 0x55f38289f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72db400640 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828bf7f0 0x55f38289fe20 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f72d4017040 tx=0x7f72d4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b76653d0609e5a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72bbe00640 1 -- 172.21.15.5:0/3683047829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4014e60 con 0x55f3828bf7f0 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72bbe00640 1 -- 172.21.15.5:0/3683047829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f72d4029c70 con 0x55f3828bf7f0 2024-08-18T22:28:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 -- 172.21.15.5:0/3683047829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72d401a070 con 0x55f3828bf7f0 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72bbe00640 1 -- 172.21.15.5:0/3683047829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f72d4015480 con 0x55f3828bf7f0 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 10 client.8403 fetch_fsmap learned FSMap version 100 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 -- 172.21.15.5:0/3683047829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x55f38268af50 con 0x55f3828bf7f0 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72bbe00640 1 -- 172.21.15.5:0/3683047829 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d401a070 con 0x55f3828bf7f0 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72bbe00640 1 -- 172.21.15.5:0/3683047829 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f72d4030050 con 0x55f3828bf7f0 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 10 client.8403 fetch_fsmap finished waiting for FSMap version 100 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 10 client.8403 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 20 client.8403 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x55f3828a0830 0x55f3828d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 4 client.8403 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 -- 172.21.15.5:0/3683047829 --> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f382658e10 con 0x55f3828a0830 2024-08-18T22:28:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72daa00640 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x55f3828a0830 0x55f3828d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72daa00640 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x55f3828a0830 0x55f3828d0180 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18392659bf257e84 server_cookie=32d5adfe09cdfcdd in_seq=0 out_seq=0 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72bbe00640 10 client.8403 ms_handle_connect on v2:172.21.15.117:6835/2108480966 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72bbe00640 1 -- 172.21.15.5:0/3683047829 <== mds.0 v2:172.21.15.117:6835/2108480966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f382658e10 con 0x55f3828a0830 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72bbe00640 10 client.8403 handle_command_reply: tid=0 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 client.8403 shutdown 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 -- 172.21.15.5:0/3683047829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828bf7f0 msgr2=0x55f38289fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828bf7f0 0x55f38289fe20 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f72d4017040 tx=0x7f72d4004ac0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 -- 172.21.15.5:0/3683047829 shutdown_connections 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x55f3828a0830 0x55f3828d0180 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828bf7f0 0x55f38289fe20 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f3828beed0 0x55f38289f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 --2- 172.21.15.5:0/3683047829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f382872910 0x55f38289f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72bbe00640 0 client.8403 ms_handle_reset on v2:172.21.15.117:6835/2108480966 2024-08-18T22:28:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.315+0000 7f72e51d9000 1 -- 172.21.15.5:0/3683047829 >> 172.21.15.5:0/3683047829 conn(0x55f382868010 msgr2=0x55f38286d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.319+0000 7f72e51d9000 1 -- 172.21.15.5:0/3683047829 shutdown_connections 2024-08-18T22:28:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.319+0000 7f72e51d9000 1 -- 172.21.15.5:0/3683047829 wait complete. 2024-08-18T22:28:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.319+0000 7f72e51d9000 20 client.8403 trim_cache size 0 max 16384 2024-08-18T22:28:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72e51d9000 1 Processor -- start 2024-08-18T22:28:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72e51d9000 1 -- start start 2024-08-18T22:28:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f382868010 0x55f3828bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f382872910 0x55f3828bd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828beed0 0x55f3828d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72e51d9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc1ffb40 con 0x55f3828beed0 2024-08-18T22:28:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72e51d9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc15d9a0 con 0x55f382872910 2024-08-18T22:28:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72e51d9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc155430 con 0x55f382868010 2024-08-18T22:28:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72db400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828beed0 0x55f3828d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72db400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828beed0 0x55f3828d0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40674/0 (socket says 172.21.15.5:40674) 2024-08-18T22:28:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72db400640 1 -- 172.21.15.5:0/862381092 learned_addr learned my addr 172.21.15.5:0/862381092 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72daa00640 1 --2- 172.21.15.5:0/862381092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f382868010 0x55f3828bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72da000640 1 --2- 172.21.15.5:0/862381092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f382872910 0x55f3828bd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72db400640 1 -- 172.21.15.5:0/862381092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f382868010 msgr2=0x55f3828bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72db400640 1 --2- 172.21.15.5:0/862381092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f382868010 0x55f3828bccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72db400640 1 -- 172.21.15.5:0/862381092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f382872910 msgr2=0x55f3828bd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72db400640 1 --2- 172.21.15.5:0/862381092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f382872910 0x55f3828bd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72db400640 1 -- 172.21.15.5:0/862381092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f382740dd0 con 0x55f3828beed0 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72db400640 1 --2- 172.21.15.5:0/862381092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828beed0 0x55f3828d0180 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f72d4000f90 tx=0x7f72d4021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64540c8e02f0161 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72c6a00640 1 -- 172.21.15.5:0/862381092 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4037070 con 0x55f3828beed0 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72c6a00640 1 -- 172.21.15.5:0/862381092 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d401a070 con 0x55f3828beed0 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.335+0000 7f72c6a00640 1 -- 172.21.15.5:0/862381092 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4015a50 con 0x55f3828beed0 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 -- 172.21.15.5:0/862381092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828beed0 msgr2=0x55f3828d0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 --2- 172.21.15.5:0/862381092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828beed0 0x55f3828d0180 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f72d4000f90 tx=0x7f72d4021070 comp rx=0 tx=0).stop 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 -- 172.21.15.5:0/862381092 shutdown_connections 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 --2- 172.21.15.5:0/862381092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3828beed0 0x55f3828d0180 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 --2- 172.21.15.5:0/862381092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f382872910 0x55f3828bd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 --2- 172.21.15.5:0/862381092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f382868010 0x55f3828bccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 -- 172.21.15.5:0/862381092 >> 172.21.15.5:0/862381092 conn(0x55f38286d830 msgr2=0x55f3828be120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 -- 172.21.15.5:0/862381092 shutdown_connections 2024-08-18T22:28:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 -- 172.21.15.5:0/862381092 wait complete. 2024-08-18T22:28:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 -- start start 2024-08-18T22:28:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 Processor -- start 2024-08-18T22:28:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382868010 0x55f3828d2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f382872910 0x55f3828d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828beed0 0x55f3828ee470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc15d350 con 0x55f382868010 2024-08-18T22:28:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f3826bd800 con 0x55f3828beed0 2024-08-18T22:28:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f382879bc0 con 0x55f382872910 2024-08-18T22:28:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 10 client.0 _ll_register_callbacks cb 0x7f72d4003a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72daa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382868010 0x55f3828d2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72daa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382868010 0x55f3828d2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40682/0 (socket says 172.21.15.5:40682) 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72daa00640 1 -- 172.21.15.5:0/734294794 learned_addr learned my addr 172.21.15.5:0/734294794 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72da000640 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f382872910 0x55f3828d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72db400640 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828beed0 0x55f3828ee470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72daa00640 1 -- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f382872910 msgr2=0x55f3828d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72daa00640 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f382872910 0x55f3828d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72daa00640 1 -- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828beed0 msgr2=0x55f3828ee470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72daa00640 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828beed0 0x55f3828ee470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72daa00640 1 -- 172.21.15.5:0/734294794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f382651cd0 con 0x55f382868010 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72da000640 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f382872910 0x55f3828d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72db400640 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828beed0 0x55f3828ee470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72daa00640 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382868010 0x55f3828d2f70 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00fd80 tx=0x7f72cc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f845a91669ad34ce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72bbe00640 1 -- 172.21.15.5:0/734294794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc014450 con 0x55f382868010 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72bbe00640 1 -- 172.21.15.5:0/734294794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f72cc010040 con 0x55f382868010 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 -- 172.21.15.5:0/734294794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72d401a070 con 0x55f382868010 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72bbe00640 1 -- 172.21.15.5:0/734294794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f72cc038050 con 0x55f382868010 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 10 client.8409 fetch_fsmap learned FSMap version 100 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.339+0000 7f72e51d9000 1 -- 172.21.15.5:0/734294794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x55f382664320 con 0x55f382868010 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72bbe00640 1 -- 172.21.15.5:0/734294794 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d401a070 con 0x55f382868010 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72bbe00640 1 -- 172.21.15.5:0/734294794 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f72cc03b020 con 0x55f382868010 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 10 client.8409 fetch_fsmap finished waiting for FSMap version 100 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 10 client.8409 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 20 client.8409 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x55f3828bf7f0 0x55f382932500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 4 client.8409 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 -- 172.21.15.5:0/734294794 --> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f3826cbc20 con 0x55f3828bf7f0 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72da000640 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x55f3828bf7f0 0x55f382932500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72da000640 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x55f3828bf7f0 0x55f382932500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de3914c572248606 server_cookie=cfba05c43cbc5c38 in_seq=0 out_seq=0 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72bbe00640 10 client.8409 ms_handle_connect on v2:172.21.15.117:6835/2108480966 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72bbe00640 1 -- 172.21.15.5:0/734294794 <== mds.0 v2:172.21.15.117:6835/2108480966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f3826cbc20 con 0x55f3828bf7f0 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72bbe00640 10 client.8409 handle_command_reply: tid=0 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 client.8409 shutdown 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 -- 172.21.15.5:0/734294794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382868010 msgr2=0x55f3828d2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382868010 0x55f3828d2f70 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00fd80 tx=0x7f72cc000bd0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 -- 172.21.15.5:0/734294794 shutdown_connections 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:6835/2108480966,v1:172.21.15.117:6837/2108480966] conn(0x55f3828bf7f0 0x55f382932500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f3828beed0 0x55f3828ee470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f382872910 0x55f3828d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 --2- 172.21.15.5:0/734294794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f382868010 0x55f3828d2f70 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72bbe00640 0 client.8409 ms_handle_reset on v2:172.21.15.117:6835/2108480966 2024-08-18T22:28:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 -- 172.21.15.5:0/734294794 >> 172.21.15.5:0/734294794 conn(0x55f38286d830 msgr2=0x55f3828bd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 -- 172.21.15.5:0/734294794 shutdown_connections 2024-08-18T22:28:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 1 -- 172.21.15.5:0/734294794 wait complete. 2024-08-18T22:28:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e51d9000 20 client.8409 trim_cache size 0 max 16384 2024-08-18T22:28:04.348 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:28:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-18T22:28:04.348 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-08-18T22:28:04.349 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:28:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 -- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72bc0678c0 msgr2=0x7f72bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72bc0678c0 0x7f72bc069d80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b12f0 tx=0x7f72cc009040 comp rx=0 tx=0).stop 2024-08-18T22:28:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 -- 172.21.15.5:0/487129158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72dc15b1c0 msgr2=0x7f72dc14c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72dc15b1c0 0x7f72dc14c720 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f72c80ad040 tx=0x7f72c801ad30 comp rx=0 tx=0).stop 2024-08-18T22:28:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 -- 172.21.15.5:0/487129158 shutdown_connections 2024-08-18T22:28:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72bc0678c0 0x7f72bc069d80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72dc149180 0x7f72dc14cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72dc15b1c0 0x7f72dc14c720 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 --2- 172.21.15.5:0/487129158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72dc0b4850 0x7f72dc1489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 -- 172.21.15.5:0/487129158 >> 172.21.15.5:0/487129158 conn(0x7f72dc0b65f0 msgr2=0x7f72dc0b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 -- 172.21.15.5:0/487129158 shutdown_connections 2024-08-18T22:28:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.343+0000 7f72e1c00640 1 -- 172.21.15.5:0/487129158 wait complete. 2024-08-18T22:28:04.364 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:28:04.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdecf200640 1 Processor -- start 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdecf200640 1 -- start start 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdecf200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdec815c180 0x7fdec80b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdecf200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdec806fad0 0x7fdec815c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdecf200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec80b5e30 con 0x7fdec8071580 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdecf200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdec815caa0 con 0x7fdec815c180 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdecf200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdec80b6110 con 0x7fdec806fad0 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdec7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdec815c180 0x7fdec80b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdec7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdec815c180 0x7fdec80b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40686/0 (socket says 172.21.15.5:40686) 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdec7e00640 1 -- 172.21.15.5:0/2076782396 learned_addr learned my addr 172.21.15.5:0/2076782396 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdecd200640 1 --1- 172.21.15.5:0/2076782396 >> v1:172.21.15.5:6789/0 conn(0x7fdec8071580 0x7fdec80d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36256/0 (socket says 172.21.15.5:36256) 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdebf400640 1 --2- 172.21.15.5:0/2076782396 >> v2:172.21.15.117:3300/0 conn(0x7fdec806fad0 0x7fdec815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdec7e00640 1 -- 172.21.15.5:0/2076782396 >> v2:172.21.15.117:3300/0 conn(0x7fdec806fad0 msgr2=0x7fdec815c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdec7e00640 1 --2- 172.21.15.5:0/2076782396 >> v2:172.21.15.117:3300/0 conn(0x7fdec806fad0 0x7fdec815c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdec7e00640 1 -- 172.21.15.5:0/2076782396 >> v1:172.21.15.5:6789/0 conn(0x7fdec8071580 legacy=0x7fdec80d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.503+0000 7fdec7e00640 1 -- 172.21.15.5:0/2076782396 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec80b63f0 con 0x7fdec815c180 2024-08-18T22:28:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdec7e00640 1 --2- 172.21.15.5:0/2076782396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec815c180 0x7fdec80b57c0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fdec80694d0 tx=0x7fdeb801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb26a9e0c25102e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdec7400640 1 -- 172.21.15.5:0/2076782396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb80b2070 con 0x7fdec815c180 2024-08-18T22:28:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdec7400640 1 -- 172.21.15.5:0/2076782396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb80a9070 con 0x7fdec815c180 2024-08-18T22:28:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdec7400640 1 -- 172.21.15.5:0/2076782396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb80ad880 con 0x7fdec815c180 2024-08-18T22:28:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdecf200640 1 -- 172.21.15.5:0/2076782396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec815c180 msgr2=0x7fdec80b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdecf200640 1 --2- 172.21.15.5:0/2076782396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec815c180 0x7fdec80b57c0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fdec80694d0 tx=0x7fdeb801c3d0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdecf200640 1 -- 172.21.15.5:0/2076782396 shutdown_connections 2024-08-18T22:28:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdecf200640 1 --2- 172.21.15.5:0/2076782396 >> v2:172.21.15.117:3300/0 conn(0x7fdec806fad0 0x7fdec815c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdecf200640 1 --2- 172.21.15.5:0/2076782396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec815c180 0x7fdec80b57c0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdecf200640 1 -- 172.21.15.5:0/2076782396 >> 172.21.15.5:0/2076782396 conn(0x7fdec80b3eb0 msgr2=0x7fdec80b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdecf200640 1 -- 172.21.15.5:0/2076782396 shutdown_connections 2024-08-18T22:28:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.507+0000 7fdecf200640 1 -- 172.21.15.5:0/2076782396 wait complete. 2024-08-18T22:28:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecf200640 1 Processor -- start 2024-08-18T22:28:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecf200640 1 -- start start 2024-08-18T22:28:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecf200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec806fad0 0x7fdec814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecf200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec8071580 0x7fdec8147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecf200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec815c180 0x7fdec81436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecf200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdec8071da0 con 0x7fdec8071580 2024-08-18T22:28:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecf200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdec8168fd0 con 0x7fdec806fad0 2024-08-18T22:28:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecf200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdec8153630 con 0x7fdec815c180 2024-08-18T22:28:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdebf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec8071580 0x7fdec8147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdebf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec8071580 0x7fdec8147aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40696/0 (socket says 172.21.15.5:40696) 2024-08-18T22:28:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdebf400640 1 -- 172.21.15.5:0/4181886050 learned_addr learned my addr 172.21.15.5:0/4181886050 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecd200640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec815c180 0x7fdec81436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdec7e00640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec806fad0 0x7fdec814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdebf400640 1 -- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec815c180 msgr2=0x7fdec81436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdebf400640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec815c180 0x7fdec81436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdebf400640 1 -- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec806fad0 msgr2=0x7fdec814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdebf400640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec806fad0 0x7fdec814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdebf400640 1 -- 172.21.15.5:0/4181886050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec814a120 con 0x7fdec8071580 2024-08-18T22:28:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdebf400640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec8071580 0x7fdec8147aa0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000d5f0 tx=0x7fdeb000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdec4c00640 1 -- 172.21.15.5:0/4181886050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb00125f0 con 0x7fdec8071580 2024-08-18T22:28:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdec4c00640 1 -- 172.21.15.5:0/4181886050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb0019070 con 0x7fdec8071580 2024-08-18T22:28:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecf200640 1 -- 172.21.15.5:0/4181886050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec814a400 con 0x7fdec8071580 2024-08-18T22:28:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdec4c00640 1 -- 172.21.15.5:0/4181886050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb00129b0 con 0x7fdec8071580 2024-08-18T22:28:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecf200640 1 -- 172.21.15.5:0/4181886050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec814d060 con 0x7fdec8071580 2024-08-18T22:28:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.511+0000 7fdecf200640 1 -- 172.21.15.5:0/4181886050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec815c560 con 0x7fdec8071580 2024-08-18T22:28:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.515+0000 7fdec4c00640 1 -- 172.21.15.5:0/4181886050 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdeb0012b50 con 0x7fdec8071580 2024-08-18T22:28:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.515+0000 7fdec4c00640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea40678c0 0x7fdea4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.515+0000 7fdec4c00640 1 -- 172.21.15.5:0/4181886050 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fdeb0086210 con 0x7fdec8071580 2024-08-18T22:28:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.515+0000 7fdec7e00640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea40678c0 0x7fdea4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.515+0000 7fdec7e00640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea40678c0 0x7fdea4069d80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80af000 tx=0x7fdeb80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.519+0000 7fdec4c00640 1 -- 172.21.15.5:0/4181886050 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdeb0056440 con 0x7fdec8071580 2024-08-18T22:28:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 -- 172.21.15.5:0/4181886050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdec80cf7d0 con 0x7fdec8071580 2024-08-18T22:28:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdec4c00640 1 -- 172.21.15.5:0/4181886050 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5224 (secure 0 0 0) 0x7fdeb005a740 con 0x7fdec8071580 2024-08-18T22:28:04.723 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:04.723 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":100,"btime":"2024-08-18T22:27:27:572472+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1632895454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1632895454},{"type":"v1","addr":"172.21.15.117:6836","nonce":1632895454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/932399139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":932399139},{"type":"v1","addr":"172.21.15.5:6835","nonce":932399139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3229011054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3229011054},{"type":"v1","addr":"172.21.15.5:6834","nonce":3229011054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:27:23.980938+0000","modified":"2024-08-18T22:27:26.969472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2108480966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2108480966},{"type":"v1","addr":"172.21.15.117:6837","nonce":2108480966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8166,"qdb_cluster":[8166]},"id":8}]} 2024-08-18T22:28:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 100 2024-08-18T22:28:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 -- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea40678c0 msgr2=0x7fdea4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea40678c0 0x7fdea4069d80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80af000 tx=0x7fdeb80a7000 comp rx=0 tx=0).stop 2024-08-18T22:28:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 -- 172.21.15.5:0/4181886050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec8071580 msgr2=0x7fdec8147aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec8071580 0x7fdec8147aa0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000d5f0 tx=0x7fdeb000dab0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 -- 172.21.15.5:0/4181886050 shutdown_connections 2024-08-18T22:28:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdea40678c0 0x7fdea4069d80 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec815c180 0x7fdec81436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdec8071580 0x7fdec8147aa0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 --2- 172.21.15.5:0/4181886050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec806fad0 0x7fdec814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 -- 172.21.15.5:0/4181886050 >> 172.21.15.5:0/4181886050 conn(0x7fdec80b3eb0 msgr2=0x7fdec815d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:04.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 -- 172.21.15.5:0/4181886050 shutdown_connections 2024-08-18T22:28:04.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.723+0000 7fdecf200640 1 -- 172.21.15.5:0/4181886050 wait complete. 2024-08-18T22:28:04.744 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-08-18T22:28:04.744 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:28:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.883+0000 7f1ff5a00640 1 Processor -- start 2024-08-18T22:28:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.883+0000 7f1ff5a00640 1 -- start start 2024-08-18T22:28:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.883+0000 7f1ff5a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ff015e460 0x7f1ff006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.883+0000 7f1ff5a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ff00ca3e0 0x7f1ff00ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.883+0000 7f1ff5a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff015e840 con 0x7f1ff00cee40 2024-08-18T22:28:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.883+0000 7f1ff5a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1ff00ae750 con 0x7f1ff00ca3e0 2024-08-18T22:28:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.883+0000 7f1ff5a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff006c900 con 0x7f1ff015e460 2024-08-18T22:28:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.887+0000 7f1fee000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1ff00cee40 0x7f1ff00ae040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36262/0 (socket says 172.21.15.5:36262) 2024-08-18T22:28:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.887+0000 7f1fee000640 1 -- 172.21.15.5:0/539493063 learned_addr learned my addr 172.21.15.5:0/539493063 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.887+0000 7f1fef400640 1 --2- 172.21.15.5:0/539493063 >> v2:172.21.15.117:3300/0 conn(0x7f1ff00ca3e0 0x7f1ff00ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.887+0000 7f1feea00640 1 --2- 172.21.15.5:0/539493063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ff015e460 0x7f1ff006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.887+0000 7f1fed600640 1 -- 172.21.15.5:0/539493063 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707255700 0 0) 0x7f1ff015e840 con 0x7f1ff00cee40 2024-08-18T22:28:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.887+0000 7f1fed600640 1 -- 172.21.15.5:0/539493063 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fd4003530 con 0x7f1ff00cee40 2024-08-18T22:28:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.887+0000 7f1fef400640 1 -- 172.21.15.5:0/539493063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ff015e460 msgr2=0x7f1ff006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.887+0000 7f1fef400640 1 --2- 172.21.15.5:0/539493063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ff015e460 0x7f1ff006c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.887+0000 7f1fef400640 1 -- 172.21.15.5:0/539493063 >> v1:172.21.15.5:6789/0 conn(0x7f1ff00cee40 legacy=0x7f1ff00ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.887+0000 7f1fef400640 1 -- 172.21.15.5:0/539493063 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff00cf320 con 0x7f1ff00ca3e0 2024-08-18T22:28:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.887+0000 7f1fef400640 1 --2- 172.21.15.5:0/539493063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ff00ca3e0 0x7f1ff00ca890 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009d90 tx=0x7f1fe801f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=754f2ef56decf40a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1fed600640 1 -- 172.21.15.5:0/539493063 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80b5070 con 0x7f1ff00ca3e0 2024-08-18T22:28:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1fed600640 1 -- 172.21.15.5:0/539493063 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe80a8dd0 con 0x7f1ff00ca3e0 2024-08-18T22:28:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1fed600640 1 -- 172.21.15.5:0/539493063 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80b0660 con 0x7f1ff00ca3e0 2024-08-18T22:28:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 -- 172.21.15.5:0/539493063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ff00ca3e0 msgr2=0x7f1ff00ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 --2- 172.21.15.5:0/539493063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ff00ca3e0 0x7f1ff00ca890 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009d90 tx=0x7f1fe801f080 comp rx=0 tx=0).stop 2024-08-18T22:28:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 -- 172.21.15.5:0/539493063 shutdown_connections 2024-08-18T22:28:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 --2- 172.21.15.5:0/539493063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ff00ca3e0 0x7f1ff00ca890 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 --2- 172.21.15.5:0/539493063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ff015e460 0x7f1ff006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 -- 172.21.15.5:0/539493063 >> 172.21.15.5:0/539493063 conn(0x7f1ff009aa40 msgr2=0x7f1ff00b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 -- 172.21.15.5:0/539493063 shutdown_connections 2024-08-18T22:28:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 -- 172.21.15.5:0/539493063 wait complete. 2024-08-18T22:28:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 Processor -- start 2024-08-18T22:28:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 -- start start 2024-08-18T22:28:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ff00ca3e0 0x7f1ff0151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ff00cee40 0x7f1ff015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015e460 0x7f1ff015d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff00cfbc0 con 0x7f1ff015e460 2024-08-18T22:28:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff00cf8e0 con 0x7f1ff00ca3e0 2024-08-18T22:28:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1ff5a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff00cfea0 con 0x7f1ff00cee40 2024-08-18T22:28:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1fef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015e460 0x7f1ff015d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1fef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015e460 0x7f1ff015d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40704/0 (socket says 172.21.15.5:40704) 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1fef400640 1 -- 172.21.15.5:0/1958663465 learned_addr learned my addr 172.21.15.5:0/1958663465 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1feea00640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ff00ca3e0 0x7f1ff0151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.891+0000 7f1fee000640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ff00cee40 0x7f1ff015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fef400640 1 -- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ff00cee40 msgr2=0x7f1ff015cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fef400640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ff00cee40 0x7f1ff015cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fef400640 1 -- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ff00ca3e0 msgr2=0x7f1ff0151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fef400640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ff00ca3e0 0x7f1ff0151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fef400640 1 -- 172.21.15.5:0/1958663465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff00b41e0 con 0x7f1ff015e460 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fee000640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ff00cee40 0x7f1ff015cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fef400640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015e460 0x7f1ff015d070 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80b3040 tx=0x7f1fe801be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fe6a00640 1 -- 172.21.15.5:0/1958663465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80b5040 con 0x7f1ff015e460 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fe6a00640 1 -- 172.21.15.5:0/1958663465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe80c2070 con 0x7f1ff015e460 2024-08-18T22:28:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1ff5a00640 1 -- 172.21.15.5:0/1958663465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff00b44c0 con 0x7f1ff015e460 2024-08-18T22:28:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fe6a00640 1 -- 172.21.15.5:0/1958663465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8009450 con 0x7f1ff015e460 2024-08-18T22:28:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1ff5a00640 1 -- 172.21.15.5:0/1958663465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff00b4a80 con 0x7f1ff015e460 2024-08-18T22:28:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1ff5a00640 1 -- 172.21.15.5:0/1958663465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff00b3620 con 0x7f1ff015e460 2024-08-18T22:28:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fe6a00640 1 -- 172.21.15.5:0/1958663465 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1fe80b0ca0 con 0x7f1ff015e460 2024-08-18T22:28:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fe6a00640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fd00678f0 0x7f1fd0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1fe6a00640 1 -- 172.21.15.5:0/1958663465 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f1fe8124440 con 0x7f1ff015e460 2024-08-18T22:28:04.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.895+0000 7f1feea00640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fd00678f0 0x7f1fd0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:04.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.899+0000 7f1feea00640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fd00678f0 0x7f1fd0069db0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009ac0 tx=0x7f1fe0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:04.903+0000 7f1fe6a00640 1 -- 172.21.15.5:0/1958663465 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1fe8018be0 con 0x7f1ff015e460 2024-08-18T22:28:05.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.127+0000 7f1ff5a00640 1 -- 172.21.15.5:0/1958663465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1ff00aed30 con 0x7f1ff015e460 2024-08-18T22:28:05.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.127+0000 7f1fe6a00640 1 -- 172.21.15.5:0/1958663465 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1231 (secure 0 0 0) 0x7f1fe80f4f00 con 0x7f1ff015e460 2024-08-18T22:28:05.129 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:05.129 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":548,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":129,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076443502,"bytes_used":2554757120,"bytes_avail":770539356160,"bytes_total":773094113280,"write_bytes_sec":37767065,"read_op_per_sec":0,"write_op_per_sec":38},"fsmap":{"epoch":100,"btime":"2024-08-18T22:27:27:572472+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"b","status":"up:active","gid":8166}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-08-18T22:26:45.730180+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:28:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 -- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fd00678f0 msgr2=0x7f1fd0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fd00678f0 0x7f1fd0069db0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009ac0 tx=0x7f1fe0009190 comp rx=0 tx=0).stop 2024-08-18T22:28:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 -- 172.21.15.5:0/1958663465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015e460 msgr2=0x7f1ff015d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015e460 0x7f1ff015d070 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80b3040 tx=0x7f1fe801be20 comp rx=0 tx=0).stop 2024-08-18T22:28:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 -- 172.21.15.5:0/1958663465 shutdown_connections 2024-08-18T22:28:05.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fd00678f0 0x7f1fd0069db0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ff015e460 0x7f1ff015d070 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ff00cee40 0x7f1ff015cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 --2- 172.21.15.5:0/1958663465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ff00ca3e0 0x7f1ff0151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 -- 172.21.15.5:0/1958663465 >> 172.21.15.5:0/1958663465 conn(0x7f1ff009aa40 msgr2=0x7f1ff00af530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:05.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 -- 172.21.15.5:0/1958663465 shutdown_connections 2024-08-18T22:28:05.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.131+0000 7f1ff5a00640 1 -- 172.21.15.5:0/1958663465 wait complete. 2024-08-18T22:28:05.151 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-08-18T22:28:05.151 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:28:05.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:28:05.249 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:28:05.340 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:28:05.340 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:28:05.340 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:28:05.340 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:05.349 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:28:05.349 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:05.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:28:05.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc350800640 1 Processor -- start 2024-08-18T22:28:05.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc350800640 1 -- start start 2024-08-18T22:28:05.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc350800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34809aca0 0x7fc3480afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:05.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc350800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc34809b080 0x7fc3480b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:05.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc350800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc34806e8a0 con 0x7fc3480b1300 2024-08-18T22:28:05.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc350800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc34809bb80 con 0x7fc34809b080 2024-08-18T22:28:05.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc350800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc3480d2e40 con 0x7fc34809aca0 2024-08-18T22:28:05.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc34d400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3480b1300 0x7fc3480affd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36270/0 (socket says 172.21.15.5:36270) 2024-08-18T22:28:05.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc34d400640 1 -- 172.21.15.5:0/454797457 learned_addr learned my addr 172.21.15.5:0/454797457 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:05.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc34de00640 1 --2- 172.21.15.5:0/454797457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34809aca0 0x7fc3480afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:05.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc34e800640 1 --2- 172.21.15.5:0/454797457 >> v2:172.21.15.117:3300/0 conn(0x7fc34809b080 0x7fc3480b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:05.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc34ca00640 1 -- 172.21.15.5:0/454797457 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 385655935 0 0) 0x7fc34806e8a0 con 0x7fc3480b1300 2024-08-18T22:28:05.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc34ca00640 1 -- 172.21.15.5:0/454797457 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc330003530 con 0x7fc3480b1300 2024-08-18T22:28:05.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc34e800640 1 -- 172.21.15.5:0/454797457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34809aca0 msgr2=0x7fc3480afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:05.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc34e800640 1 --2- 172.21.15.5:0/454797457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34809aca0 0x7fc3480afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc34e800640 1 -- 172.21.15.5:0/454797457 >> v1:172.21.15.5:6789/0 conn(0x7fc3480b1300 legacy=0x7fc3480affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:05.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.587+0000 7fc34e800640 1 -- 172.21.15.5:0/454797457 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34806cbd0 con 0x7fc34809b080 2024-08-18T22:28:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc34e800640 1 --2- 172.21.15.5:0/454797457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34809b080 0x7fc3480b06e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc344009dc0 tx=0x7fc34401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=231e2104119b3e7a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:05.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc34ca00640 1 -- 172.21.15.5:0/454797457 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3440b2070 con 0x7fc34809b080 2024-08-18T22:28:05.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc34ca00640 1 -- 172.21.15.5:0/454797457 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3440a58c0 con 0x7fc34809b080 2024-08-18T22:28:05.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc34ca00640 1 -- 172.21.15.5:0/454797457 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3440a5c70 con 0x7fc34809b080 2024-08-18T22:28:05.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc350800640 1 -- 172.21.15.5:0/454797457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34809b080 msgr2=0x7fc3480b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:05.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc350800640 1 --2- 172.21.15.5:0/454797457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34809b080 0x7fc3480b06e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc344009dc0 tx=0x7fc34401c950 comp rx=0 tx=0).stop 2024-08-18T22:28:05.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc350800640 1 -- 172.21.15.5:0/454797457 shutdown_connections 2024-08-18T22:28:05.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc350800640 1 --2- 172.21.15.5:0/454797457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34809b080 0x7fc3480b06e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc350800640 1 --2- 172.21.15.5:0/454797457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34809aca0 0x7fc3480afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc350800640 1 -- 172.21.15.5:0/454797457 >> 172.21.15.5:0/454797457 conn(0x7fc3480d2180 msgr2=0x7fc3480d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:05.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc350800640 1 -- 172.21.15.5:0/454797457 shutdown_connections 2024-08-18T22:28:05.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.591+0000 7fc350800640 1 -- 172.21.15.5:0/454797457 wait complete. 2024-08-18T22:28:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc350800640 1 Processor -- start 2024-08-18T22:28:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc350800640 1 -- start start 2024-08-18T22:28:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc350800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34809aca0 0x7fc348155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc350800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34809b080 0x7fc34815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc350800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b1300 0x7fc348150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc350800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc34816b6b0 con 0x7fc34809b080 2024-08-18T22:28:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc350800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc34816b530 con 0x7fc34809aca0 2024-08-18T22:28:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc350800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc34816b830 con 0x7fc3480b1300 2024-08-18T22:28:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34809b080 0x7fc34815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34809b080 0x7fc34815ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40718/0 (socket says 172.21.15.5:40718) 2024-08-18T22:28:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34d400640 1 -- 172.21.15.5:0/3690038830 learned_addr learned my addr 172.21.15.5:0/3690038830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34de00640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34809aca0 0x7fc348155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34e800640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b1300 0x7fc348150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34d400640 1 -- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b1300 msgr2=0x7fc348150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34d400640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b1300 0x7fc348150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34d400640 1 -- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34809aca0 msgr2=0x7fc348155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34d400640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34809aca0 0x7fc348155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34d400640 1 -- 172.21.15.5:0/3690038830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3481565b0 con 0x7fc34809b080 2024-08-18T22:28:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34e800640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b1300 0x7fc348150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc34d400640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34809b080 0x7fc34815ced0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fc33800c3c0 tx=0x7fc33800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc342000640 1 -- 172.21.15.5:0/3690038830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338017070 con 0x7fc34809b080 2024-08-18T22:28:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc342000640 1 -- 172.21.15.5:0/3690038830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc338005d10 con 0x7fc34809b080 2024-08-18T22:28:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc342000640 1 -- 172.21.15.5:0/3690038830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338007310 con 0x7fc34809b080 2024-08-18T22:28:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc350800640 1 -- 172.21.15.5:0/3690038830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc348156890 con 0x7fc34809b080 2024-08-18T22:28:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.595+0000 7fc350800640 1 -- 172.21.15.5:0/3690038830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc348156e50 con 0x7fc34809b080 2024-08-18T22:28:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.599+0000 7fc350800640 1 -- 172.21.15.5:0/3690038830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc348161940 con 0x7fc34809b080 2024-08-18T22:28:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.599+0000 7fc342000640 1 -- 172.21.15.5:0/3690038830 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc33801a070 con 0x7fc34809b080 2024-08-18T22:28:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.599+0000 7fc342000640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc32c0678f0 0x7fc32c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:05.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.599+0000 7fc342000640 1 -- 172.21.15.5:0/3690038830 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fc338085280 con 0x7fc34809b080 2024-08-18T22:28:05.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.599+0000 7fc34de00640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc32c0678f0 0x7fc32c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:05.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.599+0000 7fc34de00640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc32c0678f0 0x7fc32c069db0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009af0 tx=0x7fc33c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.603+0000 7fc342000640 1 -- 172.21.15.5:0/3690038830 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc338055c50 con 0x7fc34809b080 2024-08-18T22:28:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 -- 172.21.15.5:0/3690038830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc34806dff0 con 0x7fc34809b080 2024-08-18T22:28:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc342000640 1 -- 172.21.15.5:0/3690038830 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v129) ==== 80+0+0 (secure 0 0 0) 0x7fc338055550 con 0x7fc34809b080 2024-08-18T22:28:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:28:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 -- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc32c0678f0 msgr2=0x7fc32c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc32c0678f0 0x7fc32c069db0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009af0 tx=0x7fc33c008040 comp rx=0 tx=0).stop 2024-08-18T22:28:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 -- 172.21.15.5:0/3690038830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34809b080 msgr2=0x7fc34815ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34809b080 0x7fc34815ced0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fc33800c3c0 tx=0x7fc33800c880 comp rx=0 tx=0).stop 2024-08-18T22:28:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 -- 172.21.15.5:0/3690038830 shutdown_connections 2024-08-18T22:28:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc32c0678f0 0x7fc32c069db0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3480b1300 0x7fc348150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc34809b080 0x7fc34815ced0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 --2- 172.21.15.5:0/3690038830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34809aca0 0x7fc348155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 -- 172.21.15.5:0/3690038830 >> 172.21.15.5:0/3690038830 conn(0x7fc3480d2180 msgr2=0x7fc3480b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 -- 172.21.15.5:0/3690038830 shutdown_connections 2024-08-18T22:28:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:05.783+0000 7fc350800640 1 -- 172.21.15.5:0/3690038830 wait complete. 2024-08-18T22:28:05.804 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:28:05.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:05.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:28:06.567 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:28:06.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:06.567 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:28:06.576 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:28:06.576 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:28:06.577 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:06.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:28:06.585 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:28:06.585 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:28:06.585 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:06.626 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:28:06.626 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:28:06.626 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:28:06.626 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:06.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:28:06.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a95800640 1 Processor -- start 2024-08-18T22:28:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a95800640 1 -- start start 2024-08-18T22:28:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a95800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3a9009aa40 0x7f3a9015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a95800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900cde30 0x7f3a9009ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a95800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a9009b360 con 0x7f3a900b4510 2024-08-18T22:28:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a95800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3a900ce770 con 0x7f3a9009aa40 2024-08-18T22:28:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a95800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9015d520 con 0x7f3a900cde30 2024-08-18T22:28:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a94e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3a900b4510 0x7f3a9015fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36280/0 (socket says 172.21.15.5:36280) 2024-08-18T22:28:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a94e00640 1 -- 172.21.15.5:0/2088041751 learned_addr learned my addr 172.21.15.5:0/2088041751 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a87400640 1 --2- 172.21.15.5:0/2088041751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900cde30 0x7f3a9009ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a8fe00640 1 --2- 172.21.15.5:0/2088041751 >> v2:172.21.15.117:3300/0 conn(0x7f3a9009aa40 0x7f3a9015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a8f400640 1 -- 172.21.15.5:0/2088041751 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008411252 0 0) 0x7f3a9009b360 con 0x7f3a900b4510 2024-08-18T22:28:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a8f400640 1 -- 172.21.15.5:0/2088041751 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a74003530 con 0x7f3a900b4510 2024-08-18T22:28:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a8f400640 1 -- 172.21.15.5:0/2088041751 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 477585219 0 0) 0x7f3a74003530 con 0x7f3a900b4510 2024-08-18T22:28:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a87400640 1 -- 172.21.15.5:0/2088041751 >> v2:172.21.15.117:3300/0 conn(0x7f3a9009aa40 msgr2=0x7f3a9015cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a87400640 1 --2- 172.21.15.5:0/2088041751 >> v2:172.21.15.117:3300/0 conn(0x7f3a9009aa40 0x7f3a9015cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a87400640 1 -- 172.21.15.5:0/2088041751 >> v1:172.21.15.5:6789/0 conn(0x7f3a900b4510 legacy=0x7f3a9015fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a87400640 1 -- 172.21.15.5:0/2088041751 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a900ccd90 con 0x7f3a900cde30 2024-08-18T22:28:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.811+0000 7f3a8fe00640 1 --2- 172.21.15.5:0/2088041751 >> v2:172.21.15.117:3300/0 conn(0x7f3a9009aa40 0x7f3a9015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a87400640 1 --2- 172.21.15.5:0/2088041751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900cde30 0x7f3a9009ae20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a780097c0 tx=0x7f3a7801c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c21c6cd3a7eb073c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a8f400640 1 -- 172.21.15.5:0/2088041751 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780b0070 con 0x7f3a900cde30 2024-08-18T22:28:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a8f400640 1 -- 172.21.15.5:0/2088041751 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a780ab400 con 0x7f3a900cde30 2024-08-18T22:28:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a8f400640 1 -- 172.21.15.5:0/2088041751 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88001a00 con 0x7f3a900cde30 2024-08-18T22:28:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a95800640 1 -- 172.21.15.5:0/2088041751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900cde30 msgr2=0x7f3a9009ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a95800640 1 --2- 172.21.15.5:0/2088041751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900cde30 0x7f3a9009ae20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a780097c0 tx=0x7f3a7801c390 comp rx=0 tx=0).stop 2024-08-18T22:28:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a95800640 1 -- 172.21.15.5:0/2088041751 shutdown_connections 2024-08-18T22:28:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a95800640 1 --2- 172.21.15.5:0/2088041751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900cde30 0x7f3a9009ae20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a95800640 1 --2- 172.21.15.5:0/2088041751 >> v2:172.21.15.117:3300/0 conn(0x7f3a9009aa40 0x7f3a9015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a95800640 1 -- 172.21.15.5:0/2088041751 >> 172.21.15.5:0/2088041751 conn(0x7f3a900b3a20 msgr2=0x7f3a900b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a95800640 1 -- 172.21.15.5:0/2088041751 shutdown_connections 2024-08-18T22:28:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a95800640 1 -- 172.21.15.5:0/2088041751 wait complete. 2024-08-18T22:28:06.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.815+0000 7f3a95800640 1 Processor -- start 2024-08-18T22:28:06.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a95800640 1 -- start start 2024-08-18T22:28:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a95800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a9009aa40 0x7f3a900b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a95800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900b4510 0x7f3a9006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a95800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900cde30 0x7f3a900c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a95800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9015c230 con 0x7f3a9009aa40 2024-08-18T22:28:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a95800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3a900cd910 con 0x7f3a900cde30 2024-08-18T22:28:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a95800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9015c3b0 con 0x7f3a900b4510 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a9009aa40 0x7f3a900b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a9009aa40 0x7f3a900b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40724/0 (socket says 172.21.15.5:40724) 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8fe00640 1 -- 172.21.15.5:0/1475227878 learned_addr learned my addr 172.21.15.5:0/1475227878 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a87400640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900b4510 0x7f3a9006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a94e00640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900cde30 0x7f3a900c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8fe00640 1 -- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900b4510 msgr2=0x7f3a9006fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8fe00640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900b4510 0x7f3a9006fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8fe00640 1 -- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900cde30 msgr2=0x7f3a900c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8fe00640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900cde30 0x7f3a900c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8fe00640 1 -- 172.21.15.5:0/1475227878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a900b7910 con 0x7f3a9009aa40 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a87400640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900b4510 0x7f3a9006fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8fe00640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a9009aa40 0x7f3a900b5c30 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000ebe0 tx=0x7f3a8000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8cc00640 1 -- 172.21.15.5:0/1475227878 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80017070 con 0x7f3a9009aa40 2024-08-18T22:28:06.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8cc00640 1 -- 172.21.15.5:0/1475227878 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8000cc30 con 0x7f3a9009aa40 2024-08-18T22:28:06.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a8cc00640 1 -- 172.21.15.5:0/1475227878 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80013470 con 0x7f3a9009aa40 2024-08-18T22:28:06.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a95800640 1 -- 172.21.15.5:0/1475227878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a900b7bf0 con 0x7f3a9009aa40 2024-08-18T22:28:06.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a95800640 1 -- 172.21.15.5:0/1475227878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a90159f20 con 0x7f3a9009aa40 2024-08-18T22:28:06.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.819+0000 7f3a95800640 1 -- 172.21.15.5:0/1475227878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a9015cfe0 con 0x7f3a9009aa40 2024-08-18T22:28:06.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.823+0000 7f3a8cc00640 1 -- 172.21.15.5:0/1475227878 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a8001a070 con 0x7f3a9009aa40 2024-08-18T22:28:06.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.823+0000 7f3a8cc00640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3a6c0678c0 0x7f3a6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:06.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.823+0000 7f3a8cc00640 1 -- 172.21.15.5:0/1475227878 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f3a80086160 con 0x7f3a9009aa40 2024-08-18T22:28:06.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.823+0000 7f3a87400640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3a6c0678c0 0x7f3a6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:06.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.823+0000 7f3a87400640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3a6c0678c0 0x7f3a6c069d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3a780097c0 tx=0x7f3a780a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:06.827+0000 7f3a8cc00640 1 -- 172.21.15.5:0/1475227878 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f3a80056b00 con 0x7f3a9009aa40 2024-08-18T22:28:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.023+0000 7f3a95800640 1 -- 172.21.15.5:0/1475227878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a90073d40 con 0x7f3a9009aa40 2024-08-18T22:28:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.023+0000 7f3a8cc00640 1 -- 172.21.15.5:0/1475227878 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5224 (secure 0 0 0) 0x7f3a80056400 con 0x7f3a9009aa40 2024-08-18T22:28:07.026 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:07.026 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":100,"btime":"2024-08-18T22:27:27:572472+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1632895454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1632895454},{"type":"v1","addr":"172.21.15.117:6836","nonce":1632895454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/932399139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":932399139},{"type":"v1","addr":"172.21.15.5:6835","nonce":932399139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3229011054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3229011054},{"type":"v1","addr":"172.21.15.5:6834","nonce":3229011054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:27:23.980938+0000","modified":"2024-08-18T22:27:26.969472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2108480966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2108480966},{"type":"v1","addr":"172.21.15.117:6837","nonce":2108480966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8166,"qdb_cluster":[8166]},"id":8}]} 2024-08-18T22:28:07.026 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 100 2024-08-18T22:28:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 -- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3a6c0678c0 msgr2=0x7f3a6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3a6c0678c0 0x7f3a6c069d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3a780097c0 tx=0x7f3a780a6000 comp rx=0 tx=0).stop 2024-08-18T22:28:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 -- 172.21.15.5:0/1475227878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a9009aa40 msgr2=0x7f3a900b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a9009aa40 0x7f3a900b5c30 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000ebe0 tx=0x7f3a8000c520 comp rx=0 tx=0).stop 2024-08-18T22:28:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 -- 172.21.15.5:0/1475227878 shutdown_connections 2024-08-18T22:28:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3a6c0678c0 0x7f3a6c069d80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a900cde30 0x7f3a900c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a900b4510 0x7f3a9006fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 --2- 172.21.15.5:0/1475227878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a9009aa40 0x7f3a900b5c30 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 -- 172.21.15.5:0/1475227878 >> 172.21.15.5:0/1475227878 conn(0x7f3a900b3a20 msgr2=0x7f3a900cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:07.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 -- 172.21.15.5:0/1475227878 shutdown_connections 2024-08-18T22:28:07.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.027+0000 7f3a95800640 1 -- 172.21.15.5:0/1475227878 wait complete. 2024-08-18T22:28:07.047 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:07.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.187+0000 7f0b32200640 1 Processor -- start 2024-08-18T22:28:07.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.187+0000 7f0b32200640 1 -- start start 2024-08-18T22:28:07.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.187+0000 7f0b32200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b2c0b54c0 0x7f0b2c071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.187+0000 7f0b32200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0b2c0cbed0 0x7f0b2c0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.187+0000 7f0b32200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2c071c80 con 0x7f0b2c06dd80 2024-08-18T22:28:07.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.187+0000 7f0b32200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0b2c0cba40 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.187+0000 7f0b32200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0b2c071f60 con 0x7f0b2c0cbed0 2024-08-18T22:28:07.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.187+0000 7f0b2b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b2c0b54c0 0x7f0b2c071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.187+0000 7f0b2b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b2c0b54c0 0x7f0b2c071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40730/0 (socket says 172.21.15.5:40730) 2024-08-18T22:28:07.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.187+0000 7f0b2b400640 1 -- 172.21.15.5:0/2620117374 learned_addr learned my addr 172.21.15.5:0/2620117374 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:07.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b2be00640 1 --2- 172.21.15.5:0/2620117374 >> v2:172.21.15.117:3300/0 conn(0x7f0b2c0cbed0 0x7f0b2c0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b2b400640 1 -- 172.21.15.5:0/2620117374 >> v2:172.21.15.117:3300/0 conn(0x7f0b2c0cbed0 msgr2=0x7f0b2c0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:07.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b2b400640 1 --2- 172.21.15.5:0/2620117374 >> v2:172.21.15.117:3300/0 conn(0x7f0b2c0cbed0 0x7f0b2c0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b2b400640 1 -- 172.21.15.5:0/2620117374 >> v1:172.21.15.117:6789/0 conn(0x7f0b2c06dd80 legacy=0x7f0b2c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:07.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b2b400640 1 -- 172.21.15.5:0/2620117374 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c0cb6d0 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b2be00640 1 --2- 172.21.15.5:0/2620117374 >> v2:172.21.15.117:3300/0 conn(0x7f0b2c0cbed0 0x7f0b2c0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:07.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b2b400640 1 --2- 172.21.15.5:0/2620117374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b54c0 0x7f0b2c071580 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c06f4c0 tx=0x7f0b1c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ecb8d027008132 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:07.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b2aa00640 1 -- 172.21.15.5:0/2620117374 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c0b5070 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b2aa00640 1 -- 172.21.15.5:0/2620117374 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1c0a89d0 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b2aa00640 1 -- 172.21.15.5:0/2620117374 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c0a8da0 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b32200640 1 -- 172.21.15.5:0/2620117374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b54c0 msgr2=0x7f0b2c071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.191+0000 7f0b32200640 1 --2- 172.21.15.5:0/2620117374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b54c0 0x7f0b2c071580 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c06f4c0 tx=0x7f0b1c01ecd0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 -- 172.21.15.5:0/2620117374 shutdown_connections 2024-08-18T22:28:07.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 --2- 172.21.15.5:0/2620117374 >> v2:172.21.15.117:3300/0 conn(0x7f0b2c0cbed0 0x7f0b2c0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 --2- 172.21.15.5:0/2620117374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b54c0 0x7f0b2c071580 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 -- 172.21.15.5:0/2620117374 >> 172.21.15.5:0/2620117374 conn(0x7f0b2c0b3eb0 msgr2=0x7f0b2c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:07.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 -- 172.21.15.5:0/2620117374 shutdown_connections 2024-08-18T22:28:07.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 -- 172.21.15.5:0/2620117374 wait complete. 2024-08-18T22:28:07.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 Processor -- start 2024-08-18T22:28:07.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 -- start start 2024-08-18T22:28:07.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b2c06dd80 0x7f0b2c1f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b54c0 0x7f0b2c1604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b2c0cbed0 0x7f0b2c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c1481a0 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c148020 con 0x7f0b2c0cbed0 2024-08-18T22:28:07.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b32200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2c0cc8a0 con 0x7f0b2c06dd80 2024-08-18T22:28:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b22a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b54c0 0x7f0b2c1604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b22a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b54c0 0x7f0b2c1604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40740/0 (socket says 172.21.15.5:40740) 2024-08-18T22:28:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b22a00640 1 -- 172.21.15.5:0/651242484 learned_addr learned my addr 172.21.15.5:0/651242484 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b2b400640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b2c06dd80 0x7f0b2c1f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b2be00640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b2c0cbed0 0x7f0b2c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b22a00640 1 -- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b2c06dd80 msgr2=0x7f0b2c1f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b22a00640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b2c06dd80 0x7f0b2c1f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b22a00640 1 -- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b2c0cbed0 msgr2=0x7f0b2c0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b22a00640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b2c0cbed0 0x7f0b2c0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b22a00640 1 -- 172.21.15.5:0/651242484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c15ec70 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b22a00640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b54c0 0x7f0b2c1604c0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c480 tx=0x7f0b1400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b23e00640 1 -- 172.21.15.5:0/651242484 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14012830 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b23e00640 1 -- 172.21.15.5:0/651242484 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b14017070 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.195+0000 7f0b23e00640 1 -- 172.21.15.5:0/651242484 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14012c30 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.199+0000 7f0b32200640 1 -- 172.21.15.5:0/651242484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2c15ef50 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.199+0000 7f0b32200640 1 -- 172.21.15.5:0/651242484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2c15f510 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.199+0000 7f0b32200640 1 -- 172.21.15.5:0/651242484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b2c0cc360 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.199+0000 7f0b23e00640 1 -- 172.21.15.5:0/651242484 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0b1401c460 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.199+0000 7f0b23e00640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b080678c0 0x7f0b08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.199+0000 7f0b23e00640 1 -- 172.21.15.5:0/651242484 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f0b14085cc0 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.199+0000 7f0b2b400640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b080678c0 0x7f0b08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.199+0000 7f0b2b400640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b080678c0 0x7f0b08069d80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0b2000 tx=0x7f0b1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:07.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.203+0000 7f0b23e00640 1 -- 172.21.15.5:0/651242484 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0b1408c080 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 -- 172.21.15.5:0/651242484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b2c15f6e0 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b23e00640 1 -- 172.21.15.5:0/651242484 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5224 (secure 0 0 0) 0x7f0b14056660 con 0x7f0b2c0b54c0 2024-08-18T22:28:07.404 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:07.404 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":100,"btime":"2024-08-18T22:27:27:572472+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1632895454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1632895454},{"type":"v1","addr":"172.21.15.117:6836","nonce":1632895454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/932399139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":932399139},{"type":"v1","addr":"172.21.15.5:6835","nonce":932399139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3229011054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3229011054},{"type":"v1","addr":"172.21.15.5:6834","nonce":3229011054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:27:23.980938+0000","modified":"2024-08-18T22:27:26.969472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2108480966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2108480966},{"type":"v1","addr":"172.21.15.117:6837","nonce":2108480966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8166,"qdb_cluster":[8166]},"id":8}]} 2024-08-18T22:28:07.404 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 100 2024-08-18T22:28:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 -- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b080678c0 msgr2=0x7f0b08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b080678c0 0x7f0b08069d80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0b2000 tx=0x7f0b1c008040 comp rx=0 tx=0).stop 2024-08-18T22:28:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 -- 172.21.15.5:0/651242484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b54c0 msgr2=0x7f0b2c1604c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b54c0 0x7f0b2c1604c0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c480 tx=0x7f0b1400c940 comp rx=0 tx=0).stop 2024-08-18T22:28:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 -- 172.21.15.5:0/651242484 shutdown_connections 2024-08-18T22:28:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0b080678c0 0x7f0b08069d80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b2c0cbed0 0x7f0b2c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b54c0 0x7f0b2c1604c0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 --2- 172.21.15.5:0/651242484 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b2c06dd80 0x7f0b2c1f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 -- 172.21.15.5:0/651242484 >> 172.21.15.5:0/651242484 conn(0x7f0b2c0b3eb0 msgr2=0x7f0b2c0b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 -- 172.21.15.5:0/651242484 shutdown_connections 2024-08-18T22:28:07.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.403+0000 7f0b32200640 1 -- 172.21.15.5:0/651242484 wait complete. 2024-08-18T22:28:07.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:28:07.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.563+0000 7f2e8ae00640 1 Processor -- start 2024-08-18T22:28:07.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.563+0000 7f2e8ae00640 1 -- start start 2024-08-18T22:28:07.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.563+0000 7f2e8ae00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e8415e460 0x7f2e8406c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e8ae00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e840ca3e0 0x7f2e840ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e8ae00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8415e840 con 0x7f2e840cee40 2024-08-18T22:28:07.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e8ae00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2e840ae750 con 0x7f2e840ca3e0 2024-08-18T22:28:07.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e8ae00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2e8406c900 con 0x7f2e8415e460 2024-08-18T22:28:07.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e88e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e840ca3e0 0x7f2e840ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e88e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e840ca3e0 0x7f2e840ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40742/0 (socket says 172.21.15.5:40742) 2024-08-18T22:28:07.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e88e00640 1 -- 172.21.15.5:0/2375504333 learned_addr learned my addr 172.21.15.5:0/2375504333 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:07.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e83e00640 1 --2- 172.21.15.5:0/2375504333 >> v2:172.21.15.117:3300/0 conn(0x7f2e8415e460 0x7f2e8406c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e88e00640 1 -- 172.21.15.5:0/2375504333 >> v2:172.21.15.117:3300/0 conn(0x7f2e8415e460 msgr2=0x7f2e8406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e88e00640 1 --2- 172.21.15.5:0/2375504333 >> v2:172.21.15.117:3300/0 conn(0x7f2e8415e460 0x7f2e8406c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e88e00640 1 -- 172.21.15.5:0/2375504333 >> v1:172.21.15.117:6789/0 conn(0x7f2e840cee40 legacy=0x7f2e840ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e88e00640 1 -- 172.21.15.5:0/2375504333 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e840cf320 con 0x7f2e840ca3e0 2024-08-18T22:28:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e83e00640 1 --2- 172.21.15.5:0/2375504333 >> v2:172.21.15.117:3300/0 conn(0x7f2e8415e460 0x7f2e8406c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:07.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e88e00640 1 --2- 172.21.15.5:0/2375504333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e840ca3e0 0x7f2e840ca890 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f2e840ceb50 tx=0x7f2e7c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae93698be5c8e15 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:07.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e82a00640 1 -- 172.21.15.5:0/2375504333 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0b4070 con 0x7f2e840ca3e0 2024-08-18T22:28:07.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e82a00640 1 -- 172.21.15.5:0/2375504333 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c0af400 con 0x7f2e840ca3e0 2024-08-18T22:28:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.567+0000 7f2e82a00640 1 -- 172.21.15.5:0/2375504333 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0af7d0 con 0x7f2e840ca3e0 2024-08-18T22:28:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 -- 172.21.15.5:0/2375504333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e840ca3e0 msgr2=0x7f2e840ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 --2- 172.21.15.5:0/2375504333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e840ca3e0 0x7f2e840ca890 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f2e840ceb50 tx=0x7f2e7c01f1e0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 -- 172.21.15.5:0/2375504333 shutdown_connections 2024-08-18T22:28:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 --2- 172.21.15.5:0/2375504333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e840ca3e0 0x7f2e840ca890 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 --2- 172.21.15.5:0/2375504333 >> v2:172.21.15.117:3300/0 conn(0x7f2e8415e460 0x7f2e8406c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 -- 172.21.15.5:0/2375504333 >> 172.21.15.5:0/2375504333 conn(0x7f2e8409aa40 msgr2=0x7f2e840b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 -- 172.21.15.5:0/2375504333 shutdown_connections 2024-08-18T22:28:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 -- 172.21.15.5:0/2375504333 wait complete. 2024-08-18T22:28:07.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 Processor -- start 2024-08-18T22:28:07.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 -- start start 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e840ca3e0 0x7f2e840b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e840cee40 0x7f2e840b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e8415e460 0x7f2e8414ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2e840cfbc0 con 0x7f2e840ca3e0 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2e840cf8e0 con 0x7f2e8415e460 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e8ae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2e840cfea0 con 0x7f2e840cee40 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e83e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e840ca3e0 0x7f2e840b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e83e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e840ca3e0 0x7f2e840b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40750/0 (socket says 172.21.15.5:40750) 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e83e00640 1 -- 172.21.15.5:0/1289572439 learned_addr learned my addr 172.21.15.5:0/1289572439 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e88e00640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e8415e460 0x7f2e8414ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e83400640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e840cee40 0x7f2e840b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e83e00640 1 -- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e840cee40 msgr2=0x7f2e840b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e83e00640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e840cee40 0x7f2e840b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e83e00640 1 -- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e8415e460 msgr2=0x7f2e8414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e83e00640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e8415e460 0x7f2e8414ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.571+0000 7f2e83e00640 1 -- 172.21.15.5:0/1289572439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e840b4800 con 0x7f2e840ca3e0 2024-08-18T22:28:07.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.575+0000 7f2e83e00640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e840ca3e0 0x7f2e840b67e0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400d800 tx=0x7f2e7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:07.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.575+0000 7f2e7be00640 1 -- 172.21.15.5:0/1289572439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400b6c0 con 0x7f2e840ca3e0 2024-08-18T22:28:07.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.575+0000 7f2e7be00640 1 -- 172.21.15.5:0/1289572439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e74019070 con 0x7f2e840ca3e0 2024-08-18T22:28:07.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.575+0000 7f2e7be00640 1 -- 172.21.15.5:0/1289572439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400baa0 con 0x7f2e840ca3e0 2024-08-18T22:28:07.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.575+0000 7f2e8ae00640 1 -- 172.21.15.5:0/1289572439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e840b4ae0 con 0x7f2e840ca3e0 2024-08-18T22:28:07.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.575+0000 7f2e8ae00640 1 -- 172.21.15.5:0/1289572439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e840b50a0 con 0x7f2e840ca3e0 2024-08-18T22:28:07.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.575+0000 7f2e8ae00640 1 -- 172.21.15.5:0/1289572439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e840b3620 con 0x7f2e840ca3e0 2024-08-18T22:28:07.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.575+0000 7f2e7be00640 1 -- 172.21.15.5:0/1289572439 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e7400bc40 con 0x7f2e840ca3e0 2024-08-18T22:28:07.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.575+0000 7f2e7be00640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2e640678c0 0x7f2e64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.575+0000 7f2e7be00640 1 -- 172.21.15.5:0/1289572439 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f2e74086220 con 0x7f2e840ca3e0 2024-08-18T22:28:07.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.579+0000 7f2e83400640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2e640678c0 0x7f2e64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.579+0000 7f2e83400640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2e640678c0 0x7f2e64069d80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2e840b7260 tx=0x7f2e70009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:07.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.579+0000 7f2e7be00640 1 -- 172.21.15.5:0/1289572439 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2e74056b30 con 0x7f2e840ca3e0 2024-08-18T22:28:07.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.747+0000 7f2e8ae00640 1 -- 172.21.15.5:0/1289572439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e8414bf50 con 0x7f2e840ca3e0 2024-08-18T22:28:07.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e7be00640 1 -- 172.21.15.5:0/1289572439 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16880 (secure 0 0 0) 0x7f2e74056430 con 0x7f2e840ca3e0 2024-08-18T22:28:07.751 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:07.751 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":129,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:27:25.555095+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:27:21.667014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-08-18T22:27:22.938200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 -- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2e640678c0 msgr2=0x7f2e64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2e640678c0 0x7f2e64069d80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2e840b7260 tx=0x7f2e70009040 comp rx=0 tx=0).stop 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 -- 172.21.15.5:0/1289572439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e840ca3e0 msgr2=0x7f2e840b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e840ca3e0 0x7f2e840b67e0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400d800 tx=0x7f2e7400dcc0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 -- 172.21.15.5:0/1289572439 shutdown_connections 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2e640678c0 0x7f2e64069d80 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e8415e460 0x7f2e8414ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e840cee40 0x7f2e840b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 --2- 172.21.15.5:0/1289572439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e840ca3e0 0x7f2e840b67e0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 -- 172.21.15.5:0/1289572439 >> 172.21.15.5:0/1289572439 conn(0x7f2e8409aa40 msgr2=0x7f2e8415cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 -- 172.21.15.5:0/1289572439 shutdown_connections 2024-08-18T22:28:07.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.751+0000 7f2e8ae00640 1 -- 172.21.15.5:0/1289572439 wait complete. 2024-08-18T22:28:07.774 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:28:07.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f9136e00640 1 Processor -- start 2024-08-18T22:28:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f9136e00640 1 -- start start 2024-08-18T22:28:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f9136e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91300b54c0 0x7f9130071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f9136e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f91300cbed0 0x7f91300cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f9136e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9130071c80 con 0x7f913006dd80 2024-08-18T22:28:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f9136e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f91300cba40 con 0x7f91300b54c0 2024-08-18T22:28:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f9136e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9130071f60 con 0x7f91300cbed0 2024-08-18T22:28:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f912fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91300b54c0 0x7f9130071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f912fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91300b54c0 0x7f9130071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40766/0 (socket says 172.21.15.5:40766) 2024-08-18T22:28:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f912fe00640 1 -- 172.21.15.5:0/3865940721 learned_addr learned my addr 172.21.15.5:0/3865940721 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f9134e00640 1 --2- 172.21.15.5:0/3865940721 >> v2:172.21.15.117:3300/0 conn(0x7f91300cbed0 0x7f91300cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f912fe00640 1 -- 172.21.15.5:0/3865940721 >> v2:172.21.15.117:3300/0 conn(0x7f91300cbed0 msgr2=0x7f91300cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f912fe00640 1 --2- 172.21.15.5:0/3865940721 >> v2:172.21.15.117:3300/0 conn(0x7f91300cbed0 0x7f91300cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f912fe00640 1 -- 172.21.15.5:0/3865940721 >> v1:172.21.15.117:6789/0 conn(0x7f913006dd80 legacy=0x7f91300b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f912fe00640 1 -- 172.21.15.5:0/3865940721 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91300cb6d0 con 0x7f91300b54c0 2024-08-18T22:28:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.915+0000 7f9134e00640 1 --2- 172.21.15.5:0/3865940721 >> v2:172.21.15.117:3300/0 conn(0x7f91300cbed0 0x7f91300cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f912fe00640 1 --2- 172.21.15.5:0/3865940721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91300b54c0 0x7f9130071580 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f913006f4c0 tx=0x7f912001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f345cc2d0c759 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f912ea00640 1 -- 172.21.15.5:0/3865940721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91200b5070 con 0x7f91300b54c0 2024-08-18T22:28:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f912ea00640 1 -- 172.21.15.5:0/3865940721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91200a89d0 con 0x7f91300b54c0 2024-08-18T22:28:07.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f912ea00640 1 -- 172.21.15.5:0/3865940721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91200a8da0 con 0x7f91300b54c0 2024-08-18T22:28:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f9136e00640 1 -- 172.21.15.5:0/3865940721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91300b54c0 msgr2=0x7f9130071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f9136e00640 1 --2- 172.21.15.5:0/3865940721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91300b54c0 0x7f9130071580 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f913006f4c0 tx=0x7f912001ecd0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f9136e00640 1 -- 172.21.15.5:0/3865940721 shutdown_connections 2024-08-18T22:28:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f9136e00640 1 --2- 172.21.15.5:0/3865940721 >> v2:172.21.15.117:3300/0 conn(0x7f91300cbed0 0x7f91300cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f9136e00640 1 --2- 172.21.15.5:0/3865940721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91300b54c0 0x7f9130071580 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f9136e00640 1 -- 172.21.15.5:0/3865940721 >> 172.21.15.5:0/3865940721 conn(0x7f91300b3eb0 msgr2=0x7f91300b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f9136e00640 1 -- 172.21.15.5:0/3865940721 shutdown_connections 2024-08-18T22:28:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.919+0000 7f9136e00640 1 -- 172.21.15.5:0/3865940721 wait complete. 2024-08-18T22:28:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9136e00640 1 Processor -- start 2024-08-18T22:28:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9136e00640 1 -- start start 2024-08-18T22:28:07.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9136e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f913006dd80 0x7f91301f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9136e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91300b54c0 0x7f91301604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9136e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91300cbed0 0x7f91300cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9136e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f91301481a0 con 0x7f91300cbed0 2024-08-18T22:28:07.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9136e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9130148020 con 0x7f913006dd80 2024-08-18T22:28:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9136e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f91300cc8a0 con 0x7f91300b54c0 2024-08-18T22:28:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9134e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91300cbed0 0x7f91300cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9134e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91300cbed0 0x7f91300cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40768/0 (socket says 172.21.15.5:40768) 2024-08-18T22:28:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9134e00640 1 -- 172.21.15.5:0/3745263507 learned_addr learned my addr 172.21.15.5:0/3745263507 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f912fe00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f913006dd80 0x7f91301f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f912f400640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91300b54c0 0x7f91301604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9134e00640 1 -- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91300b54c0 msgr2=0x7f91301604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9134e00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91300b54c0 0x7f91301604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9134e00640 1 -- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f913006dd80 msgr2=0x7f91301f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9134e00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f913006dd80 0x7f91301f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9134e00640 1 -- 172.21.15.5:0/3745263507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913015ec70 con 0x7f91300cbed0 2024-08-18T22:28:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f912f400640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91300b54c0 0x7f91301604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9134e00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91300cbed0 0x7f91300cccf0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f912800cd80 tx=0x7f912800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9127e00640 1 -- 172.21.15.5:0/3745263507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912800f680 con 0x7f91300cbed0 2024-08-18T22:28:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9127e00640 1 -- 172.21.15.5:0/3745263507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912800f840 con 0x7f91300cbed0 2024-08-18T22:28:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9127e00640 1 -- 172.21.15.5:0/3745263507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912800fc30 con 0x7f91300cbed0 2024-08-18T22:28:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9136e00640 1 -- 172.21.15.5:0/3745263507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913015ef50 con 0x7f91300cbed0 2024-08-18T22:28:07.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.923+0000 7f9136e00640 1 -- 172.21.15.5:0/3745263507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f913015f510 con 0x7f91300cbed0 2024-08-18T22:28:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.927+0000 7f9136e00640 1 -- 172.21.15.5:0/3745263507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91300cc360 con 0x7f91300cbed0 2024-08-18T22:28:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.927+0000 7f9127e00640 1 -- 172.21.15.5:0/3745263507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f912800e3e0 con 0x7f91300cbed0 2024-08-18T22:28:07.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.927+0000 7f9127e00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f91100678c0 0x7f9110069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:07.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.927+0000 7f9127e00640 1 -- 172.21.15.5:0/3745263507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f9128086b80 con 0x7f91300cbed0 2024-08-18T22:28:07.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.927+0000 7f912fe00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f91100678c0 0x7f9110069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:07.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.927+0000 7f912fe00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f91100678c0 0x7f9110069d80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f91200b2000 tx=0x7f9120009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:07.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:07.931+0000 7f9127e00640 1 -- 172.21.15.5:0/3745263507 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9128014030 con 0x7f91300cbed0 2024-08-18T22:28:08.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.131+0000 7f9136e00640 1 -- 172.21.15.5:0/3745263507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f913015e510 con 0x7f91300cbed0 2024-08-18T22:28:08.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.131+0000 7f9127e00640 1 -- 172.21.15.5:0/3745263507 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5224 (secure 0 0 0) 0x7f9128057520 con 0x7f91300cbed0 2024-08-18T22:28:08.132 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:08.133 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":100,"btime":"2024-08-18T22:27:27:572472+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1632895454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1632895454},{"type":"v1","addr":"172.21.15.117:6836","nonce":1632895454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/932399139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":932399139},{"type":"v1","addr":"172.21.15.5:6835","nonce":932399139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3229011054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3229011054},{"type":"v1","addr":"172.21.15.5:6834","nonce":3229011054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:27:23.980938+0000","modified":"2024-08-18T22:27:26.969472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2108480966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2108480966},{"type":"v1","addr":"172.21.15.117:6837","nonce":2108480966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8166,"qdb_cluster":[8166]},"id":8}]} 2024-08-18T22:28:08.133 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 100 2024-08-18T22:28:08.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 -- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f91100678c0 msgr2=0x7f9110069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f91100678c0 0x7f9110069d80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f91200b2000 tx=0x7f9120009040 comp rx=0 tx=0).stop 2024-08-18T22:28:08.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 -- 172.21.15.5:0/3745263507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91300cbed0 msgr2=0x7f91300cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91300cbed0 0x7f91300cccf0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f912800cd80 tx=0x7f912800a650 comp rx=0 tx=0).stop 2024-08-18T22:28:08.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 -- 172.21.15.5:0/3745263507 shutdown_connections 2024-08-18T22:28:08.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f91100678c0 0x7f9110069d80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91300cbed0 0x7f91300cccf0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91300b54c0 0x7f91301604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 --2- 172.21.15.5:0/3745263507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f913006dd80 0x7f91301f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 -- 172.21.15.5:0/3745263507 >> 172.21.15.5:0/3745263507 conn(0x7f91300b3eb0 msgr2=0x7f91300b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:08.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 -- 172.21.15.5:0/3745263507 shutdown_connections 2024-08-18T22:28:08.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.135+0000 7f9136e00640 1 -- 172.21.15.5:0/3745263507 wait complete. 2024-08-18T22:28:08.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:08.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.295+0000 7faadd000640 1 Processor -- start 2024-08-18T22:28:08.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.295+0000 7faadd000640 1 -- start start 2024-08-18T22:28:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.295+0000 7faadd000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faad815b010 0x7faad80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.295+0000 7faadd000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faad806f290 0x7faad8072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.295+0000 7faadd000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faad80cee20 con 0x7faad80cd3a0 2024-08-18T22:28:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.295+0000 7faadd000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7faad80cfa30 con 0x7faad806f290 2024-08-18T22:28:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.295+0000 7faadd000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faad80cf100 con 0x7faad815b010 2024-08-18T22:28:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faad6800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faad806f290 0x7faad8072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faacd400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faad80cd3a0 0x7faad806eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36286/0 (socket says 172.21.15.5:36286) 2024-08-18T22:28:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faacd400640 1 -- 172.21.15.5:0/2538563617 learned_addr learned my addr 172.21.15.5:0/2538563617 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faad5e00640 1 --2- 172.21.15.5:0/2538563617 >> v2:172.21.15.117:3300/0 conn(0x7faad815b010 0x7faad80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faad6800640 1 -- 172.21.15.5:0/2538563617 >> v2:172.21.15.117:3300/0 conn(0x7faad815b010 msgr2=0x7faad80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faad6800640 1 --2- 172.21.15.5:0/2538563617 >> v2:172.21.15.117:3300/0 conn(0x7faad815b010 0x7faad80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faad6800640 1 -- 172.21.15.5:0/2538563617 >> v1:172.21.15.5:6789/0 conn(0x7faad80cd3a0 legacy=0x7faad806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faad6800640 1 -- 172.21.15.5:0/2538563617 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad80cf3e0 con 0x7faad806f290 2024-08-18T22:28:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faad6800640 1 --2- 172.21.15.5:0/2538563617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad806f290 0x7faad8072620 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7faad80cfbb0 tx=0x7faad001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ada2b35472ef64a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faad5400640 1 -- 172.21.15.5:0/2538563617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad00b2070 con 0x7faad806f290 2024-08-18T22:28:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faad5400640 1 -- 172.21.15.5:0/2538563617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad00a58f0 con 0x7faad806f290 2024-08-18T22:28:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.299+0000 7faad5400640 1 -- 172.21.15.5:0/2538563617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad00a5cc0 con 0x7faad806f290 2024-08-18T22:28:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 -- 172.21.15.5:0/2538563617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad806f290 msgr2=0x7faad8072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 --2- 172.21.15.5:0/2538563617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad806f290 0x7faad8072620 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7faad80cfbb0 tx=0x7faad001c900 comp rx=0 tx=0).stop 2024-08-18T22:28:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 -- 172.21.15.5:0/2538563617 shutdown_connections 2024-08-18T22:28:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 --2- 172.21.15.5:0/2538563617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad806f290 0x7faad8072620 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 --2- 172.21.15.5:0/2538563617 >> v2:172.21.15.117:3300/0 conn(0x7faad815b010 0x7faad80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 -- 172.21.15.5:0/2538563617 >> 172.21.15.5:0/2538563617 conn(0x7faad80b1c50 msgr2=0x7faad80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 -- 172.21.15.5:0/2538563617 shutdown_connections 2024-08-18T22:28:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 -- 172.21.15.5:0/2538563617 wait complete. 2024-08-18T22:28:08.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 Processor -- start 2024-08-18T22:28:08.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 -- start start 2024-08-18T22:28:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faad806f290 0x7faad8142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80cd3a0 0x7faad809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad815b010 0x7faad809af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faad80734f0 con 0x7faad80cd3a0 2024-08-18T22:28:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faad8073370 con 0x7faad815b010 2024-08-18T22:28:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faadd000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faad8073670 con 0x7faad806f290 2024-08-18T22:28:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faacd400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80cd3a0 0x7faad809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faacd400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80cd3a0 0x7faad809aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40780/0 (socket says 172.21.15.5:40780) 2024-08-18T22:28:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faacd400640 1 -- 172.21.15.5:0/3106628614 learned_addr learned my addr 172.21.15.5:0/3106628614 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faad5e00640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faad806f290 0x7faad8142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faad6800640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad815b010 0x7faad809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faacd400640 1 -- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faad806f290 msgr2=0x7faad8142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faacd400640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faad806f290 0x7faad8142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faacd400640 1 -- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad815b010 msgr2=0x7faad809af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faacd400640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad815b010 0x7faad809af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faacd400640 1 -- 172.21.15.5:0/3106628614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad8143080 con 0x7faad80cd3a0 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.303+0000 7faad6800640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad815b010 0x7faad809af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.307+0000 7faacd400640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80cd3a0 0x7faad809aa40 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7faac000c420 tx=0x7faac000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.307+0000 7faacea00640 1 -- 172.21.15.5:0/3106628614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0017070 con 0x7faad80cd3a0 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.307+0000 7faacea00640 1 -- 172.21.15.5:0/3106628614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac0005cf0 con 0x7faad80cd3a0 2024-08-18T22:28:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.307+0000 7faacea00640 1 -- 172.21.15.5:0/3106628614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac00072f0 con 0x7faad80cd3a0 2024-08-18T22:28:08.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.307+0000 7faadd000640 1 -- 172.21.15.5:0/3106628614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad80b30f0 con 0x7faad80cd3a0 2024-08-18T22:28:08.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.307+0000 7faadd000640 1 -- 172.21.15.5:0/3106628614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad80b36b0 con 0x7faad80cd3a0 2024-08-18T22:28:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.307+0000 7faadd000640 1 -- 172.21.15.5:0/3106628614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad8072620 con 0x7faad80cd3a0 2024-08-18T22:28:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.307+0000 7faacea00640 1 -- 172.21.15.5:0/3106628614 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faac001a070 con 0x7faad80cd3a0 2024-08-18T22:28:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.307+0000 7faacea00640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faab40678c0 0x7faab4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.307+0000 7faacea00640 1 -- 172.21.15.5:0/3106628614 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7faac00852c0 con 0x7faad80cd3a0 2024-08-18T22:28:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.307+0000 7faad5e00640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faab40678c0 0x7faab4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.311+0000 7faad5e00640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faab40678c0 0x7faab4069d80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7faac8009a50 tx=0x7faac8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:08.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.311+0000 7faacea00640 1 -- 172.21.15.5:0/3106628614 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7faac0055bd0 con 0x7faad80cd3a0 2024-08-18T22:28:08.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.515+0000 7faadd000640 1 -- 172.21.15.5:0/3106628614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faad80cb630 con 0x7faad80cd3a0 2024-08-18T22:28:08.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.515+0000 7faacea00640 1 -- 172.21.15.5:0/3106628614 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5224 (secure 0 0 0) 0x7faac00554d0 con 0x7faad80cd3a0 2024-08-18T22:28:08.517 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:08.517 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":100,"btime":"2024-08-18T22:27:27:572472+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1632895454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1632895454},{"type":"v1","addr":"172.21.15.117:6836","nonce":1632895454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/932399139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":932399139},{"type":"v1","addr":"172.21.15.5:6835","nonce":932399139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3229011054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3229011054},{"type":"v1","addr":"172.21.15.5:6834","nonce":3229011054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:27:23.980938+0000","modified":"2024-08-18T22:27:26.969472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"b","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2108480966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2108480966},{"type":"v1","addr":"172.21.15.117:6837","nonce":2108480966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8166,"qdb_cluster":[8166]},"id":8}]} 2024-08-18T22:28:08.517 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 100 2024-08-18T22:28:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 -- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faab40678c0 msgr2=0x7faab4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faab40678c0 0x7faab4069d80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7faac8009a50 tx=0x7faac8008040 comp rx=0 tx=0).stop 2024-08-18T22:28:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 -- 172.21.15.5:0/3106628614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80cd3a0 msgr2=0x7faad809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80cd3a0 0x7faad809aa40 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7faac000c420 tx=0x7faac000c8e0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 -- 172.21.15.5:0/3106628614 shutdown_connections 2024-08-18T22:28:08.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faab40678c0 0x7faab4069d80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad815b010 0x7faad809af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80cd3a0 0x7faad809aa40 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 --2- 172.21.15.5:0/3106628614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faad806f290 0x7faad8142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 -- 172.21.15.5:0/3106628614 >> 172.21.15.5:0/3106628614 conn(0x7faad80b1c50 msgr2=0x7faad80caf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 -- 172.21.15.5:0/3106628614 shutdown_connections 2024-08-18T22:28:08.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.519+0000 7faadd000640 1 -- 172.21.15.5:0/3106628614 wait complete. 2024-08-18T22:28:08.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:28:08.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec9c00640 1 Processor -- start 2024-08-18T22:28:08.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec9c00640 1 -- start start 2024-08-18T22:28:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec9c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 0x7faec415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec9c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faec40b4510 0x7faec40cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec9c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec40ccd90 con 0x7faec40cde30 2024-08-18T22:28:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec9c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faec40ce770 con 0x7faec40b4510 2024-08-18T22:28:08.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec9c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faec415d520 con 0x7faec409aa40 2024-08-18T22:28:08.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 0x7faec415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 0x7faec415cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:36316/0 (socket says 172.21.15.5:36316) 2024-08-18T22:28:08.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec3e00640 1 -- 172.21.15.5:0/1541543385 learned_addr learned my addr 172.21.15.5:0/1541543385 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec9200640 1 --2- 172.21.15.5:0/1541543385 >> v2:172.21.15.117:3300/0 conn(0x7faec40b4510 0x7faec40cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec3e00640 1 -- 172.21.15.5:0/1541543385 >> v2:172.21.15.117:3300/0 conn(0x7faec40b4510 msgr2=0x7faec40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec3e00640 1 --2- 172.21.15.5:0/1541543385 >> v2:172.21.15.117:3300/0 conn(0x7faec40b4510 0x7faec40cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec3e00640 1 -- 172.21.15.5:0/1541543385 >> v1:172.21.15.117:6789/0 conn(0x7faec40cde30 legacy=0x7faec409ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.683+0000 7faec3e00640 1 -- 172.21.15.5:0/1541543385 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec40cd070 con 0x7faec409aa40 2024-08-18T22:28:08.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec3e00640 1 --2- 172.21.15.5:0/1541543385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 0x7faec415cfe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009870 tx=0x7faeb401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ee96e8443206d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:08.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec2a00640 1 -- 172.21.15.5:0/1541543385 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb40aa600 con 0x7faec409aa40 2024-08-18T22:28:08.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec2a00640 1 -- 172.21.15.5:0/1541543385 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb40af070 con 0x7faec409aa40 2024-08-18T22:28:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec2a00640 1 -- 172.21.15.5:0/1541543385 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb40aa9c0 con 0x7faec409aa40 2024-08-18T22:28:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec9c00640 1 -- 172.21.15.5:0/1541543385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 msgr2=0x7faec415cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec9c00640 1 --2- 172.21.15.5:0/1541543385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 0x7faec415cfe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009870 tx=0x7faeb401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec9c00640 1 -- 172.21.15.5:0/1541543385 shutdown_connections 2024-08-18T22:28:08.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec9c00640 1 --2- 172.21.15.5:0/1541543385 >> v2:172.21.15.117:3300/0 conn(0x7faec40b4510 0x7faec40cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec9c00640 1 --2- 172.21.15.5:0/1541543385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 0x7faec415cfe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec9c00640 1 -- 172.21.15.5:0/1541543385 >> 172.21.15.5:0/1541543385 conn(0x7faec40b3a20 msgr2=0x7faec40b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec9c00640 1 -- 172.21.15.5:0/1541543385 shutdown_connections 2024-08-18T22:28:08.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec9c00640 1 -- 172.21.15.5:0/1541543385 wait complete. 2024-08-18T22:28:08.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec9c00640 1 Processor -- start 2024-08-18T22:28:08.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.687+0000 7faec9c00640 1 -- start start 2024-08-18T22:28:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec9c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 0x7faec4157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec9c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec40b4510 0x7faec40af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec9c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec40cde30 0x7faec40aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec9c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faec415c3b0 con 0x7faec40b4510 2024-08-18T22:28:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec9c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faec415c230 con 0x7faec40cde30 2024-08-18T22:28:08.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec9c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faec4168e40 con 0x7faec409aa40 2024-08-18T22:28:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec40b4510 0x7faec40af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec40b4510 0x7faec40af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40790/0 (socket says 172.21.15.5:40790) 2024-08-18T22:28:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec3400640 1 -- 172.21.15.5:0/1742274749 learned_addr learned my addr 172.21.15.5:0/1742274749 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec3e00640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 0x7faec4157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec9200640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec40cde30 0x7faec40aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec3400640 1 -- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 msgr2=0x7faec4157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec3400640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 0x7faec4157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec3400640 1 -- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec40cde30 msgr2=0x7faec40aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec3400640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec40cde30 0x7faec40aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec3400640 1 -- 172.21.15.5:0/1742274749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec4071210 con 0x7faec40b4510 2024-08-18T22:28:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec3400640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec40b4510 0x7faec40af9f0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c340 tx=0x7faeb000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faebbe00640 1 -- 172.21.15.5:0/1742274749 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb00052d0 con 0x7faec40b4510 2024-08-18T22:28:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faebbe00640 1 -- 172.21.15.5:0/1742274749 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb0005470 con 0x7faec40b4510 2024-08-18T22:28:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faebbe00640 1 -- 172.21.15.5:0/1742274749 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0007260 con 0x7faec40b4510 2024-08-18T22:28:08.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec9c00640 1 -- 172.21.15.5:0/1742274749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec406d570 con 0x7faec40b4510 2024-08-18T22:28:08.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec9c00640 1 -- 172.21.15.5:0/1742274749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec406db30 con 0x7faec40b4510 2024-08-18T22:28:08.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.691+0000 7faec9c00640 1 -- 172.21.15.5:0/1742274749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec415cfe0 con 0x7faec40b4510 2024-08-18T22:28:08.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.695+0000 7faebbe00640 1 -- 172.21.15.5:0/1742274749 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faeb0007400 con 0x7faec40b4510 2024-08-18T22:28:08.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.695+0000 7faebbe00640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faea40678c0 0x7faea4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:08.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.695+0000 7faebbe00640 1 -- 172.21.15.5:0/1742274749 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7faeb0085320 con 0x7faec40b4510 2024-08-18T22:28:08.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.695+0000 7faec3e00640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faea40678c0 0x7faea4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:08.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.695+0000 7faec3e00640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faea40678c0 0x7faea4069d80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7faeb40ae000 tx=0x7faeb40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:08.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.699+0000 7faebbe00640 1 -- 172.21.15.5:0/1742274749 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7faeb0055560 con 0x7faec40b4510 2024-08-18T22:28:08.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.863+0000 7faec9c00640 1 -- 172.21.15.5:0/1742274749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faec4073d40 con 0x7faec40b4510 2024-08-18T22:28:08.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.863+0000 7faebbe00640 1 -- 172.21.15.5:0/1742274749 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16880 (secure 0 0 0) 0x7faeb00850e0 con 0x7faec40b4510 2024-08-18T22:28:08.866 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:08.866 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":129,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:27:25.555095+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:27:21.667014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-08-18T22:27:22.938200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:28:08.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 -- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faea40678c0 msgr2=0x7faea4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faea40678c0 0x7faea4069d80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7faeb40ae000 tx=0x7faeb40a7000 comp rx=0 tx=0).stop 2024-08-18T22:28:08.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 -- 172.21.15.5:0/1742274749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec40b4510 msgr2=0x7faec40af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec40b4510 0x7faec40af9f0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c340 tx=0x7faeb000c800 comp rx=0 tx=0).stop 2024-08-18T22:28:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 -- 172.21.15.5:0/1742274749 shutdown_connections 2024-08-18T22:28:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faea40678c0 0x7faea4069d80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faec40cde30 0x7faec40aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faec40b4510 0x7faec40af9f0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 --2- 172.21.15.5:0/1742274749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faec409aa40 0x7faec4157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 -- 172.21.15.5:0/1742274749 >> 172.21.15.5:0/1742274749 conn(0x7faec40b3a20 msgr2=0x7faec415a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 -- 172.21.15.5:0/1742274749 shutdown_connections 2024-08-18T22:28:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:08.867+0000 7faec9c00640 1 -- 172.21.15.5:0/1742274749 wait complete. 2024-08-18T22:28:08.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:28:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.027+0000 7f6fe9200640 1 Processor -- start 2024-08-18T22:28:09.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.027+0000 7f6fe9200640 1 -- start start 2024-08-18T22:28:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe9200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe40b1300 0x7f6fe4162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe9200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6fe409b080 0x7f6fe40b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe9200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe406e8a0 con 0x7f6fe409aca0 2024-08-18T22:28:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe9200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe409bb80 con 0x7f6fe409b080 2024-08-18T22:28:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe9200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe40d2e40 con 0x7f6fe40b1300 2024-08-18T22:28:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe1400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe40b1300 0x7f6fe4162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe1400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe40b1300 0x7f6fe4162950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:36340/0 (socket says 172.21.15.5:36340) 2024-08-18T22:28:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe2800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6fe409b080 0x7f6fe40b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe1400640 1 -- 172.21.15.5:0/3977187420 learned_addr learned my addr 172.21.15.5:0/3977187420 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:09.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe1e00640 1 --1- 172.21.15.5:0/3977187420 >> v1:172.21.15.117:6789/0 conn(0x7f6fe409aca0 0x7f6fe40afa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:58180/0 (socket says 172.21.15.5:58180) 2024-08-18T22:28:09.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe2800640 1 -- 172.21.15.5:0/3977187420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe40b1300 msgr2=0x7f6fe4162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:09.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe2800640 1 --2- 172.21.15.5:0/3977187420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe40b1300 0x7f6fe4162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe2800640 1 -- 172.21.15.5:0/3977187420 >> v1:172.21.15.117:6789/0 conn(0x7f6fe409aca0 legacy=0x7f6fe40afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:09.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.031+0000 7f6fe2800640 1 -- 172.21.15.5:0/3977187420 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe406cbd0 con 0x7f6fe409b080 2024-08-18T22:28:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe2800640 1 --2- 172.21.15.5:0/3977187420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fe409b080 0x7f6fe40b01a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009d90 tx=0x7f6fdc01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c196e626ad6791b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe0a00640 1 -- 172.21.15.5:0/3977187420 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0b2070 con 0x7f6fe409b080 2024-08-18T22:28:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe0a00640 1 -- 172.21.15.5:0/3977187420 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc0a5940 con 0x7f6fe409b080 2024-08-18T22:28:09.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe0a00640 1 -- 172.21.15.5:0/3977187420 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0a5d10 con 0x7f6fe409b080 2024-08-18T22:28:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 -- 172.21.15.5:0/3977187420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fe409b080 msgr2=0x7f6fe40b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 --2- 172.21.15.5:0/3977187420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fe409b080 0x7f6fe40b01a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009d90 tx=0x7f6fdc01c970 comp rx=0 tx=0).stop 2024-08-18T22:28:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 -- 172.21.15.5:0/3977187420 shutdown_connections 2024-08-18T22:28:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 --2- 172.21.15.5:0/3977187420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fe409b080 0x7f6fe40b01a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 --2- 172.21.15.5:0/3977187420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe40b1300 0x7f6fe4162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 -- 172.21.15.5:0/3977187420 >> 172.21.15.5:0/3977187420 conn(0x7f6fe40d2180 msgr2=0x7f6fe40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:09.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 -- 172.21.15.5:0/3977187420 shutdown_connections 2024-08-18T22:28:09.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 -- 172.21.15.5:0/3977187420 wait complete. 2024-08-18T22:28:09.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 Processor -- start 2024-08-18T22:28:09.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 -- start start 2024-08-18T22:28:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe409aca0 0x7f6fe4168720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe409b080 0x7f6fe41fb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fe40b1300 0x7f6fe415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe416bcb0 con 0x7f6fe409aca0 2024-08-18T22:28:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe416bb30 con 0x7f6fe40b1300 2024-08-18T22:28:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe9200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe416be30 con 0x7f6fe409b080 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.035+0000 7f6fe1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe409aca0 0x7f6fe4168720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe409aca0 0x7f6fe4168720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40792/0 (socket says 172.21.15.5:40792) 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe1e00640 1 -- 172.21.15.5:0/3500174335 learned_addr learned my addr 172.21.15.5:0/3500174335 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe1400640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe409b080 0x7f6fe41fb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe2800640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fe40b1300 0x7f6fe415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe1e00640 1 -- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe409b080 msgr2=0x7f6fe41fb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe1e00640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe409b080 0x7f6fe41fb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe1e00640 1 -- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fe40b1300 msgr2=0x7f6fe415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe1e00640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fe40b1300 0x7f6fe415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe1e00640 1 -- 172.21.15.5:0/3500174335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe415a7e0 con 0x7f6fe409aca0 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe1400640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe409b080 0x7f6fe41fb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe1e00640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe409aca0 0x7f6fe4168720 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400c450 tx=0x7f6fd400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fda000640 1 -- 172.21.15.5:0/3500174335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40074e0 con 0x7f6fe409aca0 2024-08-18T22:28:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fda000640 1 -- 172.21.15.5:0/3500174335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd4007680 con 0x7f6fe409aca0 2024-08-18T22:28:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fda000640 1 -- 172.21.15.5:0/3500174335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4004a30 con 0x7f6fe409aca0 2024-08-18T22:28:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe9200640 1 -- 172.21.15.5:0/3500174335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe4168de0 con 0x7f6fe409aca0 2024-08-18T22:28:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe9200640 1 -- 172.21.15.5:0/3500174335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe415dab0 con 0x7f6fe409aca0 2024-08-18T22:28:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fe9200640 1 -- 172.21.15.5:0/3500174335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe40afa90 con 0x7f6fe409aca0 2024-08-18T22:28:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fda000640 1 -- 172.21.15.5:0/3500174335 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6fd401a020 con 0x7f6fe409aca0 2024-08-18T22:28:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.039+0000 7f6fda000640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fc40678c0 0x7f6fc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.043+0000 7f6fda000640 1 -- 172.21.15.5:0/3500174335 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f6fd40856d0 con 0x7f6fe409aca0 2024-08-18T22:28:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.043+0000 7f6fe1400640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fc40678c0 0x7f6fc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.043+0000 7f6fe1400640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fc40678c0 0x7f6fc4069d80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40713d0 tx=0x7f6fd0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.043+0000 7f6fda000640 1 -- 172.21.15.5:0/3500174335 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6fe415a7e0 con 0x7f6fe409aca0 2024-08-18T22:28:09.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.243+0000 7f6fe9200640 1 -- 172.21.15.5:0/3500174335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6fe40d1cc0 con 0x7f6fe409aca0 2024-08-18T22:28:09.243 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:28:09.243+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:28:09.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.243+0000 7f6fda000640 1 -- 172.21.15.5:0/3500174335 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v101) ==== 161+0+0 (secure 0 0 0) 0x7f6fd405ae20 con 0x7f6fe409aca0 2024-08-18T22:28:09.245 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:28:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 -- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fc40678c0 msgr2=0x7f6fc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fc40678c0 0x7f6fc4069d80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40713d0 tx=0x7f6fd0008040 comp rx=0 tx=0).stop 2024-08-18T22:28:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 -- 172.21.15.5:0/3500174335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe409aca0 msgr2=0x7f6fe4168720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe409aca0 0x7f6fe4168720 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400c450 tx=0x7f6fd400c910 comp rx=0 tx=0).stop 2024-08-18T22:28:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 -- 172.21.15.5:0/3500174335 shutdown_connections 2024-08-18T22:28:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fc40678c0 0x7f6fc4069d80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fe40b1300 0x7f6fe415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fe409b080 0x7f6fe41fb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 --2- 172.21.15.5:0/3500174335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe409aca0 0x7f6fe4168720 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 -- 172.21.15.5:0/3500174335 >> 172.21.15.5:0/3500174335 conn(0x7f6fe40d2180 msgr2=0x7f6fe40716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 -- 172.21.15.5:0/3500174335 shutdown_connections 2024-08-18T22:28:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.247+0000 7f6fe9200640 1 -- 172.21.15.5:0/3500174335 wait complete. 2024-08-18T22:28:09.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:28:09.319 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:28:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.407+0000 7f5d39e00640 1 Processor -- start 2024-08-18T22:28:09.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.407+0000 7f5d39e00640 1 -- start start 2024-08-18T22:28:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d39e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34144050 0x7f5d3406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d39e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5d34147860 0x7f5d340b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d39e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d3406ddd0 con 0x7f5d3406f3b0 2024-08-18T22:28:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d39e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5d3406db80 con 0x7f5d34147860 2024-08-18T22:28:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d39e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3406e9e0 con 0x7f5d34144050 2024-08-18T22:28:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34144050 0x7f5d3406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d33400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5d34147860 0x7f5d340b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34144050 0x7f5d3406ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:36356/0 (socket says 172.21.15.5:36356) 2024-08-18T22:28:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d32a00640 1 -- 172.21.15.5:0/3082340669 learned_addr learned my addr 172.21.15.5:0/3082340669 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d32000640 1 --1- 172.21.15.5:0/3082340669 >> v1:172.21.15.117:6789/0 conn(0x7f5d3406f3b0 0x7f5d34144430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:58182/0 (socket says 172.21.15.5:58182) 2024-08-18T22:28:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d32a00640 1 -- 172.21.15.5:0/3082340669 >> v2:172.21.15.117:3300/0 conn(0x7f5d34147860 msgr2=0x7f5d340b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d32a00640 1 --2- 172.21.15.5:0/3082340669 >> v2:172.21.15.117:3300/0 conn(0x7f5d34147860 0x7f5d340b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d32a00640 1 -- 172.21.15.5:0/3082340669 >> v1:172.21.15.117:6789/0 conn(0x7f5d3406f3b0 legacy=0x7f5d34144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.411+0000 7f5d32a00640 1 -- 172.21.15.5:0/3082340669 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3406e0b0 con 0x7f5d34144050 2024-08-18T22:28:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d32a00640 1 --2- 172.21.15.5:0/3082340669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34144050 0x7f5d3406ee70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009870 tx=0x7f5d2401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=488f3ff64724b03 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d31600640 1 -- 172.21.15.5:0/3082340669 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d240b1070 con 0x7f5d34144050 2024-08-18T22:28:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d31600640 1 -- 172.21.15.5:0/3082340669 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d240ac410 con 0x7f5d34144050 2024-08-18T22:28:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d31600640 1 -- 172.21.15.5:0/3082340669 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d240ac7e0 con 0x7f5d34144050 2024-08-18T22:28:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d39e00640 1 -- 172.21.15.5:0/3082340669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34144050 msgr2=0x7f5d3406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d39e00640 1 --2- 172.21.15.5:0/3082340669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34144050 0x7f5d3406ee70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009870 tx=0x7f5d2401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d39e00640 1 -- 172.21.15.5:0/3082340669 shutdown_connections 2024-08-18T22:28:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d39e00640 1 --2- 172.21.15.5:0/3082340669 >> v2:172.21.15.117:3300/0 conn(0x7f5d34147860 0x7f5d340b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d39e00640 1 --2- 172.21.15.5:0/3082340669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34144050 0x7f5d3406ee70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d39e00640 1 -- 172.21.15.5:0/3082340669 >> 172.21.15.5:0/3082340669 conn(0x7f5d340b1dc0 msgr2=0x7f5d340b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d39e00640 1 -- 172.21.15.5:0/3082340669 shutdown_connections 2024-08-18T22:28:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d39e00640 1 -- 172.21.15.5:0/3082340669 wait complete. 2024-08-18T22:28:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d39e00640 1 Processor -- start 2024-08-18T22:28:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.415+0000 7f5d39e00640 1 -- start start 2024-08-18T22:28:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d39e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3406f3b0 0x7f5d340720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d39e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34144050 0x7f5d34072620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d39e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34147860 0x7f5d341595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d39e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3416b4d0 con 0x7f5d3406f3b0 2024-08-18T22:28:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d39e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3416b350 con 0x7f5d34144050 2024-08-18T22:28:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d39e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3416b650 con 0x7f5d34147860 2024-08-18T22:28:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3406f3b0 0x7f5d340720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d32a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3406f3b0 0x7f5d340720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40794/0 (socket says 172.21.15.5:40794) 2024-08-18T22:28:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d32a00640 1 -- 172.21.15.5:0/54464508 learned_addr learned my addr 172.21.15.5:0/54464508 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d32000640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34144050 0x7f5d34072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d33400640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34147860 0x7f5d341595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d32a00640 1 -- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34147860 msgr2=0x7f5d341595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d32a00640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34147860 0x7f5d341595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d32a00640 1 -- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34144050 msgr2=0x7f5d34072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d32a00640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34144050 0x7f5d34072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d32a00640 1 -- 172.21.15.5:0/54464508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d340ad0d0 con 0x7f5d3406f3b0 2024-08-18T22:28:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d32000640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34144050 0x7f5d34072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d32a00640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3406f3b0 0x7f5d340720e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f5d240af040 tx=0x7f5d24019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d2b400640 1 -- 172.21.15.5:0/54464508 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d240bc070 con 0x7f5d3406f3b0 2024-08-18T22:28:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d2b400640 1 -- 172.21.15.5:0/54464508 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d240acd10 con 0x7f5d3406f3b0 2024-08-18T22:28:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d2b400640 1 -- 172.21.15.5:0/54464508 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d240b1040 con 0x7f5d3406f3b0 2024-08-18T22:28:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d39e00640 1 -- 172.21.15.5:0/54464508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d340ad370 con 0x7f5d3406f3b0 2024-08-18T22:28:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d39e00640 1 -- 172.21.15.5:0/54464508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d340ad930 con 0x7f5d3406f3b0 2024-08-18T22:28:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d39e00640 1 -- 172.21.15.5:0/54464508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3406ee70 con 0x7f5d3406f3b0 2024-08-18T22:28:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.419+0000 7f5d2b400640 1 -- 172.21.15.5:0/54464508 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5d240bf070 con 0x7f5d3406f3b0 2024-08-18T22:28:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.423+0000 7f5d2b400640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d140678f0 0x7f5d14069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.423+0000 7f5d2b400640 1 -- 172.21.15.5:0/54464508 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 6187+0+0 (secure 0 0 0) 0x7f5d2411f420 con 0x7f5d3406f3b0 2024-08-18T22:28:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.423+0000 7f5d32000640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d140678f0 0x7f5d14069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.423+0000 7f5d32000640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d140678f0 0x7f5d14069db0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5d340b3500 tx=0x7f5d20007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.427+0000 7f5d2b400640 1 -- 172.21.15.5:0/54464508 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5d24016150 con 0x7f5d3406f3b0 2024-08-18T22:28:09.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:09.627+0000 7f5d39e00640 1 -- 172.21.15.5:0/54464508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5d3406f7c0 con 0x7f5d3406f3b0 2024-08-18T22:28:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.247+0000 7f5d2b400640 1 -- 172.21.15.5:0/54464508 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v102) ==== 104+0+0 (secure 0 0 0) 0x7f5d240ef690 con 0x7f5d3406f3b0 2024-08-18T22:28:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 -- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d140678f0 msgr2=0x7f5d14069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d140678f0 0x7f5d14069db0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5d340b3500 tx=0x7f5d20007e90 comp rx=0 tx=0).stop 2024-08-18T22:28:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 -- 172.21.15.5:0/54464508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3406f3b0 msgr2=0x7f5d340720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3406f3b0 0x7f5d340720e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f5d240af040 tx=0x7f5d24019240 comp rx=0 tx=0).stop 2024-08-18T22:28:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 -- 172.21.15.5:0/54464508 shutdown_connections 2024-08-18T22:28:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d140678f0 0x7f5d14069db0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d34147860 0x7f5d341595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d34144050 0x7f5d34072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 --2- 172.21.15.5:0/54464508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3406f3b0 0x7f5d340720e0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 -- 172.21.15.5:0/54464508 >> 172.21.15.5:0/54464508 conn(0x7f5d340b1dc0 msgr2=0x7f5d3415da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 -- 172.21.15.5:0/54464508 shutdown_connections 2024-08-18T22:28:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.251+0000 7f5d39e00640 1 -- 172.21.15.5:0/54464508 wait complete. 2024-08-18T22:28:10.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:28:10.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.427+0000 7fd1d9400640 1 Processor -- start 2024-08-18T22:28:10.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.427+0000 7fd1d9400640 1 -- start start 2024-08-18T22:28:10.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d9400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd1d40ccaa0 0x7fd1d40cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:10.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d9400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d40b3260 con 0x7fd1d415d1d0 2024-08-18T22:28:10.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d9400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d415d630 con 0x7fd1d406dc60 2024-08-18T22:28:10.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d9400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d40cfe90 con 0x7fd1d40ccaa0 2024-08-18T22:28:10.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd1d415d1d0 0x7fd1d40cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36288/0 (socket says 172.21.15.5:36288) 2024-08-18T22:28:10.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1e00640 1 -- 172.21.15.5:0/2869724434 learned_addr learned my addr 172.21.15.5:0/2869724434 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d2800640 1 --2- 172.21.15.5:0/2869724434 >> v2:172.21.15.117:3300/0 conn(0x7fd1d40ccaa0 0x7fd1d40cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300943111 0 0) 0x7fd1d40b3260 con 0x7fd1d415d1d0 2024-08-18T22:28:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b8003530 con 0x7fd1d415d1d0 2024-08-18T22:28:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044969097 0 0) 0x7fd1d415d630 con 0x7fd1d406dc60 2024-08-18T22:28:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1d40b3260 con 0x7fd1d406dc60 2024-08-18T22:28:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2450523383 0 0) 0x7fd1b8003530 con 0x7fd1d415d1d0 2024-08-18T22:28:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 >> v2:172.21.15.117:3300/0 conn(0x7fd1d40ccaa0 msgr2=0x7fd1d40cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:10.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 --2- 172.21.15.5:0/2869724434 >> v2:172.21.15.117:3300/0 conn(0x7fd1d40ccaa0 0x7fd1d40cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 >> v1:172.21.15.117:6789/0 conn(0x7fd1d406dc60 legacy=0x7fd1d406e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d40b3500 con 0x7fd1d415d1d0 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fd1c0001680 con 0x7fd1d415d1d0 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d2800640 1 --2- 172.21.15.5:0/2869724434 >> v2:172.21.15.117:3300/0 conn(0x7fd1d40ccaa0 0x7fd1d40cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 >> v1:172.21.15.5:6789/0 conn(0x7fd1d415d1d0 legacy=0x7fd1d40cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 --2- 172.21.15.5:0/2869724434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b8003ba0 0x7fd1b8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 --2- 172.21.15.5:0/2869724434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1b8004810 0x7fd1b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 --2- 172.21.15.5:0/2869724434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1b8005220 0x7fd1b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d40cfe90 con 0x7fd1b8005220 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b800c150 con 0x7fd1b8003ba0 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b800c350 con 0x7fd1b8004810 2024-08-18T22:28:10.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d3200640 1 --2- 172.21.15.5:0/2869724434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1b8005220 0x7fd1b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:10.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d2800640 1 --2- 172.21.15.5:0/2869724434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b8003ba0 0x7fd1b8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:10.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d1e00640 1 --2- 172.21.15.5:0/2869724434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1b8004810 0x7fd1b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:10.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d3200640 1 -- 172.21.15.5:0/2869724434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1b8004810 msgr2=0x7fd1b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:10.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d3200640 1 --2- 172.21.15.5:0/2869724434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1b8004810 0x7fd1b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:10.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d3200640 1 -- 172.21.15.5:0/2869724434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b8003ba0 msgr2=0x7fd1b8003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:10.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d3200640 1 --2- 172.21.15.5:0/2869724434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b8003ba0 0x7fd1b8003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:10.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.431+0000 7fd1d3200640 1 -- 172.21.15.5:0/2869724434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b8003530 con 0x7fd1b8005220 2024-08-18T22:28:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d3200640 1 -- 172.21.15.5:0/2869724434 reap_dead start 2024-08-18T22:28:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d3200640 1 --2- 172.21.15.5:0/2869724434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1b8005220 0x7fd1b800b9d0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc001fd0 tx=0x7fd1cc01f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d09e3465430017 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc001c20 con 0x7fd1b8005220 2024-08-18T22:28:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0a8c90 con 0x7fd1b8005220 2024-08-18T22:28:10.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d1400640 1 -- 172.21.15.5:0/2869724434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc003bc0 con 0x7fd1b8005220 2024-08-18T22:28:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d9400640 1 -- 172.21.15.5:0/2869724434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1b8005220 msgr2=0x7fd1b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d9400640 1 --2- 172.21.15.5:0/2869724434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1b8005220 0x7fd1b800b9d0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc001fd0 tx=0x7fd1cc01f070 comp rx=0 tx=0).stop 2024-08-18T22:28:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d9400640 1 -- 172.21.15.5:0/2869724434 shutdown_connections 2024-08-18T22:28:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d9400640 1 --2- 172.21.15.5:0/2869724434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1b8005220 0x7fd1b800b9d0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d9400640 1 -- 172.21.15.5:0/2869724434 >> 172.21.15.5:0/2869724434 conn(0x7fd1d406b9b0 msgr2=0x7fd1d406bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d9400640 1 -- 172.21.15.5:0/2869724434 shutdown_connections 2024-08-18T22:28:10.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d9400640 1 -- 172.21.15.5:0/2869724434 wait complete. 2024-08-18T22:28:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d9400640 1 Processor -- start 2024-08-18T22:28:10.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.435+0000 7fd1d9400640 1 -- start start 2024-08-18T22:28:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d9400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b8005220 0x7fd1d41f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d9400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d41f5510 0x7fd1d4154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d41545b0 0x7fd1d4154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d9400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d40af5c0 con 0x7fd1d41545b0 2024-08-18T22:28:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d9400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d40b37e0 con 0x7fd1b8005220 2024-08-18T22:28:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d9400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d4156a10 con 0x7fd1d41f5510 2024-08-18T22:28:10.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d41545b0 0x7fd1d4154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:10.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d41545b0 0x7fd1d4154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40802/0 (socket says 172.21.15.5:40802) 2024-08-18T22:28:10.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d3200640 1 -- 172.21.15.5:0/492739129 learned_addr learned my addr 172.21.15.5:0/492739129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d3200640 1 -- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d41f5510 msgr2=0x7fd1d4154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d3200640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d41f5510 0x7fd1d4154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d3200640 1 -- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b8005220 msgr2=0x7fd1d41f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d2800640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b8005220 0x7fd1d41f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:10.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d3200640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b8005220 0x7fd1d41f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d3200640 1 -- 172.21.15.5:0/492739129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d4147170 con 0x7fd1d41545b0 2024-08-18T22:28:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d2800640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b8005220 0x7fd1d41f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d3200640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d41545b0 0x7fd1d4154a30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc01eea0 tx=0x7fd1b8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1caa00640 1 -- 172.21.15.5:0/492739129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc001c00 con 0x7fd1d41545b0 2024-08-18T22:28:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1caa00640 1 -- 172.21.15.5:0/492739129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0a8a90 con 0x7fd1d41545b0 2024-08-18T22:28:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d9400640 1 -- 172.21.15.5:0/492739129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d41f2b20 con 0x7fd1d41545b0 2024-08-18T22:28:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1caa00640 1 -- 172.21.15.5:0/492739129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc003ba0 con 0x7fd1d41545b0 2024-08-18T22:28:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d9400640 1 -- 172.21.15.5:0/492739129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d4147410 con 0x7fd1d41545b0 2024-08-18T22:28:10.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.439+0000 7fd1d9400640 1 -- 172.21.15.5:0/492739129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d40cce80 con 0x7fd1d41545b0 2024-08-18T22:28:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.443+0000 7fd1caa00640 1 -- 172.21.15.5:0/492739129 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd1cc0b8030 con 0x7fd1d41545b0 2024-08-18T22:28:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.443+0000 7fd1caa00640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1b40678c0 0x7fd1b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.443+0000 7fd1caa00640 1 -- 172.21.15.5:0/492739129 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 6187+0+0 (secure 0 0 0) 0x7fd1cc1224e0 con 0x7fd1d41545b0 2024-08-18T22:28:10.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.443+0000 7fd1d2800640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1b40678c0 0x7fd1b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:10.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.443+0000 7fd1d2800640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1b40678c0 0x7fd1b4069d80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4006b20 tx=0x7fd1c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.447+0000 7fd1caa00640 1 -- 172.21.15.5:0/492739129 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd1cc018d80 con 0x7fd1d41545b0 2024-08-18T22:28:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:10.615+0000 7fd1d9400640 1 -- 172.21.15.5:0/492739129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd1d40ad5d0 con 0x7fd1d41545b0 2024-08-18T22:28:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.247+0000 7fd1caa00640 1 -- 172.21.15.5:0/492739129 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v131) ==== 181+0+0 (secure 0 0 0) 0x7fd1cc0f2d90 con 0x7fd1d41545b0 2024-08-18T22:28:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:28:11.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 -- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1b40678c0 msgr2=0x7fd1b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:11.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1b40678c0 0x7fd1b4069d80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4006b20 tx=0x7fd1c4008040 comp rx=0 tx=0).stop 2024-08-18T22:28:11.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 -- 172.21.15.5:0/492739129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d41545b0 msgr2=0x7fd1d4154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:11.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d41545b0 0x7fd1d4154a30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc01eea0 tx=0x7fd1b8005840 comp rx=0 tx=0).stop 2024-08-18T22:28:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 -- 172.21.15.5:0/492739129 shutdown_connections 2024-08-18T22:28:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd1b40678c0 0x7fd1b4069d80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d41545b0 0x7fd1d4154a30 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d41f5510 0x7fd1d4154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 --2- 172.21.15.5:0/492739129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1b8005220 0x7fd1d41f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 -- 172.21.15.5:0/492739129 >> 172.21.15.5:0/492739129 conn(0x7fd1d406b9b0 msgr2=0x7fd1d40b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 -- 172.21.15.5:0/492739129 shutdown_connections 2024-08-18T22:28:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.251+0000 7fd1d9400640 1 -- 172.21.15.5:0/492739129 wait complete. 2024-08-18T22:28:11.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:28:11.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f802e800640 1 Processor -- start 2024-08-18T22:28:11.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f802e800640 1 -- start start 2024-08-18T22:28:11.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f802e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8028072a20 0x7f8028072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:11.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f802e800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80280b3c20 0x7f80280b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:11.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f802e800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80280735e0 con 0x7f80280cf020 2024-08-18T22:28:11.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f802e800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f80280733c0 con 0x7f8028072a20 2024-08-18T22:28:11.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f802e800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f80280738c0 con 0x7f80280b3c20 2024-08-18T22:28:11.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f8027400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f80280cf020 0x7f80280cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36290/0 (socket says 172.21.15.5:36290) 2024-08-18T22:28:11.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f8027400640 1 -- 172.21.15.5:0/2188822498 learned_addr learned my addr 172.21.15.5:0/2188822498 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:11.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f8026a00640 1 --2- 172.21.15.5:0/2188822498 >> v2:172.21.15.5:3300/0 conn(0x7f8028072a20 0x7f8028072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:11.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f8027e00640 1 --2- 172.21.15.5:0/2188822498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80280b3c20 0x7f80280b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:11.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f8026000640 1 -- 172.21.15.5:0/2188822498 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816773299 0 0) 0x7f80280735e0 con 0x7f80280cf020 2024-08-18T22:28:11.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f8026000640 1 -- 172.21.15.5:0/2188822498 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f800c003530 con 0x7f80280cf020 2024-08-18T22:28:11.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f8026a00640 1 -- 172.21.15.5:0/2188822498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80280b3c20 msgr2=0x7f80280b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:11.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f8026a00640 1 --2- 172.21.15.5:0/2188822498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80280b3c20 0x7f80280b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:11.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f8026a00640 1 -- 172.21.15.5:0/2188822498 >> v1:172.21.15.5:6789/0 conn(0x7f80280cf020 legacy=0x7f80280cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:11.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.439+0000 7f8026a00640 1 -- 172.21.15.5:0/2188822498 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8028073ba0 con 0x7f8028072a20 2024-08-18T22:28:11.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f8026a00640 1 --2- 172.21.15.5:0/2188822498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028072a20 0x7f8028072e80 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f80140097c0 tx=0x7f801401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf36cc5cf06e0eec server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:11.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f8026000640 1 -- 172.21.15.5:0/2188822498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80140b1070 con 0x7f8028072a20 2024-08-18T22:28:11.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f8026000640 1 -- 172.21.15.5:0/2188822498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80140ac630 con 0x7f8028072a20 2024-08-18T22:28:11.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f8026000640 1 -- 172.21.15.5:0/2188822498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80140a8050 con 0x7f8028072a20 2024-08-18T22:28:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f802e800640 1 -- 172.21.15.5:0/2188822498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028072a20 msgr2=0x7f8028072e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f802e800640 1 --2- 172.21.15.5:0/2188822498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028072a20 0x7f8028072e80 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f80140097c0 tx=0x7f801401c430 comp rx=0 tx=0).stop 2024-08-18T22:28:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f802e800640 1 -- 172.21.15.5:0/2188822498 shutdown_connections 2024-08-18T22:28:11.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f802e800640 1 --2- 172.21.15.5:0/2188822498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80280b3c20 0x7f80280b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:11.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f802e800640 1 --2- 172.21.15.5:0/2188822498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8028072a20 0x7f8028072e80 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:11.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f802e800640 1 -- 172.21.15.5:0/2188822498 >> 172.21.15.5:0/2188822498 conn(0x7f802806b9b0 msgr2=0x7f802806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:11.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f802e800640 1 -- 172.21.15.5:0/2188822498 shutdown_connections 2024-08-18T22:28:11.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.443+0000 7f802e800640 1 -- 172.21.15.5:0/2188822498 wait complete. 2024-08-18T22:28:11.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f802e800640 1 Processor -- start 2024-08-18T22:28:11.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f802e800640 1 -- start start 2024-08-18T22:28:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f802e800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8028072a20 0x7f8028143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f802e800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80280b3c20 0x7f8028166be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f802e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80280cf020 0x7f8028143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:11.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f802e800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8028155a60 con 0x7f80280cf020 2024-08-18T22:28:11.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f802e800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f80281558e0 con 0x7f80280b3c20 2024-08-18T22:28:11.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f802e800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f802815c760 con 0x7f8028072a20 2024-08-18T22:28:11.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f8027e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80280cf020 0x7f8028143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:11.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f8027400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8028072a20 0x7f8028143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:11.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f8027e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80280cf020 0x7f8028143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40818/0 (socket says 172.21.15.5:40818) 2024-08-18T22:28:11.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f8027e00640 1 -- 172.21.15.5:0/682506452 learned_addr learned my addr 172.21.15.5:0/682506452 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:11.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f8026a00640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80280b3c20 0x7f8028166be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:11.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f8027e00640 1 -- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8028072a20 msgr2=0x7f8028143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:11.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f8027e00640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8028072a20 0x7f8028143ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:11.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f8027e00640 1 -- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80280b3c20 msgr2=0x7f8028166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:11.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f8027e00640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80280b3c20 0x7f8028166be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f8027e00640 1 -- 172.21.15.5:0/682506452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80281581f0 con 0x7f80280cf020 2024-08-18T22:28:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f8027e00640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80280cf020 0x7f8028143150 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f8020007e40 tx=0x7f802000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f801f400640 1 -- 172.21.15.5:0/682506452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8020014620 con 0x7f80280cf020 2024-08-18T22:28:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f801f400640 1 -- 172.21.15.5:0/682506452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8020019070 con 0x7f80280cf020 2024-08-18T22:28:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f801f400640 1 -- 172.21.15.5:0/682506452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8020014a20 con 0x7f80280cf020 2024-08-18T22:28:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f802e800640 1 -- 172.21.15.5:0/682506452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8028144400 con 0x7f80280cf020 2024-08-18T22:28:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f802e800640 1 -- 172.21.15.5:0/682506452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8028156a60 con 0x7f80280cf020 2024-08-18T22:28:11.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.447+0000 7f802e800640 1 -- 172.21.15.5:0/682506452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8028142e10 con 0x7f80280cf020 2024-08-18T22:28:11.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.451+0000 7f801f400640 1 -- 172.21.15.5:0/682506452 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8020014bc0 con 0x7f80280cf020 2024-08-18T22:28:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.451+0000 7f801f400640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80080678c0 0x7f8008069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:11.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.451+0000 7f801f400640 1 -- 172.21.15.5:0/682506452 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5749+0+0 (secure 0 0 0) 0x7f80200864f0 con 0x7f80280cf020 2024-08-18T22:28:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.451+0000 7f8027400640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80080678c0 0x7f8008069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:11.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.451+0000 7f8027400640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80080678c0 0x7f8008069d80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8018007fd0 tx=0x7f8018009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.455+0000 7f801f400640 1 -- 172.21.15.5:0/682506452 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8020056910 con 0x7f80280cf020 2024-08-18T22:28:11.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:11.623+0000 7f802e800640 1 -- 172.21.15.5:0/682506452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8028072e80 con 0x7f80280cf020 2024-08-18T22:28:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f801f400640 1 -- 172.21.15.5:0/682506452 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v132) ==== 169+0+0 (secure 0 0 0) 0x7f802005ac10 con 0x7f80280cf020 2024-08-18T22:28:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:28:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 -- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80080678c0 msgr2=0x7f8008069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80080678c0 0x7f8008069d80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8018007fd0 tx=0x7f8018009040 comp rx=0 tx=0).stop 2024-08-18T22:28:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 -- 172.21.15.5:0/682506452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80280cf020 msgr2=0x7f8028143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80280cf020 0x7f8028143150 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f8020007e40 tx=0x7f802000e4b0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 -- 172.21.15.5:0/682506452 shutdown_connections 2024-08-18T22:28:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80080678c0 0x7f8008069d80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80280cf020 0x7f8028143150 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80280b3c20 0x7f8028166be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 --2- 172.21.15.5:0/682506452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8028072a20 0x7f8028143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 -- 172.21.15.5:0/682506452 >> 172.21.15.5:0/682506452 conn(0x7f802806b9b0 msgr2=0x7f8028141820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 -- 172.21.15.5:0/682506452 shutdown_connections 2024-08-18T22:28:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.251+0000 7f802e800640 1 -- 172.21.15.5:0/682506452 wait complete. 2024-08-18T22:28:12.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:28:12.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd029800640 1 Processor -- start 2024-08-18T22:28:12.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd029800640 1 -- start start 2024-08-18T22:28:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd029800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd02409b080 0x7fd0240b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd029800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd02406e8a0 con 0x7fd0240b1300 2024-08-18T22:28:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd029800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd02409bb80 con 0x7fd02409aca0 2024-08-18T22:28:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd029800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd0240d2e40 con 0x7fd02409b080 2024-08-18T22:28:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd023400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd02409b080 0x7fd0240b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd023400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd02409b080 0x7fd0240b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40824/0 (socket says 172.21.15.5:40824) 2024-08-18T22:28:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd01a000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd0240b1300 0x7fd024162950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36304/0 (socket says 172.21.15.5:36304) 2024-08-18T22:28:12.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd023400640 1 -- 172.21.15.5:0/1781921985 learned_addr learned my addr 172.21.15.5:0/1781921985 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd023400640 1 -- 172.21.15.5:0/1781921985 >> v1:172.21.15.117:6789/0 conn(0x7fd02409aca0 legacy=0x7fd0240afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd023400640 1 -- 172.21.15.5:0/1781921985 >> v1:172.21.15.5:6789/0 conn(0x7fd0240b1300 legacy=0x7fd024162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.423+0000 7fd023400640 1 -- 172.21.15.5:0/1781921985 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02406cbd0 con 0x7fd02409b080 2024-08-18T22:28:12.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd023400640 1 --2- 172.21.15.5:0/1781921985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd02409b080 0x7fd0240b01a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009e50 tx=0x7fd01c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d229abbc92f0820d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:12.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd022000640 1 -- 172.21.15.5:0/1781921985 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0a5810 con 0x7fd02409b080 2024-08-18T22:28:12.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd022000640 1 -- 172.21.15.5:0/1781921985 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd01c0a59b0 con 0x7fd02409b080 2024-08-18T22:28:12.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd022000640 1 -- 172.21.15.5:0/1781921985 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0a5d80 con 0x7fd02409b080 2024-08-18T22:28:12.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd029800640 1 -- 172.21.15.5:0/1781921985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd02409b080 msgr2=0x7fd0240b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd029800640 1 --2- 172.21.15.5:0/1781921985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd02409b080 0x7fd0240b01a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009e50 tx=0x7fd01c01ca30 comp rx=0 tx=0).stop 2024-08-18T22:28:12.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd029800640 1 -- 172.21.15.5:0/1781921985 shutdown_connections 2024-08-18T22:28:12.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd029800640 1 --2- 172.21.15.5:0/1781921985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd02409b080 0x7fd0240b01a0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd029800640 1 -- 172.21.15.5:0/1781921985 >> 172.21.15.5:0/1781921985 conn(0x7fd0240d2180 msgr2=0x7fd0240d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd029800640 1 -- 172.21.15.5:0/1781921985 shutdown_connections 2024-08-18T22:28:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd029800640 1 -- 172.21.15.5:0/1781921985 wait complete. 2024-08-18T22:28:12.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd029800640 1 Processor -- start 2024-08-18T22:28:12.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.427+0000 7fd029800640 1 -- start start 2024-08-18T22:28:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd029800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd02409aca0 0x7fd024146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd029800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02409b080 0x7fd0241604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd029800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0240b1300 0x7fd0240b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd029800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd02416ced0 con 0x7fd02409aca0 2024-08-18T22:28:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd029800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd02416cd50 con 0x7fd0240b1300 2024-08-18T22:28:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd029800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd02416d050 con 0x7fd02409b080 2024-08-18T22:28:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd022a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd02409aca0 0x7fd024146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd01a000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02409b080 0x7fd0241604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd022a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd02409aca0 0x7fd024146cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40832/0 (socket says 172.21.15.5:40832) 2024-08-18T22:28:12.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd022a00640 1 -- 172.21.15.5:0/576080384 learned_addr learned my addr 172.21.15.5:0/576080384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:12.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd023400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0240b1300 0x7fd0240b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd022a00640 1 -- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02409b080 msgr2=0x7fd0241604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd022a00640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02409b080 0x7fd0241604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd022a00640 1 -- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0240b1300 msgr2=0x7fd0240b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd022a00640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0240b1300 0x7fd0240b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd022a00640 1 -- 172.21.15.5:0/576080384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02415cb30 con 0x7fd02409aca0 2024-08-18T22:28:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd022a00640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd02409aca0 0x7fd024146cd0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c500 tx=0x7fd01400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd01b400640 1 -- 172.21.15.5:0/576080384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014016020 con 0x7fd02409aca0 2024-08-18T22:28:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd01b400640 1 -- 172.21.15.5:0/576080384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd014005220 con 0x7fd02409aca0 2024-08-18T22:28:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd01b400640 1 -- 172.21.15.5:0/576080384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014007030 con 0x7fd02409aca0 2024-08-18T22:28:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd029800640 1 -- 172.21.15.5:0/576080384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02415ce10 con 0x7fd02409aca0 2024-08-18T22:28:12.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd029800640 1 -- 172.21.15.5:0/576080384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02415d3d0 con 0x7fd02409aca0 2024-08-18T22:28:12.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.431+0000 7fd029800640 1 -- 172.21.15.5:0/576080384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0240afa90 con 0x7fd02409aca0 2024-08-18T22:28:12.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.435+0000 7fd01b400640 1 -- 172.21.15.5:0/576080384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0140071f0 con 0x7fd02409aca0 2024-08-18T22:28:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.435+0000 7fd01b400640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0000678c0 0x7fd000069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.435+0000 7fd01b400640 1 -- 172.21.15.5:0/576080384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7fd014085460 con 0x7fd02409aca0 2024-08-18T22:28:12.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.435+0000 7fd01a000640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0000678c0 0x7fd000069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:12.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.435+0000 7fd01a000640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0000678c0 0x7fd000069d80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd0241fa9d0 tx=0x7fd00c007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:12.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.439+0000 7fd01b400640 1 -- 172.21.15.5:0/576080384 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd014020020 con 0x7fd02409aca0 2024-08-18T22:28:12.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.607+0000 7fd029800640 1 -- 172.21.15.5:0/576080384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd02415d7b0 con 0x7fd02409aca0 2024-08-18T22:28:12.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd01b400640 1 -- 172.21.15.5:0/576080384 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7fd014055a30 con 0x7fd02409aca0 2024-08-18T22:28:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 -- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0000678c0 msgr2=0x7fd000069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0000678c0 0x7fd000069d80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd0241fa9d0 tx=0x7fd00c007e50 comp rx=0 tx=0).stop 2024-08-18T22:28:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 -- 172.21.15.5:0/576080384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd02409aca0 msgr2=0x7fd024146cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd02409aca0 0x7fd024146cd0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c500 tx=0x7fd01400c9c0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 -- 172.21.15.5:0/576080384 shutdown_connections 2024-08-18T22:28:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0000678c0 0x7fd000069d80 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0240b1300 0x7fd0240b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02409b080 0x7fd0241604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 --2- 172.21.15.5:0/576080384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd02409aca0 0x7fd024146cd0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 -- 172.21.15.5:0/576080384 >> 172.21.15.5:0/576080384 conn(0x7fd0240d2180 msgr2=0x7fd024169b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 -- 172.21.15.5:0/576080384 shutdown_connections 2024-08-18T22:28:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.611+0000 7fd029800640 1 -- 172.21.15.5:0/576080384 wait complete. 2024-08-18T22:28:12.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-08-18T22:28:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.779+0000 7f9fe1800640 1 Processor -- start 2024-08-18T22:28:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.779+0000 7f9fe1800640 1 -- start start 2024-08-18T22:28:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.779+0000 7f9fe1800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fdc0aea40 0x7f9fdc0aee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.779+0000 7f9fe1800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fdc0ace90 0x7f9fdc15ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.779+0000 7f9fe1800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fdc0af360 con 0x7f9fdc15d5e0 2024-08-18T22:28:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.779+0000 7f9fe1800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9fdc06da20 con 0x7f9fdc0aea40 2024-08-18T22:28:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.779+0000 7f9fe1800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9fdc15d390 con 0x7f9fdc0ace90 2024-08-18T22:28:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.779+0000 7f9fe0e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9fdc15d5e0 0x7f9fdc06ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36306/0 (socket says 172.21.15.5:36306) 2024-08-18T22:28:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.779+0000 7f9fdbe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fdc0aea40 0x7f9fdc0aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.779+0000 7f9fe0e00640 1 -- 172.21.15.5:0/918583740 learned_addr learned my addr 172.21.15.5:0/918583740 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.779+0000 7f9fd3400640 1 --2- 172.21.15.5:0/918583740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fdc0ace90 0x7f9fdc15ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.783+0000 7f9fd3400640 1 -- 172.21.15.5:0/918583740 >> v2:172.21.15.5:3300/0 conn(0x7f9fdc0aea40 msgr2=0x7f9fdc0aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.783+0000 7f9fd3400640 1 --2- 172.21.15.5:0/918583740 >> v2:172.21.15.5:3300/0 conn(0x7f9fdc0aea40 0x7f9fdc0aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.783+0000 7f9fd3400640 1 -- 172.21.15.5:0/918583740 >> v1:172.21.15.5:6789/0 conn(0x7f9fdc15d5e0 legacy=0x7f9fdc06ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.783+0000 7f9fd3400640 1 -- 172.21.15.5:0/918583740 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc06dc70 con 0x7f9fdc0ace90 2024-08-18T22:28:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.783+0000 7f9fd3400640 1 --2- 172.21.15.5:0/918583740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fdc0ace90 0x7f9fdc15ce50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009d90 tx=0x7f9fcc01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d175ee03e4e5bd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fdb400640 1 -- 172.21.15.5:0/918583740 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0b2070 con 0x7f9fdc0ace90 2024-08-18T22:28:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fdb400640 1 -- 172.21.15.5:0/918583740 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc0a5a00 con 0x7f9fdc0ace90 2024-08-18T22:28:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fdb400640 1 -- 172.21.15.5:0/918583740 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0a5dd0 con 0x7f9fdc0ace90 2024-08-18T22:28:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fe1800640 1 -- 172.21.15.5:0/918583740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fdc0ace90 msgr2=0x7f9fdc15ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fe1800640 1 --2- 172.21.15.5:0/918583740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fdc0ace90 0x7f9fdc15ce50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009d90 tx=0x7f9fcc01c940 comp rx=0 tx=0).stop 2024-08-18T22:28:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fe1800640 1 -- 172.21.15.5:0/918583740 shutdown_connections 2024-08-18T22:28:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fe1800640 1 --2- 172.21.15.5:0/918583740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fdc0ace90 0x7f9fdc15ce50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fe1800640 1 --2- 172.21.15.5:0/918583740 >> v2:172.21.15.5:3300/0 conn(0x7f9fdc0aea40 0x7f9fdc0aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fe1800640 1 -- 172.21.15.5:0/918583740 >> 172.21.15.5:0/918583740 conn(0x7f9fdc0b1b00 msgr2=0x7f9fdc0b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fe1800640 1 -- 172.21.15.5:0/918583740 shutdown_connections 2024-08-18T22:28:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fe1800640 1 -- 172.21.15.5:0/918583740 wait complete. 2024-08-18T22:28:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fe1800640 1 Processor -- start 2024-08-18T22:28:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.787+0000 7f9fe1800640 1 -- start start 2024-08-18T22:28:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fe1800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fdc0ace90 0x7f9fdc158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fe1800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fdc0aea40 0x7f9fdc09b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fe1800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc15d5e0 0x7f9fdc1f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fe1800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc15f730 con 0x7f9fdc0ace90 2024-08-18T22:28:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fe1800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc06e7f0 con 0x7f9fdc15d5e0 2024-08-18T22:28:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fe1800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9fdc06f830 con 0x7f9fdc0aea40 2024-08-18T22:28:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fdbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fdc0ace90 0x7f9fdc158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fdbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fdc0ace90 0x7f9fdc158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40848/0 (socket says 172.21.15.5:40848) 2024-08-18T22:28:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fdbe00640 1 -- 172.21.15.5:0/2726800467 learned_addr learned my addr 172.21.15.5:0/2726800467 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fe0e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc15d5e0 0x7f9fdc1f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fd3400640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fdc0aea40 0x7f9fdc09b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fdbe00640 1 -- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fdc0aea40 msgr2=0x7f9fdc09b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fdbe00640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fdc0aea40 0x7f9fdc09b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fdbe00640 1 -- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc15d5e0 msgr2=0x7f9fdc1f6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fdbe00640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc15d5e0 0x7f9fdc1f6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fdbe00640 1 -- 172.21.15.5:0/2726800467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc1589d0 con 0x7f9fdc0ace90 2024-08-18T22:28:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fe0e00640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc15d5e0 0x7f9fdc1f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fdbe00640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fdc0ace90 0x7f9fdc158490 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400e930 tx=0x7f9fc400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fd8c00640 1 -- 172.21.15.5:0/2726800467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4017070 con 0x7f9fdc0ace90 2024-08-18T22:28:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fd8c00640 1 -- 172.21.15.5:0/2726800467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc400ca00 con 0x7f9fdc0ace90 2024-08-18T22:28:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fe1800640 1 -- 172.21.15.5:0/2726800467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fdc09bda0 con 0x7f9fdc0ace90 2024-08-18T22:28:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fd8c00640 1 -- 172.21.15.5:0/2726800467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc400cdb0 con 0x7f9fdc0ace90 2024-08-18T22:28:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.791+0000 7f9fe1800640 1 -- 172.21.15.5:0/2726800467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fdc09c360 con 0x7f9fdc0ace90 2024-08-18T22:28:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.795+0000 7f9fe1800640 1 -- 172.21.15.5:0/2726800467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fdc09ca80 con 0x7f9fdc0ace90 2024-08-18T22:28:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.795+0000 7f9fd8c00640 1 -- 172.21.15.5:0/2726800467 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9fc401a070 con 0x7f9fdc0ace90 2024-08-18T22:28:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.795+0000 7f9fd8c00640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9fb80678c0 0x7f9fb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.795+0000 7f9fd8c00640 1 -- 172.21.15.5:0/2726800467 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7f9fc4085b50 con 0x7f9fdc0ace90 2024-08-18T22:28:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.795+0000 7f9fd3400640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9fb80678c0 0x7f9fb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.795+0000 7f9fd3400640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9fb80678c0 0x7f9fb8069d80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0af000 tx=0x7f9fcc0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:12.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:12.799+0000 7f9fd8c00640 1 -- 172.21.15.5:0/2726800467 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9fc40561d0 con 0x7f9fdc0ace90 2024-08-18T22:28:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.027+0000 7f9fe1800640 1 -- 172.21.15.5:0/2726800467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7f9fdc15d9f0 con 0x7f9fdc0ace90 2024-08-18T22:28:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.251+0000 7f9fd8c00640 1 -- 172.21.15.5:0/2726800467 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v427) ==== 144+0+0 (secure 0 0 0) 0x7f9fc405a4d0 con 0x7f9fdc0ace90 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 -- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9fb80678c0 msgr2=0x7f9fb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9fb80678c0 0x7f9fb8069d80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0af000 tx=0x7f9fcc0a7070 comp rx=0 tx=0).stop 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 -- 172.21.15.5:0/2726800467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fdc0ace90 msgr2=0x7f9fdc158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fdc0ace90 0x7f9fdc158490 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400e930 tx=0x7f9fc400edf0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 -- 172.21.15.5:0/2726800467 shutdown_connections 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9fb80678c0 0x7f9fb8069d80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc15d5e0 0x7f9fdc1f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fdc0aea40 0x7f9fdc09b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 --2- 172.21.15.5:0/2726800467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fdc0ace90 0x7f9fdc158490 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 -- 172.21.15.5:0/2726800467 >> 172.21.15.5:0/2726800467 conn(0x7f9fdc0b1b00 msgr2=0x7f9fdc0b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 -- 172.21.15.5:0/2726800467 shutdown_connections 2024-08-18T22:28:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.255+0000 7f9fe1800640 1 -- 172.21.15.5:0/2726800467 wait complete. 2024-08-18T22:28:13.275 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-08-18T22:28:13.275 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-08-18T22:28:13.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:28:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69db000640 1 Processor -- start 2024-08-18T22:28:13.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69db000640 1 -- start start 2024-08-18T22:28:13.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69db000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f69d41618d0 0x7f69d415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69db000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69d4161d40 0x7f69d415f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69db000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69d4162300 con 0x7f69d40c92d0 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69db000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f69d41625e0 con 0x7f69d4161d40 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69db000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f69d41628c0 con 0x7f69d41618d0 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69cb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69d4161d40 0x7f69d415f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69cb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69d4161d40 0x7f69d415f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40864/0 (socket says 172.21.15.5:40864) 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69cb400640 1 -- 172.21.15.5:0/1021445778 learned_addr learned my addr 172.21.15.5:0/1021445778 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69d3e00640 1 --2- 172.21.15.5:0/1021445778 >> v2:172.21.15.117:3300/0 conn(0x7f69d41618d0 0x7f69d415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69cb400640 1 -- 172.21.15.5:0/1021445778 >> v2:172.21.15.117:3300/0 conn(0x7f69d41618d0 msgr2=0x7f69d415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69cb400640 1 --2- 172.21.15.5:0/1021445778 >> v2:172.21.15.117:3300/0 conn(0x7f69d41618d0 0x7f69d415f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69cb400640 1 -- 172.21.15.5:0/1021445778 >> v1:172.21.15.5:6789/0 conn(0x7f69d40c92d0 legacy=0x7f69d40c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69cb400640 1 -- 172.21.15.5:0/1021445778 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d4162ba0 con 0x7f69d4161d40 2024-08-18T22:28:13.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.415+0000 7f69d3e00640 1 --2- 172.21.15.5:0/1021445778 >> v2:172.21.15.117:3300/0 conn(0x7f69d41618d0 0x7f69d415f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69cb400640 1 --2- 172.21.15.5:0/1021445778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d4161d40 0x7f69d415f910 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f69d40ca440 tx=0x7f69bc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482692bc983e3098 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69d3400640 1 -- 172.21.15.5:0/1021445778 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0b0070 con 0x7f69d4161d40 2024-08-18T22:28:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69d3400640 1 -- 172.21.15.5:0/1021445778 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69bc0ab600 con 0x7f69d4161d40 2024-08-18T22:28:13.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69d3400640 1 -- 172.21.15.5:0/1021445778 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0ab9d0 con 0x7f69d4161d40 2024-08-18T22:28:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69db000640 1 -- 172.21.15.5:0/1021445778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d4161d40 msgr2=0x7f69d415f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69db000640 1 --2- 172.21.15.5:0/1021445778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d4161d40 0x7f69d415f910 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f69d40ca440 tx=0x7f69bc01c520 comp rx=0 tx=0).stop 2024-08-18T22:28:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69db000640 1 -- 172.21.15.5:0/1021445778 shutdown_connections 2024-08-18T22:28:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69db000640 1 --2- 172.21.15.5:0/1021445778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d4161d40 0x7f69d415f910 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69db000640 1 --2- 172.21.15.5:0/1021445778 >> v2:172.21.15.117:3300/0 conn(0x7f69d41618d0 0x7f69d415f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69db000640 1 -- 172.21.15.5:0/1021445778 >> 172.21.15.5:0/1021445778 conn(0x7f69d40b1c50 msgr2=0x7f69d40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69db000640 1 -- 172.21.15.5:0/1021445778 shutdown_connections 2024-08-18T22:28:13.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.419+0000 7f69db000640 1 -- 172.21.15.5:0/1021445778 wait complete. 2024-08-18T22:28:13.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69db000640 1 Processor -- start 2024-08-18T22:28:13.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69db000640 1 -- start start 2024-08-18T22:28:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69db000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d40c92d0 0x7f69d4156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69db000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d41618d0 0x7f69d41565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69db000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69d4161d40 0x7f69d40cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69db000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f69d416b0e0 con 0x7f69d41618d0 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69db000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f69d40cf300 con 0x7f69d4161d40 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69db000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f69d416b260 con 0x7f69d40c92d0 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69cb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d41618d0 0x7f69d41565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69cb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d41618d0 0x7f69d41565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40868/0 (socket says 172.21.15.5:40868) 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69cb400640 1 -- 172.21.15.5:0/1839033168 learned_addr learned my addr 172.21.15.5:0/1839033168 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69d9000640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69d4161d40 0x7f69d40cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69d3e00640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d40c92d0 0x7f69d4156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69cb400640 1 -- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d40c92d0 msgr2=0x7f69d4156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69cb400640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d40c92d0 0x7f69d4156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69cb400640 1 -- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69d4161d40 msgr2=0x7f69d40cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69cb400640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69d4161d40 0x7f69d40cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69cb400640 1 -- 172.21.15.5:0/1839033168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d415d370 con 0x7f69d41618d0 2024-08-18T22:28:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69d3e00640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d40c92d0 0x7f69d4156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69d9000640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69d4161d40 0x7f69d40cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69cb400640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d41618d0 0x7f69d41565b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f69bc01ca00 tx=0x7f69bc0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69d0c00640 1 -- 172.21.15.5:0/1839033168 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0b0040 con 0x7f69d41618d0 2024-08-18T22:28:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69d0c00640 1 -- 172.21.15.5:0/1839033168 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69bc0ba070 con 0x7f69d41618d0 2024-08-18T22:28:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69db000640 1 -- 172.21.15.5:0/1839033168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d415d5f0 con 0x7f69d41618d0 2024-08-18T22:28:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69d0c00640 1 -- 172.21.15.5:0/1839033168 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0b4870 con 0x7f69d41618d0 2024-08-18T22:28:13.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.423+0000 7f69db000640 1 -- 172.21.15.5:0/1839033168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d415dbb0 con 0x7f69d41618d0 2024-08-18T22:28:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.427+0000 7f69db000640 1 -- 172.21.15.5:0/1839033168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d415f1d0 con 0x7f69d41618d0 2024-08-18T22:28:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.427+0000 7f69d0c00640 1 -- 172.21.15.5:0/1839033168 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f69bc0ab4c0 con 0x7f69d41618d0 2024-08-18T22:28:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.427+0000 7f69d0c00640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678f0 0x7f69b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.427+0000 7f69d0c00640 1 -- 172.21.15.5:0/1839033168 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7f69bc11f750 con 0x7f69d41618d0 2024-08-18T22:28:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.427+0000 7f69d3e00640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678f0 0x7f69b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.427+0000 7f69d3e00640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678f0 0x7f69b0069db0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f69d40699f0 tx=0x7f69c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.431+0000 7f69d0c00640 1 -- 172.21.15.5:0/1839033168 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f69d415d370 con 0x7f69d41618d0 2024-08-18T22:28:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 -- 172.21.15.5:0/1839033168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69d40739b0 con 0x7f69d41618d0 2024-08-18T22:28:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69d0c00640 1 -- 172.21.15.5:0/1839033168 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+13233 (secure 0 0 0) 0x7f69bc11f070 con 0x7f69d41618d0 2024-08-18T22:28:13.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:13.600 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":132,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:28:12.253720+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6837/2108480966":"2024-08-19T22:28:09.247142+0000","172.21.15.117:6835/2108480966":"2024-08-19T22:28:09.247142+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:28:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 -- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678f0 msgr2=0x7f69b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678f0 0x7f69b0069db0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f69d40699f0 tx=0x7f69c4008040 comp rx=0 tx=0).stop 2024-08-18T22:28:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 -- 172.21.15.5:0/1839033168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d41618d0 msgr2=0x7f69d41565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d41618d0 0x7f69d41565b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f69bc01ca00 tx=0x7f69bc0192c0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 -- 172.21.15.5:0/1839033168 shutdown_connections 2024-08-18T22:28:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69b00678f0 0x7f69b0069db0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69d4161d40 0x7f69d40cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69d41618d0 0x7f69d41565b0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 --2- 172.21.15.5:0/1839033168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69d40c92d0 0x7f69d4156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 -- 172.21.15.5:0/1839033168 >> 172.21.15.5:0/1839033168 conn(0x7f69d40b1c50 msgr2=0x7f69d406eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 -- 172.21.15.5:0/1839033168 shutdown_connections 2024-08-18T22:28:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.599+0000 7f69db000640 1 -- 172.21.15.5:0/1839033168 wait complete. 2024-08-18T22:28:13.622 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:28:13.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:28:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f9694e00640 1 Processor -- start 2024-08-18T22:28:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f9694e00640 1 -- start start 2024-08-18T22:28:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f9694e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f969009aca0 0x7f96900afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f9694e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f96900b1300 0x7f96900affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f9694e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969006e8a0 con 0x7f969009b080 2024-08-18T22:28:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f9694e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f969009bb80 con 0x7f969009aca0 2024-08-18T22:28:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f9694e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f96900d2e40 con 0x7f96900b1300 2024-08-18T22:28:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f968de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f969009aca0 0x7f96900afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f968de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f969009aca0 0x7f96900afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42882/0 (socket says 172.21.15.5:42882) 2024-08-18T22:28:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f968de00640 1 -- 172.21.15.5:0/1061175304 learned_addr learned my addr 172.21.15.5:0/1061175304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:13.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f968e800640 1 --1- 172.21.15.5:0/1061175304 >> v1:172.21.15.5:6789/0 conn(0x7f969009b080 0x7f96900b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41784/0 (socket says 172.21.15.5:41784) 2024-08-18T22:28:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f968d400640 1 --2- 172.21.15.5:0/1061175304 >> v2:172.21.15.117:3300/0 conn(0x7f96900b1300 0x7f96900affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f968de00640 1 -- 172.21.15.5:0/1061175304 >> v2:172.21.15.117:3300/0 conn(0x7f96900b1300 msgr2=0x7f96900affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f968de00640 1 --2- 172.21.15.5:0/1061175304 >> v2:172.21.15.117:3300/0 conn(0x7f96900b1300 0x7f96900affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f968de00640 1 -- 172.21.15.5:0/1061175304 >> v1:172.21.15.5:6789/0 conn(0x7f969009b080 legacy=0x7f96900b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.767+0000 7f968de00640 1 -- 172.21.15.5:0/1061175304 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969006cbd0 con 0x7f969009aca0 2024-08-18T22:28:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f968de00640 1 --2- 172.21.15.5:0/1061175304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f969009aca0 0x7f96900afa90 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f9690050430 tx=0x7f968001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5aca78d3da84ce3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f968ca00640 1 -- 172.21.15.5:0/1061175304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96800b1070 con 0x7f969009aca0 2024-08-18T22:28:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f968ca00640 1 -- 172.21.15.5:0/1061175304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96800ac630 con 0x7f969009aca0 2024-08-18T22:28:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f968ca00640 1 -- 172.21.15.5:0/1061175304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96800a8050 con 0x7f969009aca0 2024-08-18T22:28:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f9694e00640 1 -- 172.21.15.5:0/1061175304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f969009aca0 msgr2=0x7f96900afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f9694e00640 1 --2- 172.21.15.5:0/1061175304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f969009aca0 0x7f96900afa90 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f9690050430 tx=0x7f968001c520 comp rx=0 tx=0).stop 2024-08-18T22:28:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f9694e00640 1 -- 172.21.15.5:0/1061175304 shutdown_connections 2024-08-18T22:28:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f9694e00640 1 --2- 172.21.15.5:0/1061175304 >> v2:172.21.15.117:3300/0 conn(0x7f96900b1300 0x7f96900affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f9694e00640 1 --2- 172.21.15.5:0/1061175304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f969009aca0 0x7f96900afa90 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f9694e00640 1 -- 172.21.15.5:0/1061175304 >> 172.21.15.5:0/1061175304 conn(0x7f96900d2180 msgr2=0x7f96900d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f9694e00640 1 -- 172.21.15.5:0/1061175304 shutdown_connections 2024-08-18T22:28:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f9694e00640 1 -- 172.21.15.5:0/1061175304 wait complete. 2024-08-18T22:28:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f9694e00640 1 Processor -- start 2024-08-18T22:28:13.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.771+0000 7f9694e00640 1 -- start start 2024-08-18T22:28:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9694e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f969009aca0 0x7f9690150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9694e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f969009b080 0x7f9690156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9694e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96900b1300 0x7f9690157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9694e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f969016b6b0 con 0x7f969009aca0 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9694e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f969016b530 con 0x7f96900b1300 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9694e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f969016b830 con 0x7f969009b080 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f968de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f969009aca0 0x7f9690150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f968de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f969009aca0 0x7f9690150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42898/0 (socket says 172.21.15.5:42898) 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f968de00640 1 -- 172.21.15.5:0/4189097219 learned_addr learned my addr 172.21.15.5:0/4189097219 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f968d400640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f969009b080 0x7f9690156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f968e800640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96900b1300 0x7f9690157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f968de00640 1 -- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f969009b080 msgr2=0x7f9690156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f968de00640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f969009b080 0x7f9690156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f968de00640 1 -- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96900b1300 msgr2=0x7f9690157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f968de00640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96900b1300 0x7f9690157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f968de00640 1 -- 172.21.15.5:0/4189097219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96901f7cc0 con 0x7f969009aca0 2024-08-18T22:28:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f968de00640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f969009aca0 0x7f9690150f20 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f96800af040 tx=0x7f968001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9686000640 1 -- 172.21.15.5:0/4189097219 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96800bb020 con 0x7f969009aca0 2024-08-18T22:28:13.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9686000640 1 -- 172.21.15.5:0/4189097219 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96800ab670 con 0x7f969009aca0 2024-08-18T22:28:13.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9686000640 1 -- 172.21.15.5:0/4189097219 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96800b1040 con 0x7f969009aca0 2024-08-18T22:28:13.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9694e00640 1 -- 172.21.15.5:0/4189097219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96900cb470 con 0x7f969009aca0 2024-08-18T22:28:13.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9694e00640 1 -- 172.21.15.5:0/4189097219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96900cba30 con 0x7f969009aca0 2024-08-18T22:28:13.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9694e00640 1 -- 172.21.15.5:0/4189097219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9690161940 con 0x7f969009aca0 2024-08-18T22:28:13.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.775+0000 7f9686000640 1 -- 172.21.15.5:0/4189097219 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96800be020 con 0x7f969009aca0 2024-08-18T22:28:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.779+0000 7f9686000640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96700678c0 0x7f9670069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.779+0000 7f9686000640 1 -- 172.21.15.5:0/4189097219 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7f968011fb20 con 0x7f969009aca0 2024-08-18T22:28:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.779+0000 7f968d400640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96700678c0 0x7f9670069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.779+0000 7f968d400640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96700678c0 0x7f9670069d80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f969004ffa0 tx=0x7f967c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:13.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.783+0000 7f9686000640 1 -- 172.21.15.5:0/4189097219 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9680016110 con 0x7f969009aca0 2024-08-18T22:28:13.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 -- 172.21.15.5:0/4189097219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9690152200 con 0x7f969009aca0 2024-08-18T22:28:13.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9686000640 1 -- 172.21.15.5:0/4189097219 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) ==== 93+0+10 (secure 0 0 0) 0x7f96800f08e0 con 0x7f969009aca0 2024-08-18T22:28:13.947 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:28:13.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 -- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96700678c0 msgr2=0x7f9670069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96700678c0 0x7f9670069d80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f969004ffa0 tx=0x7f967c008040 comp rx=0 tx=0).stop 2024-08-18T22:28:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 -- 172.21.15.5:0/4189097219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f969009aca0 msgr2=0x7f9690150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f969009aca0 0x7f9690150f20 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f96800af040 tx=0x7f968001ad60 comp rx=0 tx=0).stop 2024-08-18T22:28:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 -- 172.21.15.5:0/4189097219 shutdown_connections 2024-08-18T22:28:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f96700678c0 0x7f9670069d80 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96900b1300 0x7f9690157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f969009b080 0x7f9690156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 --2- 172.21.15.5:0/4189097219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f969009aca0 0x7f9690150f20 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 -- 172.21.15.5:0/4189097219 >> 172.21.15.5:0/4189097219 conn(0x7f96900d2180 msgr2=0x7f9690151510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 -- 172.21.15.5:0/4189097219 shutdown_connections 2024-08-18T22:28:13.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:13.947+0000 7f9694e00640 1 -- 172.21.15.5:0/4189097219 wait complete. 2024-08-18T22:28:13.968 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-08-18T22:28:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.107+0000 7fa145e00640 1 Processor -- start 2024-08-18T22:28:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.107+0000 7fa145e00640 1 -- start start 2024-08-18T22:28:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa145e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa140161960 0x7fa14006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa145e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa14015eb60 con 0x7fa140070730 2024-08-18T22:28:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa145e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa14015ee40 con 0x7fa14015e4b0 2024-08-18T22:28:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa145e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa14015fcc0 con 0x7fa140161960 2024-08-18T22:28:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa136000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa140070730 0x7fa14015dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41794/0 (socket says 172.21.15.5:41794) 2024-08-18T22:28:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa136000640 1 -- 172.21.15.5:0/478093491 learned_addr learned my addr 172.21.15.5:0/478093491 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa13ea00640 1 --2- 172.21.15.5:0/478093491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa140161960 0x7fa14006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa13e000640 1 -- 172.21.15.5:0/478093491 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2648020408 0 0) 0x7fa14015eb60 con 0x7fa140070730 2024-08-18T22:28:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa13e000640 1 -- 172.21.15.5:0/478093491 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa124003530 con 0x7fa140070730 2024-08-18T22:28:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa13e000640 1 -- 172.21.15.5:0/478093491 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3813042835 0 0) 0x7fa14015ee40 con 0x7fa14015e4b0 2024-08-18T22:28:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa13e000640 1 -- 172.21.15.5:0/478093491 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa14015eb60 con 0x7fa14015e4b0 2024-08-18T22:28:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa13ea00640 1 -- 172.21.15.5:0/478093491 >> v1:172.21.15.117:6789/0 conn(0x7fa14015e4b0 legacy=0x7fa1400d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa13ea00640 1 -- 172.21.15.5:0/478093491 >> v1:172.21.15.5:6789/0 conn(0x7fa140070730 legacy=0x7fa14015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.111+0000 7fa13ea00640 1 -- 172.21.15.5:0/478093491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14015f120 con 0x7fa140161960 2024-08-18T22:28:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa13ea00640 1 --2- 172.21.15.5:0/478093491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa140161960 0x7fa14006fd20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa130009dc0 tx=0x7fa13001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b645200f0f65b97d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa13e000640 1 -- 172.21.15.5:0/478093491 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1300b2070 con 0x7fa140161960 2024-08-18T22:28:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa13e000640 1 -- 172.21.15.5:0/478093491 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1300a5850 con 0x7fa140161960 2024-08-18T22:28:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa13e000640 1 -- 172.21.15.5:0/478093491 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1300a5c00 con 0x7fa140161960 2024-08-18T22:28:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 -- 172.21.15.5:0/478093491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa140161960 msgr2=0x7fa14006fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 --2- 172.21.15.5:0/478093491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa140161960 0x7fa14006fd20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa130009dc0 tx=0x7fa13001c990 comp rx=0 tx=0).stop 2024-08-18T22:28:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 -- 172.21.15.5:0/478093491 shutdown_connections 2024-08-18T22:28:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 --2- 172.21.15.5:0/478093491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa140161960 0x7fa14006fd20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 -- 172.21.15.5:0/478093491 >> 172.21.15.5:0/478093491 conn(0x7fa1400d2130 msgr2=0x7fa1400d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 -- 172.21.15.5:0/478093491 shutdown_connections 2024-08-18T22:28:14.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 -- 172.21.15.5:0/478093491 wait complete. 2024-08-18T22:28:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 Processor -- start 2024-08-18T22:28:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 -- start start 2024-08-18T22:28:14.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa140070730 0x7fa1400c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:14.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa14015e4b0 0x7fa14015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:14.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa140161960 0x7fa1400cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:14.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa1400710a0 con 0x7fa140161960 2024-08-18T22:28:14.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa140070f20 con 0x7fa140070730 2024-08-18T22:28:14.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa145e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa140070260 con 0x7fa14015e4b0 2024-08-18T22:28:14.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.115+0000 7fa13f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa140161960 0x7fa1400cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:14.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa13f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa140161960 0x7fa1400cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42900/0 (socket says 172.21.15.5:42900) 2024-08-18T22:28:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa13f400640 1 -- 172.21.15.5:0/2074616232 learned_addr learned my addr 172.21.15.5:0/2074616232 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa13ea00640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa140070730 0x7fa1400c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa136000640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa14015e4b0 0x7fa14015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa13f400640 1 -- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa14015e4b0 msgr2=0x7fa14015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa13f400640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa14015e4b0 0x7fa14015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa13f400640 1 -- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa140070730 msgr2=0x7fa1400c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa13f400640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa140070730 0x7fa1400c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa13f400640 1 -- 172.21.15.5:0/2074616232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1400c8b00 con 0x7fa140161960 2024-08-18T22:28:14.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa13f400640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa140161960 0x7fa1400cd510 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fa13800c3f0 tx=0x7fa13800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa137e00640 1 -- 172.21.15.5:0/2074616232 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa138017070 con 0x7fa140161960 2024-08-18T22:28:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa137e00640 1 -- 172.21.15.5:0/2074616232 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1380052d0 con 0x7fa140161960 2024-08-18T22:28:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa137e00640 1 -- 172.21.15.5:0/2074616232 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa138003820 con 0x7fa140161960 2024-08-18T22:28:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa145e00640 1 -- 172.21.15.5:0/2074616232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1400c8260 con 0x7fa140161960 2024-08-18T22:28:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa145e00640 1 -- 172.21.15.5:0/2074616232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1400c8820 con 0x7fa140161960 2024-08-18T22:28:14.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa145e00640 1 -- 172.21.15.5:0/2074616232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa14015ee40 con 0x7fa140161960 2024-08-18T22:28:14.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa137e00640 1 -- 172.21.15.5:0/2074616232 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa13801a070 con 0x7fa140161960 2024-08-18T22:28:14.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa137e00640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa11c0678c0 0x7fa11c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:14.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.119+0000 7fa137e00640 1 -- 172.21.15.5:0/2074616232 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7fa138084e20 con 0x7fa140161960 2024-08-18T22:28:14.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.123+0000 7fa13ea00640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa11c0678c0 0x7fa11c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:14.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.123+0000 7fa13ea00640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa11c0678c0 0x7fa11c069d80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa1300af000 tx=0x7fa1300a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:14.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.127+0000 7fa137e00640 1 -- 172.21.15.5:0/2074616232 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa138005480 con 0x7fa140161960 2024-08-18T22:28:14.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:14.347+0000 7fa145e00640 1 -- 172.21.15.5:0/2074616232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7fa1400d3010 con 0x7fa140161960 2024-08-18T22:28:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.259+0000 7fa137e00640 1 -- 172.21.15.5:0/2074616232 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v429) ==== 158+0+0 (secure 0 0 0) 0x7fa138055480 con 0x7fa140161960 2024-08-18T22:28:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 -- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa11c0678c0 msgr2=0x7fa11c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa11c0678c0 0x7fa11c069d80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa1300af000 tx=0x7fa1300a7070 comp rx=0 tx=0).stop 2024-08-18T22:28:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 -- 172.21.15.5:0/2074616232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa140161960 msgr2=0x7fa1400cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa140161960 0x7fa1400cd510 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fa13800c3f0 tx=0x7fa13800c8b0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 -- 172.21.15.5:0/2074616232 shutdown_connections 2024-08-18T22:28:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa11c0678c0 0x7fa11c069d80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa140161960 0x7fa1400cd510 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa14015e4b0 0x7fa14015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 --2- 172.21.15.5:0/2074616232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa140070730 0x7fa1400c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 -- 172.21.15.5:0/2074616232 >> 172.21.15.5:0/2074616232 conn(0x7fa1400d2130 msgr2=0x7fa1400b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:15.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 -- 172.21.15.5:0/2074616232 shutdown_connections 2024-08-18T22:28:15.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.263+0000 7fa145e00640 1 -- 172.21.15.5:0/2074616232 wait complete. 2024-08-18T22:28:15.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:28:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8209e00640 1 Processor -- start 2024-08-18T22:28:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8209e00640 1 -- start start 2024-08-18T22:28:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8209e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f820415c180 0x7f82040cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8209e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f820415d4d0 0x7f820406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8209e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82040cfb00 con 0x7f820415c560 2024-08-18T22:28:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8209e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f820415d040 con 0x7f820415c180 2024-08-18T22:28:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8209e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f820415c9f0 con 0x7f820415d4d0 2024-08-18T22:28:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8202a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f820415c180 0x7f82040cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8202a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f820415c180 0x7f82040cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42912/0 (socket says 172.21.15.5:42912) 2024-08-18T22:28:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8202a00640 1 -- 172.21.15.5:0/159757198 learned_addr learned my addr 172.21.15.5:0/159757198 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8203400640 1 --2- 172.21.15.5:0/159757198 >> v2:172.21.15.117:3300/0 conn(0x7f820415d4d0 0x7f820406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8202a00640 1 -- 172.21.15.5:0/159757198 >> v2:172.21.15.117:3300/0 conn(0x7f820415d4d0 msgr2=0x7f820406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8202a00640 1 --2- 172.21.15.5:0/159757198 >> v2:172.21.15.117:3300/0 conn(0x7f820415d4d0 0x7f820406db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8202a00640 1 -- 172.21.15.5:0/159757198 >> v1:172.21.15.117:6789/0 conn(0x7f820415c560 legacy=0x7f82040ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8202a00640 1 -- 172.21.15.5:0/159757198 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820415ccd0 con 0x7f820415c180 2024-08-18T22:28:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.435+0000 7f8203400640 1 --2- 172.21.15.5:0/159757198 >> v2:172.21.15.117:3300/0 conn(0x7f820415d4d0 0x7f820406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8202a00640 1 --2- 172.21.15.5:0/159757198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f820415c180 0x7f82040cdf10 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f82040cdd30 tx=0x7f81f401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1789f7f467c423f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8201600640 1 -- 172.21.15.5:0/159757198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f40a7070 con 0x7f820415c180 2024-08-18T22:28:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8201600640 1 -- 172.21.15.5:0/159757198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f40b0070 con 0x7f820415c180 2024-08-18T22:28:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8201600640 1 -- 172.21.15.5:0/159757198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f40ab890 con 0x7f820415c180 2024-08-18T22:28:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8209e00640 1 -- 172.21.15.5:0/159757198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f820415c180 msgr2=0x7f82040cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8209e00640 1 --2- 172.21.15.5:0/159757198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f820415c180 0x7f82040cdf10 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f82040cdd30 tx=0x7f81f401c450 comp rx=0 tx=0).stop 2024-08-18T22:28:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8209e00640 1 -- 172.21.15.5:0/159757198 shutdown_connections 2024-08-18T22:28:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8209e00640 1 --2- 172.21.15.5:0/159757198 >> v2:172.21.15.117:3300/0 conn(0x7f820415d4d0 0x7f820406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8209e00640 1 --2- 172.21.15.5:0/159757198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f820415c180 0x7f82040cdf10 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8209e00640 1 -- 172.21.15.5:0/159757198 >> 172.21.15.5:0/159757198 conn(0x7f82040b1dc0 msgr2=0x7f82040b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8209e00640 1 -- 172.21.15.5:0/159757198 shutdown_connections 2024-08-18T22:28:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.439+0000 7f8209e00640 1 -- 172.21.15.5:0/159757198 wait complete. 2024-08-18T22:28:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8209e00640 1 Processor -- start 2024-08-18T22:28:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8209e00640 1 -- start start 2024-08-18T22:28:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8209e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f820415c180 0x7f82041549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8209e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f820415d4d0 0x7f8204071b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8209e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8204072060 0x7f820414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8209e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f82041692b0 con 0x7f8204072060 2024-08-18T22:28:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8209e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8204169130 con 0x7f820415c180 2024-08-18T22:28:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8209e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8204169430 con 0x7f820415d4d0 2024-08-18T22:28:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8203400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8204072060 0x7f820414caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8203400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8204072060 0x7f820414caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42914/0 (socket says 172.21.15.5:42914) 2024-08-18T22:28:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8203400640 1 -- 172.21.15.5:0/1050744877 learned_addr learned my addr 172.21.15.5:0/1050744877 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8202a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f820415c180 0x7f82041549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8202000640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f820415d4d0 0x7f8204071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8203400640 1 -- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f820415d4d0 msgr2=0x7f8204071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8203400640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f820415d4d0 0x7f8204071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8203400640 1 -- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f820415c180 msgr2=0x7f82041549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8203400640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f820415c180 0x7f82041549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8203400640 1 -- 172.21.15.5:0/1050744877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8204072570 con 0x7f8204072060 2024-08-18T22:28:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8203400640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8204072060 0x7f820414caa0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00cd50 tx=0x7f81fc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f81fb400640 1 -- 172.21.15.5:0/1050744877 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc00f680 con 0x7f8204072060 2024-08-18T22:28:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f81fb400640 1 -- 172.21.15.5:0/1050744877 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc00f840 con 0x7f8204072060 2024-08-18T22:28:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f81fb400640 1 -- 172.21.15.5:0/1050744877 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc00fc30 con 0x7f8204072060 2024-08-18T22:28:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8209e00640 1 -- 172.21.15.5:0/1050744877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8204072850 con 0x7f8204072060 2024-08-18T22:28:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8209e00640 1 -- 172.21.15.5:0/1050744877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8204072e10 con 0x7f8204072060 2024-08-18T22:28:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.443+0000 7f8209e00640 1 -- 172.21.15.5:0/1050744877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82041591c0 con 0x7f8204072060 2024-08-18T22:28:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.447+0000 7f81fb400640 1 -- 172.21.15.5:0/1050744877 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81fc00e3e0 con 0x7f8204072060 2024-08-18T22:28:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.447+0000 7f81fb400640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81e40678c0 0x7f81e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.447+0000 7f81fb400640 1 -- 172.21.15.5:0/1050744877 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7f81fc086820 con 0x7f8204072060 2024-08-18T22:28:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.447+0000 7f8202a00640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81e40678c0 0x7f81e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.447+0000 7f8202a00640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81e40678c0 0x7f81e4069d80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f81f40af000 tx=0x7f81f40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:15.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.451+0000 7f81fb400640 1 -- 172.21.15.5:0/1050744877 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f81fc014030 con 0x7f8204072060 2024-08-18T22:28:15.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.615+0000 7f8209e00640 1 -- 172.21.15.5:0/1050744877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8204158ee0 con 0x7f8204072060 2024-08-18T22:28:15.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.619+0000 7f81fb400640 1 -- 172.21.15.5:0/1050744877 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f81fc056de0 con 0x7f8204072060 2024-08-18T22:28:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 -- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81e40678c0 msgr2=0x7f81e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81e40678c0 0x7f81e4069d80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f81f40af000 tx=0x7f81f40a7000 comp rx=0 tx=0).stop 2024-08-18T22:28:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 -- 172.21.15.5:0/1050744877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8204072060 msgr2=0x7f820414caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8204072060 0x7f820414caa0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00cd50 tx=0x7f81fc00a650 comp rx=0 tx=0).stop 2024-08-18T22:28:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 -- 172.21.15.5:0/1050744877 shutdown_connections 2024-08-18T22:28:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81e40678c0 0x7f81e4069d80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8204072060 0x7f820414caa0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f820415d4d0 0x7f8204071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 --2- 172.21.15.5:0/1050744877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f820415c180 0x7f82041549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 -- 172.21.15.5:0/1050744877 >> 172.21.15.5:0/1050744877 conn(0x7f82040b1dc0 msgr2=0x7f820409dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 -- 172.21.15.5:0/1050744877 shutdown_connections 2024-08-18T22:28:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:15.623+0000 7f8209e00640 1 -- 172.21.15.5:0/1050744877 wait complete. 2024-08-18T22:28:15.643 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:28:15.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:28:15.756 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:28:15.852 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:28:15.852 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:28:15.852 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:15.861 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:28:15.861 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:28:15.861 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:15.870 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:28:15.870 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:28:15.870 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:15.909 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:28:15.910 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:28:15.910 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:15.920 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:28:15.921 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:28:15.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e2600640 1 Processor -- start 2024-08-18T22:28:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e2600640 1 -- start start 2024-08-18T22:28:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e2600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94dc15c0d0 0x7f94dc06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e2600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f94dc06c0c0 0x7f94dc0ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e2600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94dc06f8f0 con 0x7f94dc0707e0 2024-08-18T22:28:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e2600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f94dc0d0dc0 con 0x7f94dc15c0d0 2024-08-18T22:28:16.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e2600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f94dc0cdda0 con 0x7f94dc06c0c0 2024-08-18T22:28:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e1200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94dc15c0d0 0x7f94dc06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e1200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94dc15c0d0 0x7f94dc06f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42924/0 (socket says 172.21.15.5:42924) 2024-08-18T22:28:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94dbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f94dc0707e0 0x7f94dc06b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41798/0 (socket says 172.21.15.5:41798) 2024-08-18T22:28:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e1200640 1 -- 172.21.15.5:0/4287060293 learned_addr learned my addr 172.21.15.5:0/4287060293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e1200640 1 -- 172.21.15.5:0/4287060293 >> v2:172.21.15.117:3300/0 conn(0x7f94dc06c0c0 msgr2=0x7f94dc0ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e1c00640 1 --2- 172.21.15.5:0/4287060293 >> v2:172.21.15.117:3300/0 conn(0x7f94dc06c0c0 0x7f94dc0ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e1200640 1 --2- 172.21.15.5:0/4287060293 >> v2:172.21.15.117:3300/0 conn(0x7f94dc06c0c0 0x7f94dc0ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94db400640 1 -- 172.21.15.5:0/4287060293 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 653747598 0 0) 0x7f94dc06f8f0 con 0x7f94dc0707e0 2024-08-18T22:28:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e1200640 1 -- 172.21.15.5:0/4287060293 >> v1:172.21.15.5:6789/0 conn(0x7f94dc0707e0 legacy=0x7f94dc06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e1200640 1 -- 172.21.15.5:0/4287060293 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94dc070ce0 con 0x7f94dc15c0d0 2024-08-18T22:28:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.095+0000 7f94e1c00640 1 --2- 172.21.15.5:0/4287060293 >> v2:172.21.15.117:3300/0 conn(0x7f94dc06c0c0 0x7f94dc0ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94e1200640 1 --2- 172.21.15.5:0/4287060293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94dc15c0d0 0x7f94dc06f3b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0b6be0 tx=0x7f94d001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f89291eadb1d67f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94db400640 1 -- 172.21.15.5:0/4287060293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d00ab610 con 0x7f94dc15c0d0 2024-08-18T22:28:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94db400640 1 -- 172.21.15.5:0/4287060293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d00b0070 con 0x7f94dc15c0d0 2024-08-18T22:28:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94db400640 1 -- 172.21.15.5:0/4287060293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d00ab9d0 con 0x7f94dc15c0d0 2024-08-18T22:28:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94e2600640 1 -- 172.21.15.5:0/4287060293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94dc15c0d0 msgr2=0x7f94dc06f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94e2600640 1 --2- 172.21.15.5:0/4287060293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94dc15c0d0 0x7f94dc06f3b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0b6be0 tx=0x7f94d001c520 comp rx=0 tx=0).stop 2024-08-18T22:28:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94e2600640 1 -- 172.21.15.5:0/4287060293 shutdown_connections 2024-08-18T22:28:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94e2600640 1 --2- 172.21.15.5:0/4287060293 >> v2:172.21.15.117:3300/0 conn(0x7f94dc06c0c0 0x7f94dc0ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94e2600640 1 --2- 172.21.15.5:0/4287060293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94dc15c0d0 0x7f94dc06f3b0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94e2600640 1 -- 172.21.15.5:0/4287060293 >> 172.21.15.5:0/4287060293 conn(0x7f94dc06e890 msgr2=0x7f94dc06eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94e2600640 1 -- 172.21.15.5:0/4287060293 shutdown_connections 2024-08-18T22:28:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.099+0000 7f94e2600640 1 -- 172.21.15.5:0/4287060293 wait complete. 2024-08-18T22:28:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e2600640 1 Processor -- start 2024-08-18T22:28:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e2600640 1 -- start start 2024-08-18T22:28:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e2600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94dc06c0c0 0x7f94dc166360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e2600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94dc0707e0 0x7f94dc14ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e2600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94dc15c0d0 0x7f94dc14bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e2600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc0cf100 con 0x7f94dc0707e0 2024-08-18T22:28:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e2600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc0cef80 con 0x7f94dc06c0c0 2024-08-18T22:28:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e2600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f94dc0cf280 con 0x7f94dc15c0d0 2024-08-18T22:28:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94dbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94dc0707e0 0x7f94dc14ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94dbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94dc0707e0 0x7f94dc14ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42928/0 (socket says 172.21.15.5:42928) 2024-08-18T22:28:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94dbe00640 1 -- 172.21.15.5:0/2017297317 learned_addr learned my addr 172.21.15.5:0/2017297317 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e1200640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94dc06c0c0 0x7f94dc166360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e1c00640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94dc15c0d0 0x7f94dc14bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94dbe00640 1 -- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94dc15c0d0 msgr2=0x7f94dc14bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94dbe00640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94dc15c0d0 0x7f94dc14bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94dbe00640 1 -- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94dc06c0c0 msgr2=0x7f94dc166360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94dbe00640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94dc06c0c0 0x7f94dc166360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94dbe00640 1 -- 172.21.15.5:0/2017297317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94dc1668a0 con 0x7f94dc0707e0 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e1c00640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94dc15c0d0 0x7f94dc14bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94dbe00640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94dc0707e0 0x7f94dc14ded0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f94c80011f0 tx=0x7f94c800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94d8c00640 1 -- 172.21.15.5:0/2017297317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8018070 con 0x7f94dc0707e0 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94d8c00640 1 -- 172.21.15.5:0/2017297317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c80074e0 con 0x7f94dc0707e0 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e2600640 1 -- 172.21.15.5:0/2017297317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94dc14e940 con 0x7f94dc0707e0 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94d8c00640 1 -- 172.21.15.5:0/2017297317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8004a10 con 0x7f94dc0707e0 2024-08-18T22:28:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e2600640 1 -- 172.21.15.5:0/2017297317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94dc14f1e0 con 0x7f94dc0707e0 2024-08-18T22:28:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.103+0000 7f94e2600640 1 -- 172.21.15.5:0/2017297317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94dc068120 con 0x7f94dc0707e0 2024-08-18T22:28:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.107+0000 7f94d8c00640 1 -- 172.21.15.5:0/2017297317 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f94c801b070 con 0x7f94dc0707e0 2024-08-18T22:28:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.107+0000 7f94d8c00640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94bc0678c0 0x7f94bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.107+0000 7f94d8c00640 1 -- 172.21.15.5:0/2017297317 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7f94c8084eb0 con 0x7f94dc0707e0 2024-08-18T22:28:16.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.107+0000 7f94e1200640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94bc0678c0 0x7f94bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.107+0000 7f94e1200640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94bc0678c0 0x7f94bc069d80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f94d00af000 tx=0x7f94d00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.111+0000 7f94d8c00640 1 -- 172.21.15.5:0/2017297317 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f94c8055470 con 0x7f94dc0707e0 2024-08-18T22:28:16.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 -- 172.21.15.5:0/2017297317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94dc0ce210 con 0x7f94dc0707e0 2024-08-18T22:28:16.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94d8c00640 1 -- 172.21.15.5:0/2017297317 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+3910 (secure 0 0 0) 0x7f94c8059770 con 0x7f94dc0707e0 2024-08-18T22:28:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:16.311 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":102,"btime":"2024-08-18T22:28:10:249344+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1632895454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1632895454},{"type":"v1","addr":"172.21.15.117:6836","nonce":1632895454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/4222801809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":4222801809},{"type":"v1","addr":"172.21.15.117:6837","nonce":4222801809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/932399139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":932399139},{"type":"v1","addr":"172.21.15.5:6835","nonce":932399139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8157,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3229011054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3229011054},{"type":"v1","addr":"172.21.15.5:6834","nonce":3229011054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[]} 2024-08-18T22:28:16.311 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 102 2024-08-18T22:28:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 -- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94bc0678c0 msgr2=0x7f94bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94bc0678c0 0x7f94bc069d80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f94d00af000 tx=0x7f94d00a7000 comp rx=0 tx=0).stop 2024-08-18T22:28:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 -- 172.21.15.5:0/2017297317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94dc0707e0 msgr2=0x7f94dc14ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94dc0707e0 0x7f94dc14ded0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f94c80011f0 tx=0x7f94c800c9b0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 -- 172.21.15.5:0/2017297317 shutdown_connections 2024-08-18T22:28:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94bc0678c0 0x7f94bc069d80 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94dc15c0d0 0x7f94dc14bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94dc0707e0 0x7f94dc14ded0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 --2- 172.21.15.5:0/2017297317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94dc06c0c0 0x7f94dc166360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 -- 172.21.15.5:0/2017297317 >> 172.21.15.5:0/2017297317 conn(0x7f94dc06e890 msgr2=0x7f94dc15e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:16.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 -- 172.21.15.5:0/2017297317 shutdown_connections 2024-08-18T22:28:16.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.311+0000 7f94e2600640 1 -- 172.21.15.5:0/2017297317 wait complete. 2024-08-18T22:28:16.332 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:28:16.332 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:28:16.332 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:28:16.333 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:28:16.333 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:28:16.333 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:28:16.333 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:28:16.333 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:28:16.333 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:28:16.333 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:28:16.334 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:28:16.334 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:28:16.334 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:28:16.334 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:28:16.334 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:28:16.334 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:28:16.345 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:28:16.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:28:16.346 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:28:16.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:28:16.348 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:28:16.348 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:28:16.348 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:28:16.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:28:16.389 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:28:16.389 DEBUG:teuthology.parallel:result is None 2024-08-18T22:28:16.390 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:28:16.390 DEBUG:teuthology.parallel:result is None 2024-08-18T22:28:16.392 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:28:16.392 DEBUG:teuthology.parallel:result is None 2024-08-18T22:28:16.393 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:28:16.393 DEBUG:teuthology.parallel:result is None 2024-08-18T22:28:16.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:28:16.475 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:28:16.478 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:28:16.480 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:28:16.480 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:28:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.539+0000 7f3df1000640 1 Processor -- start 2024-08-18T22:28:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.539+0000 7f3df1000640 1 -- start start 2024-08-18T22:28:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.539+0000 7f3df1000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dec15b0c0 0x7f3dec06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.539+0000 7f3df1000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3dec0cf290 0x7f3dec0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.539+0000 7f3df1000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dec0b31f0 con 0x7f3dec0b40c0 2024-08-18T22:28:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.539+0000 7f3df1000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3dec0b3d70 con 0x7f3dec0cf290 2024-08-18T22:28:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.539+0000 7f3df1000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3dec0b4a40 con 0x7f3dec15b0c0 2024-08-18T22:28:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de1400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3dec0b40c0 0x7f3dec072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41816/0 (socket says 172.21.15.5:41816) 2024-08-18T22:28:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de1400640 1 -- 172.21.15.5:0/2149787555 learned_addr learned my addr 172.21.15.5:0/2149787555 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de9e00640 1 --2- 172.21.15.5:0/2149787555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dec15b0c0 0x7f3dec06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3dea800640 1 --2- 172.21.15.5:0/2149787555 >> v2:172.21.15.117:3300/0 conn(0x7f3dec0cf290 0x7f3dec0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de9e00640 1 -- 172.21.15.5:0/2149787555 >> v2:172.21.15.117:3300/0 conn(0x7f3dec0cf290 msgr2=0x7f3dec0b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de9e00640 1 --2- 172.21.15.5:0/2149787555 >> v2:172.21.15.117:3300/0 conn(0x7f3dec0cf290 0x7f3dec0b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de9e00640 1 -- 172.21.15.5:0/2149787555 >> v1:172.21.15.5:6789/0 conn(0x7f3dec0b40c0 legacy=0x7f3dec072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de9e00640 1 -- 172.21.15.5:0/2149787555 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec0b34d0 con 0x7f3dec15b0c0 2024-08-18T22:28:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de9400640 1 -- 172.21.15.5:0/2149787555 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1373732661 0 0) 0x7f3dec0b31f0 con 0x7f3dec0b40c0 2024-08-18T22:28:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de9e00640 1 --2- 172.21.15.5:0/2149787555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dec15b0c0 0x7f3dec06db80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0097c0 tx=0x7f3ddc01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5088d798cde2f66f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de9400640 1 -- 172.21.15.5:0/2149787555 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0b0070 con 0x7f3dec15b0c0 2024-08-18T22:28:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de9400640 1 -- 172.21.15.5:0/2149787555 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc004230 con 0x7f3dec15b0c0 2024-08-18T22:28:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.543+0000 7f3de9400640 1 -- 172.21.15.5:0/2149787555 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc003620 con 0x7f3dec15b0c0 2024-08-18T22:28:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 -- 172.21.15.5:0/2149787555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dec15b0c0 msgr2=0x7f3dec06db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 --2- 172.21.15.5:0/2149787555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dec15b0c0 0x7f3dec06db80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0097c0 tx=0x7f3ddc01c350 comp rx=0 tx=0).stop 2024-08-18T22:28:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 -- 172.21.15.5:0/2149787555 shutdown_connections 2024-08-18T22:28:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 --2- 172.21.15.5:0/2149787555 >> v2:172.21.15.117:3300/0 conn(0x7f3dec0cf290 0x7f3dec0b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 --2- 172.21.15.5:0/2149787555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dec15b0c0 0x7f3dec06db80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 -- 172.21.15.5:0/2149787555 >> 172.21.15.5:0/2149787555 conn(0x7f3dec0b1dc0 msgr2=0x7f3dec0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 -- 172.21.15.5:0/2149787555 shutdown_connections 2024-08-18T22:28:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 -- 172.21.15.5:0/2149787555 wait complete. 2024-08-18T22:28:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 Processor -- start 2024-08-18T22:28:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 -- start start 2024-08-18T22:28:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dec0b40c0 0x7f3dec157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dec0cf290 0x7f3dec151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dec15b0c0 0x7f3dec150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec15b620 con 0x7f3dec0b40c0 2024-08-18T22:28:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec15b4a0 con 0x7f3dec15b0c0 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3df1000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3dec06f670 con 0x7f3dec0cf290 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3de9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dec0b40c0 0x7f3dec157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3de9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dec0b40c0 0x7f3dec157e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42962/0 (socket says 172.21.15.5:42962) 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3de9e00640 1 -- 172.21.15.5:0/3512074371 learned_addr learned my addr 172.21.15.5:0/3512074371 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3de1400640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dec0cf290 0x7f3dec151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3dea800640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dec15b0c0 0x7f3dec150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3de9e00640 1 -- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dec0cf290 msgr2=0x7f3dec151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3de9e00640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dec0cf290 0x7f3dec151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3de9e00640 1 -- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dec15b0c0 msgr2=0x7f3dec150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3de9e00640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dec15b0c0 0x7f3dec150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3de9e00640 1 -- 172.21.15.5:0/3512074371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec1510d0 con 0x7f3dec0b40c0 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.547+0000 7f3de9e00640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dec0b40c0 0x7f3dec157e30 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0ae040 tx=0x7f3ddc0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.551+0000 7f3de2a00640 1 -- 172.21.15.5:0/3512074371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0bb070 con 0x7f3dec0b40c0 2024-08-18T22:28:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.551+0000 7f3de2a00640 1 -- 172.21.15.5:0/3512074371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc003e10 con 0x7f3dec0b40c0 2024-08-18T22:28:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.551+0000 7f3df1000640 1 -- 172.21.15.5:0/3512074371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dec151880 con 0x7f3dec0b40c0 2024-08-18T22:28:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.551+0000 7f3de2a00640 1 -- 172.21.15.5:0/3512074371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0b0040 con 0x7f3dec0b40c0 2024-08-18T22:28:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.551+0000 7f3df1000640 1 -- 172.21.15.5:0/3512074371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dec157630 con 0x7f3dec0b40c0 2024-08-18T22:28:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.551+0000 7f3df1000640 1 -- 172.21.15.5:0/3512074371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dec06fe40 con 0x7f3dec0b40c0 2024-08-18T22:28:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.551+0000 7f3de2a00640 1 -- 172.21.15.5:0/3512074371 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ddc0be070 con 0x7f3dec0b40c0 2024-08-18T22:28:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.551+0000 7f3de2a00640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3dc80678c0 0x7f3dc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.551+0000 7f3de2a00640 1 -- 172.21.15.5:0/3512074371 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7f3ddc120060 con 0x7f3dec0b40c0 2024-08-18T22:28:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.551+0000 7f3de1400640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3dc80678c0 0x7f3dc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.555+0000 7f3de1400640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3dc80678c0 0x7f3dc8069d80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3dec15e8e0 tx=0x7f3dd4007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.555+0000 7f3de2a00640 1 -- 172.21.15.5:0/3512074371 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f3ddc016090 con 0x7f3dec0b40c0 2024-08-18T22:28:16.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:16.735+0000 7f3df1000640 1 -- 172.21.15.5:0/3512074371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3dec15d630 con 0x7f3dec0b40c0 2024-08-18T22:28:17.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3de2a00640 1 -- 172.21.15.5:0/3512074371 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v137) ==== 97+0+0 (secure 0 0 0) 0x7f3ddc0f0d90 con 0x7f3dec0b40c0 2024-08-18T22:28:17.635 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 -- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3dc80678c0 msgr2=0x7f3dc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3dc80678c0 0x7f3dc8069d80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3dec15e8e0 tx=0x7f3dd4007c10 comp rx=0 tx=0).stop 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 -- 172.21.15.5:0/3512074371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dec0b40c0 msgr2=0x7f3dec157e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dec0b40c0 0x7f3dec157e30 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0ae040 tx=0x7f3ddc0190f0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 -- 172.21.15.5:0/3512074371 shutdown_connections 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3dc80678c0 0x7f3dc8069d80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dec15b0c0 0x7f3dec150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dec0cf290 0x7f3dec151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 --2- 172.21.15.5:0/3512074371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dec0b40c0 0x7f3dec157e30 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 -- 172.21.15.5:0/3512074371 >> 172.21.15.5:0/3512074371 conn(0x7f3dec0b1dc0 msgr2=0x7f3dec15cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 -- 172.21.15.5:0/3512074371 shutdown_connections 2024-08-18T22:28:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.635+0000 7f3df1000640 1 -- 172.21.15.5:0/3512074371 wait complete. 2024-08-18T22:28:17.662 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:28:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.807+0000 7f75c0000640 1 Processor -- start 2024-08-18T22:28:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.807+0000 7f75c0000640 1 -- start start 2024-08-18T22:28:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.807+0000 7f75c0000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75b815b010 0x7f75b80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.807+0000 7f75c0000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75b80cd3a0 0x7f75b806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.807+0000 7f75c0000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b806f0c0 0x7f75b80caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.807+0000 7f75c0000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f75b80cfa30 con 0x7f75b80cd3a0 2024-08-18T22:28:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.807+0000 7f75c0000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f75b80cee20 con 0x7f75b815b010 2024-08-18T22:28:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.807+0000 7f75c0000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75b80cf100 con 0x7f75b806f0c0 2024-08-18T22:28:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.807+0000 7f75bcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75b80cd3a0 0x7f75b806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.807+0000 7f75bcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75b80cd3a0 0x7f75b806eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42968/0 (socket says 172.21.15.5:42968) 2024-08-18T22:28:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.807+0000 7f75bcc00640 1 -- 172.21.15.5:0/4230472394 learned_addr learned my addr 172.21.15.5:0/4230472394 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75bd600640 1 --2- 172.21.15.5:0/4230472394 >> v2:172.21.15.117:3300/0 conn(0x7f75b815b010 0x7f75b80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75be000640 1 --2- 172.21.15.5:0/4230472394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b806f0c0 0x7f75b80caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75bcc00640 1 -- 172.21.15.5:0/4230472394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b806f0c0 msgr2=0x7f75b80caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75bcc00640 1 --2- 172.21.15.5:0/4230472394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b806f0c0 0x7f75b80caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75bcc00640 1 -- 172.21.15.5:0/4230472394 >> v2:172.21.15.117:3300/0 conn(0x7f75b815b010 msgr2=0x7f75b80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75bcc00640 1 --2- 172.21.15.5:0/4230472394 >> v2:172.21.15.117:3300/0 conn(0x7f75b815b010 0x7f75b80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75bcc00640 1 -- 172.21.15.5:0/4230472394 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b80cf3e0 con 0x7f75b80cd3a0 2024-08-18T22:28:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75bcc00640 1 --2- 172.21.15.5:0/4230472394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75b80cd3a0 0x7f75b806eb80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f75b80b2cc0 tx=0x7f75a401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb162412e90bd41 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75b7e00640 1 -- 172.21.15.5:0/4230472394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a40b0070 con 0x7f75b80cd3a0 2024-08-18T22:28:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75b7e00640 1 -- 172.21.15.5:0/4230472394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a40ab600 con 0x7f75b80cd3a0 2024-08-18T22:28:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75b7e00640 1 -- 172.21.15.5:0/4230472394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a40ab9d0 con 0x7f75b80cd3a0 2024-08-18T22:28:17.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75c0000640 1 -- 172.21.15.5:0/4230472394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75b80cd3a0 msgr2=0x7f75b806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:17.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75c0000640 1 --2- 172.21.15.5:0/4230472394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75b80cd3a0 0x7f75b806eb80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f75b80b2cc0 tx=0x7f75a401c260 comp rx=0 tx=0).stop 2024-08-18T22:28:17.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75c0000640 1 -- 172.21.15.5:0/4230472394 shutdown_connections 2024-08-18T22:28:17.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75c0000640 1 --2- 172.21.15.5:0/4230472394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b806f0c0 0x7f75b80caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.811+0000 7f75c0000640 1 --2- 172.21.15.5:0/4230472394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75b80cd3a0 0x7f75b806eb80 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 --2- 172.21.15.5:0/4230472394 >> v2:172.21.15.117:3300/0 conn(0x7f75b815b010 0x7f75b80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 -- 172.21.15.5:0/4230472394 >> 172.21.15.5:0/4230472394 conn(0x7f75b80b1c50 msgr2=0x7f75b80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 -- 172.21.15.5:0/4230472394 shutdown_connections 2024-08-18T22:28:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 -- 172.21.15.5:0/4230472394 wait complete. 2024-08-18T22:28:17.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 Processor -- start 2024-08-18T22:28:17.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 -- start start 2024-08-18T22:28:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75b806f0c0 0x7f75b81fae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75b80cd3a0 0x7f75b81420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b815b010 0x7f75b815b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f75b8072780 con 0x7f75b80cd3a0 2024-08-18T22:28:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75b8072600 con 0x7f75b806f0c0 2024-08-18T22:28:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75c0000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75b8072900 con 0x7f75b815b010 2024-08-18T22:28:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75bcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75b80cd3a0 0x7f75b81420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75bcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75b80cd3a0 0x7f75b81420d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42970/0 (socket says 172.21.15.5:42970) 2024-08-18T22:28:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75bcc00640 1 -- 172.21.15.5:0/2182544111 learned_addr learned my addr 172.21.15.5:0/2182544111 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75bd600640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75b806f0c0 0x7f75b81fae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75be000640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b815b010 0x7f75b815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75bcc00640 1 -- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b815b010 msgr2=0x7f75b815b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75bcc00640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b815b010 0x7f75b815b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75bcc00640 1 -- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75b806f0c0 msgr2=0x7f75b81fae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75bcc00640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75b806f0c0 0x7f75b81fae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75bcc00640 1 -- 172.21.15.5:0/2182544111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b815bf70 con 0x7f75b80cd3a0 2024-08-18T22:28:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.815+0000 7f75bcc00640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75b80cd3a0 0x7f75b81420d0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f75a401a910 tx=0x7f75a4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.819+0000 7f75b5600640 1 -- 172.21.15.5:0/2182544111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a40b9070 con 0x7f75b80cd3a0 2024-08-18T22:28:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.819+0000 7f75b5600640 1 -- 172.21.15.5:0/2182544111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a40b4400 con 0x7f75b80cd3a0 2024-08-18T22:28:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.819+0000 7f75b5600640 1 -- 172.21.15.5:0/2182544111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a40b0040 con 0x7f75b80cd3a0 2024-08-18T22:28:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.819+0000 7f75c0000640 1 -- 172.21.15.5:0/2182544111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b815c250 con 0x7f75b80cd3a0 2024-08-18T22:28:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.819+0000 7f75c0000640 1 -- 172.21.15.5:0/2182544111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b81fa8e0 con 0x7f75b80cd3a0 2024-08-18T22:28:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.819+0000 7f75c0000640 1 -- 172.21.15.5:0/2182544111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b806eb80 con 0x7f75b80cd3a0 2024-08-18T22:28:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.819+0000 7f75b5600640 1 -- 172.21.15.5:0/2182544111 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f75a40b33a0 con 0x7f75b80cd3a0 2024-08-18T22:28:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.819+0000 7f75b5600640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75980678c0 0x7f7598069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.819+0000 7f75b5600640 1 -- 172.21.15.5:0/2182544111 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5249+0+0 (secure 0 0 0) 0x7f75a411ed50 con 0x7f75b80cd3a0 2024-08-18T22:28:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.819+0000 7f75bd600640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75980678c0 0x7f7598069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.819+0000 7f75bd600640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75980678c0 0x7f7598069d80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f75b80b05a0 tx=0x7f75ac009830 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:17.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:17.823+0000 7f75b5600640 1 -- 172.21.15.5:0/2182544111 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f75a4016110 con 0x7f75b80cd3a0 2024-08-18T22:28:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.055+0000 7f75c0000640 1 -- 172.21.15.5:0/2182544111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f75b81580f0 con 0x7f75b80cd3a0 2024-08-18T22:28:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75b5600640 1 -- 172.21.15.5:0/2182544111 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f75a40ef3f0 con 0x7f75b80cd3a0 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.060 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.061 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:28:18.063 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:28:18.065 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:28:18.066 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.067 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:28:18.068 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:28:18.070 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.071 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:28:18.072 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:28:18.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 -- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75980678c0 msgr2=0x7f7598069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75980678c0 0x7f7598069d80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f75b80b05a0 tx=0x7f75ac009830 comp rx=0 tx=0).stop 2024-08-18T22:28:18.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 -- 172.21.15.5:0/2182544111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75b80cd3a0 msgr2=0x7f75b81420d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75b80cd3a0 0x7f75b81420d0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f75a401a910 tx=0x7f75a4019000 comp rx=0 tx=0).stop 2024-08-18T22:28:18.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 -- 172.21.15.5:0/2182544111 shutdown_connections 2024-08-18T22:28:18.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75980678c0 0x7f7598069d80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b815b010 0x7f75b815b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75b80cd3a0 0x7f75b81420d0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 --2- 172.21.15.5:0/2182544111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75b806f0c0 0x7f75b81fae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 -- 172.21.15.5:0/2182544111 >> 172.21.15.5:0/2182544111 conn(0x7f75b80b1c50 msgr2=0x7f75b80b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:18.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 -- 172.21.15.5:0/2182544111 shutdown_connections 2024-08-18T22:28:18.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.059+0000 7f75c0000640 1 -- 172.21.15.5:0/2182544111 wait complete. 2024-08-18T22:28:18.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:28:18.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.219+0000 7f1fcf600640 1 Processor -- start 2024-08-18T22:28:18.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.219+0000 7f1fcf600640 1 -- start start 2024-08-18T22:28:18.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.219+0000 7f1fcf600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1fc806f290 0x7f1fc80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.219+0000 7f1fcf600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc80cd850 con 0x7f1fc815b010 2024-08-18T22:28:18.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.219+0000 7f1fcf600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc80cee20 con 0x7f1fc80cd3a0 2024-08-18T22:28:18.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fcf600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc80cfa30 con 0x7f1fc806f290 2024-08-18T22:28:18.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fccc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1fc815b010 0x7f1fc806eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41820/0 (socket says 172.21.15.5:41820) 2024-08-18T22:28:18.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fccc00640 1 -- 172.21.15.5:0/2488833991 learned_addr learned my addr 172.21.15.5:0/2488833991 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:18.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fbfe00640 1 --2- 172.21.15.5:0/2488833991 >> v2:172.21.15.117:3300/0 conn(0x7f1fc806f290 0x7f1fc80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652057265 0 0) 0x7f1fc80cd850 con 0x7f1fc815b010 2024-08-18T22:28:18.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fac003530 con 0x7f1fc815b010 2024-08-18T22:28:18.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 396010425 0 0) 0x7f1fac003530 con 0x7f1fc815b010 2024-08-18T22:28:18.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 >> v2:172.21.15.117:3300/0 conn(0x7f1fc806f290 msgr2=0x7f1fc80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:18.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 --2- 172.21.15.5:0/2488833991 >> v2:172.21.15.117:3300/0 conn(0x7f1fc806f290 0x7f1fc80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 >> v1:172.21.15.117:6789/0 conn(0x7f1fc80cd3a0 legacy=0x7f1fc8072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc80cf100 con 0x7f1fc815b010 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f1fb8001680 con 0x7f1fc815b010 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 >> v1:172.21.15.5:6789/0 conn(0x7f1fc815b010 legacy=0x7f1fc806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 --2- 172.21.15.5:0/2488833991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fac0039c0 0x7f1fac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 --2- 172.21.15.5:0/2488833991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 0x7f1fac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 --2- 172.21.15.5:0/2488833991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fac0051d0 0x7f1fac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc80cfa30 con 0x7f1fac004810 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac00c070 con 0x7f1fac0039c0 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1fac00c270 con 0x7f1fac0051d0 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fbfe00640 1 --2- 172.21.15.5:0/2488833991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 0x7f1fac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fccc00640 1 --2- 172.21.15.5:0/2488833991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fac0039c0 0x7f1fac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fcd600640 1 --2- 172.21.15.5:0/2488833991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fac0051d0 0x7f1fac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fbfe00640 1 -- 172.21.15.5:0/2488833991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fac0051d0 msgr2=0x7f1fac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:18.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fbfe00640 1 --2- 172.21.15.5:0/2488833991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fac0051d0 0x7f1fac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fbfe00640 1 -- 172.21.15.5:0/2488833991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fac0039c0 msgr2=0x7f1fac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:18.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fbfe00640 1 --2- 172.21.15.5:0/2488833991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fac0039c0 0x7f1fac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fbfe00640 1 -- 172.21.15.5:0/2488833991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fac003530 con 0x7f1fac004810 2024-08-18T22:28:18.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.223+0000 7f1fcd600640 1 -- 172.21.15.5:0/2488833991 reap_dead start 2024-08-18T22:28:18.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fbfe00640 1 --2- 172.21.15.5:0/2488833991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 0x7f1fac004c90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009ae0 tx=0x7f1fb001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c3dd9b59055df3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:18.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00b2070 con 0x7f1fac004810 2024-08-18T22:28:18.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb00a5550 con 0x7f1fac004810 2024-08-18T22:28:18.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fc7e00640 1 -- 172.21.15.5:0/2488833991 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00096b0 con 0x7f1fac004810 2024-08-18T22:28:18.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fcf600640 1 -- 172.21.15.5:0/2488833991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 msgr2=0x7f1fac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fcf600640 1 --2- 172.21.15.5:0/2488833991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 0x7f1fac004c90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009ae0 tx=0x7f1fb001ca70 comp rx=0 tx=0).stop 2024-08-18T22:28:18.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fcf600640 1 -- 172.21.15.5:0/2488833991 shutdown_connections 2024-08-18T22:28:18.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fcf600640 1 --2- 172.21.15.5:0/2488833991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 0x7f1fac004c90 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fcf600640 1 -- 172.21.15.5:0/2488833991 >> 172.21.15.5:0/2488833991 conn(0x7f1fc80b1c50 msgr2=0x7f1fc80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:18.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fcf600640 1 -- 172.21.15.5:0/2488833991 shutdown_connections 2024-08-18T22:28:18.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fcf600640 1 -- 172.21.15.5:0/2488833991 wait complete. 2024-08-18T22:28:18.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fcf600640 1 Processor -- start 2024-08-18T22:28:18.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.227+0000 7f1fcf600640 1 -- start start 2024-08-18T22:28:18.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fcf600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 0x7f1fc816a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fcf600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fc8169bd0 0x7f1fc80b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fcf600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fc814a3e0 0x7f1fc814a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fcf600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc815b3f0 con 0x7f1fac004810 2024-08-18T22:28:18.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fcf600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc80cf6c0 con 0x7f1fc814a3e0 2024-08-18T22:28:18.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fcf600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc80c92d0 con 0x7f1fc8169bd0 2024-08-18T22:28:18.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fccc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 0x7f1fc816a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fccc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 0x7f1fc816a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42978/0 (socket says 172.21.15.5:42978) 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fccc00640 1 -- 172.21.15.5:0/698846144 learned_addr learned my addr 172.21.15.5:0/698846144 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fcd600640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fc814a3e0 0x7f1fc814a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fbfe00640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fc8169bd0 0x7f1fc80b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fccc00640 1 -- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fc8169bd0 msgr2=0x7f1fc80b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fccc00640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fc8169bd0 0x7f1fc80b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fccc00640 1 -- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fc814a3e0 msgr2=0x7f1fc814a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fccc00640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fc814a3e0 0x7f1fc814a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fccc00640 1 -- 172.21.15.5:0/698846144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc80c9520 con 0x7f1fac004810 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fbfe00640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fc8169bd0 0x7f1fc80b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fccc00640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 0x7f1fc816a890 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8007d10 tx=0x7f1fb8012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fc5600640 1 -- 172.21.15.5:0/698846144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb801c070 con 0x7f1fac004810 2024-08-18T22:28:18.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fc5600640 1 -- 172.21.15.5:0/698846144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb8014750 con 0x7f1fac004810 2024-08-18T22:28:18.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fc5600640 1 -- 172.21.15.5:0/698846144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8014b40 con 0x7f1fac004810 2024-08-18T22:28:18.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fcf600640 1 -- 172.21.15.5:0/698846144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc80c9800 con 0x7f1fac004810 2024-08-18T22:28:18.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fcf600640 1 -- 172.21.15.5:0/698846144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc80c9dc0 con 0x7f1fac004810 2024-08-18T22:28:18.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fcf600640 1 -- 172.21.15.5:0/698846144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc80ce840 con 0x7f1fac004810 2024-08-18T22:28:18.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.231+0000 7f1fc5600640 1 -- 172.21.15.5:0/698846144 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1fb8014ce0 con 0x7f1fac004810 2024-08-18T22:28:18.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.235+0000 7f1fc5600640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fa40678c0 0x7f1fa4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.235+0000 7f1fc5600640 1 -- 172.21.15.5:0/698846144 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5249+0+0 (secure 0 0 0) 0x7f1fb80883f0 con 0x7f1fac004810 2024-08-18T22:28:18.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.235+0000 7f1fbfe00640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fa40678c0 0x7f1fa4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.235+0000 7f1fbfe00640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fa40678c0 0x7f1fa4069d80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00af000 tx=0x7f1fb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:18.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.239+0000 7f1fc5600640 1 -- 172.21.15.5:0/698846144 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1fb80591a0 con 0x7f1fac004810 2024-08-18T22:28:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.411+0000 7f1fcf600640 1 -- 172.21.15.5:0/698846144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1fc814a1a0 con 0x7f1fac004810 2024-08-18T22:28:18.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.411+0000 7f1fc5600640 1 -- 172.21.15.5:0/698846144 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v137) ==== 84+0+65 (secure 0 0 0) 0x7f1fb8058aa0 con 0x7f1fac004810 2024-08-18T22:28:18.412 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:18.412 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:28:18.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:28:18.413 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:28:18.413 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:28:18.413 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:18.413 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:28:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 -- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fa40678c0 msgr2=0x7f1fa4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fa40678c0 0x7f1fa4069d80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00af000 tx=0x7f1fb0008040 comp rx=0 tx=0).stop 2024-08-18T22:28:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 -- 172.21.15.5:0/698846144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 msgr2=0x7f1fc816a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 0x7f1fc816a890 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8007d10 tx=0x7f1fb8012920 comp rx=0 tx=0).stop 2024-08-18T22:28:18.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 -- 172.21.15.5:0/698846144 shutdown_connections 2024-08-18T22:28:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1fa40678c0 0x7f1fa4069d80 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fc814a3e0 0x7f1fc814a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fc8169bd0 0x7f1fc80b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 --2- 172.21.15.5:0/698846144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac004810 0x7f1fc816a890 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 -- 172.21.15.5:0/698846144 >> 172.21.15.5:0/698846144 conn(0x7f1fc80b1c50 msgr2=0x7f1fc81592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 -- 172.21.15.5:0/698846144 shutdown_connections 2024-08-18T22:28:18.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.415+0000 7f1fcf600640 1 -- 172.21.15.5:0/698846144 wait complete. 2024-08-18T22:28:18.433 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:28:18.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:28:18.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.575+0000 7f486e400640 1 Processor -- start 2024-08-18T22:28:18.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.575+0000 7f486e400640 1 -- start start 2024-08-18T22:28:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f486e400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48680703a0 0x7f4868070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f486e400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48681486b0 con 0x7f4868147ce0 2024-08-18T22:28:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f486e400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48680b3c60 con 0x7f48680b4a20 2024-08-18T22:28:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f486e400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4868070d50 con 0x7f48680703a0 2024-08-18T22:28:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f4867400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4868147ce0 0x7f48680af9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41834/0 (socket says 172.21.15.5:41834) 2024-08-18T22:28:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f4867400640 1 -- 172.21.15.5:0/4122181887 learned_addr learned my addr 172.21.15.5:0/4122181887 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f4866a00640 1 --2- 172.21.15.5:0/4122181887 >> v2:172.21.15.5:3300/0 conn(0x7f48680703a0 0x7f4868070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f4866000640 1 -- 172.21.15.5:0/4122181887 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022569180 0 0) 0x7f48681486b0 con 0x7f4868147ce0 2024-08-18T22:28:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f4866000640 1 -- 172.21.15.5:0/4122181887 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f484c003530 con 0x7f4868147ce0 2024-08-18T22:28:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f4866a00640 1 -- 172.21.15.5:0/4122181887 >> v1:172.21.15.117:6789/0 conn(0x7f48680b4a20 legacy=0x7f48680b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f4866a00640 1 -- 172.21.15.5:0/4122181887 >> v1:172.21.15.5:6789/0 conn(0x7f4868147ce0 legacy=0x7f48680af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.579+0000 7f4866a00640 1 -- 172.21.15.5:0/4122181887 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48680b3f40 con 0x7f48680703a0 2024-08-18T22:28:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f4866a00640 1 --2- 172.21.15.5:0/4122181887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48680703a0 0x7f4868070810 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f48540097c0 tx=0x7f485401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b820647bcccb49e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:18.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f4866000640 1 -- 172.21.15.5:0/4122181887 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540aa600 con 0x7f48680703a0 2024-08-18T22:28:18.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f4866000640 1 -- 172.21.15.5:0/4122181887 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48540af070 con 0x7f48680703a0 2024-08-18T22:28:18.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f4866000640 1 -- 172.21.15.5:0/4122181887 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540aa9a0 con 0x7f48680703a0 2024-08-18T22:28:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f486e400640 1 -- 172.21.15.5:0/4122181887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48680703a0 msgr2=0x7f4868070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f486e400640 1 --2- 172.21.15.5:0/4122181887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48680703a0 0x7f4868070810 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f48540097c0 tx=0x7f485401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f486e400640 1 -- 172.21.15.5:0/4122181887 shutdown_connections 2024-08-18T22:28:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f486e400640 1 --2- 172.21.15.5:0/4122181887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48680703a0 0x7f4868070810 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f486e400640 1 -- 172.21.15.5:0/4122181887 >> 172.21.15.5:0/4122181887 conn(0x7f48680732f0 msgr2=0x7f486806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f486e400640 1 -- 172.21.15.5:0/4122181887 shutdown_connections 2024-08-18T22:28:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f486e400640 1 -- 172.21.15.5:0/4122181887 wait complete. 2024-08-18T22:28:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f486e400640 1 Processor -- start 2024-08-18T22:28:18.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.583+0000 7f486e400640 1 -- start start 2024-08-18T22:28:18.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f486e400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48680703a0 0x7f486813ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f486e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48680b4a20 0x7f4868143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f486e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4868147ce0 0x7f4868136b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f486e400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f48680b0230 con 0x7f48680b4a20 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f486e400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48680b00b0 con 0x7f48680703a0 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f486e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f486816c4d0 con 0x7f4868147ce0 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f4866a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48680b4a20 0x7f4868143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f4866a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48680b4a20 0x7f4868143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42986/0 (socket says 172.21.15.5:42986) 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f4866a00640 1 -- 172.21.15.5:0/1778808971 learned_addr learned my addr 172.21.15.5:0/1778808971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f4867400640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48680703a0 0x7f486813ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f4867e00640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4868147ce0 0x7f4868136b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f4866a00640 1 -- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4868147ce0 msgr2=0x7f4868136b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f4866a00640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4868147ce0 0x7f4868136b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f4866a00640 1 -- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48680703a0 msgr2=0x7f486813ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f4866a00640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48680703a0 0x7f486813ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f4866a00640 1 -- 172.21.15.5:0/1778808971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4868135a80 con 0x7f48680b4a20 2024-08-18T22:28:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f4866a00640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48680b4a20 0x7f4868143f40 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f48540ac040 tx=0x7f4854019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f485f400640 1 -- 172.21.15.5:0/1778808971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540c0070 con 0x7f48680b4a20 2024-08-18T22:28:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f485f400640 1 -- 172.21.15.5:0/1778808971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4854003820 con 0x7f48680b4a20 2024-08-18T22:28:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f485f400640 1 -- 172.21.15.5:0/1778808971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854003bf0 con 0x7f48680b4a20 2024-08-18T22:28:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f486e400640 1 -- 172.21.15.5:0/1778808971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4868135d60 con 0x7f48680b4a20 2024-08-18T22:28:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f486e400640 1 -- 172.21.15.5:0/1778808971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4868136600 con 0x7f48680b4a20 2024-08-18T22:28:18.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f486e400640 1 -- 172.21.15.5:0/1778808971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4868068f50 con 0x7f48680b4a20 2024-08-18T22:28:18.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.587+0000 7f485f400640 1 -- 172.21.15.5:0/1778808971 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f48540c3070 con 0x7f48680b4a20 2024-08-18T22:28:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.591+0000 7f485f400640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48480678c0 0x7f4848069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.591+0000 7f485f400640 1 -- 172.21.15.5:0/1778808971 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5249+0+0 (secure 0 0 0) 0x7f485411f9b0 con 0x7f48680b4a20 2024-08-18T22:28:18.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.591+0000 7f4867400640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48480678c0 0x7f4848069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:18.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.591+0000 7f4867400640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48480678c0 0x7f4848069d80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f48580011f0 tx=0x7f4858007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:18.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.595+0000 7f485f400640 1 -- 172.21.15.5:0/1778808971 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4854016090 con 0x7f48680b4a20 2024-08-18T22:28:18.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:18.763+0000 7f486e400640 1 -- 172.21.15.5:0/1778808971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4868135f30 con 0x7f48680b4a20 2024-08-18T22:28:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.639+0000 7f485f400640 1 -- 172.21.15.5:0/1778808971 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v138) ==== 138+0+0 (secure 0 0 0) 0x7f48540f0050 con 0x7f48680b4a20 2024-08-18T22:28:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:28:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 -- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48480678c0 msgr2=0x7f4848069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48480678c0 0x7f4848069d80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f48580011f0 tx=0x7f4858007d40 comp rx=0 tx=0).stop 2024-08-18T22:28:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 -- 172.21.15.5:0/1778808971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48680b4a20 msgr2=0x7f4868143f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48680b4a20 0x7f4868143f40 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f48540ac040 tx=0x7f4854019240 comp rx=0 tx=0).stop 2024-08-18T22:28:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 -- 172.21.15.5:0/1778808971 shutdown_connections 2024-08-18T22:28:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f48480678c0 0x7f4848069d80 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4868147ce0 0x7f4868136b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48680b4a20 0x7f4868143f40 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 --2- 172.21.15.5:0/1778808971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48680703a0 0x7f486813ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 -- 172.21.15.5:0/1778808971 >> 172.21.15.5:0/1778808971 conn(0x7f48680732f0 msgr2=0x7f486813b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 -- 172.21.15.5:0/1778808971 shutdown_connections 2024-08-18T22:28:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.643+0000 7f486e400640 1 -- 172.21.15.5:0/1778808971 wait complete. 2024-08-18T22:28:19.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:28:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f771ea00640 1 Processor -- start 2024-08-18T22:28:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f771ea00640 1 -- start start 2024-08-18T22:28:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f771ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7718158710 0x7f771806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f771ea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f771815e7b0 0x7f771806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f771ea00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f771815f780 con 0x7f771806cf00 2024-08-18T22:28:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f771ea00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f771806d370 con 0x7f771815e7b0 2024-08-18T22:28:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f771ea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f771815ec10 con 0x7f7718158710 2024-08-18T22:28:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f770f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f771815e7b0 0x7f771806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f771ca00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f771806cf00 0x7f77180ad8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41850/0 (socket says 172.21.15.5:41850) 2024-08-18T22:28:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f771ca00640 1 -- 172.21.15.5:0/3128821163 learned_addr learned my addr 172.21.15.5:0/3128821163 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f7717e00640 1 --2- 172.21.15.5:0/3128821163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7718158710 0x7f771806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.823+0000 7f770f400640 1 -- 172.21.15.5:0/3128821163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7718158710 msgr2=0x7f771806ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f770f400640 1 --2- 172.21.15.5:0/3128821163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7718158710 0x7f771806ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f770f400640 1 -- 172.21.15.5:0/3128821163 >> v1:172.21.15.5:6789/0 conn(0x7f771806cf00 legacy=0x7f77180ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f770f400640 1 -- 172.21.15.5:0/3128821163 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771815eee0 con 0x7f771815e7b0 2024-08-18T22:28:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f7717400640 1 -- 172.21.15.5:0/3128821163 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195491412 0 0) 0x7f771815f780 con 0x7f771806cf00 2024-08-18T22:28:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f770f400640 1 --2- 172.21.15.5:0/3128821163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771815e7b0 0x7f771806c9c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f77000097c0 tx=0x7f770001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584da3f8415af082 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f7717400640 1 -- 172.21.15.5:0/3128821163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77000b0070 con 0x7f771815e7b0 2024-08-18T22:28:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f7717400640 1 -- 172.21.15.5:0/3128821163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77000ab600 con 0x7f771815e7b0 2024-08-18T22:28:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f7717400640 1 -- 172.21.15.5:0/3128821163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77000ab9d0 con 0x7f771815e7b0 2024-08-18T22:28:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f771ea00640 1 -- 172.21.15.5:0/3128821163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771815e7b0 msgr2=0x7f771806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f771ea00640 1 --2- 172.21.15.5:0/3128821163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771815e7b0 0x7f771806c9c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f77000097c0 tx=0x7f770001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:28:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f771ea00640 1 -- 172.21.15.5:0/3128821163 shutdown_connections 2024-08-18T22:28:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f771ea00640 1 --2- 172.21.15.5:0/3128821163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f771815e7b0 0x7f771806c9c0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f771ea00640 1 --2- 172.21.15.5:0/3128821163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7718158710 0x7f771806ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f771ea00640 1 -- 172.21.15.5:0/3128821163 >> 172.21.15.5:0/3128821163 conn(0x7f7718072350 msgr2=0x7f7718072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f771ea00640 1 -- 172.21.15.5:0/3128821163 shutdown_connections 2024-08-18T22:28:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.827+0000 7f771ea00640 1 -- 172.21.15.5:0/3128821163 wait complete. 2024-08-18T22:28:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f771ea00640 1 Processor -- start 2024-08-18T22:28:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f771ea00640 1 -- start start 2024-08-18T22:28:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f771ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f771806cf00 0x7f7718149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f771ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7718158710 0x7f77180b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f771ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f771815e7b0 0x7f771814d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f771ea00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7718158af0 con 0x7f7718158710 2024-08-18T22:28:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f771ea00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f77180b03a0 con 0x7f771806cf00 2024-08-18T22:28:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f771ea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7718158c70 con 0x7f771815e7b0 2024-08-18T22:28:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f770f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7718158710 0x7f77180b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f770f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7718158710 0x7f77180b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42990/0 (socket says 172.21.15.5:42990) 2024-08-18T22:28:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f770f400640 1 -- 172.21.15.5:0/1350592580 learned_addr learned my addr 172.21.15.5:0/1350592580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f771ca00640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f771815e7b0 0x7f771814d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f7717e00640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f771806cf00 0x7f7718149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f770f400640 1 -- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f771815e7b0 msgr2=0x7f771814d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f770f400640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f771815e7b0 0x7f771814d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f770f400640 1 -- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f771806cf00 msgr2=0x7f7718149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f770f400640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f771806cf00 0x7f7718149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f770f400640 1 -- 172.21.15.5:0/1350592580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771814dde0 con 0x7f7718158710 2024-08-18T22:28:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f770f400640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7718158710 0x7f77180b0640 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f77000ae040 tx=0x7f7700019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:19.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f7714c00640 1 -- 172.21.15.5:0/1350592580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77000be070 con 0x7f7718158710 2024-08-18T22:28:19.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f7714c00640 1 -- 172.21.15.5:0/1350592580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7700004030 con 0x7f7718158710 2024-08-18T22:28:19.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f771ea00640 1 -- 172.21.15.5:0/1350592580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77181555d0 con 0x7f7718158710 2024-08-18T22:28:19.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.831+0000 7f7714c00640 1 -- 172.21.15.5:0/1350592580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77000b0040 con 0x7f7718158710 2024-08-18T22:28:19.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.835+0000 7f771ea00640 1 -- 172.21.15.5:0/1350592580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7718155b70 con 0x7f7718158710 2024-08-18T22:28:19.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.835+0000 7f771ea00640 1 -- 172.21.15.5:0/1350592580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77180b4f60 con 0x7f7718158710 2024-08-18T22:28:19.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.835+0000 7f7714c00640 1 -- 172.21.15.5:0/1350592580 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77000c1070 con 0x7f7718158710 2024-08-18T22:28:19.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.835+0000 7f7714c00640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76f40678f0 0x7f76f4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:19.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.835+0000 7f7714c00640 1 -- 172.21.15.5:0/1350592580 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5619+0+0 (secure 0 0 0) 0x7f770011f240 con 0x7f7718158710 2024-08-18T22:28:19.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.835+0000 7f7717e00640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76f40678f0 0x7f76f4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:19.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.839+0000 7f7717e00640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76f40678f0 0x7f76f4069db0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7708007a60 tx=0x7f7708008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:19.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:19.843+0000 7f7714c00640 1 -- 172.21.15.5:0/1350592580 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7700016090 con 0x7f7718158710 2024-08-18T22:28:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.011+0000 7f771ea00640 1 -- 172.21.15.5:0/1350592580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f77180afa50 con 0x7f7718158710 2024-08-18T22:28:20.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.643+0000 7f7714c00640 1 -- 172.21.15.5:0/1350592580 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v139) ==== 170+0+0 (secure 0 0 0) 0x7f77000ef6e0 con 0x7f7718158710 2024-08-18T22:28:20.646 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:28:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 -- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76f40678f0 msgr2=0x7f76f4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76f40678f0 0x7f76f4069db0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7708007a60 tx=0x7f7708008040 comp rx=0 tx=0).stop 2024-08-18T22:28:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 -- 172.21.15.5:0/1350592580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7718158710 msgr2=0x7f77180b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7718158710 0x7f77180b0640 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f77000ae040 tx=0x7f7700019240 comp rx=0 tx=0).stop 2024-08-18T22:28:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 -- 172.21.15.5:0/1350592580 shutdown_connections 2024-08-18T22:28:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f76f40678f0 0x7f76f4069db0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f771815e7b0 0x7f771814d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7718158710 0x7f77180b0640 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 --2- 172.21.15.5:0/1350592580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f771806cf00 0x7f7718149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 -- 172.21.15.5:0/1350592580 >> 172.21.15.5:0/1350592580 conn(0x7f7718072350 msgr2=0x7f77181542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 -- 172.21.15.5:0/1350592580 shutdown_connections 2024-08-18T22:28:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.647+0000 7f771ea00640 1 -- 172.21.15.5:0/1350592580 wait complete. 2024-08-18T22:28:20.689 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:28:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.831+0000 7f1a94e00640 1 Processor -- start 2024-08-18T22:28:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a94e00640 1 -- start start 2024-08-18T22:28:20.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a94e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1a900b4530 0x7f1a900ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:20.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a94e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a900b31f0 con 0x7f1a900b40c0 2024-08-18T22:28:20.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a94e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a900b34d0 con 0x7f1a9015b0c0 2024-08-18T22:28:20.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a94e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1a900b3d70 con 0x7f1a900b4530 2024-08-18T22:28:20.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a8d400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1a900b40c0 0x7f1a900ce280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41864/0 (socket says 172.21.15.5:41864) 2024-08-18T22:28:20.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a8d400640 1 -- 172.21.15.5:0/3740915142 learned_addr learned my addr 172.21.15.5:0/3740915142 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:20.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a8e800640 1 --2- 172.21.15.5:0/3740915142 >> v2:172.21.15.117:3300/0 conn(0x7f1a900b4530 0x7f1a900ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:20.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a8ca00640 1 -- 172.21.15.5:0/3740915142 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2718060917 0 0) 0x7f1a900b31f0 con 0x7f1a900b40c0 2024-08-18T22:28:20.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a8ca00640 1 -- 172.21.15.5:0/3740915142 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a74003530 con 0x7f1a900b40c0 2024-08-18T22:28:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a8ca00640 1 -- 172.21.15.5:0/3740915142 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860938789 0 0) 0x7f1a900b34d0 con 0x7f1a9015b0c0 2024-08-18T22:28:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a8ca00640 1 -- 172.21.15.5:0/3740915142 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a900b31f0 con 0x7f1a9015b0c0 2024-08-18T22:28:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a8e800640 1 -- 172.21.15.5:0/3740915142 >> v1:172.21.15.117:6789/0 conn(0x7f1a9015b0c0 legacy=0x7f1a9006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a8e800640 1 -- 172.21.15.5:0/3740915142 >> v1:172.21.15.5:6789/0 conn(0x7f1a900b40c0 legacy=0x7f1a900ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.835+0000 7f1a8e800640 1 -- 172.21.15.5:0/3740915142 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a900b37b0 con 0x7f1a900b4530 2024-08-18T22:28:20.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a8e800640 1 --2- 172.21.15.5:0/3740915142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a900b4530 0x7f1a900ce990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009d90 tx=0x7f1a8801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2a3516e95e4d00d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:20.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a8ca00640 1 -- 172.21.15.5:0/3740915142 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880b2070 con 0x7f1a900b4530 2024-08-18T22:28:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a8ca00640 1 -- 172.21.15.5:0/3740915142 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a880a57c0 con 0x7f1a900b4530 2024-08-18T22:28:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a8ca00640 1 -- 172.21.15.5:0/3740915142 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880a5b90 con 0x7f1a900b4530 2024-08-18T22:28:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a94e00640 1 -- 172.21.15.5:0/3740915142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a900b4530 msgr2=0x7f1a900ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a94e00640 1 --2- 172.21.15.5:0/3740915142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a900b4530 0x7f1a900ce990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009d90 tx=0x7f1a8801c850 comp rx=0 tx=0).stop 2024-08-18T22:28:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a94e00640 1 -- 172.21.15.5:0/3740915142 shutdown_connections 2024-08-18T22:28:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a94e00640 1 --2- 172.21.15.5:0/3740915142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a900b4530 0x7f1a900ce990 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a94e00640 1 -- 172.21.15.5:0/3740915142 >> 172.21.15.5:0/3740915142 conn(0x7f1a900b1dc0 msgr2=0x7f1a900b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a94e00640 1 -- 172.21.15.5:0/3740915142 shutdown_connections 2024-08-18T22:28:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a94e00640 1 -- 172.21.15.5:0/3740915142 wait complete. 2024-08-18T22:28:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a94e00640 1 Processor -- start 2024-08-18T22:28:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.839+0000 7f1a94e00640 1 -- start start 2024-08-18T22:28:20.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a94e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a900b40c0 0x7f1a900b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:20.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a94e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a900b4530 0x7f1a90150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:20.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a94e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a9015b0c0 0x7f1a90151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:20.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a94e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9006f7f0 con 0x7f1a9015b0c0 2024-08-18T22:28:20.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a94e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9006f670 con 0x7f1a900b40c0 2024-08-18T22:28:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a94e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9006e410 con 0x7f1a900b4530 2024-08-18T22:28:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a8e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a9015b0c0 0x7f1a90151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a8e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a9015b0c0 0x7f1a90151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42998/0 (socket says 172.21.15.5:42998) 2024-08-18T22:28:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a8e800640 1 -- 172.21.15.5:0/279915692 learned_addr learned my addr 172.21.15.5:0/279915692 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a8d400640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a900b4530 0x7f1a90150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a8de00640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a900b40c0 0x7f1a900b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a8e800640 1 -- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a900b4530 msgr2=0x7f1a90150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a8e800640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a900b4530 0x7f1a90150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a8e800640 1 -- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a900b40c0 msgr2=0x7f1a900b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:20.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a8e800640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a900b40c0 0x7f1a900b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:20.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a8e800640 1 -- 172.21.15.5:0/279915692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a900983c0 con 0x7f1a9015b0c0 2024-08-18T22:28:20.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a8e800640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a9015b0c0 0x7f1a90151260 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f1a8801a480 tx=0x7f1a900cf6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:20.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a86000640 1 -- 172.21.15.5:0/279915692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880bc030 con 0x7f1a9015b0c0 2024-08-18T22:28:20.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a86000640 1 -- 172.21.15.5:0/279915692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a880a55c0 con 0x7f1a9015b0c0 2024-08-18T22:28:20.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a86000640 1 -- 172.21.15.5:0/279915692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a880b2040 con 0x7f1a9015b0c0 2024-08-18T22:28:20.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a94e00640 1 -- 172.21.15.5:0/279915692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a900986a0 con 0x7f1a9015b0c0 2024-08-18T22:28:20.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a94e00640 1 -- 172.21.15.5:0/279915692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a90098c60 con 0x7f1a9015b0c0 2024-08-18T22:28:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.843+0000 7f1a94e00640 1 -- 172.21.15.5:0/279915692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a900008e0 con 0x7f1a9015b0c0 2024-08-18T22:28:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.847+0000 7f1a86000640 1 -- 172.21.15.5:0/279915692 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1a880bf070 con 0x7f1a9015b0c0 2024-08-18T22:28:20.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.847+0000 7f1a86000640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a700678c0 0x7f1a70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:20.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.847+0000 7f1a86000640 1 -- 172.21.15.5:0/279915692 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 6001+0+0 (secure 0 0 0) 0x7f1a88120a70 con 0x7f1a9015b0c0 2024-08-18T22:28:20.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.847+0000 7f1a8de00640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a700678c0 0x7f1a70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:20.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.847+0000 7f1a8de00640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a700678c0 0x7f1a70069d80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1a800011f0 tx=0x7f1a80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:20.851+0000 7f1a86000640 1 -- 172.21.15.5:0/279915692 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1a880c6070 con 0x7f1a9015b0c0 2024-08-18T22:28:21.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.051+0000 7f1a94e00640 1 -- 172.21.15.5:0/279915692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1a9006cae0 con 0x7f1a9015b0c0 2024-08-18T22:28:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.647+0000 7f1a86000640 1 -- 172.21.15.5:0/279915692 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v104) ==== 174+0+0 (secure 0 0 0) 0x7f1a88016560 con 0x7f1a9015b0c0 2024-08-18T22:28:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 19 and data pool 20 2024-08-18T22:28:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.651+0000 7f1a94e00640 1 -- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a700678c0 msgr2=0x7f1a70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.651+0000 7f1a94e00640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a700678c0 0x7f1a70069d80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1a800011f0 tx=0x7f1a80009040 comp rx=0 tx=0).stop 2024-08-18T22:28:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.651+0000 7f1a94e00640 1 -- 172.21.15.5:0/279915692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a9015b0c0 msgr2=0x7f1a90151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.651+0000 7f1a94e00640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a9015b0c0 0x7f1a90151260 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f1a8801a480 tx=0x7f1a900cf6e0 comp rx=0 tx=0).stop 2024-08-18T22:28:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.655+0000 7f1a94e00640 1 -- 172.21.15.5:0/279915692 shutdown_connections 2024-08-18T22:28:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.655+0000 7f1a94e00640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1a700678c0 0x7f1a70069d80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.655+0000 7f1a94e00640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a9015b0c0 0x7f1a90151260 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.655+0000 7f1a94e00640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a900b4530 0x7f1a90150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.655+0000 7f1a94e00640 1 --2- 172.21.15.5:0/279915692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a900b40c0 0x7f1a900b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.655+0000 7f1a94e00640 1 -- 172.21.15.5:0/279915692 >> 172.21.15.5:0/279915692 conn(0x7f1a900b1dc0 msgr2=0x7f1a900732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.655+0000 7f1a94e00640 1 -- 172.21.15.5:0/279915692 shutdown_connections 2024-08-18T22:28:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.655+0000 7f1a94e00640 1 -- 172.21.15.5:0/279915692 wait complete. 2024-08-18T22:28:21.705 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:28:21.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.847+0000 7fc066200640 1 Processor -- start 2024-08-18T22:28:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.847+0000 7fc066200640 1 -- start start 2024-08-18T22:28:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.847+0000 7fc066200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc060071c90 0x7fc0600b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.847+0000 7fc066200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc06006fad0 0x7fc06015c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.847+0000 7fc066200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0600b5e30 con 0x7fc06015c180 2024-08-18T22:28:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.847+0000 7fc066200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc06015caa0 con 0x7fc060071c90 2024-08-18T22:28:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.847+0000 7fc066200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc0600b6110 con 0x7fc06006fad0 2024-08-18T22:28:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc06015c180 0x7fc060071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41876/0 (socket says 172.21.15.5:41876) 2024-08-18T22:28:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05f400640 1 -- 172.21.15.5:0/530447284 learned_addr learned my addr 172.21.15.5:0/530447284 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05ea00640 1 --2- 172.21.15.5:0/530447284 >> v2:172.21.15.5:3300/0 conn(0x7fc060071c90 0x7fc0600b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05e000640 1 -- 172.21.15.5:0/530447284 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690991709 0 0) 0x7fc0600b5e30 con 0x7fc06015c180 2024-08-18T22:28:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05e000640 1 -- 172.21.15.5:0/530447284 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc044003530 con 0x7fc06015c180 2024-08-18T22:28:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05fe00640 1 --2- 172.21.15.5:0/530447284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc06006fad0 0x7fc06015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05ea00640 1 -- 172.21.15.5:0/530447284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc06006fad0 msgr2=0x7fc06015c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05ea00640 1 --2- 172.21.15.5:0/530447284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc06006fad0 0x7fc06015c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05ea00640 1 -- 172.21.15.5:0/530447284 >> v1:172.21.15.5:6789/0 conn(0x7fc06015c180 legacy=0x7fc060071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05ea00640 1 -- 172.21.15.5:0/530447284 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0600b63f0 con 0x7fc060071c90 2024-08-18T22:28:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05fe00640 1 --2- 172.21.15.5:0/530447284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc06006fad0 0x7fc06015c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05ea00640 1 --2- 172.21.15.5:0/530447284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc060071c90 0x7fc0600b57c0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0097c0 tx=0x7fc04c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ccda170cd1259c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.851+0000 7fc05e000640 1 -- 172.21.15.5:0/530447284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c0b1070 con 0x7fc060071c90 2024-08-18T22:28:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc05e000640 1 -- 172.21.15.5:0/530447284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc04c0ac640 con 0x7fc060071c90 2024-08-18T22:28:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc05e000640 1 -- 172.21.15.5:0/530447284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c0ac9f0 con 0x7fc060071c90 2024-08-18T22:28:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 -- 172.21.15.5:0/530447284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc060071c90 msgr2=0x7fc0600b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 --2- 172.21.15.5:0/530447284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc060071c90 0x7fc0600b57c0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0097c0 tx=0x7fc04c01c350 comp rx=0 tx=0).stop 2024-08-18T22:28:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 -- 172.21.15.5:0/530447284 shutdown_connections 2024-08-18T22:28:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 --2- 172.21.15.5:0/530447284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc06006fad0 0x7fc06015c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 --2- 172.21.15.5:0/530447284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc060071c90 0x7fc0600b57c0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 -- 172.21.15.5:0/530447284 >> 172.21.15.5:0/530447284 conn(0x7fc0600b3eb0 msgr2=0x7fc0600b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 -- 172.21.15.5:0/530447284 shutdown_connections 2024-08-18T22:28:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 -- 172.21.15.5:0/530447284 wait complete. 2024-08-18T22:28:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 Processor -- start 2024-08-18T22:28:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 -- start start 2024-08-18T22:28:21.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc06006fad0 0x7fc0601fa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:21.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc060071c90 0x7fc06006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:21.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06015c180 0x7fc06006d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:21.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc0600d1c30 con 0x7fc06015c180 2024-08-18T22:28:21.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc0600d1ab0 con 0x7fc06006fad0 2024-08-18T22:28:21.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc066200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc0600d1db0 con 0x7fc060071c90 2024-08-18T22:28:21.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc05fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06015c180 0x7fc06006d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:21.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc05fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06015c180 0x7fc06006d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43018/0 (socket says 172.21.15.5:43018) 2024-08-18T22:28:21.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc05fe00640 1 -- 172.21.15.5:0/2198881262 learned_addr learned my addr 172.21.15.5:0/2198881262 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:21.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc05ea00640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc060071c90 0x7fc06006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:21.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.855+0000 7fc05f400640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc06006fad0 0x7fc0601fa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc05fe00640 1 -- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc060071c90 msgr2=0x7fc06006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc05fe00640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc060071c90 0x7fc06006cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc05fe00640 1 -- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc06006fad0 msgr2=0x7fc0601fa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc05fe00640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc06006fad0 0x7fc0601fa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc05fe00640 1 -- 172.21.15.5:0/2198881262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0601f6b30 con 0x7fc06015c180 2024-08-18T22:28:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc05f400640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc06006fad0 0x7fc0601fa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc05fe00640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06015c180 0x7fc06006d000 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fc05800cea0 tx=0x7fc05800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc057400640 1 -- 172.21.15.5:0/2198881262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058003ba0 con 0x7fc06015c180 2024-08-18T22:28:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc057400640 1 -- 172.21.15.5:0/2198881262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058003d60 con 0x7fc06015c180 2024-08-18T22:28:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc057400640 1 -- 172.21.15.5:0/2198881262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05800d880 con 0x7fc06015c180 2024-08-18T22:28:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc066200640 1 -- 172.21.15.5:0/2198881262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0601f6e10 con 0x7fc06015c180 2024-08-18T22:28:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc066200640 1 -- 172.21.15.5:0/2198881262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0601f73d0 con 0x7fc06015c180 2024-08-18T22:28:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc066200640 1 -- 172.21.15.5:0/2198881262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0601475b0 con 0x7fc06015c180 2024-08-18T22:28:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc057400640 1 -- 172.21.15.5:0/2198881262 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc05800da20 con 0x7fc06015c180 2024-08-18T22:28:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc057400640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0400678c0 0x7fc040069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc057400640 1 -- 172.21.15.5:0/2198881262 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fc058086800 con 0x7fc06015c180 2024-08-18T22:28:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.859+0000 7fc05f400640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0400678c0 0x7fc040069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.863+0000 7fc05f400640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0400678c0 0x7fc040069d80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc050005890 tx=0x7fc050009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:21.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:21.863+0000 7fc057400640 1 -- 172.21.15.5:0/2198881262 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc0601475b0 con 0x7fc06015c180 2024-08-18T22:28:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.031+0000 7fc066200640 1 -- 172.21.15.5:0/2198881262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc06015c560 con 0x7fc06015c180 2024-08-18T22:28:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.031+0000 7fc057400640 1 -- 172.21.15.5:0/2198881262 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16841 (secure 0 0 0) 0x7fc058056ac0 con 0x7fc06015c180 2024-08-18T22:28:22.032 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:22.033 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":140,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:28:21.056042+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:28:18.813860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-08-18T22:28:20.061149+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:28:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 -- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0400678c0 msgr2=0x7fc040069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0400678c0 0x7fc040069d80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc050005890 tx=0x7fc050009040 comp rx=0 tx=0).stop 2024-08-18T22:28:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 -- 172.21.15.5:0/2198881262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06015c180 msgr2=0x7fc06006d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06015c180 0x7fc06006d000 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fc05800cea0 tx=0x7fc05800cf90 comp rx=0 tx=0).stop 2024-08-18T22:28:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 -- 172.21.15.5:0/2198881262 shutdown_connections 2024-08-18T22:28:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0400678c0 0x7fc040069d80 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc06015c180 0x7fc06006d000 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc060071c90 0x7fc06006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 --2- 172.21.15.5:0/2198881262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc06006fad0 0x7fc0601fa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 -- 172.21.15.5:0/2198881262 >> 172.21.15.5:0/2198881262 conn(0x7fc0600b3eb0 msgr2=0x7fc0600b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 -- 172.21.15.5:0/2198881262 shutdown_connections 2024-08-18T22:28:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.035+0000 7fc066200640 1 -- 172.21.15.5:0/2198881262 wait complete. 2024-08-18T22:28:22.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:28:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f1131c00640 1 Processor -- start 2024-08-18T22:28:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f1131c00640 1 -- start start 2024-08-18T22:28:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f1131c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f112c15b010 0x7f112c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f1131c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f112c0cd3a0 0x7f112c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f1131c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f112c06f0c0 0x7f112c0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f1131c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f112c0cfa30 con 0x7f112c0cd3a0 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f1131c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f112c0cee20 con 0x7f112c06f0c0 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f1131c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f112c0cf100 con 0x7f112c15b010 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f112a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f112c0cd3a0 0x7f112c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f112a000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f112c0cd3a0 0x7f112c06eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43026/0 (socket says 172.21.15.5:43026) 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f112a000640 1 -- 172.21.15.5:0/1947872755 learned_addr learned my addr 172.21.15.5:0/1947872755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f112aa00640 1 --2- 172.21.15.5:0/1947872755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f112c15b010 0x7f112c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f112b400640 1 --2- 172.21.15.5:0/1947872755 >> v2:172.21.15.117:3300/0 conn(0x7f112c06f0c0 0x7f112c0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f112a000640 1 -- 172.21.15.5:0/1947872755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f112c15b010 msgr2=0x7f112c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f112a000640 1 --2- 172.21.15.5:0/1947872755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f112c15b010 0x7f112c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f112a000640 1 -- 172.21.15.5:0/1947872755 >> v2:172.21.15.117:3300/0 conn(0x7f112c06f0c0 msgr2=0x7f112c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f112a000640 1 --2- 172.21.15.5:0/1947872755 >> v2:172.21.15.117:3300/0 conn(0x7f112c06f0c0 0x7f112c0caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.195+0000 7f112a000640 1 -- 172.21.15.5:0/1947872755 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112c0cf3e0 con 0x7f112c0cd3a0 2024-08-18T22:28:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f112a000640 1 --2- 172.21.15.5:0/1947872755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c0cd3a0 0x7f112c06eb80 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f112c06ffa0 tx=0x7f111801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f266324e610db server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1129600640 1 -- 172.21.15.5:0/1947872755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11180b0070 con 0x7f112c0cd3a0 2024-08-18T22:28:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1129600640 1 -- 172.21.15.5:0/1947872755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11180ab600 con 0x7f112c0cd3a0 2024-08-18T22:28:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1129600640 1 -- 172.21.15.5:0/1947872755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11180ab9d0 con 0x7f112c0cd3a0 2024-08-18T22:28:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1131c00640 1 -- 172.21.15.5:0/1947872755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c0cd3a0 msgr2=0x7f112c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1131c00640 1 --2- 172.21.15.5:0/1947872755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c0cd3a0 0x7f112c06eb80 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f112c06ffa0 tx=0x7f111801c260 comp rx=0 tx=0).stop 2024-08-18T22:28:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1131c00640 1 -- 172.21.15.5:0/1947872755 shutdown_connections 2024-08-18T22:28:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1131c00640 1 --2- 172.21.15.5:0/1947872755 >> v2:172.21.15.117:3300/0 conn(0x7f112c06f0c0 0x7f112c0caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1131c00640 1 --2- 172.21.15.5:0/1947872755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c0cd3a0 0x7f112c06eb80 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1131c00640 1 --2- 172.21.15.5:0/1947872755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f112c15b010 0x7f112c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1131c00640 1 -- 172.21.15.5:0/1947872755 >> 172.21.15.5:0/1947872755 conn(0x7f112c0b1c50 msgr2=0x7f112c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1131c00640 1 -- 172.21.15.5:0/1947872755 shutdown_connections 2024-08-18T22:28:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.199+0000 7f1131c00640 1 -- 172.21.15.5:0/1947872755 wait complete. 2024-08-18T22:28:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1131c00640 1 Processor -- start 2024-08-18T22:28:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1131c00640 1 -- start start 2024-08-18T22:28:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1131c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c06f0c0 0x7f112c152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1131c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f112c0cd3a0 0x7f112c1521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1131c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f112c15b010 0x7f112c09c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1131c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f112c06dbf0 con 0x7f112c06f0c0 2024-08-18T22:28:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1131c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f112c06da70 con 0x7f112c0cd3a0 2024-08-18T22:28:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1131c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f112c06dd70 con 0x7f112c15b010 2024-08-18T22:28:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f112aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c06f0c0 0x7f112c152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f112aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c06f0c0 0x7f112c152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43040/0 (socket says 172.21.15.5:43040) 2024-08-18T22:28:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f112aa00640 1 -- 172.21.15.5:0/1843991412 learned_addr learned my addr 172.21.15.5:0/1843991412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f112a000640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f112c0cd3a0 0x7f112c1521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f112b400640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f112c15b010 0x7f112c09c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f112aa00640 1 -- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f112c15b010 msgr2=0x7f112c09c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f112aa00640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f112c15b010 0x7f112c09c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f112aa00640 1 -- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f112c0cd3a0 msgr2=0x7f112c1521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f112aa00640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f112c0cd3a0 0x7f112c1521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f112aa00640 1 -- 172.21.15.5:0/1843991412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112c09d920 con 0x7f112c06f0c0 2024-08-18T22:28:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f112aa00640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c06f0c0 0x7f112c152a40 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f111c00d620 tx=0x7f111c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1122a00640 1 -- 172.21.15.5:0/1843991412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c00b620 con 0x7f112c06f0c0 2024-08-18T22:28:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1122a00640 1 -- 172.21.15.5:0/1843991412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111c019070 con 0x7f112c06f0c0 2024-08-18T22:28:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1122a00640 1 -- 172.21.15.5:0/1843991412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c00b9e0 con 0x7f112c06f0c0 2024-08-18T22:28:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1131c00640 1 -- 172.21.15.5:0/1843991412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112c09cda0 con 0x7f112c06f0c0 2024-08-18T22:28:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1131c00640 1 -- 172.21.15.5:0/1843991412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f112c09d360 con 0x7f112c06f0c0 2024-08-18T22:28:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.203+0000 7f1131c00640 1 -- 172.21.15.5:0/1843991412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f112c0caf40 con 0x7f112c06f0c0 2024-08-18T22:28:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.207+0000 7f1122a00640 1 -- 172.21.15.5:0/1843991412 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f111c00bb80 con 0x7f112c06f0c0 2024-08-18T22:28:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.207+0000 7f1122a00640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f110c0678c0 0x7f110c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.207+0000 7f1122a00640 1 -- 172.21.15.5:0/1843991412 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f111c0860b0 con 0x7f112c06f0c0 2024-08-18T22:28:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.207+0000 7f112a000640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f110c0678c0 0x7f110c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.207+0000 7f112a000640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f110c0678c0 0x7f110c069d80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f11180ad000 tx=0x7f11180a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.211+0000 7f1122a00640 1 -- 172.21.15.5:0/1843991412 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f111c056400 con 0x7f112c06f0c0 2024-08-18T22:28:22.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.375+0000 7f1131c00640 1 -- 172.21.15.5:0/1843991412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f112c06ca70 con 0x7f112c06f0c0 2024-08-18T22:28:22.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.375+0000 7f1122a00640 1 -- 172.21.15.5:0/1843991412 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16841 (secure 0 0 0) 0x7f111c05a700 con 0x7f112c06f0c0 2024-08-18T22:28:22.378 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:22.378 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":140,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:28:21.056042+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:28:18.813860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-08-18T22:28:20.061149+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:28:22.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 -- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f110c0678c0 msgr2=0x7f110c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:22.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f110c0678c0 0x7f110c069d80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f11180ad000 tx=0x7f11180a6000 comp rx=0 tx=0).stop 2024-08-18T22:28:22.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 -- 172.21.15.5:0/1843991412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c06f0c0 msgr2=0x7f112c152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:22.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c06f0c0 0x7f112c152a40 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f111c00d620 tx=0x7f111c00dae0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 -- 172.21.15.5:0/1843991412 shutdown_connections 2024-08-18T22:28:22.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f110c0678c0 0x7f110c069d80 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f112c15b010 0x7f112c09c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f112c0cd3a0 0x7f112c1521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 --2- 172.21.15.5:0/1843991412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f112c06f0c0 0x7f112c152a40 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 -- 172.21.15.5:0/1843991412 >> 172.21.15.5:0/1843991412 conn(0x7f112c0b1c50 msgr2=0x7f112c0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:22.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 -- 172.21.15.5:0/1843991412 shutdown_connections 2024-08-18T22:28:22.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.379+0000 7f1131c00640 1 -- 172.21.15.5:0/1843991412 wait complete. 2024-08-18T22:28:22.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:28:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f660b200640 1 Processor -- start 2024-08-18T22:28:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f660b200640 1 -- start start 2024-08-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f660b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660409aca0 0x7f66040afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f660b200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f660409b080 0x7f66040b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f660b200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f660406e8a0 con 0x7f66040b1300 2024-08-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f660b200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f660409bb80 con 0x7f660409b080 2024-08-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f660b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f66040d2e40 con 0x7f660409aca0 2024-08-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f6603400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f66040b1300 0x7f66040affd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41878/0 (socket says 172.21.15.5:41878) 2024-08-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f6603400640 1 -- 172.21.15.5:0/1185154454 learned_addr learned my addr 172.21.15.5:0/1185154454 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f6603e00640 1 --2- 172.21.15.5:0/1185154454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660409aca0 0x7f66040afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f6609200640 1 --2- 172.21.15.5:0/1185154454 >> v2:172.21.15.117:3300/0 conn(0x7f660409b080 0x7f66040b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f6602a00640 1 -- 172.21.15.5:0/1185154454 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3393716467 0 0) 0x7f660406e8a0 con 0x7f66040b1300 2024-08-18T22:28:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f6602a00640 1 -- 172.21.15.5:0/1185154454 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e8003530 con 0x7f66040b1300 2024-08-18T22:28:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f6603e00640 1 -- 172.21.15.5:0/1185154454 >> v2:172.21.15.117:3300/0 conn(0x7f660409b080 msgr2=0x7f66040b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f6603e00640 1 --2- 172.21.15.5:0/1185154454 >> v2:172.21.15.117:3300/0 conn(0x7f660409b080 0x7f66040b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f6603e00640 1 -- 172.21.15.5:0/1185154454 >> v1:172.21.15.5:6789/0 conn(0x7f66040b1300 legacy=0x7f66040affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.543+0000 7f6603e00640 1 -- 172.21.15.5:0/1185154454 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660406cbd0 con 0x7f660409aca0 2024-08-18T22:28:22.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f6603e00640 1 --2- 172.21.15.5:0/1185154454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660409aca0 0x7f66040afa90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65f40097f0 tx=0x7f65f401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d1b0e312230ab0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:22.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f6602a00640 1 -- 172.21.15.5:0/1185154454 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f40b0070 con 0x7f660409aca0 2024-08-18T22:28:22.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f6602a00640 1 -- 172.21.15.5:0/1185154454 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f4004230 con 0x7f660409aca0 2024-08-18T22:28:22.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f6602a00640 1 -- 172.21.15.5:0/1185154454 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4003620 con 0x7f660409aca0 2024-08-18T22:28:22.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f660b200640 1 -- 172.21.15.5:0/1185154454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660409aca0 msgr2=0x7f66040afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:22.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f660b200640 1 --2- 172.21.15.5:0/1185154454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660409aca0 0x7f66040afa90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65f40097f0 tx=0x7f65f401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f660b200640 1 -- 172.21.15.5:0/1185154454 shutdown_connections 2024-08-18T22:28:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f660b200640 1 --2- 172.21.15.5:0/1185154454 >> v2:172.21.15.117:3300/0 conn(0x7f660409b080 0x7f66040b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f660b200640 1 --2- 172.21.15.5:0/1185154454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660409aca0 0x7f66040afa90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f660b200640 1 -- 172.21.15.5:0/1185154454 >> 172.21.15.5:0/1185154454 conn(0x7f66040d2180 msgr2=0x7f66040d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f660b200640 1 -- 172.21.15.5:0/1185154454 shutdown_connections 2024-08-18T22:28:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.547+0000 7f660b200640 1 -- 172.21.15.5:0/1185154454 wait complete. 2024-08-18T22:28:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f660b200640 1 Processor -- start 2024-08-18T22:28:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f660b200640 1 -- start start 2024-08-18T22:28:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f660b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660409aca0 0x7f6604141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f660b200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660409b080 0x7f6604152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f660b200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66040b1300 0x7f6604152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f660b200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f660416b6b0 con 0x7f660409aca0 2024-08-18T22:28:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f660b200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f660416b530 con 0x7f66040b1300 2024-08-18T22:28:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f660b200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f660416b830 con 0x7f660409b080 2024-08-18T22:28:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f6603e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660409aca0 0x7f6604141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f6603e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660409aca0 0x7f6604141ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43044/0 (socket says 172.21.15.5:43044) 2024-08-18T22:28:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f6603e00640 1 -- 172.21.15.5:0/345854730 learned_addr learned my addr 172.21.15.5:0/345854730 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f6603e00640 1 -- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660409b080 msgr2=0x7f6604152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f6603e00640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660409b080 0x7f6604152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f6603e00640 1 -- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66040b1300 msgr2=0x7f6604152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f6603e00640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66040b1300 0x7f6604152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f6603e00640 1 -- 172.21.15.5:0/345854730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6604154360 con 0x7f660409aca0 2024-08-18T22:28:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f6603e00640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660409aca0 0x7f6604141ba0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f65f40ae040 tx=0x7f65f4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f65fbe00640 1 -- 172.21.15.5:0/345854730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f40b9070 con 0x7f660409aca0 2024-08-18T22:28:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f65fbe00640 1 -- 172.21.15.5:0/345854730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f4003cc0 con 0x7f660409aca0 2024-08-18T22:28:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f65fbe00640 1 -- 172.21.15.5:0/345854730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f40b0040 con 0x7f660409aca0 2024-08-18T22:28:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f660b200640 1 -- 172.21.15.5:0/345854730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6604154640 con 0x7f660409aca0 2024-08-18T22:28:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.551+0000 7f660b200640 1 -- 172.21.15.5:0/345854730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6604154c00 con 0x7f660409aca0 2024-08-18T22:28:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.555+0000 7f660b200640 1 -- 172.21.15.5:0/345854730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6604161940 con 0x7f660409aca0 2024-08-18T22:28:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.555+0000 7f65fbe00640 1 -- 172.21.15.5:0/345854730 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65f40bc070 con 0x7f660409aca0 2024-08-18T22:28:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.555+0000 7f65fbe00640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 0x7f65e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.555+0000 7f65fbe00640 1 -- 172.21.15.5:0/345854730 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f65f411fec0 con 0x7f660409aca0 2024-08-18T22:28:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.555+0000 7f6603400640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 0x7f65e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:22.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.555+0000 7f6603400640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 0x7f65e4069d80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f65f0007fd0 tx=0x7f65f0007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:22.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.559+0000 7f65fbe00640 1 -- 172.21.15.5:0/345854730 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f65f4016090 con 0x7f660409aca0 2024-08-18T22:28:22.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:22.763+0000 7f660b200640 1 -- 172.21.15.5:0/345854730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f66040702e0 con 0x7f660409aca0 2024-08-18T22:28:23.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:28:23.556 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:28:23.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.679+0000 7f65fbe00640 1 -- 172.21.15.5:0/345854730 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v107) ==== 118+0+0 (secure 0 0 0) 0x7f65f40f0860 con 0x7f660409aca0 2024-08-18T22:28:23.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 -- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 msgr2=0x7f65e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:23.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 0x7f65e4069d80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f65f0007fd0 tx=0x7f65f0007900 comp rx=0 tx=0).stop 2024-08-18T22:28:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 -- 172.21.15.5:0/345854730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660409aca0 msgr2=0x7f6604141ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660409aca0 0x7f6604141ba0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f65f40ae040 tx=0x7f65f4019240 comp rx=0 tx=0).stop 2024-08-18T22:28:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 -- 172.21.15.5:0/345854730 shutdown_connections 2024-08-18T22:28:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 0x7f65e4069d80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66040b1300 0x7f6604152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f660409b080 0x7f6604152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 --2- 172.21.15.5:0/345854730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660409aca0 0x7f6604141ba0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 -- 172.21.15.5:0/345854730 >> 172.21.15.5:0/345854730 conn(0x7f66040d2180 msgr2=0x7f66040d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 -- 172.21.15.5:0/345854730 shutdown_connections 2024-08-18T22:28:23.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.683+0000 7f660b200640 1 -- 172.21.15.5:0/345854730 wait complete. 2024-08-18T22:28:23.707 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:28:23.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:28:23.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87f5c00640 1 Processor -- start 2024-08-18T22:28:23.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87f5c00640 1 -- start start 2024-08-18T22:28:23.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87f5c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87f015b0c0 0x7f87f006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:23.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87f5c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87f00b40c0 0x7f87f00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:23.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87f5c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f00b31f0 con 0x7f87f0072a30 2024-08-18T22:28:23.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87f5c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f87f00b4a70 con 0x7f87f015b0c0 2024-08-18T22:28:23.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87f5c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f87f00b3d70 con 0x7f87f00b40c0 2024-08-18T22:28:23.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87ef400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f87f0072a30 0x7f87f0072e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34026/0 (socket says 172.21.15.5:34026) 2024-08-18T22:28:23.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87ef400640 1 -- 172.21.15.5:0/4009939344 learned_addr learned my addr 172.21.15.5:0/4009939344 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:23.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87eea00640 1 --2- 172.21.15.5:0/4009939344 >> v2:172.21.15.5:3300/0 conn(0x7f87f015b0c0 0x7f87f006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:23.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87e6000640 1 --2- 172.21.15.5:0/4009939344 >> v2:172.21.15.117:3300/0 conn(0x7f87f00b40c0 0x7f87f00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87eea00640 1 -- 172.21.15.5:0/4009939344 >> v2:172.21.15.117:3300/0 conn(0x7f87f00b40c0 msgr2=0x7f87f00b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87eea00640 1 --2- 172.21.15.5:0/4009939344 >> v2:172.21.15.117:3300/0 conn(0x7f87f00b40c0 0x7f87f00b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87eea00640 1 -- 172.21.15.5:0/4009939344 >> v1:172.21.15.5:6789/0 conn(0x7f87f0072a30 legacy=0x7f87f0072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87eea00640 1 -- 172.21.15.5:0/4009939344 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f00b34d0 con 0x7f87f015b0c0 2024-08-18T22:28:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.899+0000 7f87e6000640 1 --2- 172.21.15.5:0/4009939344 >> v2:172.21.15.117:3300/0 conn(0x7f87f00b40c0 0x7f87f00b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87eea00640 1 --2- 172.21.15.5:0/4009939344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87f015b0c0 0x7f87f006db80 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f87f0073f90 tx=0x7f87e001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890e5f5e78f744f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87ee000640 1 -- 172.21.15.5:0/4009939344 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e00b0070 con 0x7f87f015b0c0 2024-08-18T22:28:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87ee000640 1 -- 172.21.15.5:0/4009939344 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e00ab600 con 0x7f87f015b0c0 2024-08-18T22:28:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87ee000640 1 -- 172.21.15.5:0/4009939344 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e00ab9d0 con 0x7f87f015b0c0 2024-08-18T22:28:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87f5c00640 1 -- 172.21.15.5:0/4009939344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87f015b0c0 msgr2=0x7f87f006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87f5c00640 1 --2- 172.21.15.5:0/4009939344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87f015b0c0 0x7f87f006db80 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f87f0073f90 tx=0x7f87e001c330 comp rx=0 tx=0).stop 2024-08-18T22:28:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87f5c00640 1 -- 172.21.15.5:0/4009939344 shutdown_connections 2024-08-18T22:28:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87f5c00640 1 --2- 172.21.15.5:0/4009939344 >> v2:172.21.15.117:3300/0 conn(0x7f87f00b40c0 0x7f87f00b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87f5c00640 1 --2- 172.21.15.5:0/4009939344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87f015b0c0 0x7f87f006db80 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87f5c00640 1 -- 172.21.15.5:0/4009939344 >> 172.21.15.5:0/4009939344 conn(0x7f87f00b1dc0 msgr2=0x7f87f00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87f5c00640 1 -- 172.21.15.5:0/4009939344 shutdown_connections 2024-08-18T22:28:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87f5c00640 1 -- 172.21.15.5:0/4009939344 wait complete. 2024-08-18T22:28:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87f5c00640 1 Processor -- start 2024-08-18T22:28:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.903+0000 7f87f5c00640 1 -- start start 2024-08-18T22:28:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87f5c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87f0072a30 0x7f87f015a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87f5c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f00b40c0 0x7f87f0149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87f5c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87f015b0c0 0x7f87f0156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87f5c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f87f015b4a0 con 0x7f87f015b0c0 2024-08-18T22:28:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87f5c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f87f00739a0 con 0x7f87f00b40c0 2024-08-18T22:28:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87f5c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f87f015b620 con 0x7f87f0072a30 2024-08-18T22:28:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87f015b0c0 0x7f87f0156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87f015b0c0 0x7f87f0156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37288/0 (socket says 172.21.15.5:37288) 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87ef400640 1 -- 172.21.15.5:0/2063340101 learned_addr learned my addr 172.21.15.5:0/2063340101 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87eea00640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87f0072a30 0x7f87f015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87ef400640 1 -- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87f0072a30 msgr2=0x7f87f015a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87ef400640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87f0072a30 0x7f87f015a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87e6000640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f00b40c0 0x7f87f0149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87ef400640 1 -- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f00b40c0 msgr2=0x7f87f0149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87ef400640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f00b40c0 0x7f87f0149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87ef400640 1 -- 172.21.15.5:0/2063340101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f0149c20 con 0x7f87f015b0c0 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87eea00640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87f0072a30 0x7f87f015a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87e6000640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f00b40c0 0x7f87f0149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87ef400640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87f015b0c0 0x7f87f0156fe0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f87e800cbc0 tx=0x7f87e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87e7400640 1 -- 172.21.15.5:0/2063340101 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8017070 con 0x7f87f015b0c0 2024-08-18T22:28:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87e7400640 1 -- 172.21.15.5:0/2063340101 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e800ad40 con 0x7f87f015b0c0 2024-08-18T22:28:23.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87e7400640 1 -- 172.21.15.5:0/2063340101 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8012600 con 0x7f87f015b0c0 2024-08-18T22:28:23.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87f5c00640 1 -- 172.21.15.5:0/2063340101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f00b1120 con 0x7f87f015b0c0 2024-08-18T22:28:23.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87f5c00640 1 -- 172.21.15.5:0/2063340101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f0159050 con 0x7f87f015b0c0 2024-08-18T22:28:23.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.907+0000 7f87f5c00640 1 -- 172.21.15.5:0/2063340101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f006f700 con 0x7f87f015b0c0 2024-08-18T22:28:23.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.911+0000 7f87e7400640 1 -- 172.21.15.5:0/2063340101 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87e801a070 con 0x7f87f015b0c0 2024-08-18T22:28:23.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.911+0000 7f87e7400640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87cc0678c0 0x7f87cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:23.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.911+0000 7f87e7400640 1 -- 172.21.15.5:0/2063340101 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f87e8085b20 con 0x7f87f015b0c0 2024-08-18T22:28:23.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.911+0000 7f87eea00640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87cc0678c0 0x7f87cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:23.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.911+0000 7f87eea00640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87cc0678c0 0x7f87cc069d80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f87e00ad000 tx=0x7f87e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:23.915+0000 7f87e7400640 1 -- 172.21.15.5:0/2063340101 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f87e8055e70 con 0x7f87f015b0c0 2024-08-18T22:28:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.115+0000 7f87f5c00640 1 -- 172.21.15.5:0/2063340101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f87f00af420 con 0x7f87f015b0c0 2024-08-18T22:28:24.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.683+0000 7f87e7400640 1 -- 172.21.15.5:0/2063340101 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v108) ==== 122+0+0 (secure 0 0 0) 0x7f87e805a170 con 0x7f87f015b0c0 2024-08-18T22:28:24.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 -- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87cc0678c0 msgr2=0x7f87cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87cc0678c0 0x7f87cc069d80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f87e00ad000 tx=0x7f87e0008040 comp rx=0 tx=0).stop 2024-08-18T22:28:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 -- 172.21.15.5:0/2063340101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87f015b0c0 msgr2=0x7f87f0156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87f015b0c0 0x7f87f0156fe0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f87e800cbc0 tx=0x7f87e800a430 comp rx=0 tx=0).stop 2024-08-18T22:28:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 -- 172.21.15.5:0/2063340101 shutdown_connections 2024-08-18T22:28:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87cc0678c0 0x7f87cc069d80 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87f015b0c0 0x7f87f0156fe0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87f00b40c0 0x7f87f0149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 --2- 172.21.15.5:0/2063340101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87f0072a30 0x7f87f015a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 -- 172.21.15.5:0/2063340101 >> 172.21.15.5:0/2063340101 conn(0x7f87f00b1dc0 msgr2=0x7f87f014a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 -- 172.21.15.5:0/2063340101 shutdown_connections 2024-08-18T22:28:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.687+0000 7f87f5c00640 1 -- 172.21.15.5:0/2063340101 wait complete. 2024-08-18T22:28:24.713 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:28:24.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.855+0000 7f818e400640 1 Processor -- start 2024-08-18T22:28:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.855+0000 7f818e400640 1 -- start start 2024-08-18T22:28:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.855+0000 7f818e400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f818806f290 0x7f81880ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.855+0000 7f818e400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81880cd3a0 0x7f8188072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.855+0000 7f818e400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81880cd850 con 0x7f818815b010 2024-08-18T22:28:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.855+0000 7f818e400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f81880cfa30 con 0x7f81880cd3a0 2024-08-18T22:28:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.855+0000 7f818e400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f81880cee20 con 0x7f818806f290 2024-08-18T22:28:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.855+0000 7f8187e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81880cd3a0 0x7f8188072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.855+0000 7f8187e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81880cd3a0 0x7f8188072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37302/0 (socket says 172.21.15.5:37302) 2024-08-18T22:28:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.855+0000 7f8187e00640 1 -- 172.21.15.5:0/3699755121 learned_addr learned my addr 172.21.15.5:0/3699755121 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.859+0000 7f8186a00640 1 --2- 172.21.15.5:0/3699755121 >> v2:172.21.15.117:3300/0 conn(0x7f818806f290 0x7f81880ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.859+0000 7f8187e00640 1 -- 172.21.15.5:0/3699755121 >> v2:172.21.15.117:3300/0 conn(0x7f818806f290 msgr2=0x7f81880ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.859+0000 7f8187e00640 1 --2- 172.21.15.5:0/3699755121 >> v2:172.21.15.117:3300/0 conn(0x7f818806f290 0x7f81880ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.859+0000 7f8187e00640 1 -- 172.21.15.5:0/3699755121 >> v1:172.21.15.117:6789/0 conn(0x7f818815b010 legacy=0x7f818806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.859+0000 7f8187e00640 1 -- 172.21.15.5:0/3699755121 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81880cf100 con 0x7f81880cd3a0 2024-08-18T22:28:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.859+0000 7f8187e00640 1 --2- 172.21.15.5:0/3699755121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81880cd3a0 0x7f8188072620 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f81880ca580 tx=0x7f818001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7efcb5f60786c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.859+0000 7f8186000640 1 -- 172.21.15.5:0/3699755121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800a5880 con 0x7f81880cd3a0 2024-08-18T22:28:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.859+0000 7f8186000640 1 -- 172.21.15.5:0/3699755121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81800a5a20 con 0x7f81880cd3a0 2024-08-18T22:28:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.859+0000 7f8186000640 1 -- 172.21.15.5:0/3699755121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800a5df0 con 0x7f81880cd3a0 2024-08-18T22:28:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.859+0000 7f818e400640 1 -- 172.21.15.5:0/3699755121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81880cd3a0 msgr2=0x7f8188072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.859+0000 7f818e400640 1 --2- 172.21.15.5:0/3699755121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81880cd3a0 0x7f8188072620 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f81880ca580 tx=0x7f818001c9c0 comp rx=0 tx=0).stop 2024-08-18T22:28:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 -- 172.21.15.5:0/3699755121 shutdown_connections 2024-08-18T22:28:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 --2- 172.21.15.5:0/3699755121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81880cd3a0 0x7f8188072620 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 --2- 172.21.15.5:0/3699755121 >> v2:172.21.15.117:3300/0 conn(0x7f818806f290 0x7f81880ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 -- 172.21.15.5:0/3699755121 >> 172.21.15.5:0/3699755121 conn(0x7f81880b1c50 msgr2=0x7f81880b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:24.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 -- 172.21.15.5:0/3699755121 shutdown_connections 2024-08-18T22:28:24.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 -- 172.21.15.5:0/3699755121 wait complete. 2024-08-18T22:28:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 Processor -- start 2024-08-18T22:28:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 -- start start 2024-08-18T22:28:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f818806f290 0x7f8188151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81880cd3a0 0x7f8188154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f818815b010 0x7f81880b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f81880734f0 con 0x7f81880cd3a0 2024-08-18T22:28:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8188073370 con 0x7f818815b010 2024-08-18T22:28:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8188073670 con 0x7f818806f290 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8186a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81880cd3a0 0x7f8188154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8186a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81880cd3a0 0x7f8188154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37310/0 (socket says 172.21.15.5:37310) 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8186a00640 1 -- 172.21.15.5:0/2579313765 learned_addr learned my addr 172.21.15.5:0/2579313765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8187400640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f818806f290 0x7f8188151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8187e00640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f818815b010 0x7f81880b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8186a00640 1 -- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f818806f290 msgr2=0x7f8188151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8186a00640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f818806f290 0x7f8188151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8186a00640 1 -- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f818815b010 msgr2=0x7f81880b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8186a00640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f818815b010 0x7f81880b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8186a00640 1 -- 172.21.15.5:0/2579313765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818815ca50 con 0x7f81880cd3a0 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8187e00640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f818815b010 0x7f81880b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f8186a00640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81880cd3a0 0x7f8188154b80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f817400e930 tx=0x7f817400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f817f400640 1 -- 172.21.15.5:0/2579313765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8174017070 con 0x7f81880cd3a0 2024-08-18T22:28:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f817f400640 1 -- 172.21.15.5:0/2579313765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817400ca00 con 0x7f81880cd3a0 2024-08-18T22:28:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f817f400640 1 -- 172.21.15.5:0/2579313765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817400cdb0 con 0x7f81880cd3a0 2024-08-18T22:28:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 -- 172.21.15.5:0/2579313765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818815cd30 con 0x7f81880cd3a0 2024-08-18T22:28:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.863+0000 7f818e400640 1 -- 172.21.15.5:0/2579313765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f818815d2f0 con 0x7f81880cd3a0 2024-08-18T22:28:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.867+0000 7f818e400640 1 -- 172.21.15.5:0/2579313765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81880ce840 con 0x7f81880cd3a0 2024-08-18T22:28:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.867+0000 7f817f400640 1 -- 172.21.15.5:0/2579313765 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f817401a070 con 0x7f81880cd3a0 2024-08-18T22:28:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.867+0000 7f817f400640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81680678f0 0x7f8168069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.867+0000 7f817f400640 1 -- 172.21.15.5:0/2579313765 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f81740861a0 con 0x7f81880cd3a0 2024-08-18T22:28:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.867+0000 7f8187400640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81680678f0 0x7f8168069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.871+0000 7f8187400640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81680678f0 0x7f8168069db0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8178000f70 tx=0x7f8178009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:24.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:24.871+0000 7f817f400640 1 -- 172.21.15.5:0/2579313765 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8174056ca0 con 0x7f81880cd3a0 2024-08-18T22:28:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.071+0000 7f818e400640 1 -- 172.21.15.5:0/2579313765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8188158940 con 0x7f81880cd3a0 2024-08-18T22:28:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.071+0000 7f817f400640 1 -- 172.21.15.5:0/2579313765 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5231 (secure 0 0 0) 0x7f81740565a0 con 0x7f81880cd3a0 2024-08-18T22:28:25.073 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:25.073 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:28:21.056377+0000","modified":"2024-08-18T22:28:24.121089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1373218784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1373218784},{"type":"v1","addr":"172.21.15.5:6833","nonce":1373218784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8565,"qdb_cluster":[8565]},"id":9}]} 2024-08-18T22:28:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 108 2024-08-18T22:28:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 -- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81680678f0 msgr2=0x7f8168069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81680678f0 0x7f8168069db0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8178000f70 tx=0x7f8178009040 comp rx=0 tx=0).stop 2024-08-18T22:28:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 -- 172.21.15.5:0/2579313765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81880cd3a0 msgr2=0x7f8188154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81880cd3a0 0x7f8188154b80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f817400e930 tx=0x7f817400edf0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 -- 172.21.15.5:0/2579313765 shutdown_connections 2024-08-18T22:28:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f81680678f0 0x7f8168069db0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f818815b010 0x7f81880b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81880cd3a0 0x7f8188154b80 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 --2- 172.21.15.5:0/2579313765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f818806f290 0x7f8188151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 -- 172.21.15.5:0/2579313765 >> 172.21.15.5:0/2579313765 conn(0x7f81880b1c50 msgr2=0x7f818806e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 -- 172.21.15.5:0/2579313765 shutdown_connections 2024-08-18T22:28:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.075+0000 7f818e400640 1 -- 172.21.15.5:0/2579313765 wait complete. 2024-08-18T22:28:25.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:28:25.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.231+0000 7f9539600640 1 Processor -- start 2024-08-18T22:28:25.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9539600640 1 -- start start 2024-08-18T22:28:25.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9539600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9534161960 0x7f953406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9539600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534070730 0x7f9534070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9539600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f953415eb60 con 0x7f953415dda0 2024-08-18T22:28:25.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9539600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f953415fcc0 con 0x7f9534161960 2024-08-18T22:28:25.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9539600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f95340710b0 con 0x7f9534070730 2024-08-18T22:28:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9532a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9534161960 0x7f953406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9532000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534070730 0x7f9534070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9532000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534070730 0x7f9534070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:48100/0 (socket says 172.21.15.5:48100) 2024-08-18T22:28:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9532a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9534161960 0x7f953406fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:43846/0 (socket says 172.21.15.5:43846) 2024-08-18T22:28:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9532000640 1 -- 172.21.15.5:0/2595511500 learned_addr learned my addr 172.21.15.5:0/2595511500 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9533400640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f953415dda0 0x7f953415e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:39936/0 (socket says 172.21.15.5:39936) 2024-08-18T22:28:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9532000640 1 -- 172.21.15.5:0/2595511500 >> v2:172.21.15.117:3300/0 conn(0x7f9534161960 msgr2=0x7f953406fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:25.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9532000640 1 --2- 172.21.15.5:0/2595511500 >> v2:172.21.15.117:3300/0 conn(0x7f9534161960 0x7f953406fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9532000640 1 -- 172.21.15.5:0/2595511500 >> v1:172.21.15.117:6789/0 conn(0x7f953415dda0 legacy=0x7f953415e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.235+0000 7f9532000640 1 -- 172.21.15.5:0/2595511500 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953415ee40 con 0x7f9534070730 2024-08-18T22:28:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9532000640 1 --2- 172.21.15.5:0/2595511500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534070730 0x7f9534070b70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9520009870 tx=0x7f952001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1c7c7eaff10c4a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9531600640 1 -- 172.21.15.5:0/2595511500 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95200b2070 con 0x7f9534070730 2024-08-18T22:28:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9531600640 1 -- 172.21.15.5:0/2595511500 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95200a9070 con 0x7f9534070730 2024-08-18T22:28:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9531600640 1 -- 172.21.15.5:0/2595511500 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95200ad880 con 0x7f9534070730 2024-08-18T22:28:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9539600640 1 -- 172.21.15.5:0/2595511500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534070730 msgr2=0x7f9534070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9539600640 1 --2- 172.21.15.5:0/2595511500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534070730 0x7f9534070b70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9520009870 tx=0x7f952001c560 comp rx=0 tx=0).stop 2024-08-18T22:28:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9539600640 1 -- 172.21.15.5:0/2595511500 shutdown_connections 2024-08-18T22:28:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9539600640 1 --2- 172.21.15.5:0/2595511500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534070730 0x7f9534070b70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9539600640 1 --2- 172.21.15.5:0/2595511500 >> v2:172.21.15.117:3300/0 conn(0x7f9534161960 0x7f953406fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9539600640 1 -- 172.21.15.5:0/2595511500 >> 172.21.15.5:0/2595511500 conn(0x7f95340d2130 msgr2=0x7f95340d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9539600640 1 -- 172.21.15.5:0/2595511500 shutdown_connections 2024-08-18T22:28:25.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9539600640 1 -- 172.21.15.5:0/2595511500 wait complete. 2024-08-18T22:28:25.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9539600640 1 Processor -- start 2024-08-18T22:28:25.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.239+0000 7f9539600640 1 -- start start 2024-08-18T22:28:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9539600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9534070730 0x7f95340b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9539600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f953415dda0 0x7f953415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9539600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534161960 0x7f95340ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9539600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f953409ba30 con 0x7f9534070730 2024-08-18T22:28:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9539600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9534070260 con 0x7f953415dda0 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9539600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f95340b52f0 con 0x7f9534161960 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9532a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9534070730 0x7f95340b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9532a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9534070730 0x7f95340b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37312/0 (socket says 172.21.15.5:37312) 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9532a00640 1 -- 172.21.15.5:0/1947242482 learned_addr learned my addr 172.21.15.5:0/1947242482 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9533400640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534161960 0x7f95340ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9532000640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f953415dda0 0x7f953415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9532a00640 1 -- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534161960 msgr2=0x7f95340ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9532a00640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534161960 0x7f95340ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9532a00640 1 -- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f953415dda0 msgr2=0x7f953415a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9532a00640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f953415dda0 0x7f953415a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9532a00640 1 -- 172.21.15.5:0/1947242482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95340b55d0 con 0x7f9534070730 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9533400640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534161960 0x7f95340ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9532a00640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9534070730 0x7f95340b6390 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f952400e930 tx=0x7f952400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f952aa00640 1 -- 172.21.15.5:0/1947242482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524017070 con 0x7f9534070730 2024-08-18T22:28:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f952aa00640 1 -- 172.21.15.5:0/1947242482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952400ca00 con 0x7f9534070730 2024-08-18T22:28:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f952aa00640 1 -- 172.21.15.5:0/1947242482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952400cdb0 con 0x7f9534070730 2024-08-18T22:28:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9539600640 1 -- 172.21.15.5:0/1947242482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95340b58b0 con 0x7f9534070730 2024-08-18T22:28:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9539600640 1 -- 172.21.15.5:0/1947242482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95340b5e70 con 0x7f9534070730 2024-08-18T22:28:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f9539600640 1 -- 172.21.15.5:0/1947242482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9534070b70 con 0x7f9534070730 2024-08-18T22:28:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.243+0000 7f952aa00640 1 -- 172.21.15.5:0/1947242482 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f952401a070 con 0x7f9534070730 2024-08-18T22:28:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.247+0000 7f952aa00640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95140678c0 0x7f9514069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.247+0000 7f952aa00640 1 -- 172.21.15.5:0/1947242482 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f95240862d0 con 0x7f9534070730 2024-08-18T22:28:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.247+0000 7f9532000640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95140678c0 0x7f9514069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.247+0000 7f9532000640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95140678c0 0x7f9514069d80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f95200af000 tx=0x7f95200a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:25.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.251+0000 7f952aa00640 1 -- 172.21.15.5:0/1947242482 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9524056ca0 con 0x7f9534070730 2024-08-18T22:28:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.415+0000 7f9539600640 1 -- 172.21.15.5:0/1947242482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f953409bbb0 con 0x7f9534070730 2024-08-18T22:28:25.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.415+0000 7f952aa00640 1 -- 172.21.15.5:0/1947242482 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16828 (secure 0 0 0) 0x7f95240565a0 con 0x7f9534070730 2024-08-18T22:28:25.418 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:25.418 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":141,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:28:22.652816+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:28:18.813860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-08-18T22:28:20.061149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:28:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 -- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95140678c0 msgr2=0x7f9514069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95140678c0 0x7f9514069d80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f95200af000 tx=0x7f95200a7000 comp rx=0 tx=0).stop 2024-08-18T22:28:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 -- 172.21.15.5:0/1947242482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9534070730 msgr2=0x7f95340b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9534070730 0x7f95340b6390 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f952400e930 tx=0x7f952400edf0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 -- 172.21.15.5:0/1947242482 shutdown_connections 2024-08-18T22:28:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95140678c0 0x7f9514069d80 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9534161960 0x7f95340ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f953415dda0 0x7f953415a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 --2- 172.21.15.5:0/1947242482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9534070730 0x7f95340b6390 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 -- 172.21.15.5:0/1947242482 >> 172.21.15.5:0/1947242482 conn(0x7f95340d2130 msgr2=0x7f95340cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:25.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 -- 172.21.15.5:0/1947242482 shutdown_connections 2024-08-18T22:28:25.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.419+0000 7f9539600640 1 -- 172.21.15.5:0/1947242482 wait complete. 2024-08-18T22:28:25.439 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:28:25.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:28:25.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90cb200640 1 Processor -- start 2024-08-18T22:28:25.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90cb200640 1 -- start start 2024-08-18T22:28:25.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90cb200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc146f10 0x7f90cc06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90cb200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90cc071040 con 0x7f90cc0b59b0 2024-08-18T22:28:25.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90cb200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90cc162b90 con 0x7f90cc06b9b0 2024-08-18T22:28:25.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90cb200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f90cc0b4510 con 0x7f90cc146f10 2024-08-18T22:28:25.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90ca800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f90cc0b59b0 0x7f90cc162480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34038/0 (socket says 172.21.15.5:34038) 2024-08-18T22:28:25.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90ca800640 1 -- 172.21.15.5:0/1458385846 learned_addr learned my addr 172.21.15.5:0/1458385846 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c9e00640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc146f10 0x7f90cc06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321749119 0 0) 0x7f90cc071040 con 0x7f90cc0b59b0 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90b0003530 con 0x7f90cc0b59b0 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 988309824 0 0) 0x7f90b0003530 con 0x7f90cc0b59b0 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc146f10 msgr2=0x7f90cc06f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc146f10 0x7f90cc06f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 >> v1:172.21.15.117:6789/0 conn(0x7f90cc06b9b0 legacy=0x7f90cc161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc0707e0 con 0x7f90cc0b59b0 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f90c4001a00 con 0x7f90cc0b59b0 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 >> v1:172.21.15.5:6789/0 conn(0x7f90cc0b59b0 legacy=0x7f90cc162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90b00039f0 0x7f90b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc146f10 0x7f90b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90b0004d50 0x7f90b00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc0b4510 con 0x7f90b0004d50 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90b000ba80 con 0x7f90b00039f0 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f90b000bc80 con 0x7f90cc146f10 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c9e00640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90b00039f0 0x7f90b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90ca800640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90b0004d50 0x7f90b00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c9400640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc146f10 0x7f90b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90ca800640 1 -- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc146f10 msgr2=0x7f90b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90ca800640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc146f10 0x7f90b0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90ca800640 1 -- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90b00039f0 msgr2=0x7f90b0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90ca800640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90b00039f0 0x7f90b0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90ca800640 1 -- 172.21.15.5:0/1458385846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b0003530 con 0x7f90b0004d50 2024-08-18T22:28:25.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.579+0000 7f90c9e00640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90b00039f0 0x7f90b0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:25.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.583+0000 7f90ca800640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90b0004d50 0x7f90b00051d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f90c400a880 tx=0x7f90c401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66671da3ddfaed0b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:25.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.583+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c400a4a0 con 0x7f90b0004d50 2024-08-18T22:28:25.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.583+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c40ad650 con 0x7f90b0004d50 2024-08-18T22:28:25.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.583+0000 7f90c8a00640 1 -- 172.21.15.5:0/1458385846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c40ada40 con 0x7f90b0004d50 2024-08-18T22:28:25.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.583+0000 7f90cb200640 1 -- 172.21.15.5:0/1458385846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90b0004d50 msgr2=0x7f90b00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.583+0000 7f90cb200640 1 --2- 172.21.15.5:0/1458385846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90b0004d50 0x7f90b00051d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f90c400a880 tx=0x7f90c401d380 comp rx=0 tx=0).stop 2024-08-18T22:28:25.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.583+0000 7f90ca800640 1 -- 172.21.15.5:0/1458385846 reap_dead start 2024-08-18T22:28:25.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.583+0000 7f90cb200640 1 -- 172.21.15.5:0/1458385846 shutdown_connections 2024-08-18T22:28:25.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.583+0000 7f90cb200640 1 -- 172.21.15.5:0/1458385846 >> 172.21.15.5:0/1458385846 conn(0x7f90cc06e890 msgr2=0x7f90cc06eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:25.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.583+0000 7f90cb200640 1 -- 172.21.15.5:0/1458385846 shutdown_connections 2024-08-18T22:28:25.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.583+0000 7f90cb200640 1 -- 172.21.15.5:0/1458385846 wait complete. 2024-08-18T22:28:25.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90cb200640 1 Processor -- start 2024-08-18T22:28:25.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90cb200640 1 -- start start 2024-08-18T22:28:25.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90cb200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc160b60 0x7f90cc161770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90cb200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc161220 0x7f90cc13c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90cb200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc13c9f0 0x7f90cc1fafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90cb200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc06c340 con 0x7f90cc160b60 2024-08-18T22:28:25.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90cb200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc06c1c0 con 0x7f90cc161220 2024-08-18T22:28:25.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90cb200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f90cc147c40 con 0x7f90cc13c9f0 2024-08-18T22:28:25.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc160b60 0x7f90cc161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc160b60 0x7f90cc161770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37322/0 (socket says 172.21.15.5:37322) 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c9e00640 1 -- 172.21.15.5:0/3736294208 learned_addr learned my addr 172.21.15.5:0/3736294208 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c9400640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc161220 0x7f90cc13c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90ca800640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc13c9f0 0x7f90cc1fafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c9e00640 1 -- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc13c9f0 msgr2=0x7f90cc1fafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c9e00640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc13c9f0 0x7f90cc1fafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c9e00640 1 -- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc161220 msgr2=0x7f90cc13c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c9e00640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc161220 0x7f90cc13c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c9e00640 1 -- 172.21.15.5:0/3736294208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc0d0990 con 0x7f90cc160b60 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90ca800640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc13c9f0 0x7f90cc1fafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c9e00640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc160b60 0x7f90cc161770 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f90bc011cd0 tx=0x7f90bc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c2000640 1 -- 172.21.15.5:0/3736294208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc00fcc0 con 0x7f90cc160b60 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c2000640 1 -- 172.21.15.5:0/3736294208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc00fe60 con 0x7f90cc160b60 2024-08-18T22:28:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90cb200640 1 -- 172.21.15.5:0/3736294208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90cc13e220 con 0x7f90cc160b60 2024-08-18T22:28:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90c2000640 1 -- 172.21.15.5:0/3736294208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc004260 con 0x7f90cc160b60 2024-08-18T22:28:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.587+0000 7f90cb200640 1 -- 172.21.15.5:0/3736294208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90cc166fb0 con 0x7f90cc160b60 2024-08-18T22:28:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.591+0000 7f90cb200640 1 -- 172.21.15.5:0/3736294208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90cc068120 con 0x7f90cc160b60 2024-08-18T22:28:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.591+0000 7f90c2000640 1 -- 172.21.15.5:0/3736294208 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f90bc012040 con 0x7f90cc160b60 2024-08-18T22:28:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.591+0000 7f90c2000640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90ac0678c0 0x7f90ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.591+0000 7f90c2000640 1 -- 172.21.15.5:0/3736294208 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f90bc0863e0 con 0x7f90cc160b60 2024-08-18T22:28:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.591+0000 7f90c9400640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90ac0678c0 0x7f90ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.591+0000 7f90c9400640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90ac0678c0 0x7f90ac069d80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f90cc140b20 tx=0x7f90b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:25.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.595+0000 7f90c2000640 1 -- 172.21.15.5:0/3736294208 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f90bc019030 con 0x7f90cc160b60 2024-08-18T22:28:25.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.759+0000 7f90cb200640 1 -- 172.21.15.5:0/3736294208 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90cc06f7c0 con 0x7f90ac0678c0 2024-08-18T22:28:25.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.767+0000 7f90c2000640 1 -- 172.21.15.5:0/3736294208 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7f90cc06f7c0 con 0x7f90ac0678c0 2024-08-18T22:28:25.770 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:25.772 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:28:25.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 -- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90ac0678c0 msgr2=0x7f90ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90ac0678c0 0x7f90ac069d80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f90cc140b20 tx=0x7f90b8009040 comp rx=0 tx=0).stop 2024-08-18T22:28:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 -- 172.21.15.5:0/3736294208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc160b60 msgr2=0x7f90cc161770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc160b60 0x7f90cc161770 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f90bc011cd0 tx=0x7f90bc00f610 comp rx=0 tx=0).stop 2024-08-18T22:28:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 -- 172.21.15.5:0/3736294208 shutdown_connections 2024-08-18T22:28:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90ac0678c0 0x7f90ac069d80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90cc13c9f0 0x7f90cc1fafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc161220 0x7f90cc13c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 --2- 172.21.15.5:0/3736294208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc160b60 0x7f90cc161770 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 -- 172.21.15.5:0/3736294208 >> 172.21.15.5:0/3736294208 conn(0x7f90cc06e890 msgr2=0x7f90cc0ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 -- 172.21.15.5:0/3736294208 shutdown_connections 2024-08-18T22:28:25.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.771+0000 7f90cb200640 1 -- 172.21.15.5:0/3736294208 wait complete. 2024-08-18T22:28:25.789 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2024-08-18T22:28:25.754953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403200,"kb_used_data":14920,"kb_used_omap":12,"kb_used_meta":388147,"kb_avail":754571520,"statfs":{"total":773094113280,"available":772681236480,"internally_reserved":0,"allocated":15278080,"data_stored":7795348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":397463088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001559"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912755+0000","last_change":"2024-08-18T22:28:21.679393+0000","last_active":"2024-08-18T22:28:22.912755+0000","last_peered":"2024-08-18T22:28:22.912755+0000","last_clean":"2024-08-18T22:28:22.912755+0000","last_became_active":"2024-08-18T22:28:21.679127+0000","last_became_peered":"2024-08-18T22:28:21.679127+0000","last_unstale":"2024-08-18T22:28:22.912755+0000","last_undegraded":"2024-08-18T22:28:22.912755+0000","last_fullsized":"2024-08-18T22:28:22.912755+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:52.119965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909211+0000","last_change":"2024-08-18T22:28:21.677074+0000","last_active":"2024-08-18T22:28:22.909211+0000","last_peered":"2024-08-18T22:28:22.909211+0000","last_clean":"2024-08-18T22:28:22.909211+0000","last_became_active":"2024-08-18T22:28:21.676805+0000","last_became_peered":"2024-08-18T22:28:21.676805+0000","last_unstale":"2024-08-18T22:28:22.909211+0000","last_undegraded":"2024-08-18T22:28:22.909211+0000","last_fullsized":"2024-08-18T22:28:22.909211+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:53:56.804355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658596+0000","last_change":"2024-08-18T22:28:21.678184+0000","last_active":"2024-08-18T22:28:22.658596+0000","last_peered":"2024-08-18T22:28:22.658596+0000","last_clean":"2024-08-18T22:28:22.658596+0000","last_became_active":"2024-08-18T22:28:21.677900+0000","last_became_peered":"2024-08-18T22:28:21.677900+0000","last_unstale":"2024-08-18T22:28:22.658596+0000","last_undegraded":"2024-08-18T22:28:22.658596+0000","last_fullsized":"2024-08-18T22:28:22.658596+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:10:04.144329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909069+0000","last_change":"2024-08-18T22:28:21.676911+0000","last_active":"2024-08-18T22:28:22.909069+0000","last_peered":"2024-08-18T22:28:22.909069+0000","last_clean":"2024-08-18T22:28:22.909069+0000","last_became_active":"2024-08-18T22:28:21.676621+0000","last_became_peered":"2024-08-18T22:28:21.676621+0000","last_unstale":"2024-08-18T22:28:22.909069+0000","last_undegraded":"2024-08-18T22:28:22.909069+0000","last_fullsized":"2024-08-18T22:28:22.909069+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:54.689047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911898+0000","last_change":"2024-08-18T22:28:21.683129+0000","last_active":"2024-08-18T22:28:22.911898+0000","last_peered":"2024-08-18T22:28:22.911898+0000","last_clean":"2024-08-18T22:28:22.911898+0000","last_became_active":"2024-08-18T22:28:21.682851+0000","last_became_peered":"2024-08-18T22:28:21.682851+0000","last_unstale":"2024-08-18T22:28:22.911898+0000","last_undegraded":"2024-08-18T22:28:22.911898+0000","last_fullsized":"2024-08-18T22:28:22.911898+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:28:15.881360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911153+0000","last_change":"2024-08-18T22:28:21.674462+0000","last_active":"2024-08-18T22:28:22.911153+0000","last_peered":"2024-08-18T22:28:22.911153+0000","last_clean":"2024-08-18T22:28:22.911153+0000","last_became_active":"2024-08-18T22:28:21.670920+0000","last_became_peered":"2024-08-18T22:28:21.670920+0000","last_unstale":"2024-08-18T22:28:22.911153+0000","last_undegraded":"2024-08-18T22:28:22.911153+0000","last_fullsized":"2024-08-18T22:28:22.911153+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:23.332196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660694+0000","last_change":"2024-08-18T22:28:21.666086+0000","last_active":"2024-08-18T22:28:22.660694+0000","last_peered":"2024-08-18T22:28:22.660694+0000","last_clean":"2024-08-18T22:28:22.660694+0000","last_became_active":"2024-08-18T22:28:21.665682+0000","last_became_peered":"2024-08-18T22:28:21.665682+0000","last_unstale":"2024-08-18T22:28:22.660694+0000","last_undegraded":"2024-08-18T22:28:22.660694+0000","last_fullsized":"2024-08-18T22:28:22.660694+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:48.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659294+0000","last_change":"2024-08-18T22:28:21.672784+0000","last_active":"2024-08-18T22:28:22.659294+0000","last_peered":"2024-08-18T22:28:22.659294+0000","last_clean":"2024-08-18T22:28:22.659294+0000","last_became_active":"2024-08-18T22:28:21.672502+0000","last_became_peered":"2024-08-18T22:28:21.672502+0000","last_unstale":"2024-08-18T22:28:22.659294+0000","last_undegraded":"2024-08-18T22:28:22.659294+0000","last_fullsized":"2024-08-18T22:28:22.659294+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:11:04.122261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911849+0000","last_change":"2024-08-18T22:28:21.676294+0000","last_active":"2024-08-18T22:28:22.911849+0000","last_peered":"2024-08-18T22:28:22.911849+0000","last_clean":"2024-08-18T22:28:22.911849+0000","last_became_active":"2024-08-18T22:28:21.675930+0000","last_became_peered":"2024-08-18T22:28:21.675930+0000","last_unstale":"2024-08-18T22:28:22.911849+0000","last_undegraded":"2024-08-18T22:28:22.911849+0000","last_fullsized":"2024-08-18T22:28:22.911849+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:15:45.811166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911553+0000","last_change":"2024-08-18T22:28:21.674151+0000","last_active":"2024-08-18T22:28:22.911553+0000","last_peered":"2024-08-18T22:28:22.911553+0000","last_clean":"2024-08-18T22:28:22.911553+0000","last_became_active":"2024-08-18T22:28:21.673849+0000","last_became_peered":"2024-08-18T22:28:21.673849+0000","last_unstale":"2024-08-18T22:28:22.911553+0000","last_undegraded":"2024-08-18T22:28:22.911553+0000","last_fullsized":"2024-08-18T22:28:22.911553+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:43:03.881966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909004+0000","last_change":"2024-08-18T22:28:21.678958+0000","last_active":"2024-08-18T22:28:22.909004+0000","last_peered":"2024-08-18T22:28:22.909004+0000","last_clean":"2024-08-18T22:28:22.909004+0000","last_became_active":"2024-08-18T22:28:21.678684+0000","last_became_peered":"2024-08-18T22:28:21.678684+0000","last_unstale":"2024-08-18T22:28:22.909004+0000","last_undegraded":"2024-08-18T22:28:22.909004+0000","last_fullsized":"2024-08-18T22:28:22.909004+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:06.360700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912313+0000","last_change":"2024-08-18T22:28:21.680302+0000","last_active":"2024-08-18T22:28:22.912313+0000","last_peered":"2024-08-18T22:28:22.912313+0000","last_clean":"2024-08-18T22:28:22.912313+0000","last_became_active":"2024-08-18T22:28:21.679907+0000","last_became_peered":"2024-08-18T22:28:21.679907+0000","last_unstale":"2024-08-18T22:28:22.912313+0000","last_undegraded":"2024-08-18T22:28:22.912313+0000","last_fullsized":"2024-08-18T22:28:22.912313+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:46:26.225894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911508+0000","last_change":"2024-08-18T22:28:21.666997+0000","last_active":"2024-08-18T22:28:22.911508+0000","last_peered":"2024-08-18T22:28:22.911508+0000","last_clean":"2024-08-18T22:28:22.911508+0000","last_became_active":"2024-08-18T22:28:21.666731+0000","last_became_peered":"2024-08-18T22:28:21.666731+0000","last_unstale":"2024-08-18T22:28:22.911508+0000","last_undegraded":"2024-08-18T22:28:22.911508+0000","last_fullsized":"2024-08-18T22:28:22.911508+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:44.306645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911791+0000","last_change":"2024-08-18T22:28:21.676464+0000","last_active":"2024-08-18T22:28:22.911791+0000","last_peered":"2024-08-18T22:28:22.911791+0000","last_clean":"2024-08-18T22:28:22.911791+0000","last_became_active":"2024-08-18T22:28:21.675213+0000","last_became_peered":"2024-08-18T22:28:21.675213+0000","last_unstale":"2024-08-18T22:28:22.911791+0000","last_undegraded":"2024-08-18T22:28:22.911791+0000","last_fullsized":"2024-08-18T22:28:22.911791+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:46:03.404356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910461+0000","last_change":"2024-08-18T22:28:21.672737+0000","last_active":"2024-08-18T22:28:22.910461+0000","last_peered":"2024-08-18T22:28:22.910461+0000","last_clean":"2024-08-18T22:28:22.910461+0000","last_became_active":"2024-08-18T22:28:21.672435+0000","last_became_peered":"2024-08-18T22:28:21.672435+0000","last_unstale":"2024-08-18T22:28:22.910461+0000","last_undegraded":"2024-08-18T22:28:22.910461+0000","last_fullsized":"2024-08-18T22:28:22.910461+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:18.250786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910681+0000","last_change":"2024-08-18T22:28:21.680499+0000","last_active":"2024-08-18T22:28:22.910681+0000","last_peered":"2024-08-18T22:28:22.910681+0000","last_clean":"2024-08-18T22:28:22.910681+0000","last_became_active":"2024-08-18T22:28:21.680150+0000","last_became_peered":"2024-08-18T22:28:21.680150+0000","last_unstale":"2024-08-18T22:28:22.910681+0000","last_undegraded":"2024-08-18T22:28:22.910681+0000","last_fullsized":"2024-08-18T22:28:22.910681+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:11:45.810091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911822+0000","last_change":"2024-08-18T22:28:21.679510+0000","last_active":"2024-08-18T22:28:22.911822+0000","last_peered":"2024-08-18T22:28:22.911822+0000","last_clean":"2024-08-18T22:28:22.911822+0000","last_became_active":"2024-08-18T22:28:21.679254+0000","last_became_peered":"2024-08-18T22:28:21.679254+0000","last_unstale":"2024-08-18T22:28:22.911822+0000","last_undegraded":"2024-08-18T22:28:22.911822+0000","last_fullsized":"2024-08-18T22:28:22.911822+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:46.693220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912360+0000","last_change":"2024-08-18T22:28:21.685162+0000","last_active":"2024-08-18T22:28:22.912360+0000","last_peered":"2024-08-18T22:28:22.912360+0000","last_clean":"2024-08-18T22:28:22.912360+0000","last_became_active":"2024-08-18T22:28:21.683648+0000","last_became_peered":"2024-08-18T22:28:21.683648+0000","last_unstale":"2024-08-18T22:28:22.912360+0000","last_undegraded":"2024-08-18T22:28:22.912360+0000","last_fullsized":"2024-08-18T22:28:22.912360+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:30.124597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660959+0000","last_change":"2024-08-18T22:28:21.662287+0000","last_active":"2024-08-18T22:28:22.660959+0000","last_peered":"2024-08-18T22:28:22.660959+0000","last_clean":"2024-08-18T22:28:22.660959+0000","last_became_active":"2024-08-18T22:28:21.661996+0000","last_became_peered":"2024-08-18T22:28:21.661996+0000","last_unstale":"2024-08-18T22:28:22.660959+0000","last_undegraded":"2024-08-18T22:28:22.660959+0000","last_fullsized":"2024-08-18T22:28:22.660959+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:08.819020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912479+0000","last_change":"2024-08-18T22:28:21.681932+0000","last_active":"2024-08-18T22:28:22.912479+0000","last_peered":"2024-08-18T22:28:22.912479+0000","last_clean":"2024-08-18T22:28:22.912479+0000","last_became_active":"2024-08-18T22:28:21.681573+0000","last_became_peered":"2024-08-18T22:28:21.681573+0000","last_unstale":"2024-08-18T22:28:22.912479+0000","last_undegraded":"2024-08-18T22:28:22.912479+0000","last_fullsized":"2024-08-18T22:28:22.912479+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:08:39.644006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.908896+0000","last_change":"2024-08-18T22:28:21.675572+0000","last_active":"2024-08-18T22:28:22.908896+0000","last_peered":"2024-08-18T22:28:22.908896+0000","last_clean":"2024-08-18T22:28:22.908896+0000","last_became_active":"2024-08-18T22:28:21.675318+0000","last_became_peered":"2024-08-18T22:28:21.675318+0000","last_unstale":"2024-08-18T22:28:22.908896+0000","last_undegraded":"2024-08-18T22:28:22.908896+0000","last_fullsized":"2024-08-18T22:28:22.908896+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:35.890418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911646+0000","last_change":"2024-08-18T22:28:21.677069+0000","last_active":"2024-08-18T22:28:22.911646+0000","last_peered":"2024-08-18T22:28:22.911646+0000","last_clean":"2024-08-18T22:28:22.911646+0000","last_became_active":"2024-08-18T22:28:21.676805+0000","last_became_peered":"2024-08-18T22:28:21.676805+0000","last_unstale":"2024-08-18T22:28:22.911646+0000","last_undegraded":"2024-08-18T22:28:22.911646+0000","last_fullsized":"2024-08-18T22:28:22.911646+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:06:50.190932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.908939+0000","last_change":"2024-08-18T22:28:21.672904+0000","last_active":"2024-08-18T22:28:22.908939+0000","last_peered":"2024-08-18T22:28:22.908939+0000","last_clean":"2024-08-18T22:28:22.908939+0000","last_became_active":"2024-08-18T22:28:21.672625+0000","last_became_peered":"2024-08-18T22:28:21.672625+0000","last_unstale":"2024-08-18T22:28:22.908939+0000","last_undegraded":"2024-08-18T22:28:22.908939+0000","last_fullsized":"2024-08-18T22:28:22.908939+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:05.124874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910528+0000","last_change":"2024-08-18T22:28:21.675227+0000","last_active":"2024-08-18T22:28:22.910528+0000","last_peered":"2024-08-18T22:28:22.910528+0000","last_clean":"2024-08-18T22:28:22.910528+0000","last_became_active":"2024-08-18T22:28:21.674948+0000","last_became_peered":"2024-08-18T22:28:21.674948+0000","last_unstale":"2024-08-18T22:28:22.910528+0000","last_undegraded":"2024-08-18T22:28:22.910528+0000","last_fullsized":"2024-08-18T22:28:22.910528+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:14.808483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659023+0000","last_change":"2024-08-18T22:28:21.672343+0000","last_active":"2024-08-18T22:28:22.659023+0000","last_peered":"2024-08-18T22:28:22.659023+0000","last_clean":"2024-08-18T22:28:22.659023+0000","last_became_active":"2024-08-18T22:28:21.672003+0000","last_became_peered":"2024-08-18T22:28:21.672003+0000","last_unstale":"2024-08-18T22:28:22.659023+0000","last_undegraded":"2024-08-18T22:28:22.659023+0000","last_fullsized":"2024-08-18T22:28:22.659023+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:06.360700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658619+0000","last_change":"2024-08-18T22:28:21.669174+0000","last_active":"2024-08-18T22:28:22.658619+0000","last_peered":"2024-08-18T22:28:22.658619+0000","last_clean":"2024-08-18T22:28:22.658619+0000","last_became_active":"2024-08-18T22:28:21.668867+0000","last_became_peered":"2024-08-18T22:28:21.668867+0000","last_unstale":"2024-08-18T22:28:22.658619+0000","last_undegraded":"2024-08-18T22:28:22.658619+0000","last_fullsized":"2024-08-18T22:28:22.658619+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:05.124874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661119+0000","last_change":"2024-08-18T22:28:21.672019+0000","last_active":"2024-08-18T22:28:22.661119+0000","last_peered":"2024-08-18T22:28:22.661119+0000","last_clean":"2024-08-18T22:28:22.661119+0000","last_became_active":"2024-08-18T22:28:21.671657+0000","last_became_peered":"2024-08-18T22:28:21.671657+0000","last_unstale":"2024-08-18T22:28:22.661119+0000","last_undegraded":"2024-08-18T22:28:22.661119+0000","last_fullsized":"2024-08-18T22:28:22.661119+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:21.716821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911353+0000","last_change":"2024-08-18T22:28:21.683258+0000","last_active":"2024-08-18T22:28:22.911353+0000","last_peered":"2024-08-18T22:28:22.911353+0000","last_clean":"2024-08-18T22:28:22.911353+0000","last_became_active":"2024-08-18T22:28:21.682973+0000","last_became_peered":"2024-08-18T22:28:21.682973+0000","last_unstale":"2024-08-18T22:28:22.911353+0000","last_undegraded":"2024-08-18T22:28:22.911353+0000","last_fullsized":"2024-08-18T22:28:22.911353+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:39:23.496740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658453+0000","last_change":"2024-08-18T22:28:21.676248+0000","last_active":"2024-08-18T22:28:22.658453+0000","last_peered":"2024-08-18T22:28:22.658453+0000","last_clean":"2024-08-18T22:28:22.658453+0000","last_became_active":"2024-08-18T22:28:21.675993+0000","last_became_peered":"2024-08-18T22:28:21.675993+0000","last_unstale":"2024-08-18T22:28:22.658453+0000","last_undegraded":"2024-08-18T22:28:22.658453+0000","last_fullsized":"2024-08-18T22:28:22.658453+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:15:45.811166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.657962+0000","last_change":"2024-08-18T22:28:21.673023+0000","last_active":"2024-08-18T22:28:22.657962+0000","last_peered":"2024-08-18T22:28:22.657962+0000","last_clean":"2024-08-18T22:28:22.657962+0000","last_became_active":"2024-08-18T22:28:21.672547+0000","last_became_peered":"2024-08-18T22:28:21.672547+0000","last_unstale":"2024-08-18T22:28:22.657962+0000","last_undegraded":"2024-08-18T22:28:22.657962+0000","last_fullsized":"2024-08-18T22:28:22.657962+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:30.163352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659357+0000","last_change":"2024-08-18T22:28:21.680886+0000","last_active":"2024-08-18T22:28:22.659357+0000","last_peered":"2024-08-18T22:28:22.659357+0000","last_clean":"2024-08-18T22:28:22.659357+0000","last_became_active":"2024-08-18T22:28:21.678617+0000","last_became_peered":"2024-08-18T22:28:21.678617+0000","last_unstale":"2024-08-18T22:28:22.659357+0000","last_undegraded":"2024-08-18T22:28:22.659357+0000","last_fullsized":"2024-08-18T22:28:22.659357+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:36:04.733503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910421+0000","last_change":"2024-08-18T22:28:21.674817+0000","last_active":"2024-08-18T22:28:22.910421+0000","last_peered":"2024-08-18T22:28:22.910421+0000","last_clean":"2024-08-18T22:28:22.910421+0000","last_became_active":"2024-08-18T22:28:21.674405+0000","last_became_peered":"2024-08-18T22:28:21.674405+0000","last_unstale":"2024-08-18T22:28:22.910421+0000","last_undegraded":"2024-08-18T22:28:22.910421+0000","last_fullsized":"2024-08-18T22:28:22.910421+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:01.148521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659300+0000","last_change":"2024-08-18T22:28:21.661451+0000","last_active":"2024-08-18T22:28:22.659300+0000","last_peered":"2024-08-18T22:28:22.659300+0000","last_clean":"2024-08-18T22:28:22.659300+0000","last_became_active":"2024-08-18T22:28:21.661187+0000","last_became_peered":"2024-08-18T22:28:21.661187+0000","last_unstale":"2024-08-18T22:28:22.659300+0000","last_undegraded":"2024-08-18T22:28:22.659300+0000","last_fullsized":"2024-08-18T22:28:22.659300+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:36.851708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"140'4","reported_seq":18,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658971+0000","last_change":"2024-08-18T22:28:20.669219+0000","last_active":"2024-08-18T22:28:22.658971+0000","last_peered":"2024-08-18T22:28:22.658971+0000","last_clean":"2024-08-18T22:28:22.658971+0000","last_became_active":"2024-08-18T22:28:20.668933+0000","last_became_peered":"2024-08-18T22:28:20.668933+0000","last_unstale":"2024-08-18T22:28:22.658971+0000","last_undegraded":"2024-08-18T22:28:22.658971+0000","last_fullsized":"2024-08-18T22:28:22.658971+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:30:27.532269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910683+0000","last_change":"2024-08-18T22:28:21.676474+0000","last_active":"2024-08-18T22:28:22.910683+0000","last_peered":"2024-08-18T22:28:22.910683+0000","last_clean":"2024-08-18T22:28:22.910683+0000","last_became_active":"2024-08-18T22:28:21.675911+0000","last_became_peered":"2024-08-18T22:28:21.675911+0000","last_unstale":"2024-08-18T22:28:22.910683+0000","last_undegraded":"2024-08-18T22:28:22.910683+0000","last_fullsized":"2024-08-18T22:28:22.910683+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:17:52.948750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"140'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912487+0000","last_change":"2024-08-18T22:28:20.667654+0000","last_active":"2024-08-18T22:28:22.912487+0000","last_peered":"2024-08-18T22:28:22.912487+0000","last_clean":"2024-08-18T22:28:22.912487+0000","last_became_active":"2024-08-18T22:28:20.665818+0000","last_became_peered":"2024-08-18T22:28:20.665818+0000","last_unstale":"2024-08-18T22:28:22.912487+0000","last_undegraded":"2024-08-18T22:28:22.912487+0000","last_fullsized":"2024-08-18T22:28:22.912487+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:52:08.921825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.908936+0000","last_change":"2024-08-18T22:28:21.679601+0000","last_active":"2024-08-18T22:28:22.908936+0000","last_peered":"2024-08-18T22:28:22.908936+0000","last_clean":"2024-08-18T22:28:22.908936+0000","last_became_active":"2024-08-18T22:28:21.679346+0000","last_became_peered":"2024-08-18T22:28:21.679346+0000","last_unstale":"2024-08-18T22:28:22.908936+0000","last_undegraded":"2024-08-18T22:28:22.908936+0000","last_fullsized":"2024-08-18T22:28:22.908936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:30.751448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661264+0000","last_change":"2024-08-18T22:28:20.676900+0000","last_active":"2024-08-18T22:28:22.661264+0000","last_peered":"2024-08-18T22:28:22.661264+0000","last_clean":"2024-08-18T22:28:22.661264+0000","last_became_active":"2024-08-18T22:28:20.676597+0000","last_became_peered":"2024-08-18T22:28:20.676597+0000","last_unstale":"2024-08-18T22:28:22.661264+0000","last_undegraded":"2024-08-18T22:28:22.661264+0000","last_fullsized":"2024-08-18T22:28:22.661264+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:04.121548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911738+0000","last_change":"2024-08-18T22:28:21.672173+0000","last_active":"2024-08-18T22:28:22.911738+0000","last_peered":"2024-08-18T22:28:22.911738+0000","last_clean":"2024-08-18T22:28:22.911738+0000","last_became_active":"2024-08-18T22:28:21.671902+0000","last_became_peered":"2024-08-18T22:28:21.671902+0000","last_unstale":"2024-08-18T22:28:22.911738+0000","last_undegraded":"2024-08-18T22:28:22.911738+0000","last_fullsized":"2024-08-18T22:28:22.911738+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:05:48.378052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660893+0000","last_change":"2024-08-18T22:28:20.674692+0000","last_active":"2024-08-18T22:28:22.660893+0000","last_peered":"2024-08-18T22:28:22.660893+0000","last_clean":"2024-08-18T22:28:22.660893+0000","last_became_active":"2024-08-18T22:28:20.673945+0000","last_became_peered":"2024-08-18T22:28:20.673945+0000","last_unstale":"2024-08-18T22:28:22.660893+0000","last_undegraded":"2024-08-18T22:28:22.660893+0000","last_fullsized":"2024-08-18T22:28:22.660893+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:34.887092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659666+0000","last_change":"2024-08-18T22:28:21.673646+0000","last_active":"2024-08-18T22:28:22.659666+0000","last_peered":"2024-08-18T22:28:22.659666+0000","last_clean":"2024-08-18T22:28:22.659666+0000","last_became_active":"2024-08-18T22:28:21.673350+0000","last_became_peered":"2024-08-18T22:28:21.673350+0000","last_unstale":"2024-08-18T22:28:22.659666+0000","last_undegraded":"2024-08-18T22:28:22.659666+0000","last_fullsized":"2024-08-18T22:28:22.659666+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:56:37.989141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"140'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659505+0000","last_change":"2024-08-18T22:28:20.674123+0000","last_active":"2024-08-18T22:28:22.659505+0000","last_peered":"2024-08-18T22:28:22.659505+0000","last_clean":"2024-08-18T22:28:22.659505+0000","last_became_active":"2024-08-18T22:28:20.673860+0000","last_became_peered":"2024-08-18T22:28:20.673860+0000","last_unstale":"2024-08-18T22:28:22.659505+0000","last_undegraded":"2024-08-18T22:28:22.659505+0000","last_fullsized":"2024-08-18T22:28:22.659505+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:19:51.372303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659661+0000","last_change":"2024-08-18T22:28:21.672716+0000","last_active":"2024-08-18T22:28:22.659661+0000","last_peered":"2024-08-18T22:28:22.659661+0000","last_clean":"2024-08-18T22:28:22.659661+0000","last_became_active":"2024-08-18T22:28:21.672430+0000","last_became_peered":"2024-08-18T22:28:21.672430+0000","last_unstale":"2024-08-18T22:28:22.659661+0000","last_undegraded":"2024-08-18T22:28:22.659661+0000","last_fullsized":"2024-08-18T22:28:22.659661+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:38.916892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"140'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911683+0000","last_change":"2024-08-18T22:28:20.665729+0000","last_active":"2024-08-18T22:28:22.911683+0000","last_peered":"2024-08-18T22:28:22.911683+0000","last_clean":"2024-08-18T22:28:22.911683+0000","last_became_active":"2024-08-18T22:28:20.665430+0000","last_became_peered":"2024-08-18T22:28:20.665430+0000","last_unstale":"2024-08-18T22:28:22.911683+0000","last_undegraded":"2024-08-18T22:28:22.911683+0000","last_fullsized":"2024-08-18T22:28:22.911683+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:53.248819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912383+0000","last_change":"2024-08-18T22:28:21.687604+0000","last_active":"2024-08-18T22:28:22.912383+0000","last_peered":"2024-08-18T22:28:22.912383+0000","last_clean":"2024-08-18T22:28:22.912383+0000","last_became_active":"2024-08-18T22:28:21.687297+0000","last_became_peered":"2024-08-18T22:28:21.687297+0000","last_unstale":"2024-08-18T22:28:22.912383+0000","last_undegraded":"2024-08-18T22:28:22.912383+0000","last_fullsized":"2024-08-18T22:28:22.912383+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:35:47.878022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910986+0000","last_change":"2024-08-18T22:28:20.667271+0000","last_active":"2024-08-18T22:28:22.910986+0000","last_peered":"2024-08-18T22:28:22.910986+0000","last_clean":"2024-08-18T22:28:22.910986+0000","last_became_active":"2024-08-18T22:28:20.666128+0000","last_became_peered":"2024-08-18T22:28:20.666128+0000","last_unstale":"2024-08-18T22:28:22.910986+0000","last_undegraded":"2024-08-18T22:28:22.910986+0000","last_fullsized":"2024-08-18T22:28:22.910986+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:22:09.204790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661486+0000","last_change":"2024-08-18T22:28:21.681742+0000","last_active":"2024-08-18T22:28:22.661486+0000","last_peered":"2024-08-18T22:28:22.661486+0000","last_clean":"2024-08-18T22:28:22.661486+0000","last_became_active":"2024-08-18T22:28:21.681464+0000","last_became_peered":"2024-08-18T22:28:21.681464+0000","last_unstale":"2024-08-18T22:28:22.661486+0000","last_undegraded":"2024-08-18T22:28:22.661486+0000","last_fullsized":"2024-08-18T22:28:22.661486+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:52:38.794051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658179+0000","last_change":"2024-08-18T22:28:20.666649+0000","last_active":"2024-08-18T22:28:22.658179+0000","last_peered":"2024-08-18T22:28:22.658179+0000","last_clean":"2024-08-18T22:28:22.658179+0000","last_became_active":"2024-08-18T22:28:20.665088+0000","last_became_peered":"2024-08-18T22:28:20.665088+0000","last_unstale":"2024-08-18T22:28:22.658179+0000","last_undegraded":"2024-08-18T22:28:22.658179+0000","last_fullsized":"2024-08-18T22:28:22.658179+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:35:28.584323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910396+0000","last_change":"2024-08-18T22:28:21.669386+0000","last_active":"2024-08-18T22:28:22.910396+0000","last_peered":"2024-08-18T22:28:22.910396+0000","last_clean":"2024-08-18T22:28:22.910396+0000","last_became_active":"2024-08-18T22:28:21.669090+0000","last_became_peered":"2024-08-18T22:28:21.669090+0000","last_unstale":"2024-08-18T22:28:22.910396+0000","last_undegraded":"2024-08-18T22:28:22.910396+0000","last_fullsized":"2024-08-18T22:28:22.910396+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:40.634418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909271+0000","last_change":"2024-08-18T22:28:20.665188+0000","last_active":"2024-08-18T22:28:22.909271+0000","last_peered":"2024-08-18T22:28:22.909271+0000","last_clean":"2024-08-18T22:28:22.909271+0000","last_became_active":"2024-08-18T22:28:20.664926+0000","last_became_peered":"2024-08-18T22:28:20.664926+0000","last_unstale":"2024-08-18T22:28:22.909271+0000","last_undegraded":"2024-08-18T22:28:22.909271+0000","last_fullsized":"2024-08-18T22:28:22.909271+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:13.805157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911104+0000","last_change":"2024-08-18T22:28:21.678188+0000","last_active":"2024-08-18T22:28:22.911104+0000","last_peered":"2024-08-18T22:28:22.911104+0000","last_clean":"2024-08-18T22:28:22.911104+0000","last_became_active":"2024-08-18T22:28:21.677917+0000","last_became_peered":"2024-08-18T22:28:21.677917+0000","last_unstale":"2024-08-18T22:28:22.911104+0000","last_undegraded":"2024-08-18T22:28:22.911104+0000","last_fullsized":"2024-08-18T22:28:22.911104+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:29.727874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912642+0000","last_change":"2024-08-18T22:28:20.678188+0000","last_active":"2024-08-18T22:28:22.912642+0000","last_peered":"2024-08-18T22:28:22.912642+0000","last_clean":"2024-08-18T22:28:22.912642+0000","last_became_active":"2024-08-18T22:28:20.677872+0000","last_became_peered":"2024-08-18T22:28:20.677872+0000","last_unstale":"2024-08-18T22:28:22.912642+0000","last_undegraded":"2024-08-18T22:28:22.912642+0000","last_fullsized":"2024-08-18T22:28:22.912642+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:02:08.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658224+0000","last_change":"2024-08-18T22:28:21.672801+0000","last_active":"2024-08-18T22:28:22.658224+0000","last_peered":"2024-08-18T22:28:22.658224+0000","last_clean":"2024-08-18T22:28:22.658224+0000","last_became_active":"2024-08-18T22:28:21.671880+0000","last_became_peered":"2024-08-18T22:28:21.671880+0000","last_unstale":"2024-08-18T22:28:22.658224+0000","last_undegraded":"2024-08-18T22:28:22.658224+0000","last_fullsized":"2024-08-18T22:28:22.658224+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:46.693220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"140'3","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661228+0000","last_change":"2024-08-18T22:28:20.671106+0000","last_active":"2024-08-18T22:28:22.661228+0000","last_peered":"2024-08-18T22:28:22.661228+0000","last_clean":"2024-08-18T22:28:22.661228+0000","last_became_active":"2024-08-18T22:28:20.670355+0000","last_became_peered":"2024-08-18T22:28:20.670355+0000","last_unstale":"2024-08-18T22:28:22.661228+0000","last_undegraded":"2024-08-18T22:28:22.661228+0000","last_fullsized":"2024-08-18T22:28:22.661228+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:05.357374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658607+0000","last_change":"2024-08-18T22:28:21.669609+0000","last_active":"2024-08-18T22:28:22.658607+0000","last_peered":"2024-08-18T22:28:22.658607+0000","last_clean":"2024-08-18T22:28:22.658607+0000","last_became_active":"2024-08-18T22:28:21.669314+0000","last_became_peered":"2024-08-18T22:28:21.669314+0000","last_unstale":"2024-08-18T22:28:22.658607+0000","last_undegraded":"2024-08-18T22:28:22.658607+0000","last_fullsized":"2024-08-18T22:28:22.658607+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:35.890418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"140'6","reported_seq":20,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660925+0000","last_change":"2024-08-18T22:28:20.676391+0000","last_active":"2024-08-18T22:28:22.660925+0000","last_peered":"2024-08-18T22:28:22.660925+0000","last_clean":"2024-08-18T22:28:22.660925+0000","last_became_active":"2024-08-18T22:28:20.676041+0000","last_became_peered":"2024-08-18T22:28:20.676041+0000","last_unstale":"2024-08-18T22:28:22.660925+0000","last_undegraded":"2024-08-18T22:28:22.660925+0000","last_fullsized":"2024-08-18T22:28:22.660925+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:29.748122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911173+0000","last_change":"2024-08-18T22:28:21.687319+0000","last_active":"2024-08-18T22:28:22.911173+0000","last_peered":"2024-08-18T22:28:22.911173+0000","last_clean":"2024-08-18T22:28:22.911173+0000","last_became_active":"2024-08-18T22:28:21.687043+0000","last_became_peered":"2024-08-18T22:28:21.687043+0000","last_unstale":"2024-08-18T22:28:22.911173+0000","last_undegraded":"2024-08-18T22:28:22.911173+0000","last_fullsized":"2024-08-18T22:28:22.911173+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:56.385939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911905+0000","last_change":"2024-08-18T22:28:20.674165+0000","last_active":"2024-08-18T22:28:22.911905+0000","last_peered":"2024-08-18T22:28:22.911905+0000","last_clean":"2024-08-18T22:28:22.911905+0000","last_became_active":"2024-08-18T22:28:20.673876+0000","last_became_peered":"2024-08-18T22:28:20.673876+0000","last_unstale":"2024-08-18T22:28:22.911905+0000","last_undegraded":"2024-08-18T22:28:22.911905+0000","last_fullsized":"2024-08-18T22:28:22.911905+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:24:27.745674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661487+0000","last_change":"2024-08-18T22:28:21.677158+0000","last_active":"2024-08-18T22:28:22.661487+0000","last_peered":"2024-08-18T22:28:22.661487+0000","last_clean":"2024-08-18T22:28:22.661487+0000","last_became_active":"2024-08-18T22:28:21.673622+0000","last_became_peered":"2024-08-18T22:28:21.673622+0000","last_unstale":"2024-08-18T22:28:22.661487+0000","last_undegraded":"2024-08-18T22:28:22.661487+0000","last_fullsized":"2024-08-18T22:28:22.661487+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:28:15.881360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.657975+0000","last_change":"2024-08-18T22:28:20.665480+0000","last_active":"2024-08-18T22:28:22.657975+0000","last_peered":"2024-08-18T22:28:22.657975+0000","last_clean":"2024-08-18T22:28:22.657975+0000","last_became_active":"2024-08-18T22:28:20.665210+0000","last_became_peered":"2024-08-18T22:28:20.665210+0000","last_unstale":"2024-08-18T22:28:22.657975+0000","last_undegraded":"2024-08-18T22:28:22.657975+0000","last_fullsized":"2024-08-18T22:28:22.657975+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:56:36.287006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912538+0000","last_change":"2024-08-18T22:28:21.679905+0000","last_active":"2024-08-18T22:28:22.912538+0000","last_peered":"2024-08-18T22:28:22.912538+0000","last_clean":"2024-08-18T22:28:22.912538+0000","last_became_active":"2024-08-18T22:28:21.679480+0000","last_became_peered":"2024-08-18T22:28:21.679480+0000","last_unstale":"2024-08-18T22:28:22.912538+0000","last_undegraded":"2024-08-18T22:28:22.912538+0000","last_fullsized":"2024-08-18T22:28:22.912538+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:28.359707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"140'8","reported_seq":22,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910787+0000","last_change":"2024-08-18T22:28:20.663870+0000","last_active":"2024-08-18T22:28:22.910787+0000","last_peered":"2024-08-18T22:28:22.910787+0000","last_clean":"2024-08-18T22:28:22.910787+0000","last_became_active":"2024-08-18T22:28:20.663582+0000","last_became_peered":"2024-08-18T22:28:20.663582+0000","last_unstale":"2024-08-18T22:28:22.910787+0000","last_undegraded":"2024-08-18T22:28:22.910787+0000","last_fullsized":"2024-08-18T22:28:22.910787+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:05.766222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658063+0000","last_change":"2024-08-18T22:28:21.678081+0000","last_active":"2024-08-18T22:28:22.658063+0000","last_peered":"2024-08-18T22:28:22.658063+0000","last_clean":"2024-08-18T22:28:22.658063+0000","last_became_active":"2024-08-18T22:28:21.677747+0000","last_became_peered":"2024-08-18T22:28:21.677747+0000","last_unstale":"2024-08-18T22:28:22.658063+0000","last_undegraded":"2024-08-18T22:28:22.658063+0000","last_fullsized":"2024-08-18T22:28:22.658063+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:44.306645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"140'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909280+0000","last_change":"2024-08-18T22:28:20.675662+0000","last_active":"2024-08-18T22:28:22.909280+0000","last_peered":"2024-08-18T22:28:22.909280+0000","last_clean":"2024-08-18T22:28:22.909280+0000","last_became_active":"2024-08-18T22:28:20.675348+0000","last_became_peered":"2024-08-18T22:28:20.675348+0000","last_unstale":"2024-08-18T22:28:22.909280+0000","last_undegraded":"2024-08-18T22:28:22.909280+0000","last_fullsized":"2024-08-18T22:28:22.909280+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:11:44.806765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660827+0000","last_change":"2024-08-18T22:28:21.679851+0000","last_active":"2024-08-18T22:28:22.660827+0000","last_peered":"2024-08-18T22:28:22.660827+0000","last_clean":"2024-08-18T22:28:22.660827+0000","last_became_active":"2024-08-18T22:28:21.679589+0000","last_became_peered":"2024-08-18T22:28:21.679589+0000","last_unstale":"2024-08-18T22:28:22.660827+0000","last_undegraded":"2024-08-18T22:28:22.660827+0000","last_fullsized":"2024-08-18T22:28:22.660827+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:11.790318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658731+0000","last_change":"2024-08-18T22:28:20.673720+0000","last_active":"2024-08-18T22:28:22.658731+0000","last_peered":"2024-08-18T22:28:22.658731+0000","last_clean":"2024-08-18T22:28:22.658731+0000","last_became_active":"2024-08-18T22:28:20.673351+0000","last_became_peered":"2024-08-18T22:28:20.673351+0000","last_unstale":"2024-08-18T22:28:22.658731+0000","last_undegraded":"2024-08-18T22:28:22.658731+0000","last_fullsized":"2024-08-18T22:28:22.658731+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:33.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661120+0000","last_change":"2024-08-18T22:28:21.660607+0000","last_active":"2024-08-18T22:28:22.661120+0000","last_peered":"2024-08-18T22:28:22.661120+0000","last_clean":"2024-08-18T22:28:22.661120+0000","last_became_active":"2024-08-18T22:28:21.660204+0000","last_became_peered":"2024-08-18T22:28:21.660204+0000","last_unstale":"2024-08-18T22:28:22.661120+0000","last_undegraded":"2024-08-18T22:28:22.661120+0000","last_fullsized":"2024-08-18T22:28:22.661120+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:04.958449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"140'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911590+0000","last_change":"2024-08-18T22:28:20.673057+0000","last_active":"2024-08-18T22:28:22.911590+0000","last_peered":"2024-08-18T22:28:22.911590+0000","last_clean":"2024-08-18T22:28:22.911590+0000","last_became_active":"2024-08-18T22:28:20.672808+0000","last_became_peered":"2024-08-18T22:28:20.672808+0000","last_unstale":"2024-08-18T22:28:22.911590+0000","last_undegraded":"2024-08-18T22:28:22.911590+0000","last_fullsized":"2024-08-18T22:28:22.911590+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:10.084272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910734+0000","last_change":"2024-08-18T22:28:21.680244+0000","last_active":"2024-08-18T22:28:22.910734+0000","last_peered":"2024-08-18T22:28:22.910734+0000","last_clean":"2024-08-18T22:28:22.910734+0000","last_became_active":"2024-08-18T22:28:21.679958+0000","last_became_peered":"2024-08-18T22:28:21.679958+0000","last_unstale":"2024-08-18T22:28:22.910734+0000","last_undegraded":"2024-08-18T22:28:22.910734+0000","last_fullsized":"2024-08-18T22:28:22.910734+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:14.016086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912559+0000","last_change":"2024-08-18T22:28:20.675159+0000","last_active":"2024-08-18T22:28:22.912559+0000","last_peered":"2024-08-18T22:28:22.912559+0000","last_clean":"2024-08-18T22:28:22.912559+0000","last_became_active":"2024-08-18T22:28:20.674184+0000","last_became_peered":"2024-08-18T22:28:20.674184+0000","last_unstale":"2024-08-18T22:28:22.912559+0000","last_undegraded":"2024-08-18T22:28:22.912559+0000","last_fullsized":"2024-08-18T22:28:22.912559+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:10:14.848574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912465+0000","last_change":"2024-08-18T22:28:21.691407+0000","last_active":"2024-08-18T22:28:22.912465+0000","last_peered":"2024-08-18T22:28:22.912465+0000","last_clean":"2024-08-18T22:28:22.912465+0000","last_became_active":"2024-08-18T22:28:21.690292+0000","last_became_peered":"2024-08-18T22:28:21.690292+0000","last_unstale":"2024-08-18T22:28:22.912465+0000","last_undegraded":"2024-08-18T22:28:22.912465+0000","last_fullsized":"2024-08-18T22:28:22.912465+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:18.569634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659510+0000","last_change":"2024-08-18T22:28:20.668430+0000","last_active":"2024-08-18T22:28:22.659510+0000","last_peered":"2024-08-18T22:28:22.659510+0000","last_clean":"2024-08-18T22:28:22.659510+0000","last_became_active":"2024-08-18T22:28:20.668158+0000","last_became_peered":"2024-08-18T22:28:20.668158+0000","last_unstale":"2024-08-18T22:28:22.659510+0000","last_undegraded":"2024-08-18T22:28:22.659510+0000","last_fullsized":"2024-08-18T22:28:22.659510+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:28.601196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912691+0000","last_change":"2024-08-18T22:28:21.681045+0000","last_active":"2024-08-18T22:28:22.912691+0000","last_peered":"2024-08-18T22:28:22.912691+0000","last_clean":"2024-08-18T22:28:22.912691+0000","last_became_active":"2024-08-18T22:28:21.673672+0000","last_became_peered":"2024-08-18T22:28:21.673672+0000","last_unstale":"2024-08-18T22:28:22.912691+0000","last_undegraded":"2024-08-18T22:28:22.912691+0000","last_fullsized":"2024-08-18T22:28:22.912691+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:39.470940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911835+0000","last_change":"2024-08-18T22:28:20.674409+0000","last_active":"2024-08-18T22:28:22.911835+0000","last_peered":"2024-08-18T22:28:22.911835+0000","last_clean":"2024-08-18T22:28:22.911835+0000","last_became_active":"2024-08-18T22:28:20.673769+0000","last_became_peered":"2024-08-18T22:28:20.673769+0000","last_unstale":"2024-08-18T22:28:22.911835+0000","last_undegraded":"2024-08-18T22:28:22.911835+0000","last_fullsized":"2024-08-18T22:28:22.911835+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:00:50.485369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912560+0000","last_change":"2024-08-18T22:28:21.679252+0000","last_active":"2024-08-18T22:28:22.912560+0000","last_peered":"2024-08-18T22:28:22.912560+0000","last_clean":"2024-08-18T22:28:22.912560+0000","last_became_active":"2024-08-18T22:28:21.678985+0000","last_became_peered":"2024-08-18T22:28:21.678985+0000","last_unstale":"2024-08-18T22:28:22.912560+0000","last_undegraded":"2024-08-18T22:28:22.912560+0000","last_fullsized":"2024-08-18T22:28:22.912560+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:42.232356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660794+0000","last_change":"2024-08-18T22:28:20.675610+0000","last_active":"2024-08-18T22:28:22.660794+0000","last_peered":"2024-08-18T22:28:22.660794+0000","last_clean":"2024-08-18T22:28:22.660794+0000","last_became_active":"2024-08-18T22:28:20.675331+0000","last_became_peered":"2024-08-18T22:28:20.675331+0000","last_unstale":"2024-08-18T22:28:22.660794+0000","last_undegraded":"2024-08-18T22:28:22.660794+0000","last_fullsized":"2024-08-18T22:28:22.660794+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:10:03.141004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909210+0000","last_change":"2024-08-18T22:28:21.677776+0000","last_active":"2024-08-18T22:28:22.909210+0000","last_peered":"2024-08-18T22:28:22.909210+0000","last_clean":"2024-08-18T22:28:22.909210+0000","last_became_active":"2024-08-18T22:28:21.677330+0000","last_became_peered":"2024-08-18T22:28:21.677330+0000","last_unstale":"2024-08-18T22:28:22.909210+0000","last_undegraded":"2024-08-18T22:28:22.909210+0000","last_fullsized":"2024-08-18T22:28:22.909210+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.877073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910884+0000","last_change":"2024-08-18T22:28:20.673091+0000","last_active":"2024-08-18T22:28:22.910884+0000","last_peered":"2024-08-18T22:28:22.910884+0000","last_clean":"2024-08-18T22:28:22.910884+0000","last_became_active":"2024-08-18T22:28:20.672769+0000","last_became_peered":"2024-08-18T22:28:20.672769+0000","last_unstale":"2024-08-18T22:28:22.910884+0000","last_undegraded":"2024-08-18T22:28:22.910884+0000","last_fullsized":"2024-08-18T22:28:22.910884+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:31:19.203695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910971+0000","last_change":"2024-08-18T22:28:21.678024+0000","last_active":"2024-08-18T22:28:22.910971+0000","last_peered":"2024-08-18T22:28:22.910971+0000","last_clean":"2024-08-18T22:28:22.910971+0000","last_became_active":"2024-08-18T22:28:21.677514+0000","last_became_peered":"2024-08-18T22:28:21.677514+0000","last_unstale":"2024-08-18T22:28:22.910971+0000","last_undegraded":"2024-08-18T22:28:22.910971+0000","last_fullsized":"2024-08-18T22:28:22.910971+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:52:38.794051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912758+0000","last_change":"2024-08-18T22:28:20.670277+0000","last_active":"2024-08-18T22:28:22.912758+0000","last_peered":"2024-08-18T22:28:22.912758+0000","last_clean":"2024-08-18T22:28:22.912758+0000","last_became_active":"2024-08-18T22:28:20.669870+0000","last_became_peered":"2024-08-18T22:28:20.669870+0000","last_unstale":"2024-08-18T22:28:22.912758+0000","last_undegraded":"2024-08-18T22:28:22.912758+0000","last_fullsized":"2024-08-18T22:28:22.912758+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:54.611820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.657984+0000","last_change":"2024-08-18T22:28:21.673919+0000","last_active":"2024-08-18T22:28:22.657984+0000","last_peered":"2024-08-18T22:28:22.657984+0000","last_clean":"2024-08-18T22:28:22.657984+0000","last_became_active":"2024-08-18T22:28:21.673664+0000","last_became_peered":"2024-08-18T22:28:21.673664+0000","last_unstale":"2024-08-18T22:28:22.657984+0000","last_undegraded":"2024-08-18T22:28:22.657984+0000","last_fullsized":"2024-08-18T22:28:22.657984+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:09:01.125607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"141'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659913+0000","last_change":"2024-08-18T22:28:20.670267+0000","last_active":"2024-08-18T22:28:22.659913+0000","last_peered":"2024-08-18T22:28:22.659913+0000","last_clean":"2024-08-18T22:28:22.659913+0000","last_became_active":"2024-08-18T22:28:20.669380+0000","last_became_peered":"2024-08-18T22:28:20.669380+0000","last_unstale":"2024-08-18T22:28:22.659913+0000","last_undegraded":"2024-08-18T22:28:22.659913+0000","last_fullsized":"2024-08-18T22:28:22.659913+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.610701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660763+0000","last_change":"2024-08-18T22:28:21.670932+0000","last_active":"2024-08-18T22:28:22.660763+0000","last_peered":"2024-08-18T22:28:22.660763+0000","last_clean":"2024-08-18T22:28:22.660763+0000","last_became_active":"2024-08-18T22:28:21.670646+0000","last_became_peered":"2024-08-18T22:28:21.670646+0000","last_unstale":"2024-08-18T22:28:22.660763+0000","last_undegraded":"2024-08-18T22:28:22.660763+0000","last_fullsized":"2024-08-18T22:28:22.660763+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:22:30.840214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659626+0000","last_change":"2024-08-18T22:28:20.672206+0000","last_active":"2024-08-18T22:28:22.659626+0000","last_peered":"2024-08-18T22:28:22.659626+0000","last_clean":"2024-08-18T22:28:22.659626+0000","last_became_active":"2024-08-18T22:28:20.671916+0000","last_became_peered":"2024-08-18T22:28:20.671916+0000","last_unstale":"2024-08-18T22:28:22.659626+0000","last_undegraded":"2024-08-18T22:28:22.659626+0000","last_fullsized":"2024-08-18T22:28:22.659626+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:18.950965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910868+0000","last_change":"2024-08-18T22:28:21.683803+0000","last_active":"2024-08-18T22:28:22.910868+0000","last_peered":"2024-08-18T22:28:22.910868+0000","last_clean":"2024-08-18T22:28:22.910868+0000","last_became_active":"2024-08-18T22:28:21.683492+0000","last_became_peered":"2024-08-18T22:28:21.683492+0000","last_unstale":"2024-08-18T22:28:22.910868+0000","last_undegraded":"2024-08-18T22:28:22.910868+0000","last_fullsized":"2024-08-18T22:28:22.910868+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:35:36.647886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911510+0000","last_change":"2024-08-18T22:28:20.676058+0000","last_active":"2024-08-18T22:28:22.911510+0000","last_peered":"2024-08-18T22:28:22.911510+0000","last_clean":"2024-08-18T22:28:22.911510+0000","last_became_active":"2024-08-18T22:28:20.673389+0000","last_became_peered":"2024-08-18T22:28:20.673389+0000","last_unstale":"2024-08-18T22:28:22.911510+0000","last_undegraded":"2024-08-18T22:28:22.911510+0000","last_fullsized":"2024-08-18T22:28:22.911510+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:38.688122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911903+0000","last_change":"2024-08-18T22:28:21.671212+0000","last_active":"2024-08-18T22:28:22.911903+0000","last_peered":"2024-08-18T22:28:22.911903+0000","last_clean":"2024-08-18T22:28:22.911903+0000","last_became_active":"2024-08-18T22:28:21.670485+0000","last_became_peered":"2024-08-18T22:28:21.670485+0000","last_unstale":"2024-08-18T22:28:22.911903+0000","last_undegraded":"2024-08-18T22:28:22.911903+0000","last_fullsized":"2024-08-18T22:28:22.911903+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:10:04.144329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.908851+0000","last_change":"2024-08-18T22:28:20.672810+0000","last_active":"2024-08-18T22:28:22.908851+0000","last_peered":"2024-08-18T22:28:22.908851+0000","last_clean":"2024-08-18T22:28:22.908851+0000","last_became_active":"2024-08-18T22:28:20.672297+0000","last_became_peered":"2024-08-18T22:28:20.672297+0000","last_unstale":"2024-08-18T22:28:22.908851+0000","last_undegraded":"2024-08-18T22:28:22.908851+0000","last_fullsized":"2024-08-18T22:28:22.908851+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:49.615648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911487+0000","last_change":"2024-08-18T22:28:21.684817+0000","last_active":"2024-08-18T22:28:22.911487+0000","last_peered":"2024-08-18T22:28:22.911487+0000","last_clean":"2024-08-18T22:28:22.911487+0000","last_became_active":"2024-08-18T22:28:21.684531+0000","last_became_peered":"2024-08-18T22:28:21.684531+0000","last_unstale":"2024-08-18T22:28:22.911487+0000","last_undegraded":"2024-08-18T22:28:22.911487+0000","last_fullsized":"2024-08-18T22:28:22.911487+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:09:01.125607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661231+0000","last_change":"2024-08-18T22:28:20.670969+0000","last_active":"2024-08-18T22:28:22.661231+0000","last_peered":"2024-08-18T22:28:22.661231+0000","last_clean":"2024-08-18T22:28:22.661231+0000","last_became_active":"2024-08-18T22:28:20.670023+0000","last_became_peered":"2024-08-18T22:28:20.670023+0000","last_unstale":"2024-08-18T22:28:22.661231+0000","last_undegraded":"2024-08-18T22:28:22.661231+0000","last_fullsized":"2024-08-18T22:28:22.661231+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:15:44.807841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911456+0000","last_change":"2024-08-18T22:28:21.666414+0000","last_active":"2024-08-18T22:28:22.911456+0000","last_peered":"2024-08-18T22:28:22.911456+0000","last_clean":"2024-08-18T22:28:22.911456+0000","last_became_active":"2024-08-18T22:28:21.663859+0000","last_became_peered":"2024-08-18T22:28:21.663859+0000","last_unstale":"2024-08-18T22:28:22.911456+0000","last_undegraded":"2024-08-18T22:28:22.911456+0000","last_fullsized":"2024-08-18T22:28:22.911456+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:30.163352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911087+0000","last_change":"2024-08-18T22:28:20.674742+0000","last_active":"2024-08-18T22:28:22.911087+0000","last_peered":"2024-08-18T22:28:22.911087+0000","last_clean":"2024-08-18T22:28:22.911087+0000","last_became_active":"2024-08-18T22:28:20.671162+0000","last_became_peered":"2024-08-18T22:28:20.671162+0000","last_unstale":"2024-08-18T22:28:22.911087+0000","last_undegraded":"2024-08-18T22:28:22.911087+0000","last_fullsized":"2024-08-18T22:28:22.911087+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:12:34.230853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661534+0000","last_change":"2024-08-18T22:28:21.671225+0000","last_active":"2024-08-18T22:28:22.661534+0000","last_peered":"2024-08-18T22:28:22.661534+0000","last_clean":"2024-08-18T22:28:22.661534+0000","last_became_active":"2024-08-18T22:28:21.670933+0000","last_became_peered":"2024-08-18T22:28:21.670933+0000","last_unstale":"2024-08-18T22:28:22.661534+0000","last_undegraded":"2024-08-18T22:28:22.661534+0000","last_fullsized":"2024-08-18T22:28:22.661534+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:30.124597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911115+0000","last_change":"2024-08-18T22:28:20.663292+0000","last_active":"2024-08-18T22:28:22.911115+0000","last_peered":"2024-08-18T22:28:22.911115+0000","last_clean":"2024-08-18T22:28:22.911115+0000","last_became_active":"2024-08-18T22:28:20.662999+0000","last_became_peered":"2024-08-18T22:28:20.662999+0000","last_unstale":"2024-08-18T22:28:22.911115+0000","last_undegraded":"2024-08-18T22:28:22.911115+0000","last_fullsized":"2024-08-18T22:28:22.911115+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:30.463983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658722+0000","last_change":"2024-08-18T22:28:21.680589+0000","last_active":"2024-08-18T22:28:22.658722+0000","last_peered":"2024-08-18T22:28:22.658722+0000","last_clean":"2024-08-18T22:28:22.658722+0000","last_became_active":"2024-08-18T22:28:21.680305+0000","last_became_peered":"2024-08-18T22:28:21.680305+0000","last_unstale":"2024-08-18T22:28:22.658722+0000","last_undegraded":"2024-08-18T22:28:22.658722+0000","last_fullsized":"2024-08-18T22:28:22.658722+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:30.751448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660963+0000","last_change":"2024-08-18T22:28:20.676508+0000","last_active":"2024-08-18T22:28:22.660963+0000","last_peered":"2024-08-18T22:28:22.660963+0000","last_clean":"2024-08-18T22:28:22.660963+0000","last_became_active":"2024-08-18T22:28:20.676206+0000","last_became_peered":"2024-08-18T22:28:20.676206+0000","last_unstale":"2024-08-18T22:28:22.660963+0000","last_undegraded":"2024-08-18T22:28:22.660963+0000","last_fullsized":"2024-08-18T22:28:22.660963+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:45.689894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":414,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660428+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:28:22.660428+0000","last_peered":"2024-08-18T22:28:22.660428+0000","last_clean":"2024-08-18T22:28:22.660428+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:28:22.660428+0000","last_undegraded":"2024-08-18T22:28:22.660428+0000","last_fullsized":"2024-08-18T22:28:22.660428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":2363392,"data_stored":1418294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509556,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46792,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325048,"statfs":{"total":96636764160,"available":96588849152,"internally_reserved":0,"allocated":1761280,"data_stored":826896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509554,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46788,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325052,"statfs":{"total":96636764160,"available":96588853248,"internally_reserved":0,"allocated":1757184,"data_stored":826246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509555,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55120,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316720,"statfs":{"total":96636764160,"available":96580321280,"internally_reserved":0,"allocated":1769472,"data_stored":827906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509554,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55104,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316736,"statfs":{"total":96636764160,"available":96580337664,"internally_reserved":0,"allocated":1757184,"data_stored":826294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509555,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51528,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320312,"statfs":{"total":96636764160,"available":96583999488,"internally_reserved":0,"allocated":2355200,"data_stored":1416648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50944,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320896,"statfs":{"total":96636764160,"available":96584597504,"internally_reserved":0,"allocated":1753088,"data_stored":826224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55116,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316724,"statfs":{"total":96636764160,"available":96580325376,"internally_reserved":0,"allocated":1761280,"data_stored":826840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:28:25.794 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:28:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febbe800640 1 Processor -- start 2024-08-18T22:28:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febbe800640 1 -- start start 2024-08-18T22:28:25.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febbe800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febb815b010 0x7febb80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febbe800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80cd3a0 0x7febb806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febbe800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb80cee20 con 0x7febb806f0c0 2024-08-18T22:28:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febbe800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7febb80cfa30 con 0x7febb815b010 2024-08-18T22:28:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febbe800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7febb80cf100 con 0x7febb80cd3a0 2024-08-18T22:28:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febb7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febb815b010 0x7febb80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febb7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febb815b010 0x7febb80ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37324/0 (socket says 172.21.15.5:37324) 2024-08-18T22:28:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febb7400640 1 -- 172.21.15.5:0/2565708019 learned_addr learned my addr 172.21.15.5:0/2565708019 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febb7400640 1 -- 172.21.15.5:0/2565708019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80cd3a0 msgr2=0x7febb806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febb7400640 1 --2- 172.21.15.5:0/2565708019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80cd3a0 0x7febb806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febb7400640 1 -- 172.21.15.5:0/2565708019 >> v1:172.21.15.117:6789/0 conn(0x7febb806f0c0 legacy=0x7febb80caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:25.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.971+0000 7febb7400640 1 -- 172.21.15.5:0/2565708019 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb80cf3e0 con 0x7febb815b010 2024-08-18T22:28:25.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febb7400640 1 --2- 172.21.15.5:0/2565708019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb815b010 0x7febb80ce840 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7feba800bb10 tx=0x7feba801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8b80ec8f4eb3ee server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febb6000640 1 -- 172.21.15.5:0/2565708019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba80b4070 con 0x7febb815b010 2024-08-18T22:28:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febb6000640 1 -- 172.21.15.5:0/2565708019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba80a7b00 con 0x7febb815b010 2024-08-18T22:28:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febb6000640 1 -- 172.21.15.5:0/2565708019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba80af440 con 0x7febb815b010 2024-08-18T22:28:25.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febbe800640 1 -- 172.21.15.5:0/2565708019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb815b010 msgr2=0x7febb80ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febbe800640 1 --2- 172.21.15.5:0/2565708019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb815b010 0x7febb80ce840 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7feba800bb10 tx=0x7feba801ebf0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febbe800640 1 -- 172.21.15.5:0/2565708019 shutdown_connections 2024-08-18T22:28:25.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febbe800640 1 --2- 172.21.15.5:0/2565708019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80cd3a0 0x7febb806eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febbe800640 1 --2- 172.21.15.5:0/2565708019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb815b010 0x7febb80ce840 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febbe800640 1 -- 172.21.15.5:0/2565708019 >> 172.21.15.5:0/2565708019 conn(0x7febb80b1c50 msgr2=0x7febb80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:25.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febbe800640 1 -- 172.21.15.5:0/2565708019 shutdown_connections 2024-08-18T22:28:25.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.975+0000 7febbe800640 1 -- 172.21.15.5:0/2565708019 wait complete. 2024-08-18T22:28:25.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febbe800640 1 Processor -- start 2024-08-18T22:28:25.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febbe800640 1 -- start start 2024-08-18T22:28:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febbe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb806f0c0 0x7febb80ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febbe800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80cd3a0 0x7febb814bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febbe800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febb815b010 0x7febb80b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febbe800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7febb806dbf0 con 0x7febb806f0c0 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febbe800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7febb806da70 con 0x7febb815b010 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febbe800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7febb806dd70 con 0x7febb80cd3a0 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb806f0c0 0x7febb80ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb806f0c0 0x7febb80ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37338/0 (socket says 172.21.15.5:37338) 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb7400640 1 -- 172.21.15.5:0/1667308298 learned_addr learned my addr 172.21.15.5:0/1667308298 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb6a00640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80cd3a0 0x7febb814bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb7e00640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febb815b010 0x7febb80b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb7400640 1 -- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80cd3a0 msgr2=0x7febb814bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb7400640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80cd3a0 0x7febb814bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb7400640 1 -- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febb815b010 msgr2=0x7febb80b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb7400640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febb815b010 0x7febb80b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb7400640 1 -- 172.21.15.5:0/1667308298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb8157690 con 0x7febb806f0c0 2024-08-18T22:28:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb7e00640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febb815b010 0x7febb80b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febb7400640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb806f0c0 0x7febb80ae4c0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7feba801d2a0 tx=0x7feba801d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:25.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febaf400640 1 -- 172.21.15.5:0/1667308298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba80bf070 con 0x7febb806f0c0 2024-08-18T22:28:25.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febaf400640 1 -- 172.21.15.5:0/1667308298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba80ba660 con 0x7febb806f0c0 2024-08-18T22:28:25.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febaf400640 1 -- 172.21.15.5:0/1667308298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba80b4070 con 0x7febb806f0c0 2024-08-18T22:28:25.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febbe800640 1 -- 172.21.15.5:0/1667308298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb814c210 con 0x7febb806f0c0 2024-08-18T22:28:25.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.979+0000 7febbe800640 1 -- 172.21.15.5:0/1667308298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb80ad9e0 con 0x7febb806f0c0 2024-08-18T22:28:25.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.983+0000 7febbe800640 1 -- 172.21.15.5:0/1667308298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb80ce840 con 0x7febb806f0c0 2024-08-18T22:28:25.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.983+0000 7febaf400640 1 -- 172.21.15.5:0/1667308298 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feba80b93e0 con 0x7febb806f0c0 2024-08-18T22:28:25.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.983+0000 7febaf400640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb980678c0 0x7feb98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:25.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.983+0000 7febaf400640 1 -- 172.21.15.5:0/1667308298 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7feba8120620 con 0x7febb806f0c0 2024-08-18T22:28:25.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.983+0000 7febb6a00640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb980678c0 0x7feb98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:25.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.983+0000 7febb6a00640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb980678c0 0x7feb98069d80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7febb80d0e90 tx=0x7feba4009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:25.987+0000 7febaf400640 1 -- 172.21.15.5:0/1667308298 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7feba80187e0 con 0x7febb806f0c0 2024-08-18T22:28:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.151+0000 7febbe800640 1 -- 172.21.15.5:0/1667308298 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7febb8165a20 con 0x7feb980678c0 2024-08-18T22:28:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.159+0000 7febaf400640 1 -- 172.21.15.5:0/1667308298 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7febb8165a20 con 0x7feb980678c0 2024-08-18T22:28:26.162 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:26.163 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:28:26.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 -- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb980678c0 msgr2=0x7feb98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb980678c0 0x7feb98069d80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7febb80d0e90 tx=0x7feba4009110 comp rx=0 tx=0).stop 2024-08-18T22:28:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 -- 172.21.15.5:0/1667308298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb806f0c0 msgr2=0x7febb80ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb806f0c0 0x7febb80ae4c0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7feba801d2a0 tx=0x7feba801d430 comp rx=0 tx=0).stop 2024-08-18T22:28:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 -- 172.21.15.5:0/1667308298 shutdown_connections 2024-08-18T22:28:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb980678c0 0x7feb98069d80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febb815b010 0x7febb80b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80cd3a0 0x7febb814bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 --2- 172.21.15.5:0/1667308298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb806f0c0 0x7febb80ae4c0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 -- 172.21.15.5:0/1667308298 >> 172.21.15.5:0/1667308298 conn(0x7febb80b1c50 msgr2=0x7febb80b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 -- 172.21.15.5:0/1667308298 shutdown_connections 2024-08-18T22:28:26.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.163+0000 7febbe800640 1 -- 172.21.15.5:0/1667308298 wait complete. 2024-08-18T22:28:26.182 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2024-08-18T22:28:25.754953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403200,"kb_used_data":14920,"kb_used_omap":12,"kb_used_meta":388147,"kb_avail":754571520,"statfs":{"total":773094113280,"available":772681236480,"internally_reserved":0,"allocated":15278080,"data_stored":7795348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":397463088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001559"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912755+0000","last_change":"2024-08-18T22:28:21.679393+0000","last_active":"2024-08-18T22:28:22.912755+0000","last_peered":"2024-08-18T22:28:22.912755+0000","last_clean":"2024-08-18T22:28:22.912755+0000","last_became_active":"2024-08-18T22:28:21.679127+0000","last_became_peered":"2024-08-18T22:28:21.679127+0000","last_unstale":"2024-08-18T22:28:22.912755+0000","last_undegraded":"2024-08-18T22:28:22.912755+0000","last_fullsized":"2024-08-18T22:28:22.912755+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:21:52.119965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909211+0000","last_change":"2024-08-18T22:28:21.677074+0000","last_active":"2024-08-18T22:28:22.909211+0000","last_peered":"2024-08-18T22:28:22.909211+0000","last_clean":"2024-08-18T22:28:22.909211+0000","last_became_active":"2024-08-18T22:28:21.676805+0000","last_became_peered":"2024-08-18T22:28:21.676805+0000","last_unstale":"2024-08-18T22:28:22.909211+0000","last_undegraded":"2024-08-18T22:28:22.909211+0000","last_fullsized":"2024-08-18T22:28:22.909211+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:53:56.804355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658596+0000","last_change":"2024-08-18T22:28:21.678184+0000","last_active":"2024-08-18T22:28:22.658596+0000","last_peered":"2024-08-18T22:28:22.658596+0000","last_clean":"2024-08-18T22:28:22.658596+0000","last_became_active":"2024-08-18T22:28:21.677900+0000","last_became_peered":"2024-08-18T22:28:21.677900+0000","last_unstale":"2024-08-18T22:28:22.658596+0000","last_undegraded":"2024-08-18T22:28:22.658596+0000","last_fullsized":"2024-08-18T22:28:22.658596+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:10:04.144329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909069+0000","last_change":"2024-08-18T22:28:21.676911+0000","last_active":"2024-08-18T22:28:22.909069+0000","last_peered":"2024-08-18T22:28:22.909069+0000","last_clean":"2024-08-18T22:28:22.909069+0000","last_became_active":"2024-08-18T22:28:21.676621+0000","last_became_peered":"2024-08-18T22:28:21.676621+0000","last_unstale":"2024-08-18T22:28:22.909069+0000","last_undegraded":"2024-08-18T22:28:22.909069+0000","last_fullsized":"2024-08-18T22:28:22.909069+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:13:54.689047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911898+0000","last_change":"2024-08-18T22:28:21.683129+0000","last_active":"2024-08-18T22:28:22.911898+0000","last_peered":"2024-08-18T22:28:22.911898+0000","last_clean":"2024-08-18T22:28:22.911898+0000","last_became_active":"2024-08-18T22:28:21.682851+0000","last_became_peered":"2024-08-18T22:28:21.682851+0000","last_unstale":"2024-08-18T22:28:22.911898+0000","last_undegraded":"2024-08-18T22:28:22.911898+0000","last_fullsized":"2024-08-18T22:28:22.911898+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:28:15.881360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911153+0000","last_change":"2024-08-18T22:28:21.674462+0000","last_active":"2024-08-18T22:28:22.911153+0000","last_peered":"2024-08-18T22:28:22.911153+0000","last_clean":"2024-08-18T22:28:22.911153+0000","last_became_active":"2024-08-18T22:28:21.670920+0000","last_became_peered":"2024-08-18T22:28:21.670920+0000","last_unstale":"2024-08-18T22:28:22.911153+0000","last_undegraded":"2024-08-18T22:28:22.911153+0000","last_fullsized":"2024-08-18T22:28:22.911153+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:56:23.332196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660694+0000","last_change":"2024-08-18T22:28:21.666086+0000","last_active":"2024-08-18T22:28:22.660694+0000","last_peered":"2024-08-18T22:28:22.660694+0000","last_clean":"2024-08-18T22:28:22.660694+0000","last_became_active":"2024-08-18T22:28:21.665682+0000","last_became_peered":"2024-08-18T22:28:21.665682+0000","last_unstale":"2024-08-18T22:28:22.660694+0000","last_undegraded":"2024-08-18T22:28:22.660694+0000","last_fullsized":"2024-08-18T22:28:22.660694+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:59:48.302687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659294+0000","last_change":"2024-08-18T22:28:21.672784+0000","last_active":"2024-08-18T22:28:22.659294+0000","last_peered":"2024-08-18T22:28:22.659294+0000","last_clean":"2024-08-18T22:28:22.659294+0000","last_became_active":"2024-08-18T22:28:21.672502+0000","last_became_peered":"2024-08-18T22:28:21.672502+0000","last_unstale":"2024-08-18T22:28:22.659294+0000","last_undegraded":"2024-08-18T22:28:22.659294+0000","last_fullsized":"2024-08-18T22:28:22.659294+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:11:04.122261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911849+0000","last_change":"2024-08-18T22:28:21.676294+0000","last_active":"2024-08-18T22:28:22.911849+0000","last_peered":"2024-08-18T22:28:22.911849+0000","last_clean":"2024-08-18T22:28:22.911849+0000","last_became_active":"2024-08-18T22:28:21.675930+0000","last_became_peered":"2024-08-18T22:28:21.675930+0000","last_unstale":"2024-08-18T22:28:22.911849+0000","last_undegraded":"2024-08-18T22:28:22.911849+0000","last_fullsized":"2024-08-18T22:28:22.911849+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:15:45.811166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911553+0000","last_change":"2024-08-18T22:28:21.674151+0000","last_active":"2024-08-18T22:28:22.911553+0000","last_peered":"2024-08-18T22:28:22.911553+0000","last_clean":"2024-08-18T22:28:22.911553+0000","last_became_active":"2024-08-18T22:28:21.673849+0000","last_became_peered":"2024-08-18T22:28:21.673849+0000","last_unstale":"2024-08-18T22:28:22.911553+0000","last_undegraded":"2024-08-18T22:28:22.911553+0000","last_fullsized":"2024-08-18T22:28:22.911553+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:43:03.881966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909004+0000","last_change":"2024-08-18T22:28:21.678958+0000","last_active":"2024-08-18T22:28:22.909004+0000","last_peered":"2024-08-18T22:28:22.909004+0000","last_clean":"2024-08-18T22:28:22.909004+0000","last_became_active":"2024-08-18T22:28:21.678684+0000","last_became_peered":"2024-08-18T22:28:21.678684+0000","last_unstale":"2024-08-18T22:28:22.909004+0000","last_undegraded":"2024-08-18T22:28:22.909004+0000","last_fullsized":"2024-08-18T22:28:22.909004+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:06.360700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912313+0000","last_change":"2024-08-18T22:28:21.680302+0000","last_active":"2024-08-18T22:28:22.912313+0000","last_peered":"2024-08-18T22:28:22.912313+0000","last_clean":"2024-08-18T22:28:22.912313+0000","last_became_active":"2024-08-18T22:28:21.679907+0000","last_became_peered":"2024-08-18T22:28:21.679907+0000","last_unstale":"2024-08-18T22:28:22.912313+0000","last_undegraded":"2024-08-18T22:28:22.912313+0000","last_fullsized":"2024-08-18T22:28:22.912313+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:46:26.225894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911508+0000","last_change":"2024-08-18T22:28:21.666997+0000","last_active":"2024-08-18T22:28:22.911508+0000","last_peered":"2024-08-18T22:28:22.911508+0000","last_clean":"2024-08-18T22:28:22.911508+0000","last_became_active":"2024-08-18T22:28:21.666731+0000","last_became_peered":"2024-08-18T22:28:21.666731+0000","last_unstale":"2024-08-18T22:28:22.911508+0000","last_undegraded":"2024-08-18T22:28:22.911508+0000","last_fullsized":"2024-08-18T22:28:22.911508+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:44.306645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911791+0000","last_change":"2024-08-18T22:28:21.676464+0000","last_active":"2024-08-18T22:28:22.911791+0000","last_peered":"2024-08-18T22:28:22.911791+0000","last_clean":"2024-08-18T22:28:22.911791+0000","last_became_active":"2024-08-18T22:28:21.675213+0000","last_became_peered":"2024-08-18T22:28:21.675213+0000","last_unstale":"2024-08-18T22:28:22.911791+0000","last_undegraded":"2024-08-18T22:28:22.911791+0000","last_fullsized":"2024-08-18T22:28:22.911791+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:46:03.404356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910461+0000","last_change":"2024-08-18T22:28:21.672737+0000","last_active":"2024-08-18T22:28:22.910461+0000","last_peered":"2024-08-18T22:28:22.910461+0000","last_clean":"2024-08-18T22:28:22.910461+0000","last_became_active":"2024-08-18T22:28:21.672435+0000","last_became_peered":"2024-08-18T22:28:21.672435+0000","last_unstale":"2024-08-18T22:28:22.910461+0000","last_undegraded":"2024-08-18T22:28:22.910461+0000","last_fullsized":"2024-08-18T22:28:22.910461+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:23:18.250786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910681+0000","last_change":"2024-08-18T22:28:21.680499+0000","last_active":"2024-08-18T22:28:22.910681+0000","last_peered":"2024-08-18T22:28:22.910681+0000","last_clean":"2024-08-18T22:28:22.910681+0000","last_became_active":"2024-08-18T22:28:21.680150+0000","last_became_peered":"2024-08-18T22:28:21.680150+0000","last_unstale":"2024-08-18T22:28:22.910681+0000","last_undegraded":"2024-08-18T22:28:22.910681+0000","last_fullsized":"2024-08-18T22:28:22.910681+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:11:45.810091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911822+0000","last_change":"2024-08-18T22:28:21.679510+0000","last_active":"2024-08-18T22:28:22.911822+0000","last_peered":"2024-08-18T22:28:22.911822+0000","last_clean":"2024-08-18T22:28:22.911822+0000","last_became_active":"2024-08-18T22:28:21.679254+0000","last_became_peered":"2024-08-18T22:28:21.679254+0000","last_unstale":"2024-08-18T22:28:22.911822+0000","last_undegraded":"2024-08-18T22:28:22.911822+0000","last_fullsized":"2024-08-18T22:28:22.911822+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:46.693220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912360+0000","last_change":"2024-08-18T22:28:21.685162+0000","last_active":"2024-08-18T22:28:22.912360+0000","last_peered":"2024-08-18T22:28:22.912360+0000","last_clean":"2024-08-18T22:28:22.912360+0000","last_became_active":"2024-08-18T22:28:21.683648+0000","last_became_peered":"2024-08-18T22:28:21.683648+0000","last_unstale":"2024-08-18T22:28:22.912360+0000","last_undegraded":"2024-08-18T22:28:22.912360+0000","last_fullsized":"2024-08-18T22:28:22.912360+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:30.124597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660959+0000","last_change":"2024-08-18T22:28:21.662287+0000","last_active":"2024-08-18T22:28:22.660959+0000","last_peered":"2024-08-18T22:28:22.660959+0000","last_clean":"2024-08-18T22:28:22.660959+0000","last_became_active":"2024-08-18T22:28:21.661996+0000","last_became_peered":"2024-08-18T22:28:21.661996+0000","last_unstale":"2024-08-18T22:28:22.660959+0000","last_undegraded":"2024-08-18T22:28:22.660959+0000","last_fullsized":"2024-08-18T22:28:22.660959+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:46:08.819020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912479+0000","last_change":"2024-08-18T22:28:21.681932+0000","last_active":"2024-08-18T22:28:22.912479+0000","last_peered":"2024-08-18T22:28:22.912479+0000","last_clean":"2024-08-18T22:28:22.912479+0000","last_became_active":"2024-08-18T22:28:21.681573+0000","last_became_peered":"2024-08-18T22:28:21.681573+0000","last_unstale":"2024-08-18T22:28:22.912479+0000","last_undegraded":"2024-08-18T22:28:22.912479+0000","last_fullsized":"2024-08-18T22:28:22.912479+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:08:39.644006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.908896+0000","last_change":"2024-08-18T22:28:21.675572+0000","last_active":"2024-08-18T22:28:22.908896+0000","last_peered":"2024-08-18T22:28:22.908896+0000","last_clean":"2024-08-18T22:28:22.908896+0000","last_became_active":"2024-08-18T22:28:21.675318+0000","last_became_peered":"2024-08-18T22:28:21.675318+0000","last_unstale":"2024-08-18T22:28:22.908896+0000","last_undegraded":"2024-08-18T22:28:22.908896+0000","last_fullsized":"2024-08-18T22:28:22.908896+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:35.890418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911646+0000","last_change":"2024-08-18T22:28:21.677069+0000","last_active":"2024-08-18T22:28:22.911646+0000","last_peered":"2024-08-18T22:28:22.911646+0000","last_clean":"2024-08-18T22:28:22.911646+0000","last_became_active":"2024-08-18T22:28:21.676805+0000","last_became_peered":"2024-08-18T22:28:21.676805+0000","last_unstale":"2024-08-18T22:28:22.911646+0000","last_undegraded":"2024-08-18T22:28:22.911646+0000","last_fullsized":"2024-08-18T22:28:22.911646+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:06:50.190932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.908939+0000","last_change":"2024-08-18T22:28:21.672904+0000","last_active":"2024-08-18T22:28:22.908939+0000","last_peered":"2024-08-18T22:28:22.908939+0000","last_clean":"2024-08-18T22:28:22.908939+0000","last_became_active":"2024-08-18T22:28:21.672625+0000","last_became_peered":"2024-08-18T22:28:21.672625+0000","last_unstale":"2024-08-18T22:28:22.908939+0000","last_undegraded":"2024-08-18T22:28:22.908939+0000","last_fullsized":"2024-08-18T22:28:22.908939+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:05.124874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910528+0000","last_change":"2024-08-18T22:28:21.675227+0000","last_active":"2024-08-18T22:28:22.910528+0000","last_peered":"2024-08-18T22:28:22.910528+0000","last_clean":"2024-08-18T22:28:22.910528+0000","last_became_active":"2024-08-18T22:28:21.674948+0000","last_became_peered":"2024-08-18T22:28:21.674948+0000","last_unstale":"2024-08-18T22:28:22.910528+0000","last_undegraded":"2024-08-18T22:28:22.910528+0000","last_fullsized":"2024-08-18T22:28:22.910528+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:14.808483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659023+0000","last_change":"2024-08-18T22:28:21.672343+0000","last_active":"2024-08-18T22:28:22.659023+0000","last_peered":"2024-08-18T22:28:22.659023+0000","last_clean":"2024-08-18T22:28:22.659023+0000","last_became_active":"2024-08-18T22:28:21.672003+0000","last_became_peered":"2024-08-18T22:28:21.672003+0000","last_unstale":"2024-08-18T22:28:22.659023+0000","last_undegraded":"2024-08-18T22:28:22.659023+0000","last_fullsized":"2024-08-18T22:28:22.659023+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:06.360700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658619+0000","last_change":"2024-08-18T22:28:21.669174+0000","last_active":"2024-08-18T22:28:22.658619+0000","last_peered":"2024-08-18T22:28:22.658619+0000","last_clean":"2024-08-18T22:28:22.658619+0000","last_became_active":"2024-08-18T22:28:21.668867+0000","last_became_peered":"2024-08-18T22:28:21.668867+0000","last_unstale":"2024-08-18T22:28:22.658619+0000","last_undegraded":"2024-08-18T22:28:22.658619+0000","last_fullsized":"2024-08-18T22:28:22.658619+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:05.124874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661119+0000","last_change":"2024-08-18T22:28:21.672019+0000","last_active":"2024-08-18T22:28:22.661119+0000","last_peered":"2024-08-18T22:28:22.661119+0000","last_clean":"2024-08-18T22:28:22.661119+0000","last_became_active":"2024-08-18T22:28:21.671657+0000","last_became_peered":"2024-08-18T22:28:21.671657+0000","last_unstale":"2024-08-18T22:28:22.661119+0000","last_undegraded":"2024-08-18T22:28:22.661119+0000","last_fullsized":"2024-08-18T22:28:22.661119+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:49:21.716821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911353+0000","last_change":"2024-08-18T22:28:21.683258+0000","last_active":"2024-08-18T22:28:22.911353+0000","last_peered":"2024-08-18T22:28:22.911353+0000","last_clean":"2024-08-18T22:28:22.911353+0000","last_became_active":"2024-08-18T22:28:21.682973+0000","last_became_peered":"2024-08-18T22:28:21.682973+0000","last_unstale":"2024-08-18T22:28:22.911353+0000","last_undegraded":"2024-08-18T22:28:22.911353+0000","last_fullsized":"2024-08-18T22:28:22.911353+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:39:23.496740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658453+0000","last_change":"2024-08-18T22:28:21.676248+0000","last_active":"2024-08-18T22:28:22.658453+0000","last_peered":"2024-08-18T22:28:22.658453+0000","last_clean":"2024-08-18T22:28:22.658453+0000","last_became_active":"2024-08-18T22:28:21.675993+0000","last_became_peered":"2024-08-18T22:28:21.675993+0000","last_unstale":"2024-08-18T22:28:22.658453+0000","last_undegraded":"2024-08-18T22:28:22.658453+0000","last_fullsized":"2024-08-18T22:28:22.658453+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:15:45.811166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.657962+0000","last_change":"2024-08-18T22:28:21.673023+0000","last_active":"2024-08-18T22:28:22.657962+0000","last_peered":"2024-08-18T22:28:22.657962+0000","last_clean":"2024-08-18T22:28:22.657962+0000","last_became_active":"2024-08-18T22:28:21.672547+0000","last_became_peered":"2024-08-18T22:28:21.672547+0000","last_unstale":"2024-08-18T22:28:22.657962+0000","last_undegraded":"2024-08-18T22:28:22.657962+0000","last_fullsized":"2024-08-18T22:28:22.657962+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:30.163352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659357+0000","last_change":"2024-08-18T22:28:21.680886+0000","last_active":"2024-08-18T22:28:22.659357+0000","last_peered":"2024-08-18T22:28:22.659357+0000","last_clean":"2024-08-18T22:28:22.659357+0000","last_became_active":"2024-08-18T22:28:21.678617+0000","last_became_peered":"2024-08-18T22:28:21.678617+0000","last_unstale":"2024-08-18T22:28:22.659357+0000","last_undegraded":"2024-08-18T22:28:22.659357+0000","last_fullsized":"2024-08-18T22:28:22.659357+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:36:04.733503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910421+0000","last_change":"2024-08-18T22:28:21.674817+0000","last_active":"2024-08-18T22:28:22.910421+0000","last_peered":"2024-08-18T22:28:22.910421+0000","last_clean":"2024-08-18T22:28:22.910421+0000","last_became_active":"2024-08-18T22:28:21.674405+0000","last_became_peered":"2024-08-18T22:28:21.674405+0000","last_unstale":"2024-08-18T22:28:22.910421+0000","last_undegraded":"2024-08-18T22:28:22.910421+0000","last_fullsized":"2024-08-18T22:28:22.910421+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:38:01.148521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659300+0000","last_change":"2024-08-18T22:28:21.661451+0000","last_active":"2024-08-18T22:28:22.659300+0000","last_peered":"2024-08-18T22:28:22.659300+0000","last_clean":"2024-08-18T22:28:22.659300+0000","last_became_active":"2024-08-18T22:28:21.661187+0000","last_became_peered":"2024-08-18T22:28:21.661187+0000","last_unstale":"2024-08-18T22:28:22.659300+0000","last_undegraded":"2024-08-18T22:28:22.659300+0000","last_fullsized":"2024-08-18T22:28:22.659300+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:36.851708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"140'4","reported_seq":18,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658971+0000","last_change":"2024-08-18T22:28:20.669219+0000","last_active":"2024-08-18T22:28:22.658971+0000","last_peered":"2024-08-18T22:28:22.658971+0000","last_clean":"2024-08-18T22:28:22.658971+0000","last_became_active":"2024-08-18T22:28:20.668933+0000","last_became_peered":"2024-08-18T22:28:20.668933+0000","last_unstale":"2024-08-18T22:28:22.658971+0000","last_undegraded":"2024-08-18T22:28:22.658971+0000","last_fullsized":"2024-08-18T22:28:22.658971+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:30:27.532269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910683+0000","last_change":"2024-08-18T22:28:21.676474+0000","last_active":"2024-08-18T22:28:22.910683+0000","last_peered":"2024-08-18T22:28:22.910683+0000","last_clean":"2024-08-18T22:28:22.910683+0000","last_became_active":"2024-08-18T22:28:21.675911+0000","last_became_peered":"2024-08-18T22:28:21.675911+0000","last_unstale":"2024-08-18T22:28:22.910683+0000","last_undegraded":"2024-08-18T22:28:22.910683+0000","last_fullsized":"2024-08-18T22:28:22.910683+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:17:52.948750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"140'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912487+0000","last_change":"2024-08-18T22:28:20.667654+0000","last_active":"2024-08-18T22:28:22.912487+0000","last_peered":"2024-08-18T22:28:22.912487+0000","last_clean":"2024-08-18T22:28:22.912487+0000","last_became_active":"2024-08-18T22:28:20.665818+0000","last_became_peered":"2024-08-18T22:28:20.665818+0000","last_unstale":"2024-08-18T22:28:22.912487+0000","last_undegraded":"2024-08-18T22:28:22.912487+0000","last_fullsized":"2024-08-18T22:28:22.912487+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:52:08.921825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.908936+0000","last_change":"2024-08-18T22:28:21.679601+0000","last_active":"2024-08-18T22:28:22.908936+0000","last_peered":"2024-08-18T22:28:22.908936+0000","last_clean":"2024-08-18T22:28:22.908936+0000","last_became_active":"2024-08-18T22:28:21.679346+0000","last_became_peered":"2024-08-18T22:28:21.679346+0000","last_unstale":"2024-08-18T22:28:22.908936+0000","last_undegraded":"2024-08-18T22:28:22.908936+0000","last_fullsized":"2024-08-18T22:28:22.908936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:30.751448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661264+0000","last_change":"2024-08-18T22:28:20.676900+0000","last_active":"2024-08-18T22:28:22.661264+0000","last_peered":"2024-08-18T22:28:22.661264+0000","last_clean":"2024-08-18T22:28:22.661264+0000","last_became_active":"2024-08-18T22:28:20.676597+0000","last_became_peered":"2024-08-18T22:28:20.676597+0000","last_unstale":"2024-08-18T22:28:22.661264+0000","last_undegraded":"2024-08-18T22:28:22.661264+0000","last_fullsized":"2024-08-18T22:28:22.661264+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:20:04.121548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911738+0000","last_change":"2024-08-18T22:28:21.672173+0000","last_active":"2024-08-18T22:28:22.911738+0000","last_peered":"2024-08-18T22:28:22.911738+0000","last_clean":"2024-08-18T22:28:22.911738+0000","last_became_active":"2024-08-18T22:28:21.671902+0000","last_became_peered":"2024-08-18T22:28:21.671902+0000","last_unstale":"2024-08-18T22:28:22.911738+0000","last_undegraded":"2024-08-18T22:28:22.911738+0000","last_fullsized":"2024-08-18T22:28:22.911738+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:05:48.378052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660893+0000","last_change":"2024-08-18T22:28:20.674692+0000","last_active":"2024-08-18T22:28:22.660893+0000","last_peered":"2024-08-18T22:28:22.660893+0000","last_clean":"2024-08-18T22:28:22.660893+0000","last_became_active":"2024-08-18T22:28:20.673945+0000","last_became_peered":"2024-08-18T22:28:20.673945+0000","last_unstale":"2024-08-18T22:28:22.660893+0000","last_undegraded":"2024-08-18T22:28:22.660893+0000","last_fullsized":"2024-08-18T22:28:22.660893+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:34.887092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659666+0000","last_change":"2024-08-18T22:28:21.673646+0000","last_active":"2024-08-18T22:28:22.659666+0000","last_peered":"2024-08-18T22:28:22.659666+0000","last_clean":"2024-08-18T22:28:22.659666+0000","last_became_active":"2024-08-18T22:28:21.673350+0000","last_became_peered":"2024-08-18T22:28:21.673350+0000","last_unstale":"2024-08-18T22:28:22.659666+0000","last_undegraded":"2024-08-18T22:28:22.659666+0000","last_fullsized":"2024-08-18T22:28:22.659666+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:56:37.989141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"140'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659505+0000","last_change":"2024-08-18T22:28:20.674123+0000","last_active":"2024-08-18T22:28:22.659505+0000","last_peered":"2024-08-18T22:28:22.659505+0000","last_clean":"2024-08-18T22:28:22.659505+0000","last_became_active":"2024-08-18T22:28:20.673860+0000","last_became_peered":"2024-08-18T22:28:20.673860+0000","last_unstale":"2024-08-18T22:28:22.659505+0000","last_undegraded":"2024-08-18T22:28:22.659505+0000","last_fullsized":"2024-08-18T22:28:22.659505+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:19:51.372303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659661+0000","last_change":"2024-08-18T22:28:21.672716+0000","last_active":"2024-08-18T22:28:22.659661+0000","last_peered":"2024-08-18T22:28:22.659661+0000","last_clean":"2024-08-18T22:28:22.659661+0000","last_became_active":"2024-08-18T22:28:21.672430+0000","last_became_peered":"2024-08-18T22:28:21.672430+0000","last_unstale":"2024-08-18T22:28:22.659661+0000","last_undegraded":"2024-08-18T22:28:22.659661+0000","last_fullsized":"2024-08-18T22:28:22.659661+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:38.916892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"140'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911683+0000","last_change":"2024-08-18T22:28:20.665729+0000","last_active":"2024-08-18T22:28:22.911683+0000","last_peered":"2024-08-18T22:28:22.911683+0000","last_clean":"2024-08-18T22:28:22.911683+0000","last_became_active":"2024-08-18T22:28:20.665430+0000","last_became_peered":"2024-08-18T22:28:20.665430+0000","last_unstale":"2024-08-18T22:28:22.911683+0000","last_undegraded":"2024-08-18T22:28:22.911683+0000","last_fullsized":"2024-08-18T22:28:22.911683+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:53.248819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912383+0000","last_change":"2024-08-18T22:28:21.687604+0000","last_active":"2024-08-18T22:28:22.912383+0000","last_peered":"2024-08-18T22:28:22.912383+0000","last_clean":"2024-08-18T22:28:22.912383+0000","last_became_active":"2024-08-18T22:28:21.687297+0000","last_became_peered":"2024-08-18T22:28:21.687297+0000","last_unstale":"2024-08-18T22:28:22.912383+0000","last_undegraded":"2024-08-18T22:28:22.912383+0000","last_fullsized":"2024-08-18T22:28:22.912383+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:35:47.878022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910986+0000","last_change":"2024-08-18T22:28:20.667271+0000","last_active":"2024-08-18T22:28:22.910986+0000","last_peered":"2024-08-18T22:28:22.910986+0000","last_clean":"2024-08-18T22:28:22.910986+0000","last_became_active":"2024-08-18T22:28:20.666128+0000","last_became_peered":"2024-08-18T22:28:20.666128+0000","last_unstale":"2024-08-18T22:28:22.910986+0000","last_undegraded":"2024-08-18T22:28:22.910986+0000","last_fullsized":"2024-08-18T22:28:22.910986+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:22:09.204790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661486+0000","last_change":"2024-08-18T22:28:21.681742+0000","last_active":"2024-08-18T22:28:22.661486+0000","last_peered":"2024-08-18T22:28:22.661486+0000","last_clean":"2024-08-18T22:28:22.661486+0000","last_became_active":"2024-08-18T22:28:21.681464+0000","last_became_peered":"2024-08-18T22:28:21.681464+0000","last_unstale":"2024-08-18T22:28:22.661486+0000","last_undegraded":"2024-08-18T22:28:22.661486+0000","last_fullsized":"2024-08-18T22:28:22.661486+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:52:38.794051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658179+0000","last_change":"2024-08-18T22:28:20.666649+0000","last_active":"2024-08-18T22:28:22.658179+0000","last_peered":"2024-08-18T22:28:22.658179+0000","last_clean":"2024-08-18T22:28:22.658179+0000","last_became_active":"2024-08-18T22:28:20.665088+0000","last_became_peered":"2024-08-18T22:28:20.665088+0000","last_unstale":"2024-08-18T22:28:22.658179+0000","last_undegraded":"2024-08-18T22:28:22.658179+0000","last_fullsized":"2024-08-18T22:28:22.658179+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:35:28.584323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910396+0000","last_change":"2024-08-18T22:28:21.669386+0000","last_active":"2024-08-18T22:28:22.910396+0000","last_peered":"2024-08-18T22:28:22.910396+0000","last_clean":"2024-08-18T22:28:22.910396+0000","last_became_active":"2024-08-18T22:28:21.669090+0000","last_became_peered":"2024-08-18T22:28:21.669090+0000","last_unstale":"2024-08-18T22:28:22.910396+0000","last_undegraded":"2024-08-18T22:28:22.910396+0000","last_fullsized":"2024-08-18T22:28:22.910396+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:40.634418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909271+0000","last_change":"2024-08-18T22:28:20.665188+0000","last_active":"2024-08-18T22:28:22.909271+0000","last_peered":"2024-08-18T22:28:22.909271+0000","last_clean":"2024-08-18T22:28:22.909271+0000","last_became_active":"2024-08-18T22:28:20.664926+0000","last_became_peered":"2024-08-18T22:28:20.664926+0000","last_unstale":"2024-08-18T22:28:22.909271+0000","last_undegraded":"2024-08-18T22:28:22.909271+0000","last_fullsized":"2024-08-18T22:28:22.909271+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:13.805157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911104+0000","last_change":"2024-08-18T22:28:21.678188+0000","last_active":"2024-08-18T22:28:22.911104+0000","last_peered":"2024-08-18T22:28:22.911104+0000","last_clean":"2024-08-18T22:28:22.911104+0000","last_became_active":"2024-08-18T22:28:21.677917+0000","last_became_peered":"2024-08-18T22:28:21.677917+0000","last_unstale":"2024-08-18T22:28:22.911104+0000","last_undegraded":"2024-08-18T22:28:22.911104+0000","last_fullsized":"2024-08-18T22:28:22.911104+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:29.727874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912642+0000","last_change":"2024-08-18T22:28:20.678188+0000","last_active":"2024-08-18T22:28:22.912642+0000","last_peered":"2024-08-18T22:28:22.912642+0000","last_clean":"2024-08-18T22:28:22.912642+0000","last_became_active":"2024-08-18T22:28:20.677872+0000","last_became_peered":"2024-08-18T22:28:20.677872+0000","last_unstale":"2024-08-18T22:28:22.912642+0000","last_undegraded":"2024-08-18T22:28:22.912642+0000","last_fullsized":"2024-08-18T22:28:22.912642+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:02:08.564370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658224+0000","last_change":"2024-08-18T22:28:21.672801+0000","last_active":"2024-08-18T22:28:22.658224+0000","last_peered":"2024-08-18T22:28:22.658224+0000","last_clean":"2024-08-18T22:28:22.658224+0000","last_became_active":"2024-08-18T22:28:21.671880+0000","last_became_peered":"2024-08-18T22:28:21.671880+0000","last_unstale":"2024-08-18T22:28:22.658224+0000","last_undegraded":"2024-08-18T22:28:22.658224+0000","last_fullsized":"2024-08-18T22:28:22.658224+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:46.693220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"140'3","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661228+0000","last_change":"2024-08-18T22:28:20.671106+0000","last_active":"2024-08-18T22:28:22.661228+0000","last_peered":"2024-08-18T22:28:22.661228+0000","last_clean":"2024-08-18T22:28:22.661228+0000","last_became_active":"2024-08-18T22:28:20.670355+0000","last_became_peered":"2024-08-18T22:28:20.670355+0000","last_unstale":"2024-08-18T22:28:22.661228+0000","last_undegraded":"2024-08-18T22:28:22.661228+0000","last_fullsized":"2024-08-18T22:28:22.661228+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:47:05.357374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658607+0000","last_change":"2024-08-18T22:28:21.669609+0000","last_active":"2024-08-18T22:28:22.658607+0000","last_peered":"2024-08-18T22:28:22.658607+0000","last_clean":"2024-08-18T22:28:22.658607+0000","last_became_active":"2024-08-18T22:28:21.669314+0000","last_became_peered":"2024-08-18T22:28:21.669314+0000","last_unstale":"2024-08-18T22:28:22.658607+0000","last_undegraded":"2024-08-18T22:28:22.658607+0000","last_fullsized":"2024-08-18T22:28:22.658607+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:15:35.890418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"140'6","reported_seq":20,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660925+0000","last_change":"2024-08-18T22:28:20.676391+0000","last_active":"2024-08-18T22:28:22.660925+0000","last_peered":"2024-08-18T22:28:22.660925+0000","last_clean":"2024-08-18T22:28:22.660925+0000","last_became_active":"2024-08-18T22:28:20.676041+0000","last_became_peered":"2024-08-18T22:28:20.676041+0000","last_unstale":"2024-08-18T22:28:22.660925+0000","last_undegraded":"2024-08-18T22:28:22.660925+0000","last_fullsized":"2024-08-18T22:28:22.660925+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:29.748122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911173+0000","last_change":"2024-08-18T22:28:21.687319+0000","last_active":"2024-08-18T22:28:22.911173+0000","last_peered":"2024-08-18T22:28:22.911173+0000","last_clean":"2024-08-18T22:28:22.911173+0000","last_became_active":"2024-08-18T22:28:21.687043+0000","last_became_peered":"2024-08-18T22:28:21.687043+0000","last_unstale":"2024-08-18T22:28:22.911173+0000","last_undegraded":"2024-08-18T22:28:22.911173+0000","last_fullsized":"2024-08-18T22:28:22.911173+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:56.385939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911905+0000","last_change":"2024-08-18T22:28:20.674165+0000","last_active":"2024-08-18T22:28:22.911905+0000","last_peered":"2024-08-18T22:28:22.911905+0000","last_clean":"2024-08-18T22:28:22.911905+0000","last_became_active":"2024-08-18T22:28:20.673876+0000","last_became_peered":"2024-08-18T22:28:20.673876+0000","last_unstale":"2024-08-18T22:28:22.911905+0000","last_undegraded":"2024-08-18T22:28:22.911905+0000","last_fullsized":"2024-08-18T22:28:22.911905+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:24:27.745674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661487+0000","last_change":"2024-08-18T22:28:21.677158+0000","last_active":"2024-08-18T22:28:22.661487+0000","last_peered":"2024-08-18T22:28:22.661487+0000","last_clean":"2024-08-18T22:28:22.661487+0000","last_became_active":"2024-08-18T22:28:21.673622+0000","last_became_peered":"2024-08-18T22:28:21.673622+0000","last_unstale":"2024-08-18T22:28:22.661487+0000","last_undegraded":"2024-08-18T22:28:22.661487+0000","last_fullsized":"2024-08-18T22:28:22.661487+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:28:15.881360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.657975+0000","last_change":"2024-08-18T22:28:20.665480+0000","last_active":"2024-08-18T22:28:22.657975+0000","last_peered":"2024-08-18T22:28:22.657975+0000","last_clean":"2024-08-18T22:28:22.657975+0000","last_became_active":"2024-08-18T22:28:20.665210+0000","last_became_peered":"2024-08-18T22:28:20.665210+0000","last_unstale":"2024-08-18T22:28:22.657975+0000","last_undegraded":"2024-08-18T22:28:22.657975+0000","last_fullsized":"2024-08-18T22:28:22.657975+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:56:36.287006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912538+0000","last_change":"2024-08-18T22:28:21.679905+0000","last_active":"2024-08-18T22:28:22.912538+0000","last_peered":"2024-08-18T22:28:22.912538+0000","last_clean":"2024-08-18T22:28:22.912538+0000","last_became_active":"2024-08-18T22:28:21.679480+0000","last_became_peered":"2024-08-18T22:28:21.679480+0000","last_unstale":"2024-08-18T22:28:22.912538+0000","last_undegraded":"2024-08-18T22:28:22.912538+0000","last_fullsized":"2024-08-18T22:28:22.912538+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:28.359707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"140'8","reported_seq":22,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910787+0000","last_change":"2024-08-18T22:28:20.663870+0000","last_active":"2024-08-18T22:28:22.910787+0000","last_peered":"2024-08-18T22:28:22.910787+0000","last_clean":"2024-08-18T22:28:22.910787+0000","last_became_active":"2024-08-18T22:28:20.663582+0000","last_became_peered":"2024-08-18T22:28:20.663582+0000","last_unstale":"2024-08-18T22:28:22.910787+0000","last_undegraded":"2024-08-18T22:28:22.910787+0000","last_fullsized":"2024-08-18T22:28:22.910787+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:29:05.766222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658063+0000","last_change":"2024-08-18T22:28:21.678081+0000","last_active":"2024-08-18T22:28:22.658063+0000","last_peered":"2024-08-18T22:28:22.658063+0000","last_clean":"2024-08-18T22:28:22.658063+0000","last_became_active":"2024-08-18T22:28:21.677747+0000","last_became_peered":"2024-08-18T22:28:21.677747+0000","last_unstale":"2024-08-18T22:28:22.658063+0000","last_undegraded":"2024-08-18T22:28:22.658063+0000","last_fullsized":"2024-08-18T22:28:22.658063+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:44.306645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"140'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909280+0000","last_change":"2024-08-18T22:28:20.675662+0000","last_active":"2024-08-18T22:28:22.909280+0000","last_peered":"2024-08-18T22:28:22.909280+0000","last_clean":"2024-08-18T22:28:22.909280+0000","last_became_active":"2024-08-18T22:28:20.675348+0000","last_became_peered":"2024-08-18T22:28:20.675348+0000","last_unstale":"2024-08-18T22:28:22.909280+0000","last_undegraded":"2024-08-18T22:28:22.909280+0000","last_fullsized":"2024-08-18T22:28:22.909280+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:11:44.806765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660827+0000","last_change":"2024-08-18T22:28:21.679851+0000","last_active":"2024-08-18T22:28:22.660827+0000","last_peered":"2024-08-18T22:28:22.660827+0000","last_clean":"2024-08-18T22:28:22.660827+0000","last_became_active":"2024-08-18T22:28:21.679589+0000","last_became_peered":"2024-08-18T22:28:21.679589+0000","last_unstale":"2024-08-18T22:28:22.660827+0000","last_undegraded":"2024-08-18T22:28:22.660827+0000","last_fullsized":"2024-08-18T22:28:22.660827+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:11.790318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658731+0000","last_change":"2024-08-18T22:28:20.673720+0000","last_active":"2024-08-18T22:28:22.658731+0000","last_peered":"2024-08-18T22:28:22.658731+0000","last_clean":"2024-08-18T22:28:22.658731+0000","last_became_active":"2024-08-18T22:28:20.673351+0000","last_became_peered":"2024-08-18T22:28:20.673351+0000","last_unstale":"2024-08-18T22:28:22.658731+0000","last_undegraded":"2024-08-18T22:28:22.658731+0000","last_fullsized":"2024-08-18T22:28:22.658731+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:33.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661120+0000","last_change":"2024-08-18T22:28:21.660607+0000","last_active":"2024-08-18T22:28:22.661120+0000","last_peered":"2024-08-18T22:28:22.661120+0000","last_clean":"2024-08-18T22:28:22.661120+0000","last_became_active":"2024-08-18T22:28:21.660204+0000","last_became_peered":"2024-08-18T22:28:21.660204+0000","last_unstale":"2024-08-18T22:28:22.661120+0000","last_undegraded":"2024-08-18T22:28:22.661120+0000","last_fullsized":"2024-08-18T22:28:22.661120+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:04.958449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"140'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911590+0000","last_change":"2024-08-18T22:28:20.673057+0000","last_active":"2024-08-18T22:28:22.911590+0000","last_peered":"2024-08-18T22:28:22.911590+0000","last_clean":"2024-08-18T22:28:22.911590+0000","last_became_active":"2024-08-18T22:28:20.672808+0000","last_became_peered":"2024-08-18T22:28:20.672808+0000","last_unstale":"2024-08-18T22:28:22.911590+0000","last_undegraded":"2024-08-18T22:28:22.911590+0000","last_fullsized":"2024-08-18T22:28:22.911590+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:10.084272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910734+0000","last_change":"2024-08-18T22:28:21.680244+0000","last_active":"2024-08-18T22:28:22.910734+0000","last_peered":"2024-08-18T22:28:22.910734+0000","last_clean":"2024-08-18T22:28:22.910734+0000","last_became_active":"2024-08-18T22:28:21.679958+0000","last_became_peered":"2024-08-18T22:28:21.679958+0000","last_unstale":"2024-08-18T22:28:22.910734+0000","last_undegraded":"2024-08-18T22:28:22.910734+0000","last_fullsized":"2024-08-18T22:28:22.910734+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:14.016086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912559+0000","last_change":"2024-08-18T22:28:20.675159+0000","last_active":"2024-08-18T22:28:22.912559+0000","last_peered":"2024-08-18T22:28:22.912559+0000","last_clean":"2024-08-18T22:28:22.912559+0000","last_became_active":"2024-08-18T22:28:20.674184+0000","last_became_peered":"2024-08-18T22:28:20.674184+0000","last_unstale":"2024-08-18T22:28:22.912559+0000","last_undegraded":"2024-08-18T22:28:22.912559+0000","last_fullsized":"2024-08-18T22:28:22.912559+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:10:14.848574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912465+0000","last_change":"2024-08-18T22:28:21.691407+0000","last_active":"2024-08-18T22:28:22.912465+0000","last_peered":"2024-08-18T22:28:22.912465+0000","last_clean":"2024-08-18T22:28:22.912465+0000","last_became_active":"2024-08-18T22:28:21.690292+0000","last_became_peered":"2024-08-18T22:28:21.690292+0000","last_unstale":"2024-08-18T22:28:22.912465+0000","last_undegraded":"2024-08-18T22:28:22.912465+0000","last_fullsized":"2024-08-18T22:28:22.912465+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:18.569634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659510+0000","last_change":"2024-08-18T22:28:20.668430+0000","last_active":"2024-08-18T22:28:22.659510+0000","last_peered":"2024-08-18T22:28:22.659510+0000","last_clean":"2024-08-18T22:28:22.659510+0000","last_became_active":"2024-08-18T22:28:20.668158+0000","last_became_peered":"2024-08-18T22:28:20.668158+0000","last_unstale":"2024-08-18T22:28:22.659510+0000","last_undegraded":"2024-08-18T22:28:22.659510+0000","last_fullsized":"2024-08-18T22:28:22.659510+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:28.601196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912691+0000","last_change":"2024-08-18T22:28:21.681045+0000","last_active":"2024-08-18T22:28:22.912691+0000","last_peered":"2024-08-18T22:28:22.912691+0000","last_clean":"2024-08-18T22:28:22.912691+0000","last_became_active":"2024-08-18T22:28:21.673672+0000","last_became_peered":"2024-08-18T22:28:21.673672+0000","last_unstale":"2024-08-18T22:28:22.912691+0000","last_undegraded":"2024-08-18T22:28:22.912691+0000","last_fullsized":"2024-08-18T22:28:22.912691+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:39.470940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911835+0000","last_change":"2024-08-18T22:28:20.674409+0000","last_active":"2024-08-18T22:28:22.911835+0000","last_peered":"2024-08-18T22:28:22.911835+0000","last_clean":"2024-08-18T22:28:22.911835+0000","last_became_active":"2024-08-18T22:28:20.673769+0000","last_became_peered":"2024-08-18T22:28:20.673769+0000","last_unstale":"2024-08-18T22:28:22.911835+0000","last_undegraded":"2024-08-18T22:28:22.911835+0000","last_fullsized":"2024-08-18T22:28:22.911835+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:00:50.485369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912560+0000","last_change":"2024-08-18T22:28:21.679252+0000","last_active":"2024-08-18T22:28:22.912560+0000","last_peered":"2024-08-18T22:28:22.912560+0000","last_clean":"2024-08-18T22:28:22.912560+0000","last_became_active":"2024-08-18T22:28:21.678985+0000","last_became_peered":"2024-08-18T22:28:21.678985+0000","last_unstale":"2024-08-18T22:28:22.912560+0000","last_undegraded":"2024-08-18T22:28:22.912560+0000","last_fullsized":"2024-08-18T22:28:22.912560+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:42.232356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660794+0000","last_change":"2024-08-18T22:28:20.675610+0000","last_active":"2024-08-18T22:28:22.660794+0000","last_peered":"2024-08-18T22:28:22.660794+0000","last_clean":"2024-08-18T22:28:22.660794+0000","last_became_active":"2024-08-18T22:28:20.675331+0000","last_became_peered":"2024-08-18T22:28:20.675331+0000","last_unstale":"2024-08-18T22:28:22.660794+0000","last_undegraded":"2024-08-18T22:28:22.660794+0000","last_fullsized":"2024-08-18T22:28:22.660794+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:10:03.141004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.909210+0000","last_change":"2024-08-18T22:28:21.677776+0000","last_active":"2024-08-18T22:28:22.909210+0000","last_peered":"2024-08-18T22:28:22.909210+0000","last_clean":"2024-08-18T22:28:22.909210+0000","last_became_active":"2024-08-18T22:28:21.677330+0000","last_became_peered":"2024-08-18T22:28:21.677330+0000","last_unstale":"2024-08-18T22:28:22.909210+0000","last_undegraded":"2024-08-18T22:28:22.909210+0000","last_fullsized":"2024-08-18T22:28:22.909210+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:16.877073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910884+0000","last_change":"2024-08-18T22:28:20.673091+0000","last_active":"2024-08-18T22:28:22.910884+0000","last_peered":"2024-08-18T22:28:22.910884+0000","last_clean":"2024-08-18T22:28:22.910884+0000","last_became_active":"2024-08-18T22:28:20.672769+0000","last_became_peered":"2024-08-18T22:28:20.672769+0000","last_unstale":"2024-08-18T22:28:22.910884+0000","last_undegraded":"2024-08-18T22:28:22.910884+0000","last_fullsized":"2024-08-18T22:28:22.910884+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:31:19.203695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910971+0000","last_change":"2024-08-18T22:28:21.678024+0000","last_active":"2024-08-18T22:28:22.910971+0000","last_peered":"2024-08-18T22:28:22.910971+0000","last_clean":"2024-08-18T22:28:22.910971+0000","last_became_active":"2024-08-18T22:28:21.677514+0000","last_became_peered":"2024-08-18T22:28:21.677514+0000","last_unstale":"2024-08-18T22:28:22.910971+0000","last_undegraded":"2024-08-18T22:28:22.910971+0000","last_fullsized":"2024-08-18T22:28:22.910971+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:52:38.794051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"140'2","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.912758+0000","last_change":"2024-08-18T22:28:20.670277+0000","last_active":"2024-08-18T22:28:22.912758+0000","last_peered":"2024-08-18T22:28:22.912758+0000","last_clean":"2024-08-18T22:28:22.912758+0000","last_became_active":"2024-08-18T22:28:20.669870+0000","last_became_peered":"2024-08-18T22:28:20.669870+0000","last_unstale":"2024-08-18T22:28:22.912758+0000","last_undegraded":"2024-08-18T22:28:22.912758+0000","last_fullsized":"2024-08-18T22:28:22.912758+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:18:54.611820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.657984+0000","last_change":"2024-08-18T22:28:21.673919+0000","last_active":"2024-08-18T22:28:22.657984+0000","last_peered":"2024-08-18T22:28:22.657984+0000","last_clean":"2024-08-18T22:28:22.657984+0000","last_became_active":"2024-08-18T22:28:21.673664+0000","last_became_peered":"2024-08-18T22:28:21.673664+0000","last_unstale":"2024-08-18T22:28:22.657984+0000","last_undegraded":"2024-08-18T22:28:22.657984+0000","last_fullsized":"2024-08-18T22:28:22.657984+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:09:01.125607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"141'1","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659913+0000","last_change":"2024-08-18T22:28:20.670267+0000","last_active":"2024-08-18T22:28:22.659913+0000","last_peered":"2024-08-18T22:28:22.659913+0000","last_clean":"2024-08-18T22:28:22.659913+0000","last_became_active":"2024-08-18T22:28:20.669380+0000","last_became_peered":"2024-08-18T22:28:20.669380+0000","last_unstale":"2024-08-18T22:28:22.659913+0000","last_undegraded":"2024-08-18T22:28:22.659913+0000","last_fullsized":"2024-08-18T22:28:22.659913+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:08.610701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660763+0000","last_change":"2024-08-18T22:28:21.670932+0000","last_active":"2024-08-18T22:28:22.660763+0000","last_peered":"2024-08-18T22:28:22.660763+0000","last_clean":"2024-08-18T22:28:22.660763+0000","last_became_active":"2024-08-18T22:28:21.670646+0000","last_became_peered":"2024-08-18T22:28:21.670646+0000","last_unstale":"2024-08-18T22:28:22.660763+0000","last_undegraded":"2024-08-18T22:28:22.660763+0000","last_fullsized":"2024-08-18T22:28:22.660763+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:22:30.840214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.659626+0000","last_change":"2024-08-18T22:28:20.672206+0000","last_active":"2024-08-18T22:28:22.659626+0000","last_peered":"2024-08-18T22:28:22.659626+0000","last_clean":"2024-08-18T22:28:22.659626+0000","last_became_active":"2024-08-18T22:28:20.671916+0000","last_became_peered":"2024-08-18T22:28:20.671916+0000","last_unstale":"2024-08-18T22:28:22.659626+0000","last_undegraded":"2024-08-18T22:28:22.659626+0000","last_fullsized":"2024-08-18T22:28:22.659626+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:18.950965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.910868+0000","last_change":"2024-08-18T22:28:21.683803+0000","last_active":"2024-08-18T22:28:22.910868+0000","last_peered":"2024-08-18T22:28:22.910868+0000","last_clean":"2024-08-18T22:28:22.910868+0000","last_became_active":"2024-08-18T22:28:21.683492+0000","last_became_peered":"2024-08-18T22:28:21.683492+0000","last_unstale":"2024-08-18T22:28:22.910868+0000","last_undegraded":"2024-08-18T22:28:22.910868+0000","last_fullsized":"2024-08-18T22:28:22.910868+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:35:36.647886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911510+0000","last_change":"2024-08-18T22:28:20.676058+0000","last_active":"2024-08-18T22:28:22.911510+0000","last_peered":"2024-08-18T22:28:22.911510+0000","last_clean":"2024-08-18T22:28:22.911510+0000","last_became_active":"2024-08-18T22:28:20.673389+0000","last_became_peered":"2024-08-18T22:28:20.673389+0000","last_unstale":"2024-08-18T22:28:22.911510+0000","last_undegraded":"2024-08-18T22:28:22.911510+0000","last_fullsized":"2024-08-18T22:28:22.911510+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:44:38.688122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911903+0000","last_change":"2024-08-18T22:28:21.671212+0000","last_active":"2024-08-18T22:28:22.911903+0000","last_peered":"2024-08-18T22:28:22.911903+0000","last_clean":"2024-08-18T22:28:22.911903+0000","last_became_active":"2024-08-18T22:28:21.670485+0000","last_became_peered":"2024-08-18T22:28:21.670485+0000","last_unstale":"2024-08-18T22:28:22.911903+0000","last_undegraded":"2024-08-18T22:28:22.911903+0000","last_fullsized":"2024-08-18T22:28:22.911903+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:10:04.144329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.908851+0000","last_change":"2024-08-18T22:28:20.672810+0000","last_active":"2024-08-18T22:28:22.908851+0000","last_peered":"2024-08-18T22:28:22.908851+0000","last_clean":"2024-08-18T22:28:22.908851+0000","last_became_active":"2024-08-18T22:28:20.672297+0000","last_became_peered":"2024-08-18T22:28:20.672297+0000","last_unstale":"2024-08-18T22:28:22.908851+0000","last_undegraded":"2024-08-18T22:28:22.908851+0000","last_fullsized":"2024-08-18T22:28:22.908851+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:49.615648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911487+0000","last_change":"2024-08-18T22:28:21.684817+0000","last_active":"2024-08-18T22:28:22.911487+0000","last_peered":"2024-08-18T22:28:22.911487+0000","last_clean":"2024-08-18T22:28:22.911487+0000","last_became_active":"2024-08-18T22:28:21.684531+0000","last_became_peered":"2024-08-18T22:28:21.684531+0000","last_unstale":"2024-08-18T22:28:22.911487+0000","last_undegraded":"2024-08-18T22:28:22.911487+0000","last_fullsized":"2024-08-18T22:28:22.911487+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:09:01.125607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661231+0000","last_change":"2024-08-18T22:28:20.670969+0000","last_active":"2024-08-18T22:28:22.661231+0000","last_peered":"2024-08-18T22:28:22.661231+0000","last_clean":"2024-08-18T22:28:22.661231+0000","last_became_active":"2024-08-18T22:28:20.670023+0000","last_became_peered":"2024-08-18T22:28:20.670023+0000","last_unstale":"2024-08-18T22:28:22.661231+0000","last_undegraded":"2024-08-18T22:28:22.661231+0000","last_fullsized":"2024-08-18T22:28:22.661231+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:15:44.807841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911456+0000","last_change":"2024-08-18T22:28:21.666414+0000","last_active":"2024-08-18T22:28:22.911456+0000","last_peered":"2024-08-18T22:28:22.911456+0000","last_clean":"2024-08-18T22:28:22.911456+0000","last_became_active":"2024-08-18T22:28:21.663859+0000","last_became_peered":"2024-08-18T22:28:21.663859+0000","last_unstale":"2024-08-18T22:28:22.911456+0000","last_undegraded":"2024-08-18T22:28:22.911456+0000","last_fullsized":"2024-08-18T22:28:22.911456+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:30.163352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911087+0000","last_change":"2024-08-18T22:28:20.674742+0000","last_active":"2024-08-18T22:28:22.911087+0000","last_peered":"2024-08-18T22:28:22.911087+0000","last_clean":"2024-08-18T22:28:22.911087+0000","last_became_active":"2024-08-18T22:28:20.671162+0000","last_became_peered":"2024-08-18T22:28:20.671162+0000","last_unstale":"2024-08-18T22:28:22.911087+0000","last_undegraded":"2024-08-18T22:28:22.911087+0000","last_fullsized":"2024-08-18T22:28:22.911087+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:12:34.230853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.661534+0000","last_change":"2024-08-18T22:28:21.671225+0000","last_active":"2024-08-18T22:28:22.661534+0000","last_peered":"2024-08-18T22:28:22.661534+0000","last_clean":"2024-08-18T22:28:22.661534+0000","last_became_active":"2024-08-18T22:28:21.670933+0000","last_became_peered":"2024-08-18T22:28:21.670933+0000","last_unstale":"2024-08-18T22:28:22.661534+0000","last_undegraded":"2024-08-18T22:28:22.661534+0000","last_fullsized":"2024-08-18T22:28:22.661534+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:33:30.124597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.911115+0000","last_change":"2024-08-18T22:28:20.663292+0000","last_active":"2024-08-18T22:28:22.911115+0000","last_peered":"2024-08-18T22:28:22.911115+0000","last_clean":"2024-08-18T22:28:22.911115+0000","last_became_active":"2024-08-18T22:28:20.662999+0000","last_became_peered":"2024-08-18T22:28:20.662999+0000","last_unstale":"2024-08-18T22:28:22.911115+0000","last_undegraded":"2024-08-18T22:28:22.911115+0000","last_fullsized":"2024-08-18T22:28:22.911115+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:50:30.463983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.658722+0000","last_change":"2024-08-18T22:28:21.680589+0000","last_active":"2024-08-18T22:28:22.658722+0000","last_peered":"2024-08-18T22:28:22.658722+0000","last_clean":"2024-08-18T22:28:22.658722+0000","last_became_active":"2024-08-18T22:28:21.680305+0000","last_became_peered":"2024-08-18T22:28:21.680305+0000","last_unstale":"2024-08-18T22:28:22.658722+0000","last_undegraded":"2024-08-18T22:28:22.658722+0000","last_fullsized":"2024-08-18T22:28:22.658722+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:20.643923+0000","last_clean_scrub_stamp":"2024-08-18T22:28:20.643923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:05:30.751448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660963+0000","last_change":"2024-08-18T22:28:20.676508+0000","last_active":"2024-08-18T22:28:22.660963+0000","last_peered":"2024-08-18T22:28:22.660963+0000","last_clean":"2024-08-18T22:28:22.660963+0000","last_became_active":"2024-08-18T22:28:20.676206+0000","last_became_peered":"2024-08-18T22:28:20.676206+0000","last_unstale":"2024-08-18T22:28:22.660963+0000","last_undegraded":"2024-08-18T22:28:22.660963+0000","last_fullsized":"2024-08-18T22:28:22.660963+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:28:19.640597+0000","last_clean_scrub_stamp":"2024-08-18T22:28:19.640597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:45.689894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":414,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-08-18T22:28:22.660428+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:28:22.660428+0000","last_peered":"2024-08-18T22:28:22.660428+0000","last_clean":"2024-08-18T22:28:22.660428+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:28:22.660428+0000","last_undegraded":"2024-08-18T22:28:22.660428+0000","last_fullsized":"2024-08-18T22:28:22.660428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":2363392,"data_stored":1418294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509556,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46792,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325048,"statfs":{"total":96636764160,"available":96588849152,"internally_reserved":0,"allocated":1761280,"data_stored":826896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509554,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46788,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325052,"statfs":{"total":96636764160,"available":96588853248,"internally_reserved":0,"allocated":1757184,"data_stored":826246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509555,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55120,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316720,"statfs":{"total":96636764160,"available":96580321280,"internally_reserved":0,"allocated":1769472,"data_stored":827906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509554,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55104,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316736,"statfs":{"total":96636764160,"available":96580337664,"internally_reserved":0,"allocated":1757184,"data_stored":826294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509555,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51528,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320312,"statfs":{"total":96636764160,"available":96583999488,"internally_reserved":0,"allocated":2355200,"data_stored":1416648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50944,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320896,"statfs":{"total":96636764160,"available":96584597504,"internally_reserved":0,"allocated":1753088,"data_stored":826224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55116,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316724,"statfs":{"total":96636764160,"available":96580325376,"internally_reserved":0,"allocated":1761280,"data_stored":826840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:28:26.186 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:28:26.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:28:26.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.375+0000 7f9621200640 1 Processor -- start 2024-08-18T22:28:26.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.375+0000 7f9621200640 1 -- start start 2024-08-18T22:28:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9621200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f961c15c180 0x7f961c0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9621200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f961c15d4d0 0x7f961c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9621200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c0cfb00 con 0x7f961c15c560 2024-08-18T22:28:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9621200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f961c15d040 con 0x7f961c15c180 2024-08-18T22:28:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9621200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f961c15c9f0 con 0x7f961c15d4d0 2024-08-18T22:28:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9619e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f961c15c180 0x7f961c0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9619400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f961c15c560 0x7f961c0ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34054/0 (socket says 172.21.15.5:34054) 2024-08-18T22:28:26.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9619400640 1 -- 172.21.15.5:0/3481628115 learned_addr learned my addr 172.21.15.5:0/3481628115 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f961a800640 1 --2- 172.21.15.5:0/3481628115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f961c15d4d0 0x7f961c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9619e00640 1 -- 172.21.15.5:0/3481628115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f961c15d4d0 msgr2=0x7f961c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9619e00640 1 --2- 172.21.15.5:0/3481628115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f961c15d4d0 0x7f961c06db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9619e00640 1 -- 172.21.15.5:0/3481628115 >> v1:172.21.15.5:6789/0 conn(0x7f961c15c560 legacy=0x7f961c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9619e00640 1 -- 172.21.15.5:0/3481628115 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c15ccd0 con 0x7f961c15c180 2024-08-18T22:28:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.379+0000 7f9619e00640 1 --2- 172.21.15.5:0/3481628115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c15c180 0x7f961c0cdf10 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f960c009d90 tx=0x7f960c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6d589e35f788d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:26.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9618a00640 1 -- 172.21.15.5:0/3481628115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c0b2070 con 0x7f961c15c180 2024-08-18T22:28:26.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9618a00640 1 -- 172.21.15.5:0/3481628115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f961c0ced70 con 0x7f961c15c180 2024-08-18T22:28:26.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9618a00640 1 -- 172.21.15.5:0/3481628115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c0a5be0 con 0x7f961c15c180 2024-08-18T22:28:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 -- 172.21.15.5:0/3481628115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c15c180 msgr2=0x7f961c0cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 --2- 172.21.15.5:0/3481628115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c15c180 0x7f961c0cdf10 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f960c009d90 tx=0x7f960c01c8e0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 -- 172.21.15.5:0/3481628115 shutdown_connections 2024-08-18T22:28:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 --2- 172.21.15.5:0/3481628115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f961c15d4d0 0x7f961c06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 --2- 172.21.15.5:0/3481628115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c15c180 0x7f961c0cdf10 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 -- 172.21.15.5:0/3481628115 >> 172.21.15.5:0/3481628115 conn(0x7f961c0b1dc0 msgr2=0x7f961c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 -- 172.21.15.5:0/3481628115 shutdown_connections 2024-08-18T22:28:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 -- 172.21.15.5:0/3481628115 wait complete. 2024-08-18T22:28:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 Processor -- start 2024-08-18T22:28:26.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 -- start start 2024-08-18T22:28:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f961c15c180 0x7f961c0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c15d4d0 0x7f961c14d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f961c151ba0 0x7f961c14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f961c1692b0 con 0x7f961c15d4d0 2024-08-18T22:28:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f961c169130 con 0x7f961c15c180 2024-08-18T22:28:26.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9621200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f961c169430 con 0x7f961c151ba0 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9619400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c15d4d0 0x7f961c14d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9619400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c15d4d0 0x7f961c14d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37348/0 (socket says 172.21.15.5:37348) 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.383+0000 7f9619400640 1 -- 172.21.15.5:0/2762099166 learned_addr learned my addr 172.21.15.5:0/2762099166 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f961a800640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f961c151ba0 0x7f961c14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9619e00640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f961c15c180 0x7f961c0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9619400640 1 -- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f961c151ba0 msgr2=0x7f961c14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9619400640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f961c151ba0 0x7f961c14eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9619400640 1 -- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f961c15c180 msgr2=0x7f961c0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9619400640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f961c15c180 0x7f961c0cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9619400640 1 -- 172.21.15.5:0/2762099166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c14e1e0 con 0x7f961c15d4d0 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9619400640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c15d4d0 0x7f961c14d650 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f960800c420 tx=0x7f960800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9612000640 1 -- 172.21.15.5:0/2762099166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608017070 con 0x7f961c15d4d0 2024-08-18T22:28:26.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9612000640 1 -- 172.21.15.5:0/2762099166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9608005cf0 con 0x7f961c15d4d0 2024-08-18T22:28:26.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9621200640 1 -- 172.21.15.5:0/2762099166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961c14e6c0 con 0x7f961c15d4d0 2024-08-18T22:28:26.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9612000640 1 -- 172.21.15.5:0/2762099166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96080072f0 con 0x7f961c15d4d0 2024-08-18T22:28:26.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9621200640 1 -- 172.21.15.5:0/2762099166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f961c151090 con 0x7f961c15d4d0 2024-08-18T22:28:26.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9621200640 1 -- 172.21.15.5:0/2762099166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f961c072560 con 0x7f961c15d4d0 2024-08-18T22:28:26.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9612000640 1 -- 172.21.15.5:0/2762099166 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f960801a070 con 0x7f961c15d4d0 2024-08-18T22:28:26.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9612000640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95fc0678c0 0x7f95fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.387+0000 7f9612000640 1 -- 172.21.15.5:0/2762099166 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f96080851a0 con 0x7f961c15d4d0 2024-08-18T22:28:26.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.391+0000 7f9619e00640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95fc0678c0 0x7f95fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.391+0000 7f9619e00640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95fc0678c0 0x7f95fc069d80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f960c0af000 tx=0x7f960c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:26.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.391+0000 7f9612000640 1 -- 172.21.15.5:0/2762099166 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f961c14e1e0 con 0x7f961c15d4d0 2024-08-18T22:28:26.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.615+0000 7f9621200640 1 -- 172.21.15.5:0/2762099166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f961c14e890 con 0x7f961c15d4d0 2024-08-18T22:28:26.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.619+0000 7f9612000640 1 -- 172.21.15.5:0/2762099166 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f9608055460 con 0x7f961c15d4d0 2024-08-18T22:28:26.622 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:28:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:28:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:28:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:28:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:28:26.622 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:28:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 -- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95fc0678c0 msgr2=0x7f95fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95fc0678c0 0x7f95fc069d80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f960c0af000 tx=0x7f960c0a7070 comp rx=0 tx=0).stop 2024-08-18T22:28:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 -- 172.21.15.5:0/2762099166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c15d4d0 msgr2=0x7f961c14d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c15d4d0 0x7f961c14d650 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f960800c420 tx=0x7f960800c820 comp rx=0 tx=0).stop 2024-08-18T22:28:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 -- 172.21.15.5:0/2762099166 shutdown_connections 2024-08-18T22:28:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f95fc0678c0 0x7f95fc069d80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f961c151ba0 0x7f961c14eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c15d4d0 0x7f961c14d650 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 --2- 172.21.15.5:0/2762099166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f961c15c180 0x7f961c0cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 -- 172.21.15.5:0/2762099166 >> 172.21.15.5:0/2762099166 conn(0x7f961c0b1dc0 msgr2=0x7f961c0ad680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 -- 172.21.15.5:0/2762099166 shutdown_connections 2024-08-18T22:28:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.623+0000 7f9621200640 1 -- 172.21.15.5:0/2762099166 wait complete. 2024-08-18T22:28:26.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:26.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae8d000640 1 Processor -- start 2024-08-18T22:28:26.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae8d000640 1 -- start start 2024-08-18T22:28:26.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae8d000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae88070510 0x7fae8809b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae8d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae8815f130 0x7fae880708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae8d000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae88070e30 con 0x7fae880d02a0 2024-08-18T22:28:26.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae8d000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fae8806fe70 con 0x7fae88070510 2024-08-18T22:28:26.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae8d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fae88070150 con 0x7fae8815f130 2024-08-18T22:28:26.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae87400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae88070510 0x7fae8809b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae86a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae8815f130 0x7fae880708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae87e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fae880d02a0 0x7fae880d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:39956/0 (socket says 172.21.15.5:39956) 2024-08-18T22:28:26.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae87e00640 1 -- 172.21.15.5:0/752197686 learned_addr learned my addr 172.21.15.5:0/752197686 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:26.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae87400640 1 -- 172.21.15.5:0/752197686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae8815f130 msgr2=0x7fae880708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:26.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae87400640 1 --2- 172.21.15.5:0/752197686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae8815f130 0x7fae880708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae87400640 1 -- 172.21.15.5:0/752197686 >> v1:172.21.15.117:6789/0 conn(0x7fae880d02a0 legacy=0x7fae880d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae87400640 1 -- 172.21.15.5:0/752197686 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8809aa40 con 0x7fae88070510 2024-08-18T22:28:26.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae86000640 1 -- 172.21.15.5:0/752197686 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078728878 0 0) 0x7fae88070e30 con 0x7fae880d02a0 2024-08-18T22:28:26.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.787+0000 7fae86a00640 1 --2- 172.21.15.5:0/752197686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae8815f130 0x7fae880708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:26.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae87400640 1 --2- 172.21.15.5:0/752197686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae88070510 0x7fae8809b520 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fae78009d90 tx=0x7fae7801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=848091cf97c9a7f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:26.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae86000640 1 -- 172.21.15.5:0/752197686 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780b2070 con 0x7fae88070510 2024-08-18T22:28:26.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae86000640 1 -- 172.21.15.5:0/752197686 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae780a5830 con 0x7fae88070510 2024-08-18T22:28:26.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae86000640 1 -- 172.21.15.5:0/752197686 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780a5c00 con 0x7fae88070510 2024-08-18T22:28:26.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae8d000640 1 -- 172.21.15.5:0/752197686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae88070510 msgr2=0x7fae8809b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae8d000640 1 --2- 172.21.15.5:0/752197686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae88070510 0x7fae8809b520 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fae78009d90 tx=0x7fae7801c970 comp rx=0 tx=0).stop 2024-08-18T22:28:26.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae8d000640 1 -- 172.21.15.5:0/752197686 shutdown_connections 2024-08-18T22:28:26.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae8d000640 1 --2- 172.21.15.5:0/752197686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae8815f130 0x7fae880708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae8d000640 1 --2- 172.21.15.5:0/752197686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae88070510 0x7fae8809b520 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae8d000640 1 -- 172.21.15.5:0/752197686 >> 172.21.15.5:0/752197686 conn(0x7fae880b3a20 msgr2=0x7fae880b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:26.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae8d000640 1 -- 172.21.15.5:0/752197686 shutdown_connections 2024-08-18T22:28:26.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae8d000640 1 -- 172.21.15.5:0/752197686 wait complete. 2024-08-18T22:28:26.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.791+0000 7fae8d000640 1 Processor -- start 2024-08-18T22:28:26.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae8d000640 1 -- start start 2024-08-18T22:28:26.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae8d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae88070510 0x7fae881524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae8d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae880d02a0 0x7fae880c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae8d000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8815f130 0x7fae880c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae8d000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fae8815f690 con 0x7fae88070510 2024-08-18T22:28:26.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae8d000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fae8815f510 con 0x7fae8815f130 2024-08-18T22:28:26.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae8d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fae880b46d0 con 0x7fae880d02a0 2024-08-18T22:28:26.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae87400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae88070510 0x7fae881524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae87400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae88070510 0x7fae881524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37358/0 (socket says 172.21.15.5:37358) 2024-08-18T22:28:26.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae87400640 1 -- 172.21.15.5:0/801393211 learned_addr learned my addr 172.21.15.5:0/801393211 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:26.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae87e00640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8815f130 0x7fae880c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae86a00640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae880d02a0 0x7fae880c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae87400640 1 -- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae880d02a0 msgr2=0x7fae880c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae87400640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae880d02a0 0x7fae880c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae87400640 1 -- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8815f130 msgr2=0x7fae880c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:26.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae87400640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8815f130 0x7fae880c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:26.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae87400640 1 -- 172.21.15.5:0/801393211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae88157960 con 0x7fae88070510 2024-08-18T22:28:26.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae87e00640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8815f130 0x7fae880c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:26.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae86a00640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae880d02a0 0x7fae880c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:26.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae87400640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae88070510 0x7fae881524c0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fae7801a5a0 tx=0x7fae78019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:26.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae7f400640 1 -- 172.21.15.5:0/801393211 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780bd020 con 0x7fae88070510 2024-08-18T22:28:26.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae7f400640 1 -- 172.21.15.5:0/801393211 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae780b8470 con 0x7fae88070510 2024-08-18T22:28:26.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae7f400640 1 -- 172.21.15.5:0/801393211 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780b2040 con 0x7fae88070510 2024-08-18T22:28:26.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae8d000640 1 -- 172.21.15.5:0/801393211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae88157c40 con 0x7fae88070510 2024-08-18T22:28:26.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae8d000640 1 -- 172.21.15.5:0/801393211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae880af3a0 con 0x7fae88070510 2024-08-18T22:28:26.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.795+0000 7fae8d000640 1 -- 172.21.15.5:0/801393211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae8809b520 con 0x7fae88070510 2024-08-18T22:28:26.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.799+0000 7fae7f400640 1 -- 172.21.15.5:0/801393211 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae780c0020 con 0x7fae88070510 2024-08-18T22:28:26.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.799+0000 7fae7f400640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae680678c0 0x7fae68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:26.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.799+0000 7fae7f400640 1 -- 172.21.15.5:0/801393211 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7fae78120ce0 con 0x7fae88070510 2024-08-18T22:28:26.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.799+0000 7fae86a00640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae680678c0 0x7fae68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.799+0000 7fae86a00640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae680678c0 0x7fae68069d80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fae880b3180 tx=0x7fae74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:26.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:26.803+0000 7fae7f400640 1 -- 172.21.15.5:0/801393211 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fae780c7030 con 0x7fae88070510 2024-08-18T22:28:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 -- 172.21.15.5:0/801393211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae88073d40 con 0x7fae88070510 2024-08-18T22:28:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae7f400640 1 -- 172.21.15.5:0/801393211 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5231 (secure 0 0 0) 0x7fae78016560 con 0x7fae88070510 2024-08-18T22:28:27.003 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:27.003 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:28:21.056377+0000","modified":"2024-08-18T22:28:24.121089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1373218784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1373218784},{"type":"v1","addr":"172.21.15.5:6833","nonce":1373218784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8565,"qdb_cluster":[8565]},"id":9}]} 2024-08-18T22:28:27.004 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 108 2024-08-18T22:28:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 -- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae680678c0 msgr2=0x7fae68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae680678c0 0x7fae68069d80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fae880b3180 tx=0x7fae74008040 comp rx=0 tx=0).stop 2024-08-18T22:28:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 -- 172.21.15.5:0/801393211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae88070510 msgr2=0x7fae881524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae88070510 0x7fae881524c0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fae7801a5a0 tx=0x7fae78019710 comp rx=0 tx=0).stop 2024-08-18T22:28:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 -- 172.21.15.5:0/801393211 shutdown_connections 2024-08-18T22:28:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fae680678c0 0x7fae68069d80 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8815f130 0x7fae880c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae880d02a0 0x7fae880c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 --2- 172.21.15.5:0/801393211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae88070510 0x7fae881524c0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 -- 172.21.15.5:0/801393211 >> 172.21.15.5:0/801393211 conn(0x7fae880b3a20 msgr2=0x7fae8815e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 -- 172.21.15.5:0/801393211 shutdown_connections 2024-08-18T22:28:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.003+0000 7fae8d000640 1 -- 172.21.15.5:0/801393211 wait complete. 2024-08-18T22:28:27.271 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-08-18T22:28:27.275+0000 7f66d1200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:28:27.427 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 108, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:28:21.056377+0000', 'modified': '2024-08-18T22:28:24.121089+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8565}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8565': {'gid': 8565, 'name': 'a', 'rank': 0, 'incarnation': 104, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6833/1373218784', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 1373218784}, {'type': 'v1', 'addr': '172.21.15.5:6833', 'nonce': 1373218784}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8565, 'qdb_cluster': [8565]} 2024-08-18T22:28:27.428 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:28:27.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-18T22:28:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.571+0000 7fcc1f200640 1 Processor -- start 2024-08-18T22:28:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.571+0000 7fcc1f200640 1 -- start start 2024-08-18T22:28:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc1f200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc1815c180 0x7fcc180cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc1f200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcc1815d4d0 0x7fcc1806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc1f200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc180cfb00 con 0x7fcc1815c560 2024-08-18T22:28:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc1f200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcc1815d040 con 0x7fcc1815c180 2024-08-18T22:28:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc1f200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcc1815c9f0 con 0x7fcc1815d4d0 2024-08-18T22:28:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc17e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc1815c180 0x7fcc180cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc17e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc1815c180 0x7fcc180cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37368/0 (socket says 172.21.15.5:37368) 2024-08-18T22:28:27.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc17e00640 1 -- 172.21.15.5:0/3666647845 learned_addr learned my addr 172.21.15.5:0/3666647845 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:27.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc17e00640 1 -- 172.21.15.5:0/3666647845 >> v2:172.21.15.117:3300/0 conn(0x7fcc1815d4d0 msgr2=0x7fcc1806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:27.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc17e00640 1 --2- 172.21.15.5:0/3666647845 >> v2:172.21.15.117:3300/0 conn(0x7fcc1815d4d0 0x7fcc1806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc17e00640 1 -- 172.21.15.5:0/3666647845 >> v1:172.21.15.117:6789/0 conn(0x7fcc1815c560 legacy=0x7fcc180ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:27.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.575+0000 7fcc17e00640 1 -- 172.21.15.5:0/3666647845 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1815ccd0 con 0x7fcc1815c180 2024-08-18T22:28:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc17e00640 1 --2- 172.21.15.5:0/3666647845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1815c180 0x7fcc180cdf10 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fcc180cdd30 tx=0x7fcc0801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885f65f33cc128ab server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc16a00640 1 -- 172.21.15.5:0/3666647845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc080a7070 con 0x7fcc1815c180 2024-08-18T22:28:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc16a00640 1 -- 172.21.15.5:0/3666647845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc080b0070 con 0x7fcc1815c180 2024-08-18T22:28:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc16a00640 1 -- 172.21.15.5:0/3666647845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc080ab890 con 0x7fcc1815c180 2024-08-18T22:28:27.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 -- 172.21.15.5:0/3666647845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1815c180 msgr2=0x7fcc180cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 --2- 172.21.15.5:0/3666647845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1815c180 0x7fcc180cdf10 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fcc180cdd30 tx=0x7fcc0801c450 comp rx=0 tx=0).stop 2024-08-18T22:28:27.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 -- 172.21.15.5:0/3666647845 shutdown_connections 2024-08-18T22:28:27.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 --2- 172.21.15.5:0/3666647845 >> v2:172.21.15.117:3300/0 conn(0x7fcc1815d4d0 0x7fcc1806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 --2- 172.21.15.5:0/3666647845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1815c180 0x7fcc180cdf10 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 -- 172.21.15.5:0/3666647845 >> 172.21.15.5:0/3666647845 conn(0x7fcc180b1dc0 msgr2=0x7fcc180b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:27.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 -- 172.21.15.5:0/3666647845 shutdown_connections 2024-08-18T22:28:27.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 -- 172.21.15.5:0/3666647845 wait complete. 2024-08-18T22:28:27.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 Processor -- start 2024-08-18T22:28:27.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 -- start start 2024-08-18T22:28:27.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc1815c180 0x7fcc180af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1815d4d0 0x7fcc181f7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc1814d4b0 0x7fcc1814ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcc181692b0 con 0x7fcc1815d4d0 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcc18169130 con 0x7fcc1815c180 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.579+0000 7fcc1f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcc18169430 con 0x7fcc1814d4b0 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1815d4d0 0x7fcc181f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1815d4d0 0x7fcc181f7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37384/0 (socket says 172.21.15.5:37384) 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc17400640 1 -- 172.21.15.5:0/4263379345 learned_addr learned my addr 172.21.15.5:0/4263379345 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc17e00640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc1815c180 0x7fcc180af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc1d200640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc1814d4b0 0x7fcc1814ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc17400640 1 -- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc1814d4b0 msgr2=0x7fcc1814ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc17400640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc1814d4b0 0x7fcc1814ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc17400640 1 -- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc1815c180 msgr2=0x7fcc180af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc17400640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc1815c180 0x7fcc180af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc17400640 1 -- 172.21.15.5:0/4263379345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1814d940 con 0x7fcc1815d4d0 2024-08-18T22:28:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc17400640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1815d4d0 0x7fcc181f7890 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c490 tx=0x7fcc04001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc0fe00640 1 -- 172.21.15.5:0/4263379345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04017070 con 0x7fcc1815d4d0 2024-08-18T22:28:27.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc0fe00640 1 -- 172.21.15.5:0/4263379345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc04003600 con 0x7fcc1815d4d0 2024-08-18T22:28:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc1f200640 1 -- 172.21.15.5:0/4263379345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1814f370 con 0x7fcc1815d4d0 2024-08-18T22:28:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc0fe00640 1 -- 172.21.15.5:0/4263379345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04003a30 con 0x7fcc1815d4d0 2024-08-18T22:28:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc1f200640 1 -- 172.21.15.5:0/4263379345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc180ad6a0 con 0x7fcc1815d4d0 2024-08-18T22:28:27.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.583+0000 7fcc0fe00640 1 -- 172.21.15.5:0/4263379345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc0401a070 con 0x7fcc1815d4d0 2024-08-18T22:28:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc0fe00640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbf80678c0 0x7fcbf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc0fe00640 1 -- 172.21.15.5:0/4263379345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7fcc04085250 con 0x7fcc1815d4d0 2024-08-18T22:28:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 Processor -- start 2024-08-18T22:28:27.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17e00640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbf80678c0 0x7fcbf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 -- start start 2024-08-18T22:28:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17e00640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbf80678c0 0x7fcbf8069d80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcc080af000 tx=0x7fcc080a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:27.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248fed50 0x55e7248ff130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248b5990 0x55e7248b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e72479bfd0 con 0x55e7248ff670 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e7247023c0 con 0x55e7248fed50 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e7246a7f70 con 0x55e7248b5990 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37400/0 (socket says 172.21.15.5:37400) 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17400640 1 -- 172.21.15.5:0/3951559783 learned_addr learned my addr 172.21.15.5:0/3951559783 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17e00640 1 --2- 172.21.15.5:0/3951559783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248fed50 0x55e7248ff130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc1d200640 1 --2- 172.21.15.5:0/3951559783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248b5990 0x55e7248b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17400640 1 -- 172.21.15.5:0/3951559783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248b5990 msgr2=0x55e7248b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17400640 1 --2- 172.21.15.5:0/3951559783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248b5990 0x55e7248b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17400640 1 -- 172.21.15.5:0/3951559783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248fed50 msgr2=0x55e7248ff130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17400640 1 --2- 172.21.15.5:0/3951559783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248fed50 0x55e7248ff130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17400640 1 -- 172.21.15.5:0/3951559783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72469c2e0 con 0x55e7248ff670 2024-08-18T22:28:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc17400640 1 --2- 172.21.15.5:0/3951559783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248b5450 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fcc04000c10 tx=0x7fcc040517c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9cf1a95507b4d90 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc0cc00640 1 -- 172.21.15.5:0/3951559783 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04053820 con 0x55e7248ff670 2024-08-18T22:28:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc0cc00640 1 -- 172.21.15.5:0/3951559783 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc04051b90 con 0x55e7248ff670 2024-08-18T22:28:27.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc0cc00640 1 -- 172.21.15.5:0/3951559783 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0405de50 con 0x55e7248ff670 2024-08-18T22:28:27.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 -- 172.21.15.5:0/3951559783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 msgr2=0x55e7248b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 --2- 172.21.15.5:0/3951559783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248b5450 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fcc04000c10 tx=0x7fcc040517c0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 -- 172.21.15.5:0/3951559783 shutdown_connections 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 --2- 172.21.15.5:0/3951559783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248b5990 0x55e7248b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 --2- 172.21.15.5:0/3951559783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248b5450 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 --2- 172.21.15.5:0/3951559783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248fed50 0x55e7248ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 -- 172.21.15.5:0/3951559783 >> 172.21.15.5:0/3951559783 conn(0x55e7248b1910 msgr2=0x55e7248b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 -- 172.21.15.5:0/3951559783 shutdown_connections 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.587+0000 7fcc226ed000 1 -- 172.21.15.5:0/3951559783 wait complete. 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 -- start start 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 Processor -- start 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248b5990 0x55e7248ec640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248fed50 0x55e7248bab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248bb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e7246a9e40 con 0x55e7248ff670 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e7247bfaf0 con 0x55e7248b5990 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e724764450 con 0x55e7248fed50 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 10 client.0 _ll_register_callbacks cb 0x55e7248a0630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc1d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc1d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248bb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37414/0 (socket says 172.21.15.5:37414) 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc1d200640 1 -- 172.21.15.5:0/2017317626 learned_addr learned my addr 172.21.15.5:0/2017317626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc17400640 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248fed50 0x55e7248bab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc17e00640 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248b5990 0x55e7248ec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc1d200640 1 -- 172.21.15.5:0/2017317626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248fed50 msgr2=0x55e7248bab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc1d200640 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248fed50 0x55e7248bab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc1d200640 1 -- 172.21.15.5:0/2017317626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248b5990 msgr2=0x55e7248ec640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:27.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc1d200640 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248b5990 0x55e7248ec640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc1d200640 1 -- 172.21.15.5:0/2017317626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e724689fd0 con 0x55e7248ff670 2024-08-18T22:28:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc17e00640 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248b5990 0x55e7248ec640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc1d200640 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248bb060 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000aaa0 tx=0x7fcc1000af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2084d21b5e23a95 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc01600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc01600640 1 -- 172.21.15.5:0/2017317626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc10007df0 con 0x55e7248ff670 2024-08-18T22:28:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc01600640 1 -- 172.21.15.5:0/2017317626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7fcc10016410 con 0x55e7248ff670 2024-08-18T22:28:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 -- 172.21.15.5:0/2017317626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc04051b90 con 0x55e7248ff670 2024-08-18T22:28:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc01600640 1 -- 172.21.15.5:0/2017317626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7fcc10016610 con 0x55e7248ff670 2024-08-18T22:28:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 10 client.8691 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:27.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 -- 172.21.15.5:0/2017317626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x55e7247854d0 con 0x55e7248ff670 2024-08-18T22:28:27.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc01600640 1 -- 172.21.15.5:0/2017317626 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc04051b90 con 0x55e7248ff670 2024-08-18T22:28:27.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc01600640 1 -- 172.21.15.5:0/2017317626 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7fcc10026080 con 0x55e7248ff670 2024-08-18T22:28:27.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 10 client.8691 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:27.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 10 client.8691 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:28:27.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 20 client.8691 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55e7248ed4f0 0x55e7248ed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 4 client.8691 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc226ed000 1 -- 172.21.15.5:0/2017317626 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e72469cc00 con 0x55e7248ed4f0 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.591+0000 7fcc17e00640 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55e7248ed4f0 0x55e7248ed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc01600640 10 client.8691 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc17e00640 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55e7248ed4f0 0x55e7248ed8d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5172e6a957765d server_cookie=9beef0ec585d155b in_seq=0 out_seq=0 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc01600640 1 -- 172.21.15.5:0/2017317626 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e72469cc00 con 0x55e7248ed4f0 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc01600640 10 client.8691 handle_command_reply: tid=0 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 1 client.8691 shutdown 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 1 -- 172.21.15.5:0/2017317626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 msgr2=0x55e7248bb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248bb060 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000aaa0 tx=0x7fcc1000af60 comp rx=0 tx=0).stop 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 1 -- 172.21.15.5:0/2017317626 shutdown_connections 2024-08-18T22:28:27.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55e7248ed4f0 0x55e7248ed8d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248ff670 0x55e7248bb060 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248fed50 0x55e7248bab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc01600640 0 client.8691 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:27.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 1 --2- 172.21.15.5:0/2017317626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248b5990 0x55e7248ec640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 1 -- 172.21.15.5:0/2017317626 >> 172.21.15.5:0/2017317626 conn(0x55e7248b1910 msgr2=0x55e7248b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:27.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 1 -- 172.21.15.5:0/2017317626 shutdown_connections 2024-08-18T22:28:27.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 1 -- 172.21.15.5:0/2017317626 wait complete. 2024-08-18T22:28:27.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.595+0000 7fcc226ed000 20 client.8691 trim_cache size 0 max 16384 2024-08-18T22:28:27.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 Processor -- start 2024-08-18T22:28:27.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 -- start start 2024-08-18T22:28:27.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b1910 0x55e7248fe060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248b5990 0x55e7248fe5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248fed50 0x55e724916060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcc18203530 con 0x55e7248b1910 2024-08-18T22:28:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcc18155ac0 con 0x55e7248fed50 2024-08-18T22:28:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcc18203050 con 0x55e7248b5990 2024-08-18T22:28:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc17e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b1910 0x55e7248fe060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc17e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b1910 0x55e7248fe060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37420/0 (socket says 172.21.15.5:37420) 2024-08-18T22:28:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc17e00640 1 -- 172.21.15.5:0/2544714499 learned_addr learned my addr 172.21.15.5:0/2544714499 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc1d200640 1 --2- 172.21.15.5:0/2544714499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248fed50 0x55e724916060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc17400640 1 --2- 172.21.15.5:0/2544714499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248b5990 0x55e7248fe5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc17e00640 1 -- 172.21.15.5:0/2544714499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248b5990 msgr2=0x55e7248fe5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc17e00640 1 --2- 172.21.15.5:0/2544714499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248b5990 0x55e7248fe5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc17e00640 1 -- 172.21.15.5:0/2544714499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248fed50 msgr2=0x55e724916060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc17e00640 1 --2- 172.21.15.5:0/2544714499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248fed50 0x55e724916060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc17e00640 1 -- 172.21.15.5:0/2544714499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7246fbb30 con 0x55e7248b1910 2024-08-18T22:28:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc17e00640 1 --2- 172.21.15.5:0/2544714499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b1910 0x55e7248fe060 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fcc0801a080 tx=0x7fcc08009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6326d90b8a4d4dc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc03e00640 1 -- 172.21.15.5:0/2544714499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc080bf8d0 con 0x55e7248b1910 2024-08-18T22:28:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc03e00640 1 -- 172.21.15.5:0/2544714499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc080b0040 con 0x55e7248b1910 2024-08-18T22:28:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc03e00640 1 -- 172.21.15.5:0/2544714499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc080bfc90 con 0x55e7248b1910 2024-08-18T22:28:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 -- 172.21.15.5:0/2544714499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b1910 msgr2=0x55e7248fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 --2- 172.21.15.5:0/2544714499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b1910 0x55e7248fe060 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fcc0801a080 tx=0x7fcc08009240 comp rx=0 tx=0).stop 2024-08-18T22:28:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 -- 172.21.15.5:0/2544714499 shutdown_connections 2024-08-18T22:28:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 --2- 172.21.15.5:0/2544714499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248fed50 0x55e724916060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 --2- 172.21.15.5:0/2544714499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248b5990 0x55e7248fe5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 --2- 172.21.15.5:0/2544714499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b1910 0x55e7248fe060 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 -- 172.21.15.5:0/2544714499 >> 172.21.15.5:0/2544714499 conn(0x55e72490c5d0 msgr2=0x55e7248fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 -- 172.21.15.5:0/2544714499 shutdown_connections 2024-08-18T22:28:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 -- 172.21.15.5:0/2544714499 wait complete. 2024-08-18T22:28:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 -- start start 2024-08-18T22:28:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.615+0000 7fcc226ed000 1 Processor -- start 2024-08-18T22:28:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248b1910 0x55e724913350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b5990 0x55e724913890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248fed50 0x55e724913dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e7246bb1d0 con 0x55e7248b5990 2024-08-18T22:28:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e724699900 con 0x55e7248b1910 2024-08-18T22:28:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e7247016d0 con 0x55e7248fed50 2024-08-18T22:28:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 10 client.0 _ll_register_callbacks cb 0x7fcc100099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b5990 0x55e724913890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b5990 0x55e724913890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37432/0 (socket says 172.21.15.5:37432) 2024-08-18T22:28:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17400640 1 -- 172.21.15.5:0/4056266480 learned_addr learned my addr 172.21.15.5:0/4056266480 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17e00640 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248b1910 0x55e724913350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc1d200640 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248fed50 0x55e724913dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17400640 1 -- 172.21.15.5:0/4056266480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248fed50 msgr2=0x55e724913dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17400640 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248fed50 0x55e724913dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17400640 1 -- 172.21.15.5:0/4056266480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248b1910 msgr2=0x55e724913350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17400640 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248b1910 0x55e724913350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17400640 1 -- 172.21.15.5:0/4056266480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7246b3810 con 0x55e7248b5990 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17400640 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b5990 0x55e724913890 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fcc040554b0 tx=0x7fcc04014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4008bffb0089eb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc01600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc01600640 1 -- 172.21.15.5:0/4056266480 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040517c0 con 0x55e7248b5990 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc01600640 1 -- 172.21.15.5:0/4056266480 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7fcc0405de50 con 0x55e7248b5990 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 -- 172.21.15.5:0/4056266480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc080b0040 con 0x55e7248b5990 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc01600640 1 -- 172.21.15.5:0/4056266480 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7fcc04054970 con 0x55e7248b5990 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 10 client.8697 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 -- 172.21.15.5:0/4056266480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x55e724698d30 con 0x55e7248b5990 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc01600640 1 -- 172.21.15.5:0/4056266480 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc080b0040 con 0x55e7248b5990 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc01600640 1 -- 172.21.15.5:0/4056266480 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7fcc04054b10 con 0x55e7248b5990 2024-08-18T22:28:27.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 10 client.8697 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 10 client.8697 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 20 client.8697 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55e7248ff670 0x55e724914310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 4 client.8697 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 -- 172.21.15.5:0/4056266480 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "status"}) -- 0x55e72470faf0 con 0x55e7248ff670 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17e00640 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55e7248ff670 0x55e724914310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc17e00640 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55e7248ff670 0x55e724914310 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f394db29954d97d server_cookie=e8ce724b702d6d43 in_seq=0 out_seq=0 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc01600640 10 client.8697 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc01600640 1 -- 172.21.15.5:0/4056266480 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55e72470faf0 con 0x55e7248ff670 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc01600640 10 client.8697 handle_command_reply: tid=0 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 client.8697 shutdown 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 -- 172.21.15.5:0/4056266480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b5990 msgr2=0x55e724913890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b5990 0x55e724913890 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fcc040554b0 tx=0x7fcc04014070 comp rx=0 tx=0).stop 2024-08-18T22:28:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 -- 172.21.15.5:0/4056266480 shutdown_connections 2024-08-18T22:28:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55e7248ff670 0x55e724914310 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e7248fed50 0x55e724913dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e7248b5990 0x55e724913890 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc01600640 0 client.8697 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 --2- 172.21.15.5:0/4056266480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e7248b1910 0x55e724913350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.619+0000 7fcc226ed000 1 -- 172.21.15.5:0/4056266480 >> 172.21.15.5:0/4056266480 conn(0x55e72490c5d0 msgr2=0x55e7248fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc226ed000 1 -- 172.21.15.5:0/4056266480 shutdown_connections 2024-08-18T22:28:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc226ed000 1 -- 172.21.15.5:0/4056266480 wait complete. 2024-08-18T22:28:27.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc226ed000 20 client.8697 trim_cache size 0 max 16384 2024-08-18T22:28:27.629 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:28:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:28:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:28:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8565, 2024-08-18T22:28:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:28:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:28:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:28:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.9719570590000002, 2024-08-18T22:28:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 108, 2024-08-18T22:28:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 141, 2024-08-18T22:28:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 141, 2024-08-18T22:28:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 11.142221065999999 2024-08-18T22:28:27.630 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:28:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 -- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbf80678c0 msgr2=0x7fcbf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbf80678c0 0x7fcbf8069d80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcc080af000 tx=0x7fcc080a7000 comp rx=0 tx=0).stop 2024-08-18T22:28:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 -- 172.21.15.5:0/4263379345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1815d4d0 msgr2=0x7fcc181f7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1815d4d0 0x7fcc181f7890 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c490 tx=0x7fcc04001e80 comp rx=0 tx=0).stop 2024-08-18T22:28:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 -- 172.21.15.5:0/4263379345 shutdown_connections 2024-08-18T22:28:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbf80678c0 0x7fcbf8069d80 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc1814d4b0 0x7fcc1814ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc1815d4d0 0x7fcc181f7890 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 --2- 172.21.15.5:0/4263379345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc1815c180 0x7fcc180af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 -- 172.21.15.5:0/4263379345 >> 172.21.15.5:0/4263379345 conn(0x7fcc180b1dc0 msgr2=0x7fcc180af830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 -- 172.21.15.5:0/4263379345 shutdown_connections 2024-08-18T22:28:27.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.623+0000 7fcc1f200640 1 -- 172.21.15.5:0/4263379345 wait complete. 2024-08-18T22:28:27.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:28:27.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10ce400640 1 Processor -- start 2024-08-18T22:28:27.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10ce400640 1 -- start start 2024-08-18T22:28:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10ce400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10c80cee40 0x7f10c806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10ce400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c80ca3e0 0x7f10c80ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10ce400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c815e840 con 0x7f10c815e460 2024-08-18T22:28:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10ce400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f10c80ae750 con 0x7f10c80cee40 2024-08-18T22:28:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10ce400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10c806c900 con 0x7f10c80ca3e0 2024-08-18T22:28:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10c7400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f10c815e460 0x7f10c80ae040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34060/0 (socket says 172.21.15.5:34060) 2024-08-18T22:28:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10c7400640 1 -- 172.21.15.5:0/3154983812 learned_addr learned my addr 172.21.15.5:0/3154983812 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10bea00640 1 --2- 172.21.15.5:0/3154983812 >> v2:172.21.15.5:3300/0 conn(0x7f10c80cee40 0x7f10c806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10c7e00640 1 --2- 172.21.15.5:0/3154983812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c80ca3e0 0x7f10c80ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.783+0000 7f10c6a00640 1 -- 172.21.15.5:0/3154983812 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201491975 0 0) 0x7f10c815e840 con 0x7f10c815e460 2024-08-18T22:28:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10bea00640 1 -- 172.21.15.5:0/3154983812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c80ca3e0 msgr2=0x7f10c80ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10bea00640 1 --2- 172.21.15.5:0/3154983812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c80ca3e0 0x7f10c80ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10bea00640 1 -- 172.21.15.5:0/3154983812 >> v1:172.21.15.5:6789/0 conn(0x7f10c815e460 legacy=0x7f10c80ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10bea00640 1 -- 172.21.15.5:0/3154983812 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c80cf320 con 0x7f10c80cee40 2024-08-18T22:28:27.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10bea00640 1 --2- 172.21.15.5:0/3154983812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c80cee40 0x7f10c806c3c0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f10b00097c0 tx=0x7f10b001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145018455b92eb14 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:27.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10c6a00640 1 -- 172.21.15.5:0/3154983812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b00b5070 con 0x7f10c80cee40 2024-08-18T22:28:27.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10c6a00640 1 -- 172.21.15.5:0/3154983812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b00a8990 con 0x7f10c80cee40 2024-08-18T22:28:27.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10c6a00640 1 -- 172.21.15.5:0/3154983812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b00a8d60 con 0x7f10c80cee40 2024-08-18T22:28:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10ce400640 1 -- 172.21.15.5:0/3154983812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c80cee40 msgr2=0x7f10c806c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10ce400640 1 --2- 172.21.15.5:0/3154983812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c80cee40 0x7f10c806c3c0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f10b00097c0 tx=0x7f10b001ec90 comp rx=0 tx=0).stop 2024-08-18T22:28:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10ce400640 1 -- 172.21.15.5:0/3154983812 shutdown_connections 2024-08-18T22:28:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10ce400640 1 --2- 172.21.15.5:0/3154983812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c80ca3e0 0x7f10c80ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10ce400640 1 --2- 172.21.15.5:0/3154983812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c80cee40 0x7f10c806c3c0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10ce400640 1 -- 172.21.15.5:0/3154983812 >> 172.21.15.5:0/3154983812 conn(0x7f10c809aa40 msgr2=0x7f10c80b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10ce400640 1 -- 172.21.15.5:0/3154983812 shutdown_connections 2024-08-18T22:28:27.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.787+0000 7f10ce400640 1 -- 172.21.15.5:0/3154983812 wait complete. 2024-08-18T22:28:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10ce400640 1 Processor -- start 2024-08-18T22:28:27.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10ce400640 1 -- start start 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10ce400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c80ca3e0 0x7f10c80b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10ce400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c80cee40 0x7f10c8144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10ce400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c815e460 0x7f10c815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10ce400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f10c80cfbc0 con 0x7f10c80ca3e0 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10ce400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f10c80cf8e0 con 0x7f10c80cee40 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10ce400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10c80cfea0 con 0x7f10c815e460 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10c7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c80ca3e0 0x7f10c80b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10c7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c80ca3e0 0x7f10c80b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37450/0 (socket says 172.21.15.5:37450) 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10c7400640 1 -- 172.21.15.5:0/3293853775 learned_addr learned my addr 172.21.15.5:0/3293853775 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10c7e00640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c815e460 0x7f10c815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10bea00640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c80cee40 0x7f10c8144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10c7400640 1 -- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c815e460 msgr2=0x7f10c815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10c7400640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c815e460 0x7f10c815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10c7400640 1 -- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c80cee40 msgr2=0x7f10c8144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10c7400640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c80cee40 0x7f10c8144df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10c7400640 1 -- 172.21.15.5:0/3293853775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c81f7720 con 0x7f10c80ca3e0 2024-08-18T22:28:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10bea00640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c80cee40 0x7f10c8144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10c7e00640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c815e460 0x7f10c815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10c7400640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c80ca3e0 0x7f10c80b5a20 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f10b800c4b0 tx=0x7f10b800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10bfe00640 1 -- 172.21.15.5:0/3293853775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8018070 con 0x7f10c80ca3e0 2024-08-18T22:28:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10bfe00640 1 -- 172.21.15.5:0/3293853775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b8007500 con 0x7f10c80ca3e0 2024-08-18T22:28:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10ce400640 1 -- 172.21.15.5:0/3293853775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c81f7a00 con 0x7f10c80ca3e0 2024-08-18T22:28:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10bfe00640 1 -- 172.21.15.5:0/3293853775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8004a30 con 0x7f10c80ca3e0 2024-08-18T22:28:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.791+0000 7f10ce400640 1 -- 172.21.15.5:0/3293853775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c81f7fc0 con 0x7f10c80ca3e0 2024-08-18T22:28:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.795+0000 7f10ce400640 1 -- 172.21.15.5:0/3293853775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c80b3620 con 0x7f10c80ca3e0 2024-08-18T22:28:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.795+0000 7f10bfe00640 1 -- 172.21.15.5:0/3293853775 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10b801b070 con 0x7f10c80ca3e0 2024-08-18T22:28:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.795+0000 7f10bfe00640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10a40678f0 0x7f10a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.795+0000 7f10bfe00640 1 -- 172.21.15.5:0/3293853775 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f10b8085150 con 0x7f10c80ca3e0 2024-08-18T22:28:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.795+0000 7f10bea00640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10a40678f0 0x7f10a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:27.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.795+0000 7f10bea00640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10a40678f0 0x7f10a4069db0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f10b00b2000 tx=0x7f10b00aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.799+0000 7f10bfe00640 1 -- 172.21.15.5:0/3293853775 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f10b8055a60 con 0x7f10c80ca3e0 2024-08-18T22:28:28.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.999+0000 7f10ce400640 1 -- 172.21.15.5:0/3293853775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f10c815d8f0 con 0x7f10c80ca3e0 2024-08-18T22:28:28.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:27.999+0000 7f10bfe00640 1 -- 172.21.15.5:0/3293853775 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v108) ==== 53+0+73 (secure 0 0 0) 0x7f10b8055360 con 0x7f10c80ca3e0 2024-08-18T22:28:28.001 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:28:28.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 -- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10a40678f0 msgr2=0x7f10a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:28.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10a40678f0 0x7f10a4069db0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f10b00b2000 tx=0x7f10b00aa070 comp rx=0 tx=0).stop 2024-08-18T22:28:28.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 -- 172.21.15.5:0/3293853775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c80ca3e0 msgr2=0x7f10c80b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c80ca3e0 0x7f10c80b5a20 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f10b800c4b0 tx=0x7f10b800c970 comp rx=0 tx=0).stop 2024-08-18T22:28:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 -- 172.21.15.5:0/3293853775 shutdown_connections 2024-08-18T22:28:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10a40678f0 0x7f10a4069db0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10c815e460 0x7f10c815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10c80cee40 0x7f10c8144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 --2- 172.21.15.5:0/3293853775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10c80ca3e0 0x7f10c80b5a20 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 -- 172.21.15.5:0/3293853775 >> 172.21.15.5:0/3293853775 conn(0x7f10c809aa40 msgr2=0x7f10c80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 -- 172.21.15.5:0/3293853775 shutdown_connections 2024-08-18T22:28:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28.003+0000 7f10ce400640 1 -- 172.21.15.5:0/3293853775 wait complete. 2024-08-18T22:28:28.023 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:28:28.023 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:28:28.023 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:28:28.023 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:28:28.023 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:28:28.023 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:28:28.023 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:28:28.023 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:28:28.023 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:28:28.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:28.024 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:28:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41893sec preferred_lft 41893sec 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:28:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:28:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:28:28.036 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:28:28.036 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:28:28.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:28.037 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:28:28.095 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:28:28.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:28.097 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:28:28.151 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:28:28.151 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:28:28.151 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:28:28.151 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:28:28.151 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:28:28.151 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:28:28.151 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:28:28.151 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:28.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:28:28.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:28:28.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:28:28.152 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:28:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:28.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:28.290 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:28:28.299 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:28:28.299 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:28:28.300 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:28:28.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:28.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:28:28.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:28:28.361 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:28:28.410 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:28:28.410 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:28:28.410 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:28:28.461 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:28:28.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:28.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:28:28.550 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:28:28.550 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:28:28.550 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:28:28.565 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:28:28.565 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:28:28.565 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:28:28.565 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:28:28.565 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:28:28.574 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:28:28.575 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:28:28.575 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:28:28.575 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:28:28.575 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:28:28.575 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:28:28.575 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:28:28.575 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:28:28.579 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:28:28.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:28.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:28:28.600 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:28:28.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:28.711 INFO:teuthology.orchestra.run.smithi005.stdout:client7298 2024-08-18T22:28:28.712 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:28:28.712 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:28.721 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-08-18T22:28:28.721 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-08-18T22:28:28.721 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:28.721 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:28.721 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.0 2024-08-18T22:28:28.721 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:28.722 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:28.722 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:28.722 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:28.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:28.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:28.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:28.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158471 s, 66.2 MB/s 2024-08-18T22:28:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028074 s, 37.4 MB/s 2024-08-18T22:28:28.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:28.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:28.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209804 s, 50.0 MB/s 2024-08-18T22:28:28.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:28.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:28.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147759 s, 71.0 MB/s 2024-08-18T22:28:28.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:28.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:28.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154739 s, 67.8 MB/s 2024-08-18T22:28:28.955 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:28.956 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232604 s, 45.1 MB/s 2024-08-18T22:28:28.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:28.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:28.979 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201061 s, 52.2 MB/s 2024-08-18T22:28:29.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199447 s, 52.6 MB/s 2024-08-18T22:28:29.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.020 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162832 s, 64.4 MB/s 2024-08-18T22:28:29.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173794 s, 60.3 MB/s 2024-08-18T22:28:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193284 s, 54.3 MB/s 2024-08-18T22:28:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186019 s, 56.4 MB/s 2024-08-18T22:28:29.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176758 s, 59.3 MB/s 2024-08-18T22:28:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.121 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159914 s, 65.6 MB/s 2024-08-18T22:28:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144375 s, 72.6 MB/s 2024-08-18T22:28:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169077 s, 62.0 MB/s 2024-08-18T22:28:29.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200373 s, 52.3 MB/s 2024-08-18T22:28:29.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.202 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189967 s, 55.2 MB/s 2024-08-18T22:28:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160374 s, 65.4 MB/s 2024-08-18T22:28:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198301 s, 52.9 MB/s 2024-08-18T22:28:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147496 s, 71.1 MB/s 2024-08-18T22:28:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211101 s, 49.7 MB/s 2024-08-18T22:28:29.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.301 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150347 s, 69.7 MB/s 2024-08-18T22:28:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173403 s, 60.5 MB/s 2024-08-18T22:28:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239484 s, 43.8 MB/s 2024-08-18T22:28:29.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147666 s, 71.0 MB/s 2024-08-18T22:28:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173023 s, 60.6 MB/s 2024-08-18T22:28:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146428 s, 71.6 MB/s 2024-08-18T22:28:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01675 s, 62.6 MB/s 2024-08-18T22:28:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144605 s, 72.5 MB/s 2024-08-18T22:28:29.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171346 s, 61.2 MB/s 2024-08-18T22:28:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149981 s, 69.9 MB/s 2024-08-18T22:28:29.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:29.484 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:29.484 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:29.484 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.1 2024-08-18T22:28:29.484 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:29.484 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:29.484 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:29.484 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016114 s, 65.1 MB/s 2024-08-18T22:28:29.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166761 s, 62.9 MB/s 2024-08-18T22:28:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217075 s, 48.3 MB/s 2024-08-18T22:28:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158329 s, 66.2 MB/s 2024-08-18T22:28:29.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.636 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161464 s, 64.9 MB/s 2024-08-18T22:28:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148401 s, 70.7 MB/s 2024-08-18T22:28:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247758 s, 42.3 MB/s 2024-08-18T22:28:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147106 s, 71.3 MB/s 2024-08-18T22:28:29.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169128 s, 62.0 MB/s 2024-08-18T22:28:29.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.738 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183569 s, 57.1 MB/s 2024-08-18T22:28:29.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145438 s, 72.1 MB/s 2024-08-18T22:28:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168897 s, 62.1 MB/s 2024-08-18T22:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014886 s, 70.4 MB/s 2024-08-18T22:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164795 s, 63.6 MB/s 2024-08-18T22:28:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146669 s, 71.5 MB/s 2024-08-18T22:28:29.843 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.843 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.843 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117859 s, 89.0 MB/s 2024-08-18T22:28:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141597 s, 74.1 MB/s 2024-08-18T22:28:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152794 s, 68.6 MB/s 2024-08-18T22:28:29.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165538 s, 63.3 MB/s 2024-08-18T22:28:29.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.915 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155671 s, 67.4 MB/s 2024-08-18T22:28:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148614 s, 70.6 MB/s 2024-08-18T22:28:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151312 s, 69.3 MB/s 2024-08-18T22:28:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.969 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167868 s, 62.5 MB/s 2024-08-18T22:28:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:29.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:29.992 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198014 s, 53.0 MB/s 2024-08-18T22:28:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196263 s, 53.4 MB/s 2024-08-18T22:28:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.034 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170951 s, 61.3 MB/s 2024-08-18T22:28:30.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150312 s, 69.8 MB/s 2024-08-18T22:28:30.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140311 s, 74.7 MB/s 2024-08-18T22:28:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146964 s, 71.3 MB/s 2024-08-18T22:28:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147612 s, 71.0 MB/s 2024-08-18T22:28:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168975 s, 62.1 MB/s 2024-08-18T22:28:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148055 s, 70.8 MB/s 2024-08-18T22:28:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:30.147 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:30.147 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:30.147 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.2 2024-08-18T22:28:30.147 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:30.148 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:30.148 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:30.148 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:30.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.219 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166757 s, 62.9 MB/s 2024-08-18T22:28:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207888 s, 50.4 MB/s 2024-08-18T22:28:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.256 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113749 s, 92.2 MB/s 2024-08-18T22:28:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209898 s, 50.0 MB/s 2024-08-18T22:28:30.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171167 s, 61.3 MB/s 2024-08-18T22:28:30.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.318 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162782 s, 64.4 MB/s 2024-08-18T22:28:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152519 s, 68.8 MB/s 2024-08-18T22:28:30.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.356 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168519 s, 62.2 MB/s 2024-08-18T22:28:30.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.379 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.379 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201157 s, 52.1 MB/s 2024-08-18T22:28:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01588 s, 66.0 MB/s 2024-08-18T22:28:30.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.415 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154668 s, 67.8 MB/s 2024-08-18T22:28:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176817 s, 59.3 MB/s 2024-08-18T22:28:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149744 s, 70.0 MB/s 2024-08-18T22:28:30.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146665 s, 71.5 MB/s 2024-08-18T22:28:30.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.497 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238319 s, 44.0 MB/s 2024-08-18T22:28:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165543 s, 63.3 MB/s 2024-08-18T22:28:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154131 s, 68.0 MB/s 2024-08-18T22:28:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146467 s, 71.6 MB/s 2024-08-18T22:28:30.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.574 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202864 s, 51.7 MB/s 2024-08-18T22:28:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148611 s, 70.6 MB/s 2024-08-18T22:28:30.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.611 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.611 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165549 s, 63.3 MB/s 2024-08-18T22:28:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122944 s, 85.3 MB/s 2024-08-18T22:28:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.644 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154054 s, 68.1 MB/s 2024-08-18T22:28:30.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01508 s, 69.5 MB/s 2024-08-18T22:28:30.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142436 s, 73.6 MB/s 2024-08-18T22:28:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148155 s, 70.8 MB/s 2024-08-18T22:28:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145353 s, 72.1 MB/s 2024-08-18T22:28:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143229 s, 73.2 MB/s 2024-08-18T22:28:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143173 s, 73.2 MB/s 2024-08-18T22:28:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.765 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015295 s, 68.6 MB/s 2024-08-18T22:28:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.785 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171604 s, 61.1 MB/s 2024-08-18T22:28:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146813 s, 71.4 MB/s 2024-08-18T22:28:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:30.810 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:30.810 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:30.810 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.3 2024-08-18T22:28:30.810 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:30.810 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:30.810 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:30.810 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:30.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015141 s, 69.3 MB/s 2024-08-18T22:28:30.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237804 s, 44.1 MB/s 2024-08-18T22:28:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149697 s, 70.0 MB/s 2024-08-18T22:28:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:30.984 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141308 s, 74.2 MB/s 2024-08-18T22:28:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.003 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170547 s, 61.5 MB/s 2024-08-18T22:28:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.025 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199747 s, 52.5 MB/s 2024-08-18T22:28:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143725 s, 73.0 MB/s 2024-08-18T22:28:31.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150617 s, 69.6 MB/s 2024-08-18T22:28:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160548 s, 65.3 MB/s 2024-08-18T22:28:31.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199837 s, 52.5 MB/s 2024-08-18T22:28:31.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147202 s, 71.2 MB/s 2024-08-18T22:28:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.141 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197126 s, 53.2 MB/s 2024-08-18T22:28:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147898 s, 70.9 MB/s 2024-08-18T22:28:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159074 s, 65.9 MB/s 2024-08-18T22:28:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149391 s, 70.2 MB/s 2024-08-18T22:28:31.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113117 s, 92.7 MB/s 2024-08-18T22:28:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014245 s, 73.6 MB/s 2024-08-18T22:28:31.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014649 s, 71.6 MB/s 2024-08-18T22:28:31.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.260 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147324 s, 71.2 MB/s 2024-08-18T22:28:31.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.277 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01454 s, 72.1 MB/s 2024-08-18T22:28:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151133 s, 69.4 MB/s 2024-08-18T22:28:31.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.322 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245845 s, 42.7 MB/s 2024-08-18T22:28:31.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147763 s, 71.0 MB/s 2024-08-18T22:28:31.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195026 s, 53.8 MB/s 2024-08-18T22:28:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171276 s, 61.2 MB/s 2024-08-18T22:28:31.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206053 s, 50.9 MB/s 2024-08-18T22:28:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186605 s, 56.2 MB/s 2024-08-18T22:28:31.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.448 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204327 s, 51.3 MB/s 2024-08-18T22:28:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.472 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021061 s, 49.8 MB/s 2024-08-18T22:28:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155176 s, 67.6 MB/s 2024-08-18T22:28:31.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207679 s, 50.5 MB/s 2024-08-18T22:28:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150988 s, 69.4 MB/s 2024-08-18T22:28:31.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:31.539 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:31.539 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:31.540 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.4 2024-08-18T22:28:31.540 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:31.540 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:31.540 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:31.540 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021536 s, 48.7 MB/s 2024-08-18T22:28:31.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148955 s, 70.4 MB/s 2024-08-18T22:28:31.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114315 s, 91.7 MB/s 2024-08-18T22:28:31.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.671 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209955 s, 49.9 MB/s 2024-08-18T22:28:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140962 s, 74.4 MB/s 2024-08-18T22:28:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148429 s, 70.6 MB/s 2024-08-18T22:28:31.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152761 s, 68.6 MB/s 2024-08-18T22:28:31.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.742 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157402 s, 66.6 MB/s 2024-08-18T22:28:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146503 s, 71.6 MB/s 2024-08-18T22:28:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146942 s, 71.4 MB/s 2024-08-18T22:28:31.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.791 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123177 s, 85.1 MB/s 2024-08-18T22:28:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171697 s, 61.1 MB/s 2024-08-18T22:28:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210009 s, 49.9 MB/s 2024-08-18T22:28:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149595 s, 70.1 MB/s 2024-08-18T22:28:31.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.869 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146434 s, 71.6 MB/s 2024-08-18T22:28:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144602 s, 72.5 MB/s 2024-08-18T22:28:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164719 s, 63.7 MB/s 2024-08-18T22:28:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146563 s, 71.5 MB/s 2024-08-18T22:28:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174986 s, 59.9 MB/s 2024-08-18T22:28:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.960 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147376 s, 71.1 MB/s 2024-08-18T22:28:31.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:31.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:31.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143411 s, 73.1 MB/s 2024-08-18T22:28:32.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.000 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213659 s, 49.1 MB/s 2024-08-18T22:28:32.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01594 s, 65.8 MB/s 2024-08-18T22:28:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.038 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165273 s, 63.4 MB/s 2024-08-18T22:28:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152256 s, 68.9 MB/s 2024-08-18T22:28:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145434 s, 72.1 MB/s 2024-08-18T22:28:32.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.087 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119059 s, 88.1 MB/s 2024-08-18T22:28:32.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.109 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195043 s, 53.8 MB/s 2024-08-18T22:28:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208309 s, 50.3 MB/s 2024-08-18T22:28:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016881 s, 62.1 MB/s 2024-08-18T22:28:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173656 s, 60.4 MB/s 2024-08-18T22:28:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165092 s, 63.5 MB/s 2024-08-18T22:28:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:32.199 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:32.199 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:32.199 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.5 2024-08-18T22:28:32.199 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:32.200 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:32.200 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:32.200 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:32.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168444 s, 62.3 MB/s 2024-08-18T22:28:32.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.287 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145056 s, 72.3 MB/s 2024-08-18T22:28:32.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.305 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150792 s, 69.5 MB/s 2024-08-18T22:28:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171653 s, 61.1 MB/s 2024-08-18T22:28:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.343 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016206 s, 64.7 MB/s 2024-08-18T22:28:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168919 s, 62.1 MB/s 2024-08-18T22:28:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014591 s, 71.9 MB/s 2024-08-18T22:28:32.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.397 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.398 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149242 s, 70.3 MB/s 2024-08-18T22:28:32.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.424 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238971 s, 43.9 MB/s 2024-08-18T22:28:32.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.444 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175325 s, 59.8 MB/s 2024-08-18T22:28:32.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141441 s, 74.1 MB/s 2024-08-18T22:28:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016092 s, 65.2 MB/s 2024-08-18T22:28:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148787 s, 70.5 MB/s 2024-08-18T22:28:32.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144435 s, 72.6 MB/s 2024-08-18T22:28:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231536 s, 45.3 MB/s 2024-08-18T22:28:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014699 s, 71.3 MB/s 2024-08-18T22:28:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211361 s, 49.6 MB/s 2024-08-18T22:28:32.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.598 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151336 s, 69.3 MB/s 2024-08-18T22:28:32.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182174 s, 57.6 MB/s 2024-08-18T22:28:32.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202142 s, 51.9 MB/s 2024-08-18T22:28:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015001 s, 69.9 MB/s 2024-08-18T22:28:32.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.678 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163044 s, 64.3 MB/s 2024-08-18T22:28:32.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.702 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211028 s, 49.7 MB/s 2024-08-18T22:28:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.721 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166064 s, 63.1 MB/s 2024-08-18T22:28:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172992 s, 60.6 MB/s 2024-08-18T22:28:32.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189842 s, 55.2 MB/s 2024-08-18T22:28:32.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148427 s, 70.6 MB/s 2024-08-18T22:28:32.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144785 s, 72.4 MB/s 2024-08-18T22:28:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152652 s, 68.7 MB/s 2024-08-18T22:28:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137665 s, 76.2 MB/s 2024-08-18T22:28:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212134 s, 49.4 MB/s 2024-08-18T22:28:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142552 s, 73.6 MB/s 2024-08-18T22:28:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:32.879 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:32.879 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:32.879 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.6 2024-08-18T22:28:32.879 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:32.879 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:32.879 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:32.879 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:32.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:32.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196386 s, 53.4 MB/s 2024-08-18T22:28:32.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147901 s, 70.9 MB/s 2024-08-18T22:28:32.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:32.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:32.987 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143002 s, 73.3 MB/s 2024-08-18T22:28:33.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.007 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165752 s, 63.3 MB/s 2024-08-18T22:28:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149276 s, 70.2 MB/s 2024-08-18T22:28:33.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146754 s, 71.5 MB/s 2024-08-18T22:28:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238922 s, 43.9 MB/s 2024-08-18T22:28:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159986 s, 65.5 MB/s 2024-08-18T22:28:33.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141961 s, 73.9 MB/s 2024-08-18T22:28:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019233 s, 54.5 MB/s 2024-08-18T22:28:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015025 s, 69.8 MB/s 2024-08-18T22:28:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.159 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144223 s, 72.7 MB/s 2024-08-18T22:28:33.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175836 s, 59.6 MB/s 2024-08-18T22:28:33.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.207 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024014 s, 43.7 MB/s 2024-08-18T22:28:33.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.224 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150944 s, 69.5 MB/s 2024-08-18T22:28:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149091 s, 70.3 MB/s 2024-08-18T22:28:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148057 s, 70.8 MB/s 2024-08-18T22:28:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143067 s, 73.3 MB/s 2024-08-18T22:28:33.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.293 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143513 s, 73.1 MB/s 2024-08-18T22:28:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.312 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159845 s, 65.6 MB/s 2024-08-18T22:28:33.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156394 s, 67.0 MB/s 2024-08-18T22:28:33.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155503 s, 67.4 MB/s 2024-08-18T22:28:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149326 s, 70.2 MB/s 2024-08-18T22:28:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147301 s, 71.2 MB/s 2024-08-18T22:28:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189908 s, 55.2 MB/s 2024-08-18T22:28:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211815 s, 49.5 MB/s 2024-08-18T22:28:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164486 s, 63.7 MB/s 2024-08-18T22:28:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014803 s, 70.8 MB/s 2024-08-18T22:28:33.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152443 s, 68.8 MB/s 2024-08-18T22:28:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167627 s, 62.6 MB/s 2024-08-18T22:28:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207851 s, 50.4 MB/s 2024-08-18T22:28:33.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.544 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01709 s, 61.4 MB/s 2024-08-18T22:28:33.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:33.551 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:33.552 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:33.552 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.7 2024-08-18T22:28:33.552 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:33.552 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:33.552 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:33.552 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:33.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153432 s, 68.3 MB/s 2024-08-18T22:28:33.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168237 s, 62.3 MB/s 2024-08-18T22:28:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153066 s, 68.5 MB/s 2024-08-18T22:28:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173813 s, 60.3 MB/s 2024-08-18T22:28:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161717 s, 64.8 MB/s 2024-08-18T22:28:33.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153593 s, 68.3 MB/s 2024-08-18T22:28:33.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.733 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148466 s, 70.6 MB/s 2024-08-18T22:28:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180188 s, 58.2 MB/s 2024-08-18T22:28:33.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.769 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123225 s, 85.1 MB/s 2024-08-18T22:28:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154625 s, 67.8 MB/s 2024-08-18T22:28:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143807 s, 72.9 MB/s 2024-08-18T22:28:33.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.820 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141377 s, 74.2 MB/s 2024-08-18T22:28:33.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.838 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149358 s, 70.2 MB/s 2024-08-18T22:28:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143233 s, 73.2 MB/s 2024-08-18T22:28:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201973 s, 51.9 MB/s 2024-08-18T22:28:33.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147388 s, 71.1 MB/s 2024-08-18T22:28:33.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.915 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017011 s, 61.6 MB/s 2024-08-18T22:28:33.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.935 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167494 s, 62.6 MB/s 2024-08-18T22:28:33.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240461 s, 43.6 MB/s 2024-08-18T22:28:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156338 s, 67.1 MB/s 2024-08-18T22:28:33.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:33.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:33.996 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145097 s, 72.3 MB/s 2024-08-18T22:28:34.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142901 s, 73.4 MB/s 2024-08-18T22:28:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207062 s, 50.6 MB/s 2024-08-18T22:28:34.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178619 s, 58.7 MB/s 2024-08-18T22:28:34.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165547 s, 63.3 MB/s 2024-08-18T22:28:34.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183637 s, 57.1 MB/s 2024-08-18T22:28:34.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.115 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154348 s, 67.9 MB/s 2024-08-18T22:28:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168273 s, 62.3 MB/s 2024-08-18T22:28:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.153 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161062 s, 65.1 MB/s 2024-08-18T22:28:34.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.170 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143467 s, 73.1 MB/s 2024-08-18T22:28:34.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162842 s, 64.4 MB/s 2024-08-18T22:28:34.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211711 s, 49.5 MB/s 2024-08-18T22:28:34.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:34.220 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:34.220 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:34.220 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.8 2024-08-18T22:28:34.220 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:34.220 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:34.220 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:34.220 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:34.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.292 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.292 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166541 s, 63.0 MB/s 2024-08-18T22:28:34.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207758 s, 50.5 MB/s 2024-08-18T22:28:34.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.333 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152526 s, 68.7 MB/s 2024-08-18T22:28:34.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247872 s, 42.3 MB/s 2024-08-18T22:28:34.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.377 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148167 s, 70.8 MB/s 2024-08-18T22:28:34.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114138 s, 91.9 MB/s 2024-08-18T22:28:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154903 s, 67.7 MB/s 2024-08-18T22:28:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014463 s, 72.5 MB/s 2024-08-18T22:28:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151084 s, 69.4 MB/s 2024-08-18T22:28:34.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.462 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150088 s, 69.9 MB/s 2024-08-18T22:28:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190918 s, 54.9 MB/s 2024-08-18T22:28:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.500 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014058 s, 74.6 MB/s 2024-08-18T22:28:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166412 s, 63.0 MB/s 2024-08-18T22:28:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.539 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170152 s, 61.6 MB/s 2024-08-18T22:28:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212083 s, 49.4 MB/s 2024-08-18T22:28:34.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150034 s, 69.9 MB/s 2024-08-18T22:28:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146319 s, 71.7 MB/s 2024-08-18T22:28:34.615 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.615 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.615 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154176 s, 68.0 MB/s 2024-08-18T22:28:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242443 s, 43.3 MB/s 2024-08-18T22:28:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164886 s, 63.6 MB/s 2024-08-18T22:28:34.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155565 s, 67.4 MB/s 2024-08-18T22:28:34.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.699 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170021 s, 61.7 MB/s 2024-08-18T22:28:34.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150571 s, 69.6 MB/s 2024-08-18T22:28:34.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165714 s, 63.3 MB/s 2024-08-18T22:28:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145622 s, 72.0 MB/s 2024-08-18T22:28:34.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204546 s, 51.3 MB/s 2024-08-18T22:28:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143969 s, 72.8 MB/s 2024-08-18T22:28:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168678 s, 62.2 MB/s 2024-08-18T22:28:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149817 s, 70.0 MB/s 2024-08-18T22:28:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.857 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209457 s, 50.1 MB/s 2024-08-18T22:28:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161891 s, 64.8 MB/s 2024-08-18T22:28:34.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.894 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014854 s, 70.6 MB/s 2024-08-18T22:28:34.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:34.902 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:34.902 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:34.902 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.9 2024-08-18T22:28:34.902 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:34.902 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:34.902 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:34.902 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:34.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191192 s, 54.8 MB/s 2024-08-18T22:28:34.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:34.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:34.993 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146088 s, 71.8 MB/s 2024-08-18T22:28:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.011 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150945 s, 69.5 MB/s 2024-08-18T22:28:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145685 s, 72.0 MB/s 2024-08-18T22:28:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163688 s, 64.1 MB/s 2024-08-18T22:28:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171444 s, 61.2 MB/s 2024-08-18T22:28:35.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169854 s, 61.7 MB/s 2024-08-18T22:28:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167319 s, 62.7 MB/s 2024-08-18T22:28:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159067 s, 65.9 MB/s 2024-08-18T22:28:35.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156517 s, 67.0 MB/s 2024-08-18T22:28:35.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024269 s, 43.2 MB/s 2024-08-18T22:28:35.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.189 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175416 s, 59.8 MB/s 2024-08-18T22:28:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016772 s, 62.5 MB/s 2024-08-18T22:28:35.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.227 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01614 s, 65.0 MB/s 2024-08-18T22:28:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.244 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141763 s, 74.0 MB/s 2024-08-18T22:28:35.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168878 s, 62.1 MB/s 2024-08-18T22:28:35.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.285 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193264 s, 54.3 MB/s 2024-08-18T22:28:35.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015087 s, 69.5 MB/s 2024-08-18T22:28:35.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.322 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149615 s, 70.1 MB/s 2024-08-18T22:28:35.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.341 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183171 s, 57.2 MB/s 2024-08-18T22:28:35.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170446 s, 61.5 MB/s 2024-08-18T22:28:35.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164416 s, 63.8 MB/s 2024-08-18T22:28:35.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.399 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153558 s, 68.3 MB/s 2024-08-18T22:28:35.415 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147957 s, 70.9 MB/s 2024-08-18T22:28:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150359 s, 69.7 MB/s 2024-08-18T22:28:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168199 s, 62.3 MB/s 2024-08-18T22:28:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015337 s, 68.4 MB/s 2024-08-18T22:28:35.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163727 s, 64.0 MB/s 2024-08-18T22:28:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016766 s, 62.5 MB/s 2024-08-18T22:28:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.527 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160127 s, 65.5 MB/s 2024-08-18T22:28:35.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.545 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146497 s, 71.6 MB/s 2024-08-18T22:28:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149842 s, 70.0 MB/s 2024-08-18T22:28:35.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:35.569 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:35.570 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:35.570 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.10 2024-08-18T22:28:35.570 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:35.570 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:35.570 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:35.570 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.641 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170861 s, 61.4 MB/s 2024-08-18T22:28:35.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225949 s, 46.4 MB/s 2024-08-18T22:28:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163659 s, 64.1 MB/s 2024-08-18T22:28:35.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197456 s, 53.1 MB/s 2024-08-18T22:28:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218119 s, 48.1 MB/s 2024-08-18T22:28:35.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.753 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187349 s, 56.0 MB/s 2024-08-18T22:28:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141406 s, 74.2 MB/s 2024-08-18T22:28:35.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.788 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151285 s, 69.3 MB/s 2024-08-18T22:28:35.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.804 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142211 s, 73.7 MB/s 2024-08-18T22:28:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.823 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155144 s, 67.6 MB/s 2024-08-18T22:28:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121348 s, 86.4 MB/s 2024-08-18T22:28:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237861 s, 44.1 MB/s 2024-08-18T22:28:35.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.881 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154417 s, 67.9 MB/s 2024-08-18T22:28:35.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.901 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174364 s, 60.1 MB/s 2024-08-18T22:28:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217592 s, 48.2 MB/s 2024-08-18T22:28:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014358 s, 73.0 MB/s 2024-08-18T22:28:35.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166297 s, 63.1 MB/s 2024-08-18T22:28:35.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.980 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152163 s, 68.9 MB/s 2024-08-18T22:28:35.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:35.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:35.997 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149367 s, 70.2 MB/s 2024-08-18T22:28:36.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.012 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117258 s, 89.4 MB/s 2024-08-18T22:28:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196726 s, 53.3 MB/s 2024-08-18T22:28:36.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.053 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166625 s, 62.9 MB/s 2024-08-18T22:28:36.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.070 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149392 s, 70.2 MB/s 2024-08-18T22:28:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163186 s, 64.3 MB/s 2024-08-18T22:28:36.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.109 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172692 s, 60.7 MB/s 2024-08-18T22:28:36.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170009 s, 61.7 MB/s 2024-08-18T22:28:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198578 s, 52.8 MB/s 2024-08-18T22:28:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169629 s, 61.8 MB/s 2024-08-18T22:28:36.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016257 s, 64.5 MB/s 2024-08-18T22:28:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.215 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235254 s, 44.6 MB/s 2024-08-18T22:28:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212131 s, 49.4 MB/s 2024-08-18T22:28:36.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.258 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154768 s, 67.8 MB/s 2024-08-18T22:28:36.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:36.265 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:36.265 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:36.265 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.11 2024-08-18T22:28:36.265 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:36.265 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:36.265 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:36.265 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:36.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:36.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.376 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164555 s, 63.7 MB/s 2024-08-18T22:28:36.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.397 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179628 s, 58.4 MB/s 2024-08-18T22:28:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147244 s, 71.2 MB/s 2024-08-18T22:28:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201817 s, 52.0 MB/s 2024-08-18T22:28:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215182 s, 48.7 MB/s 2024-08-18T22:28:36.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150144 s, 69.8 MB/s 2024-08-18T22:28:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153657 s, 68.2 MB/s 2024-08-18T22:28:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.521 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204565 s, 51.3 MB/s 2024-08-18T22:28:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157476 s, 66.6 MB/s 2024-08-18T22:28:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147679 s, 71.0 MB/s 2024-08-18T22:28:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.577 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156257 s, 67.1 MB/s 2024-08-18T22:28:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143893 s, 72.9 MB/s 2024-08-18T22:28:36.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.613 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166876 s, 62.8 MB/s 2024-08-18T22:28:36.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168084 s, 62.4 MB/s 2024-08-18T22:28:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.649 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147998 s, 70.9 MB/s 2024-08-18T22:28:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150027 s, 69.9 MB/s 2024-08-18T22:28:36.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183043 s, 57.3 MB/s 2024-08-18T22:28:36.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025048 s, 41.9 MB/s 2024-08-18T22:28:36.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146123 s, 71.8 MB/s 2024-08-18T22:28:36.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109268 s, 96.0 MB/s 2024-08-18T22:28:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113262 s, 92.6 MB/s 2024-08-18T22:28:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149 s, 70.4 MB/s 2024-08-18T22:28:36.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.796 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149545 s, 70.1 MB/s 2024-08-18T22:28:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147844 s, 70.9 MB/s 2024-08-18T22:28:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.837 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212128 s, 49.4 MB/s 2024-08-18T22:28:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.857 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169336 s, 61.9 MB/s 2024-08-18T22:28:36.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.875 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149421 s, 70.2 MB/s 2024-08-18T22:28:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242247 s, 43.3 MB/s 2024-08-18T22:28:36.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.919 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147313 s, 71.2 MB/s 2024-08-18T22:28:36.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.936 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148051 s, 70.8 MB/s 2024-08-18T22:28:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147641 s, 71.0 MB/s 2024-08-18T22:28:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146382 s, 71.6 MB/s 2024-08-18T22:28:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:36.978 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:36.978 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:36.978 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.12 2024-08-18T22:28:36.979 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:36.979 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:36.979 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:36.979 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210615 s, 49.8 MB/s 2024-08-18T22:28:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163925 s, 64.0 MB/s 2024-08-18T22:28:37.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.091 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147094 s, 71.3 MB/s 2024-08-18T22:28:37.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155176 s, 67.6 MB/s 2024-08-18T22:28:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150456 s, 69.7 MB/s 2024-08-18T22:28:37.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.147 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171347 s, 61.2 MB/s 2024-08-18T22:28:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241885 s, 43.4 MB/s 2024-08-18T22:28:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177511 s, 59.1 MB/s 2024-08-18T22:28:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187044 s, 56.1 MB/s 2024-08-18T22:28:37.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.232 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146348 s, 71.6 MB/s 2024-08-18T22:28:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.256 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209924 s, 50.0 MB/s 2024-08-18T22:28:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165755 s, 63.3 MB/s 2024-08-18T22:28:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153453 s, 68.3 MB/s 2024-08-18T22:28:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170761 s, 61.4 MB/s 2024-08-18T22:28:37.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146307 s, 71.7 MB/s 2024-08-18T22:28:37.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154439 s, 67.9 MB/s 2024-08-18T22:28:37.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.365 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147817 s, 70.9 MB/s 2024-08-18T22:28:37.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.385 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176206 s, 59.5 MB/s 2024-08-18T22:28:37.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172575 s, 60.8 MB/s 2024-08-18T22:28:37.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.423 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150858 s, 69.5 MB/s 2024-08-18T22:28:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165305 s, 63.4 MB/s 2024-08-18T22:28:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171778 s, 61.0 MB/s 2024-08-18T22:28:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164775 s, 63.6 MB/s 2024-08-18T22:28:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149506 s, 70.1 MB/s 2024-08-18T22:28:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151842 s, 69.1 MB/s 2024-08-18T22:28:37.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171958 s, 61.0 MB/s 2024-08-18T22:28:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217036 s, 48.3 MB/s 2024-08-18T22:28:37.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175658 s, 59.7 MB/s 2024-08-18T22:28:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.600 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169838 s, 61.7 MB/s 2024-08-18T22:28:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014546 s, 72.1 MB/s 2024-08-18T22:28:37.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.635 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01476 s, 71.0 MB/s 2024-08-18T22:28:37.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.658 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215807 s, 48.6 MB/s 2024-08-18T22:28:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:37.666 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:37.666 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:37.666 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.13 2024-08-18T22:28:37.666 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:37.666 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:37.666 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:37.667 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209243 s, 50.1 MB/s 2024-08-18T22:28:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176086 s, 59.5 MB/s 2024-08-18T22:28:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201777 s, 52.0 MB/s 2024-08-18T22:28:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.805 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153069 s, 68.5 MB/s 2024-08-18T22:28:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018231 s, 57.5 MB/s 2024-08-18T22:28:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139363 s, 75.2 MB/s 2024-08-18T22:28:37.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170567 s, 61.5 MB/s 2024-08-18T22:28:37.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212775 s, 49.3 MB/s 2024-08-18T22:28:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170743 s, 61.4 MB/s 2024-08-18T22:28:37.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214494 s, 48.9 MB/s 2024-08-18T22:28:37.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143273 s, 73.2 MB/s 2024-08-18T22:28:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152096 s, 68.9 MB/s 2024-08-18T22:28:37.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:37.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:37.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172385 s, 60.8 MB/s 2024-08-18T22:28:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157907 s, 66.4 MB/s 2024-08-18T22:28:38.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.020 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142673 s, 73.5 MB/s 2024-08-18T22:28:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168759 s, 62.1 MB/s 2024-08-18T22:28:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145587 s, 72.0 MB/s 2024-08-18T22:28:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213181 s, 49.2 MB/s 2024-08-18T22:28:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176534 s, 59.4 MB/s 2024-08-18T22:28:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.119 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160429 s, 65.4 MB/s 2024-08-18T22:28:38.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.136 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146769 s, 71.4 MB/s 2024-08-18T22:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165617 s, 63.3 MB/s 2024-08-18T22:28:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146862 s, 71.4 MB/s 2024-08-18T22:28:38.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.197 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215642 s, 48.6 MB/s 2024-08-18T22:28:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147755 s, 71.0 MB/s 2024-08-18T22:28:38.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.237 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202695 s, 51.7 MB/s 2024-08-18T22:28:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212355 s, 49.4 MB/s 2024-08-18T22:28:38.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.278 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153044 s, 68.5 MB/s 2024-08-18T22:28:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.297 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.298 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167774 s, 62.5 MB/s 2024-08-18T22:28:38.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152433 s, 68.8 MB/s 2024-08-18T22:28:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.338 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198844 s, 52.7 MB/s 2024-08-18T22:28:38.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152344 s, 68.8 MB/s 2024-08-18T22:28:38.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:38.363 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:38.363 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:38.363 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.14 2024-08-18T22:28:38.363 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:38.363 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:38.363 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:38.363 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:38.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:38.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.433 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151061 s, 69.4 MB/s 2024-08-18T22:28:38.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.454 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180654 s, 58.0 MB/s 2024-08-18T22:28:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152931 s, 68.6 MB/s 2024-08-18T22:28:38.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.494 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197014 s, 53.2 MB/s 2024-08-18T22:28:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169051 s, 62.0 MB/s 2024-08-18T22:28:38.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.538 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215848 s, 48.6 MB/s 2024-08-18T22:28:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151964 s, 69.0 MB/s 2024-08-18T22:28:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143012 s, 73.3 MB/s 2024-08-18T22:28:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.591 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150299 s, 69.8 MB/s 2024-08-18T22:28:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016542 s, 63.4 MB/s 2024-08-18T22:28:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.632 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208363 s, 50.3 MB/s 2024-08-18T22:28:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160077 s, 65.5 MB/s 2024-08-18T22:28:38.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.670 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161918 s, 64.8 MB/s 2024-08-18T22:28:38.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.692 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198559 s, 52.8 MB/s 2024-08-18T22:28:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211945 s, 49.5 MB/s 2024-08-18T22:28:38.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.734 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157107 s, 66.7 MB/s 2024-08-18T22:28:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149928 s, 69.9 MB/s 2024-08-18T22:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148041 s, 70.8 MB/s 2024-08-18T22:28:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154231 s, 68.0 MB/s 2024-08-18T22:28:38.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.805 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149139 s, 70.3 MB/s 2024-08-18T22:28:38.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115956 s, 90.4 MB/s 2024-08-18T22:28:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.838 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164231 s, 63.8 MB/s 2024-08-18T22:28:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.856 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155527 s, 67.4 MB/s 2024-08-18T22:28:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169222 s, 62.0 MB/s 2024-08-18T22:28:38.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.893 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.893 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149082 s, 70.3 MB/s 2024-08-18T22:28:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167525 s, 62.6 MB/s 2024-08-18T22:28:38.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149292 s, 70.2 MB/s 2024-08-18T22:28:38.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162304 s, 64.6 MB/s 2024-08-18T22:28:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139624 s, 75.1 MB/s 2024-08-18T22:28:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:38.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:38.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168445 s, 62.3 MB/s 2024-08-18T22:28:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.004 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167911 s, 62.4 MB/s 2024-08-18T22:28:39.022 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.022 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.022 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157679 s, 66.5 MB/s 2024-08-18T22:28:39.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:39.030 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:39.030 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:39.030 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.15 2024-08-18T22:28:39.030 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:39.030 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:39.030 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:39.030 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:39.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:39.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.144 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016569 s, 63.3 MB/s 2024-08-18T22:28:39.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160746 s, 65.2 MB/s 2024-08-18T22:28:39.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142366 s, 73.7 MB/s 2024-08-18T22:28:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173286 s, 60.5 MB/s 2024-08-18T22:28:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017282 s, 60.7 MB/s 2024-08-18T22:28:39.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.239 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170095 s, 61.6 MB/s 2024-08-18T22:28:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145845 s, 71.9 MB/s 2024-08-18T22:28:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138308 s, 75.8 MB/s 2024-08-18T22:28:39.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.290 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150434 s, 69.7 MB/s 2024-08-18T22:28:39.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173606 s, 60.4 MB/s 2024-08-18T22:28:39.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146427 s, 71.6 MB/s 2024-08-18T22:28:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.344 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141853 s, 73.9 MB/s 2024-08-18T22:28:39.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156968 s, 66.8 MB/s 2024-08-18T22:28:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176037 s, 59.6 MB/s 2024-08-18T22:28:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154897 s, 67.7 MB/s 2024-08-18T22:28:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176035 s, 59.6 MB/s 2024-08-18T22:28:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151778 s, 69.1 MB/s 2024-08-18T22:28:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140129 s, 74.8 MB/s 2024-08-18T22:28:39.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148901 s, 70.4 MB/s 2024-08-18T22:28:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.491 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152139 s, 68.9 MB/s 2024-08-18T22:28:39.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202377 s, 51.8 MB/s 2024-08-18T22:28:39.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.541 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024241 s, 43.3 MB/s 2024-08-18T22:28:39.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.559 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015488 s, 67.7 MB/s 2024-08-18T22:28:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.579 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165768 s, 63.3 MB/s 2024-08-18T22:28:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199195 s, 52.6 MB/s 2024-08-18T22:28:39.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015271 s, 68.7 MB/s 2024-08-18T22:28:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164729 s, 63.7 MB/s 2024-08-18T22:28:39.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.656 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159724 s, 65.6 MB/s 2024-08-18T22:28:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199006 s, 52.7 MB/s 2024-08-18T22:28:39.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147939 s, 70.9 MB/s 2024-08-18T22:28:39.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.714 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148077 s, 70.8 MB/s 2024-08-18T22:28:39.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.734 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179092 s, 58.5 MB/s 2024-08-18T22:28:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:39.742 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:39.742 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:39.742 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.16 2024-08-18T22:28:39.742 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:39.742 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:39.742 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:39.742 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:39.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223011 s, 47.0 MB/s 2024-08-18T22:28:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220393 s, 47.6 MB/s 2024-08-18T22:28:39.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150146 s, 69.8 MB/s 2024-08-18T22:28:39.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149509 s, 70.1 MB/s 2024-08-18T22:28:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204729 s, 51.2 MB/s 2024-08-18T22:28:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145681 s, 72.0 MB/s 2024-08-18T22:28:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.936 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139778 s, 75.0 MB/s 2024-08-18T22:28:39.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.956 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172186 s, 60.9 MB/s 2024-08-18T22:28:39.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:39.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:39.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239837 s, 43.7 MB/s 2024-08-18T22:28:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151639 s, 69.1 MB/s 2024-08-18T22:28:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150034 s, 69.9 MB/s 2024-08-18T22:28:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207574 s, 50.5 MB/s 2024-08-18T22:28:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155613 s, 67.4 MB/s 2024-08-18T22:28:40.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200043 s, 52.4 MB/s 2024-08-18T22:28:40.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.105 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204089 s, 51.4 MB/s 2024-08-18T22:28:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148433 s, 70.6 MB/s 2024-08-18T22:28:40.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141325 s, 74.2 MB/s 2024-08-18T22:28:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.153 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011006 s, 95.3 MB/s 2024-08-18T22:28:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243924 s, 43.0 MB/s 2024-08-18T22:28:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161907 s, 64.8 MB/s 2024-08-18T22:28:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.216 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146258 s, 71.7 MB/s 2024-08-18T22:28:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015183 s, 69.1 MB/s 2024-08-18T22:28:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147924 s, 70.9 MB/s 2024-08-18T22:28:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163745 s, 64.0 MB/s 2024-08-18T22:28:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.289 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170487 s, 61.5 MB/s 2024-08-18T22:28:40.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154621 s, 67.8 MB/s 2024-08-18T22:28:40.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179591 s, 58.4 MB/s 2024-08-18T22:28:40.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165778 s, 63.3 MB/s 2024-08-18T22:28:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.371 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216191 s, 48.5 MB/s 2024-08-18T22:28:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168726 s, 62.1 MB/s 2024-08-18T22:28:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011775 s, 89.1 MB/s 2024-08-18T22:28:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150977 s, 69.5 MB/s 2024-08-18T22:28:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:40.430 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:40.430 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:40.430 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.17 2024-08-18T22:28:40.430 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:40.430 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:40.431 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:40.431 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:40.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:40.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.544 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165715 s, 63.3 MB/s 2024-08-18T22:28:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162005 s, 64.7 MB/s 2024-08-18T22:28:40.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239296 s, 43.8 MB/s 2024-08-18T22:28:40.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162232 s, 64.6 MB/s 2024-08-18T22:28:40.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163653 s, 64.1 MB/s 2024-08-18T22:28:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171447 s, 61.2 MB/s 2024-08-18T22:28:40.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154718 s, 67.8 MB/s 2024-08-18T22:28:40.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152518 s, 68.8 MB/s 2024-08-18T22:28:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166789 s, 62.9 MB/s 2024-08-18T22:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154495 s, 67.9 MB/s 2024-08-18T22:28:40.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170223 s, 61.6 MB/s 2024-08-18T22:28:40.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143793 s, 72.9 MB/s 2024-08-18T22:28:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019236 s, 54.5 MB/s 2024-08-18T22:28:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157366 s, 66.6 MB/s 2024-08-18T22:28:40.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149913 s, 69.9 MB/s 2024-08-18T22:28:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152647 s, 68.7 MB/s 2024-08-18T22:28:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175197 s, 59.9 MB/s 2024-08-18T22:28:40.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.874 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.874 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195024 s, 53.8 MB/s 2024-08-18T22:28:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142614 s, 73.5 MB/s 2024-08-18T22:28:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155642 s, 67.4 MB/s 2024-08-18T22:28:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140314 s, 74.7 MB/s 2024-08-18T22:28:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148001 s, 70.8 MB/s 2024-08-18T22:28:40.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.960 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139881 s, 75.0 MB/s 2024-08-18T22:28:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205261 s, 51.1 MB/s 2024-08-18T22:28:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017731 s, 59.1 MB/s 2024-08-18T22:28:41.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.027 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212294 s, 49.4 MB/s 2024-08-18T22:28:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176097 s, 59.5 MB/s 2024-08-18T22:28:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.067 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017386 s, 60.3 MB/s 2024-08-18T22:28:41.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122558 s, 85.6 MB/s 2024-08-18T22:28:41.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150078 s, 69.9 MB/s 2024-08-18T22:28:41.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.120 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171235 s, 61.2 MB/s 2024-08-18T22:28:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196994 s, 53.2 MB/s 2024-08-18T22:28:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:41.149 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:41.149 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:41.149 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.18 2024-08-18T22:28:41.149 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:41.149 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:41.150 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:41.150 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:41.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.220 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156778 s, 66.9 MB/s 2024-08-18T22:28:41.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.239 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163586 s, 64.1 MB/s 2024-08-18T22:28:41.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.258 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166505 s, 63.0 MB/s 2024-08-18T22:28:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014151 s, 74.1 MB/s 2024-08-18T22:28:41.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.290 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122069 s, 85.9 MB/s 2024-08-18T22:28:41.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.313 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205726 s, 51.0 MB/s 2024-08-18T22:28:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196017 s, 53.5 MB/s 2024-08-18T22:28:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155345 s, 67.5 MB/s 2024-08-18T22:28:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015315 s, 68.5 MB/s 2024-08-18T22:28:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139363 s, 75.2 MB/s 2024-08-18T22:28:41.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175562 s, 59.7 MB/s 2024-08-18T22:28:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150356 s, 69.7 MB/s 2024-08-18T22:28:41.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116319 s, 90.1 MB/s 2024-08-18T22:28:41.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135112 s, 77.6 MB/s 2024-08-18T22:28:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149456 s, 70.2 MB/s 2024-08-18T22:28:41.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.502 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026001 s, 40.3 MB/s 2024-08-18T22:28:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238552 s, 44.0 MB/s 2024-08-18T22:28:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200591 s, 52.3 MB/s 2024-08-18T22:28:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149601 s, 70.1 MB/s 2024-08-18T22:28:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167708 s, 62.5 MB/s 2024-08-18T22:28:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174971 s, 59.9 MB/s 2024-08-18T22:28:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209557 s, 50.0 MB/s 2024-08-18T22:28:41.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.649 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143165 s, 73.2 MB/s 2024-08-18T22:28:41.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161171 s, 65.1 MB/s 2024-08-18T22:28:41.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145531 s, 72.1 MB/s 2024-08-18T22:28:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169346 s, 61.9 MB/s 2024-08-18T22:28:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178767 s, 58.7 MB/s 2024-08-18T22:28:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148735 s, 70.5 MB/s 2024-08-18T22:28:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177486 s, 59.1 MB/s 2024-08-18T22:28:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018288 s, 57.3 MB/s 2024-08-18T22:28:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148811 s, 70.5 MB/s 2024-08-18T22:28:41.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209697 s, 50.0 MB/s 2024-08-18T22:28:41.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:41.833 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:41.833 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:41.833 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.19 2024-08-18T22:28:41.833 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:41.833 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:41.833 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:41.833 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:41.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018048 s, 58.1 MB/s 2024-08-18T22:28:41.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239455 s, 43.8 MB/s 2024-08-18T22:28:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160834 s, 65.2 MB/s 2024-08-18T22:28:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151976 s, 69.0 MB/s 2024-08-18T22:28:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153489 s, 68.3 MB/s 2024-08-18T22:28:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168206 s, 62.3 MB/s 2024-08-18T22:28:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173449 s, 60.5 MB/s 2024-08-18T22:28:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205885 s, 50.9 MB/s 2024-08-18T22:28:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171587 s, 61.1 MB/s 2024-08-18T22:28:42.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172419 s, 60.8 MB/s 2024-08-18T22:28:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153138 s, 68.5 MB/s 2024-08-18T22:28:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170676 s, 61.4 MB/s 2024-08-18T22:28:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219094 s, 47.9 MB/s 2024-08-18T22:28:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167223 s, 62.7 MB/s 2024-08-18T22:28:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147626 s, 71.0 MB/s 2024-08-18T22:28:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015063 s, 69.6 MB/s 2024-08-18T22:28:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147337 s, 71.2 MB/s 2024-08-18T22:28:42.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145213 s, 72.2 MB/s 2024-08-18T22:28:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160444 s, 65.4 MB/s 2024-08-18T22:28:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157784 s, 66.5 MB/s 2024-08-18T22:28:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015603 s, 67.2 MB/s 2024-08-18T22:28:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164145 s, 63.9 MB/s 2024-08-18T22:28:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226004 s, 46.4 MB/s 2024-08-18T22:28:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015325 s, 68.4 MB/s 2024-08-18T22:28:42.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.376 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169077 s, 62.0 MB/s 2024-08-18T22:28:42.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.393 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146553 s, 71.5 MB/s 2024-08-18T22:28:42.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.410 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145157 s, 72.2 MB/s 2024-08-18T22:28:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024067 s, 43.6 MB/s 2024-08-18T22:28:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.454 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148213 s, 70.7 MB/s 2024-08-18T22:28:42.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.472 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152579 s, 68.7 MB/s 2024-08-18T22:28:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152281 s, 68.9 MB/s 2024-08-18T22:28:42.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164855 s, 63.6 MB/s 2024-08-18T22:28:42.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:42.516 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:42.516 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:42.516 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.20 2024-08-18T22:28:42.516 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:42.516 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:42.516 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:42.517 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:42.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154934 s, 67.7 MB/s 2024-08-18T22:28:42.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.647 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176105 s, 59.5 MB/s 2024-08-18T22:28:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152925 s, 68.6 MB/s 2024-08-18T22:28:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.687 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160166 s, 65.5 MB/s 2024-08-18T22:28:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149378 s, 70.2 MB/s 2024-08-18T22:28:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184627 s, 56.8 MB/s 2024-08-18T22:28:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166489 s, 63.0 MB/s 2024-08-18T22:28:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016694 s, 62.8 MB/s 2024-08-18T22:28:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161323 s, 65.0 MB/s 2024-08-18T22:28:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175418 s, 59.8 MB/s 2024-08-18T22:28:42.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168484 s, 62.2 MB/s 2024-08-18T22:28:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169697 s, 61.8 MB/s 2024-08-18T22:28:42.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.856 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155052 s, 67.6 MB/s 2024-08-18T22:28:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.875 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016536 s, 63.4 MB/s 2024-08-18T22:28:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.894 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160271 s, 65.4 MB/s 2024-08-18T22:28:42.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178335 s, 58.8 MB/s 2024-08-18T22:28:42.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01529 s, 68.6 MB/s 2024-08-18T22:28:42.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148593 s, 70.6 MB/s 2024-08-18T22:28:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169279 s, 61.9 MB/s 2024-08-18T22:28:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163105 s, 64.3 MB/s 2024-08-18T22:28:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159982 s, 65.5 MB/s 2024-08-18T22:28:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157557 s, 66.6 MB/s 2024-08-18T22:28:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153953 s, 68.1 MB/s 2024-08-18T22:28:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153564 s, 68.3 MB/s 2024-08-18T22:28:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.078 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149063 s, 70.3 MB/s 2024-08-18T22:28:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157331 s, 66.6 MB/s 2024-08-18T22:28:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171658 s, 61.1 MB/s 2024-08-18T22:28:43.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151708 s, 69.1 MB/s 2024-08-18T22:28:43.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.154 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177121 s, 59.2 MB/s 2024-08-18T22:28:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174361 s, 60.1 MB/s 2024-08-18T22:28:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219821 s, 47.7 MB/s 2024-08-18T22:28:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171088 s, 61.3 MB/s 2024-08-18T22:28:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:43.226 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:43.226 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:43.226 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.21 2024-08-18T22:28:43.226 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:43.226 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:43.226 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:43.226 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:43.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150173 s, 69.8 MB/s 2024-08-18T22:28:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.312 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147577 s, 71.1 MB/s 2024-08-18T22:28:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160492 s, 65.3 MB/s 2024-08-18T22:28:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167164 s, 62.7 MB/s 2024-08-18T22:28:43.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146266 s, 71.7 MB/s 2024-08-18T22:28:43.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.395 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250558 s, 41.8 MB/s 2024-08-18T22:28:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176912 s, 59.3 MB/s 2024-08-18T22:28:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173058 s, 60.6 MB/s 2024-08-18T22:28:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175242 s, 59.8 MB/s 2024-08-18T22:28:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243281 s, 43.1 MB/s 2024-08-18T22:28:43.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.502 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016543 s, 63.4 MB/s 2024-08-18T22:28:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153814 s, 68.2 MB/s 2024-08-18T22:28:43.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.538 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156167 s, 67.1 MB/s 2024-08-18T22:28:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158327 s, 66.2 MB/s 2024-08-18T22:28:43.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.573 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148672 s, 70.5 MB/s 2024-08-18T22:28:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.597 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207305 s, 50.6 MB/s 2024-08-18T22:28:43.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144752 s, 72.4 MB/s 2024-08-18T22:28:43.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142819 s, 73.4 MB/s 2024-08-18T22:28:43.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.649 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151971 s, 69.0 MB/s 2024-08-18T22:28:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150971 s, 69.5 MB/s 2024-08-18T22:28:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.686 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173933 s, 60.3 MB/s 2024-08-18T22:28:43.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151951 s, 69.0 MB/s 2024-08-18T22:28:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163903 s, 64.0 MB/s 2024-08-18T22:28:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177588 s, 59.0 MB/s 2024-08-18T22:28:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157579 s, 66.5 MB/s 2024-08-18T22:28:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170088 s, 61.6 MB/s 2024-08-18T22:28:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180364 s, 58.1 MB/s 2024-08-18T22:28:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.829 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246887 s, 42.5 MB/s 2024-08-18T22:28:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147178 s, 71.2 MB/s 2024-08-18T22:28:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.866 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164326 s, 63.8 MB/s 2024-08-18T22:28:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174698 s, 60.0 MB/s 2024-08-18T22:28:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194519 s, 53.9 MB/s 2024-08-18T22:28:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:43.919 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:43.919 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:43.919 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.22 2024-08-18T22:28:43.919 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:43.919 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:43.920 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:43.920 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:43.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149193 s, 70.3 MB/s 2024-08-18T22:28:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.007 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148433 s, 70.6 MB/s 2024-08-18T22:28:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167418 s, 62.6 MB/s 2024-08-18T22:28:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150576 s, 69.6 MB/s 2024-08-18T22:28:44.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.063 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165118 s, 63.5 MB/s 2024-08-18T22:28:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172216 s, 60.9 MB/s 2024-08-18T22:28:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.102 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168056 s, 62.4 MB/s 2024-08-18T22:28:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017676 s, 59.3 MB/s 2024-08-18T22:28:44.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.141 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159083 s, 65.9 MB/s 2024-08-18T22:28:44.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.156 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123866 s, 84.7 MB/s 2024-08-18T22:28:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161307 s, 65.0 MB/s 2024-08-18T22:28:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224943 s, 46.6 MB/s 2024-08-18T22:28:44.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199286 s, 52.6 MB/s 2024-08-18T22:28:44.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174652 s, 60.0 MB/s 2024-08-18T22:28:44.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168793 s, 62.1 MB/s 2024-08-18T22:28:44.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205822 s, 50.9 MB/s 2024-08-18T22:28:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.304 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168353 s, 62.3 MB/s 2024-08-18T22:28:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199252 s, 52.6 MB/s 2024-08-18T22:28:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171725 s, 61.1 MB/s 2024-08-18T22:28:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155015 s, 67.6 MB/s 2024-08-18T22:28:44.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145589 s, 72.0 MB/s 2024-08-18T22:28:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156589 s, 67.0 MB/s 2024-08-18T22:28:44.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166607 s, 62.9 MB/s 2024-08-18T22:28:44.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.441 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191416 s, 54.8 MB/s 2024-08-18T22:28:44.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208135 s, 50.4 MB/s 2024-08-18T22:28:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.484 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169573 s, 61.8 MB/s 2024-08-18T22:28:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145484 s, 72.1 MB/s 2024-08-18T22:28:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151984 s, 69.0 MB/s 2024-08-18T22:28:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.540 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185011 s, 56.7 MB/s 2024-08-18T22:28:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015244 s, 68.8 MB/s 2024-08-18T22:28:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152878 s, 68.6 MB/s 2024-08-18T22:28:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151876 s, 69.0 MB/s 2024-08-18T22:28:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:44.601 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:44.601 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:44.601 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.23 2024-08-18T22:28:44.601 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:44.601 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:44.601 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:44.601 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157534 s, 66.6 MB/s 2024-08-18T22:28:44.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175846 s, 59.6 MB/s 2024-08-18T22:28:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169981 s, 61.7 MB/s 2024-08-18T22:28:44.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.779 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196443 s, 53.4 MB/s 2024-08-18T22:28:44.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.798 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167615 s, 62.6 MB/s 2024-08-18T22:28:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201346 s, 52.1 MB/s 2024-08-18T22:28:44.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159067 s, 65.9 MB/s 2024-08-18T22:28:44.857 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159038 s, 65.9 MB/s 2024-08-18T22:28:44.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154936 s, 67.7 MB/s 2024-08-18T22:28:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181045 s, 57.9 MB/s 2024-08-18T22:28:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.916 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173242 s, 60.5 MB/s 2024-08-18T22:28:44.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242105 s, 43.3 MB/s 2024-08-18T22:28:44.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162508 s, 64.5 MB/s 2024-08-18T22:28:44.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:44.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:44.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170046 s, 61.7 MB/s 2024-08-18T22:28:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.009 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247639 s, 42.3 MB/s 2024-08-18T22:28:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.027 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156752 s, 66.9 MB/s 2024-08-18T22:28:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156726 s, 66.9 MB/s 2024-08-18T22:28:45.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.072 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236226 s, 44.4 MB/s 2024-08-18T22:28:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117448 s, 89.3 MB/s 2024-08-18T22:28:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.109 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207928 s, 50.4 MB/s 2024-08-18T22:28:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.126 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145837 s, 71.9 MB/s 2024-08-18T22:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168146 s, 62.4 MB/s 2024-08-18T22:28:45.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205783 s, 51.0 MB/s 2024-08-18T22:28:45.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.186 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149181 s, 70.3 MB/s 2024-08-18T22:28:45.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193615 s, 54.2 MB/s 2024-08-18T22:28:45.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.227 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162784 s, 64.4 MB/s 2024-08-18T22:28:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211572 s, 49.6 MB/s 2024-08-18T22:28:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.269 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152381 s, 68.8 MB/s 2024-08-18T22:28:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015651 s, 67.0 MB/s 2024-08-18T22:28:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143304 s, 73.2 MB/s 2024-08-18T22:28:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.326 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193221 s, 54.3 MB/s 2024-08-18T22:28:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182738 s, 57.4 MB/s 2024-08-18T22:28:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:45.356 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:45.356 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:45.356 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.24 2024-08-18T22:28:45.356 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:45.356 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:45.356 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:45.356 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:45.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175466 s, 59.8 MB/s 2024-08-18T22:28:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015755 s, 66.6 MB/s 2024-08-18T22:28:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152448 s, 68.8 MB/s 2024-08-18T22:28:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.483 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152053 s, 69.0 MB/s 2024-08-18T22:28:45.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123121 s, 85.2 MB/s 2024-08-18T22:28:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172073 s, 60.9 MB/s 2024-08-18T22:28:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159786 s, 65.6 MB/s 2024-08-18T22:28:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147198 s, 71.2 MB/s 2024-08-18T22:28:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.572 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161914 s, 64.8 MB/s 2024-08-18T22:28:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155011 s, 67.6 MB/s 2024-08-18T22:28:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.607 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141638 s, 74.0 MB/s 2024-08-18T22:28:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174912 s, 59.9 MB/s 2024-08-18T22:28:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.641 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011818 s, 88.7 MB/s 2024-08-18T22:28:45.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155339 s, 67.5 MB/s 2024-08-18T22:28:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169805 s, 61.8 MB/s 2024-08-18T22:28:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164503 s, 63.7 MB/s 2024-08-18T22:28:45.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.718 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170937 s, 61.3 MB/s 2024-08-18T22:28:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015358 s, 68.3 MB/s 2024-08-18T22:28:45.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.757 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168137 s, 62.4 MB/s 2024-08-18T22:28:45.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.774 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143247 s, 73.2 MB/s 2024-08-18T22:28:45.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163511 s, 64.1 MB/s 2024-08-18T22:28:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.813 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016696 s, 62.8 MB/s 2024-08-18T22:28:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.832 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154619 s, 67.8 MB/s 2024-08-18T22:28:45.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.852 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173759 s, 60.3 MB/s 2024-08-18T22:28:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154124 s, 68.0 MB/s 2024-08-18T22:28:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.889 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158802 s, 66.0 MB/s 2024-08-18T22:28:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.909 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169953 s, 61.7 MB/s 2024-08-18T22:28:45.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.928 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152116 s, 68.9 MB/s 2024-08-18T22:28:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014845 s, 70.6 MB/s 2024-08-18T22:28:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151022 s, 69.4 MB/s 2024-08-18T22:28:45.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:45.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:45.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180198 s, 58.2 MB/s 2024-08-18T22:28:46.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017805 s, 58.9 MB/s 2024-08-18T22:28:46.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:46.014 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:46.014 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:46.014 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.25 2024-08-18T22:28:46.014 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:46.014 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:46.014 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:46.014 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:46.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:46.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170255 s, 61.6 MB/s 2024-08-18T22:28:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172947 s, 60.6 MB/s 2024-08-18T22:28:46.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.124 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144485 s, 72.6 MB/s 2024-08-18T22:28:46.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153115 s, 68.5 MB/s 2024-08-18T22:28:46.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.160 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015057 s, 69.6 MB/s 2024-08-18T22:28:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150169 s, 69.8 MB/s 2024-08-18T22:28:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144864 s, 72.4 MB/s 2024-08-18T22:28:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160347 s, 65.4 MB/s 2024-08-18T22:28:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171524 s, 61.1 MB/s 2024-08-18T22:28:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150559 s, 69.6 MB/s 2024-08-18T22:28:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155746 s, 67.3 MB/s 2024-08-18T22:28:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146357 s, 71.6 MB/s 2024-08-18T22:28:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143732 s, 73.0 MB/s 2024-08-18T22:28:46.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168542 s, 62.2 MB/s 2024-08-18T22:28:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172736 s, 60.7 MB/s 2024-08-18T22:28:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162904 s, 64.4 MB/s 2024-08-18T22:28:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167395 s, 62.6 MB/s 2024-08-18T22:28:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154715 s, 67.8 MB/s 2024-08-18T22:28:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016448 s, 63.8 MB/s 2024-08-18T22:28:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156522 s, 67.0 MB/s 2024-08-18T22:28:46.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146066 s, 71.8 MB/s 2024-08-18T22:28:46.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.483 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206388 s, 50.8 MB/s 2024-08-18T22:28:46.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.502 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015474 s, 67.8 MB/s 2024-08-18T22:28:46.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.522 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167973 s, 62.4 MB/s 2024-08-18T22:28:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.543 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177759 s, 59.0 MB/s 2024-08-18T22:28:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164405 s, 63.8 MB/s 2024-08-18T22:28:46.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.584 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179658 s, 58.4 MB/s 2024-08-18T22:28:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.603 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158165 s, 66.3 MB/s 2024-08-18T22:28:46.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.626 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192018 s, 54.6 MB/s 2024-08-18T22:28:46.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.644 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154399 s, 67.9 MB/s 2024-08-18T22:28:46.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178939 s, 58.6 MB/s 2024-08-18T22:28:46.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176259 s, 59.5 MB/s 2024-08-18T22:28:46.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:46.693 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:46.693 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:46.693 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.26 2024-08-18T22:28:46.693 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:46.693 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:46.693 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:46.693 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247426 s, 42.4 MB/s 2024-08-18T22:28:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166989 s, 62.8 MB/s 2024-08-18T22:28:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150759 s, 69.6 MB/s 2024-08-18T22:28:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161222 s, 65.0 MB/s 2024-08-18T22:28:46.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.848 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017373 s, 60.4 MB/s 2024-08-18T22:28:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181563 s, 57.8 MB/s 2024-08-18T22:28:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209622 s, 50.0 MB/s 2024-08-18T22:28:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153165 s, 68.5 MB/s 2024-08-18T22:28:46.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.928 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015461 s, 67.8 MB/s 2024-08-18T22:28:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153337 s, 68.4 MB/s 2024-08-18T22:28:46.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150549 s, 69.7 MB/s 2024-08-18T22:28:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179318 s, 58.5 MB/s 2024-08-18T22:28:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192783 s, 54.4 MB/s 2024-08-18T22:28:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145982 s, 71.8 MB/s 2024-08-18T22:28:47.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144985 s, 72.3 MB/s 2024-08-18T22:28:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226385 s, 46.3 MB/s 2024-08-18T22:28:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144947 s, 72.3 MB/s 2024-08-18T22:28:47.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178407 s, 58.8 MB/s 2024-08-18T22:28:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174598 s, 60.1 MB/s 2024-08-18T22:28:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.147 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209608 s, 50.0 MB/s 2024-08-18T22:28:47.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.162 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113526 s, 92.4 MB/s 2024-08-18T22:28:47.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164235 s, 63.8 MB/s 2024-08-18T22:28:47.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147239 s, 71.2 MB/s 2024-08-18T22:28:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150275 s, 69.8 MB/s 2024-08-18T22:28:47.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.232 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149758 s, 70.0 MB/s 2024-08-18T22:28:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145727 s, 72.0 MB/s 2024-08-18T22:28:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147102 s, 71.3 MB/s 2024-08-18T22:28:47.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.285 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155486 s, 67.4 MB/s 2024-08-18T22:28:47.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.302 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014982 s, 70.0 MB/s 2024-08-18T22:28:47.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.320 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151459 s, 69.2 MB/s 2024-08-18T22:28:47.337 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.337 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.338 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148879 s, 70.4 MB/s 2024-08-18T22:28:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149336 s, 70.2 MB/s 2024-08-18T22:28:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:47.362 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:47.362 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:47.362 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.27 2024-08-18T22:28:47.363 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:47.363 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:47.363 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:47.363 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:47.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183733 s, 57.1 MB/s 2024-08-18T22:28:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.455 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158472 s, 66.2 MB/s 2024-08-18T22:28:47.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162625 s, 64.5 MB/s 2024-08-18T22:28:47.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181518 s, 57.8 MB/s 2024-08-18T22:28:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.515 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173747 s, 60.4 MB/s 2024-08-18T22:28:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151652 s, 69.1 MB/s 2024-08-18T22:28:47.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.553 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177693 s, 59.0 MB/s 2024-08-18T22:28:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149576 s, 70.1 MB/s 2024-08-18T22:28:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160981 s, 65.1 MB/s 2024-08-18T22:28:47.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.612 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209596 s, 50.0 MB/s 2024-08-18T22:28:47.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151395 s, 69.3 MB/s 2024-08-18T22:28:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152763 s, 68.6 MB/s 2024-08-18T22:28:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167236 s, 62.7 MB/s 2024-08-18T22:28:47.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173194 s, 60.5 MB/s 2024-08-18T22:28:47.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017105 s, 61.3 MB/s 2024-08-18T22:28:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.725 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155344 s, 67.5 MB/s 2024-08-18T22:28:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196925 s, 53.2 MB/s 2024-08-18T22:28:47.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.767 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170604 s, 61.5 MB/s 2024-08-18T22:28:47.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.785 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146528 s, 71.6 MB/s 2024-08-18T22:28:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148973 s, 70.4 MB/s 2024-08-18T22:28:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187355 s, 56.0 MB/s 2024-08-18T22:28:47.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015597 s, 67.2 MB/s 2024-08-18T22:28:47.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.861 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163848 s, 64.0 MB/s 2024-08-18T22:28:47.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147941 s, 70.9 MB/s 2024-08-18T22:28:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170249 s, 61.6 MB/s 2024-08-18T22:28:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140543 s, 74.6 MB/s 2024-08-18T22:28:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241108 s, 43.5 MB/s 2024-08-18T22:28:47.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155675 s, 67.4 MB/s 2024-08-18T22:28:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149739 s, 70.0 MB/s 2024-08-18T22:28:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175758 s, 59.7 MB/s 2024-08-18T22:28:48.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170647 s, 61.4 MB/s 2024-08-18T22:28:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212639 s, 49.3 MB/s 2024-08-18T22:28:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:48.048 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:48.048 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:48.048 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.28 2024-08-18T22:28:48.048 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:48.048 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:48.048 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:48.049 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:48.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:48.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196073 s, 53.5 MB/s 2024-08-18T22:28:48.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161277 s, 65.0 MB/s 2024-08-18T22:28:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150013 s, 69.9 MB/s 2024-08-18T22:28:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151088 s, 69.4 MB/s 2024-08-18T22:28:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174532 s, 60.1 MB/s 2024-08-18T22:28:48.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.220 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212317 s, 49.4 MB/s 2024-08-18T22:28:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163652 s, 64.1 MB/s 2024-08-18T22:28:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209485 s, 50.1 MB/s 2024-08-18T22:28:48.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.281 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015945 s, 65.8 MB/s 2024-08-18T22:28:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017982 s, 58.3 MB/s 2024-08-18T22:28:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015405 s, 68.1 MB/s 2024-08-18T22:28:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020113 s, 52.1 MB/s 2024-08-18T22:28:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167223 s, 62.7 MB/s 2024-08-18T22:28:48.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017304 s, 60.6 MB/s 2024-08-18T22:28:48.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185038 s, 56.7 MB/s 2024-08-18T22:28:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.426 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218551 s, 48.0 MB/s 2024-08-18T22:28:48.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.451 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022138 s, 47.4 MB/s 2024-08-18T22:28:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.468 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146845 s, 71.4 MB/s 2024-08-18T22:28:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023446 s, 44.7 MB/s 2024-08-18T22:28:48.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177483 s, 59.1 MB/s 2024-08-18T22:28:48.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174345 s, 60.1 MB/s 2024-08-18T22:28:48.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.553 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162916 s, 64.4 MB/s 2024-08-18T22:28:48.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.577 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206932 s, 50.7 MB/s 2024-08-18T22:28:48.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.594 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144372 s, 72.6 MB/s 2024-08-18T22:28:48.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170124 s, 61.6 MB/s 2024-08-18T22:28:48.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.635 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.635 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191694 s, 54.7 MB/s 2024-08-18T22:28:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.653 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151557 s, 69.2 MB/s 2024-08-18T22:28:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168265 s, 62.3 MB/s 2024-08-18T22:28:48.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.691 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01597 s, 65.7 MB/s 2024-08-18T22:28:48.710 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.710 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.711 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172897 s, 60.6 MB/s 2024-08-18T22:28:48.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.735 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219342 s, 47.8 MB/s 2024-08-18T22:28:48.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.753 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151842 s, 69.1 MB/s 2024-08-18T22:28:48.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:48.760 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:48.760 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:48.760 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.29 2024-08-18T22:28:48.760 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:48.761 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:48.761 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:48.761 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:48.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177661 s, 59.0 MB/s 2024-08-18T22:28:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186258 s, 56.3 MB/s 2024-08-18T22:28:48.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.881 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240878 s, 43.5 MB/s 2024-08-18T22:28:48.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.898 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146983 s, 71.3 MB/s 2024-08-18T22:28:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197572 s, 53.1 MB/s 2024-08-18T22:28:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226239 s, 46.3 MB/s 2024-08-18T22:28:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147387 s, 71.1 MB/s 2024-08-18T22:28:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017693 s, 59.3 MB/s 2024-08-18T22:28:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244259 s, 42.9 MB/s 2024-08-18T22:28:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170714 s, 61.4 MB/s 2024-08-18T22:28:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.049 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016533 s, 63.4 MB/s 2024-08-18T22:28:49.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213898 s, 49.0 MB/s 2024-08-18T22:28:49.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.095 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197415 s, 53.1 MB/s 2024-08-18T22:28:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146763 s, 71.4 MB/s 2024-08-18T22:28:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152916 s, 68.6 MB/s 2024-08-18T22:28:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.150 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174362 s, 60.1 MB/s 2024-08-18T22:28:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.167 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144317 s, 72.7 MB/s 2024-08-18T22:28:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228207 s, 45.9 MB/s 2024-08-18T22:28:49.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.211 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152321 s, 68.8 MB/s 2024-08-18T22:28:49.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216689 s, 48.4 MB/s 2024-08-18T22:28:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147599 s, 71.0 MB/s 2024-08-18T22:28:49.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.276 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210923 s, 49.7 MB/s 2024-08-18T22:28:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232562 s, 45.1 MB/s 2024-08-18T22:28:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204913 s, 51.2 MB/s 2024-08-18T22:28:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141519 s, 74.1 MB/s 2024-08-18T22:28:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.362 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177108 s, 59.2 MB/s 2024-08-18T22:28:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018833 s, 55.7 MB/s 2024-08-18T22:28:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147126 s, 71.3 MB/s 2024-08-18T22:28:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151041 s, 69.4 MB/s 2024-08-18T22:28:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153186 s, 68.5 MB/s 2024-08-18T22:28:49.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.455 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162707 s, 64.4 MB/s 2024-08-18T22:28:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.469 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118165 s, 88.7 MB/s 2024-08-18T22:28:49.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:49.477 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:49.477 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:49.477 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.30 2024-08-18T22:28:49.477 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:49.477 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:49.477 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:49.477 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:49.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150056 s, 69.9 MB/s 2024-08-18T22:28:49.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.567 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162953 s, 64.3 MB/s 2024-08-18T22:28:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.591 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219164 s, 47.8 MB/s 2024-08-18T22:28:49.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.611 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164816 s, 63.6 MB/s 2024-08-18T22:28:49.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207081 s, 50.6 MB/s 2024-08-18T22:28:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171761 s, 61.0 MB/s 2024-08-18T22:28:49.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173283 s, 60.5 MB/s 2024-08-18T22:28:49.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.690 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148821 s, 70.5 MB/s 2024-08-18T22:28:49.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223602 s, 46.9 MB/s 2024-08-18T22:28:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.736 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01729 s, 60.6 MB/s 2024-08-18T22:28:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157833 s, 66.4 MB/s 2024-08-18T22:28:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154258 s, 68.0 MB/s 2024-08-18T22:28:49.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182396 s, 57.5 MB/s 2024-08-18T22:28:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144632 s, 72.5 MB/s 2024-08-18T22:28:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214097 s, 49.0 MB/s 2024-08-18T22:28:49.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.851 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142727 s, 73.5 MB/s 2024-08-18T22:28:49.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.868 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144017 s, 72.8 MB/s 2024-08-18T22:28:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01582 s, 66.3 MB/s 2024-08-18T22:28:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207274 s, 50.6 MB/s 2024-08-18T22:28:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.927 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152179 s, 68.9 MB/s 2024-08-18T22:28:49.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147077 s, 71.3 MB/s 2024-08-18T22:28:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167887 s, 62.5 MB/s 2024-08-18T22:28:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151957 s, 69.0 MB/s 2024-08-18T22:28:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.000 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159112 s, 65.9 MB/s 2024-08-18T22:28:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199949 s, 52.4 MB/s 2024-08-18T22:28:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146731 s, 71.5 MB/s 2024-08-18T22:28:50.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.062 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191531 s, 54.7 MB/s 2024-08-18T22:28:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171671 s, 61.1 MB/s 2024-08-18T22:28:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.102 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177507 s, 59.1 MB/s 2024-08-18T22:28:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015061 s, 69.6 MB/s 2024-08-18T22:28:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143874 s, 72.9 MB/s 2024-08-18T22:28:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180274 s, 58.2 MB/s 2024-08-18T22:28:50.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:50.165 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:28:50.165 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:28:50.165 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.31 2024-08-18T22:28:50.165 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:28:50.166 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:28:50.166 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:28:50.166 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:28:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:28:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147421 s, 71.1 MB/s 2024-08-18T22:28:50.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.255 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175702 s, 59.7 MB/s 2024-08-18T22:28:50.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173762 s, 60.3 MB/s 2024-08-18T22:28:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156002 s, 67.2 MB/s 2024-08-18T22:28:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.312 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154612 s, 67.8 MB/s 2024-08-18T22:28:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017215 s, 60.9 MB/s 2024-08-18T22:28:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014562 s, 72.0 MB/s 2024-08-18T22:28:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.366 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153937 s, 68.1 MB/s 2024-08-18T22:28:50.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182437 s, 57.5 MB/s 2024-08-18T22:28:50.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.407 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171548 s, 61.1 MB/s 2024-08-18T22:28:50.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.426 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159182 s, 65.9 MB/s 2024-08-18T22:28:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180879 s, 58.0 MB/s 2024-08-18T22:28:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157151 s, 66.7 MB/s 2024-08-18T22:28:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169194 s, 62.0 MB/s 2024-08-18T22:28:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.503 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149247 s, 70.3 MB/s 2024-08-18T22:28:50.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112988 s, 92.8 MB/s 2024-08-18T22:28:50.533 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150627 s, 69.6 MB/s 2024-08-18T22:28:50.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.553 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170862 s, 61.4 MB/s 2024-08-18T22:28:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016833 s, 62.3 MB/s 2024-08-18T22:28:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016694 s, 62.8 MB/s 2024-08-18T22:28:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151729 s, 69.1 MB/s 2024-08-18T22:28:50.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171035 s, 61.3 MB/s 2024-08-18T22:28:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01593 s, 65.8 MB/s 2024-08-18T22:28:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016811 s, 62.4 MB/s 2024-08-18T22:28:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.686 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151966 s, 69.0 MB/s 2024-08-18T22:28:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148215 s, 70.7 MB/s 2024-08-18T22:28:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145047 s, 72.3 MB/s 2024-08-18T22:28:50.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.739 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147675 s, 71.0 MB/s 2024-08-18T22:28:50.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.758 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151365 s, 69.3 MB/s 2024-08-18T22:28:50.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150131 s, 69.8 MB/s 2024-08-18T22:28:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019769 s, 53.0 MB/s 2024-08-18T22:28:50.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:28:50.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:28:50.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162346 s, 64.6 MB/s 2024-08-18T22:28:50.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:28:50.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:50.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-08-18T22:28:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff924400640 1 Processor -- start 2024-08-18T22:28:50.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff924400640 1 -- start start 2024-08-18T22:28:50.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff924400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff91c0ccaa0 0x7ff91c0cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff924400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91c0b3260 con 0x7ff91c15d1d0 2024-08-18T22:28:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff924400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91c15d630 con 0x7ff91c06dc60 2024-08-18T22:28:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff924400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff91c0cfe90 con 0x7ff91c0ccaa0 2024-08-18T22:28:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff921a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff91c0ccaa0 0x7ff91c0cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff921000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff91c15d1d0 0x7ff91c0cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38528/0 (socket says 172.21.15.5:38528) 2024-08-18T22:28:50.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff921000640 1 -- 172.21.15.5:0/2294730675 learned_addr learned my addr 172.21.15.5:0/2294730675 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:50.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff921a00640 1 -- 172.21.15.5:0/2294730675 >> v1:172.21.15.117:6789/0 conn(0x7ff91c06dc60 legacy=0x7ff91c06e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:50.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff921a00640 1 -- 172.21.15.5:0/2294730675 >> v1:172.21.15.5:6789/0 conn(0x7ff91c15d1d0 legacy=0x7ff91c0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:50.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff921a00640 1 -- 172.21.15.5:0/2294730675 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91c0b3500 con 0x7ff91c0ccaa0 2024-08-18T22:28:50.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.971+0000 7ff91be00640 1 -- 172.21.15.5:0/2294730675 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590958646 0 0) 0x7ff91c0b3260 con 0x7ff91c15d1d0 2024-08-18T22:28:50.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.975+0000 7ff921a00640 1 --2- 172.21.15.5:0/2294730675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff91c0ccaa0 0x7ff91c0cf760 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7ff9100097c0 tx=0x7ff91001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7a602e3a98ac57 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:50.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.975+0000 7ff91be00640 1 -- 172.21.15.5:0/2294730675 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9100b0070 con 0x7ff91c0ccaa0 2024-08-18T22:28:50.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.975+0000 7ff91be00640 1 -- 172.21.15.5:0/2294730675 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9100ab600 con 0x7ff91c0ccaa0 2024-08-18T22:28:50.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.975+0000 7ff91be00640 1 -- 172.21.15.5:0/2294730675 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9100ab9d0 con 0x7ff91c0ccaa0 2024-08-18T22:28:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.975+0000 7ff924400640 1 -- 172.21.15.5:0/2294730675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff91c0ccaa0 msgr2=0x7ff91c0cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.975+0000 7ff924400640 1 --2- 172.21.15.5:0/2294730675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff91c0ccaa0 0x7ff91c0cf760 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7ff9100097c0 tx=0x7ff91001c410 comp rx=0 tx=0).stop 2024-08-18T22:28:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.975+0000 7ff924400640 1 -- 172.21.15.5:0/2294730675 shutdown_connections 2024-08-18T22:28:50.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.975+0000 7ff924400640 1 --2- 172.21.15.5:0/2294730675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff91c0ccaa0 0x7ff91c0cf760 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.975+0000 7ff924400640 1 -- 172.21.15.5:0/2294730675 >> 172.21.15.5:0/2294730675 conn(0x7ff91c06b9b0 msgr2=0x7ff91c06bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.975+0000 7ff924400640 1 -- 172.21.15.5:0/2294730675 shutdown_connections 2024-08-18T22:28:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.975+0000 7ff924400640 1 -- 172.21.15.5:0/2294730675 wait complete. 2024-08-18T22:28:50.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff924400640 1 Processor -- start 2024-08-18T22:28:50.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff924400640 1 -- start start 2024-08-18T22:28:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff924400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff91c06dc60 0x7ff91c149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff924400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff91c0ccaa0 0x7ff91c159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff924400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff91c15d1d0 0x7ff91c146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff924400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c16a520 con 0x7ff91c15d1d0 2024-08-18T22:28:50.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff924400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c0af5c0 con 0x7ff91c06dc60 2024-08-18T22:28:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff924400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff91c16a6a0 con 0x7ff91c0ccaa0 2024-08-18T22:28:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff922400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff91c15d1d0 0x7ff91c146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff921a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff91c06dc60 0x7ff91c149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff921000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff91c0ccaa0 0x7ff91c159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff921a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff91c06dc60 0x7ff91c149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:35798/0 (socket says 172.21.15.5:35798) 2024-08-18T22:28:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff921a00640 1 -- 172.21.15.5:0/3747281283 learned_addr learned my addr 172.21.15.5:0/3747281283 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:50.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff922400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff91c15d1d0 0x7ff91c146160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38970/0 (socket says 172.21.15.5:38970) 2024-08-18T22:28:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff921a00640 1 -- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff91c0ccaa0 msgr2=0x7ff91c159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff921a00640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff91c0ccaa0 0x7ff91c159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff921a00640 1 -- 172.21.15.5:0/3747281283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff91c15d1d0 msgr2=0x7ff91c146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:50.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff921a00640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff91c15d1d0 0x7ff91c146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff921a00640 1 -- 172.21.15.5:0/3747281283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91c0b4930 con 0x7ff91c06dc60 2024-08-18T22:28:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff922400640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff91c15d1d0 0x7ff91c146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff921000640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff91c0ccaa0 0x7ff91c159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff921a00640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff91c06dc60 0x7ff91c149210 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff9100ae040 tx=0x7ff91001ac50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff919600640 1 -- 172.21.15.5:0/3747281283 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9100bb070 con 0x7ff91c06dc60 2024-08-18T22:28:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff919600640 1 -- 172.21.15.5:0/3747281283 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff910004020 con 0x7ff91c06dc60 2024-08-18T22:28:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff919600640 1 -- 172.21.15.5:0/3747281283 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9100b0040 con 0x7ff91c06dc60 2024-08-18T22:28:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff924400640 1 -- 172.21.15.5:0/3747281283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91c158f90 con 0x7ff91c06dc60 2024-08-18T22:28:50.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.979+0000 7ff924400640 1 -- 172.21.15.5:0/3747281283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff91c15bf30 con 0x7ff91c06dc60 2024-08-18T22:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.983+0000 7ff919600640 1 -- 172.21.15.5:0/3747281283 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff910003620 con 0x7ff91c06dc60 2024-08-18T22:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.983+0000 7ff919600640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8fc0678c0 0x7ff8fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.983+0000 7ff919600640 1 -- 172.21.15.5:0/3747281283 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7ff9101203b0 con 0x7ff91c06dc60 2024-08-18T22:28:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.983+0000 7ff921000640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8fc0678c0 0x7ff8fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.983+0000 7ff9278ae000 1 Processor -- start 2024-08-18T22:28:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.983+0000 7ff9278ae000 1 -- start start 2024-08-18T22:28:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.983+0000 7ff921000640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8fc0678c0 0x7ff8fc069d80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff908007bc0 tx=0x7ff908007b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c000 0x55845df0c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845dec2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845dec3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55845dd10340 con 0x55845dec30b0 2024-08-18T22:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55845dccaba0 con 0x55845df0c920 2024-08-18T22:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55845dd0c300 con 0x55845df0c000 2024-08-18T22:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff922400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845dec3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff922400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845dec3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38974/0 (socket says 172.21.15.5:38974) 2024-08-18T22:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff922400640 1 -- 172.21.15.5:0/193660650 learned_addr learned my addr 172.21.15.5:0/193660650 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff921a00640 1 --2- 172.21.15.5:0/193660650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c000 0x55845df0c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff921000640 1 --2- 172.21.15.5:0/193660650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845dec2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff922400640 1 -- 172.21.15.5:0/193660650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c000 msgr2=0x55845df0c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff922400640 1 --2- 172.21.15.5:0/193660650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c000 0x55845df0c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff922400640 1 -- 172.21.15.5:0/193660650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 msgr2=0x55845dec2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff922400640 1 --2- 172.21.15.5:0/193660650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845dec2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff922400640 1 -- 172.21.15.5:0/193660650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55845ddbca30 con 0x55845dec30b0 2024-08-18T22:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff922400640 1 --2- 172.21.15.5:0/193660650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845dec3490 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7ff91400f1d0 tx=0x7ff914001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fe7e7c584bb1a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff90e000640 1 -- 172.21.15.5:0/193660650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91400fe50 con 0x55845dec30b0 2024-08-18T22:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff90e000640 1 -- 172.21.15.5:0/193660650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff914018070 con 0x55845dec30b0 2024-08-18T22:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff90e000640 1 -- 172.21.15.5:0/193660650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914003d90 con 0x55845dec30b0 2024-08-18T22:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- 172.21.15.5:0/193660650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 msgr2=0x55845dec3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 --2- 172.21.15.5:0/193660650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845dec3490 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7ff91400f1d0 tx=0x7ff914001610 comp rx=0 tx=0).stop 2024-08-18T22:28:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- 172.21.15.5:0/193660650 shutdown_connections 2024-08-18T22:28:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 --2- 172.21.15.5:0/193660650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845dec3490 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 --2- 172.21.15.5:0/193660650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845dec2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 --2- 172.21.15.5:0/193660650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c000 0x55845df0c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- 172.21.15.5:0/193660650 >> 172.21.15.5:0/193660650 conn(0x55845debf030 msgr2=0x55845dec1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- 172.21.15.5:0/193660650 shutdown_connections 2024-08-18T22:28:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- 172.21.15.5:0/193660650 wait complete. 2024-08-18T22:28:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- start start 2024-08-18T22:28:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 Processor -- start 2024-08-18T22:28:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845dec30b0 0x55845df0b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845dece010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c920 0x55845dece550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55845dd14970 con 0x55845df0c000 2024-08-18T22:28:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55845dcb1c00 con 0x55845dec30b0 2024-08-18T22:28:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55845dcbbf80 con 0x55845df0c920 2024-08-18T22:28:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.987+0000 7ff9278ae000 10 client.0 _ll_register_callbacks cb 0x55845deadaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845dece010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845dece010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38988/0 (socket says 172.21.15.5:38988) 2024-08-18T22:28:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921000640 1 -- 172.21.15.5:0/79894315 learned_addr learned my addr 172.21.15.5:0/79894315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921a00640 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845dec30b0 0x55845df0b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff922400640 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c920 0x55845dece550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921000640 1 -- 172.21.15.5:0/79894315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c920 msgr2=0x55845dece550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921000640 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c920 0x55845dece550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921000640 1 -- 172.21.15.5:0/79894315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845dec30b0 msgr2=0x55845df0b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921000640 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845dec30b0 0x55845df0b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921000640 1 -- 172.21.15.5:0/79894315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55845ddb89e0 con 0x55845df0c000 2024-08-18T22:28:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921a00640 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845dec30b0 0x55845df0b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921000640 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845dece010 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7ff90800c780 tx=0x7ff908010050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c468909648429f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff902a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff902a00640 1 -- 172.21.15.5:0/79894315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90802c060 con 0x55845df0c000 2024-08-18T22:28:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff902a00640 1 -- 172.21.15.5:0/79894315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7ff90801a110 con 0x55845df0c000 2024-08-18T22:28:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 -- 172.21.15.5:0/79894315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff914018070 con 0x55845df0c000 2024-08-18T22:28:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff902a00640 1 -- 172.21.15.5:0/79894315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7ff90801a9a0 con 0x55845df0c000 2024-08-18T22:28:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 10 client.8721 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 -- 172.21.15.5:0/79894315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x55845dcea520 con 0x55845df0c000 2024-08-18T22:28:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff902a00640 1 -- 172.21.15.5:0/79894315 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff914018070 con 0x55845df0c000 2024-08-18T22:28:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff902a00640 1 -- 172.21.15.5:0/79894315 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7ff90801ab40 con 0x55845df0c000 2024-08-18T22:28:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 10 client.8721 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 10 client.8721 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-08-18T22:28:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 20 client.8721 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55845decf290 0x55845df1e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 4 client.8721 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:28:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 -- 172.21.15.5:0/79894315 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55845dda8e30 con 0x55845decf290 2024-08-18T22:28:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921a00640 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55845decf290 0x55845df1e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff921a00640 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55845decf290 0x55845df1e2c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d3381bd4c48df7a server_cookie=6542f4a2888b8e96 in_seq=0 out_seq=0 2024-08-18T22:28:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff902a00640 10 client.8721 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff902a00640 1 -- 172.21.15.5:0/79894315 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55845dda8e30 con 0x55845decf290 2024-08-18T22:28:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff902a00640 10 client.8721 handle_command_reply: tid=0 2024-08-18T22:28:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 client.8721 shutdown 2024-08-18T22:28:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 -- 172.21.15.5:0/79894315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 msgr2=0x55845dece010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845dece010 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7ff90800c780 tx=0x7ff908010050 comp rx=0 tx=0).stop 2024-08-18T22:28:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 -- 172.21.15.5:0/79894315 shutdown_connections 2024-08-18T22:28:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55845decf290 0x55845df1e2c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c920 0x55845dece550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845dece010 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 --2- 172.21.15.5:0/79894315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845dec30b0 0x55845df0b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff9278ae000 1 -- 172.21.15.5:0/79894315 >> 172.21.15.5:0/79894315 conn(0x55845debf030 msgr2=0x55845dec1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.991+0000 7ff902a00640 0 client.8721 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.995+0000 7ff9278ae000 1 -- 172.21.15.5:0/79894315 shutdown_connections 2024-08-18T22:28:51.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.995+0000 7ff9278ae000 1 -- 172.21.15.5:0/79894315 wait complete. 2024-08-18T22:28:51.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:50.995+0000 7ff9278ae000 20 client.8721 trim_cache size 0 max 16384 2024-08-18T22:28:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff9278ae000 1 Processor -- start 2024-08-18T22:28:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff9278ae000 1 -- start start 2024-08-18T22:28:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845df21710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c000 0x55845dec2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845dec2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff9278ae000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c072f70 con 0x55845dec30b0 2024-08-18T22:28:51.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff9278ae000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c14ffd0 con 0x55845df0c920 2024-08-18T22:28:51.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff9278ae000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff91c14b850 con 0x55845df0c000 2024-08-18T22:28:51.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff921a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845df21710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff921a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845df21710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39002/0 (socket says 172.21.15.5:39002) 2024-08-18T22:28:51.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff921a00640 1 -- 172.21.15.5:0/2069084854 learned_addr learned my addr 172.21.15.5:0/2069084854 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff922400640 1 --2- 172.21.15.5:0/2069084854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845dec2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff921000640 1 --2- 172.21.15.5:0/2069084854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c000 0x55845dec2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff921a00640 1 -- 172.21.15.5:0/2069084854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c000 msgr2=0x55845dec2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff921a00640 1 --2- 172.21.15.5:0/2069084854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c000 0x55845dec2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff921a00640 1 -- 172.21.15.5:0/2069084854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 msgr2=0x55845dec2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff921a00640 1 --2- 172.21.15.5:0/2069084854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845dec2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff921a00640 1 -- 172.21.15.5:0/2069084854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55845dd692f0 con 0x55845dec30b0 2024-08-18T22:28:51.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff922400640 1 --2- 172.21.15.5:0/2069084854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845dec2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:51.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.011+0000 7ff921a00640 1 --2- 172.21.15.5:0/2069084854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845df21710 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff9100f70d0 tx=0x7ff9100c2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9fb2b4089c868a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff90d600640 1 -- 172.21.15.5:0/2069084854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9100f9230 con 0x55845dec30b0 2024-08-18T22:28:51.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff90d600640 1 -- 172.21.15.5:0/2069084854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9100ee7a0 con 0x55845dec30b0 2024-08-18T22:28:51.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff90d600640 1 -- 172.21.15.5:0/2069084854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9100eea00 con 0x55845dec30b0 2024-08-18T22:28:51.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 -- 172.21.15.5:0/2069084854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 msgr2=0x55845df21710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 --2- 172.21.15.5:0/2069084854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845df21710 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff9100f70d0 tx=0x7ff9100c2040 comp rx=0 tx=0).stop 2024-08-18T22:28:51.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 -- 172.21.15.5:0/2069084854 shutdown_connections 2024-08-18T22:28:51.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 --2- 172.21.15.5:0/2069084854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845dec2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 --2- 172.21.15.5:0/2069084854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845df0c000 0x55845dec2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 --2- 172.21.15.5:0/2069084854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845dec30b0 0x55845df21710 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 -- 172.21.15.5:0/2069084854 >> 172.21.15.5:0/2069084854 conn(0x55845debf030 msgr2=0x55845decd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 -- 172.21.15.5:0/2069084854 shutdown_connections 2024-08-18T22:28:51.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 -- 172.21.15.5:0/2069084854 wait complete. 2024-08-18T22:28:51.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 -- start start 2024-08-18T22:28:51.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 Processor -- start 2024-08-18T22:28:51.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845dec30b0 0x55845df21150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845df3c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845df3caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55845dcac340 con 0x55845df0c000 2024-08-18T22:28:51.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55845dcdafb0 con 0x55845df0c920 2024-08-18T22:28:51.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55845dc958f0 con 0x55845dec30b0 2024-08-18T22:28:51.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 10 client.0 _ll_register_callbacks cb 0x7ff90800e9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:51.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff921000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845df3c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff921000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845df3c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39006/0 (socket says 172.21.15.5:39006) 2024-08-18T22:28:51.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff921000640 1 -- 172.21.15.5:0/524678875 learned_addr learned my addr 172.21.15.5:0/524678875 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff921a00640 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845dec30b0 0x55845df21150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff922400640 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845df3caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff921000640 1 -- 172.21.15.5:0/524678875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845dec30b0 msgr2=0x55845df21150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff921000640 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845dec30b0 0x55845df21150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff921000640 1 -- 172.21.15.5:0/524678875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 msgr2=0x55845df3caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff921000640 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845df3caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff921000640 1 -- 172.21.15.5:0/524678875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55845dcac9d0 con 0x55845df0c000 2024-08-18T22:28:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff921000640 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845df3c5b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff908000c10 tx=0x7ff90800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbece299ca7243f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff902a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff902a00640 1 -- 172.21.15.5:0/524678875 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90801a7f0 con 0x55845df0c000 2024-08-18T22:28:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff902a00640 1 -- 172.21.15.5:0/524678875 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7ff908027500 con 0x55845df0c000 2024-08-18T22:28:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.015+0000 7ff9278ae000 1 -- 172.21.15.5:0/524678875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9100ee7a0 con 0x55845df0c000 2024-08-18T22:28:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff902a00640 1 -- 172.21.15.5:0/524678875 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7ff908043050 con 0x55845df0c000 2024-08-18T22:28:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff9278ae000 10 client.8727 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff9278ae000 1 -- 172.21.15.5:0/524678875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x55845d9cb1a0 con 0x55845df0c000 2024-08-18T22:28:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff902a00640 1 -- 172.21.15.5:0/524678875 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9100ee7a0 con 0x55845df0c000 2024-08-18T22:28:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff902a00640 1 -- 172.21.15.5:0/524678875 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7ff908027700 con 0x55845df0c000 2024-08-18T22:28:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff9278ae000 10 client.8727 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff9278ae000 10 client.8727 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-08-18T22:28:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff9278ae000 20 client.8727 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff9278ae000 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55845df3d030 0x55845df7fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff9278ae000 4 client.8727 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-08-18T22:28:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff9278ae000 1 -- 172.21.15.5:0/524678875 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55845dcaabd0 con 0x55845df3d030 2024-08-18T22:28:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff921a00640 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55845df3d030 0x55845df7fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff921a00640 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55845df3d030 0x55845df7fbf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acadfb4af1e4c2ff server_cookie=a096c1cb90c1d93d in_seq=0 out_seq=0 2024-08-18T22:28:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff902a00640 10 client.8727 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff902a00640 1 -- 172.21.15.5:0/524678875 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55845dcaabd0 con 0x55845df3d030 2024-08-18T22:28:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff902a00640 10 client.8727 handle_command_reply: tid=0 2024-08-18T22:28:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.019+0000 7ff9278ae000 1 client.8727 shutdown 2024-08-18T22:28:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff9278ae000 1 -- 172.21.15.5:0/524678875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 msgr2=0x55845df3c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff9278ae000 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845df3c5b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff908000c10 tx=0x7ff90800e000 comp rx=0 tx=0).stop 2024-08-18T22:28:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff9278ae000 1 -- 172.21.15.5:0/524678875 shutdown_connections 2024-08-18T22:28:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff9278ae000 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55845df3d030 0x55845df7fbf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff9278ae000 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55845df0c920 0x55845df3caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff9278ae000 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55845df0c000 0x55845df3c5b0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff9278ae000 1 --2- 172.21.15.5:0/524678875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55845dec30b0 0x55845df21150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff9278ae000 1 -- 172.21.15.5:0/524678875 >> 172.21.15.5:0/524678875 conn(0x55845debf030 msgr2=0x55845dece090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff902a00640 0 client.8727 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff9278ae000 1 -- 172.21.15.5:0/524678875 shutdown_connections 2024-08-18T22:28:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff9278ae000 1 -- 172.21.15.5:0/524678875 wait complete. 2024-08-18T22:28:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff9278ae000 20 client.8727 trim_cache size 0 max 16384 2024-08-18T22:28:51.039 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:28:51.039 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:28:51.039 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "bcdc7333-7957-478f-b933-4093dc5def21", 2024-08-18T22:28:51.040 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:28:51.040 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:28:51.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 -- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8fc0678c0 msgr2=0x7ff8fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8fc0678c0 0x7ff8fc069d80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff908007bc0 tx=0x7ff908007b10 comp rx=0 tx=0).stop 2024-08-18T22:28:51.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 -- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff91c06dc60 msgr2=0x7ff91c149210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff91c06dc60 0x7ff91c149210 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff9100ae040 tx=0x7ff91001ac50 comp rx=0 tx=0).stop 2024-08-18T22:28:51.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 -- 172.21.15.5:0/3747281283 shutdown_connections 2024-08-18T22:28:51.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8fc0678c0 0x7ff8fc069d80 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff91c15d1d0 0x7ff91c146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff91c0ccaa0 0x7ff91c159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 --2- 172.21.15.5:0/3747281283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff91c06dc60 0x7ff91c149210 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 -- 172.21.15.5:0/3747281283 >> 172.21.15.5:0/3747281283 conn(0x7ff91c06b9b0 msgr2=0x7ff91c14c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 -- 172.21.15.5:0/3747281283 shutdown_connections 2024-08-18T22:28:51.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.023+0000 7ff924400640 1 -- 172.21.15.5:0/3747281283 wait complete. 2024-08-18T22:28:51.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:51.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-08-18T22:28:51.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e39c00640 1 Processor -- start 2024-08-18T22:28:51.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e39c00640 1 -- start start 2024-08-18T22:28:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e39c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3415b0c0 0x7f4e3406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e39c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e340cf290 0x7f4e340b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e39c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e340b31f0 con 0x7f4e340b40c0 2024-08-18T22:28:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e39c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4e340b3d70 con 0x7f4e340cf290 2024-08-18T22:28:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e39c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4e340b4a40 con 0x7f4e3415b0c0 2024-08-18T22:28:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e2be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4e340b40c0 0x7f4e34072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38534/0 (socket says 172.21.15.5:38534) 2024-08-18T22:28:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e2be00640 1 -- 172.21.15.5:0/3521632565 learned_addr learned my addr 172.21.15.5:0/3521632565 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:51.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e33400640 1 --2- 172.21.15.5:0/3521632565 >> v2:172.21.15.117:3300/0 conn(0x7f4e340cf290 0x7f4e340b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e32a00640 1 --2- 172.21.15.5:0/3521632565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3415b0c0 0x7f4e3406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e32000640 1 -- 172.21.15.5:0/3521632565 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 706121145 0 0) 0x7f4e340b31f0 con 0x7f4e340b40c0 2024-08-18T22:28:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e32000640 1 -- 172.21.15.5:0/3521632565 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e18003530 con 0x7f4e340b40c0 2024-08-18T22:28:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e33400640 1 -- 172.21.15.5:0/3521632565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3415b0c0 msgr2=0x7f4e3406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e33400640 1 --2- 172.21.15.5:0/3521632565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3415b0c0 0x7f4e3406db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e33400640 1 -- 172.21.15.5:0/3521632565 >> v1:172.21.15.5:6789/0 conn(0x7f4e340b40c0 legacy=0x7f4e34072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.223+0000 7f4e33400640 1 -- 172.21.15.5:0/3521632565 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e340b34d0 con 0x7f4e340cf290 2024-08-18T22:28:51.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e33400640 1 --2- 172.21.15.5:0/3521632565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e340cf290 0x7f4e340b4500 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009d90 tx=0x7f4e2c01c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc86cfae9b41b639 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e32000640 1 -- 172.21.15.5:0/3521632565 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0b2070 con 0x7f4e340cf290 2024-08-18T22:28:51.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e32000640 1 -- 172.21.15.5:0/3521632565 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c0a58e0 con 0x7f4e340cf290 2024-08-18T22:28:51.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e32000640 1 -- 172.21.15.5:0/3521632565 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0a5cb0 con 0x7f4e340cf290 2024-08-18T22:28:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e39c00640 1 -- 172.21.15.5:0/3521632565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e340cf290 msgr2=0x7f4e340b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e39c00640 1 --2- 172.21.15.5:0/3521632565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e340cf290 0x7f4e340b4500 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009d90 tx=0x7f4e2c01c820 comp rx=0 tx=0).stop 2024-08-18T22:28:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e39c00640 1 -- 172.21.15.5:0/3521632565 shutdown_connections 2024-08-18T22:28:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e39c00640 1 --2- 172.21.15.5:0/3521632565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e340cf290 0x7f4e340b4500 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e39c00640 1 --2- 172.21.15.5:0/3521632565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e3415b0c0 0x7f4e3406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e39c00640 1 -- 172.21.15.5:0/3521632565 >> 172.21.15.5:0/3521632565 conn(0x7f4e340b1dc0 msgr2=0x7f4e340b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e39c00640 1 -- 172.21.15.5:0/3521632565 shutdown_connections 2024-08-18T22:28:51.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.227+0000 7f4e39c00640 1 -- 172.21.15.5:0/3521632565 wait complete. 2024-08-18T22:28:51.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e39c00640 1 Processor -- start 2024-08-18T22:28:51.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e39c00640 1 -- start start 2024-08-18T22:28:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e39c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e340b40c0 0x7f4e341576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e39c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e340cf290 0x7f4e34152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e39c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e3415b0c0 0x7f4e34153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e39c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3415b620 con 0x7f4e340b40c0 2024-08-18T22:28:51.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e39c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3415b4a0 con 0x7f4e3415b0c0 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e39c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3406f670 con 0x7f4e340cf290 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e32a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e340b40c0 0x7f4e341576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e32a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e340b40c0 0x7f4e341576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39012/0 (socket says 172.21.15.5:39012) 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e32a00640 1 -- 172.21.15.5:0/753491427 learned_addr learned my addr 172.21.15.5:0/753491427 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e2be00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e340cf290 0x7f4e34152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e33400640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e3415b0c0 0x7f4e34153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e32a00640 1 -- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e340cf290 msgr2=0x7f4e34152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e32a00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e340cf290 0x7f4e34152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e32a00640 1 -- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e3415b0c0 msgr2=0x7f4e34153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e32a00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e3415b0c0 0x7f4e34153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e32a00640 1 -- 172.21.15.5:0/753491427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3414d9e0 con 0x7f4e340b40c0 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e32a00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e340b40c0 0x7f4e341576e0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400e930 tx=0x7f4e2400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e2aa00640 1 -- 172.21.15.5:0/753491427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24017070 con 0x7f4e340b40c0 2024-08-18T22:28:51.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e2aa00640 1 -- 172.21.15.5:0/753491427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2400ca00 con 0x7f4e340b40c0 2024-08-18T22:28:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e39c00640 1 -- 172.21.15.5:0/753491427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e3414dcc0 con 0x7f4e340b40c0 2024-08-18T22:28:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e2aa00640 1 -- 172.21.15.5:0/753491427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2400cdb0 con 0x7f4e340b40c0 2024-08-18T22:28:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.231+0000 7f4e39c00640 1 -- 172.21.15.5:0/753491427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e34156ee0 con 0x7f4e340b40c0 2024-08-18T22:28:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e2aa00640 1 -- 172.21.15.5:0/753491427 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4e2401a070 con 0x7f4e340b40c0 2024-08-18T22:28:51.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e2aa00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4e100678c0 0x7f4e10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e2aa00640 1 -- 172.21.15.5:0/753491427 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f4e24086240 con 0x7f4e340b40c0 2024-08-18T22:28:51.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e2be00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4e100678c0 0x7f4e10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e3d113000 1 Processor -- start 2024-08-18T22:28:51.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e3d113000 1 -- start start 2024-08-18T22:28:51.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e2be00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4e100678c0 0x7f4e10069d80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4e34148220 tx=0x7f4e1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051667c0 0x561005166ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5610051670e0 0x56100511e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56100511eaf0 0x56100511eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e3d113000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561004f62470 con 0x5610051667c0 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e3d113000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561004f1cad0 con 0x56100511eaf0 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e3d113000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561004f5e430 con 0x5610051670e0 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e32a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051667c0 0x561005166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e2be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5610051670e0 0x56100511e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e32a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051667c0 0x561005166ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39018/0 (socket says 172.21.15.5:39018) 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e32a00640 1 -- 172.21.15.5:0/2999292822 learned_addr learned my addr 172.21.15.5:0/2999292822 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e33400640 1 --2- 172.21.15.5:0/2999292822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56100511eaf0 0x56100511eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e32a00640 1 -- 172.21.15.5:0/2999292822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5610051670e0 msgr2=0x56100511e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e32a00640 1 --2- 172.21.15.5:0/2999292822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5610051670e0 0x56100511e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e32a00640 1 -- 172.21.15.5:0/2999292822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56100511eaf0 msgr2=0x56100511eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e32a00640 1 --2- 172.21.15.5:0/2999292822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56100511eaf0 0x56100511eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.235+0000 7f4e32a00640 1 -- 172.21.15.5:0/2999292822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561004f02a10 con 0x5610051667c0 2024-08-18T22:28:51.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e32a00640 1 --2- 172.21.15.5:0/2999292822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051667c0 0x561005166ba0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4e2405ec50 tx=0x7f4e24056dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b927b9105931bb62 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e23400640 1 -- 172.21.15.5:0/2999292822 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24082070 con 0x5610051667c0 2024-08-18T22:28:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e23400640 1 -- 172.21.15.5:0/2999292822 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2405f180 con 0x5610051667c0 2024-08-18T22:28:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e23400640 1 -- 172.21.15.5:0/2999292822 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24021050 con 0x5610051667c0 2024-08-18T22:28:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 -- 172.21.15.5:0/2999292822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051667c0 msgr2=0x561005166ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 --2- 172.21.15.5:0/2999292822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051667c0 0x561005166ba0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4e2405ec50 tx=0x7f4e24056dd0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 -- 172.21.15.5:0/2999292822 shutdown_connections 2024-08-18T22:28:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 --2- 172.21.15.5:0/2999292822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56100511eaf0 0x56100511eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 --2- 172.21.15.5:0/2999292822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5610051670e0 0x56100511e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 --2- 172.21.15.5:0/2999292822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051667c0 0x561005166ba0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 -- 172.21.15.5:0/2999292822 >> 172.21.15.5:0/2999292822 conn(0x56100510b680 msgr2=0x561005140df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 -- 172.21.15.5:0/2999292822 shutdown_connections 2024-08-18T22:28:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 -- 172.21.15.5:0/2999292822 wait complete. 2024-08-18T22:28:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 -- start start 2024-08-18T22:28:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 Processor -- start 2024-08-18T22:28:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56100511eaf0 0x56100516d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 0x56100516de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x56100516e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561004f2d770 con 0x5610051670e0 2024-08-18T22:28:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561004f03c80 con 0x5610051667c0 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561004fe3130 con 0x56100511eaf0 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e3d113000 10 client.0 _ll_register_callbacks cb 0x5610050ff0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e33400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x56100516e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e2be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 0x56100516de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e33400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x56100516e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39026/0 (socket says 172.21.15.5:39026) 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e33400640 1 -- 172.21.15.5:0/1841992250 learned_addr learned my addr 172.21.15.5:0/1841992250 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e32a00640 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56100511eaf0 0x56100516d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e33400640 1 -- 172.21.15.5:0/1841992250 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56100511eaf0 msgr2=0x56100516d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e33400640 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56100511eaf0 0x56100516d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e33400640 1 -- 172.21.15.5:0/1841992250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 msgr2=0x56100516de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e33400640 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 0x56100516de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e33400640 1 -- 172.21.15.5:0/1841992250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561004f1afe0 con 0x5610051670e0 2024-08-18T22:28:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e2be00640 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 0x56100516de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e33400640 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x56100516e3c0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009d90 tx=0x7f4e2c01b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bbf778a1f9817c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.239+0000 7f4e17e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e17e00640 1 -- 172.21.15.5:0/1841992250 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0b2040 con 0x5610051670e0 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 -- 172.21.15.5:0/1841992250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e2405f180 con 0x5610051670e0 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e17e00640 1 -- 172.21.15.5:0/1841992250 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f4e2c0ad440 con 0x5610051670e0 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e17e00640 1 -- 172.21.15.5:0/1841992250 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f4e2c0ca050 con 0x5610051670e0 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 10 client.8739 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 -- 172.21.15.5:0/1841992250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x561004f2eed0 con 0x5610051670e0 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e17e00640 1 -- 172.21.15.5:0/1841992250 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2405f180 con 0x5610051670e0 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e17e00640 1 -- 172.21.15.5:0/1841992250 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7f4e2c0cd020 con 0x5610051670e0 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 10 client.8739 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 10 client.8739 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-08-18T22:28:51.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 20 client.8739 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x561005175d10 0x561005178100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 4 client.8739 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 -- 172.21.15.5:0/1841992250 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561004efcd90 con 0x561005175d10 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e32a00640 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x561005175d10 0x561005178100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e32a00640 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x561005175d10 0x561005178100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7a9a7cee7ed3f03 server_cookie=b103721fee6a2d4 in_seq=0 out_seq=0 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e17e00640 10 client.8739 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e17e00640 1 -- 172.21.15.5:0/1841992250 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561004efcd90 con 0x561005175d10 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e17e00640 10 client.8739 handle_command_reply: tid=0 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 client.8739 shutdown 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 -- 172.21.15.5:0/1841992250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 msgr2=0x56100516e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x56100516e3c0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009d90 tx=0x7f4e2c01b060 comp rx=0 tx=0).stop 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 -- 172.21.15.5:0/1841992250 shutdown_connections 2024-08-18T22:28:51.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x561005175d10 0x561005178100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x56100516e3c0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 0x56100516de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 --2- 172.21.15.5:0/1841992250 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56100511eaf0 0x56100516d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e17e00640 0 client.8739 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 -- 172.21.15.5:0/1841992250 >> 172.21.15.5:0/1841992250 conn(0x56100510b680 msgr2=0x561005110d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 -- 172.21.15.5:0/1841992250 shutdown_connections 2024-08-18T22:28:51.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 1 -- 172.21.15.5:0/1841992250 wait complete. 2024-08-18T22:28:51.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.243+0000 7f4e3d113000 20 client.8739 trim_cache size 0 max 16384 2024-08-18T22:28:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 Processor -- start 2024-08-18T22:28:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 -- start start 2024-08-18T22:28:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56100511eaf0 0x561005165fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 0x561005164e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4e340af3f0 con 0x5610051670e0 2024-08-18T22:28:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e340ae430 con 0x5610051667c0 2024-08-18T22:28:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3414e7a0 con 0x56100511eaf0 2024-08-18T22:28:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e33400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e33400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39030/0 (socket says 172.21.15.5:39030) 2024-08-18T22:28:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e33400640 1 -- 172.21.15.5:0/446514173 learned_addr learned my addr 172.21.15.5:0/446514173 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e2be00640 1 --2- 172.21.15.5:0/446514173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 0x561005164e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e33400640 1 -- 172.21.15.5:0/446514173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56100511eaf0 msgr2=0x561005165fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e32a00640 1 --2- 172.21.15.5:0/446514173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56100511eaf0 0x561005165fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e33400640 1 --2- 172.21.15.5:0/446514173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56100511eaf0 0x561005165fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e33400640 1 -- 172.21.15.5:0/446514173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 msgr2=0x561005164e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e33400640 1 --2- 172.21.15.5:0/446514173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 0x561005164e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e33400640 1 -- 172.21.15.5:0/446514173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561004fe35c0 con 0x5610051670e0 2024-08-18T22:28:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e2be00640 1 --2- 172.21.15.5:0/446514173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 0x561005164e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e32a00640 1 --2- 172.21.15.5:0/446514173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56100511eaf0 0x561005165fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e33400640 1 --2- 172.21.15.5:0/446514173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051653a0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c01c860 tx=0x7f4e2c0ba000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1cc361984ba0726 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e22a00640 1 -- 172.21.15.5:0/446514173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0b2040 con 0x5610051670e0 2024-08-18T22:28:51.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e22a00640 1 -- 172.21.15.5:0/446514173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c0ad440 con 0x5610051670e0 2024-08-18T22:28:51.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e22a00640 1 -- 172.21.15.5:0/446514173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0a5c80 con 0x5610051670e0 2024-08-18T22:28:51.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 -- 172.21.15.5:0/446514173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 msgr2=0x5610051653a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 --2- 172.21.15.5:0/446514173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051653a0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c01c860 tx=0x7f4e2c0ba000 comp rx=0 tx=0).stop 2024-08-18T22:28:51.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 -- 172.21.15.5:0/446514173 shutdown_connections 2024-08-18T22:28:51.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 --2- 172.21.15.5:0/446514173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051653a0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 --2- 172.21.15.5:0/446514173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5610051667c0 0x561005164e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 --2- 172.21.15.5:0/446514173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56100511eaf0 0x561005165fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 -- 172.21.15.5:0/446514173 >> 172.21.15.5:0/446514173 conn(0x56100510b680 msgr2=0x561005123710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 -- 172.21.15.5:0/446514173 shutdown_connections 2024-08-18T22:28:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.263+0000 7f4e3d113000 1 -- 172.21.15.5:0/446514173 wait complete. 2024-08-18T22:28:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 -- start start 2024-08-18T22:28:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 Processor -- start 2024-08-18T22:28:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56100511eaf0 0x5610051d9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5610051667c0 0x5610051d97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051d9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561004f09a10 con 0x5610051670e0 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3414edf0 con 0x56100511eaf0 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561004f61780 con 0x5610051667c0 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 10 client.0 _ll_register_callbacks cb 0x7f4e18003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e33400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051d9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e33400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051d9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39032/0 (socket says 172.21.15.5:39032) 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e33400640 1 -- 172.21.15.5:0/2143748295 learned_addr learned my addr 172.21.15.5:0/2143748295 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e32a00640 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56100511eaf0 0x5610051d9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e2be00640 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5610051667c0 0x5610051d97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e33400640 1 -- 172.21.15.5:0/2143748295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5610051667c0 msgr2=0x5610051d97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e33400640 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5610051667c0 0x5610051d97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e33400640 1 -- 172.21.15.5:0/2143748295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56100511eaf0 msgr2=0x5610051d9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e33400640 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56100511eaf0 0x5610051d9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e33400640 1 -- 172.21.15.5:0/2143748295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561004ef5c50 con 0x5610051670e0 2024-08-18T22:28:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e2be00640 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5610051667c0 0x5610051d97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e33400640 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051d9ce0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009d10 tx=0x7f4e2c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625d3f97268053ca server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e17e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e17e00640 1 -- 172.21.15.5:0/2143748295 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0b2070 con 0x5610051670e0 2024-08-18T22:28:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e17e00640 1 -- 172.21.15.5:0/2143748295 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f4e2c0c4c50 con 0x5610051670e0 2024-08-18T22:28:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 -- 172.21.15.5:0/2143748295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e2c0ad440 con 0x5610051670e0 2024-08-18T22:28:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e17e00640 1 -- 172.21.15.5:0/2143748295 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f4e2c0c4e50 con 0x5610051670e0 2024-08-18T22:28:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 10 client.8745 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 -- 172.21.15.5:0/2143748295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x561004f082a0 con 0x5610051670e0 2024-08-18T22:28:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e17e00640 1 -- 172.21.15.5:0/2143748295 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c0ad440 con 0x5610051670e0 2024-08-18T22:28:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e17e00640 1 -- 172.21.15.5:0/2143748295 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7f4e2c0cd050 con 0x5610051670e0 2024-08-18T22:28:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 10 client.8745 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 10 client.8745 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-08-18T22:28:51.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 20 client.8745 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:51.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x56100517a8c0 0x56100517aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 4 client.8745 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-08-18T22:28:51.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 -- 172.21.15.5:0/2143748295 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x561004f6fba0 con 0x56100517a8c0 2024-08-18T22:28:51.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e32a00640 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x56100517a8c0 0x56100517aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e32a00640 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x56100517a8c0 0x56100517aca0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98ab72f9dd679269 server_cookie=67cf73b4aa2e8267 in_seq=0 out_seq=0 2024-08-18T22:28:51.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e17e00640 10 client.8745 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e17e00640 1 -- 172.21.15.5:0/2143748295 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561004f6fba0 con 0x56100517a8c0 2024-08-18T22:28:51.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e17e00640 10 client.8745 handle_command_reply: tid=0 2024-08-18T22:28:51.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.267+0000 7f4e3d113000 1 client.8745 shutdown 2024-08-18T22:28:51.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e3d113000 1 -- 172.21.15.5:0/2143748295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 msgr2=0x5610051d9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e3d113000 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051d9ce0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009d10 tx=0x7f4e2c009750 comp rx=0 tx=0).stop 2024-08-18T22:28:51.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e3d113000 1 -- 172.21.15.5:0/2143748295 shutdown_connections 2024-08-18T22:28:51.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e3d113000 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x56100517a8c0 0x56100517aca0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e3d113000 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5610051670e0 0x5610051d9ce0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e3d113000 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5610051667c0 0x5610051d97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e3d113000 1 --2- 172.21.15.5:0/2143748295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56100511eaf0 0x5610051d9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e17e00640 0 client.8745 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e3d113000 1 -- 172.21.15.5:0/2143748295 >> 172.21.15.5:0/2143748295 conn(0x56100510b680 msgr2=0x561005173520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e3d113000 1 -- 172.21.15.5:0/2143748295 shutdown_connections 2024-08-18T22:28:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e3d113000 1 -- 172.21.15.5:0/2143748295 wait complete. 2024-08-18T22:28:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e3d113000 20 client.8745 trim_cache size 0 max 16384 2024-08-18T22:28:51.277 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:28:51.278 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:28:51.278 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:28:51.278 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:28:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 -- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4e100678c0 msgr2=0x7f4e10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4e100678c0 0x7f4e10069d80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4e34148220 tx=0x7f4e1c009040 comp rx=0 tx=0).stop 2024-08-18T22:28:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 -- 172.21.15.5:0/753491427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e340b40c0 msgr2=0x7f4e341576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e340b40c0 0x7f4e341576e0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400e930 tx=0x7f4e2400edf0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 -- 172.21.15.5:0/753491427 shutdown_connections 2024-08-18T22:28:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4e100678c0 0x7f4e10069d80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e3415b0c0 0x7f4e34153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e340cf290 0x7f4e34152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 --2- 172.21.15.5:0/753491427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e340b40c0 0x7f4e341576e0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 -- 172.21.15.5:0/753491427 >> 172.21.15.5:0/753491427 conn(0x7f4e340b1dc0 msgr2=0x7f4e3415a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 -- 172.21.15.5:0/753491427 shutdown_connections 2024-08-18T22:28:51.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.271+0000 7f4e39c00640 1 -- 172.21.15.5:0/753491427 wait complete. 2024-08-18T22:28:51.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:51.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-08-18T22:28:51.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.431+0000 7f11fd200640 1 Processor -- start 2024-08-18T22:28:51.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.431+0000 7f11fd200640 1 -- start start 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11fd200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f815a9e0 0x7f11f8072220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11fd200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11f806eb20 0x7f11f80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11fd200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11f815adc0 con 0x7f11f8073ba0 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11fd200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f11f8072b00 con 0x7f11f806eb20 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11fd200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f11f8072de0 con 0x7f11f815a9e0 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11ed400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f11f8073ba0 0x7f11f806e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38536/0 (socket says 172.21.15.5:38536) 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11ed400640 1 -- 172.21.15.5:0/1571974002 learned_addr learned my addr 172.21.15.5:0/1571974002 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11f6800640 1 --2- 172.21.15.5:0/1571974002 >> v2:172.21.15.5:3300/0 conn(0x7f11f806eb20 0x7f11f80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11f5e00640 1 --2- 172.21.15.5:0/1571974002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f815a9e0 0x7f11f8072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11f5400640 1 -- 172.21.15.5:0/1571974002 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2528098317 0 0) 0x7f11f815adc0 con 0x7f11f8073ba0 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11f5400640 1 -- 172.21.15.5:0/1571974002 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11dc005740 con 0x7f11f8073ba0 2024-08-18T22:28:51.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11f6800640 1 -- 172.21.15.5:0/1571974002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f815a9e0 msgr2=0x7f11f8072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11f6800640 1 --2- 172.21.15.5:0/1571974002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f815a9e0 0x7f11f8072220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11f6800640 1 -- 172.21.15.5:0/1571974002 >> v1:172.21.15.5:6789/0 conn(0x7f11f8073ba0 legacy=0x7f11f806e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.435+0000 7f11f6800640 1 -- 172.21.15.5:0/1571974002 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f80730c0 con 0x7f11f806eb20 2024-08-18T22:28:51.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11f6800640 1 --2- 172.21.15.5:0/1571974002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11f806eb20 0x7f11f80cdf10 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009d90 tx=0x7f11f001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d720ad0fe80c554 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11f5400640 1 -- 172.21.15.5:0/1571974002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f00b2070 con 0x7f11f806eb20 2024-08-18T22:28:51.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11f5400640 1 -- 172.21.15.5:0/1571974002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f00a5980 con 0x7f11f806eb20 2024-08-18T22:28:51.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11f5400640 1 -- 172.21.15.5:0/1571974002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f00a5d30 con 0x7f11f806eb20 2024-08-18T22:28:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 -- 172.21.15.5:0/1571974002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11f806eb20 msgr2=0x7f11f80cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 --2- 172.21.15.5:0/1571974002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11f806eb20 0x7f11f80cdf10 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009d90 tx=0x7f11f001c940 comp rx=0 tx=0).stop 2024-08-18T22:28:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 -- 172.21.15.5:0/1571974002 shutdown_connections 2024-08-18T22:28:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 --2- 172.21.15.5:0/1571974002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11f806eb20 0x7f11f80cdf10 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 --2- 172.21.15.5:0/1571974002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f815a9e0 0x7f11f8072220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 -- 172.21.15.5:0/1571974002 >> 172.21.15.5:0/1571974002 conn(0x7f11f80b1dc0 msgr2=0x7f11f80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 -- 172.21.15.5:0/1571974002 shutdown_connections 2024-08-18T22:28:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 -- 172.21.15.5:0/1571974002 wait complete. 2024-08-18T22:28:51.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 Processor -- start 2024-08-18T22:28:51.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 -- start start 2024-08-18T22:28:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f806eb20 0x7f11f81523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8073ba0 0x7f11f815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11f815a9e0 0x7f11f8162870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f11f80ce5d0 con 0x7f11f815a9e0 2024-08-18T22:28:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f11f80ce450 con 0x7f11f8073ba0 2024-08-18T22:28:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11fd200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f11f80ce750 con 0x7f11f806eb20 2024-08-18T22:28:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11f6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11f815a9e0 0x7f11f8162870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11f6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11f815a9e0 0x7f11f8162870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39046/0 (socket says 172.21.15.5:39046) 2024-08-18T22:28:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.439+0000 7f11f6800640 1 -- 172.21.15.5:0/3618405370 learned_addr learned my addr 172.21.15.5:0/3618405370 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11ed400640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8073ba0 0x7f11f815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11f5e00640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f806eb20 0x7f11f81523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11f6800640 1 -- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f806eb20 msgr2=0x7f11f81523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11f6800640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f806eb20 0x7f11f81523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11f6800640 1 -- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8073ba0 msgr2=0x7f11f815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11f6800640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8073ba0 0x7f11f815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11f6800640 1 -- 172.21.15.5:0/3618405370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f8152930 con 0x7f11f815a9e0 2024-08-18T22:28:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11f6800640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11f815a9e0 0x7f11f8162870 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f11f001a570 tx=0x7f11f00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11eea00640 1 -- 172.21.15.5:0/3618405370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f00b2050 con 0x7f11f815a9e0 2024-08-18T22:28:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11eea00640 1 -- 172.21.15.5:0/3618405370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f00be070 con 0x7f11f815a9e0 2024-08-18T22:28:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11eea00640 1 -- 172.21.15.5:0/3618405370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f0004040 con 0x7f11f815a9e0 2024-08-18T22:28:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11fd200640 1 -- 172.21.15.5:0/3618405370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f815ddd0 con 0x7f11f815a9e0 2024-08-18T22:28:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11fd200640 1 -- 172.21.15.5:0/3618405370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f81537b0 con 0x7f11f815a9e0 2024-08-18T22:28:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11eea00640 1 -- 172.21.15.5:0/3618405370 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f11f0004200 con 0x7f11f815a9e0 2024-08-18T22:28:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11eea00640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f11d40678c0 0x7f11d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.443+0000 7f11eea00640 1 -- 172.21.15.5:0/3618405370 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f11f0120fa0 con 0x7f11f815a9e0 2024-08-18T22:28:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f5e00640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f11d40678c0 0x7f11d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 Processor -- start 2024-08-18T22:28:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 -- start start 2024-08-18T22:28:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f5e00640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f11d40678c0 0x7f11d4069d80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f11f815d680 tx=0x7f11e8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c182d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1832c0 0x560e9c135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 0x560e9c1368e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560e9c01fae0 con 0x560e9c1829a0 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560e9c00bba0 con 0x560e9c136500 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560e9bf864f0 con 0x560e9c1832c0 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c182d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c182d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39050/0 (socket says 172.21.15.5:39050) 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f5e00640 1 -- 172.21.15.5:0/819593277 learned_addr learned my addr 172.21.15.5:0/819593277 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11ed400640 1 --2- 172.21.15.5:0/819593277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1832c0 0x560e9c135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f6800640 1 --2- 172.21.15.5:0/819593277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 0x560e9c1368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f5e00640 1 -- 172.21.15.5:0/819593277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1832c0 msgr2=0x560e9c135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f5e00640 1 --2- 172.21.15.5:0/819593277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1832c0 0x560e9c135fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f5e00640 1 -- 172.21.15.5:0/819593277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 msgr2=0x560e9c1368e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f5e00640 1 --2- 172.21.15.5:0/819593277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 0x560e9c1368e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f5e00640 1 -- 172.21.15.5:0/819593277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e9bf26a90 con 0x560e9c1829a0 2024-08-18T22:28:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f6800640 1 --2- 172.21.15.5:0/819593277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 0x560e9c1368e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11f5e00640 1 --2- 172.21.15.5:0/819593277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c182d80 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f11e8011d80 tx=0x7f11e8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72899ca187291b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11e6a00640 1 -- 172.21.15.5:0/819593277 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8014bd0 con 0x560e9c1829a0 2024-08-18T22:28:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11e6a00640 1 -- 172.21.15.5:0/819593277 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e801b070 con 0x560e9c1829a0 2024-08-18T22:28:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f11e6a00640 1 -- 172.21.15.5:0/819593277 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8004030 con 0x560e9c1829a0 2024-08-18T22:28:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 -- 172.21.15.5:0/819593277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 msgr2=0x560e9c182d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 --2- 172.21.15.5:0/819593277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c182d80 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f11e8011d80 tx=0x7f11e8014000 comp rx=0 tx=0).stop 2024-08-18T22:28:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 -- 172.21.15.5:0/819593277 shutdown_connections 2024-08-18T22:28:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 --2- 172.21.15.5:0/819593277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 0x560e9c1368e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 --2- 172.21.15.5:0/819593277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1832c0 0x560e9c135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 --2- 172.21.15.5:0/819593277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c182d80 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 -- 172.21.15.5:0/819593277 >> 172.21.15.5:0/819593277 conn(0x560e9c130010 msgr2=0x560e9c165820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 -- 172.21.15.5:0/819593277 shutdown_connections 2024-08-18T22:28:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 -- 172.21.15.5:0/819593277 wait complete. 2024-08-18T22:28:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.447+0000 7f12003ff000 1 -- start start 2024-08-18T22:28:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 1 Processor -- start 2024-08-18T22:28:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c136500 0x560e9c162e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c1829a0 0x560e9c13e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1832c0 0x560e9c13e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560e9bf824b0 con 0x560e9c1832c0 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560e9bf40b50 con 0x560e9c1829a0 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560e9bf27d00 con 0x560e9c136500 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 10 client.0 _ll_register_callbacks cb 0x560e9c123f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1832c0 0x560e9c13e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11ed400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c1829a0 0x560e9c13e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1832c0 0x560e9c13e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39062/0 (socket says 172.21.15.5:39062) 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c136500 0x560e9c162e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f6800640 1 -- 172.21.15.5:0/1246431495 learned_addr learned my addr 172.21.15.5:0/1246431495 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f6800640 1 -- 172.21.15.5:0/1246431495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c136500 msgr2=0x560e9c162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f6800640 1 --2- 172.21.15.5:0/1246431495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c136500 0x560e9c162e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f6800640 1 -- 172.21.15.5:0/1246431495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c1829a0 msgr2=0x560e9c13e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f6800640 1 --2- 172.21.15.5:0/1246431495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c1829a0 0x560e9c13e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f6800640 1 -- 172.21.15.5:0/1246431495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e9bf3f060 con 0x560e9c1832c0 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f6800640 1 --2- 172.21.15.5:0/1246431495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1832c0 0x560e9c13e570 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f11f0019550 tx=0x7f11f00f12e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab9b930237571b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11db400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11db400640 1 -- 172.21.15.5:0/1246431495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f00f9900 con 0x560e9c1832c0 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11db400640 1 -- 172.21.15.5:0/1246431495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f11f00f9aa0 con 0x560e9c1832c0 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 1 -- 172.21.15.5:0/1246431495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11e801b070 con 0x560e9c1832c0 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11db400640 1 -- 172.21.15.5:0/1246431495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f11f00f50b0 con 0x560e9c1832c0 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 10 client.8760 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 1 -- 172.21.15.5:0/1246431495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x560e9bf52f50 con 0x560e9c1832c0 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11db400640 1 -- 172.21.15.5:0/1246431495 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e801b070 con 0x560e9c1832c0 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11db400640 1 -- 172.21.15.5:0/1246431495 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7f11f00f06b0 con 0x560e9c1832c0 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 10 client.8760 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 10 client.8760 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 20 client.8760 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 1 --2- 172.21.15.5:0/1246431495 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x560e9c164d30 0x560e9c165110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 4 client.8760 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:28:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f12003ff000 1 -- 172.21.15.5:0/1246431495 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e9bf20e10 con 0x560e9c164d30 2024-08-18T22:28:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f5e00640 1 --2- 172.21.15.5:0/1246431495 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x560e9c164d30 0x560e9c165110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11f5e00640 1 --2- 172.21.15.5:0/1246431495 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x560e9c164d30 0x560e9c165110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbf1b73c44a65f16 server_cookie=c6d997a8d3846caa in_seq=0 out_seq=0 2024-08-18T22:28:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.451+0000 7f11db400640 10 client.8760 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f11db400640 1 -- 172.21.15.5:0/1246431495 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e9bf20e10 con 0x560e9c164d30 2024-08-18T22:28:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f11db400640 10 client.8760 handle_command_reply: tid=0 2024-08-18T22:28:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 1 client.8760 shutdown 2024-08-18T22:28:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 1 -- 172.21.15.5:0/1246431495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1832c0 msgr2=0x560e9c13e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 1 --2- 172.21.15.5:0/1246431495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1832c0 0x560e9c13e570 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f11f0019550 tx=0x7f11f00f12e0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 1 -- 172.21.15.5:0/1246431495 shutdown_connections 2024-08-18T22:28:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 1 --2- 172.21.15.5:0/1246431495 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x560e9c164d30 0x560e9c165110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 1 --2- 172.21.15.5:0/1246431495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1832c0 0x560e9c13e570 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 1 --2- 172.21.15.5:0/1246431495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c1829a0 0x560e9c13e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 1 --2- 172.21.15.5:0/1246431495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c136500 0x560e9c162e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f11db400640 0 client.8760 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 1 -- 172.21.15.5:0/1246431495 >> 172.21.15.5:0/1246431495 conn(0x560e9c130010 msgr2=0x560e9c1356c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 1 -- 172.21.15.5:0/1246431495 shutdown_connections 2024-08-18T22:28:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 1 -- 172.21.15.5:0/1246431495 wait complete. 2024-08-18T22:28:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.455+0000 7f12003ff000 20 client.8760 trim_cache size 0 max 16384 2024-08-18T22:28:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.471+0000 7f12003ff000 1 Processor -- start 2024-08-18T22:28:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.471+0000 7f12003ff000 1 -- start start 2024-08-18T22:28:51.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.471+0000 7f12003ff000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c136500 0x560e9c181d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.471+0000 7f12003ff000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1829a0 0x560e9c1357a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.471+0000 7f12003ff000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c1832c0 0x560e9c135ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.471+0000 7f12003ff000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8203be0 con 0x560e9c136500 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.471+0000 7f12003ff000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8202e60 con 0x560e9c1832c0 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.471+0000 7f12003ff000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f11f81fad00 con 0x560e9c1829a0 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c136500 0x560e9c181d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c136500 0x560e9c181d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39070/0 (socket says 172.21.15.5:39070) 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f5e00640 1 -- 172.21.15.5:0/3999261604 learned_addr learned my addr 172.21.15.5:0/3999261604 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f6800640 1 --2- 172.21.15.5:0/3999261604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c1832c0 0x560e9c135ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11ed400640 1 --2- 172.21.15.5:0/3999261604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1829a0 0x560e9c1357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f5e00640 1 -- 172.21.15.5:0/3999261604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1829a0 msgr2=0x560e9c1357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f5e00640 1 --2- 172.21.15.5:0/3999261604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1829a0 0x560e9c1357a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f5e00640 1 -- 172.21.15.5:0/3999261604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c1832c0 msgr2=0x560e9c135ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f5e00640 1 --2- 172.21.15.5:0/3999261604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c1832c0 0x560e9c135ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f5e00640 1 -- 172.21.15.5:0/3999261604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e9c008dd0 con 0x560e9c136500 2024-08-18T22:28:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f5e00640 1 --2- 172.21.15.5:0/3999261604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c136500 0x560e9c181d20 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f11e8011d50 tx=0x7f11e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0656bcd237e7682 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11e6000640 1 -- 172.21.15.5:0/3999261604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8004230 con 0x560e9c136500 2024-08-18T22:28:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11e6000640 1 -- 172.21.15.5:0/3999261604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e803a070 con 0x560e9c136500 2024-08-18T22:28:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11e6000640 1 -- 172.21.15.5:0/3999261604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8003620 con 0x560e9c136500 2024-08-18T22:28:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 -- 172.21.15.5:0/3999261604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c136500 msgr2=0x560e9c181d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 --2- 172.21.15.5:0/3999261604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c136500 0x560e9c181d20 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f11e8011d50 tx=0x7f11e8016000 comp rx=0 tx=0).stop 2024-08-18T22:28:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 -- 172.21.15.5:0/3999261604 shutdown_connections 2024-08-18T22:28:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 --2- 172.21.15.5:0/3999261604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c1832c0 0x560e9c135ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 --2- 172.21.15.5:0/3999261604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1829a0 0x560e9c1357a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 --2- 172.21.15.5:0/3999261604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c136500 0x560e9c181d20 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 -- 172.21.15.5:0/3999261604 >> 172.21.15.5:0/3999261604 conn(0x560e9c130010 msgr2=0x560e9c1811f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 -- 172.21.15.5:0/3999261604 shutdown_connections 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 -- 172.21.15.5:0/3999261604 wait complete. 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 -- start start 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 Processor -- start 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 0x560e9c1f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c1f6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1832c0 0x560e9c1f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f11f81fb350 con 0x560e9c1829a0 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560e9bf517f0 con 0x560e9c136500 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560e9c043240 con 0x560e9c1832c0 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f12003ff000 10 client.0 _ll_register_callbacks cb 0x7f11f00f10c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11ed400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c1f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11ed400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c1f6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39082/0 (socket says 172.21.15.5:39082) 2024-08-18T22:28:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f5e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 0x560e9c1f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11ed400640 1 -- 172.21.15.5:0/1118810732 learned_addr learned my addr 172.21.15.5:0/1118810732 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.475+0000 7f11f6800640 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1832c0 0x560e9c1f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11f5e00640 1 -- 172.21.15.5:0/1118810732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1832c0 msgr2=0x560e9c1f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11f5e00640 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1832c0 0x560e9c1f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11f5e00640 1 -- 172.21.15.5:0/1118810732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 msgr2=0x560e9c1f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11f5e00640 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c1f6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11f5e00640 1 -- 172.21.15.5:0/1118810732 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e9bf19cd0 con 0x560e9c136500 2024-08-18T22:28:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11ed400640 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c1f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:28:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11f5e00640 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 0x560e9c1f5e20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x560e9bfc59f0 tx=0x7f11e8019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d99a6892ea28e330 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11db400640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-08-18T22:28:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11db400640 1 -- 172.21.15.5:0/1118810732 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8042030 con 0x560e9c136500 2024-08-18T22:28:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11db400640 1 -- 172.21.15.5:0/1118810732 <== mon.1 v2:172.21.15.117:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f11e8004240 con 0x560e9c136500 2024-08-18T22:28:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 -- 172.21.15.5:0/1118810732 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11e803a070 con 0x560e9c136500 2024-08-18T22:28:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11db400640 1 -- 172.21.15.5:0/1118810732 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f11e8004440 con 0x560e9c136500 2024-08-18T22:28:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 10 client.8062 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 -- 172.21.15.5:0/1118810732 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x560e9bf2c320 con 0x560e9c136500 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11db400640 1 -- 172.21.15.5:0/1118810732 <== mon.1 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e803a070 con 0x560e9c136500 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11db400640 1 -- 172.21.15.5:0/1118810732 <== mon.1 v2:172.21.15.117:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7f11e8020070 con 0x560e9c136500 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 10 client.8062 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 10 client.8062 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 20 client.8062 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x560e9c195440 0x560e9c195820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 4 client.8062 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 -- 172.21.15.5:0/1118810732 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560e9bf93c20 con 0x560e9c195440 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11ed400640 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x560e9c195440 0x560e9c195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11db400640 10 client.8062 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11ed400640 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x560e9c195440 0x560e9c195820 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1fdd94c99965d80 server_cookie=4a788ce6b6f4011d in_seq=0 out_seq=0 2024-08-18T22:28:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11db400640 1 -- 172.21.15.5:0/1118810732 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x560e9bf93c20 con 0x560e9c195440 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11db400640 10 client.8062 handle_command_reply: tid=0 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 client.8062 shutdown 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 -- 172.21.15.5:0/1118810732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 msgr2=0x560e9c1f5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 0x560e9c1f5e20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x560e9bfc59f0 tx=0x7f11e8019000 comp rx=0 tx=0).stop 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 -- 172.21.15.5:0/1118810732 shutdown_connections 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x560e9c195440 0x560e9c195820 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560e9c1832c0 0x560e9c1f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e9c1829a0 0x560e9c1f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 --2- 172.21.15.5:0/1118810732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560e9c136500 0x560e9c1f5e20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11db400640 0 client.8062 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 -- 172.21.15.5:0/1118810732 >> 172.21.15.5:0/1118810732 conn(0x560e9c130010 msgr2=0x560e9c163f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 -- 172.21.15.5:0/1118810732 shutdown_connections 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 1 -- 172.21.15.5:0/1118810732 wait complete. 2024-08-18T22:28:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f12003ff000 20 client.8062 trim_cache size 0 max 16384 2024-08-18T22:28:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:28:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-08-18T22:28:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-18T22:28:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "bcdc7333-7957-478f-b933-4093dc5def21": { 2024-08-18T22:28:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_control_test_path", 2024-08-18T22:28:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "bcdc7333-7957-478f-b933-4093dc5def21", 2024-08-18T22:28:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive" 2024-08-18T22:28:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:28:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:28:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 -- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f11d40678c0 msgr2=0x7f11d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f11d40678c0 0x7f11d4069d80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f11f815d680 tx=0x7f11e8009190 comp rx=0 tx=0).stop 2024-08-18T22:28:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 -- 172.21.15.5:0/3618405370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11f815a9e0 msgr2=0x7f11f8162870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11f815a9e0 0x7f11f8162870 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f11f001a570 tx=0x7f11f00196e0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 -- 172.21.15.5:0/3618405370 shutdown_connections 2024-08-18T22:28:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f11d40678c0 0x7f11d4069d80 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11f815a9e0 0x7f11f8162870 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8073ba0 0x7f11f815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 --2- 172.21.15.5:0/3618405370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f806eb20 0x7f11f81523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 -- 172.21.15.5:0/3618405370 >> 172.21.15.5:0/3618405370 conn(0x7f11f80b1dc0 msgr2=0x7f11f8165070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 -- 172.21.15.5:0/3618405370 shutdown_connections 2024-08-18T22:28:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.479+0000 7f11fd200640 1 -- 172.21.15.5:0/3618405370 wait complete. 2024-08-18T22:28:51.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:51.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa8600640 1 Processor -- start 2024-08-18T22:28:51.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa8600640 1 -- start start 2024-08-18T22:28:51.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa8600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6aa006b9b0 0x7f6aa00ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa8600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6aa00b1c50 0x7f6aa00b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa8600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa00b0bd0 con 0x7f6aa006bd90 2024-08-18T22:28:51.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa8600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6aa00b0e90 con 0x7f6aa006b9b0 2024-08-18T22:28:51.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa8600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6aa00b1170 con 0x7f6aa00b1c50 2024-08-18T22:28:51.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa5c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6aa006b9b0 0x7f6aa00ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa5c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6aa006b9b0 0x7f6aa00ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39098/0 (socket says 172.21.15.5:39098) 2024-08-18T22:28:51.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa5c00640 1 -- 172.21.15.5:0/3556985909 learned_addr learned my addr 172.21.15.5:0/3556985909 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa6600640 1 --2- 172.21.15.5:0/3556985909 >> v2:172.21.15.117:3300/0 conn(0x7f6aa00b1c50 0x7f6aa00b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa5c00640 1 -- 172.21.15.5:0/3556985909 >> v2:172.21.15.117:3300/0 conn(0x7f6aa00b1c50 msgr2=0x7f6aa00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa5c00640 1 --2- 172.21.15.5:0/3556985909 >> v2:172.21.15.117:3300/0 conn(0x7f6aa00b1c50 0x7f6aa00b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa5c00640 1 -- 172.21.15.5:0/3556985909 >> v1:172.21.15.117:6789/0 conn(0x7f6aa006bd90 legacy=0x7f6aa01453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa5c00640 1 -- 172.21.15.5:0/3556985909 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa00b1450 con 0x7f6aa006b9b0 2024-08-18T22:28:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.643+0000 7f6aa6600640 1 --2- 172.21.15.5:0/3556985909 >> v2:172.21.15.117:3300/0 conn(0x7f6aa00b1c50 0x7f6aa00b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:51.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6aa5c00640 1 --2- 172.21.15.5:0/3556985909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa006b9b0 0x7f6aa00ce520 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0072980 tx=0x7f6a9401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfc69f75533bc3c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6a9fe00640 1 -- 172.21.15.5:0/3556985909 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a940a57f0 con 0x7f6aa006b9b0 2024-08-18T22:28:51.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6a9fe00640 1 -- 172.21.15.5:0/3556985909 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a940a5990 con 0x7f6aa006b9b0 2024-08-18T22:28:51.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6a9fe00640 1 -- 172.21.15.5:0/3556985909 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a940a5d60 con 0x7f6aa006b9b0 2024-08-18T22:28:51.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6aa8600640 1 -- 172.21.15.5:0/3556985909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa006b9b0 msgr2=0x7f6aa00ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6aa8600640 1 --2- 172.21.15.5:0/3556985909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa006b9b0 0x7f6aa00ce520 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0072980 tx=0x7f6a9401c9f0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6aa8600640 1 -- 172.21.15.5:0/3556985909 shutdown_connections 2024-08-18T22:28:51.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6aa8600640 1 --2- 172.21.15.5:0/3556985909 >> v2:172.21.15.117:3300/0 conn(0x7f6aa00b1c50 0x7f6aa00b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6aa8600640 1 --2- 172.21.15.5:0/3556985909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa006b9b0 0x7f6aa00ce520 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6aa8600640 1 -- 172.21.15.5:0/3556985909 >> 172.21.15.5:0/3556985909 conn(0x7f6aa009aa40 msgr2=0x7f6aa00b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6aa8600640 1 -- 172.21.15.5:0/3556985909 shutdown_connections 2024-08-18T22:28:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.647+0000 7f6aa8600640 1 -- 172.21.15.5:0/3556985909 wait complete. 2024-08-18T22:28:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa8600640 1 Processor -- start 2024-08-18T22:28:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa8600640 1 -- start start 2024-08-18T22:28:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa8600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa006b9b0 0x7f6aa00b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa8600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa006bd90 0x7f6aa00ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa8600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6aa00b1c50 0x7f6aa0143b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa8600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa006c2f0 con 0x7f6aa006b9b0 2024-08-18T22:28:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa8600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa006c170 con 0x7f6aa006bd90 2024-08-18T22:28:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa8600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6aa00ae040 con 0x7f6aa00b1c50 2024-08-18T22:28:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa5c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa006b9b0 0x7f6aa00b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa5c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa006b9b0 0x7f6aa00b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39100/0 (socket says 172.21.15.5:39100) 2024-08-18T22:28:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa5c00640 1 -- 172.21.15.5:0/2795868007 learned_addr learned my addr 172.21.15.5:0/2795868007 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa5200640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa006bd90 0x7f6aa00ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa6600640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6aa00b1c50 0x7f6aa0143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa5c00640 1 -- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6aa00b1c50 msgr2=0x7f6aa0143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa5c00640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6aa00b1c50 0x7f6aa0143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa5c00640 1 -- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa006bd90 msgr2=0x7f6aa00ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa5c00640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa006bd90 0x7f6aa00ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa5c00640 1 -- 172.21.15.5:0/2795868007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa01426f0 con 0x7f6aa006b9b0 2024-08-18T22:28:51.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa6600640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6aa00b1c50 0x7f6aa0143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:51.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa5c00640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa006b9b0 0x7f6aa00b5750 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f6a9401a620 tx=0x7f6a94019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6a9d600640 1 -- 172.21.15.5:0/2795868007 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a940b8880 con 0x7f6aa006b9b0 2024-08-18T22:28:51.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6a9d600640 1 -- 172.21.15.5:0/2795868007 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a940be070 con 0x7f6aa006b9b0 2024-08-18T22:28:51.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6a9d600640 1 -- 172.21.15.5:0/2795868007 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a940b8ca0 con 0x7f6aa006b9b0 2024-08-18T22:28:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa8600640 1 -- 172.21.15.5:0/2795868007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa01429d0 con 0x7f6aa006b9b0 2024-08-18T22:28:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.651+0000 7f6aa8600640 1 -- 172.21.15.5:0/2795868007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa0142f90 con 0x7f6aa006b9b0 2024-08-18T22:28:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.655+0000 7f6aa8600640 1 -- 172.21.15.5:0/2795868007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aa00ce520 con 0x7f6aa006b9b0 2024-08-18T22:28:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.655+0000 7f6a9d600640 1 -- 172.21.15.5:0/2795868007 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a940c3460 con 0x7f6aa006b9b0 2024-08-18T22:28:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.655+0000 7f6a9d600640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a800678c0 0x7f6a80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:51.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.655+0000 7f6a9d600640 1 -- 172.21.15.5:0/2795868007 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f6a94120fb0 con 0x7f6aa006b9b0 2024-08-18T22:28:51.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.655+0000 7f6aa5200640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a800678c0 0x7f6a80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:51.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.655+0000 7f6aa5200640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a800678c0 0x7f6a80069d80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00b34f0 tx=0x7f6a8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:51.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.659+0000 7f6a9d600640 1 -- 172.21.15.5:0/2795868007 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6a940165e0 con 0x7f6aa006b9b0 2024-08-18T22:28:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 -- 172.21.15.5:0/2795868007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6aa01fa6f0 con 0x7f6aa006b9b0 2024-08-18T22:28:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6a9d600640 1 -- 172.21.15.5:0/2795868007 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5231 (secure 0 0 0) 0x7f6a940f18c0 con 0x7f6aa006b9b0 2024-08-18T22:28:51.863 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:51.863 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:28:21.056377+0000","modified":"2024-08-18T22:28:24.121089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1373218784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1373218784},{"type":"v1","addr":"172.21.15.5:6833","nonce":1373218784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8565,"qdb_cluster":[8565]},"id":9}]} 2024-08-18T22:28:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 108 2024-08-18T22:28:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 -- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a800678c0 msgr2=0x7f6a80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a800678c0 0x7f6a80069d80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00b34f0 tx=0x7f6a8c009040 comp rx=0 tx=0).stop 2024-08-18T22:28:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 -- 172.21.15.5:0/2795868007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa006b9b0 msgr2=0x7f6aa00b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa006b9b0 0x7f6aa00b5750 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f6a9401a620 tx=0x7f6a94019790 comp rx=0 tx=0).stop 2024-08-18T22:28:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 -- 172.21.15.5:0/2795868007 shutdown_connections 2024-08-18T22:28:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a800678c0 0x7f6a80069d80 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6aa00b1c50 0x7f6aa0143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa006bd90 0x7f6aa00ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 --2- 172.21.15.5:0/2795868007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa006b9b0 0x7f6aa00b5750 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 -- 172.21.15.5:0/2795868007 >> 172.21.15.5:0/2795868007 conn(0x7f6aa009aa40 msgr2=0x7f6aa0070470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 -- 172.21.15.5:0/2795868007 shutdown_connections 2024-08-18T22:28:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:51.863+0000 7f6aa8600640 1 -- 172.21.15.5:0/2795868007 wait complete. 2024-08-18T22:28:51.884 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:28:51.884 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:28:52.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40dd600640 1 Processor -- start 2024-08-18T22:28:52.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40dd600640 1 -- start start 2024-08-18T22:28:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40dd600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40d815bed0 0x7f40d80735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40dd600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40d8073c80 con 0x7f40d80cb390 2024-08-18T22:28:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40dd600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40d80ca5d0 con 0x7f40d806da70 2024-08-18T22:28:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40dd600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f40d80ca8b0 con 0x7f40d815bed0 2024-08-18T22:28:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40d6000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f40d80cb390 0x7f40d8071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38544/0 (socket says 172.21.15.5:38544) 2024-08-18T22:28:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40d6000640 1 -- 172.21.15.5:0/3794853188 learned_addr learned my addr 172.21.15.5:0/3794853188 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40d6a00640 1 --2- 172.21.15.5:0/3794853188 >> v2:172.21.15.117:3300/0 conn(0x7f40d815bed0 0x7f40d80735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40d5600640 1 -- 172.21.15.5:0/3794853188 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190627547 0 0) 0x7f40d8073c80 con 0x7f40d80cb390 2024-08-18T22:28:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40d5600640 1 -- 172.21.15.5:0/3794853188 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40bc003530 con 0x7f40d80cb390 2024-08-18T22:28:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40d5600640 1 -- 172.21.15.5:0/3794853188 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333377547 0 0) 0x7f40d80ca5d0 con 0x7f40d806da70 2024-08-18T22:28:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40d5600640 1 -- 172.21.15.5:0/3794853188 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40d8073c80 con 0x7f40d806da70 2024-08-18T22:28:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40d5600640 1 -- 172.21.15.5:0/3794853188 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3916770771 0 0) 0x7f40bc003530 con 0x7f40d80cb390 2024-08-18T22:28:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40d6a00640 1 -- 172.21.15.5:0/3794853188 >> v1:172.21.15.117:6789/0 conn(0x7f40d806da70 legacy=0x7f40d8165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:52.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40d6a00640 1 -- 172.21.15.5:0/3794853188 >> v1:172.21.15.5:6789/0 conn(0x7f40d80cb390 legacy=0x7f40d8071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:52.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.023+0000 7f40d6a00640 1 -- 172.21.15.5:0/3794853188 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d80cab90 con 0x7f40d815bed0 2024-08-18T22:28:52.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.027+0000 7f40d6a00640 1 --2- 172.21.15.5:0/3794853188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40d815bed0 0x7f40d80735a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f40c80097c0 tx=0x7f40c801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3a404b5bbd4f202 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:52.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.027+0000 7f40d5600640 1 -- 172.21.15.5:0/3794853188 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c80b0070 con 0x7f40d815bed0 2024-08-18T22:28:52.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.027+0000 7f40d5600640 1 -- 172.21.15.5:0/3794853188 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c80ab400 con 0x7f40d815bed0 2024-08-18T22:28:52.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.027+0000 7f40d5600640 1 -- 172.21.15.5:0/3794853188 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4001680 con 0x7f40d815bed0 2024-08-18T22:28:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.027+0000 7f40dd600640 1 -- 172.21.15.5:0/3794853188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40d815bed0 msgr2=0x7f40d80735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.027+0000 7f40dd600640 1 --2- 172.21.15.5:0/3794853188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40d815bed0 0x7f40d80735a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f40c80097c0 tx=0x7f40c801c390 comp rx=0 tx=0).stop 2024-08-18T22:28:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.027+0000 7f40dd600640 1 -- 172.21.15.5:0/3794853188 shutdown_connections 2024-08-18T22:28:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.027+0000 7f40dd600640 1 --2- 172.21.15.5:0/3794853188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40d815bed0 0x7f40d80735a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.027+0000 7f40dd600640 1 -- 172.21.15.5:0/3794853188 >> 172.21.15.5:0/3794853188 conn(0x7f40d80b1c50 msgr2=0x7f40d80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.027+0000 7f40dd600640 1 -- 172.21.15.5:0/3794853188 shutdown_connections 2024-08-18T22:28:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.027+0000 7f40dd600640 1 -- 172.21.15.5:0/3794853188 wait complete. 2024-08-18T22:28:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40dd600640 1 Processor -- start 2024-08-18T22:28:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40dd600640 1 -- start start 2024-08-18T22:28:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40dd600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40d806da70 0x7f40d81578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40dd600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40d80cb390 0x7f40d815ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40dd600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40d815bed0 0x7f40d815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40dd600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8169c40 con 0x7f40d80cb390 2024-08-18T22:28:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40dd600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8169ac0 con 0x7f40d806da70 2024-08-18T22:28:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40dd600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f40d8169dc0 con 0x7f40d815bed0 2024-08-18T22:28:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40d6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40d80cb390 0x7f40d815ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40d6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40d80cb390 0x7f40d815ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39104/0 (socket says 172.21.15.5:39104) 2024-08-18T22:28:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40d6000640 1 -- 172.21.15.5:0/3247750654 learned_addr learned my addr 172.21.15.5:0/3247750654 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40d7400640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40d815bed0 0x7f40d815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40d6a00640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40d806da70 0x7f40d81578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40d6000640 1 -- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40d815bed0 msgr2=0x7f40d815a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40d6000640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40d815bed0 0x7f40d815a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40d6000640 1 -- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40d806da70 msgr2=0x7f40d81578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40d6000640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40d806da70 0x7f40d81578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40d6000640 1 -- 172.21.15.5:0/3247750654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d815d7a0 con 0x7f40d80cb390 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40d6000640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40d80cb390 0x7f40d815ce30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c780 tx=0x7f40c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40cea00640 1 -- 172.21.15.5:0/3247750654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4005cf0 con 0x7f40d80cb390 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40cea00640 1 -- 172.21.15.5:0/3247750654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c400ce30 con 0x7f40d80cb390 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40dd600640 1 -- 172.21.15.5:0/3247750654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d815da80 con 0x7f40d80cb390 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40cea00640 1 -- 172.21.15.5:0/3247750654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007290 con 0x7f40d80cb390 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40dd600640 1 -- 172.21.15.5:0/3247750654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d815e040 con 0x7f40d80cb390 2024-08-18T22:28:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.031+0000 7f40dd600640 1 -- 172.21.15.5:0/3247750654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d80735a0 con 0x7f40d80cb390 2024-08-18T22:28:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.035+0000 7f40cea00640 1 -- 172.21.15.5:0/3247750654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f40c4007430 con 0x7f40d80cb390 2024-08-18T22:28:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.035+0000 7f40cea00640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40b80678f0 0x7f40b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.035+0000 7f40cea00640 1 -- 172.21.15.5:0/3247750654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f40c4085d40 con 0x7f40d80cb390 2024-08-18T22:28:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.035+0000 7f40d6a00640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40b80678f0 0x7f40b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.035+0000 7f40d6a00640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40b80678f0 0x7f40b8069db0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ad000 tx=0x7f40c80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:52.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.039+0000 7f40cea00640 1 -- 172.21.15.5:0/3247750654 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f40c4007720 con 0x7f40d80cb390 2024-08-18T22:28:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 -- 172.21.15.5:0/3247750654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f40d80ca340 con 0x7f40d80cb390 2024-08-18T22:28:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40cea00640 1 -- 172.21.15.5:0/3247750654 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1487 (secure 0 0 0) 0x7f40c4056710 con 0x7f40d80cb390 2024-08-18T22:28:52.263 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:52.263 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":595,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":141,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":971,"data_bytes":995300612,"bytes_used":2324504576,"bytes_avail":770769608704,"bytes_total":773094113280,"write_bytes_sec":45600848,"read_op_per_sec":0,"write_op_per_sec":46},"fsmap":{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8565}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-08-18T22:28:09.751072+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:28:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 -- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40b80678f0 msgr2=0x7f40b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40b80678f0 0x7f40b8069db0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ad000 tx=0x7f40c80a6000 comp rx=0 tx=0).stop 2024-08-18T22:28:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 -- 172.21.15.5:0/3247750654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40d80cb390 msgr2=0x7f40d815ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40d80cb390 0x7f40d815ce30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c780 tx=0x7f40c400cc40 comp rx=0 tx=0).stop 2024-08-18T22:28:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 -- 172.21.15.5:0/3247750654 shutdown_connections 2024-08-18T22:28:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f40b80678f0 0x7f40b8069db0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40d815bed0 0x7f40d815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40d80cb390 0x7f40d815ce30 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 --2- 172.21.15.5:0/3247750654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40d806da70 0x7f40d81578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 -- 172.21.15.5:0/3247750654 >> 172.21.15.5:0/3247750654 conn(0x7f40d80b1c50 msgr2=0x7f40d815c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 -- 172.21.15.5:0/3247750654 shutdown_connections 2024-08-18T22:28:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:52.263+0000 7f40dd600640 1 -- 172.21.15.5:0/3247750654 wait complete. 2024-08-18T22:28:52.284 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-08-18T22:28:53.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:53.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6319200640 1 Processor -- start 2024-08-18T22:28:53.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6319200640 1 -- start start 2024-08-18T22:28:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6319200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f631415ae70 0x7f63140d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6319200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f631406fdd0 0x7f63140cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6319200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6314070210 con 0x7f63140cdfd0 2024-08-18T22:28:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6319200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f63140704d0 con 0x7f631415ae70 2024-08-18T22:28:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6319200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f63140707b0 con 0x7f631406fdd0 2024-08-18T22:28:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6313400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f631415ae70 0x7f63140d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6313e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f63140cdfd0 0x7f631415eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38550/0 (socket says 172.21.15.5:38550) 2024-08-18T22:28:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6313e00640 1 -- 172.21.15.5:0/4293264146 learned_addr learned my addr 172.21.15.5:0/4293264146 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6312a00640 1 --2- 172.21.15.5:0/4293264146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f631406fdd0 0x7f63140cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6313400640 1 -- 172.21.15.5:0/4293264146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f631406fdd0 msgr2=0x7f63140cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6313400640 1 --2- 172.21.15.5:0/4293264146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f631406fdd0 0x7f63140cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6313400640 1 -- 172.21.15.5:0/4293264146 >> v1:172.21.15.5:6789/0 conn(0x7f63140cdfd0 legacy=0x7f631415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6313400640 1 -- 172.21.15.5:0/4293264146 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6314070a90 con 0x7f631415ae70 2024-08-18T22:28:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6312000640 1 -- 172.21.15.5:0/4293264146 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459644751 0 0) 0x7f6314070210 con 0x7f63140cdfd0 2024-08-18T22:28:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.435+0000 7f6312a00640 1 --2- 172.21.15.5:0/4293264146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f631406fdd0 0x7f63140cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6313400640 1 --2- 172.21.15.5:0/4293264146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f631415ae70 0x7f63140d09c0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f63040097c0 tx=0x7f630401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca97ed384e542b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6312000640 1 -- 172.21.15.5:0/4293264146 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63040b2070 con 0x7f631415ae70 2024-08-18T22:28:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6312000640 1 -- 172.21.15.5:0/4293264146 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63040ad640 con 0x7f631415ae70 2024-08-18T22:28:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6312000640 1 -- 172.21.15.5:0/4293264146 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63040ada10 con 0x7f631415ae70 2024-08-18T22:28:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6319200640 1 -- 172.21.15.5:0/4293264146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f631415ae70 msgr2=0x7f63140d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6319200640 1 --2- 172.21.15.5:0/4293264146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f631415ae70 0x7f63140d09c0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f63040097c0 tx=0x7f630401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6319200640 1 -- 172.21.15.5:0/4293264146 shutdown_connections 2024-08-18T22:28:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6319200640 1 --2- 172.21.15.5:0/4293264146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f631406fdd0 0x7f63140cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6319200640 1 --2- 172.21.15.5:0/4293264146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f631415ae70 0x7f63140d09c0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6319200640 1 -- 172.21.15.5:0/4293264146 >> 172.21.15.5:0/4293264146 conn(0x7f631406e890 msgr2=0x7f631406eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6319200640 1 -- 172.21.15.5:0/4293264146 shutdown_connections 2024-08-18T22:28:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6319200640 1 -- 172.21.15.5:0/4293264146 wait complete. 2024-08-18T22:28:53.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6319200640 1 Processor -- start 2024-08-18T22:28:53.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.439+0000 7f6319200640 1 -- start start 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6319200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f631406fdd0 0x7f63141fa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6319200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63140cdfd0 0x7f6314149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6319200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f631415ae70 0x7f631414a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6319200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6314167fd0 con 0x7f63140cdfd0 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6319200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6314167e50 con 0x7f631415ae70 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6319200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6314168150 con 0x7f631406fdd0 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6312a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63140cdfd0 0x7f6314149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6312a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63140cdfd0 0x7f6314149c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39118/0 (socket says 172.21.15.5:39118) 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6312a00640 1 -- 172.21.15.5:0/1459487026 learned_addr learned my addr 172.21.15.5:0/1459487026 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6313e00640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f631415ae70 0x7f631414a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6313400640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f631406fdd0 0x7f63141fa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6312a00640 1 -- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f631406fdd0 msgr2=0x7f63141fa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6312a00640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f631406fdd0 0x7f63141fa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6312a00640 1 -- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f631415ae70 msgr2=0x7f631414a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6312a00640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f631415ae70 0x7f631414a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6312a00640 1 -- 172.21.15.5:0/1459487026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63141fb410 con 0x7f63140cdfd0 2024-08-18T22:28:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6312a00640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63140cdfd0 0x7f6314149c80 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f630000c820 tx=0x7f630000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f630b400640 1 -- 172.21.15.5:0/1459487026 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300015070 con 0x7f63140cdfd0 2024-08-18T22:28:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f630b400640 1 -- 172.21.15.5:0/1459487026 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6300007a30 con 0x7f63140cdfd0 2024-08-18T22:28:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6319200640 1 -- 172.21.15.5:0/1459487026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63141fab70 con 0x7f63140cdfd0 2024-08-18T22:28:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f630b400640 1 -- 172.21.15.5:0/1459487026 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300007e40 con 0x7f63140cdfd0 2024-08-18T22:28:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6319200640 1 -- 172.21.15.5:0/1459487026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63141fb130 con 0x7f63140cdfd0 2024-08-18T22:28:53.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f6319200640 1 -- 172.21.15.5:0/1459487026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63140cda90 con 0x7f63140cdfd0 2024-08-18T22:28:53.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.443+0000 7f630b400640 1 -- 172.21.15.5:0/1459487026 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6300018070 con 0x7f63140cdfd0 2024-08-18T22:28:53.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.447+0000 7f630b400640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62f40678c0 0x7f62f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.447+0000 7f630b400640 1 -- 172.21.15.5:0/1459487026 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f6300085d00 con 0x7f63140cdfd0 2024-08-18T22:28:53.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.447+0000 7f6313400640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62f40678c0 0x7f62f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.447+0000 7f6313400640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62f40678c0 0x7f62f4069d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f63040af000 tx=0x7f6304008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:53.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.451+0000 7f630b400640 1 -- 172.21.15.5:0/1459487026 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f63000566a0 con 0x7f63140cdfd0 2024-08-18T22:28:53.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:28:53.646 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:28:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.647+0000 7f6319200640 1 -- 172.21.15.5:0/1459487026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f631406c380 con 0x7f63140cdfd0 2024-08-18T22:28:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f630b400640 1 -- 172.21.15.5:0/1459487026 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5231 (secure 0 0 0) 0x7f6300055fa0 con 0x7f63140cdfd0 2024-08-18T22:28:53.650 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:53.651 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:28:21.056377+0000","modified":"2024-08-18T22:28:24.121089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1373218784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1373218784},{"type":"v1","addr":"172.21.15.5:6833","nonce":1373218784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8565,"qdb_cluster":[8565]},"id":9}]} 2024-08-18T22:28:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 108 2024-08-18T22:28:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 -- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62f40678c0 msgr2=0x7f62f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62f40678c0 0x7f62f4069d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f63040af000 tx=0x7f6304008040 comp rx=0 tx=0).stop 2024-08-18T22:28:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 -- 172.21.15.5:0/1459487026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63140cdfd0 msgr2=0x7f6314149c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63140cdfd0 0x7f6314149c80 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f630000c820 tx=0x7f630000cce0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 -- 172.21.15.5:0/1459487026 shutdown_connections 2024-08-18T22:28:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62f40678c0 0x7f62f4069d80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f631415ae70 0x7f631414a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63140cdfd0 0x7f6314149c80 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 --2- 172.21.15.5:0/1459487026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f631406fdd0 0x7f63141fa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 -- 172.21.15.5:0/1459487026 >> 172.21.15.5:0/1459487026 conn(0x7f631406e890 msgr2=0x7f63140729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 -- 172.21.15.5:0/1459487026 shutdown_connections 2024-08-18T22:28:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.651+0000 7f6319200640 1 -- 172.21.15.5:0/1459487026 wait complete. 2024-08-18T22:28:53.673 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:28:53.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:28:53.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.875+0000 7f8eea800640 1 Processor -- start 2024-08-18T22:28:53.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.875+0000 7f8eea800640 1 -- start start 2024-08-18T22:28:53.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.875+0000 7f8eea800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ee4162830 0x7f8ee40cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.875+0000 7f8eea800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ee40cef10 0x7f8ee40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.875+0000 7f8eea800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ee406f990 con 0x7f8ee4162450 2024-08-18T22:28:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.875+0000 7f8eea800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8ee40cdfb0 con 0x7f8ee40cef10 2024-08-18T22:28:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.875+0000 7f8eea800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8ee40cdc80 con 0x7f8ee4162830 2024-08-18T22:28:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.875+0000 7f8ee3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ee40cef10 0x7f8ee40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.879+0000 7f8ee3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ee40cef10 0x7f8ee40cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35626/0 (socket says 172.21.15.5:35626) 2024-08-18T22:28:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.879+0000 7f8ee3e00640 1 -- 172.21.15.5:0/3300991891 learned_addr learned my addr 172.21.15.5:0/3300991891 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:53.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.879+0000 7f8ee2a00640 1 --2- 172.21.15.5:0/3300991891 >> v2:172.21.15.117:3300/0 conn(0x7f8ee4162830 0x7f8ee40cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.879+0000 7f8ee3e00640 1 -- 172.21.15.5:0/3300991891 >> v2:172.21.15.117:3300/0 conn(0x7f8ee4162830 msgr2=0x7f8ee40cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.879+0000 7f8ee3e00640 1 --2- 172.21.15.5:0/3300991891 >> v2:172.21.15.117:3300/0 conn(0x7f8ee4162830 0x7f8ee40cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.879+0000 7f8ee3e00640 1 -- 172.21.15.5:0/3300991891 >> v1:172.21.15.117:6789/0 conn(0x7f8ee4162450 legacy=0x7f8ee40ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.879+0000 7f8ee3e00640 1 -- 172.21.15.5:0/3300991891 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee40ca6e0 con 0x7f8ee40cef10 2024-08-18T22:28:53.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.879+0000 7f8ee3e00640 1 --2- 172.21.15.5:0/3300991891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee40cef10 0x7f8ee40cc6f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40ca580 tx=0x7f8edc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d492e3e59d17bb60 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:53.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.879+0000 7f8ee2000640 1 -- 172.21.15.5:0/3300991891 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0b0070 con 0x7f8ee40cef10 2024-08-18T22:28:53.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.879+0000 7f8ee2000640 1 -- 172.21.15.5:0/3300991891 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8edc0ab600 con 0x7f8ee40cef10 2024-08-18T22:28:53.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.879+0000 7f8ee2000640 1 -- 172.21.15.5:0/3300991891 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0ab9d0 con 0x7f8ee40cef10 2024-08-18T22:28:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 -- 172.21.15.5:0/3300991891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee40cef10 msgr2=0x7f8ee40cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 --2- 172.21.15.5:0/3300991891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee40cef10 0x7f8ee40cc6f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40ca580 tx=0x7f8edc01c490 comp rx=0 tx=0).stop 2024-08-18T22:28:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 -- 172.21.15.5:0/3300991891 shutdown_connections 2024-08-18T22:28:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 --2- 172.21.15.5:0/3300991891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee40cef10 0x7f8ee40cc6f0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 --2- 172.21.15.5:0/3300991891 >> v2:172.21.15.117:3300/0 conn(0x7f8ee4162830 0x7f8ee40cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 -- 172.21.15.5:0/3300991891 >> 172.21.15.5:0/3300991891 conn(0x7f8ee40b1c50 msgr2=0x7f8ee40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 -- 172.21.15.5:0/3300991891 shutdown_connections 2024-08-18T22:28:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 -- 172.21.15.5:0/3300991891 wait complete. 2024-08-18T22:28:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 Processor -- start 2024-08-18T22:28:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 -- start start 2024-08-18T22:28:53.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ee40cef10 0x7f8ee4157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee4162450 0x7f8ee40b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ee4162830 0x7f8ee40ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee4166b40 con 0x7f8ee4162450 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee41669c0 con 0x7f8ee4162830 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8eea800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8ee4166cc0 con 0x7f8ee40cef10 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8ee2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee4162450 0x7f8ee40b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8ee2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee4162450 0x7f8ee40b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35636/0 (socket says 172.21.15.5:35636) 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8ee2a00640 1 -- 172.21.15.5:0/3975070318 learned_addr learned my addr 172.21.15.5:0/3975070318 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8ee3e00640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ee4162830 0x7f8ee40ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8ee3400640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ee40cef10 0x7f8ee4157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8ee2a00640 1 -- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ee40cef10 msgr2=0x7f8ee4157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8ee2a00640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ee40cef10 0x7f8ee4157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8ee2a00640 1 -- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ee4162830 msgr2=0x7f8ee40ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8ee2a00640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ee4162830 0x7f8ee40ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.883+0000 7f8ee2a00640 1 -- 172.21.15.5:0/3975070318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee4162f00 con 0x7f8ee4162450 2024-08-18T22:28:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.887+0000 7f8ee2a00640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee4162450 0x7f8ee40b4d50 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000e8a0 tx=0x7f8ed000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.887+0000 7f8edb400640 1 -- 172.21.15.5:0/3975070318 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0017070 con 0x7f8ee4162450 2024-08-18T22:28:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.887+0000 7f8edb400640 1 -- 172.21.15.5:0/3975070318 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed000c940 con 0x7f8ee4162450 2024-08-18T22:28:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.887+0000 7f8edb400640 1 -- 172.21.15.5:0/3975070318 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000cd10 con 0x7f8ee4162450 2024-08-18T22:28:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.887+0000 7f8eea800640 1 -- 172.21.15.5:0/3975070318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee41631e0 con 0x7f8ee4162450 2024-08-18T22:28:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.887+0000 7f8eea800640 1 -- 172.21.15.5:0/3975070318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee41637a0 con 0x7f8ee4162450 2024-08-18T22:28:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.887+0000 7f8eea800640 1 -- 172.21.15.5:0/3975070318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee41639a0 con 0x7f8ee4162450 2024-08-18T22:28:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.887+0000 7f8edb400640 1 -- 172.21.15.5:0/3975070318 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ed001a070 con 0x7f8ee4162450 2024-08-18T22:28:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.887+0000 7f8edb400640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ec40678c0 0x7f8ec4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.887+0000 7f8edb400640 1 -- 172.21.15.5:0/3975070318 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f8ed0086080 con 0x7f8ee4162450 2024-08-18T22:28:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.887+0000 7f8ee3400640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ec40678c0 0x7f8ec4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.891+0000 7f8ee3400640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ec40678c0 0x7f8ec4069d80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4001d50 tx=0x7f8ed4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:53.891+0000 7f8edb400640 1 -- 172.21.15.5:0/3975070318 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8ee41639a0 con 0x7f8ee4162450 2024-08-18T22:28:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 -- 172.21.15.5:0/3975070318 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8ee40ce440 con 0x7f8ee4162450 2024-08-18T22:28:54.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8edb400640 1 -- 172.21.15.5:0/3975070318 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1641 (secure 0 0 0) 0x7f8ed00563d0 con 0x7f8ee4162450 2024-08-18T22:28:54.115 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:54.115 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":597,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":141,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1047,"data_bytes":1075394926,"bytes_used":2547613696,"bytes_avail":770546499584,"bytes_total":773094113280,"write_bytes_sec":47379586,"read_op_per_sec":0,"write_op_per_sec":47},"fsmap":{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8565}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-08-18T22:28:53.761893+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 -- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ec40678c0 msgr2=0x7f8ec4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ec40678c0 0x7f8ec4069d80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4001d50 tx=0x7f8ed4009040 comp rx=0 tx=0).stop 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 -- 172.21.15.5:0/3975070318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee4162450 msgr2=0x7f8ee40b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee4162450 0x7f8ee40b4d50 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000e8a0 tx=0x7f8ed000ed60 comp rx=0 tx=0).stop 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 -- 172.21.15.5:0/3975070318 shutdown_connections 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ec40678c0 0x7f8ec4069d80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ee4162830 0x7f8ee40ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ee4162450 0x7f8ee40b4d50 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 --2- 172.21.15.5:0/3975070318 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ee40cef10 0x7f8ee4157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 -- 172.21.15.5:0/3975070318 >> 172.21.15.5:0/3975070318 conn(0x7f8ee40b1c50 msgr2=0x7f8ee40caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 -- 172.21.15.5:0/3975070318 shutdown_connections 2024-08-18T22:28:54.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.115+0000 7f8eea800640 1 -- 172.21.15.5:0/3975070318 wait complete. 2024-08-18T22:28:54.136 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused'} 2024-08-18T22:28:54.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:54.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub resume 2024-08-18T22:28:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3f02200640 1 Processor -- start 2024-08-18T22:28:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3f02200640 1 -- start start 2024-08-18T22:28:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3f02200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3efc06d0d0 0x7f3efc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3f02200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3efc15e7b0 0x7f3efc0af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3f02200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3efc15f780 con 0x7f3efc158710 2024-08-18T22:28:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3f02200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3efc15eee0 con 0x7f3efc06d0d0 2024-08-18T22:28:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3f02200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3efc15f1c0 con 0x7f3efc15e7b0 2024-08-18T22:28:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3efaa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3efc06d0d0 0x7f3efc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3efb400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3efc158710 0x7f3efc06c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41730/0 (socket says 172.21.15.5:41730) 2024-08-18T22:28:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3efb400640 1 -- 172.21.15.5:0/3225193783 learned_addr learned my addr 172.21.15.5:0/3225193783 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3efbe00640 1 --2- 172.21.15.5:0/3225193783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3efc15e7b0 0x7f3efc0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3efaa00640 1 -- 172.21.15.5:0/3225193783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3efc15e7b0 msgr2=0x7f3efc0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3efaa00640 1 --2- 172.21.15.5:0/3225193783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3efc15e7b0 0x7f3efc0af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3efaa00640 1 -- 172.21.15.5:0/3225193783 >> v1:172.21.15.5:6789/0 conn(0x7f3efc158710 legacy=0x7f3efc06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3efaa00640 1 -- 172.21.15.5:0/3225193783 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc15f4a0 con 0x7f3efc06d0d0 2024-08-18T22:28:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.279+0000 7f3efa000640 1 -- 172.21.15.5:0/3225193783 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1582842532 0 0) 0x7f3efc15f780 con 0x7f3efc158710 2024-08-18T22:28:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3efaa00640 1 --2- 172.21.15.5:0/3225193783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc06d0d0 0x7f3efc06ef60 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80097f0 tx=0x7f3ee801cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce6bfc74ed8e23e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3efa000640 1 -- 172.21.15.5:0/3225193783 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80b1070 con 0x7f3efc06d0d0 2024-08-18T22:28:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3efa000640 1 -- 172.21.15.5:0/3225193783 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee80ac410 con 0x7f3efc06d0d0 2024-08-18T22:28:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3efa000640 1 -- 172.21.15.5:0/3225193783 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80ac7e0 con 0x7f3efc06d0d0 2024-08-18T22:28:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3f02200640 1 -- 172.21.15.5:0/3225193783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc06d0d0 msgr2=0x7f3efc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3f02200640 1 --2- 172.21.15.5:0/3225193783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc06d0d0 0x7f3efc06ef60 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80097f0 tx=0x7f3ee801cf00 comp rx=0 tx=0).stop 2024-08-18T22:28:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3f02200640 1 -- 172.21.15.5:0/3225193783 shutdown_connections 2024-08-18T22:28:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3f02200640 1 --2- 172.21.15.5:0/3225193783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3efc15e7b0 0x7f3efc0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3f02200640 1 --2- 172.21.15.5:0/3225193783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc06d0d0 0x7f3efc06ef60 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3f02200640 1 -- 172.21.15.5:0/3225193783 >> 172.21.15.5:0/3225193783 conn(0x7f3efc072350 msgr2=0x7f3efc072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3f02200640 1 -- 172.21.15.5:0/3225193783 shutdown_connections 2024-08-18T22:28:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.283+0000 7f3f02200640 1 -- 172.21.15.5:0/3225193783 wait complete. 2024-08-18T22:28:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3f02200640 1 Processor -- start 2024-08-18T22:28:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3f02200640 1 -- start start 2024-08-18T22:28:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3f02200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3efc06d0d0 0x7f3efc14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3f02200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3efc158710 0x7f3efc156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3f02200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc15e7b0 0x7f3efc1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3f02200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc0b5050 con 0x7f3efc15e7b0 2024-08-18T22:28:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3f02200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc0b4ed0 con 0x7f3efc06d0d0 2024-08-18T22:28:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3f02200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3efc0b00e0 con 0x7f3efc158710 2024-08-18T22:28:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc15e7b0 0x7f3efc1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc15e7b0 0x7f3efc1567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35654/0 (socket says 172.21.15.5:35654) 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efbe00640 1 -- 172.21.15.5:0/3221849326 learned_addr learned my addr 172.21.15.5:0/3221849326 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efaa00640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3efc158710 0x7f3efc156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efb400640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3efc06d0d0 0x7f3efc14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efbe00640 1 -- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3efc158710 msgr2=0x7f3efc156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efbe00640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3efc158710 0x7f3efc156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efbe00640 1 -- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3efc06d0d0 msgr2=0x7f3efc14da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efbe00640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3efc06d0d0 0x7f3efc14da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efbe00640 1 -- 172.21.15.5:0/3221849326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc154c10 con 0x7f3efc15e7b0 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efb400640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3efc06d0d0 0x7f3efc14da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3efbe00640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc15e7b0 0x7f3efc1567c0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400ec10 tx=0x7f3ef400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3ef3400640 1 -- 172.21.15.5:0/3221849326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4018020 con 0x7f3efc15e7b0 2024-08-18T22:28:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3ef3400640 1 -- 172.21.15.5:0/3221849326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef400cd20 con 0x7f3efc15e7b0 2024-08-18T22:28:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3ef3400640 1 -- 172.21.15.5:0/3221849326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40146c0 con 0x7f3efc15e7b0 2024-08-18T22:28:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3f02200640 1 -- 172.21.15.5:0/3221849326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3efc154ef0 con 0x7f3efc15e7b0 2024-08-18T22:28:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.287+0000 7f3f02200640 1 -- 172.21.15.5:0/3221849326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3efc1554b0 con 0x7f3efc15e7b0 2024-08-18T22:28:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3ef3400640 1 -- 172.21.15.5:0/3221849326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ef401b020 con 0x7f3efc15e7b0 2024-08-18T22:28:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3ef3400640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3edc0678f0 0x7f3edc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3ef3400640 1 -- 172.21.15.5:0/3221849326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f3ef40869c0 con 0x7f3efc15e7b0 2024-08-18T22:28:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3f053ff000 1 Processor -- start 2024-08-18T22:28:54.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3f053ff000 1 -- start start 2024-08-18T22:28:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3efb400640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3edc0678f0 0x7f3edc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8400d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e84012c0 0x55f4e83b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83b4500 0x55f4e83b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3f053ff000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f4e829dae0 con 0x55f4e84009a0 2024-08-18T22:28:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3f053ff000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f4e8289ba0 con 0x55f4e84012c0 2024-08-18T22:28:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3f053ff000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f4e82044f0 con 0x55f4e83b4500 2024-08-18T22:28:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3efb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8400d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3efb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8400d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35668/0 (socket says 172.21.15.5:35668) 2024-08-18T22:28:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3efb400640 1 -- 172.21.15.5:0/1785325065 learned_addr learned my addr 172.21.15.5:0/1785325065 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3efbe00640 1 --2- 172.21.15.5:0/1785325065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83b4500 0x55f4e83b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3efb400640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3edc0678f0 0x7f3edc069db0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3eec007fd0 tx=0x7f3eec007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.291+0000 7f3efaa00640 1 --2- 172.21.15.5:0/1785325065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e84012c0 0x55f4e83b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3efb400640 1 -- 172.21.15.5:0/1785325065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83b4500 msgr2=0x55f4e83b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3efb400640 1 --2- 172.21.15.5:0/1785325065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83b4500 0x55f4e83b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3efb400640 1 -- 172.21.15.5:0/1785325065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e84012c0 msgr2=0x55f4e83b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3efb400640 1 --2- 172.21.15.5:0/1785325065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e84012c0 0x55f4e83b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3efb400640 1 -- 172.21.15.5:0/1785325065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e81a4a90 con 0x55f4e84009a0 2024-08-18T22:28:54.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3efb400640 1 --2- 172.21.15.5:0/1785325065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8400d80 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f3eec005eb0 tx=0x7f3eec011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56cd770a3b79f4e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3ee7e00640 1 -- 172.21.15.5:0/1785325065 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec025070 con 0x55f4e84009a0 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3ee7e00640 1 -- 172.21.15.5:0/1785325065 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eec018070 con 0x55f4e84009a0 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3ee7e00640 1 -- 172.21.15.5:0/1785325065 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec01a050 con 0x55f4e84009a0 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 -- 172.21.15.5:0/1785325065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 msgr2=0x55f4e8400d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 --2- 172.21.15.5:0/1785325065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8400d80 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f3eec005eb0 tx=0x7f3eec011000 comp rx=0 tx=0).stop 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 -- 172.21.15.5:0/1785325065 shutdown_connections 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 --2- 172.21.15.5:0/1785325065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83b4500 0x55f4e83b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 --2- 172.21.15.5:0/1785325065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e84012c0 0x55f4e83b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 --2- 172.21.15.5:0/1785325065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8400d80 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 -- 172.21.15.5:0/1785325065 >> 172.21.15.5:0/1785325065 conn(0x55f4e83ae010 msgr2=0x55f4e83e3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 -- 172.21.15.5:0/1785325065 shutdown_connections 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 -- 172.21.15.5:0/1785325065 wait complete. 2024-08-18T22:28:54.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 -- start start 2024-08-18T22:28:54.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 Processor -- start 2024-08-18T22:28:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e83e1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e84009a0 0x55f4e83bc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84012c0 0x55f4e83bc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f4e82004b0 con 0x55f4e84012c0 2024-08-18T22:28:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f4e81beb50 con 0x55f4e83b4500 2024-08-18T22:28:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f4e81a5d00 con 0x55f4e84009a0 2024-08-18T22:28:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3f053ff000 10 client.0 _ll_register_callbacks cb 0x55f4e83a1f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84012c0 0x55f4e83bc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84012c0 0x55f4e83bc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35670/0 (socket says 172.21.15.5:35670) 2024-08-18T22:28:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3efbe00640 1 -- 172.21.15.5:0/3115962260 learned_addr learned my addr 172.21.15.5:0/3115962260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3efaa00640 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e84009a0 0x55f4e83bc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.295+0000 7f3efb400640 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e83e1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3efbe00640 1 -- 172.21.15.5:0/3115962260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e84009a0 msgr2=0x55f4e83bc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3efbe00640 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e84009a0 0x55f4e83bc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3efbe00640 1 -- 172.21.15.5:0/3115962260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 msgr2=0x55f4e83e1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3efbe00640 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e83e1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3efbe00640 1 -- 172.21.15.5:0/3115962260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e81bd060 con 0x55f4e84012c0 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3efbe00640 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84012c0 0x55f4e83bc5b0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4084d50 tx=0x7f3ef4057420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f8c101a4adf44f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3ee4c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3115962260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40562b0 con 0x55f4e84012c0 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3115962260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f3ef405d210 con 0x55f4e84012c0 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 -- 172.21.15.5:0/3115962260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3eec018070 con 0x55f4e84012c0 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3115962260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f3ef4075050 con 0x55f4e84012c0 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 10 client.8808 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 -- 172.21.15.5:0/3115962260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x55f4e81d0f50 con 0x55f4e84012c0 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3115962260 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eec018070 con 0x55f4e84012c0 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3115962260 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7f3ef40529b0 con 0x55f4e84012c0 2024-08-18T22:28:54.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 10 client.8808 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 10 client.8808 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-08-18T22:28:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 20 client.8808 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55f4e83e2d30 0x55f4e83e3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 4 client.8808 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:28:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 -- 172.21.15.5:0/3115962260 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4e819ee10 con 0x55f4e83e2d30 2024-08-18T22:28:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3efb400640 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55f4e83e2d30 0x55f4e83e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3efb400640 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55f4e83e2d30 0x55f4e83e3110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eef121b5f5f7a7d7 server_cookie=1546dac96873c61 in_seq=0 out_seq=0 2024-08-18T22:28:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3ee4c00640 10 client.8808 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3115962260 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4e819ee10 con 0x55f4e83e2d30 2024-08-18T22:28:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3ee4c00640 10 client.8808 handle_command_reply: tid=0 2024-08-18T22:28:54.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 client.8808 shutdown 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 -- 172.21.15.5:0/3115962260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84012c0 msgr2=0x55f4e83bc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84012c0 0x55f4e83bc5b0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4084d50 tx=0x7f3ef4057420 comp rx=0 tx=0).stop 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 -- 172.21.15.5:0/3115962260 shutdown_connections 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55f4e83e2d30 0x55f4e83e3110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84012c0 0x55f4e83bc5b0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e84009a0 0x55f4e83bc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3115962260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e83e1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3ee4c00640 0 client.8808 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 -- 172.21.15.5:0/3115962260 >> 172.21.15.5:0/3115962260 conn(0x55f4e83ae010 msgr2=0x55f4e83b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 -- 172.21.15.5:0/3115962260 shutdown_connections 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 1 -- 172.21.15.5:0/3115962260 wait complete. 2024-08-18T22:28:54.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.299+0000 7f3f053ff000 20 client.8808 trim_cache size 0 max 16384 2024-08-18T22:28:54.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 Processor -- start 2024-08-18T22:28:54.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 -- start start 2024-08-18T22:28:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83ae010 0x55f4e84184f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e83e1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e83e2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc203ac0 con 0x55f4e84009a0 2024-08-18T22:28:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc202ac0 con 0x55f4e83b4500 2024-08-18T22:28:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3efc151e70 con 0x55f4e83ae010 2024-08-18T22:28:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e83e2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e83e2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35684/0 (socket says 172.21.15.5:35684) 2024-08-18T22:28:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efbe00640 1 -- 172.21.15.5:0/883493445 learned_addr learned my addr 172.21.15.5:0/883493445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efb400640 1 --2- 172.21.15.5:0/883493445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83ae010 0x55f4e84184f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efaa00640 1 --2- 172.21.15.5:0/883493445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e83e1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efbe00640 1 -- 172.21.15.5:0/883493445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83ae010 msgr2=0x55f4e84184f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efbe00640 1 --2- 172.21.15.5:0/883493445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83ae010 0x55f4e84184f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efbe00640 1 -- 172.21.15.5:0/883493445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 msgr2=0x55f4e83e1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efbe00640 1 --2- 172.21.15.5:0/883493445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e83e1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efbe00640 1 -- 172.21.15.5:0/883493445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e8286dd0 con 0x55f4e84009a0 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efaa00640 1 --2- 172.21.15.5:0/883493445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e83e1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3efbe00640 1 --2- 172.21.15.5:0/883493445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e83e2230 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f3ef405b1b0 tx=0x7f3ef405a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a9801d178f9c37 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3ee7400640 1 -- 172.21.15.5:0/883493445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40751f0 con 0x55f4e84009a0 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3ee7400640 1 -- 172.21.15.5:0/883493445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef4083070 con 0x55f4e84009a0 2024-08-18T22:28:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3ee7400640 1 -- 172.21.15.5:0/883493445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40560b0 con 0x55f4e84009a0 2024-08-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 -- 172.21.15.5:0/883493445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 msgr2=0x55f4e83e2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 --2- 172.21.15.5:0/883493445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e83e2230 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f3ef405b1b0 tx=0x7f3ef405a000 comp rx=0 tx=0).stop 2024-08-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 -- 172.21.15.5:0/883493445 shutdown_connections 2024-08-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 --2- 172.21.15.5:0/883493445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e83e2230 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 --2- 172.21.15.5:0/883493445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e83e1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 --2- 172.21.15.5:0/883493445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83ae010 0x55f4e84184f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.319+0000 7f3f053ff000 1 -- 172.21.15.5:0/883493445 >> 172.21.15.5:0/883493445 conn(0x55f4e83b8ec0 msgr2=0x55f4e83e15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 -- 172.21.15.5:0/883493445 shutdown_connections 2024-08-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 -- 172.21.15.5:0/883493445 wait complete. 2024-08-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 -- start start 2024-08-18T22:28:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 Processor -- start 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83ae010 0x55f4e8474460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e84749a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8474ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f4e8286940 con 0x55f4e84009a0 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc202510 con 0x55f4e83b4500 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f4e82c1240 con 0x55f4e83ae010 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 10 client.0 _ll_register_callbacks cb 0x7f3ef4004a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8474ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8474ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35694/0 (socket says 172.21.15.5:35694) 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efbe00640 1 -- 172.21.15.5:0/3554545481 learned_addr learned my addr 172.21.15.5:0/3554545481 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efaa00640 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e84749a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efb400640 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83ae010 0x55f4e8474460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efbe00640 1 -- 172.21.15.5:0/3554545481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83ae010 msgr2=0x55f4e8474460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efbe00640 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83ae010 0x55f4e8474460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efbe00640 1 -- 172.21.15.5:0/3554545481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 msgr2=0x55f4e84749a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efbe00640 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e84749a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efbe00640 1 -- 172.21.15.5:0/3554545481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e8197cd0 con 0x55f4e84009a0 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efb400640 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83ae010 0x55f4e8474460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efaa00640 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e84749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efbe00640 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8474ee0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f3ef405b1d0 tx=0x7f3ef4052f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2715da217b92ae server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3ee4c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3554545481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4063070 con 0x55f4e84009a0 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3554545481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f3ef40562c0 con 0x55f4e84009a0 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 -- 172.21.15.5:0/3554545481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ef4083070 con 0x55f4e84009a0 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3554545481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f3ef40565c0 con 0x55f4e84009a0 2024-08-18T22:28:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 10 client.8814 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 -- 172.21.15.5:0/3554545481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x55f4e81aa320 con 0x55f4e84009a0 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3554545481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef4083070 con 0x55f4e84009a0 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3554545481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7f3ef405d210 con 0x55f4e84009a0 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 10 client.8814 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 10 client.8814 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 20 client.8814 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55f4e84012c0 0x55f4e8415d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 4 client.8814 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3f053ff000 1 -- 172.21.15.5:0/3554545481 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55f4e8211c20 con 0x55f4e84012c0 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.323+0000 7f3efb400640 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55f4e84012c0 0x55f4e8415d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3efb400640 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55f4e84012c0 0x55f4e8415d60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aea3ca9f4c0af0ef server_cookie=a1ed6e624e20c19d in_seq=0 out_seq=0 2024-08-18T22:28:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3ee4c00640 10 client.8814 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3ee4c00640 1 -- 172.21.15.5:0/3554545481 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f4e8211c20 con 0x55f4e84012c0 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3ee4c00640 10 client.8814 handle_command_reply: tid=0 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 1 client.8814 shutdown 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 1 -- 172.21.15.5:0/3554545481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 msgr2=0x55f4e8474ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8474ee0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f3ef405b1d0 tx=0x7f3ef4052f80 comp rx=0 tx=0).stop 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 1 -- 172.21.15.5:0/3554545481 shutdown_connections 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x55f4e84012c0 0x55f4e8415d60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f4e84009a0 0x55f4e8474ee0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f4e83b4500 0x55f4e84749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3ee4c00640 0 client.8814 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 1 --2- 172.21.15.5:0/3554545481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f4e83ae010 0x55f4e8474460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 1 -- 172.21.15.5:0/3554545481 >> 172.21.15.5:0/3554545481 conn(0x55f4e83b8ec0 msgr2=0x55f4e83e1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 1 -- 172.21.15.5:0/3554545481 shutdown_connections 2024-08-18T22:28:54.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 1 -- 172.21.15.5:0/3554545481 wait complete. 2024-08-18T22:28:54.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f053ff000 20 client.8814 trim_cache size 0 max 16384 2024-08-18T22:28:54.332 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:28:54.332 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:28:54.332 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:28:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 -- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3edc0678f0 msgr2=0x7f3edc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3edc0678f0 0x7f3edc069db0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3eec007fd0 tx=0x7f3eec007c20 comp rx=0 tx=0).stop 2024-08-18T22:28:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 -- 172.21.15.5:0/3221849326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc15e7b0 msgr2=0x7f3efc1567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc15e7b0 0x7f3efc1567c0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400ec10 tx=0x7f3ef400c490 comp rx=0 tx=0).stop 2024-08-18T22:28:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 -- 172.21.15.5:0/3221849326 shutdown_connections 2024-08-18T22:28:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3edc0678f0 0x7f3edc069db0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc15e7b0 0x7f3efc1567c0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3efc158710 0x7f3efc156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 --2- 172.21.15.5:0/3221849326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3efc06d0d0 0x7f3efc14da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 -- 172.21.15.5:0/3221849326 >> 172.21.15.5:0/3221849326 conn(0x7f3efc072350 msgr2=0x7f3efc06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 -- 172.21.15.5:0/3221849326 shutdown_connections 2024-08-18T22:28:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.327+0000 7f3f02200640 1 -- 172.21.15.5:0/3221849326 wait complete. 2024-08-18T22:28:54.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:54.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-08-18T22:28:54.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.487+0000 7f20b4800640 1 Processor -- start 2024-08-18T22:28:54.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.487+0000 7f20b4800640 1 -- start start 2024-08-18T22:28:54.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.491+0000 7f20b4800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20ac0b1300 0x7f20ac162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.491+0000 7f20b4800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac06e8a0 con 0x7f20ac09b080 2024-08-18T22:28:54.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.491+0000 7f20b4800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac09bb80 con 0x7f20ac09aca0 2024-08-18T22:28:54.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.491+0000 7f20b4800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f20ac0d2e40 con 0x7f20ac0b1300 2024-08-18T22:28:54.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.491+0000 7f20b2800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f20ac09b080 0x7f20ac0b01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41734/0 (socket says 172.21.15.5:41734) 2024-08-18T22:28:54.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.491+0000 7f20b2800640 1 -- 172.21.15.5:0/2075441986 learned_addr learned my addr 172.21.15.5:0/2075441986 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:54.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.491+0000 7f20b1400640 1 --2- 172.21.15.5:0/2075441986 >> v2:172.21.15.5:3300/0 conn(0x7f20ac0b1300 0x7f20ac162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.491+0000 7f20b1400640 1 -- 172.21.15.5:0/2075441986 >> v1:172.21.15.117:6789/0 conn(0x7f20ac09aca0 legacy=0x7f20ac0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.491+0000 7f20b1400640 1 -- 172.21.15.5:0/2075441986 >> v1:172.21.15.5:6789/0 conn(0x7f20ac09b080 legacy=0x7f20ac0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.491+0000 7f20b1400640 1 -- 172.21.15.5:0/2075441986 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac06cbd0 con 0x7f20ac0b1300 2024-08-18T22:28:54.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b1400640 1 --2- 172.21.15.5:0/2075441986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac0b1300 0x7f20ac162950 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f209c0097c0 tx=0x7f209c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49f0095f346aa01 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b0a00640 1 -- 172.21.15.5:0/2075441986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c0b1070 con 0x7f20ac0b1300 2024-08-18T22:28:54.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b0a00640 1 -- 172.21.15.5:0/2075441986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c0ac410 con 0x7f20ac0b1300 2024-08-18T22:28:54.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b0a00640 1 -- 172.21.15.5:0/2075441986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c0ac7e0 con 0x7f20ac0b1300 2024-08-18T22:28:54.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 -- 172.21.15.5:0/2075441986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac0b1300 msgr2=0x7f20ac162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 --2- 172.21.15.5:0/2075441986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac0b1300 0x7f20ac162950 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f209c0097c0 tx=0x7f209c01c4a0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 -- 172.21.15.5:0/2075441986 shutdown_connections 2024-08-18T22:28:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 --2- 172.21.15.5:0/2075441986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac0b1300 0x7f20ac162950 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 -- 172.21.15.5:0/2075441986 >> 172.21.15.5:0/2075441986 conn(0x7f20ac0d2180 msgr2=0x7f20ac0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 -- 172.21.15.5:0/2075441986 shutdown_connections 2024-08-18T22:28:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 -- 172.21.15.5:0/2075441986 wait complete. 2024-08-18T22:28:54.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 Processor -- start 2024-08-18T22:28:54.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 -- start start 2024-08-18T22:28:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20ac09aca0 0x7f20ac14f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac09b080 0x7f20ac0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b1300 0x7f20ac15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac16ced0 con 0x7f20ac09b080 2024-08-18T22:28:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac16cd50 con 0x7f20ac09aca0 2024-08-18T22:28:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.495+0000 7f20b4800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac16d050 con 0x7f20ac0b1300 2024-08-18T22:28:54.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac09b080 0x7f20ac0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac09b080 0x7f20ac0b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35720/0 (socket says 172.21.15.5:35720) 2024-08-18T22:28:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b1400640 1 -- 172.21.15.5:0/514091241 learned_addr learned my addr 172.21.15.5:0/514091241 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b2800640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b1300 0x7f20ac15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b1e00640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20ac09aca0 0x7f20ac14f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b1400640 1 -- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b1300 msgr2=0x7f20ac15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b1400640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b1300 0x7f20ac15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b1400640 1 -- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20ac09aca0 msgr2=0x7f20ac14f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b1400640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20ac09aca0 0x7f20ac14f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b1400640 1 -- 172.21.15.5:0/514091241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac160df0 con 0x7f20ac09b080 2024-08-18T22:28:54.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b1400640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac09b080 0x7f20ac0b2ea0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f209c0af040 tx=0x7f209c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20a6000640 1 -- 172.21.15.5:0/514091241 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c0b1040 con 0x7f20ac09b080 2024-08-18T22:28:54.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20a6000640 1 -- 172.21.15.5:0/514091241 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c0b5430 con 0x7f20ac09b080 2024-08-18T22:28:54.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20a6000640 1 -- 172.21.15.5:0/514091241 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c006e20 con 0x7f20ac09b080 2024-08-18T22:28:54.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b4800640 1 -- 172.21.15.5:0/514091241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac1610d0 con 0x7f20ac09b080 2024-08-18T22:28:54.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20b4800640 1 -- 172.21.15.5:0/514091241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ac15f240 con 0x7f20ac09b080 2024-08-18T22:28:54.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.499+0000 7f20a6000640 1 -- 172.21.15.5:0/514091241 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f209c0bc020 con 0x7f20ac09b080 2024-08-18T22:28:54.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20a6000640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20900678c0 0x7f2090069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20a6000640 1 -- 172.21.15.5:0/514091241 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f209c11f220 con 0x7f20ac09b080 2024-08-18T22:28:54.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 Processor -- start 2024-08-18T22:28:54.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 -- start start 2024-08-18T22:28:54.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1e00640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20900678c0 0x7f2090069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1e00640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20900678c0 0x7f2090069d80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0b3d40 tx=0x7f20a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b40c39a0 0x5641b40c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4076fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b4077500 0x5641b40778e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5641b3f60ae0 con 0x5641b40c42c0 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5641b3f4cba0 con 0x5641b4077500 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5641b3ec74f0 con 0x5641b40c39a0 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4076fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4076fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35726/0 (socket says 172.21.15.5:35726) 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1400640 1 -- 172.21.15.5:0/1253234820 learned_addr learned my addr 172.21.15.5:0/1253234820 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1e00640 1 --2- 172.21.15.5:0/1253234820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b40c39a0 0x5641b40c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b2800640 1 --2- 172.21.15.5:0/1253234820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b4077500 0x5641b40778e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1400640 1 -- 172.21.15.5:0/1253234820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b40c39a0 msgr2=0x5641b40c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1400640 1 --2- 172.21.15.5:0/1253234820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b40c39a0 0x5641b40c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1400640 1 -- 172.21.15.5:0/1253234820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b4077500 msgr2=0x5641b40778e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1400640 1 --2- 172.21.15.5:0/1253234820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b4077500 0x5641b40778e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1400640 1 -- 172.21.15.5:0/1253234820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641b3e67a90 con 0x5641b40c42c0 2024-08-18T22:28:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1e00640 1 --2- 172.21.15.5:0/1253234820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b40c39a0 0x5641b40c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b2800640 1 --2- 172.21.15.5:0/1253234820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b4077500 0x5641b40778e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b1400640 1 --2- 172.21.15.5:0/1253234820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4076fc0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f209c0eb890 tx=0x7f209c0b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a163ddb8c33600 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f209aa00640 1 -- 172.21.15.5:0/1253234820 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c0f8010 con 0x5641b40c42c0 2024-08-18T22:28:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f209aa00640 1 -- 172.21.15.5:0/1253234820 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c0bcdf0 con 0x5641b40c42c0 2024-08-18T22:28:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f209aa00640 1 -- 172.21.15.5:0/1253234820 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c0ebaa0 con 0x5641b40c42c0 2024-08-18T22:28:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 -- 172.21.15.5:0/1253234820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 msgr2=0x5641b4076fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 --2- 172.21.15.5:0/1253234820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4076fc0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f209c0eb890 tx=0x7f209c0b5000 comp rx=0 tx=0).stop 2024-08-18T22:28:54.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 -- 172.21.15.5:0/1253234820 shutdown_connections 2024-08-18T22:28:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 --2- 172.21.15.5:0/1253234820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b4077500 0x5641b40778e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 --2- 172.21.15.5:0/1253234820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4076fc0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 --2- 172.21.15.5:0/1253234820 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b40c39a0 0x5641b40c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 -- 172.21.15.5:0/1253234820 >> 172.21.15.5:0/1253234820 conn(0x5641b4071010 msgr2=0x5641b40a6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 -- 172.21.15.5:0/1253234820 shutdown_connections 2024-08-18T22:28:54.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.503+0000 7f20b7d21000 1 -- 172.21.15.5:0/1253234820 wait complete. 2024-08-18T22:28:54.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 -- start start 2024-08-18T22:28:54.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 Processor -- start 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b4077500 0x5641b40a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b40c39a0 0x5641b407ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b407f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5641b3ec34b0 con 0x5641b40c42c0 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5641b3e81b50 con 0x5641b40c39a0 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5641b3e68d00 con 0x5641b4077500 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 10 client.0 _ll_register_callbacks cb 0x5641b4064f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b407f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b407f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35734/0 (socket says 172.21.15.5:35734) 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b2800640 1 -- 172.21.15.5:0/325744441 learned_addr learned my addr 172.21.15.5:0/325744441 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b1400640 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b40c39a0 0x5641b407ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b1e00640 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b4077500 0x5641b40a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b2800640 1 -- 172.21.15.5:0/325744441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b4077500 msgr2=0x5641b40a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b2800640 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b4077500 0x5641b40a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b2800640 1 -- 172.21.15.5:0/325744441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b40c39a0 msgr2=0x5641b407ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b2800640 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b40c39a0 0x5641b407ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b2800640 1 -- 172.21.15.5:0/325744441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641b3e80060 con 0x5641b40c42c0 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b2800640 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b407f3d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f20a8007530 tx=0x7f20a80079f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7241159054dd7b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f208f400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f208f400640 1 -- 172.21.15.5:0/325744441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8018020 con 0x5641b40c42c0 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f208f400640 1 -- 172.21.15.5:0/325744441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f20a8010b70 con 0x5641b40c42c0 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 -- 172.21.15.5:0/325744441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f209c0bcdf0 con 0x5641b40c42c0 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f208f400640 1 -- 172.21.15.5:0/325744441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f20a8022050 con 0x5641b40c42c0 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 10 client.8829 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 -- 172.21.15.5:0/325744441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x5641b3e93f50 con 0x5641b40c42c0 2024-08-18T22:28:54.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f208f400640 1 -- 172.21.15.5:0/325744441 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c0bcdf0 con 0x5641b40c42c0 2024-08-18T22:28:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f208f400640 1 -- 172.21.15.5:0/325744441 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7f20a8025020 con 0x5641b40c42c0 2024-08-18T22:28:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 10 client.8829 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 10 client.8829 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-08-18T22:28:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 20 client.8829 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x5641b40a5d30 0x5641b40a6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 4 client.8829 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:28:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b7d21000 1 -- 172.21.15.5:0/325744441 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641b3e61e10 con 0x5641b40a5d30 2024-08-18T22:28:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.507+0000 7f20b1e00640 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x5641b40a5d30 0x5641b40a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f208f400640 10 client.8829 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b1e00640 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x5641b40a5d30 0x5641b40a6110 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec625e862ad1a957 server_cookie=c448017695936994 in_seq=0 out_seq=0 2024-08-18T22:28:54.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f208f400640 1 -- 172.21.15.5:0/325744441 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641b3e61e10 con 0x5641b40a5d30 2024-08-18T22:28:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f208f400640 10 client.8829 handle_command_reply: tid=0 2024-08-18T22:28:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 1 client.8829 shutdown 2024-08-18T22:28:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 1 -- 172.21.15.5:0/325744441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 msgr2=0x5641b407f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b407f3d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f20a8007530 tx=0x7f20a80079f0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 1 -- 172.21.15.5:0/325744441 shutdown_connections 2024-08-18T22:28:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x5641b40a5d30 0x5641b40a6110 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b407f3d0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b40c39a0 0x5641b407ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 1 --2- 172.21.15.5:0/325744441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b4077500 0x5641b40a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f208f400640 0 client.8829 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:54.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 1 -- 172.21.15.5:0/325744441 >> 172.21.15.5:0/325744441 conn(0x5641b4071010 msgr2=0x5641b40766c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 1 -- 172.21.15.5:0/325744441 shutdown_connections 2024-08-18T22:28:54.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 1 -- 172.21.15.5:0/325744441 wait complete. 2024-08-18T22:28:54.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.511+0000 7f20b7d21000 20 client.8829 trim_cache size 0 max 16384 2024-08-18T22:28:54.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.527+0000 7f20b7d21000 1 Processor -- start 2024-08-18T22:28:54.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.527+0000 7f20b7d21000 1 -- start start 2024-08-18T22:28:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b4077500 0x5641b4132ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b40c39a0 0x5641b4133530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac2045b0 con 0x5641b40c42c0 2024-08-18T22:28:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac203690 con 0x5641b40c39a0 2024-08-18T22:28:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac0b6ee0 con 0x5641b4077500 2024-08-18T22:28:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4133a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35748/0 (socket says 172.21.15.5:35748) 2024-08-18T22:28:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b2800640 1 -- 172.21.15.5:0/3209624969 learned_addr learned my addr 172.21.15.5:0/3209624969 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b2800640 1 -- 172.21.15.5:0/3209624969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b4077500 msgr2=0x5641b4132ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b2800640 1 --2- 172.21.15.5:0/3209624969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b4077500 0x5641b4132ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b2800640 1 -- 172.21.15.5:0/3209624969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b40c39a0 msgr2=0x5641b4133530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b2800640 1 --2- 172.21.15.5:0/3209624969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b40c39a0 0x5641b4133530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b2800640 1 -- 172.21.15.5:0/3209624969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641b3f49dd0 con 0x5641b40c42c0 2024-08-18T22:28:54.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b2800640 1 --2- 172.21.15.5:0/3209624969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4133a70 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f20a8001770 tx=0x7f20a800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a14c7ec0c5d2ff server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f209a000640 1 -- 172.21.15.5:0/3209624969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a802b070 con 0x5641b40c42c0 2024-08-18T22:28:54.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f209a000640 1 -- 172.21.15.5:0/3209624969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a80070c0 con 0x5641b40c42c0 2024-08-18T22:28:54.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f209a000640 1 -- 172.21.15.5:0/3209624969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8018040 con 0x5641b40c42c0 2024-08-18T22:28:54.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- 172.21.15.5:0/3209624969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 msgr2=0x5641b4133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 --2- 172.21.15.5:0/3209624969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4133a70 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f20a8001770 tx=0x7f20a800c000 comp rx=0 tx=0).stop 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- 172.21.15.5:0/3209624969 shutdown_connections 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 --2- 172.21.15.5:0/3209624969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c42c0 0x5641b4133a70 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 --2- 172.21.15.5:0/3209624969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b40c39a0 0x5641b4133530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 --2- 172.21.15.5:0/3209624969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b4077500 0x5641b4132ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- 172.21.15.5:0/3209624969 >> 172.21.15.5:0/3209624969 conn(0x5641b4071010 msgr2=0x5641b40d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- 172.21.15.5:0/3209624969 shutdown_connections 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- 172.21.15.5:0/3209624969 wait complete. 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- start start 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 Processor -- start 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b4077500 0x5641b4136e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c39a0 0x5641b4137360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b40c42c0 0x5641b41378a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5641b3ec6800 con 0x5641b40c39a0 2024-08-18T22:28:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5641b3e927f0 con 0x5641b4077500 2024-08-18T22:28:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5641b40a56e0 con 0x5641b40c42c0 2024-08-18T22:28:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b7d21000 10 client.0 _ll_register_callbacks cb 0x7f20a8001aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:28:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.531+0000 7f20b1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c39a0 0x5641b4137360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c39a0 0x5641b4137360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35760/0 (socket says 172.21.15.5:35760) 2024-08-18T22:28:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b1400640 1 -- 172.21.15.5:0/1290876862 learned_addr learned my addr 172.21.15.5:0/1290876862 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b2800640 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b40c42c0 0x5641b41378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b1e00640 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b4077500 0x5641b4136e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b1400640 1 -- 172.21.15.5:0/1290876862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b40c42c0 msgr2=0x5641b41378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b1400640 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b40c42c0 0x5641b41378a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b1400640 1 -- 172.21.15.5:0/1290876862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b4077500 msgr2=0x5641b4136e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b1400640 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b4077500 0x5641b4136e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b1400640 1 -- 172.21.15.5:0/1290876862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641b3e5acd0 con 0x5641b40c39a0 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b1400640 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c39a0 0x5641b4137360 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f209c01a0d0 tx=0x7f209c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7fa5b884b517c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f208f400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f208f400640 1 -- 172.21.15.5:0/1290876862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c0eb6d0 con 0x5641b40c39a0 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f208f400640 1 -- 172.21.15.5:0/1290876862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f209c11d170 con 0x5641b40c39a0 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 -- 172.21.15.5:0/1290876862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5641b3ed4c20 con 0x5641b40c39a0 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f208f400640 1 -- 172.21.15.5:0/1290876862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f209c0f8010 con 0x5641b40c39a0 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 10 client.8835 fetch_fsmap learned FSMap version 108 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 -- 172.21.15.5:0/1290876862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x5641b3e6d320 con 0x5641b40c39a0 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f208f400640 1 -- 172.21.15.5:0/1290876862 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5641b3ed4c20 con 0x5641b40c39a0 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f208f400640 1 -- 172.21.15.5:0/1290876862 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 108) ==== 3502+0+0 (secure 0 0 0) 0x7f209c0b4070 con 0x5641b40c39a0 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 10 client.8835 fetch_fsmap finished waiting for FSMap version 108 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 10 client.8835 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-08-18T22:28:54.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 20 client.8835 populate_metadata read hostname 'smithi005' 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x5641b40d63b0 0x5641b40d67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 4 client.8835 mds_command: new command op to 8565 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 -- 172.21.15.5:0/1290876862 --> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5641b3ecef70 con 0x5641b40d63b0 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b1e00640 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x5641b40d63b0 0x5641b40d67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b1e00640 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x5641b40d63b0 0x5641b40d67c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e63d54f5f03b84e server_cookie=f5a064c593f1ffad in_seq=0 out_seq=0 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f208f400640 10 client.8835 ms_handle_connect on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f208f400640 1 -- 172.21.15.5:0/1290876862 <== mds.0 v2:172.21.15.5:6832/1373218784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5641b3ecef70 con 0x5641b40d63b0 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f208f400640 10 client.8835 handle_command_reply: tid=0 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 client.8835 shutdown 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 -- 172.21.15.5:0/1290876862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c39a0 msgr2=0x5641b4137360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c39a0 0x5641b4137360 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f209c01a0d0 tx=0x7f209c009190 comp rx=0 tx=0).stop 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 -- 172.21.15.5:0/1290876862 shutdown_connections 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.5:6832/1373218784,v1:172.21.15.5:6833/1373218784] conn(0x5641b40d63b0 0x5641b40d67c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5641b40c42c0 0x5641b41378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641b40c39a0 0x5641b4137360 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f208f400640 0 client.8835 ms_handle_reset on v2:172.21.15.5:6832/1373218784 2024-08-18T22:28:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 --2- 172.21.15.5:0/1290876862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641b4077500 0x5641b4136e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 -- 172.21.15.5:0/1290876862 >> 172.21.15.5:0/1290876862 conn(0x5641b4071010 msgr2=0x5641b40c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 -- 172.21.15.5:0/1290876862 shutdown_connections 2024-08-18T22:28:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 1 -- 172.21.15.5:0/1290876862 wait complete. 2024-08-18T22:28:54.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b7d21000 20 client.8835 trim_cache size 0 max 16384 2024-08-18T22:28:54.541 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:28:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-18T22:28:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-08-18T22:28:54.542 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:28:54.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 -- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20900678c0 msgr2=0x7f2090069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20900678c0 0x7f2090069d80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0b3d40 tx=0x7f20a0009040 comp rx=0 tx=0).stop 2024-08-18T22:28:54.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 -- 172.21.15.5:0/514091241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac09b080 msgr2=0x7f20ac0b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac09b080 0x7f20ac0b2ea0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f209c0af040 tx=0x7f209c019240 comp rx=0 tx=0).stop 2024-08-18T22:28:54.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 -- 172.21.15.5:0/514091241 shutdown_connections 2024-08-18T22:28:54.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20900678c0 0x7f2090069d80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20ac0b1300 0x7f20ac15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20ac09b080 0x7f20ac0b2ea0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 --2- 172.21.15.5:0/514091241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20ac09aca0 0x7f20ac14f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 -- 172.21.15.5:0/514091241 >> 172.21.15.5:0/514091241 conn(0x7f20ac0d2180 msgr2=0x7f20ac0afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 -- 172.21.15.5:0/514091241 shutdown_connections 2024-08-18T22:28:54.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.535+0000 7f20b4800640 1 -- 172.21.15.5:0/514091241 wait complete. 2024-08-18T22:28:54.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:54.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.695+0000 7f0d12c00640 1 Processor -- start 2024-08-18T22:28:54.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.695+0000 7f0d12c00640 1 -- start start 2024-08-18T22:28:54.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d12c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0c0ccc10 0x7f0d0c0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d12c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d0c0cff50 con 0x7f0d0c15ff60 2024-08-18T22:28:54.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d12c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d0c09ab70 con 0x7f0d0c0ce610 2024-08-18T22:28:54.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d12c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c0cfd00 con 0x7f0d0c0ccc10 2024-08-18T22:28:54.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0d0c15ff60 0x7f0d0c160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41742/0 (socket says 172.21.15.5:41742) 2024-08-18T22:28:54.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0be00640 1 -- 172.21.15.5:0/3632738960 learned_addr learned my addr 172.21.15.5:0/3632738960 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:54.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d10c00640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0c0ccc10 0x7f0d0c0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243603410 0 0) 0x7f0d0c0cff50 con 0x7f0d0c15ff60 2024-08-18T22:28:54.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cf0003530 con 0x7f0d0c15ff60 2024-08-18T22:28:54.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681502614 0 0) 0x7f0d0c09ab70 con 0x7f0d0c0ce610 2024-08-18T22:28:54.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d0c0cff50 con 0x7f0d0c0ce610 2024-08-18T22:28:54.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2105399549 0 0) 0x7f0cf0003530 con 0x7f0d0c15ff60 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0c0ccc10 msgr2=0x7f0d0c0cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0c0ccc10 0x7f0d0c0cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 >> v1:172.21.15.117:6789/0 conn(0x7f0d0c0ce610 legacy=0x7f0d0c09b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c160a50 con 0x7f0d0c15ff60 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f0cfc001680 con 0x7f0d0c15ff60 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 >> v1:172.21.15.5:6789/0 conn(0x7f0d0c15ff60 legacy=0x7f0d0c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cf0003b80 0x7f0cf0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf0004810 0x7f0cf0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0c0ccc10 0x7f0cf00052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0cfd00 con 0x7f0cf0003b80 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf000bc00 con 0x7f0cf0004810 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf000be00 con 0x7f0d0c0ccc10 2024-08-18T22:28:54.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0be00640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cf0003b80 0x7f0cf0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d10c00640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0c0ccc10 0x7f0cf00052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0b400640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf0004810 0x7f0cf0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0be00640 1 -- 172.21.15.5:0/3632738960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0c0ccc10 msgr2=0x7f0cf00052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0be00640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d0c0ccc10 0x7f0cf00052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0be00640 1 -- 172.21.15.5:0/3632738960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf0004810 msgr2=0x7f0cf0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:54.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0be00640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf0004810 0x7f0cf0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.699+0000 7f0d0be00640 1 -- 172.21.15.5:0/3632738960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf0003530 con 0x7f0cf0003b80 2024-08-18T22:28:54.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d0be00640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cf0003b80 0x7f0cf0003f80 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c0e0 tx=0x7f0cfc01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b338557ba367b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc007c50 con 0x7f0cf0003b80 2024-08-18T22:28:54.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cfc0a9070 con 0x7f0cf0003b80 2024-08-18T22:28:54.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d0aa00640 1 -- 172.21.15.5:0/3632738960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc005d20 con 0x7f0cf0003b80 2024-08-18T22:28:54.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d12c00640 1 -- 172.21.15.5:0/3632738960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cf0003b80 msgr2=0x7f0cf0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d12c00640 1 --2- 172.21.15.5:0/3632738960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cf0003b80 0x7f0cf0003f80 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c0e0 tx=0x7f0cfc01cb60 comp rx=0 tx=0).stop 2024-08-18T22:28:54.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d10c00640 1 -- 172.21.15.5:0/3632738960 reap_dead start 2024-08-18T22:28:54.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d12c00640 1 -- 172.21.15.5:0/3632738960 shutdown_connections 2024-08-18T22:28:54.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d12c00640 1 -- 172.21.15.5:0/3632738960 >> 172.21.15.5:0/3632738960 conn(0x7f0d0c0d2130 msgr2=0x7f0d0c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d12c00640 1 -- 172.21.15.5:0/3632738960 shutdown_connections 2024-08-18T22:28:54.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d12c00640 1 -- 172.21.15.5:0/3632738960 wait complete. 2024-08-18T22:28:54.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d12c00640 1 Processor -- start 2024-08-18T22:28:54.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.703+0000 7f0d12c00640 1 -- start start 2024-08-18T22:28:54.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d12c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf0003b80 0x7f0d0c0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d12c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d0c15b250 0x7f0d0c15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d12c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d0c0b60a0 0x7f0d0c0b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d12c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0b13a0 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d12c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c09aee0 con 0x7f0d0c15b250 2024-08-18T22:28:54.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d12c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c0b1520 con 0x7f0cf0003b80 2024-08-18T22:28:54.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d10c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d0c0b60a0 0x7f0d0c0b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d10c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d0c0b60a0 0x7f0d0c0b6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35772/0 (socket says 172.21.15.5:35772) 2024-08-18T22:28:54.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d10c00640 1 -- 172.21.15.5:0/497281555 learned_addr learned my addr 172.21.15.5:0/497281555 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:54.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d0be00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf0003b80 0x7f0d0c0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d0b400640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d0c15b250 0x7f0d0c15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d10c00640 1 -- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf0003b80 msgr2=0x7f0d0c0c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d10c00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf0003b80 0x7f0d0c0c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d10c00640 1 -- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d0c15b250 msgr2=0x7f0d0c15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d10c00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d0c15b250 0x7f0d0c15b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d10c00640 1 -- 172.21.15.5:0/497281555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c149330 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d10c00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d0c0b60a0 0x7f0d0c0b6530 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0cc730 tx=0x7f0d0400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d03e00640 1 -- 172.21.15.5:0/497281555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04015430 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d03e00640 1 -- 172.21.15.5:0/497281555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d040155f0 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d03e00640 1 -- 172.21.15.5:0/497281555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d040159e0 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d12c00640 1 -- 172.21.15.5:0/497281555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0c149610 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d12c00640 1 -- 172.21.15.5:0/497281555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0c149bd0 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d12c00640 1 -- 172.21.15.5:0/497281555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0c09ab70 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.707+0000 7f0d03e00640 1 -- 172.21.15.5:0/497281555 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d04015b80 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.711+0000 7f0d03e00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cec0678c0 0x7f0cec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:54.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.711+0000 7f0d03e00640 1 -- 172.21.15.5:0/497281555 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f0d04086e10 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.711+0000 7f0d0be00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cec0678c0 0x7f0cec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:54.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.711+0000 7f0d0be00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cec0678c0 0x7f0cec069d80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0ab000 tx=0x7f0cfc0b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:54.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.715+0000 7f0d03e00640 1 -- 172.21.15.5:0/497281555 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0d0408a030 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.915+0000 7f0d12c00640 1 -- 172.21.15.5:0/497281555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d0c0d0f90 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.915+0000 7f0d03e00640 1 -- 172.21.15.5:0/497281555 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5231 (secure 0 0 0) 0x7f0d04019030 con 0x7f0d0c0b60a0 2024-08-18T22:28:54.917 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:54.918 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:28:21.056377+0000","modified":"2024-08-18T22:28:24.121089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1373218784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1373218784},{"type":"v1","addr":"172.21.15.5:6833","nonce":1373218784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8565,"qdb_cluster":[8565]},"id":9}]} 2024-08-18T22:28:54.918 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 108 2024-08-18T22:28:54.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 -- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cec0678c0 msgr2=0x7f0cec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cec0678c0 0x7f0cec069d80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0ab000 tx=0x7f0cfc0b1040 comp rx=0 tx=0).stop 2024-08-18T22:28:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 -- 172.21.15.5:0/497281555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d0c0b60a0 msgr2=0x7f0d0c0b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d0c0b60a0 0x7f0d0c0b6530 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0cc730 tx=0x7f0d0400f580 comp rx=0 tx=0).stop 2024-08-18T22:28:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 -- 172.21.15.5:0/497281555 shutdown_connections 2024-08-18T22:28:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0cec0678c0 0x7f0cec069d80 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d0c0b60a0 0x7f0d0c0b6530 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d0c15b250 0x7f0d0c15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 --2- 172.21.15.5:0/497281555 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cf0003b80 0x7f0d0c0c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 -- 172.21.15.5:0/497281555 >> 172.21.15.5:0/497281555 conn(0x7f0d0c0d2130 msgr2=0x7f0d0c06e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 -- 172.21.15.5:0/497281555 shutdown_connections 2024-08-18T22:28:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:54.919+0000 7f0d12c00640 1 -- 172.21.15.5:0/497281555 wait complete. 2024-08-18T22:28:54.938 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:28:54.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:28:55.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed2f600640 1 Processor -- start 2024-08-18T22:28:55.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed2f600640 1 -- start start 2024-08-18T22:28:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed2f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed280cb390 0x7fed280735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed2f600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed2806da70 0x7fed2806df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed2f600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed28073c80 con 0x7fed2815bed0 2024-08-18T22:28:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed2f600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fed280ca5d0 con 0x7fed2806da70 2024-08-18T22:28:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed2f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fed280ca8b0 con 0x7fed280cb390 2024-08-18T22:28:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed2cc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fed2815bed0 0x7fed28071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41750/0 (socket says 172.21.15.5:41750) 2024-08-18T22:28:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed2cc00640 1 -- 172.21.15.5:0/2829912374 learned_addr learned my addr 172.21.15.5:0/2829912374 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed27e00640 1 --2- 172.21.15.5:0/2829912374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed280cb390 0x7fed280735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed2d600640 1 --2- 172.21.15.5:0/2829912374 >> v2:172.21.15.117:3300/0 conn(0x7fed2806da70 0x7fed2806df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed27400640 1 -- 172.21.15.5:0/2829912374 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847290887 0 0) 0x7fed28073c80 con 0x7fed2815bed0 2024-08-18T22:28:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed27400640 1 -- 172.21.15.5:0/2829912374 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed10003530 con 0x7fed2815bed0 2024-08-18T22:28:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed27e00640 1 -- 172.21.15.5:0/2829912374 >> v2:172.21.15.117:3300/0 conn(0x7fed2806da70 msgr2=0x7fed2806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed27e00640 1 --2- 172.21.15.5:0/2829912374 >> v2:172.21.15.117:3300/0 conn(0x7fed2806da70 0x7fed2806df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed27e00640 1 -- 172.21.15.5:0/2829912374 >> v1:172.21.15.5:6789/0 conn(0x7fed2815bed0 legacy=0x7fed28071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.079+0000 7fed27e00640 1 -- 172.21.15.5:0/2829912374 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed280cab90 con 0x7fed280cb390 2024-08-18T22:28:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed27e00640 1 --2- 172.21.15.5:0/2829912374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed280cb390 0x7fed280735a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fed140097c0 tx=0x7fed1401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9d81c9b8f1f4764 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed27400640 1 -- 172.21.15.5:0/2829912374 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed140b1070 con 0x7fed280cb390 2024-08-18T22:28:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed27400640 1 -- 172.21.15.5:0/2829912374 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed140ac410 con 0x7fed280cb390 2024-08-18T22:28:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed27400640 1 -- 172.21.15.5:0/2829912374 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed140ac7e0 con 0x7fed280cb390 2024-08-18T22:28:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed2f600640 1 -- 172.21.15.5:0/2829912374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed280cb390 msgr2=0x7fed280735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed2f600640 1 --2- 172.21.15.5:0/2829912374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed280cb390 0x7fed280735a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fed140097c0 tx=0x7fed1401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:28:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed2f600640 1 -- 172.21.15.5:0/2829912374 shutdown_connections 2024-08-18T22:28:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed2f600640 1 --2- 172.21.15.5:0/2829912374 >> v2:172.21.15.117:3300/0 conn(0x7fed2806da70 0x7fed2806df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed2f600640 1 --2- 172.21.15.5:0/2829912374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed280cb390 0x7fed280735a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed2f600640 1 -- 172.21.15.5:0/2829912374 >> 172.21.15.5:0/2829912374 conn(0x7fed280b1c50 msgr2=0x7fed280b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed2f600640 1 -- 172.21.15.5:0/2829912374 shutdown_connections 2024-08-18T22:28:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.083+0000 7fed2f600640 1 -- 172.21.15.5:0/2829912374 wait complete. 2024-08-18T22:28:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2f600640 1 Processor -- start 2024-08-18T22:28:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2f600640 1 -- start start 2024-08-18T22:28:55.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2f600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2806da70 0x7fed2814a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:55.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed280cb390 0x7fed280cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:55.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2f600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed2815bed0 0x7fed28154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:55.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2f600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fed28168730 con 0x7fed2806da70 2024-08-18T22:28:55.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2f600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fed281685b0 con 0x7fed2815bed0 2024-08-18T22:28:55.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fed281688b0 con 0x7fed280cb390 2024-08-18T22:28:55.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2806da70 0x7fed2814a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2806da70 0x7fed2814a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35784/0 (socket says 172.21.15.5:35784) 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2cc00640 1 -- 172.21.15.5:0/3974442731 learned_addr learned my addr 172.21.15.5:0/3974442731 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed27e00640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed280cb390 0x7fed280cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2d600640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed2815bed0 0x7fed28154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2cc00640 1 -- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed280cb390 msgr2=0x7fed280cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2cc00640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed280cb390 0x7fed280cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2cc00640 1 -- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed2815bed0 msgr2=0x7fed28154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2cc00640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed2815bed0 0x7fed28154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2cc00640 1 -- 172.21.15.5:0/3974442731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed28154560 con 0x7fed2806da70 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2cc00640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2806da70 0x7fed2814a2e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c450 tx=0x7fed1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed24c00640 1 -- 172.21.15.5:0/3974442731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c017070 con 0x7fed2806da70 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed24c00640 1 -- 172.21.15.5:0/3974442731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1c005cf0 con 0x7fed2806da70 2024-08-18T22:28:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed24c00640 1 -- 172.21.15.5:0/3974442731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c007290 con 0x7fed2806da70 2024-08-18T22:28:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2f600640 1 -- 172.21.15.5:0/3974442731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed280cfa50 con 0x7fed2806da70 2024-08-18T22:28:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2f600640 1 -- 172.21.15.5:0/3974442731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed28154f50 con 0x7fed2806da70 2024-08-18T22:28:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.087+0000 7fed2f600640 1 -- 172.21.15.5:0/3974442731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2806df00 con 0x7fed2806da70 2024-08-18T22:28:55.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.091+0000 7fed24c00640 1 -- 172.21.15.5:0/3974442731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed1c01a070 con 0x7fed2806da70 2024-08-18T22:28:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.091+0000 7fed24c00640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed080678c0 0x7fed08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.091+0000 7fed24c00640 1 -- 172.21.15.5:0/3974442731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7fed1c085210 con 0x7fed2806da70 2024-08-18T22:28:55.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.091+0000 7fed27e00640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed080678c0 0x7fed08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:55.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.091+0000 7fed27e00640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed080678c0 0x7fed08069d80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fed140ae000 tx=0x7fed14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:55.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.095+0000 7fed24c00640 1 -- 172.21.15.5:0/3974442731 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fed1c0554d0 con 0x7fed2806da70 2024-08-18T22:28:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.319+0000 7fed2f600640 1 -- 172.21.15.5:0/3974442731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fed28073770 con 0x7fed2806da70 2024-08-18T22:28:55.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.319+0000 7fed24c00640 1 -- 172.21.15.5:0/3974442731 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1641 (secure 0 0 0) 0x7fed1c0597d0 con 0x7fed2806da70 2024-08-18T22:28:55.321 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:55.322 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":598,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":141,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1047,"data_bytes":1075394926,"bytes_used":2547613696,"bytes_avail":770546499584,"bytes_total":773094113280,"write_bytes_sec":47379586,"read_op_per_sec":0,"write_op_per_sec":47},"fsmap":{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8565}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-08-18T22:28:53.761893+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:28:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 -- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed080678c0 msgr2=0x7fed08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed080678c0 0x7fed08069d80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fed140ae000 tx=0x7fed14008040 comp rx=0 tx=0).stop 2024-08-18T22:28:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 -- 172.21.15.5:0/3974442731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2806da70 msgr2=0x7fed2814a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2806da70 0x7fed2814a2e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c450 tx=0x7fed1c00c910 comp rx=0 tx=0).stop 2024-08-18T22:28:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 -- 172.21.15.5:0/3974442731 shutdown_connections 2024-08-18T22:28:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed080678c0 0x7fed08069d80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed2815bed0 0x7fed28154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed280cb390 0x7fed280cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 --2- 172.21.15.5:0/3974442731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2806da70 0x7fed2814a2e0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:55.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 -- 172.21.15.5:0/3974442731 >> 172.21.15.5:0/3974442731 conn(0x7fed280b1c50 msgr2=0x7fed280b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 -- 172.21.15.5:0/3974442731 shutdown_connections 2024-08-18T22:28:55.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:55.323+0000 7fed2f600640 1 -- 172.21.15.5:0/3974442731 wait complete. 2024-08-18T22:28:55.342 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused'} 2024-08-18T22:28:56.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:56.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.495+0000 7efe52e00640 1 Processor -- start 2024-08-18T22:28:56.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.495+0000 7efe52e00640 1 -- start start 2024-08-18T22:28:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe52e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe4c15b010 0x7efe4c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe52e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe4c06f290 0x7efe4c072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe52e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4c0cee20 con 0x7efe4c0cd3a0 2024-08-18T22:28:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe52e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7efe4c0cfa30 con 0x7efe4c15b010 2024-08-18T22:28:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe52e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efe4c0cf100 con 0x7efe4c06f290 2024-08-18T22:28:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe4be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe4c15b010 0x7efe4c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe4be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe4c15b010 0x7efe4c0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35794/0 (socket says 172.21.15.5:35794) 2024-08-18T22:28:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe4be00640 1 -- 172.21.15.5:0/775079703 learned_addr learned my addr 172.21.15.5:0/775079703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe43400640 1 --1- 172.21.15.5:0/775079703 >> v1:172.21.15.5:6789/0 conn(0x7efe4c0cd3a0 0x7efe4c06eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41762/0 (socket says 172.21.15.5:41762) 2024-08-18T22:28:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe50e00640 1 --2- 172.21.15.5:0/775079703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe4c06f290 0x7efe4c072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe4be00640 1 -- 172.21.15.5:0/775079703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe4c06f290 msgr2=0x7efe4c072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe4be00640 1 --2- 172.21.15.5:0/775079703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe4c06f290 0x7efe4c072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe4be00640 1 -- 172.21.15.5:0/775079703 >> v1:172.21.15.5:6789/0 conn(0x7efe4c0cd3a0 legacy=0x7efe4c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe4be00640 1 -- 172.21.15.5:0/775079703 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c0cf3e0 con 0x7efe4c15b010 2024-08-18T22:28:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.499+0000 7efe50e00640 1 --2- 172.21.15.5:0/775079703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe4c06f290 0x7efe4c072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe4be00640 1 --2- 172.21.15.5:0/775079703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe4c15b010 0x7efe4c0ce840 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009870 tx=0x7efe3c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c092663a94a4d26e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe4b400640 1 -- 172.21.15.5:0/775079703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c0ab660 con 0x7efe4c15b010 2024-08-18T22:28:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe4b400640 1 -- 172.21.15.5:0/775079703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c0b0070 con 0x7efe4c15b010 2024-08-18T22:28:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe4b400640 1 -- 172.21.15.5:0/775079703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c0aba20 con 0x7efe4c15b010 2024-08-18T22:28:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 -- 172.21.15.5:0/775079703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe4c15b010 msgr2=0x7efe4c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 --2- 172.21.15.5:0/775079703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe4c15b010 0x7efe4c0ce840 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009870 tx=0x7efe3c01c530 comp rx=0 tx=0).stop 2024-08-18T22:28:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 -- 172.21.15.5:0/775079703 shutdown_connections 2024-08-18T22:28:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 --2- 172.21.15.5:0/775079703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe4c06f290 0x7efe4c072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 --2- 172.21.15.5:0/775079703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe4c15b010 0x7efe4c0ce840 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 -- 172.21.15.5:0/775079703 >> 172.21.15.5:0/775079703 conn(0x7efe4c0b1c50 msgr2=0x7efe4c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 -- 172.21.15.5:0/775079703 shutdown_connections 2024-08-18T22:28:56.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 -- 172.21.15.5:0/775079703 wait complete. 2024-08-18T22:28:56.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 Processor -- start 2024-08-18T22:28:56.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 -- start start 2024-08-18T22:28:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe4c06f290 0x7efe4c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe4c0cd3a0 0x7efe4c0b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c15b010 0x7efe4c14d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c0734f0 con 0x7efe4c06f290 2024-08-18T22:28:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c073370 con 0x7efe4c15b010 2024-08-18T22:28:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe52e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efe4c073670 con 0x7efe4c0cd3a0 2024-08-18T22:28:56.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe4be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe4c06f290 0x7efe4c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe4be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe4c06f290 0x7efe4c0ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35810/0 (socket says 172.21.15.5:35810) 2024-08-18T22:28:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.503+0000 7efe4be00640 1 -- 172.21.15.5:0/3103821895 learned_addr learned my addr 172.21.15.5:0/3103821895 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe43400640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe4c0cd3a0 0x7efe4c0b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe50e00640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c15b010 0x7efe4c14d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe4be00640 1 -- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe4c0cd3a0 msgr2=0x7efe4c0b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe4be00640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe4c0cd3a0 0x7efe4c0b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe4be00640 1 -- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c15b010 msgr2=0x7efe4c14d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe4be00640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c15b010 0x7efe4c14d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe4be00640 1 -- 172.21.15.5:0/3103821895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c0b10e0 con 0x7efe4c06f290 2024-08-18T22:28:56.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe4be00640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe4c06f290 0x7efe4c0ad0c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7efe3c01abe0 tx=0x7efe3c01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:56.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe48c00640 1 -- 172.21.15.5:0/3103821895 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c0be5f0 con 0x7efe4c06f290 2024-08-18T22:28:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe48c00640 1 -- 172.21.15.5:0/3103821895 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c0be7b0 con 0x7efe4c06f290 2024-08-18T22:28:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe48c00640 1 -- 172.21.15.5:0/3103821895 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c0beba0 con 0x7efe4c06f290 2024-08-18T22:28:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe52e00640 1 -- 172.21.15.5:0/3103821895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4c0b1380 con 0x7efe4c06f290 2024-08-18T22:28:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe52e00640 1 -- 172.21.15.5:0/3103821895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe4c1564b0 con 0x7efe4c06f290 2024-08-18T22:28:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe52e00640 1 -- 172.21.15.5:0/3103821895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe4c072620 con 0x7efe4c06f290 2024-08-18T22:28:56.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe48c00640 1 -- 172.21.15.5:0/3103821895 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe3c0b43f0 con 0x7efe4c06f290 2024-08-18T22:28:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe48c00640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe28067940 0x7efe28069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.507+0000 7efe48c00640 1 -- 172.21.15.5:0/3103821895 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7efe3c120350 con 0x7efe4c06f290 2024-08-18T22:28:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.511+0000 7efe43400640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe28067940 0x7efe28069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:56.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.511+0000 7efe43400640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe28067940 0x7efe28069e00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efe4c1fa440 tx=0x7efe34007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:56.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.515+0000 7efe48c00640 1 -- 172.21.15.5:0/3103821895 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7efe3c0c4060 con 0x7efe4c06f290 2024-08-18T22:28:56.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.711+0000 7efe52e00640 1 -- 172.21.15.5:0/3103821895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe4c0b2510 con 0x7efe4c06f290 2024-08-18T22:28:56.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.711+0000 7efe48c00640 1 -- 172.21.15.5:0/3103821895 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5231 (secure 0 0 0) 0x7efe3c016150 con 0x7efe4c06f290 2024-08-18T22:28:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:56.713 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:28:21.056377+0000","modified":"2024-08-18T22:28:24.121089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1373218784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1373218784},{"type":"v1","addr":"172.21.15.5:6833","nonce":1373218784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8565,"qdb_cluster":[8565]},"id":9}]} 2024-08-18T22:28:56.714 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 108 2024-08-18T22:28:56.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 -- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe28067940 msgr2=0x7efe28069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:56.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe28067940 0x7efe28069e00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efe4c1fa440 tx=0x7efe34007e90 comp rx=0 tx=0).stop 2024-08-18T22:28:56.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 -- 172.21.15.5:0/3103821895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe4c06f290 msgr2=0x7efe4c0ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:56.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe4c06f290 0x7efe4c0ad0c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7efe3c01abe0 tx=0x7efe3c01ad70 comp rx=0 tx=0).stop 2024-08-18T22:28:56.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 -- 172.21.15.5:0/3103821895 shutdown_connections 2024-08-18T22:28:56.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efe28067940 0x7efe28069e00 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe4c15b010 0x7efe4c14d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe4c0cd3a0 0x7efe4c0b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 --2- 172.21.15.5:0/3103821895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe4c06f290 0x7efe4c0ad0c0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 -- 172.21.15.5:0/3103821895 >> 172.21.15.5:0/3103821895 conn(0x7efe4c0b1c50 msgr2=0x7efe4c158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:56.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 -- 172.21.15.5:0/3103821895 shutdown_connections 2024-08-18T22:28:56.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.715+0000 7efe52e00640 1 -- 172.21.15.5:0/3103821895 wait complete. 2024-08-18T22:28:56.735 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:28:56.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:28:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e8800640 1 Processor -- start 2024-08-18T22:28:56.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e8800640 1 -- start start 2024-08-18T22:28:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e8800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e006fad0 0x7f94e00b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e8800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94e00b5e30 con 0x7f94e0071c90 2024-08-18T22:28:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e8800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94e00b6110 con 0x7f94e015c180 2024-08-18T22:28:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e8800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f94e00b63f0 con 0x7f94e006fad0 2024-08-18T22:28:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e5400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f94e0071c90 0x7f94e00d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41772/0 (socket says 172.21.15.5:41772) 2024-08-18T22:28:56.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e5400640 1 -- 172.21.15.5:0/1917209868 learned_addr learned my addr 172.21.15.5:0/1917209868 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e6800640 1 --2- 172.21.15.5:0/1917209868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e006fad0 0x7f94e00b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e4a00640 1 -- 172.21.15.5:0/1917209868 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2232709550 0 0) 0x7f94e00b5e30 con 0x7f94e0071c90 2024-08-18T22:28:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e4a00640 1 -- 172.21.15.5:0/1917209868 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94c8003530 con 0x7f94e0071c90 2024-08-18T22:28:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e4a00640 1 -- 172.21.15.5:0/1917209868 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435132524 0 0) 0x7f94e00b6110 con 0x7f94e015c180 2024-08-18T22:28:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e6800640 1 -- 172.21.15.5:0/1917209868 >> v1:172.21.15.117:6789/0 conn(0x7f94e015c180 legacy=0x7f94e0071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e6800640 1 -- 172.21.15.5:0/1917209868 >> v1:172.21.15.5:6789/0 conn(0x7f94e0071c90 legacy=0x7f94e00d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:56.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.875+0000 7f94e6800640 1 -- 172.21.15.5:0/1917209868 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e00b66d0 con 0x7f94e006fad0 2024-08-18T22:28:56.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.879+0000 7f94e6800640 1 --2- 172.21.15.5:0/1917209868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e006fad0 0x7f94e00b57c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009dc0 tx=0x7f94dc01c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b48e3288f50b707 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:56.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.879+0000 7f94e4a00640 1 -- 172.21.15.5:0/1917209868 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0b2070 con 0x7f94e006fad0 2024-08-18T22:28:56.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.879+0000 7f94e4a00640 1 -- 172.21.15.5:0/1917209868 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94dc0a58c0 con 0x7f94e006fad0 2024-08-18T22:28:56.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.879+0000 7f94e4a00640 1 -- 172.21.15.5:0/1917209868 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0a5c90 con 0x7f94e006fad0 2024-08-18T22:28:56.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.879+0000 7f94e8800640 1 -- 172.21.15.5:0/1917209868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e006fad0 msgr2=0x7f94e00b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.879+0000 7f94e8800640 1 --2- 172.21.15.5:0/1917209868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e006fad0 0x7f94e00b57c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009dc0 tx=0x7f94dc01c810 comp rx=0 tx=0).stop 2024-08-18T22:28:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.879+0000 7f94e8800640 1 -- 172.21.15.5:0/1917209868 shutdown_connections 2024-08-18T22:28:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.879+0000 7f94e8800640 1 --2- 172.21.15.5:0/1917209868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e006fad0 0x7f94e00b57c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.879+0000 7f94e8800640 1 -- 172.21.15.5:0/1917209868 >> 172.21.15.5:0/1917209868 conn(0x7f94e00b3eb0 msgr2=0x7f94e00b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.879+0000 7f94e8800640 1 -- 172.21.15.5:0/1917209868 shutdown_connections 2024-08-18T22:28:56.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.879+0000 7f94e8800640 1 -- 172.21.15.5:0/1917209868 wait complete. 2024-08-18T22:28:56.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e8800640 1 Processor -- start 2024-08-18T22:28:56.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e8800640 1 -- start start 2024-08-18T22:28:56.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e8800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e006fad0 0x7f94e0157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e8800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e0071c90 0x7f94e0151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e8800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015c180 0x7f94e00d21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e8800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94e016a160 con 0x7f94e015c180 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e8800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0169fe0 con 0x7f94e006fad0 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e8800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f94e016a2e0 con 0x7f94e0071c90 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015c180 0x7f94e00d21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015c180 0x7f94e00d21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35820/0 (socket says 172.21.15.5:35820) 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e6800640 1 -- 172.21.15.5:0/3632591627 learned_addr learned my addr 172.21.15.5:0/3632591627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e5400640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e0071c90 0x7f94e0151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e5e00640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e006fad0 0x7f94e0157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e6800640 1 -- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e0071c90 msgr2=0x7f94e0151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e6800640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e0071c90 0x7f94e0151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e6800640 1 -- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e006fad0 msgr2=0x7f94e0157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:56.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e6800640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e006fad0 0x7f94e0157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:56.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e6800640 1 -- 172.21.15.5:0/3632591627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e014de00 con 0x7f94e015c180 2024-08-18T22:28:56.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e6800640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015c180 0x7f94e00d21f0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f94dc01ccf0 tx=0x7f94dc019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:56.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94da000640 1 -- 172.21.15.5:0/3632591627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0bd020 con 0x7f94e015c180 2024-08-18T22:28:56.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94da000640 1 -- 172.21.15.5:0/3632591627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94dc0b8670 con 0x7f94e015c180 2024-08-18T22:28:56.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e8800640 1 -- 172.21.15.5:0/3632591627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e0154630 con 0x7f94e015c180 2024-08-18T22:28:56.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94da000640 1 -- 172.21.15.5:0/3632591627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0b2040 con 0x7f94e015c180 2024-08-18T22:28:56.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e8800640 1 -- 172.21.15.5:0/3632591627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e0154bf0 con 0x7f94e015c180 2024-08-18T22:28:56.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.883+0000 7f94e8800640 1 -- 172.21.15.5:0/3632591627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e00cf7d0 con 0x7f94e015c180 2024-08-18T22:28:56.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.887+0000 7f94da000640 1 -- 172.21.15.5:0/3632591627 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f94dc0c0020 con 0x7f94e015c180 2024-08-18T22:28:56.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.887+0000 7f94da000640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94c40678c0 0x7f94c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:56.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.887+0000 7f94da000640 1 -- 172.21.15.5:0/3632591627 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f94dc120ce0 con 0x7f94e015c180 2024-08-18T22:28:56.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.887+0000 7f94e5e00640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94c40678c0 0x7f94c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:56.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.887+0000 7f94e5e00640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94c40678c0 0x7f94c4069d80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f94d4007fd0 tx=0x7f94d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:56.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:56.891+0000 7f94da000640 1 -- 172.21.15.5:0/3632591627 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f94dc0c7030 con 0x7f94e015c180 2024-08-18T22:28:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.119+0000 7f94e8800640 1 -- 172.21.15.5:0/3632591627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f94e00725e0 con 0x7f94e015c180 2024-08-18T22:28:57.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.119+0000 7f94da000640 1 -- 172.21.15.5:0/3632591627 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1641 (secure 0 0 0) 0x7f94dc016580 con 0x7f94e015c180 2024-08-18T22:28:57.122 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:57.122 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":600,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":141,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076443502,"bytes_used":2556002304,"bytes_avail":770538110976,"bytes_total":773094113280,"write_bytes_sec":31441405,"read_op_per_sec":0,"write_op_per_sec":32},"fsmap":{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8565}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-08-18T22:28:53.761893+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:28:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 -- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94c40678c0 msgr2=0x7f94c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94c40678c0 0x7f94c4069d80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f94d4007fd0 tx=0x7f94d4009040 comp rx=0 tx=0).stop 2024-08-18T22:28:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 -- 172.21.15.5:0/3632591627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015c180 msgr2=0x7f94e00d21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015c180 0x7f94e00d21f0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f94dc01ccf0 tx=0x7f94dc019610 comp rx=0 tx=0).stop 2024-08-18T22:28:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 -- 172.21.15.5:0/3632591627 shutdown_connections 2024-08-18T22:28:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94c40678c0 0x7f94c4069d80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e015c180 0x7f94e00d21f0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e0071c90 0x7f94e0151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:57.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 --2- 172.21.15.5:0/3632591627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e006fad0 0x7f94e0157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:57.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 -- 172.21.15.5:0/3632591627 >> 172.21.15.5:0/3632591627 conn(0x7f94e00b3eb0 msgr2=0x7f94e00d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:57.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 -- 172.21.15.5:0/3632591627 shutdown_connections 2024-08-18T22:28:57.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:57.123+0000 7f94e8800640 1 -- 172.21.15.5:0/3632591627 wait complete. 2024-08-18T22:28:57.143 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused'} 2024-08-18T22:28:58.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:28:58.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.295+0000 7fcd6f800640 1 Processor -- start 2024-08-18T22:28:58.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.295+0000 7fcd6f800640 1 -- start start 2024-08-18T22:28:58.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.295+0000 7fcd6f800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd680cb390 0x7fcd680735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:58.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.295+0000 7fcd6f800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd68073c80 con 0x7fcd6815bed0 2024-08-18T22:28:58.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.295+0000 7fcd6f800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd680ca5d0 con 0x7fcd6806da70 2024-08-18T22:28:58.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.295+0000 7fcd6f800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd680ca8b0 con 0x7fcd680cb390 2024-08-18T22:28:58.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.295+0000 7fcd6ce00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcd6815bed0 0x7fcd68071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41782/0 (socket says 172.21.15.5:41782) 2024-08-18T22:28:58.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.295+0000 7fcd6ce00640 1 -- 172.21.15.5:0/3358665543 learned_addr learned my addr 172.21.15.5:0/3358665543 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:58.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.299+0000 7fcd67e00640 1 --2- 172.21.15.5:0/3358665543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd680cb390 0x7fcd680735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:58.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.299+0000 7fcd67400640 1 -- 172.21.15.5:0/3358665543 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3805693205 0 0) 0x7fcd68073c80 con 0x7fcd6815bed0 2024-08-18T22:28:58.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.299+0000 7fcd67400640 1 -- 172.21.15.5:0/3358665543 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd4c003530 con 0x7fcd6815bed0 2024-08-18T22:28:58.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.299+0000 7fcd67400640 1 -- 172.21.15.5:0/3358665543 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537071261 0 0) 0x7fcd680ca5d0 con 0x7fcd6806da70 2024-08-18T22:28:58.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.299+0000 7fcd67400640 1 -- 172.21.15.5:0/3358665543 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd68073c80 con 0x7fcd6806da70 2024-08-18T22:28:58.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.299+0000 7fcd67e00640 1 -- 172.21.15.5:0/3358665543 >> v1:172.21.15.117:6789/0 conn(0x7fcd6806da70 legacy=0x7fcd68165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.299+0000 7fcd67e00640 1 -- 172.21.15.5:0/3358665543 >> v1:172.21.15.5:6789/0 conn(0x7fcd6815bed0 legacy=0x7fcd68071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.299+0000 7fcd67e00640 1 -- 172.21.15.5:0/3358665543 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd680cab90 con 0x7fcd680cb390 2024-08-18T22:28:58.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.299+0000 7fcd67e00640 1 --2- 172.21.15.5:0/3358665543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd680cb390 0x7fcd680735a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd540097f0 tx=0x7fcd5401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d99760795c29654 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd67400640 1 -- 172.21.15.5:0/3358665543 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd540b1070 con 0x7fcd680cb390 2024-08-18T22:28:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd67400640 1 -- 172.21.15.5:0/3358665543 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd540ac630 con 0x7fcd680cb390 2024-08-18T22:28:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd67400640 1 -- 172.21.15.5:0/3358665543 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd540a8050 con 0x7fcd680cb390 2024-08-18T22:28:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 -- 172.21.15.5:0/3358665543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd680cb390 msgr2=0x7fcd680735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 --2- 172.21.15.5:0/3358665543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd680cb390 0x7fcd680735a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcd540097f0 tx=0x7fcd5401c4b0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 -- 172.21.15.5:0/3358665543 shutdown_connections 2024-08-18T22:28:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 --2- 172.21.15.5:0/3358665543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd680cb390 0x7fcd680735a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 -- 172.21.15.5:0/3358665543 >> 172.21.15.5:0/3358665543 conn(0x7fcd680b1c50 msgr2=0x7fcd680b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 -- 172.21.15.5:0/3358665543 shutdown_connections 2024-08-18T22:28:58.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 -- 172.21.15.5:0/3358665543 wait complete. 2024-08-18T22:28:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 Processor -- start 2024-08-18T22:28:58.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 -- start start 2024-08-18T22:28:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd6806da70 0x7fcd6814bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd680cb390 0x7fcd681594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd6815bed0 0x7fcd680b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcd68169c40 con 0x7fcd680cb390 2024-08-18T22:28:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd68169ac0 con 0x7fcd6815bed0 2024-08-18T22:28:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd6f800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcd68169dc0 con 0x7fcd6806da70 2024-08-18T22:28:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd67e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd680cb390 0x7fcd681594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd67e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd680cb390 0x7fcd681594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35826/0 (socket says 172.21.15.5:35826) 2024-08-18T22:28:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.303+0000 7fcd67e00640 1 -- 172.21.15.5:0/3118602993 learned_addr learned my addr 172.21.15.5:0/3118602993 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd6ce00640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd6806da70 0x7fcd6814bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd6d800640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd6815bed0 0x7fcd680b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd67e00640 1 -- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd6806da70 msgr2=0x7fcd6814bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd67e00640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd6806da70 0x7fcd6814bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd67e00640 1 -- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd6815bed0 msgr2=0x7fcd680b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd67e00640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd6815bed0 0x7fcd680b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd67e00640 1 -- 172.21.15.5:0/3118602993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd68151520 con 0x7fcd680cb390 2024-08-18T22:28:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd6ce00640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd6806da70 0x7fcd6814bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:58.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd67e00640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd680cb390 0x7fcd681594d0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009740 tx=0x7fcd54019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd64c00640 1 -- 172.21.15.5:0/3118602993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd540b9020 con 0x7fcd680cb390 2024-08-18T22:28:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd64c00640 1 -- 172.21.15.5:0/3118602993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd540b5410 con 0x7fcd680cb390 2024-08-18T22:28:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd64c00640 1 -- 172.21.15.5:0/3118602993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd540b1040 con 0x7fcd680cb390 2024-08-18T22:28:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd6f800640 1 -- 172.21.15.5:0/3118602993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd68151240 con 0x7fcd680cb390 2024-08-18T22:28:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd6f800640 1 -- 172.21.15.5:0/3118602993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd680af910 con 0x7fcd680cb390 2024-08-18T22:28:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd6f800640 1 -- 172.21.15.5:0/3118602993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd680735a0 con 0x7fcd680cb390 2024-08-18T22:28:58.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.307+0000 7fcd64c00640 1 -- 172.21.15.5:0/3118602993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd540bc020 con 0x7fcd680cb390 2024-08-18T22:28:58.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.311+0000 7fcd64c00640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcd480678c0 0x7fcd48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:58.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.311+0000 7fcd64c00640 1 -- 172.21.15.5:0/3118602993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7fcd5411f4c0 con 0x7fcd680cb390 2024-08-18T22:28:58.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.311+0000 7fcd6ce00640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcd480678c0 0x7fcd48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:58.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.311+0000 7fcd6ce00640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcd480678c0 0x7fcd48069d80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcd58000f70 tx=0x7fcd58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:58.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.315+0000 7fcd64c00640 1 -- 172.21.15.5:0/3118602993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcd540160d0 con 0x7fcd680cb390 2024-08-18T22:28:58.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.511+0000 7fcd6f800640 1 -- 172.21.15.5:0/3118602993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd6814c230 con 0x7fcd680cb390 2024-08-18T22:28:58.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.511+0000 7fcd64c00640 1 -- 172.21.15.5:0/3118602993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5231 (secure 0 0 0) 0x7fcd540efe60 con 0x7fcd680cb390 2024-08-18T22:28:58.513 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:58.513 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:28:21.056377+0000","modified":"2024-08-18T22:28:24.121089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1373218784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1373218784},{"type":"v1","addr":"172.21.15.5:6833","nonce":1373218784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8565,"qdb_cluster":[8565]},"id":9}]} 2024-08-18T22:28:58.513 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 108 2024-08-18T22:28:58.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 -- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcd480678c0 msgr2=0x7fcd48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcd480678c0 0x7fcd48069d80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcd58000f70 tx=0x7fcd58009040 comp rx=0 tx=0).stop 2024-08-18T22:28:58.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 -- 172.21.15.5:0/3118602993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd680cb390 msgr2=0x7fcd681594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd680cb390 0x7fcd681594d0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009740 tx=0x7fcd54019250 comp rx=0 tx=0).stop 2024-08-18T22:28:58.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 -- 172.21.15.5:0/3118602993 shutdown_connections 2024-08-18T22:28:58.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcd480678c0 0x7fcd48069d80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd6815bed0 0x7fcd680b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd680cb390 0x7fcd681594d0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 --2- 172.21.15.5:0/3118602993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd6806da70 0x7fcd6814bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 -- 172.21.15.5:0/3118602993 >> 172.21.15.5:0/3118602993 conn(0x7fcd680b1c50 msgr2=0x7fcd680b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:58.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 -- 172.21.15.5:0/3118602993 shutdown_connections 2024-08-18T22:28:58.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.515+0000 7fcd6f800640 1 -- 172.21.15.5:0/3118602993 wait complete. 2024-08-18T22:28:58.534 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:28:58.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:28:58.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571f000640 1 Processor -- start 2024-08-18T22:28:58.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571f000640 1 -- start start 2024-08-18T22:28:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571f000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5718071c90 0x7f57180b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571f000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f571806fad0 0x7f571815c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571f000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57180b5e30 con 0x7f571815c180 2024-08-18T22:28:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571f000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f571815caa0 con 0x7f571806fad0 2024-08-18T22:28:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571f000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f57180b6110 con 0x7f5718071c90 2024-08-18T22:28:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571d000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f571806fad0 0x7f571815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571d000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f571806fad0 0x7f571815c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35838/0 (socket says 172.21.15.5:35838) 2024-08-18T22:28:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571d000640 1 -- 172.21.15.5:0/1353693681 learned_addr learned my addr 172.21.15.5:0/1353693681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f5717400640 1 --2- 172.21.15.5:0/1353693681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5718071c90 0x7f57180b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571d000640 1 -- 172.21.15.5:0/1353693681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5718071c90 msgr2=0x7f57180b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:28:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571d000640 1 --2- 172.21.15.5:0/1353693681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5718071c90 0x7f57180b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571d000640 1 -- 172.21.15.5:0/1353693681 >> v1:172.21.15.117:6789/0 conn(0x7f571815c180 legacy=0x7f5718071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f571d000640 1 -- 172.21.15.5:0/1353693681 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57180b63f0 con 0x7f571806fad0 2024-08-18T22:28:58.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.675+0000 7f5717400640 1 --2- 172.21.15.5:0/1353693681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5718071c90 0x7f57180b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:58.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f571d000640 1 --2- 172.21.15.5:0/1353693681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571806fad0 0x7f571815c560 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f5710009e50 tx=0x7f571001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af28c46afe4e48ca server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:58.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f5716a00640 1 -- 172.21.15.5:0/1353693681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57100a5760 con 0x7f571806fad0 2024-08-18T22:28:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f5716a00640 1 -- 172.21.15.5:0/1353693681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57100a5900 con 0x7f571806fad0 2024-08-18T22:28:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f5716a00640 1 -- 172.21.15.5:0/1353693681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57100a5cd0 con 0x7f571806fad0 2024-08-18T22:28:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f571f000640 1 -- 172.21.15.5:0/1353693681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571806fad0 msgr2=0x7f571815c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f571f000640 1 --2- 172.21.15.5:0/1353693681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571806fad0 0x7f571815c560 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f5710009e50 tx=0x7f571001c8e0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f571f000640 1 -- 172.21.15.5:0/1353693681 shutdown_connections 2024-08-18T22:28:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f571f000640 1 --2- 172.21.15.5:0/1353693681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571806fad0 0x7f571815c560 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f571f000640 1 --2- 172.21.15.5:0/1353693681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5718071c90 0x7f57180b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f571f000640 1 -- 172.21.15.5:0/1353693681 >> 172.21.15.5:0/1353693681 conn(0x7f57180b3eb0 msgr2=0x7f57180b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f571f000640 1 -- 172.21.15.5:0/1353693681 shutdown_connections 2024-08-18T22:28:58.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.679+0000 7f571f000640 1 -- 172.21.15.5:0/1353693681 wait complete. 2024-08-18T22:28:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571f000640 1 Processor -- start 2024-08-18T22:28:58.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571f000640 1 -- start start 2024-08-18T22:28:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571f000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571806fad0 0x7f571814d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:58.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571f000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5718071c90 0x7f571815fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:58.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571f000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f571815c180 0x7f5718160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:58.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571f000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f57180d1c30 con 0x7f571806fad0 2024-08-18T22:28:58.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571f000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f57180d1ab0 con 0x7f5718071c90 2024-08-18T22:28:58.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571f000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f57180d1db0 con 0x7f571815c180 2024-08-18T22:28:58.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f5717e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571806fad0 0x7f571814d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:58.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f5717e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571806fad0 0x7f571814d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35842/0 (socket says 172.21.15.5:35842) 2024-08-18T22:28:58.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f5717e00640 1 -- 172.21.15.5:0/2496484842 learned_addr learned my addr 172.21.15.5:0/2496484842 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:58.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f5717400640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5718071c90 0x7f571815fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:58.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571d000640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f571815c180 0x7f5718160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:58.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f5717e00640 1 -- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f571815c180 msgr2=0x7f5718160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f5717e00640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f571815c180 0x7f5718160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f5717e00640 1 -- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5718071c90 msgr2=0x7f571815fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f5717e00640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5718071c90 0x7f571815fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f5717e00640 1 -- 172.21.15.5:0/2496484842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5718068a70 con 0x7f571806fad0 2024-08-18T22:28:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f5717400640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5718071c90 0x7f571815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571d000640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f571815c180 0x7f5718160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:28:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f5717e00640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571806fad0 0x7f571814d880 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f570800c3c0 tx=0x7f570800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f570fe00640 1 -- 172.21.15.5:0/2496484842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708017070 con 0x7f571806fad0 2024-08-18T22:28:58.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f570fe00640 1 -- 172.21.15.5:0/2496484842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57080052d0 con 0x7f571806fad0 2024-08-18T22:28:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f570fe00640 1 -- 172.21.15.5:0/2496484842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708003840 con 0x7f571806fad0 2024-08-18T22:28:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571f000640 1 -- 172.21.15.5:0/2496484842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571815a970 con 0x7f571806fad0 2024-08-18T22:28:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571f000640 1 -- 172.21.15.5:0/2496484842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571815af30 con 0x7f571806fad0 2024-08-18T22:28:58.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.683+0000 7f571f000640 1 -- 172.21.15.5:0/2496484842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571815c560 con 0x7f571806fad0 2024-08-18T22:28:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.687+0000 7f570fe00640 1 -- 172.21.15.5:0/2496484842 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f570801a070 con 0x7f571806fad0 2024-08-18T22:28:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.687+0000 7f570fe00640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56f80678c0 0x7f56f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.687+0000 7f570fe00640 1 -- 172.21.15.5:0/2496484842 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f5708085190 con 0x7f571806fad0 2024-08-18T22:28:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.687+0000 7f5717400640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56f80678c0 0x7f56f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.687+0000 7f5717400640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56f80678c0 0x7f56f8069d80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5718155160 tx=0x7f5704008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.691+0000 7f570fe00640 1 -- 172.21.15.5:0/2496484842 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5708005480 con 0x7f571806fad0 2024-08-18T22:28:58.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.919+0000 7f571f000640 1 -- 172.21.15.5:0/2496484842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f57180cf7d0 con 0x7f571806fad0 2024-08-18T22:28:58.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.919+0000 7f570fe00640 1 -- 172.21.15.5:0/2496484842 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7f5708055b30 con 0x7f571806fad0 2024-08-18T22:28:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:28:58.922 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":602,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":141,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076443502,"bytes_used":2556002304,"bytes_avail":770538110976,"bytes_total":773094113280,"write_bytes_sec":26634817,"read_op_per_sec":0,"write_op_per_sec":26},"fsmap":{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8565}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-08-18T22:28:57.762805+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:28:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 -- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56f80678c0 msgr2=0x7f56f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56f80678c0 0x7f56f8069d80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5718155160 tx=0x7f5704008040 comp rx=0 tx=0).stop 2024-08-18T22:28:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 -- 172.21.15.5:0/2496484842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571806fad0 msgr2=0x7f571814d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571806fad0 0x7f571814d880 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f570800c3c0 tx=0x7f570800c880 comp rx=0 tx=0).stop 2024-08-18T22:28:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 -- 172.21.15.5:0/2496484842 shutdown_connections 2024-08-18T22:28:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f56f80678c0 0x7f56f8069d80 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f571815c180 0x7f5718160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5718071c90 0x7f571815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 --2- 172.21.15.5:0/2496484842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f571806fad0 0x7f571814d880 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 -- 172.21.15.5:0/2496484842 >> 172.21.15.5:0/2496484842 conn(0x7f57180b3eb0 msgr2=0x7f5718151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 -- 172.21.15.5:0/2496484842 shutdown_connections 2024-08-18T22:28:58.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:58.923+0000 7f571f000640 1 -- 172.21.15.5:0/2496484842 wait complete. 2024-08-18T22:28:58.943 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-08-18T22:28:58.943 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:28:58.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:28:59.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:28:59.107 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:28:59.108 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:28:59.108 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:28:59.108 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:59.117 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:28:59.117 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:28:59.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:28:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.355+0000 7f287f600640 1 Processor -- start 2024-08-18T22:28:59.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.355+0000 7f287f600640 1 -- start start 2024-08-18T22:28:59.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.355+0000 7f287f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780b40c0 0x7f28780b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:59.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.355+0000 7f287f600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28780b31f0 con 0x7f28780ce280 2024-08-18T22:28:59.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.355+0000 7f287f600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28780b34d0 con 0x7f287815b0c0 2024-08-18T22:28:59.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.355+0000 7f287f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28780b3d70 con 0x7f28780b40c0 2024-08-18T22:28:59.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.355+0000 7f287d600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f28780ce280 0x7f28780ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41788/0 (socket says 172.21.15.5:41788) 2024-08-18T22:28:59.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.355+0000 7f287d600640 1 -- 172.21.15.5:0/2913125661 learned_addr learned my addr 172.21.15.5:0/2913125661 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:28:59.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.359+0000 7f2877e00640 1 --2- 172.21.15.5:0/2913125661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780b40c0 0x7f28780b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:59.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.359+0000 7f2877400640 1 -- 172.21.15.5:0/2913125661 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059529463 0 0) 0x7f28780b31f0 con 0x7f28780ce280 2024-08-18T22:28:59.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.359+0000 7f2877400640 1 -- 172.21.15.5:0/2913125661 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f285c005740 con 0x7f28780ce280 2024-08-18T22:28:59.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.359+0000 7f2877400640 1 -- 172.21.15.5:0/2913125661 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225989312 0 0) 0x7f28780b34d0 con 0x7f287815b0c0 2024-08-18T22:28:59.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.359+0000 7f2877400640 1 -- 172.21.15.5:0/2913125661 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28780b31f0 con 0x7f287815b0c0 2024-08-18T22:28:59.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.359+0000 7f2877400640 1 -- 172.21.15.5:0/2913125661 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1813292608 0 0) 0x7f285c005740 con 0x7f28780ce280 2024-08-18T22:28:59.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.359+0000 7f2877e00640 1 -- 172.21.15.5:0/2913125661 >> v1:172.21.15.117:6789/0 conn(0x7f287815b0c0 legacy=0x7f287806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:59.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.359+0000 7f2877e00640 1 -- 172.21.15.5:0/2913125661 >> v1:172.21.15.5:6789/0 conn(0x7f28780ce280 legacy=0x7f28780ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:59.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.359+0000 7f2877e00640 1 -- 172.21.15.5:0/2913125661 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28780b37b0 con 0x7f28780b40c0 2024-08-18T22:28:59.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.359+0000 7f2877e00640 1 --2- 172.21.15.5:0/2913125661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780b40c0 0x7f28780b4500 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f28640097f0 tx=0x7f286401c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6650dc28f43ddb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:59.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.359+0000 7f2877400640 1 -- 172.21.15.5:0/2913125661 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28640b0070 con 0x7f28780b40c0 2024-08-18T22:28:59.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f2877400640 1 -- 172.21.15.5:0/2913125661 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28640ab400 con 0x7f28780b40c0 2024-08-18T22:28:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f2877400640 1 -- 172.21.15.5:0/2913125661 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2870001a00 con 0x7f28780b40c0 2024-08-18T22:28:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 -- 172.21.15.5:0/2913125661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780b40c0 msgr2=0x7f28780b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 --2- 172.21.15.5:0/2913125661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780b40c0 0x7f28780b4500 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f28640097f0 tx=0x7f286401c2e0 comp rx=0 tx=0).stop 2024-08-18T22:28:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 -- 172.21.15.5:0/2913125661 shutdown_connections 2024-08-18T22:28:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 --2- 172.21.15.5:0/2913125661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780b40c0 0x7f28780b4500 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 -- 172.21.15.5:0/2913125661 >> 172.21.15.5:0/2913125661 conn(0x7f28780b1dc0 msgr2=0x7f28780b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 -- 172.21.15.5:0/2913125661 shutdown_connections 2024-08-18T22:28:59.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 -- 172.21.15.5:0/2913125661 wait complete. 2024-08-18T22:28:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 Processor -- start 2024-08-18T22:28:59.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 -- start start 2024-08-18T22:28:59.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28780b40c0 0x7f2878152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:59.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780ce280 0x7f287814b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:59.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f287815b0c0 0x7f2878145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:59.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f287806e590 con 0x7f28780b40c0 2024-08-18T22:28:59.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f287806e410 con 0x7f287815b0c0 2024-08-18T22:28:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f287806e710 con 0x7f28780ce280 2024-08-18T22:28:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28780b40c0 0x7f2878152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28780b40c0 0x7f2878152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35844/0 (socket says 172.21.15.5:35844) 2024-08-18T22:28:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.363+0000 7f287cc00640 1 -- 172.21.15.5:0/3403415812 learned_addr learned my addr 172.21.15.5:0/3403415812 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:28:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f287cc00640 1 -- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780ce280 msgr2=0x7f287814b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f2877e00640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780ce280 0x7f287814b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f287cc00640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780ce280 0x7f287814b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f287d600640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f287815b0c0 0x7f2878145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f287cc00640 1 -- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f287815b0c0 msgr2=0x7f2878145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f287cc00640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f287815b0c0 0x7f2878145220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f287cc00640 1 -- 172.21.15.5:0/3403415812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2878149090 con 0x7f28780b40c0 2024-08-18T22:28:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f2877e00640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780ce280 0x7f287814b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f287d600640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f287815b0c0 0x7f2878145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:28:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f287cc00640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28780b40c0 0x7f2878152060 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f286800c430 tx=0x7f286800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f2874c00640 1 -- 172.21.15.5:0/3403415812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868017070 con 0x7f28780b40c0 2024-08-18T22:28:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f2874c00640 1 -- 172.21.15.5:0/3403415812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28680052f0 con 0x7f28780b40c0 2024-08-18T22:28:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f2874c00640 1 -- 172.21.15.5:0/3403415812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868003840 con 0x7f28780b40c0 2024-08-18T22:28:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f287f600640 1 -- 172.21.15.5:0/3403415812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2878149370 con 0x7f28780b40c0 2024-08-18T22:28:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f287f600640 1 -- 172.21.15.5:0/3403415812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2878149930 con 0x7f28780b40c0 2024-08-18T22:28:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f287f600640 1 -- 172.21.15.5:0/3403415812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28780b4500 con 0x7f28780b40c0 2024-08-18T22:28:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f2874c00640 1 -- 172.21.15.5:0/3403415812 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f286801a070 con 0x7f28780b40c0 2024-08-18T22:28:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f2874c00640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28580678c0 0x7f2858069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:28:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.367+0000 7f2874c00640 1 -- 172.21.15.5:0/3403415812 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f28680852e0 con 0x7f28780b40c0 2024-08-18T22:28:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.371+0000 7f2877e00640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28580678c0 0x7f2858069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:28:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.371+0000 7f2877e00640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28580678c0 0x7f2858069d80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f28640ad000 tx=0x7f2864008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:28:59.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.371+0000 7f2874c00640 1 -- 172.21.15.5:0/3403415812 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2868055bf0 con 0x7f28780b40c0 2024-08-18T22:28:59.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.551+0000 7f287f600640 1 -- 172.21.15.5:0/3403415812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2878073660 con 0x7f28780b40c0 2024-08-18T22:28:59.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.551+0000 7f2874c00640 1 -- 172.21.15.5:0/3403415812 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v141) ==== 80+0+0 (secure 0 0 0) 0x7f28680554f0 con 0x7f28780b40c0 2024-08-18T22:28:59.553 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:28:59.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 -- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28580678c0 msgr2=0x7f2858069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:59.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28580678c0 0x7f2858069d80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f28640ad000 tx=0x7f2864008040 comp rx=0 tx=0).stop 2024-08-18T22:28:59.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 -- 172.21.15.5:0/3403415812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28780b40c0 msgr2=0x7f2878152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:28:59.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28780b40c0 0x7f2878152060 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f286800c430 tx=0x7f286800c8f0 comp rx=0 tx=0).stop 2024-08-18T22:28:59.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 -- 172.21.15.5:0/3403415812 shutdown_connections 2024-08-18T22:28:59.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28580678c0 0x7f2858069d80 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:59.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f287815b0c0 0x7f2878145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:59.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28780ce280 0x7f287814b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:59.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 --2- 172.21.15.5:0/3403415812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28780b40c0 0x7f2878152060 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:28:59.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 -- 172.21.15.5:0/3403415812 >> 172.21.15.5:0/3403415812 conn(0x7f28780b1dc0 msgr2=0x7f2878072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:28:59.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 -- 172.21.15.5:0/3403415812 shutdown_connections 2024-08-18T22:28:59.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:28:59.555+0000 7f287f600640 1 -- 172.21.15.5:0/3403415812 wait complete. 2024-08-18T22:28:59.575 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:28:59.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:28:59.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:29:00.324 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:29:00.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:00.324 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:29:00.340 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:29:00.341 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:29:00.341 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:29:00.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:29:00.350 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:29:00.350 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:29:00.350 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:29:00.390 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:29:00.390 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:29:00.390 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:29:00.390 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:29:00.404 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:29:00.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.571+0000 7f5d7e600640 1 Processor -- start 2024-08-18T22:29:00.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.571+0000 7f5d7e600640 1 -- start start 2024-08-18T22:29:00.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d7e600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5d7815e460 0x7f5d7806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d7e600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d780ca3e0 0x7f5d780ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d7e600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d7815e840 con 0x7f5d780cee40 2024-08-18T22:29:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d7e600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5d780ae750 con 0x7f5d780ca3e0 2024-08-18T22:29:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d7e600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5d7806c900 con 0x7f5d7815e460 2024-08-18T22:29:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d77e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d780ca3e0 0x7f5d780ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d6ea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5d780cee40 0x7f5d780ae040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41804/0 (socket says 172.21.15.5:41804) 2024-08-18T22:29:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d6ea00640 1 -- 172.21.15.5:0/3681961773 learned_addr learned my addr 172.21.15.5:0/3681961773 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:00.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d77400640 1 --2- 172.21.15.5:0/3681961773 >> v2:172.21.15.117:3300/0 conn(0x7f5d7815e460 0x7f5d7806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d77e00640 1 -- 172.21.15.5:0/3681961773 >> v2:172.21.15.117:3300/0 conn(0x7f5d7815e460 msgr2=0x7f5d7806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d77e00640 1 --2- 172.21.15.5:0/3681961773 >> v2:172.21.15.117:3300/0 conn(0x7f5d7815e460 0x7f5d7806c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d77e00640 1 -- 172.21.15.5:0/3681961773 >> v1:172.21.15.5:6789/0 conn(0x7f5d780cee40 legacy=0x7f5d780ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d77e00640 1 -- 172.21.15.5:0/3681961773 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d780cf320 con 0x7f5d780ca3e0 2024-08-18T22:29:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d76a00640 1 -- 172.21.15.5:0/3681961773 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531878272 0 0) 0x7f5d7815e840 con 0x7f5d780cee40 2024-08-18T22:29:00.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.575+0000 7f5d77400640 1 --2- 172.21.15.5:0/3681961773 >> v2:172.21.15.117:3300/0 conn(0x7f5d7815e460 0x7f5d7806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:00.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d77e00640 1 --2- 172.21.15.5:0/3681961773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d780ca3e0 0x7f5d780ca890 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f5d780ceb50 tx=0x7f5d7001f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b44c38f5219687 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:00.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d76a00640 1 -- 172.21.15.5:0/3681961773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d700b4070 con 0x7f5d780ca3e0 2024-08-18T22:29:00.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d76a00640 1 -- 172.21.15.5:0/3681961773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d700af600 con 0x7f5d780ca3e0 2024-08-18T22:29:00.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d76a00640 1 -- 172.21.15.5:0/3681961773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d700af9d0 con 0x7f5d780ca3e0 2024-08-18T22:29:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 -- 172.21.15.5:0/3681961773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d780ca3e0 msgr2=0x7f5d780ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 --2- 172.21.15.5:0/3681961773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d780ca3e0 0x7f5d780ca890 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f5d780ceb50 tx=0x7f5d7001f110 comp rx=0 tx=0).stop 2024-08-18T22:29:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 -- 172.21.15.5:0/3681961773 shutdown_connections 2024-08-18T22:29:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 --2- 172.21.15.5:0/3681961773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d780ca3e0 0x7f5d780ca890 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 --2- 172.21.15.5:0/3681961773 >> v2:172.21.15.117:3300/0 conn(0x7f5d7815e460 0x7f5d7806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 -- 172.21.15.5:0/3681961773 >> 172.21.15.5:0/3681961773 conn(0x7f5d7809aa40 msgr2=0x7f5d780b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:00.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 -- 172.21.15.5:0/3681961773 shutdown_connections 2024-08-18T22:29:00.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 -- 172.21.15.5:0/3681961773 wait complete. 2024-08-18T22:29:00.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 Processor -- start 2024-08-18T22:29:00.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 -- start start 2024-08-18T22:29:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d780ca3e0 0x7f5d78146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d780cee40 0x7f5d7815bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7815e460 0x7f5d78146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5d780cfbc0 con 0x7f5d7815e460 2024-08-18T22:29:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5d780cf8e0 con 0x7f5d780cee40 2024-08-18T22:29:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.579+0000 7f5d7e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5d780cfea0 con 0x7f5d780ca3e0 2024-08-18T22:29:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d77e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7815e460 0x7f5d78146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d77e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7815e460 0x7f5d78146b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35860/0 (socket says 172.21.15.5:35860) 2024-08-18T22:29:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d77e00640 1 -- 172.21.15.5:0/995103047 learned_addr learned my addr 172.21.15.5:0/995103047 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d77400640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d780ca3e0 0x7f5d78146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d6ea00640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d780cee40 0x7f5d7815bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d77e00640 1 -- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d780ca3e0 msgr2=0x7f5d78146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d77e00640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d780ca3e0 0x7f5d78146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d77e00640 1 -- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d780cee40 msgr2=0x7f5d7815bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d77e00640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d780cee40 0x7f5d7815bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d77e00640 1 -- 172.21.15.5:0/995103047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d780cc650 con 0x7f5d7815e460 2024-08-18T22:29:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d6ea00640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d780cee40 0x7f5d7815bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d77e00640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7815e460 0x7f5d78146b40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f5d7001bd20 tx=0x7f5d7001beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d6fe00640 1 -- 172.21.15.5:0/995103047 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d700b4040 con 0x7f5d7815e460 2024-08-18T22:29:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d6fe00640 1 -- 172.21.15.5:0/995103047 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d700c1070 con 0x7f5d7815e460 2024-08-18T22:29:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d6fe00640 1 -- 172.21.15.5:0/995103047 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70009450 con 0x7f5d7815e460 2024-08-18T22:29:00.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d7e600640 1 -- 172.21.15.5:0/995103047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d780cc8f0 con 0x7f5d7815e460 2024-08-18T22:29:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d7e600640 1 -- 172.21.15.5:0/995103047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d780cceb0 con 0x7f5d7815e460 2024-08-18T22:29:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d7e600640 1 -- 172.21.15.5:0/995103047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d780b3620 con 0x7f5d7815e460 2024-08-18T22:29:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d6fe00640 1 -- 172.21.15.5:0/995103047 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5d700ba6b0 con 0x7f5d7815e460 2024-08-18T22:29:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.583+0000 7f5d6fe00640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d540678c0 0x7f5d54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.587+0000 7f5d6fe00640 1 -- 172.21.15.5:0/995103047 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f5d70124850 con 0x7f5d7815e460 2024-08-18T22:29:00.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.587+0000 7f5d77400640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d540678c0 0x7f5d54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.587+0000 7f5d77400640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d540678c0 0x7f5d54069d80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5d780ce390 tx=0x7f5d68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.591+0000 7f5d6fe00640 1 -- 172.21.15.5:0/995103047 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5d70018c70 con 0x7f5d7815e460 2024-08-18T22:29:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.791+0000 7f5d7e600640 1 -- 172.21.15.5:0/995103047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d780d19e0 con 0x7f5d7815e460 2024-08-18T22:29:00.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d6fe00640 1 -- 172.21.15.5:0/995103047 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5231 (secure 0 0 0) 0x7f5d700f51f0 con 0x7f5d7815e460 2024-08-18T22:29:00.795 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:00.795 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:28:21.056377+0000","modified":"2024-08-18T22:28:24.121089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1373218784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1373218784},{"type":"v1","addr":"172.21.15.5:6833","nonce":1373218784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8565,"qdb_cluster":[8565]},"id":9}]} 2024-08-18T22:29:00.795 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 108 2024-08-18T22:29:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 -- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d540678c0 msgr2=0x7f5d54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:00.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d540678c0 0x7f5d54069d80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5d780ce390 tx=0x7f5d68008040 comp rx=0 tx=0).stop 2024-08-18T22:29:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 -- 172.21.15.5:0/995103047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7815e460 msgr2=0x7f5d78146b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7815e460 0x7f5d78146b40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f5d7001bd20 tx=0x7f5d7001beb0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 -- 172.21.15.5:0/995103047 shutdown_connections 2024-08-18T22:29:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d540678c0 0x7f5d54069d80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d7815e460 0x7f5d78146b40 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d780cee40 0x7f5d7815bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 --2- 172.21.15.5:0/995103047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d780ca3e0 0x7f5d78146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 -- 172.21.15.5:0/995103047 >> 172.21.15.5:0/995103047 conn(0x7f5d7809aa40 msgr2=0x7f5d780aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 -- 172.21.15.5:0/995103047 shutdown_connections 2024-08-18T22:29:00.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.795+0000 7f5d7e600640 1 -- 172.21.15.5:0/995103047 wait complete. 2024-08-18T22:29:00.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00e6200640 1 Processor -- start 2024-08-18T22:29:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00e6200640 1 -- start start 2024-08-18T22:29:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00e6200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e00b4510 0x7f00e015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00e6200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e00ccd90 con 0x7f00e00cde30 2024-08-18T22:29:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00e6200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e00cd070 con 0x7f00e009aa40 2024-08-18T22:29:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00e6200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f00e00ce770 con 0x7f00e00b4510 2024-08-18T22:29:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00d7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f00e00cde30 0x7f00e00cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41818/0 (socket says 172.21.15.5:41818) 2024-08-18T22:29:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00d7e00640 1 -- 172.21.15.5:0/3364549864 learned_addr learned my addr 172.21.15.5:0/3364549864 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00e5800640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e00b4510 0x7f00e015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3170903840 0 0) 0x7f00e00ccd90 con 0x7f00e00cde30 2024-08-18T22:29:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00c4003530 con 0x7f00e00cde30 2024-08-18T22:29:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1990221948 0 0) 0x7f00c4003530 con 0x7f00e00cde30 2024-08-18T22:29:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e00b4510 msgr2=0x7f00e015cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e00b4510 0x7f00e015cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 >> v1:172.21.15.117:6789/0 conn(0x7f00e009aa40 legacy=0x7f00e009ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e00cd350 con 0x7f00e00cde30 2024-08-18T22:29:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f00c8001680 con 0x7f00e00cde30 2024-08-18T22:29:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 >> v1:172.21.15.5:6789/0 conn(0x7f00e00cde30 legacy=0x7f00e00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e00b4510 0x7f00c40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00c4003f30 0x7f00c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c4004d50 0x7f00c40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f00e00ce770 con 0x7f00c4003f30 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f00c400ba30 con 0x7f00c4004d50 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f00c400bc30 con 0x7f00e00b4510 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00d7e00640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00c4003f30 0x7f00c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00e4e00640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e00b4510 0x7f00c40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00e5800640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c4004d50 0x7f00c40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00d7e00640 1 -- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e00b4510 msgr2=0x7f00c40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00d7e00640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e00b4510 0x7f00c40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00d7e00640 1 -- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c4004d50 msgr2=0x7f00c40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00d7e00640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c4004d50 0x7f00c40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00d7e00640 1 -- 172.21.15.5:0/3364549864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c4003530 con 0x7f00c4003f30 2024-08-18T22:29:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00e5800640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c4004d50 0x7f00c40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.959+0000 7f00e4e00640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00e00b4510 0x7f00c40039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.963+0000 7f00d7e00640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00c4003f30 0x7f00c4004810 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f00c800c190 tx=0x7f00c801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667b4dae38662fa9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.963+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c8007cd0 con 0x7f00c4003f30 2024-08-18T22:29:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.963+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c80a9070 con 0x7f00c4003f30 2024-08-18T22:29:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.963+0000 7f00dfe00640 1 -- 172.21.15.5:0/3364549864 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c8005d60 con 0x7f00c4003f30 2024-08-18T22:29:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.963+0000 7f00e6200640 1 -- 172.21.15.5:0/3364549864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00c4003f30 msgr2=0x7f00c4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.963+0000 7f00e6200640 1 --2- 172.21.15.5:0/3364549864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00c4003f30 0x7f00c4004810 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f00c800c190 tx=0x7f00c801cb60 comp rx=0 tx=0).stop 2024-08-18T22:29:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.963+0000 7f00e5800640 1 -- 172.21.15.5:0/3364549864 reap_dead start 2024-08-18T22:29:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.963+0000 7f00e6200640 1 -- 172.21.15.5:0/3364549864 shutdown_connections 2024-08-18T22:29:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.963+0000 7f00e6200640 1 -- 172.21.15.5:0/3364549864 >> 172.21.15.5:0/3364549864 conn(0x7f00e00b3a20 msgr2=0x7f00e00b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.963+0000 7f00e6200640 1 -- 172.21.15.5:0/3364549864 shutdown_connections 2024-08-18T22:29:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.963+0000 7f00e6200640 1 -- 172.21.15.5:0/3364549864 wait complete. 2024-08-18T22:29:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e6200640 1 Processor -- start 2024-08-18T22:29:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e6200640 1 -- start start 2024-08-18T22:29:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e6200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c4003f30 0x7f00e006dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e0156ff0 0x7f00e0157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e6200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00e0159670 0x7f00e0159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e6200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f00e015c230 con 0x7f00e0156ff0 2024-08-18T22:29:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e6200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f00e00cd910 con 0x7f00e0159670 2024-08-18T22:29:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e6200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f00e015c3b0 con 0x7f00c4003f30 2024-08-18T22:29:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00d7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e0156ff0 0x7f00e0157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00d7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e0156ff0 0x7f00e0157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35876/0 (socket says 172.21.15.5:35876) 2024-08-18T22:29:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00d7e00640 1 -- 172.21.15.5:0/3639760148 learned_addr learned my addr 172.21.15.5:0/3639760148 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e4e00640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c4003f30 0x7f00e006dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e5800640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00e0159670 0x7f00e0159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00d7e00640 1 -- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c4003f30 msgr2=0x7f00e006dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00d7e00640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c4003f30 0x7f00e006dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00d7e00640 1 -- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00e0159670 msgr2=0x7f00e0159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00d7e00640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00e0159670 0x7f00e0159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00d7e00640 1 -- 172.21.15.5:0/3639760148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e00b1040 con 0x7f00e0156ff0 2024-08-18T22:29:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00d7e00640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e0156ff0 0x7f00e0157470 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f00c801c990 tx=0x7f00c4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00dd600640 1 -- 172.21.15.5:0/3639760148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c8007cd0 con 0x7f00e0156ff0 2024-08-18T22:29:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00dd600640 1 -- 172.21.15.5:0/3639760148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c80a6d30 con 0x7f00e0156ff0 2024-08-18T22:29:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00dd600640 1 -- 172.21.15.5:0/3639760148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c8004a10 con 0x7f00e0156ff0 2024-08-18T22:29:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e6200640 1 -- 172.21.15.5:0/3639760148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e01579b0 con 0x7f00e0156ff0 2024-08-18T22:29:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.967+0000 7f00e6200640 1 -- 172.21.15.5:0/3639760148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e0158300 con 0x7f00e0156ff0 2024-08-18T22:29:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.971+0000 7f00e6200640 1 -- 172.21.15.5:0/3639760148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e015cfe0 con 0x7f00e0156ff0 2024-08-18T22:29:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.971+0000 7f00dd600640 1 -- 172.21.15.5:0/3639760148 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00c8004bb0 con 0x7f00e0156ff0 2024-08-18T22:29:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.971+0000 7f00dd600640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f00bc0678f0 0x7f00bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.971+0000 7f00dd600640 1 -- 172.21.15.5:0/3639760148 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f00c811fe40 con 0x7f00e0156ff0 2024-08-18T22:29:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.971+0000 7f00e4e00640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f00bc0678f0 0x7f00bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.971+0000 7f00e4e00640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f00bc0678f0 0x7f00bc069db0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f00e0159600 tx=0x7f00d0001330 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:00.975+0000 7f00dd600640 1 -- 172.21.15.5:0/3639760148 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f00e01579b0 con 0x7f00e0156ff0 2024-08-18T22:29:01.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 -- 172.21.15.5:0/3639760148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00e0073d40 con 0x7f00e0156ff0 2024-08-18T22:29:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00dd600640 1 -- 172.21.15.5:0/3639760148 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5231 (secure 0 0 0) 0x7f00c8016870 con 0x7f00e0156ff0 2024-08-18T22:29:01.175 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:01.176 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:28:21.056377+0000","modified":"2024-08-18T22:28:24.121089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1373218784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1373218784},{"type":"v1","addr":"172.21.15.5:6833","nonce":1373218784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8565,"qdb_cluster":[8565]},"id":9}]} 2024-08-18T22:29:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 108 2024-08-18T22:29:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 -- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f00bc0678f0 msgr2=0x7f00bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f00bc0678f0 0x7f00bc069db0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f00e0159600 tx=0x7f00d0001330 comp rx=0 tx=0).stop 2024-08-18T22:29:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 -- 172.21.15.5:0/3639760148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e0156ff0 msgr2=0x7f00e0157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e0156ff0 0x7f00e0157470 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f00c801c990 tx=0x7f00c4005840 comp rx=0 tx=0).stop 2024-08-18T22:29:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 -- 172.21.15.5:0/3639760148 shutdown_connections 2024-08-18T22:29:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f00bc0678f0 0x7f00bc069db0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00e0159670 0x7f00e0159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e0156ff0 0x7f00e0157470 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 --2- 172.21.15.5:0/3639760148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c4003f30 0x7f00e006dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 -- 172.21.15.5:0/3639760148 >> 172.21.15.5:0/3639760148 conn(0x7f00e00b3a20 msgr2=0x7f00e0070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 -- 172.21.15.5:0/3639760148 shutdown_connections 2024-08-18T22:29:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.175+0000 7f00e6200640 1 -- 172.21.15.5:0/3639760148 wait complete. 2024-08-18T22:29:01.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:29:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.335+0000 7f9d47600640 1 Processor -- start 2024-08-18T22:29:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.335+0000 7f9d47600640 1 -- start start 2024-08-18T22:29:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.335+0000 7f9d47600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d400cb390 0x7f9d400735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.335+0000 7f9d47600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d4006da70 0x7f9d4006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.335+0000 7f9d47600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d40073c80 con 0x7f9d4015bed0 2024-08-18T22:29:01.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.335+0000 7f9d47600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9d4006e3e0 con 0x7f9d400cb390 2024-08-18T22:29:01.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.335+0000 7f9d47600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9d400ca5d0 con 0x7f9d4006da70 2024-08-18T22:29:01.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.335+0000 7f9d3fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9d400cb390 0x7f9d400735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.335+0000 7f9d44c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9d4015bed0 0x7f9d40071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41824/0 (socket says 172.21.15.5:41824) 2024-08-18T22:29:01.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.335+0000 7f9d44c00640 1 -- 172.21.15.5:0/3376474336 learned_addr learned my addr 172.21.15.5:0/3376474336 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.339+0000 7f9d45600640 1 --2- 172.21.15.5:0/3376474336 >> v2:172.21.15.117:3300/0 conn(0x7f9d4006da70 0x7f9d4006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.339+0000 7f9d3fe00640 1 -- 172.21.15.5:0/3376474336 >> v2:172.21.15.117:3300/0 conn(0x7f9d4006da70 msgr2=0x7f9d4006dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.339+0000 7f9d3fe00640 1 --2- 172.21.15.5:0/3376474336 >> v2:172.21.15.117:3300/0 conn(0x7f9d4006da70 0x7f9d4006dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.339+0000 7f9d3fe00640 1 -- 172.21.15.5:0/3376474336 >> v1:172.21.15.5:6789/0 conn(0x7f9d4015bed0 legacy=0x7f9d40071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.339+0000 7f9d3fe00640 1 -- 172.21.15.5:0/3376474336 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d400ca8b0 con 0x7f9d400cb390 2024-08-18T22:29:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.339+0000 7f9d3f400640 1 -- 172.21.15.5:0/3376474336 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216683321 0 0) 0x7f9d40073c80 con 0x7f9d4015bed0 2024-08-18T22:29:01.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.339+0000 7f9d3fe00640 1 --2- 172.21.15.5:0/3376474336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d400cb390 0x7f9d400735a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f9d400cfe50 tx=0x7f9d2c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9276ea1b306b289 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:01.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.339+0000 7f9d3f400640 1 -- 172.21.15.5:0/3376474336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0ab650 con 0x7f9d400cb390 2024-08-18T22:29:01.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.339+0000 7f9d3f400640 1 -- 172.21.15.5:0/3376474336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0b0070 con 0x7f9d400cb390 2024-08-18T22:29:01.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.339+0000 7f9d3f400640 1 -- 172.21.15.5:0/3376474336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0aba10 con 0x7f9d400cb390 2024-08-18T22:29:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 -- 172.21.15.5:0/3376474336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d400cb390 msgr2=0x7f9d400735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 --2- 172.21.15.5:0/3376474336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d400cb390 0x7f9d400735a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f9d400cfe50 tx=0x7f9d2c01c450 comp rx=0 tx=0).stop 2024-08-18T22:29:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 -- 172.21.15.5:0/3376474336 shutdown_connections 2024-08-18T22:29:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 --2- 172.21.15.5:0/3376474336 >> v2:172.21.15.117:3300/0 conn(0x7f9d4006da70 0x7f9d4006dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 --2- 172.21.15.5:0/3376474336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d400cb390 0x7f9d400735a0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 -- 172.21.15.5:0/3376474336 >> 172.21.15.5:0/3376474336 conn(0x7f9d400b1c50 msgr2=0x7f9d400b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 -- 172.21.15.5:0/3376474336 shutdown_connections 2024-08-18T22:29:01.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 -- 172.21.15.5:0/3376474336 wait complete. 2024-08-18T22:29:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 Processor -- start 2024-08-18T22:29:01.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 -- start start 2024-08-18T22:29:01.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d4006da70 0x7f9d400ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d400cb390 0x7f9d40150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d4015bed0 0x7f9d40150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9d40168520 con 0x7f9d400cb390 2024-08-18T22:29:01.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9d401683a0 con 0x7f9d4015bed0 2024-08-18T22:29:01.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d47600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9d401686a0 con 0x7f9d4006da70 2024-08-18T22:29:01.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d3fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d400cb390 0x7f9d40150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d3fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d400cb390 0x7f9d40150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35894/0 (socket says 172.21.15.5:35894) 2024-08-18T22:29:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d3fe00640 1 -- 172.21.15.5:0/531080495 learned_addr learned my addr 172.21.15.5:0/531080495 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d45600640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d4015bed0 0x7f9d40150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d44c00640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d4006da70 0x7f9d400ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d3fe00640 1 -- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d4006da70 msgr2=0x7f9d400ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d3fe00640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d4006da70 0x7f9d400ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d3fe00640 1 -- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d4015bed0 msgr2=0x7f9d40150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d3fe00640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d4015bed0 0x7f9d40150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d3fe00640 1 -- 172.21.15.5:0/531080495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d400adb70 con 0x7f9d400cb390 2024-08-18T22:29:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.343+0000 7f9d3fe00640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d400cb390 0x7f9d40150690 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0ad040 tx=0x7f9d2c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.347+0000 7f9d3cc00640 1 -- 172.21.15.5:0/531080495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c004230 con 0x7f9d400cb390 2024-08-18T22:29:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.347+0000 7f9d3cc00640 1 -- 172.21.15.5:0/531080495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0043d0 con 0x7f9d400cb390 2024-08-18T22:29:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.347+0000 7f9d3cc00640 1 -- 172.21.15.5:0/531080495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c003820 con 0x7f9d400cb390 2024-08-18T22:29:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.347+0000 7f9d47600640 1 -- 172.21.15.5:0/531080495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d400ade50 con 0x7f9d400cb390 2024-08-18T22:29:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.347+0000 7f9d47600640 1 -- 172.21.15.5:0/531080495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d400ae410 con 0x7f9d400cb390 2024-08-18T22:29:01.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.347+0000 7f9d47600640 1 -- 172.21.15.5:0/531080495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d4014e6d0 con 0x7f9d400cb390 2024-08-18T22:29:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.347+0000 7f9d3cc00640 1 -- 172.21.15.5:0/531080495 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d2c0039c0 con 0x7f9d400cb390 2024-08-18T22:29:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.347+0000 7f9d3cc00640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d200678c0 0x7f9d20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.347+0000 7f9d3cc00640 1 -- 172.21.15.5:0/531080495 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f9d2c120a10 con 0x7f9d400cb390 2024-08-18T22:29:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.347+0000 7f9d44c00640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d200678c0 0x7f9d20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.351+0000 7f9d44c00640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d200678c0 0x7f9d20069d80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9d30000f70 tx=0x7f9d30007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:01.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.351+0000 7f9d3cc00640 1 -- 172.21.15.5:0/531080495 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9d4014e6d0 con 0x7f9d400cb390 2024-08-18T22:29:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.519+0000 7f9d47600640 1 -- 172.21.15.5:0/531080495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d4006dea0 con 0x7f9d400cb390 2024-08-18T22:29:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.519+0000 7f9d3cc00640 1 -- 172.21.15.5:0/531080495 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16828 (secure 0 0 0) 0x7f9d2c016070 con 0x7f9d400cb390 2024-08-18T22:29:01.520 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:01.520 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":141,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:28:22.652816+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:28:18.813860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-08-18T22:28:20.061149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 -- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d200678c0 msgr2=0x7f9d20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d200678c0 0x7f9d20069d80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9d30000f70 tx=0x7f9d30007c10 comp rx=0 tx=0).stop 2024-08-18T22:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 -- 172.21.15.5:0/531080495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d400cb390 msgr2=0x7f9d40150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d400cb390 0x7f9d40150690 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0ad040 tx=0x7f9d2c01ac90 comp rx=0 tx=0).stop 2024-08-18T22:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 -- 172.21.15.5:0/531080495 shutdown_connections 2024-08-18T22:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9d200678c0 0x7f9d20069d80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d4015bed0 0x7f9d40150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d400cb390 0x7f9d40150690 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 --2- 172.21.15.5:0/531080495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d4006da70 0x7f9d400ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 -- 172.21.15.5:0/531080495 >> 172.21.15.5:0/531080495 conn(0x7f9d400b1c50 msgr2=0x7f9d400cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 -- 172.21.15.5:0/531080495 shutdown_connections 2024-08-18T22:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.523+0000 7f9d47600640 1 -- 172.21.15.5:0/531080495 wait complete. 2024-08-18T22:29:01.544 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:29:01.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.687+0000 7f1f31200640 1 Processor -- start 2024-08-18T22:29:01.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.687+0000 7f1f31200640 1 -- start start 2024-08-18T22:29:01.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.687+0000 7f1f31200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1f2c13f020 0x7f1f2c0d2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.687+0000 7f1f31200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f2c0d2850 0x7f1f2c0d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.687+0000 7f1f31200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f2c141770 con 0x7f1f2c13ec40 2024-08-18T22:29:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.687+0000 7f1f31200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1f2c142380 con 0x7f1f2c13f020 2024-08-18T22:29:01.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.687+0000 7f1f31200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2c141a50 con 0x7f1f2c0d2850 2024-08-18T22:29:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2aa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1f2c13f020 0x7f1f2c0d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f2c0d2850 0x7f1f2c0d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2aa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1f2c13f020 0x7f1f2c0d2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:37718/0 (socket says 172.21.15.5:37718) 2024-08-18T22:29:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2aa00640 1 -- 172.21.15.5:0/2409292701 learned_addr learned my addr 172.21.15.5:0/2409292701 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2b400640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1f2c13ec40 0x7f1f2c15cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:59368/0 (socket says 172.21.15.5:59368) 2024-08-18T22:29:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2aa00640 1 -- 172.21.15.5:0/2409292701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f2c0d2850 msgr2=0x7f1f2c0d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2aa00640 1 --2- 172.21.15.5:0/2409292701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f2c0d2850 0x7f1f2c0d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2aa00640 1 -- 172.21.15.5:0/2409292701 >> v1:172.21.15.117:6789/0 conn(0x7f1f2c13ec40 legacy=0x7f1f2c15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2aa00640 1 -- 172.21.15.5:0/2409292701 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c141d30 con 0x7f1f2c13f020 2024-08-18T22:29:01.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2a000640 1 -- 172.21.15.5:0/2409292701 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191845120 0 0) 0x7f1f2c141770 con 0x7f1f2c13ec40 2024-08-18T22:29:01.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2be00640 1 --2- 172.21.15.5:0/2409292701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f2c0d2850 0x7f1f2c0d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:01.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.691+0000 7f1f2aa00640 1 --2- 172.21.15.5:0/2409292701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f2c13f020 0x7f1f2c0d2310 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009870 tx=0x7f1f1801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ef84e26c3c656c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:01.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f2a000640 1 -- 172.21.15.5:0/2409292701 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f180b2070 con 0x7f1f2c13f020 2024-08-18T22:29:01.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f2a000640 1 -- 172.21.15.5:0/2409292701 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f180a9070 con 0x7f1f2c13f020 2024-08-18T22:29:01.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f2a000640 1 -- 172.21.15.5:0/2409292701 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f180ad880 con 0x7f1f2c13f020 2024-08-18T22:29:01.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 -- 172.21.15.5:0/2409292701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f2c13f020 msgr2=0x7f1f2c0d2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 --2- 172.21.15.5:0/2409292701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f2c13f020 0x7f1f2c0d2310 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009870 tx=0x7f1f1801c560 comp rx=0 tx=0).stop 2024-08-18T22:29:01.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 -- 172.21.15.5:0/2409292701 shutdown_connections 2024-08-18T22:29:01.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 --2- 172.21.15.5:0/2409292701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f2c0d2850 0x7f1f2c0d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 --2- 172.21.15.5:0/2409292701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f2c13f020 0x7f1f2c0d2310 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 -- 172.21.15.5:0/2409292701 >> 172.21.15.5:0/2409292701 conn(0x7f1f2c067840 msgr2=0x7f1f2c067c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:01.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 -- 172.21.15.5:0/2409292701 shutdown_connections 2024-08-18T22:29:01.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 -- 172.21.15.5:0/2409292701 wait complete. 2024-08-18T22:29:01.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 Processor -- start 2024-08-18T22:29:01.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 -- start start 2024-08-18T22:29:01.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f2c0d2850 0x7f1f2c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f2c13ec40 0x7f1f2c156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2c13f020 0x7f1f2c15bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c0d1c70 con 0x7f1f2c13f020 2024-08-18T22:29:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c0d1af0 con 0x7f1f2c0d2850 2024-08-18T22:29:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f31200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2c0d1df0 con 0x7f1f2c13ec40 2024-08-18T22:29:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f2be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2c13f020 0x7f1f2c15bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f2be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2c13f020 0x7f1f2c15bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35908/0 (socket says 172.21.15.5:35908) 2024-08-18T22:29:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f2be00640 1 -- 172.21.15.5:0/1502600258 learned_addr learned my addr 172.21.15.5:0/1502600258 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f2aa00640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f2c13ec40 0x7f1f2c156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.695+0000 7f1f2b400640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f2c0d2850 0x7f1f2c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f2be00640 1 -- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f2c13ec40 msgr2=0x7f1f2c156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f2be00640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f2c13ec40 0x7f1f2c156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f2be00640 1 -- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f2c0d2850 msgr2=0x7f1f2c15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f2be00640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f2c0d2850 0x7f1f2c15a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f2be00640 1 -- 172.21.15.5:0/1502600258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c15ad10 con 0x7f1f2c13f020 2024-08-18T22:29:01.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f2be00640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2c13f020 0x7f1f2c15bdb0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400efc0 tx=0x7f1f24009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:01.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f23400640 1 -- 172.21.15.5:0/1502600258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24018030 con 0x7f1f2c13f020 2024-08-18T22:29:01.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f23400640 1 -- 172.21.15.5:0/1502600258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2400cde0 con 0x7f1f2c13f020 2024-08-18T22:29:01.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f23400640 1 -- 172.21.15.5:0/1502600258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24003bc0 con 0x7f1f2c13f020 2024-08-18T22:29:01.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f31200640 1 -- 172.21.15.5:0/1502600258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2c15aff0 con 0x7f1f2c13f020 2024-08-18T22:29:01.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f31200640 1 -- 172.21.15.5:0/1502600258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f2c15b5b0 con 0x7f1f2c13f020 2024-08-18T22:29:01.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f31200640 1 -- 172.21.15.5:0/1502600258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2c1414b0 con 0x7f1f2c13f020 2024-08-18T22:29:01.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f23400640 1 -- 172.21.15.5:0/1502600258 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f2401b070 con 0x7f1f2c13f020 2024-08-18T22:29:01.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f23400640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f0c0678c0 0x7f1f0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:01.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f23400640 1 -- 172.21.15.5:0/1502600258 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f1f24086790 con 0x7f1f2c13f020 2024-08-18T22:29:01.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.699+0000 7f1f2b400640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f0c0678c0 0x7f1f0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:01.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.703+0000 7f1f2b400640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f0c0678c0 0x7f1f0c069d80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c007fd0 tx=0x7f1f1c007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:01.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.703+0000 7f1f23400640 1 -- 172.21.15.5:0/1502600258 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1f24022070 con 0x7f1f2c13f020 2024-08-18T22:29:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.907+0000 7f1f31200640 1 -- 172.21.15.5:0/1502600258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f2c0d0b30 con 0x7f1f2c13f020 2024-08-18T22:29:01.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.907+0000 7f1f23400640 1 -- 172.21.15.5:0/1502600258 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5231 (secure 0 0 0) 0x7f1f24010040 con 0x7f1f2c13f020 2024-08-18T22:29:01.908 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:01.908 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:28:21.056377+0000","modified":"2024-08-18T22:28:24.121089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1373218784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1373218784},{"type":"v1","addr":"172.21.15.5:6833","nonce":1373218784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8565,"qdb_cluster":[8565]},"id":9}]} 2024-08-18T22:29:01.909 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 108 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 -- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f0c0678c0 msgr2=0x7f1f0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f0c0678c0 0x7f1f0c069d80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c007fd0 tx=0x7f1f1c007d60 comp rx=0 tx=0).stop 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 -- 172.21.15.5:0/1502600258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2c13f020 msgr2=0x7f1f2c15bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2c13f020 0x7f1f2c15bdb0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400efc0 tx=0x7f1f24009f90 comp rx=0 tx=0).stop 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 -- 172.21.15.5:0/1502600258 shutdown_connections 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1f0c0678c0 0x7f1f0c069d80 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2c13f020 0x7f1f2c15bdb0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f2c13ec40 0x7f1f2c156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 --2- 172.21.15.5:0/1502600258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f2c0d2850 0x7f1f2c15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 -- 172.21.15.5:0/1502600258 >> 172.21.15.5:0/1502600258 conn(0x7f1f2c067840 msgr2=0x7f1f2c0704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 -- 172.21.15.5:0/1502600258 shutdown_connections 2024-08-18T22:29:01.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:01.911+0000 7f1f31200640 1 -- 172.21.15.5:0/1502600258 wait complete. 2024-08-18T22:29:01.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:02.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.067+0000 7fc9d8400640 1 Processor -- start 2024-08-18T22:29:02.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.067+0000 7fc9d8400640 1 -- start start 2024-08-18T22:29:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d8400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9d015b010 0x7fc9d00ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d8400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9d006f290 0x7fc9d0072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d8400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9d00cee20 con 0x7fc9d00cd3a0 2024-08-18T22:29:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d8400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc9d00cfa30 con 0x7fc9d006f290 2024-08-18T22:29:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d8400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc9d00cf100 con 0x7fc9d015b010 2024-08-18T22:29:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d6400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9d006f290 0x7fc9d0072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d6400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9d006f290 0x7fc9d0072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35916/0 (socket says 172.21.15.5:35916) 2024-08-18T22:29:02.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d6400640 1 -- 172.21.15.5:0/1105199273 learned_addr learned my addr 172.21.15.5:0/1105199273 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d5a00640 1 --2- 172.21.15.5:0/1105199273 >> v2:172.21.15.117:3300/0 conn(0x7fc9d015b010 0x7fc9d00ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d6400640 1 -- 172.21.15.5:0/1105199273 >> v2:172.21.15.117:3300/0 conn(0x7fc9d015b010 msgr2=0x7fc9d00ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d6400640 1 --2- 172.21.15.5:0/1105199273 >> v2:172.21.15.117:3300/0 conn(0x7fc9d015b010 0x7fc9d00ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d6400640 1 -- 172.21.15.5:0/1105199273 >> v1:172.21.15.117:6789/0 conn(0x7fc9d00cd3a0 legacy=0x7fc9d006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.071+0000 7fc9d6400640 1 -- 172.21.15.5:0/1105199273 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d00cf3e0 con 0x7fc9d006f290 2024-08-18T22:29:02.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9d6400640 1 --2- 172.21.15.5:0/1105199273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9d006f290 0x7fc9d0072620 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00cfbb0 tx=0x7fc9c801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8b283d7fd1dcb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:02.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9cfe00640 1 -- 172.21.15.5:0/1105199273 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80a57b0 con 0x7fc9d006f290 2024-08-18T22:29:02.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9cfe00640 1 -- 172.21.15.5:0/1105199273 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c80a5950 con 0x7fc9d006f290 2024-08-18T22:29:02.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9cfe00640 1 -- 172.21.15.5:0/1105199273 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80a5d20 con 0x7fc9d006f290 2024-08-18T22:29:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9d8400640 1 -- 172.21.15.5:0/1105199273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9d006f290 msgr2=0x7fc9d0072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9d8400640 1 --2- 172.21.15.5:0/1105199273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9d006f290 0x7fc9d0072620 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00cfbb0 tx=0x7fc9c801c9c0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9d8400640 1 -- 172.21.15.5:0/1105199273 shutdown_connections 2024-08-18T22:29:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9d8400640 1 --2- 172.21.15.5:0/1105199273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9d006f290 0x7fc9d0072620 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9d8400640 1 --2- 172.21.15.5:0/1105199273 >> v2:172.21.15.117:3300/0 conn(0x7fc9d015b010 0x7fc9d00ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9d8400640 1 -- 172.21.15.5:0/1105199273 >> 172.21.15.5:0/1105199273 conn(0x7fc9d00b1c50 msgr2=0x7fc9d00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9d8400640 1 -- 172.21.15.5:0/1105199273 shutdown_connections 2024-08-18T22:29:02.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9d8400640 1 -- 172.21.15.5:0/1105199273 wait complete. 2024-08-18T22:29:02.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9d8400640 1 Processor -- start 2024-08-18T22:29:02.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.075+0000 7fc9d8400640 1 -- start start 2024-08-18T22:29:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d8400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d006f290 0x7fc9d0145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d8400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d00cd3a0 0x7fc9d015d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d8400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9d015b010 0x7fc9d015d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d8400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d00734f0 con 0x7fc9d015b010 2024-08-18T22:29:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d8400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d0073370 con 0x7fc9d006f290 2024-08-18T22:29:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d8400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d0073670 con 0x7fc9d00cd3a0 2024-08-18T22:29:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d6400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9d015b010 0x7fc9d015d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d5a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d006f290 0x7fc9d0145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d5a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d006f290 0x7fc9d0145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:37744/0 (socket says 172.21.15.5:37744) 2024-08-18T22:29:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d5000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d00cd3a0 0x7fc9d015d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d5a00640 1 -- 172.21.15.5:0/2167404062 learned_addr learned my addr 172.21.15.5:0/2167404062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d6400640 1 -- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d00cd3a0 msgr2=0x7fc9d015d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d6400640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d00cd3a0 0x7fc9d015d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d6400640 1 -- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d006f290 msgr2=0x7fc9d0145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d6400640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d006f290 0x7fc9d0145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d6400640 1 -- 172.21.15.5:0/2167404062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d015ded0 con 0x7fc9d015b010 2024-08-18T22:29:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d6400640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9d015b010 0x7fc9d015d740 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00ce600 tx=0x7fc9c8019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9cd600640 1 -- 172.21.15.5:0/2167404062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80b8670 con 0x7fc9d015b010 2024-08-18T22:29:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9cd600640 1 -- 172.21.15.5:0/2167404062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c80be070 con 0x7fc9d015b010 2024-08-18T22:29:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9cd600640 1 -- 172.21.15.5:0/2167404062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80b8a30 con 0x7fc9d015b010 2024-08-18T22:29:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d8400640 1 -- 172.21.15.5:0/2167404062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d015b950 con 0x7fc9d015b010 2024-08-18T22:29:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d8400640 1 -- 172.21.15.5:0/2167404062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d015e420 con 0x7fc9d015b010 2024-08-18T22:29:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9d8400640 1 -- 172.21.15.5:0/2167404062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d0072620 con 0x7fc9d015b010 2024-08-18T22:29:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.079+0000 7fc9cd600640 1 -- 172.21.15.5:0/2167404062 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc9c80b8bd0 con 0x7fc9d015b010 2024-08-18T22:29:02.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.083+0000 7fc9cd600640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9b00678f0 0x7fc9b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.083+0000 7fc9cd600640 1 -- 172.21.15.5:0/2167404062 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7fc9c8120e80 con 0x7fc9d015b010 2024-08-18T22:29:02.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.083+0000 7fc9d5a00640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9b00678f0 0x7fc9b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.083+0000 7fc9d5a00640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9b00678f0 0x7fc9b0069db0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4007a80 tx=0x7fc9c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:02.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.087+0000 7fc9cd600640 1 -- 172.21.15.5:0/2167404062 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc9c80165e0 con 0x7fc9d015b010 2024-08-18T22:29:02.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.283+0000 7fc9d8400640 1 -- 172.21.15.5:0/2167404062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9d006e520 con 0x7fc9d015b010 2024-08-18T22:29:02.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9cd600640 1 -- 172.21.15.5:0/2167404062 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5231 (secure 0 0 0) 0x7fc9c80f1140 con 0x7fc9d015b010 2024-08-18T22:29:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:02.286 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":108,"btime":"2024-08-18T22:28:24:685294+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:28:21.056377+0000","modified":"2024-08-18T22:28:24.121089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8565":{"gid":8565,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6833/1373218784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1373218784},{"type":"v1","addr":"172.21.15.5:6833","nonce":1373218784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8565,"qdb_cluster":[8565]},"id":9}]} 2024-08-18T22:29:02.287 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 108 2024-08-18T22:29:02.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 -- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9b00678f0 msgr2=0x7fc9b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9b00678f0 0x7fc9b0069db0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4007a80 tx=0x7fc9c4008040 comp rx=0 tx=0).stop 2024-08-18T22:29:02.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 -- 172.21.15.5:0/2167404062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9d015b010 msgr2=0x7fc9d015d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9d015b010 0x7fc9d015d740 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00ce600 tx=0x7fc9c8019760 comp rx=0 tx=0).stop 2024-08-18T22:29:02.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 -- 172.21.15.5:0/2167404062 shutdown_connections 2024-08-18T22:29:02.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc9b00678f0 0x7fc9b0069db0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9d015b010 0x7fc9d015d740 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d00cd3a0 0x7fc9d015d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 --2- 172.21.15.5:0/2167404062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d006f290 0x7fc9d0145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 -- 172.21.15.5:0/2167404062 >> 172.21.15.5:0/2167404062 conn(0x7fc9d00b1c50 msgr2=0x7fc9d0158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:02.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 -- 172.21.15.5:0/2167404062 shutdown_connections 2024-08-18T22:29:02.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.287+0000 7fc9d8400640 1 -- 172.21.15.5:0/2167404062 wait complete. 2024-08-18T22:29:02.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:29:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.447+0000 7fecfd600640 1 Processor -- start 2024-08-18T22:29:02.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.447+0000 7fecfd600640 1 -- start start 2024-08-18T22:29:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.447+0000 7fecfd600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fecf815bed0 0x7fecf80735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.447+0000 7fecfd600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf80cb390 0x7fecf8071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.447+0000 7fecfd600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf8072060 con 0x7fecf806da70 2024-08-18T22:29:02.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.447+0000 7fecfd600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fecf8073c80 con 0x7fecf815bed0 2024-08-18T22:29:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.447+0000 7fecfd600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fecf80ca5d0 con 0x7fecf80cb390 2024-08-18T22:29:02.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.447+0000 7fecf6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fecf815bed0 0x7fecf80735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.447+0000 7fecf7400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fecf806da70 0x7fecf80cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41836/0 (socket says 172.21.15.5:41836) 2024-08-18T22:29:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.451+0000 7fecf7400640 1 -- 172.21.15.5:0/3297089830 learned_addr learned my addr 172.21.15.5:0/3297089830 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.451+0000 7fecee000640 1 --2- 172.21.15.5:0/3297089830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf80cb390 0x7fecf8071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.451+0000 7fecf6a00640 1 -- 172.21.15.5:0/3297089830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf80cb390 msgr2=0x7fecf8071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.451+0000 7fecf6a00640 1 --2- 172.21.15.5:0/3297089830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf80cb390 0x7fecf8071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.451+0000 7fecf6a00640 1 -- 172.21.15.5:0/3297089830 >> v1:172.21.15.5:6789/0 conn(0x7fecf806da70 legacy=0x7fecf80cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.451+0000 7fecf6a00640 1 -- 172.21.15.5:0/3297089830 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf80ca8b0 con 0x7fecf815bed0 2024-08-18T22:29:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.451+0000 7fecf6000640 1 -- 172.21.15.5:0/3297089830 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382300996 0 0) 0x7fecf8072060 con 0x7fecf806da70 2024-08-18T22:29:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.451+0000 7fecf6a00640 1 --2- 172.21.15.5:0/3297089830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf815bed0 0x7fecf80735a0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fece80097c0 tx=0x7fece801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20453588be91476 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.451+0000 7fecf6000640 1 -- 172.21.15.5:0/3297089830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece80a7070 con 0x7fecf815bed0 2024-08-18T22:29:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.451+0000 7fecf6000640 1 -- 172.21.15.5:0/3297089830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece80b0070 con 0x7fecf815bed0 2024-08-18T22:29:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.451+0000 7fecf6000640 1 -- 172.21.15.5:0/3297089830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece80ab890 con 0x7fecf815bed0 2024-08-18T22:29:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 -- 172.21.15.5:0/3297089830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf815bed0 msgr2=0x7fecf80735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 --2- 172.21.15.5:0/3297089830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf815bed0 0x7fecf80735a0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fece80097c0 tx=0x7fece801c470 comp rx=0 tx=0).stop 2024-08-18T22:29:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 -- 172.21.15.5:0/3297089830 shutdown_connections 2024-08-18T22:29:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 --2- 172.21.15.5:0/3297089830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf80cb390 0x7fecf8071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 --2- 172.21.15.5:0/3297089830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf815bed0 0x7fecf80735a0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 -- 172.21.15.5:0/3297089830 >> 172.21.15.5:0/3297089830 conn(0x7fecf80b1c50 msgr2=0x7fecf80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 -- 172.21.15.5:0/3297089830 shutdown_connections 2024-08-18T22:29:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 -- 172.21.15.5:0/3297089830 wait complete. 2024-08-18T22:29:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 Processor -- start 2024-08-18T22:29:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 -- start start 2024-08-18T22:29:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf806da70 0x7fecf81f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf80cb390 0x7fecf814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecf815bed0 0x7fecf814c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fecf815c430 con 0x7fecf80cb390 2024-08-18T22:29:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fecf815c2b0 con 0x7fecf815bed0 2024-08-18T22:29:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecfd600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fecf8168ba0 con 0x7fecf806da70 2024-08-18T22:29:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecee000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf80cb390 0x7fecf814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecee000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf80cb390 0x7fecf814b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35942/0 (socket says 172.21.15.5:35942) 2024-08-18T22:29:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecee000640 1 -- 172.21.15.5:0/1652457320 learned_addr learned my addr 172.21.15.5:0/1652457320 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecf7400640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecf815bed0 0x7fecf814c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecf6a00640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf806da70 0x7fecf81f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecee000640 1 -- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf806da70 msgr2=0x7fecf81f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecee000640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf806da70 0x7fecf81f6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecee000640 1 -- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecf815bed0 msgr2=0x7fecf814c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecee000640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecf815bed0 0x7fecf814c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecee000640 1 -- 172.21.15.5:0/1652457320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf814cbf0 con 0x7fecf80cb390 2024-08-18T22:29:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecee000640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf80cb390 0x7fecf814b3c0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fece0007ef0 tx=0x7fece000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.455+0000 7fecef400640 1 -- 172.21.15.5:0/1652457320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece0014620 con 0x7fecf80cb390 2024-08-18T22:29:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.459+0000 7fecef400640 1 -- 172.21.15.5:0/1652457320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece0019070 con 0x7fecf80cb390 2024-08-18T22:29:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.459+0000 7fecef400640 1 -- 172.21.15.5:0/1652457320 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece0014a00 con 0x7fecf80cb390 2024-08-18T22:29:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.459+0000 7fecfd600640 1 -- 172.21.15.5:0/1652457320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf809ac90 con 0x7fecf80cb390 2024-08-18T22:29:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.459+0000 7fecfd600640 1 -- 172.21.15.5:0/1652457320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf814cfd0 con 0x7fecf80cb390 2024-08-18T22:29:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.459+0000 7fecfd600640 1 -- 172.21.15.5:0/1652457320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf80735a0 con 0x7fecf80cb390 2024-08-18T22:29:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.459+0000 7fecef400640 1 -- 172.21.15.5:0/1652457320 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fece0014ba0 con 0x7fecf80cb390 2024-08-18T22:29:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.459+0000 7fecef400640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fecd40678c0 0x7fecd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.459+0000 7fecef400640 1 -- 172.21.15.5:0/1652457320 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7fece00867a0 con 0x7fecf80cb390 2024-08-18T22:29:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.459+0000 7fecf6a00640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fecd40678c0 0x7fecd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.463+0000 7fecf6a00640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fecd40678c0 0x7fecd4069d80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fece80af000 tx=0x7fece80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:02.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.463+0000 7fecef400640 1 -- 172.21.15.5:0/1652457320 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fece0057140 con 0x7fecf80cb390 2024-08-18T22:29:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.631+0000 7fecfd600640 1 -- 172.21.15.5:0/1652457320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecf80b2240 con 0x7fecf80cb390 2024-08-18T22:29:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecef400640 1 -- 172.21.15.5:0/1652457320 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16828 (secure 0 0 0) 0x7fece0056a40 con 0x7fecf80cb390 2024-08-18T22:29:02.634 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:02.634 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":141,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:28:22.652816+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:28:18.813860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-08-18T22:28:20.061149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:29:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 -- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fecd40678c0 msgr2=0x7fecd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fecd40678c0 0x7fecd4069d80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fece80af000 tx=0x7fece80a7000 comp rx=0 tx=0).stop 2024-08-18T22:29:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 -- 172.21.15.5:0/1652457320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf80cb390 msgr2=0x7fecf814b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf80cb390 0x7fecf814b3c0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fece0007ef0 tx=0x7fece000e4b0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 -- 172.21.15.5:0/1652457320 shutdown_connections 2024-08-18T22:29:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fecd40678c0 0x7fecd4069d80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecf815bed0 0x7fecf814c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf80cb390 0x7fecf814b3c0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 --2- 172.21.15.5:0/1652457320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf806da70 0x7fecf81f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 -- 172.21.15.5:0/1652457320 >> 172.21.15.5:0/1652457320 conn(0x7fecf80b1c50 msgr2=0x7fecf80b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 -- 172.21.15.5:0/1652457320 shutdown_connections 2024-08-18T22:29:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.635+0000 7fecfd600640 1 -- 172.21.15.5:0/1652457320 wait complete. 2024-08-18T22:29:02.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:29:02.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3768c00640 1 Processor -- start 2024-08-18T22:29:02.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3768c00640 1 -- start start 2024-08-18T22:29:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3768c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3764144050 0x7f376406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3768c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f376406f3b0 0x7f3764144430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3768c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f376406ddd0 con 0x7f3764147860 2024-08-18T22:29:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3768c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f376406db80 con 0x7f3764144050 2024-08-18T22:29:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3768c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f376406e9e0 con 0x7f376406f3b0 2024-08-18T22:29:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3761e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3764144050 0x7f376406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3762800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3764147860 0x7f37640b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41848/0 (socket says 172.21.15.5:41848) 2024-08-18T22:29:02.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3762800640 1 -- 172.21.15.5:0/3046224020 learned_addr learned my addr 172.21.15.5:0/3046224020 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3761400640 1 --2- 172.21.15.5:0/3046224020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f376406f3b0 0x7f3764144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3761e00640 1 -- 172.21.15.5:0/3046224020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f376406f3b0 msgr2=0x7f3764144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3761e00640 1 --2- 172.21.15.5:0/3046224020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f376406f3b0 0x7f3764144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3761e00640 1 -- 172.21.15.5:0/3046224020 >> v1:172.21.15.5:6789/0 conn(0x7f3764147860 legacy=0x7f37640b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3761e00640 1 -- 172.21.15.5:0/3046224020 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376406e0b0 con 0x7f3764144050 2024-08-18T22:29:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3760a00640 1 -- 172.21.15.5:0/3046224020 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880391720 0 0) 0x7f376406ddd0 con 0x7f3764147860 2024-08-18T22:29:02.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.807+0000 7f3761400640 1 --2- 172.21.15.5:0/3046224020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f376406f3b0 0x7f3764144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3761e00640 1 --2- 172.21.15.5:0/3046224020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3764144050 0x7f376406ee70 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f37540097c0 tx=0x7f375401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87ab53f3e3aff57 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3760a00640 1 -- 172.21.15.5:0/3046224020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37540b1070 con 0x7f3764144050 2024-08-18T22:29:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3760a00640 1 -- 172.21.15.5:0/3046224020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37540a8050 con 0x7f3764144050 2024-08-18T22:29:02.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3760a00640 1 -- 172.21.15.5:0/3046224020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37540ac860 con 0x7f3764144050 2024-08-18T22:29:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3768c00640 1 -- 172.21.15.5:0/3046224020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3764144050 msgr2=0x7f376406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3768c00640 1 --2- 172.21.15.5:0/3046224020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3764144050 0x7f376406ee70 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f37540097c0 tx=0x7f375401c3e0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3768c00640 1 -- 172.21.15.5:0/3046224020 shutdown_connections 2024-08-18T22:29:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3768c00640 1 --2- 172.21.15.5:0/3046224020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f376406f3b0 0x7f3764144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3768c00640 1 --2- 172.21.15.5:0/3046224020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3764144050 0x7f376406ee70 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3768c00640 1 -- 172.21.15.5:0/3046224020 >> 172.21.15.5:0/3046224020 conn(0x7f37640b1dc0 msgr2=0x7f37640b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3768c00640 1 -- 172.21.15.5:0/3046224020 shutdown_connections 2024-08-18T22:29:02.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.811+0000 7f3768c00640 1 -- 172.21.15.5:0/3046224020 wait complete. 2024-08-18T22:29:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3768c00640 1 Processor -- start 2024-08-18T22:29:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3768c00640 1 -- start start 2024-08-18T22:29:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3768c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f376406f3b0 0x7f376415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3768c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3764144050 0x7f3764145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3768c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3764147860 0x7f37641462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3768c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f37640b3950 con 0x7f3764147860 2024-08-18T22:29:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3768c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f37640b37d0 con 0x7f3764144050 2024-08-18T22:29:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3768c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3764144970 con 0x7f376406f3b0 2024-08-18T22:29:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3762800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3764147860 0x7f37641462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3762800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3764147860 0x7f37641462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35966/0 (socket says 172.21.15.5:35966) 2024-08-18T22:29:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3762800640 1 -- 172.21.15.5:0/1715175429 learned_addr learned my addr 172.21.15.5:0/1715175429 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3761400640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3764144050 0x7f3764145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3761e00640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f376406f3b0 0x7f376415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3762800640 1 -- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f376406f3b0 msgr2=0x7f376415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3762800640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f376406f3b0 0x7f376415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3762800640 1 -- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3764144050 msgr2=0x7f3764145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3762800640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3764144050 0x7f3764145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3762800640 1 -- 172.21.15.5:0/1715175429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376415e2e0 con 0x7f3764147860 2024-08-18T22:29:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3762800640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3764147860 0x7f37641462f0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f375c00c780 tx=0x7f375c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f375a000640 1 -- 172.21.15.5:0/1715175429 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c018070 con 0x7f3764147860 2024-08-18T22:29:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f375a000640 1 -- 172.21.15.5:0/1715175429 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c00a640 con 0x7f3764147860 2024-08-18T22:29:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3768c00640 1 -- 172.21.15.5:0/1715175429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376409d940 con 0x7f3764147860 2024-08-18T22:29:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f375a000640 1 -- 172.21.15.5:0/1715175429 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c00aab0 con 0x7f3764147860 2024-08-18T22:29:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.815+0000 7f3768c00640 1 -- 172.21.15.5:0/1715175429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376409df00 con 0x7f3764147860 2024-08-18T22:29:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.819+0000 7f3768c00640 1 -- 172.21.15.5:0/1715175429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37640ca5e0 con 0x7f3764147860 2024-08-18T22:29:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.819+0000 7f375a000640 1 -- 172.21.15.5:0/1715175429 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f375c01b070 con 0x7f3764147860 2024-08-18T22:29:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.819+0000 7f375a000640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37440678c0 0x7f3744069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.819+0000 7f375a000640 1 -- 172.21.15.5:0/1715175429 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6101+0+0 (secure 0 0 0) 0x7f375c085340 con 0x7f3764147860 2024-08-18T22:29:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.819+0000 7f3761e00640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37440678c0 0x7f3744069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.819+0000 7f3761e00640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37440678c0 0x7f3744069d80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f37540ae000 tx=0x7f37540a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:02.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:02.823+0000 7f375a000640 1 -- 172.21.15.5:0/1715175429 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f37640ca5e0 con 0x7f3764147860 2024-08-18T22:29:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.023+0000 7f3768c00640 1 -- 172.21.15.5:0/1715175429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3764144430 con 0x7f3764147860 2024-08-18T22:29:03.026 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:29:03.027+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:29:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.027+0000 7f375a000640 1 -- 172.21.15.5:0/1715175429 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v109) ==== 161+0+0 (secure 0 0 0) 0x7f375c055690 con 0x7f3764147860 2024-08-18T22:29:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:29:03.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 -- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37440678c0 msgr2=0x7f3744069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:03.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37440678c0 0x7f3744069d80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f37540ae000 tx=0x7f37540a7000 comp rx=0 tx=0).stop 2024-08-18T22:29:03.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 -- 172.21.15.5:0/1715175429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3764147860 msgr2=0x7f37641462f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:03.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3764147860 0x7f37641462f0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f375c00c780 tx=0x7f375c00cc40 comp rx=0 tx=0).stop 2024-08-18T22:29:03.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 -- 172.21.15.5:0/1715175429 shutdown_connections 2024-08-18T22:29:03.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37440678c0 0x7f3744069d80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:03.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3764147860 0x7f37641462f0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:03.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3764144050 0x7f3764145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:03.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 --2- 172.21.15.5:0/1715175429 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f376406f3b0 0x7f376415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:03.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 -- 172.21.15.5:0/1715175429 >> 172.21.15.5:0/1715175429 conn(0x7f37640b1dc0 msgr2=0x7f37640afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:03.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 -- 172.21.15.5:0/1715175429 shutdown_connections 2024-08-18T22:29:03.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.031+0000 7f3768c00640 1 -- 172.21.15.5:0/1715175429 wait complete. 2024-08-18T22:29:03.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:29:03.100 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:29:03.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.195+0000 7f472f600640 1 Processor -- start 2024-08-18T22:29:03.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.195+0000 7f472f600640 1 -- start start 2024-08-18T22:29:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f472f600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47280b37d0 0x7f472806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f472f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f472814bef0 0x7f47280ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f472f600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472814c760 con 0x7f472806e110 2024-08-18T22:29:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f472f600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f472806ea30 con 0x7f47280b37d0 2024-08-18T22:29:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f472f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f472806ec90 con 0x7f472814bef0 2024-08-18T22:29:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f471fe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47280b37d0 0x7f472806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f472d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f472814bef0 0x7f47280ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:03.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f471fe00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47280b37d0 0x7f472806e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:37790/0 (socket says 172.21.15.5:37790) 2024-08-18T22:29:03.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f472cc00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f472806e110 0x7f47280b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:59396/0 (socket says 172.21.15.5:59396) 2024-08-18T22:29:03.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f471fe00640 1 -- 172.21.15.5:0/3493104658 learned_addr learned my addr 172.21.15.5:0/3493104658 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:03.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f471fe00640 1 -- 172.21.15.5:0/3493104658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f472814bef0 msgr2=0x7f47280ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:03.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f471fe00640 1 --2- 172.21.15.5:0/3493104658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f472814bef0 0x7f47280ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:03.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f471fe00640 1 -- 172.21.15.5:0/3493104658 >> v1:172.21.15.117:6789/0 conn(0x7f472806e110 legacy=0x7f47280b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:03.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.199+0000 7f471fe00640 1 -- 172.21.15.5:0/3493104658 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472806ef70 con 0x7f47280b37d0 2024-08-18T22:29:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f471fe00640 1 --2- 172.21.15.5:0/3493104658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280b37d0 0x7f472806e4f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4710009870 tx=0x7f471001c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab2e5fec36803aff server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f4727e00640 1 -- 172.21.15.5:0/3493104658 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47100a95f0 con 0x7f47280b37d0 2024-08-18T22:29:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f4727e00640 1 -- 172.21.15.5:0/3493104658 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47100a9790 con 0x7f47280b37d0 2024-08-18T22:29:03.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f4727e00640 1 -- 172.21.15.5:0/3493104658 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47100a9b60 con 0x7f47280b37d0 2024-08-18T22:29:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f472f600640 1 -- 172.21.15.5:0/3493104658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280b37d0 msgr2=0x7f472806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f472f600640 1 --2- 172.21.15.5:0/3493104658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280b37d0 0x7f472806e4f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4710009870 tx=0x7f471001c530 comp rx=0 tx=0).stop 2024-08-18T22:29:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f472f600640 1 -- 172.21.15.5:0/3493104658 shutdown_connections 2024-08-18T22:29:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f472f600640 1 --2- 172.21.15.5:0/3493104658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f472814bef0 0x7f47280ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f472f600640 1 --2- 172.21.15.5:0/3493104658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280b37d0 0x7f472806e4f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f472f600640 1 -- 172.21.15.5:0/3493104658 >> 172.21.15.5:0/3493104658 conn(0x7f47280b1dc0 msgr2=0x7f47280b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f472f600640 1 -- 172.21.15.5:0/3493104658 shutdown_connections 2024-08-18T22:29:03.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f472f600640 1 -- 172.21.15.5:0/3493104658 wait complete. 2024-08-18T22:29:03.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f472f600640 1 Processor -- start 2024-08-18T22:29:03.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.203+0000 7f472f600640 1 -- start start 2024-08-18T22:29:03.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f472806e110 0x7f47281fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:03.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472f600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280b37d0 0x7f472809abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:03.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472f600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472814bef0 0x7f4728161e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:03.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472f600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f47280cf3a0 con 0x7f472814bef0 2024-08-18T22:29:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472f600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47280cf220 con 0x7f47280b37d0 2024-08-18T22:29:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f47280cf520 con 0x7f472806e110 2024-08-18T22:29:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472814bef0 0x7f4728161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472814bef0 0x7f4728161e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35982/0 (socket says 172.21.15.5:35982) 2024-08-18T22:29:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472d600640 1 -- 172.21.15.5:0/649067033 learned_addr learned my addr 172.21.15.5:0/649067033 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472cc00640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f472806e110 0x7f47281fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f471fe00640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280b37d0 0x7f472809abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472cc00640 1 -- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280b37d0 msgr2=0x7f472809abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472cc00640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280b37d0 0x7f472809abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472cc00640 1 -- 172.21.15.5:0/649067033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472814bef0 msgr2=0x7f4728161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472cc00640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472814bef0 0x7f4728161e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472cc00640 1 -- 172.21.15.5:0/649067033 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472809b4c0 con 0x7f472806e110 2024-08-18T22:29:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472cc00640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f472806e110 0x7f47281fb560 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f471800c430 tx=0x7f471800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f4725600640 1 -- 172.21.15.5:0/649067033 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47180074e0 con 0x7f472806e110 2024-08-18T22:29:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f4725600640 1 -- 172.21.15.5:0/649067033 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4718007680 con 0x7f472806e110 2024-08-18T22:29:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f4725600640 1 -- 172.21.15.5:0/649067033 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718004a10 con 0x7f472806e110 2024-08-18T22:29:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472f600640 1 -- 172.21.15.5:0/649067033 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472809b7a0 con 0x7f472806e110 2024-08-18T22:29:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472f600640 1 -- 172.21.15.5:0/649067033 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f472809bd60 con 0x7f472806e110 2024-08-18T22:29:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.207+0000 7f472f600640 1 -- 172.21.15.5:0/649067033 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f472806e4f0 con 0x7f472806e110 2024-08-18T22:29:03.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.211+0000 7f4725600640 1 -- 172.21.15.5:0/649067033 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f471801a020 con 0x7f472806e110 2024-08-18T22:29:03.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.211+0000 7f4725600640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47040678c0 0x7f4704069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:03.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.211+0000 7f4725600640 1 -- 172.21.15.5:0/649067033 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(142..142 src has 1..142) ==== 6187+0+0 (secure 0 0 0) 0x7f47180856a0 con 0x7f472806e110 2024-08-18T22:29:03.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.211+0000 7f471fe00640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47040678c0 0x7f4704069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:03.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.211+0000 7f471fe00640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47040678c0 0x7f4704069d80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f47100ae000 tx=0x7f47100b4040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:03.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.215+0000 7f4725600640 1 -- 172.21.15.5:0/649067033 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4718055a20 con 0x7f472806e110 2024-08-18T22:29:03.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:03.415+0000 7f472f600640 1 -- 172.21.15.5:0/649067033 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f47280af7d0 con 0x7f472806e110 2024-08-18T22:29:04.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.031+0000 7f4725600640 1 -- 172.21.15.5:0/649067033 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v110) ==== 104+0+0 (secure 0 0 0) 0x7f4718059d20 con 0x7f472806e110 2024-08-18T22:29:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 -- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47040678c0 msgr2=0x7f4704069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47040678c0 0x7f4704069d80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f47100ae000 tx=0x7f47100b4040 comp rx=0 tx=0).stop 2024-08-18T22:29:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 -- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f472806e110 msgr2=0x7f47281fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f472806e110 0x7f47281fb560 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f471800c430 tx=0x7f471800c8f0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 -- 172.21.15.5:0/649067033 shutdown_connections 2024-08-18T22:29:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f47040678c0 0x7f4704069d80 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f472814bef0 0x7f4728161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47280b37d0 0x7f472809abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 --2- 172.21.15.5:0/649067033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f472806e110 0x7f47281fb560 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 -- 172.21.15.5:0/649067033 >> 172.21.15.5:0/649067033 conn(0x7f47280b1dc0 msgr2=0x7f47280b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:04.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 -- 172.21.15.5:0/649067033 shutdown_connections 2024-08-18T22:29:04.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.035+0000 7f472f600640 1 -- 172.21.15.5:0/649067033 wait complete. 2024-08-18T22:29:04.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:29:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.251+0000 7fa380200640 1 Processor -- start 2024-08-18T22:29:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.251+0000 7fa380200640 1 -- start start 2024-08-18T22:29:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa380200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa378147ce0 0x7fa3780af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa380200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3780afee0 0x7fa3780703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa380200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3780708e0 0x7fa37806e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa380200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa378070d10 con 0x7fa3780708e0 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa380200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa3781486b0 con 0x7fa378147ce0 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa380200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780b3c60 con 0x7fa3780afee0 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa37e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3780708e0 0x7fa37806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa37e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3780708e0 0x7fa37806e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58616/0 (socket says 172.21.15.5:58616) 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa37e200640 1 -- 172.21.15.5:0/1211204173 learned_addr learned my addr 172.21.15.5:0/1211204173 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa37d800640 1 --2- 172.21.15.5:0/1211204173 >> v2:172.21.15.117:3300/0 conn(0x7fa378147ce0 0x7fa3780af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa37ce00640 1 --2- 172.21.15.5:0/1211204173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3780afee0 0x7fa3780703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa37e200640 1 -- 172.21.15.5:0/1211204173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3780afee0 msgr2=0x7fa3780703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa37e200640 1 --2- 172.21.15.5:0/1211204173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3780afee0 0x7fa3780703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa37e200640 1 -- 172.21.15.5:0/1211204173 >> v2:172.21.15.117:3300/0 conn(0x7fa378147ce0 msgr2=0x7fa3780af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa37e200640 1 --2- 172.21.15.5:0/1211204173 >> v2:172.21.15.117:3300/0 conn(0x7fa378147ce0 0x7fa3780af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.255+0000 7fa37e200640 1 -- 172.21.15.5:0/1211204173 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3780b3f40 con 0x7fa3780708e0 2024-08-18T22:29:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa37e200640 1 --2- 172.21.15.5:0/1211204173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3780708e0 0x7fa37806e530 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa378072090 tx=0x7fa37001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73dff3721851740e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa377e00640 1 -- 172.21.15.5:0/1211204173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700b0070 con 0x7fa3780708e0 2024-08-18T22:29:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa377e00640 1 -- 172.21.15.5:0/1211204173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3700ab600 con 0x7fa3780708e0 2024-08-18T22:29:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa377e00640 1 -- 172.21.15.5:0/1211204173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700ab9d0 con 0x7fa3780708e0 2024-08-18T22:29:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 -- 172.21.15.5:0/1211204173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3780708e0 msgr2=0x7fa37806e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 --2- 172.21.15.5:0/1211204173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3780708e0 0x7fa37806e530 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa378072090 tx=0x7fa37001c260 comp rx=0 tx=0).stop 2024-08-18T22:29:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 -- 172.21.15.5:0/1211204173 shutdown_connections 2024-08-18T22:29:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 --2- 172.21.15.5:0/1211204173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3780708e0 0x7fa37806e530 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 --2- 172.21.15.5:0/1211204173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3780afee0 0x7fa3780703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 --2- 172.21.15.5:0/1211204173 >> v2:172.21.15.117:3300/0 conn(0x7fa378147ce0 0x7fa3780af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 -- 172.21.15.5:0/1211204173 >> 172.21.15.5:0/1211204173 conn(0x7fa3780732f0 msgr2=0x7fa37806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 -- 172.21.15.5:0/1211204173 shutdown_connections 2024-08-18T22:29:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 -- 172.21.15.5:0/1211204173 wait complete. 2024-08-18T22:29:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 Processor -- start 2024-08-18T22:29:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 -- start start 2024-08-18T22:29:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3780708e0 0x7fa378144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3780afee0 0x7fa37815b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa378147ce0 0x7fa37815e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780b4ba0 con 0x7fa378147ce0 2024-08-18T22:29:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780b4a20 con 0x7fa3780afee0 2024-08-18T22:29:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.259+0000 7fa380200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780b4d20 con 0x7fa3780708e0 2024-08-18T22:29:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa37e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa378147ce0 0x7fa37815e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa37d800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3780708e0 0x7fa378144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa37e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa378147ce0 0x7fa37815e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58618/0 (socket says 172.21.15.5:58618) 2024-08-18T22:29:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa37e200640 1 -- 172.21.15.5:0/1777215685 learned_addr learned my addr 172.21.15.5:0/1777215685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa37ce00640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3780afee0 0x7fa37815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa37e200640 1 -- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3780708e0 msgr2=0x7fa378144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa37e200640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3780708e0 0x7fa378144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa37e200640 1 -- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3780afee0 msgr2=0x7fa37815b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa37e200640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3780afee0 0x7fa37815b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa37e200640 1 -- 172.21.15.5:0/1777215685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa378144950 con 0x7fa378147ce0 2024-08-18T22:29:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa37e200640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa378147ce0 0x7fa37815e170 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa37001cb00 tx=0x7fa370019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa375600640 1 -- 172.21.15.5:0/1777215685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700b0040 con 0x7fa378147ce0 2024-08-18T22:29:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa375600640 1 -- 172.21.15.5:0/1777215685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3700b9070 con 0x7fa378147ce0 2024-08-18T22:29:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa380200640 1 -- 172.21.15.5:0/1777215685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa378144c30 con 0x7fa378147ce0 2024-08-18T22:29:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa375600640 1 -- 172.21.15.5:0/1777215685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700b4670 con 0x7fa378147ce0 2024-08-18T22:29:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa380200640 1 -- 172.21.15.5:0/1777215685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3781451f0 con 0x7fa378147ce0 2024-08-18T22:29:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa380200640 1 -- 172.21.15.5:0/1777215685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa378068f50 con 0x7fa378147ce0 2024-08-18T22:29:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.263+0000 7fa375600640 1 -- 172.21.15.5:0/1777215685 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3700b4810 con 0x7fa378147ce0 2024-08-18T22:29:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.267+0000 7fa375600640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3580678c0 0x7fa358069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.267+0000 7fa375600640 1 -- 172.21.15.5:0/1777215685 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6187+0+0 (secure 0 0 0) 0x7fa37011f820 con 0x7fa378147ce0 2024-08-18T22:29:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.267+0000 7fa37d800640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3580678c0 0x7fa358069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.267+0000 7fa37d800640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3580678c0 0x7fa358069d80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa36c011340 tx=0x7fa36c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.271+0000 7fa375600640 1 -- 172.21.15.5:0/1777215685 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa3700c3020 con 0x7fa378147ce0 2024-08-18T22:29:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:04.439+0000 7fa380200640 1 -- 172.21.15.5:0/1777215685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa3780703a0 con 0x7fa378147ce0 2024-08-18T22:29:05.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.035+0000 7fa375600640 1 -- 172.21.15.5:0/1777215685 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v143) ==== 181+0+0 (secure 0 0 0) 0x7fa370016110 con 0x7fa378147ce0 2024-08-18T22:29:05.037 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:29:05.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 -- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3580678c0 msgr2=0x7fa358069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:05.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3580678c0 0x7fa358069d80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa36c011340 tx=0x7fa36c00b040 comp rx=0 tx=0).stop 2024-08-18T22:29:05.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 -- 172.21.15.5:0/1777215685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa378147ce0 msgr2=0x7fa37815e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:05.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa378147ce0 0x7fa37815e170 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa37001cb00 tx=0x7fa370019000 comp rx=0 tx=0).stop 2024-08-18T22:29:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 -- 172.21.15.5:0/1777215685 shutdown_connections 2024-08-18T22:29:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3580678c0 0x7fa358069d80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa378147ce0 0x7fa37815e170 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3780afee0 0x7fa37815b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 --2- 172.21.15.5:0/1777215685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3780708e0 0x7fa378144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 -- 172.21.15.5:0/1777215685 >> 172.21.15.5:0/1777215685 conn(0x7fa3780732f0 msgr2=0x7fa378140490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:05.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 -- 172.21.15.5:0/1777215685 shutdown_connections 2024-08-18T22:29:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.039+0000 7fa380200640 1 -- 172.21.15.5:0/1777215685 wait complete. 2024-08-18T22:29:05.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:29:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d78400640 1 Processor -- start 2024-08-18T22:29:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d78400640 1 -- start start 2024-08-18T22:29:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d78400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7009bac0 0x7f0d7015bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d78400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d7009b080 0x7f0d7015c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d78400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d700b0840 con 0x7f0d7009aca0 2024-08-18T22:29:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d78400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0d7015c830 con 0x7f0d7009b080 2024-08-18T22:29:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d78400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d700b6520 con 0x7f0d7009bac0 2024-08-18T22:29:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d76400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d7009b080 0x7f0d7015c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d75000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7009bac0 0x7f0d7015bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d76400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d7009b080 0x7f0d7015c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:33954/0 (socket says 172.21.15.5:33954) 2024-08-18T22:29:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d76400640 1 -- 172.21.15.5:0/3997279388 learned_addr learned my addr 172.21.15.5:0/3997279388 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d75000640 1 -- 172.21.15.5:0/3997279388 >> v2:172.21.15.117:3300/0 conn(0x7f0d7009b080 msgr2=0x7f0d7015c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d75000640 1 --2- 172.21.15.5:0/3997279388 >> v2:172.21.15.117:3300/0 conn(0x7f0d7009b080 0x7f0d7015c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d75000640 1 -- 172.21.15.5:0/3997279388 >> v1:172.21.15.117:6789/0 conn(0x7f0d7009aca0 legacy=0x7f0d700b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d75000640 1 -- 172.21.15.5:0/3997279388 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d700b0ae0 con 0x7f0d7009bac0 2024-08-18T22:29:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.219+0000 7f0d76400640 1 --2- 172.21.15.5:0/3997279388 >> v2:172.21.15.117:3300/0 conn(0x7f0d7009b080 0x7f0d7015c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d75000640 1 --2- 172.21.15.5:0/3997279388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7009bac0 0x7f0d7015bdb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0097c0 tx=0x7f0d5c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e89e965664cc8d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d6fe00640 1 -- 172.21.15.5:0/3997279388 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0b0070 con 0x7f0d7009bac0 2024-08-18T22:29:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d6fe00640 1 -- 172.21.15.5:0/3997279388 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d5c0ab600 con 0x7f0d7009bac0 2024-08-18T22:29:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d6fe00640 1 -- 172.21.15.5:0/3997279388 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0ab9d0 con 0x7f0d7009bac0 2024-08-18T22:29:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d78400640 1 -- 172.21.15.5:0/3997279388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7009bac0 msgr2=0x7f0d7015bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d78400640 1 --2- 172.21.15.5:0/3997279388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7009bac0 0x7f0d7015bdb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0097c0 tx=0x7f0d5c01c410 comp rx=0 tx=0).stop 2024-08-18T22:29:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d78400640 1 -- 172.21.15.5:0/3997279388 shutdown_connections 2024-08-18T22:29:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d78400640 1 --2- 172.21.15.5:0/3997279388 >> v2:172.21.15.117:3300/0 conn(0x7f0d7009b080 0x7f0d7015c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d78400640 1 --2- 172.21.15.5:0/3997279388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7009bac0 0x7f0d7015bdb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d78400640 1 -- 172.21.15.5:0/3997279388 >> 172.21.15.5:0/3997279388 conn(0x7f0d700b7830 msgr2=0x7f0d700b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d78400640 1 -- 172.21.15.5:0/3997279388 shutdown_connections 2024-08-18T22:29:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.223+0000 7f0d78400640 1 -- 172.21.15.5:0/3997279388 wait complete. 2024-08-18T22:29:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d78400640 1 Processor -- start 2024-08-18T22:29:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d78400640 1 -- start start 2024-08-18T22:29:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d78400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d7009aca0 0x7f0d70140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d78400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7009b080 0x7f0d701f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d78400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7009bac0 0x7f0d701f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d78400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0d700b2800 con 0x7f0d7009aca0 2024-08-18T22:29:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d78400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0d700b2680 con 0x7f0d7009bac0 2024-08-18T22:29:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d78400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d700b2980 con 0x7f0d7009b080 2024-08-18T22:29:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d75a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d7009aca0 0x7f0d70140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d75a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d7009aca0 0x7f0d70140780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58628/0 (socket says 172.21.15.5:58628) 2024-08-18T22:29:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d75a00640 1 -- 172.21.15.5:0/3305461395 learned_addr learned my addr 172.21.15.5:0/3305461395 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d76400640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7009bac0 0x7f0d701f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d75000640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7009b080 0x7f0d701f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d75a00640 1 -- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7009b080 msgr2=0x7f0d701f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d75a00640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7009b080 0x7f0d701f8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d75a00640 1 -- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7009bac0 msgr2=0x7f0d701f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d75a00640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7009bac0 0x7f0d701f9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d75a00640 1 -- 172.21.15.5:0/3305461395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d70153b20 con 0x7f0d7009aca0 2024-08-18T22:29:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d75a00640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d7009aca0 0x7f0d70140780 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400c420 tx=0x7f0d6400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d6d600640 1 -- 172.21.15.5:0/3305461395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d640052d0 con 0x7f0d7009aca0 2024-08-18T22:29:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d6d600640 1 -- 172.21.15.5:0/3305461395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d64005470 con 0x7f0d7009aca0 2024-08-18T22:29:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d6d600640 1 -- 172.21.15.5:0/3305461395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d64007260 con 0x7f0d7009aca0 2024-08-18T22:29:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d78400640 1 -- 172.21.15.5:0/3305461395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d701564f0 con 0x7f0d7009aca0 2024-08-18T22:29:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.227+0000 7f0d78400640 1 -- 172.21.15.5:0/3305461395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d70145c90 con 0x7f0d7009aca0 2024-08-18T22:29:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.231+0000 7f0d78400640 1 -- 172.21.15.5:0/3305461395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d700b5c00 con 0x7f0d7009aca0 2024-08-18T22:29:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.231+0000 7f0d6d600640 1 -- 172.21.15.5:0/3305461395 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d64007400 con 0x7f0d7009aca0 2024-08-18T22:29:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.231+0000 7f0d6d600640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d500678c0 0x7f0d50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.231+0000 7f0d6d600640 1 -- 172.21.15.5:0/3305461395 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5749+0+0 (secure 0 0 0) 0x7f0d64085160 con 0x7f0d7009aca0 2024-08-18T22:29:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.231+0000 7f0d75000640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d500678c0 0x7f0d50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:05.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.231+0000 7f0d75000640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d500678c0 0x7f0d50069d80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0ad000 tx=0x7f0d5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:05.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.235+0000 7f0d6d600640 1 -- 172.21.15.5:0/3305461395 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0d64055610 con 0x7f0d7009aca0 2024-08-18T22:29:05.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:05.403+0000 7f0d78400640 1 -- 172.21.15.5:0/3305461395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0d70070210 con 0x7f0d7009aca0 2024-08-18T22:29:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.042+0000 7f0d6d600640 1 -- 172.21.15.5:0/3305461395 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v144) ==== 169+0+0 (secure 0 0 0) 0x7f0d64059910 con 0x7f0d7009aca0 2024-08-18T22:29:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:29:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.042+0000 7f0d78400640 1 -- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d500678c0 msgr2=0x7f0d50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.042+0000 7f0d78400640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d500678c0 0x7f0d50069d80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0ad000 tx=0x7f0d5c008040 comp rx=0 tx=0).stop 2024-08-18T22:29:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.046+0000 7f0d78400640 1 -- 172.21.15.5:0/3305461395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d7009aca0 msgr2=0x7f0d70140780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.046+0000 7f0d78400640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d7009aca0 0x7f0d70140780 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400c420 tx=0x7f0d6400c8e0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.046+0000 7f0d78400640 1 -- 172.21.15.5:0/3305461395 shutdown_connections 2024-08-18T22:29:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.046+0000 7f0d78400640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d500678c0 0x7f0d50069d80 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.046+0000 7f0d78400640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7009bac0 0x7f0d701f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.046+0000 7f0d78400640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7009b080 0x7f0d701f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.046+0000 7f0d78400640 1 --2- 172.21.15.5:0/3305461395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d7009aca0 0x7f0d70140780 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.046+0000 7f0d78400640 1 -- 172.21.15.5:0/3305461395 >> 172.21.15.5:0/3305461395 conn(0x7f0d700b7830 msgr2=0x7f0d7015bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.046+0000 7f0d78400640 1 -- 172.21.15.5:0/3305461395 shutdown_connections 2024-08-18T22:29:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.046+0000 7f0d78400640 1 -- 172.21.15.5:0/3305461395 wait complete. 2024-08-18T22:29:06.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:29:06.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.266+0000 7f49dd600640 1 Processor -- start 2024-08-18T22:29:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.266+0000 7f49dd600640 1 -- start start 2024-08-18T22:29:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49dd600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49d815b0c0 0x7f49d806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49dd600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f49d80cf290 0x7f49d80b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49dd600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49d80b31f0 con 0x7f49d80b40c0 2024-08-18T22:29:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49dd600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f49d80b3d70 con 0x7f49d80cf290 2024-08-18T22:29:06.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49dd600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49d80b4a40 con 0x7f49d815b0c0 2024-08-18T22:29:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49d6a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49d815b0c0 0x7f49d806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49d6000640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f49d80b40c0 0x7f49d8072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:51362/0 (socket says 172.21.15.5:51362) 2024-08-18T22:29:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49d6000640 1 -- 172.21.15.5:0/3817077004 learned_addr learned my addr 172.21.15.5:0/3817077004 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49d7400640 1 --2- 172.21.15.5:0/3817077004 >> v2:172.21.15.117:3300/0 conn(0x7f49d80cf290 0x7f49d80b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49d6a00640 1 -- 172.21.15.5:0/3817077004 >> v2:172.21.15.117:3300/0 conn(0x7f49d80cf290 msgr2=0x7f49d80b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49d6a00640 1 --2- 172.21.15.5:0/3817077004 >> v2:172.21.15.117:3300/0 conn(0x7f49d80cf290 0x7f49d80b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49d6a00640 1 -- 172.21.15.5:0/3817077004 >> v1:172.21.15.117:6789/0 conn(0x7f49d80b40c0 legacy=0x7f49d8072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49d6a00640 1 -- 172.21.15.5:0/3817077004 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d80b34d0 con 0x7f49d815b0c0 2024-08-18T22:29:06.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.270+0000 7f49d5600640 1 -- 172.21.15.5:0/3817077004 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96688918 0 0) 0x7f49d80b31f0 con 0x7f49d80b40c0 2024-08-18T22:29:06.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49d6a00640 1 --2- 172.21.15.5:0/3817077004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49d815b0c0 0x7f49d806db80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f49c80097c0 tx=0x7f49c801c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3c1ca13c06fbd6c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49d5600640 1 -- 172.21.15.5:0/3817077004 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c80b0070 con 0x7f49d815b0c0 2024-08-18T22:29:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49d5600640 1 -- 172.21.15.5:0/3817077004 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c8004230 con 0x7f49d815b0c0 2024-08-18T22:29:06.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49d5600640 1 -- 172.21.15.5:0/3817077004 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8003620 con 0x7f49d815b0c0 2024-08-18T22:29:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49dd600640 1 -- 172.21.15.5:0/3817077004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49d815b0c0 msgr2=0x7f49d806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49dd600640 1 --2- 172.21.15.5:0/3817077004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49d815b0c0 0x7f49d806db80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f49c80097c0 tx=0x7f49c801c350 comp rx=0 tx=0).stop 2024-08-18T22:29:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49dd600640 1 -- 172.21.15.5:0/3817077004 shutdown_connections 2024-08-18T22:29:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49dd600640 1 --2- 172.21.15.5:0/3817077004 >> v2:172.21.15.117:3300/0 conn(0x7f49d80cf290 0x7f49d80b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49dd600640 1 --2- 172.21.15.5:0/3817077004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49d815b0c0 0x7f49d806db80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49dd600640 1 -- 172.21.15.5:0/3817077004 >> 172.21.15.5:0/3817077004 conn(0x7f49d80b1dc0 msgr2=0x7f49d80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49dd600640 1 -- 172.21.15.5:0/3817077004 shutdown_connections 2024-08-18T22:29:06.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49dd600640 1 -- 172.21.15.5:0/3817077004 wait complete. 2024-08-18T22:29:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49dd600640 1 Processor -- start 2024-08-18T22:29:06.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.274+0000 7f49dd600640 1 -- start start 2024-08-18T22:29:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49dd600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49d80b40c0 0x7f49d814f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49dd600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49d80cf290 0x7f49d814b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49dd600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d815b0c0 0x7f49d8148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49dd600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49d815b620 con 0x7f49d815b0c0 2024-08-18T22:29:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49dd600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f49d815b4a0 con 0x7f49d80cf290 2024-08-18T22:29:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49dd600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49d806f670 con 0x7f49d80b40c0 2024-08-18T22:29:06.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49d7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d815b0c0 0x7f49d8148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49d6a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49d80b40c0 0x7f49d814f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49d7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d815b0c0 0x7f49d8148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58644/0 (socket says 172.21.15.5:58644) 2024-08-18T22:29:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49d7400640 1 -- 172.21.15.5:0/1873030149 learned_addr learned my addr 172.21.15.5:0/1873030149 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49d6000640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49d80cf290 0x7f49d814b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49d7400640 1 -- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49d80b40c0 msgr2=0x7f49d814f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49d7400640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49d80b40c0 0x7f49d814f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49d7400640 1 -- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49d80cf290 msgr2=0x7f49d814b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49d7400640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49d80cf290 0x7f49d814b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49d7400640 1 -- 172.21.15.5:0/1873030149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d8152990 con 0x7f49d815b0c0 2024-08-18T22:29:06.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49d7400640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d815b0c0 0x7f49d8148140 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f49d000efc0 tx=0x7f49d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49cea00640 1 -- 172.21.15.5:0/1873030149 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0018020 con 0x7f49d815b0c0 2024-08-18T22:29:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49cea00640 1 -- 172.21.15.5:0/1873030149 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d0014480 con 0x7f49d815b0c0 2024-08-18T22:29:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49cea00640 1 -- 172.21.15.5:0/1873030149 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0014870 con 0x7f49d815b0c0 2024-08-18T22:29:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49dd600640 1 -- 172.21.15.5:0/1873030149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d814fce0 con 0x7f49d815b0c0 2024-08-18T22:29:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49dd600640 1 -- 172.21.15.5:0/1873030149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d81520f0 con 0x7f49d815b0c0 2024-08-18T22:29:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49dd600640 1 -- 172.21.15.5:0/1873030149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d80b4500 con 0x7f49d815b0c0 2024-08-18T22:29:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.278+0000 7f49cea00640 1 -- 172.21.15.5:0/1873030149 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f49d001b020 con 0x7f49d815b0c0 2024-08-18T22:29:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.282+0000 7f49cea00640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49b80678c0 0x7f49b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.282+0000 7f49cea00640 1 -- 172.21.15.5:0/1873030149 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5335+0+0 (secure 0 0 0) 0x7f49d0086720 con 0x7f49d815b0c0 2024-08-18T22:29:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.282+0000 7f49d6a00640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49b80678c0 0x7f49b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:06.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.282+0000 7f49d6a00640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49b80678c0 0x7f49b8069d80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f49c80ad000 tx=0x7f49c80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:06.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.286+0000 7f49cea00640 1 -- 172.21.15.5:0/1873030149 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f49d0022030 con 0x7f49d815b0c0 2024-08-18T22:29:06.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.450+0000 7f49dd600640 1 -- 172.21.15.5:0/1873030149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f49d80cc770 con 0x7f49d815b0c0 2024-08-18T22:29:06.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49cea00640 1 -- 172.21.15.5:0/1873030149 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f49d0010040 con 0x7f49d815b0c0 2024-08-18T22:29:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 -- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49b80678c0 msgr2=0x7f49b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49b80678c0 0x7f49b8069d80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f49c80ad000 tx=0x7f49c80a6000 comp rx=0 tx=0).stop 2024-08-18T22:29:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 -- 172.21.15.5:0/1873030149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d815b0c0 msgr2=0x7f49d8148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d815b0c0 0x7f49d8148140 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f49d000efc0 tx=0x7f49d000c490 comp rx=0 tx=0).stop 2024-08-18T22:29:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 -- 172.21.15.5:0/1873030149 shutdown_connections 2024-08-18T22:29:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49b80678c0 0x7f49b8069d80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d815b0c0 0x7f49d8148140 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49d80cf290 0x7f49d814b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 --2- 172.21.15.5:0/1873030149 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49d80b40c0 0x7f49d814f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 -- 172.21.15.5:0/1873030149 >> 172.21.15.5:0/1873030149 conn(0x7f49d80b1dc0 msgr2=0x7f49d806ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:06.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 -- 172.21.15.5:0/1873030149 shutdown_connections 2024-08-18T22:29:06.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.454+0000 7f49dd600640 1 -- 172.21.15.5:0/1873030149 wait complete. 2024-08-18T22:29:06.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-08-18T22:29:06.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.614+0000 7f2d81600640 1 Processor -- start 2024-08-18T22:29:06.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d81600640 1 -- start start 2024-08-18T22:29:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d81600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d7c0cb390 0x7f2d7c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d81600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d7c073c80 con 0x7f2d7c15bed0 2024-08-18T22:29:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d81600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d7c0ca5d0 con 0x7f2d7c06da70 2024-08-18T22:29:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d81600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7c0ca8b0 con 0x7f2d7c0cb390 2024-08-18T22:29:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d7aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2d7c15bed0 0x7f2d7c071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40852/0 (socket says 172.21.15.5:40852) 2024-08-18T22:29:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d7aa00640 1 -- 172.21.15.5:0/2925226612 learned_addr learned my addr 172.21.15.5:0/2925226612 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d72000640 1 --2- 172.21.15.5:0/2925226612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d7c0cb390 0x7f2d7c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d7a000640 1 -- 172.21.15.5:0/2925226612 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3055684489 0 0) 0x7f2d7c073c80 con 0x7f2d7c15bed0 2024-08-18T22:29:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d7a000640 1 -- 172.21.15.5:0/2925226612 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d60003530 con 0x7f2d7c15bed0 2024-08-18T22:29:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d7a000640 1 -- 172.21.15.5:0/2925226612 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1925469963 0 0) 0x7f2d7c0ca5d0 con 0x7f2d7c06da70 2024-08-18T22:29:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d7a000640 1 -- 172.21.15.5:0/2925226612 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d7c073c80 con 0x7f2d7c06da70 2024-08-18T22:29:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d72000640 1 -- 172.21.15.5:0/2925226612 >> v1:172.21.15.117:6789/0 conn(0x7f2d7c06da70 legacy=0x7f2d7c165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d72000640 1 -- 172.21.15.5:0/2925226612 >> v1:172.21.15.5:6789/0 conn(0x7f2d7c15bed0 legacy=0x7f2d7c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.618+0000 7f2d72000640 1 -- 172.21.15.5:0/2925226612 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c0cab90 con 0x7f2d7c0cb390 2024-08-18T22:29:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d72000640 1 --2- 172.21.15.5:0/2925226612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d7c0cb390 0x7f2d7c0735a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2d640097f0 tx=0x7f2d6401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aca8fd0e625e28c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d7a000640 1 -- 172.21.15.5:0/2925226612 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d640b1070 con 0x7f2d7c0cb390 2024-08-18T22:29:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d7a000640 1 -- 172.21.15.5:0/2925226612 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d640ac630 con 0x7f2d7c0cb390 2024-08-18T22:29:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d7a000640 1 -- 172.21.15.5:0/2925226612 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d640a8050 con 0x7f2d7c0cb390 2024-08-18T22:29:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d81600640 1 -- 172.21.15.5:0/2925226612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d7c0cb390 msgr2=0x7f2d7c0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d81600640 1 --2- 172.21.15.5:0/2925226612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d7c0cb390 0x7f2d7c0735a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2d640097f0 tx=0x7f2d6401c4b0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d81600640 1 -- 172.21.15.5:0/2925226612 shutdown_connections 2024-08-18T22:29:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d81600640 1 --2- 172.21.15.5:0/2925226612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d7c0cb390 0x7f2d7c0735a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d81600640 1 -- 172.21.15.5:0/2925226612 >> 172.21.15.5:0/2925226612 conn(0x7f2d7c0b1c50 msgr2=0x7f2d7c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d81600640 1 -- 172.21.15.5:0/2925226612 shutdown_connections 2024-08-18T22:29:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d81600640 1 -- 172.21.15.5:0/2925226612 wait complete. 2024-08-18T22:29:06.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d81600640 1 Processor -- start 2024-08-18T22:29:06.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.622+0000 7f2d81600640 1 -- start start 2024-08-18T22:29:06.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d81600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d7c06da70 0x7f2d7c14bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d81600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d7c0cb390 0x7f2d7c1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d81600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d7c15bed0 0x7f2d7c0b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d81600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c169c40 con 0x7f2d7c06da70 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d81600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c169ac0 con 0x7f2d7c0cb390 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d81600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7c169dc0 con 0x7f2d7c15bed0 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d7aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d7c06da70 0x7f2d7c14bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d7aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d7c06da70 0x7f2d7c14bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58660/0 (socket says 172.21.15.5:58660) 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d7aa00640 1 -- 172.21.15.5:0/1259459622 learned_addr learned my addr 172.21.15.5:0/1259459622 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d72000640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d7c0cb390 0x7f2d7c1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d7b400640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d7c15bed0 0x7f2d7c0b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d7aa00640 1 -- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d7c15bed0 msgr2=0x7f2d7c0b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d7aa00640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d7c15bed0 0x7f2d7c0b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d7aa00640 1 -- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d7c0cb390 msgr2=0x7f2d7c1594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:06.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d7aa00640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d7c0cb390 0x7f2d7c1594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:06.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d7aa00640 1 -- 172.21.15.5:0/1259459622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c151520 con 0x7f2d7c06da70 2024-08-18T22:29:06.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d7aa00640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d7c06da70 0x7f2d7c14bcf0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00c450 tx=0x7f2d6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:06.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d73400640 1 -- 172.21.15.5:0/1259459622 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c017070 con 0x7f2d7c06da70 2024-08-18T22:29:06.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d73400640 1 -- 172.21.15.5:0/1259459622 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c005cf0 con 0x7f2d7c06da70 2024-08-18T22:29:06.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d73400640 1 -- 172.21.15.5:0/1259459622 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c0072b0 con 0x7f2d7c06da70 2024-08-18T22:29:06.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d81600640 1 -- 172.21.15.5:0/1259459622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7c151240 con 0x7f2d7c06da70 2024-08-18T22:29:06.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d81600640 1 -- 172.21.15.5:0/1259459622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7c0af910 con 0x7f2d7c06da70 2024-08-18T22:29:06.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d81600640 1 -- 172.21.15.5:0/1259459622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d7c0735a0 con 0x7f2d7c06da70 2024-08-18T22:29:06.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.626+0000 7f2d73400640 1 -- 172.21.15.5:0/1259459622 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2d6c01a070 con 0x7f2d7c06da70 2024-08-18T22:29:06.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.630+0000 7f2d73400640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d580678c0 0x7f2d58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:06.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.630+0000 7f2d73400640 1 -- 172.21.15.5:0/1259459622 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5335+0+0 (secure 0 0 0) 0x7f2d6c084d90 con 0x7f2d7c06da70 2024-08-18T22:29:06.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.630+0000 7f2d72000640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d580678c0 0x7f2d58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:06.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.630+0000 7f2d72000640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d580678c0 0x7f2d58069d80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2d640ae000 tx=0x7f2d64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:06.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.634+0000 7f2d73400640 1 -- 172.21.15.5:0/1259459622 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2d6c055460 con 0x7f2d7c06da70 2024-08-18T22:29:06.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:06.858+0000 7f2d81600640 1 -- 172.21.15.5:0/1259459622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f2d7c14c230 con 0x7f2d7c06da70 2024-08-18T22:29:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.042+0000 7f2d73400640 1 -- 172.21.15.5:0/1259459622 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v469) ==== 155+0+0 (secure 0 0 0) 0x7f2d6c059760 con 0x7f2d7c06da70 2024-08-18T22:29:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 -- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d580678c0 msgr2=0x7f2d58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d580678c0 0x7f2d58069d80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2d640ae000 tx=0x7f2d64008040 comp rx=0 tx=0).stop 2024-08-18T22:29:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 -- 172.21.15.5:0/1259459622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d7c06da70 msgr2=0x7f2d7c14bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d7c06da70 0x7f2d7c14bcf0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00c450 tx=0x7f2d6c00c910 comp rx=0 tx=0).stop 2024-08-18T22:29:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 -- 172.21.15.5:0/1259459622 shutdown_connections 2024-08-18T22:29:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2d580678c0 0x7f2d58069d80 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d7c15bed0 0x7f2d7c0b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d7c0cb390 0x7f2d7c1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 --2- 172.21.15.5:0/1259459622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d7c06da70 0x7f2d7c14bcf0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 -- 172.21.15.5:0/1259459622 >> 172.21.15.5:0/1259459622 conn(0x7f2d7c0b1c50 msgr2=0x7f2d7c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 -- 172.21.15.5:0/1259459622 shutdown_connections 2024-08-18T22:29:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.046+0000 7f2d81600640 1 -- 172.21.15.5:0/1259459622 wait complete. 2024-08-18T22:29:07.068 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-08-18T22:29:07.068 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-08-18T22:29:07.069 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:29:07.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d73000640 1 Processor -- start 2024-08-18T22:29:07.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d73000640 1 -- start start 2024-08-18T22:29:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d73000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d6c15bed0 0x7f3d6c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d73000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d6c0cb390 0x7f3d6c071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d73000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d6c072060 con 0x7f3d6c06da70 2024-08-18T22:29:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d73000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3d6c073c80 con 0x7f3d6c15bed0 2024-08-18T22:29:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d73000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3d6c0ca5d0 con 0x7f3d6c0cb390 2024-08-18T22:29:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d6be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d6c15bed0 0x7f3d6c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d71000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3d6c06da70 0x7f3d6c0cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40860/0 (socket says 172.21.15.5:40860) 2024-08-18T22:29:07.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d71000640 1 -- 172.21.15.5:0/3453883436 learned_addr learned my addr 172.21.15.5:0/3453883436 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:07.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d6be00640 1 -- 172.21.15.5:0/3453883436 >> v2:172.21.15.117:3300/0 conn(0x7f3d6c0cb390 msgr2=0x7f3d6c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:07.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d6be00640 1 --2- 172.21.15.5:0/3453883436 >> v2:172.21.15.117:3300/0 conn(0x7f3d6c0cb390 0x7f3d6c071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d6be00640 1 -- 172.21.15.5:0/3453883436 >> v1:172.21.15.5:6789/0 conn(0x7f3d6c06da70 legacy=0x7f3d6c0cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d6aa00640 1 -- 172.21.15.5:0/3453883436 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2684364226 0 0) 0x7f3d6c072060 con 0x7f3d6c06da70 2024-08-18T22:29:07.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.210+0000 7f3d6be00640 1 -- 172.21.15.5:0/3453883436 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c0ca8b0 con 0x7f3d6c15bed0 2024-08-18T22:29:07.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d6be00640 1 --2- 172.21.15.5:0/3453883436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c15bed0 0x7f3d6c0735a0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c06ee10 tx=0x7f3d5c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c09e18d09744d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:07.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d6aa00640 1 -- 172.21.15.5:0/3453883436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0ab650 con 0x7f3d6c15bed0 2024-08-18T22:29:07.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d6aa00640 1 -- 172.21.15.5:0/3453883436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c0b0070 con 0x7f3d6c15bed0 2024-08-18T22:29:07.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d6aa00640 1 -- 172.21.15.5:0/3453883436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0aba10 con 0x7f3d6c15bed0 2024-08-18T22:29:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d73000640 1 -- 172.21.15.5:0/3453883436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c15bed0 msgr2=0x7f3d6c0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d73000640 1 --2- 172.21.15.5:0/3453883436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c15bed0 0x7f3d6c0735a0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c06ee10 tx=0x7f3d5c01c450 comp rx=0 tx=0).stop 2024-08-18T22:29:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d73000640 1 -- 172.21.15.5:0/3453883436 shutdown_connections 2024-08-18T22:29:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d73000640 1 --2- 172.21.15.5:0/3453883436 >> v2:172.21.15.117:3300/0 conn(0x7f3d6c0cb390 0x7f3d6c071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d73000640 1 --2- 172.21.15.5:0/3453883436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c15bed0 0x7f3d6c0735a0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d73000640 1 -- 172.21.15.5:0/3453883436 >> 172.21.15.5:0/3453883436 conn(0x7f3d6c0b1c50 msgr2=0x7f3d6c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d73000640 1 -- 172.21.15.5:0/3453883436 shutdown_connections 2024-08-18T22:29:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d73000640 1 -- 172.21.15.5:0/3453883436 wait complete. 2024-08-18T22:29:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d73000640 1 Processor -- start 2024-08-18T22:29:07.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.214+0000 7f3d73000640 1 -- start start 2024-08-18T22:29:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d73000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c06da70 0x7f3d6c150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d73000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0cb390 0x7f3d6c0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d73000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c15bed0 0x7f3d6c09b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d73000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c15c430 con 0x7f3d6c0cb390 2024-08-18T22:29:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d73000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c15c2b0 con 0x7f3d6c06da70 2024-08-18T22:29:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d73000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3d6c168ba0 con 0x7f3d6c15bed0 2024-08-18T22:29:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d6b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0cb390 0x7f3d6c0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d6b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0cb390 0x7f3d6c0cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58690/0 (socket says 172.21.15.5:58690) 2024-08-18T22:29:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d6b400640 1 -- 172.21.15.5:0/458913824 learned_addr learned my addr 172.21.15.5:0/458913824 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:07.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d6be00640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c06da70 0x7f3d6c150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d71000640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c15bed0 0x7f3d6c09b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d6b400640 1 -- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c15bed0 msgr2=0x7f3d6c09b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d6b400640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c15bed0 0x7f3d6c09b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d6b400640 1 -- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c06da70 msgr2=0x7f3d6c150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d6b400640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c06da70 0x7f3d6c150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d6b400640 1 -- 172.21.15.5:0/458913824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c09bac0 con 0x7f3d6c0cb390 2024-08-18T22:29:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d71000640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c15bed0 0x7f3d6c09b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d6b400640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0cb390 0x7f3d6c0cdb50 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800b550 tx=0x7f3d5800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d63e00640 1 -- 172.21.15.5:0/458913824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58014070 con 0x7f3d6c0cb390 2024-08-18T22:29:07.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d63e00640 1 -- 172.21.15.5:0/458913824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d58010610 con 0x7f3d6c0cb390 2024-08-18T22:29:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d73000640 1 -- 172.21.15.5:0/458913824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6c0ce230 con 0x7f3d6c0cb390 2024-08-18T22:29:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d63e00640 1 -- 172.21.15.5:0/458913824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d580109e0 con 0x7f3d6c0cb390 2024-08-18T22:29:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d73000640 1 -- 172.21.15.5:0/458913824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d6c0ce7f0 con 0x7f3d6c0cb390 2024-08-18T22:29:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.218+0000 7f3d73000640 1 -- 172.21.15.5:0/458913824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d6c0735a0 con 0x7f3d6c0cb390 2024-08-18T22:29:07.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.222+0000 7f3d63e00640 1 -- 172.21.15.5:0/458913824 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d58017070 con 0x7f3d6c0cb390 2024-08-18T22:29:07.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.222+0000 7f3d63e00640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d4c0678c0 0x7f3d4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.222+0000 7f3d63e00640 1 -- 172.21.15.5:0/458913824 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5335+0+0 (secure 0 0 0) 0x7f3d58085460 con 0x7f3d6c0cb390 2024-08-18T22:29:07.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.222+0000 7f3d6be00640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d4c0678c0 0x7f3d4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.222+0000 7f3d6be00640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d4c0678c0 0x7f3d4c069d80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0af000 tx=0x7f3d5c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:07.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.226+0000 7f3d63e00640 1 -- 172.21.15.5:0/458913824 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f3d6c09bac0 con 0x7f3d6c0cb390 2024-08-18T22:29:07.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.390+0000 7f3d73000640 1 -- 172.21.15.5:0/458913824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d6c0b2030 con 0x7f3d6c0cb390 2024-08-18T22:29:07.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.390+0000 7f3d63e00640 1 -- 172.21.15.5:0/458913824 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+13229 (secure 0 0 0) 0x7f3d58055ab0 con 0x7f3d6c0cb390 2024-08-18T22:29:07.392 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:07.392 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":144,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:29:06.041710+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6833/1373218784":"2024-08-19T22:29:03.030896+0000","172.21.15.5:6832/1373218784":"2024-08-19T22:29:03.030896+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:29:07.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 -- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d4c0678c0 msgr2=0x7f3d4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d4c0678c0 0x7f3d4c069d80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0af000 tx=0x7f3d5c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:29:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 -- 172.21.15.5:0/458913824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0cb390 msgr2=0x7f3d6c0cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0cb390 0x7f3d6c0cdb50 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800b550 tx=0x7f3d5800ba10 comp rx=0 tx=0).stop 2024-08-18T22:29:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 -- 172.21.15.5:0/458913824 shutdown_connections 2024-08-18T22:29:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d4c0678c0 0x7f3d4c069d80 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c15bed0 0x7f3d6c09b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d6c0cb390 0x7f3d6c0cdb50 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 --2- 172.21.15.5:0/458913824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c06da70 0x7f3d6c150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 -- 172.21.15.5:0/458913824 >> 172.21.15.5:0/458913824 conn(0x7f3d6c0b1c50 msgr2=0x7f3d6c0cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 -- 172.21.15.5:0/458913824 shutdown_connections 2024-08-18T22:29:07.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.394+0000 7f3d73000640 1 -- 172.21.15.5:0/458913824 wait complete. 2024-08-18T22:29:07.414 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:29:07.414 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:29:07.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f2130000640 1 Processor -- start 2024-08-18T22:29:07.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f2130000640 1 -- start start 2024-08-18T22:29:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f2130000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2128144050 0x7f212806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f2130000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212806ddd0 con 0x7f212806f3b0 2024-08-18T22:29:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f2130000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212806e0b0 con 0x7f2128147860 2024-08-18T22:29:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f2130000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f212806db80 con 0x7f2128144050 2024-08-18T22:29:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f212cc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f212806f3b0 0x7f2128144430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40874/0 (socket says 172.21.15.5:40874) 2024-08-18T22:29:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f212cc00640 1 -- 172.21.15.5:0/1380969994 learned_addr learned my addr 172.21.15.5:0/1380969994 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:07.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f212d600640 1 --2- 172.21.15.5:0/1380969994 >> v2:172.21.15.117:3300/0 conn(0x7f2128144050 0x7f212806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f2127e00640 1 -- 172.21.15.5:0/1380969994 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2175246667 0 0) 0x7f212806ddd0 con 0x7f212806f3b0 2024-08-18T22:29:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f2127e00640 1 -- 172.21.15.5:0/1380969994 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2110003530 con 0x7f212806f3b0 2024-08-18T22:29:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f212d600640 1 -- 172.21.15.5:0/1380969994 >> v1:172.21.15.117:6789/0 conn(0x7f2128147860 legacy=0x7f21280b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f212d600640 1 -- 172.21.15.5:0/1380969994 >> v1:172.21.15.5:6789/0 conn(0x7f212806f3b0 legacy=0x7f2128144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.558+0000 7f212d600640 1 -- 172.21.15.5:0/1380969994 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212806e390 con 0x7f2128144050 2024-08-18T22:29:07.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.562+0000 7f212d600640 1 --2- 172.21.15.5:0/1380969994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2128144050 0x7f212806ee70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f212806dd00 tx=0x7f211c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b777809c2f5e0c1f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:07.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.562+0000 7f2127e00640 1 -- 172.21.15.5:0/1380969994 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c0b0070 con 0x7f2128144050 2024-08-18T22:29:07.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.562+0000 7f2127e00640 1 -- 172.21.15.5:0/1380969994 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f211c0ab600 con 0x7f2128144050 2024-08-18T22:29:07.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.562+0000 7f2127e00640 1 -- 172.21.15.5:0/1380969994 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c0ab9b0 con 0x7f2128144050 2024-08-18T22:29:07.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.562+0000 7f2130000640 1 -- 172.21.15.5:0/1380969994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2128144050 msgr2=0x7f212806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.562+0000 7f2130000640 1 --2- 172.21.15.5:0/1380969994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2128144050 0x7f212806ee70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f212806dd00 tx=0x7f211c01c410 comp rx=0 tx=0).stop 2024-08-18T22:29:07.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.562+0000 7f2130000640 1 -- 172.21.15.5:0/1380969994 shutdown_connections 2024-08-18T22:29:07.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.562+0000 7f2130000640 1 --2- 172.21.15.5:0/1380969994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2128144050 0x7f212806ee70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.562+0000 7f2130000640 1 -- 172.21.15.5:0/1380969994 >> 172.21.15.5:0/1380969994 conn(0x7f21280b1dc0 msgr2=0x7f21280b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:07.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.562+0000 7f2130000640 1 -- 172.21.15.5:0/1380969994 shutdown_connections 2024-08-18T22:29:07.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.562+0000 7f2130000640 1 -- 172.21.15.5:0/1380969994 wait complete. 2024-08-18T22:29:07.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2130000640 1 Processor -- start 2024-08-18T22:29:07.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2130000640 1 -- start start 2024-08-18T22:29:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2130000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f212806f3b0 0x7f212815f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2130000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2128144050 0x7f212815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2130000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2128147860 0x7f2128160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2130000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f21280b3950 con 0x7f2128147860 2024-08-18T22:29:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2130000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f21280b37d0 con 0x7f212806f3b0 2024-08-18T22:29:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2130000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f212816c360 con 0x7f2128144050 2024-08-18T22:29:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2128147860 0x7f2128160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2128147860 0x7f2128160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58696/0 (socket says 172.21.15.5:58696) 2024-08-18T22:29:07.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212e000640 1 -- 172.21.15.5:0/982678220 learned_addr learned my addr 172.21.15.5:0/982678220 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:07.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212d600640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f212806f3b0 0x7f212815f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212cc00640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2128144050 0x7f212815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212e000640 1 -- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2128144050 msgr2=0x7f212815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212e000640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2128144050 0x7f212815ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212e000640 1 -- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f212806f3b0 msgr2=0x7f212815f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212e000640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f212806f3b0 0x7f212815f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212e000640 1 -- 172.21.15.5:0/982678220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21281452a0 con 0x7f2128147860 2024-08-18T22:29:07.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212d600640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f212806f3b0 0x7f212815f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:07.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f212e000640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2128147860 0x7f2128160f90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f212000c7a0 tx=0x7f212000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:07.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2125600640 1 -- 172.21.15.5:0/982678220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120003b80 con 0x7f2128147860 2024-08-18T22:29:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2125600640 1 -- 172.21.15.5:0/982678220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2120003d20 con 0x7f2128147860 2024-08-18T22:29:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2125600640 1 -- 172.21.15.5:0/982678220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212000aa90 con 0x7f2128147860 2024-08-18T22:29:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2130000640 1 -- 172.21.15.5:0/982678220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2128145580 con 0x7f2128147860 2024-08-18T22:29:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2130000640 1 -- 172.21.15.5:0/982678220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2128145b40 con 0x7f2128147860 2024-08-18T22:29:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.566+0000 7f2130000640 1 -- 172.21.15.5:0/982678220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2128145d40 con 0x7f2128147860 2024-08-18T22:29:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.570+0000 7f2125600640 1 -- 172.21.15.5:0/982678220 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f212000ac30 con 0x7f2128147860 2024-08-18T22:29:07.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.570+0000 7f2125600640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21080678c0 0x7f2108069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.570+0000 7f2125600640 1 -- 172.21.15.5:0/982678220 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5335+0+0 (secure 0 0 0) 0x7f2120085940 con 0x7f2128147860 2024-08-18T22:29:07.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.570+0000 7f212d600640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21080678c0 0x7f2108069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.570+0000 7f212d600640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21080678c0 0x7f2108069d80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f211c0ad000 tx=0x7f211c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:07.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.574+0000 7f2125600640 1 -- 172.21.15.5:0/982678220 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2128145d40 con 0x7f2128147860 2024-08-18T22:29:07.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 -- 172.21.15.5:0/982678220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f212806ee70 con 0x7f2128147860 2024-08-18T22:29:07.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2125600640 1 -- 172.21.15.5:0/982678220 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) ==== 93+0+10 (secure 0 0 0) 0x7f2120055f00 con 0x7f2128147860 2024-08-18T22:29:07.743 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:29:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 -- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21080678c0 msgr2=0x7f2108069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21080678c0 0x7f2108069d80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f211c0ad000 tx=0x7f211c0a6000 comp rx=0 tx=0).stop 2024-08-18T22:29:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 -- 172.21.15.5:0/982678220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2128147860 msgr2=0x7f2128160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2128147860 0x7f2128160f90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f212000c7a0 tx=0x7f212000cc60 comp rx=0 tx=0).stop 2024-08-18T22:29:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 -- 172.21.15.5:0/982678220 shutdown_connections 2024-08-18T22:29:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f21080678c0 0x7f2108069d80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2128147860 0x7f2128160f90 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2128144050 0x7f212815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 --2- 172.21.15.5:0/982678220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f212806f3b0 0x7f212815f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 -- 172.21.15.5:0/982678220 >> 172.21.15.5:0/982678220 conn(0x7f21280b1dc0 msgr2=0x7f2128144430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:07.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 -- 172.21.15.5:0/982678220 shutdown_connections 2024-08-18T22:29:07.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.742+0000 7f2130000640 1 -- 172.21.15.5:0/982678220 wait complete. 2024-08-18T22:29:07.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-08-18T22:29:07.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.902+0000 7f8b5d600640 1 Processor -- start 2024-08-18T22:29:07.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.902+0000 7f8b5d600640 1 -- start start 2024-08-18T22:29:07.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b5d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815b010 0x7f8b580ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b5d600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8b580cd3a0 0x7f8b5806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b5d600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b580cee20 con 0x7f8b5806f0c0 2024-08-18T22:29:07.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b5d600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8b580cfa30 con 0x7f8b580cd3a0 2024-08-18T22:29:07.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b5d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b580cf100 con 0x7f8b5815b010 2024-08-18T22:29:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b56a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815b010 0x7f8b580ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b4e000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8b580cd3a0 0x7f8b5806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b4e000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8b580cd3a0 0x7f8b5806eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:34058/0 (socket says 172.21.15.5:34058) 2024-08-18T22:29:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b4e000640 1 -- 172.21.15.5:0/4009869041 learned_addr learned my addr 172.21.15.5:0/4009869041 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b56a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815b010 0x7f8b580ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:42662/0 (socket says 172.21.15.5:42662) 2024-08-18T22:29:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b4e000640 1 -- 172.21.15.5:0/4009869041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815b010 msgr2=0x7f8b580ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b4e000640 1 --2- 172.21.15.5:0/4009869041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815b010 0x7f8b580ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b4e000640 1 -- 172.21.15.5:0/4009869041 >> v1:172.21.15.117:6789/0 conn(0x7f8b5806f0c0 legacy=0x7f8b580caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b4e000640 1 -- 172.21.15.5:0/4009869041 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b580cf3e0 con 0x7f8b580cd3a0 2024-08-18T22:29:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.906+0000 7f8b56a00640 1 --2- 172.21.15.5:0/4009869041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815b010 0x7f8b580ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:07.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b4e000640 1 --2- 172.21.15.5:0/4009869041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580cd3a0 0x7f8b5806eb80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009870 tx=0x7f8b4001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bb8c03aadc73726 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:07.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b56000640 1 -- 172.21.15.5:0/4009869041 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b400b1070 con 0x7f8b580cd3a0 2024-08-18T22:29:07.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b56000640 1 -- 172.21.15.5:0/4009869041 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b400a8050 con 0x7f8b580cd3a0 2024-08-18T22:29:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b56000640 1 -- 172.21.15.5:0/4009869041 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b400ac860 con 0x7f8b580cd3a0 2024-08-18T22:29:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 -- 172.21.15.5:0/4009869041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580cd3a0 msgr2=0x7f8b5806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 --2- 172.21.15.5:0/4009869041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580cd3a0 0x7f8b5806eb80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009870 tx=0x7f8b4001c560 comp rx=0 tx=0).stop 2024-08-18T22:29:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 -- 172.21.15.5:0/4009869041 shutdown_connections 2024-08-18T22:29:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 --2- 172.21.15.5:0/4009869041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580cd3a0 0x7f8b5806eb80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 --2- 172.21.15.5:0/4009869041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5815b010 0x7f8b580ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 -- 172.21.15.5:0/4009869041 >> 172.21.15.5:0/4009869041 conn(0x7f8b580b1c50 msgr2=0x7f8b580b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 -- 172.21.15.5:0/4009869041 shutdown_connections 2024-08-18T22:29:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 -- 172.21.15.5:0/4009869041 wait complete. 2024-08-18T22:29:07.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 Processor -- start 2024-08-18T22:29:07.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 -- start start 2024-08-18T22:29:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5806f0c0 0x7f8b5809d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.910+0000 7f8b5d600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580cd3a0 0x7f8b580ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b5d600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5815b010 0x7f8b58156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b5d600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5806dbf0 con 0x7f8b5815b010 2024-08-18T22:29:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b5d600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5806da70 con 0x7f8b580cd3a0 2024-08-18T22:29:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b5d600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5806dd70 con 0x7f8b5806f0c0 2024-08-18T22:29:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b57400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5815b010 0x7f8b58156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b57400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5815b010 0x7f8b58156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58710/0 (socket says 172.21.15.5:58710) 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b57400640 1 -- 172.21.15.5:0/2900421637 learned_addr learned my addr 172.21.15.5:0/2900421637 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b4e000640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580cd3a0 0x7f8b580ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b56a00640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5806f0c0 0x7f8b5809d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b57400640 1 -- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5806f0c0 msgr2=0x7f8b5809d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b57400640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5806f0c0 0x7f8b5809d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b57400640 1 -- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580cd3a0 msgr2=0x7f8b580ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b57400640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580cd3a0 0x7f8b580ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b57400640 1 -- 172.21.15.5:0/2900421637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b580ad810 con 0x7f8b5815b010 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b57400640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5815b010 0x7f8b58156380 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c7a0 tx=0x7f8b5000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b4f400640 1 -- 172.21.15.5:0/2900421637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50003b80 con 0x7f8b5815b010 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b4f400640 1 -- 172.21.15.5:0/2900421637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b50003d20 con 0x7f8b5815b010 2024-08-18T22:29:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b5d600640 1 -- 172.21.15.5:0/2900421637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b580aef50 con 0x7f8b5815b010 2024-08-18T22:29:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b4f400640 1 -- 172.21.15.5:0/2900421637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5000aa90 con 0x7f8b5815b010 2024-08-18T22:29:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b5d600640 1 -- 172.21.15.5:0/2900421637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b580af210 con 0x7f8b5815b010 2024-08-18T22:29:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b5d600640 1 -- 172.21.15.5:0/2900421637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5809d870 con 0x7f8b5815b010 2024-08-18T22:29:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.914+0000 7f8b4f400640 1 -- 172.21.15.5:0/2900421637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b5000ac30 con 0x7f8b5815b010 2024-08-18T22:29:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.918+0000 7f8b4f400640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b340678c0 0x7f8b34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.918+0000 7f8b4f400640 1 -- 172.21.15.5:0/2900421637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5335+0+0 (secure 0 0 0) 0x7f8b500859d0 con 0x7f8b5815b010 2024-08-18T22:29:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.918+0000 7f8b56a00640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b340678c0 0x7f8b34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:07.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.918+0000 7f8b56a00640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b340678c0 0x7f8b34069d80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009a50 tx=0x7f8b48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:07.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:07.922+0000 7f8b4f400640 1 -- 172.21.15.5:0/2900421637 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8b50056680 con 0x7f8b5815b010 2024-08-18T22:29:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:08.146+0000 7f8b5d600640 1 -- 172.21.15.5:0/2900421637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7f8b580ce840 con 0x7f8b5815b010 2024-08-18T22:29:09.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b4f400640 1 -- 172.21.15.5:0/2900421637 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v471) ==== 169+0+0 (secure 0 0 0) 0x7f8b50055f80 con 0x7f8b5815b010 2024-08-18T22:29:09.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 -- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b340678c0 msgr2=0x7f8b34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b340678c0 0x7f8b34069d80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009a50 tx=0x7f8b48008040 comp rx=0 tx=0).stop 2024-08-18T22:29:09.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 -- 172.21.15.5:0/2900421637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5815b010 msgr2=0x7f8b58156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5815b010 0x7f8b58156380 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000c7a0 tx=0x7f8b5000cc60 comp rx=0 tx=0).stop 2024-08-18T22:29:09.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 -- 172.21.15.5:0/2900421637 shutdown_connections 2024-08-18T22:29:09.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8b340678c0 0x7f8b34069d80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b5815b010 0x7f8b58156380 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b580cd3a0 0x7f8b580ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 --2- 172.21.15.5:0/2900421637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b5806f0c0 0x7f8b5809d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 -- 172.21.15.5:0/2900421637 >> 172.21.15.5:0/2900421637 conn(0x7f8b580b1c50 msgr2=0x7f8b580c9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:09.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 -- 172.21.15.5:0/2900421637 shutdown_connections 2024-08-18T22:29:09.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.054+0000 7f8b5d600640 1 -- 172.21.15.5:0/2900421637 wait complete. 2024-08-18T22:29:09.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:29:09.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.226+0000 7fc7a8c00640 1 Processor -- start 2024-08-18T22:29:09.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.226+0000 7fc7a8c00640 1 -- start start 2024-08-18T22:29:09.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.226+0000 7fc7a8c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7a415f000 0x7fc7a40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.226+0000 7fc7a8c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc7a406c3c0 0x7fc7a40d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.226+0000 7fc7a8c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a40b46b0 con 0x7fc7a4147dd0 2024-08-18T22:29:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.226+0000 7fc7a8c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a415f7c0 con 0x7fc7a406c3c0 2024-08-18T22:29:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.226+0000 7fc7a8c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a40b6410 con 0x7fc7a415f000 2024-08-18T22:29:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a1e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc7a4147dd0 0x7fc7a415e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40876/0 (socket says 172.21.15.5:40876) 2024-08-18T22:29:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a1e00640 1 -- 172.21.15.5:0/3990295178 learned_addr learned my addr 172.21.15.5:0/3990295178 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a2800640 1 --2- 172.21.15.5:0/3990295178 >> v2:172.21.15.5:3300/0 conn(0x7fc7a406c3c0 0x7fc7a40d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc79be00640 1 --2- 172.21.15.5:0/3990295178 >> v2:172.21.15.117:3300/0 conn(0x7fc7a415f000 0x7fc7a40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a1400640 1 -- 172.21.15.5:0/3990295178 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1117344254 0 0) 0x7fc7a40b46b0 con 0x7fc7a4147dd0 2024-08-18T22:29:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a1400640 1 -- 172.21.15.5:0/3990295178 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc788003530 con 0x7fc7a4147dd0 2024-08-18T22:29:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a2800640 1 -- 172.21.15.5:0/3990295178 >> v2:172.21.15.117:3300/0 conn(0x7fc7a415f000 msgr2=0x7fc7a40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a2800640 1 --2- 172.21.15.5:0/3990295178 >> v2:172.21.15.117:3300/0 conn(0x7fc7a415f000 0x7fc7a40b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a2800640 1 -- 172.21.15.5:0/3990295178 >> v1:172.21.15.5:6789/0 conn(0x7fc7a4147dd0 legacy=0x7fc7a415e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a2800640 1 -- 172.21.15.5:0/3990295178 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a406c830 con 0x7fc7a406c3c0 2024-08-18T22:29:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc79be00640 1 --2- 172.21.15.5:0/3990295178 >> v2:172.21.15.117:3300/0 conn(0x7fc7a415f000 0x7fc7a40b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:09.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a2800640 1 --2- 172.21.15.5:0/3990295178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7a406c3c0 0x7fc7a40d0f70 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4073100 tx=0x7fc79c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475aac908685230f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:09.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a1400640 1 -- 172.21.15.5:0/3990295178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0b2070 con 0x7fc7a406c3c0 2024-08-18T22:29:09.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a1400640 1 -- 172.21.15.5:0/3990295178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c0a5930 con 0x7fc7a406c3c0 2024-08-18T22:29:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.230+0000 7fc7a1400640 1 -- 172.21.15.5:0/3990295178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0a5d00 con 0x7fc7a406c3c0 2024-08-18T22:29:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 -- 172.21.15.5:0/3990295178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7a406c3c0 msgr2=0x7fc7a40d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 --2- 172.21.15.5:0/3990295178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7a406c3c0 0x7fc7a40d0f70 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4073100 tx=0x7fc79c01c870 comp rx=0 tx=0).stop 2024-08-18T22:29:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 -- 172.21.15.5:0/3990295178 shutdown_connections 2024-08-18T22:29:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 --2- 172.21.15.5:0/3990295178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7a406c3c0 0x7fc7a40d0f70 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 --2- 172.21.15.5:0/3990295178 >> v2:172.21.15.117:3300/0 conn(0x7fc7a415f000 0x7fc7a40b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 -- 172.21.15.5:0/3990295178 >> 172.21.15.5:0/3990295178 conn(0x7fc7a40b65f0 msgr2=0x7fc7a40b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 -- 172.21.15.5:0/3990295178 shutdown_connections 2024-08-18T22:29:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 -- 172.21.15.5:0/3990295178 wait complete. 2024-08-18T22:29:09.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 Processor -- start 2024-08-18T22:29:09.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 -- start start 2024-08-18T22:29:09.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a406c3c0 0x7fc7a40701c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a4147dd0 0x7fc7a413c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7a415f000 0x7fc7a413cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a40b5b30 con 0x7fc7a415f000 2024-08-18T22:29:09.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a415f9e0 con 0x7fc7a4147dd0 2024-08-18T22:29:09.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a8c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a40b5cb0 con 0x7fc7a406c3c0 2024-08-18T22:29:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7a415f000 0x7fc7a413cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7a415f000 0x7fc7a413cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58724/0 (socket says 172.21.15.5:58724) 2024-08-18T22:29:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a2800640 1 -- 172.21.15.5:0/1247977666 learned_addr learned my addr 172.21.15.5:0/1247977666 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc79be00640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a4147dd0 0x7fc7a413c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.234+0000 7fc7a1e00640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a406c3c0 0x7fc7a40701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc7a2800640 1 -- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a406c3c0 msgr2=0x7fc7a40701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc7a2800640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a406c3c0 0x7fc7a40701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc7a2800640 1 -- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a4147dd0 msgr2=0x7fc7a413c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc7a2800640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a4147dd0 0x7fc7a413c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc7a2800640 1 -- 172.21.15.5:0/1247977666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a415e180 con 0x7fc7a415f000 2024-08-18T22:29:09.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc7a1e00640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a406c3c0 0x7fc7a40701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:09.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc7a2800640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7a415f000 0x7fc7a413cee0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fc79c019480 tx=0x7fc79c019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:09.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc79a000640 1 -- 172.21.15.5:0/1247977666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0b2050 con 0x7fc7a415f000 2024-08-18T22:29:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc79a000640 1 -- 172.21.15.5:0/1247977666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c0be070 con 0x7fc7a415f000 2024-08-18T22:29:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc79a000640 1 -- 172.21.15.5:0/1247977666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0b9690 con 0x7fc7a415f000 2024-08-18T22:29:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc7a8c00640 1 -- 172.21.15.5:0/1247977666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a415e460 con 0x7fc7a415f000 2024-08-18T22:29:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc7a8c00640 1 -- 172.21.15.5:0/1247977666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a4141f10 con 0x7fc7a415f000 2024-08-18T22:29:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc7a8c00640 1 -- 172.21.15.5:0/1247977666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a415e630 con 0x7fc7a415f000 2024-08-18T22:29:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc79a000640 1 -- 172.21.15.5:0/1247977666 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc79c0b9830 con 0x7fc7a415f000 2024-08-18T22:29:09.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc79a000640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7800678c0 0x7fc780069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc79a000640 1 -- 172.21.15.5:0/1247977666 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5335+0+0 (secure 0 0 0) 0x7fc79c120940 con 0x7fc7a415f000 2024-08-18T22:29:09.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.238+0000 7fc7a1e00640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7800678c0 0x7fc780069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.242+0000 7fc7a1e00640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7800678c0 0x7fc780069d80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc794005890 tx=0x7fc794009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:09.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.242+0000 7fc79a000640 1 -- 172.21.15.5:0/1247977666 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc79c016520 con 0x7fc7a415f000 2024-08-18T22:29:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.410+0000 7fc7a8c00640 1 -- 172.21.15.5:0/1247977666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc7a40d0f70 con 0x7fc7a415f000 2024-08-18T22:29:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.414+0000 7fc79a000640 1 -- 172.21.15.5:0/1247977666 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7fc79c0f15e0 con 0x7fc7a415f000 2024-08-18T22:29:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 -- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7800678c0 msgr2=0x7fc780069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7800678c0 0x7fc780069d80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc794005890 tx=0x7fc794009040 comp rx=0 tx=0).stop 2024-08-18T22:29:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 -- 172.21.15.5:0/1247977666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7a415f000 msgr2=0x7fc7a413cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7a415f000 0x7fc7a413cee0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fc79c019480 tx=0x7fc79c019610 comp rx=0 tx=0).stop 2024-08-18T22:29:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 -- 172.21.15.5:0/1247977666 shutdown_connections 2024-08-18T22:29:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc7800678c0 0x7fc780069d80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7a415f000 0x7fc7a413cee0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a4147dd0 0x7fc7a413c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 --2- 172.21.15.5:0/1247977666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a406c3c0 0x7fc7a40701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 -- 172.21.15.5:0/1247977666 >> 172.21.15.5:0/1247977666 conn(0x7fc7a40b65f0 msgr2=0x7fc7a413d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 -- 172.21.15.5:0/1247977666 shutdown_connections 2024-08-18T22:29:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.418+0000 7fc7a8c00640 1 -- 172.21.15.5:0/1247977666 wait complete. 2024-08-18T22:29:09.438 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:29:09.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:29:09.516 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:29:09.616 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:29:09.616 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:29:09.616 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:29:09.625 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:29:09.625 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:29:09.625 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:29:09.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:29:09.635 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:29:09.635 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:29:09.673 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:29:09.674 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:29:09.674 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:29:09.685 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:29:09.685 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:29:09.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.854+0000 7fb54aa00640 1 Processor -- start 2024-08-18T22:29:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb54aa00640 1 -- start start 2024-08-18T22:29:09.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb54aa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb54415c320 0x7fb54415f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb54aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5440d1af0 0x7fb5440d2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb54aa00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440cee10 con 0x7fb5440d4fa0 2024-08-18T22:29:09.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb54aa00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb5440cfa20 con 0x7fb54415c320 2024-08-18T22:29:09.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb54aa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb5440cf0f0 con 0x7fb5440d1af0 2024-08-18T22:29:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb548a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5440d1af0 0x7fb5440d2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb543e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb54415c320 0x7fb54415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb548a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5440d1af0 0x7fb5440d2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:42682/0 (socket says 172.21.15.5:42682) 2024-08-18T22:29:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb548a00640 1 -- 172.21.15.5:0/624186259 learned_addr learned my addr 172.21.15.5:0/624186259 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb543e00640 1 -- 172.21.15.5:0/624186259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5440d1af0 msgr2=0x7fb5440d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb543e00640 1 --2- 172.21.15.5:0/624186259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5440d1af0 0x7fb5440d2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb543e00640 1 -- 172.21.15.5:0/624186259 >> v1:172.21.15.117:6789/0 conn(0x7fb5440d4fa0 legacy=0x7fb5440d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb543e00640 1 -- 172.21.15.5:0/624186259 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5440cf3d0 con 0x7fb54415c320 2024-08-18T22:29:09.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.858+0000 7fb542a00640 1 -- 172.21.15.5:0/624186259 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 849020016 0 0) 0x7fb5440cee10 con 0x7fb5440d4fa0 2024-08-18T22:29:09.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb543e00640 1 --2- 172.21.15.5:0/624186259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb54415c320 0x7fb54415f490 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb5340097c0 tx=0x7fb53401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47f5a0e0fe54f473 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:09.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb542a00640 1 -- 172.21.15.5:0/624186259 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340b0070 con 0x7fb54415c320 2024-08-18T22:29:09.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb542a00640 1 -- 172.21.15.5:0/624186259 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5340ab600 con 0x7fb54415c320 2024-08-18T22:29:09.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb542a00640 1 -- 172.21.15.5:0/624186259 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340ab9d0 con 0x7fb54415c320 2024-08-18T22:29:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb54aa00640 1 -- 172.21.15.5:0/624186259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb54415c320 msgr2=0x7fb54415f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb54aa00640 1 --2- 172.21.15.5:0/624186259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb54415c320 0x7fb54415f490 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb5340097c0 tx=0x7fb53401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb54aa00640 1 -- 172.21.15.5:0/624186259 shutdown_connections 2024-08-18T22:29:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb54aa00640 1 --2- 172.21.15.5:0/624186259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5440d1af0 0x7fb5440d2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb54aa00640 1 --2- 172.21.15.5:0/624186259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb54415c320 0x7fb54415f490 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb54aa00640 1 -- 172.21.15.5:0/624186259 >> 172.21.15.5:0/624186259 conn(0x7fb544067aa0 msgr2=0x7fb544067eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb54aa00640 1 -- 172.21.15.5:0/624186259 shutdown_connections 2024-08-18T22:29:09.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb54aa00640 1 -- 172.21.15.5:0/624186259 wait complete. 2024-08-18T22:29:09.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb54aa00640 1 Processor -- start 2024-08-18T22:29:09.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.862+0000 7fb54aa00640 1 -- start start 2024-08-18T22:29:09.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb54aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5440d1af0 0x7fb544167e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb54aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5440d4fa0 0x7fb5440cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb54aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb54415c320 0x7fb5440cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb54aa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5440d3260 con 0x7fb5440d4fa0 2024-08-18T22:29:09.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb54aa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb5440d30e0 con 0x7fb5440d1af0 2024-08-18T22:29:09.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb54aa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb5440d33e0 con 0x7fb54415c320 2024-08-18T22:29:09.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb543400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5440d4fa0 0x7fb5440cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb543400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5440d4fa0 0x7fb5440cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58738/0 (socket says 172.21.15.5:58738) 2024-08-18T22:29:09.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb543400640 1 -- 172.21.15.5:0/655625714 learned_addr learned my addr 172.21.15.5:0/655625714 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:09.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb543e00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5440d1af0 0x7fb544167e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb548a00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb54415c320 0x7fb5440cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb543400640 1 -- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb54415c320 msgr2=0x7fb5440cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb543400640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb54415c320 0x7fb5440cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb543400640 1 -- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5440d1af0 msgr2=0x7fb544167e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb543400640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5440d1af0 0x7fb544167e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb543400640 1 -- 172.21.15.5:0/655625714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5440cc610 con 0x7fb5440d4fa0 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb543e00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5440d1af0 0x7fb544167e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb543400640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5440d4fa0 0x7fb5440cb560 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fb53000c480 tx=0x7fb53000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb53be00640 1 -- 172.21.15.5:0/655625714 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb530005480 con 0x7fb5440d4fa0 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb53be00640 1 -- 172.21.15.5:0/655625714 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb530003600 con 0x7fb5440d4fa0 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb53be00640 1 -- 172.21.15.5:0/655625714 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5300039f0 con 0x7fb5440d4fa0 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb54aa00640 1 -- 172.21.15.5:0/655625714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5440cc8b0 con 0x7fb5440d4fa0 2024-08-18T22:29:09.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb54aa00640 1 -- 172.21.15.5:0/655625714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5440cce70 con 0x7fb5440d4fa0 2024-08-18T22:29:09.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.866+0000 7fb54aa00640 1 -- 172.21.15.5:0/655625714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5440d2390 con 0x7fb5440d4fa0 2024-08-18T22:29:09.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.870+0000 7fb53be00640 1 -- 172.21.15.5:0/655625714 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb530003b90 con 0x7fb5440d4fa0 2024-08-18T22:29:09.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.870+0000 7fb53be00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5240678c0 0x7fb524069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:09.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.870+0000 7fb53be00640 1 -- 172.21.15.5:0/655625714 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5335+0+0 (secure 0 0 0) 0x7fb530085780 con 0x7fb5440d4fa0 2024-08-18T22:29:09.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.870+0000 7fb543e00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5240678c0 0x7fb524069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:09.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.870+0000 7fb543e00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5240678c0 0x7fb524069d80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb5340ad000 tx=0x7fb534008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:09.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:09.874+0000 7fb53be00640 1 -- 172.21.15.5:0/655625714 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb530055d40 con 0x7fb5440d4fa0 2024-08-18T22:29:10.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 -- 172.21.15.5:0/655625714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb54415ef60 con 0x7fb5440d4fa0 2024-08-18T22:29:10.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb53be00640 1 -- 172.21.15.5:0/655625714 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+3913 (secure 0 0 0) 0x7fb53005a040 con 0x7fb5440d4fa0 2024-08-18T22:29:10.079 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:10.079 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":110,"btime":"2024-08-18T22:29:04:033060+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4050678703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4050678703},{"type":"v1","addr":"172.21.15.5:6835","nonce":4050678703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1517034126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1517034126},{"type":"v1","addr":"172.21.15.117:6836","nonce":1517034126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2715893528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2715893528},{"type":"v1","addr":"172.21.15.117:6837","nonce":2715893528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":8934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/551020990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":551020990},{"type":"v1","addr":"172.21.15.5:6833","nonce":551020990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[]} 2024-08-18T22:29:10.080 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 110 2024-08-18T22:29:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 -- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5240678c0 msgr2=0x7fb524069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5240678c0 0x7fb524069d80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb5340ad000 tx=0x7fb534008040 comp rx=0 tx=0).stop 2024-08-18T22:29:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 -- 172.21.15.5:0/655625714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5440d4fa0 msgr2=0x7fb5440cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5440d4fa0 0x7fb5440cb560 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fb53000c480 tx=0x7fb53000c940 comp rx=0 tx=0).stop 2024-08-18T22:29:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 -- 172.21.15.5:0/655625714 shutdown_connections 2024-08-18T22:29:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb5240678c0 0x7fb524069d80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb54415c320 0x7fb5440cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5440d4fa0 0x7fb5440cb560 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 --2- 172.21.15.5:0/655625714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5440d1af0 0x7fb544167e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 -- 172.21.15.5:0/655625714 >> 172.21.15.5:0/655625714 conn(0x7fb544067aa0 msgr2=0x7fb5440d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 -- 172.21.15.5:0/655625714 shutdown_connections 2024-08-18T22:29:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:10.078+0000 7fb54aa00640 1 -- 172.21.15.5:0/655625714 wait complete. 2024-08-18T22:29:10.102 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:29:10.102 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:29:10.102 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:29:10.102 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:29:10.103 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:29:10.103 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:29:10.103 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:29:10.103 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:29:10.103 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:29:10.103 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:29:10.103 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:29:10.104 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:29:10.104 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:29:10.104 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:29:10.104 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:29:10.104 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:29:10.115 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:29:10.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:29:10.117 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:29:10.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:29:10.118 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:29:10.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:29:10.160 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:29:10.161 DEBUG:teuthology.parallel:result is None 2024-08-18T22:29:10.163 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:29:10.164 DEBUG:teuthology.parallel:result is None 2024-08-18T22:29:10.165 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:29:10.165 DEBUG:teuthology.parallel:result is None 2024-08-18T22:29:10.245 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:29:10.253 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:29:10.254 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:29:15.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-08-18T22:29:16.116 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:29:16.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:29:16.120 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:29:16.120 DEBUG:teuthology.parallel:result is None 2024-08-18T22:29:16.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:29:16.217 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:29:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd536200640 1 Processor -- start 2024-08-18T22:29:16.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd536200640 1 -- start start 2024-08-18T22:29:16.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd536200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd53015d4d0 0x7fd530166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:16.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd536200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5300ced30 con 0x7fd53015c180 2024-08-18T22:29:16.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd536200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5300cfb00 con 0x7fd53015c560 2024-08-18T22:29:16.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd536200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd53015d040 con 0x7fd53015d4d0 2024-08-18T22:29:16.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd52f400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd53015c180 0x7fd5300cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58604/0 (socket says 172.21.15.5:58604) 2024-08-18T22:29:16.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd52fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd53015d4d0 0x7fd530166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:16.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd52f400640 1 -- 172.21.15.5:0/3639437964 learned_addr learned my addr 172.21.15.5:0/3639437964 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:16.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd52fe00640 1 -- 172.21.15.5:0/3639437964 >> v1:172.21.15.117:6789/0 conn(0x7fd53015c560 legacy=0x7fd5300ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:16.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd52fe00640 1 -- 172.21.15.5:0/3639437964 >> v1:172.21.15.5:6789/0 conn(0x7fd53015c180 legacy=0x7fd5300cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:16.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd52fe00640 1 -- 172.21.15.5:0/3639437964 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53015c9f0 con 0x7fd53015d4d0 2024-08-18T22:29:16.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.274+0000 7fd52ea00640 1 -- 172.21.15.5:0/3639437964 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3779431922 0 0) 0x7fd5300ced30 con 0x7fd53015c180 2024-08-18T22:29:16.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.278+0000 7fd52fe00640 1 --2- 172.21.15.5:0/3639437964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd53015d4d0 0x7fd530166f10 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd528009d90 tx=0x7fd52801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09bbf03dfc75791 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:16.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.278+0000 7fd52ea00640 1 -- 172.21.15.5:0/3639437964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5280b2070 con 0x7fd53015d4d0 2024-08-18T22:29:16.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.278+0000 7fd52ea00640 1 -- 172.21.15.5:0/3639437964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5280a5990 con 0x7fd53015d4d0 2024-08-18T22:29:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.278+0000 7fd52ea00640 1 -- 172.21.15.5:0/3639437964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5280a5d60 con 0x7fd53015d4d0 2024-08-18T22:29:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.278+0000 7fd536200640 1 -- 172.21.15.5:0/3639437964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd53015d4d0 msgr2=0x7fd530166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.278+0000 7fd536200640 1 --2- 172.21.15.5:0/3639437964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd53015d4d0 0x7fd530166f10 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd528009d90 tx=0x7fd52801c8b0 comp rx=0 tx=0).stop 2024-08-18T22:29:16.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.278+0000 7fd536200640 1 -- 172.21.15.5:0/3639437964 shutdown_connections 2024-08-18T22:29:16.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.278+0000 7fd536200640 1 --2- 172.21.15.5:0/3639437964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd53015d4d0 0x7fd530166f10 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:16.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.278+0000 7fd536200640 1 -- 172.21.15.5:0/3639437964 >> 172.21.15.5:0/3639437964 conn(0x7fd5300b1dc0 msgr2=0x7fd5300b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:16.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.278+0000 7fd536200640 1 -- 172.21.15.5:0/3639437964 shutdown_connections 2024-08-18T22:29:16.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.278+0000 7fd536200640 1 -- 172.21.15.5:0/3639437964 wait complete. 2024-08-18T22:29:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd536200640 1 Processor -- start 2024-08-18T22:29:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd536200640 1 -- start start 2024-08-18T22:29:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd536200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd53015c180 0x7fd530163fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd536200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd53015d4d0 0x7fd5301644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd536200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd53015b4c0 0x7fd530150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd536200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd53016a000 con 0x7fd53015c180 2024-08-18T22:29:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd536200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd530169e80 con 0x7fd53015d4d0 2024-08-18T22:29:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd536200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd53016a180 con 0x7fd53015b4c0 2024-08-18T22:29:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd52f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd53015c180 0x7fd530163fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd52f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd53015c180 0x7fd530163fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58398/0 (socket says 172.21.15.5:58398) 2024-08-18T22:29:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd52f400640 1 -- 172.21.15.5:0/3953522807 learned_addr learned my addr 172.21.15.5:0/3953522807 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd526a00640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd53015d4d0 0x7fd5301644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd52fe00640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd53015b4c0 0x7fd530150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd52f400640 1 -- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd53015b4c0 msgr2=0x7fd530150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd52f400640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd53015b4c0 0x7fd530150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:16.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd52f400640 1 -- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd53015d4d0 msgr2=0x7fd5301644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd52f400640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd53015d4d0 0x7fd5301644e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd52f400640 1 -- 172.21.15.5:0/3953522807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd530155df0 con 0x7fd53015c180 2024-08-18T22:29:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd526a00640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd53015d4d0 0x7fd5301644e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd52f400640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd53015c180 0x7fd530163fa0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fd52000c440 tx=0x7fd52000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd527e00640 1 -- 172.21.15.5:0/3953522807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5200074e0 con 0x7fd53015c180 2024-08-18T22:29:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd527e00640 1 -- 172.21.15.5:0/3953522807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5200047f0 con 0x7fd53015c180 2024-08-18T22:29:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd527e00640 1 -- 172.21.15.5:0/3953522807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520007680 con 0x7fd53015c180 2024-08-18T22:29:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd536200640 1 -- 172.21.15.5:0/3953522807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5301560d0 con 0x7fd53015c180 2024-08-18T22:29:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd536200640 1 -- 172.21.15.5:0/3953522807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd530167110 con 0x7fd53015c180 2024-08-18T22:29:16.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.282+0000 7fd536200640 1 -- 172.21.15.5:0/3953522807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5300ce6d0 con 0x7fd53015c180 2024-08-18T22:29:16.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.286+0000 7fd527e00640 1 -- 172.21.15.5:0/3953522807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd520011070 con 0x7fd53015c180 2024-08-18T22:29:16.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.286+0000 7fd527e00640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd50c0678f0 0x7fd50c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:16.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.286+0000 7fd527e00640 1 -- 172.21.15.5:0/3953522807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5335+0+0 (secure 0 0 0) 0x7fd5200856f0 con 0x7fd53015c180 2024-08-18T22:29:16.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.286+0000 7fd526a00640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd50c0678f0 0x7fd50c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:16.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.286+0000 7fd526a00640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd50c0678f0 0x7fd50c069db0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd5300cfe10 tx=0x7fd518009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:16.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.290+0000 7fd527e00640 1 -- 172.21.15.5:0/3953522807 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd520056300 con 0x7fd53015c180 2024-08-18T22:29:16.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:16.466+0000 7fd536200640 1 -- 172.21.15.5:0/3953522807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd53009e380 con 0x7fd53015c180 2024-08-18T22:29:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.082+0000 7fd527e00640 1 -- 172.21.15.5:0/3953522807 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v149) ==== 97+0+0 (secure 0 0 0) 0x7fd520055c00 con 0x7fd53015c180 2024-08-18T22:29:18.085 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:29:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 -- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd50c0678f0 msgr2=0x7fd50c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd50c0678f0 0x7fd50c069db0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd5300cfe10 tx=0x7fd518009040 comp rx=0 tx=0).stop 2024-08-18T22:29:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 -- 172.21.15.5:0/3953522807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd53015c180 msgr2=0x7fd530163fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd53015c180 0x7fd530163fa0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fd52000c440 tx=0x7fd52000c900 comp rx=0 tx=0).stop 2024-08-18T22:29:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 -- 172.21.15.5:0/3953522807 shutdown_connections 2024-08-18T22:29:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd50c0678f0 0x7fd50c069db0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd53015b4c0 0x7fd530150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd53015d4d0 0x7fd5301644e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 --2- 172.21.15.5:0/3953522807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd53015c180 0x7fd530163fa0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 -- 172.21.15.5:0/3953522807 >> 172.21.15.5:0/3953522807 conn(0x7fd5300b1dc0 msgr2=0x7fd530071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 -- 172.21.15.5:0/3953522807 shutdown_connections 2024-08-18T22:29:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.086+0000 7fd536200640 1 -- 172.21.15.5:0/3953522807 wait complete. 2024-08-18T22:29:18.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:29:18.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.258+0000 7f03c8000640 1 Processor -- start 2024-08-18T22:29:18.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.258+0000 7f03c8000640 1 -- start start 2024-08-18T22:29:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.258+0000 7f03c8000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03c015e460 0x7f03c006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.258+0000 7f03c8000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f03c00cee40 0x7f03c00ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.258+0000 7f03c8000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03c015e840 con 0x7f03c00ca3e0 2024-08-18T22:29:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.258+0000 7f03c8000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f03c006c900 con 0x7f03c00cee40 2024-08-18T22:29:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.258+0000 7f03c8000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03c00cf320 con 0x7f03c015e460 2024-08-18T22:29:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03c6000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f03c00ca3e0 0x7f03c00d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58618/0 (socket says 172.21.15.5:58618) 2024-08-18T22:29:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03c6000640 1 -- 172.21.15.5:0/892529131 learned_addr learned my addr 172.21.15.5:0/892529131 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03c4c00640 1 --2- 172.21.15.5:0/892529131 >> v2:172.21.15.117:3300/0 conn(0x7f03c00cee40 0x7f03c00ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:18.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03c5600640 1 --2- 172.21.15.5:0/892529131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03c015e460 0x7f03c006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03bfe00640 1 -- 172.21.15.5:0/892529131 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102908477 0 0) 0x7f03c015e840 con 0x7f03c00ca3e0 2024-08-18T22:29:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03bfe00640 1 -- 172.21.15.5:0/892529131 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03a8003530 con 0x7f03c00ca3e0 2024-08-18T22:29:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03c5600640 1 -- 172.21.15.5:0/892529131 >> v2:172.21.15.117:3300/0 conn(0x7f03c00cee40 msgr2=0x7f03c00ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03c5600640 1 --2- 172.21.15.5:0/892529131 >> v2:172.21.15.117:3300/0 conn(0x7f03c00cee40 0x7f03c00ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03c5600640 1 -- 172.21.15.5:0/892529131 >> v1:172.21.15.5:6789/0 conn(0x7f03c00ca3e0 legacy=0x7f03c00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03c5600640 1 -- 172.21.15.5:0/892529131 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c00cf600 con 0x7f03c015e460 2024-08-18T22:29:18.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03c4c00640 1 --2- 172.21.15.5:0/892529131 >> v2:172.21.15.117:3300/0 conn(0x7f03c00cee40 0x7f03c00ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:18.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.262+0000 7f03c5600640 1 --2- 172.21.15.5:0/892529131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03c015e460 0x7f03c006c3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f03b40097c0 tx=0x7f03b401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e32ff3e835aff43c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:18.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03bfe00640 1 -- 172.21.15.5:0/892529131 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b40b5070 con 0x7f03c015e460 2024-08-18T22:29:18.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03bfe00640 1 -- 172.21.15.5:0/892529131 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03b40a8990 con 0x7f03c015e460 2024-08-18T22:29:18.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03bfe00640 1 -- 172.21.15.5:0/892529131 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b40a8d40 con 0x7f03c015e460 2024-08-18T22:29:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 -- 172.21.15.5:0/892529131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03c015e460 msgr2=0x7f03c006c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 --2- 172.21.15.5:0/892529131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03c015e460 0x7f03c006c3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f03b40097c0 tx=0x7f03b401ec90 comp rx=0 tx=0).stop 2024-08-18T22:29:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 -- 172.21.15.5:0/892529131 shutdown_connections 2024-08-18T22:29:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 --2- 172.21.15.5:0/892529131 >> v2:172.21.15.117:3300/0 conn(0x7f03c00cee40 0x7f03c00ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 --2- 172.21.15.5:0/892529131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03c015e460 0x7f03c006c3c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 -- 172.21.15.5:0/892529131 >> 172.21.15.5:0/892529131 conn(0x7f03c009aa40 msgr2=0x7f03c00b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 -- 172.21.15.5:0/892529131 shutdown_connections 2024-08-18T22:29:18.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 -- 172.21.15.5:0/892529131 wait complete. 2024-08-18T22:29:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 Processor -- start 2024-08-18T22:29:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 -- start start 2024-08-18T22:29:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03c00ca3e0 0x7f03c01f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03c00cee40 0x7f03c01608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03c015e460 0x7f03c00ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03c00cfea0 con 0x7f03c015e460 2024-08-18T22:29:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f03c00cfbc0 con 0x7f03c00ca3e0 2024-08-18T22:29:18.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c8000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03c00b3620 con 0x7f03c00cee40 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03c015e460 0x7f03c00ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03c015e460 0x7f03c00ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58402/0 (socket says 172.21.15.5:58402) 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c6000640 1 -- 172.21.15.5:0/3811437376 learned_addr learned my addr 172.21.15.5:0/3811437376 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c5600640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03c00ca3e0 0x7f03c01f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.266+0000 7f03c4c00640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03c00cee40 0x7f03c01608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03c6000640 1 -- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03c00cee40 msgr2=0x7f03c01608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03c6000640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03c00cee40 0x7f03c01608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03c6000640 1 -- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03c00ca3e0 msgr2=0x7f03c01f8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03c6000640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03c00ca3e0 0x7f03c01f8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03c6000640 1 -- 172.21.15.5:0/3811437376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c00cabe0 con 0x7f03c015e460 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03c6000640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03c015e460 0x7f03c00ae7f0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f03b800cb40 tx=0x7f03b800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03bd600640 1 -- 172.21.15.5:0/3811437376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b8017070 con 0x7f03c015e460 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03bd600640 1 -- 172.21.15.5:0/3811437376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03b800aca0 con 0x7f03c015e460 2024-08-18T22:29:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03bd600640 1 -- 172.21.15.5:0/3811437376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b8012620 con 0x7f03c015e460 2024-08-18T22:29:18.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03c8000640 1 -- 172.21.15.5:0/3811437376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c0161240 con 0x7f03c015e460 2024-08-18T22:29:18.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03c8000640 1 -- 172.21.15.5:0/3811437376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c01f7860 con 0x7f03c015e460 2024-08-18T22:29:18.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03c8000640 1 -- 172.21.15.5:0/3811437376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c006c3c0 con 0x7f03c015e460 2024-08-18T22:29:18.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03bd600640 1 -- 172.21.15.5:0/3811437376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f03b801a070 con 0x7f03c015e460 2024-08-18T22:29:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03bd600640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03a00678c0 0x7f03a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.270+0000 7f03bd600640 1 -- 172.21.15.5:0/3811437376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5249+0+0 (secure 0 0 0) 0x7f03b8085940 con 0x7f03c015e460 2024-08-18T22:29:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.274+0000 7f03c5600640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03a00678c0 0x7f03a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.274+0000 7f03c5600640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03a00678c0 0x7f03a0069d80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f03b40b2000 tx=0x7f03b40aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.274+0000 7f03bd600640 1 -- 172.21.15.5:0/3811437376 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f03b8055f50 con 0x7f03c015e460 2024-08-18T22:29:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.498+0000 7f03c8000640 1 -- 172.21.15.5:0/3811437376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f03c00b32d0 con 0x7f03c015e460 2024-08-18T22:29:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.498+0000 7f03bd600640 1 -- 172.21.15.5:0/3811437376 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7f03c00b32d0 con 0x7f03c015e460 2024-08-18T22:29:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:18.500 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:29:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:29:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:29:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:29:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:29:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:29:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:29:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:29:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:29:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:29:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:29:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:29:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:29:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:29:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:29:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:29:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:29:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:29:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:29:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:29:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:29:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:29:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:29:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:29:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:29:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:29:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:29:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:29:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:29:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:29:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:29:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:29:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:29:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:29:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:29:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:29:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:29:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:29:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:29:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:29:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:29:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:29:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:29:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:29:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:29:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:29:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:29:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:29:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:29:18.516 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:29:18.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 -- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03a00678c0 msgr2=0x7f03a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03a00678c0 0x7f03a0069d80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f03b40b2000 tx=0x7f03b40aa070 comp rx=0 tx=0).stop 2024-08-18T22:29:18.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 -- 172.21.15.5:0/3811437376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03c015e460 msgr2=0x7f03c00ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03c015e460 0x7f03c00ae7f0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f03b800cb40 tx=0x7f03b800a060 comp rx=0 tx=0).stop 2024-08-18T22:29:18.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 -- 172.21.15.5:0/3811437376 shutdown_connections 2024-08-18T22:29:18.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03a00678c0 0x7f03a0069d80 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03c015e460 0x7f03c00ae7f0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03c00cee40 0x7f03c01608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 --2- 172.21.15.5:0/3811437376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03c00ca3e0 0x7f03c01f8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 -- 172.21.15.5:0/3811437376 >> 172.21.15.5:0/3811437376 conn(0x7f03c009aa40 msgr2=0x7f03c00d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:18.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 -- 172.21.15.5:0/3811437376 shutdown_connections 2024-08-18T22:29:18.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.502+0000 7f03c8000640 1 -- 172.21.15.5:0/3811437376 wait complete. 2024-08-18T22:29:18.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:29:18.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf6ae00640 1 Processor -- start 2024-08-18T22:29:18.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf6ae00640 1 -- start start 2024-08-18T22:29:18.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf6ae00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf6415c320 0x7fcf6415f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf6ae00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf640cee10 con 0x7fcf640d1af0 2024-08-18T22:29:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf6ae00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf640cf0f0 con 0x7fcf640d4fa0 2024-08-18T22:29:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf6ae00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcf640cfa20 con 0x7fcf6415c320 2024-08-18T22:29:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf63e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf6415c320 0x7fcf6415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf68e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcf640d1af0 0x7fcf640d2390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58630/0 (socket says 172.21.15.5:58630) 2024-08-18T22:29:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf68e00640 1 -- 172.21.15.5:0/232943494 learned_addr learned my addr 172.21.15.5:0/232943494 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf63e00640 1 -- 172.21.15.5:0/232943494 >> v1:172.21.15.117:6789/0 conn(0x7fcf640d4fa0 legacy=0x7fcf640d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf63e00640 1 -- 172.21.15.5:0/232943494 >> v1:172.21.15.5:6789/0 conn(0x7fcf640d1af0 legacy=0x7fcf640d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf63e00640 1 -- 172.21.15.5:0/232943494 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf640cf3d0 con 0x7fcf6415c320 2024-08-18T22:29:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.662+0000 7fcf62a00640 1 -- 172.21.15.5:0/232943494 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038821230 0 0) 0x7fcf640cee10 con 0x7fcf640d1af0 2024-08-18T22:29:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.666+0000 7fcf63e00640 1 --2- 172.21.15.5:0/232943494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf6415c320 0x7fcf6415f490 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fcf540097c0 tx=0x7fcf5401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462099eb74314f1b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.666+0000 7fcf62a00640 1 -- 172.21.15.5:0/232943494 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf540b1070 con 0x7fcf6415c320 2024-08-18T22:29:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.666+0000 7fcf62a00640 1 -- 172.21.15.5:0/232943494 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf540ac410 con 0x7fcf6415c320 2024-08-18T22:29:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.666+0000 7fcf62a00640 1 -- 172.21.15.5:0/232943494 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf540ac7e0 con 0x7fcf6415c320 2024-08-18T22:29:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.666+0000 7fcf6ae00640 1 -- 172.21.15.5:0/232943494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf6415c320 msgr2=0x7fcf6415f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.666+0000 7fcf6ae00640 1 --2- 172.21.15.5:0/232943494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf6415c320 0x7fcf6415f490 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fcf540097c0 tx=0x7fcf5401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.666+0000 7fcf6ae00640 1 -- 172.21.15.5:0/232943494 shutdown_connections 2024-08-18T22:29:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.666+0000 7fcf6ae00640 1 --2- 172.21.15.5:0/232943494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf6415c320 0x7fcf6415f490 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.666+0000 7fcf6ae00640 1 -- 172.21.15.5:0/232943494 >> 172.21.15.5:0/232943494 conn(0x7fcf64067aa0 msgr2=0x7fcf64067eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.666+0000 7fcf6ae00640 1 -- 172.21.15.5:0/232943494 shutdown_connections 2024-08-18T22:29:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.666+0000 7fcf6ae00640 1 -- 172.21.15.5:0/232943494 wait complete. 2024-08-18T22:29:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf6ae00640 1 Processor -- start 2024-08-18T22:29:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf6ae00640 1 -- start start 2024-08-18T22:29:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf6ae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf640d1af0 0x7fcf641465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf6ae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf640d4fa0 0x7fcf64146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf6ae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf6415c320 0x7fcf64147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf6ae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6416c5b0 con 0x7fcf6415c320 2024-08-18T22:29:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf6ae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6416c430 con 0x7fcf640d4fa0 2024-08-18T22:29:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf6ae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6416c730 con 0x7fcf640d1af0 2024-08-18T22:29:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf68e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf6415c320 0x7fcf64147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf68e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf6415c320 0x7fcf64147190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58416/0 (socket says 172.21.15.5:58416) 2024-08-18T22:29:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf68e00640 1 -- 172.21.15.5:0/699856648 learned_addr learned my addr 172.21.15.5:0/699856648 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf63e00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf640d1af0 0x7fcf641465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf63400640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf640d4fa0 0x7fcf64146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf68e00640 1 -- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf640d1af0 msgr2=0x7fcf641465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf68e00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf640d1af0 0x7fcf641465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf68e00640 1 -- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf640d4fa0 msgr2=0x7fcf64146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf68e00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf640d4fa0 0x7fcf64146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf68e00640 1 -- 172.21.15.5:0/699856648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf640cb700 con 0x7fcf6415c320 2024-08-18T22:29:18.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf68e00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf6415c320 0x7fcf64147190 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00c780 tx=0x7fcf5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf5be00640 1 -- 172.21.15.5:0/699856648 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c018070 con 0x7fcf6415c320 2024-08-18T22:29:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf5be00640 1 -- 172.21.15.5:0/699856648 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5c00a640 con 0x7fcf6415c320 2024-08-18T22:29:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf5be00640 1 -- 172.21.15.5:0/699856648 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c00aab0 con 0x7fcf6415c320 2024-08-18T22:29:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf6ae00640 1 -- 172.21.15.5:0/699856648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf64147920 con 0x7fcf6415c320 2024-08-18T22:29:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.670+0000 7fcf6ae00640 1 -- 172.21.15.5:0/699856648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf640cbc80 con 0x7fcf6415c320 2024-08-18T22:29:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.674+0000 7fcf6ae00640 1 -- 172.21.15.5:0/699856648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf6415f490 con 0x7fcf6415c320 2024-08-18T22:29:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.674+0000 7fcf5be00640 1 -- 172.21.15.5:0/699856648 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf5c00ac50 con 0x7fcf6415c320 2024-08-18T22:29:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.674+0000 7fcf5be00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf440678c0 0x7fcf44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.674+0000 7fcf5be00640 1 -- 172.21.15.5:0/699856648 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5249+0+0 (secure 0 0 0) 0x7fcf5c085120 con 0x7fcf6415c320 2024-08-18T22:29:18.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.674+0000 7fcf63e00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf440678c0 0x7fcf44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.674+0000 7fcf63e00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf440678c0 0x7fcf44069d80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fcf540ae000 tx=0x7fcf540a6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:18.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.678+0000 7fcf5be00640 1 -- 172.21.15.5:0/699856648 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcf5c055730 con 0x7fcf6415c320 2024-08-18T22:29:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.842+0000 7fcf6ae00640 1 -- 172.21.15.5:0/699856648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcf64160400 con 0x7fcf6415c320 2024-08-18T22:29:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf5be00640 1 -- 172.21.15.5:0/699856648 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v149) ==== 84+0+65 (secure 0 0 0) 0x7fcf5c059a30 con 0x7fcf6415c320 2024-08-18T22:29:18.847 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:18.847 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:29:18.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:29:18.847 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:29:18.847 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:29:18.847 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:18.847 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:29:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 -- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf440678c0 msgr2=0x7fcf44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf440678c0 0x7fcf44069d80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fcf540ae000 tx=0x7fcf540a6040 comp rx=0 tx=0).stop 2024-08-18T22:29:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 -- 172.21.15.5:0/699856648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf6415c320 msgr2=0x7fcf64147190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:18.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf6415c320 0x7fcf64147190 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00c780 tx=0x7fcf5c00cc40 comp rx=0 tx=0).stop 2024-08-18T22:29:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 -- 172.21.15.5:0/699856648 shutdown_connections 2024-08-18T22:29:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf440678c0 0x7fcf44069d80 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf6415c320 0x7fcf64147190 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf640d4fa0 0x7fcf64146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 --2- 172.21.15.5:0/699856648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf640d1af0 0x7fcf641465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 -- 172.21.15.5:0/699856648 >> 172.21.15.5:0/699856648 conn(0x7fcf64067aa0 msgr2=0x7fcf6415ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 -- 172.21.15.5:0/699856648 shutdown_connections 2024-08-18T22:29:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:18.846+0000 7fcf6ae00640 1 -- 172.21.15.5:0/699856648 wait complete. 2024-08-18T22:29:18.868 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:29:18.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:29:19.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.010+0000 7f233f200640 1 Processor -- start 2024-08-18T22:29:19.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.010+0000 7f233f200640 1 -- start start 2024-08-18T22:29:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f233f200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f23380ccaa0 0x7f23380cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f233f200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23380b3260 con 0x7f233806dc60 2024-08-18T22:29:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f233f200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f233815d630 con 0x7f233815d1d0 2024-08-18T22:29:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f233f200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f23380cfe90 con 0x7f23380ccaa0 2024-08-18T22:29:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f233d200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f233806dc60 0x7f233806e0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58640/0 (socket says 172.21.15.5:58640) 2024-08-18T22:29:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f233d200640 1 -- 172.21.15.5:0/3124453611 learned_addr learned my addr 172.21.15.5:0/3124453611 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f2337e00640 1 --2- 172.21.15.5:0/3124453611 >> v2:172.21.15.117:3300/0 conn(0x7f23380ccaa0 0x7f23380cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f2337400640 1 -- 172.21.15.5:0/3124453611 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102723239 0 0) 0x7f23380b3260 con 0x7f233806dc60 2024-08-18T22:29:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f2337400640 1 -- 172.21.15.5:0/3124453611 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f231c003530 con 0x7f233806dc60 2024-08-18T22:29:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f2337e00640 1 -- 172.21.15.5:0/3124453611 >> v1:172.21.15.117:6789/0 conn(0x7f233815d1d0 legacy=0x7f23380cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f2337e00640 1 -- 172.21.15.5:0/3124453611 >> v1:172.21.15.5:6789/0 conn(0x7f233806dc60 legacy=0x7f233806e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.014+0000 7f2337e00640 1 -- 172.21.15.5:0/3124453611 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23380b3500 con 0x7f23380ccaa0 2024-08-18T22:29:19.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f2337e00640 1 --2- 172.21.15.5:0/3124453611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23380ccaa0 0x7f23380cf760 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f23280097c0 tx=0x7f232801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84b6399a1c28c830 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:19.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f2337400640 1 -- 172.21.15.5:0/3124453611 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280b0070 con 0x7f23380ccaa0 2024-08-18T22:29:19.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f2337400640 1 -- 172.21.15.5:0/3124453611 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23280ab600 con 0x7f23380ccaa0 2024-08-18T22:29:19.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f2337400640 1 -- 172.21.15.5:0/3124453611 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280ab9d0 con 0x7f23380ccaa0 2024-08-18T22:29:19.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f233f200640 1 -- 172.21.15.5:0/3124453611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23380ccaa0 msgr2=0x7f23380cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:19.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f233f200640 1 --2- 172.21.15.5:0/3124453611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23380ccaa0 0x7f23380cf760 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f23280097c0 tx=0x7f232801c410 comp rx=0 tx=0).stop 2024-08-18T22:29:19.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f233f200640 1 -- 172.21.15.5:0/3124453611 shutdown_connections 2024-08-18T22:29:19.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f233f200640 1 --2- 172.21.15.5:0/3124453611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23380ccaa0 0x7f23380cf760 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:19.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f233f200640 1 -- 172.21.15.5:0/3124453611 >> 172.21.15.5:0/3124453611 conn(0x7f233806b9b0 msgr2=0x7f233806bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:19.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f233f200640 1 -- 172.21.15.5:0/3124453611 shutdown_connections 2024-08-18T22:29:19.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f233f200640 1 -- 172.21.15.5:0/3124453611 wait complete. 2024-08-18T22:29:19.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f233f200640 1 Processor -- start 2024-08-18T22:29:19.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.018+0000 7f233f200640 1 -- start start 2024-08-18T22:29:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f233f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f233806dc60 0x7f233815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f233f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23380ccaa0 0x7f2338148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f233f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f233815d1d0 0x7f233814aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f233f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f233816a520 con 0x7f23380ccaa0 2024-08-18T22:29:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f233f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f23380af5c0 con 0x7f233806dc60 2024-08-18T22:29:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f233f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f233816a6a0 con 0x7f233815d1d0 2024-08-18T22:29:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f232f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23380ccaa0 0x7f2338148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f232f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23380ccaa0 0x7f2338148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58432/0 (socket says 172.21.15.5:58432) 2024-08-18T22:29:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f232f400640 1 -- 172.21.15.5:0/2386780910 learned_addr learned my addr 172.21.15.5:0/2386780910 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f2337e00640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f233806dc60 0x7f233815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f232f400640 1 -- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f233815d1d0 msgr2=0x7f233814aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f233d200640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f233815d1d0 0x7f233814aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f232f400640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f233815d1d0 0x7f233814aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f232f400640 1 -- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f233806dc60 msgr2=0x7f233815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f232f400640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f233806dc60 0x7f233815be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f232f400640 1 -- 172.21.15.5:0/2386780910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2338148f90 con 0x7f23380ccaa0 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f2337e00640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f233806dc60 0x7f233815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f233d200640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f233815d1d0 0x7f233814aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f232f400640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23380ccaa0 0x7f2338148a50 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f232000c3a0 tx=0x7f232000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f2334c00640 1 -- 172.21.15.5:0/2386780910 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23200052d0 con 0x7f23380ccaa0 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f2334c00640 1 -- 172.21.15.5:0/2386780910 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2320005470 con 0x7f23380ccaa0 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f2334c00640 1 -- 172.21.15.5:0/2386780910 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320007260 con 0x7f23380ccaa0 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f233f200640 1 -- 172.21.15.5:0/2386780910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2338149460 con 0x7f23380ccaa0 2024-08-18T22:29:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f233f200640 1 -- 172.21.15.5:0/2386780910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f233815b070 con 0x7f23380ccaa0 2024-08-18T22:29:19.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.022+0000 7f233f200640 1 -- 172.21.15.5:0/2386780910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23380cf760 con 0x7f23380ccaa0 2024-08-18T22:29:19.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.026+0000 7f2334c00640 1 -- 172.21.15.5:0/2386780910 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2320007400 con 0x7f23380ccaa0 2024-08-18T22:29:19.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.026+0000 7f2334c00640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23140678c0 0x7f2314069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.026+0000 7f2334c00640 1 -- 172.21.15.5:0/2386780910 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5249+0+0 (secure 0 0 0) 0x7f2320084fe0 con 0x7f23380ccaa0 2024-08-18T22:29:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.026+0000 7f2337e00640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23140678c0 0x7f2314069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.026+0000 7f2337e00640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23140678c0 0x7f2314069d80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f23280ad000 tx=0x7f2328008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:19.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.030+0000 7f2334c00640 1 -- 172.21.15.5:0/2386780910 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2320055c40 con 0x7f23380ccaa0 2024-08-18T22:29:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:19.202+0000 7f233f200640 1 -- 172.21.15.5:0/2386780910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f23380ae2d0 con 0x7f23380ccaa0 2024-08-18T22:29:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.098+0000 7f2334c00640 1 -- 172.21.15.5:0/2386780910 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v150) ==== 138+0+0 (secure 0 0 0) 0x7f2320055540 con 0x7f23380ccaa0 2024-08-18T22:29:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:29:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.098+0000 7f233f200640 1 -- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23140678c0 msgr2=0x7f2314069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.098+0000 7f233f200640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23140678c0 0x7f2314069d80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f23280ad000 tx=0x7f2328008040 comp rx=0 tx=0).stop 2024-08-18T22:29:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.098+0000 7f233f200640 1 -- 172.21.15.5:0/2386780910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23380ccaa0 msgr2=0x7f2338148a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.098+0000 7f233f200640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23380ccaa0 0x7f2338148a50 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f232000c3a0 tx=0x7f232000c860 comp rx=0 tx=0).stop 2024-08-18T22:29:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.098+0000 7f233f200640 1 -- 172.21.15.5:0/2386780910 shutdown_connections 2024-08-18T22:29:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.102+0000 7f233f200640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f23140678c0 0x7f2314069d80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.102+0000 7f233f200640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f233815d1d0 0x7f233814aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.102+0000 7f233f200640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23380ccaa0 0x7f2338148a50 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.102+0000 7f233f200640 1 --2- 172.21.15.5:0/2386780910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f233806dc60 0x7f233815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.102+0000 7f233f200640 1 -- 172.21.15.5:0/2386780910 >> 172.21.15.5:0/2386780910 conn(0x7f233806b9b0 msgr2=0x7f23380ad130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.102+0000 7f233f200640 1 -- 172.21.15.5:0/2386780910 shutdown_connections 2024-08-18T22:29:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.102+0000 7f233f200640 1 -- 172.21.15.5:0/2386780910 wait complete. 2024-08-18T22:29:20.129 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:29:20.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb44e600640 1 Processor -- start 2024-08-18T22:29:20.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb44e600640 1 -- start start 2024-08-18T22:29:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb44e600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb44815c180 0x7fb4480cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb44e600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb44815d4d0 0x7fb44806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb44e600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4480cfb00 con 0x7fb44815c560 2024-08-18T22:29:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb44e600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb44815d040 con 0x7fb44815d4d0 2024-08-18T22:29:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb44e600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb44815c9f0 con 0x7fb44815c180 2024-08-18T22:29:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb447e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb44815d4d0 0x7fb44806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:20.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb447e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb44815d4d0 0x7fb44806db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58440/0 (socket says 172.21.15.5:58440) 2024-08-18T22:29:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb447e00640 1 -- 172.21.15.5:0/2104035539 learned_addr learned my addr 172.21.15.5:0/2104035539 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb447400640 1 --2- 172.21.15.5:0/2104035539 >> v2:172.21.15.117:3300/0 conn(0x7fb44815c180 0x7fb4480cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb447e00640 1 -- 172.21.15.5:0/2104035539 >> v2:172.21.15.117:3300/0 conn(0x7fb44815c180 msgr2=0x7fb4480cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb447e00640 1 --2- 172.21.15.5:0/2104035539 >> v2:172.21.15.117:3300/0 conn(0x7fb44815c180 0x7fb4480cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb447e00640 1 -- 172.21.15.5:0/2104035539 >> v1:172.21.15.5:6789/0 conn(0x7fb44815c560 legacy=0x7fb4480ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb447e00640 1 -- 172.21.15.5:0/2104035539 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44815ccd0 con 0x7fb44815d4d0 2024-08-18T22:29:20.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.282+0000 7fb446000640 1 -- 172.21.15.5:0/2104035539 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534788358 0 0) 0x7fb4480cfb00 con 0x7fb44815c560 2024-08-18T22:29:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb447e00640 1 --2- 172.21.15.5:0/2104035539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44815d4d0 0x7fb44806db80 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb44806d8a0 tx=0x7fb44001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911af7bfbe953de3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb446000640 1 -- 172.21.15.5:0/2104035539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4400a5840 con 0x7fb44815d4d0 2024-08-18T22:29:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb446000640 1 -- 172.21.15.5:0/2104035539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4480ced70 con 0x7fb44815d4d0 2024-08-18T22:29:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb446000640 1 -- 172.21.15.5:0/2104035539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4400a5c00 con 0x7fb44815d4d0 2024-08-18T22:29:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb44e600640 1 -- 172.21.15.5:0/2104035539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44815d4d0 msgr2=0x7fb44806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb44e600640 1 --2- 172.21.15.5:0/2104035539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44815d4d0 0x7fb44806db80 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb44806d8a0 tx=0x7fb44001c960 comp rx=0 tx=0).stop 2024-08-18T22:29:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb44e600640 1 -- 172.21.15.5:0/2104035539 shutdown_connections 2024-08-18T22:29:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb44e600640 1 --2- 172.21.15.5:0/2104035539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44815d4d0 0x7fb44806db80 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb44e600640 1 --2- 172.21.15.5:0/2104035539 >> v2:172.21.15.117:3300/0 conn(0x7fb44815c180 0x7fb4480cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb44e600640 1 -- 172.21.15.5:0/2104035539 >> 172.21.15.5:0/2104035539 conn(0x7fb4480b1dc0 msgr2=0x7fb4480b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb44e600640 1 -- 172.21.15.5:0/2104035539 shutdown_connections 2024-08-18T22:29:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb44e600640 1 -- 172.21.15.5:0/2104035539 wait complete. 2024-08-18T22:29:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.286+0000 7fb44e600640 1 Processor -- start 2024-08-18T22:29:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb44e600640 1 -- start start 2024-08-18T22:29:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb44e600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb44815c180 0x7fb448154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb44e600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44815d4d0 0x7fb448166620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb44e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb44809c4d0 0x7fb4481594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb44e600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481692b0 con 0x7fb44815d4d0 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb44e600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb448169130 con 0x7fb44815c180 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb44e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb448169430 con 0x7fb44809c4d0 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb446a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44815d4d0 0x7fb448166620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb446a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44815d4d0 0x7fb448166620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58454/0 (socket says 172.21.15.5:58454) 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb446a00640 1 -- 172.21.15.5:0/3145032668 learned_addr learned my addr 172.21.15.5:0/3145032668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb447e00640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb44809c4d0 0x7fb4481594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb447400640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb44815c180 0x7fb448154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb446a00640 1 -- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb44809c4d0 msgr2=0x7fb4481594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb446a00640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb44809c4d0 0x7fb4481594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb446a00640 1 -- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb44815c180 msgr2=0x7fb448154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb446a00640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb44815c180 0x7fb448154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb446a00640 1 -- 172.21.15.5:0/3145032668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44809b430 con 0x7fb44815d4d0 2024-08-18T22:29:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb447400640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb44815c180 0x7fb448154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb446a00640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44815d4d0 0x7fb448166620 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c500 tx=0x7fb43400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb43f400640 1 -- 172.21.15.5:0/3145032668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434017070 con 0x7fb44815d4d0 2024-08-18T22:29:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb43f400640 1 -- 172.21.15.5:0/3145032668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb434003600 con 0x7fb44815d4d0 2024-08-18T22:29:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb44e600640 1 -- 172.21.15.5:0/3145032668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44809b710 con 0x7fb44815d4d0 2024-08-18T22:29:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb43f400640 1 -- 172.21.15.5:0/3145032668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4340039f0 con 0x7fb44815d4d0 2024-08-18T22:29:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb44e600640 1 -- 172.21.15.5:0/3145032668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44809bcd0 con 0x7fb44815d4d0 2024-08-18T22:29:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.290+0000 7fb44e600640 1 -- 172.21.15.5:0/3145032668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb448073d90 con 0x7fb44815d4d0 2024-08-18T22:29:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.294+0000 7fb43f400640 1 -- 172.21.15.5:0/3145032668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb43401a070 con 0x7fb44815d4d0 2024-08-18T22:29:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.294+0000 7fb43f400640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4280678c0 0x7fb428069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.294+0000 7fb43f400640 1 -- 172.21.15.5:0/3145032668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5619+0+0 (secure 0 0 0) 0x7fb434084ff0 con 0x7fb44815d4d0 2024-08-18T22:29:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.294+0000 7fb447400640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4280678c0 0x7fb428069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.294+0000 7fb447400640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4280678c0 0x7fb428069d80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb438009bb0 tx=0x7fb438008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:20.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.298+0000 7fb43f400640 1 -- 172.21.15.5:0/3145032668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb434055640 con 0x7fb44815d4d0 2024-08-18T22:29:20.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:20.466+0000 7fb44e600640 1 -- 172.21.15.5:0/3145032668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb44815b100 con 0x7fb44815d4d0 2024-08-18T22:29:21.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb43f400640 1 -- 172.21.15.5:0/3145032668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v151) ==== 170+0+0 (secure 0 0 0) 0x7fb434059940 con 0x7fb44815d4d0 2024-08-18T22:29:21.103 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:29:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 -- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4280678c0 msgr2=0x7fb428069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4280678c0 0x7fb428069d80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb438009bb0 tx=0x7fb438008040 comp rx=0 tx=0).stop 2024-08-18T22:29:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 -- 172.21.15.5:0/3145032668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44815d4d0 msgr2=0x7fb448166620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:21.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44815d4d0 0x7fb448166620 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c500 tx=0x7fb43400c9c0 comp rx=0 tx=0).stop 2024-08-18T22:29:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 -- 172.21.15.5:0/3145032668 shutdown_connections 2024-08-18T22:29:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb4280678c0 0x7fb428069d80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb44809c4d0 0x7fb4481594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb44815d4d0 0x7fb448166620 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 --2- 172.21.15.5:0/3145032668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb44815c180 0x7fb448154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 -- 172.21.15.5:0/3145032668 >> 172.21.15.5:0/3145032668 conn(0x7fb4480b1dc0 msgr2=0x7fb448072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 -- 172.21.15.5:0/3145032668 shutdown_connections 2024-08-18T22:29:21.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.102+0000 7fb44e600640 1 -- 172.21.15.5:0/3145032668 wait complete. 2024-08-18T22:29:21.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:29:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.290+0000 7fd4b0600640 1 Processor -- start 2024-08-18T22:29:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.290+0000 7fd4b0600640 1 -- start start 2024-08-18T22:29:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.290+0000 7fd4b0600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd4a815c180 0x7fd4a80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.290+0000 7fd4b0600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a815d4d0 0x7fd4a806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.290+0000 7fd4b0600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4a80cfb00 con 0x7fd4a815c560 2024-08-18T22:29:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.290+0000 7fd4b0600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd4a815d040 con 0x7fd4a815c180 2024-08-18T22:29:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.290+0000 7fd4b0600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4a815c9f0 con 0x7fd4a815d4d0 2024-08-18T22:29:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4adc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd4a815c180 0x7fd4a80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4ae600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a815d4d0 0x7fd4a806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4ad200640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd4a815c560 0x7fd4a80ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:57306/0 (socket says 172.21.15.5:57306) 2024-08-18T22:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4ad200640 1 -- 172.21.15.5:0/3330233091 learned_addr learned my addr 172.21.15.5:0/3330233091 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4a7e00640 1 -- 172.21.15.5:0/3330233091 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083151083 0 0) 0x7fd4a80cfb00 con 0x7fd4a815c560 2024-08-18T22:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4ae600640 1 -- 172.21.15.5:0/3330233091 >> v2:172.21.15.117:3300/0 conn(0x7fd4a815c180 msgr2=0x7fd4a80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4ae600640 1 --2- 172.21.15.5:0/3330233091 >> v2:172.21.15.117:3300/0 conn(0x7fd4a815c180 0x7fd4a80cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4ae600640 1 -- 172.21.15.5:0/3330233091 >> v1:172.21.15.117:6789/0 conn(0x7fd4a815c560 legacy=0x7fd4a80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4ae600640 1 -- 172.21.15.5:0/3330233091 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a815ccd0 con 0x7fd4a815d4d0 2024-08-18T22:29:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4ae600640 1 --2- 172.21.15.5:0/3330233091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a815d4d0 0x7fd4a806db80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009d90 tx=0x7fd4a001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aba553e537d65b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4a7e00640 1 -- 172.21.15.5:0/3330233091 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00b2070 con 0x7fd4a815d4d0 2024-08-18T22:29:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4a7e00640 1 -- 172.21.15.5:0/3330233091 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a80ced70 con 0x7fd4a815d4d0 2024-08-18T22:29:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.294+0000 7fd4a7e00640 1 -- 172.21.15.5:0/3330233091 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00a5be0 con 0x7fd4a815d4d0 2024-08-18T22:29:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 -- 172.21.15.5:0/3330233091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a815d4d0 msgr2=0x7fd4a806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 --2- 172.21.15.5:0/3330233091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a815d4d0 0x7fd4a806db80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009d90 tx=0x7fd4a001c8e0 comp rx=0 tx=0).stop 2024-08-18T22:29:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 -- 172.21.15.5:0/3330233091 shutdown_connections 2024-08-18T22:29:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 --2- 172.21.15.5:0/3330233091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a815d4d0 0x7fd4a806db80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 --2- 172.21.15.5:0/3330233091 >> v2:172.21.15.117:3300/0 conn(0x7fd4a815c180 0x7fd4a80cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 -- 172.21.15.5:0/3330233091 >> 172.21.15.5:0/3330233091 conn(0x7fd4a80b1dc0 msgr2=0x7fd4a80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 -- 172.21.15.5:0/3330233091 shutdown_connections 2024-08-18T22:29:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 -- 172.21.15.5:0/3330233091 wait complete. 2024-08-18T22:29:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 Processor -- start 2024-08-18T22:29:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 -- start start 2024-08-18T22:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a815c180 0x7fd4a814afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a815d4d0 0x7fd4a81594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a814f680 0x7fd4a81599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a81692b0 con 0x7fd4a814f680 2024-08-18T22:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a8169130 con 0x7fd4a815c180 2024-08-18T22:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4b0600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd4a8169430 con 0x7fd4a815d4d0 2024-08-18T22:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4ae600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a814f680 0x7fd4a81599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4adc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a815c180 0x7fd4a814afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4ae600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a814f680 0x7fd4a81599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58464/0 (socket says 172.21.15.5:58464) 2024-08-18T22:29:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4ae600640 1 -- 172.21.15.5:0/3526925239 learned_addr learned my addr 172.21.15.5:0/3526925239 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4ad200640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a815d4d0 0x7fd4a81594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4ae600640 1 -- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a815d4d0 msgr2=0x7fd4a81594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4ae600640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a815d4d0 0x7fd4a81594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4ae600640 1 -- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a815c180 msgr2=0x7fd4a814afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4ae600640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a815c180 0x7fd4a814afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4ae600640 1 -- 172.21.15.5:0/3526925239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a80721b0 con 0x7fd4a814f680 2024-08-18T22:29:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.298+0000 7fd4adc00640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a815c180 0x7fd4a814afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.302+0000 7fd4ae600640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a814f680 0x7fd4a81599f0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009d90 tx=0x7fd4a0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.302+0000 7fd4a5600640 1 -- 172.21.15.5:0/3526925239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00bd020 con 0x7fd4a814f680 2024-08-18T22:29:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.302+0000 7fd4a5600640 1 -- 172.21.15.5:0/3526925239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a00b3040 con 0x7fd4a814f680 2024-08-18T22:29:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.302+0000 7fd4b0600640 1 -- 172.21.15.5:0/3526925239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a8072490 con 0x7fd4a814f680 2024-08-18T22:29:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.302+0000 7fd4a5600640 1 -- 172.21.15.5:0/3526925239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00b2050 con 0x7fd4a814f680 2024-08-18T22:29:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.302+0000 7fd4b0600640 1 -- 172.21.15.5:0/3526925239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a8152da0 con 0x7fd4a814f680 2024-08-18T22:29:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.302+0000 7fd4b0600640 1 -- 172.21.15.5:0/3526925239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4a8072660 con 0x7fd4a814f680 2024-08-18T22:29:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.302+0000 7fd4a5600640 1 -- 172.21.15.5:0/3526925239 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd4a00ad650 con 0x7fd4a814f680 2024-08-18T22:29:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.306+0000 7fd4a5600640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4880678c0 0x7fd488069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.306+0000 7fd4a5600640 1 -- 172.21.15.5:0/3526925239 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 6001+0+0 (secure 0 0 0) 0x7fd4a01210a0 con 0x7fd4a814f680 2024-08-18T22:29:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.306+0000 7fd4adc00640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4880678c0 0x7fd488069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.306+0000 7fd4adc00640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4880678c0 0x7fd488069d80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8166df0 tx=0x7fd49c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.306+0000 7fd4a5600640 1 -- 172.21.15.5:0/3526925239 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd4a00c7060 con 0x7fd4a814f680 2024-08-18T22:29:21.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:21.506+0000 7fd4b0600640 1 -- 172.21.15.5:0/3526925239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd4a81557e0 con 0x7fd4a814f680 2024-08-18T22:29:21.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-08-18T22:29:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.118+0000 7fd4a5600640 1 -- 172.21.15.5:0/3526925239 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v113) ==== 174+0+0 (secure 0 0 0) 0x7fd4a0016560 con 0x7fd4a814f680 2024-08-18T22:29:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 21 and data pool 22 2024-08-18T22:29:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 -- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4880678c0 msgr2=0x7fd488069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4880678c0 0x7fd488069d80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8166df0 tx=0x7fd49c009190 comp rx=0 tx=0).stop 2024-08-18T22:29:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 -- 172.21.15.5:0/3526925239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a814f680 msgr2=0x7fd4a81599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a814f680 0x7fd4a81599f0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009d90 tx=0x7fd4a0019680 comp rx=0 tx=0).stop 2024-08-18T22:29:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 -- 172.21.15.5:0/3526925239 shutdown_connections 2024-08-18T22:29:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd4880678c0 0x7fd488069d80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4a814f680 0x7fd4a81599f0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a815d4d0 0x7fd4a81594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 --2- 172.21.15.5:0/3526925239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a815c180 0x7fd4a814afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 -- 172.21.15.5:0/3526925239 >> 172.21.15.5:0/3526925239 conn(0x7fd4a80b1dc0 msgr2=0x7fd4a8158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 -- 172.21.15.5:0/3526925239 shutdown_connections 2024-08-18T22:29:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.122+0000 7fd4b0600640 1 -- 172.21.15.5:0/3526925239 wait complete. 2024-08-18T22:29:22.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:29:22.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f9825400640 1 Processor -- start 2024-08-18T22:29:22.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f9825400640 1 -- start start 2024-08-18T22:29:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f9825400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9820071580 0x7f982006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f9825400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9820071c80 con 0x7f98200b54c0 2024-08-18T22:29:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f9825400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9820071f60 con 0x7f98200cbed0 2024-08-18T22:29:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f9825400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f98200cba40 con 0x7f9820071580 2024-08-18T22:29:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f981de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9820071580 0x7f982006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f981e800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f98200b54c0 0x7f98200b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58646/0 (socket says 172.21.15.5:58646) 2024-08-18T22:29:22.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f981e800640 1 -- 172.21.15.5:0/3522966882 learned_addr learned my addr 172.21.15.5:0/3522966882 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f981de00640 1 -- 172.21.15.5:0/3522966882 >> v1:172.21.15.117:6789/0 conn(0x7f98200cbed0 legacy=0x7f98200cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f981de00640 1 -- 172.21.15.5:0/3522966882 >> v1:172.21.15.5:6789/0 conn(0x7f98200b54c0 legacy=0x7f98200b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.314+0000 7f981de00640 1 -- 172.21.15.5:0/3522966882 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98200cb6d0 con 0x7f9820071580 2024-08-18T22:29:22.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981de00640 1 --2- 172.21.15.5:0/3522966882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9820071580 0x7f982006dd80 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f980c0097c0 tx=0x7f980c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cdcdef3be1e07c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:22.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981d400640 1 -- 172.21.15.5:0/3522966882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c0b5070 con 0x7f9820071580 2024-08-18T22:29:22.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981d400640 1 -- 172.21.15.5:0/3522966882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c0a8950 con 0x7f9820071580 2024-08-18T22:29:22.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981d400640 1 -- 172.21.15.5:0/3522966882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c0a8d20 con 0x7f9820071580 2024-08-18T22:29:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- 172.21.15.5:0/3522966882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9820071580 msgr2=0x7f982006dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 --2- 172.21.15.5:0/3522966882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9820071580 0x7f982006dd80 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f980c0097c0 tx=0x7f980c01ec50 comp rx=0 tx=0).stop 2024-08-18T22:29:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- 172.21.15.5:0/3522966882 shutdown_connections 2024-08-18T22:29:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 --2- 172.21.15.5:0/3522966882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9820071580 0x7f982006dd80 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- 172.21.15.5:0/3522966882 >> 172.21.15.5:0/3522966882 conn(0x7f98200b3eb0 msgr2=0x7f98200b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- 172.21.15.5:0/3522966882 shutdown_connections 2024-08-18T22:29:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- 172.21.15.5:0/3522966882 wait complete. 2024-08-18T22:29:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 Processor -- start 2024-08-18T22:29:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- start start 2024-08-18T22:29:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9820071580 0x7f9820136e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98200b54c0 0x7f98200b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200cbed0 0x7f98201f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f98201481a0 con 0x7f98200cbed0 2024-08-18T22:29:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9820148020 con 0x7f98200b54c0 2024-08-18T22:29:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f98200cca70 con 0x7f9820071580 2024-08-18T22:29:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200cbed0 0x7f98201f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200cbed0 0x7f98201f7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58494/0 (socket says 172.21.15.5:58494) 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981f200640 1 -- 172.21.15.5:0/417396925 learned_addr learned my addr 172.21.15.5:0/417396925 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981de00640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98200b54c0 0x7f98200b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981e800640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9820071580 0x7f9820136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981f200640 1 -- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9820071580 msgr2=0x7f9820136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981f200640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9820071580 0x7f9820136e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981f200640 1 -- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98200b54c0 msgr2=0x7f98200b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981f200640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98200b54c0 0x7f98200b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981f200640 1 -- 172.21.15.5:0/417396925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98201f8d40 con 0x7f98200cbed0 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981e800640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9820071580 0x7f9820136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f981f200640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200cbed0 0x7f98201f7e50 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f981800b990 tx=0x7f981800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9816a00640 1 -- 172.21.15.5:0/417396925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818019070 con 0x7f98200cbed0 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9816a00640 1 -- 172.21.15.5:0/417396925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981800cba0 con 0x7f98200cbed0 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9816a00640 1 -- 172.21.15.5:0/417396925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818014440 con 0x7f98200cbed0 2024-08-18T22:29:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- 172.21.15.5:0/417396925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98201f8a60 con 0x7f98200cbed0 2024-08-18T22:29:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- 172.21.15.5:0/417396925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9820136690 con 0x7f98200cbed0 2024-08-18T22:29:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.318+0000 7f9825400640 1 -- 172.21.15.5:0/417396925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98200ccea0 con 0x7f98200cbed0 2024-08-18T22:29:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.322+0000 7f9816a00640 1 -- 172.21.15.5:0/417396925 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f981801c070 con 0x7f98200cbed0 2024-08-18T22:29:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.322+0000 7f9816a00640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f98000678c0 0x7f9800069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.322+0000 7f9816a00640 1 -- 172.21.15.5:0/417396925 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f9818085b00 con 0x7f98200cbed0 2024-08-18T22:29:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.322+0000 7f981e800640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f98000678c0 0x7f9800069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.322+0000 7f981e800640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f98000678c0 0x7f9800069d80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9810000f70 tx=0x7f9810009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.326+0000 7f9816a00640 1 -- 172.21.15.5:0/417396925 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9818055e50 con 0x7f98200cbed0 2024-08-18T22:29:22.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.494+0000 7f9825400640 1 -- 172.21.15.5:0/417396925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f982006e1d0 con 0x7f98200cbed0 2024-08-18T22:29:22.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9816a00640 1 -- 172.21.15.5:0/417396925 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16833 (secure 0 0 0) 0x7f9818085e20 con 0x7f98200cbed0 2024-08-18T22:29:22.494 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:22.494 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":152,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:29:21.514080+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:29:19.253390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-08-18T22:29:20.520089+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:29:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 -- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f98000678c0 msgr2=0x7f9800069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f98000678c0 0x7f9800069d80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9810000f70 tx=0x7f9810009040 comp rx=0 tx=0).stop 2024-08-18T22:29:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 -- 172.21.15.5:0/417396925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200cbed0 msgr2=0x7f98201f7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200cbed0 0x7f98201f7e50 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f981800b990 tx=0x7f981800be50 comp rx=0 tx=0).stop 2024-08-18T22:29:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 -- 172.21.15.5:0/417396925 shutdown_connections 2024-08-18T22:29:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f98000678c0 0x7f9800069d80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98200cbed0 0x7f98201f7e50 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98200b54c0 0x7f98200b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 --2- 172.21.15.5:0/417396925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9820071580 0x7f9820136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 -- 172.21.15.5:0/417396925 >> 172.21.15.5:0/417396925 conn(0x7f98200b3eb0 msgr2=0x7f9820144b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 -- 172.21.15.5:0/417396925 shutdown_connections 2024-08-18T22:29:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.498+0000 7f9825400640 1 -- 172.21.15.5:0/417396925 wait complete. 2024-08-18T22:29:22.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:29:22.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f660c000640 1 Processor -- start 2024-08-18T22:29:22.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f660c000640 1 -- start start 2024-08-18T22:29:22.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f660c000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66040b54c0 0x7f6604071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f660c000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66040cbed0 0x7f66040cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f660c000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6604071c80 con 0x7f660406dd80 2024-08-18T22:29:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f660c000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f66040cba40 con 0x7f66040b54c0 2024-08-18T22:29:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f660c000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6604071f60 con 0x7f66040cbed0 2024-08-18T22:29:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f6609600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66040b54c0 0x7f6604071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f6609600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66040b54c0 0x7f6604071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58498/0 (socket says 172.21.15.5:58498) 2024-08-18T22:29:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f6609600640 1 -- 172.21.15.5:0/1466137524 learned_addr learned my addr 172.21.15.5:0/1466137524 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f660a000640 1 --2- 172.21.15.5:0/1466137524 >> v2:172.21.15.117:3300/0 conn(0x7f66040cbed0 0x7f66040cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f6609600640 1 -- 172.21.15.5:0/1466137524 >> v2:172.21.15.117:3300/0 conn(0x7f66040cbed0 msgr2=0x7f66040cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f6609600640 1 --2- 172.21.15.5:0/1466137524 >> v2:172.21.15.117:3300/0 conn(0x7f66040cbed0 0x7f66040cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f6609600640 1 -- 172.21.15.5:0/1466137524 >> v1:172.21.15.117:6789/0 conn(0x7f660406dd80 legacy=0x7f66040b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.658+0000 7f6609600640 1 -- 172.21.15.5:0/1466137524 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66040cb6d0 con 0x7f66040b54c0 2024-08-18T22:29:22.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f6609600640 1 --2- 172.21.15.5:0/1466137524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66040b54c0 0x7f6604071580 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f660406f4c0 tx=0x7f65f801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67de9eed71af2bf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f6603e00640 1 -- 172.21.15.5:0/1466137524 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f80b5070 con 0x7f66040b54c0 2024-08-18T22:29:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f6603e00640 1 -- 172.21.15.5:0/1466137524 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f80a89d0 con 0x7f66040b54c0 2024-08-18T22:29:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f6603e00640 1 -- 172.21.15.5:0/1466137524 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f80a8da0 con 0x7f66040b54c0 2024-08-18T22:29:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f660c000640 1 -- 172.21.15.5:0/1466137524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66040b54c0 msgr2=0x7f6604071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f660c000640 1 --2- 172.21.15.5:0/1466137524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66040b54c0 0x7f6604071580 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f660406f4c0 tx=0x7f65f801ecd0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f660c000640 1 -- 172.21.15.5:0/1466137524 shutdown_connections 2024-08-18T22:29:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f660c000640 1 --2- 172.21.15.5:0/1466137524 >> v2:172.21.15.117:3300/0 conn(0x7f66040cbed0 0x7f66040cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f660c000640 1 --2- 172.21.15.5:0/1466137524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66040b54c0 0x7f6604071580 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f660c000640 1 -- 172.21.15.5:0/1466137524 >> 172.21.15.5:0/1466137524 conn(0x7f66040b3eb0 msgr2=0x7f66040b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f660c000640 1 -- 172.21.15.5:0/1466137524 shutdown_connections 2024-08-18T22:29:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.662+0000 7f660c000640 1 -- 172.21.15.5:0/1466137524 wait complete. 2024-08-18T22:29:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660c000640 1 Processor -- start 2024-08-18T22:29:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660c000640 1 -- start start 2024-08-18T22:29:22.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660c000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660406dd80 0x7f660415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:22.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660c000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66040b54c0 0x7f660415d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:22.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660c000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66040cbed0 0x7f66041f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660c000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f66041481a0 con 0x7f66040cbed0 2024-08-18T22:29:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660c000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6604148020 con 0x7f660406dd80 2024-08-18T22:29:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660c000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f66040cc8a0 con 0x7f66040b54c0 2024-08-18T22:29:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66040cbed0 0x7f66041f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66040cbed0 0x7f66041f4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58500/0 (socket says 172.21.15.5:58500) 2024-08-18T22:29:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660a000640 1 -- 172.21.15.5:0/1343838905 learned_addr learned my addr 172.21.15.5:0/1343838905 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f6609600640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660406dd80 0x7f660415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f6608c00640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66040b54c0 0x7f660415d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660a000640 1 -- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66040b54c0 msgr2=0x7f660415d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660a000640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66040b54c0 0x7f660415d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660a000640 1 -- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660406dd80 msgr2=0x7f660415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660a000640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660406dd80 0x7f660415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660a000640 1 -- 172.21.15.5:0/1343838905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660413f360 con 0x7f66040cbed0 2024-08-18T22:29:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660a000640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66040cbed0 0x7f66041f4340 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f65fc007e90 tx=0x7f65fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f6601600640 1 -- 172.21.15.5:0/1343838905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc014420 con 0x7f66040cbed0 2024-08-18T22:29:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f6601600640 1 -- 172.21.15.5:0/1343838905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65fc019070 con 0x7f66040cbed0 2024-08-18T22:29:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f6601600640 1 -- 172.21.15.5:0/1343838905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc014800 con 0x7f66040cbed0 2024-08-18T22:29:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660c000640 1 -- 172.21.15.5:0/1343838905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660413f640 con 0x7f66040cbed0 2024-08-18T22:29:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.666+0000 7f660c000640 1 -- 172.21.15.5:0/1343838905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660415d5a0 con 0x7f66040cbed0 2024-08-18T22:29:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.670+0000 7f660c000640 1 -- 172.21.15.5:0/1343838905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660413f810 con 0x7f66040cbed0 2024-08-18T22:29:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.670+0000 7f6601600640 1 -- 172.21.15.5:0/1343838905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65fc0149a0 con 0x7f66040cbed0 2024-08-18T22:29:22.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.670+0000 7f6601600640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 0x7f65e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:22.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.670+0000 7f6601600640 1 -- 172.21.15.5:0/1343838905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f65fc0873f0 con 0x7f66040cbed0 2024-08-18T22:29:22.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.670+0000 7f6609600640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 0x7f65e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:22.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.674+0000 7f6609600640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 0x7f65e4069d80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f65f80b2000 tx=0x7f65f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:22.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.674+0000 7f6601600640 1 -- 172.21.15.5:0/1343838905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f65fc057e10 con 0x7f66040cbed0 2024-08-18T22:29:22.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 -- 172.21.15.5:0/1343838905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66040cc360 con 0x7f66040cbed0 2024-08-18T22:29:22.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f6601600640 1 -- 172.21.15.5:0/1343838905 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16833 (secure 0 0 0) 0x7f65fc057710 con 0x7f66040cbed0 2024-08-18T22:29:22.839 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:22.840 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":152,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:29:21.514080+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:29:19.253390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-08-18T22:29:20.520089+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:29:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 -- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 msgr2=0x7f65e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 0x7f65e4069d80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f65f80b2000 tx=0x7f65f8009040 comp rx=0 tx=0).stop 2024-08-18T22:29:22.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 -- 172.21.15.5:0/1343838905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66040cbed0 msgr2=0x7f66041f4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:22.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66040cbed0 0x7f66041f4340 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f65fc007e90 tx=0x7f65fc00e4b0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 -- 172.21.15.5:0/1343838905 shutdown_connections 2024-08-18T22:29:22.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f65e40678c0 0x7f65e4069d80 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66040cbed0 0x7f66041f4340 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66040b54c0 0x7f660415d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 --2- 172.21.15.5:0/1343838905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f660406dd80 0x7f660415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:22.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 -- 172.21.15.5:0/1343838905 >> 172.21.15.5:0/1343838905 conn(0x7f66040b3eb0 msgr2=0x7f66040b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:22.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 -- 172.21.15.5:0/1343838905 shutdown_connections 2024-08-18T22:29:22.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:22.842+0000 7f660c000640 1 -- 172.21.15.5:0/1343838905 wait complete. 2024-08-18T22:29:22.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:29:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.006+0000 7f1637000640 1 Processor -- start 2024-08-18T22:29:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.006+0000 7f1637000640 1 -- start start 2024-08-18T22:29:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f1637000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16300b40c0 0x7f16300b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f1637000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16300b31f0 con 0x7f16300ce280 2024-08-18T22:29:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f1637000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16300b34d0 con 0x7f163015b0c0 2024-08-18T22:29:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f1637000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f16300b4a70 con 0x7f16300b40c0 2024-08-18T22:29:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f1635000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f16300ce280 0x7f16300ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58662/0 (socket says 172.21.15.5:58662) 2024-08-18T22:29:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f1635000640 1 -- 172.21.15.5:0/1176093908 learned_addr learned my addr 172.21.15.5:0/1176093908 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f1627400640 1 --2- 172.21.15.5:0/1176093908 >> v2:172.21.15.117:3300/0 conn(0x7f16300b40c0 0x7f16300b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f162f400640 1 -- 172.21.15.5:0/1176093908 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678623942 0 0) 0x7f16300b31f0 con 0x7f16300ce280 2024-08-18T22:29:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f162f400640 1 -- 172.21.15.5:0/1176093908 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1614003530 con 0x7f16300ce280 2024-08-18T22:29:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f162f400640 1 -- 172.21.15.5:0/1176093908 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2618453999 0 0) 0x7f16300b34d0 con 0x7f163015b0c0 2024-08-18T22:29:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f162f400640 1 -- 172.21.15.5:0/1176093908 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16300b31f0 con 0x7f163015b0c0 2024-08-18T22:29:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f1627400640 1 -- 172.21.15.5:0/1176093908 >> v1:172.21.15.117:6789/0 conn(0x7f163015b0c0 legacy=0x7f163006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f1627400640 1 -- 172.21.15.5:0/1176093908 >> v1:172.21.15.5:6789/0 conn(0x7f16300ce280 legacy=0x7f16300ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:23.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.010+0000 7f1627400640 1 -- 172.21.15.5:0/1176093908 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16300b37b0 con 0x7f16300b40c0 2024-08-18T22:29:23.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f1627400640 1 --2- 172.21.15.5:0/1176093908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16300b40c0 0x7f16300b4530 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f16180097c0 tx=0x7f161801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a602a64757e5d51 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:23.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f162f400640 1 -- 172.21.15.5:0/1176093908 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16180b0070 con 0x7f16300b40c0 2024-08-18T22:29:23.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f162f400640 1 -- 172.21.15.5:0/1176093908 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16180ab600 con 0x7f16300b40c0 2024-08-18T22:29:23.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f162f400640 1 -- 172.21.15.5:0/1176093908 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16180ab9d0 con 0x7f16300b40c0 2024-08-18T22:29:23.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f1637000640 1 -- 172.21.15.5:0/1176093908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16300b40c0 msgr2=0x7f16300b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:23.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f1637000640 1 --2- 172.21.15.5:0/1176093908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16300b40c0 0x7f16300b4530 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f16180097c0 tx=0x7f161801c380 comp rx=0 tx=0).stop 2024-08-18T22:29:23.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f1637000640 1 -- 172.21.15.5:0/1176093908 shutdown_connections 2024-08-18T22:29:23.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f1637000640 1 --2- 172.21.15.5:0/1176093908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16300b40c0 0x7f16300b4530 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:23.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f1637000640 1 -- 172.21.15.5:0/1176093908 >> 172.21.15.5:0/1176093908 conn(0x7f16300b1dc0 msgr2=0x7f16300b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:23.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f1637000640 1 -- 172.21.15.5:0/1176093908 shutdown_connections 2024-08-18T22:29:23.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f1637000640 1 -- 172.21.15.5:0/1176093908 wait complete. 2024-08-18T22:29:23.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f1637000640 1 Processor -- start 2024-08-18T22:29:23.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.014+0000 7f1637000640 1 -- start start 2024-08-18T22:29:23.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f1637000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16300b40c0 0x7f1630147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:23.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f1637000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16300ce280 0x7f16300ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:23.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f1637000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f163015b0c0 0x7f16300ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:23.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f1637000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1630168d20 con 0x7f16300b40c0 2024-08-18T22:29:23.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f1637000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f163006f880 con 0x7f163015b0c0 2024-08-18T22:29:23.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f1637000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1630168ea0 con 0x7f16300ce280 2024-08-18T22:29:23.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16300b40c0 0x7f1630147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:23.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16300b40c0 0x7f1630147660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58504/0 (socket says 172.21.15.5:58504) 2024-08-18T22:29:23.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162fe00640 1 -- 172.21.15.5:0/1652863766 learned_addr learned my addr 172.21.15.5:0/1652863766 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:23.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162fe00640 1 -- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16300ce280 msgr2=0x7f16300ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:23.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162fe00640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16300ce280 0x7f16300ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:23.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162fe00640 1 -- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f163015b0c0 msgr2=0x7f16300ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:23.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162fe00640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f163015b0c0 0x7f16300ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:23.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162fe00640 1 -- 172.21.15.5:0/1652863766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1630147ba0 con 0x7f16300b40c0 2024-08-18T22:29:23.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162fe00640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16300b40c0 0x7f1630147660 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f162000c4c0 tx=0x7f162000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:23.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162cc00640 1 -- 172.21.15.5:0/1652863766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16200052d0 con 0x7f16300b40c0 2024-08-18T22:29:23.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162cc00640 1 -- 172.21.15.5:0/1652863766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1620005470 con 0x7f16300b40c0 2024-08-18T22:29:23.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f162cc00640 1 -- 172.21.15.5:0/1652863766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620012870 con 0x7f16300b40c0 2024-08-18T22:29:23.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f1637000640 1 -- 172.21.15.5:0/1652863766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16300add90 con 0x7f16300b40c0 2024-08-18T22:29:23.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f1637000640 1 -- 172.21.15.5:0/1652863766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16300ae350 con 0x7f16300b40c0 2024-08-18T22:29:23.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.018+0000 7f1637000640 1 -- 172.21.15.5:0/1652863766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16300b34d0 con 0x7f16300b40c0 2024-08-18T22:29:23.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.022+0000 7f162cc00640 1 -- 172.21.15.5:0/1652863766 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1620012a10 con 0x7f16300b40c0 2024-08-18T22:29:23.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.022+0000 7f162cc00640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f160c0678c0 0x7f160c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:23.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.022+0000 7f162cc00640 1 -- 172.21.15.5:0/1652863766 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f1620085c00 con 0x7f16300b40c0 2024-08-18T22:29:23.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.022+0000 7f1627400640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f160c0678c0 0x7f160c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:23.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.022+0000 7f1627400640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f160c0678c0 0x7f160c069d80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f16180ad000 tx=0x7f1618004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:23.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.026+0000 7f162cc00640 1 -- 172.21.15.5:0/1652863766 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1620056480 con 0x7f16300b40c0 2024-08-18T22:29:23.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:23.230+0000 7f1637000640 1 -- 172.21.15.5:0/1652863766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f16300b1b30 con 0x7f16300b40c0 2024-08-18T22:29:23.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:29:23.712 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:29:24.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.142+0000 7f162cc00640 1 -- 172.21.15.5:0/1652863766 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v116) ==== 118+0+0 (secure 0 0 0) 0x7f1620055d80 con 0x7f16300b40c0 2024-08-18T22:29:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 -- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f160c0678c0 msgr2=0x7f160c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f160c0678c0 0x7f160c069d80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f16180ad000 tx=0x7f1618004740 comp rx=0 tx=0).stop 2024-08-18T22:29:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 -- 172.21.15.5:0/1652863766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16300b40c0 msgr2=0x7f1630147660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16300b40c0 0x7f1630147660 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f162000c4c0 tx=0x7f162000c980 comp rx=0 tx=0).stop 2024-08-18T22:29:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 -- 172.21.15.5:0/1652863766 shutdown_connections 2024-08-18T22:29:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f160c0678c0 0x7f160c069d80 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f163015b0c0 0x7f16300ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16300ce280 0x7f16300ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 --2- 172.21.15.5:0/1652863766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16300b40c0 0x7f1630147660 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 -- 172.21.15.5:0/1652863766 >> 172.21.15.5:0/1652863766 conn(0x7f16300b1dc0 msgr2=0x7f163006db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 -- 172.21.15.5:0/1652863766 shutdown_connections 2024-08-18T22:29:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.146+0000 7f1637000640 1 -- 172.21.15.5:0/1652863766 wait complete. 2024-08-18T22:29:24.167 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:29:24.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:29:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.318+0000 7f33f1200640 1 Processor -- start 2024-08-18T22:29:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.318+0000 7f33f1200640 1 -- start start 2024-08-18T22:29:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.318+0000 7f33f1200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ec06ef60 0x7f33ec15e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:24.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.318+0000 7f33f1200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec15f780 con 0x7f33ec06d0d0 2024-08-18T22:29:24.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.318+0000 7f33f1200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec06f3b0 con 0x7f33ec158710 2024-08-18T22:29:24.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.318+0000 7f33f1200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f33ec15eee0 con 0x7f33ec06ef60 2024-08-18T22:29:24.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.318+0000 7f33e1400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f33ec06d0d0 0x7f33ec0af390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59846/0 (socket says 172.21.15.5:59846) 2024-08-18T22:29:24.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.318+0000 7f33e1400640 1 -- 172.21.15.5:0/2015213786 learned_addr learned my addr 172.21.15.5:0/2015213786 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:24.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33ea800640 1 --2- 172.21.15.5:0/2015213786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ec06ef60 0x7f33ec15e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:24.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33e9400640 1 -- 172.21.15.5:0/2015213786 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737640969 0 0) 0x7f33ec15f780 con 0x7f33ec06d0d0 2024-08-18T22:29:24.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33e9400640 1 -- 172.21.15.5:0/2015213786 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33d0003530 con 0x7f33ec06d0d0 2024-08-18T22:29:24.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33e9400640 1 -- 172.21.15.5:0/2015213786 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828370070 0 0) 0x7f33ec06f3b0 con 0x7f33ec158710 2024-08-18T22:29:24.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33e9400640 1 -- 172.21.15.5:0/2015213786 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33ec15f780 con 0x7f33ec158710 2024-08-18T22:29:24.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33ea800640 1 -- 172.21.15.5:0/2015213786 >> v1:172.21.15.117:6789/0 conn(0x7f33ec158710 legacy=0x7f33ec06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:24.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33ea800640 1 -- 172.21.15.5:0/2015213786 >> v1:172.21.15.5:6789/0 conn(0x7f33ec06d0d0 legacy=0x7f33ec0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:24.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33ea800640 1 -- 172.21.15.5:0/2015213786 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ec15f1c0 con 0x7f33ec06ef60 2024-08-18T22:29:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33ea800640 1 --2- 172.21.15.5:0/2015213786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ec06ef60 0x7f33ec15e7b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009df0 tx=0x7f33e401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1436f6dff8385323 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33e9400640 1 -- 172.21.15.5:0/2015213786 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e40b2070 con 0x7f33ec06ef60 2024-08-18T22:29:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33e9400640 1 -- 172.21.15.5:0/2015213786 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e40a5940 con 0x7f33ec06ef60 2024-08-18T22:29:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.322+0000 7f33e9400640 1 -- 172.21.15.5:0/2015213786 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e40a5d10 con 0x7f33ec06ef60 2024-08-18T22:29:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 -- 172.21.15.5:0/2015213786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ec06ef60 msgr2=0x7f33ec15e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 --2- 172.21.15.5:0/2015213786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ec06ef60 0x7f33ec15e7b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009df0 tx=0x7f33e401c990 comp rx=0 tx=0).stop 2024-08-18T22:29:24.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 -- 172.21.15.5:0/2015213786 shutdown_connections 2024-08-18T22:29:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 --2- 172.21.15.5:0/2015213786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ec06ef60 0x7f33ec15e7b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 -- 172.21.15.5:0/2015213786 >> 172.21.15.5:0/2015213786 conn(0x7f33ec072350 msgr2=0x7f33ec072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 -- 172.21.15.5:0/2015213786 shutdown_connections 2024-08-18T22:29:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 -- 172.21.15.5:0/2015213786 wait complete. 2024-08-18T22:29:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 Processor -- start 2024-08-18T22:29:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 -- start start 2024-08-18T22:29:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33ec06d0d0 0x7f33ec144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ec06ef60 0x7f33ec150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec158710 0x7f33ec14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec0b5050 con 0x7f33ec158710 2024-08-18T22:29:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec0b4ed0 con 0x7f33ec06d0d0 2024-08-18T22:29:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33f1200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f33ec16be00 con 0x7f33ec06ef60 2024-08-18T22:29:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33ea800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec158710 0x7f33ec14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33ea800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec158710 0x7f33ec14e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46784/0 (socket says 172.21.15.5:46784) 2024-08-18T22:29:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33ea800640 1 -- 172.21.15.5:0/3234860971 learned_addr learned my addr 172.21.15.5:0/3234860971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33e1400640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ec06ef60 0x7f33ec150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33e9e00640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33ec06d0d0 0x7f33ec144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33ea800640 1 -- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ec06ef60 msgr2=0x7f33ec150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33ea800640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ec06ef60 0x7f33ec150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33ea800640 1 -- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33ec06d0d0 msgr2=0x7f33ec144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33ea800640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33ec06d0d0 0x7f33ec144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33ea800640 1 -- 172.21.15.5:0/3234860971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ec15e240 con 0x7f33ec158710 2024-08-18T22:29:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.326+0000 7f33ea800640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec158710 0x7f33ec14e7f0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f33e40b0040 tx=0x7f33e4019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.330+0000 7f33e2a00640 1 -- 172.21.15.5:0/3234860971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e40b2050 con 0x7f33ec158710 2024-08-18T22:29:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.330+0000 7f33e2a00640 1 -- 172.21.15.5:0/3234860971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e40be070 con 0x7f33ec158710 2024-08-18T22:29:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.330+0000 7f33e2a00640 1 -- 172.21.15.5:0/3234860971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e40b9690 con 0x7f33ec158710 2024-08-18T22:29:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.330+0000 7f33f1200640 1 -- 172.21.15.5:0/3234860971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33ec150e30 con 0x7f33ec158710 2024-08-18T22:29:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.330+0000 7f33f1200640 1 -- 172.21.15.5:0/3234860971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33ec15fcd0 con 0x7f33ec158710 2024-08-18T22:29:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.330+0000 7f33f1200640 1 -- 172.21.15.5:0/3234860971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33ec067a30 con 0x7f33ec158710 2024-08-18T22:29:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.330+0000 7f33e2a00640 1 -- 172.21.15.5:0/3234860971 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33e40b9830 con 0x7f33ec158710 2024-08-18T22:29:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.330+0000 7f33e2a00640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c80678c0 0x7f33c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.330+0000 7f33e2a00640 1 -- 172.21.15.5:0/3234860971 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f33e4120a30 con 0x7f33ec158710 2024-08-18T22:29:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.330+0000 7f33e9e00640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c80678c0 0x7f33c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.334+0000 7f33e9e00640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c80678c0 0x7f33c8069d80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0011f0 tx=0x7f33dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.334+0000 7f33e2a00640 1 -- 172.21.15.5:0/3234860971 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f33e4016580 con 0x7f33ec158710 2024-08-18T22:29:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:24.538+0000 7f33f1200640 1 -- 172.21.15.5:0/3234860971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f33ec15e7b0 con 0x7f33ec158710 2024-08-18T22:29:25.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33e2a00640 1 -- 172.21.15.5:0/3234860971 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v117) ==== 122+0+0 (secure 0 0 0) 0x7f33e40f0e40 con 0x7f33ec158710 2024-08-18T22:29:25.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 -- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c80678c0 msgr2=0x7f33c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c80678c0 0x7f33c8069d80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0011f0 tx=0x7f33dc009040 comp rx=0 tx=0).stop 2024-08-18T22:29:25.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 -- 172.21.15.5:0/3234860971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec158710 msgr2=0x7f33ec14e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec158710 0x7f33ec14e7f0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f33e40b0040 tx=0x7f33e4019730 comp rx=0 tx=0).stop 2024-08-18T22:29:25.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 -- 172.21.15.5:0/3234860971 shutdown_connections 2024-08-18T22:29:25.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33c80678c0 0x7f33c8069d80 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ec158710 0x7f33ec14e7f0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ec06ef60 0x7f33ec150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 --2- 172.21.15.5:0/3234860971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33ec06d0d0 0x7f33ec144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 -- 172.21.15.5:0/3234860971 >> 172.21.15.5:0/3234860971 conn(0x7f33ec072350 msgr2=0x7f33ec14f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:25.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 -- 172.21.15.5:0/3234860971 shutdown_connections 2024-08-18T22:29:25.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.146+0000 7f33f1200640 1 -- 172.21.15.5:0/3234860971 wait complete. 2024-08-18T22:29:25.169 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:29:25.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:25.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a69200640 1 Processor -- start 2024-08-18T22:29:25.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a69200640 1 -- start start 2024-08-18T22:29:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a69200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a6415e140 0x7f8a640b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a69200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8a640afe50 0x7f8a6406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a69200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a640b65d0 con 0x7f8a640b5e60 2024-08-18T22:29:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a69200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8a6406e560 con 0x7f8a6415e140 2024-08-18T22:29:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a69200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8a640b68b0 con 0x7f8a640afe50 2024-08-18T22:29:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a61e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a6415e140 0x7f8a640b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a61400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8a640b5e60 0x7f8a640af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59860/0 (socket says 172.21.15.5:59860) 2024-08-18T22:29:25.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a61400640 1 -- 172.21.15.5:0/4280137497 learned_addr learned my addr 172.21.15.5:0/4280137497 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:25.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a61e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a6415e140 0x7f8a640b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46794/0 (socket says 172.21.15.5:46794) 2024-08-18T22:29:25.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a62800640 1 --2- 172.21.15.5:0/4280137497 >> v2:172.21.15.117:3300/0 conn(0x7f8a640afe50 0x7f8a6406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a61e00640 1 -- 172.21.15.5:0/4280137497 >> v2:172.21.15.117:3300/0 conn(0x7f8a640afe50 msgr2=0x7f8a6406efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:25.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a61e00640 1 --2- 172.21.15.5:0/4280137497 >> v2:172.21.15.117:3300/0 conn(0x7f8a640afe50 0x7f8a6406efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a61e00640 1 -- 172.21.15.5:0/4280137497 >> v1:172.21.15.5:6789/0 conn(0x7f8a640b5e60 legacy=0x7f8a640af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.314+0000 7f8a61e00640 1 -- 172.21.15.5:0/4280137497 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6406e7b0 con 0x7f8a6415e140 2024-08-18T22:29:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a61e00640 1 --2- 172.21.15.5:0/4280137497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a6415e140 0x7f8a640b4e40 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f8a64071fb0 tx=0x7f8a5401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78620abff7d91f3a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:25.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a60a00640 1 -- 172.21.15.5:0/4280137497 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a540ab610 con 0x7f8a6415e140 2024-08-18T22:29:25.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a60a00640 1 -- 172.21.15.5:0/4280137497 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a540b0070 con 0x7f8a6415e140 2024-08-18T22:29:25.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a60a00640 1 -- 172.21.15.5:0/4280137497 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a540ab9d0 con 0x7f8a6415e140 2024-08-18T22:29:25.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a69200640 1 -- 172.21.15.5:0/4280137497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a6415e140 msgr2=0x7f8a640b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a69200640 1 --2- 172.21.15.5:0/4280137497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a6415e140 0x7f8a640b4e40 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f8a64071fb0 tx=0x7f8a5401c3f0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a69200640 1 -- 172.21.15.5:0/4280137497 shutdown_connections 2024-08-18T22:29:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a69200640 1 --2- 172.21.15.5:0/4280137497 >> v2:172.21.15.117:3300/0 conn(0x7f8a640afe50 0x7f8a6406efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a69200640 1 --2- 172.21.15.5:0/4280137497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a6415e140 0x7f8a640b4e40 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a69200640 1 -- 172.21.15.5:0/4280137497 >> 172.21.15.5:0/4280137497 conn(0x7f8a6406b9b0 msgr2=0x7f8a6406bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a69200640 1 -- 172.21.15.5:0/4280137497 shutdown_connections 2024-08-18T22:29:25.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.318+0000 7f8a69200640 1 -- 172.21.15.5:0/4280137497 wait complete. 2024-08-18T22:29:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a69200640 1 Processor -- start 2024-08-18T22:29:25.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a69200640 1 -- start start 2024-08-18T22:29:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a69200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a640afe50 0x7f8a6415e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a69200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640b5e60 0x7f8a6415fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a69200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a6415e140 0x7f8a64149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a69200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6406fe80 con 0x7f8a640b5e60 2024-08-18T22:29:25.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a69200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6406fd00 con 0x7f8a6415e140 2024-08-18T22:29:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a69200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8a64070000 con 0x7f8a640afe50 2024-08-18T22:29:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a61400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640b5e60 0x7f8a6415fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a61400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640b5e60 0x7f8a6415fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46800/0 (socket says 172.21.15.5:46800) 2024-08-18T22:29:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a61400640 1 -- 172.21.15.5:0/794661095 learned_addr learned my addr 172.21.15.5:0/794661095 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a61e00640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a640afe50 0x7f8a6415e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a62800640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a6415e140 0x7f8a64149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a61400640 1 -- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a640afe50 msgr2=0x7f8a6415e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a61400640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a640afe50 0x7f8a6415e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a61400640 1 -- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a6415e140 msgr2=0x7f8a64149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a61400640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a6415e140 0x7f8a64149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a61400640 1 -- 172.21.15.5:0/794661095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a640cf470 con 0x7f8a640b5e60 2024-08-18T22:29:25.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a61400640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640b5e60 0x7f8a6415fea0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c370 tx=0x7f8a5000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:25.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a5a000640 1 -- 172.21.15.5:0/794661095 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50017070 con 0x7f8a640b5e60 2024-08-18T22:29:25.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a5a000640 1 -- 172.21.15.5:0/794661095 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a50005cf0 con 0x7f8a640b5e60 2024-08-18T22:29:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a5a000640 1 -- 172.21.15.5:0/794661095 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500072f0 con 0x7f8a640b5e60 2024-08-18T22:29:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a69200640 1 -- 172.21.15.5:0/794661095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a640cf750 con 0x7f8a640b5e60 2024-08-18T22:29:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.322+0000 7f8a69200640 1 -- 172.21.15.5:0/794661095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a64149780 con 0x7f8a640b5e60 2024-08-18T22:29:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.326+0000 7f8a69200640 1 -- 172.21.15.5:0/794661095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a6406efb0 con 0x7f8a640b5e60 2024-08-18T22:29:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.326+0000 7f8a5a000640 1 -- 172.21.15.5:0/794661095 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a5001a070 con 0x7f8a640b5e60 2024-08-18T22:29:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.326+0000 7f8a5a000640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a440678f0 0x7f8a44069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.326+0000 7f8a5a000640 1 -- 172.21.15.5:0/794661095 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f8a500850e0 con 0x7f8a640b5e60 2024-08-18T22:29:25.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.326+0000 7f8a61e00640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a440678f0 0x7f8a44069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.326+0000 7f8a61e00640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a440678f0 0x7f8a44069db0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8a540af000 tx=0x7f8a540a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.330+0000 7f8a5a000640 1 -- 172.21.15.5:0/794661095 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8a50055430 con 0x7f8a640b5e60 2024-08-18T22:29:25.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.530+0000 7f8a69200640 1 -- 172.21.15.5:0/794661095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a640d06c0 con 0x7f8a640b5e60 2024-08-18T22:29:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.530+0000 7f8a5a000640 1 -- 172.21.15.5:0/794661095 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7f8a50059730 con 0x7f8a640b5e60 2024-08-18T22:29:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:25.529 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:29:25.529 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:29:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 -- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a440678f0 msgr2=0x7f8a44069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a440678f0 0x7f8a44069db0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8a540af000 tx=0x7f8a540a7000 comp rx=0 tx=0).stop 2024-08-18T22:29:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 -- 172.21.15.5:0/794661095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640b5e60 msgr2=0x7f8a6415fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640b5e60 0x7f8a6415fea0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c370 tx=0x7f8a5000c830 comp rx=0 tx=0).stop 2024-08-18T22:29:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 -- 172.21.15.5:0/794661095 shutdown_connections 2024-08-18T22:29:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a440678f0 0x7f8a44069db0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a6415e140 0x7f8a64149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640b5e60 0x7f8a6415fea0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 --2- 172.21.15.5:0/794661095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a640afe50 0x7f8a6415e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 -- 172.21.15.5:0/794661095 >> 172.21.15.5:0/794661095 conn(0x7f8a6406b9b0 msgr2=0x7f8a64155110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 -- 172.21.15.5:0/794661095 shutdown_connections 2024-08-18T22:29:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.534+0000 7f8a69200640 1 -- 172.21.15.5:0/794661095 wait complete. 2024-08-18T22:29:25.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:29:25.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bfa00640 1 Processor -- start 2024-08-18T22:29:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bfa00640 1 -- start start 2024-08-18T22:29:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bfa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb3b80b54c0 0x7fb3b8071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80cbed0 0x7fb3b80cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bfa00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b8071c80 con 0x7fb3b806dd80 2024-08-18T22:29:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bfa00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b80cba40 con 0x7fb3b80b54c0 2024-08-18T22:29:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b8071f60 con 0x7fb3b80cbed0 2024-08-18T22:29:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bd000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb3b80b54c0 0x7fb3b8071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bda00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80cbed0 0x7fb3b80cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bd000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb3b80b54c0 0x7fb3b8071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:33262/0 (socket says 172.21.15.5:33262) 2024-08-18T22:29:25.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bd000640 1 -- 172.21.15.5:0/2728877483 learned_addr learned my addr 172.21.15.5:0/2728877483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:25.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bd000640 1 -- 172.21.15.5:0/2728877483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80cbed0 msgr2=0x7fb3b80cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:25.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bd000640 1 --2- 172.21.15.5:0/2728877483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80cbed0 0x7fb3b80cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bd000640 1 -- 172.21.15.5:0/2728877483 >> v1:172.21.15.117:6789/0 conn(0x7fb3b806dd80 legacy=0x7fb3b80b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.694+0000 7fb3bd000640 1 -- 172.21.15.5:0/2728877483 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b80cb6d0 con 0x7fb3b80b54c0 2024-08-18T22:29:25.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3bd000640 1 --2- 172.21.15.5:0/2728877483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b80b54c0 0x7fb3b8071580 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009870 tx=0x7fb3a801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8942d7df61cc1d72 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:25.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3b7e00640 1 -- 172.21.15.5:0/2728877483 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a80b5070 con 0x7fb3b80b54c0 2024-08-18T22:29:25.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3b7e00640 1 -- 172.21.15.5:0/2728877483 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a80a8a50 con 0x7fb3b80b54c0 2024-08-18T22:29:25.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3b7e00640 1 -- 172.21.15.5:0/2728877483 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a80a8e20 con 0x7fb3b80b54c0 2024-08-18T22:29:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3bfa00640 1 -- 172.21.15.5:0/2728877483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b80b54c0 msgr2=0x7fb3b8071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3bfa00640 1 --2- 172.21.15.5:0/2728877483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b80b54c0 0x7fb3b8071580 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009870 tx=0x7fb3a801ed50 comp rx=0 tx=0).stop 2024-08-18T22:29:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3bfa00640 1 -- 172.21.15.5:0/2728877483 shutdown_connections 2024-08-18T22:29:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3bfa00640 1 --2- 172.21.15.5:0/2728877483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80cbed0 0x7fb3b80cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3bfa00640 1 --2- 172.21.15.5:0/2728877483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b80b54c0 0x7fb3b8071580 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3bfa00640 1 -- 172.21.15.5:0/2728877483 >> 172.21.15.5:0/2728877483 conn(0x7fb3b80b3eb0 msgr2=0x7fb3b80b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3bfa00640 1 -- 172.21.15.5:0/2728877483 shutdown_connections 2024-08-18T22:29:25.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.698+0000 7fb3bfa00640 1 -- 172.21.15.5:0/2728877483 wait complete. 2024-08-18T22:29:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bfa00640 1 Processor -- start 2024-08-18T22:29:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bfa00640 1 -- start start 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b806dd80 0x7fb3b8142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80b54c0 0x7fb3b81f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80cbed0 0x7fb3b81458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81481a0 con 0x7fb3b80cbed0 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b8148020 con 0x7fb3b806dd80 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b80cc8a0 con 0x7fb3b80b54c0 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bda00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80cbed0 0x7fb3b81458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bda00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80cbed0 0x7fb3b81458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46810/0 (socket says 172.21.15.5:46810) 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bda00640 1 -- 172.21.15.5:0/3234476190 learned_addr learned my addr 172.21.15.5:0/3234476190 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bd000640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b806dd80 0x7fb3b8142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3afe00640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80b54c0 0x7fb3b81f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bda00640 1 -- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80b54c0 msgr2=0x7fb3b81f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bda00640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80b54c0 0x7fb3b81f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bda00640 1 -- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b806dd80 msgr2=0x7fb3b8142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bda00640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b806dd80 0x7fb3b8142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bda00640 1 -- 172.21.15.5:0/3234476190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b80cffa0 con 0x7fb3b80cbed0 2024-08-18T22:29:25.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3afe00640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80b54c0 0x7fb3b81f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bda00640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80cbed0 0x7fb3b81458e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000efc0 tx=0x7fb3b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3b5600640 1 -- 172.21.15.5:0/3234476190 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0018020 con 0x7fb3b80cbed0 2024-08-18T22:29:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3b5600640 1 -- 172.21.15.5:0/3234476190 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b0014480 con 0x7fb3b80cbed0 2024-08-18T22:29:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bfa00640 1 -- 172.21.15.5:0/3234476190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b80d0280 con 0x7fb3b80cbed0 2024-08-18T22:29:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3b5600640 1 -- 172.21.15.5:0/3234476190 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0014870 con 0x7fb3b80cbed0 2024-08-18T22:29:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.702+0000 7fb3bfa00640 1 -- 172.21.15.5:0/3234476190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b81f5720 con 0x7fb3b80cbed0 2024-08-18T22:29:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.706+0000 7fb3bfa00640 1 -- 172.21.15.5:0/3234476190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b80cc360 con 0x7fb3b80cbed0 2024-08-18T22:29:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.706+0000 7fb3b5600640 1 -- 172.21.15.5:0/3234476190 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3b001b020 con 0x7fb3b80cbed0 2024-08-18T22:29:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.706+0000 7fb3b5600640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3940678c0 0x7fb394069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.706+0000 7fb3b5600640 1 -- 172.21.15.5:0/3234476190 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fb3b0086880 con 0x7fb3b80cbed0 2024-08-18T22:29:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.706+0000 7fb3bd000640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3940678c0 0x7fb394069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.706+0000 7fb3bd000640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3940678c0 0x7fb394069d80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80b2000 tx=0x7fb3a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.710+0000 7fb3b5600640 1 -- 172.21.15.5:0/3234476190 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb3b0022030 con 0x7fb3b80cbed0 2024-08-18T22:29:25.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.878+0000 7fb3bfa00640 1 -- 172.21.15.5:0/3234476190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3b815e510 con 0x7fb3b80cbed0 2024-08-18T22:29:25.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.878+0000 7fb3b5600640 1 -- 172.21.15.5:0/3234476190 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) ==== 74+0+16820 (secure 0 0 0) 0x7fb3b0010040 con 0x7fb3b80cbed0 2024-08-18T22:29:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:25.877 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":153,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:29:23.132144+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:29:19.253390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-08-18T22:29:20.520089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:29:25.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 -- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3940678c0 msgr2=0x7fb394069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3940678c0 0x7fb394069d80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80b2000 tx=0x7fb3a8009040 comp rx=0 tx=0).stop 2024-08-18T22:29:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 -- 172.21.15.5:0/3234476190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80cbed0 msgr2=0x7fb3b81458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80cbed0 0x7fb3b81458e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000efc0 tx=0x7fb3b000c490 comp rx=0 tx=0).stop 2024-08-18T22:29:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 -- 172.21.15.5:0/3234476190 shutdown_connections 2024-08-18T22:29:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3940678c0 0x7fb394069d80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3b80cbed0 0x7fb3b81458e0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b80b54c0 0x7fb3b81f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 --2- 172.21.15.5:0/3234476190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b806dd80 0x7fb3b8142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 -- 172.21.15.5:0/3234476190 >> 172.21.15.5:0/3234476190 conn(0x7fb3b80b3eb0 msgr2=0x7fb3b80b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 -- 172.21.15.5:0/3234476190 shutdown_connections 2024-08-18T22:29:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:25.882+0000 7fb3bfa00640 1 -- 172.21.15.5:0/3234476190 wait complete. 2024-08-18T22:29:25.899 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:29:25.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:29:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5da800640 1 Processor -- start 2024-08-18T22:29:26.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5da800640 1 -- start start 2024-08-18T22:29:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5da800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5d415b010 0x7ff5d40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5da800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff5d406f290 0x7ff5d4072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5da800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d40cee20 con 0x7ff5d40cd3a0 2024-08-18T22:29:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5da800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d40cfa30 con 0x7ff5d415b010 2024-08-18T22:29:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5da800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d40cf100 con 0x7ff5d406f290 2024-08-18T22:29:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5d3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5d415b010 0x7ff5d40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5d3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5d415b010 0x7ff5d40ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46812/0 (socket says 172.21.15.5:46812) 2024-08-18T22:29:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5d3400640 1 -- 172.21.15.5:0/4124194352 learned_addr learned my addr 172.21.15.5:0/4124194352 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5d3e00640 1 --2- 172.21.15.5:0/4124194352 >> v2:172.21.15.117:3300/0 conn(0x7ff5d406f290 0x7ff5d4072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5d3400640 1 -- 172.21.15.5:0/4124194352 >> v2:172.21.15.117:3300/0 conn(0x7ff5d406f290 msgr2=0x7ff5d4072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.042+0000 7ff5d3400640 1 --2- 172.21.15.5:0/4124194352 >> v2:172.21.15.117:3300/0 conn(0x7ff5d406f290 0x7ff5d4072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5d3400640 1 -- 172.21.15.5:0/4124194352 >> v1:172.21.15.117:6789/0 conn(0x7ff5d40cd3a0 legacy=0x7ff5d406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5d3400640 1 -- 172.21.15.5:0/4124194352 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d40cf3e0 con 0x7ff5d415b010 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5d3400640 1 --2- 172.21.15.5:0/4124194352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d415b010 0x7ff5d40ce840 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40cfbb0 tx=0x7ff5c401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b439ddfdb579d25 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5d2a00640 1 -- 172.21.15.5:0/4124194352 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40ab620 con 0x7ff5d415b010 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5d2a00640 1 -- 172.21.15.5:0/4124194352 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c40b0070 con 0x7ff5d415b010 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5d2a00640 1 -- 172.21.15.5:0/4124194352 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40ab9e0 con 0x7ff5d415b010 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5da800640 1 -- 172.21.15.5:0/4124194352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d415b010 msgr2=0x7ff5d40ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5da800640 1 --2- 172.21.15.5:0/4124194352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d415b010 0x7ff5d40ce840 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40cfbb0 tx=0x7ff5c401c4f0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5da800640 1 -- 172.21.15.5:0/4124194352 shutdown_connections 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5da800640 1 --2- 172.21.15.5:0/4124194352 >> v2:172.21.15.117:3300/0 conn(0x7ff5d406f290 0x7ff5d4072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5da800640 1 --2- 172.21.15.5:0/4124194352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d415b010 0x7ff5d40ce840 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5da800640 1 -- 172.21.15.5:0/4124194352 >> 172.21.15.5:0/4124194352 conn(0x7ff5d40b1c50 msgr2=0x7ff5d40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5da800640 1 -- 172.21.15.5:0/4124194352 shutdown_connections 2024-08-18T22:29:26.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.046+0000 7ff5da800640 1 -- 172.21.15.5:0/4124194352 wait complete. 2024-08-18T22:29:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5da800640 1 Processor -- start 2024-08-18T22:29:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5da800640 1 -- start start 2024-08-18T22:29:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5da800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d406f290 0x7ff5d414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5da800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5d40cd3a0 0x7ff5d415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5da800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5d415b010 0x7ff5d414bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5da800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d40734f0 con 0x7ff5d406f290 2024-08-18T22:29:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5da800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d4073370 con 0x7ff5d40cd3a0 2024-08-18T22:29:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5da800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d4073670 con 0x7ff5d415b010 2024-08-18T22:29:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5d3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d406f290 0x7ff5d414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5d3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d406f290 0x7ff5d414d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46818/0 (socket says 172.21.15.5:46818) 2024-08-18T22:29:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5d3400640 1 -- 172.21.15.5:0/2251016259 learned_addr learned my addr 172.21.15.5:0/2251016259 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5caa00640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5d40cd3a0 0x7ff5d415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5d3e00640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5d415b010 0x7ff5d414bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5d3400640 1 -- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5d415b010 msgr2=0x7ff5d414bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5d3400640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5d415b010 0x7ff5d414bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5d3400640 1 -- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5d40cd3a0 msgr2=0x7ff5d415a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5d3400640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5d40cd3a0 0x7ff5d415a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5d3400640 1 -- 172.21.15.5:0/2251016259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d4150ef0 con 0x7ff5d406f290 2024-08-18T22:29:26.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5d3e00640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5d415b010 0x7ff5d414bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5d3400640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d406f290 0x7ff5d414d210 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40ad040 tx=0x7ff5c401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5cbe00640 1 -- 172.21.15.5:0/2251016259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40abd70 con 0x7ff5d406f290 2024-08-18T22:29:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5cbe00640 1 -- 172.21.15.5:0/2251016259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c40be3f0 con 0x7ff5d406f290 2024-08-18T22:29:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5cbe00640 1 -- 172.21.15.5:0/2251016259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40be7e0 con 0x7ff5d406f290 2024-08-18T22:29:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.050+0000 7ff5da800640 1 -- 172.21.15.5:0/2251016259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d4152730 con 0x7ff5d406f290 2024-08-18T22:29:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.054+0000 7ff5da800640 1 -- 172.21.15.5:0/2251016259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d4150c10 con 0x7ff5d406f290 2024-08-18T22:29:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.054+0000 7ff5da800640 1 -- 172.21.15.5:0/2251016259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d4072620 con 0x7ff5d406f290 2024-08-18T22:29:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.054+0000 7ff5cbe00640 1 -- 172.21.15.5:0/2251016259 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5c40b43f0 con 0x7ff5d406f290 2024-08-18T22:29:26.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.054+0000 7ff5cbe00640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5b00678c0 0x7ff5b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.054+0000 7ff5cbe00640 1 -- 172.21.15.5:0/2251016259 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7ff5c411fd90 con 0x7ff5d406f290 2024-08-18T22:29:26.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.054+0000 7ff5caa00640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5b00678c0 0x7ff5b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.058+0000 7ff5caa00640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5b00678c0 0x7ff5b0069d80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40b0340 tx=0x7ff5bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:26.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.058+0000 7ff5cbe00640 1 -- 172.21.15.5:0/2251016259 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff5d4150ef0 con 0x7ff5d406f290 2024-08-18T22:29:26.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.222+0000 7ff5da800640 1 -- 172.21.15.5:0/2251016259 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5d40b2240 con 0x7ff5b00678c0 2024-08-18T22:29:26.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.230+0000 7ff5cbe00640 1 -- 172.21.15.5:0/2251016259 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7ff5d40b2240 con 0x7ff5b00678c0 2024-08-18T22:29:26.230 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:26.231 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:29:26.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 -- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5b00678c0 msgr2=0x7ff5b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5b00678c0 0x7ff5b0069d80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40b0340 tx=0x7ff5bc009040 comp rx=0 tx=0).stop 2024-08-18T22:29:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 -- 172.21.15.5:0/2251016259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d406f290 msgr2=0x7ff5d414d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d406f290 0x7ff5d414d210 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40ad040 tx=0x7ff5c401ad30 comp rx=0 tx=0).stop 2024-08-18T22:29:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 -- 172.21.15.5:0/2251016259 shutdown_connections 2024-08-18T22:29:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff5b00678c0 0x7ff5b0069d80 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5d415b010 0x7ff5d414bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5d40cd3a0 0x7ff5d415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 --2- 172.21.15.5:0/2251016259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5d406f290 0x7ff5d414d210 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 -- 172.21.15.5:0/2251016259 >> 172.21.15.5:0/2251016259 conn(0x7ff5d40b1c50 msgr2=0x7ff5d40b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 -- 172.21.15.5:0/2251016259 shutdown_connections 2024-08-18T22:29:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.234+0000 7ff5da800640 1 -- 172.21.15.5:0/2251016259 wait complete. 2024-08-18T22:29:26.249 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2024-08-18T22:29:25.769330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":396056,"kb_used_data":16088,"kb_used_omap":12,"kb_used_meta":379827,"kb_avail":754578664,"statfs":{"total":773094113280,"available":772688551936,"internally_reserved":0,"allocated":16474112,"data_stored":8354332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":388943408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.660789"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297568+0000","last_change":"2024-08-18T22:29:22.145663+0000","last_active":"2024-08-18T22:29:23.297568+0000","last_peered":"2024-08-18T22:29:23.297568+0000","last_clean":"2024-08-18T22:29:23.297568+0000","last_became_active":"2024-08-18T22:29:22.145374+0000","last_became_peered":"2024-08-18T22:29:22.145374+0000","last_unstale":"2024-08-18T22:29:23.297568+0000","last_undegraded":"2024-08-18T22:29:23.297568+0000","last_fullsized":"2024-08-18T22:29:23.297568+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:39:01.608080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298708+0000","last_change":"2024-08-18T22:29:22.160810+0000","last_active":"2024-08-18T22:29:23.298708+0000","last_peered":"2024-08-18T22:29:23.298708+0000","last_clean":"2024-08-18T22:29:23.298708+0000","last_became_active":"2024-08-18T22:29:22.155221+0000","last_became_peered":"2024-08-18T22:29:22.155221+0000","last_unstale":"2024-08-18T22:29:23.298708+0000","last_undegraded":"2024-08-18T22:29:23.298708+0000","last_fullsized":"2024-08-18T22:29:23.298708+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:00.535182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297945+0000","last_change":"2024-08-18T22:29:22.158546+0000","last_active":"2024-08-18T22:29:23.297945+0000","last_peered":"2024-08-18T22:29:23.297945+0000","last_clean":"2024-08-18T22:29:23.297945+0000","last_became_active":"2024-08-18T22:29:22.158132+0000","last_became_peered":"2024-08-18T22:29:22.158132+0000","last_unstale":"2024-08-18T22:29:23.297945+0000","last_undegraded":"2024-08-18T22:29:23.297945+0000","last_fullsized":"2024-08-18T22:29:23.297945+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:31:43.276547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296827+0000","last_change":"2024-08-18T22:29:22.150214+0000","last_active":"2024-08-18T22:29:23.296827+0000","last_peered":"2024-08-18T22:29:23.296827+0000","last_clean":"2024-08-18T22:29:23.296827+0000","last_became_active":"2024-08-18T22:29:22.146414+0000","last_became_peered":"2024-08-18T22:29:22.146414+0000","last_unstale":"2024-08-18T22:29:23.296827+0000","last_undegraded":"2024-08-18T22:29:23.296827+0000","last_fullsized":"2024-08-18T22:29:23.296827+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:54:35.402014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139937+0000","last_change":"2024-08-18T22:29:22.141204+0000","last_active":"2024-08-18T22:29:23.139937+0000","last_peered":"2024-08-18T22:29:23.139937+0000","last_clean":"2024-08-18T22:29:23.139937+0000","last_became_active":"2024-08-18T22:29:22.140763+0000","last_became_peered":"2024-08-18T22:29:22.140763+0000","last_unstale":"2024-08-18T22:29:23.139937+0000","last_undegraded":"2024-08-18T22:29:23.139937+0000","last_fullsized":"2024-08-18T22:29:23.139937+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:02.535490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139401+0000","last_change":"2024-08-18T22:29:22.149735+0000","last_active":"2024-08-18T22:29:23.139401+0000","last_peered":"2024-08-18T22:29:23.139401+0000","last_clean":"2024-08-18T22:29:23.139401+0000","last_became_active":"2024-08-18T22:29:22.149477+0000","last_became_peered":"2024-08-18T22:29:22.149477+0000","last_unstale":"2024-08-18T22:29:23.139401+0000","last_undegraded":"2024-08-18T22:29:23.139401+0000","last_fullsized":"2024-08-18T22:29:23.139401+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:32:53.868381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297268+0000","last_change":"2024-08-18T22:29:22.144972+0000","last_active":"2024-08-18T22:29:23.297268+0000","last_peered":"2024-08-18T22:29:23.297268+0000","last_clean":"2024-08-18T22:29:23.297268+0000","last_became_active":"2024-08-18T22:29:22.144686+0000","last_became_peered":"2024-08-18T22:29:22.144686+0000","last_unstale":"2024-08-18T22:29:23.297268+0000","last_undegraded":"2024-08-18T22:29:23.297268+0000","last_fullsized":"2024-08-18T22:29:23.297268+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:30.161138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141538+0000","last_change":"2024-08-18T22:29:22.142285+0000","last_active":"2024-08-18T22:29:23.141538+0000","last_peered":"2024-08-18T22:29:23.141538+0000","last_clean":"2024-08-18T22:29:23.141538+0000","last_became_active":"2024-08-18T22:29:22.138410+0000","last_became_peered":"2024-08-18T22:29:22.138410+0000","last_unstale":"2024-08-18T22:29:23.141538+0000","last_undegraded":"2024-08-18T22:29:23.141538+0000","last_fullsized":"2024-08-18T22:29:23.141538+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:47.860850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140110+0000","last_change":"2024-08-18T22:29:22.155400+0000","last_active":"2024-08-18T22:29:23.140110+0000","last_peered":"2024-08-18T22:29:23.140110+0000","last_clean":"2024-08-18T22:29:23.140110+0000","last_became_active":"2024-08-18T22:29:22.155076+0000","last_became_peered":"2024-08-18T22:29:22.155076+0000","last_unstale":"2024-08-18T22:29:23.140110+0000","last_undegraded":"2024-08-18T22:29:23.140110+0000","last_fullsized":"2024-08-18T22:29:23.140110+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:43.040088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140090+0000","last_change":"2024-08-18T22:29:22.154602+0000","last_active":"2024-08-18T22:29:23.140090+0000","last_peered":"2024-08-18T22:29:23.140090+0000","last_clean":"2024-08-18T22:29:23.140090+0000","last_became_active":"2024-08-18T22:29:22.153962+0000","last_became_peered":"2024-08-18T22:29:22.153962+0000","last_unstale":"2024-08-18T22:29:23.140090+0000","last_undegraded":"2024-08-18T22:29:23.140090+0000","last_fullsized":"2024-08-18T22:29:23.140090+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:59.879573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298565+0000","last_change":"2024-08-18T22:29:22.154285+0000","last_active":"2024-08-18T22:29:23.298565+0000","last_peered":"2024-08-18T22:29:23.298565+0000","last_clean":"2024-08-18T22:29:23.298565+0000","last_became_active":"2024-08-18T22:29:22.153778+0000","last_became_peered":"2024-08-18T22:29:22.153778+0000","last_unstale":"2024-08-18T22:29:23.298565+0000","last_undegraded":"2024-08-18T22:29:23.298565+0000","last_fullsized":"2024-08-18T22:29:23.298565+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:07.692485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296971+0000","last_change":"2024-08-18T22:29:22.153598+0000","last_active":"2024-08-18T22:29:23.296971+0000","last_peered":"2024-08-18T22:29:23.296971+0000","last_clean":"2024-08-18T22:29:23.296971+0000","last_became_active":"2024-08-18T22:29:22.151913+0000","last_became_peered":"2024-08-18T22:29:22.151913+0000","last_unstale":"2024-08-18T22:29:23.296971+0000","last_undegraded":"2024-08-18T22:29:23.296971+0000","last_fullsized":"2024-08-18T22:29:23.296971+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:03.123455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140003+0000","last_change":"2024-08-18T22:29:22.145222+0000","last_active":"2024-08-18T22:29:23.140003+0000","last_peered":"2024-08-18T22:29:23.140003+0000","last_clean":"2024-08-18T22:29:23.140003+0000","last_became_active":"2024-08-18T22:29:22.144965+0000","last_became_peered":"2024-08-18T22:29:22.144965+0000","last_unstale":"2024-08-18T22:29:23.140003+0000","last_undegraded":"2024-08-18T22:29:23.140003+0000","last_fullsized":"2024-08-18T22:29:23.140003+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:00:59.998155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296772+0000","last_change":"2024-08-18T22:29:22.156860+0000","last_active":"2024-08-18T22:29:23.296772+0000","last_peered":"2024-08-18T22:29:23.296772+0000","last_clean":"2024-08-18T22:29:23.296772+0000","last_became_active":"2024-08-18T22:29:22.156467+0000","last_became_peered":"2024-08-18T22:29:22.156467+0000","last_unstale":"2024-08-18T22:29:23.296772+0000","last_undegraded":"2024-08-18T22:29:23.296772+0000","last_fullsized":"2024-08-18T22:29:23.296772+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:38.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297871+0000","last_change":"2024-08-18T22:29:22.161594+0000","last_active":"2024-08-18T22:29:23.297871+0000","last_peered":"2024-08-18T22:29:23.297871+0000","last_clean":"2024-08-18T22:29:23.297871+0000","last_became_active":"2024-08-18T22:29:22.152714+0000","last_became_peered":"2024-08-18T22:29:22.152714+0000","last_unstale":"2024-08-18T22:29:23.297871+0000","last_undegraded":"2024-08-18T22:29:23.297871+0000","last_fullsized":"2024-08-18T22:29:23.297871+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:31:32.532957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139424+0000","last_change":"2024-08-18T22:29:22.151259+0000","last_active":"2024-08-18T22:29:23.139424+0000","last_peered":"2024-08-18T22:29:23.139424+0000","last_clean":"2024-08-18T22:29:23.139424+0000","last_became_active":"2024-08-18T22:29:22.150977+0000","last_became_peered":"2024-08-18T22:29:22.150977+0000","last_unstale":"2024-08-18T22:29:23.139424+0000","last_undegraded":"2024-08-18T22:29:23.139424+0000","last_fullsized":"2024-08-18T22:29:23.139424+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:14:33.029216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297499+0000","last_change":"2024-08-18T22:29:22.156597+0000","last_active":"2024-08-18T22:29:23.297499+0000","last_peered":"2024-08-18T22:29:23.297499+0000","last_clean":"2024-08-18T22:29:23.297499+0000","last_became_active":"2024-08-18T22:29:22.156268+0000","last_became_peered":"2024-08-18T22:29:22.156268+0000","last_unstale":"2024-08-18T22:29:23.297499+0000","last_undegraded":"2024-08-18T22:29:23.297499+0000","last_fullsized":"2024-08-18T22:29:23.297499+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:31:39.014743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298265+0000","last_change":"2024-08-18T22:29:22.146208+0000","last_active":"2024-08-18T22:29:23.298265+0000","last_peered":"2024-08-18T22:29:23.298265+0000","last_clean":"2024-08-18T22:29:23.298265+0000","last_became_active":"2024-08-18T22:29:22.145956+0000","last_became_peered":"2024-08-18T22:29:22.145956+0000","last_unstale":"2024-08-18T22:29:23.298265+0000","last_undegraded":"2024-08-18T22:29:23.298265+0000","last_fullsized":"2024-08-18T22:29:23.298265+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:14:37.311267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143537+0000","last_change":"2024-08-18T22:29:22.149591+0000","last_active":"2024-08-18T22:29:23.143537+0000","last_peered":"2024-08-18T22:29:23.143537+0000","last_clean":"2024-08-18T22:29:23.143537+0000","last_became_active":"2024-08-18T22:29:22.148064+0000","last_became_peered":"2024-08-18T22:29:22.148064+0000","last_unstale":"2024-08-18T22:29:23.143537+0000","last_undegraded":"2024-08-18T22:29:23.143537+0000","last_fullsized":"2024-08-18T22:29:23.143537+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:46:14.314272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298742+0000","last_change":"2024-08-18T22:29:22.164897+0000","last_active":"2024-08-18T22:29:23.298742+0000","last_peered":"2024-08-18T22:29:23.298742+0000","last_clean":"2024-08-18T22:29:23.298742+0000","last_became_active":"2024-08-18T22:29:22.164571+0000","last_became_peered":"2024-08-18T22:29:22.164571+0000","last_unstale":"2024-08-18T22:29:23.298742+0000","last_undegraded":"2024-08-18T22:29:23.298742+0000","last_fullsized":"2024-08-18T22:29:23.298742+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:43.040088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139792+0000","last_change":"2024-08-18T22:29:22.149987+0000","last_active":"2024-08-18T22:29:23.139792+0000","last_peered":"2024-08-18T22:29:23.139792+0000","last_clean":"2024-08-18T22:29:23.139792+0000","last_became_active":"2024-08-18T22:29:22.149396+0000","last_became_peered":"2024-08-18T22:29:22.149396+0000","last_unstale":"2024-08-18T22:29:23.139792+0000","last_undegraded":"2024-08-18T22:29:23.139792+0000","last_fullsized":"2024-08-18T22:29:23.139792+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:27:23.103810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297010+0000","last_change":"2024-08-18T22:29:22.145289+0000","last_active":"2024-08-18T22:29:23.297010+0000","last_peered":"2024-08-18T22:29:23.297010+0000","last_clean":"2024-08-18T22:29:23.297010+0000","last_became_active":"2024-08-18T22:29:22.144954+0000","last_became_peered":"2024-08-18T22:29:22.144954+0000","last_unstale":"2024-08-18T22:29:23.297010+0000","last_undegraded":"2024-08-18T22:29:23.297010+0000","last_fullsized":"2024-08-18T22:29:23.297010+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:30.782199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141606+0000","last_change":"2024-08-18T22:29:22.140178+0000","last_active":"2024-08-18T22:29:23.141606+0000","last_peered":"2024-08-18T22:29:23.141606+0000","last_clean":"2024-08-18T22:29:23.141606+0000","last_became_active":"2024-08-18T22:29:22.139919+0000","last_became_peered":"2024-08-18T22:29:22.139919+0000","last_unstale":"2024-08-18T22:29:23.141606+0000","last_undegraded":"2024-08-18T22:29:23.141606+0000","last_fullsized":"2024-08-18T22:29:23.141606+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:35:48.972732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297956+0000","last_change":"2024-08-18T22:29:22.153520+0000","last_active":"2024-08-18T22:29:23.297956+0000","last_peered":"2024-08-18T22:29:23.297956+0000","last_clean":"2024-08-18T22:29:23.297956+0000","last_became_active":"2024-08-18T22:29:22.152612+0000","last_became_peered":"2024-08-18T22:29:22.152612+0000","last_unstale":"2024-08-18T22:29:23.297956+0000","last_undegraded":"2024-08-18T22:29:23.297956+0000","last_fullsized":"2024-08-18T22:29:23.297956+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:57:38.448700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297747+0000","last_change":"2024-08-18T22:29:22.155656+0000","last_active":"2024-08-18T22:29:23.297747+0000","last_peered":"2024-08-18T22:29:23.297747+0000","last_clean":"2024-08-18T22:29:23.297747+0000","last_became_active":"2024-08-18T22:29:22.155379+0000","last_became_peered":"2024-08-18T22:29:22.155379+0000","last_unstale":"2024-08-18T22:29:23.297747+0000","last_undegraded":"2024-08-18T22:29:23.297747+0000","last_fullsized":"2024-08-18T22:29:23.297747+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:56.845497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297500+0000","last_change":"2024-08-18T22:29:22.138657+0000","last_active":"2024-08-18T22:29:23.297500+0000","last_peered":"2024-08-18T22:29:23.297500+0000","last_clean":"2024-08-18T22:29:23.297500+0000","last_became_active":"2024-08-18T22:29:22.137915+0000","last_became_peered":"2024-08-18T22:29:22.137915+0000","last_unstale":"2024-08-18T22:29:23.297500+0000","last_undegraded":"2024-08-18T22:29:23.297500+0000","last_fullsized":"2024-08-18T22:29:23.297500+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:18.957297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139917+0000","last_change":"2024-08-18T22:29:22.154340+0000","last_active":"2024-08-18T22:29:23.139917+0000","last_peered":"2024-08-18T22:29:23.139917+0000","last_clean":"2024-08-18T22:29:23.139917+0000","last_became_active":"2024-08-18T22:29:22.154010+0000","last_became_peered":"2024-08-18T22:29:22.154010+0000","last_unstale":"2024-08-18T22:29:23.139917+0000","last_undegraded":"2024-08-18T22:29:23.139917+0000","last_fullsized":"2024-08-18T22:29:23.139917+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:02.025778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298472+0000","last_change":"2024-08-18T22:29:22.148198+0000","last_active":"2024-08-18T22:29:23.298472+0000","last_peered":"2024-08-18T22:29:23.298472+0000","last_clean":"2024-08-18T22:29:23.298472+0000","last_became_active":"2024-08-18T22:29:22.147903+0000","last_became_peered":"2024-08-18T22:29:22.147903+0000","last_unstale":"2024-08-18T22:29:23.298472+0000","last_undegraded":"2024-08-18T22:29:23.298472+0000","last_fullsized":"2024-08-18T22:29:23.298472+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:39.570343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142182+0000","last_change":"2024-08-18T22:29:22.138159+0000","last_active":"2024-08-18T22:29:23.142182+0000","last_peered":"2024-08-18T22:29:23.142182+0000","last_clean":"2024-08-18T22:29:23.142182+0000","last_became_active":"2024-08-18T22:29:22.137874+0000","last_became_peered":"2024-08-18T22:29:22.137874+0000","last_unstale":"2024-08-18T22:29:23.142182+0000","last_undegraded":"2024-08-18T22:29:23.142182+0000","last_fullsized":"2024-08-18T22:29:23.142182+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:19.126032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298655+0000","last_change":"2024-08-18T22:29:22.155737+0000","last_active":"2024-08-18T22:29:23.298655+0000","last_peered":"2024-08-18T22:29:23.298655+0000","last_clean":"2024-08-18T22:29:23.298655+0000","last_became_active":"2024-08-18T22:29:22.153346+0000","last_became_peered":"2024-08-18T22:29:22.153346+0000","last_unstale":"2024-08-18T22:29:23.298655+0000","last_undegraded":"2024-08-18T22:29:23.298655+0000","last_fullsized":"2024-08-18T22:29:23.298655+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:14.342734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139405+0000","last_change":"2024-08-18T22:29:22.149647+0000","last_active":"2024-08-18T22:29:23.139405+0000","last_peered":"2024-08-18T22:29:23.139405+0000","last_clean":"2024-08-18T22:29:23.139405+0000","last_became_active":"2024-08-18T22:29:22.149302+0000","last_became_peered":"2024-08-18T22:29:22.149302+0000","last_unstale":"2024-08-18T22:29:23.139405+0000","last_undegraded":"2024-08-18T22:29:23.139405+0000","last_fullsized":"2024-08-18T22:29:23.139405+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:50:10.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141565+0000","last_change":"2024-08-18T22:29:22.138707+0000","last_active":"2024-08-18T22:29:23.141565+0000","last_peered":"2024-08-18T22:29:23.141565+0000","last_clean":"2024-08-18T22:29:23.141565+0000","last_became_active":"2024-08-18T22:29:22.138407+0000","last_became_peered":"2024-08-18T22:29:22.138407+0000","last_unstale":"2024-08-18T22:29:23.141565+0000","last_undegraded":"2024-08-18T22:29:23.141565+0000","last_fullsized":"2024-08-18T22:29:23.141565+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:35.021425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298558+0000","last_change":"2024-08-18T22:29:22.160491+0000","last_active":"2024-08-18T22:29:23.298558+0000","last_peered":"2024-08-18T22:29:23.298558+0000","last_clean":"2024-08-18T22:29:23.298558+0000","last_became_active":"2024-08-18T22:29:22.160122+0000","last_became_peered":"2024-08-18T22:29:22.160122+0000","last_unstale":"2024-08-18T22:29:23.298558+0000","last_undegraded":"2024-08-18T22:29:23.298558+0000","last_fullsized":"2024-08-18T22:29:23.298558+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:30.782199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"152'4","reported_seq":18,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140264+0000","last_change":"2024-08-18T22:29:21.130018+0000","last_active":"2024-08-18T22:29:23.140264+0000","last_peered":"2024-08-18T22:29:23.140264+0000","last_clean":"2024-08-18T22:29:23.140264+0000","last_became_active":"2024-08-18T22:29:21.129713+0000","last_became_peered":"2024-08-18T22:29:21.129713+0000","last_unstale":"2024-08-18T22:29:23.140264+0000","last_undegraded":"2024-08-18T22:29:23.140264+0000","last_fullsized":"2024-08-18T22:29:23.140264+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:51:26.998695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298095+0000","last_change":"2024-08-18T22:29:22.163614+0000","last_active":"2024-08-18T22:29:23.298095+0000","last_peered":"2024-08-18T22:29:23.298095+0000","last_clean":"2024-08-18T22:29:23.298095+0000","last_became_active":"2024-08-18T22:29:22.163180+0000","last_became_peered":"2024-08-18T22:29:22.163180+0000","last_unstale":"2024-08-18T22:29:23.298095+0000","last_undegraded":"2024-08-18T22:29:23.298095+0000","last_fullsized":"2024-08-18T22:29:23.298095+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:53:43.356323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143157+0000","last_change":"2024-08-18T22:29:21.136775+0000","last_active":"2024-08-18T22:29:23.143157+0000","last_peered":"2024-08-18T22:29:23.143157+0000","last_clean":"2024-08-18T22:29:23.143157+0000","last_became_active":"2024-08-18T22:29:21.136389+0000","last_became_peered":"2024-08-18T22:29:21.136389+0000","last_unstale":"2024-08-18T22:29:23.143157+0000","last_undegraded":"2024-08-18T22:29:23.143157+0000","last_fullsized":"2024-08-18T22:29:23.143157+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:36.100377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142564+0000","last_change":"2024-08-18T22:29:22.136816+0000","last_active":"2024-08-18T22:29:23.142564+0000","last_peered":"2024-08-18T22:29:23.142564+0000","last_clean":"2024-08-18T22:29:23.142564+0000","last_became_active":"2024-08-18T22:29:22.136313+0000","last_became_peered":"2024-08-18T22:29:22.136313+0000","last_unstale":"2024-08-18T22:29:23.142564+0000","last_undegraded":"2024-08-18T22:29:23.142564+0000","last_fullsized":"2024-08-18T22:29:23.142564+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:00.125743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143607+0000","last_change":"2024-08-18T22:29:21.131692+0000","last_active":"2024-08-18T22:29:23.143607+0000","last_peered":"2024-08-18T22:29:23.143607+0000","last_clean":"2024-08-18T22:29:23.143607+0000","last_became_active":"2024-08-18T22:29:21.131375+0000","last_became_peered":"2024-08-18T22:29:21.131375+0000","last_unstale":"2024-08-18T22:29:23.143607+0000","last_undegraded":"2024-08-18T22:29:23.143607+0000","last_fullsized":"2024-08-18T22:29:23.143607+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:44:03.334457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143164+0000","last_change":"2024-08-18T22:29:22.147936+0000","last_active":"2024-08-18T22:29:23.143164+0000","last_peered":"2024-08-18T22:29:23.143164+0000","last_clean":"2024-08-18T22:29:23.143164+0000","last_became_active":"2024-08-18T22:29:22.147647+0000","last_became_peered":"2024-08-18T22:29:22.147647+0000","last_unstale":"2024-08-18T22:29:23.143164+0000","last_undegraded":"2024-08-18T22:29:23.143164+0000","last_fullsized":"2024-08-18T22:29:23.143164+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:36.644788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298682+0000","last_change":"2024-08-18T22:29:21.124715+0000","last_active":"2024-08-18T22:29:23.298682+0000","last_peered":"2024-08-18T22:29:23.298682+0000","last_clean":"2024-08-18T22:29:23.298682+0000","last_became_active":"2024-08-18T22:29:21.124411+0000","last_became_peered":"2024-08-18T22:29:21.124411+0000","last_unstale":"2024-08-18T22:29:23.298682+0000","last_undegraded":"2024-08-18T22:29:23.298682+0000","last_fullsized":"2024-08-18T22:29:23.298682+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:29.577088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297759+0000","last_change":"2024-08-18T22:29:22.140549+0000","last_active":"2024-08-18T22:29:23.297759+0000","last_peered":"2024-08-18T22:29:23.297759+0000","last_clean":"2024-08-18T22:29:23.297759+0000","last_became_active":"2024-08-18T22:29:22.140272+0000","last_became_peered":"2024-08-18T22:29:22.140272+0000","last_unstale":"2024-08-18T22:29:23.297759+0000","last_undegraded":"2024-08-18T22:29:23.297759+0000","last_fullsized":"2024-08-18T22:29:23.297759+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:59.879573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142233+0000","last_change":"2024-08-18T22:29:21.130890+0000","last_active":"2024-08-18T22:29:23.142233+0000","last_peered":"2024-08-18T22:29:23.142233+0000","last_clean":"2024-08-18T22:29:23.142233+0000","last_became_active":"2024-08-18T22:29:21.130629+0000","last_became_peered":"2024-08-18T22:29:21.130629+0000","last_unstale":"2024-08-18T22:29:23.142233+0000","last_undegraded":"2024-08-18T22:29:23.142233+0000","last_fullsized":"2024-08-18T22:29:23.142233+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:35.927353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296714+0000","last_change":"2024-08-18T22:29:22.150892+0000","last_active":"2024-08-18T22:29:23.296714+0000","last_peered":"2024-08-18T22:29:23.296714+0000","last_clean":"2024-08-18T22:29:23.296714+0000","last_became_active":"2024-08-18T22:29:22.148941+0000","last_became_peered":"2024-08-18T22:29:22.148941+0000","last_unstale":"2024-08-18T22:29:23.296714+0000","last_undegraded":"2024-08-18T22:29:23.296714+0000","last_fullsized":"2024-08-18T22:29:23.296714+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:30:46.120807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139505+0000","last_change":"2024-08-18T22:29:21.134446+0000","last_active":"2024-08-18T22:29:23.139505+0000","last_peered":"2024-08-18T22:29:23.139505+0000","last_clean":"2024-08-18T22:29:23.139505+0000","last_became_active":"2024-08-18T22:29:21.133654+0000","last_became_peered":"2024-08-18T22:29:21.133654+0000","last_unstale":"2024-08-18T22:29:23.139505+0000","last_undegraded":"2024-08-18T22:29:23.139505+0000","last_fullsized":"2024-08-18T22:29:23.139505+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:32:11.050220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298150+0000","last_change":"2024-08-18T22:29:22.158993+0000","last_active":"2024-08-18T22:29:23.298150+0000","last_peered":"2024-08-18T22:29:23.298150+0000","last_clean":"2024-08-18T22:29:23.298150+0000","last_became_active":"2024-08-18T22:29:22.158735+0000","last_became_peered":"2024-08-18T22:29:22.158735+0000","last_unstale":"2024-08-18T22:29:23.298150+0000","last_undegraded":"2024-08-18T22:29:23.298150+0000","last_fullsized":"2024-08-18T22:29:23.298150+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:54:35.402014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297251+0000","last_change":"2024-08-18T22:29:21.128394+0000","last_active":"2024-08-18T22:29:23.297251+0000","last_peered":"2024-08-18T22:29:23.297251+0000","last_clean":"2024-08-18T22:29:23.297251+0000","last_became_active":"2024-08-18T22:29:21.127907+0000","last_became_peered":"2024-08-18T22:29:21.127907+0000","last_unstale":"2024-08-18T22:29:23.297251+0000","last_undegraded":"2024-08-18T22:29:23.297251+0000","last_fullsized":"2024-08-18T22:29:23.297251+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:20.392289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297060+0000","last_change":"2024-08-18T22:29:22.139075+0000","last_active":"2024-08-18T22:29:23.297060+0000","last_peered":"2024-08-18T22:29:23.297060+0000","last_clean":"2024-08-18T22:29:23.297060+0000","last_became_active":"2024-08-18T22:29:22.138576+0000","last_became_peered":"2024-08-18T22:29:22.138576+0000","last_unstale":"2024-08-18T22:29:23.297060+0000","last_undegraded":"2024-08-18T22:29:23.297060+0000","last_fullsized":"2024-08-18T22:29:23.297060+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:00.535182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139507+0000","last_change":"2024-08-18T22:29:21.132122+0000","last_active":"2024-08-18T22:29:23.139507+0000","last_peered":"2024-08-18T22:29:23.139507+0000","last_clean":"2024-08-18T22:29:23.139507+0000","last_became_active":"2024-08-18T22:29:21.131847+0000","last_became_peered":"2024-08-18T22:29:21.131847+0000","last_unstale":"2024-08-18T22:29:23.139507+0000","last_undegraded":"2024-08-18T22:29:23.139507+0000","last_fullsized":"2024-08-18T22:29:23.139507+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:55.838429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141992+0000","last_change":"2024-08-18T22:29:22.141621+0000","last_active":"2024-08-18T22:29:23.141992+0000","last_peered":"2024-08-18T22:29:23.141992+0000","last_clean":"2024-08-18T22:29:23.141992+0000","last_became_active":"2024-08-18T22:29:22.141370+0000","last_became_peered":"2024-08-18T22:29:22.141370+0000","last_unstale":"2024-08-18T22:29:23.141992+0000","last_undegraded":"2024-08-18T22:29:23.141992+0000","last_fullsized":"2024-08-18T22:29:23.141992+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:35.936784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143342+0000","last_change":"2024-08-18T22:29:21.136267+0000","last_active":"2024-08-18T22:29:23.143342+0000","last_peered":"2024-08-18T22:29:23.143342+0000","last_clean":"2024-08-18T22:29:23.143342+0000","last_became_active":"2024-08-18T22:29:21.135859+0000","last_became_peered":"2024-08-18T22:29:21.135859+0000","last_unstale":"2024-08-18T22:29:23.143342+0000","last_undegraded":"2024-08-18T22:29:23.143342+0000","last_fullsized":"2024-08-18T22:29:23.143342+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:55.838429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298736+0000","last_change":"2024-08-18T22:29:22.154070+0000","last_active":"2024-08-18T22:29:23.298736+0000","last_peered":"2024-08-18T22:29:23.298736+0000","last_clean":"2024-08-18T22:29:23.298736+0000","last_became_active":"2024-08-18T22:29:22.153369+0000","last_became_peered":"2024-08-18T22:29:22.153369+0000","last_unstale":"2024-08-18T22:29:23.298736+0000","last_undegraded":"2024-08-18T22:29:23.298736+0000","last_fullsized":"2024-08-18T22:29:23.298736+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:45:19.766421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297719+0000","last_change":"2024-08-18T22:29:21.127172+0000","last_active":"2024-08-18T22:29:23.297719+0000","last_peered":"2024-08-18T22:29:23.297719+0000","last_clean":"2024-08-18T22:29:23.297719+0000","last_became_active":"2024-08-18T22:29:21.126172+0000","last_became_peered":"2024-08-18T22:29:21.126172+0000","last_unstale":"2024-08-18T22:29:23.297719+0000","last_undegraded":"2024-08-18T22:29:23.297719+0000","last_fullsized":"2024-08-18T22:29:23.297719+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:06:06.109067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298418+0000","last_change":"2024-08-18T22:29:22.146141+0000","last_active":"2024-08-18T22:29:23.298418+0000","last_peered":"2024-08-18T22:29:23.298418+0000","last_clean":"2024-08-18T22:29:23.298418+0000","last_became_active":"2024-08-18T22:29:22.145849+0000","last_became_peered":"2024-08-18T22:29:22.145849+0000","last_unstale":"2024-08-18T22:29:23.298418+0000","last_undegraded":"2024-08-18T22:29:23.298418+0000","last_fullsized":"2024-08-18T22:29:23.298418+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:34.524812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"152'3","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298784+0000","last_change":"2024-08-18T22:29:21.130852+0000","last_active":"2024-08-18T22:29:23.298784+0000","last_peered":"2024-08-18T22:29:23.298784+0000","last_clean":"2024-08-18T22:29:23.298784+0000","last_became_active":"2024-08-18T22:29:21.130563+0000","last_became_peered":"2024-08-18T22:29:21.130563+0000","last_unstale":"2024-08-18T22:29:23.298784+0000","last_undegraded":"2024-08-18T22:29:23.298784+0000","last_fullsized":"2024-08-18T22:29:23.298784+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:29.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141708+0000","last_change":"2024-08-18T22:29:22.143703+0000","last_active":"2024-08-18T22:29:23.141708+0000","last_peered":"2024-08-18T22:29:23.141708+0000","last_clean":"2024-08-18T22:29:23.141708+0000","last_became_active":"2024-08-18T22:29:22.142947+0000","last_became_peered":"2024-08-18T22:29:22.142947+0000","last_unstale":"2024-08-18T22:29:23.141708+0000","last_undegraded":"2024-08-18T22:29:23.141708+0000","last_fullsized":"2024-08-18T22:29:23.141708+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:33:25.914368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140039+0000","last_change":"2024-08-18T22:29:21.129712+0000","last_active":"2024-08-18T22:29:23.140039+0000","last_peered":"2024-08-18T22:29:23.140039+0000","last_clean":"2024-08-18T22:29:23.140039+0000","last_became_active":"2024-08-18T22:29:21.129360+0000","last_became_peered":"2024-08-18T22:29:21.129360+0000","last_unstale":"2024-08-18T22:29:23.140039+0000","last_undegraded":"2024-08-18T22:29:23.140039+0000","last_fullsized":"2024-08-18T22:29:23.140039+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:44:03.334457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298028+0000","last_change":"2024-08-18T22:29:22.157679+0000","last_active":"2024-08-18T22:29:23.298028+0000","last_peered":"2024-08-18T22:29:23.298028+0000","last_clean":"2024-08-18T22:29:23.298028+0000","last_became_active":"2024-08-18T22:29:22.150557+0000","last_became_peered":"2024-08-18T22:29:22.150557+0000","last_unstale":"2024-08-18T22:29:23.298028+0000","last_undegraded":"2024-08-18T22:29:23.298028+0000","last_fullsized":"2024-08-18T22:29:23.298028+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:30:46.120807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296794+0000","last_change":"2024-08-18T22:29:21.121775+0000","last_active":"2024-08-18T22:29:23.296794+0000","last_peered":"2024-08-18T22:29:23.296794+0000","last_clean":"2024-08-18T22:29:23.296794+0000","last_became_active":"2024-08-18T22:29:21.118923+0000","last_became_peered":"2024-08-18T22:29:21.118923+0000","last_unstale":"2024-08-18T22:29:23.296794+0000","last_undegraded":"2024-08-18T22:29:23.296794+0000","last_fullsized":"2024-08-18T22:29:23.296794+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:27.812197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139465+0000","last_change":"2024-08-18T22:29:22.141840+0000","last_active":"2024-08-18T22:29:23.139465+0000","last_peered":"2024-08-18T22:29:23.139465+0000","last_clean":"2024-08-18T22:29:23.139465+0000","last_became_active":"2024-08-18T22:29:22.138361+0000","last_became_peered":"2024-08-18T22:29:22.138361+0000","last_unstale":"2024-08-18T22:29:23.139465+0000","last_undegraded":"2024-08-18T22:29:23.139465+0000","last_fullsized":"2024-08-18T22:29:23.139465+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:43:52.347060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297550+0000","last_change":"2024-08-18T22:29:21.128081+0000","last_active":"2024-08-18T22:29:23.297550+0000","last_peered":"2024-08-18T22:29:23.297550+0000","last_clean":"2024-08-18T22:29:23.297550+0000","last_became_active":"2024-08-18T22:29:21.127810+0000","last_became_peered":"2024-08-18T22:29:21.127810+0000","last_unstale":"2024-08-18T22:29:23.297550+0000","last_undegraded":"2024-08-18T22:29:23.297550+0000","last_fullsized":"2024-08-18T22:29:23.297550+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:41.684847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298337+0000","last_change":"2024-08-18T22:29:22.158120+0000","last_active":"2024-08-18T22:29:23.298337+0000","last_peered":"2024-08-18T22:29:23.298337+0000","last_clean":"2024-08-18T22:29:23.298337+0000","last_became_active":"2024-08-18T22:29:22.156779+0000","last_became_peered":"2024-08-18T22:29:22.156779+0000","last_unstale":"2024-08-18T22:29:23.298337+0000","last_undegraded":"2024-08-18T22:29:23.298337+0000","last_fullsized":"2024-08-18T22:29:23.298337+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:50.338910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"152'8","reported_seq":22,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296661+0000","last_change":"2024-08-18T22:29:21.131239+0000","last_active":"2024-08-18T22:29:23.296661+0000","last_peered":"2024-08-18T22:29:23.296661+0000","last_clean":"2024-08-18T22:29:23.296661+0000","last_became_active":"2024-08-18T22:29:21.130608+0000","last_became_peered":"2024-08-18T22:29:21.130608+0000","last_unstale":"2024-08-18T22:29:23.296661+0000","last_undegraded":"2024-08-18T22:29:23.296661+0000","last_fullsized":"2024-08-18T22:29:23.296661+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:16:25.185234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143056+0000","last_change":"2024-08-18T22:29:22.137491+0000","last_active":"2024-08-18T22:29:23.143056+0000","last_peered":"2024-08-18T22:29:23.143056+0000","last_clean":"2024-08-18T22:29:23.143056+0000","last_became_active":"2024-08-18T22:29:22.137197+0000","last_became_peered":"2024-08-18T22:29:22.137197+0000","last_unstale":"2024-08-18T22:29:23.143056+0000","last_undegraded":"2024-08-18T22:29:23.143056+0000","last_fullsized":"2024-08-18T22:29:23.143056+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:35:02.304275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298504+0000","last_change":"2024-08-18T22:29:21.132614+0000","last_active":"2024-08-18T22:29:23.298504+0000","last_peered":"2024-08-18T22:29:23.298504+0000","last_clean":"2024-08-18T22:29:23.298504+0000","last_became_active":"2024-08-18T22:29:21.132322+0000","last_became_peered":"2024-08-18T22:29:21.132322+0000","last_unstale":"2024-08-18T22:29:23.298504+0000","last_undegraded":"2024-08-18T22:29:23.298504+0000","last_fullsized":"2024-08-18T22:29:23.298504+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:17.013645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143625+0000","last_change":"2024-08-18T22:29:22.150875+0000","last_active":"2024-08-18T22:29:23.143625+0000","last_peered":"2024-08-18T22:29:23.143625+0000","last_clean":"2024-08-18T22:29:23.143625+0000","last_became_active":"2024-08-18T22:29:22.149790+0000","last_became_peered":"2024-08-18T22:29:22.149790+0000","last_unstale":"2024-08-18T22:29:23.143625+0000","last_undegraded":"2024-08-18T22:29:23.143625+0000","last_fullsized":"2024-08-18T22:29:23.143625+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:53.713378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143270+0000","last_change":"2024-08-18T22:29:21.136100+0000","last_active":"2024-08-18T22:29:23.143270+0000","last_peered":"2024-08-18T22:29:23.143270+0000","last_clean":"2024-08-18T22:29:23.143270+0000","last_became_active":"2024-08-18T22:29:21.135608+0000","last_became_peered":"2024-08-18T22:29:21.135608+0000","last_unstale":"2024-08-18T22:29:23.143270+0000","last_undegraded":"2024-08-18T22:29:23.143270+0000","last_fullsized":"2024-08-18T22:29:23.143270+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:40:22.949231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297630+0000","last_change":"2024-08-18T22:29:22.152637+0000","last_active":"2024-08-18T22:29:23.297630+0000","last_peered":"2024-08-18T22:29:23.297630+0000","last_clean":"2024-08-18T22:29:23.297630+0000","last_became_active":"2024-08-18T22:29:22.152168+0000","last_became_peered":"2024-08-18T22:29:22.152168+0000","last_unstale":"2024-08-18T22:29:23.297630+0000","last_undegraded":"2024-08-18T22:29:23.297630+0000","last_fullsized":"2024-08-18T22:29:23.297630+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:14.475645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298216+0000","last_change":"2024-08-18T22:29:21.131494+0000","last_active":"2024-08-18T22:29:23.298216+0000","last_peered":"2024-08-18T22:29:23.298216+0000","last_clean":"2024-08-18T22:29:23.298216+0000","last_became_active":"2024-08-18T22:29:21.130726+0000","last_became_peered":"2024-08-18T22:29:21.130726+0000","last_unstale":"2024-08-18T22:29:23.298216+0000","last_undegraded":"2024-08-18T22:29:23.298216+0000","last_fullsized":"2024-08-18T22:29:23.298216+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:18.022125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297825+0000","last_change":"2024-08-18T22:29:22.143632+0000","last_active":"2024-08-18T22:29:23.297825+0000","last_peered":"2024-08-18T22:29:23.297825+0000","last_clean":"2024-08-18T22:29:23.297825+0000","last_became_active":"2024-08-18T22:29:22.143356+0000","last_became_peered":"2024-08-18T22:29:22.143356+0000","last_unstale":"2024-08-18T22:29:23.297825+0000","last_undegraded":"2024-08-18T22:29:23.297825+0000","last_fullsized":"2024-08-18T22:29:23.297825+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:40:23.956299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297154+0000","last_change":"2024-08-18T22:29:21.126447+0000","last_active":"2024-08-18T22:29:23.297154+0000","last_peered":"2024-08-18T22:29:23.297154+0000","last_clean":"2024-08-18T22:29:23.297154+0000","last_became_active":"2024-08-18T22:29:21.125476+0000","last_became_peered":"2024-08-18T22:29:21.125476+0000","last_unstale":"2024-08-18T22:29:23.297154+0000","last_undegraded":"2024-08-18T22:29:23.297154+0000","last_fullsized":"2024-08-18T22:29:23.297154+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:52.979441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142569+0000","last_change":"2024-08-18T22:29:22.140840+0000","last_active":"2024-08-18T22:29:23.142569+0000","last_peered":"2024-08-18T22:29:23.142569+0000","last_clean":"2024-08-18T22:29:23.142569+0000","last_became_active":"2024-08-18T22:29:22.140527+0000","last_became_peered":"2024-08-18T22:29:22.140527+0000","last_unstale":"2024-08-18T22:29:23.142569+0000","last_undegraded":"2024-08-18T22:29:23.142569+0000","last_fullsized":"2024-08-18T22:29:23.142569+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:21.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298424+0000","last_change":"2024-08-18T22:29:21.132025+0000","last_active":"2024-08-18T22:29:23.298424+0000","last_peered":"2024-08-18T22:29:23.298424+0000","last_clean":"2024-08-18T22:29:23.298424+0000","last_became_active":"2024-08-18T22:29:21.131447+0000","last_became_peered":"2024-08-18T22:29:21.131447+0000","last_unstale":"2024-08-18T22:29:23.298424+0000","last_undegraded":"2024-08-18T22:29:23.298424+0000","last_fullsized":"2024-08-18T22:29:23.298424+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:49.933410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298172+0000","last_change":"2024-08-18T22:29:22.161827+0000","last_active":"2024-08-18T22:29:23.298172+0000","last_peered":"2024-08-18T22:29:23.298172+0000","last_clean":"2024-08-18T22:29:23.298172+0000","last_became_active":"2024-08-18T22:29:22.156667+0000","last_became_peered":"2024-08-18T22:29:22.156667+0000","last_unstale":"2024-08-18T22:29:23.298172+0000","last_undegraded":"2024-08-18T22:29:23.298172+0000","last_fullsized":"2024-08-18T22:29:23.298172+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:03.123455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141645+0000","last_change":"2024-08-18T22:29:21.121220+0000","last_active":"2024-08-18T22:29:23.141645+0000","last_peered":"2024-08-18T22:29:23.141645+0000","last_clean":"2024-08-18T22:29:23.141645+0000","last_became_active":"2024-08-18T22:29:21.120817+0000","last_became_peered":"2024-08-18T22:29:21.120817+0000","last_unstale":"2024-08-18T22:29:23.141645+0000","last_undegraded":"2024-08-18T22:29:23.141645+0000","last_fullsized":"2024-08-18T22:29:23.141645+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:50.893495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142650+0000","last_change":"2024-08-18T22:29:22.136874+0000","last_active":"2024-08-18T22:29:23.142650+0000","last_peered":"2024-08-18T22:29:23.142650+0000","last_clean":"2024-08-18T22:29:23.142650+0000","last_became_active":"2024-08-18T22:29:22.136569+0000","last_became_peered":"2024-08-18T22:29:22.136569+0000","last_unstale":"2024-08-18T22:29:23.142650+0000","last_undegraded":"2024-08-18T22:29:23.142650+0000","last_fullsized":"2024-08-18T22:29:23.142650+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:28.301619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298315+0000","last_change":"2024-08-18T22:29:21.131101+0000","last_active":"2024-08-18T22:29:23.298315+0000","last_peered":"2024-08-18T22:29:23.298315+0000","last_clean":"2024-08-18T22:29:23.298315+0000","last_became_active":"2024-08-18T22:29:21.130760+0000","last_became_peered":"2024-08-18T22:29:21.130760+0000","last_unstale":"2024-08-18T22:29:23.298315+0000","last_undegraded":"2024-08-18T22:29:23.298315+0000","last_fullsized":"2024-08-18T22:29:23.298315+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:27:22.096742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298474+0000","last_change":"2024-08-18T22:29:22.158434+0000","last_active":"2024-08-18T22:29:23.298474+0000","last_peered":"2024-08-18T22:29:23.298474+0000","last_clean":"2024-08-18T22:29:23.298474+0000","last_became_active":"2024-08-18T22:29:22.155788+0000","last_became_peered":"2024-08-18T22:29:22.155788+0000","last_unstale":"2024-08-18T22:29:23.298474+0000","last_undegraded":"2024-08-18T22:29:23.298474+0000","last_fullsized":"2024-08-18T22:29:23.298474+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:31:39.014743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141764+0000","last_change":"2024-08-18T22:29:21.127177+0000","last_active":"2024-08-18T22:29:23.141764+0000","last_peered":"2024-08-18T22:29:23.141764+0000","last_clean":"2024-08-18T22:29:23.141764+0000","last_became_active":"2024-08-18T22:29:21.126884+0000","last_became_peered":"2024-08-18T22:29:21.126884+0000","last_unstale":"2024-08-18T22:29:23.141764+0000","last_undegraded":"2024-08-18T22:29:23.141764+0000","last_fullsized":"2024-08-18T22:29:23.141764+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:22:22.283877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139835+0000","last_change":"2024-08-18T22:29:22.142001+0000","last_active":"2024-08-18T22:29:23.139835+0000","last_peered":"2024-08-18T22:29:23.139835+0000","last_clean":"2024-08-18T22:29:23.139835+0000","last_became_active":"2024-08-18T22:29:22.141696+0000","last_became_peered":"2024-08-18T22:29:22.141696+0000","last_unstale":"2024-08-18T22:29:23.139835+0000","last_undegraded":"2024-08-18T22:29:23.139835+0000","last_fullsized":"2024-08-18T22:29:23.139835+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:50.940478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297614+0000","last_change":"2024-08-18T22:29:21.123146+0000","last_active":"2024-08-18T22:29:23.297614+0000","last_peered":"2024-08-18T22:29:23.297614+0000","last_clean":"2024-08-18T22:29:23.297614+0000","last_became_active":"2024-08-18T22:29:21.122749+0000","last_became_peered":"2024-08-18T22:29:21.122749+0000","last_unstale":"2024-08-18T22:29:23.297614+0000","last_undegraded":"2024-08-18T22:29:23.297614+0000","last_fullsized":"2024-08-18T22:29:23.297614+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:00:05.145794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297481+0000","last_change":"2024-08-18T22:29:22.153436+0000","last_active":"2024-08-18T22:29:23.297481+0000","last_peered":"2024-08-18T22:29:23.297481+0000","last_clean":"2024-08-18T22:29:23.297481+0000","last_became_active":"2024-08-18T22:29:22.153157+0000","last_became_peered":"2024-08-18T22:29:22.153157+0000","last_unstale":"2024-08-18T22:29:23.297481+0000","last_undegraded":"2024-08-18T22:29:23.297481+0000","last_fullsized":"2024-08-18T22:29:23.297481+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:50.338910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297780+0000","last_change":"2024-08-18T22:29:21.135080+0000","last_active":"2024-08-18T22:29:23.297780+0000","last_peered":"2024-08-18T22:29:23.297780+0000","last_clean":"2024-08-18T22:29:23.297780+0000","last_became_active":"2024-08-18T22:29:21.134757+0000","last_became_peered":"2024-08-18T22:29:21.134757+0000","last_unstale":"2024-08-18T22:29:23.297780+0000","last_undegraded":"2024-08-18T22:29:23.297780+0000","last_fullsized":"2024-08-18T22:29:23.297780+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:11.505517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297728+0000","last_change":"2024-08-18T22:29:22.146268+0000","last_active":"2024-08-18T22:29:23.297728+0000","last_peered":"2024-08-18T22:29:23.297728+0000","last_clean":"2024-08-18T22:29:23.297728+0000","last_became_active":"2024-08-18T22:29:22.145999+0000","last_became_peered":"2024-08-18T22:29:22.145999+0000","last_unstale":"2024-08-18T22:29:23.297728+0000","last_undegraded":"2024-08-18T22:29:23.297728+0000","last_fullsized":"2024-08-18T22:29:23.297728+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:37.107445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298269+0000","last_change":"2024-08-18T22:29:21.124658+0000","last_active":"2024-08-18T22:29:23.298269+0000","last_peered":"2024-08-18T22:29:23.298269+0000","last_clean":"2024-08-18T22:29:23.298269+0000","last_became_active":"2024-08-18T22:29:21.124252+0000","last_became_peered":"2024-08-18T22:29:21.124252+0000","last_unstale":"2024-08-18T22:29:23.298269+0000","last_undegraded":"2024-08-18T22:29:23.298269+0000","last_fullsized":"2024-08-18T22:29:23.298269+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:47.330513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140250+0000","last_change":"2024-08-18T22:29:22.151779+0000","last_active":"2024-08-18T22:29:23.140250+0000","last_peered":"2024-08-18T22:29:23.140250+0000","last_clean":"2024-08-18T22:29:23.140250+0000","last_became_active":"2024-08-18T22:29:22.151483+0000","last_became_peered":"2024-08-18T22:29:22.151483+0000","last_unstale":"2024-08-18T22:29:23.140250+0000","last_undegraded":"2024-08-18T22:29:23.140250+0000","last_fullsized":"2024-08-18T22:29:23.140250+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:53.370298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139806+0000","last_change":"2024-08-18T22:29:21.135598+0000","last_active":"2024-08-18T22:29:23.139806+0000","last_peered":"2024-08-18T22:29:23.139806+0000","last_clean":"2024-08-18T22:29:23.139806+0000","last_became_active":"2024-08-18T22:29:21.135223+0000","last_became_peered":"2024-08-18T22:29:21.135223+0000","last_unstale":"2024-08-18T22:29:23.139806+0000","last_undegraded":"2024-08-18T22:29:23.139806+0000","last_fullsized":"2024-08-18T22:29:23.139806+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:12:15.352575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141766+0000","last_change":"2024-08-18T22:29:22.130843+0000","last_active":"2024-08-18T22:29:23.141766+0000","last_peered":"2024-08-18T22:29:23.141766+0000","last_clean":"2024-08-18T22:29:23.141766+0000","last_became_active":"2024-08-18T22:29:22.130576+0000","last_became_peered":"2024-08-18T22:29:22.130576+0000","last_unstale":"2024-08-18T22:29:23.141766+0000","last_undegraded":"2024-08-18T22:29:23.141766+0000","last_fullsized":"2024-08-18T22:29:23.141766+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:04:55.812290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297086+0000","last_change":"2024-08-18T22:29:21.132791+0000","last_active":"2024-08-18T22:29:23.297086+0000","last_peered":"2024-08-18T22:29:23.297086+0000","last_clean":"2024-08-18T22:29:23.297086+0000","last_became_active":"2024-08-18T22:29:21.132312+0000","last_became_peered":"2024-08-18T22:29:21.132312+0000","last_unstale":"2024-08-18T22:29:23.297086+0000","last_undegraded":"2024-08-18T22:29:23.297086+0000","last_fullsized":"2024-08-18T22:29:23.297086+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:35.292739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296730+0000","last_change":"2024-08-18T22:29:22.153692+0000","last_active":"2024-08-18T22:29:23.296730+0000","last_peered":"2024-08-18T22:29:23.296730+0000","last_clean":"2024-08-18T22:29:23.296730+0000","last_became_active":"2024-08-18T22:29:22.153399+0000","last_became_peered":"2024-08-18T22:29:22.153399+0000","last_unstale":"2024-08-18T22:29:23.296730+0000","last_undegraded":"2024-08-18T22:29:23.296730+0000","last_fullsized":"2024-08-18T22:29:23.296730+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:53:43.356323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298703+0000","last_change":"2024-08-18T22:29:21.135464+0000","last_active":"2024-08-18T22:29:23.298703+0000","last_peered":"2024-08-18T22:29:23.298703+0000","last_clean":"2024-08-18T22:29:23.298703+0000","last_became_active":"2024-08-18T22:29:21.135014+0000","last_became_peered":"2024-08-18T22:29:21.135014+0000","last_unstale":"2024-08-18T22:29:23.298703+0000","last_undegraded":"2024-08-18T22:29:23.298703+0000","last_fullsized":"2024-08-18T22:29:23.298703+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:20:51.828120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298115+0000","last_change":"2024-08-18T22:29:22.161176+0000","last_active":"2024-08-18T22:29:23.298115+0000","last_peered":"2024-08-18T22:29:23.298115+0000","last_clean":"2024-08-18T22:29:23.298115+0000","last_became_active":"2024-08-18T22:29:22.160913+0000","last_became_peered":"2024-08-18T22:29:22.160913+0000","last_unstale":"2024-08-18T22:29:23.298115+0000","last_undegraded":"2024-08-18T22:29:23.298115+0000","last_fullsized":"2024-08-18T22:29:23.298115+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:38.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297349+0000","last_change":"2024-08-18T22:29:21.130182+0000","last_active":"2024-08-18T22:29:23.297349+0000","last_peered":"2024-08-18T22:29:23.297349+0000","last_clean":"2024-08-18T22:29:23.297349+0000","last_became_active":"2024-08-18T22:29:21.129916+0000","last_became_peered":"2024-08-18T22:29:21.129916+0000","last_unstale":"2024-08-18T22:29:23.297349+0000","last_undegraded":"2024-08-18T22:29:23.297349+0000","last_fullsized":"2024-08-18T22:29:23.297349+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:56:37.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142038+0000","last_change":"2024-08-18T22:29:22.138720+0000","last_active":"2024-08-18T22:29:23.142038+0000","last_peered":"2024-08-18T22:29:23.142038+0000","last_clean":"2024-08-18T22:29:23.142038+0000","last_became_active":"2024-08-18T22:29:22.138471+0000","last_became_peered":"2024-08-18T22:29:22.138471+0000","last_unstale":"2024-08-18T22:29:23.142038+0000","last_undegraded":"2024-08-18T22:29:23.142038+0000","last_fullsized":"2024-08-18T22:29:23.142038+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:48:26.277152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142640+0000","last_change":"2024-08-18T22:29:21.134539+0000","last_active":"2024-08-18T22:29:23.142640+0000","last_peered":"2024-08-18T22:29:23.142640+0000","last_clean":"2024-08-18T22:29:23.142640+0000","last_became_active":"2024-08-18T22:29:21.134260+0000","last_became_peered":"2024-08-18T22:29:21.134260+0000","last_unstale":"2024-08-18T22:29:23.142640+0000","last_undegraded":"2024-08-18T22:29:23.142640+0000","last_fullsized":"2024-08-18T22:29:23.142640+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:13.468577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142935+0000","last_change":"2024-08-18T22:29:22.146798+0000","last_active":"2024-08-18T22:29:23.142935+0000","last_peered":"2024-08-18T22:29:23.142935+0000","last_clean":"2024-08-18T22:29:23.142935+0000","last_became_active":"2024-08-18T22:29:22.146528+0000","last_became_peered":"2024-08-18T22:29:22.146528+0000","last_unstale":"2024-08-18T22:29:23.142935+0000","last_undegraded":"2024-08-18T22:29:23.142935+0000","last_fullsized":"2024-08-18T22:29:23.142935+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:01:07.532803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"152'6","reported_seq":20,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298840+0000","last_change":"2024-08-18T22:29:21.136250+0000","last_active":"2024-08-18T22:29:23.298840+0000","last_peered":"2024-08-18T22:29:23.298840+0000","last_clean":"2024-08-18T22:29:23.298840+0000","last_became_active":"2024-08-18T22:29:21.135859+0000","last_became_peered":"2024-08-18T22:29:21.135859+0000","last_unstale":"2024-08-18T22:29:23.298840+0000","last_undegraded":"2024-08-18T22:29:23.298840+0000","last_fullsized":"2024-08-18T22:29:23.298840+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:01.018709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":439,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142645+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:29:23.142645+0000","last_peered":"2024-08-18T22:29:23.142645+0000","last_clean":"2024-08-18T22:29:23.142645+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:29:23.142645+0000","last_undegraded":"2024-08-18T22:29:23.142645+0000","last_fullsized":"2024-08-18T22:29:23.142645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509566,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29468,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342372,"statfs":{"total":96636764160,"available":96606588928,"internally_reserved":0,"allocated":2506752,"data_stored":1489833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509568,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46924,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324916,"statfs":{"total":96636764160,"available":96588713984,"internally_reserved":0,"allocated":1900544,"data_stored":892821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509566,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46920,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324920,"statfs":{"total":96636764160,"available":96588718080,"internally_reserved":0,"allocated":1896448,"data_stored":892751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509567,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55264,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316576,"statfs":{"total":96636764160,"available":96580173824,"internally_reserved":0,"allocated":1916928,"data_stored":900059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509566,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55252,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316588,"statfs":{"total":96636764160,"available":96580186112,"internally_reserved":0,"allocated":1900544,"data_stored":892821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509567,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51692,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320148,"statfs":{"total":96636764160,"available":96583831552,"internally_reserved":0,"allocated":2514944,"data_stored":1485437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574974,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55268,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316572,"statfs":{"total":96636764160,"available":96580169728,"internally_reserved":0,"allocated":1921024,"data_stored":901055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55268,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316572,"statfs":{"total":96636764160,"available":96580169728,"internally_reserved":0,"allocated":1916928,"data_stored":899555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:29:26.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:29:26.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.434+0000 7f57c7c00640 1 Processor -- start 2024-08-18T22:29:26.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.434+0000 7f57c7c00640 1 -- start start 2024-08-18T22:29:26.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57c7c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57c006f290 0x7f57c00ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57c7c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c00cd3a0 0x7f57c0072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57c7c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57c00cd850 con 0x7f57c015b010 2024-08-18T22:29:26.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57c7c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f57c00cfa30 con 0x7f57c006f290 2024-08-18T22:29:26.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57c7c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f57c00cee20 con 0x7f57c00cd3a0 2024-08-18T22:29:26.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57c006f290 0x7f57c00ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57c006f290 0x7f57c00ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46832/0 (socket says 172.21.15.5:46832) 2024-08-18T22:29:26.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57bfe00640 1 -- 172.21.15.5:0/1329490869 learned_addr learned my addr 172.21.15.5:0/1329490869 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:26.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57c5c00640 1 --2- 172.21.15.5:0/1329490869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c00cd3a0 0x7f57c0072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57bfe00640 1 -- 172.21.15.5:0/1329490869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c00cd3a0 msgr2=0x7f57c0072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:26.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57bfe00640 1 --2- 172.21.15.5:0/1329490869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c00cd3a0 0x7f57c0072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57bfe00640 1 -- 172.21.15.5:0/1329490869 >> v1:172.21.15.117:6789/0 conn(0x7f57c015b010 legacy=0x7f57c006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:26.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.438+0000 7f57bfe00640 1 -- 172.21.15.5:0/1329490869 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c00cf100 con 0x7f57c006f290 2024-08-18T22:29:26.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57bfe00640 1 --2- 172.21.15.5:0/1329490869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57c006f290 0x7f57c00ce840 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009870 tx=0x7f57ac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997c06c6d55705b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:26.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57bf400640 1 -- 172.21.15.5:0/1329490869 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0aa610 con 0x7f57c006f290 2024-08-18T22:29:26.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57bf400640 1 -- 172.21.15.5:0/1329490869 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ac0af070 con 0x7f57c006f290 2024-08-18T22:29:26.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57bf400640 1 -- 172.21.15.5:0/1329490869 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0aa9d0 con 0x7f57c006f290 2024-08-18T22:29:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57c7c00640 1 -- 172.21.15.5:0/1329490869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57c006f290 msgr2=0x7f57c00ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57c7c00640 1 --2- 172.21.15.5:0/1329490869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57c006f290 0x7f57c00ce840 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009870 tx=0x7f57ac01c4f0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57c7c00640 1 -- 172.21.15.5:0/1329490869 shutdown_connections 2024-08-18T22:29:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57c7c00640 1 --2- 172.21.15.5:0/1329490869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c00cd3a0 0x7f57c0072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57c7c00640 1 --2- 172.21.15.5:0/1329490869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57c006f290 0x7f57c00ce840 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57c7c00640 1 -- 172.21.15.5:0/1329490869 >> 172.21.15.5:0/1329490869 conn(0x7f57c00b1c50 msgr2=0x7f57c00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57c7c00640 1 -- 172.21.15.5:0/1329490869 shutdown_connections 2024-08-18T22:29:26.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57c7c00640 1 -- 172.21.15.5:0/1329490869 wait complete. 2024-08-18T22:29:26.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57c7c00640 1 Processor -- start 2024-08-18T22:29:26.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.442+0000 7f57c7c00640 1 -- start start 2024-08-18T22:29:26.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c7c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57c006f290 0x7f57c00c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c7c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00cd3a0 0x7f57c0149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c7c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c015b010 0x7f57c01f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c7c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f57c00734f0 con 0x7f57c006f290 2024-08-18T22:29:26.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c7c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f57c0073370 con 0x7f57c00cd3a0 2024-08-18T22:29:26.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c7c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f57c0073670 con 0x7f57c015b010 2024-08-18T22:29:26.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57c006f290 0x7f57c00c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57c006f290 0x7f57c00c4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46844/0 (socket says 172.21.15.5:46844) 2024-08-18T22:29:26.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c5200640 1 -- 172.21.15.5:0/2345094849 learned_addr learned my addr 172.21.15.5:0/2345094849 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:26.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c5c00640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c015b010 0x7f57c01f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57bfe00640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00cd3a0 0x7f57c0149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c5200640 1 -- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c015b010 msgr2=0x7f57c01f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c5200640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c015b010 0x7f57c01f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c5200640 1 -- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00cd3a0 msgr2=0x7f57c0149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c5200640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00cd3a0 0x7f57c0149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c5200640 1 -- 172.21.15.5:0/2345094849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c009bd20 con 0x7f57c006f290 2024-08-18T22:29:26.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c5200640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57c006f290 0x7f57c00c4ec0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f57b000b410 tx=0x7f57b000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:26.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57bcc00640 1 -- 172.21.15.5:0/2345094849 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b0015030 con 0x7f57c006f290 2024-08-18T22:29:26.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57bcc00640 1 -- 172.21.15.5:0/2345094849 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b0004020 con 0x7f57c006f290 2024-08-18T22:29:26.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57bcc00640 1 -- 172.21.15.5:0/2345094849 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b0004450 con 0x7f57c006f290 2024-08-18T22:29:26.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c7c00640 1 -- 172.21.15.5:0/2345094849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c009c000 con 0x7f57c006f290 2024-08-18T22:29:26.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c7c00640 1 -- 172.21.15.5:0/2345094849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c009c5c0 con 0x7f57c006f290 2024-08-18T22:29:26.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.446+0000 7f57c7c00640 1 -- 172.21.15.5:0/2345094849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c00ce840 con 0x7f57c006f290 2024-08-18T22:29:26.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.450+0000 7f57bcc00640 1 -- 172.21.15.5:0/2345094849 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57b0018070 con 0x7f57c006f290 2024-08-18T22:29:26.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.450+0000 7f57bcc00640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57a00678c0 0x7f57a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.450+0000 7f57bcc00640 1 -- 172.21.15.5:0/2345094849 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f57b0085a10 con 0x7f57c006f290 2024-08-18T22:29:26.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.450+0000 7f57bfe00640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57a00678c0 0x7f57a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.450+0000 7f57bfe00640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57a00678c0 0x7f57a0069d80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0ae000 tx=0x7f57ac0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:26.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.454+0000 7f57bcc00640 1 -- 172.21.15.5:0/2345094849 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f57b0056320 con 0x7f57c006f290 2024-08-18T22:29:26.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.614+0000 7f57c7c00640 1 -- 172.21.15.5:0/2345094849 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57c00af630 con 0x7f57a00678c0 2024-08-18T22:29:26.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.622+0000 7f57bcc00640 1 -- 172.21.15.5:0/2345094849 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7f57c00af630 con 0x7f57a00678c0 2024-08-18T22:29:26.623 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:26.625 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 -- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57a00678c0 msgr2=0x7f57a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57a00678c0 0x7f57a0069d80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0ae000 tx=0x7f57ac0a7000 comp rx=0 tx=0).stop 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 -- 172.21.15.5:0/2345094849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57c006f290 msgr2=0x7f57c00c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57c006f290 0x7f57c00c4ec0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f57b000b410 tx=0x7f57b000b8d0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 -- 172.21.15.5:0/2345094849 shutdown_connections 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f57a00678c0 0x7f57a0069d80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c015b010 0x7f57c01f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00cd3a0 0x7f57c0149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 --2- 172.21.15.5:0/2345094849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57c006f290 0x7f57c00c4ec0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 -- 172.21.15.5:0/2345094849 >> 172.21.15.5:0/2345094849 conn(0x7f57c00b1c50 msgr2=0x7f57c009dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 -- 172.21.15.5:0/2345094849 shutdown_connections 2024-08-18T22:29:26.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.626+0000 7f57c7c00640 1 -- 172.21.15.5:0/2345094849 wait complete. 2024-08-18T22:29:26.642 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2024-08-18T22:29:25.769330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":396056,"kb_used_data":16088,"kb_used_omap":12,"kb_used_meta":379827,"kb_avail":754578664,"statfs":{"total":773094113280,"available":772688551936,"internally_reserved":0,"allocated":16474112,"data_stored":8354332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":388943408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.660789"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297568+0000","last_change":"2024-08-18T22:29:22.145663+0000","last_active":"2024-08-18T22:29:23.297568+0000","last_peered":"2024-08-18T22:29:23.297568+0000","last_clean":"2024-08-18T22:29:23.297568+0000","last_became_active":"2024-08-18T22:29:22.145374+0000","last_became_peered":"2024-08-18T22:29:22.145374+0000","last_unstale":"2024-08-18T22:29:23.297568+0000","last_undegraded":"2024-08-18T22:29:23.297568+0000","last_fullsized":"2024-08-18T22:29:23.297568+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:39:01.608080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298708+0000","last_change":"2024-08-18T22:29:22.160810+0000","last_active":"2024-08-18T22:29:23.298708+0000","last_peered":"2024-08-18T22:29:23.298708+0000","last_clean":"2024-08-18T22:29:23.298708+0000","last_became_active":"2024-08-18T22:29:22.155221+0000","last_became_peered":"2024-08-18T22:29:22.155221+0000","last_unstale":"2024-08-18T22:29:23.298708+0000","last_undegraded":"2024-08-18T22:29:23.298708+0000","last_fullsized":"2024-08-18T22:29:23.298708+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:00.535182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297945+0000","last_change":"2024-08-18T22:29:22.158546+0000","last_active":"2024-08-18T22:29:23.297945+0000","last_peered":"2024-08-18T22:29:23.297945+0000","last_clean":"2024-08-18T22:29:23.297945+0000","last_became_active":"2024-08-18T22:29:22.158132+0000","last_became_peered":"2024-08-18T22:29:22.158132+0000","last_unstale":"2024-08-18T22:29:23.297945+0000","last_undegraded":"2024-08-18T22:29:23.297945+0000","last_fullsized":"2024-08-18T22:29:23.297945+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:31:43.276547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296827+0000","last_change":"2024-08-18T22:29:22.150214+0000","last_active":"2024-08-18T22:29:23.296827+0000","last_peered":"2024-08-18T22:29:23.296827+0000","last_clean":"2024-08-18T22:29:23.296827+0000","last_became_active":"2024-08-18T22:29:22.146414+0000","last_became_peered":"2024-08-18T22:29:22.146414+0000","last_unstale":"2024-08-18T22:29:23.296827+0000","last_undegraded":"2024-08-18T22:29:23.296827+0000","last_fullsized":"2024-08-18T22:29:23.296827+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:54:35.402014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139937+0000","last_change":"2024-08-18T22:29:22.141204+0000","last_active":"2024-08-18T22:29:23.139937+0000","last_peered":"2024-08-18T22:29:23.139937+0000","last_clean":"2024-08-18T22:29:23.139937+0000","last_became_active":"2024-08-18T22:29:22.140763+0000","last_became_peered":"2024-08-18T22:29:22.140763+0000","last_unstale":"2024-08-18T22:29:23.139937+0000","last_undegraded":"2024-08-18T22:29:23.139937+0000","last_fullsized":"2024-08-18T22:29:23.139937+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:02.535490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139401+0000","last_change":"2024-08-18T22:29:22.149735+0000","last_active":"2024-08-18T22:29:23.139401+0000","last_peered":"2024-08-18T22:29:23.139401+0000","last_clean":"2024-08-18T22:29:23.139401+0000","last_became_active":"2024-08-18T22:29:22.149477+0000","last_became_peered":"2024-08-18T22:29:22.149477+0000","last_unstale":"2024-08-18T22:29:23.139401+0000","last_undegraded":"2024-08-18T22:29:23.139401+0000","last_fullsized":"2024-08-18T22:29:23.139401+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:32:53.868381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297268+0000","last_change":"2024-08-18T22:29:22.144972+0000","last_active":"2024-08-18T22:29:23.297268+0000","last_peered":"2024-08-18T22:29:23.297268+0000","last_clean":"2024-08-18T22:29:23.297268+0000","last_became_active":"2024-08-18T22:29:22.144686+0000","last_became_peered":"2024-08-18T22:29:22.144686+0000","last_unstale":"2024-08-18T22:29:23.297268+0000","last_undegraded":"2024-08-18T22:29:23.297268+0000","last_fullsized":"2024-08-18T22:29:23.297268+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:30.161138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141538+0000","last_change":"2024-08-18T22:29:22.142285+0000","last_active":"2024-08-18T22:29:23.141538+0000","last_peered":"2024-08-18T22:29:23.141538+0000","last_clean":"2024-08-18T22:29:23.141538+0000","last_became_active":"2024-08-18T22:29:22.138410+0000","last_became_peered":"2024-08-18T22:29:22.138410+0000","last_unstale":"2024-08-18T22:29:23.141538+0000","last_undegraded":"2024-08-18T22:29:23.141538+0000","last_fullsized":"2024-08-18T22:29:23.141538+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:03:47.860850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140110+0000","last_change":"2024-08-18T22:29:22.155400+0000","last_active":"2024-08-18T22:29:23.140110+0000","last_peered":"2024-08-18T22:29:23.140110+0000","last_clean":"2024-08-18T22:29:23.140110+0000","last_became_active":"2024-08-18T22:29:22.155076+0000","last_became_peered":"2024-08-18T22:29:22.155076+0000","last_unstale":"2024-08-18T22:29:23.140110+0000","last_undegraded":"2024-08-18T22:29:23.140110+0000","last_fullsized":"2024-08-18T22:29:23.140110+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:43.040088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140090+0000","last_change":"2024-08-18T22:29:22.154602+0000","last_active":"2024-08-18T22:29:23.140090+0000","last_peered":"2024-08-18T22:29:23.140090+0000","last_clean":"2024-08-18T22:29:23.140090+0000","last_became_active":"2024-08-18T22:29:22.153962+0000","last_became_peered":"2024-08-18T22:29:22.153962+0000","last_unstale":"2024-08-18T22:29:23.140090+0000","last_undegraded":"2024-08-18T22:29:23.140090+0000","last_fullsized":"2024-08-18T22:29:23.140090+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:59.879573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298565+0000","last_change":"2024-08-18T22:29:22.154285+0000","last_active":"2024-08-18T22:29:23.298565+0000","last_peered":"2024-08-18T22:29:23.298565+0000","last_clean":"2024-08-18T22:29:23.298565+0000","last_became_active":"2024-08-18T22:29:22.153778+0000","last_became_peered":"2024-08-18T22:29:22.153778+0000","last_unstale":"2024-08-18T22:29:23.298565+0000","last_undegraded":"2024-08-18T22:29:23.298565+0000","last_fullsized":"2024-08-18T22:29:23.298565+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:46:07.692485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296971+0000","last_change":"2024-08-18T22:29:22.153598+0000","last_active":"2024-08-18T22:29:23.296971+0000","last_peered":"2024-08-18T22:29:23.296971+0000","last_clean":"2024-08-18T22:29:23.296971+0000","last_became_active":"2024-08-18T22:29:22.151913+0000","last_became_peered":"2024-08-18T22:29:22.151913+0000","last_unstale":"2024-08-18T22:29:23.296971+0000","last_undegraded":"2024-08-18T22:29:23.296971+0000","last_fullsized":"2024-08-18T22:29:23.296971+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:03.123455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140003+0000","last_change":"2024-08-18T22:29:22.145222+0000","last_active":"2024-08-18T22:29:23.140003+0000","last_peered":"2024-08-18T22:29:23.140003+0000","last_clean":"2024-08-18T22:29:23.140003+0000","last_became_active":"2024-08-18T22:29:22.144965+0000","last_became_peered":"2024-08-18T22:29:22.144965+0000","last_unstale":"2024-08-18T22:29:23.140003+0000","last_undegraded":"2024-08-18T22:29:23.140003+0000","last_fullsized":"2024-08-18T22:29:23.140003+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:00:59.998155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296772+0000","last_change":"2024-08-18T22:29:22.156860+0000","last_active":"2024-08-18T22:29:23.296772+0000","last_peered":"2024-08-18T22:29:23.296772+0000","last_clean":"2024-08-18T22:29:23.296772+0000","last_became_active":"2024-08-18T22:29:22.156467+0000","last_became_peered":"2024-08-18T22:29:22.156467+0000","last_unstale":"2024-08-18T22:29:23.296772+0000","last_undegraded":"2024-08-18T22:29:23.296772+0000","last_fullsized":"2024-08-18T22:29:23.296772+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:38.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297871+0000","last_change":"2024-08-18T22:29:22.161594+0000","last_active":"2024-08-18T22:29:23.297871+0000","last_peered":"2024-08-18T22:29:23.297871+0000","last_clean":"2024-08-18T22:29:23.297871+0000","last_became_active":"2024-08-18T22:29:22.152714+0000","last_became_peered":"2024-08-18T22:29:22.152714+0000","last_unstale":"2024-08-18T22:29:23.297871+0000","last_undegraded":"2024-08-18T22:29:23.297871+0000","last_fullsized":"2024-08-18T22:29:23.297871+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:31:32.532957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139424+0000","last_change":"2024-08-18T22:29:22.151259+0000","last_active":"2024-08-18T22:29:23.139424+0000","last_peered":"2024-08-18T22:29:23.139424+0000","last_clean":"2024-08-18T22:29:23.139424+0000","last_became_active":"2024-08-18T22:29:22.150977+0000","last_became_peered":"2024-08-18T22:29:22.150977+0000","last_unstale":"2024-08-18T22:29:23.139424+0000","last_undegraded":"2024-08-18T22:29:23.139424+0000","last_fullsized":"2024-08-18T22:29:23.139424+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:14:33.029216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297499+0000","last_change":"2024-08-18T22:29:22.156597+0000","last_active":"2024-08-18T22:29:23.297499+0000","last_peered":"2024-08-18T22:29:23.297499+0000","last_clean":"2024-08-18T22:29:23.297499+0000","last_became_active":"2024-08-18T22:29:22.156268+0000","last_became_peered":"2024-08-18T22:29:22.156268+0000","last_unstale":"2024-08-18T22:29:23.297499+0000","last_undegraded":"2024-08-18T22:29:23.297499+0000","last_fullsized":"2024-08-18T22:29:23.297499+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:31:39.014743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298265+0000","last_change":"2024-08-18T22:29:22.146208+0000","last_active":"2024-08-18T22:29:23.298265+0000","last_peered":"2024-08-18T22:29:23.298265+0000","last_clean":"2024-08-18T22:29:23.298265+0000","last_became_active":"2024-08-18T22:29:22.145956+0000","last_became_peered":"2024-08-18T22:29:22.145956+0000","last_unstale":"2024-08-18T22:29:23.298265+0000","last_undegraded":"2024-08-18T22:29:23.298265+0000","last_fullsized":"2024-08-18T22:29:23.298265+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:14:37.311267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143537+0000","last_change":"2024-08-18T22:29:22.149591+0000","last_active":"2024-08-18T22:29:23.143537+0000","last_peered":"2024-08-18T22:29:23.143537+0000","last_clean":"2024-08-18T22:29:23.143537+0000","last_became_active":"2024-08-18T22:29:22.148064+0000","last_became_peered":"2024-08-18T22:29:22.148064+0000","last_unstale":"2024-08-18T22:29:23.143537+0000","last_undegraded":"2024-08-18T22:29:23.143537+0000","last_fullsized":"2024-08-18T22:29:23.143537+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:46:14.314272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298742+0000","last_change":"2024-08-18T22:29:22.164897+0000","last_active":"2024-08-18T22:29:23.298742+0000","last_peered":"2024-08-18T22:29:23.298742+0000","last_clean":"2024-08-18T22:29:23.298742+0000","last_became_active":"2024-08-18T22:29:22.164571+0000","last_became_peered":"2024-08-18T22:29:22.164571+0000","last_unstale":"2024-08-18T22:29:23.298742+0000","last_undegraded":"2024-08-18T22:29:23.298742+0000","last_fullsized":"2024-08-18T22:29:23.298742+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:43.040088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139792+0000","last_change":"2024-08-18T22:29:22.149987+0000","last_active":"2024-08-18T22:29:23.139792+0000","last_peered":"2024-08-18T22:29:23.139792+0000","last_clean":"2024-08-18T22:29:23.139792+0000","last_became_active":"2024-08-18T22:29:22.149396+0000","last_became_peered":"2024-08-18T22:29:22.149396+0000","last_unstale":"2024-08-18T22:29:23.139792+0000","last_undegraded":"2024-08-18T22:29:23.139792+0000","last_fullsized":"2024-08-18T22:29:23.139792+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:27:23.103810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297010+0000","last_change":"2024-08-18T22:29:22.145289+0000","last_active":"2024-08-18T22:29:23.297010+0000","last_peered":"2024-08-18T22:29:23.297010+0000","last_clean":"2024-08-18T22:29:23.297010+0000","last_became_active":"2024-08-18T22:29:22.144954+0000","last_became_peered":"2024-08-18T22:29:22.144954+0000","last_unstale":"2024-08-18T22:29:23.297010+0000","last_undegraded":"2024-08-18T22:29:23.297010+0000","last_fullsized":"2024-08-18T22:29:23.297010+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:30.782199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141606+0000","last_change":"2024-08-18T22:29:22.140178+0000","last_active":"2024-08-18T22:29:23.141606+0000","last_peered":"2024-08-18T22:29:23.141606+0000","last_clean":"2024-08-18T22:29:23.141606+0000","last_became_active":"2024-08-18T22:29:22.139919+0000","last_became_peered":"2024-08-18T22:29:22.139919+0000","last_unstale":"2024-08-18T22:29:23.141606+0000","last_undegraded":"2024-08-18T22:29:23.141606+0000","last_fullsized":"2024-08-18T22:29:23.141606+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:35:48.972732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297956+0000","last_change":"2024-08-18T22:29:22.153520+0000","last_active":"2024-08-18T22:29:23.297956+0000","last_peered":"2024-08-18T22:29:23.297956+0000","last_clean":"2024-08-18T22:29:23.297956+0000","last_became_active":"2024-08-18T22:29:22.152612+0000","last_became_peered":"2024-08-18T22:29:22.152612+0000","last_unstale":"2024-08-18T22:29:23.297956+0000","last_undegraded":"2024-08-18T22:29:23.297956+0000","last_fullsized":"2024-08-18T22:29:23.297956+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:57:38.448700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297747+0000","last_change":"2024-08-18T22:29:22.155656+0000","last_active":"2024-08-18T22:29:23.297747+0000","last_peered":"2024-08-18T22:29:23.297747+0000","last_clean":"2024-08-18T22:29:23.297747+0000","last_became_active":"2024-08-18T22:29:22.155379+0000","last_became_peered":"2024-08-18T22:29:22.155379+0000","last_unstale":"2024-08-18T22:29:23.297747+0000","last_undegraded":"2024-08-18T22:29:23.297747+0000","last_fullsized":"2024-08-18T22:29:23.297747+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:56.845497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297500+0000","last_change":"2024-08-18T22:29:22.138657+0000","last_active":"2024-08-18T22:29:23.297500+0000","last_peered":"2024-08-18T22:29:23.297500+0000","last_clean":"2024-08-18T22:29:23.297500+0000","last_became_active":"2024-08-18T22:29:22.137915+0000","last_became_peered":"2024-08-18T22:29:22.137915+0000","last_unstale":"2024-08-18T22:29:23.297500+0000","last_undegraded":"2024-08-18T22:29:23.297500+0000","last_fullsized":"2024-08-18T22:29:23.297500+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:18.957297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139917+0000","last_change":"2024-08-18T22:29:22.154340+0000","last_active":"2024-08-18T22:29:23.139917+0000","last_peered":"2024-08-18T22:29:23.139917+0000","last_clean":"2024-08-18T22:29:23.139917+0000","last_became_active":"2024-08-18T22:29:22.154010+0000","last_became_peered":"2024-08-18T22:29:22.154010+0000","last_unstale":"2024-08-18T22:29:23.139917+0000","last_undegraded":"2024-08-18T22:29:23.139917+0000","last_fullsized":"2024-08-18T22:29:23.139917+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:02.025778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298472+0000","last_change":"2024-08-18T22:29:22.148198+0000","last_active":"2024-08-18T22:29:23.298472+0000","last_peered":"2024-08-18T22:29:23.298472+0000","last_clean":"2024-08-18T22:29:23.298472+0000","last_became_active":"2024-08-18T22:29:22.147903+0000","last_became_peered":"2024-08-18T22:29:22.147903+0000","last_unstale":"2024-08-18T22:29:23.298472+0000","last_undegraded":"2024-08-18T22:29:23.298472+0000","last_fullsized":"2024-08-18T22:29:23.298472+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:39.570343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142182+0000","last_change":"2024-08-18T22:29:22.138159+0000","last_active":"2024-08-18T22:29:23.142182+0000","last_peered":"2024-08-18T22:29:23.142182+0000","last_clean":"2024-08-18T22:29:23.142182+0000","last_became_active":"2024-08-18T22:29:22.137874+0000","last_became_peered":"2024-08-18T22:29:22.137874+0000","last_unstale":"2024-08-18T22:29:23.142182+0000","last_undegraded":"2024-08-18T22:29:23.142182+0000","last_fullsized":"2024-08-18T22:29:23.142182+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:19.126032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298655+0000","last_change":"2024-08-18T22:29:22.155737+0000","last_active":"2024-08-18T22:29:23.298655+0000","last_peered":"2024-08-18T22:29:23.298655+0000","last_clean":"2024-08-18T22:29:23.298655+0000","last_became_active":"2024-08-18T22:29:22.153346+0000","last_became_peered":"2024-08-18T22:29:22.153346+0000","last_unstale":"2024-08-18T22:29:23.298655+0000","last_undegraded":"2024-08-18T22:29:23.298655+0000","last_fullsized":"2024-08-18T22:29:23.298655+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:14.342734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139405+0000","last_change":"2024-08-18T22:29:22.149647+0000","last_active":"2024-08-18T22:29:23.139405+0000","last_peered":"2024-08-18T22:29:23.139405+0000","last_clean":"2024-08-18T22:29:23.139405+0000","last_became_active":"2024-08-18T22:29:22.149302+0000","last_became_peered":"2024-08-18T22:29:22.149302+0000","last_unstale":"2024-08-18T22:29:23.139405+0000","last_undegraded":"2024-08-18T22:29:23.139405+0000","last_fullsized":"2024-08-18T22:29:23.139405+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:50:10.327106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141565+0000","last_change":"2024-08-18T22:29:22.138707+0000","last_active":"2024-08-18T22:29:23.141565+0000","last_peered":"2024-08-18T22:29:23.141565+0000","last_clean":"2024-08-18T22:29:23.141565+0000","last_became_active":"2024-08-18T22:29:22.138407+0000","last_became_peered":"2024-08-18T22:29:22.138407+0000","last_unstale":"2024-08-18T22:29:23.141565+0000","last_undegraded":"2024-08-18T22:29:23.141565+0000","last_fullsized":"2024-08-18T22:29:23.141565+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:58:35.021425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298558+0000","last_change":"2024-08-18T22:29:22.160491+0000","last_active":"2024-08-18T22:29:23.298558+0000","last_peered":"2024-08-18T22:29:23.298558+0000","last_clean":"2024-08-18T22:29:23.298558+0000","last_became_active":"2024-08-18T22:29:22.160122+0000","last_became_peered":"2024-08-18T22:29:22.160122+0000","last_unstale":"2024-08-18T22:29:23.298558+0000","last_undegraded":"2024-08-18T22:29:23.298558+0000","last_fullsized":"2024-08-18T22:29:23.298558+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:30.782199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"152'4","reported_seq":18,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140264+0000","last_change":"2024-08-18T22:29:21.130018+0000","last_active":"2024-08-18T22:29:23.140264+0000","last_peered":"2024-08-18T22:29:23.140264+0000","last_clean":"2024-08-18T22:29:23.140264+0000","last_became_active":"2024-08-18T22:29:21.129713+0000","last_became_peered":"2024-08-18T22:29:21.129713+0000","last_unstale":"2024-08-18T22:29:23.140264+0000","last_undegraded":"2024-08-18T22:29:23.140264+0000","last_fullsized":"2024-08-18T22:29:23.140264+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:51:26.998695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298095+0000","last_change":"2024-08-18T22:29:22.163614+0000","last_active":"2024-08-18T22:29:23.298095+0000","last_peered":"2024-08-18T22:29:23.298095+0000","last_clean":"2024-08-18T22:29:23.298095+0000","last_became_active":"2024-08-18T22:29:22.163180+0000","last_became_peered":"2024-08-18T22:29:22.163180+0000","last_unstale":"2024-08-18T22:29:23.298095+0000","last_undegraded":"2024-08-18T22:29:23.298095+0000","last_fullsized":"2024-08-18T22:29:23.298095+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:53:43.356323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143157+0000","last_change":"2024-08-18T22:29:21.136775+0000","last_active":"2024-08-18T22:29:23.143157+0000","last_peered":"2024-08-18T22:29:23.143157+0000","last_clean":"2024-08-18T22:29:23.143157+0000","last_became_active":"2024-08-18T22:29:21.136389+0000","last_became_peered":"2024-08-18T22:29:21.136389+0000","last_unstale":"2024-08-18T22:29:23.143157+0000","last_undegraded":"2024-08-18T22:29:23.143157+0000","last_fullsized":"2024-08-18T22:29:23.143157+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:36.100377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142564+0000","last_change":"2024-08-18T22:29:22.136816+0000","last_active":"2024-08-18T22:29:23.142564+0000","last_peered":"2024-08-18T22:29:23.142564+0000","last_clean":"2024-08-18T22:29:23.142564+0000","last_became_active":"2024-08-18T22:29:22.136313+0000","last_became_peered":"2024-08-18T22:29:22.136313+0000","last_unstale":"2024-08-18T22:29:23.142564+0000","last_undegraded":"2024-08-18T22:29:23.142564+0000","last_fullsized":"2024-08-18T22:29:23.142564+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:00.125743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143607+0000","last_change":"2024-08-18T22:29:21.131692+0000","last_active":"2024-08-18T22:29:23.143607+0000","last_peered":"2024-08-18T22:29:23.143607+0000","last_clean":"2024-08-18T22:29:23.143607+0000","last_became_active":"2024-08-18T22:29:21.131375+0000","last_became_peered":"2024-08-18T22:29:21.131375+0000","last_unstale":"2024-08-18T22:29:23.143607+0000","last_undegraded":"2024-08-18T22:29:23.143607+0000","last_fullsized":"2024-08-18T22:29:23.143607+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:44:03.334457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143164+0000","last_change":"2024-08-18T22:29:22.147936+0000","last_active":"2024-08-18T22:29:23.143164+0000","last_peered":"2024-08-18T22:29:23.143164+0000","last_clean":"2024-08-18T22:29:23.143164+0000","last_became_active":"2024-08-18T22:29:22.147647+0000","last_became_peered":"2024-08-18T22:29:22.147647+0000","last_unstale":"2024-08-18T22:29:23.143164+0000","last_undegraded":"2024-08-18T22:29:23.143164+0000","last_fullsized":"2024-08-18T22:29:23.143164+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:36.644788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298682+0000","last_change":"2024-08-18T22:29:21.124715+0000","last_active":"2024-08-18T22:29:23.298682+0000","last_peered":"2024-08-18T22:29:23.298682+0000","last_clean":"2024-08-18T22:29:23.298682+0000","last_became_active":"2024-08-18T22:29:21.124411+0000","last_became_peered":"2024-08-18T22:29:21.124411+0000","last_unstale":"2024-08-18T22:29:23.298682+0000","last_undegraded":"2024-08-18T22:29:23.298682+0000","last_fullsized":"2024-08-18T22:29:23.298682+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:29.577088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297759+0000","last_change":"2024-08-18T22:29:22.140549+0000","last_active":"2024-08-18T22:29:23.297759+0000","last_peered":"2024-08-18T22:29:23.297759+0000","last_clean":"2024-08-18T22:29:23.297759+0000","last_became_active":"2024-08-18T22:29:22.140272+0000","last_became_peered":"2024-08-18T22:29:22.140272+0000","last_unstale":"2024-08-18T22:29:23.297759+0000","last_undegraded":"2024-08-18T22:29:23.297759+0000","last_fullsized":"2024-08-18T22:29:23.297759+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:59.879573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142233+0000","last_change":"2024-08-18T22:29:21.130890+0000","last_active":"2024-08-18T22:29:23.142233+0000","last_peered":"2024-08-18T22:29:23.142233+0000","last_clean":"2024-08-18T22:29:23.142233+0000","last_became_active":"2024-08-18T22:29:21.130629+0000","last_became_peered":"2024-08-18T22:29:21.130629+0000","last_unstale":"2024-08-18T22:29:23.142233+0000","last_undegraded":"2024-08-18T22:29:23.142233+0000","last_fullsized":"2024-08-18T22:29:23.142233+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:25:35.927353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296714+0000","last_change":"2024-08-18T22:29:22.150892+0000","last_active":"2024-08-18T22:29:23.296714+0000","last_peered":"2024-08-18T22:29:23.296714+0000","last_clean":"2024-08-18T22:29:23.296714+0000","last_became_active":"2024-08-18T22:29:22.148941+0000","last_became_peered":"2024-08-18T22:29:22.148941+0000","last_unstale":"2024-08-18T22:29:23.296714+0000","last_undegraded":"2024-08-18T22:29:23.296714+0000","last_fullsized":"2024-08-18T22:29:23.296714+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:30:46.120807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139505+0000","last_change":"2024-08-18T22:29:21.134446+0000","last_active":"2024-08-18T22:29:23.139505+0000","last_peered":"2024-08-18T22:29:23.139505+0000","last_clean":"2024-08-18T22:29:23.139505+0000","last_became_active":"2024-08-18T22:29:21.133654+0000","last_became_peered":"2024-08-18T22:29:21.133654+0000","last_unstale":"2024-08-18T22:29:23.139505+0000","last_undegraded":"2024-08-18T22:29:23.139505+0000","last_fullsized":"2024-08-18T22:29:23.139505+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:32:11.050220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298150+0000","last_change":"2024-08-18T22:29:22.158993+0000","last_active":"2024-08-18T22:29:23.298150+0000","last_peered":"2024-08-18T22:29:23.298150+0000","last_clean":"2024-08-18T22:29:23.298150+0000","last_became_active":"2024-08-18T22:29:22.158735+0000","last_became_peered":"2024-08-18T22:29:22.158735+0000","last_unstale":"2024-08-18T22:29:23.298150+0000","last_undegraded":"2024-08-18T22:29:23.298150+0000","last_fullsized":"2024-08-18T22:29:23.298150+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:54:35.402014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297251+0000","last_change":"2024-08-18T22:29:21.128394+0000","last_active":"2024-08-18T22:29:23.297251+0000","last_peered":"2024-08-18T22:29:23.297251+0000","last_clean":"2024-08-18T22:29:23.297251+0000","last_became_active":"2024-08-18T22:29:21.127907+0000","last_became_peered":"2024-08-18T22:29:21.127907+0000","last_unstale":"2024-08-18T22:29:23.297251+0000","last_undegraded":"2024-08-18T22:29:23.297251+0000","last_fullsized":"2024-08-18T22:29:23.297251+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:20.392289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297060+0000","last_change":"2024-08-18T22:29:22.139075+0000","last_active":"2024-08-18T22:29:23.297060+0000","last_peered":"2024-08-18T22:29:23.297060+0000","last_clean":"2024-08-18T22:29:23.297060+0000","last_became_active":"2024-08-18T22:29:22.138576+0000","last_became_peered":"2024-08-18T22:29:22.138576+0000","last_unstale":"2024-08-18T22:29:23.297060+0000","last_undegraded":"2024-08-18T22:29:23.297060+0000","last_fullsized":"2024-08-18T22:29:23.297060+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:00.535182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139507+0000","last_change":"2024-08-18T22:29:21.132122+0000","last_active":"2024-08-18T22:29:23.139507+0000","last_peered":"2024-08-18T22:29:23.139507+0000","last_clean":"2024-08-18T22:29:23.139507+0000","last_became_active":"2024-08-18T22:29:21.131847+0000","last_became_peered":"2024-08-18T22:29:21.131847+0000","last_unstale":"2024-08-18T22:29:23.139507+0000","last_undegraded":"2024-08-18T22:29:23.139507+0000","last_fullsized":"2024-08-18T22:29:23.139507+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:55.838429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141992+0000","last_change":"2024-08-18T22:29:22.141621+0000","last_active":"2024-08-18T22:29:23.141992+0000","last_peered":"2024-08-18T22:29:23.141992+0000","last_clean":"2024-08-18T22:29:23.141992+0000","last_became_active":"2024-08-18T22:29:22.141370+0000","last_became_peered":"2024-08-18T22:29:22.141370+0000","last_unstale":"2024-08-18T22:29:23.141992+0000","last_undegraded":"2024-08-18T22:29:23.141992+0000","last_fullsized":"2024-08-18T22:29:23.141992+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:35.936784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143342+0000","last_change":"2024-08-18T22:29:21.136267+0000","last_active":"2024-08-18T22:29:23.143342+0000","last_peered":"2024-08-18T22:29:23.143342+0000","last_clean":"2024-08-18T22:29:23.143342+0000","last_became_active":"2024-08-18T22:29:21.135859+0000","last_became_peered":"2024-08-18T22:29:21.135859+0000","last_unstale":"2024-08-18T22:29:23.143342+0000","last_undegraded":"2024-08-18T22:29:23.143342+0000","last_fullsized":"2024-08-18T22:29:23.143342+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:38:55.838429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298736+0000","last_change":"2024-08-18T22:29:22.154070+0000","last_active":"2024-08-18T22:29:23.298736+0000","last_peered":"2024-08-18T22:29:23.298736+0000","last_clean":"2024-08-18T22:29:23.298736+0000","last_became_active":"2024-08-18T22:29:22.153369+0000","last_became_peered":"2024-08-18T22:29:22.153369+0000","last_unstale":"2024-08-18T22:29:23.298736+0000","last_undegraded":"2024-08-18T22:29:23.298736+0000","last_fullsized":"2024-08-18T22:29:23.298736+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:45:19.766421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297719+0000","last_change":"2024-08-18T22:29:21.127172+0000","last_active":"2024-08-18T22:29:23.297719+0000","last_peered":"2024-08-18T22:29:23.297719+0000","last_clean":"2024-08-18T22:29:23.297719+0000","last_became_active":"2024-08-18T22:29:21.126172+0000","last_became_peered":"2024-08-18T22:29:21.126172+0000","last_unstale":"2024-08-18T22:29:23.297719+0000","last_undegraded":"2024-08-18T22:29:23.297719+0000","last_fullsized":"2024-08-18T22:29:23.297719+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:06:06.109067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298418+0000","last_change":"2024-08-18T22:29:22.146141+0000","last_active":"2024-08-18T22:29:23.298418+0000","last_peered":"2024-08-18T22:29:23.298418+0000","last_clean":"2024-08-18T22:29:23.298418+0000","last_became_active":"2024-08-18T22:29:22.145849+0000","last_became_peered":"2024-08-18T22:29:22.145849+0000","last_unstale":"2024-08-18T22:29:23.298418+0000","last_undegraded":"2024-08-18T22:29:23.298418+0000","last_fullsized":"2024-08-18T22:29:23.298418+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:22:34.524812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"152'3","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298784+0000","last_change":"2024-08-18T22:29:21.130852+0000","last_active":"2024-08-18T22:29:23.298784+0000","last_peered":"2024-08-18T22:29:23.298784+0000","last_clean":"2024-08-18T22:29:23.298784+0000","last_became_active":"2024-08-18T22:29:21.130563+0000","last_became_peered":"2024-08-18T22:29:21.130563+0000","last_unstale":"2024-08-18T22:29:23.298784+0000","last_undegraded":"2024-08-18T22:29:23.298784+0000","last_fullsized":"2024-08-18T22:29:23.298784+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:29.057013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141708+0000","last_change":"2024-08-18T22:29:22.143703+0000","last_active":"2024-08-18T22:29:23.141708+0000","last_peered":"2024-08-18T22:29:23.141708+0000","last_clean":"2024-08-18T22:29:23.141708+0000","last_became_active":"2024-08-18T22:29:22.142947+0000","last_became_peered":"2024-08-18T22:29:22.142947+0000","last_unstale":"2024-08-18T22:29:23.141708+0000","last_undegraded":"2024-08-18T22:29:23.141708+0000","last_fullsized":"2024-08-18T22:29:23.141708+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:33:25.914368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140039+0000","last_change":"2024-08-18T22:29:21.129712+0000","last_active":"2024-08-18T22:29:23.140039+0000","last_peered":"2024-08-18T22:29:23.140039+0000","last_clean":"2024-08-18T22:29:23.140039+0000","last_became_active":"2024-08-18T22:29:21.129360+0000","last_became_peered":"2024-08-18T22:29:21.129360+0000","last_unstale":"2024-08-18T22:29:23.140039+0000","last_undegraded":"2024-08-18T22:29:23.140039+0000","last_fullsized":"2024-08-18T22:29:23.140039+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:44:03.334457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298028+0000","last_change":"2024-08-18T22:29:22.157679+0000","last_active":"2024-08-18T22:29:23.298028+0000","last_peered":"2024-08-18T22:29:23.298028+0000","last_clean":"2024-08-18T22:29:23.298028+0000","last_became_active":"2024-08-18T22:29:22.150557+0000","last_became_peered":"2024-08-18T22:29:22.150557+0000","last_unstale":"2024-08-18T22:29:23.298028+0000","last_undegraded":"2024-08-18T22:29:23.298028+0000","last_fullsized":"2024-08-18T22:29:23.298028+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:30:46.120807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296794+0000","last_change":"2024-08-18T22:29:21.121775+0000","last_active":"2024-08-18T22:29:23.296794+0000","last_peered":"2024-08-18T22:29:23.296794+0000","last_clean":"2024-08-18T22:29:23.296794+0000","last_became_active":"2024-08-18T22:29:21.118923+0000","last_became_peered":"2024-08-18T22:29:21.118923+0000","last_unstale":"2024-08-18T22:29:23.296794+0000","last_undegraded":"2024-08-18T22:29:23.296794+0000","last_fullsized":"2024-08-18T22:29:23.296794+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:27.812197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139465+0000","last_change":"2024-08-18T22:29:22.141840+0000","last_active":"2024-08-18T22:29:23.139465+0000","last_peered":"2024-08-18T22:29:23.139465+0000","last_clean":"2024-08-18T22:29:23.139465+0000","last_became_active":"2024-08-18T22:29:22.138361+0000","last_became_peered":"2024-08-18T22:29:22.138361+0000","last_unstale":"2024-08-18T22:29:23.139465+0000","last_undegraded":"2024-08-18T22:29:23.139465+0000","last_fullsized":"2024-08-18T22:29:23.139465+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:43:52.347060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297550+0000","last_change":"2024-08-18T22:29:21.128081+0000","last_active":"2024-08-18T22:29:23.297550+0000","last_peered":"2024-08-18T22:29:23.297550+0000","last_clean":"2024-08-18T22:29:23.297550+0000","last_became_active":"2024-08-18T22:29:21.127810+0000","last_became_peered":"2024-08-18T22:29:21.127810+0000","last_unstale":"2024-08-18T22:29:23.297550+0000","last_undegraded":"2024-08-18T22:29:23.297550+0000","last_fullsized":"2024-08-18T22:29:23.297550+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:41.684847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298337+0000","last_change":"2024-08-18T22:29:22.158120+0000","last_active":"2024-08-18T22:29:23.298337+0000","last_peered":"2024-08-18T22:29:23.298337+0000","last_clean":"2024-08-18T22:29:23.298337+0000","last_became_active":"2024-08-18T22:29:22.156779+0000","last_became_peered":"2024-08-18T22:29:22.156779+0000","last_unstale":"2024-08-18T22:29:23.298337+0000","last_undegraded":"2024-08-18T22:29:23.298337+0000","last_fullsized":"2024-08-18T22:29:23.298337+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:50.338910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"152'8","reported_seq":22,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296661+0000","last_change":"2024-08-18T22:29:21.131239+0000","last_active":"2024-08-18T22:29:23.296661+0000","last_peered":"2024-08-18T22:29:23.296661+0000","last_clean":"2024-08-18T22:29:23.296661+0000","last_became_active":"2024-08-18T22:29:21.130608+0000","last_became_peered":"2024-08-18T22:29:21.130608+0000","last_unstale":"2024-08-18T22:29:23.296661+0000","last_undegraded":"2024-08-18T22:29:23.296661+0000","last_fullsized":"2024-08-18T22:29:23.296661+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:16:25.185234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143056+0000","last_change":"2024-08-18T22:29:22.137491+0000","last_active":"2024-08-18T22:29:23.143056+0000","last_peered":"2024-08-18T22:29:23.143056+0000","last_clean":"2024-08-18T22:29:23.143056+0000","last_became_active":"2024-08-18T22:29:22.137197+0000","last_became_peered":"2024-08-18T22:29:22.137197+0000","last_unstale":"2024-08-18T22:29:23.143056+0000","last_undegraded":"2024-08-18T22:29:23.143056+0000","last_fullsized":"2024-08-18T22:29:23.143056+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:35:02.304275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298504+0000","last_change":"2024-08-18T22:29:21.132614+0000","last_active":"2024-08-18T22:29:23.298504+0000","last_peered":"2024-08-18T22:29:23.298504+0000","last_clean":"2024-08-18T22:29:23.298504+0000","last_became_active":"2024-08-18T22:29:21.132322+0000","last_became_peered":"2024-08-18T22:29:21.132322+0000","last_unstale":"2024-08-18T22:29:23.298504+0000","last_undegraded":"2024-08-18T22:29:23.298504+0000","last_fullsized":"2024-08-18T22:29:23.298504+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:17.013645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143625+0000","last_change":"2024-08-18T22:29:22.150875+0000","last_active":"2024-08-18T22:29:23.143625+0000","last_peered":"2024-08-18T22:29:23.143625+0000","last_clean":"2024-08-18T22:29:23.143625+0000","last_became_active":"2024-08-18T22:29:22.149790+0000","last_became_peered":"2024-08-18T22:29:22.149790+0000","last_unstale":"2024-08-18T22:29:23.143625+0000","last_undegraded":"2024-08-18T22:29:23.143625+0000","last_fullsized":"2024-08-18T22:29:23.143625+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:53.713378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.143270+0000","last_change":"2024-08-18T22:29:21.136100+0000","last_active":"2024-08-18T22:29:23.143270+0000","last_peered":"2024-08-18T22:29:23.143270+0000","last_clean":"2024-08-18T22:29:23.143270+0000","last_became_active":"2024-08-18T22:29:21.135608+0000","last_became_peered":"2024-08-18T22:29:21.135608+0000","last_unstale":"2024-08-18T22:29:23.143270+0000","last_undegraded":"2024-08-18T22:29:23.143270+0000","last_fullsized":"2024-08-18T22:29:23.143270+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:40:22.949231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297630+0000","last_change":"2024-08-18T22:29:22.152637+0000","last_active":"2024-08-18T22:29:23.297630+0000","last_peered":"2024-08-18T22:29:23.297630+0000","last_clean":"2024-08-18T22:29:23.297630+0000","last_became_active":"2024-08-18T22:29:22.152168+0000","last_became_peered":"2024-08-18T22:29:22.152168+0000","last_unstale":"2024-08-18T22:29:23.297630+0000","last_undegraded":"2024-08-18T22:29:23.297630+0000","last_fullsized":"2024-08-18T22:29:23.297630+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:14.475645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298216+0000","last_change":"2024-08-18T22:29:21.131494+0000","last_active":"2024-08-18T22:29:23.298216+0000","last_peered":"2024-08-18T22:29:23.298216+0000","last_clean":"2024-08-18T22:29:23.298216+0000","last_became_active":"2024-08-18T22:29:21.130726+0000","last_became_peered":"2024-08-18T22:29:21.130726+0000","last_unstale":"2024-08-18T22:29:23.298216+0000","last_undegraded":"2024-08-18T22:29:23.298216+0000","last_fullsized":"2024-08-18T22:29:23.298216+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:18.022125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297825+0000","last_change":"2024-08-18T22:29:22.143632+0000","last_active":"2024-08-18T22:29:23.297825+0000","last_peered":"2024-08-18T22:29:23.297825+0000","last_clean":"2024-08-18T22:29:23.297825+0000","last_became_active":"2024-08-18T22:29:22.143356+0000","last_became_peered":"2024-08-18T22:29:22.143356+0000","last_unstale":"2024-08-18T22:29:23.297825+0000","last_undegraded":"2024-08-18T22:29:23.297825+0000","last_fullsized":"2024-08-18T22:29:23.297825+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:40:23.956299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297154+0000","last_change":"2024-08-18T22:29:21.126447+0000","last_active":"2024-08-18T22:29:23.297154+0000","last_peered":"2024-08-18T22:29:23.297154+0000","last_clean":"2024-08-18T22:29:23.297154+0000","last_became_active":"2024-08-18T22:29:21.125476+0000","last_became_peered":"2024-08-18T22:29:21.125476+0000","last_unstale":"2024-08-18T22:29:23.297154+0000","last_undegraded":"2024-08-18T22:29:23.297154+0000","last_fullsized":"2024-08-18T22:29:23.297154+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:04:52.979441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142569+0000","last_change":"2024-08-18T22:29:22.140840+0000","last_active":"2024-08-18T22:29:23.142569+0000","last_peered":"2024-08-18T22:29:23.142569+0000","last_clean":"2024-08-18T22:29:23.142569+0000","last_became_active":"2024-08-18T22:29:22.140527+0000","last_became_peered":"2024-08-18T22:29:22.140527+0000","last_unstale":"2024-08-18T22:29:23.142569+0000","last_undegraded":"2024-08-18T22:29:23.142569+0000","last_fullsized":"2024-08-18T22:29:23.142569+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:59:21.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298424+0000","last_change":"2024-08-18T22:29:21.132025+0000","last_active":"2024-08-18T22:29:23.298424+0000","last_peered":"2024-08-18T22:29:23.298424+0000","last_clean":"2024-08-18T22:29:23.298424+0000","last_became_active":"2024-08-18T22:29:21.131447+0000","last_became_peered":"2024-08-18T22:29:21.131447+0000","last_unstale":"2024-08-18T22:29:23.298424+0000","last_undegraded":"2024-08-18T22:29:23.298424+0000","last_fullsized":"2024-08-18T22:29:23.298424+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:49.933410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298172+0000","last_change":"2024-08-18T22:29:22.161827+0000","last_active":"2024-08-18T22:29:23.298172+0000","last_peered":"2024-08-18T22:29:23.298172+0000","last_clean":"2024-08-18T22:29:23.298172+0000","last_became_active":"2024-08-18T22:29:22.156667+0000","last_became_peered":"2024-08-18T22:29:22.156667+0000","last_unstale":"2024-08-18T22:29:23.298172+0000","last_undegraded":"2024-08-18T22:29:23.298172+0000","last_fullsized":"2024-08-18T22:29:23.298172+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:03.123455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141645+0000","last_change":"2024-08-18T22:29:21.121220+0000","last_active":"2024-08-18T22:29:23.141645+0000","last_peered":"2024-08-18T22:29:23.141645+0000","last_clean":"2024-08-18T22:29:23.141645+0000","last_became_active":"2024-08-18T22:29:21.120817+0000","last_became_peered":"2024-08-18T22:29:21.120817+0000","last_unstale":"2024-08-18T22:29:23.141645+0000","last_undegraded":"2024-08-18T22:29:23.141645+0000","last_fullsized":"2024-08-18T22:29:23.141645+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:50.893495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142650+0000","last_change":"2024-08-18T22:29:22.136874+0000","last_active":"2024-08-18T22:29:23.142650+0000","last_peered":"2024-08-18T22:29:23.142650+0000","last_clean":"2024-08-18T22:29:23.142650+0000","last_became_active":"2024-08-18T22:29:22.136569+0000","last_became_peered":"2024-08-18T22:29:22.136569+0000","last_unstale":"2024-08-18T22:29:23.142650+0000","last_undegraded":"2024-08-18T22:29:23.142650+0000","last_fullsized":"2024-08-18T22:29:23.142650+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:28.301619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298315+0000","last_change":"2024-08-18T22:29:21.131101+0000","last_active":"2024-08-18T22:29:23.298315+0000","last_peered":"2024-08-18T22:29:23.298315+0000","last_clean":"2024-08-18T22:29:23.298315+0000","last_became_active":"2024-08-18T22:29:21.130760+0000","last_became_peered":"2024-08-18T22:29:21.130760+0000","last_unstale":"2024-08-18T22:29:23.298315+0000","last_undegraded":"2024-08-18T22:29:23.298315+0000","last_fullsized":"2024-08-18T22:29:23.298315+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:27:22.096742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298474+0000","last_change":"2024-08-18T22:29:22.158434+0000","last_active":"2024-08-18T22:29:23.298474+0000","last_peered":"2024-08-18T22:29:23.298474+0000","last_clean":"2024-08-18T22:29:23.298474+0000","last_became_active":"2024-08-18T22:29:22.155788+0000","last_became_peered":"2024-08-18T22:29:22.155788+0000","last_unstale":"2024-08-18T22:29:23.298474+0000","last_undegraded":"2024-08-18T22:29:23.298474+0000","last_fullsized":"2024-08-18T22:29:23.298474+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:31:39.014743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141764+0000","last_change":"2024-08-18T22:29:21.127177+0000","last_active":"2024-08-18T22:29:23.141764+0000","last_peered":"2024-08-18T22:29:23.141764+0000","last_clean":"2024-08-18T22:29:23.141764+0000","last_became_active":"2024-08-18T22:29:21.126884+0000","last_became_peered":"2024-08-18T22:29:21.126884+0000","last_unstale":"2024-08-18T22:29:23.141764+0000","last_undegraded":"2024-08-18T22:29:23.141764+0000","last_fullsized":"2024-08-18T22:29:23.141764+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:22:22.283877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139835+0000","last_change":"2024-08-18T22:29:22.142001+0000","last_active":"2024-08-18T22:29:23.139835+0000","last_peered":"2024-08-18T22:29:23.139835+0000","last_clean":"2024-08-18T22:29:23.139835+0000","last_became_active":"2024-08-18T22:29:22.141696+0000","last_became_peered":"2024-08-18T22:29:22.141696+0000","last_unstale":"2024-08-18T22:29:23.139835+0000","last_undegraded":"2024-08-18T22:29:23.139835+0000","last_fullsized":"2024-08-18T22:29:23.139835+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:50.940478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297614+0000","last_change":"2024-08-18T22:29:21.123146+0000","last_active":"2024-08-18T22:29:23.297614+0000","last_peered":"2024-08-18T22:29:23.297614+0000","last_clean":"2024-08-18T22:29:23.297614+0000","last_became_active":"2024-08-18T22:29:21.122749+0000","last_became_peered":"2024-08-18T22:29:21.122749+0000","last_unstale":"2024-08-18T22:29:23.297614+0000","last_undegraded":"2024-08-18T22:29:23.297614+0000","last_fullsized":"2024-08-18T22:29:23.297614+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:00:05.145794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297481+0000","last_change":"2024-08-18T22:29:22.153436+0000","last_active":"2024-08-18T22:29:23.297481+0000","last_peered":"2024-08-18T22:29:23.297481+0000","last_clean":"2024-08-18T22:29:23.297481+0000","last_became_active":"2024-08-18T22:29:22.153157+0000","last_became_peered":"2024-08-18T22:29:22.153157+0000","last_unstale":"2024-08-18T22:29:23.297481+0000","last_undegraded":"2024-08-18T22:29:23.297481+0000","last_fullsized":"2024-08-18T22:29:23.297481+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:23:50.338910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297780+0000","last_change":"2024-08-18T22:29:21.135080+0000","last_active":"2024-08-18T22:29:23.297780+0000","last_peered":"2024-08-18T22:29:23.297780+0000","last_clean":"2024-08-18T22:29:23.297780+0000","last_became_active":"2024-08-18T22:29:21.134757+0000","last_became_peered":"2024-08-18T22:29:21.134757+0000","last_unstale":"2024-08-18T22:29:23.297780+0000","last_undegraded":"2024-08-18T22:29:23.297780+0000","last_fullsized":"2024-08-18T22:29:23.297780+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:42:11.505517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297728+0000","last_change":"2024-08-18T22:29:22.146268+0000","last_active":"2024-08-18T22:29:23.297728+0000","last_peered":"2024-08-18T22:29:23.297728+0000","last_clean":"2024-08-18T22:29:23.297728+0000","last_became_active":"2024-08-18T22:29:22.145999+0000","last_became_peered":"2024-08-18T22:29:22.145999+0000","last_unstale":"2024-08-18T22:29:23.297728+0000","last_undegraded":"2024-08-18T22:29:23.297728+0000","last_fullsized":"2024-08-18T22:29:23.297728+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:36:37.107445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298269+0000","last_change":"2024-08-18T22:29:21.124658+0000","last_active":"2024-08-18T22:29:23.298269+0000","last_peered":"2024-08-18T22:29:23.298269+0000","last_clean":"2024-08-18T22:29:23.298269+0000","last_became_active":"2024-08-18T22:29:21.124252+0000","last_became_peered":"2024-08-18T22:29:21.124252+0000","last_unstale":"2024-08-18T22:29:23.298269+0000","last_undegraded":"2024-08-18T22:29:23.298269+0000","last_fullsized":"2024-08-18T22:29:23.298269+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:47.330513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.140250+0000","last_change":"2024-08-18T22:29:22.151779+0000","last_active":"2024-08-18T22:29:23.140250+0000","last_peered":"2024-08-18T22:29:23.140250+0000","last_clean":"2024-08-18T22:29:23.140250+0000","last_became_active":"2024-08-18T22:29:22.151483+0000","last_became_peered":"2024-08-18T22:29:22.151483+0000","last_unstale":"2024-08-18T22:29:23.140250+0000","last_undegraded":"2024-08-18T22:29:23.140250+0000","last_fullsized":"2024-08-18T22:29:23.140250+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:06:53.370298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.139806+0000","last_change":"2024-08-18T22:29:21.135598+0000","last_active":"2024-08-18T22:29:23.139806+0000","last_peered":"2024-08-18T22:29:23.139806+0000","last_clean":"2024-08-18T22:29:23.139806+0000","last_became_active":"2024-08-18T22:29:21.135223+0000","last_became_peered":"2024-08-18T22:29:21.135223+0000","last_unstale":"2024-08-18T22:29:23.139806+0000","last_undegraded":"2024-08-18T22:29:23.139806+0000","last_fullsized":"2024-08-18T22:29:23.139806+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:12:15.352575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.141766+0000","last_change":"2024-08-18T22:29:22.130843+0000","last_active":"2024-08-18T22:29:23.141766+0000","last_peered":"2024-08-18T22:29:23.141766+0000","last_clean":"2024-08-18T22:29:23.141766+0000","last_became_active":"2024-08-18T22:29:22.130576+0000","last_became_peered":"2024-08-18T22:29:22.130576+0000","last_unstale":"2024-08-18T22:29:23.141766+0000","last_undegraded":"2024-08-18T22:29:23.141766+0000","last_fullsized":"2024-08-18T22:29:23.141766+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:04:55.812290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297086+0000","last_change":"2024-08-18T22:29:21.132791+0000","last_active":"2024-08-18T22:29:23.297086+0000","last_peered":"2024-08-18T22:29:23.297086+0000","last_clean":"2024-08-18T22:29:23.297086+0000","last_became_active":"2024-08-18T22:29:21.132312+0000","last_became_peered":"2024-08-18T22:29:21.132312+0000","last_unstale":"2024-08-18T22:29:23.297086+0000","last_undegraded":"2024-08-18T22:29:23.297086+0000","last_fullsized":"2024-08-18T22:29:23.297086+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:53:35.292739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.296730+0000","last_change":"2024-08-18T22:29:22.153692+0000","last_active":"2024-08-18T22:29:23.296730+0000","last_peered":"2024-08-18T22:29:23.296730+0000","last_clean":"2024-08-18T22:29:23.296730+0000","last_became_active":"2024-08-18T22:29:22.153399+0000","last_became_peered":"2024-08-18T22:29:22.153399+0000","last_unstale":"2024-08-18T22:29:23.296730+0000","last_undegraded":"2024-08-18T22:29:23.296730+0000","last_fullsized":"2024-08-18T22:29:23.296730+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:53:43.356323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298703+0000","last_change":"2024-08-18T22:29:21.135464+0000","last_active":"2024-08-18T22:29:23.298703+0000","last_peered":"2024-08-18T22:29:23.298703+0000","last_clean":"2024-08-18T22:29:23.298703+0000","last_became_active":"2024-08-18T22:29:21.135014+0000","last_became_peered":"2024-08-18T22:29:21.135014+0000","last_unstale":"2024-08-18T22:29:23.298703+0000","last_undegraded":"2024-08-18T22:29:23.298703+0000","last_fullsized":"2024-08-18T22:29:23.298703+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:20:51.828120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298115+0000","last_change":"2024-08-18T22:29:22.161176+0000","last_active":"2024-08-18T22:29:23.298115+0000","last_peered":"2024-08-18T22:29:23.298115+0000","last_clean":"2024-08-18T22:29:23.298115+0000","last_became_active":"2024-08-18T22:29:22.160913+0000","last_became_peered":"2024-08-18T22:29:22.160913+0000","last_unstale":"2024-08-18T22:29:23.298115+0000","last_undegraded":"2024-08-18T22:29:23.298115+0000","last_fullsized":"2024-08-18T22:29:23.298115+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:38.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.297349+0000","last_change":"2024-08-18T22:29:21.130182+0000","last_active":"2024-08-18T22:29:23.297349+0000","last_peered":"2024-08-18T22:29:23.297349+0000","last_clean":"2024-08-18T22:29:23.297349+0000","last_became_active":"2024-08-18T22:29:21.129916+0000","last_became_peered":"2024-08-18T22:29:21.129916+0000","last_unstale":"2024-08-18T22:29:23.297349+0000","last_undegraded":"2024-08-18T22:29:23.297349+0000","last_fullsized":"2024-08-18T22:29:23.297349+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:56:37.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142038+0000","last_change":"2024-08-18T22:29:22.138720+0000","last_active":"2024-08-18T22:29:23.142038+0000","last_peered":"2024-08-18T22:29:23.142038+0000","last_clean":"2024-08-18T22:29:23.142038+0000","last_became_active":"2024-08-18T22:29:22.138471+0000","last_became_peered":"2024-08-18T22:29:22.138471+0000","last_unstale":"2024-08-18T22:29:23.142038+0000","last_undegraded":"2024-08-18T22:29:23.142038+0000","last_fullsized":"2024-08-18T22:29:23.142038+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:48:26.277152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142640+0000","last_change":"2024-08-18T22:29:21.134539+0000","last_active":"2024-08-18T22:29:23.142640+0000","last_peered":"2024-08-18T22:29:23.142640+0000","last_clean":"2024-08-18T22:29:23.142640+0000","last_became_active":"2024-08-18T22:29:21.134260+0000","last_became_peered":"2024-08-18T22:29:21.134260+0000","last_unstale":"2024-08-18T22:29:23.142640+0000","last_undegraded":"2024-08-18T22:29:23.142640+0000","last_fullsized":"2024-08-18T22:29:23.142640+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:13.468577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142935+0000","last_change":"2024-08-18T22:29:22.146798+0000","last_active":"2024-08-18T22:29:23.142935+0000","last_peered":"2024-08-18T22:29:23.142935+0000","last_clean":"2024-08-18T22:29:23.142935+0000","last_became_active":"2024-08-18T22:29:22.146528+0000","last_became_peered":"2024-08-18T22:29:22.146528+0000","last_unstale":"2024-08-18T22:29:23.142935+0000","last_undegraded":"2024-08-18T22:29:23.142935+0000","last_fullsized":"2024-08-18T22:29:23.142935+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:21.103481+0000","last_clean_scrub_stamp":"2024-08-18T22:29:21.103481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:01:07.532803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"152'6","reported_seq":20,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.298840+0000","last_change":"2024-08-18T22:29:21.136250+0000","last_active":"2024-08-18T22:29:23.298840+0000","last_peered":"2024-08-18T22:29:23.298840+0000","last_clean":"2024-08-18T22:29:23.298840+0000","last_became_active":"2024-08-18T22:29:21.135859+0000","last_became_peered":"2024-08-18T22:29:21.135859+0000","last_unstale":"2024-08-18T22:29:23.298840+0000","last_undegraded":"2024-08-18T22:29:23.298840+0000","last_fullsized":"2024-08-18T22:29:23.298840+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:29:20.096413+0000","last_clean_scrub_stamp":"2024-08-18T22:29:20.096413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:01.018709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":439,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-08-18T22:29:23.142645+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:29:23.142645+0000","last_peered":"2024-08-18T22:29:23.142645+0000","last_clean":"2024-08-18T22:29:23.142645+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:29:23.142645+0000","last_undegraded":"2024-08-18T22:29:23.142645+0000","last_fullsized":"2024-08-18T22:29:23.142645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509566,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29468,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342372,"statfs":{"total":96636764160,"available":96606588928,"internally_reserved":0,"allocated":2506752,"data_stored":1489833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509568,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46924,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324916,"statfs":{"total":96636764160,"available":96588713984,"internally_reserved":0,"allocated":1900544,"data_stored":892821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509566,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46920,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324920,"statfs":{"total":96636764160,"available":96588718080,"internally_reserved":0,"allocated":1896448,"data_stored":892751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509567,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55264,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316576,"statfs":{"total":96636764160,"available":96580173824,"internally_reserved":0,"allocated":1916928,"data_stored":900059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509566,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55252,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316588,"statfs":{"total":96636764160,"available":96580186112,"internally_reserved":0,"allocated":1900544,"data_stored":892821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509567,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51692,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320148,"statfs":{"total":96636764160,"available":96583831552,"internally_reserved":0,"allocated":2514944,"data_stored":1485437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574974,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55268,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316572,"statfs":{"total":96636764160,"available":96580169728,"internally_reserved":0,"allocated":1921024,"data_stored":901055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55268,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316572,"statfs":{"total":96636764160,"available":96580169728,"internally_reserved":0,"allocated":1916928,"data_stored":899555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:29:26.646 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:29:26.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:29:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.834+0000 7fd595000640 1 Processor -- start 2024-08-18T22:29:26.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.834+0000 7fd595000640 1 -- start start 2024-08-18T22:29:26.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.834+0000 7fd595000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd59015b0c0 0x7fd59006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.834+0000 7fd595000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900cf290 0x7fd5900b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.834+0000 7fd595000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5900b31f0 con 0x7fd5900b40c0 2024-08-18T22:29:26.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.834+0000 7fd595000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd5900b4a70 con 0x7fd59015b0c0 2024-08-18T22:29:26.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.834+0000 7fd595000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd5900b3d70 con 0x7fd5900cf290 2024-08-18T22:29:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd58e800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900cf290 0x7fd5900b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd58de00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd59015b0c0 0x7fd59006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd58de00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd59015b0c0 0x7fd59006db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:33314/0 (socket says 172.21.15.5:33314) 2024-08-18T22:29:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd58e800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900cf290 0x7fd5900b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:44822/0 (socket says 172.21.15.5:44822) 2024-08-18T22:29:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd58de00640 1 -- 172.21.15.5:0/1174316803 learned_addr learned my addr 172.21.15.5:0/1174316803 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd585400640 1 --1- 172.21.15.5:0/1174316803 >> v1:172.21.15.117:6789/0 conn(0x7fd5900b40c0 0x7fd590072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:33670/0 (socket says 172.21.15.5:33670) 2024-08-18T22:29:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd58e800640 1 -- 172.21.15.5:0/1174316803 >> v2:172.21.15.117:3300/0 conn(0x7fd59015b0c0 msgr2=0x7fd59006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd58e800640 1 --2- 172.21.15.5:0/1174316803 >> v2:172.21.15.117:3300/0 conn(0x7fd59015b0c0 0x7fd59006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd58e800640 1 -- 172.21.15.5:0/1174316803 >> v1:172.21.15.117:6789/0 conn(0x7fd5900b40c0 legacy=0x7fd590072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd58e800640 1 -- 172.21.15.5:0/1174316803 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5900b34d0 con 0x7fd5900cf290 2024-08-18T22:29:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd58de00640 1 --2- 172.21.15.5:0/1174316803 >> v2:172.21.15.117:3300/0 conn(0x7fd59015b0c0 0x7fd59006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:26.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.838+0000 7fd58e800640 1 --2- 172.21.15.5:0/1174316803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900cf290 0x7fd5900b4530 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd588009d90 tx=0x7fd58801c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f48e469580f103 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:26.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd58d400640 1 -- 172.21.15.5:0/1174316803 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5880b2070 con 0x7fd5900cf290 2024-08-18T22:29:26.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd58d400640 1 -- 172.21.15.5:0/1174316803 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5880a58e0 con 0x7fd5900cf290 2024-08-18T22:29:26.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd58d400640 1 -- 172.21.15.5:0/1174316803 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5880a5cb0 con 0x7fd5900cf290 2024-08-18T22:29:26.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 -- 172.21.15.5:0/1174316803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900cf290 msgr2=0x7fd5900b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 --2- 172.21.15.5:0/1174316803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900cf290 0x7fd5900b4530 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd588009d90 tx=0x7fd58801c820 comp rx=0 tx=0).stop 2024-08-18T22:29:26.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 -- 172.21.15.5:0/1174316803 shutdown_connections 2024-08-18T22:29:26.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 --2- 172.21.15.5:0/1174316803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5900cf290 0x7fd5900b4530 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 --2- 172.21.15.5:0/1174316803 >> v2:172.21.15.117:3300/0 conn(0x7fd59015b0c0 0x7fd59006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 -- 172.21.15.5:0/1174316803 >> 172.21.15.5:0/1174316803 conn(0x7fd5900b1dc0 msgr2=0x7fd5900b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:26.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 -- 172.21.15.5:0/1174316803 shutdown_connections 2024-08-18T22:29:26.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 -- 172.21.15.5:0/1174316803 wait complete. 2024-08-18T22:29:26.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 Processor -- start 2024-08-18T22:29:26.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 -- start start 2024-08-18T22:29:26.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5900b40c0 0x7fd590146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5900cf290 0x7fd5900ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd59015b0c0 0x7fd5900aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd59015b620 con 0x7fd5900cf290 2024-08-18T22:29:26.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd59015b4a0 con 0x7fd5900b40c0 2024-08-18T22:29:26.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd595000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd59006f670 con 0x7fd59015b0c0 2024-08-18T22:29:26.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd585400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5900cf290 0x7fd5900ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd585400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5900cf290 0x7fd5900ad1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46850/0 (socket says 172.21.15.5:46850) 2024-08-18T22:29:26.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.842+0000 7fd585400640 1 -- 172.21.15.5:0/1329534 learned_addr learned my addr 172.21.15.5:0/1329534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:26.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd58de00640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5900b40c0 0x7fd590146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd58e800640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd59015b0c0 0x7fd5900aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd585400640 1 -- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd59015b0c0 msgr2=0x7fd5900aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd585400640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd59015b0c0 0x7fd5900aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd585400640 1 -- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5900b40c0 msgr2=0x7fd590146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd585400640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5900b40c0 0x7fd590146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd585400640 1 -- 172.21.15.5:0/1329534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd590068cd0 con 0x7fd5900cf290 2024-08-18T22:29:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd585400640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5900cf290 0x7fd5900ad1e0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c370 tx=0x7fd57800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd586a00640 1 -- 172.21.15.5:0/1329534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5780074e0 con 0x7fd5900cf290 2024-08-18T22:29:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd586a00640 1 -- 172.21.15.5:0/1329534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd578007680 con 0x7fd5900cf290 2024-08-18T22:29:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd586a00640 1 -- 172.21.15.5:0/1329534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578004a30 con 0x7fd5900cf290 2024-08-18T22:29:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd595000640 1 -- 172.21.15.5:0/1329534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd590158910 con 0x7fd5900cf290 2024-08-18T22:29:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd595000640 1 -- 172.21.15.5:0/1329534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd590158e70 con 0x7fd5900cf290 2024-08-18T22:29:26.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd595000640 1 -- 172.21.15.5:0/1329534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5900b4530 con 0x7fd5900cf290 2024-08-18T22:29:26.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd586a00640 1 -- 172.21.15.5:0/1329534 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd57801a020 con 0x7fd5900cf290 2024-08-18T22:29:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.846+0000 7fd586a00640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd56c0678c0 0x7fd56c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.850+0000 7fd586a00640 1 -- 172.21.15.5:0/1329534 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fd578085490 con 0x7fd5900cf290 2024-08-18T22:29:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.850+0000 7fd58de00640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd56c0678c0 0x7fd56c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.850+0000 7fd58de00640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd56c0678c0 0x7fd56c069d80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd58000b8d0 tx=0x7fd58000b450 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:26.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:26.854+0000 7fd586a00640 1 -- 172.21.15.5:0/1329534 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd590158910 con 0x7fd5900cf290 2024-08-18T22:29:27.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.074+0000 7fd595000640 1 -- 172.21.15.5:0/1329534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd5900cf910 con 0x7fd5900cf290 2024-08-18T22:29:27.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.078+0000 7fd586a00640 1 -- 172.21.15.5:0/1329534 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7fd5780557e0 con 0x7fd5900cf290 2024-08-18T22:29:27.075 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:29:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:29:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:29:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:29:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:29:27.076 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.078+0000 7fd595000640 1 -- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd56c0678c0 msgr2=0x7fd56c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.078+0000 7fd595000640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd56c0678c0 0x7fd56c069d80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd58000b8d0 tx=0x7fd58000b450 comp rx=0 tx=0).stop 2024-08-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.078+0000 7fd595000640 1 -- 172.21.15.5:0/1329534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5900cf290 msgr2=0x7fd5900ad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.078+0000 7fd595000640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5900cf290 0x7fd5900ad1e0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c370 tx=0x7fd57800c830 comp rx=0 tx=0).stop 2024-08-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.082+0000 7fd595000640 1 -- 172.21.15.5:0/1329534 shutdown_connections 2024-08-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.082+0000 7fd595000640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd56c0678c0 0x7fd56c069d80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.082+0000 7fd595000640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd59015b0c0 0x7fd5900aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.082+0000 7fd595000640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5900cf290 0x7fd5900ad1e0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.082+0000 7fd595000640 1 --2- 172.21.15.5:0/1329534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5900b40c0 0x7fd590146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.082+0000 7fd595000640 1 -- 172.21.15.5:0/1329534 >> 172.21.15.5:0/1329534 conn(0x7fd5900b1dc0 msgr2=0x7fd59015a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.082+0000 7fd595000640 1 -- 172.21.15.5:0/1329534 shutdown_connections 2024-08-18T22:29:27.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.082+0000 7fd595000640 1 -- 172.21.15.5:0/1329534 wait complete. 2024-08-18T22:29:27.095 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-08-18T22:29:27.098+0000 7f7e7aa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:29:27.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:27.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29e1a00640 1 Processor -- start 2024-08-18T22:29:27.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29e1a00640 1 -- start start 2024-08-18T22:29:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29e1a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29dc0cb390 0x7f29dc0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29e1a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc073c80 con 0x7f29dc15bed0 2024-08-18T22:29:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29e1a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc0ca5d0 con 0x7f29dc06da70 2024-08-18T22:29:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29e1a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc0ca8b0 con 0x7f29dc0cb390 2024-08-18T22:29:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29daa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f29dc15bed0 0x7f29dc071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59868/0 (socket says 172.21.15.5:59868) 2024-08-18T22:29:27.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29daa00640 1 -- 172.21.15.5:0/716073296 learned_addr learned my addr 172.21.15.5:0/716073296 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656420163 0 0) 0x7f29dc073c80 con 0x7f29dc15bed0 2024-08-18T22:29:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c0003530 con 0x7f29dc15bed0 2024-08-18T22:29:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29d2000640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29dc0cb390 0x7f29dc0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 842214711 0 0) 0x7f29c0003530 con 0x7f29dc15bed0 2024-08-18T22:29:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29dc0cb390 msgr2=0x7f29dc0735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29dc0cb390 0x7f29dc0735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 >> v1:172.21.15.117:6789/0 conn(0x7f29dc06da70 legacy=0x7f29dc165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc0cab90 con 0x7f29dc15bed0 2024-08-18T22:29:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f29cc001680 con 0x7f29dc15bed0 2024-08-18T22:29:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 >> v1:172.21.15.5:6789/0 conn(0x7f29dc15bed0 legacy=0x7f29dc071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00039f0 0x7f29c0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c0004810 0x7f29c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29dc0cb390 0x7f29c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc0ca8b0 con 0x7f29c00039f0 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f29c000ba80 con 0x7f29c0004810 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29c000bc80 con 0x7f29dc0cb390 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29daa00640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00039f0 0x7f29c0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29d2000640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c0004810 0x7f29c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29db400640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29dc0cb390 0x7f29c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29daa00640 1 -- 172.21.15.5:0/716073296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29dc0cb390 msgr2=0x7f29c00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29daa00640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29dc0cb390 0x7f29c00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29daa00640 1 -- 172.21.15.5:0/716073296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c0004810 msgr2=0x7f29c0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29daa00640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29c0004810 0x7f29c0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.242+0000 7f29daa00640 1 -- 172.21.15.5:0/716073296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c0003530 con 0x7f29c00039f0 2024-08-18T22:29:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.246+0000 7f29daa00640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00039f0 0x7f29c0003e10 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00c210 tx=0x7f29cc01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f430cd538f30e140 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.246+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc007d20 con 0x7f29c00039f0 2024-08-18T22:29:27.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.246+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29cc0a9070 con 0x7f29c00039f0 2024-08-18T22:29:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.246+0000 7f29da000640 1 -- 172.21.15.5:0/716073296 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0a5d50 con 0x7f29c00039f0 2024-08-18T22:29:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.246+0000 7f29e1a00640 1 -- 172.21.15.5:0/716073296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00039f0 msgr2=0x7f29c0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.246+0000 7f29e1a00640 1 --2- 172.21.15.5:0/716073296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c00039f0 0x7f29c0003e10 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00c210 tx=0x7f29cc01cc10 comp rx=0 tx=0).stop 2024-08-18T22:29:27.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.246+0000 7f29db400640 1 -- 172.21.15.5:0/716073296 reap_dead start 2024-08-18T22:29:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.246+0000 7f29e1a00640 1 -- 172.21.15.5:0/716073296 shutdown_connections 2024-08-18T22:29:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.246+0000 7f29e1a00640 1 -- 172.21.15.5:0/716073296 >> 172.21.15.5:0/716073296 conn(0x7f29dc0b1c50 msgr2=0x7f29dc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.246+0000 7f29e1a00640 1 -- 172.21.15.5:0/716073296 shutdown_connections 2024-08-18T22:29:27.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.246+0000 7f29e1a00640 1 -- 172.21.15.5:0/716073296 wait complete. 2024-08-18T22:29:27.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29e1a00640 1 Processor -- start 2024-08-18T22:29:27.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29e1a00640 1 -- start start 2024-08-18T22:29:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29e1a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29c00039f0 0x7f29dc0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29e1a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29dc0ce860 0x7f29dc15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29e1a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29dc0ceca0 0x7f29dc0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29e1a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc15c430 con 0x7f29dc0ceca0 2024-08-18T22:29:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29e1a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc15c2b0 con 0x7f29dc0ce860 2024-08-18T22:29:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29e1a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc167ab0 con 0x7f29c00039f0 2024-08-18T22:29:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29db400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29dc0ceca0 0x7f29dc0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29d2000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29dc0ce860 0x7f29dc15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29daa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29c00039f0 0x7f29dc0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29d2000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29dc0ce860 0x7f29dc15ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:33342/0 (socket says 172.21.15.5:33342) 2024-08-18T22:29:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29d2000640 1 -- 172.21.15.5:0/585239621 learned_addr learned my addr 172.21.15.5:0/585239621 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29db400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29dc0ceca0 0x7f29dc0c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46868/0 (socket says 172.21.15.5:46868) 2024-08-18T22:29:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29db400640 1 -- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29c00039f0 msgr2=0x7f29dc0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29db400640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29c00039f0 0x7f29dc0cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29db400640 1 -- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29dc0ce860 msgr2=0x7f29dc15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29db400640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29dc0ce860 0x7f29dc15ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29db400640 1 -- 172.21.15.5:0/585239621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc15c970 con 0x7f29dc0ceca0 2024-08-18T22:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29db400640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29dc0ceca0 0x7f29dc0c9300 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0b2cf0 tx=0x7f29d400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29d3400640 1 -- 172.21.15.5:0/585239621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4003980 con 0x7f29dc0ceca0 2024-08-18T22:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29d3400640 1 -- 172.21.15.5:0/585239621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d4018070 con 0x7f29dc0ceca0 2024-08-18T22:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29d3400640 1 -- 172.21.15.5:0/585239621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4003d60 con 0x7f29dc0ceca0 2024-08-18T22:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.250+0000 7f29e1a00640 1 -- 172.21.15.5:0/585239621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc15cc50 con 0x7f29dc0ceca0 2024-08-18T22:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.254+0000 7f29e1a00640 1 -- 172.21.15.5:0/585239621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc15d210 con 0x7f29dc0ceca0 2024-08-18T22:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.254+0000 7f29e1a00640 1 -- 172.21.15.5:0/585239621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29dc071b20 con 0x7f29dc0ceca0 2024-08-18T22:29:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.254+0000 7f29d3400640 1 -- 172.21.15.5:0/585239621 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29d40050d0 con 0x7f29dc0ceca0 2024-08-18T22:29:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.254+0000 7f29d3400640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29b80678f0 0x7f29b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.254+0000 7f29d3400640 1 -- 172.21.15.5:0/585239621 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f29d4085a80 con 0x7f29dc0ceca0 2024-08-18T22:29:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.254+0000 7f29daa00640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29b80678f0 0x7f29b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.254+0000 7f29daa00640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29b80678f0 0x7f29b8069db0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0ab000 tx=0x7f29cc0b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:27.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.258+0000 7f29d3400640 1 -- 172.21.15.5:0/585239621 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f29d4087e20 con 0x7f29dc0ceca0 2024-08-18T22:29:27.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.458+0000 7f29e1a00640 1 -- 172.21.15.5:0/585239621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29dc0cc2c0 con 0x7f29dc0ceca0 2024-08-18T22:29:27.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.458+0000 7f29d3400640 1 -- 172.21.15.5:0/585239621 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7f29d4055d40 con 0x7f29dc0ceca0 2024-08-18T22:29:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:27.458 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:29:27.458 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:29:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 -- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29b80678f0 msgr2=0x7f29b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29b80678f0 0x7f29b8069db0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0ab000 tx=0x7f29cc0b1040 comp rx=0 tx=0).stop 2024-08-18T22:29:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 -- 172.21.15.5:0/585239621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29dc0ceca0 msgr2=0x7f29dc0c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29dc0ceca0 0x7f29dc0c9300 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0b2cf0 tx=0x7f29d400ec10 comp rx=0 tx=0).stop 2024-08-18T22:29:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 -- 172.21.15.5:0/585239621 shutdown_connections 2024-08-18T22:29:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29b80678f0 0x7f29b8069db0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29dc0ceca0 0x7f29dc0c9300 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29dc0ce860 0x7f29dc15ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 --2- 172.21.15.5:0/585239621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29c00039f0 0x7f29dc0cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 -- 172.21.15.5:0/585239621 >> 172.21.15.5:0/585239621 conn(0x7f29dc0b1c50 msgr2=0x7f29dc0cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:27.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 -- 172.21.15.5:0/585239621 shutdown_connections 2024-08-18T22:29:27.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:27.462+0000 7f29e1a00640 1 -- 172.21.15.5:0/585239621 wait complete. 2024-08-18T22:29:27.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 117, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:29:21.514415+0000', 'modified': '2024-08-18T22:29:24.540103+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9015}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9015': {'gid': 9015, 'name': 'a', 'rank': 0, 'incarnation': 113, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/1418980807', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 1418980807}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1418980807}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9015, 'qdb_cluster': [9015]} 2024-08-18T22:29:27.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:29:27.883 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-18T22:29:28.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.030+0000 7fc8caa00640 1 Processor -- start 2024-08-18T22:29:28.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.030+0000 7fc8caa00640 1 -- start start 2024-08-18T22:29:28.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.030+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c415c560 0x7fc8c40ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.030+0000 7fc8caa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8c415d4d0 0x7fc8c406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.030+0000 7fc8caa00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8c40cfb00 con 0x7fc8c415c180 2024-08-18T22:29:28.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.030+0000 7fc8caa00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc8c415d040 con 0x7fc8c415d4d0 2024-08-18T22:29:28.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.030+0000 7fc8caa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c415c9f0 con 0x7fc8c415c560 2024-08-18T22:29:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c8a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8c415d4d0 0x7fc8c406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c3400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c415c560 0x7fc8c40ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c3e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fc8c415c180 0x7fc8c40cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:33686/0 (socket says 172.21.15.5:33686) 2024-08-18T22:29:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c8a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8c415d4d0 0x7fc8c406db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:33350/0 (socket says 172.21.15.5:33350) 2024-08-18T22:29:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c3e00640 1 -- 172.21.15.5:0/2389425468 learned_addr learned my addr 172.21.15.5:0/2389425468 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c3400640 1 -- 172.21.15.5:0/2389425468 >> v2:172.21.15.117:3300/0 conn(0x7fc8c415d4d0 msgr2=0x7fc8c406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c3400640 1 --2- 172.21.15.5:0/2389425468 >> v2:172.21.15.117:3300/0 conn(0x7fc8c415d4d0 0x7fc8c406db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c3400640 1 -- 172.21.15.5:0/2389425468 >> v1:172.21.15.117:6789/0 conn(0x7fc8c415c180 legacy=0x7fc8c40cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c3400640 1 -- 172.21.15.5:0/2389425468 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c415ccd0 con 0x7fc8c415c560 2024-08-18T22:29:28.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c8a00640 1 --2- 172.21.15.5:0/2389425468 >> v2:172.21.15.117:3300/0 conn(0x7fc8c415d4d0 0x7fc8c406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:28.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c3400640 1 --2- 172.21.15.5:0/2389425468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c415c560 0x7fc8c40ce620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00097c0 tx=0x7fc8b001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1cf042c14fd206b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:28.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c2a00640 1 -- 172.21.15.5:0/2389425468 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00ab430 con 0x7fc8c415c560 2024-08-18T22:29:28.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c2a00640 1 -- 172.21.15.5:0/2389425468 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b00b0070 con 0x7fc8c415c560 2024-08-18T22:29:28.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.034+0000 7fc8c2a00640 1 -- 172.21.15.5:0/2389425468 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00ab7f0 con 0x7fc8c415c560 2024-08-18T22:29:28.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 -- 172.21.15.5:0/2389425468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c415c560 msgr2=0x7fc8c40ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 --2- 172.21.15.5:0/2389425468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c415c560 0x7fc8c40ce620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00097c0 tx=0x7fc8b001c410 comp rx=0 tx=0).stop 2024-08-18T22:29:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 -- 172.21.15.5:0/2389425468 shutdown_connections 2024-08-18T22:29:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 --2- 172.21.15.5:0/2389425468 >> v2:172.21.15.117:3300/0 conn(0x7fc8c415d4d0 0x7fc8c406db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 --2- 172.21.15.5:0/2389425468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c415c560 0x7fc8c40ce620 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 -- 172.21.15.5:0/2389425468 >> 172.21.15.5:0/2389425468 conn(0x7fc8c40b1dc0 msgr2=0x7fc8c40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 -- 172.21.15.5:0/2389425468 shutdown_connections 2024-08-18T22:29:28.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 -- 172.21.15.5:0/2389425468 wait complete. 2024-08-18T22:29:28.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 Processor -- start 2024-08-18T22:29:28.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 -- start start 2024-08-18T22:29:28.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c415c180 0x7fc8c4156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8c415d4d0 0x7fc8c4156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8c4154170 0x7fc8c41f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c41692b0 con 0x7fc8c415d4d0 2024-08-18T22:29:28.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c4169130 con 0x7fc8c4154170 2024-08-18T22:29:28.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8caa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c4169430 con 0x7fc8c415c180 2024-08-18T22:29:28.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8c3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8c415d4d0 0x7fc8c4156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8c3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8c415d4d0 0x7fc8c4156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46870/0 (socket says 172.21.15.5:46870) 2024-08-18T22:29:28.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8c3400640 1 -- 172.21.15.5:0/1788663198 learned_addr learned my addr 172.21.15.5:0/1788663198 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:28.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c415c180 0x7fc8c4156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.038+0000 7fc8c8a00640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8c4154170 0x7fc8c41f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8c3400640 1 -- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c415c180 msgr2=0x7fc8c4156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8c3400640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c415c180 0x7fc8c4156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8c3400640 1 -- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8c4154170 msgr2=0x7fc8c41f76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8c3400640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8c4154170 0x7fc8c41f76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8c3400640 1 -- 172.21.15.5:0/1788663198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c409a770 con 0x7fc8c415d4d0 2024-08-18T22:29:28.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8c3400640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8c415d4d0 0x7fc8c4156540 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00ad040 tx=0x7fc8b00191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8bbe00640 1 -- 172.21.15.5:0/1788663198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00bd480 con 0x7fc8c415d4d0 2024-08-18T22:29:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8bbe00640 1 -- 172.21.15.5:0/1788663198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c40ced70 con 0x7fc8c415d4d0 2024-08-18T22:29:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8bbe00640 1 -- 172.21.15.5:0/1788663198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00bd880 con 0x7fc8c415d4d0 2024-08-18T22:29:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8caa00640 1 -- 172.21.15.5:0/1788663198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c409aa50 con 0x7fc8c415d4d0 2024-08-18T22:29:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8caa00640 1 -- 172.21.15.5:0/1788663198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c409b010 con 0x7fc8c415d4d0 2024-08-18T22:29:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.042+0000 7fc8bbe00640 1 -- 172.21.15.5:0/1788663198 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc8b00c73f0 con 0x7fc8c415d4d0 2024-08-18T22:29:28.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8bbe00640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8a40678c0 0x7fc8a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8bbe00640 1 -- 172.21.15.5:0/1788663198 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fc8b0120280 con 0x7fc8c415d4d0 2024-08-18T22:29:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8a40678c0 0x7fc8a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8cde87000 1 Processor -- start 2024-08-18T22:29:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8cde87000 1 -- start start 2024-08-18T22:29:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8a40678c0 0x7fc8a4069d80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4000f70 tx=0x7fc8b4007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73ad50 0x559ddd73b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73b670 0x559ddd6f1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd6f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8cde87000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559ddd5d7fd0 con 0x559ddd6f1990 2024-08-18T22:29:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8cde87000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559ddd53e3c0 con 0x559ddd73b670 2024-08-18T22:29:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8cde87000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559ddd4e3f70 con 0x559ddd73ad50 2024-08-18T22:29:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c8a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd6f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c8a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd6f1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46878/0 (socket says 172.21.15.5:46878) 2024-08-18T22:29:28.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c8a00640 1 -- 172.21.15.5:0/3502810600 learned_addr learned my addr 172.21.15.5:0/3502810600 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c3400640 1 --2- 172.21.15.5:0/3502810600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73b670 0x559ddd6f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/3502810600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73ad50 0x559ddd73b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c8a00640 1 -- 172.21.15.5:0/3502810600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73ad50 msgr2=0x559ddd73b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c8a00640 1 --2- 172.21.15.5:0/3502810600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73ad50 0x559ddd73b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c8a00640 1 -- 172.21.15.5:0/3502810600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73b670 msgr2=0x559ddd6f1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c8a00640 1 --2- 172.21.15.5:0/3502810600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73b670 0x559ddd6f1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c8a00640 1 -- 172.21.15.5:0/3502810600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ddd4d82e0 con 0x559ddd6f1990 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c3400640 1 --2- 172.21.15.5:0/3502810600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73b670 0x559ddd6f1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8c8a00640 1 --2- 172.21.15.5:0/3502810600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd6f1d70 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc011310 tx=0x7fc8bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627a6c909cf30087 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8b8c00640 1 -- 172.21.15.5:0/3502810600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc003ba0 con 0x559ddd6f1990 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8b8c00640 1 -- 172.21.15.5:0/3502810600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8bc003d40 con 0x559ddd6f1990 2024-08-18T22:29:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8b8c00640 1 -- 172.21.15.5:0/3502810600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc015840 con 0x559ddd6f1990 2024-08-18T22:29:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8cde87000 1 -- 172.21.15.5:0/3502810600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 msgr2=0x559ddd6f1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.046+0000 7fc8cde87000 1 --2- 172.21.15.5:0/3502810600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd6f1d70 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc011310 tx=0x7fc8bc009750 comp rx=0 tx=0).stop 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 -- 172.21.15.5:0/3502810600 shutdown_connections 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 --2- 172.21.15.5:0/3502810600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd6f1d70 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 --2- 172.21.15.5:0/3502810600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73b670 0x559ddd6f1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 --2- 172.21.15.5:0/3502810600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73ad50 0x559ddd73b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 -- 172.21.15.5:0/3502810600 >> 172.21.15.5:0/3502810600 conn(0x559ddd6ed910 msgr2=0x559ddd6efd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 -- 172.21.15.5:0/3502810600 shutdown_connections 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 -- 172.21.15.5:0/3502810600 wait complete. 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 -- start start 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 Processor -- start 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd728640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73ad50 0x559ddd6f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73b670 0x559ddd6f7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559ddd4e5e40 con 0x559ddd6f1990 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559ddd5fbaf0 con 0x559ddd73b670 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559ddd5a0450 con 0x559ddd73ad50 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 10 client.0 _ll_register_callbacks cb 0x559ddd6dc630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd728640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd728640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46886/0 (socket says 172.21.15.5:46886) 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8c3e00640 1 -- 172.21.15.5:0/1052196146 learned_addr learned my addr 172.21.15.5:0/1052196146 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8c8a00640 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73b670 0x559ddd6f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8c3400640 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73ad50 0x559ddd6f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8c3e00640 1 -- 172.21.15.5:0/1052196146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73ad50 msgr2=0x559ddd6f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73ad50 0x559ddd6f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8c3e00640 1 -- 172.21.15.5:0/1052196146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73b670 msgr2=0x559ddd6f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73b670 0x559ddd6f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8c3e00640 1 -- 172.21.15.5:0/1052196146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ddd4c5fd0 con 0x559ddd6f1990 2024-08-18T22:29:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd728640 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4004c80 tx=0x7fc8b4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740ddc6aa3cdf592 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8ad600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8ad600640 1 -- 172.21.15.5:0/1052196146 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4020580 con 0x559ddd6f1990 2024-08-18T22:29:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 -- 172.21.15.5:0/1052196146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8bc003d40 con 0x559ddd6f1990 2024-08-18T22:29:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8ad600640 1 -- 172.21.15.5:0/1052196146 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fc8b4020720 con 0x559ddd6f1990 2024-08-18T22:29:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8ad600640 1 -- 172.21.15.5:0/1052196146 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fc8b402e050 con 0x559ddd6f1990 2024-08-18T22:29:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 10 client.9126 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.050+0000 7fc8cde87000 1 -- 172.21.15.5:0/1052196146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x559ddd5c14d0 con 0x559ddd6f1990 2024-08-18T22:29:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8ad600640 1 -- 172.21.15.5:0/1052196146 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8bc003d40 con 0x559ddd6f1990 2024-08-18T22:29:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8ad600640 1 -- 172.21.15.5:0/1052196146 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7fc8b4031020 con 0x559ddd6f1990 2024-08-18T22:29:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 10 client.9126 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 10 client.9126 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 20 client.9126 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x559ddd7294f0 0x559ddd7298d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 4 client.9126 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 -- 172.21.15.5:0/1052196146 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ddd4d8c00 con 0x559ddd7294f0 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8c3400640 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x559ddd7294f0 0x559ddd7298d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8c3400640 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x559ddd7294f0 0x559ddd7298d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21448578ae1be3c1 server_cookie=3c257cf311c779e2 in_seq=0 out_seq=0 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8ad600640 10 client.9126 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8ad600640 1 -- 172.21.15.5:0/1052196146 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ddd4d8c00 con 0x559ddd7294f0 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8ad600640 10 client.9126 handle_command_reply: tid=0 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 client.9126 shutdown 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 -- 172.21.15.5:0/1052196146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 msgr2=0x559ddd728640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd728640 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4004c80 tx=0x7fc8b4000bd0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 -- 172.21.15.5:0/1052196146 shutdown_connections 2024-08-18T22:29:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73b670 0x559ddd6f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73ad50 0x559ddd6f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x559ddd7294f0 0x559ddd7298d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 --2- 172.21.15.5:0/1052196146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd728640 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 -- 172.21.15.5:0/1052196146 >> 172.21.15.5:0/1052196146 conn(0x559ddd6ed910 msgr2=0x559ddd6f0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8ad600640 0 client.9126 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 -- 172.21.15.5:0/1052196146 shutdown_connections 2024-08-18T22:29:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 1 -- 172.21.15.5:0/1052196146 wait complete. 2024-08-18T22:29:28.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.054+0000 7fc8cde87000 20 client.9126 trim_cache size 0 max 16384 2024-08-18T22:29:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 Processor -- start 2024-08-18T22:29:28.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 -- start start 2024-08-18T22:29:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd6f1990 0x559ddd73a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd73ad50 0x559ddd73a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73b670 0x559ddd752060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c4203530 con 0x559ddd73ad50 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c409c920 con 0x559ddd6f1990 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c4202ee0 con 0x559ddd73b670 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd73ad50 0x559ddd73a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd73ad50 0x559ddd73a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46894/0 (socket says 172.21.15.5:46894) 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c3400640 1 -- 172.21.15.5:0/3005385293 learned_addr learned my addr 172.21.15.5:0/3005385293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c8a00640 1 --2- 172.21.15.5:0/3005385293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73b670 0x559ddd752060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/3005385293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd6f1990 0x559ddd73a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c3400640 1 -- 172.21.15.5:0/3005385293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73b670 msgr2=0x559ddd752060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c3400640 1 --2- 172.21.15.5:0/3005385293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73b670 0x559ddd752060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c3400640 1 -- 172.21.15.5:0/3005385293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd6f1990 msgr2=0x559ddd73a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c3400640 1 --2- 172.21.15.5:0/3005385293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd6f1990 0x559ddd73a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c3400640 1 -- 172.21.15.5:0/3005385293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ddd537b30 con 0x559ddd73ad50 2024-08-18T22:29:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/3005385293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd6f1990 0x559ddd73a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8c3400640 1 --2- 172.21.15.5:0/3005385293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd73ad50 0x559ddd73a5a0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fc8b001c8f0 tx=0x7fc8b00b6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9538330ee464a62 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8afe00640 1 -- 172.21.15.5:0/3005385293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00c2040 con 0x559ddd73ad50 2024-08-18T22:29:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8afe00640 1 -- 172.21.15.5:0/3005385293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b00b0040 con 0x559ddd73ad50 2024-08-18T22:29:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8afe00640 1 -- 172.21.15.5:0/3005385293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00ee8d0 con 0x559ddd73ad50 2024-08-18T22:29:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 -- 172.21.15.5:0/3005385293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd73ad50 msgr2=0x559ddd73a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 --2- 172.21.15.5:0/3005385293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd73ad50 0x559ddd73a5a0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fc8b001c8f0 tx=0x7fc8b00b6040 comp rx=0 tx=0).stop 2024-08-18T22:29:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 -- 172.21.15.5:0/3005385293 shutdown_connections 2024-08-18T22:29:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 --2- 172.21.15.5:0/3005385293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73b670 0x559ddd752060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 --2- 172.21.15.5:0/3005385293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd73ad50 0x559ddd73a5a0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 --2- 172.21.15.5:0/3005385293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd6f1990 0x559ddd73a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 -- 172.21.15.5:0/3005385293 >> 172.21.15.5:0/3005385293 conn(0x559ddd6ed910 msgr2=0x559ddd739950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 -- 172.21.15.5:0/3005385293 shutdown_connections 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.074+0000 7fc8cde87000 1 -- 172.21.15.5:0/3005385293 wait complete. 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 -- start start 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 Processor -- start 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd74f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73ad50 0x559ddd74f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73b670 0x559ddd74fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559ddd4f71d0 con 0x559ddd6f1990 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559ddd4d5900 con 0x559ddd73ad50 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559ddd53d6d0 con 0x559ddd73b670 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 10 client.0 _ll_register_callbacks cb 0x7fc8b4001540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd74f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd74f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46908/0 (socket says 172.21.15.5:46908) 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3e00640 1 -- 172.21.15.5:0/829995906 learned_addr learned my addr 172.21.15.5:0/829995906 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3400640 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73ad50 0x559ddd74f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c8a00640 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73b670 0x559ddd74fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3e00640 1 -- 172.21.15.5:0/829995906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73b670 msgr2=0x559ddd74fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73b670 0x559ddd74fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3e00640 1 -- 172.21.15.5:0/829995906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73ad50 msgr2=0x559ddd74f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73ad50 0x559ddd74f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3e00640 1 -- 172.21.15.5:0/829995906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ddd4ef810 con 0x559ddd6f1990 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3400640 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73ad50 0x559ddd74f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3e00640 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd74f350 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4020a60 tx=0x7fc8b400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cea995c884c6234 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8ad600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8ad600640 1 -- 172.21.15.5:0/829995906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4001d40 con 0x559ddd6f1990 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8ad600640 1 -- 172.21.15.5:0/829995906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fc8b4020e00 con 0x559ddd6f1990 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 -- 172.21.15.5:0/829995906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8b00b0040 con 0x559ddd6f1990 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8ad600640 1 -- 172.21.15.5:0/829995906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fc8b4042050 con 0x559ddd6f1990 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 10 client.9132 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 -- 172.21.15.5:0/829995906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x559ddd4d4d30 con 0x559ddd6f1990 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8ad600640 1 -- 172.21.15.5:0/829995906 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b00b0040 con 0x559ddd6f1990 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8ad600640 1 -- 172.21.15.5:0/829995906 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7fc8b4045020 con 0x559ddd6f1990 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 10 client.9132 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 10 client.9132 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 20 client.9132 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x559ddd750730 0x559ddd7b6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 4 client.9132 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8cde87000 1 -- 172.21.15.5:0/829995906 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "status"}) -- 0x559ddd54baf0 con 0x559ddd750730 2024-08-18T22:29:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3400640 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x559ddd750730 0x559ddd7b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8c3400640 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x559ddd750730 0x559ddd7b6220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a27ea4f1cad9d1 server_cookie=9bf51dc4831893d1 in_seq=0 out_seq=0 2024-08-18T22:29:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.078+0000 7fc8ad600640 10 client.9132 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8ad600640 1 -- 172.21.15.5:0/829995906 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x559ddd54baf0 con 0x559ddd750730 2024-08-18T22:29:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8ad600640 10 client.9132 handle_command_reply: tid=0 2024-08-18T22:29:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 1 client.9132 shutdown 2024-08-18T22:29:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 1 -- 172.21.15.5:0/829995906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 msgr2=0x559ddd74f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd74f350 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4020a60 tx=0x7fc8b400a000 comp rx=0 tx=0).stop 2024-08-18T22:29:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 1 -- 172.21.15.5:0/829995906 shutdown_connections 2024-08-18T22:29:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559ddd73b670 0x559ddd74fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559ddd73ad50 0x559ddd74f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x559ddd750730 0x559ddd7b6220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 1 --2- 172.21.15.5:0/829995906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559ddd6f1990 0x559ddd74f350 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8ad600640 0 client.9132 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 1 -- 172.21.15.5:0/829995906 >> 172.21.15.5:0/829995906 conn(0x559ddd6ed910 msgr2=0x559ddd73a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 1 -- 172.21.15.5:0/829995906 shutdown_connections 2024-08-18T22:29:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 1 -- 172.21.15.5:0/829995906 wait complete. 2024-08-18T22:29:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8cde87000 20 client.9132 trim_cache size 0 max 16384 2024-08-18T22:29:28.083 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:29:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:29:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:29:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 9015, 2024-08-18T22:29:28.083 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:29:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:29:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:29:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.9585564289999997, 2024-08-18T22:29:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 117, 2024-08-18T22:29:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 153, 2024-08-18T22:29:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 153, 2024-08-18T22:29:28.084 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 11.858123851 2024-08-18T22:29:28.084 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:29:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 -- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8a40678c0 msgr2=0x7fc8a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8a40678c0 0x7fc8a4069d80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4000f70 tx=0x7fc8b4007e90 comp rx=0 tx=0).stop 2024-08-18T22:29:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 -- 172.21.15.5:0/1788663198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8c415d4d0 msgr2=0x7fc8c4156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8c415d4d0 0x7fc8c4156540 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00ad040 tx=0x7fc8b00191b0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 -- 172.21.15.5:0/1788663198 shutdown_connections 2024-08-18T22:29:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc8a40678c0 0x7fc8a4069d80 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8c4154170 0x7fc8c41f76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8c415d4d0 0x7fc8c4156540 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 --2- 172.21.15.5:0/1788663198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c415c180 0x7fc8c4156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 -- 172.21.15.5:0/1788663198 >> 172.21.15.5:0/1788663198 conn(0x7fc8c40b1dc0 msgr2=0x7fc8c4071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 -- 172.21.15.5:0/1788663198 shutdown_connections 2024-08-18T22:29:28.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.082+0000 7fc8caa00640 1 -- 172.21.15.5:0/1788663198 wait complete. 2024-08-18T22:29:28.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:29:28.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf36a00640 1 Processor -- start 2024-08-18T22:29:28.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf36a00640 1 -- start start 2024-08-18T22:29:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf36a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf3015c180 0x7fcf300b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf36a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcf3006fad0 0x7fcf3015c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf36a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf30071580 0x7fcf30071a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf36a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcf3015caa0 con 0x7fcf3015c180 2024-08-18T22:29:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf36a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcf300b5e30 con 0x7fcf3006fad0 2024-08-18T22:29:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf36a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcf300b6110 con 0x7fcf30071580 2024-08-18T22:29:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf2fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf3015c180 0x7fcf300b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf2fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf3015c180 0x7fcf300b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46912/0 (socket says 172.21.15.5:46912) 2024-08-18T22:29:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf2fe00640 1 -- 172.21.15.5:0/2702010791 learned_addr learned my addr 172.21.15.5:0/2702010791 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf34a00640 1 --2- 172.21.15.5:0/2702010791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf30071580 0x7fcf30071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf2f400640 1 --2- 172.21.15.5:0/2702010791 >> v2:172.21.15.117:3300/0 conn(0x7fcf3006fad0 0x7fcf3015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf2fe00640 1 -- 172.21.15.5:0/2702010791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf30071580 msgr2=0x7fcf30071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf2fe00640 1 --2- 172.21.15.5:0/2702010791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf30071580 0x7fcf30071a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf2fe00640 1 -- 172.21.15.5:0/2702010791 >> v2:172.21.15.117:3300/0 conn(0x7fcf3006fad0 msgr2=0x7fcf3015c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf2fe00640 1 --2- 172.21.15.5:0/2702010791 >> v2:172.21.15.117:3300/0 conn(0x7fcf3006fad0 0x7fcf3015c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf2fe00640 1 -- 172.21.15.5:0/2702010791 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf300b63f0 con 0x7fcf3015c180 2024-08-18T22:29:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf2f400640 1 --2- 172.21.15.5:0/2702010791 >> v2:172.21.15.117:3300/0 conn(0x7fcf3006fad0 0x7fcf3015c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.242+0000 7fcf34a00640 1 --2- 172.21.15.5:0/2702010791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf30071580 0x7fcf30071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf2fe00640 1 --2- 172.21.15.5:0/2702010791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3015c180 0x7fcf300b57c0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fcf300694d0 tx=0x7fcf2001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6407bea8e0cf050e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf2ea00640 1 -- 172.21.15.5:0/2702010791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf200b0070 con 0x7fcf3015c180 2024-08-18T22:29:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf2ea00640 1 -- 172.21.15.5:0/2702010791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf200ab600 con 0x7fcf3015c180 2024-08-18T22:29:28.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf2ea00640 1 -- 172.21.15.5:0/2702010791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf200ab9d0 con 0x7fcf3015c180 2024-08-18T22:29:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf36a00640 1 -- 172.21.15.5:0/2702010791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3015c180 msgr2=0x7fcf300b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf36a00640 1 --2- 172.21.15.5:0/2702010791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3015c180 0x7fcf300b57c0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fcf300694d0 tx=0x7fcf2001c400 comp rx=0 tx=0).stop 2024-08-18T22:29:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf36a00640 1 -- 172.21.15.5:0/2702010791 shutdown_connections 2024-08-18T22:29:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf36a00640 1 --2- 172.21.15.5:0/2702010791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf30071580 0x7fcf30071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf36a00640 1 --2- 172.21.15.5:0/2702010791 >> v2:172.21.15.117:3300/0 conn(0x7fcf3006fad0 0x7fcf3015c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf36a00640 1 --2- 172.21.15.5:0/2702010791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3015c180 0x7fcf300b57c0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf36a00640 1 -- 172.21.15.5:0/2702010791 >> 172.21.15.5:0/2702010791 conn(0x7fcf300b3eb0 msgr2=0x7fcf300b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf36a00640 1 -- 172.21.15.5:0/2702010791 shutdown_connections 2024-08-18T22:29:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.246+0000 7fcf36a00640 1 -- 172.21.15.5:0/2702010791 wait complete. 2024-08-18T22:29:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf36a00640 1 Processor -- start 2024-08-18T22:29:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf36a00640 1 -- start start 2024-08-18T22:29:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf36a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3006fad0 0x7fcf3014ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf36a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf30071580 0x7fcf301393d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf36a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3015c180 0x7fcf30151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf36a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcf300d1c30 con 0x7fcf3015c180 2024-08-18T22:29:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf36a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcf300d1ab0 con 0x7fcf30071580 2024-08-18T22:29:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf36a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcf300d1db0 con 0x7fcf3006fad0 2024-08-18T22:29:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf34a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3015c180 0x7fcf30151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf34a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3015c180 0x7fcf30151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46922/0 (socket says 172.21.15.5:46922) 2024-08-18T22:29:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf34a00640 1 -- 172.21.15.5:0/2091502521 learned_addr learned my addr 172.21.15.5:0/2091502521 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf2fe00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3006fad0 0x7fcf3014ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf2f400640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf30071580 0x7fcf301393d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf34a00640 1 -- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3006fad0 msgr2=0x7fcf3014ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf34a00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3006fad0 0x7fcf3014ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf34a00640 1 -- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf30071580 msgr2=0x7fcf301393d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf34a00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf30071580 0x7fcf301393d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf34a00640 1 -- 172.21.15.5:0/2091502521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3014d3f0 con 0x7fcf3015c180 2024-08-18T22:29:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf34a00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3015c180 0x7fcf30151f60 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800cef0 tx=0x7fcf2800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf27e00640 1 -- 172.21.15.5:0/2091502521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2801a070 con 0x7fcf3015c180 2024-08-18T22:29:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf27e00640 1 -- 172.21.15.5:0/2091502521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2800d860 con 0x7fcf3015c180 2024-08-18T22:29:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf27e00640 1 -- 172.21.15.5:0/2091502521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800dc50 con 0x7fcf3015c180 2024-08-18T22:29:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf36a00640 1 -- 172.21.15.5:0/2091502521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf30139910 con 0x7fcf3015c180 2024-08-18T22:29:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.250+0000 7fcf36a00640 1 -- 172.21.15.5:0/2091502521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf30136e00 con 0x7fcf3015c180 2024-08-18T22:29:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.254+0000 7fcf36a00640 1 -- 172.21.15.5:0/2091502521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf30071a10 con 0x7fcf3015c180 2024-08-18T22:29:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.254+0000 7fcf27e00640 1 -- 172.21.15.5:0/2091502521 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf2801d070 con 0x7fcf3015c180 2024-08-18T22:29:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.254+0000 7fcf27e00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf100678c0 0x7fcf10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.254+0000 7fcf27e00640 1 -- 172.21.15.5:0/2091502521 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fcf28086670 con 0x7fcf3015c180 2024-08-18T22:29:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.254+0000 7fcf2fe00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf100678c0 0x7fcf10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.254+0000 7fcf2fe00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf100678c0 0x7fcf10069d80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcf200ad000 tx=0x7fcf20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.258+0000 7fcf27e00640 1 -- 172.21.15.5:0/2091502521 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcf3014d3f0 con 0x7fcf3015c180 2024-08-18T22:29:28.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.458+0000 7fcf36a00640 1 -- 172.21.15.5:0/2091502521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcf3015b9b0 con 0x7fcf3015c180 2024-08-18T22:29:28.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.458+0000 7fcf27e00640 1 -- 172.21.15.5:0/2091502521 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v117) ==== 53+0+73 (secure 0 0 0) 0x7fcf280569f0 con 0x7fcf3015c180 2024-08-18T22:29:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:29:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 -- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf100678c0 msgr2=0x7fcf10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf100678c0 0x7fcf10069d80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcf200ad000 tx=0x7fcf20008040 comp rx=0 tx=0).stop 2024-08-18T22:29:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 -- 172.21.15.5:0/2091502521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3015c180 msgr2=0x7fcf30151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3015c180 0x7fcf30151f60 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800cef0 tx=0x7fcf2800a710 comp rx=0 tx=0).stop 2024-08-18T22:29:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 -- 172.21.15.5:0/2091502521 shutdown_connections 2024-08-18T22:29:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf100678c0 0x7fcf10069d80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3015c180 0x7fcf30151f60 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf30071580 0x7fcf301393d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 --2- 172.21.15.5:0/2091502521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3006fad0 0x7fcf3014ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:28.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 -- 172.21.15.5:0/2091502521 >> 172.21.15.5:0/2091502521 conn(0x7fcf300b3eb0 msgr2=0x7fcf300b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:28.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 -- 172.21.15.5:0/2091502521 shutdown_connections 2024-08-18T22:29:28.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28.462+0000 7fcf36a00640 1 -- 172.21.15.5:0/2091502521 wait complete. 2024-08-18T22:29:28.479 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:29:28.479 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:29:28.479 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:29:28.479 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:29:28.480 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:29:28.480 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:29:28.480 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:29:28.480 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:29:28.480 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:29:28.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:28.480 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:29:28.491 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:29:28.491 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:29:28.492 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41833sec preferred_lft 41833sec 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:29:28.493 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:29:28.494 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:29:28.494 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:29:28.494 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:29:28.494 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:29:28.494 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:29:28.494 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:29:28.494 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:29:28.494 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:29:28.494 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:29:28.494 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:29:28.494 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:29:28.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:28.496 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:29:28.564 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:29:28.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:28.566 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:29:28.624 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:29:28.624 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:29:28.624 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:29:28.624 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:29:28.624 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:29:28.624 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:29:28.625 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:29:28.625 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:28.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:29:28.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:29:28.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:29:28.625 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:29:28.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:28.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:28.768 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:29:28.777 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:29:28.777 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:29:28.778 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:29:28.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:28.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:29:28.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:29:28.842 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:29:28.893 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:29:28.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:29:28.894 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:29:28.945 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:29:28.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:28.945 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:29:29.034 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:29:29.034 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:29:29.034 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:29:29.049 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:29:29.049 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:29:29.049 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:29:29.049 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:29:29.049 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:29:29.057 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:29:29.058 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:29:29.058 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:29:29.058 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:29:29.058 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:29:29.058 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:29:29.058 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:29:29.058 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:29:29.062 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:29:29.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:29.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:29:29.083 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:29:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:29.192 INFO:teuthology.orchestra.run.smithi005.stdout:client9141 2024-08-18T22:29:29.192 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:29:29.192 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:29:29.201 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:29.201 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:29.202 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.0 2024-08-18T22:29:29.202 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:29.202 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:29.202 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:29.202 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:29.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215235 s, 48.7 MB/s 2024-08-18T22:29:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.350 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181058 s, 57.9 MB/s 2024-08-18T22:29:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168376 s, 62.3 MB/s 2024-08-18T22:29:29.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191871 s, 54.7 MB/s 2024-08-18T22:29:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01543 s, 68.0 MB/s 2024-08-18T22:29:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283198 s, 37.0 MB/s 2024-08-18T22:29:29.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.461 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019102 s, 54.9 MB/s 2024-08-18T22:29:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.477 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126833 s, 82.7 MB/s 2024-08-18T22:29:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177829 s, 59.0 MB/s 2024-08-18T22:29:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166831 s, 62.9 MB/s 2024-08-18T22:29:29.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.543 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239154 s, 43.8 MB/s 2024-08-18T22:29:29.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.564 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185871 s, 56.4 MB/s 2024-08-18T22:29:29.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.586 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190594 s, 55.0 MB/s 2024-08-18T22:29:29.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.605 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163226 s, 64.2 MB/s 2024-08-18T22:29:29.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173627 s, 60.4 MB/s 2024-08-18T22:29:29.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.652 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249453 s, 42.0 MB/s 2024-08-18T22:29:29.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.673 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179364 s, 58.5 MB/s 2024-08-18T22:29:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157382 s, 66.6 MB/s 2024-08-18T22:29:29.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.709 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158409 s, 66.2 MB/s 2024-08-18T22:29:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197505 s, 53.1 MB/s 2024-08-18T22:29:29.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212446 s, 49.4 MB/s 2024-08-18T22:29:29.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.773 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014894 s, 70.4 MB/s 2024-08-18T22:29:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01476 s, 71.0 MB/s 2024-08-18T22:29:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207063 s, 50.6 MB/s 2024-08-18T22:29:29.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.833 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164696 s, 63.7 MB/s 2024-08-18T22:29:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151353 s, 69.3 MB/s 2024-08-18T22:29:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175399 s, 59.8 MB/s 2024-08-18T22:29:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225999 s, 46.4 MB/s 2024-08-18T22:29:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141913 s, 73.9 MB/s 2024-08-18T22:29:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165084 s, 63.5 MB/s 2024-08-18T22:29:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113359 s, 92.5 MB/s 2024-08-18T22:29:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:29.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155537 s, 67.4 MB/s 2024-08-18T22:29:29.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:29.971 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:29.971 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:29.971 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.1 2024-08-18T22:29:29.971 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:29.971 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:29.971 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:29.971 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:30.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147276 s, 71.2 MB/s 2024-08-18T22:29:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.059 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165255 s, 63.5 MB/s 2024-08-18T22:29:30.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.077 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156458 s, 67.0 MB/s 2024-08-18T22:29:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01711 s, 61.3 MB/s 2024-08-18T22:29:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170061 s, 61.7 MB/s 2024-08-18T22:29:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015752 s, 66.6 MB/s 2024-08-18T22:29:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.161 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225313 s, 46.5 MB/s 2024-08-18T22:29:30.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.189 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256614 s, 40.9 MB/s 2024-08-18T22:29:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.211 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199719 s, 52.5 MB/s 2024-08-18T22:29:30.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.228 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146509 s, 71.6 MB/s 2024-08-18T22:29:30.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017523 s, 59.8 MB/s 2024-08-18T22:29:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162748 s, 64.4 MB/s 2024-08-18T22:29:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.285 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156692 s, 66.9 MB/s 2024-08-18T22:29:30.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.300 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121552 s, 86.3 MB/s 2024-08-18T22:29:30.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.318 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014687 s, 71.4 MB/s 2024-08-18T22:29:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.335 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148952 s, 70.4 MB/s 2024-08-18T22:29:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.353 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147497 s, 71.1 MB/s 2024-08-18T22:29:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.371 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016225 s, 64.6 MB/s 2024-08-18T22:29:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148151 s, 70.8 MB/s 2024-08-18T22:29:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163004 s, 64.3 MB/s 2024-08-18T22:29:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159186 s, 65.9 MB/s 2024-08-18T22:29:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147861 s, 70.9 MB/s 2024-08-18T22:29:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170853 s, 61.4 MB/s 2024-08-18T22:29:30.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160099 s, 65.5 MB/s 2024-08-18T22:29:30.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172645 s, 60.7 MB/s 2024-08-18T22:29:30.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.519 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150054 s, 69.9 MB/s 2024-08-18T22:29:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168682 s, 62.2 MB/s 2024-08-18T22:29:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169954 s, 61.7 MB/s 2024-08-18T22:29:30.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147821 s, 70.9 MB/s 2024-08-18T22:29:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143246 s, 73.2 MB/s 2024-08-18T22:29:30.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150623 s, 69.6 MB/s 2024-08-18T22:29:30.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143761 s, 72.9 MB/s 2024-08-18T22:29:30.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:30.634 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:30.634 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:30.634 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.2 2024-08-18T22:29:30.635 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:30.635 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:30.635 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:30.635 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:30.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:30.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149574 s, 70.1 MB/s 2024-08-18T22:29:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149658 s, 70.1 MB/s 2024-08-18T22:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142976 s, 73.3 MB/s 2024-08-18T22:29:30.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176953 s, 59.3 MB/s 2024-08-18T22:29:30.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149192 s, 70.3 MB/s 2024-08-18T22:29:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015876 s, 66.0 MB/s 2024-08-18T22:29:30.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.859 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017964 s, 58.4 MB/s 2024-08-18T22:29:30.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168994 s, 62.0 MB/s 2024-08-18T22:29:30.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.898 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174324 s, 60.2 MB/s 2024-08-18T22:29:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259772 s, 40.4 MB/s 2024-08-18T22:29:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148034 s, 70.8 MB/s 2024-08-18T22:29:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157486 s, 66.6 MB/s 2024-08-18T22:29:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151365 s, 69.3 MB/s 2024-08-18T22:29:31.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.000 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176764 s, 59.3 MB/s 2024-08-18T22:29:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192309 s, 54.5 MB/s 2024-08-18T22:29:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160599 s, 65.3 MB/s 2024-08-18T22:29:31.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014664 s, 71.5 MB/s 2024-08-18T22:29:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153975 s, 68.1 MB/s 2024-08-18T22:29:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162054 s, 64.7 MB/s 2024-08-18T22:29:31.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.112 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146904 s, 71.4 MB/s 2024-08-18T22:29:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152199 s, 68.9 MB/s 2024-08-18T22:29:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144879 s, 72.4 MB/s 2024-08-18T22:29:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016924 s, 62.0 MB/s 2024-08-18T22:29:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169459 s, 61.9 MB/s 2024-08-18T22:29:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147135 s, 71.3 MB/s 2024-08-18T22:29:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014583 s, 71.9 MB/s 2024-08-18T22:29:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125633 s, 83.5 MB/s 2024-08-18T22:29:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172992 s, 60.6 MB/s 2024-08-18T22:29:31.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.276 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172921 s, 60.6 MB/s 2024-08-18T22:29:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195373 s, 53.7 MB/s 2024-08-18T22:29:31.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147045 s, 71.3 MB/s 2024-08-18T22:29:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150376 s, 69.7 MB/s 2024-08-18T22:29:31.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:31.340 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:31.340 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:31.341 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.3 2024-08-18T22:29:31.341 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:31.341 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:31.341 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:31.341 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:31.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:31.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153793 s, 68.2 MB/s 2024-08-18T22:29:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147384 s, 71.1 MB/s 2024-08-18T22:29:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.448 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169282 s, 61.9 MB/s 2024-08-18T22:29:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014924 s, 70.3 MB/s 2024-08-18T22:29:31.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.485 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017186 s, 61.0 MB/s 2024-08-18T22:29:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.508 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213438 s, 49.1 MB/s 2024-08-18T22:29:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.529 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183048 s, 57.3 MB/s 2024-08-18T22:29:31.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150898 s, 69.5 MB/s 2024-08-18T22:29:31.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.565 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150399 s, 69.7 MB/s 2024-08-18T22:29:31.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.585 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.585 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172756 s, 60.7 MB/s 2024-08-18T22:29:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.604 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172491 s, 60.8 MB/s 2024-08-18T22:29:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198805 s, 52.7 MB/s 2024-08-18T22:29:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.652 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021859 s, 48.0 MB/s 2024-08-18T22:29:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.669 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144064 s, 72.8 MB/s 2024-08-18T22:29:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180851 s, 58.0 MB/s 2024-08-18T22:29:31.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.713 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02028 s, 51.7 MB/s 2024-08-18T22:29:31.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147507 s, 71.1 MB/s 2024-08-18T22:29:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202827 s, 51.7 MB/s 2024-08-18T22:29:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155316 s, 67.5 MB/s 2024-08-18T22:29:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155778 s, 67.3 MB/s 2024-08-18T22:29:31.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.807 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148349 s, 70.7 MB/s 2024-08-18T22:29:31.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169826 s, 61.7 MB/s 2024-08-18T22:29:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155786 s, 67.3 MB/s 2024-08-18T22:29:31.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155623 s, 67.4 MB/s 2024-08-18T22:29:31.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146692 s, 71.5 MB/s 2024-08-18T22:29:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014466 s, 72.5 MB/s 2024-08-18T22:29:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.916 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172296 s, 60.9 MB/s 2024-08-18T22:29:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.934 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145798 s, 71.9 MB/s 2024-08-18T22:29:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170289 s, 61.6 MB/s 2024-08-18T22:29:31.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209914 s, 50.0 MB/s 2024-08-18T22:29:31.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:31.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:31.996 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168268 s, 62.3 MB/s 2024-08-18T22:29:32.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147254 s, 71.2 MB/s 2024-08-18T22:29:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:32.021 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:32.021 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:32.021 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.4 2024-08-18T22:29:32.021 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:32.021 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:32.021 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:32.021 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:32.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.091 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153498 s, 68.3 MB/s 2024-08-18T22:29:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196837 s, 53.3 MB/s 2024-08-18T22:29:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174694 s, 60.0 MB/s 2024-08-18T22:29:32.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.150 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142587 s, 73.5 MB/s 2024-08-18T22:29:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166001 s, 63.2 MB/s 2024-08-18T22:29:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.186 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146128 s, 71.8 MB/s 2024-08-18T22:29:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162176 s, 64.7 MB/s 2024-08-18T22:29:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.229 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208324 s, 50.3 MB/s 2024-08-18T22:29:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175841 s, 59.6 MB/s 2024-08-18T22:29:32.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169362 s, 61.9 MB/s 2024-08-18T22:29:32.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.292 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207899 s, 50.4 MB/s 2024-08-18T22:29:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165565 s, 63.3 MB/s 2024-08-18T22:29:32.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.329 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151422 s, 69.2 MB/s 2024-08-18T22:29:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.346 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147712 s, 71.0 MB/s 2024-08-18T22:29:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145408 s, 72.1 MB/s 2024-08-18T22:29:32.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219259 s, 47.8 MB/s 2024-08-18T22:29:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149786 s, 70.0 MB/s 2024-08-18T22:29:32.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019965 s, 52.5 MB/s 2024-08-18T22:29:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197163 s, 53.2 MB/s 2024-08-18T22:29:32.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186246 s, 56.3 MB/s 2024-08-18T22:29:32.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147934 s, 70.9 MB/s 2024-08-18T22:29:32.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177783 s, 59.0 MB/s 2024-08-18T22:29:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152213 s, 68.9 MB/s 2024-08-18T22:29:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154388 s, 67.9 MB/s 2024-08-18T22:29:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147494 s, 71.1 MB/s 2024-08-18T22:29:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152676 s, 68.7 MB/s 2024-08-18T22:29:32.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.598 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155083 s, 67.6 MB/s 2024-08-18T22:29:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152527 s, 68.7 MB/s 2024-08-18T22:29:32.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.634 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149398 s, 70.2 MB/s 2024-08-18T22:29:32.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.650 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144339 s, 72.6 MB/s 2024-08-18T22:29:32.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150284 s, 69.8 MB/s 2024-08-18T22:29:32.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174721 s, 60.0 MB/s 2024-08-18T22:29:32.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:32.696 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:32.696 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:32.696 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.5 2024-08-18T22:29:32.696 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:32.696 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:32.696 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:32.696 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165095 s, 63.5 MB/s 2024-08-18T22:29:32.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144184 s, 72.7 MB/s 2024-08-18T22:29:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196354 s, 53.4 MB/s 2024-08-18T22:29:32.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.833 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244254 s, 42.9 MB/s 2024-08-18T22:29:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.853 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170704 s, 61.4 MB/s 2024-08-18T22:29:32.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015695 s, 66.8 MB/s 2024-08-18T22:29:32.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246576 s, 42.5 MB/s 2024-08-18T22:29:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153698 s, 68.2 MB/s 2024-08-18T22:29:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148891 s, 70.4 MB/s 2024-08-18T22:29:32.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.957 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205523 s, 51.0 MB/s 2024-08-18T22:29:32.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176207 s, 59.5 MB/s 2024-08-18T22:29:32.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:32.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:32.996 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163083 s, 64.3 MB/s 2024-08-18T22:29:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147324 s, 71.2 MB/s 2024-08-18T22:29:33.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232744 s, 45.1 MB/s 2024-08-18T22:29:33.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143627 s, 73.0 MB/s 2024-08-18T22:29:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193092 s, 54.3 MB/s 2024-08-18T22:29:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.107 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257629 s, 40.7 MB/s 2024-08-18T22:29:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01735 s, 60.4 MB/s 2024-08-18T22:29:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.147 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176083 s, 59.6 MB/s 2024-08-18T22:29:33.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.165 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149095 s, 70.3 MB/s 2024-08-18T22:29:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145736 s, 72.0 MB/s 2024-08-18T22:29:33.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145919 s, 71.9 MB/s 2024-08-18T22:29:33.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234658 s, 44.7 MB/s 2024-08-18T22:29:33.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.243 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151009 s, 69.4 MB/s 2024-08-18T22:29:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261551 s, 40.1 MB/s 2024-08-18T22:29:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170498 s, 61.5 MB/s 2024-08-18T22:29:33.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.309 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147382 s, 71.1 MB/s 2024-08-18T22:29:33.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167204 s, 62.7 MB/s 2024-08-18T22:29:33.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.351 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203208 s, 51.6 MB/s 2024-08-18T22:29:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167444 s, 62.6 MB/s 2024-08-18T22:29:33.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143931 s, 72.9 MB/s 2024-08-18T22:29:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245022 s, 42.8 MB/s 2024-08-18T22:29:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:33.422 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:33.422 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:33.422 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.6 2024-08-18T22:29:33.422 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:33.422 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:33.422 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:33.422 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169814 s, 61.7 MB/s 2024-08-18T22:29:33.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155424 s, 67.5 MB/s 2024-08-18T22:29:33.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.574 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165542 s, 63.3 MB/s 2024-08-18T22:29:33.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.591 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150845 s, 69.5 MB/s 2024-08-18T22:29:33.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166115 s, 63.1 MB/s 2024-08-18T22:29:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151165 s, 69.4 MB/s 2024-08-18T22:29:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148436 s, 70.6 MB/s 2024-08-18T22:29:33.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143397 s, 73.1 MB/s 2024-08-18T22:29:33.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152699 s, 68.7 MB/s 2024-08-18T22:29:33.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232907 s, 45.0 MB/s 2024-08-18T22:29:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.724 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015105 s, 69.4 MB/s 2024-08-18T22:29:33.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160269 s, 65.4 MB/s 2024-08-18T22:29:33.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164147 s, 63.9 MB/s 2024-08-18T22:29:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151724 s, 69.1 MB/s 2024-08-18T22:29:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153855 s, 68.2 MB/s 2024-08-18T22:29:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144699 s, 72.5 MB/s 2024-08-18T22:29:33.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171189 s, 61.3 MB/s 2024-08-18T22:29:33.857 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208022 s, 50.4 MB/s 2024-08-18T22:29:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187748 s, 55.9 MB/s 2024-08-18T22:29:33.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234792 s, 44.7 MB/s 2024-08-18T22:29:33.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.923 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155012 s, 67.6 MB/s 2024-08-18T22:29:33.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195453 s, 53.6 MB/s 2024-08-18T22:29:33.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.969 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210926 s, 49.7 MB/s 2024-08-18T22:29:33.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:33.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:33.987 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147626 s, 71.0 MB/s 2024-08-18T22:29:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.011 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213163 s, 49.2 MB/s 2024-08-18T22:29:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148454 s, 70.6 MB/s 2024-08-18T22:29:34.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.049 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172434 s, 60.8 MB/s 2024-08-18T22:29:34.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.065 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142451 s, 73.6 MB/s 2024-08-18T22:29:34.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146958 s, 71.4 MB/s 2024-08-18T22:29:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158741 s, 66.1 MB/s 2024-08-18T22:29:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155958 s, 67.2 MB/s 2024-08-18T22:29:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170847 s, 61.4 MB/s 2024-08-18T22:29:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:34.146 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:34.146 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:34.146 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.7 2024-08-18T22:29:34.146 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:34.146 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:34.146 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:34.146 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:34.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125075 s, 83.8 MB/s 2024-08-18T22:29:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.231 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01446 s, 72.5 MB/s 2024-08-18T22:29:34.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016278 s, 64.4 MB/s 2024-08-18T22:29:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147081 s, 71.3 MB/s 2024-08-18T22:29:34.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.285 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147871 s, 70.9 MB/s 2024-08-18T22:29:34.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.304 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170587 s, 61.5 MB/s 2024-08-18T22:29:34.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240944 s, 43.5 MB/s 2024-08-18T22:29:34.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.353 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019426 s, 54.0 MB/s 2024-08-18T22:29:34.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.371 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145821 s, 71.9 MB/s 2024-08-18T22:29:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213185 s, 49.2 MB/s 2024-08-18T22:29:34.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.412 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145691 s, 72.0 MB/s 2024-08-18T22:29:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177561 s, 59.1 MB/s 2024-08-18T22:29:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168512 s, 62.2 MB/s 2024-08-18T22:29:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206526 s, 50.8 MB/s 2024-08-18T22:29:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.494 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155051 s, 67.6 MB/s 2024-08-18T22:29:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.510 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.511 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147635 s, 71.0 MB/s 2024-08-18T22:29:34.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.528 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149181 s, 70.3 MB/s 2024-08-18T22:29:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149219 s, 70.3 MB/s 2024-08-18T22:29:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155437 s, 67.5 MB/s 2024-08-18T22:29:34.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144142 s, 72.7 MB/s 2024-08-18T22:29:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170159 s, 61.6 MB/s 2024-08-18T22:29:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190503 s, 55.0 MB/s 2024-08-18T22:29:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207232 s, 50.6 MB/s 2024-08-18T22:29:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154551 s, 67.8 MB/s 2024-08-18T22:29:34.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175444 s, 59.8 MB/s 2024-08-18T22:29:34.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154623 s, 67.8 MB/s 2024-08-18T22:29:34.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143157 s, 73.2 MB/s 2024-08-18T22:29:34.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.736 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015083 s, 69.5 MB/s 2024-08-18T22:29:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147899 s, 70.9 MB/s 2024-08-18T22:29:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.773 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171506 s, 61.1 MB/s 2024-08-18T22:29:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.791 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144404 s, 72.6 MB/s 2024-08-18T22:29:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163622 s, 64.1 MB/s 2024-08-18T22:29:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:34.817 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:34.817 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:34.817 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.8 2024-08-18T22:29:34.817 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:34.817 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:34.817 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:34.817 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:34.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146816 s, 71.4 MB/s 2024-08-18T22:29:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244129 s, 43.0 MB/s 2024-08-18T22:29:34.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.933 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168895 s, 62.1 MB/s 2024-08-18T22:29:34.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.950 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151487 s, 69.2 MB/s 2024-08-18T22:29:34.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.969 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165631 s, 63.3 MB/s 2024-08-18T22:29:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173576 s, 60.4 MB/s 2024-08-18T22:29:35.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143716 s, 73.0 MB/s 2024-08-18T22:29:35.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.025 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162999 s, 64.3 MB/s 2024-08-18T22:29:35.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242086 s, 43.3 MB/s 2024-08-18T22:29:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166463 s, 63.0 MB/s 2024-08-18T22:29:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205361 s, 51.1 MB/s 2024-08-18T22:29:35.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.115 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180588 s, 58.1 MB/s 2024-08-18T22:29:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170928 s, 61.3 MB/s 2024-08-18T22:29:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147541 s, 71.1 MB/s 2024-08-18T22:29:35.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.170 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157137 s, 66.7 MB/s 2024-08-18T22:29:35.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168152 s, 62.4 MB/s 2024-08-18T22:29:35.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.207 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149144 s, 70.3 MB/s 2024-08-18T22:29:35.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020526 s, 51.1 MB/s 2024-08-18T22:29:35.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159976 s, 65.5 MB/s 2024-08-18T22:29:35.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.266 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145847 s, 71.9 MB/s 2024-08-18T22:29:35.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198812 s, 52.7 MB/s 2024-08-18T22:29:35.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.306 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150172 s, 69.8 MB/s 2024-08-18T22:29:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.323 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147614 s, 71.0 MB/s 2024-08-18T22:29:35.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.342 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163948 s, 64.0 MB/s 2024-08-18T22:29:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144682 s, 72.5 MB/s 2024-08-18T22:29:35.376 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.377 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147434 s, 71.1 MB/s 2024-08-18T22:29:35.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.396 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170942 s, 61.3 MB/s 2024-08-18T22:29:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206793 s, 50.7 MB/s 2024-08-18T22:29:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174575 s, 60.1 MB/s 2024-08-18T22:29:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154355 s, 67.9 MB/s 2024-08-18T22:29:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152523 s, 68.7 MB/s 2024-08-18T22:29:35.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.494 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157291 s, 66.7 MB/s 2024-08-18T22:29:35.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:35.501 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:35.501 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:35.502 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.9 2024-08-18T22:29:35.502 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:35.502 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:35.502 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:35.502 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181229 s, 57.9 MB/s 2024-08-18T22:29:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.594 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173546 s, 60.4 MB/s 2024-08-18T22:29:35.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171605 s, 61.1 MB/s 2024-08-18T22:29:35.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.636 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196 s, 53.5 MB/s 2024-08-18T22:29:35.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.654 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014678 s, 71.4 MB/s 2024-08-18T22:29:35.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.673 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162863 s, 64.4 MB/s 2024-08-18T22:29:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167942 s, 62.4 MB/s 2024-08-18T22:29:35.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.711 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.711 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166859 s, 62.8 MB/s 2024-08-18T22:29:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144667 s, 72.5 MB/s 2024-08-18T22:29:35.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163804 s, 64.0 MB/s 2024-08-18T22:29:35.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149311 s, 70.2 MB/s 2024-08-18T22:29:35.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.791 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245043 s, 42.8 MB/s 2024-08-18T22:29:35.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163571 s, 64.1 MB/s 2024-08-18T22:29:35.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016827 s, 62.3 MB/s 2024-08-18T22:29:35.843 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112916 s, 92.9 MB/s 2024-08-18T22:29:35.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154269 s, 68.0 MB/s 2024-08-18T22:29:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159356 s, 65.8 MB/s 2024-08-18T22:29:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208367 s, 50.3 MB/s 2024-08-18T22:29:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170378 s, 61.5 MB/s 2024-08-18T22:29:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149331 s, 70.2 MB/s 2024-08-18T22:29:35.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014975 s, 70.0 MB/s 2024-08-18T22:29:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204236 s, 51.3 MB/s 2024-08-18T22:29:35.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:35.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:35.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148135 s, 70.8 MB/s 2024-08-18T22:29:36.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.016 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144739 s, 72.4 MB/s 2024-08-18T22:29:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150864 s, 69.5 MB/s 2024-08-18T22:29:36.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205373 s, 51.1 MB/s 2024-08-18T22:29:36.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169212 s, 62.0 MB/s 2024-08-18T22:29:36.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149817 s, 70.0 MB/s 2024-08-18T22:29:36.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211603 s, 49.6 MB/s 2024-08-18T22:29:36.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.137 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169673 s, 61.8 MB/s 2024-08-18T22:29:36.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.154 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143637 s, 73.0 MB/s 2024-08-18T22:29:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017523 s, 59.8 MB/s 2024-08-18T22:29:36.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:36.182 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:36.182 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:36.182 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.10 2024-08-18T22:29:36.182 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:36.182 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:36.182 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:36.182 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:36.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:36.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149471 s, 70.2 MB/s 2024-08-18T22:29:36.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.321 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151954 s, 69.0 MB/s 2024-08-18T22:29:36.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.338 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147764 s, 71.0 MB/s 2024-08-18T22:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170127 s, 61.6 MB/s 2024-08-18T22:29:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014741 s, 71.1 MB/s 2024-08-18T22:29:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146555 s, 71.5 MB/s 2024-08-18T22:29:36.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.413 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179361 s, 58.5 MB/s 2024-08-18T22:29:36.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204392 s, 51.3 MB/s 2024-08-18T22:29:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195674 s, 53.6 MB/s 2024-08-18T22:29:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.477 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157741 s, 66.5 MB/s 2024-08-18T22:29:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144592 s, 72.5 MB/s 2024-08-18T22:29:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183116 s, 57.3 MB/s 2024-08-18T22:29:36.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182671 s, 57.4 MB/s 2024-08-18T22:29:36.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.553 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151906 s, 69.0 MB/s 2024-08-18T22:29:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146362 s, 71.6 MB/s 2024-08-18T22:29:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247486 s, 42.4 MB/s 2024-08-18T22:29:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.616 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161868 s, 64.8 MB/s 2024-08-18T22:29:36.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145675 s, 72.0 MB/s 2024-08-18T22:29:36.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.652 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162297 s, 64.6 MB/s 2024-08-18T22:29:36.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.675 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197359 s, 53.1 MB/s 2024-08-18T22:29:36.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208898 s, 50.2 MB/s 2024-08-18T22:29:36.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160621 s, 65.3 MB/s 2024-08-18T22:29:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163503 s, 64.1 MB/s 2024-08-18T22:29:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144231 s, 72.7 MB/s 2024-08-18T22:29:36.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.771 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016532 s, 63.4 MB/s 2024-08-18T22:29:36.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.796 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220964 s, 47.5 MB/s 2024-08-18T22:29:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173959 s, 60.3 MB/s 2024-08-18T22:29:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.836 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017116 s, 61.3 MB/s 2024-08-18T22:29:36.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.853 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144446 s, 72.6 MB/s 2024-08-18T22:29:36.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161442 s, 65.0 MB/s 2024-08-18T22:29:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210766 s, 49.8 MB/s 2024-08-18T22:29:36.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172139 s, 60.9 MB/s 2024-08-18T22:29:36.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:36.922 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:36.922 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:36.922 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.11 2024-08-18T22:29:36.922 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:36.922 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:36.922 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:36.922 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:36.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:36.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:36.992 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150937 s, 69.5 MB/s 2024-08-18T22:29:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.009 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147799 s, 70.9 MB/s 2024-08-18T22:29:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145986 s, 71.8 MB/s 2024-08-18T22:29:37.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.046 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172254 s, 60.9 MB/s 2024-08-18T22:29:37.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169151 s, 62.0 MB/s 2024-08-18T22:29:37.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.084 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157744 s, 66.5 MB/s 2024-08-18T22:29:37.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147265 s, 71.2 MB/s 2024-08-18T22:29:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249347 s, 42.1 MB/s 2024-08-18T22:29:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172324 s, 60.8 MB/s 2024-08-18T22:29:37.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173815 s, 60.3 MB/s 2024-08-18T22:29:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.194 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022911 s, 45.8 MB/s 2024-08-18T22:29:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144669 s, 72.5 MB/s 2024-08-18T22:29:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.231 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173393 s, 60.5 MB/s 2024-08-18T22:29:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149801 s, 70.0 MB/s 2024-08-18T22:29:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168075 s, 62.4 MB/s 2024-08-18T22:29:37.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168149 s, 62.4 MB/s 2024-08-18T22:29:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168259 s, 62.3 MB/s 2024-08-18T22:29:37.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150503 s, 69.7 MB/s 2024-08-18T22:29:37.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.342 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143256 s, 73.2 MB/s 2024-08-18T22:29:37.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163497 s, 64.1 MB/s 2024-08-18T22:29:37.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149663 s, 70.1 MB/s 2024-08-18T22:29:37.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.396 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.396 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153863 s, 68.2 MB/s 2024-08-18T22:29:37.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151137 s, 69.4 MB/s 2024-08-18T22:29:37.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.432 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151609 s, 69.2 MB/s 2024-08-18T22:29:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144198 s, 72.7 MB/s 2024-08-18T22:29:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158171 s, 66.3 MB/s 2024-08-18T22:29:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170297 s, 61.6 MB/s 2024-08-18T22:29:37.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164407 s, 63.8 MB/s 2024-08-18T22:29:37.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.524 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153072 s, 68.5 MB/s 2024-08-18T22:29:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114746 s, 91.4 MB/s 2024-08-18T22:29:37.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.556 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01634 s, 64.2 MB/s 2024-08-18T22:29:37.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159161 s, 65.9 MB/s 2024-08-18T22:29:37.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:37.582 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:37.582 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:37.582 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.12 2024-08-18T22:29:37.582 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:37.582 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:37.582 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:37.583 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177567 s, 59.1 MB/s 2024-08-18T22:29:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149127 s, 70.3 MB/s 2024-08-18T22:29:37.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.690 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159275 s, 65.8 MB/s 2024-08-18T22:29:37.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.708 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014994 s, 69.9 MB/s 2024-08-18T22:29:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164227 s, 63.8 MB/s 2024-08-18T22:29:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177248 s, 59.2 MB/s 2024-08-18T22:29:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149669 s, 70.1 MB/s 2024-08-18T22:29:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144768 s, 72.4 MB/s 2024-08-18T22:29:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.801 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172393 s, 60.8 MB/s 2024-08-18T22:29:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226121 s, 46.4 MB/s 2024-08-18T22:29:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155147 s, 67.6 MB/s 2024-08-18T22:29:37.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147252 s, 71.2 MB/s 2024-08-18T22:29:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.882 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172239 s, 60.9 MB/s 2024-08-18T22:29:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209225 s, 50.1 MB/s 2024-08-18T22:29:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153875 s, 68.1 MB/s 2024-08-18T22:29:37.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.943 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175656 s, 59.7 MB/s 2024-08-18T22:29:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152055 s, 69.0 MB/s 2024-08-18T22:29:37.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.980 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168615 s, 62.2 MB/s 2024-08-18T22:29:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:37.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166327 s, 63.0 MB/s 2024-08-18T22:29:38.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216337 s, 48.5 MB/s 2024-08-18T22:29:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151393 s, 69.3 MB/s 2024-08-18T22:29:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143561 s, 73.0 MB/s 2024-08-18T22:29:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165068 s, 63.5 MB/s 2024-08-18T22:29:38.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179353 s, 58.5 MB/s 2024-08-18T22:29:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169476 s, 61.9 MB/s 2024-08-18T22:29:38.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.136 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162301 s, 64.6 MB/s 2024-08-18T22:29:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190792 s, 55.0 MB/s 2024-08-18T22:29:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219362 s, 47.8 MB/s 2024-08-18T22:29:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149511 s, 70.1 MB/s 2024-08-18T22:29:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144589 s, 72.5 MB/s 2024-08-18T22:29:38.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015522 s, 67.6 MB/s 2024-08-18T22:29:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194906 s, 53.8 MB/s 2024-08-18T22:29:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:38.265 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:38.265 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:38.265 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.13 2024-08-18T22:29:38.265 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:38.265 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:38.265 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:38.265 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:38.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159578 s, 65.7 MB/s 2024-08-18T22:29:38.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.362 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243161 s, 43.1 MB/s 2024-08-18T22:29:38.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159761 s, 65.6 MB/s 2024-08-18T22:29:38.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208926 s, 50.2 MB/s 2024-08-18T22:29:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155199 s, 67.6 MB/s 2024-08-18T22:29:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150293 s, 69.8 MB/s 2024-08-18T22:29:38.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.457 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148076 s, 70.8 MB/s 2024-08-18T22:29:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.477 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171996 s, 61.0 MB/s 2024-08-18T22:29:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.496 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016849 s, 62.2 MB/s 2024-08-18T22:29:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.524 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254031 s, 41.3 MB/s 2024-08-18T22:29:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015482 s, 67.7 MB/s 2024-08-18T22:29:38.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.559 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143258 s, 73.2 MB/s 2024-08-18T22:29:38.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.577 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153995 s, 68.1 MB/s 2024-08-18T22:29:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176209 s, 59.5 MB/s 2024-08-18T22:29:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017522 s, 59.8 MB/s 2024-08-18T22:29:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206934 s, 50.7 MB/s 2024-08-18T22:29:38.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.660 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168596 s, 62.2 MB/s 2024-08-18T22:29:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171203 s, 61.2 MB/s 2024-08-18T22:29:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153447 s, 68.3 MB/s 2024-08-18T22:29:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163206 s, 64.2 MB/s 2024-08-18T22:29:38.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.736 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148184 s, 70.8 MB/s 2024-08-18T22:29:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.753 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148247 s, 70.7 MB/s 2024-08-18T22:29:38.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014479 s, 72.4 MB/s 2024-08-18T22:29:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150027 s, 69.9 MB/s 2024-08-18T22:29:38.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213201 s, 49.2 MB/s 2024-08-18T22:29:38.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017207 s, 60.9 MB/s 2024-08-18T22:29:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147054 s, 71.3 MB/s 2024-08-18T22:29:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163727 s, 64.0 MB/s 2024-08-18T22:29:38.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.891 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216921 s, 48.3 MB/s 2024-08-18T22:29:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146646 s, 71.5 MB/s 2024-08-18T22:29:38.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200759 s, 52.2 MB/s 2024-08-18T22:29:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020725 s, 50.6 MB/s 2024-08-18T22:29:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:38.961 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:38.961 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:38.961 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.14 2024-08-18T22:29:38.961 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:38.961 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:38.961 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:38.961 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:39.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199324 s, 52.6 MB/s 2024-08-18T22:29:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122034 s, 85.9 MB/s 2024-08-18T22:29:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.070 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162688 s, 64.5 MB/s 2024-08-18T22:29:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246538 s, 42.5 MB/s 2024-08-18T22:29:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148499 s, 70.6 MB/s 2024-08-18T22:29:39.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160888 s, 65.2 MB/s 2024-08-18T22:29:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145238 s, 72.2 MB/s 2024-08-18T22:29:39.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.167 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146103 s, 71.8 MB/s 2024-08-18T22:29:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.185 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151938 s, 69.0 MB/s 2024-08-18T22:29:39.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.202 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147406 s, 71.1 MB/s 2024-08-18T22:29:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151503 s, 69.2 MB/s 2024-08-18T22:29:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146443 s, 71.6 MB/s 2024-08-18T22:29:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162721 s, 64.4 MB/s 2024-08-18T22:29:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202899 s, 51.7 MB/s 2024-08-18T22:29:39.297 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.297 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.297 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155472 s, 67.4 MB/s 2024-08-18T22:29:39.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.317 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171124 s, 61.3 MB/s 2024-08-18T22:29:39.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.335 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152307 s, 68.8 MB/s 2024-08-18T22:29:39.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.353 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149237 s, 70.3 MB/s 2024-08-18T22:29:39.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167342 s, 62.7 MB/s 2024-08-18T22:29:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.392 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016734 s, 62.7 MB/s 2024-08-18T22:29:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151709 s, 69.1 MB/s 2024-08-18T22:29:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164965 s, 63.6 MB/s 2024-08-18T22:29:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.446 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149248 s, 70.3 MB/s 2024-08-18T22:29:39.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.472 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024084 s, 43.5 MB/s 2024-08-18T22:29:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147721 s, 71.0 MB/s 2024-08-18T22:29:39.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113857 s, 92.1 MB/s 2024-08-18T22:29:39.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.521 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148117 s, 70.8 MB/s 2024-08-18T22:29:39.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.541 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173791 s, 60.3 MB/s 2024-08-18T22:29:39.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.565 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211434 s, 49.6 MB/s 2024-08-18T22:29:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169068 s, 62.0 MB/s 2024-08-18T22:29:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151159 s, 69.4 MB/s 2024-08-18T22:29:39.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.620 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146824 s, 71.4 MB/s 2024-08-18T22:29:39.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:39.627 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:39.627 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:39.627 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.15 2024-08-18T22:29:39.627 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:39.627 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:39.627 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:39.627 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:39.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149417 s, 70.2 MB/s 2024-08-18T22:29:39.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.714 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153497 s, 68.3 MB/s 2024-08-18T22:29:39.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.735 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176423 s, 59.4 MB/s 2024-08-18T22:29:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191675 s, 54.7 MB/s 2024-08-18T22:29:39.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.775 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161012 s, 65.1 MB/s 2024-08-18T22:29:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148664 s, 70.5 MB/s 2024-08-18T22:29:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157129 s, 66.7 MB/s 2024-08-18T22:29:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182619 s, 57.4 MB/s 2024-08-18T22:29:39.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.852 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172344 s, 60.8 MB/s 2024-08-18T22:29:39.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165399 s, 63.4 MB/s 2024-08-18T22:29:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150075 s, 69.9 MB/s 2024-08-18T22:29:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145109 s, 72.3 MB/s 2024-08-18T22:29:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.923 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149002 s, 70.4 MB/s 2024-08-18T22:29:39.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.942 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172074 s, 60.9 MB/s 2024-08-18T22:29:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.957 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122931 s, 85.3 MB/s 2024-08-18T22:29:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196578 s, 53.3 MB/s 2024-08-18T22:29:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173798 s, 60.3 MB/s 2024-08-18T22:29:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153188 s, 68.5 MB/s 2024-08-18T22:29:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145885 s, 71.9 MB/s 2024-08-18T22:29:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015141 s, 69.3 MB/s 2024-08-18T22:29:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214078 s, 49.0 MB/s 2024-08-18T22:29:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150763 s, 69.6 MB/s 2024-08-18T22:29:40.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145916 s, 71.9 MB/s 2024-08-18T22:29:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189283 s, 55.4 MB/s 2024-08-18T22:29:40.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.150 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144486 s, 72.6 MB/s 2024-08-18T22:29:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177463 s, 59.1 MB/s 2024-08-18T22:29:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145325 s, 72.2 MB/s 2024-08-18T22:29:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179227 s, 58.5 MB/s 2024-08-18T22:29:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217081 s, 48.3 MB/s 2024-08-18T22:29:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142674 s, 73.5 MB/s 2024-08-18T22:29:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148329 s, 70.7 MB/s 2024-08-18T22:29:40.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016453 s, 63.7 MB/s 2024-08-18T22:29:40.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:40.295 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:40.295 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:40.295 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.16 2024-08-18T22:29:40.295 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:40.295 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:40.295 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:40.295 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:40.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:40.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.366 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162543 s, 64.5 MB/s 2024-08-18T22:29:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178011 s, 58.9 MB/s 2024-08-18T22:29:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147059 s, 71.3 MB/s 2024-08-18T22:29:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148267 s, 70.7 MB/s 2024-08-18T22:29:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157778 s, 66.5 MB/s 2024-08-18T22:29:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174065 s, 60.2 MB/s 2024-08-18T22:29:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147733 s, 71.0 MB/s 2024-08-18T22:29:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159643 s, 65.7 MB/s 2024-08-18T22:29:40.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.521 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187479 s, 55.9 MB/s 2024-08-18T22:29:40.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.539 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149911 s, 69.9 MB/s 2024-08-18T22:29:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017799 s, 58.9 MB/s 2024-08-18T22:29:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180656 s, 58.0 MB/s 2024-08-18T22:29:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173758 s, 60.3 MB/s 2024-08-18T22:29:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149594 s, 70.1 MB/s 2024-08-18T22:29:40.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.638 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015215 s, 68.9 MB/s 2024-08-18T22:29:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195184 s, 53.7 MB/s 2024-08-18T22:29:40.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.681 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172844 s, 60.7 MB/s 2024-08-18T22:29:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195808 s, 53.6 MB/s 2024-08-18T22:29:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154686 s, 67.8 MB/s 2024-08-18T22:29:40.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147498 s, 71.1 MB/s 2024-08-18T22:29:40.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169567 s, 61.8 MB/s 2024-08-18T22:29:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185293 s, 56.6 MB/s 2024-08-18T22:29:40.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.804 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205226 s, 51.1 MB/s 2024-08-18T22:29:40.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148771 s, 70.5 MB/s 2024-08-18T22:29:40.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148041 s, 70.8 MB/s 2024-08-18T22:29:40.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148402 s, 70.7 MB/s 2024-08-18T22:29:40.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.877 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153584 s, 68.3 MB/s 2024-08-18T22:29:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173833 s, 60.3 MB/s 2024-08-18T22:29:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151187 s, 69.4 MB/s 2024-08-18T22:29:40.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.933 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142929 s, 73.4 MB/s 2024-08-18T22:29:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016075 s, 65.2 MB/s 2024-08-18T22:29:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015752 s, 66.6 MB/s 2024-08-18T22:29:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:40.978 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:40.978 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:40.979 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.17 2024-08-18T22:29:40.979 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:40.979 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:40.979 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:40.979 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:41.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149763 s, 70.0 MB/s 2024-08-18T22:29:41.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.072 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194125 s, 54.0 MB/s 2024-08-18T22:29:41.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165016 s, 63.5 MB/s 2024-08-18T22:29:41.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192211 s, 54.6 MB/s 2024-08-18T22:29:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183051 s, 57.3 MB/s 2024-08-18T22:29:41.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.156 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179244 s, 58.5 MB/s 2024-08-18T22:29:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158429 s, 66.2 MB/s 2024-08-18T22:29:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173186 s, 60.5 MB/s 2024-08-18T22:29:41.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.212 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153127 s, 68.5 MB/s 2024-08-18T22:29:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177066 s, 59.2 MB/s 2024-08-18T22:29:41.251 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.252 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016047 s, 65.3 MB/s 2024-08-18T22:29:41.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307372 s, 34.1 MB/s 2024-08-18T22:29:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149674 s, 70.1 MB/s 2024-08-18T22:29:41.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.322 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156199 s, 67.1 MB/s 2024-08-18T22:29:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012053 s, 87.0 MB/s 2024-08-18T22:29:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156716 s, 66.9 MB/s 2024-08-18T22:29:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01515 s, 69.2 MB/s 2024-08-18T22:29:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150199 s, 69.8 MB/s 2024-08-18T22:29:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145412 s, 72.1 MB/s 2024-08-18T22:29:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146968 s, 71.3 MB/s 2024-08-18T22:29:41.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.448 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212142 s, 49.4 MB/s 2024-08-18T22:29:41.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148111 s, 70.8 MB/s 2024-08-18T22:29:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.483 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151817 s, 69.1 MB/s 2024-08-18T22:29:41.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.507 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209166 s, 50.1 MB/s 2024-08-18T22:29:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204729 s, 51.2 MB/s 2024-08-18T22:29:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153232 s, 68.4 MB/s 2024-08-18T22:29:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152409 s, 68.8 MB/s 2024-08-18T22:29:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154762 s, 67.8 MB/s 2024-08-18T22:29:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154743 s, 67.8 MB/s 2024-08-18T22:29:41.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144956 s, 72.3 MB/s 2024-08-18T22:29:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.637 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148504 s, 70.6 MB/s 2024-08-18T22:29:41.656 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.657 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174338 s, 60.1 MB/s 2024-08-18T22:29:41.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:41.664 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:41.664 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:41.664 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.18 2024-08-18T22:29:41.664 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:41.664 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:41.664 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:41.664 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171066 s, 61.3 MB/s 2024-08-18T22:29:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162642 s, 64.5 MB/s 2024-08-18T22:29:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197045 s, 53.2 MB/s 2024-08-18T22:29:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148326 s, 70.7 MB/s 2024-08-18T22:29:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145115 s, 72.3 MB/s 2024-08-18T22:29:41.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146183 s, 71.7 MB/s 2024-08-18T22:29:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184291 s, 56.9 MB/s 2024-08-18T22:29:41.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145843 s, 71.9 MB/s 2024-08-18T22:29:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200612 s, 52.3 MB/s 2024-08-18T22:29:41.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01816 s, 57.7 MB/s 2024-08-18T22:29:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.928 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150603 s, 69.6 MB/s 2024-08-18T22:29:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145127 s, 72.3 MB/s 2024-08-18T22:29:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151571 s, 69.2 MB/s 2024-08-18T22:29:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:41.986 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205246 s, 51.1 MB/s 2024-08-18T22:29:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143453 s, 73.1 MB/s 2024-08-18T22:29:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153921 s, 68.1 MB/s 2024-08-18T22:29:42.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163177 s, 64.3 MB/s 2024-08-18T22:29:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218739 s, 47.9 MB/s 2024-08-18T22:29:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144699 s, 72.5 MB/s 2024-08-18T22:29:42.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159425 s, 65.8 MB/s 2024-08-18T22:29:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149362 s, 70.2 MB/s 2024-08-18T22:29:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199237 s, 52.6 MB/s 2024-08-18T22:29:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.160 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173268 s, 60.5 MB/s 2024-08-18T22:29:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.178 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152298 s, 68.9 MB/s 2024-08-18T22:29:42.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.195 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147583 s, 71.0 MB/s 2024-08-18T22:29:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.210 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126627 s, 82.8 MB/s 2024-08-18T22:29:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168687 s, 62.2 MB/s 2024-08-18T22:29:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.252 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193521 s, 54.2 MB/s 2024-08-18T22:29:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164652 s, 63.7 MB/s 2024-08-18T22:29:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149691 s, 70.0 MB/s 2024-08-18T22:29:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148674 s, 70.5 MB/s 2024-08-18T22:29:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171494 s, 61.1 MB/s 2024-08-18T22:29:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:42.332 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:42.332 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:42.333 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.19 2024-08-18T22:29:42.333 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:42.333 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:42.333 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:42.333 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:42.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.448 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020469 s, 51.2 MB/s 2024-08-18T22:29:42.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.466 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158307 s, 66.2 MB/s 2024-08-18T22:29:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170541 s, 61.5 MB/s 2024-08-18T22:29:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154548 s, 67.8 MB/s 2024-08-18T22:29:42.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.523 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169971 s, 61.7 MB/s 2024-08-18T22:29:42.546 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.546 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.546 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204289 s, 51.3 MB/s 2024-08-18T22:29:42.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.564 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155844 s, 67.3 MB/s 2024-08-18T22:29:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.582 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148426 s, 70.6 MB/s 2024-08-18T22:29:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170212 s, 61.6 MB/s 2024-08-18T22:29:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.620 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016026 s, 65.4 MB/s 2024-08-18T22:29:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150786 s, 69.5 MB/s 2024-08-18T22:29:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197534 s, 53.1 MB/s 2024-08-18T22:29:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153385 s, 68.4 MB/s 2024-08-18T22:29:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156754 s, 66.9 MB/s 2024-08-18T22:29:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.721 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215815 s, 48.6 MB/s 2024-08-18T22:29:42.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.739 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156678 s, 66.9 MB/s 2024-08-18T22:29:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174622 s, 60.0 MB/s 2024-08-18T22:29:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017935 s, 58.5 MB/s 2024-08-18T22:29:42.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.806 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234505 s, 44.7 MB/s 2024-08-18T22:29:42.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.825 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174266 s, 60.2 MB/s 2024-08-18T22:29:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158923 s, 66.0 MB/s 2024-08-18T22:29:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.861 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146176 s, 71.7 MB/s 2024-08-18T22:29:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146699 s, 71.5 MB/s 2024-08-18T22:29:42.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.906 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244976 s, 42.8 MB/s 2024-08-18T22:29:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154588 s, 67.8 MB/s 2024-08-18T22:29:42.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147539 s, 71.1 MB/s 2024-08-18T22:29:42.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014628 s, 71.7 MB/s 2024-08-18T22:29:42.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:42.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:42.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158826 s, 66.0 MB/s 2024-08-18T22:29:43.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021442 s, 48.9 MB/s 2024-08-18T22:29:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145761 s, 71.9 MB/s 2024-08-18T22:29:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144278 s, 72.7 MB/s 2024-08-18T22:29:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171051 s, 61.3 MB/s 2024-08-18T22:29:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:43.063 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:43.063 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:43.063 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.20 2024-08-18T22:29:43.063 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:43.063 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:43.063 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:43.063 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149111 s, 70.3 MB/s 2024-08-18T22:29:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.198 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020474 s, 51.2 MB/s 2024-08-18T22:29:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.215 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014827 s, 70.7 MB/s 2024-08-18T22:29:43.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.232 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014751 s, 71.1 MB/s 2024-08-18T22:29:43.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184356 s, 56.9 MB/s 2024-08-18T22:29:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146537 s, 71.6 MB/s 2024-08-18T22:29:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172732 s, 60.7 MB/s 2024-08-18T22:29:43.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.307 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.307 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014571 s, 72.0 MB/s 2024-08-18T22:29:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145238 s, 72.2 MB/s 2024-08-18T22:29:43.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.342 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152088 s, 68.9 MB/s 2024-08-18T22:29:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143317 s, 73.2 MB/s 2024-08-18T22:29:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.379 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017786 s, 59.0 MB/s 2024-08-18T22:29:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215101 s, 48.7 MB/s 2024-08-18T22:29:43.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149662 s, 70.1 MB/s 2024-08-18T22:29:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147752 s, 71.0 MB/s 2024-08-18T22:29:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150189 s, 69.8 MB/s 2024-08-18T22:29:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196822 s, 53.3 MB/s 2024-08-18T22:29:43.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.496 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149576 s, 70.1 MB/s 2024-08-18T22:29:43.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150816 s, 69.5 MB/s 2024-08-18T22:29:43.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154024 s, 68.1 MB/s 2024-08-18T22:29:43.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150235 s, 69.8 MB/s 2024-08-18T22:29:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014608 s, 71.8 MB/s 2024-08-18T22:29:43.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.584 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014826 s, 70.7 MB/s 2024-08-18T22:29:43.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150939 s, 69.5 MB/s 2024-08-18T22:29:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226773 s, 46.2 MB/s 2024-08-18T22:29:43.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.647 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017599 s, 59.6 MB/s 2024-08-18T22:29:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151074 s, 69.4 MB/s 2024-08-18T22:29:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148362 s, 70.7 MB/s 2024-08-18T22:29:43.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.700 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151923 s, 69.0 MB/s 2024-08-18T22:29:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143988 s, 72.8 MB/s 2024-08-18T22:29:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149775 s, 70.0 MB/s 2024-08-18T22:29:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.753 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159458 s, 65.8 MB/s 2024-08-18T22:29:43.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:43.761 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:43.761 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:43.761 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.21 2024-08-18T22:29:43.761 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:43.761 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:43.761 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:43.761 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:43.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015053 s, 69.7 MB/s 2024-08-18T22:29:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014602 s, 71.8 MB/s 2024-08-18T22:29:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145276 s, 72.2 MB/s 2024-08-18T22:29:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169806 s, 61.8 MB/s 2024-08-18T22:29:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212663 s, 49.3 MB/s 2024-08-18T22:29:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.926 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014562 s, 72.0 MB/s 2024-08-18T22:29:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173745 s, 60.4 MB/s 2024-08-18T22:29:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.966 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181469 s, 57.8 MB/s 2024-08-18T22:29:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124993 s, 83.9 MB/s 2024-08-18T22:29:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:43.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150661 s, 69.6 MB/s 2024-08-18T22:29:44.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153586 s, 68.3 MB/s 2024-08-18T22:29:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193881 s, 54.1 MB/s 2024-08-18T22:29:44.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148995 s, 70.4 MB/s 2024-08-18T22:29:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211604 s, 49.6 MB/s 2024-08-18T22:29:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165383 s, 63.4 MB/s 2024-08-18T22:29:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.119 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167895 s, 62.5 MB/s 2024-08-18T22:29:44.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.144 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226702 s, 46.3 MB/s 2024-08-18T22:29:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150977 s, 69.5 MB/s 2024-08-18T22:29:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146649 s, 71.5 MB/s 2024-08-18T22:29:44.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.193 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110728 s, 94.7 MB/s 2024-08-18T22:29:44.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211485 s, 49.6 MB/s 2024-08-18T22:29:44.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.238 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188851 s, 55.5 MB/s 2024-08-18T22:29:44.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.257 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168822 s, 62.1 MB/s 2024-08-18T22:29:44.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152571 s, 68.7 MB/s 2024-08-18T22:29:44.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213589 s, 49.1 MB/s 2024-08-18T22:29:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171014 s, 61.3 MB/s 2024-08-18T22:29:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170879 s, 61.4 MB/s 2024-08-18T22:29:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159379 s, 65.8 MB/s 2024-08-18T22:29:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.384 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246935 s, 42.5 MB/s 2024-08-18T22:29:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149231 s, 70.3 MB/s 2024-08-18T22:29:44.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.422 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.422 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172236 s, 60.9 MB/s 2024-08-18T22:29:44.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173514 s, 60.4 MB/s 2024-08-18T22:29:44.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:44.449 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:44.449 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:44.450 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.22 2024-08-18T22:29:44.450 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:44.450 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:44.450 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:44.450 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:44.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236806 s, 44.3 MB/s 2024-08-18T22:29:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.545 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147689 s, 71.0 MB/s 2024-08-18T22:29:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145913 s, 71.9 MB/s 2024-08-18T22:29:44.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166834 s, 62.9 MB/s 2024-08-18T22:29:44.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.599 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150775 s, 69.5 MB/s 2024-08-18T22:29:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150162 s, 69.8 MB/s 2024-08-18T22:29:44.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194938 s, 53.8 MB/s 2024-08-18T22:29:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154853 s, 67.7 MB/s 2024-08-18T22:29:44.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.677 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017615 s, 59.5 MB/s 2024-08-18T22:29:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160232 s, 65.4 MB/s 2024-08-18T22:29:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177387 s, 59.1 MB/s 2024-08-18T22:29:44.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.739 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.739 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208693 s, 50.2 MB/s 2024-08-18T22:29:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168742 s, 62.1 MB/s 2024-08-18T22:29:44.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.777 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161445 s, 64.9 MB/s 2024-08-18T22:29:44.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145692 s, 72.0 MB/s 2024-08-18T22:29:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145965 s, 71.8 MB/s 2024-08-18T22:29:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163749 s, 64.0 MB/s 2024-08-18T22:29:44.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.849 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152528 s, 68.7 MB/s 2024-08-18T22:29:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249058 s, 42.1 MB/s 2024-08-18T22:29:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168282 s, 62.3 MB/s 2024-08-18T22:29:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.915 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168873 s, 62.1 MB/s 2024-08-18T22:29:44.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160942 s, 65.2 MB/s 2024-08-18T22:29:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145545 s, 72.0 MB/s 2024-08-18T22:29:44.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.976 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023023 s, 45.5 MB/s 2024-08-18T22:29:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:44.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201148 s, 52.1 MB/s 2024-08-18T22:29:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165733 s, 63.3 MB/s 2024-08-18T22:29:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236014 s, 44.4 MB/s 2024-08-18T22:29:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.062 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153849 s, 68.2 MB/s 2024-08-18T22:29:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144224 s, 72.7 MB/s 2024-08-18T22:29:45.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.105 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225458 s, 46.5 MB/s 2024-08-18T22:29:45.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163715 s, 64.0 MB/s 2024-08-18T22:29:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178354 s, 58.8 MB/s 2024-08-18T22:29:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:45.152 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:45.152 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:45.152 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.23 2024-08-18T22:29:45.152 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:45.152 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:45.152 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:45.152 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:45.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:45.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156014 s, 67.2 MB/s 2024-08-18T22:29:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.245 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207911 s, 50.4 MB/s 2024-08-18T22:29:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201275 s, 52.1 MB/s 2024-08-18T22:29:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171493 s, 61.1 MB/s 2024-08-18T22:29:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154833 s, 67.7 MB/s 2024-08-18T22:29:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.333 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239521 s, 43.8 MB/s 2024-08-18T22:29:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166359 s, 63.0 MB/s 2024-08-18T22:29:45.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172231 s, 60.9 MB/s 2024-08-18T22:29:45.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161166 s, 65.1 MB/s 2024-08-18T22:29:45.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.413 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203158 s, 51.6 MB/s 2024-08-18T22:29:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.432 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157843 s, 66.4 MB/s 2024-08-18T22:29:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014499 s, 72.3 MB/s 2024-08-18T22:29:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160897 s, 65.2 MB/s 2024-08-18T22:29:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.485 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149393 s, 70.2 MB/s 2024-08-18T22:29:45.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.503 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151968 s, 69.0 MB/s 2024-08-18T22:29:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174831 s, 60.0 MB/s 2024-08-18T22:29:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118917 s, 88.2 MB/s 2024-08-18T22:29:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.556 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160778 s, 65.2 MB/s 2024-08-18T22:29:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014586 s, 71.9 MB/s 2024-08-18T22:29:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.591 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150971 s, 69.5 MB/s 2024-08-18T22:29:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143351 s, 73.1 MB/s 2024-08-18T22:29:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171392 s, 61.2 MB/s 2024-08-18T22:29:45.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149354 s, 70.2 MB/s 2024-08-18T22:29:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170402 s, 61.5 MB/s 2024-08-18T22:29:45.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153976 s, 68.1 MB/s 2024-08-18T22:29:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144167 s, 72.7 MB/s 2024-08-18T22:29:45.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156506 s, 67.0 MB/s 2024-08-18T22:29:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208285 s, 50.3 MB/s 2024-08-18T22:29:45.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149741 s, 70.0 MB/s 2024-08-18T22:29:45.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175445 s, 59.8 MB/s 2024-08-18T22:29:45.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.800 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.800 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170902 s, 61.4 MB/s 2024-08-18T22:29:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150027 s, 69.9 MB/s 2024-08-18T22:29:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:45.825 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:45.825 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:45.825 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.24 2024-08-18T22:29:45.825 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:45.825 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:45.825 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:45.825 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:45.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.936 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166133 s, 63.1 MB/s 2024-08-18T22:29:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214734 s, 48.8 MB/s 2024-08-18T22:29:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.979 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164797 s, 63.6 MB/s 2024-08-18T22:29:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017182 s, 61.0 MB/s 2024-08-18T22:29:46.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153126 s, 68.5 MB/s 2024-08-18T22:29:46.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015782 s, 66.4 MB/s 2024-08-18T22:29:46.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.062 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240031 s, 43.7 MB/s 2024-08-18T22:29:46.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.080 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151184 s, 69.4 MB/s 2024-08-18T22:29:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017378 s, 60.3 MB/s 2024-08-18T22:29:46.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.119 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162312 s, 64.6 MB/s 2024-08-18T22:29:46.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202375 s, 51.8 MB/s 2024-08-18T22:29:46.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.161 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165196 s, 63.5 MB/s 2024-08-18T22:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171408 s, 61.2 MB/s 2024-08-18T22:29:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.203 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199687 s, 52.5 MB/s 2024-08-18T22:29:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149011 s, 70.4 MB/s 2024-08-18T22:29:46.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231771 s, 45.2 MB/s 2024-08-18T22:29:46.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.265 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153512 s, 68.3 MB/s 2024-08-18T22:29:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163272 s, 64.2 MB/s 2024-08-18T22:29:46.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0386134 s, 27.2 MB/s 2024-08-18T22:29:46.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.346 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170212 s, 61.6 MB/s 2024-08-18T22:29:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153208 s, 68.4 MB/s 2024-08-18T22:29:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151067 s, 69.4 MB/s 2024-08-18T22:29:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145125 s, 72.3 MB/s 2024-08-18T22:29:46.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149235 s, 70.3 MB/s 2024-08-18T22:29:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266895 s, 39.3 MB/s 2024-08-18T22:29:46.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189166 s, 55.4 MB/s 2024-08-18T22:29:46.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193869 s, 54.1 MB/s 2024-08-18T22:29:46.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.508 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164913 s, 63.6 MB/s 2024-08-18T22:29:46.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211998 s, 49.5 MB/s 2024-08-18T22:29:46.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.550 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147894 s, 70.9 MB/s 2024-08-18T22:29:46.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180048 s, 58.2 MB/s 2024-08-18T22:29:46.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.588 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150937 s, 69.5 MB/s 2024-08-18T22:29:46.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:46.595 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:46.595 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:46.595 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.25 2024-08-18T22:29:46.595 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:46.595 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:46.596 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:46.596 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:46.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.669 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018175 s, 57.7 MB/s 2024-08-18T22:29:46.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.687 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158077 s, 66.3 MB/s 2024-08-18T22:29:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144947 s, 72.3 MB/s 2024-08-18T22:29:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.724 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175753 s, 59.7 MB/s 2024-08-18T22:29:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152342 s, 68.8 MB/s 2024-08-18T22:29:46.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191698 s, 54.7 MB/s 2024-08-18T22:29:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179153 s, 58.5 MB/s 2024-08-18T22:29:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153449 s, 68.3 MB/s 2024-08-18T22:29:46.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.821 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161738 s, 64.8 MB/s 2024-08-18T22:29:46.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178711 s, 58.7 MB/s 2024-08-18T22:29:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181245 s, 57.9 MB/s 2024-08-18T22:29:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015401 s, 68.1 MB/s 2024-08-18T22:29:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169223 s, 62.0 MB/s 2024-08-18T22:29:46.918 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.918 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.919 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157617 s, 66.5 MB/s 2024-08-18T22:29:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.935 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142568 s, 73.5 MB/s 2024-08-18T22:29:46.955 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.955 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.955 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017439 s, 60.1 MB/s 2024-08-18T22:29:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171432 s, 61.2 MB/s 2024-08-18T22:29:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016195 s, 64.7 MB/s 2024-08-18T22:29:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145345 s, 72.1 MB/s 2024-08-18T22:29:47.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150928 s, 69.5 MB/s 2024-08-18T22:29:47.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.045 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147789 s, 71.0 MB/s 2024-08-18T22:29:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170066 s, 61.7 MB/s 2024-08-18T22:29:47.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152523 s, 68.7 MB/s 2024-08-18T22:29:47.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154689 s, 67.8 MB/s 2024-08-18T22:29:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150153 s, 69.8 MB/s 2024-08-18T22:29:47.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.138 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175034 s, 59.9 MB/s 2024-08-18T22:29:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173011 s, 60.6 MB/s 2024-08-18T22:29:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145928 s, 71.9 MB/s 2024-08-18T22:29:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183152 s, 57.3 MB/s 2024-08-18T22:29:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148923 s, 70.4 MB/s 2024-08-18T22:29:47.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.237 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207474 s, 50.5 MB/s 2024-08-18T22:29:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154669 s, 67.8 MB/s 2024-08-18T22:29:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:47.263 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:47.263 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:47.263 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.26 2024-08-18T22:29:47.263 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:47.264 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:47.264 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:47.264 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:47.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:47.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170896 s, 61.4 MB/s 2024-08-18T22:29:47.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.354 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155566 s, 67.4 MB/s 2024-08-18T22:29:47.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.372 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.372 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152247 s, 68.9 MB/s 2024-08-18T22:29:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151389 s, 69.3 MB/s 2024-08-18T22:29:47.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.406 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146604 s, 71.5 MB/s 2024-08-18T22:29:47.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155912 s, 67.3 MB/s 2024-08-18T22:29:47.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.443 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156429 s, 67.0 MB/s 2024-08-18T22:29:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.469 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238779 s, 43.9 MB/s 2024-08-18T22:29:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164215 s, 63.9 MB/s 2024-08-18T22:29:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.507 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016272 s, 64.4 MB/s 2024-08-18T22:29:47.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.525 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.525 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151869 s, 69.0 MB/s 2024-08-18T22:29:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148987 s, 70.4 MB/s 2024-08-18T22:29:47.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207075 s, 50.6 MB/s 2024-08-18T22:29:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.583 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149717 s, 70.0 MB/s 2024-08-18T22:29:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147271 s, 71.2 MB/s 2024-08-18T22:29:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161551 s, 64.9 MB/s 2024-08-18T22:29:47.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.643 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209036 s, 50.2 MB/s 2024-08-18T22:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171331 s, 61.2 MB/s 2024-08-18T22:29:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181685 s, 57.7 MB/s 2024-08-18T22:29:47.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153853 s, 68.2 MB/s 2024-08-18T22:29:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019614 s, 53.5 MB/s 2024-08-18T22:29:47.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148693 s, 70.5 MB/s 2024-08-18T22:29:47.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.758 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014601 s, 71.8 MB/s 2024-08-18T22:29:47.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.777 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173247 s, 60.5 MB/s 2024-08-18T22:29:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214692 s, 48.8 MB/s 2024-08-18T22:29:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169639 s, 61.8 MB/s 2024-08-18T22:29:47.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.841 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173491 s, 60.4 MB/s 2024-08-18T22:29:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.865 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208989 s, 50.2 MB/s 2024-08-18T22:29:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167825 s, 62.5 MB/s 2024-08-18T22:29:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156338 s, 67.1 MB/s 2024-08-18T22:29:47.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.926 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206241 s, 50.8 MB/s 2024-08-18T22:29:47.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:47.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:47.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157833 s, 66.4 MB/s 2024-08-18T22:29:47.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:47.951 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:47.951 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:47.951 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.27 2024-08-18T22:29:47.951 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:47.951 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:47.951 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:47.951 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168652 s, 62.2 MB/s 2024-08-18T22:29:48.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147178 s, 71.2 MB/s 2024-08-18T22:29:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.054 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118759 s, 88.3 MB/s 2024-08-18T22:29:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229969 s, 45.6 MB/s 2024-08-18T22:29:48.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.099 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165726 s, 63.3 MB/s 2024-08-18T22:29:48.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205364 s, 51.1 MB/s 2024-08-18T22:29:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.136 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114391 s, 91.7 MB/s 2024-08-18T22:29:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197293 s, 53.1 MB/s 2024-08-18T22:29:48.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.176 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151677 s, 69.1 MB/s 2024-08-18T22:29:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192381 s, 54.5 MB/s 2024-08-18T22:29:48.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.215 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150278 s, 69.8 MB/s 2024-08-18T22:29:48.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220068 s, 47.6 MB/s 2024-08-18T22:29:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165532 s, 63.3 MB/s 2024-08-18T22:29:48.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.277 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015563 s, 67.4 MB/s 2024-08-18T22:29:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02035 s, 51.5 MB/s 2024-08-18T22:29:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182129 s, 57.6 MB/s 2024-08-18T22:29:48.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.338 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151916 s, 69.0 MB/s 2024-08-18T22:29:48.356 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.357 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155092 s, 67.6 MB/s 2024-08-18T22:29:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160899 s, 65.2 MB/s 2024-08-18T22:29:48.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220695 s, 47.5 MB/s 2024-08-18T22:29:48.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145114 s, 72.3 MB/s 2024-08-18T22:29:48.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.434 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150539 s, 69.7 MB/s 2024-08-18T22:29:48.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.458 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213934 s, 49.0 MB/s 2024-08-18T22:29:48.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.478 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171708 s, 61.1 MB/s 2024-08-18T22:29:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.499 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182567 s, 57.4 MB/s 2024-08-18T22:29:48.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.519 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171608 s, 61.1 MB/s 2024-08-18T22:29:48.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.543 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219513 s, 47.8 MB/s 2024-08-18T22:29:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166359 s, 63.0 MB/s 2024-08-18T22:29:48.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162977 s, 64.3 MB/s 2024-08-18T22:29:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.601 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173072 s, 60.6 MB/s 2024-08-18T22:29:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.621 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017413 s, 60.2 MB/s 2024-08-18T22:29:48.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.640 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016152 s, 64.9 MB/s 2024-08-18T22:29:48.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:48.648 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:48.648 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:48.648 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.28 2024-08-18T22:29:48.648 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:48.648 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:48.648 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:48.648 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:48.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:48.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.721 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181633 s, 57.7 MB/s 2024-08-18T22:29:48.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.741 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177486 s, 59.1 MB/s 2024-08-18T22:29:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202053 s, 51.9 MB/s 2024-08-18T22:29:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148745 s, 70.5 MB/s 2024-08-18T22:29:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.809 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024701 s, 42.5 MB/s 2024-08-18T22:29:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179993 s, 58.3 MB/s 2024-08-18T22:29:48.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.847 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143952 s, 72.8 MB/s 2024-08-18T22:29:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186886 s, 56.1 MB/s 2024-08-18T22:29:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147703 s, 71.0 MB/s 2024-08-18T22:29:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.903 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151624 s, 69.2 MB/s 2024-08-18T22:29:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154305 s, 68.0 MB/s 2024-08-18T22:29:48.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.938 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146837 s, 71.4 MB/s 2024-08-18T22:29:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248058 s, 42.3 MB/s 2024-08-18T22:29:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144402 s, 72.6 MB/s 2024-08-18T22:29:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168386 s, 62.3 MB/s 2024-08-18T22:29:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185432 s, 56.5 MB/s 2024-08-18T22:29:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151419 s, 69.2 MB/s 2024-08-18T22:29:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014702 s, 71.3 MB/s 2024-08-18T22:29:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154884 s, 67.7 MB/s 2024-08-18T22:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145771 s, 71.9 MB/s 2024-08-18T22:29:49.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153438 s, 68.3 MB/s 2024-08-18T22:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146126 s, 71.8 MB/s 2024-08-18T22:29:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165269 s, 63.4 MB/s 2024-08-18T22:29:49.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148314 s, 70.7 MB/s 2024-08-18T22:29:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01553 s, 67.5 MB/s 2024-08-18T22:29:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177104 s, 59.2 MB/s 2024-08-18T22:29:49.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171686 s, 61.1 MB/s 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159494 s, 65.7 MB/s 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165341 s, 63.4 MB/s 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171466 s, 61.2 MB/s 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150933 s, 69.5 MB/s 2024-08-18T22:29:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172236 s, 60.9 MB/s 2024-08-18T22:29:49.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:49.331 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:49.331 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:49.331 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.29 2024-08-18T22:29:49.331 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:49.332 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:49.332 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:49.332 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.401 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146324 s, 71.7 MB/s 2024-08-18T22:29:49.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150872 s, 69.5 MB/s 2024-08-18T22:29:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205292 s, 51.1 MB/s 2024-08-18T22:29:49.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149973 s, 69.9 MB/s 2024-08-18T22:29:49.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.477 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151471 s, 69.2 MB/s 2024-08-18T22:29:49.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153384 s, 68.4 MB/s 2024-08-18T22:29:49.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.512 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145792 s, 71.9 MB/s 2024-08-18T22:29:49.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214235 s, 48.9 MB/s 2024-08-18T22:29:49.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.557 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180207 s, 58.2 MB/s 2024-08-18T22:29:49.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151683 s, 69.1 MB/s 2024-08-18T22:29:49.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150597 s, 69.6 MB/s 2024-08-18T22:29:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240096 s, 43.7 MB/s 2024-08-18T22:29:49.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.637 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151487 s, 69.2 MB/s 2024-08-18T22:29:49.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.655 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149178 s, 70.3 MB/s 2024-08-18T22:29:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222004 s, 47.2 MB/s 2024-08-18T22:29:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158637 s, 66.1 MB/s 2024-08-18T22:29:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172391 s, 60.8 MB/s 2024-08-18T22:29:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166717 s, 62.9 MB/s 2024-08-18T22:29:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147382 s, 71.1 MB/s 2024-08-18T22:29:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233329 s, 44.9 MB/s 2024-08-18T22:29:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.798 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146166 s, 71.7 MB/s 2024-08-18T22:29:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171715 s, 61.1 MB/s 2024-08-18T22:29:49.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.845 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244914 s, 42.8 MB/s 2024-08-18T22:29:49.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.863 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149885 s, 70.0 MB/s 2024-08-18T22:29:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181575 s, 57.7 MB/s 2024-08-18T22:29:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.901 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150211 s, 69.8 MB/s 2024-08-18T22:29:49.918 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149885 s, 70.0 MB/s 2024-08-18T22:29:49.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.937 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153335 s, 68.4 MB/s 2024-08-18T22:29:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.955 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153149 s, 68.5 MB/s 2024-08-18T22:29:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163309 s, 64.2 MB/s 2024-08-18T22:29:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160915 s, 65.2 MB/s 2024-08-18T22:29:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175222 s, 59.8 MB/s 2024-08-18T22:29:50.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:50.023 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:50.024 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:50.024 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.30 2024-08-18T22:29:50.024 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:50.024 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:50.024 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:50.024 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:50.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178134 s, 58.9 MB/s 2024-08-18T22:29:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208632 s, 50.3 MB/s 2024-08-18T22:29:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144964 s, 72.3 MB/s 2024-08-18T22:29:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154839 s, 67.7 MB/s 2024-08-18T22:29:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148659 s, 70.5 MB/s 2024-08-18T22:29:50.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.194 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169961 s, 61.7 MB/s 2024-08-18T22:29:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.215 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017628 s, 59.5 MB/s 2024-08-18T22:29:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217658 s, 48.2 MB/s 2024-08-18T22:29:50.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.259 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171405 s, 61.2 MB/s 2024-08-18T22:29:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.277 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01554 s, 67.5 MB/s 2024-08-18T22:29:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144498 s, 72.6 MB/s 2024-08-18T22:29:50.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.314 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01779 s, 58.9 MB/s 2024-08-18T22:29:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.332 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155335 s, 67.5 MB/s 2024-08-18T22:29:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169023 s, 62.0 MB/s 2024-08-18T22:29:50.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.369 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148204 s, 70.8 MB/s 2024-08-18T22:29:50.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.387 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150504 s, 69.7 MB/s 2024-08-18T22:29:50.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015015 s, 69.8 MB/s 2024-08-18T22:29:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171912 s, 61.0 MB/s 2024-08-18T22:29:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149937 s, 69.9 MB/s 2024-08-18T22:29:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201604 s, 52.0 MB/s 2024-08-18T22:29:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145764 s, 71.9 MB/s 2024-08-18T22:29:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176313 s, 59.5 MB/s 2024-08-18T22:29:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.529 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233784 s, 44.9 MB/s 2024-08-18T22:29:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.546 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014789 s, 70.9 MB/s 2024-08-18T22:29:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015264 s, 68.7 MB/s 2024-08-18T22:29:50.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.588 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218648 s, 48.0 MB/s 2024-08-18T22:29:50.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148389 s, 70.7 MB/s 2024-08-18T22:29:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.626 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172192 s, 60.9 MB/s 2024-08-18T22:29:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153863 s, 68.1 MB/s 2024-08-18T22:29:50.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.661 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148422 s, 70.6 MB/s 2024-08-18T22:29:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206828 s, 50.7 MB/s 2024-08-18T22:29:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172107 s, 60.9 MB/s 2024-08-18T22:29:50.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:50.712 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:29:50.713 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:29:50.713 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.31 2024-08-18T22:29:50.713 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:29:50.713 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:29:50.713 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:29:50.713 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:29:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:29:50.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.825 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175171 s, 59.9 MB/s 2024-08-18T22:29:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176499 s, 59.4 MB/s 2024-08-18T22:29:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125481 s, 83.6 MB/s 2024-08-18T22:29:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150654 s, 69.6 MB/s 2024-08-18T22:29:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155316 s, 67.5 MB/s 2024-08-18T22:29:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158259 s, 66.3 MB/s 2024-08-18T22:29:50.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151272 s, 69.3 MB/s 2024-08-18T22:29:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179939 s, 58.3 MB/s 2024-08-18T22:29:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157143 s, 66.7 MB/s 2024-08-18T22:29:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172638 s, 60.7 MB/s 2024-08-18T22:29:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016026 s, 65.4 MB/s 2024-08-18T22:29:51.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157109 s, 66.7 MB/s 2024-08-18T22:29:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145066 s, 72.3 MB/s 2024-08-18T22:29:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180376 s, 58.1 MB/s 2024-08-18T22:29:51.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.083 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014829 s, 70.7 MB/s 2024-08-18T22:29:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147379 s, 71.1 MB/s 2024-08-18T22:29:51.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.121 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180461 s, 58.1 MB/s 2024-08-18T22:29:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181429 s, 57.8 MB/s 2024-08-18T22:29:51.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.160 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151045 s, 69.4 MB/s 2024-08-18T22:29:51.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.178 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015115 s, 69.4 MB/s 2024-08-18T22:29:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.195 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149205 s, 70.3 MB/s 2024-08-18T22:29:51.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164563 s, 63.7 MB/s 2024-08-18T22:29:51.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017877 s, 58.7 MB/s 2024-08-18T22:29:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259081 s, 40.5 MB/s 2024-08-18T22:29:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204152 s, 51.4 MB/s 2024-08-18T22:29:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156101 s, 67.2 MB/s 2024-08-18T22:29:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218184 s, 48.1 MB/s 2024-08-18T22:29:51.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151829 s, 69.1 MB/s 2024-08-18T22:29:51.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.367 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170149 s, 61.6 MB/s 2024-08-18T22:29:51.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.390 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197916 s, 53.0 MB/s 2024-08-18T22:29:51.406 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.407 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143984 s, 72.8 MB/s 2024-08-18T22:29:51.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:29:51.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:29:51.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152811 s, 68.6 MB/s 2024-08-18T22:29:51.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:29:51.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:51.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub start /scrub_control_test_path recursive 2024-08-18T22:29:51.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.578+0000 7ff8ed200640 1 Processor -- start 2024-08-18T22:29:51.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.578+0000 7ff8ed200640 1 -- start start 2024-08-18T22:29:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8ed200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8e81619b0 0x7ff8e809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8ed200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8e8070e10 0x7ff8e809af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8ed200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e80d2cd0 con 0x7ff8e806ddd0 2024-08-18T22:29:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8ed200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e80d1bd0 con 0x7ff8e8070e10 2024-08-18T22:29:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8ed200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e80d1eb0 con 0x7ff8e81619b0 2024-08-18T22:29:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8dd400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8e8070e10 0x7ff8e809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8dd400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8e8070e10 0x7ff8e809af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35242/0 (socket says 172.21.15.5:35242) 2024-08-18T22:29:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8dd400640 1 -- 172.21.15.5:0/640627471 learned_addr learned my addr 172.21.15.5:0/640627471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8e6800640 1 --1- 172.21.15.5:0/640627471 >> v1:172.21.15.5:6789/0 conn(0x7ff8e806ddd0 0x7ff8e806cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58386/0 (socket says 172.21.15.5:58386) 2024-08-18T22:29:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/640627471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8e81619b0 0x7ff8e809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8dd400640 1 -- 172.21.15.5:0/640627471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8e81619b0 msgr2=0x7ff8e809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8dd400640 1 --2- 172.21.15.5:0/640627471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8e81619b0 0x7ff8e809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8dd400640 1 -- 172.21.15.5:0/640627471 >> v1:172.21.15.5:6789/0 conn(0x7ff8e806ddd0 legacy=0x7ff8e806cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.582+0000 7ff8dd400640 1 -- 172.21.15.5:0/640627471 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e80d2f70 con 0x7ff8e8070e10 2024-08-18T22:29:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8dd400640 1 --2- 172.21.15.5:0/640627471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8070e10 0x7ff8e809af80 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009870 tx=0x7ff8d001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c5cfc57a81df9d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8e5400640 1 -- 172.21.15.5:0/640627471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00b2070 con 0x7ff8e8070e10 2024-08-18T22:29:51.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8e5400640 1 -- 172.21.15.5:0/640627471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d00a9070 con 0x7ff8e8070e10 2024-08-18T22:29:51.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8e5400640 1 -- 172.21.15.5:0/640627471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00ad880 con 0x7ff8e8070e10 2024-08-18T22:29:51.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 -- 172.21.15.5:0/640627471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8070e10 msgr2=0x7ff8e809af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 --2- 172.21.15.5:0/640627471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8070e10 0x7ff8e809af80 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009870 tx=0x7ff8d001c560 comp rx=0 tx=0).stop 2024-08-18T22:29:51.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 -- 172.21.15.5:0/640627471 shutdown_connections 2024-08-18T22:29:51.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 --2- 172.21.15.5:0/640627471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8070e10 0x7ff8e809af80 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 --2- 172.21.15.5:0/640627471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8e81619b0 0x7ff8e809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 -- 172.21.15.5:0/640627471 >> 172.21.15.5:0/640627471 conn(0x7ff8e80d2110 msgr2=0x7ff8e80d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 -- 172.21.15.5:0/640627471 shutdown_connections 2024-08-18T22:29:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 -- 172.21.15.5:0/640627471 wait complete. 2024-08-18T22:29:51.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 Processor -- start 2024-08-18T22:29:51.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 -- start start 2024-08-18T22:29:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8e806ddd0 0x7ff8e8151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.586+0000 7ff8ed200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8070e10 0x7ff8e8158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8ed200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8e81619b0 0x7ff8e80b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8ed200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e816b3a0 con 0x7ff8e8070e10 2024-08-18T22:29:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8ed200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e809b8d0 con 0x7ff8e81619b0 2024-08-18T22:29:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8ed200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e816b520 con 0x7ff8e806ddd0 2024-08-18T22:29:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dd400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8070e10 0x7ff8e8158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dd400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8070e10 0x7ff8e8158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35250/0 (socket says 172.21.15.5:35250) 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dd400640 1 -- 172.21.15.5:0/3981257946 learned_addr learned my addr 172.21.15.5:0/3981257946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8e806ddd0 0x7ff8e8151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8e6800640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8e81619b0 0x7ff8e80b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dd400640 1 -- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8e806ddd0 msgr2=0x7ff8e8151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dd400640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8e806ddd0 0x7ff8e8151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dd400640 1 -- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8e81619b0 msgr2=0x7ff8e80b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dd400640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8e81619b0 0x7ff8e80b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dd400640 1 -- 172.21.15.5:0/3981257946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e815bc20 con 0x7ff8e8070e10 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8e6800640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8e81619b0 0x7ff8e80b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dd400640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8070e10 0x7ff8e8158050 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00b0040 tx=0x7ff8d0019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dea00640 1 -- 172.21.15.5:0/3981257946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00bb070 con 0x7ff8e8070e10 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dea00640 1 -- 172.21.15.5:0/3981257946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d00adce0 con 0x7ff8e8070e10 2024-08-18T22:29:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dea00640 1 -- 172.21.15.5:0/3981257946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00b2040 con 0x7ff8e8070e10 2024-08-18T22:29:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8ed200640 1 -- 172.21.15.5:0/3981257946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e815b380 con 0x7ff8e8070e10 2024-08-18T22:29:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8ed200640 1 -- 172.21.15.5:0/3981257946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e815b940 con 0x7ff8e8070e10 2024-08-18T22:29:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.590+0000 7ff8dea00640 1 -- 172.21.15.5:0/3981257946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8d00be070 con 0x7ff8e8070e10 2024-08-18T22:29:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8dea00640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8c40678c0 0x7ff8c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8dea00640 1 -- 172.21.15.5:0/3981257946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7ff8d011eca0 con 0x7ff8e8070e10 2024-08-18T22:29:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8c40678c0 0x7ff8c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 Processor -- start 2024-08-18T22:29:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 -- start start 2024-08-18T22:29:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8c40678c0 0x7ff8c4069d80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009b60 tx=0x7ff8d8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e02c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c920 0x555b4dfe2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4dfe3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555b4de30340 con 0x555b4e02c000 2024-08-18T22:29:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555b4ddeaba0 con 0x555b4dfe30b0 2024-08-18T22:29:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555b4de2c300 con 0x555b4e02c920 2024-08-18T22:29:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e02c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e02c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35260/0 (socket says 172.21.15.5:35260) 2024-08-18T22:29:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e5e00640 1 -- 172.21.15.5:0/3068587805 learned_addr learned my addr 172.21.15.5:0/3068587805 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e6800640 1 --2- 172.21.15.5:0/3068587805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4dfe3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8dd400640 1 --2- 172.21.15.5:0/3068587805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c920 0x555b4dfe2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e5e00640 1 -- 172.21.15.5:0/3068587805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c920 msgr2=0x555b4dfe2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/3068587805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c920 0x555b4dfe2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e5e00640 1 -- 172.21.15.5:0/3068587805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 msgr2=0x555b4dfe3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/3068587805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4dfe3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e5e00640 1 -- 172.21.15.5:0/3068587805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4dedca30 con 0x555b4e02c000 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/3068587805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e02c3e0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8011ec0 tx=0x7ff8d8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e493cfabb6302d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8d6a00640 1 -- 172.21.15.5:0/3068587805 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d801b070 con 0x555b4e02c000 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8d6a00640 1 -- 172.21.15.5:0/3068587805 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d8027070 con 0x555b4e02c000 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8d6a00640 1 -- 172.21.15.5:0/3068587805 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8003a30 con 0x555b4e02c000 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3068587805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 msgr2=0x555b4e02c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/3068587805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e02c3e0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8011ec0 tx=0x7ff8d8014000 comp rx=0 tx=0).stop 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3068587805 shutdown_connections 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/3068587805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4dfe3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/3068587805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c920 0x555b4dfe2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/3068587805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e02c3e0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3068587805 >> 172.21.15.5:0/3068587805 conn(0x555b4dfdf030 msgr2=0x555b4dfe1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3068587805 shutdown_connections 2024-08-18T22:29:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.594+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3068587805 wait complete. 2024-08-18T22:29:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 -- start start 2024-08-18T22:29:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 Processor -- start 2024-08-18T22:29:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4e02b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c000 0x555b4dfee010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfee550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555b4de34970 con 0x555b4e02c920 2024-08-18T22:29:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555b4ddd1c00 con 0x555b4dfe30b0 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555b4dddbf80 con 0x555b4e02c000 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 10 client.0 _ll_register_callbacks cb 0x555b4dfcdaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8e6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfee550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8e6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfee550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35270/0 (socket says 172.21.15.5:35270) 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8e6800640 1 -- 172.21.15.5:0/3274314650 learned_addr learned my addr 172.21.15.5:0/3274314650 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8dd400640 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c000 0x555b4dfee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4e02b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8e6800640 1 -- 172.21.15.5:0/3274314650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c000 msgr2=0x555b4dfee010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8e6800640 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c000 0x555b4dfee010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8e6800640 1 -- 172.21.15.5:0/3274314650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 msgr2=0x555b4e02b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8e6800640 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4e02b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8e6800640 1 -- 172.21.15.5:0/3274314650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4ded89e0 con 0x555b4e02c920 2024-08-18T22:29:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8e6800640 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfee550 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00014b0 tx=0x7ff8e0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3823aae07aec59e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8cb400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8cb400640 1 -- 172.21.15.5:0/3274314650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0013570 con 0x555b4e02c920 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8cb400640 1 -- 172.21.15.5:0/3274314650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7ff8e0013710 con 0x555b4e02c920 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3274314650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8d8027070 con 0x555b4e02c920 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8cb400640 1 -- 172.21.15.5:0/3274314650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7ff8e0021050 con 0x555b4e02c920 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 10 client.9156 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3274314650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x555b4de0a520 con 0x555b4e02c920 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8cb400640 1 -- 172.21.15.5:0/3274314650 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d8027070 con 0x555b4e02c920 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8cb400640 1 -- 172.21.15.5:0/3274314650 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7ff8e0024020 con 0x555b4e02c920 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 10 client.9156 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 10 client.9156 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 20 client.9156 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x555b4dfef2c0 0x555b4e03e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 4 client.9156 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:29:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.598+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3274314650 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b4dec8e30 con 0x555b4dfef2c0 2024-08-18T22:29:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x555b4dfef2c0 0x555b4e03e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8cb400640 10 client.9156 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x555b4dfef2c0 0x555b4e03e2c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f89ceb9729ee7172 server_cookie=4888dabb7f7e7db3 in_seq=0 out_seq=0 2024-08-18T22:29:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8cb400640 1 -- 172.21.15.5:0/3274314650 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b4dec8e30 con 0x555b4dfef2c0 2024-08-18T22:29:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8cb400640 10 client.9156 handle_command_reply: tid=0 2024-08-18T22:29:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 1 client.9156 shutdown 2024-08-18T22:29:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3274314650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 msgr2=0x555b4dfee550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfee550 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00014b0 tx=0x7ff8e0001970 comp rx=0 tx=0).stop 2024-08-18T22:29:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3274314650 shutdown_connections 2024-08-18T22:29:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x555b4dfef2c0 0x555b4e03e2c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfee550 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c000 0x555b4dfee010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/3274314650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4e02b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8cb400640 0 client.9156 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3274314650 >> 172.21.15.5:0/3274314650 conn(0x555b4dfdf030 msgr2=0x555b4dfe1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3274314650 shutdown_connections 2024-08-18T22:29:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 1 -- 172.21.15.5:0/3274314650 wait complete. 2024-08-18T22:29:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.602+0000 7ff8f06ed000 20 client.9156 trim_cache size 0 max 16384 2024-08-18T22:29:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.618+0000 7ff8f06ed000 1 Processor -- start 2024-08-18T22:29:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 -- start start 2024-08-18T22:29:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4e041710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c000 0x555b4dfe2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfe2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8203220 con 0x555b4e02c920 2024-08-18T22:29:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8159e40 con 0x555b4dfe30b0 2024-08-18T22:29:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e815a490 con 0x555b4e02c000 2024-08-18T22:29:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8e6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfe2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8e6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfe2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35286/0 (socket says 172.21.15.5:35286) 2024-08-18T22:29:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8e6800640 1 -- 172.21.15.5:0/1652507800 learned_addr learned my addr 172.21.15.5:0/1652507800 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/1652507800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4e041710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8dd400640 1 --2- 172.21.15.5:0/1652507800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c000 0x555b4dfe2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8e6800640 1 -- 172.21.15.5:0/1652507800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c000 msgr2=0x555b4dfe2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8e6800640 1 --2- 172.21.15.5:0/1652507800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c000 0x555b4dfe2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8e6800640 1 -- 172.21.15.5:0/1652507800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 msgr2=0x555b4e041710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8e6800640 1 --2- 172.21.15.5:0/1652507800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4e041710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8e6800640 1 -- 172.21.15.5:0/1652507800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4de892f0 con 0x555b4e02c920 2024-08-18T22:29:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8e6800640 1 --2- 172.21.15.5:0/1652507800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfe2970 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0000f90 tx=0x7ff8e000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33388cf0bea2d6e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8d6000640 1 -- 172.21.15.5:0/1652507800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0001e70 con 0x555b4e02c920 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8d6000640 1 -- 172.21.15.5:0/1652507800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e0019070 con 0x555b4e02c920 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8d6000640 1 -- 172.21.15.5:0/1652507800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0013570 con 0x555b4e02c920 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 -- 172.21.15.5:0/1652507800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 msgr2=0x555b4dfe2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/1652507800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfe2970 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0000f90 tx=0x7ff8e000e000 comp rx=0 tx=0).stop 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 -- 172.21.15.5:0/1652507800 shutdown_connections 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/1652507800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c920 0x555b4dfe2970 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/1652507800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4e02c000 0x555b4dfe2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/1652507800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4dfe30b0 0x555b4e041710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 -- 172.21.15.5:0/1652507800 >> 172.21.15.5:0/1652507800 conn(0x555b4dfdf030 msgr2=0x555b4dfed7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 -- 172.21.15.5:0/1652507800 shutdown_connections 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 -- 172.21.15.5:0/1652507800 wait complete. 2024-08-18T22:29:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 -- start start 2024-08-18T22:29:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.622+0000 7ff8f06ed000 1 Processor -- start 2024-08-18T22:29:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4dfe30b0 0x555b4e040c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e05c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4e02c920 0x555b4e05caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555b4ddcc340 con 0x555b4e02c000 2024-08-18T22:29:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555b4ddfafb0 con 0x555b4e02c920 2024-08-18T22:29:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x555b4ddb58f0 con 0x555b4dfe30b0 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 10 client.0 _ll_register_callbacks cb 0x7ff8e0005f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8dd400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e05c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8dd400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e05c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35288/0 (socket says 172.21.15.5:35288) 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8dd400640 1 -- 172.21.15.5:0/2442966419 learned_addr learned my addr 172.21.15.5:0/2442966419 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4dfe30b0 0x555b4e040c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8e6800640 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4e02c920 0x555b4e05caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8dd400640 1 -- 172.21.15.5:0/2442966419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4dfe30b0 msgr2=0x555b4e040c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8dd400640 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4dfe30b0 0x555b4e040c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8dd400640 1 -- 172.21.15.5:0/2442966419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4e02c920 msgr2=0x555b4e05caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8dd400640 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4e02c920 0x555b4e05caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8dd400640 1 -- 172.21.15.5:0/2442966419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4ddcc9d0 con 0x555b4e02c000 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8dd400640 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e05c5b0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00eecf0 tx=0x7ff8d00ef0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235678167672e18d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8cb400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8cb400640 1 -- 172.21.15.5:0/2442966419 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00ee640 con 0x555b4e02c000 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8cb400640 1 -- 172.21.15.5:0/2442966419 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7ff8d00ead40 con 0x555b4e02c000 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 1 -- 172.21.15.5:0/2442966419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8e0019070 con 0x555b4e02c000 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8cb400640 1 -- 172.21.15.5:0/2442966419 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7ff8d00eaf40 con 0x555b4e02c000 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 10 client.9162 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 1 -- 172.21.15.5:0/2442966419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x555b4daeb1a0 con 0x555b4e02c000 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8cb400640 1 -- 172.21.15.5:0/2442966419 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e0019070 con 0x555b4e02c000 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8cb400640 1 -- 172.21.15.5:0/2442966419 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7ff8d00edeb0 con 0x555b4e02c000 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 10 client.9162 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 10 client.9162 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 20 client.9162 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x555b4e05d030 0x555b4e09fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 4 client.9162 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-08-18T22:29:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8f06ed000 1 -- 172.21.15.5:0/2442966419 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x555b4ddcabd0 con 0x555b4e05d030 2024-08-18T22:29:51.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x555b4e05d030 0x555b4e09fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8cb400640 10 client.9162 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:51.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.626+0000 7ff8e5e00640 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x555b4e05d030 0x555b4e09fbf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7019cfd99d0d8de server_cookie=133df64ac4f1e812 in_seq=0 out_seq=0 2024-08-18T22:29:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8cb400640 1 -- 172.21.15.5:0/2442966419 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555b4ddcabd0 con 0x555b4e05d030 2024-08-18T22:29:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8cb400640 10 client.9162 handle_command_reply: tid=0 2024-08-18T22:29:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 1 client.9162 shutdown 2024-08-18T22:29:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 1 -- 172.21.15.5:0/2442966419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 msgr2=0x555b4e05c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e05c5b0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00eecf0 tx=0x7ff8d00ef0b0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 1 -- 172.21.15.5:0/2442966419 shutdown_connections 2024-08-18T22:29:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555b4e02c920 0x555b4e05caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x555b4e05d030 0x555b4e09fbf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555b4e02c000 0x555b4e05c5b0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 1 --2- 172.21.15.5:0/2442966419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555b4dfe30b0 0x555b4e040c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 1 -- 172.21.15.5:0/2442966419 >> 172.21.15.5:0/2442966419 conn(0x555b4dfdf030 msgr2=0x555b4dfe2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8cb400640 0 client.9162 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 1 -- 172.21.15.5:0/2442966419 shutdown_connections 2024-08-18T22:29:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 1 -- 172.21.15.5:0/2442966419 wait complete. 2024-08-18T22:29:51.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8f06ed000 20 client.9162 trim_cache size 0 max 16384 2024-08-18T22:29:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:29:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:29:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "9565846e-c113-47df-89c6-898e8625e9ea", 2024-08-18T22:29:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:29:51.631 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:29:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 -- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8c40678c0 msgr2=0x7ff8c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8c40678c0 0x7ff8c4069d80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009b60 tx=0x7ff8d8009190 comp rx=0 tx=0).stop 2024-08-18T22:29:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 -- 172.21.15.5:0/3981257946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8070e10 msgr2=0x7ff8e8158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8070e10 0x7ff8e8158050 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00b0040 tx=0x7ff8d0019300 comp rx=0 tx=0).stop 2024-08-18T22:29:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 -- 172.21.15.5:0/3981257946 shutdown_connections 2024-08-18T22:29:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8c40678c0 0x7ff8c4069d80 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8e81619b0 0x7ff8e80b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8070e10 0x7ff8e8158050 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 --2- 172.21.15.5:0/3981257946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8e806ddd0 0x7ff8e8151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 -- 172.21.15.5:0/3981257946 >> 172.21.15.5:0/3981257946 conn(0x7ff8e80d2110 msgr2=0x7ff8e80cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 -- 172.21.15.5:0/3981257946 shutdown_connections 2024-08-18T22:29:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.630+0000 7ff8ed200640 1 -- 172.21.15.5:0/3981257946 wait complete. 2024-08-18T22:29:51.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:51.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub pause 2024-08-18T22:29:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.841+0000 7f1c65600640 1 Processor -- start 2024-08-18T22:29:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.841+0000 7f1c65600640 1 -- start start 2024-08-18T22:29:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.841+0000 7f1c65600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c6015b0c0 0x7f1c6006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c65600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c600cf290 0x7f1c600b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c65600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c600b31f0 con 0x7f1c600b40c0 2024-08-18T22:29:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c65600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1c600b4a70 con 0x7f1c600cf290 2024-08-18T22:29:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c65600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1c600b3d70 con 0x7f1c6015b0c0 2024-08-18T22:29:51.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c5f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c600cf290 0x7f1c600b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c5f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c600cf290 0x7f1c600b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35296/0 (socket says 172.21.15.5:35296) 2024-08-18T22:29:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c5f400640 1 -- 172.21.15.5:0/2814218935 learned_addr learned my addr 172.21.15.5:0/2814218935 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c5ea00640 1 --2- 172.21.15.5:0/2814218935 >> v2:172.21.15.117:3300/0 conn(0x7f1c6015b0c0 0x7f1c6006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c5f400640 1 -- 172.21.15.5:0/2814218935 >> v2:172.21.15.117:3300/0 conn(0x7f1c6015b0c0 msgr2=0x7f1c6006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c5f400640 1 --2- 172.21.15.5:0/2814218935 >> v2:172.21.15.117:3300/0 conn(0x7f1c6015b0c0 0x7f1c6006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c5f400640 1 -- 172.21.15.5:0/2814218935 >> v1:172.21.15.5:6789/0 conn(0x7f1c600b40c0 legacy=0x7f1c60072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c5f400640 1 -- 172.21.15.5:0/2814218935 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c600b34d0 con 0x7f1c600cf290 2024-08-18T22:29:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c5e000640 1 -- 172.21.15.5:0/2814218935 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978554633 0 0) 0x7f1c600b31f0 con 0x7f1c600b40c0 2024-08-18T22:29:51.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.845+0000 7f1c5f400640 1 --2- 172.21.15.5:0/2814218935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c600cf290 0x7f1c600b4530 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f1c60070ba0 tx=0x7f1c5801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea33726d8670de85 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c5e000640 1 -- 172.21.15.5:0/2814218935 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580a5760 con 0x7f1c600cf290 2024-08-18T22:29:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c5e000640 1 -- 172.21.15.5:0/2814218935 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c580a5900 con 0x7f1c600cf290 2024-08-18T22:29:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c5e000640 1 -- 172.21.15.5:0/2814218935 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580a5cd0 con 0x7f1c600cf290 2024-08-18T22:29:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 -- 172.21.15.5:0/2814218935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c600cf290 msgr2=0x7f1c600b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 --2- 172.21.15.5:0/2814218935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c600cf290 0x7f1c600b4530 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f1c60070ba0 tx=0x7f1c5801c8a0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 -- 172.21.15.5:0/2814218935 shutdown_connections 2024-08-18T22:29:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 --2- 172.21.15.5:0/2814218935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c600cf290 0x7f1c600b4530 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 --2- 172.21.15.5:0/2814218935 >> v2:172.21.15.117:3300/0 conn(0x7f1c6015b0c0 0x7f1c6006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 -- 172.21.15.5:0/2814218935 >> 172.21.15.5:0/2814218935 conn(0x7f1c600b1dc0 msgr2=0x7f1c600b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 -- 172.21.15.5:0/2814218935 shutdown_connections 2024-08-18T22:29:51.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 -- 172.21.15.5:0/2814218935 wait complete. 2024-08-18T22:29:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 Processor -- start 2024-08-18T22:29:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 -- start start 2024-08-18T22:29:51.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c600b40c0 0x7f1c60154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c600cf290 0x7f1c60157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6015b0c0 0x7f1c6015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6015b620 con 0x7f1c6015b0c0 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6015b4a0 con 0x7f1c600cf290 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c65600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c6006f670 con 0x7f1c600b40c0 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6015b0c0 0x7f1c6015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6015b0c0 0x7f1c6015bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35306/0 (socket says 172.21.15.5:35306) 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c5f400640 1 -- 172.21.15.5:0/1758361798 learned_addr learned my addr 172.21.15.5:0/1758361798 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c5ea00640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c600b40c0 0x7f1c60154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.849+0000 7f1c56000640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c600cf290 0x7f1c60157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c5f400640 1 -- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c600b40c0 msgr2=0x7f1c60154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c5f400640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c600b40c0 0x7f1c60154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c5f400640 1 -- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c600cf290 msgr2=0x7f1c60157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c5f400640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c600cf290 0x7f1c60157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c5f400640 1 -- 172.21.15.5:0/1758361798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c60157f40 con 0x7f1c6015b0c0 2024-08-18T22:29:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c5f400640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6015b0c0 0x7f1c6015bed0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f1c580194b0 tx=0x7f1c58019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c57400640 1 -- 172.21.15.5:0/1758361798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580bc030 con 0x7f1c6015b0c0 2024-08-18T22:29:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c57400640 1 -- 172.21.15.5:0/1758361798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c580b8470 con 0x7f1c6015b0c0 2024-08-18T22:29:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c57400640 1 -- 172.21.15.5:0/1758361798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58009510 con 0x7f1c6015b0c0 2024-08-18T22:29:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c65600640 1 -- 172.21.15.5:0/1758361798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c60158240 con 0x7f1c6015b0c0 2024-08-18T22:29:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c65600640 1 -- 172.21.15.5:0/1758361798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c601567b0 con 0x7f1c6015b0c0 2024-08-18T22:29:51.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c57400640 1 -- 172.21.15.5:0/1758361798 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c580bf070 con 0x7f1c6015b0c0 2024-08-18T22:29:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c57400640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c3c0678c0 0x7f1c3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c57400640 1 -- 172.21.15.5:0/1758361798 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f1c58120d50 con 0x7f1c6015b0c0 2024-08-18T22:29:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.853+0000 7f1c5ea00640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c3c0678c0 0x7f1c3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 Processor -- start 2024-08-18T22:29:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 -- start start 2024-08-18T22:29:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c5ea00640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c3c0678c0 0x7f1c3c069d80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1c60155c40 tx=0x7f1c50009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dc2df70 0x55dd6dc2e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dbe1b70 0x55dd6dbe1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dd6da32470 con 0x55dd6dbe1b70 2024-08-18T22:29:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dd6d9ecad0 con 0x55dd6dc2e890 2024-08-18T22:29:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dd6da2e430 con 0x55dd6dc2df70 2024-08-18T22:29:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dbe1b70 0x55dd6dbe1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c5ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dc2df70 0x55dd6dc2e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dbe1b70 0x55dd6dbe1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35314/0 (socket says 172.21.15.5:35314) 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c5f400640 1 -- 172.21.15.5:0/2111276115 learned_addr learned my addr 172.21.15.5:0/2111276115 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c56000640 1 --2- 172.21.15.5:0/2111276115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c5f400640 1 -- 172.21.15.5:0/2111276115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dc2df70 msgr2=0x55dd6dc2e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c5f400640 1 --2- 172.21.15.5:0/2111276115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dc2df70 0x55dd6dc2e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c5f400640 1 -- 172.21.15.5:0/2111276115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2e890 msgr2=0x55dd6dbe1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c5f400640 1 --2- 172.21.15.5:0/2111276115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c5f400640 1 -- 172.21.15.5:0/2111276115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6d9d2a10 con 0x55dd6dbe1b70 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c5f400640 1 --2- 172.21.15.5:0/2111276115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dbe1b70 0x55dd6dbe1f50 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f1c580ed620 tx=0x7f1c580b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ba96213ac3f507 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c4f400640 1 -- 172.21.15.5:0/2111276115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580f9cf0 con 0x55dd6dbe1b70 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c4f400640 1 -- 172.21.15.5:0/2111276115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c580ef4c0 con 0x55dd6dbe1b70 2024-08-18T22:29:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c4f400640 1 -- 172.21.15.5:0/2111276115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580ed830 con 0x55dd6dbe1b70 2024-08-18T22:29:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 -- 172.21.15.5:0/2111276115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dbe1b70 msgr2=0x55dd6dbe1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/2111276115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dbe1b70 0x55dd6dbe1f50 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f1c580ed620 tx=0x7f1c580b8000 comp rx=0 tx=0).stop 2024-08-18T22:29:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 -- 172.21.15.5:0/2111276115 shutdown_connections 2024-08-18T22:29:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/2111276115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dbe1b70 0x55dd6dbe1f50 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/2111276115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/2111276115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dc2df70 0x55dd6dc2e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 -- 172.21.15.5:0/2111276115 >> 172.21.15.5:0/2111276115 conn(0x55dd6dbdb680 msgr2=0x55dd6dc10df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 -- 172.21.15.5:0/2111276115 shutdown_connections 2024-08-18T22:29:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 -- 172.21.15.5:0/2111276115 wait complete. 2024-08-18T22:29:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.857+0000 7f1c68bc1000 1 -- start start 2024-08-18T22:29:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 1 Processor -- start 2024-08-18T22:29:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dc0e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2df70 0x55dd6dbe7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dd6d9fd770 con 0x55dd6dc2e890 2024-08-18T22:29:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dd6d9d3c80 con 0x55dd6dc2df70 2024-08-18T22:29:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dd6dab3130 con 0x55dd6dbe1b70 2024-08-18T22:29:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 10 client.0 _ll_register_callbacks cb 0x55dd6dbcf0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35320/0 (socket says 172.21.15.5:35320) 2024-08-18T22:29:51.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5f400640 1 -- 172.21.15.5:0/3352651057 learned_addr learned my addr 172.21.15.5:0/3352651057 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5ea00640 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dc0e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c56000640 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2df70 0x55dd6dbe7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5f400640 1 -- 172.21.15.5:0/3352651057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 msgr2=0x55dd6dc0e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5f400640 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dc0e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5f400640 1 -- 172.21.15.5:0/3352651057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2df70 msgr2=0x55dd6dbe7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5f400640 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2df70 0x55dd6dbe7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5f400640 1 -- 172.21.15.5:0/3352651057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd6d9eafe0 con 0x55dd6dc2e890 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5f400640 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe8340 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f1c5801c8e0 tx=0x7f1c58009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9da935812976b44 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c43e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c43e00640 1 -- 172.21.15.5:0/3352651057 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580f1620 con 0x55dd6dc2e890 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c43e00640 1 -- 172.21.15.5:0/3352651057 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f1c580f9860 con 0x55dd6dc2e890 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 1 -- 172.21.15.5:0/3352651057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c580ef4c0 con 0x55dd6dc2e890 2024-08-18T22:29:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c43e00640 1 -- 172.21.15.5:0/3352651057 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f1c580f9cf0 con 0x55dd6dc2e890 2024-08-18T22:29:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 10 client.9177 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 1 -- 172.21.15.5:0/3352651057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55dd6d9feed0 con 0x55dd6dc2e890 2024-08-18T22:29:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c43e00640 1 -- 172.21.15.5:0/3352651057 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c580ef4c0 con 0x55dd6dc2e890 2024-08-18T22:29:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c43e00640 1 -- 172.21.15.5:0/3352651057 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7f1c580c9060 con 0x55dd6dc2e890 2024-08-18T22:29:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 10 client.9177 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 10 client.9177 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 20 client.9177 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55dd6dbe90b0 0x55dd6dc40020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 4 client.9177 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:29:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c68bc1000 1 -- 172.21.15.5:0/3352651057 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd6d9ccd90 con 0x55dd6dbe90b0 2024-08-18T22:29:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5ea00640 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55dd6dbe90b0 0x55dd6dc40020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c5ea00640 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55dd6dbe90b0 0x55dd6dc40020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a83d9a7027eb24e server_cookie=1f8315492fc925b9 in_seq=0 out_seq=0 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.861+0000 7f1c43e00640 10 client.9177 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c43e00640 1 -- 172.21.15.5:0/3352651057 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd6d9ccd90 con 0x55dd6dbe90b0 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c43e00640 10 client.9177 handle_command_reply: tid=0 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 1 client.9177 shutdown 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 1 -- 172.21.15.5:0/3352651057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 msgr2=0x55dd6dbe8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe8340 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f1c5801c8e0 tx=0x7f1c58009810 comp rx=0 tx=0).stop 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 1 -- 172.21.15.5:0/3352651057 shutdown_connections 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55dd6dbe90b0 0x55dd6dc40020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe8340 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2df70 0x55dd6dbe7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/3352651057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dc0e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c43e00640 0 client.9177 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 1 -- 172.21.15.5:0/3352651057 >> 172.21.15.5:0/3352651057 conn(0x55dd6dbdb680 msgr2=0x55dd6dc10df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 1 -- 172.21.15.5:0/3352651057 shutdown_connections 2024-08-18T22:29:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 1 -- 172.21.15.5:0/3352651057 wait complete. 2024-08-18T22:29:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.865+0000 7f1c68bc1000 20 client.9177 trim_cache size 0 max 16384 2024-08-18T22:29:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c68bc1000 1 Processor -- start 2024-08-18T22:29:51.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c68bc1000 1 -- start start 2024-08-18T22:29:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dbe6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2df70 0x55dd6dbe72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1c60203a90 con 0x55dd6dc2df70 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c60202ac0 con 0x55dd6dc2e890 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c60152970 con 0x55dd6dbe1b70 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c56000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2df70 0x55dd6dbe72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c56000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2df70 0x55dd6dbe72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35328/0 (socket says 172.21.15.5:35328) 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c56000640 1 -- 172.21.15.5:0/139027764 learned_addr learned my addr 172.21.15.5:0/139027764 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c5ea00640 1 --2- 172.21.15.5:0/139027764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dbe6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.881+0000 7f1c5f400640 1 --2- 172.21.15.5:0/139027764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c56000640 1 -- 172.21.15.5:0/139027764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 msgr2=0x55dd6dbe6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c56000640 1 --2- 172.21.15.5:0/139027764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dbe6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c56000640 1 -- 172.21.15.5:0/139027764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2e890 msgr2=0x55dd6dbe7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c56000640 1 --2- 172.21.15.5:0/139027764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c56000640 1 -- 172.21.15.5:0/139027764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6dab35c0 con 0x55dd6dc2df70 2024-08-18T22:29:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c56000640 1 --2- 172.21.15.5:0/139027764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2df70 0x55dd6dbe72f0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f1c48001800 tx=0x7f1c48007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d8a258a3b4ea49 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c4ea00640 1 -- 172.21.15.5:0/139027764 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480053a0 con 0x55dd6dc2df70 2024-08-18T22:29:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c4ea00640 1 -- 172.21.15.5:0/139027764 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4801a030 con 0x55dd6dc2df70 2024-08-18T22:29:51.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c4ea00640 1 -- 172.21.15.5:0/139027764 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48015b90 con 0x55dd6dc2df70 2024-08-18T22:29:51.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 -- 172.21.15.5:0/139027764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2df70 msgr2=0x55dd6dbe72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/139027764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2df70 0x55dd6dbe72f0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f1c48001800 tx=0x7f1c48007dc0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 -- 172.21.15.5:0/139027764 shutdown_connections 2024-08-18T22:29:51.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/139027764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2e890 0x55dd6dbe7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/139027764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2df70 0x55dd6dbe72f0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/139027764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dbe6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 -- 172.21.15.5:0/139027764 >> 172.21.15.5:0/139027764 conn(0x55dd6dbdb680 msgr2=0x55dd6dc3b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 -- 172.21.15.5:0/139027764 shutdown_connections 2024-08-18T22:29:51.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 -- 172.21.15.5:0/139027764 wait complete. 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 -- start start 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 Processor -- start 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dca1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2df70 0x55dd6dca18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dca1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dd6d9d9a10 con 0x55dd6dc2e890 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c601fb140 con 0x55dd6dc2df70 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55dd6da31780 con 0x55dd6dbe1b70 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c68bc1000 10 client.0 _ll_register_callbacks cb 0x7f1c48001250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dca1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c5f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dca1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35334/0 (socket says 172.21.15.5:35334) 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c5f400640 1 -- 172.21.15.5:0/1836574882 learned_addr learned my addr 172.21.15.5:0/1836574882 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c56000640 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2df70 0x55dd6dca18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c5ea00640 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dca1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c5f400640 1 -- 172.21.15.5:0/1836574882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 msgr2=0x55dd6dca1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c5f400640 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dca1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c5f400640 1 -- 172.21.15.5:0/1836574882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2df70 msgr2=0x55dd6dca18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c5f400640 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2df70 0x55dd6dca18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.885+0000 7f1c5f400640 1 -- 172.21.15.5:0/1836574882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd6d9c5c50 con 0x55dd6dc2e890 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c5f400640 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dca1e10 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f1c580f1380 tx=0x7f1c58009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd669a7a40c954e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c43e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c43e00640 1 -- 172.21.15.5:0/1836574882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580f0d00 con 0x55dd6dc2e890 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c43e00640 1 -- 172.21.15.5:0/1836574882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f1c580f0810 con 0x55dd6dc2e890 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 -- 172.21.15.5:0/1836574882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c4801a030 con 0x55dd6dc2e890 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c43e00640 1 -- 172.21.15.5:0/1836574882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f1c580ecf10 con 0x55dd6dc2e890 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 10 client.9183 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 -- 172.21.15.5:0/1836574882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55dd6d9d82a0 con 0x55dd6dc2e890 2024-08-18T22:29:51.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c43e00640 1 -- 172.21.15.5:0/1836574882 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4801a030 con 0x55dd6dc2e890 2024-08-18T22:29:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c43e00640 1 -- 172.21.15.5:0/1836574882 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7f1c580ed0b0 con 0x55dd6dc2e890 2024-08-18T22:29:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 10 client.9183 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 10 client.9183 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 20 client.9183 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55dd6dc41fd0 0x55dd6dc423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 4 client.9183 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-08-18T22:29:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 -- 172.21.15.5:0/1836574882 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55dd6da3fba0 con 0x55dd6dc41fd0 2024-08-18T22:29:51.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c5ea00640 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55dd6dc41fd0 0x55dd6dc423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:51.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c5ea00640 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55dd6dc41fd0 0x55dd6dc423e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb94943dc0d4b70 server_cookie=58204ba5000cadb0 in_seq=0 out_seq=0 2024-08-18T22:29:51.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c43e00640 10 client.9183 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:51.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c43e00640 1 -- 172.21.15.5:0/1836574882 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dd6da3fba0 con 0x55dd6dc41fd0 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c43e00640 10 client.9183 handle_command_reply: tid=0 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 client.9183 shutdown 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 -- 172.21.15.5:0/1836574882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 msgr2=0x55dd6dca1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dca1e10 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f1c580f1380 tx=0x7f1c58009040 comp rx=0 tx=0).stop 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 -- 172.21.15.5:0/1836574882 shutdown_connections 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55dd6dc41fd0 0x55dd6dc423e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dd6dc2e890 0x55dd6dca1e10 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dd6dc2df70 0x55dd6dca18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 --2- 172.21.15.5:0/1836574882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55dd6dbe1b70 0x55dd6dca1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 -- 172.21.15.5:0/1836574882 >> 172.21.15.5:0/1836574882 conn(0x55dd6dbdb680 msgr2=0x55dd6dbdfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c43e00640 0 client.9183 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 -- 172.21.15.5:0/1836574882 shutdown_connections 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 1 -- 172.21.15.5:0/1836574882 wait complete. 2024-08-18T22:29:51.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c68bc1000 20 client.9183 trim_cache size 0 max 16384 2024-08-18T22:29:51.893 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:29:51.893 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:29:51.893 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:29:51.893 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 -- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c3c0678c0 msgr2=0x7f1c3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c3c0678c0 0x7f1c3c069d80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1c60155c40 tx=0x7f1c50009190 comp rx=0 tx=0).stop 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 -- 172.21.15.5:0/1758361798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6015b0c0 msgr2=0x7f1c6015bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6015b0c0 0x7f1c6015bed0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f1c580194b0 tx=0x7f1c58019640 comp rx=0 tx=0).stop 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 -- 172.21.15.5:0/1758361798 shutdown_connections 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c3c0678c0 0x7f1c3c069d80 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c6015b0c0 0x7f1c6015bed0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c600cf290 0x7f1c60157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 --2- 172.21.15.5:0/1758361798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c600b40c0 0x7f1c60154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 -- 172.21.15.5:0/1758361798 >> 172.21.15.5:0/1758361798 conn(0x7f1c600b1dc0 msgr2=0x7f1c600cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 -- 172.21.15.5:0/1758361798 shutdown_connections 2024-08-18T22:29:51.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:51.889+0000 7f1c65600640 1 -- 172.21.15.5:0/1758361798 wait complete. 2024-08-18T22:29:51.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:51.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-08-18T22:29:52.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f496be00640 1 Processor -- start 2024-08-18T22:29:52.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f496be00640 1 -- start start 2024-08-18T22:29:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f496be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f496415fb80 0x7f49640d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f496be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49640b5ad0 0x7f496406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f496be00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4964071550 0x7f496409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f496be00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f49640d1eb0 con 0x7f496415fb80 2024-08-18T22:29:52.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f496be00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f49640d30b0 con 0x7f4964071550 2024-08-18T22:29:52.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f496be00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49640d1bd0 con 0x7f49640b5ad0 2024-08-18T22:29:52.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f4969400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f496415fb80 0x7f49640d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f4969400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f496415fb80 0x7f49640d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35348/0 (socket says 172.21.15.5:35348) 2024-08-18T22:29:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f4969400640 1 -- 172.21.15.5:0/2770594959 learned_addr learned my addr 172.21.15.5:0/2770594959 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f4968a00640 1 --2- 172.21.15.5:0/2770594959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49640b5ad0 0x7f496406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f4969e00640 1 --2- 172.21.15.5:0/2770594959 >> v2:172.21.15.117:3300/0 conn(0x7f4964071550 0x7f496409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f4969400640 1 -- 172.21.15.5:0/2770594959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49640b5ad0 msgr2=0x7f496406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f4969400640 1 --2- 172.21.15.5:0/2770594959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49640b5ad0 0x7f496406fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f4969400640 1 -- 172.21.15.5:0/2770594959 >> v2:172.21.15.117:3300/0 conn(0x7f4964071550 msgr2=0x7f496409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f4969400640 1 --2- 172.21.15.5:0/2770594959 >> v2:172.21.15.117:3300/0 conn(0x7f4964071550 0x7f496409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f4969400640 1 -- 172.21.15.5:0/2770594959 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49640d2dd0 con 0x7f496415fb80 2024-08-18T22:29:52.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.053+0000 7f4969e00640 1 --2- 172.21.15.5:0/2770594959 >> v2:172.21.15.117:3300/0 conn(0x7f4964071550 0x7f496409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f4969400640 1 --2- 172.21.15.5:0/2770594959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f496415fb80 0x7f49640d15e0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f4964075dd0 tx=0x7f495801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ab5a7be8d75bc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f4963e00640 1 -- 172.21.15.5:0/2770594959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49580a5550 con 0x7f496415fb80 2024-08-18T22:29:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f4963e00640 1 -- 172.21.15.5:0/2770594959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49580a56f0 con 0x7f496415fb80 2024-08-18T22:29:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f4963e00640 1 -- 172.21.15.5:0/2770594959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49580a5ac0 con 0x7f496415fb80 2024-08-18T22:29:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f496be00640 1 -- 172.21.15.5:0/2770594959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f496415fb80 msgr2=0x7f49640d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f496be00640 1 --2- 172.21.15.5:0/2770594959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f496415fb80 0x7f49640d15e0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f4964075dd0 tx=0x7f495801c8d0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f496be00640 1 -- 172.21.15.5:0/2770594959 shutdown_connections 2024-08-18T22:29:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f496be00640 1 --2- 172.21.15.5:0/2770594959 >> v2:172.21.15.117:3300/0 conn(0x7f4964071550 0x7f496409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f496be00640 1 --2- 172.21.15.5:0/2770594959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49640b5ad0 0x7f496406fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f496be00640 1 --2- 172.21.15.5:0/2770594959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f496415fb80 0x7f49640d15e0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f496be00640 1 -- 172.21.15.5:0/2770594959 >> 172.21.15.5:0/2770594959 conn(0x7f49640d2180 msgr2=0x7f49640d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f496be00640 1 -- 172.21.15.5:0/2770594959 shutdown_connections 2024-08-18T22:29:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.057+0000 7f496be00640 1 -- 172.21.15.5:0/2770594959 wait complete. 2024-08-18T22:29:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f496be00640 1 Processor -- start 2024-08-18T22:29:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f496be00640 1 -- start start 2024-08-18T22:29:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f496be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4964071550 0x7f4964152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f496be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49640b5ad0 0x7f49640b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f496be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f496415fb80 0x7f49640b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f496be00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49640d0890 con 0x7f49640b5ad0 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f496be00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f496409b390 con 0x7f4964071550 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f496be00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49640d0a10 con 0x7f496415fb80 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4968a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49640b5ad0 0x7f49640b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4968a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49640b5ad0 0x7f49640b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35350/0 (socket says 172.21.15.5:35350) 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4968a00640 1 -- 172.21.15.5:0/940287946 learned_addr learned my addr 172.21.15.5:0/940287946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4969400640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4964071550 0x7f4964152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4969e00640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f496415fb80 0x7f49640b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4968a00640 1 -- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f496415fb80 msgr2=0x7f49640b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4968a00640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f496415fb80 0x7f49640b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4968a00640 1 -- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4964071550 msgr2=0x7f4964152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4968a00640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4964071550 0x7f4964152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4968a00640 1 -- 172.21.15.5:0/940287946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4964153e00 con 0x7f49640b5ad0 2024-08-18T22:29:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4968a00640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49640b5ad0 0x7f49640b2250 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f495000e900 tx=0x7f495000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4961600640 1 -- 172.21.15.5:0/940287946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950017070 con 0x7f49640b5ad0 2024-08-18T22:29:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4961600640 1 -- 172.21.15.5:0/940287946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495000ca00 con 0x7f49640b5ad0 2024-08-18T22:29:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f4961600640 1 -- 172.21.15.5:0/940287946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495000cdd0 con 0x7f49640b5ad0 2024-08-18T22:29:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f496be00640 1 -- 172.21.15.5:0/940287946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49641540e0 con 0x7f49640b5ad0 2024-08-18T22:29:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.061+0000 7f496be00640 1 -- 172.21.15.5:0/940287946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49641546a0 con 0x7f49640b5ad0 2024-08-18T22:29:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4961600640 1 -- 172.21.15.5:0/940287946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f495001a070 con 0x7f49640b5ad0 2024-08-18T22:29:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4961600640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49440678c0 0x7f4944069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4961600640 1 -- 172.21.15.5:0/940287946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f49500861f0 con 0x7f49640b5ad0 2024-08-18T22:29:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4969400640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49440678c0 0x7f4944069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f496f319000 1 Processor -- start 2024-08-18T22:29:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f496f319000 1 -- start start 2024-08-18T22:29:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4969400640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49440678c0 0x7f4944069d80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f49580ae000 tx=0x7f49580a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f496f319000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1aaad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f496f319000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1a5dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f496f319000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1a5e500 0x5560e1a5e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f496f319000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5560e1947ae0 con 0x5560e1aaa9a0 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f496f319000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5560e1933ba0 con 0x5560e1a5e500 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f496f319000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5560e18ae4f0 con 0x5560e1aab2c0 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4969400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1aaad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4968a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1a5dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4969400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1aaad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35356/0 (socket says 172.21.15.5:35356) 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4969400640 1 -- 172.21.15.5:0/1833473546 learned_addr learned my addr 172.21.15.5:0/1833473546 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4968a00640 1 --2- 172.21.15.5:0/1833473546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1a5dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:49428/0 (socket says 172.21.15.5:49428) 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4969e00640 1 --2- 172.21.15.5:0/1833473546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1a5e500 0x5560e1a5e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4968a00640 1 -- 172.21.15.5:0/1833473546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1a5e500 msgr2=0x5560e1a5e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4968a00640 1 --2- 172.21.15.5:0/1833473546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1a5e500 0x5560e1a5e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4968a00640 1 -- 172.21.15.5:0/1833473546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 msgr2=0x5560e1aaad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4968a00640 1 --2- 172.21.15.5:0/1833473546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1aaad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4968a00640 1 -- 172.21.15.5:0/1833473546 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e184ea90 con 0x5560e1aab2c0 2024-08-18T22:29:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4969400640 1 --2- 172.21.15.5:0/1833473546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1aaad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4968a00640 1 --2- 172.21.15.5:0/1833473546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1a5dfc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f495000c520 tx=0x7f49500565f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd8a5e4e5844e1ed server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4956000640 1 -- 172.21.15.5:0/1833473546 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950021040 con 0x5560e1aab2c0 2024-08-18T22:29:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4956000640 1 -- 172.21.15.5:0/1833473546 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495007de50 con 0x5560e1aab2c0 2024-08-18T22:29:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.065+0000 7f4956000640 1 -- 172.21.15.5:0/1833473546 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950052b20 con 0x5560e1aab2c0 2024-08-18T22:29:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 -- 172.21.15.5:0/1833473546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 msgr2=0x5560e1a5dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 --2- 172.21.15.5:0/1833473546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1a5dfc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f495000c520 tx=0x7f49500565f0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 -- 172.21.15.5:0/1833473546 shutdown_connections 2024-08-18T22:29:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 --2- 172.21.15.5:0/1833473546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1a5e500 0x5560e1a5e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 --2- 172.21.15.5:0/1833473546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1a5dfc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 --2- 172.21.15.5:0/1833473546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1aaad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 -- 172.21.15.5:0/1833473546 >> 172.21.15.5:0/1833473546 conn(0x5560e1a58010 msgr2=0x5560e1a8d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 -- 172.21.15.5:0/1833473546 shutdown_connections 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 -- 172.21.15.5:0/1833473546 wait complete. 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 -- start start 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 Processor -- start 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1a5e500 0x5560e1a8b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1a660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1a665f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5560e18aa4b0 con 0x5560e1aaa9a0 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5560e1868b50 con 0x5560e1a5e500 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5560e184fd00 con 0x5560e1aab2c0 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 10 client.0 _ll_register_callbacks cb 0x5560e1a4bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4968a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1a660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4969400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1a5e500 0x5560e1a8b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4968a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1a660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35372/0 (socket says 172.21.15.5:35372) 2024-08-18T22:29:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4968a00640 1 -- 172.21.15.5:0/2420901799 learned_addr learned my addr 172.21.15.5:0/2420901799 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4969e00640 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1a665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4969400640 1 -- 172.21.15.5:0/2420901799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 msgr2=0x5560e1a665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4969400640 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1a665f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4969400640 1 -- 172.21.15.5:0/2420901799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 msgr2=0x5560e1a660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4969400640 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1a660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4969400640 1 -- 172.21.15.5:0/2420901799 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560e1867060 con 0x5560e1a5e500 2024-08-18T22:29:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4968a00640 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1a660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f4969400640 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1a5e500 0x5560e1a8b040 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f495801d170 tx=0x7f495801b110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4fa49a1240a167d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f494aa00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-08-18T22:29:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f494aa00640 1 -- 172.21.15.5:0/2420901799 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49580cc670 con 0x5560e1a5e500 2024-08-18T22:29:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f494aa00640 1 -- 172.21.15.5:0/2420901799 <== mon.1 v2:172.21.15.117:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f49580cc810 con 0x5560e1a5e500 2024-08-18T22:29:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f496f319000 1 -- 172.21.15.5:0/2420901799 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f495007de50 con 0x5560e1a5e500 2024-08-18T22:29:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.069+0000 7f494aa00640 1 -- 172.21.15.5:0/2420901799 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f49580cca10 con 0x5560e1a5e500 2024-08-18T22:29:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 10 client.8461 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 -- 172.21.15.5:0/2420901799 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x5560e187af50 con 0x5560e1a5e500 2024-08-18T22:29:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f494aa00640 1 -- 172.21.15.5:0/2420901799 <== mon.1 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495007de50 con 0x5560e1a5e500 2024-08-18T22:29:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f494aa00640 1 -- 172.21.15.5:0/2420901799 <== mon.1 v2:172.21.15.117:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7f4958008030 con 0x5560e1a5e500 2024-08-18T22:29:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 10 client.8461 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 10 client.8461 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 20 client.8461 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x5560e1a8d060 0x5560e1abcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 4 client.8461 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 -- 172.21.15.5:0/2420901799 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560e1848e10 con 0x5560e1a8d060 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f4968a00640 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x5560e1a8d060 0x5560e1abcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f4968a00640 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x5560e1a8d060 0x5560e1abcc60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0e3edff44af4cfe server_cookie=1d2c0278f3fd018d in_seq=0 out_seq=0 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f494aa00640 10 client.8461 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f494aa00640 1 -- 172.21.15.5:0/2420901799 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560e1848e10 con 0x5560e1a8d060 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f494aa00640 10 client.8461 handle_command_reply: tid=0 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 client.8461 shutdown 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 -- 172.21.15.5:0/2420901799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1a5e500 msgr2=0x5560e1a8b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1a5e500 0x5560e1a8b040 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f495801d170 tx=0x7f495801b110 comp rx=0 tx=0).stop 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 -- 172.21.15.5:0/2420901799 shutdown_connections 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1a665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x5560e1a8d060 0x5560e1abcc60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1a660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 --2- 172.21.15.5:0/2420901799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1a5e500 0x5560e1a8b040 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f494aa00640 0 client.8461 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 -- 172.21.15.5:0/2420901799 >> 172.21.15.5:0/2420901799 conn(0x5560e1a58010 msgr2=0x5560e1a5d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 -- 172.21.15.5:0/2420901799 shutdown_connections 2024-08-18T22:29:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 1 -- 172.21.15.5:0/2420901799 wait complete. 2024-08-18T22:29:52.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.073+0000 7f496f319000 20 client.8461 trim_cache size 0 max 16384 2024-08-18T22:29:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 Processor -- start 2024-08-18T22:29:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 -- start start 2024-08-18T22:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1a5e500 0x5560e1b1a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1b1a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aab2c0 0x5560e1b1adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49642046b0 con 0x5560e1aaa9a0 2024-08-18T22:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f49642036d0 con 0x5560e1aab2c0 2024-08-18T22:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f496409e480 con 0x5560e1a5e500 2024-08-18T22:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4968a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1b1a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4968a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1b1a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35378/0 (socket says 172.21.15.5:35378) 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4968a00640 1 -- 172.21.15.5:0/3225199897 learned_addr learned my addr 172.21.15.5:0/3225199897 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4968a00640 1 -- 172.21.15.5:0/3225199897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1a5e500 msgr2=0x5560e1b1a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4969e00640 1 --2- 172.21.15.5:0/3225199897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aab2c0 0x5560e1b1adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4968a00640 1 --2- 172.21.15.5:0/3225199897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1a5e500 0x5560e1b1a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4968a00640 1 -- 172.21.15.5:0/3225199897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aab2c0 msgr2=0x5560e1b1adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4968a00640 1 --2- 172.21.15.5:0/3225199897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aab2c0 0x5560e1b1adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4968a00640 1 -- 172.21.15.5:0/3225199897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e1930dd0 con 0x5560e1aaa9a0 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4969e00640 1 --2- 172.21.15.5:0/3225199897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aab2c0 0x5560e1b1adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4968a00640 1 --2- 172.21.15.5:0/3225199897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1b1a880 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f495000c520 tx=0x7f4950086000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79142cfc530378d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4955600640 1 -- 172.21.15.5:0/3225199897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950021040 con 0x5560e1aaa9a0 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4955600640 1 -- 172.21.15.5:0/3225199897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495007de50 con 0x5560e1aaa9a0 2024-08-18T22:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f4955600640 1 -- 172.21.15.5:0/3225199897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495006e3e0 con 0x5560e1aaa9a0 2024-08-18T22:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 -- 172.21.15.5:0/3225199897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 msgr2=0x5560e1b1a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 --2- 172.21.15.5:0/3225199897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1b1a880 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f495000c520 tx=0x7f4950086000 comp rx=0 tx=0).stop 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 -- 172.21.15.5:0/3225199897 shutdown_connections 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 --2- 172.21.15.5:0/3225199897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aab2c0 0x5560e1b1adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 --2- 172.21.15.5:0/3225199897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1aaa9a0 0x5560e1b1a880 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 --2- 172.21.15.5:0/3225199897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1a5e500 0x5560e1b1a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 -- 172.21.15.5:0/3225199897 >> 172.21.15.5:0/3225199897 conn(0x5560e1a58010 msgr2=0x5560e1ab8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 -- 172.21.15.5:0/3225199897 shutdown_connections 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 -- 172.21.15.5:0/3225199897 wait complete. 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 -- start start 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.093+0000 7f496f319000 1 Processor -- start 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1a5e500 0x5560e1b1e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aaa9a0 0x5560e1b1e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1b1ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4964203080 con 0x5560e1a5e500 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5560e196b240 con 0x5560e1aaa9a0 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5560e18ad800 con 0x5560e1aab2c0 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 10 client.0 _ll_register_callbacks cb 0x7f4958009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4969400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1a5e500 0x5560e1b1e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4969400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1a5e500 0x5560e1b1e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35394/0 (socket says 172.21.15.5:35394) 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4969400640 1 -- 172.21.15.5:0/2493589818 learned_addr learned my addr 172.21.15.5:0/2493589818 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4969e00640 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1b1ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4968a00640 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aaa9a0 0x5560e1b1e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4969400640 1 -- 172.21.15.5:0/2493589818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 msgr2=0x5560e1b1ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4969400640 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1b1ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4969400640 1 -- 172.21.15.5:0/2493589818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aaa9a0 msgr2=0x5560e1b1e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4969400640 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aaa9a0 0x5560e1b1e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4969400640 1 -- 172.21.15.5:0/2493589818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560e1841cd0 con 0x5560e1a5e500 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4968a00640 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aaa9a0 0x5560e1b1e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4969400640 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1a5e500 0x5560e1b1e1e0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f4958004a90 tx=0x7f4958019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ff2a94108e6d1b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f494aa00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f494aa00640 1 -- 172.21.15.5:0/2493589818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49580dc070 con 0x5560e1a5e500 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f494aa00640 1 -- 172.21.15.5:0/2493589818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f49580c37d0 con 0x5560e1a5e500 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 -- 172.21.15.5:0/2493589818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f495007de50 con 0x5560e1a5e500 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f494aa00640 1 -- 172.21.15.5:0/2493589818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f49580c39d0 con 0x5560e1a5e500 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 10 client.9201 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 -- 172.21.15.5:0/2493589818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x5560e1854320 con 0x5560e1a5e500 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f494aa00640 1 -- 172.21.15.5:0/2493589818 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495007de50 con 0x5560e1a5e500 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f494aa00640 1 -- 172.21.15.5:0/2493589818 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7f4958008040 con 0x5560e1a5e500 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 10 client.9201 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 10 client.9201 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 20 client.9201 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x5560e1abf5a0 0x5560e1abf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 4 client.9201 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:29:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 -- 172.21.15.5:0/2493589818 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5560e18bbc20 con 0x5560e1abf5a0 2024-08-18T22:29:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4968a00640 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x5560e1abf5a0 0x5560e1abf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f4968a00640 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x5560e1abf5a0 0x5560e1abf9b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76d5a5582d5fd739 server_cookie=b6dd19237fc93786 in_seq=0 out_seq=0 2024-08-18T22:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f494aa00640 10 client.9201 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f494aa00640 1 -- 172.21.15.5:0/2493589818 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x5560e18bbc20 con 0x5560e1abf5a0 2024-08-18T22:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f494aa00640 10 client.9201 handle_command_reply: tid=0 2024-08-18T22:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 client.9201 shutdown 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 -- 172.21.15.5:0/2493589818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1a5e500 msgr2=0x5560e1b1e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1a5e500 0x5560e1b1e1e0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f4958004a90 tx=0x7f4958019670 comp rx=0 tx=0).stop 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 -- 172.21.15.5:0/2493589818 shutdown_connections 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5560e1aab2c0 0x5560e1b1ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5560e1aaa9a0 0x5560e1b1e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x5560e1abf5a0 0x5560e1abf9b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 --2- 172.21.15.5:0/2493589818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5560e1a5e500 0x5560e1b1e1e0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f494aa00640 0 client.9201 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.097+0000 7f496f319000 1 -- 172.21.15.5:0/2493589818 >> 172.21.15.5:0/2493589818 conn(0x5560e1a58010 msgr2=0x5560e1a8b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496f319000 1 -- 172.21.15.5:0/2493589818 shutdown_connections 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496f319000 1 -- 172.21.15.5:0/2493589818 wait complete. 2024-08-18T22:29:52.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496f319000 20 client.9201 trim_cache size 0 max 16384 2024-08-18T22:29:52.103 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:29:52.103 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-08-18T22:29:52.103 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-18T22:29:52.103 INFO:teuthology.orchestra.run.smithi005.stdout: "9565846e-c113-47df-89c6-898e8625e9ea": { 2024-08-18T22:29:52.103 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_control_test_path", 2024-08-18T22:29:52.103 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "9565846e-c113-47df-89c6-898e8625e9ea", 2024-08-18T22:29:52.103 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive" 2024-08-18T22:29:52.103 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:52.103 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:29:52.103 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:29:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 -- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49440678c0 msgr2=0x7f4944069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49440678c0 0x7f4944069d80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f49580ae000 tx=0x7f49580a7070 comp rx=0 tx=0).stop 2024-08-18T22:29:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 -- 172.21.15.5:0/940287946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49640b5ad0 msgr2=0x7f49640b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49640b5ad0 0x7f49640b2250 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f495000e900 tx=0x7f495000edc0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 -- 172.21.15.5:0/940287946 shutdown_connections 2024-08-18T22:29:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49440678c0 0x7f4944069d80 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f496415fb80 0x7f49640b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49640b5ad0 0x7f49640b2250 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 --2- 172.21.15.5:0/940287946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4964071550 0x7f4964152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 -- 172.21.15.5:0/940287946 >> 172.21.15.5:0/940287946 conn(0x7f49640d2180 msgr2=0x7f4964156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 -- 172.21.15.5:0/940287946 shutdown_connections 2024-08-18T22:29:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.101+0000 7f496be00640 1 -- 172.21.15.5:0/940287946 wait complete. 2024-08-18T22:29:52.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba3e800640 1 Processor -- start 2024-08-18T22:29:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba3e800640 1 -- start start 2024-08-18T22:29:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba3e800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba38070730 0x7fba38070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba3e800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba38070430 con 0x7fba38161960 2024-08-18T22:29:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba3e800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3815eb60 con 0x7fba3815dda0 2024-08-18T22:29:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba3e800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fba3815fcc0 con 0x7fba38070730 2024-08-18T22:29:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba37400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fba38161960 0x7fba3806fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58402/0 (socket says 172.21.15.5:58402) 2024-08-18T22:29:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba37400640 1 -- 172.21.15.5:0/1781950036 learned_addr learned my addr 172.21.15.5:0/1781950036 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba2ea00640 1 --2- 172.21.15.5:0/1781950036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba38070730 0x7fba38070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba36a00640 1 -- 172.21.15.5:0/1781950036 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125950355 0 0) 0x7fba3815eb60 con 0x7fba3815dda0 2024-08-18T22:29:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba36a00640 1 -- 172.21.15.5:0/1781950036 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba1c003530 con 0x7fba3815dda0 2024-08-18T22:29:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba36a00640 1 -- 172.21.15.5:0/1781950036 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452749860 0 0) 0x7fba38070430 con 0x7fba38161960 2024-08-18T22:29:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba36a00640 1 -- 172.21.15.5:0/1781950036 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3815eb60 con 0x7fba38161960 2024-08-18T22:29:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba2ea00640 1 -- 172.21.15.5:0/1781950036 >> v1:172.21.15.117:6789/0 conn(0x7fba3815dda0 legacy=0x7fba3815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba2ea00640 1 -- 172.21.15.5:0/1781950036 >> v1:172.21.15.5:6789/0 conn(0x7fba38161960 legacy=0x7fba3806fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.261+0000 7fba2ea00640 1 -- 172.21.15.5:0/1781950036 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3815ee40 con 0x7fba38070730 2024-08-18T22:29:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.265+0000 7fba2ea00640 1 --2- 172.21.15.5:0/1781950036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba38070730 0x7fba38070b70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba200097f0 tx=0x7fba2001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71fa271df45565d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.265+0000 7fba36a00640 1 -- 172.21.15.5:0/1781950036 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba200b0070 con 0x7fba38070730 2024-08-18T22:29:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.265+0000 7fba36a00640 1 -- 172.21.15.5:0/1781950036 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba200ab600 con 0x7fba38070730 2024-08-18T22:29:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.265+0000 7fba36a00640 1 -- 172.21.15.5:0/1781950036 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba200ab9d0 con 0x7fba38070730 2024-08-18T22:29:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.265+0000 7fba3e800640 1 -- 172.21.15.5:0/1781950036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba38070730 msgr2=0x7fba38070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.265+0000 7fba3e800640 1 --2- 172.21.15.5:0/1781950036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba38070730 0x7fba38070b70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba200097f0 tx=0x7fba2001c4e0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.265+0000 7fba3e800640 1 -- 172.21.15.5:0/1781950036 shutdown_connections 2024-08-18T22:29:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.265+0000 7fba3e800640 1 --2- 172.21.15.5:0/1781950036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba38070730 0x7fba38070b70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.265+0000 7fba3e800640 1 -- 172.21.15.5:0/1781950036 >> 172.21.15.5:0/1781950036 conn(0x7fba380d2130 msgr2=0x7fba380d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.265+0000 7fba3e800640 1 -- 172.21.15.5:0/1781950036 shutdown_connections 2024-08-18T22:29:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.265+0000 7fba3e800640 1 -- 172.21.15.5:0/1781950036 wait complete. 2024-08-18T22:29:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba3e800640 1 Processor -- start 2024-08-18T22:29:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba3e800640 1 -- start start 2024-08-18T22:29:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba3e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba38070730 0x7fba380b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba3e800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3815dda0 0x7fba380cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba3e800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba38161960 0x7fba380ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba3e800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fba3809ba30 con 0x7fba38070730 2024-08-18T22:29:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba3e800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fba380710b0 con 0x7fba3815dda0 2024-08-18T22:29:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba3e800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fba380b7350 con 0x7fba38161960 2024-08-18T22:29:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba37400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba38070730 0x7fba380b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba37400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba38070730 0x7fba380b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35410/0 (socket says 172.21.15.5:35410) 2024-08-18T22:29:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba37400640 1 -- 172.21.15.5:0/3813012953 learned_addr learned my addr 172.21.15.5:0/3813012953 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba2ea00640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3815dda0 0x7fba380cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba37e00640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba38161960 0x7fba380ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba37400640 1 -- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba38161960 msgr2=0x7fba380ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba37400640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba38161960 0x7fba380ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba37400640 1 -- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3815dda0 msgr2=0x7fba380cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba37400640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3815dda0 0x7fba380cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba37400640 1 -- 172.21.15.5:0/3813012953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba380cf3e0 con 0x7fba38070730 2024-08-18T22:29:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba37400640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba38070730 0x7fba380b6d70 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fba2800c4d0 tx=0x7fba2800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba2fe00640 1 -- 172.21.15.5:0/3813012953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28017070 con 0x7fba38070730 2024-08-18T22:29:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba2fe00640 1 -- 172.21.15.5:0/3813012953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba28005cf0 con 0x7fba38070730 2024-08-18T22:29:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba2fe00640 1 -- 172.21.15.5:0/3813012953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28007270 con 0x7fba38070730 2024-08-18T22:29:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba3e800640 1 -- 172.21.15.5:0/3813012953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba380ce0e0 con 0x7fba38070730 2024-08-18T22:29:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.269+0000 7fba3e800640 1 -- 172.21.15.5:0/3813012953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba380ce6a0 con 0x7fba38070730 2024-08-18T22:29:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.273+0000 7fba3e800640 1 -- 172.21.15.5:0/3813012953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3809bbb0 con 0x7fba38070730 2024-08-18T22:29:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.273+0000 7fba2fe00640 1 -- 172.21.15.5:0/3813012953 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba2801a070 con 0x7fba38070730 2024-08-18T22:29:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.273+0000 7fba2fe00640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba140678c0 0x7fba14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.273+0000 7fba2fe00640 1 -- 172.21.15.5:0/3813012953 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fba28085220 con 0x7fba38070730 2024-08-18T22:29:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.273+0000 7fba2ea00640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba140678c0 0x7fba14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.273+0000 7fba2ea00640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba140678c0 0x7fba14069d80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fba200ad000 tx=0x7fba200a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.277+0000 7fba2fe00640 1 -- 172.21.15.5:0/3813012953 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fba280554e0 con 0x7fba38070730 2024-08-18T22:29:52.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.477+0000 7fba3e800640 1 -- 172.21.15.5:0/3813012953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba38169fe0 con 0x7fba38070730 2024-08-18T22:29:52.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.477+0000 7fba2fe00640 1 -- 172.21.15.5:0/3813012953 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7fba280597e0 con 0x7fba38070730 2024-08-18T22:29:52.477 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:52.477 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:29:52.478 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:29:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 -- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba140678c0 msgr2=0x7fba14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba140678c0 0x7fba14069d80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fba200ad000 tx=0x7fba200a6000 comp rx=0 tx=0).stop 2024-08-18T22:29:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 -- 172.21.15.5:0/3813012953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba38070730 msgr2=0x7fba380b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba38070730 0x7fba380b6d70 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fba2800c4d0 tx=0x7fba2800c990 comp rx=0 tx=0).stop 2024-08-18T22:29:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 -- 172.21.15.5:0/3813012953 shutdown_connections 2024-08-18T22:29:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fba140678c0 0x7fba14069d80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba38161960 0x7fba380ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3815dda0 0x7fba380cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 --2- 172.21.15.5:0/3813012953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba38070730 0x7fba380b6d70 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 -- 172.21.15.5:0/3813012953 >> 172.21.15.5:0/3813012953 conn(0x7fba380d2130 msgr2=0x7fba3806fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 -- 172.21.15.5:0/3813012953 shutdown_connections 2024-08-18T22:29:52.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.481+0000 7fba3e800640 1 -- 172.21.15.5:0/3813012953 wait complete. 2024-08-18T22:29:52.498 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:29:52.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:29:52.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4e5400640 1 Processor -- start 2024-08-18T22:29:52.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4e5400640 1 -- start start 2024-08-18T22:29:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4e5400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4e00b54c0 0x7ff4e0071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4e5400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 0x7ff4e00cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4e5400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4e0071c80 con 0x7ff4e006dd80 2024-08-18T22:29:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4e5400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff4e00cba40 con 0x7ff4e00b54c0 2024-08-18T22:29:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4e5400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e0071f60 con 0x7ff4e00cbed0 2024-08-18T22:29:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4de800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4e00b54c0 0x7ff4e0071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4d7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff4e006dd80 0x7ff4e00b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58408/0 (socket says 172.21.15.5:58408) 2024-08-18T22:29:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4d7e00640 1 -- 172.21.15.5:0/2437640043 learned_addr learned my addr 172.21.15.5:0/2437640043 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:52.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4df200640 1 --2- 172.21.15.5:0/2437640043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 0x7ff4e00cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4dde00640 1 -- 172.21.15.5:0/2437640043 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1692897426 0 0) 0x7ff4e0071c80 con 0x7ff4e006dd80 2024-08-18T22:29:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4dde00640 1 -- 172.21.15.5:0/2437640043 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4c4003530 con 0x7ff4e006dd80 2024-08-18T22:29:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4de800640 1 -- 172.21.15.5:0/2437640043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 msgr2=0x7ff4e00cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4de800640 1 --2- 172.21.15.5:0/2437640043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 0x7ff4e00cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4de800640 1 -- 172.21.15.5:0/2437640043 >> v1:172.21.15.5:6789/0 conn(0x7ff4e006dd80 legacy=0x7ff4e00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4de800640 1 -- 172.21.15.5:0/2437640043 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e00cb6d0 con 0x7ff4e00b54c0 2024-08-18T22:29:52.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.641+0000 7ff4df200640 1 --2- 172.21.15.5:0/2437640043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 0x7ff4e00cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4de800640 1 --2- 172.21.15.5:0/2437640043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4e00b54c0 0x7ff4e0071580 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00097c0 tx=0x7ff4d001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9934a6a0ba7ef63c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4dde00640 1 -- 172.21.15.5:0/2437640043 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00b5070 con 0x7ff4e00b54c0 2024-08-18T22:29:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4dde00640 1 -- 172.21.15.5:0/2437640043 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d00a8990 con 0x7ff4e00b54c0 2024-08-18T22:29:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4dde00640 1 -- 172.21.15.5:0/2437640043 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00a8d60 con 0x7ff4e00b54c0 2024-08-18T22:29:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4e5400640 1 -- 172.21.15.5:0/2437640043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4e00b54c0 msgr2=0x7ff4e0071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4e5400640 1 --2- 172.21.15.5:0/2437640043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4e00b54c0 0x7ff4e0071580 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00097c0 tx=0x7ff4d001ec90 comp rx=0 tx=0).stop 2024-08-18T22:29:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4e5400640 1 -- 172.21.15.5:0/2437640043 shutdown_connections 2024-08-18T22:29:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4e5400640 1 --2- 172.21.15.5:0/2437640043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 0x7ff4e00cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4e5400640 1 --2- 172.21.15.5:0/2437640043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4e00b54c0 0x7ff4e0071580 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4e5400640 1 -- 172.21.15.5:0/2437640043 >> 172.21.15.5:0/2437640043 conn(0x7ff4e00b3eb0 msgr2=0x7ff4e00b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4e5400640 1 -- 172.21.15.5:0/2437640043 shutdown_connections 2024-08-18T22:29:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.645+0000 7ff4e5400640 1 -- 172.21.15.5:0/2437640043 wait complete. 2024-08-18T22:29:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4e5400640 1 Processor -- start 2024-08-18T22:29:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4e5400640 1 -- start start 2024-08-18T22:29:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4e5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4e006dd80 0x7ff4e00d2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4e5400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4e00b54c0 0x7ff4e01f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4e5400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 0x7ff4e01f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4e5400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e01481a0 con 0x7ff4e006dd80 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4e5400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e0148020 con 0x7ff4e00b54c0 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4e5400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e00cc8a0 con 0x7ff4e00cbed0 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4de800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4e006dd80 0x7ff4e00d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4de800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4e006dd80 0x7ff4e00d2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35430/0 (socket says 172.21.15.5:35430) 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4de800640 1 -- 172.21.15.5:0/3238523762 learned_addr learned my addr 172.21.15.5:0/3238523762 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4df200640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 0x7ff4e01f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4d7e00640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4e00b54c0 0x7ff4e01f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4de800640 1 -- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 msgr2=0x7ff4e01f34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4de800640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 0x7ff4e01f34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4de800640 1 -- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4e00b54c0 msgr2=0x7ff4e01f7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4de800640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4e00b54c0 0x7ff4e01f7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4de800640 1 -- 172.21.15.5:0/3238523762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e00d0430 con 0x7ff4e006dd80 2024-08-18T22:29:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4df200640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 0x7ff4e01f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4de800640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4e006dd80 0x7ff4e00d2960 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7ff4d001c8c0 tx=0x7ff4d001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4d6a00640 1 -- 172.21.15.5:0/3238523762 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00bf070 con 0x7ff4e006dd80 2024-08-18T22:29:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4d6a00640 1 -- 172.21.15.5:0/3238523762 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d00b0640 con 0x7ff4e006dd80 2024-08-18T22:29:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4e5400640 1 -- 172.21.15.5:0/3238523762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e00d06a0 con 0x7ff4e006dd80 2024-08-18T22:29:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4d6a00640 1 -- 172.21.15.5:0/3238523762 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00b5040 con 0x7ff4e006dd80 2024-08-18T22:29:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4e5400640 1 -- 172.21.15.5:0/3238523762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e00d0c60 con 0x7ff4e006dd80 2024-08-18T22:29:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.649+0000 7ff4e5400640 1 -- 172.21.15.5:0/3238523762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e0071c80 con 0x7ff4e006dd80 2024-08-18T22:29:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.653+0000 7ff4d6a00640 1 -- 172.21.15.5:0/3238523762 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff4d00c2070 con 0x7ff4e006dd80 2024-08-18T22:29:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.653+0000 7ff4d6a00640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4bc0678c0 0x7ff4bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.653+0000 7ff4d6a00640 1 -- 172.21.15.5:0/3238523762 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7ff4d01225b0 con 0x7ff4e006dd80 2024-08-18T22:29:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.653+0000 7ff4d7e00640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4bc0678c0 0x7ff4bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.653+0000 7ff4d7e00640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4bc0678c0 0x7ff4bc069d80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00d0320 tx=0x7ff4c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.657+0000 7ff4d6a00640 1 -- 172.21.15.5:0/3238523762 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff4d00187f0 con 0x7ff4e006dd80 2024-08-18T22:29:52.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.885+0000 7ff4e5400640 1 -- 172.21.15.5:0/3238523762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff4e00cdd00 con 0x7ff4e006dd80 2024-08-18T22:29:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.885+0000 7ff4d6a00640 1 -- 172.21.15.5:0/3238523762 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7ff4d00f2ec0 con 0x7ff4e006dd80 2024-08-18T22:29:52.885 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:52.885 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":656,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":946,"data_bytes":969002826,"bytes_used":2316869632,"bytes_avail":770777243648,"bytes_total":773094113280,"write_bytes_sec":45598240,"read_op_per_sec":0,"write_op_per_sec":45},"fsmap":{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9015}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-08-18T22:29:03.764567+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:29:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 -- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4bc0678c0 msgr2=0x7ff4bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4bc0678c0 0x7ff4bc069d80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00d0320 tx=0x7ff4c8009040 comp rx=0 tx=0).stop 2024-08-18T22:29:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 -- 172.21.15.5:0/3238523762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4e006dd80 msgr2=0x7ff4e00d2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4e006dd80 0x7ff4e00d2960 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7ff4d001c8c0 tx=0x7ff4d001ba30 comp rx=0 tx=0).stop 2024-08-18T22:29:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 -- 172.21.15.5:0/3238523762 shutdown_connections 2024-08-18T22:29:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4bc0678c0 0x7ff4bc069d80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4e00cbed0 0x7ff4e01f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4e00b54c0 0x7ff4e01f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 --2- 172.21.15.5:0/3238523762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4e006dd80 0x7ff4e00d2960 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 -- 172.21.15.5:0/3238523762 >> 172.21.15.5:0/3238523762 conn(0x7ff4e00b3eb0 msgr2=0x7ff4e00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 -- 172.21.15.5:0/3238523762 shutdown_connections 2024-08-18T22:29:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:52.889+0000 7ff4e5400640 1 -- 172.21.15.5:0/3238523762 wait complete. 2024-08-18T22:29:52.906 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-08-18T22:29:53.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:29:53.783 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:29:53.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.053+0000 7f5342200640 1 Processor -- start 2024-08-18T22:29:54.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.053+0000 7f5342200640 1 -- start start 2024-08-18T22:29:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f5342200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533c06f290 0x7f533c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f5342200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f533c0cd3a0 0x7f533c072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f5342200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c0cee20 con 0x7f533c15b010 2024-08-18T22:29:54.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f5342200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f533c0cfa30 con 0x7f533c0cd3a0 2024-08-18T22:29:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f5342200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f533c0cf100 con 0x7f533c06f290 2024-08-18T22:29:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f533b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f533c15b010 0x7f533c06eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52978/0 (socket says 172.21.15.5:52978) 2024-08-18T22:29:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f533b400640 1 -- 172.21.15.5:0/59054386 learned_addr learned my addr 172.21.15.5:0/59054386 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f533be00640 1 --2- 172.21.15.5:0/59054386 >> v2:172.21.15.5:3300/0 conn(0x7f533c0cd3a0 0x7f533c072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f533aa00640 1 --2- 172.21.15.5:0/59054386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533c06f290 0x7f533c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f533a000640 1 -- 172.21.15.5:0/59054386 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374175934 0 0) 0x7f533c0cee20 con 0x7f533c15b010 2024-08-18T22:29:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f533a000640 1 -- 172.21.15.5:0/59054386 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5320003530 con 0x7f533c15b010 2024-08-18T22:29:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f533be00640 1 -- 172.21.15.5:0/59054386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533c06f290 msgr2=0x7f533c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f533be00640 1 --2- 172.21.15.5:0/59054386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533c06f290 0x7f533c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f533be00640 1 -- 172.21.15.5:0/59054386 >> v1:172.21.15.5:6789/0 conn(0x7f533c15b010 legacy=0x7f533c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:54.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.057+0000 7f533be00640 1 -- 172.21.15.5:0/59054386 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c0cf3e0 con 0x7f533c0cd3a0 2024-08-18T22:29:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f533be00640 1 --2- 172.21.15.5:0/59054386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533c0cd3a0 0x7f533c072620 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f5334009d90 tx=0x7f533401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5016310a84df3a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f533a000640 1 -- 172.21.15.5:0/59054386 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53340b2070 con 0x7f533c0cd3a0 2024-08-18T22:29:54.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f533a000640 1 -- 172.21.15.5:0/59054386 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53340a59e0 con 0x7f533c0cd3a0 2024-08-18T22:29:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f533a000640 1 -- 172.21.15.5:0/59054386 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53340a5d90 con 0x7f533c0cd3a0 2024-08-18T22:29:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 -- 172.21.15.5:0/59054386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533c0cd3a0 msgr2=0x7f533c072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 --2- 172.21.15.5:0/59054386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533c0cd3a0 0x7f533c072620 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f5334009d90 tx=0x7f533401c940 comp rx=0 tx=0).stop 2024-08-18T22:29:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 -- 172.21.15.5:0/59054386 shutdown_connections 2024-08-18T22:29:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 --2- 172.21.15.5:0/59054386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533c0cd3a0 0x7f533c072620 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 --2- 172.21.15.5:0/59054386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533c06f290 0x7f533c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 -- 172.21.15.5:0/59054386 >> 172.21.15.5:0/59054386 conn(0x7f533c0b1c50 msgr2=0x7f533c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 -- 172.21.15.5:0/59054386 shutdown_connections 2024-08-18T22:29:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 -- 172.21.15.5:0/59054386 wait complete. 2024-08-18T22:29:54.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 Processor -- start 2024-08-18T22:29:54.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 -- start start 2024-08-18T22:29:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f533c06f290 0x7f533c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533c0cd3a0 0x7f533c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.061+0000 7f5342200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533c15b010 0x7f533c0b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f5342200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f533c0734f0 con 0x7f533c0cd3a0 2024-08-18T22:29:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f5342200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f533c073370 con 0x7f533c06f290 2024-08-18T22:29:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f5342200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f533c073670 con 0x7f533c15b010 2024-08-18T22:29:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533c0cd3a0 0x7f533c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:54.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533c0cd3a0 0x7f533c15b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46088/0 (socket says 172.21.15.5:46088) 2024-08-18T22:29:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533aa00640 1 -- 172.21.15.5:0/3350314924 learned_addr learned my addr 172.21.15.5:0/3350314924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533b400640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f533c06f290 0x7f533c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533be00640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533c15b010 0x7f533c0b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533aa00640 1 -- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533c15b010 msgr2=0x7f533c0b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533aa00640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533c15b010 0x7f533c0b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533aa00640 1 -- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f533c06f290 msgr2=0x7f533c151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533aa00640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f533c06f290 0x7f533c151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533aa00640 1 -- 172.21.15.5:0/3350314924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c15c3a0 con 0x7f533c0cd3a0 2024-08-18T22:29:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533be00640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533c15b010 0x7f533c0b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:54.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f533aa00640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533c0cd3a0 0x7f533c15b600 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f5328006d50 tx=0x7f532800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f5333400640 1 -- 172.21.15.5:0/3350314924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328017070 con 0x7f533c0cd3a0 2024-08-18T22:29:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f5333400640 1 -- 172.21.15.5:0/3350314924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532800c940 con 0x7f533c0cd3a0 2024-08-18T22:29:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f5342200640 1 -- 172.21.15.5:0/3350314924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533c1f6720 con 0x7f533c0cd3a0 2024-08-18T22:29:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f5333400640 1 -- 172.21.15.5:0/3350314924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532800cd10 con 0x7f533c0cd3a0 2024-08-18T22:29:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f5342200640 1 -- 172.21.15.5:0/3350314924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533c15c680 con 0x7f533c0cd3a0 2024-08-18T22:29:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f5342200640 1 -- 172.21.15.5:0/3350314924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533c0ce840 con 0x7f533c0cd3a0 2024-08-18T22:29:54.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.065+0000 7f5333400640 1 -- 172.21.15.5:0/3350314924 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f532801a070 con 0x7f533c0cd3a0 2024-08-18T22:29:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.069+0000 7f5333400640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f531c0678c0 0x7f531c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.069+0000 7f5333400640 1 -- 172.21.15.5:0/3350314924 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f5328086160 con 0x7f533c0cd3a0 2024-08-18T22:29:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.069+0000 7f533b400640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f531c0678c0 0x7f531c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:54.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.069+0000 7f533b400640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f531c0678c0 0x7f531c069d80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f532c005890 tx=0x7f532c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:54.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.073+0000 7f5333400640 1 -- 172.21.15.5:0/3350314924 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5328056b40 con 0x7f533c0cd3a0 2024-08-18T22:29:54.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.277+0000 7f5342200640 1 -- 172.21.15.5:0/3350314924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f533c165a20 con 0x7f533c0cd3a0 2024-08-18T22:29:54.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.277+0000 7f5333400640 1 -- 172.21.15.5:0/3350314924 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7f5328056440 con 0x7f533c0cd3a0 2024-08-18T22:29:54.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:54.276 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:29:54.276 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:29:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.277+0000 7f5342200640 1 -- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f531c0678c0 msgr2=0x7f531c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.277+0000 7f5342200640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f531c0678c0 0x7f531c069d80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f532c005890 tx=0x7f532c009040 comp rx=0 tx=0).stop 2024-08-18T22:29:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.277+0000 7f5342200640 1 -- 172.21.15.5:0/3350314924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533c0cd3a0 msgr2=0x7f533c15b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.277+0000 7f5342200640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533c0cd3a0 0x7f533c15b600 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f5328006d50 tx=0x7f532800ed60 comp rx=0 tx=0).stop 2024-08-18T22:29:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.281+0000 7f5342200640 1 -- 172.21.15.5:0/3350314924 shutdown_connections 2024-08-18T22:29:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.281+0000 7f5342200640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f531c0678c0 0x7f531c069d80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.281+0000 7f5342200640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f533c15b010 0x7f533c0b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.281+0000 7f5342200640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f533c0cd3a0 0x7f533c15b600 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.281+0000 7f5342200640 1 --2- 172.21.15.5:0/3350314924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f533c06f290 0x7f533c151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.281+0000 7f5342200640 1 -- 172.21.15.5:0/3350314924 >> 172.21.15.5:0/3350314924 conn(0x7f533c0b1c50 msgr2=0x7f533c0cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.281+0000 7f5342200640 1 -- 172.21.15.5:0/3350314924 shutdown_connections 2024-08-18T22:29:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.281+0000 7f5342200640 1 -- 172.21.15.5:0/3350314924 wait complete. 2024-08-18T22:29:54.296 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:29:54.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:29:54.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.437+0000 7f1701a00640 1 Processor -- start 2024-08-18T22:29:54.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.437+0000 7f1701a00640 1 -- start start 2024-08-18T22:29:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.437+0000 7f1701a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16fc15b010 0x7f16fc0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.437+0000 7f1701a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16fc0cd3a0 0x7f16fc06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.437+0000 7f1701a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16fc06f0c0 0x7f16fc0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f1701a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f16fc0cfa30 con 0x7f16fc15b010 2024-08-18T22:29:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f1701a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f16fc0cee20 con 0x7f16fc06f0c0 2024-08-18T22:29:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f1701a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f16fc0cf100 con 0x7f16fc0cd3a0 2024-08-18T22:29:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16faa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16fc15b010 0x7f16fc0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16faa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16fc15b010 0x7f16fc0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46096/0 (socket says 172.21.15.5:46096) 2024-08-18T22:29:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16faa00640 1 -- 172.21.15.5:0/3743273337 learned_addr learned my addr 172.21.15.5:0/3743273337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16faa00640 1 -- 172.21.15.5:0/3743273337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16fc0cd3a0 msgr2=0x7f16fc06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16faa00640 1 --2- 172.21.15.5:0/3743273337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16fc0cd3a0 0x7f16fc06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16faa00640 1 -- 172.21.15.5:0/3743273337 >> v2:172.21.15.117:3300/0 conn(0x7f16fc06f0c0 msgr2=0x7f16fc0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16faa00640 1 --2- 172.21.15.5:0/3743273337 >> v2:172.21.15.117:3300/0 conn(0x7f16fc06f0c0 0x7f16fc0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16faa00640 1 -- 172.21.15.5:0/3743273337 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16fc0cf3e0 con 0x7f16fc15b010 2024-08-18T22:29:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16faa00640 1 --2- 172.21.15.5:0/3743273337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16fc15b010 0x7f16fc0ce840 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f16fc06ffa0 tx=0x7f16ec01e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54dd36c03af7b2cb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16f9600640 1 -- 172.21.15.5:0/3743273337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0b2070 con 0x7f16fc15b010 2024-08-18T22:29:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16f9600640 1 -- 172.21.15.5:0/3743273337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec0ad600 con 0x7f16fc15b010 2024-08-18T22:29:54.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.441+0000 7f16f9600640 1 -- 172.21.15.5:0/3743273337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0ad9d0 con 0x7f16fc15b010 2024-08-18T22:29:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 -- 172.21.15.5:0/3743273337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16fc15b010 msgr2=0x7f16fc0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 --2- 172.21.15.5:0/3743273337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16fc15b010 0x7f16fc0ce840 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f16fc06ffa0 tx=0x7f16ec01e470 comp rx=0 tx=0).stop 2024-08-18T22:29:54.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 -- 172.21.15.5:0/3743273337 shutdown_connections 2024-08-18T22:29:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 --2- 172.21.15.5:0/3743273337 >> v2:172.21.15.117:3300/0 conn(0x7f16fc06f0c0 0x7f16fc0caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 --2- 172.21.15.5:0/3743273337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16fc0cd3a0 0x7f16fc06eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 --2- 172.21.15.5:0/3743273337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16fc15b010 0x7f16fc0ce840 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 -- 172.21.15.5:0/3743273337 >> 172.21.15.5:0/3743273337 conn(0x7f16fc0b1c50 msgr2=0x7f16fc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 -- 172.21.15.5:0/3743273337 shutdown_connections 2024-08-18T22:29:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 -- 172.21.15.5:0/3743273337 wait complete. 2024-08-18T22:29:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 Processor -- start 2024-08-18T22:29:54.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 -- start start 2024-08-18T22:29:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16fc06f0c0 0x7f16fc158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16fc0cd3a0 0x7f16fc14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16fc15b010 0x7f16fc15db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc06dbf0 con 0x7f16fc06f0c0 2024-08-18T22:29:54.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc06da70 con 0x7f16fc15b010 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f1701a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f16fc06dd70 con 0x7f16fc0cd3a0 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f16faa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16fc06f0c0 0x7f16fc158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f16faa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16fc06f0c0 0x7f16fc158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46112/0 (socket says 172.21.15.5:46112) 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f16faa00640 1 -- 172.21.15.5:0/1194652992 learned_addr learned my addr 172.21.15.5:0/1194652992 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f16fb400640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16fc15b010 0x7f16fc15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f16fa000640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16fc0cd3a0 0x7f16fc14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f16faa00640 1 -- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16fc0cd3a0 msgr2=0x7f16fc14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f16faa00640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16fc0cd3a0 0x7f16fc14e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f16faa00640 1 -- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16fc15b010 msgr2=0x7f16fc15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f16faa00640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16fc15b010 0x7f16fc15db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.445+0000 7f16faa00640 1 -- 172.21.15.5:0/1194652992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16fc14e930 con 0x7f16fc06f0c0 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.449+0000 7f16faa00640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16fc06f0c0 0x7f16fc158040 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0b0040 tx=0x7f16ec01ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.449+0000 7f16f2a00640 1 -- 172.21.15.5:0/1194652992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0bd070 con 0x7f16fc06f0c0 2024-08-18T22:29:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.449+0000 7f16f2a00640 1 -- 172.21.15.5:0/1194652992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec0ac7d0 con 0x7f16fc06f0c0 2024-08-18T22:29:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.449+0000 7f16f2a00640 1 -- 172.21.15.5:0/1194652992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0b2070 con 0x7f16fc06f0c0 2024-08-18T22:29:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.449+0000 7f1701a00640 1 -- 172.21.15.5:0/1194652992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16fc0b0d90 con 0x7f16fc06f0c0 2024-08-18T22:29:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.449+0000 7f1701a00640 1 -- 172.21.15.5:0/1194652992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16fc156640 con 0x7f16fc06f0c0 2024-08-18T22:29:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.449+0000 7f1701a00640 1 -- 172.21.15.5:0/1194652992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16fc0caf40 con 0x7f16fc06f0c0 2024-08-18T22:29:54.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.449+0000 7f16f2a00640 1 -- 172.21.15.5:0/1194652992 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16ec0c0070 con 0x7f16fc06f0c0 2024-08-18T22:29:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.449+0000 7f16f2a00640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16dc0678c0 0x7f16dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:54.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.449+0000 7f16f2a00640 1 -- 172.21.15.5:0/1194652992 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f16ec11fa40 con 0x7f16fc06f0c0 2024-08-18T22:29:54.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.453+0000 7f16fa000640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16dc0678c0 0x7f16dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:54.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.453+0000 7f16fa000640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16dc0678c0 0x7f16dc069d80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f16e8006fd0 tx=0x7f16e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:54.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.457+0000 7f16f2a00640 1 -- 172.21.15.5:0/1194652992 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f16fc14e930 con 0x7f16fc06f0c0 2024-08-18T22:29:54.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.681+0000 7f1701a00640 1 -- 172.21.15.5:0/1194652992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f16fc155ae0 con 0x7f16fc06f0c0 2024-08-18T22:29:54.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.681+0000 7f16f2a00640 1 -- 172.21.15.5:0/1194652992 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1491 (secure 0 0 0) 0x7f16ec018320 con 0x7f16fc06f0c0 2024-08-18T22:29:54.681 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:54.681 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":658,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1041,"data_bytes":1069083853,"bytes_used":2551234560,"bytes_avail":770542878720,"bytes_total":773094113280,"write_bytes_sec":48784681,"read_op_per_sec":0,"write_op_per_sec":49},"fsmap":{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9015}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-08-18T22:29:03.764567+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:29:54.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 -- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16dc0678c0 msgr2=0x7f16dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:54.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16dc0678c0 0x7f16dc069d80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f16e8006fd0 tx=0x7f16e8008040 comp rx=0 tx=0).stop 2024-08-18T22:29:54.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 -- 172.21.15.5:0/1194652992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16fc06f0c0 msgr2=0x7f16fc158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:54.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16fc06f0c0 0x7f16fc158040 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0b0040 tx=0x7f16ec01ccb0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 -- 172.21.15.5:0/1194652992 shutdown_connections 2024-08-18T22:29:54.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16dc0678c0 0x7f16dc069d80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16fc15b010 0x7f16fc15db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16fc0cd3a0 0x7f16fc14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 --2- 172.21.15.5:0/1194652992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16fc06f0c0 0x7f16fc158040 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:54.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 -- 172.21.15.5:0/1194652992 >> 172.21.15.5:0/1194652992 conn(0x7f16fc0b1c50 msgr2=0x7f16fc1590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:54.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 -- 172.21.15.5:0/1194652992 shutdown_connections 2024-08-18T22:29:54.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:54.685+0000 7f1701a00640 1 -- 172.21.15.5:0/1194652992 wait complete. 2024-08-18T22:29:54.701 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-08-18T22:29:55.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:55.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f615ca00640 1 Processor -- start 2024-08-18T22:29:55.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f615ca00640 1 -- start start 2024-08-18T22:29:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f615ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f615806f290 0x7f61580ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f615ca00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61580cd3a0 0x7f6158072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f615ca00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61580cd850 con 0x7f615815b010 2024-08-18T22:29:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f615ca00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f61580cfa30 con 0x7f615806f290 2024-08-18T22:29:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f615ca00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f61580cee20 con 0x7f61580cd3a0 2024-08-18T22:29:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f614d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f615806f290 0x7f61580ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f614d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f615806f290 0x7f61580ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46126/0 (socket says 172.21.15.5:46126) 2024-08-18T22:29:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f614d400640 1 -- 172.21.15.5:0/1495832855 learned_addr learned my addr 172.21.15.5:0/1495832855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f6156800640 1 --2- 172.21.15.5:0/1495832855 >> v2:172.21.15.117:3300/0 conn(0x7f61580cd3a0 0x7f6158072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f614d400640 1 -- 172.21.15.5:0/1495832855 >> v2:172.21.15.117:3300/0 conn(0x7f61580cd3a0 msgr2=0x7f6158072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f614d400640 1 --2- 172.21.15.5:0/1495832855 >> v2:172.21.15.117:3300/0 conn(0x7f61580cd3a0 0x7f6158072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f614d400640 1 -- 172.21.15.5:0/1495832855 >> v1:172.21.15.117:6789/0 conn(0x7f615815b010 legacy=0x7f615806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.857+0000 7f614d400640 1 -- 172.21.15.5:0/1495832855 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61580cf100 con 0x7f615806f290 2024-08-18T22:29:55.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f614d400640 1 --2- 172.21.15.5:0/1495832855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f615806f290 0x7f61580ce840 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f61580af570 tx=0x7f614001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bc25a479a7c0ad server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:55.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f6155400640 1 -- 172.21.15.5:0/1495832855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61400aa650 con 0x7f615806f290 2024-08-18T22:29:55.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f6155400640 1 -- 172.21.15.5:0/1495832855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61400af070 con 0x7f615806f290 2024-08-18T22:29:55.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f6155400640 1 -- 172.21.15.5:0/1495832855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61400aaa10 con 0x7f615806f290 2024-08-18T22:29:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f615ca00640 1 -- 172.21.15.5:0/1495832855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f615806f290 msgr2=0x7f61580ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f615ca00640 1 --2- 172.21.15.5:0/1495832855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f615806f290 0x7f61580ce840 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f61580af570 tx=0x7f614001c4f0 comp rx=0 tx=0).stop 2024-08-18T22:29:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f615ca00640 1 -- 172.21.15.5:0/1495832855 shutdown_connections 2024-08-18T22:29:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f615ca00640 1 --2- 172.21.15.5:0/1495832855 >> v2:172.21.15.117:3300/0 conn(0x7f61580cd3a0 0x7f6158072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f615ca00640 1 --2- 172.21.15.5:0/1495832855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f615806f290 0x7f61580ce840 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f615ca00640 1 -- 172.21.15.5:0/1495832855 >> 172.21.15.5:0/1495832855 conn(0x7f61580b1c50 msgr2=0x7f61580b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f615ca00640 1 -- 172.21.15.5:0/1495832855 shutdown_connections 2024-08-18T22:29:55.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.861+0000 7f615ca00640 1 -- 172.21.15.5:0/1495832855 wait complete. 2024-08-18T22:29:55.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f615ca00640 1 Processor -- start 2024-08-18T22:29:55.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f615ca00640 1 -- start start 2024-08-18T22:29:55.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f615ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f615806f290 0x7f6158151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f615ca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580cd3a0 0x7f61580b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f615ca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f615815b010 0x7f615809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f615ca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f61580734f0 con 0x7f615806f290 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f615ca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6158073370 con 0x7f615815b010 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f615ca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6158073670 con 0x7f61580cd3a0 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f6155e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f615806f290 0x7f6158151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f6155e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f615806f290 0x7f6158151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46140/0 (socket says 172.21.15.5:46140) 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f6155e00640 1 -- 172.21.15.5:0/135193039 learned_addr learned my addr 172.21.15.5:0/135193039 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f614d400640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580cd3a0 0x7f61580b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f6156800640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f615815b010 0x7f615809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f6155e00640 1 -- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580cd3a0 msgr2=0x7f61580b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:55.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f6155e00640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580cd3a0 0x7f61580b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f6155e00640 1 -- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f615815b010 msgr2=0x7f615809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f6155e00640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f615815b010 0x7f615809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f6155e00640 1 -- 172.21.15.5:0/135193039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6158151550 con 0x7f615806f290 2024-08-18T22:29:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f6155e00640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f615806f290 0x7f6158151010 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f614800c3a0 tx=0x7f614800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f614ea00640 1 -- 172.21.15.5:0/135193039 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61480052d0 con 0x7f615806f290 2024-08-18T22:29:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f614ea00640 1 -- 172.21.15.5:0/135193039 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6148005470 con 0x7f615806f290 2024-08-18T22:29:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f614ea00640 1 -- 172.21.15.5:0/135193039 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148007260 con 0x7f615806f290 2024-08-18T22:29:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.865+0000 7f615ca00640 1 -- 172.21.15.5:0/135193039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6158157c10 con 0x7f615806f290 2024-08-18T22:29:55.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.869+0000 7f615ca00640 1 -- 172.21.15.5:0/135193039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61581581d0 con 0x7f615806f290 2024-08-18T22:29:55.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.869+0000 7f615ca00640 1 -- 172.21.15.5:0/135193039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61580ce840 con 0x7f615806f290 2024-08-18T22:29:55.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.869+0000 7f614ea00640 1 -- 172.21.15.5:0/135193039 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6148007400 con 0x7f615806f290 2024-08-18T22:29:55.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.869+0000 7f614ea00640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 0x7f6134069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:55.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.869+0000 7f614ea00640 1 -- 172.21.15.5:0/135193039 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f61480851f0 con 0x7f615806f290 2024-08-18T22:29:55.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.869+0000 7f614d400640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 0x7f6134069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:55.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.869+0000 7f614d400640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 0x7f6134069d80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f61400ae000 tx=0x7f61400a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:55.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:55.873+0000 7f614ea00640 1 -- 172.21.15.5:0/135193039 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6148055540 con 0x7f615806f290 2024-08-18T22:29:56.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.073+0000 7f615ca00640 1 -- 172.21.15.5:0/135193039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6158151780 con 0x7f615806f290 2024-08-18T22:29:56.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.073+0000 7f614ea00640 1 -- 172.21.15.5:0/135193039 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7f6148059840 con 0x7f615806f290 2024-08-18T22:29:56.073 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:56.073 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:29:56.073 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:29:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 -- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 msgr2=0x7f6134069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 0x7f6134069d80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f61400ae000 tx=0x7f61400a7000 comp rx=0 tx=0).stop 2024-08-18T22:29:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 -- 172.21.15.5:0/135193039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f615806f290 msgr2=0x7f6158151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f615806f290 0x7f6158151010 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f614800c3a0 tx=0x7f614800c860 comp rx=0 tx=0).stop 2024-08-18T22:29:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 -- 172.21.15.5:0/135193039 shutdown_connections 2024-08-18T22:29:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 0x7f6134069d80 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f615815b010 0x7f615809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580cd3a0 0x7f61580b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 --2- 172.21.15.5:0/135193039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f615806f290 0x7f6158151010 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 -- 172.21.15.5:0/135193039 >> 172.21.15.5:0/135193039 conn(0x7f61580b1c50 msgr2=0x7f61581599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:56.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 -- 172.21.15.5:0/135193039 shutdown_connections 2024-08-18T22:29:56.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.077+0000 7f615ca00640 1 -- 172.21.15.5:0/135193039 wait complete. 2024-08-18T22:29:56.094 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:29:56.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:29:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.237+0000 7f77e7200640 1 Processor -- start 2024-08-18T22:29:56.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.237+0000 7f77e7200640 1 -- start start 2024-08-18T22:29:56.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.237+0000 7f77e7200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77e80cde30 0x7f77e815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.237+0000 7f77e7200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e80b4510 0x7f77e80cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.237+0000 7f77e7200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e80ccd90 con 0x7f77e809aa40 2024-08-18T22:29:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77e7200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f77e80ce770 con 0x7f77e80cde30 2024-08-18T22:29:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77e7200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f77e815d520 con 0x7f77e80b4510 2024-08-18T22:29:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77dd400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77e80cde30 0x7f77e815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77dd400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77e80cde30 0x7f77e815cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46144/0 (socket says 172.21.15.5:46144) 2024-08-18T22:29:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77dd400640 1 -- 172.21.15.5:0/4128435140 learned_addr learned my addr 172.21.15.5:0/4128435140 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77e6800640 1 --2- 172.21.15.5:0/4128435140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e80b4510 0x7f77e80cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77dd400640 1 -- 172.21.15.5:0/4128435140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e80b4510 msgr2=0x7f77e80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77dd400640 1 --2- 172.21.15.5:0/4128435140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e80b4510 0x7f77e80cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77dd400640 1 -- 172.21.15.5:0/4128435140 >> v1:172.21.15.117:6789/0 conn(0x7f77e809aa40 legacy=0x7f77e809ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:56.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77dd400640 1 -- 172.21.15.5:0/4128435140 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e80cd070 con 0x7f77e80cde30 2024-08-18T22:29:56.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77dd400640 1 --2- 172.21.15.5:0/4128435140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e80cde30 0x7f77e815cfe0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009870 tx=0x7f77d001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd94e37c7d89cb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77e5400640 1 -- 172.21.15.5:0/4128435140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d00a95f0 con 0x7f77e80cde30 2024-08-18T22:29:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77e5400640 1 -- 172.21.15.5:0/4128435140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d00a9790 con 0x7f77e80cde30 2024-08-18T22:29:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.241+0000 7f77e5400640 1 -- 172.21.15.5:0/4128435140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d00a9b60 con 0x7f77e80cde30 2024-08-18T22:29:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 -- 172.21.15.5:0/4128435140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e80cde30 msgr2=0x7f77e815cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 --2- 172.21.15.5:0/4128435140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e80cde30 0x7f77e815cfe0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009870 tx=0x7f77d001c530 comp rx=0 tx=0).stop 2024-08-18T22:29:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 -- 172.21.15.5:0/4128435140 shutdown_connections 2024-08-18T22:29:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 --2- 172.21.15.5:0/4128435140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e80b4510 0x7f77e80cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 --2- 172.21.15.5:0/4128435140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e80cde30 0x7f77e815cfe0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 -- 172.21.15.5:0/4128435140 >> 172.21.15.5:0/4128435140 conn(0x7f77e80b3a20 msgr2=0x7f77e80b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 -- 172.21.15.5:0/4128435140 shutdown_connections 2024-08-18T22:29:56.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 -- 172.21.15.5:0/4128435140 wait complete. 2024-08-18T22:29:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 Processor -- start 2024-08-18T22:29:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 -- start start 2024-08-18T22:29:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e809aa40 0x7f77e80c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e80b4510 0x7f77e80b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e80cde30 0x7f77e8165210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77e815c3b0 con 0x7f77e809aa40 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f77e815c230 con 0x7f77e80cde30 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e7200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f77e8168e40 con 0x7f77e80b4510 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e809aa40 0x7f77e80c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e809aa40 0x7f77e80c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46148/0 (socket says 172.21.15.5:46148) 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e5e00640 1 -- 172.21.15.5:0/211689966 learned_addr learned my addr 172.21.15.5:0/211689966 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77dd400640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e80b4510 0x7f77e80b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e6800640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e80cde30 0x7f77e8165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e5e00640 1 -- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e80b4510 msgr2=0x7f77e80b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e5e00640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e80b4510 0x7f77e80b7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e5e00640 1 -- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e80cde30 msgr2=0x7f77e8165210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e5e00640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e80cde30 0x7f77e8165210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.245+0000 7f77e5e00640 1 -- 172.21.15.5:0/211689966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e80c8450 con 0x7f77e809aa40 2024-08-18T22:29:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.249+0000 7f77e5e00640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e809aa40 0x7f77e80c7f10 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c7c0 tx=0x7f77d800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.249+0000 7f77dea00640 1 -- 172.21.15.5:0/211689966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8016020 con 0x7f77e809aa40 2024-08-18T22:29:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.249+0000 7f77dea00640 1 -- 172.21.15.5:0/211689966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d8006d60 con 0x7f77e809aa40 2024-08-18T22:29:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.249+0000 7f77dea00640 1 -- 172.21.15.5:0/211689966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8003bc0 con 0x7f77e809aa40 2024-08-18T22:29:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.249+0000 7f77e7200640 1 -- 172.21.15.5:0/211689966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e80b5140 con 0x7f77e809aa40 2024-08-18T22:29:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.249+0000 7f77e7200640 1 -- 172.21.15.5:0/211689966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e80b5700 con 0x7f77e809aa40 2024-08-18T22:29:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.249+0000 7f77e7200640 1 -- 172.21.15.5:0/211689966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e80cfb00 con 0x7f77e809aa40 2024-08-18T22:29:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.249+0000 7f77dea00640 1 -- 172.21.15.5:0/211689966 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77d800a850 con 0x7f77e809aa40 2024-08-18T22:29:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.249+0000 7f77dea00640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c40678f0 0x7f77c4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.249+0000 7f77dea00640 1 -- 172.21.15.5:0/211689966 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f77d8085a00 con 0x7f77e809aa40 2024-08-18T22:29:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.249+0000 7f77dd400640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c40678f0 0x7f77c4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.253+0000 7f77dd400640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c40678f0 0x7f77c4069db0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f77d00ae000 tx=0x7f77d00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.253+0000 7f77dea00640 1 -- 172.21.15.5:0/211689966 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f77d8020020 con 0x7f77e809aa40 2024-08-18T22:29:56.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 -- 172.21.15.5:0/211689966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f77e8073d40 con 0x7f77e809aa40 2024-08-18T22:29:56.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77dea00640 1 -- 172.21.15.5:0/211689966 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1491 (secure 0 0 0) 0x7f77d8055d50 con 0x7f77e809aa40 2024-08-18T22:29:56.479 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:56.479 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":659,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076423885,"bytes_used":2584207360,"bytes_avail":770509905920,"bytes_total":773094113280,"write_bytes_sec":34153670,"read_op_per_sec":0,"write_op_per_sec":34},"fsmap":{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9015}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-08-18T22:29:03.764567+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:29:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 -- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c40678f0 msgr2=0x7f77c4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c40678f0 0x7f77c4069db0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f77d00ae000 tx=0x7f77d00a7000 comp rx=0 tx=0).stop 2024-08-18T22:29:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 -- 172.21.15.5:0/211689966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e809aa40 msgr2=0x7f77e80c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e809aa40 0x7f77e80c7f10 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c7c0 tx=0x7f77d800cc80 comp rx=0 tx=0).stop 2024-08-18T22:29:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 -- 172.21.15.5:0/211689966 shutdown_connections 2024-08-18T22:29:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77c40678f0 0x7f77c4069db0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e80cde30 0x7f77e8165210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e80b4510 0x7f77e80b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 --2- 172.21.15.5:0/211689966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e809aa40 0x7f77e80c7f10 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:56.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 -- 172.21.15.5:0/211689966 >> 172.21.15.5:0/211689966 conn(0x7f77e80b3a20 msgr2=0x7f77e80b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:56.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 -- 172.21.15.5:0/211689966 shutdown_connections 2024-08-18T22:29:56.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:56.481+0000 7f77e7200640 1 -- 172.21.15.5:0/211689966 wait complete. 2024-08-18T22:29:56.500 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-08-18T22:29:57.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.653+0000 7fd722600640 1 Processor -- start 2024-08-18T22:29:57.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd722600640 1 -- start start 2024-08-18T22:29:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd722600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd71c15bed0 0x7fd71c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd722600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c06da70 0x7fd71c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd722600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd71c073c80 con 0x7fd71c0cb390 2024-08-18T22:29:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd722600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd71c06e420 con 0x7fd71c15bed0 2024-08-18T22:29:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd722600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd71c0ca5d0 con 0x7fd71c06da70 2024-08-18T22:29:57.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd71b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd71c15bed0 0x7fd71c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:57.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd712a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd71c0cb390 0x7fd71c071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52990/0 (socket says 172.21.15.5:52990) 2024-08-18T22:29:57.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd712a00640 1 -- 172.21.15.5:0/3123705263 learned_addr learned my addr 172.21.15.5:0/3123705263 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:57.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd71be00640 1 --2- 172.21.15.5:0/3123705263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c06da70 0x7fd71c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd71b400640 1 -- 172.21.15.5:0/3123705263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c06da70 msgr2=0x7fd71c06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd71b400640 1 --2- 172.21.15.5:0/3123705263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c06da70 0x7fd71c06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd71b400640 1 -- 172.21.15.5:0/3123705263 >> v1:172.21.15.5:6789/0 conn(0x7fd71c0cb390 legacy=0x7fd71c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd71b400640 1 -- 172.21.15.5:0/3123705263 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71c0ca8b0 con 0x7fd71c15bed0 2024-08-18T22:29:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd71be00640 1 --2- 172.21.15.5:0/3123705263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c06da70 0x7fd71c06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.657+0000 7fd71aa00640 1 -- 172.21.15.5:0/3123705263 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940380477 0 0) 0x7fd71c073c80 con 0x7fd71c0cb390 2024-08-18T22:29:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd71b400640 1 --2- 172.21.15.5:0/3123705263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd71c15bed0 0x7fd71c0735a0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0097c0 tx=0x7fd70c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b939cf1e20fc3c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd71aa00640 1 -- 172.21.15.5:0/3123705263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0a7070 con 0x7fd71c15bed0 2024-08-18T22:29:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd71aa00640 1 -- 172.21.15.5:0/3123705263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd70c0b0070 con 0x7fd71c15bed0 2024-08-18T22:29:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd71aa00640 1 -- 172.21.15.5:0/3123705263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0ab890 con 0x7fd71c15bed0 2024-08-18T22:29:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd722600640 1 -- 172.21.15.5:0/3123705263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd71c15bed0 msgr2=0x7fd71c0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd722600640 1 --2- 172.21.15.5:0/3123705263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd71c15bed0 0x7fd71c0735a0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0097c0 tx=0x7fd70c01c470 comp rx=0 tx=0).stop 2024-08-18T22:29:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd722600640 1 -- 172.21.15.5:0/3123705263 shutdown_connections 2024-08-18T22:29:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd722600640 1 --2- 172.21.15.5:0/3123705263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c06da70 0x7fd71c06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd722600640 1 --2- 172.21.15.5:0/3123705263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd71c15bed0 0x7fd71c0735a0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd722600640 1 -- 172.21.15.5:0/3123705263 >> 172.21.15.5:0/3123705263 conn(0x7fd71c0b1c50 msgr2=0x7fd71c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd722600640 1 -- 172.21.15.5:0/3123705263 shutdown_connections 2024-08-18T22:29:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd722600640 1 -- 172.21.15.5:0/3123705263 wait complete. 2024-08-18T22:29:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd722600640 1 Processor -- start 2024-08-18T22:29:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.661+0000 7fd722600640 1 -- start start 2024-08-18T22:29:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd722600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c06da70 0x7fd71c14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd722600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd71c0cb390 0x7fd71c0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd722600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c15bed0 0x7fd71c14b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd722600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c168520 con 0x7fd71c0cb390 2024-08-18T22:29:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd722600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c1683a0 con 0x7fd71c06da70 2024-08-18T22:29:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd722600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd71c1686a0 con 0x7fd71c15bed0 2024-08-18T22:29:57.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd712a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd71c0cb390 0x7fd71c0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd712a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd71c0cb390 0x7fd71c0cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46170/0 (socket says 172.21.15.5:46170) 2024-08-18T22:29:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd712a00640 1 -- 172.21.15.5:0/2486365319 learned_addr learned my addr 172.21.15.5:0/2486365319 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd71b400640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c06da70 0x7fd71c14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd71be00640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c15bed0 0x7fd71c14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd712a00640 1 -- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c15bed0 msgr2=0x7fd71c14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd712a00640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c15bed0 0x7fd71c14b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd712a00640 1 -- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c06da70 msgr2=0x7fd71c14f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd712a00640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c06da70 0x7fd71c14f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd712a00640 1 -- 172.21.15.5:0/2486365319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71c14bb30 con 0x7fd71c0cb390 2024-08-18T22:29:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd712a00640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd71c0cb390 0x7fd71c0cdb50 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fd70400c480 tx=0x7fd70400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:57.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd713e00640 1 -- 172.21.15.5:0/2486365319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704018070 con 0x7fd71c0cb390 2024-08-18T22:29:57.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd713e00640 1 -- 172.21.15.5:0/2486365319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd704007500 con 0x7fd71c0cb390 2024-08-18T22:29:57.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd722600640 1 -- 172.21.15.5:0/2486365319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71c0b3960 con 0x7fd71c0cb390 2024-08-18T22:29:57.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd713e00640 1 -- 172.21.15.5:0/2486365319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704004a30 con 0x7fd71c0cb390 2024-08-18T22:29:57.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd722600640 1 -- 172.21.15.5:0/2486365319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd71c0b3c00 con 0x7fd71c0cb390 2024-08-18T22:29:57.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.665+0000 7fd722600640 1 -- 172.21.15.5:0/2486365319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd71c06dee0 con 0x7fd71c0cb390 2024-08-18T22:29:57.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.669+0000 7fd713e00640 1 -- 172.21.15.5:0/2486365319 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd70401b070 con 0x7fd71c0cb390 2024-08-18T22:29:57.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.669+0000 7fd713e00640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6f80678c0 0x7fd6f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.669+0000 7fd713e00640 1 -- 172.21.15.5:0/2486365319 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fd7040850f0 con 0x7fd71c0cb390 2024-08-18T22:29:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.669+0000 7fd71b400640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6f80678c0 0x7fd6f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.669+0000 7fd71b400640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6f80678c0 0x7fd6f8069d80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0af000 tx=0x7fd70c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:57.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.673+0000 7fd713e00640 1 -- 172.21.15.5:0/2486365319 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd704055440 con 0x7fd71c0cb390 2024-08-18T22:29:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.873+0000 7fd722600640 1 -- 172.21.15.5:0/2486365319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd71c151e00 con 0x7fd71c0cb390 2024-08-18T22:29:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.873+0000 7fd713e00640 1 -- 172.21.15.5:0/2486365319 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7fd704059740 con 0x7fd71c0cb390 2024-08-18T22:29:57.873 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:57.873 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:29:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:29:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 -- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6f80678c0 msgr2=0x7fd6f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6f80678c0 0x7fd6f8069d80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0af000 tx=0x7fd70c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:29:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 -- 172.21.15.5:0/2486365319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd71c0cb390 msgr2=0x7fd71c0cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd71c0cb390 0x7fd71c0cdb50 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fd70400c480 tx=0x7fd70400c940 comp rx=0 tx=0).stop 2024-08-18T22:29:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 -- 172.21.15.5:0/2486365319 shutdown_connections 2024-08-18T22:29:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6f80678c0 0x7fd6f8069d80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c15bed0 0x7fd71c14b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd71c0cb390 0x7fd71c0cdb50 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 --2- 172.21.15.5:0/2486365319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c06da70 0x7fd71c14f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 -- 172.21.15.5:0/2486365319 >> 172.21.15.5:0/2486365319 conn(0x7fd71c0b1c50 msgr2=0x7fd71c152320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 -- 172.21.15.5:0/2486365319 shutdown_connections 2024-08-18T22:29:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:57.877+0000 7fd722600640 1 -- 172.21.15.5:0/2486365319 wait complete. 2024-08-18T22:29:57.894 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:29:57.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:29:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.033+0000 7f7b6b800640 1 Processor -- start 2024-08-18T22:29:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.033+0000 7f7b6b800640 1 -- start start 2024-08-18T22:29:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b6b800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b641618d0 0x7f7b6415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b6b800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b64161d40 0x7f7b6415f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b6b800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7b640c92d0 0x7f7b640c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b6b800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7b640c9c60 con 0x7f7b641618d0 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b6b800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7b64162300 con 0x7f7b640c92d0 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b6b800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7b641625e0 con 0x7f7b64161d40 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b68e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b641618d0 0x7f7b6415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b68e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b641618d0 0x7f7b6415f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46178/0 (socket says 172.21.15.5:46178) 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b68e00640 1 -- 172.21.15.5:0/1721803185 learned_addr learned my addr 172.21.15.5:0/1721803185 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b63e00640 1 --2- 172.21.15.5:0/1721803185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b64161d40 0x7f7b6415f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b69800640 1 --2- 172.21.15.5:0/1721803185 >> v2:172.21.15.117:3300/0 conn(0x7f7b640c92d0 0x7f7b640c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b68e00640 1 -- 172.21.15.5:0/1721803185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b64161d40 msgr2=0x7f7b6415f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b68e00640 1 --2- 172.21.15.5:0/1721803185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b64161d40 0x7f7b6415f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b68e00640 1 -- 172.21.15.5:0/1721803185 >> v2:172.21.15.117:3300/0 conn(0x7f7b640c92d0 msgr2=0x7f7b640c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b68e00640 1 --2- 172.21.15.5:0/1721803185 >> v2:172.21.15.117:3300/0 conn(0x7f7b640c92d0 0x7f7b640c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b68e00640 1 -- 172.21.15.5:0/1721803185 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b641628c0 con 0x7f7b641618d0 2024-08-18T22:29:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b63e00640 1 --2- 172.21.15.5:0/1721803185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b64161d40 0x7f7b6415f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.037+0000 7f7b69800640 1 --2- 172.21.15.5:0/1721803185 >> v2:172.21.15.117:3300/0 conn(0x7f7b640c92d0 0x7f7b640c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b68e00640 1 --2- 172.21.15.5:0/1721803185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b641618d0 0x7f7b6415f1d0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f7b640cac00 tx=0x7f7b5401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8b827bce1b8894 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b63400640 1 -- 172.21.15.5:0/1721803185 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b540b0070 con 0x7f7b641618d0 2024-08-18T22:29:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b63400640 1 -- 172.21.15.5:0/1721803185 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b540ab600 con 0x7f7b641618d0 2024-08-18T22:29:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b63400640 1 -- 172.21.15.5:0/1721803185 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b540ab9d0 con 0x7f7b641618d0 2024-08-18T22:29:58.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b6b800640 1 -- 172.21.15.5:0/1721803185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b641618d0 msgr2=0x7f7b6415f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b6b800640 1 --2- 172.21.15.5:0/1721803185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b641618d0 0x7f7b6415f1d0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f7b640cac00 tx=0x7f7b5401c520 comp rx=0 tx=0).stop 2024-08-18T22:29:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b6b800640 1 -- 172.21.15.5:0/1721803185 shutdown_connections 2024-08-18T22:29:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b6b800640 1 --2- 172.21.15.5:0/1721803185 >> v2:172.21.15.117:3300/0 conn(0x7f7b640c92d0 0x7f7b640c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b6b800640 1 --2- 172.21.15.5:0/1721803185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b64161d40 0x7f7b6415f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b6b800640 1 --2- 172.21.15.5:0/1721803185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b641618d0 0x7f7b6415f1d0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b6b800640 1 -- 172.21.15.5:0/1721803185 >> 172.21.15.5:0/1721803185 conn(0x7f7b640b1c50 msgr2=0x7f7b640b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b6b800640 1 -- 172.21.15.5:0/1721803185 shutdown_connections 2024-08-18T22:29:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b6b800640 1 -- 172.21.15.5:0/1721803185 wait complete. 2024-08-18T22:29:58.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b6b800640 1 Processor -- start 2024-08-18T22:29:58.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.041+0000 7f7b6b800640 1 -- start start 2024-08-18T22:29:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b6b800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b640c92d0 0x7f7b640cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b6b800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b641618d0 0x7f7b640ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b6b800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b64161d40 0x7f7b641520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b6b800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7b640cf1f0 con 0x7f7b640c92d0 2024-08-18T22:29:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b6b800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7b640cf070 con 0x7f7b64161d40 2024-08-18T22:29:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b6b800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7b640cf370 con 0x7f7b641618d0 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b68e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b640c92d0 0x7f7b640cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b68e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b640c92d0 0x7f7b640cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46194/0 (socket says 172.21.15.5:46194) 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b68e00640 1 -- 172.21.15.5:0/2247772989 learned_addr learned my addr 172.21.15.5:0/2247772989 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b63e00640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b641618d0 0x7f7b640ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b69800640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b64161d40 0x7f7b641520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b68e00640 1 -- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b641618d0 msgr2=0x7f7b640ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b68e00640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b641618d0 0x7f7b640ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b68e00640 1 -- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b64161d40 msgr2=0x7f7b641520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b68e00640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b64161d40 0x7f7b641520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b68e00640 1 -- 172.21.15.5:0/2247772989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b640cb8c0 con 0x7f7b640c92d0 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b68e00640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b640c92d0 0x7f7b640cb380 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f7b540ae040 tx=0x7f7b540192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b60c00640 1 -- 172.21.15.5:0/2247772989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b540ba070 con 0x7f7b640c92d0 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b60c00640 1 -- 172.21.15.5:0/2247772989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b540b4620 con 0x7f7b640c92d0 2024-08-18T22:29:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b60c00640 1 -- 172.21.15.5:0/2247772989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b540b0040 con 0x7f7b640c92d0 2024-08-18T22:29:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b6b800640 1 -- 172.21.15.5:0/2247772989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b640ad720 con 0x7f7b640c92d0 2024-08-18T22:29:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b6b800640 1 -- 172.21.15.5:0/2247772989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b64152c20 con 0x7f7b640c92d0 2024-08-18T22:29:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b6b800640 1 -- 172.21.15.5:0/2247772989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b6415f1d0 con 0x7f7b640c92d0 2024-08-18T22:29:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.045+0000 7f7b60c00640 1 -- 172.21.15.5:0/2247772989 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b540ab4c0 con 0x7f7b640c92d0 2024-08-18T22:29:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.049+0000 7f7b60c00640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7b440678c0 0x7f7b44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.049+0000 7f7b60c00640 1 -- 172.21.15.5:0/2247772989 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f7b5411f250 con 0x7f7b640c92d0 2024-08-18T22:29:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.049+0000 7f7b63e00640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7b440678c0 0x7f7b44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.049+0000 7f7b63e00640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7b440678c0 0x7f7b44069d80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7b50006fd0 tx=0x7f7b50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.053+0000 7f7b60c00640 1 -- 172.21.15.5:0/2247772989 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7b54016110 con 0x7f7b640c92d0 2024-08-18T22:29:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 -- 172.21.15.5:0/2247772989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7b6406df80 con 0x7f7b640c92d0 2024-08-18T22:29:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b60c00640 1 -- 172.21.15.5:0/2247772989 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f7b540efad0 con 0x7f7b640c92d0 2024-08-18T22:29:58.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":661,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076423885,"bytes_used":2584207360,"bytes_avail":770509905920,"bytes_total":773094113280,"write_bytes_sec":28563058,"read_op_per_sec":0,"write_op_per_sec":29},"fsmap":{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9015}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-08-18T22:29:57.776947+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:29:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 -- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7b440678c0 msgr2=0x7f7b44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7b440678c0 0x7f7b44069d80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7b50006fd0 tx=0x7f7b50008040 comp rx=0 tx=0).stop 2024-08-18T22:29:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 -- 172.21.15.5:0/2247772989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b640c92d0 msgr2=0x7f7b640cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b640c92d0 0x7f7b640cb380 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f7b540ae040 tx=0x7f7b540192c0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 -- 172.21.15.5:0/2247772989 shutdown_connections 2024-08-18T22:29:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7b440678c0 0x7f7b44069d80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b64161d40 0x7f7b641520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b641618d0 0x7f7b640ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 --2- 172.21.15.5:0/2247772989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b640c92d0 0x7f7b640cb380 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 -- 172.21.15.5:0/2247772989 >> 172.21.15.5:0/2247772989 conn(0x7f7b640b1c50 msgr2=0x7f7b640b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 -- 172.21.15.5:0/2247772989 shutdown_connections 2024-08-18T22:29:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.277+0000 7f7b6b800640 1 -- 172.21.15.5:0/2247772989 wait complete. 2024-08-18T22:29:58.296 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-08-18T22:29:58.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:58.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub abort 2024-08-18T22:29:58.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dfc00640 1 Processor -- start 2024-08-18T22:29:58.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dfc00640 1 -- start start 2024-08-18T22:29:58.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dfc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24d815b0c0 0x7f24d806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dfc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24d80b40c0 0x7f24d80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dfc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d8072a30 0x7f24d8072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dfc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f24d80b4a70 con 0x7f24d815b0c0 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dfc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f24d80b3d70 con 0x7f24d80b40c0 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dfc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f24d80b31f0 con 0x7f24d8072a30 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dd200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24d815b0c0 0x7f24d806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dd200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24d815b0c0 0x7f24d806db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46202/0 (socket says 172.21.15.5:46202) 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dd200640 1 -- 172.21.15.5:0/409913271 learned_addr learned my addr 172.21.15.5:0/409913271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24ddc00640 1 --2- 172.21.15.5:0/409913271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d8072a30 0x7f24d8072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24d7e00640 1 --2- 172.21.15.5:0/409913271 >> v2:172.21.15.117:3300/0 conn(0x7f24d80b40c0 0x7f24d80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dd200640 1 -- 172.21.15.5:0/409913271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d8072a30 msgr2=0x7f24d8072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dd200640 1 --2- 172.21.15.5:0/409913271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d8072a30 0x7f24d8072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dd200640 1 -- 172.21.15.5:0/409913271 >> v2:172.21.15.117:3300/0 conn(0x7f24d80b40c0 msgr2=0x7f24d80b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dd200640 1 --2- 172.21.15.5:0/409913271 >> v2:172.21.15.117:3300/0 conn(0x7f24d80b40c0 0x7f24d80b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.441+0000 7f24dd200640 1 -- 172.21.15.5:0/409913271 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d80b34d0 con 0x7f24d815b0c0 2024-08-18T22:29:58.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24dd200640 1 --2- 172.21.15.5:0/409913271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d815b0c0 0x7f24d806db80 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f24d8073f90 tx=0x7f24c801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a012f9e1fc7288 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24d7400640 1 -- 172.21.15.5:0/409913271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80b2070 con 0x7f24d815b0c0 2024-08-18T22:29:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24d7400640 1 -- 172.21.15.5:0/409913271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c80ad640 con 0x7f24d815b0c0 2024-08-18T22:29:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24d7400640 1 -- 172.21.15.5:0/409913271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80ada10 con 0x7f24d815b0c0 2024-08-18T22:29:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24dfc00640 1 -- 172.21.15.5:0/409913271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d815b0c0 msgr2=0x7f24d806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24dfc00640 1 --2- 172.21.15.5:0/409913271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d815b0c0 0x7f24d806db80 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f24d8073f90 tx=0x7f24c801c3d0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24dfc00640 1 -- 172.21.15.5:0/409913271 shutdown_connections 2024-08-18T22:29:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24dfc00640 1 --2- 172.21.15.5:0/409913271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d8072a30 0x7f24d8072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24dfc00640 1 --2- 172.21.15.5:0/409913271 >> v2:172.21.15.117:3300/0 conn(0x7f24d80b40c0 0x7f24d80b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24dfc00640 1 --2- 172.21.15.5:0/409913271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d815b0c0 0x7f24d806db80 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24dfc00640 1 -- 172.21.15.5:0/409913271 >> 172.21.15.5:0/409913271 conn(0x7f24d80b1dc0 msgr2=0x7f24d80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24dfc00640 1 -- 172.21.15.5:0/409913271 shutdown_connections 2024-08-18T22:29:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.445+0000 7f24dfc00640 1 -- 172.21.15.5:0/409913271 wait complete. 2024-08-18T22:29:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dfc00640 1 Processor -- start 2024-08-18T22:29:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dfc00640 1 -- start start 2024-08-18T22:29:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dfc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d8072a30 0x7f24d81f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dfc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d80b40c0 0x7f24d814d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dfc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24d815b0c0 0x7f24d815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dfc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f24d815b620 con 0x7f24d8072a30 2024-08-18T22:29:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dfc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f24d815b4a0 con 0x7f24d815b0c0 2024-08-18T22:29:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dfc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f24d80737d0 con 0x7f24d80b40c0 2024-08-18T22:29:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dd200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d8072a30 0x7f24d81f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dd200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d8072a30 0x7f24d81f7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46210/0 (socket says 172.21.15.5:46210) 2024-08-18T22:29:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dd200640 1 -- 172.21.15.5:0/3512556723 learned_addr learned my addr 172.21.15.5:0/3512556723 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24d7e00640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d80b40c0 0x7f24d814d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24ddc00640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24d815b0c0 0x7f24d815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dd200640 1 -- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d80b40c0 msgr2=0x7f24d814d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dd200640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d80b40c0 0x7f24d814d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dd200640 1 -- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24d815b0c0 msgr2=0x7f24d815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dd200640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24d815b0c0 0x7f24d815b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dd200640 1 -- 172.21.15.5:0/3512556723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d81f8460 con 0x7f24d8072a30 2024-08-18T22:29:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dd200640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d8072a30 0x7f24d81f7f20 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f24c80b0040 tx=0x7f24c8019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24d4c00640 1 -- 172.21.15.5:0/3512556723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80bd070 con 0x7f24d8072a30 2024-08-18T22:29:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24d4c00640 1 -- 172.21.15.5:0/3512556723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c80b6750 con 0x7f24d8072a30 2024-08-18T22:29:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24d4c00640 1 -- 172.21.15.5:0/3512556723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80b2070 con 0x7f24d8072a30 2024-08-18T22:29:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dfc00640 1 -- 172.21.15.5:0/3512556723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d814d900 con 0x7f24d8072a30 2024-08-18T22:29:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.449+0000 7f24dfc00640 1 -- 172.21.15.5:0/3512556723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d8158920 con 0x7f24d8072a30 2024-08-18T22:29:58.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d4c00640 1 -- 172.21.15.5:0/3512556723 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24c80ad500 con 0x7f24d8072a30 2024-08-18T22:29:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d4c00640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24b80678c0 0x7f24b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d4c00640 1 -- 172.21.15.5:0/3512556723 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f24c811fc00 con 0x7f24d8072a30 2024-08-18T22:29:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d7e00640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24b80678c0 0x7f24b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24e3051000 1 Processor -- start 2024-08-18T22:29:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24e3051000 1 -- start start 2024-08-18T22:29:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d7e00640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24b80678c0 0x7f24b8069d80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f24d80cc280 tx=0x7f24c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24e3051000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9d42350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24e3051000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9cf5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24e3051000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9cf5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24e3051000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55eef9b46470 con 0x55eef9d42890 2024-08-18T22:29:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24e3051000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55eef9b00ad0 con 0x55eef9d41f70 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24e3051000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55eef9b42430 con 0x55eef9cf5b70 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9cf5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9cf5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46212/0 (socket says 172.21.15.5:46212) 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d7e00640 1 -- 172.21.15.5:0/688828443 learned_addr learned my addr 172.21.15.5:0/688828443 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24ddc00640 1 --2- 172.21.15.5:0/688828443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9cf5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24dd200640 1 --2- 172.21.15.5:0/688828443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9d42350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d7e00640 1 -- 172.21.15.5:0/688828443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 msgr2=0x55eef9cf5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d7e00640 1 --2- 172.21.15.5:0/688828443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9cf5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d7e00640 1 -- 172.21.15.5:0/688828443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 msgr2=0x55eef9d42350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d7e00640 1 --2- 172.21.15.5:0/688828443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9d42350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24d7e00640 1 -- 172.21.15.5:0/688828443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eef9ae6a10 con 0x55eef9d42890 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.453+0000 7f24ddc00640 1 --2- 172.21.15.5:0/688828443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9cf5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24d7e00640 1 --2- 172.21.15.5:0/688828443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9cf5630 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f24c400fa30 tx=0x7f24c4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15aa54806cc5ec server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24cd600640 1 -- 172.21.15.5:0/688828443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c401b050 con 0x55eef9d42890 2024-08-18T22:29:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24cd600640 1 -- 172.21.15.5:0/688828443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c4025070 con 0x55eef9d42890 2024-08-18T22:29:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24cd600640 1 -- 172.21.15.5:0/688828443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4014de0 con 0x55eef9d42890 2024-08-18T22:29:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 -- 172.21.15.5:0/688828443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 msgr2=0x55eef9cf5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 --2- 172.21.15.5:0/688828443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9cf5630 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f24c400fa30 tx=0x7f24c4012000 comp rx=0 tx=0).stop 2024-08-18T22:29:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 -- 172.21.15.5:0/688828443 shutdown_connections 2024-08-18T22:29:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 --2- 172.21.15.5:0/688828443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9cf5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 --2- 172.21.15.5:0/688828443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9cf5630 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 --2- 172.21.15.5:0/688828443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9d42350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 -- 172.21.15.5:0/688828443 >> 172.21.15.5:0/688828443 conn(0x55eef9cef680 msgr2=0x55eef9d24df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 -- 172.21.15.5:0/688828443 shutdown_connections 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 -- 172.21.15.5:0/688828443 wait complete. 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 -- start start 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 Processor -- start 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9cf5b70 0x55eef9cfc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9cfc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9d42890 0x55eef9cfceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55eef9b11770 con 0x55eef9cf5b70 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55eef9ae7c80 con 0x55eef9d41f70 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55eef9bc7130 con 0x55eef9d42890 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24e3051000 10 client.0 _ll_register_callbacks cb 0x55eef9ce30e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24dd200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9cf5b70 0x55eef9cfc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24dd200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9cf5b70 0x55eef9cfc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46228/0 (socket says 172.21.15.5:46228) 2024-08-18T22:29:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24dd200640 1 -- 172.21.15.5:0/2359885763 learned_addr learned my addr 172.21.15.5:0/2359885763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24ddc00640 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9d42890 0x55eef9cfceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24d7e00640 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9cfc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24dd200640 1 -- 172.21.15.5:0/2359885763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9d42890 msgr2=0x55eef9cfceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24dd200640 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9d42890 0x55eef9cfceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24dd200640 1 -- 172.21.15.5:0/2359885763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 msgr2=0x55eef9cfc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24dd200640 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9cfc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24dd200640 1 -- 172.21.15.5:0/2359885763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eef9afefe0 con 0x55eef9cf5b70 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24dd200640 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9cf5b70 0x55eef9cfc430 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f24c80efda0 tx=0x7f24c80f0510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9817b46e185c2ff server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.457+0000 7f24c2000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24c2000640 1 -- 172.21.15.5:0/2359885763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80f89f0 con 0x55eef9cf5b70 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24c2000640 1 -- 172.21.15.5:0/2359885763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f24c80f8560 con 0x55eef9cf5b70 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 -- 172.21.15.5:0/2359885763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24c4025070 con 0x55eef9cf5b70 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24c2000640 1 -- 172.21.15.5:0/2359885763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f24c80f8760 con 0x55eef9cf5b70 2024-08-18T22:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 10 client.9270 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 -- 172.21.15.5:0/2359885763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55eef9b12ed0 con 0x55eef9cf5b70 2024-08-18T22:29:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24c2000640 1 -- 172.21.15.5:0/2359885763 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c4025070 con 0x55eef9cf5b70 2024-08-18T22:29:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24c2000640 1 -- 172.21.15.5:0/2359885763 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7f24c810e170 con 0x55eef9cf5b70 2024-08-18T22:29:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 10 client.9270 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 10 client.9270 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 20 client.9270 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55eef9cfd8c0 0x55eef9d54020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 4 client.9270 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:29:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 -- 172.21.15.5:0/2359885763 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eef9ae0d90 con 0x55eef9cfd8c0 2024-08-18T22:29:58.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24d7e00640 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55eef9cfd8c0 0x55eef9d54020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24d7e00640 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55eef9cfd8c0 0x55eef9d54020 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=602cbbe83117b3f5 server_cookie=63b996604b9a4649 in_seq=0 out_seq=0 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24c2000640 10 client.9270 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24c2000640 1 -- 172.21.15.5:0/2359885763 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eef9ae0d90 con 0x55eef9cfd8c0 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24c2000640 10 client.9270 handle_command_reply: tid=0 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 client.9270 shutdown 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 -- 172.21.15.5:0/2359885763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9cf5b70 msgr2=0x55eef9cfc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9cf5b70 0x55eef9cfc430 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f24c80efda0 tx=0x7f24c80f0510 comp rx=0 tx=0).stop 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 -- 172.21.15.5:0/2359885763 shutdown_connections 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9d42890 0x55eef9cfceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9cfc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55eef9cfd8c0 0x55eef9d54020 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 --2- 172.21.15.5:0/2359885763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9cf5b70 0x55eef9cfc430 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 -- 172.21.15.5:0/2359885763 >> 172.21.15.5:0/2359885763 conn(0x55eef9cef680 msgr2=0x55eef9d24df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24c2000640 0 client.9270 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:58.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 -- 172.21.15.5:0/2359885763 shutdown_connections 2024-08-18T22:29:58.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 1 -- 172.21.15.5:0/2359885763 wait complete. 2024-08-18T22:29:58.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.461+0000 7f24e3051000 20 client.9270 trim_cache size 0 max 16384 2024-08-18T22:29:58.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 Processor -- start 2024-08-18T22:29:58.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 -- start start 2024-08-18T22:29:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9d57260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9d577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9d55030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8203ef0 con 0x55eef9d42890 2024-08-18T22:29:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8202f20 con 0x55eef9d41f70 2024-08-18T22:29:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f24d81faf40 con 0x55eef9cf5b70 2024-08-18T22:29:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ddc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9d55030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ddc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9d55030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46244/0 (socket says 172.21.15.5:46244) 2024-08-18T22:29:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ddc00640 1 -- 172.21.15.5:0/2063746800 learned_addr learned my addr 172.21.15.5:0/2063746800 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24dd200640 1 --2- 172.21.15.5:0/2063746800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9d57260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24d7e00640 1 --2- 172.21.15.5:0/2063746800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9d577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ddc00640 1 -- 172.21.15.5:0/2063746800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 msgr2=0x55eef9d57260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ddc00640 1 --2- 172.21.15.5:0/2063746800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9d57260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ddc00640 1 -- 172.21.15.5:0/2063746800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 msgr2=0x55eef9d577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ddc00640 1 --2- 172.21.15.5:0/2063746800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9d577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ddc00640 1 -- 172.21.15.5:0/2063746800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eef9bc75c0 con 0x55eef9d42890 2024-08-18T22:29:58.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ddc00640 1 --2- 172.21.15.5:0/2063746800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9d55030 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009f10 tx=0x7f24d0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998e291c2223e0cb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ccc00640 1 -- 172.21.15.5:0/2063746800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d001b030 con 0x55eef9d42890 2024-08-18T22:29:58.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ccc00640 1 -- 172.21.15.5:0/2063746800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d0017650 con 0x55eef9d42890 2024-08-18T22:29:58.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24ccc00640 1 -- 172.21.15.5:0/2063746800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0017840 con 0x55eef9d42890 2024-08-18T22:29:58.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 -- 172.21.15.5:0/2063746800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 msgr2=0x55eef9d55030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 --2- 172.21.15.5:0/2063746800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9d55030 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009f10 tx=0x7f24d0007700 comp rx=0 tx=0).stop 2024-08-18T22:29:58.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 -- 172.21.15.5:0/2063746800 shutdown_connections 2024-08-18T22:29:58.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 --2- 172.21.15.5:0/2063746800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9d55030 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 --2- 172.21.15.5:0/2063746800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9d577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 --2- 172.21.15.5:0/2063746800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9d57260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 -- 172.21.15.5:0/2063746800 >> 172.21.15.5:0/2063746800 conn(0x55eef9cef680 msgr2=0x55eef9cf53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 -- 172.21.15.5:0/2063746800 shutdown_connections 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 -- 172.21.15.5:0/2063746800 wait complete. 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.481+0000 7f24e3051000 1 -- start start 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 Processor -- start 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9db5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9db6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9db6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55eef9aeda10 con 0x55eef9d42890 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f24d81fb590 con 0x55eef9d41f70 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55eef9b45780 con 0x55eef9cf5b70 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 10 client.0 _ll_register_callbacks cb 0x7f24c80efbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:58.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24ddc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9db6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24d7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9db6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24d7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9db6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:48624/0 (socket says 172.21.15.5:48624) 2024-08-18T22:29:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24d7e00640 1 -- 172.21.15.5:0/2485929404 learned_addr learned my addr 172.21.15.5:0/2485929404 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24dd200640 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9db5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24ddc00640 1 -- 172.21.15.5:0/2485929404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 msgr2=0x55eef9db5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24ddc00640 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9db5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24ddc00640 1 -- 172.21.15.5:0/2485929404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 msgr2=0x55eef9db6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24ddc00640 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9db6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24ddc00640 1 -- 172.21.15.5:0/2485929404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eef9ad9c50 con 0x55eef9d42890 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24ddc00640 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9db6780 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f24d001e000 tx=0x7f24d0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7db73da71ed17f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24c2000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24c2000640 1 -- 172.21.15.5:0/2485929404 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d002d060 con 0x55eef9d42890 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24c2000640 1 -- 172.21.15.5:0/2485929404 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f24d0020820 con 0x55eef9d42890 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 -- 172.21.15.5:0/2485929404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24d0017650 con 0x55eef9d42890 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24c2000640 1 -- 172.21.15.5:0/2485929404 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f24d0033050 con 0x55eef9d42890 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 10 client.9276 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 -- 172.21.15.5:0/2485929404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55eef9aec2a0 con 0x55eef9d42890 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24c2000640 1 -- 172.21.15.5:0/2485929404 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d0017650 con 0x55eef9d42890 2024-08-18T22:29:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24c2000640 1 -- 172.21.15.5:0/2485929404 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7f24d0036020 con 0x55eef9d42890 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 10 client.9276 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 10 client.9276 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 20 client.9276 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55eef9d717d0 0x55eef9d71bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 4 client.9276 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 -- 172.21.15.5:0/2485929404 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55eef9b53ba0 con 0x55eef9d717d0 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24dd200640 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55eef9d717d0 0x55eef9d71bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24dd200640 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55eef9d717d0 0x55eef9d71bb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f08672ad538fb782 server_cookie=751e7244ef481753 in_seq=0 out_seq=0 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24c2000640 10 client.9276 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24c2000640 1 -- 172.21.15.5:0/2485929404 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eef9b53ba0 con 0x55eef9d717d0 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24c2000640 10 client.9276 handle_command_reply: tid=0 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.485+0000 7f24e3051000 1 client.9276 shutdown 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24e3051000 1 -- 172.21.15.5:0/2485929404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 msgr2=0x55eef9db6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24e3051000 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9db6780 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f24d001e000 tx=0x7f24d0004ac0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24e3051000 1 -- 172.21.15.5:0/2485929404 shutdown_connections 2024-08-18T22:29:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24e3051000 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55eef9d717d0 0x55eef9d71bb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24e3051000 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eef9d42890 0x55eef9db6780 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24e3051000 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55eef9d41f70 0x55eef9db6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24c2000640 0 client.9276 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24e3051000 1 --2- 172.21.15.5:0/2485929404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55eef9cf5b70 0x55eef9db5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24e3051000 1 -- 172.21.15.5:0/2485929404 >> 172.21.15.5:0/2485929404 conn(0x55eef9cef680 msgr2=0x55eef9cf50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24e3051000 1 -- 172.21.15.5:0/2485929404 shutdown_connections 2024-08-18T22:29:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24e3051000 1 -- 172.21.15.5:0/2485929404 wait complete. 2024-08-18T22:29:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24e3051000 20 client.9276 trim_cache size 0 max 16384 2024-08-18T22:29:58.491 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:29:58.491 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:29:58.491 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:29:58.491 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:29:58.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 -- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24b80678c0 msgr2=0x7f24b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24b80678c0 0x7f24b8069d80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f24d80cc280 tx=0x7f24c4008040 comp rx=0 tx=0).stop 2024-08-18T22:29:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 -- 172.21.15.5:0/3512556723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d8072a30 msgr2=0x7f24d81f7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d8072a30 0x7f24d81f7f20 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f24c80b0040 tx=0x7f24c8019170 comp rx=0 tx=0).stop 2024-08-18T22:29:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 -- 172.21.15.5:0/3512556723 shutdown_connections 2024-08-18T22:29:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24b80678c0 0x7f24b8069d80 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24d815b0c0 0x7f24d815b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24d80b40c0 0x7f24d814d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 --2- 172.21.15.5:0/3512556723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d8072a30 0x7f24d81f7f20 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 -- 172.21.15.5:0/3512556723 >> 172.21.15.5:0/3512556723 conn(0x7f24d80b1dc0 msgr2=0x7f24d80cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 -- 172.21.15.5:0/3512556723 shutdown_connections 2024-08-18T22:29:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.489+0000 7f24dfc00640 1 -- 172.21.15.5:0/3512556723 wait complete. 2024-08-18T22:29:58.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:58.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-08-18T22:29:58.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.649+0000 7fbede800640 1 Processor -- start 2024-08-18T22:29:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.649+0000 7fbede800640 1 -- start start 2024-08-18T22:29:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.649+0000 7fbede800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbed80b40c0 0x7fbed80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.649+0000 7fbede800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbed80ce280 0x7fbed80ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.649+0000 7fbede800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed80b31f0 con 0x7fbed815b0c0 2024-08-18T22:29:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.649+0000 7fbede800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbed80b4a70 con 0x7fbed80b40c0 2024-08-18T22:29:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.649+0000 7fbede800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbed80b3d70 con 0x7fbed80ce280 2024-08-18T22:29:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbed7400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbed815b0c0 0x7fbed806db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52992/0 (socket says 172.21.15.5:52992) 2024-08-18T22:29:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbed7400640 1 -- 172.21.15.5:0/2409014861 learned_addr learned my addr 172.21.15.5:0/2409014861 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbecea00640 1 --2- 172.21.15.5:0/2409014861 >> v2:172.21.15.117:3300/0 conn(0x7fbed80b40c0 0x7fbed80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbed7e00640 1 --2- 172.21.15.5:0/2409014861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbed80ce280 0x7fbed80ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbed6a00640 1 -- 172.21.15.5:0/2409014861 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844681856 0 0) 0x7fbed80b31f0 con 0x7fbed815b0c0 2024-08-18T22:29:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbed6a00640 1 -- 172.21.15.5:0/2409014861 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbebc003530 con 0x7fbed815b0c0 2024-08-18T22:29:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbecea00640 1 -- 172.21.15.5:0/2409014861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbed80ce280 msgr2=0x7fbed80ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbecea00640 1 --2- 172.21.15.5:0/2409014861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbed80ce280 0x7fbed80ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbecea00640 1 -- 172.21.15.5:0/2409014861 >> v1:172.21.15.5:6789/0 conn(0x7fbed815b0c0 legacy=0x7fbed806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbecea00640 1 -- 172.21.15.5:0/2409014861 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed80b34d0 con 0x7fbed80b40c0 2024-08-18T22:29:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbed7e00640 1 --2- 172.21.15.5:0/2409014861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbed80ce280 0x7fbed80ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:58.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.653+0000 7fbecea00640 1 --2- 172.21.15.5:0/2409014861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbed80b40c0 0x7fbed80b4530 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbec00097c0 tx=0x7fbec001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae72658e770c06d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbed6a00640 1 -- 172.21.15.5:0/2409014861 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec00b0070 con 0x7fbed80b40c0 2024-08-18T22:29:58.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbed6a00640 1 -- 172.21.15.5:0/2409014861 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec00ab600 con 0x7fbed80b40c0 2024-08-18T22:29:58.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbed6a00640 1 -- 172.21.15.5:0/2409014861 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec00ab9b0 con 0x7fbed80b40c0 2024-08-18T22:29:58.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 -- 172.21.15.5:0/2409014861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbed80b40c0 msgr2=0x7fbed80b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 --2- 172.21.15.5:0/2409014861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbed80b40c0 0x7fbed80b4530 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbec00097c0 tx=0x7fbec001c380 comp rx=0 tx=0).stop 2024-08-18T22:29:58.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 -- 172.21.15.5:0/2409014861 shutdown_connections 2024-08-18T22:29:58.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 --2- 172.21.15.5:0/2409014861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbed80ce280 0x7fbed80ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 --2- 172.21.15.5:0/2409014861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbed80b40c0 0x7fbed80b4530 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 -- 172.21.15.5:0/2409014861 >> 172.21.15.5:0/2409014861 conn(0x7fbed80b1dc0 msgr2=0x7fbed80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 -- 172.21.15.5:0/2409014861 shutdown_connections 2024-08-18T22:29:58.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 -- 172.21.15.5:0/2409014861 wait complete. 2024-08-18T22:29:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 Processor -- start 2024-08-18T22:29:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 -- start start 2024-08-18T22:29:58.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed80b40c0 0x7fbed815d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbed80ce280 0x7fbed8168560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbed815b0c0 0x7fbed814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbed806f7f0 con 0x7fbed80b40c0 2024-08-18T22:29:58.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbed806f670 con 0x7fbed80ce280 2024-08-18T22:29:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbede800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbed8165d00 con 0x7fbed815b0c0 2024-08-18T22:29:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbed7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed80b40c0 0x7fbed815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbed7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed80b40c0 0x7fbed815d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46264/0 (socket says 172.21.15.5:46264) 2024-08-18T22:29:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbed7400640 1 -- 172.21.15.5:0/3618287151 learned_addr learned my addr 172.21.15.5:0/3618287151 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbed7400640 1 -- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbed815b0c0 msgr2=0x7fbed814ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbed7400640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbed815b0c0 0x7fbed814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbecea00640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbed80ce280 0x7fbed8168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbed7400640 1 -- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbed80ce280 msgr2=0x7fbed8168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.657+0000 7fbed7400640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbed80ce280 0x7fbed8168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbed7400640 1 -- 172.21.15.5:0/3618287151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed815c6f0 con 0x7fbed80b40c0 2024-08-18T22:29:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbecea00640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbed80ce280 0x7fbed8168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbed7400640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed80b40c0 0x7fbed815d750 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c370 tx=0x7fbec800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbecfe00640 1 -- 172.21.15.5:0/3618287151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8017070 con 0x7fbed80b40c0 2024-08-18T22:29:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbecfe00640 1 -- 172.21.15.5:0/3618287151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec8005cf0 con 0x7fbed80b40c0 2024-08-18T22:29:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbecfe00640 1 -- 172.21.15.5:0/3618287151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec80072f0 con 0x7fbed80b40c0 2024-08-18T22:29:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbede800640 1 -- 172.21.15.5:0/3618287151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed8168aa0 con 0x7fbed80b40c0 2024-08-18T22:29:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbede800640 1 -- 172.21.15.5:0/3618287151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed815cc70 con 0x7fbed80b40c0 2024-08-18T22:29:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbecfe00640 1 -- 172.21.15.5:0/3618287151 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbec801a070 con 0x7fbed80b40c0 2024-08-18T22:29:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbecfe00640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb40678f0 0x7fbeb4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbecfe00640 1 -- 172.21.15.5:0/3618287151 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fbec8085260 con 0x7fbed80b40c0 2024-08-18T22:29:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbecea00640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb40678f0 0x7fbeb4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbee1d95000 1 Processor -- start 2024-08-18T22:29:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.661+0000 7fbee1d95000 1 -- start start 2024-08-18T22:29:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbecea00640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb40678f0 0x7fbeb4069db0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbec00ad000 tx=0x7fbec0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 0x55c9c0ba3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0b56fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0b57500 0x55c9c0b578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c9c0a40ae0 con 0x55c9c0ba42c0 2024-08-18T22:29:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c9c0a2cba0 con 0x55c9c0ba39a0 2024-08-18T22:29:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c9c09a74f0 con 0x55c9c0b57500 2024-08-18T22:29:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbecea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0b56fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbecea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0b56fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46276/0 (socket says 172.21.15.5:46276) 2024-08-18T22:29:58.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbecea00640 1 -- 172.21.15.5:0/1582558638 learned_addr learned my addr 172.21.15.5:0/1582558638 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbed7400640 1 --2- 172.21.15.5:0/1582558638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 0x55c9c0ba3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbecea00640 1 -- 172.21.15.5:0/1582558638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0b57500 msgr2=0x55c9c0b578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbed7e00640 1 --2- 172.21.15.5:0/1582558638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0b57500 0x55c9c0b578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbecea00640 1 --2- 172.21.15.5:0/1582558638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0b57500 0x55c9c0b578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbecea00640 1 -- 172.21.15.5:0/1582558638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 msgr2=0x55c9c0ba3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbecea00640 1 --2- 172.21.15.5:0/1582558638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 0x55c9c0ba3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbecea00640 1 -- 172.21.15.5:0/1582558638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c0947a90 con 0x55c9c0ba42c0 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbed7400640 1 --2- 172.21.15.5:0/1582558638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 0x55c9c0ba3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbed7e00640 1 --2- 172.21.15.5:0/1582558638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0b57500 0x55c9c0b578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbecea00640 1 --2- 172.21.15.5:0/1582558638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0b56fc0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fbec00ae040 tx=0x7fbec00a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417f793229dee83c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbec7e00640 1 -- 172.21.15.5:0/1582558638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec00c7070 con 0x55c9c0ba42c0 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbec7e00640 1 -- 172.21.15.5:0/1582558638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec00b1040 con 0x55c9c0ba42c0 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbec7e00640 1 -- 172.21.15.5:0/1582558638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec00b7830 con 0x55c9c0ba42c0 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 -- 172.21.15.5:0/1582558638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 msgr2=0x55c9c0b56fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 --2- 172.21.15.5:0/1582558638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0b56fc0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fbec00ae040 tx=0x7fbec00a6000 comp rx=0 tx=0).stop 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 -- 172.21.15.5:0/1582558638 shutdown_connections 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 --2- 172.21.15.5:0/1582558638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0b57500 0x55c9c0b578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 --2- 172.21.15.5:0/1582558638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0b56fc0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 --2- 172.21.15.5:0/1582558638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 0x55c9c0ba3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 -- 172.21.15.5:0/1582558638 >> 172.21.15.5:0/1582558638 conn(0x55c9c0b51010 msgr2=0x55c9c0b86820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 -- 172.21.15.5:0/1582558638 shutdown_connections 2024-08-18T22:29:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 -- 172.21.15.5:0/1582558638 wait complete. 2024-08-18T22:29:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 -- start start 2024-08-18T22:29:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.665+0000 7fbee1d95000 1 Processor -- start 2024-08-18T22:29:58.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0b84040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 0x55c9c0b5f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba42c0 0x55c9c0b5f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c9c09a34b0 con 0x55c9c0b57500 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c9c0961b50 con 0x55c9c0ba39a0 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c9c0948d00 con 0x55c9c0ba42c0 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 10 client.0 _ll_register_callbacks cb 0x55c9c0b44f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbed7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0b84040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbed7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0b84040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46290/0 (socket says 172.21.15.5:46290) 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbed7400640 1 -- 172.21.15.5:0/530137286 learned_addr learned my addr 172.21.15.5:0/530137286 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbecea00640 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 0x55c9c0b5f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbed7e00640 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba42c0 0x55c9c0b5f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbed7400640 1 -- 172.21.15.5:0/530137286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba42c0 msgr2=0x55c9c0b5f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbed7400640 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba42c0 0x55c9c0b5f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbed7400640 1 -- 172.21.15.5:0/530137286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 msgr2=0x55c9c0b5f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbed7400640 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 0x55c9c0b5f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbed7400640 1 -- 172.21.15.5:0/530137286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c0960060 con 0x55c9c0b57500 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbecea00640 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 0x55c9c0b5f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbed7400640 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0b84040 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fbec8055400 tx=0x7fbec8055cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2842f999e95095b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbec4c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbec4c00640 1 -- 172.21.15.5:0/530137286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8007690 con 0x55c9c0b57500 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbec4c00640 1 -- 172.21.15.5:0/530137286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fbec806d1d0 con 0x55c9c0b57500 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 1 -- 172.21.15.5:0/530137286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbec00b1040 con 0x55c9c0b57500 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbec4c00640 1 -- 172.21.15.5:0/530137286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fbec8083050 con 0x55c9c0b57500 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 10 client.9288 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 1 -- 172.21.15.5:0/530137286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55c9c0973f50 con 0x55c9c0b57500 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbec4c00640 1 -- 172.21.15.5:0/530137286 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec00b1040 con 0x55c9c0b57500 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbec4c00640 1 -- 172.21.15.5:0/530137286 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7fbec80548c0 con 0x55c9c0b57500 2024-08-18T22:29:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 10 client.9288 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 10 client.9288 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 20 client.9288 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55c9c0b85d30 0x55c9c0b86140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 4 client.9288 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:29:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 1 -- 172.21.15.5:0/530137286 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9c0941e10 con 0x55c9c0b85d30 2024-08-18T22:29:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbecea00640 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55c9c0b85d30 0x55c9c0b86140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbecea00640 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55c9c0b85d30 0x55c9c0b86140 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=802644a8a0346133 server_cookie=993c4f10a7e6f6a4 in_seq=0 out_seq=0 2024-08-18T22:29:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbec4c00640 10 client.9288 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbec4c00640 1 -- 172.21.15.5:0/530137286 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c9c0941e10 con 0x55c9c0b85d30 2024-08-18T22:29:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbec4c00640 10 client.9288 handle_command_reply: tid=0 2024-08-18T22:29:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.669+0000 7fbee1d95000 1 client.9288 shutdown 2024-08-18T22:29:58.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbee1d95000 1 -- 172.21.15.5:0/530137286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 msgr2=0x55c9c0b84040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbee1d95000 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0b84040 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fbec8055400 tx=0x7fbec8055cb0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbee1d95000 1 -- 172.21.15.5:0/530137286 shutdown_connections 2024-08-18T22:29:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbee1d95000 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba42c0 0x55c9c0b5f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbee1d95000 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba39a0 0x55c9c0b5f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbee1d95000 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55c9c0b85d30 0x55c9c0b86140 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbee1d95000 1 --2- 172.21.15.5:0/530137286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0b84040 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbec4c00640 0 client.9288 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbee1d95000 1 -- 172.21.15.5:0/530137286 >> 172.21.15.5:0/530137286 conn(0x55c9c0b51010 msgr2=0x55c9c0b566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbee1d95000 1 -- 172.21.15.5:0/530137286 shutdown_connections 2024-08-18T22:29:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbee1d95000 1 -- 172.21.15.5:0/530137286 wait complete. 2024-08-18T22:29:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.673+0000 7fbee1d95000 20 client.9288 trim_cache size 0 max 16384 2024-08-18T22:29:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbee1d95000 1 Processor -- start 2024-08-18T22:29:58.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbee1d95000 1 -- start start 2024-08-18T22:29:58.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0bbb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba39a0 0x55c9c0b84c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba42c0 0x55c9c0b85150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbee1d95000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbed8203b50 con 0x55c9c0b57500 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbee1d95000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbed8202bd0 con 0x55c9c0ba42c0 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbee1d95000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbed8167770 con 0x55c9c0ba39a0 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbed7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0bbb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbed7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0bbb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46304/0 (socket says 172.21.15.5:46304) 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbed7400640 1 -- 172.21.15.5:0/610786951 learned_addr learned my addr 172.21.15.5:0/610786951 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbecea00640 1 --2- 172.21.15.5:0/610786951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba39a0 0x55c9c0b84c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.689+0000 7fbed7e00640 1 --2- 172.21.15.5:0/610786951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba42c0 0x55c9c0b85150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7400640 1 -- 172.21.15.5:0/610786951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba39a0 msgr2=0x55c9c0b84c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7400640 1 --2- 172.21.15.5:0/610786951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba39a0 0x55c9c0b84c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7400640 1 -- 172.21.15.5:0/610786951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba42c0 msgr2=0x55c9c0b85150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7400640 1 --2- 172.21.15.5:0/610786951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba42c0 0x55c9c0b85150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7400640 1 -- 172.21.15.5:0/610786951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c0a29dd0 con 0x55c9c0b57500 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbecea00640 1 --2- 172.21.15.5:0/610786951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba39a0 0x55c9c0b84c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7400640 1 --2- 172.21.15.5:0/610786951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0bbb2e0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fbec8005ec0 tx=0x7fbec8057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b25a5fcdcd438b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbec7400640 1 -- 172.21.15.5:0/610786951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8055240 con 0x55c9c0b57500 2024-08-18T22:29:58.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbec7400640 1 -- 172.21.15.5:0/610786951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec805e050 con 0x55c9c0b57500 2024-08-18T22:29:58.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbec7400640 1 -- 172.21.15.5:0/610786951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec80548c0 con 0x55c9c0b57500 2024-08-18T22:29:58.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 -- 172.21.15.5:0/610786951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 msgr2=0x55c9c0bbb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 --2- 172.21.15.5:0/610786951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0bbb2e0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fbec8005ec0 tx=0x7fbec8057000 comp rx=0 tx=0).stop 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 -- 172.21.15.5:0/610786951 shutdown_connections 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 --2- 172.21.15.5:0/610786951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0ba42c0 0x55c9c0b85150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 --2- 172.21.15.5:0/610786951 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba39a0 0x55c9c0b84c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 --2- 172.21.15.5:0/610786951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0b57500 0x55c9c0bbb2e0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 -- 172.21.15.5:0/610786951 >> 172.21.15.5:0/610786951 conn(0x55c9c0b51010 msgr2=0x55c9c0b84500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 -- 172.21.15.5:0/610786951 shutdown_connections 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 -- 172.21.15.5:0/610786951 wait complete. 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 -- start start 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 Processor -- start 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0b57500 0x55c9c0c17250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba39a0 0x55c9c0c17790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0c17cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c9c09abb20 con 0x55c9c0ba42c0 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c9c09827a0 con 0x55c9c0b57500 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55c9c0961b50 con 0x55c9c0ba39a0 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbee1d95000 10 client.0 _ll_register_callbacks cb 0x7fbec8051790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0c17cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0c17cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46314/0 (socket says 172.21.15.5:46314) 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7e00640 1 -- 172.21.15.5:0/744798334 learned_addr learned my addr 172.21.15.5:0/744798334 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7400640 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0b57500 0x55c9c0c17250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbecea00640 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba39a0 0x55c9c0c17790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7e00640 1 -- 172.21.15.5:0/744798334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba39a0 msgr2=0x55c9c0c17790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7e00640 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba39a0 0x55c9c0c17790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7e00640 1 -- 172.21.15.5:0/744798334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0b57500 msgr2=0x55c9c0c17250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7e00640 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0b57500 0x55c9c0c17250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.693+0000 7fbed7e00640 1 -- 172.21.15.5:0/744798334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c093acd0 con 0x55c9c0ba42c0 2024-08-18T22:29:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbed7e00640 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0c17cd0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fbed0004480 tx=0x7fbed0004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f36dbb2b871d64 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbec4c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbec4c00640 1 -- 172.21.15.5:0/744798334 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed001b020 con 0x55c9c0ba42c0 2024-08-18T22:29:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 -- 172.21.15.5:0/744798334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbec805e050 con 0x55c9c0ba42c0 2024-08-18T22:29:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbec4c00640 1 -- 172.21.15.5:0/744798334 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fbed0007c20 con 0x55c9c0ba42c0 2024-08-18T22:29:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbec4c00640 1 -- 172.21.15.5:0/744798334 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fbed0025050 con 0x55c9c0ba42c0 2024-08-18T22:29:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 10 client.9294 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 -- 172.21.15.5:0/744798334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55c9c094d320 con 0x55c9c0ba42c0 2024-08-18T22:29:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbec4c00640 1 -- 172.21.15.5:0/744798334 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec805e050 con 0x55c9c0ba42c0 2024-08-18T22:29:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbec4c00640 1 -- 172.21.15.5:0/744798334 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7fbed0028020 con 0x55c9c0ba42c0 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 10 client.9294 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 10 client.9294 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 20 client.9294 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55c9c0bb93b0 0x55c9c0bb97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 4 client.9294 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 -- 172.21.15.5:0/744798334 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c9c09b4c20 con 0x55c9c0bb93b0 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbed7400640 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55c9c0bb93b0 0x55c9c0bb97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbed7400640 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55c9c0bb93b0 0x55c9c0bb97c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75b91728be5c6dda server_cookie=94b16cd1c5fb4ec5 in_seq=0 out_seq=0 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbec4c00640 10 client.9294 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbec4c00640 1 -- 172.21.15.5:0/744798334 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+69 (crc 0 0 0) 0x55c9c09b4c20 con 0x55c9c0bb93b0 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbec4c00640 10 client.9294 handle_command_reply: tid=0 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 client.9294 shutdown 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 -- 172.21.15.5:0/744798334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 msgr2=0x55c9c0c17cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0c17cd0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fbed0004480 tx=0x7fbed0004940 comp rx=0 tx=0).stop 2024-08-18T22:29:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 -- 172.21.15.5:0/744798334 shutdown_connections 2024-08-18T22:29:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55c9c0bb93b0 0x55c9c0bb97c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c9c0ba42c0 0x55c9c0c17cd0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55c9c0ba39a0 0x55c9c0c17790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 --2- 172.21.15.5:0/744798334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c9c0b57500 0x55c9c0c17250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbec4c00640 0 client.9294 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 -- 172.21.15.5:0/744798334 >> 172.21.15.5:0/744798334 conn(0x55c9c0b51010 msgr2=0x55c9c0b84d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 -- 172.21.15.5:0/744798334 shutdown_connections 2024-08-18T22:29:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 1 -- 172.21.15.5:0/744798334 wait complete. 2024-08-18T22:29:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbee1d95000 20 client.9294 trim_cache size 0 max 16384 2024-08-18T22:29:58.700 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:29:58.701 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-08-18T22:29:58.701 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-08-18T22:29:58.701 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:29:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 -- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb40678f0 msgr2=0x7fbeb4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb40678f0 0x7fbeb4069db0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbec00ad000 tx=0x7fbec0008040 comp rx=0 tx=0).stop 2024-08-18T22:29:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 -- 172.21.15.5:0/3618287151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed80b40c0 msgr2=0x7fbed815d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed80b40c0 0x7fbed815d750 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c370 tx=0x7fbec800c830 comp rx=0 tx=0).stop 2024-08-18T22:29:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 -- 172.21.15.5:0/3618287151 shutdown_connections 2024-08-18T22:29:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb40678f0 0x7fbeb4069db0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbed815b0c0 0x7fbed814ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbed80ce280 0x7fbed8168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 --2- 172.21.15.5:0/3618287151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbed80b40c0 0x7fbed815d750 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 -- 172.21.15.5:0/3618287151 >> 172.21.15.5:0/3618287151 conn(0x7fbed80b1dc0 msgr2=0x7fbed80b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 -- 172.21.15.5:0/3618287151 shutdown_connections 2024-08-18T22:29:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.697+0000 7fbede800640 1 -- 172.21.15.5:0/3618287151 wait complete. 2024-08-18T22:29:58.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:29:58.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb36c600640 1 Processor -- start 2024-08-18T22:29:58.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb36c600640 1 -- start start 2024-08-18T22:29:58.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb36c600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb36415b010 0x7fb3640ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb36c600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb36406f290 0x7fb364072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb36c600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3640cee20 con 0x7fb3640cd3a0 2024-08-18T22:29:58.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb36c600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb3640cfa30 con 0x7fb36415b010 2024-08-18T22:29:58.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb36c600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb3640cf100 con 0x7fb36406f290 2024-08-18T22:29:58.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb369200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3640cd3a0 0x7fb36406eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53008/0 (socket says 172.21.15.5:53008) 2024-08-18T22:29:58.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb369200640 1 -- 172.21.15.5:0/3001814215 learned_addr learned my addr 172.21.15.5:0/3001814215 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb369c00640 1 --2- 172.21.15.5:0/3001814215 >> v2:172.21.15.117:3300/0 conn(0x7fb36415b010 0x7fb3640ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb36a600640 1 --2- 172.21.15.5:0/3001814215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb36406f290 0x7fb364072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb363e00640 1 -- 172.21.15.5:0/3001814215 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4026785168 0 0) 0x7fb3640cee20 con 0x7fb3640cd3a0 2024-08-18T22:29:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb363e00640 1 -- 172.21.15.5:0/3001814215 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb34c003530 con 0x7fb3640cd3a0 2024-08-18T22:29:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb363e00640 1 -- 172.21.15.5:0/3001814215 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2148253773 0 0) 0x7fb34c003530 con 0x7fb3640cd3a0 2024-08-18T22:29:58.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb369c00640 1 -- 172.21.15.5:0/3001814215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb36406f290 msgr2=0x7fb364072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:58.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb369c00640 1 --2- 172.21.15.5:0/3001814215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb36406f290 0x7fb364072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb369c00640 1 -- 172.21.15.5:0/3001814215 >> v1:172.21.15.5:6789/0 conn(0x7fb3640cd3a0 legacy=0x7fb36406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.857+0000 7fb369c00640 1 -- 172.21.15.5:0/3001814215 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3640cf3e0 con 0x7fb36415b010 2024-08-18T22:29:58.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.861+0000 7fb369c00640 1 --2- 172.21.15.5:0/3001814215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb36415b010 0x7fb3640ce840 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb3580097c0 tx=0x7fb35801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97ea027628e9c120 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.861+0000 7fb363e00640 1 -- 172.21.15.5:0/3001814215 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580b0070 con 0x7fb36415b010 2024-08-18T22:29:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.861+0000 7fb363e00640 1 -- 172.21.15.5:0/3001814215 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3580ab400 con 0x7fb36415b010 2024-08-18T22:29:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.861+0000 7fb363e00640 1 -- 172.21.15.5:0/3001814215 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350001680 con 0x7fb36415b010 2024-08-18T22:29:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.861+0000 7fb36c600640 1 -- 172.21.15.5:0/3001814215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb36415b010 msgr2=0x7fb3640ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.861+0000 7fb36c600640 1 --2- 172.21.15.5:0/3001814215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb36415b010 0x7fb3640ce840 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb3580097c0 tx=0x7fb35801c390 comp rx=0 tx=0).stop 2024-08-18T22:29:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.861+0000 7fb36c600640 1 -- 172.21.15.5:0/3001814215 shutdown_connections 2024-08-18T22:29:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.861+0000 7fb36c600640 1 --2- 172.21.15.5:0/3001814215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb36406f290 0x7fb364072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.861+0000 7fb36c600640 1 --2- 172.21.15.5:0/3001814215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb36415b010 0x7fb3640ce840 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.861+0000 7fb36c600640 1 -- 172.21.15.5:0/3001814215 >> 172.21.15.5:0/3001814215 conn(0x7fb3640b1c50 msgr2=0x7fb3640b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.861+0000 7fb36c600640 1 -- 172.21.15.5:0/3001814215 shutdown_connections 2024-08-18T22:29:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36c600640 1 -- 172.21.15.5:0/3001814215 wait complete. 2024-08-18T22:29:58.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36c600640 1 Processor -- start 2024-08-18T22:29:58.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36c600640 1 -- start start 2024-08-18T22:29:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36c600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb36406f290 0x7fb364151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36c600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3640cd3a0 0x7fb3640b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36c600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb36415b010 0x7fb3640b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36c600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb3640734f0 con 0x7fb36406f290 2024-08-18T22:29:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36c600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb364073370 con 0x7fb36415b010 2024-08-18T22:29:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36c600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb364073670 con 0x7fb3640cd3a0 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb369c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb36406f290 0x7fb364151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb369c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb36406f290 0x7fb364151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46318/0 (socket says 172.21.15.5:46318) 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb369c00640 1 -- 172.21.15.5:0/1633431710 learned_addr learned my addr 172.21.15.5:0/1633431710 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb369200640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3640cd3a0 0x7fb3640b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36a600640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb36415b010 0x7fb3640b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb369c00640 1 -- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3640cd3a0 msgr2=0x7fb3640b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb369c00640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3640cd3a0 0x7fb3640b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb369c00640 1 -- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb36415b010 msgr2=0x7fb3640b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb369c00640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb36415b010 0x7fb3640b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb369c00640 1 -- 172.21.15.5:0/1633431710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36409d810 con 0x7fb36406f290 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36a600640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb36415b010 0x7fb3640b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb369200640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3640cd3a0 0x7fb3640b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb369c00640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb36406f290 0x7fb364151730 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb358000c10 tx=0x7fb358019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb361600640 1 -- 172.21.15.5:0/1633431710 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580b9020 con 0x7fb36406f290 2024-08-18T22:29:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb361600640 1 -- 172.21.15.5:0/1633431710 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb358003820 con 0x7fb36406f290 2024-08-18T22:29:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb36c600640 1 -- 172.21.15.5:0/1633431710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb36409daf0 con 0x7fb36406f290 2024-08-18T22:29:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.865+0000 7fb361600640 1 -- 172.21.15.5:0/1633431710 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580b0040 con 0x7fb36406f290 2024-08-18T22:29:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.869+0000 7fb36c600640 1 -- 172.21.15.5:0/1633431710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3640b3cc0 con 0x7fb36406f290 2024-08-18T22:29:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.869+0000 7fb36c600640 1 -- 172.21.15.5:0/1633431710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb364072620 con 0x7fb36406f290 2024-08-18T22:29:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.869+0000 7fb361600640 1 -- 172.21.15.5:0/1633431710 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3580bc020 con 0x7fb36406f290 2024-08-18T22:29:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.869+0000 7fb361600640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3440678f0 0x7fb344069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.869+0000 7fb361600640 1 -- 172.21.15.5:0/1633431710 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fb35811fc70 con 0x7fb36406f290 2024-08-18T22:29:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.869+0000 7fb369200640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3440678f0 0x7fb344069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.869+0000 7fb369200640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3440678f0 0x7fb344069db0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb3640cbdf0 tx=0x7fb350009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:58.873+0000 7fb361600640 1 -- 172.21.15.5:0/1633431710 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb3580c3030 con 0x7fb36406f290 2024-08-18T22:29:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 -- 172.21.15.5:0/1633431710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3640b18c0 con 0x7fb36406f290 2024-08-18T22:29:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb361600640 1 -- 172.21.15.5:0/1633431710 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7fb358015fb0 con 0x7fb36406f290 2024-08-18T22:29:59.075 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:59.075 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:29:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:29:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 -- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3440678f0 msgr2=0x7fb344069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3440678f0 0x7fb344069db0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb3640cbdf0 tx=0x7fb350009040 comp rx=0 tx=0).stop 2024-08-18T22:29:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 -- 172.21.15.5:0/1633431710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb36406f290 msgr2=0x7fb364151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb36406f290 0x7fb364151730 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb358000c10 tx=0x7fb358019130 comp rx=0 tx=0).stop 2024-08-18T22:29:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 -- 172.21.15.5:0/1633431710 shutdown_connections 2024-08-18T22:29:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb3440678f0 0x7fb344069db0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb36415b010 0x7fb3640b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3640cd3a0 0x7fb3640b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 --2- 172.21.15.5:0/1633431710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb36406f290 0x7fb364151730 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 -- 172.21.15.5:0/1633431710 >> 172.21.15.5:0/1633431710 conn(0x7fb3640b1c50 msgr2=0x7fb36415a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 -- 172.21.15.5:0/1633431710 shutdown_connections 2024-08-18T22:29:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.077+0000 7fb36c600640 1 -- 172.21.15.5:0/1633431710 wait complete. 2024-08-18T22:29:59.096 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:29:59.096 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:29:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.237+0000 7f9a40a00640 1 Processor -- start 2024-08-18T22:29:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.237+0000 7f9a40a00640 1 -- start start 2024-08-18T22:29:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.237+0000 7f9a40a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a3c0ce840 0x7f9a3c0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.237+0000 7f9a40a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a3c0cee20 con 0x7f9a3c15b010 2024-08-18T22:29:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.237+0000 7f9a40a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a3c0cf100 con 0x7f9a3c06f290 2024-08-18T22:29:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.237+0000 7f9a40a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9a3c0cd8e0 con 0x7f9a3c0ce840 2024-08-18T22:29:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.237+0000 7f9a39e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9a3c15b010 0x7f9a3c06eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53012/0 (socket says 172.21.15.5:53012) 2024-08-18T22:29:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.237+0000 7f9a39e00640 1 -- 172.21.15.5:0/2242141991 learned_addr learned my addr 172.21.15.5:0/2242141991 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.237+0000 7f9a3a800640 1 --2- 172.21.15.5:0/2242141991 >> v2:172.21.15.117:3300/0 conn(0x7f9a3c0ce840 0x7f9a3c0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a38a00640 1 -- 172.21.15.5:0/2242141991 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4037275109 0 0) 0x7f9a3c0cee20 con 0x7f9a3c15b010 2024-08-18T22:29:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a38a00640 1 -- 172.21.15.5:0/2242141991 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a20003530 con 0x7f9a3c15b010 2024-08-18T22:29:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a38a00640 1 -- 172.21.15.5:0/2242141991 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647040995 0 0) 0x7f9a3c0cf100 con 0x7f9a3c06f290 2024-08-18T22:29:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a38a00640 1 -- 172.21.15.5:0/2242141991 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a3c0cee20 con 0x7f9a3c06f290 2024-08-18T22:29:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a3a800640 1 -- 172.21.15.5:0/2242141991 >> v1:172.21.15.117:6789/0 conn(0x7f9a3c06f290 legacy=0x7f9a3c072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a3a800640 1 -- 172.21.15.5:0/2242141991 >> v1:172.21.15.5:6789/0 conn(0x7f9a3c15b010 legacy=0x7f9a3c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a38a00640 1 -- 172.21.15.5:0/2242141991 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1123241843 0 0) 0x7f9a20003530 con 0x7f9a3c15b010 2024-08-18T22:29:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a3a800640 1 -- 172.21.15.5:0/2242141991 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c0cf3e0 con 0x7f9a3c0ce840 2024-08-18T22:29:59.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a3a800640 1 --2- 172.21.15.5:0/2242141991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c0ce840 0x7f9a3c0cd3a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009d90 tx=0x7f9a3401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cef9936f8aad4d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a38a00640 1 -- 172.21.15.5:0/2242141991 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a340b2070 con 0x7f9a3c0ce840 2024-08-18T22:29:59.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a38a00640 1 -- 172.21.15.5:0/2242141991 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a340a57b0 con 0x7f9a3c0ce840 2024-08-18T22:29:59.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.241+0000 7f9a38a00640 1 -- 172.21.15.5:0/2242141991 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a340a5b60 con 0x7f9a3c0ce840 2024-08-18T22:29:59.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 -- 172.21.15.5:0/2242141991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c0ce840 msgr2=0x7f9a3c0cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 --2- 172.21.15.5:0/2242141991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c0ce840 0x7f9a3c0cd3a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009d90 tx=0x7f9a3401c8e0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 -- 172.21.15.5:0/2242141991 shutdown_connections 2024-08-18T22:29:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 --2- 172.21.15.5:0/2242141991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c0ce840 0x7f9a3c0cd3a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 -- 172.21.15.5:0/2242141991 >> 172.21.15.5:0/2242141991 conn(0x7f9a3c0b1c50 msgr2=0x7f9a3c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 -- 172.21.15.5:0/2242141991 shutdown_connections 2024-08-18T22:29:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 -- 172.21.15.5:0/2242141991 wait complete. 2024-08-18T22:29:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 Processor -- start 2024-08-18T22:29:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 -- start start 2024-08-18T22:29:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a3c06f290 0x7f9a3c0b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3c0ce840 0x7f9a3c152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c15b010 0x7f9a3c150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c0738d0 con 0x7f9a3c06f290 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c073750 con 0x7f9a3c15b010 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a40a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9a3c168c60 con 0x7f9a3c0ce840 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a39e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a3c06f290 0x7f9a3c0b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a39e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a3c06f290 0x7f9a3c0b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46330/0 (socket says 172.21.15.5:46330) 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a39e00640 1 -- 172.21.15.5:0/11505458 learned_addr learned my addr 172.21.15.5:0/11505458 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a3a800640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c15b010 0x7f9a3c150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a39400640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3c0ce840 0x7f9a3c152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a39e00640 1 -- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3c0ce840 msgr2=0x7f9a3c152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a39e00640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3c0ce840 0x7f9a3c152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a39e00640 1 -- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c15b010 msgr2=0x7f9a3c150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a39e00640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c15b010 0x7f9a3c150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.245+0000 7f9a39e00640 1 -- 172.21.15.5:0/11505458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c0ae930 con 0x7f9a3c06f290 2024-08-18T22:29:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.249+0000 7f9a39e00640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a3c06f290 0x7f9a3c0b09a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0011f0 tx=0x7f9a2c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.249+0000 7f9a32000640 1 -- 172.21.15.5:0/11505458 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c017070 con 0x7f9a3c06f290 2024-08-18T22:29:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.249+0000 7f9a32000640 1 -- 172.21.15.5:0/11505458 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2c005cf0 con 0x7f9a3c06f290 2024-08-18T22:29:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.249+0000 7f9a32000640 1 -- 172.21.15.5:0/11505458 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0072f0 con 0x7f9a3c06f290 2024-08-18T22:29:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.249+0000 7f9a40a00640 1 -- 172.21.15.5:0/11505458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3c0aec10 con 0x7f9a3c06f290 2024-08-18T22:29:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.249+0000 7f9a40a00640 1 -- 172.21.15.5:0/11505458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a3c0af1d0 con 0x7f9a3c06f290 2024-08-18T22:29:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.249+0000 7f9a40a00640 1 -- 172.21.15.5:0/11505458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3c0cd3a0 con 0x7f9a3c06f290 2024-08-18T22:29:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.249+0000 7f9a32000640 1 -- 172.21.15.5:0/11505458 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a2c01a070 con 0x7f9a3c06f290 2024-08-18T22:29:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.249+0000 7f9a32000640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a1c0678c0 0x7f9a1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.249+0000 7f9a32000640 1 -- 172.21.15.5:0/11505458 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f9a2c0852d0 con 0x7f9a3c06f290 2024-08-18T22:29:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.249+0000 7f9a39400640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a1c0678c0 0x7f9a1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.253+0000 7f9a39400640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a1c0678c0 0x7f9a1c069d80 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9a280011f0 tx=0x7f9a28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.253+0000 7f9a32000640 1 -- 172.21.15.5:0/11505458 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9a2c055590 con 0x7f9a3c06f290 2024-08-18T22:29:59.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.477+0000 7f9a40a00640 1 -- 172.21.15.5:0/11505458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9a3c158080 con 0x7f9a3c06f290 2024-08-18T22:29:59.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a32000640 1 -- 172.21.15.5:0/11505458 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f9a2c059890 con 0x7f9a3c06f290 2024-08-18T22:29:59.478 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:29:59.478 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":662,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076423885,"bytes_used":2584207360,"bytes_avail":770509905920,"bytes_total":773094113280,"write_bytes_sec":28563058,"read_op_per_sec":0,"write_op_per_sec":29},"fsmap":{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9015}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-08-18T22:29:57.776947+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:29:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 -- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a1c0678c0 msgr2=0x7f9a1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a1c0678c0 0x7f9a1c069d80 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9a280011f0 tx=0x7f9a28009040 comp rx=0 tx=0).stop 2024-08-18T22:29:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 -- 172.21.15.5:0/11505458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a3c06f290 msgr2=0x7f9a3c0b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a3c06f290 0x7f9a3c0b09a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0011f0 tx=0x7f9a2c00c8e0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 -- 172.21.15.5:0/11505458 shutdown_connections 2024-08-18T22:29:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a1c0678c0 0x7f9a1c069d80 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c15b010 0x7f9a3c150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3c0ce840 0x7f9a3c152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 --2- 172.21.15.5:0/11505458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a3c06f290 0x7f9a3c0b09a0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 -- 172.21.15.5:0/11505458 >> 172.21.15.5:0/11505458 conn(0x7f9a3c0b1c50 msgr2=0x7f9a3c0c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 -- 172.21.15.5:0/11505458 shutdown_connections 2024-08-18T22:29:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.481+0000 7f9a40a00640 1 -- 172.21.15.5:0/11505458 wait complete. 2024-08-18T22:29:59.500 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-08-18T22:29:59.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:29:59.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub resume 2024-08-18T22:29:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a9600640 1 Processor -- start 2024-08-18T22:29:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a9600640 1 -- start start 2024-08-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a9600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f49a415fb80 0x7f49a40d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a9600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49a40b5ad0 0x7f49a406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a9600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49a4071550 0x7f49a409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a9600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f49a40d1eb0 con 0x7f49a40b5ad0 2024-08-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a9600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f49a40d30b0 con 0x7f49a415fb80 2024-08-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a9600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49a40d1bd0 con 0x7f49a4071550 2024-08-18T22:29:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a2000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49a40b5ad0 0x7f49a406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a2000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49a40b5ad0 0x7f49a406fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46346/0 (socket says 172.21.15.5:46346) 2024-08-18T22:29:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a2000640 1 -- 172.21.15.5:0/2123419403 learned_addr learned my addr 172.21.15.5:0/2123419403 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a2a00640 1 --2- 172.21.15.5:0/2123419403 >> v2:172.21.15.117:3300/0 conn(0x7f49a415fb80 0x7f49a40d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a3400640 1 --2- 172.21.15.5:0/2123419403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49a4071550 0x7f49a409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a2000640 1 -- 172.21.15.5:0/2123419403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49a4071550 msgr2=0x7f49a409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a2000640 1 --2- 172.21.15.5:0/2123419403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49a4071550 0x7f49a409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a2000640 1 -- 172.21.15.5:0/2123419403 >> v2:172.21.15.117:3300/0 conn(0x7f49a415fb80 msgr2=0x7f49a40d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a2000640 1 --2- 172.21.15.5:0/2123419403 >> v2:172.21.15.117:3300/0 conn(0x7f49a415fb80 0x7f49a40d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.645+0000 7f49a2000640 1 -- 172.21.15.5:0/2123419403 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a40d2dd0 con 0x7f49a40b5ad0 2024-08-18T22:29:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a2000640 1 --2- 172.21.15.5:0/2123419403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a40b5ad0 0x7f49a406fad0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f49a4072ec0 tx=0x7f499001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157be6f21cfeefa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a1600640 1 -- 172.21.15.5:0/2123419403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900b0070 con 0x7f49a40b5ad0 2024-08-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a1600640 1 -- 172.21.15.5:0/2123419403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49900a4e50 con 0x7f49a40b5ad0 2024-08-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a1600640 1 -- 172.21.15.5:0/2123419403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900ab820 con 0x7f49a40b5ad0 2024-08-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a9600640 1 -- 172.21.15.5:0/2123419403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a40b5ad0 msgr2=0x7f49a406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a9600640 1 --2- 172.21.15.5:0/2123419403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a40b5ad0 0x7f49a406fad0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f49a4072ec0 tx=0x7f499001c400 comp rx=0 tx=0).stop 2024-08-18T22:29:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a9600640 1 -- 172.21.15.5:0/2123419403 shutdown_connections 2024-08-18T22:29:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a9600640 1 --2- 172.21.15.5:0/2123419403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49a4071550 0x7f49a409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a9600640 1 --2- 172.21.15.5:0/2123419403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a40b5ad0 0x7f49a406fad0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a9600640 1 --2- 172.21.15.5:0/2123419403 >> v2:172.21.15.117:3300/0 conn(0x7f49a415fb80 0x7f49a40d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a9600640 1 -- 172.21.15.5:0/2123419403 >> 172.21.15.5:0/2123419403 conn(0x7f49a40d2180 msgr2=0x7f49a40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a9600640 1 -- 172.21.15.5:0/2123419403 shutdown_connections 2024-08-18T22:29:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.649+0000 7f49a9600640 1 -- 172.21.15.5:0/2123419403 wait complete. 2024-08-18T22:29:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a9600640 1 Processor -- start 2024-08-18T22:29:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a9600640 1 -- start start 2024-08-18T22:29:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a9600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a4071550 0x7f49a415a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a9600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49a40b5ad0 0x7f49a40cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a9600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49a415fb80 0x7f49a40b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a9600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49a40d0890 con 0x7f49a4071550 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a9600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f49a409b390 con 0x7f49a40b5ad0 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a9600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49a40d0a10 con 0x7f49a415fb80 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a4071550 0x7f49a415a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a4071550 0x7f49a415a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46354/0 (socket says 172.21.15.5:46354) 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a2a00640 1 -- 172.21.15.5:0/1867801510 learned_addr learned my addr 172.21.15.5:0/1867801510 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a2000640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49a40b5ad0 0x7f49a40cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a3400640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49a415fb80 0x7f49a40b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a2a00640 1 -- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49a415fb80 msgr2=0x7f49a40b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a2a00640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49a415fb80 0x7f49a40b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a2a00640 1 -- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49a40b5ad0 msgr2=0x7f49a40cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a2a00640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49a40b5ad0 0x7f49a40cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a2a00640 1 -- 172.21.15.5:0/1867801510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a40b0660 con 0x7f49a4071550 2024-08-18T22:29:59.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a3400640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49a415fb80 0x7f49a40b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:59.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a2a00640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a4071550 0x7f49a415a210 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f499400d5f0 tx=0x7f499400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f499aa00640 1 -- 172.21.15.5:0/1867801510 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940125f0 con 0x7f49a4071550 2024-08-18T22:29:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f499aa00640 1 -- 172.21.15.5:0/1867801510 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4994019070 con 0x7f49a4071550 2024-08-18T22:29:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f499aa00640 1 -- 172.21.15.5:0/1867801510 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940129b0 con 0x7f49a4071550 2024-08-18T22:29:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a9600640 1 -- 172.21.15.5:0/1867801510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a40b08e0 con 0x7f49a4071550 2024-08-18T22:29:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.653+0000 7f49a9600640 1 -- 172.21.15.5:0/1867801510 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a40b0ea0 con 0x7f49a4071550 2024-08-18T22:29:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f499aa00640 1 -- 172.21.15.5:0/1867801510 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4994012b50 con 0x7f49a4071550 2024-08-18T22:29:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f499aa00640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49840678f0 0x7f4984069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f499aa00640 1 -- 172.21.15.5:0/1867801510 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f4994086210 con 0x7f49a4071550 2024-08-18T22:29:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2000640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49840678f0 0x7f4984069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49acafe000 1 Processor -- start 2024-08-18T22:29:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49acafe000 1 -- start start 2024-08-18T22:29:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2000640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49840678f0 0x7f4984069db0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f49900ad000 tx=0x7f4990008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49acafe000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c542589a0 0x560c54258d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49acafe000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c5420bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49acafe000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c5420c500 0x560c5420c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49acafe000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560c540f5ae0 con 0x560c542592c0 2024-08-18T22:29:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49acafe000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560c540e1ba0 con 0x560c542589a0 2024-08-18T22:29:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49acafe000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560c5405c4f0 con 0x560c5420c500 2024-08-18T22:29:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c5420bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c542589a0 0x560c54258d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c5420bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46356/0 (socket says 172.21.15.5:46356) 2024-08-18T22:29:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2000640 1 -- 172.21.15.5:0/3955981050 learned_addr learned my addr 172.21.15.5:0/3955981050 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a3400640 1 --2- 172.21.15.5:0/3955981050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c5420c500 0x560c5420c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2000640 1 -- 172.21.15.5:0/3955981050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c5420c500 msgr2=0x560c5420c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2000640 1 --2- 172.21.15.5:0/3955981050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c5420c500 0x560c5420c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2000640 1 -- 172.21.15.5:0/3955981050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c542589a0 msgr2=0x560c54258d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2000640 1 --2- 172.21.15.5:0/3955981050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c542589a0 0x560c54258d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2000640 1 -- 172.21.15.5:0/3955981050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c53ffca90 con 0x560c542592c0 2024-08-18T22:29:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.657+0000 7f49a2a00640 1 --2- 172.21.15.5:0/3955981050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c542589a0 0x560c54258d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a2000640 1 --2- 172.21.15.5:0/3955981050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c5420bfc0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f49900ae040 tx=0x7f49900a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9b8748db2fd519 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f498f400640 1 -- 172.21.15.5:0/3955981050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900c7070 con 0x560c542592c0 2024-08-18T22:29:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f498f400640 1 -- 172.21.15.5:0/3955981050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49900b1040 con 0x560c542592c0 2024-08-18T22:29:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f498f400640 1 -- 172.21.15.5:0/3955981050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900b5600 con 0x560c542592c0 2024-08-18T22:29:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 -- 172.21.15.5:0/3955981050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 msgr2=0x560c5420bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 --2- 172.21.15.5:0/3955981050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c5420bfc0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f49900ae040 tx=0x7f49900a6000 comp rx=0 tx=0).stop 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 -- 172.21.15.5:0/3955981050 shutdown_connections 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 --2- 172.21.15.5:0/3955981050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c5420c500 0x560c5420c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 --2- 172.21.15.5:0/3955981050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c5420bfc0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 --2- 172.21.15.5:0/3955981050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c542589a0 0x560c54258d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 -- 172.21.15.5:0/3955981050 >> 172.21.15.5:0/3955981050 conn(0x560c54206010 msgr2=0x560c5423b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 -- 172.21.15.5:0/3955981050 shutdown_connections 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 -- 172.21.15.5:0/3955981050 wait complete. 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 -- start start 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 Processor -- start 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c5420c500 0x560c54239040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542589a0 0x560c542140b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c542592c0 0x560c542145f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560c540584b0 con 0x560c5420c500 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560c54016b50 con 0x560c542592c0 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560c53ffdd00 con 0x560c542589a0 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 10 client.0 _ll_register_callbacks cb 0x560c541f9f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c5420c500 0x560c54239040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c5420c500 0x560c54239040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46370/0 (socket says 172.21.15.5:46370) 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a2a00640 1 -- 172.21.15.5:0/1322591983 learned_addr learned my addr 172.21.15.5:0/1322591983 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a3400640 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c542592c0 0x560c542145f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a2000640 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542589a0 0x560c542140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a2a00640 1 -- 172.21.15.5:0/1322591983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542589a0 msgr2=0x560c542140b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a2a00640 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542589a0 0x560c542140b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a2a00640 1 -- 172.21.15.5:0/1322591983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c542592c0 msgr2=0x560c542145f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a2a00640 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c542592c0 0x560c542145f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a2a00640 1 -- 172.21.15.5:0/1322591983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c54015060 con 0x560c5420c500 2024-08-18T22:29:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49a2a00640 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c5420c500 0x560c54239040 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f499400dfb0 tx=0x7f4994056c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802552b7241fdce3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f4983e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f4983e00640 1 -- 172.21.15.5:0/1322591983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994082060 con 0x560c5420c500 2024-08-18T22:29:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f4983e00640 1 -- 172.21.15.5:0/1322591983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f4994052a90 con 0x560c5420c500 2024-08-18T22:29:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.661+0000 7f49acafe000 1 -- 172.21.15.5:0/1322591983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49900b1040 con 0x560c5420c500 2024-08-18T22:29:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f4983e00640 1 -- 172.21.15.5:0/1322591983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f4994073050 con 0x560c5420c500 2024-08-18T22:29:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 10 client.9318 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 -- 172.21.15.5:0/1322591983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x560c54028f50 con 0x560c5420c500 2024-08-18T22:29:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f4983e00640 1 -- 172.21.15.5:0/1322591983 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49900b1040 con 0x560c5420c500 2024-08-18T22:29:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f4983e00640 1 -- 172.21.15.5:0/1322591983 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7f4994013070 con 0x560c5420c500 2024-08-18T22:29:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 10 client.9318 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 10 client.9318 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 20 client.9318 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x560c5423b0c0 0x560c5426ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 4 client.9318 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 -- 172.21.15.5:0/1322591983 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c53ff6e10 con 0x560c5423b0c0 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49a2000640 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x560c5423b0c0 0x560c5426ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49a2000640 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x560c5423b0c0 0x560c5426ac60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99e341bcc6572107 server_cookie=4c7da30be6c19a87 in_seq=0 out_seq=0 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f4983e00640 10 client.9318 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f4983e00640 1 -- 172.21.15.5:0/1322591983 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c53ff6e10 con 0x560c5423b0c0 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f4983e00640 10 client.9318 handle_command_reply: tid=0 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 client.9318 shutdown 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 -- 172.21.15.5:0/1322591983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c5420c500 msgr2=0x560c54239040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c5420c500 0x560c54239040 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f499400dfb0 tx=0x7f4994056c60 comp rx=0 tx=0).stop 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 -- 172.21.15.5:0/1322591983 shutdown_connections 2024-08-18T22:29:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c542592c0 0x560c542145f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542589a0 0x560c542140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x560c5423b0c0 0x560c5426ac60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 --2- 172.21.15.5:0/1322591983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c5420c500 0x560c54239040 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f4983e00640 0 client.9318 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 -- 172.21.15.5:0/1322591983 >> 172.21.15.5:0/1322591983 conn(0x560c54206010 msgr2=0x560c5420b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 -- 172.21.15.5:0/1322591983 shutdown_connections 2024-08-18T22:29:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 1 -- 172.21.15.5:0/1322591983 wait complete. 2024-08-18T22:29:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.665+0000 7f49acafe000 20 client.9318 trim_cache size 0 max 16384 2024-08-18T22:29:59.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 Processor -- start 2024-08-18T22:29:59.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 -- start start 2024-08-18T22:29:59.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 0x560c542c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542589a0 0x560c542c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542592c0 0x560c542c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49a42044e0 con 0x560c542589a0 2024-08-18T22:29:59.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f49a42034e0 con 0x560c5420c500 2024-08-18T22:29:59.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49a4152970 con 0x560c542592c0 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542589a0 0x560c542c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542589a0 0x560c542c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46382/0 (socket says 172.21.15.5:46382) 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a2000640 1 -- 172.21.15.5:0/876368677 learned_addr learned my addr 172.21.15.5:0/876368677 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a2000640 1 -- 172.21.15.5:0/876368677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542592c0 msgr2=0x560c542c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a2a00640 1 --2- 172.21.15.5:0/876368677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 0x560c542c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a3400640 1 --2- 172.21.15.5:0/876368677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542592c0 0x560c542c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a2000640 1 --2- 172.21.15.5:0/876368677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542592c0 0x560c542c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a2000640 1 -- 172.21.15.5:0/876368677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 msgr2=0x560c542c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a2000640 1 --2- 172.21.15.5:0/876368677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 0x560c542c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a2000640 1 -- 172.21.15.5:0/876368677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c540dedd0 con 0x560c542589a0 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a2a00640 1 --2- 172.21.15.5:0/876368677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 0x560c542c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:59.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a3400640 1 --2- 172.21.15.5:0/876368677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542592c0 0x560c542c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:29:59.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49a2000640 1 --2- 172.21.15.5:0/876368677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542589a0 0x560c542c8880 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f499001cca0 tx=0x7f4990004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9be3f6f8b773072 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f498ea00640 1 -- 172.21.15.5:0/876368677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900d3030 con 0x560c542589a0 2024-08-18T22:29:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f498ea00640 1 -- 172.21.15.5:0/876368677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49900b1040 con 0x560c542589a0 2024-08-18T22:29:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f498ea00640 1 -- 172.21.15.5:0/876368677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900c7040 con 0x560c542589a0 2024-08-18T22:29:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 -- 172.21.15.5:0/876368677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542589a0 msgr2=0x560c542c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 --2- 172.21.15.5:0/876368677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542589a0 0x560c542c8880 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f499001cca0 tx=0x7f4990004740 comp rx=0 tx=0).stop 2024-08-18T22:29:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 -- 172.21.15.5:0/876368677 shutdown_connections 2024-08-18T22:29:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 --2- 172.21.15.5:0/876368677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542592c0 0x560c542c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 --2- 172.21.15.5:0/876368677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542589a0 0x560c542c8880 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 --2- 172.21.15.5:0/876368677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 0x560c542c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 -- 172.21.15.5:0/876368677 >> 172.21.15.5:0/876368677 conn(0x560c54206010 msgr2=0x560c54266130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 -- 172.21.15.5:0/876368677 shutdown_connections 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.685+0000 7f49acafe000 1 -- 172.21.15.5:0/876368677 wait complete. 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 -- start start 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 Processor -- start 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 0x560c542cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542589a0 0x560c542cc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c542ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49a4152fc0 con 0x560c542592c0 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560c540362c0 con 0x560c5420c500 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560c54119240 con 0x560c542589a0 2024-08-18T22:29:59.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 10 client.0 _ll_register_callbacks cb 0x7f4994056050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c542ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c542ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46386/0 (socket says 172.21.15.5:46386) 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a3400640 1 -- 172.21.15.5:0/2222665679 learned_addr learned my addr 172.21.15.5:0/2222665679 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a2a00640 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 0x560c542cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a2000640 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542589a0 0x560c542cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a3400640 1 -- 172.21.15.5:0/2222665679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542589a0 msgr2=0x560c542cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a3400640 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542589a0 0x560c542cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a3400640 1 -- 172.21.15.5:0/2222665679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 msgr2=0x560c542cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a3400640 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 0x560c542cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a3400640 1 -- 172.21.15.5:0/2222665679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c53fefcd0 con 0x560c542592c0 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a2a00640 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 0x560c542cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a3400640 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c542ccc60 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f499c015e70 tx=0x7f499c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4275bcb7759b7caa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f4983e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f4983e00640 1 -- 172.21.15.5:0/2222665679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c021610 con 0x560c542592c0 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 -- 172.21.15.5:0/2222665679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49900b1040 con 0x560c542592c0 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f4983e00640 1 -- 172.21.15.5:0/2222665679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f499c0217b0 con 0x560c542592c0 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f4983e00640 1 -- 172.21.15.5:0/2222665679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f499c029050 con 0x560c542592c0 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 10 client.9324 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 -- 172.21.15.5:0/2222665679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x560c54002320 con 0x560c542592c0 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f4983e00640 1 -- 172.21.15.5:0/2222665679 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49900b1040 con 0x560c542592c0 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f4983e00640 1 -- 172.21.15.5:0/2222665679 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7f499c02c020 con 0x560c542592c0 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 10 client.9324 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 10 client.9324 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 20 client.9324 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x560c5426d960 0x560c5426dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 4 client.9324 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-08-18T22:29:59.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49acafe000 1 -- 172.21.15.5:0/2222665679 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x560c54069c20 con 0x560c5426d960 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a2a00640 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x560c5426d960 0x560c5426dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f4983e00640 10 client.9324 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.689+0000 7f49a2a00640 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x560c5426d960 0x560c5426dd70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c945b31cd8d0baae server_cookie=c8da9c0bed0e9dfc in_seq=0 out_seq=0 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f4983e00640 1 -- 172.21.15.5:0/2222665679 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x560c54069c20 con 0x560c5426d960 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f4983e00640 10 client.9324 handle_command_reply: tid=0 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 1 client.9324 shutdown 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 1 -- 172.21.15.5:0/2222665679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 msgr2=0x560c542ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c542ccc60 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f499c015e70 tx=0x7f499c007700 comp rx=0 tx=0).stop 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 1 -- 172.21.15.5:0/2222665679 shutdown_connections 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x560c5426d960 0x560c5426dd70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c542592c0 0x560c542ccc60 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560c542589a0 0x560c542cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 1 --2- 172.21.15.5:0/2222665679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560c5420c500 0x560c542cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f4983e00640 0 client.9324 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:59.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 1 -- 172.21.15.5:0/2222665679 >> 172.21.15.5:0/2222665679 conn(0x560c54206010 msgr2=0x560c54239500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 1 -- 172.21.15.5:0/2222665679 shutdown_connections 2024-08-18T22:29:59.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 1 -- 172.21.15.5:0/2222665679 wait complete. 2024-08-18T22:29:59.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49acafe000 20 client.9324 trim_cache size 0 max 16384 2024-08-18T22:29:59.696 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:29:59.696 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:29:59.696 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:29:59.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 -- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49840678f0 msgr2=0x7f4984069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49840678f0 0x7f4984069db0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f49900ad000 tx=0x7f4990008040 comp rx=0 tx=0).stop 2024-08-18T22:29:59.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 -- 172.21.15.5:0/1867801510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a4071550 msgr2=0x7f49a415a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a4071550 0x7f49a415a210 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f499400d5f0 tx=0x7f499400dab0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 -- 172.21.15.5:0/1867801510 shutdown_connections 2024-08-18T22:29:59.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49840678f0 0x7f4984069db0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49a415fb80 0x7f49a40b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49a40b5ad0 0x7f49a40cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 --2- 172.21.15.5:0/1867801510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49a4071550 0x7f49a415a210 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 -- 172.21.15.5:0/1867801510 >> 172.21.15.5:0/1867801510 conn(0x7f49a40d2180 msgr2=0x7f49a40d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 -- 172.21.15.5:0/1867801510 shutdown_connections 2024-08-18T22:29:59.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.693+0000 7f49a9600640 1 -- 172.21.15.5:0/1867801510 wait complete. 2024-08-18T22:29:59.710 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-18T22:29:59.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-08-18T22:29:59.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.853+0000 7fc342200640 1 Processor -- start 2024-08-18T22:29:59.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.853+0000 7fc342200640 1 -- start start 2024-08-18T22:29:59.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc342200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33c0b1300 0x7fc33c162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc342200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33c06e8a0 con 0x7fc33c09b080 2024-08-18T22:29:59.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc342200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33c09bb80 con 0x7fc33c09aca0 2024-08-18T22:29:59.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc342200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c0d2e40 con 0x7fc33c0b1300 2024-08-18T22:29:59.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc33be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc33c09b080 0x7fc33c0b01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53020/0 (socket says 172.21.15.5:53020) 2024-08-18T22:29:59.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc33be00640 1 -- 172.21.15.5:0/1612336916 learned_addr learned my addr 172.21.15.5:0/1612336916 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:29:59.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc33aa00640 1 --2- 172.21.15.5:0/1612336916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33c0b1300 0x7fc33c162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc33a000640 1 -- 172.21.15.5:0/1612336916 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926337921 0 0) 0x7fc33c06e8a0 con 0x7fc33c09b080 2024-08-18T22:29:59.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc33a000640 1 -- 172.21.15.5:0/1612336916 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc320003530 con 0x7fc33c09b080 2024-08-18T22:29:59.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc33a000640 1 -- 172.21.15.5:0/1612336916 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 903616268 0 0) 0x7fc33c09bb80 con 0x7fc33c09aca0 2024-08-18T22:29:59.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc33a000640 1 -- 172.21.15.5:0/1612336916 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc33c06e8a0 con 0x7fc33c09aca0 2024-08-18T22:29:59.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc33aa00640 1 -- 172.21.15.5:0/1612336916 >> v1:172.21.15.117:6789/0 conn(0x7fc33c09aca0 legacy=0x7fc33c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc33aa00640 1 -- 172.21.15.5:0/1612336916 >> v1:172.21.15.5:6789/0 conn(0x7fc33c09b080 legacy=0x7fc33c0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.857+0000 7fc33aa00640 1 -- 172.21.15.5:0/1612336916 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c06cbd0 con 0x7fc33c0b1300 2024-08-18T22:29:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc33aa00640 1 --2- 172.21.15.5:0/1612336916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33c0b1300 0x7fc33c162950 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc3280097f0 tx=0x7fc32801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7db978224019b4a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc33a000640 1 -- 172.21.15.5:0/1612336916 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3280ab5f0 con 0x7fc33c0b1300 2024-08-18T22:29:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc33a000640 1 -- 172.21.15.5:0/1612336916 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3280b0070 con 0x7fc33c0b1300 2024-08-18T22:29:59.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc33a000640 1 -- 172.21.15.5:0/1612336916 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3280ab990 con 0x7fc33c0b1300 2024-08-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc342200640 1 -- 172.21.15.5:0/1612336916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33c0b1300 msgr2=0x7fc33c162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc342200640 1 --2- 172.21.15.5:0/1612336916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33c0b1300 0x7fc33c162950 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc3280097f0 tx=0x7fc32801c4e0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc342200640 1 -- 172.21.15.5:0/1612336916 shutdown_connections 2024-08-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc342200640 1 --2- 172.21.15.5:0/1612336916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33c0b1300 0x7fc33c162950 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc342200640 1 -- 172.21.15.5:0/1612336916 >> 172.21.15.5:0/1612336916 conn(0x7fc33c0d2180 msgr2=0x7fc33c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc342200640 1 -- 172.21.15.5:0/1612336916 shutdown_connections 2024-08-18T22:29:59.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc342200640 1 -- 172.21.15.5:0/1612336916 wait complete. 2024-08-18T22:29:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc342200640 1 Processor -- start 2024-08-18T22:29:59.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.861+0000 7fc342200640 1 -- start start 2024-08-18T22:29:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc342200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc33c09aca0 0x7fc33c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc342200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33c09b080 0x7fc33c169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc342200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc33c0b1300 0x7fc33c160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc342200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c16ced0 con 0x7fc33c0b1300 2024-08-18T22:29:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc342200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c16cd50 con 0x7fc33c09aca0 2024-08-18T22:29:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc342200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c16d050 con 0x7fc33c09b080 2024-08-18T22:29:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc33be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc33c0b1300 0x7fc33c160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc33be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc33c0b1300 0x7fc33c160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46394/0 (socket says 172.21.15.5:46394) 2024-08-18T22:29:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc33be00640 1 -- 172.21.15.5:0/264354412 learned_addr learned my addr 172.21.15.5:0/264354412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc33b400640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc33c09aca0 0x7fc33c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc33aa00640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33c09b080 0x7fc33c169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc33be00640 1 -- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33c09b080 msgr2=0x7fc33c169b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc33be00640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33c09b080 0x7fc33c169b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc33be00640 1 -- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc33c09aca0 msgr2=0x7fc33c15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc33be00640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc33c09aca0 0x7fc33c15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc33be00640 1 -- 172.21.15.5:0/264354412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c15a570 con 0x7fc33c0b1300 2024-08-18T22:29:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc33be00640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc33c0b1300 0x7fc33c160bf0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc33400cb40 tx=0x7fc33400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc333400640 1 -- 172.21.15.5:0/264354412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334017070 con 0x7fc33c0b1300 2024-08-18T22:29:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc333400640 1 -- 172.21.15.5:0/264354412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33400aca0 con 0x7fc33c0b1300 2024-08-18T22:29:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc333400640 1 -- 172.21.15.5:0/264354412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334012600 con 0x7fc33c0b1300 2024-08-18T22:29:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc342200640 1 -- 172.21.15.5:0/264354412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33c15a810 con 0x7fc33c0b1300 2024-08-18T22:29:59.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.865+0000 7fc342200640 1 -- 172.21.15.5:0/264354412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33c15aab0 con 0x7fc33c0b1300 2024-08-18T22:29:59.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc333400640 1 -- 172.21.15.5:0/264354412 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc33401a070 con 0x7fc33c0b1300 2024-08-18T22:29:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc333400640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc31c0678c0 0x7fc31c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc333400640 1 -- 172.21.15.5:0/264354412 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fc334085bd0 con 0x7fc33c0b1300 2024-08-18T22:29:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33b400640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc31c0678c0 0x7fc31c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc3457c6000 1 Processor -- start 2024-08-18T22:29:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc3457c6000 1 -- start start 2024-08-18T22:29:59.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33b400640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc31c0678c0 0x7fc31c069d80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0011f0 tx=0x7fc32c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef4089a0 0x55e5ef408d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef3bbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef3bc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc3457c6000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e5ef2a5ae0 con 0x55e5ef3bc500 2024-08-18T22:29:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc3457c6000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e5ef291ba0 con 0x55e5ef4092c0 2024-08-18T22:29:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc3457c6000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e5ef20c4f0 con 0x55e5ef4089a0 2024-08-18T22:29:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef3bc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef3bc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46400/0 (socket says 172.21.15.5:46400) 2024-08-18T22:29:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33be00640 1 -- 172.21.15.5:0/100874827 learned_addr learned my addr 172.21.15.5:0/100874827 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33b400640 1 --2- 172.21.15.5:0/100874827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef4089a0 0x55e5ef408d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33aa00640 1 --2- 172.21.15.5:0/100874827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef3bbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33be00640 1 -- 172.21.15.5:0/100874827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef4089a0 msgr2=0x55e5ef408d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33be00640 1 --2- 172.21.15.5:0/100874827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef4089a0 0x55e5ef408d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33be00640 1 -- 172.21.15.5:0/100874827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 msgr2=0x55e5ef3bbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33be00640 1 --2- 172.21.15.5:0/100874827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef3bbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33be00640 1 -- 172.21.15.5:0/100874827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ef1aca90 con 0x55e5ef3bc500 2024-08-18T22:29:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc33be00640 1 --2- 172.21.15.5:0/100874827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef3bc8e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fc33400a560 tx=0x7fc334055f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9641133ebbae051 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc327e00640 1 -- 172.21.15.5:0/100874827 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334054190 con 0x55e5ef3bc500 2024-08-18T22:29:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc327e00640 1 -- 172.21.15.5:0/100874827 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc334052500 con 0x55e5ef3bc500 2024-08-18T22:29:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.869+0000 7fc327e00640 1 -- 172.21.15.5:0/100874827 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33405e730 con 0x55e5ef3bc500 2024-08-18T22:29:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 -- 172.21.15.5:0/100874827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 msgr2=0x55e5ef3bc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 --2- 172.21.15.5:0/100874827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef3bc8e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fc33400a560 tx=0x7fc334055f50 comp rx=0 tx=0).stop 2024-08-18T22:29:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 -- 172.21.15.5:0/100874827 shutdown_connections 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 --2- 172.21.15.5:0/100874827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef3bc8e0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 --2- 172.21.15.5:0/100874827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef3bbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 --2- 172.21.15.5:0/100874827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef4089a0 0x55e5ef408d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 -- 172.21.15.5:0/100874827 >> 172.21.15.5:0/100874827 conn(0x55e5ef3b6010 msgr2=0x55e5ef3eb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 -- 172.21.15.5:0/100874827 shutdown_connections 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 -- 172.21.15.5:0/100874827 wait complete. 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 -- start start 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 Processor -- start 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef3bc500 0x55e5ef3e8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef3c4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef3c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e5ef2084b0 con 0x55e5ef4089a0 2024-08-18T22:29:59.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e5ef1c6b50 con 0x55e5ef4092c0 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e5ef1add00 con 0x55e5ef3bc500 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 10 client.0 _ll_register_callbacks cb 0x55e5ef3a9f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef3c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef3c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46410/0 (socket says 172.21.15.5:46410) 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33aa00640 1 -- 172.21.15.5:0/2864386822 learned_addr learned my addr 172.21.15.5:0/2864386822 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33be00640 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef3c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33b400640 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef3bc500 0x55e5ef3e8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33aa00640 1 -- 172.21.15.5:0/2864386822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef3bc500 msgr2=0x55e5ef3e8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33aa00640 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef3bc500 0x55e5ef3e8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33aa00640 1 -- 172.21.15.5:0/2864386822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 msgr2=0x55e5ef3c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33aa00640 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef3c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33aa00640 1 -- 172.21.15.5:0/2864386822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ef1c5060 con 0x55e5ef4089a0 2024-08-18T22:29:59.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33be00640 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef3c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc33aa00640 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef3c4030 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fc32801a110 tx=0x7fc32801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ae188124df7e64 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc324c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc324c00640 1 -- 172.21.15.5:0/2864386822 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328006e20 con 0x55e5ef4089a0 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc324c00640 1 -- 172.21.15.5:0/2864386822 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fc3280b4930 con 0x55e5ef4089a0 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 -- 172.21.15.5:0/2864386822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc334052500 con 0x55e5ef4089a0 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc324c00640 1 -- 172.21.15.5:0/2864386822 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fc3280ca050 con 0x55e5ef4089a0 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 10 client.9336 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc3457c6000 1 -- 172.21.15.5:0/2864386822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55e5ef1d8f50 con 0x55e5ef4089a0 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.873+0000 7fc324c00640 1 -- 172.21.15.5:0/2864386822 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc334052500 con 0x55e5ef4089a0 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc324c00640 1 -- 172.21.15.5:0/2864386822 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7fc3280cd020 con 0x55e5ef4089a0 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 10 client.9336 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 10 client.9336 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:59.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 20 client.9336 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55e5ef3ead30 0x55e5ef3eb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 4 client.9336 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 -- 172.21.15.5:0/2864386822 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5ef1a6e10 con 0x55e5ef3ead30 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc33b400640 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55e5ef3ead30 0x55e5ef3eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc33b400640 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55e5ef3ead30 0x55e5ef3eb110 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84f8d64fc59af56b server_cookie=12d68e2f3cc7bd35 in_seq=0 out_seq=0 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc324c00640 10 client.9336 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc324c00640 1 -- 172.21.15.5:0/2864386822 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5ef1a6e10 con 0x55e5ef3ead30 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc324c00640 10 client.9336 handle_command_reply: tid=0 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 client.9336 shutdown 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 -- 172.21.15.5:0/2864386822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 msgr2=0x55e5ef3c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef3c4030 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fc32801a110 tx=0x7fc32801ad20 comp rx=0 tx=0).stop 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 -- 172.21.15.5:0/2864386822 shutdown_connections 2024-08-18T22:29:59.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef3c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55e5ef3ead30 0x55e5ef3eb110 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef3c4030 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 --2- 172.21.15.5:0/2864386822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef3bc500 0x55e5ef3e8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc324c00640 0 client.9336 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 -- 172.21.15.5:0/2864386822 >> 172.21.15.5:0/2864386822 conn(0x55e5ef3b6010 msgr2=0x55e5ef3bb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 -- 172.21.15.5:0/2864386822 shutdown_connections 2024-08-18T22:29:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 1 -- 172.21.15.5:0/2864386822 wait complete. 2024-08-18T22:29:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.877+0000 7fc3457c6000 20 client.9336 trim_cache size 0 max 16384 2024-08-18T22:29:59.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 Processor -- start 2024-08-18T22:29:59.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 -- start start 2024-08-18T22:29:59.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef420500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4089a0 0x55e5ef3bb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef4092c0 0x55e5ef3bbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c204330 con 0x55e5ef3bc500 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c2033a0 con 0x55e5ef4089a0 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c15c810 con 0x55e5ef4092c0 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef420500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef420500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46420/0 (socket says 172.21.15.5:46420) 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33b400640 1 -- 172.21.15.5:0/97182949 learned_addr learned my addr 172.21.15.5:0/97182949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33aa00640 1 --2- 172.21.15.5:0/97182949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4089a0 0x55e5ef3bb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33be00640 1 --2- 172.21.15.5:0/97182949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef4092c0 0x55e5ef3bbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33b400640 1 -- 172.21.15.5:0/97182949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef4092c0 msgr2=0x55e5ef3bbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33b400640 1 --2- 172.21.15.5:0/97182949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef4092c0 0x55e5ef3bbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33b400640 1 -- 172.21.15.5:0/97182949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4089a0 msgr2=0x55e5ef3bb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33b400640 1 --2- 172.21.15.5:0/97182949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4089a0 0x55e5ef3bb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33b400640 1 -- 172.21.15.5:0/97182949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ef28edd0 con 0x55e5ef3bc500 2024-08-18T22:29:59.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33aa00640 1 --2- 172.21.15.5:0/97182949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4089a0 0x55e5ef3bb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:29:59.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc33b400640 1 --2- 172.21.15.5:0/97182949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef420500 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fc32c001640 tx=0x7fc32c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f1b0e6476588d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc327400640 1 -- 172.21.15.5:0/97182949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c014990 con 0x55e5ef3bc500 2024-08-18T22:29:59.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc327400640 1 -- 172.21.15.5:0/97182949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c01b040 con 0x55e5ef3bc500 2024-08-18T22:29:59.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc327400640 1 -- 172.21.15.5:0/97182949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c014d30 con 0x55e5ef3bc500 2024-08-18T22:29:59.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 -- 172.21.15.5:0/97182949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 msgr2=0x55e5ef420500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 --2- 172.21.15.5:0/97182949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef420500 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fc32c001640 tx=0x7fc32c012000 comp rx=0 tx=0).stop 2024-08-18T22:29:59.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 -- 172.21.15.5:0/97182949 shutdown_connections 2024-08-18T22:29:59.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 --2- 172.21.15.5:0/97182949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef4092c0 0x55e5ef3bbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 --2- 172.21.15.5:0/97182949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4089a0 0x55e5ef3bb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 --2- 172.21.15.5:0/97182949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef3bc500 0x55e5ef420500 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 -- 172.21.15.5:0/97182949 >> 172.21.15.5:0/97182949 conn(0x55e5ef3b6010 msgr2=0x55e5ef4071f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 -- 172.21.15.5:0/97182949 shutdown_connections 2024-08-18T22:29:59.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 -- 172.21.15.5:0/97182949 wait complete. 2024-08-18T22:29:59.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 -- start start 2024-08-18T22:29:59.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.897+0000 7fc3457c6000 1 Processor -- start 2024-08-18T22:29:59.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef3bc500 0x55e5ef47c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef47c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef47ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c202e10 con 0x55e5ef4089a0 2024-08-18T22:29:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e5ef1e62c0 con 0x55e5ef4092c0 2024-08-18T22:29:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e5ef2c9240 con 0x55e5ef3bc500 2024-08-18T22:29:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 10 client.0 _ll_register_callbacks cb 0x7fc320003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:29:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef47c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef47c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46436/0 (socket says 172.21.15.5:46436) 2024-08-18T22:29:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33aa00640 1 -- 172.21.15.5:0/1579266262 learned_addr learned my addr 172.21.15.5:0/1579266262 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:29:59.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33b400640 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef3bc500 0x55e5ef47c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33be00640 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef47ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33aa00640 1 -- 172.21.15.5:0/1579266262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef3bc500 msgr2=0x55e5ef47c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33aa00640 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef3bc500 0x55e5ef47c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33aa00640 1 -- 172.21.15.5:0/1579266262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 msgr2=0x55e5ef47ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33aa00640 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef47ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33aa00640 1 -- 172.21.15.5:0/1579266262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ef19fcd0 con 0x55e5ef4089a0 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33aa00640 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef47c990 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fc328097ec0 tx=0x7fc3280a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafd238ef6623783 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc324c00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc324c00640 1 -- 172.21.15.5:0/1579266262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3280d2030 con 0x55e5ef4089a0 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc324c00640 1 -- 172.21.15.5:0/1579266262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fc3280bfa30 con 0x55e5ef4089a0 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 1 -- 172.21.15.5:0/1579266262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc32c01b040 con 0x55e5ef4089a0 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc324c00640 1 -- 172.21.15.5:0/1579266262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fc3280de050 con 0x55e5ef4089a0 2024-08-18T22:29:59.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 10 client.9342 fetch_fsmap learned FSMap version 117 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 1 -- 172.21.15.5:0/1579266262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) -- 0x55e5ef1b2320 con 0x55e5ef4089a0 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc324c00640 1 -- 172.21.15.5:0/1579266262 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c01b040 con 0x55e5ef4089a0 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc324c00640 1 -- 172.21.15.5:0/1579266262 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 117) ==== 3502+0+0 (secure 0 0 0) 0x7fc3280e1020 con 0x55e5ef4089a0 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 10 client.9342 fetch_fsmap finished waiting for FSMap version 117 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 10 client.9342 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 20 client.9342 populate_metadata read hostname 'smithi005' 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55e5ef41bbf0 0x55e5ef41c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 4 client.9342 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 1 -- 172.21.15.5:0/1579266262 --> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e5ef219c20 con 0x55e5ef41bbf0 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33b400640 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55e5ef41bbf0 0x55e5ef41c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc33b400640 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55e5ef41bbf0 0x55e5ef41c000 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bea313540e0aa4aa server_cookie=71d1d10a44a08988 in_seq=0 out_seq=0 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc324c00640 10 client.9342 ms_handle_connect on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc324c00640 1 -- 172.21.15.5:0/1579266262 <== mds.0 v2:172.21.15.5:6834/1418980807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e5ef219c20 con 0x55e5ef41bbf0 2024-08-18T22:29:59.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc324c00640 10 client.9342 handle_command_reply: tid=0 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.901+0000 7fc3457c6000 1 client.9342 shutdown 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc3457c6000 1 -- 172.21.15.5:0/1579266262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 msgr2=0x55e5ef47c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc3457c6000 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef47c990 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fc328097ec0 tx=0x7fc3280a9000 comp rx=0 tx=0).stop 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc3457c6000 1 -- 172.21.15.5:0/1579266262 shutdown_connections 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc3457c6000 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e5ef4092c0 0x55e5ef47ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc3457c6000 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.5:6834/1418980807,v1:172.21.15.5:6835/1418980807] conn(0x55e5ef41bbf0 0x55e5ef41c000 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc3457c6000 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5ef4089a0 0x55e5ef47c990 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc3457c6000 1 --2- 172.21.15.5:0/1579266262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e5ef3bc500 0x55e5ef47c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc3457c6000 1 -- 172.21.15.5:0/1579266262 >> 172.21.15.5:0/1579266262 conn(0x55e5ef3b6010 msgr2=0x55e5ef407a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc324c00640 0 client.9342 ms_handle_reset on v2:172.21.15.5:6834/1418980807 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc3457c6000 1 -- 172.21.15.5:0/1579266262 shutdown_connections 2024-08-18T22:29:59.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc3457c6000 1 -- 172.21.15.5:0/1579266262 wait complete. 2024-08-18T22:29:59.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc3457c6000 20 client.9342 trim_cache size 0 max 16384 2024-08-18T22:29:59.907 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:29:59.907 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-18T22:29:59.907 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-08-18T22:29:59.907 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:29:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 -- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc31c0678c0 msgr2=0x7fc31c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc31c0678c0 0x7fc31c069d80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0011f0 tx=0x7fc32c009040 comp rx=0 tx=0).stop 2024-08-18T22:29:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 -- 172.21.15.5:0/264354412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc33c0b1300 msgr2=0x7fc33c160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:29:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc33c0b1300 0x7fc33c160bf0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc33400cb40 tx=0x7fc33400a060 comp rx=0 tx=0).stop 2024-08-18T22:29:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 -- 172.21.15.5:0/264354412 shutdown_connections 2024-08-18T22:29:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc31c0678c0 0x7fc31c069d80 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc33c0b1300 0x7fc33c160bf0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33c09b080 0x7fc33c169b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 --2- 172.21.15.5:0/264354412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc33c09aca0 0x7fc33c15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:29:59.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 -- 172.21.15.5:0/264354412 >> 172.21.15.5:0/264354412 conn(0x7fc33c0d2180 msgr2=0x7fc33c0701a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:29:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 -- 172.21.15.5:0/264354412 shutdown_connections 2024-08-18T22:29:59.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:29:59.905+0000 7fc342200640 1 -- 172.21.15.5:0/264354412 wait complete. 2024-08-18T22:29:59.922 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:29:59.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7fc00640 1 Processor -- start 2024-08-18T22:30:00.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7fc00640 1 -- start start 2024-08-18T22:30:00.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7fc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff7815bed0 0x7eff780735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:00.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7fc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff78073c80 con 0x7eff7806da70 2024-08-18T22:30:00.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7fc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff780ca5d0 con 0x7eff780cb390 2024-08-18T22:30:00.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7fc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7eff780ca8b0 con 0x7eff7815bed0 2024-08-18T22:30:00.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7dc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7eff7806da70 0x7eff78165b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53024/0 (socket says 172.21.15.5:53024) 2024-08-18T22:30:00.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7dc00640 1 -- 172.21.15.5:0/682973679 learned_addr learned my addr 172.21.15.5:0/682973679 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7d200640 1 --2- 172.21.15.5:0/682973679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff7815bed0 0x7eff780735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff77400640 1 -- 172.21.15.5:0/682973679 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552504571 0 0) 0x7eff78073c80 con 0x7eff7806da70 2024-08-18T22:30:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff77400640 1 -- 172.21.15.5:0/682973679 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff60003530 con 0x7eff7806da70 2024-08-18T22:30:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7d200640 1 -- 172.21.15.5:0/682973679 >> v1:172.21.15.117:6789/0 conn(0x7eff780cb390 legacy=0x7eff78071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7d200640 1 -- 172.21.15.5:0/682973679 >> v1:172.21.15.5:6789/0 conn(0x7eff7806da70 legacy=0x7eff78165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.065+0000 7eff7d200640 1 -- 172.21.15.5:0/682973679 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff780cab90 con 0x7eff7815bed0 2024-08-18T22:30:00.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.069+0000 7eff7d200640 1 --2- 172.21.15.5:0/682973679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff7815bed0 0x7eff780735a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009dc0 tx=0x7eff6c01c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da548de6e111aa37 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:00.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.069+0000 7eff77400640 1 -- 172.21.15.5:0/682973679 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0b2070 con 0x7eff7815bed0 2024-08-18T22:30:00.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.069+0000 7eff77400640 1 -- 172.21.15.5:0/682973679 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6c0a5a40 con 0x7eff7815bed0 2024-08-18T22:30:00.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.069+0000 7eff77400640 1 -- 172.21.15.5:0/682973679 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0a5df0 con 0x7eff7815bed0 2024-08-18T22:30:00.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.069+0000 7eff7fc00640 1 -- 172.21.15.5:0/682973679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff7815bed0 msgr2=0x7eff780735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.069+0000 7eff7fc00640 1 --2- 172.21.15.5:0/682973679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff7815bed0 0x7eff780735a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009dc0 tx=0x7eff6c01c960 comp rx=0 tx=0).stop 2024-08-18T22:30:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.069+0000 7eff7fc00640 1 -- 172.21.15.5:0/682973679 shutdown_connections 2024-08-18T22:30:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.069+0000 7eff7fc00640 1 --2- 172.21.15.5:0/682973679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff7815bed0 0x7eff780735a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.069+0000 7eff7fc00640 1 -- 172.21.15.5:0/682973679 >> 172.21.15.5:0/682973679 conn(0x7eff780b1c50 msgr2=0x7eff780b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.069+0000 7eff7fc00640 1 -- 172.21.15.5:0/682973679 shutdown_connections 2024-08-18T22:30:00.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.069+0000 7eff7fc00640 1 -- 172.21.15.5:0/682973679 wait complete. 2024-08-18T22:30:00.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7fc00640 1 Processor -- start 2024-08-18T22:30:00.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7fc00640 1 -- start start 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7fc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff7806da70 0x7eff7815b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7fc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780cb390 0x7eff78159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7fc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff7815bed0 0x7eff78156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7fc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7eff78169c40 con 0x7eff780cb390 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7fc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7eff78169ac0 con 0x7eff7815bed0 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7fc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7eff78169dc0 con 0x7eff7806da70 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff77e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780cb390 0x7eff78159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff77e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780cb390 0x7eff78159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46452/0 (socket says 172.21.15.5:46452) 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff77e00640 1 -- 172.21.15.5:0/510865465 learned_addr learned my addr 172.21.15.5:0/510865465 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7d200640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff7806da70 0x7eff7815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7dc00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff7815bed0 0x7eff78156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff77e00640 1 -- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff7806da70 msgr2=0x7eff7815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff77e00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff7806da70 0x7eff7815b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff77e00640 1 -- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff7815bed0 msgr2=0x7eff78156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff77e00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff7815bed0 0x7eff78156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff77e00640 1 -- 172.21.15.5:0/510865465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7815a1c0 con 0x7eff780cb390 2024-08-18T22:30:00.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7dc00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff7815bed0 0x7eff78156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:00.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff77e00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780cb390 0x7eff78159850 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c430 tx=0x7eff6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:00.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff74c00640 1 -- 172.21.15.5:0/510865465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff640052d0 con 0x7eff780cb390 2024-08-18T22:30:00.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff74c00640 1 -- 172.21.15.5:0/510865465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff64005470 con 0x7eff780cb390 2024-08-18T22:30:00.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff74c00640 1 -- 172.21.15.5:0/510865465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64007260 con 0x7eff780cb390 2024-08-18T22:30:00.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7fc00640 1 -- 172.21.15.5:0/510865465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff7815a4a0 con 0x7eff780cb390 2024-08-18T22:30:00.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7fc00640 1 -- 172.21.15.5:0/510865465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff7815aa60 con 0x7eff780cb390 2024-08-18T22:30:00.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.073+0000 7eff7fc00640 1 -- 172.21.15.5:0/510865465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff780735a0 con 0x7eff780cb390 2024-08-18T22:30:00.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.077+0000 7eff74c00640 1 -- 172.21.15.5:0/510865465 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff64007400 con 0x7eff780cb390 2024-08-18T22:30:00.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.077+0000 7eff74c00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff580678c0 0x7eff58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:00.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.077+0000 7eff74c00640 1 -- 172.21.15.5:0/510865465 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7eff640852d0 con 0x7eff780cb390 2024-08-18T22:30:00.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.077+0000 7eff7d200640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff580678c0 0x7eff58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:00.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.077+0000 7eff7d200640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff580678c0 0x7eff58069d80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0af000 tx=0x7eff6c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:00.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.081+0000 7eff74c00640 1 -- 172.21.15.5:0/510865465 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7eff64055620 con 0x7eff780cb390 2024-08-18T22:30:00.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 -- 172.21.15.5:0/510865465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff780b1a30 con 0x7eff780cb390 2024-08-18T22:30:00.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff74c00640 1 -- 172.21.15.5:0/510865465 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7eff64059920 con 0x7eff780cb390 2024-08-18T22:30:00.283 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:00.283 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:30:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:30:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 -- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff580678c0 msgr2=0x7eff58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff580678c0 0x7eff58069d80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0af000 tx=0x7eff6c0a7070 comp rx=0 tx=0).stop 2024-08-18T22:30:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 -- 172.21.15.5:0/510865465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780cb390 msgr2=0x7eff78159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780cb390 0x7eff78159850 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c430 tx=0x7eff6400c8f0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 -- 172.21.15.5:0/510865465 shutdown_connections 2024-08-18T22:30:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7eff580678c0 0x7eff58069d80 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff7815bed0 0x7eff78156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff780cb390 0x7eff78159850 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 --2- 172.21.15.5:0/510865465 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff7806da70 0x7eff7815b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 -- 172.21.15.5:0/510865465 >> 172.21.15.5:0/510865465 conn(0x7eff780b1c50 msgr2=0x7eff780cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 -- 172.21.15.5:0/510865465 shutdown_connections 2024-08-18T22:30:00.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.285+0000 7eff7fc00640 1 -- 172.21.15.5:0/510865465 wait complete. 2024-08-18T22:30:00.305 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:30:00.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:30:00.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.445+0000 7f3443800640 1 Processor -- start 2024-08-18T22:30:00.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.445+0000 7f3443800640 1 -- start start 2024-08-18T22:30:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.445+0000 7f3443800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f343c0cee40 0x7f343c06c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.445+0000 7f3443800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c0ca3e0 0x7f343c0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.445+0000 7f3443800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f343c15e840 con 0x7f343c15e460 2024-08-18T22:30:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.445+0000 7f3443800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f343c0ae750 con 0x7f343c0cee40 2024-08-18T22:30:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.445+0000 7f3443800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f343c06c900 con 0x7f343c0ca3e0 2024-08-18T22:30:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f3433e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f343c0cee40 0x7f343c06c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f3440e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f343c15e460 0x7f343c0ae040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53034/0 (socket says 172.21.15.5:53034) 2024-08-18T22:30:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f3440e00640 1 -- 172.21.15.5:0/1627036522 learned_addr learned my addr 172.21.15.5:0/1627036522 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f3433e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f343c0cee40 0x7f343c06c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46454/0 (socket says 172.21.15.5:46454) 2024-08-18T22:30:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f3441800640 1 --2- 172.21.15.5:0/1627036522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c0ca3e0 0x7f343c0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f3433e00640 1 -- 172.21.15.5:0/1627036522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c0ca3e0 msgr2=0x7f343c0ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f3433e00640 1 --2- 172.21.15.5:0/1627036522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c0ca3e0 0x7f343c0ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f3433e00640 1 -- 172.21.15.5:0/1627036522 >> v1:172.21.15.5:6789/0 conn(0x7f343c15e460 legacy=0x7f343c0ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f3433e00640 1 -- 172.21.15.5:0/1627036522 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c0cf320 con 0x7f343c0cee40 2024-08-18T22:30:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f343be00640 1 -- 172.21.15.5:0/1627036522 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4171126633 0 0) 0x7f343c15e840 con 0x7f343c15e460 2024-08-18T22:30:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f3433e00640 1 --2- 172.21.15.5:0/1627036522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0cee40 0x7f343c06c3c0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f34240097c0 tx=0x7f342401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148280b135945e80 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f343be00640 1 -- 172.21.15.5:0/1627036522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34240b5070 con 0x7f343c0cee40 2024-08-18T22:30:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f343be00640 1 -- 172.21.15.5:0/1627036522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34240a8990 con 0x7f343c0cee40 2024-08-18T22:30:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.449+0000 7f343be00640 1 -- 172.21.15.5:0/1627036522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34240a8d60 con 0x7f343c0cee40 2024-08-18T22:30:00.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 -- 172.21.15.5:0/1627036522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0cee40 msgr2=0x7f343c06c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 --2- 172.21.15.5:0/1627036522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0cee40 0x7f343c06c3c0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f34240097c0 tx=0x7f342401ec90 comp rx=0 tx=0).stop 2024-08-18T22:30:00.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 -- 172.21.15.5:0/1627036522 shutdown_connections 2024-08-18T22:30:00.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 --2- 172.21.15.5:0/1627036522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c0ca3e0 0x7f343c0ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 --2- 172.21.15.5:0/1627036522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0cee40 0x7f343c06c3c0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 -- 172.21.15.5:0/1627036522 >> 172.21.15.5:0/1627036522 conn(0x7f343c09aa40 msgr2=0x7f343c0b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:00.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 -- 172.21.15.5:0/1627036522 shutdown_connections 2024-08-18T22:30:00.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 -- 172.21.15.5:0/1627036522 wait complete. 2024-08-18T22:30:00.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 Processor -- start 2024-08-18T22:30:00.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 -- start start 2024-08-18T22:30:00.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0ca3e0 0x7f343c14f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:00.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c0cee40 0x7f343c145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:00.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343c15e460 0x7f343c157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f343c0cfbc0 con 0x7f343c0ca3e0 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f343c0cf8e0 con 0x7f343c15e460 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3443800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f343c0cfea0 con 0x7f343c0cee40 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3440e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0ca3e0 0x7f343c14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3440e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0ca3e0 0x7f343c14f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46462/0 (socket says 172.21.15.5:46462) 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3440e00640 1 -- 172.21.15.5:0/4070049173 learned_addr learned my addr 172.21.15.5:0/4070049173 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3433e00640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c0cee40 0x7f343c145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3441800640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343c15e460 0x7f343c157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3440e00640 1 -- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c0cee40 msgr2=0x7f343c145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3440e00640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c0cee40 0x7f343c145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3440e00640 1 -- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343c15e460 msgr2=0x7f343c157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3440e00640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343c15e460 0x7f343c157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3440e00640 1 -- 172.21.15.5:0/4070049173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c1567b0 con 0x7f343c0ca3e0 2024-08-18T22:30:00.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.453+0000 7f3440e00640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0ca3e0 0x7f343c14f270 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f342c00c480 tx=0x7f342c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:00.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.457+0000 7f3439600640 1 -- 172.21.15.5:0/4070049173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c018070 con 0x7f343c0ca3e0 2024-08-18T22:30:00.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.457+0000 7f3439600640 1 -- 172.21.15.5:0/4070049173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342c007500 con 0x7f343c0ca3e0 2024-08-18T22:30:00.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.457+0000 7f3443800640 1 -- 172.21.15.5:0/4070049173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c156a70 con 0x7f343c0ca3e0 2024-08-18T22:30:00.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.457+0000 7f3439600640 1 -- 172.21.15.5:0/4070049173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c004a30 con 0x7f343c0ca3e0 2024-08-18T22:30:00.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.457+0000 7f3443800640 1 -- 172.21.15.5:0/4070049173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c157030 con 0x7f343c0ca3e0 2024-08-18T22:30:00.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.457+0000 7f3443800640 1 -- 172.21.15.5:0/4070049173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343c0b3620 con 0x7f343c0ca3e0 2024-08-18T22:30:00.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.457+0000 7f3439600640 1 -- 172.21.15.5:0/4070049173 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f342c01b070 con 0x7f343c0ca3e0 2024-08-18T22:30:00.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.457+0000 7f3439600640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 0x7f3418069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:00.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.457+0000 7f3439600640 1 -- 172.21.15.5:0/4070049173 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f342c085130 con 0x7f343c0ca3e0 2024-08-18T22:30:00.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.457+0000 7f3433e00640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 0x7f3418069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:00.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.461+0000 7f3433e00640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 0x7f3418069d80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f34240b2000 tx=0x7f34240aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:00.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.461+0000 7f3439600640 1 -- 172.21.15.5:0/4070049173 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f342c055ad0 con 0x7f343c0ca3e0 2024-08-18T22:30:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 -- 172.21.15.5:0/4070049173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f343c15d790 con 0x7f343c0ca3e0 2024-08-18T22:30:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3439600640 1 -- 172.21.15.5:0/4070049173 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f342c0553d0 con 0x7f343c0ca3e0 2024-08-18T22:30:00.688 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:00.688 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":664,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076445795,"bytes_used":2584227840,"bytes_avail":770509885440,"bytes_total":773094113280,"write_bytes_sec":28566453,"read_op_per_sec":0,"write_op_per_sec":29},"fsmap":{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9015}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-08-18T22:29:57.776947+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:30:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 -- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 msgr2=0x7f3418069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 0x7f3418069d80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f34240b2000 tx=0x7f34240aa070 comp rx=0 tx=0).stop 2024-08-18T22:30:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 -- 172.21.15.5:0/4070049173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0ca3e0 msgr2=0x7f343c14f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0ca3e0 0x7f343c14f270 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f342c00c480 tx=0x7f342c00c940 comp rx=0 tx=0).stop 2024-08-18T22:30:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 -- 172.21.15.5:0/4070049173 shutdown_connections 2024-08-18T22:30:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f34180678c0 0x7f3418069d80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f343c15e460 0x7f343c157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f343c0cee40 0x7f343c145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 --2- 172.21.15.5:0/4070049173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f343c0ca3e0 0x7f343c14f270 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 -- 172.21.15.5:0/4070049173 >> 172.21.15.5:0/4070049173 conn(0x7f343c09aa40 msgr2=0x7f343c0af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 -- 172.21.15.5:0/4070049173 shutdown_connections 2024-08-18T22:30:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:00.689+0000 7f3443800640 1 -- 172.21.15.5:0/4070049173 wait complete. 2024-08-18T22:30:00.709 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-08-18T22:30:01.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:01.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed2e000640 1 Processor -- start 2024-08-18T22:30:01.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed2e000640 1 -- start start 2024-08-18T22:30:01.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed2e000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed2806d0d0 0x7fed2815c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:01.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed2e000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed2815e8a0 con 0x7fed2815ace0 2024-08-18T22:30:01.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed2e000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed2815c130 con 0x7fed28072c50 2024-08-18T22:30:01.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed2e000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fed2815eb40 con 0x7fed2806d0d0 2024-08-18T22:30:01.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed2cc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fed2815ace0 0x7fed2806c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53042/0 (socket says 172.21.15.5:53042) 2024-08-18T22:30:01.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed2cc00640 1 -- 172.21.15.5:0/2979982057 learned_addr learned my addr 172.21.15.5:0/2979982057 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed1fe00640 1 --2- 172.21.15.5:0/2979982057 >> v2:172.21.15.117:3300/0 conn(0x7fed2806d0d0 0x7fed2815c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681968643 0 0) 0x7fed2815e8a0 con 0x7fed2815ace0 2024-08-18T22:30:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed0c003530 con 0x7fed2815ace0 2024-08-18T22:30:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2412660797 0 0) 0x7fed2815c130 con 0x7fed28072c50 2024-08-18T22:30:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed2815e8a0 con 0x7fed28072c50 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 933581955 0 0) 0x7fed0c003530 con 0x7fed2815ace0 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 >> v2:172.21.15.117:3300/0 conn(0x7fed2806d0d0 msgr2=0x7fed2815c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 --2- 172.21.15.5:0/2979982057 >> v2:172.21.15.117:3300/0 conn(0x7fed2806d0d0 0x7fed2815c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 >> v1:172.21.15.117:6789/0 conn(0x7fed28072c50 legacy=0x7fed2815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2815ee20 con 0x7fed2815ace0 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fed180016a0 con 0x7fed2815ace0 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 >> v1:172.21.15.5:6789/0 conn(0x7fed2815ace0 legacy=0x7fed2806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed0c003b50 0x7fed0c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed0c004810 0x7fed0c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed0c0051d0 0x7fed0c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fed2815eb40 con 0x7fed0c0051d0 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c00c050 con 0x7fed0c004810 2024-08-18T22:30:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fed0c00c250 con 0x7fed0c003b50 2024-08-18T22:30:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed2d600640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed0c0051d0 0x7fed0c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed2cc00640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed0c003b50 0x7fed0c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.865+0000 7fed1fe00640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed0c004810 0x7fed0c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2cc00640 1 -- 172.21.15.5:0/2979982057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed0c004810 msgr2=0x7fed0c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2cc00640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed0c004810 0x7fed0c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2cc00640 1 -- 172.21.15.5:0/2979982057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed0c0051d0 msgr2=0x7fed0c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2cc00640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed0c0051d0 0x7fed0c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2cc00640 1 -- 172.21.15.5:0/2979982057 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c003530 con 0x7fed0c003b50 2024-08-18T22:30:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2d600640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed0c0051d0 0x7fed0c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2d600640 1 -- 172.21.15.5:0/2979982057 reap_dead start 2024-08-18T22:30:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2cc00640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed0c003b50 0x7fed0c003f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c190 tx=0x7fed1801f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d04da4e9f1f5052 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18007cd0 con 0x7fed0c003b50 2024-08-18T22:30:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed18005b00 con 0x7fed0c003b50 2024-08-18T22:30:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed27e00640 1 -- 172.21.15.5:0/2979982057 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18007070 con 0x7fed0c003b50 2024-08-18T22:30:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2e000640 1 -- 172.21.15.5:0/2979982057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed0c003b50 msgr2=0x7fed0c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2e000640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed0c003b50 0x7fed0c003f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c190 tx=0x7fed1801f330 comp rx=0 tx=0).stop 2024-08-18T22:30:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2e000640 1 -- 172.21.15.5:0/2979982057 shutdown_connections 2024-08-18T22:30:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2e000640 1 --2- 172.21.15.5:0/2979982057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed0c003b50 0x7fed0c003f50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.869+0000 7fed2e000640 1 -- 172.21.15.5:0/2979982057 >> 172.21.15.5:0/2979982057 conn(0x7fed28072130 msgr2=0x7fed28072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2e000640 1 -- 172.21.15.5:0/2979982057 shutdown_connections 2024-08-18T22:30:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2e000640 1 -- 172.21.15.5:0/2979982057 wait complete. 2024-08-18T22:30:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2e000640 1 Processor -- start 2024-08-18T22:30:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2e000640 1 -- start start 2024-08-18T22:30:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2e000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed0c003b50 0x7fed280aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed28148ca0 0x7fed28149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2e000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed2806f8d0 0x7fed2806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2e000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fed2815bd70 con 0x7fed28148ca0 2024-08-18T22:30:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2e000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fed2815b0c0 con 0x7fed0c003b50 2024-08-18T22:30:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2e000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fed2815bef0 con 0x7fed2806f8d0 2024-08-18T22:30:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed1fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed28148ca0 0x7fed28149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed1fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed28148ca0 0x7fed28149120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46482/0 (socket says 172.21.15.5:46482) 2024-08-18T22:30:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed1fe00640 1 -- 172.21.15.5:0/2775583073 learned_addr learned my addr 172.21.15.5:0/2775583073 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2cc00640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed0c003b50 0x7fed280aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2d600640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed2806f8d0 0x7fed2806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed1fe00640 1 -- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed2806f8d0 msgr2=0x7fed2806fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed1fe00640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed2806f8d0 0x7fed2806fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed1fe00640 1 -- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed0c003b50 msgr2=0x7fed280aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed1fe00640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed0c003b50 0x7fed280aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed1fe00640 1 -- 172.21.15.5:0/2775583073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed28070290 con 0x7fed28148ca0 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed2d600640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed2806f8d0 0x7fed2806fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed1fe00640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed28148ca0 0x7fed28149120 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fed10011b60 tx=0x7fed10010810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.873+0000 7fed25600640 1 -- 172.21.15.5:0/2775583073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1000f7e0 con 0x7fed28148ca0 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.877+0000 7fed25600640 1 -- 172.21.15.5:0/2775583073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1000f980 con 0x7fed28148ca0 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.877+0000 7fed2e000640 1 -- 172.21.15.5:0/2775583073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed280b3890 con 0x7fed28148ca0 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.877+0000 7fed25600640 1 -- 172.21.15.5:0/2775583073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1000fd50 con 0x7fed28148ca0 2024-08-18T22:30:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.877+0000 7fed2e000640 1 -- 172.21.15.5:0/2775583073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed280b3e50 con 0x7fed28148ca0 2024-08-18T22:30:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.877+0000 7fed2e000640 1 -- 172.21.15.5:0/2775583073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2815f620 con 0x7fed28148ca0 2024-08-18T22:30:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.877+0000 7fed25600640 1 -- 172.21.15.5:0/2775583073 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed10011d10 con 0x7fed28148ca0 2024-08-18T22:30:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.877+0000 7fed25600640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed040678f0 0x7fed04069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.877+0000 7fed25600640 1 -- 172.21.15.5:0/2775583073 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fed10086be0 con 0x7fed28148ca0 2024-08-18T22:30:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.877+0000 7fed2cc00640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed040678f0 0x7fed04069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.881+0000 7fed2cc00640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed040678f0 0x7fed04069db0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fed180ae000 tx=0x7fed18007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:01.881+0000 7fed25600640 1 -- 172.21.15.5:0/2775583073 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fed100575b0 con 0x7fed28148ca0 2024-08-18T22:30:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.081+0000 7fed2e000640 1 -- 172.21.15.5:0/2775583073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed2806cc50 con 0x7fed28148ca0 2024-08-18T22:30:02.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.081+0000 7fed25600640 1 -- 172.21.15.5:0/2775583073 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7fed10056eb0 con 0x7fed28148ca0 2024-08-18T22:30:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:02.082 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:30:02.082 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:30:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 -- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed040678f0 msgr2=0x7fed04069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed040678f0 0x7fed04069db0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fed180ae000 tx=0x7fed18007040 comp rx=0 tx=0).stop 2024-08-18T22:30:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 -- 172.21.15.5:0/2775583073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed28148ca0 msgr2=0x7fed28149120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed28148ca0 0x7fed28149120 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fed10011b60 tx=0x7fed10010810 comp rx=0 tx=0).stop 2024-08-18T22:30:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 -- 172.21.15.5:0/2775583073 shutdown_connections 2024-08-18T22:30:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed040678f0 0x7fed04069db0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed2806f8d0 0x7fed2806fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed28148ca0 0x7fed28149120 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 --2- 172.21.15.5:0/2775583073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed0c003b50 0x7fed280aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 -- 172.21.15.5:0/2775583073 >> 172.21.15.5:0/2775583073 conn(0x7fed28072130 msgr2=0x7fed2815d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:02.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 -- 172.21.15.5:0/2775583073 shutdown_connections 2024-08-18T22:30:02.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.085+0000 7fed2e000640 1 -- 172.21.15.5:0/2775583073 wait complete. 2024-08-18T22:30:02.103 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:30:02.103 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:30:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.249+0000 7f9959000640 1 Processor -- start 2024-08-18T22:30:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.249+0000 7f9959000640 1 -- start start 2024-08-18T22:30:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9959000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9954070510 0x7f995409b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9959000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995406fe70 con 0x7f99540d02a0 2024-08-18T22:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9959000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9954070150 con 0x7f995415f130 2024-08-18T22:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9959000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f995409aa40 con 0x7f9954070510 2024-08-18T22:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9953e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f99540d02a0 0x7f99540d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53044/0 (socket says 172.21.15.5:53044) 2024-08-18T22:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9953e00640 1 -- 172.21.15.5:0/4007544951 learned_addr learned my addr 172.21.15.5:0/4007544951 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9953400640 1 --2- 172.21.15.5:0/4007544951 >> v2:172.21.15.117:3300/0 conn(0x7f9954070510 0x7f995409b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9952000640 1 -- 172.21.15.5:0/4007544951 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923320624 0 0) 0x7f995406fe70 con 0x7f99540d02a0 2024-08-18T22:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9952000640 1 -- 172.21.15.5:0/4007544951 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9938003530 con 0x7f99540d02a0 2024-08-18T22:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9952000640 1 -- 172.21.15.5:0/4007544951 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943393835 0 0) 0x7f9954070150 con 0x7f995415f130 2024-08-18T22:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9953400640 1 -- 172.21.15.5:0/4007544951 >> v1:172.21.15.117:6789/0 conn(0x7f995415f130 legacy=0x7f99540708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9953400640 1 -- 172.21.15.5:0/4007544951 >> v1:172.21.15.5:6789/0 conn(0x7f99540d02a0 legacy=0x7f99540d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.253+0000 7f9953400640 1 -- 172.21.15.5:0/4007544951 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995409ad20 con 0x7f9954070510 2024-08-18T22:30:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9953400640 1 --2- 172.21.15.5:0/4007544951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9954070510 0x7f995409b520 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f99440097c0 tx=0x7f994401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66fcd32fa5280c1d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9952000640 1 -- 172.21.15.5:0/4007544951 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99440b0070 con 0x7f9954070510 2024-08-18T22:30:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9952000640 1 -- 172.21.15.5:0/4007544951 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99440ab600 con 0x7f9954070510 2024-08-18T22:30:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9952000640 1 -- 172.21.15.5:0/4007544951 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99440ab9d0 con 0x7f9954070510 2024-08-18T22:30:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9959000640 1 -- 172.21.15.5:0/4007544951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9954070510 msgr2=0x7f995409b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9959000640 1 --2- 172.21.15.5:0/4007544951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9954070510 0x7f995409b520 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f99440097c0 tx=0x7f994401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9959000640 1 -- 172.21.15.5:0/4007544951 shutdown_connections 2024-08-18T22:30:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9959000640 1 --2- 172.21.15.5:0/4007544951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9954070510 0x7f995409b520 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9959000640 1 -- 172.21.15.5:0/4007544951 >> 172.21.15.5:0/4007544951 conn(0x7f99540b3a20 msgr2=0x7f99540b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9959000640 1 -- 172.21.15.5:0/4007544951 shutdown_connections 2024-08-18T22:30:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9959000640 1 -- 172.21.15.5:0/4007544951 wait complete. 2024-08-18T22:30:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9959000640 1 Processor -- start 2024-08-18T22:30:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.257+0000 7f9959000640 1 -- start start 2024-08-18T22:30:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9959000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9954070510 0x7f995415d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9959000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540d02a0 0x7f99540b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9959000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995415f130 0x7f9954153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9959000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99540b4850 con 0x7f9954070510 2024-08-18T22:30:02.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9959000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99540b46d0 con 0x7f99540d02a0 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9959000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f995416c7e0 con 0x7f995415f130 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9953400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9954070510 0x7f995415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9953400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9954070510 0x7f995415d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46486/0 (socket says 172.21.15.5:46486) 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9953400640 1 -- 172.21.15.5:0/4056623164 learned_addr learned my addr 172.21.15.5:0/4056623164 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9953e00640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995415f130 0x7f9954153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9952a00640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540d02a0 0x7f99540b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9953400640 1 -- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995415f130 msgr2=0x7f9954153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9953400640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995415f130 0x7f9954153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9953400640 1 -- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540d02a0 msgr2=0x7f99540b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9953400640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540d02a0 0x7f99540b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9953400640 1 -- 172.21.15.5:0/4056623164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9954154960 con 0x7f9954070510 2024-08-18T22:30:02.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9953400640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9954070510 0x7f995415d190 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f99440097c0 tx=0x7f994401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f994b400640 1 -- 172.21.15.5:0/4056623164 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99440b0050 con 0x7f9954070510 2024-08-18T22:30:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f994b400640 1 -- 172.21.15.5:0/4056623164 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99440b1040 con 0x7f9954070510 2024-08-18T22:30:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f994b400640 1 -- 172.21.15.5:0/4056623164 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944006e20 con 0x7f9954070510 2024-08-18T22:30:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9959000640 1 -- 172.21.15.5:0/4056623164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9954154440 con 0x7f9954070510 2024-08-18T22:30:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9959000640 1 -- 172.21.15.5:0/4056623164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99541565f0 con 0x7f9954070510 2024-08-18T22:30:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f9959000640 1 -- 172.21.15.5:0/4056623164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9954070150 con 0x7f9954070510 2024-08-18T22:30:02.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.261+0000 7f994b400640 1 -- 172.21.15.5:0/4056623164 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99440be020 con 0x7f9954070510 2024-08-18T22:30:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.265+0000 7f994b400640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99340678c0 0x7f9934069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.265+0000 7f994b400640 1 -- 172.21.15.5:0/4056623164 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f994411fd30 con 0x7f9954070510 2024-08-18T22:30:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.265+0000 7f9952a00640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99340678c0 0x7f9934069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.265+0000 7f9952a00640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99340678c0 0x7f9934069d80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f99540af5d0 tx=0x7f9940009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:02.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.269+0000 7f994b400640 1 -- 172.21.15.5:0/4056623164 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9954154960 con 0x7f9954070510 2024-08-18T22:30:02.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.489+0000 7f9959000640 1 -- 172.21.15.5:0/4056623164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9954073d40 con 0x7f9954070510 2024-08-18T22:30:02.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f994b400640 1 -- 172.21.15.5:0/4056623164 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f9944016090 con 0x7f9954070510 2024-08-18T22:30:02.490 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:02.490 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":665,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076445795,"bytes_used":2584248320,"bytes_avail":770509864960,"bytes_total":773094113280,"write_bytes_sec":14720012,"read_op_per_sec":0,"write_op_per_sec":15},"fsmap":{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9015}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-08-18T22:29:57.776947+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:30:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 -- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99340678c0 msgr2=0x7f9934069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99340678c0 0x7f9934069d80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f99540af5d0 tx=0x7f9940009040 comp rx=0 tx=0).stop 2024-08-18T22:30:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 -- 172.21.15.5:0/4056623164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9954070510 msgr2=0x7f995415d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9954070510 0x7f995415d190 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f99440097c0 tx=0x7f994401ace0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 -- 172.21.15.5:0/4056623164 shutdown_connections 2024-08-18T22:30:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f99340678c0 0x7f9934069d80 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995415f130 0x7f9954153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540d02a0 0x7f99540b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 --2- 172.21.15.5:0/4056623164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9954070510 0x7f995415d190 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 -- 172.21.15.5:0/4056623164 >> 172.21.15.5:0/4056623164 conn(0x7f99540b3a20 msgr2=0x7f995415e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 -- 172.21.15.5:0/4056623164 shutdown_connections 2024-08-18T22:30:02.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:02.493+0000 7f9959000640 1 -- 172.21.15.5:0/4056623164 wait complete. 2024-08-18T22:30:02.512 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-08-18T22:30:03.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:03.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed61000640 1 Processor -- start 2024-08-18T22:30:03.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed61000640 1 -- start start 2024-08-18T22:30:03.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed61000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c06f290 0x7fed5c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:03.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed61000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed5c0cee20 con 0x7fed5c0cd3a0 2024-08-18T22:30:03.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed61000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed5c0cf100 con 0x7fed5c15b010 2024-08-18T22:30:03.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed61000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fed5c0cfa30 con 0x7fed5c06f290 2024-08-18T22:30:03.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed5a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fed5c0cd3a0 0x7fed5c072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34714/0 (socket says 172.21.15.5:34714) 2024-08-18T22:30:03.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed5a800640 1 -- 172.21.15.5:0/1951233292 learned_addr learned my addr 172.21.15.5:0/1951233292 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:03.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed59400640 1 --2- 172.21.15.5:0/1951233292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c06f290 0x7fed5c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed58a00640 1 -- 172.21.15.5:0/1951233292 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913382200 0 0) 0x7fed5c0cee20 con 0x7fed5c0cd3a0 2024-08-18T22:30:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed58a00640 1 -- 172.21.15.5:0/1951233292 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed40005740 con 0x7fed5c0cd3a0 2024-08-18T22:30:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed58a00640 1 -- 172.21.15.5:0/1951233292 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064058579 0 0) 0x7fed5c0cf100 con 0x7fed5c15b010 2024-08-18T22:30:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed59400640 1 -- 172.21.15.5:0/1951233292 >> v1:172.21.15.117:6789/0 conn(0x7fed5c15b010 legacy=0x7fed5c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed59400640 1 -- 172.21.15.5:0/1951233292 >> v1:172.21.15.5:6789/0 conn(0x7fed5c0cd3a0 legacy=0x7fed5c072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:03.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.669+0000 7fed59400640 1 -- 172.21.15.5:0/1951233292 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c0cf3e0 con 0x7fed5c06f290 2024-08-18T22:30:03.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.673+0000 7fed59400640 1 --2- 172.21.15.5:0/1951233292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c06f290 0x7fed5c0ce840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed480097f0 tx=0x7fed4801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c373375a74c09c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.673+0000 7fed58a00640 1 -- 172.21.15.5:0/1951233292 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed480ab610 con 0x7fed5c06f290 2024-08-18T22:30:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.673+0000 7fed58a00640 1 -- 172.21.15.5:0/1951233292 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed480b0070 con 0x7fed5c06f290 2024-08-18T22:30:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.673+0000 7fed58a00640 1 -- 172.21.15.5:0/1951233292 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed480ab9b0 con 0x7fed5c06f290 2024-08-18T22:30:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.673+0000 7fed61000640 1 -- 172.21.15.5:0/1951233292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c06f290 msgr2=0x7fed5c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.673+0000 7fed61000640 1 --2- 172.21.15.5:0/1951233292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c06f290 0x7fed5c0ce840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed480097f0 tx=0x7fed4801c4b0 comp rx=0 tx=0).stop 2024-08-18T22:30:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.673+0000 7fed61000640 1 -- 172.21.15.5:0/1951233292 shutdown_connections 2024-08-18T22:30:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.673+0000 7fed61000640 1 --2- 172.21.15.5:0/1951233292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c06f290 0x7fed5c0ce840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.673+0000 7fed61000640 1 -- 172.21.15.5:0/1951233292 >> 172.21.15.5:0/1951233292 conn(0x7fed5c0b1c50 msgr2=0x7fed5c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.673+0000 7fed61000640 1 -- 172.21.15.5:0/1951233292 shutdown_connections 2024-08-18T22:30:03.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.673+0000 7fed61000640 1 -- 172.21.15.5:0/1951233292 wait complete. 2024-08-18T22:30:03.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed61000640 1 Processor -- start 2024-08-18T22:30:03.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed61000640 1 -- start start 2024-08-18T22:30:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed61000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed5c06f290 0x7fed5c1503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed61000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5c0cd3a0 0x7fed5c0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed61000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c15b010 0x7fed5c0b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed61000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c0736c0 con 0x7fed5c06f290 2024-08-18T22:30:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed61000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c073540 con 0x7fed5c0cd3a0 2024-08-18T22:30:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed61000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fed5c073840 con 0x7fed5c15b010 2024-08-18T22:30:03.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed59e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed5c06f290 0x7fed5c1503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed59e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed5c06f290 0x7fed5c1503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55934/0 (socket says 172.21.15.5:55934) 2024-08-18T22:30:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed59e00640 1 -- 172.21.15.5:0/424815507 learned_addr learned my addr 172.21.15.5:0/424815507 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed59400640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5c0cd3a0 0x7fed5c0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:03.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed5a800640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c15b010 0x7fed5c0b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed59e00640 1 -- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c15b010 msgr2=0x7fed5c0b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed59e00640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c15b010 0x7fed5c0b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed59e00640 1 -- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5c0cd3a0 msgr2=0x7fed5c0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed59e00640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5c0cd3a0 0x7fed5c0b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:03.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed59e00640 1 -- 172.21.15.5:0/424815507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c0b5ae0 con 0x7fed5c06f290 2024-08-18T22:30:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed5a800640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c15b010 0x7fed5c0b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed59e00640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed5c06f290 0x7fed5c1503e0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c4d0 tx=0x7fed4c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed52000640 1 -- 172.21.15.5:0/424815507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c017070 con 0x7fed5c06f290 2024-08-18T22:30:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed52000640 1 -- 172.21.15.5:0/424815507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed4c005480 con 0x7fed5c06f290 2024-08-18T22:30:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed61000640 1 -- 172.21.15.5:0/424815507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5c15c1b0 con 0x7fed5c06f290 2024-08-18T22:30:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed52000640 1 -- 172.21.15.5:0/424815507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c003840 con 0x7fed5c06f290 2024-08-18T22:30:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.677+0000 7fed61000640 1 -- 172.21.15.5:0/424815507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5c15cc90 con 0x7fed5c06f290 2024-08-18T22:30:03.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.681+0000 7fed61000640 1 -- 172.21.15.5:0/424815507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed5c0ce840 con 0x7fed5c06f290 2024-08-18T22:30:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.681+0000 7fed52000640 1 -- 172.21.15.5:0/424815507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed4c01a070 con 0x7fed5c06f290 2024-08-18T22:30:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.681+0000 7fed52000640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed3c0678c0 0x7fed3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.681+0000 7fed52000640 1 -- 172.21.15.5:0/424815507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7fed4c085250 con 0x7fed5c06f290 2024-08-18T22:30:03.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.681+0000 7fed59400640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed3c0678c0 0x7fed3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:03.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.681+0000 7fed59400640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed3c0678c0 0x7fed3c069d80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fed480af000 tx=0x7fed480a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:03.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.685+0000 7fed52000640 1 -- 172.21.15.5:0/424815507 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fed4c0555d0 con 0x7fed5c06f290 2024-08-18T22:30:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.885+0000 7fed61000640 1 -- 172.21.15.5:0/424815507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed5c0d0b70 con 0x7fed5c06f290 2024-08-18T22:30:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.885+0000 7fed52000640 1 -- 172.21.15.5:0/424815507 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7fed4c0598d0 con 0x7fed5c06f290 2024-08-18T22:30:03.886 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:30:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:30:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 -- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed3c0678c0 msgr2=0x7fed3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed3c0678c0 0x7fed3c069d80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fed480af000 tx=0x7fed480a7000 comp rx=0 tx=0).stop 2024-08-18T22:30:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 -- 172.21.15.5:0/424815507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed5c06f290 msgr2=0x7fed5c1503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed5c06f290 0x7fed5c1503e0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c4d0 tx=0x7fed4c00c990 comp rx=0 tx=0).stop 2024-08-18T22:30:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 -- 172.21.15.5:0/424815507 shutdown_connections 2024-08-18T22:30:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fed3c0678c0 0x7fed3c069d80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5c15b010 0x7fed5c0b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5c0cd3a0 0x7fed5c0b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 --2- 172.21.15.5:0/424815507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed5c06f290 0x7fed5c1503e0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 -- 172.21.15.5:0/424815507 >> 172.21.15.5:0/424815507 conn(0x7fed5c0b1c50 msgr2=0x7fed5c0cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 -- 172.21.15.5:0/424815507 shutdown_connections 2024-08-18T22:30:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:03.889+0000 7fed61000640 1 -- 172.21.15.5:0/424815507 wait complete. 2024-08-18T22:30:03.907 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:30:03.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:30:04.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.045+0000 7f50d5200640 1 Processor -- start 2024-08-18T22:30:04.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50d5200640 1 -- start start 2024-08-18T22:30:04.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50d5200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d015c180 0x7f50d00b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50d5200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50d006fad0 0x7f50d015c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50d5200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50d00b5e30 con 0x7f50d0071580 2024-08-18T22:30:04.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50d5200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f50d015caa0 con 0x7f50d006fad0 2024-08-18T22:30:04.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50d5200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50d00b6110 con 0x7f50d015c180 2024-08-18T22:30:04.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50c5400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50d006fad0 0x7f50d015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50cde00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d015c180 0x7f50d00b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50c5400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50d006fad0 0x7f50d015c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:46060/0 (socket says 172.21.15.5:46060) 2024-08-18T22:30:04.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50cde00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d015c180 0x7f50d00b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:54454/0 (socket says 172.21.15.5:54454) 2024-08-18T22:30:04.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50c5400640 1 -- 172.21.15.5:0/3053231589 learned_addr learned my addr 172.21.15.5:0/3053231589 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:04.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50c5400640 1 -- 172.21.15.5:0/3053231589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d015c180 msgr2=0x7f50d00b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:04.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50c5400640 1 --2- 172.21.15.5:0/3053231589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d015c180 0x7f50d00b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50c5400640 1 -- 172.21.15.5:0/3053231589 >> v1:172.21.15.117:6789/0 conn(0x7f50d0071580 legacy=0x7f50d00d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.049+0000 7f50c5400640 1 -- 172.21.15.5:0/3053231589 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d00b63f0 con 0x7f50d006fad0 2024-08-18T22:30:04.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50c5400640 1 --2- 172.21.15.5:0/3053231589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d006fad0 0x7f50d015c560 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009870 tx=0x7f50b801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd43ad7a578fc6b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:04.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50cd400640 1 -- 172.21.15.5:0/3053231589 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b80b1070 con 0x7f50d006fad0 2024-08-18T22:30:04.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50cd400640 1 -- 172.21.15.5:0/3053231589 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b80ac600 con 0x7f50d006fad0 2024-08-18T22:30:04.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50cd400640 1 -- 172.21.15.5:0/3053231589 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b80ac9d0 con 0x7f50d006fad0 2024-08-18T22:30:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50d5200640 1 -- 172.21.15.5:0/3053231589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d006fad0 msgr2=0x7f50d015c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50d5200640 1 --2- 172.21.15.5:0/3053231589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d006fad0 0x7f50d015c560 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009870 tx=0x7f50b801c410 comp rx=0 tx=0).stop 2024-08-18T22:30:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50d5200640 1 -- 172.21.15.5:0/3053231589 shutdown_connections 2024-08-18T22:30:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50d5200640 1 --2- 172.21.15.5:0/3053231589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d006fad0 0x7f50d015c560 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50d5200640 1 --2- 172.21.15.5:0/3053231589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d015c180 0x7f50d00b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50d5200640 1 -- 172.21.15.5:0/3053231589 >> 172.21.15.5:0/3053231589 conn(0x7f50d00b3eb0 msgr2=0x7f50d00b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50d5200640 1 -- 172.21.15.5:0/3053231589 shutdown_connections 2024-08-18T22:30:04.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50d5200640 1 -- 172.21.15.5:0/3053231589 wait complete. 2024-08-18T22:30:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50d5200640 1 Processor -- start 2024-08-18T22:30:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.053+0000 7f50d5200640 1 -- start start 2024-08-18T22:30:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50d5200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d006fad0 0x7f50d013ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50d5200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d0071580 0x7f50d015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50d5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d015c180 0x7f50d0155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50d5200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f50d0168fd0 con 0x7f50d015c180 2024-08-18T22:30:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50d5200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50d0071dc0 con 0x7f50d0071580 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50d5200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f50d0169150 con 0x7f50d006fad0 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50ce800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d015c180 0x7f50d0155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50ce800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d015c180 0x7f50d0155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55946/0 (socket says 172.21.15.5:55946) 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50ce800640 1 -- 172.21.15.5:0/591808500 learned_addr learned my addr 172.21.15.5:0/591808500 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50c5400640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d0071580 0x7f50d015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50cde00640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d006fad0 0x7f50d013ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50ce800640 1 -- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d006fad0 msgr2=0x7f50d013ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50ce800640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d006fad0 0x7f50d013ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50ce800640 1 -- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d0071580 msgr2=0x7f50d015d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50ce800640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d0071580 0x7f50d015d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50ce800640 1 -- 172.21.15.5:0/591808500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d015e2b0 con 0x7f50d015c180 2024-08-18T22:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50ce800640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d015c180 0x7f50d0155500 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f50c800c730 tx=0x7f50c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50c6a00640 1 -- 172.21.15.5:0/591808500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8003b80 con 0x7f50d015c180 2024-08-18T22:30:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50c6a00640 1 -- 172.21.15.5:0/591808500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c8003d20 con 0x7f50d015c180 2024-08-18T22:30:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50c6a00640 1 -- 172.21.15.5:0/591808500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c800aa30 con 0x7f50d015c180 2024-08-18T22:30:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50d5200640 1 -- 172.21.15.5:0/591808500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d015e590 con 0x7f50d015c180 2024-08-18T22:30:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50d5200640 1 -- 172.21.15.5:0/591808500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d014bd50 con 0x7f50d015c180 2024-08-18T22:30:04.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.057+0000 7f50d5200640 1 -- 172.21.15.5:0/591808500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d015c560 con 0x7f50d015c180 2024-08-18T22:30:04.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.061+0000 7f50c6a00640 1 -- 172.21.15.5:0/591808500 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f50c800abd0 con 0x7f50d015c180 2024-08-18T22:30:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.061+0000 7f50c6a00640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50ac0678c0 0x7f50ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.061+0000 7f50c6a00640 1 -- 172.21.15.5:0/591808500 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6101+0+0 (secure 0 0 0) 0x7f50c8085c60 con 0x7f50d015c180 2024-08-18T22:30:04.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.061+0000 7f50cde00640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50ac0678c0 0x7f50ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.061+0000 7f50cde00640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50ac0678c0 0x7f50ac069d80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009af0 tx=0x7f50c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:04.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.065+0000 7f50c6a00640 1 -- 172.21.15.5:0/591808500 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f50c8056680 con 0x7f50d015c180 2024-08-18T22:30:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.297+0000 7f50d5200640 1 -- 172.21.15.5:0/591808500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f50d00cf7d0 con 0x7f50d015c180 2024-08-18T22:30:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.297+0000 7f50c6a00640 1 -- 172.21.15.5:0/591808500 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7f50c8055f80 con 0x7f50d015c180 2024-08-18T22:30:04.296 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:04.296 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":667,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076445795,"bytes_used":2584248320,"bytes_avail":770509864960,"bytes_total":773094113280,"write_bytes_sec":8954072,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9015}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-08-18T22:30:03.778679+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:30:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 -- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50ac0678c0 msgr2=0x7f50ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50ac0678c0 0x7f50ac069d80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009af0 tx=0x7f50c0008040 comp rx=0 tx=0).stop 2024-08-18T22:30:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 -- 172.21.15.5:0/591808500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d015c180 msgr2=0x7f50d0155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d015c180 0x7f50d0155500 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f50c800c730 tx=0x7f50c800cbf0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 -- 172.21.15.5:0/591808500 shutdown_connections 2024-08-18T22:30:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f50ac0678c0 0x7f50ac069d80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d015c180 0x7f50d0155500 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50d0071580 0x7f50d015d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 --2- 172.21.15.5:0/591808500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50d006fad0 0x7f50d013ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 -- 172.21.15.5:0/591808500 >> 172.21.15.5:0/591808500 conn(0x7f50d00b3eb0 msgr2=0x7f50d006ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 -- 172.21.15.5:0/591808500 shutdown_connections 2024-08-18T22:30:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.301+0000 7f50d5200640 1 -- 172.21.15.5:0/591808500 wait complete. 2024-08-18T22:30:04.318 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-08-18T22:30:04.318 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:30:04.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:30:04.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:30:04.519 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:30:04.519 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:30:04.519 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:30:04.520 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:30:04.529 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:30:04.529 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:30:04.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:30:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd9c00640 1 Processor -- start 2024-08-18T22:30:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd9c00640 1 -- start start 2024-08-18T22:30:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd9c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efcd409aca0 0x7efcd40afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd9c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd409b080 0x7efcd40b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd9c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd406e8a0 con 0x7efcd40b1300 2024-08-18T22:30:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd9c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7efcd409bb80 con 0x7efcd409aca0 2024-08-18T22:30:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd9c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efcd40d2e40 con 0x7efcd409b080 2024-08-18T22:30:04.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd2a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efcd409aca0 0x7efcd40afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcca000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efcd40b1300 0x7efcd40affd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34728/0 (socket says 172.21.15.5:34728) 2024-08-18T22:30:04.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd2a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efcd409aca0 0x7efcd40afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55952/0 (socket says 172.21.15.5:55952) 2024-08-18T22:30:04.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcca000640 1 -- 172.21.15.5:0/214510906 learned_addr learned my addr 172.21.15.5:0/214510906 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:04.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd3400640 1 --2- 172.21.15.5:0/214510906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd409b080 0x7efcd40b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd2a00640 1 -- 172.21.15.5:0/214510906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd409b080 msgr2=0x7efcd40b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:04.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd2a00640 1 --2- 172.21.15.5:0/214510906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd409b080 0x7efcd40b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd2a00640 1 -- 172.21.15.5:0/214510906 >> v1:172.21.15.5:6789/0 conn(0x7efcd40b1300 legacy=0x7efcd40affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.773+0000 7efcd2a00640 1 -- 172.21.15.5:0/214510906 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd406cbd0 con 0x7efcd409aca0 2024-08-18T22:30:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd2a00640 1 --2- 172.21.15.5:0/214510906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcd409aca0 0x7efcd40afa90 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7efcc40097c0 tx=0x7efcc401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402a7ff8cbc66fbf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd2000640 1 -- 172.21.15.5:0/214510906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc40b0070 con 0x7efcd409aca0 2024-08-18T22:30:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd2000640 1 -- 172.21.15.5:0/214510906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc4004230 con 0x7efcd409aca0 2024-08-18T22:30:04.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd2000640 1 -- 172.21.15.5:0/214510906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc4003620 con 0x7efcd409aca0 2024-08-18T22:30:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd9c00640 1 -- 172.21.15.5:0/214510906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcd409aca0 msgr2=0x7efcd40afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd9c00640 1 --2- 172.21.15.5:0/214510906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcd409aca0 0x7efcd40afa90 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7efcc40097c0 tx=0x7efcc401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd9c00640 1 -- 172.21.15.5:0/214510906 shutdown_connections 2024-08-18T22:30:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd9c00640 1 --2- 172.21.15.5:0/214510906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd409b080 0x7efcd40b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd9c00640 1 --2- 172.21.15.5:0/214510906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcd409aca0 0x7efcd40afa90 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd9c00640 1 -- 172.21.15.5:0/214510906 >> 172.21.15.5:0/214510906 conn(0x7efcd40d2180 msgr2=0x7efcd40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd9c00640 1 -- 172.21.15.5:0/214510906 shutdown_connections 2024-08-18T22:30:04.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.777+0000 7efcd9c00640 1 -- 172.21.15.5:0/214510906 wait complete. 2024-08-18T22:30:04.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd9c00640 1 Processor -- start 2024-08-18T22:30:04.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd9c00640 1 -- start start 2024-08-18T22:30:04.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd9c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd409aca0 0x7efcd409f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd9c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcd409b080 0x7efcd4070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd9c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd40b1300 0x7efcd4071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd9c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efcd416b6b0 con 0x7efcd409b080 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd9c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efcd416b530 con 0x7efcd409aca0 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd9c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efcd416b830 con 0x7efcd40b1300 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcca000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcd409b080 0x7efcd4070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcca000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcd409b080 0x7efcd4070b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55968/0 (socket says 172.21.15.5:55968) 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcca000640 1 -- 172.21.15.5:0/3193035812 learned_addr learned my addr 172.21.15.5:0/3193035812 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd2a00640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd409aca0 0x7efcd409f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd3400640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd40b1300 0x7efcd4071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcca000640 1 -- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd40b1300 msgr2=0x7efcd4071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcca000640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd40b1300 0x7efcd4071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcca000640 1 -- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd409aca0 msgr2=0x7efcd409f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcca000640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd409aca0 0x7efcd409f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcca000640 1 -- 172.21.15.5:0/3193035812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd4157e10 con 0x7efcd409b080 2024-08-18T22:30:04.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd3400640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd40b1300 0x7efcd4071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcca000640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcd409b080 0x7efcd4070b20 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c370 tx=0x7efcbc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efccb400640 1 -- 172.21.15.5:0/3193035812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc017070 con 0x7efcd409b080 2024-08-18T22:30:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efccb400640 1 -- 172.21.15.5:0/3193035812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcbc005cf0 con 0x7efcd409b080 2024-08-18T22:30:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd9c00640 1 -- 172.21.15.5:0/3193035812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd415ebe0 con 0x7efcd409b080 2024-08-18T22:30:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efccb400640 1 -- 172.21.15.5:0/3193035812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc0072f0 con 0x7efcd409b080 2024-08-18T22:30:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.781+0000 7efcd9c00640 1 -- 172.21.15.5:0/3193035812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd415f6a0 con 0x7efcd409b080 2024-08-18T22:30:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.785+0000 7efcd9c00640 1 -- 172.21.15.5:0/3193035812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd4145450 con 0x7efcd409b080 2024-08-18T22:30:04.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.785+0000 7efccb400640 1 -- 172.21.15.5:0/3193035812 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efcbc01a070 con 0x7efcd409b080 2024-08-18T22:30:04.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.785+0000 7efccb400640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efcb00678c0 0x7efcb0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:04.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.785+0000 7efccb400640 1 -- 172.21.15.5:0/3193035812 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7efcbc0851c0 con 0x7efcd409b080 2024-08-18T22:30:04.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.785+0000 7efcd2a00640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efcb00678c0 0x7efcb0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:04.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.785+0000 7efcd2a00640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efcb00678c0 0x7efcb0069d80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efcc40ad000 tx=0x7efcc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:04.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.789+0000 7efccb400640 1 -- 172.21.15.5:0/3193035812 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7efcd4145450 con 0x7efcd409b080 2024-08-18T22:30:04.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.965+0000 7efcd9c00640 1 -- 172.21.15.5:0/3193035812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efcd4161940 con 0x7efcd409b080 2024-08-18T22:30:04.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.965+0000 7efccb400640 1 -- 172.21.15.5:0/3193035812 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v154) ==== 80+0+0 (secure 0 0 0) 0x7efcd4157e10 con 0x7efcd409b080 2024-08-18T22:30:04.965 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:30:04.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 -- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efcb00678c0 msgr2=0x7efcb0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efcb00678c0 0x7efcb0069d80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efcc40ad000 tx=0x7efcc4008040 comp rx=0 tx=0).stop 2024-08-18T22:30:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 -- 172.21.15.5:0/3193035812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcd409b080 msgr2=0x7efcd4070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcd409b080 0x7efcd4070b20 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c370 tx=0x7efcbc00c830 comp rx=0 tx=0).stop 2024-08-18T22:30:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 -- 172.21.15.5:0/3193035812 shutdown_connections 2024-08-18T22:30:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efcb00678c0 0x7efcb0069d80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd40b1300 0x7efcd4071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efcd409b080 0x7efcd4070b20 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 --2- 172.21.15.5:0/3193035812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd409aca0 0x7efcd409f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 -- 172.21.15.5:0/3193035812 >> 172.21.15.5:0/3193035812 conn(0x7efcd40d2180 msgr2=0x7efcd415d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 -- 172.21.15.5:0/3193035812 shutdown_connections 2024-08-18T22:30:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:04.969+0000 7efcd9c00640 1 -- 172.21.15.5:0/3193035812 wait complete. 2024-08-18T22:30:04.987 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:30:04.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:04.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:30:05.790 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:30:05.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:05.790 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:30:05.799 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:30:05.799 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:30:05.799 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:30:05.808 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:30:05.809 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:30:05.809 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:30:05.809 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:30:05.854 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:30:05.854 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:30:05.854 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:30:05.854 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:30:05.862 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:30:05.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:06.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.037+0000 7faac6000640 1 Processor -- start 2024-08-18T22:30:06.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.037+0000 7faac6000640 1 -- start start 2024-08-18T22:30:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faac6000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faac00afda0 0x7faac00b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faac6000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac00ce9c0 con 0x7faac00ce3a0 2024-08-18T22:30:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faac6000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac00ceca0 con 0x7faac00b61e0 2024-08-18T22:30:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faac6000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faac015d8c0 con 0x7faac00afda0 2024-08-18T22:30:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faabfe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faac00ce3a0 0x7faac015e0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34736/0 (socket says 172.21.15.5:34736) 2024-08-18T22:30:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faabfe00640 1 -- 172.21.15.5:0/3236658750 learned_addr learned my addr 172.21.15.5:0/3236658750 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faabf400640 1 --2- 172.21.15.5:0/3236658750 >> v2:172.21.15.117:3300/0 conn(0x7faac00afda0 0x7faac00b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faabe000640 1 -- 172.21.15.5:0/3236658750 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715764771 0 0) 0x7faac00ce9c0 con 0x7faac00ce3a0 2024-08-18T22:30:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faabe000640 1 -- 172.21.15.5:0/3236658750 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaa4003530 con 0x7faac00ce3a0 2024-08-18T22:30:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faabe000640 1 -- 172.21.15.5:0/3236658750 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097620153 0 0) 0x7faac00ceca0 con 0x7faac00b61e0 2024-08-18T22:30:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faabe000640 1 -- 172.21.15.5:0/3236658750 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faac00ce9c0 con 0x7faac00b61e0 2024-08-18T22:30:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faabe000640 1 -- 172.21.15.5:0/3236658750 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4070018891 0 0) 0x7faaa4003530 con 0x7faac00ce3a0 2024-08-18T22:30:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faabf400640 1 -- 172.21.15.5:0/3236658750 >> v1:172.21.15.117:6789/0 conn(0x7faac00b61e0 legacy=0x7faac00cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faabf400640 1 -- 172.21.15.5:0/3236658750 >> v1:172.21.15.5:6789/0 conn(0x7faac00ce3a0 legacy=0x7faac015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.041+0000 7faabf400640 1 -- 172.21.15.5:0/3236658750 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac015dba0 con 0x7faac00afda0 2024-08-18T22:30:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faabf400640 1 --2- 172.21.15.5:0/3236658750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac00afda0 0x7faac00b5ca0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7faab00097c0 tx=0x7faab001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da43055e63225930 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faabe000640 1 -- 172.21.15.5:0/3236658750 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab00b0070 con 0x7faac00afda0 2024-08-18T22:30:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faabe000640 1 -- 172.21.15.5:0/3236658750 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab00ab400 con 0x7faac00afda0 2024-08-18T22:30:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faabe000640 1 -- 172.21.15.5:0/3236658750 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8001a00 con 0x7faac00afda0 2024-08-18T22:30:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faac6000640 1 -- 172.21.15.5:0/3236658750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac00afda0 msgr2=0x7faac00b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faac6000640 1 --2- 172.21.15.5:0/3236658750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac00afda0 0x7faac00b5ca0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7faab00097c0 tx=0x7faab001c3c0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faac6000640 1 -- 172.21.15.5:0/3236658750 shutdown_connections 2024-08-18T22:30:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faac6000640 1 --2- 172.21.15.5:0/3236658750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac00afda0 0x7faac00b5ca0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faac6000640 1 -- 172.21.15.5:0/3236658750 >> 172.21.15.5:0/3236658750 conn(0x7faac006b9b0 msgr2=0x7faac006bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faac6000640 1 -- 172.21.15.5:0/3236658750 shutdown_connections 2024-08-18T22:30:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faac6000640 1 -- 172.21.15.5:0/3236658750 wait complete. 2024-08-18T22:30:06.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faac6000640 1 Processor -- start 2024-08-18T22:30:06.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.045+0000 7faac6000640 1 -- start start 2024-08-18T22:30:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faac6000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac00afda0 0x7faac014bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faac6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac00b61e0 0x7faac00ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faac6000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faac00ce3a0 0x7faac00b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faac6000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faac015f350 con 0x7faac00b61e0 2024-08-18T22:30:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faac6000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faac015f1d0 con 0x7faac00afda0 2024-08-18T22:30:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faac6000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faac0169d60 con 0x7faac00ce3a0 2024-08-18T22:30:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac00b61e0 0x7faac00ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabf400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac00afda0 0x7faac014bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac00b61e0 0x7faac00ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55974/0 (socket says 172.21.15.5:55974) 2024-08-18T22:30:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabea00640 1 -- 172.21.15.5:0/2877383809 learned_addr learned my addr 172.21.15.5:0/2877383809 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabfe00640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faac00ce3a0 0x7faac00b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabea00640 1 -- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faac00ce3a0 msgr2=0x7faac00b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabea00640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faac00ce3a0 0x7faac00b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabea00640 1 -- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac00afda0 msgr2=0x7faac014bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabea00640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac00afda0 0x7faac014bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabea00640 1 -- 172.21.15.5:0/2877383809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac015baf0 con 0x7faac00b61e0 2024-08-18T22:30:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabf400640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac00afda0 0x7faac014bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faabea00640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac00b61e0 0x7faac00ccd80 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c430 tx=0x7faaac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faab7400640 1 -- 172.21.15.5:0/2877383809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac017070 con 0x7faac00b61e0 2024-08-18T22:30:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faab7400640 1 -- 172.21.15.5:0/2877383809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaac0052f0 con 0x7faac00b61e0 2024-08-18T22:30:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faab7400640 1 -- 172.21.15.5:0/2877383809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac003840 con 0x7faac00b61e0 2024-08-18T22:30:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faac6000640 1 -- 172.21.15.5:0/2877383809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac015bdd0 con 0x7faac00b61e0 2024-08-18T22:30:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faac6000640 1 -- 172.21.15.5:0/2877383809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac015c390 con 0x7faac00b61e0 2024-08-18T22:30:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faac6000640 1 -- 172.21.15.5:0/2877383809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac00b5ca0 con 0x7faac00b61e0 2024-08-18T22:30:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.049+0000 7faab7400640 1 -- 172.21.15.5:0/2877383809 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faaac01a070 con 0x7faac00b61e0 2024-08-18T22:30:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.053+0000 7faab7400640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa00678c0 0x7faaa0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.053+0000 7faab7400640 1 -- 172.21.15.5:0/2877383809 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6188+0+0 (secure 0 0 0) 0x7faaac085280 con 0x7faac00b61e0 2024-08-18T22:30:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.053+0000 7faabf400640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa00678c0 0x7faaa0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.053+0000 7faabf400640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa00678c0 0x7faaa0069d80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7faab00ad000 tx=0x7faab00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.057+0000 7faab7400640 1 -- 172.21.15.5:0/2877383809 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7faaac0554f0 con 0x7faac00b61e0 2024-08-18T22:30:06.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 -- 172.21.15.5:0/2877383809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faac00cdf70 con 0x7faac00b61e0 2024-08-18T22:30:06.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faab7400640 1 -- 172.21.15.5:0/2877383809 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7faaac0597f0 con 0x7faac00b61e0 2024-08-18T22:30:06.255 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:06.255 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:30:06.255 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:30:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 -- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa00678c0 msgr2=0x7faaa0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa00678c0 0x7faaa0069d80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7faab00ad000 tx=0x7faab00a6000 comp rx=0 tx=0).stop 2024-08-18T22:30:06.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 -- 172.21.15.5:0/2877383809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac00b61e0 msgr2=0x7faac00ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac00b61e0 0x7faac00ccd80 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c430 tx=0x7faaac00c8f0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 -- 172.21.15.5:0/2877383809 shutdown_connections 2024-08-18T22:30:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faaa00678c0 0x7faaa0069d80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faac00ce3a0 0x7faac00b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac00b61e0 0x7faac00ccd80 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 --2- 172.21.15.5:0/2877383809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faac00afda0 0x7faac014bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 -- 172.21.15.5:0/2877383809 >> 172.21.15.5:0/2877383809 conn(0x7faac006b9b0 msgr2=0x7faac00698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 -- 172.21.15.5:0/2877383809 shutdown_connections 2024-08-18T22:30:06.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.257+0000 7faac6000640 1 -- 172.21.15.5:0/2877383809 wait complete. 2024-08-18T22:30:06.277 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:06.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.417+0000 7f777ae00640 1 Processor -- start 2024-08-18T22:30:06.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.417+0000 7f777ae00640 1 -- start start 2024-08-18T22:30:06.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f777ae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777415b010 0x7f77740ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f777ae00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77740cd3a0 0x7f777406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f777ae00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77740cee20 con 0x7f777406f0c0 2024-08-18T22:30:06.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f777ae00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f77740cfa30 con 0x7f77740cd3a0 2024-08-18T22:30:06.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f777ae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f77740cf100 con 0x7f777415b010 2024-08-18T22:30:06.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f7773400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77740cd3a0 0x7f777406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f7778e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f777406f0c0 0x7f77740caf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34740/0 (socket says 172.21.15.5:34740) 2024-08-18T22:30:06.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f7778e00640 1 -- 172.21.15.5:0/38638205 learned_addr learned my addr 172.21.15.5:0/38638205 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:06.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f7773e00640 1 --2- 172.21.15.5:0/38638205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777415b010 0x7f77740ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f7773400640 1 -- 172.21.15.5:0/38638205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777415b010 msgr2=0x7f77740ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:06.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f7773400640 1 --2- 172.21.15.5:0/38638205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777415b010 0x7f77740ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f7773400640 1 -- 172.21.15.5:0/38638205 >> v1:172.21.15.5:6789/0 conn(0x7f777406f0c0 legacy=0x7f77740caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f7773400640 1 -- 172.21.15.5:0/38638205 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77740cf3e0 con 0x7f77740cd3a0 2024-08-18T22:30:06.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.421+0000 7f7772a00640 1 -- 172.21.15.5:0/38638205 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616182983 0 0) 0x7f77740cee20 con 0x7f777406f0c0 2024-08-18T22:30:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f7773400640 1 --2- 172.21.15.5:0/38638205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77740cd3a0 0x7f777406eb80 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f77600097c0 tx=0x7f776001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc187e3a07af8c9b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f7772a00640 1 -- 172.21.15.5:0/38638205 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77600b0070 con 0x7f77740cd3a0 2024-08-18T22:30:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f7772a00640 1 -- 172.21.15.5:0/38638205 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77600ab600 con 0x7f77740cd3a0 2024-08-18T22:30:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f7772a00640 1 -- 172.21.15.5:0/38638205 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77600ab9d0 con 0x7f77740cd3a0 2024-08-18T22:30:06.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f777ae00640 1 -- 172.21.15.5:0/38638205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77740cd3a0 msgr2=0x7f777406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f777ae00640 1 --2- 172.21.15.5:0/38638205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77740cd3a0 0x7f777406eb80 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f77600097c0 tx=0x7f776001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f777ae00640 1 -- 172.21.15.5:0/38638205 shutdown_connections 2024-08-18T22:30:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f777ae00640 1 --2- 172.21.15.5:0/38638205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77740cd3a0 0x7f777406eb80 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f777ae00640 1 --2- 172.21.15.5:0/38638205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777415b010 0x7f77740ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f777ae00640 1 -- 172.21.15.5:0/38638205 >> 172.21.15.5:0/38638205 conn(0x7f77740b1c50 msgr2=0x7f77740b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f777ae00640 1 -- 172.21.15.5:0/38638205 shutdown_connections 2024-08-18T22:30:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f777ae00640 1 -- 172.21.15.5:0/38638205 wait complete. 2024-08-18T22:30:06.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f777ae00640 1 Processor -- start 2024-08-18T22:30:06.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.425+0000 7f777ae00640 1 -- start start 2024-08-18T22:30:06.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f777ae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777406f0c0 0x7f77740b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f777ae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77740cd3a0 0x7f7774144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f777ae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f777415b010 0x7f7774142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f777ae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7774167dd0 con 0x7f777415b010 2024-08-18T22:30:06.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f777ae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7774167c50 con 0x7f77740cd3a0 2024-08-18T22:30:06.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f777ae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7774167f50 con 0x7f777406f0c0 2024-08-18T22:30:06.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f7778e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f777415b010 0x7f7774142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f7778e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f777415b010 0x7f7774142c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55986/0 (socket says 172.21.15.5:55986) 2024-08-18T22:30:06.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f7778e00640 1 -- 172.21.15.5:0/522212068 learned_addr learned my addr 172.21.15.5:0/522212068 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f7773400640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77740cd3a0 0x7f7774144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f7773e00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777406f0c0 0x7f77740b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f7778e00640 1 -- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777406f0c0 msgr2=0x7f77740b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f7778e00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777406f0c0 0x7f77740b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f7778e00640 1 -- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77740cd3a0 msgr2=0x7f7774144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f7778e00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77740cd3a0 0x7f7774144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f7778e00640 1 -- 172.21.15.5:0/522212068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777409c8b0 con 0x7f777415b010 2024-08-18T22:30:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f7778e00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f777415b010 0x7f7774142c70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c7a0 tx=0x7f776c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:06.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f776be00640 1 -- 172.21.15.5:0/522212068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c018070 con 0x7f777415b010 2024-08-18T22:30:06.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f776be00640 1 -- 172.21.15.5:0/522212068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776c00a640 con 0x7f777415b010 2024-08-18T22:30:06.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f776be00640 1 -- 172.21.15.5:0/522212068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c00aa70 con 0x7f777415b010 2024-08-18T22:30:06.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f777ae00640 1 -- 172.21.15.5:0/522212068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77741431b0 con 0x7f777415b010 2024-08-18T22:30:06.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f777ae00640 1 -- 172.21.15.5:0/522212068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7774145750 con 0x7f777415b010 2024-08-18T22:30:06.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f777ae00640 1 -- 172.21.15.5:0/522212068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f777406eb80 con 0x7f777415b010 2024-08-18T22:30:06.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.429+0000 7f776be00640 1 -- 172.21.15.5:0/522212068 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f776c00ac10 con 0x7f777415b010 2024-08-18T22:30:06.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.433+0000 7f776be00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77540678f0 0x7f7754069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.433+0000 7f776be00640 1 -- 172.21.15.5:0/522212068 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6188+0+0 (secure 0 0 0) 0x7f776c085490 con 0x7f777415b010 2024-08-18T22:30:06.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.433+0000 7f7773e00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77540678f0 0x7f7754069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.433+0000 7f7773e00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77540678f0 0x7f7754069db0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f776400b930 tx=0x7f7764008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:06.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.437+0000 7f776be00640 1 -- 172.21.15.5:0/522212068 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f777409c8b0 con 0x7f777415b010 2024-08-18T22:30:06.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.633+0000 7f777ae00640 1 -- 172.21.15.5:0/522212068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77740cb430 con 0x7f777415b010 2024-08-18T22:30:06.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.633+0000 7f776be00640 1 -- 172.21.15.5:0/522212068 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7f776c055d50 con 0x7f777415b010 2024-08-18T22:30:06.633 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:06.633 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:30:06.634 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:30:06.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 -- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77540678f0 msgr2=0x7f7754069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77540678f0 0x7f7754069db0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f776400b930 tx=0x7f7764008040 comp rx=0 tx=0).stop 2024-08-18T22:30:06.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 -- 172.21.15.5:0/522212068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f777415b010 msgr2=0x7f7774142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f777415b010 0x7f7774142c70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c7a0 tx=0x7f776c00cc60 comp rx=0 tx=0).stop 2024-08-18T22:30:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 -- 172.21.15.5:0/522212068 shutdown_connections 2024-08-18T22:30:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77540678f0 0x7f7754069db0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f777415b010 0x7f7774142c70 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77740cd3a0 0x7f7774144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 --2- 172.21.15.5:0/522212068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f777406f0c0 0x7f77740b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 -- 172.21.15.5:0/522212068 >> 172.21.15.5:0/522212068 conn(0x7f77740b1c50 msgr2=0x7f777415d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 -- 172.21.15.5:0/522212068 shutdown_connections 2024-08-18T22:30:06.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.637+0000 7f777ae00640 1 -- 172.21.15.5:0/522212068 wait complete. 2024-08-18T22:30:06.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:30:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.797+0000 7fe6c6800640 1 Processor -- start 2024-08-18T22:30:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.797+0000 7fe6c6800640 1 -- start start 2024-08-18T22:30:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6c6800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe6c006f290 0x7fe6c00ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6c6800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6c00cd3a0 0x7fe6c0072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6c6800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6c00cd850 con 0x7fe6c015b010 2024-08-18T22:30:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6c6800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c00cfa30 con 0x7fe6c00cd3a0 2024-08-18T22:30:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6c6800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c00cee20 con 0x7fe6c006f290 2024-08-18T22:30:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6c00cd3a0 0x7fe6c0072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6bfe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6c00cd3a0 0x7fe6c0072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56002/0 (socket says 172.21.15.5:56002) 2024-08-18T22:30:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6bfe00640 1 -- 172.21.15.5:0/2677965649 learned_addr learned my addr 172.21.15.5:0/2677965649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6bf400640 1 --1- 172.21.15.5:0/2677965649 >> v1:172.21.15.5:6789/0 conn(0x7fe6c015b010 0x7fe6c006eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34746/0 (socket says 172.21.15.5:34746) 2024-08-18T22:30:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6b6a00640 1 --2- 172.21.15.5:0/2677965649 >> v2:172.21.15.117:3300/0 conn(0x7fe6c006f290 0x7fe6c00ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6bfe00640 1 -- 172.21.15.5:0/2677965649 >> v2:172.21.15.117:3300/0 conn(0x7fe6c006f290 msgr2=0x7fe6c00ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6bfe00640 1 --2- 172.21.15.5:0/2677965649 >> v2:172.21.15.117:3300/0 conn(0x7fe6c006f290 0x7fe6c00ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6bfe00640 1 -- 172.21.15.5:0/2677965649 >> v1:172.21.15.5:6789/0 conn(0x7fe6c015b010 legacy=0x7fe6c006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.801+0000 7fe6bfe00640 1 -- 172.21.15.5:0/2677965649 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c00cf100 con 0x7fe6c00cd3a0 2024-08-18T22:30:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6bfe00640 1 --2- 172.21.15.5:0/2677965649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6c00cd3a0 0x7fe6c0072620 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ca580 tx=0x7fe6b801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d5b0c9cb3dd3f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6bea00640 1 -- 172.21.15.5:0/2677965649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b80a5880 con 0x7fe6c00cd3a0 2024-08-18T22:30:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6bea00640 1 -- 172.21.15.5:0/2677965649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b80a5a20 con 0x7fe6c00cd3a0 2024-08-18T22:30:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6bea00640 1 -- 172.21.15.5:0/2677965649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b80a5df0 con 0x7fe6c00cd3a0 2024-08-18T22:30:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 -- 172.21.15.5:0/2677965649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6c00cd3a0 msgr2=0x7fe6c0072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 --2- 172.21.15.5:0/2677965649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6c00cd3a0 0x7fe6c0072620 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ca580 tx=0x7fe6b801c9c0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 -- 172.21.15.5:0/2677965649 shutdown_connections 2024-08-18T22:30:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 --2- 172.21.15.5:0/2677965649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6c00cd3a0 0x7fe6c0072620 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 --2- 172.21.15.5:0/2677965649 >> v2:172.21.15.117:3300/0 conn(0x7fe6c006f290 0x7fe6c00ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 -- 172.21.15.5:0/2677965649 >> 172.21.15.5:0/2677965649 conn(0x7fe6c00b1c50 msgr2=0x7fe6c00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 -- 172.21.15.5:0/2677965649 shutdown_connections 2024-08-18T22:30:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 -- 172.21.15.5:0/2677965649 wait complete. 2024-08-18T22:30:06.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 Processor -- start 2024-08-18T22:30:06.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 -- start start 2024-08-18T22:30:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6c006f290 0x7fe6c014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c00cd3a0 0x7fe6c015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6c015b010 0x7fe6c00b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c00734f0 con 0x7fe6c006f290 2024-08-18T22:30:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c0073370 con 0x7fe6c00cd3a0 2024-08-18T22:30:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6c6800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c0073670 con 0x7fe6c015b010 2024-08-18T22:30:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6bf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6c006f290 0x7fe6c014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6bf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6c006f290 0x7fe6c014ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56010/0 (socket says 172.21.15.5:56010) 2024-08-18T22:30:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.805+0000 7fe6bf400640 1 -- 172.21.15.5:0/3374443886 learned_addr learned my addr 172.21.15.5:0/3374443886 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6b6a00640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c00cd3a0 0x7fe6c015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6bfe00640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6c015b010 0x7fe6c00b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6bf400640 1 -- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6c015b010 msgr2=0x7fe6c00b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6bf400640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6c015b010 0x7fe6c00b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6bf400640 1 -- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c00cd3a0 msgr2=0x7fe6c015b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6bf400640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c00cd3a0 0x7fe6c015b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6bf400640 1 -- 172.21.15.5:0/3374443886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c00b5bd0 con 0x7fe6c006f290 2024-08-18T22:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6bf400640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6c006f290 0x7fe6c014ed60 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000c370 tx=0x7fe6b000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6b7e00640 1 -- 172.21.15.5:0/3374443886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00074e0 con 0x7fe6c006f290 2024-08-18T22:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6b7e00640 1 -- 172.21.15.5:0/3374443886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0007680 con 0x7fe6c006f290 2024-08-18T22:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6b7e00640 1 -- 172.21.15.5:0/3374443886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0004a30 con 0x7fe6c006f290 2024-08-18T22:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6c6800640 1 -- 172.21.15.5:0/3374443886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c00b30f0 con 0x7fe6c006f290 2024-08-18T22:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6c6800640 1 -- 172.21.15.5:0/3374443886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c014e8d0 con 0x7fe6c006f290 2024-08-18T22:30:06.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6c6800640 1 -- 172.21.15.5:0/3374443886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c014eb60 con 0x7fe6c006f290 2024-08-18T22:30:06.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6b7e00640 1 -- 172.21.15.5:0/3374443886 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe6b001a020 con 0x7fe6c006f290 2024-08-18T22:30:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.809+0000 7fe6b7e00640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe69c0678c0 0x7fe69c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.813+0000 7fe6b7e00640 1 -- 172.21.15.5:0/3374443886 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6188+0+0 (secure 0 0 0) 0x7fe6b0085630 con 0x7fe6c006f290 2024-08-18T22:30:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.813+0000 7fe6b6a00640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe69c0678c0 0x7fe69c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.813+0000 7fe6b6a00640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe69c0678c0 0x7fe69c069d80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00cb640 tx=0x7fe6a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:06.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.817+0000 7fe6b7e00640 1 -- 172.21.15.5:0/3374443886 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe6c014eb60 con 0x7fe6c006f290 2024-08-18T22:30:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.981+0000 7fe6c6800640 1 -- 172.21.15.5:0/3374443886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6c00ce840 con 0x7fe6c006f290 2024-08-18T22:30:06.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.981+0000 7fe6b7e00640 1 -- 172.21.15.5:0/3374443886 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16965 (secure 0 0 0) 0x7fe6b0055f80 con 0x7fe6c006f290 2024-08-18T22:30:06.981 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:06.981 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":155,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:30:05.239888+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:29:19.253390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-08-18T22:29:20.520089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.36","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:30:06.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 -- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe69c0678c0 msgr2=0x7fe69c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe69c0678c0 0x7fe69c069d80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00cb640 tx=0x7fe6a8008040 comp rx=0 tx=0).stop 2024-08-18T22:30:06.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 -- 172.21.15.5:0/3374443886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6c006f290 msgr2=0x7fe6c014ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:06.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6c006f290 0x7fe6c014ed60 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000c370 tx=0x7fe6b000c830 comp rx=0 tx=0).stop 2024-08-18T22:30:06.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 -- 172.21.15.5:0/3374443886 shutdown_connections 2024-08-18T22:30:06.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe69c0678c0 0x7fe69c069d80 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6c015b010 0x7fe6c00b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c00cd3a0 0x7fe6c015b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 --2- 172.21.15.5:0/3374443886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6c006f290 0x7fe6c014ed60 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:06.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 -- 172.21.15.5:0/3374443886 >> 172.21.15.5:0/3374443886 conn(0x7fe6c00b1c50 msgr2=0x7fe6c00cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:06.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 -- 172.21.15.5:0/3374443886 shutdown_connections 2024-08-18T22:30:06.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:06.985+0000 7fe6c6800640 1 -- 172.21.15.5:0/3374443886 wait complete. 2024-08-18T22:30:07.002 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:30:07.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:07.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f3236600640 1 Processor -- start 2024-08-18T22:30:07.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f3236600640 1 -- start start 2024-08-18T22:30:07.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f3236600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 0x7f3230070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f3236600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3230070430 con 0x7f3230070730 2024-08-18T22:30:07.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f3236600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f323015eb60 con 0x7f3230161960 2024-08-18T22:30:07.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f3236600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f323015e940 con 0x7f323015e4b0 2024-08-18T22:30:07.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f3226a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3230070730 0x7f323015dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34760/0 (socket says 172.21.15.5:34760) 2024-08-18T22:30:07.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f3226a00640 1 -- 172.21.15.5:0/2131021635 learned_addr learned my addr 172.21.15.5:0/2131021635 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:07.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f322fe00640 1 --2- 172.21.15.5:0/2131021635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 0x7f3230070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f322ea00640 1 -- 172.21.15.5:0/2131021635 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944303885 0 0) 0x7f3230070430 con 0x7f3230070730 2024-08-18T22:30:07.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f322fe00640 1 -- 172.21.15.5:0/2131021635 >> v1:172.21.15.117:6789/0 conn(0x7f3230161960 legacy=0x7f323006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f322fe00640 1 -- 172.21.15.5:0/2131021635 >> v1:172.21.15.5:6789/0 conn(0x7f3230070730 legacy=0x7f323015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.145+0000 7f322fe00640 1 -- 172.21.15.5:0/2131021635 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323015ee40 con 0x7f323015e4b0 2024-08-18T22:30:07.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.149+0000 7f322fe00640 1 --2- 172.21.15.5:0/2131021635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 0x7f3230070ba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3228009dc0 tx=0x7f322801c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29ca277386a0300d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.149+0000 7f322ea00640 1 -- 172.21.15.5:0/2131021635 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280ac070 con 0x7f323015e4b0 2024-08-18T22:30:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.149+0000 7f322ea00640 1 -- 172.21.15.5:0/2131021635 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32280a6690 con 0x7f323015e4b0 2024-08-18T22:30:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.149+0000 7f322ea00640 1 -- 172.21.15.5:0/2131021635 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280a6a60 con 0x7f323015e4b0 2024-08-18T22:30:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.149+0000 7f3236600640 1 -- 172.21.15.5:0/2131021635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 msgr2=0x7f3230070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.149+0000 7f3236600640 1 --2- 172.21.15.5:0/2131021635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 0x7f3230070ba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3228009dc0 tx=0x7f322801c840 comp rx=0 tx=0).stop 2024-08-18T22:30:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.149+0000 7f3236600640 1 -- 172.21.15.5:0/2131021635 shutdown_connections 2024-08-18T22:30:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.149+0000 7f3236600640 1 --2- 172.21.15.5:0/2131021635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 0x7f3230070ba0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.149+0000 7f3236600640 1 -- 172.21.15.5:0/2131021635 >> 172.21.15.5:0/2131021635 conn(0x7f32300d2130 msgr2=0x7f32300d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.149+0000 7f3236600640 1 -- 172.21.15.5:0/2131021635 shutdown_connections 2024-08-18T22:30:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.149+0000 7f3236600640 1 -- 172.21.15.5:0/2131021635 wait complete. 2024-08-18T22:30:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3236600640 1 Processor -- start 2024-08-18T22:30:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3236600640 1 -- start start 2024-08-18T22:30:07.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3236600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3230070730 0x7f3230146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3236600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 0x7f32300cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3236600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3230161960 0x7f32300c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3236600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f323009ba30 con 0x7f3230161960 2024-08-18T22:30:07.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3236600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f32300710e0 con 0x7f3230070730 2024-08-18T22:30:07.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3236600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f32300b5100 con 0x7f323015e4b0 2024-08-18T22:30:07.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f322fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3230161960 0x7f32300c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f322fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3230161960 0x7f32300c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56014/0 (socket says 172.21.15.5:56014) 2024-08-18T22:30:07.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f322fe00640 1 -- 172.21.15.5:0/3355890473 learned_addr learned my addr 172.21.15.5:0/3355890473 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f322f400640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3230070730 0x7f3230146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f322fe00640 1 -- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 msgr2=0x7f32300cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3226a00640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 0x7f32300cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f322fe00640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 0x7f32300cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f322fe00640 1 -- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3230070730 msgr2=0x7f3230146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f322fe00640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3230070730 0x7f3230146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f322fe00640 1 -- 172.21.15.5:0/3355890473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32300b53c0 con 0x7f3230161960 2024-08-18T22:30:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f322f400640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3230070730 0x7f3230146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3226a00640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 0x7f32300cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:07.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f322fe00640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3230161960 0x7f32300c77a0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f322801a470 tx=0x7f32280195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3227e00640 1 -- 172.21.15.5:0/3355890473 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280ac070 con 0x7f3230161960 2024-08-18T22:30:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3227e00640 1 -- 172.21.15.5:0/3355890473 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32280a7880 con 0x7f3230161960 2024-08-18T22:30:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3236600640 1 -- 172.21.15.5:0/3355890473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32300b7b00 con 0x7f3230161960 2024-08-18T22:30:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3227e00640 1 -- 172.21.15.5:0/3355890473 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280a7c50 con 0x7f3230161960 2024-08-18T22:30:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.153+0000 7f3236600640 1 -- 172.21.15.5:0/3355890473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32300c7ce0 con 0x7f3230161960 2024-08-18T22:30:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.157+0000 7f3236600640 1 -- 172.21.15.5:0/3355890473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f323009bbb0 con 0x7f3230161960 2024-08-18T22:30:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.157+0000 7f3227e00640 1 -- 172.21.15.5:0/3355890473 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32280af070 con 0x7f3230161960 2024-08-18T22:30:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.157+0000 7f3227e00640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f320c0678c0 0x7f320c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.157+0000 7f3227e00640 1 -- 172.21.15.5:0/3355890473 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6188+0+0 (secure 0 0 0) 0x7f32281209a0 con 0x7f3230161960 2024-08-18T22:30:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.157+0000 7f322f400640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f320c0678c0 0x7f320c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.157+0000 7f322f400640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f320c0678c0 0x7f320c069d80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3220007fd0 tx=0x7f3220009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:07.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.161+0000 7f3227e00640 1 -- 172.21.15.5:0/3355890473 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f32280c1060 con 0x7f3230161960 2024-08-18T22:30:07.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.361+0000 7f3236600640 1 -- 172.21.15.5:0/3355890473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32300d3010 con 0x7f3230161960 2024-08-18T22:30:07.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.361+0000 7f3227e00640 1 -- 172.21.15.5:0/3355890473 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7f32280164c0 con 0x7f3230161960 2024-08-18T22:30:07.360 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:07.360 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:30:07.361 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:30:07.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 -- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f320c0678c0 msgr2=0x7f320c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f320c0678c0 0x7f320c069d80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3220007fd0 tx=0x7f3220009040 comp rx=0 tx=0).stop 2024-08-18T22:30:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 -- 172.21.15.5:0/3355890473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3230161960 msgr2=0x7f32300c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3230161960 0x7f32300c77a0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f322801a470 tx=0x7f32280195e0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 -- 172.21.15.5:0/3355890473 shutdown_connections 2024-08-18T22:30:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f320c0678c0 0x7f320c069d80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3230161960 0x7f32300c77a0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f323015e4b0 0x7f32300cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 --2- 172.21.15.5:0/3355890473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3230070730 0x7f3230146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 -- 172.21.15.5:0/3355890473 >> 172.21.15.5:0/3355890473 conn(0x7f32300d2130 msgr2=0x7f32300b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 -- 172.21.15.5:0/3355890473 shutdown_connections 2024-08-18T22:30:07.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.365+0000 7f3236600640 1 -- 172.21.15.5:0/3355890473 wait complete. 2024-08-18T22:30:07.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1ea000640 1 Processor -- start 2024-08-18T22:30:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1ea000640 1 -- start start 2024-08-18T22:30:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1ea000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff1e4070730 0x7ff1e4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1ea000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1e415dda0 0x7ff1e415e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1ea000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e4070430 con 0x7ff1e4161960 2024-08-18T22:30:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1ea000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e40710e0 con 0x7ff1e415dda0 2024-08-18T22:30:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1ea000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e415fcc0 con 0x7ff1e4070730 2024-08-18T22:30:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1e3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1e415dda0 0x7ff1e415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1e3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1e415dda0 0x7ff1e415e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56016/0 (socket says 172.21.15.5:56016) 2024-08-18T22:30:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1e3e00640 1 -- 172.21.15.5:0/3111261799 learned_addr learned my addr 172.21.15.5:0/3111261799 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1e2a00640 1 --2- 172.21.15.5:0/3111261799 >> v2:172.21.15.117:3300/0 conn(0x7ff1e4070730 0x7ff1e4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1e3e00640 1 -- 172.21.15.5:0/3111261799 >> v2:172.21.15.117:3300/0 conn(0x7ff1e4070730 msgr2=0x7ff1e4070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.525+0000 7ff1e3e00640 1 --2- 172.21.15.5:0/3111261799 >> v2:172.21.15.117:3300/0 conn(0x7ff1e4070730 0x7ff1e4070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1e3e00640 1 -- 172.21.15.5:0/3111261799 >> v1:172.21.15.117:6789/0 conn(0x7ff1e4161960 legacy=0x7ff1e406fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1e3e00640 1 -- 172.21.15.5:0/3111261799 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e415eb60 con 0x7ff1e415dda0 2024-08-18T22:30:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1e3e00640 1 --2- 172.21.15.5:0/3111261799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e415dda0 0x7ff1e415e230 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4071d80 tx=0x7ff1dc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c8b32f0db83f3c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1e2000640 1 -- 172.21.15.5:0/3111261799 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0a57a0 con 0x7ff1e415dda0 2024-08-18T22:30:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1e2000640 1 -- 172.21.15.5:0/3111261799 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0a5940 con 0x7ff1e415dda0 2024-08-18T22:30:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1e2000640 1 -- 172.21.15.5:0/3111261799 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0a5d10 con 0x7ff1e415dda0 2024-08-18T22:30:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1ea000640 1 -- 172.21.15.5:0/3111261799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e415dda0 msgr2=0x7ff1e415e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1ea000640 1 --2- 172.21.15.5:0/3111261799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e415dda0 0x7ff1e415e230 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4071d80 tx=0x7ff1dc01c9f0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1ea000640 1 -- 172.21.15.5:0/3111261799 shutdown_connections 2024-08-18T22:30:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1ea000640 1 --2- 172.21.15.5:0/3111261799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e415dda0 0x7ff1e415e230 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1ea000640 1 --2- 172.21.15.5:0/3111261799 >> v2:172.21.15.117:3300/0 conn(0x7ff1e4070730 0x7ff1e4070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1ea000640 1 -- 172.21.15.5:0/3111261799 >> 172.21.15.5:0/3111261799 conn(0x7ff1e40d2130 msgr2=0x7ff1e40d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1ea000640 1 -- 172.21.15.5:0/3111261799 shutdown_connections 2024-08-18T22:30:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.529+0000 7ff1ea000640 1 -- 172.21.15.5:0/3111261799 wait complete. 2024-08-18T22:30:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1ea000640 1 Processor -- start 2024-08-18T22:30:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1ea000640 1 -- start start 2024-08-18T22:30:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1ea000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e4070730 0x7ff1e409f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1ea000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e415dda0 0x7ff1e415d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1ea000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e4161960 0x7ff1e40b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1ea000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e409ba30 con 0x7ff1e4070730 2024-08-18T22:30:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1ea000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e415f6e0 con 0x7ff1e4161960 2024-08-18T22:30:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1ea000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e415ce70 con 0x7ff1e415dda0 2024-08-18T22:30:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1e3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e4070730 0x7ff1e409f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1e3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e4070730 0x7ff1e409f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56026/0 (socket says 172.21.15.5:56026) 2024-08-18T22:30:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1e3400640 1 -- 172.21.15.5:0/1572846828 learned_addr learned my addr 172.21.15.5:0/1572846828 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1e2a00640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e415dda0 0x7ff1e415d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1e3e00640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e4161960 0x7ff1e40b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1e3400640 1 -- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e415dda0 msgr2=0x7ff1e415d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1e3400640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e415dda0 0x7ff1e415d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1e3400640 1 -- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e4161960 msgr2=0x7ff1e40b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1e3400640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e4161960 0x7ff1e40b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1e3400640 1 -- 172.21.15.5:0/1572846828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e409fda0 con 0x7ff1e4070730 2024-08-18T22:30:07.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1e3400640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e4070730 0x7ff1e409f860 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400c420 tx=0x7ff1d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1db400640 1 -- 172.21.15.5:0/1572846828 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40052d0 con 0x7ff1e4070730 2024-08-18T22:30:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1db400640 1 -- 172.21.15.5:0/1572846828 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d4005470 con 0x7ff1e4070730 2024-08-18T22:30:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1db400640 1 -- 172.21.15.5:0/1572846828 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4007260 con 0x7ff1e4070730 2024-08-18T22:30:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1ea000640 1 -- 172.21.15.5:0/1572846828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e415c260 con 0x7ff1e4070730 2024-08-18T22:30:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.533+0000 7ff1ea000640 1 -- 172.21.15.5:0/1572846828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e415c820 con 0x7ff1e4070730 2024-08-18T22:30:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.537+0000 7ff1ea000640 1 -- 172.21.15.5:0/1572846828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e4070ba0 con 0x7ff1e4070730 2024-08-18T22:30:07.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.537+0000 7ff1db400640 1 -- 172.21.15.5:0/1572846828 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1d4007400 con 0x7ff1e4070730 2024-08-18T22:30:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.537+0000 7ff1db400640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1c40678c0 0x7ff1c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.537+0000 7ff1db400640 1 -- 172.21.15.5:0/1572846828 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6188+0+0 (secure 0 0 0) 0x7ff1d40852b0 con 0x7ff1e4070730 2024-08-18T22:30:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.537+0000 7ff1e2a00640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1c40678c0 0x7ff1c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.537+0000 7ff1e2a00640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1c40678c0 0x7ff1c4069d80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40b1dd0 tx=0x7ff1d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:07.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.541+0000 7ff1db400640 1 -- 172.21.15.5:0/1572846828 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff1d40555b0 con 0x7ff1e4070730 2024-08-18T22:30:07.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.741+0000 7ff1ea000640 1 -- 172.21.15.5:0/1572846828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1e409bbb0 con 0x7ff1e4070730 2024-08-18T22:30:07.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1db400640 1 -- 172.21.15.5:0/1572846828 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+5233 (secure 0 0 0) 0x7ff1d40598b0 con 0x7ff1e4070730 2024-08-18T22:30:07.742 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:07.742 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":117,"btime":"2024-08-18T22:29:25:145721+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:29:21.514415+0000","modified":"2024-08-18T22:29:24.540103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1418980807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1418980807},{"type":"v1","addr":"172.21.15.5:6835","nonce":1418980807}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":10}]} 2024-08-18T22:30:07.743 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 117 2024-08-18T22:30:07.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 -- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1c40678c0 msgr2=0x7ff1c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1c40678c0 0x7ff1c4069d80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40b1dd0 tx=0x7ff1d0008040 comp rx=0 tx=0).stop 2024-08-18T22:30:07.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 -- 172.21.15.5:0/1572846828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e4070730 msgr2=0x7ff1e409f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e4070730 0x7ff1e409f860 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400c420 tx=0x7ff1d400c8e0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 -- 172.21.15.5:0/1572846828 shutdown_connections 2024-08-18T22:30:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff1c40678c0 0x7ff1c4069d80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e4161960 0x7ff1e40b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e415dda0 0x7ff1e415d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 --2- 172.21.15.5:0/1572846828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e4070730 0x7ff1e409f860 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 -- 172.21.15.5:0/1572846828 >> 172.21.15.5:0/1572846828 conn(0x7ff1e40d2130 msgr2=0x7ff1e415e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 -- 172.21.15.5:0/1572846828 shutdown_connections 2024-08-18T22:30:07.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.745+0000 7ff1ea000640 1 -- 172.21.15.5:0/1572846828 wait complete. 2024-08-18T22:30:07.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:30:07.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.905+0000 7f35ad600640 1 Processor -- start 2024-08-18T22:30:07.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.905+0000 7f35ad600640 1 -- start start 2024-08-18T22:30:07.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35ad600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35a809aa40 0x7f35a815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35ad600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35a80cde30 0x7f35a809ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35ad600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f35a80b4510 0x7f35a815fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35ad600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f35a80ce770 con 0x7f35a80cde30 2024-08-18T22:30:07.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35ad600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f35a815d520 con 0x7f35a80b4510 2024-08-18T22:30:07.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35ad600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f35a809b360 con 0x7f35a809aa40 2024-08-18T22:30:07.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35a7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35a80cde30 0x7f35a809ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35a7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35a80cde30 0x7f35a809ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56042/0 (socket says 172.21.15.5:56042) 2024-08-18T22:30:07.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35a7400640 1 -- 172.21.15.5:0/379594438 learned_addr learned my addr 172.21.15.5:0/379594438 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:07.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35a7e00640 1 --2- 172.21.15.5:0/379594438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35a809aa40 0x7f35a815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35acc00640 1 --2- 172.21.15.5:0/379594438 >> v2:172.21.15.117:3300/0 conn(0x7f35a80b4510 0x7f35a815fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35a7400640 1 -- 172.21.15.5:0/379594438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35a809aa40 msgr2=0x7f35a815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35a7400640 1 --2- 172.21.15.5:0/379594438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35a809aa40 0x7f35a815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35a7400640 1 -- 172.21.15.5:0/379594438 >> v2:172.21.15.117:3300/0 conn(0x7f35a80b4510 msgr2=0x7f35a815fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35a7400640 1 --2- 172.21.15.5:0/379594438 >> v2:172.21.15.117:3300/0 conn(0x7f35a80b4510 0x7f35a815fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35a7400640 1 -- 172.21.15.5:0/379594438 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a80ccd90 con 0x7f35a80cde30 2024-08-18T22:30:07.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.909+0000 7f35a7400640 1 --2- 172.21.15.5:0/379594438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80cde30 0x7f35a809ae20 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f35a8160ba0 tx=0x7f359401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67003f08e6903f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:07.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35a6a00640 1 -- 172.21.15.5:0/379594438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940b0070 con 0x7f35a80cde30 2024-08-18T22:30:07.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35a6a00640 1 -- 172.21.15.5:0/379594438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35940ab600 con 0x7f35a80cde30 2024-08-18T22:30:07.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35a6a00640 1 -- 172.21.15.5:0/379594438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940ab9d0 con 0x7f35a80cde30 2024-08-18T22:30:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 -- 172.21.15.5:0/379594438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80cde30 msgr2=0x7f35a809ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 --2- 172.21.15.5:0/379594438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80cde30 0x7f35a809ae20 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f35a8160ba0 tx=0x7f359401c230 comp rx=0 tx=0).stop 2024-08-18T22:30:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 -- 172.21.15.5:0/379594438 shutdown_connections 2024-08-18T22:30:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 --2- 172.21.15.5:0/379594438 >> v2:172.21.15.117:3300/0 conn(0x7f35a80b4510 0x7f35a815fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 --2- 172.21.15.5:0/379594438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80cde30 0x7f35a809ae20 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 --2- 172.21.15.5:0/379594438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35a809aa40 0x7f35a815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 -- 172.21.15.5:0/379594438 >> 172.21.15.5:0/379594438 conn(0x7f35a80b3a20 msgr2=0x7f35a80b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 -- 172.21.15.5:0/379594438 shutdown_connections 2024-08-18T22:30:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 -- 172.21.15.5:0/379594438 wait complete. 2024-08-18T22:30:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 Processor -- start 2024-08-18T22:30:07.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 -- start start 2024-08-18T22:30:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35a809aa40 0x7f35a814e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80b4510 0x7f35a80c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35a80cde30 0x7f35a80cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f35a815c230 con 0x7f35a80b4510 2024-08-18T22:30:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35a80cd910 con 0x7f35a809aa40 2024-08-18T22:30:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35ad600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f35a815c3b0 con 0x7f35a80cde30 2024-08-18T22:30:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35a7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80b4510 0x7f35a80c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35a7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80b4510 0x7f35a80c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56044/0 (socket says 172.21.15.5:56044) 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35a7400640 1 -- 172.21.15.5:0/251732158 learned_addr learned my addr 172.21.15.5:0/251732158 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35acc00640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35a80cde30 0x7f35a80cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.913+0000 7f35a7e00640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35a809aa40 0x7f35a814e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f35a7400640 1 -- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35a80cde30 msgr2=0x7f35a80cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f35a7400640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35a80cde30 0x7f35a80cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f35a7400640 1 -- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35a809aa40 msgr2=0x7f35a814e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f35a7400640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35a809aa40 0x7f35a814e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f35a7400640 1 -- 172.21.15.5:0/251732158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a80aeea0 con 0x7f35a80b4510 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f35a7400640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80b4510 0x7f35a80c7860 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f35940ae040 tx=0x7f359401aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f359fe00640 1 -- 172.21.15.5:0/251732158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940ba020 con 0x7f35a80b4510 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f359fe00640 1 -- 172.21.15.5:0/251732158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35940b6420 con 0x7f35a80b4510 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f359fe00640 1 -- 172.21.15.5:0/251732158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940b0040 con 0x7f35a80b4510 2024-08-18T22:30:07.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f35ad600640 1 -- 172.21.15.5:0/251732158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a80af180 con 0x7f35a80b4510 2024-08-18T22:30:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f35ad600640 1 -- 172.21.15.5:0/251732158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a80af740 con 0x7f35a80b4510 2024-08-18T22:30:07.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f35ad600640 1 -- 172.21.15.5:0/251732158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a80b5640 con 0x7f35a80b4510 2024-08-18T22:30:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f359fe00640 1 -- 172.21.15.5:0/251732158 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35940bd020 con 0x7f35a80b4510 2024-08-18T22:30:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f359fe00640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f35880678c0 0x7f3588069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f359fe00640 1 -- 172.21.15.5:0/251732158 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6188+0+0 (secure 0 0 0) 0x7f359411ff00 con 0x7f35a80b4510 2024-08-18T22:30:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.917+0000 7f35a7e00640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f35880678c0 0x7f3588069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:07.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.921+0000 7f35a7e00640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f35880678c0 0x7f3588069d80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3598009ac0 tx=0x7f3598009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:07.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:07.921+0000 7f359fe00640 1 -- 172.21.15.5:0/251732158 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f35a80b5640 con 0x7f35a80b4510 2024-08-18T22:30:08.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.089+0000 7f35ad600640 1 -- 172.21.15.5:0/251732158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35a8073d40 con 0x7f35a80b4510 2024-08-18T22:30:08.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f359fe00640 1 -- 172.21.15.5:0/251732158 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16965 (secure 0 0 0) 0x7f35940c4030 con 0x7f35a80b4510 2024-08-18T22:30:08.091 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":155,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:30:05.239888+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:29:19.253390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-08-18T22:29:20.520089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.36","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:30:08.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 -- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f35880678c0 msgr2=0x7f3588069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f35880678c0 0x7f3588069d80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3598009ac0 tx=0x7f3598009190 comp rx=0 tx=0).stop 2024-08-18T22:30:08.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 -- 172.21.15.5:0/251732158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80b4510 msgr2=0x7f35a80c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80b4510 0x7f35a80c7860 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f35940ae040 tx=0x7f359401aa70 comp rx=0 tx=0).stop 2024-08-18T22:30:08.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 -- 172.21.15.5:0/251732158 shutdown_connections 2024-08-18T22:30:08.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f35880678c0 0x7f3588069d80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35a80cde30 0x7f35a80cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35a80b4510 0x7f35a80c7860 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 --2- 172.21.15.5:0/251732158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35a809aa40 0x7f35a814e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 -- 172.21.15.5:0/251732158 >> 172.21.15.5:0/251732158 conn(0x7f35a80b3a20 msgr2=0x7f35a815f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:08.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 -- 172.21.15.5:0/251732158 shutdown_connections 2024-08-18T22:30:08.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.093+0000 7f35ad600640 1 -- 172.21.15.5:0/251732158 wait complete. 2024-08-18T22:30:08.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:30:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec7200640 1 Processor -- start 2024-08-18T22:30:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec7200640 1 -- start start 2024-08-18T22:30:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec7200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ec8158a00 0x7f5ec815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec7200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ec80afad0 0x7f5ec80cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec7200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ec80b4990 0x7f5ec80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec7200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec8158de0 con 0x7f5ec80afad0 2024-08-18T22:30:08.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec7200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec8067c50 con 0x7f5ec8158a00 2024-08-18T22:30:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec7200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec815c310 con 0x7f5ec80b4990 2024-08-18T22:30:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec5400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ec80afad0 0x7f5ec80cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec5400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ec80afad0 0x7f5ec80cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56050/0 (socket says 172.21.15.5:56050) 2024-08-18T22:30:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec5400640 1 -- 172.21.15.5:0/739175354 learned_addr learned my addr 172.21.15.5:0/739175354 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec6800640 1 --2- 172.21.15.5:0/739175354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ec80b4990 0x7f5ec80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec5e00640 1 --2- 172.21.15.5:0/739175354 >> v2:172.21.15.117:3300/0 conn(0x7f5ec8158a00 0x7f5ec815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec5400640 1 -- 172.21.15.5:0/739175354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ec80b4990 msgr2=0x7f5ec80b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec5400640 1 --2- 172.21.15.5:0/739175354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ec80b4990 0x7f5ec80b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec5400640 1 -- 172.21.15.5:0/739175354 >> v2:172.21.15.117:3300/0 conn(0x7f5ec8158a00 msgr2=0x7f5ec815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec5400640 1 --2- 172.21.15.5:0/739175354 >> v2:172.21.15.117:3300/0 conn(0x7f5ec8158a00 0x7f5ec815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.257+0000 7f5ec5400640 1 -- 172.21.15.5:0/739175354 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec80d04c0 con 0x7f5ec80afad0 2024-08-18T22:30:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec5400640 1 --2- 172.21.15.5:0/739175354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ec80afad0 0x7f5ec80cff80 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f5ec806e000 tx=0x7f5eb401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c396ae47a4c05048 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec4a00640 1 -- 172.21.15.5:0/739175354 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40b1070 con 0x7f5ec80afad0 2024-08-18T22:30:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec4a00640 1 -- 172.21.15.5:0/739175354 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb40ac630 con 0x7f5ec80afad0 2024-08-18T22:30:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec4a00640 1 -- 172.21.15.5:0/739175354 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40a8050 con 0x7f5ec80afad0 2024-08-18T22:30:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec7200640 1 -- 172.21.15.5:0/739175354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ec80afad0 msgr2=0x7f5ec80cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec7200640 1 --2- 172.21.15.5:0/739175354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ec80afad0 0x7f5ec80cff80 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f5ec806e000 tx=0x7f5eb401c520 comp rx=0 tx=0).stop 2024-08-18T22:30:08.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec7200640 1 -- 172.21.15.5:0/739175354 shutdown_connections 2024-08-18T22:30:08.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec7200640 1 --2- 172.21.15.5:0/739175354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ec80b4990 0x7f5ec80b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec7200640 1 --2- 172.21.15.5:0/739175354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ec80afad0 0x7f5ec80cff80 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec7200640 1 --2- 172.21.15.5:0/739175354 >> v2:172.21.15.117:3300/0 conn(0x7f5ec8158a00 0x7f5ec815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec7200640 1 -- 172.21.15.5:0/739175354 >> 172.21.15.5:0/739175354 conn(0x7f5ec8073090 msgr2=0x7f5ec806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:08.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec7200640 1 -- 172.21.15.5:0/739175354 shutdown_connections 2024-08-18T22:30:08.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.261+0000 7f5ec7200640 1 -- 172.21.15.5:0/739175354 wait complete. 2024-08-18T22:30:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec7200640 1 Processor -- start 2024-08-18T22:30:08.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec7200640 1 -- start start 2024-08-18T22:30:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec7200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ec80afad0 0x7f5ec814cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec7200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ec80b4990 0x7f5ec806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec7200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ec8158a00 0x7f5ec806f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec7200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec80cf0c0 con 0x7f5ec80afad0 2024-08-18T22:30:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec7200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec80cfa60 con 0x7f5ec80b4990 2024-08-18T22:30:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec7200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec80cf240 con 0x7f5ec8158a00 2024-08-18T22:30:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ec80afad0 0x7f5ec814cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ec80afad0 0x7f5ec814cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56060/0 (socket says 172.21.15.5:56060) 2024-08-18T22:30:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec5e00640 1 -- 172.21.15.5:0/1836100466 learned_addr learned my addr 172.21.15.5:0/1836100466 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec6800640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ec8158a00 0x7f5ec806f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec5400640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ec80b4990 0x7f5ec806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec5e00640 1 -- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ec8158a00 msgr2=0x7f5ec806f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec5e00640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ec8158a00 0x7f5ec806f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec5e00640 1 -- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ec80b4990 msgr2=0x7f5ec806ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec5e00640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ec80b4990 0x7f5ec806ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec5e00640 1 -- 172.21.15.5:0/1836100466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec8153490 con 0x7f5ec80afad0 2024-08-18T22:30:08.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec5e00640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ec80afad0 0x7f5ec814cc20 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800d5f0 tx=0x7f5eb800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:08.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ebe000640 1 -- 172.21.15.5:0/1836100466 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80125f0 con 0x7f5ec80afad0 2024-08-18T22:30:08.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ebe000640 1 -- 172.21.15.5:0/1836100466 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb8019070 con 0x7f5ec80afad0 2024-08-18T22:30:08.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ebe000640 1 -- 172.21.15.5:0/1836100466 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80129b0 con 0x7f5ec80afad0 2024-08-18T22:30:08.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec7200640 1 -- 172.21.15.5:0/1836100466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec8153770 con 0x7f5ec80afad0 2024-08-18T22:30:08.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.265+0000 7f5ec7200640 1 -- 172.21.15.5:0/1836100466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec8153d30 con 0x7f5ec80afad0 2024-08-18T22:30:08.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.269+0000 7f5ec7200640 1 -- 172.21.15.5:0/1836100466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec815d570 con 0x7f5ec80afad0 2024-08-18T22:30:08.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.269+0000 7f5ebe000640 1 -- 172.21.15.5:0/1836100466 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5eb8012b50 con 0x7f5ec80afad0 2024-08-18T22:30:08.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.269+0000 7f5ebe000640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ea80678c0 0x7f5ea8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.269+0000 7f5ebe000640 1 -- 172.21.15.5:0/1836100466 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6188+0+0 (secure 0 0 0) 0x7f5eb8086130 con 0x7f5ec80afad0 2024-08-18T22:30:08.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.269+0000 7f5ec5400640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ea80678c0 0x7f5ea8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.269+0000 7f5ec5400640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ea80678c0 0x7f5ea8069d80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40ae000 tx=0x7f5eb4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:08.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.273+0000 7f5ebe000640 1 -- 172.21.15.5:0/1836100466 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5eb8056430 con 0x7f5ec80afad0 2024-08-18T22:30:08.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.473+0000 7f5ec7200640 1 -- 172.21.15.5:0/1836100466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5ec814d880 con 0x7f5ec80afad0 2024-08-18T22:30:08.471 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:30:08.473+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:30:08.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ebe000640 1 -- 172.21.15.5:0/1836100466 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v118) ==== 161+0+0 (secure 0 0 0) 0x7f5eb805a730 con 0x7f5ec80afad0 2024-08-18T22:30:08.474 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:30:08.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 -- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ea80678c0 msgr2=0x7f5ea8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ea80678c0 0x7f5ea8069d80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40ae000 tx=0x7f5eb4009040 comp rx=0 tx=0).stop 2024-08-18T22:30:08.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 -- 172.21.15.5:0/1836100466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ec80afad0 msgr2=0x7f5ec814cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ec80afad0 0x7f5ec814cc20 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800d5f0 tx=0x7f5eb800dab0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 -- 172.21.15.5:0/1836100466 shutdown_connections 2024-08-18T22:30:08.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5ea80678c0 0x7f5ea8069d80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ec8158a00 0x7f5ec806f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ec80b4990 0x7f5ec806ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 --2- 172.21.15.5:0/1836100466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ec80afad0 0x7f5ec814cc20 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 -- 172.21.15.5:0/1836100466 >> 172.21.15.5:0/1836100466 conn(0x7f5ec8073090 msgr2=0x7f5ec814dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:08.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 -- 172.21.15.5:0/1836100466 shutdown_connections 2024-08-18T22:30:08.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.477+0000 7f5ec7200640 1 -- 172.21.15.5:0/1836100466 wait complete. 2024-08-18T22:30:08.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:30:08.546 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:30:08.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.645+0000 7f4668200640 1 Processor -- start 2024-08-18T22:30:08.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.645+0000 7f4668200640 1 -- start start 2024-08-18T22:30:08.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.645+0000 7f4668200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f466015fb80 0x7f46600d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.645+0000 7f4668200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46600d30b0 con 0x7f46600d1090 2024-08-18T22:30:08.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.645+0000 7f4668200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46600d1bd0 con 0x7f46600b5ad0 2024-08-18T22:30:08.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.645+0000 7f4668200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4660071c60 con 0x7f466015fb80 2024-08-18T22:30:08.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.649+0000 7f4665800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f466015fb80 0x7f46600d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.649+0000 7f4665800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f466015fb80 0x7f46600d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56106/0 (socket says 172.21.15.5:56106) 2024-08-18T22:30:08.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.649+0000 7f4665800640 1 -- 172.21.15.5:0/4056845723 learned_addr learned my addr 172.21.15.5:0/4056845723 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:08.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.649+0000 7f4666200640 1 --1- 172.21.15.5:0/4056845723 >> v1:172.21.15.5:6789/0 conn(0x7f46600d1090 0x7f4660071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34774/0 (socket says 172.21.15.5:34774) 2024-08-18T22:30:08.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.649+0000 7f4665800640 1 -- 172.21.15.5:0/4056845723 >> v1:172.21.15.117:6789/0 conn(0x7f46600b5ad0 legacy=0x7f466006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.649+0000 7f4665800640 1 -- 172.21.15.5:0/4056845723 >> v1:172.21.15.5:6789/0 conn(0x7f46600d1090 legacy=0x7f4660071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.649+0000 7f4665800640 1 -- 172.21.15.5:0/4056845723 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46600d2dd0 con 0x7f466015fb80 2024-08-18T22:30:08.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.649+0000 7f4665800640 1 --2- 172.21.15.5:0/4056845723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466015fb80 0x7f46600d15e0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f4654009e50 tx=0x7f465401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc052648fc3fbea server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:08.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.649+0000 7f465fe00640 1 -- 172.21.15.5:0/4056845723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46540a56e0 con 0x7f466015fb80 2024-08-18T22:30:08.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.649+0000 7f465fe00640 1 -- 172.21.15.5:0/4056845723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46540a5880 con 0x7f466015fb80 2024-08-18T22:30:08.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.649+0000 7f465fe00640 1 -- 172.21.15.5:0/4056845723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46540a5c50 con 0x7f466015fb80 2024-08-18T22:30:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 -- 172.21.15.5:0/4056845723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466015fb80 msgr2=0x7f46600d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 --2- 172.21.15.5:0/4056845723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466015fb80 0x7f46600d15e0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f4654009e50 tx=0x7f465401c910 comp rx=0 tx=0).stop 2024-08-18T22:30:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 -- 172.21.15.5:0/4056845723 shutdown_connections 2024-08-18T22:30:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 --2- 172.21.15.5:0/4056845723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466015fb80 0x7f46600d15e0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 -- 172.21.15.5:0/4056845723 >> 172.21.15.5:0/4056845723 conn(0x7f46600d2180 msgr2=0x7f46600d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:08.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 -- 172.21.15.5:0/4056845723 shutdown_connections 2024-08-18T22:30:08.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 -- 172.21.15.5:0/4056845723 wait complete. 2024-08-18T22:30:08.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 Processor -- start 2024-08-18T22:30:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 -- start start 2024-08-18T22:30:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46600b5ad0 0x7f466013fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46600d1090 0x7f4660153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f466015fb80 0x7f466015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f46600b5eb0 con 0x7f46600b5ad0 2024-08-18T22:30:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f46600d1eb0 con 0x7f466015fb80 2024-08-18T22:30:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4668200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f466016a310 con 0x7f46600d1090 2024-08-18T22:30:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4665800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46600b5ad0 0x7f466013fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4665800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46600b5ad0 0x7f466013fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56120/0 (socket says 172.21.15.5:56120) 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4665800640 1 -- 172.21.15.5:0/716658825 learned_addr learned my addr 172.21.15.5:0/716658825 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4666200640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f466015fb80 0x7f466015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4664e00640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46600d1090 0x7f4660153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4665800640 1 -- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46600d1090 msgr2=0x7f4660153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4665800640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46600d1090 0x7f4660153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4665800640 1 -- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f466015fb80 msgr2=0x7f466015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4665800640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f466015fb80 0x7f466015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4665800640 1 -- 172.21.15.5:0/716658825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4660140110 con 0x7f46600b5ad0 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f4665800640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46600b5ad0 0x7f466013fbd0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f4654019520 tx=0x7f46540196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.653+0000 7f465d600640 1 -- 172.21.15.5:0/716658825 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46540bc020 con 0x7f46600b5ad0 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.657+0000 7f465d600640 1 -- 172.21.15.5:0/716658825 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46540b8670 con 0x7f46600b5ad0 2024-08-18T22:30:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.657+0000 7f465d600640 1 -- 172.21.15.5:0/716658825 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46540b8a40 con 0x7f46600b5ad0 2024-08-18T22:30:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.657+0000 7f4668200640 1 -- 172.21.15.5:0/716658825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46601524b0 con 0x7f46600b5ad0 2024-08-18T22:30:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.657+0000 7f4668200640 1 -- 172.21.15.5:0/716658825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4660152a70 con 0x7f46600b5ad0 2024-08-18T22:30:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.657+0000 7f4668200640 1 -- 172.21.15.5:0/716658825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46600d15e0 con 0x7f46600b5ad0 2024-08-18T22:30:08.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.657+0000 7f465d600640 1 -- 172.21.15.5:0/716658825 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46540bf020 con 0x7f46600b5ad0 2024-08-18T22:30:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.657+0000 7f465d600640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46400678c0 0x7f4640069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.657+0000 7f465d600640 1 -- 172.21.15.5:0/716658825 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 6274+0+0 (secure 0 0 0) 0x7f4654120f80 con 0x7f46600b5ad0 2024-08-18T22:30:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.657+0000 7f4664e00640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46400678c0 0x7f4640069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.661+0000 7f4664e00640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46400678c0 0x7f4640069d80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f46600b3260 tx=0x7f464c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.661+0000 7f465d600640 1 -- 172.21.15.5:0/716658825 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f46540c6030 con 0x7f46600b5ad0 2024-08-18T22:30:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:08.865+0000 7f4668200640 1 -- 172.21.15.5:0/716658825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f46600ce0d0 con 0x7f46600b5ad0 2024-08-18T22:30:09.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.477+0000 7f465d600640 1 -- 172.21.15.5:0/716658825 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v119) ==== 104+0+0 (secure 0 0 0) 0x7f4654016620 con 0x7f46600b5ad0 2024-08-18T22:30:09.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 -- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46400678c0 msgr2=0x7f4640069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46400678c0 0x7f4640069d80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f46600b3260 tx=0x7f464c009040 comp rx=0 tx=0).stop 2024-08-18T22:30:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 -- 172.21.15.5:0/716658825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46600b5ad0 msgr2=0x7f466013fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46600b5ad0 0x7f466013fbd0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f4654019520 tx=0x7f46540196b0 comp rx=0 tx=0).stop 2024-08-18T22:30:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 -- 172.21.15.5:0/716658825 shutdown_connections 2024-08-18T22:30:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f46400678c0 0x7f4640069d80 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f466015fb80 0x7f466015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46600d1090 0x7f4660153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 --2- 172.21.15.5:0/716658825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46600b5ad0 0x7f466013fbd0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 -- 172.21.15.5:0/716658825 >> 172.21.15.5:0/716658825 conn(0x7f46600d2180 msgr2=0x7f46600b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 -- 172.21.15.5:0/716658825 shutdown_connections 2024-08-18T22:30:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.481+0000 7f4668200640 1 -- 172.21.15.5:0/716658825 wait complete. 2024-08-18T22:30:09.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:30:09.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb36000640 1 Processor -- start 2024-08-18T22:30:09.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb36000640 1 -- start start 2024-08-18T22:30:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb36000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb300b7e80 0x7feb300b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb36000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb30071470 0x7feb30071920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb36000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb300b6470 con 0x7feb30147c40 2024-08-18T22:30:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb36000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7feb300b6750 con 0x7feb300b7e80 2024-08-18T22:30:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb36000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb3006d6b0 con 0x7feb30071470 2024-08-18T22:30:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb2fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb300b7e80 0x7feb300b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb34c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feb30147c40 0x7feb3015e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34782/0 (socket says 172.21.15.5:34782) 2024-08-18T22:30:09.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb34c00640 1 -- 172.21.15.5:0/3963932694 learned_addr learned my addr 172.21.15.5:0/3963932694 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb2fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb300b7e80 0x7feb300b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56132/0 (socket says 172.21.15.5:56132) 2024-08-18T22:30:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb35600640 1 --2- 172.21.15.5:0/3963932694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb30071470 0x7feb30071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb2fe00640 1 -- 172.21.15.5:0/3963932694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb30071470 msgr2=0x7feb30071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb2fe00640 1 --2- 172.21.15.5:0/3963932694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb30071470 0x7feb30071920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb2fe00640 1 -- 172.21.15.5:0/3963932694 >> v1:172.21.15.5:6789/0 conn(0x7feb30147c40 legacy=0x7feb3015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb2f400640 1 -- 172.21.15.5:0/3963932694 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2241243587 0 0) 0x7feb300b6470 con 0x7feb30147c40 2024-08-18T22:30:09.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.649+0000 7feb2fe00640 1 -- 172.21.15.5:0/3963932694 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3006d990 con 0x7feb300b7e80 2024-08-18T22:30:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb2fe00640 1 --2- 172.21.15.5:0/3963932694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb300b7e80 0x7feb300b5de0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0097c0 tx=0x7feb1c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509c4dbe48f84dda server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb2f400640 1 -- 172.21.15.5:0/3963932694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c0b1070 con 0x7feb300b7e80 2024-08-18T22:30:09.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb2f400640 1 -- 172.21.15.5:0/3963932694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c0ac410 con 0x7feb300b7e80 2024-08-18T22:30:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb2f400640 1 -- 172.21.15.5:0/3963932694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c0ac7e0 con 0x7feb300b7e80 2024-08-18T22:30:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb36000640 1 -- 172.21.15.5:0/3963932694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb300b7e80 msgr2=0x7feb300b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb36000640 1 --2- 172.21.15.5:0/3963932694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb300b7e80 0x7feb300b5de0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0097c0 tx=0x7feb1c01c4a0 comp rx=0 tx=0).stop 2024-08-18T22:30:09.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb36000640 1 -- 172.21.15.5:0/3963932694 shutdown_connections 2024-08-18T22:30:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb36000640 1 --2- 172.21.15.5:0/3963932694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb30071470 0x7feb30071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb36000640 1 --2- 172.21.15.5:0/3963932694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb300b7e80 0x7feb300b5de0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb36000640 1 -- 172.21.15.5:0/3963932694 >> 172.21.15.5:0/3963932694 conn(0x7feb300b3da0 msgr2=0x7feb300b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb36000640 1 -- 172.21.15.5:0/3963932694 shutdown_connections 2024-08-18T22:30:09.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.653+0000 7feb36000640 1 -- 172.21.15.5:0/3963932694 wait complete. 2024-08-18T22:30:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb36000640 1 Processor -- start 2024-08-18T22:30:09.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb36000640 1 -- start start 2024-08-18T22:30:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb36000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb30071470 0x7feb301462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb36000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300b7e80 0x7feb3015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb36000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb30147c40 0x7feb3015dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb36000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb3006ea50 con 0x7feb30147c40 2024-08-18T22:30:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb36000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feb3006e8d0 con 0x7feb30071470 2024-08-18T22:30:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb36000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb3016aca0 con 0x7feb300b7e80 2024-08-18T22:30:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb35600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb30147c40 0x7feb3015dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:09.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb35600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb30147c40 0x7feb3015dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56134/0 (socket says 172.21.15.5:56134) 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb35600640 1 -- 172.21.15.5:0/830807233 learned_addr learned my addr 172.21.15.5:0/830807233 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb34c00640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb30071470 0x7feb301462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb2fe00640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300b7e80 0x7feb3015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb35600640 1 -- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300b7e80 msgr2=0x7feb3015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb35600640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300b7e80 0x7feb3015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb35600640 1 -- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb30071470 msgr2=0x7feb301462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb35600640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb30071470 0x7feb301462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb35600640 1 -- 172.21.15.5:0/830807233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb30141ca0 con 0x7feb30147c40 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb2fe00640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300b7e80 0x7feb3015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb34c00640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb30071470 0x7feb301462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb35600640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb30147c40 0x7feb3015dcf0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7feb2800d830 tx=0x7feb2800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb2cc00640 1 -- 172.21.15.5:0/830807233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2800b6c0 con 0x7feb30147c40 2024-08-18T22:30:09.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb2cc00640 1 -- 172.21.15.5:0/830807233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb28019070 con 0x7feb30147c40 2024-08-18T22:30:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb36000640 1 -- 172.21.15.5:0/830807233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb30141f80 con 0x7feb30147c40 2024-08-18T22:30:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb2cc00640 1 -- 172.21.15.5:0/830807233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2800baa0 con 0x7feb30147c40 2024-08-18T22:30:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb36000640 1 -- 172.21.15.5:0/830807233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb30142540 con 0x7feb30147c40 2024-08-18T22:30:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.657+0000 7feb36000640 1 -- 172.21.15.5:0/830807233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb300b5de0 con 0x7feb30147c40 2024-08-18T22:30:09.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.661+0000 7feb2cc00640 1 -- 172.21.15.5:0/830807233 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb2801e460 con 0x7feb30147c40 2024-08-18T22:30:09.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.661+0000 7feb2cc00640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb100678c0 0x7feb10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:09.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.661+0000 7feb2cc00640 1 -- 172.21.15.5:0/830807233 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 6274+0+0 (secure 0 0 0) 0x7feb28086620 con 0x7feb30147c40 2024-08-18T22:30:09.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.661+0000 7feb34c00640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb100678c0 0x7feb10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:09.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.661+0000 7feb34c00640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb100678c0 0x7feb10069d80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7feb20007fd0 tx=0x7feb20005b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.665+0000 7feb2cc00640 1 -- 172.21.15.5:0/830807233 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7feb28056f10 con 0x7feb30147c40 2024-08-18T22:30:09.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:09.829+0000 7feb36000640 1 -- 172.21.15.5:0/830807233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7feb300b59b0 con 0x7feb30147c40 2024-08-18T22:30:10.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.481+0000 7feb2cc00640 1 -- 172.21.15.5:0/830807233 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v157) ==== 181+0+0 (secure 0 0 0) 0x7feb28056810 con 0x7feb30147c40 2024-08-18T22:30:10.481 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:30:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 -- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb100678c0 msgr2=0x7feb10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb100678c0 0x7feb10069d80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7feb20007fd0 tx=0x7feb20005b80 comp rx=0 tx=0).stop 2024-08-18T22:30:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 -- 172.21.15.5:0/830807233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb30147c40 msgr2=0x7feb3015dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb30147c40 0x7feb3015dcf0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7feb2800d830 tx=0x7feb2800dcf0 comp rx=0 tx=0).stop 2024-08-18T22:30:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 -- 172.21.15.5:0/830807233 shutdown_connections 2024-08-18T22:30:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb100678c0 0x7feb10069d80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb30147c40 0x7feb3015dcf0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300b7e80 0x7feb3015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 --2- 172.21.15.5:0/830807233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb30071470 0x7feb301462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 -- 172.21.15.5:0/830807233 >> 172.21.15.5:0/830807233 conn(0x7feb300b3da0 msgr2=0x7feb301452d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 -- 172.21.15.5:0/830807233 shutdown_connections 2024-08-18T22:30:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.485+0000 7feb36000640 1 -- 172.21.15.5:0/830807233 wait complete. 2024-08-18T22:30:10.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:30:10.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.653+0000 7f4208600640 1 Processor -- start 2024-08-18T22:30:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.653+0000 7f4208600640 1 -- start start 2024-08-18T22:30:10.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.653+0000 7f4208600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42000cf020 0x7f42000cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:10.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.653+0000 7f4208600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4200072a20 0x7f4200072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:10.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.653+0000 7f4208600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42000cf940 con 0x7f420006ea50 2024-08-18T22:30:10.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.653+0000 7f4208600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f42000733c0 con 0x7f4200072a20 2024-08-18T22:30:10.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.653+0000 7f4208600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f42000b4c30 con 0x7f42000cf020 2024-08-18T22:30:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.657+0000 7f4205200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4200072a20 0x7f4200072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.657+0000 7f4205c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42000cf020 0x7f42000cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.657+0000 7f4205c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42000cf020 0x7f42000cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:54666/0 (socket says 172.21.15.5:54666) 2024-08-18T22:30:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.657+0000 7f4206600640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f420006ea50 0x7f420006ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:40990/0 (socket says 172.21.15.5:40990) 2024-08-18T22:30:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.657+0000 7f4205c00640 1 -- 172.21.15.5:0/3093096112 learned_addr learned my addr 172.21.15.5:0/3093096112 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.657+0000 7f4205c00640 1 -- 172.21.15.5:0/3093096112 >> v2:172.21.15.117:3300/0 conn(0x7f4200072a20 msgr2=0x7f4200072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.657+0000 7f4205c00640 1 --2- 172.21.15.5:0/3093096112 >> v2:172.21.15.117:3300/0 conn(0x7f4200072a20 0x7f4200072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.657+0000 7f4205c00640 1 -- 172.21.15.5:0/3093096112 >> v1:172.21.15.117:6789/0 conn(0x7f420006ea50 legacy=0x7f420006ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.657+0000 7f4205c00640 1 -- 172.21.15.5:0/3093096112 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42000735e0 con 0x7f42000cf020 2024-08-18T22:30:10.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.657+0000 7f4205200640 1 --2- 172.21.15.5:0/3093096112 >> v2:172.21.15.117:3300/0 conn(0x7f4200072a20 0x7f4200072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:10.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.657+0000 7f4205c00640 1 --2- 172.21.15.5:0/3093096112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42000cf020 0x7f42000cf400 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009870 tx=0x7f41f401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9148141de1238b3d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:10.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f41ffe00640 1 -- 172.21.15.5:0/3093096112 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f40a95f0 con 0x7f42000cf020 2024-08-18T22:30:10.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f41ffe00640 1 -- 172.21.15.5:0/3093096112 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f40a9790 con 0x7f42000cf020 2024-08-18T22:30:10.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f41ffe00640 1 -- 172.21.15.5:0/3093096112 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f40a9b60 con 0x7f42000cf020 2024-08-18T22:30:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 -- 172.21.15.5:0/3093096112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42000cf020 msgr2=0x7f42000cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 --2- 172.21.15.5:0/3093096112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42000cf020 0x7f42000cf400 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009870 tx=0x7f41f401c530 comp rx=0 tx=0).stop 2024-08-18T22:30:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 -- 172.21.15.5:0/3093096112 shutdown_connections 2024-08-18T22:30:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 --2- 172.21.15.5:0/3093096112 >> v2:172.21.15.117:3300/0 conn(0x7f4200072a20 0x7f4200072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 --2- 172.21.15.5:0/3093096112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42000cf020 0x7f42000cf400 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 -- 172.21.15.5:0/3093096112 >> 172.21.15.5:0/3093096112 conn(0x7f420006b9b0 msgr2=0x7f420006bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 -- 172.21.15.5:0/3093096112 shutdown_connections 2024-08-18T22:30:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 -- 172.21.15.5:0/3093096112 wait complete. 2024-08-18T22:30:10.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 Processor -- start 2024-08-18T22:30:10.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 -- start start 2024-08-18T22:30:10.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f420006ea50 0x7f420014a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:10.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4200072a20 0x7f4200148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:10.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42000cf020 0x7f42001486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:10.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f420006e3e0 con 0x7f420006ea50 2024-08-18T22:30:10.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4200073e80 con 0x7f42000cf020 2024-08-18T22:30:10.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4208600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f42001558e0 con 0x7f4200072a20 2024-08-18T22:30:10.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4205c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f420006ea50 0x7f420014a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:10.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4205c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f420006ea50 0x7f420014a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56148/0 (socket says 172.21.15.5:56148) 2024-08-18T22:30:10.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4205c00640 1 -- 172.21.15.5:0/2144750613 learned_addr learned my addr 172.21.15.5:0/2144750613 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:10.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4206600640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42000cf020 0x7f42001486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:10.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.661+0000 7f4205200640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4200072a20 0x7f4200148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:10.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f4205c00640 1 -- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4200072a20 msgr2=0x7f4200148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:10.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f4205c00640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4200072a20 0x7f4200148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:10.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f4205c00640 1 -- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42000cf020 msgr2=0x7f42001486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:10.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f4205c00640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42000cf020 0x7f42001486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:10.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f4205c00640 1 -- 172.21.15.5:0/2144750613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420009b8a0 con 0x7f420006ea50 2024-08-18T22:30:10.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f4205c00640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f420006ea50 0x7f420014a160 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f41f401abe0 tx=0x7f41f40192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:10.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f41fd600640 1 -- 172.21.15.5:0/2144750613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f40bb640 con 0x7f420006ea50 2024-08-18T22:30:10.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f41fd600640 1 -- 172.21.15.5:0/2144750613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f40bb7e0 con 0x7f420006ea50 2024-08-18T22:30:10.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f41fd600640 1 -- 172.21.15.5:0/2144750613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f40bbbd0 con 0x7f420006ea50 2024-08-18T22:30:10.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f4208600640 1 -- 172.21.15.5:0/2144750613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420009bb80 con 0x7f420006ea50 2024-08-18T22:30:10.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f4208600640 1 -- 172.21.15.5:0/2144750613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f420014a6a0 con 0x7f420006ea50 2024-08-18T22:30:10.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f4208600640 1 -- 172.21.15.5:0/2144750613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f420015c760 con 0x7f420006ea50 2024-08-18T22:30:10.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f41fd600640 1 -- 172.21.15.5:0/2144750613 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f41f40c43f0 con 0x7f420006ea50 2024-08-18T22:30:10.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f41fd600640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41e00678c0 0x7f41e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:10.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.665+0000 7f41fd600640 1 -- 172.21.15.5:0/2144750613 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5836+0+0 (secure 0 0 0) 0x7f41f4120250 con 0x7f420006ea50 2024-08-18T22:30:10.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.669+0000 7f4205200640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41e00678c0 0x7f41e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:10.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.669+0000 7f4205200640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41e00678c0 0x7f41e0069d80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009580 tx=0x7f41ec009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.669+0000 7f41fd600640 1 -- 172.21.15.5:0/2144750613 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f41f40ad020 con 0x7f420006ea50 2024-08-18T22:30:10.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:10.837+0000 7f4208600640 1 -- 172.21.15.5:0/2144750613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4200071f20 con 0x7f420006ea50 2024-08-18T22:30:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.485+0000 7f41fd600640 1 -- 172.21.15.5:0/2144750613 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v158) ==== 169+0+0 (secure 0 0 0) 0x7f41f4016150 con 0x7f420006ea50 2024-08-18T22:30:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:30:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 -- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41e00678c0 msgr2=0x7f41e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41e00678c0 0x7f41e0069d80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009580 tx=0x7f41ec009190 comp rx=0 tx=0).stop 2024-08-18T22:30:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 -- 172.21.15.5:0/2144750613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f420006ea50 msgr2=0x7f420014a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f420006ea50 0x7f420014a160 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f41f401abe0 tx=0x7f41f40192d0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 -- 172.21.15.5:0/2144750613 shutdown_connections 2024-08-18T22:30:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f41e00678c0 0x7f41e0069d80 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42000cf020 0x7f42001486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4200072a20 0x7f4200148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 --2- 172.21.15.5:0/2144750613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f420006ea50 0x7f420014a160 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 -- 172.21.15.5:0/2144750613 >> 172.21.15.5:0/2144750613 conn(0x7f420006b9b0 msgr2=0x7f420006ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 -- 172.21.15.5:0/2144750613 shutdown_connections 2024-08-18T22:30:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.489+0000 7f4208600640 1 -- 172.21.15.5:0/2144750613 wait complete. 2024-08-18T22:30:11.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:30:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.669+0000 7feaf7600640 1 Processor -- start 2024-08-18T22:30:11.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.669+0000 7feaf7600640 1 -- start start 2024-08-18T22:30:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaf7600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feaf0158710 0x7feaf006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaf7600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feaf015e7b0 0x7feaf006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaf7600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaf006cf00 0x7feaf00ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaf7600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7feaf006d350 con 0x7feaf015e7b0 2024-08-18T22:30:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaf7600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7feaf015f780 con 0x7feaf0158710 2024-08-18T22:30:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaf7600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feaf015ec40 con 0x7feaf006cf00 2024-08-18T22:30:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaefe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feaf015e7b0 0x7feaf006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:11.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaefe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feaf015e7b0 0x7feaf006c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56150/0 (socket says 172.21.15.5:56150) 2024-08-18T22:30:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaefe00640 1 -- 172.21.15.5:0/3682534611 learned_addr learned my addr 172.21.15.5:0/3682534611 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaf4c00640 1 --2- 172.21.15.5:0/3682534611 >> v2:172.21.15.117:3300/0 conn(0x7feaf0158710 0x7feaf006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaf5600640 1 --2- 172.21.15.5:0/3682534611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaf006cf00 0x7feaf00ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaefe00640 1 -- 172.21.15.5:0/3682534611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaf006cf00 msgr2=0x7feaf00ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaefe00640 1 --2- 172.21.15.5:0/3682534611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaf006cf00 0x7feaf00ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaefe00640 1 -- 172.21.15.5:0/3682534611 >> v2:172.21.15.117:3300/0 conn(0x7feaf0158710 msgr2=0x7feaf006ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaefe00640 1 --2- 172.21.15.5:0/3682534611 >> v2:172.21.15.117:3300/0 conn(0x7feaf0158710 0x7feaf006ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaefe00640 1 -- 172.21.15.5:0/3682534611 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf015eee0 con 0x7feaf015e7b0 2024-08-18T22:30:11.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.673+0000 7feaf4c00640 1 --2- 172.21.15.5:0/3682534611 >> v2:172.21.15.117:3300/0 conn(0x7feaf0158710 0x7feaf006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaefe00640 1 --2- 172.21.15.5:0/3682534611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf015e7b0 0x7feaf006c9c0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7feaf00731e0 tx=0x7feadc01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b731259d1a8c06b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaef400640 1 -- 172.21.15.5:0/3682534611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc0b0070 con 0x7feaf015e7b0 2024-08-18T22:30:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaef400640 1 -- 172.21.15.5:0/3682534611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feadc0ab600 con 0x7feaf015e7b0 2024-08-18T22:30:11.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaef400640 1 -- 172.21.15.5:0/3682534611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc0ab9d0 con 0x7feaf015e7b0 2024-08-18T22:30:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 -- 172.21.15.5:0/3682534611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf015e7b0 msgr2=0x7feaf006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 --2- 172.21.15.5:0/3682534611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf015e7b0 0x7feaf006c9c0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7feaf00731e0 tx=0x7feadc01c260 comp rx=0 tx=0).stop 2024-08-18T22:30:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 -- 172.21.15.5:0/3682534611 shutdown_connections 2024-08-18T22:30:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 --2- 172.21.15.5:0/3682534611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaf006cf00 0x7feaf00ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 --2- 172.21.15.5:0/3682534611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf015e7b0 0x7feaf006c9c0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 --2- 172.21.15.5:0/3682534611 >> v2:172.21.15.117:3300/0 conn(0x7feaf0158710 0x7feaf006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 -- 172.21.15.5:0/3682534611 >> 172.21.15.5:0/3682534611 conn(0x7feaf0072350 msgr2=0x7feaf0072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 -- 172.21.15.5:0/3682534611 shutdown_connections 2024-08-18T22:30:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 -- 172.21.15.5:0/3682534611 wait complete. 2024-08-18T22:30:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 Processor -- start 2024-08-18T22:30:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 -- start start 2024-08-18T22:30:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaf006cf00 0x7feaf00b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feaf0158710 0x7feaf0160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf015e7b0 0x7feaf00af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feaf0158c70 con 0x7feaf015e7b0 2024-08-18T22:30:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feaf0158af0 con 0x7feaf0158710 2024-08-18T22:30:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf7600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feaf00b4ed0 con 0x7feaf006cf00 2024-08-18T22:30:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.677+0000 7feaf5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf015e7b0 0x7feaf00af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf015e7b0 0x7feaf00af4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56164/0 (socket says 172.21.15.5:56164) 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf5600640 1 -- 172.21.15.5:0/1562950859 learned_addr learned my addr 172.21.15.5:0/1562950859 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf4c00640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaf006cf00 0x7feaf00b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaefe00640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feaf0158710 0x7feaf0160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf5600640 1 -- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaf006cf00 msgr2=0x7feaf00b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf5600640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaf006cf00 0x7feaf00b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf5600640 1 -- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feaf0158710 msgr2=0x7feaf0160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf5600640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feaf0158710 0x7feaf0160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf5600640 1 -- 172.21.15.5:0/1562950859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf01598c0 con 0x7feaf015e7b0 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf5600640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf015e7b0 0x7feaf00af4b0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7feae8007d90 tx=0x7feae800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaecc00640 1 -- 172.21.15.5:0/1562950859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae8014420 con 0x7feaf015e7b0 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaecc00640 1 -- 172.21.15.5:0/1562950859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae8019070 con 0x7feaf015e7b0 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaecc00640 1 -- 172.21.15.5:0/1562950859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae8014820 con 0x7feaf015e7b0 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf7600640 1 -- 172.21.15.5:0/1562950859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf0159ba0 con 0x7feaf015e7b0 2024-08-18T22:30:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf7600640 1 -- 172.21.15.5:0/1562950859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf015a160 con 0x7feaf015e7b0 2024-08-18T22:30:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaf7600640 1 -- 172.21.15.5:0/1562950859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf006ef60 con 0x7feaf015e7b0 2024-08-18T22:30:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.681+0000 7feaecc00640 1 -- 172.21.15.5:0/1562950859 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feae80149c0 con 0x7feaf015e7b0 2024-08-18T22:30:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.685+0000 7feaecc00640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fead00678c0 0x7fead0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.685+0000 7feaecc00640 1 -- 172.21.15.5:0/1562950859 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7feae80862c0 con 0x7feaf015e7b0 2024-08-18T22:30:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.685+0000 7feaf4c00640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fead00678c0 0x7fead0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.685+0000 7feaf4c00640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fead00678c0 0x7fead0069d80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7feae0006e90 tx=0x7feae0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:11.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.689+0000 7feaecc00640 1 -- 172.21.15.5:0/1562950859 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7feae8056880 con 0x7feaf015e7b0 2024-08-18T22:30:11.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.901+0000 7feaf7600640 1 -- 172.21.15.5:0/1562950859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7feaf006fac0 con 0x7feaf015e7b0 2024-08-18T22:30:11.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaecc00640 1 -- 172.21.15.5:0/1562950859 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v41) ==== 104+0+0 (secure 0 0 0) 0x7feae805ab80 con 0x7feaf015e7b0 2024-08-18T22:30:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 -- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fead00678c0 msgr2=0x7fead0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fead00678c0 0x7fead0069d80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7feae0006e90 tx=0x7feae0008040 comp rx=0 tx=0).stop 2024-08-18T22:30:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 -- 172.21.15.5:0/1562950859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf015e7b0 msgr2=0x7feaf00af4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:11.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf015e7b0 0x7feaf00af4b0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7feae8007d90 tx=0x7feae800e4b0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 -- 172.21.15.5:0/1562950859 shutdown_connections 2024-08-18T22:30:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fead00678c0 0x7fead0069d80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feaf015e7b0 0x7feaf00af4b0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feaf0158710 0x7feaf0160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 --2- 172.21.15.5:0/1562950859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feaf006cf00 0x7feaf00b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 -- 172.21.15.5:0/1562950859 >> 172.21.15.5:0/1562950859 conn(0x7feaf0072350 msgr2=0x7feaf0155950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 -- 172.21.15.5:0/1562950859 shutdown_connections 2024-08-18T22:30:11.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:11.905+0000 7feaf7600640 1 -- 172.21.15.5:0/1562950859 wait complete. 2024-08-18T22:30:11.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-08-18T22:30:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.065+0000 7f0f19c00640 1 Processor -- start 2024-08-18T22:30:12.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.065+0000 7f0f19c00640 1 -- start start 2024-08-18T22:30:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f19c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f14070730 0x7f0f14070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f19c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0f1415dda0 0x7f0f1415e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f19c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f14070430 con 0x7f0f14161960 2024-08-18T22:30:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f19c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0f1415fcc0 con 0x7f0f1415dda0 2024-08-18T22:30:12.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f19c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0f140710b0 con 0x7f0f14070730 2024-08-18T22:30:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f13400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0f1415dda0 0x7f0f1415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f12000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f14070730 0x7f0f14070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f12a00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f0f14161960 0x7f0f1406fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:41004/0 (socket says 172.21.15.5:41004) 2024-08-18T22:30:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f12a00640 1 -- 172.21.15.5:0/1650144676 learned_addr learned my addr 172.21.15.5:0/1650144676 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f12000640 1 -- 172.21.15.5:0/1650144676 >> v2:172.21.15.117:3300/0 conn(0x7f0f1415dda0 msgr2=0x7f0f1415e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f12000640 1 --2- 172.21.15.5:0/1650144676 >> v2:172.21.15.117:3300/0 conn(0x7f0f1415dda0 0x7f0f1415e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f12000640 1 -- 172.21.15.5:0/1650144676 >> v1:172.21.15.117:6789/0 conn(0x7f0f14161960 legacy=0x7f0f1406fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.069+0000 7f0f12000640 1 -- 172.21.15.5:0/1650144676 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1415eb60 con 0x7f0f14070730 2024-08-18T22:30:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f12000640 1 --2- 172.21.15.5:0/1650144676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f14070730 0x7f0f14070b70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0f000097c0 tx=0x7f0f0001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e0a1ac95aa241ce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f11600640 1 -- 172.21.15.5:0/1650144676 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f000b2070 con 0x7f0f14070730 2024-08-18T22:30:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f11600640 1 -- 172.21.15.5:0/1650144676 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f000ad640 con 0x7f0f14070730 2024-08-18T22:30:12.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f11600640 1 -- 172.21.15.5:0/1650144676 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f000ada10 con 0x7f0f14070730 2024-08-18T22:30:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 -- 172.21.15.5:0/1650144676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f14070730 msgr2=0x7f0f14070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 --2- 172.21.15.5:0/1650144676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f14070730 0x7f0f14070b70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0f000097c0 tx=0x7f0f0001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 -- 172.21.15.5:0/1650144676 shutdown_connections 2024-08-18T22:30:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 --2- 172.21.15.5:0/1650144676 >> v2:172.21.15.117:3300/0 conn(0x7f0f1415dda0 0x7f0f1415e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 --2- 172.21.15.5:0/1650144676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f14070730 0x7f0f14070b70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 -- 172.21.15.5:0/1650144676 >> 172.21.15.5:0/1650144676 conn(0x7f0f140d2130 msgr2=0x7f0f140d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 -- 172.21.15.5:0/1650144676 shutdown_connections 2024-08-18T22:30:12.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 -- 172.21.15.5:0/1650144676 wait complete. 2024-08-18T22:30:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 Processor -- start 2024-08-18T22:30:12.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 -- start start 2024-08-18T22:30:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f14070730 0x7f0f1415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1415dda0 0x7f0f140c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f14161960 0x7f0f1406dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1409ba30 con 0x7f0f14161960 2024-08-18T22:30:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1415f6e0 con 0x7f0f14070730 2024-08-18T22:30:12.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f19c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0f140ca150 con 0x7f0f1415dda0 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f13400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f14161960 0x7f0f1406dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f12000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1415dda0 0x7f0f140c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f12a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f14070730 0x7f0f1415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f12000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1415dda0 0x7f0f140c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:54720/0 (socket says 172.21.15.5:54720) 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.073+0000 7f0f12000640 1 -- 172.21.15.5:0/522523330 learned_addr learned my addr 172.21.15.5:0/522523330 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f12000640 1 -- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f14070730 msgr2=0x7f0f1415a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f12000640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f14070730 0x7f0f1415a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f12000640 1 -- 172.21.15.5:0/522523330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f14161960 msgr2=0x7f0f1406dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f12000640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f14161960 0x7f0f1406dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f12000640 1 -- 172.21.15.5:0/522523330 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f140b5730 con 0x7f0f1415dda0 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f12000640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1415dda0 0x7f0f140c9c10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0f0001a0d0 tx=0x7f0f00019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:12.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f0aa00640 1 -- 172.21.15.5:0/522523330 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f000b2040 con 0x7f0f1415dda0 2024-08-18T22:30:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f0aa00640 1 -- 172.21.15.5:0/522523330 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f000bd070 con 0x7f0f1415dda0 2024-08-18T22:30:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f0aa00640 1 -- 172.21.15.5:0/522523330 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f000b6630 con 0x7f0f1415dda0 2024-08-18T22:30:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f19c00640 1 -- 172.21.15.5:0/522523330 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f140b5a10 con 0x7f0f1415dda0 2024-08-18T22:30:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f19c00640 1 -- 172.21.15.5:0/522523330 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f140b5fd0 con 0x7f0f1415dda0 2024-08-18T22:30:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f19c00640 1 -- 172.21.15.5:0/522523330 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1415af30 con 0x7f0f1415dda0 2024-08-18T22:30:12.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f0aa00640 1 -- 172.21.15.5:0/522523330 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f000b67d0 con 0x7f0f1415dda0 2024-08-18T22:30:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f0aa00640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678f0 0x7f0ef4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f0aa00640 1 -- 172.21.15.5:0/522523330 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f0f0011f870 con 0x7f0f1415dda0 2024-08-18T22:30:12.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.077+0000 7f0f12a00640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678f0 0x7f0ef4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.081+0000 7f0f12a00640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678f0 0x7f0ef4069db0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0f1406e960 tx=0x7f0f04007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:12.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.085+0000 7f0f0aa00640 1 -- 172.21.15.5:0/522523330 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0f1415af30 con 0x7f0f1415dda0 2024-08-18T22:30:12.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.309+0000 7f0f19c00640 1 -- 172.21.15.5:0/522523330 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7f0f1409bbb0 con 0x7f0f1415dda0 2024-08-18T22:30:12.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.501+0000 7f0f0aa00640 1 -- 172.21.15.5:0/522523330 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v519) ==== 166+0+0 (secure 0 0 0) 0x7f0f00016090 con 0x7f0f1415dda0 2024-08-18T22:30:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 -- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678f0 msgr2=0x7f0ef4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678f0 0x7f0ef4069db0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0f1406e960 tx=0x7f0f04007e90 comp rx=0 tx=0).stop 2024-08-18T22:30:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 -- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1415dda0 msgr2=0x7f0f140c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1415dda0 0x7f0f140c9c10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0f0001a0d0 tx=0x7f0f00019240 comp rx=0 tx=0).stop 2024-08-18T22:30:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 -- 172.21.15.5:0/522523330 shutdown_connections 2024-08-18T22:30:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ef40678f0 0x7f0ef4069db0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f14161960 0x7f0f1406dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f1415dda0 0x7f0f140c9c10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 --2- 172.21.15.5:0/522523330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f14070730 0x7f0f1415a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 -- 172.21.15.5:0/522523330 >> 172.21.15.5:0/522523330 conn(0x7f0f140d2130 msgr2=0x7f0f14160b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 -- 172.21.15.5:0/522523330 shutdown_connections 2024-08-18T22:30:12.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.505+0000 7f0f19c00640 1 -- 172.21.15.5:0/522523330 wait complete. 2024-08-18T22:30:12.524 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-08-18T22:30:12.524 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-08-18T22:30:12.524 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:30:12.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.665+0000 7f6991200640 1 Processor -- start 2024-08-18T22:30:12.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.665+0000 7f6991200640 1 -- start start 2024-08-18T22:30:12.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.665+0000 7f6991200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f698c15bed0 0x7f698c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.665+0000 7f6991200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f698c06da70 0x7f698c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.665+0000 7f6991200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f698c073c80 con 0x7f698c0cb390 2024-08-18T22:30:12.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.665+0000 7f6991200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f698c06e420 con 0x7f698c15bed0 2024-08-18T22:30:12.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.665+0000 7f6991200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f698c0ca5d0 con 0x7f698c06da70 2024-08-18T22:30:12.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.665+0000 7f6989e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f698c15bed0 0x7f698c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.665+0000 7f6989e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f698c15bed0 0x7f698c0735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56172/0 (socket says 172.21.15.5:56172) 2024-08-18T22:30:12.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.665+0000 7f6989e00640 1 -- 172.21.15.5:0/317747168 learned_addr learned my addr 172.21.15.5:0/317747168 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:12.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f698a800640 1 --2- 172.21.15.5:0/317747168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f698c06da70 0x7f698c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f6989e00640 1 -- 172.21.15.5:0/317747168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f698c06da70 msgr2=0x7f698c06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f6989e00640 1 --2- 172.21.15.5:0/317747168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f698c06da70 0x7f698c06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f6989e00640 1 -- 172.21.15.5:0/317747168 >> v1:172.21.15.5:6789/0 conn(0x7f698c0cb390 legacy=0x7f698c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f6989e00640 1 -- 172.21.15.5:0/317747168 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c0ca8b0 con 0x7f698c15bed0 2024-08-18T22:30:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f698a800640 1 --2- 172.21.15.5:0/317747168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f698c06da70 0x7f698c06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:12.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f6989400640 1 -- 172.21.15.5:0/317747168 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2207482569 0 0) 0x7f698c073c80 con 0x7f698c0cb390 2024-08-18T22:30:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f6989e00640 1 --2- 172.21.15.5:0/317747168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698c15bed0 0x7f698c0735a0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f697c009870 tx=0x7f697c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aeacd5d0ef6a334 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f6989400640 1 -- 172.21.15.5:0/317747168 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c0a95f0 con 0x7f698c15bed0 2024-08-18T22:30:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f6989400640 1 -- 172.21.15.5:0/317747168 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c0a9790 con 0x7f698c15bed0 2024-08-18T22:30:12.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f6989400640 1 -- 172.21.15.5:0/317747168 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c0a9b60 con 0x7f698c15bed0 2024-08-18T22:30:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f6991200640 1 -- 172.21.15.5:0/317747168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698c15bed0 msgr2=0x7f698c0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.669+0000 7f6991200640 1 --2- 172.21.15.5:0/317747168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698c15bed0 0x7f698c0735a0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f697c009870 tx=0x7f697c01c530 comp rx=0 tx=0).stop 2024-08-18T22:30:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 -- 172.21.15.5:0/317747168 shutdown_connections 2024-08-18T22:30:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 --2- 172.21.15.5:0/317747168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f698c06da70 0x7f698c06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 --2- 172.21.15.5:0/317747168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698c15bed0 0x7f698c0735a0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 -- 172.21.15.5:0/317747168 >> 172.21.15.5:0/317747168 conn(0x7f698c0b1c50 msgr2=0x7f698c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:12.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 -- 172.21.15.5:0/317747168 shutdown_connections 2024-08-18T22:30:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 -- 172.21.15.5:0/317747168 wait complete. 2024-08-18T22:30:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 Processor -- start 2024-08-18T22:30:12.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 -- start start 2024-08-18T22:30:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f698c06da70 0x7f698c14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c0cb390 0x7f698c0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698c15bed0 0x7f698c150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f698c168520 con 0x7f698c15bed0 2024-08-18T22:30:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f698c1683a0 con 0x7f698c0cb390 2024-08-18T22:30:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6991200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f698c1686a0 con 0x7f698c06da70 2024-08-18T22:30:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f698a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698c15bed0 0x7f698c150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f698a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698c15bed0 0x7f698c150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56176/0 (socket says 172.21.15.5:56176) 2024-08-18T22:30:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f698a800640 1 -- 172.21.15.5:0/1545259275 learned_addr learned my addr 172.21.15.5:0/1545259275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6989e00640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f698c06da70 0x7f698c14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6981400640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c0cb390 0x7f698c0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f698a800640 1 -- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f698c06da70 msgr2=0x7f698c14ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f698a800640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f698c06da70 0x7f698c14ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f698a800640 1 -- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c0cb390 msgr2=0x7f698c0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f698a800640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c0cb390 0x7f698c0b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f698a800640 1 -- 172.21.15.5:0/1545259275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c0b3ea0 con 0x7f698c15bed0 2024-08-18T22:30:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f698a800640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698c15bed0 0x7f698c150bc0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f698400d830 tx=0x7f698400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.673+0000 7f6982a00640 1 -- 172.21.15.5:0/1545259275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984007e10 con 0x7f698c15bed0 2024-08-18T22:30:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.677+0000 7f6982a00640 1 -- 172.21.15.5:0/1545259275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6984019070 con 0x7f698c15bed0 2024-08-18T22:30:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.677+0000 7f6982a00640 1 -- 172.21.15.5:0/1545259275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698400bb10 con 0x7f698c15bed0 2024-08-18T22:30:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.677+0000 7f6991200640 1 -- 172.21.15.5:0/1545259275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c14f240 con 0x7f698c15bed0 2024-08-18T22:30:12.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.677+0000 7f6991200640 1 -- 172.21.15.5:0/1545259275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c0b4300 con 0x7f698c15bed0 2024-08-18T22:30:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.677+0000 7f6991200640 1 -- 172.21.15.5:0/1545259275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f698c0b40b0 con 0x7f698c15bed0 2024-08-18T22:30:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.677+0000 7f6982a00640 1 -- 172.21.15.5:0/1545259275 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f698400bcb0 con 0x7f698c15bed0 2024-08-18T22:30:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.677+0000 7f6982a00640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69680678c0 0x7f6968069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:12.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.677+0000 7f6982a00640 1 -- 172.21.15.5:0/1545259275 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f6984086010 con 0x7f698c15bed0 2024-08-18T22:30:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.677+0000 7f6989e00640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69680678c0 0x7f6968069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.677+0000 7f6989e00640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69680678c0 0x7f6968069d80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f697c0ae000 tx=0x7f697c0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.681+0000 7f6982a00640 1 -- 172.21.15.5:0/1545259275 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f698c0b3ea0 con 0x7f698c15bed0 2024-08-18T22:30:12.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.845+0000 7f6991200640 1 -- 172.21.15.5:0/1545259275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f698c06ca70 con 0x7f698c15bed0 2024-08-18T22:30:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.845+0000 7f6982a00640 1 -- 172.21.15.5:0/1545259275 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) ==== 74+0+13229 (secure 0 0 0) 0x7f6984056b90 con 0x7f698c15bed0 2024-08-18T22:30:12.846 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:12.846 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":158,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:30:11.485564+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1418980807":"2024-08-19T22:30:08.476182+0000","172.21.15.5:6834/1418980807":"2024-08-19T22:30:08.476182+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:30:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 -- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69680678c0 msgr2=0x7f6968069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69680678c0 0x7f6968069d80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f697c0ae000 tx=0x7f697c0b3040 comp rx=0 tx=0).stop 2024-08-18T22:30:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 -- 172.21.15.5:0/1545259275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698c15bed0 msgr2=0x7f698c150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698c15bed0 0x7f698c150bc0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f698400d830 tx=0x7f698400dcf0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 -- 172.21.15.5:0/1545259275 shutdown_connections 2024-08-18T22:30:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69680678c0 0x7f6968069d80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f698c15bed0 0x7f698c150bc0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f698c0cb390 0x7f698c0b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 --2- 172.21.15.5:0/1545259275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f698c06da70 0x7f698c14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 -- 172.21.15.5:0/1545259275 >> 172.21.15.5:0/1545259275 conn(0x7f698c0b1c50 msgr2=0x7f698c152370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 -- 172.21.15.5:0/1545259275 shutdown_connections 2024-08-18T22:30:12.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:12.849+0000 7f6991200640 1 -- 172.21.15.5:0/1545259275 wait complete. 2024-08-18T22:30:12.868 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:30:12.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:30:13.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcc1400640 1 Processor -- start 2024-08-18T22:30:13.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcc1400640 1 -- start start 2024-08-18T22:30:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcc1400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdcbc15fb80 0x7fdcbc0d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcc1400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcbc0b5ad0 0x7fdcbc06fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcc1400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcbc0d30b0 con 0x7fdcbc071550 2024-08-18T22:30:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcc1400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdcbc0d1eb0 con 0x7fdcbc15fb80 2024-08-18T22:30:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcc1400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdcbc0d1bd0 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcbb200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdcbc071550 0x7fdcbc09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34792/0 (socket says 172.21.15.5:34792) 2024-08-18T22:30:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcbb200640 1 -- 172.21.15.5:0/2840242057 learned_addr learned my addr 172.21.15.5:0/2840242057 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcba800640 1 --2- 172.21.15.5:0/2840242057 >> v2:172.21.15.117:3300/0 conn(0x7fdcbc15fb80 0x7fdcbc0d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcb9e00640 1 --2- 172.21.15.5:0/2840242057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcbc0b5ad0 0x7fdcbc06fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcb9400640 1 -- 172.21.15.5:0/2840242057 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4126459002 0 0) 0x7fdcbc0d30b0 con 0x7fdcbc071550 2024-08-18T22:30:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcb9400640 1 -- 172.21.15.5:0/2840242057 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdca0003530 con 0x7fdcbc071550 2024-08-18T22:30:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcba800640 1 -- 172.21.15.5:0/2840242057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcbc0b5ad0 msgr2=0x7fdcbc06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcba800640 1 --2- 172.21.15.5:0/2840242057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcbc0b5ad0 0x7fdcbc06fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcba800640 1 -- 172.21.15.5:0/2840242057 >> v1:172.21.15.5:6789/0 conn(0x7fdcbc071550 legacy=0x7fdcbc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:13.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.013+0000 7fdcba800640 1 -- 172.21.15.5:0/2840242057 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc0d2dd0 con 0x7fdcbc15fb80 2024-08-18T22:30:13.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcba800640 1 --2- 172.21.15.5:0/2840242057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcbc15fb80 0x7fdcbc0d15e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8d4da3e393890e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcb9400640 1 -- 172.21.15.5:0/2840242057 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0b0070 con 0x7fdcbc15fb80 2024-08-18T22:30:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcb9400640 1 -- 172.21.15.5:0/2840242057 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcac0ab600 con 0x7fdcbc15fb80 2024-08-18T22:30:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcb9400640 1 -- 172.21.15.5:0/2840242057 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0ab9b0 con 0x7fdcbc15fb80 2024-08-18T22:30:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcc1400640 1 -- 172.21.15.5:0/2840242057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcbc15fb80 msgr2=0x7fdcbc0d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcc1400640 1 --2- 172.21.15.5:0/2840242057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcbc15fb80 0x7fdcbc0d15e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01c380 comp rx=0 tx=0).stop 2024-08-18T22:30:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcc1400640 1 -- 172.21.15.5:0/2840242057 shutdown_connections 2024-08-18T22:30:13.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcc1400640 1 --2- 172.21.15.5:0/2840242057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcbc0b5ad0 0x7fdcbc06fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcc1400640 1 --2- 172.21.15.5:0/2840242057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcbc15fb80 0x7fdcbc0d15e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcc1400640 1 -- 172.21.15.5:0/2840242057 >> 172.21.15.5:0/2840242057 conn(0x7fdcbc0d2180 msgr2=0x7fdcbc0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:13.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcc1400640 1 -- 172.21.15.5:0/2840242057 shutdown_connections 2024-08-18T22:30:13.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.017+0000 7fdcc1400640 1 -- 172.21.15.5:0/2840242057 wait complete. 2024-08-18T22:30:13.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcc1400640 1 Processor -- start 2024-08-18T22:30:13.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcc1400640 1 -- start start 2024-08-18T22:30:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcc1400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcbc071550 0x7fdcbc150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcc1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcbc0b5ad0 0x7fdcbc150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcc1400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcbc15fb80 0x7fdcbc0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcc1400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc09b2d0 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcc1400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc09b150 con 0x7fdcbc071550 2024-08-18T22:30:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcc1400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdcbc071980 con 0x7fdcbc15fb80 2024-08-18T22:30:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcbc0b5ad0 0x7fdcbc150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcbc0b5ad0 0x7fdcbc150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56186/0 (socket says 172.21.15.5:56186) 2024-08-18T22:30:13.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb9e00640 1 -- 172.21.15.5:0/600673481 learned_addr learned my addr 172.21.15.5:0/600673481 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:13.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcba800640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcbc071550 0x7fdcbc150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcbb200640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcbc15fb80 0x7fdcbc0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb9e00640 1 -- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcbc15fb80 msgr2=0x7fdcbc0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb9e00640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcbc15fb80 0x7fdcbc0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb9e00640 1 -- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcbc071550 msgr2=0x7fdcbc150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb9e00640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcbc071550 0x7fdcbc150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb9e00640 1 -- 172.21.15.5:0/600673481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc0af0d0 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb9e00640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcbc0b5ad0 0x7fdcbc150940 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fdca800e900 tx=0x7fdca800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb2a00640 1 -- 172.21.15.5:0/600673481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8017070 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb2a00640 1 -- 172.21.15.5:0/600673481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca800ca00 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcb2a00640 1 -- 172.21.15.5:0/600673481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca800cdd0 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcc1400640 1 -- 172.21.15.5:0/600673481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcbc0af3b0 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.021+0000 7fdcc1400640 1 -- 172.21.15.5:0/600673481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcbc0af970 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.025+0000 7fdcc1400640 1 -- 172.21.15.5:0/600673481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcbc06fad0 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.025+0000 7fdcb2a00640 1 -- 172.21.15.5:0/600673481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdca801a070 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.025+0000 7fdcb2a00640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678c0 0x7fdc9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.025+0000 7fdcb2a00640 1 -- 172.21.15.5:0/600673481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7fdca80862e0 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.025+0000 7fdcba800640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678c0 0x7fdc9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.025+0000 7fdcba800640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678c0 0x7fdc9c069d80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0ad000 tx=0x7fdcac0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.029+0000 7fdcb2a00640 1 -- 172.21.15.5:0/600673481 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdca80569b0 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.193+0000 7fdcc1400640 1 -- 172.21.15.5:0/600673481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdcbc14fe50 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.193+0000 7fdcb2a00640 1 -- 172.21.15.5:0/600673481 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) ==== 93+0+10 (secure 0 0 0) 0x7fdca805acb0 con 0x7fdcbc0b5ad0 2024-08-18T22:30:13.194 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 -- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678c0 msgr2=0x7fdc9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678c0 0x7fdc9c069d80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0ad000 tx=0x7fdcac0a6000 comp rx=0 tx=0).stop 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 -- 172.21.15.5:0/600673481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcbc0b5ad0 msgr2=0x7fdcbc150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcbc0b5ad0 0x7fdcbc150940 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fdca800e900 tx=0x7fdca800edc0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 -- 172.21.15.5:0/600673481 shutdown_connections 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdc9c0678c0 0x7fdc9c069d80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcbc15fb80 0x7fdcbc0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcbc0b5ad0 0x7fdcbc150940 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 --2- 172.21.15.5:0/600673481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcbc071550 0x7fdcbc150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 -- 172.21.15.5:0/600673481 >> 172.21.15.5:0/600673481 conn(0x7fdcbc0d2180 msgr2=0x7fdcbc09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 -- 172.21.15.5:0/600673481 shutdown_connections 2024-08-18T22:30:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.197+0000 7fdcc1400640 1 -- 172.21.15.5:0/600673481 wait complete. 2024-08-18T22:30:13.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-08-18T22:30:13.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.357+0000 7fdcc8600640 1 Processor -- start 2024-08-18T22:30:13.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.357+0000 7fdcc8600640 1 -- start start 2024-08-18T22:30:13.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc8600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc015bed0 0x7fdcc00735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc8600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcc00cb390 0x7fdcc0071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc8600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc0072060 con 0x7fdcc006da70 2024-08-18T22:30:13.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc8600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc0073c80 con 0x7fdcc00cb390 2024-08-18T22:30:13.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc8600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc00ca5d0 con 0x7fdcc015bed0 2024-08-18T22:30:13.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc5200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcc00cb390 0x7fdcc0071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc6600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdcc006da70 0x7fdcc00cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34794/0 (socket says 172.21.15.5:34794) 2024-08-18T22:30:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc5200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdcc00cb390 0x7fdcc0071b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56192/0 (socket says 172.21.15.5:56192) 2024-08-18T22:30:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc6600640 1 -- 172.21.15.5:0/1803143078 learned_addr learned my addr 172.21.15.5:0/1803143078 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:13.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc5c00640 1 --2- 172.21.15.5:0/1803143078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc015bed0 0x7fdcc00735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc5200640 1 -- 172.21.15.5:0/1803143078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc015bed0 msgr2=0x7fdcc00735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:13.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc5200640 1 --2- 172.21.15.5:0/1803143078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc015bed0 0x7fdcc00735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc5200640 1 -- 172.21.15.5:0/1803143078 >> v1:172.21.15.5:6789/0 conn(0x7fdcc006da70 legacy=0x7fdcc00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:13.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc5200640 1 -- 172.21.15.5:0/1803143078 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc00ca8b0 con 0x7fdcc00cb390 2024-08-18T22:30:13.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcbfe00640 1 -- 172.21.15.5:0/1803143078 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1824404925 0 0) 0x7fdcc0072060 con 0x7fdcc006da70 2024-08-18T22:30:13.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc5c00640 1 --2- 172.21.15.5:0/1803143078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc015bed0 0x7fdcc00735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:13.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.361+0000 7fdcc5200640 1 --2- 172.21.15.5:0/1803143078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc00cb390 0x7fdcc0071b20 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3ed6e2a821bb39 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:13.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcbfe00640 1 -- 172.21.15.5:0/1803143078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0a7070 con 0x7fdcc00cb390 2024-08-18T22:30:13.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcbfe00640 1 -- 172.21.15.5:0/1803143078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcac0b0070 con 0x7fdcc00cb390 2024-08-18T22:30:13.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcbfe00640 1 -- 172.21.15.5:0/1803143078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0ab890 con 0x7fdcc00cb390 2024-08-18T22:30:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 -- 172.21.15.5:0/1803143078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc00cb390 msgr2=0x7fdcc0071b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 --2- 172.21.15.5:0/1803143078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc00cb390 0x7fdcc0071b20 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01c470 comp rx=0 tx=0).stop 2024-08-18T22:30:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 -- 172.21.15.5:0/1803143078 shutdown_connections 2024-08-18T22:30:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 --2- 172.21.15.5:0/1803143078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc00cb390 0x7fdcc0071b20 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 --2- 172.21.15.5:0/1803143078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc015bed0 0x7fdcc00735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 -- 172.21.15.5:0/1803143078 >> 172.21.15.5:0/1803143078 conn(0x7fdcc00b1c50 msgr2=0x7fdcc00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 -- 172.21.15.5:0/1803143078 shutdown_connections 2024-08-18T22:30:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 -- 172.21.15.5:0/1803143078 wait complete. 2024-08-18T22:30:13.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 Processor -- start 2024-08-18T22:30:13.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 -- start start 2024-08-18T22:30:13.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc006da70 0x7fdcc0151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc00cb390 0x7fdcc014d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc015bed0 0x7fdcc01535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc015c430 con 0x7fdcc00cb390 2024-08-18T22:30:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc015c2b0 con 0x7fdcc015bed0 2024-08-18T22:30:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc8600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc0168ba0 con 0x7fdcc006da70 2024-08-18T22:30:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc00cb390 0x7fdcc014d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc5200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc00cb390 0x7fdcc014d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56208/0 (socket says 172.21.15.5:56208) 2024-08-18T22:30:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc5200640 1 -- 172.21.15.5:0/3707917962 learned_addr learned my addr 172.21.15.5:0/3707917962 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc5c00640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc006da70 0x7fdcc0151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.365+0000 7fdcc6600640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc015bed0 0x7fdcc01535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcc5200640 1 -- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc006da70 msgr2=0x7fdcc0151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcc5200640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc006da70 0x7fdcc0151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcc5200640 1 -- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc015bed0 msgr2=0x7fdcc01535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcc5200640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc015bed0 0x7fdcc01535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcc5200640 1 -- 172.21.15.5:0/3707917962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc0152500 con 0x7fdcc00cb390 2024-08-18T22:30:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcc6600640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc015bed0 0x7fdcc01535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcc5200640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc00cb390 0x7fdcc014d8a0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0ad040 tx=0x7fdcac01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcbd600640 1 -- 172.21.15.5:0/3707917962 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac004230 con 0x7fdcc00cb390 2024-08-18T22:30:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcbd600640 1 -- 172.21.15.5:0/3707917962 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcac0043d0 con 0x7fdcc00cb390 2024-08-18T22:30:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcbd600640 1 -- 172.21.15.5:0/3707917962 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac003820 con 0x7fdcc00cb390 2024-08-18T22:30:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcc8600640 1 -- 172.21.15.5:0/3707917962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc01527e0 con 0x7fdcc00cb390 2024-08-18T22:30:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcc8600640 1 -- 172.21.15.5:0/3707917962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc0152da0 con 0x7fdcc00cb390 2024-08-18T22:30:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcc8600640 1 -- 172.21.15.5:0/3707917962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc00735a0 con 0x7fdcc00cb390 2024-08-18T22:30:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcbd600640 1 -- 172.21.15.5:0/3707917962 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdcac0039c0 con 0x7fdcc00cb390 2024-08-18T22:30:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcbd600640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdca00678c0 0x7fdca0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.369+0000 7fdcbd600640 1 -- 172.21.15.5:0/3707917962 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7fdcac120390 con 0x7fdcc00cb390 2024-08-18T22:30:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.373+0000 7fdcc5c00640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdca00678c0 0x7fdca0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:13.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.373+0000 7fdcc5c00640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdca00678c0 0x7fdca0069d80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400ab60 tx=0x7fdcb4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:13.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.373+0000 7fdcbd600640 1 -- 172.21.15.5:0/3707917962 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdcac0c6030 con 0x7fdcc00cb390 2024-08-18T22:30:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:13.597+0000 7fdcc8600640 1 -- 172.21.15.5:0/3707917962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7fdcc00d0100 con 0x7fdcc00cb390 2024-08-18T22:30:14.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.505+0000 7fdcbd600640 1 -- 172.21.15.5:0/3707917962 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v521) ==== 169+0+0 (secure 0 0 0) 0x7fdcac016090 con 0x7fdcc00cb390 2024-08-18T22:30:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 -- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdca00678c0 msgr2=0x7fdca0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdca00678c0 0x7fdca0069d80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400ab60 tx=0x7fdcb4008040 comp rx=0 tx=0).stop 2024-08-18T22:30:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 -- 172.21.15.5:0/3707917962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc00cb390 msgr2=0x7fdcc014d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc00cb390 0x7fdcc014d8a0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0ad040 tx=0x7fdcac01acb0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 -- 172.21.15.5:0/3707917962 shutdown_connections 2024-08-18T22:30:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdca00678c0 0x7fdca0069d80 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc015bed0 0x7fdcc01535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc00cb390 0x7fdcc014d8a0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 --2- 172.21.15.5:0/3707917962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc006da70 0x7fdcc0151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 -- 172.21.15.5:0/3707917962 >> 172.21.15.5:0/3707917962 conn(0x7fdcc00b1c50 msgr2=0x7fdcc00d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 -- 172.21.15.5:0/3707917962 shutdown_connections 2024-08-18T22:30:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.509+0000 7fdcc8600640 1 -- 172.21.15.5:0/3707917962 wait complete. 2024-08-18T22:30:14.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:30:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.681+0000 7f72fee00640 1 Processor -- start 2024-08-18T22:30:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72fee00640 1 -- start start 2024-08-18T22:30:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72fee00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72f815c5d0 0x7f72f80b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72fee00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f8072a20 0x7f72f80b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72fee00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f815fed0 con 0x7f72f815c1f0 2024-08-18T22:30:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72fee00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f72f815fc80 con 0x7f72f815c5d0 2024-08-18T22:30:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72fee00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f72f8160800 con 0x7f72f8072a20 2024-08-18T22:30:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72f7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f72f815c1f0 0x7f72f80af9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59332/0 (socket says 172.21.15.5:59332) 2024-08-18T22:30:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72f7e00640 1 -- 172.21.15.5:0/3791303075 learned_addr learned my addr 172.21.15.5:0/3791303075 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72efe00640 1 --2- 172.21.15.5:0/3791303075 >> v2:172.21.15.5:3300/0 conn(0x7f72f815c5d0 0x7f72f80b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72fce00640 1 --2- 172.21.15.5:0/3791303075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f8072a20 0x7f72f80b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72f7400640 1 -- 172.21.15.5:0/3791303075 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 920104756 0 0) 0x7f72f815fed0 con 0x7f72f815c1f0 2024-08-18T22:30:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72f7400640 1 -- 172.21.15.5:0/3791303075 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72dc003530 con 0x7f72f815c1f0 2024-08-18T22:30:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72efe00640 1 -- 172.21.15.5:0/3791303075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f8072a20 msgr2=0x7f72f80b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72efe00640 1 --2- 172.21.15.5:0/3791303075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f8072a20 0x7f72f80b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72efe00640 1 -- 172.21.15.5:0/3791303075 >> v1:172.21.15.5:6789/0 conn(0x7f72f815c1f0 legacy=0x7f72f80af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.685+0000 7f72efe00640 1 -- 172.21.15.5:0/3791303075 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f81601b0 con 0x7f72f815c5d0 2024-08-18T22:30:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72efe00640 1 --2- 172.21.15.5:0/3791303075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f815c5d0 0x7f72f80b59b0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f72e00097c0 tx=0x7f72e001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0891eebb278b83 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72f7400640 1 -- 172.21.15.5:0/3791303075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e00b1070 con 0x7f72f815c5d0 2024-08-18T22:30:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72f7400640 1 -- 172.21.15.5:0/3791303075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e00a8050 con 0x7f72f815c5d0 2024-08-18T22:30:14.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72f7400640 1 -- 172.21.15.5:0/3791303075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e00ac840 con 0x7f72f815c5d0 2024-08-18T22:30:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72fee00640 1 -- 172.21.15.5:0/3791303075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f815c5d0 msgr2=0x7f72f80b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72fee00640 1 --2- 172.21.15.5:0/3791303075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f815c5d0 0x7f72f80b59b0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f72e00097c0 tx=0x7f72e001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72fee00640 1 -- 172.21.15.5:0/3791303075 shutdown_connections 2024-08-18T22:30:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72fee00640 1 --2- 172.21.15.5:0/3791303075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f8072a20 0x7f72f80b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72fee00640 1 --2- 172.21.15.5:0/3791303075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f815c5d0 0x7f72f80b59b0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72fee00640 1 -- 172.21.15.5:0/3791303075 >> 172.21.15.5:0/3791303075 conn(0x7f72f8071f30 msgr2=0x7f72f8072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72fee00640 1 -- 172.21.15.5:0/3791303075 shutdown_connections 2024-08-18T22:30:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72fee00640 1 -- 172.21.15.5:0/3791303075 wait complete. 2024-08-18T22:30:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72fee00640 1 Processor -- start 2024-08-18T22:30:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.689+0000 7f72fee00640 1 -- start start 2024-08-18T22:30:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72fee00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72f8072a20 0x7f72f81520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72fee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f815c1f0 0x7f72f81651c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72fee00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f8165700 0x7f72f8157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72fee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f72f80cdc00 con 0x7f72f815c1f0 2024-08-18T22:30:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72fee00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f72f80cda80 con 0x7f72f8072a20 2024-08-18T22:30:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72fee00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f72f80cdd80 con 0x7f72f8165700 2024-08-18T22:30:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72efe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f815c1f0 0x7f72f81651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72efe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f815c1f0 0x7f72f81651c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55030/0 (socket says 172.21.15.5:55030) 2024-08-18T22:30:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72efe00640 1 -- 172.21.15.5:0/408699205 learned_addr learned my addr 172.21.15.5:0/408699205 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72fce00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f8165700 0x7f72f8157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72f7e00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72f8072a20 0x7f72f81520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72efe00640 1 -- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f8165700 msgr2=0x7f72f8157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72efe00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f8165700 0x7f72f8157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72efe00640 1 -- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72f8072a20 msgr2=0x7f72f81520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72efe00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72f8072a20 0x7f72f81520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72efe00640 1 -- 172.21.15.5:0/408699205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f80b37a0 con 0x7f72f815c1f0 2024-08-18T22:30:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72f7e00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72f8072a20 0x7f72f81520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72efe00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f815c1f0 0x7f72f81651c0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f72e001a0d0 tx=0x7f72e0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72f4c00640 1 -- 172.21.15.5:0/408699205 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e00b1040 con 0x7f72f815c1f0 2024-08-18T22:30:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72f4c00640 1 -- 172.21.15.5:0/408699205 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e00be070 con 0x7f72f815c1f0 2024-08-18T22:30:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72fee00640 1 -- 172.21.15.5:0/408699205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f80b3a40 con 0x7f72f815c1f0 2024-08-18T22:30:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72f4c00640 1 -- 172.21.15.5:0/408699205 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e00b6660 con 0x7f72f815c1f0 2024-08-18T22:30:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72fee00640 1 -- 172.21.15.5:0/408699205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f80b4000 con 0x7f72f815c1f0 2024-08-18T22:30:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.693+0000 7f72fee00640 1 -- 172.21.15.5:0/408699205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f8165b10 con 0x7f72f815c1f0 2024-08-18T22:30:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.697+0000 7f72f4c00640 1 -- 172.21.15.5:0/408699205 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72e00b4070 con 0x7f72f815c1f0 2024-08-18T22:30:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.697+0000 7f72f4c00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72d40678f0 0x7f72d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.697+0000 7f72f4c00640 1 -- 172.21.15.5:0/408699205 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f72e011fbd0 con 0x7f72f815c1f0 2024-08-18T22:30:14.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.697+0000 7f72f7e00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72d40678f0 0x7f72d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:14.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.697+0000 7f72f7e00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72d40678f0 0x7f72d4069db0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f72e8005890 tx=0x7f72e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:14.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.701+0000 7f72f4c00640 1 -- 172.21.15.5:0/408699205 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f72f8165b10 con 0x7f72f815c1f0 2024-08-18T22:30:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.865+0000 7f72fee00640 1 -- 172.21.15.5:0/408699205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f72f815fed0 con 0x7f72f815c1f0 2024-08-18T22:30:14.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.869+0000 7f72f4c00640 1 -- 172.21.15.5:0/408699205 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f72e00c8020 con 0x7f72f815c1f0 2024-08-18T22:30:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 -- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72d40678f0 msgr2=0x7f72d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72d40678f0 0x7f72d4069db0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f72e8005890 tx=0x7f72e8009040 comp rx=0 tx=0).stop 2024-08-18T22:30:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 -- 172.21.15.5:0/408699205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f815c1f0 msgr2=0x7f72f81651c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f815c1f0 0x7f72f81651c0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f72e001a0d0 tx=0x7f72e0019240 comp rx=0 tx=0).stop 2024-08-18T22:30:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 -- 172.21.15.5:0/408699205 shutdown_connections 2024-08-18T22:30:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f72d40678f0 0x7f72d4069db0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72f8165700 0x7f72f8157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72f815c1f0 0x7f72f81651c0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 --2- 172.21.15.5:0/408699205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72f8072a20 0x7f72f81520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 -- 172.21.15.5:0/408699205 >> 172.21.15.5:0/408699205 conn(0x7f72f8071f30 msgr2=0x7f72f8072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:14.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 -- 172.21.15.5:0/408699205 shutdown_connections 2024-08-18T22:30:14.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:14.873+0000 7f72fee00640 1 -- 172.21.15.5:0/408699205 wait complete. 2024-08-18T22:30:14.890 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:30:14.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:30:14.976 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:30:15.063 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:30:15.063 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:30:15.063 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:30:15.072 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:30:15.072 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:30:15.072 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:30:15.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:30:15.081 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:30:15.081 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:30:15.121 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:30:15.121 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:30:15.121 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:30:15.134 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:30:15.134 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:30:15.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:15.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.301+0000 7f23b1800640 1 Processor -- start 2024-08-18T22:30:15.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.301+0000 7f23b1800640 1 -- start start 2024-08-18T22:30:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.305+0000 7f23b1800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23ac15b010 0x7f23ac0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.305+0000 7f23b1800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23ac0cee20 con 0x7f23ac0cd3a0 2024-08-18T22:30:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.305+0000 7f23b1800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23ac0cf100 con 0x7f23ac06f290 2024-08-18T22:30:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.305+0000 7f23b1800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f23ac0cfa30 con 0x7f23ac15b010 2024-08-18T22:30:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.305+0000 7f23aaa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23ac15b010 0x7f23ac0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.305+0000 7f23aaa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23ac15b010 0x7f23ac0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55040/0 (socket says 172.21.15.5:55040) 2024-08-18T22:30:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.305+0000 7f23aaa00640 1 -- 172.21.15.5:0/3727635200 learned_addr learned my addr 172.21.15.5:0/3727635200 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.305+0000 7f23aa000640 1 --1- 172.21.15.5:0/3727635200 >> v1:172.21.15.5:6789/0 conn(0x7f23ac0cd3a0 0x7f23ac06eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59348/0 (socket says 172.21.15.5:59348) 2024-08-18T22:30:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.305+0000 7f23aaa00640 1 -- 172.21.15.5:0/3727635200 >> v1:172.21.15.117:6789/0 conn(0x7f23ac06f290 legacy=0x7f23ac072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.305+0000 7f23aaa00640 1 -- 172.21.15.5:0/3727635200 >> v1:172.21.15.5:6789/0 conn(0x7f23ac0cd3a0 legacy=0x7f23ac06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.305+0000 7f23aaa00640 1 -- 172.21.15.5:0/3727635200 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac0cf3e0 con 0x7f23ac15b010 2024-08-18T22:30:15.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23aaa00640 1 --2- 172.21.15.5:0/3727635200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac15b010 0x7f23ac0ce840 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f239c009870 tx=0x7f239c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e107c56806507f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:15.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23a9600640 1 -- 172.21.15.5:0/3727635200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c0ab660 con 0x7f23ac15b010 2024-08-18T22:30:15.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23a9600640 1 -- 172.21.15.5:0/3727635200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f239c0b0070 con 0x7f23ac15b010 2024-08-18T22:30:15.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23a9600640 1 -- 172.21.15.5:0/3727635200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c0aba20 con 0x7f23ac15b010 2024-08-18T22:30:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23b1800640 1 -- 172.21.15.5:0/3727635200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac15b010 msgr2=0x7f23ac0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23b1800640 1 --2- 172.21.15.5:0/3727635200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac15b010 0x7f23ac0ce840 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f239c009870 tx=0x7f239c01c530 comp rx=0 tx=0).stop 2024-08-18T22:30:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23b1800640 1 -- 172.21.15.5:0/3727635200 shutdown_connections 2024-08-18T22:30:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23b1800640 1 --2- 172.21.15.5:0/3727635200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac15b010 0x7f23ac0ce840 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23b1800640 1 -- 172.21.15.5:0/3727635200 >> 172.21.15.5:0/3727635200 conn(0x7f23ac0b1c50 msgr2=0x7f23ac0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23b1800640 1 -- 172.21.15.5:0/3727635200 shutdown_connections 2024-08-18T22:30:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23b1800640 1 -- 172.21.15.5:0/3727635200 wait complete. 2024-08-18T22:30:15.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23b1800640 1 Processor -- start 2024-08-18T22:30:15.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.309+0000 7f23b1800640 1 -- start start 2024-08-18T22:30:15.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23b1800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23ac06f290 0x7f23ac09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:15.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23b1800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23ac0cd3a0 0x7f23ac0b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:15.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23b1800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac15b010 0x7f23ac0b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:15.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23b1800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac0736c0 con 0x7f23ac15b010 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23b1800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac073540 con 0x7f23ac06f290 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23b1800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f23ac073840 con 0x7f23ac0cd3a0 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23ab400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac15b010 0x7f23ac0b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23ab400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac15b010 0x7f23ac0b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55052/0 (socket says 172.21.15.5:55052) 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23ab400640 1 -- 172.21.15.5:0/497919785 learned_addr learned my addr 172.21.15.5:0/497919785 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23aaa00640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23ac06f290 0x7f23ac09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23aa000640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23ac0cd3a0 0x7f23ac0b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23ab400640 1 -- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23ac0cd3a0 msgr2=0x7f23ac0b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23ab400640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23ac0cd3a0 0x7f23ac0b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23ab400640 1 -- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23ac06f290 msgr2=0x7f23ac09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23ab400640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23ac06f290 0x7f23ac09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23ab400640 1 -- 172.21.15.5:0/497919785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac0b3850 con 0x7f23ac15b010 2024-08-18T22:30:15.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23aa000640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23ac0cd3a0 0x7f23ac0b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:15.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23ab400640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac15b010 0x7f23ac0b5540 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f23a400c730 tx=0x7f23a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:15.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23a2a00640 1 -- 172.21.15.5:0/497919785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4003b80 con 0x7f23ac15b010 2024-08-18T22:30:15.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23a2a00640 1 -- 172.21.15.5:0/497919785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a4003d20 con 0x7f23ac15b010 2024-08-18T22:30:15.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23a2a00640 1 -- 172.21.15.5:0/497919785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a400aa90 con 0x7f23ac15b010 2024-08-18T22:30:15.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23b1800640 1 -- 172.21.15.5:0/497919785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ac0b3b30 con 0x7f23ac15b010 2024-08-18T22:30:15.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23b1800640 1 -- 172.21.15.5:0/497919785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ac1584b0 con 0x7f23ac15b010 2024-08-18T22:30:15.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23b1800640 1 -- 172.21.15.5:0/497919785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ac157fc0 con 0x7f23ac15b010 2024-08-18T22:30:15.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.313+0000 7f23a2a00640 1 -- 172.21.15.5:0/497919785 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23a400ac30 con 0x7f23ac15b010 2024-08-18T22:30:15.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.317+0000 7f23a2a00640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f238c0678c0 0x7f238c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:15.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.317+0000 7f23a2a00640 1 -- 172.21.15.5:0/497919785 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f23a4085940 con 0x7f23ac15b010 2024-08-18T22:30:15.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.317+0000 7f23aaa00640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f238c0678c0 0x7f238c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:15.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.317+0000 7f23aaa00640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f238c0678c0 0x7f238c069d80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f239c0af000 tx=0x7f239c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:15.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.321+0000 7f23a2a00640 1 -- 172.21.15.5:0/497919785 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f23a40565f0 con 0x7f23ac15b010 2024-08-18T22:30:15.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.517+0000 7f23b1800640 1 -- 172.21.15.5:0/497919785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23ac0ce840 con 0x7f23ac15b010 2024-08-18T22:30:15.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.517+0000 7f23a2a00640 1 -- 172.21.15.5:0/497919785 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+3916 (secure 0 0 0) 0x7f23a4055ef0 con 0x7f23ac15b010 2024-08-18T22:30:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:15.518 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":119,"btime":"2024-08-18T22:30:09:478516+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1043336199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1043336199},{"type":"v1","addr":"172.21.15.117:6836","nonce":1043336199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2521877181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2521877181},{"type":"v1","addr":"172.21.15.117:6837","nonce":2521877181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1768187738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1768187738},{"type":"v1","addr":"172.21.15.5:6833","nonce":1768187738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9441,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4162017446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":4162017446},{"type":"v1","addr":"172.21.15.5:6835","nonce":4162017446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[]} 2024-08-18T22:30:15.518 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 119 2024-08-18T22:30:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 -- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f238c0678c0 msgr2=0x7f238c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f238c0678c0 0x7f238c069d80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f239c0af000 tx=0x7f239c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:30:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 -- 172.21.15.5:0/497919785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac15b010 msgr2=0x7f23ac0b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac15b010 0x7f23ac0b5540 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f23a400c730 tx=0x7f23a400cbf0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 -- 172.21.15.5:0/497919785 shutdown_connections 2024-08-18T22:30:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f238c0678c0 0x7f238c069d80 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac15b010 0x7f23ac0b5540 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23ac0cd3a0 0x7f23ac0b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 --2- 172.21.15.5:0/497919785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23ac06f290 0x7f23ac09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 -- 172.21.15.5:0/497919785 >> 172.21.15.5:0/497919785 conn(0x7f23ac0b1c50 msgr2=0x7f23ac0cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 -- 172.21.15.5:0/497919785 shutdown_connections 2024-08-18T22:30:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.521+0000 7f23b1800640 1 -- 172.21.15.5:0/497919785 wait complete. 2024-08-18T22:30:15.540 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:30:15.540 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:30:15.540 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:30:15.540 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:30:15.540 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:30:15.541 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:30:15.541 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:30:15.541 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:30:15.541 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:30:15.541 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:30:15.541 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:30:15.541 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:30:15.542 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:30:15.542 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:30:15.542 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:30:15.542 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:30:15.551 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:30:15.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:30:15.553 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:30:15.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:30:15.555 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:30:15.556 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:30:15.556 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:30:15.556 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:30:15.599 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:30:15.599 DEBUG:teuthology.parallel:result is None 2024-08-18T22:30:15.600 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:30:15.600 DEBUG:teuthology.parallel:result is None 2024-08-18T22:30:15.601 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:30:15.601 DEBUG:teuthology.parallel:result is None 2024-08-18T22:30:15.602 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:30:15.602 DEBUG:teuthology.parallel:result is None 2024-08-18T22:30:15.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:30:15.688 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:30:15.688 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:30:15.690 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:30:15.690 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:30:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.749+0000 7fcaddc00640 1 Processor -- start 2024-08-18T22:30:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.749+0000 7fcaddc00640 1 -- start start 2024-08-18T22:30:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.749+0000 7fcaddc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcad815c180 0x7fcad80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:15.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.749+0000 7fcaddc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcad815c560 0x7fcad80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.749+0000 7fcaddc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad80cfb00 con 0x7fcad815d4d0 2024-08-18T22:30:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.749+0000 7fcaddc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcad815d040 con 0x7fcad815c560 2024-08-18T22:30:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.749+0000 7fcaddc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcad815c9f0 con 0x7fcad815c180 2024-08-18T22:30:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcad815c560 0x7fcad80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcad815c560 0x7fcad80ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55072/0 (socket says 172.21.15.5:55072) 2024-08-18T22:30:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad6000640 1 -- 172.21.15.5:0/604655451 learned_addr learned my addr 172.21.15.5:0/604655451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad6a00640 1 --2- 172.21.15.5:0/604655451 >> v2:172.21.15.117:3300/0 conn(0x7fcad815c180 0x7fcad80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad6000640 1 -- 172.21.15.5:0/604655451 >> v2:172.21.15.117:3300/0 conn(0x7fcad815c180 msgr2=0x7fcad80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad6000640 1 --2- 172.21.15.5:0/604655451 >> v2:172.21.15.117:3300/0 conn(0x7fcad815c180 0x7fcad80cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad6000640 1 -- 172.21.15.5:0/604655451 >> v1:172.21.15.117:6789/0 conn(0x7fcad815d4d0 legacy=0x7fcad815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:15.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad6000640 1 -- 172.21.15.5:0/604655451 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad815ccd0 con 0x7fcad815c560 2024-08-18T22:30:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad6000640 1 --2- 172.21.15.5:0/604655451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcad815c560 0x7fcad80ce450 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fcad806d8a0 tx=0x7fcac401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d98a5a36ae34e3e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad5600640 1 -- 172.21.15.5:0/604655451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40a7070 con 0x7fcad815c560 2024-08-18T22:30:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad5600640 1 -- 172.21.15.5:0/604655451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac40b0070 con 0x7fcad815c560 2024-08-18T22:30:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.753+0000 7fcad5600640 1 -- 172.21.15.5:0/604655451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40ab890 con 0x7fcad815c560 2024-08-18T22:30:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 -- 172.21.15.5:0/604655451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcad815c560 msgr2=0x7fcad80ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 --2- 172.21.15.5:0/604655451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcad815c560 0x7fcad80ce450 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fcad806d8a0 tx=0x7fcac401c450 comp rx=0 tx=0).stop 2024-08-18T22:30:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 -- 172.21.15.5:0/604655451 shutdown_connections 2024-08-18T22:30:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 --2- 172.21.15.5:0/604655451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcad815c560 0x7fcad80ce450 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 --2- 172.21.15.5:0/604655451 >> v2:172.21.15.117:3300/0 conn(0x7fcad815c180 0x7fcad80cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 -- 172.21.15.5:0/604655451 >> 172.21.15.5:0/604655451 conn(0x7fcad80b1dc0 msgr2=0x7fcad80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 -- 172.21.15.5:0/604655451 shutdown_connections 2024-08-18T22:30:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 -- 172.21.15.5:0/604655451 wait complete. 2024-08-18T22:30:15.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 Processor -- start 2024-08-18T22:30:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 -- start start 2024-08-18T22:30:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcad815c180 0x7fcad81536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcad815d4d0 0x7fcad8155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcad8150780 0x7fcad8155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81692b0 con 0x7fcad815d4d0 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcad8169130 con 0x7fcad8150780 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcaddc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcad8169430 con 0x7fcad815c180 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcad6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcad815d4d0 0x7fcad8155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcad6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcad815d4d0 0x7fcad8155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55076/0 (socket says 172.21.15.5:55076) 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcad6000640 1 -- 172.21.15.5:0/2917630302 learned_addr learned my addr 172.21.15.5:0/2917630302 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcad6a00640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcad815c180 0x7fcad81536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcad7400640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcad8150780 0x7fcad8155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcad6000640 1 -- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcad815c180 msgr2=0x7fcad81536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcad6000640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcad815c180 0x7fcad81536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcad6000640 1 -- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcad8150780 msgr2=0x7fcad8155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcad6000640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcad8150780 0x7fcad8155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcad6000640 1 -- 172.21.15.5:0/2917630302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad809bba0 con 0x7fcad815d4d0 2024-08-18T22:30:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.757+0000 7fcad6000640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcad815d4d0 0x7fcad8155670 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fcac401a080 tx=0x7fcac401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.761+0000 7fcacea00640 1 -- 172.21.15.5:0/2917630302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40be5f0 con 0x7fcad815d4d0 2024-08-18T22:30:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.761+0000 7fcacea00640 1 -- 172.21.15.5:0/2917630302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac40be790 con 0x7fcad815d4d0 2024-08-18T22:30:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.761+0000 7fcacea00640 1 -- 172.21.15.5:0/2917630302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40beb40 con 0x7fcad815d4d0 2024-08-18T22:30:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.761+0000 7fcaddc00640 1 -- 172.21.15.5:0/2917630302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad815d8d0 con 0x7fcad815d4d0 2024-08-18T22:30:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.761+0000 7fcaddc00640 1 -- 172.21.15.5:0/2917630302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad815de90 con 0x7fcad815d4d0 2024-08-18T22:30:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.761+0000 7fcaddc00640 1 -- 172.21.15.5:0/2917630302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad815fd90 con 0x7fcad815d4d0 2024-08-18T22:30:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.761+0000 7fcacea00640 1 -- 172.21.15.5:0/2917630302 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcac40b43f0 con 0x7fcad815d4d0 2024-08-18T22:30:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.761+0000 7fcacea00640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcab80678c0 0x7fcab8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.761+0000 7fcacea00640 1 -- 172.21.15.5:0/2917630302 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7fcac411ff70 con 0x7fcad815d4d0 2024-08-18T22:30:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.761+0000 7fcad6a00640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcab80678c0 0x7fcab8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:15.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.765+0000 7fcad6a00640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcab80678c0 0x7fcab8069d80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcac8007a60 tx=0x7fcac8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.765+0000 7fcacea00640 1 -- 172.21.15.5:0/2917630302 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcac40160d0 con 0x7fcad815d4d0 2024-08-18T22:30:15.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:15.945+0000 7fcaddc00640 1 -- 172.21.15.5:0/2917630302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fcad80b3920 con 0x7fcad815d4d0 2024-08-18T22:30:16.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.525+0000 7fcacea00640 1 -- 172.21.15.5:0/2917630302 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v160) ==== 97+0+0 (secure 0 0 0) 0x7fcac40f0530 con 0x7fcad815d4d0 2024-08-18T22:30:16.524 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:30:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 -- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcab80678c0 msgr2=0x7fcab8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcab80678c0 0x7fcab8069d80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcac8007a60 tx=0x7fcac8008040 comp rx=0 tx=0).stop 2024-08-18T22:30:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 -- 172.21.15.5:0/2917630302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcad815d4d0 msgr2=0x7fcad8155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcad815d4d0 0x7fcad8155670 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fcac401a080 tx=0x7fcac401ac90 comp rx=0 tx=0).stop 2024-08-18T22:30:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 -- 172.21.15.5:0/2917630302 shutdown_connections 2024-08-18T22:30:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcab80678c0 0x7fcab8069d80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcad8150780 0x7fcad8155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcad815d4d0 0x7fcad8155670 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 --2- 172.21.15.5:0/2917630302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcad815c180 0x7fcad81536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 -- 172.21.15.5:0/2917630302 >> 172.21.15.5:0/2917630302 conn(0x7fcad80b1dc0 msgr2=0x7fcad809a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 -- 172.21.15.5:0/2917630302 shutdown_connections 2024-08-18T22:30:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.529+0000 7fcaddc00640 1 -- 172.21.15.5:0/2917630302 wait complete. 2024-08-18T22:30:16.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:30:16.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.697+0000 7fd3ed000640 1 Processor -- start 2024-08-18T22:30:16.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.697+0000 7fd3ed000640 1 -- start start 2024-08-18T22:30:16.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.697+0000 7fd3ed000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e806f290 0x7fd3e80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:16.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3ed000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3e80cd3a0 0x7fd3e8072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:16.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3ed000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e80cee20 con 0x7fd3e815b010 2024-08-18T22:30:16.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3ed000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e80cfa30 con 0x7fd3e80cd3a0 2024-08-18T22:30:16.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3ed000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e80cf100 con 0x7fd3e806f290 2024-08-18T22:30:16.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3e6800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3e80cd3a0 0x7fd3e8072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:16.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3e5400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e806f290 0x7fd3e80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:16.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3e6800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3e80cd3a0 0x7fd3e8072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:49500/0 (socket says 172.21.15.5:49500) 2024-08-18T22:30:16.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3e6800640 1 -- 172.21.15.5:0/40613016 learned_addr learned my addr 172.21.15.5:0/40613016 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:16.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3e5400640 1 -- 172.21.15.5:0/40613016 >> v2:172.21.15.117:3300/0 conn(0x7fd3e80cd3a0 msgr2=0x7fd3e8072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:16.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3e5400640 1 --2- 172.21.15.5:0/40613016 >> v2:172.21.15.117:3300/0 conn(0x7fd3e80cd3a0 0x7fd3e8072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3e5400640 1 -- 172.21.15.5:0/40613016 >> v1:172.21.15.117:6789/0 conn(0x7fd3e815b010 legacy=0x7fd3e806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:16.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3e5400640 1 -- 172.21.15.5:0/40613016 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e80cf3e0 con 0x7fd3e806f290 2024-08-18T22:30:16.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.701+0000 7fd3e6800640 1 --2- 172.21.15.5:0/40613016 >> v2:172.21.15.117:3300/0 conn(0x7fd3e80cd3a0 0x7fd3e8072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:16.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3e5400640 1 --2- 172.21.15.5:0/40613016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e806f290 0x7fd3e80ce840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40097c0 tx=0x7fd3d401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1375852e431fa08e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:16.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3e4a00640 1 -- 172.21.15.5:0/40613016 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40b1070 con 0x7fd3e806f290 2024-08-18T22:30:16.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3e4a00640 1 -- 172.21.15.5:0/40613016 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d40ac630 con 0x7fd3e806f290 2024-08-18T22:30:16.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3e4a00640 1 -- 172.21.15.5:0/40613016 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40a8050 con 0x7fd3e806f290 2024-08-18T22:30:16.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 -- 172.21.15.5:0/40613016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e806f290 msgr2=0x7fd3e80ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:16.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 --2- 172.21.15.5:0/40613016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e806f290 0x7fd3e80ce840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40097c0 tx=0x7fd3d401c470 comp rx=0 tx=0).stop 2024-08-18T22:30:16.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 -- 172.21.15.5:0/40613016 shutdown_connections 2024-08-18T22:30:16.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 --2- 172.21.15.5:0/40613016 >> v2:172.21.15.117:3300/0 conn(0x7fd3e80cd3a0 0x7fd3e8072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 --2- 172.21.15.5:0/40613016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e806f290 0x7fd3e80ce840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 -- 172.21.15.5:0/40613016 >> 172.21.15.5:0/40613016 conn(0x7fd3e80b1c50 msgr2=0x7fd3e80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:16.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 -- 172.21.15.5:0/40613016 shutdown_connections 2024-08-18T22:30:16.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 -- 172.21.15.5:0/40613016 wait complete. 2024-08-18T22:30:16.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 Processor -- start 2024-08-18T22:30:16.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 -- start start 2024-08-18T22:30:16.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3e806f290 0x7fd3e80acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e80cd3a0 0x7fd3e80aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e815b010 0x7fd3e8153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e80734f0 con 0x7fd3e806f290 2024-08-18T22:30:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e8073370 con 0x7fd3e80cd3a0 2024-08-18T22:30:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.705+0000 7fd3ed000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e8073670 con 0x7fd3e815b010 2024-08-18T22:30:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3e5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3e806f290 0x7fd3e80acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3e5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3e806f290 0x7fd3e80acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55080/0 (socket says 172.21.15.5:55080) 2024-08-18T22:30:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3e5e00640 1 -- 172.21.15.5:0/3558259193 learned_addr learned my addr 172.21.15.5:0/3558259193 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3e5400640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e80cd3a0 0x7fd3e80aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3e6800640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e815b010 0x7fd3e8153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:16.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3e5e00640 1 -- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e815b010 msgr2=0x7fd3e8153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3e5e00640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e815b010 0x7fd3e8153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3e5e00640 1 -- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e80cd3a0 msgr2=0x7fd3e80aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3e5e00640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e80cd3a0 0x7fd3e80aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3e5e00640 1 -- 172.21.15.5:0/3558259193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e80ad610 con 0x7fd3e806f290 2024-08-18T22:30:16.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3e5e00640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3e806f290 0x7fd3e80acf30 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c3f0 tx=0x7fd3d800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:16.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3de000640 1 -- 172.21.15.5:0/3558259193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8017070 con 0x7fd3e806f290 2024-08-18T22:30:16.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3de000640 1 -- 172.21.15.5:0/3558259193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d80052d0 con 0x7fd3e806f290 2024-08-18T22:30:16.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3de000640 1 -- 172.21.15.5:0/3558259193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8003840 con 0x7fd3e806f290 2024-08-18T22:30:16.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3ed000640 1 -- 172.21.15.5:0/3558259193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e80ad8f0 con 0x7fd3e806f290 2024-08-18T22:30:16.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3ed000640 1 -- 172.21.15.5:0/3558259193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e80adeb0 con 0x7fd3e806f290 2024-08-18T22:30:16.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3ed000640 1 -- 172.21.15.5:0/3558259193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e80ce840 con 0x7fd3e806f290 2024-08-18T22:30:16.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.709+0000 7fd3de000640 1 -- 172.21.15.5:0/3558259193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3d801a070 con 0x7fd3e806f290 2024-08-18T22:30:16.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.713+0000 7fd3de000640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3c80678c0 0x7fd3c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:16.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.713+0000 7fd3de000640 1 -- 172.21.15.5:0/3558259193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5249+0+0 (secure 0 0 0) 0x7fd3d8084f00 con 0x7fd3e806f290 2024-08-18T22:30:16.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.713+0000 7fd3e5400640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3c80678c0 0x7fd3c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:16.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.713+0000 7fd3e5400640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3c80678c0 0x7fd3c8069d80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40ae000 tx=0x7fd3d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:16.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.717+0000 7fd3de000640 1 -- 172.21.15.5:0/3558259193 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd3d8005480 con 0x7fd3e806f290 2024-08-18T22:30:16.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.937+0000 7fd3ed000640 1 -- 172.21.15.5:0/3558259193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd3e815cef0 con 0x7fd3e806f290 2024-08-18T22:30:16.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.937+0000 7fd3de000640 1 -- 172.21.15.5:0/3558259193 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7fd3d8055480 con 0x7fd3e806f290 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:30:16.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:30:16.943 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.944 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:30:16.945 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:30:16.946 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.947 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.948 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:30:16.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:16.950 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:30:16.950 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:30:16.950 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:30:16.950 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:30:16.950 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:30:16.950 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:30:16.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:16.950 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:30:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:30:16.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 -- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3c80678c0 msgr2=0x7fd3c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:16.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3c80678c0 0x7fd3c8069d80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40ae000 tx=0x7fd3d4008040 comp rx=0 tx=0).stop 2024-08-18T22:30:16.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 -- 172.21.15.5:0/3558259193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3e806f290 msgr2=0x7fd3e80acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:16.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3e806f290 0x7fd3e80acf30 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c3f0 tx=0x7fd3d800c8b0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 -- 172.21.15.5:0/3558259193 shutdown_connections 2024-08-18T22:30:16.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3c80678c0 0x7fd3c8069d80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3e815b010 0x7fd3e8153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e80cd3a0 0x7fd3e80aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 --2- 172.21.15.5:0/3558259193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3e806f290 0x7fd3e80acf30 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:16.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 -- 172.21.15.5:0/3558259193 >> 172.21.15.5:0/3558259193 conn(0x7fd3e80b1c50 msgr2=0x7fd3e809dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:16.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 -- 172.21.15.5:0/3558259193 shutdown_connections 2024-08-18T22:30:16.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:16.941+0000 7fd3ed000640 1 -- 172.21.15.5:0/3558259193 wait complete. 2024-08-18T22:30:16.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:30:17.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.101+0000 7fdbd1600640 1 Processor -- start 2024-08-18T22:30:17.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.101+0000 7fdbd1600640 1 -- start start 2024-08-18T22:30:17.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbd1600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdbcc15e4b0 0x7fdbcc070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:17.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbd1600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbcc070430 con 0x7fdbcc070730 2024-08-18T22:30:17.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbd1600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbcc15eb60 con 0x7fdbcc161960 2024-08-18T22:30:17.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbd1600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdbcc15e940 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbca000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdbcc070730 0x7fdbcc15dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59358/0 (socket says 172.21.15.5:59358) 2024-08-18T22:30:17.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbca000640 1 -- 172.21.15.5:0/2313530256 learned_addr learned my addr 172.21.15.5:0/2313530256 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbcb400640 1 --2- 172.21.15.5:0/2313530256 >> v2:172.21.15.117:3300/0 conn(0x7fdbcc15e4b0 0x7fdbcc070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbc9600640 1 -- 172.21.15.5:0/2313530256 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438453939 0 0) 0x7fdbcc070430 con 0x7fdbcc070730 2024-08-18T22:30:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbc9600640 1 -- 172.21.15.5:0/2313530256 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb0003530 con 0x7fdbcc070730 2024-08-18T22:30:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbcb400640 1 -- 172.21.15.5:0/2313530256 >> v1:172.21.15.117:6789/0 conn(0x7fdbcc161960 legacy=0x7fdbcc06fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbcb400640 1 -- 172.21.15.5:0/2313530256 >> v1:172.21.15.5:6789/0 conn(0x7fdbcc070730 legacy=0x7fdbcc15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.105+0000 7fdbcb400640 1 -- 172.21.15.5:0/2313530256 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc15ee40 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbcb400640 1 --2- 172.21.15.5:0/2313530256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbcc15e4b0 0x7fdbcc070ba0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009d90 tx=0x7fdbc401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed9f0fe515208d12 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:17.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbc9600640 1 -- 172.21.15.5:0/2313530256 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40b2070 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbc9600640 1 -- 172.21.15.5:0/2313530256 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc40a5830 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbc9600640 1 -- 172.21.15.5:0/2313530256 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40a5c00 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbd1600640 1 -- 172.21.15.5:0/2313530256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbcc15e4b0 msgr2=0x7fdbcc070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbd1600640 1 --2- 172.21.15.5:0/2313530256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbcc15e4b0 0x7fdbcc070ba0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009d90 tx=0x7fdbc401c970 comp rx=0 tx=0).stop 2024-08-18T22:30:17.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbd1600640 1 -- 172.21.15.5:0/2313530256 shutdown_connections 2024-08-18T22:30:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbd1600640 1 --2- 172.21.15.5:0/2313530256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbcc15e4b0 0x7fdbcc070ba0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbd1600640 1 -- 172.21.15.5:0/2313530256 >> 172.21.15.5:0/2313530256 conn(0x7fdbcc0d2130 msgr2=0x7fdbcc0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbd1600640 1 -- 172.21.15.5:0/2313530256 shutdown_connections 2024-08-18T22:30:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbd1600640 1 -- 172.21.15.5:0/2313530256 wait complete. 2024-08-18T22:30:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbd1600640 1 Processor -- start 2024-08-18T22:30:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.109+0000 7fdbd1600640 1 -- start start 2024-08-18T22:30:17.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbd1600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbcc070730 0x7fdbcc0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:17.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbd1600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbcc15e4b0 0x7fdbcc0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:17.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbd1600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbcc161960 0x7fdbcc1fa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:17.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbd1600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc09ba30 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbd1600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc0710e0 con 0x7fdbcc070730 2024-08-18T22:30:17.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbd1600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdbcc0ccb30 con 0x7fdbcc161960 2024-08-18T22:30:17.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbca000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbcc15e4b0 0x7fdbcc0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:17.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbca000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbcc15e4b0 0x7fdbcc0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55086/0 (socket says 172.21.15.5:55086) 2024-08-18T22:30:17.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbca000640 1 -- 172.21.15.5:0/4207362362 learned_addr learned my addr 172.21.15.5:0/4207362362 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbcaa00640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbcc070730 0x7fdbcc0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbcb400640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbcc161960 0x7fdbcc1fa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbca000640 1 -- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbcc161960 msgr2=0x7fdbcc1fa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbca000640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbcc161960 0x7fdbcc1fa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbca000640 1 -- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbcc070730 msgr2=0x7fdbcc0cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbca000640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbcc070730 0x7fdbcc0cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbca000640 1 -- 172.21.15.5:0/4207362362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc15e210 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbca000640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbcc15e4b0 0x7fdbcc0cb7c0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800c420 tx=0x7fdbb800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbc2a00640 1 -- 172.21.15.5:0/4207362362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8017070 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbc2a00640 1 -- 172.21.15.5:0/4207362362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb8005cf0 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbc2a00640 1 -- 172.21.15.5:0/4207362362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80072d0 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbd1600640 1 -- 172.21.15.5:0/4207362362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbcc0b7aa0 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbd1600640 1 -- 172.21.15.5:0/4207362362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbcc0b5100 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbd1600640 1 -- 172.21.15.5:0/4207362362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbcc070ba0 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.113+0000 7fdbc2a00640 1 -- 172.21.15.5:0/4207362362 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdbb801a070 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.117+0000 7fdbc2a00640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbac0678c0 0x7fdbac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:17.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.117+0000 7fdbc2a00640 1 -- 172.21.15.5:0/4207362362 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5249+0+0 (secure 0 0 0) 0x7fdbb8084dc0 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.117+0000 7fdbcaa00640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbac0678c0 0x7fdbac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:17.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.117+0000 7fdbcaa00640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbac0678c0 0x7fdbac069d80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc000f70 tx=0x7fdbbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:17.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.121+0000 7fdbc2a00640 1 -- 172.21.15.5:0/4207362362 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdbb8055460 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 -- 172.21.15.5:0/4207362362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdbcc09bbb0 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbc2a00640 1 -- 172.21.15.5:0/4207362362 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v162) ==== 84+0+65 (secure 0 0 0) 0x7fdbb8059760 con 0x7fdbcc15e4b0 2024-08-18T22:30:17.287 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:17.287 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:30:17.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:30:17.287 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:30:17.287 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:30:17.287 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:17.287 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:30:17.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 -- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbac0678c0 msgr2=0x7fdbac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbac0678c0 0x7fdbac069d80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc000f70 tx=0x7fdbbc009040 comp rx=0 tx=0).stop 2024-08-18T22:30:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 -- 172.21.15.5:0/4207362362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbcc15e4b0 msgr2=0x7fdbcc0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbcc15e4b0 0x7fdbcc0cb7c0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800c420 tx=0x7fdbb800c8e0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 -- 172.21.15.5:0/4207362362 shutdown_connections 2024-08-18T22:30:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbac0678c0 0x7fdbac069d80 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbcc161960 0x7fdbcc1fa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbcc15e4b0 0x7fdbcc0cb7c0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 --2- 172.21.15.5:0/4207362362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbcc070730 0x7fdbcc0cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 -- 172.21.15.5:0/4207362362 >> 172.21.15.5:0/4207362362 conn(0x7fdbcc0d2130 msgr2=0x7fdbcc0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 -- 172.21.15.5:0/4207362362 shutdown_connections 2024-08-18T22:30:17.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.289+0000 7fdbd1600640 1 -- 172.21.15.5:0/4207362362 wait complete. 2024-08-18T22:30:17.308 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:30:17.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:30:17.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.453+0000 7fcc14000640 1 Processor -- start 2024-08-18T22:30:17.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.453+0000 7fcc14000640 1 -- start start 2024-08-18T22:30:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc14000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 0x7fcc0c0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc14000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc0c06f870 con 0x7fcc0c072a20 2024-08-18T22:30:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc14000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc0c0cf940 con 0x7fcc0c072e80 2024-08-18T22:30:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc14000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0c0b4c30 con 0x7fcc0c0cf020 2024-08-18T22:30:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc10c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcc0c072a20 0x7fcc0c06ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59368/0 (socket says 172.21.15.5:59368) 2024-08-18T22:30:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc10c00640 1 -- 172.21.15.5:0/1980907125 learned_addr learned my addr 172.21.15.5:0/1980907125 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc11600640 1 --2- 172.21.15.5:0/1980907125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 0x7fcc0c0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc0be00640 1 -- 172.21.15.5:0/1980907125 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341225233 0 0) 0x7fcc0c06f870 con 0x7fcc0c072a20 2024-08-18T22:30:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc0be00640 1 -- 172.21.15.5:0/1980907125 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbf4005740 con 0x7fcc0c072a20 2024-08-18T22:30:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc0be00640 1 -- 172.21.15.5:0/1980907125 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2407324480 0 0) 0x7fcc0c0cf940 con 0x7fcc0c072e80 2024-08-18T22:30:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc0be00640 1 -- 172.21.15.5:0/1980907125 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc0c06f870 con 0x7fcc0c072e80 2024-08-18T22:30:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc11600640 1 -- 172.21.15.5:0/1980907125 >> v1:172.21.15.117:6789/0 conn(0x7fcc0c072e80 legacy=0x7fcc0c06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc11600640 1 -- 172.21.15.5:0/1980907125 >> v1:172.21.15.5:6789/0 conn(0x7fcc0c072a20 legacy=0x7fcc0c06ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.457+0000 7fcc11600640 1 -- 172.21.15.5:0/1980907125 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c073330 con 0x7fcc0c0cf020 2024-08-18T22:30:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc11600640 1 --2- 172.21.15.5:0/1980907125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 0x7fcc0c0cf400 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcc000097f0 tx=0x7fcc0001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b585b29d630f016a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc0be00640 1 -- 172.21.15.5:0/1980907125 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc000b1070 con 0x7fcc0c0cf020 2024-08-18T22:30:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc0be00640 1 -- 172.21.15.5:0/1980907125 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc000ac410 con 0x7fcc0c0cf020 2024-08-18T22:30:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc0be00640 1 -- 172.21.15.5:0/1980907125 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc000ac7c0 con 0x7fcc0c0cf020 2024-08-18T22:30:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc14000640 1 -- 172.21.15.5:0/1980907125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 msgr2=0x7fcc0c0cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc14000640 1 --2- 172.21.15.5:0/1980907125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 0x7fcc0c0cf400 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcc000097f0 tx=0x7fcc0001c4b0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc14000640 1 -- 172.21.15.5:0/1980907125 shutdown_connections 2024-08-18T22:30:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc14000640 1 --2- 172.21.15.5:0/1980907125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 0x7fcc0c0cf400 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc14000640 1 -- 172.21.15.5:0/1980907125 >> 172.21.15.5:0/1980907125 conn(0x7fcc0c06b9b0 msgr2=0x7fcc0c06bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc14000640 1 -- 172.21.15.5:0/1980907125 shutdown_connections 2024-08-18T22:30:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc14000640 1 -- 172.21.15.5:0/1980907125 wait complete. 2024-08-18T22:30:17.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc14000640 1 Processor -- start 2024-08-18T22:30:17.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.461+0000 7fcc14000640 1 -- start start 2024-08-18T22:30:17.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc14000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c072a20 0x7fcc0c159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:17.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc14000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc0c072e80 0x7fcc0c149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc14000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 0x7fcc0c1591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc14000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c073e80 con 0x7fcc0c072a20 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc14000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c0b3700 con 0x7fcc0c072e80 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc14000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0c06e3e0 con 0x7fcc0c0cf020 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc11600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c072a20 0x7fcc0c159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc11600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c072a20 0x7fcc0c159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55092/0 (socket says 172.21.15.5:55092) 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc11600640 1 -- 172.21.15.5:0/3963368868 learned_addr learned my addr 172.21.15.5:0/3963368868 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc10c00640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc0c072e80 0x7fcc0c149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc12000640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 0x7fcc0c1591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc11600640 1 -- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 msgr2=0x7fcc0c1591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc11600640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 0x7fcc0c1591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc11600640 1 -- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc0c072e80 msgr2=0x7fcc0c149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:17.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc11600640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc0c072e80 0x7fcc0c149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:17.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc11600640 1 -- 172.21.15.5:0/3963368868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c1518d0 con 0x7fcc0c072a20 2024-08-18T22:30:17.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc12000640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 0x7fcc0c1591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:17.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc11600640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c072a20 0x7fcc0c159f70 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fcc00000c10 tx=0x7fcc00019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:17.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc09600640 1 -- 172.21.15.5:0/3963368868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc000b1040 con 0x7fcc0c072a20 2024-08-18T22:30:17.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc09600640 1 -- 172.21.15.5:0/3963368868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc000accc0 con 0x7fcc0c072a20 2024-08-18T22:30:17.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc09600640 1 -- 172.21.15.5:0/3963368868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc000b6460 con 0x7fcc0c072a20 2024-08-18T22:30:17.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc14000640 1 -- 172.21.15.5:0/3963368868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0c151bb0 con 0x7fcc0c072a20 2024-08-18T22:30:17.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc14000640 1 -- 172.21.15.5:0/3963368868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc0c152170 con 0x7fcc0c072a20 2024-08-18T22:30:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc14000640 1 -- 172.21.15.5:0/3963368868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc0c1558e0 con 0x7fcc0c072a20 2024-08-18T22:30:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.465+0000 7fcc09600640 1 -- 172.21.15.5:0/3963368868 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc000c0030 con 0x7fcc0c072a20 2024-08-18T22:30:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.469+0000 7fcc09600640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbec0678f0 0x7fcbec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.469+0000 7fcc09600640 1 -- 172.21.15.5:0/3963368868 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5249+0+0 (secure 0 0 0) 0x7fcc0011f300 con 0x7fcc0c072a20 2024-08-18T22:30:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.469+0000 7fcc10c00640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbec0678f0 0x7fcbec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.469+0000 7fcc10c00640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbec0678f0 0x7fcbec069db0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c15c3c0 tx=0x7fcbf8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.473+0000 7fcc09600640 1 -- 172.21.15.5:0/3963368868 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcc000c7060 con 0x7fcc0c072a20 2024-08-18T22:30:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:17.641+0000 7fcc14000640 1 -- 172.21.15.5:0/3963368868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcc0c0ad490 con 0x7fcc0c072a20 2024-08-18T22:30:18.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.537+0000 7fcc09600640 1 -- 172.21.15.5:0/3963368868 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v163) ==== 138+0+0 (secure 0 0 0) 0x7fcc000160d0 con 0x7fcc0c072a20 2024-08-18T22:30:18.537 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 -- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbec0678f0 msgr2=0x7fcbec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbec0678f0 0x7fcbec069db0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c15c3c0 tx=0x7fcbf8009040 comp rx=0 tx=0).stop 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 -- 172.21.15.5:0/3963368868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c072a20 msgr2=0x7fcc0c159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c072a20 0x7fcc0c159f70 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fcc00000c10 tx=0x7fcc00019250 comp rx=0 tx=0).stop 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 -- 172.21.15.5:0/3963368868 shutdown_connections 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcbec0678f0 0x7fcbec069db0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc0c0cf020 0x7fcc0c1591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc0c072e80 0x7fcc0c149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 --2- 172.21.15.5:0/3963368868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c072a20 0x7fcc0c159f70 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 -- 172.21.15.5:0/3963368868 >> 172.21.15.5:0/3963368868 conn(0x7fcc0c06b9b0 msgr2=0x7fcc0c154770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 -- 172.21.15.5:0/3963368868 shutdown_connections 2024-08-18T22:30:18.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.541+0000 7fcc14000640 1 -- 172.21.15.5:0/3963368868 wait complete. 2024-08-18T22:30:18.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:30:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.721+0000 7f9305000640 1 Processor -- start 2024-08-18T22:30:18.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.721+0000 7f9305000640 1 -- start start 2024-08-18T22:30:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f9305000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f930015b0c0 0x7f930006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f9305000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000cf290 0x7f93000b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f9305000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93000b31f0 con 0x7f93000b40c0 2024-08-18T22:30:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f9305000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f93000b4a70 con 0x7f930015b0c0 2024-08-18T22:30:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f9305000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f93000b3d70 con 0x7f93000cf290 2024-08-18T22:30:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f92fde00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f930015b0c0 0x7f930006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f92fe800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000cf290 0x7f93000b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f92fde00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f930015b0c0 0x7f930006db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:49558/0 (socket says 172.21.15.5:49558) 2024-08-18T22:30:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f92fde00640 1 -- 172.21.15.5:0/2145536405 learned_addr learned my addr 172.21.15.5:0/2145536405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f92fde00640 1 -- 172.21.15.5:0/2145536405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000cf290 msgr2=0x7f93000b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f92fde00640 1 --2- 172.21.15.5:0/2145536405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000cf290 0x7f93000b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f92fde00640 1 -- 172.21.15.5:0/2145536405 >> v1:172.21.15.117:6789/0 conn(0x7f93000b40c0 legacy=0x7f9300072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f92fde00640 1 -- 172.21.15.5:0/2145536405 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93000b34d0 con 0x7f930015b0c0 2024-08-18T22:30:18.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.725+0000 7f92fe800640 1 --2- 172.21.15.5:0/2145536405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000cf290 0x7f93000b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f92fde00640 1 --2- 172.21.15.5:0/2145536405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f930015b0c0 0x7f930006db80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f92f000bb10 tx=0x7f92f001eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=894b518dba8353c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f92fd400640 1 -- 172.21.15.5:0/2145536405 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f00b4070 con 0x7f930015b0c0 2024-08-18T22:30:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f92fd400640 1 -- 172.21.15.5:0/2145536405 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f00a7bb0 con 0x7f930015b0c0 2024-08-18T22:30:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f92fd400640 1 -- 172.21.15.5:0/2145536405 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f00af440 con 0x7f930015b0c0 2024-08-18T22:30:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f9305000640 1 -- 172.21.15.5:0/2145536405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f930015b0c0 msgr2=0x7f930006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f9305000640 1 --2- 172.21.15.5:0/2145536405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f930015b0c0 0x7f930006db80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f92f000bb10 tx=0x7f92f001eae0 comp rx=0 tx=0).stop 2024-08-18T22:30:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f9305000640 1 -- 172.21.15.5:0/2145536405 shutdown_connections 2024-08-18T22:30:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f9305000640 1 --2- 172.21.15.5:0/2145536405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000cf290 0x7f93000b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f9305000640 1 --2- 172.21.15.5:0/2145536405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f930015b0c0 0x7f930006db80 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f9305000640 1 -- 172.21.15.5:0/2145536405 >> 172.21.15.5:0/2145536405 conn(0x7f93000b1dc0 msgr2=0x7f93000b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f9305000640 1 -- 172.21.15.5:0/2145536405 shutdown_connections 2024-08-18T22:30:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f9305000640 1 -- 172.21.15.5:0/2145536405 wait complete. 2024-08-18T22:30:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f9305000640 1 Processor -- start 2024-08-18T22:30:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.729+0000 7f9305000640 1 -- start start 2024-08-18T22:30:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f9305000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000b40c0 0x7f930013fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f9305000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93000cf290 0x7f9300159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f9305000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930015b0c0 0x7f930015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f9305000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f930015b620 con 0x7f930015b0c0 2024-08-18T22:30:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f9305000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f930015b4a0 con 0x7f93000cf290 2024-08-18T22:30:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f9305000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f930006f670 con 0x7f93000b40c0 2024-08-18T22:30:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92fe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930015b0c0 0x7f930015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92f5400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93000cf290 0x7f9300159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92fe800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930015b0c0 0x7f930015a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55100/0 (socket says 172.21.15.5:55100) 2024-08-18T22:30:18.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92fe800640 1 -- 172.21.15.5:0/2822614572 learned_addr learned my addr 172.21.15.5:0/2822614572 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:18.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92fde00640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000b40c0 0x7f930013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:18.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92f5400640 1 -- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000b40c0 msgr2=0x7f930013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:18.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92f5400640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000b40c0 0x7f930013fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:18.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92f5400640 1 -- 172.21.15.5:0/2822614572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930015b0c0 msgr2=0x7f930015a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:18.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92f5400640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930015b0c0 0x7f930015a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:18.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92f5400640 1 -- 172.21.15.5:0/2822614572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930013f110 con 0x7f93000cf290 2024-08-18T22:30:18.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92fde00640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000b40c0 0x7f930013fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92f5400640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93000cf290 0x7f9300159bb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f92e8000f70 tx=0x7f92e800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92f6a00640 1 -- 172.21.15.5:0/2822614572 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8017070 con 0x7f93000cf290 2024-08-18T22:30:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92f6a00640 1 -- 172.21.15.5:0/2822614572 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e80052d0 con 0x7f93000cf290 2024-08-18T22:30:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f92f6a00640 1 -- 172.21.15.5:0/2822614572 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8003840 con 0x7f93000cf290 2024-08-18T22:30:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f9305000640 1 -- 172.21.15.5:0/2822614572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930013e070 con 0x7f93000cf290 2024-08-18T22:30:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f9305000640 1 -- 172.21.15.5:0/2822614572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930013e910 con 0x7f93000cf290 2024-08-18T22:30:18.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.733+0000 7f9305000640 1 -- 172.21.15.5:0/2822614572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93000b4530 con 0x7f93000cf290 2024-08-18T22:30:18.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.737+0000 7f92f6a00640 1 -- 172.21.15.5:0/2822614572 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92e801a070 con 0x7f93000cf290 2024-08-18T22:30:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.737+0000 7f92f6a00640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92dc0678c0 0x7f92dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.737+0000 7f92f6a00640 1 -- 172.21.15.5:0/2822614572 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5619+0+0 (secure 0 0 0) 0x7f92e8084f70 con 0x7f93000cf290 2024-08-18T22:30:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.737+0000 7f92fde00640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92dc0678c0 0x7f92dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.737+0000 7f92fde00640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92dc0678c0 0x7f92dc069d80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f92f00b1000 tx=0x7f92f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:18.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.741+0000 7f92f6a00640 1 -- 172.21.15.5:0/2822614572 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f92e8005480 con 0x7f93000cf290 2024-08-18T22:30:18.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:18.905+0000 7f9305000640 1 -- 172.21.15.5:0/2822614572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f93000cd750 con 0x7f93000cf290 2024-08-18T22:30:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.549+0000 7f92f6a00640 1 -- 172.21.15.5:0/2822614572 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v164) ==== 170+0+0 (secure 0 0 0) 0x7f92e8055520 con 0x7f93000cf290 2024-08-18T22:30:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:30:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.565+0000 7f9305000640 1 -- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92dc0678c0 msgr2=0x7f92dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.565+0000 7f9305000640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92dc0678c0 0x7f92dc069d80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f92f00b1000 tx=0x7f92f0008040 comp rx=0 tx=0).stop 2024-08-18T22:30:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.565+0000 7f9305000640 1 -- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93000cf290 msgr2=0x7f9300159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:19.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.565+0000 7f9305000640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93000cf290 0x7f9300159bb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f92e8000f70 tx=0x7f92e800c820 comp rx=0 tx=0).stop 2024-08-18T22:30:19.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.569+0000 7f9305000640 1 -- 172.21.15.5:0/2822614572 shutdown_connections 2024-08-18T22:30:19.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.569+0000 7f9305000640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f92dc0678c0 0x7f92dc069d80 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:19.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.569+0000 7f9305000640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f930015b0c0 0x7f930015a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:19.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.569+0000 7f9305000640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93000cf290 0x7f9300159bb0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:19.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.569+0000 7f9305000640 1 --2- 172.21.15.5:0/2822614572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93000b40c0 0x7f930013fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:19.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.569+0000 7f9305000640 1 -- 172.21.15.5:0/2822614572 >> 172.21.15.5:0/2822614572 conn(0x7f93000b1dc0 msgr2=0x7f930006e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:19.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.569+0000 7f9305000640 1 -- 172.21.15.5:0/2822614572 shutdown_connections 2024-08-18T22:30:19.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.569+0000 7f9305000640 1 -- 172.21.15.5:0/2822614572 wait complete. 2024-08-18T22:30:19.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:30:19.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1980e00640 1 Processor -- start 2024-08-18T22:30:19.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1980e00640 1 -- start start 2024-08-18T22:30:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1980e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f197c15fb80 0x7f197c0d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1980e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f197c0b5ad0 0x7f197c06fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1980e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f197c071550 0x7f197c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1980e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f197c0d1eb0 con 0x7f197c0b5ad0 2024-08-18T22:30:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1980e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f197c0d30b0 con 0x7f197c071550 2024-08-18T22:30:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1980e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f197c0d1bd0 con 0x7f197c15fb80 2024-08-18T22:30:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1973e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f197c0b5ad0 0x7f197c06fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1973e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f197c0b5ad0 0x7f197c06fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55106/0 (socket says 172.21.15.5:55106) 2024-08-18T22:30:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1973e00640 1 -- 172.21.15.5:0/491520658 learned_addr learned my addr 172.21.15.5:0/491520658 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1979e00640 1 --2- 172.21.15.5:0/491520658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f197c15fb80 0x7f197c0d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:19.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f197a800640 1 --2- 172.21.15.5:0/491520658 >> v2:172.21.15.117:3300/0 conn(0x7f197c071550 0x7f197c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1973e00640 1 -- 172.21.15.5:0/491520658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f197c15fb80 msgr2=0x7f197c0d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1973e00640 1 --2- 172.21.15.5:0/491520658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f197c15fb80 0x7f197c0d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1973e00640 1 -- 172.21.15.5:0/491520658 >> v2:172.21.15.117:3300/0 conn(0x7f197c071550 msgr2=0x7f197c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1973e00640 1 --2- 172.21.15.5:0/491520658 >> v2:172.21.15.117:3300/0 conn(0x7f197c071550 0x7f197c09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:19.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.745+0000 7f1973e00640 1 -- 172.21.15.5:0/491520658 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c0d2dd0 con 0x7f197c0b5ad0 2024-08-18T22:30:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1973e00640 1 --2- 172.21.15.5:0/491520658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c0b5ad0 0x7f197c06fad0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f197c075dd0 tx=0x7f196401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e63e5c5e7772b3f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1979400640 1 -- 172.21.15.5:0/491520658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640b0070 con 0x7f197c0b5ad0 2024-08-18T22:30:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1979400640 1 -- 172.21.15.5:0/491520658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19640a4e50 con 0x7f197c0b5ad0 2024-08-18T22:30:19.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1979400640 1 -- 172.21.15.5:0/491520658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640ab820 con 0x7f197c0b5ad0 2024-08-18T22:30:19.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1980e00640 1 -- 172.21.15.5:0/491520658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c0b5ad0 msgr2=0x7f197c06fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:19.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1980e00640 1 --2- 172.21.15.5:0/491520658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c0b5ad0 0x7f197c06fad0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f197c075dd0 tx=0x7f196401c400 comp rx=0 tx=0).stop 2024-08-18T22:30:19.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1980e00640 1 -- 172.21.15.5:0/491520658 shutdown_connections 2024-08-18T22:30:19.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1980e00640 1 --2- 172.21.15.5:0/491520658 >> v2:172.21.15.117:3300/0 conn(0x7f197c071550 0x7f197c09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:19.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1980e00640 1 --2- 172.21.15.5:0/491520658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c0b5ad0 0x7f197c06fad0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:19.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1980e00640 1 --2- 172.21.15.5:0/491520658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f197c15fb80 0x7f197c0d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:19.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1980e00640 1 -- 172.21.15.5:0/491520658 >> 172.21.15.5:0/491520658 conn(0x7f197c0d2180 msgr2=0x7f197c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:19.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1980e00640 1 -- 172.21.15.5:0/491520658 shutdown_connections 2024-08-18T22:30:19.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1980e00640 1 -- 172.21.15.5:0/491520658 wait complete. 2024-08-18T22:30:19.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1980e00640 1 Processor -- start 2024-08-18T22:30:19.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.749+0000 7f1980e00640 1 -- start start 2024-08-18T22:30:19.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1980e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c071550 0x7f197c1f7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:19.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1980e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f197c0b5ad0 0x7f197c0b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:19.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1980e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f197c15fb80 0x7f197c0b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1980e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f197c0d0890 con 0x7f197c071550 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1980e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f197c09b390 con 0x7f197c0b5ad0 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1980e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f197c0d0a10 con 0x7f197c15fb80 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1979e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c071550 0x7f197c1f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1979e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c071550 0x7f197c1f7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55110/0 (socket says 172.21.15.5:55110) 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1979e00640 1 -- 172.21.15.5:0/1379530810 learned_addr learned my addr 172.21.15.5:0/1379530810 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f197a800640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f197c15fb80 0x7f197c0b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1973e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f197c0b5ad0 0x7f197c0b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1979e00640 1 -- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f197c15fb80 msgr2=0x7f197c0b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1979e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f197c15fb80 0x7f197c0b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1979e00640 1 -- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f197c0b5ad0 msgr2=0x7f197c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1979e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f197c0b5ad0 0x7f197c0b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:19.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1979e00640 1 -- 172.21.15.5:0/1379530810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c15f400 con 0x7f197c071550 2024-08-18T22:30:19.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1973e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f197c0b5ad0 0x7f197c0b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:19.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1979e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c071550 0x7f197c1f7540 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f196c00e8a0 tx=0x7f196c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:19.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1972000640 1 -- 172.21.15.5:0/1379530810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c017070 con 0x7f197c071550 2024-08-18T22:30:19.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1972000640 1 -- 172.21.15.5:0/1379530810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196c00c940 con 0x7f197c071550 2024-08-18T22:30:19.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1972000640 1 -- 172.21.15.5:0/1379530810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c00ccf0 con 0x7f197c071550 2024-08-18T22:30:19.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1980e00640 1 -- 172.21.15.5:0/1379530810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197c06cf30 con 0x7f197c071550 2024-08-18T22:30:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1980e00640 1 -- 172.21.15.5:0/1379530810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f197c06d4f0 con 0x7f197c071550 2024-08-18T22:30:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.753+0000 7f1980e00640 1 -- 172.21.15.5:0/1379530810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f197c09aa40 con 0x7f197c071550 2024-08-18T22:30:19.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.757+0000 7f1972000640 1 -- 172.21.15.5:0/1379530810 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f196c01a070 con 0x7f197c071550 2024-08-18T22:30:19.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.757+0000 7f1972000640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19580678c0 0x7f1958069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:19.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.757+0000 7f1972000640 1 -- 172.21.15.5:0/1379530810 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 6001+0+0 (secure 0 0 0) 0x7f196c086440 con 0x7f197c071550 2024-08-18T22:30:19.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.757+0000 7f1973e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19580678c0 0x7f1958069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:19.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.757+0000 7f1973e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19580678c0 0x7f1958069d80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f19640ad000 tx=0x7f1964008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:19.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.761+0000 7f1972000640 1 -- 172.21.15.5:0/1379530810 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f196c0567e0 con 0x7f197c071550 2024-08-18T22:30:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:19.961+0000 7f1980e00640 1 -- 172.21.15.5:0/1379530810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f197c0b1dc0 con 0x7f197c071550 2024-08-18T22:30:20.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.573+0000 7f1972000640 1 -- 172.21.15.5:0/1379530810 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v122) ==== 174+0+0 (secure 0 0 0) 0x7f196c05aae0 con 0x7f197c071550 2024-08-18T22:30:20.578 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 23 and data pool 24 2024-08-18T22:30:20.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.593+0000 7f1980e00640 1 -- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19580678c0 msgr2=0x7f1958069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:20.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.593+0000 7f1980e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19580678c0 0x7f1958069d80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f19640ad000 tx=0x7f1964008040 comp rx=0 tx=0).stop 2024-08-18T22:30:20.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.593+0000 7f1980e00640 1 -- 172.21.15.5:0/1379530810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c071550 msgr2=0x7f197c1f7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:20.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.593+0000 7f1980e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c071550 0x7f197c1f7540 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f196c00e8a0 tx=0x7f196c00eca0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.597+0000 7f1980e00640 1 -- 172.21.15.5:0/1379530810 shutdown_connections 2024-08-18T22:30:20.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.597+0000 7f1980e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19580678c0 0x7f1958069d80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.597+0000 7f1980e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f197c15fb80 0x7f197c0b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.597+0000 7f1980e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f197c0b5ad0 0x7f197c0b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.597+0000 7f1980e00640 1 --2- 172.21.15.5:0/1379530810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c071550 0x7f197c1f7540 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.597+0000 7f1980e00640 1 -- 172.21.15.5:0/1379530810 >> 172.21.15.5:0/1379530810 conn(0x7f197c0d2180 msgr2=0x7f197c0d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:20.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.601+0000 7f1980e00640 1 -- 172.21.15.5:0/1379530810 shutdown_connections 2024-08-18T22:30:20.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.601+0000 7f1980e00640 1 -- 172.21.15.5:0/1379530810 wait complete. 2024-08-18T22:30:20.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:30:20.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.769+0000 7f8883600640 1 Processor -- start 2024-08-18T22:30:20.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.769+0000 7f8883600640 1 -- start start 2024-08-18T22:30:20.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.769+0000 7f8883600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 0x7f887c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:20.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.769+0000 7f8883600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f887c0b5e60 0x7f887c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:20.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.769+0000 7f8883600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887c0b6310 con 0x7f887c15e140 2024-08-18T22:30:20.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.769+0000 7f8883600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f887c06e560 con 0x7f887c0b5e60 2024-08-18T22:30:20.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.769+0000 7f8883600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f887c0b65d0 con 0x7f887c0afe50 2024-08-18T22:30:20.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.769+0000 7f8880c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f887c15e140 0x7f887c0af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59378/0 (socket says 172.21.15.5:59378) 2024-08-18T22:30:20.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.769+0000 7f8880c00640 1 -- 172.21.15.5:0/2575453593 learned_addr learned my addr 172.21.15.5:0/2575453593 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:20.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.769+0000 7f887be00640 1 --2- 172.21.15.5:0/2575453593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 0x7f887c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:20.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.769+0000 7f8881600640 1 --2- 172.21.15.5:0/2575453593 >> v2:172.21.15.117:3300/0 conn(0x7f887c0b5e60 0x7f887c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:20.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f887b400640 1 -- 172.21.15.5:0/2575453593 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286470774 0 0) 0x7f887c0b6310 con 0x7f887c15e140 2024-08-18T22:30:20.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f887b400640 1 -- 172.21.15.5:0/2575453593 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8860003530 con 0x7f887c15e140 2024-08-18T22:30:20.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f887be00640 1 -- 172.21.15.5:0/2575453593 >> v2:172.21.15.117:3300/0 conn(0x7f887c0b5e60 msgr2=0x7f887c06efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:20.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f887be00640 1 --2- 172.21.15.5:0/2575453593 >> v2:172.21.15.117:3300/0 conn(0x7f887c0b5e60 0x7f887c06efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f887be00640 1 -- 172.21.15.5:0/2575453593 >> v1:172.21.15.5:6789/0 conn(0x7f887c15e140 legacy=0x7f887c0af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:20.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f887be00640 1 -- 172.21.15.5:0/2575453593 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887c0b68b0 con 0x7f887c0afe50 2024-08-18T22:30:20.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f8881600640 1 --2- 172.21.15.5:0/2575453593 >> v2:172.21.15.117:3300/0 conn(0x7f887c0b5e60 0x7f887c06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:20.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f887be00640 1 --2- 172.21.15.5:0/2575453593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 0x7f887c0b4e40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f887c06e6e0 tx=0x7f886801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fa1e24ebb9a9c68 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f887b400640 1 -- 172.21.15.5:0/2575453593 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88680ab610 con 0x7f887c0afe50 2024-08-18T22:30:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f887b400640 1 -- 172.21.15.5:0/2575453593 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88680b0070 con 0x7f887c0afe50 2024-08-18T22:30:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f887b400640 1 -- 172.21.15.5:0/2575453593 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88680ab9d0 con 0x7f887c0afe50 2024-08-18T22:30:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f8883600640 1 -- 172.21.15.5:0/2575453593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 msgr2=0x7f887c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.773+0000 7f8883600640 1 --2- 172.21.15.5:0/2575453593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 0x7f887c0b4e40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f887c06e6e0 tx=0x7f886801c410 comp rx=0 tx=0).stop 2024-08-18T22:30:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 -- 172.21.15.5:0/2575453593 shutdown_connections 2024-08-18T22:30:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 --2- 172.21.15.5:0/2575453593 >> v2:172.21.15.117:3300/0 conn(0x7f887c0b5e60 0x7f887c06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 --2- 172.21.15.5:0/2575453593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 0x7f887c0b4e40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 -- 172.21.15.5:0/2575453593 >> 172.21.15.5:0/2575453593 conn(0x7f887c06b9b0 msgr2=0x7f887c06bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:20.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 -- 172.21.15.5:0/2575453593 shutdown_connections 2024-08-18T22:30:20.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 -- 172.21.15.5:0/2575453593 wait complete. 2024-08-18T22:30:20.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 Processor -- start 2024-08-18T22:30:20.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 -- start start 2024-08-18T22:30:20.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 0x7f887c0cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:20.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f887c0b5e60 0x7f887c1fa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:20.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887c15e140 0x7f887c1fa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:20.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f887c06fe80 con 0x7f887c15e140 2024-08-18T22:30:20.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f887c06fd00 con 0x7f887c0b5e60 2024-08-18T22:30:20.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8883600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f887c070000 con 0x7f887c0afe50 2024-08-18T22:30:20.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8880c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 0x7f887c0cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:20.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8881600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887c15e140 0x7f887c1fa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:20.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f887be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f887c0b5e60 0x7f887c1fa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:20.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8881600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887c15e140 0x7f887c1fa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55116/0 (socket says 172.21.15.5:55116) 2024-08-18T22:30:20.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8881600640 1 -- 172.21.15.5:0/1295020991 learned_addr learned my addr 172.21.15.5:0/1295020991 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:20.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8880c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 0x7f887c0cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:36472/0 (socket says 172.21.15.5:36472) 2024-08-18T22:30:20.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8881600640 1 -- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 msgr2=0x7f887c0cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:20.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8881600640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 0x7f887c0cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8881600640 1 -- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f887c0b5e60 msgr2=0x7f887c1fa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:20.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8881600640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f887c0b5e60 0x7f887c1fa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8881600640 1 -- 172.21.15.5:0/1295020991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887c14ef30 con 0x7f887c15e140 2024-08-18T22:30:20.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f887be00640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f887c0b5e60 0x7f887c1fa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:20.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.777+0000 7f8881600640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887c15e140 0x7f887c1fa7a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f8874009e60 tx=0x7f887400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:20.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.781+0000 7f8878c00640 1 -- 172.21.15.5:0/1295020991 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874018030 con 0x7f887c15e140 2024-08-18T22:30:20.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.781+0000 7f8878c00640 1 -- 172.21.15.5:0/1295020991 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887400cdf0 con 0x7f887c15e140 2024-08-18T22:30:20.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.781+0000 7f8883600640 1 -- 172.21.15.5:0/1295020991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887c14f210 con 0x7f887c15e140 2024-08-18T22:30:20.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.781+0000 7f8878c00640 1 -- 172.21.15.5:0/1295020991 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874003bc0 con 0x7f887c15e140 2024-08-18T22:30:20.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.781+0000 7f8883600640 1 -- 172.21.15.5:0/1295020991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f887c14f7d0 con 0x7f887c15e140 2024-08-18T22:30:20.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.781+0000 7f8883600640 1 -- 172.21.15.5:0/1295020991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f887c0b4e40 con 0x7f887c15e140 2024-08-18T22:30:20.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.781+0000 7f8878c00640 1 -- 172.21.15.5:0/1295020991 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f887401b070 con 0x7f887c15e140 2024-08-18T22:30:20.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.781+0000 7f8878c00640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f885c0678c0 0x7f885c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:20.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.781+0000 7f8878c00640 1 -- 172.21.15.5:0/1295020991 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f88740865f0 con 0x7f887c15e140 2024-08-18T22:30:20.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.781+0000 7f8880c00640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f885c0678c0 0x7f885c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:20.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.785+0000 7f8880c00640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f885c0678c0 0x7f885c069d80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f886c007fd0 tx=0x7f886c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.785+0000 7f8878c00640 1 -- 172.21.15.5:0/1295020991 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8874010040 con 0x7f887c15e140 2024-08-18T22:30:20.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.953+0000 7f8883600640 1 -- 172.21.15.5:0/1295020991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f887c0d06c0 con 0x7f887c15e140 2024-08-18T22:30:20.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.953+0000 7f8878c00640 1 -- 172.21.15.5:0/1295020991 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16825 (secure 0 0 0) 0x7f88740569e0 con 0x7f887c15e140 2024-08-18T22:30:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:20.953 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":165,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:30:19.963646+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:30:17.689677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-08-18T22:30:18.956043+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:30:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 -- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f885c0678c0 msgr2=0x7f885c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f885c0678c0 0x7f885c069d80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f886c007fd0 tx=0x7f886c009040 comp rx=0 tx=0).stop 2024-08-18T22:30:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 -- 172.21.15.5:0/1295020991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887c15e140 msgr2=0x7f887c1fa7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887c15e140 0x7f887c1fa7a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f8874009e60 tx=0x7f887400c490 comp rx=0 tx=0).stop 2024-08-18T22:30:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 -- 172.21.15.5:0/1295020991 shutdown_connections 2024-08-18T22:30:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f885c0678c0 0x7f885c069d80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f887c15e140 0x7f887c1fa7a0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f887c0b5e60 0x7f887c1fa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 --2- 172.21.15.5:0/1295020991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f887c0afe50 0x7f887c0cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 -- 172.21.15.5:0/1295020991 >> 172.21.15.5:0/1295020991 conn(0x7f887c06b9b0 msgr2=0x7f887c0b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 -- 172.21.15.5:0/1295020991 shutdown_connections 2024-08-18T22:30:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:20.957+0000 7f8883600640 1 -- 172.21.15.5:0/1295020991 wait complete. 2024-08-18T22:30:20.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:30:21.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f38a3600640 1 Processor -- start 2024-08-18T22:30:21.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f38a3600640 1 -- start start 2024-08-18T22:30:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f38a3600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f389c0cb390 0x7f389c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f38a3600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389c06da70 0x7f389c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f38a3600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f389c073c80 con 0x7f389c15bed0 2024-08-18T22:30:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f38a3600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f389c06e420 con 0x7f389c0cb390 2024-08-18T22:30:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f38a3600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f389c0ca5d0 con 0x7f389c06da70 2024-08-18T22:30:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f3893e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f389c0cb390 0x7f389c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f38a0c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f389c15bed0 0x7f389c071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59386/0 (socket says 172.21.15.5:59386) 2024-08-18T22:30:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f3893e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f389c0cb390 0x7f389c0735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55126/0 (socket says 172.21.15.5:55126) 2024-08-18T22:30:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f38a0c00640 1 -- 172.21.15.5:0/2769762350 learned_addr learned my addr 172.21.15.5:0/2769762350 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f38a1600640 1 --2- 172.21.15.5:0/2769762350 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389c06da70 0x7f389c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f3893e00640 1 -- 172.21.15.5:0/2769762350 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389c06da70 msgr2=0x7f389c06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f3893e00640 1 --2- 172.21.15.5:0/2769762350 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389c06da70 0x7f389c06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f3893e00640 1 -- 172.21.15.5:0/2769762350 >> v1:172.21.15.5:6789/0 conn(0x7f389c15bed0 legacy=0x7f389c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.117+0000 7f3893e00640 1 -- 172.21.15.5:0/2769762350 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c0ca8b0 con 0x7f389c0cb390 2024-08-18T22:30:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f3893e00640 1 --2- 172.21.15.5:0/2769762350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c0cb390 0x7f389c0735a0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f38840097c0 tx=0x7f388401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abc66f1c3240571 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f389be00640 1 -- 172.21.15.5:0/2769762350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38840a7070 con 0x7f389c0cb390 2024-08-18T22:30:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f389be00640 1 -- 172.21.15.5:0/2769762350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38840b0070 con 0x7f389c0cb390 2024-08-18T22:30:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f389be00640 1 -- 172.21.15.5:0/2769762350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38840ab890 con 0x7f389c0cb390 2024-08-18T22:30:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f38a3600640 1 -- 172.21.15.5:0/2769762350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c0cb390 msgr2=0x7f389c0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f38a3600640 1 --2- 172.21.15.5:0/2769762350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c0cb390 0x7f389c0735a0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f38840097c0 tx=0x7f388401c470 comp rx=0 tx=0).stop 2024-08-18T22:30:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f38a3600640 1 -- 172.21.15.5:0/2769762350 shutdown_connections 2024-08-18T22:30:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f38a3600640 1 --2- 172.21.15.5:0/2769762350 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389c06da70 0x7f389c06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f38a3600640 1 --2- 172.21.15.5:0/2769762350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c0cb390 0x7f389c0735a0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f38a3600640 1 -- 172.21.15.5:0/2769762350 >> 172.21.15.5:0/2769762350 conn(0x7f389c0b1c50 msgr2=0x7f389c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f38a3600640 1 -- 172.21.15.5:0/2769762350 shutdown_connections 2024-08-18T22:30:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.121+0000 7f38a3600640 1 -- 172.21.15.5:0/2769762350 wait complete. 2024-08-18T22:30:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a3600640 1 Processor -- start 2024-08-18T22:30:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a3600640 1 -- start start 2024-08-18T22:30:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a3600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06da70 0x7f389c156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a3600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389c0cb390 0x7f389c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a3600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c15bed0 0x7f389c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a3600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f389c168520 con 0x7f389c06da70 2024-08-18T22:30:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a3600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f389c1683a0 con 0x7f389c15bed0 2024-08-18T22:30:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a3600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f389c1686a0 con 0x7f389c0cb390 2024-08-18T22:30:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a0c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06da70 0x7f389c156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a0c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06da70 0x7f389c156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55134/0 (socket says 172.21.15.5:55134) 2024-08-18T22:30:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a0c00640 1 -- 172.21.15.5:0/1735507219 learned_addr learned my addr 172.21.15.5:0/1735507219 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f3893e00640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389c0cb390 0x7f389c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a1600640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c15bed0 0x7f389c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a0c00640 1 -- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389c0cb390 msgr2=0x7f389c152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a0c00640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389c0cb390 0x7f389c152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a0c00640 1 -- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c15bed0 msgr2=0x7f389c1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a0c00640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c15bed0 0x7f389c1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a0c00640 1 -- 172.21.15.5:0/1735507219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c0b3db0 con 0x7f389c06da70 2024-08-18T22:30:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a1600640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c15bed0 0x7f389c1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a0c00640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06da70 0x7f389c156f40 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f388c00c420 tx=0x7f388c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f3899600640 1 -- 172.21.15.5:0/1735507219 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c017070 con 0x7f389c06da70 2024-08-18T22:30:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f3899600640 1 -- 172.21.15.5:0/1735507219 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c005cf0 con 0x7f389c06da70 2024-08-18T22:30:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f3899600640 1 -- 172.21.15.5:0/1735507219 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c0072f0 con 0x7f389c06da70 2024-08-18T22:30:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a3600640 1 -- 172.21.15.5:0/1735507219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389c0b4050 con 0x7f389c06da70 2024-08-18T22:30:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a3600640 1 -- 172.21.15.5:0/1735507219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389c0b4610 con 0x7f389c06da70 2024-08-18T22:30:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.125+0000 7f38a3600640 1 -- 172.21.15.5:0/1735507219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f389c06dee0 con 0x7f389c06da70 2024-08-18T22:30:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.129+0000 7f3899600640 1 -- 172.21.15.5:0/1735507219 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f388c01a070 con 0x7f389c06da70 2024-08-18T22:30:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.129+0000 7f3899600640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678f0 0x7f3878069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.129+0000 7f3899600640 1 -- 172.21.15.5:0/1735507219 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f388c0851c0 con 0x7f389c06da70 2024-08-18T22:30:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.129+0000 7f3893e00640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678f0 0x7f3878069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.129+0000 7f3893e00640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678f0 0x7f3878069db0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f38840af000 tx=0x7f38840a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:21.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.133+0000 7f3899600640 1 -- 172.21.15.5:0/1735507219 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f388c055480 con 0x7f389c06da70 2024-08-18T22:30:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.297+0000 7f38a3600640 1 -- 172.21.15.5:0/1735507219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f389c0b2140 con 0x7f389c06da70 2024-08-18T22:30:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f3899600640 1 -- 172.21.15.5:0/1735507219 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16825 (secure 0 0 0) 0x7f388c07ce20 con 0x7f389c06da70 2024-08-18T22:30:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:21.298 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":165,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:30:19.963646+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:30:17.689677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-08-18T22:30:18.956043+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:30:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 -- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678f0 msgr2=0x7f3878069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678f0 0x7f3878069db0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f38840af000 tx=0x7f38840a7000 comp rx=0 tx=0).stop 2024-08-18T22:30:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 -- 172.21.15.5:0/1735507219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06da70 msgr2=0x7f389c156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06da70 0x7f389c156f40 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f388c00c420 tx=0x7f388c00c8e0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 -- 172.21.15.5:0/1735507219 shutdown_connections 2024-08-18T22:30:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38780678f0 0x7f3878069db0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389c15bed0 0x7f389c1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389c0cb390 0x7f389c152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 --2- 172.21.15.5:0/1735507219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f389c06da70 0x7f389c156f40 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 -- 172.21.15.5:0/1735507219 >> 172.21.15.5:0/1735507219 conn(0x7f389c0b1c50 msgr2=0x7f389c0cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 -- 172.21.15.5:0/1735507219 shutdown_connections 2024-08-18T22:30:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.301+0000 7f38a3600640 1 -- 172.21.15.5:0/1735507219 wait complete. 2024-08-18T22:30:21.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:30:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.465+0000 7fda94a00640 1 Processor -- start 2024-08-18T22:30:21.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.465+0000 7fda94a00640 1 -- start start 2024-08-18T22:30:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.465+0000 7fda94a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda9015fb80 0x7fda900d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.465+0000 7fda94a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda900b5ad0 0x7fda9006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.465+0000 7fda94a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda900d30b0 con 0x7fda90071550 2024-08-18T22:30:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.465+0000 7fda94a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fda900d1eb0 con 0x7fda9015fb80 2024-08-18T22:30:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.465+0000 7fda94a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fda900d1bd0 con 0x7fda900b5ad0 2024-08-18T22:30:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.465+0000 7fda8de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda9015fb80 0x7fda900d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.465+0000 7fda8de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda9015fb80 0x7fda900d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55138/0 (socket says 172.21.15.5:55138) 2024-08-18T22:30:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.465+0000 7fda8de00640 1 -- 172.21.15.5:0/2328399382 learned_addr learned my addr 172.21.15.5:0/2328399382 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.465+0000 7fda85400640 1 --2- 172.21.15.5:0/2328399382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda900b5ad0 0x7fda9006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda8de00640 1 -- 172.21.15.5:0/2328399382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda900b5ad0 msgr2=0x7fda9006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda8de00640 1 --2- 172.21.15.5:0/2328399382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda900b5ad0 0x7fda9006fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda8de00640 1 -- 172.21.15.5:0/2328399382 >> v1:172.21.15.117:6789/0 conn(0x7fda90071550 legacy=0x7fda9009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda8de00640 1 -- 172.21.15.5:0/2328399382 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda900d2dd0 con 0x7fda9015fb80 2024-08-18T22:30:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda8de00640 1 --2- 172.21.15.5:0/2328399382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda9015fb80 0x7fda900d15e0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fda80009870 tx=0x7fda8001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4f33fef485b57 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda8d400640 1 -- 172.21.15.5:0/2328399382 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda800b0070 con 0x7fda9015fb80 2024-08-18T22:30:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda8d400640 1 -- 172.21.15.5:0/2328399382 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda800ab600 con 0x7fda9015fb80 2024-08-18T22:30:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda8d400640 1 -- 172.21.15.5:0/2328399382 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda800ab9d0 con 0x7fda9015fb80 2024-08-18T22:30:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda94a00640 1 -- 172.21.15.5:0/2328399382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda9015fb80 msgr2=0x7fda900d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda94a00640 1 --2- 172.21.15.5:0/2328399382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda9015fb80 0x7fda900d15e0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fda80009870 tx=0x7fda8001c440 comp rx=0 tx=0).stop 2024-08-18T22:30:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda94a00640 1 -- 172.21.15.5:0/2328399382 shutdown_connections 2024-08-18T22:30:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda94a00640 1 --2- 172.21.15.5:0/2328399382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda900b5ad0 0x7fda9006fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda94a00640 1 --2- 172.21.15.5:0/2328399382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda9015fb80 0x7fda900d15e0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda94a00640 1 -- 172.21.15.5:0/2328399382 >> 172.21.15.5:0/2328399382 conn(0x7fda900d2180 msgr2=0x7fda900d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.469+0000 7fda94a00640 1 -- 172.21.15.5:0/2328399382 shutdown_connections 2024-08-18T22:30:21.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda94a00640 1 -- 172.21.15.5:0/2328399382 wait complete. 2024-08-18T22:30:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda94a00640 1 Processor -- start 2024-08-18T22:30:21.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda94a00640 1 -- start start 2024-08-18T22:30:21.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda94a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda90071550 0x7fda9013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda94a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda900b5ad0 0x7fda9006d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda94a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda9015fb80 0x7fda9014ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda94a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda9009b2d0 con 0x7fda9015fb80 2024-08-18T22:30:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda94a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda9009b150 con 0x7fda900b5ad0 2024-08-18T22:30:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda94a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fda90071980 con 0x7fda90071550 2024-08-18T22:30:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda8e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda9015fb80 0x7fda9014ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda85400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda900b5ad0 0x7fda9006d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda8de00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda90071550 0x7fda9013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda85400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda900b5ad0 0x7fda9006d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:49622/0 (socket says 172.21.15.5:49622) 2024-08-18T22:30:21.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda85400640 1 -- 172.21.15.5:0/3556988280 learned_addr learned my addr 172.21.15.5:0/3556988280 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda8de00640 1 -- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda900b5ad0 msgr2=0x7fda9006d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda8de00640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda900b5ad0 0x7fda9006d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda8de00640 1 -- 172.21.15.5:0/3556988280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda9015fb80 msgr2=0x7fda9014ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda8de00640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda9015fb80 0x7fda9014ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda8de00640 1 -- 172.21.15.5:0/3556988280 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda900cfc10 con 0x7fda90071550 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda8e800640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda9015fb80 0x7fda9014ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.473+0000 7fda8de00640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda90071550 0x7fda9013ece0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda800ab000 tx=0x7fda8001ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.477+0000 7fda86a00640 1 -- 172.21.15.5:0/3556988280 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda800ba020 con 0x7fda90071550 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.477+0000 7fda86a00640 1 -- 172.21.15.5:0/3556988280 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda800b6620 con 0x7fda90071550 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.477+0000 7fda86a00640 1 -- 172.21.15.5:0/3556988280 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda800b0040 con 0x7fda90071550 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.477+0000 7fda94a00640 1 -- 172.21.15.5:0/3556988280 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9006e430 con 0x7fda90071550 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.477+0000 7fda94a00640 1 -- 172.21.15.5:0/3556988280 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda90150590 con 0x7fda90071550 2024-08-18T22:30:21.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.477+0000 7fda94a00640 1 -- 172.21.15.5:0/3556988280 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9006fad0 con 0x7fda90071550 2024-08-18T22:30:21.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.477+0000 7fda86a00640 1 -- 172.21.15.5:0/3556988280 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda800bd020 con 0x7fda90071550 2024-08-18T22:30:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.477+0000 7fda86a00640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda6c0678c0 0x7fda6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.477+0000 7fda86a00640 1 -- 172.21.15.5:0/3556988280 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7fda8011fff0 con 0x7fda90071550 2024-08-18T22:30:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.477+0000 7fda85400640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda6c0678c0 0x7fda6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.481+0000 7fda85400640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda6c0678c0 0x7fda6c069d80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fda9014f920 tx=0x7fda78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:21.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.481+0000 7fda86a00640 1 -- 172.21.15.5:0/3556988280 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fda800c4030 con 0x7fda90071550 2024-08-18T22:30:21.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:21.689+0000 7fda94a00640 1 -- 172.21.15.5:0/3556988280 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fda900ce0d0 con 0x7fda90071550 2024-08-18T22:30:22.534 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-08-18T22:30:22.537+0000 7efe68e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:30:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.593+0000 7fda86a00640 1 -- 172.21.15.5:0/3556988280 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v124) ==== 118+0+0 (secure 0 0 0) 0x7fda80016150 con 0x7fda90071550 2024-08-18T22:30:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 -- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda6c0678c0 msgr2=0x7fda6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda6c0678c0 0x7fda6c069d80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fda9014f920 tx=0x7fda78008040 comp rx=0 tx=0).stop 2024-08-18T22:30:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 -- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda90071550 msgr2=0x7fda9013ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda90071550 0x7fda9013ece0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fda800ab000 tx=0x7fda8001ac80 comp rx=0 tx=0).stop 2024-08-18T22:30:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 -- 172.21.15.5:0/3556988280 shutdown_connections 2024-08-18T22:30:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fda6c0678c0 0x7fda6c069d80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda9015fb80 0x7fda9014ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda900b5ad0 0x7fda9006d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 --2- 172.21.15.5:0/3556988280 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda90071550 0x7fda9013ece0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 -- 172.21.15.5:0/3556988280 >> 172.21.15.5:0/3556988280 conn(0x7fda900d2180 msgr2=0x7fda90156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 -- 172.21.15.5:0/3556988280 shutdown_connections 2024-08-18T22:30:22.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.597+0000 7fda94a00640 1 -- 172.21.15.5:0/3556988280 wait complete. 2024-08-18T22:30:22.618 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:30:22.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:30:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb46e00640 1 Processor -- start 2024-08-18T22:30:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb46e00640 1 -- start start 2024-08-18T22:30:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb46e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb4009b080 0x7fbb400b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:22.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb46e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb4006e8a0 con 0x7fbb400b1300 2024-08-18T22:30:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb46e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb4009bb80 con 0x7fbb4009aca0 2024-08-18T22:30:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb46e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbb400d2e40 con 0x7fbb4009b080 2024-08-18T22:30:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb44e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb4009b080 0x7fbb400b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb37400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbb400b1300 0x7fbb40162950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59400/0 (socket says 172.21.15.5:59400) 2024-08-18T22:30:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb37400640 1 -- 172.21.15.5:0/154348672 learned_addr learned my addr 172.21.15.5:0/154348672 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb44e00640 1 -- 172.21.15.5:0/154348672 >> v1:172.21.15.117:6789/0 conn(0x7fbb4009aca0 legacy=0x7fbb400afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb44e00640 1 -- 172.21.15.5:0/154348672 >> v1:172.21.15.5:6789/0 conn(0x7fbb400b1300 legacy=0x7fbb40162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb44e00640 1 -- 172.21.15.5:0/154348672 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4006cbd0 con 0x7fbb4009b080 2024-08-18T22:30:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.769+0000 7fbb3f400640 1 -- 172.21.15.5:0/154348672 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784637551 0 0) 0x7fbb4006e8a0 con 0x7fbb400b1300 2024-08-18T22:30:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb44e00640 1 --2- 172.21.15.5:0/154348672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4009b080 0x7fbb400b01a0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009d90 tx=0x7fbb3801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1545f7acf43022d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb3f400640 1 -- 172.21.15.5:0/154348672 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb380b2070 con 0x7fbb4009b080 2024-08-18T22:30:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb3f400640 1 -- 172.21.15.5:0/154348672 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb380a5900 con 0x7fbb4009b080 2024-08-18T22:30:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb3f400640 1 -- 172.21.15.5:0/154348672 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb380a5cd0 con 0x7fbb4009b080 2024-08-18T22:30:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb46e00640 1 -- 172.21.15.5:0/154348672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4009b080 msgr2=0x7fbb400b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb46e00640 1 --2- 172.21.15.5:0/154348672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4009b080 0x7fbb400b01a0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009d90 tx=0x7fbb3801c930 comp rx=0 tx=0).stop 2024-08-18T22:30:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb46e00640 1 -- 172.21.15.5:0/154348672 shutdown_connections 2024-08-18T22:30:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb46e00640 1 --2- 172.21.15.5:0/154348672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4009b080 0x7fbb400b01a0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb46e00640 1 -- 172.21.15.5:0/154348672 >> 172.21.15.5:0/154348672 conn(0x7fbb400d2180 msgr2=0x7fbb400d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb46e00640 1 -- 172.21.15.5:0/154348672 shutdown_connections 2024-08-18T22:30:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb46e00640 1 -- 172.21.15.5:0/154348672 wait complete. 2024-08-18T22:30:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.773+0000 7fbb46e00640 1 Processor -- start 2024-08-18T22:30:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb46e00640 1 -- start start 2024-08-18T22:30:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb46e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb4009aca0 0x7fbb400b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb46e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4009b080 0x7fbb4015fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb46e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb400b1300 0x7fbb4015bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb46e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4016ced0 con 0x7fbb4009b080 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb46e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4016cd50 con 0x7fbb400b1300 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb46e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4016d050 con 0x7fbb4009aca0 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb37400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4009b080 0x7fbb4015fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb37400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4009b080 0x7fbb4015fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55172/0 (socket says 172.21.15.5:55172) 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb37400640 1 -- 172.21.15.5:0/1685284831 learned_addr learned my addr 172.21.15.5:0/1685284831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb44e00640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb400b1300 0x7fbb4015bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb3fe00640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb4009aca0 0x7fbb400b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb37400640 1 -- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb4009aca0 msgr2=0x7fbb400b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb37400640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb4009aca0 0x7fbb400b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb37400640 1 -- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb400b1300 msgr2=0x7fbb4015bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb37400640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb400b1300 0x7fbb4015bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb37400640 1 -- 172.21.15.5:0/1685284831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4015cc20 con 0x7fbb4009b080 2024-08-18T22:30:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb37400640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4009b080 0x7fbb4015fb90 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800c480 tx=0x7fbb2800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb3cc00640 1 -- 172.21.15.5:0/1685284831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb28018070 con 0x7fbb4009b080 2024-08-18T22:30:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb3cc00640 1 -- 172.21.15.5:0/1685284831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb28007500 con 0x7fbb4009b080 2024-08-18T22:30:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb46e00640 1 -- 172.21.15.5:0/1685284831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4015cf00 con 0x7fbb4009b080 2024-08-18T22:30:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb3cc00640 1 -- 172.21.15.5:0/1685284831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb28004a30 con 0x7fbb4009b080 2024-08-18T22:30:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb46e00640 1 -- 172.21.15.5:0/1685284831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb401603e0 con 0x7fbb4009b080 2024-08-18T22:30:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.777+0000 7fbb46e00640 1 -- 172.21.15.5:0/1685284831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb400afa90 con 0x7fbb4009b080 2024-08-18T22:30:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.781+0000 7fbb3cc00640 1 -- 172.21.15.5:0/1685284831 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbb2801b070 con 0x7fbb4009b080 2024-08-18T22:30:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.781+0000 7fbb3cc00640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb1c0678f0 0x7fbb1c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.781+0000 7fbb3cc00640 1 -- 172.21.15.5:0/1685284831 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fbb28085110 con 0x7fbb4009b080 2024-08-18T22:30:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.781+0000 7fbb3fe00640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb1c0678f0 0x7fbb1c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.781+0000 7fbb3fe00640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb1c0678f0 0x7fbb1c069db0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fbb400d1ee0 tx=0x7fbb30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.785+0000 7fbb3cc00640 1 -- 172.21.15.5:0/1685284831 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbb28055ab0 con 0x7fbb4009b080 2024-08-18T22:30:22.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:22.989+0000 7fbb46e00640 1 -- 172.21.15.5:0/1685284831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbb400715a0 con 0x7fbb4009b080 2024-08-18T22:30:23.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb3cc00640 1 -- 172.21.15.5:0/1685284831 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v125) ==== 122+0+0 (secure 0 0 0) 0x7fbb280553b0 con 0x7fbb4009b080 2024-08-18T22:30:23.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 -- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb1c0678f0 msgr2=0x7fbb1c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:23.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb1c0678f0 0x7fbb1c069db0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fbb400d1ee0 tx=0x7fbb30009040 comp rx=0 tx=0).stop 2024-08-18T22:30:23.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 -- 172.21.15.5:0/1685284831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4009b080 msgr2=0x7fbb4015fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:23.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4009b080 0x7fbb4015fb90 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800c480 tx=0x7fbb2800c940 comp rx=0 tx=0).stop 2024-08-18T22:30:23.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 -- 172.21.15.5:0/1685284831 shutdown_connections 2024-08-18T22:30:23.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb1c0678f0 0x7fbb1c069db0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb400b1300 0x7fbb4015bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4009b080 0x7fbb4015fb90 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 --2- 172.21.15.5:0/1685284831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb4009aca0 0x7fbb400b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 -- 172.21.15.5:0/1685284831 >> 172.21.15.5:0/1685284831 conn(0x7fbb400d2180 msgr2=0x7fbb400cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:23.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 -- 172.21.15.5:0/1685284831 shutdown_connections 2024-08-18T22:30:23.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.593+0000 7fbb46e00640 1 -- 172.21.15.5:0/1685284831 wait complete. 2024-08-18T22:30:23.616 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:30:23.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ffcc00640 1 Processor -- start 2024-08-18T22:30:23.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ffcc00640 1 -- start start 2024-08-18T22:30:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ffcc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff80b54c0 0x7f5ff8071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ffcc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ff806dd80 0x7f5ff80b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ffcc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ff806fad0 0x7f5ff806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ffcc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff80cba40 con 0x7f5ff806fad0 2024-08-18T22:30:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ffcc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff80b5de0 con 0x7f5ff806dd80 2024-08-18T22:30:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ffcc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff8071c80 con 0x7f5ff80b54c0 2024-08-18T22:30:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ff6800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ff806fad0 0x7f5ff806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ff6800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ff806fad0 0x7f5ff806ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42504/0 (socket says 172.21.15.5:42504) 2024-08-18T22:30:23.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ff6800640 1 -- 172.21.15.5:0/1220460877 learned_addr learned my addr 172.21.15.5:0/1220460877 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ff5e00640 1 --2- 172.21.15.5:0/1220460877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff80b54c0 0x7f5ff8071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5fefe00640 1 --2- 172.21.15.5:0/1220460877 >> v2:172.21.15.117:3300/0 conn(0x7f5ff806dd80 0x7f5ff80b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ff6800640 1 -- 172.21.15.5:0/1220460877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff80b54c0 msgr2=0x7f5ff8071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ff6800640 1 --2- 172.21.15.5:0/1220460877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff80b54c0 0x7f5ff8071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ff6800640 1 -- 172.21.15.5:0/1220460877 >> v2:172.21.15.117:3300/0 conn(0x7f5ff806dd80 msgr2=0x7f5ff80b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ff6800640 1 --2- 172.21.15.5:0/1220460877 >> v2:172.21.15.117:3300/0 conn(0x7f5ff806dd80 0x7f5ff80b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ff6800640 1 -- 172.21.15.5:0/1220460877 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff8071f60 con 0x7f5ff806fad0 2024-08-18T22:30:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5ff5e00640 1 --2- 172.21.15.5:0/1220460877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff80b54c0 0x7f5ff8071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:23.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.761+0000 7f5fefe00640 1 --2- 172.21.15.5:0/1220460877 >> v2:172.21.15.117:3300/0 conn(0x7f5ff806dd80 0x7f5ff80b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ff6800640 1 --2- 172.21.15.5:0/1220460877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff806fad0 0x7f5ff806ff80 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8071340 tx=0x7f5ff001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e841665e9a61308 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ff5400640 1 -- 172.21.15.5:0/1220460877 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00b4070 con 0x7f5ff806fad0 2024-08-18T22:30:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ff5400640 1 -- 172.21.15.5:0/1220460877 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff00af400 con 0x7f5ff806fad0 2024-08-18T22:30:23.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ff5400640 1 -- 172.21.15.5:0/1220460877 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00af7d0 con 0x7f5ff806fad0 2024-08-18T22:30:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1220460877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff806fad0 msgr2=0x7f5ff806ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ffcc00640 1 --2- 172.21.15.5:0/1220460877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff806fad0 0x7f5ff806ff80 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8071340 tx=0x7f5ff001f1e0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1220460877 shutdown_connections 2024-08-18T22:30:23.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ffcc00640 1 --2- 172.21.15.5:0/1220460877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff806fad0 0x7f5ff806ff80 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ffcc00640 1 --2- 172.21.15.5:0/1220460877 >> v2:172.21.15.117:3300/0 conn(0x7f5ff806dd80 0x7f5ff80b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ffcc00640 1 --2- 172.21.15.5:0/1220460877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff80b54c0 0x7f5ff8071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1220460877 >> 172.21.15.5:0/1220460877 conn(0x7f5ff80b3eb0 msgr2=0x7f5ff80b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1220460877 shutdown_connections 2024-08-18T22:30:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1220460877 wait complete. 2024-08-18T22:30:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ffcc00640 1 Processor -- start 2024-08-18T22:30:23.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.765+0000 7f5ffcc00640 1 -- start start 2024-08-18T22:30:23.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ffcc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff806dd80 0x7f5ff81f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:23.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ffcc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff806fad0 0x7f5ff81422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ffcc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff80b54c0 0x7f5ff815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ffcc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff8148020 con 0x7f5ff80b54c0 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ffcc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff806e1a0 con 0x7f5ff806fad0 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ffcc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff81481a0 con 0x7f5ff806dd80 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ff6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff80b54c0 0x7f5ff815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ff6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff80b54c0 0x7f5ff815dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42516/0 (socket says 172.21.15.5:42516) 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ff6800640 1 -- 172.21.15.5:0/1365723575 learned_addr learned my addr 172.21.15.5:0/1365723575 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ff5e00640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff806dd80 0x7f5ff81f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5fefe00640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff806fad0 0x7f5ff81422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ff6800640 1 -- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff806dd80 msgr2=0x7f5ff81f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ff6800640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff806dd80 0x7f5ff81f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ff6800640 1 -- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff806fad0 msgr2=0x7f5ff81422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:23.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ff6800640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff806fad0 0x7f5ff81422e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ff6800640 1 -- 172.21.15.5:0/1365723575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff80cf170 con 0x7f5ff80b54c0 2024-08-18T22:30:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ff6800640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff80b54c0 0x7f5ff815dd80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00b2040 tx=0x7f5ff001bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5fee000640 1 -- 172.21.15.5:0/1365723575 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00c0020 con 0x7f5ff80b54c0 2024-08-18T22:30:23.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5fee000640 1 -- 172.21.15.5:0/1365723575 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff00090d0 con 0x7f5ff80b54c0 2024-08-18T22:30:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5fee000640 1 -- 172.21.15.5:0/1365723575 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00b4040 con 0x7f5ff80b54c0 2024-08-18T22:30:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1365723575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff815e2c0 con 0x7f5ff80b54c0 2024-08-18T22:30:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1365723575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff813f660 con 0x7f5ff80b54c0 2024-08-18T22:30:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.769+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1365723575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff80b58a0 con 0x7f5ff80b54c0 2024-08-18T22:30:23.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.773+0000 7f5fee000640 1 -- 172.21.15.5:0/1365723575 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ff00c3070 con 0x7f5ff80b54c0 2024-08-18T22:30:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.773+0000 7f5fee000640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5fd40678c0 0x7f5fd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.773+0000 7f5fee000640 1 -- 172.21.15.5:0/1365723575 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f5ff0123570 con 0x7f5ff80b54c0 2024-08-18T22:30:23.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.773+0000 7f5ff5e00640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5fd40678c0 0x7f5fd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:23.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.773+0000 7f5ff5e00640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5fd40678c0 0x7f5fd4069d80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5ff81449e0 tx=0x7f5fe8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:23.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.777+0000 7f5fee000640 1 -- 172.21.15.5:0/1365723575 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5ff80cf170 con 0x7f5ff80b54c0 2024-08-18T22:30:23.828 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:30:23.831 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:30:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.977+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1365723575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ff8146a40 con 0x7f5ff80b54c0 2024-08-18T22:30:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.977+0000 7f5fee000640 1 -- 172.21.15.5:0/1365723575 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f5ff0018d40 con 0x7f5ff80b54c0 2024-08-18T22:30:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:23.977 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:30:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:30:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5fd40678c0 msgr2=0x7f5fd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5fd40678c0 0x7f5fd4069d80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5ff81449e0 tx=0x7f5fe8008040 comp rx=0 tx=0).stop 2024-08-18T22:30:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1365723575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff80b54c0 msgr2=0x7f5ff815dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff80b54c0 0x7f5ff815dd80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00b2040 tx=0x7f5ff001bf80 comp rx=0 tx=0).stop 2024-08-18T22:30:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1365723575 shutdown_connections 2024-08-18T22:30:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5fd40678c0 0x7f5fd4069d80 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff80b54c0 0x7f5ff815dd80 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff806fad0 0x7f5ff81422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 --2- 172.21.15.5:0/1365723575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff806dd80 0x7f5ff81f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1365723575 >> 172.21.15.5:0/1365723575 conn(0x7f5ff80b3eb0 msgr2=0x7f5ff8146d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1365723575 shutdown_connections 2024-08-18T22:30:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:23.981+0000 7f5ffcc00640 1 -- 172.21.15.5:0/1365723575 wait complete. 2024-08-18T22:30:23.998 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:30:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a69c00640 1 Processor -- start 2024-08-18T22:30:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a69c00640 1 -- start start 2024-08-18T22:30:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a69c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071580 0x7f0a6406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a69c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0a640cbed0 0x7f0a640cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a69c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a64071c80 con 0x7f0a640b54c0 2024-08-18T22:30:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a69c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0a640cba40 con 0x7f0a640cbed0 2024-08-18T22:30:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a69c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0a64071f60 con 0x7f0a64071580 2024-08-18T22:30:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0a640b54c0 0x7f0a640b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49510/0 (socket says 172.21.15.5:49510) 2024-08-18T22:30:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62a00640 1 -- 172.21.15.5:0/916923028 learned_addr learned my addr 172.21.15.5:0/916923028 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a63400640 1 --2- 172.21.15.5:0/916923028 >> v2:172.21.15.117:3300/0 conn(0x7f0a640cbed0 0x7f0a640cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a5a000640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071580 0x7f0a6406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537877839 0 0) 0x7f0a64071c80 con 0x7f0a640b54c0 2024-08-18T22:30:24.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a48003530 con 0x7f0a640b54c0 2024-08-18T22:30:24.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1893532459 0 0) 0x7f0a48003530 con 0x7f0a640b54c0 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071580 msgr2=0x7f0a6406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071580 0x7f0a6406dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 >> v2:172.21.15.117:3300/0 conn(0x7f0a640cbed0 msgr2=0x7f0a640cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 --2- 172.21.15.5:0/916923028 >> v2:172.21.15.117:3300/0 conn(0x7f0a640cbed0 0x7f0a640cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a640cb6d0 con 0x7f0a640b54c0 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f0a54001680 con 0x7f0a640b54c0 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 >> v1:172.21.15.5:6789/0 conn(0x7f0a640b54c0 legacy=0x7f0a640b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a480039c0 0x7f0a48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071580 0x7f0a48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48004d50 0x7f0a480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0a640cba40 con 0x7f0a48004d50 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64071f60 con 0x7f0a480039c0 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0a4800b9d0 con 0x7f0a64071580 2024-08-18T22:30:24.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a63400640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48004d50 0x7f0a480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a62a00640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a480039c0 0x7f0a48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.141+0000 7f0a5a000640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071580 0x7f0a48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a63400640 1 -- 172.21.15.5:0/916923028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071580 msgr2=0x7f0a48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a63400640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071580 0x7f0a48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a63400640 1 -- 172.21.15.5:0/916923028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a480039c0 msgr2=0x7f0a48003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a63400640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a480039c0 0x7f0a48003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a63400640 1 -- 172.21.15.5:0/916923028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a48003530 con 0x7f0a48004d50 2024-08-18T22:30:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a63400640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48004d50 0x7f0a480051d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009fc0 tx=0x7f0a5c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b267219258075c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0b2070 con 0x7f0a48004d50 2024-08-18T22:30:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a5c0a5cd0 con 0x7f0a48004d50 2024-08-18T22:30:24.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a62000640 1 -- 172.21.15.5:0/916923028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c009c10 con 0x7f0a48004d50 2024-08-18T22:30:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a69c00640 1 -- 172.21.15.5:0/916923028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48004d50 msgr2=0x7f0a480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a69c00640 1 --2- 172.21.15.5:0/916923028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a48004d50 0x7f0a480051d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009fc0 tx=0x7f0a5c01ccc0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a63400640 1 -- 172.21.15.5:0/916923028 reap_dead start 2024-08-18T22:30:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a69c00640 1 -- 172.21.15.5:0/916923028 shutdown_connections 2024-08-18T22:30:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.145+0000 7f0a69c00640 1 -- 172.21.15.5:0/916923028 >> 172.21.15.5:0/916923028 conn(0x7f0a640b3eb0 msgr2=0x7f0a640b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:24.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a69c00640 1 -- 172.21.15.5:0/916923028 shutdown_connections 2024-08-18T22:30:24.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a69c00640 1 -- 172.21.15.5:0/916923028 wait complete. 2024-08-18T22:30:24.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a69c00640 1 Processor -- start 2024-08-18T22:30:24.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a69c00640 1 -- start start 2024-08-18T22:30:24.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a69c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a48004d50 0x7f0a640cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a69c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a640d1d90 0x7f0a641f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a69c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a640b2f10 0x7f0a640b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a69c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0a641481a0 con 0x7f0a640d1d90 2024-08-18T22:30:24.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a69c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64148020 con 0x7f0a48004d50 2024-08-18T22:30:24.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a69c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0a6406dd80 con 0x7f0a640b2f10 2024-08-18T22:30:24.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a640d1d90 0x7f0a641f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a640d1d90 0x7f0a641f35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42542/0 (socket says 172.21.15.5:42542) 2024-08-18T22:30:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5a000640 1 -- 172.21.15.5:0/3052671549 learned_addr learned my addr 172.21.15.5:0/3052671549 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a62a00640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a48004d50 0x7f0a640cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a63400640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a640b2f10 0x7f0a640b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5a000640 1 -- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a640b2f10 msgr2=0x7f0a640b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5a000640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a640b2f10 0x7f0a640b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5a000640 1 -- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a48004d50 msgr2=0x7f0a640cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5a000640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a48004d50 0x7f0a640cffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5a000640 1 -- 172.21.15.5:0/3052671549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a640d1160 con 0x7f0a640d1d90 2024-08-18T22:30:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5a000640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a640d1d90 0x7f0a641f35d0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c011930 tx=0x7f0a4c011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5b400640 1 -- 172.21.15.5:0/3052671549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00f9d0 con 0x7f0a640d1d90 2024-08-18T22:30:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5b400640 1 -- 172.21.15.5:0/3052671549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a4c00fb70 con 0x7f0a640d1d90 2024-08-18T22:30:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a5b400640 1 -- 172.21.15.5:0/3052671549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c014440 con 0x7f0a640d1d90 2024-08-18T22:30:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.149+0000 7f0a69c00640 1 -- 172.21.15.5:0/3052671549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a641f3b10 con 0x7f0a640d1d90 2024-08-18T22:30:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.153+0000 7f0a69c00640 1 -- 172.21.15.5:0/3052671549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a640d08c0 con 0x7f0a640d1d90 2024-08-18T22:30:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.153+0000 7f0a69c00640 1 -- 172.21.15.5:0/3052671549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a6406e1b0 con 0x7f0a640d1d90 2024-08-18T22:30:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.153+0000 7f0a5b400640 1 -- 172.21.15.5:0/3052671549 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a4c012040 con 0x7f0a640d1d90 2024-08-18T22:30:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.153+0000 7f0a5b400640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a400678f0 0x7f0a40069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.153+0000 7f0a5b400640 1 -- 172.21.15.5:0/3052671549 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f0a4c086390 con 0x7f0a640d1d90 2024-08-18T22:30:24.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.153+0000 7f0a62a00640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a400678f0 0x7f0a40069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.153+0000 7f0a62a00640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a400678f0 0x7f0a40069db0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0a54000c10 tx=0x7f0a54007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:24.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.157+0000 7f0a5b400640 1 -- 172.21.15.5:0/3052671549 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0a4c019030 con 0x7f0a640d1d90 2024-08-18T22:30:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.329+0000 7f0a69c00640 1 -- 172.21.15.5:0/3052671549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a6415e510 con 0x7f0a640d1d90 2024-08-18T22:30:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.329+0000 7f0a5b400640 1 -- 172.21.15.5:0/3052671549 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16812 (secure 0 0 0) 0x7f0a4c056ca0 con 0x7f0a640d1d90 2024-08-18T22:30:24.329 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:24.329 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":166,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:30:21.572418+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:30:17.689677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-08-18T22:30:18.956043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:30:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 -- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a400678f0 msgr2=0x7f0a40069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a400678f0 0x7f0a40069db0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0a54000c10 tx=0x7f0a54007900 comp rx=0 tx=0).stop 2024-08-18T22:30:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 -- 172.21.15.5:0/3052671549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a640d1d90 msgr2=0x7f0a641f35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a640d1d90 0x7f0a641f35d0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c011930 tx=0x7f0a4c011d30 comp rx=0 tx=0).stop 2024-08-18T22:30:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 -- 172.21.15.5:0/3052671549 shutdown_connections 2024-08-18T22:30:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a400678f0 0x7f0a40069db0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a640b2f10 0x7f0a640b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a640d1d90 0x7f0a641f35d0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 --2- 172.21.15.5:0/3052671549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a48004d50 0x7f0a640cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 -- 172.21.15.5:0/3052671549 >> 172.21.15.5:0/3052671549 conn(0x7f0a640b3eb0 msgr2=0x7f0a640b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 -- 172.21.15.5:0/3052671549 shutdown_connections 2024-08-18T22:30:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.333+0000 7f0a69c00640 1 -- 172.21.15.5:0/3052671549 wait complete. 2024-08-18T22:30:24.350 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:30:24.350 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:30:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb246200640 1 Processor -- start 2024-08-18T22:30:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb246200640 1 -- start start 2024-08-18T22:30:24.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb246200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb24015e460 0x7fb24006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb246200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb2400cee40 0x7fb2400ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb246200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb24015e840 con 0x7fb2400ca3e0 2024-08-18T22:30:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb246200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb24006c900 con 0x7fb24015e460 2024-08-18T22:30:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb246200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb2400cf320 con 0x7fb2400cee40 2024-08-18T22:30:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb23f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb24015e460 0x7fb24006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb23fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb2400ca3e0 0x7fb2400d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49520/0 (socket says 172.21.15.5:49520) 2024-08-18T22:30:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb23fe00640 1 -- 172.21.15.5:0/1689326014 learned_addr learned my addr 172.21.15.5:0/1689326014 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb23ea00640 1 --2- 172.21.15.5:0/1689326014 >> v2:172.21.15.117:3300/0 conn(0x7fb2400cee40 0x7fb2400ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb23f400640 1 -- 172.21.15.5:0/1689326014 >> v2:172.21.15.117:3300/0 conn(0x7fb2400cee40 msgr2=0x7fb2400ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb23f400640 1 --2- 172.21.15.5:0/1689326014 >> v2:172.21.15.117:3300/0 conn(0x7fb2400cee40 0x7fb2400ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb23f400640 1 -- 172.21.15.5:0/1689326014 >> v1:172.21.15.5:6789/0 conn(0x7fb2400ca3e0 legacy=0x7fb2400d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb23f400640 1 -- 172.21.15.5:0/1689326014 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2400cf600 con 0x7fb24015e460 2024-08-18T22:30:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.493+0000 7fb23e000640 1 -- 172.21.15.5:0/1689326014 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568044323 0 0) 0x7fb24015e840 con 0x7fb2400ca3e0 2024-08-18T22:30:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb23f400640 1 --2- 172.21.15.5:0/1689326014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb24015e460 0x7fb24006c3c0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fb240073ec0 tx=0x7fb23001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4f8362d53b7789 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb23e000640 1 -- 172.21.15.5:0/1689326014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2300b5070 con 0x7fb24015e460 2024-08-18T22:30:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb23e000640 1 -- 172.21.15.5:0/1689326014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2300a8970 con 0x7fb24015e460 2024-08-18T22:30:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb23e000640 1 -- 172.21.15.5:0/1689326014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2300a8d40 con 0x7fb24015e460 2024-08-18T22:30:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb246200640 1 -- 172.21.15.5:0/1689326014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb24015e460 msgr2=0x7fb24006c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb246200640 1 --2- 172.21.15.5:0/1689326014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb24015e460 0x7fb24006c3c0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fb240073ec0 tx=0x7fb23001ec70 comp rx=0 tx=0).stop 2024-08-18T22:30:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb246200640 1 -- 172.21.15.5:0/1689326014 shutdown_connections 2024-08-18T22:30:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb246200640 1 --2- 172.21.15.5:0/1689326014 >> v2:172.21.15.117:3300/0 conn(0x7fb2400cee40 0x7fb2400ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb246200640 1 --2- 172.21.15.5:0/1689326014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb24015e460 0x7fb24006c3c0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb246200640 1 -- 172.21.15.5:0/1689326014 >> 172.21.15.5:0/1689326014 conn(0x7fb24009aa40 msgr2=0x7fb2400b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb246200640 1 -- 172.21.15.5:0/1689326014 shutdown_connections 2024-08-18T22:30:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.497+0000 7fb246200640 1 -- 172.21.15.5:0/1689326014 wait complete. 2024-08-18T22:30:24.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb246200640 1 Processor -- start 2024-08-18T22:30:24.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb246200640 1 -- start start 2024-08-18T22:30:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb246200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2400ca3e0 0x7fb2400cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb246200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400cee40 0x7fb240153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb246200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24015e460 0x7fb2400cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb246200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb2400cfea0 con 0x7fb2400cee40 2024-08-18T22:30:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb246200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb2400cfbc0 con 0x7fb24015e460 2024-08-18T22:30:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb246200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb2400b3620 con 0x7fb2400ca3e0 2024-08-18T22:30:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400cee40 0x7fb240153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400cee40 0x7fb240153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42560/0 (socket says 172.21.15.5:42560) 2024-08-18T22:30:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23ea00640 1 -- 172.21.15.5:0/1646779337 learned_addr learned my addr 172.21.15.5:0/1646779337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23fe00640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24015e460 0x7fb2400cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23f400640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2400ca3e0 0x7fb2400cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23ea00640 1 -- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2400ca3e0 msgr2=0x7fb2400cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23ea00640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2400ca3e0 0x7fb2400cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23ea00640 1 -- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24015e460 msgr2=0x7fb2400cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23ea00640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24015e460 0x7fb2400cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23ea00640 1 -- 172.21.15.5:0/1646779337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2400cd180 con 0x7fb2400cee40 2024-08-18T22:30:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23fe00640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24015e460 0x7fb2400cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb23ea00640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400cee40 0x7fb240153c50 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00e930 tx=0x7fb22c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb237400640 1 -- 172.21.15.5:0/1646779337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c017070 con 0x7fb2400cee40 2024-08-18T22:30:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb237400640 1 -- 172.21.15.5:0/1646779337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c00ca00 con 0x7fb2400cee40 2024-08-18T22:30:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb237400640 1 -- 172.21.15.5:0/1646779337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00cdb0 con 0x7fb2400cee40 2024-08-18T22:30:24.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb246200640 1 -- 172.21.15.5:0/1646779337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2400cbd50 con 0x7fb2400cee40 2024-08-18T22:30:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb246200640 1 -- 172.21.15.5:0/1646779337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2400cc310 con 0x7fb2400cee40 2024-08-18T22:30:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.501+0000 7fb246200640 1 -- 172.21.15.5:0/1646779337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb24006c3c0 con 0x7fb2400cee40 2024-08-18T22:30:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.505+0000 7fb237400640 1 -- 172.21.15.5:0/1646779337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb22c01a070 con 0x7fb2400cee40 2024-08-18T22:30:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.505+0000 7fb237400640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2200678c0 0x7fb220069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.505+0000 7fb237400640 1 -- 172.21.15.5:0/1646779337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fb22c085e10 con 0x7fb2400cee40 2024-08-18T22:30:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.505+0000 7fb23f400640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2200678c0 0x7fb220069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.505+0000 7fb23f400640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2200678c0 0x7fb220069d80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb2300b2000 tx=0x7fb230008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.509+0000 7fb237400640 1 -- 172.21.15.5:0/1646779337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb22c089030 con 0x7fb2400cee40 2024-08-18T22:30:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.673+0000 7fb246200640 1 -- 172.21.15.5:0/1646779337 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2400d1090 con 0x7fb2200678c0 2024-08-18T22:30:24.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.681+0000 7fb237400640 1 -- 172.21.15.5:0/1646779337 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252463 (secure 0 0 0) 0x7fb2400d1090 con 0x7fb2200678c0 2024-08-18T22:30:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:24.683 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:30:24.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.681+0000 7fb246200640 1 -- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2200678c0 msgr2=0x7fb220069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.681+0000 7fb246200640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2200678c0 0x7fb220069d80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb2300b2000 tx=0x7fb230008040 comp rx=0 tx=0).stop 2024-08-18T22:30:24.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.681+0000 7fb246200640 1 -- 172.21.15.5:0/1646779337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400cee40 msgr2=0x7fb240153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.681+0000 7fb246200640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400cee40 0x7fb240153c50 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00e930 tx=0x7fb22c00edf0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.681+0000 7fb246200640 1 -- 172.21.15.5:0/1646779337 shutdown_connections 2024-08-18T22:30:24.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.681+0000 7fb246200640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2200678c0 0x7fb220069d80 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.681+0000 7fb246200640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb24015e460 0x7fb2400cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.681+0000 7fb246200640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400cee40 0x7fb240153c50 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.681+0000 7fb246200640 1 --2- 172.21.15.5:0/1646779337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2400ca3e0 0x7fb2400cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.681+0000 7fb246200640 1 -- 172.21.15.5:0/1646779337 >> 172.21.15.5:0/1646779337 conn(0x7fb24009aa40 msgr2=0x7fb2400ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.685+0000 7fb246200640 1 -- 172.21.15.5:0/1646779337 shutdown_connections 2024-08-18T22:30:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.685+0000 7fb246200640 1 -- 172.21.15.5:0/1646779337 wait complete. 2024-08-18T22:30:24.701 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-08-18T22:30:23.783354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":432052,"kb_used_data":17384,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754542668,"statfs":{"total":773094113280,"available":772651692032,"internally_reserved":0,"allocated":17801216,"data_stored":8997482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":424463920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.238271"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.588260+0000","last_change":"2024-08-18T22:30:20.587462+0000","last_active":"2024-08-18T22:30:20.588260+0000","last_peered":"2024-08-18T22:30:20.588260+0000","last_clean":"2024-08-18T22:30:20.588260+0000","last_became_active":"2024-08-18T22:30:20.587171+0000","last_became_peered":"2024-08-18T22:30:20.587171+0000","last_unstale":"2024-08-18T22:30:20.588260+0000","last_undegraded":"2024-08-18T22:30:20.588260+0000","last_fullsized":"2024-08-18T22:30:20.588260+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:36:23.092549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582256+0000","last_change":"2024-08-18T22:30:20.583494+0000","last_active":"2024-08-18T22:30:21.582256+0000","last_peered":"2024-08-18T22:30:21.582256+0000","last_clean":"2024-08-18T22:30:21.582256+0000","last_became_active":"2024-08-18T22:30:20.583177+0000","last_became_peered":"2024-08-18T22:30:20.583177+0000","last_unstale":"2024-08-18T22:30:21.582256+0000","last_undegraded":"2024-08-18T22:30:21.582256+0000","last_fullsized":"2024-08-18T22:30:21.582256+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:52:11.973629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.586322+0000","last_change":"2024-08-18T22:30:20.583215+0000","last_active":"2024-08-18T22:30:20.586322+0000","last_peered":"2024-08-18T22:30:20.586322+0000","last_clean":"2024-08-18T22:30:20.586322+0000","last_became_active":"2024-08-18T22:30:20.581435+0000","last_became_peered":"2024-08-18T22:30:20.581435+0000","last_unstale":"2024-08-18T22:30:20.586322+0000","last_undegraded":"2024-08-18T22:30:20.586322+0000","last_fullsized":"2024-08-18T22:30:20.586322+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:43:56.817730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596880+0000","last_change":"2024-08-18T22:30:20.593647+0000","last_active":"2024-08-18T22:30:20.596880+0000","last_peered":"2024-08-18T22:30:20.596880+0000","last_clean":"2024-08-18T22:30:20.596880+0000","last_became_active":"2024-08-18T22:30:20.592198+0000","last_became_peered":"2024-08-18T22:30:20.592198+0000","last_unstale":"2024-08-18T22:30:20.596880+0000","last_undegraded":"2024-08-18T22:30:20.596880+0000","last_fullsized":"2024-08-18T22:30:20.596880+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:13:09.063990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676187+0000","last_change":"2024-08-18T22:30:20.590767+0000","last_active":"2024-08-18T22:30:21.676187+0000","last_peered":"2024-08-18T22:30:21.676187+0000","last_clean":"2024-08-18T22:30:21.676187+0000","last_became_active":"2024-08-18T22:30:20.590498+0000","last_became_peered":"2024-08-18T22:30:20.590498+0000","last_unstale":"2024-08-18T22:30:21.676187+0000","last_undegraded":"2024-08-18T22:30:21.676187+0000","last_fullsized":"2024-08-18T22:30:21.676187+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:35:03.751898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582399+0000","last_change":"2024-08-18T22:30:20.582736+0000","last_active":"2024-08-18T22:30:21.582399+0000","last_peered":"2024-08-18T22:30:21.582399+0000","last_clean":"2024-08-18T22:30:21.582399+0000","last_became_active":"2024-08-18T22:30:20.582477+0000","last_became_peered":"2024-08-18T22:30:20.582477+0000","last_unstale":"2024-08-18T22:30:21.582399+0000","last_undegraded":"2024-08-18T22:30:21.582399+0000","last_fullsized":"2024-08-18T22:30:21.582399+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:52:49.467854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593161+0000","last_change":"2024-08-18T22:30:20.583528+0000","last_active":"2024-08-18T22:30:21.593161+0000","last_peered":"2024-08-18T22:30:21.593161+0000","last_clean":"2024-08-18T22:30:21.593161+0000","last_became_active":"2024-08-18T22:30:20.583243+0000","last_became_peered":"2024-08-18T22:30:20.583243+0000","last_unstale":"2024-08-18T22:30:21.593161+0000","last_undegraded":"2024-08-18T22:30:21.593161+0000","last_fullsized":"2024-08-18T22:30:21.593161+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:48.513034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.592925+0000","last_change":"2024-08-18T22:30:20.588459+0000","last_active":"2024-08-18T22:30:21.592925+0000","last_peered":"2024-08-18T22:30:21.592925+0000","last_clean":"2024-08-18T22:30:21.592925+0000","last_became_active":"2024-08-18T22:30:20.587965+0000","last_became_peered":"2024-08-18T22:30:20.587965+0000","last_unstale":"2024-08-18T22:30:21.592925+0000","last_undegraded":"2024-08-18T22:30:21.592925+0000","last_fullsized":"2024-08-18T22:30:21.592925+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:14:57.559207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593441+0000","last_change":"2024-08-18T22:30:20.586506+0000","last_active":"2024-08-18T22:30:21.593441+0000","last_peered":"2024-08-18T22:30:21.593441+0000","last_clean":"2024-08-18T22:30:21.593441+0000","last_became_active":"2024-08-18T22:30:20.586244+0000","last_became_peered":"2024-08-18T22:30:20.586244+0000","last_unstale":"2024-08-18T22:30:21.593441+0000","last_undegraded":"2024-08-18T22:30:21.593441+0000","last_fullsized":"2024-08-18T22:30:21.593441+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:26:46.488602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593534+0000","last_change":"2024-08-18T22:30:20.592278+0000","last_active":"2024-08-18T22:30:21.593534+0000","last_peered":"2024-08-18T22:30:21.593534+0000","last_clean":"2024-08-18T22:30:21.593534+0000","last_became_active":"2024-08-18T22:30:20.589154+0000","last_became_peered":"2024-08-18T22:30:20.589154+0000","last_unstale":"2024-08-18T22:30:21.593534+0000","last_undegraded":"2024-08-18T22:30:21.593534+0000","last_fullsized":"2024-08-18T22:30:21.593534+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:01:53.550642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675819+0000","last_change":"2024-08-18T22:30:20.589119+0000","last_active":"2024-08-18T22:30:21.675819+0000","last_peered":"2024-08-18T22:30:21.675819+0000","last_clean":"2024-08-18T22:30:21.675819+0000","last_became_active":"2024-08-18T22:30:20.588829+0000","last_became_peered":"2024-08-18T22:30:20.588829+0000","last_unstale":"2024-08-18T22:30:21.675819+0000","last_undegraded":"2024-08-18T22:30:21.675819+0000","last_fullsized":"2024-08-18T22:30:21.675819+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:30.614103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582700+0000","last_change":"2024-08-18T22:30:20.586732+0000","last_active":"2024-08-18T22:30:21.582700+0000","last_peered":"2024-08-18T22:30:21.582700+0000","last_clean":"2024-08-18T22:30:21.582700+0000","last_became_active":"2024-08-18T22:30:20.585874+0000","last_became_peered":"2024-08-18T22:30:20.585874+0000","last_unstale":"2024-08-18T22:30:21.582700+0000","last_undegraded":"2024-08-18T22:30:21.582700+0000","last_fullsized":"2024-08-18T22:30:21.582700+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:44:44.445124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590614+0000","last_change":"2024-08-18T22:30:20.585961+0000","last_active":"2024-08-18T22:30:21.590614+0000","last_peered":"2024-08-18T22:30:21.590614+0000","last_clean":"2024-08-18T22:30:21.590614+0000","last_became_active":"2024-08-18T22:30:20.585703+0000","last_became_peered":"2024-08-18T22:30:20.585703+0000","last_unstale":"2024-08-18T22:30:21.590614+0000","last_undegraded":"2024-08-18T22:30:21.590614+0000","last_fullsized":"2024-08-18T22:30:21.590614+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:22.406287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676082+0000","last_change":"2024-08-18T22:30:20.584745+0000","last_active":"2024-08-18T22:30:21.676082+0000","last_peered":"2024-08-18T22:30:21.676082+0000","last_clean":"2024-08-18T22:30:21.676082+0000","last_became_active":"2024-08-18T22:30:20.584276+0000","last_became_peered":"2024-08-18T22:30:20.584276+0000","last_unstale":"2024-08-18T22:30:21.676082+0000","last_undegraded":"2024-08-18T22:30:21.676082+0000","last_fullsized":"2024-08-18T22:30:21.676082+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:39.917528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675470+0000","last_change":"2024-08-18T22:30:20.580273+0000","last_active":"2024-08-18T22:30:21.675470+0000","last_peered":"2024-08-18T22:30:21.675470+0000","last_clean":"2024-08-18T22:30:21.675470+0000","last_became_active":"2024-08-18T22:30:20.579782+0000","last_became_peered":"2024-08-18T22:30:20.579782+0000","last_unstale":"2024-08-18T22:30:21.675470+0000","last_undegraded":"2024-08-18T22:30:21.675470+0000","last_fullsized":"2024-08-18T22:30:21.675470+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:48.513034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596779+0000","last_change":"2024-08-18T22:30:20.592538+0000","last_active":"2024-08-18T22:30:20.596779+0000","last_peered":"2024-08-18T22:30:20.596779+0000","last_clean":"2024-08-18T22:30:20.596779+0000","last_became_active":"2024-08-18T22:30:20.592133+0000","last_became_peered":"2024-08-18T22:30:20.592133+0000","last_unstale":"2024-08-18T22:30:20.596779+0000","last_undegraded":"2024-08-18T22:30:20.596779+0000","last_fullsized":"2024-08-18T22:30:20.596779+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:37:35.839972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593504+0000","last_change":"2024-08-18T22:30:20.594232+0000","last_active":"2024-08-18T22:30:21.593504+0000","last_peered":"2024-08-18T22:30:21.593504+0000","last_clean":"2024-08-18T22:30:21.593504+0000","last_became_active":"2024-08-18T22:30:20.593977+0000","last_became_peered":"2024-08-18T22:30:20.593977+0000","last_unstale":"2024-08-18T22:30:21.593504+0000","last_undegraded":"2024-08-18T22:30:21.593504+0000","last_fullsized":"2024-08-18T22:30:21.593504+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:30.614103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.578033+0000","last_change":"2024-08-18T22:30:20.580725+0000","last_active":"2024-08-18T22:30:21.578033+0000","last_peered":"2024-08-18T22:30:21.578033+0000","last_clean":"2024-08-18T22:30:21.578033+0000","last_became_active":"2024-08-18T22:30:20.580467+0000","last_became_peered":"2024-08-18T22:30:20.580467+0000","last_unstale":"2024-08-18T22:30:21.578033+0000","last_undegraded":"2024-08-18T22:30:21.578033+0000","last_fullsized":"2024-08-18T22:30:21.578033+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:15:31.466864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675696+0000","last_change":"2024-08-18T22:30:20.578975+0000","last_active":"2024-08-18T22:30:21.675696+0000","last_peered":"2024-08-18T22:30:21.675696+0000","last_clean":"2024-08-18T22:30:21.675696+0000","last_became_active":"2024-08-18T22:30:20.578702+0000","last_became_peered":"2024-08-18T22:30:20.578702+0000","last_unstale":"2024-08-18T22:30:21.675696+0000","last_undegraded":"2024-08-18T22:30:21.675696+0000","last_fullsized":"2024-08-18T22:30:21.675696+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:26:46.488602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596372+0000","last_change":"2024-08-18T22:30:20.595104+0000","last_active":"2024-08-18T22:30:20.596372+0000","last_peered":"2024-08-18T22:30:20.596372+0000","last_clean":"2024-08-18T22:30:20.596372+0000","last_became_active":"2024-08-18T22:30:20.593935+0000","last_became_peered":"2024-08-18T22:30:20.593935+0000","last_unstale":"2024-08-18T22:30:20.596372+0000","last_undegraded":"2024-08-18T22:30:20.596372+0000","last_fullsized":"2024-08-18T22:30:20.596372+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:17.563680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590725+0000","last_change":"2024-08-18T22:30:20.595352+0000","last_active":"2024-08-18T22:30:21.590725+0000","last_peered":"2024-08-18T22:30:21.590725+0000","last_clean":"2024-08-18T22:30:21.590725+0000","last_became_active":"2024-08-18T22:30:20.590468+0000","last_became_peered":"2024-08-18T22:30:20.590468+0000","last_unstale":"2024-08-18T22:30:21.590725+0000","last_undegraded":"2024-08-18T22:30:21.590725+0000","last_fullsized":"2024-08-18T22:30:21.590725+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:08.035642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582137+0000","last_change":"2024-08-18T22:30:20.596705+0000","last_active":"2024-08-18T22:30:21.582137+0000","last_peered":"2024-08-18T22:30:21.582137+0000","last_clean":"2024-08-18T22:30:21.582137+0000","last_became_active":"2024-08-18T22:30:20.596434+0000","last_became_peered":"2024-08-18T22:30:20.596434+0000","last_unstale":"2024-08-18T22:30:21.582137+0000","last_undegraded":"2024-08-18T22:30:21.582137+0000","last_fullsized":"2024-08-18T22:30:21.582137+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:23.787740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675900+0000","last_change":"2024-08-18T22:30:20.589627+0000","last_active":"2024-08-18T22:30:21.675900+0000","last_peered":"2024-08-18T22:30:21.675900+0000","last_clean":"2024-08-18T22:30:21.675900+0000","last_became_active":"2024-08-18T22:30:20.589361+0000","last_became_peered":"2024-08-18T22:30:20.589361+0000","last_unstale":"2024-08-18T22:30:21.675900+0000","last_undegraded":"2024-08-18T22:30:21.675900+0000","last_fullsized":"2024-08-18T22:30:21.675900+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:52.678944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596803+0000","last_change":"2024-08-18T22:30:20.592954+0000","last_active":"2024-08-18T22:30:20.596803+0000","last_peered":"2024-08-18T22:30:20.596803+0000","last_clean":"2024-08-18T22:30:20.596803+0000","last_became_active":"2024-08-18T22:30:20.592579+0000","last_became_peered":"2024-08-18T22:30:20.592579+0000","last_unstale":"2024-08-18T22:30:20.596803+0000","last_undegraded":"2024-08-18T22:30:20.596803+0000","last_fullsized":"2024-08-18T22:30:20.596803+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:58.995130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.591173+0000","last_change":"2024-08-18T22:30:20.581912+0000","last_active":"2024-08-18T22:30:21.591173+0000","last_peered":"2024-08-18T22:30:21.591173+0000","last_clean":"2024-08-18T22:30:21.591173+0000","last_became_active":"2024-08-18T22:30:20.580183+0000","last_became_peered":"2024-08-18T22:30:20.580183+0000","last_unstale":"2024-08-18T22:30:21.591173+0000","last_undegraded":"2024-08-18T22:30:21.591173+0000","last_fullsized":"2024-08-18T22:30:21.591173+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:48.620490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.590801+0000","last_change":"2024-08-18T22:30:20.588490+0000","last_active":"2024-08-18T22:30:20.590801+0000","last_peered":"2024-08-18T22:30:20.590801+0000","last_clean":"2024-08-18T22:30:20.590801+0000","last_became_active":"2024-08-18T22:30:20.587791+0000","last_became_peered":"2024-08-18T22:30:20.587791+0000","last_unstale":"2024-08-18T22:30:20.590801+0000","last_undegraded":"2024-08-18T22:30:20.590801+0000","last_fullsized":"2024-08-18T22:30:20.590801+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:24.352016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582684+0000","last_change":"2024-08-18T22:30:20.596704+0000","last_active":"2024-08-18T22:30:21.582684+0000","last_peered":"2024-08-18T22:30:21.582684+0000","last_clean":"2024-08-18T22:30:21.582684+0000","last_became_active":"2024-08-18T22:30:20.596366+0000","last_became_peered":"2024-08-18T22:30:20.596366+0000","last_unstale":"2024-08-18T22:30:21.582684+0000","last_undegraded":"2024-08-18T22:30:21.582684+0000","last_fullsized":"2024-08-18T22:30:21.582684+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:55.405966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590735+0000","last_change":"2024-08-18T22:30:20.591292+0000","last_active":"2024-08-18T22:30:21.590735+0000","last_peered":"2024-08-18T22:30:21.590735+0000","last_clean":"2024-08-18T22:30:21.590735+0000","last_became_active":"2024-08-18T22:30:20.591033+0000","last_became_peered":"2024-08-18T22:30:20.591033+0000","last_unstale":"2024-08-18T22:30:21.590735+0000","last_undegraded":"2024-08-18T22:30:21.590735+0000","last_fullsized":"2024-08-18T22:30:21.590735+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:44:44.373899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582606+0000","last_change":"2024-08-18T22:30:20.592274+0000","last_active":"2024-08-18T22:30:21.582606+0000","last_peered":"2024-08-18T22:30:21.582606+0000","last_clean":"2024-08-18T22:30:21.582606+0000","last_became_active":"2024-08-18T22:30:20.591930+0000","last_became_peered":"2024-08-18T22:30:20.591930+0000","last_unstale":"2024-08-18T22:30:21.582606+0000","last_undegraded":"2024-08-18T22:30:21.582606+0000","last_fullsized":"2024-08-18T22:30:21.582606+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:13:05.550471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.577981+0000","last_change":"2024-08-18T22:30:20.589162+0000","last_active":"2024-08-18T22:30:21.577981+0000","last_peered":"2024-08-18T22:30:21.577981+0000","last_clean":"2024-08-18T22:30:21.577981+0000","last_became_active":"2024-08-18T22:30:20.588749+0000","last_became_peered":"2024-08-18T22:30:20.588749+0000","last_unstale":"2024-08-18T22:30:21.577981+0000","last_undegraded":"2024-08-18T22:30:21.577981+0000","last_fullsized":"2024-08-18T22:30:21.577981+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:52.306028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675507+0000","last_change":"2024-08-18T22:30:20.572672+0000","last_active":"2024-08-18T22:30:21.675507+0000","last_peered":"2024-08-18T22:30:21.675507+0000","last_clean":"2024-08-18T22:30:21.675507+0000","last_became_active":"2024-08-18T22:30:20.572400+0000","last_became_peered":"2024-08-18T22:30:20.572400+0000","last_unstale":"2024-08-18T22:30:21.675507+0000","last_undegraded":"2024-08-18T22:30:21.675507+0000","last_fullsized":"2024-08-18T22:30:21.675507+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:32:23.415945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.577671+0000","last_change":"2024-08-18T22:30:20.580232+0000","last_active":"2024-08-18T22:30:21.577671+0000","last_peered":"2024-08-18T22:30:21.577671+0000","last_clean":"2024-08-18T22:30:21.577671+0000","last_became_active":"2024-08-18T22:30:20.579959+0000","last_became_peered":"2024-08-18T22:30:20.579959+0000","last_unstale":"2024-08-18T22:30:21.577671+0000","last_undegraded":"2024-08-18T22:30:21.577671+0000","last_fullsized":"2024-08-18T22:30:21.577671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:17.168331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582120+0000","last_change":"2024-08-18T22:30:20.584432+0000","last_active":"2024-08-18T22:30:21.582120+0000","last_peered":"2024-08-18T22:30:21.582120+0000","last_clean":"2024-08-18T22:30:21.582120+0000","last_became_active":"2024-08-18T22:30:20.584127+0000","last_became_peered":"2024-08-18T22:30:20.584127+0000","last_unstale":"2024-08-18T22:30:21.582120+0000","last_undegraded":"2024-08-18T22:30:21.582120+0000","last_fullsized":"2024-08-18T22:30:21.582120+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:18.224275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"165'4","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.603418+0000","last_change":"2024-08-18T22:30:19.575013+0000","last_active":"2024-08-18T22:30:20.603418+0000","last_peered":"2024-08-18T22:30:20.603418+0000","last_clean":"2024-08-18T22:30:20.603418+0000","last_became_active":"2024-08-18T22:30:19.574646+0000","last_became_peered":"2024-08-18T22:30:19.574646+0000","last_unstale":"2024-08-18T22:30:20.603418+0000","last_undegraded":"2024-08-18T22:30:20.603418+0000","last_fullsized":"2024-08-18T22:30:20.603418+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:24.062096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590485+0000","last_change":"2024-08-18T22:30:20.588919+0000","last_active":"2024-08-18T22:30:21.590485+0000","last_peered":"2024-08-18T22:30:21.590485+0000","last_clean":"2024-08-18T22:30:21.590485+0000","last_became_active":"2024-08-18T22:30:20.588661+0000","last_became_peered":"2024-08-18T22:30:20.588661+0000","last_unstale":"2024-08-18T22:30:21.590485+0000","last_undegraded":"2024-08-18T22:30:21.590485+0000","last_fullsized":"2024-08-18T22:30:21.590485+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:35:03.751898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676452+0000","last_change":"2024-08-18T22:30:19.568781+0000","last_active":"2024-08-18T22:30:21.676452+0000","last_peered":"2024-08-18T22:30:21.676452+0000","last_clean":"2024-08-18T22:30:21.676452+0000","last_became_active":"2024-08-18T22:30:19.568472+0000","last_became_peered":"2024-08-18T22:30:19.568472+0000","last_unstale":"2024-08-18T22:30:21.676452+0000","last_undegraded":"2024-08-18T22:30:21.676452+0000","last_fullsized":"2024-08-18T22:30:21.676452+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:15.704018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676010+0000","last_change":"2024-08-18T22:30:20.584534+0000","last_active":"2024-08-18T22:30:21.676010+0000","last_peered":"2024-08-18T22:30:21.676010+0000","last_clean":"2024-08-18T22:30:21.676010+0000","last_became_active":"2024-08-18T22:30:20.583778+0000","last_became_peered":"2024-08-18T22:30:20.583778+0000","last_unstale":"2024-08-18T22:30:21.676010+0000","last_undegraded":"2024-08-18T22:30:21.676010+0000","last_fullsized":"2024-08-18T22:30:21.676010+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:03.744978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675892+0000","last_change":"2024-08-18T22:30:19.567920+0000","last_active":"2024-08-18T22:30:21.675892+0000","last_peered":"2024-08-18T22:30:21.675892+0000","last_clean":"2024-08-18T22:30:21.675892+0000","last_became_active":"2024-08-18T22:30:19.567602+0000","last_became_peered":"2024-08-18T22:30:19.567602+0000","last_unstale":"2024-08-18T22:30:21.675892+0000","last_undegraded":"2024-08-18T22:30:21.675892+0000","last_fullsized":"2024-08-18T22:30:21.675892+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:59.965215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582531+0000","last_change":"2024-08-18T22:30:20.593429+0000","last_active":"2024-08-18T22:30:21.582531+0000","last_peered":"2024-08-18T22:30:21.582531+0000","last_clean":"2024-08-18T22:30:21.582531+0000","last_became_active":"2024-08-18T22:30:20.593119+0000","last_became_peered":"2024-08-18T22:30:20.593119+0000","last_unstale":"2024-08-18T22:30:21.582531+0000","last_undegraded":"2024-08-18T22:30:21.582531+0000","last_fullsized":"2024-08-18T22:30:21.582531+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:13.973958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"165'2","reported_seq":14,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.603579+0000","last_change":"2024-08-18T22:30:19.567076+0000","last_active":"2024-08-18T22:30:20.603579+0000","last_peered":"2024-08-18T22:30:20.603579+0000","last_clean":"2024-08-18T22:30:20.603579+0000","last_became_active":"2024-08-18T22:30:19.566836+0000","last_became_peered":"2024-08-18T22:30:19.566836+0000","last_unstale":"2024-08-18T22:30:20.603579+0000","last_undegraded":"2024-08-18T22:30:20.603579+0000","last_fullsized":"2024-08-18T22:30:20.603579+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:47.739538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593239+0000","last_change":"2024-08-18T22:30:20.587120+0000","last_active":"2024-08-18T22:30:21.593239+0000","last_peered":"2024-08-18T22:30:21.593239+0000","last_clean":"2024-08-18T22:30:21.593239+0000","last_became_active":"2024-08-18T22:30:20.586850+0000","last_became_peered":"2024-08-18T22:30:20.586850+0000","last_unstale":"2024-08-18T22:30:21.593239+0000","last_undegraded":"2024-08-18T22:30:21.593239+0000","last_fullsized":"2024-08-18T22:30:21.593239+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:46.143640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593069+0000","last_change":"2024-08-18T22:30:19.569375+0000","last_active":"2024-08-18T22:30:21.593069+0000","last_peered":"2024-08-18T22:30:21.593069+0000","last_clean":"2024-08-18T22:30:21.593069+0000","last_became_active":"2024-08-18T22:30:19.568984+0000","last_became_peered":"2024-08-18T22:30:19.568984+0000","last_unstale":"2024-08-18T22:30:21.593069+0000","last_undegraded":"2024-08-18T22:30:21.593069+0000","last_fullsized":"2024-08-18T22:30:21.593069+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:44:49.776785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.589491+0000","last_change":"2024-08-18T22:30:20.584746+0000","last_active":"2024-08-18T22:30:20.589491+0000","last_peered":"2024-08-18T22:30:20.589491+0000","last_clean":"2024-08-18T22:30:20.589491+0000","last_became_active":"2024-08-18T22:30:20.584454+0000","last_became_peered":"2024-08-18T22:30:20.584454+0000","last_unstale":"2024-08-18T22:30:20.589491+0000","last_undegraded":"2024-08-18T22:30:20.589491+0000","last_fullsized":"2024-08-18T22:30:20.589491+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:36:47.410380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676060+0000","last_change":"2024-08-18T22:30:19.577474+0000","last_active":"2024-08-18T22:30:21.676060+0000","last_peered":"2024-08-18T22:30:21.676060+0000","last_clean":"2024-08-18T22:30:21.676060+0000","last_became_active":"2024-08-18T22:30:19.577186+0000","last_became_peered":"2024-08-18T22:30:19.577186+0000","last_unstale":"2024-08-18T22:30:21.676060+0000","last_undegraded":"2024-08-18T22:30:21.676060+0000","last_fullsized":"2024-08-18T22:30:21.676060+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:44:43.437202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.591920+0000","last_change":"2024-08-18T22:30:20.588715+0000","last_active":"2024-08-18T22:30:20.591920+0000","last_peered":"2024-08-18T22:30:20.591920+0000","last_clean":"2024-08-18T22:30:20.591920+0000","last_became_active":"2024-08-18T22:30:20.588188+0000","last_became_peered":"2024-08-18T22:30:20.588188+0000","last_unstale":"2024-08-18T22:30:20.591920+0000","last_undegraded":"2024-08-18T22:30:20.591920+0000","last_fullsized":"2024-08-18T22:30:20.591920+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:54.249938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.574772+0000","last_change":"2024-08-18T22:30:19.573068+0000","last_active":"2024-08-18T22:30:20.574772+0000","last_peered":"2024-08-18T22:30:20.574772+0000","last_clean":"2024-08-18T22:30:20.574772+0000","last_became_active":"2024-08-18T22:30:19.572731+0000","last_became_peered":"2024-08-18T22:30:19.572731+0000","last_unstale":"2024-08-18T22:30:20.574772+0000","last_undegraded":"2024-08-18T22:30:20.574772+0000","last_fullsized":"2024-08-18T22:30:20.574772+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:58.701572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.587340+0000","last_change":"2024-08-18T22:30:20.585225+0000","last_active":"2024-08-18T22:30:20.587340+0000","last_peered":"2024-08-18T22:30:20.587340+0000","last_clean":"2024-08-18T22:30:20.587340+0000","last_became_active":"2024-08-18T22:30:20.584959+0000","last_became_peered":"2024-08-18T22:30:20.584959+0000","last_unstale":"2024-08-18T22:30:20.587340+0000","last_undegraded":"2024-08-18T22:30:20.587340+0000","last_fullsized":"2024-08-18T22:30:20.587340+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:50:12.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.592999+0000","last_change":"2024-08-18T22:30:19.565786+0000","last_active":"2024-08-18T22:30:21.592999+0000","last_peered":"2024-08-18T22:30:21.592999+0000","last_clean":"2024-08-18T22:30:21.592999+0000","last_became_active":"2024-08-18T22:30:19.564822+0000","last_became_peered":"2024-08-18T22:30:19.564822+0000","last_unstale":"2024-08-18T22:30:21.592999+0000","last_undegraded":"2024-08-18T22:30:21.592999+0000","last_fullsized":"2024-08-18T22:30:21.592999+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:51:07.756831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582342+0000","last_change":"2024-08-18T22:30:20.581202+0000","last_active":"2024-08-18T22:30:21.582342+0000","last_peered":"2024-08-18T22:30:21.582342+0000","last_clean":"2024-08-18T22:30:21.582342+0000","last_became_active":"2024-08-18T22:30:20.579054+0000","last_became_peered":"2024-08-18T22:30:20.579054+0000","last_unstale":"2024-08-18T22:30:21.582342+0000","last_undegraded":"2024-08-18T22:30:21.582342+0000","last_fullsized":"2024-08-18T22:30:21.582342+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:25:35.713474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.591027+0000","last_change":"2024-08-18T22:30:19.575419+0000","last_active":"2024-08-18T22:30:21.591027+0000","last_peered":"2024-08-18T22:30:21.591027+0000","last_clean":"2024-08-18T22:30:21.591027+0000","last_became_active":"2024-08-18T22:30:19.575015+0000","last_became_peered":"2024-08-18T22:30:19.575015+0000","last_unstale":"2024-08-18T22:30:21.591027+0000","last_undegraded":"2024-08-18T22:30:21.591027+0000","last_fullsized":"2024-08-18T22:30:21.591027+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:39:14.013272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590508+0000","last_change":"2024-08-18T22:30:20.577603+0000","last_active":"2024-08-18T22:30:21.590508+0000","last_peered":"2024-08-18T22:30:21.590508+0000","last_clean":"2024-08-18T22:30:21.590508+0000","last_became_active":"2024-08-18T22:30:20.577316+0000","last_became_peered":"2024-08-18T22:30:20.577316+0000","last_unstale":"2024-08-18T22:30:21.590508+0000","last_undegraded":"2024-08-18T22:30:21.590508+0000","last_fullsized":"2024-08-18T22:30:21.590508+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:54:37.754491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"165'3","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.599430+0000","last_change":"2024-08-18T22:30:19.566222+0000","last_active":"2024-08-18T22:30:20.599430+0000","last_peered":"2024-08-18T22:30:20.599430+0000","last_clean":"2024-08-18T22:30:20.599430+0000","last_became_active":"2024-08-18T22:30:19.565901+0000","last_became_peered":"2024-08-18T22:30:19.565901+0000","last_unstale":"2024-08-18T22:30:20.599430+0000","last_undegraded":"2024-08-18T22:30:20.599430+0000","last_fullsized":"2024-08-18T22:30:20.599430+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:40.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596628+0000","last_change":"2024-08-18T22:30:20.593802+0000","last_active":"2024-08-18T22:30:20.596628+0000","last_peered":"2024-08-18T22:30:20.596628+0000","last_clean":"2024-08-18T22:30:20.596628+0000","last_became_active":"2024-08-18T22:30:20.593519+0000","last_became_peered":"2024-08-18T22:30:20.593519+0000","last_unstale":"2024-08-18T22:30:20.596628+0000","last_undegraded":"2024-08-18T22:30:20.596628+0000","last_fullsized":"2024-08-18T22:30:20.596628+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:58.563391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"165'6","reported_seq":20,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590808+0000","last_change":"2024-08-18T22:30:19.573085+0000","last_active":"2024-08-18T22:30:21.590808+0000","last_peered":"2024-08-18T22:30:21.590808+0000","last_clean":"2024-08-18T22:30:21.590808+0000","last_became_active":"2024-08-18T22:30:19.572794+0000","last_became_peered":"2024-08-18T22:30:19.572794+0000","last_unstale":"2024-08-18T22:30:21.590808+0000","last_undegraded":"2024-08-18T22:30:21.590808+0000","last_fullsized":"2024-08-18T22:30:21.590808+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:25:02.938374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.577951+0000","last_change":"2024-08-18T22:30:20.578030+0000","last_active":"2024-08-18T22:30:21.577951+0000","last_peered":"2024-08-18T22:30:21.577951+0000","last_clean":"2024-08-18T22:30:21.577951+0000","last_became_active":"2024-08-18T22:30:20.577747+0000","last_became_peered":"2024-08-18T22:30:20.577747+0000","last_unstale":"2024-08-18T22:30:21.577951+0000","last_undegraded":"2024-08-18T22:30:21.577951+0000","last_fullsized":"2024-08-18T22:30:21.577951+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:51:08.764754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676198+0000","last_change":"2024-08-18T22:30:19.575675+0000","last_active":"2024-08-18T22:30:21.676198+0000","last_peered":"2024-08-18T22:30:21.676198+0000","last_clean":"2024-08-18T22:30:21.676198+0000","last_became_active":"2024-08-18T22:30:19.575388+0000","last_became_peered":"2024-08-18T22:30:19.575388+0000","last_unstale":"2024-08-18T22:30:21.676198+0000","last_undegraded":"2024-08-18T22:30:21.676198+0000","last_fullsized":"2024-08-18T22:30:21.676198+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:08.158319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593367+0000","last_change":"2024-08-18T22:30:20.599600+0000","last_active":"2024-08-18T22:30:21.593367+0000","last_peered":"2024-08-18T22:30:21.593367+0000","last_clean":"2024-08-18T22:30:21.593367+0000","last_became_active":"2024-08-18T22:30:20.599316+0000","last_became_peered":"2024-08-18T22:30:20.599316+0000","last_unstale":"2024-08-18T22:30:21.593367+0000","last_undegraded":"2024-08-18T22:30:21.593367+0000","last_fullsized":"2024-08-18T22:30:21.593367+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:12.349849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590717+0000","last_change":"2024-08-18T22:30:19.564405+0000","last_active":"2024-08-18T22:30:21.590717+0000","last_peered":"2024-08-18T22:30:21.590717+0000","last_clean":"2024-08-18T22:30:21.590717+0000","last_became_active":"2024-08-18T22:30:19.563582+0000","last_became_peered":"2024-08-18T22:30:19.563582+0000","last_unstale":"2024-08-18T22:30:21.590717+0000","last_undegraded":"2024-08-18T22:30:21.590717+0000","last_fullsized":"2024-08-18T22:30:21.590717+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:15.704018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675842+0000","last_change":"2024-08-18T22:30:20.584448+0000","last_active":"2024-08-18T22:30:21.675842+0000","last_peered":"2024-08-18T22:30:21.675842+0000","last_clean":"2024-08-18T22:30:21.675842+0000","last_became_active":"2024-08-18T22:30:20.582689+0000","last_became_peered":"2024-08-18T22:30:20.582689+0000","last_unstale":"2024-08-18T22:30:21.675842+0000","last_undegraded":"2024-08-18T22:30:21.675842+0000","last_fullsized":"2024-08-18T22:30:21.675842+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:01:53.550642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675580+0000","last_change":"2024-08-18T22:30:19.573181+0000","last_active":"2024-08-18T22:30:21.675580+0000","last_peered":"2024-08-18T22:30:21.675580+0000","last_clean":"2024-08-18T22:30:21.675580+0000","last_became_active":"2024-08-18T22:30:19.572862+0000","last_became_peered":"2024-08-18T22:30:19.572862+0000","last_unstale":"2024-08-18T22:30:21.675580+0000","last_undegraded":"2024-08-18T22:30:21.675580+0000","last_fullsized":"2024-08-18T22:30:21.675580+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:59.455503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.592532+0000","last_change":"2024-08-18T22:30:20.588427+0000","last_active":"2024-08-18T22:30:20.592532+0000","last_peered":"2024-08-18T22:30:20.592532+0000","last_clean":"2024-08-18T22:30:20.592532+0000","last_became_active":"2024-08-18T22:30:20.587755+0000","last_became_peered":"2024-08-18T22:30:20.587755+0000","last_unstale":"2024-08-18T22:30:20.592532+0000","last_undegraded":"2024-08-18T22:30:20.592532+0000","last_fullsized":"2024-08-18T22:30:20.592532+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:24.714800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"165'8","reported_seq":22,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.592992+0000","last_change":"2024-08-18T22:30:19.566022+0000","last_active":"2024-08-18T22:30:21.592992+0000","last_peered":"2024-08-18T22:30:21.592992+0000","last_clean":"2024-08-18T22:30:21.592992+0000","last_became_active":"2024-08-18T22:30:19.565519+0000","last_became_peered":"2024-08-18T22:30:19.565519+0000","last_unstale":"2024-08-18T22:30:21.592992+0000","last_undegraded":"2024-08-18T22:30:21.592992+0000","last_fullsized":"2024-08-18T22:30:21.592992+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:51.298106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.592933+0000","last_change":"2024-08-18T22:30:20.588228+0000","last_active":"2024-08-18T22:30:21.592933+0000","last_peered":"2024-08-18T22:30:21.592933+0000","last_clean":"2024-08-18T22:30:21.592933+0000","last_became_active":"2024-08-18T22:30:20.587575+0000","last_became_peered":"2024-08-18T22:30:20.587575+0000","last_unstale":"2024-08-18T22:30:21.592933+0000","last_undegraded":"2024-08-18T22:30:21.592933+0000","last_fullsized":"2024-08-18T22:30:21.592933+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:50.887479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.591129+0000","last_change":"2024-08-18T22:30:19.572441+0000","last_active":"2024-08-18T22:30:21.591129+0000","last_peered":"2024-08-18T22:30:21.591129+0000","last_clean":"2024-08-18T22:30:21.591129+0000","last_became_active":"2024-08-18T22:30:19.569716+0000","last_became_peered":"2024-08-18T22:30:19.569716+0000","last_unstale":"2024-08-18T22:30:21.591129+0000","last_undegraded":"2024-08-18T22:30:21.591129+0000","last_fullsized":"2024-08-18T22:30:21.591129+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:10:50.823672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.578091+0000","last_change":"2024-08-18T22:30:20.574276+0000","last_active":"2024-08-18T22:30:21.578091+0000","last_peered":"2024-08-18T22:30:21.578091+0000","last_clean":"2024-08-18T22:30:21.578091+0000","last_became_active":"2024-08-18T22:30:20.573988+0000","last_became_peered":"2024-08-18T22:30:20.573988+0000","last_unstale":"2024-08-18T22:30:21.578091+0000","last_undegraded":"2024-08-18T22:30:21.578091+0000","last_fullsized":"2024-08-18T22:30:21.578091+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:44:50.784708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593516+0000","last_change":"2024-08-18T22:30:19.570653+0000","last_active":"2024-08-18T22:30:21.593516+0000","last_peered":"2024-08-18T22:30:21.593516+0000","last_clean":"2024-08-18T22:30:21.593516+0000","last_became_active":"2024-08-18T22:30:19.570355+0000","last_became_peered":"2024-08-18T22:30:19.570355+0000","last_unstale":"2024-08-18T22:30:21.593516+0000","last_undegraded":"2024-08-18T22:30:21.593516+0000","last_fullsized":"2024-08-18T22:30:21.593516+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:20.533535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675502+0000","last_change":"2024-08-18T22:30:20.583944+0000","last_active":"2024-08-18T22:30:21.675502+0000","last_peered":"2024-08-18T22:30:21.675502+0000","last_clean":"2024-08-18T22:30:21.675502+0000","last_became_active":"2024-08-18T22:30:20.583669+0000","last_became_peered":"2024-08-18T22:30:20.583669+0000","last_unstale":"2024-08-18T22:30:21.675502+0000","last_undegraded":"2024-08-18T22:30:21.675502+0000","last_fullsized":"2024-08-18T22:30:21.675502+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:46.143640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676412+0000","last_change":"2024-08-18T22:30:19.573363+0000","last_active":"2024-08-18T22:30:21.676412+0000","last_peered":"2024-08-18T22:30:21.676412+0000","last_clean":"2024-08-18T22:30:21.676412+0000","last_became_active":"2024-08-18T22:30:19.570435+0000","last_became_peered":"2024-08-18T22:30:19.570435+0000","last_unstale":"2024-08-18T22:30:21.676412+0000","last_undegraded":"2024-08-18T22:30:21.676412+0000","last_fullsized":"2024-08-18T22:30:21.676412+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:45.359622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675581+0000","last_change":"2024-08-18T22:30:20.593451+0000","last_active":"2024-08-18T22:30:21.675581+0000","last_peered":"2024-08-18T22:30:21.675581+0000","last_clean":"2024-08-18T22:30:21.675581+0000","last_became_active":"2024-08-18T22:30:20.593168+0000","last_became_peered":"2024-08-18T22:30:20.593168+0000","last_unstale":"2024-08-18T22:30:21.675581+0000","last_undegraded":"2024-08-18T22:30:21.675581+0000","last_fullsized":"2024-08-18T22:30:21.675581+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:12.349849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593167+0000","last_change":"2024-08-18T22:30:19.569280+0000","last_active":"2024-08-18T22:30:21.593167+0000","last_peered":"2024-08-18T22:30:21.593167+0000","last_clean":"2024-08-18T22:30:21.593167+0000","last_became_active":"2024-08-18T22:30:19.568921+0000","last_became_peered":"2024-08-18T22:30:19.568921+0000","last_unstale":"2024-08-18T22:30:21.593167+0000","last_undegraded":"2024-08-18T22:30:21.593167+0000","last_fullsized":"2024-08-18T22:30:21.593167+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:15:30.458942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590871+0000","last_change":"2024-08-18T22:30:20.592203+0000","last_active":"2024-08-18T22:30:21.590871+0000","last_peered":"2024-08-18T22:30:21.590871+0000","last_clean":"2024-08-18T22:30:21.590871+0000","last_became_active":"2024-08-18T22:30:20.591950+0000","last_became_peered":"2024-08-18T22:30:20.591950+0000","last_unstale":"2024-08-18T22:30:21.590871+0000","last_undegraded":"2024-08-18T22:30:21.590871+0000","last_fullsized":"2024-08-18T22:30:21.590871+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:31.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676243+0000","last_change":"2024-08-18T22:30:19.574993+0000","last_active":"2024-08-18T22:30:21.676243+0000","last_peered":"2024-08-18T22:30:21.676243+0000","last_clean":"2024-08-18T22:30:21.676243+0000","last_became_active":"2024-08-18T22:30:19.574525+0000","last_became_peered":"2024-08-18T22:30:19.574525+0000","last_unstale":"2024-08-18T22:30:21.676243+0000","last_undegraded":"2024-08-18T22:30:21.676243+0000","last_fullsized":"2024-08-18T22:30:21.676243+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:25:02.938374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676498+0000","last_change":"2024-08-18T22:30:20.585607+0000","last_active":"2024-08-18T22:30:21.676498+0000","last_peered":"2024-08-18T22:30:21.676498+0000","last_clean":"2024-08-18T22:30:21.676498+0000","last_became_active":"2024-08-18T22:30:20.585294+0000","last_became_peered":"2024-08-18T22:30:20.585294+0000","last_unstale":"2024-08-18T22:30:21.676498+0000","last_undegraded":"2024-08-18T22:30:21.676498+0000","last_fullsized":"2024-08-18T22:30:21.676498+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:22.406287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675545+0000","last_change":"2024-08-18T22:30:19.570111+0000","last_active":"2024-08-18T22:30:21.675545+0000","last_peered":"2024-08-18T22:30:21.675545+0000","last_clean":"2024-08-18T22:30:21.675545+0000","last_became_active":"2024-08-18T22:30:19.569832+0000","last_became_peered":"2024-08-18T22:30:19.569832+0000","last_unstale":"2024-08-18T22:30:21.675545+0000","last_undegraded":"2024-08-18T22:30:21.675545+0000","last_fullsized":"2024-08-18T22:30:21.675545+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:17:48.370203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676412+0000","last_change":"2024-08-18T22:30:20.582751+0000","last_active":"2024-08-18T22:30:21.676412+0000","last_peered":"2024-08-18T22:30:21.676412+0000","last_clean":"2024-08-18T22:30:21.676412+0000","last_became_active":"2024-08-18T22:30:20.582466+0000","last_became_peered":"2024-08-18T22:30:20.582466+0000","last_unstale":"2024-08-18T22:30:21.676412+0000","last_undegraded":"2024-08-18T22:30:21.676412+0000","last_fullsized":"2024-08-18T22:30:21.676412+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:54:37.754491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.574952+0000","last_change":"2024-08-18T22:30:19.563996+0000","last_active":"2024-08-18T22:30:20.574952+0000","last_peered":"2024-08-18T22:30:20.574952+0000","last_clean":"2024-08-18T22:30:20.574952+0000","last_became_active":"2024-08-18T22:30:19.563688+0000","last_became_peered":"2024-08-18T22:30:19.563688+0000","last_unstale":"2024-08-18T22:30:20.574952+0000","last_undegraded":"2024-08-18T22:30:20.574952+0000","last_fullsized":"2024-08-18T22:30:20.574952+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:39.211918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582674+0000","last_change":"2024-08-18T22:30:20.582244+0000","last_active":"2024-08-18T22:30:21.582674+0000","last_peered":"2024-08-18T22:30:21.582674+0000","last_clean":"2024-08-18T22:30:21.582674+0000","last_became_active":"2024-08-18T22:30:20.580574+0000","last_became_peered":"2024-08-18T22:30:20.580574+0000","last_unstale":"2024-08-18T22:30:21.582674+0000","last_undegraded":"2024-08-18T22:30:21.582674+0000","last_fullsized":"2024-08-18T22:30:21.582674+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:30.390150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582181+0000","last_change":"2024-08-18T22:30:19.561765+0000","last_active":"2024-08-18T22:30:21.582181+0000","last_peered":"2024-08-18T22:30:21.582181+0000","last_clean":"2024-08-18T22:30:21.582181+0000","last_became_active":"2024-08-18T22:30:19.560319+0000","last_became_peered":"2024-08-18T22:30:19.560319+0000","last_unstale":"2024-08-18T22:30:21.582181+0000","last_undegraded":"2024-08-18T22:30:21.582181+0000","last_fullsized":"2024-08-18T22:30:21.582181+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:49.879557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675455+0000","last_change":"2024-08-18T22:30:20.572291+0000","last_active":"2024-08-18T22:30:21.675455+0000","last_peered":"2024-08-18T22:30:21.675455+0000","last_clean":"2024-08-18T22:30:21.675455+0000","last_became_active":"2024-08-18T22:30:20.572004+0000","last_became_peered":"2024-08-18T22:30:20.572004+0000","last_unstale":"2024-08-18T22:30:21.675455+0000","last_undegraded":"2024-08-18T22:30:21.675455+0000","last_fullsized":"2024-08-18T22:30:21.675455+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:16.513684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676452+0000","last_change":"2024-08-18T22:30:19.575108+0000","last_active":"2024-08-18T22:30:21.676452+0000","last_peered":"2024-08-18T22:30:21.676452+0000","last_clean":"2024-08-18T22:30:21.676452+0000","last_became_active":"2024-08-18T22:30:19.574441+0000","last_became_peered":"2024-08-18T22:30:19.574441+0000","last_unstale":"2024-08-18T22:30:21.676452+0000","last_undegraded":"2024-08-18T22:30:21.676452+0000","last_fullsized":"2024-08-18T22:30:21.676452+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:33:16.334650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593328+0000","last_change":"2024-08-18T22:30:20.582538+0000","last_active":"2024-08-18T22:30:21.593328+0000","last_peered":"2024-08-18T22:30:21.593328+0000","last_clean":"2024-08-18T22:30:21.593328+0000","last_became_active":"2024-08-18T22:30:20.580556+0000","last_became_peered":"2024-08-18T22:30:20.580556+0000","last_unstale":"2024-08-18T22:30:21.593328+0000","last_undegraded":"2024-08-18T22:30:21.593328+0000","last_fullsized":"2024-08-18T22:30:21.593328+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:32:23.415945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"166'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.591116+0000","last_change":"2024-08-18T22:30:19.569747+0000","last_active":"2024-08-18T22:30:21.591116+0000","last_peered":"2024-08-18T22:30:21.591116+0000","last_clean":"2024-08-18T22:30:21.591116+0000","last_became_active":"2024-08-18T22:30:19.569409+0000","last_became_peered":"2024-08-18T22:30:19.569409+0000","last_unstale":"2024-08-18T22:30:21.591116+0000","last_undegraded":"2024-08-18T22:30:21.591116+0000","last_fullsized":"2024-08-18T22:30:21.591116+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:08.158319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.579971+0000","last_change":"2024-08-18T22:30:20.578914+0000","last_active":"2024-08-18T22:30:20.579971+0000","last_peered":"2024-08-18T22:30:20.579971+0000","last_clean":"2024-08-18T22:30:20.579971+0000","last_became_active":"2024-08-18T22:30:20.578650+0000","last_became_peered":"2024-08-18T22:30:20.578650+0000","last_unstale":"2024-08-18T22:30:20.579971+0000","last_undegraded":"2024-08-18T22:30:20.579971+0000","last_fullsized":"2024-08-18T22:30:20.579971+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:46.298498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590947+0000","last_change":"2024-08-18T22:30:19.564710+0000","last_active":"2024-08-18T22:30:21.590947+0000","last_peered":"2024-08-18T22:30:21.590947+0000","last_clean":"2024-08-18T22:30:21.590947+0000","last_became_active":"2024-08-18T22:30:19.564417+0000","last_became_peered":"2024-08-18T22:30:19.564417+0000","last_unstale":"2024-08-18T22:30:21.590947+0000","last_undegraded":"2024-08-18T22:30:21.590947+0000","last_fullsized":"2024-08-18T22:30:21.590947+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:54.398044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593106+0000","last_change":"2024-08-18T22:30:20.585461+0000","last_active":"2024-08-18T22:30:21.593106+0000","last_peered":"2024-08-18T22:30:21.593106+0000","last_clean":"2024-08-18T22:30:21.593106+0000","last_became_active":"2024-08-18T22:30:20.585200+0000","last_became_peered":"2024-08-18T22:30:20.585200+0000","last_unstale":"2024-08-18T22:30:21.593106+0000","last_undegraded":"2024-08-18T22:30:21.593106+0000","last_fullsized":"2024-08-18T22:30:21.593106+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:16.513684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.580189+0000","last_change":"2024-08-18T22:30:19.567457+0000","last_active":"2024-08-18T22:30:20.580189+0000","last_peered":"2024-08-18T22:30:20.580189+0000","last_clean":"2024-08-18T22:30:20.580189+0000","last_became_active":"2024-08-18T22:30:19.565408+0000","last_became_peered":"2024-08-18T22:30:19.565408+0000","last_unstale":"2024-08-18T22:30:20.580189+0000","last_undegraded":"2024-08-18T22:30:20.580189+0000","last_fullsized":"2024-08-18T22:30:20.580189+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:32.451150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596844+0000","last_change":"2024-08-18T22:30:20.593259+0000","last_active":"2024-08-18T22:30:20.596844+0000","last_peered":"2024-08-18T22:30:20.596844+0000","last_clean":"2024-08-18T22:30:20.596844+0000","last_became_active":"2024-08-18T22:30:20.592609+0000","last_became_peered":"2024-08-18T22:30:20.592609+0000","last_unstale":"2024-08-18T22:30:20.596844+0000","last_undegraded":"2024-08-18T22:30:20.596844+0000","last_fullsized":"2024-08-18T22:30:20.596844+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:00.416089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.577412+0000","last_change":"2024-08-18T22:30:19.574945+0000","last_active":"2024-08-18T22:30:20.577412+0000","last_peered":"2024-08-18T22:30:20.577412+0000","last_clean":"2024-08-18T22:30:20.577412+0000","last_became_active":"2024-08-18T22:30:19.574691+0000","last_became_peered":"2024-08-18T22:30:19.574691+0000","last_unstale":"2024-08-18T22:30:20.577412+0000","last_undegraded":"2024-08-18T22:30:20.577412+0000","last_fullsized":"2024-08-18T22:30:20.577412+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:31:06.384235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582719+0000","last_change":"2024-08-18T22:30:20.585005+0000","last_active":"2024-08-18T22:30:21.582719+0000","last_peered":"2024-08-18T22:30:21.582719+0000","last_clean":"2024-08-18T22:30:21.582719+0000","last_became_active":"2024-08-18T22:30:20.584750+0000","last_became_peered":"2024-08-18T22:30:20.584750+0000","last_unstale":"2024-08-18T22:30:21.582719+0000","last_undegraded":"2024-08-18T22:30:21.582719+0000","last_fullsized":"2024-08-18T22:30:21.582719+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:09.166241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590618+0000","last_change":"2024-08-18T22:30:19.573379+0000","last_active":"2024-08-18T22:30:21.590618+0000","last_peered":"2024-08-18T22:30:21.590618+0000","last_clean":"2024-08-18T22:30:21.590618+0000","last_became_active":"2024-08-18T22:30:19.570148+0000","last_became_peered":"2024-08-18T22:30:19.570148+0000","last_unstale":"2024-08-18T22:30:21.590618+0000","last_undegraded":"2024-08-18T22:30:21.590618+0000","last_fullsized":"2024-08-18T22:30:21.590618+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:33:16.334650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.591065+0000","last_change":"2024-08-18T22:30:20.591371+0000","last_active":"2024-08-18T22:30:21.591065+0000","last_peered":"2024-08-18T22:30:21.591065+0000","last_clean":"2024-08-18T22:30:21.591065+0000","last_became_active":"2024-08-18T22:30:20.590378+0000","last_became_peered":"2024-08-18T22:30:20.590378+0000","last_unstale":"2024-08-18T22:30:21.591065+0000","last_undegraded":"2024-08-18T22:30:21.591065+0000","last_fullsized":"2024-08-18T22:30:21.591065+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:52:27.703243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675581+0000","last_change":"2024-08-18T22:30:19.567920+0000","last_active":"2024-08-18T22:30:21.675581+0000","last_peered":"2024-08-18T22:30:21.675581+0000","last_clean":"2024-08-18T22:30:21.675581+0000","last_became_active":"2024-08-18T22:30:19.567615+0000","last_became_peered":"2024-08-18T22:30:19.567615+0000","last_unstale":"2024-08-18T22:30:21.675581+0000","last_undegraded":"2024-08-18T22:30:21.675581+0000","last_fullsized":"2024-08-18T22:30:21.675581+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:01:57.427880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.591994+0000","last_change":"2024-08-18T22:30:20.588723+0000","last_active":"2024-08-18T22:30:20.591994+0000","last_peered":"2024-08-18T22:30:20.591994+0000","last_clean":"2024-08-18T22:30:20.591994+0000","last_became_active":"2024-08-18T22:30:20.588139+0000","last_became_peered":"2024-08-18T22:30:20.588139+0000","last_unstale":"2024-08-18T22:30:20.591994+0000","last_undegraded":"2024-08-18T22:30:20.591994+0000","last_fullsized":"2024-08-18T22:30:20.591994+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:06:34.374432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675753+0000","last_change":"2024-08-18T22:30:19.567575+0000","last_active":"2024-08-18T22:30:21.675753+0000","last_peered":"2024-08-18T22:30:21.675753+0000","last_clean":"2024-08-18T22:30:21.675753+0000","last_became_active":"2024-08-18T22:30:19.567290+0000","last_became_peered":"2024-08-18T22:30:19.567290+0000","last_unstale":"2024-08-18T22:30:21.675753+0000","last_undegraded":"2024-08-18T22:30:21.675753+0000","last_fullsized":"2024-08-18T22:30:21.675753+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:54.398044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582106+0000","last_change":"2024-08-18T22:30:20.588882+0000","last_active":"2024-08-18T22:30:21.582106+0000","last_peered":"2024-08-18T22:30:21.582106+0000","last_clean":"2024-08-18T22:30:21.582106+0000","last_became_active":"2024-08-18T22:30:20.587688+0000","last_became_peered":"2024-08-18T22:30:20.587688+0000","last_unstale":"2024-08-18T22:30:21.582106+0000","last_undegraded":"2024-08-18T22:30:21.582106+0000","last_fullsized":"2024-08-18T22:30:21.582106+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:48:39.208730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590958+0000","last_change":"2024-08-18T22:30:19.570369+0000","last_active":"2024-08-18T22:30:21.590958+0000","last_peered":"2024-08-18T22:30:21.590958+0000","last_clean":"2024-08-18T22:30:21.590958+0000","last_became_active":"2024-08-18T22:30:19.570108+0000","last_became_peered":"2024-08-18T22:30:19.570108+0000","last_unstale":"2024-08-18T22:30:21.590958+0000","last_undegraded":"2024-08-18T22:30:21.590958+0000","last_fullsized":"2024-08-18T22:30:21.590958+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:44:43.437202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":465,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582289+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:30:21.582289+0000","last_peered":"2024-08-18T22:30:21.582289+0000","last_clean":"2024-08-18T22:30:21.582289+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:30:21.582289+0000","last_undegraded":"2024-08-18T22:30:21.582289+0000","last_fullsized":"2024-08-18T22:30:21.582289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509578,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47680,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324160,"statfs":{"total":96636764160,"available":96587939840,"internally_reserved":0,"allocated":2670592,"data_stored":1570419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509580,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51264,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320576,"statfs":{"total":96636764160,"available":96584269824,"internally_reserved":0,"allocated":2076672,"data_stored":980051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51272,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320568,"statfs":{"total":96636764160,"available":96584261632,"internally_reserved":0,"allocated":2084864,"data_stored":980175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509579,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59604,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312236,"statfs":{"total":96636764160,"available":96575729664,"internally_reserved":0,"allocated":2097152,"data_stored":982267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509578,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55432,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316408,"statfs":{"total":96636764160,"available":96580001792,"internally_reserved":0,"allocated":2088960,"data_stored":981663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509579,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56008,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315832,"statfs":{"total":96636764160,"available":96579411968,"internally_reserved":0,"allocated":2678784,"data_stored":1570523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55392,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316448,"statfs":{"total":96636764160,"available":96580042752,"internally_reserved":0,"allocated":2052096,"data_stored":966192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55400,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316440,"statfs":{"total":96636764160,"available":96580034560,"internally_reserved":0,"allocated":2052096,"data_stored":966192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:30:24.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:30:24.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.885+0000 7f1bbb600640 1 Processor -- start 2024-08-18T22:30:24.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.885+0000 7f1bbb600640 1 -- start start 2024-08-18T22:30:24.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bbb600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1bb415a800 0x7f1bb40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bbb600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1bb40ce280 0x7f1bb406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bbb600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb40ce6c0 0x7f1bb406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bbb600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb40cb5d0 con 0x7f1bb40ce280 2024-08-18T22:30:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bbb600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb4072e60 con 0x7f1bb415a800 2024-08-18T22:30:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bbb600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb4073140 con 0x7f1bb40ce6c0 2024-08-18T22:30:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bb3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1bb40ce280 0x7f1bb406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bb3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1bb40ce280 0x7f1bb406ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42564/0 (socket says 172.21.15.5:42564) 2024-08-18T22:30:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bb3e00640 1 -- 172.21.15.5:0/2773459625 learned_addr learned my addr 172.21.15.5:0/2773459625 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bb9600640 1 --2- 172.21.15.5:0/2773459625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb40ce6c0 0x7f1bb406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bb8c00640 1 --2- 172.21.15.5:0/2773459625 >> v2:172.21.15.117:3300/0 conn(0x7f1bb415a800 0x7f1bb40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bb3e00640 1 -- 172.21.15.5:0/2773459625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb40ce6c0 msgr2=0x7f1bb406ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:24.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bb3e00640 1 --2- 172.21.15.5:0/2773459625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb40ce6c0 0x7f1bb406ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bb3e00640 1 -- 172.21.15.5:0/2773459625 >> v2:172.21.15.117:3300/0 conn(0x7f1bb415a800 msgr2=0x7f1bb40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:24.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bb3e00640 1 --2- 172.21.15.5:0/2773459625 >> v2:172.21.15.117:3300/0 conn(0x7f1bb415a800 0x7f1bb40caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.889+0000 7f1bb3e00640 1 -- 172.21.15.5:0/2773459625 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb4073420 con 0x7f1bb40ce280 2024-08-18T22:30:24.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bb3e00640 1 --2- 172.21.15.5:0/2773459625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bb40ce280 0x7f1bb406ea40 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40d0fd0 tx=0x7f1ba001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132584debbd6dac1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bb3400640 1 -- 172.21.15.5:0/2773459625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00b0070 con 0x7f1bb40ce280 2024-08-18T22:30:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bb3400640 1 -- 172.21.15.5:0/2773459625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba00ab600 con 0x7f1bb40ce280 2024-08-18T22:30:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bb3400640 1 -- 172.21.15.5:0/2773459625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00ab9d0 con 0x7f1bb40ce280 2024-08-18T22:30:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bbb600640 1 -- 172.21.15.5:0/2773459625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bb40ce280 msgr2=0x7f1bb406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bbb600640 1 --2- 172.21.15.5:0/2773459625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bb40ce280 0x7f1bb406ea40 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40d0fd0 tx=0x7f1ba001c520 comp rx=0 tx=0).stop 2024-08-18T22:30:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bbb600640 1 -- 172.21.15.5:0/2773459625 shutdown_connections 2024-08-18T22:30:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bbb600640 1 --2- 172.21.15.5:0/2773459625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb40ce6c0 0x7f1bb406ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bbb600640 1 --2- 172.21.15.5:0/2773459625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bb40ce280 0x7f1bb406ea40 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bbb600640 1 --2- 172.21.15.5:0/2773459625 >> v2:172.21.15.117:3300/0 conn(0x7f1bb415a800 0x7f1bb40caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bbb600640 1 -- 172.21.15.5:0/2773459625 >> 172.21.15.5:0/2773459625 conn(0x7f1bb40b1c50 msgr2=0x7f1bb40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bbb600640 1 -- 172.21.15.5:0/2773459625 shutdown_connections 2024-08-18T22:30:24.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bbb600640 1 -- 172.21.15.5:0/2773459625 wait complete. 2024-08-18T22:30:24.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bbb600640 1 Processor -- start 2024-08-18T22:30:24.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.893+0000 7f1bbb600640 1 -- start start 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bbb600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bb40ce280 0x7f1bb4152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bbb600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb40ce6c0 0x7f1bb40b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bbb600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bb415a800 0x7f1bb40b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bbb600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb415edb0 con 0x7f1bb415a800 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bbb600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb415ec30 con 0x7f1bb40ce280 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bbb600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb415ef30 con 0x7f1bb40ce6c0 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb9600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bb415a800 0x7f1bb40b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb9600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bb415a800 0x7f1bb40b51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42574/0 (socket says 172.21.15.5:42574) 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb9600640 1 -- 172.21.15.5:0/4267023834 learned_addr learned my addr 172.21.15.5:0/4267023834 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb3e00640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb40ce6c0 0x7f1bb40b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb8c00640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bb40ce280 0x7f1bb4152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb9600640 1 -- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb40ce6c0 msgr2=0x7f1bb40b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb9600640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb40ce6c0 0x7f1bb40b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb9600640 1 -- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bb40ce280 msgr2=0x7f1bb4152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb9600640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bb40ce280 0x7f1bb4152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb9600640 1 -- 172.21.15.5:0/4267023834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb4157ba0 con 0x7f1bb415a800 2024-08-18T22:30:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb9600640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bb415a800 0x7f1bb40b51a0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f1bac007db0 tx=0x7f1bac00d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb0c00640 1 -- 172.21.15.5:0/4267023834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00dba0 con 0x7f1bb415a800 2024-08-18T22:30:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb0c00640 1 -- 172.21.15.5:0/4267023834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac00dd60 con 0x7f1bb415a800 2024-08-18T22:30:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bbb600640 1 -- 172.21.15.5:0/4267023834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb4157e80 con 0x7f1bb415a800 2024-08-18T22:30:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb0c00640 1 -- 172.21.15.5:0/4267023834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac003be0 con 0x7f1bb415a800 2024-08-18T22:30:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bbb600640 1 -- 172.21.15.5:0/4267023834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb4158720 con 0x7f1bb415a800 2024-08-18T22:30:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bbb600640 1 -- 172.21.15.5:0/4267023834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb40caec0 con 0x7f1bb415a800 2024-08-18T22:30:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.897+0000 7f1bb0c00640 1 -- 172.21.15.5:0/4267023834 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1bac01a020 con 0x7f1bb415a800 2024-08-18T22:30:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.901+0000 7f1bb0c00640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1b940678f0 0x7f1b94069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.901+0000 7f1bb0c00640 1 -- 172.21.15.5:0/4267023834 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f1bac085dc0 con 0x7f1bb415a800 2024-08-18T22:30:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.901+0000 7f1bb8c00640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1b940678f0 0x7f1b94069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.901+0000 7f1bb8c00640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1b940678f0 0x7f1b94069db0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40079c0 tx=0x7f1ba4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:24.905+0000 7f1bb0c00640 1 -- 172.21.15.5:0/4267023834 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1bac056080 con 0x7f1bb415a800 2024-08-18T22:30:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.065+0000 7f1bbb600640 1 -- 172.21.15.5:0/4267023834 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1bb40cd910 con 0x7f1b940678f0 2024-08-18T22:30:25.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.073+0000 7f1bb0c00640 1 -- 172.21.15.5:0/4267023834 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252463 (secure 0 0 0) 0x7f1bb40cd910 con 0x7f1b940678f0 2024-08-18T22:30:25.074 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:30:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 -- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1b940678f0 msgr2=0x7f1b94069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1b940678f0 0x7f1b94069db0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40079c0 tx=0x7f1ba4008040 comp rx=0 tx=0).stop 2024-08-18T22:30:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 -- 172.21.15.5:0/4267023834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bb415a800 msgr2=0x7f1bb40b51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bb415a800 0x7f1bb40b51a0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f1bac007db0 tx=0x7f1bac00d490 comp rx=0 tx=0).stop 2024-08-18T22:30:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 -- 172.21.15.5:0/4267023834 shutdown_connections 2024-08-18T22:30:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1b940678f0 0x7f1b94069db0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bb415a800 0x7f1bb40b51a0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bb40ce6c0 0x7f1bb40b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 --2- 172.21.15.5:0/4267023834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bb40ce280 0x7f1bb4152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 -- 172.21.15.5:0/4267023834 >> 172.21.15.5:0/4267023834 conn(0x7f1bb40b1c50 msgr2=0x7f1bb40b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 -- 172.21.15.5:0/4267023834 shutdown_connections 2024-08-18T22:30:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.077+0000 7f1bbb600640 1 -- 172.21.15.5:0/4267023834 wait complete. 2024-08-18T22:30:25.094 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-08-18T22:30:23.783354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":432052,"kb_used_data":17384,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754542668,"statfs":{"total":773094113280,"available":772651692032,"internally_reserved":0,"allocated":17801216,"data_stored":8997482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":424463920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.238271"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.588260+0000","last_change":"2024-08-18T22:30:20.587462+0000","last_active":"2024-08-18T22:30:20.588260+0000","last_peered":"2024-08-18T22:30:20.588260+0000","last_clean":"2024-08-18T22:30:20.588260+0000","last_became_active":"2024-08-18T22:30:20.587171+0000","last_became_peered":"2024-08-18T22:30:20.587171+0000","last_unstale":"2024-08-18T22:30:20.588260+0000","last_undegraded":"2024-08-18T22:30:20.588260+0000","last_fullsized":"2024-08-18T22:30:20.588260+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:36:23.092549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582256+0000","last_change":"2024-08-18T22:30:20.583494+0000","last_active":"2024-08-18T22:30:21.582256+0000","last_peered":"2024-08-18T22:30:21.582256+0000","last_clean":"2024-08-18T22:30:21.582256+0000","last_became_active":"2024-08-18T22:30:20.583177+0000","last_became_peered":"2024-08-18T22:30:20.583177+0000","last_unstale":"2024-08-18T22:30:21.582256+0000","last_undegraded":"2024-08-18T22:30:21.582256+0000","last_fullsized":"2024-08-18T22:30:21.582256+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:52:11.973629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.586322+0000","last_change":"2024-08-18T22:30:20.583215+0000","last_active":"2024-08-18T22:30:20.586322+0000","last_peered":"2024-08-18T22:30:20.586322+0000","last_clean":"2024-08-18T22:30:20.586322+0000","last_became_active":"2024-08-18T22:30:20.581435+0000","last_became_peered":"2024-08-18T22:30:20.581435+0000","last_unstale":"2024-08-18T22:30:20.586322+0000","last_undegraded":"2024-08-18T22:30:20.586322+0000","last_fullsized":"2024-08-18T22:30:20.586322+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:43:56.817730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596880+0000","last_change":"2024-08-18T22:30:20.593647+0000","last_active":"2024-08-18T22:30:20.596880+0000","last_peered":"2024-08-18T22:30:20.596880+0000","last_clean":"2024-08-18T22:30:20.596880+0000","last_became_active":"2024-08-18T22:30:20.592198+0000","last_became_peered":"2024-08-18T22:30:20.592198+0000","last_unstale":"2024-08-18T22:30:20.596880+0000","last_undegraded":"2024-08-18T22:30:20.596880+0000","last_fullsized":"2024-08-18T22:30:20.596880+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:13:09.063990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676187+0000","last_change":"2024-08-18T22:30:20.590767+0000","last_active":"2024-08-18T22:30:21.676187+0000","last_peered":"2024-08-18T22:30:21.676187+0000","last_clean":"2024-08-18T22:30:21.676187+0000","last_became_active":"2024-08-18T22:30:20.590498+0000","last_became_peered":"2024-08-18T22:30:20.590498+0000","last_unstale":"2024-08-18T22:30:21.676187+0000","last_undegraded":"2024-08-18T22:30:21.676187+0000","last_fullsized":"2024-08-18T22:30:21.676187+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:35:03.751898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582399+0000","last_change":"2024-08-18T22:30:20.582736+0000","last_active":"2024-08-18T22:30:21.582399+0000","last_peered":"2024-08-18T22:30:21.582399+0000","last_clean":"2024-08-18T22:30:21.582399+0000","last_became_active":"2024-08-18T22:30:20.582477+0000","last_became_peered":"2024-08-18T22:30:20.582477+0000","last_unstale":"2024-08-18T22:30:21.582399+0000","last_undegraded":"2024-08-18T22:30:21.582399+0000","last_fullsized":"2024-08-18T22:30:21.582399+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:52:49.467854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593161+0000","last_change":"2024-08-18T22:30:20.583528+0000","last_active":"2024-08-18T22:30:21.593161+0000","last_peered":"2024-08-18T22:30:21.593161+0000","last_clean":"2024-08-18T22:30:21.593161+0000","last_became_active":"2024-08-18T22:30:20.583243+0000","last_became_peered":"2024-08-18T22:30:20.583243+0000","last_unstale":"2024-08-18T22:30:21.593161+0000","last_undegraded":"2024-08-18T22:30:21.593161+0000","last_fullsized":"2024-08-18T22:30:21.593161+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:48.513034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.592925+0000","last_change":"2024-08-18T22:30:20.588459+0000","last_active":"2024-08-18T22:30:21.592925+0000","last_peered":"2024-08-18T22:30:21.592925+0000","last_clean":"2024-08-18T22:30:21.592925+0000","last_became_active":"2024-08-18T22:30:20.587965+0000","last_became_peered":"2024-08-18T22:30:20.587965+0000","last_unstale":"2024-08-18T22:30:21.592925+0000","last_undegraded":"2024-08-18T22:30:21.592925+0000","last_fullsized":"2024-08-18T22:30:21.592925+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:14:57.559207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593441+0000","last_change":"2024-08-18T22:30:20.586506+0000","last_active":"2024-08-18T22:30:21.593441+0000","last_peered":"2024-08-18T22:30:21.593441+0000","last_clean":"2024-08-18T22:30:21.593441+0000","last_became_active":"2024-08-18T22:30:20.586244+0000","last_became_peered":"2024-08-18T22:30:20.586244+0000","last_unstale":"2024-08-18T22:30:21.593441+0000","last_undegraded":"2024-08-18T22:30:21.593441+0000","last_fullsized":"2024-08-18T22:30:21.593441+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:26:46.488602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593534+0000","last_change":"2024-08-18T22:30:20.592278+0000","last_active":"2024-08-18T22:30:21.593534+0000","last_peered":"2024-08-18T22:30:21.593534+0000","last_clean":"2024-08-18T22:30:21.593534+0000","last_became_active":"2024-08-18T22:30:20.589154+0000","last_became_peered":"2024-08-18T22:30:20.589154+0000","last_unstale":"2024-08-18T22:30:21.593534+0000","last_undegraded":"2024-08-18T22:30:21.593534+0000","last_fullsized":"2024-08-18T22:30:21.593534+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:01:53.550642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675819+0000","last_change":"2024-08-18T22:30:20.589119+0000","last_active":"2024-08-18T22:30:21.675819+0000","last_peered":"2024-08-18T22:30:21.675819+0000","last_clean":"2024-08-18T22:30:21.675819+0000","last_became_active":"2024-08-18T22:30:20.588829+0000","last_became_peered":"2024-08-18T22:30:20.588829+0000","last_unstale":"2024-08-18T22:30:21.675819+0000","last_undegraded":"2024-08-18T22:30:21.675819+0000","last_fullsized":"2024-08-18T22:30:21.675819+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:30.614103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582700+0000","last_change":"2024-08-18T22:30:20.586732+0000","last_active":"2024-08-18T22:30:21.582700+0000","last_peered":"2024-08-18T22:30:21.582700+0000","last_clean":"2024-08-18T22:30:21.582700+0000","last_became_active":"2024-08-18T22:30:20.585874+0000","last_became_peered":"2024-08-18T22:30:20.585874+0000","last_unstale":"2024-08-18T22:30:21.582700+0000","last_undegraded":"2024-08-18T22:30:21.582700+0000","last_fullsized":"2024-08-18T22:30:21.582700+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:44:44.445124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590614+0000","last_change":"2024-08-18T22:30:20.585961+0000","last_active":"2024-08-18T22:30:21.590614+0000","last_peered":"2024-08-18T22:30:21.590614+0000","last_clean":"2024-08-18T22:30:21.590614+0000","last_became_active":"2024-08-18T22:30:20.585703+0000","last_became_peered":"2024-08-18T22:30:20.585703+0000","last_unstale":"2024-08-18T22:30:21.590614+0000","last_undegraded":"2024-08-18T22:30:21.590614+0000","last_fullsized":"2024-08-18T22:30:21.590614+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:22.406287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676082+0000","last_change":"2024-08-18T22:30:20.584745+0000","last_active":"2024-08-18T22:30:21.676082+0000","last_peered":"2024-08-18T22:30:21.676082+0000","last_clean":"2024-08-18T22:30:21.676082+0000","last_became_active":"2024-08-18T22:30:20.584276+0000","last_became_peered":"2024-08-18T22:30:20.584276+0000","last_unstale":"2024-08-18T22:30:21.676082+0000","last_undegraded":"2024-08-18T22:30:21.676082+0000","last_fullsized":"2024-08-18T22:30:21.676082+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:39.917528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675470+0000","last_change":"2024-08-18T22:30:20.580273+0000","last_active":"2024-08-18T22:30:21.675470+0000","last_peered":"2024-08-18T22:30:21.675470+0000","last_clean":"2024-08-18T22:30:21.675470+0000","last_became_active":"2024-08-18T22:30:20.579782+0000","last_became_peered":"2024-08-18T22:30:20.579782+0000","last_unstale":"2024-08-18T22:30:21.675470+0000","last_undegraded":"2024-08-18T22:30:21.675470+0000","last_fullsized":"2024-08-18T22:30:21.675470+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:17:48.513034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596779+0000","last_change":"2024-08-18T22:30:20.592538+0000","last_active":"2024-08-18T22:30:20.596779+0000","last_peered":"2024-08-18T22:30:20.596779+0000","last_clean":"2024-08-18T22:30:20.596779+0000","last_became_active":"2024-08-18T22:30:20.592133+0000","last_became_peered":"2024-08-18T22:30:20.592133+0000","last_unstale":"2024-08-18T22:30:20.596779+0000","last_undegraded":"2024-08-18T22:30:20.596779+0000","last_fullsized":"2024-08-18T22:30:20.596779+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:37:35.839972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593504+0000","last_change":"2024-08-18T22:30:20.594232+0000","last_active":"2024-08-18T22:30:21.593504+0000","last_peered":"2024-08-18T22:30:21.593504+0000","last_clean":"2024-08-18T22:30:21.593504+0000","last_became_active":"2024-08-18T22:30:20.593977+0000","last_became_peered":"2024-08-18T22:30:20.593977+0000","last_unstale":"2024-08-18T22:30:21.593504+0000","last_undegraded":"2024-08-18T22:30:21.593504+0000","last_fullsized":"2024-08-18T22:30:21.593504+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:12:30.614103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.578033+0000","last_change":"2024-08-18T22:30:20.580725+0000","last_active":"2024-08-18T22:30:21.578033+0000","last_peered":"2024-08-18T22:30:21.578033+0000","last_clean":"2024-08-18T22:30:21.578033+0000","last_became_active":"2024-08-18T22:30:20.580467+0000","last_became_peered":"2024-08-18T22:30:20.580467+0000","last_unstale":"2024-08-18T22:30:21.578033+0000","last_undegraded":"2024-08-18T22:30:21.578033+0000","last_fullsized":"2024-08-18T22:30:21.578033+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:15:31.466864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675696+0000","last_change":"2024-08-18T22:30:20.578975+0000","last_active":"2024-08-18T22:30:21.675696+0000","last_peered":"2024-08-18T22:30:21.675696+0000","last_clean":"2024-08-18T22:30:21.675696+0000","last_became_active":"2024-08-18T22:30:20.578702+0000","last_became_peered":"2024-08-18T22:30:20.578702+0000","last_unstale":"2024-08-18T22:30:21.675696+0000","last_undegraded":"2024-08-18T22:30:21.675696+0000","last_fullsized":"2024-08-18T22:30:21.675696+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:26:46.488602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596372+0000","last_change":"2024-08-18T22:30:20.595104+0000","last_active":"2024-08-18T22:30:20.596372+0000","last_peered":"2024-08-18T22:30:20.596372+0000","last_clean":"2024-08-18T22:30:20.596372+0000","last_became_active":"2024-08-18T22:30:20.593935+0000","last_became_peered":"2024-08-18T22:30:20.593935+0000","last_unstale":"2024-08-18T22:30:20.596372+0000","last_undegraded":"2024-08-18T22:30:20.596372+0000","last_fullsized":"2024-08-18T22:30:20.596372+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:17.563680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590725+0000","last_change":"2024-08-18T22:30:20.595352+0000","last_active":"2024-08-18T22:30:21.590725+0000","last_peered":"2024-08-18T22:30:21.590725+0000","last_clean":"2024-08-18T22:30:21.590725+0000","last_became_active":"2024-08-18T22:30:20.590468+0000","last_became_peered":"2024-08-18T22:30:20.590468+0000","last_unstale":"2024-08-18T22:30:21.590725+0000","last_undegraded":"2024-08-18T22:30:21.590725+0000","last_fullsized":"2024-08-18T22:30:21.590725+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:08.035642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582137+0000","last_change":"2024-08-18T22:30:20.596705+0000","last_active":"2024-08-18T22:30:21.582137+0000","last_peered":"2024-08-18T22:30:21.582137+0000","last_clean":"2024-08-18T22:30:21.582137+0000","last_became_active":"2024-08-18T22:30:20.596434+0000","last_became_peered":"2024-08-18T22:30:20.596434+0000","last_unstale":"2024-08-18T22:30:21.582137+0000","last_undegraded":"2024-08-18T22:30:21.582137+0000","last_fullsized":"2024-08-18T22:30:21.582137+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:40:23.787740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675900+0000","last_change":"2024-08-18T22:30:20.589627+0000","last_active":"2024-08-18T22:30:21.675900+0000","last_peered":"2024-08-18T22:30:21.675900+0000","last_clean":"2024-08-18T22:30:21.675900+0000","last_became_active":"2024-08-18T22:30:20.589361+0000","last_became_peered":"2024-08-18T22:30:20.589361+0000","last_unstale":"2024-08-18T22:30:21.675900+0000","last_undegraded":"2024-08-18T22:30:21.675900+0000","last_fullsized":"2024-08-18T22:30:21.675900+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:52:52.678944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596803+0000","last_change":"2024-08-18T22:30:20.592954+0000","last_active":"2024-08-18T22:30:20.596803+0000","last_peered":"2024-08-18T22:30:20.596803+0000","last_clean":"2024-08-18T22:30:20.596803+0000","last_became_active":"2024-08-18T22:30:20.592579+0000","last_became_peered":"2024-08-18T22:30:20.592579+0000","last_unstale":"2024-08-18T22:30:20.596803+0000","last_undegraded":"2024-08-18T22:30:20.596803+0000","last_fullsized":"2024-08-18T22:30:20.596803+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:21:58.995130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.591173+0000","last_change":"2024-08-18T22:30:20.581912+0000","last_active":"2024-08-18T22:30:21.591173+0000","last_peered":"2024-08-18T22:30:21.591173+0000","last_clean":"2024-08-18T22:30:21.591173+0000","last_became_active":"2024-08-18T22:30:20.580183+0000","last_became_peered":"2024-08-18T22:30:20.580183+0000","last_unstale":"2024-08-18T22:30:21.591173+0000","last_undegraded":"2024-08-18T22:30:21.591173+0000","last_fullsized":"2024-08-18T22:30:21.591173+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:54:48.620490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.590801+0000","last_change":"2024-08-18T22:30:20.588490+0000","last_active":"2024-08-18T22:30:20.590801+0000","last_peered":"2024-08-18T22:30:20.590801+0000","last_clean":"2024-08-18T22:30:20.590801+0000","last_became_active":"2024-08-18T22:30:20.587791+0000","last_became_peered":"2024-08-18T22:30:20.587791+0000","last_unstale":"2024-08-18T22:30:20.590801+0000","last_undegraded":"2024-08-18T22:30:20.590801+0000","last_fullsized":"2024-08-18T22:30:20.590801+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:24.352016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582684+0000","last_change":"2024-08-18T22:30:20.596704+0000","last_active":"2024-08-18T22:30:21.582684+0000","last_peered":"2024-08-18T22:30:21.582684+0000","last_clean":"2024-08-18T22:30:21.582684+0000","last_became_active":"2024-08-18T22:30:20.596366+0000","last_became_peered":"2024-08-18T22:30:20.596366+0000","last_unstale":"2024-08-18T22:30:21.582684+0000","last_undegraded":"2024-08-18T22:30:21.582684+0000","last_fullsized":"2024-08-18T22:30:21.582684+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:55.405966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590735+0000","last_change":"2024-08-18T22:30:20.591292+0000","last_active":"2024-08-18T22:30:21.590735+0000","last_peered":"2024-08-18T22:30:21.590735+0000","last_clean":"2024-08-18T22:30:21.590735+0000","last_became_active":"2024-08-18T22:30:20.591033+0000","last_became_peered":"2024-08-18T22:30:20.591033+0000","last_unstale":"2024-08-18T22:30:21.590735+0000","last_undegraded":"2024-08-18T22:30:21.590735+0000","last_fullsized":"2024-08-18T22:30:21.590735+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:44:44.373899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582606+0000","last_change":"2024-08-18T22:30:20.592274+0000","last_active":"2024-08-18T22:30:21.582606+0000","last_peered":"2024-08-18T22:30:21.582606+0000","last_clean":"2024-08-18T22:30:21.582606+0000","last_became_active":"2024-08-18T22:30:20.591930+0000","last_became_peered":"2024-08-18T22:30:20.591930+0000","last_unstale":"2024-08-18T22:30:21.582606+0000","last_undegraded":"2024-08-18T22:30:21.582606+0000","last_fullsized":"2024-08-18T22:30:21.582606+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:13:05.550471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.577981+0000","last_change":"2024-08-18T22:30:20.589162+0000","last_active":"2024-08-18T22:30:21.577981+0000","last_peered":"2024-08-18T22:30:21.577981+0000","last_clean":"2024-08-18T22:30:21.577981+0000","last_became_active":"2024-08-18T22:30:20.588749+0000","last_became_peered":"2024-08-18T22:30:20.588749+0000","last_unstale":"2024-08-18T22:30:21.577981+0000","last_undegraded":"2024-08-18T22:30:21.577981+0000","last_fullsized":"2024-08-18T22:30:21.577981+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:52.306028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675507+0000","last_change":"2024-08-18T22:30:20.572672+0000","last_active":"2024-08-18T22:30:21.675507+0000","last_peered":"2024-08-18T22:30:21.675507+0000","last_clean":"2024-08-18T22:30:21.675507+0000","last_became_active":"2024-08-18T22:30:20.572400+0000","last_became_peered":"2024-08-18T22:30:20.572400+0000","last_unstale":"2024-08-18T22:30:21.675507+0000","last_undegraded":"2024-08-18T22:30:21.675507+0000","last_fullsized":"2024-08-18T22:30:21.675507+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:32:23.415945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.577671+0000","last_change":"2024-08-18T22:30:20.580232+0000","last_active":"2024-08-18T22:30:21.577671+0000","last_peered":"2024-08-18T22:30:21.577671+0000","last_clean":"2024-08-18T22:30:21.577671+0000","last_became_active":"2024-08-18T22:30:20.579959+0000","last_became_peered":"2024-08-18T22:30:20.579959+0000","last_unstale":"2024-08-18T22:30:21.577671+0000","last_undegraded":"2024-08-18T22:30:21.577671+0000","last_fullsized":"2024-08-18T22:30:21.577671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:17.168331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582120+0000","last_change":"2024-08-18T22:30:20.584432+0000","last_active":"2024-08-18T22:30:21.582120+0000","last_peered":"2024-08-18T22:30:21.582120+0000","last_clean":"2024-08-18T22:30:21.582120+0000","last_became_active":"2024-08-18T22:30:20.584127+0000","last_became_peered":"2024-08-18T22:30:20.584127+0000","last_unstale":"2024-08-18T22:30:21.582120+0000","last_undegraded":"2024-08-18T22:30:21.582120+0000","last_fullsized":"2024-08-18T22:30:21.582120+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:18.224275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"165'4","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.603418+0000","last_change":"2024-08-18T22:30:19.575013+0000","last_active":"2024-08-18T22:30:20.603418+0000","last_peered":"2024-08-18T22:30:20.603418+0000","last_clean":"2024-08-18T22:30:20.603418+0000","last_became_active":"2024-08-18T22:30:19.574646+0000","last_became_peered":"2024-08-18T22:30:19.574646+0000","last_unstale":"2024-08-18T22:30:20.603418+0000","last_undegraded":"2024-08-18T22:30:20.603418+0000","last_fullsized":"2024-08-18T22:30:20.603418+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:24.062096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590485+0000","last_change":"2024-08-18T22:30:20.588919+0000","last_active":"2024-08-18T22:30:21.590485+0000","last_peered":"2024-08-18T22:30:21.590485+0000","last_clean":"2024-08-18T22:30:21.590485+0000","last_became_active":"2024-08-18T22:30:20.588661+0000","last_became_peered":"2024-08-18T22:30:20.588661+0000","last_unstale":"2024-08-18T22:30:21.590485+0000","last_undegraded":"2024-08-18T22:30:21.590485+0000","last_fullsized":"2024-08-18T22:30:21.590485+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:35:03.751898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676452+0000","last_change":"2024-08-18T22:30:19.568781+0000","last_active":"2024-08-18T22:30:21.676452+0000","last_peered":"2024-08-18T22:30:21.676452+0000","last_clean":"2024-08-18T22:30:21.676452+0000","last_became_active":"2024-08-18T22:30:19.568472+0000","last_became_peered":"2024-08-18T22:30:19.568472+0000","last_unstale":"2024-08-18T22:30:21.676452+0000","last_undegraded":"2024-08-18T22:30:21.676452+0000","last_fullsized":"2024-08-18T22:30:21.676452+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:15.704018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676010+0000","last_change":"2024-08-18T22:30:20.584534+0000","last_active":"2024-08-18T22:30:21.676010+0000","last_peered":"2024-08-18T22:30:21.676010+0000","last_clean":"2024-08-18T22:30:21.676010+0000","last_became_active":"2024-08-18T22:30:20.583778+0000","last_became_peered":"2024-08-18T22:30:20.583778+0000","last_unstale":"2024-08-18T22:30:21.676010+0000","last_undegraded":"2024-08-18T22:30:21.676010+0000","last_fullsized":"2024-08-18T22:30:21.676010+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:03.744978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675892+0000","last_change":"2024-08-18T22:30:19.567920+0000","last_active":"2024-08-18T22:30:21.675892+0000","last_peered":"2024-08-18T22:30:21.675892+0000","last_clean":"2024-08-18T22:30:21.675892+0000","last_became_active":"2024-08-18T22:30:19.567602+0000","last_became_peered":"2024-08-18T22:30:19.567602+0000","last_unstale":"2024-08-18T22:30:21.675892+0000","last_undegraded":"2024-08-18T22:30:21.675892+0000","last_fullsized":"2024-08-18T22:30:21.675892+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:16:59.965215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582531+0000","last_change":"2024-08-18T22:30:20.593429+0000","last_active":"2024-08-18T22:30:21.582531+0000","last_peered":"2024-08-18T22:30:21.582531+0000","last_clean":"2024-08-18T22:30:21.582531+0000","last_became_active":"2024-08-18T22:30:20.593119+0000","last_became_peered":"2024-08-18T22:30:20.593119+0000","last_unstale":"2024-08-18T22:30:21.582531+0000","last_undegraded":"2024-08-18T22:30:21.582531+0000","last_fullsized":"2024-08-18T22:30:21.582531+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:13.973958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"165'2","reported_seq":14,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.603579+0000","last_change":"2024-08-18T22:30:19.567076+0000","last_active":"2024-08-18T22:30:20.603579+0000","last_peered":"2024-08-18T22:30:20.603579+0000","last_clean":"2024-08-18T22:30:20.603579+0000","last_became_active":"2024-08-18T22:30:19.566836+0000","last_became_peered":"2024-08-18T22:30:19.566836+0000","last_unstale":"2024-08-18T22:30:20.603579+0000","last_undegraded":"2024-08-18T22:30:20.603579+0000","last_fullsized":"2024-08-18T22:30:20.603579+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:47.739538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593239+0000","last_change":"2024-08-18T22:30:20.587120+0000","last_active":"2024-08-18T22:30:21.593239+0000","last_peered":"2024-08-18T22:30:21.593239+0000","last_clean":"2024-08-18T22:30:21.593239+0000","last_became_active":"2024-08-18T22:30:20.586850+0000","last_became_peered":"2024-08-18T22:30:20.586850+0000","last_unstale":"2024-08-18T22:30:21.593239+0000","last_undegraded":"2024-08-18T22:30:21.593239+0000","last_fullsized":"2024-08-18T22:30:21.593239+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:46.143640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593069+0000","last_change":"2024-08-18T22:30:19.569375+0000","last_active":"2024-08-18T22:30:21.593069+0000","last_peered":"2024-08-18T22:30:21.593069+0000","last_clean":"2024-08-18T22:30:21.593069+0000","last_became_active":"2024-08-18T22:30:19.568984+0000","last_became_peered":"2024-08-18T22:30:19.568984+0000","last_unstale":"2024-08-18T22:30:21.593069+0000","last_undegraded":"2024-08-18T22:30:21.593069+0000","last_fullsized":"2024-08-18T22:30:21.593069+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:44:49.776785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.589491+0000","last_change":"2024-08-18T22:30:20.584746+0000","last_active":"2024-08-18T22:30:20.589491+0000","last_peered":"2024-08-18T22:30:20.589491+0000","last_clean":"2024-08-18T22:30:20.589491+0000","last_became_active":"2024-08-18T22:30:20.584454+0000","last_became_peered":"2024-08-18T22:30:20.584454+0000","last_unstale":"2024-08-18T22:30:20.589491+0000","last_undegraded":"2024-08-18T22:30:20.589491+0000","last_fullsized":"2024-08-18T22:30:20.589491+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:36:47.410380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676060+0000","last_change":"2024-08-18T22:30:19.577474+0000","last_active":"2024-08-18T22:30:21.676060+0000","last_peered":"2024-08-18T22:30:21.676060+0000","last_clean":"2024-08-18T22:30:21.676060+0000","last_became_active":"2024-08-18T22:30:19.577186+0000","last_became_peered":"2024-08-18T22:30:19.577186+0000","last_unstale":"2024-08-18T22:30:21.676060+0000","last_undegraded":"2024-08-18T22:30:21.676060+0000","last_fullsized":"2024-08-18T22:30:21.676060+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:44:43.437202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.591920+0000","last_change":"2024-08-18T22:30:20.588715+0000","last_active":"2024-08-18T22:30:20.591920+0000","last_peered":"2024-08-18T22:30:20.591920+0000","last_clean":"2024-08-18T22:30:20.591920+0000","last_became_active":"2024-08-18T22:30:20.588188+0000","last_became_peered":"2024-08-18T22:30:20.588188+0000","last_unstale":"2024-08-18T22:30:20.591920+0000","last_undegraded":"2024-08-18T22:30:20.591920+0000","last_fullsized":"2024-08-18T22:30:20.591920+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:05:54.249938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.574772+0000","last_change":"2024-08-18T22:30:19.573068+0000","last_active":"2024-08-18T22:30:20.574772+0000","last_peered":"2024-08-18T22:30:20.574772+0000","last_clean":"2024-08-18T22:30:20.574772+0000","last_became_active":"2024-08-18T22:30:19.572731+0000","last_became_peered":"2024-08-18T22:30:19.572731+0000","last_unstale":"2024-08-18T22:30:20.574772+0000","last_undegraded":"2024-08-18T22:30:20.574772+0000","last_fullsized":"2024-08-18T22:30:20.574772+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:58.701572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.587340+0000","last_change":"2024-08-18T22:30:20.585225+0000","last_active":"2024-08-18T22:30:20.587340+0000","last_peered":"2024-08-18T22:30:20.587340+0000","last_clean":"2024-08-18T22:30:20.587340+0000","last_became_active":"2024-08-18T22:30:20.584959+0000","last_became_peered":"2024-08-18T22:30:20.584959+0000","last_unstale":"2024-08-18T22:30:20.587340+0000","last_undegraded":"2024-08-18T22:30:20.587340+0000","last_fullsized":"2024-08-18T22:30:20.587340+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:50:12.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.592999+0000","last_change":"2024-08-18T22:30:19.565786+0000","last_active":"2024-08-18T22:30:21.592999+0000","last_peered":"2024-08-18T22:30:21.592999+0000","last_clean":"2024-08-18T22:30:21.592999+0000","last_became_active":"2024-08-18T22:30:19.564822+0000","last_became_peered":"2024-08-18T22:30:19.564822+0000","last_unstale":"2024-08-18T22:30:21.592999+0000","last_undegraded":"2024-08-18T22:30:21.592999+0000","last_fullsized":"2024-08-18T22:30:21.592999+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:51:07.756831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582342+0000","last_change":"2024-08-18T22:30:20.581202+0000","last_active":"2024-08-18T22:30:21.582342+0000","last_peered":"2024-08-18T22:30:21.582342+0000","last_clean":"2024-08-18T22:30:21.582342+0000","last_became_active":"2024-08-18T22:30:20.579054+0000","last_became_peered":"2024-08-18T22:30:20.579054+0000","last_unstale":"2024-08-18T22:30:21.582342+0000","last_undegraded":"2024-08-18T22:30:21.582342+0000","last_fullsized":"2024-08-18T22:30:21.582342+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:25:35.713474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.591027+0000","last_change":"2024-08-18T22:30:19.575419+0000","last_active":"2024-08-18T22:30:21.591027+0000","last_peered":"2024-08-18T22:30:21.591027+0000","last_clean":"2024-08-18T22:30:21.591027+0000","last_became_active":"2024-08-18T22:30:19.575015+0000","last_became_peered":"2024-08-18T22:30:19.575015+0000","last_unstale":"2024-08-18T22:30:21.591027+0000","last_undegraded":"2024-08-18T22:30:21.591027+0000","last_fullsized":"2024-08-18T22:30:21.591027+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:39:14.013272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590508+0000","last_change":"2024-08-18T22:30:20.577603+0000","last_active":"2024-08-18T22:30:21.590508+0000","last_peered":"2024-08-18T22:30:21.590508+0000","last_clean":"2024-08-18T22:30:21.590508+0000","last_became_active":"2024-08-18T22:30:20.577316+0000","last_became_peered":"2024-08-18T22:30:20.577316+0000","last_unstale":"2024-08-18T22:30:21.590508+0000","last_undegraded":"2024-08-18T22:30:21.590508+0000","last_fullsized":"2024-08-18T22:30:21.590508+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:54:37.754491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"165'3","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.599430+0000","last_change":"2024-08-18T22:30:19.566222+0000","last_active":"2024-08-18T22:30:20.599430+0000","last_peered":"2024-08-18T22:30:20.599430+0000","last_clean":"2024-08-18T22:30:20.599430+0000","last_became_active":"2024-08-18T22:30:19.565901+0000","last_became_peered":"2024-08-18T22:30:19.565901+0000","last_unstale":"2024-08-18T22:30:20.599430+0000","last_undegraded":"2024-08-18T22:30:20.599430+0000","last_fullsized":"2024-08-18T22:30:20.599430+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:40.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596628+0000","last_change":"2024-08-18T22:30:20.593802+0000","last_active":"2024-08-18T22:30:20.596628+0000","last_peered":"2024-08-18T22:30:20.596628+0000","last_clean":"2024-08-18T22:30:20.596628+0000","last_became_active":"2024-08-18T22:30:20.593519+0000","last_became_peered":"2024-08-18T22:30:20.593519+0000","last_unstale":"2024-08-18T22:30:20.596628+0000","last_undegraded":"2024-08-18T22:30:20.596628+0000","last_fullsized":"2024-08-18T22:30:20.596628+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:58.563391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"165'6","reported_seq":20,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590808+0000","last_change":"2024-08-18T22:30:19.573085+0000","last_active":"2024-08-18T22:30:21.590808+0000","last_peered":"2024-08-18T22:30:21.590808+0000","last_clean":"2024-08-18T22:30:21.590808+0000","last_became_active":"2024-08-18T22:30:19.572794+0000","last_became_peered":"2024-08-18T22:30:19.572794+0000","last_unstale":"2024-08-18T22:30:21.590808+0000","last_undegraded":"2024-08-18T22:30:21.590808+0000","last_fullsized":"2024-08-18T22:30:21.590808+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:25:02.938374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.577951+0000","last_change":"2024-08-18T22:30:20.578030+0000","last_active":"2024-08-18T22:30:21.577951+0000","last_peered":"2024-08-18T22:30:21.577951+0000","last_clean":"2024-08-18T22:30:21.577951+0000","last_became_active":"2024-08-18T22:30:20.577747+0000","last_became_peered":"2024-08-18T22:30:20.577747+0000","last_unstale":"2024-08-18T22:30:21.577951+0000","last_undegraded":"2024-08-18T22:30:21.577951+0000","last_fullsized":"2024-08-18T22:30:21.577951+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:51:08.764754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676198+0000","last_change":"2024-08-18T22:30:19.575675+0000","last_active":"2024-08-18T22:30:21.676198+0000","last_peered":"2024-08-18T22:30:21.676198+0000","last_clean":"2024-08-18T22:30:21.676198+0000","last_became_active":"2024-08-18T22:30:19.575388+0000","last_became_peered":"2024-08-18T22:30:19.575388+0000","last_unstale":"2024-08-18T22:30:21.676198+0000","last_undegraded":"2024-08-18T22:30:21.676198+0000","last_fullsized":"2024-08-18T22:30:21.676198+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:08.158319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593367+0000","last_change":"2024-08-18T22:30:20.599600+0000","last_active":"2024-08-18T22:30:21.593367+0000","last_peered":"2024-08-18T22:30:21.593367+0000","last_clean":"2024-08-18T22:30:21.593367+0000","last_became_active":"2024-08-18T22:30:20.599316+0000","last_became_peered":"2024-08-18T22:30:20.599316+0000","last_unstale":"2024-08-18T22:30:21.593367+0000","last_undegraded":"2024-08-18T22:30:21.593367+0000","last_fullsized":"2024-08-18T22:30:21.593367+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:12.349849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590717+0000","last_change":"2024-08-18T22:30:19.564405+0000","last_active":"2024-08-18T22:30:21.590717+0000","last_peered":"2024-08-18T22:30:21.590717+0000","last_clean":"2024-08-18T22:30:21.590717+0000","last_became_active":"2024-08-18T22:30:19.563582+0000","last_became_peered":"2024-08-18T22:30:19.563582+0000","last_unstale":"2024-08-18T22:30:21.590717+0000","last_undegraded":"2024-08-18T22:30:21.590717+0000","last_fullsized":"2024-08-18T22:30:21.590717+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:15.704018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675842+0000","last_change":"2024-08-18T22:30:20.584448+0000","last_active":"2024-08-18T22:30:21.675842+0000","last_peered":"2024-08-18T22:30:21.675842+0000","last_clean":"2024-08-18T22:30:21.675842+0000","last_became_active":"2024-08-18T22:30:20.582689+0000","last_became_peered":"2024-08-18T22:30:20.582689+0000","last_unstale":"2024-08-18T22:30:21.675842+0000","last_undegraded":"2024-08-18T22:30:21.675842+0000","last_fullsized":"2024-08-18T22:30:21.675842+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:01:53.550642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675580+0000","last_change":"2024-08-18T22:30:19.573181+0000","last_active":"2024-08-18T22:30:21.675580+0000","last_peered":"2024-08-18T22:30:21.675580+0000","last_clean":"2024-08-18T22:30:21.675580+0000","last_became_active":"2024-08-18T22:30:19.572862+0000","last_became_peered":"2024-08-18T22:30:19.572862+0000","last_unstale":"2024-08-18T22:30:21.675580+0000","last_undegraded":"2024-08-18T22:30:21.675580+0000","last_fullsized":"2024-08-18T22:30:21.675580+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:09:59.455503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.592532+0000","last_change":"2024-08-18T22:30:20.588427+0000","last_active":"2024-08-18T22:30:20.592532+0000","last_peered":"2024-08-18T22:30:20.592532+0000","last_clean":"2024-08-18T22:30:20.592532+0000","last_became_active":"2024-08-18T22:30:20.587755+0000","last_became_peered":"2024-08-18T22:30:20.587755+0000","last_unstale":"2024-08-18T22:30:20.592532+0000","last_undegraded":"2024-08-18T22:30:20.592532+0000","last_fullsized":"2024-08-18T22:30:20.592532+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:24.714800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"165'8","reported_seq":22,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.592992+0000","last_change":"2024-08-18T22:30:19.566022+0000","last_active":"2024-08-18T22:30:21.592992+0000","last_peered":"2024-08-18T22:30:21.592992+0000","last_clean":"2024-08-18T22:30:21.592992+0000","last_became_active":"2024-08-18T22:30:19.565519+0000","last_became_peered":"2024-08-18T22:30:19.565519+0000","last_unstale":"2024-08-18T22:30:21.592992+0000","last_undegraded":"2024-08-18T22:30:21.592992+0000","last_fullsized":"2024-08-18T22:30:21.592992+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:33:51.298106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.592933+0000","last_change":"2024-08-18T22:30:20.588228+0000","last_active":"2024-08-18T22:30:21.592933+0000","last_peered":"2024-08-18T22:30:21.592933+0000","last_clean":"2024-08-18T22:30:21.592933+0000","last_became_active":"2024-08-18T22:30:20.587575+0000","last_became_peered":"2024-08-18T22:30:20.587575+0000","last_unstale":"2024-08-18T22:30:21.592933+0000","last_undegraded":"2024-08-18T22:30:21.592933+0000","last_fullsized":"2024-08-18T22:30:21.592933+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:50.887479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.591129+0000","last_change":"2024-08-18T22:30:19.572441+0000","last_active":"2024-08-18T22:30:21.591129+0000","last_peered":"2024-08-18T22:30:21.591129+0000","last_clean":"2024-08-18T22:30:21.591129+0000","last_became_active":"2024-08-18T22:30:19.569716+0000","last_became_peered":"2024-08-18T22:30:19.569716+0000","last_unstale":"2024-08-18T22:30:21.591129+0000","last_undegraded":"2024-08-18T22:30:21.591129+0000","last_fullsized":"2024-08-18T22:30:21.591129+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:10:50.823672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.578091+0000","last_change":"2024-08-18T22:30:20.574276+0000","last_active":"2024-08-18T22:30:21.578091+0000","last_peered":"2024-08-18T22:30:21.578091+0000","last_clean":"2024-08-18T22:30:21.578091+0000","last_became_active":"2024-08-18T22:30:20.573988+0000","last_became_peered":"2024-08-18T22:30:20.573988+0000","last_unstale":"2024-08-18T22:30:21.578091+0000","last_undegraded":"2024-08-18T22:30:21.578091+0000","last_fullsized":"2024-08-18T22:30:21.578091+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:44:50.784708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593516+0000","last_change":"2024-08-18T22:30:19.570653+0000","last_active":"2024-08-18T22:30:21.593516+0000","last_peered":"2024-08-18T22:30:21.593516+0000","last_clean":"2024-08-18T22:30:21.593516+0000","last_became_active":"2024-08-18T22:30:19.570355+0000","last_became_peered":"2024-08-18T22:30:19.570355+0000","last_unstale":"2024-08-18T22:30:21.593516+0000","last_undegraded":"2024-08-18T22:30:21.593516+0000","last_fullsized":"2024-08-18T22:30:21.593516+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:20.533535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675502+0000","last_change":"2024-08-18T22:30:20.583944+0000","last_active":"2024-08-18T22:30:21.675502+0000","last_peered":"2024-08-18T22:30:21.675502+0000","last_clean":"2024-08-18T22:30:21.675502+0000","last_became_active":"2024-08-18T22:30:20.583669+0000","last_became_peered":"2024-08-18T22:30:20.583669+0000","last_unstale":"2024-08-18T22:30:21.675502+0000","last_undegraded":"2024-08-18T22:30:21.675502+0000","last_fullsized":"2024-08-18T22:30:21.675502+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:46.143640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676412+0000","last_change":"2024-08-18T22:30:19.573363+0000","last_active":"2024-08-18T22:30:21.676412+0000","last_peered":"2024-08-18T22:30:21.676412+0000","last_clean":"2024-08-18T22:30:21.676412+0000","last_became_active":"2024-08-18T22:30:19.570435+0000","last_became_peered":"2024-08-18T22:30:19.570435+0000","last_unstale":"2024-08-18T22:30:21.676412+0000","last_undegraded":"2024-08-18T22:30:21.676412+0000","last_fullsized":"2024-08-18T22:30:21.676412+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:22:45.359622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675581+0000","last_change":"2024-08-18T22:30:20.593451+0000","last_active":"2024-08-18T22:30:21.675581+0000","last_peered":"2024-08-18T22:30:21.675581+0000","last_clean":"2024-08-18T22:30:21.675581+0000","last_became_active":"2024-08-18T22:30:20.593168+0000","last_became_peered":"2024-08-18T22:30:20.593168+0000","last_unstale":"2024-08-18T22:30:21.675581+0000","last_undegraded":"2024-08-18T22:30:21.675581+0000","last_fullsized":"2024-08-18T22:30:21.675581+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:12.349849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593167+0000","last_change":"2024-08-18T22:30:19.569280+0000","last_active":"2024-08-18T22:30:21.593167+0000","last_peered":"2024-08-18T22:30:21.593167+0000","last_clean":"2024-08-18T22:30:21.593167+0000","last_became_active":"2024-08-18T22:30:19.568921+0000","last_became_peered":"2024-08-18T22:30:19.568921+0000","last_unstale":"2024-08-18T22:30:21.593167+0000","last_undegraded":"2024-08-18T22:30:21.593167+0000","last_fullsized":"2024-08-18T22:30:21.593167+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:15:30.458942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590871+0000","last_change":"2024-08-18T22:30:20.592203+0000","last_active":"2024-08-18T22:30:21.590871+0000","last_peered":"2024-08-18T22:30:21.590871+0000","last_clean":"2024-08-18T22:30:21.590871+0000","last_became_active":"2024-08-18T22:30:20.591950+0000","last_became_peered":"2024-08-18T22:30:20.591950+0000","last_unstale":"2024-08-18T22:30:21.590871+0000","last_undegraded":"2024-08-18T22:30:21.590871+0000","last_fullsized":"2024-08-18T22:30:21.590871+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:31.865829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676243+0000","last_change":"2024-08-18T22:30:19.574993+0000","last_active":"2024-08-18T22:30:21.676243+0000","last_peered":"2024-08-18T22:30:21.676243+0000","last_clean":"2024-08-18T22:30:21.676243+0000","last_became_active":"2024-08-18T22:30:19.574525+0000","last_became_peered":"2024-08-18T22:30:19.574525+0000","last_unstale":"2024-08-18T22:30:21.676243+0000","last_undegraded":"2024-08-18T22:30:21.676243+0000","last_fullsized":"2024-08-18T22:30:21.676243+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:25:02.938374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676498+0000","last_change":"2024-08-18T22:30:20.585607+0000","last_active":"2024-08-18T22:30:21.676498+0000","last_peered":"2024-08-18T22:30:21.676498+0000","last_clean":"2024-08-18T22:30:21.676498+0000","last_became_active":"2024-08-18T22:30:20.585294+0000","last_became_peered":"2024-08-18T22:30:20.585294+0000","last_unstale":"2024-08-18T22:30:21.676498+0000","last_undegraded":"2024-08-18T22:30:21.676498+0000","last_fullsized":"2024-08-18T22:30:21.676498+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:22.406287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675545+0000","last_change":"2024-08-18T22:30:19.570111+0000","last_active":"2024-08-18T22:30:21.675545+0000","last_peered":"2024-08-18T22:30:21.675545+0000","last_clean":"2024-08-18T22:30:21.675545+0000","last_became_active":"2024-08-18T22:30:19.569832+0000","last_became_peered":"2024-08-18T22:30:19.569832+0000","last_unstale":"2024-08-18T22:30:21.675545+0000","last_undegraded":"2024-08-18T22:30:21.675545+0000","last_fullsized":"2024-08-18T22:30:21.675545+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:17:48.370203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676412+0000","last_change":"2024-08-18T22:30:20.582751+0000","last_active":"2024-08-18T22:30:21.676412+0000","last_peered":"2024-08-18T22:30:21.676412+0000","last_clean":"2024-08-18T22:30:21.676412+0000","last_became_active":"2024-08-18T22:30:20.582466+0000","last_became_peered":"2024-08-18T22:30:20.582466+0000","last_unstale":"2024-08-18T22:30:21.676412+0000","last_undegraded":"2024-08-18T22:30:21.676412+0000","last_fullsized":"2024-08-18T22:30:21.676412+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:54:37.754491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.574952+0000","last_change":"2024-08-18T22:30:19.563996+0000","last_active":"2024-08-18T22:30:20.574952+0000","last_peered":"2024-08-18T22:30:20.574952+0000","last_clean":"2024-08-18T22:30:20.574952+0000","last_became_active":"2024-08-18T22:30:19.563688+0000","last_became_peered":"2024-08-18T22:30:19.563688+0000","last_unstale":"2024-08-18T22:30:20.574952+0000","last_undegraded":"2024-08-18T22:30:20.574952+0000","last_fullsized":"2024-08-18T22:30:20.574952+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:39.211918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582674+0000","last_change":"2024-08-18T22:30:20.582244+0000","last_active":"2024-08-18T22:30:21.582674+0000","last_peered":"2024-08-18T22:30:21.582674+0000","last_clean":"2024-08-18T22:30:21.582674+0000","last_became_active":"2024-08-18T22:30:20.580574+0000","last_became_peered":"2024-08-18T22:30:20.580574+0000","last_unstale":"2024-08-18T22:30:21.582674+0000","last_undegraded":"2024-08-18T22:30:21.582674+0000","last_fullsized":"2024-08-18T22:30:21.582674+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:32:30.390150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582181+0000","last_change":"2024-08-18T22:30:19.561765+0000","last_active":"2024-08-18T22:30:21.582181+0000","last_peered":"2024-08-18T22:30:21.582181+0000","last_clean":"2024-08-18T22:30:21.582181+0000","last_became_active":"2024-08-18T22:30:19.560319+0000","last_became_peered":"2024-08-18T22:30:19.560319+0000","last_unstale":"2024-08-18T22:30:21.582181+0000","last_undegraded":"2024-08-18T22:30:21.582181+0000","last_fullsized":"2024-08-18T22:30:21.582181+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:13:49.879557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675455+0000","last_change":"2024-08-18T22:30:20.572291+0000","last_active":"2024-08-18T22:30:21.675455+0000","last_peered":"2024-08-18T22:30:21.675455+0000","last_clean":"2024-08-18T22:30:21.675455+0000","last_became_active":"2024-08-18T22:30:20.572004+0000","last_became_peered":"2024-08-18T22:30:20.572004+0000","last_unstale":"2024-08-18T22:30:21.675455+0000","last_undegraded":"2024-08-18T22:30:21.675455+0000","last_fullsized":"2024-08-18T22:30:21.675455+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:16.513684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.676452+0000","last_change":"2024-08-18T22:30:19.575108+0000","last_active":"2024-08-18T22:30:21.676452+0000","last_peered":"2024-08-18T22:30:21.676452+0000","last_clean":"2024-08-18T22:30:21.676452+0000","last_became_active":"2024-08-18T22:30:19.574441+0000","last_became_peered":"2024-08-18T22:30:19.574441+0000","last_unstale":"2024-08-18T22:30:21.676452+0000","last_undegraded":"2024-08-18T22:30:21.676452+0000","last_fullsized":"2024-08-18T22:30:21.676452+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:33:16.334650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593328+0000","last_change":"2024-08-18T22:30:20.582538+0000","last_active":"2024-08-18T22:30:21.593328+0000","last_peered":"2024-08-18T22:30:21.593328+0000","last_clean":"2024-08-18T22:30:21.593328+0000","last_became_active":"2024-08-18T22:30:20.580556+0000","last_became_peered":"2024-08-18T22:30:20.580556+0000","last_unstale":"2024-08-18T22:30:21.593328+0000","last_undegraded":"2024-08-18T22:30:21.593328+0000","last_fullsized":"2024-08-18T22:30:21.593328+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:32:23.415945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"166'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.591116+0000","last_change":"2024-08-18T22:30:19.569747+0000","last_active":"2024-08-18T22:30:21.591116+0000","last_peered":"2024-08-18T22:30:21.591116+0000","last_clean":"2024-08-18T22:30:21.591116+0000","last_became_active":"2024-08-18T22:30:19.569409+0000","last_became_peered":"2024-08-18T22:30:19.569409+0000","last_unstale":"2024-08-18T22:30:21.591116+0000","last_undegraded":"2024-08-18T22:30:21.591116+0000","last_fullsized":"2024-08-18T22:30:21.591116+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:08.158319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.579971+0000","last_change":"2024-08-18T22:30:20.578914+0000","last_active":"2024-08-18T22:30:20.579971+0000","last_peered":"2024-08-18T22:30:20.579971+0000","last_clean":"2024-08-18T22:30:20.579971+0000","last_became_active":"2024-08-18T22:30:20.578650+0000","last_became_peered":"2024-08-18T22:30:20.578650+0000","last_unstale":"2024-08-18T22:30:20.579971+0000","last_undegraded":"2024-08-18T22:30:20.579971+0000","last_fullsized":"2024-08-18T22:30:20.579971+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:46.298498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590947+0000","last_change":"2024-08-18T22:30:19.564710+0000","last_active":"2024-08-18T22:30:21.590947+0000","last_peered":"2024-08-18T22:30:21.590947+0000","last_clean":"2024-08-18T22:30:21.590947+0000","last_became_active":"2024-08-18T22:30:19.564417+0000","last_became_peered":"2024-08-18T22:30:19.564417+0000","last_unstale":"2024-08-18T22:30:21.590947+0000","last_undegraded":"2024-08-18T22:30:21.590947+0000","last_fullsized":"2024-08-18T22:30:21.590947+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:54.398044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.593106+0000","last_change":"2024-08-18T22:30:20.585461+0000","last_active":"2024-08-18T22:30:21.593106+0000","last_peered":"2024-08-18T22:30:21.593106+0000","last_clean":"2024-08-18T22:30:21.593106+0000","last_became_active":"2024-08-18T22:30:20.585200+0000","last_became_peered":"2024-08-18T22:30:20.585200+0000","last_unstale":"2024-08-18T22:30:21.593106+0000","last_undegraded":"2024-08-18T22:30:21.593106+0000","last_fullsized":"2024-08-18T22:30:21.593106+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:16.513684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.580189+0000","last_change":"2024-08-18T22:30:19.567457+0000","last_active":"2024-08-18T22:30:20.580189+0000","last_peered":"2024-08-18T22:30:20.580189+0000","last_clean":"2024-08-18T22:30:20.580189+0000","last_became_active":"2024-08-18T22:30:19.565408+0000","last_became_peered":"2024-08-18T22:30:19.565408+0000","last_unstale":"2024-08-18T22:30:20.580189+0000","last_undegraded":"2024-08-18T22:30:20.580189+0000","last_fullsized":"2024-08-18T22:30:20.580189+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:59:32.451150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.596844+0000","last_change":"2024-08-18T22:30:20.593259+0000","last_active":"2024-08-18T22:30:20.596844+0000","last_peered":"2024-08-18T22:30:20.596844+0000","last_clean":"2024-08-18T22:30:20.596844+0000","last_became_active":"2024-08-18T22:30:20.592609+0000","last_became_peered":"2024-08-18T22:30:20.592609+0000","last_unstale":"2024-08-18T22:30:20.596844+0000","last_undegraded":"2024-08-18T22:30:20.596844+0000","last_fullsized":"2024-08-18T22:30:20.596844+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:00.416089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.577412+0000","last_change":"2024-08-18T22:30:19.574945+0000","last_active":"2024-08-18T22:30:20.577412+0000","last_peered":"2024-08-18T22:30:20.577412+0000","last_clean":"2024-08-18T22:30:20.577412+0000","last_became_active":"2024-08-18T22:30:19.574691+0000","last_became_peered":"2024-08-18T22:30:19.574691+0000","last_unstale":"2024-08-18T22:30:20.577412+0000","last_undegraded":"2024-08-18T22:30:20.577412+0000","last_fullsized":"2024-08-18T22:30:20.577412+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:31:06.384235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582719+0000","last_change":"2024-08-18T22:30:20.585005+0000","last_active":"2024-08-18T22:30:21.582719+0000","last_peered":"2024-08-18T22:30:21.582719+0000","last_clean":"2024-08-18T22:30:21.582719+0000","last_became_active":"2024-08-18T22:30:20.584750+0000","last_became_peered":"2024-08-18T22:30:20.584750+0000","last_unstale":"2024-08-18T22:30:21.582719+0000","last_undegraded":"2024-08-18T22:30:21.582719+0000","last_fullsized":"2024-08-18T22:30:21.582719+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:09.166241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590618+0000","last_change":"2024-08-18T22:30:19.573379+0000","last_active":"2024-08-18T22:30:21.590618+0000","last_peered":"2024-08-18T22:30:21.590618+0000","last_clean":"2024-08-18T22:30:21.590618+0000","last_became_active":"2024-08-18T22:30:19.570148+0000","last_became_peered":"2024-08-18T22:30:19.570148+0000","last_unstale":"2024-08-18T22:30:21.590618+0000","last_undegraded":"2024-08-18T22:30:21.590618+0000","last_fullsized":"2024-08-18T22:30:21.590618+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:33:16.334650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.591065+0000","last_change":"2024-08-18T22:30:20.591371+0000","last_active":"2024-08-18T22:30:21.591065+0000","last_peered":"2024-08-18T22:30:21.591065+0000","last_clean":"2024-08-18T22:30:21.591065+0000","last_became_active":"2024-08-18T22:30:20.590378+0000","last_became_peered":"2024-08-18T22:30:20.590378+0000","last_unstale":"2024-08-18T22:30:21.591065+0000","last_undegraded":"2024-08-18T22:30:21.591065+0000","last_fullsized":"2024-08-18T22:30:21.591065+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:52:27.703243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675581+0000","last_change":"2024-08-18T22:30:19.567920+0000","last_active":"2024-08-18T22:30:21.675581+0000","last_peered":"2024-08-18T22:30:21.675581+0000","last_clean":"2024-08-18T22:30:21.675581+0000","last_became_active":"2024-08-18T22:30:19.567615+0000","last_became_peered":"2024-08-18T22:30:19.567615+0000","last_unstale":"2024-08-18T22:30:21.675581+0000","last_undegraded":"2024-08-18T22:30:21.675581+0000","last_fullsized":"2024-08-18T22:30:21.675581+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:01:57.427880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-08-18T22:30:20.591994+0000","last_change":"2024-08-18T22:30:20.588723+0000","last_active":"2024-08-18T22:30:20.591994+0000","last_peered":"2024-08-18T22:30:20.591994+0000","last_clean":"2024-08-18T22:30:20.591994+0000","last_became_active":"2024-08-18T22:30:20.588139+0000","last_became_peered":"2024-08-18T22:30:20.588139+0000","last_unstale":"2024-08-18T22:30:20.591994+0000","last_undegraded":"2024-08-18T22:30:20.591994+0000","last_fullsized":"2024-08-18T22:30:20.591994+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:06:34.374432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.675753+0000","last_change":"2024-08-18T22:30:19.567575+0000","last_active":"2024-08-18T22:30:21.675753+0000","last_peered":"2024-08-18T22:30:21.675753+0000","last_clean":"2024-08-18T22:30:21.675753+0000","last_became_active":"2024-08-18T22:30:19.567290+0000","last_became_peered":"2024-08-18T22:30:19.567290+0000","last_unstale":"2024-08-18T22:30:21.675753+0000","last_undegraded":"2024-08-18T22:30:21.675753+0000","last_fullsized":"2024-08-18T22:30:21.675753+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:54.398044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582106+0000","last_change":"2024-08-18T22:30:20.588882+0000","last_active":"2024-08-18T22:30:21.582106+0000","last_peered":"2024-08-18T22:30:21.582106+0000","last_clean":"2024-08-18T22:30:21.582106+0000","last_became_active":"2024-08-18T22:30:20.587688+0000","last_became_peered":"2024-08-18T22:30:20.587688+0000","last_unstale":"2024-08-18T22:30:21.582106+0000","last_undegraded":"2024-08-18T22:30:21.582106+0000","last_fullsized":"2024-08-18T22:30:21.582106+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:19.541129+0000","last_clean_scrub_stamp":"2024-08-18T22:30:19.541129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:48:39.208730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.590958+0000","last_change":"2024-08-18T22:30:19.570369+0000","last_active":"2024-08-18T22:30:21.590958+0000","last_peered":"2024-08-18T22:30:21.590958+0000","last_clean":"2024-08-18T22:30:21.590958+0000","last_became_active":"2024-08-18T22:30:19.570108+0000","last_became_peered":"2024-08-18T22:30:19.570108+0000","last_unstale":"2024-08-18T22:30:21.590958+0000","last_undegraded":"2024-08-18T22:30:21.590958+0000","last_fullsized":"2024-08-18T22:30:21.590958+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:30:18.533207+0000","last_clean_scrub_stamp":"2024-08-18T22:30:18.533207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:44:43.437202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":465,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-08-18T22:30:21.582289+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:30:21.582289+0000","last_peered":"2024-08-18T22:30:21.582289+0000","last_clean":"2024-08-18T22:30:21.582289+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:30:21.582289+0000","last_undegraded":"2024-08-18T22:30:21.582289+0000","last_fullsized":"2024-08-18T22:30:21.582289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509578,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47680,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324160,"statfs":{"total":96636764160,"available":96587939840,"internally_reserved":0,"allocated":2670592,"data_stored":1570419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509580,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51264,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320576,"statfs":{"total":96636764160,"available":96584269824,"internally_reserved":0,"allocated":2076672,"data_stored":980051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509578,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51272,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320568,"statfs":{"total":96636764160,"available":96584261632,"internally_reserved":0,"allocated":2084864,"data_stored":980175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509579,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59604,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312236,"statfs":{"total":96636764160,"available":96575729664,"internally_reserved":0,"allocated":2097152,"data_stored":982267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509578,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55432,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316408,"statfs":{"total":96636764160,"available":96580001792,"internally_reserved":0,"allocated":2088960,"data_stored":981663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509579,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56008,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315832,"statfs":{"total":96636764160,"available":96579411968,"internally_reserved":0,"allocated":2678784,"data_stored":1570523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55392,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316448,"statfs":{"total":96636764160,"available":96580042752,"internally_reserved":0,"allocated":2052096,"data_stored":966192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55400,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316440,"statfs":{"total":96636764160,"available":96580034560,"internally_reserved":0,"allocated":2052096,"data_stored":966192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:30:25.098 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:30:25.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:30:25.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.285+0000 7f3982800640 1 Processor -- start 2024-08-18T22:30:25.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.285+0000 7f3982800640 1 -- start start 2024-08-18T22:30:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.285+0000 7f3982800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f397c15b0c0 0x7f397c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.285+0000 7f3982800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 0x7f397c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f3982800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397c0b31f0 con 0x7f397c0b40c0 2024-08-18T22:30:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f3982800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f397c0b4a70 con 0x7f397c15b0c0 2024-08-18T22:30:25.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f3982800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f397c0b3d70 con 0x7f397c0cf290 2024-08-18T22:30:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f397be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 0x7f397c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f397b400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f397c15b0c0 0x7f397c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f397be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 0x7f397c0b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:47978/0 (socket says 172.21.15.5:47978) 2024-08-18T22:30:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f397be00640 1 -- 172.21.15.5:0/2315244616 learned_addr learned my addr 172.21.15.5:0/2315244616 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f397be00640 1 -- 172.21.15.5:0/2315244616 >> v2:172.21.15.117:3300/0 conn(0x7f397c15b0c0 msgr2=0x7f397c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f397be00640 1 --2- 172.21.15.5:0/2315244616 >> v2:172.21.15.117:3300/0 conn(0x7f397c15b0c0 0x7f397c06db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f397be00640 1 -- 172.21.15.5:0/2315244616 >> v1:172.21.15.117:6789/0 conn(0x7f397c0b40c0 legacy=0x7f397c072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f397be00640 1 -- 172.21.15.5:0/2315244616 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c0b34d0 con 0x7f397c0cf290 2024-08-18T22:30:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.289+0000 7f397be00640 1 --2- 172.21.15.5:0/2315244616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 0x7f397c0b4530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3974009e50 tx=0x7f397401eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f386f3ca749b39 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f397a000640 1 -- 172.21.15.5:0/2315244616 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39740a79c0 con 0x7f397c0cf290 2024-08-18T22:30:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f397a000640 1 -- 172.21.15.5:0/2315244616 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39740a7b60 con 0x7f397c0cf290 2024-08-18T22:30:25.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f397a000640 1 -- 172.21.15.5:0/2315244616 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39740af3f0 con 0x7f397c0cf290 2024-08-18T22:30:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 -- 172.21.15.5:0/2315244616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 msgr2=0x7f397c0b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 --2- 172.21.15.5:0/2315244616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 0x7f397c0b4530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3974009e50 tx=0x7f397401eaf0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 -- 172.21.15.5:0/2315244616 shutdown_connections 2024-08-18T22:30:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 --2- 172.21.15.5:0/2315244616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 0x7f397c0b4530 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 --2- 172.21.15.5:0/2315244616 >> v2:172.21.15.117:3300/0 conn(0x7f397c15b0c0 0x7f397c06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 -- 172.21.15.5:0/2315244616 >> 172.21.15.5:0/2315244616 conn(0x7f397c0b1dc0 msgr2=0x7f397c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 -- 172.21.15.5:0/2315244616 shutdown_connections 2024-08-18T22:30:25.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 -- 172.21.15.5:0/2315244616 wait complete. 2024-08-18T22:30:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 Processor -- start 2024-08-18T22:30:25.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 -- start start 2024-08-18T22:30:25.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c0b40c0 0x7f397c14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 0x7f397c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f397c15b0c0 0x7f397c153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f397c15b620 con 0x7f397c15b0c0 2024-08-18T22:30:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f397c15b4a0 con 0x7f397c0b40c0 2024-08-18T22:30:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f3982800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f397c06f670 con 0x7f397c0cf290 2024-08-18T22:30:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f397be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f397c15b0c0 0x7f397c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f397be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f397c15b0c0 0x7f397c153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42576/0 (socket says 172.21.15.5:42576) 2024-08-18T22:30:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f397be00640 1 -- 172.21.15.5:0/1024226791 learned_addr learned my addr 172.21.15.5:0/1024226791 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f397b400640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c0b40c0 0x7f397c14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.293+0000 7f397aa00640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 0x7f397c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f397be00640 1 -- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 msgr2=0x7f397c0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f397be00640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 0x7f397c0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f397be00640 1 -- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c0b40c0 msgr2=0x7f397c14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f397be00640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c0b40c0 0x7f397c14b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f397be00640 1 -- 172.21.15.5:0/1024226791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c156e30 con 0x7f397c15b0c0 2024-08-18T22:30:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f397b400640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c0b40c0 0x7f397c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f397be00640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f397c15b0c0 0x7f397c153f40 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f397401c720 tx=0x7f397401b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f3973400640 1 -- 172.21.15.5:0/1024226791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39740be020 con 0x7f397c15b0c0 2024-08-18T22:30:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f3973400640 1 -- 172.21.15.5:0/1024226791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3974007dd0 con 0x7f397c15b0c0 2024-08-18T22:30:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f3973400640 1 -- 172.21.15.5:0/1024226791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39740a79c0 con 0x7f397c15b0c0 2024-08-18T22:30:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f3982800640 1 -- 172.21.15.5:0/1024226791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397c1570d0 con 0x7f397c15b0c0 2024-08-18T22:30:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f3982800640 1 -- 172.21.15.5:0/1024226791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397c157690 con 0x7f397c15b0c0 2024-08-18T22:30:25.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f3982800640 1 -- 172.21.15.5:0/1024226791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397c0b4530 con 0x7f397c15b0c0 2024-08-18T22:30:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f3973400640 1 -- 172.21.15.5:0/1024226791 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f39740c1020 con 0x7f397c15b0c0 2024-08-18T22:30:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f3973400640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f395c0678c0 0x7f395c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.297+0000 7f3973400640 1 -- 172.21.15.5:0/1024226791 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f3974123390 con 0x7f397c15b0c0 2024-08-18T22:30:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.301+0000 7f397b400640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f395c0678c0 0x7f395c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.301+0000 7f397b400640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f395c0678c0 0x7f395c069d80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f396c009bb0 tx=0x7f396c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:25.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.301+0000 7f3973400640 1 -- 172.21.15.5:0/1024226791 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f39740c8030 con 0x7f397c15b0c0 2024-08-18T22:30:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.525+0000 7f3982800640 1 -- 172.21.15.5:0/1024226791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f397c1598e0 con 0x7f397c15b0c0 2024-08-18T22:30:25.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.529+0000 7f3973400640 1 -- 172.21.15.5:0/1024226791 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7f3974018830 con 0x7f397c15b0c0 2024-08-18T22:30:25.528 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:30:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:30:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:30:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:30:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:30:25.528 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:30:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 -- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f395c0678c0 msgr2=0x7f395c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f395c0678c0 0x7f395c069d80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f396c009bb0 tx=0x7f396c008040 comp rx=0 tx=0).stop 2024-08-18T22:30:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 -- 172.21.15.5:0/1024226791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f397c15b0c0 msgr2=0x7f397c153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f397c15b0c0 0x7f397c153f40 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f397401c720 tx=0x7f397401b890 comp rx=0 tx=0).stop 2024-08-18T22:30:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 -- 172.21.15.5:0/1024226791 shutdown_connections 2024-08-18T22:30:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f395c0678c0 0x7f395c069d80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f397c15b0c0 0x7f397c153f40 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0cf290 0x7f397c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 --2- 172.21.15.5:0/1024226791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c0b40c0 0x7f397c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 -- 172.21.15.5:0/1024226791 >> 172.21.15.5:0/1024226791 conn(0x7f397c0b1dc0 msgr2=0x7f397c06ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 -- 172.21.15.5:0/1024226791 shutdown_connections 2024-08-18T22:30:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.533+0000 7f3982800640 1 -- 172.21.15.5:0/1024226791 wait complete. 2024-08-18T22:30:25.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:25.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.697+0000 7f4543a00640 1 Processor -- start 2024-08-18T22:30:25.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.697+0000 7f4543a00640 1 -- start start 2024-08-18T22:30:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f4543a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453c15c180 0x7f453c0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f4543a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f453c071c90 0x7f453c15c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f4543a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f453c0b5e30 con 0x7f453c06fad0 2024-08-18T22:30:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f4543a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f453c15caa0 con 0x7f453c071c90 2024-08-18T22:30:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f4543a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f453c0b6110 con 0x7f453c15c180 2024-08-18T22:30:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f453be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f453c06fad0 0x7f453c071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49526/0 (socket says 172.21.15.5:49526) 2024-08-18T22:30:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f453be00640 1 -- 172.21.15.5:0/1575454959 learned_addr learned my addr 172.21.15.5:0/1575454959 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f4541000640 1 --2- 172.21.15.5:0/1575454959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453c15c180 0x7f453c0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f4541a00640 1 --2- 172.21.15.5:0/1575454959 >> v2:172.21.15.117:3300/0 conn(0x7f453c071c90 0x7f453c15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f453b400640 1 -- 172.21.15.5:0/1575454959 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3378672891 0 0) 0x7f453c0b5e30 con 0x7f453c06fad0 2024-08-18T22:30:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f453b400640 1 -- 172.21.15.5:0/1575454959 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4520003530 con 0x7f453c06fad0 2024-08-18T22:30:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f4541000640 1 -- 172.21.15.5:0/1575454959 >> v2:172.21.15.117:3300/0 conn(0x7f453c071c90 msgr2=0x7f453c15c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f4541000640 1 --2- 172.21.15.5:0/1575454959 >> v2:172.21.15.117:3300/0 conn(0x7f453c071c90 0x7f453c15c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f4541000640 1 -- 172.21.15.5:0/1575454959 >> v1:172.21.15.5:6789/0 conn(0x7f453c06fad0 legacy=0x7f453c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f453b400640 1 -- 172.21.15.5:0/1575454959 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3324759103 0 0) 0x7f4520003530 con 0x7f453c06fad0 2024-08-18T22:30:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.701+0000 7f4541000640 1 -- 172.21.15.5:0/1575454959 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453c0b63f0 con 0x7f453c15c180 2024-08-18T22:30:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f4541000640 1 --2- 172.21.15.5:0/1575454959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453c15c180 0x7f453c0b57c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f452c0097c0 tx=0x7f452c01c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff1e68c84ea41f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f453b400640 1 -- 172.21.15.5:0/1575454959 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452c0b0070 con 0x7f453c15c180 2024-08-18T22:30:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f453b400640 1 -- 172.21.15.5:0/1575454959 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f452c0ab400 con 0x7f453c15c180 2024-08-18T22:30:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f453b400640 1 -- 172.21.15.5:0/1575454959 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528001680 con 0x7f453c15c180 2024-08-18T22:30:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f4543a00640 1 -- 172.21.15.5:0/1575454959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453c15c180 msgr2=0x7f453c0b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f4543a00640 1 --2- 172.21.15.5:0/1575454959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453c15c180 0x7f453c0b57c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f452c0097c0 tx=0x7f452c01c270 comp rx=0 tx=0).stop 2024-08-18T22:30:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f4543a00640 1 -- 172.21.15.5:0/1575454959 shutdown_connections 2024-08-18T22:30:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f4543a00640 1 --2- 172.21.15.5:0/1575454959 >> v2:172.21.15.117:3300/0 conn(0x7f453c071c90 0x7f453c15c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f4543a00640 1 --2- 172.21.15.5:0/1575454959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453c15c180 0x7f453c0b57c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f4543a00640 1 -- 172.21.15.5:0/1575454959 >> 172.21.15.5:0/1575454959 conn(0x7f453c0b3eb0 msgr2=0x7f453c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f4543a00640 1 -- 172.21.15.5:0/1575454959 shutdown_connections 2024-08-18T22:30:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f4543a00640 1 -- 172.21.15.5:0/1575454959 wait complete. 2024-08-18T22:30:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f4543a00640 1 Processor -- start 2024-08-18T22:30:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.705+0000 7f4543a00640 1 -- start start 2024-08-18T22:30:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4543a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453c06fad0 0x7f453c149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4543a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453c071c90 0x7f453c1f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4543a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f453c15c180 0x7f453c152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4543a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f453c0d1c30 con 0x7f453c071c90 2024-08-18T22:30:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4543a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f453c0d1ab0 con 0x7f453c15c180 2024-08-18T22:30:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4543a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f453c0d1db0 con 0x7f453c06fad0 2024-08-18T22:30:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f453be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453c071c90 0x7f453c1f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f453be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453c071c90 0x7f453c1f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42584/0 (socket says 172.21.15.5:42584) 2024-08-18T22:30:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f453be00640 1 -- 172.21.15.5:0/736382111 learned_addr learned my addr 172.21.15.5:0/736382111 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4541000640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453c06fad0 0x7f453c149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4541a00640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f453c15c180 0x7f453c152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f453be00640 1 -- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453c06fad0 msgr2=0x7f453c149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f453be00640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453c06fad0 0x7f453c149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f453be00640 1 -- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f453c15c180 msgr2=0x7f453c152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f453be00640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f453c15c180 0x7f453c152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f453be00640 1 -- 172.21.15.5:0/736382111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453c14c550 con 0x7f453c071c90 2024-08-18T22:30:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f453be00640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453c071c90 0x7f453c1f8f50 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f452800c750 tx=0x7f452800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4538c00640 1 -- 172.21.15.5:0/736382111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528005af0 con 0x7f453c071c90 2024-08-18T22:30:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4538c00640 1 -- 172.21.15.5:0/736382111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4528005c90 con 0x7f453c071c90 2024-08-18T22:30:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4543a00640 1 -- 172.21.15.5:0/736382111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453c14c830 con 0x7f453c071c90 2024-08-18T22:30:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4538c00640 1 -- 172.21.15.5:0/736382111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528007290 con 0x7f453c071c90 2024-08-18T22:30:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4543a00640 1 -- 172.21.15.5:0/736382111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f453c14a940 con 0x7f453c071c90 2024-08-18T22:30:25.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.709+0000 7f4543a00640 1 -- 172.21.15.5:0/736382111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f453c15c560 con 0x7f453c071c90 2024-08-18T22:30:25.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.713+0000 7f4538c00640 1 -- 172.21.15.5:0/736382111 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4528007430 con 0x7f453c071c90 2024-08-18T22:30:25.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.713+0000 7f4538c00640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f451c0678c0 0x7f451c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:25.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.713+0000 7f4538c00640 1 -- 172.21.15.5:0/736382111 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f4528085b70 con 0x7f453c071c90 2024-08-18T22:30:25.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.713+0000 7f4541000640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f451c0678c0 0x7f451c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.713+0000 7f4541000640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f451c0678c0 0x7f451c069d80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f452c0ad000 tx=0x7f452c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.717+0000 7f4538c00640 1 -- 172.21.15.5:0/736382111 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4528007720 con 0x7f453c071c90 2024-08-18T22:30:25.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.917+0000 7f4543a00640 1 -- 172.21.15.5:0/736382111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f453c0cf7d0 con 0x7f453c071c90 2024-08-18T22:30:25.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.917+0000 7f4538c00640 1 -- 172.21.15.5:0/736382111 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f4528055ec0 con 0x7f453c071c90 2024-08-18T22:30:25.917 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:25.917 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:30:25.917 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:30:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 -- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f451c0678c0 msgr2=0x7f451c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f451c0678c0 0x7f451c069d80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f452c0ad000 tx=0x7f452c0a6000 comp rx=0 tx=0).stop 2024-08-18T22:30:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 -- 172.21.15.5:0/736382111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453c071c90 msgr2=0x7f453c1f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453c071c90 0x7f453c1f8f50 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f452800c750 tx=0x7f452800cc10 comp rx=0 tx=0).stop 2024-08-18T22:30:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 -- 172.21.15.5:0/736382111 shutdown_connections 2024-08-18T22:30:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f451c0678c0 0x7f451c069d80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f453c15c180 0x7f453c152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453c071c90 0x7f453c1f8f50 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 --2- 172.21.15.5:0/736382111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453c06fad0 0x7f453c149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:25.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 -- 172.21.15.5:0/736382111 >> 172.21.15.5:0/736382111 conn(0x7f453c0b3eb0 msgr2=0x7f453c0b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:25.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 -- 172.21.15.5:0/736382111 shutdown_connections 2024-08-18T22:30:25.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:25.921+0000 7f4543a00640 1 -- 172.21.15.5:0/736382111 wait complete. 2024-08-18T22:30:26.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 125, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:30:19.963982+0000', 'modified': '2024-08-18T22:30:22.993564+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9525}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9525': {'gid': 9525, 'name': 'a', 'rank': 0, 'incarnation': 122, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/324683204', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 324683204}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 324683204}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9525, 'qdb_cluster': [9525]} 2024-08-18T22:30:26.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:30:26.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-18T22:30:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.489+0000 7f54f5600640 1 Processor -- start 2024-08-18T22:30:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.489+0000 7f54f5600640 1 -- start start 2024-08-18T22:30:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.489+0000 7f54f5600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54f00b55f0 0x7f54f00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.489+0000 7f54f5600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f006eae0 con 0x7f54f015e060 2024-08-18T22:30:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.489+0000 7f54f5600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f0071440 con 0x7f54f00b3fe0 2024-08-18T22:30:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.489+0000 7f54f5600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f54f00b4990 con 0x7f54f00b55f0 2024-08-18T22:30:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.493+0000 7f54f4c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54f00b55f0 0x7f54f00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.493+0000 7f54efe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f54f015e060 0x7f54f0071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49540/0 (socket says 172.21.15.5:49540) 2024-08-18T22:30:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.493+0000 7f54efe00640 1 -- 172.21.15.5:0/357771926 learned_addr learned my addr 172.21.15.5:0/357771926 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.493+0000 7f54f4c00640 1 -- 172.21.15.5:0/357771926 >> v1:172.21.15.117:6789/0 conn(0x7f54f00b3fe0 legacy=0x7f54f00b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.493+0000 7f54f4c00640 1 -- 172.21.15.5:0/357771926 >> v1:172.21.15.5:6789/0 conn(0x7f54f015e060 legacy=0x7f54f0071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.493+0000 7f54eea00640 1 -- 172.21.15.5:0/357771926 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114554667 0 0) 0x7f54f006eae0 con 0x7f54f015e060 2024-08-18T22:30:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.493+0000 7f54f4c00640 1 -- 172.21.15.5:0/357771926 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f006e800 con 0x7f54f00b55f0 2024-08-18T22:30:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.493+0000 7f54f4c00640 1 --2- 172.21.15.5:0/357771926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54f00b55f0 0x7f54f00b4450 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009d90 tx=0x7f54e801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fedf3d1bea81f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.493+0000 7f54eea00640 1 -- 172.21.15.5:0/357771926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e80b2070 con 0x7f54f00b55f0 2024-08-18T22:30:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.493+0000 7f54eea00640 1 -- 172.21.15.5:0/357771926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e80a59c0 con 0x7f54f00b55f0 2024-08-18T22:30:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.493+0000 7f54eea00640 1 -- 172.21.15.5:0/357771926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e80a5d90 con 0x7f54f00b55f0 2024-08-18T22:30:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 -- 172.21.15.5:0/357771926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54f00b55f0 msgr2=0x7f54f00b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 --2- 172.21.15.5:0/357771926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54f00b55f0 0x7f54f00b4450 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009d90 tx=0x7f54e801c8e0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 -- 172.21.15.5:0/357771926 shutdown_connections 2024-08-18T22:30:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 --2- 172.21.15.5:0/357771926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54f00b55f0 0x7f54f00b4450 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 -- 172.21.15.5:0/357771926 >> 172.21.15.5:0/357771926 conn(0x7f54f0067a70 msgr2=0x7f54f0067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 -- 172.21.15.5:0/357771926 shutdown_connections 2024-08-18T22:30:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 -- 172.21.15.5:0/357771926 wait complete. 2024-08-18T22:30:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 Processor -- start 2024-08-18T22:30:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 -- start start 2024-08-18T22:30:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54f00b3fe0 0x7f54f0152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f00b55f0 0x7f54f01509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f015e060 0x7f54f0159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f54f006e3f0 con 0x7f54f00b3fe0 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f54f006e270 con 0x7f54f015e060 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f5600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f54f006e570 con 0x7f54f00b55f0 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54efe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54f00b3fe0 0x7f54f0152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54efe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54f00b3fe0 0x7f54f0152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42600/0 (socket says 172.21.15.5:42600) 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54efe00640 1 -- 172.21.15.5:0/3472738086 learned_addr learned my addr 172.21.15.5:0/3472738086 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54f4c00640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f015e060 0x7f54f0159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54ef400640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f00b55f0 0x7f54f01509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54efe00640 1 -- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f00b55f0 msgr2=0x7f54f01509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54efe00640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f00b55f0 0x7f54f01509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54efe00640 1 -- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f015e060 msgr2=0x7f54f0159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54efe00640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f015e060 0x7f54f0159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54efe00640 1 -- 172.21.15.5:0/3472738086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f01526a0 con 0x7f54f00b3fe0 2024-08-18T22:30:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.497+0000 7f54ef400640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f00b55f0 0x7f54f01509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54efe00640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54f00b3fe0 0x7f54f0152160 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f54e000c4d0 tx=0x7f54e000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54e7e00640 1 -- 172.21.15.5:0/3472738086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0018070 con 0x7f54f00b3fe0 2024-08-18T22:30:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54e7e00640 1 -- 172.21.15.5:0/3472738086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e00074e0 con 0x7f54f00b3fe0 2024-08-18T22:30:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54e7e00640 1 -- 172.21.15.5:0/3472738086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0004a30 con 0x7f54f00b3fe0 2024-08-18T22:30:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54f5600640 1 -- 172.21.15.5:0/3472738086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f0158460 con 0x7f54f00b3fe0 2024-08-18T22:30:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54f5600640 1 -- 172.21.15.5:0/3472738086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f0158a20 con 0x7f54f00b3fe0 2024-08-18T22:30:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54e7e00640 1 -- 172.21.15.5:0/3472738086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54e001b070 con 0x7f54f00b3fe0 2024-08-18T22:30:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54e7e00640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54d00678c0 0x7f54d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54e7e00640 1 -- 172.21.15.5:0/3472738086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f54e0085120 con 0x7f54f00b3fe0 2024-08-18T22:30:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54ef400640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54d00678c0 0x7f54d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54fa1b5000 1 Processor -- start 2024-08-18T22:30:26.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.501+0000 7f54fa1b5000 1 -- start start 2024-08-18T22:30:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54ef400640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54d00678c0 0x7f54d0069d80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f54f01fa130 tx=0x7f54dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b41d50 0x55f025b42130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b42670 0x55f025af8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f0259defd0 con 0x55f025af8990 2024-08-18T22:30:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f0259453c0 con 0x55f025b41d50 2024-08-18T22:30:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f0258eaf70 con 0x55f025b42670 2024-08-18T22:30:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54f4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54f4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42612/0 (socket says 172.21.15.5:42612) 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54f4c00640 1 -- 172.21.15.5:0/3922690080 learned_addr learned my addr 172.21.15.5:0/3922690080 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54efe00640 1 --2- 172.21.15.5:0/3922690080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b41d50 0x55f025b42130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54ef400640 1 --2- 172.21.15.5:0/3922690080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b42670 0x55f025af8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54f4c00640 1 -- 172.21.15.5:0/3922690080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b42670 msgr2=0x55f025af8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54f4c00640 1 --2- 172.21.15.5:0/3922690080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b42670 0x55f025af8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54f4c00640 1 -- 172.21.15.5:0/3922690080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b41d50 msgr2=0x55f025b42130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54f4c00640 1 --2- 172.21.15.5:0/3922690080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b41d50 0x55f025b42130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54f4c00640 1 -- 172.21.15.5:0/3922690080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0258df2e0 con 0x55f025af8990 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54f4c00640 1 --2- 172.21.15.5:0/3922690080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af8d70 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f54e801c920 tx=0x7f54e8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53dc5f2a02675cc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54e4c00640 1 -- 172.21.15.5:0/3922690080 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e80bd030 con 0x55f025af8990 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54e4c00640 1 -- 172.21.15.5:0/3922690080 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e8003d30 con 0x55f025af8990 2024-08-18T22:30:26.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54e4c00640 1 -- 172.21.15.5:0/3922690080 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e80b2040 con 0x55f025af8990 2024-08-18T22:30:26.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3922690080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 msgr2=0x55f025af8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/3922690080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af8d70 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f54e801c920 tx=0x7f54e8004ac0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3922690080 shutdown_connections 2024-08-18T22:30:26.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/3922690080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af8d70 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/3922690080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b42670 0x55f025af8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/3922690080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b41d50 0x55f025b42130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3922690080 >> 172.21.15.5:0/3922690080 conn(0x55f025af4910 msgr2=0x55f025af6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:26.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3922690080 shutdown_connections 2024-08-18T22:30:26.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3922690080 wait complete. 2024-08-18T22:30:26.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 -- start start 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.505+0000 7f54fa1b5000 1 Processor -- start 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025af8990 0x55f025b2f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b41d50 0x55f025afdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b42670 0x55f025afe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f0258ece40 con 0x55f025b42670 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f025a02af0 con 0x55f025af8990 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f0259a7450 con 0x55f025b41d50 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 10 client.0 _ll_register_callbacks cb 0x55f025ae3630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54f4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b42670 0x55f025afe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54f4c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b42670 0x55f025afe0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42620/0 (socket says 172.21.15.5:42620) 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54f4c00640 1 -- 172.21.15.5:0/3704018650 learned_addr learned my addr 172.21.15.5:0/3704018650 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54efe00640 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025af8990 0x55f025b2f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54ef400640 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b41d50 0x55f025afdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54f4c00640 1 -- 172.21.15.5:0/3704018650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b41d50 msgr2=0x55f025afdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54f4c00640 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b41d50 0x55f025afdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54f4c00640 1 -- 172.21.15.5:0/3704018650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025af8990 msgr2=0x55f025b2f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54f4c00640 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025af8990 0x55f025b2f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54f4c00640 1 -- 172.21.15.5:0/3704018650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0258ccfd0 con 0x55f025b42670 2024-08-18T22:30:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54f4c00640 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b42670 0x55f025afe0a0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f54e80194f0 tx=0x7f54e801b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b58efad6a5d7b8b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54d9600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54d9600640 1 -- 172.21.15.5:0/3704018650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e80b2070 con 0x55f025b42670 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3704018650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54e8003d30 con 0x55f025b42670 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54d9600640 1 -- 172.21.15.5:0/3704018650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f54e80a59c0 con 0x55f025b42670 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54d9600640 1 -- 172.21.15.5:0/3704018650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7f54e80a5bc0 con 0x55f025b42670 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 10 client.9642 fetch_fsmap learned FSMap version 125 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3704018650 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x55f0259c84d0 con 0x55f025b42670 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54d9600640 1 -- 172.21.15.5:0/3704018650 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e8003d30 con 0x55f025b42670 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54d9600640 1 -- 172.21.15.5:0/3704018650 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7f54e80c9030 con 0x55f025b42670 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 10 client.9642 fetch_fsmap finished waiting for FSMap version 125 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 10 client.9642 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 20 client.9642 populate_metadata read hostname 'smithi005' 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55f025b304f0 0x55f025b308d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 4 client.9642 mds_command: new command op to 9525 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:30:26.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3704018650 --> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0258dfc00 con 0x55f025b304f0 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54efe00640 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55f025b304f0 0x55f025b308d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54efe00640 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55f025b304f0 0x55f025b308d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d6d2a855e50faed server_cookie=4906dd8b9f5bbe54 in_seq=0 out_seq=0 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.509+0000 7f54d9600640 10 client.9642 ms_handle_connect on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54d9600640 1 -- 172.21.15.5:0/3704018650 <== mds.0 v2:172.21.15.5:6833/324683204 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0258dfc00 con 0x55f025b304f0 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54d9600640 10 client.9642 handle_command_reply: tid=0 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 1 client.9642 shutdown 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3704018650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b42670 msgr2=0x55f025afe0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b42670 0x55f025afe0a0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f54e80194f0 tx=0x7f54e801b120 comp rx=0 tx=0).stop 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3704018650 shutdown_connections 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55f025b304f0 0x55f025b308d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b42670 0x55f025afe0a0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b41d50 0x55f025afdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/3704018650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025af8990 0x55f025b2f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54d9600640 0 client.9642 ms_handle_reset on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:26.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3704018650 >> 172.21.15.5:0/3704018650 conn(0x55f025af4910 msgr2=0x55f025af7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3704018650 shutdown_connections 2024-08-18T22:30:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 1 -- 172.21.15.5:0/3704018650 wait complete. 2024-08-18T22:30:26.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.513+0000 7f54fa1b5000 20 client.9642 trim_cache size 0 max 16384 2024-08-18T22:30:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.529+0000 7f54fa1b5000 1 Processor -- start 2024-08-18T22:30:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.529+0000 7f54fa1b5000 1 -- start start 2024-08-18T22:30:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b41d50 0x55f025af7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b42670 0x55f025af7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f54f02029a0 con 0x55f025af8990 2024-08-18T22:30:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f54f00cc9f0 con 0x55f025b42670 2024-08-18T22:30:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f54f00cd040 con 0x55f025b41d50 2024-08-18T22:30:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54efe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54efe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42628/0 (socket says 172.21.15.5:42628) 2024-08-18T22:30:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54efe00640 1 -- 172.21.15.5:0/2341714279 learned_addr learned my addr 172.21.15.5:0/2341714279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:26.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54ef400640 1 --2- 172.21.15.5:0/2341714279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b41d50 0x55f025af7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54f4c00640 1 --2- 172.21.15.5:0/2341714279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b42670 0x55f025af7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54efe00640 1 -- 172.21.15.5:0/2341714279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b41d50 msgr2=0x55f025af7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54efe00640 1 --2- 172.21.15.5:0/2341714279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b41d50 0x55f025af7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54efe00640 1 -- 172.21.15.5:0/2341714279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b42670 msgr2=0x55f025af7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54efe00640 1 --2- 172.21.15.5:0/2341714279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b42670 0x55f025af7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54efe00640 1 -- 172.21.15.5:0/2341714279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f025b424a0 con 0x55f025af8990 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54f4c00640 1 --2- 172.21.15.5:0/2341714279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b42670 0x55f025af7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54ef400640 1 --2- 172.21.15.5:0/2341714279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b41d50 0x55f025af7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54efe00640 1 --2- 172.21.15.5:0/2341714279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af6d00 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f54e0051840 tx=0x7f54e0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2114c96633120eb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54dbe00640 1 -- 172.21.15.5:0/2341714279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0081070 con 0x55f025af8990 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54dbe00640 1 -- 172.21.15.5:0/2341714279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e00536e0 con 0x55f025af8990 2024-08-18T22:30:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54dbe00640 1 -- 172.21.15.5:0/2341714279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e005da80 con 0x55f025af8990 2024-08-18T22:30:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 -- 172.21.15.5:0/2341714279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 msgr2=0x55f025af6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/2341714279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af6d00 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f54e0051840 tx=0x7f54e0009040 comp rx=0 tx=0).stop 2024-08-18T22:30:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 -- 172.21.15.5:0/2341714279 shutdown_connections 2024-08-18T22:30:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/2341714279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b42670 0x55f025af7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/2341714279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025b41d50 0x55f025af7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/2341714279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025af8990 0x55f025af6d00 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 -- 172.21.15.5:0/2341714279 >> 172.21.15.5:0/2341714279 conn(0x55f025af4910 msgr2=0x55f025afdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 -- 172.21.15.5:0/2341714279 shutdown_connections 2024-08-18T22:30:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 -- 172.21.15.5:0/2341714279 wait complete. 2024-08-18T22:30:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 -- start start 2024-08-18T22:30:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.533+0000 7f54fa1b5000 1 Processor -- start 2024-08-18T22:30:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025af8990 0x55f025bb53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b41d50 0x55f025bb5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b42670 0x55f025b56350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f0258fe1d0 con 0x55f025b41d50 2024-08-18T22:30:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f0258dc900 con 0x55f025b42670 2024-08-18T22:30:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f0259446d0 con 0x55f025af8990 2024-08-18T22:30:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 10 client.0 _ll_register_callbacks cb 0x7f54e0007690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b41d50 0x55f025bb5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54efe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025af8990 0x55f025bb53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54ef400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b41d50 0x55f025bb5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42640/0 (socket says 172.21.15.5:42640) 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54ef400640 1 -- 172.21.15.5:0/4210885566 learned_addr learned my addr 172.21.15.5:0/4210885566 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54f4c00640 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b42670 0x55f025b56350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54efe00640 1 -- 172.21.15.5:0/4210885566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b42670 msgr2=0x55f025b56350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54efe00640 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b42670 0x55f025b56350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54efe00640 1 -- 172.21.15.5:0/4210885566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b41d50 msgr2=0x55f025bb5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54efe00640 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b41d50 0x55f025bb5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54efe00640 1 -- 172.21.15.5:0/4210885566 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f02593eb30 con 0x55f025af8990 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54ef400640 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b41d50 0x55f025bb5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54efe00640 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025af8990 0x55f025bb53c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55f025991c00 tx=0x7f54e0014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f6760065a077405 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54d9600640 10 client.0 ms_handle_connect on v2:172.21.15.117:3301/0 2024-08-18T22:30:26.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54d9600640 1 -- 172.21.15.5:0/4210885566 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0081070 con 0x55f025af8990 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54d9600640 1 -- 172.21.15.5:0/4210885566 <== mon.2 v2:172.21.15.117:3301/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f54e005dc80 con 0x55f025af8990 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 -- 172.21.15.5:0/4210885566 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54e00536e0 con 0x55f025af8990 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54d9600640 1 -- 172.21.15.5:0/4210885566 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7f54e006d0c0 con 0x55f025af8990 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 10 client.7997 fetch_fsmap learned FSMap version 125 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 -- 172.21.15.5:0/4210885566 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x55f0258f6810 con 0x55f025af8990 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54d9600640 1 -- 172.21.15.5:0/4210885566 <== mon.2 v2:172.21.15.117:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e00536e0 con 0x55f025af8990 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54d9600640 1 -- 172.21.15.5:0/4210885566 <== mon.2 v2:172.21.15.117:3301/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7f54e0054830 con 0x55f025af8990 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 10 client.7997 fetch_fsmap finished waiting for FSMap version 125 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 10 client.7997 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 20 client.7997 populate_metadata read hostname 'smithi005' 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55f025b56890 0x55f025b56c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 4 client.7997 mds_command: new command op to 9525 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:30:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 -- 172.21.15.5:0/4210885566 --> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] -- command(tid 0: {"prefix": "status"}) -- 0x55f025b2f9d0 con 0x55f025b56890 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54ef400640 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55f025b56890 0x55f025b56c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54d9600640 10 client.7997 ms_handle_connect on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54ef400640 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55f025b56890 0x55f025b56c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4faa517aaeee9539 server_cookie=ab014f849a148666 in_seq=0 out_seq=0 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54d9600640 1 -- 172.21.15.5:0/4210885566 <== mds.0 v2:172.21.15.5:6833/324683204 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55f025b2f9d0 con 0x55f025b56890 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54d9600640 10 client.7997 handle_command_reply: tid=0 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 client.7997 shutdown 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 -- 172.21.15.5:0/4210885566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025af8990 msgr2=0x55f025bb53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025af8990 0x55f025bb53c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55f025991c00 tx=0x7f54e0014040 comp rx=0 tx=0).stop 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 -- 172.21.15.5:0/4210885566 shutdown_connections 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55f025b56890 0x55f025b56c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f025b42670 0x55f025b56350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54d9600640 0 client.7997 ms_handle_reset on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f025b41d50 0x55f025bb5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 --2- 172.21.15.5:0/4210885566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f025af8990 0x55f025bb53c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 -- 172.21.15.5:0/4210885566 >> 172.21.15.5:0/4210885566 conn(0x55f025af4910 msgr2=0x55f025b40950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 -- 172.21.15.5:0/4210885566 shutdown_connections 2024-08-18T22:30:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 1 -- 172.21.15.5:0/4210885566 wait complete. 2024-08-18T22:30:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.537+0000 7f54fa1b5000 20 client.7997 trim_cache size 0 max 16384 2024-08-18T22:30:26.542 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:30:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:30:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:30:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 9525, 2024-08-18T22:30:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:30:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:30:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:30:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.9619312500000001, 2024-08-18T22:30:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 125, 2024-08-18T22:30:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 166, 2024-08-18T22:30:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 166, 2024-08-18T22:30:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 10.844922265999999 2024-08-18T22:30:26.543 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:30:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 -- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54d00678c0 msgr2=0x7f54d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54d00678c0 0x7f54d0069d80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f54f01fa130 tx=0x7f54dc009040 comp rx=0 tx=0).stop 2024-08-18T22:30:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 -- 172.21.15.5:0/3472738086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54f00b3fe0 msgr2=0x7f54f0152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54f00b3fe0 0x7f54f0152160 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f54e000c4d0 tx=0x7f54e000c990 comp rx=0 tx=0).stop 2024-08-18T22:30:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 -- 172.21.15.5:0/3472738086 shutdown_connections 2024-08-18T22:30:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f54d00678c0 0x7f54d0069d80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54f015e060 0x7f54f0159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54f00b55f0 0x7f54f01509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 --2- 172.21.15.5:0/3472738086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54f00b3fe0 0x7f54f0152160 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 -- 172.21.15.5:0/3472738086 >> 172.21.15.5:0/3472738086 conn(0x7f54f0067a70 msgr2=0x7f54f0071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 -- 172.21.15.5:0/3472738086 shutdown_connections 2024-08-18T22:30:26.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.541+0000 7f54f5600640 1 -- 172.21.15.5:0/3472738086 wait complete. 2024-08-18T22:30:26.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:30:26.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab81200640 1 Processor -- start 2024-08-18T22:30:26.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab81200640 1 -- start start 2024-08-18T22:30:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab81200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab7c165d70 0x7fab7c0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab81200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab7c0c7b80 0x7fab7c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab81200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab7c06f420 con 0x7fab7c06f010 2024-08-18T22:30:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab81200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fab7c0cc670 con 0x7fab7c0c7b80 2024-08-18T22:30:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab81200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fab7c072c40 con 0x7fab7c165d70 2024-08-18T22:30:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab73e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab7c0c7b80 0x7fab7c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab73e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab7c0c7b80 0x7fab7c06ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42646/0 (socket says 172.21.15.5:42646) 2024-08-18T22:30:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab73e00640 1 -- 172.21.15.5:0/3556142807 learned_addr learned my addr 172.21.15.5:0/3556142807 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab79e00640 1 --2- 172.21.15.5:0/3556142807 >> v2:172.21.15.117:3300/0 conn(0x7fab7c165d70 0x7fab7c0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab73e00640 1 -- 172.21.15.5:0/3556142807 >> v2:172.21.15.117:3300/0 conn(0x7fab7c165d70 msgr2=0x7fab7c0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab73e00640 1 --2- 172.21.15.5:0/3556142807 >> v2:172.21.15.117:3300/0 conn(0x7fab7c165d70 0x7fab7c0c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab73e00640 1 -- 172.21.15.5:0/3556142807 >> v1:172.21.15.117:6789/0 conn(0x7fab7c06f010 legacy=0x7fab7c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.701+0000 7fab73e00640 1 -- 172.21.15.5:0/3556142807 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c072f20 con 0x7fab7c0c7b80 2024-08-18T22:30:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab73e00640 1 --2- 172.21.15.5:0/3556142807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c0c7b80 0x7fab7c06ead0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0c8090 tx=0x7fab6401c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6428a6e041268bbb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab79400640 1 -- 172.21.15.5:0/3556142807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab640b0070 con 0x7fab7c0c7b80 2024-08-18T22:30:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab79400640 1 -- 172.21.15.5:0/3556142807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab640ab600 con 0x7fab7c0c7b80 2024-08-18T22:30:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab79400640 1 -- 172.21.15.5:0/3556142807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab640ab9d0 con 0x7fab7c0c7b80 2024-08-18T22:30:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab81200640 1 -- 172.21.15.5:0/3556142807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c0c7b80 msgr2=0x7fab7c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab81200640 1 --2- 172.21.15.5:0/3556142807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c0c7b80 0x7fab7c06ead0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0c8090 tx=0x7fab6401c270 comp rx=0 tx=0).stop 2024-08-18T22:30:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab81200640 1 -- 172.21.15.5:0/3556142807 shutdown_connections 2024-08-18T22:30:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab81200640 1 --2- 172.21.15.5:0/3556142807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c0c7b80 0x7fab7c06ead0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab81200640 1 --2- 172.21.15.5:0/3556142807 >> v2:172.21.15.117:3300/0 conn(0x7fab7c165d70 0x7fab7c0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab81200640 1 -- 172.21.15.5:0/3556142807 >> 172.21.15.5:0/3556142807 conn(0x7fab7c0d1010 msgr2=0x7fab7c0d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab81200640 1 -- 172.21.15.5:0/3556142807 shutdown_connections 2024-08-18T22:30:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab81200640 1 -- 172.21.15.5:0/3556142807 wait complete. 2024-08-18T22:30:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab81200640 1 Processor -- start 2024-08-18T22:30:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.705+0000 7fab81200640 1 -- start start 2024-08-18T22:30:26.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab81200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab7c06f010 0x7fab7c158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab81200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab7c0c7b80 0x7fab7c158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab81200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c165d70 0x7fab7c1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab81200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c073e60 con 0x7fab7c165d70 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab81200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c073ce0 con 0x7fab7c0c7b80 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab81200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fab7c0c6410 con 0x7fab7c06f010 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab7a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c165d70 0x7fab7c1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab7a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c165d70 0x7fab7c1591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42656/0 (socket says 172.21.15.5:42656) 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab7a800640 1 -- 172.21.15.5:0/2502994440 learned_addr learned my addr 172.21.15.5:0/2502994440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab79e00640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab7c06f010 0x7fab7c158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab73e00640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab7c0c7b80 0x7fab7c158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab7a800640 1 -- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab7c06f010 msgr2=0x7fab7c158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab7a800640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab7c06f010 0x7fab7c158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab7a800640 1 -- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab7c0c7b80 msgr2=0x7fab7c158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab7a800640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab7c0c7b80 0x7fab7c158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab7a800640 1 -- 172.21.15.5:0/2502994440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c0b59c0 con 0x7fab7c165d70 2024-08-18T22:30:26.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab73e00640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab7c0c7b80 0x7fab7c158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:26.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab79e00640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab7c06f010 0x7fab7c158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:26.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab7a800640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c165d70 0x7fab7c1591b0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fab7400b970 tx=0x7fab7400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:26.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab72000640 1 -- 172.21.15.5:0/2502994440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74019070 con 0x7fab7c165d70 2024-08-18T22:30:26.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab72000640 1 -- 172.21.15.5:0/2502994440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7400cb40 con 0x7fab7c165d70 2024-08-18T22:30:26.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab72000640 1 -- 172.21.15.5:0/2502994440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74014440 con 0x7fab7c165d70 2024-08-18T22:30:26.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab81200640 1 -- 172.21.15.5:0/2502994440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7c15ad70 con 0x7fab7c165d70 2024-08-18T22:30:26.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab81200640 1 -- 172.21.15.5:0/2502994440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab7c0b5ca0 con 0x7fab7c165d70 2024-08-18T22:30:26.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab81200640 1 -- 172.21.15.5:0/2502994440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab7c15ab80 con 0x7fab7c165d70 2024-08-18T22:30:26.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.709+0000 7fab72000640 1 -- 172.21.15.5:0/2502994440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fab7401c070 con 0x7fab7c165d70 2024-08-18T22:30:26.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.713+0000 7fab72000640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fab580678c0 0x7fab58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:26.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.713+0000 7fab72000640 1 -- 172.21.15.5:0/2502994440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fab74085b70 con 0x7fab7c165d70 2024-08-18T22:30:26.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.713+0000 7fab79e00640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fab580678c0 0x7fab58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.713+0000 7fab79e00640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fab580678c0 0x7fab58069d80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fab6c007a70 tx=0x7fab6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:26.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.717+0000 7fab72000640 1 -- 172.21.15.5:0/2502994440 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fab74056480 con 0x7fab7c165d70 2024-08-18T22:30:26.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.917+0000 7fab81200640 1 -- 172.21.15.5:0/2502994440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fab7c0cf2b0 con 0x7fab7c165d70 2024-08-18T22:30:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.917+0000 7fab72000640 1 -- 172.21.15.5:0/2502994440 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v125) ==== 53+0+73 (secure 0 0 0) 0x7fab74055d80 con 0x7fab7c165d70 2024-08-18T22:30:26.917 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:30:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 -- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fab580678c0 msgr2=0x7fab58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fab580678c0 0x7fab58069d80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fab6c007a70 tx=0x7fab6c008040 comp rx=0 tx=0).stop 2024-08-18T22:30:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 -- 172.21.15.5:0/2502994440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c165d70 msgr2=0x7fab7c1591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c165d70 0x7fab7c1591b0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fab7400b970 tx=0x7fab7400be30 comp rx=0 tx=0).stop 2024-08-18T22:30:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 -- 172.21.15.5:0/2502994440 shutdown_connections 2024-08-18T22:30:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fab580678c0 0x7fab58069d80 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c165d70 0x7fab7c1591b0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab7c0c7b80 0x7fab7c158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 --2- 172.21.15.5:0/2502994440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab7c06f010 0x7fab7c158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:26.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 -- 172.21.15.5:0/2502994440 >> 172.21.15.5:0/2502994440 conn(0x7fab7c0d1010 msgr2=0x7fab7c0c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:26.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 -- 172.21.15.5:0/2502994440 shutdown_connections 2024-08-18T22:30:26.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:26.921+0000 7fab81200640 1 -- 172.21.15.5:0/2502994440 wait complete. 2024-08-18T22:30:26.939 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:30:26.939 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:30:26.939 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:30:26.939 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:30:26.939 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:30:26.939 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:30:26.939 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:30:26.939 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:30:26.939 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:30:26.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:26.940 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:30:26.949 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:30:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:30:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:30:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:30:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:30:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:30:26.949 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41774sec preferred_lft 41774sec 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:30:26.950 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:30:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:30:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:30:26.952 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:30:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:30:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:30:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:30:26.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:26.952 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:30:27.011 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:30:27.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:27.013 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:30:27.066 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:30:27.066 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:30:27.066 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:30:27.066 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:30:27.066 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:30:27.067 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:30:27.067 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:30:27.067 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:27.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:30:27.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:30:27.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:30:27.067 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:27.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:30:27.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:27.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:27.205 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:30:27.254 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:30:27.254 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:30:27.255 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:30:27.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:27.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:30:27.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:30:27.317 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:30:27.369 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:30:27.369 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:30:27.369 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:30:27.417 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:30:27.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:27.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:30:27.506 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:30:27.506 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:30:27.506 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:30:27.521 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:30:27.521 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:30:27.521 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:30:27.521 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:30:27.522 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:30:27.529 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:30:27.529 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:30:27.530 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:30:27.530 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:30:27.530 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:30:27.530 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:30:27.530 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:30:27.530 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:30:27.533 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:30:27.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:27.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:30:27.553 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:30:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:27.660 INFO:teuthology.orchestra.run.smithi005.stdout:client8003 2024-08-18T22:30:27.660 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:30:27.661 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:30:27.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.857+0000 7f7a8e200640 1 Processor -- start 2024-08-18T22:30:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.857+0000 7f7a8e200640 1 -- start start 2024-08-18T22:30:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a8e200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7a8806dd80 0x7f7a880cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a8e200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a8806e210 con 0x7f7a880b54c0 2024-08-18T22:30:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a8e200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a88071c80 con 0x7f7a88071580 2024-08-18T22:30:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a8e200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7a880cba40 con 0x7f7a8806dd80 2024-08-18T22:30:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a87400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7a880b54c0 0x7f7a880b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49546/0 (socket says 172.21.15.5:49546) 2024-08-18T22:30:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a87400640 1 -- 172.21.15.5:0/743223075 learned_addr learned my addr 172.21.15.5:0/743223075 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a87e00640 1 --2- 172.21.15.5:0/743223075 >> v2:172.21.15.117:3300/0 conn(0x7f7a8806dd80 0x7f7a880cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a86000640 1 -- 172.21.15.5:0/743223075 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4108815514 0 0) 0x7f7a78001120 con 0x7f7a880b54c0 2024-08-18T22:30:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a86000640 1 -- 172.21.15.5:0/743223075 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a6c003530 con 0x7f7a880b54c0 2024-08-18T22:30:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a87e00640 1 -- 172.21.15.5:0/743223075 >> v1:172.21.15.117:6789/0 conn(0x7f7a88071580 legacy=0x7f7a880cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a87e00640 1 -- 172.21.15.5:0/743223075 >> v1:172.21.15.5:6789/0 conn(0x7f7a880b54c0 legacy=0x7f7a880b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a86000640 1 -- 172.21.15.5:0/743223075 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4108702274 0 0) 0x7f7a6c003530 con 0x7f7a880b54c0 2024-08-18T22:30:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.861+0000 7f7a87e00640 1 -- 172.21.15.5:0/743223075 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a88071f60 con 0x7f7a8806dd80 2024-08-18T22:30:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a87e00640 1 --2- 172.21.15.5:0/743223075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a8806dd80 0x7f7a880cc5e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009d90 tx=0x7f7a8001f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f527606d83bdb5c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a86000640 1 -- 172.21.15.5:0/743223075 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a800b5070 con 0x7f7a8806dd80 2024-08-18T22:30:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a86000640 1 -- 172.21.15.5:0/743223075 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a800a8c10 con 0x7f7a8806dd80 2024-08-18T22:30:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a86000640 1 -- 172.21.15.5:0/743223075 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78001850 con 0x7f7a8806dd80 2024-08-18T22:30:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a8e200640 1 -- 172.21.15.5:0/743223075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a8806dd80 msgr2=0x7f7a880cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a8e200640 1 --2- 172.21.15.5:0/743223075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a8806dd80 0x7f7a880cc5e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009d90 tx=0x7f7a8001f080 comp rx=0 tx=0).stop 2024-08-18T22:30:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a8e200640 1 -- 172.21.15.5:0/743223075 shutdown_connections 2024-08-18T22:30:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a8e200640 1 --2- 172.21.15.5:0/743223075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a8806dd80 0x7f7a880cc5e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a8e200640 1 -- 172.21.15.5:0/743223075 >> 172.21.15.5:0/743223075 conn(0x7f7a880b3eb0 msgr2=0x7f7a880b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a8e200640 1 -- 172.21.15.5:0/743223075 shutdown_connections 2024-08-18T22:30:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a8e200640 1 -- 172.21.15.5:0/743223075 wait complete. 2024-08-18T22:30:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a8e200640 1 Processor -- start 2024-08-18T22:30:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.865+0000 7f7a8e200640 1 -- start start 2024-08-18T22:30:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a8e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a8806dd80 0x7f7a8815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a8e200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a88071580 0x7f7a8815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a8e200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a880b54c0 0x7f7a8813e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a8e200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7a88148020 con 0x7f7a8806dd80 2024-08-18T22:30:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a8e200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7a880719a0 con 0x7f7a88071580 2024-08-18T22:30:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a8e200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7a881481a0 con 0x7f7a880b54c0 2024-08-18T22:30:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a87400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a8806dd80 0x7f7a8815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a87400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a8806dd80 0x7f7a8815ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42662/0 (socket says 172.21.15.5:42662) 2024-08-18T22:30:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a87400640 1 -- 172.21.15.5:0/3252420718 learned_addr learned my addr 172.21.15.5:0/3252420718 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a87e00640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a880b54c0 0x7f7a8813e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a86a00640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a88071580 0x7f7a8815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a87400640 1 -- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a880b54c0 msgr2=0x7f7a8813e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a87400640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a880b54c0 0x7f7a8813e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a87400640 1 -- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a88071580 msgr2=0x7f7a8815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a87400640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a88071580 0x7f7a8815dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a87400640 1 -- 172.21.15.5:0/3252420718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8815f270 con 0x7f7a8806dd80 2024-08-18T22:30:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a87400640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a8806dd80 0x7f7a8815ea20 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800c780 tx=0x7f7a7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a7f400640 1 -- 172.21.15.5:0/3252420718 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78017070 con 0x7f7a8806dd80 2024-08-18T22:30:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a7f400640 1 -- 172.21.15.5:0/3252420718 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a78005b00 con 0x7f7a8806dd80 2024-08-18T22:30:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a7f400640 1 -- 172.21.15.5:0/3252420718 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78007070 con 0x7f7a8806dd80 2024-08-18T22:30:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a8e200640 1 -- 172.21.15.5:0/3252420718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8815f550 con 0x7f7a8806dd80 2024-08-18T22:30:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a8e200640 1 -- 172.21.15.5:0/3252420718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8815fb10 con 0x7f7a8806dd80 2024-08-18T22:30:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a8e200640 1 -- 172.21.15.5:0/3252420718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a880b58a0 con 0x7f7a8806dd80 2024-08-18T22:30:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.869+0000 7f7a7f400640 1 -- 172.21.15.5:0/3252420718 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a7801a070 con 0x7f7a8806dd80 2024-08-18T22:30:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.873+0000 7f7a7f400640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a680678c0 0x7f7a68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.873+0000 7f7a7f400640 1 -- 172.21.15.5:0/3252420718 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f7a78085390 con 0x7f7a8806dd80 2024-08-18T22:30:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.873+0000 7f7a86a00640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a680678c0 0x7f7a68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.873+0000 7f7a86a00640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a680678c0 0x7f7a68069d80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7a880b3e80 tx=0x7f7a74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:27.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:27.877+0000 7f7a7f400640 1 -- 172.21.15.5:0/3252420718 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7a8806e210 con 0x7f7a8806dd80 2024-08-18T22:30:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.073+0000 7f7a8e200640 1 -- 172.21.15.5:0/3252420718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a880b18d0 con 0x7f7a8806dd80 2024-08-18T22:30:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.073+0000 7f7a7f400640 1 -- 172.21.15.5:0/3252420718 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f7a78055dd0 con 0x7f7a8806dd80 2024-08-18T22:30:28.074 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:28.074 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:30:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:30:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 -- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a680678c0 msgr2=0x7f7a68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a680678c0 0x7f7a68069d80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7a880b3e80 tx=0x7f7a74009040 comp rx=0 tx=0).stop 2024-08-18T22:30:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 -- 172.21.15.5:0/3252420718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a8806dd80 msgr2=0x7f7a8815ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a8806dd80 0x7f7a8815ea20 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800c780 tx=0x7f7a7800cc40 comp rx=0 tx=0).stop 2024-08-18T22:30:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 -- 172.21.15.5:0/3252420718 shutdown_connections 2024-08-18T22:30:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a680678c0 0x7f7a68069d80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a880b54c0 0x7f7a8813e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a88071580 0x7f7a8815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 --2- 172.21.15.5:0/3252420718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a8806dd80 0x7f7a8815ea20 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 -- 172.21.15.5:0/3252420718 >> 172.21.15.5:0/3252420718 conn(0x7f7a880b3eb0 msgr2=0x7f7a880b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 -- 172.21.15.5:0/3252420718 shutdown_connections 2024-08-18T22:30:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.077+0000 7f7a8e200640 1 -- 172.21.15.5:0/3252420718 wait complete. 2024-08-18T22:30:28.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:28.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d7e00640 1 Processor -- start 2024-08-18T22:30:28.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d7e00640 1 -- start start 2024-08-18T22:30:28.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d7e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 0x7fd8d00735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d7e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8d00cb390 0x7fd8d0071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8d006da70 0x7fd8d006df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d7e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d0072060 con 0x7fd8d006da70 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d7e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d0073c80 con 0x7fd8d00cb390 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d7e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d00ca5d0 con 0x7fd8d015bed0 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8d006da70 0x7fd8d006df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8d006da70 0x7fd8d006df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42674/0 (socket says 172.21.15.5:42674) 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d5e00640 1 -- 172.21.15.5:0/3425620228 learned_addr learned my addr 172.21.15.5:0/3425620228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d4a00640 1 --2- 172.21.15.5:0/3425620228 >> v2:172.21.15.117:3300/0 conn(0x7fd8d00cb390 0x7fd8d0071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d5400640 1 --2- 172.21.15.5:0/3425620228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 0x7fd8d00735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d5e00640 1 -- 172.21.15.5:0/3425620228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 msgr2=0x7fd8d00735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d5e00640 1 --2- 172.21.15.5:0/3425620228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 0x7fd8d00735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d5e00640 1 -- 172.21.15.5:0/3425620228 >> v2:172.21.15.117:3300/0 conn(0x7fd8d00cb390 msgr2=0x7fd8d0071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:28.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d5e00640 1 --2- 172.21.15.5:0/3425620228 >> v2:172.21.15.117:3300/0 conn(0x7fd8d00cb390 0x7fd8d0071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d5e00640 1 -- 172.21.15.5:0/3425620228 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d00ca8b0 con 0x7fd8d006da70 2024-08-18T22:30:28.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d4a00640 1 --2- 172.21.15.5:0/3425620228 >> v2:172.21.15.117:3300/0 conn(0x7fd8d00cb390 0x7fd8d0071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:28.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.237+0000 7fd8d5400640 1 --2- 172.21.15.5:0/3425620228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 0x7fd8d00735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:28.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8d5e00640 1 --2- 172.21.15.5:0/3425620228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d006da70 0x7fd8d006df20 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fd8d006fce0 tx=0x7fd8c801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbe945893028a12 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8cfe00640 1 -- 172.21.15.5:0/3425620228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80a5760 con 0x7fd8d006da70 2024-08-18T22:30:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8cfe00640 1 -- 172.21.15.5:0/3425620228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c80a5900 con 0x7fd8d006da70 2024-08-18T22:30:28.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8cfe00640 1 -- 172.21.15.5:0/3425620228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80a5cd0 con 0x7fd8d006da70 2024-08-18T22:30:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8d7e00640 1 -- 172.21.15.5:0/3425620228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d006da70 msgr2=0x7fd8d006df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8d7e00640 1 --2- 172.21.15.5:0/3425620228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d006da70 0x7fd8d006df20 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fd8d006fce0 tx=0x7fd8c801c9f0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8d7e00640 1 -- 172.21.15.5:0/3425620228 shutdown_connections 2024-08-18T22:30:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8d7e00640 1 --2- 172.21.15.5:0/3425620228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d006da70 0x7fd8d006df20 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8d7e00640 1 --2- 172.21.15.5:0/3425620228 >> v2:172.21.15.117:3300/0 conn(0x7fd8d00cb390 0x7fd8d0071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8d7e00640 1 --2- 172.21.15.5:0/3425620228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 0x7fd8d00735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8d7e00640 1 -- 172.21.15.5:0/3425620228 >> 172.21.15.5:0/3425620228 conn(0x7fd8d00b1c50 msgr2=0x7fd8d00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8d7e00640 1 -- 172.21.15.5:0/3425620228 shutdown_connections 2024-08-18T22:30:28.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.241+0000 7fd8d7e00640 1 -- 172.21.15.5:0/3425620228 wait complete. 2024-08-18T22:30:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d7e00640 1 Processor -- start 2024-08-18T22:30:28.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d7e00640 1 -- start start 2024-08-18T22:30:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d006da70 0x7fd8d015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00cb390 0x7fd8d0149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d7e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 0x7fd8d0151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d7e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d00ccc40 con 0x7fd8d00cb390 2024-08-18T22:30:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d7e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d00ccac0 con 0x7fd8d006da70 2024-08-18T22:30:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d7e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d00ccdc0 con 0x7fd8d015bed0 2024-08-18T22:30:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00cb390 0x7fd8d0149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d4a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00cb390 0x7fd8d0149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42684/0 (socket says 172.21.15.5:42684) 2024-08-18T22:30:28.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d4a00640 1 -- 172.21.15.5:0/210886831 learned_addr learned my addr 172.21.15.5:0/210886831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d5400640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d006da70 0x7fd8d015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d5e00640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 0x7fd8d0151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d4a00640 1 -- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 msgr2=0x7fd8d0151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d4a00640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 0x7fd8d0151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d4a00640 1 -- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d006da70 msgr2=0x7fd8d015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d4a00640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d006da70 0x7fd8d015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d4a00640 1 -- 172.21.15.5:0/210886831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d00cea20 con 0x7fd8d00cb390 2024-08-18T22:30:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d5400640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d006da70 0x7fd8d015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d5e00640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 0x7fd8d0151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d4a00640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00cb390 0x7fd8d0149140 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00e730 tx=0x7fd8bc00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8cd600640 1 -- 172.21.15.5:0/210886831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc017070 con 0x7fd8d00cb390 2024-08-18T22:30:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8cd600640 1 -- 172.21.15.5:0/210886831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8bc00c8d0 con 0x7fd8d00cb390 2024-08-18T22:30:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8cd600640 1 -- 172.21.15.5:0/210886831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc00f040 con 0x7fd8d00cb390 2024-08-18T22:30:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d7e00640 1 -- 172.21.15.5:0/210886831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d00cdea0 con 0x7fd8d00cb390 2024-08-18T22:30:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.245+0000 7fd8d7e00640 1 -- 172.21.15.5:0/210886831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d00ce740 con 0x7fd8d00cb390 2024-08-18T22:30:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.249+0000 7fd8d7e00640 1 -- 172.21.15.5:0/210886831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d006df20 con 0x7fd8d00cb390 2024-08-18T22:30:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.249+0000 7fd8cd600640 1 -- 172.21.15.5:0/210886831 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8bc01a070 con 0x7fd8d00cb390 2024-08-18T22:30:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.249+0000 7fd8cd600640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8b00678c0 0x7fd8b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.249+0000 7fd8cd600640 1 -- 172.21.15.5:0/210886831 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fd8bc085b00 con 0x7fd8d00cb390 2024-08-18T22:30:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.249+0000 7fd8d5400640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8b00678c0 0x7fd8b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.253+0000 7fd8d5400640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8b00678c0 0x7fd8b0069d80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4007950 tx=0x7fd8c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.253+0000 7fd8cd600640 1 -- 172.21.15.5:0/210886831 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd8bc056410 con 0x7fd8d00cb390 2024-08-18T22:30:28.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 -- 172.21.15.5:0/210886831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8d00b0810 con 0x7fd8d00cb390 2024-08-18T22:30:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8cd600640 1 -- 172.21.15.5:0/210886831 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7fd8bc085e20 con 0x7fd8d00cb390 2024-08-18T22:30:28.451 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:28.451 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:30:28.452 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:30:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 -- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8b00678c0 msgr2=0x7fd8b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8b00678c0 0x7fd8b0069d80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4007950 tx=0x7fd8c4008040 comp rx=0 tx=0).stop 2024-08-18T22:30:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 -- 172.21.15.5:0/210886831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00cb390 msgr2=0x7fd8d0149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00cb390 0x7fd8d0149140 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00e730 tx=0x7fd8bc00ebf0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 -- 172.21.15.5:0/210886831 shutdown_connections 2024-08-18T22:30:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8b00678c0 0x7fd8b0069d80 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8d015bed0 0x7fd8d0151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d00cb390 0x7fd8d0149140 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 --2- 172.21.15.5:0/210886831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8d006da70 0x7fd8d015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 -- 172.21.15.5:0/210886831 >> 172.21.15.5:0/210886831 conn(0x7fd8d00b1c50 msgr2=0x7fd8d0152b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 -- 172.21.15.5:0/210886831 shutdown_connections 2024-08-18T22:30:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28.453+0000 7fd8d7e00640 1 -- 172.21.15.5:0/210886831 wait complete. 2024-08-18T22:30:28.473 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:28.473 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:28.473 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.0 2024-08-18T22:30:28.473 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:28.473 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:28.473 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:28.473 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:28.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231367 s, 45.3 MB/s 2024-08-18T22:30:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.583 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206597 s, 50.8 MB/s 2024-08-18T22:30:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202278 s, 51.8 MB/s 2024-08-18T22:30:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.626 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168082 s, 62.4 MB/s 2024-08-18T22:30:28.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.646 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181095 s, 57.9 MB/s 2024-08-18T22:30:28.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.662 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012842 s, 81.7 MB/s 2024-08-18T22:30:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.676 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121019 s, 86.6 MB/s 2024-08-18T22:30:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246237 s, 42.6 MB/s 2024-08-18T22:30:28.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.722 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162631 s, 64.5 MB/s 2024-08-18T22:30:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149666 s, 70.1 MB/s 2024-08-18T22:30:28.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164317 s, 63.8 MB/s 2024-08-18T22:30:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175524 s, 59.7 MB/s 2024-08-18T22:30:28.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.798 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166888 s, 62.8 MB/s 2024-08-18T22:30:28.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258511 s, 40.6 MB/s 2024-08-18T22:30:28.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.845 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154199 s, 68.0 MB/s 2024-08-18T22:30:28.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.865 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173154 s, 60.6 MB/s 2024-08-18T22:30:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.887 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192733 s, 54.4 MB/s 2024-08-18T22:30:28.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.907 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017249 s, 60.8 MB/s 2024-08-18T22:30:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161638 s, 64.9 MB/s 2024-08-18T22:30:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.947 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019292 s, 54.4 MB/s 2024-08-18T22:30:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219694 s, 47.7 MB/s 2024-08-18T22:30:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:28.990 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160798 s, 65.2 MB/s 2024-08-18T22:30:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202684 s, 51.7 MB/s 2024-08-18T22:30:29.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196011 s, 53.5 MB/s 2024-08-18T22:30:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191474 s, 54.8 MB/s 2024-08-18T22:30:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140625 s, 74.6 MB/s 2024-08-18T22:30:29.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157557 s, 66.6 MB/s 2024-08-18T22:30:29.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.109 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.109 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145082 s, 72.3 MB/s 2024-08-18T22:30:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173882 s, 60.3 MB/s 2024-08-18T22:30:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162719 s, 64.4 MB/s 2024-08-18T22:30:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150427 s, 69.7 MB/s 2024-08-18T22:30:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175207 s, 59.8 MB/s 2024-08-18T22:30:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:29.194 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:29.194 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:29.194 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.1 2024-08-18T22:30:29.194 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:29.194 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:29.195 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:29.195 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019216 s, 54.6 MB/s 2024-08-18T22:30:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178578 s, 58.7 MB/s 2024-08-18T22:30:29.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168467 s, 62.2 MB/s 2024-08-18T22:30:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.326 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151666 s, 69.1 MB/s 2024-08-18T22:30:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201694 s, 52.0 MB/s 2024-08-18T22:30:29.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165677 s, 63.3 MB/s 2024-08-18T22:30:29.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017265 s, 60.7 MB/s 2024-08-18T22:30:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174327 s, 60.1 MB/s 2024-08-18T22:30:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181184 s, 57.9 MB/s 2024-08-18T22:30:29.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.451 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198583 s, 52.8 MB/s 2024-08-18T22:30:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014861 s, 70.6 MB/s 2024-08-18T22:30:29.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.486 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142918 s, 73.4 MB/s 2024-08-18T22:30:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152724 s, 68.7 MB/s 2024-08-18T22:30:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.523 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165268 s, 63.4 MB/s 2024-08-18T22:30:29.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.541 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161399 s, 65.0 MB/s 2024-08-18T22:30:29.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183267 s, 57.2 MB/s 2024-08-18T22:30:29.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.582 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167884 s, 62.5 MB/s 2024-08-18T22:30:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151382 s, 69.3 MB/s 2024-08-18T22:30:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171433 s, 61.2 MB/s 2024-08-18T22:30:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207674 s, 50.5 MB/s 2024-08-18T22:30:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.664 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189215 s, 55.4 MB/s 2024-08-18T22:30:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148675 s, 70.5 MB/s 2024-08-18T22:30:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156557 s, 67.0 MB/s 2024-08-18T22:30:29.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180403 s, 58.1 MB/s 2024-08-18T22:30:29.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143566 s, 73.0 MB/s 2024-08-18T22:30:29.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.756 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150987 s, 69.4 MB/s 2024-08-18T22:30:29.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.773 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.774 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160274 s, 65.4 MB/s 2024-08-18T22:30:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159929 s, 65.6 MB/s 2024-08-18T22:30:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171274 s, 61.2 MB/s 2024-08-18T22:30:29.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193348 s, 54.2 MB/s 2024-08-18T22:30:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176813 s, 59.3 MB/s 2024-08-18T22:30:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.877 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211567 s, 49.6 MB/s 2024-08-18T22:30:29.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:29.885 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:29.885 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:29.885 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.2 2024-08-18T22:30:29.885 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:29.885 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:29.885 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:29.885 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:29.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.955 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154132 s, 68.0 MB/s 2024-08-18T22:30:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:29.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242984 s, 43.2 MB/s 2024-08-18T22:30:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.004 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188314 s, 55.7 MB/s 2024-08-18T22:30:30.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.022 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.022 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153981 s, 68.1 MB/s 2024-08-18T22:30:30.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.037 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129884 s, 80.7 MB/s 2024-08-18T22:30:30.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.061 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208567 s, 50.3 MB/s 2024-08-18T22:30:30.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.080 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170815 s, 61.4 MB/s 2024-08-18T22:30:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147414 s, 71.1 MB/s 2024-08-18T22:30:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147295 s, 71.2 MB/s 2024-08-18T22:30:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017198 s, 61.0 MB/s 2024-08-18T22:30:30.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.160 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219641 s, 47.7 MB/s 2024-08-18T22:30:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170068 s, 61.7 MB/s 2024-08-18T22:30:30.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177538 s, 59.1 MB/s 2024-08-18T22:30:30.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.223 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209672 s, 50.0 MB/s 2024-08-18T22:30:30.241 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157894 s, 66.4 MB/s 2024-08-18T22:30:30.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.266 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213584 s, 49.1 MB/s 2024-08-18T22:30:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241177 s, 43.5 MB/s 2024-08-18T22:30:30.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.314 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.314 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192971 s, 54.3 MB/s 2024-08-18T22:30:30.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014367 s, 73.0 MB/s 2024-08-18T22:30:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146614 s, 71.5 MB/s 2024-08-18T22:30:30.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017147 s, 61.2 MB/s 2024-08-18T22:30:30.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146614 s, 71.5 MB/s 2024-08-18T22:30:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133321 s, 78.7 MB/s 2024-08-18T22:30:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151553 s, 69.2 MB/s 2024-08-18T22:30:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214561 s, 48.9 MB/s 2024-08-18T22:30:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172894 s, 60.6 MB/s 2024-08-18T22:30:30.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.480 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.480 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144603 s, 72.5 MB/s 2024-08-18T22:30:30.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.499 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166977 s, 62.8 MB/s 2024-08-18T22:30:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145167 s, 72.2 MB/s 2024-08-18T22:30:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147383 s, 71.1 MB/s 2024-08-18T22:30:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186198 s, 56.3 MB/s 2024-08-18T22:30:30.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.576 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018162 s, 57.7 MB/s 2024-08-18T22:30:30.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:30.583 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:30.583 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:30.583 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.3 2024-08-18T22:30:30.583 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:30.583 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:30.583 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:30.583 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:30.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015701 s, 66.8 MB/s 2024-08-18T22:30:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205765 s, 51.0 MB/s 2024-08-18T22:30:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212565 s, 49.3 MB/s 2024-08-18T22:30:30.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158979 s, 66.0 MB/s 2024-08-18T22:30:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161014 s, 65.1 MB/s 2024-08-18T22:30:30.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152744 s, 68.6 MB/s 2024-08-18T22:30:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015498 s, 67.7 MB/s 2024-08-18T22:30:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.835 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149967 s, 69.9 MB/s 2024-08-18T22:30:30.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017943 s, 58.4 MB/s 2024-08-18T22:30:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146208 s, 71.7 MB/s 2024-08-18T22:30:30.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.892 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168048 s, 62.4 MB/s 2024-08-18T22:30:30.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.910 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149208 s, 70.3 MB/s 2024-08-18T22:30:30.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149512 s, 70.1 MB/s 2024-08-18T22:30:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147346 s, 71.2 MB/s 2024-08-18T22:30:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181001 s, 57.9 MB/s 2024-08-18T22:30:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144635 s, 72.5 MB/s 2024-08-18T22:30:31.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.000 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146167 s, 71.7 MB/s 2024-08-18T22:30:31.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140712 s, 74.5 MB/s 2024-08-18T22:30:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154728 s, 67.8 MB/s 2024-08-18T22:30:31.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144162 s, 72.7 MB/s 2024-08-18T22:30:31.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.069 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138349 s, 75.8 MB/s 2024-08-18T22:30:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149571 s, 70.1 MB/s 2024-08-18T22:30:31.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.105 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156895 s, 66.8 MB/s 2024-08-18T22:30:31.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147292 s, 71.2 MB/s 2024-08-18T22:30:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170733 s, 61.4 MB/s 2024-08-18T22:30:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143713 s, 73.0 MB/s 2024-08-18T22:30:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237733 s, 44.1 MB/s 2024-08-18T22:30:31.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.206 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185161 s, 56.6 MB/s 2024-08-18T22:30:31.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.227 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178571 s, 58.7 MB/s 2024-08-18T22:30:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170613 s, 61.5 MB/s 2024-08-18T22:30:31.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.274 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248742 s, 42.2 MB/s 2024-08-18T22:30:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171126 s, 61.3 MB/s 2024-08-18T22:30:31.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:31.301 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:31.302 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:31.302 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.4 2024-08-18T22:30:31.302 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:31.302 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:31.302 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:31.302 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172791 s, 60.7 MB/s 2024-08-18T22:30:31.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157856 s, 66.4 MB/s 2024-08-18T22:30:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175932 s, 59.6 MB/s 2024-08-18T22:30:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213808 s, 49.0 MB/s 2024-08-18T22:30:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.454 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158289 s, 66.2 MB/s 2024-08-18T22:30:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146614 s, 71.5 MB/s 2024-08-18T22:30:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165626 s, 63.3 MB/s 2024-08-18T22:30:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209776 s, 50.0 MB/s 2024-08-18T22:30:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182543 s, 57.4 MB/s 2024-08-18T22:30:31.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174979 s, 59.9 MB/s 2024-08-18T22:30:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148084 s, 70.8 MB/s 2024-08-18T22:30:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210461 s, 49.8 MB/s 2024-08-18T22:30:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.616 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178144 s, 58.9 MB/s 2024-08-18T22:30:31.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.636 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172676 s, 60.7 MB/s 2024-08-18T22:30:31.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.655 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015556 s, 67.4 MB/s 2024-08-18T22:30:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.675 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179639 s, 58.4 MB/s 2024-08-18T22:30:31.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232764 s, 45.0 MB/s 2024-08-18T22:30:31.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.718 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148639 s, 70.5 MB/s 2024-08-18T22:30:31.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.741 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204935 s, 51.2 MB/s 2024-08-18T22:30:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175734 s, 59.7 MB/s 2024-08-18T22:30:31.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.782 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173536 s, 60.4 MB/s 2024-08-18T22:30:31.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147509 s, 71.1 MB/s 2024-08-18T22:30:31.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172983 s, 60.6 MB/s 2024-08-18T22:30:31.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172843 s, 60.7 MB/s 2024-08-18T22:30:31.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.864 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224856 s, 46.6 MB/s 2024-08-18T22:30:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.882 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150702 s, 69.6 MB/s 2024-08-18T22:30:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.898 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142422 s, 73.6 MB/s 2024-08-18T22:30:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.923 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213303 s, 49.2 MB/s 2024-08-18T22:30:31.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.943 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176575 s, 59.4 MB/s 2024-08-18T22:30:31.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169265 s, 61.9 MB/s 2024-08-18T22:30:31.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.979 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148506 s, 70.6 MB/s 2024-08-18T22:30:31.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:31.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:31.998 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153679 s, 68.2 MB/s 2024-08-18T22:30:31.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:32.005 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:32.005 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:32.005 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.5 2024-08-18T22:30:32.005 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:32.005 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:32.005 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:32.005 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:32.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143222 s, 73.2 MB/s 2024-08-18T22:30:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180973 s, 57.9 MB/s 2024-08-18T22:30:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145369 s, 72.1 MB/s 2024-08-18T22:30:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153631 s, 68.3 MB/s 2024-08-18T22:30:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176698 s, 59.3 MB/s 2024-08-18T22:30:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017261 s, 60.7 MB/s 2024-08-18T22:30:32.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.232 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.232 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155095 s, 67.6 MB/s 2024-08-18T22:30:32.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148715 s, 70.5 MB/s 2024-08-18T22:30:32.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.273 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203807 s, 51.4 MB/s 2024-08-18T22:30:32.292 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.292 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172448 s, 60.8 MB/s 2024-08-18T22:30:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.312 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163928 s, 64.0 MB/s 2024-08-18T22:30:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175112 s, 59.9 MB/s 2024-08-18T22:30:32.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146289 s, 71.7 MB/s 2024-08-18T22:30:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.369 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176229 s, 59.5 MB/s 2024-08-18T22:30:32.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196047 s, 53.5 MB/s 2024-08-18T22:30:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143702 s, 73.0 MB/s 2024-08-18T22:30:32.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146045 s, 71.8 MB/s 2024-08-18T22:30:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143322 s, 73.2 MB/s 2024-08-18T22:30:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186348 s, 56.3 MB/s 2024-08-18T22:30:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148452 s, 70.6 MB/s 2024-08-18T22:30:32.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.500 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169928 s, 61.7 MB/s 2024-08-18T22:30:32.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.521 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173371 s, 60.5 MB/s 2024-08-18T22:30:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152565 s, 68.7 MB/s 2024-08-18T22:30:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173778 s, 60.3 MB/s 2024-08-18T22:30:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196067 s, 53.5 MB/s 2024-08-18T22:30:32.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175354 s, 59.8 MB/s 2024-08-18T22:30:32.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153821 s, 68.2 MB/s 2024-08-18T22:30:32.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.636 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015214 s, 68.9 MB/s 2024-08-18T22:30:32.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.654 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148294 s, 70.7 MB/s 2024-08-18T22:30:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.671 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147028 s, 71.3 MB/s 2024-08-18T22:30:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017153 s, 61.1 MB/s 2024-08-18T22:30:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.709 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155462 s, 67.4 MB/s 2024-08-18T22:30:32.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:32.716 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:32.717 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:32.717 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.6 2024-08-18T22:30:32.717 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:32.717 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:32.717 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:32.717 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:32.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.788 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174845 s, 60.0 MB/s 2024-08-18T22:30:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151893 s, 69.0 MB/s 2024-08-18T22:30:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162033 s, 64.7 MB/s 2024-08-18T22:30:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151331 s, 69.3 MB/s 2024-08-18T22:30:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.860 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144484 s, 72.6 MB/s 2024-08-18T22:30:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174339 s, 60.1 MB/s 2024-08-18T22:30:32.899 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.900 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170781 s, 61.4 MB/s 2024-08-18T22:30:32.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.925 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225594 s, 46.5 MB/s 2024-08-18T22:30:32.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177491 s, 59.1 MB/s 2024-08-18T22:30:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158334 s, 66.2 MB/s 2024-08-18T22:30:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163381 s, 64.2 MB/s 2024-08-18T22:30:33.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209216 s, 50.1 MB/s 2024-08-18T22:30:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.024 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156049 s, 67.2 MB/s 2024-08-18T22:30:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.045 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181735 s, 57.7 MB/s 2024-08-18T22:30:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158022 s, 66.4 MB/s 2024-08-18T22:30:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149532 s, 70.1 MB/s 2024-08-18T22:30:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146942 s, 71.4 MB/s 2024-08-18T22:30:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160547 s, 65.3 MB/s 2024-08-18T22:30:33.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016975 s, 61.8 MB/s 2024-08-18T22:30:33.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.162 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022764 s, 46.1 MB/s 2024-08-18T22:30:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175783 s, 59.7 MB/s 2024-08-18T22:30:33.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147057 s, 71.3 MB/s 2024-08-18T22:30:33.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.223 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021265 s, 49.3 MB/s 2024-08-18T22:30:33.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.243 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174864 s, 60.0 MB/s 2024-08-18T22:30:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.262 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161925 s, 64.8 MB/s 2024-08-18T22:30:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.282 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175028 s, 59.9 MB/s 2024-08-18T22:30:33.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.300 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150351 s, 69.7 MB/s 2024-08-18T22:30:33.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222934 s, 47.0 MB/s 2024-08-18T22:30:33.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.350 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219732 s, 47.7 MB/s 2024-08-18T22:30:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.367 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151682 s, 69.1 MB/s 2024-08-18T22:30:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195604 s, 53.6 MB/s 2024-08-18T22:30:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151556 s, 69.2 MB/s 2024-08-18T22:30:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:33.415 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:33.415 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:33.415 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.7 2024-08-18T22:30:33.415 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:33.415 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:33.415 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:33.415 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:33.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.485 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151199 s, 69.4 MB/s 2024-08-18T22:30:33.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213582 s, 49.1 MB/s 2024-08-18T22:30:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152335 s, 68.8 MB/s 2024-08-18T22:30:33.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201405 s, 52.1 MB/s 2024-08-18T22:30:33.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180785 s, 58.0 MB/s 2024-08-18T22:30:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171664 s, 61.1 MB/s 2024-08-18T22:30:33.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.607 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014574 s, 71.9 MB/s 2024-08-18T22:30:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154046 s, 68.1 MB/s 2024-08-18T22:30:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144908 s, 72.4 MB/s 2024-08-18T22:30:33.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.660 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147885 s, 70.9 MB/s 2024-08-18T22:30:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153162 s, 68.5 MB/s 2024-08-18T22:30:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.695 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149883 s, 70.0 MB/s 2024-08-18T22:30:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156733 s, 66.9 MB/s 2024-08-18T22:30:33.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.733 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169229 s, 62.0 MB/s 2024-08-18T22:30:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.749 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133064 s, 78.8 MB/s 2024-08-18T22:30:33.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.769 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177867 s, 59.0 MB/s 2024-08-18T22:30:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172038 s, 61.0 MB/s 2024-08-18T22:30:33.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.807 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154095 s, 68.0 MB/s 2024-08-18T22:30:33.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.825 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014944 s, 70.2 MB/s 2024-08-18T22:30:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014749 s, 71.1 MB/s 2024-08-18T22:30:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220249 s, 47.6 MB/s 2024-08-18T22:30:33.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.887 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171898 s, 61.0 MB/s 2024-08-18T22:30:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220725 s, 47.5 MB/s 2024-08-18T22:30:33.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.931 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170262 s, 61.6 MB/s 2024-08-18T22:30:33.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194623 s, 53.9 MB/s 2024-08-18T22:30:33.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.970 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141516 s, 74.1 MB/s 2024-08-18T22:30:33.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:33.994 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:33.994 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210968 s, 49.7 MB/s 2024-08-18T22:30:34.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171775 s, 61.0 MB/s 2024-08-18T22:30:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014662 s, 71.5 MB/s 2024-08-18T22:30:34.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171336 s, 61.2 MB/s 2024-08-18T22:30:34.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147783 s, 71.0 MB/s 2024-08-18T22:30:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186314 s, 56.3 MB/s 2024-08-18T22:30:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:34.096 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:34.097 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:34.097 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.8 2024-08-18T22:30:34.097 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:34.097 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:34.097 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:34.097 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:34.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:34.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171253 s, 61.2 MB/s 2024-08-18T22:30:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144501 s, 72.6 MB/s 2024-08-18T22:30:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177929 s, 58.9 MB/s 2024-08-18T22:30:34.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.266 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171641 s, 61.1 MB/s 2024-08-18T22:30:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148862 s, 70.4 MB/s 2024-08-18T22:30:34.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.300 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147255 s, 71.2 MB/s 2024-08-18T22:30:34.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015531 s, 67.5 MB/s 2024-08-18T22:30:34.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145658 s, 72.0 MB/s 2024-08-18T22:30:34.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.353 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.353 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146869 s, 71.4 MB/s 2024-08-18T22:30:34.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145849 s, 71.9 MB/s 2024-08-18T22:30:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148049 s, 70.8 MB/s 2024-08-18T22:30:34.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178709 s, 58.7 MB/s 2024-08-18T22:30:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181793 s, 57.7 MB/s 2024-08-18T22:30:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153709 s, 68.2 MB/s 2024-08-18T22:30:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191863 s, 54.7 MB/s 2024-08-18T22:30:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.487 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150206 s, 69.8 MB/s 2024-08-18T22:30:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.503 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142622 s, 73.5 MB/s 2024-08-18T22:30:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179606 s, 58.4 MB/s 2024-08-18T22:30:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.545 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181219 s, 57.9 MB/s 2024-08-18T22:30:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152668 s, 68.7 MB/s 2024-08-18T22:30:34.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.578 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125279 s, 83.7 MB/s 2024-08-18T22:30:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160876 s, 65.2 MB/s 2024-08-18T22:30:34.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149751 s, 70.0 MB/s 2024-08-18T22:30:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195606 s, 53.6 MB/s 2024-08-18T22:30:34.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.654 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015042 s, 69.7 MB/s 2024-08-18T22:30:34.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.674 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.674 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166285 s, 63.1 MB/s 2024-08-18T22:30:34.694 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.694 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.694 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182469 s, 57.5 MB/s 2024-08-18T22:30:34.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.712 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150884 s, 69.5 MB/s 2024-08-18T22:30:34.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155659 s, 67.4 MB/s 2024-08-18T22:30:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147369 s, 71.2 MB/s 2024-08-18T22:30:34.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.765 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147981 s, 70.9 MB/s 2024-08-18T22:30:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151254 s, 69.3 MB/s 2024-08-18T22:30:34.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:34.790 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:34.790 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:34.790 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.9 2024-08-18T22:30:34.790 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:34.790 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:34.791 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:34.791 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:34.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:34.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173107 s, 60.6 MB/s 2024-08-18T22:30:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194411 s, 53.9 MB/s 2024-08-18T22:30:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.908 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207273 s, 50.6 MB/s 2024-08-18T22:30:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.924 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144501 s, 72.6 MB/s 2024-08-18T22:30:34.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144872 s, 72.4 MB/s 2024-08-18T22:30:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145761 s, 71.9 MB/s 2024-08-18T22:30:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158355 s, 66.2 MB/s 2024-08-18T22:30:34.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:34.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:34.995 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154667 s, 67.8 MB/s 2024-08-18T22:30:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.012 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142502 s, 73.6 MB/s 2024-08-18T22:30:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244784 s, 42.8 MB/s 2024-08-18T22:30:35.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.059 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167212 s, 62.7 MB/s 2024-08-18T22:30:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168555 s, 62.2 MB/s 2024-08-18T22:30:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.095 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148256 s, 70.7 MB/s 2024-08-18T22:30:35.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.112 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144134 s, 72.8 MB/s 2024-08-18T22:30:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143965 s, 72.8 MB/s 2024-08-18T22:30:35.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.153 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212634 s, 49.3 MB/s 2024-08-18T22:30:35.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.173 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173304 s, 60.5 MB/s 2024-08-18T22:30:35.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.193 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171201 s, 61.2 MB/s 2024-08-18T22:30:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021266 s, 49.3 MB/s 2024-08-18T22:30:35.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.234 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.234 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149088 s, 70.3 MB/s 2024-08-18T22:30:35.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.254 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163516 s, 64.1 MB/s 2024-08-18T22:30:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020069 s, 52.2 MB/s 2024-08-18T22:30:35.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.293 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146382 s, 71.6 MB/s 2024-08-18T22:30:35.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.312 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157458 s, 66.6 MB/s 2024-08-18T22:30:35.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219518 s, 47.8 MB/s 2024-08-18T22:30:35.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.358 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189818 s, 55.2 MB/s 2024-08-18T22:30:35.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192731 s, 54.4 MB/s 2024-08-18T22:30:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173985 s, 60.3 MB/s 2024-08-18T22:30:35.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.418 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150778 s, 69.5 MB/s 2024-08-18T22:30:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144561 s, 72.5 MB/s 2024-08-18T22:30:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164249 s, 63.8 MB/s 2024-08-18T22:30:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015077 s, 69.5 MB/s 2024-08-18T22:30:35.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:35.479 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:35.479 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:35.479 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.10 2024-08-18T22:30:35.479 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:35.479 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:35.479 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:35.479 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:35.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155566 s, 67.4 MB/s 2024-08-18T22:30:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181363 s, 57.8 MB/s 2024-08-18T22:30:35.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.596 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224685 s, 46.7 MB/s 2024-08-18T22:30:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146569 s, 71.5 MB/s 2024-08-18T22:30:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147404 s, 71.1 MB/s 2024-08-18T22:30:35.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144812 s, 72.4 MB/s 2024-08-18T22:30:35.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.661 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.662 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110807 s, 94.6 MB/s 2024-08-18T22:30:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178927 s, 58.6 MB/s 2024-08-18T22:30:35.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196709 s, 53.3 MB/s 2024-08-18T22:30:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212863 s, 49.3 MB/s 2024-08-18T22:30:35.749 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.750 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179648 s, 58.4 MB/s 2024-08-18T22:30:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152507 s, 68.8 MB/s 2024-08-18T22:30:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.790 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191302 s, 54.8 MB/s 2024-08-18T22:30:35.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.809 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155265 s, 67.5 MB/s 2024-08-18T22:30:35.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.829 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177445 s, 59.1 MB/s 2024-08-18T22:30:35.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.853 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214632 s, 48.9 MB/s 2024-08-18T22:30:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145676 s, 72.0 MB/s 2024-08-18T22:30:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152886 s, 68.6 MB/s 2024-08-18T22:30:35.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213044 s, 49.2 MB/s 2024-08-18T22:30:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167819 s, 62.5 MB/s 2024-08-18T22:30:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.952 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173981 s, 60.3 MB/s 2024-08-18T22:30:35.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.970 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160806 s, 65.2 MB/s 2024-08-18T22:30:35.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:35.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:35.990 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170942 s, 61.3 MB/s 2024-08-18T22:30:36.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.011 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018253 s, 57.4 MB/s 2024-08-18T22:30:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163276 s, 64.2 MB/s 2024-08-18T22:30:36.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248851 s, 42.1 MB/s 2024-08-18T22:30:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122535 s, 85.6 MB/s 2024-08-18T22:30:36.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164995 s, 63.6 MB/s 2024-08-18T22:30:36.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.112 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182447 s, 57.5 MB/s 2024-08-18T22:30:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178654 s, 58.7 MB/s 2024-08-18T22:30:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168342 s, 62.3 MB/s 2024-08-18T22:30:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.173 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178273 s, 58.8 MB/s 2024-08-18T22:30:36.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:36.180 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:36.180 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:36.180 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.11 2024-08-18T22:30:36.180 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:36.180 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:36.180 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:36.180 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:36.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:36.251 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.252 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173964 s, 60.3 MB/s 2024-08-18T22:30:36.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.274 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193766 s, 54.1 MB/s 2024-08-18T22:30:36.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.294 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.294 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172181 s, 60.9 MB/s 2024-08-18T22:30:36.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.313 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167292 s, 62.7 MB/s 2024-08-18T22:30:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150744 s, 69.6 MB/s 2024-08-18T22:30:36.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.351 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173591 s, 60.4 MB/s 2024-08-18T22:30:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212249 s, 49.4 MB/s 2024-08-18T22:30:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145288 s, 72.2 MB/s 2024-08-18T22:30:36.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.410 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151809 s, 69.1 MB/s 2024-08-18T22:30:36.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.429 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.429 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173353 s, 60.5 MB/s 2024-08-18T22:30:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170117 s, 61.6 MB/s 2024-08-18T22:30:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153457 s, 68.3 MB/s 2024-08-18T22:30:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180437 s, 58.1 MB/s 2024-08-18T22:30:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.507 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172968 s, 60.6 MB/s 2024-08-18T22:30:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144951 s, 72.3 MB/s 2024-08-18T22:30:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151489 s, 69.2 MB/s 2024-08-18T22:30:36.561 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.561 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.561 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156379 s, 67.1 MB/s 2024-08-18T22:30:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182349 s, 57.5 MB/s 2024-08-18T22:30:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179815 s, 58.3 MB/s 2024-08-18T22:30:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208799 s, 50.2 MB/s 2024-08-18T22:30:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174192 s, 60.2 MB/s 2024-08-18T22:30:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145392 s, 72.1 MB/s 2024-08-18T22:30:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.681 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120783 s, 86.8 MB/s 2024-08-18T22:30:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173036 s, 60.6 MB/s 2024-08-18T22:30:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014844 s, 70.6 MB/s 2024-08-18T22:30:36.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176365 s, 59.5 MB/s 2024-08-18T22:30:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207472 s, 50.5 MB/s 2024-08-18T22:30:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198423 s, 52.8 MB/s 2024-08-18T22:30:36.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.805 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159107 s, 65.9 MB/s 2024-08-18T22:30:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221644 s, 47.3 MB/s 2024-08-18T22:30:36.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166849 s, 62.8 MB/s 2024-08-18T22:30:36.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173564 s, 60.4 MB/s 2024-08-18T22:30:36.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:36.878 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:36.878 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:36.878 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.12 2024-08-18T22:30:36.878 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:36.878 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:36.879 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:36.879 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:36.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.952 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177237 s, 59.2 MB/s 2024-08-18T22:30:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149429 s, 70.2 MB/s 2024-08-18T22:30:36.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:36.988 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015265 s, 68.7 MB/s 2024-08-18T22:30:37.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.008 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172754 s, 60.7 MB/s 2024-08-18T22:30:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149081 s, 70.3 MB/s 2024-08-18T22:30:37.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.044 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.044 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145754 s, 71.9 MB/s 2024-08-18T22:30:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154167 s, 68.0 MB/s 2024-08-18T22:30:37.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.080 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147078 s, 71.3 MB/s 2024-08-18T22:30:37.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.099 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.099 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156447 s, 67.0 MB/s 2024-08-18T22:30:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171466 s, 61.2 MB/s 2024-08-18T22:30:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167682 s, 62.5 MB/s 2024-08-18T22:30:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198408 s, 52.8 MB/s 2024-08-18T22:30:37.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161968 s, 64.7 MB/s 2024-08-18T22:30:37.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.197 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.197 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146175 s, 71.7 MB/s 2024-08-18T22:30:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248127 s, 42.3 MB/s 2024-08-18T22:30:37.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.244 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151939 s, 69.0 MB/s 2024-08-18T22:30:37.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163739 s, 64.0 MB/s 2024-08-18T22:30:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.281 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.282 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158278 s, 66.2 MB/s 2024-08-18T22:30:37.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.301 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164712 s, 63.7 MB/s 2024-08-18T22:30:37.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.321 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174746 s, 60.0 MB/s 2024-08-18T22:30:37.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.346 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217291 s, 48.3 MB/s 2024-08-18T22:30:37.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154501 s, 67.9 MB/s 2024-08-18T22:30:37.382 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.382 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.382 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145847 s, 71.9 MB/s 2024-08-18T22:30:37.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223014 s, 47.0 MB/s 2024-08-18T22:30:37.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146949 s, 71.4 MB/s 2024-08-18T22:30:37.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.443 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143282 s, 73.2 MB/s 2024-08-18T22:30:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147281 s, 71.2 MB/s 2024-08-18T22:30:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243096 s, 43.1 MB/s 2024-08-18T22:30:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143698 s, 73.0 MB/s 2024-08-18T22:30:37.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.522 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150709 s, 69.6 MB/s 2024-08-18T22:30:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177834 s, 59.0 MB/s 2024-08-18T22:30:37.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.557 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120719 s, 86.9 MB/s 2024-08-18T22:30:37.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:37.564 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:37.564 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:37.564 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.13 2024-08-18T22:30:37.564 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:37.565 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:37.565 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:37.565 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:37.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.640 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203305 s, 51.6 MB/s 2024-08-18T22:30:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175701 s, 59.7 MB/s 2024-08-18T22:30:37.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.678 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150568 s, 69.6 MB/s 2024-08-18T22:30:37.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.695 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014839 s, 70.7 MB/s 2024-08-18T22:30:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150651 s, 69.6 MB/s 2024-08-18T22:30:37.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.733 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.733 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172634 s, 60.7 MB/s 2024-08-18T22:30:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.757 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218781 s, 47.9 MB/s 2024-08-18T22:30:37.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125471 s, 83.6 MB/s 2024-08-18T22:30:37.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175436 s, 59.8 MB/s 2024-08-18T22:30:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166227 s, 63.1 MB/s 2024-08-18T22:30:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158318 s, 66.2 MB/s 2024-08-18T22:30:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168897 s, 62.1 MB/s 2024-08-18T22:30:37.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.873 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212112 s, 49.4 MB/s 2024-08-18T22:30:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195906 s, 53.5 MB/s 2024-08-18T22:30:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209374 s, 50.1 MB/s 2024-08-18T22:30:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143641 s, 73.0 MB/s 2024-08-18T22:30:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236354 s, 44.4 MB/s 2024-08-18T22:30:37.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:37.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:37.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171704 s, 61.1 MB/s 2024-08-18T22:30:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173574 s, 60.4 MB/s 2024-08-18T22:30:38.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.020 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154933 s, 67.7 MB/s 2024-08-18T22:30:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175247 s, 59.8 MB/s 2024-08-18T22:30:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151079 s, 69.4 MB/s 2024-08-18T22:30:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215628 s, 48.6 MB/s 2024-08-18T22:30:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153753 s, 68.2 MB/s 2024-08-18T22:30:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144716 s, 72.5 MB/s 2024-08-18T22:30:38.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148449 s, 70.6 MB/s 2024-08-18T22:30:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148999 s, 70.4 MB/s 2024-08-18T22:30:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170097 s, 61.6 MB/s 2024-08-18T22:30:38.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151545 s, 69.2 MB/s 2024-08-18T22:30:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163003 s, 64.3 MB/s 2024-08-18T22:30:38.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.228 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171481 s, 61.1 MB/s 2024-08-18T22:30:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210411 s, 49.8 MB/s 2024-08-18T22:30:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:38.259 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:38.259 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:38.259 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.14 2024-08-18T22:30:38.259 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:38.260 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:38.260 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:38.260 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:38.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175031 s, 59.9 MB/s 2024-08-18T22:30:38.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.349 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.349 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152699 s, 68.7 MB/s 2024-08-18T22:30:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.366 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145664 s, 72.0 MB/s 2024-08-18T22:30:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014218 s, 73.8 MB/s 2024-08-18T22:30:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163548 s, 64.1 MB/s 2024-08-18T22:30:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153103 s, 68.5 MB/s 2024-08-18T22:30:38.438 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.438 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.438 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015468 s, 67.8 MB/s 2024-08-18T22:30:38.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153709 s, 68.2 MB/s 2024-08-18T22:30:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151826 s, 69.1 MB/s 2024-08-18T22:30:38.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.492 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150799 s, 69.5 MB/s 2024-08-18T22:30:38.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.515 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209177 s, 50.1 MB/s 2024-08-18T22:30:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172648 s, 60.7 MB/s 2024-08-18T22:30:38.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.553 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014965 s, 70.1 MB/s 2024-08-18T22:30:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142043 s, 73.8 MB/s 2024-08-18T22:30:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.587 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143708 s, 73.0 MB/s 2024-08-18T22:30:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146327 s, 71.7 MB/s 2024-08-18T22:30:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141555 s, 74.1 MB/s 2024-08-18T22:30:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242599 s, 43.2 MB/s 2024-08-18T22:30:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161644 s, 64.9 MB/s 2024-08-18T22:30:38.684 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.684 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.684 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149597 s, 70.1 MB/s 2024-08-18T22:30:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.702 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152609 s, 68.7 MB/s 2024-08-18T22:30:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151745 s, 69.1 MB/s 2024-08-18T22:30:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.741 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182435 s, 57.5 MB/s 2024-08-18T22:30:38.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203865 s, 51.4 MB/s 2024-08-18T22:30:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146074 s, 71.8 MB/s 2024-08-18T22:30:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180899 s, 58.0 MB/s 2024-08-18T22:30:38.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.821 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166133 s, 63.1 MB/s 2024-08-18T22:30:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.841 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172409 s, 60.8 MB/s 2024-08-18T22:30:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141147 s, 74.3 MB/s 2024-08-18T22:30:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170181 s, 61.6 MB/s 2024-08-18T22:30:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207086 s, 50.6 MB/s 2024-08-18T22:30:38.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:38.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:38.923 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195754 s, 53.6 MB/s 2024-08-18T22:30:38.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:38.930 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:38.931 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:38.931 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.15 2024-08-18T22:30:38.931 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:38.931 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:38.931 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:38.931 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:38.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159855 s, 65.6 MB/s 2024-08-18T22:30:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125066 s, 83.8 MB/s 2024-08-18T22:30:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154478 s, 67.9 MB/s 2024-08-18T22:30:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183629 s, 57.1 MB/s 2024-08-18T22:30:39.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.076 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178091 s, 58.9 MB/s 2024-08-18T22:30:39.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172667 s, 60.7 MB/s 2024-08-18T22:30:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.115 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167495 s, 62.6 MB/s 2024-08-18T22:30:39.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166108 s, 63.1 MB/s 2024-08-18T22:30:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145359 s, 72.1 MB/s 2024-08-18T22:30:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.177 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239325 s, 43.8 MB/s 2024-08-18T22:30:39.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185868 s, 56.4 MB/s 2024-08-18T22:30:39.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157068 s, 66.8 MB/s 2024-08-18T22:30:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.237 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174984 s, 59.9 MB/s 2024-08-18T22:30:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169938 s, 61.7 MB/s 2024-08-18T22:30:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162005 s, 64.7 MB/s 2024-08-18T22:30:39.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.293 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151952 s, 69.0 MB/s 2024-08-18T22:30:39.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015532 s, 67.5 MB/s 2024-08-18T22:30:39.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.329 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145294 s, 72.2 MB/s 2024-08-18T22:30:39.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.346 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146327 s, 71.7 MB/s 2024-08-18T22:30:39.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152242 s, 68.9 MB/s 2024-08-18T22:30:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181018 s, 57.9 MB/s 2024-08-18T22:30:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155566 s, 67.4 MB/s 2024-08-18T22:30:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015175 s, 69.1 MB/s 2024-08-18T22:30:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169657 s, 61.8 MB/s 2024-08-18T22:30:39.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.458 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01469 s, 71.4 MB/s 2024-08-18T22:30:39.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166331 s, 63.0 MB/s 2024-08-18T22:30:39.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177386 s, 59.1 MB/s 2024-08-18T22:30:39.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152362 s, 68.8 MB/s 2024-08-18T22:30:39.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165608 s, 63.3 MB/s 2024-08-18T22:30:39.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148337 s, 70.7 MB/s 2024-08-18T22:30:39.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.572 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.572 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160031 s, 65.5 MB/s 2024-08-18T22:30:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179752 s, 58.3 MB/s 2024-08-18T22:30:39.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:39.601 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:39.601 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:39.601 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.16 2024-08-18T22:30:39.601 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:39.601 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:39.601 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:39.601 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147361 s, 71.2 MB/s 2024-08-18T22:30:39.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.691 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180239 s, 58.2 MB/s 2024-08-18T22:30:39.708 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.709 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150174 s, 69.8 MB/s 2024-08-18T22:30:39.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.727 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152119 s, 68.9 MB/s 2024-08-18T22:30:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248319 s, 42.2 MB/s 2024-08-18T22:30:39.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.774 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.774 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017584 s, 59.6 MB/s 2024-08-18T22:30:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150318 s, 69.8 MB/s 2024-08-18T22:30:39.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.810 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147911 s, 70.9 MB/s 2024-08-18T22:30:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171232 s, 61.2 MB/s 2024-08-18T22:30:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.856 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.856 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238079 s, 44.0 MB/s 2024-08-18T22:30:39.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172736 s, 60.7 MB/s 2024-08-18T22:30:39.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169065 s, 62.0 MB/s 2024-08-18T22:30:39.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161781 s, 64.8 MB/s 2024-08-18T22:30:39.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.931 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151298 s, 69.3 MB/s 2024-08-18T22:30:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167276 s, 62.7 MB/s 2024-08-18T22:30:39.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.973 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.973 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202329 s, 51.8 MB/s 2024-08-18T22:30:39.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:39.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:39.993 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017346 s, 60.5 MB/s 2024-08-18T22:30:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.013 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177527 s, 59.1 MB/s 2024-08-18T22:30:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186469 s, 56.2 MB/s 2024-08-18T22:30:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.059 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219425 s, 47.8 MB/s 2024-08-18T22:30:40.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172386 s, 60.8 MB/s 2024-08-18T22:30:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152102 s, 68.9 MB/s 2024-08-18T22:30:40.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146615 s, 71.5 MB/s 2024-08-18T22:30:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.130 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134896 s, 77.7 MB/s 2024-08-18T22:30:40.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.150 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.150 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174431 s, 60.1 MB/s 2024-08-18T22:30:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156993 s, 66.8 MB/s 2024-08-18T22:30:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015354 s, 68.3 MB/s 2024-08-18T22:30:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.204 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146525 s, 71.6 MB/s 2024-08-18T22:30:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143353 s, 73.1 MB/s 2024-08-18T22:30:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194269 s, 54.0 MB/s 2024-08-18T22:30:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151339 s, 69.3 MB/s 2024-08-18T22:30:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142858 s, 73.4 MB/s 2024-08-18T22:30:40.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:40.285 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:40.285 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:40.285 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.17 2024-08-18T22:30:40.285 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:40.285 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:40.285 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:40.286 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:40.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:40.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213625 s, 49.1 MB/s 2024-08-18T22:30:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173139 s, 60.6 MB/s 2024-08-18T22:30:40.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.399 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145618 s, 72.0 MB/s 2024-08-18T22:30:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017272 s, 60.7 MB/s 2024-08-18T22:30:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152525 s, 68.7 MB/s 2024-08-18T22:30:40.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.454 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01512 s, 69.4 MB/s 2024-08-18T22:30:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211176 s, 49.7 MB/s 2024-08-18T22:30:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190613 s, 55.0 MB/s 2024-08-18T22:30:40.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.519 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172685 s, 60.7 MB/s 2024-08-18T22:30:40.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207582 s, 50.5 MB/s 2024-08-18T22:30:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126294 s, 83.0 MB/s 2024-08-18T22:30:40.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.576 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164354 s, 63.8 MB/s 2024-08-18T22:30:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015989 s, 65.6 MB/s 2024-08-18T22:30:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.613 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155642 s, 67.4 MB/s 2024-08-18T22:30:40.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.634 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176592 s, 59.4 MB/s 2024-08-18T22:30:40.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.652 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153875 s, 68.1 MB/s 2024-08-18T22:30:40.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.673 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177298 s, 59.1 MB/s 2024-08-18T22:30:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218769 s, 47.9 MB/s 2024-08-18T22:30:40.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.727 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264635 s, 39.6 MB/s 2024-08-18T22:30:40.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219617 s, 47.7 MB/s 2024-08-18T22:30:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211153 s, 49.7 MB/s 2024-08-18T22:30:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154075 s, 68.1 MB/s 2024-08-18T22:30:40.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.813 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.813 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015574 s, 67.3 MB/s 2024-08-18T22:30:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145904 s, 71.9 MB/s 2024-08-18T22:30:40.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.848 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157643 s, 66.5 MB/s 2024-08-18T22:30:40.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.868 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172984 s, 60.6 MB/s 2024-08-18T22:30:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209835 s, 50.0 MB/s 2024-08-18T22:30:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020349 s, 51.5 MB/s 2024-08-18T22:30:40.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146614 s, 71.5 MB/s 2024-08-18T22:30:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015342 s, 68.3 MB/s 2024-08-18T22:30:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171056 s, 61.3 MB/s 2024-08-18T22:30:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144345 s, 72.6 MB/s 2024-08-18T22:30:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:40.994 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:40.994 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:40.994 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.18 2024-08-18T22:30:40.994 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:40.994 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:40.994 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:40.994 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190235 s, 55.1 MB/s 2024-08-18T22:30:41.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.095 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243962 s, 43.0 MB/s 2024-08-18T22:30:41.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.112 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147325 s, 71.2 MB/s 2024-08-18T22:30:41.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240175 s, 43.7 MB/s 2024-08-18T22:30:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152207 s, 68.9 MB/s 2024-08-18T22:30:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149763 s, 70.0 MB/s 2024-08-18T22:30:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167789 s, 62.5 MB/s 2024-08-18T22:30:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166448 s, 63.0 MB/s 2024-08-18T22:30:41.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.236 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.236 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201411 s, 52.1 MB/s 2024-08-18T22:30:41.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.253 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147863 s, 70.9 MB/s 2024-08-18T22:30:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157136 s, 66.7 MB/s 2024-08-18T22:30:41.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.289 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149486 s, 70.1 MB/s 2024-08-18T22:30:41.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.316 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246628 s, 42.5 MB/s 2024-08-18T22:30:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170709 s, 61.4 MB/s 2024-08-18T22:30:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155858 s, 67.3 MB/s 2024-08-18T22:30:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172863 s, 60.7 MB/s 2024-08-18T22:30:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221316 s, 47.4 MB/s 2024-08-18T22:30:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145251 s, 72.2 MB/s 2024-08-18T22:30:41.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174194 s, 60.2 MB/s 2024-08-18T22:30:41.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143445 s, 73.1 MB/s 2024-08-18T22:30:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172787 s, 60.7 MB/s 2024-08-18T22:30:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192234 s, 54.5 MB/s 2024-08-18T22:30:41.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151102 s, 69.4 MB/s 2024-08-18T22:30:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147527 s, 71.1 MB/s 2024-08-18T22:30:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161627 s, 64.9 MB/s 2024-08-18T22:30:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145517 s, 72.1 MB/s 2024-08-18T22:30:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238711 s, 43.9 MB/s 2024-08-18T22:30:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144603 s, 72.5 MB/s 2024-08-18T22:30:41.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164862 s, 63.6 MB/s 2024-08-18T22:30:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155541 s, 67.4 MB/s 2024-08-18T22:30:41.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155196 s, 67.6 MB/s 2024-08-18T22:30:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150062 s, 69.9 MB/s 2024-08-18T22:30:41.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:41.690 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:41.690 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:41.690 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.19 2024-08-18T22:30:41.690 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:41.690 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:41.690 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:41.690 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153605 s, 68.3 MB/s 2024-08-18T22:30:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179335 s, 58.5 MB/s 2024-08-18T22:30:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.801 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179051 s, 58.6 MB/s 2024-08-18T22:30:41.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.820 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.820 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161543 s, 64.9 MB/s 2024-08-18T22:30:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173134 s, 60.6 MB/s 2024-08-18T22:30:41.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.859 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161349 s, 65.0 MB/s 2024-08-18T22:30:41.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165591 s, 63.3 MB/s 2024-08-18T22:30:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203014 s, 51.7 MB/s 2024-08-18T22:30:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178643 s, 58.7 MB/s 2024-08-18T22:30:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179991 s, 58.3 MB/s 2024-08-18T22:30:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151014 s, 69.4 MB/s 2024-08-18T22:30:41.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.979 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.979 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172159 s, 60.9 MB/s 2024-08-18T22:30:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143733 s, 73.0 MB/s 2024-08-18T22:30:42.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207077 s, 50.6 MB/s 2024-08-18T22:30:42.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.038 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163049 s, 64.3 MB/s 2024-08-18T22:30:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159794 s, 65.6 MB/s 2024-08-18T22:30:42.071 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.072 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124888 s, 84.0 MB/s 2024-08-18T22:30:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.090 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162582 s, 64.5 MB/s 2024-08-18T22:30:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.116 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230261 s, 45.5 MB/s 2024-08-18T22:30:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165781 s, 63.3 MB/s 2024-08-18T22:30:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017215 s, 60.9 MB/s 2024-08-18T22:30:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175185 s, 59.9 MB/s 2024-08-18T22:30:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.193 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158273 s, 66.3 MB/s 2024-08-18T22:30:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170362 s, 61.5 MB/s 2024-08-18T22:30:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146784 s, 71.4 MB/s 2024-08-18T22:30:42.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146928 s, 71.4 MB/s 2024-08-18T22:30:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168383 s, 62.3 MB/s 2024-08-18T22:30:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150004 s, 69.9 MB/s 2024-08-18T22:30:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017621 s, 59.5 MB/s 2024-08-18T22:30:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149005 s, 70.4 MB/s 2024-08-18T22:30:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143346 s, 73.2 MB/s 2024-08-18T22:30:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168693 s, 62.2 MB/s 2024-08-18T22:30:42.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:42.366 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:42.366 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:42.366 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.20 2024-08-18T22:30:42.366 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:42.366 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:42.366 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:42.366 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:42.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178779 s, 58.7 MB/s 2024-08-18T22:30:42.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.457 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144059 s, 72.8 MB/s 2024-08-18T22:30:42.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015281 s, 68.6 MB/s 2024-08-18T22:30:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172837 s, 60.7 MB/s 2024-08-18T22:30:42.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173753 s, 60.3 MB/s 2024-08-18T22:30:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153231 s, 68.4 MB/s 2024-08-18T22:30:42.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143302 s, 73.2 MB/s 2024-08-18T22:30:42.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148425 s, 70.6 MB/s 2024-08-18T22:30:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184033 s, 57.0 MB/s 2024-08-18T22:30:42.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.606 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.606 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159757 s, 65.6 MB/s 2024-08-18T22:30:42.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194565 s, 53.9 MB/s 2024-08-18T22:30:42.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180819 s, 58.0 MB/s 2024-08-18T22:30:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235769 s, 44.5 MB/s 2024-08-18T22:30:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.695 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177606 s, 59.0 MB/s 2024-08-18T22:30:42.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.715 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173602 s, 60.4 MB/s 2024-08-18T22:30:42.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.734 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164636 s, 63.7 MB/s 2024-08-18T22:30:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221185 s, 47.4 MB/s 2024-08-18T22:30:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152972 s, 68.5 MB/s 2024-08-18T22:30:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165546 s, 63.3 MB/s 2024-08-18T22:30:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.816 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172065 s, 60.9 MB/s 2024-08-18T22:30:42.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.835 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167811 s, 62.5 MB/s 2024-08-18T22:30:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150485 s, 69.7 MB/s 2024-08-18T22:30:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.870 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145875 s, 71.9 MB/s 2024-08-18T22:30:42.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.887 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146609 s, 71.5 MB/s 2024-08-18T22:30:42.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.906 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.907 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167465 s, 62.6 MB/s 2024-08-18T22:30:42.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.923 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144102 s, 72.8 MB/s 2024-08-18T22:30:42.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.947 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.947 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185057 s, 56.7 MB/s 2024-08-18T22:30:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170603 s, 61.5 MB/s 2024-08-18T22:30:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144476 s, 72.6 MB/s 2024-08-18T22:30:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157639 s, 66.5 MB/s 2024-08-18T22:30:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172619 s, 60.7 MB/s 2024-08-18T22:30:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168766 s, 62.1 MB/s 2024-08-18T22:30:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:43.047 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:43.047 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:43.047 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.21 2024-08-18T22:30:43.047 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:43.047 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:43.047 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:43.048 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:43.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.117 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146416 s, 71.6 MB/s 2024-08-18T22:30:43.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175097 s, 59.9 MB/s 2024-08-18T22:30:43.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.154 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143104 s, 73.3 MB/s 2024-08-18T22:30:43.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125506 s, 83.5 MB/s 2024-08-18T22:30:43.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.188 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170723 s, 61.4 MB/s 2024-08-18T22:30:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.206 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156312 s, 67.1 MB/s 2024-08-18T22:30:43.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.225 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157576 s, 66.5 MB/s 2024-08-18T22:30:43.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.242 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150489 s, 69.7 MB/s 2024-08-18T22:30:43.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.260 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146875 s, 71.4 MB/s 2024-08-18T22:30:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.277 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146352 s, 71.6 MB/s 2024-08-18T22:30:43.297 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.298 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.298 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182006 s, 57.6 MB/s 2024-08-18T22:30:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168342 s, 62.3 MB/s 2024-08-18T22:30:43.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.336 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.336 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165618 s, 63.3 MB/s 2024-08-18T22:30:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151356 s, 69.3 MB/s 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.371 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142905 s, 73.4 MB/s 2024-08-18T22:30:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143728 s, 73.0 MB/s 2024-08-18T22:30:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177566 s, 59.1 MB/s 2024-08-18T22:30:43.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165143 s, 63.5 MB/s 2024-08-18T22:30:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148814 s, 70.5 MB/s 2024-08-18T22:30:43.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169305 s, 61.9 MB/s 2024-08-18T22:30:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.483 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160717 s, 65.2 MB/s 2024-08-18T22:30:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.503 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179937 s, 58.3 MB/s 2024-08-18T22:30:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.521 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148533 s, 70.6 MB/s 2024-08-18T22:30:43.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.545 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210383 s, 49.8 MB/s 2024-08-18T22:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160392 s, 65.4 MB/s 2024-08-18T22:30:43.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224081 s, 46.8 MB/s 2024-08-18T22:30:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.607 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152321 s, 68.8 MB/s 2024-08-18T22:30:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151044 s, 69.4 MB/s 2024-08-18T22:30:43.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.652 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.652 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024429 s, 42.9 MB/s 2024-08-18T22:30:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021778 s, 48.1 MB/s 2024-08-18T22:30:43.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178808 s, 58.6 MB/s 2024-08-18T22:30:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.714 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151583 s, 69.2 MB/s 2024-08-18T22:30:43.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:43.721 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:43.722 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:43.722 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.22 2024-08-18T22:30:43.722 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:43.722 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:43.722 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:43.722 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:43.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017408 s, 60.2 MB/s 2024-08-18T22:30:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148107 s, 70.8 MB/s 2024-08-18T22:30:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160551 s, 65.3 MB/s 2024-08-18T22:30:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155381 s, 67.5 MB/s 2024-08-18T22:30:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143704 s, 73.0 MB/s 2024-08-18T22:30:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.882 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144946 s, 72.3 MB/s 2024-08-18T22:30:43.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.900 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155449 s, 67.5 MB/s 2024-08-18T22:30:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202611 s, 51.8 MB/s 2024-08-18T22:30:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156876 s, 66.8 MB/s 2024-08-18T22:30:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.960 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145572 s, 72.0 MB/s 2024-08-18T22:30:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.980 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165018 s, 63.5 MB/s 2024-08-18T22:30:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:43.997 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143795 s, 72.9 MB/s 2024-08-18T22:30:44.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184699 s, 56.8 MB/s 2024-08-18T22:30:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145117 s, 72.3 MB/s 2024-08-18T22:30:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.054 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143594 s, 73.0 MB/s 2024-08-18T22:30:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131109 s, 80.0 MB/s 2024-08-18T22:30:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.090 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167015 s, 62.8 MB/s 2024-08-18T22:30:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172622 s, 60.7 MB/s 2024-08-18T22:30:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147165 s, 71.3 MB/s 2024-08-18T22:30:44.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173193 s, 60.5 MB/s 2024-08-18T22:30:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.168 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167359 s, 62.7 MB/s 2024-08-18T22:30:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.185 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147887 s, 70.9 MB/s 2024-08-18T22:30:44.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.203 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147611 s, 71.0 MB/s 2024-08-18T22:30:44.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.227 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208583 s, 50.3 MB/s 2024-08-18T22:30:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.248 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177371 s, 59.1 MB/s 2024-08-18T22:30:44.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.267 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163367 s, 64.2 MB/s 2024-08-18T22:30:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.285 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150051 s, 69.9 MB/s 2024-08-18T22:30:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.300 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120694 s, 86.9 MB/s 2024-08-18T22:30:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.321 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173854 s, 60.3 MB/s 2024-08-18T22:30:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149596 s, 70.1 MB/s 2024-08-18T22:30:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179944 s, 58.3 MB/s 2024-08-18T22:30:44.379 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149653 s, 70.1 MB/s 2024-08-18T22:30:44.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:44.385 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:44.385 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:44.385 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.23 2024-08-18T22:30:44.385 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:44.385 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:44.385 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:44.385 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:44.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:44.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.455 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145843 s, 71.9 MB/s 2024-08-18T22:30:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.473 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152284 s, 68.9 MB/s 2024-08-18T22:30:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.491 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146088 s, 71.8 MB/s 2024-08-18T22:30:44.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.511 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.511 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170109 s, 61.6 MB/s 2024-08-18T22:30:44.529 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160539 s, 65.3 MB/s 2024-08-18T22:30:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144955 s, 72.3 MB/s 2024-08-18T22:30:44.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.568 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.569 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181497 s, 57.8 MB/s 2024-08-18T22:30:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168745 s, 62.1 MB/s 2024-08-18T22:30:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175403 s, 59.8 MB/s 2024-08-18T22:30:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157938 s, 66.4 MB/s 2024-08-18T22:30:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181286 s, 57.8 MB/s 2024-08-18T22:30:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147092 s, 71.3 MB/s 2024-08-18T22:30:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191515 s, 54.8 MB/s 2024-08-18T22:30:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217593 s, 48.2 MB/s 2024-08-18T22:30:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015479 s, 67.7 MB/s 2024-08-18T22:30:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215645 s, 48.6 MB/s 2024-08-18T22:30:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151393 s, 69.3 MB/s 2024-08-18T22:30:44.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.793 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181872 s, 57.7 MB/s 2024-08-18T22:30:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150628 s, 69.6 MB/s 2024-08-18T22:30:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175173 s, 59.9 MB/s 2024-08-18T22:30:44.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.851 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172959 s, 60.6 MB/s 2024-08-18T22:30:44.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.868 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146412 s, 71.6 MB/s 2024-08-18T22:30:44.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.885 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.885 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146991 s, 71.3 MB/s 2024-08-18T22:30:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154362 s, 67.9 MB/s 2024-08-18T22:30:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145066 s, 72.3 MB/s 2024-08-18T22:30:44.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.938 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148335 s, 70.7 MB/s 2024-08-18T22:30:44.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211069 s, 49.7 MB/s 2024-08-18T22:30:44.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.978 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139949 s, 74.9 MB/s 2024-08-18T22:30:44.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:44.995 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:44.996 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146926 s, 71.4 MB/s 2024-08-18T22:30:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183624 s, 57.1 MB/s 2024-08-18T22:30:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210567 s, 49.8 MB/s 2024-08-18T22:30:45.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176538 s, 59.4 MB/s 2024-08-18T22:30:45.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:45.067 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:45.067 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:45.068 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.24 2024-08-18T22:30:45.068 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:45.068 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:45.068 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:45.068 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:45.141 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192076 s, 54.6 MB/s 2024-08-18T22:30:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189154 s, 55.4 MB/s 2024-08-18T22:30:45.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213938 s, 49.0 MB/s 2024-08-18T22:30:45.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181264 s, 57.8 MB/s 2024-08-18T22:30:45.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.225 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.225 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143226 s, 73.2 MB/s 2024-08-18T22:30:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.243 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158735 s, 66.1 MB/s 2024-08-18T22:30:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.261 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.262 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155543 s, 67.4 MB/s 2024-08-18T22:30:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145586 s, 72.0 MB/s 2024-08-18T22:30:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177462 s, 59.1 MB/s 2024-08-18T22:30:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171831 s, 61.0 MB/s 2024-08-18T22:30:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195667 s, 53.6 MB/s 2024-08-18T22:30:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164892 s, 63.6 MB/s 2024-08-18T22:30:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175689 s, 59.7 MB/s 2024-08-18T22:30:45.399 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.400 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169386 s, 61.9 MB/s 2024-08-18T22:30:45.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147839 s, 70.9 MB/s 2024-08-18T22:30:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.434 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146446 s, 71.6 MB/s 2024-08-18T22:30:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.451 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141747 s, 74.0 MB/s 2024-08-18T22:30:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173814 s, 60.3 MB/s 2024-08-18T22:30:45.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144179 s, 72.7 MB/s 2024-08-18T22:30:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201826 s, 52.0 MB/s 2024-08-18T22:30:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017556 s, 59.7 MB/s 2024-08-18T22:30:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.551 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150421 s, 69.7 MB/s 2024-08-18T22:30:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174756 s, 60.0 MB/s 2024-08-18T22:30:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152498 s, 68.8 MB/s 2024-08-18T22:30:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153639 s, 68.2 MB/s 2024-08-18T22:30:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016848 s, 62.2 MB/s 2024-08-18T22:30:45.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.647 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015588 s, 67.3 MB/s 2024-08-18T22:30:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154988 s, 67.7 MB/s 2024-08-18T22:30:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161331 s, 65.0 MB/s 2024-08-18T22:30:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018446 s, 56.8 MB/s 2024-08-18T22:30:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134134 s, 78.2 MB/s 2024-08-18T22:30:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192707 s, 54.4 MB/s 2024-08-18T22:30:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:45.753 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:45.754 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:45.754 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.25 2024-08-18T22:30:45.754 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:45.754 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:45.754 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:45.754 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:45.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.828 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174091 s, 60.2 MB/s 2024-08-18T22:30:45.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.846 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.846 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158389 s, 66.2 MB/s 2024-08-18T22:30:45.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213073 s, 49.2 MB/s 2024-08-18T22:30:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.891 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178973 s, 58.6 MB/s 2024-08-18T22:30:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.910 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152656 s, 68.7 MB/s 2024-08-18T22:30:45.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176514 s, 59.4 MB/s 2024-08-18T22:30:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170808 s, 61.4 MB/s 2024-08-18T22:30:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169711 s, 61.8 MB/s 2024-08-18T22:30:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:45.999 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259131 s, 40.5 MB/s 2024-08-18T22:30:46.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206747 s, 50.7 MB/s 2024-08-18T22:30:46.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.043 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.043 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171643 s, 61.1 MB/s 2024-08-18T22:30:46.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.061 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153565 s, 68.3 MB/s 2024-08-18T22:30:46.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212625 s, 49.3 MB/s 2024-08-18T22:30:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155603 s, 67.4 MB/s 2024-08-18T22:30:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153399 s, 68.4 MB/s 2024-08-18T22:30:46.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.140 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.140 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150414 s, 69.7 MB/s 2024-08-18T22:30:46.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.162 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179962 s, 58.3 MB/s 2024-08-18T22:30:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177918 s, 58.9 MB/s 2024-08-18T22:30:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142362 s, 73.7 MB/s 2024-08-18T22:30:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169678 s, 61.8 MB/s 2024-08-18T22:30:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.244 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215748 s, 48.6 MB/s 2024-08-18T22:30:46.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.265 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170642 s, 61.4 MB/s 2024-08-18T22:30:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148955 s, 70.4 MB/s 2024-08-18T22:30:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.306 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207998 s, 50.4 MB/s 2024-08-18T22:30:46.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150082 s, 69.9 MB/s 2024-08-18T22:30:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178332 s, 58.8 MB/s 2024-08-18T22:30:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146564 s, 71.5 MB/s 2024-08-18T22:30:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211289 s, 49.6 MB/s 2024-08-18T22:30:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014836 s, 70.7 MB/s 2024-08-18T22:30:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016213 s, 64.7 MB/s 2024-08-18T22:30:46.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.444 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.444 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173997 s, 60.3 MB/s 2024-08-18T22:30:46.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.461 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143059 s, 73.3 MB/s 2024-08-18T22:30:46.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:46.469 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:46.470 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:46.470 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.26 2024-08-18T22:30:46.470 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:46.470 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:46.470 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:46.470 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:46.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167344 s, 62.7 MB/s 2024-08-18T22:30:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018254 s, 57.4 MB/s 2024-08-18T22:30:46.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.582 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.582 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160482 s, 65.3 MB/s 2024-08-18T22:30:46.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.601 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162712 s, 64.4 MB/s 2024-08-18T22:30:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.619 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146433 s, 71.6 MB/s 2024-08-18T22:30:46.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167506 s, 62.6 MB/s 2024-08-18T22:30:46.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.660 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180091 s, 58.2 MB/s 2024-08-18T22:30:46.678 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161334 s, 65.0 MB/s 2024-08-18T22:30:46.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147788 s, 71.0 MB/s 2024-08-18T22:30:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016015 s, 65.5 MB/s 2024-08-18T22:30:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.733 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153683 s, 68.2 MB/s 2024-08-18T22:30:46.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.752 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.752 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164993 s, 63.6 MB/s 2024-08-18T22:30:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151285 s, 69.3 MB/s 2024-08-18T22:30:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153101 s, 68.5 MB/s 2024-08-18T22:30:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017459 s, 60.1 MB/s 2024-08-18T22:30:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147358 s, 71.2 MB/s 2024-08-18T22:30:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168764 s, 62.1 MB/s 2024-08-18T22:30:46.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.869 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.869 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223153 s, 47.0 MB/s 2024-08-18T22:30:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145514 s, 72.1 MB/s 2024-08-18T22:30:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228211 s, 45.9 MB/s 2024-08-18T22:30:46.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.929 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152635 s, 68.7 MB/s 2024-08-18T22:30:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145525 s, 72.1 MB/s 2024-08-18T22:30:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.966 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172167 s, 60.9 MB/s 2024-08-18T22:30:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145102 s, 72.3 MB/s 2024-08-18T22:30:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146636 s, 71.5 MB/s 2024-08-18T22:30:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201589 s, 52.0 MB/s 2024-08-18T22:30:47.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151832 s, 69.1 MB/s 2024-08-18T22:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145654 s, 72.0 MB/s 2024-08-18T22:30:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.083 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021749 s, 48.2 MB/s 2024-08-18T22:30:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.102 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.103 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173958 s, 60.3 MB/s 2024-08-18T22:30:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233401 s, 44.9 MB/s 2024-08-18T22:30:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.146 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152631 s, 68.7 MB/s 2024-08-18T22:30:47.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:47.154 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:47.154 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:47.154 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.27 2024-08-18T22:30:47.154 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:47.154 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:47.154 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:47.154 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:47.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.231 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229092 s, 45.8 MB/s 2024-08-18T22:30:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.248 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01441 s, 72.8 MB/s 2024-08-18T22:30:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148446 s, 70.6 MB/s 2024-08-18T22:30:47.292 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.293 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241619 s, 43.4 MB/s 2024-08-18T22:30:47.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152525 s, 68.7 MB/s 2024-08-18T22:30:47.334 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.334 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.334 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210869 s, 49.7 MB/s 2024-08-18T22:30:47.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116397 s, 90.1 MB/s 2024-08-18T22:30:47.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171635 s, 61.1 MB/s 2024-08-18T22:30:47.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.387 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166946 s, 62.8 MB/s 2024-08-18T22:30:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152129 s, 68.9 MB/s 2024-08-18T22:30:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.419 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116393 s, 90.1 MB/s 2024-08-18T22:30:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.437 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145651 s, 72.0 MB/s 2024-08-18T22:30:47.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170883 s, 61.4 MB/s 2024-08-18T22:30:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149988 s, 69.9 MB/s 2024-08-18T22:30:47.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.497 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208765 s, 50.2 MB/s 2024-08-18T22:30:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171322 s, 61.2 MB/s 2024-08-18T22:30:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145023 s, 72.3 MB/s 2024-08-18T22:30:47.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.553 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156567 s, 67.0 MB/s 2024-08-18T22:30:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196598 s, 53.3 MB/s 2024-08-18T22:30:47.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155777 s, 67.3 MB/s 2024-08-18T22:30:47.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142041 s, 73.8 MB/s 2024-08-18T22:30:47.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172839 s, 60.7 MB/s 2024-08-18T22:30:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.649 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015423 s, 68.0 MB/s 2024-08-18T22:30:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.669 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174128 s, 60.2 MB/s 2024-08-18T22:30:47.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.692 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209331 s, 50.1 MB/s 2024-08-18T22:30:47.712 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.713 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179077 s, 58.6 MB/s 2024-08-18T22:30:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145671 s, 72.0 MB/s 2024-08-18T22:30:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.748 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154678 s, 67.8 MB/s 2024-08-18T22:30:47.766 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.766 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.766 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153578 s, 68.3 MB/s 2024-08-18T22:30:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145205 s, 72.2 MB/s 2024-08-18T22:30:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166304 s, 63.1 MB/s 2024-08-18T22:30:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159662 s, 65.7 MB/s 2024-08-18T22:30:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:47.828 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:47.828 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:47.828 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.28 2024-08-18T22:30:47.828 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:47.829 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:47.829 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:47.829 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:47.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.946 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187204 s, 56.0 MB/s 2024-08-18T22:30:47.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.966 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174494 s, 60.1 MB/s 2024-08-18T22:30:47.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:47.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:47.986 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017487 s, 60.0 MB/s 2024-08-18T22:30:48.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.004 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148658 s, 70.5 MB/s 2024-08-18T22:30:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152918 s, 68.6 MB/s 2024-08-18T22:30:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.041 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169598 s, 61.8 MB/s 2024-08-18T22:30:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.061 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.061 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169865 s, 61.7 MB/s 2024-08-18T22:30:48.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.080 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.080 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170633 s, 61.5 MB/s 2024-08-18T22:30:48.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179437 s, 58.4 MB/s 2024-08-18T22:30:48.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.120 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171606 s, 61.1 MB/s 2024-08-18T22:30:48.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.143 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197848 s, 53.0 MB/s 2024-08-18T22:30:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165367 s, 63.4 MB/s 2024-08-18T22:30:48.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.179 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144695 s, 72.5 MB/s 2024-08-18T22:30:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.196 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146802 s, 71.4 MB/s 2024-08-18T22:30:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.214 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146624 s, 71.5 MB/s 2024-08-18T22:30:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190677 s, 55.0 MB/s 2024-08-18T22:30:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.253 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147184 s, 71.2 MB/s 2024-08-18T22:30:48.273 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.274 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.274 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183754 s, 57.1 MB/s 2024-08-18T22:30:48.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150339 s, 69.7 MB/s 2024-08-18T22:30:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171585 s, 61.1 MB/s 2024-08-18T22:30:48.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169866 s, 61.7 MB/s 2024-08-18T22:30:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143707 s, 73.0 MB/s 2024-08-18T22:30:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.366 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153581 s, 68.3 MB/s 2024-08-18T22:30:48.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.387 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188516 s, 55.6 MB/s 2024-08-18T22:30:48.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149708 s, 70.0 MB/s 2024-08-18T22:30:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.423 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156203 s, 67.1 MB/s 2024-08-18T22:30:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169479 s, 61.9 MB/s 2024-08-18T22:30:48.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014815 s, 70.8 MB/s 2024-08-18T22:30:48.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.478 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147148 s, 71.3 MB/s 2024-08-18T22:30:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150664 s, 69.6 MB/s 2024-08-18T22:30:48.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.515 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.515 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167715 s, 62.5 MB/s 2024-08-18T22:30:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149158 s, 70.3 MB/s 2024-08-18T22:30:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:48.540 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:48.540 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:48.540 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.29 2024-08-18T22:30:48.540 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:48.540 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:48.540 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:48.540 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:48.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194459 s, 53.9 MB/s 2024-08-18T22:30:48.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184847 s, 56.7 MB/s 2024-08-18T22:30:48.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180314 s, 58.2 MB/s 2024-08-18T22:30:48.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151742 s, 69.1 MB/s 2024-08-18T22:30:48.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159171 s, 65.9 MB/s 2024-08-18T22:30:48.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.755 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151167 s, 69.4 MB/s 2024-08-18T22:30:48.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146291 s, 71.7 MB/s 2024-08-18T22:30:48.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157277 s, 66.7 MB/s 2024-08-18T22:30:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246037 s, 42.6 MB/s 2024-08-18T22:30:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.838 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171137 s, 61.3 MB/s 2024-08-18T22:30:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172509 s, 60.8 MB/s 2024-08-18T22:30:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159799 s, 65.6 MB/s 2024-08-18T22:30:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.901 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220703 s, 47.5 MB/s 2024-08-18T22:30:48.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162617 s, 64.5 MB/s 2024-08-18T22:30:48.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.939 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.939 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171854 s, 61.0 MB/s 2024-08-18T22:30:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151553 s, 69.2 MB/s 2024-08-18T22:30:48.974 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149174 s, 70.3 MB/s 2024-08-18T22:30:48.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:48.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:48.990 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130316 s, 80.5 MB/s 2024-08-18T22:30:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172937 s, 60.6 MB/s 2024-08-18T22:30:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152244 s, 68.9 MB/s 2024-08-18T22:30:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.045 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146784 s, 71.4 MB/s 2024-08-18T22:30:49.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.062 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.062 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143 s, 73.3 MB/s 2024-08-18T22:30:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147041 s, 71.3 MB/s 2024-08-18T22:30:49.097 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.098 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156468 s, 67.0 MB/s 2024-08-18T22:30:49.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173432 s, 60.5 MB/s 2024-08-18T22:30:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149627 s, 70.1 MB/s 2024-08-18T22:30:49.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144884 s, 72.4 MB/s 2024-08-18T22:30:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194405 s, 53.9 MB/s 2024-08-18T22:30:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.192 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150804 s, 69.5 MB/s 2024-08-18T22:30:49.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.209 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143971 s, 72.8 MB/s 2024-08-18T22:30:49.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.228 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157617 s, 66.5 MB/s 2024-08-18T22:30:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145927 s, 71.9 MB/s 2024-08-18T22:30:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:49.252 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:49.252 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:49.252 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.30 2024-08-18T22:30:49.252 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:49.252 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:49.253 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:49.253 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:49.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.323 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163186 s, 64.3 MB/s 2024-08-18T22:30:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152377 s, 68.8 MB/s 2024-08-18T22:30:49.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.358 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014968 s, 70.1 MB/s 2024-08-18T22:30:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167401 s, 62.6 MB/s 2024-08-18T22:30:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.395 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149625 s, 70.1 MB/s 2024-08-18T22:30:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121382 s, 86.4 MB/s 2024-08-18T22:30:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.433 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201934 s, 51.9 MB/s 2024-08-18T22:30:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118279 s, 88.7 MB/s 2024-08-18T22:30:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153752 s, 68.2 MB/s 2024-08-18T22:30:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.491 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227667 s, 46.1 MB/s 2024-08-18T22:30:49.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161609 s, 64.9 MB/s 2024-08-18T22:30:49.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241877 s, 43.4 MB/s 2024-08-18T22:30:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160435 s, 65.4 MB/s 2024-08-18T22:30:49.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.573 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159134 s, 65.9 MB/s 2024-08-18T22:30:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199344 s, 52.6 MB/s 2024-08-18T22:30:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157894 s, 66.4 MB/s 2024-08-18T22:30:49.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.637 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.637 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194651 s, 53.9 MB/s 2024-08-18T22:30:49.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.654 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014649 s, 71.6 MB/s 2024-08-18T22:30:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.673 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168755 s, 62.1 MB/s 2024-08-18T22:30:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220671 s, 47.5 MB/s 2024-08-18T22:30:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.721 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207123 s, 50.6 MB/s 2024-08-18T22:30:49.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169885 s, 61.7 MB/s 2024-08-18T22:30:49.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.765 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214247 s, 48.9 MB/s 2024-08-18T22:30:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256044 s, 41.0 MB/s 2024-08-18T22:30:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157654 s, 66.5 MB/s 2024-08-18T22:30:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256917 s, 40.8 MB/s 2024-08-18T22:30:49.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158703 s, 66.1 MB/s 2024-08-18T22:30:49.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148997 s, 70.4 MB/s 2024-08-18T22:30:49.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169497 s, 61.9 MB/s 2024-08-18T22:30:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189982 s, 55.2 MB/s 2024-08-18T22:30:49.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.936 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.937 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172043 s, 60.9 MB/s 2024-08-18T22:30:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153993 s, 68.1 MB/s 2024-08-18T22:30:49.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:49.962 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:30:49.962 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:30:49.962 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.31 2024-08-18T22:30:49.962 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:30:49.962 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:30:49.962 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:30:49.962 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:30:50.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:30:50.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.034 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016847 s, 62.2 MB/s 2024-08-18T22:30:50.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.052 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.052 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148437 s, 70.6 MB/s 2024-08-18T22:30:50.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.072 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166729 s, 62.9 MB/s 2024-08-18T22:30:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149269 s, 70.2 MB/s 2024-08-18T22:30:50.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.108 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144056 s, 72.8 MB/s 2024-08-18T22:30:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144309 s, 72.7 MB/s 2024-08-18T22:30:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.143 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154839 s, 67.7 MB/s 2024-08-18T22:30:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171913 s, 61.0 MB/s 2024-08-18T22:30:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151238 s, 69.3 MB/s 2024-08-18T22:30:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.198 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151518 s, 69.2 MB/s 2024-08-18T22:30:50.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.219 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176013 s, 59.6 MB/s 2024-08-18T22:30:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189905 s, 55.2 MB/s 2024-08-18T22:30:50.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.258 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153021 s, 68.5 MB/s 2024-08-18T22:30:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.276 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153303 s, 68.4 MB/s 2024-08-18T22:30:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020004 s, 52.4 MB/s 2024-08-18T22:30:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169073 s, 62.0 MB/s 2024-08-18T22:30:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.335 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147949 s, 70.9 MB/s 2024-08-18T22:30:50.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178267 s, 58.8 MB/s 2024-08-18T22:30:50.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150883 s, 69.5 MB/s 2024-08-18T22:30:50.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.390 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147118 s, 71.3 MB/s 2024-08-18T22:30:50.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174027 s, 60.3 MB/s 2024-08-18T22:30:50.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.430 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165816 s, 63.2 MB/s 2024-08-18T22:30:50.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.450 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.450 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174893 s, 60.0 MB/s 2024-08-18T22:30:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015197 s, 69.0 MB/s 2024-08-18T22:30:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170504 s, 61.5 MB/s 2024-08-18T22:30:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165175 s, 63.5 MB/s 2024-08-18T22:30:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.528 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195437 s, 53.7 MB/s 2024-08-18T22:30:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160425 s, 65.4 MB/s 2024-08-18T22:30:50.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.569 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193499 s, 54.2 MB/s 2024-08-18T22:30:50.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.589 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.589 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174366 s, 60.1 MB/s 2024-08-18T22:30:50.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175217 s, 59.8 MB/s 2024-08-18T22:30:50.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:30:50.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:30:50.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173124 s, 60.6 MB/s 2024-08-18T22:30:50.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:30:50.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:50.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub start /scrub_control_test_path recursive 2024-08-18T22:30:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.788+0000 7ff325e00640 1 Processor -- start 2024-08-18T22:30:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.788+0000 7ff325e00640 1 -- start start 2024-08-18T22:30:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff325e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff320071b80 0x7ff32015f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff325e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff32015d0f0 0x7ff32015ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff325e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff32015c370 con 0x7ff320156530 2024-08-18T22:30:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff325e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff3200d1890 con 0x7ff32015d0f0 2024-08-18T22:30:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff325e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff320160450 con 0x7ff320071b80 2024-08-18T22:30:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff324a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff320156530 0x7ff320071470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33514/0 (socket says 172.21.15.5:33514) 2024-08-18T22:30:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff324a00640 1 -- 172.21.15.5:0/2709325092 learned_addr learned my addr 172.21.15.5:0/2709325092 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff325400640 1 --2- 172.21.15.5:0/2709325092 >> v2:172.21.15.5:3300/0 conn(0x7ff32015d0f0 0x7ff32015ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff31fe00640 1 --2- 172.21.15.5:0/2709325092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff320071b80 0x7ff32015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff325400640 1 -- 172.21.15.5:0/2709325092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff320071b80 msgr2=0x7ff32015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff325400640 1 --2- 172.21.15.5:0/2709325092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff320071b80 0x7ff32015f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff325400640 1 -- 172.21.15.5:0/2709325092 >> v1:172.21.15.5:6789/0 conn(0x7ff320156530 legacy=0x7ff320071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff325400640 1 -- 172.21.15.5:0/2709325092 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff320160700 con 0x7ff32015d0f0 2024-08-18T22:30:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.792+0000 7ff31f400640 1 -- 172.21.15.5:0/2709325092 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112402387 0 0) 0x7ff32015c370 con 0x7ff320156530 2024-08-18T22:30:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325400640 1 --2- 172.21.15.5:0/2709325092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32015d0f0 0x7ff32015ff10 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7ff318009d90 tx=0x7ff31801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd76d7b094d5dd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff31f400640 1 -- 172.21.15.5:0/2709325092 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180b2070 con 0x7ff32015d0f0 2024-08-18T22:30:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff31f400640 1 -- 172.21.15.5:0/2709325092 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180a5a30 con 0x7ff32015d0f0 2024-08-18T22:30:50.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff31f400640 1 -- 172.21.15.5:0/2709325092 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180a5e00 con 0x7ff32015d0f0 2024-08-18T22:30:50.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 -- 172.21.15.5:0/2709325092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32015d0f0 msgr2=0x7ff32015ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:50.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 --2- 172.21.15.5:0/2709325092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32015d0f0 0x7ff32015ff10 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7ff318009d90 tx=0x7ff31801c970 comp rx=0 tx=0).stop 2024-08-18T22:30:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 -- 172.21.15.5:0/2709325092 shutdown_connections 2024-08-18T22:30:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 --2- 172.21.15.5:0/2709325092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32015d0f0 0x7ff32015ff10 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 --2- 172.21.15.5:0/2709325092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff320071b80 0x7ff32015f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 -- 172.21.15.5:0/2709325092 >> 172.21.15.5:0/2709325092 conn(0x7ff3200b3da0 msgr2=0x7ff3200b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 -- 172.21.15.5:0/2709325092 shutdown_connections 2024-08-18T22:30:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 -- 172.21.15.5:0/2709325092 wait complete. 2024-08-18T22:30:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 Processor -- start 2024-08-18T22:30:50.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 -- start start 2024-08-18T22:30:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff320071b80 0x7ff3200b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff320156530 0x7ff32006dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32015d0f0 0x7ff32013e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3200d1210 con 0x7ff32015d0f0 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff3200d1090 con 0x7ff320071b80 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.796+0000 7ff325e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff3200d1390 con 0x7ff320156530 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff325400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32015d0f0 0x7ff32013e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff325400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32015d0f0 0x7ff32013e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42740/0 (socket says 172.21.15.5:42740) 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff325400640 1 -- 172.21.15.5:0/9629699 learned_addr learned my addr 172.21.15.5:0/9629699 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff324a00640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff320071b80 0x7ff3200b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff31fe00640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff320156530 0x7ff32006dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff325400640 1 -- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff320156530 msgr2=0x7ff32006dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff325400640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff320156530 0x7ff32006dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff325400640 1 -- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff320071b80 msgr2=0x7ff3200b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff325400640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff320071b80 0x7ff3200b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff325400640 1 -- 172.21.15.5:0/9629699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3201f6660 con 0x7ff32015d0f0 2024-08-18T22:30:50.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff325400640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32015d0f0 0x7ff32013e5e0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff3180b0040 tx=0x7ff318019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:50.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff31cc00640 1 -- 172.21.15.5:0/9629699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180b2050 con 0x7ff32015d0f0 2024-08-18T22:30:50.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff31cc00640 1 -- 172.21.15.5:0/9629699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180b3040 con 0x7ff32015d0f0 2024-08-18T22:30:50.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff325e00640 1 -- 172.21.15.5:0/9629699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3200b5fe0 con 0x7ff32015d0f0 2024-08-18T22:30:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff31cc00640 1 -- 172.21.15.5:0/9629699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180ad8f0 con 0x7ff32015d0f0 2024-08-18T22:30:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff325e00640 1 -- 172.21.15.5:0/9629699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3201f6bc0 con 0x7ff32015d0f0 2024-08-18T22:30:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff31cc00640 1 -- 172.21.15.5:0/9629699 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3180c0020 con 0x7ff32015d0f0 2024-08-18T22:30:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.800+0000 7ff31cc00640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3000678c0 0x7ff300069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff31cc00640 1 -- 172.21.15.5:0/9629699 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7ff318120570 con 0x7ff32015d0f0 2024-08-18T22:30:50.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff324a00640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3000678c0 0x7ff300069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 Processor -- start 2024-08-18T22:30:50.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 -- start start 2024-08-18T22:30:50.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff324a00640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3000678c0 0x7ff300069d80 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff310007fd0 tx=0x7ff310007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b19c8000 0x5572b19c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b197eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5572b17cc340 con 0x5572b197f0b0 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5572b1786ba0 con 0x5572b19c8000 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5572b17c8300 con 0x5572b19c8920 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff325400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff325400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42748/0 (socket says 172.21.15.5:42748) 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff325400640 1 -- 172.21.15.5:0/547304758 learned_addr learned my addr 172.21.15.5:0/547304758 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff324a00640 1 --2- 172.21.15.5:0/547304758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b19c8000 0x5572b19c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff31fe00640 1 --2- 172.21.15.5:0/547304758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b197eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff325400640 1 -- 172.21.15.5:0/547304758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 msgr2=0x5572b197eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff325400640 1 --2- 172.21.15.5:0/547304758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b197eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff325400640 1 -- 172.21.15.5:0/547304758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b19c8000 msgr2=0x5572b19c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff325400640 1 --2- 172.21.15.5:0/547304758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b19c8000 0x5572b19c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff325400640 1 -- 172.21.15.5:0/547304758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b1878a30 con 0x5572b197f0b0 2024-08-18T22:30:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff325400640 1 --2- 172.21.15.5:0/547304758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197f490 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff3180f07d0 tx=0x7ff318009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bc38981160d707 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff315600640 1 -- 172.21.15.5:0/547304758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180f4b40 con 0x5572b197f0b0 2024-08-18T22:30:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff315600640 1 -- 172.21.15.5:0/547304758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180f9370 con 0x5572b197f0b0 2024-08-18T22:30:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff315600640 1 -- 172.21.15.5:0/547304758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180eceb0 con 0x5572b197f0b0 2024-08-18T22:30:50.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 -- 172.21.15.5:0/547304758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 msgr2=0x5572b197f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:50.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 --2- 172.21.15.5:0/547304758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197f490 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff3180f07d0 tx=0x7ff318009750 comp rx=0 tx=0).stop 2024-08-18T22:30:50.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 -- 172.21.15.5:0/547304758 shutdown_connections 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 --2- 172.21.15.5:0/547304758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197f490 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 --2- 172.21.15.5:0/547304758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b197eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 --2- 172.21.15.5:0/547304758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b19c8000 0x5572b19c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 -- 172.21.15.5:0/547304758 >> 172.21.15.5:0/547304758 conn(0x5572b197b030 msgr2=0x5572b197d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 -- 172.21.15.5:0/547304758 shutdown_connections 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.804+0000 7ff32a897000 1 -- 172.21.15.5:0/547304758 wait complete. 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 -- start start 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 Processor -- start 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b197f0b0 0x5572b19c7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 0x5572b198a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b198a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5572b17d0970 con 0x5572b19c8000 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5572b176dc00 con 0x5572b197f0b0 2024-08-18T22:30:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5572b1777f80 con 0x5572b19c8920 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 10 client.0 _ll_register_callbacks cb 0x5572b1969af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff31fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 0x5572b198a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff31fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 0x5572b198a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42758/0 (socket says 172.21.15.5:42758) 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff31fe00640 1 -- 172.21.15.5:0/540863874 learned_addr learned my addr 172.21.15.5:0/540863874 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff324a00640 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b197f0b0 0x5572b19c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff325400640 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b198a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff31fe00640 1 -- 172.21.15.5:0/540863874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 msgr2=0x5572b198a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff31fe00640 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b198a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff31fe00640 1 -- 172.21.15.5:0/540863874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b197f0b0 msgr2=0x5572b19c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff31fe00640 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b197f0b0 0x5572b19c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff31fe00640 1 -- 172.21.15.5:0/540863874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b18749e0 con 0x5572b19c8000 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff31fe00640 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 0x5572b198a010 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7ff30c014640 tx=0x7ff30c014b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcf85214f1d006a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff30a000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:30:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff30a000640 1 -- 172.21.15.5:0/540863874 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30c012810 con 0x5572b19c8000 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 -- 172.21.15.5:0/540863874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3180f9370 con 0x5572b19c8000 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff30a000640 1 -- 172.21.15.5:0/540863874 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7ff30c0129b0 con 0x5572b19c8000 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff30a000640 1 -- 172.21.15.5:0/540863874 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7ff30c028050 con 0x5572b19c8000 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 10 client.9681 fetch_fsmap learned FSMap version 125 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 -- 172.21.15.5:0/540863874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x5572b17a6520 con 0x5572b19c8000 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff30a000640 1 -- 172.21.15.5:0/540863874 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180f9370 con 0x5572b19c8000 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff30a000640 1 -- 172.21.15.5:0/540863874 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7ff30c02b020 con 0x5572b19c8000 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 10 client.9681 fetch_fsmap finished waiting for FSMap version 125 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 10 client.9681 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 20 client.9681 populate_metadata read hostname 'smithi005' 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5572b198b290 0x5572b19da2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 4 client.9681 mds_command: new command op to 9525 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff32a897000 1 -- 172.21.15.5:0/540863874 --> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572b1864e30 con 0x5572b198b290 2024-08-18T22:30:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.808+0000 7ff324a00640 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5572b198b290 0x5572b19da2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff324a00640 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5572b198b290 0x5572b19da2c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcfe85c9e00ce009 server_cookie=4f8713529bf02585 in_seq=0 out_seq=0 2024-08-18T22:30:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff30a000640 10 client.9681 ms_handle_connect on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff30a000640 1 -- 172.21.15.5:0/540863874 <== mds.0 v2:172.21.15.5:6833/324683204 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572b1864e30 con 0x5572b198b290 2024-08-18T22:30:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff30a000640 10 client.9681 handle_command_reply: tid=0 2024-08-18T22:30:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 1 client.9681 shutdown 2024-08-18T22:30:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 1 -- 172.21.15.5:0/540863874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 msgr2=0x5572b198a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 0x5572b198a010 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7ff30c014640 tx=0x7ff30c014b00 comp rx=0 tx=0).stop 2024-08-18T22:30:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 1 -- 172.21.15.5:0/540863874 shutdown_connections 2024-08-18T22:30:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5572b198b290 0x5572b19da2c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b198a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff30a000640 0 client.9681 ms_handle_reset on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:50.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 0x5572b198a010 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 1 --2- 172.21.15.5:0/540863874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b197f0b0 0x5572b19c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 1 -- 172.21.15.5:0/540863874 >> 172.21.15.5:0/540863874 conn(0x5572b197b030 msgr2=0x5572b197dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:50.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 1 -- 172.21.15.5:0/540863874 shutdown_connections 2024-08-18T22:30:50.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 1 -- 172.21.15.5:0/540863874 wait complete. 2024-08-18T22:30:50.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.812+0000 7ff32a897000 20 client.9681 trim_cache size 0 max 16384 2024-08-18T22:30:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.828+0000 7ff32a897000 1 Processor -- start 2024-08-18T22:30:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.828+0000 7ff32a897000 1 -- start start 2024-08-18T22:30:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8000 0x5572b197e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b19c8920 0x5572b19dd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff320202650 con 0x5572b197f0b0 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff3201f8280 con 0x5572b19c8920 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff320202030 con 0x5572b19c8000 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff324a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff324a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42772/0 (socket says 172.21.15.5:42772) 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff324a00640 1 -- 172.21.15.5:0/2719172169 learned_addr learned my addr 172.21.15.5:0/2719172169 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff324a00640 1 -- 172.21.15.5:0/2719172169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8000 msgr2=0x5572b197e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff324a00640 1 --2- 172.21.15.5:0/2719172169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8000 0x5572b197e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff324a00640 1 -- 172.21.15.5:0/2719172169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b19c8920 msgr2=0x5572b19dd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff324a00640 1 --2- 172.21.15.5:0/2719172169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b19c8920 0x5572b19dd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff324a00640 1 -- 172.21.15.5:0/2719172169 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b18252f0 con 0x5572b197f0b0 2024-08-18T22:30:50.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff324a00640 1 --2- 172.21.15.5:0/2719172169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197e430 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7ff310000f70 tx=0x7ff310013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10d76b591a6fa5c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff314c00640 1 -- 172.21.15.5:0/2719172169 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31002e070 con 0x5572b197f0b0 2024-08-18T22:30:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff314c00640 1 -- 172.21.15.5:0/2719172169 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff310001d10 con 0x5572b197f0b0 2024-08-18T22:30:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff314c00640 1 -- 172.21.15.5:0/2719172169 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3100135f0 con 0x5572b197f0b0 2024-08-18T22:30:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- 172.21.15.5:0/2719172169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 msgr2=0x5572b197e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 --2- 172.21.15.5:0/2719172169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197e430 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7ff310000f70 tx=0x7ff310013000 comp rx=0 tx=0).stop 2024-08-18T22:30:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- 172.21.15.5:0/2719172169 shutdown_connections 2024-08-18T22:30:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 --2- 172.21.15.5:0/2719172169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b19c8920 0x5572b19dd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 --2- 172.21.15.5:0/2719172169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8000 0x5572b197e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 --2- 172.21.15.5:0/2719172169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b197f0b0 0x5572b197e430 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- 172.21.15.5:0/2719172169 >> 172.21.15.5:0/2719172169 conn(0x5572b197b030 msgr2=0x5572b19897e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:50.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- 172.21.15.5:0/2719172169 shutdown_connections 2024-08-18T22:30:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- 172.21.15.5:0/2719172169 wait complete. 2024-08-18T22:30:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- start start 2024-08-18T22:30:50.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 Processor -- start 2024-08-18T22:30:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b197f0b0 0x5572b19dcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 0x5572b19f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b19f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5572b1768340 con 0x5572b19c8000 2024-08-18T22:30:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5572b1796fb0 con 0x5572b197f0b0 2024-08-18T22:30:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5572b17518f0 con 0x5572b19c8920 2024-08-18T22:30:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff32a897000 10 client.0 _ll_register_callbacks cb 0x7ff30c009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:30:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff31fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 0x5572b19f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff324a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b197f0b0 0x5572b19dcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff31fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 0x5572b19f85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42776/0 (socket says 172.21.15.5:42776) 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff31fe00640 1 -- 172.21.15.5:0/2855257116 learned_addr learned my addr 172.21.15.5:0/2855257116 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.832+0000 7ff325400640 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b19f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff324a00640 1 -- 172.21.15.5:0/2855257116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 msgr2=0x5572b19f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff324a00640 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b19f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff324a00640 1 -- 172.21.15.5:0/2855257116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 msgr2=0x5572b19f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff324a00640 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 0x5572b19f85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff324a00640 1 -- 172.21.15.5:0/2855257116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b17689d0 con 0x5572b197f0b0 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff324a00640 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b197f0b0 0x5572b19dcc40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff310007830 tx=0x7ff310000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fac9daaec94496f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff30a000640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff30a000640 1 -- 172.21.15.5:0/2855257116 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310037060 con 0x5572b197f0b0 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff30a000640 1 -- 172.21.15.5:0/2855257116 <== mon.1 v2:172.21.15.117:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7ff310015110 con 0x5572b197f0b0 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff32a897000 1 -- 172.21.15.5:0/2855257116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff310001d10 con 0x5572b197f0b0 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff30a000640 1 -- 172.21.15.5:0/2855257116 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7ff31002e040 con 0x5572b197f0b0 2024-08-18T22:30:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff32a897000 10 client.8893 fetch_fsmap learned FSMap version 125 2024-08-18T22:30:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff32a897000 1 -- 172.21.15.5:0/2855257116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x5572b14871a0 con 0x5572b197f0b0 2024-08-18T22:30:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff30a000640 1 -- 172.21.15.5:0/2855257116 <== mon.1 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff310001d10 con 0x5572b197f0b0 2024-08-18T22:30:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff30a000640 1 -- 172.21.15.5:0/2855257116 <== mon.1 v2:172.21.15.117:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7ff310040080 con 0x5572b197f0b0 2024-08-18T22:30:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff32a897000 10 client.8893 fetch_fsmap finished waiting for FSMap version 125 2024-08-18T22:30:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff32a897000 10 client.8893 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-08-18T22:30:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff32a897000 20 client.8893 populate_metadata read hostname 'smithi005' 2024-08-18T22:30:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff32a897000 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5572b19f9030 0x5572b1a3be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff32a897000 4 client.8893 mds_command: new command op to 9525 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-08-18T22:30:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff32a897000 1 -- 172.21.15.5:0/2855257116 --> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5572b1766bd0 con 0x5572b19f9030 2024-08-18T22:30:50.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff31fe00640 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5572b19f9030 0x5572b1a3be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:50.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff31fe00640 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5572b19f9030 0x5572b1a3be00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ed1f45ad8bc9b2a server_cookie=40f45e6552f2416b in_seq=0 out_seq=0 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.836+0000 7ff30a000640 10 client.8893 ms_handle_connect on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff30a000640 1 -- 172.21.15.5:0/2855257116 <== mds.0 v2:172.21.15.5:6833/324683204 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5572b1766bd0 con 0x5572b19f9030 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff30a000640 10 client.8893 handle_command_reply: tid=0 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 1 client.8893 shutdown 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 1 -- 172.21.15.5:0/2855257116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b197f0b0 msgr2=0x5572b19dcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b197f0b0 0x5572b19dcc40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff310007830 tx=0x7ff310000ee0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 1 -- 172.21.15.5:0/2855257116 shutdown_connections 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5572b19f9030 0x5572b1a3be00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5572b19c8920 0x5572b19f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572b19c8000 0x5572b19f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff30a000640 0 client.8893 ms_handle_reset on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 1 --2- 172.21.15.5:0/2855257116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5572b197f0b0 0x5572b19dcc40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 1 -- 172.21.15.5:0/2855257116 >> 172.21.15.5:0/2855257116 conn(0x5572b197b030 msgr2=0x5572b197e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 1 -- 172.21.15.5:0/2855257116 shutdown_connections 2024-08-18T22:30:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 1 -- 172.21.15.5:0/2855257116 wait complete. 2024-08-18T22:30:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff32a897000 20 client.8893 trim_cache size 0 max 16384 2024-08-18T22:30:50.841 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:30:50.841 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:30:50.841 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "93c0c0c9-60f8-4039-be70-2b8966a84480", 2024-08-18T22:30:50.841 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:30:50.841 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:30:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 -- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3000678c0 msgr2=0x7ff300069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3000678c0 0x7ff300069d80 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff310007fd0 tx=0x7ff310007d60 comp rx=0 tx=0).stop 2024-08-18T22:30:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 -- 172.21.15.5:0/9629699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32015d0f0 msgr2=0x7ff32013e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32015d0f0 0x7ff32013e5e0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff3180b0040 tx=0x7ff318019710 comp rx=0 tx=0).stop 2024-08-18T22:30:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 -- 172.21.15.5:0/9629699 shutdown_connections 2024-08-18T22:30:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3000678c0 0x7ff300069d80 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32015d0f0 0x7ff32013e5e0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff320156530 0x7ff32006dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 --2- 172.21.15.5:0/9629699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff320071b80 0x7ff3200b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 -- 172.21.15.5:0/9629699 >> 172.21.15.5:0/9629699 conn(0x7ff3200b3da0 msgr2=0x7ff320152050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 -- 172.21.15.5:0/9629699 shutdown_connections 2024-08-18T22:30:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:50.840+0000 7ff325e00640 1 -- 172.21.15.5:0/9629699 wait complete. 2024-08-18T22:30:50.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:50.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub pause 2024-08-18T22:30:51.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff32dc00640 1 Processor -- start 2024-08-18T22:30:51.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff32dc00640 1 -- start start 2024-08-18T22:30:51.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff32dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815c180 0x7ff3280cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff32dc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff32815d4d0 0x7ff32806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff32dc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3280cfb00 con 0x7ff32815c560 2024-08-18T22:30:51.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff32dc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff32815d040 con 0x7ff32815d4d0 2024-08-18T22:30:51.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff32dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff32815c9f0 con 0x7ff32815c180 2024-08-18T22:30:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff327400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff32815d4d0 0x7ff32806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff326a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815c180 0x7ff3280cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff327400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff32815d4d0 0x7ff32806db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:48896/0 (socket says 172.21.15.5:48896) 2024-08-18T22:30:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff326a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815c180 0x7ff3280cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:41098/0 (socket says 172.21.15.5:41098) 2024-08-18T22:30:51.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff327400640 1 -- 172.21.15.5:0/3629138304 learned_addr learned my addr 172.21.15.5:0/3629138304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff326000640 1 -- 172.21.15.5:0/3629138304 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2515393663 0 0) 0x7ff3280cfb00 con 0x7ff32815c560 2024-08-18T22:30:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff326000640 1 -- 172.21.15.5:0/3629138304 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff30c003530 con 0x7ff32815c560 2024-08-18T22:30:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff326a00640 1 -- 172.21.15.5:0/3629138304 >> v2:172.21.15.117:3300/0 conn(0x7ff32815d4d0 msgr2=0x7ff32806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff326a00640 1 --2- 172.21.15.5:0/3629138304 >> v2:172.21.15.117:3300/0 conn(0x7ff32815d4d0 0x7ff32806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff326a00640 1 -- 172.21.15.5:0/3629138304 >> v1:172.21.15.117:6789/0 conn(0x7ff32815c560 legacy=0x7ff3280ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff326a00640 1 -- 172.21.15.5:0/3629138304 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32815ccd0 con 0x7ff32815c180 2024-08-18T22:30:51.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.052+0000 7ff327400640 1 --2- 172.21.15.5:0/3629138304 >> v2:172.21.15.117:3300/0 conn(0x7ff32815d4d0 0x7ff32806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:51.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff326a00640 1 --2- 172.21.15.5:0/3629138304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815c180 0x7ff3280cdf10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff3180097c0 tx=0x7ff31801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7fd385a230c181d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff326000640 1 -- 172.21.15.5:0/3629138304 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180ab430 con 0x7ff32815c180 2024-08-18T22:30:51.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff326000640 1 -- 172.21.15.5:0/3629138304 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180b0070 con 0x7ff32815c180 2024-08-18T22:30:51.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff326000640 1 -- 172.21.15.5:0/3629138304 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180ab7f0 con 0x7ff32815c180 2024-08-18T22:30:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff32dc00640 1 -- 172.21.15.5:0/3629138304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815c180 msgr2=0x7ff3280cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff32dc00640 1 --2- 172.21.15.5:0/3629138304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815c180 0x7ff3280cdf10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff3180097c0 tx=0x7ff31801c410 comp rx=0 tx=0).stop 2024-08-18T22:30:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff32dc00640 1 -- 172.21.15.5:0/3629138304 shutdown_connections 2024-08-18T22:30:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff32dc00640 1 --2- 172.21.15.5:0/3629138304 >> v2:172.21.15.117:3300/0 conn(0x7ff32815d4d0 0x7ff32806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff32dc00640 1 --2- 172.21.15.5:0/3629138304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815c180 0x7ff3280cdf10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff32dc00640 1 -- 172.21.15.5:0/3629138304 >> 172.21.15.5:0/3629138304 conn(0x7ff3280b1dc0 msgr2=0x7ff3280b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff32dc00640 1 -- 172.21.15.5:0/3629138304 shutdown_connections 2024-08-18T22:30:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff32dc00640 1 -- 172.21.15.5:0/3629138304 wait complete. 2024-08-18T22:30:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.056+0000 7ff32dc00640 1 Processor -- start 2024-08-18T22:30:51.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff32dc00640 1 -- start start 2024-08-18T22:30:51.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff32dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32815c180 0x7ff328165a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff32dc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815d4d0 0x7ff3280c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff32dc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3280ca390 0x7ff3280b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff32dc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3281692b0 con 0x7ff32815c180 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff32dc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff328169130 con 0x7ff3280ca390 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff32dc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff328169430 con 0x7ff32815d4d0 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff326a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32815c180 0x7ff328165a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff326a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32815c180 0x7ff328165a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42784/0 (socket says 172.21.15.5:42784) 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff326a00640 1 -- 172.21.15.5:0/466949881 learned_addr learned my addr 172.21.15.5:0/466949881 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff31fe00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815d4d0 0x7ff3280c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff327400640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3280ca390 0x7ff3280b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff326a00640 1 -- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815d4d0 msgr2=0x7ff3280c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff326a00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815d4d0 0x7ff3280c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff326a00640 1 -- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3280ca390 msgr2=0x7ff3280b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff326a00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3280ca390 0x7ff3280b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff326a00640 1 -- 172.21.15.5:0/466949881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff328068cd0 con 0x7ff32815c180 2024-08-18T22:30:51.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff326a00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32815c180 0x7ff328165a00 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7ff31801a040 tx=0x7ff3180191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff31ea00640 1 -- 172.21.15.5:0/466949881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180abe10 con 0x7ff32815c180 2024-08-18T22:30:51.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff31ea00640 1 -- 172.21.15.5:0/466949881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180bd070 con 0x7ff32815c180 2024-08-18T22:30:51.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff31ea00640 1 -- 172.21.15.5:0/466949881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180b4630 con 0x7ff32815c180 2024-08-18T22:30:51.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff32dc00640 1 -- 172.21.15.5:0/466949881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3280ca880 con 0x7ff32815c180 2024-08-18T22:30:51.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.060+0000 7ff32dc00640 1 -- 172.21.15.5:0/466949881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff328148210 con 0x7ff32815c180 2024-08-18T22:30:51.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31ea00640 1 -- 172.21.15.5:0/466949881 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3180b47d0 con 0x7ff32815c180 2024-08-18T22:30:51.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31ea00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3040678c0 0x7ff304069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31ea00640 1 -- 172.21.15.5:0/466949881 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7ff31811f920 con 0x7ff32815c180 2024-08-18T22:30:51.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31fe00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3040678c0 0x7ff304069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff331160000 1 Processor -- start 2024-08-18T22:30:51.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff331160000 1 -- start start 2024-08-18T22:30:51.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31fe00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3040678c0 0x7ff304069d80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff3281fac10 tx=0x7ff310009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff331160000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381ec2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff331160000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e75630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff331160000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381e75f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff331160000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d381cc6470 con 0x55d381ec2890 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff331160000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d381c80ad0 con 0x55d381ec1f70 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff331160000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d381cc2430 con 0x55d381e75b70 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e75630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff326a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381ec2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e75630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42790/0 (socket says 172.21.15.5:42790) 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31fe00640 1 -- 172.21.15.5:0/3480740568 learned_addr learned my addr 172.21.15.5:0/3480740568 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff327400640 1 --2- 172.21.15.5:0/3480740568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381e75f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31fe00640 1 -- 172.21.15.5:0/3480740568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 msgr2=0x55d381e75f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31fe00640 1 --2- 172.21.15.5:0/3480740568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381e75f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31fe00640 1 -- 172.21.15.5:0/3480740568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 msgr2=0x55d381ec2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31fe00640 1 --2- 172.21.15.5:0/3480740568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381ec2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31fe00640 1 -- 172.21.15.5:0/3480740568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d381c66a10 con 0x55d381ec2890 2024-08-18T22:30:51.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff326a00640 1 --2- 172.21.15.5:0/3480740568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381ec2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:51.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff327400640 1 --2- 172.21.15.5:0/3480740568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381e75f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:51.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff31fe00640 1 --2- 172.21.15.5:0/3480740568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e75630 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7ff31000fb70 tx=0x7ff310012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7129d3211d24f5c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff317400640 1 -- 172.21.15.5:0/3480740568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310025070 con 0x55d381ec2890 2024-08-18T22:30:51.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff317400640 1 -- 172.21.15.5:0/3480740568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff31001b050 con 0x55d381ec2890 2024-08-18T22:30:51.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.064+0000 7ff317400640 1 -- 172.21.15.5:0/3480740568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310014de0 con 0x55d381ec2890 2024-08-18T22:30:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 -- 172.21.15.5:0/3480740568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 msgr2=0x55d381e75630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 --2- 172.21.15.5:0/3480740568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e75630 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7ff31000fb70 tx=0x7ff310012000 comp rx=0 tx=0).stop 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 -- 172.21.15.5:0/3480740568 shutdown_connections 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 --2- 172.21.15.5:0/3480740568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381e75f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 --2- 172.21.15.5:0/3480740568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e75630 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 --2- 172.21.15.5:0/3480740568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381ec2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 -- 172.21.15.5:0/3480740568 >> 172.21.15.5:0/3480740568 conn(0x55d381e6f680 msgr2=0x55d381ea4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 -- 172.21.15.5:0/3480740568 shutdown_connections 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 -- 172.21.15.5:0/3480740568 wait complete. 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 -- start start 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 Processor -- start 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381e7c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381e7c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e7ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d381c91770 con 0x55d381ec2890 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d381c67c80 con 0x55d381ec1f70 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d381d47130 con 0x55d381e75b70 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 10 client.0 _ll_register_callbacks cb 0x55d381e630e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff327400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e7ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff326a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381e7c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff31fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381e7c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff326a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381e7c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:41116/0 (socket says 172.21.15.5:41116) 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff327400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e7ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42794/0 (socket says 172.21.15.5:42794) 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff326a00640 1 -- 172.21.15.5:0/2205214738 learned_addr learned my addr 172.21.15.5:0/2205214738 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff327400640 1 -- 172.21.15.5:0/2205214738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 msgr2=0x55d381e7c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff327400640 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381e7c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff327400640 1 -- 172.21.15.5:0/2205214738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 msgr2=0x55d381e7c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff327400640 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381e7c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff327400640 1 -- 172.21.15.5:0/2205214738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d381c7efe0 con 0x55d381ec2890 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff326a00640 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381e7c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff327400640 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e7ce70 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7ff3200072e0 tx=0x7ff320007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4aaa512ebcfa9f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff30be00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff30be00640 1 -- 172.21.15.5:0/2205214738 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32001c070 con 0x55d381ec2890 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff30be00640 1 -- 172.21.15.5:0/2205214738 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7ff320013b70 con 0x55d381ec2890 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.068+0000 7ff331160000 1 -- 172.21.15.5:0/2205214738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff31001b050 con 0x55d381ec2890 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff30be00640 1 -- 172.21.15.5:0/2205214738 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7ff320027050 con 0x55d381ec2890 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 10 client.9696 fetch_fsmap learned FSMap version 125 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 -- 172.21.15.5:0/2205214738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x55d381c92ed0 con 0x55d381ec2890 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff30be00640 1 -- 172.21.15.5:0/2205214738 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff31001b050 con 0x55d381ec2890 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff30be00640 1 -- 172.21.15.5:0/2205214738 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7ff32002a020 con 0x55d381ec2890 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 10 client.9696 fetch_fsmap finished waiting for FSMap version 125 2024-08-18T22:30:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 10 client.9696 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-08-18T22:30:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 20 client.9696 populate_metadata read hostname 'smithi005' 2024-08-18T22:30:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55d381e7d880 0x55d381ed4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 4 client.9696 mds_command: new command op to 9525 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:30:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 -- 172.21.15.5:0/2205214738 --> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d381c60d90 con 0x55d381e7d880 2024-08-18T22:30:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff326a00640 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55d381e7d880 0x55d381ed4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff326a00640 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55d381e7d880 0x55d381ed4020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb14acb6a85f6595 server_cookie=a155ff22246cd882 in_seq=0 out_seq=0 2024-08-18T22:30:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff30be00640 10 client.9696 ms_handle_connect on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff30be00640 1 -- 172.21.15.5:0/2205214738 <== mds.0 v2:172.21.15.5:6833/324683204 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d381c60d90 con 0x55d381e7d880 2024-08-18T22:30:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff30be00640 10 client.9696 handle_command_reply: tid=0 2024-08-18T22:30:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 client.9696 shutdown 2024-08-18T22:30:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 -- 172.21.15.5:0/2205214738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 msgr2=0x55d381e7ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e7ce70 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7ff3200072e0 tx=0x7ff320007e50 comp rx=0 tx=0).stop 2024-08-18T22:30:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 -- 172.21.15.5:0/2205214738 shutdown_connections 2024-08-18T22:30:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55d381e7d880 0x55d381ed4020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381ec2890 0x55d381e7ce70 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381e7c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff30be00640 0 client.9696 ms_handle_reset on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 --2- 172.21.15.5:0/2205214738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381e7c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 -- 172.21.15.5:0/2205214738 >> 172.21.15.5:0/2205214738 conn(0x55d381e6f680 msgr2=0x55d381ea4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 -- 172.21.15.5:0/2205214738 shutdown_connections 2024-08-18T22:30:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 1 -- 172.21.15.5:0/2205214738 wait complete. 2024-08-18T22:30:51.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.072+0000 7ff331160000 20 client.9696 trim_cache size 0 max 16384 2024-08-18T22:30:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 Processor -- start 2024-08-18T22:30:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 -- start start 2024-08-18T22:30:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 0x55d381f31f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381f32490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381f329d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff328204230 con 0x55d381e6f680 2024-08-18T22:30:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff328203250 con 0x55d381ec1f70 2024-08-18T22:30:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff3281495b0 con 0x55d381e75b70 2024-08-18T22:30:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff326a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 0x55d381f31f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff326a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 0x55d381f31f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42802/0 (socket says 172.21.15.5:42802) 2024-08-18T22:30:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff326a00640 1 -- 172.21.15.5:0/3226052583 learned_addr learned my addr 172.21.15.5:0/3226052583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff31fe00640 1 --2- 172.21.15.5:0/3226052583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381f32490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff327400640 1 --2- 172.21.15.5:0/3226052583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381f329d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff326a00640 1 -- 172.21.15.5:0/3226052583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 msgr2=0x55d381f32490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff326a00640 1 --2- 172.21.15.5:0/3226052583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381f32490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff326a00640 1 -- 172.21.15.5:0/3226052583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 msgr2=0x55d381f329d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff326a00640 1 --2- 172.21.15.5:0/3226052583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381f329d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff326a00640 1 -- 172.21.15.5:0/3226052583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d381d475c0 con 0x55d381e6f680 2024-08-18T22:30:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff326a00640 1 --2- 172.21.15.5:0/3226052583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 0x55d381f31f50 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7ff3180ebfb0 tx=0x7ff31811daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a470263cef99a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff316a00640 1 -- 172.21.15.5:0/3226052583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180f8710 con 0x55d381e6f680 2024-08-18T22:30:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff316a00640 1 -- 172.21.15.5:0/3226052583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180b0040 con 0x55d381e6f680 2024-08-18T22:30:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff316a00640 1 -- 172.21.15.5:0/3226052583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180ede50 con 0x55d381e6f680 2024-08-18T22:30:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 -- 172.21.15.5:0/3226052583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 msgr2=0x55d381f31f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 --2- 172.21.15.5:0/3226052583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 0x55d381f31f50 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7ff3180ebfb0 tx=0x7ff31811daf0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 -- 172.21.15.5:0/3226052583 shutdown_connections 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 --2- 172.21.15.5:0/3226052583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381ec1f70 0x55d381f329d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 --2- 172.21.15.5:0/3226052583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381e75b70 0x55d381f32490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 --2- 172.21.15.5:0/3226052583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 0x55d381f31f50 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 -- 172.21.15.5:0/3226052583 >> 172.21.15.5:0/3226052583 conn(0x55d381ea5330 msgr2=0x55d381e746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 -- 172.21.15.5:0/3226052583 shutdown_connections 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 -- 172.21.15.5:0/3226052583 wait complete. 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 -- start start 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.092+0000 7ff331160000 1 Processor -- start 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 0x55d381ed72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381e75b70 0x55d381ed7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381ec1f70 0x55d381ef1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d381c6da10 con 0x55d381e6f680 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff328149c00 con 0x55d381e75b70 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55d381cc5780 con 0x55d381ec1f70 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 10 client.0 _ll_register_callbacks cb 0x7ff320009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff326a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 0x55d381ed72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff31fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381e75b70 0x55d381ed7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff327400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381ec1f70 0x55d381ef1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff31fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381e75b70 0x55d381ed7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:48944/0 (socket says 172.21.15.5:48944) 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff31fe00640 1 -- 172.21.15.5:0/753748724 learned_addr learned my addr 172.21.15.5:0/753748724 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff326a00640 1 -- 172.21.15.5:0/753748724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381ec1f70 msgr2=0x55d381ef1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff326a00640 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381ec1f70 0x55d381ef1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff326a00640 1 -- 172.21.15.5:0/753748724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381e75b70 msgr2=0x55d381ed7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff326a00640 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381e75b70 0x55d381ed7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff326a00640 1 -- 172.21.15.5:0/753748724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d381c59c50 con 0x55d381e6f680 2024-08-18T22:30:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff327400640 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381ec1f70 0x55d381ef1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff31fe00640 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381e75b70 0x55d381ed7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff326a00640 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 0x55d381ed72d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7ff3180097c0 tx=0x7ff3180c3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd11e400cedc4103 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff30be00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff30be00640 1 -- 172.21.15.5:0/753748724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318117150 con 0x55d381e6f680 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff30be00640 1 -- 172.21.15.5:0/753748724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7ff3181172f0 con 0x55d381e6f680 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 -- 172.21.15.5:0/753748724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3180b0040 con 0x55d381e6f680 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff30be00640 1 -- 172.21.15.5:0/753748724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7ff3180eefa0 con 0x55d381e6f680 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 10 client.9702 fetch_fsmap learned FSMap version 125 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 -- 172.21.15.5:0/753748724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x55d381c6c2a0 con 0x55d381e6f680 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff30be00640 1 -- 172.21.15.5:0/753748724 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180b0040 con 0x55d381e6f680 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff30be00640 1 -- 172.21.15.5:0/753748724 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7ff3180aa070 con 0x55d381e6f680 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 10 client.9702 fetch_fsmap finished waiting for FSMap version 125 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 10 client.9702 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-08-18T22:30:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 20 client.9702 populate_metadata read hostname 'smithi005' 2024-08-18T22:30:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55d381ec2890 0x55d381ef1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 4 client.9702 mds_command: new command op to 9525 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-08-18T22:30:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 -- 172.21.15.5:0/753748724 --> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55d381cd3ba0 con 0x55d381ec2890 2024-08-18T22:30:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff31fe00640 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55d381ec2890 0x55d381ef1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff30be00640 10 client.9702 ms_handle_connect on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff31fe00640 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55d381ec2890 0x55d381ef1ce0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3778db46e12573b9 server_cookie=a764d15dfa4a5811 in_seq=0 out_seq=0 2024-08-18T22:30:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff30be00640 1 -- 172.21.15.5:0/753748724 <== mds.0 v2:172.21.15.5:6833/324683204 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d381cd3ba0 con 0x55d381ec2890 2024-08-18T22:30:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff30be00640 10 client.9702 handle_command_reply: tid=0 2024-08-18T22:30:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 client.9702 shutdown 2024-08-18T22:30:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 -- 172.21.15.5:0/753748724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 msgr2=0x55d381ed72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 0x55d381ed72d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7ff3180097c0 tx=0x7ff3180c3040 comp rx=0 tx=0).stop 2024-08-18T22:30:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 -- 172.21.15.5:0/753748724 shutdown_connections 2024-08-18T22:30:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x55d381ec2890 0x55d381ef1ce0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55d381ec1f70 0x55d381ef1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d381e75b70 0x55d381ed7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 --2- 172.21.15.5:0/753748724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d381e6f680 0x55d381ed72d0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff30be00640 0 client.9702 ms_handle_reset on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.096+0000 7ff331160000 1 -- 172.21.15.5:0/753748724 >> 172.21.15.5:0/753748724 conn(0x55d381ea5330 msgr2=0x55d381e74ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff331160000 1 -- 172.21.15.5:0/753748724 shutdown_connections 2024-08-18T22:30:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff331160000 1 -- 172.21.15.5:0/753748724 wait complete. 2024-08-18T22:30:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff331160000 20 client.9702 trim_cache size 0 max 16384 2024-08-18T22:30:51.103 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:30:51.103 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-08-18T22:30:51.103 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0 2024-08-18T22:30:51.103 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 -- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3040678c0 msgr2=0x7ff304069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3040678c0 0x7ff304069d80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff3281fac10 tx=0x7ff310009040 comp rx=0 tx=0).stop 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 -- 172.21.15.5:0/466949881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32815c180 msgr2=0x7ff328165a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32815c180 0x7ff328165a00 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7ff31801a040 tx=0x7ff3180191b0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 -- 172.21.15.5:0/466949881 shutdown_connections 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff3040678c0 0x7ff304069d80 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3280ca390 0x7ff3280b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff32815d4d0 0x7ff3280c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 --2- 172.21.15.5:0/466949881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32815c180 0x7ff328165a00 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 -- 172.21.15.5:0/466949881 >> 172.21.15.5:0/466949881 conn(0x7ff3280b1dc0 msgr2=0x7ff3280b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 -- 172.21.15.5:0/466949881 shutdown_connections 2024-08-18T22:30:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.100+0000 7ff32dc00640 1 -- 172.21.15.5:0/466949881 wait complete. 2024-08-18T22:30:51.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:30:51.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub status 2024-08-18T22:30:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.260+0000 7f688d000640 1 Processor -- start 2024-08-18T22:30:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.260+0000 7f688d000640 1 -- start start 2024-08-18T22:30:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f688d000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f688815b0c0 0x7f688806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f688d000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68880cf290 0x7f68880b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f688d000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68880b31f0 con 0x7f68880b40c0 2024-08-18T22:30:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f688d000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f68880b4a70 con 0x7f68880cf290 2024-08-18T22:30:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f688d000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f68880b3d70 con 0x7f688815b0c0 2024-08-18T22:30:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f6886800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68880cf290 0x7f68880b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f687d400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68880b40c0 0x7f6888072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33530/0 (socket says 172.21.15.5:33530) 2024-08-18T22:30:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f687d400640 1 -- 172.21.15.5:0/1222846870 learned_addr learned my addr 172.21.15.5:0/1222846870 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f6885e00640 1 --2- 172.21.15.5:0/1222846870 >> v2:172.21.15.117:3300/0 conn(0x7f688815b0c0 0x7f688806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f6886800640 1 -- 172.21.15.5:0/1222846870 >> v2:172.21.15.117:3300/0 conn(0x7f688815b0c0 msgr2=0x7f688806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f6886800640 1 --2- 172.21.15.5:0/1222846870 >> v2:172.21.15.117:3300/0 conn(0x7f688815b0c0 0x7f688806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f6886800640 1 -- 172.21.15.5:0/1222846870 >> v1:172.21.15.5:6789/0 conn(0x7f68880b40c0 legacy=0x7f6888072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f6886800640 1 -- 172.21.15.5:0/1222846870 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68880b34d0 con 0x7f68880cf290 2024-08-18T22:30:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f6885400640 1 -- 172.21.15.5:0/1222846870 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2765058592 0 0) 0x7f68880b31f0 con 0x7f68880b40c0 2024-08-18T22:30:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.264+0000 7f6886800640 1 --2- 172.21.15.5:0/1222846870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880cf290 0x7f68880b4530 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f6888070ba0 tx=0x7f688001c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62af083c97d10475 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f6885400640 1 -- 172.21.15.5:0/1222846870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68800b2070 con 0x7f68880cf290 2024-08-18T22:30:51.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f6885400640 1 -- 172.21.15.5:0/1222846870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68800a58a0 con 0x7f68880cf290 2024-08-18T22:30:51.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f6885400640 1 -- 172.21.15.5:0/1222846870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68800a5c70 con 0x7f68880cf290 2024-08-18T22:30:51.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 -- 172.21.15.5:0/1222846870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880cf290 msgr2=0x7f68880b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 --2- 172.21.15.5:0/1222846870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880cf290 0x7f68880b4530 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f6888070ba0 tx=0x7f688001c7e0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 -- 172.21.15.5:0/1222846870 shutdown_connections 2024-08-18T22:30:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 --2- 172.21.15.5:0/1222846870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880cf290 0x7f68880b4530 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 --2- 172.21.15.5:0/1222846870 >> v2:172.21.15.117:3300/0 conn(0x7f688815b0c0 0x7f688806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 -- 172.21.15.5:0/1222846870 >> 172.21.15.5:0/1222846870 conn(0x7f68880b1dc0 msgr2=0x7f68880b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 -- 172.21.15.5:0/1222846870 shutdown_connections 2024-08-18T22:30:51.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 -- 172.21.15.5:0/1222846870 wait complete. 2024-08-18T22:30:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 Processor -- start 2024-08-18T22:30:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 -- start start 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880b40c0 0x7f6888151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68880cf290 0x7f688815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688815b0c0 0x7f688806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f688815b620 con 0x7f68880b40c0 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f688815b4a0 con 0x7f68880cf290 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f688d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f688806f670 con 0x7f688815b0c0 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f6885e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880b40c0 0x7f6888151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f6885e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880b40c0 0x7f6888151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42824/0 (socket says 172.21.15.5:42824) 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f6885e00640 1 -- 172.21.15.5:0/4058485048 learned_addr learned my addr 172.21.15.5:0/4058485048 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f687d400640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68880cf290 0x7f688815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.268+0000 7f6886800640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688815b0c0 0x7f688806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f6885e00640 1 -- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688815b0c0 msgr2=0x7f688806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f6885e00640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688815b0c0 0x7f688806e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f6885e00640 1 -- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68880cf290 msgr2=0x7f688815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f6885e00640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68880cf290 0x7f688815b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f6885e00640 1 -- 172.21.15.5:0/4058485048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6888152250 con 0x7f68880b40c0 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f687d400640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68880cf290 0x7f688815b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f6886800640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688815b0c0 0x7f688806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f6885e00640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880b40c0 0x7f6888151d10 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f687800e930 tx=0x7f687800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f687ea00640 1 -- 172.21.15.5:0/4058485048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878017070 con 0x7f68880b40c0 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f687ea00640 1 -- 172.21.15.5:0/4058485048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687800ca00 con 0x7f68880b40c0 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f687ea00640 1 -- 172.21.15.5:0/4058485048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687800cdb0 con 0x7f68880b40c0 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f688d000640 1 -- 172.21.15.5:0/4058485048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688815c280 con 0x7f68880b40c0 2024-08-18T22:30:51.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f688d000640 1 -- 172.21.15.5:0/4058485048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688815c840 con 0x7f68880b40c0 2024-08-18T22:30:51.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.272+0000 7f687ea00640 1 -- 172.21.15.5:0/4058485048 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f687801a070 con 0x7f68880b40c0 2024-08-18T22:30:51.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f687ea00640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68640678c0 0x7f6864069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f687ea00640 1 -- 172.21.15.5:0/4058485048 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f6878085dd0 con 0x7f68880b40c0 2024-08-18T22:30:51.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 Processor -- start 2024-08-18T22:30:51.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f687d400640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68640678c0 0x7f6864069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 -- start start 2024-08-18T22:30:51.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f687d400640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68640678c0 0x7f6864069d80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f68880af0e0 tx=0x7f6870007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 0x5591e8681d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86822c0 0x5591e8634fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e86358e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5591e851eae0 con 0x5591e8635500 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5591e850aba0 con 0x5591e86819a0 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5591e84854f0 con 0x5591e86822c0 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6886800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e86358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f687d400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86822c0 0x5591e8634fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6885e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 0x5591e8681d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6885e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 0x5591e8681d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:48964/0 (socket says 172.21.15.5:48964) 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6885e00640 1 -- 172.21.15.5:0/3024598746 learned_addr learned my addr 172.21.15.5:0/3024598746 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6885e00640 1 -- 172.21.15.5:0/3024598746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86822c0 msgr2=0x5591e8634fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6885e00640 1 --2- 172.21.15.5:0/3024598746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86822c0 0x5591e8634fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6885e00640 1 -- 172.21.15.5:0/3024598746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 msgr2=0x5591e86358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6885e00640 1 --2- 172.21.15.5:0/3024598746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e86358e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6885e00640 1 -- 172.21.15.5:0/3024598746 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e8425a90 con 0x5591e86819a0 2024-08-18T22:30:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6885e00640 1 --2- 172.21.15.5:0/3024598746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 0x5591e8681d80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f687805e880 tx=0x7f68780561d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e68c9bdb986a1e92 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6876a00640 1 -- 172.21.15.5:0/3024598746 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878081020 con 0x5591e86819a0 2024-08-18T22:30:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6876a00640 1 -- 172.21.15.5:0/3024598746 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687805edb0 con 0x5591e86819a0 2024-08-18T22:30:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6876a00640 1 -- 172.21.15.5:0/3024598746 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878021040 con 0x5591e86819a0 2024-08-18T22:30:51.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 -- 172.21.15.5:0/3024598746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 msgr2=0x5591e8681d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 --2- 172.21.15.5:0/3024598746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 0x5591e8681d80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f687805e880 tx=0x7f68780561d0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 -- 172.21.15.5:0/3024598746 shutdown_connections 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 --2- 172.21.15.5:0/3024598746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e86358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 --2- 172.21.15.5:0/3024598746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86822c0 0x5591e8634fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 --2- 172.21.15.5:0/3024598746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 0x5591e8681d80 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 -- 172.21.15.5:0/3024598746 >> 172.21.15.5:0/3024598746 conn(0x5591e862f010 msgr2=0x5591e8664820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 -- 172.21.15.5:0/3024598746 shutdown_connections 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.276+0000 7f6890426000 1 -- 172.21.15.5:0/3024598746 wait complete. 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 -- start start 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 Processor -- start 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e8635500 0x5591e8661e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e86819a0 0x5591e863d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86822c0 0x5591e863d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5591e84814b0 con 0x5591e86819a0 2024-08-18T22:30:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5591e843fb50 con 0x5591e86822c0 2024-08-18T22:30:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5591e8426d00 con 0x5591e8635500 2024-08-18T22:30:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 10 client.0 _ll_register_callbacks cb 0x5591e8622f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:30:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f687d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e86819a0 0x5591e863d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f687d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e86819a0 0x5591e863d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42850/0 (socket says 172.21.15.5:42850) 2024-08-18T22:30:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f687d400640 1 -- 172.21.15.5:0/3635230709 learned_addr learned my addr 172.21.15.5:0/3635230709 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f687d400640 1 -- 172.21.15.5:0/3635230709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e8635500 msgr2=0x5591e8661e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f687d400640 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e8635500 0x5591e8661e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6886800640 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86822c0 0x5591e863d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f687d400640 1 -- 172.21.15.5:0/3635230709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86822c0 msgr2=0x5591e863d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f687d400640 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86822c0 0x5591e863d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f687d400640 1 -- 172.21.15.5:0/3635230709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e843e060 con 0x5591e86819a0 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6886800640 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86822c0 0x5591e863d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f687d400640 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e86819a0 0x5591e863d030 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f6870001d30 tx=0x7f6870000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deee7303f5cbc051 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f686b400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f686b400640 1 -- 172.21.15.5:0/3635230709 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870014e40 con 0x5591e86819a0 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 -- 172.21.15.5:0/3635230709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f687805edb0 con 0x5591e86819a0 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f686b400640 1 -- 172.21.15.5:0/3635230709 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f6870010040 con 0x5591e86819a0 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f686b400640 1 -- 172.21.15.5:0/3635230709 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7f687002e050 con 0x5591e86819a0 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 10 client.9717 fetch_fsmap learned FSMap version 125 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 -- 172.21.15.5:0/3635230709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x5591e8451f50 con 0x5591e86819a0 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f686b400640 1 -- 172.21.15.5:0/3635230709 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687805edb0 con 0x5591e86819a0 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f686b400640 1 -- 172.21.15.5:0/3635230709 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7f6870031020 con 0x5591e86819a0 2024-08-18T22:30:51.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 10 client.9717 fetch_fsmap finished waiting for FSMap version 125 2024-08-18T22:30:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 10 client.9717 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-08-18T22:30:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 20 client.9717 populate_metadata read hostname 'smithi005' 2024-08-18T22:30:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5591e8663d30 0x5591e8664140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 4 client.9717 mds_command: new command op to 9525 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:30:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6890426000 1 -- 172.21.15.5:0/3635230709 --> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591e841fe10 con 0x5591e8663d30 2024-08-18T22:30:51.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.280+0000 7f6885e00640 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5591e8663d30 0x5591e8664140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6885e00640 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5591e8663d30 0x5591e8664140 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1f696f8808b80a8 server_cookie=ccad2544c42235bc in_seq=0 out_seq=0 2024-08-18T22:30:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f686b400640 10 client.9717 ms_handle_connect on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f686b400640 1 -- 172.21.15.5:0/3635230709 <== mds.0 v2:172.21.15.5:6833/324683204 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591e841fe10 con 0x5591e8663d30 2024-08-18T22:30:51.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f686b400640 10 client.9717 handle_command_reply: tid=0 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 1 client.9717 shutdown 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 1 -- 172.21.15.5:0/3635230709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e86819a0 msgr2=0x5591e863d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e86819a0 0x5591e863d030 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f6870001d30 tx=0x7f6870000ee0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 1 -- 172.21.15.5:0/3635230709 shutdown_connections 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5591e8663d30 0x5591e8664140 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86822c0 0x5591e863d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e86819a0 0x5591e863d030 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f686b400640 0 client.9717 ms_handle_reset on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 1 --2- 172.21.15.5:0/3635230709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e8635500 0x5591e8661e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 1 -- 172.21.15.5:0/3635230709 >> 172.21.15.5:0/3635230709 conn(0x5591e862f010 msgr2=0x5591e86346c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 1 -- 172.21.15.5:0/3635230709 shutdown_connections 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 1 -- 172.21.15.5:0/3635230709 wait complete. 2024-08-18T22:30:51.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.284+0000 7f6890426000 20 client.9717 trim_cache size 0 max 16384 2024-08-18T22:30:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.300+0000 7f6890426000 1 Processor -- start 2024-08-18T22:30:51.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 -- start start 2024-08-18T22:30:51.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8680d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 0x5591e86347a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86822c0 0x5591e8634ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6888203a60 con 0x5591e8635500 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6888202ab0 con 0x5591e86819a0 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f68881f76f0 con 0x5591e86822c0 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6885e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8680d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6885e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8680d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42858/0 (socket says 172.21.15.5:42858) 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6885e00640 1 -- 172.21.15.5:0/3995196003 learned_addr learned my addr 172.21.15.5:0/3995196003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f687d400640 1 --2- 172.21.15.5:0/3995196003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 0x5591e86347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6886800640 1 --2- 172.21.15.5:0/3995196003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86822c0 0x5591e8634ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6885e00640 1 -- 172.21.15.5:0/3995196003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86822c0 msgr2=0x5591e8634ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6885e00640 1 --2- 172.21.15.5:0/3995196003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86822c0 0x5591e8634ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6885e00640 1 -- 172.21.15.5:0/3995196003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 msgr2=0x5591e86347a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6885e00640 1 --2- 172.21.15.5:0/3995196003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 0x5591e86347a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6885e00640 1 -- 172.21.15.5:0/3995196003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e8507dd0 con 0x5591e8635500 2024-08-18T22:30:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f687d400640 1 --2- 172.21.15.5:0/3995196003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 0x5591e86347a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6885e00640 1 --2- 172.21.15.5:0/3995196003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8680d50 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f68780568f0 tx=0x7f687801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509a97ace84eb849 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6876000640 1 -- 172.21.15.5:0/3995196003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878021040 con 0x5591e8635500 2024-08-18T22:30:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6876000640 1 -- 172.21.15.5:0/3995196003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6878052840 con 0x5591e8635500 2024-08-18T22:30:51.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6876000640 1 -- 172.21.15.5:0/3995196003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878081040 con 0x5591e8635500 2024-08-18T22:30:51.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 -- 172.21.15.5:0/3995196003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 msgr2=0x5591e8680d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 --2- 172.21.15.5:0/3995196003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8680d50 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f68780568f0 tx=0x7f687801d000 comp rx=0 tx=0).stop 2024-08-18T22:30:51.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 -- 172.21.15.5:0/3995196003 shutdown_connections 2024-08-18T22:30:51.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 --2- 172.21.15.5:0/3995196003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86822c0 0x5591e8634ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 --2- 172.21.15.5:0/3995196003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86819a0 0x5591e86347a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 --2- 172.21.15.5:0/3995196003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8680d50 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 -- 172.21.15.5:0/3995196003 >> 172.21.15.5:0/3995196003 conn(0x5591e862f010 msgr2=0x5591e8680220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 -- 172.21.15.5:0/3995196003 shutdown_connections 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 -- 172.21.15.5:0/3995196003 wait complete. 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 -- start start 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.304+0000 7f6890426000 1 Processor -- start 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8698d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86819a0 0x5591e8699250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86822c0 0x5591e8693f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5591e8507940 con 0x5591e8635500 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5591e8489b20 con 0x5591e86822c0 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5591e8484800 con 0x5591e86819a0 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 10 client.0 _ll_register_callbacks cb 0x7f6870005c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6885e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8698d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6885e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8698d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42870/0 (socket says 172.21.15.5:42870) 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6885e00640 1 -- 172.21.15.5:0/1075136468 learned_addr learned my addr 172.21.15.5:0/1075136468 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6886800640 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86822c0 0x5591e8693f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f687d400640 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86819a0 0x5591e8699250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6885e00640 1 -- 172.21.15.5:0/1075136468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86819a0 msgr2=0x5591e8699250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6885e00640 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86819a0 0x5591e8699250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6885e00640 1 -- 172.21.15.5:0/1075136468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86822c0 msgr2=0x5591e8693f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6885e00640 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86822c0 0x5591e8693f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6885e00640 1 -- 172.21.15.5:0/1075136468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e8418cd0 con 0x5591e8635500 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6885e00640 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8698d10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f687805a740 tx=0x7f687800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b1a8e5a6caf5e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f686b400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f686b400640 1 -- 172.21.15.5:0/1075136468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878078070 con 0x5591e8635500 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f686b400640 1 -- 172.21.15.5:0/1075136468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f687807db60 con 0x5591e8635500 2024-08-18T22:30:51.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 -- 172.21.15.5:0/1075136468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6878052840 con 0x5591e8635500 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f686b400640 1 -- 172.21.15.5:0/1075136468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7f6878081050 con 0x5591e8635500 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 10 client.9723 fetch_fsmap learned FSMap version 125 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 -- 172.21.15.5:0/1075136468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x5591e842b320 con 0x5591e8635500 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f686b400640 1 -- 172.21.15.5:0/1075136468 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6878052840 con 0x5591e8635500 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f686b400640 1 -- 172.21.15.5:0/1075136468 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7f6878024060 con 0x5591e8635500 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 10 client.9723 fetch_fsmap finished waiting for FSMap version 125 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 10 client.9723 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 20 client.9723 populate_metadata read hostname 'smithi005' 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5591e8694920 0x5591e86f5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 4 client.9723 mds_command: new command op to 9525 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 -- 172.21.15.5:0/1075136468 --> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5591e8492c20 con 0x5591e8694920 2024-08-18T22:30:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f687d400640 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5591e8694920 0x5591e86f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f687d400640 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5591e8694920 0x5591e86f5240 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9705913580ecc06b server_cookie=26040d338fedd5ae in_seq=0 out_seq=0 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f686b400640 10 client.9723 ms_handle_connect on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f686b400640 1 -- 172.21.15.5:0/1075136468 <== mds.0 v2:172.21.15.5:6833/324683204 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x5591e8492c20 con 0x5591e8694920 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f686b400640 10 client.9723 handle_command_reply: tid=0 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 client.9723 shutdown 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 -- 172.21.15.5:0/1075136468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 msgr2=0x5591e8698d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8698d10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f687805a740 tx=0x7f687800cf50 comp rx=0 tx=0).stop 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 -- 172.21.15.5:0/1075136468 shutdown_connections 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.5:6833/324683204,v1:172.21.15.5:6835/324683204] conn(0x5591e8694920 0x5591e86f5240 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5591e86822c0 0x5591e8693f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5591e86819a0 0x5591e8699250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 --2- 172.21.15.5:0/1075136468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591e8635500 0x5591e8698d10 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 -- 172.21.15.5:0/1075136468 >> 172.21.15.5:0/1075136468 conn(0x5591e862f010 msgr2=0x5591e8662f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f686b400640 0 client.9723 ms_handle_reset on v2:172.21.15.5:6833/324683204 2024-08-18T22:30:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 -- 172.21.15.5:0/1075136468 shutdown_connections 2024-08-18T22:30:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 1 -- 172.21.15.5:0/1075136468 wait complete. 2024-08-18T22:30:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.308+0000 7f6890426000 20 client.9723 trim_cache size 0 max 16384 2024-08-18T22:30:51.314 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:30:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-08-18T22:30:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-18T22:30:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "93c0c0c9-60f8-4039-be70-2b8966a84480": { 2024-08-18T22:30:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/scrub_control_test_path", 2024-08-18T22:30:51.314 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "93c0c0c9-60f8-4039-be70-2b8966a84480", 2024-08-18T22:30:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive" 2024-08-18T22:30:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:51.315 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:30:51.315 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:30:51.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 -- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68640678c0 msgr2=0x7f6864069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68640678c0 0x7f6864069d80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f68880af0e0 tx=0x7f6870007cb0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 -- 172.21.15.5:0/4058485048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880b40c0 msgr2=0x7f6888151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880b40c0 0x7f6888151d10 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f687800e930 tx=0x7f687800edf0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 -- 172.21.15.5:0/4058485048 shutdown_connections 2024-08-18T22:30:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f68640678c0 0x7f6864069d80 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688815b0c0 0x7f688806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68880cf290 0x7f688815b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 --2- 172.21.15.5:0/4058485048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68880b40c0 0x7f6888151d10 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 -- 172.21.15.5:0/4058485048 >> 172.21.15.5:0/4058485048 conn(0x7f68880b1dc0 msgr2=0x7f68881596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 -- 172.21.15.5:0/4058485048 shutdown_connections 2024-08-18T22:30:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.312+0000 7f688d000640 1 -- 172.21.15.5:0/4058485048 wait complete. 2024-08-18T22:30:51.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:51.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.468+0000 7f8c50400640 1 Processor -- start 2024-08-18T22:30:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.468+0000 7f8c50400640 1 -- start start 2024-08-18T22:30:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.472+0000 7f8c50400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8c48161960 0x7f8c4806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.472+0000 7f8c50400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4815eb60 con 0x7f8c48070730 2024-08-18T22:30:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.472+0000 7f8c50400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4815ee40 con 0x7f8c4815e4b0 2024-08-18T22:30:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.472+0000 7f8c50400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4815e940 con 0x7f8c48161960 2024-08-18T22:30:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.472+0000 7f8c4da00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8c48161960 0x7f8c4806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.472+0000 7f8c4da00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8c48161960 0x7f8c4806fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42884/0 (socket says 172.21.15.5:42884) 2024-08-18T22:30:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.472+0000 7f8c4da00640 1 -- 172.21.15.5:0/292945473 learned_addr learned my addr 172.21.15.5:0/292945473 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.472+0000 7f8c4da00640 1 -- 172.21.15.5:0/292945473 >> v1:172.21.15.117:6789/0 conn(0x7f8c4815e4b0 legacy=0x7f8c480d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.472+0000 7f8c4da00640 1 -- 172.21.15.5:0/292945473 >> v1:172.21.15.5:6789/0 conn(0x7f8c48070730 legacy=0x7f8c4815dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.472+0000 7f8c4da00640 1 -- 172.21.15.5:0/292945473 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4815f120 con 0x7f8c48161960 2024-08-18T22:30:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.472+0000 7f8c47e00640 1 -- 172.21.15.5:0/292945473 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1803304111 0 0) 0x7f8c4815eb60 con 0x7f8c48070730 2024-08-18T22:30:51.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c4da00640 1 --2- 172.21.15.5:0/292945473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c48161960 0x7f8c4806fd20 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009870 tx=0x7f8c3c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b978ddf277f609 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c47e00640 1 -- 172.21.15.5:0/292945473 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c0b2070 con 0x7f8c48161960 2024-08-18T22:30:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c47e00640 1 -- 172.21.15.5:0/292945473 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3c0a9070 con 0x7f8c48161960 2024-08-18T22:30:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c47e00640 1 -- 172.21.15.5:0/292945473 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c0ad880 con 0x7f8c48161960 2024-08-18T22:30:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c50400640 1 -- 172.21.15.5:0/292945473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c48161960 msgr2=0x7f8c4806fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c50400640 1 --2- 172.21.15.5:0/292945473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c48161960 0x7f8c4806fd20 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009870 tx=0x7f8c3c01c560 comp rx=0 tx=0).stop 2024-08-18T22:30:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c50400640 1 -- 172.21.15.5:0/292945473 shutdown_connections 2024-08-18T22:30:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c50400640 1 --2- 172.21.15.5:0/292945473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c48161960 0x7f8c4806fd20 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c50400640 1 -- 172.21.15.5:0/292945473 >> 172.21.15.5:0/292945473 conn(0x7f8c480d2130 msgr2=0x7f8c480d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c50400640 1 -- 172.21.15.5:0/292945473 shutdown_connections 2024-08-18T22:30:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c50400640 1 -- 172.21.15.5:0/292945473 wait complete. 2024-08-18T22:30:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c50400640 1 Processor -- start 2024-08-18T22:30:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.476+0000 7f8c50400640 1 -- start start 2024-08-18T22:30:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c50400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c48070730 0x7f8c4814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c50400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4815e4b0 0x7f8c480c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c50400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c48161960 0x7f8c480c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c50400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4809ba30 con 0x7f8c48161960 2024-08-18T22:30:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c50400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48070260 con 0x7f8c4815e4b0 2024-08-18T22:30:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c50400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8c480cae00 con 0x7f8c48070730 2024-08-18T22:30:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c48161960 0x7f8c480c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4da00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c48070730 0x7f8c4814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c48161960 0x7f8c480c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42900/0 (socket says 172.21.15.5:42900) 2024-08-18T22:30:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4d000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4815e4b0 0x7f8c480c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4e400640 1 -- 172.21.15.5:0/1575640540 learned_addr learned my addr 172.21.15.5:0/1575640540 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4e400640 1 -- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c48070730 msgr2=0x7f8c4814d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4e400640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c48070730 0x7f8c4814d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4e400640 1 -- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4815e4b0 msgr2=0x7f8c480c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4e400640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4815e4b0 0x7f8c480c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4e400640 1 -- 172.21.15.5:0/1575640540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c480caad0 con 0x7f8c48161960 2024-08-18T22:30:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4d000640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4815e4b0 0x7f8c480c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c4e400640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c48161960 0x7f8c480c9740 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000c730 tx=0x7f8c4000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c45600640 1 -- 172.21.15.5:0/1575640540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40003b80 con 0x7f8c48161960 2024-08-18T22:30:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c45600640 1 -- 172.21.15.5:0/1575640540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c40003d20 con 0x7f8c48161960 2024-08-18T22:30:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c45600640 1 -- 172.21.15.5:0/1575640540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4000aa30 con 0x7f8c48161960 2024-08-18T22:30:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c50400640 1 -- 172.21.15.5:0/1575640540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4815ddb0 con 0x7f8c48161960 2024-08-18T22:30:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c50400640 1 -- 172.21.15.5:0/1575640540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c480ca050 con 0x7f8c48161960 2024-08-18T22:30:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c50400640 1 -- 172.21.15.5:0/1575640540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4806fd20 con 0x7f8c48161960 2024-08-18T22:30:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.480+0000 7f8c45600640 1 -- 172.21.15.5:0/1575640540 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c4000abd0 con 0x7f8c48161960 2024-08-18T22:30:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.484+0000 7f8c45600640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c280678c0 0x7f8c28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.484+0000 7f8c45600640 1 -- 172.21.15.5:0/1575640540 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f8c40085ba0 con 0x7f8c48161960 2024-08-18T22:30:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.484+0000 7f8c4da00640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c280678c0 0x7f8c28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.484+0000 7f8c4da00640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c280678c0 0x7f8c28069d80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0af000 tx=0x7f8c3c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.488+0000 7f8c45600640 1 -- 172.21.15.5:0/1575640540 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8c40055ef0 con 0x7f8c48161960 2024-08-18T22:30:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.692+0000 7f8c50400640 1 -- 172.21.15.5:0/1575640540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c4809bbb0 con 0x7f8c48161960 2024-08-18T22:30:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.692+0000 7f8c45600640 1 -- 172.21.15.5:0/1575640540 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f8c4005a1f0 con 0x7f8c48161960 2024-08-18T22:30:51.692 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:51.692 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:30:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:30:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 -- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c280678c0 msgr2=0x7f8c28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c280678c0 0x7f8c28069d80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0af000 tx=0x7f8c3c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:30:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 -- 172.21.15.5:0/1575640540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c48161960 msgr2=0x7f8c480c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c48161960 0x7f8c480c9740 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000c730 tx=0x7f8c4000cbf0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 -- 172.21.15.5:0/1575640540 shutdown_connections 2024-08-18T22:30:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c280678c0 0x7f8c28069d80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c48161960 0x7f8c480c9740 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4815e4b0 0x7f8c480c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 --2- 172.21.15.5:0/1575640540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c48070730 0x7f8c4814d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 -- 172.21.15.5:0/1575640540 >> 172.21.15.5:0/1575640540 conn(0x7f8c480d2130 msgr2=0x7f8c4809b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 -- 172.21.15.5:0/1575640540 shutdown_connections 2024-08-18T22:30:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.696+0000 7f8c50400640 1 -- 172.21.15.5:0/1575640540 wait complete. 2024-08-18T22:30:51.713 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:30:51.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:30:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.852+0000 7faf14600640 1 Processor -- start 2024-08-18T22:30:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.852+0000 7faf14600640 1 -- start start 2024-08-18T22:30:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf14600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0c161960 0x7faf0c06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf14600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faf0c070730 0x7faf0c070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf14600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf0c15eb60 con 0x7faf0c15dda0 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf14600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faf0c15fcc0 con 0x7faf0c070730 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf14600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf0c0710b0 con 0x7faf0c161960 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf12600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faf0c15dda0 0x7faf0c15e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33544/0 (socket says 172.21.15.5:33544) 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf12600640 1 -- 172.21.15.5:0/1593295252 learned_addr learned my addr 172.21.15.5:0/1593295252 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf11c00640 1 --2- 172.21.15.5:0/1593295252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0c161960 0x7faf0c06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf11200640 1 --2- 172.21.15.5:0/1593295252 >> v2:172.21.15.117:3300/0 conn(0x7faf0c070730 0x7faf0c070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf0be00640 1 -- 172.21.15.5:0/1593295252 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 679133684 0 0) 0x7faf0c15eb60 con 0x7faf0c15dda0 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf0be00640 1 -- 172.21.15.5:0/1593295252 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faef4003530 con 0x7faf0c15dda0 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf11c00640 1 -- 172.21.15.5:0/1593295252 >> v2:172.21.15.117:3300/0 conn(0x7faf0c070730 msgr2=0x7faf0c070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf11c00640 1 --2- 172.21.15.5:0/1593295252 >> v2:172.21.15.117:3300/0 conn(0x7faf0c070730 0x7faf0c070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf11c00640 1 -- 172.21.15.5:0/1593295252 >> v1:172.21.15.5:6789/0 conn(0x7faf0c15dda0 legacy=0x7faf0c15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.856+0000 7faf11c00640 1 -- 172.21.15.5:0/1593295252 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c15ee40 con 0x7faf0c161960 2024-08-18T22:30:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf11c00640 1 --2- 172.21.15.5:0/1593295252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0c161960 0x7faf0c06fd20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faf000097c0 tx=0x7faf0001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5144fc89cb2cf7da server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf0be00640 1 -- 172.21.15.5:0/1593295252 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf000b0070 con 0x7faf0c161960 2024-08-18T22:30:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf0be00640 1 -- 172.21.15.5:0/1593295252 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf000ab600 con 0x7faf0c161960 2024-08-18T22:30:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf0be00640 1 -- 172.21.15.5:0/1593295252 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf000ab9d0 con 0x7faf0c161960 2024-08-18T22:30:51.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf14600640 1 -- 172.21.15.5:0/1593295252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0c161960 msgr2=0x7faf0c06fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf14600640 1 --2- 172.21.15.5:0/1593295252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0c161960 0x7faf0c06fd20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faf000097c0 tx=0x7faf0001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf14600640 1 -- 172.21.15.5:0/1593295252 shutdown_connections 2024-08-18T22:30:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf14600640 1 --2- 172.21.15.5:0/1593295252 >> v2:172.21.15.117:3300/0 conn(0x7faf0c070730 0x7faf0c070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf14600640 1 --2- 172.21.15.5:0/1593295252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0c161960 0x7faf0c06fd20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf14600640 1 -- 172.21.15.5:0/1593295252 >> 172.21.15.5:0/1593295252 conn(0x7faf0c0d2130 msgr2=0x7faf0c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf14600640 1 -- 172.21.15.5:0/1593295252 shutdown_connections 2024-08-18T22:30:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf14600640 1 -- 172.21.15.5:0/1593295252 wait complete. 2024-08-18T22:30:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf14600640 1 Processor -- start 2024-08-18T22:30:51.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.860+0000 7faf14600640 1 -- start start 2024-08-18T22:30:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf14600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c070730 0x7faf0c0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf14600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf0c15dda0 0x7faf0c15c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf14600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0c161960 0x7faf0c158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf14600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c09ba30 con 0x7faf0c070730 2024-08-18T22:30:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf14600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c070260 con 0x7faf0c15dda0 2024-08-18T22:30:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf14600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf0c0cff60 con 0x7faf0c161960 2024-08-18T22:30:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf11c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c070730 0x7faf0c0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf11c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c070730 0x7faf0c0cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42908/0 (socket says 172.21.15.5:42908) 2024-08-18T22:30:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf11c00640 1 -- 172.21.15.5:0/3662844160 learned_addr learned my addr 172.21.15.5:0/3662844160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:51.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf12600640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0c161960 0x7faf0c158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf11200640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf0c15dda0 0x7faf0c15c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf11c00640 1 -- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0c161960 msgr2=0x7faf0c158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf11c00640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0c161960 0x7faf0c158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf11c00640 1 -- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf0c15dda0 msgr2=0x7faf0c15c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf11c00640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf0c15dda0 0x7faf0c15c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf11c00640 1 -- 172.21.15.5:0/3662844160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c0c93a0 con 0x7faf0c070730 2024-08-18T22:30:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf11c00640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c070730 0x7faf0c0cbd20 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7faf0001ab50 tx=0x7faf00019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf09600640 1 -- 172.21.15.5:0/3662844160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf000bb070 con 0x7faf0c070730 2024-08-18T22:30:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf09600640 1 -- 172.21.15.5:0/3662844160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf000b7460 con 0x7faf0c070730 2024-08-18T22:30:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf09600640 1 -- 172.21.15.5:0/3662844160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf000b0040 con 0x7faf0c070730 2024-08-18T22:30:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf14600640 1 -- 172.21.15.5:0/3662844160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c0cfc80 con 0x7faf0c070730 2024-08-18T22:30:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf14600640 1 -- 172.21.15.5:0/3662844160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c158ec0 con 0x7faf0c070730 2024-08-18T22:30:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf14600640 1 -- 172.21.15.5:0/3662844160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c070b70 con 0x7faf0c070730 2024-08-18T22:30:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.864+0000 7faf09600640 1 -- 172.21.15.5:0/3662844160 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf000be070 con 0x7faf0c070730 2024-08-18T22:30:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.868+0000 7faf09600640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faeec0678c0 0x7faeec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.868+0000 7faf09600640 1 -- 172.21.15.5:0/3662844160 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7faf00120320 con 0x7faf0c070730 2024-08-18T22:30:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.868+0000 7faf11200640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faeec0678c0 0x7faeec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.868+0000 7faf11200640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faeec0678c0 0x7faeec069d80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0cc260 tx=0x7faef8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:51.872+0000 7faf09600640 1 -- 172.21.15.5:0/3662844160 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7faf00016090 con 0x7faf0c070730 2024-08-18T22:30:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.092+0000 7faf14600640 1 -- 172.21.15.5:0/3662844160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7faf0c09bbb0 con 0x7faf0c070730 2024-08-18T22:30:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.092+0000 7faf09600640 1 -- 172.21.15.5:0/3662844160 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1231 (secure 0 0 0) 0x7faf000f0e80 con 0x7faf0c070730 2024-08-18T22:30:52.093 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:52.093 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":715,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":923,"data_bytes":944913640,"bytes_used":2288189440,"bytes_avail":770805923840,"bytes_total":773094113280,"write_bytes_sec":55690304,"read_op_per_sec":0,"write_op_per_sec":56},"fsmap":{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9525}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-08-18T22:30:11.780982+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:30:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 -- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faeec0678c0 msgr2=0x7faeec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faeec0678c0 0x7faeec069d80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0cc260 tx=0x7faef8008040 comp rx=0 tx=0).stop 2024-08-18T22:30:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 -- 172.21.15.5:0/3662844160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c070730 msgr2=0x7faf0c0cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c070730 0x7faf0c0cbd20 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7faf0001ab50 tx=0x7faf00019240 comp rx=0 tx=0).stop 2024-08-18T22:30:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 -- 172.21.15.5:0/3662844160 shutdown_connections 2024-08-18T22:30:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faeec0678c0 0x7faeec069d80 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf0c161960 0x7faf0c158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf0c15dda0 0x7faf0c15c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 --2- 172.21.15.5:0/3662844160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c070730 0x7faf0c0cbd20 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 -- 172.21.15.5:0/3662844160 >> 172.21.15.5:0/3662844160 conn(0x7faf0c0d2130 msgr2=0x7faf0c09ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 -- 172.21.15.5:0/3662844160 shutdown_connections 2024-08-18T22:30:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:52.096+0000 7faf14600640 1 -- 172.21.15.5:0/3662844160 wait complete. 2024-08-18T22:30:52.114 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-08-18T22:30:53.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.268+0000 7f8708c00640 1 Processor -- start 2024-08-18T22:30:53.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.268+0000 7f8708c00640 1 -- start start 2024-08-18T22:30:53.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.268+0000 7f8708c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f870415b010 0x7f87040ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:53.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.268+0000 7f8708c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87040cd3a0 0x7f870406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:53.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.268+0000 7f8708c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87040cee20 con 0x7f870406f0c0 2024-08-18T22:30:53.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.268+0000 7f8708c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f87040cfa30 con 0x7f870415b010 2024-08-18T22:30:53.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.268+0000 7f8708c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f87040cf100 con 0x7f87040cd3a0 2024-08-18T22:30:53.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.268+0000 7f8702800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f870406f0c0 0x7f87040caf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33550/0 (socket says 172.21.15.5:33550) 2024-08-18T22:30:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.268+0000 7f8702800640 1 -- 172.21.15.5:0/3738850799 learned_addr learned my addr 172.21.15.5:0/3738850799 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.268+0000 7f8701e00640 1 --2- 172.21.15.5:0/3738850799 >> v2:172.21.15.117:3300/0 conn(0x7f870415b010 0x7f87040ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.268+0000 7f86f9400640 1 --2- 172.21.15.5:0/3738850799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87040cd3a0 0x7f870406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8701400640 1 -- 172.21.15.5:0/3738850799 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373199489 0 0) 0x7f87040cee20 con 0x7f870406f0c0 2024-08-18T22:30:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8701400640 1 -- 172.21.15.5:0/3738850799 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86e8003530 con 0x7f870406f0c0 2024-08-18T22:30:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8701e00640 1 -- 172.21.15.5:0/3738850799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87040cd3a0 msgr2=0x7f870406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8701e00640 1 --2- 172.21.15.5:0/3738850799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87040cd3a0 0x7f870406eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8701e00640 1 -- 172.21.15.5:0/3738850799 >> v1:172.21.15.5:6789/0 conn(0x7f870406f0c0 legacy=0x7f87040caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8701e00640 1 -- 172.21.15.5:0/3738850799 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87040cf3e0 con 0x7f870415b010 2024-08-18T22:30:53.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8701e00640 1 --2- 172.21.15.5:0/3738850799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870415b010 0x7f87040ce840 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f86f40097c0 tx=0x7f86f401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=494e7b27d9b621b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:53.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8701400640 1 -- 172.21.15.5:0/3738850799 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f40b0070 con 0x7f870415b010 2024-08-18T22:30:53.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8701400640 1 -- 172.21.15.5:0/3738850799 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f40ab600 con 0x7f870415b010 2024-08-18T22:30:53.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8701400640 1 -- 172.21.15.5:0/3738850799 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f40ab9d0 con 0x7f870415b010 2024-08-18T22:30:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8708c00640 1 -- 172.21.15.5:0/3738850799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870415b010 msgr2=0x7f87040ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.272+0000 7f8708c00640 1 --2- 172.21.15.5:0/3738850799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870415b010 0x7f87040ce840 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f86f40097c0 tx=0x7f86f401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 -- 172.21.15.5:0/3738850799 shutdown_connections 2024-08-18T22:30:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 --2- 172.21.15.5:0/3738850799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87040cd3a0 0x7f870406eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 --2- 172.21.15.5:0/3738850799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870415b010 0x7f87040ce840 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 -- 172.21.15.5:0/3738850799 >> 172.21.15.5:0/3738850799 conn(0x7f87040b1c50 msgr2=0x7f87040b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 -- 172.21.15.5:0/3738850799 shutdown_connections 2024-08-18T22:30:53.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 -- 172.21.15.5:0/3738850799 wait complete. 2024-08-18T22:30:53.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 Processor -- start 2024-08-18T22:30:53.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 -- start start 2024-08-18T22:30:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870406f0c0 0x7f870414ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87040cd3a0 0x7f87040aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f870415b010 0x7f87040cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8704167dd0 con 0x7f87040cd3a0 2024-08-18T22:30:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8704167c50 con 0x7f870406f0c0 2024-08-18T22:30:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8708c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8704167f50 con 0x7f870415b010 2024-08-18T22:30:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f86f9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87040cd3a0 0x7f87040aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f86f9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87040cd3a0 0x7f87040aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42910/0 (socket says 172.21.15.5:42910) 2024-08-18T22:30:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f86f9400640 1 -- 172.21.15.5:0/2375850868 learned_addr learned my addr 172.21.15.5:0/2375850868 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8701e00640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870406f0c0 0x7f870414ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f8702800640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f870415b010 0x7f87040cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f86f9400640 1 -- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f870415b010 msgr2=0x7f87040cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f86f9400640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f870415b010 0x7f87040cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f86f9400640 1 -- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870406f0c0 msgr2=0x7f870414ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f86f9400640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870406f0c0 0x7f870414ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f86f9400640 1 -- 172.21.15.5:0/2375850868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8704150780 con 0x7f87040cd3a0 2024-08-18T22:30:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.276+0000 7f86f9400640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87040cd3a0 0x7f87040aea80 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00e900 tx=0x7f86ec00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.280+0000 7f86faa00640 1 -- 172.21.15.5:0/2375850868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec017070 con 0x7f87040cd3a0 2024-08-18T22:30:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.280+0000 7f86faa00640 1 -- 172.21.15.5:0/2375850868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ec00ca00 con 0x7f87040cd3a0 2024-08-18T22:30:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.280+0000 7f86faa00640 1 -- 172.21.15.5:0/2375850868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00cdd0 con 0x7f87040cd3a0 2024-08-18T22:30:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.280+0000 7f8708c00640 1 -- 172.21.15.5:0/2375850868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8704150a60 con 0x7f87040cd3a0 2024-08-18T22:30:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.280+0000 7f8708c00640 1 -- 172.21.15.5:0/2375850868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8704151020 con 0x7f87040cd3a0 2024-08-18T22:30:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.280+0000 7f8708c00640 1 -- 172.21.15.5:0/2375850868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870406eb80 con 0x7f87040cd3a0 2024-08-18T22:30:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.280+0000 7f86faa00640 1 -- 172.21.15.5:0/2375850868 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86ec01a070 con 0x7f87040cd3a0 2024-08-18T22:30:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.280+0000 7f86faa00640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e00678c0 0x7f86e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.280+0000 7f86faa00640 1 -- 172.21.15.5:0/2375850868 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f86ec0861f0 con 0x7f87040cd3a0 2024-08-18T22:30:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.280+0000 7f8701e00640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e00678c0 0x7f86e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.284+0000 7f8701e00640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e00678c0 0x7f86e0069d80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f86f40ad000 tx=0x7f86f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:53.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.284+0000 7f86faa00640 1 -- 172.21.15.5:0/2375850868 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f86ec0564b0 con 0x7f87040cd3a0 2024-08-18T22:30:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 -- 172.21.15.5:0/2375850868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87040cb0c0 con 0x7f87040cd3a0 2024-08-18T22:30:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f86faa00640 1 -- 172.21.15.5:0/2375850868 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f86ec05a7b0 con 0x7f87040cd3a0 2024-08-18T22:30:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:53.484 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:30:53.484 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:30:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 -- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e00678c0 msgr2=0x7f86e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e00678c0 0x7f86e0069d80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f86f40ad000 tx=0x7f86f4008040 comp rx=0 tx=0).stop 2024-08-18T22:30:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 -- 172.21.15.5:0/2375850868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87040cd3a0 msgr2=0x7f87040aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87040cd3a0 0x7f87040aea80 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00e900 tx=0x7f86ec00edc0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 -- 172.21.15.5:0/2375850868 shutdown_connections 2024-08-18T22:30:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f86e00678c0 0x7f86e0069d80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f870415b010 0x7f87040cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87040cd3a0 0x7f87040aea80 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 --2- 172.21.15.5:0/2375850868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f870406f0c0 0x7f870414ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 -- 172.21.15.5:0/2375850868 >> 172.21.15.5:0/2375850868 conn(0x7f87040b1c50 msgr2=0x7f8704152a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 -- 172.21.15.5:0/2375850868 shutdown_connections 2024-08-18T22:30:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.484+0000 7f8708c00640 1 -- 172.21.15.5:0/2375850868 wait complete. 2024-08-18T22:30:53.504 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:30:53.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:30:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa7400640 1 Processor -- start 2024-08-18T22:30:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa7400640 1 -- start start 2024-08-18T22:30:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0fa0164ea0 0x7f0fa0167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa7400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa00b0bd0 con 0x7f0fa006b9b0 2024-08-18T22:30:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa7400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa00b0e90 con 0x7f0fa00ce520 2024-08-18T22:30:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa7400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa00b1170 con 0x7f0fa0164ea0 2024-08-18T22:30:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa4a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0fa006b9b0 0x7f0fa006bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33490/0 (socket says 172.21.15.5:33490) 2024-08-18T22:30:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa4a00640 1 -- 172.21.15.5:0/3320373912 learned_addr learned my addr 172.21.15.5:0/3320373912 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa5400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0fa0164ea0 0x7f0fa0167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa5400640 1 -- 172.21.15.5:0/3320373912 >> v1:172.21.15.117:6789/0 conn(0x7f0fa00ce520 legacy=0x7f0fa01453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa5400640 1 -- 172.21.15.5:0/3320373912 >> v1:172.21.15.5:6789/0 conn(0x7f0fa006b9b0 legacy=0x7f0fa006bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.644+0000 7f0fa5400640 1 -- 172.21.15.5:0/3320373912 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa00b1450 con 0x7f0fa0164ea0 2024-08-18T22:30:53.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.648+0000 7f0fa5400640 1 --2- 172.21.15.5:0/3320373912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0164ea0 0x7f0fa0167290 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009d90 tx=0x7f0f9801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7107244853a352a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.648+0000 7f0f9f400640 1 -- 172.21.15.5:0/3320373912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f980b2070 con 0x7f0fa0164ea0 2024-08-18T22:30:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.648+0000 7f0f9f400640 1 -- 172.21.15.5:0/3320373912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f980a5940 con 0x7f0fa0164ea0 2024-08-18T22:30:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.648+0000 7f0f9f400640 1 -- 172.21.15.5:0/3320373912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f980a5d10 con 0x7f0fa0164ea0 2024-08-18T22:30:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.648+0000 7f0fa7400640 1 -- 172.21.15.5:0/3320373912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0164ea0 msgr2=0x7f0fa0167290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.648+0000 7f0fa7400640 1 --2- 172.21.15.5:0/3320373912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0164ea0 0x7f0fa0167290 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009d90 tx=0x7f0f9801c970 comp rx=0 tx=0).stop 2024-08-18T22:30:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.648+0000 7f0fa7400640 1 -- 172.21.15.5:0/3320373912 shutdown_connections 2024-08-18T22:30:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.648+0000 7f0fa7400640 1 --2- 172.21.15.5:0/3320373912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0164ea0 0x7f0fa0167290 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.648+0000 7f0fa7400640 1 -- 172.21.15.5:0/3320373912 >> 172.21.15.5:0/3320373912 conn(0x7f0fa009aa40 msgr2=0x7f0fa00b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.648+0000 7f0fa7400640 1 -- 172.21.15.5:0/3320373912 shutdown_connections 2024-08-18T22:30:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.648+0000 7f0fa7400640 1 -- 172.21.15.5:0/3320373912 wait complete. 2024-08-18T22:30:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa7400640 1 Processor -- start 2024-08-18T22:30:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa7400640 1 -- start start 2024-08-18T22:30:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa7400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa006b9b0 0x7f0fa00aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fa00ce520 0x7f0fa015af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0164ea0 0x7f0fa00ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa7400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa016a170 con 0x7f0fa0164ea0 2024-08-18T22:30:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa7400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa0169ff0 con 0x7f0fa006b9b0 2024-08-18T22:30:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa7400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa016a2f0 con 0x7f0fa00ce520 2024-08-18T22:30:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0164ea0 0x7f0fa00ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0164ea0 0x7f0fa00ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37248/0 (socket says 172.21.15.5:37248) 2024-08-18T22:30:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa4a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa006b9b0 0x7f0fa00aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa5400640 1 -- 172.21.15.5:0/442687868 learned_addr learned my addr 172.21.15.5:0/442687868 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:53.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0f9fe00640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fa00ce520 0x7f0fa015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa5400640 1 -- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fa00ce520 msgr2=0x7f0fa015af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa5400640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fa00ce520 0x7f0fa015af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa5400640 1 -- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa006b9b0 msgr2=0x7f0fa00aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa5400640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa006b9b0 0x7f0fa00aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa5400640 1 -- 172.21.15.5:0/442687868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa015b490 con 0x7f0fa0164ea0 2024-08-18T22:30:53.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa5400640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0164ea0 0x7f0fa00ca450 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f0f980b0040 tx=0x7f0f98019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0f9cc00640 1 -- 172.21.15.5:0/442687868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f980b2050 con 0x7f0fa0164ea0 2024-08-18T22:30:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0f9cc00640 1 -- 172.21.15.5:0/442687868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f980be070 con 0x7f0fa0164ea0 2024-08-18T22:30:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0f9cc00640 1 -- 172.21.15.5:0/442687868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f980adaf0 con 0x7f0fa0164ea0 2024-08-18T22:30:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa7400640 1 -- 172.21.15.5:0/442687868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa013d5c0 con 0x7f0fa0164ea0 2024-08-18T22:30:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa7400640 1 -- 172.21.15.5:0/442687868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa013d860 con 0x7f0fa0164ea0 2024-08-18T22:30:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.652+0000 7f0fa7400640 1 -- 172.21.15.5:0/442687868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa006bd90 con 0x7f0fa0164ea0 2024-08-18T22:30:53.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.656+0000 7f0f9cc00640 1 -- 172.21.15.5:0/442687868 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f980adc90 con 0x7f0fa0164ea0 2024-08-18T22:30:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.656+0000 7f0f9cc00640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f800678c0 0x7f0f80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.656+0000 7f0f9cc00640 1 -- 172.21.15.5:0/442687868 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f0f98120f50 con 0x7f0fa0164ea0 2024-08-18T22:30:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.656+0000 7f0fa4a00640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f800678c0 0x7f0f80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.656+0000 7f0fa4a00640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f800678c0 0x7f0f80069d80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0f90005890 tx=0x7f0f90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.664+0000 7f0f9cc00640 1 -- 172.21.15.5:0/442687868 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0f98016560 con 0x7f0fa0164ea0 2024-08-18T22:30:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.884+0000 7f0fa7400640 1 -- 172.21.15.5:0/442687868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0fa013ecd0 con 0x7f0fa0164ea0 2024-08-18T22:30:53.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:30:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0f9cc00640 1 -- 172.21.15.5:0/442687868 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1232 (secure 0 0 0) 0x7f0f980f1220 con 0x7f0fa0164ea0 2024-08-18T22:30:53.887 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:53.887 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":717,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":978,"data_bytes":1002585320,"bytes_used":2423455744,"bytes_avail":770670657536,"bytes_total":773094113280,"write_bytes_sec":44813909,"read_op_per_sec":0,"write_op_per_sec":44},"fsmap":{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9525}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-08-18T22:30:11.780982+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:30:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 -- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f800678c0 msgr2=0x7f0f80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f800678c0 0x7f0f80069d80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0f90005890 tx=0x7f0f90009040 comp rx=0 tx=0).stop 2024-08-18T22:30:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 -- 172.21.15.5:0/442687868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0164ea0 msgr2=0x7f0fa00ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0164ea0 0x7f0fa00ca450 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f0f980b0040 tx=0x7f0f98019710 comp rx=0 tx=0).stop 2024-08-18T22:30:53.890 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:30:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 -- 172.21.15.5:0/442687868 shutdown_connections 2024-08-18T22:30:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0f800678c0 0x7f0f80069d80 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa0164ea0 0x7f0fa00ca450 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fa00ce520 0x7f0fa015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 --2- 172.21.15.5:0/442687868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa006b9b0 0x7f0fa00aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 -- 172.21.15.5:0/442687868 >> 172.21.15.5:0/442687868 conn(0x7f0fa009aa40 msgr2=0x7f0fa00b1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 -- 172.21.15.5:0/442687868 shutdown_connections 2024-08-18T22:30:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:53.888+0000 7f0fa7400640 1 -- 172.21.15.5:0/442687868 wait complete. 2024-08-18T22:30:53.908 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-08-18T22:30:54.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:55.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.060+0000 7fe569000640 1 Processor -- start 2024-08-18T22:30:55.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.060+0000 7fe569000640 1 -- start start 2024-08-18T22:30:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.060+0000 7fe569000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe564161540 0x7fe56415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.060+0000 7fe569000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe56406f950 con 0x7fe56406f100 2024-08-18T22:30:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe569000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe56406f670 con 0x7fe56415e7a0 2024-08-18T22:30:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe569000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe5641600a0 con 0x7fe564161540 2024-08-18T22:30:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe562800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe56406f100 0x7fe56415f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33500/0 (socket says 172.21.15.5:33500) 2024-08-18T22:30:55.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe562800640 1 -- 172.21.15.5:0/258843028 learned_addr learned my addr 172.21.15.5:0/258843028 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:55.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe559400640 1 --2- 172.21.15.5:0/258843028 >> v2:172.21.15.117:3300/0 conn(0x7fe564161540 0x7fe56415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4173444981 0 0) 0x7fe56406f950 con 0x7fe56406f100 2024-08-18T22:30:55.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe548003530 con 0x7fe56406f100 2024-08-18T22:30:55.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3018899272 0 0) 0x7fe56406f670 con 0x7fe56415e7a0 2024-08-18T22:30:55.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe56406f950 con 0x7fe56415e7a0 2024-08-18T22:30:55.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4280962695 0 0) 0x7fe548003530 con 0x7fe56406f100 2024-08-18T22:30:55.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 >> v2:172.21.15.117:3300/0 conn(0x7fe564161540 msgr2=0x7fe56415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 --2- 172.21.15.5:0/258843028 >> v2:172.21.15.117:3300/0 conn(0x7fe564161540 0x7fe56415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 >> v1:172.21.15.117:6789/0 conn(0x7fe56415e7a0 legacy=0x7fe56406e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56415fa50 con 0x7fe56406f100 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fe55c001a00 con 0x7fe56406f100 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe559400640 1 --2- 172.21.15.5:0/258843028 >> v2:172.21.15.117:3300/0 conn(0x7fe564161540 0x7fe56415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 >> v1:172.21.15.5:6789/0 conn(0x7fe56406f100 legacy=0x7fe56415f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 --2- 172.21.15.5:0/258843028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe548003b50 0x7fe548003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 --2- 172.21.15.5:0/258843028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe548004810 0x7fe548004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 --2- 172.21.15.5:0/258843028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5480051d0 0x7fe54800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5641600a0 con 0x7fe5480051d0 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe54800c070 con 0x7fe548004810 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe54800c270 con 0x7fe548003b50 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe562800640 1 --2- 172.21.15.5:0/258843028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5480051d0 0x7fe54800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe559400640 1 --2- 172.21.15.5:0/258843028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe548004810 0x7fe548004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe561e00640 1 --2- 172.21.15.5:0/258843028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe548003b50 0x7fe548003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe562800640 1 -- 172.21.15.5:0/258843028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe548003b50 msgr2=0x7fe548003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe562800640 1 --2- 172.21.15.5:0/258843028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe548003b50 0x7fe548003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe562800640 1 -- 172.21.15.5:0/258843028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe548004810 msgr2=0x7fe548004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe562800640 1 --2- 172.21.15.5:0/258843028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe548004810 0x7fe548004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.064+0000 7fe562800640 1 -- 172.21.15.5:0/258843028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe548003530 con 0x7fe5480051d0 2024-08-18T22:30:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe562800640 1 -- 172.21.15.5:0/258843028 reap_dead start 2024-08-18T22:30:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe562800640 1 --2- 172.21.15.5:0/258843028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5480051d0 0x7fe54800b9d0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fe56415f7d0 tx=0x7fe55c01fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb122c90c0129687 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00a410 con 0x7fe5480051d0 2024-08-18T22:30:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55c0aa690 con 0x7fe5480051d0 2024-08-18T22:30:55.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe561400640 1 -- 172.21.15.5:0/258843028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0aaa80 con 0x7fe5480051d0 2024-08-18T22:30:55.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe569000640 1 -- 172.21.15.5:0/258843028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5480051d0 msgr2=0x7fe54800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe569000640 1 --2- 172.21.15.5:0/258843028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5480051d0 0x7fe54800b9d0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fe56415f7d0 tx=0x7fe55c01fa20 comp rx=0 tx=0).stop 2024-08-18T22:30:55.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe569000640 1 -- 172.21.15.5:0/258843028 shutdown_connections 2024-08-18T22:30:55.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe569000640 1 --2- 172.21.15.5:0/258843028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5480051d0 0x7fe54800b9d0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe569000640 1 -- 172.21.15.5:0/258843028 >> 172.21.15.5:0/258843028 conn(0x7fe564070190 msgr2=0x7fe56406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:55.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe569000640 1 -- 172.21.15.5:0/258843028 shutdown_connections 2024-08-18T22:30:55.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe569000640 1 -- 172.21.15.5:0/258843028 wait complete. 2024-08-18T22:30:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe569000640 1 Processor -- start 2024-08-18T22:30:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.068+0000 7fe569000640 1 -- start start 2024-08-18T22:30:55.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe569000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5480051d0 0x7fe564152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe569000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe56414c240 0x7fe5640cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe569000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe564160380 0x7fe564160830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe569000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe56406eb70 con 0x7fe564160380 2024-08-18T22:30:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe569000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe56406e9f0 con 0x7fe56414c240 2024-08-18T22:30:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe569000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe56406ecf0 con 0x7fe5480051d0 2024-08-18T22:30:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe562800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe564160380 0x7fe564160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe562800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe564160380 0x7fe564160830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37254/0 (socket says 172.21.15.5:37254) 2024-08-18T22:30:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe562800640 1 -- 172.21.15.5:0/125987216 learned_addr learned my addr 172.21.15.5:0/125987216 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe561e00640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5480051d0 0x7fe564152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe559400640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe56414c240 0x7fe5640cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe562800640 1 -- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5480051d0 msgr2=0x7fe564152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe562800640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5480051d0 0x7fe564152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe562800640 1 -- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe56414c240 msgr2=0x7fe5640cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe562800640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe56414c240 0x7fe5640cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe562800640 1 -- 172.21.15.5:0/125987216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe564152e50 con 0x7fe564160380 2024-08-18T22:30:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe559400640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe56414c240 0x7fe5640cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe562800640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe564160380 0x7fe564160830 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0202c0 tx=0x7fe548005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe55aa00640 1 -- 172.21.15.5:0/125987216 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00a3f0 con 0x7fe564160380 2024-08-18T22:30:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe55aa00640 1 -- 172.21.15.5:0/125987216 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55c0aa450 con 0x7fe564160380 2024-08-18T22:30:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe55aa00640 1 -- 172.21.15.5:0/125987216 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0aaa60 con 0x7fe564160380 2024-08-18T22:30:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe569000640 1 -- 172.21.15.5:0/125987216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe564153130 con 0x7fe564160380 2024-08-18T22:30:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe569000640 1 -- 172.21.15.5:0/125987216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5641536f0 con 0x7fe564160380 2024-08-18T22:30:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.072+0000 7fe569000640 1 -- 172.21.15.5:0/125987216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe56414c620 con 0x7fe564160380 2024-08-18T22:30:55.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.076+0000 7fe55aa00640 1 -- 172.21.15.5:0/125987216 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe55c0bb030 con 0x7fe564160380 2024-08-18T22:30:55.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.076+0000 7fe55aa00640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5400678f0 0x7fe540069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.076+0000 7fe55aa00640 1 -- 172.21.15.5:0/125987216 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fe55c122bb0 con 0x7fe564160380 2024-08-18T22:30:55.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.076+0000 7fe561e00640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5400678f0 0x7fe540069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.076+0000 7fe561e00640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5400678f0 0x7fe540069db0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe5640cce10 tx=0x7fe554009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:55.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.080+0000 7fe55aa00640 1 -- 172.21.15.5:0/125987216 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe55c0c2060 con 0x7fe564160380 2024-08-18T22:30:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.276+0000 7fe569000640 1 -- 172.21.15.5:0/125987216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe56406f5d0 con 0x7fe564160380 2024-08-18T22:30:55.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.276+0000 7fe55aa00640 1 -- 172.21.15.5:0/125987216 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7fe55c019730 con 0x7fe564160380 2024-08-18T22:30:55.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:55.276 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:30:55.276 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:30:55.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 -- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5400678f0 msgr2=0x7fe540069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5400678f0 0x7fe540069db0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe5640cce10 tx=0x7fe554009040 comp rx=0 tx=0).stop 2024-08-18T22:30:55.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 -- 172.21.15.5:0/125987216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe564160380 msgr2=0x7fe564160830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe564160380 0x7fe564160830 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0202c0 tx=0x7fe548005840 comp rx=0 tx=0).stop 2024-08-18T22:30:55.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 -- 172.21.15.5:0/125987216 shutdown_connections 2024-08-18T22:30:55.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe5400678f0 0x7fe540069db0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe564160380 0x7fe564160830 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe56414c240 0x7fe5640cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 --2- 172.21.15.5:0/125987216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5480051d0 0x7fe564152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 -- 172.21.15.5:0/125987216 >> 172.21.15.5:0/125987216 conn(0x7fe564070190 msgr2=0x7fe5640b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:55.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 -- 172.21.15.5:0/125987216 shutdown_connections 2024-08-18T22:30:55.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.280+0000 7fe569000640 1 -- 172.21.15.5:0/125987216 wait complete. 2024-08-18T22:30:55.297 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:30:55.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:30:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.436+0000 7f039d800640 1 Processor -- start 2024-08-18T22:30:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.436+0000 7f039d800640 1 -- start start 2024-08-18T22:30:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.436+0000 7f039d800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 0x7f039806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.436+0000 7f039d800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0398070730 0x7f0398070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.436+0000 7f039d800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f039815eb60 con 0x7f039815dda0 2024-08-18T22:30:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.436+0000 7f039d800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f039815fcc0 con 0x7f0398070730 2024-08-18T22:30:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.436+0000 7f039d800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03980710b0 con 0x7f0398161960 2024-08-18T22:30:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 0x7f039806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f038e000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0398070730 0x7f0398070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 0x7f039806fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:53748/0 (socket says 172.21.15.5:53748) 2024-08-18T22:30:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396a00640 1 -- 172.21.15.5:0/2063581339 learned_addr learned my addr 172.21.15.5:0/2063581339 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396a00640 1 -- 172.21.15.5:0/2063581339 >> v2:172.21.15.117:3300/0 conn(0x7f0398070730 msgr2=0x7f0398070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396a00640 1 --2- 172.21.15.5:0/2063581339 >> v2:172.21.15.117:3300/0 conn(0x7f0398070730 0x7f0398070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396a00640 1 -- 172.21.15.5:0/2063581339 >> v1:172.21.15.117:6789/0 conn(0x7f039815dda0 legacy=0x7f039815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396a00640 1 -- 172.21.15.5:0/2063581339 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f039815ee40 con 0x7f0398161960 2024-08-18T22:30:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396000640 1 -- 172.21.15.5:0/2063581339 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1276415668 0 0) 0x7f039815eb60 con 0x7f039815dda0 2024-08-18T22:30:55.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396a00640 1 --2- 172.21.15.5:0/2063581339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 0x7f039806fd20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0388009870 tx=0x7f038801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f300c36f223e167b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:55.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396000640 1 -- 172.21.15.5:0/2063581339 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880b2070 con 0x7f0398161960 2024-08-18T22:30:55.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396000640 1 -- 172.21.15.5:0/2063581339 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03880a9070 con 0x7f0398161960 2024-08-18T22:30:55.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.440+0000 7f0396000640 1 -- 172.21.15.5:0/2063581339 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880ad880 con 0x7f0398161960 2024-08-18T22:30:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 -- 172.21.15.5:0/2063581339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 msgr2=0x7f039806fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 --2- 172.21.15.5:0/2063581339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 0x7f039806fd20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0388009870 tx=0x7f038801c560 comp rx=0 tx=0).stop 2024-08-18T22:30:55.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 -- 172.21.15.5:0/2063581339 shutdown_connections 2024-08-18T22:30:55.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 --2- 172.21.15.5:0/2063581339 >> v2:172.21.15.117:3300/0 conn(0x7f0398070730 0x7f0398070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 --2- 172.21.15.5:0/2063581339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 0x7f039806fd20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 -- 172.21.15.5:0/2063581339 >> 172.21.15.5:0/2063581339 conn(0x7f03980d2130 msgr2=0x7f03980d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:55.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 -- 172.21.15.5:0/2063581339 shutdown_connections 2024-08-18T22:30:55.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 -- 172.21.15.5:0/2063581339 wait complete. 2024-08-18T22:30:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 Processor -- start 2024-08-18T22:30:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 -- start start 2024-08-18T22:30:55.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0398070730 0x7f03980b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f039815dda0 0x7f0398159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 0x7f039815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f039809ba30 con 0x7f0398070730 2024-08-18T22:30:55.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0398070260 con 0x7f039815dda0 2024-08-18T22:30:55.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f039d800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03980b5340 con 0x7f0398161960 2024-08-18T22:30:55.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f0396a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0398070730 0x7f03980b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f0396a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0398070730 0x7f03980b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37258/0 (socket says 172.21.15.5:37258) 2024-08-18T22:30:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f0396a00640 1 -- 172.21.15.5:0/4204196669 learned_addr learned my addr 172.21.15.5:0/4204196669 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f038e000640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f039815dda0 0x7f0398159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f0397400640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 0x7f039815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f0396a00640 1 -- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 msgr2=0x7f039815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f0396a00640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 0x7f039815a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f0396a00640 1 -- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f039815dda0 msgr2=0x7f0398159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f0396a00640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f039815dda0 0x7f0398159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f0396a00640 1 -- 172.21.15.5:0/4204196669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03980b5620 con 0x7f0398070730 2024-08-18T22:30:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.444+0000 7f038e000640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f039815dda0 0x7f0398159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.448+0000 7f0396a00640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0398070730 0x7f03980b75b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f03880b0040 tx=0x7f0388019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.448+0000 7f038f400640 1 -- 172.21.15.5:0/4204196669 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880b2050 con 0x7f0398070730 2024-08-18T22:30:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.448+0000 7f038f400640 1 -- 172.21.15.5:0/4204196669 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03880be070 con 0x7f0398070730 2024-08-18T22:30:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.448+0000 7f039d800640 1 -- 172.21.15.5:0/4204196669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03980b5900 con 0x7f0398070730 2024-08-18T22:30:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.448+0000 7f038f400640 1 -- 172.21.15.5:0/4204196669 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880b9690 con 0x7f0398070730 2024-08-18T22:30:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.448+0000 7f039d800640 1 -- 172.21.15.5:0/4204196669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03980b4f80 con 0x7f0398070730 2024-08-18T22:30:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.448+0000 7f039d800640 1 -- 172.21.15.5:0/4204196669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f039815eb60 con 0x7f0398070730 2024-08-18T22:30:55.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.448+0000 7f038f400640 1 -- 172.21.15.5:0/4204196669 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f03880ab070 con 0x7f0398070730 2024-08-18T22:30:55.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.448+0000 7f038f400640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03740678c0 0x7f0374069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:55.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.448+0000 7f038f400640 1 -- 172.21.15.5:0/4204196669 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f0388120280 con 0x7f0398070730 2024-08-18T22:30:55.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.448+0000 7f038e000640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03740678c0 0x7f0374069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:55.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.452+0000 7f038e000640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03740678c0 0x7f0374069d80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f03981fa8b0 tx=0x7f0380009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.452+0000 7f038f400640 1 -- 172.21.15.5:0/4204196669 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0388016150 con 0x7f0398070730 2024-08-18T22:30:55.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.676+0000 7f039d800640 1 -- 172.21.15.5:0/4204196669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f03980b5db0 con 0x7f0398070730 2024-08-18T22:30:55.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.676+0000 7f038f400640 1 -- 172.21.15.5:0/4204196669 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1233 (secure 0 0 0) 0x7f03880f0540 con 0x7f0398070730 2024-08-18T22:30:55.678 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:55.678 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":719,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076443502,"bytes_used":2588999680,"bytes_avail":770505113600,"bytes_total":773094113280,"write_bytes_sec":47126370,"read_op_per_sec":0,"write_op_per_sec":47},"fsmap":{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9525}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-08-18T22:30:11.780982+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:30:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 -- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03740678c0 msgr2=0x7f0374069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03740678c0 0x7f0374069d80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f03981fa8b0 tx=0x7f0380009190 comp rx=0 tx=0).stop 2024-08-18T22:30:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 -- 172.21.15.5:0/4204196669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0398070730 msgr2=0x7f03980b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0398070730 0x7f03980b75b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f03880b0040 tx=0x7f0388019300 comp rx=0 tx=0).stop 2024-08-18T22:30:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 -- 172.21.15.5:0/4204196669 shutdown_connections 2024-08-18T22:30:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03740678c0 0x7f0374069d80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0398161960 0x7f039815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f039815dda0 0x7f0398159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 --2- 172.21.15.5:0/4204196669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0398070730 0x7f03980b75b0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 -- 172.21.15.5:0/4204196669 >> 172.21.15.5:0/4204196669 conn(0x7f03980d2130 msgr2=0x7f0398169540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:55.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 -- 172.21.15.5:0/4204196669 shutdown_connections 2024-08-18T22:30:55.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:55.680+0000 7f039d800640 1 -- 172.21.15.5:0/4204196669 wait complete. 2024-08-18T22:30:55.700 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-08-18T22:30:56.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd6a600640 1 Processor -- start 2024-08-18T22:30:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd6a600640 1 -- start start 2024-08-18T22:30:56.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd6a600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd640adc50 0x7fbd6415f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:56.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd6a600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd64072f80 con 0x7fbd6415bb20 2024-08-18T22:30:56.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd6a600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6415bf00 con 0x7fbd6406d0d0 2024-08-18T22:30:56.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd6a600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbd640ae1a0 con 0x7fbd640adc50 2024-08-18T22:30:56.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd69200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbd6415bb20 0x7fbd6406c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33510/0 (socket says 172.21.15.5:33510) 2024-08-18T22:30:56.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd69200640 1 -- 172.21.15.5:0/3923160731 learned_addr learned my addr 172.21.15.5:0/3923160731 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:56.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd69c00640 1 --2- 172.21.15.5:0/3923160731 >> v2:172.21.15.117:3300/0 conn(0x7fbd640adc50 0x7fbd6415f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:56.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3867192594 0 0) 0x7fbd54001120 con 0x7fbd6415bb20 2024-08-18T22:30:56.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd48003530 con 0x7fbd6415bb20 2024-08-18T22:30:56.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1828617713 0 0) 0x7fbd48003530 con 0x7fbd6415bb20 2024-08-18T22:30:56.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 >> v2:172.21.15.117:3300/0 conn(0x7fbd640adc50 msgr2=0x7fbd6415f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:56.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 --2- 172.21.15.5:0/3923160731 >> v2:172.21.15.117:3300/0 conn(0x7fbd640adc50 0x7fbd6415f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:56.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 >> v1:172.21.15.117:6789/0 conn(0x7fbd6406d0d0 legacy=0x7fbd640b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:56.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd640ae480 con 0x7fbd6415bb20 2024-08-18T22:30:56.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fbd54001850 con 0x7fbd6415bb20 2024-08-18T22:30:56.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 >> v1:172.21.15.5:6789/0 conn(0x7fbd6415bb20 legacy=0x7fbd6406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:56.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 --2- 172.21.15.5:0/3923160731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd48003a10 0x7fbd48003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 --2- 172.21.15.5:0/3923160731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48004810 0x7fbd48004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 --2- 172.21.15.5:0/3923160731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 0x7fbd4800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbd640ae1a0 con 0x7fbd480051d0 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4800c0b0 con 0x7fbd48003a10 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbd4800c2b0 con 0x7fbd48004810 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd69c00640 1 --2- 172.21.15.5:0/3923160731 >> v2:172.21.15.117:3300/0 conn(0x7fbd640adc50 0x7fbd6415f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd69c00640 1 --2- 172.21.15.5:0/3923160731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 0x7fbd4800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd69200640 1 --2- 172.21.15.5:0/3923160731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd48003a10 0x7fbd48003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd5be00640 1 --2- 172.21.15.5:0/3923160731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48004810 0x7fbd48004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd69c00640 1 -- 172.21.15.5:0/3923160731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48004810 msgr2=0x7fbd48004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd69c00640 1 --2- 172.21.15.5:0/3923160731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd48004810 0x7fbd48004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd69c00640 1 -- 172.21.15.5:0/3923160731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd48003a10 msgr2=0x7fbd48003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:56.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd69c00640 1 --2- 172.21.15.5:0/3923160731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd48003a10 0x7fbd48003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:56.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.856+0000 7fbd69c00640 1 -- 172.21.15.5:0/3923160731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd48003530 con 0x7fbd480051d0 2024-08-18T22:30:56.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd69c00640 1 -- 172.21.15.5:0/3923160731 reap_dead start 2024-08-18T22:30:56.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd69c00640 1 --2- 172.21.15.5:0/3923160731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 0x7fbd4800b9d0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00e350 tx=0x7fbd5c01ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3b697a6629f056 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:56.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c009dc0 con 0x7fbd480051d0 2024-08-18T22:30:56.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5c0039a0 con 0x7fbd480051d0 2024-08-18T22:30:56.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd63e00640 1 -- 172.21.15.5:0/3923160731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c003d90 con 0x7fbd480051d0 2024-08-18T22:30:56.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd6a600640 1 -- 172.21.15.5:0/3923160731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 msgr2=0x7fbd4800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:56.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd6a600640 1 --2- 172.21.15.5:0/3923160731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 0x7fbd4800b9d0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00e350 tx=0x7fbd5c01ce60 comp rx=0 tx=0).stop 2024-08-18T22:30:56.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd6a600640 1 -- 172.21.15.5:0/3923160731 shutdown_connections 2024-08-18T22:30:56.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd6a600640 1 --2- 172.21.15.5:0/3923160731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 0x7fbd4800b9d0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:56.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd6a600640 1 -- 172.21.15.5:0/3923160731 >> 172.21.15.5:0/3923160731 conn(0x7fbd64072130 msgr2=0x7fbd64072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:56.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd6a600640 1 -- 172.21.15.5:0/3923160731 shutdown_connections 2024-08-18T22:30:56.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.860+0000 7fbd6a600640 1 -- 172.21.15.5:0/3923160731 wait complete. 2024-08-18T22:30:56.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd6a600640 1 Processor -- start 2024-08-18T22:30:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd6a600640 1 -- start start 2024-08-18T22:30:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd6a600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 0x7fbd6415ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd6a600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd64154400 0x7fbd64161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:56.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd6a600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6415d630 0x7fbd6415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:56.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd6a600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbd640aed20 con 0x7fbd480051d0 2024-08-18T22:30:56.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd6a600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbd640aea40 con 0x7fbd6415d630 2024-08-18T22:30:56.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd6a600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6415f000 con 0x7fbd64154400 2024-08-18T22:30:56.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd69200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 0x7fbd6415ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:56.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd69200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 0x7fbd6415ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37278/0 (socket says 172.21.15.5:37278) 2024-08-18T22:30:56.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd69200640 1 -- 172.21.15.5:0/1795462230 learned_addr learned my addr 172.21.15.5:0/1795462230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:56.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd5be00640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd64154400 0x7fbd64161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd69c00640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6415d630 0x7fbd6415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd69200640 1 -- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd64154400 msgr2=0x7fbd64161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd69200640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd64154400 0x7fbd64161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd69200640 1 -- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6415d630 msgr2=0x7fbd6415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd69200640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6415d630 0x7fbd6415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd69200640 1 -- 172.21.15.5:0/1795462230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd64161960 con 0x7fbd480051d0 2024-08-18T22:30:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd5be00640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd64154400 0x7fbd64161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd69200640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 0x7fbd6415ffb0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fbd54004f80 tx=0x7fbd540074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd61600640 1 -- 172.21.15.5:0/1795462230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400f7b0 con 0x7fbd480051d0 2024-08-18T22:30:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd61600640 1 -- 172.21.15.5:0/1795462230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd54018070 con 0x7fbd480051d0 2024-08-18T22:30:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd6a600640 1 -- 172.21.15.5:0/1795462230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd64160990 con 0x7fbd480051d0 2024-08-18T22:30:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd61600640 1 -- 172.21.15.5:0/1795462230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400fbb0 con 0x7fbd480051d0 2024-08-18T22:30:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.864+0000 7fbd6a600640 1 -- 172.21.15.5:0/1795462230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd640cd410 con 0x7fbd480051d0 2024-08-18T22:30:56.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.868+0000 7fbd6a600640 1 -- 172.21.15.5:0/1795462230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6415f390 con 0x7fbd480051d0 2024-08-18T22:30:56.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.868+0000 7fbd61600640 1 -- 172.21.15.5:0/1795462230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbd5401d460 con 0x7fbd480051d0 2024-08-18T22:30:56.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.868+0000 7fbd61600640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd400678f0 0x7fbd40069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:56.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.868+0000 7fbd61600640 1 -- 172.21.15.5:0/1795462230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fbd54085ff0 con 0x7fbd480051d0 2024-08-18T22:30:56.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.868+0000 7fbd5be00640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd400678f0 0x7fbd40069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:56.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.868+0000 7fbd5be00640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd400678f0 0x7fbd40069db0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbd6415e450 tx=0x7fbd4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:56.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:56.872+0000 7fbd61600640 1 -- 172.21.15.5:0/1795462230 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbd64072f80 con 0x7fbd480051d0 2024-08-18T22:30:57.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.072+0000 7fbd6a600640 1 -- 172.21.15.5:0/1795462230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd6415a110 con 0x7fbd480051d0 2024-08-18T22:30:57.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.072+0000 7fbd61600640 1 -- 172.21.15.5:0/1795462230 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7fbd54056940 con 0x7fbd480051d0 2024-08-18T22:30:57.073 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:57.073 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:30:57.073 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:30:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 -- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd400678f0 msgr2=0x7fbd40069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd400678f0 0x7fbd40069db0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbd6415e450 tx=0x7fbd4c009040 comp rx=0 tx=0).stop 2024-08-18T22:30:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 -- 172.21.15.5:0/1795462230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 msgr2=0x7fbd6415ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 0x7fbd6415ffb0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fbd54004f80 tx=0x7fbd540074f0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 -- 172.21.15.5:0/1795462230 shutdown_connections 2024-08-18T22:30:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd400678f0 0x7fbd40069db0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6415d630 0x7fbd6415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd64154400 0x7fbd64161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 --2- 172.21.15.5:0/1795462230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd480051d0 0x7fbd6415ffb0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 -- 172.21.15.5:0/1795462230 >> 172.21.15.5:0/1795462230 conn(0x7fbd64072130 msgr2=0x7fbd64072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 -- 172.21.15.5:0/1795462230 shutdown_connections 2024-08-18T22:30:57.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.076+0000 7fbd6a600640 1 -- 172.21.15.5:0/1795462230 wait complete. 2024-08-18T22:30:57.094 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:30:57.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:30:57.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.232+0000 7fc0ee600640 1 Processor -- start 2024-08-18T22:30:57.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.232+0000 7fc0ee600640 1 -- start start 2024-08-18T22:30:57.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0ee600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc0e806f290 0x7fc0e80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:57.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0ee600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e80cd850 con 0x7fc0e80cd3a0 2024-08-18T22:30:57.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0ee600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e80cee20 con 0x7fc0e815b010 2024-08-18T22:30:57.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0ee600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e80cfa30 con 0x7fc0e806f290 2024-08-18T22:30:57.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0e6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc0e806f290 0x7fc0e80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:57.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0e7e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc0e80cd3a0 0x7fc0e8072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33516/0 (socket says 172.21.15.5:33516) 2024-08-18T22:30:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0e6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc0e806f290 0x7fc0e80ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37282/0 (socket says 172.21.15.5:37282) 2024-08-18T22:30:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0e7e00640 1 -- 172.21.15.5:0/2956072817 learned_addr learned my addr 172.21.15.5:0/2956072817 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0e6a00640 1 -- 172.21.15.5:0/2956072817 >> v1:172.21.15.117:6789/0 conn(0x7fc0e815b010 legacy=0x7fc0e806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0e6a00640 1 -- 172.21.15.5:0/2956072817 >> v1:172.21.15.5:6789/0 conn(0x7fc0e80cd3a0 legacy=0x7fc0e8072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0e6a00640 1 -- 172.21.15.5:0/2956072817 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e80cf100 con 0x7fc0e806f290 2024-08-18T22:30:57.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.236+0000 7fc0e6000640 1 -- 172.21.15.5:0/2956072817 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046771257 0 0) 0x7fc0e80cd850 con 0x7fc0e80cd3a0 2024-08-18T22:30:57.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0e6a00640 1 --2- 172.21.15.5:0/2956072817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e806f290 0x7fc0e80ce840 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40097c0 tx=0x7fc0d401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca09edd97bd0962 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:57.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0e6000640 1 -- 172.21.15.5:0/2956072817 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40a7070 con 0x7fc0e806f290 2024-08-18T22:30:57.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0e6000640 1 -- 172.21.15.5:0/2956072817 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d40b0070 con 0x7fc0e806f290 2024-08-18T22:30:57.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0e6000640 1 -- 172.21.15.5:0/2956072817 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40ab890 con 0x7fc0e806f290 2024-08-18T22:30:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0ee600640 1 -- 172.21.15.5:0/2956072817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e806f290 msgr2=0x7fc0e80ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0ee600640 1 --2- 172.21.15.5:0/2956072817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e806f290 0x7fc0e80ce840 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40097c0 tx=0x7fc0d401c470 comp rx=0 tx=0).stop 2024-08-18T22:30:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0ee600640 1 -- 172.21.15.5:0/2956072817 shutdown_connections 2024-08-18T22:30:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0ee600640 1 --2- 172.21.15.5:0/2956072817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e806f290 0x7fc0e80ce840 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0ee600640 1 -- 172.21.15.5:0/2956072817 >> 172.21.15.5:0/2956072817 conn(0x7fc0e80b1c50 msgr2=0x7fc0e80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0ee600640 1 -- 172.21.15.5:0/2956072817 shutdown_connections 2024-08-18T22:30:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0ee600640 1 -- 172.21.15.5:0/2956072817 wait complete. 2024-08-18T22:30:57.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0ee600640 1 Processor -- start 2024-08-18T22:30:57.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.240+0000 7fc0ee600640 1 -- start start 2024-08-18T22:30:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0ee600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0e806f290 0x7fc0e8159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0ee600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0e80cd3a0 0x7fc0e814f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0ee600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e815b010 0x7fc0e80c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0ee600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e80736c0 con 0x7fc0e815b010 2024-08-18T22:30:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0ee600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e8073540 con 0x7fc0e806f290 2024-08-18T22:30:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0ee600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e8073840 con 0x7fc0e80cd3a0 2024-08-18T22:30:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0e7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e815b010 0x7fc0e80c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0e7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e815b010 0x7fc0e80c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37298/0 (socket says 172.21.15.5:37298) 2024-08-18T22:30:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0e7e00640 1 -- 172.21.15.5:0/2119962925 learned_addr learned my addr 172.21.15.5:0/2119962925 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0e7400640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0e806f290 0x7fc0e8159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0e6a00640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0e80cd3a0 0x7fc0e814f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0e7e00640 1 -- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0e80cd3a0 msgr2=0x7fc0e814f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0e7e00640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0e80cd3a0 0x7fc0e814f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0e7e00640 1 -- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0e806f290 msgr2=0x7fc0e8159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0e7e00640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0e806f290 0x7fc0e8159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0e7e00640 1 -- 172.21.15.5:0/2119962925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e80b30e0 con 0x7fc0e815b010 2024-08-18T22:30:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0e7e00640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e815b010 0x7fc0e80c9300 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000c7a0 tx=0x7fc0e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0df400640 1 -- 172.21.15.5:0/2119962925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0018070 con 0x7fc0e815b010 2024-08-18T22:30:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0df400640 1 -- 172.21.15.5:0/2119962925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e000a640 con 0x7fc0e815b010 2024-08-18T22:30:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0df400640 1 -- 172.21.15.5:0/2119962925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e000aa70 con 0x7fc0e815b010 2024-08-18T22:30:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0ee600640 1 -- 172.21.15.5:0/2119962925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e815a250 con 0x7fc0e815b010 2024-08-18T22:30:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0ee600640 1 -- 172.21.15.5:0/2119962925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e815ba10 con 0x7fc0e815b010 2024-08-18T22:30:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.244+0000 7fc0ee600640 1 -- 172.21.15.5:0/2119962925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e81500b0 con 0x7fc0e815b010 2024-08-18T22:30:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.248+0000 7fc0df400640 1 -- 172.21.15.5:0/2119962925 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc0e000ac10 con 0x7fc0e815b010 2024-08-18T22:30:57.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.248+0000 7fc0df400640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0c80678c0 0x7fc0c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:57.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.248+0000 7fc0df400640 1 -- 172.21.15.5:0/2119962925 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fc0e0085410 con 0x7fc0e815b010 2024-08-18T22:30:57.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.248+0000 7fc0e7400640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0c80678c0 0x7fc0c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:57.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.248+0000 7fc0e7400640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0c80678c0 0x7fc0c8069d80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8007fd0 tx=0x7fc0d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.252+0000 7fc0df400640 1 -- 172.21.15.5:0/2119962925 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc0e0055760 con 0x7fc0e815b010 2024-08-18T22:30:57.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.480+0000 7fc0ee600640 1 -- 172.21.15.5:0/2119962925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc0e80ce840 con 0x7fc0e815b010 2024-08-18T22:30:57.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0df400640 1 -- 172.21.15.5:0/2119962925 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1233 (secure 0 0 0) 0x7fc0e0059a60 con 0x7fc0e815b010 2024-08-18T22:30:57.482 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:57.482 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":720,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076443502,"bytes_used":2602631168,"bytes_avail":770491482112,"bytes_total":773094113280,"write_bytes_sec":30660083,"read_op_per_sec":0,"write_op_per_sec":31},"fsmap":{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9525}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-08-18T22:30:11.780982+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:30:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 -- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0c80678c0 msgr2=0x7fc0c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0c80678c0 0x7fc0c8069d80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8007fd0 tx=0x7fc0d8009040 comp rx=0 tx=0).stop 2024-08-18T22:30:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 -- 172.21.15.5:0/2119962925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e815b010 msgr2=0x7fc0e80c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e815b010 0x7fc0e80c9300 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000c7a0 tx=0x7fc0e000cc60 comp rx=0 tx=0).stop 2024-08-18T22:30:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 -- 172.21.15.5:0/2119962925 shutdown_connections 2024-08-18T22:30:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc0c80678c0 0x7fc0c8069d80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e815b010 0x7fc0e80c9300 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0e80cd3a0 0x7fc0e814f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 --2- 172.21.15.5:0/2119962925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0e806f290 0x7fc0e8159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 -- 172.21.15.5:0/2119962925 >> 172.21.15.5:0/2119962925 conn(0x7fc0e80b1c50 msgr2=0x7fc0e80b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 -- 172.21.15.5:0/2119962925 shutdown_connections 2024-08-18T22:30:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:57.484+0000 7fc0ee600640 1 -- 172.21.15.5:0/2119962925 wait complete. 2024-08-18T22:30:57.503 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-08-18T22:30:58.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.656+0000 7ff871200640 1 Processor -- start 2024-08-18T22:30:58.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.656+0000 7ff871200640 1 -- start start 2024-08-18T22:30:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff871200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff86c0cde30 0x7ff86c15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff871200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0b4510 0x7ff86c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:58.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff871200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86c0ccd90 con 0x7ff86c09aa40 2024-08-18T22:30:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff871200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff86c0ce770 con 0x7ff86c0cde30 2024-08-18T22:30:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff871200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff86c15d520 con 0x7ff86c0b4510 2024-08-18T22:30:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff862a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff86c0cde30 0x7ff86c15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff862a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff86c0cde30 0x7ff86c15cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37310/0 (socket says 172.21.15.5:37310) 2024-08-18T22:30:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff862a00640 1 -- 172.21.15.5:0/2575138263 learned_addr learned my addr 172.21.15.5:0/2575138263 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:58.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff86be00640 1 --2- 172.21.15.5:0/2575138263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0b4510 0x7ff86c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff862a00640 1 -- 172.21.15.5:0/2575138263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0b4510 msgr2=0x7ff86c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff862a00640 1 --2- 172.21.15.5:0/2575138263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0b4510 0x7ff86c0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff862a00640 1 -- 172.21.15.5:0/2575138263 >> v1:172.21.15.5:6789/0 conn(0x7ff86c09aa40 legacy=0x7ff86c09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:58.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.660+0000 7ff862a00640 1 -- 172.21.15.5:0/2575138263 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c0cd070 con 0x7ff86c0cde30 2024-08-18T22:30:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff862a00640 1 --2- 172.21.15.5:0/2575138263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86c0cde30 0x7ff86c15cfe0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7ff854009870 tx=0x7ff85401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1c74fa0e197542 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff86aa00640 1 -- 172.21.15.5:0/2575138263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8540a95f0 con 0x7ff86c0cde30 2024-08-18T22:30:58.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff86aa00640 1 -- 172.21.15.5:0/2575138263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8540a9790 con 0x7ff86c0cde30 2024-08-18T22:30:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff86aa00640 1 -- 172.21.15.5:0/2575138263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8540a9b60 con 0x7ff86c0cde30 2024-08-18T22:30:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff871200640 1 -- 172.21.15.5:0/2575138263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86c0cde30 msgr2=0x7ff86c15cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff871200640 1 --2- 172.21.15.5:0/2575138263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86c0cde30 0x7ff86c15cfe0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7ff854009870 tx=0x7ff85401c530 comp rx=0 tx=0).stop 2024-08-18T22:30:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff871200640 1 -- 172.21.15.5:0/2575138263 shutdown_connections 2024-08-18T22:30:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff871200640 1 --2- 172.21.15.5:0/2575138263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c0b4510 0x7ff86c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff871200640 1 --2- 172.21.15.5:0/2575138263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86c0cde30 0x7ff86c15cfe0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff871200640 1 -- 172.21.15.5:0/2575138263 >> 172.21.15.5:0/2575138263 conn(0x7ff86c0b3a20 msgr2=0x7ff86c0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff871200640 1 -- 172.21.15.5:0/2575138263 shutdown_connections 2024-08-18T22:30:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff871200640 1 -- 172.21.15.5:0/2575138263 wait complete. 2024-08-18T22:30:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff871200640 1 Processor -- start 2024-08-18T22:30:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.664+0000 7ff871200640 1 -- start start 2024-08-18T22:30:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff871200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c09aa40 0x7ff86c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff871200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86c0b4510 0x7ff86c156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff871200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c0cde30 0x7ff86c15b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff871200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c15c3b0 con 0x7ff86c0b4510 2024-08-18T22:30:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff871200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c15c230 con 0x7ff86c0cde30 2024-08-18T22:30:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff871200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff86c168e40 con 0x7ff86c09aa40 2024-08-18T22:30:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff862a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86c0b4510 0x7ff86c156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff862a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86c0b4510 0x7ff86c156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37324/0 (socket says 172.21.15.5:37324) 2024-08-18T22:30:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff862a00640 1 -- 172.21.15.5:0/292656146 learned_addr learned my addr 172.21.15.5:0/292656146 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff86b400640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c09aa40 0x7ff86c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff862a00640 1 -- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c09aa40 msgr2=0x7ff86c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff862a00640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c09aa40 0x7ff86c159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:58.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff86be00640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c0cde30 0x7ff86c15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:58.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff862a00640 1 -- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c0cde30 msgr2=0x7ff86c15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:58.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff862a00640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c0cde30 0x7ff86c15b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:58.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff862a00640 1 -- 172.21.15.5:0/292656146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c1589c0 con 0x7ff86c0b4510 2024-08-18T22:30:58.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff86b400640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c09aa40 0x7ff86c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:58.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff86be00640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c0cde30 0x7ff86c15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:30:58.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff862a00640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86c0b4510 0x7ff86c156f30 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7ff85401abe0 tx=0x7ff8540192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:58.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff863e00640 1 -- 172.21.15.5:0/292656146 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8540bb640 con 0x7ff86c0b4510 2024-08-18T22:30:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff863e00640 1 -- 172.21.15.5:0/292656146 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8540bb7e0 con 0x7ff86c0b4510 2024-08-18T22:30:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff863e00640 1 -- 172.21.15.5:0/292656146 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8540bbbb0 con 0x7ff86c0b4510 2024-08-18T22:30:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff871200640 1 -- 172.21.15.5:0/292656146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86c158c60 con 0x7ff86c0b4510 2024-08-18T22:30:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff871200640 1 -- 172.21.15.5:0/292656146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff86c159220 con 0x7ff86c0b4510 2024-08-18T22:30:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff871200640 1 -- 172.21.15.5:0/292656146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff86c0cfb00 con 0x7ff86c0b4510 2024-08-18T22:30:58.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.668+0000 7ff863e00640 1 -- 172.21.15.5:0/292656146 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8540b13f0 con 0x7ff86c0b4510 2024-08-18T22:30:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.672+0000 7ff863e00640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8480678c0 0x7ff848069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.672+0000 7ff863e00640 1 -- 172.21.15.5:0/292656146 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7ff8541200c0 con 0x7ff86c0b4510 2024-08-18T22:30:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.672+0000 7ff86b400640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8480678c0 0x7ff848069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:58.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.672+0000 7ff86b400640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8480678c0 0x7ff848069d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0016f0 tx=0x7ff85c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.676+0000 7ff863e00640 1 -- 172.21.15.5:0/292656146 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff8540c2070 con 0x7ff86c0b4510 2024-08-18T22:30:58.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.876+0000 7ff871200640 1 -- 172.21.15.5:0/292656146 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff86c073d40 con 0x7ff86c0b4510 2024-08-18T22:30:58.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.876+0000 7ff863e00640 1 -- 172.21.15.5:0/292656146 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7ff8540ad020 con 0x7ff86c0b4510 2024-08-18T22:30:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:58.879 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:30:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:30:58.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 -- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8480678c0 msgr2=0x7ff848069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8480678c0 0x7ff848069d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0016f0 tx=0x7ff85c009040 comp rx=0 tx=0).stop 2024-08-18T22:30:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 -- 172.21.15.5:0/292656146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86c0b4510 msgr2=0x7ff86c156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86c0b4510 0x7ff86c156f30 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7ff85401abe0 tx=0x7ff8540192d0 comp rx=0 tx=0).stop 2024-08-18T22:30:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 -- 172.21.15.5:0/292656146 shutdown_connections 2024-08-18T22:30:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8480678c0 0x7ff848069d80 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:58.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff86c0cde30 0x7ff86c15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff86c0b4510 0x7ff86c156f30 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 --2- 172.21.15.5:0/292656146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86c09aa40 0x7ff86c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 -- 172.21.15.5:0/292656146 >> 172.21.15.5:0/292656146 conn(0x7ff86c0b3a20 msgr2=0x7ff86c0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 -- 172.21.15.5:0/292656146 shutdown_connections 2024-08-18T22:30:58.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:58.880+0000 7ff871200640 1 -- 172.21.15.5:0/292656146 wait complete. 2024-08-18T22:30:58.899 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-08-18T22:30:58.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:30:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef33e00640 1 Processor -- start 2024-08-18T22:30:59.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef33e00640 1 -- start start 2024-08-18T22:30:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef33e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef2c0cb390 0x7fef2c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef33e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c06da70 0x7fef2c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef33e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef2c073c80 con 0x7fef2c15bed0 2024-08-18T22:30:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef33e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fef2c06e420 con 0x7fef2c0cb390 2024-08-18T22:30:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef33e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fef2c0ca5d0 con 0x7fef2c06da70 2024-08-18T22:30:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef31400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fef2c15bed0 0x7fef2c071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33532/0 (socket says 172.21.15.5:33532) 2024-08-18T22:30:59.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef31400640 1 -- 172.21.15.5:0/1403891636 learned_addr learned my addr 172.21.15.5:0/1403891636 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef31e00640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c06da70 0x7fef2c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef30a00640 1 --2- 172.21.15.5:0/1403891636 >> v2:172.21.15.117:3300/0 conn(0x7fef2c0cb390 0x7fef2c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707890285 0 0) 0x7fef2c073c80 con 0x7fef2c15bed0 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef14003530 con 0x7fef2c15bed0 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3624510750 0 0) 0x7fef14003530 con 0x7fef2c15bed0 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c06da70 msgr2=0x7fef2c06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c06da70 0x7fef2c06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 >> v2:172.21.15.117:3300/0 conn(0x7fef2c0cb390 msgr2=0x7fef2c0735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 --2- 172.21.15.5:0/1403891636 >> v2:172.21.15.117:3300/0 conn(0x7fef2c0cb390 0x7fef2c0735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2c0ca8b0 con 0x7fef2c15bed0 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fef20001a00 con 0x7fef2c15bed0 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 >> v1:172.21.15.5:6789/0 conn(0x7fef2c15bed0 legacy=0x7fef2c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 0x7fef14003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c06da70 0x7fef14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14004d50 0x7fef140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c06e420 con 0x7fef140039c0 2024-08-18T22:30:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c0ca5d0 con 0x7fef14004d50 2024-08-18T22:30:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fef1400b9d0 con 0x7fef2c06da70 2024-08-18T22:30:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef31400640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 0x7fef14003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef30a00640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c06da70 0x7fef14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef31e00640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14004d50 0x7fef140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef31400640 1 -- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c06da70 msgr2=0x7fef14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef31400640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c06da70 0x7fef14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef31400640 1 -- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14004d50 msgr2=0x7fef140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:30:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef31400640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14004d50 0x7fef140051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef31400640 1 -- 172.21.15.5:0/1403891636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef14003530 con 0x7fef140039c0 2024-08-18T22:30:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.040+0000 7fef31e00640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14004d50 0x7fef140051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.044+0000 7fef31400640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 0x7fef14003de0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fef2000a920 tx=0x7fef2001d410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48534093821d75ec server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.044+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2000a4c0 con 0x7fef140039c0 2024-08-18T22:30:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.044+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef200a5e50 con 0x7fef140039c0 2024-08-18T22:30:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.044+0000 7fef2be00640 1 -- 172.21.15.5:0/1403891636 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef200ad890 con 0x7fef140039c0 2024-08-18T22:30:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.044+0000 7fef33e00640 1 -- 172.21.15.5:0/1403891636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 msgr2=0x7fef14003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.044+0000 7fef33e00640 1 --2- 172.21.15.5:0/1403891636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 0x7fef14003de0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fef2000a920 tx=0x7fef2001d410 comp rx=0 tx=0).stop 2024-08-18T22:30:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.044+0000 7fef31e00640 1 -- 172.21.15.5:0/1403891636 reap_dead start 2024-08-18T22:30:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.044+0000 7fef33e00640 1 -- 172.21.15.5:0/1403891636 shutdown_connections 2024-08-18T22:30:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.044+0000 7fef33e00640 1 -- 172.21.15.5:0/1403891636 >> 172.21.15.5:0/1403891636 conn(0x7fef2c0b1c50 msgr2=0x7fef2c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:59.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.044+0000 7fef33e00640 1 -- 172.21.15.5:0/1403891636 shutdown_connections 2024-08-18T22:30:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.044+0000 7fef33e00640 1 -- 172.21.15.5:0/1403891636 wait complete. 2024-08-18T22:30:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef33e00640 1 Processor -- start 2024-08-18T22:30:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef33e00640 1 -- start start 2024-08-18T22:30:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef33e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 0x7fef2c0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef33e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2c0c9a40 0x7fef2c155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef33e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c156000 0x7fef2c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef33e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c166510 con 0x7fef140039c0 2024-08-18T22:30:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef33e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c166390 con 0x7fef2c0c9a40 2024-08-18T22:30:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef33e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fef2c166690 con 0x7fef2c156000 2024-08-18T22:30:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef31400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 0x7fef2c0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef31400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 0x7fef2c0cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37344/0 (socket says 172.21.15.5:37344) 2024-08-18T22:30:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef31400640 1 -- 172.21.15.5:0/887040407 learned_addr learned my addr 172.21.15.5:0/887040407 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef30a00640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2c0c9a40 0x7fef2c155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef31e00640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c156000 0x7fef2c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef31400640 1 -- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c156000 msgr2=0x7fef2c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef31400640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c156000 0x7fef2c15cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef31400640 1 -- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2c0c9a40 msgr2=0x7fef2c155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef31400640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2c0c9a40 0x7fef2c155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef31400640 1 -- 172.21.15.5:0/887040407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2c0ce150 con 0x7fef140039c0 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef30a00640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2c0c9a40 0x7fef2c155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef31400640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 0x7fef2c0cdb50 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fef2001d240 tx=0x7fef14005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef29600640 1 -- 172.21.15.5:0/887040407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef200ad570 con 0x7fef140039c0 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef29600640 1 -- 172.21.15.5:0/887040407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef20004b70 con 0x7fef140039c0 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef29600640 1 -- 172.21.15.5:0/887040407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef200017c0 con 0x7fef140039c0 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef33e00640 1 -- 172.21.15.5:0/887040407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2c0ce430 con 0x7fef140039c0 2024-08-18T22:30:59.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.048+0000 7fef33e00640 1 -- 172.21.15.5:0/887040407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef2c0ce9f0 con 0x7fef140039c0 2024-08-18T22:30:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.052+0000 7fef33e00640 1 -- 172.21.15.5:0/887040407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef2c0735a0 con 0x7fef140039c0 2024-08-18T22:30:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.052+0000 7fef29600640 1 -- 172.21.15.5:0/887040407 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef200b5070 con 0x7fef140039c0 2024-08-18T22:30:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.052+0000 7fef29600640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef0c0678f0 0x7fef0c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.052+0000 7fef29600640 1 -- 172.21.15.5:0/887040407 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fef2011fc30 con 0x7fef140039c0 2024-08-18T22:30:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.052+0000 7fef30a00640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef0c0678f0 0x7fef0c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.052+0000 7fef30a00640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef0c0678f0 0x7fef0c069db0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0cfd30 tx=0x7fef18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:59.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.056+0000 7fef29600640 1 -- 172.21.15.5:0/887040407 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fef20017150 con 0x7fef140039c0 2024-08-18T22:30:59.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.280+0000 7fef33e00640 1 -- 172.21.15.5:0/887040407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fef2c15c900 con 0x7fef140039c0 2024-08-18T22:30:59.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.280+0000 7fef29600640 1 -- 172.21.15.5:0/887040407 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1643 (secure 0 0 0) 0x7fef200f0540 con 0x7fef140039c0 2024-08-18T22:30:59.281 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:59.281 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":722,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076443502,"bytes_used":2602631168,"bytes_avail":770491482112,"bytes_total":773094113280,"write_bytes_sec":26029528,"read_op_per_sec":0,"write_op_per_sec":26},"fsmap":{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9525}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-08-18T22:30:57.791606+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T22:30:59.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 -- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef0c0678f0 msgr2=0x7fef0c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef0c0678f0 0x7fef0c069db0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0cfd30 tx=0x7fef18008040 comp rx=0 tx=0).stop 2024-08-18T22:30:59.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 -- 172.21.15.5:0/887040407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 msgr2=0x7fef2c0cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 0x7fef2c0cdb50 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fef2001d240 tx=0x7fef14005840 comp rx=0 tx=0).stop 2024-08-18T22:30:59.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 -- 172.21.15.5:0/887040407 shutdown_connections 2024-08-18T22:30:59.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef0c0678f0 0x7fef0c069db0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2c156000 0x7fef2c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2c0c9a40 0x7fef2c155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 --2- 172.21.15.5:0/887040407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140039c0 0x7fef2c0cdb50 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 -- 172.21.15.5:0/887040407 >> 172.21.15.5:0/887040407 conn(0x7fef2c0b1c50 msgr2=0x7fef2c0acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:59.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 -- 172.21.15.5:0/887040407 shutdown_connections 2024-08-18T22:30:59.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.284+0000 7fef33e00640 1 -- 172.21.15.5:0/887040407 wait complete. 2024-08-18T22:30:59.303 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused'} 2024-08-18T22:30:59.304 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:30:59.304 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:30:59.319 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:30:59.320 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'c', 'd', 'b'} 2024-08-18T22:30:59.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-08-18T22:30:59.512 INFO:teuthology.orchestra.run.smithi005.stdout:{"mds_beacon_grace":"15.000000"} 2024-08-18T22:30:59.512 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-08-18T22:30:59.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:30:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe138400640 1 Processor -- start 2024-08-18T22:30:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe138400640 1 -- start start 2024-08-18T22:30:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe138400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13006dd80 0x7fe1300cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe138400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13006e210 con 0x7fe130071580 2024-08-18T22:30:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe138400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe130071c80 con 0x7fe1300b54c0 2024-08-18T22:30:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe138400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe1300cba40 con 0x7fe13006dd80 2024-08-18T22:30:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe135000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe130071580 0x7fe1300cbed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33546/0 (socket says 172.21.15.5:33546) 2024-08-18T22:30:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe135000640 1 -- 172.21.15.5:0/1368369784 learned_addr learned my addr 172.21.15.5:0/1368369784 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:30:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe136400640 1 --2- 172.21.15.5:0/1368369784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13006dd80 0x7fe1300cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe12fe00640 1 -- 172.21.15.5:0/1368369784 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700619481 0 0) 0x7fe11c001120 con 0x7fe130071580 2024-08-18T22:30:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe12fe00640 1 -- 172.21.15.5:0/1368369784 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe118003530 con 0x7fe130071580 2024-08-18T22:30:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe136400640 1 -- 172.21.15.5:0/1368369784 >> v1:172.21.15.117:6789/0 conn(0x7fe1300b54c0 legacy=0x7fe1300b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe12fe00640 1 -- 172.21.15.5:0/1368369784 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194697410 0 0) 0x7fe130071c80 con 0x7fe1300b54c0 2024-08-18T22:30:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe136400640 1 -- 172.21.15.5:0/1368369784 >> v1:172.21.15.5:6789/0 conn(0x7fe130071580 legacy=0x7fe1300cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.656+0000 7fe136400640 1 -- 172.21.15.5:0/1368369784 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe130071f60 con 0x7fe13006dd80 2024-08-18T22:30:59.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.660+0000 7fe136400640 1 --2- 172.21.15.5:0/1368369784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13006dd80 0x7fe1300cc5e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe128009dc0 tx=0x7fe12801f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6ffb37e1ec614e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.660+0000 7fe12fe00640 1 -- 172.21.15.5:0/1368369784 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1280b4070 con 0x7fe13006dd80 2024-08-18T22:30:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.660+0000 7fe12fe00640 1 -- 172.21.15.5:0/1368369784 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1280af600 con 0x7fe13006dd80 2024-08-18T22:30:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.660+0000 7fe12fe00640 1 -- 172.21.15.5:0/1368369784 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1280af9b0 con 0x7fe13006dd80 2024-08-18T22:30:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.660+0000 7fe138400640 1 -- 172.21.15.5:0/1368369784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13006dd80 msgr2=0x7fe1300cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.660+0000 7fe138400640 1 --2- 172.21.15.5:0/1368369784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13006dd80 0x7fe1300cc5e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe128009dc0 tx=0x7fe12801f170 comp rx=0 tx=0).stop 2024-08-18T22:30:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.660+0000 7fe138400640 1 -- 172.21.15.5:0/1368369784 shutdown_connections 2024-08-18T22:30:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.660+0000 7fe138400640 1 --2- 172.21.15.5:0/1368369784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13006dd80 0x7fe1300cc5e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.660+0000 7fe138400640 1 -- 172.21.15.5:0/1368369784 >> 172.21.15.5:0/1368369784 conn(0x7fe1300b3eb0 msgr2=0x7fe1300b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.660+0000 7fe138400640 1 -- 172.21.15.5:0/1368369784 shutdown_connections 2024-08-18T22:30:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.660+0000 7fe138400640 1 -- 172.21.15.5:0/1368369784 wait complete. 2024-08-18T22:30:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe138400640 1 Processor -- start 2024-08-18T22:30:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe138400640 1 -- start start 2024-08-18T22:30:59.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe138400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13006dd80 0x7fe1301e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe138400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe130071580 0x7fe1300d1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe138400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1300b54c0 0x7fe130142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe138400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe130148020 con 0x7fe130071580 2024-08-18T22:30:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe138400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1300719a0 con 0x7fe1300b54c0 2024-08-18T22:30:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe138400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe1301481a0 con 0x7fe13006dd80 2024-08-18T22:30:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe135000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe130071580 0x7fe1300d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe135000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe130071580 0x7fe1300d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37346/0 (socket says 172.21.15.5:37346) 2024-08-18T22:30:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe135000640 1 -- 172.21.15.5:0/4268416014 learned_addr learned my addr 172.21.15.5:0/4268416014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:30:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe135a00640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13006dd80 0x7fe1301e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe136400640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1300b54c0 0x7fe130142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe135000640 1 -- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13006dd80 msgr2=0x7fe1301e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe135000640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13006dd80 0x7fe1301e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe135000640 1 -- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1300b54c0 msgr2=0x7fe130142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe135000640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1300b54c0 0x7fe130142cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe135000640 1 -- 172.21.15.5:0/4268416014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1300d0520 con 0x7fe130071580 2024-08-18T22:30:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe135000640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe130071580 0x7fe1300d1550 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00c730 tx=0x7fe11c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe12d600640 1 -- 172.21.15.5:0/4268416014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c017070 con 0x7fe130071580 2024-08-18T22:30:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe12d600640 1 -- 172.21.15.5:0/4268416014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe11c005ae0 con 0x7fe130071580 2024-08-18T22:30:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe12d600640 1 -- 172.21.15.5:0/4268416014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c007e30 con 0x7fe130071580 2024-08-18T22:30:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe138400640 1 -- 172.21.15.5:0/4268416014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1300d0790 con 0x7fe130071580 2024-08-18T22:30:59.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.664+0000 7fe138400640 1 -- 172.21.15.5:0/4268416014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1300d0d50 con 0x7fe130071580 2024-08-18T22:30:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.668+0000 7fe138400640 1 -- 172.21.15.5:0/4268416014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1300b58a0 con 0x7fe130071580 2024-08-18T22:30:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.668+0000 7fe12d600640 1 -- 172.21.15.5:0/4268416014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe11c01a070 con 0x7fe130071580 2024-08-18T22:30:59.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.668+0000 7fe12d600640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1100678c0 0x7fe110069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:30:59.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.668+0000 7fe12d600640 1 -- 172.21.15.5:0/4268416014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fe11c085180 con 0x7fe130071580 2024-08-18T22:30:59.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.668+0000 7fe135a00640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1100678c0 0x7fe110069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:30:59.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.668+0000 7fe135a00640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1100678c0 0x7fe110069d80 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe1300cfba0 tx=0x7fe124009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:30:59.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.672+0000 7fe12d600640 1 -- 172.21.15.5:0/4268416014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe13006e210 con 0x7fe130071580 2024-08-18T22:30:59.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.876+0000 7fe138400640 1 -- 172.21.15.5:0/4268416014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1300d2c10 con 0x7fe130071580 2024-08-18T22:30:59.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.876+0000 7fe12d600640 1 -- 172.21.15.5:0/4268416014 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7fe11c0554d0 con 0x7fe130071580 2024-08-18T22:30:59.877 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:30:59.877 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:30:59.877 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:30:59.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 -- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1100678c0 msgr2=0x7fe110069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1100678c0 0x7fe110069d80 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe1300cfba0 tx=0x7fe124009040 comp rx=0 tx=0).stop 2024-08-18T22:30:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 -- 172.21.15.5:0/4268416014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe130071580 msgr2=0x7fe1300d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:30:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe130071580 0x7fe1300d1550 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00c730 tx=0x7fe11c00cbf0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 -- 172.21.15.5:0/4268416014 shutdown_connections 2024-08-18T22:30:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1100678c0 0x7fe110069d80 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1300b54c0 0x7fe130142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe130071580 0x7fe1300d1550 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 --2- 172.21.15.5:0/4268416014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe13006dd80 0x7fe1301e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:30:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 -- 172.21.15.5:0/4268416014 >> 172.21.15.5:0/4268416014 conn(0x7fe1300b3eb0 msgr2=0x7fe1300b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:30:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 -- 172.21.15.5:0/4268416014 shutdown_connections 2024-08-18T22:30:59.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:30:59.880+0000 7fe138400640 1 -- 172.21.15.5:0/4268416014 wait complete. 2024-08-18T22:30:59.897 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-08-18T22:31:04.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff03f000640 1 Processor -- start 2024-08-18T22:31:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff03f000640 1 -- start start 2024-08-18T22:31:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff03f000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0380cb390 0x7ff0380735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff03f000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff038073c80 con 0x7ff03815bed0 2024-08-18T22:31:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff03f000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0380ca5d0 con 0x7ff03806da70 2024-08-18T22:31:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff03f000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff0380ca8b0 con 0x7ff0380cb390 2024-08-18T22:31:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff037e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff03815bed0 0x7ff038071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36454/0 (socket says 172.21.15.5:36454) 2024-08-18T22:31:05.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff037e00640 1 -- 172.21.15.5:0/2112344293 learned_addr learned my addr 172.21.15.5:0/2112344293 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff037400640 1 --2- 172.21.15.5:0/2112344293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0380cb390 0x7ff0380735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff036a00640 1 -- 172.21.15.5:0/2112344293 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959638835 0 0) 0x7ff038073c80 con 0x7ff03815bed0 2024-08-18T22:31:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff036a00640 1 -- 172.21.15.5:0/2112344293 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff01c003530 con 0x7ff03815bed0 2024-08-18T22:31:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff036a00640 1 -- 172.21.15.5:0/2112344293 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417491258 0 0) 0x7ff0380ca5d0 con 0x7ff03806da70 2024-08-18T22:31:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff036a00640 1 -- 172.21.15.5:0/2112344293 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff038073c80 con 0x7ff03806da70 2024-08-18T22:31:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff037400640 1 -- 172.21.15.5:0/2112344293 >> v1:172.21.15.117:6789/0 conn(0x7ff03806da70 legacy=0x7ff038165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff036a00640 1 -- 172.21.15.5:0/2112344293 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 23586550 0 0) 0x7ff01c003530 con 0x7ff03815bed0 2024-08-18T22:31:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff037400640 1 -- 172.21.15.5:0/2112344293 >> v1:172.21.15.5:6789/0 conn(0x7ff03815bed0 legacy=0x7ff038071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.052+0000 7ff037400640 1 -- 172.21.15.5:0/2112344293 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0380cab90 con 0x7ff0380cb390 2024-08-18T22:31:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.056+0000 7ff037400640 1 --2- 172.21.15.5:0/2112344293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0380cb390 0x7ff0380735a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0240097f0 tx=0x7ff02401c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef4246729338bc27 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.056+0000 7ff036a00640 1 -- 172.21.15.5:0/2112344293 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240b0070 con 0x7ff0380cb390 2024-08-18T22:31:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.056+0000 7ff036a00640 1 -- 172.21.15.5:0/2112344293 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0240ab400 con 0x7ff0380cb390 2024-08-18T22:31:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.056+0000 7ff036a00640 1 -- 172.21.15.5:0/2112344293 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028001680 con 0x7ff0380cb390 2024-08-18T22:31:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 -- 172.21.15.5:0/2112344293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0380cb390 msgr2=0x7ff0380735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 --2- 172.21.15.5:0/2112344293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0380cb390 0x7ff0380735a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0240097f0 tx=0x7ff02401c3d0 comp rx=0 tx=0).stop 2024-08-18T22:31:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 -- 172.21.15.5:0/2112344293 shutdown_connections 2024-08-18T22:31:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 --2- 172.21.15.5:0/2112344293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0380cb390 0x7ff0380735a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 -- 172.21.15.5:0/2112344293 >> 172.21.15.5:0/2112344293 conn(0x7ff0380b1c50 msgr2=0x7ff0380b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 -- 172.21.15.5:0/2112344293 shutdown_connections 2024-08-18T22:31:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 -- 172.21.15.5:0/2112344293 wait complete. 2024-08-18T22:31:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 Processor -- start 2024-08-18T22:31:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 -- start start 2024-08-18T22:31:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff03806da70 0x7ff03814cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0380cb390 0x7ff0380cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff03815bed0 0x7ff0380b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff038169c40 con 0x7ff0380cb390 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff038169ac0 con 0x7ff03815bed0 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03f000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff038169dc0 con 0x7ff03806da70 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff037400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0380cb390 0x7ff0380cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff037400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0380cb390 0x7ff0380cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38640/0 (socket says 172.21.15.5:38640) 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff037400640 1 -- 172.21.15.5:0/3886660680 learned_addr learned my addr 172.21.15.5:0/3886660680 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff037e00640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff03806da70 0x7ff03814cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff03d000640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff03815bed0 0x7ff0380b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff037400640 1 -- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff03806da70 msgr2=0x7ff03814cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff037400640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff03806da70 0x7ff03814cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff037400640 1 -- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff03815bed0 msgr2=0x7ff0380b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff037400640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff03815bed0 0x7ff0380b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff037400640 1 -- 172.21.15.5:0/3886660680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0380ce610 con 0x7ff0380cb390 2024-08-18T22:31:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.060+0000 7ff037400640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0380cb390 0x7ff0380cdb50 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7ff0240ae040 tx=0x7ff02401ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.064+0000 7ff02fe00640 1 -- 172.21.15.5:0/3886660680 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240bb020 con 0x7ff0380cb390 2024-08-18T22:31:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.064+0000 7ff02fe00640 1 -- 172.21.15.5:0/3886660680 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0240b1040 con 0x7ff0380cb390 2024-08-18T22:31:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.064+0000 7ff03f000640 1 -- 172.21.15.5:0/3886660680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0380ce8f0 con 0x7ff0380cb390 2024-08-18T22:31:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.064+0000 7ff02fe00640 1 -- 172.21.15.5:0/3886660680 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240b0050 con 0x7ff0380cb390 2024-08-18T22:31:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.064+0000 7ff03f000640 1 -- 172.21.15.5:0/3886660680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0380ceeb0 con 0x7ff0380cb390 2024-08-18T22:31:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.064+0000 7ff03f000640 1 -- 172.21.15.5:0/3886660680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0380735a0 con 0x7ff0380cb390 2024-08-18T22:31:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.064+0000 7ff02fe00640 1 -- 172.21.15.5:0/3886660680 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0240be070 con 0x7ff0380cb390 2024-08-18T22:31:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.064+0000 7ff02fe00640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff0180678c0 0x7ff018069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.064+0000 7ff02fe00640 1 -- 172.21.15.5:0/3886660680 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7ff02411f4c0 con 0x7ff0380cb390 2024-08-18T22:31:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.064+0000 7ff037e00640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff0180678c0 0x7ff018069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.068+0000 7ff037e00640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff0180678c0 0x7ff018069d80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff028000fe0 tx=0x7ff028001160 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.068+0000 7ff02fe00640 1 -- 172.21.15.5:0/3886660680 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff024015ff0 con 0x7ff0380cb390 2024-08-18T22:31:05.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 -- 172.21.15.5:0/3886660680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0380cc5e0 con 0x7ff0380cb390 2024-08-18T22:31:05.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff02fe00640 1 -- 172.21.15.5:0/3886660680 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7ff0240ef6f0 con 0x7ff0380cb390 2024-08-18T22:31:05.272 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:31:05.272 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 -- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff0180678c0 msgr2=0x7ff018069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff0180678c0 0x7ff018069d80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff028000fe0 tx=0x7ff028001160 comp rx=0 tx=0).stop 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 -- 172.21.15.5:0/3886660680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0380cb390 msgr2=0x7ff0380cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0380cb390 0x7ff0380cdb50 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7ff0240ae040 tx=0x7ff02401ac10 comp rx=0 tx=0).stop 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 -- 172.21.15.5:0/3886660680 shutdown_connections 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff0180678c0 0x7ff018069d80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff03815bed0 0x7ff0380b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0380cb390 0x7ff0380cdb50 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 --2- 172.21.15.5:0/3886660680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff03806da70 0x7ff03814cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 -- 172.21.15.5:0/3886660680 >> 172.21.15.5:0/3886660680 conn(0x7ff0380b1c50 msgr2=0x7ff0380acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.272+0000 7ff03f000640 1 -- 172.21.15.5:0/3886660680 shutdown_connections 2024-08-18T22:31:05.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:05.276+0000 7ff03f000640 1 -- 172.21.15.5:0/3886660680 wait complete. 2024-08-18T22:31:05.294 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-08-18T22:31:10.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37eee00640 1 Processor -- start 2024-08-18T22:31:10.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37eee00640 1 -- start start 2024-08-18T22:31:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37eee00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e8072c10 0x7f37e806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37eee00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e80ad820 con 0x7f37e815ade0 2024-08-18T22:31:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37eee00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e80731e0 con 0x7f37e806f3c0 2024-08-18T22:31:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37eee00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f37e8072030 con 0x7f37e8072c10 2024-08-18T22:31:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37eda00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f37e815ade0 0x7f37e80ae5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36460/0 (socket says 172.21.15.5:36460) 2024-08-18T22:31:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37eda00640 1 -- 172.21.15.5:0/2763021283 learned_addr learned my addr 172.21.15.5:0/2763021283 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37ed000640 1 --2- 172.21.15.5:0/2763021283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e8072c10 0x7f37e806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37e7e00640 1 -- 172.21.15.5:0/2763021283 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950010600 0 0) 0x7f37e80ad820 con 0x7f37e815ade0 2024-08-18T22:31:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37e7e00640 1 -- 172.21.15.5:0/2763021283 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37d0003530 con 0x7f37e815ade0 2024-08-18T22:31:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37e7e00640 1 -- 172.21.15.5:0/2763021283 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264032575 0 0) 0x7f37e80731e0 con 0x7f37e806f3c0 2024-08-18T22:31:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37e7e00640 1 -- 172.21.15.5:0/2763021283 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37e80ad820 con 0x7f37e806f3c0 2024-08-18T22:31:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37ed000640 1 -- 172.21.15.5:0/2763021283 >> v1:172.21.15.117:6789/0 conn(0x7f37e806f3c0 legacy=0x7f37e80b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37ed000640 1 -- 172.21.15.5:0/2763021283 >> v1:172.21.15.5:6789/0 conn(0x7f37e815ade0 legacy=0x7f37e80ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:10.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.448+0000 7f37ed000640 1 -- 172.21.15.5:0/2763021283 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e80adae0 con 0x7f37e8072c10 2024-08-18T22:31:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.452+0000 7f37ed000640 1 --2- 172.21.15.5:0/2763021283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e8072c10 0x7f37e806dad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f37d40097f0 tx=0x7f37d401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3bde338402caf75 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.452+0000 7f37e7e00640 1 -- 172.21.15.5:0/2763021283 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d40b0070 con 0x7f37e8072c10 2024-08-18T22:31:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.452+0000 7f37e7e00640 1 -- 172.21.15.5:0/2763021283 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d40ab600 con 0x7f37e8072c10 2024-08-18T22:31:10.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.452+0000 7f37e7e00640 1 -- 172.21.15.5:0/2763021283 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d40ab9b0 con 0x7f37e8072c10 2024-08-18T22:31:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.452+0000 7f37eee00640 1 -- 172.21.15.5:0/2763021283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e8072c10 msgr2=0x7f37e806dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.452+0000 7f37eee00640 1 --2- 172.21.15.5:0/2763021283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e8072c10 0x7f37e806dad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f37d40097f0 tx=0x7f37d401c4e0 comp rx=0 tx=0).stop 2024-08-18T22:31:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.452+0000 7f37eee00640 1 -- 172.21.15.5:0/2763021283 shutdown_connections 2024-08-18T22:31:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.452+0000 7f37eee00640 1 --2- 172.21.15.5:0/2763021283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e8072c10 0x7f37e806dad0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.452+0000 7f37eee00640 1 -- 172.21.15.5:0/2763021283 >> 172.21.15.5:0/2763021283 conn(0x7f37e80b1b00 msgr2=0x7f37e80b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.452+0000 7f37eee00640 1 -- 172.21.15.5:0/2763021283 shutdown_connections 2024-08-18T22:31:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.452+0000 7f37eee00640 1 -- 172.21.15.5:0/2763021283 wait complete. 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eee00640 1 Processor -- start 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eee00640 1 -- start start 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eee00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e806f3c0 0x7f37e8148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eee00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e8072c10 0x7f37e809d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eee00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e815ade0 0x7f37e80cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eee00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f37e80734c0 con 0x7f37e806f3c0 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eee00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f37e80aecd0 con 0x7f37e8072c10 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eee00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f37e806eac0 con 0x7f37e815ade0 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eda00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e806f3c0 0x7f37e8148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eda00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e806f3c0 0x7f37e8148a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38644/0 (socket says 172.21.15.5:38644) 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eda00640 1 -- 172.21.15.5:0/990613891 learned_addr learned my addr 172.21.15.5:0/990613891 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37ed000640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e8072c10 0x7f37e809d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:10.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37ee400640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e815ade0 0x7f37e80cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eda00640 1 -- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e815ade0 msgr2=0x7f37e80cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eda00640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e815ade0 0x7f37e80cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eda00640 1 -- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e8072c10 msgr2=0x7f37e809d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eda00640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e8072c10 0x7f37e809d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eda00640 1 -- 172.21.15.5:0/990613891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e809c6a0 con 0x7f37e806f3c0 2024-08-18T22:31:10.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37ee400640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e815ade0 0x7f37e80cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eda00640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e806f3c0 0x7f37e8148a90 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00c450 tx=0x7f37dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37e5600640 1 -- 172.21.15.5:0/990613891 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc017070 con 0x7f37e806f3c0 2024-08-18T22:31:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37e5600640 1 -- 172.21.15.5:0/990613891 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc005cf0 con 0x7f37e806f3c0 2024-08-18T22:31:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eee00640 1 -- 172.21.15.5:0/990613891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e809c980 con 0x7f37e806f3c0 2024-08-18T22:31:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37e5600640 1 -- 172.21.15.5:0/990613891 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc0072b0 con 0x7f37e806f3c0 2024-08-18T22:31:10.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.456+0000 7f37eee00640 1 -- 172.21.15.5:0/990613891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e8148fd0 con 0x7f37e806f3c0 2024-08-18T22:31:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.460+0000 7f37eee00640 1 -- 172.21.15.5:0/990613891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e806ee80 con 0x7f37e806f3c0 2024-08-18T22:31:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.460+0000 7f37e5600640 1 -- 172.21.15.5:0/990613891 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f37dc01a070 con 0x7f37e806f3c0 2024-08-18T22:31:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.460+0000 7f37e5600640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37c80678c0 0x7f37c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.460+0000 7f37e5600640 1 -- 172.21.15.5:0/990613891 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f37dc085120 con 0x7f37e806f3c0 2024-08-18T22:31:10.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.460+0000 7f37ed000640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37c80678c0 0x7f37c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.460+0000 7f37ed000640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37c80678c0 0x7f37c8069d80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f37d40ad000 tx=0x7f37d40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:10.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.464+0000 7f37e5600640 1 -- 172.21.15.5:0/990613891 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f37dc055470 con 0x7f37e806f3c0 2024-08-18T22:31:10.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.664+0000 7f37eee00640 1 -- 172.21.15.5:0/990613891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37e806e090 con 0x7f37e806f3c0 2024-08-18T22:31:10.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.664+0000 7f37e5600640 1 -- 172.21.15.5:0/990613891 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f37dc059770 con 0x7f37e806f3c0 2024-08-18T22:31:10.665 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:10.665 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:31:10.665 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:31:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 -- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37c80678c0 msgr2=0x7f37c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37c80678c0 0x7f37c8069d80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f37d40ad000 tx=0x7f37d40a6000 comp rx=0 tx=0).stop 2024-08-18T22:31:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 -- 172.21.15.5:0/990613891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e806f3c0 msgr2=0x7f37e8148a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e806f3c0 0x7f37e8148a90 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00c450 tx=0x7f37dc00c910 comp rx=0 tx=0).stop 2024-08-18T22:31:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 -- 172.21.15.5:0/990613891 shutdown_connections 2024-08-18T22:31:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f37c80678c0 0x7f37c8069d80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e815ade0 0x7f37e80cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e8072c10 0x7f37e809d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 --2- 172.21.15.5:0/990613891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e806f3c0 0x7f37e8148a90 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 -- 172.21.15.5:0/990613891 >> 172.21.15.5:0/990613891 conn(0x7f37e80b1b00 msgr2=0x7f37e814f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 -- 172.21.15.5:0/990613891 shutdown_connections 2024-08-18T22:31:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:10.668+0000 7f37eee00640 1 -- 172.21.15.5:0/990613891 wait complete. 2024-08-18T22:31:10.687 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-08-18T22:31:15.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.844+0000 7f1c62e00640 1 Processor -- start 2024-08-18T22:31:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.844+0000 7f1c62e00640 1 -- start start 2024-08-18T22:31:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c62e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c5c15b010 0x7f1c5c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c62e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c5c073630 0x7f1c5c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c62e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c5c0cee20 con 0x7f1c5c0cd3a0 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c62e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1c5c0cfa30 con 0x7f1c5c073630 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c62e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5c0cf100 con 0x7f1c5c15b010 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c60e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c5c073630 0x7f1c5c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c60e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c5c073630 0x7f1c5c0cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42830/0 (socket says 172.21.15.5:42830) 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c60e00640 1 -- 172.21.15.5:0/373184248 learned_addr learned my addr 172.21.15.5:0/373184248 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c53400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1c5c0cd3a0 0x7f1c5c0caf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39828/0 (socket says 172.21.15.5:39828) 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c5be00640 1 --2- 172.21.15.5:0/373184248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c5c15b010 0x7f1c5c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c60e00640 1 -- 172.21.15.5:0/373184248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c5c15b010 msgr2=0x7f1c5c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c60e00640 1 --2- 172.21.15.5:0/373184248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c5c15b010 0x7f1c5c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c60e00640 1 -- 172.21.15.5:0/373184248 >> v1:172.21.15.5:6789/0 conn(0x7f1c5c0cd3a0 legacy=0x7f1c5c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c60e00640 1 -- 172.21.15.5:0/373184248 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5c0cf3e0 con 0x7f1c5c073630 2024-08-18T22:31:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.848+0000 7f1c60e00640 1 --2- 172.21.15.5:0/373184248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c5c073630 0x7f1c5c0cb650 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009e50 tx=0x7f1c5401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf3d91f1c9aaf97 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c5b400640 1 -- 172.21.15.5:0/373184248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c540a57e0 con 0x7f1c5c073630 2024-08-18T22:31:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c5b400640 1 -- 172.21.15.5:0/373184248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c540a5980 con 0x7f1c5c073630 2024-08-18T22:31:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c5b400640 1 -- 172.21.15.5:0/373184248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c540a5d50 con 0x7f1c5c073630 2024-08-18T22:31:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 -- 172.21.15.5:0/373184248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c5c073630 msgr2=0x7f1c5c0cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 --2- 172.21.15.5:0/373184248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c5c073630 0x7f1c5c0cb650 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009e50 tx=0x7f1c5401ca00 comp rx=0 tx=0).stop 2024-08-18T22:31:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 -- 172.21.15.5:0/373184248 shutdown_connections 2024-08-18T22:31:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 --2- 172.21.15.5:0/373184248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c5c073630 0x7f1c5c0cb650 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 --2- 172.21.15.5:0/373184248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c5c15b010 0x7f1c5c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 -- 172.21.15.5:0/373184248 >> 172.21.15.5:0/373184248 conn(0x7f1c5c0b1c50 msgr2=0x7f1c5c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 -- 172.21.15.5:0/373184248 shutdown_connections 2024-08-18T22:31:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 -- 172.21.15.5:0/373184248 wait complete. 2024-08-18T22:31:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 Processor -- start 2024-08-18T22:31:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 -- start start 2024-08-18T22:31:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c5c073630 0x7f1c5c0af800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c5c0cd3a0 0x7f1c5c0afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c5c15b010 0x7f1c5c14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c0cbd10 con 0x7f1c5c15b010 2024-08-18T22:31:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c0cbb90 con 0x7f1c5c0cd3a0 2024-08-18T22:31:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.852+0000 7f1c62e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5c06e280 con 0x7f1c5c073630 2024-08-18T22:31:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c60e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c5c15b010 0x7f1c5c14f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c60e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c5c15b010 0x7f1c5c14f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42834/0 (socket says 172.21.15.5:42834) 2024-08-18T22:31:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c5be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c5c073630 0x7f1c5c0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c60e00640 1 -- 172.21.15.5:0/2989507625 learned_addr learned my addr 172.21.15.5:0/2989507625 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c53400640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c5c0cd3a0 0x7f1c5c0afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c60e00640 1 -- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c5c073630 msgr2=0x7f1c5c0af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c60e00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c5c073630 0x7f1c5c0af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c60e00640 1 -- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c5c0cd3a0 msgr2=0x7f1c5c0afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c60e00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c5c0cd3a0 0x7f1c5c0afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c60e00640 1 -- 172.21.15.5:0/2989507625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5c15e0f0 con 0x7f1c5c15b010 2024-08-18T22:31:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c60e00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c5c15b010 0x7f1c5c14f580 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f1c540af040 tx=0x7f1c540197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c58c00640 1 -- 172.21.15.5:0/2989507625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c540b8670 con 0x7f1c5c15b010 2024-08-18T22:31:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c58c00640 1 -- 172.21.15.5:0/2989507625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c540be070 con 0x7f1c5c15b010 2024-08-18T22:31:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c62e00640 1 -- 172.21.15.5:0/2989507625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c5c15e3d0 con 0x7f1c5c15b010 2024-08-18T22:31:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c58c00640 1 -- 172.21.15.5:0/2989507625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c540b8a70 con 0x7f1c5c15b010 2024-08-18T22:31:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.856+0000 7f1c62e00640 1 -- 172.21.15.5:0/2989507625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c5c0b3230 con 0x7f1c5c15b010 2024-08-18T22:31:15.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.860+0000 7f1c62e00640 1 -- 172.21.15.5:0/2989507625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c5c0ce840 con 0x7f1c5c15b010 2024-08-18T22:31:15.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.860+0000 7f1c58c00640 1 -- 172.21.15.5:0/2989507625 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c540b8c10 con 0x7f1c5c15b010 2024-08-18T22:31:15.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.860+0000 7f1c58c00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c380678c0 0x7f1c38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:15.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.860+0000 7f1c58c00640 1 -- 172.21.15.5:0/2989507625 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f1c54120ff0 con 0x7f1c5c15b010 2024-08-18T22:31:15.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.860+0000 7f1c5be00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c380678c0 0x7f1c38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:15.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.860+0000 7f1c5be00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c380678c0 0x7f1c38069d80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c09e0a0 tx=0x7f1c4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:15.864+0000 7f1c58c00640 1 -- 172.21.15.5:0/2989507625 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1c54016620 con 0x7f1c5c15b010 2024-08-18T22:31:16.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.064+0000 7f1c62e00640 1 -- 172.21.15.5:0/2989507625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c5c06eb90 con 0x7f1c5c15b010 2024-08-18T22:31:16.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.064+0000 7f1c58c00640 1 -- 172.21.15.5:0/2989507625 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f1c540f1450 con 0x7f1c5c15b010 2024-08-18T22:31:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:16.065 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":125,"btime":"2024-08-18T22:30:23:593839+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8740,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:30:22.993564+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9525":{"gid":9525,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/324683204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":324683204},{"type":"v1","addr":"172.21.15.5:6835","nonce":324683204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9525,"qdb_cluster":[9525]},"id":11}]} 2024-08-18T22:31:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 125 2024-08-18T22:31:16.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 -- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c380678c0 msgr2=0x7f1c38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:16.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c380678c0 0x7f1c38069d80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c09e0a0 tx=0x7f1c4c008040 comp rx=0 tx=0).stop 2024-08-18T22:31:16.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 -- 172.21.15.5:0/2989507625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c5c15b010 msgr2=0x7f1c5c14f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c5c15b010 0x7f1c5c14f580 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f1c540af040 tx=0x7f1c540197a0 comp rx=0 tx=0).stop 2024-08-18T22:31:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 -- 172.21.15.5:0/2989507625 shutdown_connections 2024-08-18T22:31:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c380678c0 0x7f1c38069d80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c5c15b010 0x7f1c5c14f580 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c5c0cd3a0 0x7f1c5c0afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 --2- 172.21.15.5:0/2989507625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c5c073630 0x7f1c5c0af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 -- 172.21.15.5:0/2989507625 >> 172.21.15.5:0/2989507625 conn(0x7f1c5c0b1c50 msgr2=0x7f1c5c15a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 -- 172.21.15.5:0/2989507625 shutdown_connections 2024-08-18T22:31:16.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:16.068+0000 7f1c62e00640 1 -- 172.21.15.5:0/2989507625 wait complete. 2024-08-18T22:31:16.087 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-08-18T22:31:21.088 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:21.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.232+0000 7fbec9400640 1 Processor -- start 2024-08-18T22:31:21.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.232+0000 7fbec9400640 1 -- start start 2024-08-18T22:31:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec9400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec4161540 0x7fbec415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec9400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbec406f100 0x7fbec415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec9400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec406f950 con 0x7fbec415e7a0 2024-08-18T22:31:21.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec9400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbec41600a0 con 0x7fbec406f100 2024-08-18T22:31:21.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec9400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbec415f600 con 0x7fbec4161540 2024-08-18T22:31:21.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec2800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbec415e7a0 0x7fbec406e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39840/0 (socket says 172.21.15.5:39840) 2024-08-18T22:31:21.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec2800640 1 -- 172.21.15.5:0/2939289471 learned_addr learned my addr 172.21.15.5:0/2939289471 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:21.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec3200640 1 --2- 172.21.15.5:0/2939289471 >> v2:172.21.15.117:3300/0 conn(0x7fbec406f100 0x7fbec415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1e00640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec4161540 0x7fbec415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1483381910 0 0) 0x7fbec406f950 con 0x7fbec415e7a0 2024-08-18T22:31:21.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbea8003530 con 0x7fbec415e7a0 2024-08-18T22:31:21.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1158393666 0 0) 0x7fbea8003530 con 0x7fbec415e7a0 2024-08-18T22:31:21.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec4161540 msgr2=0x7fbec415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:21.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec4161540 0x7fbec415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 >> v2:172.21.15.117:3300/0 conn(0x7fbec406f100 msgr2=0x7fbec415f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 --2- 172.21.15.5:0/2939289471 >> v2:172.21.15.117:3300/0 conn(0x7fbec406f100 0x7fbec415f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec406f670 con 0x7fbec415e7a0 2024-08-18T22:31:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fbeb4001680 con 0x7fbec415e7a0 2024-08-18T22:31:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 >> v1:172.21.15.5:6789/0 conn(0x7fbec415e7a0 legacy=0x7fbec406e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbea80039c0 0x7fbea8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec4161540 0x7fbea8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbea8004d50 0x7fbea80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbec41600a0 con 0x7fbea80039c0 2024-08-18T22:31:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbec415f600 con 0x7fbea8004d50 2024-08-18T22:31:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbea800b9d0 con 0x7fbec4161540 2024-08-18T22:31:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec2800640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbea80039c0 0x7fbea8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec1e00640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec4161540 0x7fbea8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec3200640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbea8004d50 0x7fbea80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec2800640 1 -- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec4161540 msgr2=0x7fbea8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec2800640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbec4161540 0x7fbea8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec2800640 1 -- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbea8004d50 msgr2=0x7fbea80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec2800640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbea8004d50 0x7fbea80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec2800640 1 -- 172.21.15.5:0/2939289471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea8003530 con 0x7fbea80039c0 2024-08-18T22:31:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.236+0000 7fbec3200640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbea8004d50 0x7fbea80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec2800640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbea80039c0 0x7fbea8003de0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c190 tx=0x7fbeb401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db61aba9e5170ea9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4007c90 con 0x7fbea80039c0 2024-08-18T22:31:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb40a9020 con 0x7fbea80039c0 2024-08-18T22:31:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec1400640 1 -- 172.21.15.5:0/2939289471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4005ae0 con 0x7fbea80039c0 2024-08-18T22:31:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec9400640 1 -- 172.21.15.5:0/2939289471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbea80039c0 msgr2=0x7fbea8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec9400640 1 --2- 172.21.15.5:0/2939289471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbea80039c0 0x7fbea8003de0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c190 tx=0x7fbeb401cbe0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec3200640 1 -- 172.21.15.5:0/2939289471 reap_dead start 2024-08-18T22:31:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec9400640 1 -- 172.21.15.5:0/2939289471 shutdown_connections 2024-08-18T22:31:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec9400640 1 -- 172.21.15.5:0/2939289471 >> 172.21.15.5:0/2939289471 conn(0x7fbec4070190 msgr2=0x7fbec406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec9400640 1 -- 172.21.15.5:0/2939289471 shutdown_connections 2024-08-18T22:31:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec9400640 1 -- 172.21.15.5:0/2939289471 wait complete. 2024-08-18T22:31:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec9400640 1 Processor -- start 2024-08-18T22:31:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.240+0000 7fbec9400640 1 -- start start 2024-08-18T22:31:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec9400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea80039c0 0x7fbec4163510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40ca7f0 0x7fbec41fa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec9400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec40cac70 0x7fbec41fabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec9400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbec4168940 con 0x7fbec40ca7f0 2024-08-18T22:31:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec9400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbec41687c0 con 0x7fbec40cac70 2024-08-18T22:31:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec9400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbec4168ac0 con 0x7fbea80039c0 2024-08-18T22:31:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40ca7f0 0x7fbec41fa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec1e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40ca7f0 0x7fbec41fa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42854/0 (socket says 172.21.15.5:42854) 2024-08-18T22:31:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec1e00640 1 -- 172.21.15.5:0/1057867216 learned_addr learned my addr 172.21.15.5:0/1057867216 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec2800640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea80039c0 0x7fbec4163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec3200640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec40cac70 0x7fbec41fabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec1e00640 1 -- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea80039c0 msgr2=0x7fbec4163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec1e00640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea80039c0 0x7fbec4163510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec1e00640 1 -- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec40cac70 msgr2=0x7fbec41fabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec1e00640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec40cac70 0x7fbec41fabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec1e00640 1 -- 172.21.15.5:0/1057867216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec41fb210 con 0x7fbec40ca7f0 2024-08-18T22:31:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec1e00640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40ca7f0 0x7fbec41fa6a0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0011930 tx=0x7fbeb0011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbebaa00640 1 -- 172.21.15.5:0/1057867216 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb000faf0 con 0x7fbec40ca7f0 2024-08-18T22:31:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbebaa00640 1 -- 172.21.15.5:0/1057867216 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb000fc90 con 0x7fbec40ca7f0 2024-08-18T22:31:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbebaa00640 1 -- 172.21.15.5:0/1057867216 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0014440 con 0x7fbec40ca7f0 2024-08-18T22:31:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec9400640 1 -- 172.21.15.5:0/1057867216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec41fb4f0 con 0x7fbec40ca7f0 2024-08-18T22:31:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec9400640 1 -- 172.21.15.5:0/1057867216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec40ce280 con 0x7fbec40ca7f0 2024-08-18T22:31:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.244+0000 7fbec9400640 1 -- 172.21.15.5:0/1057867216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec415f0a0 con 0x7fbec40ca7f0 2024-08-18T22:31:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.248+0000 7fbebaa00640 1 -- 172.21.15.5:0/1057867216 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbeb0012040 con 0x7fbec40ca7f0 2024-08-18T22:31:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.248+0000 7fbebaa00640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbea40678f0 0x7fbea4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.248+0000 7fbebaa00640 1 -- 172.21.15.5:0/1057867216 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7fbeb0086490 con 0x7fbec40ca7f0 2024-08-18T22:31:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.248+0000 7fbec2800640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbea40678f0 0x7fbea4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.248+0000 7fbec2800640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbea40678f0 0x7fbea4069db0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40aa000 tx=0x7fbeb40b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.252+0000 7fbebaa00640 1 -- 172.21.15.5:0/1057867216 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbeb0019030 con 0x7fbec40ca7f0 2024-08-18T22:31:21.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.448+0000 7fbec9400640 1 -- 172.21.15.5:0/1057867216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbec406e860 con 0x7fbec40ca7f0 2024-08-18T22:31:21.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbebaa00640 1 -- 172.21.15.5:0/1057867216 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4413 (secure 0 0 0) 0x7fbeb0056700 con 0x7fbec40ca7f0 2024-08-18T22:31:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:21.451 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":129,"btime":"2024-08-18T22:31:19:462942+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:31:19.462935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8740":{"gid":8740,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8740,"qdb_cluster":[8740]},"id":11}]} 2024-08-18T22:31:21.451 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 129 2024-08-18T22:31:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 -- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbea40678f0 msgr2=0x7fbea4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbea40678f0 0x7fbea4069db0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40aa000 tx=0x7fbeb40b1040 comp rx=0 tx=0).stop 2024-08-18T22:31:21.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 -- 172.21.15.5:0/1057867216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40ca7f0 msgr2=0x7fbec41fa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40ca7f0 0x7fbec41fa6a0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0011930 tx=0x7fbeb0011df0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 -- 172.21.15.5:0/1057867216 shutdown_connections 2024-08-18T22:31:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbea40678f0 0x7fbea4069db0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbec40cac70 0x7fbec41fabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40ca7f0 0x7fbec41fa6a0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 --2- 172.21.15.5:0/1057867216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbea80039c0 0x7fbec4163510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 -- 172.21.15.5:0/1057867216 >> 172.21.15.5:0/1057867216 conn(0x7fbec4070190 msgr2=0x7fbec406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 -- 172.21.15.5:0/1057867216 shutdown_connections 2024-08-18T22:31:21.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.452+0000 7fbec9400640 1 -- 172.21.15.5:0/1057867216 wait complete. 2024-08-18T22:31:21.471 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-08-18T22:31:21.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:21.524 INFO:tasks.ceph.mds.c.smithi005.stderr:2024-08-18T22:31:21.524+0000 7fcd4a200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:31:21.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.612+0000 7f5a53e00640 1 Processor -- start 2024-08-18T22:31:21.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.612+0000 7f5a53e00640 1 -- start start 2024-08-18T22:31:21.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.612+0000 7f5a53e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a4c1618d0 0x7f5a4c15f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.612+0000 7f5a53e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a4c161d40 0x7f5a4c15f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.612+0000 7f5a53e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a4c162300 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.612+0000 7f5a53e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5a4c1625e0 con 0x7f5a4c1618d0 2024-08-18T22:31:21.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.612+0000 7f5a53e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4c1628c0 con 0x7f5a4c161d40 2024-08-18T22:31:21.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.612+0000 7f5a51400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a4c1618d0 0x7f5a4c15f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.612+0000 7f5a51400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a4c1618d0 0x7f5a4c15f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42864/0 (socket says 172.21.15.5:42864) 2024-08-18T22:31:21.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.612+0000 7f5a51400640 1 -- 172.21.15.5:0/2869069514 learned_addr learned my addr 172.21.15.5:0/2869069514 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:21.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.612+0000 7f5a51e00640 1 --1- 172.21.15.5:0/2869069514 >> v1:172.21.15.5:6789/0 conn(0x7f5a4c0c92d0 0x7f5a4c0ce860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39848/0 (socket says 172.21.15.5:39848) 2024-08-18T22:31:21.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.616+0000 7f5a50a00640 1 --2- 172.21.15.5:0/2869069514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a4c161d40 0x7f5a4c15f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.616+0000 7f5a51400640 1 -- 172.21.15.5:0/2869069514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a4c161d40 msgr2=0x7f5a4c15f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:21.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.616+0000 7f5a51400640 1 --2- 172.21.15.5:0/2869069514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a4c161d40 0x7f5a4c15f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.616+0000 7f5a51400640 1 -- 172.21.15.5:0/2869069514 >> v1:172.21.15.5:6789/0 conn(0x7f5a4c0c92d0 legacy=0x7f5a4c0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.616+0000 7f5a51400640 1 -- 172.21.15.5:0/2869069514 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c162ba0 con 0x7f5a4c1618d0 2024-08-18T22:31:21.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.616+0000 7f5a50a00640 1 --2- 172.21.15.5:0/2869069514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a4c161d40 0x7f5a4c15f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.616+0000 7f5a51400640 1 --2- 172.21.15.5:0/2869069514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4c1618d0 0x7f5a4c15f1d0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009e50 tx=0x7f5a4001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34811689bbd9db0c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.616+0000 7f5a4be00640 1 -- 172.21.15.5:0/2869069514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a400a5700 con 0x7f5a4c1618d0 2024-08-18T22:31:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.616+0000 7f5a4be00640 1 -- 172.21.15.5:0/2869069514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a400a58a0 con 0x7f5a4c1618d0 2024-08-18T22:31:21.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.616+0000 7f5a4be00640 1 -- 172.21.15.5:0/2869069514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a400a5c70 con 0x7f5a4c1618d0 2024-08-18T22:31:21.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 -- 172.21.15.5:0/2869069514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4c1618d0 msgr2=0x7f5a4c15f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 --2- 172.21.15.5:0/2869069514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4c1618d0 0x7f5a4c15f1d0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009e50 tx=0x7f5a4001ca30 comp rx=0 tx=0).stop 2024-08-18T22:31:21.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 -- 172.21.15.5:0/2869069514 shutdown_connections 2024-08-18T22:31:21.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 --2- 172.21.15.5:0/2869069514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a4c161d40 0x7f5a4c15f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 --2- 172.21.15.5:0/2869069514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4c1618d0 0x7f5a4c15f1d0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 -- 172.21.15.5:0/2869069514 >> 172.21.15.5:0/2869069514 conn(0x7f5a4c0b1c50 msgr2=0x7f5a4c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:21.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 -- 172.21.15.5:0/2869069514 shutdown_connections 2024-08-18T22:31:21.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 -- 172.21.15.5:0/2869069514 wait complete. 2024-08-18T22:31:21.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 Processor -- start 2024-08-18T22:31:21.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 -- start start 2024-08-18T22:31:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4c0c92d0 0x7f5a4c1579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a4c1618d0 0x7f5a4c0cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a4c161d40 0x7f5a4c15be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c16b8f0 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c0cf380 con 0x7f5a4c1618d0 2024-08-18T22:31:21.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a53e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4c16ba70 con 0x7f5a4c161d40 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a51400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4c0c92d0 0x7f5a4c1579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a51400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4c0c92d0 0x7f5a4c1579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42876/0 (socket says 172.21.15.5:42876) 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a51400640 1 -- 172.21.15.5:0/2130916808 learned_addr learned my addr 172.21.15.5:0/2130916808 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a51e00640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a4c161d40 0x7f5a4c15be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a50a00640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a4c1618d0 0x7f5a4c0cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a51400640 1 -- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a4c161d40 msgr2=0x7f5a4c15be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a51400640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a4c161d40 0x7f5a4c15be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a51400640 1 -- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a4c1618d0 msgr2=0x7f5a4c0cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a51400640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a4c1618d0 0x7f5a4c0cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a51400640 1 -- 172.21.15.5:0/2130916808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c0caf10 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a50a00640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a4c1618d0 0x7f5a4c0cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.620+0000 7f5a51400640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4c0c92d0 0x7f5a4c1579d0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f5a4001a660 tx=0x7f5a400197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:21.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.624+0000 7f5a49600640 1 -- 172.21.15.5:0/2130916808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a400b8470 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.624+0000 7f5a49600640 1 -- 172.21.15.5:0/2130916808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a400b8630 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.624+0000 7f5a49600640 1 -- 172.21.15.5:0/2130916808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a400b8a20 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.624+0000 7f5a53e00640 1 -- 172.21.15.5:0/2130916808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4c0cb1f0 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.624+0000 7f5a53e00640 1 -- 172.21.15.5:0/2130916808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4c0cb7b0 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.624+0000 7f5a53e00640 1 -- 172.21.15.5:0/2130916808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4c15f1d0 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.624+0000 7f5a49600640 1 -- 172.21.15.5:0/2130916808 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a400c0020 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.624+0000 7f5a49600640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5a2c0678c0 0x7f5a2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.624+0000 7f5a49600640 1 -- 172.21.15.5:0/2130916808 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f5a401207c0 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.624+0000 7f5a50a00640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5a2c0678c0 0x7f5a2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.628+0000 7f5a50a00640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5a2c0678c0 0x7f5a2c069d80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c156fe0 tx=0x7f5a38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:21.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.632+0000 7f5a49600640 1 -- 172.21.15.5:0/2130916808 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5a400c7020 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.828+0000 7f5a53e00640 1 -- 172.21.15.5:0/2130916808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a4c06df80 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.828+0000 7f5a49600640 1 -- 172.21.15.5:0/2130916808 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4413 (secure 0 0 0) 0x7f5a40016620 con 0x7f5a4c0c92d0 2024-08-18T22:31:21.829 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:21.829 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":129,"btime":"2024-08-18T22:31:19:462942+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:31:19.462935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8740":{"gid":8740,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8740,"qdb_cluster":[8740]},"id":11}]} 2024-08-18T22:31:21.829 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 129 2024-08-18T22:31:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 -- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5a2c0678c0 msgr2=0x7f5a2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5a2c0678c0 0x7f5a2c069d80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c156fe0 tx=0x7f5a38008040 comp rx=0 tx=0).stop 2024-08-18T22:31:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 -- 172.21.15.5:0/2130916808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4c0c92d0 msgr2=0x7f5a4c1579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4c0c92d0 0x7f5a4c1579d0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f5a4001a660 tx=0x7f5a400197d0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 -- 172.21.15.5:0/2130916808 shutdown_connections 2024-08-18T22:31:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5a2c0678c0 0x7f5a2c069d80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a4c161d40 0x7f5a4c15be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a4c1618d0 0x7f5a4c0cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 --2- 172.21.15.5:0/2130916808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a4c0c92d0 0x7f5a4c1579d0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 -- 172.21.15.5:0/2130916808 >> 172.21.15.5:0/2130916808 conn(0x7f5a4c0b1c50 msgr2=0x7f5a4c15b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 -- 172.21.15.5:0/2130916808 shutdown_connections 2024-08-18T22:31:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.832+0000 7f5a53e00640 1 -- 172.21.15.5:0/2130916808 wait complete. 2024-08-18T22:31:21.850 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-08-18T22:31:21.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:31:21.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94d0400640 1 Processor -- start 2024-08-18T22:31:21.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94d0400640 1 -- start start 2024-08-18T22:31:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94d0400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94c815bed0 0x7f94c80735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94d0400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c806da70 0x7f94c806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94d0400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94c8073c80 con 0x7f94c80cb390 2024-08-18T22:31:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94d0400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f94c806e420 con 0x7f94c815bed0 2024-08-18T22:31:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94d0400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f94c80ca5d0 con 0x7f94c806da70 2024-08-18T22:31:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94cda00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94c815bed0 0x7f94c80735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94cda00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94c815bed0 0x7f94c80735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42888/0 (socket says 172.21.15.5:42888) 2024-08-18T22:31:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94cda00640 1 -- 172.21.15.5:0/3337090850 learned_addr learned my addr 172.21.15.5:0/3337090850 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94cd000640 1 --1- 172.21.15.5:0/3337090850 >> v1:172.21.15.5:6789/0 conn(0x7f94c80cb390 0x7f94c8071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39858/0 (socket says 172.21.15.5:39858) 2024-08-18T22:31:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94cda00640 1 -- 172.21.15.5:0/3337090850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c806da70 msgr2=0x7f94c806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94cda00640 1 --2- 172.21.15.5:0/3337090850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c806da70 0x7f94c806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94cda00640 1 -- 172.21.15.5:0/3337090850 >> v1:172.21.15.5:6789/0 conn(0x7f94c80cb390 legacy=0x7f94c8071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.992+0000 7f94cda00640 1 -- 172.21.15.5:0/3337090850 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c80ca8b0 con 0x7f94c815bed0 2024-08-18T22:31:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94cda00640 1 --2- 172.21.15.5:0/3337090850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94c815bed0 0x7f94c80735a0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009870 tx=0x7f94bc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329f691cb4deaef6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94c7e00640 1 -- 172.21.15.5:0/3337090850 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0a95f0 con 0x7f94c815bed0 2024-08-18T22:31:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94c7e00640 1 -- 172.21.15.5:0/3337090850 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94bc0a9790 con 0x7f94c815bed0 2024-08-18T22:31:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94c7e00640 1 -- 172.21.15.5:0/3337090850 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0a9b60 con 0x7f94c815bed0 2024-08-18T22:31:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94d0400640 1 -- 172.21.15.5:0/3337090850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94c815bed0 msgr2=0x7f94c80735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94d0400640 1 --2- 172.21.15.5:0/3337090850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94c815bed0 0x7f94c80735a0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009870 tx=0x7f94bc01c530 comp rx=0 tx=0).stop 2024-08-18T22:31:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94d0400640 1 -- 172.21.15.5:0/3337090850 shutdown_connections 2024-08-18T22:31:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94d0400640 1 --2- 172.21.15.5:0/3337090850 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c806da70 0x7f94c806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94d0400640 1 --2- 172.21.15.5:0/3337090850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94c815bed0 0x7f94c80735a0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94d0400640 1 -- 172.21.15.5:0/3337090850 >> 172.21.15.5:0/3337090850 conn(0x7f94c80b1c50 msgr2=0x7f94c80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94d0400640 1 -- 172.21.15.5:0/3337090850 shutdown_connections 2024-08-18T22:31:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94d0400640 1 -- 172.21.15.5:0/3337090850 wait complete. 2024-08-18T22:31:21.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94d0400640 1 Processor -- start 2024-08-18T22:31:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:21.996+0000 7f94d0400640 1 -- start start 2024-08-18T22:31:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94d0400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94c806da70 0x7f94c815aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94d0400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94c80cb390 0x7f94c8157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94d0400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c815bed0 0x7f94c80b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94d0400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94c8168520 con 0x7f94c806da70 2024-08-18T22:31:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94d0400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f94c81683a0 con 0x7f94c80cb390 2024-08-18T22:31:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94d0400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f94c81686a0 con 0x7f94c815bed0 2024-08-18T22:31:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94cda00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94c806da70 0x7f94c815aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94cda00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94c806da70 0x7f94c815aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42896/0 (socket says 172.21.15.5:42896) 2024-08-18T22:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94cda00640 1 -- 172.21.15.5:0/3477012342 learned_addr learned my addr 172.21.15.5:0/3477012342 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94cd000640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94c80cb390 0x7f94c8157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94ce400640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c815bed0 0x7f94c80b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94cda00640 1 -- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c815bed0 msgr2=0x7f94c80b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94cda00640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c815bed0 0x7f94c80b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94cda00640 1 -- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94c80cb390 msgr2=0x7f94c8157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94cda00640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94c80cb390 0x7f94c8157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94cda00640 1 -- 172.21.15.5:0/3477012342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c81fa290 con 0x7f94c806da70 2024-08-18T22:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94cd000640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94c80cb390 0x7f94c8157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94cda00640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94c806da70 0x7f94c815aa80 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f94bc01a160 tx=0x7f94bc01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94c5600640 1 -- 172.21.15.5:0/3477012342 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0b1800 con 0x7f94c806da70 2024-08-18T22:31:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94c5600640 1 -- 172.21.15.5:0/3477012342 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94bc0b19c0 con 0x7f94c806da70 2024-08-18T22:31:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94c5600640 1 -- 172.21.15.5:0/3477012342 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0b1db0 con 0x7f94c806da70 2024-08-18T22:31:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94d0400640 1 -- 172.21.15.5:0/3477012342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c81fa570 con 0x7f94c806da70 2024-08-18T22:31:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94d0400640 1 -- 172.21.15.5:0/3477012342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c81fab30 con 0x7f94c806da70 2024-08-18T22:31:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94d0400640 1 -- 172.21.15.5:0/3477012342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94c806dee0 con 0x7f94c806da70 2024-08-18T22:31:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.000+0000 7f94c5600640 1 -- 172.21.15.5:0/3477012342 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f94bc0bc450 con 0x7f94c806da70 2024-08-18T22:31:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.004+0000 7f94c5600640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94a80678c0 0x7f94a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.004+0000 7f94c5600640 1 -- 172.21.15.5:0/3477012342 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f94bc1207f0 con 0x7f94c806da70 2024-08-18T22:31:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.004+0000 7f94cd000640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94a80678c0 0x7f94a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.004+0000 7f94cd000640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94a80678c0 0x7f94a8069d80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f94c8156580 tx=0x7f94b4007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:22.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.008+0000 7f94c5600640 1 -- 172.21.15.5:0/3477012342 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f94bc0c3030 con 0x7f94c806da70 2024-08-18T22:31:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.232+0000 7f94d0400640 1 -- 172.21.15.5:0/3477012342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f94c80b07e0 con 0x7f94c806da70 2024-08-18T22:31:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.232+0000 7f94c5600640 1 -- 172.21.15.5:0/3477012342 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1090 (secure 0 0 0) 0x7f94bc0ad020 con 0x7f94c806da70 2024-08-18T22:31:22.233 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:22.233 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":745,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":167,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076447843,"bytes_used":2602733568,"bytes_avail":770491379712,"bytes_total":773094113280,"read_bytes_sec":219180,"write_bytes_sec":204,"read_op_per_sec":1,"write_op_per_sec":0},"fsmap":{"epoch":129,"btime":"2024-08-18T22:31:19:462942+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":8740}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-08-18T22:31:17.796771+0000","services":{}},"progress_events":{}} 2024-08-18T22:31:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 -- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94a80678c0 msgr2=0x7f94a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94a80678c0 0x7f94a8069d80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f94c8156580 tx=0x7f94b4007d70 comp rx=0 tx=0).stop 2024-08-18T22:31:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 -- 172.21.15.5:0/3477012342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94c806da70 msgr2=0x7f94c815aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94c806da70 0x7f94c815aa80 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f94bc01a160 tx=0x7f94bc01ad70 comp rx=0 tx=0).stop 2024-08-18T22:31:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 -- 172.21.15.5:0/3477012342 shutdown_connections 2024-08-18T22:31:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f94a80678c0 0x7f94a8069d80 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94c815bed0 0x7f94c80b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94c80cb390 0x7f94c8157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 --2- 172.21.15.5:0/3477012342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94c806da70 0x7f94c815aa80 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 -- 172.21.15.5:0/3477012342 >> 172.21.15.5:0/3477012342 conn(0x7f94c80b1c50 msgr2=0x7f94c80cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 -- 172.21.15.5:0/3477012342 shutdown_connections 2024-08-18T22:31:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.236+0000 7f94d0400640 1 -- 172.21.15.5:0/3477012342 wait complete. 2024-08-18T22:31:22.254 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:31:22.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:31:22.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:31:22.415 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:31:22.415 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:31:22.415 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:31:22.415 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:31:22.424 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:31:22.424 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:31:22.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:31:22.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d67e00640 1 Processor -- start 2024-08-18T22:31:22.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d67e00640 1 -- start start 2024-08-18T22:31:22.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d67e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006d0d0 0x7f8d6006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:22.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d67e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d6015e7b0 0x7f8d600af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:22.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d67e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6015f780 con 0x7f8d60158710 2024-08-18T22:31:22.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d67e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6015eee0 con 0x7f8d6015e7b0 2024-08-18T22:31:22.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d67e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6015f1c0 con 0x7f8d6006d0d0 2024-08-18T22:31:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d65e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d6015e7b0 0x7f8d600af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d64a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006d0d0 0x7f8d6006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d65e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d6015e7b0 0x7f8d600af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:43742/0 (socket says 172.21.15.5:43742) 2024-08-18T22:31:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d65e00640 1 -- 172.21.15.5:0/604757269 learned_addr learned my addr 172.21.15.5:0/604757269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.664+0000 7f8d65400640 1 --1- 172.21.15.5:0/604757269 >> v1:172.21.15.117:6789/0 conn(0x7f8d60158710 0x7f8d6006c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:54396/0 (socket says 172.21.15.5:54396) 2024-08-18T22:31:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.668+0000 7f8d65e00640 1 -- 172.21.15.5:0/604757269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006d0d0 msgr2=0x7f8d6006ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.668+0000 7f8d65e00640 1 --2- 172.21.15.5:0/604757269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006d0d0 0x7f8d6006ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.668+0000 7f8d65e00640 1 -- 172.21.15.5:0/604757269 >> v1:172.21.15.117:6789/0 conn(0x7f8d60158710 legacy=0x7f8d6006c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.668+0000 7f8d65e00640 1 -- 172.21.15.5:0/604757269 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6015f4a0 con 0x7f8d6015e7b0 2024-08-18T22:31:22.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.668+0000 7f8d64a00640 1 --2- 172.21.15.5:0/604757269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006d0d0 0x7f8d6006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:31:22.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.668+0000 7f8d65e00640 1 --2- 172.21.15.5:0/604757269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6015e7b0 0x7f8d600af390 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009e50 tx=0x7f8d5801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4fa6220309a69d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:22.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.668+0000 7f8d5fe00640 1 -- 172.21.15.5:0/604757269 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d580a55b0 con 0x7f8d6015e7b0 2024-08-18T22:31:22.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.668+0000 7f8d5fe00640 1 -- 172.21.15.5:0/604757269 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d580a5750 con 0x7f8d6015e7b0 2024-08-18T22:31:22.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.668+0000 7f8d5fe00640 1 -- 172.21.15.5:0/604757269 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d580a5b20 con 0x7f8d6015e7b0 2024-08-18T22:31:22.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 -- 172.21.15.5:0/604757269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6015e7b0 msgr2=0x7f8d600af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:22.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 --2- 172.21.15.5:0/604757269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6015e7b0 0x7f8d600af390 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009e50 tx=0x7f8d5801c8c0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 -- 172.21.15.5:0/604757269 shutdown_connections 2024-08-18T22:31:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 --2- 172.21.15.5:0/604757269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6015e7b0 0x7f8d600af390 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 --2- 172.21.15.5:0/604757269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006d0d0 0x7f8d6006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 -- 172.21.15.5:0/604757269 >> 172.21.15.5:0/604757269 conn(0x7f8d60072350 msgr2=0x7f8d60072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 -- 172.21.15.5:0/604757269 shutdown_connections 2024-08-18T22:31:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 -- 172.21.15.5:0/604757269 wait complete. 2024-08-18T22:31:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 Processor -- start 2024-08-18T22:31:22.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 -- start start 2024-08-18T22:31:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6006d0d0 0x7f8d6014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d60158710 0x7f8d6014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6015e7b0 0x7f8d600cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8d600b5050 con 0x7f8d60158710 2024-08-18T22:31:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8d600b4ed0 con 0x7f8d6006d0d0 2024-08-18T22:31:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d67e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8d600b00e0 con 0x7f8d6015e7b0 2024-08-18T22:31:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d64a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d60158710 0x7f8d6014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d64a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d60158710 0x7f8d6014db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42904/0 (socket says 172.21.15.5:42904) 2024-08-18T22:31:22.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d64a00640 1 -- 172.21.15.5:0/675398144 learned_addr learned my addr 172.21.15.5:0/675398144 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d65400640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6006d0d0 0x7f8d6014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d64a00640 1 -- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6015e7b0 msgr2=0x7f8d600cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d65e00640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6015e7b0 0x7f8d600cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d64a00640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6015e7b0 0x7f8d600cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d64a00640 1 -- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6006d0d0 msgr2=0x7f8d6014ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d64a00640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6006d0d0 0x7f8d6014ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d64a00640 1 -- 172.21.15.5:0/675398144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6014e190 con 0x7f8d60158710 2024-08-18T22:31:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d65400640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6006d0d0 0x7f8d6014ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d65e00640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6015e7b0 0x7f8d600cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.672+0000 7f8d64a00640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d60158710 0x7f8d6014db00 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00ebe0 tx=0x7f8d4c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.676+0000 7f8d5d600640 1 -- 172.21.15.5:0/675398144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c017070 con 0x7f8d60158710 2024-08-18T22:31:22.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.676+0000 7f8d5d600640 1 -- 172.21.15.5:0/675398144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4c00cc30 con 0x7f8d60158710 2024-08-18T22:31:22.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.676+0000 7f8d67e00640 1 -- 172.21.15.5:0/675398144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6014ce40 con 0x7f8d60158710 2024-08-18T22:31:22.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.676+0000 7f8d5d600640 1 -- 172.21.15.5:0/675398144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c013470 con 0x7f8d60158710 2024-08-18T22:31:22.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.676+0000 7f8d67e00640 1 -- 172.21.15.5:0/675398144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d600b04a0 con 0x7f8d60158710 2024-08-18T22:31:22.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.676+0000 7f8d67e00640 1 -- 172.21.15.5:0/675398144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6006ef60 con 0x7f8d60158710 2024-08-18T22:31:22.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.676+0000 7f8d5d600640 1 -- 172.21.15.5:0/675398144 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8d4c01a070 con 0x7f8d60158710 2024-08-18T22:31:22.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.676+0000 7f8d5d600640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d400678c0 0x7f8d40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:22.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.676+0000 7f8d5d600640 1 -- 172.21.15.5:0/675398144 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f8d4c086240 con 0x7f8d60158710 2024-08-18T22:31:22.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.676+0000 7f8d65400640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d400678c0 0x7f8d40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:22.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.676+0000 7f8d65400640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d400678c0 0x7f8d40069d80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8d54000f70 tx=0x7f8d54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:22.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.680+0000 7f8d5d600640 1 -- 172.21.15.5:0/675398144 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8d4c056b00 con 0x7f8d60158710 2024-08-18T22:31:22.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.856+0000 7f8d67e00640 1 -- 172.21.15.5:0/675398144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8d60157e50 con 0x7f8d60158710 2024-08-18T22:31:22.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.856+0000 7f8d5d600640 1 -- 172.21.15.5:0/675398144 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v167) ==== 80+0+118 (secure 0 0 0) 0x7f8d4c056400 con 0x7f8d60158710 2024-08-18T22:31:22.858 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6835/324683204 2024-08-19T22:31:16.452649+0000 2024-08-18T22:31:22.858 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6833/324683204 2024-08-19T22:31:16.452649+0000 2024-08-18T22:31:22.858 INFO:teuthology.orchestra.run.smithi005.stderr:listed 2 entries 2024-08-18T22:31:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 -- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d400678c0 msgr2=0x7f8d40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d400678c0 0x7f8d40069d80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8d54000f70 tx=0x7f8d54009040 comp rx=0 tx=0).stop 2024-08-18T22:31:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 -- 172.21.15.5:0/675398144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d60158710 msgr2=0x7f8d6014db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d60158710 0x7f8d6014db00 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00ebe0 tx=0x7f8d4c00c520 comp rx=0 tx=0).stop 2024-08-18T22:31:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 -- 172.21.15.5:0/675398144 shutdown_connections 2024-08-18T22:31:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8d400678c0 0x7f8d40069d80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6015e7b0 0x7f8d600cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d60158710 0x7f8d6014db00 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 --2- 172.21.15.5:0/675398144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6006d0d0 0x7f8d6014ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 -- 172.21.15.5:0/675398144 >> 172.21.15.5:0/675398144 conn(0x7f8d60072350 msgr2=0x7f8d600b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:22.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 -- 172.21.15.5:0/675398144 shutdown_connections 2024-08-18T22:31:22.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:22.860+0000 7f8d67e00640 1 -- 172.21.15.5:0/675398144 wait complete. 2024-08-18T22:31:22.879 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:31:22.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:31:22.879 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:31:22.905 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:31:22.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:31:22.905 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:31:22.958 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:31:22.959 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:31:22.959 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:31:22.968 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:31:22.969 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:31:22.969 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:31:22.969 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:31:23.009 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:31:23.010 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:31:23.010 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:31:23.010 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:31:23.020 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:31:23.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.192+0000 7f848ba00640 1 Processor -- start 2024-08-18T22:31:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.192+0000 7f848ba00640 1 -- start start 2024-08-18T22:31:23.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f848ba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84840cb390 0x7f84840735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f848ba00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f848406da70 0x7f848406df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f848ba00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8484073c80 con 0x7f848415bed0 2024-08-18T22:31:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f848ba00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f84840ca5d0 con 0x7f848406da70 2024-08-18T22:31:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f848ba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f84840ca8b0 con 0x7f84840cb390 2024-08-18T22:31:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f8489a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f848406da70 0x7f848406df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f8489a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f848406da70 0x7f848406df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42912/0 (socket says 172.21.15.5:42912) 2024-08-18T22:31:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f8489a00640 1 -- 172.21.15.5:0/3435465256 learned_addr learned my addr 172.21.15.5:0/3435465256 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:23.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f8483e00640 1 --2- 172.21.15.5:0/3435465256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84840cb390 0x7f84840735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f8489a00640 1 -- 172.21.15.5:0/3435465256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84840cb390 msgr2=0x7f84840735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:23.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f8489a00640 1 --2- 172.21.15.5:0/3435465256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84840cb390 0x7f84840735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f8489a00640 1 -- 172.21.15.5:0/3435465256 >> v1:172.21.15.117:6789/0 conn(0x7f848415bed0 legacy=0x7f8484071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:23.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.196+0000 7f8489a00640 1 -- 172.21.15.5:0/3435465256 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84840cab90 con 0x7f848406da70 2024-08-18T22:31:23.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f8489a00640 1 --2- 172.21.15.5:0/3435465256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f848406da70 0x7f848406df00 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f847c009e50 tx=0x7f847c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5e9e70de7174ab server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:23.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f8483400640 1 -- 172.21.15.5:0/3435465256 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c0a5780 con 0x7f848406da70 2024-08-18T22:31:23.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f8483400640 1 -- 172.21.15.5:0/3435465256 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847c0a5920 con 0x7f848406da70 2024-08-18T22:31:23.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f8483400640 1 -- 172.21.15.5:0/3435465256 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c0a5cf0 con 0x7f848406da70 2024-08-18T22:31:23.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 -- 172.21.15.5:0/3435465256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f848406da70 msgr2=0x7f848406df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 --2- 172.21.15.5:0/3435465256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f848406da70 0x7f848406df00 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f847c009e50 tx=0x7f847c01c9f0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 -- 172.21.15.5:0/3435465256 shutdown_connections 2024-08-18T22:31:23.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 --2- 172.21.15.5:0/3435465256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f848406da70 0x7f848406df00 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 --2- 172.21.15.5:0/3435465256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84840cb390 0x7f84840735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 -- 172.21.15.5:0/3435465256 >> 172.21.15.5:0/3435465256 conn(0x7f84840b1c50 msgr2=0x7f84840b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:23.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 -- 172.21.15.5:0/3435465256 shutdown_connections 2024-08-18T22:31:23.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 -- 172.21.15.5:0/3435465256 wait complete. 2024-08-18T22:31:23.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 Processor -- start 2024-08-18T22:31:23.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 -- start start 2024-08-18T22:31:23.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848406da70 0x7f84840c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84840cb390 0x7f84840cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f848415bed0 0x7f84840cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8484168730 con 0x7f84840cb390 2024-08-18T22:31:23.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f84841685b0 con 0x7f848406da70 2024-08-18T22:31:23.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f848ba00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f84841688b0 con 0x7f848415bed0 2024-08-18T22:31:23.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f8483e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84840cb390 0x7f84840cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f8483e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84840cb390 0x7f84840cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42918/0 (socket says 172.21.15.5:42918) 2024-08-18T22:31:23.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.200+0000 7f8483e00640 1 -- 172.21.15.5:0/1677296589 learned_addr learned my addr 172.21.15.5:0/1677296589 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:23.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8489000640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848406da70 0x7f84840c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8489a00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f848415bed0 0x7f84840cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8483e00640 1 -- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f848415bed0 msgr2=0x7f84840cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8483e00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f848415bed0 0x7f84840cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8483e00640 1 -- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848406da70 msgr2=0x7f84840c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8483e00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848406da70 0x7f84840c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8483e00640 1 -- 172.21.15.5:0/1677296589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848415c6b0 con 0x7f84840cb390 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8489a00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f848415bed0 0x7f84840cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8489000640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848406da70 0x7f84840c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8483e00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84840cb390 0x7f84840cec10 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f847000d5f0 tx=0x7f847000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8480c00640 1 -- 172.21.15.5:0/1677296589 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84700125f0 con 0x7f84840cb390 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8480c00640 1 -- 172.21.15.5:0/1677296589 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8470019070 con 0x7f84840cb390 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8480c00640 1 -- 172.21.15.5:0/1677296589 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84700129b0 con 0x7f84840cb390 2024-08-18T22:31:23.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f848ba00640 1 -- 172.21.15.5:0/1677296589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84840cf5f0 con 0x7f84840cb390 2024-08-18T22:31:23.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f848ba00640 1 -- 172.21.15.5:0/1677296589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84840cf8d0 con 0x7f84840cb390 2024-08-18T22:31:23.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f848ba00640 1 -- 172.21.15.5:0/1677296589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f848406df00 con 0x7f84840cb390 2024-08-18T22:31:23.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.204+0000 7f8480c00640 1 -- 172.21.15.5:0/1677296589 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8470012b50 con 0x7f84840cb390 2024-08-18T22:31:23.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.208+0000 7f8480c00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84640678c0 0x7f8464069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.208+0000 7f8480c00640 1 -- 172.21.15.5:0/1677296589 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f84700862e0 con 0x7f84840cb390 2024-08-18T22:31:23.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.208+0000 7f8489000640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84640678c0 0x7f8464069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.208+0000 7f8489000640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84640678c0 0x7f8464069d80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8474003ec0 tx=0x7f8474009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:23.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.208+0000 7f8480c00640 1 -- 172.21.15.5:0/1677296589 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8470056ba0 con 0x7f84840cb390 2024-08-18T22:31:23.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 -- 172.21.15.5:0/1677296589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84840b1910 con 0x7f84840cb390 2024-08-18T22:31:23.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f8480c00640 1 -- 172.21.15.5:0/1677296589 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4413 (secure 0 0 0) 0x7f84700564a0 con 0x7f84840cb390 2024-08-18T22:31:23.407 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:23.407 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":129,"btime":"2024-08-18T22:31:19:462942+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:31:19.462935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8740":{"gid":8740,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8740,"qdb_cluster":[8740]},"id":11}]} 2024-08-18T22:31:23.407 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 129 2024-08-18T22:31:23.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 -- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84640678c0 msgr2=0x7f8464069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84640678c0 0x7f8464069d80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8474003ec0 tx=0x7f8474009040 comp rx=0 tx=0).stop 2024-08-18T22:31:23.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 -- 172.21.15.5:0/1677296589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84840cb390 msgr2=0x7f84840cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84840cb390 0x7f84840cec10 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f847000d5f0 tx=0x7f847000dab0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 -- 172.21.15.5:0/1677296589 shutdown_connections 2024-08-18T22:31:23.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f84640678c0 0x7f8464069d80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f848415bed0 0x7f84840cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84840cb390 0x7f84840cec10 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 --2- 172.21.15.5:0/1677296589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f848406da70 0x7f84840c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 -- 172.21.15.5:0/1677296589 >> 172.21.15.5:0/1677296589 conn(0x7f84840b1c50 msgr2=0x7f84840cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:23.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 -- 172.21.15.5:0/1677296589 shutdown_connections 2024-08-18T22:31:23.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.408+0000 7f848ba00640 1 -- 172.21.15.5:0/1677296589 wait complete. 2024-08-18T22:31:23.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3337000640 1 Processor -- start 2024-08-18T22:31:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3337000640 1 -- start start 2024-08-18T22:31:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3337000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3330146f10 0x7f333006f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3337000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f333006b9b0 0x7f333006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3337000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3330071040 con 0x7f3330161d70 2024-08-18T22:31:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3337000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f33300b4510 con 0x7f3330146f10 2024-08-18T22:31:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3337000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f333006c330 con 0x7f333006b9b0 2024-08-18T22:31:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3335c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3330146f10 0x7f333006f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3335c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3330146f10 0x7f333006f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51866/0 (socket says 172.21.15.5:51866) 2024-08-18T22:31:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3335c00640 1 -- 172.21.15.5:0/2784329224 learned_addr learned my addr 172.21.15.5:0/2784329224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3335200640 1 --2- 172.21.15.5:0/2784329224 >> v2:172.21.15.117:3300/0 conn(0x7f333006b9b0 0x7f333006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3335c00640 1 -- 172.21.15.5:0/2784329224 >> v2:172.21.15.117:3300/0 conn(0x7f333006b9b0 msgr2=0x7f333006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3335c00640 1 --2- 172.21.15.5:0/2784329224 >> v2:172.21.15.117:3300/0 conn(0x7f333006b9b0 0x7f333006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3335c00640 1 -- 172.21.15.5:0/2784329224 >> v1:172.21.15.5:6789/0 conn(0x7f3330161d70 legacy=0x7f3330162200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.572+0000 7f3335c00640 1 -- 172.21.15.5:0/2784329224 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33300707e0 con 0x7f3330146f10 2024-08-18T22:31:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f3335c00640 1 --2- 172.21.15.5:0/2784329224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3330146f10 0x7f333006f3b0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f333006e410 tx=0x7f332401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0488953736132f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f332fe00640 1 -- 172.21.15.5:0/2784329224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240b2070 con 0x7f3330146f10 2024-08-18T22:31:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f332fe00640 1 -- 172.21.15.5:0/2784329224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33240ad680 con 0x7f3330146f10 2024-08-18T22:31:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f332fe00640 1 -- 172.21.15.5:0/2784329224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240ada50 con 0x7f3330146f10 2024-08-18T22:31:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f3337000640 1 -- 172.21.15.5:0/2784329224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3330146f10 msgr2=0x7f333006f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f3337000640 1 --2- 172.21.15.5:0/2784329224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3330146f10 0x7f333006f3b0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f333006e410 tx=0x7f332401c490 comp rx=0 tx=0).stop 2024-08-18T22:31:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f3337000640 1 -- 172.21.15.5:0/2784329224 shutdown_connections 2024-08-18T22:31:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f3337000640 1 --2- 172.21.15.5:0/2784329224 >> v2:172.21.15.117:3300/0 conn(0x7f333006b9b0 0x7f333006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f3337000640 1 --2- 172.21.15.5:0/2784329224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3330146f10 0x7f333006f3b0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f3337000640 1 -- 172.21.15.5:0/2784329224 >> 172.21.15.5:0/2784329224 conn(0x7f333006e890 msgr2=0x7f333006eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f3337000640 1 -- 172.21.15.5:0/2784329224 shutdown_connections 2024-08-18T22:31:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.576+0000 7f3337000640 1 -- 172.21.15.5:0/2784329224 wait complete. 2024-08-18T22:31:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3337000640 1 Processor -- start 2024-08-18T22:31:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3337000640 1 -- start start 2024-08-18T22:31:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3337000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f333006b9b0 0x7f33301335e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3337000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3330146f10 0x7f3330137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3337000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3330161d70 0x7f3330160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3337000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3330147c40 con 0x7f333006b9b0 2024-08-18T22:31:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3337000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f333006f8f0 con 0x7f3330161d70 2024-08-18T22:31:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3337000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3330147dc0 con 0x7f3330146f10 2024-08-18T22:31:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3335c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f333006b9b0 0x7f33301335e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3335c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f333006b9b0 0x7f33301335e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51872/0 (socket says 172.21.15.5:51872) 2024-08-18T22:31:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3335c00640 1 -- 172.21.15.5:0/2380119666 learned_addr learned my addr 172.21.15.5:0/2380119666 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3336600640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3330161d70 0x7f3330160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3335200640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3330146f10 0x7f3330137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3335c00640 1 -- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3330146f10 msgr2=0x7f3330137ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3335c00640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3330146f10 0x7f3330137ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3335c00640 1 -- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3330161d70 msgr2=0x7f3330160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3335c00640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3330161d70 0x7f3330160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3335c00640 1 -- 172.21.15.5:0/2380119666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333015f770 con 0x7f333006b9b0 2024-08-18T22:31:23.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3335200640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3330146f10 0x7f3330137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3335c00640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f333006b9b0 0x7f33301335e0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f33240190a0 tx=0x7f332401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f332d600640 1 -- 172.21.15.5:0/2380119666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240bc020 con 0x7f333006b9b0 2024-08-18T22:31:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f332d600640 1 -- 172.21.15.5:0/2380119666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33240b8420 con 0x7f333006b9b0 2024-08-18T22:31:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3337000640 1 -- 172.21.15.5:0/2380119666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333015fa50 con 0x7f333006b9b0 2024-08-18T22:31:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f332d600640 1 -- 172.21.15.5:0/2380119666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240b2040 con 0x7f333006b9b0 2024-08-18T22:31:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.580+0000 7f3337000640 1 -- 172.21.15.5:0/2380119666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3330160010 con 0x7f333006b9b0 2024-08-18T22:31:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.584+0000 7f3337000640 1 -- 172.21.15.5:0/2380119666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3330068120 con 0x7f333006b9b0 2024-08-18T22:31:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.584+0000 7f332d600640 1 -- 172.21.15.5:0/2380119666 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33240bf020 con 0x7f333006b9b0 2024-08-18T22:31:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.584+0000 7f332d600640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33100678c0 0x7f3310069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.584+0000 7f332d600640 1 -- 172.21.15.5:0/2380119666 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f33241201a0 con 0x7f333006b9b0 2024-08-18T22:31:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.584+0000 7f3335200640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33100678c0 0x7f3310069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.584+0000 7f3335200640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33100678c0 0x7f3310069d80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f33301fafd0 tx=0x7f331c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.588+0000 7f332d600640 1 -- 172.21.15.5:0/2380119666 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f33240c6030 con 0x7f333006b9b0 2024-08-18T22:31:23.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.788+0000 7f3337000640 1 -- 172.21.15.5:0/2380119666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33300b6580 con 0x7f333006b9b0 2024-08-18T22:31:23.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.788+0000 7f332d600640 1 -- 172.21.15.5:0/2380119666 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4413 (secure 0 0 0) 0x7f3324016110 con 0x7f333006b9b0 2024-08-18T22:31:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:23.789 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":129,"btime":"2024-08-18T22:31:19:462942+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:31:19.462935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8740":{"gid":8740,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8740,"qdb_cluster":[8740]},"id":11}]} 2024-08-18T22:31:23.789 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 129 2024-08-18T22:31:23.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 -- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33100678c0 msgr2=0x7f3310069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33100678c0 0x7f3310069d80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f33301fafd0 tx=0x7f331c008040 comp rx=0 tx=0).stop 2024-08-18T22:31:23.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 -- 172.21.15.5:0/2380119666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f333006b9b0 msgr2=0x7f33301335e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f333006b9b0 0x7f33301335e0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f33240190a0 tx=0x7f332401acd0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 -- 172.21.15.5:0/2380119666 shutdown_connections 2024-08-18T22:31:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33100678c0 0x7f3310069d80 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3330161d70 0x7f3330160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3330146f10 0x7f3330137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 --2- 172.21.15.5:0/2380119666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f333006b9b0 0x7f33301335e0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 -- 172.21.15.5:0/2380119666 >> 172.21.15.5:0/2380119666 conn(0x7f333006e890 msgr2=0x7f333006ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 -- 172.21.15.5:0/2380119666 shutdown_connections 2024-08-18T22:31:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.792+0000 7f3337000640 1 -- 172.21.15.5:0/2380119666 wait complete. 2024-08-18T22:31:23.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:31:23.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:31:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3653200640 1 Processor -- start 2024-08-18T22:31:23.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3653200640 1 -- start start 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3653200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f365409b520 0x7f365415f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3653200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36540d02a0 0x7f36540d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3653200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365409b9b0 con 0x7f3654070510 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3653200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f365415f670 con 0x7f365409b520 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3653200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f365406fe70 con 0x7f36540d02a0 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3651400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f365409b520 0x7f365415f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3651e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3654070510 0x7f36540708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49292/0 (socket says 172.21.15.5:49292) 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3651e00640 1 -- 172.21.15.5:0/811748068 learned_addr learned my addr 172.21.15.5:0/811748068 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3652800640 1 --2- 172.21.15.5:0/811748068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36540d02a0 0x7f36540d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3651400640 1 -- 172.21.15.5:0/811748068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36540d02a0 msgr2=0x7f36540d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3651400640 1 --2- 172.21.15.5:0/811748068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36540d02a0 0x7f36540d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3651400640 1 -- 172.21.15.5:0/811748068 >> v1:172.21.15.5:6789/0 conn(0x7f3654070510 legacy=0x7f36540708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.952+0000 7f3651400640 1 -- 172.21.15.5:0/811748068 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3654070150 con 0x7f365409b520 2024-08-18T22:31:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3651400640 1 --2- 172.21.15.5:0/811748068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f365409b520 0x7f365415f130 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f36400097c0 tx=0x7f364001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797effe41ba9aa6c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3650a00640 1 -- 172.21.15.5:0/811748068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400b0070 con 0x7f365409b520 2024-08-18T22:31:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3650a00640 1 -- 172.21.15.5:0/811748068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36400ab600 con 0x7f365409b520 2024-08-18T22:31:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3650a00640 1 -- 172.21.15.5:0/811748068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400ab9d0 con 0x7f365409b520 2024-08-18T22:31:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3653200640 1 -- 172.21.15.5:0/811748068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f365409b520 msgr2=0x7f365415f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3653200640 1 --2- 172.21.15.5:0/811748068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f365409b520 0x7f365415f130 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f36400097c0 tx=0x7f364001c330 comp rx=0 tx=0).stop 2024-08-18T22:31:23.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3653200640 1 -- 172.21.15.5:0/811748068 shutdown_connections 2024-08-18T22:31:23.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3653200640 1 --2- 172.21.15.5:0/811748068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36540d02a0 0x7f36540d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3653200640 1 --2- 172.21.15.5:0/811748068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f365409b520 0x7f365415f130 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3653200640 1 -- 172.21.15.5:0/811748068 >> 172.21.15.5:0/811748068 conn(0x7f36540b3a20 msgr2=0x7f36540b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:23.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3653200640 1 -- 172.21.15.5:0/811748068 shutdown_connections 2024-08-18T22:31:23.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.956+0000 7f3653200640 1 -- 172.21.15.5:0/811748068 wait complete. 2024-08-18T22:31:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3653200640 1 Processor -- start 2024-08-18T22:31:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3653200640 1 -- start start 2024-08-18T22:31:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3653200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3654070510 0x7f36540c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3653200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f365409b520 0x7f36540b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3653200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36540d02a0 0x7f36540b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3653200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f36540b46d0 con 0x7f365409b520 2024-08-18T22:31:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3653200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f365406fb00 con 0x7f3654070510 2024-08-18T22:31:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3653200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f36540b4850 con 0x7f36540d02a0 2024-08-18T22:31:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3651400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f365409b520 0x7f36540b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3651400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f365409b520 0x7f36540b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51898/0 (socket says 172.21.15.5:51898) 2024-08-18T22:31:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3651400640 1 -- 172.21.15.5:0/1421393330 learned_addr learned my addr 172.21.15.5:0/1421393330 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3651e00640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3654070510 0x7f36540c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3652800640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36540d02a0 0x7f36540b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3651400640 1 -- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36540d02a0 msgr2=0x7f36540b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3651400640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36540d02a0 0x7f36540b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3651400640 1 -- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3654070510 msgr2=0x7f36540c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3651400640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3654070510 0x7f36540c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3651400640 1 -- 172.21.15.5:0/1421393330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36540b2990 con 0x7f365409b520 2024-08-18T22:31:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3651e00640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3654070510 0x7f36540c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3652800640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36540d02a0 0x7f36540b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3651400640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f365409b520 0x7f36540b00e0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f364001a9e0 tx=0x7f364001ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f364a000640 1 -- 172.21.15.5:0/1421393330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400b0050 con 0x7f365409b520 2024-08-18T22:31:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f364a000640 1 -- 172.21.15.5:0/1421393330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36400bc070 con 0x7f365409b520 2024-08-18T22:31:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f364a000640 1 -- 172.21.15.5:0/1421393330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400b5830 con 0x7f365409b520 2024-08-18T22:31:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3653200640 1 -- 172.21.15.5:0/1421393330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36540b2c70 con 0x7f365409b520 2024-08-18T22:31:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.960+0000 7f3653200640 1 -- 172.21.15.5:0/1421393330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36540b2f50 con 0x7f365409b520 2024-08-18T22:31:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.964+0000 7f3653200640 1 -- 172.21.15.5:0/1421393330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f365415f130 con 0x7f365409b520 2024-08-18T22:31:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.964+0000 7f364a000640 1 -- 172.21.15.5:0/1421393330 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36400b59d0 con 0x7f365409b520 2024-08-18T22:31:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.964+0000 7f364a000640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36340678c0 0x7f3634069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.964+0000 7f364a000640 1 -- 172.21.15.5:0/1421393330 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f3640120670 con 0x7f365409b520 2024-08-18T22:31:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.964+0000 7f3651e00640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36340678c0 0x7f3634069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.964+0000 7f3651e00640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36340678c0 0x7f3634069d80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3644000f70 tx=0x7f3644007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:23.968+0000 7f364a000640 1 -- 172.21.15.5:0/1421393330 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f3640015fb0 con 0x7f365409b520 2024-08-18T22:31:24.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.136+0000 7f3653200640 1 -- 172.21.15.5:0/1421393330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3654073d40 con 0x7f365409b520 2024-08-18T22:31:24.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.136+0000 7f364a000640 1 -- 172.21.15.5:0/1421393330 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16937 (secure 0 0 0) 0x7f36400f10e0 con 0x7f365409b520 2024-08-18T22:31:24.137 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:24.137 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":167,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:31:16.452714+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:30:17.689677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-08-18T22:30:18.956043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/324683204":"2024-08-19T22:31:16.452649+0000","172.21.15.5:6833/324683204":"2024-08-19T22:31:16.452649+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:31:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 -- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36340678c0 msgr2=0x7f3634069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36340678c0 0x7f3634069d80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3644000f70 tx=0x7f3644007d30 comp rx=0 tx=0).stop 2024-08-18T22:31:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 -- 172.21.15.5:0/1421393330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f365409b520 msgr2=0x7f36540b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f365409b520 0x7f36540b00e0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f364001a9e0 tx=0x7f364001ab70 comp rx=0 tx=0).stop 2024-08-18T22:31:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 -- 172.21.15.5:0/1421393330 shutdown_connections 2024-08-18T22:31:24.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f36340678c0 0x7f3634069d80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36540d02a0 0x7f36540b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f365409b520 0x7f36540b00e0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 --2- 172.21.15.5:0/1421393330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3654070510 0x7f36540c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 -- 172.21.15.5:0/1421393330 >> 172.21.15.5:0/1421393330 conn(0x7f36540b3a20 msgr2=0x7f36540708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 -- 172.21.15.5:0/1421393330 shutdown_connections 2024-08-18T22:31:24.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.140+0000 7f3653200640 1 -- 172.21.15.5:0/1421393330 wait complete. 2024-08-18T22:31:24.159 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:31:24.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c9a400640 1 Processor -- start 2024-08-18T22:31:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c9a400640 1 -- start start 2024-08-18T22:31:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c9a400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c9409aa40 0x7f9c9415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c9a400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c940cde30 0x7f9c9409ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c9a400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c9409b360 con 0x7f9c940b4510 2024-08-18T22:31:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c9a400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9c940ce770 con 0x7f9c9409aa40 2024-08-18T22:31:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c9a400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9415d520 con 0x7f9c940cde30 2024-08-18T22:31:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c99000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c9409aa40 0x7f9c9415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c93e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c940cde30 0x7f9c9409ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c93e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c940cde30 0x7f9c9409ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:49028/0 (socket says 172.21.15.5:49028) 2024-08-18T22:31:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c99a00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9c940b4510 0x7f9c9415fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:46614/0 (socket says 172.21.15.5:46614) 2024-08-18T22:31:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.300+0000 7f9c93e00640 1 -- 172.21.15.5:0/924334181 learned_addr learned my addr 172.21.15.5:0/924334181 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.304+0000 7f9c93e00640 1 -- 172.21.15.5:0/924334181 >> v2:172.21.15.117:3300/0 conn(0x7f9c9409aa40 msgr2=0x7f9c9415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:24.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.304+0000 7f9c93e00640 1 --2- 172.21.15.5:0/924334181 >> v2:172.21.15.117:3300/0 conn(0x7f9c9409aa40 0x7f9c9415cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.304+0000 7f9c93e00640 1 -- 172.21.15.5:0/924334181 >> v1:172.21.15.117:6789/0 conn(0x7f9c940b4510 legacy=0x7f9c9415fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.304+0000 7f9c93e00640 1 -- 172.21.15.5:0/924334181 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c940ccd90 con 0x7f9c940cde30 2024-08-18T22:31:24.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.304+0000 7f9c93e00640 1 --2- 172.21.15.5:0/924334181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c940cde30 0x7f9c9409ae20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009870 tx=0x7f9c8001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1215940f45010f2f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:24.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.304+0000 7f9c93400640 1 -- 172.21.15.5:0/924334181 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c800ab650 con 0x7f9c940cde30 2024-08-18T22:31:24.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.304+0000 7f9c93400640 1 -- 172.21.15.5:0/924334181 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c800b0070 con 0x7f9c940cde30 2024-08-18T22:31:24.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.304+0000 7f9c93400640 1 -- 172.21.15.5:0/924334181 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c800aba10 con 0x7f9c940cde30 2024-08-18T22:31:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.304+0000 7f9c9a400640 1 -- 172.21.15.5:0/924334181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c940cde30 msgr2=0x7f9c9409ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.304+0000 7f9c9a400640 1 --2- 172.21.15.5:0/924334181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c940cde30 0x7f9c9409ae20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009870 tx=0x7f9c8001c530 comp rx=0 tx=0).stop 2024-08-18T22:31:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 -- 172.21.15.5:0/924334181 shutdown_connections 2024-08-18T22:31:24.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 --2- 172.21.15.5:0/924334181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c940cde30 0x7f9c9409ae20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 --2- 172.21.15.5:0/924334181 >> v2:172.21.15.117:3300/0 conn(0x7f9c9409aa40 0x7f9c9415cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 -- 172.21.15.5:0/924334181 >> 172.21.15.5:0/924334181 conn(0x7f9c940b3a20 msgr2=0x7f9c940b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:24.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 -- 172.21.15.5:0/924334181 shutdown_connections 2024-08-18T22:31:24.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 -- 172.21.15.5:0/924334181 wait complete. 2024-08-18T22:31:24.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 Processor -- start 2024-08-18T22:31:24.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 -- start start 2024-08-18T22:31:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c9409aa40 0x7f9c94155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c940b4510 0x7f9c94151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c940cde30 0x7f9c9406de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9415c230 con 0x7f9c940b4510 2024-08-18T22:31:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9c940cd910 con 0x7f9c940cde30 2024-08-18T22:31:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c9a400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9415c3b0 con 0x7f9c9409aa40 2024-08-18T22:31:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c93e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c940b4510 0x7f9c94151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c93e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c940b4510 0x7f9c94151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51904/0 (socket says 172.21.15.5:51904) 2024-08-18T22:31:24.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c99000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c9409aa40 0x7f9c94155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c93e00640 1 -- 172.21.15.5:0/3924564971 learned_addr learned my addr 172.21.15.5:0/3924564971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:24.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c99a00640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c940cde30 0x7f9c9406de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c93e00640 1 -- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c9409aa40 msgr2=0x7f9c94155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c93e00640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c9409aa40 0x7f9c94155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c93e00640 1 -- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c940cde30 msgr2=0x7f9c9406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c93e00640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c940cde30 0x7f9c9406de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c93e00640 1 -- 172.21.15.5:0/3924564971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9406e850 con 0x7f9c940b4510 2024-08-18T22:31:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.308+0000 7f9c93e00640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c940b4510 0x7f9c94151080 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f9c800ad040 tx=0x7f9c800192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.312+0000 7f9c90c00640 1 -- 172.21.15.5:0/3924564971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c800c0680 con 0x7f9c940b4510 2024-08-18T22:31:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.312+0000 7f9c90c00640 1 -- 172.21.15.5:0/3924564971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c800c0840 con 0x7f9c940b4510 2024-08-18T22:31:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.312+0000 7f9c90c00640 1 -- 172.21.15.5:0/3924564971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c800c0c30 con 0x7f9c940b4510 2024-08-18T22:31:24.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.312+0000 7f9c9a400640 1 -- 172.21.15.5:0/3924564971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c940aeea0 con 0x7f9c940b4510 2024-08-18T22:31:24.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.312+0000 7f9c9a400640 1 -- 172.21.15.5:0/3924564971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c940af460 con 0x7f9c940b4510 2024-08-18T22:31:24.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.312+0000 7f9c9a400640 1 -- 172.21.15.5:0/3924564971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9415cfe0 con 0x7f9c940b4510 2024-08-18T22:31:24.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.312+0000 7f9c90c00640 1 -- 172.21.15.5:0/3924564971 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c800b5400 con 0x7f9c940b4510 2024-08-18T22:31:24.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.312+0000 7f9c90c00640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9c740678c0 0x7f9c74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.312+0000 7f9c90c00640 1 -- 172.21.15.5:0/3924564971 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f9c80120ba0 con 0x7f9c940b4510 2024-08-18T22:31:24.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.312+0000 7f9c99000640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9c740678c0 0x7f9c74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.316+0000 7f9c99000640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9c740678c0 0x7f9c74069d80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009b60 tx=0x7f9c84009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:24.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.316+0000 7f9c90c00640 1 -- 172.21.15.5:0/3924564971 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9c80016150 con 0x7f9c940b4510 2024-08-18T22:31:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.516+0000 7f9c9a400640 1 -- 172.21.15.5:0/3924564971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c94073d40 con 0x7f9c940b4510 2024-08-18T22:31:24.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.516+0000 7f9c90c00640 1 -- 172.21.15.5:0/3924564971 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4413 (secure 0 0 0) 0x7f9c800abe20 con 0x7f9c940b4510 2024-08-18T22:31:24.518 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:24.518 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":129,"btime":"2024-08-18T22:31:19:462942+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:31:19.462935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8740":{"gid":8740,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8740,"qdb_cluster":[8740]},"id":11}]} 2024-08-18T22:31:24.518 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 129 2024-08-18T22:31:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 -- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9c740678c0 msgr2=0x7f9c74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9c740678c0 0x7f9c74069d80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009b60 tx=0x7f9c84009190 comp rx=0 tx=0).stop 2024-08-18T22:31:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 -- 172.21.15.5:0/3924564971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c940b4510 msgr2=0x7f9c94151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c940b4510 0x7f9c94151080 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f9c800ad040 tx=0x7f9c800192d0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 -- 172.21.15.5:0/3924564971 shutdown_connections 2024-08-18T22:31:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9c740678c0 0x7f9c74069d80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c940cde30 0x7f9c9406de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c940b4510 0x7f9c94151080 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 --2- 172.21.15.5:0/3924564971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c9409aa40 0x7f9c94155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 -- 172.21.15.5:0/3924564971 >> 172.21.15.5:0/3924564971 conn(0x7f9c940b3a20 msgr2=0x7f9c940b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 -- 172.21.15.5:0/3924564971 shutdown_connections 2024-08-18T22:31:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.520+0000 7f9c9a400640 1 -- 172.21.15.5:0/3924564971 wait complete. 2024-08-18T22:31:24.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:24.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b68e00640 1 Processor -- start 2024-08-18T22:31:24.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b68e00640 1 -- start start 2024-08-18T22:31:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b68e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64071580 0x7f2b6406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b68e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b64071c80 con 0x7f2b640b54c0 2024-08-18T22:31:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b68e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b64071f60 con 0x7f2b640cbed0 2024-08-18T22:31:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b68e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2b640cba40 con 0x7f2b64071580 2024-08-18T22:31:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2b640b54c0 0x7f2b640b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49306/0 (socket says 172.21.15.5:49306) 2024-08-18T22:31:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61e00640 1 -- 172.21.15.5:0/2819923366 learned_addr learned my addr 172.21.15.5:0/2819923366 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b59400640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64071580 0x7f2b6406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652858421 0 0) 0x7f2b64071c80 con 0x7f2b640b54c0 2024-08-18T22:31:24.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b48003530 con 0x7f2b640b54c0 2024-08-18T22:31:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292993049 0 0) 0x7f2b64071f60 con 0x7f2b640cbed0 2024-08-18T22:31:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b64071c80 con 0x7f2b640cbed0 2024-08-18T22:31:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2102037720 0 0) 0x7f2b48003530 con 0x7f2b640b54c0 2024-08-18T22:31:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64071580 msgr2=0x7f2b6406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64071580 0x7f2b6406dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 >> v1:172.21.15.117:6789/0 conn(0x7f2b640cbed0 legacy=0x7f2b640cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b640cb6d0 con 0x7f2b640b54c0 2024-08-18T22:31:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f2b54001680 con 0x7f2b640b54c0 2024-08-18T22:31:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 >> v1:172.21.15.5:6789/0 conn(0x7f2b640b54c0 legacy=0x7f2b640b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b48003b80 0x7f2b48003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 0x7f2b48004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64071580 0x7f2b480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b640cba40 con 0x7f2b48004810 2024-08-18T22:31:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4800ba80 con 0x7f2b48003b80 2024-08-18T22:31:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.684+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2b4800bc80 con 0x7f2b64071580 2024-08-18T22:31:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b59400640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 0x7f2b48004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b62800640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64071580 0x7f2b480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b61e00640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b48003b80 0x7f2b48003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b59400640 1 -- 172.21.15.5:0/2819923366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64071580 msgr2=0x7f2b480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:24.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b59400640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64071580 0x7f2b480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b59400640 1 -- 172.21.15.5:0/2819923366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b48003b80 msgr2=0x7f2b48003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:24.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b59400640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b48003b80 0x7f2b48003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b59400640 1 -- 172.21.15.5:0/2819923366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b48003530 con 0x7f2b48004810 2024-08-18T22:31:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b59400640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 0x7f2b48004c90 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009ab0 tx=0x7f2b4c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6b3292dbde3752 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c0096b0 con 0x7f2b48004810 2024-08-18T22:31:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4c0a9460 con 0x7f2b48004810 2024-08-18T22:31:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.688+0000 7f2b61400640 1 -- 172.21.15.5:0/2819923366 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c0a9810 con 0x7f2b48004810 2024-08-18T22:31:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 -- 172.21.15.5:0/2819923366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 msgr2=0x7f2b48004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 --2- 172.21.15.5:0/2819923366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 0x7f2b48004c90 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009ab0 tx=0x7f2b4c01c870 comp rx=0 tx=0).stop 2024-08-18T22:31:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b62800640 1 -- 172.21.15.5:0/2819923366 reap_dead start 2024-08-18T22:31:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 -- 172.21.15.5:0/2819923366 shutdown_connections 2024-08-18T22:31:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 -- 172.21.15.5:0/2819923366 >> 172.21.15.5:0/2819923366 conn(0x7f2b640b3eb0 msgr2=0x7f2b640b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 -- 172.21.15.5:0/2819923366 shutdown_connections 2024-08-18T22:31:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 -- 172.21.15.5:0/2819923366 wait complete. 2024-08-18T22:31:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 Processor -- start 2024-08-18T22:31:24.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 -- start start 2024-08-18T22:31:24.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 0x7f2b6415dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b640cdf30 0x7f2b641f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64160da0 0x7f2b64161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b641481a0 con 0x7f2b48004810 2024-08-18T22:31:24.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2b64148020 con 0x7f2b640cdf30 2024-08-18T22:31:24.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b68e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6406dd80 con 0x7f2b64160da0 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b61e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 0x7f2b6415dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b61e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 0x7f2b6415dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51930/0 (socket says 172.21.15.5:51930) 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b61e00640 1 -- 172.21.15.5:0/3144922678 learned_addr learned my addr 172.21.15.5:0/3144922678 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b59400640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b640cdf30 0x7f2b641f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b62800640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64160da0 0x7f2b64161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b61e00640 1 -- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64160da0 msgr2=0x7f2b64161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b61e00640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64160da0 0x7f2b64161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b61e00640 1 -- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b640cdf30 msgr2=0x7f2b641f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b61e00640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b640cdf30 0x7f2b641f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b61e00640 1 -- 172.21.15.5:0/3144922678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b641f4ba0 con 0x7f2b48004810 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b62800640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64160da0 0x7f2b64161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.692+0000 7f2b61e00640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 0x7f2b6415dde0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f2b54012490 tx=0x7f2b54012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.696+0000 7f2b5aa00640 1 -- 172.21.15.5:0/3144922678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5401c070 con 0x7f2b48004810 2024-08-18T22:31:24.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.696+0000 7f2b5aa00640 1 -- 172.21.15.5:0/3144922678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b54014750 con 0x7f2b48004810 2024-08-18T22:31:24.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.696+0000 7f2b5aa00640 1 -- 172.21.15.5:0/3144922678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54014b40 con 0x7f2b48004810 2024-08-18T22:31:24.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.696+0000 7f2b68e00640 1 -- 172.21.15.5:0/3144922678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b641f5100 con 0x7f2b48004810 2024-08-18T22:31:24.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.696+0000 7f2b68e00640 1 -- 172.21.15.5:0/3144922678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b641f56c0 con 0x7f2b48004810 2024-08-18T22:31:24.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.696+0000 7f2b68e00640 1 -- 172.21.15.5:0/3144922678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b64071f60 con 0x7f2b48004810 2024-08-18T22:31:24.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.696+0000 7f2b5aa00640 1 -- 172.21.15.5:0/3144922678 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b5401f070 con 0x7f2b48004810 2024-08-18T22:31:24.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.696+0000 7f2b5aa00640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b400678f0 0x7f2b40069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.696+0000 7f2b5aa00640 1 -- 172.21.15.5:0/3144922678 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f2b54088810 con 0x7f2b48004810 2024-08-18T22:31:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.696+0000 7f2b59400640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b400678f0 0x7f2b40069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:24.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.696+0000 7f2b59400640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b400678f0 0x7f2b40069db0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0ae000 tx=0x7f2b4c0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:24.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.700+0000 7f2b5aa00640 1 -- 172.21.15.5:0/3144922678 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2b54059160 con 0x7f2b48004810 2024-08-18T22:31:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.900+0000 7f2b68e00640 1 -- 172.21.15.5:0/3144922678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b641458e0 con 0x7f2b48004810 2024-08-18T22:31:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.900+0000 7f2b5aa00640 1 -- 172.21.15.5:0/3144922678 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4413 (secure 0 0 0) 0x7f2b54058a60 con 0x7f2b48004810 2024-08-18T22:31:24.901 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:24.901 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":129,"btime":"2024-08-18T22:31:19:462942+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:30:19.963982+0000","modified":"2024-08-18T22:31:19.462935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8740":{"gid":8740,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.5:6834/2956295757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2956295757},{"type":"v1","addr":"172.21.15.5:6834","nonce":2956295757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8740,"qdb_cluster":[8740]},"id":11}]} 2024-08-18T22:31:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 129 2024-08-18T22:31:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 -- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b400678f0 msgr2=0x7f2b40069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b400678f0 0x7f2b40069db0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0ae000 tx=0x7f2b4c0b3040 comp rx=0 tx=0).stop 2024-08-18T22:31:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 -- 172.21.15.5:0/3144922678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 msgr2=0x7f2b6415dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 0x7f2b6415dde0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f2b54012490 tx=0x7f2b54012950 comp rx=0 tx=0).stop 2024-08-18T22:31:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 -- 172.21.15.5:0/3144922678 shutdown_connections 2024-08-18T22:31:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2b400678f0 0x7f2b40069db0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b64160da0 0x7f2b64161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b640cdf30 0x7f2b641f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 --2- 172.21.15.5:0/3144922678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b48004810 0x7f2b6415dde0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 -- 172.21.15.5:0/3144922678 >> 172.21.15.5:0/3144922678 conn(0x7f2b640b3eb0 msgr2=0x7f2b6406cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 -- 172.21.15.5:0/3144922678 shutdown_connections 2024-08-18T22:31:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:24.904+0000 7f2b68e00640 1 -- 172.21.15.5:0/3144922678 wait complete. 2024-08-18T22:31:24.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:31:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75ab000640 1 Processor -- start 2024-08-18T22:31:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75ab000640 1 -- start start 2024-08-18T22:31:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75ab000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a415bb20 0x7f75a415f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75ab000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75a40adc50 0x7f75a406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75ab000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75a406cf00 0x7f75a4161b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75ab000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f75a4072f80 con 0x7f75a40adc50 2024-08-18T22:31:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75ab000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f75a415bf00 con 0x7f75a406cf00 2024-08-18T22:31:25.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75ab000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75a40ae1a0 con 0x7f75a415bb20 2024-08-18T22:31:25.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75a9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75a40adc50 0x7f75a406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75a9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f75a40adc50 0x7f75a406c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51938/0 (socket says 172.21.15.5:51938) 2024-08-18T22:31:25.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75a9200640 1 -- 172.21.15.5:0/295130212 learned_addr learned my addr 172.21.15.5:0/295130212 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75a9c00640 1 --2- 172.21.15.5:0/295130212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a415bb20 0x7f75a415f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75aa600640 1 --2- 172.21.15.5:0/295130212 >> v2:172.21.15.117:3300/0 conn(0x7f75a406cf00 0x7f75a4161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75a9200640 1 -- 172.21.15.5:0/295130212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a415bb20 msgr2=0x7f75a415f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75a9200640 1 --2- 172.21.15.5:0/295130212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a415bb20 0x7f75a415f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75a9200640 1 -- 172.21.15.5:0/295130212 >> v2:172.21.15.117:3300/0 conn(0x7f75a406cf00 msgr2=0x7f75a4161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75a9200640 1 --2- 172.21.15.5:0/295130212 >> v2:172.21.15.117:3300/0 conn(0x7f75a406cf00 0x7f75a4161b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75a9200640 1 -- 172.21.15.5:0/295130212 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a40ae480 con 0x7f75a40adc50 2024-08-18T22:31:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.064+0000 7f75aa600640 1 --2- 172.21.15.5:0/295130212 >> v2:172.21.15.117:3300/0 conn(0x7f75a406cf00 0x7f75a4161b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75a9200640 1 --2- 172.21.15.5:0/295130212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a40adc50 0x7f75a406c9c0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f75a415e580 tx=0x7f759001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3ea1dae2f0a689 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75a3e00640 1 -- 172.21.15.5:0/295130212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75900b0070 con 0x7f75a40adc50 2024-08-18T22:31:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75a3e00640 1 -- 172.21.15.5:0/295130212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75900ab600 con 0x7f75a40adc50 2024-08-18T22:31:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75a3e00640 1 -- 172.21.15.5:0/295130212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75900ab9d0 con 0x7f75a40adc50 2024-08-18T22:31:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75ab000640 1 -- 172.21.15.5:0/295130212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a40adc50 msgr2=0x7f75a406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75ab000640 1 --2- 172.21.15.5:0/295130212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a40adc50 0x7f75a406c9c0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f75a415e580 tx=0x7f759001c260 comp rx=0 tx=0).stop 2024-08-18T22:31:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75ab000640 1 -- 172.21.15.5:0/295130212 shutdown_connections 2024-08-18T22:31:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75ab000640 1 --2- 172.21.15.5:0/295130212 >> v2:172.21.15.117:3300/0 conn(0x7f75a406cf00 0x7f75a4161b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75ab000640 1 --2- 172.21.15.5:0/295130212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a40adc50 0x7f75a406c9c0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75ab000640 1 --2- 172.21.15.5:0/295130212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a415bb20 0x7f75a415f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75ab000640 1 -- 172.21.15.5:0/295130212 >> 172.21.15.5:0/295130212 conn(0x7f75a4072130 msgr2=0x7f75a4072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75ab000640 1 -- 172.21.15.5:0/295130212 shutdown_connections 2024-08-18T22:31:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75ab000640 1 -- 172.21.15.5:0/295130212 wait complete. 2024-08-18T22:31:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75ab000640 1 Processor -- start 2024-08-18T22:31:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.068+0000 7f75ab000640 1 -- start start 2024-08-18T22:31:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75ab000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a406cf00 0x7f75a4140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75ab000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a40adc50 0x7f75a415e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75ab000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a415bb20 0x7f75a4160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75ab000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40b3ab0 con 0x7f75a406cf00 2024-08-18T22:31:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75ab000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40b3930 con 0x7f75a40adc50 2024-08-18T22:31:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75ab000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f75a40b3c30 con 0x7f75a415bb20 2024-08-18T22:31:25.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a9c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a406cf00 0x7f75a4140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a9c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a406cf00 0x7f75a4140970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51942/0 (socket says 172.21.15.5:51942) 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a9c00640 1 -- 172.21.15.5:0/3041991801 learned_addr learned my addr 172.21.15.5:0/3041991801 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a9200640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a40adc50 0x7f75a415e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75aa600640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a415bb20 0x7f75a4160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a9c00640 1 -- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a415bb20 msgr2=0x7f75a4160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a9c00640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a415bb20 0x7f75a4160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a9c00640 1 -- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a40adc50 msgr2=0x7f75a415e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a9c00640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a40adc50 0x7f75a415e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a9c00640 1 -- 172.21.15.5:0/3041991801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a415f330 con 0x7f75a406cf00 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a9c00640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a406cf00 0x7f75a4140970 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f759800d830 tx=0x7f759800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a1600640 1 -- 172.21.15.5:0/3041991801 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759800b6c0 con 0x7f75a406cf00 2024-08-18T22:31:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a1600640 1 -- 172.21.15.5:0/3041991801 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7598019070 con 0x7f75a406cf00 2024-08-18T22:31:25.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a1600640 1 -- 172.21.15.5:0/3041991801 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759800ba60 con 0x7f75a406cf00 2024-08-18T22:31:25.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75ab000640 1 -- 172.21.15.5:0/3041991801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a415ed70 con 0x7f75a406cf00 2024-08-18T22:31:25.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75ab000640 1 -- 172.21.15.5:0/3041991801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a4141350 con 0x7f75a406cf00 2024-08-18T22:31:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75ab000640 1 -- 172.21.15.5:0/3041991801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a406c9c0 con 0x7f75a406cf00 2024-08-18T22:31:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.072+0000 7f75a1600640 1 -- 172.21.15.5:0/3041991801 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f759801e460 con 0x7f75a406cf00 2024-08-18T22:31:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.076+0000 7f75a1600640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75840678c0 0x7f7584069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.076+0000 7f75a1600640 1 -- 172.21.15.5:0/3041991801 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f7598086430 con 0x7f75a406cf00 2024-08-18T22:31:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.076+0000 7f75a9200640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75840678c0 0x7f7584069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.076+0000 7f75a9200640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75840678c0 0x7f7584069d80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f75900ad000 tx=0x7f7590008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.080+0000 7f75a1600640 1 -- 172.21.15.5:0/3041991801 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7598056730 con 0x7f75a406cf00 2024-08-18T22:31:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.244+0000 7f75ab000640 1 -- 172.21.15.5:0/3041991801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75a4168a90 con 0x7f75a406cf00 2024-08-18T22:31:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75a1600640 1 -- 172.21.15.5:0/3041991801 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16937 (secure 0 0 0) 0x7f759805aa30 con 0x7f75a406cf00 2024-08-18T22:31:25.247 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:25.247 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":167,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:31:16.452714+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:30:17.689677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-08-18T22:30:18.956043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/324683204":"2024-08-19T22:31:16.452649+0000","172.21.15.5:6833/324683204":"2024-08-19T22:31:16.452649+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:31:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 -- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75840678c0 msgr2=0x7f7584069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75840678c0 0x7f7584069d80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f75900ad000 tx=0x7f7590008040 comp rx=0 tx=0).stop 2024-08-18T22:31:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 -- 172.21.15.5:0/3041991801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a406cf00 msgr2=0x7f75a4140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a406cf00 0x7f75a4140970 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f759800d830 tx=0x7f759800dcf0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 -- 172.21.15.5:0/3041991801 shutdown_connections 2024-08-18T22:31:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f75840678c0 0x7f7584069d80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75a415bb20 0x7f75a4160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75a40adc50 0x7f75a415e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 --2- 172.21.15.5:0/3041991801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a406cf00 0x7f75a4140970 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 -- 172.21.15.5:0/3041991801 >> 172.21.15.5:0/3041991801 conn(0x7f75a4072130 msgr2=0x7f75a406e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 -- 172.21.15.5:0/3041991801 shutdown_connections 2024-08-18T22:31:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.248+0000 7f75ab000640 1 -- 172.21.15.5:0/3041991801 wait complete. 2024-08-18T22:31:25.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:31:25.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.408+0000 7fd708400640 1 Processor -- start 2024-08-18T22:31:25.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.408+0000 7fd708400640 1 -- start start 2024-08-18T22:31:25.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd708400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd70009aca0 0x7fd7000afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd708400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd70009b080 0x7fd7000b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd708400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd70006e8a0 con 0x7fd7000b1300 2024-08-18T22:31:25.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd708400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd70009bb80 con 0x7fd70009aca0 2024-08-18T22:31:25.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd708400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd7000d2e40 con 0x7fd70009b080 2024-08-18T22:31:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd705a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd70009aca0 0x7fd7000afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd705a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd70009aca0 0x7fd7000afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51958/0 (socket says 172.21.15.5:51958) 2024-08-18T22:31:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd705a00640 1 -- 172.21.15.5:0/2864242373 learned_addr learned my addr 172.21.15.5:0/2864242373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd706400640 1 --2- 172.21.15.5:0/2864242373 >> v2:172.21.15.117:3300/0 conn(0x7fd70009b080 0x7fd7000b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd705a00640 1 -- 172.21.15.5:0/2864242373 >> v2:172.21.15.117:3300/0 conn(0x7fd70009b080 msgr2=0x7fd7000b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd705a00640 1 --2- 172.21.15.5:0/2864242373 >> v2:172.21.15.117:3300/0 conn(0x7fd70009b080 0x7fd7000b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd705a00640 1 -- 172.21.15.5:0/2864242373 >> v1:172.21.15.117:6789/0 conn(0x7fd7000b1300 legacy=0x7fd7000affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:25.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.412+0000 7fd705a00640 1 -- 172.21.15.5:0/2864242373 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70006cbd0 con 0x7fd70009aca0 2024-08-18T22:31:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd705a00640 1 --2- 172.21.15.5:0/2864242373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70009aca0 0x7fd7000afa90 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fd700073460 tx=0x7fd6f401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4224e89201af3aa6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd6ffe00640 1 -- 172.21.15.5:0/2864242373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40b2070 con 0x7fd70009aca0 2024-08-18T22:31:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd6ffe00640 1 -- 172.21.15.5:0/2864242373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f40ad640 con 0x7fd70009aca0 2024-08-18T22:31:25.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd6ffe00640 1 -- 172.21.15.5:0/2864242373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40ada10 con 0x7fd70009aca0 2024-08-18T22:31:25.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 -- 172.21.15.5:0/2864242373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70009aca0 msgr2=0x7fd7000afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 --2- 172.21.15.5:0/2864242373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70009aca0 0x7fd7000afa90 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fd700073460 tx=0x7fd6f401c4e0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 -- 172.21.15.5:0/2864242373 shutdown_connections 2024-08-18T22:31:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 --2- 172.21.15.5:0/2864242373 >> v2:172.21.15.117:3300/0 conn(0x7fd70009b080 0x7fd7000b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 --2- 172.21.15.5:0/2864242373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70009aca0 0x7fd7000afa90 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 -- 172.21.15.5:0/2864242373 >> 172.21.15.5:0/2864242373 conn(0x7fd7000d2180 msgr2=0x7fd7000d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 -- 172.21.15.5:0/2864242373 shutdown_connections 2024-08-18T22:31:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 -- 172.21.15.5:0/2864242373 wait complete. 2024-08-18T22:31:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 Processor -- start 2024-08-18T22:31:25.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 -- start start 2024-08-18T22:31:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd70009aca0 0x7fd700160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd70009b080 0x7fd7000b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7000b1300 0x7fd7000b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd70016b6b0 con 0x7fd7000b1300 2024-08-18T22:31:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd70016b530 con 0x7fd70009aca0 2024-08-18T22:31:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd708400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd70016b830 con 0x7fd70009b080 2024-08-18T22:31:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.416+0000 7fd706400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7000b1300 0x7fd7000b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd706400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7000b1300 0x7fd7000b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51972/0 (socket says 172.21.15.5:51972) 2024-08-18T22:31:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd706400640 1 -- 172.21.15.5:0/1779223646 learned_addr learned my addr 172.21.15.5:0/1779223646 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd705a00640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd70009aca0 0x7fd700160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd705000640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd70009b080 0x7fd7000b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd706400640 1 -- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd70009b080 msgr2=0x7fd7000b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd706400640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd70009b080 0x7fd7000b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd706400640 1 -- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd70009aca0 msgr2=0x7fd700160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd706400640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd70009aca0 0x7fd700160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd706400640 1 -- 172.21.15.5:0/1779223646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd700157d00 con 0x7fd7000b1300 2024-08-18T22:31:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd706400640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7000b1300 0x7fd7000b0820 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8007e40 tx=0x7fd6f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd6fd600640 1 -- 172.21.15.5:0/1779223646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8014620 con 0x7fd7000b1300 2024-08-18T22:31:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd6fd600640 1 -- 172.21.15.5:0/1779223646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f8019070 con 0x7fd7000b1300 2024-08-18T22:31:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd6fd600640 1 -- 172.21.15.5:0/1779223646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8014a20 con 0x7fd7000b1300 2024-08-18T22:31:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd708400640 1 -- 172.21.15.5:0/1779223646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd700157fe0 con 0x7fd7000b1300 2024-08-18T22:31:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd708400640 1 -- 172.21.15.5:0/1779223646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7000cb6c0 con 0x7fd7000b1300 2024-08-18T22:31:25.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd708400640 1 -- 172.21.15.5:0/1779223646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7000cb8c0 con 0x7fd7000b1300 2024-08-18T22:31:25.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.420+0000 7fd6fd600640 1 -- 172.21.15.5:0/1779223646 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6f8014bc0 con 0x7fd7000b1300 2024-08-18T22:31:25.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.424+0000 7fd6fd600640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6e00678f0 0x7fd6e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.424+0000 7fd6fd600640 1 -- 172.21.15.5:0/1779223646 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7fd6f80864e0 con 0x7fd7000b1300 2024-08-18T22:31:25.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.424+0000 7fd705a00640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6e00678f0 0x7fd6e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.424+0000 7fd705a00640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6e00678f0 0x7fd6e0069db0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40af000 tx=0x7fd6f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:25.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.424+0000 7fd6fd600640 1 -- 172.21.15.5:0/1779223646 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd7000cb8c0 con 0x7fd7000b1300 2024-08-18T22:31:25.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.628+0000 7fd708400640 1 -- 172.21.15.5:0/1779223646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd700162100 con 0x7fd7000b1300 2024-08-18T22:31:25.628 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:31:25.628+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:31:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd6fd600640 1 -- 172.21.15.5:0/1779223646 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v130) ==== 161+0+0 (secure 0 0 0) 0x7fd6f8056880 con 0x7fd7000b1300 2024-08-18T22:31:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:31:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 -- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6e00678f0 msgr2=0x7fd6e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6e00678f0 0x7fd6e0069db0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40af000 tx=0x7fd6f4008040 comp rx=0 tx=0).stop 2024-08-18T22:31:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 -- 172.21.15.5:0/1779223646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7000b1300 msgr2=0x7fd7000b0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7000b1300 0x7fd7000b0820 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8007e40 tx=0x7fd6f800e4b0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 -- 172.21.15.5:0/1779223646 shutdown_connections 2024-08-18T22:31:25.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd6e00678f0 0x7fd6e0069db0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7000b1300 0x7fd7000b0820 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd70009b080 0x7fd7000b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 --2- 172.21.15.5:0/1779223646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd70009aca0 0x7fd700160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 -- 172.21.15.5:0/1779223646 >> 172.21.15.5:0/1779223646 conn(0x7fd7000d2180 msgr2=0x7fd7000d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 -- 172.21.15.5:0/1779223646 shutdown_connections 2024-08-18T22:31:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.632+0000 7fd708400640 1 -- 172.21.15.5:0/1779223646 wait complete. 2024-08-18T22:31:25.659 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:31:25.664 INFO:tasks.ceph.mds.c.smithi005.stderr: -207> 2024-08-18T22:31:21.524+0000 7fcd4a200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:31:25.707 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:31:25.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856fa00640 1 Processor -- start 2024-08-18T22:31:25.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856fa00640 1 -- start start 2024-08-18T22:31:25.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856fa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f856815c180 0x7f85680cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856fa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856815c560 0x7f85680ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856fa00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85680cfb00 con 0x7f856815d4d0 2024-08-18T22:31:25.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856fa00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f856815d040 con 0x7f856815c180 2024-08-18T22:31:25.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856fa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f856815c9f0 con 0x7f856815c560 2024-08-18T22:31:25.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856d000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f856815c180 0x7f85680cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f8567e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856815c560 0x7f85680ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856da00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f856815d4d0 0x7f856815fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:46646/0 (socket says 172.21.15.5:46646) 2024-08-18T22:31:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856da00640 1 -- 172.21.15.5:0/1215647296 learned_addr learned my addr 172.21.15.5:0/1215647296 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856d000640 1 -- 172.21.15.5:0/1215647296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856815c560 msgr2=0x7f85680ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856d000640 1 --2- 172.21.15.5:0/1215647296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856815c560 0x7f85680ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856d000640 1 -- 172.21.15.5:0/1215647296 >> v1:172.21.15.117:6789/0 conn(0x7f856815d4d0 legacy=0x7f856815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f856d000640 1 -- 172.21.15.5:0/1215647296 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856815ccd0 con 0x7f856815c180 2024-08-18T22:31:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.808+0000 7f8567e00640 1 --2- 172.21.15.5:0/1215647296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856815c560 0x7f85680ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:31:25.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f856d000640 1 --2- 172.21.15.5:0/1215647296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856815c180 0x7f85680cdf10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f855c0097c0 tx=0x7f855c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=589af9fa6ab8d365 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f8567400640 1 -- 172.21.15.5:0/1215647296 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0ab430 con 0x7f856815c180 2024-08-18T22:31:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f8567400640 1 -- 172.21.15.5:0/1215647296 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855c0b0070 con 0x7f856815c180 2024-08-18T22:31:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f8567400640 1 -- 172.21.15.5:0/1215647296 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0ab7f0 con 0x7f856815c180 2024-08-18T22:31:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f856fa00640 1 -- 172.21.15.5:0/1215647296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856815c180 msgr2=0x7f85680cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f856fa00640 1 --2- 172.21.15.5:0/1215647296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856815c180 0x7f85680cdf10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f855c0097c0 tx=0x7f855c01c410 comp rx=0 tx=0).stop 2024-08-18T22:31:25.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f856fa00640 1 -- 172.21.15.5:0/1215647296 shutdown_connections 2024-08-18T22:31:25.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f856fa00640 1 --2- 172.21.15.5:0/1215647296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856815c560 0x7f85680ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f856fa00640 1 --2- 172.21.15.5:0/1215647296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856815c180 0x7f85680cdf10 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f856fa00640 1 -- 172.21.15.5:0/1215647296 >> 172.21.15.5:0/1215647296 conn(0x7f85680b1dc0 msgr2=0x7f85680b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:25.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f856fa00640 1 -- 172.21.15.5:0/1215647296 shutdown_connections 2024-08-18T22:31:25.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.812+0000 7f856fa00640 1 -- 172.21.15.5:0/1215647296 wait complete. 2024-08-18T22:31:25.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856fa00640 1 Processor -- start 2024-08-18T22:31:25.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856fa00640 1 -- start start 2024-08-18T22:31:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856fa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856815c180 0x7f8568152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856fa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856815d4d0 0x7f856814f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856fa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8568150020 0x7f8568151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856fa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f85681692b0 con 0x7f8568150020 2024-08-18T22:31:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856fa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8568169130 con 0x7f856815d4d0 2024-08-18T22:31:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856fa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8568169430 con 0x7f856815c180 2024-08-18T22:31:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856da00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8568150020 0x7f8568151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856da00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8568150020 0x7f8568151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52000/0 (socket says 172.21.15.5:52000) 2024-08-18T22:31:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856da00640 1 -- 172.21.15.5:0/458590206 learned_addr learned my addr 172.21.15.5:0/458590206 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f8567e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856815d4d0 0x7f856814f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856d000640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856815c180 0x7f8568152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856da00640 1 -- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856815c180 msgr2=0x7f8568152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856da00640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856815c180 0x7f8568152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856da00640 1 -- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856815d4d0 msgr2=0x7f856814f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856da00640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856815d4d0 0x7f856814f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856da00640 1 -- 172.21.15.5:0/458590206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85681546c0 con 0x7f8568150020 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856da00640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8568150020 0x7f8568151d50 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f856000cb10 tx=0x7f856000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f8564c00640 1 -- 172.21.15.5:0/458590206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560017070 con 0x7f8568150020 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f8564c00640 1 -- 172.21.15.5:0/458590206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856000ac70 con 0x7f8568150020 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f8564c00640 1 -- 172.21.15.5:0/458590206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856000ae60 con 0x7f8568150020 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856fa00640 1 -- 172.21.15.5:0/458590206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8568150880 con 0x7f8568150020 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856fa00640 1 -- 172.21.15.5:0/458590206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856815b710 con 0x7f8568150020 2024-08-18T22:31:25.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.816+0000 7f856fa00640 1 -- 172.21.15.5:0/458590206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f856815fd90 con 0x7f8568150020 2024-08-18T22:31:25.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.820+0000 7f8564c00640 1 -- 172.21.15.5:0/458590206 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f856001a070 con 0x7f8568150020 2024-08-18T22:31:25.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.820+0000 7f8564c00640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85480678c0 0x7f8548069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:25.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.820+0000 7f8564c00640 1 -- 172.21.15.5:0/458590206 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6273+0+0 (secure 0 0 0) 0x7f8560085c60 con 0x7f8568150020 2024-08-18T22:31:25.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.820+0000 7f856d000640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85480678c0 0x7f8548069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:25.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.820+0000 7f856d000640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85480678c0 0x7f8548069d80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f855c0af000 tx=0x7f855c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:25.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:25.824+0000 7f8564c00640 1 -- 172.21.15.5:0/458590206 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8560055df0 con 0x7f8568150020 2024-08-18T22:31:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.024+0000 7f856fa00640 1 -- 172.21.15.5:0/458590206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f856806ef00 con 0x7f8568150020 2024-08-18T22:31:26.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.632+0000 7f8564c00640 1 -- 172.21.15.5:0/458590206 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v131) ==== 104+0+0 (secure 0 0 0) 0x7f856005a0f0 con 0x7f8568150020 2024-08-18T22:31:26.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.632+0000 7f856fa00640 1 -- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85480678c0 msgr2=0x7f8548069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:26.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.632+0000 7f856fa00640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85480678c0 0x7f8548069d80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f855c0af000 tx=0x7f855c008040 comp rx=0 tx=0).stop 2024-08-18T22:31:26.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.632+0000 7f856fa00640 1 -- 172.21.15.5:0/458590206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8568150020 msgr2=0x7f8568151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.632+0000 7f856fa00640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8568150020 0x7f8568151d50 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f856000cb10 tx=0x7f856000a060 comp rx=0 tx=0).stop 2024-08-18T22:31:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.636+0000 7f856fa00640 1 -- 172.21.15.5:0/458590206 shutdown_connections 2024-08-18T22:31:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.636+0000 7f856fa00640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85480678c0 0x7f8548069d80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.636+0000 7f856fa00640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8568150020 0x7f8568151d50 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.636+0000 7f856fa00640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f856815d4d0 0x7f856814f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.636+0000 7f856fa00640 1 --2- 172.21.15.5:0/458590206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f856815c180 0x7f8568152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:26.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.636+0000 7f856fa00640 1 -- 172.21.15.5:0/458590206 >> 172.21.15.5:0/458590206 conn(0x7f85680b1dc0 msgr2=0x7f856809a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.636+0000 7f856fa00640 1 -- 172.21.15.5:0/458590206 shutdown_connections 2024-08-18T22:31:26.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.636+0000 7f856fa00640 1 -- 172.21.15.5:0/458590206 wait complete. 2024-08-18T22:31:26.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:31:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.852+0000 7f6d14600640 1 Processor -- start 2024-08-18T22:31:26.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.852+0000 7f6d14600640 1 -- start start 2024-08-18T22:31:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d14600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d0c15d1d0 0x7f6d0c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d14600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d0c0b3260 con 0x7f6d0c0ccaa0 2024-08-18T22:31:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d14600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d0c15d660 con 0x7f6d0c0cf760 2024-08-18T22:31:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d14600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0c0cfe90 con 0x7f6d0c15d1d0 2024-08-18T22:31:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d11c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6d0c0ccaa0 0x7f6d0c0cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49314/0 (socket says 172.21.15.5:49314) 2024-08-18T22:31:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d11c00640 1 -- 172.21.15.5:0/2549583001 learned_addr learned my addr 172.21.15.5:0/2549583001 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:26.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d12600640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d0c15d1d0 0x7f6d0c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:26.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 263154173 0 0) 0x7f6d0c0b3260 con 0x7f6d0c0ccaa0 2024-08-18T22:31:26.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cf4003530 con 0x7f6d0c0ccaa0 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1390772118 0 0) 0x7f6d0c15d660 con 0x7f6d0c0cf760 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d0c0b3260 con 0x7f6d0c0cf760 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 311711644 0 0) 0x7f6cf4003530 con 0x7f6d0c0ccaa0 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d0c15d1d0 msgr2=0x7f6d0c06e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d0c15d1d0 0x7f6d0c06e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 >> v1:172.21.15.117:6789/0 conn(0x7f6d0c0cf760 legacy=0x7f6d0c06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c0cfbc0 con 0x7f6d0c0ccaa0 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f6d00001680 con 0x7f6d0c0ccaa0 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 >> v1:172.21.15.5:6789/0 conn(0x7f6d0c0ccaa0 legacy=0x7f6d0c0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cf4003b80 0x7f6cf4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cf4004810 0x7f6cf4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf40051d0 0x7f6cf400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:26.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c0cfe90 con 0x7f6cf4003b80 2024-08-18T22:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf400c040 con 0x7f6cf40051d0 2024-08-18T22:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf400c240 con 0x7f6cf4004810 2024-08-18T22:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d12600640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d0c15d1d0 0x7f6d0c06e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d11c00640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cf4003b80 0x7f6cf4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d11200640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cf4004810 0x7f6cf4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d12600640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf40051d0 0x7f6cf400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d11c00640 1 -- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cf4004810 msgr2=0x7f6cf4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d11c00640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cf4004810 0x7f6cf4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d11c00640 1 -- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf40051d0 msgr2=0x7f6cf400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d11c00640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf40051d0 0x7f6cf400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:26.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.856+0000 7f6d11c00640 1 -- 172.21.15.5:0/2549583001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf4003530 con 0x7f6cf4003b80 2024-08-18T22:31:26.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d11c00640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cf4003b80 0x7f6cf4003f80 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000c1c0 tx=0x7f6d0001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e26c57f0e45b5f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:26.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00007cf0 con 0x7f6cf4003b80 2024-08-18T22:31:26.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d000a9020 con 0x7f6cf4003b80 2024-08-18T22:31:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d0be00640 1 -- 172.21.15.5:0/2549583001 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00005b00 con 0x7f6cf4003b80 2024-08-18T22:31:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d14600640 1 -- 172.21.15.5:0/2549583001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cf4003b80 msgr2=0x7f6cf4003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d14600640 1 --2- 172.21.15.5:0/2549583001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cf4003b80 0x7f6cf4003f80 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000c1c0 tx=0x7f6d0001cc20 comp rx=0 tx=0).stop 2024-08-18T22:31:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d12600640 1 -- 172.21.15.5:0/2549583001 reap_dead start 2024-08-18T22:31:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d14600640 1 -- 172.21.15.5:0/2549583001 shutdown_connections 2024-08-18T22:31:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d14600640 1 -- 172.21.15.5:0/2549583001 >> 172.21.15.5:0/2549583001 conn(0x7f6d0c06b9b0 msgr2=0x7f6d0c06bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d14600640 1 -- 172.21.15.5:0/2549583001 shutdown_connections 2024-08-18T22:31:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d14600640 1 -- 172.21.15.5:0/2549583001 wait complete. 2024-08-18T22:31:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d14600640 1 Processor -- start 2024-08-18T22:31:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.860+0000 7f6d14600640 1 -- start start 2024-08-18T22:31:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d14600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf4003b80 0x7f6d0c164d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d14600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0c0b06e0 0x7f6d0c1f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d14600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d0c0b1e30 0x7f6d0c0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d14600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c167e80 con 0x7f6d0c0b06e0 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d14600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c167d00 con 0x7f6cf4003b80 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d14600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0c168000 con 0x7f6d0c0b1e30 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d11200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0c0b06e0 0x7f6d0c1f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d11200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0c0b06e0 0x7f6d0c1f65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52028/0 (socket says 172.21.15.5:52028) 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d11200640 1 -- 172.21.15.5:0/572148089 learned_addr learned my addr 172.21.15.5:0/572148089 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d11c00640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf4003b80 0x7f6d0c164d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d12600640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d0c0b1e30 0x7f6d0c0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d11200640 1 -- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d0c0b1e30 msgr2=0x7f6d0c0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d11200640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d0c0b1e30 0x7f6d0c0b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d11200640 1 -- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf4003b80 msgr2=0x7f6d0c164d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d11200640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf4003b80 0x7f6d0c164d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d11200640 1 -- 172.21.15.5:0/572148089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c0b2910 con 0x7f6d0c0b06e0 2024-08-18T22:31:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d11c00640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf4003b80 0x7f6d0c164d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d12600640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d0c0b1e30 0x7f6d0c0b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d11200640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0c0b06e0 0x7f6d0c1f65d0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800f7a0 tx=0x7f6cf800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d09600640 1 -- 172.21.15.5:0/572148089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf801a070 con 0x7f6d0c0b06e0 2024-08-18T22:31:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d09600640 1 -- 172.21.15.5:0/572148089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf800fe50 con 0x7f6d0c0b06e0 2024-08-18T22:31:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d14600640 1 -- 172.21.15.5:0/572148089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0c164260 con 0x7f6d0c0b06e0 2024-08-18T22:31:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d09600640 1 -- 172.21.15.5:0/572148089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8007030 con 0x7f6d0c0b06e0 2024-08-18T22:31:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d14600640 1 -- 172.21.15.5:0/572148089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0c164820 con 0x7f6d0c0b06e0 2024-08-18T22:31:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d14600640 1 -- 172.21.15.5:0/572148089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d0c15d5e0 con 0x7f6d0c0b06e0 2024-08-18T22:31:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.864+0000 7f6d09600640 1 -- 172.21.15.5:0/572148089 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6cf801d070 con 0x7f6d0c0b06e0 2024-08-18T22:31:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.868+0000 7f6d09600640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6cec0678c0 0x7f6cec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.868+0000 7f6d09600640 1 -- 172.21.15.5:0/572148089 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6273+0+0 (secure 0 0 0) 0x7f6cf8085780 con 0x7f6d0c0b06e0 2024-08-18T22:31:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.868+0000 7f6d11c00640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6cec0678c0 0x7f6cec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.868+0000 7f6d11c00640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6cec0678c0 0x7f6cec069d80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6d000aa000 tx=0x7f6d00001a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:26.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:26.872+0000 7f6d09600640 1 -- 172.21.15.5:0/572148089 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6cf8055fe0 con 0x7f6d0c0b06e0 2024-08-18T22:31:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.040+0000 7f6d14600640 1 -- 172.21.15.5:0/572148089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6d0c15e1b0 con 0x7f6d0c0b06e0 2024-08-18T22:31:27.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.640+0000 7f6d09600640 1 -- 172.21.15.5:0/572148089 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v169) ==== 181+0+0 (secure 0 0 0) 0x7f6cf805ae20 con 0x7f6d0c0b06e0 2024-08-18T22:31:27.639 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:31:27.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.640+0000 7f6d14600640 1 -- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6cec0678c0 msgr2=0x7f6cec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:27.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.640+0000 7f6d14600640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6cec0678c0 0x7f6cec069d80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6d000aa000 tx=0x7f6d00001a40 comp rx=0 tx=0).stop 2024-08-18T22:31:27.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.640+0000 7f6d14600640 1 -- 172.21.15.5:0/572148089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0c0b06e0 msgr2=0x7f6d0c1f65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:27.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.640+0000 7f6d14600640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0c0b06e0 0x7f6d0c1f65d0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800f7a0 tx=0x7f6cf800fc60 comp rx=0 tx=0).stop 2024-08-18T22:31:27.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.640+0000 7f6d14600640 1 -- 172.21.15.5:0/572148089 shutdown_connections 2024-08-18T22:31:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.640+0000 7f6d14600640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6cec0678c0 0x7f6cec069d80 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.640+0000 7f6d14600640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d0c0b1e30 0x7f6d0c0b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.640+0000 7f6d14600640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0c0b06e0 0x7f6d0c1f65d0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.640+0000 7f6d14600640 1 --2- 172.21.15.5:0/572148089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf4003b80 0x7f6d0c164d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.640+0000 7f6d14600640 1 -- 172.21.15.5:0/572148089 >> 172.21.15.5:0/572148089 conn(0x7f6d0c06b9b0 msgr2=0x7f6d0c06bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.644+0000 7f6d14600640 1 -- 172.21.15.5:0/572148089 shutdown_connections 2024-08-18T22:31:27.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.644+0000 7f6d14600640 1 -- 172.21.15.5:0/572148089 wait complete. 2024-08-18T22:31:27.666 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:31:27.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.816+0000 7f4dab800640 1 Processor -- start 2024-08-18T22:31:27.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4dab800640 1 -- start start 2024-08-18T22:31:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4dab800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4da4072a20 0x7f4da4072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4dab800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4da40735e0 con 0x7f4da40cf020 2024-08-18T22:31:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4dab800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4da40738c0 con 0x7f4da40b3c20 2024-08-18T22:31:27.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4dab800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4da40733c0 con 0x7f4da4072a20 2024-08-18T22:31:27.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da8e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4da40cf020 0x7f4da40cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49316/0 (socket says 172.21.15.5:49316) 2024-08-18T22:31:27.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da8e00640 1 -- 172.21.15.5:0/3246740299 learned_addr learned my addr 172.21.15.5:0/3246740299 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:27.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3510275893 0 0) 0x7f4da40735e0 con 0x7f4da40cf020 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d88005740 con 0x7f4da40cf020 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3e00640 1 --2- 172.21.15.5:0/3246740299 >> v2:172.21.15.117:3300/0 conn(0x7f4da4072a20 0x7f4da4072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2705975941 0 0) 0x7f4d88005740 con 0x7f4da40cf020 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 >> v2:172.21.15.117:3300/0 conn(0x7f4da4072a20 msgr2=0x7f4da4072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 --2- 172.21.15.5:0/3246740299 >> v2:172.21.15.117:3300/0 conn(0x7f4da4072a20 0x7f4da4072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 >> v1:172.21.15.117:6789/0 conn(0x7f4da40b3c20 legacy=0x7f4da40b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da4073ba0 con 0x7f4da40cf020 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f4d94001680 con 0x7f4da40cf020 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 >> v1:172.21.15.5:6789/0 conn(0x7f4da40cf020 legacy=0x7f4da40cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 --2- 172.21.15.5:0/3246740299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d88005c20 0x7f4d88006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 --2- 172.21.15.5:0/3246740299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d88006a20 0x7f4d88006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:27.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 --2- 172.21.15.5:0/3246740299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d880073e0 0x7f4d8800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4da40733c0 con 0x7f4d880073e0 2024-08-18T22:31:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8800e2e0 con 0x7f4d88006a20 2024-08-18T22:31:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8800e4e0 con 0x7f4d88005c20 2024-08-18T22:31:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da9800640 1 --2- 172.21.15.5:0/3246740299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d880073e0 0x7f4d8800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da8e00640 1 --2- 172.21.15.5:0/3246740299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d88005c20 0x7f4d88006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da3e00640 1 --2- 172.21.15.5:0/3246740299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d88006a20 0x7f4d88006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da9800640 1 -- 172.21.15.5:0/3246740299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d88005c20 msgr2=0x7f4d88006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da9800640 1 --2- 172.21.15.5:0/3246740299 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d88005c20 0x7f4d88006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da9800640 1 -- 172.21.15.5:0/3246740299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d88006a20 msgr2=0x7f4d88006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da9800640 1 --2- 172.21.15.5:0/3246740299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d88006a20 0x7f4d88006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:27.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.820+0000 7f4da9800640 1 -- 172.21.15.5:0/3246740299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d88005740 con 0x7f4d880073e0 2024-08-18T22:31:27.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4da9800640 1 -- 172.21.15.5:0/3246740299 reap_dead start 2024-08-18T22:31:27.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4da9800640 1 --2- 172.21.15.5:0/3246740299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d880073e0 0x7f4d8800dbe0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c001e70 tx=0x7f4d9c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ea593177664cb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:27.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c001a90 con 0x7f4d880073e0 2024-08-18T22:31:27.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c003bc0 con 0x7f4d880073e0 2024-08-18T22:31:27.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4da3400640 1 -- 172.21.15.5:0/3246740299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c005020 con 0x7f4d880073e0 2024-08-18T22:31:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4dab800640 1 -- 172.21.15.5:0/3246740299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d880073e0 msgr2=0x7f4d8800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4dab800640 1 --2- 172.21.15.5:0/3246740299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d880073e0 0x7f4d8800dbe0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c001e70 tx=0x7f4d9c01c780 comp rx=0 tx=0).stop 2024-08-18T22:31:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4dab800640 1 -- 172.21.15.5:0/3246740299 shutdown_connections 2024-08-18T22:31:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4dab800640 1 --2- 172.21.15.5:0/3246740299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d880073e0 0x7f4d8800dbe0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4dab800640 1 -- 172.21.15.5:0/3246740299 >> 172.21.15.5:0/3246740299 conn(0x7f4da406b9b0 msgr2=0x7f4da406bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:27.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4dab800640 1 -- 172.21.15.5:0/3246740299 shutdown_connections 2024-08-18T22:31:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.824+0000 7f4dab800640 1 -- 172.21.15.5:0/3246740299 wait complete. 2024-08-18T22:31:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4dab800640 1 Processor -- start 2024-08-18T22:31:27.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4dab800640 1 -- start start 2024-08-18T22:31:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4dab800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d880073e0 0x7f4da414a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4dab800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4da415c030 0x7f4da40ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4dab800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da415a090 0x7f4da40ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4dab800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4da406e3e0 con 0x7f4da415a090 2024-08-18T22:31:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4dab800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4da4073e80 con 0x7f4d880073e0 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4dab800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4da41558e0 con 0x7f4da415c030 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da9800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da415a090 0x7f4da40ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da9800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da415a090 0x7f4da40ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52034/0 (socket says 172.21.15.5:52034) 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da9800640 1 -- 172.21.15.5:0/1475476375 learned_addr learned my addr 172.21.15.5:0/1475476375 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da8e00640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d880073e0 0x7f4da414a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da3e00640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4da415c030 0x7f4da40ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da9800640 1 -- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4da415c030 msgr2=0x7f4da40ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da9800640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4da415c030 0x7f4da40ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da9800640 1 -- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d880073e0 msgr2=0x7f4da414a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da9800640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d880073e0 0x7f4da414a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da9800640 1 -- 172.21.15.5:0/1475476375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da415a5c0 con 0x7f4da415a090 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da3e00640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4da415c030 0x7f4da40ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da9800640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da415a090 0x7f4da40ae760 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c01c5b0 tx=0x7f4d88007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da0c00640 1 -- 172.21.15.5:0/1475476375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c007dc0 con 0x7f4da415a090 2024-08-18T22:31:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da0c00640 1 -- 172.21.15.5:0/1475476375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c003980 con 0x7f4da415a090 2024-08-18T22:31:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4da0c00640 1 -- 172.21.15.5:0/1475476375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c001a90 con 0x7f4da415a090 2024-08-18T22:31:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4dab800640 1 -- 172.21.15.5:0/1475476375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da4157010 con 0x7f4da415a090 2024-08-18T22:31:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.828+0000 7f4dab800640 1 -- 172.21.15.5:0/1475476375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da41f50d0 con 0x7f4da415a090 2024-08-18T22:31:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.832+0000 7f4dab800640 1 -- 172.21.15.5:0/1475476375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da40735a0 con 0x7f4da415a090 2024-08-18T22:31:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.832+0000 7f4da0c00640 1 -- 172.21.15.5:0/1475476375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4d9c0a6480 con 0x7f4da415a090 2024-08-18T22:31:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.832+0000 7f4da0c00640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4d840678c0 0x7f4d84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.832+0000 7f4da0c00640 1 -- 172.21.15.5:0/1475476375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5835+0+0 (secure 0 0 0) 0x7f4d9c11f4e0 con 0x7f4da415a090 2024-08-18T22:31:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.832+0000 7f4da8e00640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4d840678c0 0x7f4d84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.832+0000 7f4da8e00640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4d840678c0 0x7f4d84069d80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000c10 tx=0x7f4d94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:27.836+0000 7f4da0c00640 1 -- 172.21.15.5:0/1475476375 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4d9c016490 con 0x7f4da415a090 2024-08-18T22:31:28.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.000+0000 7f4dab800640 1 -- 172.21.15.5:0/1475476375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4da40749c0 con 0x7f4da415a090 2024-08-18T22:31:28.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.648+0000 7f4da0c00640 1 -- 172.21.15.5:0/1475476375 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v170) ==== 169+0+0 (secure 0 0 0) 0x7f4d9c0eff00 con 0x7f4da415a090 2024-08-18T22:31:28.648 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:31:28.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 -- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4d840678c0 msgr2=0x7f4d84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:28.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4d840678c0 0x7f4d84069d80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000c10 tx=0x7f4d94009040 comp rx=0 tx=0).stop 2024-08-18T22:31:28.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 -- 172.21.15.5:0/1475476375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da415a090 msgr2=0x7f4da40ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:28.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da415a090 0x7f4da40ae760 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c01c5b0 tx=0x7f4d88007a50 comp rx=0 tx=0).stop 2024-08-18T22:31:28.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 -- 172.21.15.5:0/1475476375 shutdown_connections 2024-08-18T22:31:28.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4d840678c0 0x7f4d84069d80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da415a090 0x7f4da40ae760 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4da415c030 0x7f4da40ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 --2- 172.21.15.5:0/1475476375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d880073e0 0x7f4da414a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 -- 172.21.15.5:0/1475476375 >> 172.21.15.5:0/1475476375 conn(0x7f4da406b9b0 msgr2=0x7f4da40b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:28.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 -- 172.21.15.5:0/1475476375 shutdown_connections 2024-08-18T22:31:28.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.652+0000 7f4dab800640 1 -- 172.21.15.5:0/1475476375 wait complete. 2024-08-18T22:31:28.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:31:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.828+0000 7f2696000640 1 Processor -- start 2024-08-18T22:31:28.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.828+0000 7f2696000640 1 -- start start 2024-08-18T22:31:28.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.832+0000 7f2696000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f269015a690 0x7f26900b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:28.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.832+0000 7f2696000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2690073620 0x7f26900cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:28.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.832+0000 7f2696000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26900ccef0 0x7f26900cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:28.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.832+0000 7f2696000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2690073e00 con 0x7f26900ccef0 2024-08-18T22:31:28.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.832+0000 7f2696000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f26900b33d0 con 0x7f269015a690 2024-08-18T22:31:28.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.832+0000 7f2696000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f26900b4110 con 0x7f2690073620 2024-08-18T22:31:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.832+0000 7f268ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2690073620 0x7f26900cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.832+0000 7f268f400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f269015a690 0x7f26900b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.832+0000 7f268ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2690073620 0x7f26900cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:49180/0 (socket says 172.21.15.5:49180) 2024-08-18T22:31:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.832+0000 7f268ea00640 1 -- 172.21.15.5:0/3360131263 learned_addr learned my addr 172.21.15.5:0/3360131263 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.836+0000 7f268fe00640 1 --2- 172.21.15.5:0/3360131263 >> v2:172.21.15.5:3300/0 conn(0x7f26900ccef0 0x7f26900cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:28.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.836+0000 7f268f400640 1 -- 172.21.15.5:0/3360131263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2690073620 msgr2=0x7f26900cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:28.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.836+0000 7f268f400640 1 --2- 172.21.15.5:0/3360131263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2690073620 0x7f26900cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.836+0000 7f268f400640 1 -- 172.21.15.5:0/3360131263 >> v2:172.21.15.5:3300/0 conn(0x7f26900ccef0 msgr2=0x7f26900cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:28.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.836+0000 7f268f400640 1 --2- 172.21.15.5:0/3360131263 >> v2:172.21.15.5:3300/0 conn(0x7f26900ccef0 0x7f26900cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.836+0000 7f268f400640 1 -- 172.21.15.5:0/3360131263 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26900b43b0 con 0x7f269015a690 2024-08-18T22:31:28.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.836+0000 7f268ea00640 1 --2- 172.21.15.5:0/3360131263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2690073620 0x7f26900cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:31:28.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.840+0000 7f268f400640 1 --2- 172.21.15.5:0/3360131263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f269015a690 0x7f26900b52a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f26900725a0 tx=0x7f267c01f5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7fe89c65016debe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:28.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.844+0000 7f268e000640 1 -- 172.21.15.5:0/3360131263 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0af600 con 0x7f269015a690 2024-08-18T22:31:28.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.844+0000 7f268e000640 1 -- 172.21.15.5:0/3360131263 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267c0b4070 con 0x7f269015a690 2024-08-18T22:31:28.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.844+0000 7f268e000640 1 -- 172.21.15.5:0/3360131263 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0af9c0 con 0x7f269015a690 2024-08-18T22:31:28.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.844+0000 7f2696000640 1 -- 172.21.15.5:0/3360131263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f269015a690 msgr2=0x7f26900b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:28.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.844+0000 7f2696000640 1 --2- 172.21.15.5:0/3360131263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f269015a690 0x7f26900b52a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f26900725a0 tx=0x7f267c01f5d0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.848+0000 7f2696000640 1 -- 172.21.15.5:0/3360131263 shutdown_connections 2024-08-18T22:31:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.848+0000 7f2696000640 1 --2- 172.21.15.5:0/3360131263 >> v2:172.21.15.5:3300/0 conn(0x7f26900ccef0 0x7f26900cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.848+0000 7f2696000640 1 --2- 172.21.15.5:0/3360131263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2690073620 0x7f26900cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.848+0000 7f2696000640 1 --2- 172.21.15.5:0/3360131263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f269015a690 0x7f26900b52a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.848+0000 7f2696000640 1 -- 172.21.15.5:0/3360131263 >> 172.21.15.5:0/3360131263 conn(0x7f26900b5800 msgr2=0x7f2690072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:28.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.848+0000 7f2696000640 1 -- 172.21.15.5:0/3360131263 shutdown_connections 2024-08-18T22:31:28.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.848+0000 7f2696000640 1 -- 172.21.15.5:0/3360131263 wait complete. 2024-08-18T22:31:28.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.852+0000 7f2696000640 1 Processor -- start 2024-08-18T22:31:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.856+0000 7f2696000640 1 -- start start 2024-08-18T22:31:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.856+0000 7f2696000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2690073620 0x7f269015b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.856+0000 7f2696000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26900ccef0 0x7f2690153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:28.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.856+0000 7f268ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26900ccef0 0x7f2690153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f268ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26900ccef0 0x7f2690153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52066/0 (socket says 172.21.15.5:52066) 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f268ea00640 1 -- 172.21.15.5:0/2711496821 learned_addr learned my addr 172.21.15.5:0/2711496821 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f2696000640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f269015a690 0x7f269014d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2690073a60 con 0x7f26900ccef0 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f26900b4970 con 0x7f2690073620 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2690073be0 con 0x7f269015a690 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f268fe00640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f269015a690 0x7f269014d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f268fe00640 1 -- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2690073620 msgr2=0x7f269015b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f268fe00640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2690073620 0x7f269015b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f268fe00640 1 -- 172.21.15.5:0/2711496821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26900ccef0 msgr2=0x7f2690153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f268fe00640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26900ccef0 0x7f2690153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f268fe00640 1 -- 172.21.15.5:0/2711496821 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269015ba20 con 0x7f269015a690 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f268ea00640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26900ccef0 0x7f2690153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f268fe00640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f269015a690 0x7f269014d040 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2688007cb0 tx=0x7f268800d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:28.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f2687400640 1 -- 172.21.15.5:0/2711496821 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268800dba0 con 0x7f269015a690 2024-08-18T22:31:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f2687400640 1 -- 172.21.15.5:0/2711496821 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268800dd40 con 0x7f269015a690 2024-08-18T22:31:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f2687400640 1 -- 172.21.15.5:0/2711496821 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2688003be0 con 0x7f269015a690 2024-08-18T22:31:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269015bd00 con 0x7f269015a690 2024-08-18T22:31:28.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.860+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f269015c2c0 con 0x7f269015a690 2024-08-18T22:31:28.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.864+0000 7f2687400640 1 -- 172.21.15.5:0/2711496821 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f268801a020 con 0x7f269015a690 2024-08-18T22:31:28.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.864+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26900adf70 con 0x7f269015a690 2024-08-18T22:31:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.868+0000 7f2687400640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26700679c0 0x7f2670069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:28.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.868+0000 7f2687400640 1 -- 172.21.15.5:0/2711496821 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7f2688085a40 con 0x7f269015a690 2024-08-18T22:31:28.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.868+0000 7f268f400640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26700679c0 0x7f2670069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:28.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.872+0000 7f268f400640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26700679c0 0x7f2670069e80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f267c0b3000 tx=0x7f267c0ab000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:28.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:28.872+0000 7f2687400640 1 -- 172.21.15.5:0/2711496821 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2688056680 con 0x7f269015a690 2024-08-18T22:31:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.072+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f26900adc90 con 0x7f269015a690 2024-08-18T22:31:29.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.076+0000 7f2687400640 1 -- 172.21.15.5:0/2711496821 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7f2688055f80 con 0x7f269015a690 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26700679c0 msgr2=0x7f2670069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26700679c0 0x7f2670069e80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f267c0b3000 tx=0x7f267c0ab000 comp rx=0 tx=0).stop 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f269015a690 msgr2=0x7f269014d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f269015a690 0x7f269014d040 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2688007cb0 tx=0x7f268800d490 comp rx=0 tx=0).stop 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 shutdown_connections 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26700679c0 0x7f2670069e80 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f269015a690 0x7f269014d040 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26900ccef0 0x7f2690153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 --2- 172.21.15.5:0/2711496821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2690073620 0x7f269015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 >> 172.21.15.5:0/2711496821 conn(0x7f26900b5800 msgr2=0x7f269006e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 shutdown_connections 2024-08-18T22:31:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.080+0000 7f2696000640 1 -- 172.21.15.5:0/2711496821 wait complete. 2024-08-18T22:31:29.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-08-18T22:31:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.240+0000 7fa5ab000640 1 Processor -- start 2024-08-18T22:31:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.240+0000 7fa5ab000640 1 -- start start 2024-08-18T22:31:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5ab000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa5a415e7a0 0x7fa5a406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5ab000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa5a406ef30 0x7fa5a415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5ab000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a415f0c0 0x7fa5a4160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5ab000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a41600a0 con 0x7fa5a406ef30 2024-08-18T22:31:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5ab000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a406f950 con 0x7fa5a415e7a0 2024-08-18T22:31:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5ab000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a406f3c0 con 0x7fa5a415f0c0 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa5a406ef30 0x7fa5a415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa5a406ef30 0x7fa5a415eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52082/0 (socket says 172.21.15.5:52082) 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a3400640 1 -- 172.21.15.5:0/1868860063 learned_addr learned my addr 172.21.15.5:0/1868860063 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a9000640 1 --2- 172.21.15.5:0/1868860063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a415f0c0 0x7fa5a4160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a3e00640 1 --2- 172.21.15.5:0/1868860063 >> v2:172.21.15.117:3300/0 conn(0x7fa5a415e7a0 0x7fa5a406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a3400640 1 -- 172.21.15.5:0/1868860063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a415f0c0 msgr2=0x7fa5a4160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a3400640 1 --2- 172.21.15.5:0/1868860063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a415f0c0 0x7fa5a4160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a3400640 1 -- 172.21.15.5:0/1868860063 >> v2:172.21.15.117:3300/0 conn(0x7fa5a415e7a0 msgr2=0x7fa5a406e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a3400640 1 --2- 172.21.15.5:0/1868860063 >> v2:172.21.15.117:3300/0 conn(0x7fa5a415e7a0 0x7fa5a406e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a3400640 1 -- 172.21.15.5:0/1868860063 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a406f670 con 0x7fa5a406ef30 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a9000640 1 --2- 172.21.15.5:0/1868860063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a415f0c0 0x7fa5a4160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a3e00640 1 --2- 172.21.15.5:0/1868860063 >> v2:172.21.15.117:3300/0 conn(0x7fa5a415e7a0 0x7fa5a406e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.244+0000 7fa5a3400640 1 --2- 172.21.15.5:0/1868860063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a406ef30 0x7fa5a415eb80 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fa5a406fbe0 tx=0x7fa59001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c878503d83f4723 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5a2a00640 1 -- 172.21.15.5:0/1868860063 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5900b0070 con 0x7fa5a406ef30 2024-08-18T22:31:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5a2a00640 1 -- 172.21.15.5:0/1868860063 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5900ab600 con 0x7fa5a406ef30 2024-08-18T22:31:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5a2a00640 1 -- 172.21.15.5:0/1868860063 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5900ab9d0 con 0x7fa5a406ef30 2024-08-18T22:31:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 -- 172.21.15.5:0/1868860063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a406ef30 msgr2=0x7fa5a415eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 --2- 172.21.15.5:0/1868860063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a406ef30 0x7fa5a415eb80 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fa5a406fbe0 tx=0x7fa59001c520 comp rx=0 tx=0).stop 2024-08-18T22:31:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 -- 172.21.15.5:0/1868860063 shutdown_connections 2024-08-18T22:31:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 --2- 172.21.15.5:0/1868860063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a415f0c0 0x7fa5a4160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 --2- 172.21.15.5:0/1868860063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a406ef30 0x7fa5a415eb80 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 --2- 172.21.15.5:0/1868860063 >> v2:172.21.15.117:3300/0 conn(0x7fa5a415e7a0 0x7fa5a406e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 -- 172.21.15.5:0/1868860063 >> 172.21.15.5:0/1868860063 conn(0x7fa5a4070190 msgr2=0x7fa5a406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 -- 172.21.15.5:0/1868860063 shutdown_connections 2024-08-18T22:31:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 -- 172.21.15.5:0/1868860063 wait complete. 2024-08-18T22:31:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 Processor -- start 2024-08-18T22:31:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 -- start start 2024-08-18T22:31:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a406ef30 0x7fa5a414a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a415e7a0 0x7fa5a414a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a415f0c0 0x7fa5a413f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a4161400 con 0x7fa5a415e7a0 2024-08-18T22:31:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a4161280 con 0x7fa5a406ef30 2024-08-18T22:31:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5ab000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a4161580 con 0x7fa5a415f0c0 2024-08-18T22:31:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5a3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a415e7a0 0x7fa5a414a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5a3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a415e7a0 0x7fa5a414a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52094/0 (socket says 172.21.15.5:52094) 2024-08-18T22:31:29.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5a3400640 1 -- 172.21.15.5:0/3664606248 learned_addr learned my addr 172.21.15.5:0/3664606248 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.248+0000 7fa5a3e00640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a406ef30 0x7fa5a414a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa5a9000640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a415f0c0 0x7fa5a413f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa5a3400640 1 -- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a415f0c0 msgr2=0x7fa5a413f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa5a3400640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a415f0c0 0x7fa5a413f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa5a3400640 1 -- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a406ef30 msgr2=0x7fa5a414a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa5a3400640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a406ef30 0x7fa5a414a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa5a3400640 1 -- 172.21.15.5:0/3664606248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a4139880 con 0x7fa5a415e7a0 2024-08-18T22:31:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa5a3400640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a415e7a0 0x7fa5a414a690 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fa5900ae040 tx=0x7fa5900192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa59be00640 1 -- 172.21.15.5:0/3664606248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5900b0040 con 0x7fa5a415e7a0 2024-08-18T22:31:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa59be00640 1 -- 172.21.15.5:0/3664606248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5900b9070 con 0x7fa5a415e7a0 2024-08-18T22:31:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa59be00640 1 -- 172.21.15.5:0/3664606248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5900b4680 con 0x7fa5a415e7a0 2024-08-18T22:31:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa5ab000640 1 -- 172.21.15.5:0/3664606248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a41fec20 con 0x7fa5a415e7a0 2024-08-18T22:31:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa5ab000640 1 -- 172.21.15.5:0/3664606248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a41ff1e0 con 0x7fa5a415e7a0 2024-08-18T22:31:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa5ab000640 1 -- 172.21.15.5:0/3664606248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a406e9f0 con 0x7fa5a415e7a0 2024-08-18T22:31:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa59be00640 1 -- 172.21.15.5:0/3664606248 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5900b4820 con 0x7fa5a415e7a0 2024-08-18T22:31:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa59be00640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5840678c0 0x7fa584069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.252+0000 7fa59be00640 1 -- 172.21.15.5:0/3664606248 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7fa59011f750 con 0x7fa5a415e7a0 2024-08-18T22:31:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.256+0000 7fa5a3e00640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5840678c0 0x7fa584069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.256+0000 7fa5a3e00640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5840678c0 0x7fa584069d80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa5940098d0 tx=0x7fa594008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.256+0000 7fa59be00640 1 -- 172.21.15.5:0/3664606248 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa590016110 con 0x7fa5a415e7a0 2024-08-18T22:31:29.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.480+0000 7fa5ab000640 1 -- 172.21.15.5:0/3664606248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7fa5a4157c80 con 0x7fa5a415e7a0 2024-08-18T22:31:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.648+0000 7fa59be00640 1 -- 172.21.15.5:0/3664606248 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v576) ==== 166+0+0 (secure 0 0 0) 0x7fa5900efd50 con 0x7fa5a415e7a0 2024-08-18T22:31:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 -- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5840678c0 msgr2=0x7fa584069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5840678c0 0x7fa584069d80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa5940098d0 tx=0x7fa594008040 comp rx=0 tx=0).stop 2024-08-18T22:31:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 -- 172.21.15.5:0/3664606248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a415e7a0 msgr2=0x7fa5a414a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a415e7a0 0x7fa5a414a690 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fa5900ae040 tx=0x7fa5900192c0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 -- 172.21.15.5:0/3664606248 shutdown_connections 2024-08-18T22:31:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa5840678c0 0x7fa584069d80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a415f0c0 0x7fa5a413f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5a415e7a0 0x7fa5a414a690 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 --2- 172.21.15.5:0/3664606248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a406ef30 0x7fa5a414a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 -- 172.21.15.5:0/3664606248 >> 172.21.15.5:0/3664606248 conn(0x7fa5a4070190 msgr2=0x7fa5a41581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 -- 172.21.15.5:0/3664606248 shutdown_connections 2024-08-18T22:31:29.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.652+0000 7fa5ab000640 1 -- 172.21.15.5:0/3664606248 wait complete. 2024-08-18T22:31:29.673 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-08-18T22:31:29.673 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-08-18T22:31:29.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:31:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9aa5e00640 1 Processor -- start 2024-08-18T22:31:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9aa5e00640 1 -- start start 2024-08-18T22:31:29.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9aa5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa0161960 0x7f9aa006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9aa5e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9aa015e4b0 0x7f9aa0070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9aa5e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa015eb60 con 0x7f9aa0070730 2024-08-18T22:31:29.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9aa5e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa015fcc0 con 0x7f9aa015e4b0 2024-08-18T22:31:29.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9aa5e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa00710b0 con 0x7f9aa0161960 2024-08-18T22:31:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9a9ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa0161960 0x7f9aa006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9a9e000640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9aa0070730 0x7f9aa015dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:46668/0 (socket says 172.21.15.5:46668) 2024-08-18T22:31:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9a9e000640 1 -- 172.21.15.5:0/254001352 learned_addr learned my addr 172.21.15.5:0/254001352 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9a9f400640 1 --2- 172.21.15.5:0/254001352 >> v2:172.21.15.117:3300/0 conn(0x7f9aa015e4b0 0x7f9aa0070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9a9ea00640 1 -- 172.21.15.5:0/254001352 >> v2:172.21.15.117:3300/0 conn(0x7f9aa015e4b0 msgr2=0x7f9aa0070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9a9ea00640 1 --2- 172.21.15.5:0/254001352 >> v2:172.21.15.117:3300/0 conn(0x7f9aa015e4b0 0x7f9aa0070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9a9ea00640 1 -- 172.21.15.5:0/254001352 >> v1:172.21.15.117:6789/0 conn(0x7f9aa0070730 legacy=0x7f9aa015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:29.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.816+0000 7f9a9ea00640 1 -- 172.21.15.5:0/254001352 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa015ee40 con 0x7f9aa0161960 2024-08-18T22:31:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9a9ea00640 1 --2- 172.21.15.5:0/254001352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa0161960 0x7f9aa006fd20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9a900097c0 tx=0x7f9a9001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db1b213b37dc7ef0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9a9d600640 1 -- 172.21.15.5:0/254001352 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a900b0070 con 0x7f9aa0161960 2024-08-18T22:31:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9a9d600640 1 -- 172.21.15.5:0/254001352 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a900ab600 con 0x7f9aa0161960 2024-08-18T22:31:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9a9d600640 1 -- 172.21.15.5:0/254001352 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a900ab9d0 con 0x7f9aa0161960 2024-08-18T22:31:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9aa5e00640 1 -- 172.21.15.5:0/254001352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa0161960 msgr2=0x7f9aa006fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9aa5e00640 1 --2- 172.21.15.5:0/254001352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa0161960 0x7f9aa006fd20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9a900097c0 tx=0x7f9a9001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9aa5e00640 1 -- 172.21.15.5:0/254001352 shutdown_connections 2024-08-18T22:31:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9aa5e00640 1 --2- 172.21.15.5:0/254001352 >> v2:172.21.15.117:3300/0 conn(0x7f9aa015e4b0 0x7f9aa0070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9aa5e00640 1 --2- 172.21.15.5:0/254001352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa0161960 0x7f9aa006fd20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9aa5e00640 1 -- 172.21.15.5:0/254001352 >> 172.21.15.5:0/254001352 conn(0x7f9aa00d2130 msgr2=0x7f9aa00d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9aa5e00640 1 -- 172.21.15.5:0/254001352 shutdown_connections 2024-08-18T22:31:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.820+0000 7f9aa5e00640 1 -- 172.21.15.5:0/254001352 wait complete. 2024-08-18T22:31:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9aa5e00640 1 Processor -- start 2024-08-18T22:31:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9aa5e00640 1 -- start start 2024-08-18T22:31:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9aa5e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa0070730 0x7f9aa015be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9aa5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa015e4b0 0x7f9aa00b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9aa5e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9aa0161960 0x7f9aa00ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9aa5e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa009ba30 con 0x7f9aa015e4b0 2024-08-18T22:31:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9aa5e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa0070260 con 0x7f9aa0161960 2024-08-18T22:31:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9aa5e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa00ca210 con 0x7f9aa0070730 2024-08-18T22:31:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa015e4b0 0x7f9aa00b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa015e4b0 0x7f9aa00b73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52104/0 (socket says 172.21.15.5:52104) 2024-08-18T22:31:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9e000640 1 -- 172.21.15.5:0/3994063661 learned_addr learned my addr 172.21.15.5:0/3994063661 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9ea00640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa0070730 0x7f9aa015be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9f400640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9aa0161960 0x7f9aa00ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9e000640 1 -- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa0070730 msgr2=0x7f9aa015be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9e000640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa0070730 0x7f9aa015be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9e000640 1 -- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9aa0161960 msgr2=0x7f9aa00ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9e000640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9aa0161960 0x7f9aa00ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9e000640 1 -- 172.21.15.5:0/3994063661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa00ca630 con 0x7f9aa015e4b0 2024-08-18T22:31:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9f400640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9aa0161960 0x7f9aa00ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a9e000640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa015e4b0 0x7f9aa00b73b0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00c340 tx=0x7f9a8c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a97400640 1 -- 172.21.15.5:0/3994063661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c017070 con 0x7f9aa015e4b0 2024-08-18T22:31:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a97400640 1 -- 172.21.15.5:0/3994063661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a8c005cf0 con 0x7f9aa015e4b0 2024-08-18T22:31:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9a97400640 1 -- 172.21.15.5:0/3994063661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0072f0 con 0x7f9aa015e4b0 2024-08-18T22:31:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9aa5e00640 1 -- 172.21.15.5:0/3994063661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa00ca910 con 0x7f9aa015e4b0 2024-08-18T22:31:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.824+0000 7f9aa5e00640 1 -- 172.21.15.5:0/3994063661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa00caed0 con 0x7f9aa015e4b0 2024-08-18T22:31:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.828+0000 7f9aa5e00640 1 -- 172.21.15.5:0/3994063661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa0070b70 con 0x7f9aa015e4b0 2024-08-18T22:31:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.828+0000 7f9a97400640 1 -- 172.21.15.5:0/3994063661 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a8c01a070 con 0x7f9aa015e4b0 2024-08-18T22:31:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.828+0000 7f9a97400640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a800678c0 0x7f9a80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.828+0000 7f9a97400640 1 -- 172.21.15.5:0/3994063661 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7f9a8c084f40 con 0x7f9aa015e4b0 2024-08-18T22:31:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.828+0000 7f9a9ea00640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a800678c0 0x7f9a80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.828+0000 7f9a9ea00640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a800678c0 0x7f9a80069d80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9a900ad000 tx=0x7f9a900a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:29.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:29.832+0000 7f9a97400640 1 -- 172.21.15.5:0/3994063661 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9a8c055b10 con 0x7f9aa015e4b0 2024-08-18T22:31:29.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.000+0000 7f9aa5e00640 1 -- 172.21.15.5:0/3994063661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9aa009bbb0 con 0x7f9aa015e4b0 2024-08-18T22:31:30.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.000+0000 7f9a97400640 1 -- 172.21.15.5:0/3994063661 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) ==== 74+0+13355 (secure 0 0 0) 0x7f9a8c055410 con 0x7f9aa015e4b0 2024-08-18T22:31:30.001 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:30.001 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":170,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:31:28.644077+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6834/2956295757":"2024-08-19T22:31:25.632460+0000","172.21.15.5:6832/2956295757":"2024-08-19T22:31:25.632460+0000","172.21.15.5:6835/324683204":"2024-08-19T22:31:16.452649+0000","172.21.15.5:6833/324683204":"2024-08-19T22:31:16.452649+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:31:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 -- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a800678c0 msgr2=0x7f9a80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a800678c0 0x7f9a80069d80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9a900ad000 tx=0x7f9a900a6000 comp rx=0 tx=0).stop 2024-08-18T22:31:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 -- 172.21.15.5:0/3994063661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa015e4b0 msgr2=0x7f9aa00b73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa015e4b0 0x7f9aa00b73b0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00c340 tx=0x7f9a8c00c800 comp rx=0 tx=0).stop 2024-08-18T22:31:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 -- 172.21.15.5:0/3994063661 shutdown_connections 2024-08-18T22:31:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a800678c0 0x7f9a80069d80 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9aa0161960 0x7f9aa00ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa015e4b0 0x7f9aa00b73b0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 --2- 172.21.15.5:0/3994063661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa0070730 0x7f9aa015be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 -- 172.21.15.5:0/3994063661 >> 172.21.15.5:0/3994063661 conn(0x7f9aa00d2130 msgr2=0x7f9aa006d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 -- 172.21.15.5:0/3994063661 shutdown_connections 2024-08-18T22:31:30.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.004+0000 7f9aa5e00640 1 -- 172.21.15.5:0/3994063661 wait complete. 2024-08-18T22:31:30.021 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:31:30.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:31:30.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.164+0000 7fbf08c00640 1 Processor -- start 2024-08-18T22:31:30.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.164+0000 7fbf08c00640 1 -- start start 2024-08-18T22:31:30.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.168+0000 7fbf08c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf04144050 0x7fbf0406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:30.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.168+0000 7fbf08c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf0406ddd0 con 0x7fbf04147860 2024-08-18T22:31:30.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.168+0000 7fbf08c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf0406e0b0 con 0x7fbf0406f3b0 2024-08-18T22:31:30.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.168+0000 7fbf08c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbf0406db80 con 0x7fbf04144050 2024-08-18T22:31:30.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.168+0000 7fbf01e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf04144050 0x7fbf0406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:30.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.168+0000 7fbf02800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbf04147860 0x7fbf040b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49324/0 (socket says 172.21.15.5:49324) 2024-08-18T22:31:30.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.168+0000 7fbf02800640 1 -- 172.21.15.5:0/2540643040 learned_addr learned my addr 172.21.15.5:0/2540643040 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.168+0000 7fbf01e00640 1 -- 172.21.15.5:0/2540643040 >> v1:172.21.15.117:6789/0 conn(0x7fbf0406f3b0 legacy=0x7fbf04144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.168+0000 7fbf01e00640 1 -- 172.21.15.5:0/2540643040 >> v1:172.21.15.5:6789/0 conn(0x7fbf04147860 legacy=0x7fbf040b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.168+0000 7fbf01e00640 1 -- 172.21.15.5:0/2540643040 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0406e390 con 0x7fbf04144050 2024-08-18T22:31:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.168+0000 7fbf01400640 1 -- 172.21.15.5:0/2540643040 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258631143 0 0) 0x7fbf0406ddd0 con 0x7fbf04147860 2024-08-18T22:31:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf01e00640 1 --2- 172.21.15.5:0/2540643040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf04144050 0x7fbf0406ee70 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fbf0406dd00 tx=0x7fbef401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87a727cfbfee025 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf01400640 1 -- 172.21.15.5:0/2540643040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef40b0070 con 0x7fbf04144050 2024-08-18T22:31:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf01400640 1 -- 172.21.15.5:0/2540643040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef40ab600 con 0x7fbf04144050 2024-08-18T22:31:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf01400640 1 -- 172.21.15.5:0/2540643040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef40ab9d0 con 0x7fbf04144050 2024-08-18T22:31:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf08c00640 1 -- 172.21.15.5:0/2540643040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf04144050 msgr2=0x7fbf0406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf08c00640 1 --2- 172.21.15.5:0/2540643040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf04144050 0x7fbf0406ee70 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fbf0406dd00 tx=0x7fbef401c410 comp rx=0 tx=0).stop 2024-08-18T22:31:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf08c00640 1 -- 172.21.15.5:0/2540643040 shutdown_connections 2024-08-18T22:31:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf08c00640 1 --2- 172.21.15.5:0/2540643040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf04144050 0x7fbf0406ee70 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf08c00640 1 -- 172.21.15.5:0/2540643040 >> 172.21.15.5:0/2540643040 conn(0x7fbf040b1dc0 msgr2=0x7fbf040b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf08c00640 1 -- 172.21.15.5:0/2540643040 shutdown_connections 2024-08-18T22:31:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf08c00640 1 -- 172.21.15.5:0/2540643040 wait complete. 2024-08-18T22:31:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf08c00640 1 Processor -- start 2024-08-18T22:31:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.172+0000 7fbf08c00640 1 -- start start 2024-08-18T22:31:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf08c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf0406f3b0 0x7fbf0415f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf08c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf04144050 0x7fbf0415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf08c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf04147860 0x7fbf041604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf08c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbf040b3950 con 0x7fbf0406f3b0 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf08c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbf040b37d0 con 0x7fbf04147860 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf08c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0416c360 con 0x7fbf04144050 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf01e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf0406f3b0 0x7fbf0415f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf01e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf0406f3b0 0x7fbf0415f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52118/0 (socket says 172.21.15.5:52118) 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf01e00640 1 -- 172.21.15.5:0/3448259314 learned_addr learned my addr 172.21.15.5:0/3448259314 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf01e00640 1 -- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf04144050 msgr2=0x7fbf0415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf01e00640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf04144050 0x7fbf0415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf01e00640 1 -- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf04147860 msgr2=0x7fbf041604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf01e00640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf04147860 0x7fbf041604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf01e00640 1 -- 172.21.15.5:0/3448259314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf04160f60 con 0x7fbf0406f3b0 2024-08-18T22:31:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf01e00640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf0406f3b0 0x7fbf0415f6a0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fbef40ae040 tx=0x7fbef401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbefaa00640 1 -- 172.21.15.5:0/3448259314 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef40b0050 con 0x7fbf0406f3b0 2024-08-18T22:31:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbefaa00640 1 -- 172.21.15.5:0/3448259314 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef40bc070 con 0x7fbf0406f3b0 2024-08-18T22:31:30.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbefaa00640 1 -- 172.21.15.5:0/3448259314 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef40b5870 con 0x7fbf0406f3b0 2024-08-18T22:31:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf08c00640 1 -- 172.21.15.5:0/3448259314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0415ebc0 con 0x7fbf0406f3b0 2024-08-18T22:31:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf08c00640 1 -- 172.21.15.5:0/3448259314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf0415f180 con 0x7fbf0406f3b0 2024-08-18T22:31:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbf08c00640 1 -- 172.21.15.5:0/3448259314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf0406ee70 con 0x7fbf0406f3b0 2024-08-18T22:31:30.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.176+0000 7fbefaa00640 1 -- 172.21.15.5:0/3448259314 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbef40b5a10 con 0x7fbf0406f3b0 2024-08-18T22:31:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.180+0000 7fbefaa00640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbee00678c0 0x7fbee0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.180+0000 7fbefaa00640 1 -- 172.21.15.5:0/3448259314 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7fbef4120330 con 0x7fbf0406f3b0 2024-08-18T22:31:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.180+0000 7fbef9400640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbee00678c0 0x7fbee0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.180+0000 7fbef9400640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbee00678c0 0x7fbee0069d80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fbeec000f70 tx=0x7fbeec0079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.184+0000 7fbefaa00640 1 -- 172.21.15.5:0/3448259314 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbef4016090 con 0x7fbf0406f3b0 2024-08-18T22:31:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.348+0000 7fbf08c00640 1 -- 172.21.15.5:0/3448259314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbf0406f7c0 con 0x7fbf0406f3b0 2024-08-18T22:31:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.348+0000 7fbefaa00640 1 -- 172.21.15.5:0/3448259314 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) ==== 93+0+10 (secure 0 0 0) 0x7fbef40f1020 con 0x7fbf0406f3b0 2024-08-18T22:31:30.349 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:31:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 -- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbee00678c0 msgr2=0x7fbee0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbee00678c0 0x7fbee0069d80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fbeec000f70 tx=0x7fbeec0079c0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 -- 172.21.15.5:0/3448259314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf0406f3b0 msgr2=0x7fbf0415f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf0406f3b0 0x7fbf0415f6a0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fbef40ae040 tx=0x7fbef401ac50 comp rx=0 tx=0).stop 2024-08-18T22:31:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 -- 172.21.15.5:0/3448259314 shutdown_connections 2024-08-18T22:31:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbee00678c0 0x7fbee0069d80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf04147860 0x7fbf041604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf04144050 0x7fbf0415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 --2- 172.21.15.5:0/3448259314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf0406f3b0 0x7fbf0415f6a0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 -- 172.21.15.5:0/3448259314 >> 172.21.15.5:0/3448259314 conn(0x7fbf040b1dc0 msgr2=0x7fbf04071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 -- 172.21.15.5:0/3448259314 shutdown_connections 2024-08-18T22:31:30.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.352+0000 7fbf08c00640 1 -- 172.21.15.5:0/3448259314 wait complete. 2024-08-18T22:31:30.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-08-18T22:31:30.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f715f600640 1 Processor -- start 2024-08-18T22:31:30.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f715f600640 1 -- start start 2024-08-18T22:31:30.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f715f600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71580cb390 0x7f71580735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:30.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f715f600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7158073c80 con 0x7f715806da70 2024-08-18T22:31:30.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f715f600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71580ca5d0 con 0x7f715815bed0 2024-08-18T22:31:30.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f715f600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f71580ca8b0 con 0x7f71580cb390 2024-08-18T22:31:30.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f7157e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71580cb390 0x7f71580735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:30.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f715d600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f715806da70 0x7f7158165b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49332/0 (socket says 172.21.15.5:49332) 2024-08-18T22:31:30.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f715d600640 1 -- 172.21.15.5:0/950247572 learned_addr learned my addr 172.21.15.5:0/950247572 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:30.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f7157e00640 1 -- 172.21.15.5:0/950247572 >> v1:172.21.15.117:6789/0 conn(0x7f715815bed0 legacy=0x7f7158071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f7157400640 1 -- 172.21.15.5:0/950247572 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229252536 0 0) 0x7f7158073c80 con 0x7f715806da70 2024-08-18T22:31:30.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f7157e00640 1 -- 172.21.15.5:0/950247572 >> v1:172.21.15.5:6789/0 conn(0x7f715806da70 legacy=0x7f7158165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.512+0000 7f7157e00640 1 -- 172.21.15.5:0/950247572 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71580cab90 con 0x7f71580cb390 2024-08-18T22:31:30.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.516+0000 7f7157e00640 1 --2- 172.21.15.5:0/950247572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71580cb390 0x7f71580735a0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f71440097c0 tx=0x7f714401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c872b486238c1ed5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.516+0000 7f7157400640 1 -- 172.21.15.5:0/950247572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440b1070 con 0x7f71580cb390 2024-08-18T22:31:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.516+0000 7f7157400640 1 -- 172.21.15.5:0/950247572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71440ac5f0 con 0x7f71580cb390 2024-08-18T22:31:30.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.516+0000 7f7157400640 1 -- 172.21.15.5:0/950247572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440ac9c0 con 0x7f71580cb390 2024-08-18T22:31:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.516+0000 7f715f600640 1 -- 172.21.15.5:0/950247572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71580cb390 msgr2=0x7f71580735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.516+0000 7f715f600640 1 --2- 172.21.15.5:0/950247572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71580cb390 0x7f71580735a0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f71440097c0 tx=0x7f714401c470 comp rx=0 tx=0).stop 2024-08-18T22:31:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.516+0000 7f715f600640 1 -- 172.21.15.5:0/950247572 shutdown_connections 2024-08-18T22:31:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.516+0000 7f715f600640 1 --2- 172.21.15.5:0/950247572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71580cb390 0x7f71580735a0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.516+0000 7f715f600640 1 -- 172.21.15.5:0/950247572 >> 172.21.15.5:0/950247572 conn(0x7f71580b1c50 msgr2=0x7f71580b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:30.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.516+0000 7f715f600640 1 -- 172.21.15.5:0/950247572 shutdown_connections 2024-08-18T22:31:30.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.516+0000 7f715f600640 1 -- 172.21.15.5:0/950247572 wait complete. 2024-08-18T22:31:30.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715f600640 1 Processor -- start 2024-08-18T22:31:30.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715f600640 1 -- start start 2024-08-18T22:31:30.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715f600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715806da70 0x7f7158166c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715f600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71580cb390 0x7f71580c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715f600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715815bed0 0x7f715814ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715f600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7158169c40 con 0x7f715806da70 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715f600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7158169ac0 con 0x7f715815bed0 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715f600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7158169dc0 con 0x7f71580cb390 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715806da70 0x7f7158166c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715806da70 0x7f7158166c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52136/0 (socket says 172.21.15.5:52136) 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715cc00640 1 -- 172.21.15.5:0/1278736200 learned_addr learned my addr 172.21.15.5:0/1278736200 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f7157e00640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71580cb390 0x7f71580c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715d600640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715815bed0 0x7f715814ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715cc00640 1 -- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71580cb390 msgr2=0x7f71580c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715cc00640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71580cb390 0x7f71580c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715cc00640 1 -- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715815bed0 msgr2=0x7f715814ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715cc00640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715815bed0 0x7f715814ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715cc00640 1 -- 172.21.15.5:0/1278736200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71580b0240 con 0x7f715806da70 2024-08-18T22:31:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715cc00640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715806da70 0x7f7158166c00 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f714800c3c0 tx=0x7f714800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f7154c00640 1 -- 172.21.15.5:0/1278736200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148017070 con 0x7f715806da70 2024-08-18T22:31:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f7154c00640 1 -- 172.21.15.5:0/1278736200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71480052d0 con 0x7f715806da70 2024-08-18T22:31:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f7154c00640 1 -- 172.21.15.5:0/1278736200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148003840 con 0x7f715806da70 2024-08-18T22:31:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715f600640 1 -- 172.21.15.5:0/1278736200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71580ceb20 con 0x7f715806da70 2024-08-18T22:31:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.520+0000 7f715f600640 1 -- 172.21.15.5:0/1278736200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7158151050 con 0x7f715806da70 2024-08-18T22:31:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.524+0000 7f715f600640 1 -- 172.21.15.5:0/1278736200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71580735a0 con 0x7f715806da70 2024-08-18T22:31:30.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.524+0000 7f7154c00640 1 -- 172.21.15.5:0/1278736200 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f714801a070 con 0x7f715806da70 2024-08-18T22:31:30.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.524+0000 7f7154c00640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71380678c0 0x7f7138069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:30.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.524+0000 7f7154c00640 1 -- 172.21.15.5:0/1278736200 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7f7148084f50 con 0x7f715806da70 2024-08-18T22:31:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.524+0000 7f7157e00640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71380678c0 0x7f7138069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.524+0000 7f7157e00640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71380678c0 0x7f7138069d80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f71440ae000 tx=0x7f71440a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:30.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.528+0000 7f7154c00640 1 -- 172.21.15.5:0/1278736200 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7148005480 con 0x7f715806da70 2024-08-18T22:31:30.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:30.752+0000 7f715f600640 1 -- 172.21.15.5:0/1278736200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f715806ca70 con 0x7f715806da70 2024-08-18T22:31:31.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.660+0000 7f7154c00640 1 -- 172.21.15.5:0/1278736200 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v578) ==== 162+0+0 (secure 0 0 0) 0x7f7148055b10 con 0x7f715806da70 2024-08-18T22:31:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 -- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71380678c0 msgr2=0x7f7138069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71380678c0 0x7f7138069d80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f71440ae000 tx=0x7f71440a7000 comp rx=0 tx=0).stop 2024-08-18T22:31:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 -- 172.21.15.5:0/1278736200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715806da70 msgr2=0x7f7158166c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715806da70 0x7f7158166c00 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f714800c3c0 tx=0x7f714800c880 comp rx=0 tx=0).stop 2024-08-18T22:31:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 -- 172.21.15.5:0/1278736200 shutdown_connections 2024-08-18T22:31:31.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f71380678c0 0x7f7138069d80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f715815bed0 0x7f715814ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71580cb390 0x7f71580c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 --2- 172.21.15.5:0/1278736200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f715806da70 0x7f7158166c00 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 -- 172.21.15.5:0/1278736200 >> 172.21.15.5:0/1278736200 conn(0x7f71580b1c50 msgr2=0x7f71580cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 -- 172.21.15.5:0/1278736200 shutdown_connections 2024-08-18T22:31:31.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.664+0000 7f715f600640 1 -- 172.21.15.5:0/1278736200 wait complete. 2024-08-18T22:31:31.686 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:31:31.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f262cc00640 1 Processor -- start 2024-08-18T22:31:31.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f262cc00640 1 -- start start 2024-08-18T22:31:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f262cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f262815b0c0 0x7f262806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f262cc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26280b40c0 0x7f26280b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f262cc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26280b31f0 con 0x7f2628072a30 2024-08-18T22:31:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f262cc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f26280b3d70 con 0x7f262815b0c0 2024-08-18T22:31:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f262cc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f26280b4a40 con 0x7f26280b40c0 2024-08-18T22:31:31.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f2625e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f262815b0c0 0x7f262806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:31.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f2625e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f262815b0c0 0x7f262806db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52150/0 (socket says 172.21.15.5:52150) 2024-08-18T22:31:31.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f2625e00640 1 -- 172.21.15.5:0/174387031 learned_addr learned my addr 172.21.15.5:0/174387031 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:31.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f2625400640 1 --2- 172.21.15.5:0/174387031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26280b40c0 0x7f26280b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:31.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f2625e00640 1 -- 172.21.15.5:0/174387031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26280b40c0 msgr2=0x7f26280b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:31.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f2625e00640 1 --2- 172.21.15.5:0/174387031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26280b40c0 0x7f26280b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:31.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f2625e00640 1 -- 172.21.15.5:0/174387031 >> v1:172.21.15.117:6789/0 conn(0x7f2628072a30 legacy=0x7f2628072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:31.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.836+0000 7f2625e00640 1 -- 172.21.15.5:0/174387031 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26280b34d0 con 0x7f262815b0c0 2024-08-18T22:31:31.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f2625e00640 1 --2- 172.21.15.5:0/174387031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262815b0c0 0x7f262806db80 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f2618009870 tx=0x7f261801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a13ffa725b17a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:31.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f2624a00640 1 -- 172.21.15.5:0/174387031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26180ab610 con 0x7f262815b0c0 2024-08-18T22:31:31.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f2624a00640 1 -- 172.21.15.5:0/174387031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26180b0070 con 0x7f262815b0c0 2024-08-18T22:31:31.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f2624a00640 1 -- 172.21.15.5:0/174387031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26180ab9d0 con 0x7f262815b0c0 2024-08-18T22:31:31.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f262cc00640 1 -- 172.21.15.5:0/174387031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262815b0c0 msgr2=0x7f262806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:31.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f262cc00640 1 --2- 172.21.15.5:0/174387031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262815b0c0 0x7f262806db80 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f2618009870 tx=0x7f261801c410 comp rx=0 tx=0).stop 2024-08-18T22:31:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f262cc00640 1 -- 172.21.15.5:0/174387031 shutdown_connections 2024-08-18T22:31:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f262cc00640 1 --2- 172.21.15.5:0/174387031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26280b40c0 0x7f26280b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f262cc00640 1 --2- 172.21.15.5:0/174387031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262815b0c0 0x7f262806db80 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f262cc00640 1 -- 172.21.15.5:0/174387031 >> 172.21.15.5:0/174387031 conn(0x7f26280b1dc0 msgr2=0x7f26280b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f262cc00640 1 -- 172.21.15.5:0/174387031 shutdown_connections 2024-08-18T22:31:31.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f262cc00640 1 -- 172.21.15.5:0/174387031 wait complete. 2024-08-18T22:31:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.840+0000 7f262cc00640 1 Processor -- start 2024-08-18T22:31:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f262cc00640 1 -- start start 2024-08-18T22:31:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f262cc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2628072a30 0x7f2628157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f262cc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26280b40c0 0x7f2628099560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f262cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262815b0c0 0x7f2628099aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f262cc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f262815b4a0 con 0x7f262815b0c0 2024-08-18T22:31:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f262cc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f26280739a0 con 0x7f26280b40c0 2024-08-18T22:31:31.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f262cc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f262815b620 con 0x7f2628072a30 2024-08-18T22:31:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2626800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262815b0c0 0x7f2628099aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2626800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262815b0c0 0x7f2628099aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52160/0 (socket says 172.21.15.5:52160) 2024-08-18T22:31:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2626800640 1 -- 172.21.15.5:0/406598175 learned_addr learned my addr 172.21.15.5:0/406598175 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2625400640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26280b40c0 0x7f2628099560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2625e00640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2628072a30 0x7f2628157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2626800640 1 -- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2628072a30 msgr2=0x7f2628157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2626800640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2628072a30 0x7f2628157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2626800640 1 -- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26280b40c0 msgr2=0x7f2628099560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2626800640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26280b40c0 0x7f2628099560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2626800640 1 -- 172.21.15.5:0/406598175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2628158a30 con 0x7f262815b0c0 2024-08-18T22:31:31.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2625e00640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2628072a30 0x7f2628157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f2626800640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262815b0c0 0x7f2628099aa0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f262000c770 tx=0x7f262000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f261e000640 1 -- 172.21.15.5:0/406598175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620003b80 con 0x7f262815b0c0 2024-08-18T22:31:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f261e000640 1 -- 172.21.15.5:0/406598175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2620003d20 con 0x7f262815b0c0 2024-08-18T22:31:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f261e000640 1 -- 172.21.15.5:0/406598175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262000aa90 con 0x7f262815b0c0 2024-08-18T22:31:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f262cc00640 1 -- 172.21.15.5:0/406598175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2628158d10 con 0x7f262815b0c0 2024-08-18T22:31:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f262cc00640 1 -- 172.21.15.5:0/406598175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26281592d0 con 0x7f262815b0c0 2024-08-18T22:31:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.844+0000 7f262cc00640 1 -- 172.21.15.5:0/406598175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f262806f670 con 0x7f262815b0c0 2024-08-18T22:31:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.848+0000 7f261e000640 1 -- 172.21.15.5:0/406598175 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f262000ac30 con 0x7f262815b0c0 2024-08-18T22:31:31.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.848+0000 7f261e000640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26080678c0 0x7f2608069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:31.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.848+0000 7f261e000640 1 -- 172.21.15.5:0/406598175 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7f2620085aa0 con 0x7f262815b0c0 2024-08-18T22:31:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.848+0000 7f2625e00640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26080678c0 0x7f2608069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.848+0000 7f2625e00640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26080678c0 0x7f2608069d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f26180af000 tx=0x7f26180a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:31.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:31.852+0000 7f261e000640 1 -- 172.21.15.5:0/406598175 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2620087e20 con 0x7f262815b0c0 2024-08-18T22:31:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.016+0000 7f262cc00640 1 -- 172.21.15.5:0/406598175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f262806de80 con 0x7f262815b0c0 2024-08-18T22:31:32.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.020+0000 7f261e000640 1 -- 172.21.15.5:0/406598175 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7f2620056660 con 0x7f262815b0c0 2024-08-18T22:31:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 -- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26080678c0 msgr2=0x7f2608069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26080678c0 0x7f2608069d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f26180af000 tx=0x7f26180a7000 comp rx=0 tx=0).stop 2024-08-18T22:31:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 -- 172.21.15.5:0/406598175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262815b0c0 msgr2=0x7f2628099aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262815b0c0 0x7f2628099aa0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f262000c770 tx=0x7f262000cc30 comp rx=0 tx=0).stop 2024-08-18T22:31:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 -- 172.21.15.5:0/406598175 shutdown_connections 2024-08-18T22:31:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f26080678c0 0x7f2608069d80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262815b0c0 0x7f2628099aa0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26280b40c0 0x7f2628099560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 --2- 172.21.15.5:0/406598175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2628072a30 0x7f2628157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 -- 172.21.15.5:0/406598175 >> 172.21.15.5:0/406598175 conn(0x7f26280b1dc0 msgr2=0x7f26280b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 -- 172.21.15.5:0/406598175 shutdown_connections 2024-08-18T22:31:32.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.024+0000 7f262cc00640 1 -- 172.21.15.5:0/406598175 wait complete. 2024-08-18T22:31:32.042 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:31:32.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:31:32.121 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:31:32.219 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:31:32.219 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:31:32.219 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:31:32.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:31:32.228 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:31:32.228 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:31:32.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:31:32.237 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:31:32.237 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:31:32.277 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:31:32.277 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:31:32.277 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:31:32.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:31:32.288 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:31:32.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:32.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf4000640 1 Processor -- start 2024-08-18T22:31:32.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf4000640 1 -- start start 2024-08-18T22:31:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf4000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0b54c0 0x7ffaec071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf4000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaec071c80 con 0x7ffaec06dd80 2024-08-18T22:31:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf4000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaec071f60 con 0x7ffaec0cbed0 2024-08-18T22:31:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf4000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffaec0cba40 con 0x7ffaec0b54c0 2024-08-18T22:31:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf0c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffaec06dd80 0x7ffaec0b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49342/0 (socket says 172.21.15.5:49342) 2024-08-18T22:31:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf0c00640 1 -- 172.21.15.5:0/2543530153 learned_addr learned my addr 172.21.15.5:0/2543530153 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf1600640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0b54c0 0x7ffaec071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537743059 0 0) 0x7ffaec071c80 con 0x7ffaec06dd80 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffad4003530 con 0x7ffaec06dd80 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1057963600 0 0) 0x7ffaec071f60 con 0x7ffaec0cbed0 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaec071c80 con 0x7ffaec0cbed0 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2131658671 0 0) 0x7ffad4003530 con 0x7ffaec06dd80 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0b54c0 msgr2=0x7ffaec071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0b54c0 0x7ffaec071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 >> v1:172.21.15.117:6789/0 conn(0x7ffaec0cbed0 legacy=0x7ffaec0cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaec0cb6d0 con 0x7ffaec06dd80 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7ffad8001680 con 0x7ffaec06dd80 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 >> v1:172.21.15.5:6789/0 conn(0x7ffaec06dd80 legacy=0x7ffaec0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffad4003b80 0x7ffad4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0b54c0 0x7ffad4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 0x7ffad40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec0cba40 con 0x7ffad4004d50 2024-08-18T22:31:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffad400ba80 con 0x7ffad4003b80 2024-08-18T22:31:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffad400bc30 con 0x7ffaec0b54c0 2024-08-18T22:31:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf2000640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 0x7ffad40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf1600640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffad4003b80 0x7ffad4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf0c00640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0b54c0 0x7ffad4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf2000640 1 -- 172.21.15.5:0/2543530153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0b54c0 msgr2=0x7ffad4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf2000640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0b54c0 0x7ffad4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf2000640 1 -- 172.21.15.5:0/2543530153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffad4003b80 msgr2=0x7ffad4003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf2000640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffad4003b80 0x7ffad4003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.464+0000 7ffaf2000640 1 -- 172.21.15.5:0/2543530153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad4003530 con 0x7ffad4004d50 2024-08-18T22:31:32.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.468+0000 7ffaf2000640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 0x7ffad40051d0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7ffae4001fd0 tx=0x7ffae401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b23dea65379d77 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:32.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.468+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4001c20 con 0x7ffad4004d50 2024-08-18T22:31:32.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.468+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffae4003ba0 con 0x7ffad4004d50 2024-08-18T22:31:32.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.468+0000 7ffaebe00640 1 -- 172.21.15.5:0/2543530153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae40050d0 con 0x7ffad4004d50 2024-08-18T22:31:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.468+0000 7ffaf4000640 1 -- 172.21.15.5:0/2543530153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 msgr2=0x7ffad40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.468+0000 7ffaf4000640 1 --2- 172.21.15.5:0/2543530153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 0x7ffad40051d0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7ffae4001fd0 tx=0x7ffae401c900 comp rx=0 tx=0).stop 2024-08-18T22:31:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.468+0000 7ffaf2000640 1 -- 172.21.15.5:0/2543530153 reap_dead start 2024-08-18T22:31:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.468+0000 7ffaf4000640 1 -- 172.21.15.5:0/2543530153 shutdown_connections 2024-08-18T22:31:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.468+0000 7ffaf4000640 1 -- 172.21.15.5:0/2543530153 >> 172.21.15.5:0/2543530153 conn(0x7ffaec0b3eb0 msgr2=0x7ffaec0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.468+0000 7ffaf4000640 1 -- 172.21.15.5:0/2543530153 shutdown_connections 2024-08-18T22:31:32.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.468+0000 7ffaf4000640 1 -- 172.21.15.5:0/2543530153 wait complete. 2024-08-18T22:31:32.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf4000640 1 Processor -- start 2024-08-18T22:31:32.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf4000640 1 -- start start 2024-08-18T22:31:32.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf4000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 0x7ffaec1f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf4000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec1f4e40 0x7ffaec0a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf4000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec1f35a0 0x7ffaec146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf4000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec1481a0 con 0x7ffad4004d50 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf4000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec148020 con 0x7ffaec1f4e40 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf4000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffaec071580 con 0x7ffaec1f35a0 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf1600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 0x7ffaec1f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf1600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 0x7ffaec1f4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52172/0 (socket says 172.21.15.5:52172) 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf1600640 1 -- 172.21.15.5:0/2607676387 learned_addr learned my addr 172.21.15.5:0/2607676387 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf0c00640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec1f4e40 0x7ffaec0a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf2000640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec1f35a0 0x7ffaec146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf1600640 1 -- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec1f35a0 msgr2=0x7ffaec146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf1600640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec1f35a0 0x7ffaec146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf1600640 1 -- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec1f4e40 msgr2=0x7ffaec0a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf1600640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec1f4e40 0x7ffaec0a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf1600640 1 -- 172.21.15.5:0/2607676387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaec0a99e0 con 0x7ffad4004d50 2024-08-18T22:31:32.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf2000640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec1f35a0 0x7ffaec146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:32.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf1600640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 0x7ffaec1f4700 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7ffae00119d0 tx=0x7ffae0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:32.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffae9600640 1 -- 172.21.15.5:0/2607676387 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae000fb50 con 0x7ffad4004d50 2024-08-18T22:31:32.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffae9600640 1 -- 172.21.15.5:0/2607676387 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffae000fcf0 con 0x7ffad4004d50 2024-08-18T22:31:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffae9600640 1 -- 172.21.15.5:0/2607676387 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae000fea0 con 0x7ffad4004d50 2024-08-18T22:31:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf4000640 1 -- 172.21.15.5:0/2607676387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaec0cf7f0 con 0x7ffad4004d50 2024-08-18T22:31:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.472+0000 7ffaf4000640 1 -- 172.21.15.5:0/2607676387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaec0cfdb0 con 0x7ffad4004d50 2024-08-18T22:31:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.476+0000 7ffaf4000640 1 -- 172.21.15.5:0/2607676387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaec071f60 con 0x7ffad4004d50 2024-08-18T22:31:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.476+0000 7ffae9600640 1 -- 172.21.15.5:0/2607676387 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffae0012040 con 0x7ffad4004d50 2024-08-18T22:31:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.476+0000 7ffae9600640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffacc0678c0 0x7ffacc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.476+0000 7ffae9600640 1 -- 172.21.15.5:0/2607676387 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7ffae0086130 con 0x7ffad4004d50 2024-08-18T22:31:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.476+0000 7ffaf0c00640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffacc0678c0 0x7ffacc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.476+0000 7ffaf0c00640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffacc0678c0 0x7ffacc069d80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ffad8001060 tx=0x7ffad8001e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.480+0000 7ffae9600640 1 -- 172.21.15.5:0/2607676387 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ffae0019030 con 0x7ffad4004d50 2024-08-18T22:31:32.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.680+0000 7ffaf4000640 1 -- 172.21.15.5:0/2607676387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffaec15e510 con 0x7ffad4004d50 2024-08-18T22:31:32.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.680+0000 7ffae9600640 1 -- 172.21.15.5:0/2607676387 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 131 v131) ==== 95+0+3093 (secure 0 0 0) 0x7ffae0056e40 con 0x7ffad4004d50 2024-08-18T22:31:32.681 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:32.681 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":131,"btime":"2024-08-18T22:31:26:634531+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2539008312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2539008312},{"type":"v1","addr":"172.21.15.117:6836","nonce":2539008312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":7907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2430116719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2430116719},{"type":"v1","addr":"172.21.15.117:6837","nonce":2430116719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":9900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3244493083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3244493083},{"type":"v1","addr":"172.21.15.5:6833","nonce":3244493083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131}],"filesystems":[]} 2024-08-18T22:31:32.682 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 131 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 -- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffacc0678c0 msgr2=0x7ffacc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffacc0678c0 0x7ffacc069d80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ffad8001060 tx=0x7ffad8001e50 comp rx=0 tx=0).stop 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 -- 172.21.15.5:0/2607676387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 msgr2=0x7ffaec1f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 0x7ffaec1f4700 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7ffae00119d0 tx=0x7ffae0011e90 comp rx=0 tx=0).stop 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 -- 172.21.15.5:0/2607676387 shutdown_connections 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffacc0678c0 0x7ffacc069d80 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec1f35a0 0x7ffaec146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec1f4e40 0x7ffaec0a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 --2- 172.21.15.5:0/2607676387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad4004d50 0x7ffaec1f4700 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 -- 172.21.15.5:0/2607676387 >> 172.21.15.5:0/2607676387 conn(0x7ffaec0b3eb0 msgr2=0x7ffaec160cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 -- 172.21.15.5:0/2607676387 shutdown_connections 2024-08-18T22:31:32.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.684+0000 7ffaf4000640 1 -- 172.21.15.5:0/2607676387 wait complete. 2024-08-18T22:31:32.704 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:31:32.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:31:32.704 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:31:32.704 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:31:32.705 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:31:32.705 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:31:32.705 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:31:32.705 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:31:32.705 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:31:32.705 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:31:32.705 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:31:32.705 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:31:32.706 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:31:32.706 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:31:32.718 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:31:32.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:31:32.719 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:31:32.720 DEBUG:teuthology.parallel:result is None 2024-08-18T22:31:32.720 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:31:32.721 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:31:32.721 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:31:32.721 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:31:32.722 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:31:32.722 DEBUG:teuthology.parallel:result is None 2024-08-18T22:31:32.771 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:31:32.771 DEBUG:teuthology.parallel:result is None 2024-08-18T22:31:32.773 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:31:32.773 DEBUG:teuthology.parallel:result is None 2024-08-18T22:31:32.773 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:31:32.806 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:31:32.806 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:31:32.862 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:31:32.863 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:31:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93e00640 1 Processor -- start 2024-08-18T22:31:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93e00640 1 -- start start 2024-08-18T22:31:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e940afe50 0x7f9e94166ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e94156800 con 0x7f9e940676e0 2024-08-18T22:31:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e9415c460 con 0x7f9e94156420 2024-08-18T22:31:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9e9415c740 con 0x7f9e940afe50 2024-08-18T22:31:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e940afe50 0x7f9e94166ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e940afe50 0x7f9e94166ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52210/0 (socket says 172.21.15.5:52210) 2024-08-18T22:31:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93400640 1 -- 172.21.15.5:0/972730698 learned_addr learned my addr 172.21.15.5:0/972730698 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e92000640 1 --1- 172.21.15.5:0/972730698 >> v1:172.21.15.5:6789/0 conn(0x7f9e940676e0 0x7f9e940af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49372/0 (socket says 172.21.15.5:49372) 2024-08-18T22:31:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93400640 1 -- 172.21.15.5:0/972730698 >> v1:172.21.15.117:6789/0 conn(0x7f9e94156420 legacy=0x7f9e940704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93400640 1 -- 172.21.15.5:0/972730698 >> v1:172.21.15.5:6789/0 conn(0x7f9e940676e0 legacy=0x7f9e940af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.920+0000 7f9e93400640 1 -- 172.21.15.5:0/972730698 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9415ca20 con 0x7f9e940afe50 2024-08-18T22:31:32.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.924+0000 7f9e93400640 1 --2- 172.21.15.5:0/972730698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e940afe50 0x7f9e94166ac0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009e50 tx=0x7f9e8c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cedca9fab6ce1fd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:32.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.924+0000 7f9e91600640 1 -- 172.21.15.5:0/972730698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0a5810 con 0x7f9e940afe50 2024-08-18T22:31:32.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.924+0000 7f9e91600640 1 -- 172.21.15.5:0/972730698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c0a59b0 con 0x7f9e940afe50 2024-08-18T22:31:32.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.924+0000 7f9e91600640 1 -- 172.21.15.5:0/972730698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0a5d80 con 0x7f9e940afe50 2024-08-18T22:31:32.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.924+0000 7f9e93e00640 1 -- 172.21.15.5:0/972730698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e940afe50 msgr2=0x7f9e94166ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.924+0000 7f9e93e00640 1 --2- 172.21.15.5:0/972730698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e940afe50 0x7f9e94166ac0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009e50 tx=0x7f9e8c01ca30 comp rx=0 tx=0).stop 2024-08-18T22:31:32.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.924+0000 7f9e93e00640 1 -- 172.21.15.5:0/972730698 shutdown_connections 2024-08-18T22:31:32.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.924+0000 7f9e93e00640 1 --2- 172.21.15.5:0/972730698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e940afe50 0x7f9e94166ac0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.924+0000 7f9e93e00640 1 -- 172.21.15.5:0/972730698 >> 172.21.15.5:0/972730698 conn(0x7f9e94073090 msgr2=0x7f9e9406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:32.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.924+0000 7f9e93e00640 1 -- 172.21.15.5:0/972730698 shutdown_connections 2024-08-18T22:31:32.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.924+0000 7f9e93e00640 1 -- 172.21.15.5:0/972730698 wait complete. 2024-08-18T22:31:32.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93e00640 1 Processor -- start 2024-08-18T22:31:32.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93e00640 1 -- start start 2024-08-18T22:31:32.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e940676e0 0x7f9e94147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e940afe50 0x7f9e94142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94156420 0x7f9e941433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94169a30 con 0x7f9e94156420 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94169bb0 con 0x7f9e940afe50 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e94169d30 con 0x7f9e940676e0 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94156420 0x7f9e941433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94156420 0x7f9e941433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52222/0 (socket says 172.21.15.5:52222) 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93400640 1 -- 172.21.15.5:0/3270333401 learned_addr learned my addr 172.21.15.5:0/3270333401 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e92000640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e940afe50 0x7f9e94142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e92a00640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e940676e0 0x7f9e94147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93400640 1 -- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e940676e0 msgr2=0x7f9e94147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93400640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e940676e0 0x7f9e94147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93400640 1 -- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e940afe50 msgr2=0x7f9e94142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93400640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e940afe50 0x7f9e94142e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93400640 1 -- 172.21.15.5:0/3270333401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e94141a90 con 0x7f9e94156420 2024-08-18T22:31:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e92a00640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e940676e0 0x7f9e94147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93400640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94156420 0x7f9e941433c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0af040 tx=0x7f9e8c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e8aa00640 1 -- 172.21.15.5:0/3270333401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0b8880 con 0x7f9e94156420 2024-08-18T22:31:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e8aa00640 1 -- 172.21.15.5:0/3270333401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c0be070 con 0x7f9e94156420 2024-08-18T22:31:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93e00640 1 -- 172.21.15.5:0/3270333401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e941439f0 con 0x7f9e94156420 2024-08-18T22:31:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e8aa00640 1 -- 172.21.15.5:0/3270333401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0b8c80 con 0x7f9e94156420 2024-08-18T22:31:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93e00640 1 -- 172.21.15.5:0/3270333401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e94144290 con 0x7f9e94156420 2024-08-18T22:31:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.928+0000 7f9e93e00640 1 -- 172.21.15.5:0/3270333401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e940af740 con 0x7f9e94156420 2024-08-18T22:31:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.932+0000 7f9e8aa00640 1 -- 172.21.15.5:0/3270333401 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e8c0c3460 con 0x7f9e94156420 2024-08-18T22:31:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.932+0000 7f9e8aa00640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9e740678c0 0x7f9e74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.932+0000 7f9e8aa00640 1 -- 172.21.15.5:0/3270333401 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7f9e8c120db0 con 0x7f9e94156420 2024-08-18T22:31:32.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.932+0000 7f9e92a00640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9e740678c0 0x7f9e74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:32.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.932+0000 7f9e92a00640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9e740678c0 0x7f9e74069d80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9e84001670 tx=0x7f9e84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:32.936+0000 7f9e8aa00640 1 -- 172.21.15.5:0/3270333401 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9e8c125070 con 0x7f9e94156420 2024-08-18T22:31:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.112+0000 7f9e93e00640 1 -- 172.21.15.5:0/3270333401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9e940b50b0 con 0x7f9e94156420 2024-08-18T22:31:33.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e8aa00640 1 -- 172.21.15.5:0/3270333401 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v172) ==== 97+0+0 (secure 0 0 0) 0x7f9e8c016620 con 0x7f9e94156420 2024-08-18T22:31:33.682 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 -- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9e740678c0 msgr2=0x7f9e74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9e740678c0 0x7f9e74069d80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9e84001670 tx=0x7f9e84009040 comp rx=0 tx=0).stop 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 -- 172.21.15.5:0/3270333401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94156420 msgr2=0x7f9e941433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94156420 0x7f9e941433c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0af040 tx=0x7f9e8c0197d0 comp rx=0 tx=0).stop 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 -- 172.21.15.5:0/3270333401 shutdown_connections 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9e740678c0 0x7f9e74069d80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e94156420 0x7f9e941433c0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e940afe50 0x7f9e94142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 --2- 172.21.15.5:0/3270333401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e940676e0 0x7f9e94147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 -- 172.21.15.5:0/3270333401 >> 172.21.15.5:0/3270333401 conn(0x7f9e94073090 msgr2=0x7f9e940b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 -- 172.21.15.5:0/3270333401 shutdown_connections 2024-08-18T22:31:33.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.684+0000 7f9e93e00640 1 -- 172.21.15.5:0/3270333401 wait complete. 2024-08-18T22:31:33.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:31:33.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.896+0000 7f89ca600640 1 Processor -- start 2024-08-18T22:31:33.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.896+0000 7f89ca600640 1 -- start start 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89ca600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89c415e460 0x7f89c406c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89ca600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c40cee40 0x7f89c40ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89ca600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c415e840 con 0x7f89c40ca3e0 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89ca600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f89c406c900 con 0x7f89c415e460 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89ca600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f89c40cf320 con 0x7f89c40cee40 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89c3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89c415e460 0x7f89c406c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89c3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89c415e460 0x7f89c406c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57652/0 (socket says 172.21.15.5:57652) 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89c3400640 1 -- 172.21.15.5:0/2666473601 learned_addr learned my addr 172.21.15.5:0/2666473601 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89c2a00640 1 --2- 172.21.15.5:0/2666473601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c40cee40 0x7f89c40ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89c3400640 1 -- 172.21.15.5:0/2666473601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c40cee40 msgr2=0x7f89c40ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89c3400640 1 --2- 172.21.15.5:0/2666473601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c40cee40 0x7f89c40ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:33.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89c3400640 1 -- 172.21.15.5:0/2666473601 >> v1:172.21.15.117:6789/0 conn(0x7f89c40ca3e0 legacy=0x7f89c40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:33.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89c3400640 1 -- 172.21.15.5:0/2666473601 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c40cf600 con 0x7f89c415e460 2024-08-18T22:31:33.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.900+0000 7f89c3400640 1 --2- 172.21.15.5:0/2666473601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89c415e460 0x7f89c406c3c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009870 tx=0x7f89b401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bdf19f6f8dc6cb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:33.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89c2000640 1 -- 172.21.15.5:0/2666473601 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b40b5070 con 0x7f89c415e460 2024-08-18T22:31:33.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89c2000640 1 -- 172.21.15.5:0/2666473601 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b40a8a50 con 0x7f89c415e460 2024-08-18T22:31:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89c2000640 1 -- 172.21.15.5:0/2666473601 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b40a8e20 con 0x7f89c415e460 2024-08-18T22:31:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 -- 172.21.15.5:0/2666473601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89c415e460 msgr2=0x7f89c406c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 --2- 172.21.15.5:0/2666473601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89c415e460 0x7f89c406c3c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009870 tx=0x7f89b401ed50 comp rx=0 tx=0).stop 2024-08-18T22:31:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 -- 172.21.15.5:0/2666473601 shutdown_connections 2024-08-18T22:31:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 --2- 172.21.15.5:0/2666473601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c40cee40 0x7f89c40ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 --2- 172.21.15.5:0/2666473601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89c415e460 0x7f89c406c3c0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 -- 172.21.15.5:0/2666473601 >> 172.21.15.5:0/2666473601 conn(0x7f89c409aa40 msgr2=0x7f89c40b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 -- 172.21.15.5:0/2666473601 shutdown_connections 2024-08-18T22:31:33.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 -- 172.21.15.5:0/2666473601 wait complete. 2024-08-18T22:31:33.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 Processor -- start 2024-08-18T22:31:33.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 -- start start 2024-08-18T22:31:33.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c40ca3e0 0x7f89c40b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:33.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c40cee40 0x7f89c40cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:33.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89c415e460 0x7f89c414b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:33.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f89c40cfea0 con 0x7f89c415e460 2024-08-18T22:31:33.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f89c40cfbc0 con 0x7f89c40ca3e0 2024-08-18T22:31:33.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89ca600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f89c40b3620 con 0x7f89c40cee40 2024-08-18T22:31:33.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89c415e460 0x7f89c414b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89c415e460 0x7f89c414b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57654/0 (socket says 172.21.15.5:57654) 2024-08-18T22:31:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.904+0000 7f89c3e00640 1 -- 172.21.15.5:0/683909803 learned_addr learned my addr 172.21.15.5:0/683909803 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89c2a00640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c40cee40 0x7f89c40cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89c3400640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c40ca3e0 0x7f89c40b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89c3e00640 1 -- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c40cee40 msgr2=0x7f89c40cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89c3e00640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c40cee40 0x7f89c40cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89c3e00640 1 -- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c40ca3e0 msgr2=0x7f89c40b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89c3e00640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c40ca3e0 0x7f89c40b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89c3e00640 1 -- 172.21.15.5:0/683909803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c40b7070 con 0x7f89c415e460 2024-08-18T22:31:33.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89c3e00640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89c415e460 0x7f89c414b640 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00c770 tx=0x7f89bc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:33.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89bb400640 1 -- 172.21.15.5:0/683909803 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc003b80 con 0x7f89c415e460 2024-08-18T22:31:33.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89bb400640 1 -- 172.21.15.5:0/683909803 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc003d20 con 0x7f89c415e460 2024-08-18T22:31:33.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89bb400640 1 -- 172.21.15.5:0/683909803 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc00aa90 con 0x7f89c415e460 2024-08-18T22:31:33.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89ca600640 1 -- 172.21.15.5:0/683909803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c40cc610 con 0x7f89c415e460 2024-08-18T22:31:33.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89ca600640 1 -- 172.21.15.5:0/683909803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c40b4100 con 0x7f89c415e460 2024-08-18T22:31:33.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89ca600640 1 -- 172.21.15.5:0/683909803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c406c3c0 con 0x7f89c415e460 2024-08-18T22:31:33.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89bb400640 1 -- 172.21.15.5:0/683909803 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f89bc00ac30 con 0x7f89c415e460 2024-08-18T22:31:33.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89bb400640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89a40678f0 0x7f89a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:33.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.908+0000 7f89bb400640 1 -- 172.21.15.5:0/683909803 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5249+0+0 (secure 0 0 0) 0x7f89bc085930 con 0x7f89c415e460 2024-08-18T22:31:33.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.912+0000 7f89c3400640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89a40678f0 0x7f89a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:33.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.912+0000 7f89c3400640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89a40678f0 0x7f89a4069db0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f89b40b2000 tx=0x7f89b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:33.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:33.916+0000 7f89bb400640 1 -- 172.21.15.5:0/683909803 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f89c40cc610 con 0x7f89c415e460 2024-08-18T22:31:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 -- 172.21.15.5:0/683909803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f89c40d1200 con 0x7f89c415e460 2024-08-18T22:31:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89bb400640 1 -- 172.21.15.5:0/683909803 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) ==== 80+0+5304 (secure 0 0 0) 0x7f89bc055f40 con 0x7f89c415e460 2024-08-18T22:31:34.135 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:34.135 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:31:34.136 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:31:34.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.136 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:31:34.136 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:31:34.136 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.136 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:31:34.136 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:31:34.136 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:31:34.136 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.136 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.137 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:31:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:31:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:31:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:31:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:31:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:31:34.138 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.139 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:31:34.140 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:31:34.140 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.141 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:31:34.141 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:31:34.141 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.141 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:31:34.141 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:31:34.141 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:31:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:31:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:31:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:31:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:31:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:31:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:31:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:31:34.144 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.144 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.144 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:31:34.144 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:31:34.144 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.144 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:31:34.145 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:31:34.145 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.145 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.145 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:31:34.145 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:31:34.145 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.145 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:31:34.145 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:31:34.145 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.146 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.146 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:31:34.146 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:31:34.146 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.146 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:31:34.146 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:31:34.146 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.146 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.147 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:31:34.147 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:31:34.147 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.147 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:31:34.147 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:31:34.147 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.147 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.147 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.148 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:31:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:31:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:31:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:31:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:31:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:31:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:31:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:31:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:31:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:31:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:31:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:31:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:31:34.153 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:31:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 -- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89a40678f0 msgr2=0x7f89a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89a40678f0 0x7f89a4069db0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f89b40b2000 tx=0x7f89b4009040 comp rx=0 tx=0).stop 2024-08-18T22:31:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 -- 172.21.15.5:0/683909803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89c415e460 msgr2=0x7f89c414b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89c415e460 0x7f89c414b640 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00c770 tx=0x7f89bc00cc30 comp rx=0 tx=0).stop 2024-08-18T22:31:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 -- 172.21.15.5:0/683909803 shutdown_connections 2024-08-18T22:31:34.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f89a40678f0 0x7f89a4069db0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89c415e460 0x7f89c414b640 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89c40cee40 0x7f89c40cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 --2- 172.21.15.5:0/683909803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89c40ca3e0 0x7f89c40b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 -- 172.21.15.5:0/683909803 >> 172.21.15.5:0/683909803 conn(0x7f89c409aa40 msgr2=0x7f89c40d1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 -- 172.21.15.5:0/683909803 shutdown_connections 2024-08-18T22:31:34.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.136+0000 7f89ca600640 1 -- 172.21.15.5:0/683909803 wait complete. 2024-08-18T22:31:34.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:31:34.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.300+0000 7f5407600640 1 Processor -- start 2024-08-18T22:31:34.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.300+0000 7f5407600640 1 -- start start 2024-08-18T22:31:34.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.300+0000 7f5407600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f540015ff60 0x7f54000ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.300+0000 7f5407600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5400160340 0x7f540009b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.300+0000 7f5407600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54000cff50 con 0x7f540009b8b0 2024-08-18T22:31:34.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.300+0000 7f5407600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f54000cfd00 con 0x7f540015ff60 2024-08-18T22:31:34.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.300+0000 7f5407600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f54000d0230 con 0x7f5400160340 2024-08-18T22:31:34.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f5404c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f540015ff60 0x7f54000ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f53f7e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5400160340 0x7f540009b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f5404c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f540015ff60 0x7f54000ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:42278/0 (socket says 172.21.15.5:42278) 2024-08-18T22:31:34.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f53f7e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5400160340 0x7f540009b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:50772/0 (socket says 172.21.15.5:50772) 2024-08-18T22:31:34.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f53f7e00640 1 -- 172.21.15.5:0/1547354802 learned_addr learned my addr 172.21.15.5:0/1547354802 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:34.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f53f7e00640 1 -- 172.21.15.5:0/1547354802 >> v2:172.21.15.117:3300/0 conn(0x7f540015ff60 msgr2=0x7f54000ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:34.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f53f7e00640 1 --2- 172.21.15.5:0/1547354802 >> v2:172.21.15.117:3300/0 conn(0x7f540015ff60 0x7f54000ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f53f7e00640 1 -- 172.21.15.5:0/1547354802 >> v1:172.21.15.117:6789/0 conn(0x7f540009b8b0 legacy=0x7f54000ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f53f7e00640 1 -- 172.21.15.5:0/1547354802 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540009ab70 con 0x7f5400160340 2024-08-18T22:31:34.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f53f7e00640 1 --2- 172.21.15.5:0/1547354802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5400160340 0x7f540009b370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009870 tx=0x7f53e801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0dbc9b1f7c0d3ff server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:34.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f53ffe00640 1 -- 172.21.15.5:0/1547354802 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e80b0070 con 0x7f5400160340 2024-08-18T22:31:34.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f53ffe00640 1 -- 172.21.15.5:0/1547354802 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e8004230 con 0x7f5400160340 2024-08-18T22:31:34.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.304+0000 7f53ffe00640 1 -- 172.21.15.5:0/1547354802 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8003620 con 0x7f5400160340 2024-08-18T22:31:34.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 -- 172.21.15.5:0/1547354802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5400160340 msgr2=0x7f540009b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 --2- 172.21.15.5:0/1547354802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5400160340 0x7f540009b370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009870 tx=0x7f53e801c440 comp rx=0 tx=0).stop 2024-08-18T22:31:34.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 -- 172.21.15.5:0/1547354802 shutdown_connections 2024-08-18T22:31:34.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 --2- 172.21.15.5:0/1547354802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5400160340 0x7f540009b370 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 --2- 172.21.15.5:0/1547354802 >> v2:172.21.15.117:3300/0 conn(0x7f540015ff60 0x7f54000ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 -- 172.21.15.5:0/1547354802 >> 172.21.15.5:0/1547354802 conn(0x7f54000d2130 msgr2=0x7f54000d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:34.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 -- 172.21.15.5:0/1547354802 shutdown_connections 2024-08-18T22:31:34.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 -- 172.21.15.5:0/1547354802 wait complete. 2024-08-18T22:31:34.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 Processor -- start 2024-08-18T22:31:34.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 -- start start 2024-08-18T22:31:34.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f540009b8b0 0x7f5400159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f540015ff60 0x7f54001f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5400160340 0x7f54000b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5400169be0 con 0x7f5400160340 2024-08-18T22:31:34.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5400169a60 con 0x7f540009b8b0 2024-08-18T22:31:34.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5407600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5400169d60 con 0x7f540015ff60 2024-08-18T22:31:34.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5405600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5400160340 0x7f54000b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5404c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f540009b8b0 0x7f5400159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5405600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5400160340 0x7f54000b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57662/0 (socket says 172.21.15.5:57662) 2024-08-18T22:31:34.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5405600640 1 -- 172.21.15.5:0/438153672 learned_addr learned my addr 172.21.15.5:0/438153672 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:34.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f53f7e00640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f540015ff60 0x7f54001f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5405600640 1 -- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f540015ff60 msgr2=0x7f54001f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5405600640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f540015ff60 0x7f54001f5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5405600640 1 -- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f540009b8b0 msgr2=0x7f5400159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5405600640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f540009b8b0 0x7f5400159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5405600640 1 -- 172.21.15.5:0/438153672 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54000c9c10 con 0x7f5400160340 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.308+0000 7f5405600640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5400160340 0x7f54000b56c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c730 tx=0x7f53f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.312+0000 7f53fd600640 1 -- 172.21.15.5:0/438153672 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8003b80 con 0x7f5400160340 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.312+0000 7f53fd600640 1 -- 172.21.15.5:0/438153672 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f8003d20 con 0x7f5400160340 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.312+0000 7f53fd600640 1 -- 172.21.15.5:0/438153672 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f800aa30 con 0x7f5400160340 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.312+0000 7f5407600640 1 -- 172.21.15.5:0/438153672 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54000c9ed0 con 0x7f5400160340 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.312+0000 7f5407600640 1 -- 172.21.15.5:0/438153672 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54000ca490 con 0x7f5400160340 2024-08-18T22:31:34.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.312+0000 7f5407600640 1 -- 172.21.15.5:0/438153672 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f540009b370 con 0x7f5400160340 2024-08-18T22:31:34.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.312+0000 7f53fd600640 1 -- 172.21.15.5:0/438153672 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53f800abd0 con 0x7f5400160340 2024-08-18T22:31:34.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.312+0000 7f53fd600640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53dc0678c0 0x7f53dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.312+0000 7f53fd600640 1 -- 172.21.15.5:0/438153672 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5249+0+0 (secure 0 0 0) 0x7f53f80858d0 con 0x7f5400160340 2024-08-18T22:31:34.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.312+0000 7f5404c00640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53dc0678c0 0x7f53dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.316+0000 7f5404c00640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53dc0678c0 0x7f53dc069d80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009ac0 tx=0x7f53f0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:34.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.316+0000 7f53fd600640 1 -- 172.21.15.5:0/438153672 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f53f8055ee0 con 0x7f5400160340 2024-08-18T22:31:34.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.484+0000 7f5407600640 1 -- 172.21.15.5:0/438153672 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f54000d0f90 con 0x7f5400160340 2024-08-18T22:31:34.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.484+0000 7f53fd600640 1 -- 172.21.15.5:0/438153672 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v173) ==== 84+0+65 (secure 0 0 0) 0x7f53f805a1e0 con 0x7f5400160340 2024-08-18T22:31:34.484 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:34.484 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:31:34.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:31:34.484 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:31:34.484 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:31:34.484 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:31:34.484 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:31:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.484+0000 7f5407600640 1 -- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53dc0678c0 msgr2=0x7f53dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.484+0000 7f5407600640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53dc0678c0 0x7f53dc069d80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009ac0 tx=0x7f53f0009190 comp rx=0 tx=0).stop 2024-08-18T22:31:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.484+0000 7f5407600640 1 -- 172.21.15.5:0/438153672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5400160340 msgr2=0x7f54000b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.484+0000 7f5407600640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5400160340 0x7f54000b56c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c730 tx=0x7f53f800cbf0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.488+0000 7f5407600640 1 -- 172.21.15.5:0/438153672 shutdown_connections 2024-08-18T22:31:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.488+0000 7f5407600640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f53dc0678c0 0x7f53dc069d80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.488+0000 7f5407600640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5400160340 0x7f54000b56c0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.488+0000 7f5407600640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f540015ff60 0x7f54001f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.488+0000 7f5407600640 1 --2- 172.21.15.5:0/438153672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f540009b8b0 0x7f5400159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.488+0000 7f5407600640 1 -- 172.21.15.5:0/438153672 >> 172.21.15.5:0/438153672 conn(0x7f54000d2130 msgr2=0x7f5400070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:34.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.488+0000 7f5407600640 1 -- 172.21.15.5:0/438153672 shutdown_connections 2024-08-18T22:31:34.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.488+0000 7f5407600640 1 -- 172.21.15.5:0/438153672 wait complete. 2024-08-18T22:31:34.505 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:31:34.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:31:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bce600640 1 Processor -- start 2024-08-18T22:31:34.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bce600640 1 -- start start 2024-08-18T22:31:34.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bce600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1bc80b5050 0x7f1bc80b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bce600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc815e750 con 0x7f1bc80d2920 2024-08-18T22:31:34.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bce600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc815ea30 con 0x7f1bc80b43c0 2024-08-18T22:31:34.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bce600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1bc80b4810 con 0x7f1bc80b5050 2024-08-18T22:31:34.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bcd200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1bc80d2920 0x7f1bc80b55f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55774/0 (socket says 172.21.15.5:55774) 2024-08-18T22:31:34.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bcd200640 1 -- 172.21.15.5:0/1149271456 learned_addr learned my addr 172.21.15.5:0/1149271456 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7e00640 1 --2- 172.21.15.5:0/1149271456 >> v2:172.21.15.117:3300/0 conn(0x7f1bc80b5050 0x7f1bc80b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472106931 0 0) 0x7f1bc815e750 con 0x7f1bc80d2920 2024-08-18T22:31:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bac003530 con 0x7f1bc80d2920 2024-08-18T22:31:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942938805 0 0) 0x7f1bc815ea30 con 0x7f1bc80b43c0 2024-08-18T22:31:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bc815e750 con 0x7f1bc80b43c0 2024-08-18T22:31:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2932976689 0 0) 0x7f1bac003530 con 0x7f1bc80d2920 2024-08-18T22:31:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 >> v2:172.21.15.117:3300/0 conn(0x7f1bc80b5050 msgr2=0x7f1bc80b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:34.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 --2- 172.21.15.5:0/1149271456 >> v2:172.21.15.117:3300/0 conn(0x7f1bc80b5050 0x7f1bc80b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 >> v1:172.21.15.117:6789/0 conn(0x7f1bc80b43c0 legacy=0x7f1bc8141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc815ed10 con 0x7f1bc80d2920 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f1bb8001680 con 0x7f1bc80d2920 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 >> v1:172.21.15.5:6789/0 conn(0x7f1bc80d2920 legacy=0x7f1bc80b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 --2- 172.21.15.5:0/1149271456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bac003bc0 0x7f1bac003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 --2- 172.21.15.5:0/1149271456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac004810 0x7f1bac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 --2- 172.21.15.5:0/1149271456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bac005220 0x7f1bac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc80b4810 con 0x7f1bac004810 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac00c170 con 0x7f1bac003bc0 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1bac00c370 con 0x7f1bac005220 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bc7e00640 1 --2- 172.21.15.5:0/1149271456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac004810 0x7f1bac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bcd200640 1 --2- 172.21.15.5:0/1149271456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bac003bc0 0x7f1bac003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.652+0000 7f1bcdc00640 1 --2- 172.21.15.5:0/1149271456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bac005220 0x7f1bac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bc7e00640 1 -- 172.21.15.5:0/1149271456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bac005220 msgr2=0x7f1bac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:34.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bc7e00640 1 --2- 172.21.15.5:0/1149271456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bac005220 0x7f1bac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bc7e00640 1 -- 172.21.15.5:0/1149271456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bac003bc0 msgr2=0x7f1bac003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:34.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bc7e00640 1 --2- 172.21.15.5:0/1149271456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bac003bc0 0x7f1bac003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bc7e00640 1 -- 172.21.15.5:0/1149271456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bac003530 con 0x7f1bac004810 2024-08-18T22:31:34.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bcdc00640 1 -- 172.21.15.5:0/1149271456 reap_dead start 2024-08-18T22:31:34.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bc7e00640 1 --2- 172.21.15.5:0/1149271456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac004810 0x7f1bac004c90 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80b5430 tx=0x7f1bb401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce77af40ed6708b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:34.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40096b0 con 0x7f1bac004810 2024-08-18T22:31:34.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb40a9400 con 0x7f1bac004810 2024-08-18T22:31:34.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bc7400640 1 -- 172.21.15.5:0/1149271456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40a95f0 con 0x7f1bac004810 2024-08-18T22:31:34.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bce600640 1 -- 172.21.15.5:0/1149271456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac004810 msgr2=0x7f1bac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bce600640 1 --2- 172.21.15.5:0/1149271456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac004810 0x7f1bac004c90 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80b5430 tx=0x7f1bb401ca10 comp rx=0 tx=0).stop 2024-08-18T22:31:34.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bce600640 1 -- 172.21.15.5:0/1149271456 shutdown_connections 2024-08-18T22:31:34.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bce600640 1 --2- 172.21.15.5:0/1149271456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bac004810 0x7f1bac004c90 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.656+0000 7f1bce600640 1 -- 172.21.15.5:0/1149271456 >> 172.21.15.5:0/1149271456 conn(0x7f1bc8067840 msgr2=0x7f1bc8067c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:34.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bce600640 1 -- 172.21.15.5:0/1149271456 shutdown_connections 2024-08-18T22:31:34.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bce600640 1 -- 172.21.15.5:0/1149271456 wait complete. 2024-08-18T22:31:34.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bce600640 1 Processor -- start 2024-08-18T22:31:34.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bce600640 1 -- start start 2024-08-18T22:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bce600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bac004810 0x7f1bc81575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bce600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc8157f00 0x7f1bc81fb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bce600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bc81379e0 0x7f1bc8137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bce600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc8143b50 con 0x7f1bc8157f00 2024-08-18T22:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bce600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc81439d0 con 0x7f1bc81379e0 2024-08-18T22:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bce600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc8143cd0 con 0x7f1bac004810 2024-08-18T22:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc8157f00 0x7f1bc81fb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc8157f00 0x7f1bc81fb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57674/0 (socket says 172.21.15.5:57674) 2024-08-18T22:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc7e00640 1 -- 172.21.15.5:0/3177619636 learned_addr learned my addr 172.21.15.5:0/3177619636 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bcd200640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bac004810 0x7f1bc81575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bcdc00640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bc81379e0 0x7f1bc8137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc7e00640 1 -- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bac004810 msgr2=0x7f1bc81575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc7e00640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bac004810 0x7f1bc81575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc7e00640 1 -- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bc81379e0 msgr2=0x7f1bc8137e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc7e00640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bc81379e0 0x7f1bc8137e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc7e00640 1 -- 172.21.15.5:0/3177619636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc8138eb0 con 0x7f1bc8157f00 2024-08-18T22:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bcdc00640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bc81379e0 0x7f1bc8137e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc7e00640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc8157f00 0x7f1bc81fb840 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f1bb401cef0 tx=0x7f1bb401b250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc4c00640 1 -- 172.21.15.5:0/3177619636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40096b0 con 0x7f1bc8157f00 2024-08-18T22:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bce600640 1 -- 172.21.15.5:0/3177619636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc8139150 con 0x7f1bc8157f00 2024-08-18T22:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc4c00640 1 -- 172.21.15.5:0/3177619636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb400f000 con 0x7f1bc8157f00 2024-08-18T22:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.660+0000 7f1bc4c00640 1 -- 172.21.15.5:0/3177619636 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4004020 con 0x7f1bc8157f00 2024-08-18T22:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.664+0000 7f1bce600640 1 -- 172.21.15.5:0/3177619636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc8139710 con 0x7f1bc8157f00 2024-08-18T22:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.664+0000 7f1bce600640 1 -- 172.21.15.5:0/3177619636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc8144060 con 0x7f1bc8157f00 2024-08-18T22:31:34.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.664+0000 7f1bc4c00640 1 -- 172.21.15.5:0/3177619636 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1bb40041c0 con 0x7f1bc8157f00 2024-08-18T22:31:34.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.664+0000 7f1bc4c00640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ba80678f0 0x7f1ba8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:34.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.664+0000 7f1bc4c00640 1 -- 172.21.15.5:0/3177619636 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5249+0+0 (secure 0 0 0) 0x7f1bb4120360 con 0x7f1bc8157f00 2024-08-18T22:31:34.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.664+0000 7f1bcd200640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ba80678f0 0x7f1ba8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:34.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.664+0000 7f1bcd200640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ba80678f0 0x7f1ba8069db0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8000c10 tx=0x7f1bb8000fb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:34.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.668+0000 7f1bc4c00640 1 -- 172.21.15.5:0/3177619636 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1bb40ad020 con 0x7f1bc8157f00 2024-08-18T22:31:34.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:34.836+0000 7f1bce600640 1 -- 172.21.15.5:0/3177619636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1bc81623e0 con 0x7f1bc8157f00 2024-08-18T22:31:35.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.696+0000 7f1bc4c00640 1 -- 172.21.15.5:0/3177619636 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v174) ==== 138+0+0 (secure 0 0 0) 0x7f1bb4016720 con 0x7f1bc8157f00 2024-08-18T22:31:35.696 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 -- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ba80678f0 msgr2=0x7f1ba8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ba80678f0 0x7f1ba8069db0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8000c10 tx=0x7f1bb8000fb0 comp rx=0 tx=0).stop 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 -- 172.21.15.5:0/3177619636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc8157f00 msgr2=0x7f1bc81fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc8157f00 0x7f1bc81fb840 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f1bb401cef0 tx=0x7f1bb401b250 comp rx=0 tx=0).stop 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 -- 172.21.15.5:0/3177619636 shutdown_connections 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ba80678f0 0x7f1ba8069db0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1bc81379e0 0x7f1bc8137e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc8157f00 0x7f1bc81fb840 secure :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f1bb401cef0 tx=0x7f1bb401b250 comp rx=0 tx=0).stop 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 --2- 172.21.15.5:0/3177619636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1bac004810 0x7f1bc81575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 -- 172.21.15.5:0/3177619636 >> 172.21.15.5:0/3177619636 conn(0x7f1bc8067840 msgr2=0x7f1bc8067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 -- 172.21.15.5:0/3177619636 shutdown_connections 2024-08-18T22:31:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.700+0000 7f1bce600640 1 -- 172.21.15.5:0/3177619636 wait complete. 2024-08-18T22:31:35.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:31:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.880+0000 7fdc1ea00640 1 Processor -- start 2024-08-18T22:31:35.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.880+0000 7fdc1ea00640 1 -- start start 2024-08-18T22:31:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ea00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdc1815fb80 0x7fdc180d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 0x7fdc18071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ea00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc180d30b0 con 0x7fdc180b5ad0 2024-08-18T22:31:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ea00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdc180d1eb0 con 0x7fdc1815fb80 2024-08-18T22:31:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdc180d1bd0 con 0x7fdc180d1090 2024-08-18T22:31:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 0x7fdc18071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc17e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdc1815fb80 0x7fdc180d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 0x7fdc18071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:50796/0 (socket says 172.21.15.5:50796) 2024-08-18T22:31:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ca00640 1 -- 172.21.15.5:0/2875609196 learned_addr learned my addr 172.21.15.5:0/2875609196 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc17e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdc1815fb80 0x7fdc180d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:42338/0 (socket says 172.21.15.5:42338) 2024-08-18T22:31:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ca00640 1 -- 172.21.15.5:0/2875609196 >> v2:172.21.15.117:3300/0 conn(0x7fdc1815fb80 msgr2=0x7fdc180d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ca00640 1 --2- 172.21.15.5:0/2875609196 >> v2:172.21.15.117:3300/0 conn(0x7fdc1815fb80 0x7fdc180d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ca00640 1 -- 172.21.15.5:0/2875609196 >> v1:172.21.15.117:6789/0 conn(0x7fdc180b5ad0 legacy=0x7fdc1806fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc1ca00640 1 -- 172.21.15.5:0/2875609196 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc180d2dd0 con 0x7fdc180d1090 2024-08-18T22:31:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.884+0000 7fdc17e00640 1 --2- 172.21.15.5:0/2875609196 >> v2:172.21.15.117:3300/0 conn(0x7fdc1815fb80 0x7fdc180d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:31:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ca00640 1 --2- 172.21.15.5:0/2875609196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 0x7fdc18071550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009e50 tx=0x7fdc1001c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=764424420e4202a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc17400640 1 -- 172.21.15.5:0/2875609196 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc100a55d0 con 0x7fdc180d1090 2024-08-18T22:31:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc17400640 1 -- 172.21.15.5:0/2875609196 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc100a5770 con 0x7fdc180d1090 2024-08-18T22:31:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc17400640 1 -- 172.21.15.5:0/2875609196 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc100a5b40 con 0x7fdc180d1090 2024-08-18T22:31:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 -- 172.21.15.5:0/2875609196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 msgr2=0x7fdc18071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 --2- 172.21.15.5:0/2875609196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 0x7fdc18071550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009e50 tx=0x7fdc1001c910 comp rx=0 tx=0).stop 2024-08-18T22:31:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 -- 172.21.15.5:0/2875609196 shutdown_connections 2024-08-18T22:31:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 --2- 172.21.15.5:0/2875609196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 0x7fdc18071550 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 --2- 172.21.15.5:0/2875609196 >> v2:172.21.15.117:3300/0 conn(0x7fdc1815fb80 0x7fdc180d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:35.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 -- 172.21.15.5:0/2875609196 >> 172.21.15.5:0/2875609196 conn(0x7fdc180d2180 msgr2=0x7fdc180d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 -- 172.21.15.5:0/2875609196 shutdown_connections 2024-08-18T22:31:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 -- 172.21.15.5:0/2875609196 wait complete. 2024-08-18T22:31:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 Processor -- start 2024-08-18T22:31:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 -- start start 2024-08-18T22:31:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc180b5ad0 0x7fdc180b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 0x7fdc180b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc1815fb80 0x7fdc18149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdc18169270 con 0x7fdc1815fb80 2024-08-18T22:31:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdc181690f0 con 0x7fdc180b5ad0 2024-08-18T22:31:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.888+0000 7fdc1ea00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdc181693f0 con 0x7fdc180d1090 2024-08-18T22:31:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc1815fb80 0x7fdc18149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc1815fb80 0x7fdc18149d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57690/0 (socket says 172.21.15.5:57690) 2024-08-18T22:31:35.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ca00640 1 -- 172.21.15.5:0/4259139953 learned_addr learned my addr 172.21.15.5:0/4259139953 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc17e00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc180b5ad0 0x7fdc180b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:35.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc0f400640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 0x7fdc180b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ca00640 1 -- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 msgr2=0x7fdc180b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ca00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 0x7fdc180b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ca00640 1 -- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc180b5ad0 msgr2=0x7fdc180b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ca00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc180b5ad0 0x7fdc180b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ca00640 1 -- 172.21.15.5:0/4259139953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1814bc20 con 0x7fdc1815fb80 2024-08-18T22:31:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ca00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc1815fb80 0x7fdc18149d30 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fdc1001a540 tx=0x7fdc100196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc14c00640 1 -- 172.21.15.5:0/4259139953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc100bc020 con 0x7fdc1815fb80 2024-08-18T22:31:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc14c00640 1 -- 172.21.15.5:0/4259139953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc100b8670 con 0x7fdc1815fb80 2024-08-18T22:31:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc14c00640 1 -- 172.21.15.5:0/4259139953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc100a55d0 con 0x7fdc1815fb80 2024-08-18T22:31:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ea00640 1 -- 172.21.15.5:0/4259139953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc18153070 con 0x7fdc1815fb80 2024-08-18T22:31:35.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ea00640 1 -- 172.21.15.5:0/4259139953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1814b380 con 0x7fdc1815fb80 2024-08-18T22:31:35.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.892+0000 7fdc1ea00640 1 -- 172.21.15.5:0/4259139953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc18071550 con 0x7fdc1815fb80 2024-08-18T22:31:35.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.896+0000 7fdc14c00640 1 -- 172.21.15.5:0/4259139953 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc100bf020 con 0x7fdc1815fb80 2024-08-18T22:31:35.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.896+0000 7fdc14c00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbf4067910 0x7fdbf4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:35.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.896+0000 7fdc14c00640 1 -- 172.21.15.5:0/4259139953 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5619+0+0 (secure 0 0 0) 0x7fdc10120860 con 0x7fdc1815fb80 2024-08-18T22:31:35.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.896+0000 7fdc17e00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbf4067910 0x7fdbf4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:35.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.896+0000 7fdc17e00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbf4067910 0x7fdbf4069dd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009580 tx=0x7fdc08009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:35.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:35.900+0000 7fdc14c00640 1 -- 172.21.15.5:0/4259139953 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdc100c6030 con 0x7fdc1815fb80 2024-08-18T22:31:36.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.068+0000 7fdc1ea00640 1 -- 172.21.15.5:0/4259139953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdc180ce0d0 con 0x7fdc1815fb80 2024-08-18T22:31:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.704+0000 7fdc14c00640 1 -- 172.21.15.5:0/4259139953 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v175) ==== 170+0+0 (secure 0 0 0) 0x7fdc10016620 con 0x7fdc1815fb80 2024-08-18T22:31:36.704 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:31:36.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 -- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbf4067910 msgr2=0x7fdbf4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:36.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbf4067910 0x7fdbf4069dd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009580 tx=0x7fdc08009190 comp rx=0 tx=0).stop 2024-08-18T22:31:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 -- 172.21.15.5:0/4259139953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc1815fb80 msgr2=0x7fdc18149d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc1815fb80 0x7fdc18149d30 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fdc1001a540 tx=0x7fdc100196b0 comp rx=0 tx=0).stop 2024-08-18T22:31:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 -- 172.21.15.5:0/4259139953 shutdown_connections 2024-08-18T22:31:36.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdbf4067910 0x7fdbf4069dd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:36.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc1815fb80 0x7fdc18149d30 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:36.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc180d1090 0x7fdc180b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:36.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 --2- 172.21.15.5:0/4259139953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc180b5ad0 0x7fdc180b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:36.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 -- 172.21.15.5:0/4259139953 >> 172.21.15.5:0/4259139953 conn(0x7fdc180d2180 msgr2=0x7fdc180d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:36.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 -- 172.21.15.5:0/4259139953 shutdown_connections 2024-08-18T22:31:36.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.708+0000 7fdc1ea00640 1 -- 172.21.15.5:0/4259139953 wait complete. 2024-08-18T22:31:36.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:31:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5c600640 1 Processor -- start 2024-08-18T22:31:36.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5c600640 1 -- start start 2024-08-18T22:31:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5c600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbb5406d0d0 0x7fbb5406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5c600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb5415e7b0 0x7fbb540af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5c600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5415f780 con 0x7fbb54158710 2024-08-18T22:31:36.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5c600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5415eee0 con 0x7fbb5415e7b0 2024-08-18T22:31:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5c600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5415f1c0 con 0x7fbb5406d0d0 2024-08-18T22:31:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5a600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb5415e7b0 0x7fbb540af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5a600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb5415e7b0 0x7fbb540af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57696/0 (socket says 172.21.15.5:57696) 2024-08-18T22:31:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5a600640 1 -- 172.21.15.5:0/1070828276 learned_addr learned my addr 172.21.15.5:0/1070828276 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb59200640 1 --2- 172.21.15.5:0/1070828276 >> v2:172.21.15.117:3300/0 conn(0x7fbb5406d0d0 0x7fbb5406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5a600640 1 -- 172.21.15.5:0/1070828276 >> v2:172.21.15.117:3300/0 conn(0x7fbb5406d0d0 msgr2=0x7fbb5406ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5a600640 1 --2- 172.21.15.5:0/1070828276 >> v2:172.21.15.117:3300/0 conn(0x7fbb5406d0d0 0x7fbb5406ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5a600640 1 -- 172.21.15.5:0/1070828276 >> v1:172.21.15.117:6789/0 conn(0x7fbb54158710 legacy=0x7fbb5406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb5a600640 1 -- 172.21.15.5:0/1070828276 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5415f4a0 con 0x7fbb5415e7b0 2024-08-18T22:31:36.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.896+0000 7fbb59200640 1 --2- 172.21.15.5:0/1070828276 >> v2:172.21.15.117:3300/0 conn(0x7fbb5406d0d0 0x7fbb5406ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:36.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb5a600640 1 --2- 172.21.15.5:0/1070828276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb5415e7b0 0x7fbb540af390 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009e50 tx=0x7fbb4c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fda7a3e01e773c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb53e00640 1 -- 172.21.15.5:0/1070828276 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0a57d0 con 0x7fbb5415e7b0 2024-08-18T22:31:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb53e00640 1 -- 172.21.15.5:0/1070828276 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4c0a5970 con 0x7fbb5415e7b0 2024-08-18T22:31:36.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb53e00640 1 -- 172.21.15.5:0/1070828276 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0a5d40 con 0x7fbb5415e7b0 2024-08-18T22:31:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb5c600640 1 -- 172.21.15.5:0/1070828276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb5415e7b0 msgr2=0x7fbb540af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb5c600640 1 --2- 172.21.15.5:0/1070828276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb5415e7b0 0x7fbb540af390 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009e50 tx=0x7fbb4c01c9f0 comp rx=0 tx=0).stop 2024-08-18T22:31:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb5c600640 1 -- 172.21.15.5:0/1070828276 shutdown_connections 2024-08-18T22:31:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb5c600640 1 --2- 172.21.15.5:0/1070828276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb5415e7b0 0x7fbb540af390 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb5c600640 1 --2- 172.21.15.5:0/1070828276 >> v2:172.21.15.117:3300/0 conn(0x7fbb5406d0d0 0x7fbb5406ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb5c600640 1 -- 172.21.15.5:0/1070828276 >> 172.21.15.5:0/1070828276 conn(0x7fbb54072350 msgr2=0x7fbb54072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb5c600640 1 -- 172.21.15.5:0/1070828276 shutdown_connections 2024-08-18T22:31:36.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.900+0000 7fbb5c600640 1 -- 172.21.15.5:0/1070828276 wait complete. 2024-08-18T22:31:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5c600640 1 Processor -- start 2024-08-18T22:31:36.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5c600640 1 -- start start 2024-08-18T22:31:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5c600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb5406d0d0 0x7fbb54152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5c600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb54158710 0x7fbb5414b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5c600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb5415e7b0 0x7fbb5415ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5c600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb540b5050 con 0x7fbb5415e7b0 2024-08-18T22:31:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5c600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbb540b4ed0 con 0x7fbb5406d0d0 2024-08-18T22:31:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5c600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbb540b00e0 con 0x7fbb54158710 2024-08-18T22:31:36.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5a600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb5415e7b0 0x7fbb5415ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb59c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb5406d0d0 0x7fbb54152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5a600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb5415e7b0 0x7fbb5415ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57706/0 (socket says 172.21.15.5:57706) 2024-08-18T22:31:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5a600640 1 -- 172.21.15.5:0/4228180632 learned_addr learned my addr 172.21.15.5:0/4228180632 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb59200640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb54158710 0x7fbb5414b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5a600640 1 -- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb54158710 msgr2=0x7fbb5414b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5a600640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb54158710 0x7fbb5414b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5a600640 1 -- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb5406d0d0 msgr2=0x7fbb54152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5a600640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb5406d0d0 0x7fbb54152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5a600640 1 -- 172.21.15.5:0/4228180632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb541530c0 con 0x7fbb5415e7b0 2024-08-18T22:31:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb59200640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb54158710 0x7fbb5414b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:36.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5a600640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb5415e7b0 0x7fbb5415ff10 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c019600 tx=0x7fbb4c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:36.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb51600640 1 -- 172.21.15.5:0/4228180632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0bc020 con 0x7fbb5415e7b0 2024-08-18T22:31:36.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb51600640 1 -- 172.21.15.5:0/4228180632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4c0b8670 con 0x7fbb5415e7b0 2024-08-18T22:31:36.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5c600640 1 -- 172.21.15.5:0/4228180632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb54153380 con 0x7fbb5415e7b0 2024-08-18T22:31:36.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb51600640 1 -- 172.21.15.5:0/4228180632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0b8a20 con 0x7fbb5415e7b0 2024-08-18T22:31:36.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5c600640 1 -- 172.21.15.5:0/4228180632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb54153940 con 0x7fbb5415e7b0 2024-08-18T22:31:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.904+0000 7fbb5c600640 1 -- 172.21.15.5:0/4228180632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb5406ef60 con 0x7fbb5415e7b0 2024-08-18T22:31:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.908+0000 7fbb51600640 1 -- 172.21.15.5:0/4228180632 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbb4c0bf020 con 0x7fbb5415e7b0 2024-08-18T22:31:36.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.908+0000 7fbb51600640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb340678c0 0x7fbb34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.908+0000 7fbb51600640 1 -- 172.21.15.5:0/4228180632 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 6001+0+0 (secure 0 0 0) 0x7fbb4c120f50 con 0x7fbb5415e7b0 2024-08-18T22:31:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.908+0000 7fbb59c00640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb340678c0 0x7fbb34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:36.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.908+0000 7fbb59c00640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb340678c0 0x7fbb34069d80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbb48001810 tx=0x7fbb48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:36.912+0000 7fbb51600640 1 -- 172.21.15.5:0/4228180632 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbb4c0c6030 con 0x7fbb5415e7b0 2024-08-18T22:31:37.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.116+0000 7fbb5c600640 1 -- 172.21.15.5:0/4228180632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbb541500e0 con 0x7fbb5415e7b0 2024-08-18T22:31:37.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb51600640 1 -- 172.21.15.5:0/4228180632 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v134) ==== 174+0+0 (secure 0 0 0) 0x7fbb4c0165e0 con 0x7fbb5415e7b0 2024-08-18T22:31:37.707 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 25 and data pool 26 2024-08-18T22:31:37.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 -- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb340678c0 msgr2=0x7fbb34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:37.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb340678c0 0x7fbb34069d80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbb48001810 tx=0x7fbb48009040 comp rx=0 tx=0).stop 2024-08-18T22:31:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 -- 172.21.15.5:0/4228180632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb5415e7b0 msgr2=0x7fbb5415ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb5415e7b0 0x7fbb5415ff10 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c019600 tx=0x7fbb4c019790 comp rx=0 tx=0).stop 2024-08-18T22:31:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 -- 172.21.15.5:0/4228180632 shutdown_connections 2024-08-18T22:31:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbb340678c0 0x7fbb34069d80 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb5415e7b0 0x7fbb5415ff10 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb54158710 0x7fbb5414b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 --2- 172.21.15.5:0/4228180632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb5406d0d0 0x7fbb54152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 -- 172.21.15.5:0/4228180632 >> 172.21.15.5:0/4228180632 conn(0x7fbb54072350 msgr2=0x7fbb5406c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 -- 172.21.15.5:0/4228180632 shutdown_connections 2024-08-18T22:31:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.708+0000 7fbb5c600640 1 -- 172.21.15.5:0/4228180632 wait complete. 2024-08-18T22:31:37.761 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:31:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.904+0000 7f33c9200640 1 Processor -- start 2024-08-18T22:31:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.904+0000 7f33c9200640 1 -- start start 2024-08-18T22:31:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c9200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33c415e460 0x7f33c406c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33c40ca3e0 0x7f33c40ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c9200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c415e840 con 0x7f33c40cee40 2024-08-18T22:31:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c9200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f33c40ae750 con 0x7f33c40ca3e0 2024-08-18T22:31:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c9200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f33c406c900 con 0x7f33c415e460 2024-08-18T22:31:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c2800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33c40ca3e0 0x7f33c40ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c2800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33c40ca3e0 0x7f33c40ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57714/0 (socket says 172.21.15.5:57714) 2024-08-18T22:31:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c2800640 1 -- 172.21.15.5:0/1159252385 learned_addr learned my addr 172.21.15.5:0/1159252385 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c1e00640 1 --2- 172.21.15.5:0/1159252385 >> v2:172.21.15.117:3300/0 conn(0x7f33c415e460 0x7f33c406c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c2800640 1 -- 172.21.15.5:0/1159252385 >> v2:172.21.15.117:3300/0 conn(0x7f33c415e460 msgr2=0x7f33c406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c2800640 1 --2- 172.21.15.5:0/1159252385 >> v2:172.21.15.117:3300/0 conn(0x7f33c415e460 0x7f33c406c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c2800640 1 -- 172.21.15.5:0/1159252385 >> v1:172.21.15.117:6789/0 conn(0x7f33c40cee40 legacy=0x7f33c40ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.908+0000 7f33c2800640 1 -- 172.21.15.5:0/1159252385 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c40cf320 con 0x7f33c40ca3e0 2024-08-18T22:31:37.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c2800640 1 --2- 172.21.15.5:0/1159252385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c40ca3e0 0x7f33c40ca890 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f33c40ceb50 tx=0x7f33bc01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd5b1b32fb6a4ce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c1400640 1 -- 172.21.15.5:0/1159252385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0b4070 con 0x7f33c40ca3e0 2024-08-18T22:31:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c1400640 1 -- 172.21.15.5:0/1159252385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc0af400 con 0x7f33c40ca3e0 2024-08-18T22:31:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c1400640 1 -- 172.21.15.5:0/1159252385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0af7d0 con 0x7f33c40ca3e0 2024-08-18T22:31:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 -- 172.21.15.5:0/1159252385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c40ca3e0 msgr2=0x7f33c40ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 --2- 172.21.15.5:0/1159252385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c40ca3e0 0x7f33c40ca890 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f33c40ceb50 tx=0x7f33bc01f1e0 comp rx=0 tx=0).stop 2024-08-18T22:31:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 -- 172.21.15.5:0/1159252385 shutdown_connections 2024-08-18T22:31:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 --2- 172.21.15.5:0/1159252385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c40ca3e0 0x7f33c40ca890 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 --2- 172.21.15.5:0/1159252385 >> v2:172.21.15.117:3300/0 conn(0x7f33c415e460 0x7f33c406c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 -- 172.21.15.5:0/1159252385 >> 172.21.15.5:0/1159252385 conn(0x7f33c409aa40 msgr2=0x7f33c40b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 -- 172.21.15.5:0/1159252385 shutdown_connections 2024-08-18T22:31:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 -- 172.21.15.5:0/1159252385 wait complete. 2024-08-18T22:31:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 Processor -- start 2024-08-18T22:31:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 -- start start 2024-08-18T22:31:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33c40ca3e0 0x7f33c41f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c40cee40 0x7f33c4151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33c415e460 0x7f33c40b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f33c40cfbc0 con 0x7f33c40cee40 2024-08-18T22:31:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33c40cf8e0 con 0x7f33c40ca3e0 2024-08-18T22:31:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c9200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f33c40cfea0 con 0x7f33c415e460 2024-08-18T22:31:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33b9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c40cee40 0x7f33c4151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33b9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c40cee40 0x7f33c4151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57726/0 (socket says 172.21.15.5:57726) 2024-08-18T22:31:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33b9400640 1 -- 172.21.15.5:0/2925033926 learned_addr learned my addr 172.21.15.5:0/2925033926 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c2800640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33c415e460 0x7f33c40b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.912+0000 7f33c1e00640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33c40ca3e0 0x7f33c41f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33b9400640 1 -- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33c415e460 msgr2=0x7f33c40b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33b9400640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33c415e460 0x7f33c40b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33b9400640 1 -- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33c40ca3e0 msgr2=0x7f33c41f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33b9400640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33c40ca3e0 0x7f33c41f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33b9400640 1 -- 172.21.15.5:0/2925033926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c41f7d50 con 0x7f33c40cee40 2024-08-18T22:31:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33b9400640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c40cee40 0x7f33c4151b10 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00c450 tx=0x7f33ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33baa00640 1 -- 172.21.15.5:0/2925033926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac016020 con 0x7f33c40cee40 2024-08-18T22:31:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33baa00640 1 -- 172.21.15.5:0/2925033926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ac0052d0 con 0x7f33c40cee40 2024-08-18T22:31:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33c9200640 1 -- 172.21.15.5:0/2925033926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c41f8030 con 0x7f33c40cee40 2024-08-18T22:31:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33baa00640 1 -- 172.21.15.5:0/2925033926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac007260 con 0x7f33c40cee40 2024-08-18T22:31:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33c9200640 1 -- 172.21.15.5:0/2925033926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c40b4100 con 0x7f33c40cee40 2024-08-18T22:31:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33c9200640 1 -- 172.21.15.5:0/2925033926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c40b3620 con 0x7f33c40cee40 2024-08-18T22:31:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33baa00640 1 -- 172.21.15.5:0/2925033926 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33ac007400 con 0x7f33c40cee40 2024-08-18T22:31:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33baa00640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33a00678c0 0x7f33a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.916+0000 7f33baa00640 1 -- 172.21.15.5:0/2925033926 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f33ac085740 con 0x7f33c40cee40 2024-08-18T22:31:37.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.920+0000 7f33c1e00640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33a00678c0 0x7f33a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:37.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.920+0000 7f33c1e00640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33a00678c0 0x7f33a0069d80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009ac0 tx=0x7f33b4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:37.924+0000 7f33baa00640 1 -- 172.21.15.5:0/2925033926 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f33ac020020 con 0x7f33c40cee40 2024-08-18T22:31:38.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.092+0000 7f33c9200640 1 -- 172.21.15.5:0/2925033926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33c40b0e00 con 0x7f33c40cee40 2024-08-18T22:31:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.092+0000 7f33baa00640 1 -- 172.21.15.5:0/2925033926 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16829 (secure 0 0 0) 0x7f33ac005480 con 0x7f33c40cee40 2024-08-18T22:31:38.092 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:38.092 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":176,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:31:37.120133+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:31:34.888000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-08-18T22:31:36.119247+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:31:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 -- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33a00678c0 msgr2=0x7f33a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33a00678c0 0x7f33a0069d80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009ac0 tx=0x7f33b4009190 comp rx=0 tx=0).stop 2024-08-18T22:31:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 -- 172.21.15.5:0/2925033926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c40cee40 msgr2=0x7f33c4151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c40cee40 0x7f33c4151b10 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00c450 tx=0x7f33ac00c910 comp rx=0 tx=0).stop 2024-08-18T22:31:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 -- 172.21.15.5:0/2925033926 shutdown_connections 2024-08-18T22:31:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33a00678c0 0x7f33a0069d80 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33c415e460 0x7f33c40b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c40cee40 0x7f33c4151b10 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 --2- 172.21.15.5:0/2925033926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33c40ca3e0 0x7f33c41f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 -- 172.21.15.5:0/2925033926 >> 172.21.15.5:0/2925033926 conn(0x7f33c409aa40 msgr2=0x7f33c40b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 -- 172.21.15.5:0/2925033926 shutdown_connections 2024-08-18T22:31:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.096+0000 7f33c9200640 1 -- 172.21.15.5:0/2925033926 wait complete. 2024-08-18T22:31:38.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:31:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.252+0000 7f5d8d000640 1 Processor -- start 2024-08-18T22:31:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d8d000640 1 -- start start 2024-08-18T22:31:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d8d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d8806dd80 0x7f5d880cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d8d000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8806e210 con 0x7f5d88071580 2024-08-18T22:31:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d8d000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d88071c80 con 0x7f5d880b54c0 2024-08-18T22:31:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d8d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5d880cba40 con 0x7f5d8806dd80 2024-08-18T22:31:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d85400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5d88071580 0x7f5d880cbed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55782/0 (socket says 172.21.15.5:55782) 2024-08-18T22:31:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d85400640 1 -- 172.21.15.5:0/140256491 learned_addr learned my addr 172.21.15.5:0/140256491 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:31:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756724426 0 0) 0x7f5d74001120 con 0x7f5d88071580 2024-08-18T22:31:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d86800640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d8806dd80 0x7f5d880cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d6c003530 con 0x7f5d88071580 2024-08-18T22:31:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 392580445 0 0) 0x7f5d6c003530 con 0x7f5d88071580 2024-08-18T22:31:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d8806dd80 msgr2=0x7f5d880cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d8806dd80 0x7f5d880cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 >> v1:172.21.15.117:6789/0 conn(0x7f5d880b54c0 legacy=0x7f5d880b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d88071f60 con 0x7f5d88071580 2024-08-18T22:31:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f5d74001850 con 0x7f5d88071580 2024-08-18T22:31:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 >> v1:172.21.15.5:6789/0 conn(0x7f5d88071580 legacy=0x7f5d880cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d6c0039f0 0x7f5d6c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d6c004810 0x7f5d6c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d8806dd80 0x7f5d6c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5d880cba40 con 0x7f5d6c0039f0 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c00bb40 con 0x7f5d6c004810 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6c00bd40 con 0x7f5d8806dd80 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d85e00640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d6c0039f0 0x7f5d6c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d86800640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d8806dd80 0x7f5d6c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d85400640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d6c004810 0x7f5d6c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d85e00640 1 -- 172.21.15.5:0/140256491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d8806dd80 msgr2=0x7f5d6c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d85e00640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d8806dd80 0x7f5d6c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d85e00640 1 -- 172.21.15.5:0/140256491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d6c004810 msgr2=0x7f5d6c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d85e00640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d6c004810 0x7f5d6c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.256+0000 7f5d85e00640 1 -- 172.21.15.5:0/140256491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6c003530 con 0x7f5d6c0039f0 2024-08-18T22:31:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.260+0000 7f5d85e00640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d6c0039f0 0x7f5d6c003e10 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f5d78001750 tx=0x7f5d7801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aaef9b9c060c7fa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.260+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d780013a0 con 0x7f5d6c0039f0 2024-08-18T22:31:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.260+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d780052f0 con 0x7f5d6c0039f0 2024-08-18T22:31:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.260+0000 7f5d84a00640 1 -- 172.21.15.5:0/140256491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78003840 con 0x7f5d6c0039f0 2024-08-18T22:31:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.260+0000 7f5d8d000640 1 -- 172.21.15.5:0/140256491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d6c0039f0 msgr2=0x7f5d6c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.260+0000 7f5d8d000640 1 --2- 172.21.15.5:0/140256491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d6c0039f0 0x7f5d6c003e10 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f5d78001750 tx=0x7f5d7801c3c0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.260+0000 7f5d86800640 1 -- 172.21.15.5:0/140256491 reap_dead start 2024-08-18T22:31:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.260+0000 7f5d8d000640 1 -- 172.21.15.5:0/140256491 shutdown_connections 2024-08-18T22:31:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.260+0000 7f5d8d000640 1 -- 172.21.15.5:0/140256491 >> 172.21.15.5:0/140256491 conn(0x7f5d880b3eb0 msgr2=0x7f5d880b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.260+0000 7f5d8d000640 1 -- 172.21.15.5:0/140256491 shutdown_connections 2024-08-18T22:31:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.260+0000 7f5d8d000640 1 -- 172.21.15.5:0/140256491 wait complete. 2024-08-18T22:31:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d8d000640 1 Processor -- start 2024-08-18T22:31:38.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d8d000640 1 -- start start 2024-08-18T22:31:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d8d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d6c0039f0 0x7f5d881f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d8d000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d8813f820 0x7f5d881413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d8d000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8813fca0 0x7f5d8815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d8d000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88148020 con 0x7f5d8813fca0 2024-08-18T22:31:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d8d000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5d880719a0 con 0x7f5d8813f820 2024-08-18T22:31:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d8d000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5d881481a0 con 0x7f5d6c0039f0 2024-08-18T22:31:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d86800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8813fca0 0x7f5d8815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d86800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8813fca0 0x7f5d8815ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57734/0 (socket says 172.21.15.5:57734) 2024-08-18T22:31:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d86800640 1 -- 172.21.15.5:0/1156136154 learned_addr learned my addr 172.21.15.5:0/1156136154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d85e00640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d6c0039f0 0x7f5d881f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d85400640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d8813f820 0x7f5d881413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d86800640 1 -- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d6c0039f0 msgr2=0x7f5d881f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d86800640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d6c0039f0 0x7f5d881f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d86800640 1 -- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d8813f820 msgr2=0x7f5d881413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d86800640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d8813f820 0x7f5d881413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d86800640 1 -- 172.21.15.5:0/1156136154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d881f55e0 con 0x7f5d8813fca0 2024-08-18T22:31:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d86800640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8813fca0 0x7f5d8815ea20 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f5d88050430 tx=0x7f5d800115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d7e000640 1 -- 172.21.15.5:0/1156136154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d800039a0 con 0x7f5d8813fca0 2024-08-18T22:31:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d7e000640 1 -- 172.21.15.5:0/1156136154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8001b070 con 0x7f5d8813fca0 2024-08-18T22:31:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d7e000640 1 -- 172.21.15.5:0/1156136154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80003b80 con 0x7f5d8813fca0 2024-08-18T22:31:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d8d000640 1 -- 172.21.15.5:0/1156136154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d88161390 con 0x7f5d8813fca0 2024-08-18T22:31:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d8d000640 1 -- 172.21.15.5:0/1156136154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d88140910 con 0x7f5d8813fca0 2024-08-18T22:31:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.264+0000 7f5d8d000640 1 -- 172.21.15.5:0/1156136154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d880b58a0 con 0x7f5d8813fca0 2024-08-18T22:31:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.268+0000 7f5d7e000640 1 -- 172.21.15.5:0/1156136154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5d80004030 con 0x7f5d8813fca0 2024-08-18T22:31:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.268+0000 7f5d7e000640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d680678c0 0x7f5d68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.268+0000 7f5d7e000640 1 -- 172.21.15.5:0/1156136154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f5d800872b0 con 0x7f5d8813fca0 2024-08-18T22:31:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.268+0000 7f5d85e00640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d680678c0 0x7f5d68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.268+0000 7f5d85e00640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d680678c0 0x7f5d68069d80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0057f0 tx=0x7f5d780011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:38.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.272+0000 7f5d7e000640 1 -- 172.21.15.5:0/1156136154 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5d881f55e0 con 0x7f5d8813fca0 2024-08-18T22:31:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.440+0000 7f5d8d000640 1 -- 172.21.15.5:0/1156136154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d88146e80 con 0x7f5d8813fca0 2024-08-18T22:31:38.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.440+0000 7f5d7e000640 1 -- 172.21.15.5:0/1156136154 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16829 (secure 0 0 0) 0x7f5d800575f0 con 0x7f5d8813fca0 2024-08-18T22:31:38.441 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:38.441 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":176,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:31:37.120133+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:31:34.888000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-08-18T22:31:36.119247+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:31:38.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 -- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d680678c0 msgr2=0x7f5d68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d680678c0 0x7f5d68069d80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0057f0 tx=0x7f5d780011a0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 -- 172.21.15.5:0/1156136154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8813fca0 msgr2=0x7f5d8815ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8813fca0 0x7f5d8815ea20 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f5d88050430 tx=0x7f5d800115a0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 -- 172.21.15.5:0/1156136154 shutdown_connections 2024-08-18T22:31:38.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5d680678c0 0x7f5d68069d80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d8813fca0 0x7f5d8815ea20 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d8813f820 0x7f5d881413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 --2- 172.21.15.5:0/1156136154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d6c0039f0 0x7f5d881f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 -- 172.21.15.5:0/1156136154 >> 172.21.15.5:0/1156136154 conn(0x7f5d880b3eb0 msgr2=0x7f5d8806fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 -- 172.21.15.5:0/1156136154 shutdown_connections 2024-08-18T22:31:38.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.444+0000 7f5d8d000640 1 -- 172.21.15.5:0/1156136154 wait complete. 2024-08-18T22:31:38.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:31:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6268600640 1 Processor -- start 2024-08-18T22:31:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6268600640 1 -- start start 2024-08-18T22:31:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6268600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f626015a6b0 0x7f62600cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6268600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6260073940 0x7f62600b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6268600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6260073180 con 0x7f62600733f0 2024-08-18T22:31:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6268600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f626015aa90 con 0x7f6260073940 2024-08-18T22:31:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6268600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f62600ced80 con 0x7f626015a6b0 2024-08-18T22:31:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6265200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6260073940 0x7f62600b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6265200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6260073940 0x7f62600b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57738/0 (socket says 172.21.15.5:57738) 2024-08-18T22:31:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6265200640 1 -- 172.21.15.5:0/444908954 learned_addr learned my addr 172.21.15.5:0/444908954 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6265c00640 1 --2- 172.21.15.5:0/444908954 >> v2:172.21.15.117:3300/0 conn(0x7f626015a6b0 0x7f62600cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6265200640 1 -- 172.21.15.5:0/444908954 >> v2:172.21.15.117:3300/0 conn(0x7f626015a6b0 msgr2=0x7f62600cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6265200640 1 --2- 172.21.15.5:0/444908954 >> v2:172.21.15.117:3300/0 conn(0x7f626015a6b0 0x7f62600cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6265200640 1 -- 172.21.15.5:0/444908954 >> v1:172.21.15.117:6789/0 conn(0x7f62600733f0 legacy=0x7f626006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6265200640 1 -- 172.21.15.5:0/444908954 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62600af6c0 con 0x7f6260073940 2024-08-18T22:31:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.608+0000 7f6265c00640 1 --2- 172.21.15.5:0/444908954 >> v2:172.21.15.117:3300/0 conn(0x7f626015a6b0 0x7f62600cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f6265200640 1 --2- 172.21.15.5:0/444908954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6260073940 0x7f62600b33d0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f626006d8a0 tx=0x7f624c01ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfd0c61547e46b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f625fe00640 1 -- 172.21.15.5:0/444908954 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0a5c90 con 0x7f6260073940 2024-08-18T22:31:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f625fe00640 1 -- 172.21.15.5:0/444908954 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c0a5e30 con 0x7f6260073940 2024-08-18T22:31:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f625fe00640 1 -- 172.21.15.5:0/444908954 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c007ad0 con 0x7f6260073940 2024-08-18T22:31:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f6268600640 1 -- 172.21.15.5:0/444908954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6260073940 msgr2=0x7f62600b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f6268600640 1 --2- 172.21.15.5:0/444908954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6260073940 0x7f62600b33d0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f626006d8a0 tx=0x7f624c01ccb0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f6268600640 1 -- 172.21.15.5:0/444908954 shutdown_connections 2024-08-18T22:31:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f6268600640 1 --2- 172.21.15.5:0/444908954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6260073940 0x7f62600b33d0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f6268600640 1 --2- 172.21.15.5:0/444908954 >> v2:172.21.15.117:3300/0 conn(0x7f626015a6b0 0x7f62600cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f6268600640 1 -- 172.21.15.5:0/444908954 >> 172.21.15.5:0/444908954 conn(0x7f62600b1dc0 msgr2=0x7f62600b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f6268600640 1 -- 172.21.15.5:0/444908954 shutdown_connections 2024-08-18T22:31:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.612+0000 7f6268600640 1 -- 172.21.15.5:0/444908954 wait complete. 2024-08-18T22:31:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6268600640 1 Processor -- start 2024-08-18T22:31:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6268600640 1 -- start start 2024-08-18T22:31:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6268600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62600733f0 0x7f626014bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6268600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6260073940 0x7f626015c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6268600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f626015a6b0 0x7f626015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6268600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f626006e620 con 0x7f6260073940 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6268600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f626006e4a0 con 0x7f626015a6b0 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6268600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f626006e7a0 con 0x7f62600733f0 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6265200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6260073940 0x7f626015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6265200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6260073940 0x7f626015c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57742/0 (socket says 172.21.15.5:57742) 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6265200640 1 -- 172.21.15.5:0/2027812644 learned_addr learned my addr 172.21.15.5:0/2027812644 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6265c00640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62600733f0 0x7f626014bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6266600640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f626015a6b0 0x7f626015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6265200640 1 -- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62600733f0 msgr2=0x7f626014bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6265200640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62600733f0 0x7f626014bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6265200640 1 -- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f626015a6b0 msgr2=0x7f626015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6265200640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f626015a6b0 0x7f626015cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6265200640 1 -- 172.21.15.5:0/2027812644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6260153330 con 0x7f6260073940 2024-08-18T22:31:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6265c00640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62600733f0 0x7f626014bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6266600640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f626015a6b0 0x7f626015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6265200640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6260073940 0x7f626015c690 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f624c0198c0 tx=0x7f624c01b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f625d600640 1 -- 172.21.15.5:0/2027812644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0b8470 con 0x7f6260073940 2024-08-18T22:31:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f625d600640 1 -- 172.21.15.5:0/2027812644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c0b8630 con 0x7f6260073940 2024-08-18T22:31:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f625d600640 1 -- 172.21.15.5:0/2027812644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0b8a20 con 0x7f6260073940 2024-08-18T22:31:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6268600640 1 -- 172.21.15.5:0/2027812644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f626015bc50 con 0x7f6260073940 2024-08-18T22:31:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6268600640 1 -- 172.21.15.5:0/2027812644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f626015c210 con 0x7f6260073940 2024-08-18T22:31:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.616+0000 7f6268600640 1 -- 172.21.15.5:0/2027812644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6260153500 con 0x7f6260073940 2024-08-18T22:31:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.620+0000 7f625d600640 1 -- 172.21.15.5:0/2027812644 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f624c0c0020 con 0x7f6260073940 2024-08-18T22:31:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.620+0000 7f625d600640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62400678f0 0x7f6240069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.620+0000 7f625d600640 1 -- 172.21.15.5:0/2027812644 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f624c120110 con 0x7f6260073940 2024-08-18T22:31:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.620+0000 7f6265c00640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62400678f0 0x7f6240069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.620+0000 7f6265c00640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62400678f0 0x7f6240069db0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6254009970 tx=0x7f6254008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.624+0000 7f625d600640 1 -- 172.21.15.5:0/2027812644 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f624c0c7020 con 0x7f6260073940 2024-08-18T22:31:38.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:38.828+0000 7f6268600640 1 -- 172.21.15.5:0/2027812644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f62600b33d0 con 0x7f6260073940 2024-08-18T22:31:39.687 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-08-18T22:31:39.686+0000 7fbe35200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:31:39.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f625d600640 1 -- 172.21.15.5:0/2027812644 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v137) ==== 118+0+0 (secure 0 0 0) 0x7f624c0168a0 con 0x7f6260073940 2024-08-18T22:31:39.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 -- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62400678f0 msgr2=0x7f6240069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:39.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62400678f0 0x7f6240069db0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6254009970 tx=0x7f6254008040 comp rx=0 tx=0).stop 2024-08-18T22:31:39.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 -- 172.21.15.5:0/2027812644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6260073940 msgr2=0x7f626015c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:39.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6260073940 0x7f626015c690 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f624c0198c0 tx=0x7f624c01b4f0 comp rx=0 tx=0).stop 2024-08-18T22:31:39.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 -- 172.21.15.5:0/2027812644 shutdown_connections 2024-08-18T22:31:39.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f62400678f0 0x7f6240069db0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:39.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f626015a6b0 0x7f626015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:39.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6260073940 0x7f626015c690 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:39.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 --2- 172.21.15.5:0/2027812644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62600733f0 0x7f626014bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:39.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 -- 172.21.15.5:0/2027812644 >> 172.21.15.5:0/2027812644 conn(0x7f62600b1dc0 msgr2=0x7f62600b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:39.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 -- 172.21.15.5:0/2027812644 shutdown_connections 2024-08-18T22:31:39.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.735+0000 7f6268600640 1 -- 172.21.15.5:0/2027812644 wait complete. 2024-08-18T22:31:39.761 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:31:39.761 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:31:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.907+0000 7f608ce00640 1 Processor -- start 2024-08-18T22:31:39.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.907+0000 7f608ce00640 1 -- start start 2024-08-18T22:31:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f608ce00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f608815b0c0 0x7f608806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f608ce00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60880b40c0 0x7f60880b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f608ce00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60880b31f0 con 0x7f6088072a30 2024-08-18T22:31:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f608ce00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f60880b3d70 con 0x7f608815b0c0 2024-08-18T22:31:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f608ce00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f60880b4a40 con 0x7f60880b40c0 2024-08-18T22:31:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f607fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60880b40c0 0x7f60880b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f607fe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60880b40c0 0x7f60880b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:50864/0 (socket says 172.21.15.5:50864) 2024-08-18T22:31:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f607fe00640 1 -- 172.21.15.5:0/1688117024 learned_addr learned my addr 172.21.15.5:0/1688117024 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f6085e00640 1 --2- 172.21.15.5:0/1688117024 >> v2:172.21.15.117:3300/0 conn(0x7f608815b0c0 0x7f608806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f607fe00640 1 -- 172.21.15.5:0/1688117024 >> v2:172.21.15.117:3300/0 conn(0x7f608815b0c0 msgr2=0x7f608806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f607fe00640 1 --2- 172.21.15.5:0/1688117024 >> v2:172.21.15.117:3300/0 conn(0x7f608815b0c0 0x7f608806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f607fe00640 1 -- 172.21.15.5:0/1688117024 >> v1:172.21.15.117:6789/0 conn(0x7f6088072a30 legacy=0x7f6088072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.911+0000 7f607fe00640 1 -- 172.21.15.5:0/1688117024 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60880b34d0 con 0x7f60880b40c0 2024-08-18T22:31:39.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f607fe00640 1 --2- 172.21.15.5:0/1688117024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60880b40c0 0x7f60880b4500 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6070009870 tx=0x7f607001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d8c20bd3f43d5d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:39.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f6085400640 1 -- 172.21.15.5:0/1688117024 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60700ab610 con 0x7f60880b40c0 2024-08-18T22:31:39.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f6085400640 1 -- 172.21.15.5:0/1688117024 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60700b0070 con 0x7f60880b40c0 2024-08-18T22:31:39.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f6085400640 1 -- 172.21.15.5:0/1688117024 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60700ab9d0 con 0x7f60880b40c0 2024-08-18T22:31:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f608ce00640 1 -- 172.21.15.5:0/1688117024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60880b40c0 msgr2=0x7f60880b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f608ce00640 1 --2- 172.21.15.5:0/1688117024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60880b40c0 0x7f60880b4500 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6070009870 tx=0x7f607001c410 comp rx=0 tx=0).stop 2024-08-18T22:31:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f608ce00640 1 -- 172.21.15.5:0/1688117024 shutdown_connections 2024-08-18T22:31:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f608ce00640 1 --2- 172.21.15.5:0/1688117024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60880b40c0 0x7f60880b4500 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f608ce00640 1 --2- 172.21.15.5:0/1688117024 >> v2:172.21.15.117:3300/0 conn(0x7f608815b0c0 0x7f608806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f608ce00640 1 -- 172.21.15.5:0/1688117024 >> 172.21.15.5:0/1688117024 conn(0x7f60880b1dc0 msgr2=0x7f60880b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f608ce00640 1 -- 172.21.15.5:0/1688117024 shutdown_connections 2024-08-18T22:31:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f608ce00640 1 -- 172.21.15.5:0/1688117024 wait complete. 2024-08-18T22:31:39.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f608ce00640 1 Processor -- start 2024-08-18T22:31:39.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.915+0000 7f608ce00640 1 -- start start 2024-08-18T22:31:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f608ce00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6088072a30 0x7f6088149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f608ce00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60880b40c0 0x7f60880ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f608ce00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f608815b0c0 0x7f60880ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f608ce00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f608815b4a0 con 0x7f608815b0c0 2024-08-18T22:31:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f608ce00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f60880739a0 con 0x7f60880b40c0 2024-08-18T22:31:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f608ce00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f608815b620 con 0x7f6088072a30 2024-08-18T22:31:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f6086800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f608815b0c0 0x7f60880ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f6086800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f608815b0c0 0x7f60880ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57752/0 (socket says 172.21.15.5:57752) 2024-08-18T22:31:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f6086800640 1 -- 172.21.15.5:0/1048746860 learned_addr learned my addr 172.21.15.5:0/1048746860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f607fe00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60880b40c0 0x7f60880ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f6085e00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6088072a30 0x7f6088149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f6086800640 1 -- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6088072a30 msgr2=0x7f6088149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f6086800640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6088072a30 0x7f6088149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f6086800640 1 -- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60880b40c0 msgr2=0x7f60880ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f6086800640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60880b40c0 0x7f60880ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f6086800640 1 -- 172.21.15.5:0/1048746860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6088149d80 con 0x7f608815b0c0 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f607fe00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60880b40c0 0x7f60880ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f6085e00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6088072a30 0x7f6088149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f6086800640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f608815b0c0 0x7f60880ae980 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f608000c7a0 tx=0x7f608000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f607e000640 1 -- 172.21.15.5:0/1048746860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080003b80 con 0x7f608815b0c0 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f607e000640 1 -- 172.21.15.5:0/1048746860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6080003d20 con 0x7f608815b0c0 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f608ce00640 1 -- 172.21.15.5:0/1048746860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60880ad3a0 con 0x7f608815b0c0 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f607e000640 1 -- 172.21.15.5:0/1048746860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608000aa90 con 0x7f608815b0c0 2024-08-18T22:31:39.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f608ce00640 1 -- 172.21.15.5:0/1048746860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60880ad960 con 0x7f608815b0c0 2024-08-18T22:31:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.919+0000 7f608ce00640 1 -- 172.21.15.5:0/1048746860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f608806f670 con 0x7f608815b0c0 2024-08-18T22:31:39.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.923+0000 7f607e000640 1 -- 172.21.15.5:0/1048746860 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f608000ac30 con 0x7f608815b0c0 2024-08-18T22:31:39.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.923+0000 7f607e000640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60640678c0 0x7f6064069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:39.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.923+0000 7f607e000640 1 -- 172.21.15.5:0/1048746860 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f6080085e70 con 0x7f608815b0c0 2024-08-18T22:31:39.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.923+0000 7f6085e00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60640678c0 0x7f6064069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:39.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.923+0000 7f6085e00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60640678c0 0x7f6064069d80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f6078009a40 tx=0x7f6078008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:39.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:39.927+0000 7f607e000640 1 -- 172.21.15.5:0/1048746860 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6080056700 con 0x7f608815b0c0 2024-08-18T22:31:40.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.127+0000 7f608ce00640 1 -- 172.21.15.5:0/1048746860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f60880b2410 con 0x7f608815b0c0 2024-08-18T22:31:40.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.739+0000 7f607e000640 1 -- 172.21.15.5:0/1048746860 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v138) ==== 122+0+0 (secure 0 0 0) 0x7f6080056000 con 0x7f608815b0c0 2024-08-18T22:31:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 -- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60640678c0 msgr2=0x7f6064069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60640678c0 0x7f6064069d80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f6078009a40 tx=0x7f6078008040 comp rx=0 tx=0).stop 2024-08-18T22:31:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 -- 172.21.15.5:0/1048746860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f608815b0c0 msgr2=0x7f60880ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f608815b0c0 0x7f60880ae980 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f608000c7a0 tx=0x7f608000cc60 comp rx=0 tx=0).stop 2024-08-18T22:31:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 -- 172.21.15.5:0/1048746860 shutdown_connections 2024-08-18T22:31:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f60640678c0 0x7f6064069d80 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f608815b0c0 0x7f60880ae980 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60880b40c0 0x7f60880ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 --2- 172.21.15.5:0/1048746860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6088072a30 0x7f6088149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:40.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 -- 172.21.15.5:0/1048746860 >> 172.21.15.5:0/1048746860 conn(0x7f60880b1dc0 msgr2=0x7f6088072e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:40.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 -- 172.21.15.5:0/1048746860 shutdown_connections 2024-08-18T22:31:40.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.743+0000 7f608ce00640 1 -- 172.21.15.5:0/1048746860 wait complete. 2024-08-18T22:31:40.767 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:31:40.768 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8abf600640 1 Processor -- start 2024-08-18T22:31:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8abf600640 1 -- start start 2024-08-18T22:31:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8abf600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ab80cb390 0x7f8ab80735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8abf600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ab806da70 0x7f8ab806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8abf600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab8073c80 con 0x7f8ab815bed0 2024-08-18T22:31:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8abf600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab806e3e0 con 0x7f8ab80cb390 2024-08-18T22:31:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8abf600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab80ca5d0 con 0x7f8ab806da70 2024-08-18T22:31:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8ab7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ab80cb390 0x7f8ab80735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8ab7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ab80cb390 0x7f8ab80735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57760/0 (socket says 172.21.15.5:57760) 2024-08-18T22:31:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8ab7e00640 1 -- 172.21.15.5:0/1514714627 learned_addr learned my addr 172.21.15.5:0/1514714627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8abd600640 1 --2- 172.21.15.5:0/1514714627 >> v2:172.21.15.117:3300/0 conn(0x7f8ab806da70 0x7f8ab806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8ab7e00640 1 -- 172.21.15.5:0/1514714627 >> v2:172.21.15.117:3300/0 conn(0x7f8ab806da70 msgr2=0x7f8ab806dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:40.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8ab7e00640 1 --2- 172.21.15.5:0/1514714627 >> v2:172.21.15.117:3300/0 conn(0x7f8ab806da70 0x7f8ab806dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:40.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8ab7e00640 1 -- 172.21.15.5:0/1514714627 >> v1:172.21.15.117:6789/0 conn(0x7f8ab815bed0 legacy=0x7f8ab8071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:40.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8ab7e00640 1 -- 172.21.15.5:0/1514714627 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab80ca8b0 con 0x7f8ab80cb390 2024-08-18T22:31:40.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.915+0000 7f8abd600640 1 --2- 172.21.15.5:0/1514714627 >> v2:172.21.15.117:3300/0 conn(0x7f8ab806da70 0x7f8ab806dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8ab7e00640 1 --2- 172.21.15.5:0/1514714627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ab80cb390 0x7f8ab80735a0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80cfe50 tx=0x7f8aa401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8380ca1ceae0b84 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8ab7400640 1 -- 172.21.15.5:0/1514714627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40aa650 con 0x7f8ab80cb390 2024-08-18T22:31:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8ab7400640 1 -- 172.21.15.5:0/1514714627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40af070 con 0x7f8ab80cb390 2024-08-18T22:31:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8ab7400640 1 -- 172.21.15.5:0/1514714627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40aaa10 con 0x7f8ab80cb390 2024-08-18T22:31:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8abf600640 1 -- 172.21.15.5:0/1514714627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ab80cb390 msgr2=0x7f8ab80735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8abf600640 1 --2- 172.21.15.5:0/1514714627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ab80cb390 0x7f8ab80735a0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80cfe50 tx=0x7f8aa401c4f0 comp rx=0 tx=0).stop 2024-08-18T22:31:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8abf600640 1 -- 172.21.15.5:0/1514714627 shutdown_connections 2024-08-18T22:31:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8abf600640 1 --2- 172.21.15.5:0/1514714627 >> v2:172.21.15.117:3300/0 conn(0x7f8ab806da70 0x7f8ab806dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8abf600640 1 --2- 172.21.15.5:0/1514714627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ab80cb390 0x7f8ab80735a0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8abf600640 1 -- 172.21.15.5:0/1514714627 >> 172.21.15.5:0/1514714627 conn(0x7f8ab80b1c50 msgr2=0x7f8ab80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8abf600640 1 -- 172.21.15.5:0/1514714627 shutdown_connections 2024-08-18T22:31:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.919+0000 7f8abf600640 1 -- 172.21.15.5:0/1514714627 wait complete. 2024-08-18T22:31:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abf600640 1 Processor -- start 2024-08-18T22:31:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abf600640 1 -- start start 2024-08-18T22:31:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abf600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ab806da70 0x7f8ab8154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abf600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ab80cb390 0x7f8ab809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abf600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ab815bed0 0x7f8ab80c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abf600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8168520 con 0x7f8ab815bed0 2024-08-18T22:31:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abf600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab81683a0 con 0x7f8ab80cb390 2024-08-18T22:31:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abf600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab81686a0 con 0x7f8ab806da70 2024-08-18T22:31:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abd600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ab815bed0 0x7f8ab80c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abd600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ab815bed0 0x7f8ab80c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57772/0 (socket says 172.21.15.5:57772) 2024-08-18T22:31:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abd600640 1 -- 172.21.15.5:0/931545648 learned_addr learned my addr 172.21.15.5:0/931545648 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8ab7e00640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ab80cb390 0x7f8ab809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abcc00640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ab806da70 0x7f8ab8154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abd600640 1 -- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ab806da70 msgr2=0x7f8ab8154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abd600640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ab806da70 0x7f8ab8154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abd600640 1 -- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ab80cb390 msgr2=0x7f8ab809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abd600640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ab80cb390 0x7f8ab809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abd600640 1 -- 172.21.15.5:0/931545648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab80b2ff0 con 0x7f8ab815bed0 2024-08-18T22:31:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abd600640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ab815bed0 0x7f8ab80c92d0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009fa0 tx=0x7f8ab000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8ab4c00640 1 -- 172.21.15.5:0/931545648 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab001a070 con 0x7f8ab815bed0 2024-08-18T22:31:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8ab4c00640 1 -- 172.21.15.5:0/931545648 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab0003bc0 con 0x7f8ab815bed0 2024-08-18T22:31:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abf600640 1 -- 172.21.15.5:0/931545648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab80b35b0 con 0x7f8ab815bed0 2024-08-18T22:31:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8ab4c00640 1 -- 172.21.15.5:0/931545648 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0004030 con 0x7f8ab815bed0 2024-08-18T22:31:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.923+0000 7f8abf600640 1 -- 172.21.15.5:0/931545648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab80b3b70 con 0x7f8ab815bed0 2024-08-18T22:31:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.927+0000 7f8abf600640 1 -- 172.21.15.5:0/931545648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab806dea0 con 0x7f8ab815bed0 2024-08-18T22:31:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.927+0000 7f8ab4c00640 1 -- 172.21.15.5:0/931545648 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ab001d070 con 0x7f8ab815bed0 2024-08-18T22:31:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.927+0000 7f8ab4c00640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a980678c0 0x7f8a98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.927+0000 7f8ab4c00640 1 -- 172.21.15.5:0/931545648 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f8ab0086190 con 0x7f8ab815bed0 2024-08-18T22:31:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.927+0000 7f8abcc00640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a980678c0 0x7f8a98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.927+0000 7f8abcc00640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a980678c0 0x7f8a98069d80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8ab81fa170 tx=0x7f8aa8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:40.931+0000 7f8ab4c00640 1 -- 172.21.15.5:0/931545648 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8ab0010070 con 0x7f8ab815bed0 2024-08-18T22:31:41.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.131+0000 7f8abf600640 1 -- 172.21.15.5:0/931545648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ab80afbc0 con 0x7f8ab815bed0 2024-08-18T22:31:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.131+0000 7f8ab4c00640 1 -- 172.21.15.5:0/931545648 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) ==== 95+0+5233 (secure 0 0 0) 0x7f8ab0056b30 con 0x7f8ab815bed0 2024-08-18T22:31:41.132 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:41.132 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":138,"btime":"2024-08-18T22:31:40:739638+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4068691051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4068691051},{"type":"v1","addr":"172.21.15.117:6836","nonce":4068691051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":9972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/4128479928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4128479928},{"type":"v1","addr":"172.21.15.5:6834","nonce":4128479928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9975,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1984562471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1984562471},{"type":"v1","addr":"172.21.15.5:6835","nonce":1984562471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:31:37.120589+0000","modified":"2024-08-18T22:31:40.134577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9981},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9981":{"gid":9981,"name":"d","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/3224274565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3224274565},{"type":"v1","addr":"172.21.15.117:6837","nonce":3224274565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9981,"qdb_cluster":[9981]},"id":12}]} 2024-08-18T22:31:41.133 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 138 2024-08-18T22:31:41.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 -- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a980678c0 msgr2=0x7f8a98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a980678c0 0x7f8a98069d80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8ab81fa170 tx=0x7f8aa8009040 comp rx=0 tx=0).stop 2024-08-18T22:31:41.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 -- 172.21.15.5:0/931545648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ab815bed0 msgr2=0x7f8ab80c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ab815bed0 0x7f8ab80c92d0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0009fa0 tx=0x7f8ab000d560 comp rx=0 tx=0).stop 2024-08-18T22:31:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 -- 172.21.15.5:0/931545648 shutdown_connections 2024-08-18T22:31:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8a980678c0 0x7f8a98069d80 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ab815bed0 0x7f8ab80c92d0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ab80cb390 0x7f8ab809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 --2- 172.21.15.5:0/931545648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ab806da70 0x7f8ab8154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 -- 172.21.15.5:0/931545648 >> 172.21.15.5:0/931545648 conn(0x7f8ab80b1c50 msgr2=0x7f8ab80b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 -- 172.21.15.5:0/931545648 shutdown_connections 2024-08-18T22:31:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.135+0000 7f8abf600640 1 -- 172.21.15.5:0/931545648 wait complete. 2024-08-18T22:31:41.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:31:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.291+0000 7f0948800640 1 Processor -- start 2024-08-18T22:31:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0948800640 1 -- start start 2024-08-18T22:31:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0948800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09400b54c0 0x7f0940071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0948800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09400cbed0 0x7f09400cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0948800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0940071c80 con 0x7f094006dd80 2024-08-18T22:31:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0948800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f09400cba40 con 0x7f09400b54c0 2024-08-18T22:31:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0948800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0940071f60 con 0x7f09400cbed0 2024-08-18T22:31:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0945e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09400b54c0 0x7f0940071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0945e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09400b54c0 0x7f0940071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57778/0 (socket says 172.21.15.5:57778) 2024-08-18T22:31:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0945e00640 1 -- 172.21.15.5:0/1233100031 learned_addr learned my addr 172.21.15.5:0/1233100031 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0945e00640 1 -- 172.21.15.5:0/1233100031 >> v2:172.21.15.117:3300/0 conn(0x7f09400cbed0 msgr2=0x7f09400cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0945e00640 1 --2- 172.21.15.5:0/1233100031 >> v2:172.21.15.117:3300/0 conn(0x7f09400cbed0 0x7f09400cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0945e00640 1 -- 172.21.15.5:0/1233100031 >> v1:172.21.15.5:6789/0 conn(0x7f094006dd80 legacy=0x7f09400b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.295+0000 7f0945e00640 1 -- 172.21.15.5:0/1233100031 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09400cb6d0 con 0x7f09400b54c0 2024-08-18T22:31:41.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0945e00640 1 --2- 172.21.15.5:0/1233100031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09400b54c0 0x7f0940071580 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f094006f4c0 tx=0x7f093401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c8275f2203b6ba server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:41.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0944a00640 1 -- 172.21.15.5:0/1233100031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09340b5070 con 0x7f09400b54c0 2024-08-18T22:31:41.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0944a00640 1 -- 172.21.15.5:0/1233100031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09340a8a10 con 0x7f09400b54c0 2024-08-18T22:31:41.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0944a00640 1 -- 172.21.15.5:0/1233100031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09340a8de0 con 0x7f09400b54c0 2024-08-18T22:31:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0948800640 1 -- 172.21.15.5:0/1233100031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09400b54c0 msgr2=0x7f0940071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0948800640 1 --2- 172.21.15.5:0/1233100031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09400b54c0 0x7f0940071580 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f094006f4c0 tx=0x7f093401ed10 comp rx=0 tx=0).stop 2024-08-18T22:31:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0948800640 1 -- 172.21.15.5:0/1233100031 shutdown_connections 2024-08-18T22:31:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0948800640 1 --2- 172.21.15.5:0/1233100031 >> v2:172.21.15.117:3300/0 conn(0x7f09400cbed0 0x7f09400cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0948800640 1 --2- 172.21.15.5:0/1233100031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09400b54c0 0x7f0940071580 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0948800640 1 -- 172.21.15.5:0/1233100031 >> 172.21.15.5:0/1233100031 conn(0x7f09400b3eb0 msgr2=0x7f09400b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0948800640 1 -- 172.21.15.5:0/1233100031 shutdown_connections 2024-08-18T22:31:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0948800640 1 -- 172.21.15.5:0/1233100031 wait complete. 2024-08-18T22:31:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0948800640 1 Processor -- start 2024-08-18T22:31:41.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.299+0000 7f0948800640 1 -- start start 2024-08-18T22:31:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0948800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f094006dd80 0x7f094013deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0948800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09400b54c0 0x7f094015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0948800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09400cbed0 0x7f09401f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0948800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09401481a0 con 0x7f09400cbed0 2024-08-18T22:31:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0948800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0940148020 con 0x7f09400b54c0 2024-08-18T22:31:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0948800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f09400cc8a0 con 0x7f094006dd80 2024-08-18T22:31:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0946800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09400cbed0 0x7f09401f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0946800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09400cbed0 0x7f09401f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57782/0 (socket says 172.21.15.5:57782) 2024-08-18T22:31:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0946800640 1 -- 172.21.15.5:0/2239301759 learned_addr learned my addr 172.21.15.5:0/2239301759 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0945e00640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f094006dd80 0x7f094013deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0945400640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09400b54c0 0x7f094015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:41.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0946800640 1 -- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f094006dd80 msgr2=0x7f094013deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0946800640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f094006dd80 0x7f094013deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0946800640 1 -- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09400b54c0 msgr2=0x7f094015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0946800640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09400b54c0 0x7f094015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0946800640 1 -- 172.21.15.5:0/2239301759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094013e6e0 con 0x7f09400cbed0 2024-08-18T22:31:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0946800640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09400cbed0 0x7f09401f4680 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b970 tx=0x7f093c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f093a000640 1 -- 172.21.15.5:0/2239301759 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c019070 con 0x7f09400cbed0 2024-08-18T22:31:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f093a000640 1 -- 172.21.15.5:0/2239301759 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c00cb00 con 0x7f09400cbed0 2024-08-18T22:31:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f093a000640 1 -- 172.21.15.5:0/2239301759 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c014440 con 0x7f09400cbed0 2024-08-18T22:31:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0948800640 1 -- 172.21.15.5:0/2239301759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094015eb30 con 0x7f09400cbed0 2024-08-18T22:31:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0948800640 1 -- 172.21.15.5:0/2239301759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f094015f0f0 con 0x7f09400cbed0 2024-08-18T22:31:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.303+0000 7f0948800640 1 -- 172.21.15.5:0/2239301759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09400cc360 con 0x7f09400cbed0 2024-08-18T22:31:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.307+0000 7f093a000640 1 -- 172.21.15.5:0/2239301759 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f093c01c070 con 0x7f09400cbed0 2024-08-18T22:31:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.307+0000 7f093a000640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09240678c0 0x7f0924069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.307+0000 7f093a000640 1 -- 172.21.15.5:0/2239301759 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f093c085b20 con 0x7f09400cbed0 2024-08-18T22:31:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.307+0000 7f0945e00640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09240678c0 0x7f0924069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.307+0000 7f0945e00640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09240678c0 0x7f0924069d80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f09340b2000 tx=0x7f0934009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:41.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.311+0000 7f093a000640 1 -- 172.21.15.5:0/2239301759 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f093c055de0 con 0x7f09400cbed0 2024-08-18T22:31:41.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.475+0000 7f0948800640 1 -- 172.21.15.5:0/2239301759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f094015e510 con 0x7f09400cbed0 2024-08-18T22:31:41.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.475+0000 7f093a000640 1 -- 172.21.15.5:0/2239301759 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) ==== 74+0+16816 (secure 0 0 0) 0x7f093c05a0e0 con 0x7f09400cbed0 2024-08-18T22:31:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:41.477 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":177,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:31:38.721197+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:31:34.888000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-08-18T22:31:36.119247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:31:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 -- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09240678c0 msgr2=0x7f0924069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09240678c0 0x7f0924069d80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f09340b2000 tx=0x7f0934009040 comp rx=0 tx=0).stop 2024-08-18T22:31:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 -- 172.21.15.5:0/2239301759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09400cbed0 msgr2=0x7f09401f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09400cbed0 0x7f09401f4680 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b970 tx=0x7f093c00be30 comp rx=0 tx=0).stop 2024-08-18T22:31:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 -- 172.21.15.5:0/2239301759 shutdown_connections 2024-08-18T22:31:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f09240678c0 0x7f0924069d80 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09400cbed0 0x7f09401f4680 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09400b54c0 0x7f094015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 --2- 172.21.15.5:0/2239301759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f094006dd80 0x7f094013deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 -- 172.21.15.5:0/2239301759 >> 172.21.15.5:0/2239301759 conn(0x7f09400b3eb0 msgr2=0x7f09400b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:41.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 -- 172.21.15.5:0/2239301759 shutdown_connections 2024-08-18T22:31:41.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.479+0000 7f0948800640 1 -- 172.21.15.5:0/2239301759 wait complete. 2024-08-18T22:31:41.499 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:31:41.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:31:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.639+0000 7fabf1800640 1 Processor -- start 2024-08-18T22:31:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.639+0000 7fabf1800640 1 -- start start 2024-08-18T22:31:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.639+0000 7fabf1800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabec0cb390 0x7fabec0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.639+0000 7fabf1800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabec06da70 0x7fabec06df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.639+0000 7fabf1800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabec073c80 con 0x7fabec15bed0 2024-08-18T22:31:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.639+0000 7fabf1800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fabec0ca5d0 con 0x7fabec06da70 2024-08-18T22:31:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.639+0000 7fabf1800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fabec0ca8b0 con 0x7fabec0cb390 2024-08-18T22:31:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabeb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabec06da70 0x7fabec06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabeb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabec06da70 0x7fabec06df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57794/0 (socket says 172.21.15.5:57794) 2024-08-18T22:31:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabeb400640 1 -- 172.21.15.5:0/547196210 learned_addr learned my addr 172.21.15.5:0/547196210 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabea000640 1 --2- 172.21.15.5:0/547196210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabec0cb390 0x7fabec0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabeb400640 1 -- 172.21.15.5:0/547196210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabec0cb390 msgr2=0x7fabec0735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabeb400640 1 --2- 172.21.15.5:0/547196210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabec0cb390 0x7fabec0735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabeb400640 1 -- 172.21.15.5:0/547196210 >> v1:172.21.15.117:6789/0 conn(0x7fabec15bed0 legacy=0x7fabec071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabeb400640 1 -- 172.21.15.5:0/547196210 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec0cab90 con 0x7fabec06da70 2024-08-18T22:31:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabeb400640 1 --2- 172.21.15.5:0/547196210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec06da70 0x7fabec06df00 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009870 tx=0x7fabd801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d625f563d38e870f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabe9600640 1 -- 172.21.15.5:0/547196210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd80ab5f0 con 0x7fabec06da70 2024-08-18T22:31:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabe9600640 1 -- 172.21.15.5:0/547196210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd80b0070 con 0x7fabec06da70 2024-08-18T22:31:41.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.643+0000 7fabe9600640 1 -- 172.21.15.5:0/547196210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd80ab9b0 con 0x7fabec06da70 2024-08-18T22:31:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 -- 172.21.15.5:0/547196210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec06da70 msgr2=0x7fabec06df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 --2- 172.21.15.5:0/547196210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec06da70 0x7fabec06df00 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009870 tx=0x7fabd801c520 comp rx=0 tx=0).stop 2024-08-18T22:31:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 -- 172.21.15.5:0/547196210 shutdown_connections 2024-08-18T22:31:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 --2- 172.21.15.5:0/547196210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec06da70 0x7fabec06df00 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 --2- 172.21.15.5:0/547196210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabec0cb390 0x7fabec0735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 -- 172.21.15.5:0/547196210 >> 172.21.15.5:0/547196210 conn(0x7fabec0b1c50 msgr2=0x7fabec0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 -- 172.21.15.5:0/547196210 shutdown_connections 2024-08-18T22:31:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 -- 172.21.15.5:0/547196210 wait complete. 2024-08-18T22:31:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 Processor -- start 2024-08-18T22:31:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 -- start start 2024-08-18T22:31:41.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabec06da70 0x7fabec159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0cb390 0x7fabec09bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabec15bed0 0x7fabec09c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fabec168730 con 0x7fabec0cb390 2024-08-18T22:31:41.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fabec1685b0 con 0x7fabec06da70 2024-08-18T22:31:41.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabf1800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fabec1688b0 con 0x7fabec15bed0 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabea000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0cb390 0x7fabec09bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabea000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0cb390 0x7fabec09bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57804/0 (socket says 172.21.15.5:57804) 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabea000640 1 -- 172.21.15.5:0/3780651760 learned_addr learned my addr 172.21.15.5:0/3780651760 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabeaa00640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabec06da70 0x7fabec159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabeb400640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabec15bed0 0x7fabec09c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabea000640 1 -- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabec15bed0 msgr2=0x7fabec09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabea000640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabec15bed0 0x7fabec09c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabea000640 1 -- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabec06da70 msgr2=0x7fabec159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabea000640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabec06da70 0x7fabec159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabea000640 1 -- 172.21.15.5:0/3780651760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec15b080 con 0x7fabec0cb390 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabeaa00640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabec06da70 0x7fabec159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.647+0000 7fabea000640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0cb390 0x7fabec09bb80 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00d620 tx=0x7fabdc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:41.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.651+0000 7fabe2a00640 1 -- 172.21.15.5:0/3780651760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00b620 con 0x7fabec0cb390 2024-08-18T22:31:41.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.651+0000 7fabe2a00640 1 -- 172.21.15.5:0/3780651760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabdc019070 con 0x7fabec0cb390 2024-08-18T22:31:41.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.651+0000 7fabe2a00640 1 -- 172.21.15.5:0/3780651760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00b9e0 con 0x7fabec0cb390 2024-08-18T22:31:41.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.651+0000 7fabf1800640 1 -- 172.21.15.5:0/3780651760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabec15a7e0 con 0x7fabec0cb390 2024-08-18T22:31:41.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.651+0000 7fabf1800640 1 -- 172.21.15.5:0/3780651760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabec15ada0 con 0x7fabec0cb390 2024-08-18T22:31:41.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.651+0000 7fabf1800640 1 -- 172.21.15.5:0/3780651760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabec06df00 con 0x7fabec0cb390 2024-08-18T22:31:41.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.651+0000 7fabe2a00640 1 -- 172.21.15.5:0/3780651760 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fabdc00bb80 con 0x7fabec0cb390 2024-08-18T22:31:41.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.651+0000 7fabe2a00640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabcc0678f0 0x7fabcc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:41.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.651+0000 7fabe2a00640 1 -- 172.21.15.5:0/3780651760 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fabdc086d60 con 0x7fabec0cb390 2024-08-18T22:31:41.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.651+0000 7fabeaa00640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabcc0678f0 0x7fabcc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:41.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.655+0000 7fabeaa00640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabcc0678f0 0x7fabcc069db0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fabe40045c0 tx=0x7fabe4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:41.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.655+0000 7fabe2a00640 1 -- 172.21.15.5:0/3780651760 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fabdc0576f0 con 0x7fabec0cb390 2024-08-18T22:31:41.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.819+0000 7fabf1800640 1 -- 172.21.15.5:0/3780651760 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fabec0af950 con 0x7fabcc0678f0 2024-08-18T22:31:41.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.827+0000 7fabe2a00640 1 -- 172.21.15.5:0/3780651760 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252456 (secure 0 0 0) 0x7fabe4056a40 con 0x7fabcc0678f0 2024-08-18T22:31:41.830 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:41.832 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:31:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 -- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabcc0678f0 msgr2=0x7fabcc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabcc0678f0 0x7fabcc069db0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fabe40045c0 tx=0x7fabe4009040 comp rx=0 tx=0).stop 2024-08-18T22:31:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 -- 172.21.15.5:0/3780651760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0cb390 msgr2=0x7fabec09bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0cb390 0x7fabec09bb80 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00d620 tx=0x7fabdc00dae0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 -- 172.21.15.5:0/3780651760 shutdown_connections 2024-08-18T22:31:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabcc0678f0 0x7fabcc069db0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabec15bed0 0x7fabec09c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabec0cb390 0x7fabec09bb80 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 --2- 172.21.15.5:0/3780651760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabec06da70 0x7fabec159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 -- 172.21.15.5:0/3780651760 >> 172.21.15.5:0/3780651760 conn(0x7fabec0b1c50 msgr2=0x7fabec0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 -- 172.21.15.5:0/3780651760 shutdown_connections 2024-08-18T22:31:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:41.831+0000 7fabf1800640 1 -- 172.21.15.5:0/3780651760 wait complete. 2024-08-18T22:31:41.850 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2024-08-18T22:31:41.802121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":453944,"kb_used_data":18496,"kb_used_omap":12,"kb_used_meta":435315,"kb_avail":754520776,"statfs":{"total":773094113280,"available":772629274624,"internally_reserved":0,"allocated":18939904,"data_stored":9537412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":445763120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001235"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.742943+0000","last_change":"2024-08-18T22:31:37.736647+0000","last_active":"2024-08-18T22:31:37.742943+0000","last_peered":"2024-08-18T22:31:37.742943+0000","last_clean":"2024-08-18T22:31:37.742943+0000","last_became_active":"2024-08-18T22:31:37.736356+0000","last_became_peered":"2024-08-18T22:31:37.736356+0000","last_unstale":"2024-08-18T22:31:37.742943+0000","last_undegraded":"2024-08-18T22:31:37.742943+0000","last_fullsized":"2024-08-18T22:31:37.742943+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:55:17.635407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.749699+0000","last_change":"2024-08-18T22:31:37.748330+0000","last_active":"2024-08-18T22:31:37.749699+0000","last_peered":"2024-08-18T22:31:37.749699+0000","last_clean":"2024-08-18T22:31:37.749699+0000","last_became_active":"2024-08-18T22:31:37.748062+0000","last_became_peered":"2024-08-18T22:31:37.748062+0000","last_unstale":"2024-08-18T22:31:37.749699+0000","last_undegraded":"2024-08-18T22:31:37.749699+0000","last_fullsized":"2024-08-18T22:31:37.749699+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:22:18.109539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.737822+0000","last_change":"2024-08-18T22:31:37.725612+0000","last_active":"2024-08-18T22:31:37.737822+0000","last_peered":"2024-08-18T22:31:37.737822+0000","last_clean":"2024-08-18T22:31:37.737822+0000","last_became_active":"2024-08-18T22:31:37.725287+0000","last_became_peered":"2024-08-18T22:31:37.725287+0000","last_unstale":"2024-08-18T22:31:37.737822+0000","last_undegraded":"2024-08-18T22:31:37.737822+0000","last_fullsized":"2024-08-18T22:31:37.737822+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:14:22.710178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.735775+0000","last_change":"2024-08-18T22:31:37.729007+0000","last_active":"2024-08-18T22:31:37.735775+0000","last_peered":"2024-08-18T22:31:37.735775+0000","last_clean":"2024-08-18T22:31:37.735775+0000","last_became_active":"2024-08-18T22:31:37.728699+0000","last_became_peered":"2024-08-18T22:31:37.728699+0000","last_unstale":"2024-08-18T22:31:37.735775+0000","last_undegraded":"2024-08-18T22:31:37.735775+0000","last_fullsized":"2024-08-18T22:31:37.735775+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:41.217296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728338+0000","last_change":"2024-08-18T22:31:37.750394+0000","last_active":"2024-08-18T22:31:38.728338+0000","last_peered":"2024-08-18T22:31:38.728338+0000","last_clean":"2024-08-18T22:31:38.728338+0000","last_became_active":"2024-08-18T22:31:37.749961+0000","last_became_peered":"2024-08-18T22:31:37.749961+0000","last_unstale":"2024-08-18T22:31:38.728338+0000","last_undegraded":"2024-08-18T22:31:38.728338+0000","last_fullsized":"2024-08-18T22:31:38.728338+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:45.211718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728192+0000","last_change":"2024-08-18T22:31:37.750993+0000","last_active":"2024-08-18T22:31:38.728192+0000","last_peered":"2024-08-18T22:31:38.728192+0000","last_clean":"2024-08-18T22:31:38.728192+0000","last_became_active":"2024-08-18T22:31:37.750484+0000","last_became_peered":"2024-08-18T22:31:37.750484+0000","last_unstale":"2024-08-18T22:31:38.728192+0000","last_undegraded":"2024-08-18T22:31:38.728192+0000","last_fullsized":"2024-08-18T22:31:38.728192+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:07.218406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901213+0000","last_change":"2024-08-18T22:31:37.735436+0000","last_active":"2024-08-18T22:31:38.901213+0000","last_peered":"2024-08-18T22:31:38.901213+0000","last_clean":"2024-08-18T22:31:38.901213+0000","last_became_active":"2024-08-18T22:31:37.735007+0000","last_became_peered":"2024-08-18T22:31:37.735007+0000","last_unstale":"2024-08-18T22:31:38.901213+0000","last_undegraded":"2024-08-18T22:31:38.901213+0000","last_fullsized":"2024-08-18T22:31:38.901213+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:03:25.734294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731573+0000","last_change":"2024-08-18T22:31:37.730412+0000","last_active":"2024-08-18T22:31:38.731573+0000","last_peered":"2024-08-18T22:31:38.731573+0000","last_clean":"2024-08-18T22:31:38.731573+0000","last_became_active":"2024-08-18T22:31:37.730112+0000","last_became_peered":"2024-08-18T22:31:37.730112+0000","last_unstale":"2024-08-18T22:31:38.731573+0000","last_undegraded":"2024-08-18T22:31:38.731573+0000","last_fullsized":"2024-08-18T22:31:38.731573+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.736780+0000","last_change":"2024-08-18T22:31:37.732206+0000","last_active":"2024-08-18T22:31:37.736780+0000","last_peered":"2024-08-18T22:31:37.736780+0000","last_clean":"2024-08-18T22:31:37.736780+0000","last_became_active":"2024-08-18T22:31:37.731904+0000","last_became_peered":"2024-08-18T22:31:37.731904+0000","last_unstale":"2024-08-18T22:31:37.736780+0000","last_undegraded":"2024-08-18T22:31:37.736780+0000","last_fullsized":"2024-08-18T22:31:37.736780+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:44.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728625+0000","last_change":"2024-08-18T22:31:37.750599+0000","last_active":"2024-08-18T22:31:38.728625+0000","last_peered":"2024-08-18T22:31:38.728625+0000","last_clean":"2024-08-18T22:31:38.728625+0000","last_became_active":"2024-08-18T22:31:37.746079+0000","last_became_peered":"2024-08-18T22:31:37.746079+0000","last_unstale":"2024-08-18T22:31:38.728625+0000","last_undegraded":"2024-08-18T22:31:38.728625+0000","last_fullsized":"2024-08-18T22:31:38.728625+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:20.188575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.747003+0000","last_change":"2024-08-18T22:31:37.743562+0000","last_active":"2024-08-18T22:31:37.747003+0000","last_peered":"2024-08-18T22:31:37.747003+0000","last_clean":"2024-08-18T22:31:37.747003+0000","last_became_active":"2024-08-18T22:31:37.742492+0000","last_became_peered":"2024-08-18T22:31:37.742492+0000","last_unstale":"2024-08-18T22:31:37.747003+0000","last_undegraded":"2024-08-18T22:31:37.747003+0000","last_fullsized":"2024-08-18T22:31:37.747003+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:55:17.635407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.737119+0000","last_change":"2024-08-18T22:31:37.736027+0000","last_active":"2024-08-18T22:31:37.737119+0000","last_peered":"2024-08-18T22:31:37.737119+0000","last_clean":"2024-08-18T22:31:37.737119+0000","last_became_active":"2024-08-18T22:31:37.731251+0000","last_became_peered":"2024-08-18T22:31:37.731251+0000","last_unstale":"2024-08-18T22:31:37.737119+0000","last_undegraded":"2024-08-18T22:31:37.737119+0000","last_fullsized":"2024-08-18T22:31:37.737119+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:40.422128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730819+0000","last_change":"2024-08-18T22:31:37.728203+0000","last_active":"2024-08-18T22:31:38.730819+0000","last_peered":"2024-08-18T22:31:38.730819+0000","last_clean":"2024-08-18T22:31:38.730819+0000","last_became_active":"2024-08-18T22:31:37.727878+0000","last_became_peered":"2024-08-18T22:31:37.727878+0000","last_unstale":"2024-08-18T22:31:38.730819+0000","last_undegraded":"2024-08-18T22:31:38.730819+0000","last_fullsized":"2024-08-18T22:31:38.730819+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:07:11.812015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901278+0000","last_change":"2024-08-18T22:31:37.737727+0000","last_active":"2024-08-18T22:31:38.901278+0000","last_peered":"2024-08-18T22:31:38.901278+0000","last_clean":"2024-08-18T22:31:38.901278+0000","last_became_active":"2024-08-18T22:31:37.737395+0000","last_became_peered":"2024-08-18T22:31:37.737395+0000","last_unstale":"2024-08-18T22:31:38.901278+0000","last_undegraded":"2024-08-18T22:31:38.901278+0000","last_fullsized":"2024-08-18T22:31:38.901278+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:03:24.315995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.735929+0000","last_change":"2024-08-18T22:31:37.732467+0000","last_active":"2024-08-18T22:31:37.735929+0000","last_peered":"2024-08-18T22:31:37.735929+0000","last_clean":"2024-08-18T22:31:37.735929+0000","last_became_active":"2024-08-18T22:31:37.730478+0000","last_became_peered":"2024-08-18T22:31:37.730478+0000","last_unstale":"2024-08-18T22:31:37.735929+0000","last_undegraded":"2024-08-18T22:31:37.735929+0000","last_fullsized":"2024-08-18T22:31:37.735929+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:32:47.708683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728057+0000","last_change":"2024-08-18T22:31:37.749304+0000","last_active":"2024-08-18T22:31:38.728057+0000","last_peered":"2024-08-18T22:31:38.728057+0000","last_clean":"2024-08-18T22:31:38.728057+0000","last_became_active":"2024-08-18T22:31:37.747744+0000","last_became_peered":"2024-08-18T22:31:37.747744+0000","last_unstale":"2024-08-18T22:31:38.728057+0000","last_undegraded":"2024-08-18T22:31:38.728057+0000","last_fullsized":"2024-08-18T22:31:38.728057+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:39.191377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728783+0000","last_change":"2024-08-18T22:31:37.740347+0000","last_active":"2024-08-18T22:31:38.728783+0000","last_peered":"2024-08-18T22:31:38.728783+0000","last_clean":"2024-08-18T22:31:38.728783+0000","last_became_active":"2024-08-18T22:31:37.739960+0000","last_became_peered":"2024-08-18T22:31:37.739960+0000","last_unstale":"2024-08-18T22:31:38.728783+0000","last_undegraded":"2024-08-18T22:31:38.728783+0000","last_fullsized":"2024-08-18T22:31:38.728783+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:30:12.877666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731182+0000","last_change":"2024-08-18T22:31:37.738418+0000","last_active":"2024-08-18T22:31:38.731182+0000","last_peered":"2024-08-18T22:31:38.731182+0000","last_clean":"2024-08-18T22:31:38.731182+0000","last_became_active":"2024-08-18T22:31:37.737646+0000","last_became_peered":"2024-08-18T22:31:37.737646+0000","last_unstale":"2024-08-18T22:31:38.731182+0000","last_undegraded":"2024-08-18T22:31:38.731182+0000","last_fullsized":"2024-08-18T22:31:38.731182+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:29:59.147032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731135+0000","last_change":"2024-08-18T22:31:37.736394+0000","last_active":"2024-08-18T22:31:38.731135+0000","last_peered":"2024-08-18T22:31:38.731135+0000","last_clean":"2024-08-18T22:31:38.731135+0000","last_became_active":"2024-08-18T22:31:37.735597+0000","last_became_peered":"2024-08-18T22:31:37.735597+0000","last_unstale":"2024-08-18T22:31:38.731135+0000","last_undegraded":"2024-08-18T22:31:38.731135+0000","last_fullsized":"2024-08-18T22:31:38.731135+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:17:35.234457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728308+0000","last_change":"2024-08-18T22:31:37.736635+0000","last_active":"2024-08-18T22:31:38.728308+0000","last_peered":"2024-08-18T22:31:38.728308+0000","last_clean":"2024-08-18T22:31:38.728308+0000","last_became_active":"2024-08-18T22:31:37.734950+0000","last_became_peered":"2024-08-18T22:31:37.734950+0000","last_unstale":"2024-08-18T22:31:38.728308+0000","last_undegraded":"2024-08-18T22:31:38.728308+0000","last_fullsized":"2024-08-18T22:31:38.728308+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:39.349927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.739931+0000","last_change":"2024-08-18T22:31:37.732535+0000","last_active":"2024-08-18T22:31:37.739931+0000","last_peered":"2024-08-18T22:31:37.739931+0000","last_clean":"2024-08-18T22:31:37.739931+0000","last_became_active":"2024-08-18T22:31:37.732224+0000","last_became_peered":"2024-08-18T22:31:37.732224+0000","last_unstale":"2024-08-18T22:31:37.739931+0000","last_undegraded":"2024-08-18T22:31:37.739931+0000","last_fullsized":"2024-08-18T22:31:37.739931+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:37.295450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.743567+0000","last_change":"2024-08-18T22:31:37.737778+0000","last_active":"2024-08-18T22:31:37.743567+0000","last_peered":"2024-08-18T22:31:37.743567+0000","last_clean":"2024-08-18T22:31:37.743567+0000","last_became_active":"2024-08-18T22:31:37.737493+0000","last_became_peered":"2024-08-18T22:31:37.737493+0000","last_unstale":"2024-08-18T22:31:37.743567+0000","last_undegraded":"2024-08-18T22:31:37.743567+0000","last_fullsized":"2024-08-18T22:31:37.743567+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:31.728259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.732272+0000","last_change":"2024-08-18T22:31:37.740540+0000","last_active":"2024-08-18T22:31:38.732272+0000","last_peered":"2024-08-18T22:31:38.732272+0000","last_clean":"2024-08-18T22:31:38.732272+0000","last_became_active":"2024-08-18T22:31:37.740264+0000","last_became_peered":"2024-08-18T22:31:37.740264+0000","last_unstale":"2024-08-18T22:31:38.732272+0000","last_undegraded":"2024-08-18T22:31:38.732272+0000","last_fullsized":"2024-08-18T22:31:38.732272+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:20:41.506303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.743015+0000","last_change":"2024-08-18T22:31:37.738419+0000","last_active":"2024-08-18T22:31:37.743015+0000","last_peered":"2024-08-18T22:31:37.743015+0000","last_clean":"2024-08-18T22:31:37.743015+0000","last_became_active":"2024-08-18T22:31:37.737304+0000","last_became_peered":"2024-08-18T22:31:37.737304+0000","last_unstale":"2024-08-18T22:31:37.743015+0000","last_undegraded":"2024-08-18T22:31:37.743015+0000","last_fullsized":"2024-08-18T22:31:37.743015+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:34:07.961843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901531+0000","last_change":"2024-08-18T22:31:37.743843+0000","last_active":"2024-08-18T22:31:38.901531+0000","last_peered":"2024-08-18T22:31:38.901531+0000","last_clean":"2024-08-18T22:31:38.901531+0000","last_became_active":"2024-08-18T22:31:37.743514+0000","last_became_peered":"2024-08-18T22:31:37.743514+0000","last_unstale":"2024-08-18T22:31:38.901531+0000","last_undegraded":"2024-08-18T22:31:38.901531+0000","last_fullsized":"2024-08-18T22:31:38.901531+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:46.759293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.755129+0000","last_change":"2024-08-18T22:31:37.751938+0000","last_active":"2024-08-18T22:31:37.755129+0000","last_peered":"2024-08-18T22:31:37.755129+0000","last_clean":"2024-08-18T22:31:37.755129+0000","last_became_active":"2024-08-18T22:31:37.751668+0000","last_became_peered":"2024-08-18T22:31:37.751668+0000","last_unstale":"2024-08-18T22:31:37.755129+0000","last_undegraded":"2024-08-18T22:31:37.755129+0000","last_fullsized":"2024-08-18T22:31:37.755129+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:34:07.961843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731855+0000","last_change":"2024-08-18T22:31:37.728454+0000","last_active":"2024-08-18T22:31:38.731855+0000","last_peered":"2024-08-18T22:31:38.731855+0000","last_clean":"2024-08-18T22:31:38.731855+0000","last_became_active":"2024-08-18T22:31:37.728191+0000","last_became_peered":"2024-08-18T22:31:37.728191+0000","last_unstale":"2024-08-18T22:31:38.731855+0000","last_undegraded":"2024-08-18T22:31:38.731855+0000","last_fullsized":"2024-08-18T22:31:38.731855+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:16.333040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728363+0000","last_change":"2024-08-18T22:31:37.745355+0000","last_active":"2024-08-18T22:31:38.728363+0000","last_peered":"2024-08-18T22:31:38.728363+0000","last_clean":"2024-08-18T22:31:38.728363+0000","last_became_active":"2024-08-18T22:31:37.745073+0000","last_became_peered":"2024-08-18T22:31:37.745073+0000","last_unstale":"2024-08-18T22:31:38.728363+0000","last_undegraded":"2024-08-18T22:31:38.728363+0000","last_fullsized":"2024-08-18T22:31:38.728363+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:16:19.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.746820+0000","last_change":"2024-08-18T22:31:37.742602+0000","last_active":"2024-08-18T22:31:37.746820+0000","last_peered":"2024-08-18T22:31:37.746820+0000","last_clean":"2024-08-18T22:31:37.746820+0000","last_became_active":"2024-08-18T22:31:37.742333+0000","last_became_peered":"2024-08-18T22:31:37.742333+0000","last_unstale":"2024-08-18T22:31:37.746820+0000","last_undegraded":"2024-08-18T22:31:37.746820+0000","last_fullsized":"2024-08-18T22:31:37.746820+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:37.295450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.746819+0000","last_change":"2024-08-18T22:31:37.743422+0000","last_active":"2024-08-18T22:31:37.746819+0000","last_peered":"2024-08-18T22:31:37.746819+0000","last_clean":"2024-08-18T22:31:37.746819+0000","last_became_active":"2024-08-18T22:31:37.742381+0000","last_became_peered":"2024-08-18T22:31:37.742381+0000","last_unstale":"2024-08-18T22:31:37.746819+0000","last_undegraded":"2024-08-18T22:31:37.746819+0000","last_fullsized":"2024-08-18T22:31:37.746819+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:21.952522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901176+0000","last_change":"2024-08-18T22:31:37.739997+0000","last_active":"2024-08-18T22:31:38.901176+0000","last_peered":"2024-08-18T22:31:38.901176+0000","last_clean":"2024-08-18T22:31:38.901176+0000","last_became_active":"2024-08-18T22:31:37.739685+0000","last_became_peered":"2024-08-18T22:31:37.739685+0000","last_unstale":"2024-08-18T22:31:38.901176+0000","last_undegraded":"2024-08-18T22:31:38.901176+0000","last_fullsized":"2024-08-18T22:31:38.901176+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:32:29.741988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728132+0000","last_change":"2024-08-18T22:31:37.746994+0000","last_active":"2024-08-18T22:31:38.728132+0000","last_peered":"2024-08-18T22:31:38.728132+0000","last_clean":"2024-08-18T22:31:38.728132+0000","last_became_active":"2024-08-18T22:31:37.746717+0000","last_became_peered":"2024-08-18T22:31:37.746717+0000","last_unstale":"2024-08-18T22:31:38.728132+0000","last_undegraded":"2024-08-18T22:31:38.728132+0000","last_fullsized":"2024-08-18T22:31:38.728132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:40.406251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.732131+0000","last_change":"2024-08-18T22:31:37.726729+0000","last_active":"2024-08-18T22:31:38.732131+0000","last_peered":"2024-08-18T22:31:38.732131+0000","last_clean":"2024-08-18T22:31:38.732131+0000","last_became_active":"2024-08-18T22:31:37.722318+0000","last_became_peered":"2024-08-18T22:31:37.722318+0000","last_unstale":"2024-08-18T22:31:38.732131+0000","last_undegraded":"2024-08-18T22:31:38.732131+0000","last_fullsized":"2024-08-18T22:31:38.732131+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:04.727886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"176'4","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.738100+0000","last_change":"2024-08-18T22:31:36.729582+0000","last_active":"2024-08-18T22:31:37.738100+0000","last_peered":"2024-08-18T22:31:37.738100+0000","last_clean":"2024-08-18T22:31:37.738100+0000","last_became_active":"2024-08-18T22:31:36.729256+0000","last_became_peered":"2024-08-18T22:31:36.729256+0000","last_unstale":"2024-08-18T22:31:37.738100+0000","last_undegraded":"2024-08-18T22:31:37.738100+0000","last_fullsized":"2024-08-18T22:31:37.738100+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:45.186613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901605+0000","last_change":"2024-08-18T22:31:37.733013+0000","last_active":"2024-08-18T22:31:38.901605+0000","last_peered":"2024-08-18T22:31:38.901605+0000","last_clean":"2024-08-18T22:31:38.901605+0000","last_became_active":"2024-08-18T22:31:37.732718+0000","last_became_peered":"2024-08-18T22:31:37.732718+0000","last_unstale":"2024-08-18T22:31:38.901605+0000","last_undegraded":"2024-08-18T22:31:38.901605+0000","last_fullsized":"2024-08-18T22:31:38.901605+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:02.083243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"176'1","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728733+0000","last_change":"2024-08-18T22:31:36.735137+0000","last_active":"2024-08-18T22:31:38.728733+0000","last_peered":"2024-08-18T22:31:38.728733+0000","last_clean":"2024-08-18T22:31:38.728733+0000","last_became_active":"2024-08-18T22:31:36.733429+0000","last_became_peered":"2024-08-18T22:31:36.733429+0000","last_unstale":"2024-08-18T22:31:38.728733+0000","last_undegraded":"2024-08-18T22:31:38.728733+0000","last_fullsized":"2024-08-18T22:31:38.728733+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:38:56.910744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.746670+0000","last_change":"2024-08-18T22:31:37.739515+0000","last_active":"2024-08-18T22:31:37.746670+0000","last_peered":"2024-08-18T22:31:37.746670+0000","last_clean":"2024-08-18T22:31:37.746670+0000","last_became_active":"2024-08-18T22:31:37.738983+0000","last_became_peered":"2024-08-18T22:31:37.738983+0000","last_unstale":"2024-08-18T22:31:37.746670+0000","last_undegraded":"2024-08-18T22:31:37.746670+0000","last_fullsized":"2024-08-18T22:31:37.746670+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:32:47.708683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"176'2","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.746954+0000","last_change":"2024-08-18T22:31:36.725872+0000","last_active":"2024-08-18T22:31:37.746954+0000","last_peered":"2024-08-18T22:31:37.746954+0000","last_clean":"2024-08-18T22:31:37.746954+0000","last_became_active":"2024-08-18T22:31:36.725433+0000","last_became_peered":"2024-08-18T22:31:36.725433+0000","last_unstale":"2024-08-18T22:31:37.746954+0000","last_undegraded":"2024-08-18T22:31:37.746954+0000","last_fullsized":"2024-08-18T22:31:37.746954+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:04.776915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.741294+0000","last_change":"2024-08-18T22:31:37.736904+0000","last_active":"2024-08-18T22:31:37.741294+0000","last_peered":"2024-08-18T22:31:37.741294+0000","last_clean":"2024-08-18T22:31:37.741294+0000","last_became_active":"2024-08-18T22:31:37.736528+0000","last_became_peered":"2024-08-18T22:31:37.736528+0000","last_unstale":"2024-08-18T22:31:37.741294+0000","last_undegraded":"2024-08-18T22:31:37.741294+0000","last_fullsized":"2024-08-18T22:31:37.741294+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:12.565673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"176'2","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730799+0000","last_change":"2024-08-18T22:31:36.729158+0000","last_active":"2024-08-18T22:31:38.730799+0000","last_peered":"2024-08-18T22:31:38.730799+0000","last_clean":"2024-08-18T22:31:38.730799+0000","last_became_active":"2024-08-18T22:31:36.728858+0000","last_became_peered":"2024-08-18T22:31:36.728858+0000","last_unstale":"2024-08-18T22:31:38.730799+0000","last_undegraded":"2024-08-18T22:31:38.730799+0000","last_fullsized":"2024-08-18T22:31:38.730799+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:57:51.922520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730344+0000","last_change":"2024-08-18T22:31:37.738755+0000","last_active":"2024-08-18T22:31:38.730344+0000","last_peered":"2024-08-18T22:31:38.730344+0000","last_clean":"2024-08-18T22:31:38.730344+0000","last_became_active":"2024-08-18T22:31:37.738471+0000","last_became_peered":"2024-08-18T22:31:37.738471+0000","last_unstale":"2024-08-18T22:31:38.730344+0000","last_undegraded":"2024-08-18T22:31:38.730344+0000","last_fullsized":"2024-08-18T22:31:38.730344+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:01.753579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"176'1","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728480+0000","last_change":"2024-08-18T22:31:36.733521+0000","last_active":"2024-08-18T22:31:38.728480+0000","last_peered":"2024-08-18T22:31:38.728480+0000","last_clean":"2024-08-18T22:31:38.728480+0000","last_became_active":"2024-08-18T22:31:36.733210+0000","last_became_peered":"2024-08-18T22:31:36.733210+0000","last_unstale":"2024-08-18T22:31:38.728480+0000","last_undegraded":"2024-08-18T22:31:38.728480+0000","last_fullsized":"2024-08-18T22:31:38.728480+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:11.659058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.742872+0000","last_change":"2024-08-18T22:31:37.732241+0000","last_active":"2024-08-18T22:31:37.742872+0000","last_peered":"2024-08-18T22:31:37.742872+0000","last_clean":"2024-08-18T22:31:37.742872+0000","last_became_active":"2024-08-18T22:31:37.731951+0000","last_became_peered":"2024-08-18T22:31:37.731951+0000","last_unstale":"2024-08-18T22:31:37.742872+0000","last_undegraded":"2024-08-18T22:31:37.742872+0000","last_fullsized":"2024-08-18T22:31:37.742872+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:05.780197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"176'1","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.744590+0000","last_change":"2024-08-18T22:31:36.735101+0000","last_active":"2024-08-18T22:31:37.744590+0000","last_peered":"2024-08-18T22:31:37.744590+0000","last_clean":"2024-08-18T22:31:37.744590+0000","last_became_active":"2024-08-18T22:31:36.734702+0000","last_became_peered":"2024-08-18T22:31:36.734702+0000","last_unstale":"2024-08-18T22:31:37.744590+0000","last_undegraded":"2024-08-18T22:31:37.744590+0000","last_fullsized":"2024-08-18T22:31:37.744590+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:19:55.692859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.744339+0000","last_change":"2024-08-18T22:31:37.741194+0000","last_active":"2024-08-18T22:31:37.744339+0000","last_peered":"2024-08-18T22:31:37.744339+0000","last_clean":"2024-08-18T22:31:37.744339+0000","last_became_active":"2024-08-18T22:31:37.740272+0000","last_became_peered":"2024-08-18T22:31:37.740272+0000","last_unstale":"2024-08-18T22:31:37.744339+0000","last_undegraded":"2024-08-18T22:31:37.744339+0000","last_fullsized":"2024-08-18T22:31:37.744339+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:28.484407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730499+0000","last_change":"2024-08-18T22:31:36.721961+0000","last_active":"2024-08-18T22:31:38.730499+0000","last_peered":"2024-08-18T22:31:38.730499+0000","last_clean":"2024-08-18T22:31:38.730499+0000","last_became_active":"2024-08-18T22:31:36.721685+0000","last_became_peered":"2024-08-18T22:31:36.721685+0000","last_unstale":"2024-08-18T22:31:38.730499+0000","last_undegraded":"2024-08-18T22:31:38.730499+0000","last_fullsized":"2024-08-18T22:31:38.730499+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:04.980631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.732223+0000","last_change":"2024-08-18T22:31:37.730732+0000","last_active":"2024-08-18T22:31:38.732223+0000","last_peered":"2024-08-18T22:31:38.732223+0000","last_clean":"2024-08-18T22:31:38.732223+0000","last_became_active":"2024-08-18T22:31:37.729598+0000","last_became_peered":"2024-08-18T22:31:37.729598+0000","last_unstale":"2024-08-18T22:31:38.732223+0000","last_undegraded":"2024-08-18T22:31:38.732223+0000","last_fullsized":"2024-08-18T22:31:38.732223+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:16:00.536889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728830+0000","last_change":"2024-08-18T22:31:36.737289+0000","last_active":"2024-08-18T22:31:38.728830+0000","last_peered":"2024-08-18T22:31:38.728830+0000","last_clean":"2024-08-18T22:31:38.728830+0000","last_became_active":"2024-08-18T22:31:36.736982+0000","last_became_peered":"2024-08-18T22:31:36.736982+0000","last_unstale":"2024-08-18T22:31:38.728830+0000","last_undegraded":"2024-08-18T22:31:38.728830+0000","last_fullsized":"2024-08-18T22:31:38.728830+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:41:28.171750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728771+0000","last_change":"2024-08-18T22:31:37.743943+0000","last_active":"2024-08-18T22:31:38.728771+0000","last_peered":"2024-08-18T22:31:38.728771+0000","last_clean":"2024-08-18T22:31:38.728771+0000","last_became_active":"2024-08-18T22:31:37.743195+0000","last_became_peered":"2024-08-18T22:31:37.743195+0000","last_unstale":"2024-08-18T22:31:38.728771+0000","last_undegraded":"2024-08-18T22:31:38.728771+0000","last_fullsized":"2024-08-18T22:31:38.728771+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:19:28.281484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.720999+0000","last_change":"2024-08-18T22:31:36.739017+0000","last_active":"2024-08-18T22:31:37.720999+0000","last_peered":"2024-08-18T22:31:37.720999+0000","last_clean":"2024-08-18T22:31:37.720999+0000","last_became_active":"2024-08-18T22:31:36.738747+0000","last_became_peered":"2024-08-18T22:31:36.738747+0000","last_unstale":"2024-08-18T22:31:37.720999+0000","last_undegraded":"2024-08-18T22:31:37.720999+0000","last_fullsized":"2024-08-18T22:31:37.720999+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:35:24.192068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731204+0000","last_change":"2024-08-18T22:31:37.738621+0000","last_active":"2024-08-18T22:31:38.731204+0000","last_peered":"2024-08-18T22:31:38.731204+0000","last_clean":"2024-08-18T22:31:38.731204+0000","last_became_active":"2024-08-18T22:31:37.738334+0000","last_became_peered":"2024-08-18T22:31:37.738334+0000","last_unstale":"2024-08-18T22:31:38.731204+0000","last_undegraded":"2024-08-18T22:31:38.731204+0000","last_fullsized":"2024-08-18T22:31:38.731204+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:17:11.625333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"176'3","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.750233+0000","last_change":"2024-08-18T22:31:36.740381+0000","last_active":"2024-08-18T22:31:37.750233+0000","last_peered":"2024-08-18T22:31:37.750233+0000","last_clean":"2024-08-18T22:31:37.750233+0000","last_became_active":"2024-08-18T22:31:36.740089+0000","last_became_peered":"2024-08-18T22:31:36.740089+0000","last_unstale":"2024-08-18T22:31:37.750233+0000","last_undegraded":"2024-08-18T22:31:37.750233+0000","last_fullsized":"2024-08-18T22:31:37.750233+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:11.659058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.750073+0000","last_change":"2024-08-18T22:31:37.749266+0000","last_active":"2024-08-18T22:31:37.750073+0000","last_peered":"2024-08-18T22:31:37.750073+0000","last_clean":"2024-08-18T22:31:37.750073+0000","last_became_active":"2024-08-18T22:31:37.748912+0000","last_became_peered":"2024-08-18T22:31:37.748912+0000","last_unstale":"2024-08-18T22:31:37.750073+0000","last_undegraded":"2024-08-18T22:31:37.750073+0000","last_fullsized":"2024-08-18T22:31:37.750073+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:05.394538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"176'6","reported_seq":20,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730971+0000","last_change":"2024-08-18T22:31:36.726671+0000","last_active":"2024-08-18T22:31:38.730971+0000","last_peered":"2024-08-18T22:31:38.730971+0000","last_clean":"2024-08-18T22:31:38.730971+0000","last_became_active":"2024-08-18T22:31:36.726370+0000","last_became_peered":"2024-08-18T22:31:36.726370+0000","last_unstale":"2024-08-18T22:31:38.730971+0000","last_undegraded":"2024-08-18T22:31:38.730971+0000","last_fullsized":"2024-08-18T22:31:38.730971+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:04:52.420553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901204+0000","last_change":"2024-08-18T22:31:37.731600+0000","last_active":"2024-08-18T22:31:38.901204+0000","last_peered":"2024-08-18T22:31:38.901204+0000","last_clean":"2024-08-18T22:31:38.901204+0000","last_became_active":"2024-08-18T22:31:37.731324+0000","last_became_peered":"2024-08-18T22:31:37.731324+0000","last_unstale":"2024-08-18T22:31:38.901204+0000","last_undegraded":"2024-08-18T22:31:38.901204+0000","last_fullsized":"2024-08-18T22:31:38.901204+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:58:06.565861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"176'2","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730883+0000","last_change":"2024-08-18T22:31:36.724203+0000","last_active":"2024-08-18T22:31:38.730883+0000","last_peered":"2024-08-18T22:31:38.730883+0000","last_clean":"2024-08-18T22:31:38.730883+0000","last_became_active":"2024-08-18T22:31:36.723787+0000","last_became_peered":"2024-08-18T22:31:36.723787+0000","last_unstale":"2024-08-18T22:31:38.730883+0000","last_undegraded":"2024-08-18T22:31:38.730883+0000","last_fullsized":"2024-08-18T22:31:38.730883+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:32:39.375326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728092+0000","last_change":"2024-08-18T22:31:37.742227+0000","last_active":"2024-08-18T22:31:38.728092+0000","last_peered":"2024-08-18T22:31:38.728092+0000","last_clean":"2024-08-18T22:31:38.728092+0000","last_became_active":"2024-08-18T22:31:37.741942+0000","last_became_peered":"2024-08-18T22:31:37.741942+0000","last_unstale":"2024-08-18T22:31:38.728092+0000","last_undegraded":"2024-08-18T22:31:38.728092+0000","last_fullsized":"2024-08-18T22:31:38.728092+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:15.513896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.721703+0000","last_change":"2024-08-18T22:31:36.732427+0000","last_active":"2024-08-18T22:31:37.721703+0000","last_peered":"2024-08-18T22:31:37.721703+0000","last_clean":"2024-08-18T22:31:37.721703+0000","last_became_active":"2024-08-18T22:31:36.732160+0000","last_became_peered":"2024-08-18T22:31:36.732160+0000","last_unstale":"2024-08-18T22:31:37.721703+0000","last_undegraded":"2024-08-18T22:31:37.721703+0000","last_fullsized":"2024-08-18T22:31:37.721703+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:00.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730683+0000","last_change":"2024-08-18T22:31:37.732564+0000","last_active":"2024-08-18T22:31:38.730683+0000","last_peered":"2024-08-18T22:31:38.730683+0000","last_clean":"2024-08-18T22:31:38.730683+0000","last_became_active":"2024-08-18T22:31:37.731216+0000","last_became_peered":"2024-08-18T22:31:37.731216+0000","last_unstale":"2024-08-18T22:31:38.730683+0000","last_undegraded":"2024-08-18T22:31:38.730683+0000","last_fullsized":"2024-08-18T22:31:38.730683+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:43:09.852071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.718749+0000","last_change":"2024-08-18T22:31:36.726097+0000","last_active":"2024-08-18T22:31:37.718749+0000","last_peered":"2024-08-18T22:31:37.718749+0000","last_clean":"2024-08-18T22:31:37.718749+0000","last_became_active":"2024-08-18T22:31:36.724456+0000","last_became_peered":"2024-08-18T22:31:36.724456+0000","last_unstale":"2024-08-18T22:31:37.718749+0000","last_undegraded":"2024-08-18T22:31:37.718749+0000","last_fullsized":"2024-08-18T22:31:37.718749+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:38:56.910744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730845+0000","last_change":"2024-08-18T22:31:37.741499+0000","last_active":"2024-08-18T22:31:38.730845+0000","last_peered":"2024-08-18T22:31:38.730845+0000","last_clean":"2024-08-18T22:31:38.730845+0000","last_became_active":"2024-08-18T22:31:37.741186+0000","last_became_peered":"2024-08-18T22:31:37.741186+0000","last_unstale":"2024-08-18T22:31:38.730845+0000","last_undegraded":"2024-08-18T22:31:38.730845+0000","last_fullsized":"2024-08-18T22:31:38.730845+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:17.844421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"176'8","reported_seq":20,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.750542+0000","last_change":"2024-08-18T22:31:36.727719+0000","last_active":"2024-08-18T22:31:37.750542+0000","last_peered":"2024-08-18T22:31:37.750542+0000","last_clean":"2024-08-18T22:31:37.750542+0000","last_became_active":"2024-08-18T22:31:36.727400+0000","last_became_peered":"2024-08-18T22:31:36.727400+0000","last_unstale":"2024-08-18T22:31:37.750542+0000","last_undegraded":"2024-08-18T22:31:37.750542+0000","last_fullsized":"2024-08-18T22:31:37.750542+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:00.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901443+0000","last_change":"2024-08-18T22:31:37.740300+0000","last_active":"2024-08-18T22:31:38.901443+0000","last_peered":"2024-08-18T22:31:38.901443+0000","last_clean":"2024-08-18T22:31:38.901443+0000","last_became_active":"2024-08-18T22:31:37.740004+0000","last_became_peered":"2024-08-18T22:31:37.740004+0000","last_unstale":"2024-08-18T22:31:38.901443+0000","last_undegraded":"2024-08-18T22:31:38.901443+0000","last_fullsized":"2024-08-18T22:31:38.901443+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:54:49.606023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"176'1","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.748987+0000","last_change":"2024-08-18T22:31:36.730166+0000","last_active":"2024-08-18T22:31:37.748987+0000","last_peered":"2024-08-18T22:31:37.748987+0000","last_clean":"2024-08-18T22:31:37.748987+0000","last_became_active":"2024-08-18T22:31:36.729851+0000","last_became_peered":"2024-08-18T22:31:36.729851+0000","last_unstale":"2024-08-18T22:31:37.748987+0000","last_undegraded":"2024-08-18T22:31:37.748987+0000","last_fullsized":"2024-08-18T22:31:37.748987+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:24:48.022255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728538+0000","last_change":"2024-08-18T22:31:37.744155+0000","last_active":"2024-08-18T22:31:38.728538+0000","last_peered":"2024-08-18T22:31:38.728538+0000","last_clean":"2024-08-18T22:31:38.728538+0000","last_became_active":"2024-08-18T22:31:37.743696+0000","last_became_peered":"2024-08-18T22:31:37.743696+0000","last_unstale":"2024-08-18T22:31:38.728538+0000","last_undegraded":"2024-08-18T22:31:38.728538+0000","last_fullsized":"2024-08-18T22:31:38.728538+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:41:52.882342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"176'2","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.748466+0000","last_change":"2024-08-18T22:31:36.727103+0000","last_active":"2024-08-18T22:31:37.748466+0000","last_peered":"2024-08-18T22:31:37.748466+0000","last_clean":"2024-08-18T22:31:37.748466+0000","last_became_active":"2024-08-18T22:31:36.726638+0000","last_became_peered":"2024-08-18T22:31:36.726638+0000","last_unstale":"2024-08-18T22:31:37.748466+0000","last_undegraded":"2024-08-18T22:31:37.748466+0000","last_fullsized":"2024-08-18T22:31:37.748466+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:06.700725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.748736+0000","last_change":"2024-08-18T22:31:37.744467+0000","last_active":"2024-08-18T22:31:37.748736+0000","last_peered":"2024-08-18T22:31:37.748736+0000","last_clean":"2024-08-18T22:31:37.748736+0000","last_became_active":"2024-08-18T22:31:37.743977+0000","last_became_peered":"2024-08-18T22:31:37.743977+0000","last_unstale":"2024-08-18T22:31:37.748736+0000","last_undegraded":"2024-08-18T22:31:37.748736+0000","last_fullsized":"2024-08-18T22:31:37.748736+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:31.728259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"176'1","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.747572+0000","last_change":"2024-08-18T22:31:36.738198+0000","last_active":"2024-08-18T22:31:37.747572+0000","last_peered":"2024-08-18T22:31:37.747572+0000","last_clean":"2024-08-18T22:31:37.747572+0000","last_became_active":"2024-08-18T22:31:36.737899+0000","last_became_peered":"2024-08-18T22:31:36.737899+0000","last_unstale":"2024-08-18T22:31:37.747572+0000","last_undegraded":"2024-08-18T22:31:37.747572+0000","last_fullsized":"2024-08-18T22:31:37.747572+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:54:05.624279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.749427+0000","last_change":"2024-08-18T22:31:37.745495+0000","last_active":"2024-08-18T22:31:37.749427+0000","last_peered":"2024-08-18T22:31:37.749427+0000","last_clean":"2024-08-18T22:31:37.749427+0000","last_became_active":"2024-08-18T22:31:37.744680+0000","last_became_peered":"2024-08-18T22:31:37.744680+0000","last_unstale":"2024-08-18T22:31:37.749427+0000","last_undegraded":"2024-08-18T22:31:37.749427+0000","last_fullsized":"2024-08-18T22:31:37.749427+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:32.865858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.737904+0000","last_change":"2024-08-18T22:31:36.730036+0000","last_active":"2024-08-18T22:31:37.737904+0000","last_peered":"2024-08-18T22:31:37.737904+0000","last_clean":"2024-08-18T22:31:37.737904+0000","last_became_active":"2024-08-18T22:31:36.729724+0000","last_became_peered":"2024-08-18T22:31:36.729724+0000","last_unstale":"2024-08-18T22:31:37.737904+0000","last_undegraded":"2024-08-18T22:31:37.737904+0000","last_fullsized":"2024-08-18T22:31:37.737904+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:43.859668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.746528+0000","last_change":"2024-08-18T22:31:37.745251+0000","last_active":"2024-08-18T22:31:37.746528+0000","last_peered":"2024-08-18T22:31:37.746528+0000","last_clean":"2024-08-18T22:31:37.746528+0000","last_became_active":"2024-08-18T22:31:37.744718+0000","last_became_peered":"2024-08-18T22:31:37.744718+0000","last_unstale":"2024-08-18T22:31:37.746528+0000","last_undegraded":"2024-08-18T22:31:37.746528+0000","last_fullsized":"2024-08-18T22:31:37.746528+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:42:07.593095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"176'2","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730905+0000","last_change":"2024-08-18T22:31:36.736551+0000","last_active":"2024-08-18T22:31:38.730905+0000","last_peered":"2024-08-18T22:31:38.730905+0000","last_clean":"2024-08-18T22:31:38.730905+0000","last_became_active":"2024-08-18T22:31:36.736248+0000","last_became_peered":"2024-08-18T22:31:36.736248+0000","last_unstale":"2024-08-18T22:31:38.730905+0000","last_undegraded":"2024-08-18T22:31:38.730905+0000","last_fullsized":"2024-08-18T22:31:38.730905+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:42.264680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.732982+0000","last_change":"2024-08-18T22:31:37.729075+0000","last_active":"2024-08-18T22:31:37.732982+0000","last_peered":"2024-08-18T22:31:37.732982+0000","last_clean":"2024-08-18T22:31:37.732982+0000","last_became_active":"2024-08-18T22:31:37.728704+0000","last_became_peered":"2024-08-18T22:31:37.728704+0000","last_unstale":"2024-08-18T22:31:37.732982+0000","last_undegraded":"2024-08-18T22:31:37.732982+0000","last_fullsized":"2024-08-18T22:31:37.732982+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:41:29.175032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.717694+0000","last_change":"2024-08-18T22:31:36.727477+0000","last_active":"2024-08-18T22:31:37.717694+0000","last_peered":"2024-08-18T22:31:37.717694+0000","last_clean":"2024-08-18T22:31:37.717694+0000","last_became_active":"2024-08-18T22:31:36.727133+0000","last_became_peered":"2024-08-18T22:31:36.727133+0000","last_unstale":"2024-08-18T22:31:37.717694+0000","last_undegraded":"2024-08-18T22:31:37.717694+0000","last_fullsized":"2024-08-18T22:31:37.717694+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:44.591999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.740560+0000","last_change":"2024-08-18T22:31:37.739284+0000","last_active":"2024-08-18T22:31:37.740560+0000","last_peered":"2024-08-18T22:31:37.740560+0000","last_clean":"2024-08-18T22:31:37.740560+0000","last_became_active":"2024-08-18T22:31:37.739004+0000","last_became_peered":"2024-08-18T22:31:37.739004+0000","last_unstale":"2024-08-18T22:31:37.740560+0000","last_undegraded":"2024-08-18T22:31:37.740560+0000","last_fullsized":"2024-08-18T22:31:37.740560+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:33:12.109555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901277+0000","last_change":"2024-08-18T22:31:36.736210+0000","last_active":"2024-08-18T22:31:38.901277+0000","last_peered":"2024-08-18T22:31:38.901277+0000","last_clean":"2024-08-18T22:31:38.901277+0000","last_became_active":"2024-08-18T22:31:36.735763+0000","last_became_peered":"2024-08-18T22:31:36.735763+0000","last_unstale":"2024-08-18T22:31:38.901277+0000","last_undegraded":"2024-08-18T22:31:38.901277+0000","last_fullsized":"2024-08-18T22:31:38.901277+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:24.863657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728364+0000","last_change":"2024-08-18T22:31:37.750473+0000","last_active":"2024-08-18T22:31:38.728364+0000","last_peered":"2024-08-18T22:31:38.728364+0000","last_clean":"2024-08-18T22:31:38.728364+0000","last_became_active":"2024-08-18T22:31:37.743259+0000","last_became_peered":"2024-08-18T22:31:37.743259+0000","last_unstale":"2024-08-18T22:31:38.728364+0000","last_undegraded":"2024-08-18T22:31:38.728364+0000","last_fullsized":"2024-08-18T22:31:38.728364+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:21.399341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.717924+0000","last_change":"2024-08-18T22:31:36.720852+0000","last_active":"2024-08-18T22:31:37.717924+0000","last_peered":"2024-08-18T22:31:37.717924+0000","last_clean":"2024-08-18T22:31:37.717924+0000","last_became_active":"2024-08-18T22:31:36.720397+0000","last_became_peered":"2024-08-18T22:31:36.720397+0000","last_unstale":"2024-08-18T22:31:37.717924+0000","last_undegraded":"2024-08-18T22:31:37.717924+0000","last_fullsized":"2024-08-18T22:31:37.717924+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:53:28.130055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901445+0000","last_change":"2024-08-18T22:31:37.737812+0000","last_active":"2024-08-18T22:31:38.901445+0000","last_peered":"2024-08-18T22:31:38.901445+0000","last_clean":"2024-08-18T22:31:38.901445+0000","last_became_active":"2024-08-18T22:31:37.737287+0000","last_became_peered":"2024-08-18T22:31:37.737287+0000","last_unstale":"2024-08-18T22:31:38.901445+0000","last_undegraded":"2024-08-18T22:31:38.901445+0000","last_fullsized":"2024-08-18T22:31:38.901445+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:46:56.554374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"176'2","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.739370+0000","last_change":"2024-08-18T22:31:36.719940+0000","last_active":"2024-08-18T22:31:37.739370+0000","last_peered":"2024-08-18T22:31:37.739370+0000","last_clean":"2024-08-18T22:31:37.739370+0000","last_became_active":"2024-08-18T22:31:36.719624+0000","last_became_peered":"2024-08-18T22:31:36.719624+0000","last_unstale":"2024-08-18T22:31:37.739370+0000","last_undegraded":"2024-08-18T22:31:37.739370+0000","last_fullsized":"2024-08-18T22:31:37.739370+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:44:47.635275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.738356+0000","last_change":"2024-08-18T22:31:37.731702+0000","last_active":"2024-08-18T22:31:37.738356+0000","last_peered":"2024-08-18T22:31:37.738356+0000","last_clean":"2024-08-18T22:31:37.738356+0000","last_became_active":"2024-08-18T22:31:37.731435+0000","last_became_peered":"2024-08-18T22:31:37.731435+0000","last_unstale":"2024-08-18T22:31:37.738356+0000","last_undegraded":"2024-08-18T22:31:37.738356+0000","last_fullsized":"2024-08-18T22:31:37.738356+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:24:49.025537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"177'1","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901479+0000","last_change":"2024-08-18T22:31:36.738922+0000","last_active":"2024-08-18T22:31:38.901479+0000","last_peered":"2024-08-18T22:31:38.901479+0000","last_clean":"2024-08-18T22:31:38.901479+0000","last_became_active":"2024-08-18T22:31:36.738593+0000","last_became_peered":"2024-08-18T22:31:36.738593+0000","last_unstale":"2024-08-18T22:31:38.901479+0000","last_undegraded":"2024-08-18T22:31:38.901479+0000","last_fullsized":"2024-08-18T22:31:38.901479+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:29.340022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.732049+0000","last_change":"2024-08-18T22:31:37.727877+0000","last_active":"2024-08-18T22:31:38.732049+0000","last_peered":"2024-08-18T22:31:38.732049+0000","last_clean":"2024-08-18T22:31:38.732049+0000","last_became_active":"2024-08-18T22:31:37.727610+0000","last_became_peered":"2024-08-18T22:31:37.727610+0000","last_unstale":"2024-08-18T22:31:38.732049+0000","last_undegraded":"2024-08-18T22:31:38.732049+0000","last_fullsized":"2024-08-18T22:31:38.732049+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:21.129924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728662+0000","last_change":"2024-08-18T22:31:36.737079+0000","last_active":"2024-08-18T22:31:38.728662+0000","last_peered":"2024-08-18T22:31:38.728662+0000","last_clean":"2024-08-18T22:31:38.728662+0000","last_became_active":"2024-08-18T22:31:36.736730+0000","last_became_peered":"2024-08-18T22:31:36.736730+0000","last_unstale":"2024-08-18T22:31:38.728662+0000","last_undegraded":"2024-08-18T22:31:38.728662+0000","last_fullsized":"2024-08-18T22:31:38.728662+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:44:47.635275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901592+0000","last_change":"2024-08-18T22:31:37.746231+0000","last_active":"2024-08-18T22:31:38.901592+0000","last_peered":"2024-08-18T22:31:38.901592+0000","last_clean":"2024-08-18T22:31:38.901592+0000","last_became_active":"2024-08-18T22:31:37.745894+0000","last_became_peered":"2024-08-18T22:31:37.745894+0000","last_unstale":"2024-08-18T22:31:38.901592+0000","last_undegraded":"2024-08-18T22:31:38.901592+0000","last_fullsized":"2024-08-18T22:31:38.901592+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:37.457031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728620+0000","last_change":"2024-08-18T22:31:36.739261+0000","last_active":"2024-08-18T22:31:38.728620+0000","last_peered":"2024-08-18T22:31:38.728620+0000","last_clean":"2024-08-18T22:31:38.728620+0000","last_became_active":"2024-08-18T22:31:36.738977+0000","last_became_peered":"2024-08-18T22:31:36.738977+0000","last_unstale":"2024-08-18T22:31:38.728620+0000","last_undegraded":"2024-08-18T22:31:38.728620+0000","last_fullsized":"2024-08-18T22:31:38.728620+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:45.186613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.735652+0000","last_change":"2024-08-18T22:31:37.724975+0000","last_active":"2024-08-18T22:31:37.735652+0000","last_peered":"2024-08-18T22:31:37.735652+0000","last_clean":"2024-08-18T22:31:37.735652+0000","last_became_active":"2024-08-18T22:31:37.724665+0000","last_became_peered":"2024-08-18T22:31:37.724665+0000","last_unstale":"2024-08-18T22:31:37.735652+0000","last_undegraded":"2024-08-18T22:31:37.735652+0000","last_fullsized":"2024-08-18T22:31:37.735652+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:31.133665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731743+0000","last_change":"2024-08-18T22:31:36.725782+0000","last_active":"2024-08-18T22:31:38.731743+0000","last_peered":"2024-08-18T22:31:38.731743+0000","last_clean":"2024-08-18T22:31:38.731743+0000","last_became_active":"2024-08-18T22:31:36.725511+0000","last_became_peered":"2024-08-18T22:31:36.725511+0000","last_unstale":"2024-08-18T22:31:38.731743+0000","last_undegraded":"2024-08-18T22:31:38.731743+0000","last_fullsized":"2024-08-18T22:31:38.731743+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:31.862576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730436+0000","last_change":"2024-08-18T22:31:37.728399+0000","last_active":"2024-08-18T22:31:38.730436+0000","last_peered":"2024-08-18T22:31:38.730436+0000","last_clean":"2024-08-18T22:31:38.730436+0000","last_became_active":"2024-08-18T22:31:37.728094+0000","last_became_peered":"2024-08-18T22:31:37.728094+0000","last_unstale":"2024-08-18T22:31:38.730436+0000","last_undegraded":"2024-08-18T22:31:38.730436+0000","last_fullsized":"2024-08-18T22:31:38.730436+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:17.088247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731622+0000","last_change":"2024-08-18T22:31:36.728772+0000","last_active":"2024-08-18T22:31:38.731622+0000","last_peered":"2024-08-18T22:31:38.731622+0000","last_clean":"2024-08-18T22:31:38.731622+0000","last_became_active":"2024-08-18T22:31:36.728482+0000","last_became_peered":"2024-08-18T22:31:36.728482+0000","last_unstale":"2024-08-18T22:31:38.731622+0000","last_undegraded":"2024-08-18T22:31:38.731622+0000","last_fullsized":"2024-08-18T22:31:38.731622+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:42:06.589813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.742945+0000","last_change":"2024-08-18T22:31:37.736609+0000","last_active":"2024-08-18T22:31:37.742945+0000","last_peered":"2024-08-18T22:31:37.742945+0000","last_clean":"2024-08-18T22:31:37.742945+0000","last_became_active":"2024-08-18T22:31:37.736327+0000","last_became_peered":"2024-08-18T22:31:37.736327+0000","last_unstale":"2024-08-18T22:31:37.742945+0000","last_undegraded":"2024-08-18T22:31:37.742945+0000","last_fullsized":"2024-08-18T22:31:37.742945+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:21.952522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901282+0000","last_change":"2024-08-18T22:31:36.723897+0000","last_active":"2024-08-18T22:31:38.901282+0000","last_peered":"2024-08-18T22:31:38.901282+0000","last_clean":"2024-08-18T22:31:38.901282+0000","last_became_active":"2024-08-18T22:31:36.723603+0000","last_became_peered":"2024-08-18T22:31:36.723603+0000","last_unstale":"2024-08-18T22:31:38.901282+0000","last_undegraded":"2024-08-18T22:31:38.901282+0000","last_fullsized":"2024-08-18T22:31:38.901282+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:31:15.579480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731754+0000","last_change":"2024-08-18T22:31:37.741836+0000","last_active":"2024-08-18T22:31:38.731754+0000","last_peered":"2024-08-18T22:31:38.731754+0000","last_clean":"2024-08-18T22:31:38.731754+0000","last_became_active":"2024-08-18T22:31:37.741561+0000","last_became_peered":"2024-08-18T22:31:37.741561+0000","last_unstale":"2024-08-18T22:31:38.731754+0000","last_undegraded":"2024-08-18T22:31:38.731754+0000","last_fullsized":"2024-08-18T22:31:38.731754+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:41:31.590092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.720750+0000","last_change":"2024-08-18T22:31:36.733858+0000","last_active":"2024-08-18T22:31:37.720750+0000","last_peered":"2024-08-18T22:31:37.720750+0000","last_clean":"2024-08-18T22:31:37.720750+0000","last_became_active":"2024-08-18T22:31:36.733567+0000","last_became_peered":"2024-08-18T22:31:36.733567+0000","last_unstale":"2024-08-18T22:31:37.720750+0000","last_undegraded":"2024-08-18T22:31:37.720750+0000","last_fullsized":"2024-08-18T22:31:37.720750+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:26:51.869900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.741276+0000","last_change":"2024-08-18T22:31:37.735239+0000","last_active":"2024-08-18T22:31:37.741276+0000","last_peered":"2024-08-18T22:31:37.741276+0000","last_clean":"2024-08-18T22:31:37.741276+0000","last_became_active":"2024-08-18T22:31:37.734950+0000","last_became_peered":"2024-08-18T22:31:37.734950+0000","last_unstale":"2024-08-18T22:31:37.741276+0000","last_undegraded":"2024-08-18T22:31:37.741276+0000","last_fullsized":"2024-08-18T22:31:37.741276+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:33:47.549857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.717470+0000","last_change":"2024-08-18T22:31:36.724981+0000","last_active":"2024-08-18T22:31:37.717470+0000","last_peered":"2024-08-18T22:31:37.717470+0000","last_clean":"2024-08-18T22:31:37.717470+0000","last_became_active":"2024-08-18T22:31:36.724644+0000","last_became_peered":"2024-08-18T22:31:36.724644+0000","last_unstale":"2024-08-18T22:31:37.717470+0000","last_undegraded":"2024-08-18T22:31:37.717470+0000","last_fullsized":"2024-08-18T22:31:37.717470+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:42.579698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":488,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731488+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:31:38.731488+0000","last_peered":"2024-08-18T22:31:38.731488+0000","last_clean":"2024-08-18T22:31:38.731488+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:31:38.731488+0000","last_undegraded":"2024-08-18T22:31:38.731488+0000","last_fullsized":"2024-08-18T22:31:38.731488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509593,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51972,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319868,"statfs":{"total":96636764160,"available":96583544832,"internally_reserved":0,"allocated":2801664,"data_stored":1632677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509595,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51388,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320452,"statfs":{"total":96636764160,"available":96584142848,"internally_reserved":0,"allocated":2211840,"data_stored":1042379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509593,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51400,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320440,"statfs":{"total":96636764160,"available":96584130560,"internally_reserved":0,"allocated":2224128,"data_stored":1043943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509594,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63876,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307964,"statfs":{"total":96636764160,"available":96571355136,"internally_reserved":0,"allocated":2215936,"data_stored":1042469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63868,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307972,"statfs":{"total":96636764160,"available":96571363328,"internally_reserved":0,"allocated":2207744,"data_stored":1042309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509594,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56144,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315696,"statfs":{"total":96636764160,"available":96579272704,"internally_reserved":0,"allocated":2818048,"data_stored":1633405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59736,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312104,"statfs":{"total":96636764160,"available":96575594496,"internally_reserved":0,"allocated":2236416,"data_stored":1050647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55560,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316280,"statfs":{"total":96636764160,"available":96579870720,"internally_reserved":0,"allocated":2224128,"data_stored":1049583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:31:41.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:31:42.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.031+0000 7f2b03000640 1 Processor -- start 2024-08-18T22:31:42.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.031+0000 7f2b03000640 1 -- start start 2024-08-18T22:31:42.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2b03000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2afc0cb390 0x7f2afc0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2b03000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc06da70 0x7f2afc06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2b03000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2afc073c80 con 0x7f2afc15bed0 2024-08-18T22:31:42.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2b03000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2afc06e420 con 0x7f2afc0cb390 2024-08-18T22:31:42.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2b03000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2afc0ca5d0 con 0x7f2afc06da70 2024-08-18T22:31:42.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2afb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2afc0cb390 0x7f2afc0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2afb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2afc0cb390 0x7f2afc0735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57818/0 (socket says 172.21.15.5:57818) 2024-08-18T22:31:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2afb400640 1 -- 172.21.15.5:0/349736758 learned_addr learned my addr 172.21.15.5:0/349736758 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2b01000640 1 --2- 172.21.15.5:0/349736758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc06da70 0x7f2afc06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2afb400640 1 -- 172.21.15.5:0/349736758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc06da70 msgr2=0x7f2afc06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2afb400640 1 --2- 172.21.15.5:0/349736758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc06da70 0x7f2afc06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2afb400640 1 -- 172.21.15.5:0/349736758 >> v1:172.21.15.5:6789/0 conn(0x7f2afc15bed0 legacy=0x7f2afc071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.035+0000 7f2afb400640 1 -- 172.21.15.5:0/349736758 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc0ca8b0 con 0x7f2afc0cb390 2024-08-18T22:31:42.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2afb400640 1 --2- 172.21.15.5:0/349736758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc0cb390 0x7f2afc0735a0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009870 tx=0x7f2ae801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5272004a2b4f9ee server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:42.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2afaa00640 1 -- 172.21.15.5:0/349736758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80a95f0 con 0x7f2afc0cb390 2024-08-18T22:31:42.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2afaa00640 1 -- 172.21.15.5:0/349736758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae80a9790 con 0x7f2afc0cb390 2024-08-18T22:31:42.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2afaa00640 1 -- 172.21.15.5:0/349736758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80a9b60 con 0x7f2afc0cb390 2024-08-18T22:31:42.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2b03000640 1 -- 172.21.15.5:0/349736758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc0cb390 msgr2=0x7f2afc0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2b03000640 1 --2- 172.21.15.5:0/349736758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc0cb390 0x7f2afc0735a0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009870 tx=0x7f2ae801c530 comp rx=0 tx=0).stop 2024-08-18T22:31:42.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2b03000640 1 -- 172.21.15.5:0/349736758 shutdown_connections 2024-08-18T22:31:42.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2b03000640 1 --2- 172.21.15.5:0/349736758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc06da70 0x7f2afc06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2b03000640 1 --2- 172.21.15.5:0/349736758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc0cb390 0x7f2afc0735a0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2b03000640 1 -- 172.21.15.5:0/349736758 >> 172.21.15.5:0/349736758 conn(0x7f2afc0b1c50 msgr2=0x7f2afc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:42.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2b03000640 1 -- 172.21.15.5:0/349736758 shutdown_connections 2024-08-18T22:31:42.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2b03000640 1 -- 172.21.15.5:0/349736758 wait complete. 2024-08-18T22:31:42.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2b03000640 1 Processor -- start 2024-08-18T22:31:42.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.039+0000 7f2b03000640 1 -- start start 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b03000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc06da70 0x7f2afc0b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b03000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0cb390 0x7f2afc0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b03000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc15bed0 0x7f2afc09cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b03000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc168520 con 0x7f2afc15bed0 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b03000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc1683a0 con 0x7f2afc06da70 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b03000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2afc1686a0 con 0x7f2afc0cb390 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b01000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc15bed0 0x7f2afc09cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b01000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc15bed0 0x7f2afc09cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57824/0 (socket says 172.21.15.5:57824) 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b01000640 1 -- 172.21.15.5:0/2434305550 learned_addr learned my addr 172.21.15.5:0/2434305550 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2afb400640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0cb390 0x7f2afc0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2afbe00640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc06da70 0x7f2afc0b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b01000640 1 -- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0cb390 msgr2=0x7f2afc0b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b01000640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0cb390 0x7f2afc0b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b01000640 1 -- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc06da70 msgr2=0x7f2afc0b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b01000640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc06da70 0x7f2afc0b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b01000640 1 -- 172.21.15.5:0/2434305550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc1594d0 con 0x7f2afc15bed0 2024-08-18T22:31:42.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2afb400640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0cb390 0x7f2afc0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:42.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2afbe00640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc06da70 0x7f2afc0b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:42.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b01000640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc15bed0 0x7f2afc09cf20 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f2af400d560 tx=0x7f2af400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:42.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2af3e00640 1 -- 172.21.15.5:0/2434305550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af40125f0 con 0x7f2afc15bed0 2024-08-18T22:31:42.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2af3e00640 1 -- 172.21.15.5:0/2434305550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af4019070 con 0x7f2afc15bed0 2024-08-18T22:31:42.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b03000640 1 -- 172.21.15.5:0/2434305550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2afc0b3810 con 0x7f2afc15bed0 2024-08-18T22:31:42.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2af3e00640 1 -- 172.21.15.5:0/2434305550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af40129f0 con 0x7f2afc15bed0 2024-08-18T22:31:42.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b03000640 1 -- 172.21.15.5:0/2434305550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2afc159790 con 0x7f2afc15bed0 2024-08-18T22:31:42.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2b03000640 1 -- 172.21.15.5:0/2434305550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2afc06dee0 con 0x7f2afc15bed0 2024-08-18T22:31:42.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.043+0000 7f2af3e00640 1 -- 172.21.15.5:0/2434305550 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2af4012b90 con 0x7f2afc15bed0 2024-08-18T22:31:42.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.047+0000 7f2af3e00640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2adc0678c0 0x7f2adc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.047+0000 7f2af3e00640 1 -- 172.21.15.5:0/2434305550 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f2af4086300 con 0x7f2afc15bed0 2024-08-18T22:31:42.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.047+0000 7f2afbe00640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2adc0678c0 0x7f2adc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.047+0000 7f2afbe00640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2adc0678c0 0x7f2adc069d80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f2aec001e10 tx=0x7f2aec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.051+0000 7f2af3e00640 1 -- 172.21.15.5:0/2434305550 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2af4056c10 con 0x7f2afc15bed0 2024-08-18T22:31:42.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.211+0000 7f2b03000640 1 -- 172.21.15.5:0/2434305550 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2afc0b21d0 con 0x7f2adc0678c0 2024-08-18T22:31:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2af3e00640 1 -- 172.21.15.5:0/2434305550 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252456 (secure 0 0 0) 0x7f2afc0b21d0 con 0x7f2adc0678c0 2024-08-18T22:31:42.222 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:31:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 -- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2adc0678c0 msgr2=0x7f2adc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2adc0678c0 0x7f2adc069d80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f2aec001e10 tx=0x7f2aec009040 comp rx=0 tx=0).stop 2024-08-18T22:31:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 -- 172.21.15.5:0/2434305550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc15bed0 msgr2=0x7f2afc09cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc15bed0 0x7f2afc09cf20 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f2af400d560 tx=0x7f2af400da20 comp rx=0 tx=0).stop 2024-08-18T22:31:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 -- 172.21.15.5:0/2434305550 shutdown_connections 2024-08-18T22:31:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2adc0678c0 0x7f2adc069d80 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2afc15bed0 0x7f2afc09cf20 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2afc0cb390 0x7f2afc0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 --2- 172.21.15.5:0/2434305550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc06da70 0x7f2afc0b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 -- 172.21.15.5:0/2434305550 >> 172.21.15.5:0/2434305550 conn(0x7f2afc0b1c50 msgr2=0x7f2afc0cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 -- 172.21.15.5:0/2434305550 shutdown_connections 2024-08-18T22:31:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.223+0000 7f2b03000640 1 -- 172.21.15.5:0/2434305550 wait complete. 2024-08-18T22:31:42.244 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2024-08-18T22:31:41.802121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":453944,"kb_used_data":18496,"kb_used_omap":12,"kb_used_meta":435315,"kb_avail":754520776,"statfs":{"total":773094113280,"available":772629274624,"internally_reserved":0,"allocated":18939904,"data_stored":9537412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":445763120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001235"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.742943+0000","last_change":"2024-08-18T22:31:37.736647+0000","last_active":"2024-08-18T22:31:37.742943+0000","last_peered":"2024-08-18T22:31:37.742943+0000","last_clean":"2024-08-18T22:31:37.742943+0000","last_became_active":"2024-08-18T22:31:37.736356+0000","last_became_peered":"2024-08-18T22:31:37.736356+0000","last_unstale":"2024-08-18T22:31:37.742943+0000","last_undegraded":"2024-08-18T22:31:37.742943+0000","last_fullsized":"2024-08-18T22:31:37.742943+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:55:17.635407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.749699+0000","last_change":"2024-08-18T22:31:37.748330+0000","last_active":"2024-08-18T22:31:37.749699+0000","last_peered":"2024-08-18T22:31:37.749699+0000","last_clean":"2024-08-18T22:31:37.749699+0000","last_became_active":"2024-08-18T22:31:37.748062+0000","last_became_peered":"2024-08-18T22:31:37.748062+0000","last_unstale":"2024-08-18T22:31:37.749699+0000","last_undegraded":"2024-08-18T22:31:37.749699+0000","last_fullsized":"2024-08-18T22:31:37.749699+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:22:18.109539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.737822+0000","last_change":"2024-08-18T22:31:37.725612+0000","last_active":"2024-08-18T22:31:37.737822+0000","last_peered":"2024-08-18T22:31:37.737822+0000","last_clean":"2024-08-18T22:31:37.737822+0000","last_became_active":"2024-08-18T22:31:37.725287+0000","last_became_peered":"2024-08-18T22:31:37.725287+0000","last_unstale":"2024-08-18T22:31:37.737822+0000","last_undegraded":"2024-08-18T22:31:37.737822+0000","last_fullsized":"2024-08-18T22:31:37.737822+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:14:22.710178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.735775+0000","last_change":"2024-08-18T22:31:37.729007+0000","last_active":"2024-08-18T22:31:37.735775+0000","last_peered":"2024-08-18T22:31:37.735775+0000","last_clean":"2024-08-18T22:31:37.735775+0000","last_became_active":"2024-08-18T22:31:37.728699+0000","last_became_peered":"2024-08-18T22:31:37.728699+0000","last_unstale":"2024-08-18T22:31:37.735775+0000","last_undegraded":"2024-08-18T22:31:37.735775+0000","last_fullsized":"2024-08-18T22:31:37.735775+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:22:41.217296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728338+0000","last_change":"2024-08-18T22:31:37.750394+0000","last_active":"2024-08-18T22:31:38.728338+0000","last_peered":"2024-08-18T22:31:38.728338+0000","last_clean":"2024-08-18T22:31:38.728338+0000","last_became_active":"2024-08-18T22:31:37.749961+0000","last_became_peered":"2024-08-18T22:31:37.749961+0000","last_unstale":"2024-08-18T22:31:38.728338+0000","last_undegraded":"2024-08-18T22:31:38.728338+0000","last_fullsized":"2024-08-18T22:31:38.728338+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:45.211718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728192+0000","last_change":"2024-08-18T22:31:37.750993+0000","last_active":"2024-08-18T22:31:38.728192+0000","last_peered":"2024-08-18T22:31:38.728192+0000","last_clean":"2024-08-18T22:31:38.728192+0000","last_became_active":"2024-08-18T22:31:37.750484+0000","last_became_peered":"2024-08-18T22:31:37.750484+0000","last_unstale":"2024-08-18T22:31:38.728192+0000","last_undegraded":"2024-08-18T22:31:38.728192+0000","last_fullsized":"2024-08-18T22:31:38.728192+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:07.218406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901213+0000","last_change":"2024-08-18T22:31:37.735436+0000","last_active":"2024-08-18T22:31:38.901213+0000","last_peered":"2024-08-18T22:31:38.901213+0000","last_clean":"2024-08-18T22:31:38.901213+0000","last_became_active":"2024-08-18T22:31:37.735007+0000","last_became_peered":"2024-08-18T22:31:37.735007+0000","last_unstale":"2024-08-18T22:31:38.901213+0000","last_undegraded":"2024-08-18T22:31:38.901213+0000","last_fullsized":"2024-08-18T22:31:38.901213+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:03:25.734294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731573+0000","last_change":"2024-08-18T22:31:37.730412+0000","last_active":"2024-08-18T22:31:38.731573+0000","last_peered":"2024-08-18T22:31:38.731573+0000","last_clean":"2024-08-18T22:31:38.731573+0000","last_became_active":"2024-08-18T22:31:37.730112+0000","last_became_peered":"2024-08-18T22:31:37.730112+0000","last_unstale":"2024-08-18T22:31:38.731573+0000","last_undegraded":"2024-08-18T22:31:38.731573+0000","last_fullsized":"2024-08-18T22:31:38.731573+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:46:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.736780+0000","last_change":"2024-08-18T22:31:37.732206+0000","last_active":"2024-08-18T22:31:37.736780+0000","last_peered":"2024-08-18T22:31:37.736780+0000","last_clean":"2024-08-18T22:31:37.736780+0000","last_became_active":"2024-08-18T22:31:37.731904+0000","last_became_peered":"2024-08-18T22:31:37.731904+0000","last_unstale":"2024-08-18T22:31:37.736780+0000","last_undegraded":"2024-08-18T22:31:37.736780+0000","last_fullsized":"2024-08-18T22:31:37.736780+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:44.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728625+0000","last_change":"2024-08-18T22:31:37.750599+0000","last_active":"2024-08-18T22:31:38.728625+0000","last_peered":"2024-08-18T22:31:38.728625+0000","last_clean":"2024-08-18T22:31:38.728625+0000","last_became_active":"2024-08-18T22:31:37.746079+0000","last_became_peered":"2024-08-18T22:31:37.746079+0000","last_unstale":"2024-08-18T22:31:38.728625+0000","last_undegraded":"2024-08-18T22:31:38.728625+0000","last_fullsized":"2024-08-18T22:31:38.728625+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:20.188575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.747003+0000","last_change":"2024-08-18T22:31:37.743562+0000","last_active":"2024-08-18T22:31:37.747003+0000","last_peered":"2024-08-18T22:31:37.747003+0000","last_clean":"2024-08-18T22:31:37.747003+0000","last_became_active":"2024-08-18T22:31:37.742492+0000","last_became_peered":"2024-08-18T22:31:37.742492+0000","last_unstale":"2024-08-18T22:31:37.747003+0000","last_undegraded":"2024-08-18T22:31:37.747003+0000","last_fullsized":"2024-08-18T22:31:37.747003+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:55:17.635407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.737119+0000","last_change":"2024-08-18T22:31:37.736027+0000","last_active":"2024-08-18T22:31:37.737119+0000","last_peered":"2024-08-18T22:31:37.737119+0000","last_clean":"2024-08-18T22:31:37.737119+0000","last_became_active":"2024-08-18T22:31:37.731251+0000","last_became_peered":"2024-08-18T22:31:37.731251+0000","last_unstale":"2024-08-18T22:31:37.737119+0000","last_undegraded":"2024-08-18T22:31:37.737119+0000","last_fullsized":"2024-08-18T22:31:37.737119+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:40.422128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730819+0000","last_change":"2024-08-18T22:31:37.728203+0000","last_active":"2024-08-18T22:31:38.730819+0000","last_peered":"2024-08-18T22:31:38.730819+0000","last_clean":"2024-08-18T22:31:38.730819+0000","last_became_active":"2024-08-18T22:31:37.727878+0000","last_became_peered":"2024-08-18T22:31:37.727878+0000","last_unstale":"2024-08-18T22:31:38.730819+0000","last_undegraded":"2024-08-18T22:31:38.730819+0000","last_fullsized":"2024-08-18T22:31:38.730819+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:07:11.812015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901278+0000","last_change":"2024-08-18T22:31:37.737727+0000","last_active":"2024-08-18T22:31:38.901278+0000","last_peered":"2024-08-18T22:31:38.901278+0000","last_clean":"2024-08-18T22:31:38.901278+0000","last_became_active":"2024-08-18T22:31:37.737395+0000","last_became_peered":"2024-08-18T22:31:37.737395+0000","last_unstale":"2024-08-18T22:31:38.901278+0000","last_undegraded":"2024-08-18T22:31:38.901278+0000","last_fullsized":"2024-08-18T22:31:38.901278+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:03:24.315995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.735929+0000","last_change":"2024-08-18T22:31:37.732467+0000","last_active":"2024-08-18T22:31:37.735929+0000","last_peered":"2024-08-18T22:31:37.735929+0000","last_clean":"2024-08-18T22:31:37.735929+0000","last_became_active":"2024-08-18T22:31:37.730478+0000","last_became_peered":"2024-08-18T22:31:37.730478+0000","last_unstale":"2024-08-18T22:31:37.735929+0000","last_undegraded":"2024-08-18T22:31:37.735929+0000","last_fullsized":"2024-08-18T22:31:37.735929+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:32:47.708683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728057+0000","last_change":"2024-08-18T22:31:37.749304+0000","last_active":"2024-08-18T22:31:38.728057+0000","last_peered":"2024-08-18T22:31:38.728057+0000","last_clean":"2024-08-18T22:31:38.728057+0000","last_became_active":"2024-08-18T22:31:37.747744+0000","last_became_peered":"2024-08-18T22:31:37.747744+0000","last_unstale":"2024-08-18T22:31:38.728057+0000","last_undegraded":"2024-08-18T22:31:38.728057+0000","last_fullsized":"2024-08-18T22:31:38.728057+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:06:39.191377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728783+0000","last_change":"2024-08-18T22:31:37.740347+0000","last_active":"2024-08-18T22:31:38.728783+0000","last_peered":"2024-08-18T22:31:38.728783+0000","last_clean":"2024-08-18T22:31:38.728783+0000","last_became_active":"2024-08-18T22:31:37.739960+0000","last_became_peered":"2024-08-18T22:31:37.739960+0000","last_unstale":"2024-08-18T22:31:38.728783+0000","last_undegraded":"2024-08-18T22:31:38.728783+0000","last_fullsized":"2024-08-18T22:31:38.728783+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:30:12.877666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731182+0000","last_change":"2024-08-18T22:31:37.738418+0000","last_active":"2024-08-18T22:31:38.731182+0000","last_peered":"2024-08-18T22:31:38.731182+0000","last_clean":"2024-08-18T22:31:38.731182+0000","last_became_active":"2024-08-18T22:31:37.737646+0000","last_became_peered":"2024-08-18T22:31:37.737646+0000","last_unstale":"2024-08-18T22:31:38.731182+0000","last_undegraded":"2024-08-18T22:31:38.731182+0000","last_fullsized":"2024-08-18T22:31:38.731182+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:29:59.147032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731135+0000","last_change":"2024-08-18T22:31:37.736394+0000","last_active":"2024-08-18T22:31:38.731135+0000","last_peered":"2024-08-18T22:31:38.731135+0000","last_clean":"2024-08-18T22:31:38.731135+0000","last_became_active":"2024-08-18T22:31:37.735597+0000","last_became_peered":"2024-08-18T22:31:37.735597+0000","last_unstale":"2024-08-18T22:31:38.731135+0000","last_undegraded":"2024-08-18T22:31:38.731135+0000","last_fullsized":"2024-08-18T22:31:38.731135+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:17:35.234457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728308+0000","last_change":"2024-08-18T22:31:37.736635+0000","last_active":"2024-08-18T22:31:38.728308+0000","last_peered":"2024-08-18T22:31:38.728308+0000","last_clean":"2024-08-18T22:31:38.728308+0000","last_became_active":"2024-08-18T22:31:37.734950+0000","last_became_peered":"2024-08-18T22:31:37.734950+0000","last_unstale":"2024-08-18T22:31:38.728308+0000","last_undegraded":"2024-08-18T22:31:38.728308+0000","last_fullsized":"2024-08-18T22:31:38.728308+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:39.349927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.739931+0000","last_change":"2024-08-18T22:31:37.732535+0000","last_active":"2024-08-18T22:31:37.739931+0000","last_peered":"2024-08-18T22:31:37.739931+0000","last_clean":"2024-08-18T22:31:37.739931+0000","last_became_active":"2024-08-18T22:31:37.732224+0000","last_became_peered":"2024-08-18T22:31:37.732224+0000","last_unstale":"2024-08-18T22:31:37.739931+0000","last_undegraded":"2024-08-18T22:31:37.739931+0000","last_fullsized":"2024-08-18T22:31:37.739931+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:37.295450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.743567+0000","last_change":"2024-08-18T22:31:37.737778+0000","last_active":"2024-08-18T22:31:37.743567+0000","last_peered":"2024-08-18T22:31:37.743567+0000","last_clean":"2024-08-18T22:31:37.743567+0000","last_became_active":"2024-08-18T22:31:37.737493+0000","last_became_peered":"2024-08-18T22:31:37.737493+0000","last_unstale":"2024-08-18T22:31:37.743567+0000","last_undegraded":"2024-08-18T22:31:37.743567+0000","last_fullsized":"2024-08-18T22:31:37.743567+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:31.728259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.732272+0000","last_change":"2024-08-18T22:31:37.740540+0000","last_active":"2024-08-18T22:31:38.732272+0000","last_peered":"2024-08-18T22:31:38.732272+0000","last_clean":"2024-08-18T22:31:38.732272+0000","last_became_active":"2024-08-18T22:31:37.740264+0000","last_became_peered":"2024-08-18T22:31:37.740264+0000","last_unstale":"2024-08-18T22:31:38.732272+0000","last_undegraded":"2024-08-18T22:31:38.732272+0000","last_fullsized":"2024-08-18T22:31:38.732272+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:20:41.506303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.743015+0000","last_change":"2024-08-18T22:31:37.738419+0000","last_active":"2024-08-18T22:31:37.743015+0000","last_peered":"2024-08-18T22:31:37.743015+0000","last_clean":"2024-08-18T22:31:37.743015+0000","last_became_active":"2024-08-18T22:31:37.737304+0000","last_became_peered":"2024-08-18T22:31:37.737304+0000","last_unstale":"2024-08-18T22:31:37.743015+0000","last_undegraded":"2024-08-18T22:31:37.743015+0000","last_fullsized":"2024-08-18T22:31:37.743015+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:34:07.961843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901531+0000","last_change":"2024-08-18T22:31:37.743843+0000","last_active":"2024-08-18T22:31:38.901531+0000","last_peered":"2024-08-18T22:31:38.901531+0000","last_clean":"2024-08-18T22:31:38.901531+0000","last_became_active":"2024-08-18T22:31:37.743514+0000","last_became_peered":"2024-08-18T22:31:37.743514+0000","last_unstale":"2024-08-18T22:31:38.901531+0000","last_undegraded":"2024-08-18T22:31:38.901531+0000","last_fullsized":"2024-08-18T22:31:38.901531+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:40:46.759293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.755129+0000","last_change":"2024-08-18T22:31:37.751938+0000","last_active":"2024-08-18T22:31:37.755129+0000","last_peered":"2024-08-18T22:31:37.755129+0000","last_clean":"2024-08-18T22:31:37.755129+0000","last_became_active":"2024-08-18T22:31:37.751668+0000","last_became_peered":"2024-08-18T22:31:37.751668+0000","last_unstale":"2024-08-18T22:31:37.755129+0000","last_undegraded":"2024-08-18T22:31:37.755129+0000","last_fullsized":"2024-08-18T22:31:37.755129+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:34:07.961843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731855+0000","last_change":"2024-08-18T22:31:37.728454+0000","last_active":"2024-08-18T22:31:38.731855+0000","last_peered":"2024-08-18T22:31:38.731855+0000","last_clean":"2024-08-18T22:31:38.731855+0000","last_became_active":"2024-08-18T22:31:37.728191+0000","last_became_peered":"2024-08-18T22:31:37.728191+0000","last_unstale":"2024-08-18T22:31:38.731855+0000","last_undegraded":"2024-08-18T22:31:38.731855+0000","last_fullsized":"2024-08-18T22:31:38.731855+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:23:16.333040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728363+0000","last_change":"2024-08-18T22:31:37.745355+0000","last_active":"2024-08-18T22:31:38.728363+0000","last_peered":"2024-08-18T22:31:38.728363+0000","last_clean":"2024-08-18T22:31:38.728363+0000","last_became_active":"2024-08-18T22:31:37.745073+0000","last_became_peered":"2024-08-18T22:31:37.745073+0000","last_unstale":"2024-08-18T22:31:38.728363+0000","last_undegraded":"2024-08-18T22:31:38.728363+0000","last_fullsized":"2024-08-18T22:31:38.728363+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:16:19.456244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.746820+0000","last_change":"2024-08-18T22:31:37.742602+0000","last_active":"2024-08-18T22:31:37.746820+0000","last_peered":"2024-08-18T22:31:37.746820+0000","last_clean":"2024-08-18T22:31:37.746820+0000","last_became_active":"2024-08-18T22:31:37.742333+0000","last_became_peered":"2024-08-18T22:31:37.742333+0000","last_unstale":"2024-08-18T22:31:37.746820+0000","last_undegraded":"2024-08-18T22:31:37.746820+0000","last_fullsized":"2024-08-18T22:31:37.746820+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:37.295450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.746819+0000","last_change":"2024-08-18T22:31:37.743422+0000","last_active":"2024-08-18T22:31:37.746819+0000","last_peered":"2024-08-18T22:31:37.746819+0000","last_clean":"2024-08-18T22:31:37.746819+0000","last_became_active":"2024-08-18T22:31:37.742381+0000","last_became_peered":"2024-08-18T22:31:37.742381+0000","last_unstale":"2024-08-18T22:31:37.746819+0000","last_undegraded":"2024-08-18T22:31:37.746819+0000","last_fullsized":"2024-08-18T22:31:37.746819+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:21.952522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901176+0000","last_change":"2024-08-18T22:31:37.739997+0000","last_active":"2024-08-18T22:31:38.901176+0000","last_peered":"2024-08-18T22:31:38.901176+0000","last_clean":"2024-08-18T22:31:38.901176+0000","last_became_active":"2024-08-18T22:31:37.739685+0000","last_became_peered":"2024-08-18T22:31:37.739685+0000","last_unstale":"2024-08-18T22:31:38.901176+0000","last_undegraded":"2024-08-18T22:31:38.901176+0000","last_fullsized":"2024-08-18T22:31:38.901176+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:32:29.741988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728132+0000","last_change":"2024-08-18T22:31:37.746994+0000","last_active":"2024-08-18T22:31:38.728132+0000","last_peered":"2024-08-18T22:31:38.728132+0000","last_clean":"2024-08-18T22:31:38.728132+0000","last_became_active":"2024-08-18T22:31:37.746717+0000","last_became_peered":"2024-08-18T22:31:37.746717+0000","last_unstale":"2024-08-18T22:31:38.728132+0000","last_undegraded":"2024-08-18T22:31:38.728132+0000","last_fullsized":"2024-08-18T22:31:38.728132+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:57:40.406251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.732131+0000","last_change":"2024-08-18T22:31:37.726729+0000","last_active":"2024-08-18T22:31:38.732131+0000","last_peered":"2024-08-18T22:31:38.732131+0000","last_clean":"2024-08-18T22:31:38.732131+0000","last_became_active":"2024-08-18T22:31:37.722318+0000","last_became_peered":"2024-08-18T22:31:37.722318+0000","last_unstale":"2024-08-18T22:31:38.732131+0000","last_undegraded":"2024-08-18T22:31:38.732131+0000","last_fullsized":"2024-08-18T22:31:38.732131+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:04.727886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"176'4","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.738100+0000","last_change":"2024-08-18T22:31:36.729582+0000","last_active":"2024-08-18T22:31:37.738100+0000","last_peered":"2024-08-18T22:31:37.738100+0000","last_clean":"2024-08-18T22:31:37.738100+0000","last_became_active":"2024-08-18T22:31:36.729256+0000","last_became_peered":"2024-08-18T22:31:36.729256+0000","last_unstale":"2024-08-18T22:31:37.738100+0000","last_undegraded":"2024-08-18T22:31:37.738100+0000","last_fullsized":"2024-08-18T22:31:37.738100+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:45.186613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901605+0000","last_change":"2024-08-18T22:31:37.733013+0000","last_active":"2024-08-18T22:31:38.901605+0000","last_peered":"2024-08-18T22:31:38.901605+0000","last_clean":"2024-08-18T22:31:38.901605+0000","last_became_active":"2024-08-18T22:31:37.732718+0000","last_became_peered":"2024-08-18T22:31:37.732718+0000","last_unstale":"2024-08-18T22:31:38.901605+0000","last_undegraded":"2024-08-18T22:31:38.901605+0000","last_fullsized":"2024-08-18T22:31:38.901605+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:02.083243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"176'1","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728733+0000","last_change":"2024-08-18T22:31:36.735137+0000","last_active":"2024-08-18T22:31:38.728733+0000","last_peered":"2024-08-18T22:31:38.728733+0000","last_clean":"2024-08-18T22:31:38.728733+0000","last_became_active":"2024-08-18T22:31:36.733429+0000","last_became_peered":"2024-08-18T22:31:36.733429+0000","last_unstale":"2024-08-18T22:31:38.728733+0000","last_undegraded":"2024-08-18T22:31:38.728733+0000","last_fullsized":"2024-08-18T22:31:38.728733+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:38:56.910744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.746670+0000","last_change":"2024-08-18T22:31:37.739515+0000","last_active":"2024-08-18T22:31:37.746670+0000","last_peered":"2024-08-18T22:31:37.746670+0000","last_clean":"2024-08-18T22:31:37.746670+0000","last_became_active":"2024-08-18T22:31:37.738983+0000","last_became_peered":"2024-08-18T22:31:37.738983+0000","last_unstale":"2024-08-18T22:31:37.746670+0000","last_undegraded":"2024-08-18T22:31:37.746670+0000","last_fullsized":"2024-08-18T22:31:37.746670+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:32:47.708683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"176'2","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.746954+0000","last_change":"2024-08-18T22:31:36.725872+0000","last_active":"2024-08-18T22:31:37.746954+0000","last_peered":"2024-08-18T22:31:37.746954+0000","last_clean":"2024-08-18T22:31:37.746954+0000","last_became_active":"2024-08-18T22:31:36.725433+0000","last_became_peered":"2024-08-18T22:31:36.725433+0000","last_unstale":"2024-08-18T22:31:37.746954+0000","last_undegraded":"2024-08-18T22:31:37.746954+0000","last_fullsized":"2024-08-18T22:31:37.746954+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:04.776915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.741294+0000","last_change":"2024-08-18T22:31:37.736904+0000","last_active":"2024-08-18T22:31:37.741294+0000","last_peered":"2024-08-18T22:31:37.741294+0000","last_clean":"2024-08-18T22:31:37.741294+0000","last_became_active":"2024-08-18T22:31:37.736528+0000","last_became_peered":"2024-08-18T22:31:37.736528+0000","last_unstale":"2024-08-18T22:31:37.741294+0000","last_undegraded":"2024-08-18T22:31:37.741294+0000","last_fullsized":"2024-08-18T22:31:37.741294+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:38:12.565673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"176'2","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730799+0000","last_change":"2024-08-18T22:31:36.729158+0000","last_active":"2024-08-18T22:31:38.730799+0000","last_peered":"2024-08-18T22:31:38.730799+0000","last_clean":"2024-08-18T22:31:38.730799+0000","last_became_active":"2024-08-18T22:31:36.728858+0000","last_became_peered":"2024-08-18T22:31:36.728858+0000","last_unstale":"2024-08-18T22:31:38.730799+0000","last_undegraded":"2024-08-18T22:31:38.730799+0000","last_fullsized":"2024-08-18T22:31:38.730799+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:57:51.922520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730344+0000","last_change":"2024-08-18T22:31:37.738755+0000","last_active":"2024-08-18T22:31:38.730344+0000","last_peered":"2024-08-18T22:31:38.730344+0000","last_clean":"2024-08-18T22:31:38.730344+0000","last_became_active":"2024-08-18T22:31:37.738471+0000","last_became_peered":"2024-08-18T22:31:37.738471+0000","last_unstale":"2024-08-18T22:31:38.730344+0000","last_undegraded":"2024-08-18T22:31:38.730344+0000","last_fullsized":"2024-08-18T22:31:38.730344+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:01.753579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"176'1","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728480+0000","last_change":"2024-08-18T22:31:36.733521+0000","last_active":"2024-08-18T22:31:38.728480+0000","last_peered":"2024-08-18T22:31:38.728480+0000","last_clean":"2024-08-18T22:31:38.728480+0000","last_became_active":"2024-08-18T22:31:36.733210+0000","last_became_peered":"2024-08-18T22:31:36.733210+0000","last_unstale":"2024-08-18T22:31:38.728480+0000","last_undegraded":"2024-08-18T22:31:38.728480+0000","last_fullsized":"2024-08-18T22:31:38.728480+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:11.659058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.742872+0000","last_change":"2024-08-18T22:31:37.732241+0000","last_active":"2024-08-18T22:31:37.742872+0000","last_peered":"2024-08-18T22:31:37.742872+0000","last_clean":"2024-08-18T22:31:37.742872+0000","last_became_active":"2024-08-18T22:31:37.731951+0000","last_became_peered":"2024-08-18T22:31:37.731951+0000","last_unstale":"2024-08-18T22:31:37.742872+0000","last_undegraded":"2024-08-18T22:31:37.742872+0000","last_fullsized":"2024-08-18T22:31:37.742872+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:56:05.780197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"176'1","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.744590+0000","last_change":"2024-08-18T22:31:36.735101+0000","last_active":"2024-08-18T22:31:37.744590+0000","last_peered":"2024-08-18T22:31:37.744590+0000","last_clean":"2024-08-18T22:31:37.744590+0000","last_became_active":"2024-08-18T22:31:36.734702+0000","last_became_peered":"2024-08-18T22:31:36.734702+0000","last_unstale":"2024-08-18T22:31:37.744590+0000","last_undegraded":"2024-08-18T22:31:37.744590+0000","last_fullsized":"2024-08-18T22:31:37.744590+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:19:55.692859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.744339+0000","last_change":"2024-08-18T22:31:37.741194+0000","last_active":"2024-08-18T22:31:37.744339+0000","last_peered":"2024-08-18T22:31:37.744339+0000","last_clean":"2024-08-18T22:31:37.744339+0000","last_became_active":"2024-08-18T22:31:37.740272+0000","last_became_peered":"2024-08-18T22:31:37.740272+0000","last_unstale":"2024-08-18T22:31:37.744339+0000","last_undegraded":"2024-08-18T22:31:37.744339+0000","last_fullsized":"2024-08-18T22:31:37.744339+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:28.484407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730499+0000","last_change":"2024-08-18T22:31:36.721961+0000","last_active":"2024-08-18T22:31:38.730499+0000","last_peered":"2024-08-18T22:31:38.730499+0000","last_clean":"2024-08-18T22:31:38.730499+0000","last_became_active":"2024-08-18T22:31:36.721685+0000","last_became_peered":"2024-08-18T22:31:36.721685+0000","last_unstale":"2024-08-18T22:31:38.730499+0000","last_undegraded":"2024-08-18T22:31:38.730499+0000","last_fullsized":"2024-08-18T22:31:38.730499+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:04.980631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.732223+0000","last_change":"2024-08-18T22:31:37.730732+0000","last_active":"2024-08-18T22:31:38.732223+0000","last_peered":"2024-08-18T22:31:38.732223+0000","last_clean":"2024-08-18T22:31:38.732223+0000","last_became_active":"2024-08-18T22:31:37.729598+0000","last_became_peered":"2024-08-18T22:31:37.729598+0000","last_unstale":"2024-08-18T22:31:38.732223+0000","last_undegraded":"2024-08-18T22:31:38.732223+0000","last_fullsized":"2024-08-18T22:31:38.732223+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:16:00.536889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728830+0000","last_change":"2024-08-18T22:31:36.737289+0000","last_active":"2024-08-18T22:31:38.728830+0000","last_peered":"2024-08-18T22:31:38.728830+0000","last_clean":"2024-08-18T22:31:38.728830+0000","last_became_active":"2024-08-18T22:31:36.736982+0000","last_became_peered":"2024-08-18T22:31:36.736982+0000","last_unstale":"2024-08-18T22:31:38.728830+0000","last_undegraded":"2024-08-18T22:31:38.728830+0000","last_fullsized":"2024-08-18T22:31:38.728830+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:41:28.171750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728771+0000","last_change":"2024-08-18T22:31:37.743943+0000","last_active":"2024-08-18T22:31:38.728771+0000","last_peered":"2024-08-18T22:31:38.728771+0000","last_clean":"2024-08-18T22:31:38.728771+0000","last_became_active":"2024-08-18T22:31:37.743195+0000","last_became_peered":"2024-08-18T22:31:37.743195+0000","last_unstale":"2024-08-18T22:31:38.728771+0000","last_undegraded":"2024-08-18T22:31:38.728771+0000","last_fullsized":"2024-08-18T22:31:38.728771+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:19:28.281484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.720999+0000","last_change":"2024-08-18T22:31:36.739017+0000","last_active":"2024-08-18T22:31:37.720999+0000","last_peered":"2024-08-18T22:31:37.720999+0000","last_clean":"2024-08-18T22:31:37.720999+0000","last_became_active":"2024-08-18T22:31:36.738747+0000","last_became_peered":"2024-08-18T22:31:36.738747+0000","last_unstale":"2024-08-18T22:31:37.720999+0000","last_undegraded":"2024-08-18T22:31:37.720999+0000","last_fullsized":"2024-08-18T22:31:37.720999+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:35:24.192068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731204+0000","last_change":"2024-08-18T22:31:37.738621+0000","last_active":"2024-08-18T22:31:38.731204+0000","last_peered":"2024-08-18T22:31:38.731204+0000","last_clean":"2024-08-18T22:31:38.731204+0000","last_became_active":"2024-08-18T22:31:37.738334+0000","last_became_peered":"2024-08-18T22:31:37.738334+0000","last_unstale":"2024-08-18T22:31:38.731204+0000","last_undegraded":"2024-08-18T22:31:38.731204+0000","last_fullsized":"2024-08-18T22:31:38.731204+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:17:11.625333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"176'3","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.750233+0000","last_change":"2024-08-18T22:31:36.740381+0000","last_active":"2024-08-18T22:31:37.750233+0000","last_peered":"2024-08-18T22:31:37.750233+0000","last_clean":"2024-08-18T22:31:37.750233+0000","last_became_active":"2024-08-18T22:31:36.740089+0000","last_became_peered":"2024-08-18T22:31:36.740089+0000","last_unstale":"2024-08-18T22:31:37.750233+0000","last_undegraded":"2024-08-18T22:31:37.750233+0000","last_fullsized":"2024-08-18T22:31:37.750233+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:19:11.659058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.750073+0000","last_change":"2024-08-18T22:31:37.749266+0000","last_active":"2024-08-18T22:31:37.750073+0000","last_peered":"2024-08-18T22:31:37.750073+0000","last_clean":"2024-08-18T22:31:37.750073+0000","last_became_active":"2024-08-18T22:31:37.748912+0000","last_became_peered":"2024-08-18T22:31:37.748912+0000","last_unstale":"2024-08-18T22:31:37.750073+0000","last_undegraded":"2024-08-18T22:31:37.750073+0000","last_fullsized":"2024-08-18T22:31:37.750073+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:05.394538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"176'6","reported_seq":20,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730971+0000","last_change":"2024-08-18T22:31:36.726671+0000","last_active":"2024-08-18T22:31:38.730971+0000","last_peered":"2024-08-18T22:31:38.730971+0000","last_clean":"2024-08-18T22:31:38.730971+0000","last_became_active":"2024-08-18T22:31:36.726370+0000","last_became_peered":"2024-08-18T22:31:36.726370+0000","last_unstale":"2024-08-18T22:31:38.730971+0000","last_undegraded":"2024-08-18T22:31:38.730971+0000","last_fullsized":"2024-08-18T22:31:38.730971+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:04:52.420553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901204+0000","last_change":"2024-08-18T22:31:37.731600+0000","last_active":"2024-08-18T22:31:38.901204+0000","last_peered":"2024-08-18T22:31:38.901204+0000","last_clean":"2024-08-18T22:31:38.901204+0000","last_became_active":"2024-08-18T22:31:37.731324+0000","last_became_peered":"2024-08-18T22:31:37.731324+0000","last_unstale":"2024-08-18T22:31:38.901204+0000","last_undegraded":"2024-08-18T22:31:38.901204+0000","last_fullsized":"2024-08-18T22:31:38.901204+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:58:06.565861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"176'2","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730883+0000","last_change":"2024-08-18T22:31:36.724203+0000","last_active":"2024-08-18T22:31:38.730883+0000","last_peered":"2024-08-18T22:31:38.730883+0000","last_clean":"2024-08-18T22:31:38.730883+0000","last_became_active":"2024-08-18T22:31:36.723787+0000","last_became_peered":"2024-08-18T22:31:36.723787+0000","last_unstale":"2024-08-18T22:31:38.730883+0000","last_undegraded":"2024-08-18T22:31:38.730883+0000","last_fullsized":"2024-08-18T22:31:38.730883+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:32:39.375326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728092+0000","last_change":"2024-08-18T22:31:37.742227+0000","last_active":"2024-08-18T22:31:38.728092+0000","last_peered":"2024-08-18T22:31:38.728092+0000","last_clean":"2024-08-18T22:31:38.728092+0000","last_became_active":"2024-08-18T22:31:37.741942+0000","last_became_peered":"2024-08-18T22:31:37.741942+0000","last_unstale":"2024-08-18T22:31:38.728092+0000","last_undegraded":"2024-08-18T22:31:38.728092+0000","last_fullsized":"2024-08-18T22:31:38.728092+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:03:15.513896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.721703+0000","last_change":"2024-08-18T22:31:36.732427+0000","last_active":"2024-08-18T22:31:37.721703+0000","last_peered":"2024-08-18T22:31:37.721703+0000","last_clean":"2024-08-18T22:31:37.721703+0000","last_became_active":"2024-08-18T22:31:36.732160+0000","last_became_peered":"2024-08-18T22:31:36.732160+0000","last_unstale":"2024-08-18T22:31:37.721703+0000","last_undegraded":"2024-08-18T22:31:37.721703+0000","last_fullsized":"2024-08-18T22:31:37.721703+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:00.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730683+0000","last_change":"2024-08-18T22:31:37.732564+0000","last_active":"2024-08-18T22:31:38.730683+0000","last_peered":"2024-08-18T22:31:38.730683+0000","last_clean":"2024-08-18T22:31:38.730683+0000","last_became_active":"2024-08-18T22:31:37.731216+0000","last_became_peered":"2024-08-18T22:31:37.731216+0000","last_unstale":"2024-08-18T22:31:38.730683+0000","last_undegraded":"2024-08-18T22:31:38.730683+0000","last_fullsized":"2024-08-18T22:31:38.730683+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:43:09.852071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.718749+0000","last_change":"2024-08-18T22:31:36.726097+0000","last_active":"2024-08-18T22:31:37.718749+0000","last_peered":"2024-08-18T22:31:37.718749+0000","last_clean":"2024-08-18T22:31:37.718749+0000","last_became_active":"2024-08-18T22:31:36.724456+0000","last_became_peered":"2024-08-18T22:31:36.724456+0000","last_unstale":"2024-08-18T22:31:37.718749+0000","last_undegraded":"2024-08-18T22:31:37.718749+0000","last_fullsized":"2024-08-18T22:31:37.718749+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:38:56.910744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730845+0000","last_change":"2024-08-18T22:31:37.741499+0000","last_active":"2024-08-18T22:31:38.730845+0000","last_peered":"2024-08-18T22:31:38.730845+0000","last_clean":"2024-08-18T22:31:38.730845+0000","last_became_active":"2024-08-18T22:31:37.741186+0000","last_became_peered":"2024-08-18T22:31:37.741186+0000","last_unstale":"2024-08-18T22:31:38.730845+0000","last_undegraded":"2024-08-18T22:31:38.730845+0000","last_fullsized":"2024-08-18T22:31:38.730845+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:17.844421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"176'8","reported_seq":20,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.750542+0000","last_change":"2024-08-18T22:31:36.727719+0000","last_active":"2024-08-18T22:31:37.750542+0000","last_peered":"2024-08-18T22:31:37.750542+0000","last_clean":"2024-08-18T22:31:37.750542+0000","last_became_active":"2024-08-18T22:31:36.727400+0000","last_became_peered":"2024-08-18T22:31:36.727400+0000","last_unstale":"2024-08-18T22:31:37.750542+0000","last_undegraded":"2024-08-18T22:31:37.750542+0000","last_fullsized":"2024-08-18T22:31:37.750542+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:46:00.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901443+0000","last_change":"2024-08-18T22:31:37.740300+0000","last_active":"2024-08-18T22:31:38.901443+0000","last_peered":"2024-08-18T22:31:38.901443+0000","last_clean":"2024-08-18T22:31:38.901443+0000","last_became_active":"2024-08-18T22:31:37.740004+0000","last_became_peered":"2024-08-18T22:31:37.740004+0000","last_unstale":"2024-08-18T22:31:38.901443+0000","last_undegraded":"2024-08-18T22:31:38.901443+0000","last_fullsized":"2024-08-18T22:31:38.901443+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:54:49.606023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"176'1","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.748987+0000","last_change":"2024-08-18T22:31:36.730166+0000","last_active":"2024-08-18T22:31:37.748987+0000","last_peered":"2024-08-18T22:31:37.748987+0000","last_clean":"2024-08-18T22:31:37.748987+0000","last_became_active":"2024-08-18T22:31:36.729851+0000","last_became_peered":"2024-08-18T22:31:36.729851+0000","last_unstale":"2024-08-18T22:31:37.748987+0000","last_undegraded":"2024-08-18T22:31:37.748987+0000","last_fullsized":"2024-08-18T22:31:37.748987+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:24:48.022255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728538+0000","last_change":"2024-08-18T22:31:37.744155+0000","last_active":"2024-08-18T22:31:38.728538+0000","last_peered":"2024-08-18T22:31:38.728538+0000","last_clean":"2024-08-18T22:31:38.728538+0000","last_became_active":"2024-08-18T22:31:37.743696+0000","last_became_peered":"2024-08-18T22:31:37.743696+0000","last_unstale":"2024-08-18T22:31:38.728538+0000","last_undegraded":"2024-08-18T22:31:38.728538+0000","last_fullsized":"2024-08-18T22:31:38.728538+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:41:52.882342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"176'2","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.748466+0000","last_change":"2024-08-18T22:31:36.727103+0000","last_active":"2024-08-18T22:31:37.748466+0000","last_peered":"2024-08-18T22:31:37.748466+0000","last_clean":"2024-08-18T22:31:37.748466+0000","last_became_active":"2024-08-18T22:31:36.726638+0000","last_became_peered":"2024-08-18T22:31:36.726638+0000","last_unstale":"2024-08-18T22:31:37.748466+0000","last_undegraded":"2024-08-18T22:31:37.748466+0000","last_fullsized":"2024-08-18T22:31:37.748466+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:06.700725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.748736+0000","last_change":"2024-08-18T22:31:37.744467+0000","last_active":"2024-08-18T22:31:37.748736+0000","last_peered":"2024-08-18T22:31:37.748736+0000","last_clean":"2024-08-18T22:31:37.748736+0000","last_became_active":"2024-08-18T22:31:37.743977+0000","last_became_peered":"2024-08-18T22:31:37.743977+0000","last_unstale":"2024-08-18T22:31:37.748736+0000","last_undegraded":"2024-08-18T22:31:37.748736+0000","last_fullsized":"2024-08-18T22:31:37.748736+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:35:31.728259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"176'1","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.747572+0000","last_change":"2024-08-18T22:31:36.738198+0000","last_active":"2024-08-18T22:31:37.747572+0000","last_peered":"2024-08-18T22:31:37.747572+0000","last_clean":"2024-08-18T22:31:37.747572+0000","last_became_active":"2024-08-18T22:31:36.737899+0000","last_became_peered":"2024-08-18T22:31:36.737899+0000","last_unstale":"2024-08-18T22:31:37.747572+0000","last_undegraded":"2024-08-18T22:31:37.747572+0000","last_fullsized":"2024-08-18T22:31:37.747572+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:54:05.624279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.749427+0000","last_change":"2024-08-18T22:31:37.745495+0000","last_active":"2024-08-18T22:31:37.749427+0000","last_peered":"2024-08-18T22:31:37.749427+0000","last_clean":"2024-08-18T22:31:37.749427+0000","last_became_active":"2024-08-18T22:31:37.744680+0000","last_became_peered":"2024-08-18T22:31:37.744680+0000","last_unstale":"2024-08-18T22:31:37.749427+0000","last_undegraded":"2024-08-18T22:31:37.749427+0000","last_fullsized":"2024-08-18T22:31:37.749427+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:32.865858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.737904+0000","last_change":"2024-08-18T22:31:36.730036+0000","last_active":"2024-08-18T22:31:37.737904+0000","last_peered":"2024-08-18T22:31:37.737904+0000","last_clean":"2024-08-18T22:31:37.737904+0000","last_became_active":"2024-08-18T22:31:36.729724+0000","last_became_peered":"2024-08-18T22:31:36.729724+0000","last_unstale":"2024-08-18T22:31:37.737904+0000","last_undegraded":"2024-08-18T22:31:37.737904+0000","last_fullsized":"2024-08-18T22:31:37.737904+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:53:43.859668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.746528+0000","last_change":"2024-08-18T22:31:37.745251+0000","last_active":"2024-08-18T22:31:37.746528+0000","last_peered":"2024-08-18T22:31:37.746528+0000","last_clean":"2024-08-18T22:31:37.746528+0000","last_became_active":"2024-08-18T22:31:37.744718+0000","last_became_peered":"2024-08-18T22:31:37.744718+0000","last_unstale":"2024-08-18T22:31:37.746528+0000","last_undegraded":"2024-08-18T22:31:37.746528+0000","last_fullsized":"2024-08-18T22:31:37.746528+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:42:07.593095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"176'2","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730905+0000","last_change":"2024-08-18T22:31:36.736551+0000","last_active":"2024-08-18T22:31:38.730905+0000","last_peered":"2024-08-18T22:31:38.730905+0000","last_clean":"2024-08-18T22:31:38.730905+0000","last_became_active":"2024-08-18T22:31:36.736248+0000","last_became_peered":"2024-08-18T22:31:36.736248+0000","last_unstale":"2024-08-18T22:31:38.730905+0000","last_undegraded":"2024-08-18T22:31:38.730905+0000","last_fullsized":"2024-08-18T22:31:38.730905+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:15:42.264680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.732982+0000","last_change":"2024-08-18T22:31:37.729075+0000","last_active":"2024-08-18T22:31:37.732982+0000","last_peered":"2024-08-18T22:31:37.732982+0000","last_clean":"2024-08-18T22:31:37.732982+0000","last_became_active":"2024-08-18T22:31:37.728704+0000","last_became_peered":"2024-08-18T22:31:37.728704+0000","last_unstale":"2024-08-18T22:31:37.732982+0000","last_undegraded":"2024-08-18T22:31:37.732982+0000","last_fullsized":"2024-08-18T22:31:37.732982+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:41:29.175032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.717694+0000","last_change":"2024-08-18T22:31:36.727477+0000","last_active":"2024-08-18T22:31:37.717694+0000","last_peered":"2024-08-18T22:31:37.717694+0000","last_clean":"2024-08-18T22:31:37.717694+0000","last_became_active":"2024-08-18T22:31:36.727133+0000","last_became_peered":"2024-08-18T22:31:36.727133+0000","last_unstale":"2024-08-18T22:31:37.717694+0000","last_undegraded":"2024-08-18T22:31:37.717694+0000","last_fullsized":"2024-08-18T22:31:37.717694+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:44.591999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.740560+0000","last_change":"2024-08-18T22:31:37.739284+0000","last_active":"2024-08-18T22:31:37.740560+0000","last_peered":"2024-08-18T22:31:37.740560+0000","last_clean":"2024-08-18T22:31:37.740560+0000","last_became_active":"2024-08-18T22:31:37.739004+0000","last_became_peered":"2024-08-18T22:31:37.739004+0000","last_unstale":"2024-08-18T22:31:37.740560+0000","last_undegraded":"2024-08-18T22:31:37.740560+0000","last_fullsized":"2024-08-18T22:31:37.740560+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:33:12.109555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901277+0000","last_change":"2024-08-18T22:31:36.736210+0000","last_active":"2024-08-18T22:31:38.901277+0000","last_peered":"2024-08-18T22:31:38.901277+0000","last_clean":"2024-08-18T22:31:38.901277+0000","last_became_active":"2024-08-18T22:31:36.735763+0000","last_became_peered":"2024-08-18T22:31:36.735763+0000","last_unstale":"2024-08-18T22:31:38.901277+0000","last_undegraded":"2024-08-18T22:31:38.901277+0000","last_fullsized":"2024-08-18T22:31:38.901277+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:24.863657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728364+0000","last_change":"2024-08-18T22:31:37.750473+0000","last_active":"2024-08-18T22:31:38.728364+0000","last_peered":"2024-08-18T22:31:38.728364+0000","last_clean":"2024-08-18T22:31:38.728364+0000","last_became_active":"2024-08-18T22:31:37.743259+0000","last_became_peered":"2024-08-18T22:31:37.743259+0000","last_unstale":"2024-08-18T22:31:38.728364+0000","last_undegraded":"2024-08-18T22:31:38.728364+0000","last_fullsized":"2024-08-18T22:31:38.728364+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:21.399341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.717924+0000","last_change":"2024-08-18T22:31:36.720852+0000","last_active":"2024-08-18T22:31:37.717924+0000","last_peered":"2024-08-18T22:31:37.717924+0000","last_clean":"2024-08-18T22:31:37.717924+0000","last_became_active":"2024-08-18T22:31:36.720397+0000","last_became_peered":"2024-08-18T22:31:36.720397+0000","last_unstale":"2024-08-18T22:31:37.717924+0000","last_undegraded":"2024-08-18T22:31:37.717924+0000","last_fullsized":"2024-08-18T22:31:37.717924+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:53:28.130055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901445+0000","last_change":"2024-08-18T22:31:37.737812+0000","last_active":"2024-08-18T22:31:38.901445+0000","last_peered":"2024-08-18T22:31:38.901445+0000","last_clean":"2024-08-18T22:31:38.901445+0000","last_became_active":"2024-08-18T22:31:37.737287+0000","last_became_peered":"2024-08-18T22:31:37.737287+0000","last_unstale":"2024-08-18T22:31:38.901445+0000","last_undegraded":"2024-08-18T22:31:38.901445+0000","last_fullsized":"2024-08-18T22:31:38.901445+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:46:56.554374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"176'2","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.739370+0000","last_change":"2024-08-18T22:31:36.719940+0000","last_active":"2024-08-18T22:31:37.739370+0000","last_peered":"2024-08-18T22:31:37.739370+0000","last_clean":"2024-08-18T22:31:37.739370+0000","last_became_active":"2024-08-18T22:31:36.719624+0000","last_became_peered":"2024-08-18T22:31:36.719624+0000","last_unstale":"2024-08-18T22:31:37.739370+0000","last_undegraded":"2024-08-18T22:31:37.739370+0000","last_fullsized":"2024-08-18T22:31:37.739370+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:44:47.635275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.738356+0000","last_change":"2024-08-18T22:31:37.731702+0000","last_active":"2024-08-18T22:31:37.738356+0000","last_peered":"2024-08-18T22:31:37.738356+0000","last_clean":"2024-08-18T22:31:37.738356+0000","last_became_active":"2024-08-18T22:31:37.731435+0000","last_became_peered":"2024-08-18T22:31:37.731435+0000","last_unstale":"2024-08-18T22:31:37.738356+0000","last_undegraded":"2024-08-18T22:31:37.738356+0000","last_fullsized":"2024-08-18T22:31:37.738356+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:24:49.025537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"177'1","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901479+0000","last_change":"2024-08-18T22:31:36.738922+0000","last_active":"2024-08-18T22:31:38.901479+0000","last_peered":"2024-08-18T22:31:38.901479+0000","last_clean":"2024-08-18T22:31:38.901479+0000","last_became_active":"2024-08-18T22:31:36.738593+0000","last_became_peered":"2024-08-18T22:31:36.738593+0000","last_unstale":"2024-08-18T22:31:38.901479+0000","last_undegraded":"2024-08-18T22:31:38.901479+0000","last_fullsized":"2024-08-18T22:31:38.901479+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:29.340022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.732049+0000","last_change":"2024-08-18T22:31:37.727877+0000","last_active":"2024-08-18T22:31:38.732049+0000","last_peered":"2024-08-18T22:31:38.732049+0000","last_clean":"2024-08-18T22:31:38.732049+0000","last_became_active":"2024-08-18T22:31:37.727610+0000","last_became_peered":"2024-08-18T22:31:37.727610+0000","last_unstale":"2024-08-18T22:31:38.732049+0000","last_undegraded":"2024-08-18T22:31:38.732049+0000","last_fullsized":"2024-08-18T22:31:38.732049+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:05:21.129924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728662+0000","last_change":"2024-08-18T22:31:36.737079+0000","last_active":"2024-08-18T22:31:38.728662+0000","last_peered":"2024-08-18T22:31:38.728662+0000","last_clean":"2024-08-18T22:31:38.728662+0000","last_became_active":"2024-08-18T22:31:36.736730+0000","last_became_peered":"2024-08-18T22:31:36.736730+0000","last_unstale":"2024-08-18T22:31:38.728662+0000","last_undegraded":"2024-08-18T22:31:38.728662+0000","last_fullsized":"2024-08-18T22:31:38.728662+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:44:47.635275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901592+0000","last_change":"2024-08-18T22:31:37.746231+0000","last_active":"2024-08-18T22:31:38.901592+0000","last_peered":"2024-08-18T22:31:38.901592+0000","last_clean":"2024-08-18T22:31:38.901592+0000","last_became_active":"2024-08-18T22:31:37.745894+0000","last_became_peered":"2024-08-18T22:31:37.745894+0000","last_unstale":"2024-08-18T22:31:38.901592+0000","last_undegraded":"2024-08-18T22:31:38.901592+0000","last_fullsized":"2024-08-18T22:31:38.901592+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:37.457031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.728620+0000","last_change":"2024-08-18T22:31:36.739261+0000","last_active":"2024-08-18T22:31:38.728620+0000","last_peered":"2024-08-18T22:31:38.728620+0000","last_clean":"2024-08-18T22:31:38.728620+0000","last_became_active":"2024-08-18T22:31:36.738977+0000","last_became_peered":"2024-08-18T22:31:36.738977+0000","last_unstale":"2024-08-18T22:31:38.728620+0000","last_undegraded":"2024-08-18T22:31:38.728620+0000","last_fullsized":"2024-08-18T22:31:38.728620+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:18:45.186613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.735652+0000","last_change":"2024-08-18T22:31:37.724975+0000","last_active":"2024-08-18T22:31:37.735652+0000","last_peered":"2024-08-18T22:31:37.735652+0000","last_clean":"2024-08-18T22:31:37.735652+0000","last_became_active":"2024-08-18T22:31:37.724665+0000","last_became_peered":"2024-08-18T22:31:37.724665+0000","last_unstale":"2024-08-18T22:31:37.735652+0000","last_undegraded":"2024-08-18T22:31:37.735652+0000","last_fullsized":"2024-08-18T22:31:37.735652+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:31.133665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731743+0000","last_change":"2024-08-18T22:31:36.725782+0000","last_active":"2024-08-18T22:31:38.731743+0000","last_peered":"2024-08-18T22:31:38.731743+0000","last_clean":"2024-08-18T22:31:38.731743+0000","last_became_active":"2024-08-18T22:31:36.725511+0000","last_became_peered":"2024-08-18T22:31:36.725511+0000","last_unstale":"2024-08-18T22:31:38.731743+0000","last_undegraded":"2024-08-18T22:31:38.731743+0000","last_fullsized":"2024-08-18T22:31:38.731743+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:48:31.862576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.730436+0000","last_change":"2024-08-18T22:31:37.728399+0000","last_active":"2024-08-18T22:31:38.730436+0000","last_peered":"2024-08-18T22:31:38.730436+0000","last_clean":"2024-08-18T22:31:38.730436+0000","last_became_active":"2024-08-18T22:31:37.728094+0000","last_became_peered":"2024-08-18T22:31:37.728094+0000","last_unstale":"2024-08-18T22:31:38.730436+0000","last_undegraded":"2024-08-18T22:31:38.730436+0000","last_fullsized":"2024-08-18T22:31:38.730436+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:09:17.088247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731622+0000","last_change":"2024-08-18T22:31:36.728772+0000","last_active":"2024-08-18T22:31:38.731622+0000","last_peered":"2024-08-18T22:31:38.731622+0000","last_clean":"2024-08-18T22:31:38.731622+0000","last_became_active":"2024-08-18T22:31:36.728482+0000","last_became_peered":"2024-08-18T22:31:36.728482+0000","last_unstale":"2024-08-18T22:31:38.731622+0000","last_undegraded":"2024-08-18T22:31:38.731622+0000","last_fullsized":"2024-08-18T22:31:38.731622+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:42:06.589813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.742945+0000","last_change":"2024-08-18T22:31:37.736609+0000","last_active":"2024-08-18T22:31:37.742945+0000","last_peered":"2024-08-18T22:31:37.742945+0000","last_clean":"2024-08-18T22:31:37.742945+0000","last_became_active":"2024-08-18T22:31:37.736327+0000","last_became_peered":"2024-08-18T22:31:37.736327+0000","last_unstale":"2024-08-18T22:31:37.742945+0000","last_undegraded":"2024-08-18T22:31:37.742945+0000","last_fullsized":"2024-08-18T22:31:37.742945+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:51:21.952522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.901282+0000","last_change":"2024-08-18T22:31:36.723897+0000","last_active":"2024-08-18T22:31:38.901282+0000","last_peered":"2024-08-18T22:31:38.901282+0000","last_clean":"2024-08-18T22:31:38.901282+0000","last_became_active":"2024-08-18T22:31:36.723603+0000","last_became_peered":"2024-08-18T22:31:36.723603+0000","last_unstale":"2024-08-18T22:31:38.901282+0000","last_undegraded":"2024-08-18T22:31:38.901282+0000","last_fullsized":"2024-08-18T22:31:38.901282+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:31:15.579480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731754+0000","last_change":"2024-08-18T22:31:37.741836+0000","last_active":"2024-08-18T22:31:38.731754+0000","last_peered":"2024-08-18T22:31:38.731754+0000","last_clean":"2024-08-18T22:31:38.731754+0000","last_became_active":"2024-08-18T22:31:37.741561+0000","last_became_peered":"2024-08-18T22:31:37.741561+0000","last_unstale":"2024-08-18T22:31:38.731754+0000","last_undegraded":"2024-08-18T22:31:38.731754+0000","last_fullsized":"2024-08-18T22:31:38.731754+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:41:31.590092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.720750+0000","last_change":"2024-08-18T22:31:36.733858+0000","last_active":"2024-08-18T22:31:37.720750+0000","last_peered":"2024-08-18T22:31:37.720750+0000","last_clean":"2024-08-18T22:31:37.720750+0000","last_became_active":"2024-08-18T22:31:36.733567+0000","last_became_peered":"2024-08-18T22:31:36.733567+0000","last_unstale":"2024-08-18T22:31:37.720750+0000","last_undegraded":"2024-08-18T22:31:37.720750+0000","last_fullsized":"2024-08-18T22:31:37.720750+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:26:51.869900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.741276+0000","last_change":"2024-08-18T22:31:37.735239+0000","last_active":"2024-08-18T22:31:37.741276+0000","last_peered":"2024-08-18T22:31:37.741276+0000","last_clean":"2024-08-18T22:31:37.741276+0000","last_became_active":"2024-08-18T22:31:37.734950+0000","last_became_peered":"2024-08-18T22:31:37.734950+0000","last_unstale":"2024-08-18T22:31:37.741276+0000","last_undegraded":"2024-08-18T22:31:37.741276+0000","last_fullsized":"2024-08-18T22:31:37.741276+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:36.700837+0000","last_clean_scrub_stamp":"2024-08-18T22:31:36.700837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:33:47.549857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-08-18T22:31:37.717470+0000","last_change":"2024-08-18T22:31:36.724981+0000","last_active":"2024-08-18T22:31:37.717470+0000","last_peered":"2024-08-18T22:31:37.717470+0000","last_clean":"2024-08-18T22:31:37.717470+0000","last_became_active":"2024-08-18T22:31:36.724644+0000","last_became_peered":"2024-08-18T22:31:36.724644+0000","last_unstale":"2024-08-18T22:31:37.717470+0000","last_undegraded":"2024-08-18T22:31:37.717470+0000","last_fullsized":"2024-08-18T22:31:37.717470+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:31:35.697555+0000","last_clean_scrub_stamp":"2024-08-18T22:31:35.697555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:42.579698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":488,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-08-18T22:31:38.731488+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:31:38.731488+0000","last_peered":"2024-08-18T22:31:38.731488+0000","last_clean":"2024-08-18T22:31:38.731488+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:31:38.731488+0000","last_undegraded":"2024-08-18T22:31:38.731488+0000","last_fullsized":"2024-08-18T22:31:38.731488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509593,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51972,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319868,"statfs":{"total":96636764160,"available":96583544832,"internally_reserved":0,"allocated":2801664,"data_stored":1632677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509595,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51388,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320452,"statfs":{"total":96636764160,"available":96584142848,"internally_reserved":0,"allocated":2211840,"data_stored":1042379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509593,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51400,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320440,"statfs":{"total":96636764160,"available":96584130560,"internally_reserved":0,"allocated":2224128,"data_stored":1043943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509594,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63876,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307964,"statfs":{"total":96636764160,"available":96571355136,"internally_reserved":0,"allocated":2215936,"data_stored":1042469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63868,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307972,"statfs":{"total":96636764160,"available":96571363328,"internally_reserved":0,"allocated":2207744,"data_stored":1042309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509594,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56144,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315696,"statfs":{"total":96636764160,"available":96579272704,"internally_reserved":0,"allocated":2818048,"data_stored":1633405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59736,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312104,"statfs":{"total":96636764160,"available":96575594496,"internally_reserved":0,"allocated":2236416,"data_stored":1050647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55560,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316280,"statfs":{"total":96636764160,"available":96579870720,"internally_reserved":0,"allocated":2224128,"data_stored":1049583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:31:42.248 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:31:42.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:31:42.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.431+0000 7f07b9a00640 1 Processor -- start 2024-08-18T22:31:42.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.431+0000 7f07b9a00640 1 -- start start 2024-08-18T22:31:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b9a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b415ad60 0x7f07b415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b9a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07b4071a20 0x7f07b40aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b9a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b415b140 con 0x7f07b40af000 2024-08-18T22:31:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b9a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f07b4073990 con 0x7f07b4071a20 2024-08-18T22:31:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b9a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07b40acf60 con 0x7f07b415ad60 2024-08-18T22:31:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07b4071a20 0x7f07b40aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07b4071a20 0x7f07b40aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57840/0 (socket says 172.21.15.5:57840) 2024-08-18T22:31:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b3400640 1 -- 172.21.15.5:0/468412952 learned_addr learned my addr 172.21.15.5:0/468412952 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b3e00640 1 --2- 172.21.15.5:0/468412952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b415ad60 0x7f07b415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b3400640 1 -- 172.21.15.5:0/468412952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b415ad60 msgr2=0x7f07b415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b3400640 1 --2- 172.21.15.5:0/468412952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b415ad60 0x7f07b415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b3400640 1 -- 172.21.15.5:0/468412952 >> v1:172.21.15.117:6789/0 conn(0x7f07b40af000 legacy=0x7f07b415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.435+0000 7f07b3400640 1 -- 172.21.15.5:0/468412952 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b40ad240 con 0x7f07b4071a20 2024-08-18T22:31:42.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b3400640 1 --2- 172.21.15.5:0/468412952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b4071a20 0x7f07b40aeac0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f07a0009870 tx=0x7f07a001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec062b7d6231f92 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:42.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b2a00640 1 -- 172.21.15.5:0/468412952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a00b2070 con 0x7f07b4071a20 2024-08-18T22:31:42.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b2a00640 1 -- 172.21.15.5:0/468412952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a00a9070 con 0x7f07b4071a20 2024-08-18T22:31:42.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b2a00640 1 -- 172.21.15.5:0/468412952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a00ad880 con 0x7f07b4071a20 2024-08-18T22:31:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b9a00640 1 -- 172.21.15.5:0/468412952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b4071a20 msgr2=0x7f07b40aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b9a00640 1 --2- 172.21.15.5:0/468412952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b4071a20 0x7f07b40aeac0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f07a0009870 tx=0x7f07a001c4d0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b9a00640 1 -- 172.21.15.5:0/468412952 shutdown_connections 2024-08-18T22:31:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b9a00640 1 --2- 172.21.15.5:0/468412952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b4071a20 0x7f07b40aeac0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b9a00640 1 --2- 172.21.15.5:0/468412952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b415ad60 0x7f07b415bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b9a00640 1 -- 172.21.15.5:0/468412952 >> 172.21.15.5:0/468412952 conn(0x7f07b406bdb0 msgr2=0x7f07b406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b9a00640 1 -- 172.21.15.5:0/468412952 shutdown_connections 2024-08-18T22:31:42.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b9a00640 1 -- 172.21.15.5:0/468412952 wait complete. 2024-08-18T22:31:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b9a00640 1 Processor -- start 2024-08-18T22:31:42.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b9a00640 1 -- start start 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.439+0000 7f07b9a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b4071a20 0x7f07b415e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07b40af000 0x7f07b415d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b415ad60 0x7f07b4072570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f07b415f830 con 0x7f07b415ad60 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f07b415f6b0 con 0x7f07b40af000 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07b4071e20 con 0x7f07b4071a20 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b415ad60 0x7f07b4072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b415ad60 0x7f07b4072570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57848/0 (socket says 172.21.15.5:57848) 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9000640 1 -- 172.21.15.5:0/4161419857 learned_addr learned my addr 172.21.15.5:0/4161419857 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b3e00640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b4071a20 0x7f07b415e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b3400640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07b40af000 0x7f07b415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9000640 1 -- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b4071a20 msgr2=0x7f07b415e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9000640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b4071a20 0x7f07b415e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9000640 1 -- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07b40af000 msgr2=0x7f07b415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9000640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07b40af000 0x7f07b415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9000640 1 -- 172.21.15.5:0/4161419857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b41548f0 con 0x7f07b415ad60 2024-08-18T22:31:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b3400640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07b40af000 0x7f07b415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:42.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9000640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b415ad60 0x7f07b4072570 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00c7a0 tx=0x7f07ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07abe00640 1 -- 172.21.15.5:0/4161419857 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac003b80 con 0x7f07b415ad60 2024-08-18T22:31:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07abe00640 1 -- 172.21.15.5:0/4161419857 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ac003d20 con 0x7f07b415ad60 2024-08-18T22:31:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07abe00640 1 -- 172.21.15.5:0/4161419857 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00aa90 con 0x7f07b415ad60 2024-08-18T22:31:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9a00640 1 -- 172.21.15.5:0/4161419857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b4153520 con 0x7f07b415ad60 2024-08-18T22:31:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9a00640 1 -- 172.21.15.5:0/4161419857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b4152f60 con 0x7f07b415ad60 2024-08-18T22:31:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07b9a00640 1 -- 172.21.15.5:0/4161419857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b4152d70 con 0x7f07b415ad60 2024-08-18T22:31:42.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.443+0000 7f07abe00640 1 -- 172.21.15.5:0/4161419857 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07ac00ac30 con 0x7f07b415ad60 2024-08-18T22:31:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.447+0000 7f07abe00640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 0x7f0794069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.447+0000 7f07abe00640 1 -- 172.21.15.5:0/4161419857 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f07ac085bf0 con 0x7f07b415ad60 2024-08-18T22:31:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.447+0000 7f07b3e00640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 0x7f0794069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.447+0000 7f07b3e00640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 0x7f0794069d80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f07b4073290 tx=0x7f07a4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:42.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.451+0000 7f07abe00640 1 -- 172.21.15.5:0/4161419857 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f07ac056630 con 0x7f07b415ad60 2024-08-18T22:31:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.671+0000 7f07b9a00640 1 -- 172.21.15.5:0/4161419857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f07b40ad520 con 0x7f07b415ad60 2024-08-18T22:31:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07abe00640 1 -- 172.21.15.5:0/4161419857 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) ==== 190+0+147 (secure 0 0 0) 0x7f07ac055f30 con 0x7f07b415ad60 2024-08-18T22:31:42.675 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:31:42.675 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:31:42.676 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:31:42.676 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:31:42.676 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:31:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:31:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 -- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 msgr2=0x7f0794069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 0x7f0794069d80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f07b4073290 tx=0x7f07a4009190 comp rx=0 tx=0).stop 2024-08-18T22:31:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 -- 172.21.15.5:0/4161419857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b415ad60 msgr2=0x7f07b4072570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b415ad60 0x7f07b4072570 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00c7a0 tx=0x7f07ac00cc60 comp rx=0 tx=0).stop 2024-08-18T22:31:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 -- 172.21.15.5:0/4161419857 shutdown_connections 2024-08-18T22:31:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07940678c0 0x7f0794069d80 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07b415ad60 0x7f07b4072570 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07b40af000 0x7f07b415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 --2- 172.21.15.5:0/4161419857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07b4071a20 0x7f07b415e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 -- 172.21.15.5:0/4161419857 >> 172.21.15.5:0/4161419857 conn(0x7f07b406bdb0 msgr2=0x7f07b40b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 -- 172.21.15.5:0/4161419857 shutdown_connections 2024-08-18T22:31:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.675+0000 7f07b9a00640 1 -- 172.21.15.5:0/4161419857 wait complete. 2024-08-18T22:31:42.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:31:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.839+0000 7fefa1600640 1 Processor -- start 2024-08-18T22:31:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.839+0000 7fefa1600640 1 -- start start 2024-08-18T22:31:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.839+0000 7fefa1600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef9c06f290 0x7fef9c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.839+0000 7fefa1600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 0x7fef9c072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.839+0000 7fefa1600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef9c0cd850 con 0x7fef9c15b010 2024-08-18T22:31:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.839+0000 7fefa1600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fef9c0cfa30 con 0x7fef9c06f290 2024-08-18T22:31:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.839+0000 7fefa1600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fef9c0cee20 con 0x7fef9c0cd3a0 2024-08-18T22:31:42.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef92000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef9c06f290 0x7fef9c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 0x7fef9c072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9b400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 0x7fef9c072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:50962/0 (socket says 172.21.15.5:50962) 2024-08-18T22:31:42.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9b400640 1 -- 172.21.15.5:0/280465028 learned_addr learned my addr 172.21.15.5:0/280465028 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:42.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef92000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef9c06f290 0x7fef9c0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:42498/0 (socket says 172.21.15.5:42498) 2024-08-18T22:31:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9aa00640 1 --1- 172.21.15.5:0/280465028 >> v1:172.21.15.117:6789/0 conn(0x7fef9c15b010 0x7fef9c06eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:34354/0 (socket says 172.21.15.5:34354) 2024-08-18T22:31:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9b400640 1 -- 172.21.15.5:0/280465028 >> v2:172.21.15.117:3300/0 conn(0x7fef9c06f290 msgr2=0x7fef9c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9b400640 1 --2- 172.21.15.5:0/280465028 >> v2:172.21.15.117:3300/0 conn(0x7fef9c06f290 0x7fef9c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9b400640 1 -- 172.21.15.5:0/280465028 >> v1:172.21.15.117:6789/0 conn(0x7fef9c15b010 legacy=0x7fef9c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9b400640 1 -- 172.21.15.5:0/280465028 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9c0cf100 con 0x7fef9c0cd3a0 2024-08-18T22:31:42.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef92000640 1 --2- 172.21.15.5:0/280465028 >> v2:172.21.15.117:3300/0 conn(0x7fef9c06f290 0x7fef9c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:31:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9b400640 1 --2- 172.21.15.5:0/280465028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 0x7fef9c072620 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fef94009e50 tx=0x7fef9401ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afa5c9a59c1ebbb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9a000640 1 -- 172.21.15.5:0/280465028 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef940a58d0 con 0x7fef9c0cd3a0 2024-08-18T22:31:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9a000640 1 -- 172.21.15.5:0/280465028 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef940a5a70 con 0x7fef9c0cd3a0 2024-08-18T22:31:42.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.843+0000 7fef9a000640 1 -- 172.21.15.5:0/280465028 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef940a5e40 con 0x7fef9c0cd3a0 2024-08-18T22:31:42.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 -- 172.21.15.5:0/280465028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 msgr2=0x7fef9c072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 --2- 172.21.15.5:0/280465028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 0x7fef9c072620 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fef94009e50 tx=0x7fef9401ca00 comp rx=0 tx=0).stop 2024-08-18T22:31:42.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 -- 172.21.15.5:0/280465028 shutdown_connections 2024-08-18T22:31:42.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 --2- 172.21.15.5:0/280465028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 0x7fef9c072620 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 --2- 172.21.15.5:0/280465028 >> v2:172.21.15.117:3300/0 conn(0x7fef9c06f290 0x7fef9c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 -- 172.21.15.5:0/280465028 >> 172.21.15.5:0/280465028 conn(0x7fef9c0b1c50 msgr2=0x7fef9c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:42.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 -- 172.21.15.5:0/280465028 shutdown_connections 2024-08-18T22:31:42.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 -- 172.21.15.5:0/280465028 wait complete. 2024-08-18T22:31:42.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 Processor -- start 2024-08-18T22:31:42.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 -- start start 2024-08-18T22:31:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c06f290 0x7fef9c1fb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 0x7fef9c151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef9c15b010 0x7fef9c159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c0734f0 con 0x7fef9c06f290 2024-08-18T22:31:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c073370 con 0x7fef9c15b010 2024-08-18T22:31:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fefa1600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fef9c073670 con 0x7fef9c0cd3a0 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef9aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c06f290 0x7fef9c1fb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef9aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c06f290 0x7fef9c1fb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57864/0 (socket says 172.21.15.5:57864) 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef9aa00640 1 -- 172.21.15.5:0/2867252250 learned_addr learned my addr 172.21.15.5:0/2867252250 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef92000640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 0x7fef9c151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef9b400640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef9c15b010 0x7fef9c159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef9aa00640 1 -- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 msgr2=0x7fef9c151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef9aa00640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 0x7fef9c151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef9aa00640 1 -- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef9c15b010 msgr2=0x7fef9c159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef9aa00640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef9c15b010 0x7fef9c159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef9aa00640 1 -- 172.21.15.5:0/2867252250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9c1531d0 con 0x7fef9c06f290 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef92000640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 0x7fef9c151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.847+0000 7fef9b400640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef9c15b010 0x7fef9c159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.851+0000 7fef9aa00640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c06f290 0x7fef9c1fb950 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00c430 tx=0x7fef8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.851+0000 7fef93400640 1 -- 172.21.15.5:0/2867252250 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c0074e0 con 0x7fef9c06f290 2024-08-18T22:31:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.851+0000 7fef93400640 1 -- 172.21.15.5:0/2867252250 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8c007680 con 0x7fef9c06f290 2024-08-18T22:31:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.851+0000 7fefa1600640 1 -- 172.21.15.5:0/2867252250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef9c1534b0 con 0x7fef9c06f290 2024-08-18T22:31:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.851+0000 7fef93400640 1 -- 172.21.15.5:0/2867252250 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c004a10 con 0x7fef9c06f290 2024-08-18T22:31:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.851+0000 7fefa1600640 1 -- 172.21.15.5:0/2867252250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef9c15cf40 con 0x7fef9c06f290 2024-08-18T22:31:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.851+0000 7fefa1600640 1 -- 172.21.15.5:0/2867252250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef9c153960 con 0x7fef9c06f290 2024-08-18T22:31:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.851+0000 7fef93400640 1 -- 172.21.15.5:0/2867252250 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef8c01a020 con 0x7fef9c06f290 2024-08-18T22:31:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.851+0000 7fef93400640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef78067910 0x7fef78069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.851+0000 7fef93400640 1 -- 172.21.15.5:0/2867252250 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fef8c085590 con 0x7fef9c06f290 2024-08-18T22:31:42.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.851+0000 7fef92000640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef78067910 0x7fef78069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:42.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.855+0000 7fef92000640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef78067910 0x7fef78069dd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fef84009bc0 tx=0x7fef84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:42.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:42.855+0000 7fef93400640 1 -- 172.21.15.5:0/2867252250 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fef8c055fb0 con 0x7fef9c06f290 2024-08-18T22:31:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.059+0000 7fefa1600640 1 -- 172.21.15.5:0/2867252250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef9c0ce840 con 0x7fef9c06f290 2024-08-18T22:31:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.059+0000 7fef93400640 1 -- 172.21.15.5:0/2867252250 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) ==== 95+0+5233 (secure 0 0 0) 0x7fef8c0558b0 con 0x7fef9c06f290 2024-08-18T22:31:43.061 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:31:43.061 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":138,"btime":"2024-08-18T22:31:40:739638+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4068691051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4068691051},{"type":"v1","addr":"172.21.15.117:6836","nonce":4068691051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":9972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/4128479928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4128479928},{"type":"v1","addr":"172.21.15.5:6834","nonce":4128479928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9975,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1984562471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1984562471},{"type":"v1","addr":"172.21.15.5:6835","nonce":1984562471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:31:37.120589+0000","modified":"2024-08-18T22:31:40.134577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9981},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9981":{"gid":9981,"name":"d","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/3224274565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3224274565},{"type":"v1","addr":"172.21.15.117:6837","nonce":3224274565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9981,"qdb_cluster":[9981]},"id":12}]} 2024-08-18T22:31:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 138 2024-08-18T22:31:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 -- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef78067910 msgr2=0x7fef78069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef78067910 0x7fef78069dd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fef84009bc0 tx=0x7fef84008040 comp rx=0 tx=0).stop 2024-08-18T22:31:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 -- 172.21.15.5:0/2867252250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c06f290 msgr2=0x7fef9c1fb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c06f290 0x7fef9c1fb950 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00c430 tx=0x7fef8c00c8f0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 -- 172.21.15.5:0/2867252250 shutdown_connections 2024-08-18T22:31:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fef78067910 0x7fef78069dd0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef9c15b010 0x7fef9c159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c0cd3a0 0x7fef9c151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 --2- 172.21.15.5:0/2867252250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef9c06f290 0x7fef9c1fb950 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 -- 172.21.15.5:0/2867252250 >> 172.21.15.5:0/2867252250 conn(0x7fef9c0b1c50 msgr2=0x7fef9c1570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 -- 172.21.15.5:0/2867252250 shutdown_connections 2024-08-18T22:31:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.063+0000 7fefa1600640 1 -- 172.21.15.5:0/2867252250 wait complete. 2024-08-18T22:31:43.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 138, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:31:37.120589+0000', 'modified': '2024-08-18T22:31:40.134577+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9981}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9981': {'gid': 9981, 'name': 'd', 'rank': 0, 'incarnation': 134, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6837/3224274565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6835', 'nonce': 3224274565}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 3224274565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9981, 'qdb_cluster': [9981]} 2024-08-18T22:31:43.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:31:43.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-18T22:31:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb01cc00640 1 Processor -- start 2024-08-18T22:31:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb01cc00640 1 -- start start 2024-08-18T22:31:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb01cc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb01815c180 0x7fb0180cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb01cc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb01815d4d0 0x7fb01806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb01cc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0180cfb00 con 0x7fb01815c560 2024-08-18T22:31:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb01cc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb01815d040 con 0x7fb01815d4d0 2024-08-18T22:31:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb01cc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb01815c9f0 con 0x7fb01815c180 2024-08-18T22:31:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb016800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb01815d4d0 0x7fb01806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb016800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb01815d4d0 0x7fb01806db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51108/0 (socket says 172.21.15.5:51108) 2024-08-18T22:31:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb016800640 1 -- 172.21.15.5:0/3676964878 learned_addr learned my addr 172.21.15.5:0/3676964878 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb015e00640 1 --2- 172.21.15.5:0/3676964878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb01815c180 0x7fb0180cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb016800640 1 -- 172.21.15.5:0/3676964878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb01815c180 msgr2=0x7fb0180cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb016800640 1 --2- 172.21.15.5:0/3676964878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb01815c180 0x7fb0180cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb016800640 1 -- 172.21.15.5:0/3676964878 >> v1:172.21.15.117:6789/0 conn(0x7fb01815c560 legacy=0x7fb0180ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.635+0000 7fb016800640 1 -- 172.21.15.5:0/3676964878 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01815ccd0 con 0x7fb01815d4d0 2024-08-18T22:31:43.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb016800640 1 --2- 172.21.15.5:0/3676964878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815d4d0 0x7fb01806db80 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fb010009e50 tx=0x7fb01001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a993704f772c990 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:43.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb014a00640 1 -- 172.21.15.5:0/3676964878 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0100a5880 con 0x7fb01815d4d0 2024-08-18T22:31:43.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb014a00640 1 -- 172.21.15.5:0/3676964878 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0180ced70 con 0x7fb01815d4d0 2024-08-18T22:31:43.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb014a00640 1 -- 172.21.15.5:0/3676964878 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0100a5c40 con 0x7fb01815d4d0 2024-08-18T22:31:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb01cc00640 1 -- 172.21.15.5:0/3676964878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815d4d0 msgr2=0x7fb01806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb01cc00640 1 --2- 172.21.15.5:0/3676964878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815d4d0 0x7fb01806db80 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fb010009e50 tx=0x7fb01001c9a0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb01cc00640 1 -- 172.21.15.5:0/3676964878 shutdown_connections 2024-08-18T22:31:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb01cc00640 1 --2- 172.21.15.5:0/3676964878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815d4d0 0x7fb01806db80 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb01cc00640 1 --2- 172.21.15.5:0/3676964878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb01815c180 0x7fb0180cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb01cc00640 1 -- 172.21.15.5:0/3676964878 >> 172.21.15.5:0/3676964878 conn(0x7fb0180b1dc0 msgr2=0x7fb0180b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb01cc00640 1 -- 172.21.15.5:0/3676964878 shutdown_connections 2024-08-18T22:31:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb01cc00640 1 -- 172.21.15.5:0/3676964878 wait complete. 2024-08-18T22:31:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb01cc00640 1 Processor -- start 2024-08-18T22:31:43.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.639+0000 7fb01cc00640 1 -- start start 2024-08-18T22:31:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb01cc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb01815c180 0x7fb0180ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb01cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815d4d0 0x7fb018152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb01cc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0180aeef0 0x7fb01809c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb01cc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb0181692b0 con 0x7fb01815d4d0 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb01cc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb018169130 con 0x7fb01815c180 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb01cc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb018169430 con 0x7fb0180aeef0 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb015400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815d4d0 0x7fb018152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb015e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb01815c180 0x7fb0180ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb015e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb01815c180 0x7fb0180ad030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:48350/0 (socket says 172.21.15.5:48350) 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb015e00640 1 -- 172.21.15.5:0/111183375 learned_addr learned my addr 172.21.15.5:0/111183375 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb016800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0180aeef0 0x7fb01809c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb015400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815d4d0 0x7fb018152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51122/0 (socket says 172.21.15.5:51122) 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb015400640 1 -- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0180aeef0 msgr2=0x7fb01809c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb015400640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0180aeef0 0x7fb01809c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb015400640 1 -- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb01815c180 msgr2=0x7fb0180ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb015400640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb01815c180 0x7fb0180ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb015400640 1 -- 172.21.15.5:0/111183375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0180ad7a0 con 0x7fb01815d4d0 2024-08-18T22:31:43.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb015400640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815d4d0 0x7fb018152570 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fb00400c3c0 tx=0x7fb00400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:43.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb00e000640 1 -- 172.21.15.5:0/111183375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0040052d0 con 0x7fb01815d4d0 2024-08-18T22:31:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb00e000640 1 -- 172.21.15.5:0/111183375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb004005470 con 0x7fb01815d4d0 2024-08-18T22:31:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb01cc00640 1 -- 172.21.15.5:0/111183375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0180ada80 con 0x7fb01815d4d0 2024-08-18T22:31:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb00e000640 1 -- 172.21.15.5:0/111183375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004007260 con 0x7fb01815d4d0 2024-08-18T22:31:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.643+0000 7fb01cc00640 1 -- 172.21.15.5:0/111183375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0180ae040 con 0x7fb01815d4d0 2024-08-18T22:31:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb00e000640 1 -- 172.21.15.5:0/111183375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb004007400 con 0x7fb01815d4d0 2024-08-18T22:31:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb00e000640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faff80678c0 0x7faff8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb00e000640 1 -- 172.21.15.5:0/111183375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fb004085250 con 0x7fb01815d4d0 2024-08-18T22:31:43.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb015e00640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faff80678c0 0x7faff8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb020020000 1 Processor -- start 2024-08-18T22:31:43.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb020020000 1 -- start start 2024-08-18T22:31:43.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb015e00640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faff80678c0 0x7faff8069d80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb008009c60 tx=0x7fb008009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:43.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb020020000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afcf2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb020020000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf28c0 0x55e6afca8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb020020000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afca9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb020020000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e6afb8afd0 con 0x55e6afca8da0 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb020020000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e6afaf13c0 con 0x55e6afcf1fa0 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb020020000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e6afa96f70 con 0x55e6afcf28c0 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb016800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afca9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb016800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afca9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51132/0 (socket says 172.21.15.5:51132) 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb016800640 1 -- 172.21.15.5:0/1564351016 learned_addr learned my addr 172.21.15.5:0/1564351016 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb015e00640 1 --2- 172.21.15.5:0/1564351016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afcf2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb015400640 1 --2- 172.21.15.5:0/1564351016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf28c0 0x55e6afca8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb016800640 1 -- 172.21.15.5:0/1564351016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf28c0 msgr2=0x55e6afca8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb016800640 1 --2- 172.21.15.5:0/1564351016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf28c0 0x55e6afca8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb016800640 1 -- 172.21.15.5:0/1564351016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 msgr2=0x55e6afcf2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb016800640 1 --2- 172.21.15.5:0/1564351016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afcf2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb016800640 1 -- 172.21.15.5:0/1564351016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6afa8b2e0 con 0x55e6afca8da0 2024-08-18T22:31:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb015400640 1 --2- 172.21.15.5:0/1564351016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf28c0 0x55e6afca8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb016800640 1 --2- 172.21.15.5:0/1564351016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afca9180 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fb010009040 tx=0x7fb010004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1daa6774c6608ab server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb002a00640 1 -- 172.21.15.5:0/1564351016 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0100bc070 con 0x55e6afca8da0 2024-08-18T22:31:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb002a00640 1 -- 172.21.15.5:0/1564351016 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0100a5880 con 0x55e6afca8da0 2024-08-18T22:31:43.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.647+0000 7fb002a00640 1 -- 172.21.15.5:0/1564351016 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0100a5c30 con 0x55e6afca8da0 2024-08-18T22:31:43.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 -- 172.21.15.5:0/1564351016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 msgr2=0x55e6afca9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 --2- 172.21.15.5:0/1564351016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afca9180 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fb010009040 tx=0x7fb010004ac0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 -- 172.21.15.5:0/1564351016 shutdown_connections 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 --2- 172.21.15.5:0/1564351016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afca9180 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 --2- 172.21.15.5:0/1564351016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf28c0 0x55e6afca8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 --2- 172.21.15.5:0/1564351016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afcf2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 -- 172.21.15.5:0/1564351016 >> 172.21.15.5:0/1564351016 conn(0x55e6afca0910 msgr2=0x55e6afca2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 -- 172.21.15.5:0/1564351016 shutdown_connections 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 -- 172.21.15.5:0/1564351016 wait complete. 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 -- start start 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 Processor -- start 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcdc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afcdcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf28c0 0x55e6afcdcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e6afa98e40 con 0x55e6afca8da0 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e6afbaeaf0 con 0x55e6afcf1fa0 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e6afb53450 con 0x55e6afcf28c0 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 10 client.0 _ll_register_callbacks cb 0x55e6afc8f630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb015e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcdc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb015e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcdc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51134/0 (socket says 172.21.15.5:51134) 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb015e00640 1 -- 172.21.15.5:0/3304845102 learned_addr learned my addr 172.21.15.5:0/3304845102 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb015400640 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afcdcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb016800640 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf28c0 0x55e6afcdcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb015e00640 1 -- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf28c0 msgr2=0x55e6afcdcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb015e00640 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf28c0 0x55e6afcdcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb015e00640 1 -- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 msgr2=0x55e6afcdcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:43.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb015e00640 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afcdcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb015e00640 1 -- 172.21.15.5:0/3304845102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6afa78fd0 con 0x55e6afca8da0 2024-08-18T22:31:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb015400640 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afcdcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:31:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb015e00640 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcdc570 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fb008014e10 tx=0x7fb0080046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1146005dd06c888b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7faff7400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:31:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7faff7400640 1 -- 172.21.15.5:0/3304845102 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008027030 con 0x55e6afca8da0 2024-08-18T22:31:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7faff7400640 1 -- 172.21.15.5:0/3304845102 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fb00800f040 con 0x55e6afca8da0 2024-08-18T22:31:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.651+0000 7fb020020000 1 -- 172.21.15.5:0/3304845102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0100a5880 con 0x55e6afca8da0 2024-08-18T22:31:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7faff7400640 1 -- 172.21.15.5:0/3304845102 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7fb008033050 con 0x55e6afca8da0 2024-08-18T22:31:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 10 client.10086 fetch_fsmap learned FSMap version 138 2024-08-18T22:31:43.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 -- 172.21.15.5:0/3304845102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x55e6afb744d0 con 0x55e6afca8da0 2024-08-18T22:31:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7faff7400640 1 -- 172.21.15.5:0/3304845102 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0100a5880 con 0x55e6afca8da0 2024-08-18T22:31:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7faff7400640 1 -- 172.21.15.5:0/3304845102 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7fb008036020 con 0x55e6afca8da0 2024-08-18T22:31:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 10 client.10086 fetch_fsmap finished waiting for FSMap version 138 2024-08-18T22:31:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 10 client.10086 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-18T22:31:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 20 client.10086 populate_metadata read hostname 'smithi005' 2024-08-18T22:31:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x55e6afcdda00 0x55e6afd03250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 4 client.10086 mds_command: new command op to 9981 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:31:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 -- 172.21.15.5:0/3304845102 --> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6afa8bc00 con 0x55e6afcdda00 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb015400640 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x55e6afcdda00 0x55e6afd03250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb015400640 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x55e6afcdda00 0x55e6afd03250 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94a1f3c5d6912d3d server_cookie=2594be737a74d1bc in_seq=0 out_seq=0 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7faff7400640 10 client.10086 ms_handle_connect on v2:172.21.15.117:6835/3224274565 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7faff7400640 1 -- 172.21.15.5:0/3304845102 <== mds.0 v2:172.21.15.117:6835/3224274565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6afa8bc00 con 0x55e6afcdda00 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7faff7400640 10 client.10086 handle_command_reply: tid=0 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 client.10086 shutdown 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 -- 172.21.15.5:0/3304845102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 msgr2=0x55e6afcdc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcdc570 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fb008014e10 tx=0x7fb0080046d0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 -- 172.21.15.5:0/3304845102 shutdown_connections 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x55e6afcdda00 0x55e6afd03250 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf28c0 0x55e6afcdcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afcdcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 --2- 172.21.15.5:0/3304845102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcdc570 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7faff7400640 0 client.10086 ms_handle_reset on v2:172.21.15.117:6835/3224274565 2024-08-18T22:31:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 -- 172.21.15.5:0/3304845102 >> 172.21.15.5:0/3304845102 conn(0x55e6afca0910 msgr2=0x55e6afca99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 -- 172.21.15.5:0/3304845102 shutdown_connections 2024-08-18T22:31:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 1 -- 172.21.15.5:0/3304845102 wait complete. 2024-08-18T22:31:43.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.655+0000 7fb020020000 20 client.10086 trim_cache size 0 max 16384 2024-08-18T22:31:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb020020000 1 Processor -- start 2024-08-18T22:31:43.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb020020000 1 -- start start 2024-08-18T22:31:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb020020000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcafb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb020020000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf1fa0 0x55e6afcb0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb020020000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf28c0 0x55e6afd03250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb020020000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb018072db0 con 0x55e6afca8da0 2024-08-18T22:31:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb020020000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb0181f5fc0 con 0x55e6afcf28c0 2024-08-18T22:31:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb020020000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb0181f6610 con 0x55e6afcf1fa0 2024-08-18T22:31:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb015e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcafb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb015e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcafb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51144/0 (socket says 172.21.15.5:51144) 2024-08-18T22:31:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb015e00640 1 -- 172.21.15.5:0/1122946986 learned_addr learned my addr 172.21.15.5:0/1122946986 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb016800640 1 --2- 172.21.15.5:0/1122946986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf28c0 0x55e6afd03250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb015400640 1 --2- 172.21.15.5:0/1122946986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf1fa0 0x55e6afcb0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb015e00640 1 -- 172.21.15.5:0/1122946986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf1fa0 msgr2=0x55e6afcb0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb015e00640 1 --2- 172.21.15.5:0/1122946986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf1fa0 0x55e6afcb0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb015e00640 1 -- 172.21.15.5:0/1122946986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf28c0 msgr2=0x55e6afd03250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb015e00640 1 --2- 172.21.15.5:0/1122946986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf28c0 0x55e6afd03250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb015e00640 1 -- 172.21.15.5:0/1122946986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6afaeab30 con 0x55e6afca8da0 2024-08-18T22:31:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb015e00640 1 --2- 172.21.15.5:0/1122946986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcafb10 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fb008014aa0 tx=0x7fb00801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ffffb565da86ae server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.675+0000 7fb002000640 1 -- 172.21.15.5:0/1122946986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008027040 con 0x55e6afca8da0 2024-08-18T22:31:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb002000640 1 -- 172.21.15.5:0/1122946986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00801b070 con 0x55e6afca8da0 2024-08-18T22:31:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb002000640 1 -- 172.21.15.5:0/1122946986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008005ba0 con 0x55e6afca8da0 2024-08-18T22:31:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 -- 172.21.15.5:0/1122946986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 msgr2=0x55e6afcafb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 --2- 172.21.15.5:0/1122946986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcafb10 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fb008014aa0 tx=0x7fb00801b000 comp rx=0 tx=0).stop 2024-08-18T22:31:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 -- 172.21.15.5:0/1122946986 shutdown_connections 2024-08-18T22:31:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 --2- 172.21.15.5:0/1122946986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf28c0 0x55e6afd03250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 --2- 172.21.15.5:0/1122946986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afcf1fa0 0x55e6afcb0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 --2- 172.21.15.5:0/1122946986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afca8da0 0x55e6afcafb10 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 -- 172.21.15.5:0/1122946986 >> 172.21.15.5:0/1122946986 conn(0x55e6afca0910 msgr2=0x55e6afca3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 -- 172.21.15.5:0/1122946986 shutdown_connections 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 -- 172.21.15.5:0/1122946986 wait complete. 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 -- start start 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 Processor -- start 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afca8da0 0x55e6afd05f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afd06440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afcf28c0 0x55e6afd21540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e6afaaa1d0 con 0x55e6afcf28c0 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e6afa88900 con 0x55e6afcf1fa0 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55e6afaf06d0 con 0x55e6afca8da0 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 10 client.0 _ll_register_callbacks cb 0x7fb008009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:31:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb016800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afcf28c0 0x55e6afd21540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb016800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afcf28c0 0x55e6afd21540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51158/0 (socket says 172.21.15.5:51158) 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb016800640 1 -- 172.21.15.5:0/3025517012 learned_addr learned my addr 172.21.15.5:0/3025517012 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb015400640 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afd06440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb015e00640 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afca8da0 0x55e6afd05f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb016800640 1 -- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afca8da0 msgr2=0x55e6afd05f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb016800640 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afca8da0 0x55e6afd05f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb016800640 1 -- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 msgr2=0x55e6afd06440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb016800640 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afd06440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb016800640 1 -- 172.21.15.5:0/3025517012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6afaa2810 con 0x55e6afcf28c0 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb016800640 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afcf28c0 0x55e6afd21540 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fb010009c90 tx=0x7fb01001b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46d961dbb828b88 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7faff7400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7faff7400640 1 -- 172.21.15.5:0/3025517012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0100cd060 con 0x55e6afcf28c0 2024-08-18T22:31:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7faff7400640 1 -- 172.21.15.5:0/3025517012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fb010003ce0 con 0x55e6afcf28c0 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7fb020020000 1 -- 172.21.15.5:0/3025517012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb00801b070 con 0x55e6afcf28c0 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.679+0000 7faff7400640 1 -- 172.21.15.5:0/3025517012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7fb0100d3050 con 0x55e6afcf28c0 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 10 client.10092 fetch_fsmap learned FSMap version 138 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 -- 172.21.15.5:0/3025517012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=2+}) -- 0x55e6afa87d30 con 0x55e6afcf28c0 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7faff7400640 1 -- 172.21.15.5:0/3025517012 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00801b070 con 0x55e6afcf28c0 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7faff7400640 1 -- 172.21.15.5:0/3025517012 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 138) ==== 3502+0+0 (secure 0 0 0) 0x7fb0100d6020 con 0x55e6afcf28c0 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 10 client.10092 fetch_fsmap finished waiting for FSMap version 138 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 10 client.10092 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 20 client.10092 populate_metadata read hostname 'smithi005' 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x55e6afd21ea0 0x55e6afd651b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 4 client.10092 mds_command: new command op to 9981 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:31:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 -- 172.21.15.5:0/3025517012 --> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] -- command(tid 0: {"prefix": "status"}) -- 0x55e6afafeaf0 con 0x55e6afd21ea0 2024-08-18T22:31:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb015e00640 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x55e6afd21ea0 0x55e6afd651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb015e00640 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x55e6afd21ea0 0x55e6afd651b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4940ba614c4aa1d server_cookie=7cb8b2fc10fcbaab in_seq=0 out_seq=0 2024-08-18T22:31:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7faff7400640 10 client.10092 ms_handle_connect on v2:172.21.15.117:6835/3224274565 2024-08-18T22:31:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7faff7400640 1 -- 172.21.15.5:0/3025517012 <== mds.0 v2:172.21.15.117:6835/3224274565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55e6afafeaf0 con 0x55e6afd21ea0 2024-08-18T22:31:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7faff7400640 10 client.10092 handle_command_reply: tid=0 2024-08-18T22:31:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 client.10092 shutdown 2024-08-18T22:31:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 -- 172.21.15.5:0/3025517012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afcf28c0 msgr2=0x55e6afd21540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afcf28c0 0x55e6afd21540 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fb010009c90 tx=0x7fb01001b1e0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 -- 172.21.15.5:0/3025517012 shutdown_connections 2024-08-18T22:31:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e6afcf28c0 0x55e6afd21540 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e6afcf1fa0 0x55e6afd06440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x55e6afd21ea0 0x55e6afd651b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 --2- 172.21.15.5:0/3025517012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e6afca8da0 0x55e6afd05f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 -- 172.21.15.5:0/3025517012 >> 172.21.15.5:0/3025517012 conn(0x55e6afca0910 msgr2=0x55e6afca3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7faff7400640 0 client.10092 ms_handle_reset on v2:172.21.15.117:6835/3224274565 2024-08-18T22:31:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 -- 172.21.15.5:0/3025517012 shutdown_connections 2024-08-18T22:31:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 1 -- 172.21.15.5:0/3025517012 wait complete. 2024-08-18T22:31:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb020020000 20 client.10092 trim_cache size 0 max 16384 2024-08-18T22:31:43.688 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:31:43.688 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:31:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:31:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 9981, 2024-08-18T22:31:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:31:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:31:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:31:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.9760679799999998, 2024-08-18T22:31:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 138, 2024-08-18T22:31:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 177, 2024-08-18T22:31:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 177, 2024-08-18T22:31:43.689 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 10.817338871 2024-08-18T22:31:43.689 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:31:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 -- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faff80678c0 msgr2=0x7faff8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faff80678c0 0x7faff8069d80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb008009c60 tx=0x7fb008009190 comp rx=0 tx=0).stop 2024-08-18T22:31:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 -- 172.21.15.5:0/111183375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815d4d0 msgr2=0x7fb018152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815d4d0 0x7fb018152570 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fb00400c3c0 tx=0x7fb00400c880 comp rx=0 tx=0).stop 2024-08-18T22:31:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 -- 172.21.15.5:0/111183375 shutdown_connections 2024-08-18T22:31:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faff80678c0 0x7faff8069d80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0180aeef0 0x7fb01809c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb01815d4d0 0x7fb018152570 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 --2- 172.21.15.5:0/111183375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb01815c180 0x7fb0180ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 -- 172.21.15.5:0/111183375 >> 172.21.15.5:0/111183375 conn(0x7fb0180b1dc0 msgr2=0x7fb0180b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 -- 172.21.15.5:0/111183375 shutdown_connections 2024-08-18T22:31:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.683+0000 7fb01cc00640 1 -- 172.21.15.5:0/111183375 wait complete. 2024-08-18T22:31:43.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:31:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.843+0000 7f28eb400640 1 Processor -- start 2024-08-18T22:31:43.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.843+0000 7f28eb400640 1 -- start start 2024-08-18T22:31:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28eb400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4161960 0x7f28e406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28eb400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28e415e4b0 0x7f28e4070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28eb400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e415eb60 con 0x7f28e4070730 2024-08-18T22:31:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28eb400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f28e415fcc0 con 0x7f28e415e4b0 2024-08-18T22:31:43.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28eb400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28e40710b0 con 0x7f28e4161960 2024-08-18T22:31:43.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28e8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4161960 0x7f28e406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28e9400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28e415e4b0 0x7f28e4070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28e8a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4161960 0x7f28e406fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:56478/0 (socket says 172.21.15.5:56478) 2024-08-18T22:31:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28e8a00640 1 -- 172.21.15.5:0/3874916455 learned_addr learned my addr 172.21.15.5:0/3874916455 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28e8a00640 1 -- 172.21.15.5:0/3874916455 >> v2:172.21.15.117:3300/0 conn(0x7f28e415e4b0 msgr2=0x7f28e4070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:31:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28e8a00640 1 --2- 172.21.15.5:0/3874916455 >> v2:172.21.15.117:3300/0 conn(0x7f28e415e4b0 0x7f28e4070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28e8a00640 1 -- 172.21.15.5:0/3874916455 >> v1:172.21.15.117:6789/0 conn(0x7f28e4070730 legacy=0x7f28e415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28e8a00640 1 -- 172.21.15.5:0/3874916455 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e415ee40 con 0x7f28e4161960 2024-08-18T22:31:43.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.847+0000 7f28e9400640 1 --2- 172.21.15.5:0/3874916455 >> v2:172.21.15.117:3300/0 conn(0x7f28e415e4b0 0x7f28e4070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:31:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28e8a00640 1 --2- 172.21.15.5:0/3874916455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4161960 0x7f28e406fd20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009870 tx=0x7f28d401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ae73e4bfbbb3ffe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28e3e00640 1 -- 172.21.15.5:0/3874916455 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40b2070 con 0x7f28e4161960 2024-08-18T22:31:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28e3e00640 1 -- 172.21.15.5:0/3874916455 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d40a9070 con 0x7f28e4161960 2024-08-18T22:31:43.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28e3e00640 1 -- 172.21.15.5:0/3874916455 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40ad880 con 0x7f28e4161960 2024-08-18T22:31:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 -- 172.21.15.5:0/3874916455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4161960 msgr2=0x7f28e406fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 --2- 172.21.15.5:0/3874916455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4161960 0x7f28e406fd20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009870 tx=0x7f28d401c560 comp rx=0 tx=0).stop 2024-08-18T22:31:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 -- 172.21.15.5:0/3874916455 shutdown_connections 2024-08-18T22:31:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 --2- 172.21.15.5:0/3874916455 >> v2:172.21.15.117:3300/0 conn(0x7f28e415e4b0 0x7f28e4070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 --2- 172.21.15.5:0/3874916455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e4161960 0x7f28e406fd20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 -- 172.21.15.5:0/3874916455 >> 172.21.15.5:0/3874916455 conn(0x7f28e40d2130 msgr2=0x7f28e40d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:43.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 -- 172.21.15.5:0/3874916455 shutdown_connections 2024-08-18T22:31:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 -- 172.21.15.5:0/3874916455 wait complete. 2024-08-18T22:31:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 Processor -- start 2024-08-18T22:31:43.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 -- start start 2024-08-18T22:31:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e4070730 0x7f28e415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415e4b0 0x7f28e415c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e4161960 0x7f28e415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f28e409ba30 con 0x7f28e4161960 2024-08-18T22:31:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4070260 con 0x7f28e4070730 2024-08-18T22:31:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.851+0000 7f28eb400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28e409dfd0 con 0x7f28e415e4b0 2024-08-18T22:31:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e4161960 0x7f28e415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e4161960 0x7f28e415c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51160/0 (socket says 172.21.15.5:51160) 2024-08-18T22:31:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e9400640 1 -- 172.21.15.5:0/4086785402 learned_addr learned my addr 172.21.15.5:0/4086785402 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:31:43.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e8a00640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e4070730 0x7f28e415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28dbe00640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415e4b0 0x7f28e415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e9400640 1 -- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415e4b0 msgr2=0x7f28e415c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e9400640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415e4b0 0x7f28e415c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e9400640 1 -- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e4070730 msgr2=0x7f28e415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e9400640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e4070730 0x7f28e415bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e9400640 1 -- 172.21.15.5:0/4086785402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e415dc50 con 0x7f28e4161960 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28dbe00640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415e4b0 0x7f28e415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e9400640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e4161960 0x7f28e415c990 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00efc0 tx=0x7f28dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e1600640 1 -- 172.21.15.5:0/4086785402 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc018030 con 0x7f28e4161960 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e1600640 1 -- 172.21.15.5:0/4086785402 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28dc00cdf0 con 0x7f28e4161960 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e1600640 1 -- 172.21.15.5:0/4086785402 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc003bc0 con 0x7f28e4161960 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28eb400640 1 -- 172.21.15.5:0/4086785402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e409d3c0 con 0x7f28e4161960 2024-08-18T22:31:43.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28eb400640 1 -- 172.21.15.5:0/4086785402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e409d980 con 0x7f28e4161960 2024-08-18T22:31:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28eb400640 1 -- 172.21.15.5:0/4086785402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e4070b70 con 0x7f28e4161960 2024-08-18T22:31:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.855+0000 7f28e1600640 1 -- 172.21.15.5:0/4086785402 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28dc01b070 con 0x7f28e4161960 2024-08-18T22:31:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.859+0000 7f28e1600640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28c00678c0 0x7f28c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:31:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.859+0000 7f28e1600640 1 -- 172.21.15.5:0/4086785402 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f28dc0867c0 con 0x7f28e4161960 2024-08-18T22:31:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.859+0000 7f28e8a00640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28c00678c0 0x7f28c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:31:43.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.859+0000 7f28e8a00640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28c00678c0 0x7f28c0069d80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f28d40af000 tx=0x7f28d40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:31:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:43.863+0000 7f28e1600640 1 -- 172.21.15.5:0/4086785402 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f28dc022070 con 0x7f28e4161960 2024-08-18T22:31:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.063+0000 7f28eb400640 1 -- 172.21.15.5:0/4086785402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f28e409bbb0 con 0x7f28e4161960 2024-08-18T22:31:44.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.063+0000 7f28e1600640 1 -- 172.21.15.5:0/4086785402 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v138) ==== 53+0+73 (secure 0 0 0) 0x7f28dc010040 con 0x7f28e4161960 2024-08-18T22:31:44.065 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:31:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 -- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28c00678c0 msgr2=0x7f28c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28c00678c0 0x7f28c0069d80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f28d40af000 tx=0x7f28d40a7000 comp rx=0 tx=0).stop 2024-08-18T22:31:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 -- 172.21.15.5:0/4086785402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e4161960 msgr2=0x7f28e415c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:31:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e4161960 0x7f28e415c990 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00efc0 tx=0x7f28dc00c490 comp rx=0 tx=0).stop 2024-08-18T22:31:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 -- 172.21.15.5:0/4086785402 shutdown_connections 2024-08-18T22:31:44.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f28c00678c0 0x7f28c0069d80 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:44.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28e4161960 0x7f28e415c990 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:44.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28e415e4b0 0x7f28e415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:44.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 --2- 172.21.15.5:0/4086785402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28e4070730 0x7f28e415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:31:44.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 -- 172.21.15.5:0/4086785402 >> 172.21.15.5:0/4086785402 conn(0x7f28e40d2130 msgr2=0x7f28e406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:31:44.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 -- 172.21.15.5:0/4086785402 shutdown_connections 2024-08-18T22:31:44.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44.067+0000 7f28eb400640 1 -- 172.21.15.5:0/4086785402 wait complete. 2024-08-18T22:31:44.086 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:31:44.086 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:31:44.086 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:31:44.086 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:31:44.086 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:31:44.086 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:31:44.086 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:31:44.086 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:31:44.087 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:31:44.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:31:44.087 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:31:44.096 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:31:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:31:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:31:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:31:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:31:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:31:44.096 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:31:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:31:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:31:44.096 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:31:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41697sec preferred_lft 41697sec 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:31:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:31:44.098 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:31:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:31:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:31:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:31:44.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:31:44.100 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:31:44.163 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:31:44.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:31:44.166 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:31:44.218 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:31:44.219 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:31:44.219 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:31:44.219 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:31:44.219 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:31:44.219 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:31:44.219 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:31:44.219 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:44.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:31:44.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:31:44.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:31:44.220 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:31:44.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:44.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:31:44.358 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:31:44.414 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:31:44.415 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:31:44.415 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:31:44.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:31:44.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:31:44.481 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:31:44.482 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:31:44.537 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:31:44.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:31:44.538 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:31:44.589 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:31:44.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:31:44.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:31:44.677 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:31:44.678 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:31:44.678 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:31:44.693 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:31:44.693 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:31:44.693 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:31:44.693 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:31:44.693 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:31:44.703 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:31:44.703 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:31:44.703 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:31:44.703 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:31:44.703 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:31:44.704 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:31:44.704 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:31:44.704 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:31:44.707 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:31:44.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:31:44.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:31:44.728 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:31:44.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:44.842 INFO:teuthology.orchestra.run.smithi005.stdout:client10098 2024-08-18T22:31:44.842 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:31:44.842 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:31:44.851 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:44.851 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:44.851 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.0 2024-08-18T22:31:44.851 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:44.851 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:44.851 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:44.851 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:44.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:44.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:44.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166128 s, 63.1 MB/s 2024-08-18T22:31:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.005 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219259 s, 47.8 MB/s 2024-08-18T22:31:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206082 s, 50.9 MB/s 2024-08-18T22:31:45.055 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236606 s, 44.3 MB/s 2024-08-18T22:31:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.075 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170788 s, 61.4 MB/s 2024-08-18T22:31:45.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.101 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.101 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234731 s, 44.7 MB/s 2024-08-18T22:31:45.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.124 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201675 s, 52.0 MB/s 2024-08-18T22:31:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189844 s, 55.2 MB/s 2024-08-18T22:31:45.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.171 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216123 s, 48.5 MB/s 2024-08-18T22:31:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.195 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215887 s, 48.6 MB/s 2024-08-18T22:31:45.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.217 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188648 s, 55.6 MB/s 2024-08-18T22:31:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020659 s, 50.8 MB/s 2024-08-18T22:31:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.260 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171411 s, 61.2 MB/s 2024-08-18T22:31:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160503 s, 65.3 MB/s 2024-08-18T22:31:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148974 s, 70.4 MB/s 2024-08-18T22:31:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024425 s, 42.9 MB/s 2024-08-18T22:31:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118796 s, 88.3 MB/s 2024-08-18T22:31:45.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210555 s, 49.8 MB/s 2024-08-18T22:31:45.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.384 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184938 s, 56.7 MB/s 2024-08-18T22:31:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.407 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200713 s, 52.2 MB/s 2024-08-18T22:31:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.424 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146107 s, 71.8 MB/s 2024-08-18T22:31:45.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.442 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147112 s, 71.3 MB/s 2024-08-18T22:31:45.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.457 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.457 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125158 s, 83.8 MB/s 2024-08-18T22:31:45.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143045 s, 73.3 MB/s 2024-08-18T22:31:45.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.496 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189661 s, 55.3 MB/s 2024-08-18T22:31:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145093 s, 72.3 MB/s 2024-08-18T22:31:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193617 s, 54.2 MB/s 2024-08-18T22:31:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.561 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218192 s, 48.1 MB/s 2024-08-18T22:31:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177001 s, 59.2 MB/s 2024-08-18T22:31:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198172 s, 52.9 MB/s 2024-08-18T22:31:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.622 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168029 s, 62.4 MB/s 2024-08-18T22:31:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147195 s, 71.2 MB/s 2024-08-18T22:31:45.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:45.646 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:45.647 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:45.647 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.1 2024-08-18T22:31:45.647 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:45.647 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:45.647 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:45.647 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:45.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:45.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.718 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150121 s, 69.8 MB/s 2024-08-18T22:31:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229607 s, 45.7 MB/s 2024-08-18T22:31:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168456 s, 62.2 MB/s 2024-08-18T22:31:45.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.782 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014454 s, 72.5 MB/s 2024-08-18T22:31:45.798 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144226 s, 72.7 MB/s 2024-08-18T22:31:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.824 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222031 s, 47.2 MB/s 2024-08-18T22:31:45.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156136 s, 67.2 MB/s 2024-08-18T22:31:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171902 s, 61.0 MB/s 2024-08-18T22:31:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146444 s, 71.6 MB/s 2024-08-18T22:31:45.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142261 s, 73.7 MB/s 2024-08-18T22:31:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165992 s, 63.2 MB/s 2024-08-18T22:31:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148871 s, 70.4 MB/s 2024-08-18T22:31:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153693 s, 68.2 MB/s 2024-08-18T22:31:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118739 s, 88.3 MB/s 2024-08-18T22:31:45.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:45.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:45.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143575 s, 73.0 MB/s 2024-08-18T22:31:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.000 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151609 s, 69.2 MB/s 2024-08-18T22:31:46.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147706 s, 71.0 MB/s 2024-08-18T22:31:46.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.033 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.033 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120146 s, 87.3 MB/s 2024-08-18T22:31:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150541 s, 69.7 MB/s 2024-08-18T22:31:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148808 s, 70.5 MB/s 2024-08-18T22:31:46.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.090 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173141 s, 60.6 MB/s 2024-08-18T22:31:46.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203624 s, 51.5 MB/s 2024-08-18T22:31:46.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.129 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153907 s, 68.1 MB/s 2024-08-18T22:31:46.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.146 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.146 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144564 s, 72.5 MB/s 2024-08-18T22:31:46.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200522 s, 52.3 MB/s 2024-08-18T22:31:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202465 s, 51.8 MB/s 2024-08-18T22:31:46.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.209 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147669 s, 71.0 MB/s 2024-08-18T22:31:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02102 s, 49.9 MB/s 2024-08-18T22:31:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147847 s, 70.9 MB/s 2024-08-18T22:31:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.269 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159442 s, 65.8 MB/s 2024-08-18T22:31:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209036 s, 50.2 MB/s 2024-08-18T22:31:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150927 s, 69.5 MB/s 2024-08-18T22:31:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:46.319 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:46.319 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:46.319 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.2 2024-08-18T22:31:46.319 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:46.319 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:46.319 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:46.320 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:46.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174991 s, 59.9 MB/s 2024-08-18T22:31:46.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175683 s, 59.7 MB/s 2024-08-18T22:31:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.431 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144715 s, 72.5 MB/s 2024-08-18T22:31:46.455 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214171 s, 49.0 MB/s 2024-08-18T22:31:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165047 s, 63.5 MB/s 2024-08-18T22:31:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165195 s, 63.5 MB/s 2024-08-18T22:31:46.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159928 s, 65.6 MB/s 2024-08-18T22:31:46.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180329 s, 58.1 MB/s 2024-08-18T22:31:46.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.555 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.555 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172689 s, 60.7 MB/s 2024-08-18T22:31:46.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167158 s, 62.7 MB/s 2024-08-18T22:31:46.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149283 s, 70.2 MB/s 2024-08-18T22:31:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122387 s, 85.7 MB/s 2024-08-18T22:31:46.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.626 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156833 s, 66.9 MB/s 2024-08-18T22:31:46.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.644 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147508 s, 71.1 MB/s 2024-08-18T22:31:46.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.662 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.662 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150273 s, 69.8 MB/s 2024-08-18T22:31:46.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174245 s, 60.2 MB/s 2024-08-18T22:31:46.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.702 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166884 s, 62.8 MB/s 2024-08-18T22:31:46.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.721 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.721 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151696 s, 69.1 MB/s 2024-08-18T22:31:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171318 s, 61.2 MB/s 2024-08-18T22:31:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145608 s, 72.0 MB/s 2024-08-18T22:31:46.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.778 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.778 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168082 s, 62.4 MB/s 2024-08-18T22:31:46.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149092 s, 70.3 MB/s 2024-08-18T22:31:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166941 s, 62.8 MB/s 2024-08-18T22:31:46.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.833 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015669 s, 66.9 MB/s 2024-08-18T22:31:46.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.851 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.851 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148285 s, 70.7 MB/s 2024-08-18T22:31:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146527 s, 71.6 MB/s 2024-08-18T22:31:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153137 s, 68.5 MB/s 2024-08-18T22:31:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149465 s, 70.2 MB/s 2024-08-18T22:31:46.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.921 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144107 s, 72.8 MB/s 2024-08-18T22:31:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.940 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160766 s, 65.2 MB/s 2024-08-18T22:31:46.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161239 s, 65.0 MB/s 2024-08-18T22:31:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149663 s, 70.1 MB/s 2024-08-18T22:31:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:46.984 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:46.984 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:46.984 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.3 2024-08-18T22:31:46.984 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:46.984 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:46.984 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:46.984 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:47.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147337 s, 71.2 MB/s 2024-08-18T22:31:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182123 s, 57.6 MB/s 2024-08-18T22:31:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124567 s, 84.2 MB/s 2024-08-18T22:31:47.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.108 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156488 s, 67.0 MB/s 2024-08-18T22:31:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142578 s, 73.5 MB/s 2024-08-18T22:31:47.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.145 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174804 s, 60.0 MB/s 2024-08-18T22:31:47.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.162 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.162 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140501 s, 74.6 MB/s 2024-08-18T22:31:47.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.180 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.180 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151934 s, 69.0 MB/s 2024-08-18T22:31:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194643 s, 53.9 MB/s 2024-08-18T22:31:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174471 s, 60.1 MB/s 2024-08-18T22:31:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.240 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146773 s, 71.4 MB/s 2024-08-18T22:31:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015774 s, 66.5 MB/s 2024-08-18T22:31:47.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.277 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161687 s, 64.9 MB/s 2024-08-18T22:31:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150795 s, 69.5 MB/s 2024-08-18T22:31:47.312 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.313 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015024 s, 69.8 MB/s 2024-08-18T22:31:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.330 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146701 s, 71.5 MB/s 2024-08-18T22:31:47.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144482 s, 72.6 MB/s 2024-08-18T22:31:47.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.368 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177933 s, 58.9 MB/s 2024-08-18T22:31:47.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.387 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.387 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170659 s, 61.4 MB/s 2024-08-18T22:31:47.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208648 s, 50.3 MB/s 2024-08-18T22:31:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142583 s, 73.5 MB/s 2024-08-18T22:31:47.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168886 s, 62.1 MB/s 2024-08-18T22:31:47.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148828 s, 70.5 MB/s 2024-08-18T22:31:47.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143099 s, 73.3 MB/s 2024-08-18T22:31:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.500 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148293 s, 70.7 MB/s 2024-08-18T22:31:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.517 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146399 s, 71.6 MB/s 2024-08-18T22:31:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.543 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233061 s, 45.0 MB/s 2024-08-18T22:31:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156472 s, 67.0 MB/s 2024-08-18T22:31:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.581 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168091 s, 62.4 MB/s 2024-08-18T22:31:47.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.599 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150091 s, 69.9 MB/s 2024-08-18T22:31:47.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240532 s, 43.6 MB/s 2024-08-18T22:31:47.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168885 s, 62.1 MB/s 2024-08-18T22:31:47.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:47.652 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:47.652 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:47.653 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.4 2024-08-18T22:31:47.653 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:47.653 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:47.653 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:47.653 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:47.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181712 s, 57.7 MB/s 2024-08-18T22:31:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.746 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016474 s, 63.7 MB/s 2024-08-18T22:31:47.766 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.767 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181703 s, 57.7 MB/s 2024-08-18T22:31:47.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.787 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.788 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182946 s, 57.3 MB/s 2024-08-18T22:31:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010727 s, 97.8 MB/s 2024-08-18T22:31:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154212 s, 68.0 MB/s 2024-08-18T22:31:47.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172008 s, 61.0 MB/s 2024-08-18T22:31:47.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.860 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.860 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177336 s, 59.1 MB/s 2024-08-18T22:31:47.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.878 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.879 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159804 s, 65.6 MB/s 2024-08-18T22:31:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169485 s, 61.9 MB/s 2024-08-18T22:31:47.924 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.925 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.925 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233546 s, 44.9 MB/s 2024-08-18T22:31:47.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166944 s, 62.8 MB/s 2024-08-18T22:31:47.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174318 s, 60.2 MB/s 2024-08-18T22:31:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157918 s, 66.4 MB/s 2024-08-18T22:31:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151468 s, 69.2 MB/s 2024-08-18T22:31:48.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.018 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.018 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144383 s, 72.6 MB/s 2024-08-18T22:31:48.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.038 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.038 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168519 s, 62.2 MB/s 2024-08-18T22:31:48.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.056 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.056 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151564 s, 69.2 MB/s 2024-08-18T22:31:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.075 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158808 s, 66.0 MB/s 2024-08-18T22:31:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157354 s, 66.6 MB/s 2024-08-18T22:31:48.117 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.118 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216197 s, 48.5 MB/s 2024-08-18T22:31:48.135 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.136 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.136 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015313 s, 68.5 MB/s 2024-08-18T22:31:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147259 s, 71.2 MB/s 2024-08-18T22:31:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177317 s, 59.1 MB/s 2024-08-18T22:31:48.194 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183328 s, 57.2 MB/s 2024-08-18T22:31:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.218 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205455 s, 51.0 MB/s 2024-08-18T22:31:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147995 s, 70.9 MB/s 2024-08-18T22:31:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.252 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145672 s, 72.0 MB/s 2024-08-18T22:31:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147827 s, 70.9 MB/s 2024-08-18T22:31:48.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.290 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170403 s, 61.5 MB/s 2024-08-18T22:31:48.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015423 s, 68.0 MB/s 2024-08-18T22:31:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016719 s, 62.7 MB/s 2024-08-18T22:31:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:48.336 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:48.336 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:48.336 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.5 2024-08-18T22:31:48.336 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:48.336 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:48.336 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:48.336 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:48.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:48.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163964 s, 64.0 MB/s 2024-08-18T22:31:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167926 s, 62.4 MB/s 2024-08-18T22:31:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145483 s, 72.1 MB/s 2024-08-18T22:31:48.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.469 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218355 s, 48.0 MB/s 2024-08-18T22:31:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.486 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140129 s, 74.8 MB/s 2024-08-18T22:31:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153137 s, 68.5 MB/s 2024-08-18T22:31:48.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.523 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.523 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158944 s, 66.0 MB/s 2024-08-18T22:31:48.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.541 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152599 s, 68.7 MB/s 2024-08-18T22:31:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.565 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215224 s, 48.7 MB/s 2024-08-18T22:31:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.588 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195904 s, 53.5 MB/s 2024-08-18T22:31:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.605 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149982 s, 69.9 MB/s 2024-08-18T22:31:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.629 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213288 s, 49.2 MB/s 2024-08-18T22:31:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.647 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151559 s, 69.2 MB/s 2024-08-18T22:31:48.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216674 s, 48.4 MB/s 2024-08-18T22:31:48.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014522 s, 72.2 MB/s 2024-08-18T22:31:48.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153385 s, 68.4 MB/s 2024-08-18T22:31:48.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.726 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162944 s, 64.4 MB/s 2024-08-18T22:31:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151284 s, 69.3 MB/s 2024-08-18T22:31:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019864 s, 52.8 MB/s 2024-08-18T22:31:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160685 s, 65.3 MB/s 2024-08-18T22:31:48.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.809 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212002 s, 49.5 MB/s 2024-08-18T22:31:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151014 s, 69.4 MB/s 2024-08-18T22:31:48.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.845 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157845 s, 66.4 MB/s 2024-08-18T22:31:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175125 s, 59.9 MB/s 2024-08-18T22:31:48.883 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.884 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149844 s, 70.0 MB/s 2024-08-18T22:31:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156386 s, 67.1 MB/s 2024-08-18T22:31:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153219 s, 68.4 MB/s 2024-08-18T22:31:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.938 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143331 s, 73.2 MB/s 2024-08-18T22:31:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177326 s, 59.1 MB/s 2024-08-18T22:31:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216879 s, 48.3 MB/s 2024-08-18T22:31:49.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.001 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.001 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150894 s, 69.5 MB/s 2024-08-18T22:31:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157377 s, 66.6 MB/s 2024-08-18T22:31:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:49.027 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:49.027 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:49.027 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.6 2024-08-18T22:31:49.027 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:49.027 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:49.027 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:49.028 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:49.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.098 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.099 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014754 s, 71.1 MB/s 2024-08-18T22:31:49.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.116 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.116 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142762 s, 73.4 MB/s 2024-08-18T22:31:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.134 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015101 s, 69.4 MB/s 2024-08-18T22:31:49.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.161 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.161 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244598 s, 42.9 MB/s 2024-08-18T22:31:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153727 s, 68.2 MB/s 2024-08-18T22:31:49.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016314 s, 64.3 MB/s 2024-08-18T22:31:49.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.216 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014681 s, 71.4 MB/s 2024-08-18T22:31:49.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152006 s, 69.0 MB/s 2024-08-18T22:31:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146908 s, 71.4 MB/s 2024-08-18T22:31:49.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.272 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165326 s, 63.4 MB/s 2024-08-18T22:31:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155511 s, 67.4 MB/s 2024-08-18T22:31:49.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.309 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147493 s, 71.1 MB/s 2024-08-18T22:31:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126721 s, 82.7 MB/s 2024-08-18T22:31:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247259 s, 42.4 MB/s 2024-08-18T22:31:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147326 s, 71.2 MB/s 2024-08-18T22:31:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166283 s, 63.1 MB/s 2024-08-18T22:31:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.408 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147631 s, 71.0 MB/s 2024-08-18T22:31:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164224 s, 63.9 MB/s 2024-08-18T22:31:49.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144211 s, 72.7 MB/s 2024-08-18T22:31:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165662 s, 63.3 MB/s 2024-08-18T22:31:49.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148195 s, 70.8 MB/s 2024-08-18T22:31:49.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.500 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014335 s, 73.1 MB/s 2024-08-18T22:31:49.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.517 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144466 s, 72.6 MB/s 2024-08-18T22:31:49.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140593 s, 74.6 MB/s 2024-08-18T22:31:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159598 s, 65.7 MB/s 2024-08-18T22:31:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218437 s, 48.0 MB/s 2024-08-18T22:31:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153156 s, 68.5 MB/s 2024-08-18T22:31:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242512 s, 43.2 MB/s 2024-08-18T22:31:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015213 s, 68.9 MB/s 2024-08-18T22:31:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.660 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165887 s, 63.2 MB/s 2024-08-18T22:31:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.679 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163299 s, 64.2 MB/s 2024-08-18T22:31:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190661 s, 55.0 MB/s 2024-08-18T22:31:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:49.708 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:49.708 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:49.708 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.7 2024-08-18T22:31:49.708 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:49.709 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:49.709 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:49.709 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.775 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107203 s, 97.8 MB/s 2024-08-18T22:31:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173635 s, 60.4 MB/s 2024-08-18T22:31:49.814 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016499 s, 63.6 MB/s 2024-08-18T22:31:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.833 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160607 s, 65.3 MB/s 2024-08-18T22:31:49.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.848 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.848 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122086 s, 85.9 MB/s 2024-08-18T22:31:49.866 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163006 s, 64.3 MB/s 2024-08-18T22:31:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.884 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150236 s, 69.8 MB/s 2024-08-18T22:31:49.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148627 s, 70.6 MB/s 2024-08-18T22:31:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152695 s, 68.7 MB/s 2024-08-18T22:31:49.937 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.938 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149576 s, 70.1 MB/s 2024-08-18T22:31:49.955 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.955 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.956 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149352 s, 70.2 MB/s 2024-08-18T22:31:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152488 s, 68.8 MB/s 2024-08-18T22:31:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016958 s, 61.8 MB/s 2024-08-18T22:31:50.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.016 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197442 s, 53.1 MB/s 2024-08-18T22:31:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.035 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166095 s, 63.1 MB/s 2024-08-18T22:31:50.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.054 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161891 s, 64.8 MB/s 2024-08-18T22:31:50.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.074 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.074 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177812 s, 59.0 MB/s 2024-08-18T22:31:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156286 s, 67.1 MB/s 2024-08-18T22:31:50.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150385 s, 69.7 MB/s 2024-08-18T22:31:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149136 s, 70.3 MB/s 2024-08-18T22:31:50.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167801 s, 62.5 MB/s 2024-08-18T22:31:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.165 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144605 s, 72.5 MB/s 2024-08-18T22:31:50.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.185 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.185 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180373 s, 58.1 MB/s 2024-08-18T22:31:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.203 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144278 s, 72.7 MB/s 2024-08-18T22:31:50.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.221 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152626 s, 68.7 MB/s 2024-08-18T22:31:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145227 s, 72.2 MB/s 2024-08-18T22:31:50.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.257 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163119 s, 64.3 MB/s 2024-08-18T22:31:50.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.277 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.277 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168545 s, 62.2 MB/s 2024-08-18T22:31:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165946 s, 63.2 MB/s 2024-08-18T22:31:50.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.314 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148111 s, 70.8 MB/s 2024-08-18T22:31:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147966 s, 70.9 MB/s 2024-08-18T22:31:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165942 s, 63.2 MB/s 2024-08-18T22:31:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:50.359 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:50.359 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:50.359 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.8 2024-08-18T22:31:50.359 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:50.359 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:50.359 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:50.359 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:50.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:50.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.429 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146969 s, 71.3 MB/s 2024-08-18T22:31:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138254 s, 75.8 MB/s 2024-08-18T22:31:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152626 s, 68.7 MB/s 2024-08-18T22:31:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167255 s, 62.7 MB/s 2024-08-18T22:31:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.502 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168533 s, 62.2 MB/s 2024-08-18T22:31:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.522 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171176 s, 61.3 MB/s 2024-08-18T22:31:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.540 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154237 s, 68.0 MB/s 2024-08-18T22:31:50.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010879 s, 96.4 MB/s 2024-08-18T22:31:50.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144697 s, 72.5 MB/s 2024-08-18T22:31:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198522 s, 52.8 MB/s 2024-08-18T22:31:50.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.613 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169829 s, 61.7 MB/s 2024-08-18T22:31:50.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.629 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.629 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142038 s, 73.8 MB/s 2024-08-18T22:31:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.650 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175649 s, 59.7 MB/s 2024-08-18T22:31:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149368 s, 70.2 MB/s 2024-08-18T22:31:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.690 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194911 s, 53.8 MB/s 2024-08-18T22:31:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167516 s, 62.6 MB/s 2024-08-18T22:31:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153761 s, 68.2 MB/s 2024-08-18T22:31:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147298 s, 71.2 MB/s 2024-08-18T22:31:50.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.763 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.763 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159752 s, 65.6 MB/s 2024-08-18T22:31:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171567 s, 61.1 MB/s 2024-08-18T22:31:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179691 s, 58.4 MB/s 2024-08-18T22:31:50.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.827 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.827 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207487 s, 50.5 MB/s 2024-08-18T22:31:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147171 s, 71.2 MB/s 2024-08-18T22:31:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014692 s, 71.4 MB/s 2024-08-18T22:31:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150074 s, 69.9 MB/s 2024-08-18T22:31:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143427 s, 73.1 MB/s 2024-08-18T22:31:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164637 s, 63.7 MB/s 2024-08-18T22:31:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.934 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150594 s, 69.6 MB/s 2024-08-18T22:31:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015048 s, 69.7 MB/s 2024-08-18T22:31:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161987 s, 64.7 MB/s 2024-08-18T22:31:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:50.989 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152859 s, 68.6 MB/s 2024-08-18T22:31:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169559 s, 61.8 MB/s 2024-08-18T22:31:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:51.016 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:51.016 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:51.016 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.9 2024-08-18T22:31:51.016 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:51.016 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:51.016 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:51.016 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:51.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203347 s, 51.6 MB/s 2024-08-18T22:31:51.113 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.114 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.114 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187505 s, 55.9 MB/s 2024-08-18T22:31:51.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.131 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149798 s, 70.0 MB/s 2024-08-18T22:31:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144488 s, 72.6 MB/s 2024-08-18T22:31:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177265 s, 59.2 MB/s 2024-08-18T22:31:51.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.188 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169268 s, 61.9 MB/s 2024-08-18T22:31:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.215 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241588 s, 43.4 MB/s 2024-08-18T22:31:51.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168162 s, 62.4 MB/s 2024-08-18T22:31:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017166 s, 61.1 MB/s 2024-08-18T22:31:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.278 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208611 s, 50.3 MB/s 2024-08-18T22:31:51.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.296 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.296 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149001 s, 70.4 MB/s 2024-08-18T22:31:51.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.315 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.315 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161946 s, 64.7 MB/s 2024-08-18T22:31:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172083 s, 60.9 MB/s 2024-08-18T22:31:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144836 s, 72.4 MB/s 2024-08-18T22:31:51.368 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.369 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.369 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142938 s, 73.4 MB/s 2024-08-18T22:31:51.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.393 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.393 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214575 s, 48.9 MB/s 2024-08-18T22:31:51.412 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.413 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.413 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168289 s, 62.3 MB/s 2024-08-18T22:31:51.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.430 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.430 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150636 s, 69.6 MB/s 2024-08-18T22:31:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144935 s, 72.3 MB/s 2024-08-18T22:31:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149346 s, 70.2 MB/s 2024-08-18T22:31:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151228 s, 69.3 MB/s 2024-08-18T22:31:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.500 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139879 s, 75.0 MB/s 2024-08-18T22:31:51.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.522 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196363 s, 53.4 MB/s 2024-08-18T22:31:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.540 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145242 s, 72.2 MB/s 2024-08-18T22:31:51.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.556 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.556 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139274 s, 75.3 MB/s 2024-08-18T22:31:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016185 s, 64.8 MB/s 2024-08-18T22:31:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181081 s, 57.9 MB/s 2024-08-18T22:31:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206406 s, 50.8 MB/s 2024-08-18T22:31:51.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.639 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172421 s, 60.8 MB/s 2024-08-18T22:31:51.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172704 s, 60.7 MB/s 2024-08-18T22:31:51.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.686 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236955 s, 44.3 MB/s 2024-08-18T22:31:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156943 s, 66.8 MB/s 2024-08-18T22:31:51.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:51.712 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:51.712 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:51.712 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.10 2024-08-18T22:31:51.712 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:51.712 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:51.712 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:51.712 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:51.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:51.782 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.782 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.782 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144769 s, 72.4 MB/s 2024-08-18T22:31:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158637 s, 66.1 MB/s 2024-08-18T22:31:51.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152644 s, 68.7 MB/s 2024-08-18T22:31:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169631 s, 61.8 MB/s 2024-08-18T22:31:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.864 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222968 s, 47.0 MB/s 2024-08-18T22:31:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.882 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01588 s, 66.0 MB/s 2024-08-18T22:31:51.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.900 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146641 s, 71.5 MB/s 2024-08-18T22:31:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146907 s, 71.4 MB/s 2024-08-18T22:31:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.935 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148719 s, 70.5 MB/s 2024-08-18T22:31:51.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.952 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150265 s, 69.8 MB/s 2024-08-18T22:31:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156903 s, 66.8 MB/s 2024-08-18T22:31:51.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:51.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:51.987 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139781 s, 75.0 MB/s 2024-08-18T22:31:52.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.007 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.008 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017646 s, 59.4 MB/s 2024-08-18T22:31:52.024 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.025 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014416 s, 72.7 MB/s 2024-08-18T22:31:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.046 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018807 s, 55.8 MB/s 2024-08-18T22:31:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183058 s, 57.3 MB/s 2024-08-18T22:31:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145684 s, 72.0 MB/s 2024-08-18T22:31:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195431 s, 53.7 MB/s 2024-08-18T22:31:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146257 s, 71.7 MB/s 2024-08-18T22:31:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.144 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175326 s, 59.8 MB/s 2024-08-18T22:31:52.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164231 s, 63.8 MB/s 2024-08-18T22:31:52.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.183 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016539 s, 63.4 MB/s 2024-08-18T22:31:52.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.201 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.201 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158748 s, 66.1 MB/s 2024-08-18T22:31:52.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.221 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.221 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169236 s, 62.0 MB/s 2024-08-18T22:31:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146119 s, 71.8 MB/s 2024-08-18T22:31:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.258 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017154 s, 61.1 MB/s 2024-08-18T22:31:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014419 s, 72.7 MB/s 2024-08-18T22:31:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175776 s, 59.7 MB/s 2024-08-18T22:31:52.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.313 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.313 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150934 s, 69.5 MB/s 2024-08-18T22:31:52.330 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.331 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145887 s, 71.9 MB/s 2024-08-18T22:31:52.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.474 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138363 s, 75.8 MB/s 2024-08-18T22:31:52.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.476 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143306 s, 73.2 MB/s 2024-08-18T22:31:52.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:52.477 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:52.477 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:52.477 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.11 2024-08-18T22:31:52.477 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:52.477 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:52.477 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:52.477 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:52.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169114 s, 62.0 MB/s 2024-08-18T22:31:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.573 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157503 s, 66.6 MB/s 2024-08-18T22:31:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.591 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151712 s, 69.1 MB/s 2024-08-18T22:31:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014187 s, 73.9 MB/s 2024-08-18T22:31:52.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151526 s, 69.2 MB/s 2024-08-18T22:31:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173603 s, 60.4 MB/s 2024-08-18T22:31:52.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.663 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.663 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015036 s, 69.7 MB/s 2024-08-18T22:31:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114842 s, 91.3 MB/s 2024-08-18T22:31:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159859 s, 65.6 MB/s 2024-08-18T22:31:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194485 s, 53.9 MB/s 2024-08-18T22:31:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161508 s, 64.9 MB/s 2024-08-18T22:31:52.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.755 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147597 s, 71.0 MB/s 2024-08-18T22:31:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127896 s, 82.0 MB/s 2024-08-18T22:31:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016974 s, 61.8 MB/s 2024-08-18T22:31:52.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.810 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172823 s, 60.7 MB/s 2024-08-18T22:31:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174152 s, 60.2 MB/s 2024-08-18T22:31:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166514 s, 63.0 MB/s 2024-08-18T22:31:52.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.870 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182901 s, 57.3 MB/s 2024-08-18T22:31:52.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.890 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169159 s, 62.0 MB/s 2024-08-18T22:31:52.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02061 s, 50.9 MB/s 2024-08-18T22:31:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020683 s, 50.7 MB/s 2024-08-18T22:31:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181044 s, 57.9 MB/s 2024-08-18T22:31:52.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.977 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154222 s, 68.0 MB/s 2024-08-18T22:31:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166813 s, 62.9 MB/s 2024-08-18T22:31:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180073 s, 58.2 MB/s 2024-08-18T22:31:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177642 s, 59.0 MB/s 2024-08-18T22:31:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167785 s, 62.5 MB/s 2024-08-18T22:31:53.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.076 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.077 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168318 s, 62.3 MB/s 2024-08-18T22:31:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149347 s, 70.2 MB/s 2024-08-18T22:31:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150589 s, 69.6 MB/s 2024-08-18T22:31:53.130 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.130 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.130 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155226 s, 67.6 MB/s 2024-08-18T22:31:53.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.147 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140404 s, 74.7 MB/s 2024-08-18T22:31:53.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:53.154 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:53.154 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:53.154 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.12 2024-08-18T22:31:53.155 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:53.155 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:53.155 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:53.155 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:53.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:53.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.224 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.224 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144106 s, 72.8 MB/s 2024-08-18T22:31:53.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.243 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168783 s, 62.1 MB/s 2024-08-18T22:31:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016453 s, 63.7 MB/s 2024-08-18T22:31:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152707 s, 68.7 MB/s 2024-08-18T22:31:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206131 s, 50.9 MB/s 2024-08-18T22:31:53.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.323 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147067 s, 71.3 MB/s 2024-08-18T22:31:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156219 s, 67.1 MB/s 2024-08-18T22:31:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151728 s, 69.1 MB/s 2024-08-18T22:31:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175897 s, 59.6 MB/s 2024-08-18T22:31:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205931 s, 50.9 MB/s 2024-08-18T22:31:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145184 s, 72.2 MB/s 2024-08-18T22:31:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143376 s, 73.1 MB/s 2024-08-18T22:31:53.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161641 s, 64.9 MB/s 2024-08-18T22:31:53.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.476 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143408 s, 73.1 MB/s 2024-08-18T22:31:53.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.495 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165996 s, 63.2 MB/s 2024-08-18T22:31:53.513 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154039 s, 68.1 MB/s 2024-08-18T22:31:53.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.532 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144828 s, 72.4 MB/s 2024-08-18T22:31:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145572 s, 72.0 MB/s 2024-08-18T22:31:53.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138219 s, 75.9 MB/s 2024-08-18T22:31:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01477 s, 71.0 MB/s 2024-08-18T22:31:53.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.602 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.602 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150107 s, 69.9 MB/s 2024-08-18T22:31:53.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.624 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194152 s, 54.0 MB/s 2024-08-18T22:31:53.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152719 s, 68.7 MB/s 2024-08-18T22:31:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014565 s, 72.0 MB/s 2024-08-18T22:31:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.680 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172702 s, 60.7 MB/s 2024-08-18T22:31:53.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.707 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.707 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237782 s, 44.1 MB/s 2024-08-18T22:31:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204464 s, 51.3 MB/s 2024-08-18T22:31:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163653 s, 64.1 MB/s 2024-08-18T22:31:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172451 s, 60.8 MB/s 2024-08-18T22:31:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182396 s, 57.5 MB/s 2024-08-18T22:31:53.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.812 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.812 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174436 s, 60.1 MB/s 2024-08-18T22:31:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151425 s, 69.2 MB/s 2024-08-18T22:31:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:53.837 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:53.837 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:53.838 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.13 2024-08-18T22:31:53.838 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:53.838 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:53.838 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:53.838 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:53.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.909 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.909 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154533 s, 67.9 MB/s 2024-08-18T22:31:53.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.929 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.930 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177197 s, 59.2 MB/s 2024-08-18T22:31:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199522 s, 52.6 MB/s 2024-08-18T22:31:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243551 s, 43.1 MB/s 2024-08-18T22:31:54.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.005 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205151 s, 51.1 MB/s 2024-08-18T22:31:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150355 s, 69.7 MB/s 2024-08-18T22:31:54.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:31:54.027 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:31:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.041 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.042 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154685 s, 67.8 MB/s 2024-08-18T22:31:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020835 s, 50.3 MB/s 2024-08-18T22:31:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.091 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219666 s, 47.7 MB/s 2024-08-18T22:31:54.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172994 s, 60.6 MB/s 2024-08-18T22:31:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015748 s, 66.6 MB/s 2024-08-18T22:31:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.148 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156817 s, 66.9 MB/s 2024-08-18T22:31:54.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.169 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.169 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170176 s, 61.6 MB/s 2024-08-18T22:31:54.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.186 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150597 s, 69.6 MB/s 2024-08-18T22:31:54.204 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150503 s, 69.7 MB/s 2024-08-18T22:31:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148928 s, 70.4 MB/s 2024-08-18T22:31:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216708 s, 48.4 MB/s 2024-08-18T22:31:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.264 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139857 s, 75.0 MB/s 2024-08-18T22:31:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153934 s, 68.1 MB/s 2024-08-18T22:31:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.301 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153453 s, 68.3 MB/s 2024-08-18T22:31:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197278 s, 53.2 MB/s 2024-08-18T22:31:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168229 s, 62.3 MB/s 2024-08-18T22:31:54.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.363 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.363 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161762 s, 64.8 MB/s 2024-08-18T22:31:54.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250038 s, 41.9 MB/s 2024-08-18T22:31:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.409 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147798 s, 70.9 MB/s 2024-08-18T22:31:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012199 s, 86.0 MB/s 2024-08-18T22:31:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196346 s, 53.4 MB/s 2024-08-18T22:31:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.464 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.465 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146974 s, 71.3 MB/s 2024-08-18T22:31:54.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210681 s, 49.8 MB/s 2024-08-18T22:31:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.506 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147457 s, 71.1 MB/s 2024-08-18T22:31:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.531 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212779 s, 49.3 MB/s 2024-08-18T22:31:54.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.548 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145864 s, 71.9 MB/s 2024-08-18T22:31:54.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:54.556 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:54.556 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:54.556 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.14 2024-08-18T22:31:54.556 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:54.556 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:54.556 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:54.556 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:54.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:54.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.667 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146845 s, 71.4 MB/s 2024-08-18T22:31:54.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.686 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155502 s, 67.4 MB/s 2024-08-18T22:31:54.710 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.710 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.710 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211888 s, 49.5 MB/s 2024-08-18T22:31:54.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.729 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.729 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155836 s, 67.3 MB/s 2024-08-18T22:31:54.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.745 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.746 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140371 s, 74.7 MB/s 2024-08-18T22:31:54.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.772 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238109 s, 44.0 MB/s 2024-08-18T22:31:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.790 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156181 s, 67.1 MB/s 2024-08-18T22:31:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182983 s, 57.3 MB/s 2024-08-18T22:31:54.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.831 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.831 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168904 s, 62.1 MB/s 2024-08-18T22:31:54.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.850 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.850 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166294 s, 63.1 MB/s 2024-08-18T22:31:54.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.868 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.868 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157758 s, 66.5 MB/s 2024-08-18T22:31:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150948 s, 69.5 MB/s 2024-08-18T22:31:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165492 s, 63.4 MB/s 2024-08-18T22:31:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165288 s, 63.4 MB/s 2024-08-18T22:31:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.944 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145641 s, 72.0 MB/s 2024-08-18T22:31:54.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.963 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.963 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163771 s, 64.0 MB/s 2024-08-18T22:31:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:54.987 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201772 s, 52.0 MB/s 2024-08-18T22:31:55.004 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.005 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.005 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014755 s, 71.1 MB/s 2024-08-18T22:31:55.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150913 s, 69.5 MB/s 2024-08-18T22:31:55.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.042 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.042 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161923 s, 64.8 MB/s 2024-08-18T22:31:55.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.059 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.059 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144675 s, 72.5 MB/s 2024-08-18T22:31:55.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.077 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.078 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150568 s, 69.6 MB/s 2024-08-18T22:31:55.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.095 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.095 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148643 s, 70.5 MB/s 2024-08-18T22:31:55.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.115 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168551 s, 62.2 MB/s 2024-08-18T22:31:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.133 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153765 s, 68.2 MB/s 2024-08-18T22:31:55.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.154 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.154 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170003 s, 61.7 MB/s 2024-08-18T22:31:55.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.168 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.168 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116232 s, 90.2 MB/s 2024-08-18T22:31:55.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.189 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.189 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171388 s, 61.2 MB/s 2024-08-18T22:31:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195769 s, 53.6 MB/s 2024-08-18T22:31:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166622 s, 62.9 MB/s 2024-08-18T22:31:55.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.255 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.255 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207292 s, 50.6 MB/s 2024-08-18T22:31:55.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.276 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.276 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177593 s, 59.0 MB/s 2024-08-18T22:31:55.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:55.283 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:55.283 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:55.283 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.15 2024-08-18T22:31:55.283 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:55.283 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:55.284 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:55.284 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:55.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.401 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.401 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164028 s, 63.9 MB/s 2024-08-18T22:31:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171494 s, 61.1 MB/s 2024-08-18T22:31:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227207 s, 46.2 MB/s 2024-08-18T22:31:55.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.470 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.470 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206838 s, 50.7 MB/s 2024-08-18T22:31:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166649 s, 62.9 MB/s 2024-08-18T22:31:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247858 s, 42.3 MB/s 2024-08-18T22:31:55.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.535 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146988 s, 71.3 MB/s 2024-08-18T22:31:55.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.553 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154863 s, 67.7 MB/s 2024-08-18T22:31:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182811 s, 57.4 MB/s 2024-08-18T22:31:55.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.593 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160639 s, 65.3 MB/s 2024-08-18T22:31:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150605 s, 69.6 MB/s 2024-08-18T22:31:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.633 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020235 s, 51.8 MB/s 2024-08-18T22:31:55.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.651 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.651 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148547 s, 70.6 MB/s 2024-08-18T22:31:55.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.669 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.669 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015932 s, 65.8 MB/s 2024-08-18T22:31:55.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.688 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163138 s, 64.3 MB/s 2024-08-18T22:31:55.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.705 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.705 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144857 s, 72.4 MB/s 2024-08-18T22:31:55.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146165 s, 71.7 MB/s 2024-08-18T22:31:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.740 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145427 s, 72.1 MB/s 2024-08-18T22:31:55.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.758 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014486 s, 72.4 MB/s 2024-08-18T22:31:55.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.776 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151337 s, 69.3 MB/s 2024-08-18T22:31:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152789 s, 68.6 MB/s 2024-08-18T22:31:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175594 s, 59.7 MB/s 2024-08-18T22:31:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163866 s, 64.0 MB/s 2024-08-18T22:31:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177806 s, 59.0 MB/s 2024-08-18T22:31:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.873 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151982 s, 69.0 MB/s 2024-08-18T22:31:55.890 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146395 s, 71.6 MB/s 2024-08-18T22:31:55.910 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.911 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169827 s, 61.7 MB/s 2024-08-18T22:31:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022265 s, 47.1 MB/s 2024-08-18T22:31:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142118 s, 73.8 MB/s 2024-08-18T22:31:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153633 s, 68.3 MB/s 2024-08-18T22:31:55.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:55.988 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:55.988 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014705 s, 71.3 MB/s 2024-08-18T22:31:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165963 s, 63.2 MB/s 2024-08-18T22:31:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:56.015 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:56.016 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:56.016 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.16 2024-08-18T22:31:56.016 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:56.016 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:56.016 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:56.016 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:56.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:56.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213344 s, 49.1 MB/s 2024-08-18T22:31:56.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154155 s, 68.0 MB/s 2024-08-18T22:31:56.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.127 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.127 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148198 s, 70.8 MB/s 2024-08-18T22:31:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153921 s, 68.1 MB/s 2024-08-18T22:31:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241215 s, 43.5 MB/s 2024-08-18T22:31:56.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149916 s, 69.9 MB/s 2024-08-18T22:31:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.207 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145143 s, 72.2 MB/s 2024-08-18T22:31:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.227 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017364 s, 60.4 MB/s 2024-08-18T22:31:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240898 s, 43.5 MB/s 2024-08-18T22:31:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144947 s, 72.3 MB/s 2024-08-18T22:31:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170291 s, 61.6 MB/s 2024-08-18T22:31:56.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.311 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.311 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170701 s, 61.4 MB/s 2024-08-18T22:31:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.329 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015087 s, 69.5 MB/s 2024-08-18T22:31:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.346 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148319 s, 70.7 MB/s 2024-08-18T22:31:56.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.364 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.364 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146514 s, 71.6 MB/s 2024-08-18T22:31:56.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.381 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.381 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144415 s, 72.6 MB/s 2024-08-18T22:31:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.398 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146197 s, 71.7 MB/s 2024-08-18T22:31:56.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.417 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.417 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156274 s, 67.1 MB/s 2024-08-18T22:31:56.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.436 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.436 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159401 s, 65.8 MB/s 2024-08-18T22:31:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.454 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153667 s, 68.2 MB/s 2024-08-18T22:31:56.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.478 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.478 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214272 s, 48.9 MB/s 2024-08-18T22:31:56.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.495 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147741 s, 71.0 MB/s 2024-08-18T22:31:56.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178722 s, 58.7 MB/s 2024-08-18T22:31:56.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.539 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203321 s, 51.6 MB/s 2024-08-18T22:31:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.558 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165401 s, 63.4 MB/s 2024-08-18T22:31:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.576 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155662 s, 67.4 MB/s 2024-08-18T22:31:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195339 s, 53.7 MB/s 2024-08-18T22:31:56.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217761 s, 48.2 MB/s 2024-08-18T22:31:56.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193798 s, 54.1 MB/s 2024-08-18T22:31:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197222 s, 53.2 MB/s 2024-08-18T22:31:56.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.686 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.686 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156024 s, 67.2 MB/s 2024-08-18T22:31:56.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172602 s, 60.8 MB/s 2024-08-18T22:31:56.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:56.713 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:56.713 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:56.714 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.17 2024-08-18T22:31:56.714 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:56.714 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:56.714 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:56.714 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:56.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.785 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.786 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165794 s, 63.2 MB/s 2024-08-18T22:31:56.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.805 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.805 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166725 s, 62.9 MB/s 2024-08-18T22:31:56.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.825 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173156 s, 60.6 MB/s 2024-08-18T22:31:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016566 s, 63.3 MB/s 2024-08-18T22:31:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170307 s, 61.6 MB/s 2024-08-18T22:31:56.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.882 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161002 s, 65.1 MB/s 2024-08-18T22:31:56.899 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.899 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.899 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144204 s, 72.7 MB/s 2024-08-18T22:31:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.916 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.917 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143846 s, 72.9 MB/s 2024-08-18T22:31:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154481 s, 67.9 MB/s 2024-08-18T22:31:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.952 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145297 s, 72.2 MB/s 2024-08-18T22:31:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.972 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174617 s, 60.0 MB/s 2024-08-18T22:31:56.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:56.991 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:56.991 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161551 s, 64.9 MB/s 2024-08-18T22:31:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145748 s, 71.9 MB/s 2024-08-18T22:31:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161691 s, 64.9 MB/s 2024-08-18T22:31:57.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.048 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176846 s, 59.3 MB/s 2024-08-18T22:31:57.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.066 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.066 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016119 s, 65.1 MB/s 2024-08-18T22:31:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167096 s, 62.8 MB/s 2024-08-18T22:31:57.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.104 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.104 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015365 s, 68.2 MB/s 2024-08-18T22:31:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.122 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.122 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149673 s, 70.1 MB/s 2024-08-18T22:31:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148642 s, 70.5 MB/s 2024-08-18T22:31:57.156 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.157 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149954 s, 69.9 MB/s 2024-08-18T22:31:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.174 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148348 s, 70.7 MB/s 2024-08-18T22:31:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150013 s, 69.9 MB/s 2024-08-18T22:31:57.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.210 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148648 s, 70.5 MB/s 2024-08-18T22:31:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145635 s, 72.0 MB/s 2024-08-18T22:31:57.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.248 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178686 s, 58.7 MB/s 2024-08-18T22:31:57.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016747 s, 62.6 MB/s 2024-08-18T22:31:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144013 s, 72.8 MB/s 2024-08-18T22:31:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153726 s, 68.2 MB/s 2024-08-18T22:31:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.323 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153404 s, 68.4 MB/s 2024-08-18T22:31:57.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.343 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.343 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149699 s, 70.0 MB/s 2024-08-18T22:31:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172405 s, 60.8 MB/s 2024-08-18T22:31:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:57.369 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:57.369 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:57.369 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.18 2024-08-18T22:31:57.369 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:57.369 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:57.369 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:57.369 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:57.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.441 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015441 s, 67.9 MB/s 2024-08-18T22:31:57.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.461 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.461 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173631 s, 60.4 MB/s 2024-08-18T22:31:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.486 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210737 s, 49.8 MB/s 2024-08-18T22:31:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.504 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148122 s, 70.8 MB/s 2024-08-18T22:31:57.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.522 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.522 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147973 s, 70.9 MB/s 2024-08-18T22:31:57.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.542 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.542 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167392 s, 62.6 MB/s 2024-08-18T22:31:57.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.569 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024037 s, 43.6 MB/s 2024-08-18T22:31:57.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.588 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.588 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160535 s, 65.3 MB/s 2024-08-18T22:31:57.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.605 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.605 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014198 s, 73.9 MB/s 2024-08-18T22:31:57.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.623 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.623 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142632 s, 73.5 MB/s 2024-08-18T22:31:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.640 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144633 s, 72.5 MB/s 2024-08-18T22:31:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142646 s, 73.5 MB/s 2024-08-18T22:31:57.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107442 s, 97.6 MB/s 2024-08-18T22:31:57.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.692 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171475 s, 61.2 MB/s 2024-08-18T22:31:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014886 s, 70.4 MB/s 2024-08-18T22:31:57.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.730 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.730 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016603 s, 63.2 MB/s 2024-08-18T22:31:57.750 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.750 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.751 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149286 s, 70.2 MB/s 2024-08-18T22:31:57.764 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.765 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.765 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014956 s, 70.1 MB/s 2024-08-18T22:31:57.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.781 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.781 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140951 s, 74.4 MB/s 2024-08-18T22:31:57.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149144 s, 70.3 MB/s 2024-08-18T22:31:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.817 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153138 s, 68.5 MB/s 2024-08-18T22:31:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.835 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149574 s, 70.1 MB/s 2024-08-18T22:31:57.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175112 s, 59.9 MB/s 2024-08-18T22:31:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154952 s, 67.7 MB/s 2024-08-18T22:31:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177207 s, 59.2 MB/s 2024-08-18T22:31:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249927 s, 42.0 MB/s 2024-08-18T22:31:57.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.943 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174971 s, 59.9 MB/s 2024-08-18T22:31:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153766 s, 68.2 MB/s 2024-08-18T22:31:57.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.978 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146374 s, 71.6 MB/s 2024-08-18T22:31:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:57.997 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163741 s, 64.0 MB/s 2024-08-18T22:31:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.021 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020474 s, 51.2 MB/s 2024-08-18T22:31:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165494 s, 63.4 MB/s 2024-08-18T22:31:58.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:58.047 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:58.048 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:58.048 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.19 2024-08-18T22:31:58.048 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:58.048 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:58.048 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:58.048 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:58.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:58.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.119 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.119 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151048 s, 69.4 MB/s 2024-08-18T22:31:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.138 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165055 s, 63.5 MB/s 2024-08-18T22:31:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.158 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174525 s, 60.1 MB/s 2024-08-18T22:31:58.176 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.176 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.176 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154639 s, 67.8 MB/s 2024-08-18T22:31:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166621 s, 62.9 MB/s 2024-08-18T22:31:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176661 s, 59.4 MB/s 2024-08-18T22:31:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.233 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014678 s, 71.4 MB/s 2024-08-18T22:31:58.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139661 s, 75.1 MB/s 2024-08-18T22:31:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164165 s, 63.9 MB/s 2024-08-18T22:31:58.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.289 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177887 s, 58.9 MB/s 2024-08-18T22:31:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.308 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161512 s, 64.9 MB/s 2024-08-18T22:31:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158821 s, 66.0 MB/s 2024-08-18T22:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152361 s, 68.8 MB/s 2024-08-18T22:31:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.362 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150441 s, 69.7 MB/s 2024-08-18T22:31:58.379 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.379 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.380 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014853 s, 70.6 MB/s 2024-08-18T22:31:58.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.399 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162255 s, 64.6 MB/s 2024-08-18T22:31:58.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.418 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.418 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173139 s, 60.6 MB/s 2024-08-18T22:31:58.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.440 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192162 s, 54.6 MB/s 2024-08-18T22:31:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168132 s, 62.4 MB/s 2024-08-18T22:31:58.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.477 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144311 s, 72.7 MB/s 2024-08-18T22:31:58.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.498 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.498 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180622 s, 58.1 MB/s 2024-08-18T22:31:58.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148126 s, 70.8 MB/s 2024-08-18T22:31:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.534 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149871 s, 70.0 MB/s 2024-08-18T22:31:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161601 s, 64.9 MB/s 2024-08-18T22:31:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.569 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142771 s, 73.4 MB/s 2024-08-18T22:31:58.587 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.587 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.587 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146877 s, 71.4 MB/s 2024-08-18T22:31:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.607 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169491 s, 61.9 MB/s 2024-08-18T22:31:58.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.624 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.624 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144792 s, 72.4 MB/s 2024-08-18T22:31:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.642 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014861 s, 70.6 MB/s 2024-08-18T22:31:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.659 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147218 s, 71.2 MB/s 2024-08-18T22:31:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.677 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148736 s, 70.5 MB/s 2024-08-18T22:31:58.697 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017933 s, 58.5 MB/s 2024-08-18T22:31:58.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:58.705 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:58.705 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:58.705 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.20 2024-08-18T22:31:58.705 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:58.705 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:58.705 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:58.705 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:58.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:58.776 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154966 s, 67.7 MB/s 2024-08-18T22:31:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.794 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150753 s, 69.6 MB/s 2024-08-18T22:31:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.817 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199306 s, 52.6 MB/s 2024-08-18T22:31:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152898 s, 68.6 MB/s 2024-08-18T22:31:58.852 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.853 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150757 s, 69.6 MB/s 2024-08-18T22:31:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164054 s, 63.9 MB/s 2024-08-18T22:31:58.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.894 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.894 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192227 s, 54.5 MB/s 2024-08-18T22:31:58.911 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148908 s, 70.4 MB/s 2024-08-18T22:31:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.931 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165971 s, 63.2 MB/s 2024-08-18T22:31:58.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.949 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150076 s, 69.9 MB/s 2024-08-18T22:31:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.966 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147265 s, 71.2 MB/s 2024-08-18T22:31:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176577 s, 59.4 MB/s 2024-08-18T22:31:59.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.006 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.006 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169138 s, 62.0 MB/s 2024-08-18T22:31:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.023 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152254 s, 68.9 MB/s 2024-08-18T22:31:59.047 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.048 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215489 s, 48.7 MB/s 2024-08-18T22:31:59.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.065 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.065 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143686 s, 73.0 MB/s 2024-08-18T22:31:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199696 s, 52.5 MB/s 2024-08-18T22:31:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.105 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148061 s, 70.8 MB/s 2024-08-18T22:31:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.123 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158848 s, 66.0 MB/s 2024-08-18T22:31:59.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.147 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.147 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207415 s, 50.6 MB/s 2024-08-18T22:31:59.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.165 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152425 s, 68.8 MB/s 2024-08-18T22:31:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.182 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145867 s, 71.9 MB/s 2024-08-18T22:31:59.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147322 s, 71.2 MB/s 2024-08-18T22:31:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158644 s, 66.1 MB/s 2024-08-18T22:31:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148684 s, 70.5 MB/s 2024-08-18T22:31:59.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248063 s, 42.3 MB/s 2024-08-18T22:31:59.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.280 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.280 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151892 s, 69.0 MB/s 2024-08-18T22:31:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.299 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159814 s, 65.6 MB/s 2024-08-18T22:31:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144854 s, 72.4 MB/s 2024-08-18T22:31:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214763 s, 48.8 MB/s 2024-08-18T22:31:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120089 s, 87.3 MB/s 2024-08-18T22:31:59.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.374 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.374 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162715 s, 64.4 MB/s 2024-08-18T22:31:59.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:31:59.382 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:31:59.383 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:31:59.383 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.21 2024-08-18T22:31:59.383 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:31:59.383 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:31:59.383 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:31:59.383 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:31:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:31:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:31:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015405 s, 68.1 MB/s 2024-08-18T22:31:59.472 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.473 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168757 s, 62.1 MB/s 2024-08-18T22:31:59.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.490 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.490 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145988 s, 71.8 MB/s 2024-08-18T22:31:59.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.510 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.510 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172601 s, 60.8 MB/s 2024-08-18T22:31:59.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.527 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.527 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151499 s, 69.2 MB/s 2024-08-18T22:31:59.544 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.545 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.545 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148529 s, 70.6 MB/s 2024-08-18T22:31:59.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158536 s, 66.1 MB/s 2024-08-18T22:31:59.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.580 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.580 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143828 s, 72.9 MB/s 2024-08-18T22:31:59.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.600 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169038 s, 62.0 MB/s 2024-08-18T22:31:59.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.617 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.617 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147727 s, 71.0 MB/s 2024-08-18T22:31:59.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.634 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.634 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142361 s, 73.7 MB/s 2024-08-18T22:31:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201107 s, 52.1 MB/s 2024-08-18T22:31:59.675 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.676 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.676 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158606 s, 66.1 MB/s 2024-08-18T22:31:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.693 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146208 s, 71.7 MB/s 2024-08-18T22:31:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.717 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211909 s, 49.5 MB/s 2024-08-18T22:31:59.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.734 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.735 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153549 s, 68.3 MB/s 2024-08-18T22:31:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.754 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170497 s, 61.5 MB/s 2024-08-18T22:31:59.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.771 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.772 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014804 s, 70.8 MB/s 2024-08-18T22:31:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143897 s, 72.9 MB/s 2024-08-18T22:31:59.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.809 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.809 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178621 s, 58.7 MB/s 2024-08-18T22:31:59.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.826 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146696 s, 71.5 MB/s 2024-08-18T22:31:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.844 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015584 s, 67.3 MB/s 2024-08-18T22:31:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.867 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199754 s, 52.5 MB/s 2024-08-18T22:31:59.887 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.888 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177046 s, 59.2 MB/s 2024-08-18T22:31:59.901 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.902 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.902 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110622 s, 94.8 MB/s 2024-08-18T22:31:59.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.921 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.921 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168832 s, 62.1 MB/s 2024-08-18T22:31:59.940 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016565 s, 63.3 MB/s 2024-08-18T22:31:59.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.965 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218679 s, 48.0 MB/s 2024-08-18T22:31:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:31:59.990 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:31:59.990 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216524 s, 48.4 MB/s 2024-08-18T22:32:00.008 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.009 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164088 s, 63.9 MB/s 2024-08-18T22:32:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.032 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205731 s, 51.0 MB/s 2024-08-18T22:32:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155818 s, 67.3 MB/s 2024-08-18T22:32:00.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:00.058 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:32:00.058 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:32:00.058 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.22 2024-08-18T22:32:00.058 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:32:00.058 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:32:00.058 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:32:00.058 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:32:00.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:32:00.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.128 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.128 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147652 s, 71.0 MB/s 2024-08-18T22:32:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212487 s, 49.3 MB/s 2024-08-18T22:32:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154816 s, 67.7 MB/s 2024-08-18T22:32:00.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.190 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.190 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172023 s, 61.0 MB/s 2024-08-18T22:32:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152694 s, 68.7 MB/s 2024-08-18T22:32:00.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.226 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.226 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149403 s, 70.2 MB/s 2024-08-18T22:32:00.249 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.250 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.250 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021 s, 49.9 MB/s 2024-08-18T22:32:00.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.267 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145007 s, 72.3 MB/s 2024-08-18T22:32:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.284 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147982 s, 70.9 MB/s 2024-08-18T22:32:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.304 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175611 s, 59.7 MB/s 2024-08-18T22:32:00.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.322 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014588 s, 71.9 MB/s 2024-08-18T22:32:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144047 s, 72.8 MB/s 2024-08-18T22:32:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172284 s, 60.9 MB/s 2024-08-18T22:32:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011866 s, 88.4 MB/s 2024-08-18T22:32:00.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.391 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.391 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153068 s, 68.5 MB/s 2024-08-18T22:32:00.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.409 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.409 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146976 s, 71.3 MB/s 2024-08-18T22:32:00.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.426 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.427 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148941 s, 70.4 MB/s 2024-08-18T22:32:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.449 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202003 s, 51.9 MB/s 2024-08-18T22:32:00.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.469 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.469 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167529 s, 62.6 MB/s 2024-08-18T22:32:00.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.489 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.489 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017464 s, 60.0 MB/s 2024-08-18T22:32:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226336 s, 46.3 MB/s 2024-08-18T22:32:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.531 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145817 s, 71.9 MB/s 2024-08-18T22:32:00.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.549 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.549 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151472 s, 69.2 MB/s 2024-08-18T22:32:00.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.566 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.566 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141126 s, 74.3 MB/s 2024-08-18T22:32:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.583 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149027 s, 70.4 MB/s 2024-08-18T22:32:00.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.600 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.600 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142217 s, 73.7 MB/s 2024-08-18T22:32:00.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.618 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.618 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143613 s, 73.0 MB/s 2024-08-18T22:32:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151471 s, 69.2 MB/s 2024-08-18T22:32:00.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.654 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150567 s, 69.6 MB/s 2024-08-18T22:32:00.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.673 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161182 s, 65.1 MB/s 2024-08-18T22:32:00.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.696 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206241 s, 50.8 MB/s 2024-08-18T22:32:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179144 s, 58.5 MB/s 2024-08-18T22:32:00.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:00.724 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:32:00.724 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:32:00.724 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.23 2024-08-18T22:32:00.724 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:32:00.725 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:32:00.725 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:32:00.725 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:32:00.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:32:00.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.799 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.799 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01784 s, 58.8 MB/s 2024-08-18T22:32:00.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.818 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.818 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167036 s, 62.8 MB/s 2024-08-18T22:32:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153248 s, 68.4 MB/s 2024-08-18T22:32:00.853 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.854 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148831 s, 70.5 MB/s 2024-08-18T22:32:00.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.872 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.872 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149588 s, 70.1 MB/s 2024-08-18T22:32:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.889 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148628 s, 70.6 MB/s 2024-08-18T22:32:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154968 s, 67.7 MB/s 2024-08-18T22:32:00.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.927 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.927 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171393 s, 61.2 MB/s 2024-08-18T22:32:00.944 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.945 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147817 s, 70.9 MB/s 2024-08-18T22:32:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150337 s, 69.7 MB/s 2024-08-18T22:32:00.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:00.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:00.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168132 s, 62.4 MB/s 2024-08-18T22:32:01.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.000 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155904 s, 67.3 MB/s 2024-08-18T22:32:01.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167648 s, 62.5 MB/s 2024-08-18T22:32:01.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.037 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.037 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149829 s, 70.0 MB/s 2024-08-18T22:32:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204103 s, 51.4 MB/s 2024-08-18T22:32:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195844 s, 53.5 MB/s 2024-08-18T22:32:01.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.100 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.100 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147359 s, 71.2 MB/s 2024-08-18T22:32:01.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.120 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.120 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173328 s, 60.5 MB/s 2024-08-18T22:32:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163686 s, 64.1 MB/s 2024-08-18T22:32:01.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.158 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.159 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168968 s, 62.1 MB/s 2024-08-18T22:32:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151202 s, 69.3 MB/s 2024-08-18T22:32:01.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.196 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.196 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016726 s, 62.7 MB/s 2024-08-18T22:32:01.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.213 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.213 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147493 s, 71.1 MB/s 2024-08-18T22:32:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147108 s, 71.3 MB/s 2024-08-18T22:32:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.248 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014738 s, 71.1 MB/s 2024-08-18T22:32:01.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.268 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.268 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177623 s, 59.0 MB/s 2024-08-18T22:32:01.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.285 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.285 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142087 s, 73.8 MB/s 2024-08-18T22:32:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.305 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174341 s, 60.1 MB/s 2024-08-18T22:32:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157861 s, 66.4 MB/s 2024-08-18T22:32:01.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.341 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.341 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146401 s, 71.6 MB/s 2024-08-18T22:32:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148882 s, 70.4 MB/s 2024-08-18T22:32:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168093 s, 62.4 MB/s 2024-08-18T22:32:01.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:01.385 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:32:01.386 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:32:01.386 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.24 2024-08-18T22:32:01.386 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:32:01.386 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:32:01.386 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:32:01.386 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:32:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:32:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151046 s, 69.4 MB/s 2024-08-18T22:32:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148006 s, 70.8 MB/s 2024-08-18T22:32:01.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.491 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.491 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148139 s, 70.8 MB/s 2024-08-18T22:32:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146586 s, 71.5 MB/s 2024-08-18T22:32:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155176 s, 67.6 MB/s 2024-08-18T22:32:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169007 s, 62.0 MB/s 2024-08-18T22:32:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.563 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148387 s, 70.7 MB/s 2024-08-18T22:32:01.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.586 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.586 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194864 s, 53.8 MB/s 2024-08-18T22:32:01.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.610 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211959 s, 49.5 MB/s 2024-08-18T22:32:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148434 s, 70.6 MB/s 2024-08-18T22:32:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.649 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193671 s, 54.1 MB/s 2024-08-18T22:32:01.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.667 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.667 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146693 s, 71.5 MB/s 2024-08-18T22:32:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151813 s, 69.1 MB/s 2024-08-18T22:32:01.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181898 s, 57.6 MB/s 2024-08-18T22:32:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146336 s, 71.7 MB/s 2024-08-18T22:32:01.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.743 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161773 s, 64.8 MB/s 2024-08-18T22:32:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.760 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014957 s, 70.1 MB/s 2024-08-18T22:32:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173416 s, 60.5 MB/s 2024-08-18T22:32:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144846 s, 72.4 MB/s 2024-08-18T22:32:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150557 s, 69.6 MB/s 2024-08-18T22:32:01.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.842 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.842 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236907 s, 44.3 MB/s 2024-08-18T22:32:01.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.859 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.859 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147965 s, 70.9 MB/s 2024-08-18T22:32:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200421 s, 52.3 MB/s 2024-08-18T22:32:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014573 s, 72.0 MB/s 2024-08-18T22:32:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110265 s, 95.1 MB/s 2024-08-18T22:32:01.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.931 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.931 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149729 s, 70.0 MB/s 2024-08-18T22:32:01.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.948 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.948 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147126 s, 71.3 MB/s 2024-08-18T22:32:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168123 s, 62.4 MB/s 2024-08-18T22:32:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:01.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149659 s, 70.1 MB/s 2024-08-18T22:32:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151407 s, 69.3 MB/s 2024-08-18T22:32:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112391 s, 93.3 MB/s 2024-08-18T22:32:02.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.034 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.034 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146418 s, 71.6 MB/s 2024-08-18T22:32:02.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:02.042 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:32:02.042 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:32:02.042 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.25 2024-08-18T22:32:02.042 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:32:02.042 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:32:02.042 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:32:02.042 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:32:02.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:32:02.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.115 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.115 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172253 s, 60.9 MB/s 2024-08-18T22:32:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146698 s, 71.5 MB/s 2024-08-18T22:32:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.152 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017509 s, 59.9 MB/s 2024-08-18T22:32:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160624 s, 65.3 MB/s 2024-08-18T22:32:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147156 s, 71.3 MB/s 2024-08-18T22:32:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.205 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142538 s, 73.6 MB/s 2024-08-18T22:32:02.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.223 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.223 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150143 s, 69.8 MB/s 2024-08-18T22:32:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021318 s, 49.2 MB/s 2024-08-18T22:32:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179668 s, 58.4 MB/s 2024-08-18T22:32:02.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157284 s, 66.7 MB/s 2024-08-18T22:32:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.304 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158412 s, 66.2 MB/s 2024-08-18T22:32:02.321 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146691 s, 71.5 MB/s 2024-08-18T22:32:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159633 s, 65.7 MB/s 2024-08-18T22:32:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.359 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162065 s, 64.7 MB/s 2024-08-18T22:32:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148825 s, 70.5 MB/s 2024-08-18T22:32:02.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.398 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.398 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172844 s, 60.7 MB/s 2024-08-18T22:32:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150825 s, 69.5 MB/s 2024-08-18T22:32:02.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.443 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.443 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245926 s, 42.6 MB/s 2024-08-18T22:32:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169076 s, 62.0 MB/s 2024-08-18T22:32:02.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.481 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157569 s, 66.5 MB/s 2024-08-18T22:32:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164401 s, 63.8 MB/s 2024-08-18T22:32:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015231 s, 68.8 MB/s 2024-08-18T22:32:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020077 s, 52.2 MB/s 2024-08-18T22:32:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145309 s, 72.2 MB/s 2024-08-18T22:32:02.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.575 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.576 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146612 s, 71.5 MB/s 2024-08-18T22:32:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.596 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176851 s, 59.3 MB/s 2024-08-18T22:32:02.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.614 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149019 s, 70.4 MB/s 2024-08-18T22:32:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.631 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149203 s, 70.3 MB/s 2024-08-18T22:32:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.655 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214004 s, 49.0 MB/s 2024-08-18T22:32:02.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.672 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.672 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143636 s, 73.0 MB/s 2024-08-18T22:32:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.697 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212104 s, 49.4 MB/s 2024-08-18T22:32:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.714 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149888 s, 70.0 MB/s 2024-08-18T22:32:02.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:02.721 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:32:02.722 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:32:02.722 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.26 2024-08-18T22:32:02.722 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:32:02.722 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:32:02.722 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:32:02.722 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:32:02.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:32:02.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.795 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.795 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179407 s, 58.4 MB/s 2024-08-18T22:32:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.819 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021359 s, 49.1 MB/s 2024-08-18T22:32:02.836 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.837 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146874 s, 71.4 MB/s 2024-08-18T22:32:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149181 s, 70.3 MB/s 2024-08-18T22:32:02.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.871 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.871 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143388 s, 73.1 MB/s 2024-08-18T22:32:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170646 s, 61.4 MB/s 2024-08-18T22:32:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184841 s, 56.7 MB/s 2024-08-18T22:32:02.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.935 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192482 s, 54.5 MB/s 2024-08-18T22:32:02.955 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.956 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.956 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177069 s, 59.2 MB/s 2024-08-18T22:32:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220682 s, 47.5 MB/s 2024-08-18T22:32:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155732 s, 67.3 MB/s 2024-08-18T22:32:03.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.017 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.017 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155959 s, 67.2 MB/s 2024-08-18T22:32:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167783 s, 62.5 MB/s 2024-08-18T22:32:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.054 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150322 s, 69.8 MB/s 2024-08-18T22:32:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154047 s, 68.1 MB/s 2024-08-18T22:32:03.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.092 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.092 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171548 s, 61.1 MB/s 2024-08-18T22:32:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155524 s, 67.4 MB/s 2024-08-18T22:32:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.126 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122049 s, 85.9 MB/s 2024-08-18T22:32:03.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.143 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148382 s, 70.7 MB/s 2024-08-18T22:32:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.164 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182939 s, 57.3 MB/s 2024-08-18T22:32:03.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.181 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145122 s, 72.3 MB/s 2024-08-18T22:32:03.209 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250376 s, 41.9 MB/s 2024-08-18T22:32:03.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.228 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.228 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155716 s, 67.3 MB/s 2024-08-18T22:32:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.245 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147652 s, 71.0 MB/s 2024-08-18T22:32:03.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.271 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206811 s, 50.7 MB/s 2024-08-18T22:32:03.290 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194825 s, 53.8 MB/s 2024-08-18T22:32:03.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.310 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.310 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159904 s, 65.6 MB/s 2024-08-18T22:32:03.324 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.325 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.325 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120956 s, 86.7 MB/s 2024-08-18T22:32:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.342 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014819 s, 70.8 MB/s 2024-08-18T22:32:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.360 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150328 s, 69.8 MB/s 2024-08-18T22:32:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.384 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214359 s, 48.9 MB/s 2024-08-18T22:32:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154089 s, 68.1 MB/s 2024-08-18T22:32:03.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:03.410 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:32:03.410 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:32:03.410 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.27 2024-08-18T22:32:03.410 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:32:03.410 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:32:03.410 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:32:03.410 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:32:03.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:32:03.481 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.482 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162489 s, 64.5 MB/s 2024-08-18T22:32:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153162 s, 68.5 MB/s 2024-08-18T22:32:03.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.520 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.520 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179407 s, 58.4 MB/s 2024-08-18T22:32:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.540 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171205 s, 61.2 MB/s 2024-08-18T22:32:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172791 s, 60.7 MB/s 2024-08-18T22:32:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152156 s, 68.9 MB/s 2024-08-18T22:32:03.591 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.592 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.592 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119429 s, 87.8 MB/s 2024-08-18T22:32:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146142 s, 71.8 MB/s 2024-08-18T22:32:03.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159277 s, 65.8 MB/s 2024-08-18T22:32:03.647 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.648 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.648 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176447 s, 59.4 MB/s 2024-08-18T22:32:03.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148939 s, 70.4 MB/s 2024-08-18T22:32:03.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.685 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.685 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170165 s, 61.6 MB/s 2024-08-18T22:32:03.703 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.704 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.704 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158034 s, 66.4 MB/s 2024-08-18T22:32:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.724 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178931 s, 58.6 MB/s 2024-08-18T22:32:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.742 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148174 s, 70.8 MB/s 2024-08-18T22:32:03.760 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.761 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157626 s, 66.5 MB/s 2024-08-18T22:32:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156766 s, 66.9 MB/s 2024-08-18T22:32:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200394 s, 52.3 MB/s 2024-08-18T22:32:03.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.822 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.822 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176106 s, 59.5 MB/s 2024-08-18T22:32:03.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.840 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.840 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152071 s, 69.0 MB/s 2024-08-18T22:32:03.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.862 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.862 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019687 s, 53.3 MB/s 2024-08-18T22:32:03.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.876 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116022 s, 90.4 MB/s 2024-08-18T22:32:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213009 s, 49.2 MB/s 2024-08-18T22:32:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158789 s, 66.0 MB/s 2024-08-18T22:32:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197177 s, 53.2 MB/s 2024-08-18T22:32:03.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.959 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.959 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148895 s, 70.4 MB/s 2024-08-18T22:32:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205771 s, 51.0 MB/s 2024-08-18T22:32:03.999 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.000 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.000 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149487 s, 70.1 MB/s 2024-08-18T22:32:04.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.019 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.019 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168874 s, 62.1 MB/s 2024-08-18T22:32:04.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.036 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.036 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144937 s, 72.3 MB/s 2024-08-18T22:32:04.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.064 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.064 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253151 s, 41.4 MB/s 2024-08-18T22:32:04.084 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.085 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.085 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176549 s, 59.4 MB/s 2024-08-18T22:32:04.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:04.092 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:32:04.092 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:32:04.092 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.28 2024-08-18T22:32:04.092 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:32:04.092 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:32:04.092 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:32:04.092 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:32:04.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:32:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157567 s, 66.5 MB/s 2024-08-18T22:32:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150883 s, 69.5 MB/s 2024-08-18T22:32:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145963 s, 71.8 MB/s 2024-08-18T22:32:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168497 s, 62.2 MB/s 2024-08-18T22:32:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216136 s, 48.5 MB/s 2024-08-18T22:32:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171945 s, 61.0 MB/s 2024-08-18T22:32:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204048 s, 51.4 MB/s 2024-08-18T22:32:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204181 s, 51.4 MB/s 2024-08-18T22:32:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158459 s, 66.2 MB/s 2024-08-18T22:32:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172461 s, 60.8 MB/s 2024-08-18T22:32:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154376 s, 67.9 MB/s 2024-08-18T22:32:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150287 s, 69.8 MB/s 2024-08-18T22:32:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177739 s, 59.0 MB/s 2024-08-18T22:32:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148906 s, 70.4 MB/s 2024-08-18T22:32:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169109 s, 62.0 MB/s 2024-08-18T22:32:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153572 s, 68.3 MB/s 2024-08-18T22:32:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153921 s, 68.1 MB/s 2024-08-18T22:32:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169678 s, 61.8 MB/s 2024-08-18T22:32:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171322 s, 61.2 MB/s 2024-08-18T22:32:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173018 s, 60.6 MB/s 2024-08-18T22:32:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146625 s, 71.5 MB/s 2024-08-18T22:32:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143122 s, 73.3 MB/s 2024-08-18T22:32:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174626 s, 60.0 MB/s 2024-08-18T22:32:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151128 s, 69.4 MB/s 2024-08-18T22:32:04.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.625 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.625 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143891 s, 72.9 MB/s 2024-08-18T22:32:04.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.644 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.644 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158911 s, 66.0 MB/s 2024-08-18T22:32:04.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.665 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174796 s, 60.0 MB/s 2024-08-18T22:32:04.681 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143468 s, 73.1 MB/s 2024-08-18T22:32:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141304 s, 74.2 MB/s 2024-08-18T22:32:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177399 s, 59.1 MB/s 2024-08-18T22:32:04.737 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.738 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.738 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162459 s, 64.5 MB/s 2024-08-18T22:32:04.757 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.758 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166905 s, 62.8 MB/s 2024-08-18T22:32:04.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:04.765 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:32:04.765 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:32:04.765 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.29 2024-08-18T22:32:04.765 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:32:04.765 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:32:04.766 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:32:04.766 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:32:04.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:32:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186498 s, 56.2 MB/s 2024-08-18T22:32:04.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.858 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.858 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161844 s, 64.8 MB/s 2024-08-18T22:32:04.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.875 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.876 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150768 s, 69.5 MB/s 2024-08-18T22:32:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179502 s, 58.4 MB/s 2024-08-18T22:32:04.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143162 s, 73.2 MB/s 2024-08-18T22:32:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.932 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151189 s, 69.4 MB/s 2024-08-18T22:32:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153327 s, 68.4 MB/s 2024-08-18T22:32:04.968 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.969 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.969 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149653 s, 70.1 MB/s 2024-08-18T22:32:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157826 s, 66.4 MB/s 2024-08-18T22:32:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019664 s, 53.3 MB/s 2024-08-18T22:32:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015948 s, 65.7 MB/s 2024-08-18T22:32:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:05.914 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.88324 s, 1.2 MB/s 2024-08-18T22:32:05.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:05.943 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:05.943 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251974 s, 41.6 MB/s 2024-08-18T22:32:05.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:05.964 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:05.964 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172025 s, 61.0 MB/s 2024-08-18T22:32:05.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:05.985 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:05.985 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017923 s, 58.5 MB/s 2024-08-18T22:32:06.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.010 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.011 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021694 s, 48.3 MB/s 2024-08-18T22:32:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015018 s, 69.8 MB/s 2024-08-18T22:32:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168758 s, 62.1 MB/s 2024-08-18T22:32:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213072 s, 49.2 MB/s 2024-08-18T22:32:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128077 s, 81.9 MB/s 2024-08-18T22:32:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185589 s, 56.5 MB/s 2024-08-18T22:32:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181497 s, 57.8 MB/s 2024-08-18T22:32:06.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.145 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.145 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115532 s, 90.8 MB/s 2024-08-18T22:32:06.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.159 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.159 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116763 s, 89.8 MB/s 2024-08-18T22:32:06.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.187 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.187 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024302 s, 43.1 MB/s 2024-08-18T22:32:06.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.212 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.212 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227304 s, 46.1 MB/s 2024-08-18T22:32:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123618 s, 84.8 MB/s 2024-08-18T22:32:06.251 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.251 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.252 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215935 s, 48.6 MB/s 2024-08-18T22:32:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.270 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156459 s, 67.0 MB/s 2024-08-18T22:32:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.289 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165469 s, 63.4 MB/s 2024-08-18T22:32:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.309 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170153 s, 61.6 MB/s 2024-08-18T22:32:06.326 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.327 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.327 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015394 s, 68.1 MB/s 2024-08-18T22:32:06.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:06.335 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:32:06.335 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:32:06.335 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.30 2024-08-18T22:32:06.335 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:32:06.335 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:32:06.335 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:32:06.335 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:32:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:32:06.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.410 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.411 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019477 s, 53.8 MB/s 2024-08-18T22:32:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.428 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147609 s, 71.0 MB/s 2024-08-18T22:32:06.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.448 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.448 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178828 s, 58.6 MB/s 2024-08-18T22:32:06.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.468 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.468 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168896 s, 62.1 MB/s 2024-08-18T22:32:06.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.488 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.488 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169673 s, 61.8 MB/s 2024-08-18T22:32:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173847 s, 60.3 MB/s 2024-08-18T22:32:06.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.526 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.526 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156307 s, 67.1 MB/s 2024-08-18T22:32:06.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.548 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.548 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194785 s, 53.8 MB/s 2024-08-18T22:32:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235754 s, 44.5 MB/s 2024-08-18T22:32:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173945 s, 60.3 MB/s 2024-08-18T22:32:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156667 s, 66.9 MB/s 2024-08-18T22:32:06.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.630 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.630 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148467 s, 70.6 MB/s 2024-08-18T22:32:06.653 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204181 s, 51.4 MB/s 2024-08-18T22:32:06.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.671 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.671 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146938 s, 71.4 MB/s 2024-08-18T22:32:06.688 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.689 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.689 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150075 s, 69.9 MB/s 2024-08-18T22:32:06.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.706 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.706 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150012 s, 69.9 MB/s 2024-08-18T22:32:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016465 s, 63.7 MB/s 2024-08-18T22:32:06.748 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.749 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.749 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199831 s, 52.5 MB/s 2024-08-18T22:32:06.766 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151669 s, 69.1 MB/s 2024-08-18T22:32:06.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.784 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.784 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145286 s, 72.2 MB/s 2024-08-18T22:32:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152226 s, 68.9 MB/s 2024-08-18T22:32:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126002 s, 83.2 MB/s 2024-08-18T22:32:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169089 s, 62.0 MB/s 2024-08-18T22:32:06.854 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.855 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.855 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014935 s, 70.2 MB/s 2024-08-18T22:32:06.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.877 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.878 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201385 s, 52.1 MB/s 2024-08-18T22:32:06.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.895 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.895 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014741 s, 71.1 MB/s 2024-08-18T22:32:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158955 s, 66.0 MB/s 2024-08-18T22:32:06.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.935 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.935 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185966 s, 56.4 MB/s 2024-08-18T22:32:06.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.960 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.960 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225677 s, 46.5 MB/s 2024-08-18T22:32:06.977 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147656 s, 71.0 MB/s 2024-08-18T22:32:06.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:06.996 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:06.996 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154151 s, 68.0 MB/s 2024-08-18T22:32:07.014 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.015 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.015 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163456 s, 64.2 MB/s 2024-08-18T22:32:07.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:07.022 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-08-18T22:32:07.022 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:32:07.022 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p scrub_control_test_path/dir.31 2024-08-18T22:32:07.022 DEBUG:teuthology.orchestra.run.smithi005:> for ((i = 0; i < 32; i++)); do 2024-08-18T22:32:07.022 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-08-18T22:32:07.022 DEBUG:teuthology.orchestra.run.smithi005:> done 2024-08-18T22:32:07.022 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:32:07.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:32:07.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.096 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017932 s, 58.5 MB/s 2024-08-18T22:32:07.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.125 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.125 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257584 s, 40.7 MB/s 2024-08-18T22:32:07.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.142 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.142 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143433 s, 73.1 MB/s 2024-08-18T22:32:07.165 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.166 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203658 s, 51.5 MB/s 2024-08-18T22:32:07.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.183 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.183 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150009 s, 69.9 MB/s 2024-08-18T22:32:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.202 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161484 s, 64.9 MB/s 2024-08-18T22:32:07.229 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.230 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.230 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246419 s, 42.6 MB/s 2024-08-18T22:32:07.246 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.247 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.247 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147296 s, 71.2 MB/s 2024-08-18T22:32:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153862 s, 68.2 MB/s 2024-08-18T22:32:07.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.282 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.282 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144128 s, 72.8 MB/s 2024-08-18T22:32:07.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.301 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.301 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157478 s, 66.6 MB/s 2024-08-18T22:32:07.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.320 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.320 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162144 s, 64.7 MB/s 2024-08-18T22:32:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109734 s, 95.6 MB/s 2024-08-18T22:32:07.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.355 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.355 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161068 s, 65.1 MB/s 2024-08-18T22:32:07.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.370 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.370 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153835 s, 68.2 MB/s 2024-08-18T22:32:07.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.388 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150449 s, 69.7 MB/s 2024-08-18T22:32:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.405 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147334 s, 71.2 MB/s 2024-08-18T22:32:07.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.425 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.425 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170779 s, 61.4 MB/s 2024-08-18T22:32:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171719 s, 61.1 MB/s 2024-08-18T22:32:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.467 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.467 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193341 s, 54.2 MB/s 2024-08-18T22:32:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014971 s, 70.0 MB/s 2024-08-18T22:32:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014135 s, 74.2 MB/s 2024-08-18T22:32:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144179 s, 72.7 MB/s 2024-08-18T22:32:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.536 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146093 s, 71.8 MB/s 2024-08-18T22:32:07.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.554 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.554 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153401 s, 68.4 MB/s 2024-08-18T22:32:07.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.577 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.577 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199906 s, 52.5 MB/s 2024-08-18T22:32:07.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.594 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.594 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143991 s, 72.8 MB/s 2024-08-18T22:32:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.612 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149859 s, 70.0 MB/s 2024-08-18T22:32:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012439 s, 84.3 MB/s 2024-08-18T22:32:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154261 s, 68.0 MB/s 2024-08-18T22:32:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179231 s, 58.5 MB/s 2024-08-18T22:32:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-18T22:32:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-18T22:32:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150383 s, 69.7 MB/s 2024-08-18T22:32:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:07.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-08-18T22:32:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fb0400640 1 Processor -- start 2024-08-18T22:32:07.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fb0400640 1 -- start start 2024-08-18T22:32:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fb0400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3fa80d15e0 0x7f3fa80b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fb0400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa80d30b0 con 0x7f3fa80d1090 2024-08-18T22:32:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fb0400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa80d1bd0 con 0x7f3fa815fb80 2024-08-18T22:32:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fb0400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa8071c60 con 0x7f3fa80d15e0 2024-08-18T22:32:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fad000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3fa80d1090 0x7f3fa8071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42412/0 (socket says 172.21.15.5:42412) 2024-08-18T22:32:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fad000640 1 -- 172.21.15.5:0/1008866342 learned_addr learned my addr 172.21.15.5:0/1008866342 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:07.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fae400640 1 --2- 172.21.15.5:0/1008866342 >> v2:172.21.15.117:3300/0 conn(0x7f3fa80d15e0 0x7f3fa80b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fa7e00640 1 -- 172.21.15.5:0/1008866342 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888052698 0 0) 0x7f3fa80d30b0 con 0x7f3fa80d1090 2024-08-18T22:32:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fa7e00640 1 -- 172.21.15.5:0/1008866342 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f8c003530 con 0x7f3fa80d1090 2024-08-18T22:32:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fae400640 1 -- 172.21.15.5:0/1008866342 >> v1:172.21.15.117:6789/0 conn(0x7f3fa815fb80 legacy=0x7f3fa806fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fae400640 1 -- 172.21.15.5:0/1008866342 >> v1:172.21.15.5:6789/0 conn(0x7f3fa80d1090 legacy=0x7f3fa8071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:07.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.835+0000 7f3fae400640 1 -- 172.21.15.5:0/1008866342 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa80d2dd0 con 0x7f3fa80d15e0 2024-08-18T22:32:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.839+0000 7f3fae400640 1 --2- 172.21.15.5:0/1008866342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa80d15e0 0x7f3fa80b5ad0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009d90 tx=0x7f3fa001c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35a1ad34bc5eeaa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.839+0000 7f3fa7e00640 1 -- 172.21.15.5:0/1008866342 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00b2070 con 0x7f3fa80d15e0 2024-08-18T22:32:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.839+0000 7f3fa7e00640 1 -- 172.21.15.5:0/1008866342 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa00a5710 con 0x7f3fa80d15e0 2024-08-18T22:32:07.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.839+0000 7f3fa7e00640 1 -- 172.21.15.5:0/1008866342 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00a5ae0 con 0x7f3fa80d15e0 2024-08-18T22:32:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.839+0000 7f3fb0400640 1 -- 172.21.15.5:0/1008866342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa80d15e0 msgr2=0x7f3fa80b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.839+0000 7f3fb0400640 1 --2- 172.21.15.5:0/1008866342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa80d15e0 0x7f3fa80b5ad0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009d90 tx=0x7f3fa001c850 comp rx=0 tx=0).stop 2024-08-18T22:32:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.839+0000 7f3fb0400640 1 -- 172.21.15.5:0/1008866342 shutdown_connections 2024-08-18T22:32:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.839+0000 7f3fb0400640 1 --2- 172.21.15.5:0/1008866342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa80d15e0 0x7f3fa80b5ad0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:07.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.839+0000 7f3fb0400640 1 -- 172.21.15.5:0/1008866342 >> 172.21.15.5:0/1008866342 conn(0x7f3fa80d2180 msgr2=0x7f3fa80d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.839+0000 7f3fb0400640 1 -- 172.21.15.5:0/1008866342 shutdown_connections 2024-08-18T22:32:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.839+0000 7f3fb0400640 1 -- 172.21.15.5:0/1008866342 wait complete. 2024-08-18T22:32:07.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fb0400640 1 Processor -- start 2024-08-18T22:32:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fb0400640 1 -- start start 2024-08-18T22:32:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fb0400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fa80d1090 0x7f3fa8143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fb0400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa80d15e0 0x7f3fa8155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:07.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fb0400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa815fb80 0x7f3fa815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:07.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fb0400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa816a310 con 0x7f3fa80d1090 2024-08-18T22:32:07.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fb0400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa80d1eb0 con 0x7f3fa815fb80 2024-08-18T22:32:07.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fb0400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa816a490 con 0x7f3fa80d15e0 2024-08-18T22:32:07.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fada00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fa80d1090 0x7f3fa8143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:07.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fada00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fa80d1090 0x7f3fa8143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54410/0 (socket says 172.21.15.5:54410) 2024-08-18T22:32:07.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fada00640 1 -- 172.21.15.5:0/4053212045 learned_addr learned my addr 172.21.15.5:0/4053212045 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fae400640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa815fb80 0x7f3fa815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fad000640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa80d15e0 0x7f3fa8155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fada00640 1 -- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa80d15e0 msgr2=0x7f3fa8155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fada00640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa80d15e0 0x7f3fa8155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:07.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fada00640 1 -- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa815fb80 msgr2=0x7f3fa815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fada00640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa815fb80 0x7f3fa815b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fada00640 1 -- 172.21.15.5:0/4053212045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa81440e0 con 0x7f3fa80d1090 2024-08-18T22:32:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fada00640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fa80d1090 0x7f3fa8143ba0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800c3c0 tx=0x7f3f9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fa5600640 1 -- 172.21.15.5:0/4053212045 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98017070 con 0x7f3fa80d1090 2024-08-18T22:32:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fa5600640 1 -- 172.21.15.5:0/4053212045 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f980052d0 con 0x7f3fa80d1090 2024-08-18T22:32:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fa5600640 1 -- 172.21.15.5:0/4053212045 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98003840 con 0x7f3fa80d1090 2024-08-18T22:32:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fb0400640 1 -- 172.21.15.5:0/4053212045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa815b110 con 0x7f3fa80d1090 2024-08-18T22:32:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.843+0000 7f3fb0400640 1 -- 172.21.15.5:0/4053212045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa80b0070 con 0x7f3fa80d1090 2024-08-18T22:32:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.847+0000 7f3fb0400640 1 -- 172.21.15.5:0/4053212045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa80ce0d0 con 0x7f3fa80d1090 2024-08-18T22:32:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.847+0000 7f3fa5600640 1 -- 172.21.15.5:0/4053212045 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3f9801a070 con 0x7f3fa80d1090 2024-08-18T22:32:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.847+0000 7f3fa5600640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f880678c0 0x7f3f88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.847+0000 7f3fa5600640 1 -- 172.21.15.5:0/4053212045 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f3f98085140 con 0x7f3fa80d1090 2024-08-18T22:32:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.847+0000 7f3fad000640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f880678c0 0x7f3f88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.847+0000 7f3fad000640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f880678c0 0x7f3f88069d80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80cd480 tx=0x7f3f94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:07.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:07.851+0000 7f3fa5600640 1 -- 172.21.15.5:0/4053212045 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f3f98005480 con 0x7f3fa80d1090 2024-08-18T22:32:08.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.059+0000 7f3fb0400640 1 -- 172.21.15.5:0/4053212045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f3fa806ecd0 con 0x7f3fa80d1090 2024-08-18T22:32:08.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.899+0000 7f3fa5600640 1 -- 172.21.15.5:0/4053212045 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v139) ==== 105+0+0 (secure 0 0 0) 0x7f3f98055430 con 0x7f3fa80d1090 2024-08-18T22:32:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 -- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f880678c0 msgr2=0x7f3f88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f880678c0 0x7f3f88069d80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80cd480 tx=0x7f3f94009040 comp rx=0 tx=0).stop 2024-08-18T22:32:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 -- 172.21.15.5:0/4053212045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fa80d1090 msgr2=0x7f3fa8143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fa80d1090 0x7f3fa8143ba0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800c3c0 tx=0x7f3f9800c880 comp rx=0 tx=0).stop 2024-08-18T22:32:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 -- 172.21.15.5:0/4053212045 shutdown_connections 2024-08-18T22:32:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f880678c0 0x7f3f88069d80 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa815fb80 0x7f3fa815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa80d15e0 0x7f3fa8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 --2- 172.21.15.5:0/4053212045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fa80d1090 0x7f3fa8143ba0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 -- 172.21.15.5:0/4053212045 >> 172.21.15.5:0/4053212045 conn(0x7f3fa80d2180 msgr2=0x7f3fa8071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:08.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 -- 172.21.15.5:0/4053212045 shutdown_connections 2024-08-18T22:32:08.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:08.903+0000 7f3fb0400640 1 -- 172.21.15.5:0/4053212045 wait complete. 2024-08-18T22:32:08.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-08-18T22:32:09.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee5ca00640 1 Processor -- start 2024-08-18T22:32:09.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee5ca00640 1 -- start start 2024-08-18T22:32:09.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee5ca00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee5815f7b0 0x7fee58167000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:09.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee5ca00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee5815d560 con 0x7fee5815c360 2024-08-18T22:32:09.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee5ca00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee5815d9e0 con 0x7fee58160680 2024-08-18T22:32:09.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee5ca00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fee5815dcc0 con 0x7fee5815f7b0 2024-08-18T22:32:09.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee55e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fee5815c360 0x7fee5815c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42428/0 (socket says 172.21.15.5:42428) 2024-08-18T22:32:09.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee55e00640 1 -- 172.21.15.5:0/487917041 learned_addr learned my addr 172.21.15.5:0/487917041 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:09.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee56800640 1 --2- 172.21.15.5:0/487917041 >> v2:172.21.15.5:3300/0 conn(0x7fee5815f7b0 0x7fee58167000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:09.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee55400640 1 -- 172.21.15.5:0/487917041 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634173555 0 0) 0x7fee48001120 con 0x7fee5815c360 2024-08-18T22:32:09.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee55400640 1 -- 172.21.15.5:0/487917041 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee3c003530 con 0x7fee5815c360 2024-08-18T22:32:09.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee56800640 1 -- 172.21.15.5:0/487917041 >> v1:172.21.15.117:6789/0 conn(0x7fee58160680 legacy=0x7fee5815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:09.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee56800640 1 -- 172.21.15.5:0/487917041 >> v1:172.21.15.5:6789/0 conn(0x7fee5815c360 legacy=0x7fee5815c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:09.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.071+0000 7fee56800640 1 -- 172.21.15.5:0/487917041 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5815dfa0 con 0x7fee5815f7b0 2024-08-18T22:32:09.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.075+0000 7fee56800640 1 --2- 172.21.15.5:0/487917041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5815f7b0 0x7fee58167000 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fee50009d90 tx=0x7fee5001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e508908f96b712 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:09.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.075+0000 7fee55400640 1 -- 172.21.15.5:0/487917041 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee500b2070 con 0x7fee5815f7b0 2024-08-18T22:32:09.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.075+0000 7fee55400640 1 -- 172.21.15.5:0/487917041 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee500a5830 con 0x7fee5815f7b0 2024-08-18T22:32:09.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.075+0000 7fee55400640 1 -- 172.21.15.5:0/487917041 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee500a5be0 con 0x7fee5815f7b0 2024-08-18T22:32:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.075+0000 7fee5ca00640 1 -- 172.21.15.5:0/487917041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5815f7b0 msgr2=0x7fee58167000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.075+0000 7fee5ca00640 1 --2- 172.21.15.5:0/487917041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5815f7b0 0x7fee58167000 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fee50009d90 tx=0x7fee5001c970 comp rx=0 tx=0).stop 2024-08-18T22:32:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.075+0000 7fee5ca00640 1 -- 172.21.15.5:0/487917041 shutdown_connections 2024-08-18T22:32:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.075+0000 7fee5ca00640 1 --2- 172.21.15.5:0/487917041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5815f7b0 0x7fee58167000 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.075+0000 7fee5ca00640 1 -- 172.21.15.5:0/487917041 >> 172.21.15.5:0/487917041 conn(0x7fee580b65f0 msgr2=0x7fee580b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.075+0000 7fee5ca00640 1 -- 172.21.15.5:0/487917041 shutdown_connections 2024-08-18T22:32:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.075+0000 7fee5ca00640 1 -- 172.21.15.5:0/487917041 wait complete. 2024-08-18T22:32:09.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee5ca00640 1 Processor -- start 2024-08-18T22:32:09.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee5ca00640 1 -- start start 2024-08-18T22:32:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee5ca00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815c360 0x7fee581498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee5ca00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5815f7b0 0x7fee5814a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee5ca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee58160680 0x7fee5814a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee5ca00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fee58169f70 con 0x7fee5815f7b0 2024-08-18T22:32:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee5ca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fee580ae3e0 con 0x7fee58160680 2024-08-18T22:32:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee5ca00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fee5816a0f0 con 0x7fee5815c360 2024-08-18T22:32:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5815f7b0 0x7fee5814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5815f7b0 0x7fee5814a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54424/0 (socket says 172.21.15.5:54424) 2024-08-18T22:32:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4d400640 1 -- 172.21.15.5:0/2461838861 learned_addr learned my addr 172.21.15.5:0/2461838861 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee55e00640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815c360 0x7fee581498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee56800640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee58160680 0x7fee5814a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4d400640 1 -- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815c360 msgr2=0x7fee581498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4d400640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815c360 0x7fee581498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4d400640 1 -- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee58160680 msgr2=0x7fee5814a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4d400640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee58160680 0x7fee5814a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4d400640 1 -- 172.21.15.5:0/2461838861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee581469f0 con 0x7fee5815f7b0 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee56800640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee58160680 0x7fee5814a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4d400640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5815f7b0 0x7fee5814a170 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fee4000c3a0 tx=0x7fee4000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4ea00640 1 -- 172.21.15.5:0/2461838861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee400052d0 con 0x7fee5815f7b0 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4ea00640 1 -- 172.21.15.5:0/2461838861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40005470 con 0x7fee5815f7b0 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee5ca00640 1 -- 172.21.15.5:0/2461838861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee58146cd0 con 0x7fee5815f7b0 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee4ea00640 1 -- 172.21.15.5:0/2461838861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40007260 con 0x7fee5815f7b0 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.079+0000 7fee5ca00640 1 -- 172.21.15.5:0/2461838861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee58147290 con 0x7fee5815f7b0 2024-08-18T22:32:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.083+0000 7fee5ca00640 1 -- 172.21.15.5:0/2461838861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee5815cf00 con 0x7fee5815f7b0 2024-08-18T22:32:09.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.083+0000 7fee4ea00640 1 -- 172.21.15.5:0/2461838861 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee40007400 con 0x7fee5815f7b0 2024-08-18T22:32:09.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.083+0000 7fee4ea00640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 0x7fee34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:09.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.083+0000 7fee4ea00640 1 -- 172.21.15.5:0/2461838861 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7fee400851d0 con 0x7fee5815f7b0 2024-08-18T22:32:09.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.083+0000 7fee55e00640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 0x7fee34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:09.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.083+0000 7fee55e00640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 0x7fee34069d80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fee480012c0 tx=0x7fee48007b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:09.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.087+0000 7fee4ea00640 1 -- 172.21.15.5:0/2461838861 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fee400554d0 con 0x7fee5815f7b0 2024-08-18T22:32:09.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.287+0000 7fee5ca00640 1 -- 172.21.15.5:0/2461838861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fee580cd890 con 0x7fee5815f7b0 2024-08-18T22:32:09.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee4ea00640 1 -- 172.21.15.5:0/2461838861 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v140) ==== 121+0+0 (secure 0 0 0) 0x7fee400597d0 con 0x7fee5815f7b0 2024-08-18T22:32:09.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 -- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 msgr2=0x7fee34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:09.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 0x7fee34069d80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fee480012c0 tx=0x7fee48007b80 comp rx=0 tx=0).stop 2024-08-18T22:32:09.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 -- 172.21.15.5:0/2461838861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5815f7b0 msgr2=0x7fee5814a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:09.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5815f7b0 0x7fee5814a170 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fee4000c3a0 tx=0x7fee4000c860 comp rx=0 tx=0).stop 2024-08-18T22:32:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 -- 172.21.15.5:0/2461838861 shutdown_connections 2024-08-18T22:32:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fee340678c0 0x7fee34069d80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee58160680 0x7fee5814a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee5815f7b0 0x7fee5814a170 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 --2- 172.21.15.5:0/2461838861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5815c360 0x7fee581498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 -- 172.21.15.5:0/2461838861 >> 172.21.15.5:0/2461838861 conn(0x7fee580b65f0 msgr2=0x7fee5806fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 -- 172.21.15.5:0/2461838861 shutdown_connections 2024-08-18T22:32:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:09.907+0000 7fee5ca00640 1 -- 172.21.15.5:0/2461838861 wait complete. 2024-08-18T22:32:09.936 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:32:10.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf63a00640 1 Processor -- start 2024-08-18T22:32:10.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf63a00640 1 -- start start 2024-08-18T22:32:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf63a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf5c0afe50 0x7fcf5c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf63a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c0b5e60 0x7fcf5c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf63a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5c0b65d0 con 0x7fcf5c15e140 2024-08-18T22:32:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf63a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcf5c06e560 con 0x7fcf5c0afe50 2024-08-18T22:32:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf63a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5c0b68b0 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf5be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf5c0afe50 0x7fcf5c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf5be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf5c0afe50 0x7fcf5c0b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54438/0 (socket says 172.21.15.5:54438) 2024-08-18T22:32:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf5be00640 1 -- 172.21.15.5:0/1383041402 learned_addr learned my addr 172.21.15.5:0/1383041402 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:10.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf61a00640 1 --2- 172.21.15.5:0/1383041402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c0b5e60 0x7fcf5c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf5be00640 1 -- 172.21.15.5:0/1383041402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c0b5e60 msgr2=0x7fcf5c06efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf5be00640 1 --2- 172.21.15.5:0/1383041402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c0b5e60 0x7fcf5c06efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf5be00640 1 -- 172.21.15.5:0/1383041402 >> v1:172.21.15.117:6789/0 conn(0x7fcf5c15e140 legacy=0x7fcf5c0af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf5be00640 1 -- 172.21.15.5:0/1383041402 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c06e7b0 con 0x7fcf5c0afe50 2024-08-18T22:32:10.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.079+0000 7fcf61a00640 1 --2- 172.21.15.5:0/1383041402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c0b5e60 0x7fcf5c06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:10.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf5be00640 1 --2- 172.21.15.5:0/1383041402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5c0afe50 0x7fcf5c0b4e40 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009870 tx=0x7fcf4801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64dd5722eb93872d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:10.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf5b400640 1 -- 172.21.15.5:0/1383041402 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf480aa650 con 0x7fcf5c0afe50 2024-08-18T22:32:10.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf5b400640 1 -- 172.21.15.5:0/1383041402 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf480af070 con 0x7fcf5c0afe50 2024-08-18T22:32:10.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf5b400640 1 -- 172.21.15.5:0/1383041402 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf480aaa10 con 0x7fcf5c0afe50 2024-08-18T22:32:10.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf63a00640 1 -- 172.21.15.5:0/1383041402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5c0afe50 msgr2=0x7fcf5c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf63a00640 1 --2- 172.21.15.5:0/1383041402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5c0afe50 0x7fcf5c0b4e40 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009870 tx=0x7fcf4801c4d0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf63a00640 1 -- 172.21.15.5:0/1383041402 shutdown_connections 2024-08-18T22:32:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf63a00640 1 --2- 172.21.15.5:0/1383041402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c0b5e60 0x7fcf5c06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf63a00640 1 --2- 172.21.15.5:0/1383041402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5c0afe50 0x7fcf5c0b4e40 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf63a00640 1 -- 172.21.15.5:0/1383041402 >> 172.21.15.5:0/1383041402 conn(0x7fcf5c06b9b0 msgr2=0x7fcf5c06bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf63a00640 1 -- 172.21.15.5:0/1383041402 shutdown_connections 2024-08-18T22:32:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.083+0000 7fcf63a00640 1 -- 172.21.15.5:0/1383041402 wait complete. 2024-08-18T22:32:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf63a00640 1 Processor -- start 2024-08-18T22:32:10.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf63a00640 1 -- start start 2024-08-18T22:32:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf63a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c0afe50 0x7fcf5c0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf63a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5c0b5e60 0x7fcf5c146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf63a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c15e140 0x7fcf5c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf63a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c06fe80 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf63a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c06fd00 con 0x7fcf5c0afe50 2024-08-18T22:32:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf63a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5c070000 con 0x7fcf5c15e140 2024-08-18T22:32:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf5be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5c0b5e60 0x7fcf5c146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf5be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5c0b5e60 0x7fcf5c146310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54440/0 (socket says 172.21.15.5:54440) 2024-08-18T22:32:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf5be00640 1 -- 172.21.15.5:0/1408899237 learned_addr learned my addr 172.21.15.5:0/1408899237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf61a00640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c15e140 0x7fcf5c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf61000640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c0afe50 0x7fcf5c0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf5be00640 1 -- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c15e140 msgr2=0x7fcf5c15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf5be00640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c15e140 0x7fcf5c15a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf5be00640 1 -- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c0afe50 msgr2=0x7fcf5c0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf5be00640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c0afe50 0x7fcf5c0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf5be00640 1 -- 172.21.15.5:0/1408899237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c14e880 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf5be00640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5c0b5e60 0x7fcf5c146310 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fcf4801a100 tx=0x7fcf4801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:10.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf58c00640 1 -- 172.21.15.5:0/1408899237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf480bd5f0 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf58c00640 1 -- 172.21.15.5:0/1408899237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf480a6040 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf58c00640 1 -- 172.21.15.5:0/1408899237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf480bd9d0 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf63a00640 1 -- 172.21.15.5:0/1408899237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5c14eb60 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.087+0000 7fcf63a00640 1 -- 172.21.15.5:0/1408899237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5c14f120 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.091+0000 7fcf63a00640 1 -- 172.21.15.5:0/1408899237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5c0b4e40 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.091+0000 7fcf58c00640 1 -- 172.21.15.5:0/1408899237 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf480b33f0 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.091+0000 7fcf58c00640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf3c0678c0 0x7fcf3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.091+0000 7fcf58c00640 1 -- 172.21.15.5:0/1408899237 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7fcf48120100 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.091+0000 7fcf61000640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf3c0678c0 0x7fcf3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.091+0000 7fcf61000640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf3c0678c0 0x7fcf3c069d80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c001810 tx=0x7fcf4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:10.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.095+0000 7fcf58c00640 1 -- 172.21.15.5:0/1408899237 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcf48016150 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 -- 172.21.15.5:0/1408899237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf5c0d06c0 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf58c00640 1 -- 172.21.15.5:0/1408899237 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5239 (secure 0 0 0) 0x7fcf480f0490 con 0x7fcf5c0b5e60 2024-08-18T22:32:10.295 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:10.295 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":141,"btime":"2024-08-18T22:32:09:914521+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4068691051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4068691051},{"type":"v1","addr":"172.21.15.117:6836","nonce":4068691051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":9972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/4128479928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4128479928},{"type":"v1","addr":"172.21.15.5:6834","nonce":4128479928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":141,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:31:37.120589+0000","modified":"2024-08-18T22:32:09.914504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9981},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9975":{"gid":9975,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6835/1984562471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1984562471},{"type":"v1","addr":"172.21.15.5:6835","nonce":1984562471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9981":{"gid":9981,"name":"d","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/3224274565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3224274565},{"type":"v1","addr":"172.21.15.117:6837","nonce":3224274565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9981,"qdb_cluster":[9981]},"id":12}]} 2024-08-18T22:32:10.295 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 141 2024-08-18T22:32:10.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 -- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf3c0678c0 msgr2=0x7fcf3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf3c0678c0 0x7fcf3c069d80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c001810 tx=0x7fcf4c009040 comp rx=0 tx=0).stop 2024-08-18T22:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 -- 172.21.15.5:0/1408899237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5c0b5e60 msgr2=0x7fcf5c146310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5c0b5e60 0x7fcf5c146310 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fcf4801a100 tx=0x7fcf4801ad10 comp rx=0 tx=0).stop 2024-08-18T22:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 -- 172.21.15.5:0/1408899237 shutdown_connections 2024-08-18T22:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcf3c0678c0 0x7fcf3c069d80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c15e140 0x7fcf5c15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf5c0b5e60 0x7fcf5c146310 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 --2- 172.21.15.5:0/1408899237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c0afe50 0x7fcf5c0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 -- 172.21.15.5:0/1408899237 >> 172.21.15.5:0/1408899237 conn(0x7fcf5c06b9b0 msgr2=0x7fcf5c14fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 -- 172.21.15.5:0/1408899237 shutdown_connections 2024-08-18T22:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.295+0000 7fcf63a00640 1 -- 172.21.15.5:0/1408899237 wait complete. 2024-08-18T22:32:10.720 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 141, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-18T22:31:37.120589+0000', 'modified': '2024-08-18T22:32:09.914504+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9981}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9975': {'gid': 9975, 'name': 'a', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6835/1984562471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 1984562471}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1984562471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_9981': {'gid': 9981, 'name': 'd', 'rank': 0, 'incarnation': 134, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6837/3224274565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6835', 'nonce': 3224274565}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 3224274565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9981, 'qdb_cluster': [9981]} 2024-08-18T22:32:10.720 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:32:10.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-18T22:32:10.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf34c00640 1 Processor -- start 2024-08-18T22:32:10.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf34c00640 1 -- start start 2024-08-18T22:32:10.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf34c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf3015b0c0 0x7faf3006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf34c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faf300b40c0 0x7faf300b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf34c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf30072a30 0x7faf30072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf34c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7faf300b4a70 con 0x7faf3015b0c0 2024-08-18T22:32:10.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf34c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faf300b3d70 con 0x7faf300b40c0 2024-08-18T22:32:10.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf34c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf300b31f0 con 0x7faf30072a30 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf2de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf3015b0c0 0x7faf3006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf2de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf3015b0c0 0x7faf3006db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54450/0 (socket says 172.21.15.5:54450) 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf2de00640 1 -- 172.21.15.5:0/1118957911 learned_addr learned my addr 172.21.15.5:0/1118957911 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf2de00640 1 -- 172.21.15.5:0/1118957911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf30072a30 msgr2=0x7faf30072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf2e800640 1 --2- 172.21.15.5:0/1118957911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf30072a30 0x7faf30072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf25400640 1 --2- 172.21.15.5:0/1118957911 >> v2:172.21.15.117:3300/0 conn(0x7faf300b40c0 0x7faf300b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf2de00640 1 --2- 172.21.15.5:0/1118957911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf30072a30 0x7faf30072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf2de00640 1 -- 172.21.15.5:0/1118957911 >> v2:172.21.15.117:3300/0 conn(0x7faf300b40c0 msgr2=0x7faf300b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf2de00640 1 --2- 172.21.15.5:0/1118957911 >> v2:172.21.15.117:3300/0 conn(0x7faf300b40c0 0x7faf300b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf2de00640 1 -- 172.21.15.5:0/1118957911 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf300b34d0 con 0x7faf3015b0c0 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf2e800640 1 --2- 172.21.15.5:0/1118957911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf30072a30 0x7faf30072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:10.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.867+0000 7faf25400640 1 --2- 172.21.15.5:0/1118957911 >> v2:172.21.15.117:3300/0 conn(0x7faf300b40c0 0x7faf300b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf2de00640 1 --2- 172.21.15.5:0/1118957911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf3015b0c0 0x7faf3006db80 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7faf30073f90 tx=0x7faf2001eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1b63bb0df74a67 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf2d400640 1 -- 172.21.15.5:0/1118957911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf200b4070 con 0x7faf3015b0c0 2024-08-18T22:32:10.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf2d400640 1 -- 172.21.15.5:0/1118957911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf200a7a30 con 0x7faf3015b0c0 2024-08-18T22:32:10.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf2d400640 1 -- 172.21.15.5:0/1118957911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf200a7e00 con 0x7faf3015b0c0 2024-08-18T22:32:10.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf34c00640 1 -- 172.21.15.5:0/1118957911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf3015b0c0 msgr2=0x7faf3006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf34c00640 1 --2- 172.21.15.5:0/1118957911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf3015b0c0 0x7faf3006db80 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7faf30073f90 tx=0x7faf2001eaa0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf34c00640 1 -- 172.21.15.5:0/1118957911 shutdown_connections 2024-08-18T22:32:10.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf34c00640 1 --2- 172.21.15.5:0/1118957911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf30072a30 0x7faf30072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf34c00640 1 --2- 172.21.15.5:0/1118957911 >> v2:172.21.15.117:3300/0 conn(0x7faf300b40c0 0x7faf300b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf34c00640 1 --2- 172.21.15.5:0/1118957911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf3015b0c0 0x7faf3006db80 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf34c00640 1 -- 172.21.15.5:0/1118957911 >> 172.21.15.5:0/1118957911 conn(0x7faf300b1dc0 msgr2=0x7faf300b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:10.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf34c00640 1 -- 172.21.15.5:0/1118957911 shutdown_connections 2024-08-18T22:32:10.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.871+0000 7faf34c00640 1 -- 172.21.15.5:0/1118957911 wait complete. 2024-08-18T22:32:10.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf34c00640 1 Processor -- start 2024-08-18T22:32:10.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf34c00640 1 -- start start 2024-08-18T22:32:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf34c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf30072a30 0x7faf3014c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf34c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf300b40c0 0x7faf3009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf34c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf3015b0c0 0x7faf3009d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf34c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faf3015b620 con 0x7faf3015b0c0 2024-08-18T22:32:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf34c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faf3015b4a0 con 0x7faf30072a30 2024-08-18T22:32:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf34c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf300737d0 con 0x7faf300b40c0 2024-08-18T22:32:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf2e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf3015b0c0 0x7faf3009d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf2e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf3015b0c0 0x7faf3009d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54458/0 (socket says 172.21.15.5:54458) 2024-08-18T22:32:10.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf2e800640 1 -- 172.21.15.5:0/2174782382 learned_addr learned my addr 172.21.15.5:0/2174782382 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf25400640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf300b40c0 0x7faf3009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf2e800640 1 -- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf300b40c0 msgr2=0x7faf3009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf2de00640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf30072a30 0x7faf3014c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf2e800640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf300b40c0 0x7faf3009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf2e800640 1 -- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf30072a30 msgr2=0x7faf3014c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf2e800640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf30072a30 0x7faf3014c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf2e800640 1 -- 172.21.15.5:0/2174782382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3009c550 con 0x7faf3015b0c0 2024-08-18T22:32:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf25400640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf300b40c0 0x7faf3009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf2e800640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf3015b0c0 0x7faf3009d870 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7faf2800cd40 tx=0x7faf2800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf26a00640 1 -- 172.21.15.5:0/2174782382 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2800f680 con 0x7faf3015b0c0 2024-08-18T22:32:10.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf26a00640 1 -- 172.21.15.5:0/2174782382 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2800f840 con 0x7faf3015b0c0 2024-08-18T22:32:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf26a00640 1 -- 172.21.15.5:0/2174782382 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2800fc30 con 0x7faf3015b0c0 2024-08-18T22:32:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf34c00640 1 -- 172.21.15.5:0/2174782382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3009c7d0 con 0x7faf3015b0c0 2024-08-18T22:32:10.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.875+0000 7faf34c00640 1 -- 172.21.15.5:0/2174782382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3009cd90 con 0x7faf3015b0c0 2024-08-18T22:32:10.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf26a00640 1 -- 172.21.15.5:0/2174782382 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf2800e3e0 con 0x7faf3015b0c0 2024-08-18T22:32:10.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf26a00640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf0c0678c0 0x7faf0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf26a00640 1 -- 172.21.15.5:0/2174782382 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7faf28086c30 con 0x7faf3015b0c0 2024-08-18T22:32:10.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf38001000 1 Processor -- start 2024-08-18T22:32:10.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf2de00640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf0c0678c0 0x7faf0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf38001000 1 -- start start 2024-08-18T22:32:10.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf2de00640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf0c0678c0 0x7faf0c069d80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faf200b1000 tx=0x7faf20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf38001000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea32fa0 0x56483ea33380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf38001000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea338c0 0x56483e9e8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf38001000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483e9e9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf38001000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56483e8cbfd0 con 0x56483ea338c0 2024-08-18T22:32:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf38001000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56483e8323c0 con 0x56483e9e9280 2024-08-18T22:32:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf38001000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56483e7d7f70 con 0x56483ea32fa0 2024-08-18T22:32:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf25400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea338c0 0x56483e9e8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf25400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea338c0 0x56483e9e8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54468/0 (socket says 172.21.15.5:54468) 2024-08-18T22:32:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf25400640 1 -- 172.21.15.5:0/959794895 learned_addr learned my addr 172.21.15.5:0/959794895 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf2de00640 1 --2- 172.21.15.5:0/959794895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea32fa0 0x56483ea33380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf2e800640 1 --2- 172.21.15.5:0/959794895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483e9e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf25400640 1 -- 172.21.15.5:0/959794895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea32fa0 msgr2=0x56483ea33380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:10.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.879+0000 7faf25400640 1 --2- 172.21.15.5:0/959794895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea32fa0 0x56483ea33380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 -- 172.21.15.5:0/959794895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 msgr2=0x56483e9e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:10.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 --2- 172.21.15.5:0/959794895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483e9e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 -- 172.21.15.5:0/959794895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56483e7cc2e0 con 0x56483ea338c0 2024-08-18T22:32:10.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 --2- 172.21.15.5:0/959794895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea338c0 0x56483e9e8d40 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7faf1800bab0 tx=0x7faf1800bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62065fa098c872b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf1ea00640 1 -- 172.21.15.5:0/959794895 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18016070 con 0x56483ea338c0 2024-08-18T22:32:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf1ea00640 1 -- 172.21.15.5:0/959794895 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1800dd90 con 0x56483ea338c0 2024-08-18T22:32:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf1ea00640 1 -- 172.21.15.5:0/959794895 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18012660 con 0x56483ea338c0 2024-08-18T22:32:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 -- 172.21.15.5:0/959794895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea338c0 msgr2=0x56483e9e8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 --2- 172.21.15.5:0/959794895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea338c0 0x56483e9e8d40 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7faf1800bab0 tx=0x7faf1800bf70 comp rx=0 tx=0).stop 2024-08-18T22:32:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 -- 172.21.15.5:0/959794895 shutdown_connections 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 --2- 172.21.15.5:0/959794895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483e9e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 --2- 172.21.15.5:0/959794895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea338c0 0x56483e9e8d40 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 --2- 172.21.15.5:0/959794895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea32fa0 0x56483ea33380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 -- 172.21.15.5:0/959794895 >> 172.21.15.5:0/959794895 conn(0x56483e9eaaa0 msgr2=0x56483e9eae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 -- 172.21.15.5:0/959794895 shutdown_connections 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 -- 172.21.15.5:0/959794895 wait complete. 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 -- start start 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 Processor -- start 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483ea3a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483ea3a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea338c0 0x56483ea3adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56483e7d9e40 con 0x56483ea32fa0 2024-08-18T22:32:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56483e8efaf0 con 0x56483e9e9280 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56483e894450 con 0x56483ea338c0 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf38001000 10 client.0 _ll_register_callbacks cb 0x56483e9d0630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483ea3a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483ea3a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54474/0 (socket says 172.21.15.5:54474) 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 -- 172.21.15.5:0/2838049681 learned_addr learned my addr 172.21.15.5:0/2838049681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf2de00640 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483ea3a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf2e800640 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea338c0 0x56483ea3adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 -- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea338c0 msgr2=0x56483ea3adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea338c0 0x56483ea3adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 -- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 msgr2=0x56483ea3a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483ea3a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.883+0000 7faf25400640 1 -- 172.21.15.5:0/2838049681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56483e7b9fd0 con 0x56483ea32fa0 2024-08-18T22:32:10.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf25400640 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483ea3a870 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x56483e82a670 tx=0x7faf18004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b42a173fa0aae9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:10.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf13400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:10.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf13400640 1 -- 172.21.15.5:0/2838049681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1802b060 con 0x56483ea32fa0 2024-08-18T22:32:10.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 -- 172.21.15.5:0/2838049681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf1800dd90 con 0x56483ea32fa0 2024-08-18T22:32:10.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf13400640 1 -- 172.21.15.5:0/2838049681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7faf1800b1f0 con 0x56483ea32fa0 2024-08-18T22:32:10.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf13400640 1 -- 172.21.15.5:0/2838049681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7faf18031050 con 0x56483ea32fa0 2024-08-18T22:32:10.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 10 client.10131 fetch_fsmap learned FSMap version 141 2024-08-18T22:32:10.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 -- 172.21.15.5:0/2838049681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x56483e8b54d0 con 0x56483ea32fa0 2024-08-18T22:32:10.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf13400640 1 -- 172.21.15.5:0/2838049681 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1800dd90 con 0x56483ea32fa0 2024-08-18T22:32:10.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf13400640 1 -- 172.21.15.5:0/2838049681 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7faf18034020 con 0x56483ea32fa0 2024-08-18T22:32:10.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 10 client.10131 fetch_fsmap finished waiting for FSMap version 141 2024-08-18T22:32:10.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 10 client.10131 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-18T22:32:10.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 20 client.10131 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x56483ea42700 0x56483ea44af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 4 client.10131 mds_command: new command op to 9981 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:32:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 -- 172.21.15.5:0/2838049681 --> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56483e7ccc00 con 0x56483ea42700 2024-08-18T22:32:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf2de00640 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x56483ea42700 0x56483ea44af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf2de00640 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x56483ea42700 0x56483ea44af0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ef3ad220409c969 server_cookie=eac41a44b624683f in_seq=0 out_seq=0 2024-08-18T22:32:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf13400640 10 client.10131 ms_handle_connect on v2:172.21.15.117:6835/3224274565 2024-08-18T22:32:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf13400640 1 -- 172.21.15.5:0/2838049681 <== mds.0 v2:172.21.15.117:6835/3224274565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56483e7ccc00 con 0x56483ea42700 2024-08-18T22:32:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf13400640 10 client.10131 handle_command_reply: tid=0 2024-08-18T22:32:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 client.10131 shutdown 2024-08-18T22:32:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 -- 172.21.15.5:0/2838049681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 msgr2=0x56483ea3a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483ea3a870 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x56483e82a670 tx=0x7faf18004740 comp rx=0 tx=0).stop 2024-08-18T22:32:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 -- 172.21.15.5:0/2838049681 shutdown_connections 2024-08-18T22:32:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x56483ea42700 0x56483ea44af0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea338c0 0x56483ea3adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483ea3a870 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 --2- 172.21.15.5:0/2838049681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483ea3a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 -- 172.21.15.5:0/2838049681 >> 172.21.15.5:0/2838049681 conn(0x56483e9eaaa0 msgr2=0x56483e9e9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf13400640 0 client.10131 ms_handle_reset on v2:172.21.15.117:6835/3224274565 2024-08-18T22:32:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 -- 172.21.15.5:0/2838049681 shutdown_connections 2024-08-18T22:32:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 1 -- 172.21.15.5:0/2838049681 wait complete. 2024-08-18T22:32:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.887+0000 7faf38001000 20 client.10131 trim_cache size 0 max 16384 2024-08-18T22:32:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf38001000 1 Processor -- start 2024-08-18T22:32:10.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf38001000 1 -- start start 2024-08-18T22:32:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf38001000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483e9f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf38001000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483e9f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf38001000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea338c0 0x56483e9f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf38001000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faf301ffb90 con 0x56483ea32fa0 2024-08-18T22:32:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf38001000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faf301f7440 con 0x56483e9e9280 2024-08-18T22:32:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf38001000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faf301f4910 con 0x56483ea338c0 2024-08-18T22:32:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf25400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483e9f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf25400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483e9f2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54480/0 (socket says 172.21.15.5:54480) 2024-08-18T22:32:10.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf25400640 1 -- 172.21.15.5:0/2279474544 learned_addr learned my addr 172.21.15.5:0/2279474544 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:10.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf2de00640 1 --2- 172.21.15.5:0/2279474544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483e9f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf2e800640 1 --2- 172.21.15.5:0/2279474544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea338c0 0x56483e9f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf25400640 1 -- 172.21.15.5:0/2279474544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea338c0 msgr2=0x56483e9f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:10.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf25400640 1 --2- 172.21.15.5:0/2279474544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea338c0 0x56483e9f34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf25400640 1 -- 172.21.15.5:0/2279474544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 msgr2=0x56483e9f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:10.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf25400640 1 --2- 172.21.15.5:0/2279474544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483e9f3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.907+0000 7faf25400640 1 -- 172.21.15.5:0/2279474544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56483e82bb30 con 0x56483ea32fa0 2024-08-18T22:32:10.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf25400640 1 --2- 172.21.15.5:0/2279474544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483e9f2f90 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7faf1801cc60 tx=0x7faf1801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566662cd5e291720 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf1e000640 1 -- 172.21.15.5:0/2279474544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18016040 con 0x56483ea32fa0 2024-08-18T22:32:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf1e000640 1 -- 172.21.15.5:0/2279474544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1803a070 con 0x56483ea32fa0 2024-08-18T22:32:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf1e000640 1 -- 172.21.15.5:0/2279474544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1800ddb0 con 0x56483ea32fa0 2024-08-18T22:32:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 -- 172.21.15.5:0/2279474544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 msgr2=0x56483e9f2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 --2- 172.21.15.5:0/2279474544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483e9f2f90 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7faf1801cc60 tx=0x7faf1801e040 comp rx=0 tx=0).stop 2024-08-18T22:32:10.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 -- 172.21.15.5:0/2279474544 shutdown_connections 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 --2- 172.21.15.5:0/2279474544 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483ea338c0 0x56483e9f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 --2- 172.21.15.5:0/2279474544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483e9f2f90 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 --2- 172.21.15.5:0/2279474544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483e9e9280 0x56483e9f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 -- 172.21.15.5:0/2279474544 >> 172.21.15.5:0/2279474544 conn(0x56483e9eaaa0 msgr2=0x56483e9e8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 -- 172.21.15.5:0/2279474544 shutdown_connections 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 -- 172.21.15.5:0/2279474544 wait complete. 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 -- start start 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 Processor -- start 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483e9e9280 0x56483eaa6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483eaa6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483ea338c0 0x56483eaa6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56483e7eb1d0 con 0x56483ea32fa0 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56483e7c9900 con 0x56483ea338c0 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56483e8316d0 con 0x56483e9e9280 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf38001000 10 client.0 _ll_register_callbacks cb 0x7faf28053260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf25400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483eaa6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf25400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483eaa6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54486/0 (socket says 172.21.15.5:54486) 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf25400640 1 -- 172.21.15.5:0/3695528404 learned_addr learned my addr 172.21.15.5:0/3695528404 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf2de00640 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483e9e9280 0x56483eaa6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf2e800640 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483ea338c0 0x56483eaa6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf25400640 1 -- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483e9e9280 msgr2=0x56483eaa6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf25400640 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483e9e9280 0x56483eaa6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf25400640 1 -- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483ea338c0 msgr2=0x56483eaa6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf25400640 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483ea338c0 0x56483eaa6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf25400640 1 -- 172.21.15.5:0/3695528404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56483e7e3810 con 0x56483ea32fa0 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf2de00640 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483e9e9280 0x56483eaa6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.911+0000 7faf2e800640 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483ea338c0 0x56483eaa6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf25400640 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483eaa6950 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7faf1800bfd0 tx=0x7faf18014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9eb32e8f95d76 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf13400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf13400640 1 -- 172.21.15.5:0/3695528404 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18016040 con 0x56483ea32fa0 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf13400640 1 -- 172.21.15.5:0/3695528404 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7faf18012870 con 0x56483ea32fa0 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 -- 172.21.15.5:0/3695528404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf1803a070 con 0x56483ea32fa0 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf13400640 1 -- 172.21.15.5:0/3695528404 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7faf1804d050 con 0x56483ea32fa0 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 10 client.10137 fetch_fsmap learned FSMap version 141 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 -- 172.21.15.5:0/3695528404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x56483e7c8d30 con 0x56483ea32fa0 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf13400640 1 -- 172.21.15.5:0/3695528404 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1803a070 con 0x56483ea32fa0 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf13400640 1 -- 172.21.15.5:0/3695528404 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7faf18050020 con 0x56483ea32fa0 2024-08-18T22:32:10.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 10 client.10137 fetch_fsmap finished waiting for FSMap version 141 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 10 client.10137 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 20 client.10137 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x56483ea3e650 0x56483ea3ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 4 client.10137 mds_command: new command op to 9981 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 -- 172.21.15.5:0/3695528404 --> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] -- command(tid 0: {"prefix": "status"}) -- 0x56483e83faf0 con 0x56483ea3e650 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf2de00640 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x56483ea3e650 0x56483ea3ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf2de00640 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x56483ea3e650 0x56483ea3ea30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fff174568a57fed2 server_cookie=fe2df5ce7e15900d in_seq=0 out_seq=0 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf13400640 10 client.10137 ms_handle_connect on v2:172.21.15.117:6835/3224274565 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf13400640 1 -- 172.21.15.5:0/3695528404 <== mds.0 v2:172.21.15.117:6835/3224274565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x56483e83faf0 con 0x56483ea3e650 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf13400640 10 client.10137 handle_command_reply: tid=0 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 client.10137 shutdown 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 -- 172.21.15.5:0/3695528404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 msgr2=0x56483eaa6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483eaa6950 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7faf1800bfd0 tx=0x7faf18014000 comp rx=0 tx=0).stop 2024-08-18T22:32:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 -- 172.21.15.5:0/3695528404 shutdown_connections 2024-08-18T22:32:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56483ea338c0 0x56483eaa6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483ea32fa0 0x56483eaa6950 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:6835/3224274565,v1:172.21.15.117:6837/3224274565] conn(0x56483ea3e650 0x56483ea3ea30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 --2- 172.21.15.5:0/3695528404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56483e9e9280 0x56483eaa6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf13400640 0 client.10137 ms_handle_reset on v2:172.21.15.117:6835/3224274565 2024-08-18T22:32:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 -- 172.21.15.5:0/3695528404 >> 172.21.15.5:0/3695528404 conn(0x56483e9eaaa0 msgr2=0x56483e9f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 -- 172.21.15.5:0/3695528404 shutdown_connections 2024-08-18T22:32:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 1 -- 172.21.15.5:0/3695528404 wait complete. 2024-08-18T22:32:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf38001000 20 client.10137 trim_cache size 0 max 16384 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 9981, 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 33.208866135000001, 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 141, 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 179, 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 179, 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 38.050139438000002 2024-08-18T22:32:10.923 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:32:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 -- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf0c0678c0 msgr2=0x7faf0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf0c0678c0 0x7faf0c069d80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faf200b1000 tx=0x7faf20008040 comp rx=0 tx=0).stop 2024-08-18T22:32:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 -- 172.21.15.5:0/2174782382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf3015b0c0 msgr2=0x7faf3009d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:10.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf3015b0c0 0x7faf3009d870 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7faf2800cd40 tx=0x7faf2800a650 comp rx=0 tx=0).stop 2024-08-18T22:32:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 -- 172.21.15.5:0/2174782382 shutdown_connections 2024-08-18T22:32:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faf0c0678c0 0x7faf0c069d80 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf3015b0c0 0x7faf3009d870 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf300b40c0 0x7faf3009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 --2- 172.21.15.5:0/2174782382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf30072a30 0x7faf3014c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 -- 172.21.15.5:0/2174782382 >> 172.21.15.5:0/2174782382 conn(0x7faf300b1dc0 msgr2=0x7faf300b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 -- 172.21.15.5:0/2174782382 shutdown_connections 2024-08-18T22:32:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:10.915+0000 7faf34c00640 1 -- 172.21.15.5:0/2174782382 wait complete. 2024-08-18T22:32:10.936 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub start /scrub_control_test_path recursive 2024-08-18T22:32:11.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe093000640 1 Processor -- start 2024-08-18T22:32:11.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe093000640 1 -- start start 2024-08-18T22:32:11.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe093000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe08c162980 0x7fe08c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe093000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c09b390 con 0x7fe08c09af80 2024-08-18T22:32:11.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe093000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c0b6500 con 0x7fe08c1625a0 2024-08-18T22:32:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe093000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe08c162df0 con 0x7fe08c162980 2024-08-18T22:32:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe091000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe08c09af80 0x7fe08c06ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42438/0 (socket says 172.21.15.5:42438) 2024-08-18T22:32:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe091000640 1 -- 172.21.15.5:0/678771056 learned_addr learned my addr 172.21.15.5:0/678771056 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe083400640 1 --2- 172.21.15.5:0/678771056 >> v2:172.21.15.117:3300/0 conn(0x7fe08c162980 0x7fe08c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe08b400640 1 -- 172.21.15.5:0/678771056 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322693056 0 0) 0x7fe0840014a0 con 0x7fe08c09af80 2024-08-18T22:32:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe08b400640 1 -- 172.21.15.5:0/678771056 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe070003530 con 0x7fe08c09af80 2024-08-18T22:32:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe08b400640 1 -- 172.21.15.5:0/678771056 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253083056 0 0) 0x7fe08c0b6500 con 0x7fe08c1625a0 2024-08-18T22:32:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe08b400640 1 -- 172.21.15.5:0/678771056 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0840014a0 con 0x7fe08c1625a0 2024-08-18T22:32:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe083400640 1 -- 172.21.15.5:0/678771056 >> v1:172.21.15.117:6789/0 conn(0x7fe08c1625a0 legacy=0x7fe08c0b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe08b400640 1 -- 172.21.15.5:0/678771056 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 745884873 0 0) 0x7fe070003530 con 0x7fe08c09af80 2024-08-18T22:32:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe083400640 1 -- 172.21.15.5:0/678771056 >> v1:172.21.15.5:6789/0 conn(0x7fe08c09af80 legacy=0x7fe08c06ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.083+0000 7fe083400640 1 -- 172.21.15.5:0/678771056 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c0b67e0 con 0x7fe08c162980 2024-08-18T22:32:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.087+0000 7fe083400640 1 --2- 172.21.15.5:0/678771056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe08c162980 0x7fe08c09aa40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe0740097c0 tx=0x7fe07401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bd3193e30f1bcc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.087+0000 7fe08b400640 1 -- 172.21.15.5:0/678771056 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0740b0070 con 0x7fe08c162980 2024-08-18T22:32:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.087+0000 7fe08b400640 1 -- 172.21.15.5:0/678771056 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0740ab400 con 0x7fe08c162980 2024-08-18T22:32:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.087+0000 7fe08b400640 1 -- 172.21.15.5:0/678771056 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084001bd0 con 0x7fe08c162980 2024-08-18T22:32:11.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.087+0000 7fe093000640 1 -- 172.21.15.5:0/678771056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe08c162980 msgr2=0x7fe08c09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.087+0000 7fe093000640 1 --2- 172.21.15.5:0/678771056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe08c162980 0x7fe08c09aa40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe0740097c0 tx=0x7fe07401c330 comp rx=0 tx=0).stop 2024-08-18T22:32:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.087+0000 7fe093000640 1 -- 172.21.15.5:0/678771056 shutdown_connections 2024-08-18T22:32:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.087+0000 7fe093000640 1 --2- 172.21.15.5:0/678771056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe08c162980 0x7fe08c09aa40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.087+0000 7fe093000640 1 -- 172.21.15.5:0/678771056 >> 172.21.15.5:0/678771056 conn(0x7fe08c0b3d60 msgr2=0x7fe08c0b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.087+0000 7fe093000640 1 -- 172.21.15.5:0/678771056 shutdown_connections 2024-08-18T22:32:11.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.087+0000 7fe093000640 1 -- 172.21.15.5:0/678771056 wait complete. 2024-08-18T22:32:11.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe093000640 1 Processor -- start 2024-08-18T22:32:11.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe093000640 1 -- start start 2024-08-18T22:32:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe093000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe08c09af80 0x7fe08c150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe093000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe08c1625a0 0x7fe08c1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe093000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe08c162980 0x7fe08c15d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe093000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c071010 con 0x7fe08c1625a0 2024-08-18T22:32:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe093000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c070e90 con 0x7fe08c09af80 2024-08-18T22:32:11.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe093000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe08c071190 con 0x7fe08c162980 2024-08-18T22:32:11.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe083400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe08c1625a0 0x7fe08c1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe083400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe08c1625a0 0x7fe08c1598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54492/0 (socket says 172.21.15.5:54492) 2024-08-18T22:32:11.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe083400640 1 -- 172.21.15.5:0/1476430080 learned_addr learned my addr 172.21.15.5:0/1476430080 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe08be00640 1 --2- 172.21.15.5:0/1476430080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe08c09af80 0x7fe08c150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe091000640 1 --2- 172.21.15.5:0/1476430080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe08c162980 0x7fe08c15d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe083400640 1 -- 172.21.15.5:0/1476430080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe08c162980 msgr2=0x7fe08c15d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe083400640 1 --2- 172.21.15.5:0/1476430080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe08c162980 0x7fe08c15d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe083400640 1 -- 172.21.15.5:0/1476430080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe08c09af80 msgr2=0x7fe08c150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe083400640 1 --2- 172.21.15.5:0/1476430080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe08c09af80 0x7fe08c150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe083400640 1 -- 172.21.15.5:0/1476430080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c159010 con 0x7fe08c1625a0 2024-08-18T22:32:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe08be00640 1 --2- 172.21.15.5:0/1476430080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe08c09af80 0x7fe08c150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe091000640 1 --2- 172.21.15.5:0/1476430080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe08c162980 0x7fe08c15d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe083400640 1 --2- 172.21.15.5:0/1476430080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe08c1625a0 0x7fe08c1598e0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fe0740ae040 tx=0x7fe0740190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe088c00640 1 -- 172.21.15.5:0/1476430080 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0740b8070 con 0x7fe08c1625a0 2024-08-18T22:32:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe088c00640 1 -- 172.21.15.5:0/1476430080 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe074004020 con 0x7fe08c1625a0 2024-08-18T22:32:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe088c00640 1 -- 172.21.15.5:0/1476430080 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0740b0040 con 0x7fe08c1625a0 2024-08-18T22:32:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe093000640 1 -- 172.21.15.5:0/1476430080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08c0b0e80 con 0x7fe08c1625a0 2024-08-18T22:32:11.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.091+0000 7fe093000640 1 -- 172.21.15.5:0/1476430080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08c15d180 con 0x7fe08c1625a0 2024-08-18T22:32:11.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe088c00640 1 -- 172.21.15.5:0/1476430080 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe074003620 con 0x7fe08c1625a0 2024-08-18T22:32:11.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe088c00640 1 --2- 172.21.15.5:0/1476430080 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe0680678f0 0x7fe068069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe088c00640 1 -- 172.21.15.5:0/1476430080 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7fe07411f920 con 0x7fe08c1625a0 2024-08-18T22:32:11.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe08be00640 1 --2- 172.21.15.5:0/1476430080 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe0680678f0 0x7fe068069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe0964eb000 1 Processor -- start 2024-08-18T22:32:11.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe0964eb000 1 -- start start 2024-08-18T22:32:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe08be00640 1 --2- 172.21.15.5:0/1476430080 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe0680678f0 0x7fe068069db0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fe08c1fa400 tx=0x7fe07c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb056930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb056e70 0x55a9bb0099f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb009f30 0x55a9bb00a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe0964eb000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a9baef3720 con 0x55a9bb056e70 2024-08-18T22:32:11.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe0964eb000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a9bae5b2d0 con 0x55a9bb056550 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.095+0000 7fe0964eb000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a9badf6ce0 con 0x55a9bb009f30 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe083400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb056e70 0x55a9bb0099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe083400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb056e70 0x55a9bb0099f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54506/0 (socket says 172.21.15.5:54506) 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe083400640 1 -- 172.21.15.5:0/2326639475 learned_addr learned my addr 172.21.15.5:0/2326639475 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe08be00640 1 --2- 172.21.15.5:0/2326639475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb056930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe091000640 1 --2- 172.21.15.5:0/2326639475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb009f30 0x55a9bb00a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe083400640 1 -- 172.21.15.5:0/2326639475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb009f30 msgr2=0x55a9bb00a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe083400640 1 --2- 172.21.15.5:0/2326639475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb009f30 0x55a9bb00a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe083400640 1 -- 172.21.15.5:0/2326639475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 msgr2=0x55a9bb056930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe083400640 1 --2- 172.21.15.5:0/2326639475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb056930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe083400640 1 -- 172.21.15.5:0/2326639475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9bae21fd0 con 0x55a9bb056e70 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe091000640 1 --2- 172.21.15.5:0/2326639475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb009f30 0x55a9bb00a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe083400640 1 --2- 172.21.15.5:0/2326639475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb056e70 0x55a9bb0099f0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fe0740ebfd0 tx=0x7fe0740ebf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65aa2e3f7918054 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe080c00640 1 -- 172.21.15.5:0/2326639475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0740c1040 con 0x55a9bb056e70 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe080c00640 1 -- 172.21.15.5:0/2326639475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0740f3f20 con 0x55a9bb056e70 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe080c00640 1 -- 172.21.15.5:0/2326639475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0740f8750 con 0x55a9bb056e70 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 -- 172.21.15.5:0/2326639475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb056e70 msgr2=0x55a9bb0099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 --2- 172.21.15.5:0/2326639475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb056e70 0x55a9bb0099f0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fe0740ebfd0 tx=0x7fe0740ebf40 comp rx=0 tx=0).stop 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 -- 172.21.15.5:0/2326639475 shutdown_connections 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 --2- 172.21.15.5:0/2326639475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb009f30 0x55a9bb00a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 --2- 172.21.15.5:0/2326639475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb056e70 0x55a9bb0099f0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 --2- 172.21.15.5:0/2326639475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb056930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 -- 172.21.15.5:0/2326639475 >> 172.21.15.5:0/2326639475 conn(0x55a9bb037400 msgr2=0x55a9bb0397f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 -- 172.21.15.5:0/2326639475 shutdown_connections 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 -- 172.21.15.5:0/2326639475 wait complete. 2024-08-18T22:32:11.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 -- start start 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 Processor -- start 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb05d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb05d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb05dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a9baf169e0 con 0x55a9bb009f30 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a9bae02670 con 0x55a9bb056550 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a9bae221f0 con 0x55a9bb056e70 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe0964eb000 10 client.0 _ll_register_callbacks cb 0x55a9baff7960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe08be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb05d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe08be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb05d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54516/0 (socket says 172.21.15.5:54516) 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe08be00640 1 -- 172.21.15.5:0/1776826712 learned_addr learned my addr 172.21.15.5:0/1776826712 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe083400640 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb05d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.099+0000 7fe091000640 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb05dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe08be00640 1 -- 172.21.15.5:0/1776826712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 msgr2=0x55a9bb05dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe08be00640 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb05dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe08be00640 1 -- 172.21.15.5:0/1776826712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 msgr2=0x55a9bb05d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe08be00640 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb05d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe08be00640 1 -- 172.21.15.5:0/1776826712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9bae0f170 con 0x55a9bb009f30 2024-08-18T22:32:11.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe08be00640 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb05d2b0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00dd10 tx=0x7fe07c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99bef3d32830ffb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe079600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:11.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe079600640 1 -- 172.21.15.5:0/1776826712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c020420 con 0x55a9bb009f30 2024-08-18T22:32:11.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 -- 172.21.15.5:0/1776826712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0740f3f20 con 0x55a9bb009f30 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe079600640 1 -- 172.21.15.5:0/1776826712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7fe07c0205c0 con 0x55a9bb009f30 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe079600640 1 -- 172.21.15.5:0/1776826712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7fe07c02d050 con 0x55a9bb009f30 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 10 client.10149 fetch_fsmap learned FSMap version 141 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 -- 172.21.15.5:0/1776826712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55a9bae169e0 con 0x55a9bb009f30 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe079600640 1 -- 172.21.15.5:0/1776826712 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0740f3f20 con 0x55a9bb009f30 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe079600640 1 -- 172.21.15.5:0/1776826712 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7fe07c030020 con 0x55a9bb009f30 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 10 client.10149 fetch_fsmap finished waiting for FSMap version 141 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 10 client.10149 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 20 client.10149 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55a9bb065680 0x55a9bb067a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 4 client.10149 mds_command: new command op to 9975 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 -- 172.21.15.5:0/1776826712 --> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9badf5b20 con 0x55a9bb065680 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe083400640 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55a9bb065680 0x55a9bb067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe083400640 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55a9bb065680 0x55a9bb067a70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9975 client_cookie=45e86ec3a5df5d51 server_cookie=67cb0888e6104550 in_seq=0 out_seq=0 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe079600640 10 client.10149 ms_handle_connect on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe079600640 1 -- 172.21.15.5:0/1776826712 <== mds.9975 v2:172.21.15.5:6833/1984562471 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9badf5b20 con 0x55a9bb065680 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe079600640 10 client.10149 handle_command_reply: tid=0 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 client.10149 shutdown 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 -- 172.21.15.5:0/1776826712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 msgr2=0x55a9bb05d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb05d2b0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00dd10 tx=0x7fe07c000bd0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 -- 172.21.15.5:0/1776826712 shutdown_connections 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55a9bb065680 0x55a9bb067a70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb05dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb05d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe079600640 0 client.10149 ms_handle_reset on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1776826712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb05d2b0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 -- 172.21.15.5:0/1776826712 >> 172.21.15.5:0/1776826712 conn(0x55a9bb037400 msgr2=0x55a9bb0090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 -- 172.21.15.5:0/1776826712 shutdown_connections 2024-08-18T22:32:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 1 -- 172.21.15.5:0/1776826712 wait complete. 2024-08-18T22:32:11.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.103+0000 7fe0964eb000 20 client.10149 trim_cache size 0 max 16384 2024-08-18T22:32:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe0964eb000 1 Processor -- start 2024-08-18T22:32:11.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe0964eb000 1 -- start start 2024-08-18T22:32:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb008e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe0964eb000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c203f00 con 0x55a9bb009f30 2024-08-18T22:32:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe0964eb000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c158870 con 0x55a9bb056550 2024-08-18T22:32:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe0964eb000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe08c2028e0 con 0x55a9bb056e70 2024-08-18T22:32:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe08be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe08be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0088d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54526/0 (socket says 172.21.15.5:54526) 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe08be00640 1 -- 172.21.15.5:0/1967662513 learned_addr learned my addr 172.21.15.5:0/1967662513 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe08be00640 1 -- 172.21.15.5:0/1967662513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 msgr2=0x55a9bb06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe091000640 1 --2- 172.21.15.5:0/1967662513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe083400640 1 --2- 172.21.15.5:0/1967662513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb008e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe08be00640 1 --2- 172.21.15.5:0/1967662513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb06aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe08be00640 1 -- 172.21.15.5:0/1967662513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 msgr2=0x55a9bb008e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe08be00640 1 --2- 172.21.15.5:0/1967662513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb008e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe08be00640 1 -- 172.21.15.5:0/1967662513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9baedc730 con 0x55a9bb009f30 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe091000640 1 --2- 172.21.15.5:0/1967662513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe083400640 1 --2- 172.21.15.5:0/1967662513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb008e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe08be00640 1 --2- 172.21.15.5:0/1967662513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0088d0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00d240 tx=0x7fe07c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9557612ee1ff8951 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe07be00640 1 -- 172.21.15.5:0/1967662513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c020cf0 con 0x55a9bb009f30 2024-08-18T22:32:11.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe07be00640 1 -- 172.21.15.5:0/1967662513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c025070 con 0x55a9bb009f30 2024-08-18T22:32:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.123+0000 7fe07be00640 1 -- 172.21.15.5:0/1967662513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c020660 con 0x55a9bb009f30 2024-08-18T22:32:11.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 -- 172.21.15.5:0/1967662513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 msgr2=0x55a9bb0088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1967662513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0088d0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00d240 tx=0x7fe07c01e000 comp rx=0 tx=0).stop 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 -- 172.21.15.5:0/1967662513 shutdown_connections 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1967662513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1967662513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb008e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1967662513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0088d0 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 -- 172.21.15.5:0/1967662513 >> 172.21.15.5:0/1967662513 conn(0x55a9bb037400 msgr2=0x55a9bb0081c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 -- 172.21.15.5:0/1967662513 shutdown_connections 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 -- 172.21.15.5:0/1967662513 wait complete. 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 -- start start 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 Processor -- start 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb0ca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a9bae16f70 con 0x55a9bb009f30 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a9badf2820 con 0x55a9bb056550 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55a9bae5a5e0 con 0x55a9bb056e70 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 10 client.0 _ll_register_callbacks cb 0x7fe07c00d4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe08be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe08be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54530/0 (socket says 172.21.15.5:54530) 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe08be00640 1 -- 172.21.15.5:0/1230125508 learned_addr learned my addr 172.21.15.5:0/1230125508 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe083400640 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb0ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe091000640 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe08be00640 1 -- 172.21.15.5:0/1230125508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 msgr2=0x55a9bb0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe08be00640 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb0caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe08be00640 1 -- 172.21.15.5:0/1230125508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 msgr2=0x55a9bb0ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe08be00640 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb0ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe08be00640 1 -- 172.21.15.5:0/1230125508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9bae19040 con 0x55a9bb009f30 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe08be00640 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0c9ff0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x55a9baef76b0 tx=0x7fe07c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82eb0d0d9fa2003c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe079600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe079600640 1 -- 172.21.15.5:0/1230125508 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c020830 con 0x55a9bb009f30 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe079600640 1 -- 172.21.15.5:0/1230125508 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7fe07c044c80 con 0x55a9bb009f30 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 -- 172.21.15.5:0/1230125508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe07c025070 con 0x55a9bb009f30 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe079600640 1 -- 172.21.15.5:0/1230125508 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7fe07c044e80 con 0x55a9bb009f30 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 10 client.10155 fetch_fsmap learned FSMap version 141 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.127+0000 7fe0964eb000 1 -- 172.21.15.5:0/1230125508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55a9bae01330 con 0x55a9bb009f30 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe079600640 1 -- 172.21.15.5:0/1230125508 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c025070 con 0x55a9bb009f30 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe079600640 1 -- 172.21.15.5:0/1230125508 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7fe07c030030 con 0x55a9bb009f30 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 10 client.10155 fetch_fsmap finished waiting for FSMap version 141 2024-08-18T22:32:11.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 10 client.10155 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 20 client.10155 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55a9bb068f40 0x55a9bb069320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 4 client.10155 mds_command: new command op to 9975 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 -- 172.21.15.5:0/1230125508 --> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55a9bae68a00 con 0x55a9bb068f40 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe083400640 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55a9bb068f40 0x55a9bb069320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe079600640 10 client.10155 ms_handle_connect on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe083400640 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55a9bb068f40 0x55a9bb069320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9975 client_cookie=af021285a6166bcb server_cookie=9efdaf12c5edc31f in_seq=0 out_seq=0 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe079600640 1 -- 172.21.15.5:0/1230125508 <== mds.9975 v2:172.21.15.5:6833/1984562471 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55a9bae68a00 con 0x55a9bb068f40 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe079600640 10 client.10155 handle_command_reply: tid=0 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 client.10155 shutdown 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 -- 172.21.15.5:0/1230125508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 msgr2=0x55a9bb0c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0c9ff0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x55a9baef76b0 tx=0x7fe07c012000 comp rx=0 tx=0).stop 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 -- 172.21.15.5:0/1230125508 shutdown_connections 2024-08-18T22:32:11.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55a9bb068f40 0x55a9bb069320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55a9bb056e70 0x55a9bb0caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe079600640 0 client.10155 ms_handle_reset on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a9bb056550 0x55a9bb0ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 --2- 172.21.15.5:0/1230125508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a9bb009f30 0x55a9bb0c9ff0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 -- 172.21.15.5:0/1230125508 >> 172.21.15.5:0/1230125508 conn(0x55a9bb037400 msgr2=0x55a9bb0639c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 -- 172.21.15.5:0/1230125508 shutdown_connections 2024-08-18T22:32:11.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 1 -- 172.21.15.5:0/1230125508 wait complete. 2024-08-18T22:32:11.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.131+0000 7fe0964eb000 20 client.10155 trim_cache size 0 max 16384 2024-08-18T22:32:11.136 INFO:teuthology.orchestra.run.smithi005.stderr:Error EINVAL: MDS is not active 2024-08-18T22:32:11.137 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-08-18T22:32:11.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub pause 2024-08-18T22:32:11.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.279+0000 7f6006800640 1 Processor -- start 2024-08-18T22:32:11.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.279+0000 7f6006800640 1 -- start start 2024-08-18T22:32:11.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.279+0000 7f6006800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f600015a9e0 0x7f6000072220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.279+0000 7f6006800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600015adc0 con 0x7f6000073ba0 2024-08-18T22:32:11.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.279+0000 7f6006800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6000072b00 con 0x7f600006eb20 2024-08-18T22:32:11.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.279+0000 7f6006800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6000072de0 con 0x7f600015a9e0 2024-08-18T22:32:11.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.283+0000 7f5ff6a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6000073ba0 0x7f600006e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42440/0 (socket says 172.21.15.5:42440) 2024-08-18T22:32:11.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.283+0000 7f5ff6a00640 1 -- 172.21.15.5:0/3364791080 learned_addr learned my addr 172.21.15.5:0/3364791080 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:11.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.283+0000 7f5fff400640 1 --2- 172.21.15.5:0/3364791080 >> v2:172.21.15.117:3300/0 conn(0x7f600015a9e0 0x7f6000072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.283+0000 7f5ffea00640 1 -- 172.21.15.5:0/3364791080 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4257099274 0 0) 0x7f600015adc0 con 0x7f6000073ba0 2024-08-18T22:32:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.283+0000 7f5ffea00640 1 -- 172.21.15.5:0/3364791080 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fe4005740 con 0x7f6000073ba0 2024-08-18T22:32:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.283+0000 7f5ffea00640 1 -- 172.21.15.5:0/3364791080 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4076378700 0 0) 0x7f5fe4005740 con 0x7f6000073ba0 2024-08-18T22:32:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.283+0000 7f5fff400640 1 -- 172.21.15.5:0/3364791080 >> v1:172.21.15.117:6789/0 conn(0x7f600006eb20 legacy=0x7f60000cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.283+0000 7f5fff400640 1 -- 172.21.15.5:0/3364791080 >> v1:172.21.15.5:6789/0 conn(0x7f6000073ba0 legacy=0x7f600006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.283+0000 7f5fff400640 1 -- 172.21.15.5:0/3364791080 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60000730c0 con 0x7f600015a9e0 2024-08-18T22:32:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f5fff400640 1 --2- 172.21.15.5:0/3364791080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f600015a9e0 0x7f6000072220 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00097c0 tx=0x7f5ff001c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72478d51a6014b86 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f5ffea00640 1 -- 172.21.15.5:0/3364791080 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00b0070 con 0x7f600015a9e0 2024-08-18T22:32:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f5ffea00640 1 -- 172.21.15.5:0/3364791080 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff00ab400 con 0x7f600015a9e0 2024-08-18T22:32:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f5ffea00640 1 -- 172.21.15.5:0/3364791080 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8001680 con 0x7f600015a9e0 2024-08-18T22:32:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 -- 172.21.15.5:0/3364791080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f600015a9e0 msgr2=0x7f6000072220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 --2- 172.21.15.5:0/3364791080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f600015a9e0 0x7f6000072220 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00097c0 tx=0x7f5ff001c300 comp rx=0 tx=0).stop 2024-08-18T22:32:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 -- 172.21.15.5:0/3364791080 shutdown_connections 2024-08-18T22:32:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 --2- 172.21.15.5:0/3364791080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f600015a9e0 0x7f6000072220 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 -- 172.21.15.5:0/3364791080 >> 172.21.15.5:0/3364791080 conn(0x7f60000b1dc0 msgr2=0x7f60000b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 -- 172.21.15.5:0/3364791080 shutdown_connections 2024-08-18T22:32:11.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 -- 172.21.15.5:0/3364791080 wait complete. 2024-08-18T22:32:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 Processor -- start 2024-08-18T22:32:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 -- start start 2024-08-18T22:32:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f600006eb20 0x7f6000099b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6000073ba0 0x7f6000145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600015a9e0 0x7f6000148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f60000ce7a0 con 0x7f600015a9e0 2024-08-18T22:32:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f60000ce620 con 0x7f600006eb20 2024-08-18T22:32:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f6006800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f60000ce920 con 0x7f6000073ba0 2024-08-18T22:32:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f5fffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600015a9e0 0x7f6000148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f5fffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600015a9e0 0x7f6000148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54542/0 (socket says 172.21.15.5:54542) 2024-08-18T22:32:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f5fffe00640 1 -- 172.21.15.5:0/3888481453 learned_addr learned my addr 172.21.15.5:0/3888481453 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.287+0000 7f5fff400640 1 --2- 172.21.15.5:0/3888481453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f600006eb20 0x7f6000099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f5ff6a00640 1 --2- 172.21.15.5:0/3888481453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6000073ba0 0x7f6000145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f5fffe00640 1 -- 172.21.15.5:0/3888481453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6000073ba0 msgr2=0x7f6000145870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f5fffe00640 1 --2- 172.21.15.5:0/3888481453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6000073ba0 0x7f6000145870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f5fffe00640 1 -- 172.21.15.5:0/3888481453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f600006eb20 msgr2=0x7f6000099b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f5fffe00640 1 --2- 172.21.15.5:0/3888481453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f600006eb20 0x7f6000099b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f5fffe00640 1 -- 172.21.15.5:0/3888481453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6000146780 con 0x7f600015a9e0 2024-08-18T22:32:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f5fffe00640 1 --2- 172.21.15.5:0/3888481453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600015a9e0 0x7f6000148cc0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800c7a0 tx=0x7f5ff800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f5ff7e00640 1 -- 172.21.15.5:0/3888481453 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8003b80 con 0x7f600015a9e0 2024-08-18T22:32:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f5ff7e00640 1 -- 172.21.15.5:0/3888481453 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff800ce50 con 0x7f600015a9e0 2024-08-18T22:32:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f6006800640 1 -- 172.21.15.5:0/3888481453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60001481e0 con 0x7f600015a9e0 2024-08-18T22:32:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f5ff7e00640 1 -- 172.21.15.5:0/3888481453 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff800a7f0 con 0x7f600015a9e0 2024-08-18T22:32:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.291+0000 7f6006800640 1 -- 172.21.15.5:0/3888481453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6000149200 con 0x7f600015a9e0 2024-08-18T22:32:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff7e00640 1 -- 172.21.15.5:0/3888481453 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ff800a990 con 0x7f600015a9e0 2024-08-18T22:32:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff7e00640 1 --2- 172.21.15.5:0/3888481453 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5fdc0678f0 0x7f5fdc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff7e00640 1 -- 172.21.15.5:0/3888481453 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f5ff8085be0 con 0x7f600015a9e0 2024-08-18T22:32:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 Processor -- start 2024-08-18T22:32:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 -- start start 2024-08-18T22:32:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5fff400640 1 --2- 172.21.15.5:0/3888481453 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5fdc0678f0 0x7f5fdc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa390c5b0 0x55aaa390c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3912c60 0x55aaa3913040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3913580 0x55aaa3957110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55aaa3757480 con 0x55aaa3912c60 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55aaa3711920 con 0x55aaa390c5b0 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55aaa3753440 con 0x55aaa3913580 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5fff400640 1 --2- 172.21.15.5:0/3888481453 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5fdc0678f0 0x7f5fdc069db0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00ad000 tx=0x7f5ff00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3912c60 0x55aaa3913040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3912c60 0x55aaa3913040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54550/0 (socket says 172.21.15.5:54550) 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff6a00640 1 -- 172.21.15.5:0/3387888909 learned_addr learned my addr 172.21.15.5:0/3387888909 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5fff400640 1 --2- 172.21.15.5:0/3387888909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa390c5b0 0x55aaa390c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5fffe00640 1 --2- 172.21.15.5:0/3387888909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3913580 0x55aaa3957110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff6a00640 1 -- 172.21.15.5:0/3387888909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3913580 msgr2=0x55aaa3957110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff6a00640 1 --2- 172.21.15.5:0/3387888909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3913580 0x55aaa3957110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff6a00640 1 -- 172.21.15.5:0/3387888909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa390c5b0 msgr2=0x55aaa390c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff6a00640 1 --2- 172.21.15.5:0/3387888909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa390c5b0 0x55aaa390c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff6a00640 1 -- 172.21.15.5:0/3387888909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaa3794080 con 0x55aaa3912c60 2024-08-18T22:32:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5ff6a00640 1 --2- 172.21.15.5:0/3387888909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3912c60 0x55aaa3913040 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f600009a080 tx=0x7f5fe8001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfef083f6c8d764 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5fefe00640 1 -- 172.21.15.5:0/3387888909 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8017020 con 0x55aaa3912c60 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5fefe00640 1 -- 172.21.15.5:0/3387888909 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe800fc10 con 0x55aaa3912c60 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f5fefe00640 1 -- 172.21.15.5:0/3387888909 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80133f0 con 0x55aaa3912c60 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 -- 172.21.15.5:0/3387888909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3912c60 msgr2=0x55aaa3913040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 --2- 172.21.15.5:0/3387888909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3912c60 0x55aaa3913040 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f600009a080 tx=0x7f5fe8001df0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 -- 172.21.15.5:0/3387888909 shutdown_connections 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 --2- 172.21.15.5:0/3387888909 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3913580 0x55aaa3957110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 --2- 172.21.15.5:0/3387888909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3912c60 0x55aaa3913040 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 --2- 172.21.15.5:0/3387888909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa390c5b0 0x55aaa390c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 -- 172.21.15.5:0/3387888909 >> 172.21.15.5:0/3387888909 conn(0x55aaa390dc00 msgr2=0x55aaa390ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.295+0000 7f6009c15000 1 -- 172.21.15.5:0/3387888909 shutdown_connections 2024-08-18T22:32:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 -- 172.21.15.5:0/3387888909 wait complete. 2024-08-18T22:32:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 -- start start 2024-08-18T22:32:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 Processor -- start 2024-08-18T22:32:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa390c5b0 0x55aaa3940c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3912c60 0x55aaa39411a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa3941960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55aaa37225c0 con 0x55aaa3913580 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55aaa36f8ad0 con 0x55aaa390c5b0 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55aaa37d9cb0 con 0x55aaa3912c60 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 10 client.0 _ll_register_callbacks cb 0x55aaa38f3790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa3941960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa3941960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54558/0 (socket says 172.21.15.5:54558) 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fffe00640 1 -- 172.21.15.5:0/3341998784 learned_addr learned my addr 172.21.15.5:0/3341998784 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fff400640 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa390c5b0 0x55aaa3940c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5ff6a00640 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3912c60 0x55aaa39411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fffe00640 1 -- 172.21.15.5:0/3341998784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3912c60 msgr2=0x55aaa39411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fffe00640 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3912c60 0x55aaa39411a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fffe00640 1 -- 172.21.15.5:0/3341998784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa390c5b0 msgr2=0x55aaa3940c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fffe00640 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa390c5b0 0x55aaa3940c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fffe00640 1 -- 172.21.15.5:0/3341998784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaa372f300 con 0x55aaa3913580 2024-08-18T22:32:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fffe00640 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa3941960 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8001340 tx=0x7f5ff805eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6a8b15fbfb44d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fecc00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fecc00640 1 -- 172.21.15.5:0/3341998784 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80553d0 con 0x55aaa3913580 2024-08-18T22:32:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fecc00640 1 -- 172.21.15.5:0/3341998784 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f5ff8055570 con 0x55aaa3913580 2024-08-18T22:32:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 -- 172.21.15.5:0/3341998784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fe800fc10 con 0x55aaa3913580 2024-08-18T22:32:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fecc00640 1 -- 172.21.15.5:0/3341998784 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f5ff80741a0 con 0x55aaa3913580 2024-08-18T22:32:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 10 client.10167 fetch_fsmap learned FSMap version 141 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 -- 172.21.15.5:0/3341998784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55aaa36f7860 con 0x55aaa3913580 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fecc00640 1 -- 172.21.15.5:0/3341998784 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe800fc10 con 0x55aaa3913580 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fecc00640 1 -- 172.21.15.5:0/3341998784 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7f5ff8074340 con 0x55aaa3913580 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 10 client.10167 fetch_fsmap finished waiting for FSMap version 141 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 10 client.10167 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 20 client.10167 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55aaa39426d0 0x55aaa3942ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 4 client.10167 mds_command: new command op to 9975 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f6009c15000 1 -- 172.21.15.5:0/3341998784 --> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aaa36f1be0 con 0x55aaa39426d0 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.299+0000 7f5fff400640 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55aaa39426d0 0x55aaa3942ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f5fff400640 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55aaa39426d0 0x55aaa3942ab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9975 client_cookie=7601ea359768d541 server_cookie=7e470c6adbe76a0 in_seq=0 out_seq=0 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f5fecc00640 10 client.10167 ms_handle_connect on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f5fecc00640 1 -- 172.21.15.5:0/3341998784 <== mds.9975 v2:172.21.15.5:6833/1984562471 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aaa36f1be0 con 0x55aaa39426d0 2024-08-18T22:32:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f5fecc00640 10 client.10167 handle_command_reply: tid=0 2024-08-18T22:32:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 1 client.10167 shutdown 2024-08-18T22:32:11.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 1 -- 172.21.15.5:0/3341998784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 msgr2=0x55aaa3941960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa3941960 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8001340 tx=0x7f5ff805eab0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 1 -- 172.21.15.5:0/3341998784 shutdown_connections 2024-08-18T22:32:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55aaa39426d0 0x55aaa3942ab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa3941960 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3912c60 0x55aaa39411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 1 --2- 172.21.15.5:0/3341998784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa390c5b0 0x55aaa3940c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f5fecc00640 0 client.10167 ms_handle_reset on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 1 -- 172.21.15.5:0/3341998784 >> 172.21.15.5:0/3341998784 conn(0x55aaa390dc00 msgr2=0x55aaa390ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 1 -- 172.21.15.5:0/3341998784 shutdown_connections 2024-08-18T22:32:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 1 -- 172.21.15.5:0/3341998784 wait complete. 2024-08-18T22:32:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.303+0000 7f6009c15000 20 client.10167 trim_cache size 0 max 16384 2024-08-18T22:32:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.319+0000 7f6009c15000 1 Processor -- start 2024-08-18T22:32:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.319+0000 7f6009c15000 1 -- start start 2024-08-18T22:32:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa390c5b0 0x55aaa396d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa3912c60 0x55aaa396d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3913580 0x55aaa3913b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f60001ff550 con 0x55aaa390c5b0 2024-08-18T22:32:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f60001ffc20 con 0x55aaa3912c60 2024-08-18T22:32:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6000092e10 con 0x55aaa3913580 2024-08-18T22:32:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa390c5b0 0x55aaa396d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa390c5b0 0x55aaa396d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54568/0 (socket says 172.21.15.5:54568) 2024-08-18T22:32:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fff400640 1 -- 172.21.15.5:0/2421862317 learned_addr learned my addr 172.21.15.5:0/2421862317 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fff400640 1 -- 172.21.15.5:0/2421862317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3913580 msgr2=0x55aaa3913b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fff400640 1 --2- 172.21.15.5:0/2421862317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3913580 0x55aaa3913b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fff400640 1 -- 172.21.15.5:0/2421862317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa3912c60 msgr2=0x55aaa396d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fff400640 1 --2- 172.21.15.5:0/2421862317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa3912c60 0x55aaa396d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fff400640 1 -- 172.21.15.5:0/2421862317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaa37da140 con 0x55aaa390c5b0 2024-08-18T22:32:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fff400640 1 --2- 172.21.15.5:0/2421862317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa390c5b0 0x55aaa396d1a0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0019f30 tx=0x7f5ff0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56cd913248ec32 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fef400640 1 -- 172.21.15.5:0/2421862317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00d1070 con 0x55aaa390c5b0 2024-08-18T22:32:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fef400640 1 -- 172.21.15.5:0/2421862317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff00b1040 con 0x55aaa390c5b0 2024-08-18T22:32:11.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f5fef400640 1 -- 172.21.15.5:0/2421862317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00b0040 con 0x55aaa390c5b0 2024-08-18T22:32:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 -- 172.21.15.5:0/2421862317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa390c5b0 msgr2=0x55aaa396d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 --2- 172.21.15.5:0/2421862317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa390c5b0 0x55aaa396d1a0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0019f30 tx=0x7f5ff0004740 comp rx=0 tx=0).stop 2024-08-18T22:32:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 -- 172.21.15.5:0/2421862317 shutdown_connections 2024-08-18T22:32:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 --2- 172.21.15.5:0/2421862317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa3913580 0x55aaa3913b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 --2- 172.21.15.5:0/2421862317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa3912c60 0x55aaa396d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 --2- 172.21.15.5:0/2421862317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa390c5b0 0x55aaa396d1a0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 -- 172.21.15.5:0/2421862317 >> 172.21.15.5:0/2421862317 conn(0x55aaa390dc00 msgr2=0x55aaa390ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 -- 172.21.15.5:0/2421862317 shutdown_connections 2024-08-18T22:32:11.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 -- 172.21.15.5:0/2421862317 wait complete. 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 -- start start 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.323+0000 7f6009c15000 1 Processor -- start 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa390c5b0 0x55aaa39ca070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa3912c60 0x55aaa39ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa39691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55aaa3756790 con 0x55aaa3913580 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6000095090 con 0x55aaa3912c60 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55aaa375bab0 con 0x55aaa390c5b0 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 10 client.0 _ll_register_callbacks cb 0x7f5ff8056030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa39691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa39691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54576/0 (socket says 172.21.15.5:54576) 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fffe00640 1 -- 172.21.15.5:0/3354334908 learned_addr learned my addr 172.21.15.5:0/3354334908 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5ff6a00640 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa3912c60 0x55aaa39ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fff400640 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa390c5b0 0x55aaa39ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fffe00640 1 -- 172.21.15.5:0/3354334908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa390c5b0 msgr2=0x55aaa39ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fffe00640 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa390c5b0 0x55aaa39ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fffe00640 1 -- 172.21.15.5:0/3354334908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa3912c60 msgr2=0x55aaa39ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fffe00640 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa3912c60 0x55aaa39ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fffe00640 1 -- 172.21.15.5:0/3354334908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaa36eac60 con 0x55aaa3913580 2024-08-18T22:32:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fffe00640 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa39691a0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8015000 tx=0x7f5ff8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318e35c718a116a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fecc00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fecc00640 1 -- 172.21.15.5:0/3354334908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8078070 con 0x55aaa3913580 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fecc00640 1 -- 172.21.15.5:0/3354334908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f5ff8051cd0 con 0x55aaa3913580 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 -- 172.21.15.5:0/3354334908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ff00b1040 con 0x55aaa3913580 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fecc00640 1 -- 172.21.15.5:0/3354334908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f5ff8065050 con 0x55aaa3913580 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 10 client.10173 fetch_fsmap learned FSMap version 141 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 -- 172.21.15.5:0/3354334908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55aaa36fd0f0 con 0x55aaa3913580 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fecc00640 1 -- 172.21.15.5:0/3354334908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff00b1040 con 0x55aaa3913580 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fecc00640 1 -- 172.21.15.5:0/3354334908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7f5ff8051ed0 con 0x55aaa3913580 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 10 client.10173 fetch_fsmap finished waiting for FSMap version 141 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 10 client.10173 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 20 client.10173 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55aaa39696e0 0x55aaa3969ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 4 client.10173 mds_command: new command op to 9975 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-08-18T22:32:11.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 -- 172.21.15.5:0/3354334908 --> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55aaa3764bb0 con 0x55aaa39696e0 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fff400640 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55aaa39696e0 0x55aaa3969ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fff400640 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55aaa39696e0 0x55aaa3969ac0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9975 client_cookie=44c31914b63c0a8e server_cookie=f0a0f47e6ba73107 in_seq=0 out_seq=0 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fecc00640 10 client.10173 ms_handle_connect on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fecc00640 1 -- 172.21.15.5:0/3354334908 <== mds.9975 v2:172.21.15.5:6833/1984562471 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55aaa3764bb0 con 0x55aaa39696e0 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fecc00640 10 client.10173 handle_command_reply: tid=0 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 client.10173 shutdown 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 -- 172.21.15.5:0/3354334908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 msgr2=0x55aaa39691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa39691a0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8015000 tx=0x7f5ff8011000 comp rx=0 tx=0).stop 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 -- 172.21.15.5:0/3354334908 shutdown_connections 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55aaa39696e0 0x55aaa3969ac0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aaa3913580 0x55aaa39691a0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55aaa3912c60 0x55aaa39ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 --2- 172.21.15.5:0/3354334908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55aaa390c5b0 0x55aaa39ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f5fecc00640 0 client.10173 ms_handle_reset on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 -- 172.21.15.5:0/3354334908 >> 172.21.15.5:0/3354334908 conn(0x55aaa390dc00 msgr2=0x55aaa390b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 -- 172.21.15.5:0/3354334908 shutdown_connections 2024-08-18T22:32:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 1 -- 172.21.15.5:0/3354334908 wait complete. 2024-08-18T22:32:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.327+0000 7f6009c15000 20 client.10173 trim_cache size 0 max 16384 2024-08-18T22:32:11.333 INFO:teuthology.orchestra.run.smithi005.stderr:Error EINVAL: MDS is not active 2024-08-18T22:32:11.335 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-08-18T22:32:11.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub abort 2024-08-18T22:32:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7c200640 1 Processor -- start 2024-08-18T22:32:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7c200640 1 -- start start 2024-08-18T22:32:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7c200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5a7409aca0 0x7f5a740afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7c200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a740b1300 0x7f5a740affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7c200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a7409b080 0x7f5a740b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7c200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5a7406e8a0 con 0x7f5a7409b080 2024-08-18T22:32:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7c200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5a7409bb80 con 0x7f5a7409aca0 2024-08-18T22:32:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7c200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5a740d2e40 con 0x7f5a740b1300 2024-08-18T22:32:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7a200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a7409b080 0x7f5a740b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7a200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a7409b080 0x7f5a740b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54586/0 (socket says 172.21.15.5:54586) 2024-08-18T22:32:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7a200640 1 -- 172.21.15.5:0/1154905308 learned_addr learned my addr 172.21.15.5:0/1154905308 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a78e00640 1 --2- 172.21.15.5:0/1154905308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a740b1300 0x7f5a740affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a79800640 1 --2- 172.21.15.5:0/1154905308 >> v2:172.21.15.117:3300/0 conn(0x7f5a7409aca0 0x7f5a740afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7a200640 1 -- 172.21.15.5:0/1154905308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a740b1300 msgr2=0x7f5a740affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7a200640 1 --2- 172.21.15.5:0/1154905308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a740b1300 0x7f5a740affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7a200640 1 -- 172.21.15.5:0/1154905308 >> v2:172.21.15.117:3300/0 conn(0x7f5a7409aca0 msgr2=0x7f5a740afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7a200640 1 --2- 172.21.15.5:0/1154905308 >> v2:172.21.15.117:3300/0 conn(0x7f5a7409aca0 0x7f5a740afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a7a200640 1 -- 172.21.15.5:0/1154905308 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7406cbd0 con 0x7f5a7409b080 2024-08-18T22:32:11.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.479+0000 7f5a78e00640 1 --2- 172.21.15.5:0/1154905308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a740b1300 0x7f5a740affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a7a200640 1 --2- 172.21.15.5:0/1154905308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a7409b080 0x7f5a740b0510 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f5a7406f260 tx=0x7f5a6c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7168708739c75898 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a73e00640 1 -- 172.21.15.5:0/1154905308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0a5780 con 0x7f5a7409b080 2024-08-18T22:32:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a73e00640 1 -- 172.21.15.5:0/1154905308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0a5920 con 0x7f5a7409b080 2024-08-18T22:32:11.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a73e00640 1 -- 172.21.15.5:0/1154905308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0a5cf0 con 0x7f5a7409b080 2024-08-18T22:32:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a7c200640 1 -- 172.21.15.5:0/1154905308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a7409b080 msgr2=0x7f5a740b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a7c200640 1 --2- 172.21.15.5:0/1154905308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a7409b080 0x7f5a740b0510 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f5a7406f260 tx=0x7f5a6c01c9f0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a7c200640 1 -- 172.21.15.5:0/1154905308 shutdown_connections 2024-08-18T22:32:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a7c200640 1 --2- 172.21.15.5:0/1154905308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a7409b080 0x7f5a740b0510 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a7c200640 1 --2- 172.21.15.5:0/1154905308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a740b1300 0x7f5a740affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a7c200640 1 --2- 172.21.15.5:0/1154905308 >> v2:172.21.15.117:3300/0 conn(0x7f5a7409aca0 0x7f5a740afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a7c200640 1 -- 172.21.15.5:0/1154905308 >> 172.21.15.5:0/1154905308 conn(0x7f5a740d2180 msgr2=0x7f5a740d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a7c200640 1 -- 172.21.15.5:0/1154905308 shutdown_connections 2024-08-18T22:32:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.483+0000 7f5a7c200640 1 -- 172.21.15.5:0/1154905308 wait complete. 2024-08-18T22:32:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7c200640 1 Processor -- start 2024-08-18T22:32:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7c200640 1 -- start start 2024-08-18T22:32:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7c200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a7409aca0 0x7f5a7415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7c200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a7409b080 0x7f5a74155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7c200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a740b1300 0x7f5a740d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7c200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5a741624e0 con 0x7f5a740b1300 2024-08-18T22:32:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7c200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5a74162360 con 0x7f5a7409aca0 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7c200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5a74162660 con 0x7f5a7409b080 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a740b1300 0x7f5a740d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a740b1300 0x7f5a740d0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54588/0 (socket says 172.21.15.5:54588) 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7a200640 1 -- 172.21.15.5:0/1766224036 learned_addr learned my addr 172.21.15.5:0/1766224036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a79800640 1 --2- 172.21.15.5:0/1766224036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a7409aca0 0x7f5a7415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a78e00640 1 --2- 172.21.15.5:0/1766224036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a7409b080 0x7f5a74155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7a200640 1 -- 172.21.15.5:0/1766224036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a7409b080 msgr2=0x7f5a74155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7a200640 1 --2- 172.21.15.5:0/1766224036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a7409b080 0x7f5a74155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7a200640 1 -- 172.21.15.5:0/1766224036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a7409aca0 msgr2=0x7f5a7415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7a200640 1 --2- 172.21.15.5:0/1766224036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a7409aca0 0x7f5a7415b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7a200640 1 -- 172.21.15.5:0/1766224036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7415d730 con 0x7f5a740b1300 2024-08-18T22:32:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a79800640 1 --2- 172.21.15.5:0/1766224036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a7409aca0 0x7f5a7415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7a200640 1 --2- 172.21.15.5:0/1766224036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a740b1300 0x7f5a740d0e00 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c01d290 tx=0x7f5a6c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a71600640 1 -- 172.21.15.5:0/1766224036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0b8670 con 0x7f5a740b1300 2024-08-18T22:32:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a71600640 1 -- 172.21.15.5:0/1766224036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0be070 con 0x7f5a740b1300 2024-08-18T22:32:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a71600640 1 -- 172.21.15.5:0/1766224036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0b8a50 con 0x7f5a740b1300 2024-08-18T22:32:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7c200640 1 -- 172.21.15.5:0/1766224036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7415da10 con 0x7f5a740b1300 2024-08-18T22:32:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.487+0000 7f5a7c200640 1 -- 172.21.15.5:0/1766224036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a74156360 con 0x7f5a740b1300 2024-08-18T22:32:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.491+0000 7f5a71600640 1 -- 172.21.15.5:0/1766224036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a6c0b8bf0 con 0x7f5a740b1300 2024-08-18T22:32:11.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.491+0000 7f5a71600640 1 --2- 172.21.15.5:0/1766224036 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5a540678f0 0x7f5a54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.491+0000 7f5a71600640 1 -- 172.21.15.5:0/1766224036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f5a6c120f00 con 0x7f5a740b1300 2024-08-18T22:32:11.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.491+0000 7f5a79800640 1 --2- 172.21.15.5:0/1766224036 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5a540678f0 0x7f5a54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.491+0000 7f5a7f648000 1 Processor -- start 2024-08-18T22:32:11.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.491+0000 7f5a7f648000 1 -- start start 2024-08-18T22:32:11.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.491+0000 7f5a79800640 1 --2- 172.21.15.5:0/1766224036 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5a540678f0 0x7f5a54069db0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5a68004660 tx=0x7f5a68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.491+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eaccea30 0x55f8eaccee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.491+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccf350 0x55f8eac81a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eac81fc0 0x55f8eac823a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f8eaad3480 con 0x55f8eac81fc0 2024-08-18T22:32:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f8eaa8d920 con 0x55f8eaccf350 2024-08-18T22:32:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f8eaacf440 con 0x55f8eaccea30 2024-08-18T22:32:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eac81fc0 0x55f8eac823a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eac81fc0 0x55f8eac823a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54598/0 (socket says 172.21.15.5:54598) 2024-08-18T22:32:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a79800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eaccea30 0x55f8eaccee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7a200640 1 -- 172.21.15.5:0/3928598391 learned_addr learned my addr 172.21.15.5:0/3928598391 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a78e00640 1 --2- 172.21.15.5:0/3928598391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccf350 0x55f8eac81a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7a200640 1 -- 172.21.15.5:0/3928598391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eaccea30 msgr2=0x55f8eaccee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7a200640 1 --2- 172.21.15.5:0/3928598391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eaccea30 0x55f8eaccee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7a200640 1 -- 172.21.15.5:0/3928598391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccf350 msgr2=0x55f8eac81a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7a200640 1 --2- 172.21.15.5:0/3928598391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccf350 0x55f8eac81a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7a200640 1 -- 172.21.15.5:0/3928598391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8eab10080 con 0x55f8eac81fc0 2024-08-18T22:32:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a78e00640 1 --2- 172.21.15.5:0/3928598391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccf350 0x55f8eac81a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7a200640 1 --2- 172.21.15.5:0/3928598391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eac81fc0 0x55f8eac823a0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0f1110 tx=0x7f5a6c0f0ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8cd439a7518247 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a66000640 1 -- 172.21.15.5:0/3928598391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0f5530 con 0x55f8eac81fc0 2024-08-18T22:32:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a66000640 1 -- 172.21.15.5:0/3928598391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0f9d60 con 0x55f8eac81fc0 2024-08-18T22:32:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a66000640 1 -- 172.21.15.5:0/3928598391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0ef480 con 0x55f8eac81fc0 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- 172.21.15.5:0/3928598391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eac81fc0 msgr2=0x55f8eac823a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 --2- 172.21.15.5:0/3928598391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eac81fc0 0x55f8eac823a0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0f1110 tx=0x7f5a6c0f0ba0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- 172.21.15.5:0/3928598391 shutdown_connections 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 --2- 172.21.15.5:0/3928598391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eac81fc0 0x55f8eac823a0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 --2- 172.21.15.5:0/3928598391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccf350 0x55f8eac81a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 --2- 172.21.15.5:0/3928598391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eaccea30 0x55f8eaccee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- 172.21.15.5:0/3928598391 >> 172.21.15.5:0/3928598391 conn(0x55f8eacaf8b0 msgr2=0x55f8eacb1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- 172.21.15.5:0/3928598391 shutdown_connections 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- 172.21.15.5:0/3928598391 wait complete. 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- start start 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 Processor -- start 2024-08-18T22:32:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eac81fc0 0x55f8eac877a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccea30 0x55f8eac87ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccf350 0x55f8eac88220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f8eaa9e5c0 con 0x55f8eaccf350 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f8eaa74ad0 con 0x55f8eaccea30 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f8eab55cb0 con 0x55f8eac81fc0 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.495+0000 7f5a7f648000 10 client.0 _ll_register_callbacks cb 0x55f8eac6f790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccf350 0x55f8eac88220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccf350 0x55f8eac88220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54612/0 (socket says 172.21.15.5:54612) 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7a200640 1 -- 172.21.15.5:0/3315487238 learned_addr learned my addr 172.21.15.5:0/3315487238 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a79800640 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eac81fc0 0x55f8eac877a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a78e00640 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccea30 0x55f8eac87ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7a200640 1 -- 172.21.15.5:0/3315487238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eac81fc0 msgr2=0x55f8eac877a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7a200640 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eac81fc0 0x55f8eac877a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7a200640 1 -- 172.21.15.5:0/3315487238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccea30 msgr2=0x55f8eac87ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7a200640 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccea30 0x55f8eac87ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7a200640 1 -- 172.21.15.5:0/3315487238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8eaaab300 con 0x55f8eaccf350 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a79800640 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eac81fc0 0x55f8eac877a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7a200640 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccf350 0x55f8eac88220 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0f1340 tx=0x7f5a6c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc32d474698c66d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a5aa00640 1 -- 172.21.15.5:0/3315487238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c11c070 con 0x55f8eaccf350 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a5aa00640 1 -- 172.21.15.5:0/3315487238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f5a6c0f50d0 con 0x55f8eaccf350 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 -- 172.21.15.5:0/3315487238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a6c0f9d60 con 0x55f8eaccf350 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a5aa00640 1 -- 172.21.15.5:0/3315487238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f5a6c0f5330 con 0x55f8eaccf350 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 10 client.10185 fetch_fsmap learned FSMap version 141 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 -- 172.21.15.5:0/3315487238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55f8eaa73860 con 0x55f8eaccf350 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a5aa00640 1 -- 172.21.15.5:0/3315487238 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0f9d60 con 0x55f8eaccf350 2024-08-18T22:32:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a5aa00640 1 -- 172.21.15.5:0/3315487238 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7f5a6c0f13e0 con 0x55f8eaccf350 2024-08-18T22:32:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 10 client.10185 fetch_fsmap finished waiting for FSMap version 141 2024-08-18T22:32:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 10 client.10185 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:32:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 20 client.10185 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55f8eac88c30 0x55f8eace0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 4 client.10185 mds_command: new command op to 9975 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:32:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 -- 172.21.15.5:0/3315487238 --> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8eaa6dbe0 con 0x55f8eac88c30 2024-08-18T22:32:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a79800640 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55f8eac88c30 0x55f8eace0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a79800640 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55f8eac88c30 0x55f8eace0cf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9975 client_cookie=ae7651ddfa1b0451 server_cookie=1ce5f65587875482 in_seq=0 out_seq=0 2024-08-18T22:32:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a5aa00640 10 client.10185 ms_handle_connect on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a5aa00640 1 -- 172.21.15.5:0/3315487238 <== mds.9975 v2:172.21.15.5:6833/1984562471 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8eaa6dbe0 con 0x55f8eac88c30 2024-08-18T22:32:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a5aa00640 10 client.10185 handle_command_reply: tid=0 2024-08-18T22:32:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 client.10185 shutdown 2024-08-18T22:32:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 -- 172.21.15.5:0/3315487238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccf350 msgr2=0x55f8eac88220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccf350 0x55f8eac88220 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0f1340 tx=0x7f5a6c009810 comp rx=0 tx=0).stop 2024-08-18T22:32:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 -- 172.21.15.5:0/3315487238 shutdown_connections 2024-08-18T22:32:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55f8eac88c30 0x55f8eace0cf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccf350 0x55f8eac88220 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccea30 0x55f8eac87ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 --2- 172.21.15.5:0/3315487238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eac81fc0 0x55f8eac877a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a5aa00640 0 client.10185 ms_handle_reset on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 -- 172.21.15.5:0/3315487238 >> 172.21.15.5:0/3315487238 conn(0x55f8eacaf8b0 msgr2=0x55f8eac81180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 -- 172.21.15.5:0/3315487238 shutdown_connections 2024-08-18T22:32:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 1 -- 172.21.15.5:0/3315487238 wait complete. 2024-08-18T22:32:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.499+0000 7f5a7f648000 20 client.10185 trim_cache size 0 max 16384 2024-08-18T22:32:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7f648000 1 Processor -- start 2024-08-18T22:32:11.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7f648000 1 -- start start 2024-08-18T22:32:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eacaf8b0 0x55f8eac835c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eac81fc0 0x55f8eac80960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccea30 0x55f8eac80ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7f648000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5a74161030 con 0x55f8eaccea30 2024-08-18T22:32:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7f648000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5a74202ae0 con 0x55f8eac81fc0 2024-08-18T22:32:11.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7f648000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f8eaad2790 con 0x55f8eacaf8b0 2024-08-18T22:32:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccea30 0x55f8eac80ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccea30 0x55f8eac80ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54628/0 (socket says 172.21.15.5:54628) 2024-08-18T22:32:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7a200640 1 -- 172.21.15.5:0/1460481139 learned_addr learned my addr 172.21.15.5:0/1460481139 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a78e00640 1 --2- 172.21.15.5:0/1460481139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eac81fc0 0x55f8eac80960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a79800640 1 --2- 172.21.15.5:0/1460481139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eacaf8b0 0x55f8eac835c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7a200640 1 -- 172.21.15.5:0/1460481139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eacaf8b0 msgr2=0x55f8eac835c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7a200640 1 --2- 172.21.15.5:0/1460481139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eacaf8b0 0x55f8eac835c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7a200640 1 -- 172.21.15.5:0/1460481139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eac81fc0 msgr2=0x55f8eac80960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7a200640 1 --2- 172.21.15.5:0/1460481139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eac81fc0 0x55f8eac80960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7a200640 1 -- 172.21.15.5:0/1460481139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8eac85070 con 0x55f8eaccea30 2024-08-18T22:32:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a7a200640 1 --2- 172.21.15.5:0/1460481139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccea30 0x55f8eac80ea0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0f0e80 tx=0x7f5a6c0f4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c446ee530a4962 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a65600640 1 -- 172.21.15.5:0/1460481139 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0f9d60 con 0x55f8eaccea30 2024-08-18T22:32:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a65600640 1 -- 172.21.15.5:0/1460481139 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0ef480 con 0x55f8eaccea30 2024-08-18T22:32:11.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.519+0000 7f5a65600640 1 -- 172.21.15.5:0/1460481139 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0f98d0 con 0x55f8eaccea30 2024-08-18T22:32:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 -- 172.21.15.5:0/1460481139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccea30 msgr2=0x55f8eac80ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 --2- 172.21.15.5:0/1460481139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccea30 0x55f8eac80ea0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0f0e80 tx=0x7f5a6c0f4040 comp rx=0 tx=0).stop 2024-08-18T22:32:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 -- 172.21.15.5:0/1460481139 shutdown_connections 2024-08-18T22:32:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 --2- 172.21.15.5:0/1460481139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eaccea30 0x55f8eac80ea0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 --2- 172.21.15.5:0/1460481139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eac81fc0 0x55f8eac80960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 --2- 172.21.15.5:0/1460481139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eacaf8b0 0x55f8eac835c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 -- 172.21.15.5:0/1460481139 >> 172.21.15.5:0/1460481139 conn(0x55f8eac89e80 msgr2=0x55f8eac80250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 -- 172.21.15.5:0/1460481139 shutdown_connections 2024-08-18T22:32:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 -- 172.21.15.5:0/1460481139 wait complete. 2024-08-18T22:32:11.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 -- start start 2024-08-18T22:32:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 Processor -- start 2024-08-18T22:32:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eac81fc0 0x55f8ead42a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eacaf8b0 0x55f8ead42f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccea30 0x55f8eace1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f8eaa56d90 con 0x55f8eacaf8b0 2024-08-18T22:32:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f8eaad7ab0 con 0x55f8eaccea30 2024-08-18T22:32:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55f8eaa9e5c0 con 0x55f8eac81fc0 2024-08-18T22:32:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 10 client.0 _ll_register_callbacks cb 0x7f5a68003620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a78e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eacaf8b0 0x55f8ead42f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a78e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eacaf8b0 0x55f8ead42f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54644/0 (socket says 172.21.15.5:54644) 2024-08-18T22:32:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a78e00640 1 -- 172.21.15.5:0/2984864709 learned_addr learned my addr 172.21.15.5:0/2984864709 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a79800640 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eac81fc0 0x55f8ead42a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7a200640 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccea30 0x55f8eace1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a78e00640 1 -- 172.21.15.5:0/2984864709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eac81fc0 msgr2=0x55f8ead42a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a78e00640 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eac81fc0 0x55f8ead42a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a78e00640 1 -- 172.21.15.5:0/2984864709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccea30 msgr2=0x55f8eace1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a78e00640 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccea30 0x55f8eace1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a78e00640 1 -- 172.21.15.5:0/2984864709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8eab56140 con 0x55f8eacaf8b0 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a78e00640 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eacaf8b0 0x55f8ead42f40 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f5a60004550 tx=0x7f5a60017810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5e4d69c0e0afe0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a5aa00640 1 -- 172.21.15.5:0/2984864709 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60024060 con 0x55f8eacaf8b0 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a5aa00640 1 -- 172.21.15.5:0/2984864709 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f5a60003830 con 0x55f8eacaf8b0 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 -- 172.21.15.5:0/2984864709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a6c0ef480 con 0x55f8eacaf8b0 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a5aa00640 1 -- 172.21.15.5:0/2984864709 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f5a6002a050 con 0x55f8eacaf8b0 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 10 client.10191 fetch_fsmap learned FSMap version 141 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a7f648000 1 -- 172.21.15.5:0/2984864709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55f8eaa66c60 con 0x55f8eacaf8b0 2024-08-18T22:32:11.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a5aa00640 1 -- 172.21.15.5:0/2984864709 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0ef480 con 0x55f8eacaf8b0 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.523+0000 7f5a5aa00640 1 -- 172.21.15.5:0/2984864709 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7f5a6002d020 con 0x55f8eacaf8b0 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 10 client.10191 fetch_fsmap finished waiting for FSMap version 141 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 10 client.10191 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 20 client.10191 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55f8eaccf350 0x55f8eace2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 4 client.10191 mds_command: new command op to 9975 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 -- 172.21.15.5:0/2984864709 --> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55f8eaae0bb0 con 0x55f8eaccf350 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a79800640 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55f8eaccf350 0x55f8eace2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a5aa00640 10 client.10191 ms_handle_connect on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a79800640 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55f8eaccf350 0x55f8eace2280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9975 client_cookie=de8982a0319b58a7 server_cookie=adbf876dbbaced90 in_seq=0 out_seq=0 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a5aa00640 1 -- 172.21.15.5:0/2984864709 <== mds.9975 v2:172.21.15.5:6833/1984562471 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55f8eaae0bb0 con 0x55f8eaccf350 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a5aa00640 10 client.10191 handle_command_reply: tid=0 2024-08-18T22:32:11.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 client.10191 shutdown 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 -- 172.21.15.5:0/2984864709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eacaf8b0 msgr2=0x55f8ead42f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eacaf8b0 0x55f8ead42f40 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f5a60004550 tx=0x7f5a60017810 comp rx=0 tx=0).stop 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 -- 172.21.15.5:0/2984864709 shutdown_connections 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x55f8eaccf350 0x55f8eace2280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8eaccea30 0x55f8eace1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f8eacaf8b0 0x55f8ead42f40 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 --2- 172.21.15.5:0/2984864709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f8eac81fc0 0x55f8ead42a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 -- 172.21.15.5:0/2984864709 >> 172.21.15.5:0/2984864709 conn(0x55f8eac89e80 msgr2=0x55f8eacdc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a5aa00640 0 client.10191 ms_handle_reset on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 -- 172.21.15.5:0/2984864709 shutdown_connections 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 1 -- 172.21.15.5:0/2984864709 wait complete. 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.527+0000 7f5a7f648000 20 client.10191 trim_cache size 0 max 16384 2024-08-18T22:32:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:Error EINVAL: MDS is not active 2024-08-18T22:32:11.533 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-08-18T22:32:11.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub resume 2024-08-18T22:32:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.675+0000 7efc55a00640 1 Processor -- start 2024-08-18T22:32:11.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.675+0000 7efc55a00640 1 -- start start 2024-08-18T22:32:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.675+0000 7efc55a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efc500b3fe0 0x7efc500b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.675+0000 7efc55a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc5006eae0 con 0x7efc5015e060 2024-08-18T22:32:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.675+0000 7efc55a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc50071440 con 0x7efc500b4ee0 2024-08-18T22:32:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.675+0000 7efc55a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7efc500b4990 con 0x7efc500b3fe0 2024-08-18T22:32:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.675+0000 7efc4fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efc5015e060 0x7efc50071ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42452/0 (socket says 172.21.15.5:42452) 2024-08-18T22:32:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.675+0000 7efc4fe00640 1 -- 172.21.15.5:0/740964652 learned_addr learned my addr 172.21.15.5:0/740964652 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.675+0000 7efc47400640 1 --2- 172.21.15.5:0/740964652 >> v2:172.21.15.5:3300/0 conn(0x7efc500b3fe0 0x7efc500b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.679+0000 7efc4f400640 1 -- 172.21.15.5:0/740964652 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2791251760 0 0) 0x7efc5006eae0 con 0x7efc5015e060 2024-08-18T22:32:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.679+0000 7efc47400640 1 -- 172.21.15.5:0/740964652 >> v1:172.21.15.117:6789/0 conn(0x7efc500b4ee0 legacy=0x7efc500b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.679+0000 7efc47400640 1 -- 172.21.15.5:0/740964652 >> v1:172.21.15.5:6789/0 conn(0x7efc5015e060 legacy=0x7efc50071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.679+0000 7efc47400640 1 -- 172.21.15.5:0/740964652 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5006e800 con 0x7efc500b3fe0 2024-08-18T22:32:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.679+0000 7efc47400640 1 --2- 172.21.15.5:0/740964652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc500b3fe0 0x7efc500b4450 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7efc380097c0 tx=0x7efc3801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc117f05f1122b8c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.679+0000 7efc4f400640 1 -- 172.21.15.5:0/740964652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380ab5f0 con 0x7efc500b3fe0 2024-08-18T22:32:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.679+0000 7efc4f400640 1 -- 172.21.15.5:0/740964652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc380b0070 con 0x7efc500b3fe0 2024-08-18T22:32:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.679+0000 7efc4f400640 1 -- 172.21.15.5:0/740964652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380ab9b0 con 0x7efc500b3fe0 2024-08-18T22:32:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 -- 172.21.15.5:0/740964652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc500b3fe0 msgr2=0x7efc500b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 --2- 172.21.15.5:0/740964652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc500b3fe0 0x7efc500b4450 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7efc380097c0 tx=0x7efc3801c3d0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 -- 172.21.15.5:0/740964652 shutdown_connections 2024-08-18T22:32:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 --2- 172.21.15.5:0/740964652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc500b3fe0 0x7efc500b4450 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 -- 172.21.15.5:0/740964652 >> 172.21.15.5:0/740964652 conn(0x7efc50067a70 msgr2=0x7efc50067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 -- 172.21.15.5:0/740964652 shutdown_connections 2024-08-18T22:32:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 -- 172.21.15.5:0/740964652 wait complete. 2024-08-18T22:32:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 Processor -- start 2024-08-18T22:32:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 -- start start 2024-08-18T22:32:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc500b3fe0 0x7efc50147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc500b4ee0 0x7efc50155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc5015e060 0x7efc5014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efc5006e3f0 con 0x7efc500b4ee0 2024-08-18T22:32:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efc5006e270 con 0x7efc500b3fe0 2024-08-18T22:32:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efc5006e570 con 0x7efc5015e060 2024-08-18T22:32:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc500b4ee0 0x7efc50155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc500b4ee0 0x7efc50155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54676/0 (socket says 172.21.15.5:54676) 2024-08-18T22:32:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc47400640 1 -- 172.21.15.5:0/639804385 learned_addr learned my addr 172.21.15.5:0/639804385 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc4fe00640 1 --2- 172.21.15.5:0/639804385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc500b3fe0 0x7efc50147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55000640 1 --2- 172.21.15.5:0/639804385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc5015e060 0x7efc5014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc47400640 1 -- 172.21.15.5:0/639804385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc5015e060 msgr2=0x7efc5014d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc47400640 1 --2- 172.21.15.5:0/639804385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc5015e060 0x7efc5014d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc47400640 1 -- 172.21.15.5:0/639804385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc500b3fe0 msgr2=0x7efc50147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc47400640 1 --2- 172.21.15.5:0/639804385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc500b3fe0 0x7efc50147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc47400640 1 -- 172.21.15.5:0/639804385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc501567b0 con 0x7efc500b4ee0 2024-08-18T22:32:11.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc55000640 1 --2- 172.21.15.5:0/639804385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc5015e060 0x7efc5014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.683+0000 7efc47400640 1 --2- 172.21.15.5:0/639804385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc500b4ee0 0x7efc50155eb0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7efc380ad040 tx=0x7efc3801ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.687+0000 7efc4cc00640 1 -- 172.21.15.5:0/639804385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380abe60 con 0x7efc500b4ee0 2024-08-18T22:32:11.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.687+0000 7efc4cc00640 1 -- 172.21.15.5:0/639804385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc38004230 con 0x7efc500b4ee0 2024-08-18T22:32:11.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.687+0000 7efc4cc00640 1 -- 172.21.15.5:0/639804385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38003620 con 0x7efc500b4ee0 2024-08-18T22:32:11.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.687+0000 7efc55a00640 1 -- 172.21.15.5:0/639804385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc5014ca70 con 0x7efc500b4ee0 2024-08-18T22:32:11.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.687+0000 7efc55a00640 1 -- 172.21.15.5:0/639804385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5014d030 con 0x7efc500b4ee0 2024-08-18T22:32:11.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.687+0000 7efc4cc00640 1 -- 172.21.15.5:0/639804385 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc380037c0 con 0x7efc500b4ee0 2024-08-18T22:32:11.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.687+0000 7efc4cc00640 1 --2- 172.21.15.5:0/639804385 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efc2c0678c0 0x7efc2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4cc00640 1 -- 172.21.15.5:0/639804385 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7efc381207a0 con 0x7efc500b4ee0 2024-08-18T22:32:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4fe00640 1 --2- 172.21.15.5:0/639804385 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efc2c0678c0 0x7efc2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 Processor -- start 2024-08-18T22:32:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 -- start start 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4fe00640 1 --2- 172.21.15.5:0/639804385 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efc2c0678c0 0x7efc2c069d80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7efc40000f70 tx=0x7efc40007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x5557728d7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5557728d7890 0x55577288a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55577288ab70 0x55577288af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5557726db470 con 0x5557728d6f70 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555772695ad0 con 0x55577288ab70 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5557726d7430 con 0x5557728d7890 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x5557728d7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x5557728d7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54690/0 (socket says 172.21.15.5:54690) 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4fe00640 1 -- 172.21.15.5:0/4189638723 learned_addr learned my addr 172.21.15.5:0/4189638723 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc55000640 1 --2- 172.21.15.5:0/4189638723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55577288ab70 0x55577288af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4fe00640 1 -- 172.21.15.5:0/4189638723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5557728d7890 msgr2=0x55577288a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc47400640 1 --2- 172.21.15.5:0/4189638723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5557728d7890 0x55577288a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4fe00640 1 --2- 172.21.15.5:0/4189638723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5557728d7890 0x55577288a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4fe00640 1 -- 172.21.15.5:0/4189638723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55577288ab70 msgr2=0x55577288af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4fe00640 1 --2- 172.21.15.5:0/4189638723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55577288ab70 0x55577288af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4fe00640 1 -- 172.21.15.5:0/4189638723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577267ba10 con 0x5557728d6f70 2024-08-18T22:32:11.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc55000640 1 --2- 172.21.15.5:0/4189638723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55577288ab70 0x55577288af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc47400640 1 --2- 172.21.15.5:0/4189638723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5557728d7890 0x55577288a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc4fe00640 1 --2- 172.21.15.5:0/4189638723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x5557728d7350 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7efc40005dd0 tx=0x7efc40012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8258cbd51e325e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc44c00640 1 -- 172.21.15.5:0/4189638723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40015110 con 0x5557728d6f70 2024-08-18T22:32:11.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc44c00640 1 -- 172.21.15.5:0/4189638723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc400159c0 con 0x5557728d6f70 2024-08-18T22:32:11.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc44c00640 1 -- 172.21.15.5:0/4189638723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40015d70 con 0x5557728d6f70 2024-08-18T22:32:11.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 -- 172.21.15.5:0/4189638723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 msgr2=0x5557728d7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/4189638723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x5557728d7350 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7efc40005dd0 tx=0x7efc40012000 comp rx=0 tx=0).stop 2024-08-18T22:32:11.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 -- 172.21.15.5:0/4189638723 shutdown_connections 2024-08-18T22:32:11.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/4189638723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55577288ab70 0x55577288af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/4189638723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5557728d7890 0x55577288a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/4189638723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x5557728d7350 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 -- 172.21.15.5:0/4189638723 >> 172.21.15.5:0/4189638723 conn(0x555772884680 msgr2=0x5557728b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 -- 172.21.15.5:0/4189638723 shutdown_connections 2024-08-18T22:32:11.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.691+0000 7efc5a3e6000 1 -- 172.21.15.5:0/4189638723 wait complete. 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 -- start start 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 Processor -- start 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 0x5557728913f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x555772891930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d7890 0x555772891e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5557726a6770 con 0x5557728d6f70 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55577267cc80 con 0x5557728d7890 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55577275c130 con 0x55577288ab70 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 10 client.0 _ll_register_callbacks cb 0x5557728780e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x555772891930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x555772891930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54692/0 (socket says 172.21.15.5:54692) 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc47400640 1 -- 172.21.15.5:0/3949486003 learned_addr learned my addr 172.21.15.5:0/3949486003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc47400640 1 -- 172.21.15.5:0/3949486003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 msgr2=0x5557728913f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc4fe00640 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 0x5557728913f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc55000640 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d7890 0x555772891e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc47400640 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 0x5557728913f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc47400640 1 -- 172.21.15.5:0/3949486003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d7890 msgr2=0x555772891e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc47400640 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d7890 0x555772891e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc47400640 1 -- 172.21.15.5:0/3949486003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555772693fe0 con 0x5557728d6f70 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc4fe00640 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 0x5557728913f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc55000640 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d7890 0x555772891e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc47400640 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x555772891930 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7efc3801a000 tx=0x7efc380f0540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a206af6ec1b6f4d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc3d600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc3d600640 1 -- 172.21.15.5:0/3949486003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380c4040 con 0x5557728d6f70 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc3d600640 1 -- 172.21.15.5:0/3949486003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7efc381089f0 con 0x5557728d6f70 2024-08-18T22:32:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 -- 172.21.15.5:0/3949486003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc400159c0 con 0x5557728d6f70 2024-08-18T22:32:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc3d600640 1 -- 172.21.15.5:0/3949486003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7efc380f9700 con 0x5557728d6f70 2024-08-18T22:32:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 10 client.10206 fetch_fsmap learned FSMap version 141 2024-08-18T22:32:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 -- 172.21.15.5:0/3949486003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x5557726a7ed0 con 0x5557728d6f70 2024-08-18T22:32:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc3d600640 1 -- 172.21.15.5:0/3949486003 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc400159c0 con 0x5557728d6f70 2024-08-18T22:32:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc3d600640 1 -- 172.21.15.5:0/3949486003 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7efc380f9270 con 0x5557728d6f70 2024-08-18T22:32:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 10 client.10206 fetch_fsmap finished waiting for FSMap version 141 2024-08-18T22:32:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 10 client.10206 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:32:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 20 client.10206 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x555772892880 0x5557728e9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 4 client.10206 mds_command: new command op to 9975 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:32:11.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc5a3e6000 1 -- 172.21.15.5:0/3949486003 --> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555772675d90 con 0x555772892880 2024-08-18T22:32:11.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.695+0000 7efc4fe00640 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x555772892880 0x5557728e9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc4fe00640 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x555772892880 0x5557728e9020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9975 client_cookie=91992239f2c9f3a8 server_cookie=9bc5893a1c5505bd in_seq=0 out_seq=0 2024-08-18T22:32:11.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc3d600640 10 client.10206 ms_handle_connect on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc3d600640 1 -- 172.21.15.5:0/3949486003 <== mds.9975 v2:172.21.15.5:6833/1984562471 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555772675d90 con 0x555772892880 2024-08-18T22:32:11.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc3d600640 10 client.10206 handle_command_reply: tid=0 2024-08-18T22:32:11.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 1 client.10206 shutdown 2024-08-18T22:32:11.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 1 -- 172.21.15.5:0/3949486003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 msgr2=0x555772891930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x555772891930 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7efc3801a000 tx=0x7efc380f0540 comp rx=0 tx=0).stop 2024-08-18T22:32:11.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 1 -- 172.21.15.5:0/3949486003 shutdown_connections 2024-08-18T22:32:11.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x555772892880 0x5557728e9020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d7890 0x555772891e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc3d600640 0 client.10206 ms_handle_reset on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557728d6f70 0x555772891930 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/3949486003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 0x5557728913f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 1 -- 172.21.15.5:0/3949486003 >> 172.21.15.5:0/3949486003 conn(0x555772884680 msgr2=0x5557728b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 1 -- 172.21.15.5:0/3949486003 shutdown_connections 2024-08-18T22:32:11.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 1 -- 172.21.15.5:0/3949486003 wait complete. 2024-08-18T22:32:11.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.699+0000 7efc5a3e6000 20 client.10206 trim_cache size 0 max 16384 2024-08-18T22:32:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.715+0000 7efc5a3e6000 1 Processor -- start 2024-08-18T22:32:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.715+0000 7efc5a3e6000 1 -- start start 2024-08-18T22:32:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.715+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555772884680 0x555772946f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.715+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55577288ab70 0x555772947490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.715+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d6f70 0x5557729479d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.715+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efc502039c0 con 0x55577288ab70 2024-08-18T22:32:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.715+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efc500b2430 con 0x5557728d6f70 2024-08-18T22:32:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.715+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efc500b2a80 con 0x555772884680 2024-08-18T22:32:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55577288ab70 0x555772947490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc47400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55577288ab70 0x555772947490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54698/0 (socket says 172.21.15.5:54698) 2024-08-18T22:32:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc47400640 1 -- 172.21.15.5:0/1100266924 learned_addr learned my addr 172.21.15.5:0/1100266924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc55000640 1 --2- 172.21.15.5:0/1100266924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d6f70 0x5557729479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc4fe00640 1 --2- 172.21.15.5:0/1100266924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555772884680 0x555772946f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc47400640 1 -- 172.21.15.5:0/1100266924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555772884680 msgr2=0x555772946f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc47400640 1 --2- 172.21.15.5:0/1100266924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555772884680 0x555772946f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc47400640 1 -- 172.21.15.5:0/1100266924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d6f70 msgr2=0x5557729479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc47400640 1 --2- 172.21.15.5:0/1100266924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d6f70 0x5557729479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc47400640 1 -- 172.21.15.5:0/1100266924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577275c5c0 con 0x55577288ab70 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc4fe00640 1 --2- 172.21.15.5:0/1100266924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555772884680 0x555772946f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc55000640 1 --2- 172.21.15.5:0/1100266924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d6f70 0x5557729479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc47400640 1 --2- 172.21.15.5:0/1100266924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55577288ab70 0x555772947490 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7efc380eedd0 tx=0x7efc380f05b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc9b6116a7bf184 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc3fe00640 1 -- 172.21.15.5:0/1100266924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380c4040 con 0x55577288ab70 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc3fe00640 1 -- 172.21.15.5:0/1100266924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc380f1e50 con 0x55577288ab70 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc3fe00640 1 -- 172.21.15.5:0/1100266924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380eff70 con 0x55577288ab70 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 -- 172.21.15.5:0/1100266924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55577288ab70 msgr2=0x555772947490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/1100266924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55577288ab70 0x555772947490 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7efc380eedd0 tx=0x7efc380f05b0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 -- 172.21.15.5:0/1100266924 shutdown_connections 2024-08-18T22:32:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/1100266924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d6f70 0x5557729479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/1100266924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55577288ab70 0x555772947490 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/1100266924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555772884680 0x555772946f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 -- 172.21.15.5:0/1100266924 >> 172.21.15.5:0/1100266924 conn(0x5557728ba330 msgr2=0x5557728896b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 -- 172.21.15.5:0/1100266924 shutdown_connections 2024-08-18T22:32:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 -- 172.21.15.5:0/1100266924 wait complete. 2024-08-18T22:32:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 -- start start 2024-08-18T22:32:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 Processor -- start 2024-08-18T22:32:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555772884680 0x5557728ec380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 0x5557728ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d6f70 0x555772906350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5557726da780 con 0x555772884680 2024-08-18T22:32:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555772682a10 con 0x5557728d6f70 2024-08-18T22:32:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5557726dfaa0 con 0x55577288ab70 2024-08-18T22:32:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc5a3e6000 10 client.0 _ll_register_callbacks cb 0x7efc38009420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555772884680 0x5557728ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555772884680 0x5557728ec380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54702/0 (socket says 172.21.15.5:54702) 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc4fe00640 1 -- 172.21.15.5:0/2358683289 learned_addr learned my addr 172.21.15.5:0/2358683289 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.719+0000 7efc55000640 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d6f70 0x555772906350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc47400640 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 0x5557728ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc4fe00640 1 -- 172.21.15.5:0/2358683289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 msgr2=0x5557728ec8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc4fe00640 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 0x5557728ec8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc4fe00640 1 -- 172.21.15.5:0/2358683289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d6f70 msgr2=0x555772906350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc4fe00640 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d6f70 0x555772906350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc4fe00640 1 -- 172.21.15.5:0/2358683289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55577266ec50 con 0x555772884680 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc47400640 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 0x5557728ec8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc4fe00640 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555772884680 0x5557728ec380 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7efc40014000 tx=0x7efc40000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1d6a91220a57a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc3d600640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc3d600640 1 -- 172.21.15.5:0/2358683289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40015940 con 0x555772884680 2024-08-18T22:32:11.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc3d600640 1 -- 172.21.15.5:0/2358683289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7efc40010040 con 0x555772884680 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 -- 172.21.15.5:0/2358683289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc380f1e50 con 0x555772884680 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc3d600640 1 -- 172.21.15.5:0/2358683289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7efc4003d050 con 0x555772884680 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 10 client.10212 fetch_fsmap learned FSMap version 141 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 -- 172.21.15.5:0/2358683289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x5557726812a0 con 0x555772884680 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc3d600640 1 -- 172.21.15.5:0/2358683289 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc380f1e50 con 0x555772884680 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc3d600640 1 -- 172.21.15.5:0/2358683289 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7efc40040020 con 0x555772884680 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 10 client.10212 fetch_fsmap finished waiting for FSMap version 141 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 10 client.10212 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 20 client.10212 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x5557728d7890 0x55577294aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 4 client.10212 mds_command: new command op to 9975 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 -- 172.21.15.5:0/2358683289 --> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x5557726e8ba0 con 0x5557728d7890 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc47400640 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x5557728d7890 0x55577294aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:11.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc3d600640 10 client.10212 ms_handle_connect on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc47400640 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x5557728d7890 0x55577294aa10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9975 client_cookie=50b5c2dad741bdb1 server_cookie=53acab3e8b8bd7fe in_seq=0 out_seq=0 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc3d600640 1 -- 172.21.15.5:0/2358683289 <== mds.9975 v2:172.21.15.5:6833/1984562471 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x5557726e8ba0 con 0x5557728d7890 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc3d600640 10 client.10212 handle_command_reply: tid=0 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 client.10212 shutdown 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 -- 172.21.15.5:0/2358683289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555772884680 msgr2=0x5557728ec380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555772884680 0x5557728ec380 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7efc40014000 tx=0x7efc40000ee0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 -- 172.21.15.5:0/2358683289 shutdown_connections 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.5:6833/1984562471,v1:172.21.15.5:6835/1984562471] conn(0x5557728d7890 0x55577294aa10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5557728d6f70 0x555772906350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55577288ab70 0x5557728ec8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc3d600640 0 client.10212 ms_handle_reset on v2:172.21.15.5:6833/1984562471 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 --2- 172.21.15.5:0/2358683289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555772884680 0x5557728ec380 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:11.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 -- 172.21.15.5:0/2358683289 >> 172.21.15.5:0/2358683289 conn(0x5557728ba330 msgr2=0x555772889ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 -- 172.21.15.5:0/2358683289 shutdown_connections 2024-08-18T22:32:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 1 -- 172.21.15.5:0/2358683289 wait complete. 2024-08-18T22:32:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:11.723+0000 7efc5a3e6000 20 client.10212 trim_cache size 0 max 16384 2024-08-18T22:32:11.729 INFO:teuthology.orchestra.run.smithi005.stderr:Error EINVAL: MDS is not active 2024-08-18T22:32:11.730 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-08-18T22:32:11.731 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:32:11.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:32:11.832 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:32:11.935 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:32:11.935 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:32:11.935 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:32:11.935 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:32:11.945 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:32:11.945 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:32:11.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:32:12.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a7400640 1 Processor -- start 2024-08-18T22:32:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a7400640 1 -- start start 2024-08-18T22:32:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9a015b0c0 0x7fb9a006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9a00b40c0 0x7fb9a00b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a7400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a00b31f0 con 0x7fb9a0072a30 2024-08-18T22:32:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a7400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb9a00b3d70 con 0x7fb9a015b0c0 2024-08-18T22:32:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a7400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a00b4a40 con 0x7fb9a00b40c0 2024-08-18T22:32:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a5400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb9a0072a30 0x7fb9a0072e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42460/0 (socket says 172.21.15.5:42460) 2024-08-18T22:32:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a4a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9a015b0c0 0x7fb9a006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a5400640 1 -- 172.21.15.5:0/3517953065 learned_addr learned my addr 172.21.15.5:0/3517953065 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb997e00640 1 --2- 172.21.15.5:0/3517953065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9a00b40c0 0x7fb9a00b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a4a00640 1 -- 172.21.15.5:0/3517953065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9a00b40c0 msgr2=0x7fb9a00b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a4a00640 1 --2- 172.21.15.5:0/3517953065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9a00b40c0 0x7fb9a00b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a4a00640 1 -- 172.21.15.5:0/3517953065 >> v1:172.21.15.5:6789/0 conn(0x7fb9a0072a30 legacy=0x7fb9a0072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb9a4a00640 1 -- 172.21.15.5:0/3517953065 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a00b34d0 con 0x7fb9a015b0c0 2024-08-18T22:32:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb99fe00640 1 -- 172.21.15.5:0/3517953065 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1875922603 0 0) 0x7fb9a00b31f0 con 0x7fb9a0072a30 2024-08-18T22:32:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.179+0000 7fb997e00640 1 --2- 172.21.15.5:0/3517953065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9a00b40c0 0x7fb9a00b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb9a4a00640 1 --2- 172.21.15.5:0/3517953065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a015b0c0 0x7fb9a006db80 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fb9900097c0 tx=0x7fb99001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b302fdf6471de5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb99fe00640 1 -- 172.21.15.5:0/3517953065 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9900b0070 con 0x7fb9a015b0c0 2024-08-18T22:32:12.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb99fe00640 1 -- 172.21.15.5:0/3517953065 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb990004230 con 0x7fb9a015b0c0 2024-08-18T22:32:12.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb99fe00640 1 -- 172.21.15.5:0/3517953065 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990003620 con 0x7fb9a015b0c0 2024-08-18T22:32:12.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb9a7400640 1 -- 172.21.15.5:0/3517953065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a015b0c0 msgr2=0x7fb9a006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:12.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb9a7400640 1 --2- 172.21.15.5:0/3517953065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a015b0c0 0x7fb9a006db80 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fb9900097c0 tx=0x7fb99001c350 comp rx=0 tx=0).stop 2024-08-18T22:32:12.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb9a7400640 1 -- 172.21.15.5:0/3517953065 shutdown_connections 2024-08-18T22:32:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb9a7400640 1 --2- 172.21.15.5:0/3517953065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9a00b40c0 0x7fb9a00b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb9a7400640 1 --2- 172.21.15.5:0/3517953065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a015b0c0 0x7fb9a006db80 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb9a7400640 1 -- 172.21.15.5:0/3517953065 >> 172.21.15.5:0/3517953065 conn(0x7fb9a00b1dc0 msgr2=0x7fb9a00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb9a7400640 1 -- 172.21.15.5:0/3517953065 shutdown_connections 2024-08-18T22:32:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.183+0000 7fb9a7400640 1 -- 172.21.15.5:0/3517953065 wait complete. 2024-08-18T22:32:12.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a7400640 1 Processor -- start 2024-08-18T22:32:12.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a7400640 1 -- start start 2024-08-18T22:32:12.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9a0072a30 0x7fb9a014f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:12.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a00b40c0 0x7fb9a0148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a7400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9a015b0c0 0x7fb9a015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a7400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a015b4a0 con 0x7fb9a00b40c0 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a7400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a00739a0 con 0x7fb9a015b0c0 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a7400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a015b620 con 0x7fb9a0072a30 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb997e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a00b40c0 0x7fb9a0148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb997e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a00b40c0 0x7fb9a0148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54720/0 (socket says 172.21.15.5:54720) 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb997e00640 1 -- 172.21.15.5:0/1321393293 learned_addr learned my addr 172.21.15.5:0/1321393293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a4a00640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9a0072a30 0x7fb9a014f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a5400640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9a015b0c0 0x7fb9a015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb997e00640 1 -- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9a0072a30 msgr2=0x7fb9a014f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb997e00640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9a0072a30 0x7fb9a014f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb997e00640 1 -- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9a015b0c0 msgr2=0x7fb9a015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb997e00640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9a015b0c0 0x7fb9a015b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:12.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb997e00640 1 -- 172.21.15.5:0/1321393293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a00b12e0 con 0x7fb9a00b40c0 2024-08-18T22:32:12.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb997e00640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a00b40c0 0x7fb9a0148c50 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fb98800e840 tx=0x7fb98800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:12.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb99d600640 1 -- 172.21.15.5:0/1321393293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988017070 con 0x7fb9a00b40c0 2024-08-18T22:32:12.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb99d600640 1 -- 172.21.15.5:0/1321393293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98800c8d0 con 0x7fb9a00b40c0 2024-08-18T22:32:12.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb99d600640 1 -- 172.21.15.5:0/1321393293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98800f040 con 0x7fb9a00b40c0 2024-08-18T22:32:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a7400640 1 -- 172.21.15.5:0/1321393293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a015bd00 con 0x7fb9a00b40c0 2024-08-18T22:32:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a7400640 1 -- 172.21.15.5:0/1321393293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a0149ee0 con 0x7fb9a00b40c0 2024-08-18T22:32:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.187+0000 7fb9a7400640 1 -- 172.21.15.5:0/1321393293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a006f670 con 0x7fb9a00b40c0 2024-08-18T22:32:12.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.191+0000 7fb99d600640 1 -- 172.21.15.5:0/1321393293 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb98801a070 con 0x7fb9a00b40c0 2024-08-18T22:32:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.191+0000 7fb99d600640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb97c0678f0 0x7fb97c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.191+0000 7fb99d600640 1 -- 172.21.15.5:0/1321393293 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7fb988085a10 con 0x7fb9a00b40c0 2024-08-18T22:32:12.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.191+0000 7fb9a4a00640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb97c0678f0 0x7fb97c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:12.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.191+0000 7fb9a4a00640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb97c0678f0 0x7fb97c069db0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb9900ad000 tx=0x7fb9900a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:12.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.195+0000 7fb99d600640 1 -- 172.21.15.5:0/1321393293 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb988055c80 con 0x7fb9a00b40c0 2024-08-18T22:32:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.371+0000 7fb9a7400640 1 -- 172.21.15.5:0/1321393293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb9a00b0290 con 0x7fb9a00b40c0 2024-08-18T22:32:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.371+0000 7fb99d600640 1 -- 172.21.15.5:0/1321393293 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v179) ==== 80+0+0 (secure 0 0 0) 0x7fb988059f80 con 0x7fb9a00b40c0 2024-08-18T22:32:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:32:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 -- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb97c0678f0 msgr2=0x7fb97c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb97c0678f0 0x7fb97c069db0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb9900ad000 tx=0x7fb9900a6000 comp rx=0 tx=0).stop 2024-08-18T22:32:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 -- 172.21.15.5:0/1321393293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a00b40c0 msgr2=0x7fb9a0148c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a00b40c0 0x7fb9a0148c50 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fb98800e840 tx=0x7fb98800ed00 comp rx=0 tx=0).stop 2024-08-18T22:32:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 -- 172.21.15.5:0/1321393293 shutdown_connections 2024-08-18T22:32:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb97c0678f0 0x7fb97c069db0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9a015b0c0 0x7fb9a015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9a00b40c0 0x7fb9a0148c50 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 --2- 172.21.15.5:0/1321393293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9a0072a30 0x7fb9a014f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 -- 172.21.15.5:0/1321393293 >> 172.21.15.5:0/1321393293 conn(0x7fb9a00b1dc0 msgr2=0x7fb9a00b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 -- 172.21.15.5:0/1321393293 shutdown_connections 2024-08-18T22:32:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:12.375+0000 7fb9a7400640 1 -- 172.21.15.5:0/1321393293 wait complete. 2024-08-18T22:32:12.392 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:32:12.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:32:12.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:32:13.181 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:32:13.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:32:13.182 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:32:13.191 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:32:13.191 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:32:13.191 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:32:13.200 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:32:13.200 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:32:13.200 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:32:13.200 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:32:13.245 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:32:13.246 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:32:13.246 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:32:13.246 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:32:13.254 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:32:13.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:32:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.427+0000 7f9abf200640 1 Processor -- start 2024-08-18T22:32:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.427+0000 7f9abf200640 1 -- start start 2024-08-18T22:32:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abf200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9ab815e140 0x7f9ab80b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abf200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab80b5e60 0x7f9ab80af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abf200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ab80afc80 0x7f9ab80ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abf200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab806e560 con 0x7f9ab80afc80 2024-08-18T22:32:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abf200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab80b65d0 con 0x7f9ab815e140 2024-08-18T22:32:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abf200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab80b68b0 con 0x7f9ab80b5e60 2024-08-18T22:32:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abd200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ab80afc80 0x7f9ab80ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abd200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9ab80afc80 0x7f9ab80ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54724/0 (socket says 172.21.15.5:54724) 2024-08-18T22:32:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9ab7e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9ab815e140 0x7f9ab80b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abd200640 1 -- 172.21.15.5:0/3670682407 learned_addr learned my addr 172.21.15.5:0/3670682407 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9aaf400640 1 --2- 172.21.15.5:0/3670682407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab80b5e60 0x7f9ab80af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abd200640 1 -- 172.21.15.5:0/3670682407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab80b5e60 msgr2=0x7f9ab80af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abd200640 1 --2- 172.21.15.5:0/3670682407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab80b5e60 0x7f9ab80af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abd200640 1 -- 172.21.15.5:0/3670682407 >> v2:172.21.15.117:3300/0 conn(0x7f9ab815e140 msgr2=0x7f9ab80b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abd200640 1 --2- 172.21.15.5:0/3670682407 >> v2:172.21.15.117:3300/0 conn(0x7f9ab815e140 0x7f9ab80b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9abd200640 1 -- 172.21.15.5:0/3670682407 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab806e7b0 con 0x7f9ab80afc80 2024-08-18T22:32:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.431+0000 7f9ab7e00640 1 --2- 172.21.15.5:0/3670682407 >> v2:172.21.15.117:3300/0 conn(0x7f9ab815e140 0x7f9ab80b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:32:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abd200640 1 --2- 172.21.15.5:0/3670682407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ab80afc80 0x7f9ab80ad8b0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80b6ac0 tx=0x7f9ab001c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7568b5f285617046 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9ab7400640 1 -- 172.21.15.5:0/3670682407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00ac020 con 0x7f9ab80afc80 2024-08-18T22:32:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9ab7400640 1 -- 172.21.15.5:0/3670682407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab00a6440 con 0x7f9ab80afc80 2024-08-18T22:32:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9ab7400640 1 -- 172.21.15.5:0/3670682407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00a6810 con 0x7f9ab80afc80 2024-08-18T22:32:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abf200640 1 -- 172.21.15.5:0/3670682407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ab80afc80 msgr2=0x7f9ab80ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abf200640 1 --2- 172.21.15.5:0/3670682407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ab80afc80 0x7f9ab80ad8b0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80b6ac0 tx=0x7f9ab001c6a0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abf200640 1 -- 172.21.15.5:0/3670682407 shutdown_connections 2024-08-18T22:32:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abf200640 1 --2- 172.21.15.5:0/3670682407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ab80afc80 0x7f9ab80ad8b0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abf200640 1 --2- 172.21.15.5:0/3670682407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab80b5e60 0x7f9ab80af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abf200640 1 --2- 172.21.15.5:0/3670682407 >> v2:172.21.15.117:3300/0 conn(0x7f9ab815e140 0x7f9ab80b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abf200640 1 -- 172.21.15.5:0/3670682407 >> 172.21.15.5:0/3670682407 conn(0x7f9ab806b9b0 msgr2=0x7f9ab806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abf200640 1 -- 172.21.15.5:0/3670682407 shutdown_connections 2024-08-18T22:32:13.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abf200640 1 -- 172.21.15.5:0/3670682407 wait complete. 2024-08-18T22:32:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abf200640 1 Processor -- start 2024-08-18T22:32:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.435+0000 7f9abf200640 1 -- start start 2024-08-18T22:32:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9abf200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ab80afc80 0x7f9ab80cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9abf200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ab80b5e60 0x7f9ab815b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9abf200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab815e140 0x7f9ab80ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9abf200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab806f130 con 0x7f9ab80b5e60 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9abf200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab806efb0 con 0x7f9ab80afc80 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9abf200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab806f2b0 con 0x7f9ab815e140 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9aaf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ab80b5e60 0x7f9ab815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9aaf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ab80b5e60 0x7f9ab815b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54728/0 (socket says 172.21.15.5:54728) 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9aaf400640 1 -- 172.21.15.5:0/1609777846 learned_addr learned my addr 172.21.15.5:0/1609777846 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9ab7e00640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ab80afc80 0x7f9ab80cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9abd200640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab815e140 0x7f9ab80ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9aaf400640 1 -- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab815e140 msgr2=0x7f9ab80ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9aaf400640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab815e140 0x7f9ab80ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9aaf400640 1 -- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ab80afc80 msgr2=0x7f9ab80cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9aaf400640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ab80afc80 0x7f9ab80cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9aaf400640 1 -- 172.21.15.5:0/1609777846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab80cdac0 con 0x7f9ab80b5e60 2024-08-18T22:32:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9aaf400640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ab80b5e60 0x7f9ab815b410 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000e930 tx=0x7f9aa000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9ab4c00640 1 -- 172.21.15.5:0/1609777846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0017070 con 0x7f9ab80b5e60 2024-08-18T22:32:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9ab4c00640 1 -- 172.21.15.5:0/1609777846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa000c9a0 con 0x7f9ab80b5e60 2024-08-18T22:32:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9ab4c00640 1 -- 172.21.15.5:0/1609777846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000cd50 con 0x7f9ab80b5e60 2024-08-18T22:32:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9abf200640 1 -- 172.21.15.5:0/1609777846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab80cdda0 con 0x7f9ab80b5e60 2024-08-18T22:32:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9abf200640 1 -- 172.21.15.5:0/1609777846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab80ce360 con 0x7f9ab80b5e60 2024-08-18T22:32:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9abf200640 1 -- 172.21.15.5:0/1609777846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab80ad8b0 con 0x7f9ab80b5e60 2024-08-18T22:32:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.439+0000 7f9ab4c00640 1 -- 172.21.15.5:0/1609777846 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9aa001a070 con 0x7f9ab80b5e60 2024-08-18T22:32:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.443+0000 7f9ab4c00640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a940678c0 0x7f9a94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.443+0000 7f9ab4c00640 1 -- 172.21.15.5:0/1609777846 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f9aa0086190 con 0x7f9ab80b5e60 2024-08-18T22:32:13.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.443+0000 7f9ab7e00640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a940678c0 0x7f9a94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.443+0000 7f9ab7e00640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a940678c0 0x7f9a94069d80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009580 tx=0x7f9aa8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:13.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.447+0000 7f9ab4c00640 1 -- 172.21.15.5:0/1609777846 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f9aa0056550 con 0x7f9ab80b5e60 2024-08-18T22:32:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 -- 172.21.15.5:0/1609777846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ab80d06c0 con 0x7f9ab80b5e60 2024-08-18T22:32:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9ab4c00640 1 -- 172.21.15.5:0/1609777846 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5239 (secure 0 0 0) 0x7f9aa005a850 con 0x7f9ab80b5e60 2024-08-18T22:32:13.647 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:13.647 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":141,"btime":"2024-08-18T22:32:09:914521+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4068691051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4068691051},{"type":"v1","addr":"172.21.15.117:6836","nonce":4068691051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":9972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/4128479928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4128479928},{"type":"v1","addr":"172.21.15.5:6834","nonce":4128479928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":141,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:31:37.120589+0000","modified":"2024-08-18T22:32:09.914504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9981},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9975":{"gid":9975,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6835/1984562471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1984562471},{"type":"v1","addr":"172.21.15.5:6835","nonce":1984562471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9981":{"gid":9981,"name":"d","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/3224274565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3224274565},{"type":"v1","addr":"172.21.15.117:6837","nonce":3224274565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9981,"qdb_cluster":[9981]},"id":12}]} 2024-08-18T22:32:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 141 2024-08-18T22:32:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 -- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a940678c0 msgr2=0x7f9a94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a940678c0 0x7f9a94069d80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009580 tx=0x7f9aa8009190 comp rx=0 tx=0).stop 2024-08-18T22:32:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 -- 172.21.15.5:0/1609777846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ab80b5e60 msgr2=0x7f9ab815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ab80b5e60 0x7f9ab815b410 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000e930 tx=0x7f9aa000edf0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 -- 172.21.15.5:0/1609777846 shutdown_connections 2024-08-18T22:32:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9a940678c0 0x7f9a94069d80 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ab815e140 0x7f9ab80ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ab80b5e60 0x7f9ab815b410 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 --2- 172.21.15.5:0/1609777846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ab80afc80 0x7f9ab80cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 -- 172.21.15.5:0/1609777846 >> 172.21.15.5:0/1609777846 conn(0x7f9ab806b9b0 msgr2=0x7f9ab806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 -- 172.21.15.5:0/1609777846 shutdown_connections 2024-08-18T22:32:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.647+0000 7f9abf200640 1 -- 172.21.15.5:0/1609777846 wait complete. 2024-08-18T22:32:13.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:32:13.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2ded800640 1 Processor -- start 2024-08-18T22:32:13.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2ded800640 1 -- start start 2024-08-18T22:32:13.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2ded800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de815bb20 0x7f2de815f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2ded800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2de806d0d0 0x7f2de80b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2ded800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de8072f80 con 0x7f2de80adc50 2024-08-18T22:32:13.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2ded800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2de815bf00 con 0x7f2de806d0d0 2024-08-18T22:32:13.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2ded800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2de80ae1a0 con 0x7f2de815bb20 2024-08-18T22:32:13.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2ddf400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2de80adc50 0x7f2de806c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47348/0 (socket says 172.21.15.5:47348) 2024-08-18T22:32:13.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2ddf400640 1 -- 172.21.15.5:0/2001507743 learned_addr learned my addr 172.21.15.5:0/2001507743 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:13.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2de7e00640 1 --2- 172.21.15.5:0/2001507743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de815bb20 0x7f2de815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2dece00640 1 --2- 172.21.15.5:0/2001507743 >> v2:172.21.15.117:3300/0 conn(0x7f2de806d0d0 0x7f2de80b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2de7400640 1 -- 172.21.15.5:0/2001507743 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311506321 0 0) 0x7f2dd0001120 con 0x7f2de80adc50 2024-08-18T22:32:13.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2de7400640 1 -- 172.21.15.5:0/2001507743 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dcc003530 con 0x7f2de80adc50 2024-08-18T22:32:13.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2de7e00640 1 -- 172.21.15.5:0/2001507743 >> v2:172.21.15.117:3300/0 conn(0x7f2de806d0d0 msgr2=0x7f2de80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:13.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2de7e00640 1 --2- 172.21.15.5:0/2001507743 >> v2:172.21.15.117:3300/0 conn(0x7f2de806d0d0 0x7f2de80b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2de7e00640 1 -- 172.21.15.5:0/2001507743 >> v1:172.21.15.5:6789/0 conn(0x7f2de80adc50 legacy=0x7f2de806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:13.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.811+0000 7f2de7e00640 1 -- 172.21.15.5:0/2001507743 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de80ae480 con 0x7f2de815bb20 2024-08-18T22:32:13.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2de7e00640 1 --2- 172.21.15.5:0/2001507743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de815bb20 0x7f2de815f000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80097f0 tx=0x7f2dd801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bff954a41486089 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:13.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2de7400640 1 -- 172.21.15.5:0/2001507743 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80b2070 con 0x7f2de815bb20 2024-08-18T22:32:13.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2de7400640 1 -- 172.21.15.5:0/2001507743 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd80ad640 con 0x7f2de815bb20 2024-08-18T22:32:13.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2de7400640 1 -- 172.21.15.5:0/2001507743 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80ad9f0 con 0x7f2de815bb20 2024-08-18T22:32:13.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2ded800640 1 -- 172.21.15.5:0/2001507743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de815bb20 msgr2=0x7f2de815f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:13.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2ded800640 1 --2- 172.21.15.5:0/2001507743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de815bb20 0x7f2de815f000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80097f0 tx=0x7f2dd801c4a0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2ded800640 1 -- 172.21.15.5:0/2001507743 shutdown_connections 2024-08-18T22:32:13.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2ded800640 1 --2- 172.21.15.5:0/2001507743 >> v2:172.21.15.117:3300/0 conn(0x7f2de806d0d0 0x7f2de80b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2ded800640 1 --2- 172.21.15.5:0/2001507743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de815bb20 0x7f2de815f000 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2ded800640 1 -- 172.21.15.5:0/2001507743 >> 172.21.15.5:0/2001507743 conn(0x7f2de8072130 msgr2=0x7f2de8072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:13.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2ded800640 1 -- 172.21.15.5:0/2001507743 shutdown_connections 2024-08-18T22:32:13.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.815+0000 7f2ded800640 1 -- 172.21.15.5:0/2001507743 wait complete. 2024-08-18T22:32:13.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ded800640 1 Processor -- start 2024-08-18T22:32:13.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ded800640 1 -- start start 2024-08-18T22:32:13.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ded800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2de806d0d0 0x7f2de80cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ded800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de80adc50 0x7f2de81611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ded800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2de815bb20 0x7f2de81616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ded800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2de80b4800 con 0x7f2de806d0d0 2024-08-18T22:32:13.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ded800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2de80b4680 con 0x7f2de815bb20 2024-08-18T22:32:13.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ded800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2de80b4980 con 0x7f2de80adc50 2024-08-18T22:32:13.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2de806d0d0 0x7f2de80cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2de806d0d0 0x7f2de80cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55304/0 (socket says 172.21.15.5:55304) 2024-08-18T22:32:13.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de7e00640 1 -- 172.21.15.5:0/3251629804 learned_addr learned my addr 172.21.15.5:0/3251629804 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:13.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2dece00640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2de815bb20 0x7f2de81616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ddf400640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de80adc50 0x7f2de81611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de7e00640 1 -- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de80adc50 msgr2=0x7f2de81611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de7e00640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de80adc50 0x7f2de81611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de7e00640 1 -- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2de815bb20 msgr2=0x7f2de81616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de7e00640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2de815bb20 0x7f2de81616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de7e00640 1 -- 172.21.15.5:0/3251629804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de8161f40 con 0x7f2de806d0d0 2024-08-18T22:32:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ddf400640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de80adc50 0x7f2de81611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de7e00640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2de806d0d0 0x7f2de80cf7e0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f2dd801a0d0 tx=0x7f2dd8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:13.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de4c00640 1 -- 172.21.15.5:0/3251629804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80b2040 con 0x7f2de806d0d0 2024-08-18T22:32:13.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de4c00640 1 -- 172.21.15.5:0/3251629804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd80bf070 con 0x7f2de806d0d0 2024-08-18T22:32:13.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2de4c00640 1 -- 172.21.15.5:0/3251629804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8006e20 con 0x7f2de806d0d0 2024-08-18T22:32:13.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ded800640 1 -- 172.21.15.5:0/3251629804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de80ccdd0 con 0x7f2de806d0d0 2024-08-18T22:32:13.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ded800640 1 -- 172.21.15.5:0/3251629804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de8161c20 con 0x7f2de806d0d0 2024-08-18T22:32:13.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.819+0000 7f2ded800640 1 -- 172.21.15.5:0/3251629804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de80b3930 con 0x7f2de806d0d0 2024-08-18T22:32:13.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.823+0000 7f2de4c00640 1 -- 172.21.15.5:0/3251629804 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2dd80b5070 con 0x7f2de806d0d0 2024-08-18T22:32:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.823+0000 7f2de4c00640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2dc40678c0 0x7f2dc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.823+0000 7f2de4c00640 1 -- 172.21.15.5:0/3251629804 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f2dd8120d00 con 0x7f2de806d0d0 2024-08-18T22:32:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.823+0000 7f2ddf400640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2dc40678c0 0x7f2dc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.823+0000 7f2ddf400640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2dc40678c0 0x7f2dc4069d80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2de8072680 tx=0x7f2dd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:13.827+0000 7f2de4c00640 1 -- 172.21.15.5:0/3251629804 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2dd8016090 con 0x7f2de806d0d0 2024-08-18T22:32:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 -- 172.21.15.5:0/3251629804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2de80b2160 con 0x7f2de806d0d0 2024-08-18T22:32:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2de4c00640 1 -- 172.21.15.5:0/3251629804 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5239 (secure 0 0 0) 0x7f2dd80f1640 con 0x7f2de806d0d0 2024-08-18T22:32:14.027 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:14.027 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":141,"btime":"2024-08-18T22:32:09:914521+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4068691051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4068691051},{"type":"v1","addr":"172.21.15.117:6836","nonce":4068691051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":9972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/4128479928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4128479928},{"type":"v1","addr":"172.21.15.5:6834","nonce":4128479928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":141,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:31:37.120589+0000","modified":"2024-08-18T22:32:09.914504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9981},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9975":{"gid":9975,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6835/1984562471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1984562471},{"type":"v1","addr":"172.21.15.5:6835","nonce":1984562471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9981":{"gid":9981,"name":"d","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/3224274565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3224274565},{"type":"v1","addr":"172.21.15.117:6837","nonce":3224274565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9981,"qdb_cluster":[9981]},"id":12}]} 2024-08-18T22:32:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 141 2024-08-18T22:32:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 -- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2dc40678c0 msgr2=0x7f2dc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2dc40678c0 0x7f2dc4069d80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2de8072680 tx=0x7f2dd0009040 comp rx=0 tx=0).stop 2024-08-18T22:32:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 -- 172.21.15.5:0/3251629804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2de806d0d0 msgr2=0x7f2de80cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2de806d0d0 0x7f2de80cf7e0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f2dd801a0d0 tx=0x7f2dd8019240 comp rx=0 tx=0).stop 2024-08-18T22:32:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 -- 172.21.15.5:0/3251629804 shutdown_connections 2024-08-18T22:32:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2dc40678c0 0x7f2dc4069d80 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2de815bb20 0x7f2de81616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2de80adc50 0x7f2de81611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 --2- 172.21.15.5:0/3251629804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2de806d0d0 0x7f2de80cf7e0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 -- 172.21.15.5:0/3251629804 >> 172.21.15.5:0/3251629804 conn(0x7f2de8072130 msgr2=0x7f2de806f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 -- 172.21.15.5:0/3251629804 shutdown_connections 2024-08-18T22:32:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.027+0000 7f2ded800640 1 -- 172.21.15.5:0/3251629804 wait complete. 2024-08-18T22:32:14.048 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:32:14.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.187+0000 7fba13e00640 1 Processor -- start 2024-08-18T22:32:14.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba13e00640 1 -- start start 2024-08-18T22:32:14.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba13e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba1406d0d0 0x7fba1415c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba13e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1415e8a0 con 0x7fba1415ace0 2024-08-18T22:32:14.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba13e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1415c130 con 0x7fba14072c50 2024-08-18T22:32:14.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba13e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fba1415eb40 con 0x7fba1406d0d0 2024-08-18T22:32:14.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba0be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba1406d0d0 0x7fba1415c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba12a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fba1415ace0 0x7fba1406c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47350/0 (socket says 172.21.15.5:47350) 2024-08-18T22:32:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba12a00640 1 -- 172.21.15.5:0/2446841592 learned_addr learned my addr 172.21.15.5:0/2446841592 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba0be00640 1 -- 172.21.15.5:0/2446841592 >> v1:172.21.15.117:6789/0 conn(0x7fba14072c50 legacy=0x7fba1415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba0be00640 1 -- 172.21.15.5:0/2446841592 >> v1:172.21.15.5:6789/0 conn(0x7fba1415ace0 legacy=0x7fba1406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba0be00640 1 -- 172.21.15.5:0/2446841592 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1415ee20 con 0x7fba1406d0d0 2024-08-18T22:32:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.191+0000 7fba12000640 1 -- 172.21.15.5:0/2446841592 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104979354 0 0) 0x7fba1415e8a0 con 0x7fba1415ace0 2024-08-18T22:32:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba0be00640 1 --2- 172.21.15.5:0/2446841592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1406d0d0 0x7fba1415c470 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0097c0 tx=0x7fb9fc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7c125e4f44bd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba12000640 1 -- 172.21.15.5:0/2446841592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0ab600 con 0x7fba1406d0d0 2024-08-18T22:32:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba12000640 1 -- 172.21.15.5:0/2446841592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9fc0b0070 con 0x7fba1406d0d0 2024-08-18T22:32:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba12000640 1 -- 172.21.15.5:0/2446841592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0ab9c0 con 0x7fba1406d0d0 2024-08-18T22:32:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba13e00640 1 -- 172.21.15.5:0/2446841592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1406d0d0 msgr2=0x7fba1415c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba13e00640 1 --2- 172.21.15.5:0/2446841592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1406d0d0 0x7fba1415c470 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0097c0 tx=0x7fb9fc01c470 comp rx=0 tx=0).stop 2024-08-18T22:32:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba13e00640 1 -- 172.21.15.5:0/2446841592 shutdown_connections 2024-08-18T22:32:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba13e00640 1 --2- 172.21.15.5:0/2446841592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1406d0d0 0x7fba1415c470 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba13e00640 1 -- 172.21.15.5:0/2446841592 >> 172.21.15.5:0/2446841592 conn(0x7fba14072130 msgr2=0x7fba14072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba13e00640 1 -- 172.21.15.5:0/2446841592 shutdown_connections 2024-08-18T22:32:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba13e00640 1 -- 172.21.15.5:0/2446841592 wait complete. 2024-08-18T22:32:14.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba13e00640 1 Processor -- start 2024-08-18T22:32:14.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.195+0000 7fba13e00640 1 -- start start 2024-08-18T22:32:14.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba13e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba1406d0d0 0x7fba141f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba13e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba14072c50 0x7fba14153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba13e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba1415ace0 0x7fba14157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba13e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fba1415f7a0 con 0x7fba14072c50 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba13e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fba1415f620 con 0x7fba1406d0d0 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba13e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fba14169460 con 0x7fba1415ace0 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba14072c50 0x7fba14153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba14072c50 0x7fba14153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55326/0 (socket says 172.21.15.5:55326) 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0be00640 1 -- 172.21.15.5:0/2468077624 learned_addr learned my addr 172.21.15.5:0/2468077624 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba12a00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba1406d0d0 0x7fba141f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba13400640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba1415ace0 0x7fba14157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0be00640 1 -- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba1415ace0 msgr2=0x7fba14157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0be00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba1415ace0 0x7fba14157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0be00640 1 -- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba1406d0d0 msgr2=0x7fba141f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0be00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba1406d0d0 0x7fba141f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0be00640 1 -- 172.21.15.5:0/2468077624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1406ea70 con 0x7fba14072c50 2024-08-18T22:32:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0be00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba14072c50 0x7fba14153140 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0097c0 tx=0x7fb9fc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0aa00640 1 -- 172.21.15.5:0/2468077624 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc004220 con 0x7fba14072c50 2024-08-18T22:32:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0aa00640 1 -- 172.21.15.5:0/2468077624 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9fc0043e0 con 0x7fba14072c50 2024-08-18T22:32:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba13e00640 1 -- 172.21.15.5:0/2468077624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1406ed10 con 0x7fba14072c50 2024-08-18T22:32:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba0aa00640 1 -- 172.21.15.5:0/2468077624 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc003860 con 0x7fba14072c50 2024-08-18T22:32:14.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba13e00640 1 -- 172.21.15.5:0/2468077624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba141f7c80 con 0x7fba14072c50 2024-08-18T22:32:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.199+0000 7fba13e00640 1 -- 172.21.15.5:0/2468077624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba1406eee0 con 0x7fba14072c50 2024-08-18T22:32:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.203+0000 7fba0aa00640 1 -- 172.21.15.5:0/2468077624 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb9fc0aa070 con 0x7fba14072c50 2024-08-18T22:32:14.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.203+0000 7fba0aa00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9f00678c0 0x7fb9f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.203+0000 7fba0aa00640 1 -- 172.21.15.5:0/2468077624 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7fb9fc1203d0 con 0x7fba14072c50 2024-08-18T22:32:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.203+0000 7fba12a00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9f00678c0 0x7fb9f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.203+0000 7fba12a00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9f00678c0 0x7fb9f0069d80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fba04000f70 tx=0x7fba04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:14.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.207+0000 7fba0aa00640 1 -- 172.21.15.5:0/2468077624 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb9fc016090 con 0x7fba14072c50 2024-08-18T22:32:14.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.375+0000 7fba13e00640 1 -- 172.21.15.5:0/2468077624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba1406c9c0 con 0x7fba14072c50 2024-08-18T22:32:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.375+0000 7fba0aa00640 1 -- 172.21.15.5:0/2468077624 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) ==== 74+0+17016 (secure 0 0 0) 0x7fb9fc0f0c90 con 0x7fba14072c50 2024-08-18T22:32:14.376 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:14.376 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":179,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:32:05.890526+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:31:34.888000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-08-18T22:31:36.119247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.2","mappings":[{"from":1,"to":0}]},{"pgid":"26.b","mappings":[{"from":3,"to":0}]},{"pgid":"26.23","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:32:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 -- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9f00678c0 msgr2=0x7fb9f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9f00678c0 0x7fb9f0069d80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fba04000f70 tx=0x7fba04009040 comp rx=0 tx=0).stop 2024-08-18T22:32:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 -- 172.21.15.5:0/2468077624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba14072c50 msgr2=0x7fba14153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba14072c50 0x7fba14153140 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0097c0 tx=0x7fb9fc01acb0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 -- 172.21.15.5:0/2468077624 shutdown_connections 2024-08-18T22:32:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb9f00678c0 0x7fb9f0069d80 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba1415ace0 0x7fba14157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba14072c50 0x7fba14153140 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 --2- 172.21.15.5:0/2468077624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba1406d0d0 0x7fba141f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 -- 172.21.15.5:0/2468077624 >> 172.21.15.5:0/2468077624 conn(0x7fba14072130 msgr2=0x7fba140aec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 -- 172.21.15.5:0/2468077624 shutdown_connections 2024-08-18T22:32:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.379+0000 7fba13e00640 1 -- 172.21.15.5:0/2468077624 wait complete. 2024-08-18T22:32:14.398 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:32:14.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:32:14.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d63c00640 1 Processor -- start 2024-08-18T22:32:14.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d63c00640 1 -- start start 2024-08-18T22:32:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d63c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c15c180 0x7f0d5c0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d63c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d5c071c90 0x7f0d5c15c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d63c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c0b5e30 con 0x7f0d5c06fad0 2024-08-18T22:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d63c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0d5c15caa0 con 0x7f0d5c071c90 2024-08-18T22:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d63c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c0b6110 con 0x7f0d5c15c180 2024-08-18T22:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d53e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f0d5c06fad0 0x7f0d5c071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:54736/0 (socket says 172.21.15.5:54736) 2024-08-18T22:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d53e00640 1 -- 172.21.15.5:0/930868472 learned_addr learned my addr 172.21.15.5:0/930868472 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d61200640 1 --2- 172.21.15.5:0/930868472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c15c180 0x7f0d5c0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d61c00640 1 --2- 172.21.15.5:0/930868472 >> v2:172.21.15.117:3300/0 conn(0x7f0d5c071c90 0x7f0d5c15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d61200640 1 -- 172.21.15.5:0/930868472 >> v2:172.21.15.117:3300/0 conn(0x7f0d5c071c90 msgr2=0x7f0d5c15c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d61200640 1 --2- 172.21.15.5:0/930868472 >> v2:172.21.15.117:3300/0 conn(0x7f0d5c071c90 0x7f0d5c15c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d61200640 1 -- 172.21.15.5:0/930868472 >> v1:172.21.15.117:6789/0 conn(0x7f0d5c06fad0 legacy=0x7f0d5c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.539+0000 7f0d61200640 1 -- 172.21.15.5:0/930868472 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c0b63f0 con 0x7f0d5c15c180 2024-08-18T22:32:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d61200640 1 --2- 172.21.15.5:0/930868472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c15c180 0x7f0d5c0b57c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0097c0 tx=0x7f0d4c01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3817747737618de1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d5be00640 1 -- 172.21.15.5:0/930868472 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0b1070 con 0x7f0d5c15c180 2024-08-18T22:32:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d5be00640 1 -- 172.21.15.5:0/930868472 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c0ac640 con 0x7f0d5c15c180 2024-08-18T22:32:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d5be00640 1 -- 172.21.15.5:0/930868472 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0aca10 con 0x7f0d5c15c180 2024-08-18T22:32:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d63c00640 1 -- 172.21.15.5:0/930868472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c15c180 msgr2=0x7f0d5c0b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d63c00640 1 --2- 172.21.15.5:0/930868472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c15c180 0x7f0d5c0b57c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0097c0 tx=0x7f0d4c01c350 comp rx=0 tx=0).stop 2024-08-18T22:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d63c00640 1 -- 172.21.15.5:0/930868472 shutdown_connections 2024-08-18T22:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d63c00640 1 --2- 172.21.15.5:0/930868472 >> v2:172.21.15.117:3300/0 conn(0x7f0d5c071c90 0x7f0d5c15c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d63c00640 1 --2- 172.21.15.5:0/930868472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c15c180 0x7f0d5c0b57c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d63c00640 1 -- 172.21.15.5:0/930868472 >> 172.21.15.5:0/930868472 conn(0x7f0d5c0b3eb0 msgr2=0x7f0d5c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d63c00640 1 -- 172.21.15.5:0/930868472 shutdown_connections 2024-08-18T22:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.543+0000 7f0d63c00640 1 -- 172.21.15.5:0/930868472 wait complete. 2024-08-18T22:32:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d63c00640 1 Processor -- start 2024-08-18T22:32:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d63c00640 1 -- start start 2024-08-18T22:32:14.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d63c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c06fad0 0x7f0d5c153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d63c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c071c90 0x7f0d5c06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d63c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c15c180 0x7f0d5c06d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d63c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c0d1c30 con 0x7f0d5c15c180 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d63c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c0d1ab0 con 0x7f0d5c06fad0 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d63c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c0d1db0 con 0x7f0d5c071c90 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d61c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c15c180 0x7f0d5c06d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d61c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c15c180 0x7f0d5c06d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55342/0 (socket says 172.21.15.5:55342) 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d61200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c06fad0 0x7f0d5c153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d61c00640 1 -- 172.21.15.5:0/275487277 learned_addr learned my addr 172.21.15.5:0/275487277 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d53e00640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c071c90 0x7f0d5c06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d61c00640 1 -- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c071c90 msgr2=0x7f0d5c06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d61c00640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c071c90 0x7f0d5c06cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d61c00640 1 -- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c06fad0 msgr2=0x7f0d5c153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d61c00640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c06fad0 0x7f0d5c153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d61c00640 1 -- 172.21.15.5:0/275487277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c15b6d0 con 0x7f0d5c15c180 2024-08-18T22:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d61c00640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c15c180 0x7f0d5c06d000 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400efc0 tx=0x7f0d5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d59600640 1 -- 172.21.15.5:0/275487277 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54018020 con 0x7f0d5c15c180 2024-08-18T22:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d59600640 1 -- 172.21.15.5:0/275487277 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d54014480 con 0x7f0d5c15c180 2024-08-18T22:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d63c00640 1 -- 172.21.15.5:0/275487277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c0a9540 con 0x7f0d5c15c180 2024-08-18T22:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d59600640 1 -- 172.21.15.5:0/275487277 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54014870 con 0x7f0d5c15c180 2024-08-18T22:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d63c00640 1 -- 172.21.15.5:0/275487277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c0a9b00 con 0x7f0d5c15c180 2024-08-18T22:32:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.547+0000 7f0d63c00640 1 -- 172.21.15.5:0/275487277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5c15c560 con 0x7f0d5c15c180 2024-08-18T22:32:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.551+0000 7f0d59600640 1 -- 172.21.15.5:0/275487277 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d5401b020 con 0x7f0d5c15c180 2024-08-18T22:32:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.551+0000 7f0d59600640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d380678f0 0x7f0d38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.551+0000 7f0d59600640 1 -- 172.21.15.5:0/275487277 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f0d54086870 con 0x7f0d5c15c180 2024-08-18T22:32:14.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.551+0000 7f0d61200640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d380678f0 0x7f0d38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.551+0000 7f0d61200640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d380678f0 0x7f0d38069db0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0ae000 tx=0x7f0d4c0a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:14.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.555+0000 7f0d59600640 1 -- 172.21.15.5:0/275487277 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0d54022070 con 0x7f0d5c15c180 2024-08-18T22:32:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 -- 172.21.15.5:0/275487277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d5c0725e0 con 0x7f0d5c15c180 2024-08-18T22:32:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d59600640 1 -- 172.21.15.5:0/275487277 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5239 (secure 0 0 0) 0x7f0d54010040 con 0x7f0d5c15c180 2024-08-18T22:32:14.755 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:14.755 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":141,"btime":"2024-08-18T22:32:09:914521+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4068691051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4068691051},{"type":"v1","addr":"172.21.15.117:6836","nonce":4068691051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":9972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/4128479928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4128479928},{"type":"v1","addr":"172.21.15.5:6834","nonce":4128479928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":141,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:31:37.120589+0000","modified":"2024-08-18T22:32:09.914504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9981},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9975":{"gid":9975,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6835/1984562471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1984562471},{"type":"v1","addr":"172.21.15.5:6835","nonce":1984562471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9981":{"gid":9981,"name":"d","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/3224274565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3224274565},{"type":"v1","addr":"172.21.15.117:6837","nonce":3224274565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9981,"qdb_cluster":[9981]},"id":12}]} 2024-08-18T22:32:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 141 2024-08-18T22:32:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 -- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d380678f0 msgr2=0x7f0d38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d380678f0 0x7f0d38069db0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0ae000 tx=0x7f0d4c0a6070 comp rx=0 tx=0).stop 2024-08-18T22:32:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 -- 172.21.15.5:0/275487277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c15c180 msgr2=0x7f0d5c06d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c15c180 0x7f0d5c06d000 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400efc0 tx=0x7f0d5400c490 comp rx=0 tx=0).stop 2024-08-18T22:32:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 -- 172.21.15.5:0/275487277 shutdown_connections 2024-08-18T22:32:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0d380678f0 0x7f0d38069db0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c15c180 0x7f0d5c06d000 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d5c071c90 0x7f0d5c06cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 --2- 172.21.15.5:0/275487277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d5c06fad0 0x7f0d5c153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 -- 172.21.15.5:0/275487277 >> 172.21.15.5:0/275487277 conn(0x7f0d5c0b3eb0 msgr2=0x7f0d5c069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 -- 172.21.15.5:0/275487277 shutdown_connections 2024-08-18T22:32:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.755+0000 7f0d63c00640 1 -- 172.21.15.5:0/275487277 wait complete. 2024-08-18T22:32:14.776 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:32:14.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.915+0000 7f8803000640 1 Processor -- start 2024-08-18T22:32:14.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f8803000640 1 -- start start 2024-08-18T22:32:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f8803000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87fc161960 0x7f87fc06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f8803000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87fc070730 0x7f87fc070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f8803000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87fc15dda0 0x7f87fc15e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f8803000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f87fc0710e0 con 0x7f87fc070730 2024-08-18T22:32:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f8803000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f87fc15fcc0 con 0x7f87fc161960 2024-08-18T22:32:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f8803000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f87fc15eb60 con 0x7f87fc15dda0 2024-08-18T22:32:14.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f87fb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87fc070730 0x7f87fc070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f87fb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87fc070730 0x7f87fc070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55352/0 (socket says 172.21.15.5:55352) 2024-08-18T22:32:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f87fb400640 1 -- 172.21.15.5:0/2015786369 learned_addr learned my addr 172.21.15.5:0/2015786369 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f87fbe00640 1 --2- 172.21.15.5:0/2015786369 >> v2:172.21.15.117:3300/0 conn(0x7f87fc161960 0x7f87fc06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f8801000640 1 --2- 172.21.15.5:0/2015786369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87fc15dda0 0x7f87fc15e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f87fb400640 1 -- 172.21.15.5:0/2015786369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87fc15dda0 msgr2=0x7f87fc15e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:14.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f87fb400640 1 --2- 172.21.15.5:0/2015786369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87fc15dda0 0x7f87fc15e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f87fb400640 1 -- 172.21.15.5:0/2015786369 >> v2:172.21.15.117:3300/0 conn(0x7f87fc161960 msgr2=0x7f87fc06fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f87fb400640 1 --2- 172.21.15.5:0/2015786369 >> v2:172.21.15.117:3300/0 conn(0x7f87fc161960 0x7f87fc06fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f87fb400640 1 -- 172.21.15.5:0/2015786369 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc15ee40 con 0x7f87fc070730 2024-08-18T22:32:14.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.919+0000 7f8801000640 1 --2- 172.21.15.5:0/2015786369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87fc15dda0 0x7f87fc15e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:14.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f87fb400640 1 --2- 172.21.15.5:0/2015786369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87fc070730 0x7f87fc070ba0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f87fc073070 tx=0x7f87e801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4123d5ee2ad5ea36 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f87faa00640 1 -- 172.21.15.5:0/2015786369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e80b1070 con 0x7f87fc070730 2024-08-18T22:32:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f87faa00640 1 -- 172.21.15.5:0/2015786369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e80ac630 con 0x7f87fc070730 2024-08-18T22:32:14.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f87faa00640 1 -- 172.21.15.5:0/2015786369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e80a8050 con 0x7f87fc070730 2024-08-18T22:32:14.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f8803000640 1 -- 172.21.15.5:0/2015786369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87fc070730 msgr2=0x7f87fc070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f8803000640 1 --2- 172.21.15.5:0/2015786369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87fc070730 0x7f87fc070ba0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f87fc073070 tx=0x7f87e801c520 comp rx=0 tx=0).stop 2024-08-18T22:32:14.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f8803000640 1 -- 172.21.15.5:0/2015786369 shutdown_connections 2024-08-18T22:32:14.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f8803000640 1 --2- 172.21.15.5:0/2015786369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87fc15dda0 0x7f87fc15e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f8803000640 1 --2- 172.21.15.5:0/2015786369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87fc070730 0x7f87fc070ba0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f8803000640 1 --2- 172.21.15.5:0/2015786369 >> v2:172.21.15.117:3300/0 conn(0x7f87fc161960 0x7f87fc06fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f8803000640 1 -- 172.21.15.5:0/2015786369 >> 172.21.15.5:0/2015786369 conn(0x7f87fc0d2130 msgr2=0x7f87fc0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:14.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f8803000640 1 -- 172.21.15.5:0/2015786369 shutdown_connections 2024-08-18T22:32:14.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.923+0000 7f8803000640 1 -- 172.21.15.5:0/2015786369 wait complete. 2024-08-18T22:32:14.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8803000640 1 Processor -- start 2024-08-18T22:32:14.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8803000640 1 -- start start 2024-08-18T22:32:14.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8803000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87fc070730 0x7f87fc1fabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8803000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87fc15dda0 0x7f87fc1fb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8803000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87fc161960 0x7f87fc15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8803000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc09ba30 con 0x7f87fc161960 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8803000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc15e770 con 0x7f87fc15dda0 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8803000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f87fc15d990 con 0x7f87fc070730 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8801000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87fc161960 0x7f87fc15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8801000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87fc161960 0x7f87fc15c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55362/0 (socket says 172.21.15.5:55362) 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8801000640 1 -- 172.21.15.5:0/1053386498 learned_addr learned my addr 172.21.15.5:0/1053386498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f87fbe00640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87fc070730 0x7f87fc1fabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f87fb400640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87fc15dda0 0x7f87fc1fb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8801000640 1 -- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87fc070730 msgr2=0x7f87fc1fabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8801000640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87fc070730 0x7f87fc1fabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8801000640 1 -- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87fc15dda0 msgr2=0x7f87fc1fb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8801000640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87fc15dda0 0x7f87fc1fb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8801000640 1 -- 172.21.15.5:0/1053386498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc15e5a0 con 0x7f87fc161960 2024-08-18T22:32:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8801000640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87fc161960 0x7f87fc15c0a0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f87f4007e10 tx=0x7f87f400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f87f3e00640 1 -- 172.21.15.5:0/1053386498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f401a070 con 0x7f87fc161960 2024-08-18T22:32:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f87f3e00640 1 -- 172.21.15.5:0/1053386498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f4003ba0 con 0x7f87fc161960 2024-08-18T22:32:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f87f3e00640 1 -- 172.21.15.5:0/1053386498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4004030 con 0x7f87fc161960 2024-08-18T22:32:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8803000640 1 -- 172.21.15.5:0/1053386498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87fc15ce10 con 0x7f87fc161960 2024-08-18T22:32:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8803000640 1 -- 172.21.15.5:0/1053386498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87fc15d3d0 con 0x7f87fc161960 2024-08-18T22:32:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.927+0000 7f8803000640 1 -- 172.21.15.5:0/1053386498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87fc070ba0 con 0x7f87fc161960 2024-08-18T22:32:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.931+0000 7f87f3e00640 1 -- 172.21.15.5:0/1053386498 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87f401d070 con 0x7f87fc161960 2024-08-18T22:32:14.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.931+0000 7f87f3e00640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87dc0678c0 0x7f87dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:14.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.931+0000 7f87f3e00640 1 -- 172.21.15.5:0/1053386498 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f87f4086140 con 0x7f87fc161960 2024-08-18T22:32:14.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.931+0000 7f87fbe00640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87dc0678c0 0x7f87dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:14.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.931+0000 7f87fbe00640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87dc0678c0 0x7f87dc069d80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0cf8a0 tx=0x7f87ec009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:14.935+0000 7f87f3e00640 1 -- 172.21.15.5:0/1053386498 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f87f4010070 con 0x7f87fc161960 2024-08-18T22:32:15.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.131+0000 7f8803000640 1 -- 172.21.15.5:0/1053386498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87fc09bbb0 con 0x7f87fc161960 2024-08-18T22:32:15.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.131+0000 7f87f3e00640 1 -- 172.21.15.5:0/1053386498 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5239 (secure 0 0 0) 0x7f87f40563b0 con 0x7f87fc161960 2024-08-18T22:32:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:15.133 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":141,"btime":"2024-08-18T22:32:09:914521+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4068691051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4068691051},{"type":"v1","addr":"172.21.15.117:6836","nonce":4068691051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":9972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/4128479928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4128479928},{"type":"v1","addr":"172.21.15.5:6834","nonce":4128479928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":141,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-18T22:31:37.120589+0000","modified":"2024-08-18T22:32:09.914504+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9981},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9975":{"gid":9975,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6835/1984562471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1984562471},{"type":"v1","addr":"172.21.15.5:6835","nonce":1984562471}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9981":{"gid":9981,"name":"d","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/3224274565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3224274565},{"type":"v1","addr":"172.21.15.117:6837","nonce":3224274565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9981,"qdb_cluster":[9981]},"id":12}]} 2024-08-18T22:32:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 141 2024-08-18T22:32:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 -- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87dc0678c0 msgr2=0x7f87dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87dc0678c0 0x7f87dc069d80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0cf8a0 tx=0x7f87ec009190 comp rx=0 tx=0).stop 2024-08-18T22:32:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 -- 172.21.15.5:0/1053386498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87fc161960 msgr2=0x7f87fc15c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87fc161960 0x7f87fc15c0a0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f87f4007e10 tx=0x7f87f400d4a0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 -- 172.21.15.5:0/1053386498 shutdown_connections 2024-08-18T22:32:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f87dc0678c0 0x7f87dc069d80 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87fc161960 0x7f87fc15c0a0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87fc15dda0 0x7f87fc1fb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 --2- 172.21.15.5:0/1053386498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87fc070730 0x7f87fc1fabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 -- 172.21.15.5:0/1053386498 >> 172.21.15.5:0/1053386498 conn(0x7f87fc0d2130 msgr2=0x7f87fc0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 -- 172.21.15.5:0/1053386498 shutdown_connections 2024-08-18T22:32:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.135+0000 7f8803000640 1 -- 172.21.15.5:0/1053386498 wait complete. 2024-08-18T22:32:15.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:32:15.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b71800640 1 Processor -- start 2024-08-18T22:32:15.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b71800640 1 -- start start 2024-08-18T22:32:15.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b71800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b6c15c180 0x7f4b6c0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b71800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b6c06fad0 0x7f4b6c15c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b71800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b6c071580 0x7f4b6c071a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b71800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4b6c15caa0 con 0x7f4b6c15c180 2024-08-18T22:32:15.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b71800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4b6c0b5e30 con 0x7f4b6c071580 2024-08-18T22:32:15.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b71800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c0b6110 con 0x7f4b6c06fad0 2024-08-18T22:32:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b6aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b6c15c180 0x7f4b6c0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b6aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b6c15c180 0x7f4b6c0b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55366/0 (socket says 172.21.15.5:55366) 2024-08-18T22:32:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b6aa00640 1 -- 172.21.15.5:0/3836982929 learned_addr learned my addr 172.21.15.5:0/3836982929 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b6a000640 1 --2- 172.21.15.5:0/3836982929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b6c06fad0 0x7f4b6c15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b6b400640 1 --2- 172.21.15.5:0/3836982929 >> v2:172.21.15.117:3300/0 conn(0x7f4b6c071580 0x7f4b6c071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b6aa00640 1 -- 172.21.15.5:0/3836982929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b6c06fad0 msgr2=0x7f4b6c15c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b6aa00640 1 --2- 172.21.15.5:0/3836982929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b6c06fad0 0x7f4b6c15c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b6aa00640 1 -- 172.21.15.5:0/3836982929 >> v2:172.21.15.117:3300/0 conn(0x7f4b6c071580 msgr2=0x7f4b6c071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b6aa00640 1 --2- 172.21.15.5:0/3836982929 >> v2:172.21.15.117:3300/0 conn(0x7f4b6c071580 0x7f4b6c071a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.295+0000 7f4b6aa00640 1 -- 172.21.15.5:0/3836982929 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c0b63f0 con 0x7f4b6c15c180 2024-08-18T22:32:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b6aa00640 1 --2- 172.21.15.5:0/3836982929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15c180 0x7f4b6c0b57c0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c160cd0 tx=0x7f4b5c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37451e7a58c8cce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b69600640 1 -- 172.21.15.5:0/3836982929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0b0070 con 0x7f4b6c15c180 2024-08-18T22:32:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b69600640 1 -- 172.21.15.5:0/3836982929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b5c0ab600 con 0x7f4b6c15c180 2024-08-18T22:32:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b69600640 1 -- 172.21.15.5:0/3836982929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0ab9d0 con 0x7f4b6c15c180 2024-08-18T22:32:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b71800640 1 -- 172.21.15.5:0/3836982929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15c180 msgr2=0x7f4b6c0b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b71800640 1 --2- 172.21.15.5:0/3836982929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15c180 0x7f4b6c0b57c0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c160cd0 tx=0x7f4b5c01c400 comp rx=0 tx=0).stop 2024-08-18T22:32:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b71800640 1 -- 172.21.15.5:0/3836982929 shutdown_connections 2024-08-18T22:32:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b71800640 1 --2- 172.21.15.5:0/3836982929 >> v2:172.21.15.117:3300/0 conn(0x7f4b6c071580 0x7f4b6c071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b71800640 1 --2- 172.21.15.5:0/3836982929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b6c06fad0 0x7f4b6c15c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b71800640 1 --2- 172.21.15.5:0/3836982929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15c180 0x7f4b6c0b57c0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b71800640 1 -- 172.21.15.5:0/3836982929 >> 172.21.15.5:0/3836982929 conn(0x7f4b6c0b3eb0 msgr2=0x7f4b6c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b71800640 1 -- 172.21.15.5:0/3836982929 shutdown_connections 2024-08-18T22:32:15.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b71800640 1 -- 172.21.15.5:0/3836982929 wait complete. 2024-08-18T22:32:15.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.299+0000 7f4b71800640 1 Processor -- start 2024-08-18T22:32:15.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b71800640 1 -- start start 2024-08-18T22:32:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b71800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b6c06fad0 0x7f4b6c15eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b71800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b6c071580 0x7f4b6c147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b71800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15c180 0x7f4b6c1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b71800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c0d1c30 con 0x7f4b6c15c180 2024-08-18T22:32:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b71800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c0d1ab0 con 0x7f4b6c071580 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b71800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c0d1db0 con 0x7f4b6c06fad0 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b6b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15c180 0x7f4b6c1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b6b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15c180 0x7f4b6c1568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55382/0 (socket says 172.21.15.5:55382) 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b6b400640 1 -- 172.21.15.5:0/3892693489 learned_addr learned my addr 172.21.15.5:0/3892693489 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b6aa00640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b6c06fad0 0x7f4b6c15eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b6a000640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b6c071580 0x7f4b6c147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b6b400640 1 -- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b6c06fad0 msgr2=0x7f4b6c15eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b6b400640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b6c06fad0 0x7f4b6c15eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b6b400640 1 -- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b6c071580 msgr2=0x7f4b6c147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b6b400640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b6c071580 0x7f4b6c147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b6b400640 1 -- 172.21.15.5:0/3892693489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c153df0 con 0x7f4b6c15c180 2024-08-18T22:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b6b400640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15c180 0x7f4b6c1568b0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f4b64007e40 tx=0x7f4b6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:15.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b62a00640 1 -- 172.21.15.5:0/3892693489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64014620 con 0x7f4b6c15c180 2024-08-18T22:32:15.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b62a00640 1 -- 172.21.15.5:0/3892693489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b64019070 con 0x7f4b6c15c180 2024-08-18T22:32:15.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b62a00640 1 -- 172.21.15.5:0/3892693489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64014a20 con 0x7f4b6c15c180 2024-08-18T22:32:15.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b71800640 1 -- 172.21.15.5:0/3892693489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6c1540d0 con 0x7f4b6c15c180 2024-08-18T22:32:15.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b71800640 1 -- 172.21.15.5:0/3892693489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6c154690 con 0x7f4b6c15c180 2024-08-18T22:32:15.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.303+0000 7f4b71800640 1 -- 172.21.15.5:0/3892693489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6c15c560 con 0x7f4b6c15c180 2024-08-18T22:32:15.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.307+0000 7f4b62a00640 1 -- 172.21.15.5:0/3892693489 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b64014bc0 con 0x7f4b6c15c180 2024-08-18T22:32:15.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.307+0000 7f4b62a00640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b4c0678c0 0x7f4b4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.307+0000 7f4b62a00640 1 -- 172.21.15.5:0/3892693489 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7f4b64087480 con 0x7f4b6c15c180 2024-08-18T22:32:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.307+0000 7f4b6aa00640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b4c0678c0 0x7f4b4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.307+0000 7f4b6aa00640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b4c0678c0 0x7f4b4c069d80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0ad000 tx=0x7f4b5c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:15.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.311+0000 7f4b62a00640 1 -- 172.21.15.5:0/3892693489 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4b64057800 con 0x7f4b6c15c180 2024-08-18T22:32:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.475+0000 7f4b71800640 1 -- 172.21.15.5:0/3892693489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b6c0cf7d0 con 0x7f4b6c15c180 2024-08-18T22:32:15.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b62a00640 1 -- 172.21.15.5:0/3892693489 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) ==== 74+0+17016 (secure 0 0 0) 0x7f4b6405bb00 con 0x7f4b6c15c180 2024-08-18T22:32:15.478 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:15.479 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":179,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:32:05.890526+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:31:34.888000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-08-18T22:31:36.119247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.2","mappings":[{"from":1,"to":0}]},{"pgid":"26.b","mappings":[{"from":3,"to":0}]},{"pgid":"26.23","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:32:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 -- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b4c0678c0 msgr2=0x7f4b4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b4c0678c0 0x7f4b4c069d80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0ad000 tx=0x7f4b5c0a6000 comp rx=0 tx=0).stop 2024-08-18T22:32:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 -- 172.21.15.5:0/3892693489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15c180 msgr2=0x7f4b6c1568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15c180 0x7f4b6c1568b0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f4b64007e40 tx=0x7f4b6400e4b0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 -- 172.21.15.5:0/3892693489 shutdown_connections 2024-08-18T22:32:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4b4c0678c0 0x7f4b4c069d80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15c180 0x7f4b6c1568b0 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b6c071580 0x7f4b6c147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 --2- 172.21.15.5:0/3892693489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b6c06fad0 0x7f4b6c15eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 -- 172.21.15.5:0/3892693489 >> 172.21.15.5:0/3892693489 conn(0x7f4b6c0b3eb0 msgr2=0x7f4b6c151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 -- 172.21.15.5:0/3892693489 shutdown_connections 2024-08-18T22:32:15.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.479+0000 7f4b71800640 1 -- 172.21.15.5:0/3892693489 wait complete. 2024-08-18T22:32:15.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:32:15.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe724a00640 1 Processor -- start 2024-08-18T22:32:15.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe724a00640 1 -- start start 2024-08-18T22:32:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe724a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe72015d120 0x7fe7200b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe724a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72015d5b0 con 0x7fe7200b4650 2024-08-18T22:32:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe724a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7200b67e0 con 0x7fe720156770 2024-08-18T22:32:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe724a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe7200b4ac0 con 0x7fe72015d120 2024-08-18T22:32:15.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71f200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe7200b4650 0x7fe7200d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47364/0 (socket says 172.21.15.5:47364) 2024-08-18T22:32:15.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71f200640 1 -- 172.21.15.5:0/3401644842 learned_addr learned my addr 172.21.15.5:0/3401644842 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71de00640 1 --2- 172.21.15.5:0/3401644842 >> v2:172.21.15.117:3300/0 conn(0x7fe72015d120 0x7fe7200b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709593287 0 0) 0x7fe72015d5b0 con 0x7fe7200b4650 2024-08-18T22:32:15.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe704003530 con 0x7fe7200b4650 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2597929878 0 0) 0x7fe704003530 con 0x7fe7200b4650 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 >> v2:172.21.15.117:3300/0 conn(0x7fe72015d120 msgr2=0x7fe7200b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 --2- 172.21.15.5:0/3401644842 >> v2:172.21.15.117:3300/0 conn(0x7fe72015d120 0x7fe7200b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 >> v1:172.21.15.117:6789/0 conn(0x7fe720156770 legacy=0x7fe7200b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7200b6ac0 con 0x7fe7200b4650 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fe718001a00 con 0x7fe7200b4650 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 >> v1:172.21.15.5:6789/0 conn(0x7fe7200b4650 legacy=0x7fe7200d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704003a10 0x7fe704003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe704004810 0x7fe704004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704005220 0x7fe70400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe7200b4ac0 con 0x7fe704005220 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe70400c170 con 0x7fe704003a10 2024-08-18T22:32:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe70400c370 con 0x7fe704004810 2024-08-18T22:32:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71f200640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704005220 0x7fe70400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71e800640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704003a10 0x7fe704003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71de00640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe704004810 0x7fe704004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71f200640 1 -- 172.21.15.5:0/3401644842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe704004810 msgr2=0x7fe704004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71f200640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe704004810 0x7fe704004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71f200640 1 -- 172.21.15.5:0/3401644842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704003a10 msgr2=0x7fe704003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71f200640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704003a10 0x7fe704003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71f200640 1 -- 172.21.15.5:0/3401644842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe704003530 con 0x7fe704005220 2024-08-18T22:32:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.643+0000 7fe71de00640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe704004810 0x7fe704004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe71f200640 1 -- 172.21.15.5:0/3401644842 reap_dead start 2024-08-18T22:32:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe71f200640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704005220 0x7fe70400b9d0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fe71800a760 tx=0x7fe71801f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3281e22810468eab server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71800a3b0 con 0x7fe704005220 2024-08-18T22:32:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7180ac470 con 0x7fe704005220 2024-08-18T22:32:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe71d400640 1 -- 172.21.15.5:0/3401644842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7180ac860 con 0x7fe704005220 2024-08-18T22:32:15.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe724a00640 1 -- 172.21.15.5:0/3401644842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704005220 msgr2=0x7fe70400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe724a00640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704005220 0x7fe70400b9d0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fe71800a760 tx=0x7fe71801f9c0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe724a00640 1 -- 172.21.15.5:0/3401644842 shutdown_connections 2024-08-18T22:32:15.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe724a00640 1 --2- 172.21.15.5:0/3401644842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704005220 0x7fe70400b9d0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe724a00640 1 -- 172.21.15.5:0/3401644842 >> 172.21.15.5:0/3401644842 conn(0x7fe720067a70 msgr2=0x7fe720067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:15.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe724a00640 1 -- 172.21.15.5:0/3401644842 shutdown_connections 2024-08-18T22:32:15.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.647+0000 7fe724a00640 1 -- 172.21.15.5:0/3401644842 wait complete. 2024-08-18T22:32:15.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe724a00640 1 Processor -- start 2024-08-18T22:32:15.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe724a00640 1 -- start start 2024-08-18T22:32:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe724a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704005220 0x7fe720146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe724a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe720159a00 0x7fe72014d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe724a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe720150a90 0x7fe72014ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe724a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe7200b7080 con 0x7fe720159a00 2024-08-18T22:32:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe724a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe720156b50 con 0x7fe704005220 2024-08-18T22:32:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe724a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe7200b7360 con 0x7fe720150a90 2024-08-18T22:32:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe71de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe720159a00 0x7fe72014d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe71de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe720159a00 0x7fe72014d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55400/0 (socket says 172.21.15.5:55400) 2024-08-18T22:32:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe71de00640 1 -- 172.21.15.5:0/1739594055 learned_addr learned my addr 172.21.15.5:0/1739594055 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe71e800640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704005220 0x7fe720146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe71f200640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe720150a90 0x7fe72014ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe71de00640 1 -- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe720150a90 msgr2=0x7fe72014ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe71de00640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe720150a90 0x7fe72014ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe71de00640 1 -- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704005220 msgr2=0x7fe720146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe71de00640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704005220 0x7fe720146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe71de00640 1 -- 172.21.15.5:0/1739594055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe720156e00 con 0x7fe720159a00 2024-08-18T22:32:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe71de00640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe720159a00 0x7fe72014d3c0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009160 tx=0x7fe70c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe716a00640 1 -- 172.21.15.5:0/1739594055 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c004220 con 0x7fe720159a00 2024-08-18T22:32:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe716a00640 1 -- 172.21.15.5:0/1739594055 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70c0043c0 con 0x7fe720159a00 2024-08-18T22:32:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe716a00640 1 -- 172.21.15.5:0/1739594055 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c015890 con 0x7fe720159a00 2024-08-18T22:32:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe724a00640 1 -- 172.21.15.5:0/1739594055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7201570e0 con 0x7fe720159a00 2024-08-18T22:32:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.651+0000 7fe724a00640 1 -- 172.21.15.5:0/1739594055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7201576a0 con 0x7fe720159a00 2024-08-18T22:32:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.655+0000 7fe724a00640 1 -- 172.21.15.5:0/1739594055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72014e830 con 0x7fe720159a00 2024-08-18T22:32:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.655+0000 7fe716a00640 1 -- 172.21.15.5:0/1739594055 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe70c015a30 con 0x7fe720159a00 2024-08-18T22:32:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.655+0000 7fe716a00640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe7000678f0 0x7fe700069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.655+0000 7fe716a00640 1 -- 172.21.15.5:0/1739594055 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6188+0+0 (secure 0 0 0) 0x7fe70c0863f0 con 0x7fe720159a00 2024-08-18T22:32:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.655+0000 7fe71e800640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe7000678f0 0x7fe700069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.655+0000 7fe71e800640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe7000678f0 0x7fe700069db0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe710007fd0 tx=0x7fe710009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:15.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.659+0000 7fe716a00640 1 -- 172.21.15.5:0/1739594055 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe70c019030 con 0x7fe720159a00 2024-08-18T22:32:15.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.859+0000 7fe724a00640 1 -- 172.21.15.5:0/1739594055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe7200d1120 con 0x7fe720159a00 2024-08-18T22:32:15.860 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:32:15.859+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:32:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe716a00640 1 -- 172.21.15.5:0/1739594055 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v142) ==== 161+0+0 (secure 0 0 0) 0x7fe70c0566f0 con 0x7fe720159a00 2024-08-18T22:32:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:32:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 -- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe7000678f0 msgr2=0x7fe700069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe7000678f0 0x7fe700069db0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe710007fd0 tx=0x7fe710009040 comp rx=0 tx=0).stop 2024-08-18T22:32:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 -- 172.21.15.5:0/1739594055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe720159a00 msgr2=0x7fe72014d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe720159a00 0x7fe72014d3c0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009160 tx=0x7fe70c011a60 comp rx=0 tx=0).stop 2024-08-18T22:32:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 -- 172.21.15.5:0/1739594055 shutdown_connections 2024-08-18T22:32:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe7000678f0 0x7fe700069db0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe720150a90 0x7fe72014ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe720159a00 0x7fe72014d3c0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 --2- 172.21.15.5:0/1739594055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704005220 0x7fe720146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 -- 172.21.15.5:0/1739594055 >> 172.21.15.5:0/1739594055 conn(0x7fe720067a70 msgr2=0x7fe7200d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 -- 172.21.15.5:0/1739594055 shutdown_connections 2024-08-18T22:32:15.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:15.863+0000 7fe724a00640 1 -- 172.21.15.5:0/1739594055 wait complete. 2024-08-18T22:32:15.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:32:15.930 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:32:15.938 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:32:16.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.031+0000 7f615e400640 1 Processor -- start 2024-08-18T22:32:16.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.031+0000 7f615e400640 1 -- start start 2024-08-18T22:32:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615e400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6158156770 0x7f615815d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615e400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61580b6020 0x7f61580b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580b4650 0x7f615806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615e400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f61580b4ac0 con 0x7f6158156770 2024-08-18T22:32:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615e400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6158156b50 con 0x7f61580b6020 2024-08-18T22:32:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f61580b67e0 con 0x7f61580b4650 2024-08-18T22:32:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615d000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6158156770 0x7f615815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615d000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6158156770 0x7f615815d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55432/0 (socket says 172.21.15.5:55432) 2024-08-18T22:32:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615d000640 1 -- 172.21.15.5:0/3023984504 learned_addr learned my addr 172.21.15.5:0/3023984504 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615da00640 1 --2- 172.21.15.5:0/3023984504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580b4650 0x7f615806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:16.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f614fe00640 1 --2- 172.21.15.5:0/3023984504 >> v2:172.21.15.117:3300/0 conn(0x7f61580b6020 0x7f61580b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:16.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615d000640 1 -- 172.21.15.5:0/3023984504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580b4650 msgr2=0x7f615806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:16.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615d000640 1 --2- 172.21.15.5:0/3023984504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580b4650 0x7f615806fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615d000640 1 -- 172.21.15.5:0/3023984504 >> v2:172.21.15.117:3300/0 conn(0x7f61580b6020 msgr2=0x7f61580b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:16.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615d000640 1 --2- 172.21.15.5:0/3023984504 >> v2:172.21.15.117:3300/0 conn(0x7f61580b6020 0x7f61580b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615d000640 1 -- 172.21.15.5:0/3023984504 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61580b6ac0 con 0x7f6158156770 2024-08-18T22:32:16.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f614fe00640 1 --2- 172.21.15.5:0/3023984504 >> v2:172.21.15.117:3300/0 conn(0x7f61580b6020 0x7f61580b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:16.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.035+0000 7f615da00640 1 --2- 172.21.15.5:0/3023984504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580b4650 0x7f615806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615d000640 1 --2- 172.21.15.5:0/3023984504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158156770 0x7f615815d120 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f61580d1c00 tx=0x7f614801c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f73bb80507ce11 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f6157e00640 1 -- 172.21.15.5:0/3023984504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61480b0070 con 0x7f6158156770 2024-08-18T22:32:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f6157e00640 1 -- 172.21.15.5:0/3023984504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61480ab600 con 0x7f6158156770 2024-08-18T22:32:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f6157e00640 1 -- 172.21.15.5:0/3023984504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61480ab9d0 con 0x7f6158156770 2024-08-18T22:32:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615e400640 1 -- 172.21.15.5:0/3023984504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158156770 msgr2=0x7f615815d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615e400640 1 --2- 172.21.15.5:0/3023984504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158156770 0x7f615815d120 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f61580d1c00 tx=0x7f614801c1d0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615e400640 1 -- 172.21.15.5:0/3023984504 shutdown_connections 2024-08-18T22:32:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615e400640 1 --2- 172.21.15.5:0/3023984504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580b4650 0x7f615806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615e400640 1 --2- 172.21.15.5:0/3023984504 >> v2:172.21.15.117:3300/0 conn(0x7f61580b6020 0x7f61580b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615e400640 1 --2- 172.21.15.5:0/3023984504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158156770 0x7f615815d120 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615e400640 1 -- 172.21.15.5:0/3023984504 >> 172.21.15.5:0/3023984504 conn(0x7f6158067a70 msgr2=0x7f6158067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:16.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615e400640 1 -- 172.21.15.5:0/3023984504 shutdown_connections 2024-08-18T22:32:16.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615e400640 1 -- 172.21.15.5:0/3023984504 wait complete. 2024-08-18T22:32:16.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615e400640 1 Processor -- start 2024-08-18T22:32:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.039+0000 7f615e400640 1 -- start start 2024-08-18T22:32:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615e400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580b4650 0x7f61581f9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61580b6020 0x7f615815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615e400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6158156770 0x7f615815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615e400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f61580b6430 con 0x7f61580b6020 2024-08-18T22:32:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615e400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f61580d01b0 con 0x7f6158156770 2024-08-18T22:32:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615e400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6158158500 con 0x7f61580b4650 2024-08-18T22:32:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f614fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61580b6020 0x7f615815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615da00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6158156770 0x7f615815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615d000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580b4650 0x7f61581f9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f614fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61580b6020 0x7f615815a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55442/0 (socket says 172.21.15.5:55442) 2024-08-18T22:32:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615da00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6158156770 0x7f615815ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:35456/0 (socket says 172.21.15.5:35456) 2024-08-18T22:32:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f614fe00640 1 -- 172.21.15.5:0/1936288346 learned_addr learned my addr 172.21.15.5:0/1936288346 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f614fe00640 1 -- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580b4650 msgr2=0x7f61581f9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f614fe00640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580b4650 0x7f61581f9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f614fe00640 1 -- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6158156770 msgr2=0x7f615815ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f614fe00640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6158156770 0x7f615815ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f614fe00640 1 -- 172.21.15.5:0/1936288346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61581578f0 con 0x7f61580b6020 2024-08-18T22:32:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f614fe00640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61580b6020 0x7f615815a810 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f614000e810 tx=0x7f614000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f6155600640 1 -- 172.21.15.5:0/1936288346 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140017070 con 0x7f61580b6020 2024-08-18T22:32:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f6155600640 1 -- 172.21.15.5:0/1936288346 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614000c8d0 con 0x7f61580b6020 2024-08-18T22:32:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f6155600640 1 -- 172.21.15.5:0/1936288346 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614000f040 con 0x7f61580b6020 2024-08-18T22:32:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615e400640 1 -- 172.21.15.5:0/1936288346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6158157bd0 con 0x7f61580b6020 2024-08-18T22:32:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615e400640 1 -- 172.21.15.5:0/1936288346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6158158190 con 0x7f61580b6020 2024-08-18T22:32:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f615e400640 1 -- 172.21.15.5:0/1936288346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f615815d440 con 0x7f61580b6020 2024-08-18T22:32:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.043+0000 7f6155600640 1 -- 172.21.15.5:0/1936288346 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f614001a070 con 0x7f61580b6020 2024-08-18T22:32:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.047+0000 7f6155600640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 0x7f6134069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.047+0000 7f6155600640 1 -- 172.21.15.5:0/1936288346 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6274+0+0 (secure 0 0 0) 0x7f61400859e0 con 0x7f61580b6020 2024-08-18T22:32:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.047+0000 7f615d000640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 0x7f6134069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.047+0000 7f615d000640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 0x7f6134069d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f61480ad000 tx=0x7f61480a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:16.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.051+0000 7f6155600640 1 -- 172.21.15.5:0/1936288346 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6140055c80 con 0x7f61580b6020 2024-08-18T22:32:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.251+0000 7f615e400640 1 -- 172.21.15.5:0/1936288346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f61580b27e0 con 0x7f61580b6020 2024-08-18T22:32:16.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.931+0000 7f6155600640 1 -- 172.21.15.5:0/1936288346 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v143) ==== 104+0+0 (secure 0 0 0) 0x7f6140059f80 con 0x7f61580b6020 2024-08-18T22:32:16.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 -- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 msgr2=0x7f6134069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:16.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 0x7f6134069d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f61480ad000 tx=0x7f61480a6000 comp rx=0 tx=0).stop 2024-08-18T22:32:16.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 -- 172.21.15.5:0/1936288346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61580b6020 msgr2=0x7f615815a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:16.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61580b6020 0x7f615815a810 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f614000e810 tx=0x7f614000ecd0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 -- 172.21.15.5:0/1936288346 shutdown_connections 2024-08-18T22:32:16.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f61340678c0 0x7f6134069d80 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6158156770 0x7f615815ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61580b6020 0x7f615815a810 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 --2- 172.21.15.5:0/1936288346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61580b4650 0x7f61581f9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:16.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 -- 172.21.15.5:0/1936288346 >> 172.21.15.5:0/1936288346 conn(0x7f6158067a70 msgr2=0x7f61580b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:16.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 -- 172.21.15.5:0/1936288346 shutdown_connections 2024-08-18T22:32:16.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:16.935+0000 7f615e400640 1 -- 172.21.15.5:0/1936288346 wait complete. 2024-08-18T22:32:16.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:32:17.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.151+0000 7f8cb2c00640 1 Processor -- start 2024-08-18T22:32:17.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.151+0000 7f8cb2c00640 1 -- start start 2024-08-18T22:32:17.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8cac15e1f0 0x7f8cac0d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:17.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac0b6850 0x7f8cac162810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:17.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cac0d2ac0 con 0x7f8cac0d25c0 2024-08-18T22:32:17.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8cac162d50 con 0x7f8cac15e1f0 2024-08-18T22:32:17.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8cac0d2da0 con 0x7f8cac0b6850 2024-08-18T22:32:17.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac0b6850 0x7f8cac162810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:17.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac0b6850 0x7f8cac162810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:37648/0 (socket says 172.21.15.5:37648) 2024-08-18T22:32:17.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb1800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8cac15e1f0 0x7f8cac0d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:17.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2200640 1 -- 172.21.15.5:0/404320881 learned_addr learned my addr 172.21.15.5:0/404320881 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:17.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2200640 1 -- 172.21.15.5:0/404320881 >> v2:172.21.15.117:3300/0 conn(0x7f8cac15e1f0 msgr2=0x7f8cac0d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:17.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2200640 1 --2- 172.21.15.5:0/404320881 >> v2:172.21.15.117:3300/0 conn(0x7f8cac15e1f0 0x7f8cac0d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:17.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2200640 1 -- 172.21.15.5:0/404320881 >> v1:172.21.15.117:6789/0 conn(0x7f8cac0d25c0 legacy=0x7f8cac0b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:17.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb2200640 1 -- 172.21.15.5:0/404320881 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac0d3080 con 0x7f8cac0b6850 2024-08-18T22:32:17.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.155+0000 7f8cb1800640 1 --2- 172.21.15.5:0/404320881 >> v2:172.21.15.117:3300/0 conn(0x7f8cac15e1f0 0x7f8cac0d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:32:17.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cb2200640 1 --2- 172.21.15.5:0/404320881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac0b6850 0x7f8cac162810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009e50 tx=0x7f8ca401f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36b78f773f7a5a78 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:17.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cabe00640 1 -- 172.21.15.5:0/404320881 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40b4070 con 0x7f8cac0b6850 2024-08-18T22:32:17.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cabe00640 1 -- 172.21.15.5:0/404320881 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca40af400 con 0x7f8cac0b6850 2024-08-18T22:32:17.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cabe00640 1 -- 172.21.15.5:0/404320881 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40af7d0 con 0x7f8cac0b6850 2024-08-18T22:32:17.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cb2c00640 1 -- 172.21.15.5:0/404320881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac0b6850 msgr2=0x7f8cac162810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:17.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cb2c00640 1 --2- 172.21.15.5:0/404320881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac0b6850 0x7f8cac162810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009e50 tx=0x7f8ca401f210 comp rx=0 tx=0).stop 2024-08-18T22:32:17.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cb2c00640 1 -- 172.21.15.5:0/404320881 shutdown_connections 2024-08-18T22:32:17.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cb2c00640 1 --2- 172.21.15.5:0/404320881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac0b6850 0x7f8cac162810 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:17.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cb2c00640 1 --2- 172.21.15.5:0/404320881 >> v2:172.21.15.117:3300/0 conn(0x7f8cac15e1f0 0x7f8cac0d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:17.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cb2c00640 1 -- 172.21.15.5:0/404320881 >> 172.21.15.5:0/404320881 conn(0x7f8cac0d45a0 msgr2=0x7f8cac0d49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:17.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cb2c00640 1 -- 172.21.15.5:0/404320881 shutdown_connections 2024-08-18T22:32:17.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cb2c00640 1 -- 172.21.15.5:0/404320881 wait complete. 2024-08-18T22:32:17.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cb2c00640 1 Processor -- start 2024-08-18T22:32:17.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.159+0000 7f8cb2c00640 1 -- start start 2024-08-18T22:32:17.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb2c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cac0b6850 0x7f8cac0b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:17.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb2c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cac0d25c0 0x7f8cac1612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:17.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb2c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac15e1f0 0x7f8cac0cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:17.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb2c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac15e5d0 con 0x7f8cac0d25c0 2024-08-18T22:32:17.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb2c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac0d3640 con 0x7f8cac0b6850 2024-08-18T22:32:17.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb2c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8cac15e750 con 0x7f8cac15e1f0 2024-08-18T22:32:17.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cac0d25c0 0x7f8cac1612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:17.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb0e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cac0d25c0 0x7f8cac1612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55458/0 (socket says 172.21.15.5:55458) 2024-08-18T22:32:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb0e00640 1 -- 172.21.15.5:0/2152060938 learned_addr learned my addr 172.21.15.5:0/2152060938 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb1800640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cac0b6850 0x7f8cac0b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb2200640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac15e1f0 0x7f8cac0cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb0e00640 1 -- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac15e1f0 msgr2=0x7f8cac0cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb0e00640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac15e1f0 0x7f8cac0cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb0e00640 1 -- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cac0b6850 msgr2=0x7f8cac0b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb0e00640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cac0b6850 0x7f8cac0b9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:17.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb0e00640 1 -- 172.21.15.5:0/2152060938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac15fb30 con 0x7f8cac0d25c0 2024-08-18T22:32:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb0e00640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cac0d25c0 0x7f8cac1612e0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800c420 tx=0x7f8c9800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8ca9600640 1 -- 172.21.15.5:0/2152060938 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c980052d0 con 0x7f8cac0d25c0 2024-08-18T22:32:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8ca9600640 1 -- 172.21.15.5:0/2152060938 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c98005470 con 0x7f8cac0d25c0 2024-08-18T22:32:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8ca9600640 1 -- 172.21.15.5:0/2152060938 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98007260 con 0x7f8cac0d25c0 2024-08-18T22:32:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb2c00640 1 -- 172.21.15.5:0/2152060938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cac15fe10 con 0x7f8cac0d25c0 2024-08-18T22:32:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb2c00640 1 -- 172.21.15.5:0/2152060938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cac1603d0 con 0x7f8cac0d25c0 2024-08-18T22:32:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8cb2c00640 1 -- 172.21.15.5:0/2152060938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cac162810 con 0x7f8cac0d25c0 2024-08-18T22:32:17.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.163+0000 7f8ca9600640 1 -- 172.21.15.5:0/2152060938 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c98007400 con 0x7f8cac0d25c0 2024-08-18T22:32:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.167+0000 7f8ca9600640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c8c0678c0 0x7f8c8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.167+0000 7f8ca9600640 1 -- 172.21.15.5:0/2152060938 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 6274+0+0 (secure 0 0 0) 0x7f8c98085bf0 con 0x7f8cac0d25c0 2024-08-18T22:32:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.167+0000 7f8cb1800640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c8c0678c0 0x7f8c8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.167+0000 7f8cb1800640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c8c0678c0 0x7f8c8c069d80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009580 tx=0x7f8ca0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:17.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.167+0000 7f8ca9600640 1 -- 172.21.15.5:0/2152060938 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8c98055e80 con 0x7f8cac0d25c0 2024-08-18T22:32:17.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.335+0000 7f8cb2c00640 1 -- 172.21.15.5:0/2152060938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8cac0d1e90 con 0x7f8cac0d25c0 2024-08-18T22:32:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.943+0000 7f8ca9600640 1 -- 172.21.15.5:0/2152060938 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v181) ==== 181+0+0 (secure 0 0 0) 0x7f8c9805a180 con 0x7f8cac0d25c0 2024-08-18T22:32:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:32:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 -- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c8c0678c0 msgr2=0x7f8c8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c8c0678c0 0x7f8c8c069d80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009580 tx=0x7f8ca0009190 comp rx=0 tx=0).stop 2024-08-18T22:32:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 -- 172.21.15.5:0/2152060938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cac0d25c0 msgr2=0x7f8cac1612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cac0d25c0 0x7f8cac1612e0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800c420 tx=0x7f8c9800c8e0 comp rx=0 tx=0).stop 2024-08-18T22:32:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 -- 172.21.15.5:0/2152060938 shutdown_connections 2024-08-18T22:32:17.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8c8c0678c0 0x7f8c8c069d80 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cac15e1f0 0x7f8cac0cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cac0d25c0 0x7f8cac1612e0 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 --2- 172.21.15.5:0/2152060938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cac0b6850 0x7f8cac0b9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 -- 172.21.15.5:0/2152060938 >> 172.21.15.5:0/2152060938 conn(0x7f8cac0d45a0 msgr2=0x7f8cac15c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 -- 172.21.15.5:0/2152060938 shutdown_connections 2024-08-18T22:32:17.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:17.947+0000 7f8cb2c00640 1 -- 172.21.15.5:0/2152060938 wait complete. 2024-08-18T22:32:17.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:32:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.119+0000 7fe2ac000640 1 Processor -- start 2024-08-18T22:32:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.119+0000 7fe2ac000640 1 -- start start 2024-08-18T22:32:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2ac000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe2a415f900 0x7fe2a40d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2ac000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a4070e50 0x7fe2a40d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2ac000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a409b5f0 con 0x7fe2a40ce5d0 2024-08-18T22:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2ac000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a415fce0 con 0x7fe2a415f900 2024-08-18T22:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2ac000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a4071a90 con 0x7fe2a4070e50 2024-08-18T22:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a8c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe2a40ce5d0 0x7fe2a40ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47380/0 (socket says 172.21.15.5:47380) 2024-08-18T22:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a8c00640 1 -- 172.21.15.5:0/738467968 learned_addr learned my addr 172.21.15.5:0/738467968 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2aa000640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a4070e50 0x7fe2a40d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a9600640 1 --2- 172.21.15.5:0/738467968 >> v2:172.21.15.117:3300/0 conn(0x7fe2a415f900 0x7fe2a40d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848653427 0 0) 0x7fe2a409b5f0 con 0x7fe2a40ce5d0 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe28c003530 con 0x7fe2a40ce5d0 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3876652145 0 0) 0x7fe28c003530 con 0x7fe2a40ce5d0 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a4070e50 msgr2=0x7fe2a40d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a4070e50 0x7fe2a40d06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 >> v2:172.21.15.117:3300/0 conn(0x7fe2a415f900 msgr2=0x7fe2a40d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 --2- 172.21.15.5:0/738467968 >> v2:172.21.15.117:3300/0 conn(0x7fe2a415f900 0x7fe2a40d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a4071d70 con 0x7fe2a40ce5d0 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fe290001680 con 0x7fe2a40ce5d0 2024-08-18T22:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 >> v1:172.21.15.5:6789/0 conn(0x7fe2a40ce5d0 legacy=0x7fe2a40ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28c0039c0 0x7fe28c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 0x7fe28c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c0051d0 0x7fe28c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a415fce0 con 0x7fe28c004810 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a4071a90 con 0x7fe28c0039c0 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe28c010320 con 0x7fe28c0051d0 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a9600640 1 --2- 172.21.15.5:0/738467968 >> v2:172.21.15.117:3300/0 conn(0x7fe2a415f900 0x7fe2a40d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2aa000640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a4070e50 0x7fe2a40d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a8c00640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 0x7fe28c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2aa000640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c0051d0 0x7fe28c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a9600640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28c0039c0 0x7fe28c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a8c00640 1 -- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c0051d0 msgr2=0x7fe28c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:18.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a8c00640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c0051d0 0x7fe28c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a8c00640 1 -- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28c0039c0 msgr2=0x7fe28c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a8c00640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28c0039c0 0x7fe28c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2a8c00640 1 -- 172.21.15.5:0/738467968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c003530 con 0x7fe28c004810 2024-08-18T22:32:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.123+0000 7fe2aa000640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c0051d0 0x7fe28c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.127+0000 7fe2a8c00640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 0x7fe28c004c90 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c210 tx=0x7fe29001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb66d190691b01b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:18.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.127+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290007d40 con 0x7fe28c004810 2024-08-18T22:32:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.127+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2900a9070 con 0x7fe28c004810 2024-08-18T22:32:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.127+0000 7fe2a3e00640 1 -- 172.21.15.5:0/738467968 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2900a5e00 con 0x7fe28c004810 2024-08-18T22:32:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.127+0000 7fe2ac000640 1 -- 172.21.15.5:0/738467968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 msgr2=0x7fe28c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.127+0000 7fe2ac000640 1 --2- 172.21.15.5:0/738467968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 0x7fe28c004c90 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c210 tx=0x7fe29001cca0 comp rx=0 tx=0).stop 2024-08-18T22:32:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.127+0000 7fe2aa000640 1 -- 172.21.15.5:0/738467968 reap_dead start 2024-08-18T22:32:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.127+0000 7fe2ac000640 1 -- 172.21.15.5:0/738467968 shutdown_connections 2024-08-18T22:32:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.127+0000 7fe2ac000640 1 -- 172.21.15.5:0/738467968 >> 172.21.15.5:0/738467968 conn(0x7fe2a40d2110 msgr2=0x7fe2a40d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.127+0000 7fe2ac000640 1 -- 172.21.15.5:0/738467968 shutdown_connections 2024-08-18T22:32:18.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.127+0000 7fe2ac000640 1 -- 172.21.15.5:0/738467968 wait complete. 2024-08-18T22:32:18.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2ac000640 1 Processor -- start 2024-08-18T22:32:18.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2ac000640 1 -- start start 2024-08-18T22:32:18.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2ac000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 0x7fe2a41ef790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2ac000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a40cbd60 0x7fe2a415ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2ac000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a40cce20 0x7fe2a40cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2ac000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a40cca80 con 0x7fe28c004810 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2ac000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a40cc900 con 0x7fe2a40cbd60 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2ac000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a40d06c0 con 0x7fe2a40cce20 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a9600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 0x7fe2a41ef790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a9600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 0x7fe2a41ef790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55462/0 (socket says 172.21.15.5:55462) 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a9600640 1 -- 172.21.15.5:0/147064621 learned_addr learned my addr 172.21.15.5:0/147064621 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a8c00640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a40cbd60 0x7fe2a415ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2aa000640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a40cce20 0x7fe2a40cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a9600640 1 -- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a40cce20 msgr2=0x7fe2a40cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a9600640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a40cce20 0x7fe2a40cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:18.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a9600640 1 -- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a40cbd60 msgr2=0x7fe2a415ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a9600640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a40cbd60 0x7fe2a415ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a9600640 1 -- 172.21.15.5:0/147064621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a40c6d30 con 0x7fe28c004810 2024-08-18T22:32:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2aa000640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a40cce20 0x7fe2a40cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a8c00640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a40cbd60 0x7fe2a415ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:18.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a9600640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 0x7fe2a41ef790 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fe298011480 tx=0x7fe298011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a1600640 1 -- 172.21.15.5:0/147064621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29801a020 con 0x7fe28c004810 2024-08-18T22:32:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a1600640 1 -- 172.21.15.5:0/147064621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe298016680 con 0x7fe28c004810 2024-08-18T22:32:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2a1600640 1 -- 172.21.15.5:0/147064621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298016a50 con 0x7fe28c004810 2024-08-18T22:32:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2ac000640 1 -- 172.21.15.5:0/147064621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a41efdd0 con 0x7fe28c004810 2024-08-18T22:32:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2ac000640 1 -- 172.21.15.5:0/147064621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a41f0390 con 0x7fe28c004810 2024-08-18T22:32:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.131+0000 7fe2ac000640 1 -- 172.21.15.5:0/147064621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a40d0a20 con 0x7fe28c004810 2024-08-18T22:32:18.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.135+0000 7fe2a1600640 1 -- 172.21.15.5:0/147064621 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe29801d020 con 0x7fe28c004810 2024-08-18T22:32:18.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.135+0000 7fe2a1600640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2840678f0 0x7fe284069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:18.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.135+0000 7fe2a1600640 1 -- 172.21.15.5:0/147064621 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5836+0+0 (secure 0 0 0) 0x7fe298086e40 con 0x7fe28c004810 2024-08-18T22:32:18.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.135+0000 7fe2a8c00640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2840678f0 0x7fe284069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:18.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.135+0000 7fe2a8c00640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2840678f0 0x7fe284069db0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ab000 tx=0x7fe2900b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:18.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.139+0000 7fe2a1600640 1 -- 172.21.15.5:0/147064621 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe298024030 con 0x7fe28c004810 2024-08-18T22:32:18.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.307+0000 7fe2ac000640 1 -- 172.21.15.5:0/147064621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe2a406d460 con 0x7fe28c004810 2024-08-18T22:32:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2a1600640 1 -- 172.21.15.5:0/147064621 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v182) ==== 169+0+0 (secure 0 0 0) 0x7fe2980578f0 con 0x7fe28c004810 2024-08-18T22:32:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:32:18.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2ac000640 1 -- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2840678f0 msgr2=0x7fe284069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2ac000640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2840678f0 0x7fe284069db0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ab000 tx=0x7fe2900b1040 comp rx=0 tx=0).stop 2024-08-18T22:32:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2ac000640 1 -- 172.21.15.5:0/147064621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 msgr2=0x7fe2a41ef790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2ac000640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 0x7fe2a41ef790 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fe298011480 tx=0x7fe298011940 comp rx=0 tx=0).stop 2024-08-18T22:32:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2ac000640 1 -- 172.21.15.5:0/147064621 shutdown_connections 2024-08-18T22:32:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2ac000640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2840678f0 0x7fe284069db0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2ac000640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a40cce20 0x7fe2a40cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2ac000640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a40cbd60 0x7fe2a415ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2ac000640 1 --2- 172.21.15.5:0/147064621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28c004810 0x7fe2a41ef790 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2ac000640 1 -- 172.21.15.5:0/147064621 >> 172.21.15.5:0/147064621 conn(0x7fe2a40d2110 msgr2=0x7fe2a409ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.947+0000 7fe2ac000640 1 -- 172.21.15.5:0/147064621 shutdown_connections 2024-08-18T22:32:18.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:18.951+0000 7fe2ac000640 1 -- 172.21.15.5:0/147064621 wait complete. 2024-08-18T22:32:18.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:32:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb731800640 1 Processor -- start 2024-08-18T22:32:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb731800640 1 -- start start 2024-08-18T22:32:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb731800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb72c0b1300 0x7fb72c162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb731800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c09b080 0x7fb72c0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb731800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c06e8a0 con 0x7fb72c09aca0 2024-08-18T22:32:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb731800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb72c09bb80 con 0x7fb72c0b1300 2024-08-18T22:32:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb731800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c0d2e40 con 0x7fb72c09b080 2024-08-18T22:32:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb72aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb72c09aca0 0x7fb72c0afa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47390/0 (socket says 172.21.15.5:47390) 2024-08-18T22:32:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb72aa00640 1 -- 172.21.15.5:0/2763630827 learned_addr learned my addr 172.21.15.5:0/2763630827 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb722000640 1 --2- 172.21.15.5:0/2763630827 >> v2:172.21.15.117:3300/0 conn(0x7fb72c0b1300 0x7fb72c162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb72b400640 1 --2- 172.21.15.5:0/2763630827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c09b080 0x7fb72c0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb72a000640 1 -- 172.21.15.5:0/2763630827 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729517141 0 0) 0x7fb72c06e8a0 con 0x7fb72c09aca0 2024-08-18T22:32:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb72a000640 1 -- 172.21.15.5:0/2763630827 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb710003530 con 0x7fb72c09aca0 2024-08-18T22:32:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb722000640 1 -- 172.21.15.5:0/2763630827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c09b080 msgr2=0x7fb72c0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb722000640 1 --2- 172.21.15.5:0/2763630827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c09b080 0x7fb72c0b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb722000640 1 -- 172.21.15.5:0/2763630827 >> v1:172.21.15.5:6789/0 conn(0x7fb72c09aca0 legacy=0x7fb72c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.123+0000 7fb722000640 1 -- 172.21.15.5:0/2763630827 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c06cbd0 con 0x7fb72c0b1300 2024-08-18T22:32:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb722000640 1 --2- 172.21.15.5:0/2763630827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c0b1300 0x7fb72c162950 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb7140097c0 tx=0x7fb71401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fe74cf5353e5241 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb72a000640 1 -- 172.21.15.5:0/2763630827 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140b1070 con 0x7fb72c0b1300 2024-08-18T22:32:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb72a000640 1 -- 172.21.15.5:0/2763630827 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7140ac410 con 0x7fb72c0b1300 2024-08-18T22:32:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb72a000640 1 -- 172.21.15.5:0/2763630827 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140ac7e0 con 0x7fb72c0b1300 2024-08-18T22:32:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb731800640 1 -- 172.21.15.5:0/2763630827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c0b1300 msgr2=0x7fb72c162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb731800640 1 --2- 172.21.15.5:0/2763630827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c0b1300 0x7fb72c162950 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb7140097c0 tx=0x7fb71401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb731800640 1 -- 172.21.15.5:0/2763630827 shutdown_connections 2024-08-18T22:32:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb731800640 1 --2- 172.21.15.5:0/2763630827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c09b080 0x7fb72c0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb731800640 1 --2- 172.21.15.5:0/2763630827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c0b1300 0x7fb72c162950 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb731800640 1 -- 172.21.15.5:0/2763630827 >> 172.21.15.5:0/2763630827 conn(0x7fb72c0d2180 msgr2=0x7fb72c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb731800640 1 -- 172.21.15.5:0/2763630827 shutdown_connections 2024-08-18T22:32:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.127+0000 7fb731800640 1 -- 172.21.15.5:0/2763630827 wait complete. 2024-08-18T22:32:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb731800640 1 Processor -- start 2024-08-18T22:32:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb731800640 1 -- start start 2024-08-18T22:32:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb731800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c09aca0 0x7fb72c0b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb731800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c09b080 0x7fb72c152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb731800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c0b1300 0x7fb72c0b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb731800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c16bcb0 con 0x7fb72c09b080 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb731800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c16bb30 con 0x7fb72c09aca0 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb731800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c16be30 con 0x7fb72c0b1300 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb722000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c09b080 0x7fb72c152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb722000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c09b080 0x7fb72c152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55470/0 (socket says 172.21.15.5:55470) 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb72aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c09aca0 0x7fb72c0b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb722000640 1 -- 172.21.15.5:0/2010882221 learned_addr learned my addr 172.21.15.5:0/2010882221 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb72b400640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c0b1300 0x7fb72c0b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb722000640 1 -- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c0b1300 msgr2=0x7fb72c0b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb722000640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c0b1300 0x7fb72c0b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb722000640 1 -- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c09aca0 msgr2=0x7fb72c0b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb722000640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c09aca0 0x7fb72c0b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb722000640 1 -- 172.21.15.5:0/2010882221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c0b7260 con 0x7fb72c09b080 2024-08-18T22:32:19.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb722000640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c09b080 0x7fb72c152b60 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fb7140097c0 tx=0x7fb714019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:19.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb723400640 1 -- 172.21.15.5:0/2010882221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140bb020 con 0x7fb72c09b080 2024-08-18T22:32:19.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb723400640 1 -- 172.21.15.5:0/2010882221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7140accc0 con 0x7fb72c09b080 2024-08-18T22:32:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb731800640 1 -- 172.21.15.5:0/2010882221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c0d10a0 con 0x7fb72c09b080 2024-08-18T22:32:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb723400640 1 -- 172.21.15.5:0/2010882221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140b1040 con 0x7fb72c09b080 2024-08-18T22:32:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb731800640 1 -- 172.21.15.5:0/2010882221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c0b5220 con 0x7fb72c09b080 2024-08-18T22:32:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.131+0000 7fb731800640 1 -- 172.21.15.5:0/2010882221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c0afa90 con 0x7fb72c09b080 2024-08-18T22:32:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.135+0000 7fb723400640 1 -- 172.21.15.5:0/2010882221 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7140be020 con 0x7fb72c09b080 2024-08-18T22:32:19.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.135+0000 7fb723400640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb7080678f0 0x7fb708069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:19.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.135+0000 7fb723400640 1 -- 172.21.15.5:0/2010882221 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7fb71411f880 con 0x7fb72c09b080 2024-08-18T22:32:19.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.135+0000 7fb72aa00640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb7080678f0 0x7fb708069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:19.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.135+0000 7fb72aa00640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb7080678f0 0x7fb708069db0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb71c005c10 tx=0x7fb71c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:19.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.139+0000 7fb723400640 1 -- 172.21.15.5:0/2010882221 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb7140c5030 con 0x7fb72c09b080 2024-08-18T22:32:19.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.343+0000 7fb731800640 1 -- 172.21.15.5:0/2010882221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb72c162b30 con 0x7fb72c09b080 2024-08-18T22:32:19.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.347+0000 7fb723400640 1 -- 172.21.15.5:0/2010882221 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) ==== 104+0+0 (secure 0 0 0) 0x7fb72c0b7260 con 0x7fb72c09b080 2024-08-18T22:32:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 -- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb7080678f0 msgr2=0x7fb708069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb7080678f0 0x7fb708069db0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb71c005c10 tx=0x7fb71c009040 comp rx=0 tx=0).stop 2024-08-18T22:32:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 -- 172.21.15.5:0/2010882221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c09b080 msgr2=0x7fb72c152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c09b080 0x7fb72c152b60 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fb7140097c0 tx=0x7fb714019240 comp rx=0 tx=0).stop 2024-08-18T22:32:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 -- 172.21.15.5:0/2010882221 shutdown_connections 2024-08-18T22:32:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb7080678f0 0x7fb708069db0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb72c0b1300 0x7fb72c0b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72c09b080 0x7fb72c152b60 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 --2- 172.21.15.5:0/2010882221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb72c09aca0 0x7fb72c0b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 -- 172.21.15.5:0/2010882221 >> 172.21.15.5:0/2010882221 conn(0x7fb72c0d2180 msgr2=0x7fb72c0af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 -- 172.21.15.5:0/2010882221 shutdown_connections 2024-08-18T22:32:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.351+0000 7fb731800640 1 -- 172.21.15.5:0/2010882221 wait complete. 2024-08-18T22:32:19.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-08-18T22:32:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.547+0000 7f7e5fc00640 1 Processor -- start 2024-08-18T22:32:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.547+0000 7f7e5fc00640 1 -- start start 2024-08-18T22:32:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.547+0000 7f7e5fc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e580afe50 0x7f7e580b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.547+0000 7f7e5fc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e580b6310 con 0x7f7e580b5e60 2024-08-18T22:32:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.547+0000 7f7e5fc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e580b65d0 con 0x7f7e5815e140 2024-08-18T22:32:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.547+0000 7f7e5fc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5806e560 con 0x7f7e580afe50 2024-08-18T22:32:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.547+0000 7f7e5dc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7e580b5e60 0x7f7e5806efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47396/0 (socket says 172.21.15.5:47396) 2024-08-18T22:32:19.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.547+0000 7f7e5dc00640 1 -- 172.21.15.5:0/850103107 learned_addr learned my addr 172.21.15.5:0/850103107 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.551+0000 7f7e57e00640 1 --2- 172.21.15.5:0/850103107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e580afe50 0x7f7e580b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.551+0000 7f7e57400640 1 -- 172.21.15.5:0/850103107 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 490230307 0 0) 0x7f7e580b6310 con 0x7f7e580b5e60 2024-08-18T22:32:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.551+0000 7f7e57400640 1 -- 172.21.15.5:0/850103107 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e3c003530 con 0x7f7e580b5e60 2024-08-18T22:32:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.551+0000 7f7e57400640 1 -- 172.21.15.5:0/850103107 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960229037 0 0) 0x7f7e580b65d0 con 0x7f7e5815e140 2024-08-18T22:32:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.551+0000 7f7e57e00640 1 -- 172.21.15.5:0/850103107 >> v1:172.21.15.117:6789/0 conn(0x7f7e5815e140 legacy=0x7f7e580af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.551+0000 7f7e57e00640 1 -- 172.21.15.5:0/850103107 >> v1:172.21.15.5:6789/0 conn(0x7f7e580b5e60 legacy=0x7f7e5806efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.551+0000 7f7e57e00640 1 -- 172.21.15.5:0/850103107 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e580b68b0 con 0x7f7e580afe50 2024-08-18T22:32:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.551+0000 7f7e57e00640 1 --2- 172.21.15.5:0/850103107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e580afe50 0x7f7e580b4e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e440097f0 tx=0x7f7e4401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dfbc5b8c0f69bf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.551+0000 7f7e57400640 1 -- 172.21.15.5:0/850103107 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e440ab650 con 0x7f7e580afe50 2024-08-18T22:32:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.551+0000 7f7e57400640 1 -- 172.21.15.5:0/850103107 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e440b0070 con 0x7f7e580afe50 2024-08-18T22:32:19.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.551+0000 7f7e57400640 1 -- 172.21.15.5:0/850103107 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e440aba10 con 0x7f7e580afe50 2024-08-18T22:32:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 -- 172.21.15.5:0/850103107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e580afe50 msgr2=0x7f7e580b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 --2- 172.21.15.5:0/850103107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e580afe50 0x7f7e580b4e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e440097f0 tx=0x7f7e4401c450 comp rx=0 tx=0).stop 2024-08-18T22:32:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 -- 172.21.15.5:0/850103107 shutdown_connections 2024-08-18T22:32:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 --2- 172.21.15.5:0/850103107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e580afe50 0x7f7e580b4e40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 -- 172.21.15.5:0/850103107 >> 172.21.15.5:0/850103107 conn(0x7f7e5806b9b0 msgr2=0x7f7e5806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 -- 172.21.15.5:0/850103107 shutdown_connections 2024-08-18T22:32:19.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 -- 172.21.15.5:0/850103107 wait complete. 2024-08-18T22:32:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 Processor -- start 2024-08-18T22:32:19.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 -- start start 2024-08-18T22:32:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e580afe50 0x7f7e58157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e580b5e60 0x7f7e580cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e5815e140 0x7f7e58155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:19.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7e58070050 con 0x7f7e580b5e60 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5806fed0 con 0x7f7e580afe50 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5fc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7e58158000 con 0x7f7e5815e140 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e57e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e580b5e60 0x7f7e580cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e57e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e580b5e60 0x7f7e580cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55480/0 (socket says 172.21.15.5:55480) 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e57e00640 1 -- 172.21.15.5:0/3714403634 learned_addr learned my addr 172.21.15.5:0/3714403634 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5d200640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e580afe50 0x7f7e58157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e5dc00640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e5815e140 0x7f7e58155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e57e00640 1 -- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e5815e140 msgr2=0x7f7e58155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e57e00640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e5815e140 0x7f7e58155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e57e00640 1 -- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e580afe50 msgr2=0x7f7e58157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e57e00640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e580afe50 0x7f7e58157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.555+0000 7f7e57e00640 1 -- 172.21.15.5:0/3714403634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e580d02a0 con 0x7f7e580b5e60 2024-08-18T22:32:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.559+0000 7f7e57e00640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e580b5e60 0x7f7e580cfd60 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f7e440ad040 tx=0x7f7e4401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.559+0000 7f7e54c00640 1 -- 172.21.15.5:0/3714403634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e440bf610 con 0x7f7e580b5e60 2024-08-18T22:32:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.559+0000 7f7e54c00640 1 -- 172.21.15.5:0/3714403634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e440bf7b0 con 0x7f7e580b5e60 2024-08-18T22:32:19.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.559+0000 7f7e5fc00640 1 -- 172.21.15.5:0/3714403634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5813e130 con 0x7f7e580b5e60 2024-08-18T22:32:19.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.559+0000 7f7e54c00640 1 -- 172.21.15.5:0/3714403634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e440bfba0 con 0x7f7e580b5e60 2024-08-18T22:32:19.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.559+0000 7f7e5fc00640 1 -- 172.21.15.5:0/3714403634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e58158530 con 0x7f7e580b5e60 2024-08-18T22:32:19.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.559+0000 7f7e5fc00640 1 -- 172.21.15.5:0/3714403634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e580b4e40 con 0x7f7e580b5e60 2024-08-18T22:32:19.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.559+0000 7f7e54c00640 1 -- 172.21.15.5:0/3714403634 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e440bd020 con 0x7f7e580b5e60 2024-08-18T22:32:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.559+0000 7f7e54c00640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e380678f0 0x7f7e38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.559+0000 7f7e54c00640 1 -- 172.21.15.5:0/3714403634 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7f7e441203b0 con 0x7f7e580b5e60 2024-08-18T22:32:19.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.559+0000 7f7e5d200640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e380678f0 0x7f7e38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:19.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.563+0000 7f7e5d200640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e380678f0 0x7f7e38069db0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7e48000f70 tx=0x7f7e48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:19.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.563+0000 7f7e54c00640 1 -- 172.21.15.5:0/3714403634 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7e440160d0 con 0x7f7e580b5e60 2024-08-18T22:32:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.791+0000 7f7e5fc00640 1 -- 172.21.15.5:0/3714403634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f7e580d06c0 con 0x7f7e580b5e60 2024-08-18T22:32:19.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e54c00640 1 -- 172.21.15.5:0/3714403634 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v614) ==== 159+0+0 (secure 0 0 0) 0x7f7e440f10f0 con 0x7f7e580b5e60 2024-08-18T22:32:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 -- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e380678f0 msgr2=0x7f7e38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e380678f0 0x7f7e38069db0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7e48000f70 tx=0x7f7e48009040 comp rx=0 tx=0).stop 2024-08-18T22:32:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 -- 172.21.15.5:0/3714403634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e580b5e60 msgr2=0x7f7e580cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e580b5e60 0x7f7e580cfd60 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f7e440ad040 tx=0x7f7e4401ac90 comp rx=0 tx=0).stop 2024-08-18T22:32:19.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 -- 172.21.15.5:0/3714403634 shutdown_connections 2024-08-18T22:32:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7e380678f0 0x7f7e38069db0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e5815e140 0x7f7e58155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e580b5e60 0x7f7e580cfd60 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 --2- 172.21.15.5:0/3714403634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e580afe50 0x7f7e58157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 -- 172.21.15.5:0/3714403634 >> 172.21.15.5:0/3714403634 conn(0x7f7e5806b9b0 msgr2=0x7f7e5806c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 -- 172.21.15.5:0/3714403634 shutdown_connections 2024-08-18T22:32:19.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:19.955+0000 7f7e5fc00640 1 -- 172.21.15.5:0/3714403634 wait complete. 2024-08-18T22:32:19.976 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-08-18T22:32:19.976 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-08-18T22:32:19.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:32:20.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.115+0000 7f2fc1400640 1 Processor -- start 2024-08-18T22:32:20.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fc1400640 1 -- start start 2024-08-18T22:32:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fc1400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc0ce610 0x7f2fbc09b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fc1400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fbc09b8b0 0x7f2fbc0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fc1400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fbc0cff50 con 0x7f2fbc15ff60 2024-08-18T22:32:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fc1400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2fbc0cfd00 con 0x7f2fbc09b8b0 2024-08-18T22:32:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fc1400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc0d0230 con 0x7f2fbc0ce610 2024-08-18T22:32:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fba800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2fbc15ff60 0x7f2fbc160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47400/0 (socket says 172.21.15.5:47400) 2024-08-18T22:32:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fba800640 1 -- 172.21.15.5:0/427033230 learned_addr learned my addr 172.21.15.5:0/427033230 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fbb200640 1 --2- 172.21.15.5:0/427033230 >> v2:172.21.15.5:3300/0 conn(0x7f2fbc09b8b0 0x7f2fbc0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fb3e00640 1 --2- 172.21.15.5:0/427033230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc0ce610 0x7f2fbc09b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fb9e00640 1 -- 172.21.15.5:0/427033230 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614518279 0 0) 0x7f2fbc0cff50 con 0x7f2fbc15ff60 2024-08-18T22:32:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fbb200640 1 -- 172.21.15.5:0/427033230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc0ce610 msgr2=0x7f2fbc09b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fbb200640 1 --2- 172.21.15.5:0/427033230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc0ce610 0x7f2fbc09b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fbb200640 1 -- 172.21.15.5:0/427033230 >> v1:172.21.15.5:6789/0 conn(0x7f2fbc15ff60 legacy=0x7f2fbc160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fbb200640 1 -- 172.21.15.5:0/427033230 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc09ab70 con 0x7f2fbc09b8b0 2024-08-18T22:32:20.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.119+0000 7f2fb3e00640 1 --2- 172.21.15.5:0/427033230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc0ce610 0x7f2fbc09b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:20.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fbb200640 1 --2- 172.21.15.5:0/427033230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc09b8b0 0x7f2fbc0ccc10 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009d90 tx=0x7f2fb401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3168db27f075878b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:20.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fb9e00640 1 -- 172.21.15.5:0/427033230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40b2070 con 0x7f2fbc09b8b0 2024-08-18T22:32:20.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fb9e00640 1 -- 172.21.15.5:0/427033230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb40a5710 con 0x7f2fbc09b8b0 2024-08-18T22:32:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fb9e00640 1 -- 172.21.15.5:0/427033230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40a5ae0 con 0x7f2fbc09b8b0 2024-08-18T22:32:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fc1400640 1 -- 172.21.15.5:0/427033230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc09b8b0 msgr2=0x7f2fbc0ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fc1400640 1 --2- 172.21.15.5:0/427033230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc09b8b0 0x7f2fbc0ccc10 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009d90 tx=0x7f2fb401c850 comp rx=0 tx=0).stop 2024-08-18T22:32:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fc1400640 1 -- 172.21.15.5:0/427033230 shutdown_connections 2024-08-18T22:32:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fc1400640 1 --2- 172.21.15.5:0/427033230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc09b8b0 0x7f2fbc0ccc10 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fc1400640 1 --2- 172.21.15.5:0/427033230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc0ce610 0x7f2fbc09b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fc1400640 1 -- 172.21.15.5:0/427033230 >> 172.21.15.5:0/427033230 conn(0x7f2fbc0d2130 msgr2=0x7f2fbc0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:20.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fc1400640 1 -- 172.21.15.5:0/427033230 shutdown_connections 2024-08-18T22:32:20.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fc1400640 1 -- 172.21.15.5:0/427033230 wait complete. 2024-08-18T22:32:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fc1400640 1 Processor -- start 2024-08-18T22:32:20.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.123+0000 7f2fc1400640 1 -- start start 2024-08-18T22:32:20.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fc1400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc09b8b0 0x7f2fbc0b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fc1400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fbc0ce610 0x7f2fbc06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fc1400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc15ff60 0x7f2fbc070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fc1400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc169850 con 0x7f2fbc15ff60 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fc1400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc0cd560 con 0x7f2fbc0ce610 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fc1400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc1699d0 con 0x7f2fbc09b8b0 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fbb200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc15ff60 0x7f2fbc070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fbb200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc15ff60 0x7f2fbc070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55504/0 (socket says 172.21.15.5:55504) 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fbb200640 1 -- 172.21.15.5:0/1688099336 learned_addr learned my addr 172.21.15.5:0/1688099336 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fba800640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc09b8b0 0x7f2fbc0b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fbb200640 1 -- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc09b8b0 msgr2=0x7f2fbc0b72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fb3e00640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fbc0ce610 0x7f2fbc06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fbb200640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc09b8b0 0x7f2fbc0b72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fbb200640 1 -- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fbc0ce610 msgr2=0x7f2fbc06fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fbb200640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fbc0ce610 0x7f2fbc06fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fbb200640 1 -- 172.21.15.5:0/1688099336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc0b7d20 con 0x7f2fbc15ff60 2024-08-18T22:32:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fba800640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc09b8b0 0x7f2fbc0b72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fb3e00640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fbc0ce610 0x7f2fbc06fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fbb200640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc15ff60 0x7f2fbc070260 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40b0040 tx=0x7f2fb40195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fb2a00640 1 -- 172.21.15.5:0/1688099336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40b2050 con 0x7f2fbc15ff60 2024-08-18T22:32:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fb2a00640 1 -- 172.21.15.5:0/1688099336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb40b3040 con 0x7f2fbc15ff60 2024-08-18T22:32:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fb2a00640 1 -- 172.21.15.5:0/1688099336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40ad650 con 0x7f2fbc15ff60 2024-08-18T22:32:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fc1400640 1 -- 172.21.15.5:0/1688099336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fbc0b5ac0 con 0x7f2fbc15ff60 2024-08-18T22:32:20.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fc1400640 1 -- 172.21.15.5:0/1688099336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fbc0b6080 con 0x7f2fbc15ff60 2024-08-18T22:32:20.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fc1400640 1 -- 172.21.15.5:0/1688099336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fbc0cff50 con 0x7f2fbc15ff60 2024-08-18T22:32:20.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.127+0000 7f2fb2a00640 1 -- 172.21.15.5:0/1688099336 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2fb40c0020 con 0x7f2fbc15ff60 2024-08-18T22:32:20.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.131+0000 7f2fb2a00640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f980678c0 0x7f2f98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.131+0000 7f2fb2a00640 1 -- 172.21.15.5:0/1688099336 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7f2fb4120240 con 0x7f2fbc15ff60 2024-08-18T22:32:20.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.131+0000 7f2fba800640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f980678c0 0x7f2f98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.131+0000 7f2fba800640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f980678c0 0x7f2f98069d80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2fac000f70 tx=0x7f2fac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:20.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.135+0000 7f2fb2a00640 1 -- 172.21.15.5:0/1688099336 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2fb40c7020 con 0x7f2fbc15ff60 2024-08-18T22:32:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.299+0000 7f2fc1400640 1 -- 172.21.15.5:0/1688099336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fbc0d0f90 con 0x7f2fbc15ff60 2024-08-18T22:32:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fb2a00640 1 -- 172.21.15.5:0/1688099336 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+13233 (secure 0 0 0) 0x7f2fb4016560 con 0x7f2fbc15ff60 2024-08-18T22:32:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:20.302 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":182,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:32:18.947939+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6837/3224274565":"2024-08-19T22:32:15.865215+0000","172.21.15.117:6835/3224274565":"2024-08-19T22:32:15.865215+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:32:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 -- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f980678c0 msgr2=0x7f2f98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f980678c0 0x7f2f98069d80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2fac000f70 tx=0x7f2fac009040 comp rx=0 tx=0).stop 2024-08-18T22:32:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 -- 172.21.15.5:0/1688099336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc15ff60 msgr2=0x7f2fbc070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc15ff60 0x7f2fbc070260 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40b0040 tx=0x7f2fb40195f0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 -- 172.21.15.5:0/1688099336 shutdown_connections 2024-08-18T22:32:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2f980678c0 0x7f2f98069d80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fbc15ff60 0x7f2fbc070260 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fbc0ce610 0x7f2fbc06fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 --2- 172.21.15.5:0/1688099336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fbc09b8b0 0x7f2fbc0b72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 -- 172.21.15.5:0/1688099336 >> 172.21.15.5:0/1688099336 conn(0x7f2fbc0d2130 msgr2=0x7f2fbc15c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 -- 172.21.15.5:0/1688099336 shutdown_connections 2024-08-18T22:32:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.303+0000 7f2fc1400640 1 -- 172.21.15.5:0/1688099336 wait complete. 2024-08-18T22:32:20.323 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:32:20.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:32:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.467+0000 7ff918400640 1 Processor -- start 2024-08-18T22:32:20.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.467+0000 7ff918400640 1 -- start start 2024-08-18T22:32:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.467+0000 7ff918400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9100b40c0 0x7ff9100b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.467+0000 7ff918400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff9100ce280 0x7ff9100ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.467+0000 7ff918400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9100b31f0 con 0x7ff91015b0c0 2024-08-18T22:32:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff918400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff9100b3d70 con 0x7ff9100ce280 2024-08-18T22:32:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff918400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff9100b4a40 con 0x7ff9100b40c0 2024-08-18T22:32:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff915000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9100b40c0 0x7ff9100b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff916400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff9100ce280 0x7ff9100ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff915000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9100b40c0 0x7ff9100b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:37748/0 (socket says 172.21.15.5:37748) 2024-08-18T22:32:20.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff915000640 1 -- 172.21.15.5:0/1989706273 learned_addr learned my addr 172.21.15.5:0/1989706273 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff915000640 1 -- 172.21.15.5:0/1989706273 >> v2:172.21.15.117:3300/0 conn(0x7ff9100ce280 msgr2=0x7ff9100ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff915000640 1 --2- 172.21.15.5:0/1989706273 >> v2:172.21.15.117:3300/0 conn(0x7ff9100ce280 0x7ff9100ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff915000640 1 -- 172.21.15.5:0/1989706273 >> v1:172.21.15.117:6789/0 conn(0x7ff91015b0c0 legacy=0x7ff91006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff915000640 1 -- 172.21.15.5:0/1989706273 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9100b34d0 con 0x7ff9100b40c0 2024-08-18T22:32:20.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff916400640 1 --2- 172.21.15.5:0/1989706273 >> v2:172.21.15.117:3300/0 conn(0x7ff9100ce280 0x7ff9100ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:32:20.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.471+0000 7ff915000640 1 --2- 172.21.15.5:0/1989706273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9100b40c0 0x7ff9100b4500 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009870 tx=0x7ff8fc01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88f5a99a4ccf2c8b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:20.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff90fe00640 1 -- 172.21.15.5:0/1989706273 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0b0070 con 0x7ff9100b40c0 2024-08-18T22:32:20.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff90fe00640 1 -- 172.21.15.5:0/1989706273 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8fc0ab600 con 0x7ff9100b40c0 2024-08-18T22:32:20.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff90fe00640 1 -- 172.21.15.5:0/1989706273 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0ab9d0 con 0x7ff9100b40c0 2024-08-18T22:32:20.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 -- 172.21.15.5:0/1989706273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9100b40c0 msgr2=0x7ff9100b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 --2- 172.21.15.5:0/1989706273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9100b40c0 0x7ff9100b4500 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009870 tx=0x7ff8fc01c440 comp rx=0 tx=0).stop 2024-08-18T22:32:20.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 -- 172.21.15.5:0/1989706273 shutdown_connections 2024-08-18T22:32:20.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 --2- 172.21.15.5:0/1989706273 >> v2:172.21.15.117:3300/0 conn(0x7ff9100ce280 0x7ff9100ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 --2- 172.21.15.5:0/1989706273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9100b40c0 0x7ff9100b4500 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 -- 172.21.15.5:0/1989706273 >> 172.21.15.5:0/1989706273 conn(0x7ff9100b1dc0 msgr2=0x7ff9100b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:20.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 -- 172.21.15.5:0/1989706273 shutdown_connections 2024-08-18T22:32:20.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 -- 172.21.15.5:0/1989706273 wait complete. 2024-08-18T22:32:20.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 Processor -- start 2024-08-18T22:32:20.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 -- start start 2024-08-18T22:32:20.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9100b40c0 0x7ff9101496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9100ce280 0x7ff91015e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff91015b0c0 0x7ff9100ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff91006f7f0 con 0x7ff9100b40c0 2024-08-18T22:32:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff91006f670 con 0x7ff9100ce280 2024-08-18T22:32:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff918400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff910165d00 con 0x7ff91015b0c0 2024-08-18T22:32:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff915a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9100b40c0 0x7ff9101496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff915a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9100b40c0 0x7ff9101496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55518/0 (socket says 172.21.15.5:55518) 2024-08-18T22:32:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.475+0000 7ff915a00640 1 -- 172.21.15.5:0/465634114 learned_addr learned my addr 172.21.15.5:0/465634114 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff916400640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff91015b0c0 0x7ff9100ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff915000640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9100ce280 0x7ff91015e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff915a00640 1 -- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff91015b0c0 msgr2=0x7ff9100ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff915a00640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff91015b0c0 0x7ff9100ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff915a00640 1 -- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9100ce280 msgr2=0x7ff91015e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff915a00640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9100ce280 0x7ff91015e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff915a00640 1 -- 172.21.15.5:0/465634114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff910167b00 con 0x7ff9100b40c0 2024-08-18T22:32:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff915a00640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9100b40c0 0x7ff9101496a0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7ff90400c3c0 tx=0x7ff90400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff90d600640 1 -- 172.21.15.5:0/465634114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904017070 con 0x7ff9100b40c0 2024-08-18T22:32:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff90d600640 1 -- 172.21.15.5:0/465634114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9040052d0 con 0x7ff9100b40c0 2024-08-18T22:32:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff90d600640 1 -- 172.21.15.5:0/465634114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904003840 con 0x7ff9100b40c0 2024-08-18T22:32:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff918400640 1 -- 172.21.15.5:0/465634114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff910167de0 con 0x7ff9100b40c0 2024-08-18T22:32:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff918400640 1 -- 172.21.15.5:0/465634114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9101683a0 con 0x7ff9100b40c0 2024-08-18T22:32:20.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff918400640 1 -- 172.21.15.5:0/465634114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9100b4500 con 0x7ff9100b40c0 2024-08-18T22:32:20.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff90d600640 1 -- 172.21.15.5:0/465634114 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff90401a070 con 0x7ff9100b40c0 2024-08-18T22:32:20.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff90d600640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8f00678c0 0x7ff8f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.479+0000 7ff90d600640 1 -- 172.21.15.5:0/465634114 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7ff904084ec0 con 0x7ff9100b40c0 2024-08-18T22:32:20.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.483+0000 7ff915000640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8f00678c0 0x7ff8f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.483+0000 7ff915000640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8f00678c0 0x7ff8f0069d80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0ad000 tx=0x7ff8fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:20.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.487+0000 7ff90d600640 1 -- 172.21.15.5:0/465634114 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff904005480 con 0x7ff9100b40c0 2024-08-18T22:32:20.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.651+0000 7ff918400640 1 -- 172.21.15.5:0/465634114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff91014e880 con 0x7ff9100b40c0 2024-08-18T22:32:20.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.651+0000 7ff90d600640 1 -- 172.21.15.5:0/465634114 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v182) ==== 93+0+10 (secure 0 0 0) 0x7ff904055480 con 0x7ff9100b40c0 2024-08-18T22:32:20.653 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 -- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8f00678c0 msgr2=0x7ff8f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8f00678c0 0x7ff8f0069d80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0ad000 tx=0x7ff8fc008040 comp rx=0 tx=0).stop 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 -- 172.21.15.5:0/465634114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9100b40c0 msgr2=0x7ff9101496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9100b40c0 0x7ff9101496a0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7ff90400c3c0 tx=0x7ff90400c7c0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 -- 172.21.15.5:0/465634114 shutdown_connections 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff8f00678c0 0x7ff8f0069d80 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff91015b0c0 0x7ff9100ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9100ce280 0x7ff91015e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 --2- 172.21.15.5:0/465634114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9100b40c0 0x7ff9101496a0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 -- 172.21.15.5:0/465634114 >> 172.21.15.5:0/465634114 conn(0x7ff9100b1dc0 msgr2=0x7ff91006db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 -- 172.21.15.5:0/465634114 shutdown_connections 2024-08-18T22:32:20.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.655+0000 7ff918400640 1 -- 172.21.15.5:0/465634114 wait complete. 2024-08-18T22:32:20.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-08-18T22:32:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.815+0000 7feab3200640 1 Processor -- start 2024-08-18T22:32:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.815+0000 7feab3200640 1 -- start start 2024-08-18T22:32:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab409b520 0x7feab415f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab3200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab409b980 con 0x7feab40d02a0 2024-08-18T22:32:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab3200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab406fe70 con 0x7feab4070510 2024-08-18T22:32:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feab415f670 con 0x7feab409b520 2024-08-18T22:32:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab2800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feab40d02a0 0x7feab40d0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47416/0 (socket says 172.21.15.5:47416) 2024-08-18T22:32:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab2800640 1 -- 172.21.15.5:0/509301818 learned_addr learned my addr 172.21.15.5:0/509301818 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:20.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feaa9400640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab409b520 0x7feab415f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432261780 0 0) 0x7feab409b980 con 0x7feab40d02a0 2024-08-18T22:32:20.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea98003530 con 0x7feab40d02a0 2024-08-18T22:32:20.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133443048 0 0) 0x7feab406fe70 con 0x7feab4070510 2024-08-18T22:32:20.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feab409b980 con 0x7feab4070510 2024-08-18T22:32:20.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3457291028 0 0) 0x7fea98003530 con 0x7feab40d02a0 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab409b520 msgr2=0x7feab415f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab409b520 0x7feab415f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 >> v1:172.21.15.117:6789/0 conn(0x7feab4070510 legacy=0x7feab40708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab4070150 con 0x7feab40d02a0 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7feaac001a00 con 0x7feab40d02a0 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feaa9400640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab409b520 0x7feab415f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 >> v1:172.21.15.5:6789/0 conn(0x7feab40d02a0 legacy=0x7feab40d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea98003b80 0x7fea98003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab409b520 0x7fea98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea98004d50 0x7fea980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feab415f670 con 0x7fea98004d50 2024-08-18T22:32:20.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fea9800ba80 con 0x7fea98003b80 2024-08-18T22:32:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fea9800bc00 con 0x7feab409b520 2024-08-18T22:32:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab2800640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea98004d50 0x7fea980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feaa9400640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab409b520 0x7fea98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab1e00640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea98003b80 0x7fea98003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab2800640 1 -- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab409b520 msgr2=0x7fea98004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab2800640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab409b520 0x7fea98004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab2800640 1 -- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea98003b80 msgr2=0x7fea98003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab2800640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea98003b80 0x7fea98003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.819+0000 7feab2800640 1 -- 172.21.15.5:0/509301818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea98003530 con 0x7fea98004d50 2024-08-18T22:32:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab2800640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea98004d50 0x7fea980051d0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7feaac00a830 tx=0x7feaac01fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a3911b948cc223 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac00a430 con 0x7fea98004d50 2024-08-18T22:32:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaac0aa690 con 0x7fea98004d50 2024-08-18T22:32:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab1400640 1 -- 172.21.15.5:0/509301818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac0aaa80 con 0x7fea98004d50 2024-08-18T22:32:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab3200640 1 -- 172.21.15.5:0/509301818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea98004d50 msgr2=0x7fea980051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab3200640 1 --2- 172.21.15.5:0/509301818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea98004d50 0x7fea980051d0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7feaac00a830 tx=0x7feaac01fa60 comp rx=0 tx=0).stop 2024-08-18T22:32:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab2800640 1 -- 172.21.15.5:0/509301818 reap_dead start 2024-08-18T22:32:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab3200640 1 -- 172.21.15.5:0/509301818 shutdown_connections 2024-08-18T22:32:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab3200640 1 -- 172.21.15.5:0/509301818 >> 172.21.15.5:0/509301818 conn(0x7feab40b3a20 msgr2=0x7feab40b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab3200640 1 -- 172.21.15.5:0/509301818 shutdown_connections 2024-08-18T22:32:20.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab3200640 1 -- 172.21.15.5:0/509301818 wait complete. 2024-08-18T22:32:20.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab3200640 1 Processor -- start 2024-08-18T22:32:20.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.823+0000 7feab3200640 1 -- start start 2024-08-18T22:32:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab3200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea98004d50 0x7feab4159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab3200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab40b4d80 0x7feab4156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab3200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40b5200 0x7feab4156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab3200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feab409b000 con 0x7feab40b4d80 2024-08-18T22:32:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab3200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feab409ad20 con 0x7fea98004d50 2024-08-18T22:32:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab3200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feab406fb00 con 0x7feab40b5200 2024-08-18T22:32:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaa9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab40b4d80 0x7feab4156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaa9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab40b4d80 0x7feab4156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55532/0 (socket says 172.21.15.5:55532) 2024-08-18T22:32:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaa9400640 1 -- 172.21.15.5:0/1696405277 learned_addr learned my addr 172.21.15.5:0/1696405277 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab1e00640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea98004d50 0x7feab4159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab2800640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40b5200 0x7feab4156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaa9400640 1 -- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40b5200 msgr2=0x7feab4156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaa9400640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40b5200 0x7feab4156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaa9400640 1 -- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea98004d50 msgr2=0x7feab4159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaa9400640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea98004d50 0x7feab4159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaa9400640 1 -- 172.21.15.5:0/1696405277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab40b6800 con 0x7feab40b4d80 2024-08-18T22:32:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab2800640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40b5200 0x7feab4156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaa9400640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab40b4d80 0x7feab4156aa0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0119d0 tx=0x7fea9c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaaaa00640 1 -- 172.21.15.5:0/1696405277 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00fb50 con 0x7feab40b4d80 2024-08-18T22:32:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaaaa00640 1 -- 172.21.15.5:0/1696405277 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9c00fcf0 con 0x7feab40b4d80 2024-08-18T22:32:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaaaa00640 1 -- 172.21.15.5:0/1696405277 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00fea0 con 0x7feab40b4d80 2024-08-18T22:32:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab3200640 1 -- 172.21.15.5:0/1696405277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab40b5760 con 0x7feab40b4d80 2024-08-18T22:32:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab3200640 1 -- 172.21.15.5:0/1696405277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab40b5d20 con 0x7feab40b4d80 2024-08-18T22:32:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feab3200640 1 -- 172.21.15.5:0/1696405277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab40b46d0 con 0x7feab40b4d80 2024-08-18T22:32:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.827+0000 7feaaaa00640 1 -- 172.21.15.5:0/1696405277 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fea9c012040 con 0x7feab40b4d80 2024-08-18T22:32:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.831+0000 7feaaaa00640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fea90067910 0x7fea90069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.831+0000 7feaaaa00640 1 -- 172.21.15.5:0/1696405277 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7fea9c085f50 con 0x7feab40b4d80 2024-08-18T22:32:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.831+0000 7feab1e00640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fea90067910 0x7fea90069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.831+0000 7feab1e00640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fea90067910 0x7fea90069dd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7feab40b7e80 tx=0x7feaa4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:20.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:20.835+0000 7feaaaa00640 1 -- 172.21.15.5:0/1696405277 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fea9c019070 con 0x7feab40b4d80 2024-08-18T22:32:21.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.055+0000 7feab3200640 1 -- 172.21.15.5:0/1696405277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7feab40b7eb0 con 0x7feab40b4d80 2024-08-18T22:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.959+0000 7feaaaa00640 1 -- 172.21.15.5:0/1696405277 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v616) ==== 143+0+0 (secure 0 0 0) 0x7fea9c056be0 con 0x7feab40b4d80 2024-08-18T22:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 -- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fea90067910 msgr2=0x7fea90069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fea90067910 0x7fea90069dd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7feab40b7e80 tx=0x7feaa4009040 comp rx=0 tx=0).stop 2024-08-18T22:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 -- 172.21.15.5:0/1696405277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab40b4d80 msgr2=0x7feab4156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab40b4d80 0x7feab4156aa0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0119d0 tx=0x7fea9c011e90 comp rx=0 tx=0).stop 2024-08-18T22:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 -- 172.21.15.5:0/1696405277 shutdown_connections 2024-08-18T22:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fea90067910 0x7fea90069dd0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feab40b5200 0x7feab4156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab40b4d80 0x7feab4156aa0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 --2- 172.21.15.5:0/1696405277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea98004d50 0x7feab4159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 -- 172.21.15.5:0/1696405277 >> 172.21.15.5:0/1696405277 conn(0x7feab40b3a20 msgr2=0x7feab406d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 -- 172.21.15.5:0/1696405277 shutdown_connections 2024-08-18T22:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:21.963+0000 7feab3200640 1 -- 172.21.15.5:0/1696405277 wait complete. 2024-08-18T22:32:21.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:32:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cc1c00640 1 Processor -- start 2024-08-18T22:32:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cc1c00640 1 -- start start 2024-08-18T22:32:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cc1c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1cbc0b1300 0x7f1cbc162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cc1c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1cbc09b080 0x7f1cbc0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cc1c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cbc06e8a0 con 0x7f1cbc09aca0 2024-08-18T22:32:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cc1c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1cbc09bb80 con 0x7f1cbc0b1300 2024-08-18T22:32:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cc1c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1cbc0d2e40 con 0x7f1cbc09b080 2024-08-18T22:32:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cb2000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1cbc0b1300 0x7f1cbc162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cb2000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1cbc0b1300 0x7f1cbc162950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55548/0 (socket says 172.21.15.5:55548) 2024-08-18T22:32:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cb2000640 1 -- 172.21.15.5:0/2622042511 learned_addr learned my addr 172.21.15.5:0/2622042511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cbb400640 1 --2- 172.21.15.5:0/2622042511 >> v2:172.21.15.117:3300/0 conn(0x7f1cbc09b080 0x7f1cbc0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cb2000640 1 -- 172.21.15.5:0/2622042511 >> v2:172.21.15.117:3300/0 conn(0x7f1cbc09b080 msgr2=0x7f1cbc0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cb2000640 1 --2- 172.21.15.5:0/2622042511 >> v2:172.21.15.117:3300/0 conn(0x7f1cbc09b080 0x7f1cbc0b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cb2000640 1 -- 172.21.15.5:0/2622042511 >> v1:172.21.15.5:6789/0 conn(0x7f1cbc09aca0 legacy=0x7f1cbc0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.135+0000 7f1cb2000640 1 -- 172.21.15.5:0/2622042511 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cbc06cbd0 con 0x7f1cbc0b1300 2024-08-18T22:32:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cb2000640 1 --2- 172.21.15.5:0/2622042511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc0b1300 0x7f1cbc162950 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc073460 tx=0x7f1ca401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682a7d07da44adc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cba000640 1 -- 172.21.15.5:0/2622042511 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40ab430 con 0x7f1cbc0b1300 2024-08-18T22:32:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cba000640 1 -- 172.21.15.5:0/2622042511 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca40b0070 con 0x7f1cbc0b1300 2024-08-18T22:32:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cba000640 1 -- 172.21.15.5:0/2622042511 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40ab7f0 con 0x7f1cbc0b1300 2024-08-18T22:32:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cc1c00640 1 -- 172.21.15.5:0/2622042511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc0b1300 msgr2=0x7f1cbc162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cc1c00640 1 --2- 172.21.15.5:0/2622042511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc0b1300 0x7f1cbc162950 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc073460 tx=0x7f1ca401c520 comp rx=0 tx=0).stop 2024-08-18T22:32:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cc1c00640 1 -- 172.21.15.5:0/2622042511 shutdown_connections 2024-08-18T22:32:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cc1c00640 1 --2- 172.21.15.5:0/2622042511 >> v2:172.21.15.117:3300/0 conn(0x7f1cbc09b080 0x7f1cbc0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cc1c00640 1 --2- 172.21.15.5:0/2622042511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc0b1300 0x7f1cbc162950 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cc1c00640 1 -- 172.21.15.5:0/2622042511 >> 172.21.15.5:0/2622042511 conn(0x7f1cbc0d2180 msgr2=0x7f1cbc0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cc1c00640 1 -- 172.21.15.5:0/2622042511 shutdown_connections 2024-08-18T22:32:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.139+0000 7f1cc1c00640 1 -- 172.21.15.5:0/2622042511 wait complete. 2024-08-18T22:32:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cc1c00640 1 Processor -- start 2024-08-18T22:32:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cc1c00640 1 -- start start 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cc1c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc09aca0 0x7f1cbc154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cc1c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cbc09b080 0x7f1cbc14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cc1c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc0b1300 0x7f1cbc14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cc1c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc16bcb0 con 0x7f1cbc0b1300 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cc1c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc16bb30 con 0x7f1cbc09aca0 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cc1c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1cbc16be30 con 0x7f1cbc09b080 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cbb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc0b1300 0x7f1cbc14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cbb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc0b1300 0x7f1cbc14ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55554/0 (socket says 172.21.15.5:55554) 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cbb400640 1 -- 172.21.15.5:0/219682676 learned_addr learned my addr 172.21.15.5:0/219682676 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cbaa00640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc09aca0 0x7f1cbc154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cb2000640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cbc09b080 0x7f1cbc14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cbb400640 1 -- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cbc09b080 msgr2=0x7f1cbc14e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cbb400640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cbc09b080 0x7f1cbc14e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cbb400640 1 -- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc09aca0 msgr2=0x7f1cbc154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cbb400640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc09aca0 0x7f1cbc154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cbb400640 1 -- 172.21.15.5:0/219682676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cbc154850 con 0x7f1cbc0b1300 2024-08-18T22:32:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cb2000640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cbc09b080 0x7f1cbc14e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cbb400640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc0b1300 0x7f1cbc14ec70 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4007e70 tx=0x7f1cb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cb3400640 1 -- 172.21.15.5:0/219682676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4014620 con 0x7f1cbc0b1300 2024-08-18T22:32:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cb3400640 1 -- 172.21.15.5:0/219682676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb4019070 con 0x7f1cbc0b1300 2024-08-18T22:32:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cc1c00640 1 -- 172.21.15.5:0/219682676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cbc0b65e0 con 0x7f1cbc0b1300 2024-08-18T22:32:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cb3400640 1 -- 172.21.15.5:0/219682676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4014a20 con 0x7f1cbc0b1300 2024-08-18T22:32:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.143+0000 7f1cc1c00640 1 -- 172.21.15.5:0/219682676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cbc153b10 con 0x7f1cbc0b1300 2024-08-18T22:32:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.147+0000 7f1cc1c00640 1 -- 172.21.15.5:0/219682676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cbc0afa90 con 0x7f1cbc0b1300 2024-08-18T22:32:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.147+0000 7f1cb3400640 1 -- 172.21.15.5:0/219682676 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1cb4014bc0 con 0x7f1cbc0b1300 2024-08-18T22:32:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.147+0000 7f1cb3400640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c980678c0 0x7f1c98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.147+0000 7f1cb3400640 1 -- 172.21.15.5:0/219682676 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7f1cb4086300 con 0x7f1cbc0b1300 2024-08-18T22:32:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.147+0000 7f1cbaa00640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c980678c0 0x7f1c98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.147+0000 7f1cbaa00640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c980678c0 0x7f1c98069d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc150d50 tx=0x7f1cac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.151+0000 7f1cb3400640 1 -- 172.21.15.5:0/219682676 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1cb4057040 con 0x7f1cbc0b1300 2024-08-18T22:32:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.319+0000 7f1cc1c00640 1 -- 172.21.15.5:0/219682676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1cbc1521f0 con 0x7f1cbc0b1300 2024-08-18T22:32:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.319+0000 7f1cb3400640 1 -- 172.21.15.5:0/219682676 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f1cb4056940 con 0x7f1cbc0b1300 2024-08-18T22:32:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 -- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c980678c0 msgr2=0x7f1c98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c980678c0 0x7f1c98069d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc150d50 tx=0x7f1cac009040 comp rx=0 tx=0).stop 2024-08-18T22:32:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 -- 172.21.15.5:0/219682676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc0b1300 msgr2=0x7f1cbc14ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc0b1300 0x7f1cbc14ec70 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4007e70 tx=0x7f1cb400e4b0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 -- 172.21.15.5:0/219682676 shutdown_connections 2024-08-18T22:32:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1c980678c0 0x7f1c98069d80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc0b1300 0x7f1cbc14ec70 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cbc09b080 0x7f1cbc14e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 --2- 172.21.15.5:0/219682676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc09aca0 0x7f1cbc154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 -- 172.21.15.5:0/219682676 >> 172.21.15.5:0/219682676 conn(0x7f1cbc0d2180 msgr2=0x7f1cbc0aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:22.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 -- 172.21.15.5:0/219682676 shutdown_connections 2024-08-18T22:32:22.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.323+0000 7f1cc1c00640 1 -- 172.21.15.5:0/219682676 wait complete. 2024-08-18T22:32:22.344 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:32:22.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:32:22.440 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:32:22.527 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:32:22.527 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:32:22.527 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:32:22.535 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:32:22.536 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:32:22.536 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:32:22.545 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:32:22.545 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:32:22.545 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:32:22.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:32:22.586 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:32:22.586 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:32:22.597 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:32:22.597 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:32:22.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:32:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa652c00640 1 Processor -- start 2024-08-18T22:32:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa652c00640 1 -- start start 2024-08-18T22:32:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa652c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa64c06fad0 0x7fa64c0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa652c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa64c0b5e30 con 0x7fa64c071c90 2024-08-18T22:32:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa652c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa64c0b6110 con 0x7fa64c15c180 2024-08-18T22:32:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa652c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa64c0b63f0 con 0x7fa64c06fad0 2024-08-18T22:32:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa64c071c90 0x7fa64c0d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47426/0 (socket says 172.21.15.5:47426) 2024-08-18T22:32:22.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64b400640 1 -- 172.21.15.5:0/1878975628 learned_addr learned my addr 172.21.15.5:0/1878975628 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:22.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa650c00640 1 --2- 172.21.15.5:0/1878975628 >> v2:172.21.15.117:3300/0 conn(0x7fa64c06fad0 0x7fa64c0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4069514418 0 0) 0x7fa64c0b5e30 con 0x7fa64c071c90 2024-08-18T22:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa630003530 con 0x7fa64c071c90 2024-08-18T22:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1916599937 0 0) 0x7fa64c0b6110 con 0x7fa64c15c180 2024-08-18T22:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa64c0b5e30 con 0x7fa64c15c180 2024-08-18T22:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1612452864 0 0) 0x7fa630003530 con 0x7fa64c071c90 2024-08-18T22:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 >> v2:172.21.15.117:3300/0 conn(0x7fa64c06fad0 msgr2=0x7fa64c0b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 --2- 172.21.15.5:0/1878975628 >> v2:172.21.15.117:3300/0 conn(0x7fa64c06fad0 0x7fa64c0b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 >> v1:172.21.15.117:6789/0 conn(0x7fa64c15c180 legacy=0x7fa64c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa64c0b66d0 con 0x7fa64c071c90 2024-08-18T22:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fa638001680 con 0x7fa64c071c90 2024-08-18T22:32:22.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 >> v1:172.21.15.5:6789/0 conn(0x7fa64c071c90 legacy=0x7fa64c0d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 --2- 172.21.15.5:0/1878975628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa630003b50 0x7fa630003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 --2- 172.21.15.5:0/1878975628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa630004810 0x7fa630004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 --2- 172.21.15.5:0/1878975628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa630005240 0x7fa63000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa64c0b63f0 con 0x7fa630003b50 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa63000c1a0 con 0x7fa630004810 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa63000c3a0 con 0x7fa630005240 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64be00640 1 --2- 172.21.15.5:0/1878975628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa630003b50 0x7fa630003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64b400640 1 --2- 172.21.15.5:0/1878975628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa630004810 0x7fa630004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa650c00640 1 --2- 172.21.15.5:0/1878975628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa630005240 0x7fa63000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64be00640 1 -- 172.21.15.5:0/1878975628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa630005240 msgr2=0x7fa63000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64be00640 1 --2- 172.21.15.5:0/1878975628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa630005240 0x7fa63000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64be00640 1 -- 172.21.15.5:0/1878975628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa630004810 msgr2=0x7fa630004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64be00640 1 --2- 172.21.15.5:0/1878975628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa630004810 0x7fa630004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa64be00640 1 -- 172.21.15.5:0/1878975628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa630003530 con 0x7fa630003b50 2024-08-18T22:32:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.771+0000 7fa650c00640 1 -- 172.21.15.5:0/1878975628 reap_dead start 2024-08-18T22:32:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.775+0000 7fa64be00640 1 --2- 172.21.15.5:0/1878975628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa630003b50 0x7fa630003f50 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0018d0 tx=0x7fa63c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff59a84eb10eebe6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.775+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c001520 con 0x7fa630003b50 2024-08-18T22:32:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.775+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa63c0052f0 con 0x7fa630003b50 2024-08-18T22:32:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.775+0000 7fa64aa00640 1 -- 172.21.15.5:0/1878975628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c003840 con 0x7fa630003b50 2024-08-18T22:32:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.775+0000 7fa652c00640 1 -- 172.21.15.5:0/1878975628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa630003b50 msgr2=0x7fa630003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.775+0000 7fa652c00640 1 --2- 172.21.15.5:0/1878975628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa630003b50 0x7fa630003f50 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0018d0 tx=0x7fa63c01c4e0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.775+0000 7fa652c00640 1 -- 172.21.15.5:0/1878975628 shutdown_connections 2024-08-18T22:32:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.775+0000 7fa652c00640 1 --2- 172.21.15.5:0/1878975628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa630003b50 0x7fa630003f50 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.775+0000 7fa652c00640 1 -- 172.21.15.5:0/1878975628 >> 172.21.15.5:0/1878975628 conn(0x7fa64c0b3eb0 msgr2=0x7fa64c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.775+0000 7fa652c00640 1 -- 172.21.15.5:0/1878975628 shutdown_connections 2024-08-18T22:32:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.775+0000 7fa652c00640 1 -- 172.21.15.5:0/1878975628 wait complete. 2024-08-18T22:32:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa652c00640 1 Processor -- start 2024-08-18T22:32:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa652c00640 1 -- start start 2024-08-18T22:32:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa652c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa630003b50 0x7fa64c157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa652c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa64c13e580 0x7fa64c140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa652c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa64c0b0b20 0x7fa64c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa652c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa64c071700 con 0x7fa64c13e580 2024-08-18T22:32:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa652c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa64c071580 con 0x7fa64c0b0b20 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa652c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa64c071880 con 0x7fa630003b50 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa64b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa64c13e580 0x7fa64c140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa64b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa64c13e580 0x7fa64c140e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55562/0 (socket says 172.21.15.5:55562) 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa64b400640 1 -- 172.21.15.5:0/2653219656 learned_addr learned my addr 172.21.15.5:0/2653219656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa64be00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa630003b50 0x7fa64c157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa650c00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa64c0b0b20 0x7fa64c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa64b400640 1 -- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa630003b50 msgr2=0x7fa64c157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa64b400640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa630003b50 0x7fa64c157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa64b400640 1 -- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa64c0b0b20 msgr2=0x7fa64c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa64b400640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa64c0b0b20 0x7fa64c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa64b400640 1 -- 172.21.15.5:0/2653219656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa64c13ede0 con 0x7fa64c13e580 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa64be00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa630003b50 0x7fa64c157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:22.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa64b400640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa64c13e580 0x7fa64c140e70 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa638007310 tx=0x7fa6380077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa643e00640 1 -- 172.21.15.5:0/2653219656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa638001630 con 0x7fa64c13e580 2024-08-18T22:32:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa643e00640 1 -- 172.21.15.5:0/2653219656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa638018070 con 0x7fa64c13e580 2024-08-18T22:32:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa643e00640 1 -- 172.21.15.5:0/2653219656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63800fba0 con 0x7fa64c13e580 2024-08-18T22:32:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa652c00640 1 -- 172.21.15.5:0/2653219656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa64c1416c0 con 0x7fa64c13e580 2024-08-18T22:32:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.779+0000 7fa652c00640 1 -- 172.21.15.5:0/2653219656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa64c141c80 con 0x7fa64c13e580 2024-08-18T22:32:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.783+0000 7fa652c00640 1 -- 172.21.15.5:0/2653219656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa64c0d1ab0 con 0x7fa64c13e580 2024-08-18T22:32:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.783+0000 7fa643e00640 1 -- 172.21.15.5:0/2653219656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa63800fd40 con 0x7fa64c13e580 2024-08-18T22:32:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.783+0000 7fa643e00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa62c0678f0 0x7fa62c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.783+0000 7fa643e00640 1 -- 172.21.15.5:0/2653219656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5335+0+0 (secure 0 0 0) 0x7fa638085d20 con 0x7fa64c13e580 2024-08-18T22:32:22.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.783+0000 7fa64be00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa62c0678f0 0x7fa62c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:22.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.783+0000 7fa64be00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa62c0678f0 0x7fa62c069db0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0ac000 tx=0x7fa63c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:22.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.787+0000 7fa643e00640 1 -- 172.21.15.5:0/2653219656 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa638056250 con 0x7fa64c13e580 2024-08-18T22:32:22.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.987+0000 7fa652c00640 1 -- 172.21.15.5:0/2653219656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa64c0cf7d0 con 0x7fa64c13e580 2024-08-18T22:32:22.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.987+0000 7fa643e00640 1 -- 172.21.15.5:0/2653219656 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) ==== 95+0+3917 (secure 0 0 0) 0x7fa63805a550 con 0x7fa64c13e580 2024-08-18T22:32:22.989 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:22.989 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":143,"btime":"2024-08-18T22:32:16:934110+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/4068691051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4068691051},{"type":"v1","addr":"172.21.15.117:6836","nonce":4068691051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":9433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2857107873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":2857107873},{"type":"v1","addr":"172.21.15.117:6837","nonce":2857107873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":9972,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/4128479928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":4128479928},{"type":"v1","addr":"172.21.15.5:6834","nonce":4128479928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":10266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/4289395088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4289395088},{"type":"v1","addr":"172.21.15.5:6835","nonce":4289395088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143}],"filesystems":[]} 2024-08-18T22:32:22.989 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 143 2024-08-18T22:32:22.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 -- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa62c0678f0 msgr2=0x7fa62c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa62c0678f0 0x7fa62c069db0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0ac000 tx=0x7fa63c009040 comp rx=0 tx=0).stop 2024-08-18T22:32:22.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 -- 172.21.15.5:0/2653219656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa64c13e580 msgr2=0x7fa64c140e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:22.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa64c13e580 0x7fa64c140e70 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa638007310 tx=0x7fa6380077d0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 -- 172.21.15.5:0/2653219656 shutdown_connections 2024-08-18T22:32:22.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa62c0678f0 0x7fa62c069db0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa64c0b0b20 0x7fa64c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa64c13e580 0x7fa64c140e70 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 --2- 172.21.15.5:0/2653219656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa630003b50 0x7fa64c157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:22.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 -- 172.21.15.5:0/2653219656 >> 172.21.15.5:0/2653219656 conn(0x7fa64c0b3eb0 msgr2=0x7fa64c15eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:22.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 -- 172.21.15.5:0/2653219656 shutdown_connections 2024-08-18T22:32:22.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:22.991+0000 7fa652c00640 1 -- 172.21.15.5:0/2653219656 wait complete. 2024-08-18T22:32:23.010 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:32:23.010 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:32:23.011 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:32:23.011 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:32:23.011 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:32:23.011 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:32:23.011 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:32:23.011 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:32:23.011 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:32:23.012 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:32:23.012 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:32:23.012 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:32:23.012 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:32:23.012 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:32:23.012 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:32:23.012 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:32:23.023 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:32:23.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:32:23.025 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:32:23.026 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:32:23.027 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:32:23.027 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:32:23.068 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:32:23.068 DEBUG:teuthology.parallel:result is None 2024-08-18T22:32:23.071 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:32:23.071 DEBUG:teuthology.parallel:result is None 2024-08-18T22:32:23.073 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:32:23.073 DEBUG:teuthology.parallel:result is None 2024-08-18T22:32:23.154 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:32:23.162 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:32:23.162 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:32:24.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:32:24.433 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:32:29.023 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:32:29.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:32:29.027 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:32:29.027 DEBUG:teuthology.parallel:result is None 2024-08-18T22:32:29.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:32:29.123 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:32:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.179+0000 7febbda00640 1 Processor -- start 2024-08-18T22:32:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.179+0000 7febbda00640 1 -- start start 2024-08-18T22:32:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febbda00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febb8158a00 0x7febb815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febbda00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7febb80b4990 0x7febb80b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febbda00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb815c310 con 0x7febb80afad0 2024-08-18T22:32:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febbda00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7febb80b5340 con 0x7febb8158a00 2024-08-18T22:32:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febbda00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7febb8158de0 con 0x7febb80b4990 2024-08-18T22:32:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febb7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febb8158a00 0x7febb815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febb7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7febb8158a00 0x7febb815bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42406/0 (socket says 172.21.15.5:42406) 2024-08-18T22:32:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febb7e00640 1 -- 172.21.15.5:0/3534053797 learned_addr learned my addr 172.21.15.5:0/3534053797 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febbd000640 1 --2- 172.21.15.5:0/3534053797 >> v2:172.21.15.117:3300/0 conn(0x7febb80b4990 0x7febb80b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febb7e00640 1 -- 172.21.15.5:0/3534053797 >> v2:172.21.15.117:3300/0 conn(0x7febb80b4990 msgr2=0x7febb80b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febb7e00640 1 --2- 172.21.15.5:0/3534053797 >> v2:172.21.15.117:3300/0 conn(0x7febb80b4990 0x7febb80b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febb7e00640 1 -- 172.21.15.5:0/3534053797 >> v1:172.21.15.117:6789/0 conn(0x7febb80afad0 legacy=0x7febb80cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febb7e00640 1 -- 172.21.15.5:0/3534053797 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb80aff90 con 0x7febb8158a00 2024-08-18T22:32:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.183+0000 7febbd000640 1 --2- 172.21.15.5:0/3534053797 >> v2:172.21.15.117:3300/0 conn(0x7febb80b4990 0x7febb80b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febb7e00640 1 --2- 172.21.15.5:0/3534053797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb8158a00 0x7febb815bdd0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7feba8009870 tx=0x7feba801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb12270b9d73b8e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:29.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febb7400640 1 -- 172.21.15.5:0/3534053797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba80ab610 con 0x7febb8158a00 2024-08-18T22:32:29.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febb7400640 1 -- 172.21.15.5:0/3534053797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba80b0070 con 0x7febb8158a00 2024-08-18T22:32:29.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febb7400640 1 -- 172.21.15.5:0/3534053797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba80ab9d0 con 0x7febb8158a00 2024-08-18T22:32:29.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febbda00640 1 -- 172.21.15.5:0/3534053797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb8158a00 msgr2=0x7febb815bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:29.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febbda00640 1 --2- 172.21.15.5:0/3534053797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb8158a00 0x7febb815bdd0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7feba8009870 tx=0x7feba801c520 comp rx=0 tx=0).stop 2024-08-18T22:32:29.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febbda00640 1 -- 172.21.15.5:0/3534053797 shutdown_connections 2024-08-18T22:32:29.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febbda00640 1 --2- 172.21.15.5:0/3534053797 >> v2:172.21.15.117:3300/0 conn(0x7febb80b4990 0x7febb80b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:29.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febbda00640 1 --2- 172.21.15.5:0/3534053797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb8158a00 0x7febb815bdd0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:29.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febbda00640 1 -- 172.21.15.5:0/3534053797 >> 172.21.15.5:0/3534053797 conn(0x7febb8073090 msgr2=0x7febb806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:29.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febbda00640 1 -- 172.21.15.5:0/3534053797 shutdown_connections 2024-08-18T22:32:29.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febbda00640 1 -- 172.21.15.5:0/3534053797 wait complete. 2024-08-18T22:32:29.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febbda00640 1 Processor -- start 2024-08-18T22:32:29.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.187+0000 7febbda00640 1 -- start start 2024-08-18T22:32:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbda00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febb80afad0 0x7febb8157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbda00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80b4990 0x7febb8145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbda00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb8158a00 0x7febb8145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbda00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7febb80cf240 con 0x7febb8158a00 2024-08-18T22:32:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbda00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7febb80cf0c0 con 0x7febb80afad0 2024-08-18T22:32:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbda00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7febb815cd20 con 0x7febb80b4990 2024-08-18T22:32:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbd000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb8158a00 0x7febb8145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbd000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb8158a00 0x7febb8145dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42416/0 (socket says 172.21.15.5:42416) 2024-08-18T22:32:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbd000640 1 -- 172.21.15.5:0/769424161 learned_addr learned my addr 172.21.15.5:0/769424161 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febb7e00640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febb80afad0 0x7febb8157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febaf400640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80b4990 0x7febb8145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbd000640 1 -- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80b4990 msgr2=0x7febb8145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbd000640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80b4990 0x7febb8145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbd000640 1 -- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febb80afad0 msgr2=0x7febb8157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbd000640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febb80afad0 0x7febb8157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbd000640 1 -- 172.21.15.5:0/769424161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb8140420 con 0x7febb8158a00 2024-08-18T22:32:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbd000640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb8158a00 0x7febb8145dd0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7febb0007f20 tx=0x7febb000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febb4c00640 1 -- 172.21.15.5:0/769424161 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb001a070 con 0x7febb8158a00 2024-08-18T22:32:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febb4c00640 1 -- 172.21.15.5:0/769424161 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb0003ba0 con 0x7febb8158a00 2024-08-18T22:32:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbda00640 1 -- 172.21.15.5:0/769424161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb815eb20 con 0x7febb8158a00 2024-08-18T22:32:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febb4c00640 1 -- 172.21.15.5:0/769424161 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0004030 con 0x7febb8158a00 2024-08-18T22:32:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbda00640 1 -- 172.21.15.5:0/769424161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb815ee00 con 0x7febb8158a00 2024-08-18T22:32:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febbda00640 1 -- 172.21.15.5:0/769424161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb815e8b0 con 0x7febb8158a00 2024-08-18T22:32:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.191+0000 7febb4c00640 1 -- 172.21.15.5:0/769424161 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7febb001d070 con 0x7febb8158a00 2024-08-18T22:32:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.195+0000 7febb4c00640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb940678c0 0x7feb94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.195+0000 7febb4c00640 1 -- 172.21.15.5:0/769424161 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5335+0+0 (secure 0 0 0) 0x7febb0085ee0 con 0x7febb8158a00 2024-08-18T22:32:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.195+0000 7febb7e00640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb940678c0 0x7feb94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.195+0000 7febb7e00640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb940678c0 0x7feb94069d80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7feba80af000 tx=0x7feba80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:29.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.199+0000 7febb4c00640 1 -- 172.21.15.5:0/769424161 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7febb0010070 con 0x7febb8158a00 2024-08-18T22:32:29.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-08-18T22:32:29.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:29.375+0000 7febbda00640 1 -- 172.21.15.5:0/769424161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7febb80b4e00 con 0x7febb8158a00 2024-08-18T22:32:30.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febb4c00640 1 -- 172.21.15.5:0/769424161 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v187) ==== 97+0+0 (secure 0 0 0) 0x7febb0056410 con 0x7febb8158a00 2024-08-18T22:32:30.290 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:32:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 -- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb940678c0 msgr2=0x7feb94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb940678c0 0x7feb94069d80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7feba80af000 tx=0x7feba80a7000 comp rx=0 tx=0).stop 2024-08-18T22:32:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 -- 172.21.15.5:0/769424161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb8158a00 msgr2=0x7febb8145dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb8158a00 0x7febb8145dd0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7febb0007f20 tx=0x7febb000d560 comp rx=0 tx=0).stop 2024-08-18T22:32:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 -- 172.21.15.5:0/769424161 shutdown_connections 2024-08-18T22:32:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb940678c0 0x7feb94069d80 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febb8158a00 0x7febb8145dd0 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febb80b4990 0x7febb8145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 --2- 172.21.15.5:0/769424161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febb80afad0 0x7febb8157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 -- 172.21.15.5:0/769424161 >> 172.21.15.5:0/769424161 conn(0x7febb8073090 msgr2=0x7febb80aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:30.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 -- 172.21.15.5:0/769424161 shutdown_connections 2024-08-18T22:32:30.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.291+0000 7febbda00640 1 -- 172.21.15.5:0/769424161 wait complete. 2024-08-18T22:32:30.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:32:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.459+0000 7fa524200640 1 Processor -- start 2024-08-18T22:32:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa524200640 1 -- start start 2024-08-18T22:32:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa524200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa51c15b010 0x7fa51c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa524200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa51c0cd3a0 0x7fa51c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa524200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa51c06f0c0 0x7fa51c0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa524200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa51c0cfa30 con 0x7fa51c0cd3a0 2024-08-18T22:32:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa524200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa51c0cee20 con 0x7fa51c06f0c0 2024-08-18T22:32:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa524200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa51c0cf100 con 0x7fa51c15b010 2024-08-18T22:32:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa520e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa51c0cd3a0 0x7fa51c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa520e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa51c0cd3a0 0x7fa51c06eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42418/0 (socket says 172.21.15.5:42418) 2024-08-18T22:32:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa520e00640 1 -- 172.21.15.5:0/1074178467 learned_addr learned my addr 172.21.15.5:0/1074178467 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa521800640 1 --2- 172.21.15.5:0/1074178467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa51c15b010 0x7fa51c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa522200640 1 --2- 172.21.15.5:0/1074178467 >> v2:172.21.15.117:3300/0 conn(0x7fa51c06f0c0 0x7fa51c0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa520e00640 1 -- 172.21.15.5:0/1074178467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa51c15b010 msgr2=0x7fa51c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa520e00640 1 --2- 172.21.15.5:0/1074178467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa51c15b010 0x7fa51c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa520e00640 1 -- 172.21.15.5:0/1074178467 >> v2:172.21.15.117:3300/0 conn(0x7fa51c06f0c0 msgr2=0x7fa51c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa520e00640 1 --2- 172.21.15.5:0/1074178467 >> v2:172.21.15.117:3300/0 conn(0x7fa51c06f0c0 0x7fa51c0caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.463+0000 7fa520e00640 1 -- 172.21.15.5:0/1074178467 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c0cf3e0 con 0x7fa51c0cd3a0 2024-08-18T22:32:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa520e00640 1 --2- 172.21.15.5:0/1074178467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa51c0cd3a0 0x7fa51c06eb80 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fa51c06ffa0 tx=0x7fa50801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5e31098653c0a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:30.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa51be00640 1 -- 172.21.15.5:0/1074178467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5080b0070 con 0x7fa51c0cd3a0 2024-08-18T22:32:30.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa51be00640 1 -- 172.21.15.5:0/1074178467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5080ab600 con 0x7fa51c0cd3a0 2024-08-18T22:32:30.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa51be00640 1 -- 172.21.15.5:0/1074178467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5080ab9d0 con 0x7fa51c0cd3a0 2024-08-18T22:32:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa524200640 1 -- 172.21.15.5:0/1074178467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa51c0cd3a0 msgr2=0x7fa51c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa524200640 1 --2- 172.21.15.5:0/1074178467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa51c0cd3a0 0x7fa51c06eb80 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fa51c06ffa0 tx=0x7fa50801c260 comp rx=0 tx=0).stop 2024-08-18T22:32:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa524200640 1 -- 172.21.15.5:0/1074178467 shutdown_connections 2024-08-18T22:32:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa524200640 1 --2- 172.21.15.5:0/1074178467 >> v2:172.21.15.117:3300/0 conn(0x7fa51c06f0c0 0x7fa51c0caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa524200640 1 --2- 172.21.15.5:0/1074178467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa51c0cd3a0 0x7fa51c06eb80 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa524200640 1 --2- 172.21.15.5:0/1074178467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa51c15b010 0x7fa51c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa524200640 1 -- 172.21.15.5:0/1074178467 >> 172.21.15.5:0/1074178467 conn(0x7fa51c0b1c50 msgr2=0x7fa51c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa524200640 1 -- 172.21.15.5:0/1074178467 shutdown_connections 2024-08-18T22:32:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa524200640 1 -- 172.21.15.5:0/1074178467 wait complete. 2024-08-18T22:32:30.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa524200640 1 Processor -- start 2024-08-18T22:32:30.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.467+0000 7fa524200640 1 -- start start 2024-08-18T22:32:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa524200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa51c06f0c0 0x7fa51c0b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa524200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa51c0cd3a0 0x7fa51c0aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa524200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa51c15b010 0x7fa51c072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa524200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c072780 con 0x7fa51c15b010 2024-08-18T22:32:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa524200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c072600 con 0x7fa51c06f0c0 2024-08-18T22:32:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa524200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa51c072900 con 0x7fa51c0cd3a0 2024-08-18T22:32:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa522200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa51c15b010 0x7fa51c072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa522200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa51c15b010 0x7fa51c072cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42434/0 (socket says 172.21.15.5:42434) 2024-08-18T22:32:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa522200640 1 -- 172.21.15.5:0/1194696360 learned_addr learned my addr 172.21.15.5:0/1194696360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa521800640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa51c06f0c0 0x7fa51c0b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa520e00640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa51c0cd3a0 0x7fa51c0aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa522200640 1 -- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa51c0cd3a0 msgr2=0x7fa51c0aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa522200640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa51c0cd3a0 0x7fa51c0aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa522200640 1 -- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa51c06f0c0 msgr2=0x7fa51c0b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa522200640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa51c06f0c0 0x7fa51c0b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa522200640 1 -- 172.21.15.5:0/1194696360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c0ae560 con 0x7fa51c15b010 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa520e00640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa51c0cd3a0 0x7fa51c0aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa521800640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa51c06f0c0 0x7fa51c0b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa522200640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa51c15b010 0x7fa51c072cc0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fa51400efc0 tx=0x7fa51400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa519600640 1 -- 172.21.15.5:0/1194696360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514018020 con 0x7fa51c15b010 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa519600640 1 -- 172.21.15.5:0/1194696360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa514014480 con 0x7fa51c15b010 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa524200640 1 -- 172.21.15.5:0/1194696360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51c0b1410 con 0x7fa51c15b010 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa519600640 1 -- 172.21.15.5:0/1194696360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514014870 con 0x7fa51c15b010 2024-08-18T22:32:30.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa524200640 1 -- 172.21.15.5:0/1194696360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51c0ae820 con 0x7fa51c15b010 2024-08-18T22:32:30.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa524200640 1 -- 172.21.15.5:0/1194696360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa51c06eb80 con 0x7fa51c15b010 2024-08-18T22:32:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.471+0000 7fa519600640 1 -- 172.21.15.5:0/1194696360 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa51401b020 con 0x7fa51c15b010 2024-08-18T22:32:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.475+0000 7fa519600640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4fc0678c0 0x7fa4fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.475+0000 7fa519600640 1 -- 172.21.15.5:0/1194696360 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5249+0+0 (secure 0 0 0) 0x7fa514086650 con 0x7fa51c15b010 2024-08-18T22:32:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.475+0000 7fa521800640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4fc0678c0 0x7fa4fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.475+0000 7fa521800640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4fc0678c0 0x7fa4fc069d80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa510009a90 tx=0x7fa510008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:30.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.479+0000 7fa519600640 1 -- 172.21.15.5:0/1194696360 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa514022070 con 0x7fa51c15b010 2024-08-18T22:32:30.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.699+0000 7fa524200640 1 -- 172.21.15.5:0/1194696360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa51c15a840 con 0x7fa51c15b010 2024-08-18T22:32:30.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.699+0000 7fa519600640 1 -- 172.21.15.5:0/1194696360 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) ==== 80+0+5304 (secure 0 0 0) 0x7fa514010040 con 0x7fa51c15b010 2024-08-18T22:32:30.700 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:30.700 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:32:30.700 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:32:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.702 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:32:30.702 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:32:30.702 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:32:30.702 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.702 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.702 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:32:30.702 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:32:30.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:32:30.705 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:32:30.705 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.705 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.705 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.706 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:32:30.707 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:32:30.707 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.707 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.707 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:32:30.707 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:32:30.707 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.707 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:32:30.707 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:32:30.709 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:32:30.710 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.710 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:32:30.710 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:32:30.710 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.710 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:32:30.711 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:32:30.712 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.713 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:32:30.713 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:32:30.713 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.713 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:32:30.713 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:32:30.713 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:32:30.713 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:32:30.713 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.714 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:32:30.715 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:32:30.716 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:30.717 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:32:30.718 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:32:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 -- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4fc0678c0 msgr2=0x7fa4fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4fc0678c0 0x7fa4fc069d80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa510009a90 tx=0x7fa510008040 comp rx=0 tx=0).stop 2024-08-18T22:32:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 -- 172.21.15.5:0/1194696360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa51c15b010 msgr2=0x7fa51c072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa51c15b010 0x7fa51c072cc0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fa51400efc0 tx=0x7fa51400c490 comp rx=0 tx=0).stop 2024-08-18T22:32:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 -- 172.21.15.5:0/1194696360 shutdown_connections 2024-08-18T22:32:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4fc0678c0 0x7fa4fc069d80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa51c15b010 0x7fa51c072cc0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa51c0cd3a0 0x7fa51c0aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 --2- 172.21.15.5:0/1194696360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa51c06f0c0 0x7fa51c0b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 -- 172.21.15.5:0/1194696360 >> 172.21.15.5:0/1194696360 conn(0x7fa51c0b1c50 msgr2=0x7fa51c159160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:30.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 -- 172.21.15.5:0/1194696360 shutdown_connections 2024-08-18T22:32:30.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.703+0000 7fa524200640 1 -- 172.21.15.5:0/1194696360 wait complete. 2024-08-18T22:32:30.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:32:30.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f9055a00640 1 Processor -- start 2024-08-18T22:32:30.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f9055a00640 1 -- start start 2024-08-18T22:32:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f9055a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f905015a800 0x7f90500caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f9055a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90500ce280 0x7f905006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f9055a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90500ce6c0 0x7f905006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f9055a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f90500cb5d0 con 0x7f90500ce280 2024-08-18T22:32:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f9055a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9050072e60 con 0x7f90500ce6c0 2024-08-18T22:32:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f9055a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9050073140 con 0x7f905015a800 2024-08-18T22:32:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f904e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90500ce280 0x7f905006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f904e000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90500ce280 0x7f905006ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42438/0 (socket says 172.21.15.5:42438) 2024-08-18T22:32:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f904e000640 1 -- 172.21.15.5:0/2032232789 learned_addr learned my addr 172.21.15.5:0/2032232789 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f904ea00640 1 --2- 172.21.15.5:0/2032232789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f905015a800 0x7f90500caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.863+0000 7f904f400640 1 --2- 172.21.15.5:0/2032232789 >> v2:172.21.15.117:3300/0 conn(0x7f90500ce6c0 0x7f905006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.867+0000 7f904e000640 1 -- 172.21.15.5:0/2032232789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f905015a800 msgr2=0x7f90500caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.867+0000 7f904e000640 1 --2- 172.21.15.5:0/2032232789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f905015a800 0x7f90500caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.867+0000 7f904e000640 1 -- 172.21.15.5:0/2032232789 >> v2:172.21.15.117:3300/0 conn(0x7f90500ce6c0 msgr2=0x7f905006ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:30.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.867+0000 7f904e000640 1 --2- 172.21.15.5:0/2032232789 >> v2:172.21.15.117:3300/0 conn(0x7f90500ce6c0 0x7f905006ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.867+0000 7f904e000640 1 -- 172.21.15.5:0/2032232789 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9050073420 con 0x7f90500ce280 2024-08-18T22:32:30.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.867+0000 7f904e000640 1 --2- 172.21.15.5:0/2032232789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90500ce280 0x7f905006ea40 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f90500cff30 tx=0x7f903c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac91eef08f89165 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:30.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.867+0000 7f904d600640 1 -- 172.21.15.5:0/2032232789 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0b0070 con 0x7f90500ce280 2024-08-18T22:32:30.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.867+0000 7f904d600640 1 -- 172.21.15.5:0/2032232789 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c0ab600 con 0x7f90500ce280 2024-08-18T22:32:30.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.867+0000 7f904d600640 1 -- 172.21.15.5:0/2032232789 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0ab9d0 con 0x7f90500ce280 2024-08-18T22:32:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 -- 172.21.15.5:0/2032232789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90500ce280 msgr2=0x7f905006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 --2- 172.21.15.5:0/2032232789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90500ce280 0x7f905006ea40 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f90500cff30 tx=0x7f903c01c520 comp rx=0 tx=0).stop 2024-08-18T22:32:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 -- 172.21.15.5:0/2032232789 shutdown_connections 2024-08-18T22:32:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 --2- 172.21.15.5:0/2032232789 >> v2:172.21.15.117:3300/0 conn(0x7f90500ce6c0 0x7f905006ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 --2- 172.21.15.5:0/2032232789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90500ce280 0x7f905006ea40 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 --2- 172.21.15.5:0/2032232789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f905015a800 0x7f90500caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 -- 172.21.15.5:0/2032232789 >> 172.21.15.5:0/2032232789 conn(0x7f90500b1c50 msgr2=0x7f90500b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 -- 172.21.15.5:0/2032232789 shutdown_connections 2024-08-18T22:32:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 -- 172.21.15.5:0/2032232789 wait complete. 2024-08-18T22:32:30.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 Processor -- start 2024-08-18T22:32:30.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 -- start start 2024-08-18T22:32:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90500ce280 0x7f90500aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90500ce6c0 0x7f90501fac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f905015a800 0x7f9050157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f905015ed70 con 0x7f90500ce6c0 2024-08-18T22:32:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f905015ebf0 con 0x7f905015a800 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f9055a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f905015eef0 con 0x7f90500ce280 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90500ce6c0 0x7f90501fac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904e000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90500ce6c0 0x7f90501fac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42446/0 (socket says 172.21.15.5:42446) 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904e000640 1 -- 172.21.15.5:0/3761538288 learned_addr learned my addr 172.21.15.5:0/3761538288 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904ea00640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90500ce280 0x7f90500aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904e000640 1 -- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90500ce280 msgr2=0x7f90500aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904e000640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90500ce280 0x7f90500aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904f400640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f905015a800 0x7f9050157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904e000640 1 -- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f905015a800 msgr2=0x7f9050157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904e000640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f905015a800 0x7f9050157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904e000640 1 -- 172.21.15.5:0/3761538288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9050156a60 con 0x7f90500ce6c0 2024-08-18T22:32:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904ea00640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90500ce280 0x7f90500aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:30.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.871+0000 7f904f400640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f905015a800 0x7f9050157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:30.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.875+0000 7f904e000640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90500ce6c0 0x7f90501fac40 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f903c0ae040 tx=0x7f903c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:30.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.875+0000 7f9046a00640 1 -- 172.21.15.5:0/3761538288 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0b0040 con 0x7f90500ce6c0 2024-08-18T22:32:30.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.875+0000 7f9046a00640 1 -- 172.21.15.5:0/3761538288 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c0b9070 con 0x7f90500ce6c0 2024-08-18T22:32:30.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.875+0000 7f9046a00640 1 -- 172.21.15.5:0/3761538288 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0aa930 con 0x7f90500ce6c0 2024-08-18T22:32:30.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.875+0000 7f9055a00640 1 -- 172.21.15.5:0/3761538288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90501564a0 con 0x7f90500ce6c0 2024-08-18T22:32:30.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.875+0000 7f9055a00640 1 -- 172.21.15.5:0/3761538288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90500ae7a0 con 0x7f90500ce6c0 2024-08-18T22:32:30.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.875+0000 7f9055a00640 1 -- 172.21.15.5:0/3761538288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90500caec0 con 0x7f90500ce6c0 2024-08-18T22:32:30.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.875+0000 7f9046a00640 1 -- 172.21.15.5:0/3761538288 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f903c0aaad0 con 0x7f90500ce6c0 2024-08-18T22:32:30.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.875+0000 7f9046a00640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90300678f0 0x7f9030069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:30.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.875+0000 7f9046a00640 1 -- 172.21.15.5:0/3761538288 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5249+0+0 (secure 0 0 0) 0x7f903c11fa00 con 0x7f90500ce6c0 2024-08-18T22:32:30.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.879+0000 7f904ea00640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90300678f0 0x7f9030069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:30.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.879+0000 7f904ea00640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90300678f0 0x7f9030069db0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f90400073b0 tx=0x7f904000c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:30.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:30.883+0000 7f9046a00640 1 -- 172.21.15.5:0/3761538288 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f903c016110 con 0x7f90500ce6c0 2024-08-18T22:32:31.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 -- 172.21.15.5:0/3761538288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f90500cd910 con 0x7f90500ce6c0 2024-08-18T22:32:31.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9046a00640 1 -- 172.21.15.5:0/3761538288 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v187) ==== 84+0+65 (secure 0 0 0) 0x7f903c0f0780 con 0x7f90500ce6c0 2024-08-18T22:32:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:31.051 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:32:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:32:31.051 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:32:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:32:31.052 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:31.052 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:32:31.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 -- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90300678f0 msgr2=0x7f9030069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:31.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90300678f0 0x7f9030069db0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f90400073b0 tx=0x7f904000c040 comp rx=0 tx=0).stop 2024-08-18T22:32:31.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 -- 172.21.15.5:0/3761538288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90500ce6c0 msgr2=0x7f90501fac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:31.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90500ce6c0 0x7f90501fac40 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f903c0ae040 tx=0x7f903c0192c0 comp rx=0 tx=0).stop 2024-08-18T22:32:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 -- 172.21.15.5:0/3761538288 shutdown_connections 2024-08-18T22:32:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f90300678f0 0x7f9030069db0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f905015a800 0x7f9050157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90500ce6c0 0x7f90501fac40 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 --2- 172.21.15.5:0/3761538288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90500ce280 0x7f90500aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 -- 172.21.15.5:0/3761538288 >> 172.21.15.5:0/3761538288 conn(0x7f90500b1c50 msgr2=0x7f905006ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 -- 172.21.15.5:0/3761538288 shutdown_connections 2024-08-18T22:32:31.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.051+0000 7f9055a00640 1 -- 172.21.15.5:0/3761538288 wait complete. 2024-08-18T22:32:31.074 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:32:31.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:32:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.219+0000 7f1b11400640 1 Processor -- start 2024-08-18T22:32:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.219+0000 7f1b11400640 1 -- start start 2024-08-18T22:32:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b11400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 0x7f1b0c0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b11400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b0c0afee0 0x7f1b0c0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b11400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b0c070cf0 con 0x7f1b0c0708e0 2024-08-18T22:32:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b11400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0c1486b0 con 0x7f1b0c0afee0 2024-08-18T22:32:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b11400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0c0b3c60 con 0x7f1b0c147ce0 2024-08-18T22:32:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b0b200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1b0c0708e0 0x7f1b0c06e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47662/0 (socket says 172.21.15.5:47662) 2024-08-18T22:32:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b0b200640 1 -- 172.21.15.5:0/3436510646 learned_addr learned my addr 172.21.15.5:0/3436510646 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b0a800640 1 --2- 172.21.15.5:0/3436510646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 0x7f1b0c0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b03e00640 1 --2- 172.21.15.5:0/3436510646 >> v2:172.21.15.117:3300/0 conn(0x7f1b0c0afee0 0x7f1b0c0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b09e00640 1 -- 172.21.15.5:0/3436510646 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085641245 0 0) 0x7f1b040014a0 con 0x7f1b0c0708e0 2024-08-18T22:32:31.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b09e00640 1 -- 172.21.15.5:0/3436510646 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1af0003530 con 0x7f1b0c0708e0 2024-08-18T22:32:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b0a800640 1 -- 172.21.15.5:0/3436510646 >> v2:172.21.15.117:3300/0 conn(0x7f1b0c0afee0 msgr2=0x7f1b0c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b0a800640 1 --2- 172.21.15.5:0/3436510646 >> v2:172.21.15.117:3300/0 conn(0x7f1b0c0afee0 0x7f1b0c0703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b0a800640 1 -- 172.21.15.5:0/3436510646 >> v1:172.21.15.5:6789/0 conn(0x7f1b0c0708e0 legacy=0x7f1b0c06e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:31.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.223+0000 7f1b0a800640 1 -- 172.21.15.5:0/3436510646 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c0b3f40 con 0x7f1b0c147ce0 2024-08-18T22:32:31.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b0a800640 1 --2- 172.21.15.5:0/3436510646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 0x7f1b0c0af9a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0097c0 tx=0x7f1afc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0aca7786b9edb57 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:31.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b09e00640 1 -- 172.21.15.5:0/3436510646 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0b1070 con 0x7f1b0c147ce0 2024-08-18T22:32:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b09e00640 1 -- 172.21.15.5:0/3436510646 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1afc0ac410 con 0x7f1b0c147ce0 2024-08-18T22:32:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b09e00640 1 -- 172.21.15.5:0/3436510646 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0ac7e0 con 0x7f1b0c147ce0 2024-08-18T22:32:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b11400640 1 -- 172.21.15.5:0/3436510646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 msgr2=0x7f1b0c0af9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b11400640 1 --2- 172.21.15.5:0/3436510646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 0x7f1b0c0af9a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0097c0 tx=0x7f1afc01c4a0 comp rx=0 tx=0).stop 2024-08-18T22:32:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b11400640 1 -- 172.21.15.5:0/3436510646 shutdown_connections 2024-08-18T22:32:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b11400640 1 --2- 172.21.15.5:0/3436510646 >> v2:172.21.15.117:3300/0 conn(0x7f1b0c0afee0 0x7f1b0c0703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b11400640 1 --2- 172.21.15.5:0/3436510646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 0x7f1b0c0af9a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b11400640 1 -- 172.21.15.5:0/3436510646 >> 172.21.15.5:0/3436510646 conn(0x7f1b0c0732f0 msgr2=0x7f1b0c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b11400640 1 -- 172.21.15.5:0/3436510646 shutdown_connections 2024-08-18T22:32:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b11400640 1 -- 172.21.15.5:0/3436510646 wait complete. 2024-08-18T22:32:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b11400640 1 Processor -- start 2024-08-18T22:32:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.227+0000 7f1b11400640 1 -- start start 2024-08-18T22:32:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b11400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b0c0708e0 0x7f1b0c143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b11400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0c0afee0 0x7f1b0c161ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b11400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 0x7f1b0c1468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b11400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c16b640 con 0x7f1b0c0708e0 2024-08-18T22:32:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b11400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c16b4c0 con 0x7f1b0c0afee0 2024-08-18T22:32:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b11400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0c16b7c0 con 0x7f1b0c147ce0 2024-08-18T22:32:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b0a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b0c0708e0 0x7f1b0c143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b0a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b0c0708e0 0x7f1b0c143f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42454/0 (socket says 172.21.15.5:42454) 2024-08-18T22:32:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b0a800640 1 -- 172.21.15.5:0/3357401591 learned_addr learned my addr 172.21.15.5:0/3357401591 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b0b200640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 0x7f1b0c1468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b03e00640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0c0afee0 0x7f1b0c161ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b0a800640 1 -- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 msgr2=0x7f1b0c1468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b0a800640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 0x7f1b0c1468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b0a800640 1 -- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0c0afee0 msgr2=0x7f1b0c161ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b0a800640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0c0afee0 0x7f1b0c161ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b0a800640 1 -- 172.21.15.5:0/3357401591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c145050 con 0x7f1b0c0708e0 2024-08-18T22:32:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b0b200640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 0x7f1b0c1468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b03e00640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0c0afee0 0x7f1b0c161ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b0a800640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b0c0708e0 0x7f1b0c143f90 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f1afc01a0d0 tx=0x7f1afc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b02a00640 1 -- 172.21.15.5:0/3357401591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0b1040 con 0x7f1b0c0708e0 2024-08-18T22:32:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b02a00640 1 -- 172.21.15.5:0/3357401591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1afc0ba070 con 0x7f1b0c0708e0 2024-08-18T22:32:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b02a00640 1 -- 172.21.15.5:0/3357401591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0b5430 con 0x7f1b0c0708e0 2024-08-18T22:32:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b11400640 1 -- 172.21.15.5:0/3357401591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0c144600 con 0x7f1b0c0708e0 2024-08-18T22:32:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b11400640 1 -- 172.21.15.5:0/3357401591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0c1fb630 con 0x7f1b0c0708e0 2024-08-18T22:32:31.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b11400640 1 -- 172.21.15.5:0/3357401591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0c068f50 con 0x7f1b0c0708e0 2024-08-18T22:32:31.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.231+0000 7f1b02a00640 1 -- 172.21.15.5:0/3357401591 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1afc0b55d0 con 0x7f1b0c0708e0 2024-08-18T22:32:31.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.235+0000 7f1b02a00640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ae80678c0 0x7f1ae8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:31.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.235+0000 7f1b02a00640 1 -- 172.21.15.5:0/3357401591 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5249+0+0 (secure 0 0 0) 0x7f1afc11f180 con 0x7f1b0c0708e0 2024-08-18T22:32:31.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.235+0000 7f1b03e00640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ae80678c0 0x7f1ae8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:31.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.235+0000 7f1b03e00640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ae80678c0 0x7f1ae8069d80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c135880 tx=0x7f1af4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:31.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.239+0000 7f1b02a00640 1 -- 172.21.15.5:0/3357401591 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1afc016090 con 0x7f1b0c0708e0 2024-08-18T22:32:31.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:31.403+0000 7f1b11400640 1 -- 172.21.15.5:0/3357401591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1b0c0703a0 con 0x7f1b0c0708e0 2024-08-18T22:32:32.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.299+0000 7f1b02a00640 1 -- 172.21.15.5:0/3357401591 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v188) ==== 138+0+0 (secure 0 0 0) 0x7f1afc0efe70 con 0x7f1b0c0708e0 2024-08-18T22:32:32.300 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:32:32.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 -- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ae80678c0 msgr2=0x7f1ae8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:32.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ae80678c0 0x7f1ae8069d80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c135880 tx=0x7f1af4008040 comp rx=0 tx=0).stop 2024-08-18T22:32:32.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 -- 172.21.15.5:0/3357401591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b0c0708e0 msgr2=0x7f1b0c143f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:32.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b0c0708e0 0x7f1b0c143f90 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f1afc01a0d0 tx=0x7f1afc019240 comp rx=0 tx=0).stop 2024-08-18T22:32:32.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 -- 172.21.15.5:0/3357401591 shutdown_connections 2024-08-18T22:32:32.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1ae80678c0 0x7f1ae8069d80 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b0c147ce0 0x7f1b0c1468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b0c0afee0 0x7f1b0c161ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 --2- 172.21.15.5:0/3357401591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b0c0708e0 0x7f1b0c143f90 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 -- 172.21.15.5:0/3357401591 >> 172.21.15.5:0/3357401591 conn(0x7f1b0c0732f0 msgr2=0x7f1b0c0b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:32.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 -- 172.21.15.5:0/3357401591 shutdown_connections 2024-08-18T22:32:32.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.303+0000 7f1b11400640 1 -- 172.21.15.5:0/3357401591 wait complete. 2024-08-18T22:32:32.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:32:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff20e00640 1 Processor -- start 2024-08-18T22:32:32.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff20e00640 1 -- start start 2024-08-18T22:32:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff20e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c15b0c0 0x7eff1c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff20e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7eff1c0b40c0 0x7eff1c0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff20e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff1c072a30 0x7eff1c072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff20e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7eff1c0b3d70 con 0x7eff1c072a30 2024-08-18T22:32:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff20e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7eff1c0b4a40 con 0x7eff1c0b40c0 2024-08-18T22:32:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff20e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c0b31f0 con 0x7eff1c15b0c0 2024-08-18T22:32:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff1a800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff1c072a30 0x7eff1c072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff1a800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff1c072a30 0x7eff1c072ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42460/0 (socket says 172.21.15.5:42460) 2024-08-18T22:32:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff1a800640 1 -- 172.21.15.5:0/3066426147 learned_addr learned my addr 172.21.15.5:0/3066426147 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff19e00640 1 --2- 172.21.15.5:0/3066426147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c15b0c0 0x7eff1c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff19400640 1 --2- 172.21.15.5:0/3066426147 >> v2:172.21.15.117:3300/0 conn(0x7eff1c0b40c0 0x7eff1c0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff1a800640 1 -- 172.21.15.5:0/3066426147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c15b0c0 msgr2=0x7eff1c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff1a800640 1 --2- 172.21.15.5:0/3066426147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c15b0c0 0x7eff1c06db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff1a800640 1 -- 172.21.15.5:0/3066426147 >> v2:172.21.15.117:3300/0 conn(0x7eff1c0b40c0 msgr2=0x7eff1c0b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff1a800640 1 --2- 172.21.15.5:0/3066426147 >> v2:172.21.15.117:3300/0 conn(0x7eff1c0b40c0 0x7eff1c0b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.483+0000 7eff1a800640 1 -- 172.21.15.5:0/3066426147 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c0b34d0 con 0x7eff1c072a30 2024-08-18T22:32:32.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff1a800640 1 --2- 172.21.15.5:0/3066426147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c072a30 0x7eff1c072ea0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7eff1c06d330 tx=0x7eff1401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b6b088ab25e11a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:32.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff18a00640 1 -- 172.21.15.5:0/3066426147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140a5720 con 0x7eff1c072a30 2024-08-18T22:32:32.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff18a00640 1 -- 172.21.15.5:0/3066426147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff140a58c0 con 0x7eff1c072a30 2024-08-18T22:32:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff18a00640 1 -- 172.21.15.5:0/3066426147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140a5c90 con 0x7eff1c072a30 2024-08-18T22:32:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff20e00640 1 -- 172.21.15.5:0/3066426147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c072a30 msgr2=0x7eff1c072ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff20e00640 1 --2- 172.21.15.5:0/3066426147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c072a30 0x7eff1c072ea0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7eff1c06d330 tx=0x7eff1401c8a0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff20e00640 1 -- 172.21.15.5:0/3066426147 shutdown_connections 2024-08-18T22:32:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff20e00640 1 --2- 172.21.15.5:0/3066426147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c072a30 0x7eff1c072ea0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff20e00640 1 --2- 172.21.15.5:0/3066426147 >> v2:172.21.15.117:3300/0 conn(0x7eff1c0b40c0 0x7eff1c0b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff20e00640 1 --2- 172.21.15.5:0/3066426147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c15b0c0 0x7eff1c06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff20e00640 1 -- 172.21.15.5:0/3066426147 >> 172.21.15.5:0/3066426147 conn(0x7eff1c0b1dc0 msgr2=0x7eff1c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff20e00640 1 -- 172.21.15.5:0/3066426147 shutdown_connections 2024-08-18T22:32:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.487+0000 7eff20e00640 1 -- 172.21.15.5:0/3066426147 wait complete. 2024-08-18T22:32:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff20e00640 1 Processor -- start 2024-08-18T22:32:32.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff20e00640 1 -- start start 2024-08-18T22:32:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff20e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c072a30 0x7eff1c15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff20e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0b40c0 0x7eff1c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff20e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c15b0c0 0x7eff1c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff20e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c15b620 con 0x7eff1c072a30 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff20e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c15b4a0 con 0x7eff1c0b40c0 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff20e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c0737f0 con 0x7eff1c15b0c0 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff19e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c072a30 0x7eff1c15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff19e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c072a30 0x7eff1c15b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42464/0 (socket says 172.21.15.5:42464) 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff19e00640 1 -- 172.21.15.5:0/2700626883 learned_addr learned my addr 172.21.15.5:0/2700626883 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff19400640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0b40c0 0x7eff1c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff1a800640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c15b0c0 0x7eff1c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff19e00640 1 -- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c15b0c0 msgr2=0x7eff1c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff19e00640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c15b0c0 0x7eff1c0af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff19e00640 1 -- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0b40c0 msgr2=0x7eff1c15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff19e00640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0b40c0 0x7eff1c15e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff19e00640 1 -- 172.21.15.5:0/2700626883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c15dd20 con 0x7eff1c072a30 2024-08-18T22:32:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff19e00640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c072a30 0x7eff1c15b7a0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00d5f0 tx=0x7eff0c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff12000640 1 -- 172.21.15.5:0/2700626883 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0125f0 con 0x7eff1c072a30 2024-08-18T22:32:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff12000640 1 -- 172.21.15.5:0/2700626883 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0c019070 con 0x7eff1c072a30 2024-08-18T22:32:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff12000640 1 -- 172.21.15.5:0/2700626883 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0129b0 con 0x7eff1c072a30 2024-08-18T22:32:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff20e00640 1 -- 172.21.15.5:0/2700626883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c15bce0 con 0x7eff1c072a30 2024-08-18T22:32:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff20e00640 1 -- 172.21.15.5:0/2700626883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c0b0430 con 0x7eff1c072a30 2024-08-18T22:32:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.491+0000 7eff20e00640 1 -- 172.21.15.5:0/2700626883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c06f670 con 0x7eff1c072a30 2024-08-18T22:32:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.495+0000 7eff12000640 1 -- 172.21.15.5:0/2700626883 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff0c012b50 con 0x7eff1c072a30 2024-08-18T22:32:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.495+0000 7eff12000640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.495+0000 7eff12000640 1 -- 172.21.15.5:0/2700626883 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5619+0+0 (secure 0 0 0) 0x7eff0c085f60 con 0x7eff1c072a30 2024-08-18T22:32:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.495+0000 7eff19400640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.495+0000 7eff19400640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efefc0678c0 0x7efefc069d80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0cbff0 tx=0x7eff08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:32.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.499+0000 7eff12000640 1 -- 172.21.15.5:0/2700626883 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7eff0c056400 con 0x7eff1c072a30 2024-08-18T22:32:32.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:32.667+0000 7eff20e00640 1 -- 172.21.15.5:0/2700626883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7eff1c0b45a0 con 0x7eff1c072a30 2024-08-18T22:32:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.311+0000 7eff12000640 1 -- 172.21.15.5:0/2700626883 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v189) ==== 170+0+0 (secure 0 0 0) 0x7eff0c05a700 con 0x7eff1c072a30 2024-08-18T22:32:33.311 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:32:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 -- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efefc0678c0 msgr2=0x7efefc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efefc0678c0 0x7efefc069d80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0cbff0 tx=0x7eff08008040 comp rx=0 tx=0).stop 2024-08-18T22:32:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 -- 172.21.15.5:0/2700626883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c072a30 msgr2=0x7eff1c15b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c072a30 0x7eff1c15b7a0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00d5f0 tx=0x7eff0c00dab0 comp rx=0 tx=0).stop 2024-08-18T22:32:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 -- 172.21.15.5:0/2700626883 shutdown_connections 2024-08-18T22:32:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c15b0c0 0x7eff1c0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0b40c0 0x7eff1c15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 --2- 172.21.15.5:0/2700626883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1c072a30 0x7eff1c15b7a0 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 -- 172.21.15.5:0/2700626883 >> 172.21.15.5:0/2700626883 conn(0x7eff1c0b1dc0 msgr2=0x7eff1c159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 -- 172.21.15.5:0/2700626883 shutdown_connections 2024-08-18T22:32:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.315+0000 7eff20e00640 1 -- 172.21.15.5:0/2700626883 wait complete. 2024-08-18T22:32:33.355 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:32:33.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2e600640 1 Processor -- start 2024-08-18T22:32:33.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2e600640 1 -- start start 2024-08-18T22:32:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa280b4970 0x7faa28166060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2e600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faa280735b0 0x7faa28163250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2e600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa28162a70 con 0x7faa28163790 2024-08-18T22:32:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2e600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faa281665a0 con 0x7faa280735b0 2024-08-18T22:32:33.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faa28162dc0 con 0x7faa280b4970 2024-08-18T22:32:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2dc00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faa28163790 0x7faa2806b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47668/0 (socket says 172.21.15.5:47668) 2024-08-18T22:32:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2dc00640 1 -- 172.21.15.5:0/4161166200 learned_addr learned my addr 172.21.15.5:0/4161166200 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2d200640 1 --2- 172.21.15.5:0/4161166200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa280b4970 0x7faa28166060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:33.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa27e00640 1 --2- 172.21.15.5:0/4161166200 >> v2:172.21.15.117:3300/0 conn(0x7faa280735b0 0x7faa28163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa27400640 1 -- 172.21.15.5:0/4161166200 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854875682 0 0) 0x7faa28162a70 con 0x7faa28163790 2024-08-18T22:32:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa27400640 1 -- 172.21.15.5:0/4161166200 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa10003530 con 0x7faa28163790 2024-08-18T22:32:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2d200640 1 -- 172.21.15.5:0/4161166200 >> v2:172.21.15.117:3300/0 conn(0x7faa280735b0 msgr2=0x7faa28163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2d200640 1 --2- 172.21.15.5:0/4161166200 >> v2:172.21.15.117:3300/0 conn(0x7faa280735b0 0x7faa28163250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2d200640 1 -- 172.21.15.5:0/4161166200 >> v1:172.21.15.5:6789/0 conn(0x7faa28163790 legacy=0x7faa2806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:33.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.503+0000 7faa2d200640 1 -- 172.21.15.5:0/4161166200 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa281667d0 con 0x7faa280b4970 2024-08-18T22:32:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa2d200640 1 --2- 172.21.15.5:0/4161166200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa280b4970 0x7faa28166060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0097c0 tx=0x7faa1c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d4f7b0745039c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa27400640 1 -- 172.21.15.5:0/4161166200 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0ab610 con 0x7faa280b4970 2024-08-18T22:32:33.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa27400640 1 -- 172.21.15.5:0/4161166200 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c0b0070 con 0x7faa280b4970 2024-08-18T22:32:33.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa27400640 1 -- 172.21.15.5:0/4161166200 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0ab9d0 con 0x7faa280b4970 2024-08-18T22:32:33.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa2e600640 1 -- 172.21.15.5:0/4161166200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa280b4970 msgr2=0x7faa28166060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa2e600640 1 --2- 172.21.15.5:0/4161166200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa280b4970 0x7faa28166060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0097c0 tx=0x7faa1c01c410 comp rx=0 tx=0).stop 2024-08-18T22:32:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa2e600640 1 -- 172.21.15.5:0/4161166200 shutdown_connections 2024-08-18T22:32:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa2e600640 1 --2- 172.21.15.5:0/4161166200 >> v2:172.21.15.117:3300/0 conn(0x7faa280735b0 0x7faa28163250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa2e600640 1 --2- 172.21.15.5:0/4161166200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa280b4970 0x7faa28166060 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa2e600640 1 -- 172.21.15.5:0/4161166200 >> 172.21.15.5:0/4161166200 conn(0x7faa280d1000 msgr2=0x7faa280d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa2e600640 1 -- 172.21.15.5:0/4161166200 shutdown_connections 2024-08-18T22:32:33.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.507+0000 7faa2e600640 1 -- 172.21.15.5:0/4161166200 wait complete. 2024-08-18T22:32:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2e600640 1 Processor -- start 2024-08-18T22:32:33.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2e600640 1 -- start start 2024-08-18T22:32:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa280735b0 0x7faa2815da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2e600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa280b4970 0x7faa280b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2e600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa28163790 0x7faa28160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2e600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faa280707f0 con 0x7faa28163790 2024-08-18T22:32:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2e600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faa28070670 con 0x7faa280b4970 2024-08-18T22:32:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7faa2806c0c0 con 0x7faa280735b0 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa28163790 0x7faa28160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2dc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa28163790 0x7faa28160870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42476/0 (socket says 172.21.15.5:42476) 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2dc00640 1 -- 172.21.15.5:0/2032429054 learned_addr learned my addr 172.21.15.5:0/2032429054 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa27e00640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa280b4970 0x7faa280b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2d200640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa280735b0 0x7faa2815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2dc00640 1 -- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa280735b0 msgr2=0x7faa2815da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2dc00640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa280735b0 0x7faa2815da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2dc00640 1 -- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa280b4970 msgr2=0x7faa280b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2dc00640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa280b4970 0x7faa280b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2dc00640 1 -- 172.21.15.5:0/2032429054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2815d700 con 0x7faa28163790 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa27e00640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa280b4970 0x7faa280b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:32:33.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2dc00640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa28163790 0x7faa28160870 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7faa2000ca70 tx=0x7faa2000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:33.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa24c00640 1 -- 172.21.15.5:0/2032429054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20017070 con 0x7faa28163790 2024-08-18T22:32:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa24c00640 1 -- 172.21.15.5:0/2032429054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2000abd0 con 0x7faa28163790 2024-08-18T22:32:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa24c00640 1 -- 172.21.15.5:0/2032429054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20012400 con 0x7faa28163790 2024-08-18T22:32:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2e600640 1 -- 172.21.15.5:0/2032429054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2815d140 con 0x7faa28163790 2024-08-18T22:32:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2e600640 1 -- 172.21.15.5:0/2032429054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa28160070 con 0x7faa28163790 2024-08-18T22:32:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.511+0000 7faa2e600640 1 -- 172.21.15.5:0/2032429054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa28163230 con 0x7faa28163790 2024-08-18T22:32:33.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.515+0000 7faa24c00640 1 -- 172.21.15.5:0/2032429054 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa2001a070 con 0x7faa28163790 2024-08-18T22:32:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.515+0000 7faa24c00640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa080678f0 0x7faa08069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.515+0000 7faa24c00640 1 -- 172.21.15.5:0/2032429054 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6001+0+0 (secure 0 0 0) 0x7faa20085ea0 con 0x7faa28163790 2024-08-18T22:32:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.515+0000 7faa2d200640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa080678f0 0x7faa08069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:33.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.515+0000 7faa2d200640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa080678f0 0x7faa08069db0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0af000 tx=0x7faa1c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:33.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.519+0000 7faa24c00640 1 -- 172.21.15.5:0/2032429054 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7faa20056240 con 0x7faa28163790 2024-08-18T22:32:33.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:33.719+0000 7faa2e600640 1 -- 172.21.15.5:0/2032429054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7faa28164e00 con 0x7faa28163790 2024-08-18T22:32:34.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.331+0000 7faa24c00640 1 -- 172.21.15.5:0/2032429054 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 27 and data pool 28 v147) ==== 174+0+0 (secure 0 0 0) 0x7faa2005a540 con 0x7faa28163790 2024-08-18T22:32:34.332 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 27 and data pool 28 2024-08-18T22:32:34.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.339+0000 7faa2e600640 1 -- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa080678f0 msgr2=0x7faa08069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.339+0000 7faa2e600640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa080678f0 0x7faa08069db0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0af000 tx=0x7faa1c0a7000 comp rx=0 tx=0).stop 2024-08-18T22:32:34.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.339+0000 7faa2e600640 1 -- 172.21.15.5:0/2032429054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa28163790 msgr2=0x7faa28160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.339+0000 7faa2e600640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa28163790 0x7faa28160870 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7faa2000ca70 tx=0x7faa2000cf30 comp rx=0 tx=0).stop 2024-08-18T22:32:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.347+0000 7faa2e600640 1 -- 172.21.15.5:0/2032429054 shutdown_connections 2024-08-18T22:32:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.347+0000 7faa2e600640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7faa080678f0 0x7faa08069db0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.347+0000 7faa2e600640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa28163790 0x7faa28160870 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.347+0000 7faa2e600640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa280b4970 0x7faa280b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.347+0000 7faa2e600640 1 --2- 172.21.15.5:0/2032429054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa280735b0 0x7faa2815da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.347+0000 7faa2e600640 1 -- 172.21.15.5:0/2032429054 >> 172.21.15.5:0/2032429054 conn(0x7faa280d1000 msgr2=0x7faa28165320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.347+0000 7faa2e600640 1 -- 172.21.15.5:0/2032429054 shutdown_connections 2024-08-18T22:32:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.347+0000 7faa2e600640 1 -- 172.21.15.5:0/2032429054 wait complete. 2024-08-18T22:32:34.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:32:34.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.511+0000 7f8f19a00640 1 Processor -- start 2024-08-18T22:32:34.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.511+0000 7f8f19a00640 1 -- start start 2024-08-18T22:32:34.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f19a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8f14161540 0x7f8f1415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:34.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f19a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f1406f100 0x7f8f1415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f19a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1406f950 con 0x7f8f1415e7a0 2024-08-18T22:32:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f19a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8f141600a0 con 0x7f8f14161540 2024-08-18T22:32:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f19a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1415f600 con 0x7f8f1406f100 2024-08-18T22:32:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f12a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8f1415e7a0 0x7f8f1406e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49104/0 (socket says 172.21.15.5:49104) 2024-08-18T22:32:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f12a00640 1 -- 172.21.15.5:0/2134368377 learned_addr learned my addr 172.21.15.5:0/2134368377 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f12000640 1 --2- 172.21.15.5:0/2134368377 >> v2:172.21.15.117:3300/0 conn(0x7f8f14161540 0x7f8f1415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:34.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f13400640 1 --2- 172.21.15.5:0/2134368377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f1406f100 0x7f8f1415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f11600640 1 -- 172.21.15.5:0/2134368377 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433073104 0 0) 0x7f8f1406f950 con 0x7f8f1415e7a0 2024-08-18T22:32:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f11600640 1 -- 172.21.15.5:0/2134368377 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ef8003530 con 0x7f8f1415e7a0 2024-08-18T22:32:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f12000640 1 -- 172.21.15.5:0/2134368377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f1406f100 msgr2=0x7f8f1415f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f12000640 1 --2- 172.21.15.5:0/2134368377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f1406f100 0x7f8f1415f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f12000640 1 -- 172.21.15.5:0/2134368377 >> v1:172.21.15.5:6789/0 conn(0x7f8f1415e7a0 legacy=0x7f8f1406e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f11600640 1 -- 172.21.15.5:0/2134368377 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4079969050 0 0) 0x7f8ef8003530 con 0x7f8f1415e7a0 2024-08-18T22:32:34.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.515+0000 7f8f12000640 1 -- 172.21.15.5:0/2134368377 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1406f670 con 0x7f8f14161540 2024-08-18T22:32:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f12000640 1 --2- 172.21.15.5:0/2134368377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f14161540 0x7f8f1415eb80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8f000097c0 tx=0x7f8f0001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a352fd28ada4ff2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f11600640 1 -- 172.21.15.5:0/2134368377 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f000b0070 con 0x7f8f14161540 2024-08-18T22:32:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f11600640 1 -- 172.21.15.5:0/2134368377 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f000ab400 con 0x7f8f14161540 2024-08-18T22:32:34.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f11600640 1 -- 172.21.15.5:0/2134368377 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04001680 con 0x7f8f14161540 2024-08-18T22:32:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f19a00640 1 -- 172.21.15.5:0/2134368377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f14161540 msgr2=0x7f8f1415eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f19a00640 1 --2- 172.21.15.5:0/2134368377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f14161540 0x7f8f1415eb80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8f000097c0 tx=0x7f8f0001c3c0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f19a00640 1 -- 172.21.15.5:0/2134368377 shutdown_connections 2024-08-18T22:32:34.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f19a00640 1 --2- 172.21.15.5:0/2134368377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f1406f100 0x7f8f1415f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f19a00640 1 --2- 172.21.15.5:0/2134368377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f14161540 0x7f8f1415eb80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f19a00640 1 -- 172.21.15.5:0/2134368377 >> 172.21.15.5:0/2134368377 conn(0x7f8f14070190 msgr2=0x7f8f1406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f19a00640 1 -- 172.21.15.5:0/2134368377 shutdown_connections 2024-08-18T22:32:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f19a00640 1 -- 172.21.15.5:0/2134368377 wait complete. 2024-08-18T22:32:34.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f19a00640 1 Processor -- start 2024-08-18T22:32:34.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.519+0000 7f8f19a00640 1 -- start start 2024-08-18T22:32:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f19a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f1406f100 0x7f8f1415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f19a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f1415e7a0 0x7f8f1413ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f19a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f14161540 0x7f8f1415da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f19a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1416a950 con 0x7f8f1406f100 2024-08-18T22:32:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f19a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1416a7d0 con 0x7f8f1415e7a0 2024-08-18T22:32:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f19a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1416aad0 con 0x7f8f14161540 2024-08-18T22:32:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f12a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f1406f100 0x7f8f1415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f12a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f1406f100 0x7f8f1415a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46784/0 (socket says 172.21.15.5:46784) 2024-08-18T22:32:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f12a00640 1 -- 172.21.15.5:0/3548380046 learned_addr learned my addr 172.21.15.5:0/3548380046 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f12a00640 1 -- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f14161540 msgr2=0x7f8f1415da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f12a00640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f14161540 0x7f8f1415da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f12a00640 1 -- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f1415e7a0 msgr2=0x7f8f1413ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f12000640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f1415e7a0 0x7f8f1413ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f12a00640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f1415e7a0 0x7f8f1413ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f12a00640 1 -- 172.21.15.5:0/3548380046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1413f490 con 0x7f8f1406f100 2024-08-18T22:32:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f12a00640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f1406f100 0x7f8f1415a2a0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400c6e0 tx=0x7f8f0400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f0aa00640 1 -- 172.21.15.5:0/3548380046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04017070 con 0x7f8f1406f100 2024-08-18T22:32:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f0aa00640 1 -- 172.21.15.5:0/3548380046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f04005ae0 con 0x7f8f1406f100 2024-08-18T22:32:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f0aa00640 1 -- 172.21.15.5:0/3548380046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04007070 con 0x7f8f1406f100 2024-08-18T22:32:34.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f19a00640 1 -- 172.21.15.5:0/3548380046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f14159200 con 0x7f8f1406f100 2024-08-18T22:32:34.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f19a00640 1 -- 172.21.15.5:0/3548380046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f141597c0 con 0x7f8f1406f100 2024-08-18T22:32:34.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f19a00640 1 -- 172.21.15.5:0/3548380046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1406e9f0 con 0x7f8f1406f100 2024-08-18T22:32:34.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.523+0000 7f8f0aa00640 1 -- 172.21.15.5:0/3548380046 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f0401a070 con 0x7f8f1406f100 2024-08-18T22:32:34.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.527+0000 7f8f0aa00640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ef40678c0 0x7f8ef4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:34.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.527+0000 7f8f0aa00640 1 -- 172.21.15.5:0/3548380046 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 6101+0+0 (secure 0 0 0) 0x7f8f04085360 con 0x7f8f1406f100 2024-08-18T22:32:34.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.527+0000 7f8f12000640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ef40678c0 0x7f8ef4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:34.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.527+0000 7f8f12000640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ef40678c0 0x7f8ef4069d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8f000ad000 tx=0x7f8f000a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:34.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.531+0000 7f8f0aa00640 1 -- 172.21.15.5:0/3548380046 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8f04055d00 con 0x7f8f1406f100 2024-08-18T22:32:34.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.699+0000 7f8f19a00640 1 -- 172.21.15.5:0/3548380046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f140b5240 con 0x7f8f1406f100 2024-08-18T22:32:34.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f0aa00640 1 -- 172.21.15.5:0/3548380046 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) ==== 74+0+16893 (secure 0 0 0) 0x7f8f04055600 con 0x7f8f1406f100 2024-08-18T22:32:34.702 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:34.702 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":190,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:32:33.724599+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:32:31.454782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-08-18T22:32:32.720083+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:32:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 -- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ef40678c0 msgr2=0x7f8ef4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ef40678c0 0x7f8ef4069d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8f000ad000 tx=0x7f8f000a6000 comp rx=0 tx=0).stop 2024-08-18T22:32:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 -- 172.21.15.5:0/3548380046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f1406f100 msgr2=0x7f8f1415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f1406f100 0x7f8f1415a2a0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400c6e0 tx=0x7f8f0400cba0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 -- 172.21.15.5:0/3548380046 shutdown_connections 2024-08-18T22:32:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8ef40678c0 0x7f8ef4069d80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f14161540 0x7f8f1415da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f1415e7a0 0x7f8f1413ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 --2- 172.21.15.5:0/3548380046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f1406f100 0x7f8f1415a2a0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 -- 172.21.15.5:0/3548380046 >> 172.21.15.5:0/3548380046 conn(0x7f8f14070190 msgr2=0x7f8f140b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 -- 172.21.15.5:0/3548380046 shutdown_connections 2024-08-18T22:32:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.703+0000 7f8f19a00640 1 -- 172.21.15.5:0/3548380046 wait complete. 2024-08-18T22:32:34.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:32:34.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.863+0000 7fe17b000640 1 Processor -- start 2024-08-18T22:32:34.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.863+0000 7fe17b000640 1 -- start start 2024-08-18T22:32:34.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.863+0000 7fe17b000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe17415a800 0x7fe1740caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:34.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe17b000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1740cb5d0 con 0x7fe1740cca00 2024-08-18T22:32:34.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe17b000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe174072e60 con 0x7fe1740cce20 2024-08-18T22:32:34.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe17b000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe174073140 con 0x7fe17415a800 2024-08-18T22:32:34.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe173400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe1740cca00 0x7fe1740ce280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49116/0 (socket says 172.21.15.5:49116) 2024-08-18T22:32:34.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe173400640 1 -- 172.21.15.5:0/17590779 learned_addr learned my addr 172.21.15.5:0/17590779 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:34.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe173e00640 1 --2- 172.21.15.5:0/17590779 >> v2:172.21.15.5:3300/0 conn(0x7fe17415a800 0x7fe1740caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe173e00640 1 -- 172.21.15.5:0/17590779 >> v1:172.21.15.117:6789/0 conn(0x7fe1740cce20 legacy=0x7fe17406ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe173e00640 1 -- 172.21.15.5:0/17590779 >> v1:172.21.15.5:6789/0 conn(0x7fe1740cca00 legacy=0x7fe1740ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe172a00640 1 -- 172.21.15.5:0/17590779 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778453521 0 0) 0x7fe1740cb5d0 con 0x7fe1740cca00 2024-08-18T22:32:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe173e00640 1 -- 172.21.15.5:0/17590779 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1740ce990 con 0x7fe17415a800 2024-08-18T22:32:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe173e00640 1 --2- 172.21.15.5:0/17590779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17415a800 0x7fe1740caec0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fe164009d90 tx=0x7fe16401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed223d92916b8939 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe172a00640 1 -- 172.21.15.5:0/17590779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1640b2070 con 0x7fe17415a800 2024-08-18T22:32:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe172a00640 1 -- 172.21.15.5:0/17590779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1640a5730 con 0x7fe17415a800 2024-08-18T22:32:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.867+0000 7fe172a00640 1 -- 172.21.15.5:0/17590779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1640a5b00 con 0x7fe17415a800 2024-08-18T22:32:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 -- 172.21.15.5:0/17590779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17415a800 msgr2=0x7fe1740caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 --2- 172.21.15.5:0/17590779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17415a800 0x7fe1740caec0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fe164009d90 tx=0x7fe16401c970 comp rx=0 tx=0).stop 2024-08-18T22:32:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 -- 172.21.15.5:0/17590779 shutdown_connections 2024-08-18T22:32:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 --2- 172.21.15.5:0/17590779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17415a800 0x7fe1740caec0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 -- 172.21.15.5:0/17590779 >> 172.21.15.5:0/17590779 conn(0x7fe1740b1c50 msgr2=0x7fe1740b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 -- 172.21.15.5:0/17590779 shutdown_connections 2024-08-18T22:32:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 -- 172.21.15.5:0/17590779 wait complete. 2024-08-18T22:32:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 Processor -- start 2024-08-18T22:32:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 -- start start 2024-08-18T22:32:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1740cca00 0x7fe17415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1740cce20 0x7fe1740b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe17415a800 0x7fe1741475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe17415edf0 con 0x7fe1740cce20 2024-08-18T22:32:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe17415ec70 con 0x7fe17415a800 2024-08-18T22:32:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe17b000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe17415ef70 con 0x7fe1740cca00 2024-08-18T22:32:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe173400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1740cce20 0x7fe1740b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe173400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1740cce20 0x7fe1740b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46800/0 (socket says 172.21.15.5:46800) 2024-08-18T22:32:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe173400640 1 -- 172.21.15.5:0/3699568823 learned_addr learned my addr 172.21.15.5:0/3699568823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe173e00640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1740cca00 0x7fe17415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe179000640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe17415a800 0x7fe1741475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe173400640 1 -- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1740cca00 msgr2=0x7fe17415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe173400640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1740cca00 0x7fe17415abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe173400640 1 -- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe17415a800 msgr2=0x7fe1741475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe173400640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe17415a800 0x7fe1741475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.871+0000 7fe173400640 1 -- 172.21.15.5:0/3699568823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe174159dc0 con 0x7fe1740cce20 2024-08-18T22:32:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.875+0000 7fe173400640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1740cce20 0x7fe1740b5380 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c410 tx=0x7fe16000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.875+0000 7fe16be00640 1 -- 172.21.15.5:0/3699568823 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1600074e0 con 0x7fe1740cce20 2024-08-18T22:32:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.875+0000 7fe16be00640 1 -- 172.21.15.5:0/3699568823 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1600047f0 con 0x7fe1740cce20 2024-08-18T22:32:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.875+0000 7fe16be00640 1 -- 172.21.15.5:0/3699568823 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160007680 con 0x7fe1740cce20 2024-08-18T22:32:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.875+0000 7fe17b000640 1 -- 172.21.15.5:0/3699568823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe174159800 con 0x7fe1740cce20 2024-08-18T22:32:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.875+0000 7fe17b000640 1 -- 172.21.15.5:0/3699568823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17409ce70 con 0x7fe1740cce20 2024-08-18T22:32:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.875+0000 7fe17b000640 1 -- 172.21.15.5:0/3699568823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1740caec0 con 0x7fe1740cce20 2024-08-18T22:32:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.875+0000 7fe16be00640 1 -- 172.21.15.5:0/3699568823 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe160011070 con 0x7fe1740cce20 2024-08-18T22:32:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.875+0000 7fe16be00640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1540678f0 0x7fe154069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.875+0000 7fe16be00640 1 -- 172.21.15.5:0/3699568823 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 6101+0+0 (secure 0 0 0) 0x7fe1600859c0 con 0x7fe1740cce20 2024-08-18T22:32:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.875+0000 7fe173e00640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1540678f0 0x7fe154069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.879+0000 7fe173e00640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1540678f0 0x7fe154069db0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe1640af000 tx=0x7fe1640a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:34.879+0000 7fe16be00640 1 -- 172.21.15.5:0/3699568823 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe1600563a0 con 0x7fe1740cce20 2024-08-18T22:32:35.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 -- 172.21.15.5:0/3699568823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1740cd910 con 0x7fe1740cce20 2024-08-18T22:32:35.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe16be00640 1 -- 172.21.15.5:0/3699568823 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) ==== 74+0+16893 (secure 0 0 0) 0x7fe160055ca0 con 0x7fe1740cce20 2024-08-18T22:32:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:35.048 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":190,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:32:33.724599+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:32:31.454782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-08-18T22:32:32.720083+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:32:35.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 -- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1540678f0 msgr2=0x7fe154069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:35.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1540678f0 0x7fe154069db0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe1640af000 tx=0x7fe1640a7070 comp rx=0 tx=0).stop 2024-08-18T22:32:35.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 -- 172.21.15.5:0/3699568823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1740cce20 msgr2=0x7fe1740b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:35.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1740cce20 0x7fe1740b5380 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c410 tx=0x7fe16000c8d0 comp rx=0 tx=0).stop 2024-08-18T22:32:35.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 -- 172.21.15.5:0/3699568823 shutdown_connections 2024-08-18T22:32:35.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe1540678f0 0x7fe154069db0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:35.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe17415a800 0x7fe1741475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:35.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1740cce20 0x7fe1740b5380 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:35.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 --2- 172.21.15.5:0/3699568823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1740cca00 0x7fe17415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:35.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 -- 172.21.15.5:0/3699568823 >> 172.21.15.5:0/3699568823 conn(0x7fe1740b1c50 msgr2=0x7fe174168590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:35.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.047+0000 7fe17b000640 1 -- 172.21.15.5:0/3699568823 shutdown_connections 2024-08-18T22:32:35.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.051+0000 7fe17b000640 1 -- 172.21.15.5:0/3699568823 wait complete. 2024-08-18T22:32:35.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:32:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.211+0000 7f043a200640 1 Processor -- start 2024-08-18T22:32:35.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.211+0000 7f043a200640 1 -- start start 2024-08-18T22:32:35.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f043a200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04340b40c0 0x7f04340b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:35.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f043a200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04340ce280 0x7f04340ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:35.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f043a200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04340b31f0 con 0x7f043415b0c0 2024-08-18T22:32:35.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f043a200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f04340b3d70 con 0x7f04340ce280 2024-08-18T22:32:35.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f043a200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f04340b4a40 con 0x7f04340b40c0 2024-08-18T22:32:35.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f0433e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04340ce280 0x7f04340ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:35.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f0433e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04340ce280 0x7f04340ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46810/0 (socket says 172.21.15.5:46810) 2024-08-18T22:32:35.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f0433e00640 1 -- 172.21.15.5:0/1971306791 learned_addr learned my addr 172.21.15.5:0/1971306791 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:35.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f0432a00640 1 --2- 172.21.15.5:0/1971306791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04340b40c0 0x7f04340b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f0433e00640 1 -- 172.21.15.5:0/1971306791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04340b40c0 msgr2=0x7f04340b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f0433e00640 1 --2- 172.21.15.5:0/1971306791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04340b40c0 0x7f04340b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f0433e00640 1 -- 172.21.15.5:0/1971306791 >> v1:172.21.15.117:6789/0 conn(0x7f043415b0c0 legacy=0x7f043406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:35.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.215+0000 7f0433e00640 1 -- 172.21.15.5:0/1971306791 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04340b34d0 con 0x7f04340ce280 2024-08-18T22:32:35.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f0433e00640 1 --2- 172.21.15.5:0/1971306791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04340ce280 0x7f04340ce6d0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f042c009e50 tx=0x7f042c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cdd074532d5d70 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:35.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f0432000640 1 -- 172.21.15.5:0/1971306791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0a56c0 con 0x7f04340ce280 2024-08-18T22:32:35.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f0432000640 1 -- 172.21.15.5:0/1971306791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c0a5860 con 0x7f04340ce280 2024-08-18T22:32:35.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f0432000640 1 -- 172.21.15.5:0/1971306791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0a5c30 con 0x7f04340ce280 2024-08-18T22:32:35.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 -- 172.21.15.5:0/1971306791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04340ce280 msgr2=0x7f04340ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:35.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 --2- 172.21.15.5:0/1971306791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04340ce280 0x7f04340ce6d0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f042c009e50 tx=0x7f042c01c910 comp rx=0 tx=0).stop 2024-08-18T22:32:35.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 -- 172.21.15.5:0/1971306791 shutdown_connections 2024-08-18T22:32:35.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 --2- 172.21.15.5:0/1971306791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04340ce280 0x7f04340ce6d0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:35.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 --2- 172.21.15.5:0/1971306791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04340b40c0 0x7f04340b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 -- 172.21.15.5:0/1971306791 >> 172.21.15.5:0/1971306791 conn(0x7f04340b1dc0 msgr2=0x7f04340b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 -- 172.21.15.5:0/1971306791 shutdown_connections 2024-08-18T22:32:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 -- 172.21.15.5:0/1971306791 wait complete. 2024-08-18T22:32:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 Processor -- start 2024-08-18T22:32:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 -- start start 2024-08-18T22:32:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04340b40c0 0x7f04340998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04340ce280 0x7f0434152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f043415b0c0 0x7f0434151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f043406f7f0 con 0x7f04340b40c0 2024-08-18T22:32:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f043406f670 con 0x7f04340ce280 2024-08-18T22:32:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.219+0000 7f043a200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0434165d00 con 0x7f043415b0c0 2024-08-18T22:32:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0433400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04340b40c0 0x7f04340998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0433400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04340b40c0 0x7f04340998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46820/0 (socket says 172.21.15.5:46820) 2024-08-18T22:32:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0433400640 1 -- 172.21.15.5:0/2964252246 learned_addr learned my addr 172.21.15.5:0/2964252246 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0433e00640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f043415b0c0 0x7f0434151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0432a00640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04340ce280 0x7f0434152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0433400640 1 -- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f043415b0c0 msgr2=0x7f0434151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0433400640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f043415b0c0 0x7f0434151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0433400640 1 -- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04340ce280 msgr2=0x7f0434152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0433400640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04340ce280 0x7f0434152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0433400640 1 -- 172.21.15.5:0/2964252246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0434153a90 con 0x7f04340b40c0 2024-08-18T22:32:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0433e00640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f043415b0c0 0x7f0434151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f0433400640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04340b40c0 0x7f04340998f0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f042400c370 tx=0x7f042400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f042b400640 1 -- 172.21.15.5:0/2964252246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04240052d0 con 0x7f04340b40c0 2024-08-18T22:32:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f042b400640 1 -- 172.21.15.5:0/2964252246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0424005470 con 0x7f04340b40c0 2024-08-18T22:32:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f042b400640 1 -- 172.21.15.5:0/2964252246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424007260 con 0x7f04340b40c0 2024-08-18T22:32:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f043a200640 1 -- 172.21.15.5:0/2964252246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0434153d70 con 0x7f04340b40c0 2024-08-18T22:32:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f043a200640 1 -- 172.21.15.5:0/2964252246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0434154330 con 0x7f04340b40c0 2024-08-18T22:32:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f043a200640 1 -- 172.21.15.5:0/2964252246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04340b4500 con 0x7f04340b40c0 2024-08-18T22:32:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.223+0000 7f042b400640 1 -- 172.21.15.5:0/2964252246 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0424007400 con 0x7f04340b40c0 2024-08-18T22:32:35.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.227+0000 7f042b400640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04140678c0 0x7f0414069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:35.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.227+0000 7f042b400640 1 -- 172.21.15.5:0/2964252246 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 6101+0+0 (secure 0 0 0) 0x7f0424085350 con 0x7f04340b40c0 2024-08-18T22:32:35.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.227+0000 7f0432a00640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04140678c0 0x7f0414069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:35.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.227+0000 7f0432a00640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04140678c0 0x7f0414069d80 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0434154f00 tx=0x7f0420008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:35.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.231+0000 7f042b400640 1 -- 172.21.15.5:0/2964252246 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0424055c60 con 0x7f04340b40c0 2024-08-18T22:32:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:35.435+0000 7f043a200640 1 -- 172.21.15.5:0/2964252246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f043406dd20 con 0x7f04340b40c0 2024-08-18T22:32:35.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-08-18T22:32:36.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.335+0000 7f042b400640 1 -- 172.21.15.5:0/2964252246 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v150) ==== 118+0+0 (secure 0 0 0) 0x7f0424055560 con 0x7f04340b40c0 2024-08-18T22:32:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 -- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04140678c0 msgr2=0x7f0414069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04140678c0 0x7f0414069d80 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0434154f00 tx=0x7f0420008040 comp rx=0 tx=0).stop 2024-08-18T22:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 -- 172.21.15.5:0/2964252246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04340b40c0 msgr2=0x7f04340998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04340b40c0 0x7f04340998f0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f042400c370 tx=0x7f042400c830 comp rx=0 tx=0).stop 2024-08-18T22:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 -- 172.21.15.5:0/2964252246 shutdown_connections 2024-08-18T22:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f04140678c0 0x7f0414069d80 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f043415b0c0 0x7f0434151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04340ce280 0x7f0434152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 --2- 172.21.15.5:0/2964252246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04340b40c0 0x7f04340998f0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 -- 172.21.15.5:0/2964252246 >> 172.21.15.5:0/2964252246 conn(0x7f04340b1dc0 msgr2=0x7f043415a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 -- 172.21.15.5:0/2964252246 shutdown_connections 2024-08-18T22:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.339+0000 7f043a200640 1 -- 172.21.15.5:0/2964252246 wait complete. 2024-08-18T22:32:36.364 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:32:36.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:32:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.511+0000 7fa935400640 1 Processor -- start 2024-08-18T22:32:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.511+0000 7fa935400640 1 -- start start 2024-08-18T22:32:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa935400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300b5c60 0x7fa93015ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa935400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa930070990 con 0x7fa9300b2c60 2024-08-18T22:32:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa935400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9300b4800 con 0x7fa9300b4390 2024-08-18T22:32:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa935400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa93015f7c0 con 0x7fa9300b5c60 2024-08-18T22:32:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92fe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa9300b2c60 0x7fa9300b3040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49126/0 (socket says 172.21.15.5:49126) 2024-08-18T22:32:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92fe00640 1 -- 172.21.15.5:0/955527240 learned_addr learned my addr 172.21.15.5:0/955527240 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa934a00640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300b5c60 0x7fa93015ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3829637692 0 0) 0x7fa920001120 con 0x7fa9300b2c60 2024-08-18T22:32:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa914003530 con 0x7fa9300b2c60 2024-08-18T22:32:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033322652 0 0) 0x7fa91c001120 con 0x7fa9300b4390 2024-08-18T22:32:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa920001120 con 0x7fa9300b4390 2024-08-18T22:32:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3029742769 0 0) 0x7fa914003530 con 0x7fa9300b2c60 2024-08-18T22:32:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300b5c60 msgr2=0x7fa93015ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300b5c60 0x7fa93015ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 >> v1:172.21.15.117:6789/0 conn(0x7fa9300b4390 legacy=0x7fa93015e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93006b9b0 con 0x7fa9300b2c60 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fa920001870 con 0x7fa9300b2c60 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 >> v1:172.21.15.5:6789/0 conn(0x7fa9300b2c60 legacy=0x7fa9300b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300b5c60 0x7fa914003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa914004130 0x7fa914004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 0x7fa9140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa91400bae0 con 0x7fa914004d50 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa91400bc90 con 0x7fa914004130 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa91400be90 con 0x7fa9300b5c60 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa934a00640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 0x7fa9140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92f400640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa914004130 0x7fa914004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa92fe00640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300b5c60 0x7fa914003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa934a00640 1 -- 172.21.15.5:0/955527240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300b5c60 msgr2=0x7fa914003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa934a00640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300b5c60 0x7fa914003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa934a00640 1 -- 172.21.15.5:0/955527240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa914004130 msgr2=0x7fa914004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa934a00640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa914004130 0x7fa914004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.515+0000 7fa934a00640 1 -- 172.21.15.5:0/955527240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa914003530 con 0x7fa914004d50 2024-08-18T22:32:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa934a00640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 0x7fa9140051d0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fa928009fc0 tx=0x7fa92801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7b2f3b84c7db09 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9280b2070 con 0x7fa914004d50 2024-08-18T22:32:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9280a5c90 con 0x7fa914004d50 2024-08-18T22:32:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa92ea00640 1 -- 172.21.15.5:0/955527240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa928009c10 con 0x7fa914004d50 2024-08-18T22:32:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa935400640 1 -- 172.21.15.5:0/955527240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 msgr2=0x7fa9140051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa935400640 1 --2- 172.21.15.5:0/955527240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 0x7fa9140051d0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fa928009fc0 tx=0x7fa92801cc80 comp rx=0 tx=0).stop 2024-08-18T22:32:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa934a00640 1 -- 172.21.15.5:0/955527240 reap_dead start 2024-08-18T22:32:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa935400640 1 -- 172.21.15.5:0/955527240 shutdown_connections 2024-08-18T22:32:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa935400640 1 -- 172.21.15.5:0/955527240 >> 172.21.15.5:0/955527240 conn(0x7fa93006cac0 msgr2=0x7fa93006ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa935400640 1 -- 172.21.15.5:0/955527240 shutdown_connections 2024-08-18T22:32:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa935400640 1 -- 172.21.15.5:0/955527240 wait complete. 2024-08-18T22:32:36.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.519+0000 7fa935400640 1 Processor -- start 2024-08-18T22:32:36.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa935400640 1 -- start start 2024-08-18T22:32:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa935400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 0x7fa9301604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa935400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9301f7870 0x7fa930151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa935400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300d0d80 0x7fa9300d1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa935400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa93006bf50 con 0x7fa914004d50 2024-08-18T22:32:36.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa935400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa93006bc70 con 0x7fa9301f7870 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa935400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa93006c230 con 0x7fa9300d0d80 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa92fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 0x7fa9301604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa92fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 0x7fa9301604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46834/0 (socket says 172.21.15.5:46834) 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa92fe00640 1 -- 172.21.15.5:0/3821479104 learned_addr learned my addr 172.21.15.5:0/3821479104 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa92f400640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9301f7870 0x7fa930151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa934a00640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300d0d80 0x7fa9300d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa92fe00640 1 -- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300d0d80 msgr2=0x7fa9300d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa92fe00640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300d0d80 0x7fa9300d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa92fe00640 1 -- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9301f7870 msgr2=0x7fa930151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa92fe00640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9301f7870 0x7fa930151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa92fe00640 1 -- 172.21.15.5:0/3821479104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93015e600 con 0x7fa914004d50 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa92fe00640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 0x7fa9301604a0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fa920012470 tx=0x7fa920012870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:36.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa927e00640 1 -- 172.21.15.5:0/3821479104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92001c070 con 0x7fa914004d50 2024-08-18T22:32:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa927e00640 1 -- 172.21.15.5:0/3821479104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa920014750 con 0x7fa914004d50 2024-08-18T22:32:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa927e00640 1 -- 172.21.15.5:0/3821479104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa920014b40 con 0x7fa914004d50 2024-08-18T22:32:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa935400640 1 -- 172.21.15.5:0/3821479104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9301f7d70 con 0x7fa914004d50 2024-08-18T22:32:36.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa935400640 1 -- 172.21.15.5:0/3821479104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9301f8330 con 0x7fa914004d50 2024-08-18T22:32:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.523+0000 7fa935400640 1 -- 172.21.15.5:0/3821479104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9300b60b0 con 0x7fa914004d50 2024-08-18T22:32:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.527+0000 7fa927e00640 1 -- 172.21.15.5:0/3821479104 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa92001f070 con 0x7fa914004d50 2024-08-18T22:32:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.527+0000 7fa927e00640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9100678f0 0x7fa910069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.527+0000 7fa927e00640 1 -- 172.21.15.5:0/3821479104 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fa920088790 con 0x7fa914004d50 2024-08-18T22:32:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.527+0000 7fa92f400640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9100678f0 0x7fa910069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:36.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.527+0000 7fa92f400640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9100678f0 0x7fa910069db0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa930073de0 tx=0x7fa91c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:36.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.531+0000 7fa927e00640 1 -- 172.21.15.5:0/3821479104 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa930070990 con 0x7fa914004d50 2024-08-18T22:32:36.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:36.731+0000 7fa935400640 1 -- 172.21.15.5:0/3821479104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa93015e7d0 con 0x7fa914004d50 2024-08-18T22:32:37.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.339+0000 7fa927e00640 1 -- 172.21.15.5:0/3821479104 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v151) ==== 122+0+0 (secure 0 0 0) 0x7fa920058a50 con 0x7fa914004d50 2024-08-18T22:32:37.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 -- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9100678f0 msgr2=0x7fa910069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9100678f0 0x7fa910069db0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa930073de0 tx=0x7fa91c009040 comp rx=0 tx=0).stop 2024-08-18T22:32:37.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 -- 172.21.15.5:0/3821479104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 msgr2=0x7fa9301604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 0x7fa9301604a0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fa920012470 tx=0x7fa920012870 comp rx=0 tx=0).stop 2024-08-18T22:32:37.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 -- 172.21.15.5:0/3821479104 shutdown_connections 2024-08-18T22:32:37.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa9100678f0 0x7fa910069db0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9300d0d80 0x7fa9300d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9301f7870 0x7fa930151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 --2- 172.21.15.5:0/3821479104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa914004d50 0x7fa9301604a0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 -- 172.21.15.5:0/3821479104 >> 172.21.15.5:0/3821479104 conn(0x7fa93006cac0 msgr2=0x7fa93015c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:37.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 -- 172.21.15.5:0/3821479104 shutdown_connections 2024-08-18T22:32:37.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.343+0000 7fa935400640 1 -- 172.21.15.5:0/3821479104 wait complete. 2024-08-18T22:32:37.367 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:32:37.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:32:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.511+0000 7f4ac6000640 1 Processor -- start 2024-08-18T22:32:37.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.511+0000 7f4ac6000640 1 -- start start 2024-08-18T22:32:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4ac6000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4ac0161960 0x7f4ac006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4ac6000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac015eb60 con 0x7f4ac0070730 2024-08-18T22:32:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4ac6000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac015ee40 con 0x7f4ac015e4b0 2024-08-18T22:32:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4ac6000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac015e940 con 0x7f4ac0161960 2024-08-18T22:32:37.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4ac0070730 0x7f4ac015dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49132/0 (socket says 172.21.15.5:49132) 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abea00640 1 -- 172.21.15.5:0/4284958059 learned_addr learned my addr 172.21.15.5:0/4284958059 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abf400640 1 --2- 172.21.15.5:0/4284958059 >> v2:172.21.15.117:3300/0 conn(0x7f4ac0161960 0x7f4ac006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647892061 0 0) 0x7f4ac015eb60 con 0x7f4ac0070730 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aa4003530 con 0x7f4ac0070730 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 134817187 0 0) 0x7f4aa4003530 con 0x7f4ac0070730 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 >> v2:172.21.15.117:3300/0 conn(0x7f4ac0161960 msgr2=0x7f4ac006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 --2- 172.21.15.5:0/4284958059 >> v2:172.21.15.117:3300/0 conn(0x7f4ac0161960 0x7f4ac006fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 >> v1:172.21.15.117:6789/0 conn(0x7f4ac015e4b0 legacy=0x7f4ac00d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac015f120 con 0x7f4ac0070730 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f4aac001680 con 0x7f4ac0070730 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 >> v1:172.21.15.5:6789/0 conn(0x7f4ac0070730 legacy=0x7f4ac015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 --2- 172.21.15.5:0/4284958059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa40039c0 0x7f4aa4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 --2- 172.21.15.5:0/4284958059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40043c0 0x7f4aa4004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 --2- 172.21.15.5:0/4284958059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 0x7f4aa400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac015e940 con 0x7f4aa4005090 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa400bff0 con 0x7f4aa40043c0 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa400c1f0 con 0x7f4aa40039c0 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abfe00640 1 --2- 172.21.15.5:0/4284958059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 0x7f4aa400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abf400640 1 --2- 172.21.15.5:0/4284958059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa40039c0 0x7f4aa4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abea00640 1 --2- 172.21.15.5:0/4284958059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40043c0 0x7f4aa4004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abfe00640 1 -- 172.21.15.5:0/4284958059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa40039c0 msgr2=0x7f4aa4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abfe00640 1 --2- 172.21.15.5:0/4284958059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4aa40039c0 0x7f4aa4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abfe00640 1 -- 172.21.15.5:0/4284958059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40043c0 msgr2=0x7f4aa4004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abfe00640 1 --2- 172.21.15.5:0/4284958059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aa40043c0 0x7f4aa4004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.515+0000 7f4abfe00640 1 -- 172.21.15.5:0/4284958059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa4003530 con 0x7f4aa4005090 2024-08-18T22:32:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4abfe00640 1 -- 172.21.15.5:0/4284958059 reap_dead start 2024-08-18T22:32:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4abfe00640 1 --2- 172.21.15.5:0/4284958059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 0x7f4aa400b9d0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8002010 tx=0x7f4ab801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e0d75eeb35a0a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8001c10 con 0x7f4aa4005090 2024-08-18T22:32:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab8003ba0 con 0x7f4aa4005090 2024-08-18T22:32:37.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4abe000640 1 -- 172.21.15.5:0/4284958059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80050d0 con 0x7f4aa4005090 2024-08-18T22:32:37.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4ac6000640 1 -- 172.21.15.5:0/4284958059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 msgr2=0x7f4aa400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4ac6000640 1 --2- 172.21.15.5:0/4284958059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 0x7f4aa400b9d0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8002010 tx=0x7f4ab801c8e0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4ac6000640 1 -- 172.21.15.5:0/4284958059 shutdown_connections 2024-08-18T22:32:37.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4ac6000640 1 --2- 172.21.15.5:0/4284958059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 0x7f4aa400b9d0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4ac6000640 1 -- 172.21.15.5:0/4284958059 >> 172.21.15.5:0/4284958059 conn(0x7f4ac00d2130 msgr2=0x7f4ac00d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:37.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4ac6000640 1 -- 172.21.15.5:0/4284958059 shutdown_connections 2024-08-18T22:32:37.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.519+0000 7f4ac6000640 1 -- 172.21.15.5:0/4284958059 wait complete. 2024-08-18T22:32:37.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ac6000640 1 Processor -- start 2024-08-18T22:32:37.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ac6000640 1 -- start start 2024-08-18T22:32:37.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ac6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 0x7f4ac009c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ac6000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac015d460 0x7f4ac015cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ac6000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ac01ea0a0 0x7f4ac01ea520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ac6000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac015f6e0 con 0x7f4aa4005090 2024-08-18T22:32:37.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ac6000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac009ba30 con 0x7f4ac01ea0a0 2024-08-18T22:32:37.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ac6000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac00c5c20 con 0x7f4ac015d460 2024-08-18T22:32:37.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4abf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 0x7f4ac009c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4abf400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 0x7f4ac009c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46856/0 (socket says 172.21.15.5:46856) 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4abf400640 1 -- 172.21.15.5:0/969031925 learned_addr learned my addr 172.21.15.5:0/969031925 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4abea00640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac015d460 0x7f4ac015cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4abfe00640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ac01ea0a0 0x7f4ac01ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4abf400640 1 -- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac015d460 msgr2=0x7f4ac015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4abf400640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac015d460 0x7f4ac015cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4abf400640 1 -- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ac01ea0a0 msgr2=0x7f4ac01ea520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4abf400640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ac01ea0a0 0x7f4ac01ea520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4abf400640 1 -- 172.21.15.5:0/969031925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac00c5e70 con 0x7f4aa4005090 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4abf400640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 0x7f4ac009c070 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0011960 tx=0x7f4ab0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ab7400640 1 -- 172.21.15.5:0/969031925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000fa90 con 0x7f4aa4005090 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ab7400640 1 -- 172.21.15.5:0/969031925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab000fc50 con 0x7f4aa4005090 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ac6000640 1 -- 172.21.15.5:0/969031925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac00c6150 con 0x7f4aa4005090 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ab7400640 1 -- 172.21.15.5:0/969031925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0014440 con 0x7f4aa4005090 2024-08-18T22:32:37.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ac6000640 1 -- 172.21.15.5:0/969031925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac00c6710 con 0x7f4aa4005090 2024-08-18T22:32:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.523+0000 7f4ac6000640 1 -- 172.21.15.5:0/969031925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac015ee40 con 0x7f4aa4005090 2024-08-18T22:32:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.527+0000 7f4ab7400640 1 -- 172.21.15.5:0/969031925 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ab0012040 con 0x7f4aa4005090 2024-08-18T22:32:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.527+0000 7f4ab7400640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4aa00678c0 0x7f4aa0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.527+0000 7f4ab7400640 1 -- 172.21.15.5:0/969031925 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f4ab0086480 con 0x7f4aa4005090 2024-08-18T22:32:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.527+0000 7f4abea00640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4aa00678c0 0x7f4aa0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.527+0000 7f4abea00640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4aa00678c0 0x7f4aa0069d80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4aac001060 tx=0x7f4aac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.531+0000 7f4ab7400640 1 -- 172.21.15.5:0/969031925 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4ab0019030 con 0x7f4aa4005090 2024-08-18T22:32:37.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.727+0000 7f4ac6000640 1 -- 172.21.15.5:0/969031925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ac009bbb0 con 0x7f4aa4005090 2024-08-18T22:32:37.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ab7400640 1 -- 172.21.15.5:0/969031925 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) ==== 95+0+5229 (secure 0 0 0) 0x7f4ab0056740 con 0x7f4aa4005090 2024-08-18T22:32:37.730 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:37.731 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":151,"btime":"2024-08-18T22:32:37:342248+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/983387831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":983387831},{"type":"v1","addr":"172.21.15.5:6833","nonce":983387831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2495123422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2495123422},{"type":"v1","addr":"172.21.15.117:6836","nonce":2495123422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/53072457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":53072457},{"type":"v1","addr":"172.21.15.117:6837","nonce":53072457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:32:33.724910+0000","modified":"2024-08-18T22:32:36.736018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10350":{"gid":10350,"name":"a","rank":0,"incarnation":147,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/114900580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":114900580},{"type":"v1","addr":"172.21.15.5:6835","nonce":114900580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10350,"qdb_cluster":[10350]},"id":13}]} 2024-08-18T22:32:37.731 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 151 2024-08-18T22:32:37.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 -- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4aa00678c0 msgr2=0x7f4aa0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4aa00678c0 0x7f4aa0069d80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4aac001060 tx=0x7f4aac009040 comp rx=0 tx=0).stop 2024-08-18T22:32:37.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 -- 172.21.15.5:0/969031925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 msgr2=0x7f4ac009c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 0x7f4ac009c070 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0011960 tx=0x7f4ab0011e20 comp rx=0 tx=0).stop 2024-08-18T22:32:37.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 -- 172.21.15.5:0/969031925 shutdown_connections 2024-08-18T22:32:37.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4aa00678c0 0x7f4aa0069d80 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ac01ea0a0 0x7f4ac01ea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ac015d460 0x7f4ac015cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 --2- 172.21.15.5:0/969031925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa4005090 0x7f4ac009c070 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 -- 172.21.15.5:0/969031925 >> 172.21.15.5:0/969031925 conn(0x7f4ac00d2130 msgr2=0x7f4ac00d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:37.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 -- 172.21.15.5:0/969031925 shutdown_connections 2024-08-18T22:32:37.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.731+0000 7f4ac6000640 1 -- 172.21.15.5:0/969031925 wait complete. 2024-08-18T22:32:37.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:32:37.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.891+0000 7f6440400640 1 Processor -- start 2024-08-18T22:32:37.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.891+0000 7f6440400640 1 -- start start 2024-08-18T22:32:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6440400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f643806e180 0x7f64380735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6440400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6438073c80 con 0x7f64380cb390 2024-08-18T22:32:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6440400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64380ca5d0 con 0x7f643815bed0 2024-08-18T22:32:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6440400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f64380ca8b0 con 0x7f643806e180 2024-08-18T22:32:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643d000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f64380cb390 0x7f643806da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49148/0 (socket says 172.21.15.5:49148) 2024-08-18T22:32:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643d000640 1 -- 172.21.15.5:0/264620828 learned_addr learned my addr 172.21.15.5:0/264620828 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643e400640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f643806e180 0x7f64380735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315793351 0 0) 0x7f6438073c80 con 0x7f64380cb390 2024-08-18T22:32:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6420003530 con 0x7f64380cb390 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211095585 0 0) 0x7f64380ca5d0 con 0x7f643815bed0 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6438073c80 con 0x7f643815bed0 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2922431262 0 0) 0x7f6420003530 con 0x7f64380cb390 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f643806e180 msgr2=0x7f64380735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f643806e180 0x7f64380735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 >> v1:172.21.15.117:6789/0 conn(0x7f643815bed0 legacy=0x7f6438071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64380cab90 con 0x7f64380cb390 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f6424001680 con 0x7f64380cb390 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 >> v1:172.21.15.5:6789/0 conn(0x7f64380cb390 legacy=0x7f643806da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f643806e180 0x7f6420003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6420004130 0x7f6420004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420004d50 0x7f64200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f64380ca8b0 con 0x7f6420004130 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f642000bb10 con 0x7f6420004d50 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f642000bd10 con 0x7f643806e180 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643d000640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6420004130 0x7f6420004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643e400640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420004d50 0x7f64200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643da00640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f643806e180 0x7f6420003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643d000640 1 -- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f643806e180 msgr2=0x7f6420003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643d000640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f643806e180 0x7f6420003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643d000640 1 -- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420004d50 msgr2=0x7f64200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643d000640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420004d50 0x7f64200051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643d000640 1 -- 172.21.15.5:0/264620828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6420003530 con 0x7f6420004130 2024-08-18T22:32:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.895+0000 7f643da00640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f643806e180 0x7f6420003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.899+0000 7f643d000640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6420004130 0x7f6420004810 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f642400c110 tx=0x7f642401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc702ad25e60150 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.899+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6424007c10 con 0x7f6420004130 2024-08-18T22:32:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.899+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64240a9070 con 0x7f6420004130 2024-08-18T22:32:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.899+0000 7f6437e00640 1 -- 172.21.15.5:0/264620828 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6424005d20 con 0x7f6420004130 2024-08-18T22:32:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.899+0000 7f6440400640 1 -- 172.21.15.5:0/264620828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6420004130 msgr2=0x7f6420004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.899+0000 7f6440400640 1 --2- 172.21.15.5:0/264620828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6420004130 0x7f6420004810 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f642400c110 tx=0x7f642401ca80 comp rx=0 tx=0).stop 2024-08-18T22:32:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.899+0000 7f643e400640 1 -- 172.21.15.5:0/264620828 reap_dead start 2024-08-18T22:32:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.899+0000 7f6440400640 1 -- 172.21.15.5:0/264620828 shutdown_connections 2024-08-18T22:32:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.899+0000 7f6440400640 1 -- 172.21.15.5:0/264620828 >> 172.21.15.5:0/264620828 conn(0x7f64380b1c50 msgr2=0x7f64380b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.899+0000 7f6440400640 1 -- 172.21.15.5:0/264620828 shutdown_connections 2024-08-18T22:32:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.899+0000 7f6440400640 1 -- 172.21.15.5:0/264620828 wait complete. 2024-08-18T22:32:37.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6440400640 1 Processor -- start 2024-08-18T22:32:37.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6440400640 1 -- start start 2024-08-18T22:32:37.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6440400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420004130 0x7f643815ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6440400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6438152260 0x7f6438151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6440400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64380b5050 0x7f64380b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6440400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f643815c430 con 0x7f64380b5050 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6440400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f643815c2b0 con 0x7f6420004130 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6440400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f64380735a0 con 0x7f6438152260 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f643e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64380b5050 0x7f64380b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f643e400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64380b5050 0x7f64380b5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46878/0 (socket says 172.21.15.5:46878) 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f643e400640 1 -- 172.21.15.5:0/2673297489 learned_addr learned my addr 172.21.15.5:0/2673297489 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f643da00640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420004130 0x7f643815ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f643d000640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6438152260 0x7f6438151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f643e400640 1 -- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6438152260 msgr2=0x7f6438151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f643e400640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6438152260 0x7f6438151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f643e400640 1 -- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420004130 msgr2=0x7f643815ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f643e400640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420004130 0x7f643815ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f643e400640 1 -- 172.21.15.5:0/2673297489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6438152a70 con 0x7f64380b5050 2024-08-18T22:32:37.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f643e400640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64380b5050 0x7f64380b5500 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f64380ca580 tx=0x7f643000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6435600640 1 -- 172.21.15.5:0/2673297489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430019070 con 0x7f64380b5050 2024-08-18T22:32:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6435600640 1 -- 172.21.15.5:0/2673297489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6430011e90 con 0x7f64380b5050 2024-08-18T22:32:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6440400640 1 -- 172.21.15.5:0/2673297489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6438152d50 con 0x7f64380b5050 2024-08-18T22:32:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6435600640 1 -- 172.21.15.5:0/2673297489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430003c00 con 0x7f64380b5050 2024-08-18T22:32:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6440400640 1 -- 172.21.15.5:0/2673297489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6438153310 con 0x7f64380b5050 2024-08-18T22:32:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.903+0000 7f6440400640 1 -- 172.21.15.5:0/2673297489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64381584a0 con 0x7f64380b5050 2024-08-18T22:32:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.907+0000 7f6435600640 1 -- 172.21.15.5:0/2673297489 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f643001c070 con 0x7f64380b5050 2024-08-18T22:32:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.907+0000 7f6435600640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64180678c0 0x7f6418069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.907+0000 7f6435600640 1 -- 172.21.15.5:0/2673297489 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f6430086750 con 0x7f64380b5050 2024-08-18T22:32:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.907+0000 7f643da00640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64180678c0 0x7f6418069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.907+0000 7f643da00640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64180678c0 0x7f6418069d80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f64380cd450 tx=0x7f642c007150 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:37.911+0000 7f6435600640 1 -- 172.21.15.5:0/2673297489 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6430010040 con 0x7f64380b5050 2024-08-18T22:32:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.075+0000 7f6440400640 1 -- 172.21.15.5:0/2673297489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64380738d0 con 0x7f64380b5050 2024-08-18T22:32:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6435600640 1 -- 172.21.15.5:0/2673297489 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) ==== 74+0+16880 (secure 0 0 0) 0x7f6430056aa0 con 0x7f64380b5050 2024-08-18T22:32:38.078 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:38.078 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":191,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:32:35.317877+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:32:31.454782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-08-18T22:32:32.720083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:32:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 -- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64180678c0 msgr2=0x7f6418069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64180678c0 0x7f6418069d80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f64380cd450 tx=0x7f642c007150 comp rx=0 tx=0).stop 2024-08-18T22:32:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 -- 172.21.15.5:0/2673297489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64380b5050 msgr2=0x7f64380b5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64380b5050 0x7f64380b5500 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f64380ca580 tx=0x7f643000f580 comp rx=0 tx=0).stop 2024-08-18T22:32:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 -- 172.21.15.5:0/2673297489 shutdown_connections 2024-08-18T22:32:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f64180678c0 0x7f6418069d80 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64380b5050 0x7f64380b5500 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6438152260 0x7f6438151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 --2- 172.21.15.5:0/2673297489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420004130 0x7f643815ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 -- 172.21.15.5:0/2673297489 >> 172.21.15.5:0/2673297489 conn(0x7f64380b1c50 msgr2=0x7f64380ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 -- 172.21.15.5:0/2673297489 shutdown_connections 2024-08-18T22:32:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.079+0000 7f6440400640 1 -- 172.21.15.5:0/2673297489 wait complete. 2024-08-18T22:32:38.100 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:32:38.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:32:38.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.239+0000 7f0013e00640 1 Processor -- start 2024-08-18T22:32:38.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.239+0000 7f0013e00640 1 -- start start 2024-08-18T22:32:38.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.239+0000 7f0013e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f000c15e4b0 0x7f000c070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f0013e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000c070430 con 0x7f000c161960 2024-08-18T22:32:38.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f0013e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000c15eb60 con 0x7f000c070730 2024-08-18T22:32:38.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f0013e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f000c15e940 con 0x7f000c15e4b0 2024-08-18T22:32:38.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f0011400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f000c161960 0x7f000c06fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49156/0 (socket says 172.21.15.5:49156) 2024-08-18T22:32:38.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f0011400640 1 -- 172.21.15.5:0/29494474 learned_addr learned my addr 172.21.15.5:0/29494474 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:38.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f0011e00640 1 --2- 172.21.15.5:0/29494474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f000c15e4b0 0x7f000c070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f000be00640 1 -- 172.21.15.5:0/29494474 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503771843 0 0) 0x7f000c070430 con 0x7f000c161960 2024-08-18T22:32:38.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f000be00640 1 -- 172.21.15.5:0/29494474 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efff4003530 con 0x7f000c161960 2024-08-18T22:32:38.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f000be00640 1 -- 172.21.15.5:0/29494474 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2565652861 0 0) 0x7f000c15eb60 con 0x7f000c070730 2024-08-18T22:32:38.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f000be00640 1 -- 172.21.15.5:0/29494474 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f000c070430 con 0x7f000c070730 2024-08-18T22:32:38.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f0011e00640 1 -- 172.21.15.5:0/29494474 >> v1:172.21.15.117:6789/0 conn(0x7f000c070730 legacy=0x7f000c15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f0011e00640 1 -- 172.21.15.5:0/29494474 >> v1:172.21.15.5:6789/0 conn(0x7f000c161960 legacy=0x7f000c06fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f0011e00640 1 -- 172.21.15.5:0/29494474 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c15ee40 con 0x7f000c15e4b0 2024-08-18T22:32:38.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.243+0000 7f0011e00640 1 --2- 172.21.15.5:0/29494474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f000c15e4b0 0x7f000c070ba0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f00040097f0 tx=0x7f000401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34ffb3912acdd493 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:38.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f000be00640 1 -- 172.21.15.5:0/29494474 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00040b0070 con 0x7f000c15e4b0 2024-08-18T22:32:38.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f000be00640 1 -- 172.21.15.5:0/29494474 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00040ab600 con 0x7f000c15e4b0 2024-08-18T22:32:38.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f000be00640 1 -- 172.21.15.5:0/29494474 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00040ab9d0 con 0x7f000c15e4b0 2024-08-18T22:32:38.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 -- 172.21.15.5:0/29494474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f000c15e4b0 msgr2=0x7f000c070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 --2- 172.21.15.5:0/29494474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f000c15e4b0 0x7f000c070ba0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f00040097f0 tx=0x7f000401c4e0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 -- 172.21.15.5:0/29494474 shutdown_connections 2024-08-18T22:32:38.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 --2- 172.21.15.5:0/29494474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f000c15e4b0 0x7f000c070ba0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 -- 172.21.15.5:0/29494474 >> 172.21.15.5:0/29494474 conn(0x7f000c0d2130 msgr2=0x7f000c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:38.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 -- 172.21.15.5:0/29494474 shutdown_connections 2024-08-18T22:32:38.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 -- 172.21.15.5:0/29494474 wait complete. 2024-08-18T22:32:38.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 Processor -- start 2024-08-18T22:32:38.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 -- start start 2024-08-18T22:32:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f000c070730 0x7f000c0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f000c15e4b0 0x7f000c157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f000c161960 0x7f000c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f000c09ba30 con 0x7f000c161960 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f000c0710e0 con 0x7f000c15e4b0 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0013e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f000c0cb720 con 0x7f000c070730 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0011e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f000c161960 0x7f000c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0011e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f000c161960 0x7f000c0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46888/0 (socket says 172.21.15.5:46888) 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0011e00640 1 -- 172.21.15.5:0/39798010 learned_addr learned my addr 172.21.15.5:0/39798010 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.247+0000 7f0010a00640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f000c15e4b0 0x7f000c157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0011400640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f000c070730 0x7f000c0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0011e00640 1 -- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f000c070730 msgr2=0x7f000c0c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0011e00640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f000c070730 0x7f000c0c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0011e00640 1 -- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f000c15e4b0 msgr2=0x7f000c157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0011e00640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f000c15e4b0 0x7f000c157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0011e00640 1 -- 172.21.15.5:0/39798010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c0cba00 con 0x7f000c161960 2024-08-18T22:32:38.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0010a00640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f000c15e4b0 0x7f000c157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:38.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0011e00640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f000c161960 0x7f000c0caa50 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f00040ae040 tx=0x7f000401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0009600640 1 -- 172.21.15.5:0/39798010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00040b0050 con 0x7f000c161960 2024-08-18T22:32:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0009600640 1 -- 172.21.15.5:0/39798010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00040bc070 con 0x7f000c161960 2024-08-18T22:32:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0009600640 1 -- 172.21.15.5:0/39798010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00040b7670 con 0x7f000c161960 2024-08-18T22:32:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0013e00640 1 -- 172.21.15.5:0/39798010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c0cbce0 con 0x7f000c161960 2024-08-18T22:32:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0013e00640 1 -- 172.21.15.5:0/39798010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c0c88d0 con 0x7f000c161960 2024-08-18T22:32:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0013e00640 1 -- 172.21.15.5:0/39798010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000c070ba0 con 0x7f000c161960 2024-08-18T22:32:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0009600640 1 -- 172.21.15.5:0/39798010 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00040b7810 con 0x7f000c161960 2024-08-18T22:32:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0009600640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effec0678c0 0x7effec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.251+0000 7f0009600640 1 -- 172.21.15.5:0/39798010 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f0004120410 con 0x7f000c161960 2024-08-18T22:32:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.255+0000 7f0011400640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effec0678c0 0x7effec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.255+0000 7f0011400640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effec0678c0 0x7effec069d80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f00000012f0 tx=0x7f0000009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.255+0000 7f0009600640 1 -- 172.21.15.5:0/39798010 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f00040160d0 con 0x7f000c161960 2024-08-18T22:32:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.419+0000 7f0013e00640 1 -- 172.21.15.5:0/39798010 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f000c09bbb0 con 0x7effec0678c0 2024-08-18T22:32:38.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.427+0000 7f0009600640 1 -- 172.21.15.5:0/39798010 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248125 (secure 0 0 0) 0x7f000c09bbb0 con 0x7effec0678c0 2024-08-18T22:32:38.431 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:38.432 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:32:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 -- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effec0678c0 msgr2=0x7effec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effec0678c0 0x7effec069d80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f00000012f0 tx=0x7f0000009040 comp rx=0 tx=0).stop 2024-08-18T22:32:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 -- 172.21.15.5:0/39798010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f000c161960 msgr2=0x7f000c0caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f000c161960 0x7f000c0caa50 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f00040ae040 tx=0x7f000401ad20 comp rx=0 tx=0).stop 2024-08-18T22:32:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 -- 172.21.15.5:0/39798010 shutdown_connections 2024-08-18T22:32:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effec0678c0 0x7effec069d80 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f000c161960 0x7f000c0caa50 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f000c15e4b0 0x7f000c157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 --2- 172.21.15.5:0/39798010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f000c070730 0x7f000c0c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 -- 172.21.15.5:0/39798010 >> 172.21.15.5:0/39798010 conn(0x7f000c0d2130 msgr2=0x7f000c0d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 -- 172.21.15.5:0/39798010 shutdown_connections 2024-08-18T22:32:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.431+0000 7f0013e00640 1 -- 172.21.15.5:0/39798010 wait complete. 2024-08-18T22:32:38.452 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":590,"stamp":"2024-08-18T22:32:37.815966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":430208,"kb_used_data":19716,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754544512,"statfs":{"total":773094113280,"available":772653580288,"internally_reserved":0,"allocated":20189184,"data_stored":10147486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.510559"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.334406+0000","last_change":"2024-08-18T22:32:33.334406+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.334406+0000","last_undegraded":"2024-08-18T22:32:33.334406+0000","last_fullsized":"2024-08-18T22:32:33.334406+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325093+0000","last_change":"2024-08-18T22:32:33.325093+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325093+0000","last_undegraded":"2024-08-18T22:32:33.325093+0000","last_fullsized":"2024-08-18T22:32:33.325093+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.329261+0000","last_change":"2024-08-18T22:32:33.329261+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.329261+0000","last_undegraded":"2024-08-18T22:32:33.329261+0000","last_fullsized":"2024-08-18T22:32:33.329261+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323643+0000","last_change":"2024-08-18T22:32:33.323643+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323643+0000","last_undegraded":"2024-08-18T22:32:33.323643+0000","last_fullsized":"2024-08-18T22:32:33.323643+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327951+0000","last_change":"2024-08-18T22:32:34.332036+0000","last_active":"2024-08-18T22:32:35.327951+0000","last_peered":"2024-08-18T22:32:35.327951+0000","last_clean":"2024-08-18T22:32:35.327951+0000","last_became_active":"2024-08-18T22:32:34.331366+0000","last_became_peered":"2024-08-18T22:32:34.331366+0000","last_unstale":"2024-08-18T22:32:35.327951+0000","last_undegraded":"2024-08-18T22:32:35.327951+0000","last_fullsized":"2024-08-18T22:32:35.327951+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:00.772598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322789+0000","last_change":"2024-08-18T22:32:33.322789+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322789+0000","last_undegraded":"2024-08-18T22:32:33.322789+0000","last_fullsized":"2024-08-18T22:32:33.322789+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327668+0000","last_change":"2024-08-18T22:32:34.328506+0000","last_active":"2024-08-18T22:32:35.327668+0000","last_peered":"2024-08-18T22:32:35.327668+0000","last_clean":"2024-08-18T22:32:35.327668+0000","last_became_active":"2024-08-18T22:32:34.328188+0000","last_became_peered":"2024-08-18T22:32:34.328188+0000","last_unstale":"2024-08-18T22:32:35.327668+0000","last_undegraded":"2024-08-18T22:32:35.327668+0000","last_fullsized":"2024-08-18T22:32:35.327668+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:08.229648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324176+0000","last_change":"2024-08-18T22:32:33.324176+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324176+0000","last_undegraded":"2024-08-18T22:32:33.324176+0000","last_fullsized":"2024-08-18T22:32:33.324176+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324748+0000","last_change":"2024-08-18T22:32:33.324748+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324748+0000","last_undegraded":"2024-08-18T22:32:33.324748+0000","last_fullsized":"2024-08-18T22:32:33.324748+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322214+0000","last_change":"2024-08-18T22:32:33.322214+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322214+0000","last_undegraded":"2024-08-18T22:32:33.322214+0000","last_fullsized":"2024-08-18T22:32:33.322214+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.326218+0000","last_change":"2024-08-18T22:32:33.326218+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.326218+0000","last_undegraded":"2024-08-18T22:32:33.326218+0000","last_fullsized":"2024-08-18T22:32:33.326218+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328280+0000","last_change":"2024-08-18T22:32:34.350611+0000","last_active":"2024-08-18T22:32:35.328280+0000","last_peered":"2024-08-18T22:32:35.328280+0000","last_clean":"2024-08-18T22:32:35.328280+0000","last_became_active":"2024-08-18T22:32:34.346800+0000","last_became_peered":"2024-08-18T22:32:34.346800+0000","last_unstale":"2024-08-18T22:32:35.328280+0000","last_undegraded":"2024-08-18T22:32:35.328280+0000","last_fullsized":"2024-08-18T22:32:35.328280+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:10.581383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323206+0000","last_change":"2024-08-18T22:32:33.323206+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323206+0000","last_undegraded":"2024-08-18T22:32:33.323206+0000","last_fullsized":"2024-08-18T22:32:33.323206+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.326351+0000","last_change":"2024-08-18T22:32:33.326351+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.326351+0000","last_undegraded":"2024-08-18T22:32:33.326351+0000","last_fullsized":"2024-08-18T22:32:33.326351+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323091+0000","last_change":"2024-08-18T22:32:34.340094+0000","last_active":"2024-08-18T22:32:35.323091+0000","last_peered":"2024-08-18T22:32:35.323091+0000","last_clean":"2024-08-18T22:32:35.323091+0000","last_became_active":"2024-08-18T22:32:34.339828+0000","last_became_peered":"2024-08-18T22:32:34.339828+0000","last_unstale":"2024-08-18T22:32:35.323091+0000","last_undegraded":"2024-08-18T22:32:35.323091+0000","last_fullsized":"2024-08-18T22:32:35.323091+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:01:26.496081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.330234+0000","last_change":"2024-08-18T22:32:33.330234+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.330234+0000","last_undegraded":"2024-08-18T22:32:33.330234+0000","last_fullsized":"2024-08-18T22:32:33.330234+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324211+0000","last_change":"2024-08-18T22:32:33.324211+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324211+0000","last_undegraded":"2024-08-18T22:32:33.324211+0000","last_fullsized":"2024-08-18T22:32:33.324211+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325580+0000","last_change":"2024-08-18T22:32:33.325580+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325580+0000","last_undegraded":"2024-08-18T22:32:33.325580+0000","last_fullsized":"2024-08-18T22:32:33.325580+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321840+0000","last_change":"2024-08-18T22:32:33.321840+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321840+0000","last_undegraded":"2024-08-18T22:32:33.321840+0000","last_fullsized":"2024-08-18T22:32:33.321840+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322462+0000","last_change":"2024-08-18T22:32:33.322462+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322462+0000","last_undegraded":"2024-08-18T22:32:33.322462+0000","last_fullsized":"2024-08-18T22:32:33.322462+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323064+0000","last_change":"2024-08-18T22:32:33.323064+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323064+0000","last_undegraded":"2024-08-18T22:32:33.323064+0000","last_fullsized":"2024-08-18T22:32:33.323064+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324593+0000","last_change":"2024-08-18T22:32:33.324593+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324593+0000","last_undegraded":"2024-08-18T22:32:33.324593+0000","last_fullsized":"2024-08-18T22:32:33.324593+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325159+0000","last_change":"2024-08-18T22:32:33.325159+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325159+0000","last_undegraded":"2024-08-18T22:32:33.325159+0000","last_fullsized":"2024-08-18T22:32:33.325159+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327593+0000","last_change":"2024-08-18T22:32:34.336858+0000","last_active":"2024-08-18T22:32:35.327593+0000","last_peered":"2024-08-18T22:32:35.327593+0000","last_clean":"2024-08-18T22:32:35.327593+0000","last_became_active":"2024-08-18T22:32:34.336586+0000","last_became_peered":"2024-08-18T22:32:34.336586+0000","last_unstale":"2024-08-18T22:32:35.327593+0000","last_undegraded":"2024-08-18T22:32:35.327593+0000","last_fullsized":"2024-08-18T22:32:35.327593+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:55.751347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323775+0000","last_change":"2024-08-18T22:32:33.323775+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323775+0000","last_undegraded":"2024-08-18T22:32:33.323775+0000","last_fullsized":"2024-08-18T22:32:33.323775+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.334940+0000","last_change":"2024-08-18T22:32:33.334940+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.334940+0000","last_undegraded":"2024-08-18T22:32:33.334940+0000","last_fullsized":"2024-08-18T22:32:33.334940+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325759+0000","last_change":"2024-08-18T22:32:33.325759+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325759+0000","last_undegraded":"2024-08-18T22:32:33.325759+0000","last_fullsized":"2024-08-18T22:32:33.325759+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328352+0000","last_change":"2024-08-18T22:32:34.331458+0000","last_active":"2024-08-18T22:32:35.328352+0000","last_peered":"2024-08-18T22:32:35.328352+0000","last_clean":"2024-08-18T22:32:35.328352+0000","last_became_active":"2024-08-18T22:32:34.331049+0000","last_became_peered":"2024-08-18T22:32:34.331049+0000","last_unstale":"2024-08-18T22:32:35.328352+0000","last_undegraded":"2024-08-18T22:32:35.328352+0000","last_fullsized":"2024-08-18T22:32:35.328352+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:13:52.541926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323450+0000","last_change":"2024-08-18T22:32:33.323450+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323450+0000","last_undegraded":"2024-08-18T22:32:33.323450+0000","last_fullsized":"2024-08-18T22:32:33.323450+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323984+0000","last_change":"2024-08-18T22:32:34.338117+0000","last_active":"2024-08-18T22:32:35.323984+0000","last_peered":"2024-08-18T22:32:35.323984+0000","last_clean":"2024-08-18T22:32:35.323984+0000","last_became_active":"2024-08-18T22:32:34.337781+0000","last_became_peered":"2024-08-18T22:32:34.337781+0000","last_unstale":"2024-08-18T22:32:35.323984+0000","last_undegraded":"2024-08-18T22:32:35.323984+0000","last_fullsized":"2024-08-18T22:32:35.323984+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:15.477308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323728+0000","last_change":"2024-08-18T22:32:33.323728+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323728+0000","last_undegraded":"2024-08-18T22:32:33.323728+0000","last_fullsized":"2024-08-18T22:32:33.323728+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322973+0000","last_change":"2024-08-18T22:32:33.322973+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322973+0000","last_undegraded":"2024-08-18T22:32:33.322973+0000","last_fullsized":"2024-08-18T22:32:33.322973+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323245+0000","last_change":"2024-08-18T22:32:33.323245+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323245+0000","last_undegraded":"2024-08-18T22:32:33.323245+0000","last_fullsized":"2024-08-18T22:32:33.323245+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"190'4","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324141+0000","last_change":"2024-08-18T22:32:33.341792+0000","last_active":"2024-08-18T22:32:35.324141+0000","last_peered":"2024-08-18T22:32:35.324141+0000","last_clean":"2024-08-18T22:32:35.324141+0000","last_became_active":"2024-08-18T22:32:33.341460+0000","last_became_peered":"2024-08-18T22:32:33.341460+0000","last_unstale":"2024-08-18T22:32:35.324141+0000","last_undegraded":"2024-08-18T22:32:35.324141+0000","last_fullsized":"2024-08-18T22:32:35.324141+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:06.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.335496+0000","last_change":"2024-08-18T22:32:33.335496+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.335496+0000","last_undegraded":"2024-08-18T22:32:33.335496+0000","last_fullsized":"2024-08-18T22:32:33.335496+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340101+0000","last_change":"2024-08-18T22:32:33.337250+0000","last_active":"2024-08-18T22:32:33.340101+0000","last_peered":"2024-08-18T22:32:33.340101+0000","last_clean":"2024-08-18T22:32:33.340101+0000","last_became_active":"2024-08-18T22:32:33.336973+0000","last_became_peered":"2024-08-18T22:32:33.336973+0000","last_unstale":"2024-08-18T22:32:33.340101+0000","last_undegraded":"2024-08-18T22:32:33.340101+0000","last_fullsized":"2024-08-18T22:32:33.340101+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:20:08.258033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321863+0000","last_change":"2024-08-18T22:32:33.321863+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321863+0000","last_undegraded":"2024-08-18T22:32:33.321863+0000","last_fullsized":"2024-08-18T22:32:33.321863+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.336665+0000","last_change":"2024-08-18T22:32:33.333993+0000","last_active":"2024-08-18T22:32:33.336665+0000","last_peered":"2024-08-18T22:32:33.336665+0000","last_clean":"2024-08-18T22:32:33.336665+0000","last_became_active":"2024-08-18T22:32:33.333716+0000","last_became_peered":"2024-08-18T22:32:33.333716+0000","last_unstale":"2024-08-18T22:32:33.336665+0000","last_undegraded":"2024-08-18T22:32:33.336665+0000","last_fullsized":"2024-08-18T22:32:33.336665+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:09:29.203189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328002+0000","last_change":"2024-08-18T22:32:34.332282+0000","last_active":"2024-08-18T22:32:35.328002+0000","last_peered":"2024-08-18T22:32:35.328002+0000","last_clean":"2024-08-18T22:32:35.328002+0000","last_became_active":"2024-08-18T22:32:34.331745+0000","last_became_peered":"2024-08-18T22:32:34.331745+0000","last_unstale":"2024-08-18T22:32:35.328002+0000","last_undegraded":"2024-08-18T22:32:35.328002+0000","last_fullsized":"2024-08-18T22:32:35.328002+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:59.385206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.343265+0000","last_change":"2024-08-18T22:32:33.342536+0000","last_active":"2024-08-18T22:32:33.343265+0000","last_peered":"2024-08-18T22:32:33.343265+0000","last_clean":"2024-08-18T22:32:33.343265+0000","last_became_active":"2024-08-18T22:32:33.341981+0000","last_became_peered":"2024-08-18T22:32:33.341981+0000","last_unstale":"2024-08-18T22:32:33.343265+0000","last_undegraded":"2024-08-18T22:32:33.343265+0000","last_fullsized":"2024-08-18T22:32:33.343265+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:02.165242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324119+0000","last_change":"2024-08-18T22:32:34.343058+0000","last_active":"2024-08-18T22:32:35.324119+0000","last_peered":"2024-08-18T22:32:35.324119+0000","last_clean":"2024-08-18T22:32:35.324119+0000","last_became_active":"2024-08-18T22:32:34.339495+0000","last_became_peered":"2024-08-18T22:32:34.339495+0000","last_unstale":"2024-08-18T22:32:35.324119+0000","last_undegraded":"2024-08-18T22:32:35.324119+0000","last_fullsized":"2024-08-18T22:32:35.324119+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:51:39.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.344018+0000","last_change":"2024-08-18T22:32:33.339981+0000","last_active":"2024-08-18T22:32:33.344018+0000","last_peered":"2024-08-18T22:32:33.344018+0000","last_clean":"2024-08-18T22:32:33.344018+0000","last_became_active":"2024-08-18T22:32:33.338281+0000","last_became_peered":"2024-08-18T22:32:33.338281+0000","last_unstale":"2024-08-18T22:32:33.344018+0000","last_undegraded":"2024-08-18T22:32:33.344018+0000","last_fullsized":"2024-08-18T22:32:33.344018+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:14.271558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324121+0000","last_change":"2024-08-18T22:32:34.339553+0000","last_active":"2024-08-18T22:32:35.324121+0000","last_peered":"2024-08-18T22:32:35.324121+0000","last_clean":"2024-08-18T22:32:35.324121+0000","last_became_active":"2024-08-18T22:32:34.339281+0000","last_became_peered":"2024-08-18T22:32:34.339281+0000","last_unstale":"2024-08-18T22:32:35.324121+0000","last_undegraded":"2024-08-18T22:32:35.324121+0000","last_fullsized":"2024-08-18T22:32:35.324121+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:51.382957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.344010+0000","last_change":"2024-08-18T22:32:33.338565+0000","last_active":"2024-08-18T22:32:33.344010+0000","last_peered":"2024-08-18T22:32:33.344010+0000","last_clean":"2024-08-18T22:32:33.344010+0000","last_became_active":"2024-08-18T22:32:33.338246+0000","last_became_peered":"2024-08-18T22:32:33.338246+0000","last_unstale":"2024-08-18T22:32:33.344010+0000","last_undegraded":"2024-08-18T22:32:33.344010+0000","last_fullsized":"2024-08-18T22:32:33.344010+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:17.426503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323259+0000","last_change":"2024-08-18T22:32:33.323259+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323259+0000","last_undegraded":"2024-08-18T22:32:33.323259+0000","last_fullsized":"2024-08-18T22:32:33.323259+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.334525+0000","last_change":"2024-08-18T22:32:33.332795+0000","last_active":"2024-08-18T22:32:33.334525+0000","last_peered":"2024-08-18T22:32:33.334525+0000","last_clean":"2024-08-18T22:32:33.334525+0000","last_became_active":"2024-08-18T22:32:33.332124+0000","last_became_peered":"2024-08-18T22:32:33.332124+0000","last_unstale":"2024-08-18T22:32:33.334525+0000","last_undegraded":"2024-08-18T22:32:33.334525+0000","last_fullsized":"2024-08-18T22:32:33.334525+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:36.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322954+0000","last_change":"2024-08-18T22:32:34.343093+0000","last_active":"2024-08-18T22:32:35.322954+0000","last_peered":"2024-08-18T22:32:35.322954+0000","last_clean":"2024-08-18T22:32:35.322954+0000","last_became_active":"2024-08-18T22:32:34.342837+0000","last_became_peered":"2024-08-18T22:32:34.342837+0000","last_unstale":"2024-08-18T22:32:35.322954+0000","last_undegraded":"2024-08-18T22:32:35.322954+0000","last_fullsized":"2024-08-18T22:32:35.322954+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:59.761456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328440+0000","last_change":"2024-08-18T22:32:33.342601+0000","last_active":"2024-08-18T22:32:35.328440+0000","last_peered":"2024-08-18T22:32:35.328440+0000","last_clean":"2024-08-18T22:32:35.328440+0000","last_became_active":"2024-08-18T22:32:33.342319+0000","last_became_peered":"2024-08-18T22:32:33.342319+0000","last_unstale":"2024-08-18T22:32:35.328440+0000","last_undegraded":"2024-08-18T22:32:35.328440+0000","last_fullsized":"2024-08-18T22:32:35.328440+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:44:05.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322371+0000","last_change":"2024-08-18T22:32:33.322371+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322371+0000","last_undegraded":"2024-08-18T22:32:33.322371+0000","last_fullsized":"2024-08-18T22:32:33.322371+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.344060+0000","last_change":"2024-08-18T22:32:33.339791+0000","last_active":"2024-08-18T22:32:33.344060+0000","last_peered":"2024-08-18T22:32:33.344060+0000","last_clean":"2024-08-18T22:32:33.344060+0000","last_became_active":"2024-08-18T22:32:33.339512+0000","last_became_peered":"2024-08-18T22:32:33.339512+0000","last_unstale":"2024-08-18T22:32:33.344060+0000","last_undegraded":"2024-08-18T22:32:33.344060+0000","last_fullsized":"2024-08-18T22:32:33.344060+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:36.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323577+0000","last_change":"2024-08-18T22:32:33.323577+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323577+0000","last_undegraded":"2024-08-18T22:32:33.323577+0000","last_fullsized":"2024-08-18T22:32:33.323577+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341933+0000","last_change":"2024-08-18T22:32:33.335980+0000","last_active":"2024-08-18T22:32:33.341933+0000","last_peered":"2024-08-18T22:32:33.341933+0000","last_clean":"2024-08-18T22:32:33.341933+0000","last_became_active":"2024-08-18T22:32:33.334645+0000","last_became_peered":"2024-08-18T22:32:33.334645+0000","last_unstale":"2024-08-18T22:32:33.341933+0000","last_undegraded":"2024-08-18T22:32:33.341933+0000","last_fullsized":"2024-08-18T22:32:33.341933+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:14.092947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328147+0000","last_change":"2024-08-18T22:32:34.338668+0000","last_active":"2024-08-18T22:32:35.328147+0000","last_peered":"2024-08-18T22:32:35.328147+0000","last_clean":"2024-08-18T22:32:35.328147+0000","last_became_active":"2024-08-18T22:32:34.338385+0000","last_became_peered":"2024-08-18T22:32:34.338385+0000","last_unstale":"2024-08-18T22:32:35.328147+0000","last_undegraded":"2024-08-18T22:32:35.328147+0000","last_fullsized":"2024-08-18T22:32:35.328147+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:53:41.464541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340868+0000","last_change":"2024-08-18T22:32:33.334598+0000","last_active":"2024-08-18T22:32:33.340868+0000","last_peered":"2024-08-18T22:32:33.340868+0000","last_clean":"2024-08-18T22:32:33.340868+0000","last_became_active":"2024-08-18T22:32:33.334298+0000","last_became_peered":"2024-08-18T22:32:33.334298+0000","last_unstale":"2024-08-18T22:32:33.340868+0000","last_undegraded":"2024-08-18T22:32:33.340868+0000","last_fullsized":"2024-08-18T22:32:33.340868+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:59:20.935747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324605+0000","last_change":"2024-08-18T22:32:33.324605+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324605+0000","last_undegraded":"2024-08-18T22:32:33.324605+0000","last_fullsized":"2024-08-18T22:32:33.324605+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341389+0000","last_change":"2024-08-18T22:32:33.340299+0000","last_active":"2024-08-18T22:32:33.341389+0000","last_peered":"2024-08-18T22:32:33.341389+0000","last_clean":"2024-08-18T22:32:33.341389+0000","last_became_active":"2024-08-18T22:32:33.340027+0000","last_became_peered":"2024-08-18T22:32:33.340027+0000","last_unstale":"2024-08-18T22:32:33.341389+0000","last_undegraded":"2024-08-18T22:32:33.341389+0000","last_fullsized":"2024-08-18T22:32:33.341389+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:25:31.852300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322305+0000","last_change":"2024-08-18T22:32:33.322305+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322305+0000","last_undegraded":"2024-08-18T22:32:33.322305+0000","last_fullsized":"2024-08-18T22:32:33.322305+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.333582+0000","last_change":"2024-08-18T22:32:33.331475+0000","last_active":"2024-08-18T22:32:33.333582+0000","last_peered":"2024-08-18T22:32:33.333582+0000","last_clean":"2024-08-18T22:32:33.333582+0000","last_became_active":"2024-08-18T22:32:33.331157+0000","last_became_peered":"2024-08-18T22:32:33.331157+0000","last_unstale":"2024-08-18T22:32:33.333582+0000","last_undegraded":"2024-08-18T22:32:33.333582+0000","last_fullsized":"2024-08-18T22:32:33.333582+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:17.426503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325090+0000","last_change":"2024-08-18T22:32:33.325090+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325090+0000","last_undegraded":"2024-08-18T22:32:33.325090+0000","last_fullsized":"2024-08-18T22:32:33.325090+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341522+0000","last_change":"2024-08-18T22:32:33.340757+0000","last_active":"2024-08-18T22:32:33.341522+0000","last_peered":"2024-08-18T22:32:33.341522+0000","last_clean":"2024-08-18T22:32:33.341522+0000","last_became_active":"2024-08-18T22:32:33.340260+0000","last_became_peered":"2024-08-18T22:32:33.340260+0000","last_unstale":"2024-08-18T22:32:33.341522+0000","last_undegraded":"2024-08-18T22:32:33.341522+0000","last_fullsized":"2024-08-18T22:32:33.341522+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:12:55.135480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324549+0000","last_change":"2024-08-18T22:32:33.324549+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324549+0000","last_undegraded":"2024-08-18T22:32:33.324549+0000","last_fullsized":"2024-08-18T22:32:33.324549+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"190'8","reported_seq":22,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327742+0000","last_change":"2024-08-18T22:32:33.335461+0000","last_active":"2024-08-18T22:32:35.327742+0000","last_peered":"2024-08-18T22:32:35.327742+0000","last_clean":"2024-08-18T22:32:35.327742+0000","last_became_active":"2024-08-18T22:32:33.333576+0000","last_became_peered":"2024-08-18T22:32:33.333576+0000","last_unstale":"2024-08-18T22:32:35.327742+0000","last_undegraded":"2024-08-18T22:32:35.327742+0000","last_fullsized":"2024-08-18T22:32:35.327742+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:20:29.913730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322637+0000","last_change":"2024-08-18T22:32:33.322637+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322637+0000","last_undegraded":"2024-08-18T22:32:33.322637+0000","last_fullsized":"2024-08-18T22:32:33.322637+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345368+0000","last_change":"2024-08-18T22:32:33.343063+0000","last_active":"2024-08-18T22:32:33.345368+0000","last_peered":"2024-08-18T22:32:33.345368+0000","last_clean":"2024-08-18T22:32:33.345368+0000","last_became_active":"2024-08-18T22:32:33.342745+0000","last_became_peered":"2024-08-18T22:32:33.342745+0000","last_unstale":"2024-08-18T22:32:33.345368+0000","last_undegraded":"2024-08-18T22:32:33.345368+0000","last_fullsized":"2024-08-18T22:32:33.345368+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:19:41.785588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.333262+0000","last_change":"2024-08-18T22:32:33.333262+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.333262+0000","last_undegraded":"2024-08-18T22:32:33.333262+0000","last_fullsized":"2024-08-18T22:32:33.333262+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345849+0000","last_change":"2024-08-18T22:32:33.344896+0000","last_active":"2024-08-18T22:32:33.345849+0000","last_peered":"2024-08-18T22:32:33.345849+0000","last_clean":"2024-08-18T22:32:33.345849+0000","last_became_active":"2024-08-18T22:32:33.344602+0000","last_became_peered":"2024-08-18T22:32:33.344602+0000","last_unstale":"2024-08-18T22:32:33.345849+0000","last_undegraded":"2024-08-18T22:32:33.345849+0000","last_fullsized":"2024-08-18T22:32:33.345849+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:36.812989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.329869+0000","last_change":"2024-08-18T22:32:33.329869+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.329869+0000","last_undegraded":"2024-08-18T22:32:33.329869+0000","last_fullsized":"2024-08-18T22:32:33.329869+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341148+0000","last_change":"2024-08-18T22:32:33.337911+0000","last_active":"2024-08-18T22:32:33.341148+0000","last_peered":"2024-08-18T22:32:33.341148+0000","last_clean":"2024-08-18T22:32:33.341148+0000","last_became_active":"2024-08-18T22:32:33.337622+0000","last_became_peered":"2024-08-18T22:32:33.337622+0000","last_unstale":"2024-08-18T22:32:33.341148+0000","last_undegraded":"2024-08-18T22:32:33.341148+0000","last_fullsized":"2024-08-18T22:32:33.341148+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:35:24.749624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322556+0000","last_change":"2024-08-18T22:32:33.322556+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322556+0000","last_undegraded":"2024-08-18T22:32:33.322556+0000","last_fullsized":"2024-08-18T22:32:33.322556+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328380+0000","last_change":"2024-08-18T22:32:33.341287+0000","last_active":"2024-08-18T22:32:35.328380+0000","last_peered":"2024-08-18T22:32:35.328380+0000","last_clean":"2024-08-18T22:32:35.328380+0000","last_became_active":"2024-08-18T22:32:33.340919+0000","last_became_peered":"2024-08-18T22:32:33.340919+0000","last_unstale":"2024-08-18T22:32:35.328380+0000","last_undegraded":"2024-08-18T22:32:35.328380+0000","last_fullsized":"2024-08-18T22:32:35.328380+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:08:07.407708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324176+0000","last_change":"2024-08-18T22:32:33.324176+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324176+0000","last_undegraded":"2024-08-18T22:32:33.324176+0000","last_fullsized":"2024-08-18T22:32:33.324176+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328253+0000","last_change":"2024-08-18T22:32:33.334444+0000","last_active":"2024-08-18T22:32:35.328253+0000","last_peered":"2024-08-18T22:32:35.328253+0000","last_clean":"2024-08-18T22:32:35.328253+0000","last_became_active":"2024-08-18T22:32:33.334157+0000","last_became_peered":"2024-08-18T22:32:33.334157+0000","last_unstale":"2024-08-18T22:32:35.328253+0000","last_undegraded":"2024-08-18T22:32:35.328253+0000","last_fullsized":"2024-08-18T22:32:35.328253+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:57.349272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323306+0000","last_change":"2024-08-18T22:32:33.323306+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323306+0000","last_undegraded":"2024-08-18T22:32:33.323306+0000","last_fullsized":"2024-08-18T22:32:33.323306+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.338232+0000","last_change":"2024-08-18T22:32:33.334916+0000","last_active":"2024-08-18T22:32:33.338232+0000","last_peered":"2024-08-18T22:32:33.338232+0000","last_clean":"2024-08-18T22:32:33.338232+0000","last_became_active":"2024-08-18T22:32:33.334646+0000","last_became_peered":"2024-08-18T22:32:33.334646+0000","last_unstale":"2024-08-18T22:32:33.338232+0000","last_undegraded":"2024-08-18T22:32:33.338232+0000","last_fullsized":"2024-08-18T22:32:33.338232+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:09.453233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324673+0000","last_change":"2024-08-18T22:32:33.324673+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324673+0000","last_undegraded":"2024-08-18T22:32:33.324673+0000","last_fullsized":"2024-08-18T22:32:33.324673+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324009+0000","last_change":"2024-08-18T22:32:33.341713+0000","last_active":"2024-08-18T22:32:35.324009+0000","last_peered":"2024-08-18T22:32:35.324009+0000","last_clean":"2024-08-18T22:32:35.324009+0000","last_became_active":"2024-08-18T22:32:33.341422+0000","last_became_peered":"2024-08-18T22:32:33.341422+0000","last_unstale":"2024-08-18T22:32:35.324009+0000","last_undegraded":"2024-08-18T22:32:35.324009+0000","last_fullsized":"2024-08-18T22:32:35.324009+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:15.668948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322076+0000","last_change":"2024-08-18T22:32:33.322076+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322076+0000","last_undegraded":"2024-08-18T22:32:33.322076+0000","last_fullsized":"2024-08-18T22:32:33.322076+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345478+0000","last_change":"2024-08-18T22:32:33.342210+0000","last_active":"2024-08-18T22:32:33.345478+0000","last_peered":"2024-08-18T22:32:33.345478+0000","last_clean":"2024-08-18T22:32:33.345478+0000","last_became_active":"2024-08-18T22:32:33.341921+0000","last_became_peered":"2024-08-18T22:32:33.341921+0000","last_unstale":"2024-08-18T22:32:33.345478+0000","last_undegraded":"2024-08-18T22:32:33.345478+0000","last_fullsized":"2024-08-18T22:32:33.345478+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:22:03.299700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321838+0000","last_change":"2024-08-18T22:32:33.321838+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321838+0000","last_undegraded":"2024-08-18T22:32:33.321838+0000","last_fullsized":"2024-08-18T22:32:33.321838+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.335418+0000","last_change":"2024-08-18T22:32:33.332550+0000","last_active":"2024-08-18T22:32:33.335418+0000","last_peered":"2024-08-18T22:32:33.335418+0000","last_clean":"2024-08-18T22:32:33.335418+0000","last_became_active":"2024-08-18T22:32:33.332177+0000","last_became_peered":"2024-08-18T22:32:33.332177+0000","last_unstale":"2024-08-18T22:32:33.335418+0000","last_undegraded":"2024-08-18T22:32:33.335418+0000","last_fullsized":"2024-08-18T22:32:33.335418+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:33:51.414209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321482+0000","last_change":"2024-08-18T22:32:33.321482+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321482+0000","last_undegraded":"2024-08-18T22:32:33.321482+0000","last_fullsized":"2024-08-18T22:32:33.321482+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.337294+0000","last_change":"2024-08-18T22:32:33.333264+0000","last_active":"2024-08-18T22:32:33.337294+0000","last_peered":"2024-08-18T22:32:33.337294+0000","last_clean":"2024-08-18T22:32:33.337294+0000","last_became_active":"2024-08-18T22:32:33.332744+0000","last_became_peered":"2024-08-18T22:32:33.332744+0000","last_unstale":"2024-08-18T22:32:33.337294+0000","last_undegraded":"2024-08-18T22:32:33.337294+0000","last_fullsized":"2024-08-18T22:32:33.337294+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:54:40.458643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324000+0000","last_change":"2024-08-18T22:32:33.324000+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324000+0000","last_undegraded":"2024-08-18T22:32:33.324000+0000","last_fullsized":"2024-08-18T22:32:33.324000+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323956+0000","last_change":"2024-08-18T22:32:33.339203+0000","last_active":"2024-08-18T22:32:35.323956+0000","last_peered":"2024-08-18T22:32:35.323956+0000","last_clean":"2024-08-18T22:32:35.323956+0000","last_became_active":"2024-08-18T22:32:33.338874+0000","last_became_peered":"2024-08-18T22:32:33.338874+0000","last_unstale":"2024-08-18T22:32:35.323956+0000","last_undegraded":"2024-08-18T22:32:35.323956+0000","last_fullsized":"2024-08-18T22:32:35.323956+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:22.210202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.331526+0000","last_change":"2024-08-18T22:32:33.331526+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.331526+0000","last_undegraded":"2024-08-18T22:32:33.331526+0000","last_fullsized":"2024-08-18T22:32:33.331526+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345487+0000","last_change":"2024-08-18T22:32:33.344244+0000","last_active":"2024-08-18T22:32:33.345487+0000","last_peered":"2024-08-18T22:32:33.345487+0000","last_clean":"2024-08-18T22:32:33.345487+0000","last_became_active":"2024-08-18T22:32:33.340454+0000","last_became_peered":"2024-08-18T22:32:33.340454+0000","last_unstale":"2024-08-18T22:32:33.345487+0000","last_undegraded":"2024-08-18T22:32:33.345487+0000","last_fullsized":"2024-08-18T22:32:33.345487+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:44.234250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321885+0000","last_change":"2024-08-18T22:32:33.321885+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321885+0000","last_undegraded":"2024-08-18T22:32:33.321885+0000","last_fullsized":"2024-08-18T22:32:33.321885+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341330+0000","last_change":"2024-08-18T22:32:33.336637+0000","last_active":"2024-08-18T22:32:33.341330+0000","last_peered":"2024-08-18T22:32:33.341330+0000","last_clean":"2024-08-18T22:32:33.341330+0000","last_became_active":"2024-08-18T22:32:33.336352+0000","last_became_peered":"2024-08-18T22:32:33.336352+0000","last_unstale":"2024-08-18T22:32:33.341330+0000","last_undegraded":"2024-08-18T22:32:33.341330+0000","last_fullsized":"2024-08-18T22:32:33.341330+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:01.375890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322695+0000","last_change":"2024-08-18T22:32:33.322695+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322695+0000","last_undegraded":"2024-08-18T22:32:33.322695+0000","last_fullsized":"2024-08-18T22:32:33.322695+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340492+0000","last_change":"2024-08-18T22:32:33.338065+0000","last_active":"2024-08-18T22:32:33.340492+0000","last_peered":"2024-08-18T22:32:33.340492+0000","last_clean":"2024-08-18T22:32:33.340492+0000","last_became_active":"2024-08-18T22:32:33.337556+0000","last_became_peered":"2024-08-18T22:32:33.337556+0000","last_unstale":"2024-08-18T22:32:33.340492+0000","last_undegraded":"2024-08-18T22:32:33.340492+0000","last_fullsized":"2024-08-18T22:32:33.340492+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:38.684209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323405+0000","last_change":"2024-08-18T22:32:33.323405+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323405+0000","last_undegraded":"2024-08-18T22:32:33.323405+0000","last_fullsized":"2024-08-18T22:32:33.323405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345475+0000","last_change":"2024-08-18T22:32:33.343854+0000","last_active":"2024-08-18T22:32:33.345475+0000","last_peered":"2024-08-18T22:32:33.345475+0000","last_clean":"2024-08-18T22:32:33.345475+0000","last_became_active":"2024-08-18T22:32:33.342459+0000","last_became_peered":"2024-08-18T22:32:33.342459+0000","last_unstale":"2024-08-18T22:32:33.345475+0000","last_undegraded":"2024-08-18T22:32:33.345475+0000","last_fullsized":"2024-08-18T22:32:33.345475+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:39:53.509719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323137+0000","last_change":"2024-08-18T22:32:33.323137+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323137+0000","last_undegraded":"2024-08-18T22:32:33.323137+0000","last_fullsized":"2024-08-18T22:32:33.323137+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327687+0000","last_change":"2024-08-18T22:32:33.336271+0000","last_active":"2024-08-18T22:32:35.327687+0000","last_peered":"2024-08-18T22:32:35.327687+0000","last_clean":"2024-08-18T22:32:35.327687+0000","last_became_active":"2024-08-18T22:32:33.335793+0000","last_became_peered":"2024-08-18T22:32:33.335793+0000","last_unstale":"2024-08-18T22:32:35.327687+0000","last_undegraded":"2024-08-18T22:32:35.327687+0000","last_fullsized":"2024-08-18T22:32:35.327687+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:09.734094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.333611+0000","last_change":"2024-08-18T22:32:33.333611+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.333611+0000","last_undegraded":"2024-08-18T22:32:33.333611+0000","last_fullsized":"2024-08-18T22:32:33.333611+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340513+0000","last_change":"2024-08-18T22:32:33.335923+0000","last_active":"2024-08-18T22:32:33.340513+0000","last_peered":"2024-08-18T22:32:33.340513+0000","last_clean":"2024-08-18T22:32:33.340513+0000","last_became_active":"2024-08-18T22:32:33.335475+0000","last_became_peered":"2024-08-18T22:32:33.335475+0000","last_unstale":"2024-08-18T22:32:33.340513+0000","last_undegraded":"2024-08-18T22:32:33.340513+0000","last_fullsized":"2024-08-18T22:32:33.340513+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:13.526045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":512,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.323248+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:32:33.323248+0000","last_peered":"2024-08-18T22:32:33.323248+0000","last_clean":"2024-08-18T22:32:33.323248+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:32:33.323248+0000","last_undegraded":"2024-08-18T22:32:33.323248+0000","last_fullsized":"2024-08-18T22:32:33.323248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509604,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52120,"kb_used_data":2888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319720,"statfs":{"total":96636764160,"available":96583393280,"internally_reserved":0,"allocated":2957312,"data_stored":1705166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509606,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51552,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320288,"statfs":{"total":96636764160,"available":96583974912,"internally_reserved":0,"allocated":2375680,"data_stored":1121465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51536,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320304,"statfs":{"total":96636764160,"available":96583991296,"internally_reserved":0,"allocated":2363392,"data_stored":1114798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509605,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47384,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324456,"statfs":{"total":96636764160,"available":96588242944,"internally_reserved":0,"allocated":2363392,"data_stored":1114798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509604,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47380,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324460,"statfs":{"total":96636764160,"available":96588247040,"internally_reserved":0,"allocated":2363392,"data_stored":1114798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509605,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60448,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311392,"statfs":{"total":96636764160,"available":96574865408,"internally_reserved":0,"allocated":2969600,"data_stored":1711833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59900,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311940,"statfs":{"total":96636764160,"available":96575426560,"internally_reserved":0,"allocated":2404352,"data_stored":1135906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575013,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59888,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311952,"statfs":{"total":96636764160,"available":96575438848,"internally_reserved":0,"allocated":2392064,"data_stored":1128722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:32:38.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:32:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.635+0000 7fe4dd000640 1 Processor -- start 2024-08-18T22:32:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.635+0000 7fe4dd000640 1 -- start start 2024-08-18T22:32:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4dd000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe4d806f290 0x7fe4d80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4dd000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d80cd850 con 0x7fe4d80cd3a0 2024-08-18T22:32:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4dd000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d80cee20 con 0x7fe4d815b010 2024-08-18T22:32:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4dd000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe4d80cfa30 con 0x7fe4d806f290 2024-08-18T22:32:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d6800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe4d80cd3a0 0x7fe4d8072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49160/0 (socket says 172.21.15.5:49160) 2024-08-18T22:32:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d6800640 1 -- 172.21.15.5:0/2050378402 learned_addr learned my addr 172.21.15.5:0/2050378402 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4cd400640 1 --2- 172.21.15.5:0/2050378402 >> v2:172.21.15.117:3300/0 conn(0x7fe4d806f290 0x7fe4d80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646029769 0 0) 0x7fe4d80cd850 con 0x7fe4d80cd3a0 2024-08-18T22:32:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4bc003530 con 0x7fe4d80cd3a0 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1077986590 0 0) 0x7fe4bc003530 con 0x7fe4d80cd3a0 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 >> v2:172.21.15.117:3300/0 conn(0x7fe4d806f290 msgr2=0x7fe4d80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 --2- 172.21.15.5:0/2050378402 >> v2:172.21.15.117:3300/0 conn(0x7fe4d806f290 0x7fe4d80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 >> v1:172.21.15.117:6789/0 conn(0x7fe4d815b010 legacy=0x7fe4d806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d80cf100 con 0x7fe4d80cd3a0 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fe4d0001a00 con 0x7fe4d80cd3a0 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 >> v1:172.21.15.5:6789/0 conn(0x7fe4d80cd3a0 legacy=0x7fe4d8072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 --2- 172.21.15.5:0/2050378402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4bc0039c0 0x7fe4bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 --2- 172.21.15.5:0/2050378402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 0x7fe4bc004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 --2- 172.21.15.5:0/2050378402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4bc005090 0x7fe4bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d80cfa30 con 0x7fe4bc0043c0 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc00bff0 con 0x7fe4bc0039c0 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe4bc00c1f0 con 0x7fe4bc005090 2024-08-18T22:32:38.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4cd400640 1 --2- 172.21.15.5:0/2050378402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 0x7fe4bc004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d5e00640 1 --2- 172.21.15.5:0/2050378402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4bc0039c0 0x7fe4bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d6800640 1 --2- 172.21.15.5:0/2050378402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4bc005090 0x7fe4bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4cd400640 1 -- 172.21.15.5:0/2050378402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4bc005090 msgr2=0x7fe4bc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:38.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4cd400640 1 --2- 172.21.15.5:0/2050378402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4bc005090 0x7fe4bc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4cd400640 1 -- 172.21.15.5:0/2050378402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4bc0039c0 msgr2=0x7fe4bc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:38.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4cd400640 1 --2- 172.21.15.5:0/2050378402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4bc0039c0 0x7fe4bc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4cd400640 1 -- 172.21.15.5:0/2050378402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc003530 con 0x7fe4bc0043c0 2024-08-18T22:32:38.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.639+0000 7fe4d6800640 1 -- 172.21.15.5:0/2050378402 reap_dead start 2024-08-18T22:32:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.643+0000 7fe4cd400640 1 --2- 172.21.15.5:0/2050378402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 0x7fe4bc004890 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009ae0 tx=0x7fe4c001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba26a1c113f350ec server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.643+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00b2070 con 0x7fe4bc0043c0 2024-08-18T22:32:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.643+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c00a5660 con 0x7fe4bc0043c0 2024-08-18T22:32:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.643+0000 7fe4d5400640 1 -- 172.21.15.5:0/2050378402 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00096b0 con 0x7fe4bc0043c0 2024-08-18T22:32:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.643+0000 7fe4dd000640 1 -- 172.21.15.5:0/2050378402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 msgr2=0x7fe4bc004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.643+0000 7fe4dd000640 1 --2- 172.21.15.5:0/2050378402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 0x7fe4bc004890 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009ae0 tx=0x7fe4c001ca70 comp rx=0 tx=0).stop 2024-08-18T22:32:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.643+0000 7fe4dd000640 1 -- 172.21.15.5:0/2050378402 shutdown_connections 2024-08-18T22:32:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.643+0000 7fe4dd000640 1 --2- 172.21.15.5:0/2050378402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 0x7fe4bc004890 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.643+0000 7fe4dd000640 1 -- 172.21.15.5:0/2050378402 >> 172.21.15.5:0/2050378402 conn(0x7fe4d80b1c50 msgr2=0x7fe4d80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.643+0000 7fe4dd000640 1 -- 172.21.15.5:0/2050378402 shutdown_connections 2024-08-18T22:32:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.643+0000 7fe4dd000640 1 -- 172.21.15.5:0/2050378402 wait complete. 2024-08-18T22:32:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4dd000640 1 Processor -- start 2024-08-18T22:32:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4dd000640 1 -- start start 2024-08-18T22:32:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4dd000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 0x7fe4d809d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4dd000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4d81f3e10 0x7fe4d814ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4dd000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4d815cb50 0x7fe4d815cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4dd000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d815b3f0 con 0x7fe4bc0043c0 2024-08-18T22:32:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4dd000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d80cf6c0 con 0x7fe4d81f3e10 2024-08-18T22:32:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4dd000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d80b42b0 con 0x7fe4d815cb50 2024-08-18T22:32:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4d5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 0x7fe4d809d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4d5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 0x7fe4d809d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46896/0 (socket says 172.21.15.5:46896) 2024-08-18T22:32:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4d5e00640 1 -- 172.21.15.5:0/3813308415 learned_addr learned my addr 172.21.15.5:0/3813308415 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:38.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4cd400640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4d81f3e10 0x7fe4d814ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4d6800640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4d815cb50 0x7fe4d815cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4d5e00640 1 -- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4d815cb50 msgr2=0x7fe4d815cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4d5e00640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4d815cb50 0x7fe4d815cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4d5e00640 1 -- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4d81f3e10 msgr2=0x7fe4d814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4d5e00640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4d81f3e10 0x7fe4d814ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4d5e00640 1 -- 172.21.15.5:0/3813308415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d81f45f0 con 0x7fe4bc0043c0 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4d5e00640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 0x7fe4d809d320 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8011e30 tx=0x7fe4c800f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4cea00640 1 -- 172.21.15.5:0/3813308415 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8010040 con 0x7fe4bc0043c0 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4cea00640 1 -- 172.21.15.5:0/3813308415 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c801a070 con 0x7fe4bc0043c0 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4cea00640 1 -- 172.21.15.5:0/3813308415 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800fe60 con 0x7fe4bc0043c0 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4dd000640 1 -- 172.21.15.5:0/3813308415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d81f48d0 con 0x7fe4bc0043c0 2024-08-18T22:32:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4dd000640 1 -- 172.21.15.5:0/3813308415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d814ef40 con 0x7fe4bc0043c0 2024-08-18T22:32:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.647+0000 7fe4dd000640 1 -- 172.21.15.5:0/3813308415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d80ce840 con 0x7fe4bc0043c0 2024-08-18T22:32:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.651+0000 7fe4cea00640 1 -- 172.21.15.5:0/3813308415 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4c8015890 con 0x7fe4bc0043c0 2024-08-18T22:32:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.651+0000 7fe4cea00640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4b40678f0 0x7fe4b4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.651+0000 7fe4cea00640 1 -- 172.21.15.5:0/3813308415 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fe4c8089530 con 0x7fe4bc0043c0 2024-08-18T22:32:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.651+0000 7fe4cd400640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4b40678f0 0x7fe4b4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.651+0000 7fe4cd400640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4b40678f0 0x7fe4b4069db0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00af000 tx=0x7fe4c00046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.655+0000 7fe4cea00640 1 -- 172.21.15.5:0/3813308415 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe4c8059e40 con 0x7fe4bc0043c0 2024-08-18T22:32:38.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.815+0000 7fe4dd000640 1 -- 172.21.15.5:0/3813308415 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4d8072750 con 0x7fe4b40678f0 2024-08-18T22:32:38.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.823+0000 7fe4cea00640 1 -- 172.21.15.5:0/3813308415 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248125 (secure 0 0 0) 0x7fe4c00f9950 con 0x7fe4b40678f0 2024-08-18T22:32:38.824 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:38.826 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:32:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.823+0000 7fe4dd000640 1 -- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4b40678f0 msgr2=0x7fe4b4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.823+0000 7fe4dd000640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4b40678f0 0x7fe4b4069db0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00af000 tx=0x7fe4c00046d0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.823+0000 7fe4dd000640 1 -- 172.21.15.5:0/3813308415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 msgr2=0x7fe4d809d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:38.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.823+0000 7fe4dd000640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 0x7fe4d809d320 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8011e30 tx=0x7fe4c800f540 comp rx=0 tx=0).stop 2024-08-18T22:32:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.827+0000 7fe4dd000640 1 -- 172.21.15.5:0/3813308415 shutdown_connections 2024-08-18T22:32:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.827+0000 7fe4dd000640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe4b40678f0 0x7fe4b4069db0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.827+0000 7fe4dd000640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4d815cb50 0x7fe4d815cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.827+0000 7fe4dd000640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4d81f3e10 0x7fe4d814ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.827+0000 7fe4dd000640 1 --2- 172.21.15.5:0/3813308415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4bc0043c0 0x7fe4d809d320 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.827+0000 7fe4dd000640 1 -- 172.21.15.5:0/3813308415 >> 172.21.15.5:0/3813308415 conn(0x7fe4d80b1c50 msgr2=0x7fe4d80cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.827+0000 7fe4dd000640 1 -- 172.21.15.5:0/3813308415 shutdown_connections 2024-08-18T22:32:38.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:38.827+0000 7fe4dd000640 1 -- 172.21.15.5:0/3813308415 wait complete. 2024-08-18T22:32:38.846 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":590,"stamp":"2024-08-18T22:32:37.815966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":430208,"kb_used_data":19716,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754544512,"statfs":{"total":773094113280,"available":772653580288,"internally_reserved":0,"allocated":20189184,"data_stored":10147486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.510559"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.334406+0000","last_change":"2024-08-18T22:32:33.334406+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.334406+0000","last_undegraded":"2024-08-18T22:32:33.334406+0000","last_fullsized":"2024-08-18T22:32:33.334406+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325093+0000","last_change":"2024-08-18T22:32:33.325093+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325093+0000","last_undegraded":"2024-08-18T22:32:33.325093+0000","last_fullsized":"2024-08-18T22:32:33.325093+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.329261+0000","last_change":"2024-08-18T22:32:33.329261+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.329261+0000","last_undegraded":"2024-08-18T22:32:33.329261+0000","last_fullsized":"2024-08-18T22:32:33.329261+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323643+0000","last_change":"2024-08-18T22:32:33.323643+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323643+0000","last_undegraded":"2024-08-18T22:32:33.323643+0000","last_fullsized":"2024-08-18T22:32:33.323643+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327951+0000","last_change":"2024-08-18T22:32:34.332036+0000","last_active":"2024-08-18T22:32:35.327951+0000","last_peered":"2024-08-18T22:32:35.327951+0000","last_clean":"2024-08-18T22:32:35.327951+0000","last_became_active":"2024-08-18T22:32:34.331366+0000","last_became_peered":"2024-08-18T22:32:34.331366+0000","last_unstale":"2024-08-18T22:32:35.327951+0000","last_undegraded":"2024-08-18T22:32:35.327951+0000","last_fullsized":"2024-08-18T22:32:35.327951+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:00.772598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322789+0000","last_change":"2024-08-18T22:32:33.322789+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322789+0000","last_undegraded":"2024-08-18T22:32:33.322789+0000","last_fullsized":"2024-08-18T22:32:33.322789+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327668+0000","last_change":"2024-08-18T22:32:34.328506+0000","last_active":"2024-08-18T22:32:35.327668+0000","last_peered":"2024-08-18T22:32:35.327668+0000","last_clean":"2024-08-18T22:32:35.327668+0000","last_became_active":"2024-08-18T22:32:34.328188+0000","last_became_peered":"2024-08-18T22:32:34.328188+0000","last_unstale":"2024-08-18T22:32:35.327668+0000","last_undegraded":"2024-08-18T22:32:35.327668+0000","last_fullsized":"2024-08-18T22:32:35.327668+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:08.229648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324176+0000","last_change":"2024-08-18T22:32:33.324176+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324176+0000","last_undegraded":"2024-08-18T22:32:33.324176+0000","last_fullsized":"2024-08-18T22:32:33.324176+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324748+0000","last_change":"2024-08-18T22:32:33.324748+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324748+0000","last_undegraded":"2024-08-18T22:32:33.324748+0000","last_fullsized":"2024-08-18T22:32:33.324748+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322214+0000","last_change":"2024-08-18T22:32:33.322214+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322214+0000","last_undegraded":"2024-08-18T22:32:33.322214+0000","last_fullsized":"2024-08-18T22:32:33.322214+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.326218+0000","last_change":"2024-08-18T22:32:33.326218+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.326218+0000","last_undegraded":"2024-08-18T22:32:33.326218+0000","last_fullsized":"2024-08-18T22:32:33.326218+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328280+0000","last_change":"2024-08-18T22:32:34.350611+0000","last_active":"2024-08-18T22:32:35.328280+0000","last_peered":"2024-08-18T22:32:35.328280+0000","last_clean":"2024-08-18T22:32:35.328280+0000","last_became_active":"2024-08-18T22:32:34.346800+0000","last_became_peered":"2024-08-18T22:32:34.346800+0000","last_unstale":"2024-08-18T22:32:35.328280+0000","last_undegraded":"2024-08-18T22:32:35.328280+0000","last_fullsized":"2024-08-18T22:32:35.328280+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:10.581383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323206+0000","last_change":"2024-08-18T22:32:33.323206+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323206+0000","last_undegraded":"2024-08-18T22:32:33.323206+0000","last_fullsized":"2024-08-18T22:32:33.323206+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.326351+0000","last_change":"2024-08-18T22:32:33.326351+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.326351+0000","last_undegraded":"2024-08-18T22:32:33.326351+0000","last_fullsized":"2024-08-18T22:32:33.326351+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323091+0000","last_change":"2024-08-18T22:32:34.340094+0000","last_active":"2024-08-18T22:32:35.323091+0000","last_peered":"2024-08-18T22:32:35.323091+0000","last_clean":"2024-08-18T22:32:35.323091+0000","last_became_active":"2024-08-18T22:32:34.339828+0000","last_became_peered":"2024-08-18T22:32:34.339828+0000","last_unstale":"2024-08-18T22:32:35.323091+0000","last_undegraded":"2024-08-18T22:32:35.323091+0000","last_fullsized":"2024-08-18T22:32:35.323091+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:01:26.496081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.330234+0000","last_change":"2024-08-18T22:32:33.330234+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.330234+0000","last_undegraded":"2024-08-18T22:32:33.330234+0000","last_fullsized":"2024-08-18T22:32:33.330234+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324211+0000","last_change":"2024-08-18T22:32:33.324211+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324211+0000","last_undegraded":"2024-08-18T22:32:33.324211+0000","last_fullsized":"2024-08-18T22:32:33.324211+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325580+0000","last_change":"2024-08-18T22:32:33.325580+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325580+0000","last_undegraded":"2024-08-18T22:32:33.325580+0000","last_fullsized":"2024-08-18T22:32:33.325580+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321840+0000","last_change":"2024-08-18T22:32:33.321840+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321840+0000","last_undegraded":"2024-08-18T22:32:33.321840+0000","last_fullsized":"2024-08-18T22:32:33.321840+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322462+0000","last_change":"2024-08-18T22:32:33.322462+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322462+0000","last_undegraded":"2024-08-18T22:32:33.322462+0000","last_fullsized":"2024-08-18T22:32:33.322462+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323064+0000","last_change":"2024-08-18T22:32:33.323064+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323064+0000","last_undegraded":"2024-08-18T22:32:33.323064+0000","last_fullsized":"2024-08-18T22:32:33.323064+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324593+0000","last_change":"2024-08-18T22:32:33.324593+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324593+0000","last_undegraded":"2024-08-18T22:32:33.324593+0000","last_fullsized":"2024-08-18T22:32:33.324593+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325159+0000","last_change":"2024-08-18T22:32:33.325159+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325159+0000","last_undegraded":"2024-08-18T22:32:33.325159+0000","last_fullsized":"2024-08-18T22:32:33.325159+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327593+0000","last_change":"2024-08-18T22:32:34.336858+0000","last_active":"2024-08-18T22:32:35.327593+0000","last_peered":"2024-08-18T22:32:35.327593+0000","last_clean":"2024-08-18T22:32:35.327593+0000","last_became_active":"2024-08-18T22:32:34.336586+0000","last_became_peered":"2024-08-18T22:32:34.336586+0000","last_unstale":"2024-08-18T22:32:35.327593+0000","last_undegraded":"2024-08-18T22:32:35.327593+0000","last_fullsized":"2024-08-18T22:32:35.327593+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:55.751347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323775+0000","last_change":"2024-08-18T22:32:33.323775+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323775+0000","last_undegraded":"2024-08-18T22:32:33.323775+0000","last_fullsized":"2024-08-18T22:32:33.323775+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.334940+0000","last_change":"2024-08-18T22:32:33.334940+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.334940+0000","last_undegraded":"2024-08-18T22:32:33.334940+0000","last_fullsized":"2024-08-18T22:32:33.334940+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325759+0000","last_change":"2024-08-18T22:32:33.325759+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325759+0000","last_undegraded":"2024-08-18T22:32:33.325759+0000","last_fullsized":"2024-08-18T22:32:33.325759+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328352+0000","last_change":"2024-08-18T22:32:34.331458+0000","last_active":"2024-08-18T22:32:35.328352+0000","last_peered":"2024-08-18T22:32:35.328352+0000","last_clean":"2024-08-18T22:32:35.328352+0000","last_became_active":"2024-08-18T22:32:34.331049+0000","last_became_peered":"2024-08-18T22:32:34.331049+0000","last_unstale":"2024-08-18T22:32:35.328352+0000","last_undegraded":"2024-08-18T22:32:35.328352+0000","last_fullsized":"2024-08-18T22:32:35.328352+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:13:52.541926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323450+0000","last_change":"2024-08-18T22:32:33.323450+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323450+0000","last_undegraded":"2024-08-18T22:32:33.323450+0000","last_fullsized":"2024-08-18T22:32:33.323450+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323984+0000","last_change":"2024-08-18T22:32:34.338117+0000","last_active":"2024-08-18T22:32:35.323984+0000","last_peered":"2024-08-18T22:32:35.323984+0000","last_clean":"2024-08-18T22:32:35.323984+0000","last_became_active":"2024-08-18T22:32:34.337781+0000","last_became_peered":"2024-08-18T22:32:34.337781+0000","last_unstale":"2024-08-18T22:32:35.323984+0000","last_undegraded":"2024-08-18T22:32:35.323984+0000","last_fullsized":"2024-08-18T22:32:35.323984+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:15.477308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323728+0000","last_change":"2024-08-18T22:32:33.323728+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323728+0000","last_undegraded":"2024-08-18T22:32:33.323728+0000","last_fullsized":"2024-08-18T22:32:33.323728+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322973+0000","last_change":"2024-08-18T22:32:33.322973+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322973+0000","last_undegraded":"2024-08-18T22:32:33.322973+0000","last_fullsized":"2024-08-18T22:32:33.322973+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323245+0000","last_change":"2024-08-18T22:32:33.323245+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323245+0000","last_undegraded":"2024-08-18T22:32:33.323245+0000","last_fullsized":"2024-08-18T22:32:33.323245+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"190'4","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324141+0000","last_change":"2024-08-18T22:32:33.341792+0000","last_active":"2024-08-18T22:32:35.324141+0000","last_peered":"2024-08-18T22:32:35.324141+0000","last_clean":"2024-08-18T22:32:35.324141+0000","last_became_active":"2024-08-18T22:32:33.341460+0000","last_became_peered":"2024-08-18T22:32:33.341460+0000","last_unstale":"2024-08-18T22:32:35.324141+0000","last_undegraded":"2024-08-18T22:32:35.324141+0000","last_fullsized":"2024-08-18T22:32:35.324141+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:06.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.335496+0000","last_change":"2024-08-18T22:32:33.335496+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.335496+0000","last_undegraded":"2024-08-18T22:32:33.335496+0000","last_fullsized":"2024-08-18T22:32:33.335496+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340101+0000","last_change":"2024-08-18T22:32:33.337250+0000","last_active":"2024-08-18T22:32:33.340101+0000","last_peered":"2024-08-18T22:32:33.340101+0000","last_clean":"2024-08-18T22:32:33.340101+0000","last_became_active":"2024-08-18T22:32:33.336973+0000","last_became_peered":"2024-08-18T22:32:33.336973+0000","last_unstale":"2024-08-18T22:32:33.340101+0000","last_undegraded":"2024-08-18T22:32:33.340101+0000","last_fullsized":"2024-08-18T22:32:33.340101+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:20:08.258033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321863+0000","last_change":"2024-08-18T22:32:33.321863+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321863+0000","last_undegraded":"2024-08-18T22:32:33.321863+0000","last_fullsized":"2024-08-18T22:32:33.321863+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.336665+0000","last_change":"2024-08-18T22:32:33.333993+0000","last_active":"2024-08-18T22:32:33.336665+0000","last_peered":"2024-08-18T22:32:33.336665+0000","last_clean":"2024-08-18T22:32:33.336665+0000","last_became_active":"2024-08-18T22:32:33.333716+0000","last_became_peered":"2024-08-18T22:32:33.333716+0000","last_unstale":"2024-08-18T22:32:33.336665+0000","last_undegraded":"2024-08-18T22:32:33.336665+0000","last_fullsized":"2024-08-18T22:32:33.336665+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:09:29.203189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328002+0000","last_change":"2024-08-18T22:32:34.332282+0000","last_active":"2024-08-18T22:32:35.328002+0000","last_peered":"2024-08-18T22:32:35.328002+0000","last_clean":"2024-08-18T22:32:35.328002+0000","last_became_active":"2024-08-18T22:32:34.331745+0000","last_became_peered":"2024-08-18T22:32:34.331745+0000","last_unstale":"2024-08-18T22:32:35.328002+0000","last_undegraded":"2024-08-18T22:32:35.328002+0000","last_fullsized":"2024-08-18T22:32:35.328002+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:59.385206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.343265+0000","last_change":"2024-08-18T22:32:33.342536+0000","last_active":"2024-08-18T22:32:33.343265+0000","last_peered":"2024-08-18T22:32:33.343265+0000","last_clean":"2024-08-18T22:32:33.343265+0000","last_became_active":"2024-08-18T22:32:33.341981+0000","last_became_peered":"2024-08-18T22:32:33.341981+0000","last_unstale":"2024-08-18T22:32:33.343265+0000","last_undegraded":"2024-08-18T22:32:33.343265+0000","last_fullsized":"2024-08-18T22:32:33.343265+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:02.165242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324119+0000","last_change":"2024-08-18T22:32:34.343058+0000","last_active":"2024-08-18T22:32:35.324119+0000","last_peered":"2024-08-18T22:32:35.324119+0000","last_clean":"2024-08-18T22:32:35.324119+0000","last_became_active":"2024-08-18T22:32:34.339495+0000","last_became_peered":"2024-08-18T22:32:34.339495+0000","last_unstale":"2024-08-18T22:32:35.324119+0000","last_undegraded":"2024-08-18T22:32:35.324119+0000","last_fullsized":"2024-08-18T22:32:35.324119+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:51:39.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.344018+0000","last_change":"2024-08-18T22:32:33.339981+0000","last_active":"2024-08-18T22:32:33.344018+0000","last_peered":"2024-08-18T22:32:33.344018+0000","last_clean":"2024-08-18T22:32:33.344018+0000","last_became_active":"2024-08-18T22:32:33.338281+0000","last_became_peered":"2024-08-18T22:32:33.338281+0000","last_unstale":"2024-08-18T22:32:33.344018+0000","last_undegraded":"2024-08-18T22:32:33.344018+0000","last_fullsized":"2024-08-18T22:32:33.344018+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:14.271558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324121+0000","last_change":"2024-08-18T22:32:34.339553+0000","last_active":"2024-08-18T22:32:35.324121+0000","last_peered":"2024-08-18T22:32:35.324121+0000","last_clean":"2024-08-18T22:32:35.324121+0000","last_became_active":"2024-08-18T22:32:34.339281+0000","last_became_peered":"2024-08-18T22:32:34.339281+0000","last_unstale":"2024-08-18T22:32:35.324121+0000","last_undegraded":"2024-08-18T22:32:35.324121+0000","last_fullsized":"2024-08-18T22:32:35.324121+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:51.382957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.344010+0000","last_change":"2024-08-18T22:32:33.338565+0000","last_active":"2024-08-18T22:32:33.344010+0000","last_peered":"2024-08-18T22:32:33.344010+0000","last_clean":"2024-08-18T22:32:33.344010+0000","last_became_active":"2024-08-18T22:32:33.338246+0000","last_became_peered":"2024-08-18T22:32:33.338246+0000","last_unstale":"2024-08-18T22:32:33.344010+0000","last_undegraded":"2024-08-18T22:32:33.344010+0000","last_fullsized":"2024-08-18T22:32:33.344010+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:17.426503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323259+0000","last_change":"2024-08-18T22:32:33.323259+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323259+0000","last_undegraded":"2024-08-18T22:32:33.323259+0000","last_fullsized":"2024-08-18T22:32:33.323259+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.334525+0000","last_change":"2024-08-18T22:32:33.332795+0000","last_active":"2024-08-18T22:32:33.334525+0000","last_peered":"2024-08-18T22:32:33.334525+0000","last_clean":"2024-08-18T22:32:33.334525+0000","last_became_active":"2024-08-18T22:32:33.332124+0000","last_became_peered":"2024-08-18T22:32:33.332124+0000","last_unstale":"2024-08-18T22:32:33.334525+0000","last_undegraded":"2024-08-18T22:32:33.334525+0000","last_fullsized":"2024-08-18T22:32:33.334525+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:36.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322954+0000","last_change":"2024-08-18T22:32:34.343093+0000","last_active":"2024-08-18T22:32:35.322954+0000","last_peered":"2024-08-18T22:32:35.322954+0000","last_clean":"2024-08-18T22:32:35.322954+0000","last_became_active":"2024-08-18T22:32:34.342837+0000","last_became_peered":"2024-08-18T22:32:34.342837+0000","last_unstale":"2024-08-18T22:32:35.322954+0000","last_undegraded":"2024-08-18T22:32:35.322954+0000","last_fullsized":"2024-08-18T22:32:35.322954+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:59.761456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328440+0000","last_change":"2024-08-18T22:32:33.342601+0000","last_active":"2024-08-18T22:32:35.328440+0000","last_peered":"2024-08-18T22:32:35.328440+0000","last_clean":"2024-08-18T22:32:35.328440+0000","last_became_active":"2024-08-18T22:32:33.342319+0000","last_became_peered":"2024-08-18T22:32:33.342319+0000","last_unstale":"2024-08-18T22:32:35.328440+0000","last_undegraded":"2024-08-18T22:32:35.328440+0000","last_fullsized":"2024-08-18T22:32:35.328440+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:44:05.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322371+0000","last_change":"2024-08-18T22:32:33.322371+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322371+0000","last_undegraded":"2024-08-18T22:32:33.322371+0000","last_fullsized":"2024-08-18T22:32:33.322371+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.344060+0000","last_change":"2024-08-18T22:32:33.339791+0000","last_active":"2024-08-18T22:32:33.344060+0000","last_peered":"2024-08-18T22:32:33.344060+0000","last_clean":"2024-08-18T22:32:33.344060+0000","last_became_active":"2024-08-18T22:32:33.339512+0000","last_became_peered":"2024-08-18T22:32:33.339512+0000","last_unstale":"2024-08-18T22:32:33.344060+0000","last_undegraded":"2024-08-18T22:32:33.344060+0000","last_fullsized":"2024-08-18T22:32:33.344060+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:36.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323577+0000","last_change":"2024-08-18T22:32:33.323577+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323577+0000","last_undegraded":"2024-08-18T22:32:33.323577+0000","last_fullsized":"2024-08-18T22:32:33.323577+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341933+0000","last_change":"2024-08-18T22:32:33.335980+0000","last_active":"2024-08-18T22:32:33.341933+0000","last_peered":"2024-08-18T22:32:33.341933+0000","last_clean":"2024-08-18T22:32:33.341933+0000","last_became_active":"2024-08-18T22:32:33.334645+0000","last_became_peered":"2024-08-18T22:32:33.334645+0000","last_unstale":"2024-08-18T22:32:33.341933+0000","last_undegraded":"2024-08-18T22:32:33.341933+0000","last_fullsized":"2024-08-18T22:32:33.341933+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:14.092947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328147+0000","last_change":"2024-08-18T22:32:34.338668+0000","last_active":"2024-08-18T22:32:35.328147+0000","last_peered":"2024-08-18T22:32:35.328147+0000","last_clean":"2024-08-18T22:32:35.328147+0000","last_became_active":"2024-08-18T22:32:34.338385+0000","last_became_peered":"2024-08-18T22:32:34.338385+0000","last_unstale":"2024-08-18T22:32:35.328147+0000","last_undegraded":"2024-08-18T22:32:35.328147+0000","last_fullsized":"2024-08-18T22:32:35.328147+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:53:41.464541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340868+0000","last_change":"2024-08-18T22:32:33.334598+0000","last_active":"2024-08-18T22:32:33.340868+0000","last_peered":"2024-08-18T22:32:33.340868+0000","last_clean":"2024-08-18T22:32:33.340868+0000","last_became_active":"2024-08-18T22:32:33.334298+0000","last_became_peered":"2024-08-18T22:32:33.334298+0000","last_unstale":"2024-08-18T22:32:33.340868+0000","last_undegraded":"2024-08-18T22:32:33.340868+0000","last_fullsized":"2024-08-18T22:32:33.340868+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:59:20.935747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324605+0000","last_change":"2024-08-18T22:32:33.324605+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324605+0000","last_undegraded":"2024-08-18T22:32:33.324605+0000","last_fullsized":"2024-08-18T22:32:33.324605+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341389+0000","last_change":"2024-08-18T22:32:33.340299+0000","last_active":"2024-08-18T22:32:33.341389+0000","last_peered":"2024-08-18T22:32:33.341389+0000","last_clean":"2024-08-18T22:32:33.341389+0000","last_became_active":"2024-08-18T22:32:33.340027+0000","last_became_peered":"2024-08-18T22:32:33.340027+0000","last_unstale":"2024-08-18T22:32:33.341389+0000","last_undegraded":"2024-08-18T22:32:33.341389+0000","last_fullsized":"2024-08-18T22:32:33.341389+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:25:31.852300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322305+0000","last_change":"2024-08-18T22:32:33.322305+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322305+0000","last_undegraded":"2024-08-18T22:32:33.322305+0000","last_fullsized":"2024-08-18T22:32:33.322305+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.333582+0000","last_change":"2024-08-18T22:32:33.331475+0000","last_active":"2024-08-18T22:32:33.333582+0000","last_peered":"2024-08-18T22:32:33.333582+0000","last_clean":"2024-08-18T22:32:33.333582+0000","last_became_active":"2024-08-18T22:32:33.331157+0000","last_became_peered":"2024-08-18T22:32:33.331157+0000","last_unstale":"2024-08-18T22:32:33.333582+0000","last_undegraded":"2024-08-18T22:32:33.333582+0000","last_fullsized":"2024-08-18T22:32:33.333582+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:17.426503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325090+0000","last_change":"2024-08-18T22:32:33.325090+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325090+0000","last_undegraded":"2024-08-18T22:32:33.325090+0000","last_fullsized":"2024-08-18T22:32:33.325090+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341522+0000","last_change":"2024-08-18T22:32:33.340757+0000","last_active":"2024-08-18T22:32:33.341522+0000","last_peered":"2024-08-18T22:32:33.341522+0000","last_clean":"2024-08-18T22:32:33.341522+0000","last_became_active":"2024-08-18T22:32:33.340260+0000","last_became_peered":"2024-08-18T22:32:33.340260+0000","last_unstale":"2024-08-18T22:32:33.341522+0000","last_undegraded":"2024-08-18T22:32:33.341522+0000","last_fullsized":"2024-08-18T22:32:33.341522+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:12:55.135480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324549+0000","last_change":"2024-08-18T22:32:33.324549+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324549+0000","last_undegraded":"2024-08-18T22:32:33.324549+0000","last_fullsized":"2024-08-18T22:32:33.324549+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"190'8","reported_seq":22,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327742+0000","last_change":"2024-08-18T22:32:33.335461+0000","last_active":"2024-08-18T22:32:35.327742+0000","last_peered":"2024-08-18T22:32:35.327742+0000","last_clean":"2024-08-18T22:32:35.327742+0000","last_became_active":"2024-08-18T22:32:33.333576+0000","last_became_peered":"2024-08-18T22:32:33.333576+0000","last_unstale":"2024-08-18T22:32:35.327742+0000","last_undegraded":"2024-08-18T22:32:35.327742+0000","last_fullsized":"2024-08-18T22:32:35.327742+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:20:29.913730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322637+0000","last_change":"2024-08-18T22:32:33.322637+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322637+0000","last_undegraded":"2024-08-18T22:32:33.322637+0000","last_fullsized":"2024-08-18T22:32:33.322637+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345368+0000","last_change":"2024-08-18T22:32:33.343063+0000","last_active":"2024-08-18T22:32:33.345368+0000","last_peered":"2024-08-18T22:32:33.345368+0000","last_clean":"2024-08-18T22:32:33.345368+0000","last_became_active":"2024-08-18T22:32:33.342745+0000","last_became_peered":"2024-08-18T22:32:33.342745+0000","last_unstale":"2024-08-18T22:32:33.345368+0000","last_undegraded":"2024-08-18T22:32:33.345368+0000","last_fullsized":"2024-08-18T22:32:33.345368+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:19:41.785588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.333262+0000","last_change":"2024-08-18T22:32:33.333262+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.333262+0000","last_undegraded":"2024-08-18T22:32:33.333262+0000","last_fullsized":"2024-08-18T22:32:33.333262+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345849+0000","last_change":"2024-08-18T22:32:33.344896+0000","last_active":"2024-08-18T22:32:33.345849+0000","last_peered":"2024-08-18T22:32:33.345849+0000","last_clean":"2024-08-18T22:32:33.345849+0000","last_became_active":"2024-08-18T22:32:33.344602+0000","last_became_peered":"2024-08-18T22:32:33.344602+0000","last_unstale":"2024-08-18T22:32:33.345849+0000","last_undegraded":"2024-08-18T22:32:33.345849+0000","last_fullsized":"2024-08-18T22:32:33.345849+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:36.812989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.329869+0000","last_change":"2024-08-18T22:32:33.329869+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.329869+0000","last_undegraded":"2024-08-18T22:32:33.329869+0000","last_fullsized":"2024-08-18T22:32:33.329869+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341148+0000","last_change":"2024-08-18T22:32:33.337911+0000","last_active":"2024-08-18T22:32:33.341148+0000","last_peered":"2024-08-18T22:32:33.341148+0000","last_clean":"2024-08-18T22:32:33.341148+0000","last_became_active":"2024-08-18T22:32:33.337622+0000","last_became_peered":"2024-08-18T22:32:33.337622+0000","last_unstale":"2024-08-18T22:32:33.341148+0000","last_undegraded":"2024-08-18T22:32:33.341148+0000","last_fullsized":"2024-08-18T22:32:33.341148+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:35:24.749624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322556+0000","last_change":"2024-08-18T22:32:33.322556+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322556+0000","last_undegraded":"2024-08-18T22:32:33.322556+0000","last_fullsized":"2024-08-18T22:32:33.322556+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328380+0000","last_change":"2024-08-18T22:32:33.341287+0000","last_active":"2024-08-18T22:32:35.328380+0000","last_peered":"2024-08-18T22:32:35.328380+0000","last_clean":"2024-08-18T22:32:35.328380+0000","last_became_active":"2024-08-18T22:32:33.340919+0000","last_became_peered":"2024-08-18T22:32:33.340919+0000","last_unstale":"2024-08-18T22:32:35.328380+0000","last_undegraded":"2024-08-18T22:32:35.328380+0000","last_fullsized":"2024-08-18T22:32:35.328380+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:08:07.407708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324176+0000","last_change":"2024-08-18T22:32:33.324176+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324176+0000","last_undegraded":"2024-08-18T22:32:33.324176+0000","last_fullsized":"2024-08-18T22:32:33.324176+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328253+0000","last_change":"2024-08-18T22:32:33.334444+0000","last_active":"2024-08-18T22:32:35.328253+0000","last_peered":"2024-08-18T22:32:35.328253+0000","last_clean":"2024-08-18T22:32:35.328253+0000","last_became_active":"2024-08-18T22:32:33.334157+0000","last_became_peered":"2024-08-18T22:32:33.334157+0000","last_unstale":"2024-08-18T22:32:35.328253+0000","last_undegraded":"2024-08-18T22:32:35.328253+0000","last_fullsized":"2024-08-18T22:32:35.328253+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:57.349272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323306+0000","last_change":"2024-08-18T22:32:33.323306+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323306+0000","last_undegraded":"2024-08-18T22:32:33.323306+0000","last_fullsized":"2024-08-18T22:32:33.323306+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.338232+0000","last_change":"2024-08-18T22:32:33.334916+0000","last_active":"2024-08-18T22:32:33.338232+0000","last_peered":"2024-08-18T22:32:33.338232+0000","last_clean":"2024-08-18T22:32:33.338232+0000","last_became_active":"2024-08-18T22:32:33.334646+0000","last_became_peered":"2024-08-18T22:32:33.334646+0000","last_unstale":"2024-08-18T22:32:33.338232+0000","last_undegraded":"2024-08-18T22:32:33.338232+0000","last_fullsized":"2024-08-18T22:32:33.338232+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:09.453233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324673+0000","last_change":"2024-08-18T22:32:33.324673+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324673+0000","last_undegraded":"2024-08-18T22:32:33.324673+0000","last_fullsized":"2024-08-18T22:32:33.324673+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324009+0000","last_change":"2024-08-18T22:32:33.341713+0000","last_active":"2024-08-18T22:32:35.324009+0000","last_peered":"2024-08-18T22:32:35.324009+0000","last_clean":"2024-08-18T22:32:35.324009+0000","last_became_active":"2024-08-18T22:32:33.341422+0000","last_became_peered":"2024-08-18T22:32:33.341422+0000","last_unstale":"2024-08-18T22:32:35.324009+0000","last_undegraded":"2024-08-18T22:32:35.324009+0000","last_fullsized":"2024-08-18T22:32:35.324009+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:15.668948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322076+0000","last_change":"2024-08-18T22:32:33.322076+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322076+0000","last_undegraded":"2024-08-18T22:32:33.322076+0000","last_fullsized":"2024-08-18T22:32:33.322076+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345478+0000","last_change":"2024-08-18T22:32:33.342210+0000","last_active":"2024-08-18T22:32:33.345478+0000","last_peered":"2024-08-18T22:32:33.345478+0000","last_clean":"2024-08-18T22:32:33.345478+0000","last_became_active":"2024-08-18T22:32:33.341921+0000","last_became_peered":"2024-08-18T22:32:33.341921+0000","last_unstale":"2024-08-18T22:32:33.345478+0000","last_undegraded":"2024-08-18T22:32:33.345478+0000","last_fullsized":"2024-08-18T22:32:33.345478+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:22:03.299700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321838+0000","last_change":"2024-08-18T22:32:33.321838+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321838+0000","last_undegraded":"2024-08-18T22:32:33.321838+0000","last_fullsized":"2024-08-18T22:32:33.321838+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.335418+0000","last_change":"2024-08-18T22:32:33.332550+0000","last_active":"2024-08-18T22:32:33.335418+0000","last_peered":"2024-08-18T22:32:33.335418+0000","last_clean":"2024-08-18T22:32:33.335418+0000","last_became_active":"2024-08-18T22:32:33.332177+0000","last_became_peered":"2024-08-18T22:32:33.332177+0000","last_unstale":"2024-08-18T22:32:33.335418+0000","last_undegraded":"2024-08-18T22:32:33.335418+0000","last_fullsized":"2024-08-18T22:32:33.335418+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:33:51.414209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321482+0000","last_change":"2024-08-18T22:32:33.321482+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321482+0000","last_undegraded":"2024-08-18T22:32:33.321482+0000","last_fullsized":"2024-08-18T22:32:33.321482+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.337294+0000","last_change":"2024-08-18T22:32:33.333264+0000","last_active":"2024-08-18T22:32:33.337294+0000","last_peered":"2024-08-18T22:32:33.337294+0000","last_clean":"2024-08-18T22:32:33.337294+0000","last_became_active":"2024-08-18T22:32:33.332744+0000","last_became_peered":"2024-08-18T22:32:33.332744+0000","last_unstale":"2024-08-18T22:32:33.337294+0000","last_undegraded":"2024-08-18T22:32:33.337294+0000","last_fullsized":"2024-08-18T22:32:33.337294+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:54:40.458643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324000+0000","last_change":"2024-08-18T22:32:33.324000+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324000+0000","last_undegraded":"2024-08-18T22:32:33.324000+0000","last_fullsized":"2024-08-18T22:32:33.324000+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323956+0000","last_change":"2024-08-18T22:32:33.339203+0000","last_active":"2024-08-18T22:32:35.323956+0000","last_peered":"2024-08-18T22:32:35.323956+0000","last_clean":"2024-08-18T22:32:35.323956+0000","last_became_active":"2024-08-18T22:32:33.338874+0000","last_became_peered":"2024-08-18T22:32:33.338874+0000","last_unstale":"2024-08-18T22:32:35.323956+0000","last_undegraded":"2024-08-18T22:32:35.323956+0000","last_fullsized":"2024-08-18T22:32:35.323956+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:22.210202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.331526+0000","last_change":"2024-08-18T22:32:33.331526+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.331526+0000","last_undegraded":"2024-08-18T22:32:33.331526+0000","last_fullsized":"2024-08-18T22:32:33.331526+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345487+0000","last_change":"2024-08-18T22:32:33.344244+0000","last_active":"2024-08-18T22:32:33.345487+0000","last_peered":"2024-08-18T22:32:33.345487+0000","last_clean":"2024-08-18T22:32:33.345487+0000","last_became_active":"2024-08-18T22:32:33.340454+0000","last_became_peered":"2024-08-18T22:32:33.340454+0000","last_unstale":"2024-08-18T22:32:33.345487+0000","last_undegraded":"2024-08-18T22:32:33.345487+0000","last_fullsized":"2024-08-18T22:32:33.345487+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:44.234250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321885+0000","last_change":"2024-08-18T22:32:33.321885+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321885+0000","last_undegraded":"2024-08-18T22:32:33.321885+0000","last_fullsized":"2024-08-18T22:32:33.321885+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341330+0000","last_change":"2024-08-18T22:32:33.336637+0000","last_active":"2024-08-18T22:32:33.341330+0000","last_peered":"2024-08-18T22:32:33.341330+0000","last_clean":"2024-08-18T22:32:33.341330+0000","last_became_active":"2024-08-18T22:32:33.336352+0000","last_became_peered":"2024-08-18T22:32:33.336352+0000","last_unstale":"2024-08-18T22:32:33.341330+0000","last_undegraded":"2024-08-18T22:32:33.341330+0000","last_fullsized":"2024-08-18T22:32:33.341330+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:01.375890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322695+0000","last_change":"2024-08-18T22:32:33.322695+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322695+0000","last_undegraded":"2024-08-18T22:32:33.322695+0000","last_fullsized":"2024-08-18T22:32:33.322695+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340492+0000","last_change":"2024-08-18T22:32:33.338065+0000","last_active":"2024-08-18T22:32:33.340492+0000","last_peered":"2024-08-18T22:32:33.340492+0000","last_clean":"2024-08-18T22:32:33.340492+0000","last_became_active":"2024-08-18T22:32:33.337556+0000","last_became_peered":"2024-08-18T22:32:33.337556+0000","last_unstale":"2024-08-18T22:32:33.340492+0000","last_undegraded":"2024-08-18T22:32:33.340492+0000","last_fullsized":"2024-08-18T22:32:33.340492+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:38.684209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323405+0000","last_change":"2024-08-18T22:32:33.323405+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323405+0000","last_undegraded":"2024-08-18T22:32:33.323405+0000","last_fullsized":"2024-08-18T22:32:33.323405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345475+0000","last_change":"2024-08-18T22:32:33.343854+0000","last_active":"2024-08-18T22:32:33.345475+0000","last_peered":"2024-08-18T22:32:33.345475+0000","last_clean":"2024-08-18T22:32:33.345475+0000","last_became_active":"2024-08-18T22:32:33.342459+0000","last_became_peered":"2024-08-18T22:32:33.342459+0000","last_unstale":"2024-08-18T22:32:33.345475+0000","last_undegraded":"2024-08-18T22:32:33.345475+0000","last_fullsized":"2024-08-18T22:32:33.345475+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:39:53.509719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323137+0000","last_change":"2024-08-18T22:32:33.323137+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323137+0000","last_undegraded":"2024-08-18T22:32:33.323137+0000","last_fullsized":"2024-08-18T22:32:33.323137+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327687+0000","last_change":"2024-08-18T22:32:33.336271+0000","last_active":"2024-08-18T22:32:35.327687+0000","last_peered":"2024-08-18T22:32:35.327687+0000","last_clean":"2024-08-18T22:32:35.327687+0000","last_became_active":"2024-08-18T22:32:33.335793+0000","last_became_peered":"2024-08-18T22:32:33.335793+0000","last_unstale":"2024-08-18T22:32:35.327687+0000","last_undegraded":"2024-08-18T22:32:35.327687+0000","last_fullsized":"2024-08-18T22:32:35.327687+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:09.734094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.333611+0000","last_change":"2024-08-18T22:32:33.333611+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.333611+0000","last_undegraded":"2024-08-18T22:32:33.333611+0000","last_fullsized":"2024-08-18T22:32:33.333611+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340513+0000","last_change":"2024-08-18T22:32:33.335923+0000","last_active":"2024-08-18T22:32:33.340513+0000","last_peered":"2024-08-18T22:32:33.340513+0000","last_clean":"2024-08-18T22:32:33.340513+0000","last_became_active":"2024-08-18T22:32:33.335475+0000","last_became_peered":"2024-08-18T22:32:33.335475+0000","last_unstale":"2024-08-18T22:32:33.340513+0000","last_undegraded":"2024-08-18T22:32:33.340513+0000","last_fullsized":"2024-08-18T22:32:33.340513+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:13.526045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":512,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.323248+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:32:33.323248+0000","last_peered":"2024-08-18T22:32:33.323248+0000","last_clean":"2024-08-18T22:32:33.323248+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:32:33.323248+0000","last_undegraded":"2024-08-18T22:32:33.323248+0000","last_fullsized":"2024-08-18T22:32:33.323248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509604,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52120,"kb_used_data":2888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319720,"statfs":{"total":96636764160,"available":96583393280,"internally_reserved":0,"allocated":2957312,"data_stored":1705166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509606,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51552,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320288,"statfs":{"total":96636764160,"available":96583974912,"internally_reserved":0,"allocated":2375680,"data_stored":1121465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51536,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320304,"statfs":{"total":96636764160,"available":96583991296,"internally_reserved":0,"allocated":2363392,"data_stored":1114798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509605,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47384,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324456,"statfs":{"total":96636764160,"available":96588242944,"internally_reserved":0,"allocated":2363392,"data_stored":1114798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509604,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47380,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324460,"statfs":{"total":96636764160,"available":96588247040,"internally_reserved":0,"allocated":2363392,"data_stored":1114798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509605,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60448,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311392,"statfs":{"total":96636764160,"available":96574865408,"internally_reserved":0,"allocated":2969600,"data_stored":1711833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59900,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311940,"statfs":{"total":96636764160,"available":96575426560,"internally_reserved":0,"allocated":2404352,"data_stored":1135906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575013,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59888,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311952,"statfs":{"total":96636764160,"available":96575438848,"internally_reserved":0,"allocated":2392064,"data_stored":1128722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:32:38.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:32:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe84d200640 1 Processor -- start 2024-08-18T22:32:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe84d200640 1 -- start start 2024-08-18T22:32:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe84d200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe848070510 0x7fe84809b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe84d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe84815f130 0x7fe8480708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe84d200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe848070e30 con 0x7fe8480d02a0 2024-08-18T22:32:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe84d200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe84806fe70 con 0x7fe848070510 2024-08-18T22:32:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe84d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe848070150 con 0x7fe84815f130 2024-08-18T22:32:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe846a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe84815f130 0x7fe8480708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe847400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe848070510 0x7fe84809b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe847400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe848070510 0x7fe84809b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:56800/0 (socket says 172.21.15.5:56800) 2024-08-18T22:32:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe847400640 1 -- 172.21.15.5:0/714684100 learned_addr learned my addr 172.21.15.5:0/714684100 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe846a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe84815f130 0x7fe8480708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:50590/0 (socket says 172.21.15.5:50590) 2024-08-18T22:32:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe847e00640 1 --1- 172.21.15.5:0/714684100 >> v1:172.21.15.117:6789/0 conn(0x7fe8480d02a0 0x7fe8480d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:53924/0 (socket says 172.21.15.5:53924) 2024-08-18T22:32:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe847400640 1 -- 172.21.15.5:0/714684100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe84815f130 msgr2=0x7fe8480708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe847400640 1 --2- 172.21.15.5:0/714684100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe84815f130 0x7fe8480708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe847400640 1 -- 172.21.15.5:0/714684100 >> v1:172.21.15.117:6789/0 conn(0x7fe8480d02a0 legacy=0x7fe8480d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.031+0000 7fe847400640 1 -- 172.21.15.5:0/714684100 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84809aa40 con 0x7fe848070510 2024-08-18T22:32:39.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe847400640 1 --2- 172.21.15.5:0/714684100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe848070510 0x7fe84809b520 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe838009870 tx=0x7fe83801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e073667beed0075 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe846000640 1 -- 172.21.15.5:0/714684100 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8380b2070 con 0x7fe848070510 2024-08-18T22:32:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe846000640 1 -- 172.21.15.5:0/714684100 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8380a9070 con 0x7fe848070510 2024-08-18T22:32:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe846000640 1 -- 172.21.15.5:0/714684100 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8380ad880 con 0x7fe848070510 2024-08-18T22:32:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe84d200640 1 -- 172.21.15.5:0/714684100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe848070510 msgr2=0x7fe84809b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe84d200640 1 --2- 172.21.15.5:0/714684100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe848070510 0x7fe84809b520 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe838009870 tx=0x7fe83801c560 comp rx=0 tx=0).stop 2024-08-18T22:32:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe84d200640 1 -- 172.21.15.5:0/714684100 shutdown_connections 2024-08-18T22:32:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe84d200640 1 --2- 172.21.15.5:0/714684100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe84815f130 0x7fe8480708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe84d200640 1 --2- 172.21.15.5:0/714684100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe848070510 0x7fe84809b520 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe84d200640 1 -- 172.21.15.5:0/714684100 >> 172.21.15.5:0/714684100 conn(0x7fe8480b3a20 msgr2=0x7fe8480b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe84d200640 1 -- 172.21.15.5:0/714684100 shutdown_connections 2024-08-18T22:32:39.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe84d200640 1 -- 172.21.15.5:0/714684100 wait complete. 2024-08-18T22:32:39.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.035+0000 7fe84d200640 1 Processor -- start 2024-08-18T22:32:39.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe84d200640 1 -- start start 2024-08-18T22:32:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe84d200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe848070510 0x7fe848156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe84d200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8480d02a0 0x7fe848154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe84d200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe84815f130 0x7fe848154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe84d200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe84815f690 con 0x7fe848070510 2024-08-18T22:32:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe84d200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe84815f510 con 0x7fe8480d02a0 2024-08-18T22:32:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe84d200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe8480b46d0 con 0x7fe84815f130 2024-08-18T22:32:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe847400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe848070510 0x7fe848156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe847400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe848070510 0x7fe848156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46906/0 (socket says 172.21.15.5:46906) 2024-08-18T22:32:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe847400640 1 -- 172.21.15.5:0/1772314305 learned_addr learned my addr 172.21.15.5:0/1772314305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe846a00640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8480d02a0 0x7fe848154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe847400640 1 -- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe84815f130 msgr2=0x7fe848154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe847400640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe84815f130 0x7fe848154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe847400640 1 -- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8480d02a0 msgr2=0x7fe848154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe847400640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8480d02a0 0x7fe848154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe847400640 1 -- 172.21.15.5:0/1772314305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe848151910 con 0x7fe848070510 2024-08-18T22:32:39.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe846a00640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8480d02a0 0x7fe848154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe847400640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe848070510 0x7fe848156fe0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fe8380b0040 tx=0x7fe83801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe83f400640 1 -- 172.21.15.5:0/1772314305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8380bc020 con 0x7fe848070510 2024-08-18T22:32:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe83f400640 1 -- 172.21.15.5:0/1772314305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8380add40 con 0x7fe848070510 2024-08-18T22:32:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe83f400640 1 -- 172.21.15.5:0/1772314305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8380b2040 con 0x7fe848070510 2024-08-18T22:32:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe84d200640 1 -- 172.21.15.5:0/1772314305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe848151bf0 con 0x7fe848070510 2024-08-18T22:32:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe84d200640 1 -- 172.21.15.5:0/1772314305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8480aff60 con 0x7fe848070510 2024-08-18T22:32:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.039+0000 7fe84d200640 1 -- 172.21.15.5:0/1772314305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe84809b520 con 0x7fe848070510 2024-08-18T22:32:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.043+0000 7fe83f400640 1 -- 172.21.15.5:0/1772314305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8380bf020 con 0x7fe848070510 2024-08-18T22:32:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.043+0000 7fe83f400640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8280678c0 0x7fe828069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.043+0000 7fe83f400640 1 -- 172.21.15.5:0/1772314305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fe83811ffb0 con 0x7fe848070510 2024-08-18T22:32:39.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.043+0000 7fe846a00640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8280678c0 0x7fe828069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.043+0000 7fe846a00640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8280678c0 0x7fe828069d80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe84815b540 tx=0x7fe834008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:39.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.047+0000 7fe83f400640 1 -- 172.21.15.5:0/1772314305 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe8380c6030 con 0x7fe848070510 2024-08-18T22:32:39.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.207+0000 7fe84d200640 1 -- 172.21.15.5:0/1772314305 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe848073d40 con 0x7fe8280678c0 2024-08-18T22:32:39.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.215+0000 7fe83f400640 1 -- 172.21.15.5:0/1772314305 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248125 (secure 0 0 0) 0x7fe848073d40 con 0x7fe8280678c0 2024-08-18T22:32:39.217 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:39.218 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:32:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 -- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8280678c0 msgr2=0x7fe828069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8280678c0 0x7fe828069d80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe84815b540 tx=0x7fe834008040 comp rx=0 tx=0).stop 2024-08-18T22:32:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 -- 172.21.15.5:0/1772314305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe848070510 msgr2=0x7fe848156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe848070510 0x7fe848156fe0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fe8380b0040 tx=0x7fe83801ada0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 -- 172.21.15.5:0/1772314305 shutdown_connections 2024-08-18T22:32:39.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe8280678c0 0x7fe828069d80 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe84815f130 0x7fe848154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8480d02a0 0x7fe848154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 --2- 172.21.15.5:0/1772314305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe848070510 0x7fe848156fe0 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 -- 172.21.15.5:0/1772314305 >> 172.21.15.5:0/1772314305 conn(0x7fe8480b3a20 msgr2=0x7fe8480d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 -- 172.21.15.5:0/1772314305 shutdown_connections 2024-08-18T22:32:39.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.219+0000 7fe84d200640 1 -- 172.21.15.5:0/1772314305 wait complete. 2024-08-18T22:32:39.237 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":590,"stamp":"2024-08-18T22:32:37.815966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":430208,"kb_used_data":19716,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754544512,"statfs":{"total":773094113280,"available":772653580288,"internally_reserved":0,"allocated":20189184,"data_stored":10147486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.510559"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.334406+0000","last_change":"2024-08-18T22:32:33.334406+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.334406+0000","last_undegraded":"2024-08-18T22:32:33.334406+0000","last_fullsized":"2024-08-18T22:32:33.334406+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325093+0000","last_change":"2024-08-18T22:32:33.325093+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325093+0000","last_undegraded":"2024-08-18T22:32:33.325093+0000","last_fullsized":"2024-08-18T22:32:33.325093+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.329261+0000","last_change":"2024-08-18T22:32:33.329261+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.329261+0000","last_undegraded":"2024-08-18T22:32:33.329261+0000","last_fullsized":"2024-08-18T22:32:33.329261+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323643+0000","last_change":"2024-08-18T22:32:33.323643+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323643+0000","last_undegraded":"2024-08-18T22:32:33.323643+0000","last_fullsized":"2024-08-18T22:32:33.323643+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327951+0000","last_change":"2024-08-18T22:32:34.332036+0000","last_active":"2024-08-18T22:32:35.327951+0000","last_peered":"2024-08-18T22:32:35.327951+0000","last_clean":"2024-08-18T22:32:35.327951+0000","last_became_active":"2024-08-18T22:32:34.331366+0000","last_became_peered":"2024-08-18T22:32:34.331366+0000","last_unstale":"2024-08-18T22:32:35.327951+0000","last_undegraded":"2024-08-18T22:32:35.327951+0000","last_fullsized":"2024-08-18T22:32:35.327951+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:00.772598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322789+0000","last_change":"2024-08-18T22:32:33.322789+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322789+0000","last_undegraded":"2024-08-18T22:32:33.322789+0000","last_fullsized":"2024-08-18T22:32:33.322789+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327668+0000","last_change":"2024-08-18T22:32:34.328506+0000","last_active":"2024-08-18T22:32:35.327668+0000","last_peered":"2024-08-18T22:32:35.327668+0000","last_clean":"2024-08-18T22:32:35.327668+0000","last_became_active":"2024-08-18T22:32:34.328188+0000","last_became_peered":"2024-08-18T22:32:34.328188+0000","last_unstale":"2024-08-18T22:32:35.327668+0000","last_undegraded":"2024-08-18T22:32:35.327668+0000","last_fullsized":"2024-08-18T22:32:35.327668+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:08.229648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324176+0000","last_change":"2024-08-18T22:32:33.324176+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324176+0000","last_undegraded":"2024-08-18T22:32:33.324176+0000","last_fullsized":"2024-08-18T22:32:33.324176+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324748+0000","last_change":"2024-08-18T22:32:33.324748+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324748+0000","last_undegraded":"2024-08-18T22:32:33.324748+0000","last_fullsized":"2024-08-18T22:32:33.324748+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322214+0000","last_change":"2024-08-18T22:32:33.322214+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322214+0000","last_undegraded":"2024-08-18T22:32:33.322214+0000","last_fullsized":"2024-08-18T22:32:33.322214+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.326218+0000","last_change":"2024-08-18T22:32:33.326218+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.326218+0000","last_undegraded":"2024-08-18T22:32:33.326218+0000","last_fullsized":"2024-08-18T22:32:33.326218+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328280+0000","last_change":"2024-08-18T22:32:34.350611+0000","last_active":"2024-08-18T22:32:35.328280+0000","last_peered":"2024-08-18T22:32:35.328280+0000","last_clean":"2024-08-18T22:32:35.328280+0000","last_became_active":"2024-08-18T22:32:34.346800+0000","last_became_peered":"2024-08-18T22:32:34.346800+0000","last_unstale":"2024-08-18T22:32:35.328280+0000","last_undegraded":"2024-08-18T22:32:35.328280+0000","last_fullsized":"2024-08-18T22:32:35.328280+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:10.581383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323206+0000","last_change":"2024-08-18T22:32:33.323206+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323206+0000","last_undegraded":"2024-08-18T22:32:33.323206+0000","last_fullsized":"2024-08-18T22:32:33.323206+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.326351+0000","last_change":"2024-08-18T22:32:33.326351+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.326351+0000","last_undegraded":"2024-08-18T22:32:33.326351+0000","last_fullsized":"2024-08-18T22:32:33.326351+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323091+0000","last_change":"2024-08-18T22:32:34.340094+0000","last_active":"2024-08-18T22:32:35.323091+0000","last_peered":"2024-08-18T22:32:35.323091+0000","last_clean":"2024-08-18T22:32:35.323091+0000","last_became_active":"2024-08-18T22:32:34.339828+0000","last_became_peered":"2024-08-18T22:32:34.339828+0000","last_unstale":"2024-08-18T22:32:35.323091+0000","last_undegraded":"2024-08-18T22:32:35.323091+0000","last_fullsized":"2024-08-18T22:32:35.323091+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:01:26.496081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.330234+0000","last_change":"2024-08-18T22:32:33.330234+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.330234+0000","last_undegraded":"2024-08-18T22:32:33.330234+0000","last_fullsized":"2024-08-18T22:32:33.330234+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324211+0000","last_change":"2024-08-18T22:32:33.324211+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324211+0000","last_undegraded":"2024-08-18T22:32:33.324211+0000","last_fullsized":"2024-08-18T22:32:33.324211+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325580+0000","last_change":"2024-08-18T22:32:33.325580+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325580+0000","last_undegraded":"2024-08-18T22:32:33.325580+0000","last_fullsized":"2024-08-18T22:32:33.325580+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321840+0000","last_change":"2024-08-18T22:32:33.321840+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321840+0000","last_undegraded":"2024-08-18T22:32:33.321840+0000","last_fullsized":"2024-08-18T22:32:33.321840+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322462+0000","last_change":"2024-08-18T22:32:33.322462+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322462+0000","last_undegraded":"2024-08-18T22:32:33.322462+0000","last_fullsized":"2024-08-18T22:32:33.322462+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323064+0000","last_change":"2024-08-18T22:32:33.323064+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323064+0000","last_undegraded":"2024-08-18T22:32:33.323064+0000","last_fullsized":"2024-08-18T22:32:33.323064+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324593+0000","last_change":"2024-08-18T22:32:33.324593+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324593+0000","last_undegraded":"2024-08-18T22:32:33.324593+0000","last_fullsized":"2024-08-18T22:32:33.324593+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325159+0000","last_change":"2024-08-18T22:32:33.325159+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325159+0000","last_undegraded":"2024-08-18T22:32:33.325159+0000","last_fullsized":"2024-08-18T22:32:33.325159+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327593+0000","last_change":"2024-08-18T22:32:34.336858+0000","last_active":"2024-08-18T22:32:35.327593+0000","last_peered":"2024-08-18T22:32:35.327593+0000","last_clean":"2024-08-18T22:32:35.327593+0000","last_became_active":"2024-08-18T22:32:34.336586+0000","last_became_peered":"2024-08-18T22:32:34.336586+0000","last_unstale":"2024-08-18T22:32:35.327593+0000","last_undegraded":"2024-08-18T22:32:35.327593+0000","last_fullsized":"2024-08-18T22:32:35.327593+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:55.751347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323775+0000","last_change":"2024-08-18T22:32:33.323775+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323775+0000","last_undegraded":"2024-08-18T22:32:33.323775+0000","last_fullsized":"2024-08-18T22:32:33.323775+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.334940+0000","last_change":"2024-08-18T22:32:33.334940+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.334940+0000","last_undegraded":"2024-08-18T22:32:33.334940+0000","last_fullsized":"2024-08-18T22:32:33.334940+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325759+0000","last_change":"2024-08-18T22:32:33.325759+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325759+0000","last_undegraded":"2024-08-18T22:32:33.325759+0000","last_fullsized":"2024-08-18T22:32:33.325759+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328352+0000","last_change":"2024-08-18T22:32:34.331458+0000","last_active":"2024-08-18T22:32:35.328352+0000","last_peered":"2024-08-18T22:32:35.328352+0000","last_clean":"2024-08-18T22:32:35.328352+0000","last_became_active":"2024-08-18T22:32:34.331049+0000","last_became_peered":"2024-08-18T22:32:34.331049+0000","last_unstale":"2024-08-18T22:32:35.328352+0000","last_undegraded":"2024-08-18T22:32:35.328352+0000","last_fullsized":"2024-08-18T22:32:35.328352+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:13:52.541926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323450+0000","last_change":"2024-08-18T22:32:33.323450+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323450+0000","last_undegraded":"2024-08-18T22:32:33.323450+0000","last_fullsized":"2024-08-18T22:32:33.323450+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323984+0000","last_change":"2024-08-18T22:32:34.338117+0000","last_active":"2024-08-18T22:32:35.323984+0000","last_peered":"2024-08-18T22:32:35.323984+0000","last_clean":"2024-08-18T22:32:35.323984+0000","last_became_active":"2024-08-18T22:32:34.337781+0000","last_became_peered":"2024-08-18T22:32:34.337781+0000","last_unstale":"2024-08-18T22:32:35.323984+0000","last_undegraded":"2024-08-18T22:32:35.323984+0000","last_fullsized":"2024-08-18T22:32:35.323984+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:15.477308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323728+0000","last_change":"2024-08-18T22:32:33.323728+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323728+0000","last_undegraded":"2024-08-18T22:32:33.323728+0000","last_fullsized":"2024-08-18T22:32:33.323728+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322973+0000","last_change":"2024-08-18T22:32:33.322973+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322973+0000","last_undegraded":"2024-08-18T22:32:33.322973+0000","last_fullsized":"2024-08-18T22:32:33.322973+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323245+0000","last_change":"2024-08-18T22:32:33.323245+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323245+0000","last_undegraded":"2024-08-18T22:32:33.323245+0000","last_fullsized":"2024-08-18T22:32:33.323245+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"190'4","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324141+0000","last_change":"2024-08-18T22:32:33.341792+0000","last_active":"2024-08-18T22:32:35.324141+0000","last_peered":"2024-08-18T22:32:35.324141+0000","last_clean":"2024-08-18T22:32:35.324141+0000","last_became_active":"2024-08-18T22:32:33.341460+0000","last_became_peered":"2024-08-18T22:32:33.341460+0000","last_unstale":"2024-08-18T22:32:35.324141+0000","last_undegraded":"2024-08-18T22:32:35.324141+0000","last_fullsized":"2024-08-18T22:32:35.324141+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:06.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.335496+0000","last_change":"2024-08-18T22:32:33.335496+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.335496+0000","last_undegraded":"2024-08-18T22:32:33.335496+0000","last_fullsized":"2024-08-18T22:32:33.335496+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340101+0000","last_change":"2024-08-18T22:32:33.337250+0000","last_active":"2024-08-18T22:32:33.340101+0000","last_peered":"2024-08-18T22:32:33.340101+0000","last_clean":"2024-08-18T22:32:33.340101+0000","last_became_active":"2024-08-18T22:32:33.336973+0000","last_became_peered":"2024-08-18T22:32:33.336973+0000","last_unstale":"2024-08-18T22:32:33.340101+0000","last_undegraded":"2024-08-18T22:32:33.340101+0000","last_fullsized":"2024-08-18T22:32:33.340101+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:20:08.258033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321863+0000","last_change":"2024-08-18T22:32:33.321863+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321863+0000","last_undegraded":"2024-08-18T22:32:33.321863+0000","last_fullsized":"2024-08-18T22:32:33.321863+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.336665+0000","last_change":"2024-08-18T22:32:33.333993+0000","last_active":"2024-08-18T22:32:33.336665+0000","last_peered":"2024-08-18T22:32:33.336665+0000","last_clean":"2024-08-18T22:32:33.336665+0000","last_became_active":"2024-08-18T22:32:33.333716+0000","last_became_peered":"2024-08-18T22:32:33.333716+0000","last_unstale":"2024-08-18T22:32:33.336665+0000","last_undegraded":"2024-08-18T22:32:33.336665+0000","last_fullsized":"2024-08-18T22:32:33.336665+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:09:29.203189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328002+0000","last_change":"2024-08-18T22:32:34.332282+0000","last_active":"2024-08-18T22:32:35.328002+0000","last_peered":"2024-08-18T22:32:35.328002+0000","last_clean":"2024-08-18T22:32:35.328002+0000","last_became_active":"2024-08-18T22:32:34.331745+0000","last_became_peered":"2024-08-18T22:32:34.331745+0000","last_unstale":"2024-08-18T22:32:35.328002+0000","last_undegraded":"2024-08-18T22:32:35.328002+0000","last_fullsized":"2024-08-18T22:32:35.328002+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:59.385206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.343265+0000","last_change":"2024-08-18T22:32:33.342536+0000","last_active":"2024-08-18T22:32:33.343265+0000","last_peered":"2024-08-18T22:32:33.343265+0000","last_clean":"2024-08-18T22:32:33.343265+0000","last_became_active":"2024-08-18T22:32:33.341981+0000","last_became_peered":"2024-08-18T22:32:33.341981+0000","last_unstale":"2024-08-18T22:32:33.343265+0000","last_undegraded":"2024-08-18T22:32:33.343265+0000","last_fullsized":"2024-08-18T22:32:33.343265+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:02.165242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324119+0000","last_change":"2024-08-18T22:32:34.343058+0000","last_active":"2024-08-18T22:32:35.324119+0000","last_peered":"2024-08-18T22:32:35.324119+0000","last_clean":"2024-08-18T22:32:35.324119+0000","last_became_active":"2024-08-18T22:32:34.339495+0000","last_became_peered":"2024-08-18T22:32:34.339495+0000","last_unstale":"2024-08-18T22:32:35.324119+0000","last_undegraded":"2024-08-18T22:32:35.324119+0000","last_fullsized":"2024-08-18T22:32:35.324119+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:51:39.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.344018+0000","last_change":"2024-08-18T22:32:33.339981+0000","last_active":"2024-08-18T22:32:33.344018+0000","last_peered":"2024-08-18T22:32:33.344018+0000","last_clean":"2024-08-18T22:32:33.344018+0000","last_became_active":"2024-08-18T22:32:33.338281+0000","last_became_peered":"2024-08-18T22:32:33.338281+0000","last_unstale":"2024-08-18T22:32:33.344018+0000","last_undegraded":"2024-08-18T22:32:33.344018+0000","last_fullsized":"2024-08-18T22:32:33.344018+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:08:14.271558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324121+0000","last_change":"2024-08-18T22:32:34.339553+0000","last_active":"2024-08-18T22:32:35.324121+0000","last_peered":"2024-08-18T22:32:35.324121+0000","last_clean":"2024-08-18T22:32:35.324121+0000","last_became_active":"2024-08-18T22:32:34.339281+0000","last_became_peered":"2024-08-18T22:32:34.339281+0000","last_unstale":"2024-08-18T22:32:35.324121+0000","last_undegraded":"2024-08-18T22:32:35.324121+0000","last_fullsized":"2024-08-18T22:32:35.324121+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:51.382957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.344010+0000","last_change":"2024-08-18T22:32:33.338565+0000","last_active":"2024-08-18T22:32:33.344010+0000","last_peered":"2024-08-18T22:32:33.344010+0000","last_clean":"2024-08-18T22:32:33.344010+0000","last_became_active":"2024-08-18T22:32:33.338246+0000","last_became_peered":"2024-08-18T22:32:33.338246+0000","last_unstale":"2024-08-18T22:32:33.344010+0000","last_undegraded":"2024-08-18T22:32:33.344010+0000","last_fullsized":"2024-08-18T22:32:33.344010+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:17.426503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323259+0000","last_change":"2024-08-18T22:32:33.323259+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323259+0000","last_undegraded":"2024-08-18T22:32:33.323259+0000","last_fullsized":"2024-08-18T22:32:33.323259+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.334525+0000","last_change":"2024-08-18T22:32:33.332795+0000","last_active":"2024-08-18T22:32:33.334525+0000","last_peered":"2024-08-18T22:32:33.334525+0000","last_clean":"2024-08-18T22:32:33.334525+0000","last_became_active":"2024-08-18T22:32:33.332124+0000","last_became_peered":"2024-08-18T22:32:33.332124+0000","last_unstale":"2024-08-18T22:32:33.334525+0000","last_undegraded":"2024-08-18T22:32:33.334525+0000","last_fullsized":"2024-08-18T22:32:33.334525+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:36.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322954+0000","last_change":"2024-08-18T22:32:34.343093+0000","last_active":"2024-08-18T22:32:35.322954+0000","last_peered":"2024-08-18T22:32:35.322954+0000","last_clean":"2024-08-18T22:32:35.322954+0000","last_became_active":"2024-08-18T22:32:34.342837+0000","last_became_peered":"2024-08-18T22:32:34.342837+0000","last_unstale":"2024-08-18T22:32:35.322954+0000","last_undegraded":"2024-08-18T22:32:35.322954+0000","last_fullsized":"2024-08-18T22:32:35.322954+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:59.761456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328440+0000","last_change":"2024-08-18T22:32:33.342601+0000","last_active":"2024-08-18T22:32:35.328440+0000","last_peered":"2024-08-18T22:32:35.328440+0000","last_clean":"2024-08-18T22:32:35.328440+0000","last_became_active":"2024-08-18T22:32:33.342319+0000","last_became_peered":"2024-08-18T22:32:33.342319+0000","last_unstale":"2024-08-18T22:32:35.328440+0000","last_undegraded":"2024-08-18T22:32:35.328440+0000","last_fullsized":"2024-08-18T22:32:35.328440+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:44:05.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322371+0000","last_change":"2024-08-18T22:32:33.322371+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322371+0000","last_undegraded":"2024-08-18T22:32:33.322371+0000","last_fullsized":"2024-08-18T22:32:33.322371+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.344060+0000","last_change":"2024-08-18T22:32:33.339791+0000","last_active":"2024-08-18T22:32:33.344060+0000","last_peered":"2024-08-18T22:32:33.344060+0000","last_clean":"2024-08-18T22:32:33.344060+0000","last_became_active":"2024-08-18T22:32:33.339512+0000","last_became_peered":"2024-08-18T22:32:33.339512+0000","last_unstale":"2024-08-18T22:32:33.344060+0000","last_undegraded":"2024-08-18T22:32:33.344060+0000","last_fullsized":"2024-08-18T22:32:33.344060+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:36.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323577+0000","last_change":"2024-08-18T22:32:33.323577+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323577+0000","last_undegraded":"2024-08-18T22:32:33.323577+0000","last_fullsized":"2024-08-18T22:32:33.323577+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341933+0000","last_change":"2024-08-18T22:32:33.335980+0000","last_active":"2024-08-18T22:32:33.341933+0000","last_peered":"2024-08-18T22:32:33.341933+0000","last_clean":"2024-08-18T22:32:33.341933+0000","last_became_active":"2024-08-18T22:32:33.334645+0000","last_became_peered":"2024-08-18T22:32:33.334645+0000","last_unstale":"2024-08-18T22:32:33.341933+0000","last_undegraded":"2024-08-18T22:32:33.341933+0000","last_fullsized":"2024-08-18T22:32:33.341933+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:14.092947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328147+0000","last_change":"2024-08-18T22:32:34.338668+0000","last_active":"2024-08-18T22:32:35.328147+0000","last_peered":"2024-08-18T22:32:35.328147+0000","last_clean":"2024-08-18T22:32:35.328147+0000","last_became_active":"2024-08-18T22:32:34.338385+0000","last_became_peered":"2024-08-18T22:32:34.338385+0000","last_unstale":"2024-08-18T22:32:35.328147+0000","last_undegraded":"2024-08-18T22:32:35.328147+0000","last_fullsized":"2024-08-18T22:32:35.328147+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:53:41.464541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340868+0000","last_change":"2024-08-18T22:32:33.334598+0000","last_active":"2024-08-18T22:32:33.340868+0000","last_peered":"2024-08-18T22:32:33.340868+0000","last_clean":"2024-08-18T22:32:33.340868+0000","last_became_active":"2024-08-18T22:32:33.334298+0000","last_became_peered":"2024-08-18T22:32:33.334298+0000","last_unstale":"2024-08-18T22:32:33.340868+0000","last_undegraded":"2024-08-18T22:32:33.340868+0000","last_fullsized":"2024-08-18T22:32:33.340868+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:59:20.935747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324605+0000","last_change":"2024-08-18T22:32:33.324605+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324605+0000","last_undegraded":"2024-08-18T22:32:33.324605+0000","last_fullsized":"2024-08-18T22:32:33.324605+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341389+0000","last_change":"2024-08-18T22:32:33.340299+0000","last_active":"2024-08-18T22:32:33.341389+0000","last_peered":"2024-08-18T22:32:33.341389+0000","last_clean":"2024-08-18T22:32:33.341389+0000","last_became_active":"2024-08-18T22:32:33.340027+0000","last_became_peered":"2024-08-18T22:32:33.340027+0000","last_unstale":"2024-08-18T22:32:33.341389+0000","last_undegraded":"2024-08-18T22:32:33.341389+0000","last_fullsized":"2024-08-18T22:32:33.341389+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:25:31.852300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322305+0000","last_change":"2024-08-18T22:32:33.322305+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322305+0000","last_undegraded":"2024-08-18T22:32:33.322305+0000","last_fullsized":"2024-08-18T22:32:33.322305+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.333582+0000","last_change":"2024-08-18T22:32:33.331475+0000","last_active":"2024-08-18T22:32:33.333582+0000","last_peered":"2024-08-18T22:32:33.333582+0000","last_clean":"2024-08-18T22:32:33.333582+0000","last_became_active":"2024-08-18T22:32:33.331157+0000","last_became_peered":"2024-08-18T22:32:33.331157+0000","last_unstale":"2024-08-18T22:32:33.333582+0000","last_undegraded":"2024-08-18T22:32:33.333582+0000","last_fullsized":"2024-08-18T22:32:33.333582+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:17.426503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.325090+0000","last_change":"2024-08-18T22:32:33.325090+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.325090+0000","last_undegraded":"2024-08-18T22:32:33.325090+0000","last_fullsized":"2024-08-18T22:32:33.325090+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341522+0000","last_change":"2024-08-18T22:32:33.340757+0000","last_active":"2024-08-18T22:32:33.341522+0000","last_peered":"2024-08-18T22:32:33.341522+0000","last_clean":"2024-08-18T22:32:33.341522+0000","last_became_active":"2024-08-18T22:32:33.340260+0000","last_became_peered":"2024-08-18T22:32:33.340260+0000","last_unstale":"2024-08-18T22:32:33.341522+0000","last_undegraded":"2024-08-18T22:32:33.341522+0000","last_fullsized":"2024-08-18T22:32:33.341522+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:12:55.135480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324549+0000","last_change":"2024-08-18T22:32:33.324549+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324549+0000","last_undegraded":"2024-08-18T22:32:33.324549+0000","last_fullsized":"2024-08-18T22:32:33.324549+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"190'8","reported_seq":22,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327742+0000","last_change":"2024-08-18T22:32:33.335461+0000","last_active":"2024-08-18T22:32:35.327742+0000","last_peered":"2024-08-18T22:32:35.327742+0000","last_clean":"2024-08-18T22:32:35.327742+0000","last_became_active":"2024-08-18T22:32:33.333576+0000","last_became_peered":"2024-08-18T22:32:33.333576+0000","last_unstale":"2024-08-18T22:32:35.327742+0000","last_undegraded":"2024-08-18T22:32:35.327742+0000","last_fullsized":"2024-08-18T22:32:35.327742+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:20:29.913730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322637+0000","last_change":"2024-08-18T22:32:33.322637+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322637+0000","last_undegraded":"2024-08-18T22:32:33.322637+0000","last_fullsized":"2024-08-18T22:32:33.322637+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345368+0000","last_change":"2024-08-18T22:32:33.343063+0000","last_active":"2024-08-18T22:32:33.345368+0000","last_peered":"2024-08-18T22:32:33.345368+0000","last_clean":"2024-08-18T22:32:33.345368+0000","last_became_active":"2024-08-18T22:32:33.342745+0000","last_became_peered":"2024-08-18T22:32:33.342745+0000","last_unstale":"2024-08-18T22:32:33.345368+0000","last_undegraded":"2024-08-18T22:32:33.345368+0000","last_fullsized":"2024-08-18T22:32:33.345368+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:19:41.785588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.333262+0000","last_change":"2024-08-18T22:32:33.333262+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.333262+0000","last_undegraded":"2024-08-18T22:32:33.333262+0000","last_fullsized":"2024-08-18T22:32:33.333262+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345849+0000","last_change":"2024-08-18T22:32:33.344896+0000","last_active":"2024-08-18T22:32:33.345849+0000","last_peered":"2024-08-18T22:32:33.345849+0000","last_clean":"2024-08-18T22:32:33.345849+0000","last_became_active":"2024-08-18T22:32:33.344602+0000","last_became_peered":"2024-08-18T22:32:33.344602+0000","last_unstale":"2024-08-18T22:32:33.345849+0000","last_undegraded":"2024-08-18T22:32:33.345849+0000","last_fullsized":"2024-08-18T22:32:33.345849+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:36.812989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.329869+0000","last_change":"2024-08-18T22:32:33.329869+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.329869+0000","last_undegraded":"2024-08-18T22:32:33.329869+0000","last_fullsized":"2024-08-18T22:32:33.329869+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341148+0000","last_change":"2024-08-18T22:32:33.337911+0000","last_active":"2024-08-18T22:32:33.341148+0000","last_peered":"2024-08-18T22:32:33.341148+0000","last_clean":"2024-08-18T22:32:33.341148+0000","last_became_active":"2024-08-18T22:32:33.337622+0000","last_became_peered":"2024-08-18T22:32:33.337622+0000","last_unstale":"2024-08-18T22:32:33.341148+0000","last_undegraded":"2024-08-18T22:32:33.341148+0000","last_fullsized":"2024-08-18T22:32:33.341148+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:35:24.749624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322556+0000","last_change":"2024-08-18T22:32:33.322556+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322556+0000","last_undegraded":"2024-08-18T22:32:33.322556+0000","last_fullsized":"2024-08-18T22:32:33.322556+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328380+0000","last_change":"2024-08-18T22:32:33.341287+0000","last_active":"2024-08-18T22:32:35.328380+0000","last_peered":"2024-08-18T22:32:35.328380+0000","last_clean":"2024-08-18T22:32:35.328380+0000","last_became_active":"2024-08-18T22:32:33.340919+0000","last_became_peered":"2024-08-18T22:32:33.340919+0000","last_unstale":"2024-08-18T22:32:35.328380+0000","last_undegraded":"2024-08-18T22:32:35.328380+0000","last_fullsized":"2024-08-18T22:32:35.328380+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:08:07.407708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324176+0000","last_change":"2024-08-18T22:32:33.324176+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324176+0000","last_undegraded":"2024-08-18T22:32:33.324176+0000","last_fullsized":"2024-08-18T22:32:33.324176+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328253+0000","last_change":"2024-08-18T22:32:33.334444+0000","last_active":"2024-08-18T22:32:35.328253+0000","last_peered":"2024-08-18T22:32:35.328253+0000","last_clean":"2024-08-18T22:32:35.328253+0000","last_became_active":"2024-08-18T22:32:33.334157+0000","last_became_peered":"2024-08-18T22:32:33.334157+0000","last_unstale":"2024-08-18T22:32:35.328253+0000","last_undegraded":"2024-08-18T22:32:35.328253+0000","last_fullsized":"2024-08-18T22:32:35.328253+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:57.349272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323306+0000","last_change":"2024-08-18T22:32:33.323306+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323306+0000","last_undegraded":"2024-08-18T22:32:33.323306+0000","last_fullsized":"2024-08-18T22:32:33.323306+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.338232+0000","last_change":"2024-08-18T22:32:33.334916+0000","last_active":"2024-08-18T22:32:33.338232+0000","last_peered":"2024-08-18T22:32:33.338232+0000","last_clean":"2024-08-18T22:32:33.338232+0000","last_became_active":"2024-08-18T22:32:33.334646+0000","last_became_peered":"2024-08-18T22:32:33.334646+0000","last_unstale":"2024-08-18T22:32:33.338232+0000","last_undegraded":"2024-08-18T22:32:33.338232+0000","last_fullsized":"2024-08-18T22:32:33.338232+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:52:09.453233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324673+0000","last_change":"2024-08-18T22:32:33.324673+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324673+0000","last_undegraded":"2024-08-18T22:32:33.324673+0000","last_fullsized":"2024-08-18T22:32:33.324673+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324009+0000","last_change":"2024-08-18T22:32:33.341713+0000","last_active":"2024-08-18T22:32:35.324009+0000","last_peered":"2024-08-18T22:32:35.324009+0000","last_clean":"2024-08-18T22:32:35.324009+0000","last_became_active":"2024-08-18T22:32:33.341422+0000","last_became_peered":"2024-08-18T22:32:33.341422+0000","last_unstale":"2024-08-18T22:32:35.324009+0000","last_undegraded":"2024-08-18T22:32:35.324009+0000","last_fullsized":"2024-08-18T22:32:35.324009+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:15.668948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322076+0000","last_change":"2024-08-18T22:32:33.322076+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322076+0000","last_undegraded":"2024-08-18T22:32:33.322076+0000","last_fullsized":"2024-08-18T22:32:33.322076+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345478+0000","last_change":"2024-08-18T22:32:33.342210+0000","last_active":"2024-08-18T22:32:33.345478+0000","last_peered":"2024-08-18T22:32:33.345478+0000","last_clean":"2024-08-18T22:32:33.345478+0000","last_became_active":"2024-08-18T22:32:33.341921+0000","last_became_peered":"2024-08-18T22:32:33.341921+0000","last_unstale":"2024-08-18T22:32:33.345478+0000","last_undegraded":"2024-08-18T22:32:33.345478+0000","last_fullsized":"2024-08-18T22:32:33.345478+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:22:03.299700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321838+0000","last_change":"2024-08-18T22:32:33.321838+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321838+0000","last_undegraded":"2024-08-18T22:32:33.321838+0000","last_fullsized":"2024-08-18T22:32:33.321838+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.335418+0000","last_change":"2024-08-18T22:32:33.332550+0000","last_active":"2024-08-18T22:32:33.335418+0000","last_peered":"2024-08-18T22:32:33.335418+0000","last_clean":"2024-08-18T22:32:33.335418+0000","last_became_active":"2024-08-18T22:32:33.332177+0000","last_became_peered":"2024-08-18T22:32:33.332177+0000","last_unstale":"2024-08-18T22:32:33.335418+0000","last_undegraded":"2024-08-18T22:32:33.335418+0000","last_fullsized":"2024-08-18T22:32:33.335418+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:33:51.414209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321482+0000","last_change":"2024-08-18T22:32:33.321482+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321482+0000","last_undegraded":"2024-08-18T22:32:33.321482+0000","last_fullsized":"2024-08-18T22:32:33.321482+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.337294+0000","last_change":"2024-08-18T22:32:33.333264+0000","last_active":"2024-08-18T22:32:33.337294+0000","last_peered":"2024-08-18T22:32:33.337294+0000","last_clean":"2024-08-18T22:32:33.337294+0000","last_became_active":"2024-08-18T22:32:33.332744+0000","last_became_peered":"2024-08-18T22:32:33.332744+0000","last_unstale":"2024-08-18T22:32:33.337294+0000","last_undegraded":"2024-08-18T22:32:33.337294+0000","last_fullsized":"2024-08-18T22:32:33.337294+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:54:40.458643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.324000+0000","last_change":"2024-08-18T22:32:33.324000+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.324000+0000","last_undegraded":"2024-08-18T22:32:33.324000+0000","last_fullsized":"2024-08-18T22:32:33.324000+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323956+0000","last_change":"2024-08-18T22:32:33.339203+0000","last_active":"2024-08-18T22:32:35.323956+0000","last_peered":"2024-08-18T22:32:35.323956+0000","last_clean":"2024-08-18T22:32:35.323956+0000","last_became_active":"2024-08-18T22:32:33.338874+0000","last_became_peered":"2024-08-18T22:32:33.338874+0000","last_unstale":"2024-08-18T22:32:35.323956+0000","last_undegraded":"2024-08-18T22:32:35.323956+0000","last_fullsized":"2024-08-18T22:32:35.323956+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:22.210202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.331526+0000","last_change":"2024-08-18T22:32:33.331526+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.331526+0000","last_undegraded":"2024-08-18T22:32:33.331526+0000","last_fullsized":"2024-08-18T22:32:33.331526+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345487+0000","last_change":"2024-08-18T22:32:33.344244+0000","last_active":"2024-08-18T22:32:33.345487+0000","last_peered":"2024-08-18T22:32:33.345487+0000","last_clean":"2024-08-18T22:32:33.345487+0000","last_became_active":"2024-08-18T22:32:33.340454+0000","last_became_peered":"2024-08-18T22:32:33.340454+0000","last_unstale":"2024-08-18T22:32:33.345487+0000","last_undegraded":"2024-08-18T22:32:33.345487+0000","last_fullsized":"2024-08-18T22:32:33.345487+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:44.234250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.321885+0000","last_change":"2024-08-18T22:32:33.321885+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.321885+0000","last_undegraded":"2024-08-18T22:32:33.321885+0000","last_fullsized":"2024-08-18T22:32:33.321885+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.341330+0000","last_change":"2024-08-18T22:32:33.336637+0000","last_active":"2024-08-18T22:32:33.341330+0000","last_peered":"2024-08-18T22:32:33.341330+0000","last_clean":"2024-08-18T22:32:33.341330+0000","last_became_active":"2024-08-18T22:32:33.336352+0000","last_became_peered":"2024-08-18T22:32:33.336352+0000","last_unstale":"2024-08-18T22:32:33.341330+0000","last_undegraded":"2024-08-18T22:32:33.341330+0000","last_fullsized":"2024-08-18T22:32:33.341330+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:01.375890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.322695+0000","last_change":"2024-08-18T22:32:33.322695+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.322695+0000","last_undegraded":"2024-08-18T22:32:33.322695+0000","last_fullsized":"2024-08-18T22:32:33.322695+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340492+0000","last_change":"2024-08-18T22:32:33.338065+0000","last_active":"2024-08-18T22:32:33.340492+0000","last_peered":"2024-08-18T22:32:33.340492+0000","last_clean":"2024-08-18T22:32:33.340492+0000","last_became_active":"2024-08-18T22:32:33.337556+0000","last_became_peered":"2024-08-18T22:32:33.337556+0000","last_unstale":"2024-08-18T22:32:33.340492+0000","last_undegraded":"2024-08-18T22:32:33.340492+0000","last_fullsized":"2024-08-18T22:32:33.340492+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:38.684209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323405+0000","last_change":"2024-08-18T22:32:33.323405+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323405+0000","last_undegraded":"2024-08-18T22:32:33.323405+0000","last_fullsized":"2024-08-18T22:32:33.323405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.345475+0000","last_change":"2024-08-18T22:32:33.343854+0000","last_active":"2024-08-18T22:32:33.345475+0000","last_peered":"2024-08-18T22:32:33.345475+0000","last_clean":"2024-08-18T22:32:33.345475+0000","last_became_active":"2024-08-18T22:32:33.342459+0000","last_became_peered":"2024-08-18T22:32:33.342459+0000","last_unstale":"2024-08-18T22:32:33.345475+0000","last_undegraded":"2024-08-18T22:32:33.345475+0000","last_fullsized":"2024-08-18T22:32:33.345475+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:39:53.509719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.323137+0000","last_change":"2024-08-18T22:32:33.323137+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.323137+0000","last_undegraded":"2024-08-18T22:32:33.323137+0000","last_fullsized":"2024-08-18T22:32:33.323137+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327687+0000","last_change":"2024-08-18T22:32:33.336271+0000","last_active":"2024-08-18T22:32:35.327687+0000","last_peered":"2024-08-18T22:32:35.327687+0000","last_clean":"2024-08-18T22:32:35.327687+0000","last_became_active":"2024-08-18T22:32:33.335793+0000","last_became_peered":"2024-08-18T22:32:33.335793+0000","last_unstale":"2024-08-18T22:32:35.327687+0000","last_undegraded":"2024-08-18T22:32:35.327687+0000","last_fullsized":"2024-08-18T22:32:35.327687+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:09.734094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":1,"reported_epoch":189,"state":"creating+peering","last_fresh":"2024-08-18T22:32:33.333611+0000","last_change":"2024-08-18T22:32:33.333611+0000","last_active":"2024-08-18T22:32:33.305151+0000","last_peered":"2024-08-18T22:32:33.305151+0000","last_clean":"2024-08-18T22:32:33.305151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T22:32:33.333611+0000","last_undegraded":"2024-08-18T22:32:33.333611+0000","last_fullsized":"2024-08-18T22:32:33.333611+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.340513+0000","last_change":"2024-08-18T22:32:33.335923+0000","last_active":"2024-08-18T22:32:33.340513+0000","last_peered":"2024-08-18T22:32:33.340513+0000","last_clean":"2024-08-18T22:32:33.340513+0000","last_became_active":"2024-08-18T22:32:33.335475+0000","last_became_peered":"2024-08-18T22:32:33.335475+0000","last_unstale":"2024-08-18T22:32:33.340513+0000","last_undegraded":"2024-08-18T22:32:33.340513+0000","last_fullsized":"2024-08-18T22:32:33.340513+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:25:13.526045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":512,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-08-18T22:32:33.323248+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:32:33.323248+0000","last_peered":"2024-08-18T22:32:33.323248+0000","last_clean":"2024-08-18T22:32:33.323248+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:32:33.323248+0000","last_undegraded":"2024-08-18T22:32:33.323248+0000","last_fullsized":"2024-08-18T22:32:33.323248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509604,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52120,"kb_used_data":2888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319720,"statfs":{"total":96636764160,"available":96583393280,"internally_reserved":0,"allocated":2957312,"data_stored":1705166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509606,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51552,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320288,"statfs":{"total":96636764160,"available":96583974912,"internally_reserved":0,"allocated":2375680,"data_stored":1121465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51536,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320304,"statfs":{"total":96636764160,"available":96583991296,"internally_reserved":0,"allocated":2363392,"data_stored":1114798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509605,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47384,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324456,"statfs":{"total":96636764160,"available":96588242944,"internally_reserved":0,"allocated":2363392,"data_stored":1114798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509604,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47380,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324460,"statfs":{"total":96636764160,"available":96588247040,"internally_reserved":0,"allocated":2363392,"data_stored":1114798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509605,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60448,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311392,"statfs":{"total":96636764160,"available":96574865408,"internally_reserved":0,"allocated":2969600,"data_stored":1711833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59900,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311940,"statfs":{"total":96636764160,"available":96575426560,"internally_reserved":0,"allocated":2404352,"data_stored":1135906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575013,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59888,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311952,"statfs":{"total":96636764160,"available":96575438848,"internally_reserved":0,"allocated":2392064,"data_stored":1128722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:32:39.242 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3f is not active+clean 2024-08-18T22:32:39.242 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.334406+0000', 'last_change': '2024-08-18T22:32:33.334406+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.334406+0000', 'last_undegraded': '2024-08-18T22:32:33.334406+0000', 'last_fullsized': '2024-08-18T22:32:33.334406+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:32:39.242 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3e is not active+clean 2024-08-18T22:32:39.242 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.325093+0000', 'last_change': '2024-08-18T22:32:33.325093+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.325093+0000', 'last_undegraded': '2024-08-18T22:32:33.325093+0000', 'last_fullsized': '2024-08-18T22:32:33.325093+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:32:39.242 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3d is not active+clean 2024-08-18T22:32:39.242 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.329261+0000', 'last_change': '2024-08-18T22:32:33.329261+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.329261+0000', 'last_undegraded': '2024-08-18T22:32:33.329261+0000', 'last_fullsized': '2024-08-18T22:32:33.329261+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:32:39.242 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3c is not active+clean 2024-08-18T22:32:39.242 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323643+0000', 'last_change': '2024-08-18T22:32:33.323643+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323643+0000', 'last_undegraded': '2024-08-18T22:32:33.323643+0000', 'last_fullsized': '2024-08-18T22:32:33.323643+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:32:39.242 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3a is not active+clean 2024-08-18T22:32:39.243 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.322789+0000', 'last_change': '2024-08-18T22:32:33.322789+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.322789+0000', 'last_undegraded': '2024-08-18T22:32:33.322789+0000', 'last_fullsized': '2024-08-18T22:32:33.322789+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:32:39.243 INFO:tasks.ceph.ceph_manager.ceph:PG 28.38 is not active+clean 2024-08-18T22:32:39.243 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.324176+0000', 'last_change': '2024-08-18T22:32:33.324176+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.324176+0000', 'last_undegraded': '2024-08-18T22:32:33.324176+0000', 'last_fullsized': '2024-08-18T22:32:33.324176+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.243 INFO:tasks.ceph.ceph_manager.ceph:PG 28.37 is not active+clean 2024-08-18T22:32:39.243 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.324748+0000', 'last_change': '2024-08-18T22:32:33.324748+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.324748+0000', 'last_undegraded': '2024-08-18T22:32:33.324748+0000', 'last_fullsized': '2024-08-18T22:32:33.324748+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:32:39.243 INFO:tasks.ceph.ceph_manager.ceph:PG 28.36 is not active+clean 2024-08-18T22:32:39.243 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.322214+0000', 'last_change': '2024-08-18T22:32:33.322214+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.322214+0000', 'last_undegraded': '2024-08-18T22:32:33.322214+0000', 'last_fullsized': '2024-08-18T22:32:33.322214+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.243 INFO:tasks.ceph.ceph_manager.ceph:PG 28.35 is not active+clean 2024-08-18T22:32:39.243 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.326218+0000', 'last_change': '2024-08-18T22:32:33.326218+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.326218+0000', 'last_undegraded': '2024-08-18T22:32:33.326218+0000', 'last_fullsized': '2024-08-18T22:32:33.326218+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:32:39.243 INFO:tasks.ceph.ceph_manager.ceph:PG 28.33 is not active+clean 2024-08-18T22:32:39.243 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323206+0000', 'last_change': '2024-08-18T22:32:33.323206+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323206+0000', 'last_undegraded': '2024-08-18T22:32:33.323206+0000', 'last_fullsized': '2024-08-18T22:32:33.323206+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:PG 28.32 is not active+clean 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.326351+0000', 'last_change': '2024-08-18T22:32:33.326351+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.326351+0000', 'last_undegraded': '2024-08-18T22:32:33.326351+0000', 'last_fullsized': '2024-08-18T22:32:33.326351+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:PG 28.30 is not active+clean 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.330234+0000', 'last_change': '2024-08-18T22:32:33.330234+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.330234+0000', 'last_undegraded': '2024-08-18T22:32:33.330234+0000', 'last_fullsized': '2024-08-18T22:32:33.330234+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2f is not active+clean 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.324211+0000', 'last_change': '2024-08-18T22:32:33.324211+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.324211+0000', 'last_undegraded': '2024-08-18T22:32:33.324211+0000', 'last_fullsized': '2024-08-18T22:32:33.324211+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2e is not active+clean 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.325580+0000', 'last_change': '2024-08-18T22:32:33.325580+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.325580+0000', 'last_undegraded': '2024-08-18T22:32:33.325580+0000', 'last_fullsized': '2024-08-18T22:32:33.325580+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2d is not active+clean 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.321840+0000', 'last_change': '2024-08-18T22:32:33.321840+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.321840+0000', 'last_undegraded': '2024-08-18T22:32:33.321840+0000', 'last_fullsized': '2024-08-18T22:32:33.321840+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2c is not active+clean 2024-08-18T22:32:39.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.322462+0000', 'last_change': '2024-08-18T22:32:33.322462+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.322462+0000', 'last_undegraded': '2024-08-18T22:32:33.322462+0000', 'last_fullsized': '2024-08-18T22:32:33.322462+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.245 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2b is not active+clean 2024-08-18T22:32:39.245 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323064+0000', 'last_change': '2024-08-18T22:32:33.323064+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323064+0000', 'last_undegraded': '2024-08-18T22:32:33.323064+0000', 'last_fullsized': '2024-08-18T22:32:33.323064+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.245 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2a is not active+clean 2024-08-18T22:32:39.245 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.324593+0000', 'last_change': '2024-08-18T22:32:33.324593+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.324593+0000', 'last_undegraded': '2024-08-18T22:32:33.324593+0000', 'last_fullsized': '2024-08-18T22:32:33.324593+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.245 INFO:tasks.ceph.ceph_manager.ceph:PG 28.29 is not active+clean 2024-08-18T22:32:39.245 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.325159+0000', 'last_change': '2024-08-18T22:32:33.325159+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.325159+0000', 'last_undegraded': '2024-08-18T22:32:33.325159+0000', 'last_fullsized': '2024-08-18T22:32:33.325159+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:32:39.245 INFO:tasks.ceph.ceph_manager.ceph:PG 28.27 is not active+clean 2024-08-18T22:32:39.245 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323775+0000', 'last_change': '2024-08-18T22:32:33.323775+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323775+0000', 'last_undegraded': '2024-08-18T22:32:33.323775+0000', 'last_fullsized': '2024-08-18T22:32:33.323775+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:32:39.245 INFO:tasks.ceph.ceph_manager.ceph:PG 28.26 is not active+clean 2024-08-18T22:32:39.245 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.334940+0000', 'last_change': '2024-08-18T22:32:33.334940+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.334940+0000', 'last_undegraded': '2024-08-18T22:32:33.334940+0000', 'last_fullsized': '2024-08-18T22:32:33.334940+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:32:39.246 INFO:tasks.ceph.ceph_manager.ceph:PG 28.25 is not active+clean 2024-08-18T22:32:39.246 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.325759+0000', 'last_change': '2024-08-18T22:32:33.325759+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.325759+0000', 'last_undegraded': '2024-08-18T22:32:33.325759+0000', 'last_fullsized': '2024-08-18T22:32:33.325759+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:32:39.246 INFO:tasks.ceph.ceph_manager.ceph:PG 28.23 is not active+clean 2024-08-18T22:32:39.246 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323450+0000', 'last_change': '2024-08-18T22:32:33.323450+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323450+0000', 'last_undegraded': '2024-08-18T22:32:33.323450+0000', 'last_fullsized': '2024-08-18T22:32:33.323450+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:32:39.246 INFO:tasks.ceph.ceph_manager.ceph:PG 28.21 is not active+clean 2024-08-18T22:32:39.246 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323728+0000', 'last_change': '2024-08-18T22:32:33.323728+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323728+0000', 'last_undegraded': '2024-08-18T22:32:33.323728+0000', 'last_fullsized': '2024-08-18T22:32:33.323728+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:32:39.246 INFO:tasks.ceph.ceph_manager.ceph:PG 28.20 is not active+clean 2024-08-18T22:32:39.246 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.322973+0000', 'last_change': '2024-08-18T22:32:33.322973+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.322973+0000', 'last_undegraded': '2024-08-18T22:32:33.322973+0000', 'last_fullsized': '2024-08-18T22:32:33.322973+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:32:39.246 INFO:tasks.ceph.ceph_manager.ceph:PG 28.18 is not active+clean 2024-08-18T22:32:39.246 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323245+0000', 'last_change': '2024-08-18T22:32:33.323245+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323245+0000', 'last_undegraded': '2024-08-18T22:32:33.323245+0000', 'last_fullsized': '2024-08-18T22:32:33.323245+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:32:39.246 INFO:tasks.ceph.ceph_manager.ceph:PG 28.19 is not active+clean 2024-08-18T22:32:39.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.335496+0000', 'last_change': '2024-08-18T22:32:33.335496+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.335496+0000', 'last_undegraded': '2024-08-18T22:32:33.335496+0000', 'last_fullsized': '2024-08-18T22:32:33.335496+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:32:39.247 INFO:tasks.ceph.ceph_manager.ceph:PG 28.1a is not active+clean 2024-08-18T22:32:39.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.321863+0000', 'last_change': '2024-08-18T22:32:33.321863+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.321863+0000', 'last_undegraded': '2024-08-18T22:32:33.321863+0000', 'last_fullsized': '2024-08-18T22:32:33.321863+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.247 INFO:tasks.ceph.ceph_manager.ceph:PG 28.1f is not active+clean 2024-08-18T22:32:39.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323259+0000', 'last_change': '2024-08-18T22:32:33.323259+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323259+0000', 'last_undegraded': '2024-08-18T22:32:33.323259+0000', 'last_fullsized': '2024-08-18T22:32:33.323259+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:32:39.247 INFO:tasks.ceph.ceph_manager.ceph:PG 28.11 is not active+clean 2024-08-18T22:32:39.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.322371+0000', 'last_change': '2024-08-18T22:32:33.322371+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.322371+0000', 'last_undegraded': '2024-08-18T22:32:33.322371+0000', 'last_fullsized': '2024-08-18T22:32:33.322371+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:32:39.247 INFO:tasks.ceph.ceph_manager.ceph:PG 28.12 is not active+clean 2024-08-18T22:32:39.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323577+0000', 'last_change': '2024-08-18T22:32:33.323577+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323577+0000', 'last_undegraded': '2024-08-18T22:32:33.323577+0000', 'last_fullsized': '2024-08-18T22:32:33.323577+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:32:39.247 INFO:tasks.ceph.ceph_manager.ceph:PG 28.14 is not active+clean 2024-08-18T22:32:39.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.324605+0000', 'last_change': '2024-08-18T22:32:33.324605+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.324605+0000', 'last_undegraded': '2024-08-18T22:32:33.324605+0000', 'last_fullsized': '2024-08-18T22:32:33.324605+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:32:39.248 INFO:tasks.ceph.ceph_manager.ceph:PG 28.15 is not active+clean 2024-08-18T22:32:39.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.322305+0000', 'last_change': '2024-08-18T22:32:33.322305+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.322305+0000', 'last_undegraded': '2024-08-18T22:32:33.322305+0000', 'last_fullsized': '2024-08-18T22:32:33.322305+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:32:39.248 INFO:tasks.ceph.ceph_manager.ceph:PG 28.16 is not active+clean 2024-08-18T22:32:39.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.325090+0000', 'last_change': '2024-08-18T22:32:33.325090+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.325090+0000', 'last_undegraded': '2024-08-18T22:32:33.325090+0000', 'last_fullsized': '2024-08-18T22:32:33.325090+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:32:39.248 INFO:tasks.ceph.ceph_manager.ceph:PG 28.17 is not active+clean 2024-08-18T22:32:39.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.324549+0000', 'last_change': '2024-08-18T22:32:33.324549+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.324549+0000', 'last_undegraded': '2024-08-18T22:32:33.324549+0000', 'last_fullsized': '2024-08-18T22:32:33.324549+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:32:39.248 INFO:tasks.ceph.ceph_manager.ceph:PG 28.8 is not active+clean 2024-08-18T22:32:39.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.322637+0000', 'last_change': '2024-08-18T22:32:33.322637+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.322637+0000', 'last_undegraded': '2024-08-18T22:32:33.322637+0000', 'last_fullsized': '2024-08-18T22:32:33.322637+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.248 INFO:tasks.ceph.ceph_manager.ceph:PG 28.9 is not active+clean 2024-08-18T22:32:39.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.333262+0000', 'last_change': '2024-08-18T22:32:33.333262+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.333262+0000', 'last_undegraded': '2024-08-18T22:32:33.333262+0000', 'last_fullsized': '2024-08-18T22:32:33.333262+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:32:39.248 INFO:tasks.ceph.ceph_manager.ceph:PG 28.a is not active+clean 2024-08-18T22:32:39.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.329869+0000', 'last_change': '2024-08-18T22:32:33.329869+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.329869+0000', 'last_undegraded': '2024-08-18T22:32:33.329869+0000', 'last_fullsized': '2024-08-18T22:32:33.329869+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:32:39.249 INFO:tasks.ceph.ceph_manager.ceph:PG 28.b is not active+clean 2024-08-18T22:32:39.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.322556+0000', 'last_change': '2024-08-18T22:32:33.322556+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.322556+0000', 'last_undegraded': '2024-08-18T22:32:33.322556+0000', 'last_fullsized': '2024-08-18T22:32:33.322556+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.249 INFO:tasks.ceph.ceph_manager.ceph:PG 28.c is not active+clean 2024-08-18T22:32:39.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.324176+0000', 'last_change': '2024-08-18T22:32:33.324176+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.324176+0000', 'last_undegraded': '2024-08-18T22:32:33.324176+0000', 'last_fullsized': '2024-08-18T22:32:33.324176+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T22:32:39.249 INFO:tasks.ceph.ceph_manager.ceph:PG 28.d is not active+clean 2024-08-18T22:32:39.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323306+0000', 'last_change': '2024-08-18T22:32:33.323306+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323306+0000', 'last_undegraded': '2024-08-18T22:32:33.323306+0000', 'last_fullsized': '2024-08-18T22:32:33.323306+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:32:39.249 INFO:tasks.ceph.ceph_manager.ceph:PG 28.e is not active+clean 2024-08-18T22:32:39.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.324673+0000', 'last_change': '2024-08-18T22:32:33.324673+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.324673+0000', 'last_undegraded': '2024-08-18T22:32:33.324673+0000', 'last_fullsized': '2024-08-18T22:32:33.324673+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:32:39.249 INFO:tasks.ceph.ceph_manager.ceph:PG 28.f is not active+clean 2024-08-18T22:32:39.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.322076+0000', 'last_change': '2024-08-18T22:32:33.322076+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.322076+0000', 'last_undegraded': '2024-08-18T22:32:33.322076+0000', 'last_fullsized': '2024-08-18T22:32:33.322076+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.250 INFO:tasks.ceph.ceph_manager.ceph:PG 28.0 is not active+clean 2024-08-18T22:32:39.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.321838+0000', 'last_change': '2024-08-18T22:32:33.321838+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.321838+0000', 'last_undegraded': '2024-08-18T22:32:33.321838+0000', 'last_fullsized': '2024-08-18T22:32:33.321838+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.250 INFO:tasks.ceph.ceph_manager.ceph:PG 28.1 is not active+clean 2024-08-18T22:32:39.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.321482+0000', 'last_change': '2024-08-18T22:32:33.321482+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.321482+0000', 'last_undegraded': '2024-08-18T22:32:33.321482+0000', 'last_fullsized': '2024-08-18T22:32:33.321482+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:32:39.250 INFO:tasks.ceph.ceph_manager.ceph:PG 28.2 is not active+clean 2024-08-18T22:32:39.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.324000+0000', 'last_change': '2024-08-18T22:32:33.324000+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.324000+0000', 'last_undegraded': '2024-08-18T22:32:33.324000+0000', 'last_fullsized': '2024-08-18T22:32:33.324000+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T22:32:39.250 INFO:tasks.ceph.ceph_manager.ceph:PG 28.3 is not active+clean 2024-08-18T22:32:39.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.331526+0000', 'last_change': '2024-08-18T22:32:33.331526+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.331526+0000', 'last_undegraded': '2024-08-18T22:32:33.331526+0000', 'last_fullsized': '2024-08-18T22:32:33.331526+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:32:39.250 INFO:tasks.ceph.ceph_manager.ceph:PG 28.4 is not active+clean 2024-08-18T22:32:39.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.321885+0000', 'last_change': '2024-08-18T22:32:33.321885+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.321885+0000', 'last_undegraded': '2024-08-18T22:32:33.321885+0000', 'last_fullsized': '2024-08-18T22:32:33.321885+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T22:32:39.250 INFO:tasks.ceph.ceph_manager.ceph:PG 28.5 is not active+clean 2024-08-18T22:32:39.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.322695+0000', 'last_change': '2024-08-18T22:32:33.322695+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.322695+0000', 'last_undegraded': '2024-08-18T22:32:33.322695+0000', 'last_fullsized': '2024-08-18T22:32:33.322695+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:32:39.251 INFO:tasks.ceph.ceph_manager.ceph:PG 28.6 is not active+clean 2024-08-18T22:32:39.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323405+0000', 'last_change': '2024-08-18T22:32:33.323405+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323405+0000', 'last_undegraded': '2024-08-18T22:32:33.323405+0000', 'last_fullsized': '2024-08-18T22:32:33.323405+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T22:32:39.251 INFO:tasks.ceph.ceph_manager.ceph:PG 28.7 is not active+clean 2024-08-18T22:32:39.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.323137+0000', 'last_change': '2024-08-18T22:32:33.323137+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.323137+0000', 'last_undegraded': '2024-08-18T22:32:33.323137+0000', 'last_fullsized': '2024-08-18T22:32:33.323137+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T22:32:39.251 INFO:tasks.ceph.ceph_manager.ceph:PG 28.1d is not active+clean 2024-08-18T22:32:39.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '28.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 189, 'state': 'creating+peering', 'last_fresh': '2024-08-18T22:32:33.333611+0000', 'last_change': '2024-08-18T22:32:33.333611+0000', 'last_active': '2024-08-18T22:32:33.305151+0000', 'last_peered': '2024-08-18T22:32:33.305151+0000', 'last_clean': '2024-08-18T22:32:33.305151+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T22:32:33.333611+0000', 'last_undegraded': '2024-08-18T22:32:33.333611+0000', 'last_fullsized': '2024-08-18T22:32:33.333611+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'last_clean_scrub_stamp': '2024-08-18T22:32:33.305151+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T22:32:39.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T22:32:39.285 INFO:tasks.ceph.mds.a.smithi005.stderr:2024-08-18T22:32:39.283+0000 7f23f8000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:32:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3efe00640 1 Processor -- start 2024-08-18T22:32:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3efe00640 1 -- start start 2024-08-18T22:32:39.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3efe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3e815ff60 0x7fa3e80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3efe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e8160340 0x7fa3e809b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3efe00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e80cff50 con 0x7fa3e809b8b0 2024-08-18T22:32:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3efe00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e80cfd00 con 0x7fa3e815ff60 2024-08-18T22:32:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3efe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e80d0230 con 0x7fa3e8160340 2024-08-18T22:32:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3ed400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3e815ff60 0x7fa3e80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3ede00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa3e809b8b0 0x7fa3e80ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49166/0 (socket says 172.21.15.5:49166) 2024-08-18T22:32:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3ede00640 1 -- 172.21.15.5:0/1269851754 learned_addr learned my addr 172.21.15.5:0/1269851754 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3eca00640 1 --2- 172.21.15.5:0/1269851754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e8160340 0x7fa3e809b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3ed400640 1 -- 172.21.15.5:0/1269851754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e8160340 msgr2=0x7fa3e809b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3ed400640 1 --2- 172.21.15.5:0/1269851754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e8160340 0x7fa3e809b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3ed400640 1 -- 172.21.15.5:0/1269851754 >> v1:172.21.15.5:6789/0 conn(0x7fa3e809b8b0 legacy=0x7fa3e80ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3ed400640 1 -- 172.21.15.5:0/1269851754 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e809ab70 con 0x7fa3e815ff60 2024-08-18T22:32:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3e7e00640 1 -- 172.21.15.5:0/1269851754 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3103788231 0 0) 0x7fa3e80cff50 con 0x7fa3e809b8b0 2024-08-18T22:32:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.427+0000 7fa3eca00640 1 --2- 172.21.15.5:0/1269851754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e8160340 0x7fa3e809b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3ed400640 1 --2- 172.21.15.5:0/1269851754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e815ff60 0x7fa3e80ce610 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0097c0 tx=0x7fa3dc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c681c44dc90cfeb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3e7e00640 1 -- 172.21.15.5:0/1269851754 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0b0070 con 0x7fa3e815ff60 2024-08-18T22:32:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3e7e00640 1 -- 172.21.15.5:0/1269851754 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc0ab600 con 0x7fa3e815ff60 2024-08-18T22:32:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3e7e00640 1 -- 172.21.15.5:0/1269851754 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0ab9d0 con 0x7fa3e815ff60 2024-08-18T22:32:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3efe00640 1 -- 172.21.15.5:0/1269851754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e815ff60 msgr2=0x7fa3e80ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3efe00640 1 --2- 172.21.15.5:0/1269851754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e815ff60 0x7fa3e80ce610 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0097c0 tx=0x7fa3dc01c380 comp rx=0 tx=0).stop 2024-08-18T22:32:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3efe00640 1 -- 172.21.15.5:0/1269851754 shutdown_connections 2024-08-18T22:32:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3efe00640 1 --2- 172.21.15.5:0/1269851754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e8160340 0x7fa3e809b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3efe00640 1 --2- 172.21.15.5:0/1269851754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e815ff60 0x7fa3e80ce610 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3efe00640 1 -- 172.21.15.5:0/1269851754 >> 172.21.15.5:0/1269851754 conn(0x7fa3e80d2130 msgr2=0x7fa3e80d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3efe00640 1 -- 172.21.15.5:0/1269851754 shutdown_connections 2024-08-18T22:32:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.431+0000 7fa3efe00640 1 -- 172.21.15.5:0/1269851754 wait complete. 2024-08-18T22:32:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3efe00640 1 Processor -- start 2024-08-18T22:32:39.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3efe00640 1 -- start start 2024-08-18T22:32:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3efe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e809b8b0 0x7fa3e815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3efe00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e815ff60 0x7fa3e80b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3efe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e8160340 0x7fa3e80c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3efe00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e8169be0 con 0x7fa3e8160340 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3efe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e8169a60 con 0x7fa3e809b8b0 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3efe00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e8169d60 con 0x7fa3e815ff60 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3ede00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e8160340 0x7fa3e80c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3ede00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e8160340 0x7fa3e80c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46920/0 (socket says 172.21.15.5:46920) 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3ede00640 1 -- 172.21.15.5:0/450729827 learned_addr learned my addr 172.21.15.5:0/450729827 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3eca00640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e815ff60 0x7fa3e80b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3ed400640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e809b8b0 0x7fa3e815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3ede00640 1 -- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e815ff60 msgr2=0x7fa3e80b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3ede00640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e815ff60 0x7fa3e80b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3ede00640 1 -- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e809b8b0 msgr2=0x7fa3e815a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3ede00640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e809b8b0 0x7fa3e815a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3ede00640 1 -- 172.21.15.5:0/450729827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e815d8c0 con 0x7fa3e8160340 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3ed400640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e809b8b0 0x7fa3e815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3ede00640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e8160340 0x7fa3e80c9200 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c700 tx=0x7fa3e000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3e5600640 1 -- 172.21.15.5:0/450729827 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0018070 con 0x7fa3e8160340 2024-08-18T22:32:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3e5600640 1 -- 172.21.15.5:0/450729827 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e000ce10 con 0x7fa3e8160340 2024-08-18T22:32:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3e5600640 1 -- 172.21.15.5:0/450729827 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e000a860 con 0x7fa3e8160340 2024-08-18T22:32:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3efe00640 1 -- 172.21.15.5:0/450729827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e815dba0 con 0x7fa3e8160340 2024-08-18T22:32:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3efe00640 1 -- 172.21.15.5:0/450729827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e815e160 con 0x7fa3e8160340 2024-08-18T22:32:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.435+0000 7fa3efe00640 1 -- 172.21.15.5:0/450729827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e80d0f90 con 0x7fa3e8160340 2024-08-18T22:32:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.439+0000 7fa3e5600640 1 -- 172.21.15.5:0/450729827 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3e000aa00 con 0x7fa3e8160340 2024-08-18T22:32:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.439+0000 7fa3e5600640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c80678f0 0x7fa3c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.439+0000 7fa3e5600640 1 -- 172.21.15.5:0/450729827 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fa3e0085200 con 0x7fa3e8160340 2024-08-18T22:32:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.439+0000 7fa3ed400640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c80678f0 0x7fa3c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.439+0000 7fa3ed400640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c80678f0 0x7fa3c8069db0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0ad000 tx=0x7fa3dc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:39.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.443+0000 7fa3e5600640 1 -- 172.21.15.5:0/450729827 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa3e0055550 con 0x7fa3e8160340 2024-08-18T22:32:39.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.671+0000 7fa3efe00640 1 -- 172.21.15.5:0/450729827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa3e80d2dd0 con 0x7fa3e8160340 2024-08-18T22:32:39.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.671+0000 7fa3e5600640 1 -- 172.21.15.5:0/450729827 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1145 (secure 0 0 0) 0x7fa3e0059850 con 0x7fa3e8160340 2024-08-18T22:32:39.673 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:39.673 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":823,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":191,"num_osds":8,"num_up_osds":8,"osd_up_since":1724019548,"num_in_osds":8,"osd_in_since":1724019539,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":52},{"state_name":"active+clean","count":45}],"num_pgs":97,"num_pools":3,"num_objects":9,"data_bytes":590950,"bytes_used":440532992,"bytes_avail":772653580288,"bytes_total":773094113280,"inactive_pgs_ratio":0.53608244657516479,"write_bytes_sec":185,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":151,"btime":"2024-08-18T22:32:37:342248+0000","id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"a","status":"up:active","gid":10350}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-08-18T22:31:25.798976+0000","services":{}},"progress_events":{}} 2024-08-18T22:32:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 -- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c80678f0 msgr2=0x7fa3c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c80678f0 0x7fa3c8069db0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0ad000 tx=0x7fa3dc0a6000 comp rx=0 tx=0).stop 2024-08-18T22:32:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 -- 172.21.15.5:0/450729827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e8160340 msgr2=0x7fa3e80c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e8160340 0x7fa3e80c9200 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c700 tx=0x7fa3e000cbc0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 -- 172.21.15.5:0/450729827 shutdown_connections 2024-08-18T22:32:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa3c80678f0 0x7fa3c8069db0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3e8160340 0x7fa3e80c9200 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3e815ff60 0x7fa3e80b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 --2- 172.21.15.5:0/450729827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3e809b8b0 0x7fa3e815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 -- 172.21.15.5:0/450729827 >> 172.21.15.5:0/450729827 conn(0x7fa3e80d2130 msgr2=0x7fa3e806fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 -- 172.21.15.5:0/450729827 shutdown_connections 2024-08-18T22:32:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.675+0000 7fa3efe00640 1 -- 172.21.15.5:0/450729827 wait complete. 2024-08-18T22:32:39.696 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-18T22:32:39.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:32:39.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.839+0000 7ff2c0c00640 1 Processor -- start 2024-08-18T22:32:39.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.839+0000 7ff2c0c00640 1 -- start start 2024-08-18T22:32:39.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.843+0000 7ff2c0c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2bc08bba0 0x7ff2bc06ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.843+0000 7ff2c0c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc06e810 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.843+0000 7ff2c0c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc072570 con 0x7ff2bc0b4ab0 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.843+0000 7ff2c0c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff2bc16b2e0 con 0x7ff2bc08bba0 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.843+0000 7ff2bb400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff2bc08bba0 0x7ff2bc06ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.843+0000 7ff2bbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff2bc0b3f10 0x7ff2bc073050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49174/0 (socket says 172.21.15.5:49174) 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.843+0000 7ff2bbe00640 1 -- 172.21.15.5:0/1521065662 learned_addr learned my addr 172.21.15.5:0/1521065662 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.843+0000 7ff2baa00640 1 -- 172.21.15.5:0/1521065662 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647112120 0 0) 0x7ff2bc06e810 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.855+0000 7ff2baa00640 1 -- 172.21.15.5:0/1521065662 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a0003510 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.855+0000 7ff2baa00640 1 -- 172.21.15.5:0/1521065662 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914995979 0 0) 0x7ff2bc072570 con 0x7ff2bc0b4ab0 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.855+0000 7ff2baa00640 1 -- 172.21.15.5:0/1521065662 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2bc06e810 con 0x7ff2bc0b4ab0 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.855+0000 7ff2baa00640 1 -- 172.21.15.5:0/1521065662 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3299739237 0 0) 0x7ff2a0003510 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.855+0000 7ff2bb400640 1 -- 172.21.15.5:0/1521065662 >> v1:172.21.15.117:6789/0 conn(0x7ff2bc0b4ab0 legacy=0x7ff2bc0acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.855+0000 7ff2bb400640 1 -- 172.21.15.5:0/1521065662 >> v1:172.21.15.5:6789/0 conn(0x7ff2bc0b3f10 legacy=0x7ff2bc073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.855+0000 7ff2bb400640 1 -- 172.21.15.5:0/1521065662 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc072850 con 0x7ff2bc08bba0 2024-08-18T22:32:39.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.855+0000 7ff2bb400640 1 --2- 172.21.15.5:0/1521065662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2bc08bba0 0x7ff2bc06ff20 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0097c0 tx=0x7ff2ac01c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62a1db4f563a17d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:39.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.855+0000 7ff2baa00640 1 -- 172.21.15.5:0/1521065662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0b0070 con 0x7ff2bc08bba0 2024-08-18T22:32:39.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.855+0000 7ff2baa00640 1 -- 172.21.15.5:0/1521065662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ac0ab400 con 0x7ff2bc08bba0 2024-08-18T22:32:39.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.855+0000 7ff2baa00640 1 -- 172.21.15.5:0/1521065662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4001a00 con 0x7ff2bc08bba0 2024-08-18T22:32:39.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 -- 172.21.15.5:0/1521065662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2bc08bba0 msgr2=0x7ff2bc06ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 --2- 172.21.15.5:0/1521065662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2bc08bba0 0x7ff2bc06ff20 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0097c0 tx=0x7ff2ac01c2a0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 -- 172.21.15.5:0/1521065662 shutdown_connections 2024-08-18T22:32:39.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 --2- 172.21.15.5:0/1521065662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2bc08bba0 0x7ff2bc06ff20 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 -- 172.21.15.5:0/1521065662 >> 172.21.15.5:0/1521065662 conn(0x7ff2bc0cfd50 msgr2=0x7ff2bc0d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:39.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 -- 172.21.15.5:0/1521065662 shutdown_connections 2024-08-18T22:32:39.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 -- 172.21.15.5:0/1521065662 wait complete. 2024-08-18T22:32:39.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 Processor -- start 2024-08-18T22:32:39.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 -- start start 2024-08-18T22:32:39.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2bc08bba0 0x7ff2bc0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2bc0b3f10 0x7ff2bc0ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2bc0b4ab0 0x7ff2bc169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1794c0 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc06eaf0 con 0x7ff2bc08bba0 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2c0c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc179640 con 0x7ff2bc0b4ab0 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2b3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2bc0b3f10 0x7ff2bc0ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2b3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2bc0b3f10 0x7ff2bc0ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46940/0 (socket says 172.21.15.5:46940) 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2b3e00640 1 -- 172.21.15.5:0/2274739856 learned_addr learned my addr 172.21.15.5:0/2274739856 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2bbe00640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2bc0b4ab0 0x7ff2bc169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2bb400640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2bc08bba0 0x7ff2bc0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2b3e00640 1 -- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2bc0b4ab0 msgr2=0x7ff2bc169dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2b3e00640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2bc0b4ab0 0x7ff2bc169dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2b3e00640 1 -- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2bc08bba0 msgr2=0x7ff2bc0b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2b3e00640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2bc08bba0 0x7ff2bc0b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.859+0000 7ff2b3e00640 1 -- 172.21.15.5:0/2274739856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc0afec0 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.863+0000 7ff2b3e00640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2bc0b3f10 0x7ff2bc0ae2d0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400c430 tx=0x7ff2a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:39.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.863+0000 7ff2b3400640 1 -- 172.21.15.5:0/2274739856 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4017070 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.863+0000 7ff2b3400640 1 -- 172.21.15.5:0/2274739856 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a40052f0 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.863+0000 7ff2c0c00640 1 -- 172.21.15.5:0/2274739856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc0b01a0 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.863+0000 7ff2b3400640 1 -- 172.21.15.5:0/2274739856 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4003840 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.863+0000 7ff2c0c00640 1 -- 172.21.15.5:0/2274739856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc0adad0 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.863+0000 7ff2c0c00640 1 -- 172.21.15.5:0/2274739856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2bc06ff20 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.863+0000 7ff2b3400640 1 -- 172.21.15.5:0/2274739856 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2a401a070 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.863+0000 7ff2b3400640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2980678c0 0x7ff298069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.863+0000 7ff2b3400640 1 -- 172.21.15.5:0/2274739856 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7ff2a40852c0 con 0x7ff2bc0b3f10 2024-08-18T22:32:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.863+0000 7ff2bb400640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2980678c0 0x7ff298069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:39.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.867+0000 7ff2bb400640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2980678c0 0x7ff298069d80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0ad000 tx=0x7ff2ac0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:39.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:39.867+0000 7ff2b3400640 1 -- 172.21.15.5:0/2274739856 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff2a4055bd0 con 0x7ff2bc0b3f10 2024-08-18T22:32:40.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.031+0000 7ff2c0c00640 1 -- 172.21.15.5:0/2274739856 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2bc0ae810 con 0x7ff2980678c0 2024-08-18T22:32:40.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2b3400640 1 -- 172.21.15.5:0/2274739856 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252494 (secure 0 0 0) 0x7ff2bc0ae810 con 0x7ff2980678c0 2024-08-18T22:32:40.040 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:40.041 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:32:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 -- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2980678c0 msgr2=0x7ff298069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2980678c0 0x7ff298069d80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac0ad000 tx=0x7ff2ac0a6000 comp rx=0 tx=0).stop 2024-08-18T22:32:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 -- 172.21.15.5:0/2274739856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2bc0b3f10 msgr2=0x7ff2bc0ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2bc0b3f10 0x7ff2bc0ae2d0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400c430 tx=0x7ff2a400c8f0 comp rx=0 tx=0).stop 2024-08-18T22:32:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 -- 172.21.15.5:0/2274739856 shutdown_connections 2024-08-18T22:32:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff2980678c0 0x7ff298069d80 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2bc0b4ab0 0x7ff2bc169dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2bc0b3f10 0x7ff2bc0ae2d0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 --2- 172.21.15.5:0/2274739856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2bc08bba0 0x7ff2bc0b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 -- 172.21.15.5:0/2274739856 >> 172.21.15.5:0/2274739856 conn(0x7ff2bc0cfd50 msgr2=0x7ff2bc16dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 -- 172.21.15.5:0/2274739856 shutdown_connections 2024-08-18T22:32:40.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:40.039+0000 7ff2c0c00640 1 -- 172.21.15.5:0/2274739856 wait complete. 2024-08-18T22:32:40.060 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":591,"stamp":"2024-08-18T22:32:39.816330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":430472,"kb_used_data":19964,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754544248,"statfs":{"total":773094113280,"available":772653309952,"internally_reserved":0,"allocated":20443136,"data_stored":10261456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.488925"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327592+0000","last_change":"2024-08-18T22:32:34.348785+0000","last_active":"2024-08-18T22:32:35.327592+0000","last_peered":"2024-08-18T22:32:35.327592+0000","last_clean":"2024-08-18T22:32:35.327592+0000","last_became_active":"2024-08-18T22:32:34.348494+0000","last_became_peered":"2024-08-18T22:32:34.348494+0000","last_unstale":"2024-08-18T22:32:35.327592+0000","last_undegraded":"2024-08-18T22:32:35.327592+0000","last_fullsized":"2024-08-18T22:32:35.327592+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:17:16.060559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328811+0000","last_change":"2024-08-18T22:32:34.333620+0000","last_active":"2024-08-18T22:32:35.328811+0000","last_peered":"2024-08-18T22:32:35.328811+0000","last_clean":"2024-08-18T22:32:35.328811+0000","last_became_active":"2024-08-18T22:32:34.332760+0000","last_became_peered":"2024-08-18T22:32:34.332760+0000","last_unstale":"2024-08-18T22:32:35.328811+0000","last_undegraded":"2024-08-18T22:32:35.328811+0000","last_fullsized":"2024-08-18T22:32:35.328811+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:37:52.642432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.329066+0000","last_change":"2024-08-18T22:32:34.329653+0000","last_active":"2024-08-18T22:32:35.329066+0000","last_peered":"2024-08-18T22:32:35.329066+0000","last_clean":"2024-08-18T22:32:35.329066+0000","last_became_active":"2024-08-18T22:32:34.329341+0000","last_became_peered":"2024-08-18T22:32:34.329341+0000","last_unstale":"2024-08-18T22:32:35.329066+0000","last_undegraded":"2024-08-18T22:32:35.329066+0000","last_fullsized":"2024-08-18T22:32:35.329066+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:16.792889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323265+0000","last_change":"2024-08-18T22:32:34.347883+0000","last_active":"2024-08-18T22:32:35.323265+0000","last_peered":"2024-08-18T22:32:35.323265+0000","last_clean":"2024-08-18T22:32:35.323265+0000","last_became_active":"2024-08-18T22:32:34.347594+0000","last_became_peered":"2024-08-18T22:32:34.347594+0000","last_unstale":"2024-08-18T22:32:35.323265+0000","last_undegraded":"2024-08-18T22:32:35.323265+0000","last_fullsized":"2024-08-18T22:32:35.323265+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:40.485131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327951+0000","last_change":"2024-08-18T22:32:34.332036+0000","last_active":"2024-08-18T22:32:35.327951+0000","last_peered":"2024-08-18T22:32:35.327951+0000","last_clean":"2024-08-18T22:32:35.327951+0000","last_became_active":"2024-08-18T22:32:34.331366+0000","last_became_peered":"2024-08-18T22:32:34.331366+0000","last_unstale":"2024-08-18T22:32:35.327951+0000","last_undegraded":"2024-08-18T22:32:35.327951+0000","last_fullsized":"2024-08-18T22:32:35.327951+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:00.772598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322681+0000","last_change":"2024-08-18T22:32:34.329471+0000","last_active":"2024-08-18T22:32:35.322681+0000","last_peered":"2024-08-18T22:32:35.322681+0000","last_clean":"2024-08-18T22:32:35.322681+0000","last_became_active":"2024-08-18T22:32:34.329162+0000","last_became_peered":"2024-08-18T22:32:34.329162+0000","last_unstale":"2024-08-18T22:32:35.322681+0000","last_undegraded":"2024-08-18T22:32:35.322681+0000","last_fullsized":"2024-08-18T22:32:35.322681+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:09.481981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327668+0000","last_change":"2024-08-18T22:32:34.328506+0000","last_active":"2024-08-18T22:32:35.327668+0000","last_peered":"2024-08-18T22:32:35.327668+0000","last_clean":"2024-08-18T22:32:35.327668+0000","last_became_active":"2024-08-18T22:32:34.328188+0000","last_became_peered":"2024-08-18T22:32:34.328188+0000","last_unstale":"2024-08-18T22:32:35.327668+0000","last_undegraded":"2024-08-18T22:32:35.327668+0000","last_fullsized":"2024-08-18T22:32:35.327668+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:08.229648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.326798+0000","last_change":"2024-08-18T22:32:34.345956+0000","last_active":"2024-08-18T22:32:35.326798+0000","last_peered":"2024-08-18T22:32:35.326798+0000","last_clean":"2024-08-18T22:32:35.326798+0000","last_became_active":"2024-08-18T22:32:34.345570+0000","last_became_peered":"2024-08-18T22:32:34.345570+0000","last_unstale":"2024-08-18T22:32:35.326798+0000","last_undegraded":"2024-08-18T22:32:35.326798+0000","last_fullsized":"2024-08-18T22:32:35.326798+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:24.305313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322151+0000","last_change":"2024-08-18T22:32:34.351507+0000","last_active":"2024-08-18T22:32:35.322151+0000","last_peered":"2024-08-18T22:32:35.322151+0000","last_clean":"2024-08-18T22:32:35.322151+0000","last_became_active":"2024-08-18T22:32:34.349791+0000","last_became_peered":"2024-08-18T22:32:34.349791+0000","last_unstale":"2024-08-18T22:32:35.322151+0000","last_undegraded":"2024-08-18T22:32:35.322151+0000","last_fullsized":"2024-08-18T22:32:35.322151+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:36.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327802+0000","last_change":"2024-08-18T22:32:34.344724+0000","last_active":"2024-08-18T22:32:35.327802+0000","last_peered":"2024-08-18T22:32:35.327802+0000","last_clean":"2024-08-18T22:32:35.327802+0000","last_became_active":"2024-08-18T22:32:34.344423+0000","last_became_peered":"2024-08-18T22:32:34.344423+0000","last_unstale":"2024-08-18T22:32:35.327802+0000","last_undegraded":"2024-08-18T22:32:35.327802+0000","last_fullsized":"2024-08-18T22:32:35.327802+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:15.354545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.329287+0000","last_change":"2024-08-18T22:32:34.339585+0000","last_active":"2024-08-18T22:32:35.329287+0000","last_peered":"2024-08-18T22:32:35.329287+0000","last_clean":"2024-08-18T22:32:35.329287+0000","last_became_active":"2024-08-18T22:32:34.339064+0000","last_became_peered":"2024-08-18T22:32:34.339064+0000","last_unstale":"2024-08-18T22:32:35.329287+0000","last_undegraded":"2024-08-18T22:32:35.329287+0000","last_fullsized":"2024-08-18T22:32:35.329287+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:09.481981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328280+0000","last_change":"2024-08-18T22:32:34.350611+0000","last_active":"2024-08-18T22:32:35.328280+0000","last_peered":"2024-08-18T22:32:35.328280+0000","last_clean":"2024-08-18T22:32:35.328280+0000","last_became_active":"2024-08-18T22:32:34.346800+0000","last_became_peered":"2024-08-18T22:32:34.346800+0000","last_unstale":"2024-08-18T22:32:35.328280+0000","last_undegraded":"2024-08-18T22:32:35.328280+0000","last_fullsized":"2024-08-18T22:32:35.328280+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:10.581383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322792+0000","last_change":"2024-08-18T22:32:34.333309+0000","last_active":"2024-08-18T22:32:35.322792+0000","last_peered":"2024-08-18T22:32:35.322792+0000","last_clean":"2024-08-18T22:32:35.322792+0000","last_became_active":"2024-08-18T22:32:34.333034+0000","last_became_peered":"2024-08-18T22:32:34.333034+0000","last_unstale":"2024-08-18T22:32:35.322792+0000","last_undegraded":"2024-08-18T22:32:35.322792+0000","last_fullsized":"2024-08-18T22:32:35.322792+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:01:25.687333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327316+0000","last_change":"2024-08-18T22:32:34.348512+0000","last_active":"2024-08-18T22:32:35.327316+0000","last_peered":"2024-08-18T22:32:35.327316+0000","last_clean":"2024-08-18T22:32:35.327316+0000","last_became_active":"2024-08-18T22:32:34.347343+0000","last_became_peered":"2024-08-18T22:32:34.347343+0000","last_unstale":"2024-08-18T22:32:35.327316+0000","last_undegraded":"2024-08-18T22:32:35.327316+0000","last_fullsized":"2024-08-18T22:32:35.327316+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:06:17.734239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323091+0000","last_change":"2024-08-18T22:32:34.340094+0000","last_active":"2024-08-18T22:32:35.323091+0000","last_peered":"2024-08-18T22:32:35.323091+0000","last_clean":"2024-08-18T22:32:35.323091+0000","last_became_active":"2024-08-18T22:32:34.339828+0000","last_became_peered":"2024-08-18T22:32:34.339828+0000","last_unstale":"2024-08-18T22:32:35.323091+0000","last_undegraded":"2024-08-18T22:32:35.323091+0000","last_fullsized":"2024-08-18T22:32:35.323091+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:01:26.496081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328101+0000","last_change":"2024-08-18T22:32:34.332616+0000","last_active":"2024-08-18T22:32:35.328101+0000","last_peered":"2024-08-18T22:32:35.328101+0000","last_clean":"2024-08-18T22:32:35.328101+0000","last_became_active":"2024-08-18T22:32:34.332309+0000","last_became_peered":"2024-08-18T22:32:34.332309+0000","last_unstale":"2024-08-18T22:32:35.328101+0000","last_undegraded":"2024-08-18T22:32:35.328101+0000","last_fullsized":"2024-08-18T22:32:35.328101+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:17:16.060559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322382+0000","last_change":"2024-08-18T22:32:34.347426+0000","last_active":"2024-08-18T22:32:35.322382+0000","last_peered":"2024-08-18T22:32:35.322382+0000","last_clean":"2024-08-18T22:32:35.322382+0000","last_became_active":"2024-08-18T22:32:34.344216+0000","last_became_peered":"2024-08-18T22:32:34.344216+0000","last_unstale":"2024-08-18T22:32:35.322382+0000","last_undegraded":"2024-08-18T22:32:35.322382+0000","last_fullsized":"2024-08-18T22:32:35.322382+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:25.437503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321975+0000","last_change":"2024-08-18T22:32:34.342069+0000","last_active":"2024-08-18T22:32:35.321975+0000","last_peered":"2024-08-18T22:32:35.321975+0000","last_clean":"2024-08-18T22:32:35.321975+0000","last_became_active":"2024-08-18T22:32:34.341567+0000","last_became_peered":"2024-08-18T22:32:34.341567+0000","last_unstale":"2024-08-18T22:32:35.321975+0000","last_undegraded":"2024-08-18T22:32:35.321975+0000","last_fullsized":"2024-08-18T22:32:35.321975+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:38:09.140033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327875+0000","last_change":"2024-08-18T22:32:34.346579+0000","last_active":"2024-08-18T22:32:35.327875+0000","last_peered":"2024-08-18T22:32:35.327875+0000","last_clean":"2024-08-18T22:32:35.327875+0000","last_became_active":"2024-08-18T22:32:34.345969+0000","last_became_peered":"2024-08-18T22:32:34.345969+0000","last_unstale":"2024-08-18T22:32:35.327875+0000","last_undegraded":"2024-08-18T22:32:35.327875+0000","last_fullsized":"2024-08-18T22:32:35.327875+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:40.975776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327908+0000","last_change":"2024-08-18T22:32:34.350579+0000","last_active":"2024-08-18T22:32:35.327908+0000","last_peered":"2024-08-18T22:32:35.327908+0000","last_clean":"2024-08-18T22:32:35.327908+0000","last_became_active":"2024-08-18T22:32:34.350325+0000","last_became_peered":"2024-08-18T22:32:34.350325+0000","last_unstale":"2024-08-18T22:32:35.327908+0000","last_undegraded":"2024-08-18T22:32:35.327908+0000","last_fullsized":"2024-08-18T22:32:35.327908+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:13:34.037502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327395+0000","last_change":"2024-08-18T22:32:34.346761+0000","last_active":"2024-08-18T22:32:35.327395+0000","last_peered":"2024-08-18T22:32:35.327395+0000","last_clean":"2024-08-18T22:32:35.327395+0000","last_became_active":"2024-08-18T22:32:34.346300+0000","last_became_peered":"2024-08-18T22:32:34.346300+0000","last_unstale":"2024-08-18T22:32:35.327395+0000","last_undegraded":"2024-08-18T22:32:35.327395+0000","last_fullsized":"2024-08-18T22:32:35.327395+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:01.332201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327483+0000","last_change":"2024-08-18T22:32:34.349546+0000","last_active":"2024-08-18T22:32:35.327483+0000","last_peered":"2024-08-18T22:32:35.327483+0000","last_clean":"2024-08-18T22:32:35.327483+0000","last_became_active":"2024-08-18T22:32:34.349257+0000","last_became_peered":"2024-08-18T22:32:34.349257+0000","last_unstale":"2024-08-18T22:32:35.327483+0000","last_undegraded":"2024-08-18T22:32:35.327483+0000","last_fullsized":"2024-08-18T22:32:35.327483+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:16:57.141203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328191+0000","last_change":"2024-08-18T22:32:34.334445+0000","last_active":"2024-08-18T22:32:35.328191+0000","last_peered":"2024-08-18T22:32:35.328191+0000","last_clean":"2024-08-18T22:32:35.328191+0000","last_became_active":"2024-08-18T22:32:34.334139+0000","last_became_peered":"2024-08-18T22:32:34.334139+0000","last_unstale":"2024-08-18T22:32:35.328191+0000","last_undegraded":"2024-08-18T22:32:35.328191+0000","last_fullsized":"2024-08-18T22:32:35.328191+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:30:46.254753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327593+0000","last_change":"2024-08-18T22:32:34.336858+0000","last_active":"2024-08-18T22:32:35.327593+0000","last_peered":"2024-08-18T22:32:35.327593+0000","last_clean":"2024-08-18T22:32:35.327593+0000","last_became_active":"2024-08-18T22:32:34.336586+0000","last_became_peered":"2024-08-18T22:32:34.336586+0000","last_unstale":"2024-08-18T22:32:35.327593+0000","last_undegraded":"2024-08-18T22:32:35.327593+0000","last_fullsized":"2024-08-18T22:32:35.327593+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:55.751347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322338+0000","last_change":"2024-08-18T22:32:34.342032+0000","last_active":"2024-08-18T22:32:35.322338+0000","last_peered":"2024-08-18T22:32:35.322338+0000","last_clean":"2024-08-18T22:32:35.322338+0000","last_became_active":"2024-08-18T22:32:34.341555+0000","last_became_peered":"2024-08-18T22:32:34.341555+0000","last_unstale":"2024-08-18T22:32:35.322338+0000","last_undegraded":"2024-08-18T22:32:35.322338+0000","last_fullsized":"2024-08-18T22:32:35.322338+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:30:46.254753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327412+0000","last_change":"2024-08-18T22:32:34.345891+0000","last_active":"2024-08-18T22:32:35.327412+0000","last_peered":"2024-08-18T22:32:35.327412+0000","last_clean":"2024-08-18T22:32:35.327412+0000","last_became_active":"2024-08-18T22:32:34.345611+0000","last_became_peered":"2024-08-18T22:32:34.345611+0000","last_unstale":"2024-08-18T22:32:35.327412+0000","last_undegraded":"2024-08-18T22:32:35.327412+0000","last_fullsized":"2024-08-18T22:32:35.327412+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:35.954242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.329287+0000","last_change":"2024-08-18T22:32:34.339328+0000","last_active":"2024-08-18T22:32:35.329287+0000","last_peered":"2024-08-18T22:32:35.329287+0000","last_clean":"2024-08-18T22:32:35.329287+0000","last_became_active":"2024-08-18T22:32:34.338696+0000","last_became_peered":"2024-08-18T22:32:34.338696+0000","last_unstale":"2024-08-18T22:32:35.329287+0000","last_undegraded":"2024-08-18T22:32:35.329287+0000","last_fullsized":"2024-08-18T22:32:35.329287+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:24.885798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328352+0000","last_change":"2024-08-18T22:32:34.331458+0000","last_active":"2024-08-18T22:32:35.328352+0000","last_peered":"2024-08-18T22:32:35.328352+0000","last_clean":"2024-08-18T22:32:35.328352+0000","last_became_active":"2024-08-18T22:32:34.331049+0000","last_became_peered":"2024-08-18T22:32:34.331049+0000","last_unstale":"2024-08-18T22:32:35.328352+0000","last_undegraded":"2024-08-18T22:32:35.328352+0000","last_fullsized":"2024-08-18T22:32:35.328352+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:13:52.541926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321822+0000","last_change":"2024-08-18T22:32:34.342455+0000","last_active":"2024-08-18T22:32:35.321822+0000","last_peered":"2024-08-18T22:32:35.321822+0000","last_clean":"2024-08-18T22:32:35.321822+0000","last_became_active":"2024-08-18T22:32:34.341055+0000","last_became_peered":"2024-08-18T22:32:34.341055+0000","last_unstale":"2024-08-18T22:32:35.321822+0000","last_undegraded":"2024-08-18T22:32:35.321822+0000","last_fullsized":"2024-08-18T22:32:35.321822+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:17:35.154241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323984+0000","last_change":"2024-08-18T22:32:34.338117+0000","last_active":"2024-08-18T22:32:35.323984+0000","last_peered":"2024-08-18T22:32:35.323984+0000","last_clean":"2024-08-18T22:32:35.323984+0000","last_became_active":"2024-08-18T22:32:34.337781+0000","last_became_peered":"2024-08-18T22:32:34.337781+0000","last_unstale":"2024-08-18T22:32:35.323984+0000","last_undegraded":"2024-08-18T22:32:35.323984+0000","last_fullsized":"2024-08-18T22:32:35.323984+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:15.477308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322427+0000","last_change":"2024-08-18T22:32:34.329382+0000","last_active":"2024-08-18T22:32:35.322427+0000","last_peered":"2024-08-18T22:32:35.322427+0000","last_clean":"2024-08-18T22:32:35.322427+0000","last_became_active":"2024-08-18T22:32:34.329073+0000","last_became_peered":"2024-08-18T22:32:34.329073+0000","last_unstale":"2024-08-18T22:32:35.322427+0000","last_undegraded":"2024-08-18T22:32:35.322427+0000","last_fullsized":"2024-08-18T22:32:35.322427+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:24.885798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322388+0000","last_change":"2024-08-18T22:32:34.329457+0000","last_active":"2024-08-18T22:32:35.322388+0000","last_peered":"2024-08-18T22:32:35.322388+0000","last_clean":"2024-08-18T22:32:35.322388+0000","last_became_active":"2024-08-18T22:32:34.329151+0000","last_became_peered":"2024-08-18T22:32:34.329151+0000","last_unstale":"2024-08-18T22:32:35.322388+0000","last_undegraded":"2024-08-18T22:32:35.322388+0000","last_fullsized":"2024-08-18T22:32:35.322388+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:16.792889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328295+0000","last_change":"2024-08-18T22:32:34.344868+0000","last_active":"2024-08-18T22:32:35.328295+0000","last_peered":"2024-08-18T22:32:35.328295+0000","last_clean":"2024-08-18T22:32:35.328295+0000","last_became_active":"2024-08-18T22:32:34.344451+0000","last_became_peered":"2024-08-18T22:32:34.344451+0000","last_unstale":"2024-08-18T22:32:35.328295+0000","last_undegraded":"2024-08-18T22:32:35.328295+0000","last_fullsized":"2024-08-18T22:32:35.328295+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:05:37.628668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"190'4","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324141+0000","last_change":"2024-08-18T22:32:33.341792+0000","last_active":"2024-08-18T22:32:35.324141+0000","last_peered":"2024-08-18T22:32:35.324141+0000","last_clean":"2024-08-18T22:32:35.324141+0000","last_became_active":"2024-08-18T22:32:33.341460+0000","last_became_peered":"2024-08-18T22:32:33.341460+0000","last_unstale":"2024-08-18T22:32:35.324141+0000","last_undegraded":"2024-08-18T22:32:35.324141+0000","last_fullsized":"2024-08-18T22:32:35.324141+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:06.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.326790+0000","last_change":"2024-08-18T22:32:34.338871+0000","last_active":"2024-08-18T22:32:35.326790+0000","last_peered":"2024-08-18T22:32:35.326790+0000","last_clean":"2024-08-18T22:32:35.326790+0000","last_became_active":"2024-08-18T22:32:34.338186+0000","last_became_peered":"2024-08-18T22:32:34.338186+0000","last_unstale":"2024-08-18T22:32:35.326790+0000","last_undegraded":"2024-08-18T22:32:35.326790+0000","last_fullsized":"2024-08-18T22:32:35.326790+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:12.118210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327574+0000","last_change":"2024-08-18T22:32:33.337250+0000","last_active":"2024-08-18T22:32:35.327574+0000","last_peered":"2024-08-18T22:32:35.327574+0000","last_clean":"2024-08-18T22:32:35.327574+0000","last_became_active":"2024-08-18T22:32:33.336973+0000","last_became_peered":"2024-08-18T22:32:33.336973+0000","last_unstale":"2024-08-18T22:32:35.327574+0000","last_undegraded":"2024-08-18T22:32:35.327574+0000","last_fullsized":"2024-08-18T22:32:35.327574+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:59:20.935747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327665+0000","last_change":"2024-08-18T22:32:34.347018+0000","last_active":"2024-08-18T22:32:35.327665+0000","last_peered":"2024-08-18T22:32:35.327665+0000","last_clean":"2024-08-18T22:32:35.327665+0000","last_became_active":"2024-08-18T22:32:34.346461+0000","last_became_peered":"2024-08-18T22:32:34.346461+0000","last_unstale":"2024-08-18T22:32:35.327665+0000","last_undegraded":"2024-08-18T22:32:35.327665+0000","last_fullsized":"2024-08-18T22:32:35.327665+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:09:45.542989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328438+0000","last_change":"2024-08-18T22:32:33.333993+0000","last_active":"2024-08-18T22:32:35.328438+0000","last_peered":"2024-08-18T22:32:35.328438+0000","last_clean":"2024-08-18T22:32:35.328438+0000","last_became_active":"2024-08-18T22:32:33.333716+0000","last_became_peered":"2024-08-18T22:32:33.333716+0000","last_unstale":"2024-08-18T22:32:35.328438+0000","last_undegraded":"2024-08-18T22:32:35.328438+0000","last_fullsized":"2024-08-18T22:32:35.328438+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:17.964114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328002+0000","last_change":"2024-08-18T22:32:34.332282+0000","last_active":"2024-08-18T22:32:35.328002+0000","last_peered":"2024-08-18T22:32:35.328002+0000","last_clean":"2024-08-18T22:32:35.328002+0000","last_became_active":"2024-08-18T22:32:34.331745+0000","last_became_peered":"2024-08-18T22:32:34.331745+0000","last_unstale":"2024-08-18T22:32:35.328002+0000","last_undegraded":"2024-08-18T22:32:35.328002+0000","last_fullsized":"2024-08-18T22:32:35.328002+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:59.385206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322076+0000","last_change":"2024-08-18T22:32:33.342536+0000","last_active":"2024-08-18T22:32:35.322076+0000","last_peered":"2024-08-18T22:32:35.322076+0000","last_clean":"2024-08-18T22:32:35.322076+0000","last_became_active":"2024-08-18T22:32:33.341981+0000","last_became_peered":"2024-08-18T22:32:33.341981+0000","last_unstale":"2024-08-18T22:32:35.322076+0000","last_undegraded":"2024-08-18T22:32:35.322076+0000","last_fullsized":"2024-08-18T22:32:35.322076+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:51.209255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324119+0000","last_change":"2024-08-18T22:32:34.343058+0000","last_active":"2024-08-18T22:32:35.324119+0000","last_peered":"2024-08-18T22:32:35.324119+0000","last_clean":"2024-08-18T22:32:35.324119+0000","last_became_active":"2024-08-18T22:32:34.339495+0000","last_became_peered":"2024-08-18T22:32:34.339495+0000","last_unstale":"2024-08-18T22:32:35.324119+0000","last_undegraded":"2024-08-18T22:32:35.324119+0000","last_fullsized":"2024-08-18T22:32:35.324119+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:51:39.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322794+0000","last_change":"2024-08-18T22:32:33.339981+0000","last_active":"2024-08-18T22:32:35.322794+0000","last_peered":"2024-08-18T22:32:35.322794+0000","last_clean":"2024-08-18T22:32:35.322794+0000","last_became_active":"2024-08-18T22:32:33.338281+0000","last_became_peered":"2024-08-18T22:32:33.338281+0000","last_unstale":"2024-08-18T22:32:35.322794+0000","last_undegraded":"2024-08-18T22:32:35.322794+0000","last_fullsized":"2024-08-18T22:32:35.322794+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:00.572695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324121+0000","last_change":"2024-08-18T22:32:34.339553+0000","last_active":"2024-08-18T22:32:35.324121+0000","last_peered":"2024-08-18T22:32:35.324121+0000","last_clean":"2024-08-18T22:32:35.324121+0000","last_became_active":"2024-08-18T22:32:34.339281+0000","last_became_peered":"2024-08-18T22:32:34.339281+0000","last_unstale":"2024-08-18T22:32:35.324121+0000","last_undegraded":"2024-08-18T22:32:35.324121+0000","last_fullsized":"2024-08-18T22:32:35.324121+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:51.382957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322592+0000","last_change":"2024-08-18T22:32:33.338565+0000","last_active":"2024-08-18T22:32:35.322592+0000","last_peered":"2024-08-18T22:32:35.322592+0000","last_clean":"2024-08-18T22:32:35.322592+0000","last_became_active":"2024-08-18T22:32:33.338246+0000","last_became_peered":"2024-08-18T22:32:33.338246+0000","last_unstale":"2024-08-18T22:32:35.322592+0000","last_undegraded":"2024-08-18T22:32:35.322592+0000","last_fullsized":"2024-08-18T22:32:35.322592+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:43.240332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322442+0000","last_change":"2024-08-18T22:32:34.341819+0000","last_active":"2024-08-18T22:32:35.322442+0000","last_peered":"2024-08-18T22:32:35.322442+0000","last_clean":"2024-08-18T22:32:35.322442+0000","last_became_active":"2024-08-18T22:32:34.341185+0000","last_became_peered":"2024-08-18T22:32:34.341185+0000","last_unstale":"2024-08-18T22:32:35.322442+0000","last_undegraded":"2024-08-18T22:32:35.322442+0000","last_fullsized":"2024-08-18T22:32:35.322442+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:05:37.628668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328266+0000","last_change":"2024-08-18T22:32:33.332795+0000","last_active":"2024-08-18T22:32:35.328266+0000","last_peered":"2024-08-18T22:32:35.328266+0000","last_clean":"2024-08-18T22:32:35.328266+0000","last_became_active":"2024-08-18T22:32:33.332124+0000","last_became_peered":"2024-08-18T22:32:33.332124+0000","last_unstale":"2024-08-18T22:32:35.328266+0000","last_undegraded":"2024-08-18T22:32:35.328266+0000","last_fullsized":"2024-08-18T22:32:35.328266+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:43.240332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322954+0000","last_change":"2024-08-18T22:32:34.343093+0000","last_active":"2024-08-18T22:32:35.322954+0000","last_peered":"2024-08-18T22:32:35.322954+0000","last_clean":"2024-08-18T22:32:35.322954+0000","last_became_active":"2024-08-18T22:32:34.342837+0000","last_became_peered":"2024-08-18T22:32:34.342837+0000","last_unstale":"2024-08-18T22:32:35.322954+0000","last_undegraded":"2024-08-18T22:32:35.322954+0000","last_fullsized":"2024-08-18T22:32:35.322954+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:59.761456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328440+0000","last_change":"2024-08-18T22:32:33.342601+0000","last_active":"2024-08-18T22:32:35.328440+0000","last_peered":"2024-08-18T22:32:35.328440+0000","last_clean":"2024-08-18T22:32:35.328440+0000","last_became_active":"2024-08-18T22:32:33.342319+0000","last_became_peered":"2024-08-18T22:32:33.342319+0000","last_unstale":"2024-08-18T22:32:35.328440+0000","last_undegraded":"2024-08-18T22:32:35.328440+0000","last_fullsized":"2024-08-18T22:32:35.328440+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:44:05.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328435+0000","last_change":"2024-08-18T22:32:34.333157+0000","last_active":"2024-08-18T22:32:35.328435+0000","last_peered":"2024-08-18T22:32:35.328435+0000","last_clean":"2024-08-18T22:32:35.328435+0000","last_became_active":"2024-08-18T22:32:34.331651+0000","last_became_peered":"2024-08-18T22:32:34.331651+0000","last_unstale":"2024-08-18T22:32:35.328435+0000","last_undegraded":"2024-08-18T22:32:35.328435+0000","last_fullsized":"2024-08-18T22:32:35.328435+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:18.003655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323508+0000","last_change":"2024-08-18T22:32:33.339791+0000","last_active":"2024-08-18T22:32:35.323508+0000","last_peered":"2024-08-18T22:32:35.323508+0000","last_clean":"2024-08-18T22:32:35.323508+0000","last_became_active":"2024-08-18T22:32:33.339512+0000","last_became_peered":"2024-08-18T22:32:33.339512+0000","last_unstale":"2024-08-18T22:32:35.323508+0000","last_undegraded":"2024-08-18T22:32:35.323508+0000","last_fullsized":"2024-08-18T22:32:35.323508+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:39.897815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321876+0000","last_change":"2024-08-18T22:32:34.348924+0000","last_active":"2024-08-18T22:32:35.321876+0000","last_peered":"2024-08-18T22:32:35.321876+0000","last_clean":"2024-08-18T22:32:35.321876+0000","last_became_active":"2024-08-18T22:32:34.348652+0000","last_became_peered":"2024-08-18T22:32:34.348652+0000","last_unstale":"2024-08-18T22:32:35.321876+0000","last_undegraded":"2024-08-18T22:32:35.321876+0000","last_fullsized":"2024-08-18T22:32:35.321876+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:11.331050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"190'3","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321982+0000","last_change":"2024-08-18T22:32:33.335980+0000","last_active":"2024-08-18T22:32:35.321982+0000","last_peered":"2024-08-18T22:32:35.321982+0000","last_clean":"2024-08-18T22:32:35.321982+0000","last_became_active":"2024-08-18T22:32:33.334645+0000","last_became_peered":"2024-08-18T22:32:33.334645+0000","last_unstale":"2024-08-18T22:32:35.321982+0000","last_undegraded":"2024-08-18T22:32:35.321982+0000","last_fullsized":"2024-08-18T22:32:35.321982+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:46.471511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328147+0000","last_change":"2024-08-18T22:32:34.338668+0000","last_active":"2024-08-18T22:32:35.328147+0000","last_peered":"2024-08-18T22:32:35.328147+0000","last_clean":"2024-08-18T22:32:35.328147+0000","last_became_active":"2024-08-18T22:32:34.338385+0000","last_became_peered":"2024-08-18T22:32:34.338385+0000","last_unstale":"2024-08-18T22:32:35.328147+0000","last_undegraded":"2024-08-18T22:32:35.328147+0000","last_fullsized":"2024-08-18T22:32:35.328147+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:53:41.464541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"190'6","reported_seq":20,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323372+0000","last_change":"2024-08-18T22:32:33.334598+0000","last_active":"2024-08-18T22:32:35.323372+0000","last_peered":"2024-08-18T22:32:35.323372+0000","last_clean":"2024-08-18T22:32:35.323372+0000","last_became_active":"2024-08-18T22:32:33.334298+0000","last_became_peered":"2024-08-18T22:32:33.334298+0000","last_unstale":"2024-08-18T22:32:35.323372+0000","last_undegraded":"2024-08-18T22:32:35.323372+0000","last_fullsized":"2024-08-18T22:32:35.323372+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:31.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328060+0000","last_change":"2024-08-18T22:32:34.331853+0000","last_active":"2024-08-18T22:32:35.328060+0000","last_peered":"2024-08-18T22:32:35.328060+0000","last_clean":"2024-08-18T22:32:35.328060+0000","last_became_active":"2024-08-18T22:32:34.331022+0000","last_became_peered":"2024-08-18T22:32:34.331022+0000","last_unstale":"2024-08-18T22:32:35.328060+0000","last_undegraded":"2024-08-18T22:32:35.328060+0000","last_fullsized":"2024-08-18T22:32:35.328060+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:18.511009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327856+0000","last_change":"2024-08-18T22:32:33.340299+0000","last_active":"2024-08-18T22:32:35.327856+0000","last_peered":"2024-08-18T22:32:35.327856+0000","last_clean":"2024-08-18T22:32:35.327856+0000","last_became_active":"2024-08-18T22:32:33.340027+0000","last_became_peered":"2024-08-18T22:32:33.340027+0000","last_unstale":"2024-08-18T22:32:35.327856+0000","last_undegraded":"2024-08-18T22:32:35.327856+0000","last_fullsized":"2024-08-18T22:32:35.327856+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:16.550784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.329446+0000","last_change":"2024-08-18T22:32:34.346500+0000","last_active":"2024-08-18T22:32:35.329446+0000","last_peered":"2024-08-18T22:32:35.329446+0000","last_clean":"2024-08-18T22:32:35.329446+0000","last_became_active":"2024-08-18T22:32:34.346200+0000","last_became_peered":"2024-08-18T22:32:34.346200+0000","last_unstale":"2024-08-18T22:32:35.329446+0000","last_undegraded":"2024-08-18T22:32:35.329446+0000","last_fullsized":"2024-08-18T22:32:35.329446+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:00.847302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328840+0000","last_change":"2024-08-18T22:32:33.331475+0000","last_active":"2024-08-18T22:32:35.328840+0000","last_peered":"2024-08-18T22:32:35.328840+0000","last_clean":"2024-08-18T22:32:35.328840+0000","last_became_active":"2024-08-18T22:32:33.331157+0000","last_became_peered":"2024-08-18T22:32:33.331157+0000","last_unstale":"2024-08-18T22:32:35.328840+0000","last_undegraded":"2024-08-18T22:32:35.328840+0000","last_fullsized":"2024-08-18T22:32:35.328840+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:00.572695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322122+0000","last_change":"2024-08-18T22:32:34.341847+0000","last_active":"2024-08-18T22:32:35.322122+0000","last_peered":"2024-08-18T22:32:35.322122+0000","last_clean":"2024-08-18T22:32:35.322122+0000","last_became_active":"2024-08-18T22:32:34.341160+0000","last_became_peered":"2024-08-18T22:32:34.341160+0000","last_unstale":"2024-08-18T22:32:35.322122+0000","last_undegraded":"2024-08-18T22:32:35.322122+0000","last_fullsized":"2024-08-18T22:32:35.322122+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:14:44.383553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321675+0000","last_change":"2024-08-18T22:32:33.340757+0000","last_active":"2024-08-18T22:32:35.321675+0000","last_peered":"2024-08-18T22:32:35.321675+0000","last_clean":"2024-08-18T22:32:35.321675+0000","last_became_active":"2024-08-18T22:32:33.340260+0000","last_became_peered":"2024-08-18T22:32:33.340260+0000","last_unstale":"2024-08-18T22:32:35.321675+0000","last_undegraded":"2024-08-18T22:32:35.321675+0000","last_fullsized":"2024-08-18T22:32:35.321675+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:27:44.140250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323191+0000","last_change":"2024-08-18T22:32:34.346997+0000","last_active":"2024-08-18T22:32:35.323191+0000","last_peered":"2024-08-18T22:32:35.323191+0000","last_clean":"2024-08-18T22:32:35.323191+0000","last_became_active":"2024-08-18T22:32:34.342377+0000","last_became_peered":"2024-08-18T22:32:34.342377+0000","last_unstale":"2024-08-18T22:32:35.323191+0000","last_undegraded":"2024-08-18T22:32:35.323191+0000","last_fullsized":"2024-08-18T22:32:35.323191+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:00.847302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"190'8","reported_seq":22,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327742+0000","last_change":"2024-08-18T22:32:33.335461+0000","last_active":"2024-08-18T22:32:35.327742+0000","last_peered":"2024-08-18T22:32:35.327742+0000","last_clean":"2024-08-18T22:32:35.327742+0000","last_became_active":"2024-08-18T22:32:33.333576+0000","last_became_peered":"2024-08-18T22:32:33.333576+0000","last_unstale":"2024-08-18T22:32:35.327742+0000","last_undegraded":"2024-08-18T22:32:35.327742+0000","last_fullsized":"2024-08-18T22:32:35.327742+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:20:29.913730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327129+0000","last_change":"2024-08-18T22:32:34.333457+0000","last_active":"2024-08-18T22:32:35.327129+0000","last_peered":"2024-08-18T22:32:35.327129+0000","last_clean":"2024-08-18T22:32:35.327129+0000","last_became_active":"2024-08-18T22:32:34.333172+0000","last_became_peered":"2024-08-18T22:32:34.333172+0000","last_unstale":"2024-08-18T22:32:35.327129+0000","last_undegraded":"2024-08-18T22:32:35.327129+0000","last_fullsized":"2024-08-18T22:32:35.327129+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:42:28.194406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327785+0000","last_change":"2024-08-18T22:32:33.343063+0000","last_active":"2024-08-18T22:32:35.327785+0000","last_peered":"2024-08-18T22:32:35.327785+0000","last_clean":"2024-08-18T22:32:35.327785+0000","last_became_active":"2024-08-18T22:32:33.342745+0000","last_became_peered":"2024-08-18T22:32:33.342745+0000","last_unstale":"2024-08-18T22:32:35.327785+0000","last_undegraded":"2024-08-18T22:32:35.327785+0000","last_fullsized":"2024-08-18T22:32:35.327785+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:43.240332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327007+0000","last_change":"2024-08-18T22:32:34.345166+0000","last_active":"2024-08-18T22:32:35.327007+0000","last_peered":"2024-08-18T22:32:35.327007+0000","last_clean":"2024-08-18T22:32:35.327007+0000","last_became_active":"2024-08-18T22:32:34.344480+0000","last_became_peered":"2024-08-18T22:32:34.344480+0000","last_unstale":"2024-08-18T22:32:35.327007+0000","last_undegraded":"2024-08-18T22:32:35.327007+0000","last_fullsized":"2024-08-18T22:32:35.327007+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:58:37.010566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327582+0000","last_change":"2024-08-18T22:32:33.344896+0000","last_active":"2024-08-18T22:32:35.327582+0000","last_peered":"2024-08-18T22:32:35.327582+0000","last_clean":"2024-08-18T22:32:35.327582+0000","last_became_active":"2024-08-18T22:32:33.344602+0000","last_became_peered":"2024-08-18T22:32:33.344602+0000","last_unstale":"2024-08-18T22:32:35.327582+0000","last_undegraded":"2024-08-18T22:32:35.327582+0000","last_fullsized":"2024-08-18T22:32:35.327582+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:17.426503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328129+0000","last_change":"2024-08-18T22:32:34.345926+0000","last_active":"2024-08-18T22:32:35.328129+0000","last_peered":"2024-08-18T22:32:35.328129+0000","last_clean":"2024-08-18T22:32:35.328129+0000","last_became_active":"2024-08-18T22:32:34.345182+0000","last_became_peered":"2024-08-18T22:32:34.345182+0000","last_unstale":"2024-08-18T22:32:35.328129+0000","last_undegraded":"2024-08-18T22:32:35.328129+0000","last_fullsized":"2024-08-18T22:32:35.328129+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:18.003655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328538+0000","last_change":"2024-08-18T22:32:33.337911+0000","last_active":"2024-08-18T22:32:35.328538+0000","last_peered":"2024-08-18T22:32:35.328538+0000","last_clean":"2024-08-18T22:32:35.328538+0000","last_became_active":"2024-08-18T22:32:33.337622+0000","last_became_peered":"2024-08-18T22:32:33.337622+0000","last_unstale":"2024-08-18T22:32:35.328538+0000","last_undegraded":"2024-08-18T22:32:35.328538+0000","last_fullsized":"2024-08-18T22:32:35.328538+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:07.505012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327570+0000","last_change":"2024-08-18T22:32:34.348913+0000","last_active":"2024-08-18T22:32:35.327570+0000","last_peered":"2024-08-18T22:32:35.327570+0000","last_clean":"2024-08-18T22:32:35.327570+0000","last_became_active":"2024-08-18T22:32:34.348255+0000","last_became_peered":"2024-08-18T22:32:34.348255+0000","last_unstale":"2024-08-18T22:32:35.327570+0000","last_undegraded":"2024-08-18T22:32:35.327570+0000","last_fullsized":"2024-08-18T22:32:35.327570+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:21:38.110618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328380+0000","last_change":"2024-08-18T22:32:33.341287+0000","last_active":"2024-08-18T22:32:35.328380+0000","last_peered":"2024-08-18T22:32:35.328380+0000","last_clean":"2024-08-18T22:32:35.328380+0000","last_became_active":"2024-08-18T22:32:33.340919+0000","last_became_peered":"2024-08-18T22:32:33.340919+0000","last_unstale":"2024-08-18T22:32:35.328380+0000","last_undegraded":"2024-08-18T22:32:35.328380+0000","last_fullsized":"2024-08-18T22:32:35.328380+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:08:07.407708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328190+0000","last_change":"2024-08-18T22:32:34.328476+0000","last_active":"2024-08-18T22:32:35.328190+0000","last_peered":"2024-08-18T22:32:35.328190+0000","last_clean":"2024-08-18T22:32:35.328190+0000","last_became_active":"2024-08-18T22:32:34.328194+0000","last_became_peered":"2024-08-18T22:32:34.328194+0000","last_unstale":"2024-08-18T22:32:35.328190+0000","last_undegraded":"2024-08-18T22:32:35.328190+0000","last_fullsized":"2024-08-18T22:32:35.328190+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:25.437503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328253+0000","last_change":"2024-08-18T22:32:33.334444+0000","last_active":"2024-08-18T22:32:35.328253+0000","last_peered":"2024-08-18T22:32:35.328253+0000","last_clean":"2024-08-18T22:32:35.328253+0000","last_became_active":"2024-08-18T22:32:33.334157+0000","last_became_peered":"2024-08-18T22:32:33.334157+0000","last_unstale":"2024-08-18T22:32:35.328253+0000","last_undegraded":"2024-08-18T22:32:35.328253+0000","last_fullsized":"2024-08-18T22:32:35.328253+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:57.349272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323439+0000","last_change":"2024-08-18T22:32:34.335815+0000","last_active":"2024-08-18T22:32:35.323439+0000","last_peered":"2024-08-18T22:32:35.323439+0000","last_clean":"2024-08-18T22:32:35.323439+0000","last_became_active":"2024-08-18T22:32:34.335544+0000","last_became_peered":"2024-08-18T22:32:34.335544+0000","last_unstale":"2024-08-18T22:32:35.323439+0000","last_undegraded":"2024-08-18T22:32:35.323439+0000","last_fullsized":"2024-08-18T22:32:35.323439+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:48:35.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327855+0000","last_change":"2024-08-18T22:32:33.334916+0000","last_active":"2024-08-18T22:32:35.327855+0000","last_peered":"2024-08-18T22:32:35.327855+0000","last_clean":"2024-08-18T22:32:35.327855+0000","last_became_active":"2024-08-18T22:32:33.334646+0000","last_became_peered":"2024-08-18T22:32:33.334646+0000","last_unstale":"2024-08-18T22:32:35.327855+0000","last_undegraded":"2024-08-18T22:32:35.327855+0000","last_fullsized":"2024-08-18T22:32:35.327855+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:17:34.145619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322261+0000","last_change":"2024-08-18T22:32:34.340835+0000","last_active":"2024-08-18T22:32:35.322261+0000","last_peered":"2024-08-18T22:32:35.322261+0000","last_clean":"2024-08-18T22:32:35.322261+0000","last_became_active":"2024-08-18T22:32:34.337569+0000","last_became_peered":"2024-08-18T22:32:34.337569+0000","last_unstale":"2024-08-18T22:32:35.322261+0000","last_undegraded":"2024-08-18T22:32:35.322261+0000","last_fullsized":"2024-08-18T22:32:35.322261+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:18.511009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324009+0000","last_change":"2024-08-18T22:32:33.341713+0000","last_active":"2024-08-18T22:32:35.324009+0000","last_peered":"2024-08-18T22:32:35.324009+0000","last_clean":"2024-08-18T22:32:35.324009+0000","last_became_active":"2024-08-18T22:32:33.341422+0000","last_became_peered":"2024-08-18T22:32:33.341422+0000","last_unstale":"2024-08-18T22:32:35.324009+0000","last_undegraded":"2024-08-18T22:32:35.324009+0000","last_fullsized":"2024-08-18T22:32:35.324009+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:15.668948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328409+0000","last_change":"2024-08-18T22:32:34.345983+0000","last_active":"2024-08-18T22:32:35.328409+0000","last_peered":"2024-08-18T22:32:35.328409+0000","last_clean":"2024-08-18T22:32:35.328409+0000","last_became_active":"2024-08-18T22:32:34.345419+0000","last_became_peered":"2024-08-18T22:32:34.345419+0000","last_unstale":"2024-08-18T22:32:35.328409+0000","last_undegraded":"2024-08-18T22:32:35.328409+0000","last_fullsized":"2024-08-18T22:32:35.328409+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:53.300455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.326780+0000","last_change":"2024-08-18T22:32:33.342210+0000","last_active":"2024-08-18T22:32:35.326780+0000","last_peered":"2024-08-18T22:32:35.326780+0000","last_clean":"2024-08-18T22:32:35.326780+0000","last_became_active":"2024-08-18T22:32:33.341921+0000","last_became_peered":"2024-08-18T22:32:33.341921+0000","last_unstale":"2024-08-18T22:32:35.326780+0000","last_undegraded":"2024-08-18T22:32:35.326780+0000","last_fullsized":"2024-08-18T22:32:35.326780+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:42:24.770725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327293+0000","last_change":"2024-08-18T22:32:34.335949+0000","last_active":"2024-08-18T22:32:35.327293+0000","last_peered":"2024-08-18T22:32:35.327293+0000","last_clean":"2024-08-18T22:32:35.327293+0000","last_became_active":"2024-08-18T22:32:34.335662+0000","last_became_peered":"2024-08-18T22:32:34.335662+0000","last_unstale":"2024-08-18T22:32:35.327293+0000","last_undegraded":"2024-08-18T22:32:35.327293+0000","last_fullsized":"2024-08-18T22:32:35.327293+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:24:12.937355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322469+0000","last_change":"2024-08-18T22:32:33.332550+0000","last_active":"2024-08-18T22:32:35.322469+0000","last_peered":"2024-08-18T22:32:35.322469+0000","last_clean":"2024-08-18T22:32:35.322469+0000","last_became_active":"2024-08-18T22:32:33.332177+0000","last_became_peered":"2024-08-18T22:32:33.332177+0000","last_unstale":"2024-08-18T22:32:35.322469+0000","last_undegraded":"2024-08-18T22:32:35.322469+0000","last_fullsized":"2024-08-18T22:32:35.322469+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:52:51.741515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328654+0000","last_change":"2024-08-18T22:32:34.335836+0000","last_active":"2024-08-18T22:32:35.328654+0000","last_peered":"2024-08-18T22:32:35.328654+0000","last_clean":"2024-08-18T22:32:35.328654+0000","last_became_active":"2024-08-18T22:32:34.335560+0000","last_became_peered":"2024-08-18T22:32:34.335560+0000","last_unstale":"2024-08-18T22:32:35.328654+0000","last_undegraded":"2024-08-18T22:32:35.328654+0000","last_fullsized":"2024-08-18T22:32:35.328654+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:42:49.486657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"191'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328021+0000","last_change":"2024-08-18T22:32:33.333264+0000","last_active":"2024-08-18T22:32:35.328021+0000","last_peered":"2024-08-18T22:32:35.328021+0000","last_clean":"2024-08-18T22:32:35.328021+0000","last_became_active":"2024-08-18T22:32:33.332744+0000","last_became_peered":"2024-08-18T22:32:33.332744+0000","last_unstale":"2024-08-18T22:32:35.328021+0000","last_undegraded":"2024-08-18T22:32:35.328021+0000","last_fullsized":"2024-08-18T22:32:35.328021+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:27.323951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321877+0000","last_change":"2024-08-18T22:32:34.347178+0000","last_active":"2024-08-18T22:32:35.321877+0000","last_peered":"2024-08-18T22:32:35.321877+0000","last_clean":"2024-08-18T22:32:35.321877+0000","last_became_active":"2024-08-18T22:32:34.346845+0000","last_became_peered":"2024-08-18T22:32:34.346845+0000","last_unstale":"2024-08-18T22:32:35.321877+0000","last_undegraded":"2024-08-18T22:32:35.321877+0000","last_fullsized":"2024-08-18T22:32:35.321877+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:45:52.001371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323956+0000","last_change":"2024-08-18T22:32:33.339203+0000","last_active":"2024-08-18T22:32:35.323956+0000","last_peered":"2024-08-18T22:32:35.323956+0000","last_clean":"2024-08-18T22:32:35.323956+0000","last_became_active":"2024-08-18T22:32:33.338874+0000","last_became_peered":"2024-08-18T22:32:33.338874+0000","last_unstale":"2024-08-18T22:32:35.323956+0000","last_undegraded":"2024-08-18T22:32:35.323956+0000","last_fullsized":"2024-08-18T22:32:35.323956+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:22.210202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327099+0000","last_change":"2024-08-18T22:32:34.341494+0000","last_active":"2024-08-18T22:32:35.327099+0000","last_peered":"2024-08-18T22:32:35.327099+0000","last_clean":"2024-08-18T22:32:35.327099+0000","last_became_active":"2024-08-18T22:32:34.341199+0000","last_became_peered":"2024-08-18T22:32:34.341199+0000","last_unstale":"2024-08-18T22:32:35.327099+0000","last_undegraded":"2024-08-18T22:32:35.327099+0000","last_fullsized":"2024-08-18T22:32:35.327099+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:40:03.822721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327092+0000","last_change":"2024-08-18T22:32:33.344244+0000","last_active":"2024-08-18T22:32:35.327092+0000","last_peered":"2024-08-18T22:32:35.327092+0000","last_clean":"2024-08-18T22:32:35.327092+0000","last_became_active":"2024-08-18T22:32:33.340454+0000","last_became_peered":"2024-08-18T22:32:33.340454+0000","last_unstale":"2024-08-18T22:32:35.327092+0000","last_undegraded":"2024-08-18T22:32:35.327092+0000","last_fullsized":"2024-08-18T22:32:35.327092+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:36.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327924+0000","last_change":"2024-08-18T22:32:34.345237+0000","last_active":"2024-08-18T22:32:35.327924+0000","last_peered":"2024-08-18T22:32:35.327924+0000","last_clean":"2024-08-18T22:32:35.327924+0000","last_became_active":"2024-08-18T22:32:34.344918+0000","last_became_peered":"2024-08-18T22:32:34.344918+0000","last_unstale":"2024-08-18T22:32:35.327924+0000","last_undegraded":"2024-08-18T22:32:35.327924+0000","last_fullsized":"2024-08-18T22:32:35.327924+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:40.187295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327680+0000","last_change":"2024-08-18T22:32:33.336637+0000","last_active":"2024-08-18T22:32:35.327680+0000","last_peered":"2024-08-18T22:32:35.327680+0000","last_clean":"2024-08-18T22:32:35.327680+0000","last_became_active":"2024-08-18T22:32:33.336352+0000","last_became_peered":"2024-08-18T22:32:33.336352+0000","last_unstale":"2024-08-18T22:32:35.327680+0000","last_undegraded":"2024-08-18T22:32:35.327680+0000","last_fullsized":"2024-08-18T22:32:35.327680+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:52:17.548215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323611+0000","last_change":"2024-08-18T22:32:34.331651+0000","last_active":"2024-08-18T22:32:35.323611+0000","last_peered":"2024-08-18T22:32:35.323611+0000","last_clean":"2024-08-18T22:32:35.323611+0000","last_became_active":"2024-08-18T22:32:34.331317+0000","last_became_peered":"2024-08-18T22:32:34.331317+0000","last_unstale":"2024-08-18T22:32:35.323611+0000","last_undegraded":"2024-08-18T22:32:35.323611+0000","last_fullsized":"2024-08-18T22:32:35.323611+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:33:52.422831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322118+0000","last_change":"2024-08-18T22:32:33.338065+0000","last_active":"2024-08-18T22:32:35.322118+0000","last_peered":"2024-08-18T22:32:35.322118+0000","last_clean":"2024-08-18T22:32:35.322118+0000","last_became_active":"2024-08-18T22:32:33.337556+0000","last_became_peered":"2024-08-18T22:32:33.337556+0000","last_unstale":"2024-08-18T22:32:35.322118+0000","last_undegraded":"2024-08-18T22:32:35.322118+0000","last_fullsized":"2024-08-18T22:32:35.322118+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:18.195346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323486+0000","last_change":"2024-08-18T22:32:34.332570+0000","last_active":"2024-08-18T22:32:35.323486+0000","last_peered":"2024-08-18T22:32:35.323486+0000","last_clean":"2024-08-18T22:32:35.323486+0000","last_became_active":"2024-08-18T22:32:34.332275+0000","last_became_peered":"2024-08-18T22:32:34.332275+0000","last_unstale":"2024-08-18T22:32:35.323486+0000","last_undegraded":"2024-08-18T22:32:35.323486+0000","last_fullsized":"2024-08-18T22:32:35.323486+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:15:22.060471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327112+0000","last_change":"2024-08-18T22:32:33.343854+0000","last_active":"2024-08-18T22:32:35.327112+0000","last_peered":"2024-08-18T22:32:35.327112+0000","last_clean":"2024-08-18T22:32:35.327112+0000","last_became_active":"2024-08-18T22:32:33.342459+0000","last_became_peered":"2024-08-18T22:32:33.342459+0000","last_unstale":"2024-08-18T22:32:35.327112+0000","last_undegraded":"2024-08-18T22:32:35.327112+0000","last_fullsized":"2024-08-18T22:32:35.327112+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:36.017821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.329418+0000","last_change":"2024-08-18T22:32:34.340906+0000","last_active":"2024-08-18T22:32:35.329418+0000","last_peered":"2024-08-18T22:32:35.329418+0000","last_clean":"2024-08-18T22:32:35.329418+0000","last_became_active":"2024-08-18T22:32:34.340653+0000","last_became_peered":"2024-08-18T22:32:34.340653+0000","last_unstale":"2024-08-18T22:32:35.329418+0000","last_undegraded":"2024-08-18T22:32:35.329418+0000","last_fullsized":"2024-08-18T22:32:35.329418+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:01:25.687333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327687+0000","last_change":"2024-08-18T22:32:33.336271+0000","last_active":"2024-08-18T22:32:35.327687+0000","last_peered":"2024-08-18T22:32:35.327687+0000","last_clean":"2024-08-18T22:32:35.327687+0000","last_became_active":"2024-08-18T22:32:33.335793+0000","last_became_peered":"2024-08-18T22:32:33.335793+0000","last_unstale":"2024-08-18T22:32:35.327687+0000","last_undegraded":"2024-08-18T22:32:35.327687+0000","last_fullsized":"2024-08-18T22:32:35.327687+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:09.734094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327417+0000","last_change":"2024-08-18T22:32:34.347343+0000","last_active":"2024-08-18T22:32:35.327417+0000","last_peered":"2024-08-18T22:32:35.327417+0000","last_clean":"2024-08-18T22:32:35.327417+0000","last_became_active":"2024-08-18T22:32:34.347058+0000","last_became_peered":"2024-08-18T22:32:34.347058+0000","last_unstale":"2024-08-18T22:32:35.327417+0000","last_undegraded":"2024-08-18T22:32:35.327417+0000","last_fullsized":"2024-08-18T22:32:35.327417+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:41.816032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321993+0000","last_change":"2024-08-18T22:32:33.335923+0000","last_active":"2024-08-18T22:32:35.321993+0000","last_peered":"2024-08-18T22:32:35.321993+0000","last_clean":"2024-08-18T22:32:35.321993+0000","last_became_active":"2024-08-18T22:32:33.335475+0000","last_became_peered":"2024-08-18T22:32:33.335475+0000","last_unstale":"2024-08-18T22:32:35.321993+0000","last_undegraded":"2024-08-18T22:32:35.321993+0000","last_fullsized":"2024-08-18T22:32:35.321993+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:40.265453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":516,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322400+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:32:35.322400+0000","last_peered":"2024-08-18T22:32:35.322400+0000","last_clean":"2024-08-18T22:32:35.322400+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:32:35.322400+0000","last_undegraded":"2024-08-18T22:32:35.322400+0000","last_fullsized":"2024-08-18T22:32:35.322400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509605,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52176,"kb_used_data":2940,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319664,"statfs":{"total":96636764160,"available":96583335936,"internally_reserved":0,"allocated":3010560,"data_stored":1727374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509607,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51592,"kb_used_data":2360,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320248,"statfs":{"total":96636764160,"available":96583933952,"internally_reserved":0,"allocated":2416640,"data_stored":1137518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509605,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51580,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320260,"statfs":{"total":96636764160,"available":96583946240,"internally_reserved":0,"allocated":2408448,"data_stored":1135380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509606,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47432,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324408,"statfs":{"total":96636764160,"available":96588193792,"internally_reserved":0,"allocated":2412544,"data_stored":1135450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509605,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47420,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324420,"statfs":{"total":96636764160,"available":96588206080,"internally_reserved":0,"allocated":2400256,"data_stored":1135324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509606,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60484,"kb_used_data":2928,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311356,"statfs":{"total":96636764160,"available":96574828544,"internally_reserved":0,"allocated":2998272,"data_stored":1725782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59900,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311940,"statfs":{"total":96636764160,"available":96575426560,"internally_reserved":0,"allocated":2404352,"data_stored":1135906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575013,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59888,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311952,"statfs":{"total":96636764160,"available":96575438848,"internally_reserved":0,"allocated":2392064,"data_stored":1128722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:32:43.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:32:43.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ecbc00640 1 Processor -- start 2024-08-18T22:32:43.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ecbc00640 1 -- start start 2024-08-18T22:32:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ecbc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ec4162450 0x7f2ec40ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ecbc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 0x7f2ec40cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ecbc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec406f990 con 0x7f2ec4162830 2024-08-18T22:32:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ecbc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec40cdfb0 con 0x7f2ec4162450 2024-08-18T22:32:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ecbc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec40cdc80 con 0x7f2ec40cef10 2024-08-18T22:32:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ec9200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ec4162450 0x7f2ec40ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ec3e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2ec4162830 0x7f2ec40cc1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49184/0 (socket says 172.21.15.5:49184) 2024-08-18T22:32:43.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ec3e00640 1 -- 172.21.15.5:0/3712862290 learned_addr learned my addr 172.21.15.5:0/3712862290 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ec9200640 1 -- 172.21.15.5:0/3712862290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 msgr2=0x7f2ec40cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ec9c00640 1 --2- 172.21.15.5:0/3712862290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 0x7f2ec40cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ec3400640 1 -- 172.21.15.5:0/3712862290 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889803829 0 0) 0x7f2eb0001120 con 0x7f2ec4162830 2024-08-18T22:32:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ec9200640 1 --2- 172.21.15.5:0/3712862290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 0x7f2ec40cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ec9200640 1 -- 172.21.15.5:0/3712862290 >> v1:172.21.15.5:6789/0 conn(0x7f2ec4162830 legacy=0x7f2ec40cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ec9200640 1 -- 172.21.15.5:0/3712862290 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec40ca6e0 con 0x7f2ec4162450 2024-08-18T22:32:43.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.218+0000 7f2ec9c00640 1 --2- 172.21.15.5:0/3712862290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 0x7f2ec40cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:43.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ec9200640 1 --2- 172.21.15.5:0/3712862290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ec4162450 0x7f2ec40ce440 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80097c0 tx=0x7f2eb801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944126193156737d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:43.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ec3400640 1 -- 172.21.15.5:0/3712862290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80b0070 con 0x7f2ec4162450 2024-08-18T22:32:43.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ec3400640 1 -- 172.21.15.5:0/3712862290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb80ab600 con 0x7f2ec4162450 2024-08-18T22:32:43.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ec3400640 1 -- 172.21.15.5:0/3712862290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80ab9d0 con 0x7f2ec4162450 2024-08-18T22:32:43.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ecbc00640 1 -- 172.21.15.5:0/3712862290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ec4162450 msgr2=0x7f2ec40ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ecbc00640 1 --2- 172.21.15.5:0/3712862290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ec4162450 0x7f2ec40ce440 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80097c0 tx=0x7f2eb801c410 comp rx=0 tx=0).stop 2024-08-18T22:32:43.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ecbc00640 1 -- 172.21.15.5:0/3712862290 shutdown_connections 2024-08-18T22:32:43.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ecbc00640 1 --2- 172.21.15.5:0/3712862290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 0x7f2ec40cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ecbc00640 1 --2- 172.21.15.5:0/3712862290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ec4162450 0x7f2ec40ce440 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ecbc00640 1 -- 172.21.15.5:0/3712862290 >> 172.21.15.5:0/3712862290 conn(0x7f2ec40b1c50 msgr2=0x7f2ec40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:43.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ecbc00640 1 -- 172.21.15.5:0/3712862290 shutdown_connections 2024-08-18T22:32:43.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.222+0000 7f2ecbc00640 1 -- 172.21.15.5:0/3712862290 wait complete. 2024-08-18T22:32:43.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ecbc00640 1 Processor -- start 2024-08-18T22:32:43.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ecbc00640 1 -- start start 2024-08-18T22:32:43.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ecbc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 0x7f2ec40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ecbc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec4162450 0x7f2ec41590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ecbc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ec4162830 0x7f2ec415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ecbc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec4166b40 con 0x7f2ec4162830 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ecbc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec41669c0 con 0x7f2ec4162450 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ecbc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec4166cc0 con 0x7f2ec40cef10 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec9c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ec4162830 0x7f2ec415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec9c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ec4162830 0x7f2ec415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46948/0 (socket says 172.21.15.5:46948) 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec9c00640 1 -- 172.21.15.5:0/4034730098 learned_addr learned my addr 172.21.15.5:0/4034730098 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec9200640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 0x7f2ec40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec3e00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec4162450 0x7f2ec41590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec9c00640 1 -- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 msgr2=0x7f2ec40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec9c00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 0x7f2ec40b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec9c00640 1 -- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec4162450 msgr2=0x7f2ec41590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec9c00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec4162450 0x7f2ec41590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec9c00640 1 -- 172.21.15.5:0/4034730098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec415c6e0 con 0x7f2ec4162830 2024-08-18T22:32:43.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec3e00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec4162450 0x7f2ec41590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:43.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec9200640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 0x7f2ec40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:43.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec9c00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ec4162830 0x7f2ec415d460 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00cef0 tx=0x7f2ebc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:43.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec0c00640 1 -- 172.21.15.5:0/4034730098 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc01a070 con 0x7f2ec4162830 2024-08-18T22:32:43.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec0c00640 1 -- 172.21.15.5:0/4034730098 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc00d860 con 0x7f2ec4162830 2024-08-18T22:32:43.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ecbc00640 1 -- 172.21.15.5:0/4034730098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec415c980 con 0x7f2ec4162830 2024-08-18T22:32:43.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ec0c00640 1 -- 172.21.15.5:0/4034730098 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00dc50 con 0x7f2ec4162830 2024-08-18T22:32:43.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ecbc00640 1 -- 172.21.15.5:0/4034730098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec415cf40 con 0x7f2ec4162830 2024-08-18T22:32:43.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.226+0000 7f2ecbc00640 1 -- 172.21.15.5:0/4034730098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec41547d0 con 0x7f2ec4162830 2024-08-18T22:32:43.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.230+0000 7f2ec0c00640 1 -- 172.21.15.5:0/4034730098 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ebc01d070 con 0x7f2ec4162830 2024-08-18T22:32:43.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.230+0000 7f2ec0c00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2ea40678c0 0x7f2ea4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.230+0000 7f2ec0c00640 1 -- 172.21.15.5:0/4034730098 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f2ebc0866f0 con 0x7f2ec4162830 2024-08-18T22:32:43.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.230+0000 7f2ec9200640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2ea40678c0 0x7f2ea4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.230+0000 7f2ec9200640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2ea40678c0 0x7f2ea4069d80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80ad000 tx=0x7f2eb80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:43.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.234+0000 7f2ec0c00640 1 -- 172.21.15.5:0/4034730098 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2ebc057150 con 0x7f2ec4162830 2024-08-18T22:32:43.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.398+0000 7f2ecbc00640 1 -- 172.21.15.5:0/4034730098 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ec406f290 con 0x7f2ea40678c0 2024-08-18T22:32:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.402+0000 7f2ec0c00640 1 -- 172.21.15.5:0/4034730098 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252470 (secure 0 0 0) 0x7f2ec406f290 con 0x7f2ea40678c0 2024-08-18T22:32:43.408 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:32:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 -- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2ea40678c0 msgr2=0x7f2ea4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2ea40678c0 0x7f2ea4069d80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80ad000 tx=0x7f2eb80a6000 comp rx=0 tx=0).stop 2024-08-18T22:32:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 -- 172.21.15.5:0/4034730098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ec4162830 msgr2=0x7f2ec415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ec4162830 0x7f2ec415d460 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00cef0 tx=0x7f2ebc00a710 comp rx=0 tx=0).stop 2024-08-18T22:32:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 -- 172.21.15.5:0/4034730098 shutdown_connections 2024-08-18T22:32:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f2ea40678c0 0x7f2ea4069d80 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ec4162830 0x7f2ec415d460 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec4162450 0x7f2ec41590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 --2- 172.21.15.5:0/4034730098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ec40cef10 0x7f2ec40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 -- 172.21.15.5:0/4034730098 >> 172.21.15.5:0/4034730098 conn(0x7f2ec40b1c50 msgr2=0x7f2ec4071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 -- 172.21.15.5:0/4034730098 shutdown_connections 2024-08-18T22:32:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.406+0000 7f2ecbc00640 1 -- 172.21.15.5:0/4034730098 wait complete. 2024-08-18T22:32:43.429 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":592,"stamp":"2024-08-18T22:32:41.817035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":430488,"kb_used_data":19976,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754544232,"statfs":{"total":773094113280,"available":772653293568,"internally_reserved":0,"allocated":20455424,"data_stored":10268148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002294"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327592+0000","last_change":"2024-08-18T22:32:34.348785+0000","last_active":"2024-08-18T22:32:35.327592+0000","last_peered":"2024-08-18T22:32:35.327592+0000","last_clean":"2024-08-18T22:32:35.327592+0000","last_became_active":"2024-08-18T22:32:34.348494+0000","last_became_peered":"2024-08-18T22:32:34.348494+0000","last_unstale":"2024-08-18T22:32:35.327592+0000","last_undegraded":"2024-08-18T22:32:35.327592+0000","last_fullsized":"2024-08-18T22:32:35.327592+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:17:16.060559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328811+0000","last_change":"2024-08-18T22:32:34.333620+0000","last_active":"2024-08-18T22:32:35.328811+0000","last_peered":"2024-08-18T22:32:35.328811+0000","last_clean":"2024-08-18T22:32:35.328811+0000","last_became_active":"2024-08-18T22:32:34.332760+0000","last_became_peered":"2024-08-18T22:32:34.332760+0000","last_unstale":"2024-08-18T22:32:35.328811+0000","last_undegraded":"2024-08-18T22:32:35.328811+0000","last_fullsized":"2024-08-18T22:32:35.328811+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:37:52.642432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.329066+0000","last_change":"2024-08-18T22:32:34.329653+0000","last_active":"2024-08-18T22:32:35.329066+0000","last_peered":"2024-08-18T22:32:35.329066+0000","last_clean":"2024-08-18T22:32:35.329066+0000","last_became_active":"2024-08-18T22:32:34.329341+0000","last_became_peered":"2024-08-18T22:32:34.329341+0000","last_unstale":"2024-08-18T22:32:35.329066+0000","last_undegraded":"2024-08-18T22:32:35.329066+0000","last_fullsized":"2024-08-18T22:32:35.329066+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:16.792889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323265+0000","last_change":"2024-08-18T22:32:34.347883+0000","last_active":"2024-08-18T22:32:35.323265+0000","last_peered":"2024-08-18T22:32:35.323265+0000","last_clean":"2024-08-18T22:32:35.323265+0000","last_became_active":"2024-08-18T22:32:34.347594+0000","last_became_peered":"2024-08-18T22:32:34.347594+0000","last_unstale":"2024-08-18T22:32:35.323265+0000","last_undegraded":"2024-08-18T22:32:35.323265+0000","last_fullsized":"2024-08-18T22:32:35.323265+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:40.485131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327951+0000","last_change":"2024-08-18T22:32:34.332036+0000","last_active":"2024-08-18T22:32:35.327951+0000","last_peered":"2024-08-18T22:32:35.327951+0000","last_clean":"2024-08-18T22:32:35.327951+0000","last_became_active":"2024-08-18T22:32:34.331366+0000","last_became_peered":"2024-08-18T22:32:34.331366+0000","last_unstale":"2024-08-18T22:32:35.327951+0000","last_undegraded":"2024-08-18T22:32:35.327951+0000","last_fullsized":"2024-08-18T22:32:35.327951+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:59:00.772598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322681+0000","last_change":"2024-08-18T22:32:34.329471+0000","last_active":"2024-08-18T22:32:35.322681+0000","last_peered":"2024-08-18T22:32:35.322681+0000","last_clean":"2024-08-18T22:32:35.322681+0000","last_became_active":"2024-08-18T22:32:34.329162+0000","last_became_peered":"2024-08-18T22:32:34.329162+0000","last_unstale":"2024-08-18T22:32:35.322681+0000","last_undegraded":"2024-08-18T22:32:35.322681+0000","last_fullsized":"2024-08-18T22:32:35.322681+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:09.481981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327668+0000","last_change":"2024-08-18T22:32:34.328506+0000","last_active":"2024-08-18T22:32:35.327668+0000","last_peered":"2024-08-18T22:32:35.327668+0000","last_clean":"2024-08-18T22:32:35.327668+0000","last_became_active":"2024-08-18T22:32:34.328188+0000","last_became_peered":"2024-08-18T22:32:34.328188+0000","last_unstale":"2024-08-18T22:32:35.327668+0000","last_undegraded":"2024-08-18T22:32:35.327668+0000","last_fullsized":"2024-08-18T22:32:35.327668+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:08.229648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.326798+0000","last_change":"2024-08-18T22:32:34.345956+0000","last_active":"2024-08-18T22:32:35.326798+0000","last_peered":"2024-08-18T22:32:35.326798+0000","last_clean":"2024-08-18T22:32:35.326798+0000","last_became_active":"2024-08-18T22:32:34.345570+0000","last_became_peered":"2024-08-18T22:32:34.345570+0000","last_unstale":"2024-08-18T22:32:35.326798+0000","last_undegraded":"2024-08-18T22:32:35.326798+0000","last_fullsized":"2024-08-18T22:32:35.326798+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:24.305313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322151+0000","last_change":"2024-08-18T22:32:34.351507+0000","last_active":"2024-08-18T22:32:35.322151+0000","last_peered":"2024-08-18T22:32:35.322151+0000","last_clean":"2024-08-18T22:32:35.322151+0000","last_became_active":"2024-08-18T22:32:34.349791+0000","last_became_peered":"2024-08-18T22:32:34.349791+0000","last_unstale":"2024-08-18T22:32:35.322151+0000","last_undegraded":"2024-08-18T22:32:35.322151+0000","last_fullsized":"2024-08-18T22:32:35.322151+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:36.682163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327802+0000","last_change":"2024-08-18T22:32:34.344724+0000","last_active":"2024-08-18T22:32:35.327802+0000","last_peered":"2024-08-18T22:32:35.327802+0000","last_clean":"2024-08-18T22:32:35.327802+0000","last_became_active":"2024-08-18T22:32:34.344423+0000","last_became_peered":"2024-08-18T22:32:34.344423+0000","last_unstale":"2024-08-18T22:32:35.327802+0000","last_undegraded":"2024-08-18T22:32:35.327802+0000","last_fullsized":"2024-08-18T22:32:35.327802+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:41:15.354545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.329287+0000","last_change":"2024-08-18T22:32:34.339585+0000","last_active":"2024-08-18T22:32:35.329287+0000","last_peered":"2024-08-18T22:32:35.329287+0000","last_clean":"2024-08-18T22:32:35.329287+0000","last_became_active":"2024-08-18T22:32:34.339064+0000","last_became_peered":"2024-08-18T22:32:34.339064+0000","last_unstale":"2024-08-18T22:32:35.329287+0000","last_undegraded":"2024-08-18T22:32:35.329287+0000","last_fullsized":"2024-08-18T22:32:35.329287+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:31:09.481981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328280+0000","last_change":"2024-08-18T22:32:34.350611+0000","last_active":"2024-08-18T22:32:35.328280+0000","last_peered":"2024-08-18T22:32:35.328280+0000","last_clean":"2024-08-18T22:32:35.328280+0000","last_became_active":"2024-08-18T22:32:34.346800+0000","last_became_peered":"2024-08-18T22:32:34.346800+0000","last_unstale":"2024-08-18T22:32:35.328280+0000","last_undegraded":"2024-08-18T22:32:35.328280+0000","last_fullsized":"2024-08-18T22:32:35.328280+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:10.581383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322792+0000","last_change":"2024-08-18T22:32:34.333309+0000","last_active":"2024-08-18T22:32:35.322792+0000","last_peered":"2024-08-18T22:32:35.322792+0000","last_clean":"2024-08-18T22:32:35.322792+0000","last_became_active":"2024-08-18T22:32:34.333034+0000","last_became_peered":"2024-08-18T22:32:34.333034+0000","last_unstale":"2024-08-18T22:32:35.322792+0000","last_undegraded":"2024-08-18T22:32:35.322792+0000","last_fullsized":"2024-08-18T22:32:35.322792+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:01:25.687333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327316+0000","last_change":"2024-08-18T22:32:34.348512+0000","last_active":"2024-08-18T22:32:35.327316+0000","last_peered":"2024-08-18T22:32:35.327316+0000","last_clean":"2024-08-18T22:32:35.327316+0000","last_became_active":"2024-08-18T22:32:34.347343+0000","last_became_peered":"2024-08-18T22:32:34.347343+0000","last_unstale":"2024-08-18T22:32:35.327316+0000","last_undegraded":"2024-08-18T22:32:35.327316+0000","last_fullsized":"2024-08-18T22:32:35.327316+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:06:17.734239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323091+0000","last_change":"2024-08-18T22:32:34.340094+0000","last_active":"2024-08-18T22:32:35.323091+0000","last_peered":"2024-08-18T22:32:35.323091+0000","last_clean":"2024-08-18T22:32:35.323091+0000","last_became_active":"2024-08-18T22:32:34.339828+0000","last_became_peered":"2024-08-18T22:32:34.339828+0000","last_unstale":"2024-08-18T22:32:35.323091+0000","last_undegraded":"2024-08-18T22:32:35.323091+0000","last_fullsized":"2024-08-18T22:32:35.323091+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:01:26.496081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328101+0000","last_change":"2024-08-18T22:32:34.332616+0000","last_active":"2024-08-18T22:32:35.328101+0000","last_peered":"2024-08-18T22:32:35.328101+0000","last_clean":"2024-08-18T22:32:35.328101+0000","last_became_active":"2024-08-18T22:32:34.332309+0000","last_became_peered":"2024-08-18T22:32:34.332309+0000","last_unstale":"2024-08-18T22:32:35.328101+0000","last_undegraded":"2024-08-18T22:32:35.328101+0000","last_fullsized":"2024-08-18T22:32:35.328101+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:17:16.060559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322382+0000","last_change":"2024-08-18T22:32:34.347426+0000","last_active":"2024-08-18T22:32:35.322382+0000","last_peered":"2024-08-18T22:32:35.322382+0000","last_clean":"2024-08-18T22:32:35.322382+0000","last_became_active":"2024-08-18T22:32:34.344216+0000","last_became_peered":"2024-08-18T22:32:34.344216+0000","last_unstale":"2024-08-18T22:32:35.322382+0000","last_undegraded":"2024-08-18T22:32:35.322382+0000","last_fullsized":"2024-08-18T22:32:35.322382+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:25.437503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321975+0000","last_change":"2024-08-18T22:32:34.342069+0000","last_active":"2024-08-18T22:32:35.321975+0000","last_peered":"2024-08-18T22:32:35.321975+0000","last_clean":"2024-08-18T22:32:35.321975+0000","last_became_active":"2024-08-18T22:32:34.341567+0000","last_became_peered":"2024-08-18T22:32:34.341567+0000","last_unstale":"2024-08-18T22:32:35.321975+0000","last_undegraded":"2024-08-18T22:32:35.321975+0000","last_fullsized":"2024-08-18T22:32:35.321975+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:38:09.140033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327875+0000","last_change":"2024-08-18T22:32:34.346579+0000","last_active":"2024-08-18T22:32:35.327875+0000","last_peered":"2024-08-18T22:32:35.327875+0000","last_clean":"2024-08-18T22:32:35.327875+0000","last_became_active":"2024-08-18T22:32:34.345969+0000","last_became_peered":"2024-08-18T22:32:34.345969+0000","last_unstale":"2024-08-18T22:32:35.327875+0000","last_undegraded":"2024-08-18T22:32:35.327875+0000","last_fullsized":"2024-08-18T22:32:35.327875+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:40.975776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327908+0000","last_change":"2024-08-18T22:32:34.350579+0000","last_active":"2024-08-18T22:32:35.327908+0000","last_peered":"2024-08-18T22:32:35.327908+0000","last_clean":"2024-08-18T22:32:35.327908+0000","last_became_active":"2024-08-18T22:32:34.350325+0000","last_became_peered":"2024-08-18T22:32:34.350325+0000","last_unstale":"2024-08-18T22:32:35.327908+0000","last_undegraded":"2024-08-18T22:32:35.327908+0000","last_fullsized":"2024-08-18T22:32:35.327908+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:13:34.037502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327395+0000","last_change":"2024-08-18T22:32:34.346761+0000","last_active":"2024-08-18T22:32:35.327395+0000","last_peered":"2024-08-18T22:32:35.327395+0000","last_clean":"2024-08-18T22:32:35.327395+0000","last_became_active":"2024-08-18T22:32:34.346300+0000","last_became_peered":"2024-08-18T22:32:34.346300+0000","last_unstale":"2024-08-18T22:32:35.327395+0000","last_undegraded":"2024-08-18T22:32:35.327395+0000","last_fullsized":"2024-08-18T22:32:35.327395+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:01.332201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327483+0000","last_change":"2024-08-18T22:32:34.349546+0000","last_active":"2024-08-18T22:32:35.327483+0000","last_peered":"2024-08-18T22:32:35.327483+0000","last_clean":"2024-08-18T22:32:35.327483+0000","last_became_active":"2024-08-18T22:32:34.349257+0000","last_became_peered":"2024-08-18T22:32:34.349257+0000","last_unstale":"2024-08-18T22:32:35.327483+0000","last_undegraded":"2024-08-18T22:32:35.327483+0000","last_fullsized":"2024-08-18T22:32:35.327483+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:16:57.141203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328191+0000","last_change":"2024-08-18T22:32:34.334445+0000","last_active":"2024-08-18T22:32:35.328191+0000","last_peered":"2024-08-18T22:32:35.328191+0000","last_clean":"2024-08-18T22:32:35.328191+0000","last_became_active":"2024-08-18T22:32:34.334139+0000","last_became_peered":"2024-08-18T22:32:34.334139+0000","last_unstale":"2024-08-18T22:32:35.328191+0000","last_undegraded":"2024-08-18T22:32:35.328191+0000","last_fullsized":"2024-08-18T22:32:35.328191+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:30:46.254753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327593+0000","last_change":"2024-08-18T22:32:34.336858+0000","last_active":"2024-08-18T22:32:35.327593+0000","last_peered":"2024-08-18T22:32:35.327593+0000","last_clean":"2024-08-18T22:32:35.327593+0000","last_became_active":"2024-08-18T22:32:34.336586+0000","last_became_peered":"2024-08-18T22:32:34.336586+0000","last_unstale":"2024-08-18T22:32:35.327593+0000","last_undegraded":"2024-08-18T22:32:35.327593+0000","last_fullsized":"2024-08-18T22:32:35.327593+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:55.751347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322338+0000","last_change":"2024-08-18T22:32:34.342032+0000","last_active":"2024-08-18T22:32:35.322338+0000","last_peered":"2024-08-18T22:32:35.322338+0000","last_clean":"2024-08-18T22:32:35.322338+0000","last_became_active":"2024-08-18T22:32:34.341555+0000","last_became_peered":"2024-08-18T22:32:34.341555+0000","last_unstale":"2024-08-18T22:32:35.322338+0000","last_undegraded":"2024-08-18T22:32:35.322338+0000","last_fullsized":"2024-08-18T22:32:35.322338+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:30:46.254753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327412+0000","last_change":"2024-08-18T22:32:34.345891+0000","last_active":"2024-08-18T22:32:35.327412+0000","last_peered":"2024-08-18T22:32:35.327412+0000","last_clean":"2024-08-18T22:32:35.327412+0000","last_became_active":"2024-08-18T22:32:34.345611+0000","last_became_peered":"2024-08-18T22:32:34.345611+0000","last_unstale":"2024-08-18T22:32:35.327412+0000","last_undegraded":"2024-08-18T22:32:35.327412+0000","last_fullsized":"2024-08-18T22:32:35.327412+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:48:35.954242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.329287+0000","last_change":"2024-08-18T22:32:34.339328+0000","last_active":"2024-08-18T22:32:35.329287+0000","last_peered":"2024-08-18T22:32:35.329287+0000","last_clean":"2024-08-18T22:32:35.329287+0000","last_became_active":"2024-08-18T22:32:34.338696+0000","last_became_peered":"2024-08-18T22:32:34.338696+0000","last_unstale":"2024-08-18T22:32:35.329287+0000","last_undegraded":"2024-08-18T22:32:35.329287+0000","last_fullsized":"2024-08-18T22:32:35.329287+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:24.885798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328352+0000","last_change":"2024-08-18T22:32:34.331458+0000","last_active":"2024-08-18T22:32:35.328352+0000","last_peered":"2024-08-18T22:32:35.328352+0000","last_clean":"2024-08-18T22:32:35.328352+0000","last_became_active":"2024-08-18T22:32:34.331049+0000","last_became_peered":"2024-08-18T22:32:34.331049+0000","last_unstale":"2024-08-18T22:32:35.328352+0000","last_undegraded":"2024-08-18T22:32:35.328352+0000","last_fullsized":"2024-08-18T22:32:35.328352+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:13:52.541926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321822+0000","last_change":"2024-08-18T22:32:34.342455+0000","last_active":"2024-08-18T22:32:35.321822+0000","last_peered":"2024-08-18T22:32:35.321822+0000","last_clean":"2024-08-18T22:32:35.321822+0000","last_became_active":"2024-08-18T22:32:34.341055+0000","last_became_peered":"2024-08-18T22:32:34.341055+0000","last_unstale":"2024-08-18T22:32:35.321822+0000","last_undegraded":"2024-08-18T22:32:35.321822+0000","last_fullsized":"2024-08-18T22:32:35.321822+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:17:35.154241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323984+0000","last_change":"2024-08-18T22:32:34.338117+0000","last_active":"2024-08-18T22:32:35.323984+0000","last_peered":"2024-08-18T22:32:35.323984+0000","last_clean":"2024-08-18T22:32:35.323984+0000","last_became_active":"2024-08-18T22:32:34.337781+0000","last_became_peered":"2024-08-18T22:32:34.337781+0000","last_unstale":"2024-08-18T22:32:35.323984+0000","last_undegraded":"2024-08-18T22:32:35.323984+0000","last_fullsized":"2024-08-18T22:32:35.323984+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:15.477308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322427+0000","last_change":"2024-08-18T22:32:34.329382+0000","last_active":"2024-08-18T22:32:35.322427+0000","last_peered":"2024-08-18T22:32:35.322427+0000","last_clean":"2024-08-18T22:32:35.322427+0000","last_became_active":"2024-08-18T22:32:34.329073+0000","last_became_peered":"2024-08-18T22:32:34.329073+0000","last_unstale":"2024-08-18T22:32:35.322427+0000","last_undegraded":"2024-08-18T22:32:35.322427+0000","last_fullsized":"2024-08-18T22:32:35.322427+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:20:24.885798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322388+0000","last_change":"2024-08-18T22:32:34.329457+0000","last_active":"2024-08-18T22:32:35.322388+0000","last_peered":"2024-08-18T22:32:35.322388+0000","last_clean":"2024-08-18T22:32:35.322388+0000","last_became_active":"2024-08-18T22:32:34.329151+0000","last_became_peered":"2024-08-18T22:32:34.329151+0000","last_unstale":"2024-08-18T22:32:35.322388+0000","last_undegraded":"2024-08-18T22:32:35.322388+0000","last_fullsized":"2024-08-18T22:32:35.322388+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:58:16.792889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328295+0000","last_change":"2024-08-18T22:32:34.344868+0000","last_active":"2024-08-18T22:32:35.328295+0000","last_peered":"2024-08-18T22:32:35.328295+0000","last_clean":"2024-08-18T22:32:35.328295+0000","last_became_active":"2024-08-18T22:32:34.344451+0000","last_became_peered":"2024-08-18T22:32:34.344451+0000","last_unstale":"2024-08-18T22:32:35.328295+0000","last_undegraded":"2024-08-18T22:32:35.328295+0000","last_fullsized":"2024-08-18T22:32:35.328295+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:05:37.628668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"190'4","reported_seq":18,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324141+0000","last_change":"2024-08-18T22:32:33.341792+0000","last_active":"2024-08-18T22:32:35.324141+0000","last_peered":"2024-08-18T22:32:35.324141+0000","last_clean":"2024-08-18T22:32:35.324141+0000","last_became_active":"2024-08-18T22:32:33.341460+0000","last_became_peered":"2024-08-18T22:32:33.341460+0000","last_unstale":"2024-08-18T22:32:35.324141+0000","last_undegraded":"2024-08-18T22:32:35.324141+0000","last_fullsized":"2024-08-18T22:32:35.324141+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:06.705661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.326790+0000","last_change":"2024-08-18T22:32:34.338871+0000","last_active":"2024-08-18T22:32:35.326790+0000","last_peered":"2024-08-18T22:32:35.326790+0000","last_clean":"2024-08-18T22:32:35.326790+0000","last_became_active":"2024-08-18T22:32:34.338186+0000","last_became_peered":"2024-08-18T22:32:34.338186+0000","last_unstale":"2024-08-18T22:32:35.326790+0000","last_undegraded":"2024-08-18T22:32:35.326790+0000","last_fullsized":"2024-08-18T22:32:35.326790+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:12.118210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327574+0000","last_change":"2024-08-18T22:32:33.337250+0000","last_active":"2024-08-18T22:32:35.327574+0000","last_peered":"2024-08-18T22:32:35.327574+0000","last_clean":"2024-08-18T22:32:35.327574+0000","last_became_active":"2024-08-18T22:32:33.336973+0000","last_became_peered":"2024-08-18T22:32:33.336973+0000","last_unstale":"2024-08-18T22:32:35.327574+0000","last_undegraded":"2024-08-18T22:32:35.327574+0000","last_fullsized":"2024-08-18T22:32:35.327574+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:59:20.935747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327665+0000","last_change":"2024-08-18T22:32:34.347018+0000","last_active":"2024-08-18T22:32:35.327665+0000","last_peered":"2024-08-18T22:32:35.327665+0000","last_clean":"2024-08-18T22:32:35.327665+0000","last_became_active":"2024-08-18T22:32:34.346461+0000","last_became_peered":"2024-08-18T22:32:34.346461+0000","last_unstale":"2024-08-18T22:32:35.327665+0000","last_undegraded":"2024-08-18T22:32:35.327665+0000","last_fullsized":"2024-08-18T22:32:35.327665+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:09:45.542989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328438+0000","last_change":"2024-08-18T22:32:33.333993+0000","last_active":"2024-08-18T22:32:35.328438+0000","last_peered":"2024-08-18T22:32:35.328438+0000","last_clean":"2024-08-18T22:32:35.328438+0000","last_became_active":"2024-08-18T22:32:33.333716+0000","last_became_peered":"2024-08-18T22:32:33.333716+0000","last_unstale":"2024-08-18T22:32:35.328438+0000","last_undegraded":"2024-08-18T22:32:35.328438+0000","last_fullsized":"2024-08-18T22:32:35.328438+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:07:17.964114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328002+0000","last_change":"2024-08-18T22:32:34.332282+0000","last_active":"2024-08-18T22:32:35.328002+0000","last_peered":"2024-08-18T22:32:35.328002+0000","last_clean":"2024-08-18T22:32:35.328002+0000","last_became_active":"2024-08-18T22:32:34.331745+0000","last_became_peered":"2024-08-18T22:32:34.331745+0000","last_unstale":"2024-08-18T22:32:35.328002+0000","last_undegraded":"2024-08-18T22:32:35.328002+0000","last_fullsized":"2024-08-18T22:32:35.328002+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:00:59.385206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322076+0000","last_change":"2024-08-18T22:32:33.342536+0000","last_active":"2024-08-18T22:32:35.322076+0000","last_peered":"2024-08-18T22:32:35.322076+0000","last_clean":"2024-08-18T22:32:35.322076+0000","last_became_active":"2024-08-18T22:32:33.341981+0000","last_became_peered":"2024-08-18T22:32:33.341981+0000","last_unstale":"2024-08-18T22:32:35.322076+0000","last_undegraded":"2024-08-18T22:32:35.322076+0000","last_fullsized":"2024-08-18T22:32:35.322076+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:57:51.209255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324119+0000","last_change":"2024-08-18T22:32:34.343058+0000","last_active":"2024-08-18T22:32:35.324119+0000","last_peered":"2024-08-18T22:32:35.324119+0000","last_clean":"2024-08-18T22:32:35.324119+0000","last_became_active":"2024-08-18T22:32:34.339495+0000","last_became_peered":"2024-08-18T22:32:34.339495+0000","last_unstale":"2024-08-18T22:32:35.324119+0000","last_undegraded":"2024-08-18T22:32:35.324119+0000","last_fullsized":"2024-08-18T22:32:35.324119+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:51:39.905440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322794+0000","last_change":"2024-08-18T22:32:33.339981+0000","last_active":"2024-08-18T22:32:35.322794+0000","last_peered":"2024-08-18T22:32:35.322794+0000","last_clean":"2024-08-18T22:32:35.322794+0000","last_became_active":"2024-08-18T22:32:33.338281+0000","last_became_peered":"2024-08-18T22:32:33.338281+0000","last_unstale":"2024-08-18T22:32:35.322794+0000","last_undegraded":"2024-08-18T22:32:35.322794+0000","last_fullsized":"2024-08-18T22:32:35.322794+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:00.572695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324121+0000","last_change":"2024-08-18T22:32:34.339553+0000","last_active":"2024-08-18T22:32:35.324121+0000","last_peered":"2024-08-18T22:32:35.324121+0000","last_clean":"2024-08-18T22:32:35.324121+0000","last_became_active":"2024-08-18T22:32:34.339281+0000","last_became_peered":"2024-08-18T22:32:34.339281+0000","last_unstale":"2024-08-18T22:32:35.324121+0000","last_undegraded":"2024-08-18T22:32:35.324121+0000","last_fullsized":"2024-08-18T22:32:35.324121+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:51.382957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322592+0000","last_change":"2024-08-18T22:32:33.338565+0000","last_active":"2024-08-18T22:32:35.322592+0000","last_peered":"2024-08-18T22:32:35.322592+0000","last_clean":"2024-08-18T22:32:35.322592+0000","last_became_active":"2024-08-18T22:32:33.338246+0000","last_became_peered":"2024-08-18T22:32:33.338246+0000","last_unstale":"2024-08-18T22:32:35.322592+0000","last_undegraded":"2024-08-18T22:32:35.322592+0000","last_fullsized":"2024-08-18T22:32:35.322592+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:43.240332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322442+0000","last_change":"2024-08-18T22:32:34.341819+0000","last_active":"2024-08-18T22:32:35.322442+0000","last_peered":"2024-08-18T22:32:35.322442+0000","last_clean":"2024-08-18T22:32:35.322442+0000","last_became_active":"2024-08-18T22:32:34.341185+0000","last_became_peered":"2024-08-18T22:32:34.341185+0000","last_unstale":"2024-08-18T22:32:35.322442+0000","last_undegraded":"2024-08-18T22:32:35.322442+0000","last_fullsized":"2024-08-18T22:32:35.322442+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:05:37.628668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328266+0000","last_change":"2024-08-18T22:32:33.332795+0000","last_active":"2024-08-18T22:32:35.328266+0000","last_peered":"2024-08-18T22:32:35.328266+0000","last_clean":"2024-08-18T22:32:35.328266+0000","last_became_active":"2024-08-18T22:32:33.332124+0000","last_became_peered":"2024-08-18T22:32:33.332124+0000","last_unstale":"2024-08-18T22:32:35.328266+0000","last_undegraded":"2024-08-18T22:32:35.328266+0000","last_fullsized":"2024-08-18T22:32:35.328266+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:43.240332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322954+0000","last_change":"2024-08-18T22:32:34.343093+0000","last_active":"2024-08-18T22:32:35.322954+0000","last_peered":"2024-08-18T22:32:35.322954+0000","last_clean":"2024-08-18T22:32:35.322954+0000","last_became_active":"2024-08-18T22:32:34.342837+0000","last_became_peered":"2024-08-18T22:32:34.342837+0000","last_unstale":"2024-08-18T22:32:35.322954+0000","last_undegraded":"2024-08-18T22:32:35.322954+0000","last_fullsized":"2024-08-18T22:32:35.322954+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:59.761456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328440+0000","last_change":"2024-08-18T22:32:33.342601+0000","last_active":"2024-08-18T22:32:35.328440+0000","last_peered":"2024-08-18T22:32:35.328440+0000","last_clean":"2024-08-18T22:32:35.328440+0000","last_became_active":"2024-08-18T22:32:33.342319+0000","last_became_peered":"2024-08-18T22:32:33.342319+0000","last_unstale":"2024-08-18T22:32:35.328440+0000","last_undegraded":"2024-08-18T22:32:35.328440+0000","last_fullsized":"2024-08-18T22:32:35.328440+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:44:05.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328435+0000","last_change":"2024-08-18T22:32:34.333157+0000","last_active":"2024-08-18T22:32:35.328435+0000","last_peered":"2024-08-18T22:32:35.328435+0000","last_clean":"2024-08-18T22:32:35.328435+0000","last_became_active":"2024-08-18T22:32:34.331651+0000","last_became_peered":"2024-08-18T22:32:34.331651+0000","last_unstale":"2024-08-18T22:32:35.328435+0000","last_undegraded":"2024-08-18T22:32:35.328435+0000","last_fullsized":"2024-08-18T22:32:35.328435+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:18.003655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323508+0000","last_change":"2024-08-18T22:32:33.339791+0000","last_active":"2024-08-18T22:32:35.323508+0000","last_peered":"2024-08-18T22:32:35.323508+0000","last_clean":"2024-08-18T22:32:35.323508+0000","last_became_active":"2024-08-18T22:32:33.339512+0000","last_became_peered":"2024-08-18T22:32:33.339512+0000","last_unstale":"2024-08-18T22:32:35.323508+0000","last_undegraded":"2024-08-18T22:32:35.323508+0000","last_fullsized":"2024-08-18T22:32:35.323508+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:39.897815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321876+0000","last_change":"2024-08-18T22:32:34.348924+0000","last_active":"2024-08-18T22:32:35.321876+0000","last_peered":"2024-08-18T22:32:35.321876+0000","last_clean":"2024-08-18T22:32:35.321876+0000","last_became_active":"2024-08-18T22:32:34.348652+0000","last_became_peered":"2024-08-18T22:32:34.348652+0000","last_unstale":"2024-08-18T22:32:35.321876+0000","last_undegraded":"2024-08-18T22:32:35.321876+0000","last_fullsized":"2024-08-18T22:32:35.321876+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:16:11.331050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"190'3","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321982+0000","last_change":"2024-08-18T22:32:33.335980+0000","last_active":"2024-08-18T22:32:35.321982+0000","last_peered":"2024-08-18T22:32:35.321982+0000","last_clean":"2024-08-18T22:32:35.321982+0000","last_became_active":"2024-08-18T22:32:33.334645+0000","last_became_peered":"2024-08-18T22:32:33.334645+0000","last_unstale":"2024-08-18T22:32:35.321982+0000","last_undegraded":"2024-08-18T22:32:35.321982+0000","last_fullsized":"2024-08-18T22:32:35.321982+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:46.471511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328147+0000","last_change":"2024-08-18T22:32:34.338668+0000","last_active":"2024-08-18T22:32:35.328147+0000","last_peered":"2024-08-18T22:32:35.328147+0000","last_clean":"2024-08-18T22:32:35.328147+0000","last_became_active":"2024-08-18T22:32:34.338385+0000","last_became_peered":"2024-08-18T22:32:34.338385+0000","last_unstale":"2024-08-18T22:32:35.328147+0000","last_undegraded":"2024-08-18T22:32:35.328147+0000","last_fullsized":"2024-08-18T22:32:35.328147+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:53:41.464541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"190'6","reported_seq":20,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323372+0000","last_change":"2024-08-18T22:32:33.334598+0000","last_active":"2024-08-18T22:32:35.323372+0000","last_peered":"2024-08-18T22:32:35.323372+0000","last_clean":"2024-08-18T22:32:35.323372+0000","last_became_active":"2024-08-18T22:32:33.334298+0000","last_became_peered":"2024-08-18T22:32:33.334298+0000","last_unstale":"2024-08-18T22:32:35.323372+0000","last_undegraded":"2024-08-18T22:32:35.323372+0000","last_fullsized":"2024-08-18T22:32:35.323372+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:12:31.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328060+0000","last_change":"2024-08-18T22:32:34.331853+0000","last_active":"2024-08-18T22:32:35.328060+0000","last_peered":"2024-08-18T22:32:35.328060+0000","last_clean":"2024-08-18T22:32:35.328060+0000","last_became_active":"2024-08-18T22:32:34.331022+0000","last_became_peered":"2024-08-18T22:32:34.331022+0000","last_unstale":"2024-08-18T22:32:35.328060+0000","last_undegraded":"2024-08-18T22:32:35.328060+0000","last_fullsized":"2024-08-18T22:32:35.328060+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:18.511009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327856+0000","last_change":"2024-08-18T22:32:33.340299+0000","last_active":"2024-08-18T22:32:35.327856+0000","last_peered":"2024-08-18T22:32:35.327856+0000","last_clean":"2024-08-18T22:32:35.327856+0000","last_became_active":"2024-08-18T22:32:33.340027+0000","last_became_peered":"2024-08-18T22:32:33.340027+0000","last_unstale":"2024-08-18T22:32:35.327856+0000","last_undegraded":"2024-08-18T22:32:35.327856+0000","last_fullsized":"2024-08-18T22:32:35.327856+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:16.550784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.329446+0000","last_change":"2024-08-18T22:32:34.346500+0000","last_active":"2024-08-18T22:32:35.329446+0000","last_peered":"2024-08-18T22:32:35.329446+0000","last_clean":"2024-08-18T22:32:35.329446+0000","last_became_active":"2024-08-18T22:32:34.346200+0000","last_became_peered":"2024-08-18T22:32:34.346200+0000","last_unstale":"2024-08-18T22:32:35.329446+0000","last_undegraded":"2024-08-18T22:32:35.329446+0000","last_fullsized":"2024-08-18T22:32:35.329446+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:00.847302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328840+0000","last_change":"2024-08-18T22:32:33.331475+0000","last_active":"2024-08-18T22:32:35.328840+0000","last_peered":"2024-08-18T22:32:35.328840+0000","last_clean":"2024-08-18T22:32:35.328840+0000","last_became_active":"2024-08-18T22:32:33.331157+0000","last_became_peered":"2024-08-18T22:32:33.331157+0000","last_unstale":"2024-08-18T22:32:35.328840+0000","last_undegraded":"2024-08-18T22:32:35.328840+0000","last_fullsized":"2024-08-18T22:32:35.328840+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:00.572695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322122+0000","last_change":"2024-08-18T22:32:34.341847+0000","last_active":"2024-08-18T22:32:35.322122+0000","last_peered":"2024-08-18T22:32:35.322122+0000","last_clean":"2024-08-18T22:32:35.322122+0000","last_became_active":"2024-08-18T22:32:34.341160+0000","last_became_peered":"2024-08-18T22:32:34.341160+0000","last_unstale":"2024-08-18T22:32:35.322122+0000","last_undegraded":"2024-08-18T22:32:35.322122+0000","last_fullsized":"2024-08-18T22:32:35.322122+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:14:44.383553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321675+0000","last_change":"2024-08-18T22:32:33.340757+0000","last_active":"2024-08-18T22:32:35.321675+0000","last_peered":"2024-08-18T22:32:35.321675+0000","last_clean":"2024-08-18T22:32:35.321675+0000","last_became_active":"2024-08-18T22:32:33.340260+0000","last_became_peered":"2024-08-18T22:32:33.340260+0000","last_unstale":"2024-08-18T22:32:35.321675+0000","last_undegraded":"2024-08-18T22:32:35.321675+0000","last_fullsized":"2024-08-18T22:32:35.321675+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:27:44.140250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323191+0000","last_change":"2024-08-18T22:32:34.346997+0000","last_active":"2024-08-18T22:32:35.323191+0000","last_peered":"2024-08-18T22:32:35.323191+0000","last_clean":"2024-08-18T22:32:35.323191+0000","last_became_active":"2024-08-18T22:32:34.342377+0000","last_became_peered":"2024-08-18T22:32:34.342377+0000","last_unstale":"2024-08-18T22:32:35.323191+0000","last_undegraded":"2024-08-18T22:32:35.323191+0000","last_fullsized":"2024-08-18T22:32:35.323191+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:00.847302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"190'8","reported_seq":22,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327742+0000","last_change":"2024-08-18T22:32:33.335461+0000","last_active":"2024-08-18T22:32:35.327742+0000","last_peered":"2024-08-18T22:32:35.327742+0000","last_clean":"2024-08-18T22:32:35.327742+0000","last_became_active":"2024-08-18T22:32:33.333576+0000","last_became_peered":"2024-08-18T22:32:33.333576+0000","last_unstale":"2024-08-18T22:32:35.327742+0000","last_undegraded":"2024-08-18T22:32:35.327742+0000","last_fullsized":"2024-08-18T22:32:35.327742+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:20:29.913730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327129+0000","last_change":"2024-08-18T22:32:34.333457+0000","last_active":"2024-08-18T22:32:35.327129+0000","last_peered":"2024-08-18T22:32:35.327129+0000","last_clean":"2024-08-18T22:32:35.327129+0000","last_became_active":"2024-08-18T22:32:34.333172+0000","last_became_peered":"2024-08-18T22:32:34.333172+0000","last_unstale":"2024-08-18T22:32:35.327129+0000","last_undegraded":"2024-08-18T22:32:35.327129+0000","last_fullsized":"2024-08-18T22:32:35.327129+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:42:28.194406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327785+0000","last_change":"2024-08-18T22:32:33.343063+0000","last_active":"2024-08-18T22:32:35.327785+0000","last_peered":"2024-08-18T22:32:35.327785+0000","last_clean":"2024-08-18T22:32:35.327785+0000","last_became_active":"2024-08-18T22:32:33.342745+0000","last_became_peered":"2024-08-18T22:32:33.342745+0000","last_unstale":"2024-08-18T22:32:35.327785+0000","last_undegraded":"2024-08-18T22:32:35.327785+0000","last_fullsized":"2024-08-18T22:32:35.327785+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:43.240332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327007+0000","last_change":"2024-08-18T22:32:34.345166+0000","last_active":"2024-08-18T22:32:35.327007+0000","last_peered":"2024-08-18T22:32:35.327007+0000","last_clean":"2024-08-18T22:32:35.327007+0000","last_became_active":"2024-08-18T22:32:34.344480+0000","last_became_peered":"2024-08-18T22:32:34.344480+0000","last_unstale":"2024-08-18T22:32:35.327007+0000","last_undegraded":"2024-08-18T22:32:35.327007+0000","last_fullsized":"2024-08-18T22:32:35.327007+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:58:37.010566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327582+0000","last_change":"2024-08-18T22:32:33.344896+0000","last_active":"2024-08-18T22:32:35.327582+0000","last_peered":"2024-08-18T22:32:35.327582+0000","last_clean":"2024-08-18T22:32:35.327582+0000","last_became_active":"2024-08-18T22:32:33.344602+0000","last_became_peered":"2024-08-18T22:32:33.344602+0000","last_unstale":"2024-08-18T22:32:35.327582+0000","last_undegraded":"2024-08-18T22:32:35.327582+0000","last_fullsized":"2024-08-18T22:32:35.327582+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:17.426503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328129+0000","last_change":"2024-08-18T22:32:34.345926+0000","last_active":"2024-08-18T22:32:35.328129+0000","last_peered":"2024-08-18T22:32:35.328129+0000","last_clean":"2024-08-18T22:32:35.328129+0000","last_became_active":"2024-08-18T22:32:34.345182+0000","last_became_peered":"2024-08-18T22:32:34.345182+0000","last_unstale":"2024-08-18T22:32:35.328129+0000","last_undegraded":"2024-08-18T22:32:35.328129+0000","last_fullsized":"2024-08-18T22:32:35.328129+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:18.003655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328538+0000","last_change":"2024-08-18T22:32:33.337911+0000","last_active":"2024-08-18T22:32:35.328538+0000","last_peered":"2024-08-18T22:32:35.328538+0000","last_clean":"2024-08-18T22:32:35.328538+0000","last_became_active":"2024-08-18T22:32:33.337622+0000","last_became_peered":"2024-08-18T22:32:33.337622+0000","last_unstale":"2024-08-18T22:32:35.328538+0000","last_undegraded":"2024-08-18T22:32:35.328538+0000","last_fullsized":"2024-08-18T22:32:35.328538+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:07.505012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327570+0000","last_change":"2024-08-18T22:32:34.348913+0000","last_active":"2024-08-18T22:32:35.327570+0000","last_peered":"2024-08-18T22:32:35.327570+0000","last_clean":"2024-08-18T22:32:35.327570+0000","last_became_active":"2024-08-18T22:32:34.348255+0000","last_became_peered":"2024-08-18T22:32:34.348255+0000","last_unstale":"2024-08-18T22:32:35.327570+0000","last_undegraded":"2024-08-18T22:32:35.327570+0000","last_fullsized":"2024-08-18T22:32:35.327570+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:21:38.110618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328380+0000","last_change":"2024-08-18T22:32:33.341287+0000","last_active":"2024-08-18T22:32:35.328380+0000","last_peered":"2024-08-18T22:32:35.328380+0000","last_clean":"2024-08-18T22:32:35.328380+0000","last_became_active":"2024-08-18T22:32:33.340919+0000","last_became_peered":"2024-08-18T22:32:33.340919+0000","last_unstale":"2024-08-18T22:32:35.328380+0000","last_undegraded":"2024-08-18T22:32:35.328380+0000","last_fullsized":"2024-08-18T22:32:35.328380+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:08:07.407708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328190+0000","last_change":"2024-08-18T22:32:34.328476+0000","last_active":"2024-08-18T22:32:35.328190+0000","last_peered":"2024-08-18T22:32:35.328190+0000","last_clean":"2024-08-18T22:32:35.328190+0000","last_became_active":"2024-08-18T22:32:34.328194+0000","last_became_peered":"2024-08-18T22:32:34.328194+0000","last_unstale":"2024-08-18T22:32:35.328190+0000","last_undegraded":"2024-08-18T22:32:35.328190+0000","last_fullsized":"2024-08-18T22:32:35.328190+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:56:25.437503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328253+0000","last_change":"2024-08-18T22:32:33.334444+0000","last_active":"2024-08-18T22:32:35.328253+0000","last_peered":"2024-08-18T22:32:35.328253+0000","last_clean":"2024-08-18T22:32:35.328253+0000","last_became_active":"2024-08-18T22:32:33.334157+0000","last_became_peered":"2024-08-18T22:32:33.334157+0000","last_unstale":"2024-08-18T22:32:35.328253+0000","last_undegraded":"2024-08-18T22:32:35.328253+0000","last_fullsized":"2024-08-18T22:32:35.328253+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:57.349272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323439+0000","last_change":"2024-08-18T22:32:34.335815+0000","last_active":"2024-08-18T22:32:35.323439+0000","last_peered":"2024-08-18T22:32:35.323439+0000","last_clean":"2024-08-18T22:32:35.323439+0000","last_became_active":"2024-08-18T22:32:34.335544+0000","last_became_peered":"2024-08-18T22:32:34.335544+0000","last_unstale":"2024-08-18T22:32:35.323439+0000","last_undegraded":"2024-08-18T22:32:35.323439+0000","last_fullsized":"2024-08-18T22:32:35.323439+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:48:35.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327855+0000","last_change":"2024-08-18T22:32:33.334916+0000","last_active":"2024-08-18T22:32:35.327855+0000","last_peered":"2024-08-18T22:32:35.327855+0000","last_clean":"2024-08-18T22:32:35.327855+0000","last_became_active":"2024-08-18T22:32:33.334646+0000","last_became_peered":"2024-08-18T22:32:33.334646+0000","last_unstale":"2024-08-18T22:32:35.327855+0000","last_undegraded":"2024-08-18T22:32:35.327855+0000","last_fullsized":"2024-08-18T22:32:35.327855+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:17:34.145619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322261+0000","last_change":"2024-08-18T22:32:34.340835+0000","last_active":"2024-08-18T22:32:35.322261+0000","last_peered":"2024-08-18T22:32:35.322261+0000","last_clean":"2024-08-18T22:32:35.322261+0000","last_became_active":"2024-08-18T22:32:34.337569+0000","last_became_peered":"2024-08-18T22:32:34.337569+0000","last_unstale":"2024-08-18T22:32:35.322261+0000","last_undegraded":"2024-08-18T22:32:35.322261+0000","last_fullsized":"2024-08-18T22:32:35.322261+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:04:18.511009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.324009+0000","last_change":"2024-08-18T22:32:33.341713+0000","last_active":"2024-08-18T22:32:35.324009+0000","last_peered":"2024-08-18T22:32:35.324009+0000","last_clean":"2024-08-18T22:32:35.324009+0000","last_became_active":"2024-08-18T22:32:33.341422+0000","last_became_peered":"2024-08-18T22:32:33.341422+0000","last_unstale":"2024-08-18T22:32:35.324009+0000","last_undegraded":"2024-08-18T22:32:35.324009+0000","last_fullsized":"2024-08-18T22:32:35.324009+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:15.668948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328409+0000","last_change":"2024-08-18T22:32:34.345983+0000","last_active":"2024-08-18T22:32:35.328409+0000","last_peered":"2024-08-18T22:32:35.328409+0000","last_clean":"2024-08-18T22:32:35.328409+0000","last_became_active":"2024-08-18T22:32:34.345419+0000","last_became_peered":"2024-08-18T22:32:34.345419+0000","last_unstale":"2024-08-18T22:32:35.328409+0000","last_undegraded":"2024-08-18T22:32:35.328409+0000","last_fullsized":"2024-08-18T22:32:35.328409+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:20:53.300455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.326780+0000","last_change":"2024-08-18T22:32:33.342210+0000","last_active":"2024-08-18T22:32:35.326780+0000","last_peered":"2024-08-18T22:32:35.326780+0000","last_clean":"2024-08-18T22:32:35.326780+0000","last_became_active":"2024-08-18T22:32:33.341921+0000","last_became_peered":"2024-08-18T22:32:33.341921+0000","last_unstale":"2024-08-18T22:32:35.326780+0000","last_undegraded":"2024-08-18T22:32:35.326780+0000","last_fullsized":"2024-08-18T22:32:35.326780+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:42:24.770725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327293+0000","last_change":"2024-08-18T22:32:34.335949+0000","last_active":"2024-08-18T22:32:35.327293+0000","last_peered":"2024-08-18T22:32:35.327293+0000","last_clean":"2024-08-18T22:32:35.327293+0000","last_became_active":"2024-08-18T22:32:34.335662+0000","last_became_peered":"2024-08-18T22:32:34.335662+0000","last_unstale":"2024-08-18T22:32:35.327293+0000","last_undegraded":"2024-08-18T22:32:35.327293+0000","last_fullsized":"2024-08-18T22:32:35.327293+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:24:12.937355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"190'2","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322469+0000","last_change":"2024-08-18T22:32:33.332550+0000","last_active":"2024-08-18T22:32:35.322469+0000","last_peered":"2024-08-18T22:32:35.322469+0000","last_clean":"2024-08-18T22:32:35.322469+0000","last_became_active":"2024-08-18T22:32:33.332177+0000","last_became_peered":"2024-08-18T22:32:33.332177+0000","last_unstale":"2024-08-18T22:32:35.322469+0000","last_undegraded":"2024-08-18T22:32:35.322469+0000","last_fullsized":"2024-08-18T22:32:35.322469+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:52:51.741515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328654+0000","last_change":"2024-08-18T22:32:34.335836+0000","last_active":"2024-08-18T22:32:35.328654+0000","last_peered":"2024-08-18T22:32:35.328654+0000","last_clean":"2024-08-18T22:32:35.328654+0000","last_became_active":"2024-08-18T22:32:34.335560+0000","last_became_peered":"2024-08-18T22:32:34.335560+0000","last_unstale":"2024-08-18T22:32:35.328654+0000","last_undegraded":"2024-08-18T22:32:35.328654+0000","last_fullsized":"2024-08-18T22:32:35.328654+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:42:49.486657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"191'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.328021+0000","last_change":"2024-08-18T22:32:33.333264+0000","last_active":"2024-08-18T22:32:35.328021+0000","last_peered":"2024-08-18T22:32:35.328021+0000","last_clean":"2024-08-18T22:32:35.328021+0000","last_became_active":"2024-08-18T22:32:33.332744+0000","last_became_peered":"2024-08-18T22:32:33.332744+0000","last_unstale":"2024-08-18T22:32:35.328021+0000","last_undegraded":"2024-08-18T22:32:35.328021+0000","last_fullsized":"2024-08-18T22:32:35.328021+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:36:27.323951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321877+0000","last_change":"2024-08-18T22:32:34.347178+0000","last_active":"2024-08-18T22:32:35.321877+0000","last_peered":"2024-08-18T22:32:35.321877+0000","last_clean":"2024-08-18T22:32:35.321877+0000","last_became_active":"2024-08-18T22:32:34.346845+0000","last_became_peered":"2024-08-18T22:32:34.346845+0000","last_unstale":"2024-08-18T22:32:35.321877+0000","last_undegraded":"2024-08-18T22:32:35.321877+0000","last_fullsized":"2024-08-18T22:32:35.321877+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:45:52.001371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323956+0000","last_change":"2024-08-18T22:32:33.339203+0000","last_active":"2024-08-18T22:32:35.323956+0000","last_peered":"2024-08-18T22:32:35.323956+0000","last_clean":"2024-08-18T22:32:35.323956+0000","last_became_active":"2024-08-18T22:32:33.338874+0000","last_became_peered":"2024-08-18T22:32:33.338874+0000","last_unstale":"2024-08-18T22:32:35.323956+0000","last_undegraded":"2024-08-18T22:32:35.323956+0000","last_fullsized":"2024-08-18T22:32:35.323956+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:49:22.210202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327099+0000","last_change":"2024-08-18T22:32:34.341494+0000","last_active":"2024-08-18T22:32:35.327099+0000","last_peered":"2024-08-18T22:32:35.327099+0000","last_clean":"2024-08-18T22:32:35.327099+0000","last_became_active":"2024-08-18T22:32:34.341199+0000","last_became_peered":"2024-08-18T22:32:34.341199+0000","last_unstale":"2024-08-18T22:32:35.327099+0000","last_undegraded":"2024-08-18T22:32:35.327099+0000","last_fullsized":"2024-08-18T22:32:35.327099+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:40:03.822721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327092+0000","last_change":"2024-08-18T22:32:33.344244+0000","last_active":"2024-08-18T22:32:35.327092+0000","last_peered":"2024-08-18T22:32:35.327092+0000","last_clean":"2024-08-18T22:32:35.327092+0000","last_became_active":"2024-08-18T22:32:33.340454+0000","last_became_peered":"2024-08-18T22:32:33.340454+0000","last_unstale":"2024-08-18T22:32:35.327092+0000","last_undegraded":"2024-08-18T22:32:35.327092+0000","last_fullsized":"2024-08-18T22:32:35.327092+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:47:36.398929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327924+0000","last_change":"2024-08-18T22:32:34.345237+0000","last_active":"2024-08-18T22:32:35.327924+0000","last_peered":"2024-08-18T22:32:35.327924+0000","last_clean":"2024-08-18T22:32:35.327924+0000","last_became_active":"2024-08-18T22:32:34.344918+0000","last_became_peered":"2024-08-18T22:32:34.344918+0000","last_unstale":"2024-08-18T22:32:35.327924+0000","last_undegraded":"2024-08-18T22:32:35.327924+0000","last_fullsized":"2024-08-18T22:32:35.327924+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:40.187295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327680+0000","last_change":"2024-08-18T22:32:33.336637+0000","last_active":"2024-08-18T22:32:35.327680+0000","last_peered":"2024-08-18T22:32:35.327680+0000","last_clean":"2024-08-18T22:32:35.327680+0000","last_became_active":"2024-08-18T22:32:33.336352+0000","last_became_peered":"2024-08-18T22:32:33.336352+0000","last_unstale":"2024-08-18T22:32:35.327680+0000","last_undegraded":"2024-08-18T22:32:35.327680+0000","last_fullsized":"2024-08-18T22:32:35.327680+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:52:17.548215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323611+0000","last_change":"2024-08-18T22:32:34.331651+0000","last_active":"2024-08-18T22:32:35.323611+0000","last_peered":"2024-08-18T22:32:35.323611+0000","last_clean":"2024-08-18T22:32:35.323611+0000","last_became_active":"2024-08-18T22:32:34.331317+0000","last_became_peered":"2024-08-18T22:32:34.331317+0000","last_unstale":"2024-08-18T22:32:35.323611+0000","last_undegraded":"2024-08-18T22:32:35.323611+0000","last_fullsized":"2024-08-18T22:32:35.323611+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:33:52.422831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322118+0000","last_change":"2024-08-18T22:32:33.338065+0000","last_active":"2024-08-18T22:32:35.322118+0000","last_peered":"2024-08-18T22:32:35.322118+0000","last_clean":"2024-08-18T22:32:35.322118+0000","last_became_active":"2024-08-18T22:32:33.337556+0000","last_became_peered":"2024-08-18T22:32:33.337556+0000","last_unstale":"2024-08-18T22:32:35.322118+0000","last_undegraded":"2024-08-18T22:32:35.322118+0000","last_fullsized":"2024-08-18T22:32:35.322118+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:56:18.195346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.323486+0000","last_change":"2024-08-18T22:32:34.332570+0000","last_active":"2024-08-18T22:32:35.323486+0000","last_peered":"2024-08-18T22:32:35.323486+0000","last_clean":"2024-08-18T22:32:35.323486+0000","last_became_active":"2024-08-18T22:32:34.332275+0000","last_became_peered":"2024-08-18T22:32:34.332275+0000","last_unstale":"2024-08-18T22:32:35.323486+0000","last_undegraded":"2024-08-18T22:32:35.323486+0000","last_fullsized":"2024-08-18T22:32:35.323486+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:15:22.060471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327112+0000","last_change":"2024-08-18T22:32:33.343854+0000","last_active":"2024-08-18T22:32:35.327112+0000","last_peered":"2024-08-18T22:32:35.327112+0000","last_clean":"2024-08-18T22:32:35.327112+0000","last_became_active":"2024-08-18T22:32:33.342459+0000","last_became_peered":"2024-08-18T22:32:33.342459+0000","last_unstale":"2024-08-18T22:32:35.327112+0000","last_undegraded":"2024-08-18T22:32:35.327112+0000","last_fullsized":"2024-08-18T22:32:35.327112+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:11:36.017821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.329418+0000","last_change":"2024-08-18T22:32:34.340906+0000","last_active":"2024-08-18T22:32:35.329418+0000","last_peered":"2024-08-18T22:32:35.329418+0000","last_clean":"2024-08-18T22:32:35.329418+0000","last_became_active":"2024-08-18T22:32:34.340653+0000","last_became_peered":"2024-08-18T22:32:34.340653+0000","last_unstale":"2024-08-18T22:32:35.329418+0000","last_undegraded":"2024-08-18T22:32:35.329418+0000","last_fullsized":"2024-08-18T22:32:35.329418+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:01:25.687333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327687+0000","last_change":"2024-08-18T22:32:33.336271+0000","last_active":"2024-08-18T22:32:35.327687+0000","last_peered":"2024-08-18T22:32:35.327687+0000","last_clean":"2024-08-18T22:32:35.327687+0000","last_became_active":"2024-08-18T22:32:33.335793+0000","last_became_peered":"2024-08-18T22:32:33.335793+0000","last_unstale":"2024-08-18T22:32:35.327687+0000","last_undegraded":"2024-08-18T22:32:35.327687+0000","last_fullsized":"2024-08-18T22:32:35.327687+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:27:09.734094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.327417+0000","last_change":"2024-08-18T22:32:34.347343+0000","last_active":"2024-08-18T22:32:35.327417+0000","last_peered":"2024-08-18T22:32:35.327417+0000","last_clean":"2024-08-18T22:32:35.327417+0000","last_became_active":"2024-08-18T22:32:34.347058+0000","last_became_peered":"2024-08-18T22:32:34.347058+0000","last_unstale":"2024-08-18T22:32:35.327417+0000","last_undegraded":"2024-08-18T22:32:35.327417+0000","last_fullsized":"2024-08-18T22:32:35.327417+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:33.305151+0000","last_clean_scrub_stamp":"2024-08-18T22:32:33.305151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:41.816032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"190'1","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.321993+0000","last_change":"2024-08-18T22:32:33.335923+0000","last_active":"2024-08-18T22:32:35.321993+0000","last_peered":"2024-08-18T22:32:35.321993+0000","last_clean":"2024-08-18T22:32:35.321993+0000","last_became_active":"2024-08-18T22:32:33.335475+0000","last_became_peered":"2024-08-18T22:32:33.335475+0000","last_unstale":"2024-08-18T22:32:35.321993+0000","last_undegraded":"2024-08-18T22:32:35.321993+0000","last_fullsized":"2024-08-18T22:32:35.321993+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:32:32.296530+0000","last_clean_scrub_stamp":"2024-08-18T22:32:32.296530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:40.265453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":516,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-08-18T22:32:35.322400+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:32:35.322400+0000","last_peered":"2024-08-18T22:32:35.322400+0000","last_clean":"2024-08-18T22:32:35.322400+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:32:35.322400+0000","last_undegraded":"2024-08-18T22:32:35.322400+0000","last_fullsized":"2024-08-18T22:32:35.322400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509605,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52176,"kb_used_data":2940,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319664,"statfs":{"total":96636764160,"available":96583335936,"internally_reserved":0,"allocated":3010560,"data_stored":1727374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509607,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51592,"kb_used_data":2360,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320248,"statfs":{"total":96636764160,"available":96583933952,"internally_reserved":0,"allocated":2416640,"data_stored":1137518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509605,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51580,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320260,"statfs":{"total":96636764160,"available":96583946240,"internally_reserved":0,"allocated":2408448,"data_stored":1135380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509606,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47432,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324408,"statfs":{"total":96636764160,"available":96588193792,"internally_reserved":0,"allocated":2412544,"data_stored":1135450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509605,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47420,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324420,"statfs":{"total":96636764160,"available":96588206080,"internally_reserved":0,"allocated":2400256,"data_stored":1135324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509606,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60484,"kb_used_data":2928,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311356,"statfs":{"total":96636764160,"available":96574828544,"internally_reserved":0,"allocated":2998272,"data_stored":1725782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575013,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59900,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311940,"statfs":{"total":96636764160,"available":96575426560,"internally_reserved":0,"allocated":2404352,"data_stored":1135906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575014,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59904,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311936,"statfs":{"total":96636764160,"available":96575422464,"internally_reserved":0,"allocated":2404352,"data_stored":1135414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:32:43.433 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:32:43.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:32:43.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.622+0000 7f7b0ac00640 1 Processor -- start 2024-08-18T22:32:43.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.622+0000 7f7b0ac00640 1 -- start start 2024-08-18T22:32:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b0ac00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b0415c360 0x7f7b04160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b0ac00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7b0415c740 0x7f7b0415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b0ac00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b0415d530 con 0x7f7b0415d0c0 2024-08-18T22:32:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b0ac00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7b0415d9e0 con 0x7f7b0415c360 2024-08-18T22:32:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b0ac00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7b0415dcc0 con 0x7f7b0415c740 2024-08-18T22:32:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b03e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b0415c360 0x7f7b04160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b03e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b0415c360 0x7f7b04160680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39440/0 (socket says 172.21.15.5:39440) 2024-08-18T22:32:43.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b03e00640 1 -- 172.21.15.5:0/1935484145 learned_addr learned my addr 172.21.15.5:0/1935484145 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b03e00640 1 -- 172.21.15.5:0/1935484145 >> v2:172.21.15.117:3300/0 conn(0x7f7b0415c740 msgr2=0x7f7b0415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b03e00640 1 --2- 172.21.15.5:0/1935484145 >> v2:172.21.15.117:3300/0 conn(0x7f7b0415c740 0x7f7b0415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b03e00640 1 -- 172.21.15.5:0/1935484145 >> v1:172.21.15.117:6789/0 conn(0x7f7b0415d0c0 legacy=0x7f7b0406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:43.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b03e00640 1 -- 172.21.15.5:0/1935484145 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0415dfa0 con 0x7f7b0415c360 2024-08-18T22:32:43.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b03e00640 1 --2- 172.21.15.5:0/1935484145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415c360 0x7f7b04160680 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f7b040b6540 tx=0x7f7af401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf20b132fa602b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:43.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b03400640 1 -- 172.21.15.5:0/1935484145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af40b0070 con 0x7f7b0415c360 2024-08-18T22:32:43.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b03400640 1 -- 172.21.15.5:0/1935484145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af40ab600 con 0x7f7b0415c360 2024-08-18T22:32:43.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.626+0000 7f7b03400640 1 -- 172.21.15.5:0/1935484145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af40ab9d0 con 0x7f7b0415c360 2024-08-18T22:32:43.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 -- 172.21.15.5:0/1935484145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415c360 msgr2=0x7f7b04160680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 --2- 172.21.15.5:0/1935484145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415c360 0x7f7b04160680 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f7b040b6540 tx=0x7f7af401c4e0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 -- 172.21.15.5:0/1935484145 shutdown_connections 2024-08-18T22:32:43.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 --2- 172.21.15.5:0/1935484145 >> v2:172.21.15.117:3300/0 conn(0x7f7b0415c740 0x7f7b0415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 --2- 172.21.15.5:0/1935484145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415c360 0x7f7b04160680 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 -- 172.21.15.5:0/1935484145 >> 172.21.15.5:0/1935484145 conn(0x7f7b040b65f0 msgr2=0x7f7b040b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:43.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 -- 172.21.15.5:0/1935484145 shutdown_connections 2024-08-18T22:32:43.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 -- 172.21.15.5:0/1935484145 wait complete. 2024-08-18T22:32:43.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 Processor -- start 2024-08-18T22:32:43.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 -- start start 2024-08-18T22:32:43.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415c360 0x7f7b04147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b0415c740 0x7f7b0409da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b0415d0c0 0x7f7b04148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7b04169220 con 0x7f7b0415c360 2024-08-18T22:32:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7b040ae3e0 con 0x7f7b0415d0c0 2024-08-18T22:32:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b0ac00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7b041693a0 con 0x7f7b0415c740 2024-08-18T22:32:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b03e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415c360 0x7f7b04147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b03e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415c360 0x7f7b04147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39450/0 (socket says 172.21.15.5:39450) 2024-08-18T22:32:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b03e00640 1 -- 172.21.15.5:0/3119158758 learned_addr learned my addr 172.21.15.5:0/3119158758 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b08c00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b0415d0c0 0x7f7b04148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7afb400640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b0415c740 0x7f7b0409da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b03e00640 1 -- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b0415c740 msgr2=0x7f7b0409da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b03e00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b0415c740 0x7f7b0409da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b03e00640 1 -- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b0415d0c0 msgr2=0x7f7b04148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b03e00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b0415d0c0 0x7f7b04148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b03e00640 1 -- 172.21.15.5:0/3119158758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0409df80 con 0x7f7b0415c360 2024-08-18T22:32:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.630+0000 7f7b08c00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b0415d0c0 0x7f7b04148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.634+0000 7f7b03e00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415c360 0x7f7b04147c60 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f7af40ae040 tx=0x7f7af401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.634+0000 7f7b00c00640 1 -- 172.21.15.5:0/3119158758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af40b0040 con 0x7f7b0415c360 2024-08-18T22:32:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.634+0000 7f7b00c00640 1 -- 172.21.15.5:0/3119158758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af40bc070 con 0x7f7b0415c360 2024-08-18T22:32:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.634+0000 7f7b00c00640 1 -- 172.21.15.5:0/3119158758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af40b6880 con 0x7f7b0415c360 2024-08-18T22:32:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.634+0000 7f7b0ac00640 1 -- 172.21.15.5:0/3119158758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0409e220 con 0x7f7b0415c360 2024-08-18T22:32:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.634+0000 7f7b0ac00640 1 -- 172.21.15.5:0/3119158758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b0409e7e0 con 0x7f7b0415c360 2024-08-18T22:32:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.634+0000 7f7b0ac00640 1 -- 172.21.15.5:0/3119158758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b04160680 con 0x7f7b0415c360 2024-08-18T22:32:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.634+0000 7f7b00c00640 1 -- 172.21.15.5:0/3119158758 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7af40b6a20 con 0x7f7b0415c360 2024-08-18T22:32:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.634+0000 7f7b00c00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ae00678c0 0x7f7ae0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.634+0000 7f7b00c00640 1 -- 172.21.15.5:0/3119158758 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f7af41202d0 con 0x7f7b0415c360 2024-08-18T22:32:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.634+0000 7f7afb400640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ae00678c0 0x7f7ae0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.638+0000 7f7afb400640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ae00678c0 0x7f7ae0069d80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7aec006fd0 tx=0x7f7aec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.638+0000 7f7b00c00640 1 -- 172.21.15.5:0/3119158758 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7af40160d0 con 0x7f7b0415c360 2024-08-18T22:32:43.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.862+0000 7f7b0ac00640 1 -- 172.21.15.5:0/3119158758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f7b040cd890 con 0x7f7b0415c360 2024-08-18T22:32:43.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.866+0000 7f7b00c00640 1 -- 172.21.15.5:0/3119158758 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) ==== 190+0+147 (secure 0 0 0) 0x7f7af40f0be0 con 0x7f7b0415c360 2024-08-18T22:32:43.867 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:32:43.868 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:32:43.868 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:32:43.868 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:32:43.868 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:32:43.868 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:32:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 -- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ae00678c0 msgr2=0x7f7ae0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ae00678c0 0x7f7ae0069d80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7aec006fd0 tx=0x7f7aec008040 comp rx=0 tx=0).stop 2024-08-18T22:32:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 -- 172.21.15.5:0/3119158758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415c360 msgr2=0x7f7b04147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415c360 0x7f7b04147c60 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f7af40ae040 tx=0x7f7af401ad20 comp rx=0 tx=0).stop 2024-08-18T22:32:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 -- 172.21.15.5:0/3119158758 shutdown_connections 2024-08-18T22:32:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7ae00678c0 0x7f7ae0069d80 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b0415d0c0 0x7f7b04148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b0415c740 0x7f7b0409da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 --2- 172.21.15.5:0/3119158758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b0415c360 0x7f7b04147c60 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 -- 172.21.15.5:0/3119158758 >> 172.21.15.5:0/3119158758 conn(0x7f7b040b65f0 msgr2=0x7f7b040aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 -- 172.21.15.5:0/3119158758 shutdown_connections 2024-08-18T22:32:43.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:43.870+0000 7f7b0ac00640 1 -- 172.21.15.5:0/3119158758 wait complete. 2024-08-18T22:32:43.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:32:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f7383800640 1 Processor -- start 2024-08-18T22:32:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f7383800640 1 -- start start 2024-08-18T22:32:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f7383800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 0x7f737c0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f7383800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f737c06da70 0x7f737c06df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f7383800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f737c073c80 con 0x7f737c15bed0 2024-08-18T22:32:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f7383800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f737c0ca5d0 con 0x7f737c06da70 2024-08-18T22:32:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f7383800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f737c0ca8b0 con 0x7f737c0cb390 2024-08-18T22:32:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f737be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 0x7f737c0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f7381800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f737c06da70 0x7f737c06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f737be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 0x7f737c0735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:48396/0 (socket says 172.21.15.5:48396) 2024-08-18T22:32:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f737be00640 1 -- 172.21.15.5:0/103068518 learned_addr learned my addr 172.21.15.5:0/103068518 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f7380e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f737c15bed0 0x7f737c071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:59358/0 (socket says 172.21.15.5:59358) 2024-08-18T22:32:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f737be00640 1 -- 172.21.15.5:0/103068518 >> v2:172.21.15.117:3300/0 conn(0x7f737c06da70 msgr2=0x7f737c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f737be00640 1 --2- 172.21.15.5:0/103068518 >> v2:172.21.15.117:3300/0 conn(0x7f737c06da70 0x7f737c06df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f737be00640 1 -- 172.21.15.5:0/103068518 >> v1:172.21.15.117:6789/0 conn(0x7f737c15bed0 legacy=0x7f737c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f737be00640 1 -- 172.21.15.5:0/103068518 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c0cab90 con 0x7f737c0cb390 2024-08-18T22:32:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.030+0000 7f7381800640 1 --2- 172.21.15.5:0/103068518 >> v2:172.21.15.117:3300/0 conn(0x7f737c06da70 0x7f737c06df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:32:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f737be00640 1 --2- 172.21.15.5:0/103068518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 0x7f737c0735a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7368009870 tx=0x7f736801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4773c4886509f8d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f737b400640 1 -- 172.21.15.5:0/103068518 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73680a7070 con 0x7f737c0cb390 2024-08-18T22:32:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f737b400640 1 -- 172.21.15.5:0/103068518 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73680b0070 con 0x7f737c0cb390 2024-08-18T22:32:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f737b400640 1 -- 172.21.15.5:0/103068518 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73680ab890 con 0x7f737c0cb390 2024-08-18T22:32:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f7383800640 1 -- 172.21.15.5:0/103068518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 msgr2=0x7f737c0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f7383800640 1 --2- 172.21.15.5:0/103068518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 0x7f737c0735a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7368009870 tx=0x7f736801c560 comp rx=0 tx=0).stop 2024-08-18T22:32:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f7383800640 1 -- 172.21.15.5:0/103068518 shutdown_connections 2024-08-18T22:32:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f7383800640 1 --2- 172.21.15.5:0/103068518 >> v2:172.21.15.117:3300/0 conn(0x7f737c06da70 0x7f737c06df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f7383800640 1 --2- 172.21.15.5:0/103068518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 0x7f737c0735a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f7383800640 1 -- 172.21.15.5:0/103068518 >> 172.21.15.5:0/103068518 conn(0x7f737c0b1c50 msgr2=0x7f737c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f7383800640 1 -- 172.21.15.5:0/103068518 shutdown_connections 2024-08-18T22:32:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.034+0000 7f7383800640 1 -- 172.21.15.5:0/103068518 wait complete. 2024-08-18T22:32:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7383800640 1 Processor -- start 2024-08-18T22:32:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7383800640 1 -- start start 2024-08-18T22:32:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7383800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f737c06da70 0x7f737c158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7383800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 0x7f737c0b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7383800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f737c15bed0 0x7f737c0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7383800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f737c168730 con 0x7f737c06da70 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7383800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f737c1685b0 con 0x7f737c15bed0 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7383800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f737c1688b0 con 0x7f737c0cb390 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7380e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f737c06da70 0x7f737c158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7380e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f737c06da70 0x7f737c158bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39460/0 (socket says 172.21.15.5:39460) 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7380e00640 1 -- 172.21.15.5:0/4286268407 learned_addr learned my addr 172.21.15.5:0/4286268407 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7381800640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f737c15bed0 0x7f737c0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f737be00640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 0x7f737c0b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7380e00640 1 -- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 msgr2=0x7f737c0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7380e00640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 0x7f737c0b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7380e00640 1 -- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f737c15bed0 msgr2=0x7f737c0c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7380e00640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f737c15bed0 0x7f737c0c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7380e00640 1 -- 172.21.15.5:0/4286268407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c0b5240 con 0x7f737c06da70 2024-08-18T22:32:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7381800640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f737c15bed0 0x7f737c0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:32:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7380e00640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f737c06da70 0x7f737c158bf0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f737000c420 tx=0x7f737000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7378c00640 1 -- 172.21.15.5:0/4286268407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73700074e0 con 0x7f737c06da70 2024-08-18T22:32:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7378c00640 1 -- 172.21.15.5:0/4286268407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7370007680 con 0x7f737c06da70 2024-08-18T22:32:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7378c00640 1 -- 172.21.15.5:0/4286268407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370004a30 con 0x7f737c06da70 2024-08-18T22:32:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7383800640 1 -- 172.21.15.5:0/4286268407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737c0b5520 con 0x7f737c06da70 2024-08-18T22:32:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.038+0000 7f7383800640 1 -- 172.21.15.5:0/4286268407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737c0b5ae0 con 0x7f737c06da70 2024-08-18T22:32:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.042+0000 7f7383800640 1 -- 172.21.15.5:0/4286268407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f737c0cc480 con 0x7f737c06da70 2024-08-18T22:32:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.042+0000 7f7378c00640 1 -- 172.21.15.5:0/4286268407 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f737001a020 con 0x7f737c06da70 2024-08-18T22:32:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.042+0000 7f7378c00640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f735c0678c0 0x7f735c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.042+0000 7f7378c00640 1 -- 172.21.15.5:0/4286268407 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f7370085530 con 0x7f737c06da70 2024-08-18T22:32:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.042+0000 7f737be00640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f735c0678c0 0x7f735c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.042+0000 7f737be00640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f735c0678c0 0x7f735c069d80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f73680af000 tx=0x7f73680a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.046+0000 7f7378c00640 1 -- 172.21.15.5:0/4286268407 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7370055ed0 con 0x7f737c06da70 2024-08-18T22:32:44.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 -- 172.21.15.5:0/4286268407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f737c159130 con 0x7f737c06da70 2024-08-18T22:32:44.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7378c00640 1 -- 172.21.15.5:0/4286268407 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) ==== 95+0+5229 (secure 0 0 0) 0x7f73700557d0 con 0x7f737c06da70 2024-08-18T22:32:44.251 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:44.251 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":151,"btime":"2024-08-18T22:32:37:342248+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/983387831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":983387831},{"type":"v1","addr":"172.21.15.5:6833","nonce":983387831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2495123422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2495123422},{"type":"v1","addr":"172.21.15.117:6836","nonce":2495123422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/53072457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":53072457},{"type":"v1","addr":"172.21.15.117:6837","nonce":53072457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:32:33.724910+0000","modified":"2024-08-18T22:32:36.736018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10350":{"gid":10350,"name":"a","rank":0,"incarnation":147,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/114900580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":114900580},{"type":"v1","addr":"172.21.15.5:6835","nonce":114900580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10350,"qdb_cluster":[10350]},"id":13}]} 2024-08-18T22:32:44.251 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 151 2024-08-18T22:32:44.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 -- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f735c0678c0 msgr2=0x7f735c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f735c0678c0 0x7f735c069d80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f73680af000 tx=0x7f73680a7000 comp rx=0 tx=0).stop 2024-08-18T22:32:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 -- 172.21.15.5:0/4286268407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f737c06da70 msgr2=0x7f737c158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f737c06da70 0x7f737c158bf0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f737000c420 tx=0x7f737000c820 comp rx=0 tx=0).stop 2024-08-18T22:32:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 -- 172.21.15.5:0/4286268407 shutdown_connections 2024-08-18T22:32:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f735c0678c0 0x7f735c069d80 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f737c15bed0 0x7f737c0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f737c0cb390 0x7f737c0b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 --2- 172.21.15.5:0/4286268407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f737c06da70 0x7f737c158bf0 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 -- 172.21.15.5:0/4286268407 >> 172.21.15.5:0/4286268407 conn(0x7f737c0b1c50 msgr2=0x7f737c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 -- 172.21.15.5:0/4286268407 shutdown_connections 2024-08-18T22:32:44.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.250+0000 7f7383800640 1 -- 172.21.15.5:0/4286268407 wait complete. 2024-08-18T22:32:44.674 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 151, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:32:33.724910+0000', 'modified': '2024-08-18T22:32:36.736018+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10350}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10350': {'gid': 10350, 'name': 'a', 'rank': 0, 'incarnation': 147, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/114900580', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 114900580}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 114900580}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10350, 'qdb_cluster': [10350]} 2024-08-18T22:32:44.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:32:44.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-18T22:32:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22edc00640 1 Processor -- start 2024-08-18T22:32:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22edc00640 1 -- start start 2024-08-18T22:32:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22edc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f22e815c180 0x7f22e80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22edc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22e815c560 0x7f22e80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22edc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e80cfb00 con 0x7f22e815d4d0 2024-08-18T22:32:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22edc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f22e815d040 con 0x7f22e815c560 2024-08-18T22:32:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22edc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f22e815c9f0 con 0x7f22e815c180 2024-08-18T22:32:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22e6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22e815c560 0x7f22e80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22e6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22e815c560 0x7f22e80ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39466/0 (socket says 172.21.15.5:39466) 2024-08-18T22:32:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22e6000640 1 -- 172.21.15.5:0/1606544544 learned_addr learned my addr 172.21.15.5:0/1606544544 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22e6a00640 1 --2- 172.21.15.5:0/1606544544 >> v2:172.21.15.117:3300/0 conn(0x7f22e815c180 0x7f22e80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22e6000640 1 -- 172.21.15.5:0/1606544544 >> v2:172.21.15.117:3300/0 conn(0x7f22e815c180 msgr2=0x7f22e80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22e6000640 1 --2- 172.21.15.5:0/1606544544 >> v2:172.21.15.117:3300/0 conn(0x7f22e815c180 0x7f22e80cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22e6000640 1 -- 172.21.15.5:0/1606544544 >> v1:172.21.15.117:6789/0 conn(0x7f22e815d4d0 legacy=0x7f22e815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.818+0000 7f22e6000640 1 -- 172.21.15.5:0/1606544544 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e815ccd0 con 0x7f22e815c560 2024-08-18T22:32:44.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22e6000640 1 --2- 172.21.15.5:0/1606544544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e815c560 0x7f22e80ce450 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f22e806d8a0 tx=0x7f22d401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6aeff367b32058b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22e5600640 1 -- 172.21.15.5:0/1606544544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d40aa610 con 0x7f22e815c560 2024-08-18T22:32:44.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22e5600640 1 -- 172.21.15.5:0/1606544544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d40af070 con 0x7f22e815c560 2024-08-18T22:32:44.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22e5600640 1 -- 172.21.15.5:0/1606544544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d40aa9d0 con 0x7f22e815c560 2024-08-18T22:32:44.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22edc00640 1 -- 172.21.15.5:0/1606544544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e815c560 msgr2=0x7f22e80ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22edc00640 1 --2- 172.21.15.5:0/1606544544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e815c560 0x7f22e80ce450 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f22e806d8a0 tx=0x7f22d401c490 comp rx=0 tx=0).stop 2024-08-18T22:32:44.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22edc00640 1 -- 172.21.15.5:0/1606544544 shutdown_connections 2024-08-18T22:32:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22edc00640 1 --2- 172.21.15.5:0/1606544544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e815c560 0x7f22e80ce450 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22edc00640 1 --2- 172.21.15.5:0/1606544544 >> v2:172.21.15.117:3300/0 conn(0x7f22e815c180 0x7f22e80cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22edc00640 1 -- 172.21.15.5:0/1606544544 >> 172.21.15.5:0/1606544544 conn(0x7f22e80b1dc0 msgr2=0x7f22e80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22edc00640 1 -- 172.21.15.5:0/1606544544 shutdown_connections 2024-08-18T22:32:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.822+0000 7f22edc00640 1 -- 172.21.15.5:0/1606544544 wait complete. 2024-08-18T22:32:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22edc00640 1 Processor -- start 2024-08-18T22:32:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22edc00640 1 -- start start 2024-08-18T22:32:44.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22edc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e815c180 0x7f22e8150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22edc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e815d4d0 0x7f22e8154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22edc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e8154e80 0x7f22e815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22edc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81692b0 con 0x7f22e815d4d0 2024-08-18T22:32:44.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22edc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8169130 con 0x7f22e815c180 2024-08-18T22:32:44.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22edc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22e8169430 con 0x7f22e8154e80 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22e6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e815d4d0 0x7f22e8154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22e6a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e815c180 0x7f22e8150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22e6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e815d4d0 0x7f22e8154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39480/0 (socket says 172.21.15.5:39480) 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22e6000640 1 -- 172.21.15.5:0/375045793 learned_addr learned my addr 172.21.15.5:0/375045793 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22e7400640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e8154e80 0x7f22e815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22e6000640 1 -- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e8154e80 msgr2=0x7f22e815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22e6000640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e8154e80 0x7f22e815aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22e6000640 1 -- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e815c180 msgr2=0x7f22e8150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22e6000640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e815c180 0x7f22e8150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22e6000640 1 -- 172.21.15.5:0/375045793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e81554c0 con 0x7f22e815d4d0 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22e6000640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e815d4d0 0x7f22e8154940 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f22d40190a0 tx=0x7f22d401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22dea00640 1 -- 172.21.15.5:0/375045793 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d40bd5f0 con 0x7f22e815d4d0 2024-08-18T22:32:44.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22dea00640 1 -- 172.21.15.5:0/375045793 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d40bd790 con 0x7f22e815d4d0 2024-08-18T22:32:44.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22dea00640 1 -- 172.21.15.5:0/375045793 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d40bdb40 con 0x7f22e815d4d0 2024-08-18T22:32:44.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22edc00640 1 -- 172.21.15.5:0/375045793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e81557a0 con 0x7f22e815d4d0 2024-08-18T22:32:44.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.826+0000 7f22edc00640 1 -- 172.21.15.5:0/375045793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e8155d60 con 0x7f22e815d4d0 2024-08-18T22:32:44.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.830+0000 7f22dea00640 1 -- 172.21.15.5:0/375045793 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f22d40b33f0 con 0x7f22e815d4d0 2024-08-18T22:32:44.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.830+0000 7f22dea00640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22c80678c0 0x7f22c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.830+0000 7f22dea00640 1 -- 172.21.15.5:0/375045793 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f22d4120090 con 0x7f22e815d4d0 2024-08-18T22:32:44.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.830+0000 7f22e6a00640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22c80678c0 0x7f22c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.830+0000 7f22f10f3000 1 Processor -- start 2024-08-18T22:32:44.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 -- start start 2024-08-18T22:32:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e6a00640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22c80678c0 0x7f22c8069d80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f22d8007a60 tx=0x7f22d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b1ddd50 0x560b1b1de130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1de670 0x560b1b194450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b194990 0x560b1b194d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560b1b07afd0 con 0x560b1b1ddd50 2024-08-18T22:32:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560b1afe13c0 con 0x560b1b1de670 2024-08-18T22:32:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560b1af86f70 con 0x560b1b194990 2024-08-18T22:32:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b1ddd50 0x560b1b1de130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b1ddd50 0x560b1b1de130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39496/0 (socket says 172.21.15.5:39496) 2024-08-18T22:32:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e6a00640 1 -- 172.21.15.5:0/1676848529 learned_addr learned my addr 172.21.15.5:0/1676848529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:44.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e6000640 1 --2- 172.21.15.5:0/1676848529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1de670 0x560b1b194450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e7400640 1 --2- 172.21.15.5:0/1676848529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b194990 0x560b1b194d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e6a00640 1 -- 172.21.15.5:0/1676848529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b194990 msgr2=0x560b1b194d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:44.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e6a00640 1 --2- 172.21.15.5:0/1676848529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b194990 0x560b1b194d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e6a00640 1 -- 172.21.15.5:0/1676848529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1de670 msgr2=0x560b1b194450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:44.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e6a00640 1 --2- 172.21.15.5:0/1676848529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1de670 0x560b1b194450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e6a00640 1 -- 172.21.15.5:0/1676848529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b1af7b2e0 con 0x560b1b1ddd50 2024-08-18T22:32:44.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22e6a00640 1 --2- 172.21.15.5:0/1676848529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b1ddd50 0x560b1b1de130 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f22d8007fd0 tx=0x7f22d8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368c07af6c69c27b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22d3400640 1 -- 172.21.15.5:0/1676848529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d801c050 con 0x560b1b1ddd50 2024-08-18T22:32:44.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22d3400640 1 -- 172.21.15.5:0/1676848529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d8026070 con 0x560b1b1ddd50 2024-08-18T22:32:44.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22d3400640 1 -- 172.21.15.5:0/1676848529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8021640 con 0x560b1b1ddd50 2024-08-18T22:32:44.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 -- 172.21.15.5:0/1676848529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b1ddd50 msgr2=0x560b1b1de130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 --2- 172.21.15.5:0/1676848529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b1ddd50 0x560b1b1de130 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f22d8007fd0 tx=0x7f22d8013000 comp rx=0 tx=0).stop 2024-08-18T22:32:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 -- 172.21.15.5:0/1676848529 shutdown_connections 2024-08-18T22:32:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 --2- 172.21.15.5:0/1676848529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b194990 0x560b1b194d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 --2- 172.21.15.5:0/1676848529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1de670 0x560b1b194450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 --2- 172.21.15.5:0/1676848529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b1ddd50 0x560b1b1de130 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 -- 172.21.15.5:0/1676848529 >> 172.21.15.5:0/1676848529 conn(0x560b1b190910 msgr2=0x560b1b192d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 -- 172.21.15.5:0/1676848529 shutdown_connections 2024-08-18T22:32:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 -- 172.21.15.5:0/1676848529 wait complete. 2024-08-18T22:32:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 -- start start 2024-08-18T22:32:44.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.834+0000 7f22f10f3000 1 Processor -- start 2024-08-18T22:32:44.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1ddd50 0x560b1b199b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 0x560b1b19a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560b1af88e40 con 0x560b1b194990 2024-08-18T22:32:44.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560b1b09eaf0 con 0x560b1b1ddd50 2024-08-18T22:32:44.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560b1b043450 con 0x560b1b1de670 2024-08-18T22:32:44.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 10 client.0 _ll_register_callbacks cb 0x560b1b17f630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:44.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39504/0 (socket says 172.21.15.5:39504) 2024-08-18T22:32:44.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6a00640 1 -- 172.21.15.5:0/3636189513 learned_addr learned my addr 172.21.15.5:0/3636189513 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:44.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6000640 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1ddd50 0x560b1b199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e7400640 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 0x560b1b19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6a00640 1 -- 172.21.15.5:0/3636189513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 msgr2=0x560b1b19a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:44.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6a00640 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 0x560b1b19a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6a00640 1 -- 172.21.15.5:0/3636189513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1ddd50 msgr2=0x560b1b199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:44.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6a00640 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1ddd50 0x560b1b199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6a00640 1 -- 172.21.15.5:0/3636189513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b1af68fd0 con 0x560b1b194990 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e7400640 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 0x560b1b19a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6a00640 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1cb640 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x560b1b1846a0 tx=0x7f22d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2406dc5decc033c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22c7e00640 1 -- 172.21.15.5:0/3636189513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8016e50 con 0x560b1b194990 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22c7e00640 1 -- 172.21.15.5:0/3636189513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f22d8021db0 con 0x560b1b194990 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 1 -- 172.21.15.5:0/3636189513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22d8026070 con 0x560b1b194990 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22c7e00640 1 -- 172.21.15.5:0/3636189513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f22d803c050 con 0x560b1b194990 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 10 client.10488 fetch_fsmap learned FSMap version 151 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 1 -- 172.21.15.5:0/3636189513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x560b1b0644d0 con 0x560b1b194990 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22c7e00640 1 -- 172.21.15.5:0/3636189513 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d8026070 con 0x560b1b194990 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22c7e00640 1 -- 172.21.15.5:0/3636189513 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7f22d803f020 con 0x560b1b194990 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 10 client.10488 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:32:44.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 10 client.10488 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:32:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 20 client.10488 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560b1b1cc4f0 0x560b1b1cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 4 client.10488 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:32:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22f10f3000 1 -- 172.21.15.5:0/3636189513 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b1af7bc00 con 0x560b1b1cc4f0 2024-08-18T22:32:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6000640 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560b1b1cc4f0 0x560b1b1cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22e6000640 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560b1b1cc4f0 0x560b1b1cc8d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91c235a8039adb9e server_cookie=ab7b81c4451d8bbe in_seq=0 out_seq=0 2024-08-18T22:32:44.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.838+0000 7f22c7e00640 10 client.10488 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22c7e00640 1 -- 172.21.15.5:0/3636189513 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560b1af7bc00 con 0x560b1b1cc4f0 2024-08-18T22:32:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22c7e00640 10 client.10488 handle_command_reply: tid=0 2024-08-18T22:32:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 1 client.10488 shutdown 2024-08-18T22:32:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 1 -- 172.21.15.5:0/3636189513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 msgr2=0x560b1b1cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1cb640 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x560b1b1846a0 tx=0x7f22d8004740 comp rx=0 tx=0).stop 2024-08-18T22:32:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 1 -- 172.21.15.5:0/3636189513 shutdown_connections 2024-08-18T22:32:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560b1b1cc4f0 0x560b1b1cc8d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 0x560b1b19a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1ddd50 0x560b1b199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3636189513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1cb640 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 1 -- 172.21.15.5:0/3636189513 >> 172.21.15.5:0/3636189513 conn(0x560b1b190910 msgr2=0x560b1b193520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22c7e00640 0 client.10488 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 1 -- 172.21.15.5:0/3636189513 shutdown_connections 2024-08-18T22:32:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 1 -- 172.21.15.5:0/3636189513 wait complete. 2024-08-18T22:32:44.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.842+0000 7f22f10f3000 20 client.10488 trim_cache size 0 max 16384 2024-08-18T22:32:44.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.858+0000 7f22f10f3000 1 Processor -- start 2024-08-18T22:32:44.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.858+0000 7f22f10f3000 1 -- start start 2024-08-18T22:32:44.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1dd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1ddd50 0x560b1b1dd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 0x560b1b1f5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8203290 con 0x560b1b194990 2024-08-18T22:32:44.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8166a30 con 0x560b1b1ddd50 2024-08-18T22:32:44.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22e8202ca0 con 0x560b1b1de670 2024-08-18T22:32:44.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1dd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1dd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39518/0 (socket says 172.21.15.5:39518) 2024-08-18T22:32:44.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e6a00640 1 -- 172.21.15.5:0/474395075 learned_addr learned my addr 172.21.15.5:0/474395075 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:44.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e7400640 1 --2- 172.21.15.5:0/474395075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 0x560b1b1f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e6000640 1 --2- 172.21.15.5:0/474395075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1ddd50 0x560b1b1dd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e6a00640 1 -- 172.21.15.5:0/474395075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 msgr2=0x560b1b1f5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:44.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e6a00640 1 --2- 172.21.15.5:0/474395075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 0x560b1b1f5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e6a00640 1 -- 172.21.15.5:0/474395075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1ddd50 msgr2=0x560b1b1dd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:44.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e6a00640 1 --2- 172.21.15.5:0/474395075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1ddd50 0x560b1b1dd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e6a00640 1 -- 172.21.15.5:0/474395075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b1afdab30 con 0x560b1b194990 2024-08-18T22:32:44.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e7400640 1 --2- 172.21.15.5:0/474395075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 0x560b1b1f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:44.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e6000640 1 --2- 172.21.15.5:0/474395075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1ddd50 0x560b1b1dd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:44.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22e6a00640 1 --2- 172.21.15.5:0/474395075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1dd060 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f22d8010ac0 tx=0x7f22d802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451f10ece0a5375c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22d2a00640 1 -- 172.21.15.5:0/474395075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d801c040 con 0x560b1b194990 2024-08-18T22:32:44.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22d2a00640 1 -- 172.21.15.5:0/474395075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d8045070 con 0x560b1b194990 2024-08-18T22:32:44.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22d2a00640 1 -- 172.21.15.5:0/474395075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8004230 con 0x560b1b194990 2024-08-18T22:32:44.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 -- 172.21.15.5:0/474395075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 msgr2=0x560b1b1dd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 --2- 172.21.15.5:0/474395075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1dd060 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f22d8010ac0 tx=0x7f22d802e070 comp rx=0 tx=0).stop 2024-08-18T22:32:44.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 -- 172.21.15.5:0/474395075 shutdown_connections 2024-08-18T22:32:44.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 --2- 172.21.15.5:0/474395075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1de670 0x560b1b1f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 --2- 172.21.15.5:0/474395075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1ddd50 0x560b1b1dd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 --2- 172.21.15.5:0/474395075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1dd060 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 -- 172.21.15.5:0/474395075 >> 172.21.15.5:0/474395075 conn(0x560b1b190910 msgr2=0x560b1b1dc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 -- 172.21.15.5:0/474395075 shutdown_connections 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 -- 172.21.15.5:0/474395075 wait complete. 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 -- start start 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.862+0000 7f22f10f3000 1 Processor -- start 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1f2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1ddd50 0x560b1b1f2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1de670 0x560b1b1f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560b1af9a1d0 con 0x560b1b194990 2024-08-18T22:32:44.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560b1af78900 con 0x560b1b1de670 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560b1afe06d0 con 0x560b1b1ddd50 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 10 client.0 _ll_register_callbacks cb 0x7f22e00014b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22e6a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1f2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39532/0 (socket says 172.21.15.5:39532) 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22e6a00640 1 -- 172.21.15.5:0/3634968375 learned_addr learned my addr 172.21.15.5:0/3634968375 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22e6a00640 1 -- 172.21.15.5:0/3634968375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1ddd50 msgr2=0x560b1b1f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22e6a00640 1 --2- 172.21.15.5:0/3634968375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1ddd50 0x560b1b1f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22e6a00640 1 -- 172.21.15.5:0/3634968375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1de670 msgr2=0x560b1b1f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22e6a00640 1 --2- 172.21.15.5:0/3634968375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1de670 0x560b1b1f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22e6a00640 1 -- 172.21.15.5:0/3634968375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b1af92810 con 0x560b1b194990 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22e6a00640 1 --2- 172.21.15.5:0/3634968375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1f2350 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f22d8010830 tx=0x7f22d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8145936dfc6d4e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:44.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22c7e00640 1 -- 172.21.15.5:0/3634968375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d804e060 con 0x560b1b194990 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22c7e00640 1 -- 172.21.15.5:0/3634968375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f22d8004440 con 0x560b1b194990 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 -- 172.21.15.5:0/3634968375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22d8045070 con 0x560b1b194990 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22c7e00640 1 -- 172.21.15.5:0/3634968375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f22d8054050 con 0x560b1b194990 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 10 client.10494 fetch_fsmap learned FSMap version 151 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 -- 172.21.15.5:0/3634968375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x560b1af77d30 con 0x560b1b194990 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22c7e00640 1 -- 172.21.15.5:0/3634968375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d8045070 con 0x560b1b194990 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22c7e00640 1 -- 172.21.15.5:0/3634968375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7f22d8057020 con 0x560b1b194990 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 10 client.10494 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 10 client.10494 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 20 client.10494 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3634968375 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560b1b1f3310 0x560b1b1f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 4 client.10494 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 -- 172.21.15.5:0/3634968375 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "status"}) -- 0x560b1afeeaf0 con 0x560b1b1f3310 2024-08-18T22:32:44.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22e6000640 1 --2- 172.21.15.5:0/3634968375 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560b1b1f3310 0x560b1b1f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22e6000640 1 --2- 172.21.15.5:0/3634968375 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560b1b1f3310 0x560b1b1f36f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a56a09189350e172 server_cookie=712217a025f3708a in_seq=0 out_seq=0 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22c7e00640 10 client.10494 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22c7e00640 1 -- 172.21.15.5:0/3634968375 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x560b1afeeaf0 con 0x560b1b1f3310 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22c7e00640 10 client.10494 handle_command_reply: tid=0 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 client.10494 shutdown 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 -- 172.21.15.5:0/3634968375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 msgr2=0x560b1b1f2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3634968375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1f2350 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f22d8010830 tx=0x7f22d8016000 comp rx=0 tx=0).stop 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 -- 172.21.15.5:0/3634968375 shutdown_connections 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3634968375 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560b1b1f3310 0x560b1b1f36f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3634968375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1b1de670 0x560b1b1f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3634968375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560b1b1ddd50 0x560b1b1f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22c7e00640 0 client.10494 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 --2- 172.21.15.5:0/3634968375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b1b194990 0x560b1b1f2350 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 -- 172.21.15.5:0/3634968375 >> 172.21.15.5:0/3634968375 conn(0x560b1b190910 msgr2=0x560b1b1dd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:44.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 -- 172.21.15.5:0/3634968375 shutdown_connections 2024-08-18T22:32:44.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 1 -- 172.21.15.5:0/3634968375 wait complete. 2024-08-18T22:32:44.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.866+0000 7f22f10f3000 20 client.10494 trim_cache size 0 max 16384 2024-08-18T22:32:44.874 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:32:44.874 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:32:44.874 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:32:44.874 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 10350, 2024-08-18T22:32:44.874 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:32:44.874 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:32:44.874 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:32:44.875 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.540521838, 2024-08-18T22:32:44.875 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 151, 2024-08-18T22:32:44.875 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 191, 2024-08-18T22:32:44.875 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 191, 2024-08-18T22:32:44.875 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15.742690522 2024-08-18T22:32:44.875 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:32:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 -- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22c80678c0 msgr2=0x7f22c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22c80678c0 0x7f22c8069d80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f22d8007a60 tx=0x7f22d8008040 comp rx=0 tx=0).stop 2024-08-18T22:32:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 -- 172.21.15.5:0/375045793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e815d4d0 msgr2=0x7f22e8154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e815d4d0 0x7f22e8154940 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f22d40190a0 tx=0x7f22d401acd0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 -- 172.21.15.5:0/375045793 shutdown_connections 2024-08-18T22:32:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22c80678c0 0x7f22c8069d80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e8154e80 0x7f22e815aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e815d4d0 0x7f22e8154940 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 --2- 172.21.15.5:0/375045793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e815c180 0x7f22e8150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 -- 172.21.15.5:0/375045793 >> 172.21.15.5:0/375045793 conn(0x7f22e80b1dc0 msgr2=0x7f22e80cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:44.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 -- 172.21.15.5:0/375045793 shutdown_connections 2024-08-18T22:32:44.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:44.870+0000 7f22edc00640 1 -- 172.21.15.5:0/375045793 wait complete. 2024-08-18T22:32:44.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:32:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.026+0000 7f18d0a00640 1 Processor -- start 2024-08-18T22:32:45.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.026+0000 7f18d0a00640 1 -- start start 2024-08-18T22:32:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18d0a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc15b010 0x7f18cc0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18d0a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f18cc06f290 0x7f18cc072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18d0a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18cc0cee20 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18d0a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f18cc0cfa30 con 0x7f18cc06f290 2024-08-18T22:32:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18d0a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc0cf100 con 0x7f18cc15b010 2024-08-18T22:32:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18c9e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc15b010 0x7f18cc0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18ca800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f18cc06f290 0x7f18cc072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18c9e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc15b010 0x7f18cc0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:48456/0 (socket says 172.21.15.5:48456) 2024-08-18T22:32:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18c9e00640 1 -- 172.21.15.5:0/2194707982 learned_addr learned my addr 172.21.15.5:0/2194707982 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18c3e00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f18cc0cd3a0 0x7f18cc06eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:59378/0 (socket says 172.21.15.5:59378) 2024-08-18T22:32:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18c9e00640 1 -- 172.21.15.5:0/2194707982 >> v2:172.21.15.117:3300/0 conn(0x7f18cc06f290 msgr2=0x7f18cc072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18c9e00640 1 --2- 172.21.15.5:0/2194707982 >> v2:172.21.15.117:3300/0 conn(0x7f18cc06f290 0x7f18cc072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18c9e00640 1 -- 172.21.15.5:0/2194707982 >> v1:172.21.15.117:6789/0 conn(0x7f18cc0cd3a0 legacy=0x7f18cc06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:45.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.030+0000 7f18c9e00640 1 -- 172.21.15.5:0/2194707982 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc0cf3e0 con 0x7f18cc15b010 2024-08-18T22:32:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18c9e00640 1 --2- 172.21.15.5:0/2194707982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc15b010 0x7f18cc0ce840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009870 tx=0x7f18bc01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4d7087f4f847a0b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18c9400640 1 -- 172.21.15.5:0/2194707982 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc0ab660 con 0x7f18cc15b010 2024-08-18T22:32:45.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18c9400640 1 -- 172.21.15.5:0/2194707982 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18bc0b0070 con 0x7f18cc15b010 2024-08-18T22:32:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18c9400640 1 -- 172.21.15.5:0/2194707982 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc0aba20 con 0x7f18cc15b010 2024-08-18T22:32:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18d0a00640 1 -- 172.21.15.5:0/2194707982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc15b010 msgr2=0x7f18cc0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18d0a00640 1 --2- 172.21.15.5:0/2194707982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc15b010 0x7f18cc0ce840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009870 tx=0x7f18bc01c530 comp rx=0 tx=0).stop 2024-08-18T22:32:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18d0a00640 1 -- 172.21.15.5:0/2194707982 shutdown_connections 2024-08-18T22:32:45.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18d0a00640 1 --2- 172.21.15.5:0/2194707982 >> v2:172.21.15.117:3300/0 conn(0x7f18cc06f290 0x7f18cc072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18d0a00640 1 --2- 172.21.15.5:0/2194707982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc15b010 0x7f18cc0ce840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18d0a00640 1 -- 172.21.15.5:0/2194707982 >> 172.21.15.5:0/2194707982 conn(0x7f18cc0b1c50 msgr2=0x7f18cc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18d0a00640 1 -- 172.21.15.5:0/2194707982 shutdown_connections 2024-08-18T22:32:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18d0a00640 1 -- 172.21.15.5:0/2194707982 wait complete. 2024-08-18T22:32:45.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18d0a00640 1 Processor -- start 2024-08-18T22:32:45.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.034+0000 7f18d0a00640 1 -- start start 2024-08-18T22:32:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18d0a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc06f290 0x7f18cc1519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18d0a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc0cd3a0 0x7f18cc0b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18d0a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18cc15b010 0x7f18cc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18d0a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc0734f0 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18d0a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc073370 con 0x7f18cc15b010 2024-08-18T22:32:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18d0a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc073670 con 0x7f18cc06f290 2024-08-18T22:32:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc0cd3a0 0x7f18cc0b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc0cd3a0 0x7f18cc0b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39544/0 (socket says 172.21.15.5:39544) 2024-08-18T22:32:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c3e00640 1 -- 172.21.15.5:0/2855056433 learned_addr learned my addr 172.21.15.5:0/2855056433 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c9e00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc06f290 0x7f18cc1519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18ca800640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18cc15b010 0x7f18cc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c3e00640 1 -- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc06f290 msgr2=0x7f18cc1519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c3e00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc06f290 0x7f18cc1519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c3e00640 1 -- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18cc15b010 msgr2=0x7f18cc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c3e00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18cc15b010 0x7f18cc09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c3e00640 1 -- 172.21.15.5:0/2855056433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc0b0ec0 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c3e00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc0cd3a0 0x7f18cc0b04e0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f18b400c430 tx=0x7f18b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c2000640 1 -- 172.21.15.5:0/2855056433 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b40074e0 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c2000640 1 -- 172.21.15.5:0/2855056433 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b4007680 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18c2000640 1 -- 172.21.15.5:0/2855056433 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4004a30 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18d0a00640 1 -- 172.21.15.5:0/2855056433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc15bee0 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18d0a00640 1 -- 172.21.15.5:0/2855056433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc15c780 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.038+0000 7f18d0a00640 1 -- 172.21.15.5:0/2855056433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc15c2d0 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.042+0000 7f18c2000640 1 -- 172.21.15.5:0/2855056433 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f18b401a020 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.042+0000 7f18c2000640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a80678c0 0x7f18a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:45.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.042+0000 7f18c2000640 1 -- 172.21.15.5:0/2855056433 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f18b40854f0 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.042+0000 7f18c9e00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a80678c0 0x7f18a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.042+0000 7f18c9e00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a80678c0 0x7f18a8069d80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0af000 tx=0x7f18bc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.046+0000 7f18c2000640 1 -- 172.21.15.5:0/2855056433 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f18b4055830 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.246+0000 7f18d0a00640 1 -- 172.21.15.5:0/2855056433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f18cc15c0b0 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.246+0000 7f18c2000640 1 -- 172.21.15.5:0/2855056433 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v151) ==== 53+0+73 (secure 0 0 0) 0x7f18b4059b30 con 0x7f18cc0cd3a0 2024-08-18T22:32:45.249 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:32:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 -- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a80678c0 msgr2=0x7f18a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a80678c0 0x7f18a8069d80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0af000 tx=0x7f18bc0a7000 comp rx=0 tx=0).stop 2024-08-18T22:32:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 -- 172.21.15.5:0/2855056433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc0cd3a0 msgr2=0x7f18cc0b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:45.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc0cd3a0 0x7f18cc0b04e0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f18b400c430 tx=0x7f18b400c8f0 comp rx=0 tx=0).stop 2024-08-18T22:32:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 -- 172.21.15.5:0/2855056433 shutdown_connections 2024-08-18T22:32:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f18a80678c0 0x7f18a8069d80 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18cc15b010 0x7f18cc09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc0cd3a0 0x7f18cc0b04e0 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 --2- 172.21.15.5:0/2855056433 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18cc06f290 0x7f18cc1519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 -- 172.21.15.5:0/2855056433 >> 172.21.15.5:0/2855056433 conn(0x7f18cc0b1c50 msgr2=0x7f18cc0c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 -- 172.21.15.5:0/2855056433 shutdown_connections 2024-08-18T22:32:45.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45.250+0000 7f18d0a00640 1 -- 172.21.15.5:0/2855056433 wait complete. 2024-08-18T22:32:45.269 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:32:45.270 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:32:45.270 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:32:45.270 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:32:45.270 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:32:45.270 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:32:45.270 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:32:45.270 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:32:45.270 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:32:45.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:32:45.271 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:32:45.279 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:32:45.280 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41636sec preferred_lft 41636sec 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:32:45.281 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:32:45.282 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:32:45.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:32:45.283 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:32:45.343 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:32:45.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:32:45.345 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:32:45.398 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:32:45.399 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:32:45.399 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:32:45.399 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:32:45.399 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:32:45.399 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:32:45.399 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:32:45.399 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:32:45.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:32:45.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:32:45.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:32:45.400 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:32:45.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:32:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:45.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:32:45.539 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:32:45.547 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:32:45.547 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:32:45.548 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:32:45.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:32:45.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:32:45.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:32:45.613 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:32:45.669 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:32:45.670 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:32:45.670 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:32:45.720 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:32:45.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:32:45.721 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:32:45.814 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:32:45.814 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:32:45.814 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:32:45.830 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:32:45.830 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:32:45.830 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:32:45.830 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:32:45.830 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:32:45.840 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:32:45.840 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:32:45.840 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:32:45.840 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:32:45.841 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:32:45.841 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:32:45.841 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:32:45.841 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:32:45.846 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:32:45.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:32:45.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:32:45.866 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:32:45.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:32:45.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:32:45.973 INFO:teuthology.orchestra.run.smithi005.stdout:client8612 2024-08-18T22:32:45.973 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:32:45.973 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:32:45.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-08-18T22:32:46.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.170+0000 7f2817400640 1 Processor -- start 2024-08-18T22:32:46.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.170+0000 7f2817400640 1 -- start start 2024-08-18T22:32:46.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.170+0000 7f2817400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 0x7f281006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.170+0000 7f2817400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28100cf290 0x7f28100b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.170+0000 7f2817400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28100b31f0 con 0x7f28100b40c0 2024-08-18T22:32:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.170+0000 7f2817400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f28100b3d70 con 0x7f28100cf290 2024-08-18T22:32:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.170+0000 7f2817400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28100b4a40 con 0x7f281015b0c0 2024-08-18T22:32:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.170+0000 7f2814a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 0x7f281006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.170+0000 7f2814a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 0x7f281006db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:48480/0 (socket says 172.21.15.5:48480) 2024-08-18T22:32:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.170+0000 7f2814a00640 1 -- 172.21.15.5:0/494856041 learned_addr learned my addr 172.21.15.5:0/494856041 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.170+0000 7f2815400640 1 --2- 172.21.15.5:0/494856041 >> v2:172.21.15.117:3300/0 conn(0x7f28100cf290 0x7f28100b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f280fe00640 1 -- 172.21.15.5:0/494856041 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178469924 0 0) 0x7f28100b31f0 con 0x7f28100b40c0 2024-08-18T22:32:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2814a00640 1 -- 172.21.15.5:0/494856041 >> v2:172.21.15.117:3300/0 conn(0x7f28100cf290 msgr2=0x7f28100b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2814a00640 1 --2- 172.21.15.5:0/494856041 >> v2:172.21.15.117:3300/0 conn(0x7f28100cf290 0x7f28100b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2814a00640 1 -- 172.21.15.5:0/494856041 >> v1:172.21.15.117:6789/0 conn(0x7f28100b40c0 legacy=0x7f2810072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2814a00640 1 -- 172.21.15.5:0/494856041 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28100b34d0 con 0x7f281015b0c0 2024-08-18T22:32:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2815400640 1 --2- 172.21.15.5:0/494856041 >> v2:172.21.15.117:3300/0 conn(0x7f28100cf290 0x7f28100b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:32:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2814a00640 1 --2- 172.21.15.5:0/494856041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 0x7f281006db80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2800009870 tx=0x7f280001e620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=973e5b91a0e4533d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f280fe00640 1 -- 172.21.15.5:0/494856041 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28000aa650 con 0x7f281015b0c0 2024-08-18T22:32:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f280fe00640 1 -- 172.21.15.5:0/494856041 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28000aa7f0 con 0x7f281015b0c0 2024-08-18T22:32:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f280fe00640 1 -- 172.21.15.5:0/494856041 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28000aabc0 con 0x7f281015b0c0 2024-08-18T22:32:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2817400640 1 -- 172.21.15.5:0/494856041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 msgr2=0x7f281006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2817400640 1 --2- 172.21.15.5:0/494856041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 0x7f281006db80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2800009870 tx=0x7f280001e620 comp rx=0 tx=0).stop 2024-08-18T22:32:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2817400640 1 -- 172.21.15.5:0/494856041 shutdown_connections 2024-08-18T22:32:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2817400640 1 --2- 172.21.15.5:0/494856041 >> v2:172.21.15.117:3300/0 conn(0x7f28100cf290 0x7f28100b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2817400640 1 --2- 172.21.15.5:0/494856041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 0x7f281006db80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.174+0000 7f2817400640 1 -- 172.21.15.5:0/494856041 >> 172.21.15.5:0/494856041 conn(0x7f28100b1dc0 msgr2=0x7f28100b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2817400640 1 -- 172.21.15.5:0/494856041 shutdown_connections 2024-08-18T22:32:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2817400640 1 -- 172.21.15.5:0/494856041 wait complete. 2024-08-18T22:32:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2817400640 1 Processor -- start 2024-08-18T22:32:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2817400640 1 -- start start 2024-08-18T22:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2817400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28100b40c0 0x7f2810156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2817400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28100cf290 0x7f2810159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2817400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 0x7f28100af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2817400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f281015b620 con 0x7f28100b40c0 2024-08-18T22:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2817400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f281015b4a0 con 0x7f28100cf290 2024-08-18T22:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2817400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f281006f670 con 0x7f281015b0c0 2024-08-18T22:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2814a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28100b40c0 0x7f2810156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2814a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28100b40c0 0x7f2810156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39546/0 (socket says 172.21.15.5:39546) 2024-08-18T22:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2814a00640 1 -- 172.21.15.5:0/1693834021 learned_addr learned my addr 172.21.15.5:0/1693834021 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2807e00640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28100cf290 0x7f2810159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2815400640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 0x7f28100af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2814a00640 1 -- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 msgr2=0x7f28100af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2814a00640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 0x7f28100af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2814a00640 1 -- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28100cf290 msgr2=0x7f2810159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2814a00640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28100cf290 0x7f2810159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2814a00640 1 -- 172.21.15.5:0/1693834021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2810157520 con 0x7f28100b40c0 2024-08-18T22:32:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f2814a00640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28100b40c0 0x7f2810156fe0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f280001c250 tx=0x7f280001b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f280d600640 1 -- 172.21.15.5:0/1693834021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28000bd650 con 0x7f28100b40c0 2024-08-18T22:32:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.178+0000 7f280d600640 1 -- 172.21.15.5:0/1693834021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28000bd7f0 con 0x7f28100b40c0 2024-08-18T22:32:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.182+0000 7f2817400640 1 -- 172.21.15.5:0/1693834021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28100c5280 con 0x7f28100b40c0 2024-08-18T22:32:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.182+0000 7f280d600640 1 -- 172.21.15.5:0/1693834021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28000bdbe0 con 0x7f28100b40c0 2024-08-18T22:32:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.182+0000 7f2817400640 1 -- 172.21.15.5:0/1693834021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28100c5840 con 0x7f28100b40c0 2024-08-18T22:32:46.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.182+0000 7f280d600640 1 -- 172.21.15.5:0/1693834021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28000a8040 con 0x7f28100b40c0 2024-08-18T22:32:46.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.182+0000 7f280d600640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f27ec0678c0 0x7f27ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.182+0000 7f280d600640 1 -- 172.21.15.5:0/1693834021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f2800120550 con 0x7f28100b40c0 2024-08-18T22:32:46.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.182+0000 7f281a823000 1 Processor -- start 2024-08-18T22:32:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.182+0000 7f281a823000 1 -- start start 2024-08-18T22:32:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.182+0000 7f2807e00640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f27ec0678c0 0x7f27ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2807e00640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f27ec0678c0 0x7f27ec069d80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2810152b80 tx=0x7f27f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd586d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd5872d0 0x5630bd539fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd53a510 0x5630bd53a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5630bd423af0 con 0x5630bd5869b0 2024-08-18T22:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5630bd40fbb0 con 0x5630bd5872d0 2024-08-18T22:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5630bd38a500 con 0x5630bd53a510 2024-08-18T22:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2814a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd586d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2814a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd586d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39550/0 (socket says 172.21.15.5:39550) 2024-08-18T22:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2814a00640 1 -- 172.21.15.5:0/3678795470 learned_addr learned my addr 172.21.15.5:0/3678795470 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2807e00640 1 --2- 172.21.15.5:0/3678795470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd5872d0 0x5630bd539fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2815400640 1 --2- 172.21.15.5:0/3678795470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd53a510 0x5630bd53a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2814a00640 1 -- 172.21.15.5:0/3678795470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd53a510 msgr2=0x5630bd53a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2814a00640 1 --2- 172.21.15.5:0/3678795470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd53a510 0x5630bd53a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2814a00640 1 -- 172.21.15.5:0/3678795470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd5872d0 msgr2=0x5630bd539fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2814a00640 1 --2- 172.21.15.5:0/3678795470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd5872d0 0x5630bd539fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2814a00640 1 -- 172.21.15.5:0/3678795470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630bd32aaa0 con 0x5630bd5869b0 2024-08-18T22:32:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2814a00640 1 --2- 172.21.15.5:0/3678795470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd586d90 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f28000f0590 tx=0x7f2800009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1356a858ef6e4a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2805600640 1 -- 172.21.15.5:0/3678795470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28000f0890 con 0x5630bd5869b0 2024-08-18T22:32:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2805600640 1 -- 172.21.15.5:0/3678795470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28000f4c40 con 0x5630bd5869b0 2024-08-18T22:32:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f2805600640 1 -- 172.21.15.5:0/3678795470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28000f9470 con 0x5630bd5869b0 2024-08-18T22:32:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- 172.21.15.5:0/3678795470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 msgr2=0x5630bd586d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 --2- 172.21.15.5:0/3678795470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd586d90 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f28000f0590 tx=0x7f2800009240 comp rx=0 tx=0).stop 2024-08-18T22:32:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- 172.21.15.5:0/3678795470 shutdown_connections 2024-08-18T22:32:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 --2- 172.21.15.5:0/3678795470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd53a510 0x5630bd53a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 --2- 172.21.15.5:0/3678795470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd5872d0 0x5630bd539fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 --2- 172.21.15.5:0/3678795470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd586d90 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- 172.21.15.5:0/3678795470 >> 172.21.15.5:0/3678795470 conn(0x5630bd534020 msgr2=0x5630bd569830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- 172.21.15.5:0/3678795470 shutdown_connections 2024-08-18T22:32:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- 172.21.15.5:0/3678795470 wait complete. 2024-08-18T22:32:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- start start 2024-08-18T22:32:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 Processor -- start 2024-08-18T22:32:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 0x5630bd566e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd5869b0 0x5630bd541ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5872d0 0x5630bd542420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5630bd3864c0 con 0x5630bd5872d0 2024-08-18T22:32:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5630bd344b60 con 0x5630bd53a510 2024-08-18T22:32:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5630bd32bd10 con 0x5630bd5869b0 2024-08-18T22:32:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.186+0000 7f281a823000 10 client.0 _ll_register_callbacks cb 0x5630bd527f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2807e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd5869b0 0x5630bd541ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2814a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 0x5630bd566e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2807e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd5869b0 0x5630bd541ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:48504/0 (socket says 172.21.15.5:48504) 2024-08-18T22:32:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2807e00640 1 -- 172.21.15.5:0/1810168670 learned_addr learned my addr 172.21.15.5:0/1810168670 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2815400640 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5872d0 0x5630bd542420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2807e00640 1 -- 172.21.15.5:0/1810168670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 msgr2=0x5630bd566e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2807e00640 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 0x5630bd566e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2807e00640 1 -- 172.21.15.5:0/1810168670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5872d0 msgr2=0x5630bd542420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2807e00640 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5872d0 0x5630bd542420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2807e00640 1 -- 172.21.15.5:0/1810168670 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5630bd343070 con 0x5630bd5869b0 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2815400640 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5872d0 0x5630bd542420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2807e00640 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd5869b0 0x5630bd541ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f27f8014700 tx=0x7f27f8001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daf2886765ebd57e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f27fe000640 10 client.0 ms_handle_connect on v2:172.21.15.117:3301/0 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f27fe000640 1 -- 172.21.15.5:0/1810168670 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8025020 con 0x5630bd5869b0 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 1 -- 172.21.15.5:0/1810168670 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28000f4c40 con 0x5630bd5869b0 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f27fe000640 1 -- 172.21.15.5:0/1810168670 <== mon.2 v2:172.21.15.117:3301/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f27f8013740 con 0x5630bd5869b0 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f27fe000640 1 -- 172.21.15.5:0/1810168670 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f27f802f050 con 0x5630bd5869b0 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 10 client.8624 fetch_fsmap learned FSMap version 151 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 1 -- 172.21.15.5:0/1810168670 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x5630bd356f60 con 0x5630bd5869b0 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f27fe000640 1 -- 172.21.15.5:0/1810168670 <== mon.2 v2:172.21.15.117:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28000f4c40 con 0x5630bd5869b0 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f27fe000640 1 -- 172.21.15.5:0/1810168670 <== mon.2 v2:172.21.15.117:3301/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7f27f8032020 con 0x5630bd5869b0 2024-08-18T22:32:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 10 client.8624 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:32:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 10 client.8624 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-08-18T22:32:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 20 client.8624 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5630bd568d40 0x5630bd569150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 4 client.8624 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:32:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 1 -- 172.21.15.5:0/1810168670 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630bd324e20 con 0x5630bd568d40 2024-08-18T22:32:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2814a00640 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5630bd568d40 0x5630bd569150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f2814a00640 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5630bd568d40 0x5630bd569150 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17d518e4ef56bb4b server_cookie=24c3584516a37bf4 in_seq=0 out_seq=0 2024-08-18T22:32:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f27fe000640 10 client.8624 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f27fe000640 1 -- 172.21.15.5:0/1810168670 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630bd324e20 con 0x5630bd568d40 2024-08-18T22:32:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f27fe000640 10 client.8624 handle_command_reply: tid=0 2024-08-18T22:32:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 1 client.8624 shutdown 2024-08-18T22:32:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 1 -- 172.21.15.5:0/1810168670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd5869b0 msgr2=0x5630bd541ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.190+0000 7f281a823000 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd5869b0 0x5630bd541ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f27f8014700 tx=0x7f27f8001090 comp rx=0 tx=0).stop 2024-08-18T22:32:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.194+0000 7f281a823000 1 -- 172.21.15.5:0/1810168670 shutdown_connections 2024-08-18T22:32:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.194+0000 7f281a823000 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5630bd568d40 0x5630bd569150 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.194+0000 7f281a823000 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5872d0 0x5630bd542420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.194+0000 7f281a823000 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd5869b0 0x5630bd541ee0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.194+0000 7f27fe000640 0 client.8624 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.194+0000 7f281a823000 1 --2- 172.21.15.5:0/1810168670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 0x5630bd566e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.194+0000 7f281a823000 1 -- 172.21.15.5:0/1810168670 >> 172.21.15.5:0/1810168670 conn(0x5630bd534020 msgr2=0x5630bd5396d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.194+0000 7f281a823000 1 -- 172.21.15.5:0/1810168670 shutdown_connections 2024-08-18T22:32:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.194+0000 7f281a823000 1 -- 172.21.15.5:0/1810168670 wait complete. 2024-08-18T22:32:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.194+0000 7f281a823000 20 client.8624 trim_cache size 0 max 16384 2024-08-18T22:32:46.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f281a823000 1 Processor -- start 2024-08-18T22:32:46.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f281a823000 1 -- start start 2024-08-18T22:32:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f281a823000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd534020 0x5630bd585f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f281a823000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 0x5630bd5397b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f281a823000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd5869b0 0x5630bd539cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f281a823000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2810203b20 con 0x5630bd534020 2024-08-18T22:32:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f281a823000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2810202b40 con 0x5630bd53a510 2024-08-18T22:32:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f281a823000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f28100c9470 con 0x5630bd5869b0 2024-08-18T22:32:46.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f2814a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd534020 0x5630bd585f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f2814a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd534020 0x5630bd585f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39558/0 (socket says 172.21.15.5:39558) 2024-08-18T22:32:46.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f2814a00640 1 -- 172.21.15.5:0/2940672152 learned_addr learned my addr 172.21.15.5:0/2940672152 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f2814a00640 1 -- 172.21.15.5:0/2940672152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd5869b0 msgr2=0x5630bd539cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f2814a00640 1 --2- 172.21.15.5:0/2940672152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd5869b0 0x5630bd539cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f2814a00640 1 -- 172.21.15.5:0/2940672152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 msgr2=0x5630bd5397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f2814a00640 1 --2- 172.21.15.5:0/2940672152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 0x5630bd5397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.206+0000 7f2814a00640 1 -- 172.21.15.5:0/2940672152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630bd40cde0 con 0x5630bd534020 2024-08-18T22:32:46.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2814a00640 1 --2- 172.21.15.5:0/2940672152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd534020 0x5630bd585f40 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f2800009960 tx=0x7f2800120000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c8170387a0d92f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2804c00640 1 -- 172.21.15.5:0/2940672152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28000f0890 con 0x5630bd534020 2024-08-18T22:32:46.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2804c00640 1 -- 172.21.15.5:0/2940672152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28000f4c40 con 0x5630bd534020 2024-08-18T22:32:46.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2804c00640 1 -- 172.21.15.5:0/2940672152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28000f70b0 con 0x5630bd534020 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 -- 172.21.15.5:0/2940672152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd534020 msgr2=0x5630bd585f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 --2- 172.21.15.5:0/2940672152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd534020 0x5630bd585f40 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f2800009960 tx=0x7f2800120000 comp rx=0 tx=0).stop 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 -- 172.21.15.5:0/2940672152 shutdown_connections 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 --2- 172.21.15.5:0/2940672152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd5869b0 0x5630bd539cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 --2- 172.21.15.5:0/2940672152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 0x5630bd5397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 --2- 172.21.15.5:0/2940672152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd534020 0x5630bd585f40 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 -- 172.21.15.5:0/2940672152 >> 172.21.15.5:0/2940672152 conn(0x5630bd53eed0 msgr2=0x5630bd585200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 -- 172.21.15.5:0/2940672152 shutdown_connections 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 -- 172.21.15.5:0/2940672152 wait complete. 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 -- start start 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 Processor -- start 2024-08-18T22:32:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd534020 0x5630bd5fa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 0x5630bd5fa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd5facd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f28101fb030 con 0x5630bd5869b0 2024-08-18T22:32:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5630bd5686f0 con 0x5630bd53a510 2024-08-18T22:32:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5630bd38a500 con 0x5630bd534020 2024-08-18T22:32:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 10 client.0 _ll_register_callbacks cb 0x7f27f8001230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2815400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd5facd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2815400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd5facd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39568/0 (socket says 172.21.15.5:39568) 2024-08-18T22:32:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2815400640 1 -- 172.21.15.5:0/1224630855 learned_addr learned my addr 172.21.15.5:0/1224630855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2807e00640 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 0x5630bd5fa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2814a00640 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd534020 0x5630bd5fa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2815400640 1 -- 172.21.15.5:0/1224630855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd534020 msgr2=0x5630bd5fa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2815400640 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd534020 0x5630bd5fa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2815400640 1 -- 172.21.15.5:0/1224630855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 msgr2=0x5630bd5fa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2815400640 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 0x5630bd5fa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2815400640 1 -- 172.21.15.5:0/1224630855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630bd31dce0 con 0x5630bd5869b0 2024-08-18T22:32:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f2815400640 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd5facd0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f2808004630 tx=0x7f2808014a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cb31b4d52f63fb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f27fe000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f27fe000640 1 -- 172.21.15.5:0/1224630855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808016810 con 0x5630bd5869b0 2024-08-18T22:32:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f27fe000640 1 -- 172.21.15.5:0/1224630855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f2808021c80 con 0x5630bd5869b0 2024-08-18T22:32:46.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.210+0000 7f281a823000 1 -- 172.21.15.5:0/1224630855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28000f4c40 con 0x5630bd5869b0 2024-08-18T22:32:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f27fe000640 1 -- 172.21.15.5:0/1224630855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f2808004840 con 0x5630bd5869b0 2024-08-18T22:32:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 10 client.10512 fetch_fsmap learned FSMap version 151 2024-08-18T22:32:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 -- 172.21.15.5:0/1224630855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x5630bd330330 con 0x5630bd5869b0 2024-08-18T22:32:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f27fe000640 1 -- 172.21.15.5:0/1224630855 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28000f4c40 con 0x5630bd5869b0 2024-08-18T22:32:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f27fe000640 1 -- 172.21.15.5:0/1224630855 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7f2808028050 con 0x5630bd5869b0 2024-08-18T22:32:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 10 client.10512 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:32:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 10 client.10512 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-08-18T22:32:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 20 client.10512 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5630bd5872d0 0x5630bd599e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 4 client.10512 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:32:46.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 -- 172.21.15.5:0/1224630855 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630bd397c30 con 0x5630bd5872d0 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2814a00640 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5630bd5872d0 0x5630bd599e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2814a00640 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5630bd5872d0 0x5630bd599e00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa770d63324643a9 server_cookie=5eb61e74923c1492 in_seq=0 out_seq=0 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f27fe000640 10 client.10512 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f27fe000640 1 -- 172.21.15.5:0/1224630855 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630bd397c30 con 0x5630bd5872d0 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f27fe000640 10 client.10512 handle_command_reply: tid=0 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 client.10512 shutdown 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 -- 172.21.15.5:0/1224630855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 msgr2=0x5630bd5facd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd5facd0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f2808004630 tx=0x7f2808014a00 comp rx=0 tx=0).stop 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 -- 172.21.15.5:0/1224630855 shutdown_connections 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5630bd5872d0 0x5630bd599e00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5630bd5869b0 0x5630bd5facd0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5630bd53a510 0x5630bd5fa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 --2- 172.21.15.5:0/1224630855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5630bd534020 0x5630bd5fa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f27fe000640 0 client.10512 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 -- 172.21.15.5:0/1224630855 >> 172.21.15.5:0/1224630855 conn(0x5630bd53eed0 msgr2=0x5630bd585a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 -- 172.21.15.5:0/1224630855 shutdown_connections 2024-08-18T22:32:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 1 -- 172.21.15.5:0/1224630855 wait complete. 2024-08-18T22:32:46.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f281a823000 20 client.10512 trim_cache size 0 max 16384 2024-08-18T22:32:46.222 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-18T22:32:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 -- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f27ec0678c0 msgr2=0x7f27ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f27ec0678c0 0x7f27ec069d80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2810152b80 tx=0x7f27f8009040 comp rx=0 tx=0).stop 2024-08-18T22:32:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 -- 172.21.15.5:0/1693834021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28100b40c0 msgr2=0x7f2810156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28100b40c0 0x7f2810156fe0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f280001c250 tx=0x7f280001b3c0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 -- 172.21.15.5:0/1693834021 shutdown_connections 2024-08-18T22:32:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f27ec0678c0 0x7f27ec069d80 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281015b0c0 0x7f28100af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28100cf290 0x7f2810159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 --2- 172.21.15.5:0/1693834021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28100b40c0 0x7f2810156fe0 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 -- 172.21.15.5:0/1693834021 >> 172.21.15.5:0/1693834021 conn(0x7f28100b1dc0 msgr2=0x7f281009d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 -- 172.21.15.5:0/1693834021 shutdown_connections 2024-08-18T22:32:46.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.214+0000 7f2817400640 1 -- 172.21.15.5:0/1693834021 wait complete. 2024-08-18T22:32:46.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-18T22:32:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa074e00640 1 Processor -- start 2024-08-18T22:32:46.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa074e00640 1 -- start start 2024-08-18T22:32:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa074e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa07015bed0 0x7fa0700735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa074e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa07006da70 0x7fa07006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa074e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa070073c80 con 0x7fa0700cb390 2024-08-18T22:32:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa074e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa07006e420 con 0x7fa07015bed0 2024-08-18T22:32:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa074e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0700ca5d0 con 0x7fa07006da70 2024-08-18T22:32:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa06de00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa07015bed0 0x7fa0700735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa067e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa0700cb390 0x7fa070071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50866/0 (socket says 172.21.15.5:50866) 2024-08-18T22:32:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa067e00640 1 -- 172.21.15.5:0/13606357 learned_addr learned my addr 172.21.15.5:0/13606357 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa06e800640 1 --2- 172.21.15.5:0/13606357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa07006da70 0x7fa07006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa06de00640 1 -- 172.21.15.5:0/13606357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa07006da70 msgr2=0x7fa07006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa06de00640 1 --2- 172.21.15.5:0/13606357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa07006da70 0x7fa07006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa06de00640 1 -- 172.21.15.5:0/13606357 >> v1:172.21.15.5:6789/0 conn(0x7fa0700cb390 legacy=0x7fa070071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.374+0000 7fa06de00640 1 -- 172.21.15.5:0/13606357 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0700ca8b0 con 0x7fa07015bed0 2024-08-18T22:32:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa06de00640 1 --2- 172.21.15.5:0/13606357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa07015bed0 0x7fa0700735a0 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fa0600097c0 tx=0x7fa06001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1628fdb761e4f37 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa06d400640 1 -- 172.21.15.5:0/13606357 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600a7070 con 0x7fa07015bed0 2024-08-18T22:32:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa06d400640 1 -- 172.21.15.5:0/13606357 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0600b0070 con 0x7fa07015bed0 2024-08-18T22:32:46.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa06d400640 1 -- 172.21.15.5:0/13606357 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600ab890 con 0x7fa07015bed0 2024-08-18T22:32:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa074e00640 1 -- 172.21.15.5:0/13606357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa07015bed0 msgr2=0x7fa0700735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa074e00640 1 --2- 172.21.15.5:0/13606357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa07015bed0 0x7fa0700735a0 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fa0600097c0 tx=0x7fa06001c470 comp rx=0 tx=0).stop 2024-08-18T22:32:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa074e00640 1 -- 172.21.15.5:0/13606357 shutdown_connections 2024-08-18T22:32:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa074e00640 1 --2- 172.21.15.5:0/13606357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa07006da70 0x7fa07006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa074e00640 1 --2- 172.21.15.5:0/13606357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa07015bed0 0x7fa0700735a0 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa074e00640 1 -- 172.21.15.5:0/13606357 >> 172.21.15.5:0/13606357 conn(0x7fa0700b1c50 msgr2=0x7fa0700b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa074e00640 1 -- 172.21.15.5:0/13606357 shutdown_connections 2024-08-18T22:32:46.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.378+0000 7fa074e00640 1 -- 172.21.15.5:0/13606357 wait complete. 2024-08-18T22:32:46.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa074e00640 1 Processor -- start 2024-08-18T22:32:46.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa074e00640 1 -- start start 2024-08-18T22:32:46.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa074e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa07006da70 0x7fa0700b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa074e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0700cb390 0x7fa07014aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa074e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa07015bed0 0x7fa0701534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa074e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa070168520 con 0x7fa07015bed0 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa074e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa0701683a0 con 0x7fa07006da70 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa074e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0701686a0 con 0x7fa0700cb390 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa06e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa07015bed0 0x7fa0701534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa06e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa07015bed0 0x7fa0701534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39578/0 (socket says 172.21.15.5:39578) 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa06e800640 1 -- 172.21.15.5:0/4218597939 learned_addr learned my addr 172.21.15.5:0/4218597939 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa067e00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0700cb390 0x7fa07014aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa06de00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa07006da70 0x7fa0700b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa06e800640 1 -- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0700cb390 msgr2=0x7fa07014aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa06e800640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0700cb390 0x7fa07014aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa06e800640 1 -- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa07006da70 msgr2=0x7fa0700b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa06e800640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa07006da70 0x7fa0700b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa06e800640 1 -- 172.21.15.5:0/4218597939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0700b4310 con 0x7fa07015bed0 2024-08-18T22:32:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa067e00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0700cb390 0x7fa07014aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa06de00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa07006da70 0x7fa0700b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:46.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa06e800640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa07015bed0 0x7fa0701534a0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fa068007e60 tx=0x7fa06800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa066000640 1 -- 172.21.15.5:0/4218597939 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068014420 con 0x7fa07015bed0 2024-08-18T22:32:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa066000640 1 -- 172.21.15.5:0/4218597939 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa068019070 con 0x7fa07015bed0 2024-08-18T22:32:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa066000640 1 -- 172.21.15.5:0/4218597939 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068014820 con 0x7fa07015bed0 2024-08-18T22:32:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa074e00640 1 -- 172.21.15.5:0/4218597939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0700b45f0 con 0x7fa07015bed0 2024-08-18T22:32:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.382+0000 7fa074e00640 1 -- 172.21.15.5:0/4218597939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0700b4bb0 con 0x7fa07015bed0 2024-08-18T22:32:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.386+0000 7fa074e00640 1 -- 172.21.15.5:0/4218597939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa07006dee0 con 0x7fa07015bed0 2024-08-18T22:32:46.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.386+0000 7fa066000640 1 -- 172.21.15.5:0/4218597939 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0680149c0 con 0x7fa07015bed0 2024-08-18T22:32:46.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.386+0000 7fa066000640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa04c0678c0 0x7fa04c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.386+0000 7fa066000640 1 -- 172.21.15.5:0/4218597939 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7fa0680866c0 con 0x7fa07015bed0 2024-08-18T22:32:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.386+0000 7fa06de00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa04c0678c0 0x7fa04c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.390+0000 7fa06de00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa04c0678c0 0x7fa04c069d80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa0600af000 tx=0x7fa0600a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.390+0000 7fa066000640 1 -- 172.21.15.5:0/4218597939 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa068011260 con 0x7fa07015bed0 2024-08-18T22:32:46.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.590+0000 7fa074e00640 1 -- 172.21.15.5:0/4218597939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa070071be0 con 0x7fa07015bed0 2024-08-18T22:32:46.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.590+0000 7fa066000640 1 -- 172.21.15.5:0/4218597939 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa068056fd0 con 0x7fa07015bed0 2024-08-18T22:32:46.593 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:32:46.593 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-18T22:32:46.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 -- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa04c0678c0 msgr2=0x7fa04c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa04c0678c0 0x7fa04c069d80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa0600af000 tx=0x7fa0600a7000 comp rx=0 tx=0).stop 2024-08-18T22:32:46.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 -- 172.21.15.5:0/4218597939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa07015bed0 msgr2=0x7fa0701534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa07015bed0 0x7fa0701534a0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fa068007e60 tx=0x7fa06800e4b0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 -- 172.21.15.5:0/4218597939 shutdown_connections 2024-08-18T22:32:46.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa04c0678c0 0x7fa04c069d80 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa07015bed0 0x7fa0701534a0 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0700cb390 0x7fa07014aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 --2- 172.21.15.5:0/4218597939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa07006da70 0x7fa0700b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 -- 172.21.15.5:0/4218597939 >> 172.21.15.5:0/4218597939 conn(0x7fa0700b1c50 msgr2=0x7fa0700b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 -- 172.21.15.5:0/4218597939 shutdown_connections 2024-08-18T22:32:46.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.594+0000 7fa074e00640 1 -- 172.21.15.5:0/4218597939 wait complete. 2024-08-18T22:32:46.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:32:46.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub start '~mdsdir' recursive 2024-08-18T22:32:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6958000640 1 Processor -- start 2024-08-18T22:32:46.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6958000640 1 -- start start 2024-08-18T22:32:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6958000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f69500703a0 0x7f6950070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6958000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69500b4a20 0x7f69500b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6958000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69501486b0 con 0x7f6950147ce0 2024-08-18T22:32:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6958000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6950070d50 con 0x7f69500b4a20 2024-08-18T22:32:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6958000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f69500b3c60 con 0x7f69500703a0 2024-08-18T22:32:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6956000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69500b4a20 0x7f69500b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6955600640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6950147ce0 0x7f69500af9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50878/0 (socket says 172.21.15.5:50878) 2024-08-18T22:32:46.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6955600640 1 -- 172.21.15.5:0/2889443361 learned_addr learned my addr 172.21.15.5:0/2889443361 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6954c00640 1 --2- 172.21.15.5:0/2889443361 >> v2:172.21.15.117:3300/0 conn(0x7f69500703a0 0x7f6950070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6956000640 1 -- 172.21.15.5:0/2889443361 >> v2:172.21.15.117:3300/0 conn(0x7f69500703a0 msgr2=0x7f6950070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6956000640 1 --2- 172.21.15.5:0/2889443361 >> v2:172.21.15.117:3300/0 conn(0x7f69500703a0 0x7f6950070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6956000640 1 -- 172.21.15.5:0/2889443361 >> v1:172.21.15.5:6789/0 conn(0x7f6950147ce0 legacy=0x7f69500af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.758+0000 7f6956000640 1 -- 172.21.15.5:0/2889443361 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69500b3f40 con 0x7f69500b4a20 2024-08-18T22:32:46.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f6956000640 1 --2- 172.21.15.5:0/2889443361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500b4a20 0x7f69500b4e40 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f69500d09e0 tx=0x7f694801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e77bf7675b404e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f694fe00640 1 -- 172.21.15.5:0/2889443361 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69480b2070 con 0x7f69500b4a20 2024-08-18T22:32:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f694fe00640 1 -- 172.21.15.5:0/2889443361 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69480a59f0 con 0x7f69500b4a20 2024-08-18T22:32:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f694fe00640 1 -- 172.21.15.5:0/2889443361 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69480a5dc0 con 0x7f69500b4a20 2024-08-18T22:32:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f6958000640 1 -- 172.21.15.5:0/2889443361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500b4a20 msgr2=0x7f69500b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f6958000640 1 --2- 172.21.15.5:0/2889443361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500b4a20 0x7f69500b4e40 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f69500d09e0 tx=0x7f694801c930 comp rx=0 tx=0).stop 2024-08-18T22:32:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f6958000640 1 -- 172.21.15.5:0/2889443361 shutdown_connections 2024-08-18T22:32:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f6958000640 1 --2- 172.21.15.5:0/2889443361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500b4a20 0x7f69500b4e40 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f6958000640 1 --2- 172.21.15.5:0/2889443361 >> v2:172.21.15.117:3300/0 conn(0x7f69500703a0 0x7f6950070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f6958000640 1 -- 172.21.15.5:0/2889443361 >> 172.21.15.5:0/2889443361 conn(0x7f69500732f0 msgr2=0x7f695006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f6958000640 1 -- 172.21.15.5:0/2889443361 shutdown_connections 2024-08-18T22:32:46.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.762+0000 7f6958000640 1 -- 172.21.15.5:0/2889443361 wait complete. 2024-08-18T22:32:46.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6958000640 1 Processor -- start 2024-08-18T22:32:46.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6958000640 1 -- start start 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6958000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500703a0 0x7f6950144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6958000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69500b4a20 0x7f69501436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6958000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6950147ce0 0x7f6950133610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6958000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f69500b0230 con 0x7f69500703a0 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6958000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f69500b00b0 con 0x7f69500b4a20 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6958000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f695016b4c0 con 0x7f6950147ce0 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6955600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500703a0 0x7f6950144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6955600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500703a0 0x7f6950144c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39596/0 (socket says 172.21.15.5:39596) 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6955600640 1 -- 172.21.15.5:0/374156507 learned_addr learned my addr 172.21.15.5:0/374156507 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6956000640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6950147ce0 0x7f6950133610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6954c00640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69500b4a20 0x7f69501436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6955600640 1 -- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6950147ce0 msgr2=0x7f6950133610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6955600640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6950147ce0 0x7f6950133610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6955600640 1 -- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69500b4a20 msgr2=0x7f69501436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6955600640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69500b4a20 0x7f69501436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6955600640 1 -- 172.21.15.5:0/374156507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695013a290 con 0x7f69500703a0 2024-08-18T22:32:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6954c00640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69500b4a20 0x7f69501436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6955600640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500703a0 0x7f6950144c80 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f694400c420 tx=0x7f694400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f694d600640 1 -- 172.21.15.5:0/374156507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944017070 con 0x7f69500703a0 2024-08-18T22:32:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f694d600640 1 -- 172.21.15.5:0/374156507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6944005cf0 con 0x7f69500703a0 2024-08-18T22:32:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6958000640 1 -- 172.21.15.5:0/374156507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695013a550 con 0x7f69500703a0 2024-08-18T22:32:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f694d600640 1 -- 172.21.15.5:0/374156507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69440072f0 con 0x7f69500703a0 2024-08-18T22:32:46.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.766+0000 7f6958000640 1 -- 172.21.15.5:0/374156507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6950143bf0 con 0x7f69500703a0 2024-08-18T22:32:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f694d600640 1 -- 172.21.15.5:0/374156507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f694401a070 con 0x7f69500703a0 2024-08-18T22:32:46.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f694d600640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69300678c0 0x7f6930069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f694d600640 1 -- 172.21.15.5:0/374156507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f69440851e0 con 0x7f69500703a0 2024-08-18T22:32:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f6954c00640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69300678c0 0x7f6930069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f695b461000 1 Processor -- start 2024-08-18T22:32:46.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f695b461000 1 -- start start 2024-08-18T22:32:46.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f6954c00640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69300678c0 0x7f6930069d80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6950162380 tx=0x7f693c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f695b461000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60e3f0 0x563a6c60e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f695b461000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60ed10 0x563a6c5c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f695b461000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 0x563a6c5c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f695b461000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563a6c4ccc80 con 0x563a6c60ed10 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f695b461000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563a6c4abc30 con 0x563a6c5c52c0 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.770+0000 7f695b461000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563a6c4122b0 con 0x563a6c60e3f0 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6954c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60ed10 0x563a6c5c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6954c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60ed10 0x563a6c5c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39610/0 (socket says 172.21.15.5:39610) 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6954c00640 1 -- 172.21.15.5:0/2640415526 learned_addr learned my addr 172.21.15.5:0/2640415526 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6955600640 1 --2- 172.21.15.5:0/2640415526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60e3f0 0x563a6c60e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6956000640 1 --2- 172.21.15.5:0/2640415526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 0x563a6c5c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6954c00640 1 -- 172.21.15.5:0/2640415526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60e3f0 msgr2=0x563a6c60e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6954c00640 1 --2- 172.21.15.5:0/2640415526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60e3f0 0x563a6c60e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6954c00640 1 -- 172.21.15.5:0/2640415526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 msgr2=0x563a6c5c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6954c00640 1 --2- 172.21.15.5:0/2640415526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 0x563a6c5c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6954c00640 1 -- 172.21.15.5:0/2640415526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a6c4bb070 con 0x563a6c60ed10 2024-08-18T22:32:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6955600640 1 --2- 172.21.15.5:0/2640415526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60e3f0 0x563a6c60e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6956000640 1 --2- 172.21.15.5:0/2640415526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 0x563a6c5c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6954c00640 1 --2- 172.21.15.5:0/2640415526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60ed10 0x563a6c5c4d80 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f693c004490 tx=0x7f693c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf91956edfb3345 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6942000640 1 -- 172.21.15.5:0/2640415526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c00f040 con 0x563a6c60ed10 2024-08-18T22:32:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6942000640 1 -- 172.21.15.5:0/2640415526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c00e510 con 0x563a6c60ed10 2024-08-18T22:32:46.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f6942000640 1 -- 172.21.15.5:0/2640415526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c00e8c0 con 0x563a6c60ed10 2024-08-18T22:32:46.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 -- 172.21.15.5:0/2640415526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60ed10 msgr2=0x563a6c5c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 --2- 172.21.15.5:0/2640415526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60ed10 0x563a6c5c4d80 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f693c004490 tx=0x7f693c011000 comp rx=0 tx=0).stop 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 -- 172.21.15.5:0/2640415526 shutdown_connections 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 --2- 172.21.15.5:0/2640415526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 0x563a6c5c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 --2- 172.21.15.5:0/2640415526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60ed10 0x563a6c5c4d80 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 --2- 172.21.15.5:0/2640415526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60e3f0 0x563a6c60e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 -- 172.21.15.5:0/2640415526 >> 172.21.15.5:0/2640415526 conn(0x563a6c5c1270 msgr2=0x563a6c5c3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 -- 172.21.15.5:0/2640415526 shutdown_connections 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 -- 172.21.15.5:0/2640415526 wait complete. 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 -- start start 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 Processor -- start 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c5c52c0 0x563a6c60db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c5d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60ed10 0x563a6c5d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563a6c40e270 con 0x563a6c60e3f0 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563a6c3cc9b0 con 0x563a6c60ed10 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563a6c3b3d10 con 0x563a6c5c52c0 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.774+0000 7f695b461000 10 client.0 _ll_register_callbacks cb 0x563a6c3efd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6954c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c5d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6954c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c5d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39624/0 (socket says 172.21.15.5:39624) 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6954c00640 1 -- 172.21.15.5:0/2036841752 learned_addr learned my addr 172.21.15.5:0/2036841752 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6955600640 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c5c52c0 0x563a6c60db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6956000640 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60ed10 0x563a6c5d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6954c00640 1 -- 172.21.15.5:0/2036841752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c5c52c0 msgr2=0x563a6c60db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6954c00640 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c5c52c0 0x563a6c60db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6954c00640 1 -- 172.21.15.5:0/2036841752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60ed10 msgr2=0x563a6c5d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6954c00640 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60ed10 0x563a6c5d0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6954c00640 1 -- 172.21.15.5:0/2036841752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a6c3ef3b0 con 0x563a6c60e3f0 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6956000640 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60ed10 0x563a6c5d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6954c00640 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c5d0400 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f693c009140 tx=0x7f693c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f7dc297950404d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6936a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6936a00640 1 -- 172.21.15.5:0/2036841752 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c013640 con 0x563a6c60e3f0 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6936a00640 1 -- 172.21.15.5:0/2036841752 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f693c02bc30 con 0x563a6c60e3f0 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 -- 172.21.15.5:0/2036841752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f693c00e510 con 0x563a6c60e3f0 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6936a00640 1 -- 172.21.15.5:0/2036841752 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f693c02be30 con 0x563a6c60e3f0 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 10 client.10533 fetch_fsmap learned FSMap version 151 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 -- 172.21.15.5:0/2036841752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x563a6c458860 con 0x563a6c60e3f0 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6936a00640 1 -- 172.21.15.5:0/2036841752 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c00e510 con 0x563a6c60e3f0 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6936a00640 1 -- 172.21.15.5:0/2036841752 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7f693c012070 con 0x563a6c60e3f0 2024-08-18T22:32:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 10 client.10533 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:32:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 10 client.10533 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-08-18T22:32:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 20 client.10533 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x563a6c5d1350 0x563a6c5d1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 4 client.10533 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:32:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 -- 172.21.15.5:0/2036841752 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a6c3ace30 con 0x563a6c5d1350 2024-08-18T22:32:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6955600640 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x563a6c5d1350 0x563a6c5d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6955600640 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x563a6c5d1350 0x563a6c5d1730 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3fac9965baa1567 server_cookie=937945f92fdf07ca in_seq=0 out_seq=0 2024-08-18T22:32:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6936a00640 10 client.10533 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6936a00640 1 -- 172.21.15.5:0/2036841752 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a6c3ace30 con 0x563a6c5d1350 2024-08-18T22:32:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6936a00640 10 client.10533 handle_command_reply: tid=0 2024-08-18T22:32:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 client.10533 shutdown 2024-08-18T22:32:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 -- 172.21.15.5:0/2036841752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 msgr2=0x563a6c5d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c5d0400 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f693c009140 tx=0x7f693c004740 comp rx=0 tx=0).stop 2024-08-18T22:32:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 -- 172.21.15.5:0/2036841752 shutdown_connections 2024-08-18T22:32:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x563a6c5d1350 0x563a6c5d1730 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60ed10 0x563a6c5d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c5d0400 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 --2- 172.21.15.5:0/2036841752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c5c52c0 0x563a6c60db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 -- 172.21.15.5:0/2036841752 >> 172.21.15.5:0/2036841752 conn(0x563a6c5c1270 msgr2=0x563a6c5c3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f6936a00640 0 client.10533 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 -- 172.21.15.5:0/2036841752 shutdown_connections 2024-08-18T22:32:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 1 -- 172.21.15.5:0/2036841752 wait complete. 2024-08-18T22:32:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.778+0000 7f695b461000 20 client.10533 trim_cache size 0 max 16384 2024-08-18T22:32:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f695b461000 1 Processor -- start 2024-08-18T22:32:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f695b461000 1 -- start start 2024-08-18T22:32:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f695b461000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c5c52c0 0x563a6c5c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f695b461000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60e3f0 0x563a6c5c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f695b461000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60ed10 0x563a6c6206b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f695b461000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6950203e90 con 0x563a6c5c52c0 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f695b461000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f695013f2b0 con 0x563a6c60e3f0 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f695b461000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f695013e610 con 0x563a6c60ed10 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6955600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c5c52c0 0x563a6c5c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6955600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c5c52c0 0x563a6c5c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39632/0 (socket says 172.21.15.5:39632) 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6955600640 1 -- 172.21.15.5:0/3002961875 learned_addr learned my addr 172.21.15.5:0/3002961875 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6956000640 1 --2- 172.21.15.5:0/3002961875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60ed10 0x563a6c6206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6954c00640 1 --2- 172.21.15.5:0/3002961875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60e3f0 0x563a6c5c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6955600640 1 -- 172.21.15.5:0/3002961875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60ed10 msgr2=0x563a6c6206b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6955600640 1 --2- 172.21.15.5:0/3002961875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60ed10 0x563a6c6206b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6955600640 1 -- 172.21.15.5:0/3002961875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60e3f0 msgr2=0x563a6c5c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6955600640 1 --2- 172.21.15.5:0/3002961875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60e3f0 0x563a6c5c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6955600640 1 -- 172.21.15.5:0/3002961875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a6c3b2ab0 con 0x563a6c5c52c0 2024-08-18T22:32:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6954c00640 1 --2- 172.21.15.5:0/3002961875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60e3f0 0x563a6c5c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6956000640 1 --2- 172.21.15.5:0/3002961875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60ed10 0x563a6c6206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:32:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6955600640 1 --2- 172.21.15.5:0/3002961875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c5c52c0 0x563a6c5c4670 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f694400cde0 tx=0x7f6944058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1795f1fc8e8725 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6941600640 1 -- 172.21.15.5:0/3002961875 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944053780 con 0x563a6c5c52c0 2024-08-18T22:32:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6941600640 1 -- 172.21.15.5:0/3002961875 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6944051af0 con 0x563a6c5c52c0 2024-08-18T22:32:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.798+0000 7f6941600640 1 -- 172.21.15.5:0/3002961875 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944007690 con 0x563a6c5c52c0 2024-08-18T22:32:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 -- 172.21.15.5:0/3002961875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c5c52c0 msgr2=0x563a6c5c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 --2- 172.21.15.5:0/3002961875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c5c52c0 0x563a6c5c4670 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f694400cde0 tx=0x7f6944058040 comp rx=0 tx=0).stop 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 -- 172.21.15.5:0/3002961875 shutdown_connections 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 --2- 172.21.15.5:0/3002961875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60ed10 0x563a6c6206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 --2- 172.21.15.5:0/3002961875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c60e3f0 0x563a6c5c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 --2- 172.21.15.5:0/3002961875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c5c52c0 0x563a6c5c4670 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 -- 172.21.15.5:0/3002961875 >> 172.21.15.5:0/3002961875 conn(0x563a6c5c1270 msgr2=0x563a6c5cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 -- 172.21.15.5:0/3002961875 shutdown_connections 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 -- 172.21.15.5:0/3002961875 wait complete. 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 -- start start 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 Processor -- start 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 0x563a6c6820c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c682600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60ed10 0x563a6c682b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563a6c494ab0 con 0x563a6c60e3f0 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563a6c4168e0 con 0x563a6c5c52c0 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x563a6c3da180 con 0x563a6c60ed10 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 10 client.0 _ll_register_callbacks cb 0x7f693c004390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6954c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c682600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6954c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c682600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39640/0 (socket says 172.21.15.5:39640) 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6954c00640 1 -- 172.21.15.5:0/1738471423 learned_addr learned my addr 172.21.15.5:0/1738471423 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6956000640 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60ed10 0x563a6c682b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6955600640 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 0x563a6c6820c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6954c00640 1 -- 172.21.15.5:0/1738471423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60ed10 msgr2=0x563a6c682b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6954c00640 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60ed10 0x563a6c682b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6954c00640 1 -- 172.21.15.5:0/1738471423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 msgr2=0x563a6c6820c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6954c00640 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 0x563a6c6820c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6954c00640 1 -- 172.21.15.5:0/1738471423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a6c494f40 con 0x563a6c60e3f0 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6955600640 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 0x563a6c6820c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6954c00640 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c682600 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f693c00e260 tx=0x7f693c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9da0ca04db39bd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6936a00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6936a00640 1 -- 172.21.15.5:0/1738471423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c013640 con 0x563a6c60e3f0 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6936a00640 1 -- 172.21.15.5:0/1738471423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f693c034690 con 0x563a6c60e3f0 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 -- 172.21.15.5:0/1738471423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6944051af0 con 0x563a6c60e3f0 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6936a00640 1 -- 172.21.15.5:0/1738471423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f693c00eda0 con 0x563a6c60e3f0 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 10 client.10539 fetch_fsmap learned FSMap version 151 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 -- 172.21.15.5:0/1738471423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x563a6c46ba20 con 0x563a6c60e3f0 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6936a00640 1 -- 172.21.15.5:0/1738471423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6944051af0 con 0x563a6c60e3f0 2024-08-18T22:32:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f6936a00640 1 -- 172.21.15.5:0/1738471423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7f693c034890 con 0x563a6c60e3f0 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 10 client.10539 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 10 client.10539 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 20 client.10539 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.802+0000 7f695b461000 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x563a6c6237e0 0x563a6c623bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 4 client.10539 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 -- 172.21.15.5:0/1738471423 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x563a6c41f9e0 con 0x563a6c6237e0 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6955600640 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x563a6c6237e0 0x563a6c623bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6955600640 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x563a6c6237e0 0x563a6c623bf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=919567c009499e60 server_cookie=e3c00c069bae8921 in_seq=0 out_seq=0 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6936a00640 10 client.10539 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6936a00640 1 -- 172.21.15.5:0/1738471423 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563a6c41f9e0 con 0x563a6c6237e0 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6936a00640 10 client.10539 handle_command_reply: tid=0 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 client.10539 shutdown 2024-08-18T22:32:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 -- 172.21.15.5:0/1738471423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 msgr2=0x563a6c682600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c682600 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f693c00e260 tx=0x7f693c014000 comp rx=0 tx=0).stop 2024-08-18T22:32:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 -- 172.21.15.5:0/1738471423 shutdown_connections 2024-08-18T22:32:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x563a6c6237e0 0x563a6c623bf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x563a6c60ed10 0x563a6c682b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563a6c60e3f0 0x563a6c682600 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 --2- 172.21.15.5:0/1738471423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x563a6c5c52c0 0x563a6c6820c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 -- 172.21.15.5:0/1738471423 >> 172.21.15.5:0/1738471423 conn(0x563a6c5c1270 msgr2=0x563a6c5cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6936a00640 0 client.10539 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 -- 172.21.15.5:0/1738471423 shutdown_connections 2024-08-18T22:32:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 1 -- 172.21.15.5:0/1738471423 wait complete. 2024-08-18T22:32:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f695b461000 20 client.10539 trim_cache size 0 max 16384 2024-08-18T22:32:46.813 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:32:46.813 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:32:46.813 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "fbf8a9ad-dd6b-40c9-952b-2409fc878371", 2024-08-18T22:32:46.813 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:32:46.813 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:32:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 -- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69300678c0 msgr2=0x7f6930069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69300678c0 0x7f6930069d80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6950162380 tx=0x7f693c008040 comp rx=0 tx=0).stop 2024-08-18T22:32:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 -- 172.21.15.5:0/374156507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500703a0 msgr2=0x7f6950144c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500703a0 0x7f6950144c80 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f694400c420 tx=0x7f694400c8e0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 -- 172.21.15.5:0/374156507 shutdown_connections 2024-08-18T22:32:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f69300678c0 0x7f6930069d80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6950147ce0 0x7f6950133610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69500b4a20 0x7f69501436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 --2- 172.21.15.5:0/374156507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500703a0 0x7f6950144c80 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 -- 172.21.15.5:0/374156507 >> 172.21.15.5:0/374156507 conn(0x7f69500732f0 msgr2=0x7f6950132b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 -- 172.21.15.5:0/374156507 shutdown_connections 2024-08-18T22:32:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.806+0000 7f6958000640 1 -- 172.21.15.5:0/374156507 wait complete. 2024-08-18T22:32:46.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:32:46.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-08-18T22:32:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.966+0000 7f3f13a00640 1 Processor -- start 2024-08-18T22:32:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.966+0000 7f3f13a00640 1 -- start start 2024-08-18T22:32:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.970+0000 7f3f13a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f0c09aca0 0x7f3f0c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.970+0000 7f3f13a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f0c06e8a0 con 0x7f3f0c09b080 2024-08-18T22:32:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.970+0000 7f3f13a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f0c09bb80 con 0x7f3f0c0b1300 2024-08-18T22:32:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.970+0000 7f3f13a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3f0c0d2e40 con 0x7f3f0c09aca0 2024-08-18T22:32:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.970+0000 7f3f11000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f0c09aca0 0x7f3f0c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.970+0000 7f3f11a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3f0c09b080 0x7f3f0c162950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50890/0 (socket says 172.21.15.5:50890) 2024-08-18T22:32:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.970+0000 7f3f11a00640 1 -- 172.21.15.5:0/2875891289 learned_addr learned my addr 172.21.15.5:0/2875891289 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:32:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.970+0000 7f3f11000640 1 -- 172.21.15.5:0/2875891289 >> v1:172.21.15.117:6789/0 conn(0x7f3f0c0b1300 legacy=0x7f3f0c0affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.970+0000 7f3f11000640 1 -- 172.21.15.5:0/2875891289 >> v1:172.21.15.5:6789/0 conn(0x7f3f0c09b080 legacy=0x7f3f0c162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.970+0000 7f3f11000640 1 -- 172.21.15.5:0/2875891289 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c06cbd0 con 0x7f3f0c09aca0 2024-08-18T22:32:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f11000640 1 --2- 172.21.15.5:0/2875891289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c09aca0 0x7f3f0c0afa90 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f3f000097c0 tx=0x7f3f0001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ed5bae5a8a32bd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f0b400640 1 -- 172.21.15.5:0/2875891289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f000b0070 con 0x7f3f0c09aca0 2024-08-18T22:32:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f0b400640 1 -- 172.21.15.5:0/2875891289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f000ab600 con 0x7f3f0c09aca0 2024-08-18T22:32:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f0b400640 1 -- 172.21.15.5:0/2875891289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f000ab9d0 con 0x7f3f0c09aca0 2024-08-18T22:32:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f13a00640 1 -- 172.21.15.5:0/2875891289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c09aca0 msgr2=0x7f3f0c0afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f13a00640 1 --2- 172.21.15.5:0/2875891289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c09aca0 0x7f3f0c0afa90 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f3f000097c0 tx=0x7f3f0001c460 comp rx=0 tx=0).stop 2024-08-18T22:32:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f13a00640 1 -- 172.21.15.5:0/2875891289 shutdown_connections 2024-08-18T22:32:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f13a00640 1 --2- 172.21.15.5:0/2875891289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c09aca0 0x7f3f0c0afa90 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f13a00640 1 -- 172.21.15.5:0/2875891289 >> 172.21.15.5:0/2875891289 conn(0x7f3f0c0d2180 msgr2=0x7f3f0c0d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f13a00640 1 -- 172.21.15.5:0/2875891289 shutdown_connections 2024-08-18T22:32:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f13a00640 1 -- 172.21.15.5:0/2875891289 wait complete. 2024-08-18T22:32:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f13a00640 1 Processor -- start 2024-08-18T22:32:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.974+0000 7f3f13a00640 1 -- start start 2024-08-18T22:32:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f13a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f0c09aca0 0x7f3f0c14ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f13a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c09b080 0x7f3f0c150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f13a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f0c0b1300 0x7f3f0c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f13a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c16ced0 con 0x7f3f0c09b080 2024-08-18T22:32:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f13a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c16cd50 con 0x7f3f0c0b1300 2024-08-18T22:32:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f13a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0c16d050 con 0x7f3f0c09aca0 2024-08-18T22:32:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f0be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c09b080 0x7f3f0c150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f0be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c09b080 0x7f3f0c150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39662/0 (socket says 172.21.15.5:39662) 2024-08-18T22:32:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f0be00640 1 -- 172.21.15.5:0/1527023815 learned_addr learned my addr 172.21.15.5:0/1527023815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f11000640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f0c09aca0 0x7f3f0c14ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f11a00640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f0c0b1300 0x7f3f0c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f0be00640 1 -- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f0c09aca0 msgr2=0x7f3f0c14ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f0be00640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f0c09aca0 0x7f3f0c14ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f0be00640 1 -- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f0c0b1300 msgr2=0x7f3f0c1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f0be00640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f0c0b1300 0x7f3f0c1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f0be00640 1 -- 172.21.15.5:0/1527023815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c14f7d0 con 0x7f3f0c09b080 2024-08-18T22:32:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f11000640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f0c09aca0 0x7f3f0c14ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:32:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f0be00640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c09b080 0x7f3f0c150550 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800b410 tx=0x7f3ef800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f08c00640 1 -- 172.21.15.5:0/1527023815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8015030 con 0x7f3f0c09b080 2024-08-18T22:32:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f08c00640 1 -- 172.21.15.5:0/1527023815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef8004020 con 0x7f3f0c09b080 2024-08-18T22:32:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f13a00640 1 -- 172.21.15.5:0/1527023815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0c14fa70 con 0x7f3f0c09b080 2024-08-18T22:32:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f08c00640 1 -- 172.21.15.5:0/1527023815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8004450 con 0x7f3f0c09b080 2024-08-18T22:32:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f13a00640 1 -- 172.21.15.5:0/1527023815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f0c150030 con 0x7f3f0c09b080 2024-08-18T22:32:46.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.978+0000 7f3f08c00640 1 -- 172.21.15.5:0/1527023815 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ef8018070 con 0x7f3f0c09b080 2024-08-18T22:32:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f08c00640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3eec0678c0 0x7f3eec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f08c00640 1 -- 172.21.15.5:0/1527023815 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f3ef80859e0 con 0x7f3f0c09b080 2024-08-18T22:32:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11000640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3eec0678c0 0x7f3eec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 Processor -- start 2024-08-18T22:32:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 -- start start 2024-08-18T22:32:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11000640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3eec0678c0 0x7f3eec069d80 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3f000ad000 tx=0x7f3f000a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d032de9a0 0x560d032ded80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 0x560d03291fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032928e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560d0317bae0 con 0x560d03292500 2024-08-18T22:32:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560d03167ba0 con 0x560d032de9a0 2024-08-18T22:32:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560d030e24f0 con 0x560d032df2c0 2024-08-18T22:32:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d032de9a0 0x560d032ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d032de9a0 0x560d032ded80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:51446/0 (socket says 172.21.15.5:51446) 2024-08-18T22:32:46.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11000640 1 -- 172.21.15.5:0/3067673749 learned_addr learned my addr 172.21.15.5:0/3067673749 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032928e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39674/0 (socket says 172.21.15.5:39674) 2024-08-18T22:32:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f0be00640 1 --2- 172.21.15.5:0/3067673749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 0x560d03291fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11a00640 1 -- 172.21.15.5:0/3067673749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 msgr2=0x560d03291fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11a00640 1 --2- 172.21.15.5:0/3067673749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 0x560d03291fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11a00640 1 -- 172.21.15.5:0/3067673749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d032de9a0 msgr2=0x560d032ded80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11a00640 1 --2- 172.21.15.5:0/3067673749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d032de9a0 0x560d032ded80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11a00640 1 -- 172.21.15.5:0/3067673749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d03082a90 con 0x560d03292500 2024-08-18T22:32:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f11a00640 1 --2- 172.21.15.5:0/3067673749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032928e0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f3f040012f0 tx=0x7f3f0400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119fdbb9e5a8d7b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3efd600640 1 -- 172.21.15.5:0/3067673749 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04019070 con 0x560d03292500 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3efd600640 1 -- 172.21.15.5:0/3067673749 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0400ee50 con 0x560d03292500 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3efd600640 1 -- 172.21.15.5:0/3067673749 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04014680 con 0x560d03292500 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 -- 172.21.15.5:0/3067673749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 msgr2=0x560d032928e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 --2- 172.21.15.5:0/3067673749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032928e0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f3f040012f0 tx=0x7f3f0400e530 comp rx=0 tx=0).stop 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 -- 172.21.15.5:0/3067673749 shutdown_connections 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 --2- 172.21.15.5:0/3067673749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032928e0 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 --2- 172.21.15.5:0/3067673749 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 0x560d03291fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 --2- 172.21.15.5:0/3067673749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d032de9a0 0x560d032ded80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 -- 172.21.15.5:0/3067673749 >> 172.21.15.5:0/3067673749 conn(0x560d0328c010 msgr2=0x560d032c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 -- 172.21.15.5:0/3067673749 shutdown_connections 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.982+0000 7f3f16f79000 1 -- 172.21.15.5:0/3067673749 wait complete. 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 -- start start 2024-08-18T22:32:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 Processor -- start 2024-08-18T22:32:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d03292500 0x560d032bf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032de9a0 0x560d0329a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032df2c0 0x560d0329a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560d030de4b0 con 0x560d032df2c0 2024-08-18T22:32:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560d0309cb50 con 0x560d03292500 2024-08-18T22:32:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560d03083d00 con 0x560d032de9a0 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 10 client.0 _ll_register_callbacks cb 0x560d0327ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f11a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032df2c0 0x560d0329a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f11a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032df2c0 0x560d0329a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39680/0 (socket says 172.21.15.5:39680) 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f11a00640 1 -- 172.21.15.5:0/982576671 learned_addr learned my addr 172.21.15.5:0/982576671 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f0be00640 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032de9a0 0x560d0329a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f11000640 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d03292500 0x560d032bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f11a00640 1 -- 172.21.15.5:0/982576671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032de9a0 msgr2=0x560d0329a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f11a00640 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032de9a0 0x560d0329a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f11a00640 1 -- 172.21.15.5:0/982576671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d03292500 msgr2=0x560d032bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f11a00640 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d03292500 0x560d032bf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f11a00640 1 -- 172.21.15.5:0/982576671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d0309b060 con 0x560d032df2c0 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f11a00640 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032df2c0 0x560d0329a5f0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f3f04000f90 tx=0x7f3f04001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81061176e6b2ffa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3ef2000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3ef2000640 1 -- 172.21.15.5:0/982576671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04023020 con 0x560d032df2c0 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 -- 172.21.15.5:0/982576671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f0400ee50 con 0x560d032df2c0 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3ef2000640 1 -- 172.21.15.5:0/982576671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f3f04014a40 con 0x560d032df2c0 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3ef2000640 1 -- 172.21.15.5:0/982576671 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f3f0402d050 con 0x560d032df2c0 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 10 client.10554 fetch_fsmap learned FSMap version 151 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 -- 172.21.15.5:0/982576671 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x560d030aef50 con 0x560d032df2c0 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3ef2000640 1 -- 172.21.15.5:0/982576671 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0400ee50 con 0x560d032df2c0 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3ef2000640 1 -- 172.21.15.5:0/982576671 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7f3f04030020 con 0x560d032df2c0 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 10 client.10554 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 10 client.10554 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 20 client.10554 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560d032c10c0 0x560d032f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 4 client.10554 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:32:46.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f16f79000 1 -- 172.21.15.5:0/982576671 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d0307ce10 con 0x560d032c10c0 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.986+0000 7f3f11000640 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560d032c10c0 0x560d032f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f11000640 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560d032c10c0 0x560d032f0c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2843ddd7de241364 server_cookie=9e8d1f4e8bd2e804 in_seq=0 out_seq=0 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3ef2000640 10 client.10554 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3ef2000640 1 -- 172.21.15.5:0/982576671 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d0307ce10 con 0x560d032c10c0 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3ef2000640 10 client.10554 handle_command_reply: tid=0 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 1 client.10554 shutdown 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 1 -- 172.21.15.5:0/982576671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032df2c0 msgr2=0x560d0329a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032df2c0 0x560d0329a5f0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f3f04000f90 tx=0x7f3f04001260 comp rx=0 tx=0).stop 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 1 -- 172.21.15.5:0/982576671 shutdown_connections 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560d032c10c0 0x560d032f0c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032df2c0 0x560d0329a5f0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032de9a0 0x560d0329a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 1 --2- 172.21.15.5:0/982576671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d03292500 0x560d032bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3ef2000640 0 client.10554 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 1 -- 172.21.15.5:0/982576671 >> 172.21.15.5:0/982576671 conn(0x560d0328c010 msgr2=0x560d032916c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 1 -- 172.21.15.5:0/982576671 shutdown_connections 2024-08-18T22:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 1 -- 172.21.15.5:0/982576671 wait complete. 2024-08-18T22:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:46.990+0000 7f3f16f79000 20 client.10554 trim_cache size 0 max 16384 2024-08-18T22:32:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.006+0000 7f3f16f79000 1 Processor -- start 2024-08-18T22:32:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.006+0000 7f3f16f79000 1 -- start start 2024-08-18T22:32:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d032de9a0 0x560d032917a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 0x560d03291ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c204680 con 0x560d03292500 2024-08-18T22:32:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c2036e0 con 0x560d032de9a0 2024-08-18T22:32:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0c1538d0 con 0x560d032df2c0 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f11000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f11000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032f44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39692/0 (socket says 172.21.15.5:39692) 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f11000640 1 -- 172.21.15.5:0/2683085352 learned_addr learned my addr 172.21.15.5:0/2683085352 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f11000640 1 -- 172.21.15.5:0/2683085352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 msgr2=0x560d03291ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f11000640 1 --2- 172.21.15.5:0/2683085352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 0x560d03291ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f11000640 1 -- 172.21.15.5:0/2683085352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d032de9a0 msgr2=0x560d032917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f11000640 1 --2- 172.21.15.5:0/2683085352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d032de9a0 0x560d032917a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f11000640 1 -- 172.21.15.5:0/2683085352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d03164dd0 con 0x560d03292500 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f11000640 1 --2- 172.21.15.5:0/2683085352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032f44d0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f3f0001c940 tx=0x7f3f00004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d3aeaae992aca2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3efcc00640 1 -- 172.21.15.5:0/2683085352 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f000d1070 con 0x560d03292500 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3efcc00640 1 -- 172.21.15.5:0/2683085352 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f000abe00 con 0x560d03292500 2024-08-18T22:32:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3efcc00640 1 -- 172.21.15.5:0/2683085352 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f000b0040 con 0x560d03292500 2024-08-18T22:32:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 -- 172.21.15.5:0/2683085352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 msgr2=0x560d032f44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 --2- 172.21.15.5:0/2683085352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032f44d0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f3f0001c940 tx=0x7f3f00004740 comp rx=0 tx=0).stop 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 -- 172.21.15.5:0/2683085352 shutdown_connections 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 --2- 172.21.15.5:0/2683085352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 0x560d03291ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 --2- 172.21.15.5:0/2683085352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d032de9a0 0x560d032917a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 --2- 172.21.15.5:0/2683085352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d03292500 0x560d032f44d0 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 -- 172.21.15.5:0/2683085352 >> 172.21.15.5:0/2683085352 conn(0x560d0328c010 msgr2=0x560d032bf500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 -- 172.21.15.5:0/2683085352 shutdown_connections 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 -- 172.21.15.5:0/2683085352 wait complete. 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 -- start start 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 Processor -- start 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d03292500 0x560d032f3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032de9a0 0x560d032f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 0x560d0330ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560d030bc2c0 con 0x560d032de9a0 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.010+0000 7f3f16f79000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c203090 con 0x560d03292500 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x560d0329dbc0 con 0x560d032df2c0 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 10 client.0 _ll_register_callbacks cb 0x7f3f04017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f0be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032de9a0 0x560d032f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f0be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032de9a0 0x560d032f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39696/0 (socket says 172.21.15.5:39696) 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f0be00640 1 -- 172.21.15.5:0/1161046291 learned_addr learned my addr 172.21.15.5:0/1161046291 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f11a00640 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 0x560d0330ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f11000640 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d03292500 0x560d032f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f0be00640 1 -- 172.21.15.5:0/1161046291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 msgr2=0x560d0330ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f0be00640 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 0x560d0330ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f0be00640 1 -- 172.21.15.5:0/1161046291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d03292500 msgr2=0x560d032f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f0be00640 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d03292500 0x560d032f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f0be00640 1 -- 172.21.15.5:0/1161046291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d03075cd0 con 0x560d032de9a0 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f0be00640 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032de9a0 0x560d032f3e50 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800bdd0 tx=0x7f3ef8055d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7ae18b28f108a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3ef2000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3ef2000640 1 -- 172.21.15.5:0/1161046291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8072060 con 0x560d032de9a0 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3ef2000640 1 -- 172.21.15.5:0/1161046291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6101+0+0 (secure 0 0 0) 0x7f3ef80522f0 con 0x560d032de9a0 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 -- 172.21.15.5:0/1161046291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f000abe00 con 0x560d032de9a0 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3ef2000640 1 -- 172.21.15.5:0/1161046291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f3ef8079050 con 0x560d032de9a0 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 10 client.10560 fetch_fsmap learned FSMap version 151 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 -- 172.21.15.5:0/1161046291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x560d03088320 con 0x560d032de9a0 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3ef2000640 1 -- 172.21.15.5:0/1161046291 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f000abe00 con 0x560d032de9a0 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3ef2000640 1 -- 172.21.15.5:0/1161046291 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7f3ef8022060 con 0x560d032de9a0 2024-08-18T22:32:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 10 client.10560 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:32:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 10 client.10560 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-08-18T22:32:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 20 client.10560 populate_metadata read hostname 'smithi005' 2024-08-18T22:32:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560d0330f940 0x560d033529b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 4 client.10560 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:32:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 -- 172.21.15.5:0/1161046291 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560d030efc20 con 0x560d0330f940 2024-08-18T22:32:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f11000640 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560d0330f940 0x560d033529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3ef2000640 10 client.10560 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f11000640 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560d0330f940 0x560d033529b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=214f79fecc672488 server_cookie=c271d64475901398 in_seq=0 out_seq=0 2024-08-18T22:32:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3ef2000640 1 -- 172.21.15.5:0/1161046291 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+257 (crc 0 0 0) 0x560d030efc20 con 0x560d0330f940 2024-08-18T22:32:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3ef2000640 10 client.10560 handle_command_reply: tid=0 2024-08-18T22:32:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 client.10560 shutdown 2024-08-18T22:32:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 -- 172.21.15.5:0/1161046291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032de9a0 msgr2=0x560d032f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032de9a0 0x560d032f3e50 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800bdd0 tx=0x7f3ef8055d40 comp rx=0 tx=0).stop 2024-08-18T22:32:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 -- 172.21.15.5:0/1161046291 shutdown_connections 2024-08-18T22:32:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x560d0330f940 0x560d033529b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560d032df2c0 0x560d0330ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d032de9a0 0x560d032f3e50 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 --2- 172.21.15.5:0/1161046291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560d03292500 0x560d032f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3ef2000640 0 client.10560 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:32:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 -- 172.21.15.5:0/1161046291 >> 172.21.15.5:0/1161046291 conn(0x560d0328c010 msgr2=0x560d032bfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 -- 172.21.15.5:0/1161046291 shutdown_connections 2024-08-18T22:32:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 1 -- 172.21.15.5:0/1161046291 wait complete. 2024-08-18T22:32:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f16f79000 20 client.10560 trim_cache size 0 max 16384 2024-08-18T22:32:47.021 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:32:47.022 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-18T22:32:47.022 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-18T22:32:47.022 INFO:teuthology.orchestra.run.smithi005.stdout: "fbf8a9ad-dd6b-40c9-952b-2409fc878371": { 2024-08-18T22:32:47.022 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "~mds0", 2024-08-18T22:32:47.022 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "fbf8a9ad-dd6b-40c9-952b-2409fc878371", 2024-08-18T22:32:47.022 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive" 2024-08-18T22:32:47.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:47.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:32:47.022 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:32:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f13a00640 1 -- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3eec0678c0 msgr2=0x7f3eec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f13a00640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3eec0678c0 0x7f3eec069d80 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3f000ad000 tx=0x7f3f000a6000 comp rx=0 tx=0).stop 2024-08-18T22:32:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f13a00640 1 -- 172.21.15.5:0/1527023815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c09b080 msgr2=0x7f3f0c150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.014+0000 7f3f13a00640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c09b080 0x7f3f0c150550 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800b410 tx=0x7f3ef800b8d0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.018+0000 7f3f13a00640 1 -- 172.21.15.5:0/1527023815 shutdown_connections 2024-08-18T22:32:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.018+0000 7f3f13a00640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3eec0678c0 0x7f3eec069d80 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.018+0000 7f3f13a00640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f0c0b1300 0x7f3f0c1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.018+0000 7f3f13a00640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c09b080 0x7f3f0c150550 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.018+0000 7f3f13a00640 1 --2- 172.21.15.5:0/1527023815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f0c09aca0 0x7f3f0c14ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.018+0000 7f3f13a00640 1 -- 172.21.15.5:0/1527023815 >> 172.21.15.5:0/1527023815 conn(0x7f3f0c0d2180 msgr2=0x7f3f0c0afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:47.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.018+0000 7f3f13a00640 1 -- 172.21.15.5:0/1527023815 shutdown_connections 2024-08-18T22:32:47.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:32:47.018+0000 7f3f13a00640 1 -- 172.21.15.5:0/1527023815 wait complete. 2024-08-18T22:32:47.037 INFO:tasks.cephfs.filesystem:scrub status for tag:fbf8a9ad-dd6b-40c9-952b-2409fc878371 - {'path': '~mds0', 'tag': 'fbf8a9ad-dd6b-40c9-952b-2409fc878371', 'options': 'recursive'} 2024-08-18T22:32:54.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:32:54.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:33:17.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:17.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-08-18T22:33:17.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffba0a00640 1 Processor -- start 2024-08-18T22:33:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffba0a00640 1 -- start start 2024-08-18T22:33:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffba0a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb9c070470 0x7ffb9c06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffba0a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb9c0b4090 con 0x7ffb9c06fa40 2024-08-18T22:33:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffba0a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb9c0b4370 con 0x7ffb9c06c0c0 2024-08-18T22:33:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffba0a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb9c0b60f0 con 0x7ffb9c070470 2024-08-18T22:33:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb9a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffb9c06fa40 0x7ffb9c06b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45808/0 (socket says 172.21.15.5:45808) 2024-08-18T22:33:17.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb9a800640 1 -- 172.21.15.5:0/3387013523 learned_addr learned my addr 172.21.15.5:0/3387013523 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb9b200640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb9c070470 0x7ffb9c06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545215951 0 0) 0x7ffb9c0b4090 con 0x7ffb9c06fa40 2024-08-18T22:33:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb80003530 con 0x7ffb9c06fa40 2024-08-18T22:33:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 510658592 0 0) 0x7ffb9c0b4370 con 0x7ffb9c06c0c0 2024-08-18T22:33:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb9c0b4090 con 0x7ffb9c06c0c0 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2847943614 0 0) 0x7ffb80003530 con 0x7ffb9c06fa40 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb9c070470 msgr2=0x7ffb9c06eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb9c070470 0x7ffb9c06eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 >> v1:172.21.15.117:6789/0 conn(0x7ffb9c06c0c0 legacy=0x7ffb9c072c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9c0b5d80 con 0x7ffb9c06fa40 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7ffb8c001600 con 0x7ffb9c06fa40 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 >> v1:172.21.15.5:6789/0 conn(0x7ffb9c06fa40 legacy=0x7ffb9c06b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb80003b80 0x7ffb80003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb9c070470 0x7ffb80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb80004d50 0x7ffb800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8000bb60 con 0x7ffb80003b80 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8000bce0 con 0x7ffb80004d50 2024-08-18T22:33:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.198+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb8000bee0 con 0x7ffb9c070470 2024-08-18T22:33:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb9a800640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb80003b80 0x7ffb80003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb99e00640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb9c070470 0x7ffb80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb9b200640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb80004d50 0x7ffb800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb9a800640 1 -- 172.21.15.5:0/3387013523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb9c070470 msgr2=0x7ffb80004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb9a800640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb9c070470 0x7ffb80004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb9a800640 1 -- 172.21.15.5:0/3387013523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb80004d50 msgr2=0x7ffb800051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb9a800640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb80004d50 0x7ffb800051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb9a800640 1 -- 172.21.15.5:0/3387013523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb80003530 con 0x7ffb80003b80 2024-08-18T22:33:17.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb9a800640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb80003b80 0x7ffb80003f80 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c007f50 tx=0x7ffb8c01cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236a00b17affaf6f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c007b70 con 0x7ffb80003b80 2024-08-18T22:33:17.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb8c0a9070 con 0x7ffb80003b80 2024-08-18T22:33:17.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.202+0000 7ffb99400640 1 -- 172.21.15.5:0/3387013523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c005e40 con 0x7ffb80003b80 2024-08-18T22:33:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 -- 172.21.15.5:0/3387013523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb80003b80 msgr2=0x7ffb80003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 --2- 172.21.15.5:0/3387013523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb80003b80 0x7ffb80003f80 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c007f50 tx=0x7ffb8c01cae0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb9b200640 1 -- 172.21.15.5:0/3387013523 reap_dead start 2024-08-18T22:33:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 -- 172.21.15.5:0/3387013523 shutdown_connections 2024-08-18T22:33:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 -- 172.21.15.5:0/3387013523 >> 172.21.15.5:0/3387013523 conn(0x7ffb9c0b2bf0 msgr2=0x7ffb9c0b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 -- 172.21.15.5:0/3387013523 shutdown_connections 2024-08-18T22:33:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 -- 172.21.15.5:0/3387013523 wait complete. 2024-08-18T22:33:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 Processor -- start 2024-08-18T22:33:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 -- start start 2024-08-18T22:33:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb80003b80 0x7ffb9c15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb9c155b50 0x7ffb9c1f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb9c144670 0x7ffb9c1574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c169fd0 con 0x7ffb9c155b50 2024-08-18T22:33:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c169e50 con 0x7ffb9c144670 2024-08-18T22:33:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffba0a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb9c16a150 con 0x7ffb80003b80 2024-08-18T22:33:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb9c155b50 0x7ffb9c1f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb9c155b50 0x7ffb9c1f78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51734/0 (socket says 172.21.15.5:51734) 2024-08-18T22:33:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb99e00640 1 -- 172.21.15.5:0/4276219230 learned_addr learned my addr 172.21.15.5:0/4276219230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb9b200640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb9c144670 0x7ffb9c1574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb9a800640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb80003b80 0x7ffb9c15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb99e00640 1 -- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb80003b80 msgr2=0x7ffb9c15a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb99e00640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb80003b80 0x7ffb9c15a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb99e00640 1 -- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb9c144670 msgr2=0x7ffb9c1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb99e00640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb9c144670 0x7ffb9c1574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb99e00640 1 -- 172.21.15.5:0/4276219230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9c073cc0 con 0x7ffb9c155b50 2024-08-18T22:33:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.206+0000 7ffb9a800640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb80003b80 0x7ffb9c15a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.210+0000 7ffb99e00640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb9c155b50 0x7ffb9c1f78b0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800f810 tx=0x7ffb8800fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.210+0000 7ffb92a00640 1 -- 172.21.15.5:0/4276219230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb880052e0 con 0x7ffb9c155b50 2024-08-18T22:33:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.210+0000 7ffb92a00640 1 -- 172.21.15.5:0/4276219230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb88018070 con 0x7ffb9c155b50 2024-08-18T22:33:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.210+0000 7ffba0a00640 1 -- 172.21.15.5:0/4276219230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9c15aee0 con 0x7ffb9c155b50 2024-08-18T22:33:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.210+0000 7ffb92a00640 1 -- 172.21.15.5:0/4276219230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8800d910 con 0x7ffb9c155b50 2024-08-18T22:33:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.210+0000 7ffba0a00640 1 -- 172.21.15.5:0/4276219230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb9c15b4a0 con 0x7ffb9c155b50 2024-08-18T22:33:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.210+0000 7ffb92a00640 1 -- 172.21.15.5:0/4276219230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb8800dab0 con 0x7ffb9c155b50 2024-08-18T22:33:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb92a00640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb7c0678f0 0x7ffb7c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb92a00640 1 -- 172.21.15.5:0/4276219230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7ffb88085e30 con 0x7ffb9c155b50 2024-08-18T22:33:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 Processor -- start 2024-08-18T22:33:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9a800640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb7c0678f0 0x7ffb7c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 -- start start 2024-08-18T22:33:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9a800640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb7c0678f0 0x7ffb7c069db0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c007f50 tx=0x7ffb8c0b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563de9a0 0x5611563ded80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563df2c0 0x561156391fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 0x5611563928e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56115627bae0 con 0x561156392500 2024-08-18T22:33:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561156267ba0 con 0x5611563df2c0 2024-08-18T22:33:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5611561e24f0 con 0x5611563de9a0 2024-08-18T22:33:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9b200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 0x5611563928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9a800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563de9a0 0x5611563ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9a800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563de9a0 0x5611563ded80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:36534/0 (socket says 172.21.15.5:36534) 2024-08-18T22:33:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563df2c0 0x561156391fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9a800640 1 -- 172.21.15.5:0/3338317400 learned_addr learned my addr 172.21.15.5:0/3338317400 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9b200640 1 -- 172.21.15.5:0/3338317400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563de9a0 msgr2=0x5611563ded80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9b200640 1 --2- 172.21.15.5:0/3338317400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563de9a0 0x5611563ded80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9b200640 1 -- 172.21.15.5:0/3338317400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563df2c0 msgr2=0x561156391fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9b200640 1 --2- 172.21.15.5:0/3338317400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563df2c0 0x561156391fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9b200640 1 -- 172.21.15.5:0/3338317400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561156182a90 con 0x561156392500 2024-08-18T22:33:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb9b200640 1 --2- 172.21.15.5:0/3338317400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 0x5611563928e0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000c0b0 tx=0x7ffb94009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690b4bb2a501ed17 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb87400640 1 -- 172.21.15.5:0/3338317400 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94003ba0 con 0x561156392500 2024-08-18T22:33:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb87400640 1 -- 172.21.15.5:0/3338317400 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb94003d40 con 0x561156392500 2024-08-18T22:33:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffb87400640 1 -- 172.21.15.5:0/3338317400 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94004270 con 0x561156392500 2024-08-18T22:33:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 -- 172.21.15.5:0/3338317400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 msgr2=0x5611563928e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 --2- 172.21.15.5:0/3338317400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 0x5611563928e0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000c0b0 tx=0x7ffb94009750 comp rx=0 tx=0).stop 2024-08-18T22:33:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 -- 172.21.15.5:0/3338317400 shutdown_connections 2024-08-18T22:33:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 --2- 172.21.15.5:0/3338317400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 0x5611563928e0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 --2- 172.21.15.5:0/3338317400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563df2c0 0x561156391fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 --2- 172.21.15.5:0/3338317400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563de9a0 0x5611563ded80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 -- 172.21.15.5:0/3338317400 >> 172.21.15.5:0/3338317400 conn(0x56115638c010 msgr2=0x5611563c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 -- 172.21.15.5:0/3338317400 shutdown_connections 2024-08-18T22:33:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.214+0000 7ffba4841000 1 -- 172.21.15.5:0/3338317400 wait complete. 2024-08-18T22:33:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 -- start start 2024-08-18T22:33:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 Processor -- start 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561156392500 0x5611563bf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563de9a0 0x56115639a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563df2c0 0x56115639a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5611561de4b0 con 0x5611563de9a0 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56115619cb50 con 0x561156392500 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x561156183d00 con 0x5611563df2c0 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 10 client.0 _ll_register_callbacks cb 0x56115637ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563de9a0 0x56115639a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563de9a0 0x56115639a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51764/0 (socket says 172.21.15.5:51764) 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb99e00640 1 -- 172.21.15.5:0/606032310 learned_addr learned my addr 172.21.15.5:0/606032310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb9a800640 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561156392500 0x5611563bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb9b200640 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563df2c0 0x56115639a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb99e00640 1 -- 172.21.15.5:0/606032310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563df2c0 msgr2=0x56115639a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb99e00640 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563df2c0 0x56115639a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb99e00640 1 -- 172.21.15.5:0/606032310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561156392500 msgr2=0x5611563bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb99e00640 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561156392500 0x5611563bf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb99e00640 1 -- 172.21.15.5:0/606032310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56115619b060 con 0x5611563de9a0 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb99e00640 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563de9a0 0x56115639a0b0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800f7e0 tx=0x7ffb88056830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966e8e308eba515e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb7be00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb7be00640 1 -- 172.21.15.5:0/606032310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88055440 con 0x5611563de9a0 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb7be00640 1 -- 172.21.15.5:0/606032310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7ffb880555e0 con 0x5611563de9a0 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 -- 172.21.15.5:0/606032310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb94003d40 con 0x5611563de9a0 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb7be00640 1 -- 172.21.15.5:0/606032310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7ffb88051d40 con 0x5611563de9a0 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 10 client.10572 fetch_fsmap learned FSMap version 151 2024-08-18T22:33:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 -- 172.21.15.5:0/606032310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x5611561aef50 con 0x5611563de9a0 2024-08-18T22:33:17.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb7be00640 1 -- 172.21.15.5:0/606032310 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb94003d40 con 0x5611563de9a0 2024-08-18T22:33:17.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb7be00640 1 -- 172.21.15.5:0/606032310 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7ffb88051ee0 con 0x5611563de9a0 2024-08-18T22:33:17.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 10 client.10572 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:33:17.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 10 client.10572 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-08-18T22:33:17.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 20 client.10572 populate_metadata read hostname 'smithi005' 2024-08-18T22:33:17.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5611563c1060 0x5611563f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 4 client.10572 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:33:17.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffba4841000 1 -- 172.21.15.5:0/606032310 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56115617ce10 con 0x5611563c1060 2024-08-18T22:33:17.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.218+0000 7ffb9a800640 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5611563c1060 0x5611563f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffb9a800640 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5611563c1060 0x5611563f0c60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=335cf4feea3e06b2 server_cookie=af9315e684bc096a in_seq=0 out_seq=0 2024-08-18T22:33:17.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffb7be00640 10 client.10572 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:33:17.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffb7be00640 1 -- 172.21.15.5:0/606032310 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56115617ce10 con 0x5611563c1060 2024-08-18T22:33:17.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffb7be00640 10 client.10572 handle_command_reply: tid=0 2024-08-18T22:33:17.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 1 client.10572 shutdown 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 1 -- 172.21.15.5:0/606032310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563de9a0 msgr2=0x56115639a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563de9a0 0x56115639a0b0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800f7e0 tx=0x7ffb88056830 comp rx=0 tx=0).stop 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 1 -- 172.21.15.5:0/606032310 shutdown_connections 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5611563c1060 0x5611563f0c60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563df2c0 0x56115639a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563de9a0 0x56115639a0b0 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 1 --2- 172.21.15.5:0/606032310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561156392500 0x5611563bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffb7be00640 0 client.10572 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 1 -- 172.21.15.5:0/606032310 >> 172.21.15.5:0/606032310 conn(0x56115638c010 msgr2=0x5611563916c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 1 -- 172.21.15.5:0/606032310 shutdown_connections 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 1 -- 172.21.15.5:0/606032310 wait complete. 2024-08-18T22:33:17.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.222+0000 7ffba4841000 20 client.10572 trim_cache size 0 max 16384 2024-08-18T22:33:17.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.238+0000 7ffba4841000 1 Processor -- start 2024-08-18T22:33:17.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.238+0000 7ffba4841000 1 -- start start 2024-08-18T22:33:17.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 0x56115644e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563de9a0 0x56115644e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563df2c0 0x56115644edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c204860 con 0x561156392500 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c2038d0 con 0x5611563de9a0 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffb9c154530 con 0x5611563df2c0 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb9a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 0x56115644e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb9a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 0x56115644e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51768/0 (socket says 172.21.15.5:51768) 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb9a800640 1 -- 172.21.15.5:0/696897799 learned_addr learned my addr 172.21.15.5:0/696897799 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb99e00640 1 --2- 172.21.15.5:0/696897799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563de9a0 0x56115644e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb9b200640 1 --2- 172.21.15.5:0/696897799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563df2c0 0x56115644edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb9a800640 1 -- 172.21.15.5:0/696897799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563df2c0 msgr2=0x56115644edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb9a800640 1 --2- 172.21.15.5:0/696897799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563df2c0 0x56115644edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb9a800640 1 -- 172.21.15.5:0/696897799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563de9a0 msgr2=0x56115644e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb9a800640 1 --2- 172.21.15.5:0/696897799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563de9a0 0x56115644e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb9a800640 1 -- 172.21.15.5:0/696897799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561156264dd0 con 0x561156392500 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb9a800640 1 --2- 172.21.15.5:0/696897799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 0x56115644e340 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0982e0 tx=0x7ffb9c0700d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b672e6cd8c8672 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb86a00640 1 -- 172.21.15.5:0/696897799 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0cd070 con 0x561156392500 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb86a00640 1 -- 172.21.15.5:0/696897799 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb8c0a9050 con 0x561156392500 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffb86a00640 1 -- 172.21.15.5:0/696897799 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0a55c0 con 0x561156392500 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 -- 172.21.15.5:0/696897799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 msgr2=0x56115644e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 --2- 172.21.15.5:0/696897799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 0x56115644e340 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0982e0 tx=0x7ffb9c0700d0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 -- 172.21.15.5:0/696897799 shutdown_connections 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 --2- 172.21.15.5:0/696897799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5611563df2c0 0x56115644edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 --2- 172.21.15.5:0/696897799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563de9a0 0x56115644e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 --2- 172.21.15.5:0/696897799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561156392500 0x56115644e340 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 -- 172.21.15.5:0/696897799 >> 172.21.15.5:0/696897799 conn(0x56115638c010 msgr2=0x5611563ec130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 -- 172.21.15.5:0/696897799 shutdown_connections 2024-08-18T22:33:17.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 -- 172.21.15.5:0/696897799 wait complete. 2024-08-18T22:33:17.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 -- start start 2024-08-18T22:33:17.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.242+0000 7ffba4841000 1 Processor -- start 2024-08-18T22:33:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563de9a0 0x5611564521e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563df2c0 0x561156452720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561156452c60 0x5611563f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c203280 con 0x5611563df2c0 2024-08-18T22:33:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5611561e1800 con 0x5611563de9a0 2024-08-18T22:33:17.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5611561ad7f0 con 0x561156452c60 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 10 client.0 _ll_register_callbacks cb 0x7ffb880054a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563df2c0 0x561156452720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb99e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563df2c0 0x561156452720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51778/0 (socket says 172.21.15.5:51778) 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb99e00640 1 -- 172.21.15.5:0/1502516463 learned_addr learned my addr 172.21.15.5:0/1502516463 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb9a800640 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563de9a0 0x5611564521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb9b200640 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561156452c60 0x5611563f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb99e00640 1 -- 172.21.15.5:0/1502516463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561156452c60 msgr2=0x5611563f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb99e00640 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561156452c60 0x5611563f2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb99e00640 1 -- 172.21.15.5:0/1502516463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563de9a0 msgr2=0x5611564521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb99e00640 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563de9a0 0x5611564521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb99e00640 1 -- 172.21.15.5:0/1502516463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561156175cd0 con 0x5611563df2c0 2024-08-18T22:33:17.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb9b200640 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561156452c60 0x5611563f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb99e00640 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563df2c0 0x561156452720 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800d520 tx=0x7ffb88083fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119f9e08c6029d55 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb7be00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb7be00640 1 -- 172.21.15.5:0/1502516463 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88055650 con 0x5611563df2c0 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb7be00640 1 -- 172.21.15.5:0/1502516463 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7ffb8801ecf0 con 0x5611563df2c0 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 -- 172.21.15.5:0/1502516463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb8c0a9050 con 0x5611563df2c0 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb7be00640 1 -- 172.21.15.5:0/1502516463 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7ffb8807b020 con 0x5611563df2c0 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 10 client.10578 fetch_fsmap learned FSMap version 151 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 -- 172.21.15.5:0/1502516463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x561156188320 con 0x5611563df2c0 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb7be00640 1 -- 172.21.15.5:0/1502516463 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb8c0a9050 con 0x5611563df2c0 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb7be00640 1 -- 172.21.15.5:0/1502516463 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7ffb88054eb0 con 0x5611563df2c0 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 10 client.10578 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 10 client.10578 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 20 client.10578 populate_metadata read hostname 'smithi005' 2024-08-18T22:33:17.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5611563f3a80 0x5611563f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 4 client.10578 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 -- 172.21.15.5:0/1502516463 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5611561efc20 con 0x5611563f3a80 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb9a800640 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5611563f3a80 0x5611563f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb9a800640 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5611563f3a80 0x5611563f3e90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b6de050e78d0aac server_cookie=c5b2e391b02c97d6 in_seq=0 out_seq=0 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb7be00640 10 client.10578 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb7be00640 1 -- 172.21.15.5:0/1502516463 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5611561efc20 con 0x5611563f3a80 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb7be00640 10 client.10578 handle_command_reply: tid=0 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 client.10578 shutdown 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 -- 172.21.15.5:0/1502516463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563df2c0 msgr2=0x561156452720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563df2c0 0x561156452720 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800d520 tx=0x7ffb88083fb0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 -- 172.21.15.5:0/1502516463 shutdown_connections 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x5611563f3a80 0x5611563f3e90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x561156452c60 0x5611563f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5611563df2c0 0x561156452720 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 --2- 172.21.15.5:0/1502516463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5611563de9a0 0x5611564521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffb7be00640 0 client.10578 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:33:17.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 -- 172.21.15.5:0/1502516463 >> 172.21.15.5:0/1502516463 conn(0x56115638c010 msgr2=0x5611563bf500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 -- 172.21.15.5:0/1502516463 shutdown_connections 2024-08-18T22:33:17.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 1 -- 172.21.15.5:0/1502516463 wait complete. 2024-08-18T22:33:17.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.246+0000 7ffba4841000 20 client.10578 trim_cache size 0 max 16384 2024-08-18T22:33:17.249 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:33:17.249 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-18T22:33:17.249 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-08-18T22:33:17.249 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:33:17.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 -- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb7c0678f0 msgr2=0x7ffb7c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb7c0678f0 0x7ffb7c069db0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c007f50 tx=0x7ffb8c0b1040 comp rx=0 tx=0).stop 2024-08-18T22:33:17.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 -- 172.21.15.5:0/4276219230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb9c155b50 msgr2=0x7ffb9c1f78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb9c155b50 0x7ffb9c1f78b0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800f810 tx=0x7ffb8800fcd0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 -- 172.21.15.5:0/4276219230 shutdown_connections 2024-08-18T22:33:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb7c0678f0 0x7ffb7c069db0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb9c144670 0x7ffb9c1574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb9c155b50 0x7ffb9c1f78b0 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 --2- 172.21.15.5:0/4276219230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb80003b80 0x7ffb9c15a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 -- 172.21.15.5:0/4276219230 >> 172.21.15.5:0/4276219230 conn(0x7ffb9c0b2bf0 msgr2=0x7ffb9c15ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 -- 172.21.15.5:0/4276219230 shutdown_connections 2024-08-18T22:33:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.250+0000 7ffba0a00640 1 -- 172.21.15.5:0/4276219230 wait complete. 2024-08-18T22:33:17.265 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:33:17.265 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-08-18T22:33:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.410+0000 7fe647600640 1 Processor -- start 2024-08-18T22:33:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.410+0000 7fe647600640 1 -- start start 2024-08-18T22:33:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe647600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe640158710 0x7fe64006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe647600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64006d0d0 0x7fe6400af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe647600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe64015f780 con 0x7fe64015e7b0 2024-08-18T22:33:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe647600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe64015ec40 con 0x7fe640158710 2024-08-18T22:33:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe647600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe64015eee0 con 0x7fe64006d0d0 2024-08-18T22:33:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe637e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe64015e7b0 0x7fe64006c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45810/0 (socket says 172.21.15.5:45810) 2024-08-18T22:33:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe637e00640 1 -- 172.21.15.5:0/4024492274 learned_addr learned my addr 172.21.15.5:0/4024492274 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe644c00640 1 --2- 172.21.15.5:0/4024492274 >> v2:172.21.15.117:3300/0 conn(0x7fe640158710 0x7fe64006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe645600640 1 --2- 172.21.15.5:0/4024492274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64006d0d0 0x7fe6400af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe63fe00640 1 -- 172.21.15.5:0/4024492274 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1158627580 0 0) 0x7fe64015f780 con 0x7fe64015e7b0 2024-08-18T22:33:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe63fe00640 1 -- 172.21.15.5:0/4024492274 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe624003530 con 0x7fe64015e7b0 2024-08-18T22:33:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe644c00640 1 -- 172.21.15.5:0/4024492274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64006d0d0 msgr2=0x7fe6400af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe644c00640 1 --2- 172.21.15.5:0/4024492274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64006d0d0 0x7fe6400af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe644c00640 1 -- 172.21.15.5:0/4024492274 >> v1:172.21.15.5:6789/0 conn(0x7fe64015e7b0 legacy=0x7fe64006c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe644c00640 1 -- 172.21.15.5:0/4024492274 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64015f1c0 con 0x7fe640158710 2024-08-18T22:33:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.414+0000 7fe645600640 1 --2- 172.21.15.5:0/4024492274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64006d0d0 0x7fe6400af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:33:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe644c00640 1 --2- 172.21.15.5:0/4024492274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe640158710 0x7fe64006ef60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe6300097c0 tx=0x7fe63001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9873de5ddc4ac918 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe63fe00640 1 -- 172.21.15.5:0/4024492274 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300b2070 con 0x7fe640158710 2024-08-18T22:33:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe63fe00640 1 -- 172.21.15.5:0/4024492274 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6300ad640 con 0x7fe640158710 2024-08-18T22:33:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe63fe00640 1 -- 172.21.15.5:0/4024492274 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300ad9f0 con 0x7fe640158710 2024-08-18T22:33:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe647600640 1 -- 172.21.15.5:0/4024492274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe640158710 msgr2=0x7fe64006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe647600640 1 --2- 172.21.15.5:0/4024492274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe640158710 0x7fe64006ef60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe6300097c0 tx=0x7fe63001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe647600640 1 -- 172.21.15.5:0/4024492274 shutdown_connections 2024-08-18T22:33:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe647600640 1 --2- 172.21.15.5:0/4024492274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe64006d0d0 0x7fe6400af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe647600640 1 --2- 172.21.15.5:0/4024492274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe640158710 0x7fe64006ef60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe647600640 1 -- 172.21.15.5:0/4024492274 >> 172.21.15.5:0/4024492274 conn(0x7fe640072350 msgr2=0x7fe640072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe647600640 1 -- 172.21.15.5:0/4024492274 shutdown_connections 2024-08-18T22:33:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe647600640 1 -- 172.21.15.5:0/4024492274 wait complete. 2024-08-18T22:33:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe647600640 1 Processor -- start 2024-08-18T22:33:17.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.418+0000 7fe647600640 1 -- start start 2024-08-18T22:33:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe647600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64006d0d0 0x7fe64014f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe647600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe640158710 0x7fe64014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe647600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64015e7b0 0x7fe640135f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe647600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe6400b5050 con 0x7fe64015e7b0 2024-08-18T22:33:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe647600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6400b4ed0 con 0x7fe64006d0d0 2024-08-18T22:33:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe647600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe6400b00e0 con 0x7fe640158710 2024-08-18T22:33:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe645600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64015e7b0 0x7fe640135f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe645600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64015e7b0 0x7fe640135f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51792/0 (socket says 172.21.15.5:51792) 2024-08-18T22:33:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe645600640 1 -- 172.21.15.5:0/2314890068 learned_addr learned my addr 172.21.15.5:0/2314890068 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe637e00640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe640158710 0x7fe64014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe644c00640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64006d0d0 0x7fe64014f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe645600640 1 -- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe640158710 msgr2=0x7fe64014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe645600640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe640158710 0x7fe64014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe645600640 1 -- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64006d0d0 msgr2=0x7fe64014f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe645600640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64006d0d0 0x7fe64014f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe645600640 1 -- 172.21.15.5:0/2314890068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64014f860 con 0x7fe64015e7b0 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe645600640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64015e7b0 0x7fe640135f80 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fe638009e50 tx=0x7fe63800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe63d600640 1 -- 172.21.15.5:0/2314890068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638018030 con 0x7fe64015e7b0 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe63d600640 1 -- 172.21.15.5:0/2314890068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63800cd90 con 0x7fe64015e7b0 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe63d600640 1 -- 172.21.15.5:0/2314890068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638003bc0 con 0x7fe64015e7b0 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe647600640 1 -- 172.21.15.5:0/2314890068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64014fb40 con 0x7fe64015e7b0 2024-08-18T22:33:17.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe647600640 1 -- 172.21.15.5:0/2314890068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe640150100 con 0x7fe64015e7b0 2024-08-18T22:33:17.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.422+0000 7fe63d600640 1 -- 172.21.15.5:0/2314890068 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe63801b070 con 0x7fe64015e7b0 2024-08-18T22:33:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe63d600640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe61c0678c0 0x7fe61c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe63d600640 1 -- 172.21.15.5:0/2314890068 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fe6380868a0 con 0x7fe64015e7b0 2024-08-18T22:33:17.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe644c00640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe61c0678c0 0x7fe61c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe64ab3d000 1 Processor -- start 2024-08-18T22:33:17.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe64ab3d000 1 -- start start 2024-08-18T22:33:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe644c00640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe61c0678c0 0x7fe61c069d80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe6300af000 tx=0x7fe630008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec79b0 0x55647fec7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec82d0 0x55647fe7afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fe7b510 0x55647fe7b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55647fd64af0 con 0x55647fec79b0 2024-08-18T22:33:17.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55647fd50bb0 con 0x55647fec82d0 2024-08-18T22:33:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55647fccb500 con 0x55647fe7b510 2024-08-18T22:33:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe644c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec79b0 0x55647fec7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe644c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec79b0 0x55647fec7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51800/0 (socket says 172.21.15.5:51800) 2024-08-18T22:33:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe644c00640 1 -- 172.21.15.5:0/2667709563 learned_addr learned my addr 172.21.15.5:0/2667709563 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe645600640 1 --2- 172.21.15.5:0/2667709563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fe7b510 0x55647fe7b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe637e00640 1 --2- 172.21.15.5:0/2667709563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec82d0 0x55647fe7afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe644c00640 1 -- 172.21.15.5:0/2667709563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fe7b510 msgr2=0x55647fe7b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe644c00640 1 --2- 172.21.15.5:0/2667709563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fe7b510 0x55647fe7b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe644c00640 1 -- 172.21.15.5:0/2667709563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec82d0 msgr2=0x55647fe7afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe644c00640 1 --2- 172.21.15.5:0/2667709563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec82d0 0x55647fe7afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe644c00640 1 -- 172.21.15.5:0/2667709563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55647fc6baa0 con 0x55647fec79b0 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe637e00640 1 --2- 172.21.15.5:0/2667709563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec82d0 0x55647fe7afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.426+0000 7fe644c00640 1 --2- 172.21.15.5:0/2667709563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec79b0 0x55647fec7d90 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fe630008010 tx=0x7fe6300a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f45d300257166 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe635600640 1 -- 172.21.15.5:0/2667709563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300c9070 con 0x55647fec79b0 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe635600640 1 -- 172.21.15.5:0/2667709563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6300b3040 con 0x55647fec79b0 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe635600640 1 -- 172.21.15.5:0/2667709563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300b9630 con 0x55647fec79b0 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 -- 172.21.15.5:0/2667709563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec79b0 msgr2=0x55647fec7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/2667709563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec79b0 0x55647fec7d90 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fe630008010 tx=0x7fe6300a7070 comp rx=0 tx=0).stop 2024-08-18T22:33:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 -- 172.21.15.5:0/2667709563 shutdown_connections 2024-08-18T22:33:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/2667709563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fe7b510 0x55647fe7b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/2667709563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec82d0 0x55647fe7afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/2667709563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec79b0 0x55647fec7d90 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 -- 172.21.15.5:0/2667709563 >> 172.21.15.5:0/2667709563 conn(0x55647fe75020 msgr2=0x55647feaa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 -- 172.21.15.5:0/2667709563 shutdown_connections 2024-08-18T22:33:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 -- 172.21.15.5:0/2667709563 wait complete. 2024-08-18T22:33:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 -- start start 2024-08-18T22:33:17.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 Processor -- start 2024-08-18T22:33:17.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fea8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fec79b0 0x55647fe83080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec82d0 0x55647fe835c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55647fcc74c0 con 0x55647fe7b510 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55647fc85b60 con 0x55647fec82d0 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55647fc6cd10 con 0x55647fec79b0 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 10 client.0 _ll_register_callbacks cb 0x55647fe68f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe644c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fea8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe644c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fea8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51812/0 (socket says 172.21.15.5:51812) 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe644c00640 1 -- 172.21.15.5:0/633318228 learned_addr learned my addr 172.21.15.5:0/633318228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe644c00640 1 -- 172.21.15.5:0/633318228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fec79b0 msgr2=0x55647fe83080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe644c00640 1 --2- 172.21.15.5:0/633318228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fec79b0 0x55647fe83080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe644c00640 1 -- 172.21.15.5:0/633318228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec82d0 msgr2=0x55647fe835c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe644c00640 1 --2- 172.21.15.5:0/633318228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec82d0 0x55647fe835c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe644c00640 1 -- 172.21.15.5:0/633318228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55647fc84070 con 0x55647fe7b510 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe644c00640 1 --2- 172.21.15.5:0/633318228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fea8050 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fe63001c980 tx=0x7fe63001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70016722182ff0f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe62e000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe62e000640 1 -- 172.21.15.5:0/633318228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300d3060 con 0x55647fe7b510 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe62e000640 1 -- 172.21.15.5:0/633318228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fe6300b9b80 con 0x55647fe7b510 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.430+0000 7fe64ab3d000 1 -- 172.21.15.5:0/633318228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6300b3040 con 0x55647fe7b510 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe62e000640 1 -- 172.21.15.5:0/633318228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7fe6300d9050 con 0x55647fe7b510 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 10 client.10590 fetch_fsmap learned FSMap version 151 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 -- 172.21.15.5:0/633318228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x55647fc97f60 con 0x55647fe7b510 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe62e000640 1 -- 172.21.15.5:0/633318228 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6300b3040 con 0x55647fe7b510 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe62e000640 1 -- 172.21.15.5:0/633318228 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7fe6300dc020 con 0x55647fe7b510 2024-08-18T22:33:17.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 10 client.10590 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:33:17.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 10 client.10590 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-08-18T22:33:17.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 20 client.10590 populate_metadata read hostname 'smithi005' 2024-08-18T22:33:17.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/633318228 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x55647fea9d40 0x55647feaa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 4 client.10590 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:33:17.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 -- 172.21.15.5:0/633318228 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55647fc65e20 con 0x55647fea9d40 2024-08-18T22:33:17.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe637e00640 1 --2- 172.21.15.5:0/633318228 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x55647fea9d40 0x55647feaa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe637e00640 1 --2- 172.21.15.5:0/633318228 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x55647fea9d40 0x55647feaa120 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b97d09b49b4c49 server_cookie=fb8363f5f0259b3c in_seq=0 out_seq=0 2024-08-18T22:33:17.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe62e000640 10 client.10590 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:33:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe62e000640 1 -- 172.21.15.5:0/633318228 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55647fc65e20 con 0x55647fea9d40 2024-08-18T22:33:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe62e000640 10 client.10590 handle_command_reply: tid=0 2024-08-18T22:33:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 client.10590 shutdown 2024-08-18T22:33:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 -- 172.21.15.5:0/633318228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 msgr2=0x55647fea8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/633318228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fea8050 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fe63001c980 tx=0x7fe63001ace0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 -- 172.21.15.5:0/633318228 shutdown_connections 2024-08-18T22:33:17.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/633318228 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x55647fea9d40 0x55647feaa120 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/633318228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec82d0 0x55647fe835c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/633318228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fec79b0 0x55647fe83080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/633318228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fea8050 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 -- 172.21.15.5:0/633318228 >> 172.21.15.5:0/633318228 conn(0x55647fe75020 msgr2=0x55647fe7a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe62e000640 0 client.10590 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:33:17.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 -- 172.21.15.5:0/633318228 shutdown_connections 2024-08-18T22:33:17.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 1 -- 172.21.15.5:0/633318228 wait complete. 2024-08-18T22:33:17.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.434+0000 7fe64ab3d000 20 client.10590 trim_cache size 0 max 16384 2024-08-18T22:33:17.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 Processor -- start 2024-08-18T22:33:17.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 -- start start 2024-08-18T22:33:17.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fedf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec79b0 0x55647fea8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fec82d0 0x55647fea9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe640203b00 con 0x55647fe7b510 2024-08-18T22:33:17.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe640202b40 con 0x55647fec79b0 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe640138a90 con 0x55647fec82d0 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe644c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fedf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe644c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fedf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51818/0 (socket says 172.21.15.5:51818) 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe644c00640 1 -- 172.21.15.5:0/2595699722 learned_addr learned my addr 172.21.15.5:0/2595699722 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe637e00640 1 --2- 172.21.15.5:0/2595699722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec79b0 0x55647fea8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe645600640 1 --2- 172.21.15.5:0/2595699722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fec82d0 0x55647fea9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe644c00640 1 -- 172.21.15.5:0/2595699722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fec82d0 msgr2=0x55647fea9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe644c00640 1 --2- 172.21.15.5:0/2595699722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fec82d0 0x55647fea9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe644c00640 1 -- 172.21.15.5:0/2595699722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec79b0 msgr2=0x55647fea8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe644c00640 1 --2- 172.21.15.5:0/2595699722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec79b0 0x55647fea8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe644c00640 1 -- 172.21.15.5:0/2595699722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55647fd4dde0 con 0x55647fe7b510 2024-08-18T22:33:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe644c00640 1 --2- 172.21.15.5:0/2595699722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fedf2f0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fe63001c4e0 tx=0x7fe63000b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744ef7930785890a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe634c00640 1 -- 172.21.15.5:0/2595699722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300c9070 con 0x55647fe7b510 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe634c00640 1 -- 172.21.15.5:0/2595699722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6300b3070 con 0x55647fe7b510 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe634c00640 1 -- 172.21.15.5:0/2595699722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300b9c00 con 0x55647fe7b510 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 -- 172.21.15.5:0/2595699722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 msgr2=0x55647fedf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/2595699722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fedf2f0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fe63001c4e0 tx=0x7fe63000b050 comp rx=0 tx=0).stop 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 -- 172.21.15.5:0/2595699722 shutdown_connections 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/2595699722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fec82d0 0x55647fea9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/2595699722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec79b0 0x55647fea8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/2595699722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fe7b510 0x55647fedf2f0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 -- 172.21.15.5:0/2595699722 >> 172.21.15.5:0/2595699722 conn(0x55647fe75020 msgr2=0x55647fea85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 -- 172.21.15.5:0/2595699722 shutdown_connections 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 -- 172.21.15.5:0/2595699722 wait complete. 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.450+0000 7fe64ab3d000 1 -- start start 2024-08-18T22:33:17.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 Processor -- start 2024-08-18T22:33:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fe7b510 0x55647ff3b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec79b0 0x55647ff3b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec82d0 0x55647ff3bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe640202540 con 0x55647fec82d0 2024-08-18T22:33:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55647fcca810 con 0x55647fec79b0 2024-08-18T22:33:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55647fd88250 con 0x55647fe7b510 2024-08-18T22:33:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 10 client.0 _ll_register_callbacks cb 0x7fe6300c7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:33:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe645600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec82d0 0x55647ff3bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe645600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec82d0 0x55647ff3bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51826/0 (socket says 172.21.15.5:51826) 2024-08-18T22:33:17.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe645600640 1 -- 172.21.15.5:0/970039064 learned_addr learned my addr 172.21.15.5:0/970039064 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe637e00640 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec79b0 0x55647ff3b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe644c00640 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fe7b510 0x55647ff3b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe645600640 1 -- 172.21.15.5:0/970039064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fe7b510 msgr2=0x55647ff3b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe645600640 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fe7b510 0x55647ff3b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe645600640 1 -- 172.21.15.5:0/970039064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec79b0 msgr2=0x55647ff3b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe645600640 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec79b0 0x55647ff3b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe645600640 1 -- 172.21.15.5:0/970039064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55647fc5ece0 con 0x55647fec82d0 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe645600640 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec82d0 0x55647ff3bce0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fe638052ec0 tx=0x7fe638012480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287ad95910bc0b8c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe62e000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe62e000640 1 -- 172.21.15.5:0/970039064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63805d2b0 con 0x55647fec82d0 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe62e000640 1 -- 172.21.15.5:0/970039064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fe63807fd40 con 0x55647fec82d0 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 -- 172.21.15.5:0/970039064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6300b3070 con 0x55647fec82d0 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe62e000640 1 -- 172.21.15.5:0/970039064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7fe63805f640 con 0x55647fec82d0 2024-08-18T22:33:17.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 10 client.10596 fetch_fsmap learned FSMap version 151 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 -- 172.21.15.5:0/970039064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) -- 0x55647fc71330 con 0x55647fec82d0 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe62e000640 1 -- 172.21.15.5:0/970039064 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6300b3070 con 0x55647fec82d0 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe62e000640 1 -- 172.21.15.5:0/970039064 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 151) ==== 3502+0+0 (secure 0 0 0) 0x7fe638025060 con 0x55647fec82d0 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 10 client.10596 fetch_fsmap finished waiting for FSMap version 151 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 10 client.10596 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 20 client.10596 populate_metadata read hostname 'smithi005' 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x55647fedcd70 0x55647fedd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 4 client.10596 mds_command: new command op to 10350 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 -- 172.21.15.5:0/970039064 --> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55647fcd8c30 con 0x55647fedcd70 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe644c00640 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x55647fedcd70 0x55647fedd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe62e000640 10 client.10596 ms_handle_connect on v2:172.21.15.5:6834/114900580 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe644c00640 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x55647fedcd70 0x55647fedd180 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d7f3c6fa2b73579 server_cookie=1c548c367430c9f7 in_seq=0 out_seq=0 2024-08-18T22:33:17.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe62e000640 1 -- 172.21.15.5:0/970039064 <== mds.0 v2:172.21.15.5:6834/114900580 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55647fcd8c30 con 0x55647fedcd70 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe62e000640 10 client.10596 handle_command_reply: tid=0 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.454+0000 7fe64ab3d000 1 client.10596 shutdown 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe64ab3d000 1 -- 172.21.15.5:0/970039064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec82d0 msgr2=0x55647ff3bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec82d0 0x55647ff3bce0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fe638052ec0 tx=0x7fe638012480 comp rx=0 tx=0).stop 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe64ab3d000 1 -- 172.21.15.5:0/970039064 shutdown_connections 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.5:6834/114900580,v1:172.21.15.5:6835/114900580] conn(0x55647fedcd70 0x55647fedd180 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55647fec82d0 0x55647ff3bce0 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55647fec79b0 0x55647ff3b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe62e000640 0 client.10596 ms_handle_reset on v2:172.21.15.5:6834/114900580 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe64ab3d000 1 --2- 172.21.15.5:0/970039064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55647fe7b510 0x55647ff3b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe64ab3d000 1 -- 172.21.15.5:0/970039064 >> 172.21.15.5:0/970039064 conn(0x55647fe75020 msgr2=0x55647fea8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe64ab3d000 1 -- 172.21.15.5:0/970039064 shutdown_connections 2024-08-18T22:33:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe64ab3d000 1 -- 172.21.15.5:0/970039064 wait complete. 2024-08-18T22:33:17.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe64ab3d000 20 client.10596 trim_cache size 0 max 16384 2024-08-18T22:33:17.458 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-18T22:33:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 -- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe61c0678c0 msgr2=0x7fe61c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe61c0678c0 0x7fe61c069d80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe6300af000 tx=0x7fe630008040 comp rx=0 tx=0).stop 2024-08-18T22:33:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 -- 172.21.15.5:0/2314890068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64015e7b0 msgr2=0x7fe640135f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64015e7b0 0x7fe640135f80 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fe638009e50 tx=0x7fe63800c490 comp rx=0 tx=0).stop 2024-08-18T22:33:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 -- 172.21.15.5:0/2314890068 shutdown_connections 2024-08-18T22:33:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe61c0678c0 0x7fe61c069d80 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe64015e7b0 0x7fe640135f80 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe640158710 0x7fe64014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 --2- 172.21.15.5:0/2314890068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64006d0d0 0x7fe64014f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 -- 172.21.15.5:0/2314890068 >> 172.21.15.5:0/2314890068 conn(0x7fe640072350 msgr2=0x7fe640072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 -- 172.21.15.5:0/2314890068 shutdown_connections 2024-08-18T22:33:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.458+0000 7fe647600640 1 -- 172.21.15.5:0/2314890068 wait complete. 2024-08-18T22:33:17.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-18T22:33:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa43aa00640 1 Processor -- start 2024-08-18T22:33:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa43aa00640 1 -- start start 2024-08-18T22:33:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa43aa00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa43415b280 0x7fa4340cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa43aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4340cdf40 0x7fa4340cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa43aa00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4340b35a0 con 0x7fa4340b2560 2024-08-18T22:33:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa43aa00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa4340cbdd0 con 0x7fa4340cdf40 2024-08-18T22:33:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa43aa00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa4340b3880 con 0x7fa43415b280 2024-08-18T22:33:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa438a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4340cdf40 0x7fa4340cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa42b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa4340b2560 0x7fa4340cd830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45812/0 (socket says 172.21.15.5:45812) 2024-08-18T22:33:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa42b400640 1 -- 172.21.15.5:0/2250624031 learned_addr learned my addr 172.21.15.5:0/2250624031 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa433e00640 1 --2- 172.21.15.5:0/2250624031 >> v2:172.21.15.117:3300/0 conn(0x7fa43415b280 0x7fa4340cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa438a00640 1 -- 172.21.15.5:0/2250624031 >> v2:172.21.15.117:3300/0 conn(0x7fa43415b280 msgr2=0x7fa4340cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa438a00640 1 --2- 172.21.15.5:0/2250624031 >> v2:172.21.15.117:3300/0 conn(0x7fa43415b280 0x7fa4340cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa438a00640 1 -- 172.21.15.5:0/2250624031 >> v1:172.21.15.5:6789/0 conn(0x7fa4340b2560 legacy=0x7fa4340cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.618+0000 7fa438a00640 1 -- 172.21.15.5:0/2250624031 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4340b3b60 con 0x7fa4340cdf40 2024-08-18T22:33:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa438a00640 1 --2- 172.21.15.5:0/2250624031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4340cdf40 0x7fa4340cc260 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fa434072010 tx=0x7fa42c01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea7253c245f7c8e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa433400640 1 -- 172.21.15.5:0/2250624031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0b2070 con 0x7fa4340cdf40 2024-08-18T22:33:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa433400640 1 -- 172.21.15.5:0/2250624031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42c0a5760 con 0x7fa4340cdf40 2024-08-18T22:33:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa433400640 1 -- 172.21.15.5:0/2250624031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43415b870 con 0x7fa4340cdf40 2024-08-18T22:33:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa43aa00640 1 -- 172.21.15.5:0/2250624031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4340cdf40 msgr2=0x7fa4340cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa43aa00640 1 --2- 172.21.15.5:0/2250624031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4340cdf40 0x7fa4340cc260 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fa434072010 tx=0x7fa42c01c700 comp rx=0 tx=0).stop 2024-08-18T22:33:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa43aa00640 1 -- 172.21.15.5:0/2250624031 shutdown_connections 2024-08-18T22:33:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa43aa00640 1 --2- 172.21.15.5:0/2250624031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4340cdf40 0x7fa4340cc260 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa43aa00640 1 --2- 172.21.15.5:0/2250624031 >> v2:172.21.15.117:3300/0 conn(0x7fa43415b280 0x7fa4340cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa43aa00640 1 -- 172.21.15.5:0/2250624031 >> 172.21.15.5:0/2250624031 conn(0x7fa43409aa40 msgr2=0x7fa4340b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa43aa00640 1 -- 172.21.15.5:0/2250624031 shutdown_connections 2024-08-18T22:33:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa43aa00640 1 -- 172.21.15.5:0/2250624031 wait complete. 2024-08-18T22:33:17.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa43aa00640 1 Processor -- start 2024-08-18T22:33:17.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.622+0000 7fa43aa00640 1 -- start start 2024-08-18T22:33:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa43aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4340b2560 0x7fa434157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa43aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340cdf40 0x7fa4340aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa43aa00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa43415b280 0x7fa4340af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa43aa00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4340ccfb0 con 0x7fa4340b2560 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa43aa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4340b2b90 con 0x7fa4340cdf40 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa43aa00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa4340cd130 con 0x7fa43415b280 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa433e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4340b2560 0x7fa434157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa433e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4340b2560 0x7fa434157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51842/0 (socket says 172.21.15.5:51842) 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa433e00640 1 -- 172.21.15.5:0/1609667034 learned_addr learned my addr 172.21.15.5:0/1609667034 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa433e00640 1 -- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa43415b280 msgr2=0x7fa4340af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa433e00640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa43415b280 0x7fa4340af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa433e00640 1 -- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340cdf40 msgr2=0x7fa4340aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa42b400640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340cdf40 0x7fa4340aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa433e00640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340cdf40 0x7fa4340aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa433e00640 1 -- 172.21.15.5:0/1609667034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa434156680 con 0x7fa4340b2560 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa42b400640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340cdf40 0x7fa4340aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa433e00640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4340b2560 0x7fa434157720 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fa42400e870 tx=0x7fa42400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa430c00640 1 -- 172.21.15.5:0/1609667034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424017070 con 0x7fa4340b2560 2024-08-18T22:33:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa430c00640 1 -- 172.21.15.5:0/1609667034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42400c940 con 0x7fa4340b2560 2024-08-18T22:33:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa430c00640 1 -- 172.21.15.5:0/1609667034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42400ccf0 con 0x7fa4340b2560 2024-08-18T22:33:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa43aa00640 1 -- 172.21.15.5:0/1609667034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa434156960 con 0x7fa4340b2560 2024-08-18T22:33:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa43aa00640 1 -- 172.21.15.5:0/1609667034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa434156f20 con 0x7fa4340b2560 2024-08-18T22:33:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.626+0000 7fa43aa00640 1 -- 172.21.15.5:0/1609667034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4340cd4f0 con 0x7fa4340b2560 2024-08-18T22:33:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.630+0000 7fa430c00640 1 -- 172.21.15.5:0/1609667034 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa42401a070 con 0x7fa4340b2560 2024-08-18T22:33:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.630+0000 7fa430c00640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4100678c0 0x7fa410069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.630+0000 7fa430c00640 1 -- 172.21.15.5:0/1609667034 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fa424086180 con 0x7fa4340b2560 2024-08-18T22:33:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.630+0000 7fa42b400640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4100678c0 0x7fa410069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.630+0000 7fa42b400640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4100678c0 0x7fa410069d80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa4340cb5d0 tx=0x7fa41c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.634+0000 7fa430c00640 1 -- 172.21.15.5:0/1609667034 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa424056a40 con 0x7fa4340b2560 2024-08-18T22:33:17.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 -- 172.21.15.5:0/1609667034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa4340cfa50 con 0x7fa4340b2560 2024-08-18T22:33:17.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa430c00640 1 -- 172.21.15.5:0/1609667034 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa424056340 con 0x7fa4340b2560 2024-08-18T22:33:17.831 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:17.831 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-18T22:33:17.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 -- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4100678c0 msgr2=0x7fa410069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4100678c0 0x7fa410069d80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa4340cb5d0 tx=0x7fa41c009040 comp rx=0 tx=0).stop 2024-08-18T22:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 -- 172.21.15.5:0/1609667034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4340b2560 msgr2=0x7fa434157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4340b2560 0x7fa434157720 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fa42400e870 tx=0x7fa42400ec70 comp rx=0 tx=0).stop 2024-08-18T22:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 -- 172.21.15.5:0/1609667034 shutdown_connections 2024-08-18T22:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4100678c0 0x7fa410069d80 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa43415b280 0x7fa4340af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340cdf40 0x7fa4340aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 --2- 172.21.15.5:0/1609667034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4340b2560 0x7fa434157720 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 -- 172.21.15.5:0/1609667034 >> 172.21.15.5:0/1609667034 conn(0x7fa43409aa40 msgr2=0x7fa434069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 -- 172.21.15.5:0/1609667034 shutdown_connections 2024-08-18T22:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:17.834+0000 7fa43aa00640 1 -- 172.21.15.5:0/1609667034 wait complete. 2024-08-18T22:33:17.851 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:33:17.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:33:17.980 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:33:18.078 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:33:18.078 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:33:18.079 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:33:18.079 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:33:18.088 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:33:18.088 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:33:18.137 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:33:18.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe672400640 1 Processor -- start 2024-08-18T22:33:18.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe672400640 1 -- start start 2024-08-18T22:33:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe672400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66c15b0c0 0x7fe66c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe672400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe66c0b40c0 0x7fe66c0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe672400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe66c072a30 0x7fe66c072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe672400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe66c0b3d70 con 0x7fe66c0b40c0 2024-08-18T22:33:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe672400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe66c0b4a40 con 0x7fe66c072a30 2024-08-18T22:33:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe672400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe66c0b31f0 con 0x7fe66c15b0c0 2024-08-18T22:33:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe66aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe66c0b40c0 0x7fe66c0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe66aa00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe66c0b40c0 0x7fe66c0b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51850/0 (socket says 172.21.15.5:51850) 2024-08-18T22:33:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe66aa00640 1 -- 172.21.15.5:0/3278639363 learned_addr learned my addr 172.21.15.5:0/3278639363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe66be00640 1 --2- 172.21.15.5:0/3278639363 >> v2:172.21.15.117:3300/0 conn(0x7fe66c072a30 0x7fe66c072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe66b400640 1 --2- 172.21.15.5:0/3278639363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66c15b0c0 0x7fe66c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe66aa00640 1 -- 172.21.15.5:0/3278639363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66c15b0c0 msgr2=0x7fe66c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe66aa00640 1 --2- 172.21.15.5:0/3278639363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66c15b0c0 0x7fe66c06db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe66aa00640 1 -- 172.21.15.5:0/3278639363 >> v2:172.21.15.117:3300/0 conn(0x7fe66c072a30 msgr2=0x7fe66c072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe66aa00640 1 --2- 172.21.15.5:0/3278639363 >> v2:172.21.15.117:3300/0 conn(0x7fe66c072a30 0x7fe66c072ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe66aa00640 1 -- 172.21.15.5:0/3278639363 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c0b34d0 con 0x7fe66c0b40c0 2024-08-18T22:33:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.326+0000 7fe66be00640 1 --2- 172.21.15.5:0/3278639363 >> v2:172.21.15.117:3300/0 conn(0x7fe66c072a30 0x7fe66c072ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:18.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe66aa00640 1 --2- 172.21.15.5:0/3278639363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c0b40c0 0x7fe66c0b4500 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fe66c15ec00 tx=0x7fe65801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a1fc0d06d14dc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:18.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe66a000640 1 -- 172.21.15.5:0/3278639363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6580b2070 con 0x7fe66c0b40c0 2024-08-18T22:33:18.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe66a000640 1 -- 172.21.15.5:0/3278639363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6580ad640 con 0x7fe66c0b40c0 2024-08-18T22:33:18.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe66a000640 1 -- 172.21.15.5:0/3278639363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6580ada10 con 0x7fe66c0b40c0 2024-08-18T22:33:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe672400640 1 -- 172.21.15.5:0/3278639363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c0b40c0 msgr2=0x7fe66c0b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe672400640 1 --2- 172.21.15.5:0/3278639363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c0b40c0 0x7fe66c0b4500 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fe66c15ec00 tx=0x7fe65801c3d0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe672400640 1 -- 172.21.15.5:0/3278639363 shutdown_connections 2024-08-18T22:33:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe672400640 1 --2- 172.21.15.5:0/3278639363 >> v2:172.21.15.117:3300/0 conn(0x7fe66c072a30 0x7fe66c072ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe672400640 1 --2- 172.21.15.5:0/3278639363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c0b40c0 0x7fe66c0b4500 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe672400640 1 --2- 172.21.15.5:0/3278639363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66c15b0c0 0x7fe66c06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe672400640 1 -- 172.21.15.5:0/3278639363 >> 172.21.15.5:0/3278639363 conn(0x7fe66c0b1dc0 msgr2=0x7fe66c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe672400640 1 -- 172.21.15.5:0/3278639363 shutdown_connections 2024-08-18T22:33:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.330+0000 7fe672400640 1 -- 172.21.15.5:0/3278639363 wait complete. 2024-08-18T22:33:18.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe672400640 1 Processor -- start 2024-08-18T22:33:18.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe672400640 1 -- start start 2024-08-18T22:33:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe672400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c072a30 0x7fe66c15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe672400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe66c0b40c0 0x7fe66c15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe672400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66c15b0c0 0x7fe66c15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe672400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c15b620 con 0x7fe66c072a30 2024-08-18T22:33:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe672400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c15b4a0 con 0x7fe66c0b40c0 2024-08-18T22:33:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe672400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe66c0737f0 con 0x7fe66c15b0c0 2024-08-18T22:33:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe66b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c072a30 0x7fe66c15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe66b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c072a30 0x7fe66c15e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51866/0 (socket says 172.21.15.5:51866) 2024-08-18T22:33:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe66b400640 1 -- 172.21.15.5:0/1470769207 learned_addr learned my addr 172.21.15.5:0/1470769207 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe66be00640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66c15b0c0 0x7fe66c15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe66aa00640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe66c0b40c0 0x7fe66c15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe66b400640 1 -- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66c15b0c0 msgr2=0x7fe66c15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe66b400640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66c15b0c0 0x7fe66c15d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe66b400640 1 -- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe66c0b40c0 msgr2=0x7fe66c15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe66b400640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe66c0b40c0 0x7fe66c15b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe66b400640 1 -- 172.21.15.5:0/1470769207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c1fae20 con 0x7fe66c072a30 2024-08-18T22:33:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe66b400640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c072a30 0x7fe66c15e2d0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00d5f0 tx=0x7fe65c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe663400640 1 -- 172.21.15.5:0/1470769207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0125f0 con 0x7fe66c072a30 2024-08-18T22:33:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe663400640 1 -- 172.21.15.5:0/1470769207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65c019070 con 0x7fe66c072a30 2024-08-18T22:33:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe663400640 1 -- 172.21.15.5:0/1470769207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0129b0 con 0x7fe66c072a30 2024-08-18T22:33:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe672400640 1 -- 172.21.15.5:0/1470769207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66c1fb100 con 0x7fe66c072a30 2024-08-18T22:33:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.334+0000 7fe672400640 1 -- 172.21.15.5:0/1470769207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66c1fb6c0 con 0x7fe66c072a30 2024-08-18T22:33:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.338+0000 7fe672400640 1 -- 172.21.15.5:0/1470769207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66c06f670 con 0x7fe66c072a30 2024-08-18T22:33:18.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.338+0000 7fe663400640 1 -- 172.21.15.5:0/1470769207 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe65c012b50 con 0x7fe66c072a30 2024-08-18T22:33:18.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.338+0000 7fe663400640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe64c0678c0 0x7fe64c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.338+0000 7fe663400640 1 -- 172.21.15.5:0/1470769207 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fe65c086110 con 0x7fe66c072a30 2024-08-18T22:33:18.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.338+0000 7fe66aa00640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe64c0678c0 0x7fe64c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.338+0000 7fe66aa00640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe64c0678c0 0x7fe64c069d80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe6580af000 tx=0x7fe658009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:18.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.342+0000 7fe663400640 1 -- 172.21.15.5:0/1470769207 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe65c056410 con 0x7fe66c072a30 2024-08-18T22:33:18.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 -- 172.21.15.5:0/1470769207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe66c1f74f0 con 0x7fe66c072a30 2024-08-18T22:33:18.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe663400640 1 -- 172.21.15.5:0/1470769207 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v193) ==== 80+0+0 (secure 0 0 0) 0x7fe66c1f74f0 con 0x7fe66c072a30 2024-08-18T22:33:18.522 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 -- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe64c0678c0 msgr2=0x7fe64c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe64c0678c0 0x7fe64c069d80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe6580af000 tx=0x7fe658009040 comp rx=0 tx=0).stop 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 -- 172.21.15.5:0/1470769207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c072a30 msgr2=0x7fe66c15e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c072a30 0x7fe66c15e2d0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00d5f0 tx=0x7fe65c00dab0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 -- 172.21.15.5:0/1470769207 shutdown_connections 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe64c0678c0 0x7fe64c069d80 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66c15b0c0 0x7fe66c15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe66c0b40c0 0x7fe66c15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 --2- 172.21.15.5:0/1470769207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe66c072a30 0x7fe66c15e2d0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 -- 172.21.15.5:0/1470769207 >> 172.21.15.5:0/1470769207 conn(0x7fe66c0b1dc0 msgr2=0x7fe66c15a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 -- 172.21.15.5:0/1470769207 shutdown_connections 2024-08-18T22:33:18.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.526+0000 7fe672400640 1 -- 172.21.15.5:0/1470769207 wait complete. 2024-08-18T22:33:18.545 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:33:18.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:18.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:33:18.572 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:33:18.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:18.572 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:33:18.625 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:33:18.626 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:33:18.626 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:33:18.635 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:33:18.635 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:33:18.635 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:33:18.635 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:33:18.677 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:33:18.677 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:33:18.677 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:33:18.677 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:33:18.686 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:33:18.686 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:33:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.862+0000 7f738c000640 1 Processor -- start 2024-08-18T22:33:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.862+0000 7f738c000640 1 -- start start 2024-08-18T22:33:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f738c000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f738415b010 0x7f73840ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f738c000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73840cd3a0 0x7f738406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f738c000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f738406f0c0 0x7f73840caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f738c000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f73840cfa30 con 0x7f738415b010 2024-08-18T22:33:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f738c000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f73840cee20 con 0x7f738406f0c0 2024-08-18T22:33:18.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f738c000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f73840cf100 con 0x7f73840cd3a0 2024-08-18T22:33:18.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f7389600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f738415b010 0x7f73840ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f7389600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f738415b010 0x7f73840ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51874/0 (socket says 172.21.15.5:51874) 2024-08-18T22:33:18.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f7389600640 1 -- 172.21.15.5:0/1545081691 learned_addr learned my addr 172.21.15.5:0/1545081691 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:18.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f7388c00640 1 --2- 172.21.15.5:0/1545081691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73840cd3a0 0x7f738406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f738a000640 1 --2- 172.21.15.5:0/1545081691 >> v2:172.21.15.117:3300/0 conn(0x7f738406f0c0 0x7f73840caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f7389600640 1 -- 172.21.15.5:0/1545081691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73840cd3a0 msgr2=0x7f738406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:18.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f7389600640 1 --2- 172.21.15.5:0/1545081691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73840cd3a0 0x7f738406eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f7389600640 1 -- 172.21.15.5:0/1545081691 >> v2:172.21.15.117:3300/0 conn(0x7f738406f0c0 msgr2=0x7f73840caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:18.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f7389600640 1 --2- 172.21.15.5:0/1545081691 >> v2:172.21.15.117:3300/0 conn(0x7f738406f0c0 0x7f73840caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f7389600640 1 -- 172.21.15.5:0/1545081691 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73840cf3e0 con 0x7f738415b010 2024-08-18T22:33:18.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f738a000640 1 --2- 172.21.15.5:0/1545081691 >> v2:172.21.15.117:3300/0 conn(0x7f738406f0c0 0x7f73840caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:18.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f7388c00640 1 --2- 172.21.15.5:0/1545081691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73840cd3a0 0x7f738406eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:18.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.866+0000 7f7389600640 1 --2- 172.21.15.5:0/1545081691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738415b010 0x7f73840ce840 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f738406ffa0 tx=0x7f737801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20ea48b96724a5e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f7383e00640 1 -- 172.21.15.5:0/1545081691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73780b0070 con 0x7f738415b010 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f7383e00640 1 -- 172.21.15.5:0/1545081691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73780ab600 con 0x7f738415b010 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f7383e00640 1 -- 172.21.15.5:0/1545081691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73780ab9d0 con 0x7f738415b010 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 -- 172.21.15.5:0/1545081691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738415b010 msgr2=0x7f73840ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 --2- 172.21.15.5:0/1545081691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738415b010 0x7f73840ce840 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f738406ffa0 tx=0x7f737801c260 comp rx=0 tx=0).stop 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 -- 172.21.15.5:0/1545081691 shutdown_connections 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 --2- 172.21.15.5:0/1545081691 >> v2:172.21.15.117:3300/0 conn(0x7f738406f0c0 0x7f73840caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 --2- 172.21.15.5:0/1545081691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73840cd3a0 0x7f738406eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 --2- 172.21.15.5:0/1545081691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738415b010 0x7f73840ce840 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 -- 172.21.15.5:0/1545081691 >> 172.21.15.5:0/1545081691 conn(0x7f73840b1c50 msgr2=0x7f73840b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 -- 172.21.15.5:0/1545081691 shutdown_connections 2024-08-18T22:33:18.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 -- 172.21.15.5:0/1545081691 wait complete. 2024-08-18T22:33:18.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 Processor -- start 2024-08-18T22:33:18.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 -- start start 2024-08-18T22:33:18.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738406f0c0 0x7f738415e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73840cd3a0 0x7f738414bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f738415b010 0x7f738415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f738406dbf0 con 0x7f73840cd3a0 2024-08-18T22:33:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f738406da70 con 0x7f738406f0c0 2024-08-18T22:33:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738c000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f738406dd70 con 0x7f738415b010 2024-08-18T22:33:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f7388c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73840cd3a0 0x7f738414bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f7388c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73840cd3a0 0x7f738414bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51888/0 (socket says 172.21.15.5:51888) 2024-08-18T22:33:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f7388c00640 1 -- 172.21.15.5:0/1637500335 learned_addr learned my addr 172.21.15.5:0/1637500335 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f738a000640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f738415b010 0x7f738415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.870+0000 7f7389600640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738406f0c0 0x7f738415e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7388c00640 1 -- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f738415b010 msgr2=0x7f738415b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7388c00640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f738415b010 0x7f738415b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7388c00640 1 -- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738406f0c0 msgr2=0x7f738415e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:18.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7388c00640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738406f0c0 0x7f738415e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:18.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7388c00640 1 -- 172.21.15.5:0/1637500335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73840af0b0 con 0x7f73840cd3a0 2024-08-18T22:33:18.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f738a000640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f738415b010 0x7f738415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:18.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7389600640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738406f0c0 0x7f738415e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:18.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7388c00640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73840cd3a0 0x7f738414bdf0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f737000c820 tx=0x7f737000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:18.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7381600640 1 -- 172.21.15.5:0/1637500335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370015070 con 0x7f73840cd3a0 2024-08-18T22:33:18.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7381600640 1 -- 172.21.15.5:0/1637500335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7370007a30 con 0x7f73840cd3a0 2024-08-18T22:33:18.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f738c000640 1 -- 172.21.15.5:0/1637500335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7384151b60 con 0x7f73840cd3a0 2024-08-18T22:33:18.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7381600640 1 -- 172.21.15.5:0/1637500335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370007e20 con 0x7f73840cd3a0 2024-08-18T22:33:18.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f738c000640 1 -- 172.21.15.5:0/1637500335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73840af940 con 0x7f73840cd3a0 2024-08-18T22:33:18.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f738c000640 1 -- 172.21.15.5:0/1637500335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73840caf40 con 0x7f73840cd3a0 2024-08-18T22:33:18.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7381600640 1 -- 172.21.15.5:0/1637500335 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7370018070 con 0x7f73840cd3a0 2024-08-18T22:33:18.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7381600640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73640678c0 0x7f7364069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:18.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.874+0000 7f7381600640 1 -- 172.21.15.5:0/1637500335 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f73700859d0 con 0x7f73840cd3a0 2024-08-18T22:33:18.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.878+0000 7f7389600640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73640678c0 0x7f7364069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:18.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.878+0000 7f7389600640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73640678c0 0x7f7364069d80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f73780ad000 tx=0x7f73780a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:18.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:18.878+0000 7f7381600640 1 -- 172.21.15.5:0/1637500335 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7370056320 con 0x7f73840cd3a0 2024-08-18T22:33:19.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.078+0000 7f738c000640 1 -- 172.21.15.5:0/1637500335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73840d0920 con 0x7f73840cd3a0 2024-08-18T22:33:19.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.078+0000 7f7381600640 1 -- 172.21.15.5:0/1637500335 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) ==== 95+0+5229 (secure 0 0 0) 0x7f7370055c20 con 0x7f73840cd3a0 2024-08-18T22:33:19.076 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:19.076 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":151,"btime":"2024-08-18T22:32:37:342248+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/983387831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":983387831},{"type":"v1","addr":"172.21.15.5:6833","nonce":983387831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2495123422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2495123422},{"type":"v1","addr":"172.21.15.117:6836","nonce":2495123422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/53072457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":53072457},{"type":"v1","addr":"172.21.15.117:6837","nonce":53072457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:32:33.724910+0000","modified":"2024-08-18T22:32:36.736018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10350":{"gid":10350,"name":"a","rank":0,"incarnation":147,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/114900580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":114900580},{"type":"v1","addr":"172.21.15.5:6835","nonce":114900580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10350,"qdb_cluster":[10350]},"id":13}]} 2024-08-18T22:33:19.076 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 151 2024-08-18T22:33:19.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 -- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73640678c0 msgr2=0x7f7364069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73640678c0 0x7f7364069d80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f73780ad000 tx=0x7f73780a6000 comp rx=0 tx=0).stop 2024-08-18T22:33:19.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 -- 172.21.15.5:0/1637500335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73840cd3a0 msgr2=0x7f738414bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73840cd3a0 0x7f738414bdf0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f737000c820 tx=0x7f737000cce0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 -- 172.21.15.5:0/1637500335 shutdown_connections 2024-08-18T22:33:19.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f73640678c0 0x7f7364069d80 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f738415b010 0x7f738415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73840cd3a0 0x7f738414bdf0 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 --2- 172.21.15.5:0/1637500335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f738406f0c0 0x7f738415e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 -- 172.21.15.5:0/1637500335 >> 172.21.15.5:0/1637500335 conn(0x7f73840b1c50 msgr2=0x7f73840b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:19.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 -- 172.21.15.5:0/1637500335 shutdown_connections 2024-08-18T22:33:19.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.082+0000 7f738c000640 1 -- 172.21.15.5:0/1637500335 wait complete. 2024-08-18T22:33:19.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:33:19.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1edd000640 1 Processor -- start 2024-08-18T22:33:19.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1edd000640 1 -- start start 2024-08-18T22:33:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1edd000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ed8161960 0x7f1ed806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1edd000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ed8070730 0x7f1ed8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1edd000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed815eb60 con 0x7f1ed815dda0 2024-08-18T22:33:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1edd000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed815fcc0 con 0x7f1ed8161960 2024-08-18T22:33:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1edd000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed80710b0 con 0x7f1ed8070730 2024-08-18T22:33:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1ed5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ed8161960 0x7f1ed806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1ed5e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ed8161960 0x7f1ed806fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51896/0 (socket says 172.21.15.5:51896) 2024-08-18T22:33:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1ed5e00640 1 -- 172.21.15.5:0/2971176858 learned_addr learned my addr 172.21.15.5:0/2971176858 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1ecd400640 1 --2- 172.21.15.5:0/2971176858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ed8070730 0x7f1ed8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1ed5e00640 1 -- 172.21.15.5:0/2971176858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ed8070730 msgr2=0x7f1ed8070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1ed5e00640 1 --2- 172.21.15.5:0/2971176858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ed8070730 0x7f1ed8070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1ed5e00640 1 -- 172.21.15.5:0/2971176858 >> v1:172.21.15.117:6789/0 conn(0x7f1ed815dda0 legacy=0x7f1ed815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:19.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.242+0000 7f1ed5e00640 1 -- 172.21.15.5:0/2971176858 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed815ee40 con 0x7f1ed8161960 2024-08-18T22:33:19.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1ed5e00640 1 --2- 172.21.15.5:0/2971176858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8161960 0x7f1ed806fd20 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009870 tx=0x7f1ec801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f242281f61ab823d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1ed5400640 1 -- 172.21.15.5:0/2971176858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80b0070 con 0x7f1ed8161960 2024-08-18T22:33:19.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1ed5400640 1 -- 172.21.15.5:0/2971176858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec80ab600 con 0x7f1ed8161960 2024-08-18T22:33:19.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1ed5400640 1 -- 172.21.15.5:0/2971176858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80ab9d0 con 0x7f1ed8161960 2024-08-18T22:33:19.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1edd000640 1 -- 172.21.15.5:0/2971176858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8161960 msgr2=0x7f1ed806fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1edd000640 1 --2- 172.21.15.5:0/2971176858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8161960 0x7f1ed806fd20 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009870 tx=0x7f1ec801c520 comp rx=0 tx=0).stop 2024-08-18T22:33:19.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1edd000640 1 -- 172.21.15.5:0/2971176858 shutdown_connections 2024-08-18T22:33:19.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1edd000640 1 --2- 172.21.15.5:0/2971176858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ed8070730 0x7f1ed8070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1edd000640 1 --2- 172.21.15.5:0/2971176858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8161960 0x7f1ed806fd20 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1edd000640 1 -- 172.21.15.5:0/2971176858 >> 172.21.15.5:0/2971176858 conn(0x7f1ed80d2130 msgr2=0x7f1ed80d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:19.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1edd000640 1 -- 172.21.15.5:0/2971176858 shutdown_connections 2024-08-18T22:33:19.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.246+0000 7f1edd000640 1 -- 172.21.15.5:0/2971176858 wait complete. 2024-08-18T22:33:19.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1edd000640 1 Processor -- start 2024-08-18T22:33:19.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1edd000640 1 -- start start 2024-08-18T22:33:19.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1edd000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ed8070730 0x7f1ed80cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1edd000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ed815dda0 0x7f1ed8158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1edd000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8161960 0x7f1ed815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1edd000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed809ba30 con 0x7f1ed8161960 2024-08-18T22:33:19.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1edd000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8070260 con 0x7f1ed8070730 2024-08-18T22:33:19.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1edd000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed81fb1b0 con 0x7f1ed815dda0 2024-08-18T22:33:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ed6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8161960 0x7f1ed815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ed6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8161960 0x7f1ed815b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51906/0 (socket says 172.21.15.5:51906) 2024-08-18T22:33:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ed6800640 1 -- 172.21.15.5:0/3909924601 learned_addr learned my addr 172.21.15.5:0/3909924601 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ecd400640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ed815dda0 0x7f1ed8158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ed5e00640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ed8070730 0x7f1ed80cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ed6800640 1 -- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ed815dda0 msgr2=0x7f1ed8158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ed6800640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ed815dda0 0x7f1ed8158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ed6800640 1 -- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ed8070730 msgr2=0x7f1ed80cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ed6800640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ed8070730 0x7f1ed80cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ed6800640 1 -- 172.21.15.5:0/3909924601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed81fb490 con 0x7f1ed8161960 2024-08-18T22:33:19.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ed5e00640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ed8070730 0x7f1ed80cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:19.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ed6800640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8161960 0x7f1ed815b3d0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000b970 tx=0x7f1ed000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ecea00640 1 -- 172.21.15.5:0/3909924601 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0019070 con 0x7f1ed8161960 2024-08-18T22:33:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ecea00640 1 -- 172.21.15.5:0/3909924601 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed000cb40 con 0x7f1ed8161960 2024-08-18T22:33:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1ecea00640 1 -- 172.21.15.5:0/3909924601 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0014440 con 0x7f1ed8161960 2024-08-18T22:33:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1edd000640 1 -- 172.21.15.5:0/3909924601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed81fb770 con 0x7f1ed8161960 2024-08-18T22:33:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.250+0000 7f1edd000640 1 -- 172.21.15.5:0/3909924601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed80cf310 con 0x7f1ed8161960 2024-08-18T22:33:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.254+0000 7f1edd000640 1 -- 172.21.15.5:0/3909924601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed8070b70 con 0x7f1ed8161960 2024-08-18T22:33:19.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.254+0000 7f1ecea00640 1 -- 172.21.15.5:0/3909924601 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ed001c070 con 0x7f1ed8161960 2024-08-18T22:33:19.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.254+0000 7f1ecea00640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1eb40678c0 0x7f1eb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.254+0000 7f1ecea00640 1 -- 172.21.15.5:0/3909924601 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f1ed0085a70 con 0x7f1ed8161960 2024-08-18T22:33:19.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.254+0000 7f1ed5e00640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1eb40678c0 0x7f1eb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.254+0000 7f1ed5e00640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1eb40678c0 0x7f1eb4069d80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80ad000 tx=0x7f1ec80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.258+0000 7f1ecea00640 1 -- 172.21.15.5:0/3909924601 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1ed0055d70 con 0x7f1ed8161960 2024-08-18T22:33:19.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.458+0000 7f1edd000640 1 -- 172.21.15.5:0/3909924601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ed80d3010 con 0x7f1ed8161960 2024-08-18T22:33:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.458+0000 7f1ecea00640 1 -- 172.21.15.5:0/3909924601 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) ==== 95+0+5229 (secure 0 0 0) 0x7f1ed005a070 con 0x7f1ed8161960 2024-08-18T22:33:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:19.456 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":151,"btime":"2024-08-18T22:32:37:342248+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/983387831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":983387831},{"type":"v1","addr":"172.21.15.5:6833","nonce":983387831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2495123422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2495123422},{"type":"v1","addr":"172.21.15.117:6836","nonce":2495123422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/53072457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":53072457},{"type":"v1","addr":"172.21.15.117:6837","nonce":53072457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:32:33.724910+0000","modified":"2024-08-18T22:32:36.736018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10350":{"gid":10350,"name":"a","rank":0,"incarnation":147,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/114900580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":114900580},{"type":"v1","addr":"172.21.15.5:6835","nonce":114900580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10350,"qdb_cluster":[10350]},"id":13}]} 2024-08-18T22:33:19.457 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 151 2024-08-18T22:33:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 -- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1eb40678c0 msgr2=0x7f1eb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1eb40678c0 0x7f1eb4069d80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80ad000 tx=0x7f1ec80a6000 comp rx=0 tx=0).stop 2024-08-18T22:33:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 -- 172.21.15.5:0/3909924601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8161960 msgr2=0x7f1ed815b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8161960 0x7f1ed815b3d0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000b970 tx=0x7f1ed000be30 comp rx=0 tx=0).stop 2024-08-18T22:33:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 -- 172.21.15.5:0/3909924601 shutdown_connections 2024-08-18T22:33:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f1eb40678c0 0x7f1eb4069d80 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ed8161960 0x7f1ed815b3d0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ed815dda0 0x7f1ed8158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 --2- 172.21.15.5:0/3909924601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ed8070730 0x7f1ed80cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 -- 172.21.15.5:0/3909924601 >> 172.21.15.5:0/3909924601 conn(0x7f1ed80d2130 msgr2=0x7f1ed809ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 -- 172.21.15.5:0/3909924601 shutdown_connections 2024-08-18T22:33:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.462+0000 7f1edd000640 1 -- 172.21.15.5:0/3909924601 wait complete. 2024-08-18T22:33:19.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:33:19.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.622+0000 7f7006400640 1 Processor -- start 2024-08-18T22:33:19.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.622+0000 7f7006400640 1 -- start start 2024-08-18T22:33:19.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.622+0000 7f7006400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7000070730 0x7f7000070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.622+0000 7f7006400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f700015dda0 0x7f700015e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.622+0000 7f7006400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7000070430 con 0x7f7000161960 2024-08-18T22:33:19.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.622+0000 7f7006400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f70000710e0 con 0x7f7000070730 2024-08-18T22:33:19.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.622+0000 7f7006400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f700015fcc0 con 0x7f700015dda0 2024-08-18T22:33:19.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.622+0000 7f6ffea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7000070730 0x7f7000070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.622+0000 7f6ffea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7000070730 0x7f7000070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51916/0 (socket says 172.21.15.5:51916) 2024-08-18T22:33:19.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.622+0000 7f6ffea00640 1 -- 172.21.15.5:0/30769261 learned_addr learned my addr 172.21.15.5:0/30769261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:19.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.622+0000 7f6fffe00640 1 --2- 172.21.15.5:0/30769261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f700015dda0 0x7f700015e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f6ffea00640 1 -- 172.21.15.5:0/30769261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f700015dda0 msgr2=0x7f700015e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:19.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f6ffea00640 1 --2- 172.21.15.5:0/30769261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f700015dda0 0x7f700015e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f6ffea00640 1 -- 172.21.15.5:0/30769261 >> v1:172.21.15.117:6789/0 conn(0x7f7000161960 legacy=0x7f700006fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f6ffea00640 1 -- 172.21.15.5:0/30769261 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700015eb60 con 0x7f7000070730 2024-08-18T22:33:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f6ffea00640 1 --2- 172.21.15.5:0/30769261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7000070730 0x7f7000070ba0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009870 tx=0x7f6fec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee513e8e76bd3f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f6ffe000640 1 -- 172.21.15.5:0/30769261 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0b1070 con 0x7f7000070730 2024-08-18T22:33:19.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f6ffe000640 1 -- 172.21.15.5:0/30769261 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec0ac630 con 0x7f7000070730 2024-08-18T22:33:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f6ffe000640 1 -- 172.21.15.5:0/30769261 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0a8050 con 0x7f7000070730 2024-08-18T22:33:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f7006400640 1 -- 172.21.15.5:0/30769261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7000070730 msgr2=0x7f7000070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f7006400640 1 --2- 172.21.15.5:0/30769261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7000070730 0x7f7000070ba0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009870 tx=0x7f6fec01c520 comp rx=0 tx=0).stop 2024-08-18T22:33:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f7006400640 1 -- 172.21.15.5:0/30769261 shutdown_connections 2024-08-18T22:33:19.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f7006400640 1 --2- 172.21.15.5:0/30769261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f700015dda0 0x7f700015e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f7006400640 1 --2- 172.21.15.5:0/30769261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7000070730 0x7f7000070ba0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f7006400640 1 -- 172.21.15.5:0/30769261 >> 172.21.15.5:0/30769261 conn(0x7f70000d2130 msgr2=0x7f70000d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.626+0000 7f7006400640 1 -- 172.21.15.5:0/30769261 shutdown_connections 2024-08-18T22:33:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f7006400640 1 -- 172.21.15.5:0/30769261 wait complete. 2024-08-18T22:33:19.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f7006400640 1 Processor -- start 2024-08-18T22:33:19.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f7006400640 1 -- start start 2024-08-18T22:33:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f7006400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7000070730 0x7f70000b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f7006400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f700015dda0 0x7f70000aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f7006400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000161960 0x7f7000156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f7006400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f700009ba30 con 0x7f7000070730 2024-08-18T22:33:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f7006400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f700015f6e0 con 0x7f7000161960 2024-08-18T22:33:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f7006400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f70000b1230 con 0x7f700015dda0 2024-08-18T22:33:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6fff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7000070730 0x7f70000b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6fff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7000070730 0x7f70000b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51928/0 (socket says 172.21.15.5:51928) 2024-08-18T22:33:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6fff400640 1 -- 172.21.15.5:0/1322855833 learned_addr learned my addr 172.21.15.5:0/1322855833 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6ffea00640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f700015dda0 0x7f70000aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6fffe00640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000161960 0x7f7000156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6fff400640 1 -- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f700015dda0 msgr2=0x7f70000aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6fff400640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f700015dda0 0x7f70000aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6fff400640 1 -- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000161960 msgr2=0x7f7000156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6fff400640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000161960 0x7f7000156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6fff400640 1 -- 172.21.15.5:0/1322855833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70000b7dd0 con 0x7f7000070730 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6fffe00640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000161960 0x7f7000156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6fff400640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7000070730 0x7f70000b5220 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000c480 tx=0x7f6ff000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6ff7400640 1 -- 172.21.15.5:0/1322855833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0016020 con 0x7f7000070730 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6ff7400640 1 -- 172.21.15.5:0/1322855833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff0012830 con 0x7f7000070730 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f7006400640 1 -- 172.21.15.5:0/1322855833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70000c95d0 con 0x7f7000070730 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f6ff7400640 1 -- 172.21.15.5:0/1322855833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0012c20 con 0x7f7000070730 2024-08-18T22:33:19.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.630+0000 7f7006400640 1 -- 172.21.15.5:0/1322855833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70000c9b90 con 0x7f7000070730 2024-08-18T22:33:19.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.634+0000 7f7006400640 1 -- 172.21.15.5:0/1322855833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7000070ba0 con 0x7f7000070730 2024-08-18T22:33:19.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.634+0000 7f6ff7400640 1 -- 172.21.15.5:0/1322855833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6ff0019020 con 0x7f7000070730 2024-08-18T22:33:19.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.634+0000 7f6ff7400640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fe00678c0 0x7f6fe0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.634+0000 7f6ff7400640 1 -- 172.21.15.5:0/1322855833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f6ff0085890 con 0x7f7000070730 2024-08-18T22:33:19.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.634+0000 7f6ffea00640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fe00678c0 0x7f6fe0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.634+0000 7f6ffea00640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fe00678c0 0x7f6fe0069d80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0ae000 tx=0x7f6fec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.638+0000 7f6ff7400640 1 -- 172.21.15.5:0/1322855833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6ff0020070 con 0x7f7000070730 2024-08-18T22:33:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.806+0000 7f7006400640 1 -- 172.21.15.5:0/1322855833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70000d3010 con 0x7f7000070730 2024-08-18T22:33:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.806+0000 7f6ff7400640 1 -- 172.21.15.5:0/1322855833 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) ==== 74+0+16965 (secure 0 0 0) 0x7f6ff00561e0 con 0x7f7000070730 2024-08-18T22:33:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:19.804 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":193,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:33:06.433247+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:32:31.454782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-08-18T22:32:32.720083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.1","mappings":[{"from":6,"to":4}]},{"pgid":"28.2f","mappings":[{"from":6,"to":1}]},{"pgid":"28.36","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:33:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 -- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fe00678c0 msgr2=0x7f6fe0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fe00678c0 0x7f6fe0069d80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0ae000 tx=0x7f6fec008040 comp rx=0 tx=0).stop 2024-08-18T22:33:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 -- 172.21.15.5:0/1322855833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7000070730 msgr2=0x7f70000b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7000070730 0x7f70000b5220 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000c480 tx=0x7f6ff000c940 comp rx=0 tx=0).stop 2024-08-18T22:33:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 -- 172.21.15.5:0/1322855833 shutdown_connections 2024-08-18T22:33:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6fe00678c0 0x7f6fe0069d80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7000161960 0x7f7000156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f700015dda0 0x7f70000aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 --2- 172.21.15.5:0/1322855833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7000070730 0x7f70000b5220 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 -- 172.21.15.5:0/1322855833 >> 172.21.15.5:0/1322855833 conn(0x7f70000d2130 msgr2=0x7f700015d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 -- 172.21.15.5:0/1322855833 shutdown_connections 2024-08-18T22:33:19.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.810+0000 7f7006400640 1 -- 172.21.15.5:0/1322855833 wait complete. 2024-08-18T22:33:19.826 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:33:19.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:33:19.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c8400640 1 Processor -- start 2024-08-18T22:33:19.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c8400640 1 -- start start 2024-08-18T22:33:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c8400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0c00b54c0 0x7fa0c0071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c8400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c0071c80 con 0x7fa0c006dd80 2024-08-18T22:33:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c8400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c0071f60 con 0x7fa0c00cbed0 2024-08-18T22:33:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c8400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa0c00cba40 con 0x7fa0c00b54c0 2024-08-18T22:33:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c5000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa0c006dd80 0x7fa0c00b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45824/0 (socket says 172.21.15.5:45824) 2024-08-18T22:33:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c5000640 1 -- 172.21.15.5:0/2239782671 learned_addr learned my addr 172.21.15.5:0/2239782671 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c5a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0c00b54c0 0x7fa0c0071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c5a00640 1 -- 172.21.15.5:0/2239782671 >> v1:172.21.15.117:6789/0 conn(0x7fa0c00cbed0 legacy=0x7fa0c00cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c5a00640 1 -- 172.21.15.5:0/2239782671 >> v1:172.21.15.5:6789/0 conn(0x7fa0c006dd80 legacy=0x7fa0c00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.970+0000 7fa0c5a00640 1 -- 172.21.15.5:0/2239782671 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c00cb6d0 con 0x7fa0c00b54c0 2024-08-18T22:33:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.974+0000 7fa0c5a00640 1 --2- 172.21.15.5:0/2239782671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0c00b54c0 0x7fa0c0071580 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40097c0 tx=0x7fa0b401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2d98ebf86fabe9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.974+0000 7fa0bfe00640 1 -- 172.21.15.5:0/2239782671 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40b5070 con 0x7fa0c00b54c0 2024-08-18T22:33:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.974+0000 7fa0bfe00640 1 -- 172.21.15.5:0/2239782671 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b40a8950 con 0x7fa0c00b54c0 2024-08-18T22:33:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.974+0000 7fa0bfe00640 1 -- 172.21.15.5:0/2239782671 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40a8d20 con 0x7fa0c00b54c0 2024-08-18T22:33:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.974+0000 7fa0c8400640 1 -- 172.21.15.5:0/2239782671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0c00b54c0 msgr2=0x7fa0c0071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.974+0000 7fa0c8400640 1 --2- 172.21.15.5:0/2239782671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0c00b54c0 0x7fa0c0071580 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40097c0 tx=0x7fa0b401ec50 comp rx=0 tx=0).stop 2024-08-18T22:33:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.974+0000 7fa0c8400640 1 -- 172.21.15.5:0/2239782671 shutdown_connections 2024-08-18T22:33:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.974+0000 7fa0c8400640 1 --2- 172.21.15.5:0/2239782671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0c00b54c0 0x7fa0c0071580 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.974+0000 7fa0c8400640 1 -- 172.21.15.5:0/2239782671 >> 172.21.15.5:0/2239782671 conn(0x7fa0c00b3eb0 msgr2=0x7fa0c00b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.974+0000 7fa0c8400640 1 -- 172.21.15.5:0/2239782671 shutdown_connections 2024-08-18T22:33:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.974+0000 7fa0c8400640 1 -- 172.21.15.5:0/2239782671 wait complete. 2024-08-18T22:33:19.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c8400640 1 Processor -- start 2024-08-18T22:33:19.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c8400640 1 -- start start 2024-08-18T22:33:19.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c8400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c006dd80 0x7fa0c00d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c8400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0c00b54c0 0x7fa0c00d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c8400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0c00cbed0 0x7fa0c01f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c8400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01481a0 con 0x7fa0c00cbed0 2024-08-18T22:33:19.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c8400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c0148020 con 0x7fa0c00b54c0 2024-08-18T22:33:19.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c8400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c00cca70 con 0x7fa0c006dd80 2024-08-18T22:33:19.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c6400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0c00cbed0 0x7fa0c01f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c6400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0c00cbed0 0x7fa0c01f3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51940/0 (socket says 172.21.15.5:51940) 2024-08-18T22:33:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c6400640 1 -- 172.21.15.5:0/502887356 learned_addr learned my addr 172.21.15.5:0/502887356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c5000640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0c00b54c0 0x7fa0c00d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c5a00640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c006dd80 0x7fa0c00d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c6400640 1 -- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c006dd80 msgr2=0x7fa0c00d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c6400640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c006dd80 0x7fa0c00d05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c6400640 1 -- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0c00b54c0 msgr2=0x7fa0c00d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c6400640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0c00b54c0 0x7fa0c00d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c6400640 1 -- 172.21.15.5:0/502887356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c01f4a80 con 0x7fa0c00cbed0 2024-08-18T22:33:19.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c6400640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0c00cbed0 0x7fa0c01f3c10 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800b970 tx=0x7fa0b800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0bd600640 1 -- 172.21.15.5:0/502887356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8019070 con 0x7fa0c00cbed0 2024-08-18T22:33:19.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0bd600640 1 -- 172.21.15.5:0/502887356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b800cae0 con 0x7fa0c00cbed0 2024-08-18T22:33:19.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c8400640 1 -- 172.21.15.5:0/502887356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c01f4d60 con 0x7fa0c00cbed0 2024-08-18T22:33:19.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0bd600640 1 -- 172.21.15.5:0/502887356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8014440 con 0x7fa0c00cbed0 2024-08-18T22:33:19.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.978+0000 7fa0c8400640 1 -- 172.21.15.5:0/502887356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c00ce990 con 0x7fa0c00cbed0 2024-08-18T22:33:19.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.982+0000 7fa0c8400640 1 -- 172.21.15.5:0/502887356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c00cce90 con 0x7fa0c00cbed0 2024-08-18T22:33:19.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.982+0000 7fa0bd600640 1 -- 172.21.15.5:0/502887356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0b801c070 con 0x7fa0c00cbed0 2024-08-18T22:33:19.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.982+0000 7fa0bd600640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0a00678c0 0x7fa0a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.982+0000 7fa0bd600640 1 -- 172.21.15.5:0/502887356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fa0b8085a50 con 0x7fa0c00cbed0 2024-08-18T22:33:19.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.982+0000 7fa0c5a00640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0a00678c0 0x7fa0a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.982+0000 7fa0c5a00640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0a00678c0 0x7fa0a0069d80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40b2000 tx=0x7fa0b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:19.986+0000 7fa0bd600640 1 -- 172.21.15.5:0/502887356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa0b8055cc0 con 0x7fa0c00cbed0 2024-08-18T22:33:20.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 -- 172.21.15.5:0/502887356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0c015e510 con 0x7fa0c00cbed0 2024-08-18T22:33:20.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0bd600640 1 -- 172.21.15.5:0/502887356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) ==== 95+0+5229 (secure 0 0 0) 0x7fa0b8059fc0 con 0x7fa0c00cbed0 2024-08-18T22:33:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:20.183 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":151,"btime":"2024-08-18T22:32:37:342248+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/983387831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":983387831},{"type":"v1","addr":"172.21.15.5:6833","nonce":983387831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2495123422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2495123422},{"type":"v1","addr":"172.21.15.117:6836","nonce":2495123422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/53072457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":53072457},{"type":"v1","addr":"172.21.15.117:6837","nonce":53072457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:32:33.724910+0000","modified":"2024-08-18T22:32:36.736018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10350":{"gid":10350,"name":"a","rank":0,"incarnation":147,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/114900580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":114900580},{"type":"v1","addr":"172.21.15.5:6835","nonce":114900580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10350,"qdb_cluster":[10350]},"id":13}]} 2024-08-18T22:33:20.183 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 151 2024-08-18T22:33:20.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 -- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0a00678c0 msgr2=0x7fa0a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0a00678c0 0x7fa0a0069d80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40b2000 tx=0x7fa0b4008040 comp rx=0 tx=0).stop 2024-08-18T22:33:20.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 -- 172.21.15.5:0/502887356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0c00cbed0 msgr2=0x7fa0c01f3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0c00cbed0 0x7fa0c01f3c10 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800b970 tx=0x7fa0b800be30 comp rx=0 tx=0).stop 2024-08-18T22:33:20.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 -- 172.21.15.5:0/502887356 shutdown_connections 2024-08-18T22:33:20.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa0a00678c0 0x7fa0a0069d80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0c00cbed0 0x7fa0c01f3c10 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0c00b54c0 0x7fa0c00d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 --2- 172.21.15.5:0/502887356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0c006dd80 0x7fa0c00d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 -- 172.21.15.5:0/502887356 >> 172.21.15.5:0/502887356 conn(0x7fa0c00b3eb0 msgr2=0x7fa0c00b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:20.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 -- 172.21.15.5:0/502887356 shutdown_connections 2024-08-18T22:33:20.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.186+0000 7fa0c8400640 1 -- 172.21.15.5:0/502887356 wait complete. 2024-08-18T22:33:20.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:33:20.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.350+0000 7fc306000640 1 Processor -- start 2024-08-18T22:33:20.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.350+0000 7fc306000640 1 -- start start 2024-08-18T22:33:20.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc306000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3000b4e40 0x7fc3000b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc306000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3000b65d0 con 0x7fc3000afe50 2024-08-18T22:33:20.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc306000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3000b68b0 con 0x7fc30015e140 2024-08-18T22:33:20.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc306000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc3000b52a0 con 0x7fc3000b4e40 2024-08-18T22:33:20.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc2fea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3000afe50 0x7fc30006efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45828/0 (socket says 172.21.15.5:45828) 2024-08-18T22:33:20.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc2fea00640 1 -- 172.21.15.5:0/1932973060 learned_addr learned my addr 172.21.15.5:0/1932973060 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:20.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc2ffe00640 1 --2- 172.21.15.5:0/1932973060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3000b4e40 0x7fc3000b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc2fe000640 1 -- 172.21.15.5:0/1932973060 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96799463 0 0) 0x7fc3000b65d0 con 0x7fc3000afe50 2024-08-18T22:33:20.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc2fe000640 1 -- 172.21.15.5:0/1932973060 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2e4003530 con 0x7fc3000afe50 2024-08-18T22:33:20.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc2ffe00640 1 -- 172.21.15.5:0/1932973060 >> v1:172.21.15.117:6789/0 conn(0x7fc30015e140 legacy=0x7fc3000af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc2fe000640 1 -- 172.21.15.5:0/1932973060 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3194201984 0 0) 0x7fc2e4003530 con 0x7fc3000afe50 2024-08-18T22:33:20.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc2ffe00640 1 -- 172.21.15.5:0/1932973060 >> v1:172.21.15.5:6789/0 conn(0x7fc3000afe50 legacy=0x7fc30006efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.354+0000 7fc2ffe00640 1 -- 172.21.15.5:0/1932973060 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30006e7b0 con 0x7fc3000b4e40 2024-08-18T22:33:20.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc2ffe00640 1 --2- 172.21.15.5:0/1932973060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3000b4e40 0x7fc3000b5e60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009dc0 tx=0x7fc2f801c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57d7d2ba5539ba1d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:20.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc2fe000640 1 -- 172.21.15.5:0/1932973060 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80ac070 con 0x7fc3000b4e40 2024-08-18T22:33:20.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc2fe000640 1 -- 172.21.15.5:0/1932973060 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f80a6430 con 0x7fc3000b4e40 2024-08-18T22:33:20.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc2fe000640 1 -- 172.21.15.5:0/1932973060 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec001680 con 0x7fc3000b4e40 2024-08-18T22:33:20.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 -- 172.21.15.5:0/1932973060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3000b4e40 msgr2=0x7fc3000b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 --2- 172.21.15.5:0/1932973060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3000b4e40 0x7fc3000b5e60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009dc0 tx=0x7fc2f801c6d0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 -- 172.21.15.5:0/1932973060 shutdown_connections 2024-08-18T22:33:20.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 --2- 172.21.15.5:0/1932973060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3000b4e40 0x7fc3000b5e60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 -- 172.21.15.5:0/1932973060 >> 172.21.15.5:0/1932973060 conn(0x7fc30006b9b0 msgr2=0x7fc30006bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:20.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 -- 172.21.15.5:0/1932973060 shutdown_connections 2024-08-18T22:33:20.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 -- 172.21.15.5:0/1932973060 wait complete. 2024-08-18T22:33:20.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 Processor -- start 2024-08-18T22:33:20.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 -- start start 2024-08-18T22:33:20.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3000afe50 0x7fc3001608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3000b4e40 0x7fc3000ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc30015e140 0x7fc3000ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc30006e560 con 0x7fc30015e140 2024-08-18T22:33:20.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc300070160 con 0x7fc3000afe50 2024-08-18T22:33:20.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.358+0000 7fc306000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc30016bd70 con 0x7fc3000b4e40 2024-08-18T22:33:20.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc30015e140 0x7fc3000ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2ffe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc30015e140 0x7fc3000ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51956/0 (socket says 172.21.15.5:51956) 2024-08-18T22:33:20.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2ffe00640 1 -- 172.21.15.5:0/2758246585 learned_addr learned my addr 172.21.15.5:0/2758246585 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:20.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2fea00640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3000b4e40 0x7fc3000ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2ff400640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3000afe50 0x7fc3001608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2ffe00640 1 -- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3000b4e40 msgr2=0x7fc3000ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2ffe00640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3000b4e40 0x7fc3000ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2ffe00640 1 -- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3000afe50 msgr2=0x7fc3001608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2ffe00640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3000afe50 0x7fc3001608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2ffe00640 1 -- 172.21.15.5:0/2758246585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3000cd0c0 con 0x7fc30015e140 2024-08-18T22:33:20.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2ffe00640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc30015e140 0x7fc3000ce5b0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80981c0 tx=0x7fc2f8019470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2f7400640 1 -- 172.21.15.5:0/2758246585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80ac070 con 0x7fc30015e140 2024-08-18T22:33:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2f7400640 1 -- 172.21.15.5:0/2758246585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f8003ba0 con 0x7fc30015e140 2024-08-18T22:33:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2f7400640 1 -- 172.21.15.5:0/2758246585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8009450 con 0x7fc30015e140 2024-08-18T22:33:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc306000640 1 -- 172.21.15.5:0/2758246585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3000cd510 con 0x7fc30015e140 2024-08-18T22:33:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc306000640 1 -- 172.21.15.5:0/2758246585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3000cdad0 con 0x7fc30015e140 2024-08-18T22:33:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc306000640 1 -- 172.21.15.5:0/2758246585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3001523e0 con 0x7fc30015e140 2024-08-18T22:33:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.362+0000 7fc2f7400640 1 -- 172.21.15.5:0/2758246585 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc2f80af070 con 0x7fc30015e140 2024-08-18T22:33:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.366+0000 7fc2f7400640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc2e00678c0 0x7fc2e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.366+0000 7fc2f7400640 1 -- 172.21.15.5:0/2758246585 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fc2f811ffc0 con 0x7fc30015e140 2024-08-18T22:33:20.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.366+0000 7fc2ff400640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc2e00678c0 0x7fc2e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.366+0000 7fc2ff400640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc2e00678c0 0x7fc2e0069d80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0000c10 tx=0x7fc2f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:20.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.370+0000 7fc2f7400640 1 -- 172.21.15.5:0/2758246585 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fc2f80c2070 con 0x7fc30015e140 2024-08-18T22:33:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 -- 172.21.15.5:0/2758246585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3000d06c0 con 0x7fc30015e140 2024-08-18T22:33:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc2f7400640 1 -- 172.21.15.5:0/2758246585 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) ==== 95+0+5229 (secure 0 0 0) 0x7fc2f80164a0 con 0x7fc30015e140 2024-08-18T22:33:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:20.571 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":151,"btime":"2024-08-18T22:32:37:342248+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/983387831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":983387831},{"type":"v1","addr":"172.21.15.5:6833","nonce":983387831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2495123422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2495123422},{"type":"v1","addr":"172.21.15.117:6836","nonce":2495123422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/53072457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":53072457},{"type":"v1","addr":"172.21.15.117:6837","nonce":53072457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:32:33.724910+0000","modified":"2024-08-18T22:32:36.736018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10350":{"gid":10350,"name":"a","rank":0,"incarnation":147,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/114900580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":114900580},{"type":"v1","addr":"172.21.15.5:6835","nonce":114900580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10350,"qdb_cluster":[10350]},"id":13}]} 2024-08-18T22:33:20.571 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 151 2024-08-18T22:33:20.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 -- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc2e00678c0 msgr2=0x7fc2e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc2e00678c0 0x7fc2e0069d80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0000c10 tx=0x7fc2f0009040 comp rx=0 tx=0).stop 2024-08-18T22:33:20.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 -- 172.21.15.5:0/2758246585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc30015e140 msgr2=0x7fc3000ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc30015e140 0x7fc3000ce5b0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80981c0 tx=0x7fc2f8019470 comp rx=0 tx=0).stop 2024-08-18T22:33:20.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 -- 172.21.15.5:0/2758246585 shutdown_connections 2024-08-18T22:33:20.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc2e00678c0 0x7fc2e0069d80 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc30015e140 0x7fc3000ce5b0 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3000b4e40 0x7fc3000ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 --2- 172.21.15.5:0/2758246585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3000afe50 0x7fc3001608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 -- 172.21.15.5:0/2758246585 >> 172.21.15.5:0/2758246585 conn(0x7fc30006b9b0 msgr2=0x7fc3000ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:20.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 -- 172.21.15.5:0/2758246585 shutdown_connections 2024-08-18T22:33:20.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.574+0000 7fc306000640 1 -- 172.21.15.5:0/2758246585 wait complete. 2024-08-18T22:33:20.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:33:20.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.734+0000 7f7f47c00640 1 Processor -- start 2024-08-18T22:33:20.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.734+0000 7f7f47c00640 1 -- start start 2024-08-18T22:33:20.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f47c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7f400b4e40 0x7f7f400b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f47c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f400b65d0 con 0x7f7f4015e140 2024-08-18T22:33:20.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f47c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f400b68b0 con 0x7f7f400afe50 2024-08-18T22:33:20.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f47c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7f400b52a0 con 0x7f7f400b4e40 2024-08-18T22:33:20.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f45200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7f4015e140 0x7f7f400af740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45834/0 (socket says 172.21.15.5:45834) 2024-08-18T22:33:20.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f45200640 1 -- 172.21.15.5:0/4004969482 learned_addr learned my addr 172.21.15.5:0/4004969482 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:20.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f45c00640 1 --2- 172.21.15.5:0/4004969482 >> v2:172.21.15.117:3300/0 conn(0x7f7f400b4e40 0x7f7f400b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752734778 0 0) 0x7f7f400b65d0 con 0x7f7f4015e140 2024-08-18T22:33:20.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f28003530 con 0x7f7f4015e140 2024-08-18T22:33:20.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2746120955 0 0) 0x7f7f400b68b0 con 0x7f7f400afe50 2024-08-18T22:33:20.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f400b65d0 con 0x7f7f400afe50 2024-08-18T22:33:20.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4204556333 0 0) 0x7f7f28003530 con 0x7f7f4015e140 2024-08-18T22:33:20.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 >> v2:172.21.15.117:3300/0 conn(0x7f7f400b4e40 msgr2=0x7f7f400b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:20.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 --2- 172.21.15.5:0/4004969482 >> v2:172.21.15.117:3300/0 conn(0x7f7f400b4e40 0x7f7f400b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 >> v1:172.21.15.117:6789/0 conn(0x7f7f400afe50 legacy=0x7f7f4006efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4006e7b0 con 0x7f7f4015e140 2024-08-18T22:33:20.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f7f34001600 con 0x7f7f4015e140 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 >> v1:172.21.15.5:6789/0 conn(0x7f7f4015e140 legacy=0x7f7f400af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f28003ba0 0x7f7f28003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f28004810 0x7f7f28004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f28005220 0x7f7f2800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7f400b52a0 con 0x7f7f28005220 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2800c150 con 0x7f7f28003ba0 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2800c350 con 0x7f7f28004810 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f45c00640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f28005220 0x7f7f2800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f45200640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f28003ba0 0x7f7f28003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3fe00640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f28004810 0x7f7f28004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f45c00640 1 -- 172.21.15.5:0/4004969482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f28004810 msgr2=0x7f7f28004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f45c00640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f28004810 0x7f7f28004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f45c00640 1 -- 172.21.15.5:0/4004969482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f28003ba0 msgr2=0x7f7f28003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:20.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f45c00640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f28003ba0 0x7f7f28003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f45c00640 1 -- 172.21.15.5:0/4004969482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f28003530 con 0x7f7f28005220 2024-08-18T22:33:20.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.738+0000 7f7f3fe00640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f28004810 0x7f7f28004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:20.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f45c00640 1 -- 172.21.15.5:0/4004969482 reap_dead start 2024-08-18T22:33:20.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f45c00640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f28005220 0x7f7f2800b9d0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009fc0 tx=0x7f7f3801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64894e6052cd771e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:20.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38009c10 con 0x7f7f28005220 2024-08-18T22:33:20.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f380a5d10 con 0x7f7f28005220 2024-08-18T22:33:20.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f3f400640 1 -- 172.21.15.5:0/4004969482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38003be0 con 0x7f7f28005220 2024-08-18T22:33:20.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f47c00640 1 -- 172.21.15.5:0/4004969482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f28005220 msgr2=0x7f7f2800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f47c00640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f28005220 0x7f7f2800b9d0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009fc0 tx=0x7f7f3801ccc0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f47c00640 1 -- 172.21.15.5:0/4004969482 shutdown_connections 2024-08-18T22:33:20.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f47c00640 1 --2- 172.21.15.5:0/4004969482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f28005220 0x7f7f2800b9d0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f47c00640 1 -- 172.21.15.5:0/4004969482 >> 172.21.15.5:0/4004969482 conn(0x7f7f4006b9b0 msgr2=0x7f7f4006bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:20.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f47c00640 1 -- 172.21.15.5:0/4004969482 shutdown_connections 2024-08-18T22:33:20.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f47c00640 1 -- 172.21.15.5:0/4004969482 wait complete. 2024-08-18T22:33:20.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f47c00640 1 Processor -- start 2024-08-18T22:33:20.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.742+0000 7f7f47c00640 1 -- start start 2024-08-18T22:33:20.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f47c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f28005220 0x7f7f4014ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f47c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f40160ef0 0x7f7f40161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f47c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f400ce2f0 0x7f7f400ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f47c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4015e520 con 0x7f7f40160ef0 2024-08-18T22:33:20.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f47c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4006e560 con 0x7f7f28005220 2024-08-18T22:33:20.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f47c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4015e6a0 con 0x7f7f400ce2f0 2024-08-18T22:33:20.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f40160ef0 0x7f7f40161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f40160ef0 0x7f7f40161370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51980/0 (socket says 172.21.15.5:51980) 2024-08-18T22:33:20.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3fe00640 1 -- 172.21.15.5:0/3256072228 learned_addr learned my addr 172.21.15.5:0/3256072228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:20.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f45200640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f28005220 0x7f7f4014ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f45c00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f400ce2f0 0x7f7f400ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3fe00640 1 -- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f400ce2f0 msgr2=0x7f7f400ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3fe00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f400ce2f0 0x7f7f400ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3fe00640 1 -- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f28005220 msgr2=0x7f7f4014ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3fe00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f28005220 0x7f7f4014ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3fe00640 1 -- 172.21.15.5:0/3256072228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4015fe50 con 0x7f7f40160ef0 2024-08-18T22:33:20.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f45c00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f400ce2f0 0x7f7f400ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:20.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f45200640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f28005220 0x7f7f4014ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:20.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3fe00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f40160ef0 0x7f7f40161370 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c011d30 tx=0x7f7f2c00f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:20.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3cc00640 1 -- 172.21.15.5:0/3256072228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c010040 con 0x7f7f40160ef0 2024-08-18T22:33:20.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3cc00640 1 -- 172.21.15.5:0/3256072228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f2c01a070 con 0x7f7f40160ef0 2024-08-18T22:33:20.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3cc00640 1 -- 172.21.15.5:0/3256072228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c015610 con 0x7f7f40160ef0 2024-08-18T22:33:20.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f47c00640 1 -- 172.21.15.5:0/3256072228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f40160130 con 0x7f7f40160ef0 2024-08-18T22:33:20.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f47c00640 1 -- 172.21.15.5:0/3256072228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f401606f0 con 0x7f7f40160ef0 2024-08-18T22:33:20.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f47c00640 1 -- 172.21.15.5:0/3256072228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f400af7d0 con 0x7f7f40160ef0 2024-08-18T22:33:20.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.746+0000 7f7f3cc00640 1 -- 172.21.15.5:0/3256072228 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f2c0157b0 con 0x7f7f40160ef0 2024-08-18T22:33:20.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.750+0000 7f7f3cc00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f200678f0 0x7f7f20069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:20.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.750+0000 7f7f3cc00640 1 -- 172.21.15.5:0/3256072228 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7f7f2c0895b0 con 0x7f7f40160ef0 2024-08-18T22:33:20.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.750+0000 7f7f45200640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f200678f0 0x7f7f20069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:20.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.750+0000 7f7f45200640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f200678f0 0x7f7f20069db0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7f34001130 tx=0x7f7f34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:20.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.754+0000 7f7f3cc00640 1 -- 172.21.15.5:0/3256072228 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7f2c059f00 con 0x7f7f40160ef0 2024-08-18T22:33:20.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.922+0000 7f7f47c00640 1 -- 172.21.15.5:0/3256072228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f400d06c0 con 0x7f7f40160ef0 2024-08-18T22:33:20.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.922+0000 7f7f3cc00640 1 -- 172.21.15.5:0/3256072228 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) ==== 74+0+16965 (secure 0 0 0) 0x7f7f2c059800 con 0x7f7f40160ef0 2024-08-18T22:33:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:20.921 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":193,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:33:06.433247+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:32:31.454782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-08-18T22:32:32.720083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.1","mappings":[{"from":6,"to":4}]},{"pgid":"28.2f","mappings":[{"from":6,"to":1}]},{"pgid":"28.36","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:33:20.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 -- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f200678f0 msgr2=0x7f7f20069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f200678f0 0x7f7f20069db0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7f34001130 tx=0x7f7f34009040 comp rx=0 tx=0).stop 2024-08-18T22:33:20.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 -- 172.21.15.5:0/3256072228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f40160ef0 msgr2=0x7f7f40161370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:20.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f40160ef0 0x7f7f40161370 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c011d30 tx=0x7f7f2c00f540 comp rx=0 tx=0).stop 2024-08-18T22:33:20.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 -- 172.21.15.5:0/3256072228 shutdown_connections 2024-08-18T22:33:20.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7f200678f0 0x7f7f20069db0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f400ce2f0 0x7f7f400ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f40160ef0 0x7f7f40161370 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 --2- 172.21.15.5:0/3256072228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f28005220 0x7f7f4014ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:20.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 -- 172.21.15.5:0/3256072228 >> 172.21.15.5:0/3256072228 conn(0x7f7f4006b9b0 msgr2=0x7f7f400b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:20.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 -- 172.21.15.5:0/3256072228 shutdown_connections 2024-08-18T22:33:20.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:20.926+0000 7f7f47c00640 1 -- 172.21.15.5:0/3256072228 wait complete. 2024-08-18T22:33:20.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:33:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.086+0000 7fa705a00640 1 Processor -- start 2024-08-18T22:33:21.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.086+0000 7fa705a00640 1 -- start start 2024-08-18T22:33:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.086+0000 7fa705a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa70015d4d0 0x7fa700166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.086+0000 7fa705a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7000ced30 con 0x7fa70015c180 2024-08-18T22:33:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.086+0000 7fa705a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7000cfb00 con 0x7fa70015c560 2024-08-18T22:33:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.086+0000 7fa705a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa70015d040 con 0x7fa70015d4d0 2024-08-18T22:33:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.086+0000 7fa6fea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa70015c180 0x7fa7000cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45842/0 (socket says 172.21.15.5:45842) 2024-08-18T22:33:21.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.090+0000 7fa6fea00640 1 -- 172.21.15.5:0/83666631 learned_addr learned my addr 172.21.15.5:0/83666631 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.090+0000 7fa6ff400640 1 --2- 172.21.15.5:0/83666631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa70015d4d0 0x7fa700166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.090+0000 7fa6fe000640 1 -- 172.21.15.5:0/83666631 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083365741 0 0) 0x7fa7000ced30 con 0x7fa70015c180 2024-08-18T22:33:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.090+0000 7fa6fe000640 1 -- 172.21.15.5:0/83666631 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6e4003530 con 0x7fa70015c180 2024-08-18T22:33:21.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.090+0000 7fa6fe000640 1 -- 172.21.15.5:0/83666631 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040125254 0 0) 0x7fa7000cfb00 con 0x7fa70015c560 2024-08-18T22:33:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.090+0000 7fa6ff400640 1 -- 172.21.15.5:0/83666631 >> v1:172.21.15.117:6789/0 conn(0x7fa70015c560 legacy=0x7fa7000ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.090+0000 7fa6ff400640 1 -- 172.21.15.5:0/83666631 >> v1:172.21.15.5:6789/0 conn(0x7fa70015c180 legacy=0x7fa7000cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:21.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.090+0000 7fa6ff400640 1 -- 172.21.15.5:0/83666631 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70015c9f0 con 0x7fa70015d4d0 2024-08-18T22:33:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.090+0000 7fa6ff400640 1 --2- 172.21.15.5:0/83666631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa70015d4d0 0x7fa700166f10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009dc0 tx=0x7fa6f801c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19959812720fc8be server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.090+0000 7fa6fe000640 1 -- 172.21.15.5:0/83666631 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80b2070 con 0x7fa70015d4d0 2024-08-18T22:33:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6fe000640 1 -- 172.21.15.5:0/83666631 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f80a59b0 con 0x7fa70015d4d0 2024-08-18T22:33:21.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6fe000640 1 -- 172.21.15.5:0/83666631 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80a5d80 con 0x7fa70015d4d0 2024-08-18T22:33:21.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 -- 172.21.15.5:0/83666631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa70015d4d0 msgr2=0x7fa700166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:21.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 --2- 172.21.15.5:0/83666631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa70015d4d0 0x7fa700166f10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009dc0 tx=0x7fa6f801c8d0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 -- 172.21.15.5:0/83666631 shutdown_connections 2024-08-18T22:33:21.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 --2- 172.21.15.5:0/83666631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa70015d4d0 0x7fa700166f10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 -- 172.21.15.5:0/83666631 >> 172.21.15.5:0/83666631 conn(0x7fa7000b1dc0 msgr2=0x7fa7000b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:21.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 -- 172.21.15.5:0/83666631 shutdown_connections 2024-08-18T22:33:21.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 -- 172.21.15.5:0/83666631 wait complete. 2024-08-18T22:33:21.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 Processor -- start 2024-08-18T22:33:21.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 -- start start 2024-08-18T22:33:21.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa70015c180 0x7fa700071b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa70015d4d0 0x7fa70014a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7000732a0 0x7fa7000aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa70016a000 con 0x7fa7000732a0 2024-08-18T22:33:21.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa700169e80 con 0x7fa70015d4d0 2024-08-18T22:33:21.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa705a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa70016a180 con 0x7fa70015c180 2024-08-18T22:33:21.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6ff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7000732a0 0x7fa7000aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6ff400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7000732a0 0x7fa7000aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51994/0 (socket says 172.21.15.5:51994) 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6ff400640 1 -- 172.21.15.5:0/1971653347 learned_addr learned my addr 172.21.15.5:0/1971653347 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6fea00640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa70015c180 0x7fa700071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6f6000640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa70015d4d0 0x7fa70014a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6ff400640 1 -- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa70015c180 msgr2=0x7fa700071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6ff400640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa70015c180 0x7fa700071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6ff400640 1 -- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa70015d4d0 msgr2=0x7fa70014a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6ff400640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa70015d4d0 0x7fa70014a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.094+0000 7fa6ff400640 1 -- 172.21.15.5:0/1971653347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa700072200 con 0x7fa7000732a0 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.098+0000 7fa6ff400640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7000732a0 0x7fa7000aded0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fa6f801cdb0 tx=0x7fa6f8019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.098+0000 7fa6f7400640 1 -- 172.21.15.5:0/1971653347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80b2050 con 0x7fa7000732a0 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.098+0000 7fa6f7400640 1 -- 172.21.15.5:0/1971653347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f80be070 con 0x7fa7000732a0 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.098+0000 7fa705a00640 1 -- 172.21.15.5:0/1971653347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7000724e0 con 0x7fa7000732a0 2024-08-18T22:33:21.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.098+0000 7fa6f7400640 1 -- 172.21.15.5:0/1971653347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80ada70 con 0x7fa7000732a0 2024-08-18T22:33:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.098+0000 7fa705a00640 1 -- 172.21.15.5:0/1971653347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa700072aa0 con 0x7fa7000732a0 2024-08-18T22:33:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.098+0000 7fa705a00640 1 -- 172.21.15.5:0/1971653347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7000ce6d0 con 0x7fa7000732a0 2024-08-18T22:33:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.098+0000 7fa6f7400640 1 -- 172.21.15.5:0/1971653347 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6f80adc10 con 0x7fa7000732a0 2024-08-18T22:33:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.098+0000 7fa6f7400640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6dc0678c0 0x7fa6dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.098+0000 7fa6f7400640 1 -- 172.21.15.5:0/1971653347 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 6188+0+0 (secure 0 0 0) 0x7fa6f8121270 con 0x7fa7000732a0 2024-08-18T22:33:21.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.098+0000 7fa6fea00640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6dc0678c0 0x7fa6dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.102+0000 7fa6fea00640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6dc0678c0 0x7fa6dc069d80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005890 tx=0x7fa6f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:21.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.102+0000 7fa6f7400640 1 -- 172.21.15.5:0/1971653347 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa6f8016580 con 0x7fa7000732a0 2024-08-18T22:33:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.302+0000 7fa705a00640 1 -- 172.21.15.5:0/1971653347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa7001552e0 con 0x7fa7000732a0 2024-08-18T22:33:21.300 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:33:21.302+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:33:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa6f7400640 1 -- 172.21.15.5:0/1971653347 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v152) ==== 161+0+0 (secure 0 0 0) 0x7fa6f80f1ab0 con 0x7fa7000732a0 2024-08-18T22:33:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:33:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 -- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6dc0678c0 msgr2=0x7fa6dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6dc0678c0 0x7fa6dc069d80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005890 tx=0x7fa6f0009040 comp rx=0 tx=0).stop 2024-08-18T22:33:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 -- 172.21.15.5:0/1971653347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7000732a0 msgr2=0x7fa7000aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7000732a0 0x7fa7000aded0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fa6f801cdb0 tx=0x7fa6f8019670 comp rx=0 tx=0).stop 2024-08-18T22:33:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 -- 172.21.15.5:0/1971653347 shutdown_connections 2024-08-18T22:33:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6dc0678c0 0x7fa6dc069d80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7000732a0 0x7fa7000aded0 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa70015d4d0 0x7fa70014a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 --2- 172.21.15.5:0/1971653347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa70015c180 0x7fa700071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 -- 172.21.15.5:0/1971653347 >> 172.21.15.5:0/1971653347 conn(0x7fa7000b1dc0 msgr2=0x7fa700153ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 -- 172.21.15.5:0/1971653347 shutdown_connections 2024-08-18T22:33:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.306+0000 7fa705a00640 1 -- 172.21.15.5:0/1971653347 wait complete. 2024-08-18T22:33:21.312 INFO:tasks.ceph.mds.a.smithi005.stderr: -3539> 2024-08-18T22:32:39.283+0000 7f23f8000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:33:21.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:33:21.364 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:33:21.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f2244a00640 1 Processor -- start 2024-08-18T22:33:21.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f2244a00640 1 -- start start 2024-08-18T22:33:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f2244a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f224015c360 0x7f2240160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f2244a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f224015c740 0x7f224015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f2244a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224015d0c0 0x7f224006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f2244a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f224015d550 con 0x7f224015c740 2024-08-18T22:33:21.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f2244a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f224015d9e0 con 0x7f224015c360 2024-08-18T22:33:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f2244a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f224015dcc0 con 0x7f224015d0c0 2024-08-18T22:33:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f2237e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f224015c740 0x7f224015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f2237e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f224015c740 0x7f224015cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52026/0 (socket says 172.21.15.5:52026) 2024-08-18T22:33:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f2237e00640 1 -- 172.21.15.5:0/2053126269 learned_addr learned my addr 172.21.15.5:0/2053126269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f223e800640 1 --2- 172.21.15.5:0/2053126269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224015d0c0 0x7f224006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.478+0000 7f223de00640 1 --2- 172.21.15.5:0/2053126269 >> v2:172.21.15.117:3300/0 conn(0x7f224015c360 0x7f2240160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2237e00640 1 -- 172.21.15.5:0/2053126269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224015d0c0 msgr2=0x7f224006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2237e00640 1 --2- 172.21.15.5:0/2053126269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224015d0c0 0x7f224006b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2237e00640 1 -- 172.21.15.5:0/2053126269 >> v2:172.21.15.117:3300/0 conn(0x7f224015c360 msgr2=0x7f2240160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2237e00640 1 --2- 172.21.15.5:0/2053126269 >> v2:172.21.15.117:3300/0 conn(0x7f224015c360 0x7f2240160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2237e00640 1 -- 172.21.15.5:0/2053126269 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224015dfa0 con 0x7f224015c740 2024-08-18T22:33:21.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2237e00640 1 --2- 172.21.15.5:0/2053126269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f224015c740 0x7f224015cb80 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f22400b3e60 tx=0x7f222801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b9c5aae5dafdd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:21.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f223d400640 1 -- 172.21.15.5:0/2053126269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22280b0070 con 0x7f224015c740 2024-08-18T22:33:21.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f223d400640 1 -- 172.21.15.5:0/2053126269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22280ab600 con 0x7f224015c740 2024-08-18T22:33:21.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f223d400640 1 -- 172.21.15.5:0/2053126269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22280ab9d0 con 0x7f224015c740 2024-08-18T22:33:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2244a00640 1 -- 172.21.15.5:0/2053126269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f224015c740 msgr2=0x7f224015cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2244a00640 1 --2- 172.21.15.5:0/2053126269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f224015c740 0x7f224015cb80 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f22400b3e60 tx=0x7f222801c260 comp rx=0 tx=0).stop 2024-08-18T22:33:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2244a00640 1 -- 172.21.15.5:0/2053126269 shutdown_connections 2024-08-18T22:33:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2244a00640 1 --2- 172.21.15.5:0/2053126269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224015d0c0 0x7f224006b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2244a00640 1 --2- 172.21.15.5:0/2053126269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f224015c740 0x7f224015cb80 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2244a00640 1 --2- 172.21.15.5:0/2053126269 >> v2:172.21.15.117:3300/0 conn(0x7f224015c360 0x7f2240160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.482+0000 7f2244a00640 1 -- 172.21.15.5:0/2053126269 >> 172.21.15.5:0/2053126269 conn(0x7f22400b65f0 msgr2=0x7f22400b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2244a00640 1 -- 172.21.15.5:0/2053126269 shutdown_connections 2024-08-18T22:33:21.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2244a00640 1 -- 172.21.15.5:0/2053126269 wait complete. 2024-08-18T22:33:21.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2244a00640 1 Processor -- start 2024-08-18T22:33:21.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2244a00640 1 -- start start 2024-08-18T22:33:21.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2244a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224015c360 0x7f224014fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2244a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224015c740 0x7f2240152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2244a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f224015d0c0 0x7f2240147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2244a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f224015eb70 con 0x7f224015d0c0 2024-08-18T22:33:21.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2244a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f224015e9f0 con 0x7f224015c360 2024-08-18T22:33:21.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2244a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f224015ecf0 con 0x7f224015c740 2024-08-18T22:33:21.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f223e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f224015d0c0 0x7f2240147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f223e800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f224015d0c0 0x7f2240147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52028/0 (socket says 172.21.15.5:52028) 2024-08-18T22:33:21.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f223e800640 1 -- 172.21.15.5:0/3614586323 learned_addr learned my addr 172.21.15.5:0/3614586323 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:21.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f223de00640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224015c360 0x7f224014fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2237e00640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224015c740 0x7f2240152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f223e800640 1 -- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224015c740 msgr2=0x7f2240152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:21.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f223e800640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224015c740 0x7f2240152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f223e800640 1 -- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224015c360 msgr2=0x7f224014fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:21.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f223e800640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224015c360 0x7f224014fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:21.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f223e800640 1 -- 172.21.15.5:0/3614586323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2240150330 con 0x7f224015d0c0 2024-08-18T22:33:21.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f223e800640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f224015d0c0 0x7f2240147ad0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f2238007e60 tx=0x7f223800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:21.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2236000640 1 -- 172.21.15.5:0/3614586323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238014420 con 0x7f224015d0c0 2024-08-18T22:33:21.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2236000640 1 -- 172.21.15.5:0/3614586323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2238019070 con 0x7f224015d0c0 2024-08-18T22:33:21.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2244a00640 1 -- 172.21.15.5:0/3614586323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2240153760 con 0x7f224015d0c0 2024-08-18T22:33:21.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.486+0000 7f2236000640 1 -- 172.21.15.5:0/3614586323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238014820 con 0x7f224015d0c0 2024-08-18T22:33:21.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.490+0000 7f2244a00640 1 -- 172.21.15.5:0/3614586323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2240153d20 con 0x7f224015d0c0 2024-08-18T22:33:21.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.490+0000 7f2244a00640 1 -- 172.21.15.5:0/3614586323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224015cb80 con 0x7f224015d0c0 2024-08-18T22:33:21.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.490+0000 7f2236000640 1 -- 172.21.15.5:0/3614586323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f22380149c0 con 0x7f224015d0c0 2024-08-18T22:33:21.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.490+0000 7f2236000640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f221c0678c0 0x7f221c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:21.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.490+0000 7f2236000640 1 -- 172.21.15.5:0/3614586323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 6274+0+0 (secure 0 0 0) 0x7f2238086580 con 0x7f224015d0c0 2024-08-18T22:33:21.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.490+0000 7f223de00640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f221c0678c0 0x7f221c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:21.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.490+0000 7f223de00640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f221c0678c0 0x7f221c069d80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2240155fd0 tx=0x7f2230008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:21.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.494+0000 7f2236000640 1 -- 172.21.15.5:0/3614586323 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f22380568c0 con 0x7f224015d0c0 2024-08-18T22:33:21.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:21.694+0000 7f2244a00640 1 -- 172.21.15.5:0/3614586323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f22400cd0b0 con 0x7f224015d0c0 2024-08-18T22:33:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.306+0000 7f2236000640 1 -- 172.21.15.5:0/3614586323 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v153) ==== 104+0+0 (secure 0 0 0) 0x7f223805abc0 con 0x7f224015d0c0 2024-08-18T22:33:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 -- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f221c0678c0 msgr2=0x7f221c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f221c0678c0 0x7f221c069d80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2240155fd0 tx=0x7f2230008040 comp rx=0 tx=0).stop 2024-08-18T22:33:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 -- 172.21.15.5:0/3614586323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f224015d0c0 msgr2=0x7f2240147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f224015d0c0 0x7f2240147ad0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f2238007e60 tx=0x7f223800e4b0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 -- 172.21.15.5:0/3614586323 shutdown_connections 2024-08-18T22:33:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f221c0678c0 0x7f221c069d80 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f224015d0c0 0x7f2240147ad0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f224015c740 0x7f2240152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 --2- 172.21.15.5:0/3614586323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224015c360 0x7f224014fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 -- 172.21.15.5:0/3614586323 >> 172.21.15.5:0/3614586323 conn(0x7f22400b65f0 msgr2=0x7f22400b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 -- 172.21.15.5:0/3614586323 shutdown_connections 2024-08-18T22:33:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.310+0000 7f2244a00640 1 -- 172.21.15.5:0/3614586323 wait complete. 2024-08-18T22:33:22.330 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:33:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.522+0000 7ff7e4400640 1 Processor -- start 2024-08-18T22:33:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.522+0000 7ff7e4400640 1 -- start start 2024-08-18T22:33:22.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.522+0000 7ff7e4400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7dc0cf760 0x7ff7dc15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:22.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.522+0000 7ff7e4400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7dc06dc60 0x7ff7dc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:22.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.522+0000 7ff7e4400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7dc0b3260 con 0x7ff7dc0ccaa0 2024-08-18T22:33:22.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.522+0000 7ff7e4400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff7dc0cfe90 con 0x7ff7dc06dc60 2024-08-18T22:33:22.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.522+0000 7ff7e4400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff7dc0b37e0 con 0x7ff7dc0cf760 2024-08-18T22:33:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.522+0000 7ff7e1a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff7dc0ccaa0 0x7ff7dc0cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45852/0 (socket says 172.21.15.5:45852) 2024-08-18T22:33:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.522+0000 7ff7e1a00640 1 -- 172.21.15.5:0/1120790213 learned_addr learned my addr 172.21.15.5:0/1120790213 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7e1000640 1 --2- 172.21.15.5:0/1120790213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7dc0cf760 0x7ff7dc15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7e2400640 1 --2- 172.21.15.5:0/1120790213 >> v2:172.21.15.117:3300/0 conn(0x7ff7dc06dc60 0x7ff7dc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7dbe00640 1 -- 172.21.15.5:0/1120790213 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42992087 0 0) 0x7ff7dc0b3260 con 0x7ff7dc0ccaa0 2024-08-18T22:33:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7dbe00640 1 -- 172.21.15.5:0/1120790213 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7c4003530 con 0x7ff7dc0ccaa0 2024-08-18T22:33:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7e2400640 1 -- 172.21.15.5:0/1120790213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7dc0cf760 msgr2=0x7ff7dc15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7e2400640 1 --2- 172.21.15.5:0/1120790213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7dc0cf760 0x7ff7dc15d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7e2400640 1 -- 172.21.15.5:0/1120790213 >> v1:172.21.15.5:6789/0 conn(0x7ff7dc0ccaa0 legacy=0x7ff7dc0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:22.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7e2400640 1 -- 172.21.15.5:0/1120790213 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc0cfbc0 con 0x7ff7dc06dc60 2024-08-18T22:33:22.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7e2400640 1 --2- 172.21.15.5:0/1120790213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7dc06dc60 0x7ff7dc06e110 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009d90 tx=0x7ff7d401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2478dad562eae947 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:22.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7dbe00640 1 -- 172.21.15.5:0/1120790213 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40b2070 con 0x7ff7dc06dc60 2024-08-18T22:33:22.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7dbe00640 1 -- 172.21.15.5:0/1120790213 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d40a57a0 con 0x7ff7dc06dc60 2024-08-18T22:33:22.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.526+0000 7ff7dbe00640 1 -- 172.21.15.5:0/1120790213 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40a5b70 con 0x7ff7dc06dc60 2024-08-18T22:33:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 -- 172.21.15.5:0/1120790213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7dc06dc60 msgr2=0x7ff7dc06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 --2- 172.21.15.5:0/1120790213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7dc06dc60 0x7ff7dc06e110 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009d90 tx=0x7ff7d401c8e0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 -- 172.21.15.5:0/1120790213 shutdown_connections 2024-08-18T22:33:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 --2- 172.21.15.5:0/1120790213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7dc06dc60 0x7ff7dc06e110 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 --2- 172.21.15.5:0/1120790213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7dc0cf760 0x7ff7dc15d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 -- 172.21.15.5:0/1120790213 >> 172.21.15.5:0/1120790213 conn(0x7ff7dc06b9b0 msgr2=0x7ff7dc06bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 -- 172.21.15.5:0/1120790213 shutdown_connections 2024-08-18T22:33:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 -- 172.21.15.5:0/1120790213 wait complete. 2024-08-18T22:33:22.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 Processor -- start 2024-08-18T22:33:22.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 -- start start 2024-08-18T22:33:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7dc06dc60 0x7ff7dc09a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7dc0ccaa0 0x7ff7dc1575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7dc0cf760 0x7ff7dc159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc06ebe0 con 0x7ff7dc0cf760 2024-08-18T22:33:22.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc06ea60 con 0x7ff7dc0ccaa0 2024-08-18T22:33:22.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e4400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff7dc169510 con 0x7ff7dc06dc60 2024-08-18T22:33:22.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e2400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7dc0cf760 0x7ff7dc159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:22.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e2400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7dc0cf760 0x7ff7dc159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52038/0 (socket says 172.21.15.5:52038) 2024-08-18T22:33:22.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e2400640 1 -- 172.21.15.5:0/3163829645 learned_addr learned my addr 172.21.15.5:0/3163829645 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:22.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e1000640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7dc0ccaa0 0x7ff7dc1575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:22.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e1a00640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7dc06dc60 0x7ff7dc09a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:22.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e2400640 1 -- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7dc06dc60 msgr2=0x7ff7dc09a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:22.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e2400640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7dc06dc60 0x7ff7dc09a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e2400640 1 -- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7dc0ccaa0 msgr2=0x7ff7dc1575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:22.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e2400640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7dc0ccaa0 0x7ff7dc1575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.530+0000 7ff7e2400640 1 -- 172.21.15.5:0/3163829645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc15a3f0 con 0x7ff7dc0cf760 2024-08-18T22:33:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.534+0000 7ff7e2400640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7dc0cf760 0x7ff7dc159720 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40b0040 tx=0x7ff7d4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.534+0000 7ff7d9600640 1 -- 172.21.15.5:0/3163829645 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40bd020 con 0x7ff7dc0cf760 2024-08-18T22:33:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.534+0000 7ff7d9600640 1 -- 172.21.15.5:0/3163829645 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d40b8470 con 0x7ff7dc0cf760 2024-08-18T22:33:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.534+0000 7ff7d9600640 1 -- 172.21.15.5:0/3163829645 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40b2040 con 0x7ff7dc0cf760 2024-08-18T22:33:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.534+0000 7ff7e4400640 1 -- 172.21.15.5:0/3163829645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7dc15a6d0 con 0x7ff7dc0cf760 2024-08-18T22:33:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.534+0000 7ff7e4400640 1 -- 172.21.15.5:0/3163829645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7dc15ac90 con 0x7ff7dc0cf760 2024-08-18T22:33:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.534+0000 7ff7e4400640 1 -- 172.21.15.5:0/3163829645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7dc06e110 con 0x7ff7dc0cf760 2024-08-18T22:33:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.534+0000 7ff7d9600640 1 -- 172.21.15.5:0/3163829645 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7d40c0020 con 0x7ff7dc0cf760 2024-08-18T22:33:22.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.534+0000 7ff7d9600640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7bc0678c0 0x7ff7bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:22.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.534+0000 7ff7d9600640 1 -- 172.21.15.5:0/3163829645 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 6274+0+0 (secure 0 0 0) 0x7ff7d4120b60 con 0x7ff7dc0cf760 2024-08-18T22:33:22.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.538+0000 7ff7e1a00640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7bc0678c0 0x7ff7bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:22.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.538+0000 7ff7e1a00640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7bc0678c0 0x7ff7bc069d80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0007fd0 tx=0x7ff7d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:22.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.538+0000 7ff7d9600640 1 -- 172.21.15.5:0/3163829645 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ff7d40c7030 con 0x7ff7dc0cf760 2024-08-18T22:33:22.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:22.706+0000 7ff7e4400640 1 -- 172.21.15.5:0/3163829645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff7dc0aeb60 con 0x7ff7dc0cf760 2024-08-18T22:33:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.486+0000 7ff7d9600640 1 -- 172.21.15.5:0/3163829645 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v195) ==== 181+0+0 (secure 0 0 0) 0x7ff7d4016560 con 0x7ff7dc0cf760 2024-08-18T22:33:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:33:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 -- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7bc0678c0 msgr2=0x7ff7bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7bc0678c0 0x7ff7bc069d80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0007fd0 tx=0x7ff7d0009040 comp rx=0 tx=0).stop 2024-08-18T22:33:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 -- 172.21.15.5:0/3163829645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7dc0cf760 msgr2=0x7ff7dc159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7dc0cf760 0x7ff7dc159720 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40b0040 tx=0x7ff7d4019680 comp rx=0 tx=0).stop 2024-08-18T22:33:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 -- 172.21.15.5:0/3163829645 shutdown_connections 2024-08-18T22:33:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff7bc0678c0 0x7ff7bc069d80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7dc0cf760 0x7ff7dc159720 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7dc0ccaa0 0x7ff7dc1575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 --2- 172.21.15.5:0/3163829645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7dc06dc60 0x7ff7dc09a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 -- 172.21.15.5:0/3163829645 >> 172.21.15.5:0/3163829645 conn(0x7ff7dc06b9b0 msgr2=0x7ff7dc0adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 -- 172.21.15.5:0/3163829645 shutdown_connections 2024-08-18T22:33:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.490+0000 7ff7e4400640 1 -- 172.21.15.5:0/3163829645 wait complete. 2024-08-18T22:33:23.510 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:33:23.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45da200640 1 Processor -- start 2024-08-18T22:33:23.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45da200640 1 -- start start 2024-08-18T22:33:23.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45da200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45d409aca0 0x7f45d40b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:23.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45da200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45d409bac0 0x7f45d415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:23.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45da200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d40b0840 con 0x7f45d409b080 2024-08-18T22:33:23.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45da200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f45d40b6520 con 0x7f45d409bac0 2024-08-18T22:33:23.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45da200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f45d40b0ae0 con 0x7f45d409aca0 2024-08-18T22:33:23.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45d2a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45d409bac0 0x7f45d415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:23.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45d2a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45d409bac0 0x7f45d415bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58040/0 (socket says 172.21.15.5:58040) 2024-08-18T22:33:23.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45d2a00640 1 -- 172.21.15.5:0/1789090819 learned_addr learned my addr 172.21.15.5:0/1789090819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:23.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45d3400640 1 --2- 172.21.15.5:0/1789090819 >> v2:172.21.15.117:3300/0 conn(0x7f45d409aca0 0x7f45d40b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:23.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45d2a00640 1 -- 172.21.15.5:0/1789090819 >> v2:172.21.15.117:3300/0 conn(0x7f45d409aca0 msgr2=0x7f45d40b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:23.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45d2a00640 1 --2- 172.21.15.5:0/1789090819 >> v2:172.21.15.117:3300/0 conn(0x7f45d409aca0 0x7f45d40b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45d2a00640 1 -- 172.21.15.5:0/1789090819 >> v1:172.21.15.117:6789/0 conn(0x7f45d409b080 legacy=0x7f45d40b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:23.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.666+0000 7f45d2a00640 1 -- 172.21.15.5:0/1789090819 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d40b0dc0 con 0x7f45d409bac0 2024-08-18T22:33:23.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45d2a00640 1 --2- 172.21.15.5:0/1789090819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45d409bac0 0x7f45d415bdb0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f45d40d3240 tx=0x7f45c001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69ee47918dbc515 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:23.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45d2000640 1 -- 172.21.15.5:0/1789090819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b0070 con 0x7f45d409bac0 2024-08-18T22:33:23.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45d2000640 1 -- 172.21.15.5:0/1789090819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c00ab600 con 0x7f45d409bac0 2024-08-18T22:33:23.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45d2000640 1 -- 172.21.15.5:0/1789090819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00ab9d0 con 0x7f45d409bac0 2024-08-18T22:33:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45da200640 1 -- 172.21.15.5:0/1789090819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45d409bac0 msgr2=0x7f45d415bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45da200640 1 --2- 172.21.15.5:0/1789090819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45d409bac0 0x7f45d415bdb0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f45d40d3240 tx=0x7f45c001c520 comp rx=0 tx=0).stop 2024-08-18T22:33:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45da200640 1 -- 172.21.15.5:0/1789090819 shutdown_connections 2024-08-18T22:33:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45da200640 1 --2- 172.21.15.5:0/1789090819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45d409bac0 0x7f45d415bdb0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45da200640 1 --2- 172.21.15.5:0/1789090819 >> v2:172.21.15.117:3300/0 conn(0x7f45d409aca0 0x7f45d40b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45da200640 1 -- 172.21.15.5:0/1789090819 >> 172.21.15.5:0/1789090819 conn(0x7f45d40b7830 msgr2=0x7f45d40b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:23.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45da200640 1 -- 172.21.15.5:0/1789090819 shutdown_connections 2024-08-18T22:33:23.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.670+0000 7f45da200640 1 -- 172.21.15.5:0/1789090819 wait complete. 2024-08-18T22:33:23.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45da200640 1 Processor -- start 2024-08-18T22:33:23.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45da200640 1 -- start start 2024-08-18T22:33:23.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45da200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45d409aca0 0x7f45d414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:23.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45da200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45d409b080 0x7f45d4151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45da200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45d409bac0 0x7f45d406db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45da200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f45d41690c0 con 0x7f45d409b080 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45da200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f45d4168f40 con 0x7f45d409bac0 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45da200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f45d4169240 con 0x7f45d409aca0 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45d2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45d409b080 0x7f45d4151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45d2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45d409b080 0x7f45d4151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58044/0 (socket says 172.21.15.5:58044) 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45d2a00640 1 -- 172.21.15.5:0/4136532353 learned_addr learned my addr 172.21.15.5:0/4136532353 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45d3e00640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45d409bac0 0x7f45d406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45d3400640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45d409aca0 0x7f45d414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45d2a00640 1 -- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45d409aca0 msgr2=0x7f45d414eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45d2a00640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45d409aca0 0x7f45d414eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45d2a00640 1 -- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45d409bac0 msgr2=0x7f45d406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:23.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45d2a00640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45d409bac0 0x7f45d406db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45d2a00640 1 -- 172.21.15.5:0/4136532353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d4155ff0 con 0x7f45d409b080 2024-08-18T22:33:23.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45d2a00640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45d409b080 0x7f45d4151c40 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f45c001ca00 tx=0x7f45c00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45cb400640 1 -- 172.21.15.5:0/4136532353 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b0040 con 0x7f45d409b080 2024-08-18T22:33:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45cb400640 1 -- 172.21.15.5:0/4136532353 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c00b9070 con 0x7f45d409b080 2024-08-18T22:33:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45da200640 1 -- 172.21.15.5:0/4136532353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d4154f50 con 0x7f45d409b080 2024-08-18T22:33:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45cb400640 1 -- 172.21.15.5:0/4136532353 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b4660 con 0x7f45d409b080 2024-08-18T22:33:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45da200640 1 -- 172.21.15.5:0/4136532353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d4155510 con 0x7f45d409b080 2024-08-18T22:33:23.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.674+0000 7f45da200640 1 -- 172.21.15.5:0/4136532353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d40b5c00 con 0x7f45d409b080 2024-08-18T22:33:23.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.678+0000 7f45cb400640 1 -- 172.21.15.5:0/4136532353 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f45c00b4800 con 0x7f45d409b080 2024-08-18T22:33:23.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.678+0000 7f45cb400640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45b40678c0 0x7f45b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:23.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.678+0000 7f45cb400640 1 -- 172.21.15.5:0/4136532353 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5836+0+0 (secure 0 0 0) 0x7f45c011f800 con 0x7f45d409b080 2024-08-18T22:33:23.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.678+0000 7f45d3400640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45b40678c0 0x7f45b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:23.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.678+0000 7f45d3400640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45b40678c0 0x7f45b4069d80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f45c4007a60 tx=0x7f45c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:23.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.682+0000 7f45cb400640 1 -- 172.21.15.5:0/4136532353 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f45c0016110 con 0x7f45d409b080 2024-08-18T22:33:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:23.850+0000 7f45da200640 1 -- 172.21.15.5:0/4136532353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f45d40b3400 con 0x7f45d409b080 2024-08-18T22:33:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.498+0000 7f45cb400640 1 -- 172.21.15.5:0/4136532353 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v196) ==== 169+0+0 (secure 0 0 0) 0x7f45c00efbd0 con 0x7f45d409b080 2024-08-18T22:33:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:33:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 -- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45b40678c0 msgr2=0x7f45b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45b40678c0 0x7f45b4069d80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f45c4007a60 tx=0x7f45c4008040 comp rx=0 tx=0).stop 2024-08-18T22:33:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 -- 172.21.15.5:0/4136532353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45d409b080 msgr2=0x7f45d4151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45d409b080 0x7f45d4151c40 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f45c001ca00 tx=0x7f45c00192c0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 -- 172.21.15.5:0/4136532353 shutdown_connections 2024-08-18T22:33:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f45b40678c0 0x7f45b4069d80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45d409bac0 0x7f45d406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45d409b080 0x7f45d4151c40 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 --2- 172.21.15.5:0/4136532353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45d409aca0 0x7f45d414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 -- 172.21.15.5:0/4136532353 >> 172.21.15.5:0/4136532353 conn(0x7f45d40b7830 msgr2=0x7f45d40b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 -- 172.21.15.5:0/4136532353 shutdown_connections 2024-08-18T22:33:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.502+0000 7f45da200640 1 -- 172.21.15.5:0/4136532353 wait complete. 2024-08-18T22:33:24.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:33:24.540 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:33:24.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:33:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.670+0000 7fd3df000640 1 Processor -- start 2024-08-18T22:33:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.670+0000 7fd3df000640 1 -- start start 2024-08-18T22:33:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3df000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3d8158710 0x7fd3d806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3df000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d815e7b0 0x7fd3d806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3df000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3d815f780 con 0x7fd3d806cf00 2024-08-18T22:33:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3df000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd3d815ec40 con 0x7fd3d8158710 2024-08-18T22:33:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3df000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d815eee0 con 0x7fd3d815e7b0 2024-08-18T22:33:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3dd000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd3d806cf00 0x7fd3d80ad8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36300/0 (socket says 172.21.15.5:36300) 2024-08-18T22:33:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3dd000640 1 -- 172.21.15.5:0/1835406679 learned_addr learned my addr 172.21.15.5:0/1835406679 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3d7e00640 1 --2- 172.21.15.5:0/1835406679 >> v2:172.21.15.117:3300/0 conn(0x7fd3d8158710 0x7fd3d806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3cf400640 1 --2- 172.21.15.5:0/1835406679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d815e7b0 0x7fd3d806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3d7400640 1 -- 172.21.15.5:0/1835406679 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 167190105 0 0) 0x7fd3d815f780 con 0x7fd3d806cf00 2024-08-18T22:33:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3d7400640 1 -- 172.21.15.5:0/1835406679 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3bc003530 con 0x7fd3d806cf00 2024-08-18T22:33:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3d7e00640 1 -- 172.21.15.5:0/1835406679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d815e7b0 msgr2=0x7fd3d806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3d7e00640 1 --2- 172.21.15.5:0/1835406679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d815e7b0 0x7fd3d806c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3d7e00640 1 -- 172.21.15.5:0/1835406679 >> v1:172.21.15.5:6789/0 conn(0x7fd3d806cf00 legacy=0x7fd3d80ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3d7e00640 1 -- 172.21.15.5:0/1835406679 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d815f1c0 con 0x7fd3d8158710 2024-08-18T22:33:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.674+0000 7fd3cf400640 1 --2- 172.21.15.5:0/1835406679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d815e7b0 0x7fd3d806c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:33:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3d7e00640 1 --2- 172.21.15.5:0/1835406679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3d8158710 0x7fd3d806ef60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80097f0 tx=0x7fd3c801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c0f4ec8f1e2ab5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3d7400640 1 -- 172.21.15.5:0/1835406679 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80b0070 con 0x7fd3d8158710 2024-08-18T22:33:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3d7400640 1 -- 172.21.15.5:0/1835406679 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c80a4e50 con 0x7fd3d8158710 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3d7400640 1 -- 172.21.15.5:0/1835406679 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80ab820 con 0x7fd3d8158710 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3df000640 1 -- 172.21.15.5:0/1835406679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3d8158710 msgr2=0x7fd3d806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3df000640 1 --2- 172.21.15.5:0/1835406679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3d8158710 0x7fd3d806ef60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80097f0 tx=0x7fd3c801c4a0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3df000640 1 -- 172.21.15.5:0/1835406679 shutdown_connections 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3df000640 1 --2- 172.21.15.5:0/1835406679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d815e7b0 0x7fd3d806c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3df000640 1 --2- 172.21.15.5:0/1835406679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3d8158710 0x7fd3d806ef60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3df000640 1 -- 172.21.15.5:0/1835406679 >> 172.21.15.5:0/1835406679 conn(0x7fd3d8072350 msgr2=0x7fd3d8072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3df000640 1 -- 172.21.15.5:0/1835406679 shutdown_connections 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3df000640 1 -- 172.21.15.5:0/1835406679 wait complete. 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3df000640 1 Processor -- start 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.678+0000 7fd3df000640 1 -- start start 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3df000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3d806cf00 0x7fd3d81509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3df000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d8158710 0x7fd3d80cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3df000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3d815e7b0 0x7fd3d80b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3df000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d8158c70 con 0x7fd3d806cf00 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3df000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d8158af0 con 0x7fd3d815e7b0 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3df000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d80b4ed0 con 0x7fd3d8158710 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3d806cf00 0x7fd3d81509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3d806cf00 0x7fd3d81509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58054/0 (socket says 172.21.15.5:58054) 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d7e00640 1 -- 172.21.15.5:0/1001235083 learned_addr learned my addr 172.21.15.5:0/1001235083 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3cf400640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d8158710 0x7fd3d80cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3dd000640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3d815e7b0 0x7fd3d80b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d7e00640 1 -- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d8158710 msgr2=0x7fd3d80cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d7e00640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d8158710 0x7fd3d80cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d7e00640 1 -- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3d815e7b0 msgr2=0x7fd3d80b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d7e00640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3d815e7b0 0x7fd3d80b56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d7e00640 1 -- 172.21.15.5:0/1001235083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d8151070 con 0x7fd3d806cf00 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3cf400640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d8158710 0x7fd3d80cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d7e00640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3d806cf00 0x7fd3d81509e0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fd3c801a0d0 tx=0x7fd3c801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d4c00640 1 -- 172.21.15.5:0/1001235083 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80b0050 con 0x7fd3d806cf00 2024-08-18T22:33:24.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d4c00640 1 -- 172.21.15.5:0/1001235083 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c80bc070 con 0x7fd3d806cf00 2024-08-18T22:33:24.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d4c00640 1 -- 172.21.15.5:0/1001235083 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80b7690 con 0x7fd3d806cf00 2024-08-18T22:33:24.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3df000640 1 -- 172.21.15.5:0/1001235083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d8151350 con 0x7fd3d806cf00 2024-08-18T22:33:24.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3df000640 1 -- 172.21.15.5:0/1001235083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d8151bf0 con 0x7fd3d806cf00 2024-08-18T22:33:24.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3df000640 1 -- 172.21.15.5:0/1001235083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d806ef60 con 0x7fd3d806cf00 2024-08-18T22:33:24.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.682+0000 7fd3d4c00640 1 -- 172.21.15.5:0/1001235083 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3c80b7830 con 0x7fd3d806cf00 2024-08-18T22:33:24.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.686+0000 7fd3d4c00640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3b40678c0 0x7fd3b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:24.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.686+0000 7fd3d4c00640 1 -- 172.21.15.5:0/1001235083 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7fd3c8120180 con 0x7fd3d806cf00 2024-08-18T22:33:24.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.686+0000 7fd3cf400640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3b40678c0 0x7fd3b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:24.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.686+0000 7fd3cf400640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3b40678c0 0x7fd3b4069d80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd3d81607d0 tx=0x7fd3c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:24.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.690+0000 7fd3d4c00640 1 -- 172.21.15.5:0/1001235083 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd3c8016090 con 0x7fd3d806cf00 2024-08-18T22:33:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.858+0000 7fd3df000640 1 -- 172.21.15.5:0/1001235083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd3d815e1f0 con 0x7fd3d806cf00 2024-08-18T22:33:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3d4c00640 1 -- 172.21.15.5:0/1001235083 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v47) ==== 104+0+0 (secure 0 0 0) 0x7fd3c80f0eb0 con 0x7fd3d806cf00 2024-08-18T22:33:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 -- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3b40678c0 msgr2=0x7fd3b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3b40678c0 0x7fd3b4069d80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd3d81607d0 tx=0x7fd3c0008040 comp rx=0 tx=0).stop 2024-08-18T22:33:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 -- 172.21.15.5:0/1001235083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3d806cf00 msgr2=0x7fd3d81509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3d806cf00 0x7fd3d81509e0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fd3c801a0d0 tx=0x7fd3c801ace0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 -- 172.21.15.5:0/1001235083 shutdown_connections 2024-08-18T22:33:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd3b40678c0 0x7fd3b4069d80 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3d815e7b0 0x7fd3d80b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3d8158710 0x7fd3d80cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 --2- 172.21.15.5:0/1001235083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3d806cf00 0x7fd3d81509e0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 -- 172.21.15.5:0/1001235083 >> 172.21.15.5:0/1001235083 conn(0x7fd3d8072350 msgr2=0x7fd3d80ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 -- 172.21.15.5:0/1001235083 shutdown_connections 2024-08-18T22:33:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:24.862+0000 7fd3df000640 1 -- 172.21.15.5:0/1001235083 wait complete. 2024-08-18T22:33:24.881 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-08-18T22:33:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32be00640 1 Processor -- start 2024-08-18T22:33:25.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32be00640 1 -- start start 2024-08-18T22:33:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32be00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd32c09b520 0x7fd32c15f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32be00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd32c09b9b0 con 0x7fd32c0d02a0 2024-08-18T22:33:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32be00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd32c06fe70 con 0x7fd32c070510 2024-08-18T22:33:25.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32be00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c15f670 con 0x7fd32c09b520 2024-08-18T22:33:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32b400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd32c0d02a0 0x7fd32c0d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36308/0 (socket says 172.21.15.5:36308) 2024-08-18T22:33:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32b400640 1 -- 172.21.15.5:0/1876029196 learned_addr learned my addr 172.21.15.5:0/1876029196 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32a000640 1 --2- 172.21.15.5:0/1876029196 >> v2:172.21.15.117:3300/0 conn(0x7fd32c09b520 0x7fd32c15f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396937164 0 0) 0x7fd32c09b9b0 con 0x7fd32c0d02a0 2024-08-18T22:33:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd310003530 con 0x7fd32c0d02a0 2024-08-18T22:33:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016525471 0 0) 0x7fd32c06fe70 con 0x7fd32c070510 2024-08-18T22:33:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd32c09b9b0 con 0x7fd32c070510 2024-08-18T22:33:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1085577031 0 0) 0x7fd310003530 con 0x7fd32c0d02a0 2024-08-18T22:33:25.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 >> v2:172.21.15.117:3300/0 conn(0x7fd32c09b520 msgr2=0x7fd32c15f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 --2- 172.21.15.5:0/1876029196 >> v2:172.21.15.117:3300/0 conn(0x7fd32c09b520 0x7fd32c15f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 >> v1:172.21.15.117:6789/0 conn(0x7fd32c070510 legacy=0x7fd32c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c070150 con 0x7fd32c0d02a0 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fd324001a00 con 0x7fd32c0d02a0 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 >> v1:172.21.15.5:6789/0 conn(0x7fd32c0d02a0 legacy=0x7fd32c0d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd310003ba0 0x7fd310003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd310004810 0x7fd310004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3100051d0 0x7fd31000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c15f670 con 0x7fd310004810 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd31000c0a0 con 0x7fd3100051d0 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd31000c2a0 con 0x7fd310003ba0 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32a000640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd310004810 0x7fd310004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32aa00640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd310003ba0 0x7fd310003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32b400640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3100051d0 0x7fd31000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32a000640 1 -- 172.21.15.5:0/1876029196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd310003ba0 msgr2=0x7fd310003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32a000640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd310003ba0 0x7fd310003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32a000640 1 -- 172.21.15.5:0/1876029196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3100051d0 msgr2=0x7fd31000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32a000640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3100051d0 0x7fd31000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32a000640 1 -- 172.21.15.5:0/1876029196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd310003530 con 0x7fd310004810 2024-08-18T22:33:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32b400640 1 -- 172.21.15.5:0/1876029196 reap_dead start 2024-08-18T22:33:25.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.066+0000 7fd32aa00640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd310003ba0 0x7fd310003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.070+0000 7fd32a000640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd310004810 0x7fd310004c90 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7fd318009ae0 tx=0x7fd31801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ec0592db15ebd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.070+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3180b2070 con 0x7fd310004810 2024-08-18T22:33:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.070+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3180a5660 con 0x7fd310004810 2024-08-18T22:33:25.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.070+0000 7fd329600640 1 -- 172.21.15.5:0/1876029196 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3180096b0 con 0x7fd310004810 2024-08-18T22:33:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.070+0000 7fd32be00640 1 -- 172.21.15.5:0/1876029196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd310004810 msgr2=0x7fd310004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.070+0000 7fd32be00640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd310004810 0x7fd310004c90 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7fd318009ae0 tx=0x7fd31801ca70 comp rx=0 tx=0).stop 2024-08-18T22:33:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.070+0000 7fd32be00640 1 -- 172.21.15.5:0/1876029196 shutdown_connections 2024-08-18T22:33:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.070+0000 7fd32be00640 1 --2- 172.21.15.5:0/1876029196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd310004810 0x7fd310004c90 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.070+0000 7fd32be00640 1 -- 172.21.15.5:0/1876029196 >> 172.21.15.5:0/1876029196 conn(0x7fd32c0b3a20 msgr2=0x7fd32c0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.070+0000 7fd32be00640 1 -- 172.21.15.5:0/1876029196 shutdown_connections 2024-08-18T22:33:25.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.070+0000 7fd32be00640 1 -- 172.21.15.5:0/1876029196 wait complete. 2024-08-18T22:33:25.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32be00640 1 Processor -- start 2024-08-18T22:33:25.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32be00640 1 -- start start 2024-08-18T22:33:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd310004810 0x7fd32c1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd32c0c63f0 0x7fd32c1f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c1f4970 0x7fd32c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32be00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c09b000 con 0x7fd32c0c63f0 2024-08-18T22:33:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32be00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c09ad20 con 0x7fd32c1f4970 2024-08-18T22:33:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32be00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c06fb00 con 0x7fd310004810 2024-08-18T22:33:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd32c0c63f0 0x7fd32c1f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd32c0c63f0 0x7fd32c1f4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58072/0 (socket says 172.21.15.5:58072) 2024-08-18T22:33:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32a000640 1 -- 172.21.15.5:0/3868975018 learned_addr learned my addr 172.21.15.5:0/3868975018 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32a000640 1 -- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd310004810 msgr2=0x7fd32c1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32a000640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd310004810 0x7fd32c1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32a000640 1 -- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c1f4970 msgr2=0x7fd32c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32a000640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c1f4970 0x7fd32c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32a000640 1 -- 172.21.15.5:0/3868975018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c155930 con 0x7fd32c0c63f0 2024-08-18T22:33:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32a000640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd32c0c63f0 0x7fd32c1f4430 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7fd31801c8a0 tx=0x7fd318019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd322a00640 1 -- 172.21.15.5:0/3868975018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3180b2040 con 0x7fd32c0c63f0 2024-08-18T22:33:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd322a00640 1 -- 172.21.15.5:0/3868975018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31800f000 con 0x7fd32c0c63f0 2024-08-18T22:33:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd322a00640 1 -- 172.21.15.5:0/3868975018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3180096b0 con 0x7fd32c0c63f0 2024-08-18T22:33:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32be00640 1 -- 172.21.15.5:0/3868975018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c159c90 con 0x7fd32c0c63f0 2024-08-18T22:33:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.074+0000 7fd32be00640 1 -- 172.21.15.5:0/3868975018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c0c5ee0 con 0x7fd32c0c63f0 2024-08-18T22:33:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.078+0000 7fd32be00640 1 -- 172.21.15.5:0/3868975018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32c0b46d0 con 0x7fd32c0c63f0 2024-08-18T22:33:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.078+0000 7fd322a00640 1 -- 172.21.15.5:0/3868975018 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3180bf030 con 0x7fd32c0c63f0 2024-08-18T22:33:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.078+0000 7fd322a00640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd30c0678c0 0x7fd30c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.078+0000 7fd322a00640 1 -- 172.21.15.5:0/3868975018 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7fd31811f7c0 con 0x7fd32c0c63f0 2024-08-18T22:33:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.078+0000 7fd32aa00640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd30c0678c0 0x7fd30c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.078+0000 7fd32aa00640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd30c0678c0 0x7fd30c069d80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd31c007af0 tx=0x7fd31c0071f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.082+0000 7fd322a00640 1 -- 172.21.15.5:0/3868975018 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd3180c6060 con 0x7fd32c0c63f0 2024-08-18T22:33:25.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.306+0000 7fd32be00640 1 -- 172.21.15.5:0/3868975018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7fd32c073d40 con 0x7fd32c0c63f0 2024-08-18T22:33:25.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.498+0000 7fd322a00640 1 -- 172.21.15.5:0/3868975018 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v663) ==== 140+0+0 (secure 0 0 0) 0x7fd318016780 con 0x7fd32c0c63f0 2024-08-18T22:33:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 -- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd30c0678c0 msgr2=0x7fd30c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd30c0678c0 0x7fd30c069d80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd31c007af0 tx=0x7fd31c0071f0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 -- 172.21.15.5:0/3868975018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd32c0c63f0 msgr2=0x7fd32c1f4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd32c0c63f0 0x7fd32c1f4430 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7fd31801c8a0 tx=0x7fd318019810 comp rx=0 tx=0).stop 2024-08-18T22:33:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 -- 172.21.15.5:0/3868975018 shutdown_connections 2024-08-18T22:33:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd30c0678c0 0x7fd30c069d80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c1f4970 0x7fd32c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd32c0c63f0 0x7fd32c1f4430 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 --2- 172.21.15.5:0/3868975018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd310004810 0x7fd32c1553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 -- 172.21.15.5:0/3868975018 >> 172.21.15.5:0/3868975018 conn(0x7fd32c0b3a20 msgr2=0x7fd32c06d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:25.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 -- 172.21.15.5:0/3868975018 shutdown_connections 2024-08-18T22:33:25.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.502+0000 7fd32be00640 1 -- 172.21.15.5:0/3868975018 wait complete. 2024-08-18T22:33:25.519 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-08-18T22:33:25.519 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-08-18T22:33:25.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:33:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.662+0000 7fa4b2600640 1 Processor -- start 2024-08-18T22:33:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.662+0000 7fa4b2600640 1 -- start start 2024-08-18T22:33:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.662+0000 7fa4b2600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 0x7fa4ac0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.662+0000 7fa4b2600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa4ac0afe50 0x7fa4ac06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.662+0000 7fa4b2600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4ac0b65d0 con 0x7fa4ac0b5e60 2024-08-18T22:33:25.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.662+0000 7fa4b2600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa4ac06e560 con 0x7fa4ac0afe50 2024-08-18T22:33:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.662+0000 7fa4b2600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ac0b68b0 con 0x7fa4ac15e140 2024-08-18T22:33:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.666+0000 7fa4ab400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 0x7fa4ac0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.666+0000 7fa4ab400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 0x7fa4ac0b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:55948/0 (socket says 172.21.15.5:55948) 2024-08-18T22:33:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.666+0000 7fa4ab400640 1 -- 172.21.15.5:0/3873108502 learned_addr learned my addr 172.21.15.5:0/3873108502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.666+0000 7fa4abe00640 1 --2- 172.21.15.5:0/3873108502 >> v2:172.21.15.117:3300/0 conn(0x7fa4ac0afe50 0x7fa4ac06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.666+0000 7fa4ab400640 1 -- 172.21.15.5:0/3873108502 >> v2:172.21.15.117:3300/0 conn(0x7fa4ac0afe50 msgr2=0x7fa4ac06efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.666+0000 7fa4ab400640 1 --2- 172.21.15.5:0/3873108502 >> v2:172.21.15.117:3300/0 conn(0x7fa4ac0afe50 0x7fa4ac06efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.666+0000 7fa4ab400640 1 -- 172.21.15.5:0/3873108502 >> v1:172.21.15.117:6789/0 conn(0x7fa4ac0b5e60 legacy=0x7fa4ac0af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.666+0000 7fa4ab400640 1 -- 172.21.15.5:0/3873108502 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ac06e7b0 con 0x7fa4ac15e140 2024-08-18T22:33:25.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.666+0000 7fa4ab400640 1 --2- 172.21.15.5:0/3873108502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 0x7fa4ac0b4e40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0098a0 tx=0x7fa49c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b92fc268f84cb87f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:25.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4aaa00640 1 -- 172.21.15.5:0/3873108502 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0aa430 con 0x7fa4ac15e140 2024-08-18T22:33:25.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4aaa00640 1 -- 172.21.15.5:0/3873108502 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49c0af070 con 0x7fa4ac15e140 2024-08-18T22:33:25.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4aaa00640 1 -- 172.21.15.5:0/3873108502 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0aa7f0 con 0x7fa4ac15e140 2024-08-18T22:33:25.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 -- 172.21.15.5:0/3873108502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 msgr2=0x7fa4ac0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 --2- 172.21.15.5:0/3873108502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 0x7fa4ac0b4e40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0098a0 tx=0x7fa49c01c4b0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 -- 172.21.15.5:0/3873108502 shutdown_connections 2024-08-18T22:33:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 --2- 172.21.15.5:0/3873108502 >> v2:172.21.15.117:3300/0 conn(0x7fa4ac0afe50 0x7fa4ac06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 --2- 172.21.15.5:0/3873108502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 0x7fa4ac0b4e40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 -- 172.21.15.5:0/3873108502 >> 172.21.15.5:0/3873108502 conn(0x7fa4ac06b9b0 msgr2=0x7fa4ac06bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 -- 172.21.15.5:0/3873108502 shutdown_connections 2024-08-18T22:33:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 -- 172.21.15.5:0/3873108502 wait complete. 2024-08-18T22:33:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 Processor -- start 2024-08-18T22:33:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 -- start start 2024-08-18T22:33:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4ac0afe50 0x7fa4ac13e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0b5e60 0x7fa4ac15e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 0x7fa4ac14ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac06fe80 con 0x7fa4ac0b5e60 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac06fd00 con 0x7fa4ac0afe50 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4b2600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ac070000 con 0x7fa4ac15e140 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4ab400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4ac0afe50 0x7fa4ac13e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4a2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0b5e60 0x7fa4ac15e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4ab400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4ac0afe50 0x7fa4ac13e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:54926/0 (socket says 172.21.15.5:54926) 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4ab400640 1 -- 172.21.15.5:0/3232370743 learned_addr learned my addr 172.21.15.5:0/3232370743 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.670+0000 7fa4abe00640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 0x7fa4ac14ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4ab400640 1 -- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 msgr2=0x7fa4ac14ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4ab400640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 0x7fa4ac14ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4ab400640 1 -- 172.21.15.5:0/3232370743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0b5e60 msgr2=0x7fa4ac15e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4ab400640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0b5e60 0x7fa4ac15e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4ab400640 1 -- 172.21.15.5:0/3232370743 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ac0ce260 con 0x7fa4ac0afe50 2024-08-18T22:33:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4ab400640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4ac0afe50 0x7fa4ac13e060 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0ac040 tx=0x7fa49c019250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3232370743 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0be610 con 0x7fa4ac0afe50 2024-08-18T22:33:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3232370743 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49c0be7b0 con 0x7fa4ac0afe50 2024-08-18T22:33:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4b2600640 1 -- 172.21.15.5:0/3232370743 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ac0ce500 con 0x7fa4ac0afe50 2024-08-18T22:33:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3232370743 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0beba0 con 0x7fa4ac0afe50 2024-08-18T22:33:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4b2600640 1 -- 172.21.15.5:0/3232370743 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4ac0ceac0 con 0x7fa4ac0afe50 2024-08-18T22:33:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4b2600640 1 -- 172.21.15.5:0/3232370743 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4ac06efb0 con 0x7fa4ac0afe50 2024-08-18T22:33:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3232370743 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa49c0bc020 con 0x7fa4ac0afe50 2024-08-18T22:33:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4a3e00640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4880678f0 0x7fa488069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3232370743 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7fa49c120480 con 0x7fa4ac0afe50 2024-08-18T22:33:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.674+0000 7fa4a2a00640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4880678f0 0x7fa488069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.678+0000 7fa4a2a00640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4880678f0 0x7fa488069db0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0d0520 tx=0x7fa494009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:25.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.678+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3232370743 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa49c016130 con 0x7fa4ac0afe50 2024-08-18T22:33:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 -- 172.21.15.5:0/3232370743 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4ac0d06c0 con 0x7fa4ac0afe50 2024-08-18T22:33:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4a3e00640 1 -- 172.21.15.5:0/3232370743 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) ==== 74+0+13227 (secure 0 0 0) 0x7fa49c0f0be0 con 0x7fa4ac0afe50 2024-08-18T22:33:25.847 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:25.847 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":196,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:33:24.489704+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/114900580":"2024-08-19T22:33:21.305141+0000","172.21.15.5:6834/114900580":"2024-08-19T22:33:21.305141+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 -- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4880678f0 msgr2=0x7fa488069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4880678f0 0x7fa488069db0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0d0520 tx=0x7fa494009040 comp rx=0 tx=0).stop 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 -- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4ac0afe50 msgr2=0x7fa4ac13e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4ac0afe50 0x7fa4ac13e060 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0ac040 tx=0x7fa49c019250 comp rx=0 tx=0).stop 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 -- 172.21.15.5:0/3232370743 shutdown_connections 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa4880678f0 0x7fa488069db0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4ac15e140 0x7fa4ac14ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4ac0b5e60 0x7fa4ac15e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 --2- 172.21.15.5:0/3232370743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4ac0afe50 0x7fa4ac13e060 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 -- 172.21.15.5:0/3232370743 >> 172.21.15.5:0/3232370743 conn(0x7fa4ac06b9b0 msgr2=0x7fa4ac15bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 -- 172.21.15.5:0/3232370743 shutdown_connections 2024-08-18T22:33:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:25.850+0000 7fa4b2600640 1 -- 172.21.15.5:0/3232370743 wait complete. 2024-08-18T22:33:25.869 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:19:07.674256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-18T22:33:25.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T22:33:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.014+0000 7fbefe200640 1 Processor -- start 2024-08-18T22:33:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.014+0000 7fbefe200640 1 -- start start 2024-08-18T22:33:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefe200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbef806d0d0 0x7fbef80cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefe200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef80b5380 0x7fbef80cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefe200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef80ce240 con 0x7fbef815ae40 2024-08-18T22:33:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefe200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbef80ce010 con 0x7fbef806d0d0 2024-08-18T22:33:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefe200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbef80b58f0 con 0x7fbef80b5380 2024-08-18T22:33:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefd800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef80b5380 0x7fbef80cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefd800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef80b5380 0x7fbef80cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:55970/0 (socket says 172.21.15.5:55970) 2024-08-18T22:33:26.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefd800640 1 -- 172.21.15.5:0/1697569629 learned_addr learned my addr 172.21.15.5:0/1697569629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbef7e00640 1 --2- 172.21.15.5:0/1697569629 >> v2:172.21.15.117:3300/0 conn(0x7fbef806d0d0 0x7fbef80cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefce00640 1 --1- 172.21.15.5:0/1697569629 >> v1:172.21.15.117:6789/0 conn(0x7fbef815ae40 0x7fbef806c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:34152/0 (socket says 172.21.15.5:34152) 2024-08-18T22:33:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefd800640 1 -- 172.21.15.5:0/1697569629 >> v2:172.21.15.117:3300/0 conn(0x7fbef806d0d0 msgr2=0x7fbef80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefd800640 1 --2- 172.21.15.5:0/1697569629 >> v2:172.21.15.117:3300/0 conn(0x7fbef806d0d0 0x7fbef80cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefd800640 1 -- 172.21.15.5:0/1697569629 >> v1:172.21.15.117:6789/0 conn(0x7fbef815ae40 legacy=0x7fbef806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbefd800640 1 -- 172.21.15.5:0/1697569629 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef80ce520 con 0x7fbef80b5380 2024-08-18T22:33:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.018+0000 7fbef7400640 1 -- 172.21.15.5:0/1697569629 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963785460 0 0) 0x7fbef80ce240 con 0x7fbef815ae40 2024-08-18T22:33:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbefd800640 1 --2- 172.21.15.5:0/1697569629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef80b5380 0x7fbef80cf540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009870 tx=0x7fbef001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=852fa70be2437ffb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbef7400640 1 -- 172.21.15.5:0/1697569629 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00aa600 con 0x7fbef80b5380 2024-08-18T22:33:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbef7400640 1 -- 172.21.15.5:0/1697569629 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef00af070 con 0x7fbef80b5380 2024-08-18T22:33:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbef7400640 1 -- 172.21.15.5:0/1697569629 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00aa9c0 con 0x7fbef80b5380 2024-08-18T22:33:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbefe200640 1 -- 172.21.15.5:0/1697569629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef80b5380 msgr2=0x7fbef80cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbefe200640 1 --2- 172.21.15.5:0/1697569629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef80b5380 0x7fbef80cf540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009870 tx=0x7fbef001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbefe200640 1 -- 172.21.15.5:0/1697569629 shutdown_connections 2024-08-18T22:33:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbefe200640 1 --2- 172.21.15.5:0/1697569629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef80b5380 0x7fbef80cf540 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbefe200640 1 --2- 172.21.15.5:0/1697569629 >> v2:172.21.15.117:3300/0 conn(0x7fbef806d0d0 0x7fbef80cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbefe200640 1 -- 172.21.15.5:0/1697569629 >> 172.21.15.5:0/1697569629 conn(0x7fbef8072130 msgr2=0x7fbef8072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbefe200640 1 -- 172.21.15.5:0/1697569629 shutdown_connections 2024-08-18T22:33:26.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbefe200640 1 -- 172.21.15.5:0/1697569629 wait complete. 2024-08-18T22:33:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbefe200640 1 Processor -- start 2024-08-18T22:33:26.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.022+0000 7fbefe200640 1 -- start start 2024-08-18T22:33:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefe200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef806d0d0 0x7fbef814eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefe200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef80b5380 0x7fbef8150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefe200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbef815ae40 0x7fbef81fad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefe200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8072e60 con 0x7fbef815ae40 2024-08-18T22:33:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefe200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8072ce0 con 0x7fbef80b5380 2024-08-18T22:33:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefe200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbef80b3860 con 0x7fbef806d0d0 2024-08-18T22:33:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbef815ae40 0x7fbef81fad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefd800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbef815ae40 0x7fbef81fad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58082/0 (socket says 172.21.15.5:58082) 2024-08-18T22:33:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefd800640 1 -- 172.21.15.5:0/2581773680 learned_addr learned my addr 172.21.15.5:0/2581773680 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefce00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef806d0d0 0x7fbef814eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbef7e00640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef80b5380 0x7fbef8150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefd800640 1 -- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef806d0d0 msgr2=0x7fbef814eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefd800640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef806d0d0 0x7fbef814eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefd800640 1 -- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef80b5380 msgr2=0x7fbef8150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefd800640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef80b5380 0x7fbef8150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefd800640 1 -- 172.21.15.5:0/2581773680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef8153b70 con 0x7fbef815ae40 2024-08-18T22:33:26.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefd800640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbef815ae40 0x7fbef81fad70 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fbef001a0d0 tx=0x7fbef001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbef4c00640 1 -- 172.21.15.5:0/2581773680 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00bd5f0 con 0x7fbef815ae40 2024-08-18T22:33:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefe200640 1 -- 172.21.15.5:0/2581773680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef8153e10 con 0x7fbef815ae40 2024-08-18T22:33:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbef4c00640 1 -- 172.21.15.5:0/2581773680 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef00bd790 con 0x7fbef815ae40 2024-08-18T22:33:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbef4c00640 1 -- 172.21.15.5:0/2581773680 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00bdb40 con 0x7fbef815ae40 2024-08-18T22:33:26.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefe200640 1 -- 172.21.15.5:0/2581773680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef8157190 con 0x7fbef815ae40 2024-08-18T22:33:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.026+0000 7fbefe200640 1 -- 172.21.15.5:0/2581773680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef806c9c0 con 0x7fbef815ae40 2024-08-18T22:33:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.030+0000 7fbef4c00640 1 -- 172.21.15.5:0/2581773680 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbef00a9070 con 0x7fbef815ae40 2024-08-18T22:33:26.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.030+0000 7fbef4c00640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbed80678f0 0x7fbed8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.030+0000 7fbef4c00640 1 -- 172.21.15.5:0/2581773680 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7fbef0120450 con 0x7fbef815ae40 2024-08-18T22:33:26.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.030+0000 7fbefce00640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbed80678f0 0x7fbed8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.030+0000 7fbefce00640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbed80678f0 0x7fbed8069db0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fbee80012f0 tx=0x7fbee8001690 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:26.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.034+0000 7fbef4c00640 1 -- 172.21.15.5:0/2581773680 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbef0016150 con 0x7fbef815ae40 2024-08-18T22:33:26.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.198+0000 7fbefe200640 1 -- 172.21.15.5:0/2581773680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbef80d04d0 con 0x7fbef815ae40 2024-08-18T22:33:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.198+0000 7fbef4c00640 1 -- 172.21.15.5:0/2581773680 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v196) ==== 93+0+10 (secure 0 0 0) 0x7fbef00f0a20 con 0x7fbef815ae40 2024-08-18T22:33:26.197 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-18T22:33:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 -- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbed80678f0 msgr2=0x7fbed8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbed80678f0 0x7fbed8069db0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fbee80012f0 tx=0x7fbee8001690 comp rx=0 tx=0).stop 2024-08-18T22:33:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 -- 172.21.15.5:0/2581773680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbef815ae40 msgr2=0x7fbef81fad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbef815ae40 0x7fbef81fad70 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fbef001a0d0 tx=0x7fbef001ace0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 -- 172.21.15.5:0/2581773680 shutdown_connections 2024-08-18T22:33:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbed80678f0 0x7fbed8069db0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbef815ae40 0x7fbef81fad70 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbef80b5380 0x7fbef8150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 --2- 172.21.15.5:0/2581773680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbef806d0d0 0x7fbef814eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 -- 172.21.15.5:0/2581773680 >> 172.21.15.5:0/2581773680 conn(0x7fbef8072130 msgr2=0x7fbef80b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 -- 172.21.15.5:0/2581773680 shutdown_connections 2024-08-18T22:33:26.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.202+0000 7fbefe200640 1 -- 172.21.15.5:0/2581773680 wait complete. 2024-08-18T22:33:26.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-08-18T22:33:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa624a00640 1 Processor -- start 2024-08-18T22:33:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa624a00640 1 -- start start 2024-08-18T22:33:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa624a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6200ce840 0x7fa6200cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa624a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6200cee20 con 0x7fa62006f290 2024-08-18T22:33:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa624a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6200cf100 con 0x7fa62015b010 2024-08-18T22:33:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa624a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa6200cd8e0 con 0x7fa6200ce840 2024-08-18T22:33:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa61e800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6200ce840 0x7fa6200cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa61d400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa62006f290 0x7fa620072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36320/0 (socket says 172.21.15.5:36320) 2024-08-18T22:33:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa61d400640 1 -- 172.21.15.5:0/2596768239 learned_addr learned my addr 172.21.15.5:0/2596768239 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa61e800640 1 -- 172.21.15.5:0/2596768239 >> v1:172.21.15.117:6789/0 conn(0x7fa62015b010 legacy=0x7fa62006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa61e800640 1 -- 172.21.15.5:0/2596768239 >> v1:172.21.15.5:6789/0 conn(0x7fa62006f290 legacy=0x7fa620072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa61ca00640 1 -- 172.21.15.5:0/2596768239 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029844215 0 0) 0x7fa6200cee20 con 0x7fa62006f290 2024-08-18T22:33:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.362+0000 7fa61e800640 1 -- 172.21.15.5:0/2596768239 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6200cf3e0 con 0x7fa6200ce840 2024-08-18T22:33:26.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa61e800640 1 --2- 172.21.15.5:0/2596768239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6200ce840 0x7fa6200cd3a0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7fa618009d90 tx=0x7fa61801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fba4107fb4333f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:26.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa61ca00640 1 -- 172.21.15.5:0/2596768239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6180b2070 con 0x7fa6200ce840 2024-08-18T22:33:26.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa61ca00640 1 -- 172.21.15.5:0/2596768239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6180a57b0 con 0x7fa6200ce840 2024-08-18T22:33:26.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa61ca00640 1 -- 172.21.15.5:0/2596768239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6180a5b80 con 0x7fa6200ce840 2024-08-18T22:33:26.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa624a00640 1 -- 172.21.15.5:0/2596768239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6200ce840 msgr2=0x7fa6200cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa624a00640 1 --2- 172.21.15.5:0/2596768239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6200ce840 0x7fa6200cd3a0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7fa618009d90 tx=0x7fa61801c8e0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa624a00640 1 -- 172.21.15.5:0/2596768239 shutdown_connections 2024-08-18T22:33:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa624a00640 1 --2- 172.21.15.5:0/2596768239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6200ce840 0x7fa6200cd3a0 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa624a00640 1 -- 172.21.15.5:0/2596768239 >> 172.21.15.5:0/2596768239 conn(0x7fa6200b1c50 msgr2=0x7fa6200b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa624a00640 1 -- 172.21.15.5:0/2596768239 shutdown_connections 2024-08-18T22:33:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa624a00640 1 -- 172.21.15.5:0/2596768239 wait complete. 2024-08-18T22:33:26.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa624a00640 1 Processor -- start 2024-08-18T22:33:26.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.366+0000 7fa624a00640 1 -- start start 2024-08-18T22:33:26.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa624a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62006f290 0x7fa620150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa624a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6200ce840 0x7fa6201519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa624a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa62015b010 0x7fa620154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa624a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa6200738d0 con 0x7fa62006f290 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa624a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa620073750 con 0x7fa6200ce840 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa624a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa620168c60 con 0x7fa62015b010 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62006f290 0x7fa620150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62006f290 0x7fa620150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58090/0 (socket says 172.21.15.5:58090) 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61de00640 1 -- 172.21.15.5:0/3449259877 learned_addr learned my addr 172.21.15.5:0/3449259877 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61e800640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa62015b010 0x7fa620154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61d400640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6200ce840 0x7fa6201519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61de00640 1 -- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa62015b010 msgr2=0x7fa620154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61de00640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa62015b010 0x7fa620154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61de00640 1 -- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6200ce840 msgr2=0x7fa6201519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61de00640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6200ce840 0x7fa6201519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61de00640 1 -- 172.21.15.5:0/3449259877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa620152310 con 0x7fa62006f290 2024-08-18T22:33:26.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61d400640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6200ce840 0x7fa6201519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:26.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa61de00640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62006f290 0x7fa620150490 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c530 tx=0x7fa61000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:26.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa616000640 1 -- 172.21.15.5:0/3449259877 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa610016020 con 0x7fa62006f290 2024-08-18T22:33:26.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa616000640 1 -- 172.21.15.5:0/3449259877 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa610005220 con 0x7fa62006f290 2024-08-18T22:33:26.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa616000640 1 -- 172.21.15.5:0/3449259877 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa610007030 con 0x7fa62006f290 2024-08-18T22:33:26.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa624a00640 1 -- 172.21.15.5:0/3449259877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6201525f0 con 0x7fa62006f290 2024-08-18T22:33:26.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa624a00640 1 -- 172.21.15.5:0/3449259877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa620152bb0 con 0x7fa62006f290 2024-08-18T22:33:26.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.370+0000 7fa624a00640 1 -- 172.21.15.5:0/3449259877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6200cd3a0 con 0x7fa62006f290 2024-08-18T22:33:26.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.374+0000 7fa616000640 1 -- 172.21.15.5:0/3449259877 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6100071d0 con 0x7fa62006f290 2024-08-18T22:33:26.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.374+0000 7fa616000640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6000678c0 0x7fa600069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.374+0000 7fa616000640 1 -- 172.21.15.5:0/3449259877 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7fa6100854e0 con 0x7fa62006f290 2024-08-18T22:33:26.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.374+0000 7fa61d400640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6000678c0 0x7fa600069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.374+0000 7fa61d400640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6000678c0 0x7fa600069d80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa620158020 tx=0x7fa60c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:26.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.378+0000 7fa616000640 1 -- 172.21.15.5:0/3449259877 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa610020020 con 0x7fa62006f290 2024-08-18T22:33:26.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:26.598+0000 7fa624a00640 1 -- 172.21.15.5:0/3449259877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7fa620157d70 con 0x7fa62006f290 2024-08-18T22:33:27.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.506+0000 7fa616000640 1 -- 172.21.15.5:0/3449259877 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v665) ==== 136+0+0 (secure 0 0 0) 0x7fa6100074c0 con 0x7fa62006f290 2024-08-18T22:33:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 -- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6000678c0 msgr2=0x7fa600069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6000678c0 0x7fa600069d80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa620158020 tx=0x7fa60c009040 comp rx=0 tx=0).stop 2024-08-18T22:33:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 -- 172.21.15.5:0/3449259877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62006f290 msgr2=0x7fa620150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62006f290 0x7fa620150490 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c530 tx=0x7fa61000c9f0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 -- 172.21.15.5:0/3449259877 shutdown_connections 2024-08-18T22:33:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa6000678c0 0x7fa600069d80 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa62015b010 0x7fa620154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6200ce840 0x7fa6201519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 --2- 172.21.15.5:0/3449259877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa62006f290 0x7fa620150490 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 -- 172.21.15.5:0/3449259877 >> 172.21.15.5:0/3449259877 conn(0x7fa6200b1c50 msgr2=0x7fa6200c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 -- 172.21.15.5:0/3449259877 shutdown_connections 2024-08-18T22:33:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.510+0000 7fa624a00640 1 -- 172.21.15.5:0/3449259877 wait complete. 2024-08-18T22:33:27.531 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T22:33:27.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.682+0000 7f0aa0200640 1 Processor -- start 2024-08-18T22:33:27.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.682+0000 7f0aa0200640 1 -- start start 2024-08-18T22:33:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.682+0000 7f0aa0200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9815c560 0x7f0a980ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.682+0000 7f0aa0200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a9815d4d0 0x7f0a9806db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.682+0000 7f0aa0200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a980cfb00 con 0x7f0a9815c180 2024-08-18T22:33:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.682+0000 7f0aa0200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9815d040 con 0x7f0a9815d4d0 2024-08-18T22:33:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.682+0000 7f0aa0200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9815c9f0 con 0x7f0a9815c560 2024-08-18T22:33:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.682+0000 7f0a9e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a9815d4d0 0x7f0a9806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.682+0000 7f0a9e200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a9815d4d0 0x7f0a9806db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58106/0 (socket says 172.21.15.5:58106) 2024-08-18T22:33:27.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.682+0000 7f0a9e200640 1 -- 172.21.15.5:0/146197574 learned_addr learned my addr 172.21.15.5:0/146197574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0a9ce00640 1 --2- 172.21.15.5:0/146197574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9815c560 0x7f0a980ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0a9e200640 1 -- 172.21.15.5:0/146197574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9815c560 msgr2=0x7f0a980ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0a9e200640 1 --2- 172.21.15.5:0/146197574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9815c560 0x7f0a980ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0a9e200640 1 -- 172.21.15.5:0/146197574 >> v1:172.21.15.117:6789/0 conn(0x7f0a9815c180 legacy=0x7f0a980cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0a9e200640 1 -- 172.21.15.5:0/146197574 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9815ccd0 con 0x7f0a9815d4d0 2024-08-18T22:33:27.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0a9ce00640 1 --2- 172.21.15.5:0/146197574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9815c560 0x7f0a980ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:27.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0a9e200640 1 --2- 172.21.15.5:0/146197574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a9815d4d0 0x7f0a9806db80 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009e50 tx=0x7f0a9001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0195edde31f467 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0a97e00640 1 -- 172.21.15.5:0/146197574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900a5800 con 0x7f0a9815d4d0 2024-08-18T22:33:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0a97e00640 1 -- 172.21.15.5:0/146197574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a980ced70 con 0x7f0a9815d4d0 2024-08-18T22:33:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0a97e00640 1 -- 172.21.15.5:0/146197574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900a5bc0 con 0x7f0a9815d4d0 2024-08-18T22:33:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0aa0200640 1 -- 172.21.15.5:0/146197574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a9815d4d0 msgr2=0x7f0a9806db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0aa0200640 1 --2- 172.21.15.5:0/146197574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a9815d4d0 0x7f0a9806db80 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009e50 tx=0x7f0a9001c960 comp rx=0 tx=0).stop 2024-08-18T22:33:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0aa0200640 1 -- 172.21.15.5:0/146197574 shutdown_connections 2024-08-18T22:33:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0aa0200640 1 --2- 172.21.15.5:0/146197574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a9815d4d0 0x7f0a9806db80 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.686+0000 7f0aa0200640 1 --2- 172.21.15.5:0/146197574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9815c560 0x7f0a980ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 -- 172.21.15.5:0/146197574 >> 172.21.15.5:0/146197574 conn(0x7f0a980b1dc0 msgr2=0x7f0a980b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 -- 172.21.15.5:0/146197574 shutdown_connections 2024-08-18T22:33:27.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 -- 172.21.15.5:0/146197574 wait complete. 2024-08-18T22:33:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 Processor -- start 2024-08-18T22:33:27.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 -- start start 2024-08-18T22:33:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9815c180 0x7f0a980adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:27.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a9815d4d0 0x7f0a98155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a98150780 0x7f0a98154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0a981692b0 con 0x7f0a98150780 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0a98169130 con 0x7f0a9815d4d0 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0a98169430 con 0x7f0a9815c180 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a9e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a98150780 0x7f0a98154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a9e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a98150780 0x7f0a98154e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58110/0 (socket says 172.21.15.5:58110) 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a9e200640 1 -- 172.21.15.5:0/3210899458 learned_addr learned my addr 172.21.15.5:0/3210899458 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a9ce00640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a9815d4d0 0x7f0a98155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a9d800640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9815c180 0x7f0a980adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a9e200640 1 -- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9815c180 msgr2=0x7f0a980adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a9e200640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9815c180 0x7f0a980adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a9e200640 1 -- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a9815d4d0 msgr2=0x7f0a98155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:27.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a9e200640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a9815d4d0 0x7f0a98155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a9e200640 1 -- 172.21.15.5:0/3210899458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a98151270 con 0x7f0a98150780 2024-08-18T22:33:27.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a9e200640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a98150780 0x7f0a98154e60 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009e50 tx=0x7f0a90019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:27.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a95600640 1 -- 172.21.15.5:0/3210899458 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900bc020 con 0x7f0a98150780 2024-08-18T22:33:27.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a95600640 1 -- 172.21.15.5:0/3210899458 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a900b8670 con 0x7f0a98150780 2024-08-18T22:33:27.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0a95600640 1 -- 172.21.15.5:0/3210899458 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a900b8a60 con 0x7f0a98150780 2024-08-18T22:33:27.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 -- 172.21.15.5:0/3210899458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a98153dc0 con 0x7f0a98150780 2024-08-18T22:33:27.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.690+0000 7f0aa0200640 1 -- 172.21.15.5:0/3210899458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a98154380 con 0x7f0a98150780 2024-08-18T22:33:27.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.694+0000 7f0aa0200640 1 -- 172.21.15.5:0/3210899458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9809c6a0 con 0x7f0a98150780 2024-08-18T22:33:27.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.694+0000 7f0a95600640 1 -- 172.21.15.5:0/3210899458 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a900bf020 con 0x7f0a98150780 2024-08-18T22:33:27.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.694+0000 7f0a95600640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a780678c0 0x7f0a78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:27.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.694+0000 7f0a95600640 1 -- 172.21.15.5:0/3210899458 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f0a90120bf0 con 0x7f0a98150780 2024-08-18T22:33:27.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.694+0000 7f0a9d800640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a780678c0 0x7f0a78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:27.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.694+0000 7f0a9d800640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a780678c0 0x7f0a78069d80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0a9809bd70 tx=0x7f0a8c007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:27.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.698+0000 7f0a95600640 1 -- 172.21.15.5:0/3210899458 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0a900c6030 con 0x7f0a98150780 2024-08-18T22:33:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.862+0000 7f0aa0200640 1 -- 172.21.15.5:0/3210899458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0a9806db00 con 0x7f0a98150780 2024-08-18T22:33:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.866+0000 7f0a95600640 1 -- 172.21.15.5:0/3210899458 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f0a900165e0 con 0x7f0a98150780 2024-08-18T22:33:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 -- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a780678c0 msgr2=0x7f0a78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a780678c0 0x7f0a78069d80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0a9809bd70 tx=0x7f0a8c007e40 comp rx=0 tx=0).stop 2024-08-18T22:33:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 -- 172.21.15.5:0/3210899458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a98150780 msgr2=0x7f0a98154e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a98150780 0x7f0a98154e60 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009e50 tx=0x7f0a90019700 comp rx=0 tx=0).stop 2024-08-18T22:33:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 -- 172.21.15.5:0/3210899458 shutdown_connections 2024-08-18T22:33:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0a780678c0 0x7f0a78069d80 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a98150780 0x7f0a98154e60 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a9815d4d0 0x7f0a98155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 --2- 172.21.15.5:0/3210899458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9815c180 0x7f0a980adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 -- 172.21.15.5:0/3210899458 >> 172.21.15.5:0/3210899458 conn(0x7f0a980b1dc0 msgr2=0x7f0a980cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 -- 172.21.15.5:0/3210899458 shutdown_connections 2024-08-18T22:33:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:27.870+0000 7f0aa0200640 1 -- 172.21.15.5:0/3210899458 wait complete. 2024-08-18T22:33:27.886 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:33:27.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:33:27.980 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:33:28.059 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:33:28.059 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:33:28.059 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:33:28.067 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:33:28.068 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:33:28.068 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:33:28.077 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:33:28.077 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:33:28.077 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:33:28.121 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:33:28.121 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:33:28.121 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:33:28.130 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:33:28.130 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T22:33:28.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:33:28.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb28a00640 1 Processor -- start 2024-08-18T22:33:28.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb28a00640 1 -- start start 2024-08-18T22:33:28.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb28a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb2415c180 0x7fdb240b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb28a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb2406fad0 0x7fdb2415c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb28a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb24071580 0x7fdb24071a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb28a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdb2415caa0 con 0x7fdb2415c180 2024-08-18T22:33:28.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb28a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdb240b5e30 con 0x7fdb24071580 2024-08-18T22:33:28.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb28a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdb240b6110 con 0x7fdb2406fad0 2024-08-18T22:33:28.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb21e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb2415c180 0x7fdb240b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb21e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb2415c180 0x7fdb240b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58120/0 (socket says 172.21.15.5:58120) 2024-08-18T22:33:28.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb21e00640 1 -- 172.21.15.5:0/125609017 learned_addr learned my addr 172.21.15.5:0/125609017 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb21e00640 1 -- 172.21.15.5:0/125609017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb2406fad0 msgr2=0x7fdb2415c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb21e00640 1 --2- 172.21.15.5:0/125609017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb2406fad0 0x7fdb2415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb21e00640 1 -- 172.21.15.5:0/125609017 >> v2:172.21.15.117:3300/0 conn(0x7fdb24071580 msgr2=0x7fdb24071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb21e00640 1 --2- 172.21.15.5:0/125609017 >> v2:172.21.15.117:3300/0 conn(0x7fdb24071580 0x7fdb24071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.310+0000 7fdb21e00640 1 -- 172.21.15.5:0/125609017 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb240b63f0 con 0x7fdb2415c180 2024-08-18T22:33:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb21e00640 1 --2- 172.21.15.5:0/125609017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2415c180 0x7fdb240b57c0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fdb24160cd0 tx=0x7fdb1401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5635f78989464946 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:28.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb21400640 1 -- 172.21.15.5:0/125609017 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb140b0070 con 0x7fdb2415c180 2024-08-18T22:33:28.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb21400640 1 -- 172.21.15.5:0/125609017 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb140ab600 con 0x7fdb2415c180 2024-08-18T22:33:28.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb21400640 1 -- 172.21.15.5:0/125609017 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb140ab9d0 con 0x7fdb2415c180 2024-08-18T22:33:28.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb28a00640 1 -- 172.21.15.5:0/125609017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2415c180 msgr2=0x7fdb240b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb28a00640 1 --2- 172.21.15.5:0/125609017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2415c180 0x7fdb240b57c0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fdb24160cd0 tx=0x7fdb1401c400 comp rx=0 tx=0).stop 2024-08-18T22:33:28.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb28a00640 1 -- 172.21.15.5:0/125609017 shutdown_connections 2024-08-18T22:33:28.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb28a00640 1 --2- 172.21.15.5:0/125609017 >> v2:172.21.15.117:3300/0 conn(0x7fdb24071580 0x7fdb24071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb28a00640 1 --2- 172.21.15.5:0/125609017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb2406fad0 0x7fdb2415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb28a00640 1 --2- 172.21.15.5:0/125609017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2415c180 0x7fdb240b57c0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb28a00640 1 -- 172.21.15.5:0/125609017 >> 172.21.15.5:0/125609017 conn(0x7fdb240b3eb0 msgr2=0x7fdb240b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:28.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb28a00640 1 -- 172.21.15.5:0/125609017 shutdown_connections 2024-08-18T22:33:28.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb28a00640 1 -- 172.21.15.5:0/125609017 wait complete. 2024-08-18T22:33:28.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.314+0000 7fdb28a00640 1 Processor -- start 2024-08-18T22:33:28.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb28a00640 1 -- start start 2024-08-18T22:33:28.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb28a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb2406fad0 0x7fdb24140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb28a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb24071580 0x7fdb241f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb28a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb2415c180 0x7fdb2414da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb28a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdb240d1c30 con 0x7fdb24071580 2024-08-18T22:33:28.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb28a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdb240d1ab0 con 0x7fdb2415c180 2024-08-18T22:33:28.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb28a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fdb240d1db0 con 0x7fdb2406fad0 2024-08-18T22:33:28.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb19400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb24071580 0x7fdb241f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb19400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb24071580 0x7fdb241f6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58136/0 (socket says 172.21.15.5:58136) 2024-08-18T22:33:28.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb19400640 1 -- 172.21.15.5:0/439875922 learned_addr learned my addr 172.21.15.5:0/439875922 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:28.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb21e00640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb2406fad0 0x7fdb24140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb22800640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb2415c180 0x7fdb2414da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb19400640 1 -- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb2406fad0 msgr2=0x7fdb24140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb19400640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb2406fad0 0x7fdb24140d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb19400640 1 -- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb2415c180 msgr2=0x7fdb2414da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb19400640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb2415c180 0x7fdb2414da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb19400640 1 -- 172.21.15.5:0/439875922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb241518c0 con 0x7fdb24071580 2024-08-18T22:33:28.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb19400640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb24071580 0x7fdb241f6f20 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00ba50 tx=0x7fdb0c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:28.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb1aa00640 1 -- 172.21.15.5:0/439875922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c019070 con 0x7fdb24071580 2024-08-18T22:33:28.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb1aa00640 1 -- 172.21.15.5:0/439875922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0c00cc00 con 0x7fdb24071580 2024-08-18T22:33:28.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb1aa00640 1 -- 172.21.15.5:0/439875922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c014440 con 0x7fdb24071580 2024-08-18T22:33:28.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb28a00640 1 -- 172.21.15.5:0/439875922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2415d8e0 con 0x7fdb24071580 2024-08-18T22:33:28.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb28a00640 1 -- 172.21.15.5:0/439875922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb24151450 con 0x7fdb24071580 2024-08-18T22:33:28.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.318+0000 7fdb28a00640 1 -- 172.21.15.5:0/439875922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2415c560 con 0x7fdb24071580 2024-08-18T22:33:28.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.322+0000 7fdb1aa00640 1 -- 172.21.15.5:0/439875922 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdb0c01c070 con 0x7fdb24071580 2024-08-18T22:33:28.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.322+0000 7fdb1aa00640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdb000678c0 0x7fdb00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.322+0000 7fdb1aa00640 1 -- 172.21.15.5:0/439875922 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7fdb0c085830 con 0x7fdb24071580 2024-08-18T22:33:28.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.322+0000 7fdb21e00640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdb000678c0 0x7fdb00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.322+0000 7fdb21e00640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdb000678c0 0x7fdb00069d80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fdb140ad000 tx=0x7fdb140a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:28.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.326+0000 7fdb1aa00640 1 -- 172.21.15.5:0/439875922 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fdb0c055e80 con 0x7fdb24071580 2024-08-18T22:33:28.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.522+0000 7fdb28a00640 1 -- 172.21.15.5:0/439875922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb240cf7d0 con 0x7fdb24071580 2024-08-18T22:33:28.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.522+0000 7fdb1aa00640 1 -- 172.21.15.5:0/439875922 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) ==== 95+0+3911 (secure 0 0 0) 0x7fdb0c05a180 con 0x7fdb24071580 2024-08-18T22:33:28.520 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:28.520 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":153,"btime":"2024-08-18T22:33:22:307259+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/983387831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":983387831},{"type":"v1","addr":"172.21.15.5:6833","nonce":983387831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2495123422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2495123422},{"type":"v1","addr":"172.21.15.117:6836","nonce":2495123422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/53072457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":53072457},{"type":"v1","addr":"172.21.15.117:6837","nonce":53072457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10662,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3070412746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3070412746},{"type":"v1","addr":"172.21.15.5:6835","nonce":3070412746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":153}],"filesystems":[]} 2024-08-18T22:33:28.521 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 153 2024-08-18T22:33:28.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 -- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdb000678c0 msgr2=0x7fdb00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdb000678c0 0x7fdb00069d80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fdb140ad000 tx=0x7fdb140a6000 comp rx=0 tx=0).stop 2024-08-18T22:33:28.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 -- 172.21.15.5:0/439875922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb24071580 msgr2=0x7fdb241f6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb24071580 0x7fdb241f6f20 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00ba50 tx=0x7fdb0c00bf10 comp rx=0 tx=0).stop 2024-08-18T22:33:28.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 -- 172.21.15.5:0/439875922 shutdown_connections 2024-08-18T22:33:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fdb000678c0 0x7fdb00069d80 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb2415c180 0x7fdb2414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb24071580 0x7fdb241f6f20 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 --2- 172.21.15.5:0/439875922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb2406fad0 0x7fdb24140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 -- 172.21.15.5:0/439875922 >> 172.21.15.5:0/439875922 conn(0x7fdb240b3eb0 msgr2=0x7fdb24165ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 -- 172.21.15.5:0/439875922 shutdown_connections 2024-08-18T22:33:28.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.526+0000 7fdb28a00640 1 -- 172.21.15.5:0/439875922 wait complete. 2024-08-18T22:33:28.541 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T22:33:28.541 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T22:33:28.541 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:33:28.542 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:33:28.542 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T22:33:28.542 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T22:33:28.542 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:33:28.542 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:33:28.542 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T22:33:28.542 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T22:33:28.543 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:33:28.543 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:33:28.543 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T22:33:28.543 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T22:33:28.543 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:33:28.543 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:33:28.554 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:33:28.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T22:33:28.556 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:33:28.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T22:33:28.558 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:33:28.558 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T22:33:28.558 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:33:28.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T22:33:28.599 INFO:tasks.ceph.mds.a:Started 2024-08-18T22:33:28.599 DEBUG:teuthology.parallel:result is None 2024-08-18T22:33:28.601 INFO:tasks.ceph.mds.c:Started 2024-08-18T22:33:28.601 DEBUG:teuthology.parallel:result is None 2024-08-18T22:33:28.603 INFO:tasks.ceph.mds.b:Started 2024-08-18T22:33:28.603 DEBUG:teuthology.parallel:result is None 2024-08-18T22:33:28.604 INFO:tasks.ceph.mds.d:Started 2024-08-18T22:33:28.604 DEBUG:teuthology.parallel:result is None 2024-08-18T22:33:28.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T22:33:28.687 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2024-08-18T22:33:28.688 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-08-18T22:33:28.692 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-08-18T22:33:28.692 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:33:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.754+0000 7f5f96400640 1 Processor -- start 2024-08-18T22:33:28.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.754+0000 7f5f96400640 1 -- start start 2024-08-18T22:33:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f96400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f9015e060 0x7f5f90071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f96400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f9006eae0 con 0x7f5f900b55f0 2024-08-18T22:33:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f96400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f90071440 con 0x7f5f900b3fe0 2024-08-18T22:33:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f96400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5f9006e800 con 0x7f5f9015e060 2024-08-18T22:33:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f95000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f9015e060 0x7f5f90071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f95000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f9015e060 0x7f5f90071ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58174/0 (socket says 172.21.15.5:58174) 2024-08-18T22:33:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f95a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5f900b55f0 0x7f5f9006da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36340/0 (socket says 172.21.15.5:36340) 2024-08-18T22:33:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f95000640 1 -- 172.21.15.5:0/3982356251 learned_addr learned my addr 172.21.15.5:0/3982356251 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f95000640 1 -- 172.21.15.5:0/3982356251 >> v1:172.21.15.117:6789/0 conn(0x7f5f900b3fe0 legacy=0x7f5f900b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f95000640 1 -- 172.21.15.5:0/3982356251 >> v1:172.21.15.5:6789/0 conn(0x7f5f900b55f0 legacy=0x7f5f9006da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f95000640 1 -- 172.21.15.5:0/3982356251 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f900716e0 con 0x7f5f9015e060 2024-08-18T22:33:28.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.758+0000 7f5f8fe00640 1 -- 172.21.15.5:0/3982356251 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607393248 0 0) 0x7f5f9006eae0 con 0x7f5f900b55f0 2024-08-18T22:33:28.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f95000640 1 --2- 172.21.15.5:0/3982356251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9015e060 0x7f5f90071ee0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009870 tx=0x7f5f8001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a75a6e5baa7c88 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:28.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f8fe00640 1 -- 172.21.15.5:0/3982356251 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800aa610 con 0x7f5f9015e060 2024-08-18T22:33:28.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f8fe00640 1 -- 172.21.15.5:0/3982356251 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f800af070 con 0x7f5f9015e060 2024-08-18T22:33:28.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f8fe00640 1 -- 172.21.15.5:0/3982356251 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800aa9d0 con 0x7f5f9015e060 2024-08-18T22:33:28.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 -- 172.21.15.5:0/3982356251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9015e060 msgr2=0x7f5f90071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 --2- 172.21.15.5:0/3982356251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9015e060 0x7f5f90071ee0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009870 tx=0x7f5f8001c490 comp rx=0 tx=0).stop 2024-08-18T22:33:28.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 -- 172.21.15.5:0/3982356251 shutdown_connections 2024-08-18T22:33:28.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 --2- 172.21.15.5:0/3982356251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9015e060 0x7f5f90071ee0 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 -- 172.21.15.5:0/3982356251 >> 172.21.15.5:0/3982356251 conn(0x7f5f90067a70 msgr2=0x7f5f90067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:28.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 -- 172.21.15.5:0/3982356251 shutdown_connections 2024-08-18T22:33:28.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 -- 172.21.15.5:0/3982356251 wait complete. 2024-08-18T22:33:28.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 Processor -- start 2024-08-18T22:33:28.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 -- start start 2024-08-18T22:33:28.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f900b3fe0 0x7f5f90161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f900b55f0 0x7f5f90156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f9015e060 0x7f5f90157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5f90072420 con 0x7f5f900b3fe0 2024-08-18T22:33:28.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9006e580 con 0x7f5f9015e060 2024-08-18T22:33:28.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.762+0000 7f5f96400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9016c500 con 0x7f5f900b55f0 2024-08-18T22:33:28.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f95000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f900b3fe0 0x7f5f90161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f95000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f900b3fe0 0x7f5f90161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58186/0 (socket says 172.21.15.5:58186) 2024-08-18T22:33:28.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f95000640 1 -- 172.21.15.5:0/187726656 learned_addr learned my addr 172.21.15.5:0/187726656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:28.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f95a00640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f9015e060 0x7f5f90157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f87e00640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f900b55f0 0x7f5f90156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f95000640 1 -- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f900b55f0 msgr2=0x7f5f90156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f95000640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f900b55f0 0x7f5f90156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f95000640 1 -- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f9015e060 msgr2=0x7f5f90157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f95000640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f9015e060 0x7f5f90157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f95000640 1 -- 172.21.15.5:0/187726656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9015f290 con 0x7f5f900b3fe0 2024-08-18T22:33:28.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f95000640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f900b3fe0 0x7f5f90161100 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f5f800ac040 tx=0x7f5f8001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:28.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f8d600640 1 -- 172.21.15.5:0/187726656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800b3800 con 0x7f5f900b3fe0 2024-08-18T22:33:28.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f8d600640 1 -- 172.21.15.5:0/187726656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f800b39c0 con 0x7f5f900b3fe0 2024-08-18T22:33:28.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f96400640 1 -- 172.21.15.5:0/187726656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9015f570 con 0x7f5f900b3fe0 2024-08-18T22:33:28.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f8d600640 1 -- 172.21.15.5:0/187726656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800b3db0 con 0x7f5f900b3fe0 2024-08-18T22:33:28.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f96400640 1 -- 172.21.15.5:0/187726656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9015fb30 con 0x7f5f900b3fe0 2024-08-18T22:33:28.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f96400640 1 -- 172.21.15.5:0/187726656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f90071ee0 con 0x7f5f900b3fe0 2024-08-18T22:33:28.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.766+0000 7f5f8d600640 1 -- 172.21.15.5:0/187726656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f800c6440 con 0x7f5f900b3fe0 2024-08-18T22:33:28.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.770+0000 7f5f8d600640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f6c0678c0 0x7f5f6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.770+0000 7f5f8d600640 1 -- 172.21.15.5:0/187726656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5335+0+0 (secure 0 0 0) 0x7f5f80120370 con 0x7f5f900b3fe0 2024-08-18T22:33:28.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.770+0000 7f5f87e00640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f6c0678c0 0x7f5f6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.770+0000 7f5f87e00640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f6c0678c0 0x7f5f6c069d80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f5f900cb380 tx=0x7f5f78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:28.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.774+0000 7f5f8d600640 1 -- 172.21.15.5:0/187726656 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f5f800a7070 con 0x7f5f900b3fe0 2024-08-18T22:33:28.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:28.950+0000 7f5f96400640 1 -- 172.21.15.5:0/187726656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5f900b2d30 con 0x7f5f900b3fe0 2024-08-18T22:33:29.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f8d600640 1 -- 172.21.15.5:0/187726656 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v198) ==== 97+0+0 (secure 0 0 0) 0x7f5f80016110 con 0x7f5f900b3fe0 2024-08-18T22:33:29.522 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2024-08-18T22:33:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 -- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f6c0678c0 msgr2=0x7f5f6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f6c0678c0 0x7f5f6c069d80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f5f900cb380 tx=0x7f5f78009040 comp rx=0 tx=0).stop 2024-08-18T22:33:29.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 -- 172.21.15.5:0/187726656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f900b3fe0 msgr2=0x7f5f90161100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f900b3fe0 0x7f5f90161100 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f5f800ac040 tx=0x7f5f8001acd0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 -- 172.21.15.5:0/187726656 shutdown_connections 2024-08-18T22:33:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5f6c0678c0 0x7f5f6c069d80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f9015e060 0x7f5f90157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f900b55f0 0x7f5f90156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 --2- 172.21.15.5:0/187726656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f900b3fe0 0x7f5f90161100 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 -- 172.21.15.5:0/187726656 >> 172.21.15.5:0/187726656 conn(0x7f5f90067a70 msgr2=0x7f5f900d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 -- 172.21.15.5:0/187726656 shutdown_connections 2024-08-18T22:33:29.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.526+0000 7f5f96400640 1 -- 172.21.15.5:0/187726656 wait complete. 2024-08-18T22:33:29.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T22:33:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03b6800640 1 Processor -- start 2024-08-18T22:33:29.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03b6800640 1 -- start start 2024-08-18T22:33:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03b6800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03b00b54c0 0x7f03b0071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03b6800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f03b00cbed0 0x7f03b00cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03b6800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b0071c80 con 0x7f03b006dd80 2024-08-18T22:33:29.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03b6800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f03b00cba40 con 0x7f03b00b54c0 2024-08-18T22:33:29.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03b6800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f03b0071f60 con 0x7f03b00cbed0 2024-08-18T22:33:29.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03af400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03b00b54c0 0x7f03b0071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:29.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03af400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03b00b54c0 0x7f03b0071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58196/0 (socket says 172.21.15.5:58196) 2024-08-18T22:33:29.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03af400640 1 -- 172.21.15.5:0/3969304363 learned_addr learned my addr 172.21.15.5:0/3969304363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:29.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03afe00640 1 --2- 172.21.15.5:0/3969304363 >> v2:172.21.15.117:3300/0 conn(0x7f03b00cbed0 0x7f03b00cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:29.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03af400640 1 -- 172.21.15.5:0/3969304363 >> v2:172.21.15.117:3300/0 conn(0x7f03b00cbed0 msgr2=0x7f03b00cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03af400640 1 --2- 172.21.15.5:0/3969304363 >> v2:172.21.15.117:3300/0 conn(0x7f03b00cbed0 0x7f03b00cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03af400640 1 -- 172.21.15.5:0/3969304363 >> v1:172.21.15.117:6789/0 conn(0x7f03b006dd80 legacy=0x7f03b00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03af400640 1 -- 172.21.15.5:0/3969304363 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b00cb6d0 con 0x7f03b00b54c0 2024-08-18T22:33:29.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.694+0000 7f03afe00640 1 --2- 172.21.15.5:0/3969304363 >> v2:172.21.15.117:3300/0 conn(0x7f03b00cbed0 0x7f03b00cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:29.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03af400640 1 --2- 172.21.15.5:0/3969304363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b00b54c0 0x7f03b0071580 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f03b006f4c0 tx=0x7f03a001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b93a08ac3d5502f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03ae000640 1 -- 172.21.15.5:0/3969304363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a00b5070 con 0x7f03b00b54c0 2024-08-18T22:33:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03ae000640 1 -- 172.21.15.5:0/3969304363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a00a8a10 con 0x7f03b00b54c0 2024-08-18T22:33:29.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03ae000640 1 -- 172.21.15.5:0/3969304363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a00a8de0 con 0x7f03b00b54c0 2024-08-18T22:33:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03b6800640 1 -- 172.21.15.5:0/3969304363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b00b54c0 msgr2=0x7f03b0071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03b6800640 1 --2- 172.21.15.5:0/3969304363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b00b54c0 0x7f03b0071580 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f03b006f4c0 tx=0x7f03a001ed10 comp rx=0 tx=0).stop 2024-08-18T22:33:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03b6800640 1 -- 172.21.15.5:0/3969304363 shutdown_connections 2024-08-18T22:33:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03b6800640 1 --2- 172.21.15.5:0/3969304363 >> v2:172.21.15.117:3300/0 conn(0x7f03b00cbed0 0x7f03b00cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03b6800640 1 --2- 172.21.15.5:0/3969304363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b00b54c0 0x7f03b0071580 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03b6800640 1 -- 172.21.15.5:0/3969304363 >> 172.21.15.5:0/3969304363 conn(0x7f03b00b3eb0 msgr2=0x7f03b00b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03b6800640 1 -- 172.21.15.5:0/3969304363 shutdown_connections 2024-08-18T22:33:29.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.698+0000 7f03b6800640 1 -- 172.21.15.5:0/3969304363 wait complete. 2024-08-18T22:33:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03b6800640 1 Processor -- start 2024-08-18T22:33:29.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03b6800640 1 -- start start 2024-08-18T22:33:29.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03b6800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b006dd80 0x7f03b01f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03b6800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b00b54c0 0x7f03b0142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03b6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b00cbed0 0x7f03b01e8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03b6800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01481a0 con 0x7f03b00cbed0 2024-08-18T22:33:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03b6800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0148020 con 0x7f03b00b54c0 2024-08-18T22:33:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03b6800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03b00cc8a0 con 0x7f03b006dd80 2024-08-18T22:33:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b00cbed0 0x7f03b01e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b00cbed0 0x7f03b01e8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58202/0 (socket says 172.21.15.5:58202) 2024-08-18T22:33:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03afe00640 1 -- 172.21.15.5:0/3781045025 learned_addr learned my addr 172.21.15.5:0/3781045025 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03aea00640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b00b54c0 0x7f03b0142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:29.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03af400640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b006dd80 0x7f03b01f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03afe00640 1 -- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b006dd80 msgr2=0x7f03b01f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03afe00640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b006dd80 0x7f03b01f42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03afe00640 1 -- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b00b54c0 msgr2=0x7f03b0142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03afe00640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b00b54c0 0x7f03b0142a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03afe00640 1 -- 172.21.15.5:0/3781045025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b01f4830 con 0x7f03b00cbed0 2024-08-18T22:33:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03afe00640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b00cbed0 0x7f03b01e8160 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f03a8007df0 tx=0x7f03a800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03a7400640 1 -- 172.21.15.5:0/3781045025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a801a070 con 0x7f03b00cbed0 2024-08-18T22:33:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03a7400640 1 -- 172.21.15.5:0/3781045025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a80039a0 con 0x7f03b00cbed0 2024-08-18T22:33:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03b6800640 1 -- 172.21.15.5:0/3781045025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b01e70c0 con 0x7f03b00cbed0 2024-08-18T22:33:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03a7400640 1 -- 172.21.15.5:0/3781045025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8003d90 con 0x7f03b00cbed0 2024-08-18T22:33:29.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03b6800640 1 -- 172.21.15.5:0/3781045025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b01e7680 con 0x7f03b00cbed0 2024-08-18T22:33:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.702+0000 7f03b6800640 1 -- 172.21.15.5:0/3781045025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b00cc360 con 0x7f03b00cbed0 2024-08-18T22:33:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.706+0000 7f03a7400640 1 -- 172.21.15.5:0/3781045025 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f03a801d070 con 0x7f03b00cbed0 2024-08-18T22:33:29.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.706+0000 7f03a7400640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03900678f0 0x7f0390069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:29.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.706+0000 7f03a7400640 1 -- 172.21.15.5:0/3781045025 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5249+0+0 (secure 0 0 0) 0x7f03a8085c80 con 0x7f03b00cbed0 2024-08-18T22:33:29.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.706+0000 7f03af400640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03900678f0 0x7f0390069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:29.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.706+0000 7f03af400640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03900678f0 0x7f0390069db0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f03a00b2000 tx=0x7f03a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:29.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.710+0000 7f03a7400640 1 -- 172.21.15.5:0/3781045025 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f03a8010070 con 0x7f03b00cbed0 2024-08-18T22:33:29.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.930+0000 7f03b6800640 1 -- 172.21.15.5:0/3781045025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f03b015e510 con 0x7f03b00cbed0 2024-08-18T22:33:29.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.930+0000 7f03a7400640 1 -- 172.21.15.5:0/3781045025 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) ==== 80+0+5304 (secure 0 0 0) 0x7f03a8056320 con 0x7f03b00cbed0 2024-08-18T22:33:29.929 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:29.929 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:33:29.929 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2024-08-18T22:33:29.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.929 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2024-08-18T22:33:29.929 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8Jm6DJZMxAA6+8CmWoGr/uvAVjM2sBnrw==", 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmvTnsAxAArbteUVPrsfcFFSXsJNZNow==", 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.930 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYnu1OhAA9BYFAXqtgmdTAk+hsh+vzw==", 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:33:29.931 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8Jm+vYVCxAA/hcWaLWWjXNFemsKzypRkg==", 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.932 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAxc8JmpBytKhAA1aoiiv8ObbZqXyJsnpvLhw==", 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA0c8JmPAb+NRAAQpAbWxUGCqi8nt3kEjOymA==", 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA4c8JmxhGbAxAAwd650cE8h3G9JxLfqhrAWA==", 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2024-08-18T22:33:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7c8Jmj5vKDBAAU1TfOv1hxFursFz/0Axl9A==", 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBc8Jm98o3BRAAhMJPDyTM+vjOK9/z05j4LA==", 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:33:29.935 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEc8JmZl1BDhAAmMD2HTxfIsx4ZlKveO2JSg==", 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBHc8Jm41IzFxAAMQkBc2KYlOj6F1b1FwXjzg==", 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKc8JmVZNPHxAA7Bh7nW6OY88/GzYjf+hT0A==", 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2024-08-18T22:33:29.937 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g==", 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.938 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmYuZrGBAAKnRDCdwtQRg9WtZVtek0cg==", 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmJZT9FBAAYJHOr9ukmqHFTkCISQV+ug==", 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:33:29.939 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAwc8JmGn9HHhAA+kX0l96aCafk7/PWkTNUgQ==", 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2024-08-18T22:33:29.940 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmaqnFFxAARQHZ5k1d9lsc3oxx8ZWsAA==", 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2024-08-18T22:33:29.941 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmYPLsLhAAOEyZw6zpDsFf4DxBk/Mj2g==", 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAvc8JmSK0aKxAAw/i9DxU/EzsSboLeQy8Z5w==", 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:29.943 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-18T22:33:29.943 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:33:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 -- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03900678f0 msgr2=0x7f0390069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03900678f0 0x7f0390069db0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f03a00b2000 tx=0x7f03a0009040 comp rx=0 tx=0).stop 2024-08-18T22:33:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 -- 172.21.15.5:0/3781045025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b00cbed0 msgr2=0x7f03b01e8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b00cbed0 0x7f03b01e8160 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f03a8007df0 tx=0x7f03a800d4a0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 -- 172.21.15.5:0/3781045025 shutdown_connections 2024-08-18T22:33:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03900678f0 0x7f0390069db0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b00cbed0 0x7f03b01e8160 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b00b54c0 0x7f03b0142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 --2- 172.21.15.5:0/3781045025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b006dd80 0x7f03b01f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 -- 172.21.15.5:0/3781045025 >> 172.21.15.5:0/3781045025 conn(0x7f03b00b3eb0 msgr2=0x7f03b00cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 -- 172.21.15.5:0/3781045025 shutdown_connections 2024-08-18T22:33:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:29.934+0000 7f03b6800640 1 -- 172.21.15.5:0/3781045025 wait complete. 2024-08-18T22:33:29.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T22:33:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.094+0000 7fa7fc800640 1 Processor -- start 2024-08-18T22:33:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.094+0000 7fa7fc800640 1 -- start start 2024-08-18T22:33:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.094+0000 7fa7fc800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa7f415bed0 0x7fa7f40735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7fc800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f40cb390 0x7fa7f4071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7fc800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f4072060 con 0x7fa7f406da70 2024-08-18T22:33:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7fc800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa7f4073c80 con 0x7fa7f415bed0 2024-08-18T22:33:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7fc800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f40ca5d0 con 0x7fa7f40cb390 2024-08-18T22:33:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7fa800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa7f406da70 0x7fa7f40cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36354/0 (socket says 172.21.15.5:36354) 2024-08-18T22:33:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7fa800640 1 -- 172.21.15.5:0/3500958603 learned_addr learned my addr 172.21.15.5:0/3500958603 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f9e00640 1 --2- 172.21.15.5:0/3500958603 >> v2:172.21.15.117:3300/0 conn(0x7fa7f415bed0 0x7fa7f40735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f9400640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f40cb390 0x7fa7f4071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1831367495 0 0) 0x7fa7f4072060 con 0x7fa7f406da70 2024-08-18T22:33:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7dc003530 con 0x7fa7f406da70 2024-08-18T22:33:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4110543106 0 0) 0x7fa7dc003530 con 0x7fa7f406da70 2024-08-18T22:33:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f40cb390 msgr2=0x7fa7f4071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f40cb390 0x7fa7f4071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 >> v2:172.21.15.117:3300/0 conn(0x7fa7f415bed0 msgr2=0x7fa7f40735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 --2- 172.21.15.5:0/3500958603 >> v2:172.21.15.117:3300/0 conn(0x7fa7f415bed0 0x7fa7f40735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f40ca8b0 con 0x7fa7f406da70 2024-08-18T22:33:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fa7f0001a00 con 0x7fa7f406da70 2024-08-18T22:33:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 >> v1:172.21.15.5:6789/0 conn(0x7fa7f406da70 legacy=0x7fa7f40cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7dc0039c0 0x7fa7dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 0x7fa7dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7dc0051d0 0x7fa7dc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f4073c80 con 0x7fa7dc004810 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f40ca5d0 con 0x7fa7dc0039c0 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa7dc010320 con 0x7fa7dc0051d0 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f9400640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 0x7fa7dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f9e00640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7dc0039c0 0x7fa7dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7fa800640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7dc0051d0 0x7fa7dc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f9400640 1 -- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7dc0051d0 msgr2=0x7fa7dc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f9400640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7dc0051d0 0x7fa7dc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f9400640 1 -- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7dc0039c0 msgr2=0x7fa7dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f9400640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7dc0039c0 0x7fa7dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f9400640 1 -- 172.21.15.5:0/3500958603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc003530 con 0x7fa7dc004810 2024-08-18T22:33:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7f9e00640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7dc0039c0 0x7fa7dc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:30.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.098+0000 7fa7fa800640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7dc0051d0 0x7fa7dc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7f9400640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 0x7fa7dc004c90 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40099a0 tx=0x7fa7e401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc16479465196c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4009670 con 0x7fa7dc004810 2024-08-18T22:33:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e40a6420 con 0x7fa7dc004810 2024-08-18T22:33:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7f8a00640 1 -- 172.21.15.5:0/3500958603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e40a67d0 con 0x7fa7dc004810 2024-08-18T22:33:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7fc800640 1 -- 172.21.15.5:0/3500958603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 msgr2=0x7fa7dc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7fc800640 1 --2- 172.21.15.5:0/3500958603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 0x7fa7dc004c90 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40099a0 tx=0x7fa7e401c930 comp rx=0 tx=0).stop 2024-08-18T22:33:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7fa800640 1 -- 172.21.15.5:0/3500958603 reap_dead start 2024-08-18T22:33:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7fc800640 1 -- 172.21.15.5:0/3500958603 shutdown_connections 2024-08-18T22:33:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7fc800640 1 -- 172.21.15.5:0/3500958603 >> 172.21.15.5:0/3500958603 conn(0x7fa7f40b1c50 msgr2=0x7fa7f40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7fc800640 1 -- 172.21.15.5:0/3500958603 shutdown_connections 2024-08-18T22:33:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7fc800640 1 -- 172.21.15.5:0/3500958603 wait complete. 2024-08-18T22:33:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7fc800640 1 Processor -- start 2024-08-18T22:33:30.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.102+0000 7fa7fc800640 1 -- start start 2024-08-18T22:33:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7fc800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 0x7fa7f4157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7fc800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7f40b0e10 0x7fa7f40b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7fc800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f40b52c0 0x7fa7f40b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7fc800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f415c2b0 con 0x7fa7dc004810 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7fc800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f40cae70 con 0x7fa7f40b0e10 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7fc800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f415c430 con 0x7fa7f40b52c0 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7f9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 0x7fa7f4157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7f9e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 0x7fa7f4157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58226/0 (socket says 172.21.15.5:58226) 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7f9e00640 1 -- 172.21.15.5:0/2456774033 learned_addr learned my addr 172.21.15.5:0/2456774033 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7f9400640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7f40b0e10 0x7fa7f40b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7fa800640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f40b52c0 0x7fa7f40b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7f9e00640 1 -- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f40b52c0 msgr2=0x7fa7f40b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7f9e00640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f40b52c0 0x7fa7f40b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7f9e00640 1 -- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7f40b0e10 msgr2=0x7fa7f40b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7f9e00640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7f40b0e10 0x7fa7f40b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7f9e00640 1 -- 172.21.15.5:0/2456774033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f4158420 con 0x7fa7dc004810 2024-08-18T22:33:30.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7f9400640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7f40b0e10 0x7fa7f40b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:30.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7fa800640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f40b52c0 0x7fa7f40b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:30.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7f9e00640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 0x7fa7f4157ee0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8011930 tx=0x7fa7e8011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:30.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7ee000640 1 -- 172.21.15.5:0/2456774033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8004220 con 0x7fa7dc004810 2024-08-18T22:33:30.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7ee000640 1 -- 172.21.15.5:0/2456774033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e80043c0 con 0x7fa7dc004810 2024-08-18T22:33:30.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7ee000640 1 -- 172.21.15.5:0/2456774033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e800fbd0 con 0x7fa7dc004810 2024-08-18T22:33:30.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7fc800640 1 -- 172.21.15.5:0/2456774033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f409b6b0 con 0x7fa7dc004810 2024-08-18T22:33:30.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7fc800640 1 -- 172.21.15.5:0/2456774033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f409bc70 con 0x7fa7dc004810 2024-08-18T22:33:30.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7fc800640 1 -- 172.21.15.5:0/2456774033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f40735a0 con 0x7fa7dc004810 2024-08-18T22:33:30.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.106+0000 7fa7ee000640 1 -- 172.21.15.5:0/2456774033 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7e8003620 con 0x7fa7dc004810 2024-08-18T22:33:30.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.110+0000 7fa7ee000640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678f0 0x7fa7d8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.110+0000 7fa7ee000640 1 -- 172.21.15.5:0/2456774033 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5249+0+0 (secure 0 0 0) 0x7fa7e8086310 con 0x7fa7dc004810 2024-08-18T22:33:30.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.110+0000 7fa7f9400640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678f0 0x7fa7d8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.110+0000 7fa7f9400640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678f0 0x7fa7d8069db0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40ad000 tx=0x7fa7e40046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:30.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.114+0000 7fa7ee000640 1 -- 172.21.15.5:0/2456774033 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fa7e8019030 con 0x7fa7dc004810 2024-08-18T22:33:30.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.278+0000 7fa7fc800640 1 -- 172.21.15.5:0/2456774033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa7f409d9c0 con 0x7fa7dc004810 2024-08-18T22:33:30.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.278+0000 7fa7ee000640 1 -- 172.21.15.5:0/2456774033 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v200) ==== 84+0+65 (secure 0 0 0) 0x7fa7e8056f70 con 0x7fa7dc004810 2024-08-18T22:33:30.277 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-18T22:33:30.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-18T22:33:30.277 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-18T22:33:30.277 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-18T22:33:30.277 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:30.277 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-18T22:33:30.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 -- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678f0 msgr2=0x7fa7d8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:30.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678f0 0x7fa7d8069db0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40ad000 tx=0x7fa7e40046d0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 -- 172.21.15.5:0/2456774033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 msgr2=0x7fa7f4157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:30.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 0x7fa7f4157ee0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8011930 tx=0x7fa7e8011df0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 -- 172.21.15.5:0/2456774033 shutdown_connections 2024-08-18T22:33:30.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fa7d80678f0 0x7fa7d8069db0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7f40b52c0 0x7fa7f40b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7f40b0e10 0x7fa7f40b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 --2- 172.21.15.5:0/2456774033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7dc004810 0x7fa7f4157ee0 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 -- 172.21.15.5:0/2456774033 >> 172.21.15.5:0/2456774033 conn(0x7fa7f40b1c50 msgr2=0x7fa7f40cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 -- 172.21.15.5:0/2456774033 shutdown_connections 2024-08-18T22:33:30.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.282+0000 7fa7fc800640 1 -- 172.21.15.5:0/2456774033 wait complete. 2024-08-18T22:33:30.299 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T22:33:30.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T22:33:30.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.446+0000 7f245bc00640 1 Processor -- start 2024-08-18T22:33:30.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.446+0000 7f245bc00640 1 -- start start 2024-08-18T22:33:30.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.446+0000 7f245bc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24540ccaa0 0x7f24540cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.446+0000 7f245bc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f245415d1d0 0x7f24540cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.446+0000 7f245bc00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f245406ec70 con 0x7f24540cdf10 2024-08-18T22:33:30.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.446+0000 7f245bc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f24540cfe90 con 0x7f245415d1d0 2024-08-18T22:33:30.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.446+0000 7f245bc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f24540b37e0 con 0x7f24540ccaa0 2024-08-18T22:33:30.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f244be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f245415d1d0 0x7f24540cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f2459c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f24540cdf10 0x7f24540ce360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36362/0 (socket says 172.21.15.5:36362) 2024-08-18T22:33:30.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f2459c00640 1 -- 172.21.15.5:0/1823746637 learned_addr learned my addr 172.21.15.5:0/1823746637 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:30.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f2459200640 1 --2- 172.21.15.5:0/1823746637 >> v2:172.21.15.117:3300/0 conn(0x7f24540ccaa0 0x7f24540cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f244be00640 1 -- 172.21.15.5:0/1823746637 >> v2:172.21.15.117:3300/0 conn(0x7f24540ccaa0 msgr2=0x7f24540cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:30.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f244be00640 1 --2- 172.21.15.5:0/1823746637 >> v2:172.21.15.117:3300/0 conn(0x7f24540ccaa0 0x7f24540cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f244be00640 1 -- 172.21.15.5:0/1823746637 >> v1:172.21.15.5:6789/0 conn(0x7f24540cdf10 legacy=0x7f24540ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:30.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f244be00640 1 -- 172.21.15.5:0/1823746637 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24540b3260 con 0x7f245415d1d0 2024-08-18T22:33:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f244be00640 1 --2- 172.21.15.5:0/1823746637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f245415d1d0 0x7f24540cce80 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f24540b2dd0 tx=0x7f243c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5ae51329814e0e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f2453e00640 1 -- 172.21.15.5:0/1823746637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0b0070 con 0x7f245415d1d0 2024-08-18T22:33:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f2453e00640 1 -- 172.21.15.5:0/1823746637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c0ab600 con 0x7f245415d1d0 2024-08-18T22:33:30.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.450+0000 7f2453e00640 1 -- 172.21.15.5:0/1823746637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0ab9d0 con 0x7f245415d1d0 2024-08-18T22:33:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 -- 172.21.15.5:0/1823746637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f245415d1d0 msgr2=0x7f24540cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 --2- 172.21.15.5:0/1823746637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f245415d1d0 0x7f24540cce80 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f24540b2dd0 tx=0x7f243c01c3f0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 -- 172.21.15.5:0/1823746637 shutdown_connections 2024-08-18T22:33:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 --2- 172.21.15.5:0/1823746637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f245415d1d0 0x7f24540cce80 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 --2- 172.21.15.5:0/1823746637 >> v2:172.21.15.117:3300/0 conn(0x7f24540ccaa0 0x7f24540cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 -- 172.21.15.5:0/1823746637 >> 172.21.15.5:0/1823746637 conn(0x7f245406b9b0 msgr2=0x7f245406bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:30.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 -- 172.21.15.5:0/1823746637 shutdown_connections 2024-08-18T22:33:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 -- 172.21.15.5:0/1823746637 wait complete. 2024-08-18T22:33:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 Processor -- start 2024-08-18T22:33:30.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 -- start start 2024-08-18T22:33:30.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24540ccaa0 0x7f24541511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24540cdf10 0x7f2454154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f245415d1d0 0x7f2454154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f24540afbb0 con 0x7f24540cdf10 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f24540afa30 con 0x7f24540ccaa0 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f245bc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2454156a10 con 0x7f245415d1d0 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f244be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24540cdf10 0x7f2454154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f244be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24540cdf10 0x7f2454154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58242/0 (socket says 172.21.15.5:58242) 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f244be00640 1 -- 172.21.15.5:0/1972277926 learned_addr learned my addr 172.21.15.5:0/1972277926 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f244be00640 1 -- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f245415d1d0 msgr2=0x7f2454154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f2459c00640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f245415d1d0 0x7f2454154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f2459200640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24540ccaa0 0x7f24541511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f244be00640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f245415d1d0 0x7f2454154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f244be00640 1 -- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24540ccaa0 msgr2=0x7f24541511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f244be00640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24540ccaa0 0x7f24541511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f244be00640 1 -- 172.21.15.5:0/1972277926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24540cfa70 con 0x7f24540cdf10 2024-08-18T22:33:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f2459c00640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f245415d1d0 0x7f2454154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f2459200640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24540ccaa0 0x7f24541511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.454+0000 7f244be00640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24540cdf10 0x7f2454154400 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f243c01a020 tx=0x7f243c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.458+0000 7f2451600640 1 -- 172.21.15.5:0/1972277926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0ba070 con 0x7f24540cdf10 2024-08-18T22:33:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.458+0000 7f2451600640 1 -- 172.21.15.5:0/1972277926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c0b5460 con 0x7f24540cdf10 2024-08-18T22:33:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.458+0000 7f2451600640 1 -- 172.21.15.5:0/1972277926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0b0040 con 0x7f24540cdf10 2024-08-18T22:33:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.458+0000 7f245bc00640 1 -- 172.21.15.5:0/1972277926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24541f9170 con 0x7f24540cdf10 2024-08-18T22:33:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.458+0000 7f245bc00640 1 -- 172.21.15.5:0/1972277926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24541f83b0 con 0x7f24540cdf10 2024-08-18T22:33:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.458+0000 7f245bc00640 1 -- 172.21.15.5:0/1972277926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24540cf760 con 0x7f24540cdf10 2024-08-18T22:33:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.458+0000 7f2451600640 1 -- 172.21.15.5:0/1972277926 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f243c0bd070 con 0x7f24540cdf10 2024-08-18T22:33:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.458+0000 7f2451600640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24300678c0 0x7f2430069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.458+0000 7f2451600640 1 -- 172.21.15.5:0/1972277926 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5249+0+0 (secure 0 0 0) 0x7f243c120130 con 0x7f24540cdf10 2024-08-18T22:33:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.458+0000 7f2459200640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24300678c0 0x7f2430069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.462+0000 7f2459200640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24300678c0 0x7f2430069d80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f24540ad750 tx=0x7f2444008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:30.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.462+0000 7f2451600640 1 -- 172.21.15.5:0/1972277926 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f243c016070 con 0x7f24540cdf10 2024-08-18T22:33:30.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:30.634+0000 7f245bc00640 1 -- 172.21.15.5:0/1972277926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f245406cc30 con 0x7f24540cdf10 2024-08-18T22:33:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.538+0000 7f2451600640 1 -- 172.21.15.5:0/1972277926 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v201) ==== 138+0+0 (secure 0 0 0) 0x7f243c0f0e20 con 0x7f24540cdf10 2024-08-18T22:33:31.535 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-18T22:33:31.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 -- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24300678c0 msgr2=0x7f2430069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24300678c0 0x7f2430069d80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f24540ad750 tx=0x7f2444008040 comp rx=0 tx=0).stop 2024-08-18T22:33:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 -- 172.21.15.5:0/1972277926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24540cdf10 msgr2=0x7f2454154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24540cdf10 0x7f2454154400 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f243c01a020 tx=0x7f243c019190 comp rx=0 tx=0).stop 2024-08-18T22:33:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 -- 172.21.15.5:0/1972277926 shutdown_connections 2024-08-18T22:33:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24300678c0 0x7f2430069d80 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f245415d1d0 0x7f2454154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24540cdf10 0x7f2454154400 secure :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f243c01a020 tx=0x7f243c019190 comp rx=0 tx=0).stop 2024-08-18T22:33:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 --2- 172.21.15.5:0/1972277926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24540ccaa0 0x7f24541511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 -- 172.21.15.5:0/1972277926 >> 172.21.15.5:0/1972277926 conn(0x7f245406b9b0 msgr2=0x7f245415c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:31.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 -- 172.21.15.5:0/1972277926 shutdown_connections 2024-08-18T22:33:31.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.542+0000 7f245bc00640 1 -- 172.21.15.5:0/1972277926 wait complete. 2024-08-18T22:33:31.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T22:33:31.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f29a00640 1 Processor -- start 2024-08-18T22:33:31.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f29a00640 1 -- start start 2024-08-18T22:33:31.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f29a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f240b40c0 0x7f3f240b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:31.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f29a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f240ce280 0x7f3f240ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:31.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f29a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f240b31f0 con 0x7f3f2415b0c0 2024-08-18T22:33:31.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f29a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3f240b3d70 con 0x7f3f240ce280 2024-08-18T22:33:31.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f29a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3f240b4a40 con 0x7f3f240b40c0 2024-08-18T22:33:31.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f22a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3f2415b0c0 0x7f3f2406db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36366/0 (socket says 172.21.15.5:36366) 2024-08-18T22:33:31.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f22a00640 1 -- 172.21.15.5:0/2250462124 learned_addr learned my addr 172.21.15.5:0/2250462124 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:31.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f23400640 1 --2- 172.21.15.5:0/2250462124 >> v2:172.21.15.5:3300/0 conn(0x7f3f240ce280 0x7f3f240ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:31.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f1a000640 1 --2- 172.21.15.5:0/2250462124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f240b40c0 0x7f3f240b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:31.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f23400640 1 -- 172.21.15.5:0/2250462124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f240b40c0 msgr2=0x7f3f240b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:31.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f23400640 1 --2- 172.21.15.5:0/2250462124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f240b40c0 0x7f3f240b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f23400640 1 -- 172.21.15.5:0/2250462124 >> v1:172.21.15.5:6789/0 conn(0x7f3f2415b0c0 legacy=0x7f3f2406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:31.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.722+0000 7f3f23400640 1 -- 172.21.15.5:0/2250462124 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f240b34d0 con 0x7f3f240ce280 2024-08-18T22:33:31.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f23400640 1 --2- 172.21.15.5:0/2250462124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f240ce280 0x7f3f240ce6d0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009d90 tx=0x7f3f1c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7da7316ce0c815e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:31.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f22000640 1 -- 172.21.15.5:0/2250462124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0b2070 con 0x7f3f240ce280 2024-08-18T22:33:31.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f22000640 1 -- 172.21.15.5:0/2250462124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c0a5800 con 0x7f3f240ce280 2024-08-18T22:33:31.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f22000640 1 -- 172.21.15.5:0/2250462124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0a5bd0 con 0x7f3f240ce280 2024-08-18T22:33:31.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f29a00640 1 -- 172.21.15.5:0/2250462124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f240ce280 msgr2=0x7f3f240ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:31.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f29a00640 1 --2- 172.21.15.5:0/2250462124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f240ce280 0x7f3f240ce6d0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009d90 tx=0x7f3f1c01c850 comp rx=0 tx=0).stop 2024-08-18T22:33:31.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f29a00640 1 -- 172.21.15.5:0/2250462124 shutdown_connections 2024-08-18T22:33:31.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f29a00640 1 --2- 172.21.15.5:0/2250462124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f240ce280 0x7f3f240ce6d0 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f29a00640 1 --2- 172.21.15.5:0/2250462124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f240b40c0 0x7f3f240b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f29a00640 1 -- 172.21.15.5:0/2250462124 >> 172.21.15.5:0/2250462124 conn(0x7f3f240b1dc0 msgr2=0x7f3f240b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:31.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f29a00640 1 -- 172.21.15.5:0/2250462124 shutdown_connections 2024-08-18T22:33:31.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.726+0000 7f3f29a00640 1 -- 172.21.15.5:0/2250462124 wait complete. 2024-08-18T22:33:31.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f29a00640 1 Processor -- start 2024-08-18T22:33:31.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f29a00640 1 -- start start 2024-08-18T22:33:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f29a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f240b40c0 0x7f3f2414f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f29a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f240ce280 0x7f3f24152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f29a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2415b0c0 0x7f3f24151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f29a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2406f7f0 con 0x7f3f240ce280 2024-08-18T22:33:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f29a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2406f670 con 0x7f3f2415b0c0 2024-08-18T22:33:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f29a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3f24167d10 con 0x7f3f240b40c0 2024-08-18T22:33:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f240ce280 0x7f3f24152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f240ce280 0x7f3f24152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58262/0 (socket says 172.21.15.5:58262) 2024-08-18T22:33:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1a000640 1 -- 172.21.15.5:0/3681354583 learned_addr learned my addr 172.21.15.5:0/3681354583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:31.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f22a00640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f240b40c0 0x7f3f2414f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:31.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f23400640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2415b0c0 0x7f3f24151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:31.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1a000640 1 -- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f240b40c0 msgr2=0x7f3f2414f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:31.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1a000640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f240b40c0 0x7f3f2414f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1a000640 1 -- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2415b0c0 msgr2=0x7f3f24151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:31.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1a000640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2415b0c0 0x7f3f24151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1a000640 1 -- 172.21.15.5:0/3681354583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f240b2af0 con 0x7f3f240ce280 2024-08-18T22:33:31.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f23400640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2415b0c0 0x7f3f24151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:31.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1a000640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f240ce280 0x7f3f24152bd0 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00d5f0 tx=0x7f3f0c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:31.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1b400640 1 -- 172.21.15.5:0/3681354583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0125f0 con 0x7f3f240ce280 2024-08-18T22:33:31.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1b400640 1 -- 172.21.15.5:0/3681354583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0c019070 con 0x7f3f240ce280 2024-08-18T22:33:31.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f1b400640 1 -- 172.21.15.5:0/3681354583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0129b0 con 0x7f3f240ce280 2024-08-18T22:33:31.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f29a00640 1 -- 172.21.15.5:0/3681354583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f24153540 con 0x7f3f240ce280 2024-08-18T22:33:31.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.730+0000 7f3f29a00640 1 -- 172.21.15.5:0/3681354583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f24153b00 con 0x7f3f240ce280 2024-08-18T22:33:31.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.734+0000 7f3f29a00640 1 -- 172.21.15.5:0/3681354583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f240b4500 con 0x7f3f240ce280 2024-08-18T22:33:31.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.734+0000 7f3f1b400640 1 -- 172.21.15.5:0/3681354583 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3f0c012b50 con 0x7f3f240ce280 2024-08-18T22:33:31.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.734+0000 7f3f1b400640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f00067910 0x7f3f00069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:31.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.734+0000 7f3f1b400640 1 -- 172.21.15.5:0/3681354583 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 5619+0+0 (secure 0 0 0) 0x7f3f0c086ae0 con 0x7f3f240ce280 2024-08-18T22:33:31.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.734+0000 7f3f22a00640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f00067910 0x7f3f00069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:31.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.734+0000 7f3f22a00640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f00067910 0x7f3f00069dd0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3f14000f70 tx=0x7f3f14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:31.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.738+0000 7f3f1b400640 1 -- 172.21.15.5:0/3681354583 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f3f0c0576e0 con 0x7f3f240ce280 2024-08-18T22:33:31.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:31.906+0000 7f3f29a00640 1 -- 172.21.15.5:0/3681354583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3f240b1670 con 0x7f3f240ce280 2024-08-18T22:33:32.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.546+0000 7f3f1b400640 1 -- 172.21.15.5:0/3681354583 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v202) ==== 170+0+0 (secure 0 0 0) 0x7f3f0c056fe0 con 0x7f3f240ce280 2024-08-18T22:33:32.543 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-18T22:33:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 -- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f00067910 msgr2=0x7f3f00069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f00067910 0x7f3f00069dd0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3f14000f70 tx=0x7f3f14009040 comp rx=0 tx=0).stop 2024-08-18T22:33:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 -- 172.21.15.5:0/3681354583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f240ce280 msgr2=0x7f3f24152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f240ce280 0x7f3f24152bd0 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00d5f0 tx=0x7f3f0c00dab0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 -- 172.21.15.5:0/3681354583 shutdown_connections 2024-08-18T22:33:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f00067910 0x7f3f00069dd0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2415b0c0 0x7f3f24151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f240ce280 0x7f3f24152bd0 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 --2- 172.21.15.5:0/3681354583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f240b40c0 0x7f3f2414f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 -- 172.21.15.5:0/3681354583 >> 172.21.15.5:0/3681354583 conn(0x7f3f240b1dc0 msgr2=0x7f3f2406db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 -- 172.21.15.5:0/3681354583 shutdown_connections 2024-08-18T22:33:32.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.550+0000 7f3f29a00640 1 -- 172.21.15.5:0/3681354583 wait complete. 2024-08-18T22:33:32.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T22:33:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.726+0000 7f03ace00640 1 Processor -- start 2024-08-18T22:33:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.726+0000 7f03ace00640 1 -- start start 2024-08-18T22:33:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.726+0000 7f03ace00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03a815d4d0 0x7f03a8166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.726+0000 7f03ace00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03a80ced30 con 0x7f03a815c180 2024-08-18T22:33:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.726+0000 7f03ace00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03a80cfb00 con 0x7f03a815c560 2024-08-18T22:33:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.726+0000 7f03ace00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f03a815d040 con 0x7f03a815d4d0 2024-08-18T22:33:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.726+0000 7f03a6800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03a815d4d0 0x7f03a8166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.730+0000 7f03a6800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03a815d4d0 0x7f03a8166f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58278/0 (socket says 172.21.15.5:58278) 2024-08-18T22:33:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.730+0000 7f03a6800640 1 -- 172.21.15.5:0/2743920574 learned_addr learned my addr 172.21.15.5:0/2743920574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.730+0000 7f03a5e00640 1 --1- 172.21.15.5:0/2743920574 >> v1:172.21.15.5:6789/0 conn(0x7f03a815c180 0x7f03a80cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36382/0 (socket says 172.21.15.5:36382) 2024-08-18T22:33:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.730+0000 7f03a6800640 1 -- 172.21.15.5:0/2743920574 >> v1:172.21.15.117:6789/0 conn(0x7f03a815c560 legacy=0x7f03a80ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.730+0000 7f03a6800640 1 -- 172.21.15.5:0/2743920574 >> v1:172.21.15.5:6789/0 conn(0x7f03a815c180 legacy=0x7f03a80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.730+0000 7f03a6800640 1 -- 172.21.15.5:0/2743920574 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a815c9f0 con 0x7f03a815d4d0 2024-08-18T22:33:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.730+0000 7f03a6800640 1 --2- 172.21.15.5:0/2743920574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a815d4d0 0x7f03a8166f10 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009e50 tx=0x7f03a001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee617548c755a0c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.730+0000 7f03a4a00640 1 -- 172.21.15.5:0/2743920574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a00a5810 con 0x7f03a815d4d0 2024-08-18T22:33:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.730+0000 7f03a4a00640 1 -- 172.21.15.5:0/2743920574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a00a59b0 con 0x7f03a815d4d0 2024-08-18T22:33:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.730+0000 7f03a4a00640 1 -- 172.21.15.5:0/2743920574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a00a5d80 con 0x7f03a815d4d0 2024-08-18T22:33:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 -- 172.21.15.5:0/2743920574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a815d4d0 msgr2=0x7f03a8166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 --2- 172.21.15.5:0/2743920574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a815d4d0 0x7f03a8166f10 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009e50 tx=0x7f03a001c930 comp rx=0 tx=0).stop 2024-08-18T22:33:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 -- 172.21.15.5:0/2743920574 shutdown_connections 2024-08-18T22:33:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 --2- 172.21.15.5:0/2743920574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a815d4d0 0x7f03a8166f10 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 -- 172.21.15.5:0/2743920574 >> 172.21.15.5:0/2743920574 conn(0x7f03a80b1dc0 msgr2=0x7f03a80b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 -- 172.21.15.5:0/2743920574 shutdown_connections 2024-08-18T22:33:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 -- 172.21.15.5:0/2743920574 wait complete. 2024-08-18T22:33:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 Processor -- start 2024-08-18T22:33:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 -- start start 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a815c180 0x7f03a8151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03a815d4d0 0x7f03a809d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03a809b030 0x7f03a8157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03a816a000 con 0x7f03a815c180 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f03a8169e80 con 0x7f03a815d4d0 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03ace00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03a816a180 con 0x7f03a809b030 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03a5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a815c180 0x7f03a8151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03a5e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a815c180 0x7f03a8151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58286/0 (socket says 172.21.15.5:58286) 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03a5e00640 1 -- 172.21.15.5:0/1063405551 learned_addr learned my addr 172.21.15.5:0/1063405551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03a5400640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03a815d4d0 0x7f03a809d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03a5e00640 1 -- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03a809b030 msgr2=0x7f03a8157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03a5e00640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03a809b030 0x7f03a8157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03a5e00640 1 -- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03a815d4d0 msgr2=0x7f03a809d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03a5e00640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03a815d4d0 0x7f03a809d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03a5e00640 1 -- 172.21.15.5:0/1063405551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a809dc20 con 0x7f03a815c180 2024-08-18T22:33:32.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f03a5e00640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a815c180 0x7f03a8151210 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f039800c3a0 tx=0x7f039800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.734+0000 7f039e000640 1 -- 172.21.15.5:0/1063405551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03980074e0 con 0x7f03a815c180 2024-08-18T22:33:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.738+0000 7f039e000640 1 -- 172.21.15.5:0/1063405551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0398007680 con 0x7f03a815c180 2024-08-18T22:33:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.738+0000 7f03ace00640 1 -- 172.21.15.5:0/1063405551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a809df00 con 0x7f03a815c180 2024-08-18T22:33:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.738+0000 7f039e000640 1 -- 172.21.15.5:0/1063405551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0398004a30 con 0x7f03a815c180 2024-08-18T22:33:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.738+0000 7f03ace00640 1 -- 172.21.15.5:0/1063405551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a81531f0 con 0x7f03a815c180 2024-08-18T22:33:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.738+0000 7f03ace00640 1 -- 172.21.15.5:0/1063405551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a80cdf10 con 0x7f03a815c180 2024-08-18T22:33:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.738+0000 7f039e000640 1 -- 172.21.15.5:0/1063405551 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f039801a020 con 0x7f03a815c180 2024-08-18T22:33:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.738+0000 7f039e000640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03880678c0 0x7f0388069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.738+0000 7f039e000640 1 -- 172.21.15.5:0/1063405551 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6001+0+0 (secure 0 0 0) 0x7f03980855f0 con 0x7f03a815c180 2024-08-18T22:33:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.738+0000 7f03a5400640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03880678c0 0x7f0388069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.742+0000 7f03a5400640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03880678c0 0x7f0388069d80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0394004e30 tx=0x7f0394009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:32.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.746+0000 7f039e000640 1 -- 172.21.15.5:0/1063405551 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0398055f60 con 0x7f03a815c180 2024-08-18T22:33:32.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:32.946+0000 7f03ace00640 1 -- 172.21.15.5:0/1063405551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f03a815b850 con 0x7f03a815c180 2024-08-18T22:33:33.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.550+0000 7f039e000640 1 -- 172.21.15.5:0/1063405551 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 29 and data pool 30 v156) ==== 174+0+0 (secure 0 0 0) 0x7f0398055860 con 0x7f03a815c180 2024-08-18T22:33:33.546 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 29 and data pool 30 2024-08-18T22:33:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 -- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03880678c0 msgr2=0x7f0388069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03880678c0 0x7f0388069d80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0394004e30 tx=0x7f0394009040 comp rx=0 tx=0).stop 2024-08-18T22:33:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 -- 172.21.15.5:0/1063405551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a815c180 msgr2=0x7f03a8151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a815c180 0x7f03a8151210 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f039800c3a0 tx=0x7f039800c860 comp rx=0 tx=0).stop 2024-08-18T22:33:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 -- 172.21.15.5:0/1063405551 shutdown_connections 2024-08-18T22:33:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03880678c0 0x7f0388069d80 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03a809b030 0x7f03a8157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03a815d4d0 0x7f03a809d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 --2- 172.21.15.5:0/1063405551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a815c180 0x7f03a8151210 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 -- 172.21.15.5:0/1063405551 >> 172.21.15.5:0/1063405551 conn(0x7f03a80b1dc0 msgr2=0x7f03a80ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 -- 172.21.15.5:0/1063405551 shutdown_connections 2024-08-18T22:33:33.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.554+0000 7f03ace00640 1 -- 172.21.15.5:0/1063405551 wait complete. 2024-08-18T22:33:33.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:33:33.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb241c00640 1 Processor -- start 2024-08-18T22:33:33.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb241c00640 1 -- start start 2024-08-18T22:33:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb241c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb23c06b9b0 0x7fb23c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb241c00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23c071040 con 0x7fb23c0b49a0 2024-08-18T22:33:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb241c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23c0707e0 con 0x7fb23c146f10 2024-08-18T22:33:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb241c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb23c0b4510 con 0x7fb23c06b9b0 2024-08-18T22:33:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb241200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb23c0b49a0 0x7fb23c0b4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37244/0 (socket says 172.21.15.5:37244) 2024-08-18T22:33:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb233400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb23c06b9b0 0x7fb23c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb241200640 1 -- 172.21.15.5:0/576954562 learned_addr learned my addr 172.21.15.5:0/576954562 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb23b400640 1 -- 172.21.15.5:0/576954562 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481433856 0 0) 0x7fb23c071040 con 0x7fb23c0b49a0 2024-08-18T22:33:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb23b400640 1 -- 172.21.15.5:0/576954562 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb220003530 con 0x7fb23c0b49a0 2024-08-18T22:33:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb233400640 1 -- 172.21.15.5:0/576954562 >> v1:172.21.15.117:6789/0 conn(0x7fb23c146f10 legacy=0x7fb23c06f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb233400640 1 -- 172.21.15.5:0/576954562 >> v1:172.21.15.5:6789/0 conn(0x7fb23c0b49a0 legacy=0x7fb23c0b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.738+0000 7fb233400640 1 -- 172.21.15.5:0/576954562 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c0b41e0 con 0x7fb23c06b9b0 2024-08-18T22:33:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.742+0000 7fb233400640 1 --2- 172.21.15.5:0/576954562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb23c06b9b0 0x7fb23c06bdf0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb2240097c0 tx=0x7fb22401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c8adad26e1da956 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.742+0000 7fb23b400640 1 -- 172.21.15.5:0/576954562 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2240b0070 con 0x7fb23c06b9b0 2024-08-18T22:33:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.742+0000 7fb23b400640 1 -- 172.21.15.5:0/576954562 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2240ab600 con 0x7fb23c06b9b0 2024-08-18T22:33:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.742+0000 7fb23b400640 1 -- 172.21.15.5:0/576954562 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2240ab9b0 con 0x7fb23c06b9b0 2024-08-18T22:33:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.742+0000 7fb241c00640 1 -- 172.21.15.5:0/576954562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb23c06b9b0 msgr2=0x7fb23c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.742+0000 7fb241c00640 1 --2- 172.21.15.5:0/576954562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb23c06b9b0 0x7fb23c06bdf0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb2240097c0 tx=0x7fb22401c410 comp rx=0 tx=0).stop 2024-08-18T22:33:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.742+0000 7fb241c00640 1 -- 172.21.15.5:0/576954562 shutdown_connections 2024-08-18T22:33:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.742+0000 7fb241c00640 1 --2- 172.21.15.5:0/576954562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb23c06b9b0 0x7fb23c06bdf0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.742+0000 7fb241c00640 1 -- 172.21.15.5:0/576954562 >> 172.21.15.5:0/576954562 conn(0x7fb23c06e890 msgr2=0x7fb23c06eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.742+0000 7fb241c00640 1 -- 172.21.15.5:0/576954562 shutdown_connections 2024-08-18T22:33:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.742+0000 7fb241c00640 1 -- 172.21.15.5:0/576954562 wait complete. 2024-08-18T22:33:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb241c00640 1 Processor -- start 2024-08-18T22:33:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb241c00640 1 -- start start 2024-08-18T22:33:33.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb241c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c06b9b0 0x7fb23c15db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:33.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb241c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb23c0b49a0 0x7fb23c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb241c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb23c146f10 0x7fb23c15ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb241c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c147dc0 con 0x7fb23c06b9b0 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb241c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c147c40 con 0x7fb23c146f10 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb241c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb23c16c120 con 0x7fb23c0b49a0 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb23be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c06b9b0 0x7fb23c15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb23be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c06b9b0 0x7fb23c15db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51026/0 (socket says 172.21.15.5:51026) 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb23be00640 1 -- 172.21.15.5:0/334687596 learned_addr learned my addr 172.21.15.5:0/334687596 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb23be00640 1 -- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb23c0b49a0 msgr2=0x7fb23c15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb23be00640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb23c0b49a0 0x7fb23c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb23be00640 1 -- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb23c146f10 msgr2=0x7fb23c15ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb23be00640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb23c146f10 0x7fb23c15ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb23be00640 1 -- 172.21.15.5:0/334687596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c0cf4f0 con 0x7fb23c06b9b0 2024-08-18T22:33:33.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb23be00640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c06b9b0 0x7fb23c15db90 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c500 tx=0x7fb22c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:33.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb238c00640 1 -- 172.21.15.5:0/334687596 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c016020 con 0x7fb23c06b9b0 2024-08-18T22:33:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb238c00640 1 -- 172.21.15.5:0/334687596 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c005220 con 0x7fb23c06b9b0 2024-08-18T22:33:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb238c00640 1 -- 172.21.15.5:0/334687596 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c007030 con 0x7fb23c06b9b0 2024-08-18T22:33:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb241c00640 1 -- 172.21.15.5:0/334687596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23c139980 con 0x7fb23c06b9b0 2024-08-18T22:33:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.746+0000 7fb241c00640 1 -- 172.21.15.5:0/334687596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23c139f40 con 0x7fb23c06b9b0 2024-08-18T22:33:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.750+0000 7fb241c00640 1 -- 172.21.15.5:0/334687596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23c068120 con 0x7fb23c06b9b0 2024-08-18T22:33:33.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.750+0000 7fb238c00640 1 -- 172.21.15.5:0/334687596 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb22c0071f0 con 0x7fb23c06b9b0 2024-08-18T22:33:33.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.750+0000 7fb238c00640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2180678c0 0x7fb218069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:33.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.750+0000 7fb238c00640 1 -- 172.21.15.5:0/334687596 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 6101+0+0 (secure 0 0 0) 0x7fb22c085890 con 0x7fb23c06b9b0 2024-08-18T22:33:33.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.750+0000 7fb233400640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2180678c0 0x7fb218069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:33.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.750+0000 7fb233400640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2180678c0 0x7fb218069d80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb2240ad000 tx=0x7fb224008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:33.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.754+0000 7fb238c00640 1 -- 172.21.15.5:0/334687596 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fb22c020020 con 0x7fb23c06b9b0 2024-08-18T22:33:33.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.922+0000 7fb241c00640 1 -- 172.21.15.5:0/334687596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb23c0b6580 con 0x7fb23c06b9b0 2024-08-18T22:33:33.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb238c00640 1 -- 172.21.15.5:0/334687596 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) ==== 74+0+16825 (secure 0 0 0) 0x7fb22c0561b0 con 0x7fb23c06b9b0 2024-08-18T22:33:33.922 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:33.922 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":203,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:33:32.949302+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:33:30.682845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-08-18T22:33:31.952993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:33:33.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 -- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2180678c0 msgr2=0x7fb218069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:33.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2180678c0 0x7fb218069d80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb2240ad000 tx=0x7fb224008040 comp rx=0 tx=0).stop 2024-08-18T22:33:33.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 -- 172.21.15.5:0/334687596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c06b9b0 msgr2=0x7fb23c15db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c06b9b0 0x7fb23c15db90 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c500 tx=0x7fb22c00c9c0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 -- 172.21.15.5:0/334687596 shutdown_connections 2024-08-18T22:33:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb2180678c0 0x7fb218069d80 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb23c146f10 0x7fb23c15ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb23c0b49a0 0x7fb23c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 --2- 172.21.15.5:0/334687596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23c06b9b0 0x7fb23c15db90 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 -- 172.21.15.5:0/334687596 >> 172.21.15.5:0/334687596 conn(0x7fb23c06e890 msgr2=0x7fb23c0ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 -- 172.21.15.5:0/334687596 shutdown_connections 2024-08-18T22:33:33.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:33.926+0000 7fb241c00640 1 -- 172.21.15.5:0/334687596 wait complete. 2024-08-18T22:33:33.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:33:34.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.086+0000 7fd05f200640 1 Processor -- start 2024-08-18T22:33:34.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.086+0000 7fd05f200640 1 -- start start 2024-08-18T22:33:34.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.086+0000 7fd05f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd05815e460 0x7fd05806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.086+0000 7fd05f200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0580cee40 0x7fd0580ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.086+0000 7fd05f200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05815e840 con 0x7fd0580ca3e0 2024-08-18T22:33:34.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.086+0000 7fd05f200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd05806c900 con 0x7fd0580cee40 2024-08-18T22:33:34.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.086+0000 7fd05f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd0580cf320 con 0x7fd05815e460 2024-08-18T22:33:34.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.086+0000 7fd04f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0580cee40 0x7fd0580ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.086+0000 7fd04f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0580cee40 0x7fd0580ae040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51030/0 (socket says 172.21.15.5:51030) 2024-08-18T22:33:34.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.086+0000 7fd04f400640 1 -- 172.21.15.5:0/4244723077 learned_addr learned my addr 172.21.15.5:0/4244723077 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:34.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.086+0000 7fd057e00640 1 --2- 172.21.15.5:0/4244723077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd05815e460 0x7fd05806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd04f400640 1 -- 172.21.15.5:0/4244723077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd05815e460 msgr2=0x7fd05806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd04f400640 1 --2- 172.21.15.5:0/4244723077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd05815e460 0x7fd05806c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd04f400640 1 -- 172.21.15.5:0/4244723077 >> v1:172.21.15.117:6789/0 conn(0x7fd0580ca3e0 legacy=0x7fd0580d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd04f400640 1 -- 172.21.15.5:0/4244723077 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0580cf600 con 0x7fd0580cee40 2024-08-18T22:33:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd04f400640 1 --2- 172.21.15.5:0/4244723077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0580cee40 0x7fd0580ae040 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fd040009870 tx=0x7fd04001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637fb5399ca87d6d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd057400640 1 -- 172.21.15.5:0/4244723077 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0400b5070 con 0x7fd0580cee40 2024-08-18T22:33:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd057400640 1 -- 172.21.15.5:0/4244723077 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0400a8a50 con 0x7fd0580cee40 2024-08-18T22:33:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd057400640 1 -- 172.21.15.5:0/4244723077 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0400a8e20 con 0x7fd0580cee40 2024-08-18T22:33:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd05f200640 1 -- 172.21.15.5:0/4244723077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0580cee40 msgr2=0x7fd0580ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd05f200640 1 --2- 172.21.15.5:0/4244723077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0580cee40 0x7fd0580ae040 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fd040009870 tx=0x7fd04001ed50 comp rx=0 tx=0).stop 2024-08-18T22:33:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd05f200640 1 -- 172.21.15.5:0/4244723077 shutdown_connections 2024-08-18T22:33:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd05f200640 1 --2- 172.21.15.5:0/4244723077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0580cee40 0x7fd0580ae040 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd05f200640 1 --2- 172.21.15.5:0/4244723077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd05815e460 0x7fd05806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.090+0000 7fd05f200640 1 -- 172.21.15.5:0/4244723077 >> 172.21.15.5:0/4244723077 conn(0x7fd05809aa40 msgr2=0x7fd0580b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 -- 172.21.15.5:0/4244723077 shutdown_connections 2024-08-18T22:33:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 -- 172.21.15.5:0/4244723077 wait complete. 2024-08-18T22:33:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 Processor -- start 2024-08-18T22:33:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 -- start start 2024-08-18T22:33:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0580ca3e0 0x7fd05815f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0580cee40 0x7fd058154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd05815e460 0x7fd0581564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd0580cfea0 con 0x7fd0580ca3e0 2024-08-18T22:33:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd0580cfbc0 con 0x7fd0580cee40 2024-08-18T22:33:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd0580b3620 con 0x7fd05815e460 2024-08-18T22:33:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd057e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0580ca3e0 0x7fd05815f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd057e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0580ca3e0 0x7fd05815f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51038/0 (socket says 172.21.15.5:51038) 2024-08-18T22:33:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd057e00640 1 -- 172.21.15.5:0/387481768 learned_addr learned my addr 172.21.15.5:0/387481768 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd04f400640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0580cee40 0x7fd058154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05d200640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd05815e460 0x7fd0581564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd057e00640 1 -- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd05815e460 msgr2=0x7fd0581564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd057e00640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd05815e460 0x7fd0581564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd057e00640 1 -- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0580cee40 msgr2=0x7fd058154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd057e00640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0580cee40 0x7fd058154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd057e00640 1 -- 172.21.15.5:0/387481768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0580b4100 con 0x7fd0580ca3e0 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd04f400640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0580cee40 0x7fd058154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd057e00640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0580ca3e0 0x7fd05815f450 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fd04800e8a0 tx=0x7fd04800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd054c00640 1 -- 172.21.15.5:0/387481768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048017070 con 0x7fd0580ca3e0 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd054c00640 1 -- 172.21.15.5:0/387481768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04800c940 con 0x7fd0580ca3e0 2024-08-18T22:33:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd054c00640 1 -- 172.21.15.5:0/387481768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04800ccf0 con 0x7fd0580ca3e0 2024-08-18T22:33:34.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 -- 172.21.15.5:0/387481768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0580b43e0 con 0x7fd0580ca3e0 2024-08-18T22:33:34.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.094+0000 7fd05f200640 1 -- 172.21.15.5:0/387481768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0580b49a0 con 0x7fd0580ca3e0 2024-08-18T22:33:34.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.098+0000 7fd05f200640 1 -- 172.21.15.5:0/387481768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05815f9f0 con 0x7fd0580ca3e0 2024-08-18T22:33:34.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.098+0000 7fd054c00640 1 -- 172.21.15.5:0/387481768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd04801a070 con 0x7fd0580ca3e0 2024-08-18T22:33:34.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.098+0000 7fd054c00640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0340678c0 0x7fd034069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.098+0000 7fd054c00640 1 -- 172.21.15.5:0/387481768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 6101+0+0 (secure 0 0 0) 0x7fd0480860d0 con 0x7fd0580ca3e0 2024-08-18T22:33:34.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.098+0000 7fd04f400640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0340678c0 0x7fd034069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.098+0000 7fd04f400640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0340678c0 0x7fd034069d80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd0400b2000 tx=0x7fd040008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.102+0000 7fd054c00640 1 -- 172.21.15.5:0/387481768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd048056a60 con 0x7fd0580ca3e0 2024-08-18T22:33:34.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.270+0000 7fd05f200640 1 -- 172.21.15.5:0/387481768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd05806c3c0 con 0x7fd0580ca3e0 2024-08-18T22:33:34.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.270+0000 7fd054c00640 1 -- 172.21.15.5:0/387481768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) ==== 74+0+16825 (secure 0 0 0) 0x7fd048056360 con 0x7fd0580ca3e0 2024-08-18T22:33:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:34.268 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":203,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:33:32.949302+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:33:30.682845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-08-18T22:33:31.952993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:33:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 -- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0340678c0 msgr2=0x7fd034069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0340678c0 0x7fd034069d80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd0400b2000 tx=0x7fd040008040 comp rx=0 tx=0).stop 2024-08-18T22:33:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 -- 172.21.15.5:0/387481768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0580ca3e0 msgr2=0x7fd05815f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0580ca3e0 0x7fd05815f450 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fd04800e8a0 tx=0x7fd04800eca0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 -- 172.21.15.5:0/387481768 shutdown_connections 2024-08-18T22:33:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd0340678c0 0x7fd034069d80 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd05815e460 0x7fd0581564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0580cee40 0x7fd058154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 --2- 172.21.15.5:0/387481768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0580ca3e0 0x7fd05815f450 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 -- 172.21.15.5:0/387481768 >> 172.21.15.5:0/387481768 conn(0x7fd05809aa40 msgr2=0x7fd05815d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 -- 172.21.15.5:0/387481768 shutdown_connections 2024-08-18T22:33:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.274+0000 7fd05f200640 1 -- 172.21.15.5:0/387481768 wait complete. 2024-08-18T22:33:34.291 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T22:33:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.438+0000 7ffa3d400640 1 Processor -- start 2024-08-18T22:33:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.438+0000 7ffa3d400640 1 -- start start 2024-08-18T22:33:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa3d400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa3815c180 0x7ffa380cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa3d400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa3815c560 0x7ffa380ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa3d400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa380cfb00 con 0x7ffa3815d4d0 2024-08-18T22:33:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa3d400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ffa3815d040 con 0x7ffa3815c180 2024-08-18T22:33:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa3d400640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ffa3815c9f0 con 0x7ffa3815c560 2024-08-18T22:33:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa36800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa3815c180 0x7ffa380cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa36800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffa3815c180 0x7ffa380cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51046/0 (socket says 172.21.15.5:51046) 2024-08-18T22:33:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa36800640 1 -- 172.21.15.5:0/1420788229 learned_addr learned my addr 172.21.15.5:0/1420788229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa2de00640 1 --2- 172.21.15.5:0/1420788229 >> v2:172.21.15.117:3300/0 conn(0x7ffa3815c560 0x7ffa380ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa36800640 1 -- 172.21.15.5:0/1420788229 >> v2:172.21.15.117:3300/0 conn(0x7ffa3815c560 msgr2=0x7ffa380ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa36800640 1 --2- 172.21.15.5:0/1420788229 >> v2:172.21.15.117:3300/0 conn(0x7ffa3815c560 0x7ffa380ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa36800640 1 -- 172.21.15.5:0/1420788229 >> v1:172.21.15.117:6789/0 conn(0x7ffa3815d4d0 legacy=0x7ffa3815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa36800640 1 -- 172.21.15.5:0/1420788229 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3815ccd0 con 0x7ffa3815c180 2024-08-18T22:33:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa36800640 1 --2- 172.21.15.5:0/1420788229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3815c180 0x7ffa380cdf10 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7ffa380b5260 tx=0x7ffa2801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168925cf31fe7540 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa35e00640 1 -- 172.21.15.5:0/1420788229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa280a5840 con 0x7ffa3815c180 2024-08-18T22:33:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa35e00640 1 -- 172.21.15.5:0/1420788229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa280a59e0 con 0x7ffa3815c180 2024-08-18T22:33:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.442+0000 7ffa35e00640 1 -- 172.21.15.5:0/1420788229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa280a5db0 con 0x7ffa3815c180 2024-08-18T22:33:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 -- 172.21.15.5:0/1420788229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3815c180 msgr2=0x7ffa380cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 --2- 172.21.15.5:0/1420788229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3815c180 0x7ffa380cdf10 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7ffa380b5260 tx=0x7ffa2801c960 comp rx=0 tx=0).stop 2024-08-18T22:33:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 -- 172.21.15.5:0/1420788229 shutdown_connections 2024-08-18T22:33:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 --2- 172.21.15.5:0/1420788229 >> v2:172.21.15.117:3300/0 conn(0x7ffa3815c560 0x7ffa380ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 --2- 172.21.15.5:0/1420788229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3815c180 0x7ffa380cdf10 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 -- 172.21.15.5:0/1420788229 >> 172.21.15.5:0/1420788229 conn(0x7ffa380b1dc0 msgr2=0x7ffa380b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 -- 172.21.15.5:0/1420788229 shutdown_connections 2024-08-18T22:33:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 -- 172.21.15.5:0/1420788229 wait complete. 2024-08-18T22:33:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 Processor -- start 2024-08-18T22:33:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 -- start start 2024-08-18T22:33:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa3815c180 0x7ffa381539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa3815d4d0 0x7ffa380adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa380ae080 0x7ffa38156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffa381692b0 con 0x7ffa380ae080 2024-08-18T22:33:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa38169130 con 0x7ffa3815c180 2024-08-18T22:33:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa3d400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffa38169430 con 0x7ffa3815d4d0 2024-08-18T22:33:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa37200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa380ae080 0x7ffa38156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa37200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa380ae080 0x7ffa38156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51058/0 (socket says 172.21.15.5:51058) 2024-08-18T22:33:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa37200640 1 -- 172.21.15.5:0/536216325 learned_addr learned my addr 172.21.15.5:0/536216325 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa36800640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa3815c180 0x7ffa381539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa2de00640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa3815d4d0 0x7ffa380adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa37200640 1 -- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa3815d4d0 msgr2=0x7ffa380adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa37200640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa3815d4d0 0x7ffa380adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa37200640 1 -- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa3815c180 msgr2=0x7ffa381539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa37200640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa3815c180 0x7ffa381539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.446+0000 7ffa37200640 1 -- 172.21.15.5:0/536216325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa380aeea0 con 0x7ffa380ae080 2024-08-18T22:33:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.450+0000 7ffa37200640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa380ae080 0x7ffa38156070 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000c430 tx=0x7ffa3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.450+0000 7ffa2f400640 1 -- 172.21.15.5:0/536216325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30005220 con 0x7ffa380ae080 2024-08-18T22:33:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.450+0000 7ffa2f400640 1 -- 172.21.15.5:0/536216325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa300053c0 con 0x7ffa380ae080 2024-08-18T22:33:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.450+0000 7ffa2f400640 1 -- 172.21.15.5:0/536216325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30007270 con 0x7ffa380ae080 2024-08-18T22:33:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.450+0000 7ffa3d400640 1 -- 172.21.15.5:0/536216325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa380ae600 con 0x7ffa380ae080 2024-08-18T22:33:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.450+0000 7ffa3d400640 1 -- 172.21.15.5:0/536216325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa380aebc0 con 0x7ffa380ae080 2024-08-18T22:33:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.450+0000 7ffa3d400640 1 -- 172.21.15.5:0/536216325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa3815fd90 con 0x7ffa380ae080 2024-08-18T22:33:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.450+0000 7ffa2f400640 1 -- 172.21.15.5:0/536216325 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffa30019020 con 0x7ffa380ae080 2024-08-18T22:33:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.450+0000 7ffa2f400640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffa140678f0 0x7ffa14069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.450+0000 7ffa2f400640 1 -- 172.21.15.5:0/536216325 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 6101+0+0 (secure 0 0 0) 0x7ffa30084fa0 con 0x7ffa380ae080 2024-08-18T22:33:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.450+0000 7ffa36800640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffa140678f0 0x7ffa14069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.454+0000 7ffa36800640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffa140678f0 0x7ffa14069db0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ffa280ae000 tx=0x7ffa280a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.454+0000 7ffa2f400640 1 -- 172.21.15.5:0/536216325 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ffa30055260 con 0x7ffa380ae080 2024-08-18T22:33:34.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:34.658+0000 7ffa3d400640 1 -- 172.21.15.5:0/536216325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ffa3806f0f0 con 0x7ffa380ae080 2024-08-18T22:33:35.527 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-08-18T22:33:35.529+0000 7f89e5400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:33:35.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.582+0000 7ffa2f400640 1 -- 172.21.15.5:0/536216325 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v159) ==== 118+0+0 (secure 0 0 0) 0x7ffa30059560 con 0x7ffa380ae080 2024-08-18T22:33:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 -- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffa140678f0 msgr2=0x7ffa14069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffa140678f0 0x7ffa14069db0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ffa280ae000 tx=0x7ffa280a7070 comp rx=0 tx=0).stop 2024-08-18T22:33:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 -- 172.21.15.5:0/536216325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa380ae080 msgr2=0x7ffa38156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa380ae080 0x7ffa38156070 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000c430 tx=0x7ffa3000c8f0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 -- 172.21.15.5:0/536216325 shutdown_connections 2024-08-18T22:33:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffa140678f0 0x7ffa14069db0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa380ae080 0x7ffa38156070 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa3815d4d0 0x7ffa380adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 --2- 172.21.15.5:0/536216325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa3815c180 0x7ffa381539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 -- 172.21.15.5:0/536216325 >> 172.21.15.5:0/536216325 conn(0x7ffa380b1dc0 msgr2=0x7ffa380729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 -- 172.21.15.5:0/536216325 shutdown_connections 2024-08-18T22:33:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.586+0000 7ffa3d400640 1 -- 172.21.15.5:0/536216325 wait complete. 2024-08-18T22:33:35.608 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T22:33:35.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T22:33:35.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.758+0000 7f7aae200640 1 Processor -- start 2024-08-18T22:33:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.758+0000 7f7aae200640 1 -- start start 2024-08-18T22:33:35.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.762+0000 7f7aae200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aa80b55f0 0x7f7aa80b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:35.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.762+0000 7f7aae200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa806eae0 con 0x7f7aa80b3fe0 2024-08-18T22:33:35.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.762+0000 7f7aae200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa8071440 con 0x7f7aa815e060 2024-08-18T22:33:35.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.762+0000 7f7aae200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa80b4990 con 0x7f7aa80b55f0 2024-08-18T22:33:35.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.762+0000 7f7aad800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aa80b55f0 0x7f7aa80b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.762+0000 7f7aad800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aa80b55f0 0x7f7aa80b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51066/0 (socket says 172.21.15.5:51066) 2024-08-18T22:33:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.762+0000 7f7aad800640 1 -- 172.21.15.5:0/432647935 learned_addr learned my addr 172.21.15.5:0/432647935 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.762+0000 7f7aad800640 1 -- 172.21.15.5:0/432647935 >> v1:172.21.15.117:6789/0 conn(0x7f7aa815e060 legacy=0x7f7aa8071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.762+0000 7f7aad800640 1 -- 172.21.15.5:0/432647935 >> v1:172.21.15.5:6789/0 conn(0x7f7aa80b3fe0 legacy=0x7f7aa80b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.762+0000 7f7aad800640 1 -- 172.21.15.5:0/432647935 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa806e800 con 0x7f7aa80b55f0 2024-08-18T22:33:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aad800640 1 --2- 172.21.15.5:0/432647935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80b55f0 0x7f7aa80b4450 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009e50 tx=0x7f7aa001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0db75d00cdf316 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aa7400640 1 -- 172.21.15.5:0/432647935 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00a5880 con 0x7f7aa80b55f0 2024-08-18T22:33:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aa7400640 1 -- 172.21.15.5:0/432647935 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa00a5a20 con 0x7f7aa80b55f0 2024-08-18T22:33:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aa7400640 1 -- 172.21.15.5:0/432647935 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00a5df0 con 0x7f7aa80b55f0 2024-08-18T22:33:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 -- 172.21.15.5:0/432647935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80b55f0 msgr2=0x7f7aa80b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 --2- 172.21.15.5:0/432647935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80b55f0 0x7f7aa80b4450 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009e50 tx=0x7f7aa001c9a0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 -- 172.21.15.5:0/432647935 shutdown_connections 2024-08-18T22:33:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 --2- 172.21.15.5:0/432647935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80b55f0 0x7f7aa80b4450 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 -- 172.21.15.5:0/432647935 >> 172.21.15.5:0/432647935 conn(0x7f7aa8067a70 msgr2=0x7f7aa8067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 -- 172.21.15.5:0/432647935 shutdown_connections 2024-08-18T22:33:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 -- 172.21.15.5:0/432647935 wait complete. 2024-08-18T22:33:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 Processor -- start 2024-08-18T22:33:35.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 -- start start 2024-08-18T22:33:35.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa80b3fe0 0x7f7aa8150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80b55f0 0x7f7aa814d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aa815e060 0x7f7aa8158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa806e3f0 con 0x7f7aa80b55f0 2024-08-18T22:33:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa806e270 con 0x7f7aa80b3fe0 2024-08-18T22:33:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aae200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa806e570 con 0x7f7aa815e060 2024-08-18T22:33:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.766+0000 7f7aa7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80b55f0 0x7f7aa814d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80b55f0 0x7f7aa814d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51078/0 (socket says 172.21.15.5:51078) 2024-08-18T22:33:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa7e00640 1 -- 172.21.15.5:0/1222481954 learned_addr learned my addr 172.21.15.5:0/1222481954 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aace00640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa80b3fe0 0x7f7aa8150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aad800640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aa815e060 0x7f7aa8158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa7e00640 1 -- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aa815e060 msgr2=0x7f7aa8158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa7e00640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aa815e060 0x7f7aa8158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa7e00640 1 -- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa80b3fe0 msgr2=0x7f7aa8150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa7e00640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa80b3fe0 0x7f7aa8150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa7e00640 1 -- 172.21.15.5:0/1222481954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa814f600 con 0x7f7aa80b55f0 2024-08-18T22:33:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa7e00640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80b55f0 0x7f7aa814d970 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400c3c0 tx=0x7f7a9400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa4c00640 1 -- 172.21.15.5:0/1222481954 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94017070 con 0x7f7aa80b55f0 2024-08-18T22:33:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa4c00640 1 -- 172.21.15.5:0/1222481954 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a940052d0 con 0x7f7aa80b55f0 2024-08-18T22:33:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aae200640 1 -- 172.21.15.5:0/1222481954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa814f8a0 con 0x7f7aa80b55f0 2024-08-18T22:33:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa4c00640 1 -- 172.21.15.5:0/1222481954 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94003840 con 0x7f7aa80b55f0 2024-08-18T22:33:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aae200640 1 -- 172.21.15.5:0/1222481954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa814fe60 con 0x7f7aa80b55f0 2024-08-18T22:33:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aae200640 1 -- 172.21.15.5:0/1222481954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa80b4450 con 0x7f7aa80b55f0 2024-08-18T22:33:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.770+0000 7f7aa4c00640 1 -- 172.21.15.5:0/1222481954 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a9401a070 con 0x7f7aa80b55f0 2024-08-18T22:33:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.774+0000 7f7aa4c00640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 0x7f7a88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.774+0000 7f7aa4c00640 1 -- 172.21.15.5:0/1222481954 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f7a940850e0 con 0x7f7aa80b55f0 2024-08-18T22:33:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.774+0000 7f7aace00640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 0x7f7a88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.774+0000 7f7aace00640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 0x7f7a88069d80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7a98007fd0 tx=0x7f7a98009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.778+0000 7f7aa4c00640 1 -- 172.21.15.5:0/1222481954 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7a94005480 con 0x7f7aa80b55f0 2024-08-18T22:33:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:35.974+0000 7f7aae200640 1 -- 172.21.15.5:0/1222481954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7aa80721c0 con 0x7f7aa80b55f0 2024-08-18T22:33:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aa4c00640 1 -- 172.21.15.5:0/1222481954 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v160) ==== 122+0+0 (secure 0 0 0) 0x7f7a94055430 con 0x7f7aa80b55f0 2024-08-18T22:33:36.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 -- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 msgr2=0x7f7a88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 0x7f7a88069d80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7a98007fd0 tx=0x7f7a98009040 comp rx=0 tx=0).stop 2024-08-18T22:33:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 -- 172.21.15.5:0/1222481954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80b55f0 msgr2=0x7f7aa814d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80b55f0 0x7f7aa814d970 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400c3c0 tx=0x7f7a9400c880 comp rx=0 tx=0).stop 2024-08-18T22:33:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 -- 172.21.15.5:0/1222481954 shutdown_connections 2024-08-18T22:33:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f7a880678c0 0x7f7a88069d80 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7aa815e060 0x7f7aa8158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa80b55f0 0x7f7aa814d970 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 --2- 172.21.15.5:0/1222481954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa80b3fe0 0x7f7aa8150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 -- 172.21.15.5:0/1222481954 >> 172.21.15.5:0/1222481954 conn(0x7f7aa8067a70 msgr2=0x7f7aa80d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 -- 172.21.15.5:0/1222481954 shutdown_connections 2024-08-18T22:33:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.590+0000 7f7aae200640 1 -- 172.21.15.5:0/1222481954 wait complete. 2024-08-18T22:33:36.608 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T22:33:36.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:33:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e4800640 1 Processor -- start 2024-08-18T22:33:36.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e4800640 1 -- start start 2024-08-18T22:33:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e4800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3dc0cb390 0x7fe3dc0735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:36.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e4800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3dc073c80 con 0x7fe3dc15bed0 2024-08-18T22:33:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e4800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3dc0ca5d0 con 0x7fe3dc06da70 2024-08-18T22:33:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e4800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe3dc0ca8b0 con 0x7fe3dc0cb390 2024-08-18T22:33:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e1e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe3dc15bed0 0x7fe3dc071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37258/0 (socket says 172.21.15.5:37258) 2024-08-18T22:33:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e1e00640 1 -- 172.21.15.5:0/2688435615 learned_addr learned my addr 172.21.15.5:0/2688435615 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e1400640 1 --2- 172.21.15.5:0/2688435615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3dc0cb390 0x7fe3dc0735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e0a00640 1 -- 172.21.15.5:0/2688435615 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4213298307 0 0) 0x7fe3dc073c80 con 0x7fe3dc15bed0 2024-08-18T22:33:36.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e0a00640 1 -- 172.21.15.5:0/2688435615 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3c4003530 con 0x7fe3dc15bed0 2024-08-18T22:33:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e0a00640 1 -- 172.21.15.5:0/2688435615 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2698480017 0 0) 0x7fe3dc0ca5d0 con 0x7fe3dc06da70 2024-08-18T22:33:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e0a00640 1 -- 172.21.15.5:0/2688435615 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3dc073c80 con 0x7fe3dc06da70 2024-08-18T22:33:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e1400640 1 -- 172.21.15.5:0/2688435615 >> v1:172.21.15.117:6789/0 conn(0x7fe3dc06da70 legacy=0x7fe3dc165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e0a00640 1 -- 172.21.15.5:0/2688435615 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1336325967 0 0) 0x7fe3c4003530 con 0x7fe3dc15bed0 2024-08-18T22:33:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e1400640 1 -- 172.21.15.5:0/2688435615 >> v1:172.21.15.5:6789/0 conn(0x7fe3dc15bed0 legacy=0x7fe3dc071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:36.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.754+0000 7fe3e1400640 1 -- 172.21.15.5:0/2688435615 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3dc0cab90 con 0x7fe3dc0cb390 2024-08-18T22:33:36.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.758+0000 7fe3e1400640 1 --2- 172.21.15.5:0/2688435615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3dc0cb390 0x7fe3dc0735a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0097f0 tx=0x7fe3cc01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e244fc1a34f5e7bf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:36.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.758+0000 7fe3e0a00640 1 -- 172.21.15.5:0/2688435615 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0b0070 con 0x7fe3dc0cb390 2024-08-18T22:33:36.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.758+0000 7fe3e0a00640 1 -- 172.21.15.5:0/2688435615 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc0ab400 con 0x7fe3dc0cb390 2024-08-18T22:33:36.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.758+0000 7fe3e0a00640 1 -- 172.21.15.5:0/2688435615 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0001680 con 0x7fe3dc0cb390 2024-08-18T22:33:36.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.758+0000 7fe3e4800640 1 -- 172.21.15.5:0/2688435615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3dc0cb390 msgr2=0x7fe3dc0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:36.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.758+0000 7fe3e4800640 1 --2- 172.21.15.5:0/2688435615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3dc0cb390 0x7fe3dc0735a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0097f0 tx=0x7fe3cc01c3d0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.758+0000 7fe3e4800640 1 -- 172.21.15.5:0/2688435615 shutdown_connections 2024-08-18T22:33:36.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.758+0000 7fe3e4800640 1 --2- 172.21.15.5:0/2688435615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3dc0cb390 0x7fe3dc0735a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.758+0000 7fe3e4800640 1 -- 172.21.15.5:0/2688435615 >> 172.21.15.5:0/2688435615 conn(0x7fe3dc0b1c50 msgr2=0x7fe3dc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:36.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.758+0000 7fe3e4800640 1 -- 172.21.15.5:0/2688435615 shutdown_connections 2024-08-18T22:33:36.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.758+0000 7fe3e4800640 1 -- 172.21.15.5:0/2688435615 wait complete. 2024-08-18T22:33:36.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e4800640 1 Processor -- start 2024-08-18T22:33:36.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e4800640 1 -- start start 2024-08-18T22:33:36.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e4800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3dc06da70 0x7fe3dc153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:36.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e4800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3dc0cb390 0x7fe3dc0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e4800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3dc15bed0 0x7fe3dc0b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e4800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc169c40 con 0x7fe3dc15bed0 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e4800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc169ac0 con 0x7fe3dc06da70 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e4800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe3dc169dc0 con 0x7fe3dc0cb390 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3dc15bed0 0x7fe3dc0b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e2800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3dc15bed0 0x7fe3dc0b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51080/0 (socket says 172.21.15.5:51080) 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e2800640 1 -- 172.21.15.5:0/3353224124 learned_addr learned my addr 172.21.15.5:0/3353224124 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e1e00640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3dc06da70 0x7fe3dc153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e1400640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3dc0cb390 0x7fe3dc0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e2800640 1 -- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3dc0cb390 msgr2=0x7fe3dc0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e2800640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3dc0cb390 0x7fe3dc0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e2800640 1 -- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3dc06da70 msgr2=0x7fe3dc153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:36.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e2800640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3dc06da70 0x7fe3dc153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e2800640 1 -- 172.21.15.5:0/3353224124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3dc0b57e0 con 0x7fe3dc15bed0 2024-08-18T22:33:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e2800640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3dc15bed0 0x7fe3dc0b0b20 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c790 tx=0x7fe3d800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3d6000640 1 -- 172.21.15.5:0/3353224124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8003b80 con 0x7fe3dc15bed0 2024-08-18T22:33:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3d6000640 1 -- 172.21.15.5:0/3353224124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d8003d20 con 0x7fe3dc15bed0 2024-08-18T22:33:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3d6000640 1 -- 172.21.15.5:0/3353224124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d800aa50 con 0x7fe3dc15bed0 2024-08-18T22:33:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e4800640 1 -- 172.21.15.5:0/3353224124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3dc0b3310 con 0x7fe3dc15bed0 2024-08-18T22:33:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e4800640 1 -- 172.21.15.5:0/3353224124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3dc0b5d30 con 0x7fe3dc15bed0 2024-08-18T22:33:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.762+0000 7fe3e4800640 1 -- 172.21.15.5:0/3353224124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3dc157370 con 0x7fe3dc15bed0 2024-08-18T22:33:36.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.766+0000 7fe3d6000640 1 -- 172.21.15.5:0/3353224124 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3d800abf0 con 0x7fe3dc15bed0 2024-08-18T22:33:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.766+0000 7fe3d6000640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe3c00678c0 0x7fe3c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.766+0000 7fe3d6000640 1 -- 172.21.15.5:0/3353224124 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fe3d8085ec0 con 0x7fe3dc15bed0 2024-08-18T22:33:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.766+0000 7fe3e1e00640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe3c00678c0 0x7fe3c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.766+0000 7fe3e1e00640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe3c00678c0 0x7fe3c0069d80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00011f0 tx=0x7fe3d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:36.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.770+0000 7fe3d6000640 1 -- 172.21.15.5:0/3353224124 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe3dc157370 con 0x7fe3dc15bed0 2024-08-18T22:33:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.970+0000 7fe3e4800640 1 -- 172.21.15.5:0/3353224124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3dc0735a0 con 0x7fe3dc15bed0 2024-08-18T22:33:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.970+0000 7fe3d6000640 1 -- 172.21.15.5:0/3353224124 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5234 (secure 0 0 0) 0x7fe3d80567d0 con 0x7fe3dc15bed0 2024-08-18T22:33:36.969 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:36.969 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":160,"btime":"2024-08-18T22:33:36:585978+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1931701065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1931701065},{"type":"v1","addr":"172.21.15.117:6837","nonce":1931701065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10731,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/83313921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":83313921},{"type":"v1","addr":"172.21.15.5:6833","nonce":83313921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2593956905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2593956905},{"type":"v1","addr":"172.21.15.5:6835","nonce":2593956905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:33:32.949657+0000","modified":"2024-08-18T22:33:35.978872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10740":{"gid":10740,"name":"d","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6836/3939158605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3939158605},{"type":"v1","addr":"172.21.15.117:6836","nonce":3939158605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10740,"qdb_cluster":[10740]},"id":14}]} 2024-08-18T22:33:36.969 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 160 2024-08-18T22:33:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 -- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe3c00678c0 msgr2=0x7fe3c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe3c00678c0 0x7fe3c0069d80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00011f0 tx=0x7fe3d0009040 comp rx=0 tx=0).stop 2024-08-18T22:33:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 -- 172.21.15.5:0/3353224124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3dc15bed0 msgr2=0x7fe3dc0b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3dc15bed0 0x7fe3dc0b0b20 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800c790 tx=0x7fe3d800cc50 comp rx=0 tx=0).stop 2024-08-18T22:33:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 -- 172.21.15.5:0/3353224124 shutdown_connections 2024-08-18T22:33:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe3c00678c0 0x7fe3c0069d80 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3dc15bed0 0x7fe3dc0b0b20 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3dc0cb390 0x7fe3dc0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 --2- 172.21.15.5:0/3353224124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3dc06da70 0x7fe3dc153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:36.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 -- 172.21.15.5:0/3353224124 >> 172.21.15.5:0/3353224124 conn(0x7fe3dc0b1c50 msgr2=0x7fe3dc0ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:36.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 -- 172.21.15.5:0/3353224124 shutdown_connections 2024-08-18T22:33:36.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:36.974+0000 7fe3e4800640 1 -- 172.21.15.5:0/3353224124 wait complete. 2024-08-18T22:33:36.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:33:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.134+0000 7f7874000640 1 Processor -- start 2024-08-18T22:33:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.134+0000 7f7874000640 1 -- start start 2024-08-18T22:33:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.134+0000 7f7874000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f786c06f290 0x7f786c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.134+0000 7f7874000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786c0cd850 con 0x7f786c0cd3a0 2024-08-18T22:33:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.134+0000 7f7874000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786c0cee20 con 0x7f786c15b010 2024-08-18T22:33:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.134+0000 7f7874000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f786c0cfa30 con 0x7f786c06f290 2024-08-18T22:33:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.134+0000 7f7872000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f786c0cd3a0 0x7f786c072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37268/0 (socket says 172.21.15.5:37268) 2024-08-18T22:33:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.134+0000 7f7872000640 1 -- 172.21.15.5:0/2339405585 learned_addr learned my addr 172.21.15.5:0/2339405585 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.138+0000 7f7870c00640 1 --2- 172.21.15.5:0/2339405585 >> v2:172.21.15.117:3300/0 conn(0x7f786c06f290 0x7f786c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.138+0000 7f786be00640 1 -- 172.21.15.5:0/2339405585 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3744836752 0 0) 0x7f786c0cd850 con 0x7f786c0cd3a0 2024-08-18T22:33:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.138+0000 7f786be00640 1 -- 172.21.15.5:0/2339405585 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7854003530 con 0x7f786c0cd3a0 2024-08-18T22:33:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.138+0000 7f7870c00640 1 -- 172.21.15.5:0/2339405585 >> v1:172.21.15.117:6789/0 conn(0x7f786c15b010 legacy=0x7f786c06eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.138+0000 7f7870c00640 1 -- 172.21.15.5:0/2339405585 >> v1:172.21.15.5:6789/0 conn(0x7f786c0cd3a0 legacy=0x7f786c072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.138+0000 7f7870c00640 1 -- 172.21.15.5:0/2339405585 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786c0cf100 con 0x7f786c06f290 2024-08-18T22:33:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.138+0000 7f7870c00640 1 --2- 172.21.15.5:0/2339405585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f786c06f290 0x7f786c0ce840 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f78580097c0 tx=0x7f785801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddb43c5cd1007dc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.138+0000 7f786be00640 1 -- 172.21.15.5:0/2339405585 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78580a7070 con 0x7f786c06f290 2024-08-18T22:33:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.138+0000 7f786be00640 1 -- 172.21.15.5:0/2339405585 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78580b0070 con 0x7f786c06f290 2024-08-18T22:33:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.138+0000 7f786be00640 1 -- 172.21.15.5:0/2339405585 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78580ab890 con 0x7f786c06f290 2024-08-18T22:33:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 -- 172.21.15.5:0/2339405585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f786c06f290 msgr2=0x7f786c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 --2- 172.21.15.5:0/2339405585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f786c06f290 0x7f786c0ce840 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f78580097c0 tx=0x7f785801c470 comp rx=0 tx=0).stop 2024-08-18T22:33:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 -- 172.21.15.5:0/2339405585 shutdown_connections 2024-08-18T22:33:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 --2- 172.21.15.5:0/2339405585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f786c06f290 0x7f786c0ce840 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 -- 172.21.15.5:0/2339405585 >> 172.21.15.5:0/2339405585 conn(0x7f786c0b1c50 msgr2=0x7f786c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 -- 172.21.15.5:0/2339405585 shutdown_connections 2024-08-18T22:33:37.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 -- 172.21.15.5:0/2339405585 wait complete. 2024-08-18T22:33:37.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 Processor -- start 2024-08-18T22:33:37.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 -- start start 2024-08-18T22:33:37.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f786c06f290 0x7f786c0b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f786c0cd3a0 0x7f786c0ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f786c15b010 0x7f786c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f786c0736c0 con 0x7f786c06f290 2024-08-18T22:33:37.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f786c073540 con 0x7f786c15b010 2024-08-18T22:33:37.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7874000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f786c073840 con 0x7f786c0cd3a0 2024-08-18T22:33:37.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7871600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f786c06f290 0x7f786c0b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7871600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f786c06f290 0x7f786c0b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51094/0 (socket says 172.21.15.5:51094) 2024-08-18T22:33:37.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7871600640 1 -- 172.21.15.5:0/3241729522 learned_addr learned my addr 172.21.15.5:0/3241729522 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:37.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7870c00640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f786c0cd3a0 0x7f786c0ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7872000640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f786c15b010 0x7f786c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7871600640 1 -- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f786c0cd3a0 msgr2=0x7f786c0ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7871600640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f786c0cd3a0 0x7f786c0ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7871600640 1 -- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f786c15b010 msgr2=0x7f786c0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7871600640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f786c15b010 0x7f786c0acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7871600640 1 -- 172.21.15.5:0/3241729522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786c15c810 con 0x7f786c06f290 2024-08-18T22:33:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.142+0000 7f7872000640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f786c15b010 0x7f786c0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.146+0000 7f7871600640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f786c06f290 0x7f786c0b0870 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f786000c420 tx=0x7f786000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.146+0000 7f7869600640 1 -- 172.21.15.5:0/3241729522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600052d0 con 0x7f786c06f290 2024-08-18T22:33:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.146+0000 7f7869600640 1 -- 172.21.15.5:0/3241729522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7860005470 con 0x7f786c06f290 2024-08-18T22:33:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.146+0000 7f7869600640 1 -- 172.21.15.5:0/3241729522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860007260 con 0x7f786c06f290 2024-08-18T22:33:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.146+0000 7f7874000640 1 -- 172.21.15.5:0/3241729522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f786c15b770 con 0x7f786c06f290 2024-08-18T22:33:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.146+0000 7f7874000640 1 -- 172.21.15.5:0/3241729522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f786c15bd30 con 0x7f786c06f290 2024-08-18T22:33:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.146+0000 7f7874000640 1 -- 172.21.15.5:0/3241729522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f786c0ce840 con 0x7f786c06f290 2024-08-18T22:33:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.146+0000 7f7869600640 1 -- 172.21.15.5:0/3241729522 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7860007400 con 0x7f786c06f290 2024-08-18T22:33:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.146+0000 7f7869600640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f784c0678f0 0x7f784c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.146+0000 7f7869600640 1 -- 172.21.15.5:0/3241729522 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f7860085ac0 con 0x7f786c06f290 2024-08-18T22:33:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.146+0000 7f7870c00640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f784c0678f0 0x7f784c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.150+0000 7f7870c00640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f784c0678f0 0x7f784c069db0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f78580af000 tx=0x7f78580a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.150+0000 7f7869600640 1 -- 172.21.15.5:0/3241729522 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f7860055e00 con 0x7f786c06f290 2024-08-18T22:33:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.314+0000 7f7874000640 1 -- 172.21.15.5:0/3241729522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f786c158390 con 0x7f786c06f290 2024-08-18T22:33:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.314+0000 7f7869600640 1 -- 172.21.15.5:0/3241729522 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) ==== 74+0+16812 (secure 0 0 0) 0x7f786005a100 con 0x7f786c06f290 2024-08-18T22:33:37.313 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:37.313 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":204,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:33:34.550645+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:33:30.682845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-08-18T22:33:31.952993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:33:37.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 -- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f784c0678f0 msgr2=0x7f784c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f784c0678f0 0x7f784c069db0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f78580af000 tx=0x7f78580a7000 comp rx=0 tx=0).stop 2024-08-18T22:33:37.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 -- 172.21.15.5:0/3241729522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f786c06f290 msgr2=0x7f786c0b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f786c06f290 0x7f786c0b0870 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f786000c420 tx=0x7f786000c8e0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 -- 172.21.15.5:0/3241729522 shutdown_connections 2024-08-18T22:33:37.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f784c0678f0 0x7f784c069db0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f786c15b010 0x7f786c0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f786c0cd3a0 0x7f786c0ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 --2- 172.21.15.5:0/3241729522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f786c06f290 0x7f786c0b0870 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 -- 172.21.15.5:0/3241729522 >> 172.21.15.5:0/3241729522 conn(0x7f786c0b1c50 msgr2=0x7f786c0cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 -- 172.21.15.5:0/3241729522 shutdown_connections 2024-08-18T22:33:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.318+0000 7f7874000640 1 -- 172.21.15.5:0/3241729522 wait complete. 2024-08-18T22:33:37.335 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:33:37.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:33:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.478+0000 7f808e600640 1 Processor -- start 2024-08-18T22:33:37.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.478+0000 7f808e600640 1 -- start start 2024-08-18T22:33:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.478+0000 7f808e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f808815e140 0x7f80880b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f808e600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80880b5e60 0x7f80880af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f808e600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f80880afc80 0x7f80880ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f808e600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f808806e560 con 0x7f80880b5e60 2024-08-18T22:33:37.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f808e600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f80880b65d0 con 0x7f80880afc80 2024-08-18T22:33:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f808e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f80880b68b0 con 0x7f808815e140 2024-08-18T22:33:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80880b5e60 0x7f80880af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80880b5e60 0x7f80880af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51106/0 (socket says 172.21.15.5:51106) 2024-08-18T22:33:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086a00640 1 -- 172.21.15.5:0/1134861790 learned_addr learned my addr 172.21.15.5:0/1134861790 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8087e00640 1 --2- 172.21.15.5:0/1134861790 >> v2:172.21.15.117:3300/0 conn(0x7f80880afc80 0x7f80880ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086a00640 1 -- 172.21.15.5:0/1134861790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f808815e140 msgr2=0x7f80880b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8087400640 1 --2- 172.21.15.5:0/1134861790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f808815e140 0x7f80880b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086a00640 1 --2- 172.21.15.5:0/1134861790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f808815e140 0x7f80880b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086a00640 1 -- 172.21.15.5:0/1134861790 >> v2:172.21.15.117:3300/0 conn(0x7f80880afc80 msgr2=0x7f80880ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086a00640 1 --2- 172.21.15.5:0/1134861790 >> v2:172.21.15.117:3300/0 conn(0x7f80880afc80 0x7f80880ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086a00640 1 -- 172.21.15.5:0/1134861790 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808806e7b0 con 0x7f80880b5e60 2024-08-18T22:33:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8087e00640 1 --2- 172.21.15.5:0/1134861790 >> v2:172.21.15.117:3300/0 conn(0x7f80880afc80 0x7f80880ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8087400640 1 --2- 172.21.15.5:0/1134861790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f808815e140 0x7f80880b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086a00640 1 --2- 172.21.15.5:0/1134861790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80880b5e60 0x7f80880af740 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f80880b6ac0 tx=0x7f807401c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62c1135758ec624 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086000640 1 -- 172.21.15.5:0/1134861790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80740b0070 con 0x7f80880b5e60 2024-08-18T22:33:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086000640 1 -- 172.21.15.5:0/1134861790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80740ab600 con 0x7f80880b5e60 2024-08-18T22:33:37.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.482+0000 7f8086000640 1 -- 172.21.15.5:0/1134861790 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80740ab9d0 con 0x7f80880b5e60 2024-08-18T22:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 -- 172.21.15.5:0/1134861790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80880b5e60 msgr2=0x7f80880af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 --2- 172.21.15.5:0/1134861790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80880b5e60 0x7f80880af740 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f80880b6ac0 tx=0x7f807401c1d0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 -- 172.21.15.5:0/1134861790 shutdown_connections 2024-08-18T22:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 --2- 172.21.15.5:0/1134861790 >> v2:172.21.15.117:3300/0 conn(0x7f80880afc80 0x7f80880ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 --2- 172.21.15.5:0/1134861790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80880b5e60 0x7f80880af740 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 --2- 172.21.15.5:0/1134861790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f808815e140 0x7f80880b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 -- 172.21.15.5:0/1134861790 >> 172.21.15.5:0/1134861790 conn(0x7f808806b9b0 msgr2=0x7f808806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 -- 172.21.15.5:0/1134861790 shutdown_connections 2024-08-18T22:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 -- 172.21.15.5:0/1134861790 wait complete. 2024-08-18T22:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 Processor -- start 2024-08-18T22:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 -- start start 2024-08-18T22:33:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80880afc80 0x7f80881f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80880b5e60 0x7f80881533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f808815e140 0x7f8088153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f808806f130 con 0x7f80880b5e60 2024-08-18T22:33:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f808806efb0 con 0x7f80880afc80 2024-08-18T22:33:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f808e600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f808806f2b0 con 0x7f808815e140 2024-08-18T22:33:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f8086a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80880b5e60 0x7f80881533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f8086a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80880b5e60 0x7f80881533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51112/0 (socket says 172.21.15.5:51112) 2024-08-18T22:33:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f8086a00640 1 -- 172.21.15.5:0/2031842105 learned_addr learned my addr 172.21.15.5:0/2031842105 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f8087400640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80880afc80 0x7f80881f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f8087e00640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f808815e140 0x7f8088153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f8086a00640 1 -- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f808815e140 msgr2=0x7f8088153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f8086a00640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f808815e140 0x7f8088153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f8086a00640 1 -- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80880afc80 msgr2=0x7f80881f86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f8086a00640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80880afc80 0x7f80881f86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.486+0000 7f8086a00640 1 -- 172.21.15.5:0/2031842105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80881f8be0 con 0x7f80880b5e60 2024-08-18T22:33:37.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.490+0000 7f8086a00640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80880b5e60 0x7f80881533c0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f80740ae040 tx=0x7f8074018f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:37.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.490+0000 7f807f400640 1 -- 172.21.15.5:0/2031842105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80740b9070 con 0x7f80880b5e60 2024-08-18T22:33:37.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.490+0000 7f807f400640 1 -- 172.21.15.5:0/2031842105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80740b4600 con 0x7f80880b5e60 2024-08-18T22:33:37.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.490+0000 7f808e600640 1 -- 172.21.15.5:0/2031842105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80881f8370 con 0x7f80880b5e60 2024-08-18T22:33:37.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.490+0000 7f807f400640 1 -- 172.21.15.5:0/2031842105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80740b0040 con 0x7f80880b5e60 2024-08-18T22:33:37.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.490+0000 7f808e600640 1 -- 172.21.15.5:0/2031842105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f808815ffb0 con 0x7f80880b5e60 2024-08-18T22:33:37.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.490+0000 7f808e600640 1 -- 172.21.15.5:0/2031842105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80880ad8b0 con 0x7f80880b5e60 2024-08-18T22:33:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.490+0000 7f807f400640 1 -- 172.21.15.5:0/2031842105 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80740bc070 con 0x7f80880b5e60 2024-08-18T22:33:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.490+0000 7f807f400640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80680678f0 0x7f8068069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.494+0000 7f807f400640 1 -- 172.21.15.5:0/2031842105 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f807411ef40 con 0x7f80880b5e60 2024-08-18T22:33:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.494+0000 7f8087400640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80680678f0 0x7f8068069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.494+0000 7f8087400640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80680678f0 0x7f8068069db0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8078006fd0 tx=0x7f8078008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.494+0000 7f807f400640 1 -- 172.21.15.5:0/2031842105 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8074016110 con 0x7f80880b5e60 2024-08-18T22:33:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.658+0000 7f808e600640 1 -- 172.21.15.5:0/2031842105 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80880d06c0 con 0x7f80680678f0 2024-08-18T22:33:37.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.666+0000 7f807f400640 1 -- 172.21.15.5:0/2031842105 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252427 (secure 0 0 0) 0x7f80880d06c0 con 0x7f80680678f0 2024-08-18T22:33:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:37.669 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:33:37.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 -- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80680678f0 msgr2=0x7f8068069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80680678f0 0x7f8068069db0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8078006fd0 tx=0x7f8078008040 comp rx=0 tx=0).stop 2024-08-18T22:33:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 -- 172.21.15.5:0/2031842105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80880b5e60 msgr2=0x7f80881533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80880b5e60 0x7f80881533c0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f80740ae040 tx=0x7f8074018f70 comp rx=0 tx=0).stop 2024-08-18T22:33:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 -- 172.21.15.5:0/2031842105 shutdown_connections 2024-08-18T22:33:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f80680678f0 0x7f8068069db0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f808815e140 0x7f8088153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80880b5e60 0x7f80881533c0 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 --2- 172.21.15.5:0/2031842105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80880afc80 0x7f80881f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 -- 172.21.15.5:0/2031842105 >> 172.21.15.5:0/2031842105 conn(0x7f808806b9b0 msgr2=0x7f808806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 -- 172.21.15.5:0/2031842105 shutdown_connections 2024-08-18T22:33:37.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.670+0000 7f808e600640 1 -- 172.21.15.5:0/2031842105 wait complete. 2024-08-18T22:33:37.685 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":632,"stamp":"2024-08-18T22:33:35.832039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431604,"kb_used_data":21128,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754543116,"statfs":{"total":773094113280,"available":772652150784,"internally_reserved":0,"allocated":21635072,"data_stored":10835252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.290898"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.578371+0000","last_change":"2024-08-18T22:33:33.575423+0000","last_active":"2024-08-18T22:33:33.578371+0000","last_peered":"2024-08-18T22:33:33.578371+0000","last_clean":"2024-08-18T22:33:33.578371+0000","last_became_active":"2024-08-18T22:33:33.575152+0000","last_became_peered":"2024-08-18T22:33:33.575152+0000","last_unstale":"2024-08-18T22:33:33.578371+0000","last_undegraded":"2024-08-18T22:33:33.578371+0000","last_fullsized":"2024-08-18T22:33:33.578371+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:07.672462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.580057+0000","last_change":"2024-08-18T22:33:33.578175+0000","last_active":"2024-08-18T22:33:33.580057+0000","last_peered":"2024-08-18T22:33:33.580057+0000","last_clean":"2024-08-18T22:33:33.580057+0000","last_became_active":"2024-08-18T22:33:33.577902+0000","last_became_peered":"2024-08-18T22:33:33.577902+0000","last_unstale":"2024-08-18T22:33:33.580057+0000","last_undegraded":"2024-08-18T22:33:33.580057+0000","last_fullsized":"2024-08-18T22:33:33.580057+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:15.353659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585111+0000","last_change":"2024-08-18T22:33:33.580727+0000","last_active":"2024-08-18T22:33:33.585111+0000","last_peered":"2024-08-18T22:33:33.585111+0000","last_clean":"2024-08-18T22:33:33.585111+0000","last_became_active":"2024-08-18T22:33:33.580417+0000","last_became_peered":"2024-08-18T22:33:33.580417+0000","last_unstale":"2024-08-18T22:33:33.585111+0000","last_undegraded":"2024-08-18T22:33:33.585111+0000","last_fullsized":"2024-08-18T22:33:33.585111+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:47:26.590912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555334+0000","last_change":"2024-08-18T22:33:33.589142+0000","last_active":"2024-08-18T22:33:34.555334+0000","last_peered":"2024-08-18T22:33:34.555334+0000","last_clean":"2024-08-18T22:33:34.555334+0000","last_became_active":"2024-08-18T22:33:33.588838+0000","last_became_peered":"2024-08-18T22:33:33.588838+0000","last_unstale":"2024-08-18T22:33:34.555334+0000","last_undegraded":"2024-08-18T22:33:34.555334+0000","last_fullsized":"2024-08-18T22:33:34.555334+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:45.974299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.573114+0000","last_change":"2024-08-18T22:33:33.568962+0000","last_active":"2024-08-18T22:33:33.573114+0000","last_peered":"2024-08-18T22:33:33.573114+0000","last_clean":"2024-08-18T22:33:33.573114+0000","last_became_active":"2024-08-18T22:33:33.567641+0000","last_became_peered":"2024-08-18T22:33:33.567641+0000","last_unstale":"2024-08-18T22:33:33.573114+0000","last_undegraded":"2024-08-18T22:33:33.573114+0000","last_fullsized":"2024-08-18T22:33:33.573114+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:35.771631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585674+0000","last_change":"2024-08-18T22:33:33.571547+0000","last_active":"2024-08-18T22:33:33.585674+0000","last_peered":"2024-08-18T22:33:33.585674+0000","last_clean":"2024-08-18T22:33:33.585674+0000","last_became_active":"2024-08-18T22:33:33.571272+0000","last_became_peered":"2024-08-18T22:33:33.571272+0000","last_unstale":"2024-08-18T22:33:33.585674+0000","last_undegraded":"2024-08-18T22:33:33.585674+0000","last_fullsized":"2024-08-18T22:33:33.585674+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:26:32.096822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.583199+0000","last_change":"2024-08-18T22:33:33.578724+0000","last_active":"2024-08-18T22:33:33.583199+0000","last_peered":"2024-08-18T22:33:33.583199+0000","last_clean":"2024-08-18T22:33:33.583199+0000","last_became_active":"2024-08-18T22:33:33.575125+0000","last_became_peered":"2024-08-18T22:33:33.575125+0000","last_unstale":"2024-08-18T22:33:33.583199+0000","last_undegraded":"2024-08-18T22:33:33.583199+0000","last_fullsized":"2024-08-18T22:33:33.583199+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:58.718903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.590128+0000","last_change":"2024-08-18T22:33:33.578970+0000","last_active":"2024-08-18T22:33:33.590128+0000","last_peered":"2024-08-18T22:33:33.590128+0000","last_clean":"2024-08-18T22:33:33.590128+0000","last_became_active":"2024-08-18T22:33:33.578671+0000","last_became_peered":"2024-08-18T22:33:33.578671+0000","last_unstale":"2024-08-18T22:33:33.590128+0000","last_undegraded":"2024-08-18T22:33:33.590128+0000","last_fullsized":"2024-08-18T22:33:33.590128+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:21:07.749533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.109870+0000","last_change":"2024-08-18T22:33:33.572639+0000","last_active":"2024-08-18T22:33:35.109870+0000","last_peered":"2024-08-18T22:33:35.109870+0000","last_clean":"2024-08-18T22:33:35.109870+0000","last_became_active":"2024-08-18T22:33:33.571312+0000","last_became_peered":"2024-08-18T22:33:33.571312+0000","last_unstale":"2024-08-18T22:33:35.109870+0000","last_undegraded":"2024-08-18T22:33:35.109870+0000","last_fullsized":"2024-08-18T22:33:35.109870+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:54:09.465854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.583661+0000","last_change":"2024-08-18T22:33:33.577258+0000","last_active":"2024-08-18T22:33:33.583661+0000","last_peered":"2024-08-18T22:33:33.583661+0000","last_clean":"2024-08-18T22:33:33.583661+0000","last_became_active":"2024-08-18T22:33:33.576922+0000","last_became_peered":"2024-08-18T22:33:33.576922+0000","last_unstale":"2024-08-18T22:33:33.583661+0000","last_undegraded":"2024-08-18T22:33:33.583661+0000","last_fullsized":"2024-08-18T22:33:33.583661+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:33:59.428445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555588+0000","last_change":"2024-08-18T22:33:33.580150+0000","last_active":"2024-08-18T22:33:34.555588+0000","last_peered":"2024-08-18T22:33:34.555588+0000","last_clean":"2024-08-18T22:33:34.555588+0000","last_became_active":"2024-08-18T22:33:33.579869+0000","last_became_peered":"2024-08-18T22:33:33.579869+0000","last_unstale":"2024-08-18T22:33:34.555588+0000","last_undegraded":"2024-08-18T22:33:34.555588+0000","last_fullsized":"2024-08-18T22:33:34.555588+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:32:59.363279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.592336+0000","last_change":"2024-08-18T22:33:33.591351+0000","last_active":"2024-08-18T22:33:33.592336+0000","last_peered":"2024-08-18T22:33:33.592336+0000","last_clean":"2024-08-18T22:33:33.592336+0000","last_became_active":"2024-08-18T22:33:33.591073+0000","last_became_peered":"2024-08-18T22:33:33.591073+0000","last_unstale":"2024-08-18T22:33:33.592336+0000","last_undegraded":"2024-08-18T22:33:33.592336+0000","last_fullsized":"2024-08-18T22:33:33.592336+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:50.634653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.582273+0000","last_change":"2024-08-18T22:33:33.572621+0000","last_active":"2024-08-18T22:33:33.582273+0000","last_peered":"2024-08-18T22:33:33.582273+0000","last_clean":"2024-08-18T22:33:33.582273+0000","last_became_active":"2024-08-18T22:33:33.572322+0000","last_became_peered":"2024-08-18T22:33:33.572322+0000","last_unstale":"2024-08-18T22:33:33.582273+0000","last_undegraded":"2024-08-18T22:33:33.582273+0000","last_fullsized":"2024-08-18T22:33:33.582273+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:18.208636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.576564+0000","last_change":"2024-08-18T22:33:33.570498+0000","last_active":"2024-08-18T22:33:33.576564+0000","last_peered":"2024-08-18T22:33:33.576564+0000","last_clean":"2024-08-18T22:33:33.576564+0000","last_became_active":"2024-08-18T22:33:33.569761+0000","last_became_peered":"2024-08-18T22:33:33.569761+0000","last_unstale":"2024-08-18T22:33:33.576564+0000","last_undegraded":"2024-08-18T22:33:33.576564+0000","last_fullsized":"2024-08-18T22:33:33.576564+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:02.409764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.584471+0000","last_change":"2024-08-18T22:33:33.576398+0000","last_active":"2024-08-18T22:33:33.584471+0000","last_peered":"2024-08-18T22:33:33.584471+0000","last_clean":"2024-08-18T22:33:33.584471+0000","last_became_active":"2024-08-18T22:33:33.576128+0000","last_became_peered":"2024-08-18T22:33:33.576128+0000","last_unstale":"2024-08-18T22:33:33.584471+0000","last_undegraded":"2024-08-18T22:33:33.584471+0000","last_fullsized":"2024-08-18T22:33:33.584471+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:38:51.878333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.592047+0000","last_change":"2024-08-18T22:33:33.587365+0000","last_active":"2024-08-18T22:33:33.592047+0000","last_peered":"2024-08-18T22:33:33.592047+0000","last_clean":"2024-08-18T22:33:33.592047+0000","last_became_active":"2024-08-18T22:33:33.586101+0000","last_became_peered":"2024-08-18T22:33:33.586101+0000","last_unstale":"2024-08-18T22:33:33.592047+0000","last_undegraded":"2024-08-18T22:33:33.592047+0000","last_fullsized":"2024-08-18T22:33:33.592047+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:34.390141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585603+0000","last_change":"2024-08-18T22:33:33.584613+0000","last_active":"2024-08-18T22:33:33.585603+0000","last_peered":"2024-08-18T22:33:33.585603+0000","last_clean":"2024-08-18T22:33:33.585603+0000","last_became_active":"2024-08-18T22:33:33.584347+0000","last_became_peered":"2024-08-18T22:33:33.584347+0000","last_unstale":"2024-08-18T22:33:33.585603+0000","last_undegraded":"2024-08-18T22:33:33.585603+0000","last_fullsized":"2024-08-18T22:33:33.585603+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:46.716033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.570802+0000","last_change":"2024-08-18T22:33:33.568721+0000","last_active":"2024-08-18T22:33:33.570802+0000","last_peered":"2024-08-18T22:33:33.570802+0000","last_clean":"2024-08-18T22:33:33.570802+0000","last_became_active":"2024-08-18T22:33:33.568020+0000","last_became_peered":"2024-08-18T22:33:33.568020+0000","last_unstale":"2024-08-18T22:33:33.570802+0000","last_undegraded":"2024-08-18T22:33:33.570802+0000","last_fullsized":"2024-08-18T22:33:33.570802+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:09.899071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.587152+0000","last_change":"2024-08-18T22:33:33.583247+0000","last_active":"2024-08-18T22:33:33.587152+0000","last_peered":"2024-08-18T22:33:33.587152+0000","last_clean":"2024-08-18T22:33:33.587152+0000","last_became_active":"2024-08-18T22:33:33.582723+0000","last_became_peered":"2024-08-18T22:33:33.582723+0000","last_unstale":"2024-08-18T22:33:33.587152+0000","last_undegraded":"2024-08-18T22:33:33.587152+0000","last_fullsized":"2024-08-18T22:33:33.587152+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:22:26.585187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.593001+0000","last_change":"2024-08-18T22:33:33.591167+0000","last_active":"2024-08-18T22:33:33.593001+0000","last_peered":"2024-08-18T22:33:33.593001+0000","last_clean":"2024-08-18T22:33:33.593001+0000","last_became_active":"2024-08-18T22:33:33.587856+0000","last_became_peered":"2024-08-18T22:33:33.587856+0000","last_unstale":"2024-08-18T22:33:33.593001+0000","last_undegraded":"2024-08-18T22:33:33.593001+0000","last_fullsized":"2024-08-18T22:33:33.593001+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:17:10.566950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585724+0000","last_change":"2024-08-18T22:33:33.582866+0000","last_active":"2024-08-18T22:33:33.585724+0000","last_peered":"2024-08-18T22:33:33.585724+0000","last_clean":"2024-08-18T22:33:33.585724+0000","last_became_active":"2024-08-18T22:33:33.582365+0000","last_became_peered":"2024-08-18T22:33:33.582365+0000","last_unstale":"2024-08-18T22:33:33.585724+0000","last_undegraded":"2024-08-18T22:33:33.585724+0000","last_fullsized":"2024-08-18T22:33:33.585724+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:33.332085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.587243+0000","last_change":"2024-08-18T22:33:33.578951+0000","last_active":"2024-08-18T22:33:33.587243+0000","last_peered":"2024-08-18T22:33:33.587243+0000","last_clean":"2024-08-18T22:33:33.587243+0000","last_became_active":"2024-08-18T22:33:33.578582+0000","last_became_peered":"2024-08-18T22:33:33.578582+0000","last_unstale":"2024-08-18T22:33:33.587243+0000","last_undegraded":"2024-08-18T22:33:33.587243+0000","last_fullsized":"2024-08-18T22:33:33.587243+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:59.703538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.108686+0000","last_change":"2024-08-18T22:33:33.568431+0000","last_active":"2024-08-18T22:33:35.108686+0000","last_peered":"2024-08-18T22:33:35.108686+0000","last_clean":"2024-08-18T22:33:35.108686+0000","last_became_active":"2024-08-18T22:33:33.568151+0000","last_became_peered":"2024-08-18T22:33:33.568151+0000","last_unstale":"2024-08-18T22:33:35.108686+0000","last_undegraded":"2024-08-18T22:33:35.108686+0000","last_fullsized":"2024-08-18T22:33:35.108686+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:31.151865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.572410+0000","last_change":"2024-08-18T22:33:33.568916+0000","last_active":"2024-08-18T22:33:33.572410+0000","last_peered":"2024-08-18T22:33:33.572410+0000","last_clean":"2024-08-18T22:33:33.572410+0000","last_became_active":"2024-08-18T22:33:33.567770+0000","last_became_peered":"2024-08-18T22:33:33.567770+0000","last_unstale":"2024-08-18T22:33:33.572410+0000","last_undegraded":"2024-08-18T22:33:33.572410+0000","last_fullsized":"2024-08-18T22:33:33.572410+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:33.674730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.572329+0000","last_change":"2024-08-18T22:33:33.568262+0000","last_active":"2024-08-18T22:33:33.572329+0000","last_peered":"2024-08-18T22:33:33.572329+0000","last_clean":"2024-08-18T22:33:33.572329+0000","last_became_active":"2024-08-18T22:33:33.567997+0000","last_became_peered":"2024-08-18T22:33:33.567997+0000","last_unstale":"2024-08-18T22:33:33.572329+0000","last_undegraded":"2024-08-18T22:33:33.572329+0000","last_fullsized":"2024-08-18T22:33:33.572329+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:59.703538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.586471+0000","last_change":"2024-08-18T22:33:33.583818+0000","last_active":"2024-08-18T22:33:33.586471+0000","last_peered":"2024-08-18T22:33:33.586471+0000","last_clean":"2024-08-18T22:33:33.586471+0000","last_became_active":"2024-08-18T22:33:33.583481+0000","last_became_peered":"2024-08-18T22:33:33.583481+0000","last_unstale":"2024-08-18T22:33:33.586471+0000","last_undegraded":"2024-08-18T22:33:33.586471+0000","last_fullsized":"2024-08-18T22:33:33.586471+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:01:46.885076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555787+0000","last_change":"2024-08-18T22:33:33.567737+0000","last_active":"2024-08-18T22:33:34.555787+0000","last_peered":"2024-08-18T22:33:34.555787+0000","last_clean":"2024-08-18T22:33:34.555787+0000","last_became_active":"2024-08-18T22:33:33.567455+0000","last_became_peered":"2024-08-18T22:33:33.567455+0000","last_unstale":"2024-08-18T22:33:34.555787+0000","last_undegraded":"2024-08-18T22:33:34.555787+0000","last_fullsized":"2024-08-18T22:33:34.555787+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:53:39.155135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.591368+0000","last_change":"2024-08-18T22:33:33.590699+0000","last_active":"2024-08-18T22:33:33.591368+0000","last_peered":"2024-08-18T22:33:33.591368+0000","last_clean":"2024-08-18T22:33:33.591368+0000","last_became_active":"2024-08-18T22:33:33.590391+0000","last_became_peered":"2024-08-18T22:33:33.590391+0000","last_unstale":"2024-08-18T22:33:33.591368+0000","last_undegraded":"2024-08-18T22:33:33.591368+0000","last_fullsized":"2024-08-18T22:33:33.591368+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:53:51.986037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.582904+0000","last_change":"2024-08-18T22:33:33.578356+0000","last_active":"2024-08-18T22:33:33.582904+0000","last_peered":"2024-08-18T22:33:33.582904+0000","last_clean":"2024-08-18T22:33:33.582904+0000","last_became_active":"2024-08-18T22:33:33.577255+0000","last_became_peered":"2024-08-18T22:33:33.577255+0000","last_unstale":"2024-08-18T22:33:33.582904+0000","last_undegraded":"2024-08-18T22:33:33.582904+0000","last_fullsized":"2024-08-18T22:33:33.582904+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:01.230314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.592080+0000","last_change":"2024-08-18T22:33:33.587924+0000","last_active":"2024-08-18T22:33:33.592080+0000","last_peered":"2024-08-18T22:33:33.592080+0000","last_clean":"2024-08-18T22:33:33.592080+0000","last_became_active":"2024-08-18T22:33:33.586864+0000","last_became_peered":"2024-08-18T22:33:33.586864+0000","last_unstale":"2024-08-18T22:33:33.592080+0000","last_undegraded":"2024-08-18T22:33:33.592080+0000","last_fullsized":"2024-08-18T22:33:33.592080+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:08.375933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.108832+0000","last_change":"2024-08-18T22:33:33.581655+0000","last_active":"2024-08-18T22:33:35.108832+0000","last_peered":"2024-08-18T22:33:35.108832+0000","last_clean":"2024-08-18T22:33:35.108832+0000","last_became_active":"2024-08-18T22:33:33.577529+0000","last_became_peered":"2024-08-18T22:33:33.577529+0000","last_unstale":"2024-08-18T22:33:35.108832+0000","last_undegraded":"2024-08-18T22:33:35.108832+0000","last_fullsized":"2024-08-18T22:33:35.108832+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:21:56.758783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.592086+0000","last_change":"2024-08-18T22:33:33.587686+0000","last_active":"2024-08-18T22:33:33.592086+0000","last_peered":"2024-08-18T22:33:33.592086+0000","last_clean":"2024-08-18T22:33:33.592086+0000","last_became_active":"2024-08-18T22:33:33.587376+0000","last_became_peered":"2024-08-18T22:33:33.587376+0000","last_unstale":"2024-08-18T22:33:33.592086+0000","last_undegraded":"2024-08-18T22:33:33.592086+0000","last_fullsized":"2024-08-18T22:33:33.592086+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:46:51.237271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.589942+0000","last_change":"2024-08-18T22:33:33.589435+0000","last_active":"2024-08-18T22:33:33.589942+0000","last_peered":"2024-08-18T22:33:33.589942+0000","last_clean":"2024-08-18T22:33:33.589942+0000","last_became_active":"2024-08-18T22:33:33.587903+0000","last_became_peered":"2024-08-18T22:33:33.587903+0000","last_unstale":"2024-08-18T22:33:33.589942+0000","last_undegraded":"2024-08-18T22:33:33.589942+0000","last_fullsized":"2024-08-18T22:33:33.589942+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:49:48.406365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"203'4","reported_seq":18,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.109980+0000","last_change":"2024-08-18T22:33:32.569766+0000","last_active":"2024-08-18T22:33:35.109980+0000","last_peered":"2024-08-18T22:33:35.109980+0000","last_clean":"2024-08-18T22:33:35.109980+0000","last_became_active":"2024-08-18T22:33:32.569453+0000","last_became_peered":"2024-08-18T22:33:32.569453+0000","last_unstale":"2024-08-18T22:33:35.109980+0000","last_undegraded":"2024-08-18T22:33:35.109980+0000","last_fullsized":"2024-08-18T22:33:35.109980+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:49.834639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.570619+0000","last_change":"2024-08-18T22:33:33.568563+0000","last_active":"2024-08-18T22:33:33.570619+0000","last_peered":"2024-08-18T22:33:33.570619+0000","last_clean":"2024-08-18T22:33:33.570619+0000","last_became_active":"2024-08-18T22:33:33.568275+0000","last_became_peered":"2024-08-18T22:33:33.568275+0000","last_unstale":"2024-08-18T22:33:33.570619+0000","last_undegraded":"2024-08-18T22:33:33.570619+0000","last_fullsized":"2024-08-18T22:33:33.570619+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:01.230314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"203'1","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.584364+0000","last_change":"2024-08-18T22:33:32.573378+0000","last_active":"2024-08-18T22:33:33.584364+0000","last_peered":"2024-08-18T22:33:33.584364+0000","last_clean":"2024-08-18T22:33:33.584364+0000","last_became_active":"2024-08-18T22:33:32.571371+0000","last_became_peered":"2024-08-18T22:33:32.571371+0000","last_unstale":"2024-08-18T22:33:33.584364+0000","last_undegraded":"2024-08-18T22:33:33.584364+0000","last_fullsized":"2024-08-18T22:33:33.584364+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:50.655403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.582986+0000","last_change":"2024-08-18T22:33:33.580026+0000","last_active":"2024-08-18T22:33:33.582986+0000","last_peered":"2024-08-18T22:33:33.582986+0000","last_clean":"2024-08-18T22:33:33.582986+0000","last_became_active":"2024-08-18T22:33:33.579692+0000","last_became_peered":"2024-08-18T22:33:33.579692+0000","last_unstale":"2024-08-18T22:33:33.582986+0000","last_undegraded":"2024-08-18T22:33:33.582986+0000","last_fullsized":"2024-08-18T22:33:33.582986+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:44.384772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"203'2","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.590005+0000","last_change":"2024-08-18T22:33:32.574824+0000","last_active":"2024-08-18T22:33:33.590005+0000","last_peered":"2024-08-18T22:33:33.590005+0000","last_clean":"2024-08-18T22:33:33.590005+0000","last_became_active":"2024-08-18T22:33:32.574547+0000","last_became_peered":"2024-08-18T22:33:32.574547+0000","last_unstale":"2024-08-18T22:33:33.590005+0000","last_undegraded":"2024-08-18T22:33:33.590005+0000","last_fullsized":"2024-08-18T22:33:33.590005+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:23.990819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.577921+0000","last_change":"2024-08-18T22:33:33.576463+0000","last_active":"2024-08-18T22:33:33.577921+0000","last_peered":"2024-08-18T22:33:33.577921+0000","last_clean":"2024-08-18T22:33:33.577921+0000","last_became_active":"2024-08-18T22:33:33.575480+0000","last_became_peered":"2024-08-18T22:33:33.575480+0000","last_unstale":"2024-08-18T22:33:33.577921+0000","last_undegraded":"2024-08-18T22:33:33.577921+0000","last_fullsized":"2024-08-18T22:33:33.577921+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:39.381642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"203'1","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585609+0000","last_change":"2024-08-18T22:33:32.566447+0000","last_active":"2024-08-18T22:33:33.585609+0000","last_peered":"2024-08-18T22:33:33.585609+0000","last_clean":"2024-08-18T22:33:33.585609+0000","last_became_active":"2024-08-18T22:33:32.566161+0000","last_became_peered":"2024-08-18T22:33:32.566161+0000","last_unstale":"2024-08-18T22:33:33.585609+0000","last_undegraded":"2024-08-18T22:33:33.585609+0000","last_fullsized":"2024-08-18T22:33:33.585609+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:23.670076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.580983+0000","last_change":"2024-08-18T22:33:33.564942+0000","last_active":"2024-08-18T22:33:33.580983+0000","last_peered":"2024-08-18T22:33:33.580983+0000","last_clean":"2024-08-18T22:33:33.580983+0000","last_became_active":"2024-08-18T22:33:33.564663+0000","last_became_peered":"2024-08-18T22:33:33.564663+0000","last_unstale":"2024-08-18T22:33:33.580983+0000","last_undegraded":"2024-08-18T22:33:33.580983+0000","last_fullsized":"2024-08-18T22:33:33.580983+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:21.296371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"203'1","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.586077+0000","last_change":"2024-08-18T22:33:32.579612+0000","last_active":"2024-08-18T22:33:33.586077+0000","last_peered":"2024-08-18T22:33:33.586077+0000","last_clean":"2024-08-18T22:33:33.586077+0000","last_became_active":"2024-08-18T22:33:32.579276+0000","last_became_peered":"2024-08-18T22:33:32.579276+0000","last_unstale":"2024-08-18T22:33:33.586077+0000","last_undegraded":"2024-08-18T22:33:33.586077+0000","last_fullsized":"2024-08-18T22:33:33.586077+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:06:35.861241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.589268+0000","last_change":"2024-08-18T22:33:33.588194+0000","last_active":"2024-08-18T22:33:33.589268+0000","last_peered":"2024-08-18T22:33:33.589268+0000","last_clean":"2024-08-18T22:33:33.589268+0000","last_became_active":"2024-08-18T22:33:33.587678+0000","last_became_peered":"2024-08-18T22:33:33.587678+0000","last_unstale":"2024-08-18T22:33:33.589268+0000","last_undegraded":"2024-08-18T22:33:33.589268+0000","last_fullsized":"2024-08-18T22:33:33.589268+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:35.771631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555131+0000","last_change":"2024-08-18T22:33:32.574005+0000","last_active":"2024-08-18T22:33:34.555131+0000","last_peered":"2024-08-18T22:33:34.555131+0000","last_clean":"2024-08-18T22:33:34.555131+0000","last_became_active":"2024-08-18T22:33:32.573723+0000","last_became_peered":"2024-08-18T22:33:32.573723+0000","last_unstale":"2024-08-18T22:33:34.555131+0000","last_undegraded":"2024-08-18T22:33:34.555131+0000","last_fullsized":"2024-08-18T22:33:34.555131+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:39.863454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.109164+0000","last_change":"2024-08-18T22:33:33.574128+0000","last_active":"2024-08-18T22:33:35.109164+0000","last_peered":"2024-08-18T22:33:35.109164+0000","last_clean":"2024-08-18T22:33:35.109164+0000","last_became_active":"2024-08-18T22:33:33.573866+0000","last_became_peered":"2024-08-18T22:33:33.573866+0000","last_unstale":"2024-08-18T22:33:35.109164+0000","last_undegraded":"2024-08-18T22:33:35.109164+0000","last_fullsized":"2024-08-18T22:33:35.109164+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:47.115460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.562003+0000","last_change":"2024-08-18T22:33:32.566021+0000","last_active":"2024-08-18T22:33:33.562003+0000","last_peered":"2024-08-18T22:33:33.562003+0000","last_clean":"2024-08-18T22:33:33.562003+0000","last_became_active":"2024-08-18T22:33:32.565773+0000","last_became_peered":"2024-08-18T22:33:32.565773+0000","last_unstale":"2024-08-18T22:33:33.562003+0000","last_undegraded":"2024-08-18T22:33:33.562003+0000","last_fullsized":"2024-08-18T22:33:33.562003+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:14.350332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.577437+0000","last_change":"2024-08-18T22:33:33.571357+0000","last_active":"2024-08-18T22:33:33.577437+0000","last_peered":"2024-08-18T22:33:33.577437+0000","last_clean":"2024-08-18T22:33:33.577437+0000","last_became_active":"2024-08-18T22:33:33.571041+0000","last_became_peered":"2024-08-18T22:33:33.571041+0000","last_unstale":"2024-08-18T22:33:33.577437+0000","last_undegraded":"2024-08-18T22:33:33.577437+0000","last_fullsized":"2024-08-18T22:33:33.577437+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:06:36.864568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.556259+0000","last_change":"2024-08-18T22:33:32.579569+0000","last_active":"2024-08-18T22:33:33.556259+0000","last_peered":"2024-08-18T22:33:33.556259+0000","last_clean":"2024-08-18T22:33:33.556259+0000","last_became_active":"2024-08-18T22:33:32.579166+0000","last_became_peered":"2024-08-18T22:33:32.579166+0000","last_unstale":"2024-08-18T22:33:33.556259+0000","last_undegraded":"2024-08-18T22:33:33.556259+0000","last_fullsized":"2024-08-18T22:33:33.556259+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:31:44.487326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.587166+0000","last_change":"2024-08-18T22:33:33.578405+0000","last_active":"2024-08-18T22:33:33.587166+0000","last_peered":"2024-08-18T22:33:33.587166+0000","last_clean":"2024-08-18T22:33:33.587166+0000","last_became_active":"2024-08-18T22:33:33.578092+0000","last_became_peered":"2024-08-18T22:33:33.578092+0000","last_unstale":"2024-08-18T22:33:33.587166+0000","last_undegraded":"2024-08-18T22:33:33.587166+0000","last_fullsized":"2024-08-18T22:33:33.587166+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:05.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555704+0000","last_change":"2024-08-18T22:33:32.576751+0000","last_active":"2024-08-18T22:33:34.555704+0000","last_peered":"2024-08-18T22:33:34.555704+0000","last_clean":"2024-08-18T22:33:34.555704+0000","last_became_active":"2024-08-18T22:33:32.576478+0000","last_became_peered":"2024-08-18T22:33:32.576478+0000","last_unstale":"2024-08-18T22:33:34.555704+0000","last_undegraded":"2024-08-18T22:33:34.555704+0000","last_fullsized":"2024-08-18T22:33:34.555704+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:25.303378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.577387+0000","last_change":"2024-08-18T22:33:33.576535+0000","last_active":"2024-08-18T22:33:33.577387+0000","last_peered":"2024-08-18T22:33:33.577387+0000","last_clean":"2024-08-18T22:33:33.577387+0000","last_became_active":"2024-08-18T22:33:33.572823+0000","last_became_peered":"2024-08-18T22:33:33.572823+0000","last_unstale":"2024-08-18T22:33:33.577387+0000","last_undegraded":"2024-08-18T22:33:33.577387+0000","last_fullsized":"2024-08-18T22:33:33.577387+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:56.739658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"203'3","reported_seq":15,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.586855+0000","last_change":"2024-08-18T22:33:32.580596+0000","last_active":"2024-08-18T22:33:33.586855+0000","last_peered":"2024-08-18T22:33:33.586855+0000","last_clean":"2024-08-18T22:33:33.586855+0000","last_became_active":"2024-08-18T22:33:32.579740+0000","last_became_peered":"2024-08-18T22:33:32.579740+0000","last_unstale":"2024-08-18T22:33:33.586855+0000","last_undegraded":"2024-08-18T22:33:33.586855+0000","last_fullsized":"2024-08-18T22:33:33.586855+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:23.670076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.556238+0000","last_change":"2024-08-18T22:33:33.581159+0000","last_active":"2024-08-18T22:33:34.556238+0000","last_peered":"2024-08-18T22:33:34.556238+0000","last_clean":"2024-08-18T22:33:34.556238+0000","last_became_active":"2024-08-18T22:33:33.580669+0000","last_became_peered":"2024-08-18T22:33:33.580669+0000","last_unstale":"2024-08-18T22:33:34.556238+0000","last_undegraded":"2024-08-18T22:33:34.556238+0000","last_fullsized":"2024-08-18T22:33:34.556238+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:52:29.706033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"203'6","reported_seq":18,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.594677+0000","last_change":"2024-08-18T22:33:32.574156+0000","last_active":"2024-08-18T22:33:33.594677+0000","last_peered":"2024-08-18T22:33:33.594677+0000","last_clean":"2024-08-18T22:33:33.594677+0000","last_became_active":"2024-08-18T22:33:32.573829+0000","last_became_peered":"2024-08-18T22:33:32.573829+0000","last_unstale":"2024-08-18T22:33:33.594677+0000","last_undegraded":"2024-08-18T22:33:33.594677+0000","last_fullsized":"2024-08-18T22:33:33.594677+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:08.694427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.579862+0000","last_change":"2024-08-18T22:33:33.573630+0000","last_active":"2024-08-18T22:33:33.579862+0000","last_peered":"2024-08-18T22:33:33.579862+0000","last_clean":"2024-08-18T22:33:33.579862+0000","last_became_active":"2024-08-18T22:33:33.573305+0000","last_became_peered":"2024-08-18T22:33:33.573305+0000","last_unstale":"2024-08-18T22:33:33.579862+0000","last_undegraded":"2024-08-18T22:33:33.579862+0000","last_fullsized":"2024-08-18T22:33:33.579862+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:15:25.395432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"203'2","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.590476+0000","last_change":"2024-08-18T22:33:32.568511+0000","last_active":"2024-08-18T22:33:33.590476+0000","last_peered":"2024-08-18T22:33:33.590476+0000","last_clean":"2024-08-18T22:33:33.590476+0000","last_became_active":"2024-08-18T22:33:32.568216+0000","last_became_peered":"2024-08-18T22:33:32.568216+0000","last_unstale":"2024-08-18T22:33:33.590476+0000","last_undegraded":"2024-08-18T22:33:33.590476+0000","last_fullsized":"2024-08-18T22:33:33.590476+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:23.919906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.582961+0000","last_change":"2024-08-18T22:33:33.581119+0000","last_active":"2024-08-18T22:33:33.582961+0000","last_peered":"2024-08-18T22:33:33.582961+0000","last_clean":"2024-08-18T22:33:33.582961+0000","last_became_active":"2024-08-18T22:33:33.580828+0000","last_became_peered":"2024-08-18T22:33:33.580828+0000","last_unstale":"2024-08-18T22:33:33.582961+0000","last_undegraded":"2024-08-18T22:33:33.582961+0000","last_fullsized":"2024-08-18T22:33:33.582961+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:58:51.453777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.565020+0000","last_change":"2024-08-18T22:33:32.561205+0000","last_active":"2024-08-18T22:33:33.565020+0000","last_peered":"2024-08-18T22:33:33.565020+0000","last_clean":"2024-08-18T22:33:33.565020+0000","last_became_active":"2024-08-18T22:33:32.560904+0000","last_became_peered":"2024-08-18T22:33:32.560904+0000","last_unstale":"2024-08-18T22:33:33.565020+0000","last_undegraded":"2024-08-18T22:33:33.565020+0000","last_fullsized":"2024-08-18T22:33:33.565020+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:10:55.654112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.575192+0000","last_change":"2024-08-18T22:33:33.572322+0000","last_active":"2024-08-18T22:33:33.575192+0000","last_peered":"2024-08-18T22:33:33.575192+0000","last_clean":"2024-08-18T22:33:33.575192+0000","last_became_active":"2024-08-18T22:33:33.572074+0000","last_became_peered":"2024-08-18T22:33:33.572074+0000","last_unstale":"2024-08-18T22:33:33.575192+0000","last_undegraded":"2024-08-18T22:33:33.575192+0000","last_fullsized":"2024-08-18T22:33:33.575192+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:00:55.104928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.567873+0000","last_change":"2024-08-18T22:33:32.570929+0000","last_active":"2024-08-18T22:33:33.567873+0000","last_peered":"2024-08-18T22:33:33.567873+0000","last_clean":"2024-08-18T22:33:33.567873+0000","last_became_active":"2024-08-18T22:33:32.570382+0000","last_became_peered":"2024-08-18T22:33:32.570382+0000","last_unstale":"2024-08-18T22:33:33.567873+0000","last_undegraded":"2024-08-18T22:33:33.567873+0000","last_fullsized":"2024-08-18T22:33:33.567873+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:10:28.444384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.587324+0000","last_change":"2024-08-18T22:33:33.584273+0000","last_active":"2024-08-18T22:33:33.587324+0000","last_peered":"2024-08-18T22:33:33.587324+0000","last_clean":"2024-08-18T22:33:33.587324+0000","last_became_active":"2024-08-18T22:33:33.584011+0000","last_became_peered":"2024-08-18T22:33:33.584011+0000","last_unstale":"2024-08-18T22:33:33.587324+0000","last_undegraded":"2024-08-18T22:33:33.587324+0000","last_fullsized":"2024-08-18T22:33:33.587324+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:33.674730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"203'8","reported_seq":20,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.589533+0000","last_change":"2024-08-18T22:33:32.575570+0000","last_active":"2024-08-18T22:33:33.589533+0000","last_peered":"2024-08-18T22:33:33.589533+0000","last_clean":"2024-08-18T22:33:33.589533+0000","last_became_active":"2024-08-18T22:33:32.575306+0000","last_became_peered":"2024-08-18T22:33:32.575306+0000","last_unstale":"2024-08-18T22:33:33.589533+0000","last_undegraded":"2024-08-18T22:33:33.589533+0000","last_fullsized":"2024-08-18T22:33:33.589533+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:21:23.118371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.586227+0000","last_change":"2024-08-18T22:33:33.581288+0000","last_active":"2024-08-18T22:33:33.586227+0000","last_peered":"2024-08-18T22:33:33.586227+0000","last_clean":"2024-08-18T22:33:33.586227+0000","last_became_active":"2024-08-18T22:33:33.581005+0000","last_became_peered":"2024-08-18T22:33:33.581005+0000","last_unstale":"2024-08-18T22:33:33.586227+0000","last_undegraded":"2024-08-18T22:33:33.586227+0000","last_fullsized":"2024-08-18T22:33:33.586227+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:26.432041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"203'1","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.590267+0000","last_change":"2024-08-18T22:33:32.573003+0000","last_active":"2024-08-18T22:33:33.590267+0000","last_peered":"2024-08-18T22:33:33.590267+0000","last_clean":"2024-08-18T22:33:33.590267+0000","last_became_active":"2024-08-18T22:33:32.572711+0000","last_became_peered":"2024-08-18T22:33:32.572711+0000","last_unstale":"2024-08-18T22:33:33.590267+0000","last_undegraded":"2024-08-18T22:33:33.590267+0000","last_fullsized":"2024-08-18T22:33:33.590267+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:30.869845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.570647+0000","last_change":"2024-08-18T22:33:33.564272+0000","last_active":"2024-08-18T22:33:33.570647+0000","last_peered":"2024-08-18T22:33:33.570647+0000","last_clean":"2024-08-18T22:33:33.570647+0000","last_became_active":"2024-08-18T22:33:33.563983+0000","last_became_peered":"2024-08-18T22:33:33.563983+0000","last_unstale":"2024-08-18T22:33:33.570647+0000","last_undegraded":"2024-08-18T22:33:33.570647+0000","last_fullsized":"2024-08-18T22:33:33.570647+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:05.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"203'2","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.109477+0000","last_change":"2024-08-18T22:33:32.568900+0000","last_active":"2024-08-18T22:33:35.109477+0000","last_peered":"2024-08-18T22:33:35.109477+0000","last_clean":"2024-08-18T22:33:35.109477+0000","last_became_active":"2024-08-18T22:33:32.568594+0000","last_became_peered":"2024-08-18T22:33:32.568594+0000","last_unstale":"2024-08-18T22:33:35.109477+0000","last_undegraded":"2024-08-18T22:33:35.109477+0000","last_fullsized":"2024-08-18T22:33:35.109477+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:47.452443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.570826+0000","last_change":"2024-08-18T22:33:33.568967+0000","last_active":"2024-08-18T22:33:33.570826+0000","last_peered":"2024-08-18T22:33:33.570826+0000","last_clean":"2024-08-18T22:33:33.570826+0000","last_became_active":"2024-08-18T22:33:33.568385+0000","last_became_peered":"2024-08-18T22:33:33.568385+0000","last_unstale":"2024-08-18T22:33:33.570826+0000","last_undegraded":"2024-08-18T22:33:33.570826+0000","last_fullsized":"2024-08-18T22:33:33.570826+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:26.432041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"203'1","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.590965+0000","last_change":"2024-08-18T22:33:32.571231+0000","last_active":"2024-08-18T22:33:33.590965+0000","last_peered":"2024-08-18T22:33:33.590965+0000","last_clean":"2024-08-18T22:33:33.590965+0000","last_became_active":"2024-08-18T22:33:32.570958+0000","last_became_peered":"2024-08-18T22:33:32.570958+0000","last_unstale":"2024-08-18T22:33:33.590965+0000","last_undegraded":"2024-08-18T22:33:33.590965+0000","last_fullsized":"2024-08-18T22:33:33.590965+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:59.079875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.582322+0000","last_change":"2024-08-18T22:33:33.577694+0000","last_active":"2024-08-18T22:33:33.582322+0000","last_peered":"2024-08-18T22:33:33.582322+0000","last_clean":"2024-08-18T22:33:33.582322+0000","last_became_active":"2024-08-18T22:33:33.577437+0000","last_became_peered":"2024-08-18T22:33:33.577437+0000","last_unstale":"2024-08-18T22:33:33.582322+0000","last_undegraded":"2024-08-18T22:33:33.582322+0000","last_fullsized":"2024-08-18T22:33:33.582322+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:18.439868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.568729+0000","last_change":"2024-08-18T22:33:32.571035+0000","last_active":"2024-08-18T22:33:33.568729+0000","last_peered":"2024-08-18T22:33:33.568729+0000","last_clean":"2024-08-18T22:33:33.568729+0000","last_became_active":"2024-08-18T22:33:32.570734+0000","last_became_peered":"2024-08-18T22:33:32.570734+0000","last_unstale":"2024-08-18T22:33:33.568729+0000","last_undegraded":"2024-08-18T22:33:33.568729+0000","last_fullsized":"2024-08-18T22:33:33.568729+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:40:37.925403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.576983+0000","last_change":"2024-08-18T22:33:33.570929+0000","last_active":"2024-08-18T22:33:33.576983+0000","last_peered":"2024-08-18T22:33:33.576983+0000","last_clean":"2024-08-18T22:33:33.576983+0000","last_became_active":"2024-08-18T22:33:33.570607+0000","last_became_peered":"2024-08-18T22:33:33.570607+0000","last_unstale":"2024-08-18T22:33:33.576983+0000","last_undegraded":"2024-08-18T22:33:33.576983+0000","last_fullsized":"2024-08-18T22:33:33.576983+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:40.509975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"203'2","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.588832+0000","last_change":"2024-08-18T22:33:32.578925+0000","last_active":"2024-08-18T22:33:33.588832+0000","last_peered":"2024-08-18T22:33:33.588832+0000","last_clean":"2024-08-18T22:33:33.588832+0000","last_became_active":"2024-08-18T22:33:32.578603+0000","last_became_peered":"2024-08-18T22:33:32.578603+0000","last_unstale":"2024-08-18T22:33:33.588832+0000","last_undegraded":"2024-08-18T22:33:33.588832+0000","last_fullsized":"2024-08-18T22:33:33.588832+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:49:33.408944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.579435+0000","last_change":"2024-08-18T22:33:33.576276+0000","last_active":"2024-08-18T22:33:33.579435+0000","last_peered":"2024-08-18T22:33:33.579435+0000","last_clean":"2024-08-18T22:33:33.579435+0000","last_became_active":"2024-08-18T22:33:33.576003+0000","last_became_peered":"2024-08-18T22:33:33.576003+0000","last_unstale":"2024-08-18T22:33:33.579435+0000","last_undegraded":"2024-08-18T22:33:33.579435+0000","last_fullsized":"2024-08-18T22:33:33.579435+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:19.573546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.565281+0000","last_change":"2024-08-18T22:33:32.571701+0000","last_active":"2024-08-18T22:33:33.565281+0000","last_peered":"2024-08-18T22:33:33.565281+0000","last_clean":"2024-08-18T22:33:33.565281+0000","last_became_active":"2024-08-18T22:33:32.570649+0000","last_became_peered":"2024-08-18T22:33:32.570649+0000","last_unstale":"2024-08-18T22:33:33.565281+0000","last_undegraded":"2024-08-18T22:33:33.565281+0000","last_fullsized":"2024-08-18T22:33:33.565281+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:31:44.487326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585651+0000","last_change":"2024-08-18T22:33:33.581042+0000","last_active":"2024-08-18T22:33:33.585651+0000","last_peered":"2024-08-18T22:33:33.585651+0000","last_clean":"2024-08-18T22:33:33.585651+0000","last_became_active":"2024-08-18T22:33:33.580744+0000","last_became_peered":"2024-08-18T22:33:33.580744+0000","last_unstale":"2024-08-18T22:33:33.585651+0000","last_undegraded":"2024-08-18T22:33:33.585651+0000","last_fullsized":"2024-08-18T22:33:33.585651+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:09.899071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.564997+0000","last_change":"2024-08-18T22:33:32.574674+0000","last_active":"2024-08-18T22:33:33.564997+0000","last_peered":"2024-08-18T22:33:33.564997+0000","last_clean":"2024-08-18T22:33:33.564997+0000","last_became_active":"2024-08-18T22:33:32.574390+0000","last_became_peered":"2024-08-18T22:33:32.574390+0000","last_unstale":"2024-08-18T22:33:33.564997+0000","last_undegraded":"2024-08-18T22:33:33.564997+0000","last_fullsized":"2024-08-18T22:33:33.564997+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:16.743582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.572759+0000","last_change":"2024-08-18T22:33:33.571076+0000","last_active":"2024-08-18T22:33:33.572759+0000","last_peered":"2024-08-18T22:33:33.572759+0000","last_clean":"2024-08-18T22:33:33.572759+0000","last_became_active":"2024-08-18T22:33:33.570507+0000","last_became_peered":"2024-08-18T22:33:33.570507+0000","last_unstale":"2024-08-18T22:33:33.572759+0000","last_undegraded":"2024-08-18T22:33:33.572759+0000","last_fullsized":"2024-08-18T22:33:33.572759+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:04.607326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.108404+0000","last_change":"2024-08-18T22:33:32.568836+0000","last_active":"2024-08-18T22:33:35.108404+0000","last_peered":"2024-08-18T22:33:35.108404+0000","last_clean":"2024-08-18T22:33:35.108404+0000","last_became_active":"2024-08-18T22:33:32.568536+0000","last_became_peered":"2024-08-18T22:33:32.568536+0000","last_unstale":"2024-08-18T22:33:35.108404+0000","last_undegraded":"2024-08-18T22:33:35.108404+0000","last_fullsized":"2024-08-18T22:33:35.108404+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:04:28.393051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.579946+0000","last_change":"2024-08-18T22:33:33.573813+0000","last_active":"2024-08-18T22:33:33.579946+0000","last_peered":"2024-08-18T22:33:33.579946+0000","last_clean":"2024-08-18T22:33:33.579946+0000","last_became_active":"2024-08-18T22:33:33.573542+0000","last_became_peered":"2024-08-18T22:33:33.573542+0000","last_unstale":"2024-08-18T22:33:33.579946+0000","last_undegraded":"2024-08-18T22:33:33.579946+0000","last_fullsized":"2024-08-18T22:33:33.579946+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:31.873172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"203'2","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.581463+0000","last_change":"2024-08-18T22:33:32.576802+0000","last_active":"2024-08-18T22:33:33.581463+0000","last_peered":"2024-08-18T22:33:33.581463+0000","last_clean":"2024-08-18T22:33:33.581463+0000","last_became_active":"2024-08-18T22:33:32.576521+0000","last_became_peered":"2024-08-18T22:33:32.576521+0000","last_unstale":"2024-08-18T22:33:33.581463+0000","last_undegraded":"2024-08-18T22:33:33.581463+0000","last_fullsized":"2024-08-18T22:33:33.581463+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:13.334141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.587092+0000","last_change":"2024-08-18T22:33:33.582973+0000","last_active":"2024-08-18T22:33:33.587092+0000","last_peered":"2024-08-18T22:33:33.587092+0000","last_clean":"2024-08-18T22:33:33.587092+0000","last_became_active":"2024-08-18T22:33:33.582349+0000","last_became_peered":"2024-08-18T22:33:33.582349+0000","last_unstale":"2024-08-18T22:33:33.587092+0000","last_undegraded":"2024-08-18T22:33:33.587092+0000","last_fullsized":"2024-08-18T22:33:33.587092+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:47.615332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.564102+0000","last_change":"2024-08-18T22:33:32.570762+0000","last_active":"2024-08-18T22:33:33.564102+0000","last_peered":"2024-08-18T22:33:33.564102+0000","last_clean":"2024-08-18T22:33:33.564102+0000","last_became_active":"2024-08-18T22:33:32.570408+0000","last_became_peered":"2024-08-18T22:33:32.570408+0000","last_unstale":"2024-08-18T22:33:33.564102+0000","last_undegraded":"2024-08-18T22:33:33.564102+0000","last_fullsized":"2024-08-18T22:33:33.564102+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:15:42.616126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.591914+0000","last_change":"2024-08-18T22:33:33.586732+0000","last_active":"2024-08-18T22:33:33.591914+0000","last_peered":"2024-08-18T22:33:33.591914+0000","last_clean":"2024-08-18T22:33:33.591914+0000","last_became_active":"2024-08-18T22:33:33.586429+0000","last_became_peered":"2024-08-18T22:33:33.586429+0000","last_unstale":"2024-08-18T22:33:33.591914+0000","last_undegraded":"2024-08-18T22:33:33.591914+0000","last_fullsized":"2024-08-18T22:33:33.591914+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:16.795306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.564917+0000","last_change":"2024-08-18T22:33:32.564020+0000","last_active":"2024-08-18T22:33:33.564917+0000","last_peered":"2024-08-18T22:33:33.564917+0000","last_clean":"2024-08-18T22:33:33.564917+0000","last_became_active":"2024-08-18T22:33:32.563764+0000","last_became_peered":"2024-08-18T22:33:32.563764+0000","last_unstale":"2024-08-18T22:33:33.564917+0000","last_undegraded":"2024-08-18T22:33:33.564917+0000","last_fullsized":"2024-08-18T22:33:33.564917+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:14:34.914736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.109703+0000","last_change":"2024-08-18T22:33:33.585397+0000","last_active":"2024-08-18T22:33:35.109703+0000","last_peered":"2024-08-18T22:33:35.109703+0000","last_clean":"2024-08-18T22:33:35.109703+0000","last_became_active":"2024-08-18T22:33:33.585114+0000","last_became_peered":"2024-08-18T22:33:33.585114+0000","last_unstale":"2024-08-18T22:33:35.109703+0000","last_undegraded":"2024-08-18T22:33:35.109703+0000","last_fullsized":"2024-08-18T22:33:35.109703+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:09:26.840140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.568993+0000","last_change":"2024-08-18T22:33:32.579620+0000","last_active":"2024-08-18T22:33:33.568993+0000","last_peered":"2024-08-18T22:33:33.568993+0000","last_clean":"2024-08-18T22:33:33.568993+0000","last_became_active":"2024-08-18T22:33:32.578842+0000","last_became_peered":"2024-08-18T22:33:32.578842+0000","last_unstale":"2024-08-18T22:33:33.568993+0000","last_undegraded":"2024-08-18T22:33:33.568993+0000","last_fullsized":"2024-08-18T22:33:33.568993+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:54.376674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585148+0000","last_change":"2024-08-18T22:33:33.581711+0000","last_active":"2024-08-18T22:33:33.585148+0000","last_peered":"2024-08-18T22:33:33.585148+0000","last_clean":"2024-08-18T22:33:33.585148+0000","last_became_active":"2024-08-18T22:33:33.581456+0000","last_became_peered":"2024-08-18T22:33:33.581456+0000","last_unstale":"2024-08-18T22:33:33.585148+0000","last_undegraded":"2024-08-18T22:33:33.585148+0000","last_fullsized":"2024-08-18T22:33:33.585148+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:59.852602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.561063+0000","last_change":"2024-08-18T22:33:32.569481+0000","last_active":"2024-08-18T22:33:33.561063+0000","last_peered":"2024-08-18T22:33:33.561063+0000","last_clean":"2024-08-18T22:33:33.561063+0000","last_became_active":"2024-08-18T22:33:32.569083+0000","last_became_peered":"2024-08-18T22:33:32.569083+0000","last_unstale":"2024-08-18T22:33:33.561063+0000","last_undegraded":"2024-08-18T22:33:33.561063+0000","last_fullsized":"2024-08-18T22:33:33.561063+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:21:38.717703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.583244+0000","last_change":"2024-08-18T22:33:33.576057+0000","last_active":"2024-08-18T22:33:33.583244+0000","last_peered":"2024-08-18T22:33:33.583244+0000","last_clean":"2024-08-18T22:33:33.583244+0000","last_became_active":"2024-08-18T22:33:33.575733+0000","last_became_peered":"2024-08-18T22:33:33.575733+0000","last_unstale":"2024-08-18T22:33:33.583244+0000","last_undegraded":"2024-08-18T22:33:33.583244+0000","last_fullsized":"2024-08-18T22:33:33.583244+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:30.101525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555706+0000","last_change":"2024-08-18T22:33:32.573095+0000","last_active":"2024-08-18T22:33:34.555706+0000","last_peered":"2024-08-18T22:33:34.555706+0000","last_clean":"2024-08-18T22:33:34.555706+0000","last_became_active":"2024-08-18T22:33:32.572789+0000","last_became_peered":"2024-08-18T22:33:32.572789+0000","last_unstale":"2024-08-18T22:33:34.555706+0000","last_undegraded":"2024-08-18T22:33:34.555706+0000","last_fullsized":"2024-08-18T22:33:34.555706+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:10.968373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.108460+0000","last_change":"2024-08-18T22:33:33.566653+0000","last_active":"2024-08-18T22:33:35.108460+0000","last_peered":"2024-08-18T22:33:35.108460+0000","last_clean":"2024-08-18T22:33:35.108460+0000","last_became_active":"2024-08-18T22:33:33.566367+0000","last_became_peered":"2024-08-18T22:33:33.566367+0000","last_unstale":"2024-08-18T22:33:35.108460+0000","last_undegraded":"2024-08-18T22:33:35.108460+0000","last_fullsized":"2024-08-18T22:33:35.108460+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:16.272806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.556063+0000","last_change":"2024-08-18T22:33:32.579541+0000","last_active":"2024-08-18T22:33:33.556063+0000","last_peered":"2024-08-18T22:33:33.556063+0000","last_clean":"2024-08-18T22:33:33.556063+0000","last_became_active":"2024-08-18T22:33:32.579189+0000","last_became_peered":"2024-08-18T22:33:32.579189+0000","last_unstale":"2024-08-18T22:33:33.556063+0000","last_undegraded":"2024-08-18T22:33:33.556063+0000","last_fullsized":"2024-08-18T22:33:33.556063+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:16.743582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.577212+0000","last_change":"2024-08-18T22:33:33.568775+0000","last_active":"2024-08-18T22:33:33.577212+0000","last_peered":"2024-08-18T22:33:33.577212+0000","last_clean":"2024-08-18T22:33:33.577212+0000","last_became_active":"2024-08-18T22:33:33.568497+0000","last_became_peered":"2024-08-18T22:33:33.568497+0000","last_unstale":"2024-08-18T22:33:33.577212+0000","last_undegraded":"2024-08-18T22:33:33.577212+0000","last_fullsized":"2024-08-18T22:33:33.577212+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:26:13.770567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.558665+0000","last_change":"2024-08-18T22:33:32.574643+0000","last_active":"2024-08-18T22:33:33.558665+0000","last_peered":"2024-08-18T22:33:33.558665+0000","last_clean":"2024-08-18T22:33:33.558665+0000","last_became_active":"2024-08-18T22:33:32.574381+0000","last_became_peered":"2024-08-18T22:33:32.574381+0000","last_unstale":"2024-08-18T22:33:33.558665+0000","last_undegraded":"2024-08-18T22:33:33.558665+0000","last_fullsized":"2024-08-18T22:33:33.558665+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:07.714553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585803+0000","last_change":"2024-08-18T22:33:33.583695+0000","last_active":"2024-08-18T22:33:33.585803+0000","last_peered":"2024-08-18T22:33:33.585803+0000","last_clean":"2024-08-18T22:33:33.585803+0000","last_became_active":"2024-08-18T22:33:33.583407+0000","last_became_peered":"2024-08-18T22:33:33.583407+0000","last_unstale":"2024-08-18T22:33:33.585803+0000","last_undegraded":"2024-08-18T22:33:33.585803+0000","last_fullsized":"2024-08-18T22:33:33.585803+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:11:01.722342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"203'2","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.586536+0000","last_change":"2024-08-18T22:33:32.579553+0000","last_active":"2024-08-18T22:33:33.586536+0000","last_peered":"2024-08-18T22:33:33.586536+0000","last_clean":"2024-08-18T22:33:33.586536+0000","last_became_active":"2024-08-18T22:33:32.579220+0000","last_became_peered":"2024-08-18T22:33:32.579220+0000","last_unstale":"2024-08-18T22:33:33.586536+0000","last_undegraded":"2024-08-18T22:33:33.586536+0000","last_fullsized":"2024-08-18T22:33:33.586536+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:38:50.875005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":541,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.555932+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:33:33.555932+0000","last_peered":"2024-08-18T22:33:33.555932+0000","last_clean":"2024-08-18T22:33:33.555932+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:33:33.555932+0000","last_undegraded":"2024-08-18T22:33:33.555932+0000","last_fullsized":"2024-08-18T22:33:33.555932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509616,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52288,"kb_used_data":3064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319552,"statfs":{"total":96636764160,"available":96583221248,"internally_reserved":0,"allocated":3137536,"data_stored":1792457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509618,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51756,"kb_used_data":2520,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320084,"statfs":{"total":96636764160,"available":96583766016,"internally_reserved":0,"allocated":2580480,"data_stored":1210994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509616,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51712,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320128,"statfs":{"total":96636764160,"available":96583811072,"internally_reserved":0,"allocated":2543616,"data_stored":1202089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509617,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47556,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324284,"statfs":{"total":96636764160,"available":96588066816,"internally_reserved":0,"allocated":2543616,"data_stored":1202089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509616,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47564,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324276,"statfs":{"total":96636764160,"available":96588058624,"internally_reserved":0,"allocated":2555904,"data_stored":1209256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509617,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60616,"kb_used_data":3064,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311224,"statfs":{"total":96636764160,"available":96574693376,"internally_reserved":0,"allocated":3137536,"data_stored":1792457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60060,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311780,"statfs":{"total":96636764160,"available":96575262720,"internally_reserved":0,"allocated":2572288,"data_stored":1216038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575025,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60052,"kb_used_data":2504,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311788,"statfs":{"total":96636764160,"available":96575270912,"internally_reserved":0,"allocated":2564096,"data_stored":1209872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:33:37.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:33:37.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.874+0000 7feb77600640 1 Processor -- start 2024-08-18T22:33:37.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.874+0000 7feb77600640 1 -- start start 2024-08-18T22:33:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb77600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feb7015bed0 0x7feb700735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb77600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb700cb390 0x7feb70071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb77600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb7006da70 0x7feb7006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb77600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7feb7006e420 con 0x7feb700cb390 2024-08-18T22:33:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb77600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7feb70072060 con 0x7feb7015bed0 2024-08-18T22:33:37.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb77600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb70073c80 con 0x7feb7006da70 2024-08-18T22:33:37.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb6fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb700cb390 0x7feb70071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb6fe00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb700cb390 0x7feb70071b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51120/0 (socket says 172.21.15.5:51120) 2024-08-18T22:33:37.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb6fe00640 1 -- 172.21.15.5:0/2945068096 learned_addr learned my addr 172.21.15.5:0/2945068096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:37.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb74c00640 1 --2- 172.21.15.5:0/2945068096 >> v2:172.21.15.117:3300/0 conn(0x7feb7015bed0 0x7feb700735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb75600640 1 --2- 172.21.15.5:0/2945068096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb7006da70 0x7feb7006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb6fe00640 1 -- 172.21.15.5:0/2945068096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb7006da70 msgr2=0x7feb7006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:37.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb6fe00640 1 --2- 172.21.15.5:0/2945068096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb7006da70 0x7feb7006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb6fe00640 1 -- 172.21.15.5:0/2945068096 >> v2:172.21.15.117:3300/0 conn(0x7feb7015bed0 msgr2=0x7feb700735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:37.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb6fe00640 1 --2- 172.21.15.5:0/2945068096 >> v2:172.21.15.117:3300/0 conn(0x7feb7015bed0 0x7feb700735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.878+0000 7feb6fe00640 1 -- 172.21.15.5:0/2945068096 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb700ca5d0 con 0x7feb700cb390 2024-08-18T22:33:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb6fe00640 1 --2- 172.21.15.5:0/2945068096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb700cb390 0x7feb70071b20 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7feb700b2cc0 tx=0x7feb5c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16266ed711d46785 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb6f400640 1 -- 172.21.15.5:0/2945068096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0aa610 con 0x7feb700cb390 2024-08-18T22:33:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb6f400640 1 -- 172.21.15.5:0/2945068096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5c0af070 con 0x7feb700cb390 2024-08-18T22:33:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb6f400640 1 -- 172.21.15.5:0/2945068096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0aa9d0 con 0x7feb700cb390 2024-08-18T22:33:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb77600640 1 -- 172.21.15.5:0/2945068096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb700cb390 msgr2=0x7feb70071b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb77600640 1 --2- 172.21.15.5:0/2945068096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb700cb390 0x7feb70071b20 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7feb700b2cc0 tx=0x7feb5c01c4f0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb77600640 1 -- 172.21.15.5:0/2945068096 shutdown_connections 2024-08-18T22:33:37.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb77600640 1 --2- 172.21.15.5:0/2945068096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb7006da70 0x7feb7006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb77600640 1 --2- 172.21.15.5:0/2945068096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb700cb390 0x7feb70071b20 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb77600640 1 --2- 172.21.15.5:0/2945068096 >> v2:172.21.15.117:3300/0 conn(0x7feb7015bed0 0x7feb700735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb77600640 1 -- 172.21.15.5:0/2945068096 >> 172.21.15.5:0/2945068096 conn(0x7feb700b1c50 msgr2=0x7feb700b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:37.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb77600640 1 -- 172.21.15.5:0/2945068096 shutdown_connections 2024-08-18T22:33:37.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb77600640 1 -- 172.21.15.5:0/2945068096 wait complete. 2024-08-18T22:33:37.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb77600640 1 Processor -- start 2024-08-18T22:33:37.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.882+0000 7feb77600640 1 -- start start 2024-08-18T22:33:37.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb77600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb7006da70 0x7feb701489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb77600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb700cb390 0x7feb700b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb77600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb7015bed0 0x7feb700b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb77600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb7015c430 con 0x7feb700cb390 2024-08-18T22:33:37.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb77600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feb7015c2b0 con 0x7feb7015bed0 2024-08-18T22:33:37.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb77600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7feb700ccac0 con 0x7feb7006da70 2024-08-18T22:33:37.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb700cb390 0x7feb700b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb700cb390 0x7feb700b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51124/0 (socket says 172.21.15.5:51124) 2024-08-18T22:33:37.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6fe00640 1 -- 172.21.15.5:0/1019427449 learned_addr learned my addr 172.21.15.5:0/1019427449 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:37.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb74c00640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb7006da70 0x7feb701489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb75600640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb7015bed0 0x7feb700b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6fe00640 1 -- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb7006da70 msgr2=0x7feb701489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6fe00640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb7006da70 0x7feb701489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6fe00640 1 -- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb7015bed0 msgr2=0x7feb700b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6fe00640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb7015bed0 0x7feb700b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6fe00640 1 -- 172.21.15.5:0/1019427449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb700adb80 con 0x7feb700cb390 2024-08-18T22:33:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb75600640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb7015bed0 0x7feb700b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:37.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6fe00640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb700cb390 0x7feb700b4970 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0ac040 tx=0x7feb5c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:37.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6cc00640 1 -- 172.21.15.5:0/1019427449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0bd3f0 con 0x7feb700cb390 2024-08-18T22:33:37.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6cc00640 1 -- 172.21.15.5:0/1019427449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5c0bd590 con 0x7feb700cb390 2024-08-18T22:33:37.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb77600640 1 -- 172.21.15.5:0/1019427449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb700b5500 con 0x7feb700cb390 2024-08-18T22:33:37.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6cc00640 1 -- 172.21.15.5:0/1019427449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0bd940 con 0x7feb700cb390 2024-08-18T22:33:37.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb77600640 1 -- 172.21.15.5:0/1019427449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb700b5ac0 con 0x7feb700cb390 2024-08-18T22:33:37.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb77600640 1 -- 172.21.15.5:0/1019427449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb700cce30 con 0x7feb700cb390 2024-08-18T22:33:37.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.886+0000 7feb6cc00640 1 -- 172.21.15.5:0/1019427449 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb5c0bdae0 con 0x7feb700cb390 2024-08-18T22:33:37.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.890+0000 7feb6cc00640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb500678c0 0x7feb50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:37.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.890+0000 7feb6cc00640 1 -- 172.21.15.5:0/1019427449 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7feb5c120530 con 0x7feb700cb390 2024-08-18T22:33:37.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.890+0000 7feb74c00640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb500678c0 0x7feb50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:37.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.890+0000 7feb74c00640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb500678c0 0x7feb50069d80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7feb60009a40 tx=0x7feb60009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:37.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:37.894+0000 7feb6cc00640 1 -- 172.21.15.5:0/1019427449 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7feb5c0c3060 con 0x7feb700cb390 2024-08-18T22:33:38.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.058+0000 7feb77600640 1 -- 172.21.15.5:0/1019427449 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb70153340 con 0x7feb500678c0 2024-08-18T22:33:38.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.062+0000 7feb6cc00640 1 -- 172.21.15.5:0/1019427449 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252427 (secure 0 0 0) 0x7feb70153340 con 0x7feb500678c0 2024-08-18T22:33:38.064 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:38.066 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:33:38.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 -- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb500678c0 msgr2=0x7feb50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb500678c0 0x7feb50069d80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7feb60009a40 tx=0x7feb60009190 comp rx=0 tx=0).stop 2024-08-18T22:33:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 -- 172.21.15.5:0/1019427449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb700cb390 msgr2=0x7feb700b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb700cb390 0x7feb700b4970 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0ac040 tx=0x7feb5c01ad30 comp rx=0 tx=0).stop 2024-08-18T22:33:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 -- 172.21.15.5:0/1019427449 shutdown_connections 2024-08-18T22:33:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7feb500678c0 0x7feb50069d80 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb7015bed0 0x7feb700b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb700cb390 0x7feb700b4970 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 --2- 172.21.15.5:0/1019427449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb7006da70 0x7feb701489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 -- 172.21.15.5:0/1019427449 >> 172.21.15.5:0/1019427449 conn(0x7feb700b1c50 msgr2=0x7feb700ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 -- 172.21.15.5:0/1019427449 shutdown_connections 2024-08-18T22:33:38.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.066+0000 7feb77600640 1 -- 172.21.15.5:0/1019427449 wait complete. 2024-08-18T22:33:38.084 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":633,"stamp":"2024-08-18T22:33:37.832540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431604,"kb_used_data":21128,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754543116,"statfs":{"total":773094113280,"available":772652150784,"internally_reserved":0,"allocated":21635072,"data_stored":10835252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001700"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.578371+0000","last_change":"2024-08-18T22:33:33.575423+0000","last_active":"2024-08-18T22:33:33.578371+0000","last_peered":"2024-08-18T22:33:33.578371+0000","last_clean":"2024-08-18T22:33:33.578371+0000","last_became_active":"2024-08-18T22:33:33.575152+0000","last_became_peered":"2024-08-18T22:33:33.575152+0000","last_unstale":"2024-08-18T22:33:33.578371+0000","last_undegraded":"2024-08-18T22:33:33.578371+0000","last_fullsized":"2024-08-18T22:33:33.578371+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:07.672462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.580057+0000","last_change":"2024-08-18T22:33:33.578175+0000","last_active":"2024-08-18T22:33:33.580057+0000","last_peered":"2024-08-18T22:33:33.580057+0000","last_clean":"2024-08-18T22:33:33.580057+0000","last_became_active":"2024-08-18T22:33:33.577902+0000","last_became_peered":"2024-08-18T22:33:33.577902+0000","last_unstale":"2024-08-18T22:33:33.580057+0000","last_undegraded":"2024-08-18T22:33:33.580057+0000","last_fullsized":"2024-08-18T22:33:33.580057+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:15.353659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585111+0000","last_change":"2024-08-18T22:33:33.580727+0000","last_active":"2024-08-18T22:33:33.585111+0000","last_peered":"2024-08-18T22:33:33.585111+0000","last_clean":"2024-08-18T22:33:33.585111+0000","last_became_active":"2024-08-18T22:33:33.580417+0000","last_became_peered":"2024-08-18T22:33:33.580417+0000","last_unstale":"2024-08-18T22:33:33.585111+0000","last_undegraded":"2024-08-18T22:33:33.585111+0000","last_fullsized":"2024-08-18T22:33:33.585111+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:47:26.590912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555334+0000","last_change":"2024-08-18T22:33:33.589142+0000","last_active":"2024-08-18T22:33:34.555334+0000","last_peered":"2024-08-18T22:33:34.555334+0000","last_clean":"2024-08-18T22:33:34.555334+0000","last_became_active":"2024-08-18T22:33:33.588838+0000","last_became_peered":"2024-08-18T22:33:33.588838+0000","last_unstale":"2024-08-18T22:33:34.555334+0000","last_undegraded":"2024-08-18T22:33:34.555334+0000","last_fullsized":"2024-08-18T22:33:34.555334+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:38:45.974299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.573114+0000","last_change":"2024-08-18T22:33:33.568962+0000","last_active":"2024-08-18T22:33:33.573114+0000","last_peered":"2024-08-18T22:33:33.573114+0000","last_clean":"2024-08-18T22:33:33.573114+0000","last_became_active":"2024-08-18T22:33:33.567641+0000","last_became_peered":"2024-08-18T22:33:33.567641+0000","last_unstale":"2024-08-18T22:33:33.573114+0000","last_undegraded":"2024-08-18T22:33:33.573114+0000","last_fullsized":"2024-08-18T22:33:33.573114+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:35.771631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585674+0000","last_change":"2024-08-18T22:33:33.571547+0000","last_active":"2024-08-18T22:33:33.585674+0000","last_peered":"2024-08-18T22:33:33.585674+0000","last_clean":"2024-08-18T22:33:33.585674+0000","last_became_active":"2024-08-18T22:33:33.571272+0000","last_became_peered":"2024-08-18T22:33:33.571272+0000","last_unstale":"2024-08-18T22:33:33.585674+0000","last_undegraded":"2024-08-18T22:33:33.585674+0000","last_fullsized":"2024-08-18T22:33:33.585674+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:26:32.096822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.583199+0000","last_change":"2024-08-18T22:33:33.578724+0000","last_active":"2024-08-18T22:33:33.583199+0000","last_peered":"2024-08-18T22:33:33.583199+0000","last_clean":"2024-08-18T22:33:33.583199+0000","last_became_active":"2024-08-18T22:33:33.575125+0000","last_became_peered":"2024-08-18T22:33:33.575125+0000","last_unstale":"2024-08-18T22:33:33.583199+0000","last_undegraded":"2024-08-18T22:33:33.583199+0000","last_fullsized":"2024-08-18T22:33:33.583199+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:58.718903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.590128+0000","last_change":"2024-08-18T22:33:33.578970+0000","last_active":"2024-08-18T22:33:33.590128+0000","last_peered":"2024-08-18T22:33:33.590128+0000","last_clean":"2024-08-18T22:33:33.590128+0000","last_became_active":"2024-08-18T22:33:33.578671+0000","last_became_peered":"2024-08-18T22:33:33.578671+0000","last_unstale":"2024-08-18T22:33:33.590128+0000","last_undegraded":"2024-08-18T22:33:33.590128+0000","last_fullsized":"2024-08-18T22:33:33.590128+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:21:07.749533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.109870+0000","last_change":"2024-08-18T22:33:33.572639+0000","last_active":"2024-08-18T22:33:35.109870+0000","last_peered":"2024-08-18T22:33:35.109870+0000","last_clean":"2024-08-18T22:33:35.109870+0000","last_became_active":"2024-08-18T22:33:33.571312+0000","last_became_peered":"2024-08-18T22:33:33.571312+0000","last_unstale":"2024-08-18T22:33:35.109870+0000","last_undegraded":"2024-08-18T22:33:35.109870+0000","last_fullsized":"2024-08-18T22:33:35.109870+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:54:09.465854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.583661+0000","last_change":"2024-08-18T22:33:33.577258+0000","last_active":"2024-08-18T22:33:33.583661+0000","last_peered":"2024-08-18T22:33:33.583661+0000","last_clean":"2024-08-18T22:33:33.583661+0000","last_became_active":"2024-08-18T22:33:33.576922+0000","last_became_peered":"2024-08-18T22:33:33.576922+0000","last_unstale":"2024-08-18T22:33:33.583661+0000","last_undegraded":"2024-08-18T22:33:33.583661+0000","last_fullsized":"2024-08-18T22:33:33.583661+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:33:59.428445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555588+0000","last_change":"2024-08-18T22:33:33.580150+0000","last_active":"2024-08-18T22:33:34.555588+0000","last_peered":"2024-08-18T22:33:34.555588+0000","last_clean":"2024-08-18T22:33:34.555588+0000","last_became_active":"2024-08-18T22:33:33.579869+0000","last_became_peered":"2024-08-18T22:33:33.579869+0000","last_unstale":"2024-08-18T22:33:34.555588+0000","last_undegraded":"2024-08-18T22:33:34.555588+0000","last_fullsized":"2024-08-18T22:33:34.555588+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:32:59.363279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.592336+0000","last_change":"2024-08-18T22:33:33.591351+0000","last_active":"2024-08-18T22:33:33.592336+0000","last_peered":"2024-08-18T22:33:33.592336+0000","last_clean":"2024-08-18T22:33:33.592336+0000","last_became_active":"2024-08-18T22:33:33.591073+0000","last_became_peered":"2024-08-18T22:33:33.591073+0000","last_unstale":"2024-08-18T22:33:33.592336+0000","last_undegraded":"2024-08-18T22:33:33.592336+0000","last_fullsized":"2024-08-18T22:33:33.592336+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:50.634653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.582273+0000","last_change":"2024-08-18T22:33:33.572621+0000","last_active":"2024-08-18T22:33:33.582273+0000","last_peered":"2024-08-18T22:33:33.582273+0000","last_clean":"2024-08-18T22:33:33.582273+0000","last_became_active":"2024-08-18T22:33:33.572322+0000","last_became_peered":"2024-08-18T22:33:33.572322+0000","last_unstale":"2024-08-18T22:33:33.582273+0000","last_undegraded":"2024-08-18T22:33:33.582273+0000","last_fullsized":"2024-08-18T22:33:33.582273+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:18.208636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.576564+0000","last_change":"2024-08-18T22:33:33.570498+0000","last_active":"2024-08-18T22:33:33.576564+0000","last_peered":"2024-08-18T22:33:33.576564+0000","last_clean":"2024-08-18T22:33:33.576564+0000","last_became_active":"2024-08-18T22:33:33.569761+0000","last_became_peered":"2024-08-18T22:33:33.569761+0000","last_unstale":"2024-08-18T22:33:33.576564+0000","last_undegraded":"2024-08-18T22:33:33.576564+0000","last_fullsized":"2024-08-18T22:33:33.576564+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:02.409764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.584471+0000","last_change":"2024-08-18T22:33:33.576398+0000","last_active":"2024-08-18T22:33:33.584471+0000","last_peered":"2024-08-18T22:33:33.584471+0000","last_clean":"2024-08-18T22:33:33.584471+0000","last_became_active":"2024-08-18T22:33:33.576128+0000","last_became_peered":"2024-08-18T22:33:33.576128+0000","last_unstale":"2024-08-18T22:33:33.584471+0000","last_undegraded":"2024-08-18T22:33:33.584471+0000","last_fullsized":"2024-08-18T22:33:33.584471+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:38:51.878333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.592047+0000","last_change":"2024-08-18T22:33:33.587365+0000","last_active":"2024-08-18T22:33:33.592047+0000","last_peered":"2024-08-18T22:33:33.592047+0000","last_clean":"2024-08-18T22:33:33.592047+0000","last_became_active":"2024-08-18T22:33:33.586101+0000","last_became_peered":"2024-08-18T22:33:33.586101+0000","last_unstale":"2024-08-18T22:33:33.592047+0000","last_undegraded":"2024-08-18T22:33:33.592047+0000","last_fullsized":"2024-08-18T22:33:33.592047+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:18:34.390141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585603+0000","last_change":"2024-08-18T22:33:33.584613+0000","last_active":"2024-08-18T22:33:33.585603+0000","last_peered":"2024-08-18T22:33:33.585603+0000","last_clean":"2024-08-18T22:33:33.585603+0000","last_became_active":"2024-08-18T22:33:33.584347+0000","last_became_peered":"2024-08-18T22:33:33.584347+0000","last_unstale":"2024-08-18T22:33:33.585603+0000","last_undegraded":"2024-08-18T22:33:33.585603+0000","last_fullsized":"2024-08-18T22:33:33.585603+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:46.716033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.570802+0000","last_change":"2024-08-18T22:33:33.568721+0000","last_active":"2024-08-18T22:33:33.570802+0000","last_peered":"2024-08-18T22:33:33.570802+0000","last_clean":"2024-08-18T22:33:33.570802+0000","last_became_active":"2024-08-18T22:33:33.568020+0000","last_became_peered":"2024-08-18T22:33:33.568020+0000","last_unstale":"2024-08-18T22:33:33.570802+0000","last_undegraded":"2024-08-18T22:33:33.570802+0000","last_fullsized":"2024-08-18T22:33:33.570802+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:09.899071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.587152+0000","last_change":"2024-08-18T22:33:33.583247+0000","last_active":"2024-08-18T22:33:33.587152+0000","last_peered":"2024-08-18T22:33:33.587152+0000","last_clean":"2024-08-18T22:33:33.587152+0000","last_became_active":"2024-08-18T22:33:33.582723+0000","last_became_peered":"2024-08-18T22:33:33.582723+0000","last_unstale":"2024-08-18T22:33:33.587152+0000","last_undegraded":"2024-08-18T22:33:33.587152+0000","last_fullsized":"2024-08-18T22:33:33.587152+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:22:26.585187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.593001+0000","last_change":"2024-08-18T22:33:33.591167+0000","last_active":"2024-08-18T22:33:33.593001+0000","last_peered":"2024-08-18T22:33:33.593001+0000","last_clean":"2024-08-18T22:33:33.593001+0000","last_became_active":"2024-08-18T22:33:33.587856+0000","last_became_peered":"2024-08-18T22:33:33.587856+0000","last_unstale":"2024-08-18T22:33:33.593001+0000","last_undegraded":"2024-08-18T22:33:33.593001+0000","last_fullsized":"2024-08-18T22:33:33.593001+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:17:10.566950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585724+0000","last_change":"2024-08-18T22:33:33.582866+0000","last_active":"2024-08-18T22:33:33.585724+0000","last_peered":"2024-08-18T22:33:33.585724+0000","last_clean":"2024-08-18T22:33:33.585724+0000","last_became_active":"2024-08-18T22:33:33.582365+0000","last_became_peered":"2024-08-18T22:33:33.582365+0000","last_unstale":"2024-08-18T22:33:33.585724+0000","last_undegraded":"2024-08-18T22:33:33.585724+0000","last_fullsized":"2024-08-18T22:33:33.585724+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:33.332085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.587243+0000","last_change":"2024-08-18T22:33:33.578951+0000","last_active":"2024-08-18T22:33:33.587243+0000","last_peered":"2024-08-18T22:33:33.587243+0000","last_clean":"2024-08-18T22:33:33.587243+0000","last_became_active":"2024-08-18T22:33:33.578582+0000","last_became_peered":"2024-08-18T22:33:33.578582+0000","last_unstale":"2024-08-18T22:33:33.587243+0000","last_undegraded":"2024-08-18T22:33:33.587243+0000","last_fullsized":"2024-08-18T22:33:33.587243+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:59.703538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.108686+0000","last_change":"2024-08-18T22:33:33.568431+0000","last_active":"2024-08-18T22:33:35.108686+0000","last_peered":"2024-08-18T22:33:35.108686+0000","last_clean":"2024-08-18T22:33:35.108686+0000","last_became_active":"2024-08-18T22:33:33.568151+0000","last_became_peered":"2024-08-18T22:33:33.568151+0000","last_unstale":"2024-08-18T22:33:35.108686+0000","last_undegraded":"2024-08-18T22:33:35.108686+0000","last_fullsized":"2024-08-18T22:33:35.108686+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:31.151865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.572410+0000","last_change":"2024-08-18T22:33:33.568916+0000","last_active":"2024-08-18T22:33:33.572410+0000","last_peered":"2024-08-18T22:33:33.572410+0000","last_clean":"2024-08-18T22:33:33.572410+0000","last_became_active":"2024-08-18T22:33:33.567770+0000","last_became_peered":"2024-08-18T22:33:33.567770+0000","last_unstale":"2024-08-18T22:33:33.572410+0000","last_undegraded":"2024-08-18T22:33:33.572410+0000","last_fullsized":"2024-08-18T22:33:33.572410+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:33.674730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.572329+0000","last_change":"2024-08-18T22:33:33.568262+0000","last_active":"2024-08-18T22:33:33.572329+0000","last_peered":"2024-08-18T22:33:33.572329+0000","last_clean":"2024-08-18T22:33:33.572329+0000","last_became_active":"2024-08-18T22:33:33.567997+0000","last_became_peered":"2024-08-18T22:33:33.567997+0000","last_unstale":"2024-08-18T22:33:33.572329+0000","last_undegraded":"2024-08-18T22:33:33.572329+0000","last_fullsized":"2024-08-18T22:33:33.572329+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:46:59.703538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.586471+0000","last_change":"2024-08-18T22:33:33.583818+0000","last_active":"2024-08-18T22:33:33.586471+0000","last_peered":"2024-08-18T22:33:33.586471+0000","last_clean":"2024-08-18T22:33:33.586471+0000","last_became_active":"2024-08-18T22:33:33.583481+0000","last_became_peered":"2024-08-18T22:33:33.583481+0000","last_unstale":"2024-08-18T22:33:33.586471+0000","last_undegraded":"2024-08-18T22:33:33.586471+0000","last_fullsized":"2024-08-18T22:33:33.586471+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:01:46.885076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555787+0000","last_change":"2024-08-18T22:33:33.567737+0000","last_active":"2024-08-18T22:33:34.555787+0000","last_peered":"2024-08-18T22:33:34.555787+0000","last_clean":"2024-08-18T22:33:34.555787+0000","last_became_active":"2024-08-18T22:33:33.567455+0000","last_became_peered":"2024-08-18T22:33:33.567455+0000","last_unstale":"2024-08-18T22:33:34.555787+0000","last_undegraded":"2024-08-18T22:33:34.555787+0000","last_fullsized":"2024-08-18T22:33:34.555787+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:53:39.155135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.591368+0000","last_change":"2024-08-18T22:33:33.590699+0000","last_active":"2024-08-18T22:33:33.591368+0000","last_peered":"2024-08-18T22:33:33.591368+0000","last_clean":"2024-08-18T22:33:33.591368+0000","last_became_active":"2024-08-18T22:33:33.590391+0000","last_became_peered":"2024-08-18T22:33:33.590391+0000","last_unstale":"2024-08-18T22:33:33.591368+0000","last_undegraded":"2024-08-18T22:33:33.591368+0000","last_fullsized":"2024-08-18T22:33:33.591368+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T22:53:51.986037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.582904+0000","last_change":"2024-08-18T22:33:33.578356+0000","last_active":"2024-08-18T22:33:33.582904+0000","last_peered":"2024-08-18T22:33:33.582904+0000","last_clean":"2024-08-18T22:33:33.582904+0000","last_became_active":"2024-08-18T22:33:33.577255+0000","last_became_peered":"2024-08-18T22:33:33.577255+0000","last_unstale":"2024-08-18T22:33:33.582904+0000","last_undegraded":"2024-08-18T22:33:33.582904+0000","last_fullsized":"2024-08-18T22:33:33.582904+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:01.230314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.592080+0000","last_change":"2024-08-18T22:33:33.587924+0000","last_active":"2024-08-18T22:33:33.592080+0000","last_peered":"2024-08-18T22:33:33.592080+0000","last_clean":"2024-08-18T22:33:33.592080+0000","last_became_active":"2024-08-18T22:33:33.586864+0000","last_became_peered":"2024-08-18T22:33:33.586864+0000","last_unstale":"2024-08-18T22:33:33.592080+0000","last_undegraded":"2024-08-18T22:33:33.592080+0000","last_fullsized":"2024-08-18T22:33:33.592080+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:39:08.375933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.108832+0000","last_change":"2024-08-18T22:33:33.581655+0000","last_active":"2024-08-18T22:33:35.108832+0000","last_peered":"2024-08-18T22:33:35.108832+0000","last_clean":"2024-08-18T22:33:35.108832+0000","last_became_active":"2024-08-18T22:33:33.577529+0000","last_became_peered":"2024-08-18T22:33:33.577529+0000","last_unstale":"2024-08-18T22:33:35.108832+0000","last_undegraded":"2024-08-18T22:33:35.108832+0000","last_fullsized":"2024-08-18T22:33:35.108832+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:21:56.758783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.592086+0000","last_change":"2024-08-18T22:33:33.587686+0000","last_active":"2024-08-18T22:33:33.592086+0000","last_peered":"2024-08-18T22:33:33.592086+0000","last_clean":"2024-08-18T22:33:33.592086+0000","last_became_active":"2024-08-18T22:33:33.587376+0000","last_became_peered":"2024-08-18T22:33:33.587376+0000","last_unstale":"2024-08-18T22:33:33.592086+0000","last_undegraded":"2024-08-18T22:33:33.592086+0000","last_fullsized":"2024-08-18T22:33:33.592086+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:46:51.237271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.589942+0000","last_change":"2024-08-18T22:33:33.589435+0000","last_active":"2024-08-18T22:33:33.589942+0000","last_peered":"2024-08-18T22:33:33.589942+0000","last_clean":"2024-08-18T22:33:33.589942+0000","last_became_active":"2024-08-18T22:33:33.587903+0000","last_became_peered":"2024-08-18T22:33:33.587903+0000","last_unstale":"2024-08-18T22:33:33.589942+0000","last_undegraded":"2024-08-18T22:33:33.589942+0000","last_fullsized":"2024-08-18T22:33:33.589942+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:49:48.406365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"203'4","reported_seq":18,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.109980+0000","last_change":"2024-08-18T22:33:32.569766+0000","last_active":"2024-08-18T22:33:35.109980+0000","last_peered":"2024-08-18T22:33:35.109980+0000","last_clean":"2024-08-18T22:33:35.109980+0000","last_became_active":"2024-08-18T22:33:32.569453+0000","last_became_peered":"2024-08-18T22:33:32.569453+0000","last_unstale":"2024-08-18T22:33:35.109980+0000","last_undegraded":"2024-08-18T22:33:35.109980+0000","last_fullsized":"2024-08-18T22:33:35.109980+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:16:49.834639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.570619+0000","last_change":"2024-08-18T22:33:33.568563+0000","last_active":"2024-08-18T22:33:33.570619+0000","last_peered":"2024-08-18T22:33:33.570619+0000","last_clean":"2024-08-18T22:33:33.570619+0000","last_became_active":"2024-08-18T22:33:33.568275+0000","last_became_peered":"2024-08-18T22:33:33.568275+0000","last_unstale":"2024-08-18T22:33:33.570619+0000","last_undegraded":"2024-08-18T22:33:33.570619+0000","last_fullsized":"2024-08-18T22:33:33.570619+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:21:01.230314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"203'1","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.584364+0000","last_change":"2024-08-18T22:33:32.573378+0000","last_active":"2024-08-18T22:33:33.584364+0000","last_peered":"2024-08-18T22:33:33.584364+0000","last_clean":"2024-08-18T22:33:33.584364+0000","last_became_active":"2024-08-18T22:33:32.571371+0000","last_became_peered":"2024-08-18T22:33:32.571371+0000","last_unstale":"2024-08-18T22:33:33.584364+0000","last_undegraded":"2024-08-18T22:33:33.584364+0000","last_fullsized":"2024-08-18T22:33:33.584364+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:34:50.655403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.582986+0000","last_change":"2024-08-18T22:33:33.580026+0000","last_active":"2024-08-18T22:33:33.582986+0000","last_peered":"2024-08-18T22:33:33.582986+0000","last_clean":"2024-08-18T22:33:33.582986+0000","last_became_active":"2024-08-18T22:33:33.579692+0000","last_became_peered":"2024-08-18T22:33:33.579692+0000","last_unstale":"2024-08-18T22:33:33.582986+0000","last_undegraded":"2024-08-18T22:33:33.582986+0000","last_fullsized":"2024-08-18T22:33:33.582986+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:28:44.384772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"203'2","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.590005+0000","last_change":"2024-08-18T22:33:32.574824+0000","last_active":"2024-08-18T22:33:33.590005+0000","last_peered":"2024-08-18T22:33:33.590005+0000","last_clean":"2024-08-18T22:33:33.590005+0000","last_became_active":"2024-08-18T22:33:32.574547+0000","last_became_peered":"2024-08-18T22:33:32.574547+0000","last_unstale":"2024-08-18T22:33:33.590005+0000","last_undegraded":"2024-08-18T22:33:33.590005+0000","last_fullsized":"2024-08-18T22:33:33.590005+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:23.990819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.577921+0000","last_change":"2024-08-18T22:33:33.576463+0000","last_active":"2024-08-18T22:33:33.577921+0000","last_peered":"2024-08-18T22:33:33.577921+0000","last_clean":"2024-08-18T22:33:33.577921+0000","last_became_active":"2024-08-18T22:33:33.575480+0000","last_became_peered":"2024-08-18T22:33:33.575480+0000","last_unstale":"2024-08-18T22:33:33.577921+0000","last_undegraded":"2024-08-18T22:33:33.577921+0000","last_fullsized":"2024-08-18T22:33:33.577921+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:39.381642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"203'1","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585609+0000","last_change":"2024-08-18T22:33:32.566447+0000","last_active":"2024-08-18T22:33:33.585609+0000","last_peered":"2024-08-18T22:33:33.585609+0000","last_clean":"2024-08-18T22:33:33.585609+0000","last_became_active":"2024-08-18T22:33:32.566161+0000","last_became_peered":"2024-08-18T22:33:32.566161+0000","last_unstale":"2024-08-18T22:33:33.585609+0000","last_undegraded":"2024-08-18T22:33:33.585609+0000","last_fullsized":"2024-08-18T22:33:33.585609+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:23.670076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.580983+0000","last_change":"2024-08-18T22:33:33.564942+0000","last_active":"2024-08-18T22:33:33.580983+0000","last_peered":"2024-08-18T22:33:33.580983+0000","last_clean":"2024-08-18T22:33:33.580983+0000","last_became_active":"2024-08-18T22:33:33.564663+0000","last_became_peered":"2024-08-18T22:33:33.564663+0000","last_unstale":"2024-08-18T22:33:33.580983+0000","last_undegraded":"2024-08-18T22:33:33.580983+0000","last_fullsized":"2024-08-18T22:33:33.580983+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:16:21.296371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"203'1","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.586077+0000","last_change":"2024-08-18T22:33:32.579612+0000","last_active":"2024-08-18T22:33:33.586077+0000","last_peered":"2024-08-18T22:33:33.586077+0000","last_clean":"2024-08-18T22:33:33.586077+0000","last_became_active":"2024-08-18T22:33:32.579276+0000","last_became_peered":"2024-08-18T22:33:32.579276+0000","last_unstale":"2024-08-18T22:33:33.586077+0000","last_undegraded":"2024-08-18T22:33:33.586077+0000","last_fullsized":"2024-08-18T22:33:33.586077+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:06:35.861241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.589268+0000","last_change":"2024-08-18T22:33:33.588194+0000","last_active":"2024-08-18T22:33:33.589268+0000","last_peered":"2024-08-18T22:33:33.589268+0000","last_clean":"2024-08-18T22:33:33.589268+0000","last_became_active":"2024-08-18T22:33:33.587678+0000","last_became_peered":"2024-08-18T22:33:33.587678+0000","last_unstale":"2024-08-18T22:33:33.589268+0000","last_undegraded":"2024-08-18T22:33:33.589268+0000","last_fullsized":"2024-08-18T22:33:33.589268+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:35.771631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555131+0000","last_change":"2024-08-18T22:33:32.574005+0000","last_active":"2024-08-18T22:33:34.555131+0000","last_peered":"2024-08-18T22:33:34.555131+0000","last_clean":"2024-08-18T22:33:34.555131+0000","last_became_active":"2024-08-18T22:33:32.573723+0000","last_became_peered":"2024-08-18T22:33:32.573723+0000","last_unstale":"2024-08-18T22:33:34.555131+0000","last_undegraded":"2024-08-18T22:33:34.555131+0000","last_fullsized":"2024-08-18T22:33:34.555131+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:39.863454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.109164+0000","last_change":"2024-08-18T22:33:33.574128+0000","last_active":"2024-08-18T22:33:35.109164+0000","last_peered":"2024-08-18T22:33:35.109164+0000","last_clean":"2024-08-18T22:33:35.109164+0000","last_became_active":"2024-08-18T22:33:33.573866+0000","last_became_peered":"2024-08-18T22:33:33.573866+0000","last_unstale":"2024-08-18T22:33:35.109164+0000","last_undegraded":"2024-08-18T22:33:35.109164+0000","last_fullsized":"2024-08-18T22:33:35.109164+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:58:47.115460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.562003+0000","last_change":"2024-08-18T22:33:32.566021+0000","last_active":"2024-08-18T22:33:33.562003+0000","last_peered":"2024-08-18T22:33:33.562003+0000","last_clean":"2024-08-18T22:33:33.562003+0000","last_became_active":"2024-08-18T22:33:32.565773+0000","last_became_peered":"2024-08-18T22:33:32.565773+0000","last_unstale":"2024-08-18T22:33:33.562003+0000","last_undegraded":"2024-08-18T22:33:33.562003+0000","last_fullsized":"2024-08-18T22:33:33.562003+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:24:14.350332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.577437+0000","last_change":"2024-08-18T22:33:33.571357+0000","last_active":"2024-08-18T22:33:33.577437+0000","last_peered":"2024-08-18T22:33:33.577437+0000","last_clean":"2024-08-18T22:33:33.577437+0000","last_became_active":"2024-08-18T22:33:33.571041+0000","last_became_peered":"2024-08-18T22:33:33.571041+0000","last_unstale":"2024-08-18T22:33:33.577437+0000","last_undegraded":"2024-08-18T22:33:33.577437+0000","last_fullsized":"2024-08-18T22:33:33.577437+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:06:36.864568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.556259+0000","last_change":"2024-08-18T22:33:32.579569+0000","last_active":"2024-08-18T22:33:33.556259+0000","last_peered":"2024-08-18T22:33:33.556259+0000","last_clean":"2024-08-18T22:33:33.556259+0000","last_became_active":"2024-08-18T22:33:32.579166+0000","last_became_peered":"2024-08-18T22:33:32.579166+0000","last_unstale":"2024-08-18T22:33:33.556259+0000","last_undegraded":"2024-08-18T22:33:33.556259+0000","last_fullsized":"2024-08-18T22:33:33.556259+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:31:44.487326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.587166+0000","last_change":"2024-08-18T22:33:33.578405+0000","last_active":"2024-08-18T22:33:33.587166+0000","last_peered":"2024-08-18T22:33:33.587166+0000","last_clean":"2024-08-18T22:33:33.587166+0000","last_became_active":"2024-08-18T22:33:33.578092+0000","last_became_peered":"2024-08-18T22:33:33.578092+0000","last_unstale":"2024-08-18T22:33:33.587166+0000","last_undegraded":"2024-08-18T22:33:33.587166+0000","last_fullsized":"2024-08-18T22:33:33.587166+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:05.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555704+0000","last_change":"2024-08-18T22:33:32.576751+0000","last_active":"2024-08-18T22:33:34.555704+0000","last_peered":"2024-08-18T22:33:34.555704+0000","last_clean":"2024-08-18T22:33:34.555704+0000","last_became_active":"2024-08-18T22:33:32.576478+0000","last_became_peered":"2024-08-18T22:33:32.576478+0000","last_unstale":"2024-08-18T22:33:34.555704+0000","last_undegraded":"2024-08-18T22:33:34.555704+0000","last_fullsized":"2024-08-18T22:33:34.555704+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:09:25.303378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.577387+0000","last_change":"2024-08-18T22:33:33.576535+0000","last_active":"2024-08-18T22:33:33.577387+0000","last_peered":"2024-08-18T22:33:33.577387+0000","last_clean":"2024-08-18T22:33:33.577387+0000","last_became_active":"2024-08-18T22:33:33.572823+0000","last_became_peered":"2024-08-18T22:33:33.572823+0000","last_unstale":"2024-08-18T22:33:33.577387+0000","last_undegraded":"2024-08-18T22:33:33.577387+0000","last_fullsized":"2024-08-18T22:33:33.577387+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:56.739658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"203'3","reported_seq":15,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.586855+0000","last_change":"2024-08-18T22:33:32.580596+0000","last_active":"2024-08-18T22:33:33.586855+0000","last_peered":"2024-08-18T22:33:33.586855+0000","last_clean":"2024-08-18T22:33:33.586855+0000","last_became_active":"2024-08-18T22:33:32.579740+0000","last_became_peered":"2024-08-18T22:33:32.579740+0000","last_unstale":"2024-08-18T22:33:33.586855+0000","last_undegraded":"2024-08-18T22:33:33.586855+0000","last_fullsized":"2024-08-18T22:33:33.586855+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:23.670076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.556238+0000","last_change":"2024-08-18T22:33:33.581159+0000","last_active":"2024-08-18T22:33:34.556238+0000","last_peered":"2024-08-18T22:33:34.556238+0000","last_clean":"2024-08-18T22:33:34.556238+0000","last_became_active":"2024-08-18T22:33:33.580669+0000","last_became_peered":"2024-08-18T22:33:33.580669+0000","last_unstale":"2024-08-18T22:33:34.556238+0000","last_undegraded":"2024-08-18T22:33:34.556238+0000","last_fullsized":"2024-08-18T22:33:34.556238+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:52:29.706033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"203'6","reported_seq":18,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.594677+0000","last_change":"2024-08-18T22:33:32.574156+0000","last_active":"2024-08-18T22:33:33.594677+0000","last_peered":"2024-08-18T22:33:33.594677+0000","last_clean":"2024-08-18T22:33:33.594677+0000","last_became_active":"2024-08-18T22:33:32.573829+0000","last_became_peered":"2024-08-18T22:33:32.573829+0000","last_unstale":"2024-08-18T22:33:33.594677+0000","last_undegraded":"2024-08-18T22:33:33.594677+0000","last_fullsized":"2024-08-18T22:33:33.594677+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:53:08.694427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.579862+0000","last_change":"2024-08-18T22:33:33.573630+0000","last_active":"2024-08-18T22:33:33.579862+0000","last_peered":"2024-08-18T22:33:33.579862+0000","last_clean":"2024-08-18T22:33:33.579862+0000","last_became_active":"2024-08-18T22:33:33.573305+0000","last_became_peered":"2024-08-18T22:33:33.573305+0000","last_unstale":"2024-08-18T22:33:33.579862+0000","last_undegraded":"2024-08-18T22:33:33.579862+0000","last_fullsized":"2024-08-18T22:33:33.579862+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:15:25.395432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"203'2","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.590476+0000","last_change":"2024-08-18T22:33:32.568511+0000","last_active":"2024-08-18T22:33:33.590476+0000","last_peered":"2024-08-18T22:33:33.590476+0000","last_clean":"2024-08-18T22:33:33.590476+0000","last_became_active":"2024-08-18T22:33:32.568216+0000","last_became_peered":"2024-08-18T22:33:32.568216+0000","last_unstale":"2024-08-18T22:33:33.590476+0000","last_undegraded":"2024-08-18T22:33:33.590476+0000","last_fullsized":"2024-08-18T22:33:33.590476+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:02:23.919906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.582961+0000","last_change":"2024-08-18T22:33:33.581119+0000","last_active":"2024-08-18T22:33:33.582961+0000","last_peered":"2024-08-18T22:33:33.582961+0000","last_clean":"2024-08-18T22:33:33.582961+0000","last_became_active":"2024-08-18T22:33:33.580828+0000","last_became_peered":"2024-08-18T22:33:33.580828+0000","last_unstale":"2024-08-18T22:33:33.582961+0000","last_undegraded":"2024-08-18T22:33:33.582961+0000","last_fullsized":"2024-08-18T22:33:33.582961+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:58:51.453777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.565020+0000","last_change":"2024-08-18T22:33:32.561205+0000","last_active":"2024-08-18T22:33:33.565020+0000","last_peered":"2024-08-18T22:33:33.565020+0000","last_clean":"2024-08-18T22:33:33.565020+0000","last_became_active":"2024-08-18T22:33:32.560904+0000","last_became_peered":"2024-08-18T22:33:32.560904+0000","last_unstale":"2024-08-18T22:33:33.565020+0000","last_undegraded":"2024-08-18T22:33:33.565020+0000","last_fullsized":"2024-08-18T22:33:33.565020+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:10:55.654112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.575192+0000","last_change":"2024-08-18T22:33:33.572322+0000","last_active":"2024-08-18T22:33:33.575192+0000","last_peered":"2024-08-18T22:33:33.575192+0000","last_clean":"2024-08-18T22:33:33.575192+0000","last_became_active":"2024-08-18T22:33:33.572074+0000","last_became_peered":"2024-08-18T22:33:33.572074+0000","last_unstale":"2024-08-18T22:33:33.575192+0000","last_undegraded":"2024-08-18T22:33:33.575192+0000","last_fullsized":"2024-08-18T22:33:33.575192+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:00:55.104928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.567873+0000","last_change":"2024-08-18T22:33:32.570929+0000","last_active":"2024-08-18T22:33:33.567873+0000","last_peered":"2024-08-18T22:33:33.567873+0000","last_clean":"2024-08-18T22:33:33.567873+0000","last_became_active":"2024-08-18T22:33:32.570382+0000","last_became_peered":"2024-08-18T22:33:32.570382+0000","last_unstale":"2024-08-18T22:33:33.567873+0000","last_undegraded":"2024-08-18T22:33:33.567873+0000","last_fullsized":"2024-08-18T22:33:33.567873+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:10:28.444384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.587324+0000","last_change":"2024-08-18T22:33:33.584273+0000","last_active":"2024-08-18T22:33:33.587324+0000","last_peered":"2024-08-18T22:33:33.587324+0000","last_clean":"2024-08-18T22:33:33.587324+0000","last_became_active":"2024-08-18T22:33:33.584011+0000","last_became_peered":"2024-08-18T22:33:33.584011+0000","last_unstale":"2024-08-18T22:33:33.587324+0000","last_undegraded":"2024-08-18T22:33:33.587324+0000","last_fullsized":"2024-08-18T22:33:33.587324+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:33.674730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"203'8","reported_seq":20,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.589533+0000","last_change":"2024-08-18T22:33:32.575570+0000","last_active":"2024-08-18T22:33:33.589533+0000","last_peered":"2024-08-18T22:33:33.589533+0000","last_clean":"2024-08-18T22:33:33.589533+0000","last_became_active":"2024-08-18T22:33:32.575306+0000","last_became_peered":"2024-08-18T22:33:32.575306+0000","last_unstale":"2024-08-18T22:33:33.589533+0000","last_undegraded":"2024-08-18T22:33:33.589533+0000","last_fullsized":"2024-08-18T22:33:33.589533+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:21:23.118371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.586227+0000","last_change":"2024-08-18T22:33:33.581288+0000","last_active":"2024-08-18T22:33:33.586227+0000","last_peered":"2024-08-18T22:33:33.586227+0000","last_clean":"2024-08-18T22:33:33.586227+0000","last_became_active":"2024-08-18T22:33:33.581005+0000","last_became_peered":"2024-08-18T22:33:33.581005+0000","last_unstale":"2024-08-18T22:33:33.586227+0000","last_undegraded":"2024-08-18T22:33:33.586227+0000","last_fullsized":"2024-08-18T22:33:33.586227+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:26.432041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"203'1","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.590267+0000","last_change":"2024-08-18T22:33:32.573003+0000","last_active":"2024-08-18T22:33:33.590267+0000","last_peered":"2024-08-18T22:33:33.590267+0000","last_clean":"2024-08-18T22:33:33.590267+0000","last_became_active":"2024-08-18T22:33:32.572711+0000","last_became_peered":"2024-08-18T22:33:32.572711+0000","last_unstale":"2024-08-18T22:33:33.590267+0000","last_undegraded":"2024-08-18T22:33:33.590267+0000","last_fullsized":"2024-08-18T22:33:33.590267+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:30.869845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.570647+0000","last_change":"2024-08-18T22:33:33.564272+0000","last_active":"2024-08-18T22:33:33.570647+0000","last_peered":"2024-08-18T22:33:33.570647+0000","last_clean":"2024-08-18T22:33:33.570647+0000","last_became_active":"2024-08-18T22:33:33.563983+0000","last_became_peered":"2024-08-18T22:33:33.563983+0000","last_unstale":"2024-08-18T22:33:33.570647+0000","last_undegraded":"2024-08-18T22:33:33.570647+0000","last_fullsized":"2024-08-18T22:33:33.570647+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:50:05.902899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"203'2","reported_seq":16,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.109477+0000","last_change":"2024-08-18T22:33:32.568900+0000","last_active":"2024-08-18T22:33:35.109477+0000","last_peered":"2024-08-18T22:33:35.109477+0000","last_clean":"2024-08-18T22:33:35.109477+0000","last_became_active":"2024-08-18T22:33:32.568594+0000","last_became_peered":"2024-08-18T22:33:32.568594+0000","last_unstale":"2024-08-18T22:33:35.109477+0000","last_undegraded":"2024-08-18T22:33:35.109477+0000","last_fullsized":"2024-08-18T22:33:35.109477+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:47.452443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.570826+0000","last_change":"2024-08-18T22:33:33.568967+0000","last_active":"2024-08-18T22:33:33.570826+0000","last_peered":"2024-08-18T22:33:33.570826+0000","last_clean":"2024-08-18T22:33:33.570826+0000","last_became_active":"2024-08-18T22:33:33.568385+0000","last_became_peered":"2024-08-18T22:33:33.568385+0000","last_unstale":"2024-08-18T22:33:33.570826+0000","last_undegraded":"2024-08-18T22:33:33.570826+0000","last_fullsized":"2024-08-18T22:33:33.570826+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:06:26.432041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"203'1","reported_seq":13,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.590965+0000","last_change":"2024-08-18T22:33:32.571231+0000","last_active":"2024-08-18T22:33:33.590965+0000","last_peered":"2024-08-18T22:33:33.590965+0000","last_clean":"2024-08-18T22:33:33.590965+0000","last_became_active":"2024-08-18T22:33:32.570958+0000","last_became_peered":"2024-08-18T22:33:32.570958+0000","last_unstale":"2024-08-18T22:33:33.590965+0000","last_undegraded":"2024-08-18T22:33:33.590965+0000","last_fullsized":"2024-08-18T22:33:33.590965+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:08:59.079875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.582322+0000","last_change":"2024-08-18T22:33:33.577694+0000","last_active":"2024-08-18T22:33:33.582322+0000","last_peered":"2024-08-18T22:33:33.582322+0000","last_clean":"2024-08-18T22:33:33.582322+0000","last_became_active":"2024-08-18T22:33:33.577437+0000","last_became_peered":"2024-08-18T22:33:33.577437+0000","last_unstale":"2024-08-18T22:33:33.582322+0000","last_undegraded":"2024-08-18T22:33:33.582322+0000","last_fullsized":"2024-08-18T22:33:33.582322+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:57:18.439868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.568729+0000","last_change":"2024-08-18T22:33:32.571035+0000","last_active":"2024-08-18T22:33:33.568729+0000","last_peered":"2024-08-18T22:33:33.568729+0000","last_clean":"2024-08-18T22:33:33.568729+0000","last_became_active":"2024-08-18T22:33:32.570734+0000","last_became_peered":"2024-08-18T22:33:32.570734+0000","last_unstale":"2024-08-18T22:33:33.568729+0000","last_undegraded":"2024-08-18T22:33:33.568729+0000","last_fullsized":"2024-08-18T22:33:33.568729+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:40:37.925403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.576983+0000","last_change":"2024-08-18T22:33:33.570929+0000","last_active":"2024-08-18T22:33:33.576983+0000","last_peered":"2024-08-18T22:33:33.576983+0000","last_clean":"2024-08-18T22:33:33.576983+0000","last_became_active":"2024-08-18T22:33:33.570607+0000","last_became_peered":"2024-08-18T22:33:33.570607+0000","last_unstale":"2024-08-18T22:33:33.576983+0000","last_undegraded":"2024-08-18T22:33:33.576983+0000","last_fullsized":"2024-08-18T22:33:33.576983+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:43:40.509975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"203'2","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.588832+0000","last_change":"2024-08-18T22:33:32.578925+0000","last_active":"2024-08-18T22:33:33.588832+0000","last_peered":"2024-08-18T22:33:33.588832+0000","last_clean":"2024-08-18T22:33:33.588832+0000","last_became_active":"2024-08-18T22:33:32.578603+0000","last_became_peered":"2024-08-18T22:33:32.578603+0000","last_unstale":"2024-08-18T22:33:33.588832+0000","last_undegraded":"2024-08-18T22:33:33.588832+0000","last_fullsized":"2024-08-18T22:33:33.588832+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:49:33.408944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.579435+0000","last_change":"2024-08-18T22:33:33.576276+0000","last_active":"2024-08-18T22:33:33.579435+0000","last_peered":"2024-08-18T22:33:33.579435+0000","last_clean":"2024-08-18T22:33:33.579435+0000","last_became_active":"2024-08-18T22:33:33.576003+0000","last_became_peered":"2024-08-18T22:33:33.576003+0000","last_unstale":"2024-08-18T22:33:33.579435+0000","last_undegraded":"2024-08-18T22:33:33.579435+0000","last_fullsized":"2024-08-18T22:33:33.579435+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:11:19.573546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.565281+0000","last_change":"2024-08-18T22:33:32.571701+0000","last_active":"2024-08-18T22:33:33.565281+0000","last_peered":"2024-08-18T22:33:33.565281+0000","last_clean":"2024-08-18T22:33:33.565281+0000","last_became_active":"2024-08-18T22:33:32.570649+0000","last_became_peered":"2024-08-18T22:33:32.570649+0000","last_unstale":"2024-08-18T22:33:33.565281+0000","last_undegraded":"2024-08-18T22:33:33.565281+0000","last_fullsized":"2024-08-18T22:33:33.565281+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:31:44.487326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585651+0000","last_change":"2024-08-18T22:33:33.581042+0000","last_active":"2024-08-18T22:33:33.585651+0000","last_peered":"2024-08-18T22:33:33.585651+0000","last_clean":"2024-08-18T22:33:33.585651+0000","last_became_active":"2024-08-18T22:33:33.580744+0000","last_became_peered":"2024-08-18T22:33:33.580744+0000","last_unstale":"2024-08-18T22:33:33.585651+0000","last_undegraded":"2024-08-18T22:33:33.585651+0000","last_fullsized":"2024-08-18T22:33:33.585651+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:29:09.899071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.564997+0000","last_change":"2024-08-18T22:33:32.574674+0000","last_active":"2024-08-18T22:33:33.564997+0000","last_peered":"2024-08-18T22:33:33.564997+0000","last_clean":"2024-08-18T22:33:33.564997+0000","last_became_active":"2024-08-18T22:33:32.574390+0000","last_became_peered":"2024-08-18T22:33:32.574390+0000","last_unstale":"2024-08-18T22:33:33.564997+0000","last_undegraded":"2024-08-18T22:33:33.564997+0000","last_fullsized":"2024-08-18T22:33:33.564997+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:16.743582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.572759+0000","last_change":"2024-08-18T22:33:33.571076+0000","last_active":"2024-08-18T22:33:33.572759+0000","last_peered":"2024-08-18T22:33:33.572759+0000","last_clean":"2024-08-18T22:33:33.572759+0000","last_became_active":"2024-08-18T22:33:33.570507+0000","last_became_peered":"2024-08-18T22:33:33.570507+0000","last_unstale":"2024-08-18T22:33:33.572759+0000","last_undegraded":"2024-08-18T22:33:33.572759+0000","last_fullsized":"2024-08-18T22:33:33.572759+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:02:04.607326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.108404+0000","last_change":"2024-08-18T22:33:32.568836+0000","last_active":"2024-08-18T22:33:35.108404+0000","last_peered":"2024-08-18T22:33:35.108404+0000","last_clean":"2024-08-18T22:33:35.108404+0000","last_became_active":"2024-08-18T22:33:32.568536+0000","last_became_peered":"2024-08-18T22:33:32.568536+0000","last_unstale":"2024-08-18T22:33:35.108404+0000","last_undegraded":"2024-08-18T22:33:35.108404+0000","last_fullsized":"2024-08-18T22:33:35.108404+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:04:28.393051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.579946+0000","last_change":"2024-08-18T22:33:33.573813+0000","last_active":"2024-08-18T22:33:33.579946+0000","last_peered":"2024-08-18T22:33:33.579946+0000","last_clean":"2024-08-18T22:33:33.579946+0000","last_became_active":"2024-08-18T22:33:33.573542+0000","last_became_peered":"2024-08-18T22:33:33.573542+0000","last_unstale":"2024-08-18T22:33:33.579946+0000","last_undegraded":"2024-08-18T22:33:33.579946+0000","last_fullsized":"2024-08-18T22:33:33.579946+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:45:31.873172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"203'2","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.581463+0000","last_change":"2024-08-18T22:33:32.576802+0000","last_active":"2024-08-18T22:33:33.581463+0000","last_peered":"2024-08-18T22:33:33.581463+0000","last_clean":"2024-08-18T22:33:33.581463+0000","last_became_active":"2024-08-18T22:33:32.576521+0000","last_became_peered":"2024-08-18T22:33:32.576521+0000","last_unstale":"2024-08-18T22:33:33.581463+0000","last_undegraded":"2024-08-18T22:33:33.581463+0000","last_fullsized":"2024-08-18T22:33:33.581463+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:42:13.334141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.587092+0000","last_change":"2024-08-18T22:33:33.582973+0000","last_active":"2024-08-18T22:33:33.587092+0000","last_peered":"2024-08-18T22:33:33.587092+0000","last_clean":"2024-08-18T22:33:33.587092+0000","last_became_active":"2024-08-18T22:33:33.582349+0000","last_became_peered":"2024-08-18T22:33:33.582349+0000","last_unstale":"2024-08-18T22:33:33.587092+0000","last_undegraded":"2024-08-18T22:33:33.587092+0000","last_fullsized":"2024-08-18T22:33:33.587092+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-19T23:04:47.615332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.564102+0000","last_change":"2024-08-18T22:33:32.570762+0000","last_active":"2024-08-18T22:33:33.564102+0000","last_peered":"2024-08-18T22:33:33.564102+0000","last_clean":"2024-08-18T22:33:33.564102+0000","last_became_active":"2024-08-18T22:33:32.570408+0000","last_became_peered":"2024-08-18T22:33:32.570408+0000","last_unstale":"2024-08-18T22:33:33.564102+0000","last_undegraded":"2024-08-18T22:33:33.564102+0000","last_fullsized":"2024-08-18T22:33:33.564102+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:15:42.616126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.591914+0000","last_change":"2024-08-18T22:33:33.586732+0000","last_active":"2024-08-18T22:33:33.591914+0000","last_peered":"2024-08-18T22:33:33.591914+0000","last_clean":"2024-08-18T22:33:33.591914+0000","last_became_active":"2024-08-18T22:33:33.586429+0000","last_became_peered":"2024-08-18T22:33:33.586429+0000","last_unstale":"2024-08-18T22:33:33.591914+0000","last_undegraded":"2024-08-18T22:33:33.591914+0000","last_fullsized":"2024-08-18T22:33:33.591914+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:51:16.795306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.564917+0000","last_change":"2024-08-18T22:33:32.564020+0000","last_active":"2024-08-18T22:33:33.564917+0000","last_peered":"2024-08-18T22:33:33.564917+0000","last_clean":"2024-08-18T22:33:33.564917+0000","last_became_active":"2024-08-18T22:33:32.563764+0000","last_became_peered":"2024-08-18T22:33:32.563764+0000","last_unstale":"2024-08-18T22:33:33.564917+0000","last_undegraded":"2024-08-18T22:33:33.564917+0000","last_fullsized":"2024-08-18T22:33:33.564917+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:14:34.914736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.109703+0000","last_change":"2024-08-18T22:33:33.585397+0000","last_active":"2024-08-18T22:33:35.109703+0000","last_peered":"2024-08-18T22:33:35.109703+0000","last_clean":"2024-08-18T22:33:35.109703+0000","last_became_active":"2024-08-18T22:33:33.585114+0000","last_became_peered":"2024-08-18T22:33:33.585114+0000","last_unstale":"2024-08-18T22:33:35.109703+0000","last_undegraded":"2024-08-18T22:33:35.109703+0000","last_fullsized":"2024-08-18T22:33:35.109703+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:09:26.840140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.568993+0000","last_change":"2024-08-18T22:33:32.579620+0000","last_active":"2024-08-18T22:33:33.568993+0000","last_peered":"2024-08-18T22:33:33.568993+0000","last_clean":"2024-08-18T22:33:33.568993+0000","last_became_active":"2024-08-18T22:33:32.578842+0000","last_became_peered":"2024-08-18T22:33:32.578842+0000","last_unstale":"2024-08-18T22:33:33.568993+0000","last_undegraded":"2024-08-18T22:33:33.568993+0000","last_fullsized":"2024-08-18T22:33:33.568993+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:13:54.376674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585148+0000","last_change":"2024-08-18T22:33:33.581711+0000","last_active":"2024-08-18T22:33:33.585148+0000","last_peered":"2024-08-18T22:33:33.585148+0000","last_clean":"2024-08-18T22:33:33.585148+0000","last_became_active":"2024-08-18T22:33:33.581456+0000","last_became_peered":"2024-08-18T22:33:33.581456+0000","last_unstale":"2024-08-18T22:33:33.585148+0000","last_undegraded":"2024-08-18T22:33:33.585148+0000","last_fullsized":"2024-08-18T22:33:33.585148+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:23:59.852602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.561063+0000","last_change":"2024-08-18T22:33:32.569481+0000","last_active":"2024-08-18T22:33:33.561063+0000","last_peered":"2024-08-18T22:33:33.561063+0000","last_clean":"2024-08-18T22:33:33.561063+0000","last_became_active":"2024-08-18T22:33:32.569083+0000","last_became_peered":"2024-08-18T22:33:32.569083+0000","last_unstale":"2024-08-18T22:33:33.561063+0000","last_undegraded":"2024-08-18T22:33:33.561063+0000","last_fullsized":"2024-08-18T22:33:33.561063+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:21:38.717703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.583244+0000","last_change":"2024-08-18T22:33:33.576057+0000","last_active":"2024-08-18T22:33:33.583244+0000","last_peered":"2024-08-18T22:33:33.583244+0000","last_clean":"2024-08-18T22:33:33.583244+0000","last_became_active":"2024-08-18T22:33:33.575733+0000","last_became_peered":"2024-08-18T22:33:33.575733+0000","last_unstale":"2024-08-18T22:33:33.583244+0000","last_undegraded":"2024-08-18T22:33:33.583244+0000","last_fullsized":"2024-08-18T22:33:33.583244+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:42:30.101525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":14,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:34.555706+0000","last_change":"2024-08-18T22:33:32.573095+0000","last_active":"2024-08-18T22:33:34.555706+0000","last_peered":"2024-08-18T22:33:34.555706+0000","last_clean":"2024-08-18T22:33:34.555706+0000","last_became_active":"2024-08-18T22:33:32.572789+0000","last_became_peered":"2024-08-18T22:33:32.572789+0000","last_unstale":"2024-08-18T22:33:34.555706+0000","last_undegraded":"2024-08-18T22:33:34.555706+0000","last_fullsized":"2024-08-18T22:33:34.555706+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:55:10.968373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":12,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-08-18T22:33:35.108460+0000","last_change":"2024-08-18T22:33:33.566653+0000","last_active":"2024-08-18T22:33:35.108460+0000","last_peered":"2024-08-18T22:33:35.108460+0000","last_clean":"2024-08-18T22:33:35.108460+0000","last_became_active":"2024-08-18T22:33:33.566367+0000","last_became_peered":"2024-08-18T22:33:33.566367+0000","last_unstale":"2024-08-18T22:33:35.108460+0000","last_undegraded":"2024-08-18T22:33:35.108460+0000","last_fullsized":"2024-08-18T22:33:35.108460+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:16.272806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.556063+0000","last_change":"2024-08-18T22:33:32.579541+0000","last_active":"2024-08-18T22:33:33.556063+0000","last_peered":"2024-08-18T22:33:33.556063+0000","last_clean":"2024-08-18T22:33:33.556063+0000","last_became_active":"2024-08-18T22:33:32.579189+0000","last_became_peered":"2024-08-18T22:33:32.579189+0000","last_unstale":"2024-08-18T22:33:33.556063+0000","last_undegraded":"2024-08-18T22:33:33.556063+0000","last_fullsized":"2024-08-18T22:33:33.556063+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:05:16.743582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.577212+0000","last_change":"2024-08-18T22:33:33.568775+0000","last_active":"2024-08-18T22:33:33.577212+0000","last_peered":"2024-08-18T22:33:33.577212+0000","last_clean":"2024-08-18T22:33:33.577212+0000","last_became_active":"2024-08-18T22:33:33.568497+0000","last_became_peered":"2024-08-18T22:33:33.568497+0000","last_unstale":"2024-08-18T22:33:33.577212+0000","last_undegraded":"2024-08-18T22:33:33.577212+0000","last_fullsized":"2024-08-18T22:33:33.577212+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:26:13.770567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":12,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.558665+0000","last_change":"2024-08-18T22:33:32.574643+0000","last_active":"2024-08-18T22:33:33.558665+0000","last_peered":"2024-08-18T22:33:33.558665+0000","last_clean":"2024-08-18T22:33:33.558665+0000","last_became_active":"2024-08-18T22:33:32.574381+0000","last_became_peered":"2024-08-18T22:33:32.574381+0000","last_unstale":"2024-08-18T22:33:33.558665+0000","last_undegraded":"2024-08-18T22:33:33.558665+0000","last_fullsized":"2024-08-18T22:33:33.558665+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:07.714553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":9,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.585803+0000","last_change":"2024-08-18T22:33:33.583695+0000","last_active":"2024-08-18T22:33:33.585803+0000","last_peered":"2024-08-18T22:33:33.585803+0000","last_clean":"2024-08-18T22:33:33.585803+0000","last_became_active":"2024-08-18T22:33:33.583407+0000","last_became_peered":"2024-08-18T22:33:33.583407+0000","last_unstale":"2024-08-18T22:33:33.585803+0000","last_undegraded":"2024-08-18T22:33:33.585803+0000","last_fullsized":"2024-08-18T22:33:33.585803+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:32.541052+0000","last_clean_scrub_stamp":"2024-08-18T22:33:32.541052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:11:01.722342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"203'2","reported_seq":14,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.586536+0000","last_change":"2024-08-18T22:33:32.579553+0000","last_active":"2024-08-18T22:33:33.586536+0000","last_peered":"2024-08-18T22:33:33.586536+0000","last_clean":"2024-08-18T22:33:33.586536+0000","last_became_active":"2024-08-18T22:33:32.579220+0000","last_became_peered":"2024-08-18T22:33:32.579220+0000","last_unstale":"2024-08-18T22:33:33.586536+0000","last_undegraded":"2024-08-18T22:33:33.586536+0000","last_fullsized":"2024-08-18T22:33:33.586536+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":201,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:33:31.537724+0000","last_clean_scrub_stamp":"2024-08-18T22:33:31.537724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:38:50.875005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":541,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-08-18T22:33:33.555932+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:33:33.555932+0000","last_peered":"2024-08-18T22:33:33.555932+0000","last_clean":"2024-08-18T22:33:33.555932+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:33:33.555932+0000","last_undegraded":"2024-08-18T22:33:33.555932+0000","last_fullsized":"2024-08-18T22:33:33.555932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509616,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52288,"kb_used_data":3064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319552,"statfs":{"total":96636764160,"available":96583221248,"internally_reserved":0,"allocated":3137536,"data_stored":1792457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509618,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51756,"kb_used_data":2520,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320084,"statfs":{"total":96636764160,"available":96583766016,"internally_reserved":0,"allocated":2580480,"data_stored":1210994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509616,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51712,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320128,"statfs":{"total":96636764160,"available":96583811072,"internally_reserved":0,"allocated":2543616,"data_stored":1202089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509617,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47556,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324284,"statfs":{"total":96636764160,"available":96588066816,"internally_reserved":0,"allocated":2543616,"data_stored":1202089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509616,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47564,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324276,"statfs":{"total":96636764160,"available":96588058624,"internally_reserved":0,"allocated":2555904,"data_stored":1209256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509617,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60616,"kb_used_data":3064,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311224,"statfs":{"total":96636764160,"available":96574693376,"internally_reserved":0,"allocated":3137536,"data_stored":1792457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60060,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311780,"statfs":{"total":96636764160,"available":96575262720,"internally_reserved":0,"allocated":2572288,"data_stored":1216038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575025,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60052,"kb_used_data":2504,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311788,"statfs":{"total":96636764160,"available":96575270912,"internally_reserved":0,"allocated":2564096,"data_stored":1209872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:33:38.091 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:33:38.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T22:33:38.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.274+0000 7f385fc00640 1 Processor -- start 2024-08-18T22:33:38.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.274+0000 7f385fc00640 1 -- start start 2024-08-18T22:33:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385fc00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f385815fb80 0x7f38580d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385fc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38580b5ad0 0x7f385806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385fc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38580d30b0 con 0x7f3858071550 2024-08-18T22:33:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385fc00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f38580d1eb0 con 0x7f385815fb80 2024-08-18T22:33:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385fc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f38580d1bd0 con 0x7f38580b5ad0 2024-08-18T22:33:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385d200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f385815fb80 0x7f38580d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385d200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f385815fb80 0x7f38580d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51130/0 (socket says 172.21.15.5:51130) 2024-08-18T22:33:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385d200640 1 -- 172.21.15.5:0/2032428438 learned_addr learned my addr 172.21.15.5:0/2032428438 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:38.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f384fe00640 1 --2- 172.21.15.5:0/2032428438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38580b5ad0 0x7f385806fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385d200640 1 -- 172.21.15.5:0/2032428438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38580b5ad0 msgr2=0x7f385806fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385d200640 1 --2- 172.21.15.5:0/2032428438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38580b5ad0 0x7f385806fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385d200640 1 -- 172.21.15.5:0/2032428438 >> v1:172.21.15.117:6789/0 conn(0x7f3858071550 legacy=0x7f385809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.278+0000 7f385d200640 1 -- 172.21.15.5:0/2032428438 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38580d2dd0 con 0x7f385815fb80 2024-08-18T22:33:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f385d200640 1 --2- 172.21.15.5:0/2032428438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385815fb80 0x7f38580d15e0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f3848009870 tx=0x7f384801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5921c39c0adcc11e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:38.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f3857e00640 1 -- 172.21.15.5:0/2032428438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38480b0070 con 0x7f385815fb80 2024-08-18T22:33:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f3857e00640 1 -- 172.21.15.5:0/2032428438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38480ab600 con 0x7f385815fb80 2024-08-18T22:33:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f3857e00640 1 -- 172.21.15.5:0/2032428438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38480ab9d0 con 0x7f385815fb80 2024-08-18T22:33:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f385fc00640 1 -- 172.21.15.5:0/2032428438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385815fb80 msgr2=0x7f38580d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f385fc00640 1 --2- 172.21.15.5:0/2032428438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385815fb80 0x7f38580d15e0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f3848009870 tx=0x7f384801c440 comp rx=0 tx=0).stop 2024-08-18T22:33:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f385fc00640 1 -- 172.21.15.5:0/2032428438 shutdown_connections 2024-08-18T22:33:38.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f385fc00640 1 --2- 172.21.15.5:0/2032428438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38580b5ad0 0x7f385806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f385fc00640 1 --2- 172.21.15.5:0/2032428438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385815fb80 0x7f38580d15e0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f385fc00640 1 -- 172.21.15.5:0/2032428438 >> 172.21.15.5:0/2032428438 conn(0x7f38580d2180 msgr2=0x7f38580d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f385fc00640 1 -- 172.21.15.5:0/2032428438 shutdown_connections 2024-08-18T22:33:38.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f385fc00640 1 -- 172.21.15.5:0/2032428438 wait complete. 2024-08-18T22:33:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f385fc00640 1 Processor -- start 2024-08-18T22:33:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.282+0000 7f385fc00640 1 -- start start 2024-08-18T22:33:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f385fc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3858071550 0x7f385809cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f385fc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38580b5ad0 0x7f3858156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f385fc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385815fb80 0x7f385813fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f385fc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f385809b2d0 con 0x7f38580b5ad0 2024-08-18T22:33:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f385fc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f385809b150 con 0x7f385815fb80 2024-08-18T22:33:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f385fc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3858071980 con 0x7f3858071550 2024-08-18T22:33:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f384fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38580b5ad0 0x7f3858156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f384fe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38580b5ad0 0x7f3858156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51146/0 (socket says 172.21.15.5:51146) 2024-08-18T22:33:38.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f384fe00640 1 -- 172.21.15.5:0/3053033633 learned_addr learned my addr 172.21.15.5:0/3053033633 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f385d200640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3858071550 0x7f385809cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f385dc00640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385815fb80 0x7f385813fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f384fe00640 1 -- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3858071550 msgr2=0x7f385809cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f384fe00640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3858071550 0x7f385809cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f384fe00640 1 -- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385815fb80 msgr2=0x7f385813fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f384fe00640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385815fb80 0x7f385813fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f384fe00640 1 -- 172.21.15.5:0/3053033633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38581566d0 con 0x7f38580b5ad0 2024-08-18T22:33:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f384fe00640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38580b5ad0 0x7f3858156190 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f384000d7d0 tx=0x7f384000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f3855600640 1 -- 172.21.15.5:0/3053033633 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840004020 con 0x7f38580b5ad0 2024-08-18T22:33:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f3855600640 1 -- 172.21.15.5:0/3053033633 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38400041c0 con 0x7f38580b5ad0 2024-08-18T22:33:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f3855600640 1 -- 172.21.15.5:0/3053033633 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38400043b0 con 0x7f38580b5ad0 2024-08-18T22:33:38.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f385fc00640 1 -- 172.21.15.5:0/3053033633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385809d610 con 0x7f38580b5ad0 2024-08-18T22:33:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f385fc00640 1 -- 172.21.15.5:0/3053033633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f385809dbd0 con 0x7f38580b5ad0 2024-08-18T22:33:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f385fc00640 1 -- 172.21.15.5:0/3053033633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f385806fad0 con 0x7f38580b5ad0 2024-08-18T22:33:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.286+0000 7f3855600640 1 -- 172.21.15.5:0/3053033633 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f384001b020 con 0x7f38580b5ad0 2024-08-18T22:33:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.290+0000 7f3855600640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38340678c0 0x7f3834069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.290+0000 7f3855600640 1 -- 172.21.15.5:0/3053033633 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f3840085d00 con 0x7f38580b5ad0 2024-08-18T22:33:38.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.290+0000 7f385d200640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38340678c0 0x7f3834069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.290+0000 7f385d200640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38340678c0 0x7f3834069d80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f38480ad000 tx=0x7f38480a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:38.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.294+0000 7f3855600640 1 -- 172.21.15.5:0/3053033633 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f38581566d0 con 0x7f38580b5ad0 2024-08-18T22:33:38.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.514+0000 7f385fc00640 1 -- 172.21.15.5:0/3053033633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f38580ce0d0 con 0x7f38580b5ad0 2024-08-18T22:33:38.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.518+0000 7f3855600640 1 -- 172.21.15.5:0/3053033633 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) ==== 190+0+147 (secure 0 0 0) 0x7f3840056610 con 0x7f38580b5ad0 2024-08-18T22:33:38.516 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-18T22:33:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAwc8JmTqgRDxAAjC3AEzgCX4f/yDemk6tI4g== 2024-08-18T22:33:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2024-08-18T22:33:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2024-08-18T22:33:38.517 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T22:33:38.517 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2024-08-18T22:33:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 -- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38340678c0 msgr2=0x7f3834069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38340678c0 0x7f3834069d80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f38480ad000 tx=0x7f38480a6000 comp rx=0 tx=0).stop 2024-08-18T22:33:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 -- 172.21.15.5:0/3053033633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38580b5ad0 msgr2=0x7f3858156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38580b5ad0 0x7f3858156190 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f384000d7d0 tx=0x7f384000dc90 comp rx=0 tx=0).stop 2024-08-18T22:33:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 -- 172.21.15.5:0/3053033633 shutdown_connections 2024-08-18T22:33:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f38340678c0 0x7f3834069d80 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f385815fb80 0x7f385813fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38580b5ad0 0x7f3858156190 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 --2- 172.21.15.5:0/3053033633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3858071550 0x7f385809cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 -- 172.21.15.5:0/3053033633 >> 172.21.15.5:0/3053033633 conn(0x7f38580d2180 msgr2=0x7f38580b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:38.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 -- 172.21.15.5:0/3053033633 shutdown_connections 2024-08-18T22:33:38.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.522+0000 7f385fc00640 1 -- 172.21.15.5:0/3053033633 wait complete. 2024-08-18T22:33:38.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:33:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.682+0000 7f07ae600640 1 Processor -- start 2024-08-18T22:33:38.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07ae600640 1 -- start start 2024-08-18T22:33:38.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07ae600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07a81618d0 0x7f07a815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07ae600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f07a8161d40 0x7f07a815f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07ae600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07a80c92d0 0x7f07a80c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07ae600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f07a80c9c60 con 0x7f07a81618d0 2024-08-18T22:33:38.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07ae600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f07a8162300 con 0x7f07a8161d40 2024-08-18T22:33:38.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07ae600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07a81625e0 con 0x7f07a80c92d0 2024-08-18T22:33:38.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07a7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07a81618d0 0x7f07a815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07a7400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07a81618d0 0x7f07a815f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51148/0 (socket says 172.21.15.5:51148) 2024-08-18T22:33:38.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07a7400640 1 -- 172.21.15.5:0/4002020935 learned_addr learned my addr 172.21.15.5:0/4002020935 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:38.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f079ea00640 1 --2- 172.21.15.5:0/4002020935 >> v2:172.21.15.117:3300/0 conn(0x7f07a8161d40 0x7f07a815f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07a7e00640 1 --2- 172.21.15.5:0/4002020935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07a80c92d0 0x7f07a80c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07a7400640 1 -- 172.21.15.5:0/4002020935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07a80c92d0 msgr2=0x7f07a80c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:38.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07a7400640 1 --2- 172.21.15.5:0/4002020935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07a80c92d0 0x7f07a80c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07a7400640 1 -- 172.21.15.5:0/4002020935 >> v2:172.21.15.117:3300/0 conn(0x7f07a8161d40 msgr2=0x7f07a815f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:38.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07a7400640 1 --2- 172.21.15.5:0/4002020935 >> v2:172.21.15.117:3300/0 conn(0x7f07a8161d40 0x7f07a815f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.686+0000 7f07a7400640 1 -- 172.21.15.5:0/4002020935 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a81628c0 con 0x7f07a81618d0 2024-08-18T22:33:38.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07a7400640 1 --2- 172.21.15.5:0/4002020935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07a81618d0 0x7f07a815f1d0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f07a8071a60 tx=0x7f079801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3931cb790749b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:38.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07a6a00640 1 -- 172.21.15.5:0/4002020935 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07980b0070 con 0x7f07a81618d0 2024-08-18T22:33:38.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07a6a00640 1 -- 172.21.15.5:0/4002020935 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07980ab600 con 0x7f07a81618d0 2024-08-18T22:33:38.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07a6a00640 1 -- 172.21.15.5:0/4002020935 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07980ab9d0 con 0x7f07a81618d0 2024-08-18T22:33:38.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07ae600640 1 -- 172.21.15.5:0/4002020935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07a81618d0 msgr2=0x7f07a815f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07ae600640 1 --2- 172.21.15.5:0/4002020935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07a81618d0 0x7f07a815f1d0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f07a8071a60 tx=0x7f079801c520 comp rx=0 tx=0).stop 2024-08-18T22:33:38.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07ae600640 1 -- 172.21.15.5:0/4002020935 shutdown_connections 2024-08-18T22:33:38.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07ae600640 1 --2- 172.21.15.5:0/4002020935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07a80c92d0 0x7f07a80c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07ae600640 1 --2- 172.21.15.5:0/4002020935 >> v2:172.21.15.117:3300/0 conn(0x7f07a8161d40 0x7f07a815f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07ae600640 1 --2- 172.21.15.5:0/4002020935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07a81618d0 0x7f07a815f1d0 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07ae600640 1 -- 172.21.15.5:0/4002020935 >> 172.21.15.5:0/4002020935 conn(0x7f07a80b1c50 msgr2=0x7f07a80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:38.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07ae600640 1 -- 172.21.15.5:0/4002020935 shutdown_connections 2024-08-18T22:33:38.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07ae600640 1 -- 172.21.15.5:0/4002020935 wait complete. 2024-08-18T22:33:38.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07ae600640 1 Processor -- start 2024-08-18T22:33:38.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.690+0000 7f07ae600640 1 -- start start 2024-08-18T22:33:38.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07ae600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07a80c92d0 0x7f07a815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07ae600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07a81618d0 0x7f07a8160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07ae600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07a8161d40 0x7f07a8156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07ae600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f07a80cf1f0 con 0x7f07a8161d40 2024-08-18T22:33:38.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07ae600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f07a80cf070 con 0x7f07a81618d0 2024-08-18T22:33:38.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07ae600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f07a80cf370 con 0x7f07a80c92d0 2024-08-18T22:33:38.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07a8161d40 0x7f07a8156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07a7400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07a80c92d0 0x7f07a815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07a8161d40 0x7f07a8156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51154/0 (socket says 172.21.15.5:51154) 2024-08-18T22:33:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07a7e00640 1 -- 172.21.15.5:0/1573473887 learned_addr learned my addr 172.21.15.5:0/1573473887 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f079ea00640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07a81618d0 0x7f07a8160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07a7e00640 1 -- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07a80c92d0 msgr2=0x7f07a815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07a7e00640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07a80c92d0 0x7f07a815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07a7e00640 1 -- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07a81618d0 msgr2=0x7f07a8160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07a7e00640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07a81618d0 0x7f07a8160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07a7e00640 1 -- 172.21.15.5:0/1573473887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a80c9e00 con 0x7f07a8161d40 2024-08-18T22:33:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07a7e00640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07a8161d40 0x7f07a8156e50 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f07a0007e90 tx=0x7f07a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:38.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f079fe00640 1 -- 172.21.15.5:0/1573473887 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a0014420 con 0x7f07a8161d40 2024-08-18T22:33:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f079fe00640 1 -- 172.21.15.5:0/1573473887 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a0019070 con 0x7f07a8161d40 2024-08-18T22:33:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f079fe00640 1 -- 172.21.15.5:0/1573473887 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a0014800 con 0x7f07a8161d40 2024-08-18T22:33:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07ae600640 1 -- 172.21.15.5:0/1573473887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a8157910 con 0x7f07a8161d40 2024-08-18T22:33:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07ae600640 1 -- 172.21.15.5:0/1573473887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a815c7e0 con 0x7f07a8161d40 2024-08-18T22:33:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f07ae600640 1 -- 172.21.15.5:0/1573473887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a815f1d0 con 0x7f07a8161d40 2024-08-18T22:33:38.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.694+0000 7f079fe00640 1 -- 172.21.15.5:0/1573473887 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07a00149a0 con 0x7f07a8161d40 2024-08-18T22:33:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.698+0000 7f079fe00640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07840678c0 0x7f0784069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.698+0000 7f079fe00640 1 -- 172.21.15.5:0/1573473887 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f07a00865a0 con 0x7f07a8161d40 2024-08-18T22:33:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.698+0000 7f07a7400640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07840678c0 0x7f0784069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:38.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.698+0000 7f07a7400640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07840678c0 0x7f0784069d80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f07980ad000 tx=0x7f0798008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:38.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.702+0000 7f079fe00640 1 -- 172.21.15.5:0/1573473887 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f07a0056860 con 0x7f07a8161d40 2024-08-18T22:33:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.898+0000 7f07ae600640 1 -- 172.21.15.5:0/1573473887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07a806df80 con 0x7f07a8161d40 2024-08-18T22:33:38.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.898+0000 7f079fe00640 1 -- 172.21.15.5:0/1573473887 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5234 (secure 0 0 0) 0x7f07a005ab60 con 0x7f07a8161d40 2024-08-18T22:33:38.897 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:38.897 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":160,"btime":"2024-08-18T22:33:36:585978+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1931701065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1931701065},{"type":"v1","addr":"172.21.15.117:6837","nonce":1931701065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10731,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/83313921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":83313921},{"type":"v1","addr":"172.21.15.5:6833","nonce":83313921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2593956905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2593956905},{"type":"v1","addr":"172.21.15.5:6835","nonce":2593956905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:33:32.949657+0000","modified":"2024-08-18T22:33:35.978872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10740":{"gid":10740,"name":"d","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6836/3939158605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3939158605},{"type":"v1","addr":"172.21.15.117:6836","nonce":3939158605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10740,"qdb_cluster":[10740]},"id":14}]} 2024-08-18T22:33:38.898 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 160 2024-08-18T22:33:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 -- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07840678c0 msgr2=0x7f0784069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07840678c0 0x7f0784069d80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f07980ad000 tx=0x7f0798008040 comp rx=0 tx=0).stop 2024-08-18T22:33:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 -- 172.21.15.5:0/1573473887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07a8161d40 msgr2=0x7f07a8156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07a8161d40 0x7f07a8156e50 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f07a0007e90 tx=0x7f07a000e4b0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 -- 172.21.15.5:0/1573473887 shutdown_connections 2024-08-18T22:33:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f07840678c0 0x7f0784069d80 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07a8161d40 0x7f07a8156e50 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07a81618d0 0x7f07a8160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 --2- 172.21.15.5:0/1573473887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07a80c92d0 0x7f07a815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 -- 172.21.15.5:0/1573473887 >> 172.21.15.5:0/1573473887 conn(0x7f07a80b1c50 msgr2=0x7f07a80b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 -- 172.21.15.5:0/1573473887 shutdown_connections 2024-08-18T22:33:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:38.902+0000 7f07ae600640 1 -- 172.21.15.5:0/1573473887 wait complete. 2024-08-18T22:33:39.321 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 160, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T22:33:32.949657+0000', 'modified': '2024-08-18T22:33:35.978872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10740}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10740': {'gid': 10740, 'name': 'd', 'rank': 0, 'incarnation': 156, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6836/3939158605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 3939158605}, {'type': 'v1', 'addr': '172.21.15.117:6836', 'nonce': 3939158605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10740, 'qdb_cluster': [10740]} 2024-08-18T22:33:39.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T22:33:39.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-18T22:33:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.470+0000 7fbe0b600640 1 Processor -- start 2024-08-18T22:33:39.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.470+0000 7fbe0b600640 1 -- start start 2024-08-18T22:33:39.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.470+0000 7fbe0b600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 0x7fbe040b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.470+0000 7fbe0b600640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe040d30b0 con 0x7fbe0415fb80 2024-08-18T22:33:39.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.470+0000 7fbe0b600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe040d1bd0 con 0x7fbe040d1090 2024-08-18T22:33:39.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.470+0000 7fbe0b600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbe04071c60 con 0x7fbe040d15e0 2024-08-18T22:33:39.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.470+0000 7fbe08c00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbe0415fb80 0x7fbe0406fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37274/0 (socket says 172.21.15.5:37274) 2024-08-18T22:33:39.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.470+0000 7fbe08c00640 1 -- 172.21.15.5:0/2732478304 learned_addr learned my addr 172.21.15.5:0/2732478304 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:39.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.470+0000 7fbe09600640 1 --2- 172.21.15.5:0/2732478304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 0x7fbe040b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.470+0000 7fbe03e00640 1 -- 172.21.15.5:0/2732478304 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227182420 0 0) 0x7fbe040d30b0 con 0x7fbe0415fb80 2024-08-18T22:33:39.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.470+0000 7fbe03e00640 1 -- 172.21.15.5:0/2732478304 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbde8003530 con 0x7fbe0415fb80 2024-08-18T22:33:39.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.474+0000 7fbe03e00640 1 -- 172.21.15.5:0/2732478304 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425932626 0 0) 0x7fbe040d1bd0 con 0x7fbe040d1090 2024-08-18T22:33:39.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.474+0000 7fbe03e00640 1 -- 172.21.15.5:0/2732478304 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe040d30b0 con 0x7fbe040d1090 2024-08-18T22:33:39.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.474+0000 7fbe03e00640 1 -- 172.21.15.5:0/2732478304 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4114026341 0 0) 0x7fbde8003530 con 0x7fbe0415fb80 2024-08-18T22:33:39.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.474+0000 7fbe09600640 1 -- 172.21.15.5:0/2732478304 >> v1:172.21.15.117:6789/0 conn(0x7fbe040d1090 legacy=0x7fbe04071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.474+0000 7fbe09600640 1 -- 172.21.15.5:0/2732478304 >> v1:172.21.15.5:6789/0 conn(0x7fbe0415fb80 legacy=0x7fbe0406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.474+0000 7fbe09600640 1 -- 172.21.15.5:0/2732478304 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe040d2dd0 con 0x7fbe040d15e0 2024-08-18T22:33:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.474+0000 7fbe09600640 1 --2- 172.21.15.5:0/2732478304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 0x7fbe040b5ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009dc0 tx=0x7fbdfc01c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894e34bcb59a0c5f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.474+0000 7fbe03e00640 1 -- 172.21.15.5:0/2732478304 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4001680 con 0x7fbe040d15e0 2024-08-18T22:33:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.474+0000 7fbe03e00640 1 -- 172.21.15.5:0/2732478304 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdfc0a8440 con 0x7fbe040d15e0 2024-08-18T22:33:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.474+0000 7fbe03e00640 1 -- 172.21.15.5:0/2732478304 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0a87f0 con 0x7fbe040d15e0 2024-08-18T22:33:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 -- 172.21.15.5:0/2732478304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 msgr2=0x7fbe040b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 --2- 172.21.15.5:0/2732478304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 0x7fbe040b5ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009dc0 tx=0x7fbdfc01c790 comp rx=0 tx=0).stop 2024-08-18T22:33:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 -- 172.21.15.5:0/2732478304 shutdown_connections 2024-08-18T22:33:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 --2- 172.21.15.5:0/2732478304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 0x7fbe040b5ad0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 -- 172.21.15.5:0/2732478304 >> 172.21.15.5:0/2732478304 conn(0x7fbe040d2180 msgr2=0x7fbe040d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 -- 172.21.15.5:0/2732478304 shutdown_connections 2024-08-18T22:33:39.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 -- 172.21.15.5:0/2732478304 wait complete. 2024-08-18T22:33:39.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 Processor -- start 2024-08-18T22:33:39.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 -- start start 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe040d1090 0x7fbe04157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 0x7fbe0414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0415fb80 0x7fbe0406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0416a310 con 0x7fbe0415fb80 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040d1eb0 con 0x7fbe040d1090 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe0b600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0416a490 con 0x7fbe040d15e0 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe09600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0415fb80 0x7fbe0406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe09600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0415fb80 0x7fbe0406dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51158/0 (socket says 172.21.15.5:51158) 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe09600640 1 -- 172.21.15.5:0/2041780468 learned_addr learned my addr 172.21.15.5:0/2041780468 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe08c00640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe040d1090 0x7fbe04157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbdfbe00640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 0x7fbe0414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe09600640 1 -- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 msgr2=0x7fbe0414ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe09600640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 0x7fbe0414ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe09600640 1 -- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe040d1090 msgr2=0x7fbe04157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe09600640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe040d1090 0x7fbe04157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe09600640 1 -- 172.21.15.5:0/2041780468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe040af7b0 con 0x7fbe0415fb80 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe08c00640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe040d1090 0x7fbe04157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbdfbe00640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 0x7fbe0414ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.478+0000 7fbe09600640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0415fb80 0x7fbe0406dc40 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc01a3c0 tx=0x7fbdfc019530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.482+0000 7fbe01600640 1 -- 172.21.15.5:0/2041780468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0c0070 con 0x7fbe0415fb80 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.482+0000 7fbe01600640 1 -- 172.21.15.5:0/2041780468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdfc004250 con 0x7fbe0415fb80 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.482+0000 7fbe01600640 1 -- 172.21.15.5:0/2041780468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc004640 con 0x7fbe0415fb80 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.482+0000 7fbe0b600640 1 -- 172.21.15.5:0/2041780468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe040cc2b0 con 0x7fbe0415fb80 2024-08-18T22:33:39.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.482+0000 7fbe0b600640 1 -- 172.21.15.5:0/2041780468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe040afd00 con 0x7fbe0415fb80 2024-08-18T22:33:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.482+0000 7fbe01600640 1 -- 172.21.15.5:0/2041780468 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbdfc0a8440 con 0x7fbe0415fb80 2024-08-18T22:33:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.482+0000 7fbe01600640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbde00678c0 0x7fbde0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.482+0000 7fbe01600640 1 -- 172.21.15.5:0/2041780468 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fbdfc120200 con 0x7fbe0415fb80 2024-08-18T22:33:39.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.482+0000 7fbe08c00640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbde00678c0 0x7fbde0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.482+0000 7fbe0eb48000 1 Processor -- start 2024-08-18T22:33:39.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.482+0000 7fbe0eb48000 1 -- start start 2024-08-18T22:33:39.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe08c00640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbde00678c0 0x7fbde0069d80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4000fe0 tx=0x7fbdf4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466d670 0x559904623450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559904623990 0x559904623d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559904509fd0 con 0x55990466cd50 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5599044703c0 con 0x55990466d670 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x559904415f70 con 0x559904623990 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe08c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe08c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51166/0 (socket says 172.21.15.5:51166) 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe08c00640 1 -- 172.21.15.5:0/2071502265 learned_addr learned my addr 172.21.15.5:0/2071502265 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbdfbe00640 1 --2- 172.21.15.5:0/2071502265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466d670 0x559904623450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe09600640 1 --2- 172.21.15.5:0/2071502265 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559904623990 0x559904623d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe08c00640 1 -- 172.21.15.5:0/2071502265 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559904623990 msgr2=0x559904623d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe08c00640 1 --2- 172.21.15.5:0/2071502265 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559904623990 0x559904623d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe08c00640 1 -- 172.21.15.5:0/2071502265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466d670 msgr2=0x559904623450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:39.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe08c00640 1 --2- 172.21.15.5:0/2071502265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466d670 0x559904623450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe08c00640 1 -- 172.21.15.5:0/2071502265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990440a2e0 con 0x55990466cd50 2024-08-18T22:33:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe08c00640 1 --2- 172.21.15.5:0/2071502265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466d130 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005a40 tx=0x7fbdf4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e94be06f44d8f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbdf9600640 1 -- 172.21.15.5:0/2071502265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400e7b0 con 0x55990466cd50 2024-08-18T22:33:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbdf9600640 1 -- 172.21.15.5:0/2071502265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf400e950 con 0x55990466cd50 2024-08-18T22:33:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbdf9600640 1 -- 172.21.15.5:0/2071502265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400ed00 con 0x55990466cd50 2024-08-18T22:33:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 -- 172.21.15.5:0/2071502265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 msgr2=0x55990466d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/2071502265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466d130 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005a40 tx=0x7fbdf4011000 comp rx=0 tx=0).stop 2024-08-18T22:33:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 -- 172.21.15.5:0/2071502265 shutdown_connections 2024-08-18T22:33:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/2071502265 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559904623990 0x559904623d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/2071502265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466d670 0x559904623450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/2071502265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466d130 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 -- 172.21.15.5:0/2071502265 >> 172.21.15.5:0/2071502265 conn(0x55990461f910 msgr2=0x559904621d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 -- 172.21.15.5:0/2071502265 shutdown_connections 2024-08-18T22:33:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 -- 172.21.15.5:0/2071502265 wait complete. 2024-08-18T22:33:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 -- start start 2024-08-18T22:33:39.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.486+0000 7fbe0eb48000 1 Processor -- start 2024-08-18T22:33:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559904623990 0x55990465a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55990466cd50 0x559904628be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466d670 0x559904629120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559904417e40 con 0x559904623990 2024-08-18T22:33:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55990452daf0 con 0x55990466d670 2024-08-18T22:33:39.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5599044d2450 con 0x55990466cd50 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 10 client.0 _ll_register_callbacks cb 0x55990460e630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe08c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559904623990 0x55990465a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe08c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559904623990 0x55990465a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51180/0 (socket says 172.21.15.5:51180) 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe08c00640 1 -- 172.21.15.5:0/131871728 learned_addr learned my addr 172.21.15.5:0/131871728 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbdfbe00640 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55990466cd50 0x559904628be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe09600640 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466d670 0x559904629120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe08c00640 1 -- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55990466cd50 msgr2=0x559904628be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe08c00640 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55990466cd50 0x559904628be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe08c00640 1 -- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466d670 msgr2=0x559904629120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe08c00640 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466d670 0x559904629120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe08c00640 1 -- 172.21.15.5:0/131871728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599043f7fd0 con 0x559904623990 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe08c00640 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559904623990 0x55990465a640 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005890 tx=0x7fbdf4001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f36e3bbdc74e09 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbdf2000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:33:39.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbdf2000640 1 -- 172.21.15.5:0/131871728 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400e7b0 con 0x559904623990 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 1 -- 172.21.15.5:0/131871728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdf400e950 con 0x559904623990 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbdf2000640 1 -- 172.21.15.5:0/131871728 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fbdf4010040 con 0x559904623990 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbdf2000640 1 -- 172.21.15.5:0/131871728 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7fbdf4033050 con 0x559904623990 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 10 client.10863 fetch_fsmap learned FSMap version 160 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 1 -- 172.21.15.5:0/131871728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x5599044f34d0 con 0x559904623990 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbdf2000640 1 -- 172.21.15.5:0/131871728 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf400e950 con 0x559904623990 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbdf2000640 1 -- 172.21.15.5:0/131871728 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7fbdf4036020 con 0x559904623990 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 10 client.10863 fetch_fsmap finished waiting for FSMap version 160 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 10 client.10863 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 20 client.10863 populate_metadata read hostname 'smithi005' 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55990465b4f0 0x55990465b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 4 client.10863 mds_command: new command op to 10740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbe0eb48000 1 -- 172.21.15.5:0/131871728 --> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55990440ac00 con 0x55990465b4f0 2024-08-18T22:33:39.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbdfbe00640 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55990465b4f0 0x55990465b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbdfbe00640 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55990465b4f0 0x55990465b8d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbf193e2b2855ab7 server_cookie=5c4285ba35aa7ca5 in_seq=0 out_seq=0 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.490+0000 7fbdf2000640 10 client.10863 ms_handle_connect on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbdf2000640 1 -- 172.21.15.5:0/131871728 <== mds.0 v2:172.21.15.117:6834/3939158605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55990440ac00 con 0x55990465b4f0 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbdf2000640 10 client.10863 handle_command_reply: tid=0 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 1 client.10863 shutdown 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 1 -- 172.21.15.5:0/131871728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559904623990 msgr2=0x55990465a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559904623990 0x55990465a640 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005890 tx=0x7fbdf4001160 comp rx=0 tx=0).stop 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 1 -- 172.21.15.5:0/131871728 shutdown_connections 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55990465b4f0 0x55990465b8d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466d670 0x559904629120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55990466cd50 0x559904628be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbdf2000640 0 client.10863 ms_handle_reset on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/131871728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559904623990 0x55990465a640 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 1 -- 172.21.15.5:0/131871728 >> 172.21.15.5:0/131871728 conn(0x55990461f910 msgr2=0x559904622520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 1 -- 172.21.15.5:0/131871728 shutdown_connections 2024-08-18T22:33:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 1 -- 172.21.15.5:0/131871728 wait complete. 2024-08-18T22:33:39.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.494+0000 7fbe0eb48000 20 client.10863 trim_cache size 0 max 16384 2024-08-18T22:33:39.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 Processor -- start 2024-08-18T22:33:39.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 -- start start 2024-08-18T22:33:39.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559904623990 0x55990466c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55990466d670 0x559904684060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbe04202f30 con 0x55990466cd50 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0415c570 con 0x559904623990 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbe04202a80 con 0x55990466d670 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdfbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdfbe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51188/0 (socket says 172.21.15.5:51188) 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdfbe00640 1 -- 172.21.15.5:0/2174638882 learned_addr learned my addr 172.21.15.5:0/2174638882 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdfbe00640 1 -- 172.21.15.5:0/2174638882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55990466d670 msgr2=0x559904684060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdfbe00640 1 --2- 172.21.15.5:0/2174638882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55990466d670 0x559904684060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdfbe00640 1 -- 172.21.15.5:0/2174638882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559904623990 msgr2=0x55990466c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdfbe00640 1 --2- 172.21.15.5:0/2174638882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559904623990 0x55990466c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdfbe00640 1 -- 172.21.15.5:0/2174638882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990466d4a0 con 0x55990466cd50 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdfbe00640 1 --2- 172.21.15.5:0/2174638882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466c5a0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7fbdec007c80 tx=0x7fbdec009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1447bcdc9261c3b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdf8c00640 1 -- 172.21.15.5:0/2174638882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec016d60 con 0x55990466cd50 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdf8c00640 1 -- 172.21.15.5:0/2174638882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdec023070 con 0x55990466cd50 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbdf8c00640 1 -- 172.21.15.5:0/2174638882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec001d50 con 0x55990466cd50 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 -- 172.21.15.5:0/2174638882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 msgr2=0x55990466c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/2174638882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466c5a0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7fbdec007c80 tx=0x7fbdec009040 comp rx=0 tx=0).stop 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 -- 172.21.15.5:0/2174638882 shutdown_connections 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/2174638882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55990466d670 0x559904684060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/2174638882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466cd50 0x55990466c5a0 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/2174638882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559904623990 0x55990466c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 -- 172.21.15.5:0/2174638882 >> 172.21.15.5:0/2174638882 conn(0x55990461f910 msgr2=0x55990466b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 -- 172.21.15.5:0/2174638882 shutdown_connections 2024-08-18T22:33:39.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 -- 172.21.15.5:0/2174638882 wait complete. 2024-08-18T22:33:39.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 -- start start 2024-08-18T22:33:39.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.514+0000 7fbe0eb48000 1 Processor -- start 2024-08-18T22:33:39.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559904623990 0x559904681530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466cd50 0x559904681a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466d670 0x559904681fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5599044291d0 con 0x55990466d670 2024-08-18T22:33:39.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559904407900 con 0x55990466cd50 2024-08-18T22:33:39.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55990446f6d0 con 0x559904623990 2024-08-18T22:33:39.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 10 client.0 _ll_register_callbacks cb 0x7fbdec007df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:33:39.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe09600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466d670 0x559904681fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe09600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466d670 0x559904681fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51192/0 (socket says 172.21.15.5:51192) 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe09600640 1 -- 172.21.15.5:0/1770902811 learned_addr learned my addr 172.21.15.5:0/1770902811 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbdfbe00640 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466cd50 0x559904681a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe08c00640 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559904623990 0x559904681530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe09600640 1 -- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559904623990 msgr2=0x559904681530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe09600640 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559904623990 0x559904681530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe09600640 1 -- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466cd50 msgr2=0x559904681a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe09600640 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466cd50 0x559904681a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe09600640 1 -- 172.21.15.5:0/1770902811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559904469b30 con 0x55990466d670 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe08c00640 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559904623990 0x559904681530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe09600640 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466d670 0x559904681fb0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc098170 tx=0x7fbdfc0efed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f5123a692d9de0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbdf2000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbdf2000640 1 -- 172.21.15.5:0/1770902811 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0ef890 con 0x55990466d670 2024-08-18T22:33:39.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbdf2000640 1 -- 172.21.15.5:0/1770902811 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7fbdfc0efa30 con 0x55990466d670 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 1 -- 172.21.15.5:0/1770902811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdec023070 con 0x55990466d670 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbdf2000640 1 -- 172.21.15.5:0/1770902811 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7fbdfc108160 con 0x55990466d670 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 10 client.10869 fetch_fsmap learned FSMap version 160 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 1 -- 172.21.15.5:0/1770902811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x559904421810 con 0x55990466d670 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbdf2000640 1 -- 172.21.15.5:0/1770902811 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdec023070 con 0x55990466d670 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbdf2000640 1 -- 172.21.15.5:0/1770902811 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7fbe0409b250 con 0x55990466d670 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 10 client.10869 fetch_fsmap finished waiting for FSMap version 160 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 10 client.10869 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 20 client.10869 populate_metadata read hostname 'smithi005' 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5599046e6210 0x5599046e8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 4 client.10869 mds_command: new command op to 10740 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 1 -- 172.21.15.5:0/1770902811 --> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] -- command(tid 0: {"prefix": "status"}) -- 0x55990447daf0 con 0x5599046e6210 2024-08-18T22:33:39.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe08c00640 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5599046e6210 0x5599046e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe08c00640 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5599046e6210 0x5599046e8600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=534b49f61a9d9f25 server_cookie=35b3cac606bca99e in_seq=0 out_seq=0 2024-08-18T22:33:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbdf2000640 10 client.10869 ms_handle_connect on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbdf2000640 1 -- 172.21.15.5:0/1770902811 <== mds.0 v2:172.21.15.117:6834/3939158605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55990447daf0 con 0x5599046e6210 2024-08-18T22:33:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbdf2000640 10 client.10869 handle_command_reply: tid=0 2024-08-18T22:33:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.518+0000 7fbe0eb48000 1 client.10869 shutdown 2024-08-18T22:33:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0eb48000 1 -- 172.21.15.5:0/1770902811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466d670 msgr2=0x559904681fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466d670 0x559904681fb0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc098170 tx=0x7fbdfc0efed0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0eb48000 1 -- 172.21.15.5:0/1770902811 shutdown_connections 2024-08-18T22:33:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5599046e6210 0x5599046e8600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55990466d670 0x559904681fb0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55990466cd50 0x559904681a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0eb48000 1 --2- 172.21.15.5:0/1770902811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x559904623990 0x559904681530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbdf2000640 0 client.10869 ms_handle_reset on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:39.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0eb48000 1 -- 172.21.15.5:0/1770902811 >> 172.21.15.5:0/1770902811 conn(0x55990461f910 msgr2=0x55990465a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:39.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0eb48000 1 -- 172.21.15.5:0/1770902811 shutdown_connections 2024-08-18T22:33:39.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0eb48000 1 -- 172.21.15.5:0/1770902811 wait complete. 2024-08-18T22:33:39.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0eb48000 20 client.10869 trim_cache size 0 max 16384 2024-08-18T22:33:39.522 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:33:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "f2affb9c-c71f-418c-b271-e1d1f0126ce6", 2024-08-18T22:33:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-18T22:33:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 10740, 2024-08-18T22:33:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-18T22:33:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-18T22:33:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-18T22:33:39.522 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.9704958450000003, 2024-08-18T22:33:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 160, 2024-08-18T22:33:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 204, 2024-08-18T22:33:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 204, 2024-08-18T22:33:39.523 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 10.82094841 2024-08-18T22:33:39.523 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 -- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbde00678c0 msgr2=0x7fbde0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbde00678c0 0x7fbde0069d80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4000fe0 tx=0x7fbdf4009040 comp rx=0 tx=0).stop 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 -- 172.21.15.5:0/2041780468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0415fb80 msgr2=0x7fbe0406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0415fb80 0x7fbe0406dc40 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc01a3c0 tx=0x7fbdfc019530 comp rx=0 tx=0).stop 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 -- 172.21.15.5:0/2041780468 shutdown_connections 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbde00678c0 0x7fbde0069d80 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0415fb80 0x7fbe0406dc40 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe040d15e0 0x7fbe0414ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 --2- 172.21.15.5:0/2041780468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe040d1090 0x7fbe04157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 -- 172.21.15.5:0/2041780468 >> 172.21.15.5:0/2041780468 conn(0x7fbe040d2180 msgr2=0x7fbe0415e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 -- 172.21.15.5:0/2041780468 shutdown_connections 2024-08-18T22:33:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.522+0000 7fbe0b600640 1 -- 172.21.15.5:0/2041780468 wait complete. 2024-08-18T22:33:39.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T22:33:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f885f400640 1 Processor -- start 2024-08-18T22:33:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f885f400640 1 -- start start 2024-08-18T22:33:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f885f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f885815f0b0 0x7f88580ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f885f400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88580ce9c0 con 0x7f88580b63b0 2024-08-18T22:33:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f885f400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88580ceca0 con 0x7f88580afda0 2024-08-18T22:33:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f885f400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f885815d8c0 con 0x7f885815f0b0 2024-08-18T22:33:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f8857e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f88580b63b0 0x7f88580cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37280/0 (socket says 172.21.15.5:37280) 2024-08-18T22:33:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f8857e00640 1 -- 172.21.15.5:0/2514734095 learned_addr learned my addr 172.21.15.5:0/2514734095 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:39.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f885d400640 1 --2- 172.21.15.5:0/2514734095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f885815f0b0 0x7f88580ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f8857400640 1 -- 172.21.15.5:0/2514734095 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659456569 0 0) 0x7f88580ce9c0 con 0x7f88580b63b0 2024-08-18T22:33:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f8857400640 1 -- 172.21.15.5:0/2514734095 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f883c003530 con 0x7f88580b63b0 2024-08-18T22:33:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f8857400640 1 -- 172.21.15.5:0/2514734095 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926799558 0 0) 0x7f88580ceca0 con 0x7f88580afda0 2024-08-18T22:33:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f8857400640 1 -- 172.21.15.5:0/2514734095 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88580ce9c0 con 0x7f88580afda0 2024-08-18T22:33:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f885d400640 1 -- 172.21.15.5:0/2514734095 >> v1:172.21.15.117:6789/0 conn(0x7f88580afda0 legacy=0x7f88580b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f885d400640 1 -- 172.21.15.5:0/2514734095 >> v1:172.21.15.5:6789/0 conn(0x7f88580b63b0 legacy=0x7f88580cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.682+0000 7f885d400640 1 -- 172.21.15.5:0/2514734095 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885815dba0 con 0x7f885815f0b0 2024-08-18T22:33:39.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.686+0000 7f885d400640 1 --2- 172.21.15.5:0/2514734095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f885815f0b0 0x7f88580ce3a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8850009dc0 tx=0x7f885001c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55fcfec45181911a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.686+0000 7f8857400640 1 -- 172.21.15.5:0/2514734095 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88500b2070 con 0x7f885815f0b0 2024-08-18T22:33:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.686+0000 7f8857400640 1 -- 172.21.15.5:0/2514734095 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88500a5a10 con 0x7f885815f0b0 2024-08-18T22:33:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.686+0000 7f8857400640 1 -- 172.21.15.5:0/2514734095 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88500a5dc0 con 0x7f885815f0b0 2024-08-18T22:33:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.686+0000 7f885f400640 1 -- 172.21.15.5:0/2514734095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f885815f0b0 msgr2=0x7f88580ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.686+0000 7f885f400640 1 --2- 172.21.15.5:0/2514734095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f885815f0b0 0x7f88580ce3a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8850009dc0 tx=0x7f885001c930 comp rx=0 tx=0).stop 2024-08-18T22:33:39.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.686+0000 7f885f400640 1 -- 172.21.15.5:0/2514734095 shutdown_connections 2024-08-18T22:33:39.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.686+0000 7f885f400640 1 --2- 172.21.15.5:0/2514734095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f885815f0b0 0x7f88580ce3a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.686+0000 7f885f400640 1 -- 172.21.15.5:0/2514734095 >> 172.21.15.5:0/2514734095 conn(0x7f885806b9b0 msgr2=0x7f885806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:39.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.686+0000 7f885f400640 1 -- 172.21.15.5:0/2514734095 shutdown_connections 2024-08-18T22:33:39.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.686+0000 7f885f400640 1 -- 172.21.15.5:0/2514734095 wait complete. 2024-08-18T22:33:39.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885f400640 1 Processor -- start 2024-08-18T22:33:39.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885f400640 1 -- start start 2024-08-18T22:33:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88580afda0 0x7f885814cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88580b63b0 0x7f885814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815f0b0 0x7f88581506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885f400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8858169f10 con 0x7f885815f0b0 2024-08-18T22:33:39.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885f400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8858169d90 con 0x7f88580afda0 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885f400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f885816a090 con 0x7f88580b63b0 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815f0b0 0x7f88581506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885d400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815f0b0 0x7f88581506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51194/0 (socket says 172.21.15.5:51194) 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885d400640 1 -- 172.21.15.5:0/1092716541 learned_addr learned my addr 172.21.15.5:0/1092716541 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f8857e00640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88580b63b0 0x7f885814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885ca00640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88580afda0 0x7f885814cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885d400640 1 -- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88580b63b0 msgr2=0x7f885814bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885d400640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88580b63b0 0x7f885814bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885d400640 1 -- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88580afda0 msgr2=0x7f885814cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885d400640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88580afda0 0x7f885814cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885d400640 1 -- 172.21.15.5:0/1092716541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8858151f10 con 0x7f885815f0b0 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885ca00640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88580afda0 0x7f885814cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:39.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885d400640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815f0b0 0x7f88581506d0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f885001a5c0 tx=0x7f8850019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f8854c00640 1 -- 172.21.15.5:0/1092716541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88500bd020 con 0x7f885815f0b0 2024-08-18T22:33:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f8854c00640 1 -- 172.21.15.5:0/1092716541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88500b8670 con 0x7f885815f0b0 2024-08-18T22:33:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f8854c00640 1 -- 172.21.15.5:0/1092716541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88500b2040 con 0x7f885815f0b0 2024-08-18T22:33:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885f400640 1 -- 172.21.15.5:0/1092716541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88581521f0 con 0x7f885815f0b0 2024-08-18T22:33:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.690+0000 7f885f400640 1 -- 172.21.15.5:0/1092716541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8858151420 con 0x7f885815f0b0 2024-08-18T22:33:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.694+0000 7f885f400640 1 -- 172.21.15.5:0/1092716541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88581523c0 con 0x7f885815f0b0 2024-08-18T22:33:39.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.694+0000 7f8854c00640 1 -- 172.21.15.5:0/1092716541 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88500c0020 con 0x7f885815f0b0 2024-08-18T22:33:39.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.694+0000 7f8854c00640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88380678c0 0x7f8838069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.694+0000 7f8854c00640 1 -- 172.21.15.5:0/1092716541 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f8850120e10 con 0x7f885815f0b0 2024-08-18T22:33:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.694+0000 7f885ca00640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88380678c0 0x7f8838069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.694+0000 7f885ca00640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88380678c0 0x7f8838069d80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f8848001640 tx=0x7f8848009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.698+0000 7f8854c00640 1 -- 172.21.15.5:0/1092716541 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8850124030 con 0x7f885815f0b0 2024-08-18T22:33:39.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.898+0000 7f885f400640 1 -- 172.21.15.5:0/1092716541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f885814c2d0 con 0x7f885815f0b0 2024-08-18T22:33:39.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.898+0000 7f8854c00640 1 -- 172.21.15.5:0/1092716541 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v160) ==== 53+0+73 (secure 0 0 0) 0x7f88500c7030 con 0x7f885815f0b0 2024-08-18T22:33:39.896 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T22:33:39.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 -- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88380678c0 msgr2=0x7f8838069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88380678c0 0x7f8838069d80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f8848001640 tx=0x7f8848009040 comp rx=0 tx=0).stop 2024-08-18T22:33:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 -- 172.21.15.5:0/1092716541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815f0b0 msgr2=0x7f88581506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815f0b0 0x7f88581506d0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f885001a5c0 tx=0x7f8850019730 comp rx=0 tx=0).stop 2024-08-18T22:33:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 -- 172.21.15.5:0/1092716541 shutdown_connections 2024-08-18T22:33:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f88380678c0 0x7f8838069d80 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815f0b0 0x7f88581506d0 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88580b63b0 0x7f885814bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 --2- 172.21.15.5:0/1092716541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88580afda0 0x7f885814cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 -- 172.21.15.5:0/1092716541 >> 172.21.15.5:0/1092716541 conn(0x7f885806b9b0 msgr2=0x7f885806f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 -- 172.21.15.5:0/1092716541 shutdown_connections 2024-08-18T22:33:39.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:39.902+0000 7f885f400640 1 -- 172.21.15.5:0/1092716541 wait complete. 2024-08-18T22:33:39.917 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T22:33:39.917 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:33:39.918 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-18T22:33:39.918 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:33:39.918 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:33:39.918 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T22:33:39.918 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-18T22:33:39.918 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:33:39.918 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:33:39.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:39.918 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-18T22:33:39.928 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:33:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:33:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:33:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:33:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-18T22:33:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:33:39.928 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:33:39.928 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41581sec preferred_lft 41581sec 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-18T22:33:39.929 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:82:70:42:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:33:39.930 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:33:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-08-18T22:33:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:33:39.931 INFO:teuthology.orchestra.run.smithi005.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T22:33:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:33:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-08-18T22:33:39.931 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:33:39.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:39.931 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:33:39.991 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-18T22:33:39.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:39.993 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-18T22:33:40.050 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-18T22:33:40.050 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:33:40.050 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-18T22:33:40.050 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-18T22:33:40.050 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-18T22:33:40.050 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:33:40.051 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:33:40.051 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-18T22:33:40.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-18T22:33:40.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-18T22:33:40.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-18T22:33:40.051 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-18T22:33:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:33:40.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:33:40.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:40.189 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:33:40.198 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:33:40.198 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:33:40.199 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:33:40.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:40.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-18T22:33:40.260 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:33:40.260 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:33:40.309 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:33:40.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:33:40.309 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:33:40.364 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-08-18T22:33:40.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:40.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:33:40.458 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:33:40.458 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:33:40.458 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:33:40.473 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:33:40.473 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:33:40.473 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:33:40.474 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:33:40.474 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:33:40.483 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-08-18T22:33:40.483 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-08-18T22:33:40.483 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-08-18T22:33:40.484 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-08-18T22:33:40.484 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-08-18T22:33:40.484 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790" 2024-08-18T22:33:40.484 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.117:6789,172.21.15.117:6790:/ 2024-08-18T22:33:40.484 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2affb9c-c71f-418c-b271-e1d1f0126ce6" will pass to kernel 2024-08-18T22:33:40.488 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-18T22:33:40.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:40.488 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:33:40.510 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-18T22:33:40.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T22:33:40.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:33:40.628 INFO:teuthology.orchestra.run.smithi005.stdout:client10878 2024-08-18T22:33:40.629 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:33:40.629 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:33:40.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:40.638 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-08-18T22:33:40.698 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:33:40.698 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:33:40.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:40.749 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-08-18T22:33:40.899 INFO:teuthology.orchestra.run.smithi005.stderr:6+0 records in 2024-08-18T22:33:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:6+0 records out 2024-08-18T22:33:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0964363 s, 65.2 MB/s 2024-08-18T22:33:40.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-18T22:33:40.905 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-18T22:33:40.945 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-08-18T22:33:40.945 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-08-18T22:33:40.945 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-18T22:33:40.945 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-08-18T22:33:40.945 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.945 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-08-18T22:33:40.945 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.945 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-08-18T22:33:40.945 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-18T22:33:40.946 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-08-18T22:33:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = f2affb9c-c71f-418c-b271-e1d1f0126ce6 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.948 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug trim objects = true 2024-08-18T22:33:40.949 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.950 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-08-18T22:33:40.951 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-08-18T22:33:40.952 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-08-18T22:33:40.953 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: mon down mkfs grace = 300 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:40.954 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-08-18T22:33:40.955 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout: mds cache max size = 1000 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout: mds log max segments = 1 2024-08-18T22:33:40.956 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-08-18T22:33:40.957 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = False 2024-08-18T22:33:40.957 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-08-18T22:33:40.957 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-08-18T22:33:40.957 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-08-18T22:33:40.957 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-08-18T22:33:40.957 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-08-18T22:33:40.957 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-18T22:33:40.957 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-08-18T22:33:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-08-18T22:33:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-08-18T22:33:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.5,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on skipped message = False 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = f2affb9c-c71f-418c-b271-e1d1f0126ce6 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-08-18T22:33:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-08-18T22:33:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-08-18T22:33:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-18T22:33:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: mon down mkfs grace = 300 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on pool no app = False 2024-08-18T22:33:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-08-18T22:33:40.967 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: mds cache max size = 1000 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: mds log max segments = 1 2024-08-18T22:33:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-08-18T22:33:40.969 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = False 2024-08-18T22:33:40.969 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-08-18T22:33:40.969 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-08-18T22:33:40.969 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-08-18T22:33:40.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-18T22:33:41.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-18T22:33:41.055 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-08-18T22:33:41.056 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-08-18T22:33:41.056 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-18T22:33:41.056 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-08-18T22:33:41.056 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.056 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-08-18T22:33:41.057 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.057 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-08-18T22:33:41.057 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.057 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-08-18T22:33:41.057 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = f2affb9c-c71f-418c-b271-e1d1f0126ce6 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug trim objects = true 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-08-18T22:33:41.063 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-08-18T22:33:41.064 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-08-18T22:33:41.064 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-08-18T22:33:41.064 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-08-18T22:33:41.064 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:33:41.064 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-08-18T22:33:41.064 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-08-18T22:33:41.064 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-08-18T22:33:41.064 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-08-18T22:33:41.064 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-08-18T22:33:41.064 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-08-18T22:33:41.064 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.065 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.066 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-08-18T22:33:41.067 INFO:teuthology.orchestra.run.smithi005.stdout: mon down mkfs grace = 300 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-08-18T22:33:41.068 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-08-18T22:33:41.069 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-08-18T22:33:41.069 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-08-18T22:33:41.069 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-08-18T22:33:41.069 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-08-18T22:33:41.069 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2024-08-18T22:33:41.069 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2024-08-18T22:33:41.069 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2024-08-18T22:33:41.069 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2024-08-18T22:33:41.069 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2024-08-18T22:33:41.069 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2024-08-18T22:33:41.070 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-08-18T22:33:41.070 INFO:teuthology.orchestra.run.smithi005.stdout: mds cache max size = 1000 2024-08-18T22:33:41.070 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2024-08-18T22:33:41.070 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = False 2024-08-18T22:33:41.070 INFO:teuthology.orchestra.run.smithi005.stdout: mds log max segments = 1 2024-08-18T22:33:41.070 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2024-08-18T22:33:41.070 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = False 2024-08-18T22:33:41.070 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2024-08-18T22:33:41.070 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2024-08-18T22:33:41.070 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2024-08-18T22:33:41.071 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-08-18T22:33:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-08-18T22:33:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-18T22:33:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-08-18T22:33:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-08-18T22:33:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-08-18T22:33:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-08-18T22:33:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-08-18T22:33:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-08-18T22:33:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-08-18T22:33:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-08-18T22:33:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-08-18T22:33:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.5,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on skipped message = False 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = f2affb9c-c71f-418c-b271-e1d1f0126ce6 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-08-18T22:33:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-08-18T22:33:41.076 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.076 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-08-18T22:33:41.076 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-08-18T22:33:41.076 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-08-18T22:33:41.076 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-08-18T22:33:41.076 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.076 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-08-18T22:33:41.076 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-08-18T22:33:41.076 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.076 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-08-18T22:33:41.077 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.077 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-08-18T22:33:41.077 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.077 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-08-18T22:33:41.077 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.077 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-08-18T22:33:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-08-18T22:33:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-08-18T22:33:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-08-18T22:33:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-08-18T22:33:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-08-18T22:33:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-08-18T22:33:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-08-18T22:33:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:33:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-08-18T22:33:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-08-18T22:33:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-08-18T22:33:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:33:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:33:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-08-18T22:33:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-08-18T22:33:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.080 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-08-18T22:33:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:33:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-08-18T22:33:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: mon down mkfs grace = 300 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on pool no app = False 2024-08-18T22:33:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-08-18T22:33:41.083 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-08-18T22:33:41.084 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-08-18T22:33:41.084 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-08-18T22:33:41.084 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-08-18T22:33:41.084 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-08-18T22:33:41.084 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-08-18T22:33:41.084 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-08-18T22:33:41.084 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-08-18T22:33:41.084 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-08-18T22:33:41.084 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-08-18T22:33:41.085 INFO:teuthology.orchestra.run.smithi117.stdout: mds cache max size = 1000 2024-08-18T22:33:41.085 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-08-18T22:33:41.085 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = False 2024-08-18T22:33:41.085 INFO:teuthology.orchestra.run.smithi117.stdout: mds log max segments = 1 2024-08-18T22:33:41.085 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-08-18T22:33:41.085 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = False 2024-08-18T22:33:41.086 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-08-18T22:33:41.086 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-08-18T22:33:41.086 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-08-18T22:33:41.089 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:33:41.089 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:33:41.089 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-08-18T22:33:41.089 DEBUG:teuthology.orchestra.run.smithi005:> import json 2024-08-18T22:33:41.089 DEBUG:teuthology.orchestra.run.smithi005:> import sys 2024-08-18T22:33:41.089 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:33:41.089 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-08-18T22:33:41.089 DEBUG:teuthology.orchestra.run.smithi005:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-08-18T22:33:41.089 DEBUG:teuthology.orchestra.run.smithi005:> except OSError as e: 2024-08-18T22:33:41.090 DEBUG:teuthology.orchestra.run.smithi005:> sys.exit(e.errno) 2024-08-18T22:33:41.090 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:33:41.090 DEBUG:teuthology.orchestra.run.smithi005:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-08-18T22:33:41.090 DEBUG:teuthology.orchestra.run.smithi005:> print(json.dumps( 2024-08-18T22:33:41.090 DEBUG:teuthology.orchestra.run.smithi005:> dict([(a, getattr(s, a)) for a in attrs]), 2024-08-18T22:33:41.090 DEBUG:teuthology.orchestra.run.smithi005:> indent=2)) 2024-08-18T22:33:41.090 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:33:41.199 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:33:41.199 INFO:teuthology.orchestra.run.smithi005.stdout: "st_mode": 33204, 2024-08-18T22:33:41.199 INFO:teuthology.orchestra.run.smithi005.stdout: "st_ino": 1099511627777, 2024-08-18T22:33:41.199 INFO:teuthology.orchestra.run.smithi005.stdout: "st_dev": 44, 2024-08-18T22:33:41.199 INFO:teuthology.orchestra.run.smithi005.stdout: "st_nlink": 1, 2024-08-18T22:33:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "st_uid": 1000, 2024-08-18T22:33:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "st_gid": 1271, 2024-08-18T22:33:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "st_size": 6291456, 2024-08-18T22:33:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "st_atime": 1724020420.8061342, 2024-08-18T22:33:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "st_mtime": 1724020420.8381338, 2024-08-18T22:33:41.200 INFO:teuthology.orchestra.run.smithi005.stdout: "st_ctime": 1724020420.8381338 2024-08-18T22:33:41.200 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:33:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:33:41.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:33:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.390+0000 7f8b21a00640 1 Processor -- start 2024-08-18T22:33:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.390+0000 7f8b21a00640 1 -- start start 2024-08-18T22:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b21a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b1c071c90 0x7f8b1c0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b21a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b1c06fad0 0x7f8b1c15c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b21a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b1c0b5e30 con 0x7f8b1c15c180 2024-08-18T22:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b21a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8b1c15caa0 con 0x7f8b1c06fad0 2024-08-18T22:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b21a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1c0b6110 con 0x7f8b1c071c90 2024-08-18T22:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b1b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b1c06fad0 0x7f8b1c15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b1b400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b1c06fad0 0x7f8b1c15c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51210/0 (socket says 172.21.15.5:51210) 2024-08-18T22:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b1b400640 1 -- 172.21.15.5:0/1284376190 learned_addr learned my addr 172.21.15.5:0/1284376190 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b12000640 1 --2- 172.21.15.5:0/1284376190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b1c071c90 0x7f8b1c0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b1b400640 1 -- 172.21.15.5:0/1284376190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b1c071c90 msgr2=0x7f8b1c0b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b1b400640 1 --2- 172.21.15.5:0/1284376190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b1c071c90 0x7f8b1c0b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b1b400640 1 -- 172.21.15.5:0/1284376190 >> v1:172.21.15.117:6789/0 conn(0x7f8b1c15c180 legacy=0x7f8b1c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.394+0000 7f8b1b400640 1 -- 172.21.15.5:0/1284376190 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c0b63f0 con 0x7f8b1c06fad0 2024-08-18T22:33:41.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b1b400640 1 --2- 172.21.15.5:0/1284376190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c06fad0 0x7f8b1c15c560 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009e50 tx=0x7f8b1401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58c411ebfe07760 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:41.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b1a000640 1 -- 172.21.15.5:0/1284376190 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140a5760 con 0x7f8b1c06fad0 2024-08-18T22:33:41.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b1a000640 1 -- 172.21.15.5:0/1284376190 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b140a5900 con 0x7f8b1c06fad0 2024-08-18T22:33:41.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b1a000640 1 -- 172.21.15.5:0/1284376190 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140a5cd0 con 0x7f8b1c06fad0 2024-08-18T22:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b21a00640 1 -- 172.21.15.5:0/1284376190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c06fad0 msgr2=0x7f8b1c15c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b21a00640 1 --2- 172.21.15.5:0/1284376190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c06fad0 0x7f8b1c15c560 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009e50 tx=0x7f8b1401c8e0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b21a00640 1 -- 172.21.15.5:0/1284376190 shutdown_connections 2024-08-18T22:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b21a00640 1 --2- 172.21.15.5:0/1284376190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c06fad0 0x7f8b1c15c560 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b21a00640 1 --2- 172.21.15.5:0/1284376190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b1c071c90 0x7f8b1c0b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b21a00640 1 -- 172.21.15.5:0/1284376190 >> 172.21.15.5:0/1284376190 conn(0x7f8b1c0b3eb0 msgr2=0x7f8b1c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b21a00640 1 -- 172.21.15.5:0/1284376190 shutdown_connections 2024-08-18T22:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b21a00640 1 -- 172.21.15.5:0/1284376190 wait complete. 2024-08-18T22:33:41.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b21a00640 1 Processor -- start 2024-08-18T22:33:41.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b21a00640 1 -- start start 2024-08-18T22:33:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.398+0000 7f8b21a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b1c06fad0 0x7f8b1c165dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b21a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c071c90 0x7f8b1c06d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b21a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b1c15c180 0x7f8b1c15cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b21a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c0d1c30 con 0x7f8b1c071c90 2024-08-18T22:33:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b21a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c0d1ab0 con 0x7f8b1c06fad0 2024-08-18T22:33:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b21a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1c0d1db0 con 0x7f8b1c15c180 2024-08-18T22:33:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b12000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c071c90 0x7f8b1c06d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b12000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c071c90 0x7f8b1c06d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51212/0 (socket says 172.21.15.5:51212) 2024-08-18T22:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b12000640 1 -- 172.21.15.5:0/758853237 learned_addr learned my addr 172.21.15.5:0/758853237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b1b400640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b1c15c180 0x7f8b1c15cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b1aa00640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b1c06fad0 0x7f8b1c165dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b12000640 1 -- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b1c15c180 msgr2=0x7f8b1c15cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b12000640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b1c15c180 0x7f8b1c15cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b12000640 1 -- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b1c06fad0 msgr2=0x7f8b1c165dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b12000640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b1c06fad0 0x7f8b1c165dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b12000640 1 -- 172.21.15.5:0/758853237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c06d620 con 0x7f8b1c071c90 2024-08-18T22:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b12000640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c071c90 0x7f8b1c06d0e0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400e930 tx=0x7f8b0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b13400640 1 -- 172.21.15.5:0/758853237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b04017070 con 0x7f8b1c071c90 2024-08-18T22:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b13400640 1 -- 172.21.15.5:0/758853237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0400ca00 con 0x7f8b1c071c90 2024-08-18T22:33:41.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b13400640 1 -- 172.21.15.5:0/758853237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400cdb0 con 0x7f8b1c071c90 2024-08-18T22:33:41.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b21a00640 1 -- 172.21.15.5:0/758853237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1c1f78a0 con 0x7f8b1c071c90 2024-08-18T22:33:41.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b21a00640 1 -- 172.21.15.5:0/758853237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1c1655d0 con 0x7f8b1c071c90 2024-08-18T22:33:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b21a00640 1 -- 172.21.15.5:0/758853237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b1c15c560 con 0x7f8b1c071c90 2024-08-18T22:33:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.402+0000 7f8b13400640 1 -- 172.21.15.5:0/758853237 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b0401a070 con 0x7f8b1c071c90 2024-08-18T22:33:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.406+0000 7f8b13400640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8af80678c0 0x7f8af8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.406+0000 7f8b13400640 1 -- 172.21.15.5:0/758853237 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f8b04085de0 con 0x7f8b1c071c90 2024-08-18T22:33:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.406+0000 7f8b1aa00640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8af80678c0 0x7f8af8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.406+0000 7f8b1aa00640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8af80678c0 0x7f8af8069d80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c001770 tx=0x7f8b0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:41.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.410+0000 7f8b13400640 1 -- 172.21.15.5:0/758853237 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8b040561f0 con 0x7f8b1c071c90 2024-08-18T22:33:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.614+0000 7f8b21a00640 1 -- 172.21.15.5:0/758853237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b1c0cf7d0 con 0x7f8b1c071c90 2024-08-18T22:33:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.614+0000 7f8b13400640 1 -- 172.21.15.5:0/758853237 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5234 (secure 0 0 0) 0x7f8b0405a4f0 con 0x7f8b1c071c90 2024-08-18T22:33:41.612 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:33:41.612 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":160,"btime":"2024-08-18T22:33:36:585978+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1931701065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1931701065},{"type":"v1","addr":"172.21.15.117:6837","nonce":1931701065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10731,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/83313921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":83313921},{"type":"v1","addr":"172.21.15.5:6833","nonce":83313921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2593956905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2593956905},{"type":"v1","addr":"172.21.15.5:6835","nonce":2593956905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:33:32.949657+0000","modified":"2024-08-18T22:33:35.978872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10740":{"gid":10740,"name":"d","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6836/3939158605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3939158605},{"type":"v1","addr":"172.21.15.117:6836","nonce":3939158605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10740,"qdb_cluster":[10740]},"id":14}]} 2024-08-18T22:33:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 160 2024-08-18T22:33:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 -- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8af80678c0 msgr2=0x7f8af8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8af80678c0 0x7f8af8069d80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c001770 tx=0x7f8b0c009040 comp rx=0 tx=0).stop 2024-08-18T22:33:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 -- 172.21.15.5:0/758853237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c071c90 msgr2=0x7f8b1c06d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c071c90 0x7f8b1c06d0e0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400e930 tx=0x7f8b0400edf0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 -- 172.21.15.5:0/758853237 shutdown_connections 2024-08-18T22:33:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8af80678c0 0x7f8af8069d80 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b1c15c180 0x7f8b1c15cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c071c90 0x7f8b1c06d0e0 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 --2- 172.21.15.5:0/758853237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b1c06fad0 0x7f8b1c165dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 -- 172.21.15.5:0/758853237 >> 172.21.15.5:0/758853237 conn(0x7f8b1c0b3eb0 msgr2=0x7f8b1c071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 -- 172.21.15.5:0/758853237 shutdown_connections 2024-08-18T22:33:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.618+0000 7f8b21a00640 1 -- 172.21.15.5:0/758853237 wait complete. 2024-08-18T22:33:41.633 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-08-18T22:33:41.796 INFO:teuthology.orchestra.run.smithi117.stdout:{"message":"","return_code":0} 2024-08-18T22:33:41.796 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-08-18T22:33:41.797 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2024-08-18T22:33:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.846+0000 7ffb4d2c8080 1 Processor -- start 2024-08-18T22:33:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 -- start start 2024-08-18T22:33:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56065e7d4c40 0x56065e7af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56065e7d5020 0x56065e8630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e848c40 0x56065e7b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56065e849bf0 con 0x56065e848c40 2024-08-18T22:33:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56065e849950 con 0x56065e7d4c40 2024-08-18T22:33:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56065e849e90 con 0x56065e7d5020 2024-08-18T22:33:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4ae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e848c40 0x56065e7b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4ae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e848c40 0x56065e7b90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51240/0 (socket says 172.21.15.5:51240) 2024-08-18T22:33:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4ae00640 1 -- 172.21.15.5:0/89189588 learned_addr learned my addr 172.21.15.5:0/89189588 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb43e00640 1 --2- 172.21.15.5:0/89189588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56065e7d5020 0x56065e8630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4a400640 1 --2- 172.21.15.5:0/89189588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56065e7d4c40 0x56065e7af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4ae00640 1 -- 172.21.15.5:0/89189588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56065e7d5020 msgr2=0x56065e8630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4ae00640 1 --2- 172.21.15.5:0/89189588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56065e7d5020 0x56065e8630a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4ae00640 1 -- 172.21.15.5:0/89189588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56065e7d4c40 msgr2=0x56065e7af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4ae00640 1 --2- 172.21.15.5:0/89189588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56065e7d4c40 0x56065e7af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4ae00640 1 -- 172.21.15.5:0/89189588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56065e6caee0 con 0x56065e848c40 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4ae00640 1 --2- 172.21.15.5:0/89189588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e848c40 0x56065e7b90b0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400b790 tx=0x7ffb4400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1475afc224da58 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb49000640 1 -- 172.21.15.5:0/89189588 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44016020 con 0x56065e848c40 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb49000640 1 -- 172.21.15.5:0/89189588 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4400d960 con 0x56065e848c40 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb49000640 1 -- 172.21.15.5:0/89189588 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400bea0 con 0x56065e848c40 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/89189588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e848c40 msgr2=0x56065e7b90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 --2- 172.21.15.5:0/89189588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e848c40 0x56065e7b90b0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400b790 tx=0x7ffb4400bc50 comp rx=0 tx=0).stop 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/89189588 shutdown_connections 2024-08-18T22:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 --2- 172.21.15.5:0/89189588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e848c40 0x56065e7b90b0 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 --2- 172.21.15.5:0/89189588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56065e7d5020 0x56065e8630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 --2- 172.21.15.5:0/89189588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56065e7d4c40 0x56065e7af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/89189588 >> 172.21.15.5:0/89189588 conn(0x56065e78e300 msgr2=0x56065e847ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/89189588 shutdown_connections 2024-08-18T22:33:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/89189588 wait complete. 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 Processor -- start 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.850+0000 7ffb4d2c8080 1 -- start start 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb4d2c8080 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56065e7d4c40 0x56065e8f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb4d2c8080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e7d5020 0x56065e7ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb4d2c8080 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56065e848c40 0x56065e7b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb4d2c8080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56065e7bc3e0 con 0x56065e7d5020 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb4d2c8080 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56065e7bce60 con 0x56065e7d4c40 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb4d2c8080 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x56065e7bc680 con 0x56065e848c40 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb43e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e7d5020 0x56065e7ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb43e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e7d5020 0x56065e7ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51256/0 (socket says 172.21.15.5:51256) 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb43e00640 1 -- 172.21.15.5:0/3434160641 learned_addr learned my addr 172.21.15.5:0/3434160641 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb4a400640 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56065e7d4c40 0x56065e8f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb4ae00640 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56065e848c40 0x56065e7b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb43e00640 1 -- 172.21.15.5:0/3434160641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56065e848c40 msgr2=0x56065e7b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb43e00640 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56065e848c40 0x56065e7b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb43e00640 1 -- 172.21.15.5:0/3434160641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56065e7d4c40 msgr2=0x56065e8f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb43e00640 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56065e7d4c40 0x56065e8f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb43e00640 1 -- 172.21.15.5:0/3434160641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56065e6b7950 con 0x56065e7d5020 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb43e00640 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e7d5020 0x56065e7ccf90 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7ffb3401c2f0 tx=0x7ffb3401a9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb42a00640 1 -- 172.21.15.5:0/3434160641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb340b4040 con 0x56065e7d5020 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb42a00640 1 -- 172.21.15.5:0/3434160641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb340c4070 con 0x56065e7d5020 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb42a00640 1 -- 172.21.15.5:0/3434160641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb340bb940 con 0x56065e7d5020 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/3434160641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56065e7cd910 con 0x56065e7d5020 2024-08-18T22:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/3434160641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56065e7cde50 con 0x56065e7d5020 2024-08-18T22:33:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.854+0000 7ffb42a00640 1 -- 172.21.15.5:0/3434160641 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb340bbae0 con 0x56065e7d5020 2024-08-18T22:33:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb42a00640 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb280662a0 0x7ffb28068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb42a00640 1 -- 172.21.15.5:0/3434160641 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7ffb34123160 con 0x56065e7d5020 2024-08-18T22:33:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4a400640 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb280662a0 0x7ffb28068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x56065e8fb480 0x56065e9048b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/3434160641 --> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] -- osd_op(unknown.0.0:1 30.7 30:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e204) -- 0x56065e7cd4d0 con 0x56065e8fb480 2024-08-18T22:33:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4ae00640 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x56065e8fb480 0x56065e9048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4a400640 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb280662a0 0x7ffb28068760 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c005fd0 tx=0x7ffb3c00c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:41.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4ae00640 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x56065e8fb480 0x56065e9048b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:41.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4ae00640 1 -- 172.21.15.5:0/3434160641 <== osd.2 v2:172.21.15.5:6800/3144131686 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v204'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ffb4400db90 con 0x56065e8fb480 2024-08-18T22:33:41.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/3434160641 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x56065e8fb480 msgr2=0x56065e9048b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x56065e8fb480 0x56065e9048b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/3434160641 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb280662a0 msgr2=0x7ffb28068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffb280662a0 0x7ffb28068760 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c005fd0 tx=0x7ffb3c00c040 comp rx=0 tx=0).stop 2024-08-18T22:33:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/3434160641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e7d5020 msgr2=0x56065e7ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 --2- 172.21.15.5:0/3434160641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56065e7d5020 0x56065e7ccf90 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7ffb3401c2f0 tx=0x7ffb3401a9e0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4ae00640 1 -- 172.21.15.5:0/3434160641 reap_dead start 2024-08-18T22:33:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/3434160641 shutdown_connections 2024-08-18T22:33:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/3434160641 >> 172.21.15.5:0/3434160641 conn(0x56065e78e300 msgr2=0x56065e8630a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/3434160641 shutdown_connections 2024-08-18T22:33:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:41.858+0000 7ffb4d2c8080 1 -- 172.21.15.5:0/3434160641 wait complete. 2024-08-18T22:33:41.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:41.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub start / recursive,repair 2024-08-18T22:33:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130be00640 1 Processor -- start 2024-08-18T22:33:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130be00640 1 -- start start 2024-08-18T22:33:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130c0b46a0 0x7f130c15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130be00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f130c15f500 0x7f130c15cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130be00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130c13f730 con 0x7f130c15f120 2024-08-18T22:33:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130be00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f130c13fa10 con 0x7f130c15f500 2024-08-18T22:33:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130be00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f130c13fcf0 con 0x7f130c0b46a0 2024-08-18T22:33:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130aa00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f130c15f120 0x7f130c0b3f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37292/0 (socket says 172.21.15.5:37292) 2024-08-18T22:33:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130aa00640 1 -- 172.21.15.5:0/586893432 learned_addr learned my addr 172.21.15.5:0/586893432 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130a000640 1 --2- 172.21.15.5:0/586893432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130c0b46a0 0x7f130c15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130b400640 1 --2- 172.21.15.5:0/586893432 >> v2:172.21.15.117:3300/0 conn(0x7f130c15f500 0x7f130c15cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f1309600640 1 -- 172.21.15.5:0/586893432 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733480058 0 0) 0x7f130c13f730 con 0x7f130c15f120 2024-08-18T22:33:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f1309600640 1 -- 172.21.15.5:0/586893432 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12f0003530 con 0x7f130c15f120 2024-08-18T22:33:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130a000640 1 -- 172.21.15.5:0/586893432 >> v2:172.21.15.117:3300/0 conn(0x7f130c15f500 msgr2=0x7f130c15cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130a000640 1 --2- 172.21.15.5:0/586893432 >> v2:172.21.15.117:3300/0 conn(0x7f130c15f500 0x7f130c15cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f1309600640 1 -- 172.21.15.5:0/586893432 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1131033752 0 0) 0x7f12f0003530 con 0x7f130c15f120 2024-08-18T22:33:42.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130a000640 1 -- 172.21.15.5:0/586893432 >> v1:172.21.15.5:6789/0 conn(0x7f130c15f120 legacy=0x7f130c0b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130a000640 1 -- 172.21.15.5:0/586893432 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c13ffd0 con 0x7f130c0b46a0 2024-08-18T22:33:42.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.010+0000 7f130b400640 1 --2- 172.21.15.5:0/586893432 >> v2:172.21.15.117:3300/0 conn(0x7f130c15f500 0x7f130c15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:33:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f130a000640 1 --2- 172.21.15.5:0/586893432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130c0b46a0 0x7f130c15c7d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f12f80097c0 tx=0x7f12f801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7b073c0e44108fe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f1309600640 1 -- 172.21.15.5:0/586893432 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f80b0070 con 0x7f130c0b46a0 2024-08-18T22:33:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f1309600640 1 -- 172.21.15.5:0/586893432 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f80ab400 con 0x7f130c0b46a0 2024-08-18T22:33:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f1309600640 1 -- 172.21.15.5:0/586893432 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc001680 con 0x7f130c0b46a0 2024-08-18T22:33:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f130be00640 1 -- 172.21.15.5:0/586893432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130c0b46a0 msgr2=0x7f130c15c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f130be00640 1 --2- 172.21.15.5:0/586893432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130c0b46a0 0x7f130c15c7d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f12f80097c0 tx=0x7f12f801c3c0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f130be00640 1 -- 172.21.15.5:0/586893432 shutdown_connections 2024-08-18T22:33:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f130be00640 1 --2- 172.21.15.5:0/586893432 >> v2:172.21.15.117:3300/0 conn(0x7f130c15f500 0x7f130c15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f130be00640 1 --2- 172.21.15.5:0/586893432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130c0b46a0 0x7f130c15c7d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f130be00640 1 -- 172.21.15.5:0/586893432 >> 172.21.15.5:0/586893432 conn(0x7f130c067840 msgr2=0x7f130c067c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f130be00640 1 -- 172.21.15.5:0/586893432 shutdown_connections 2024-08-18T22:33:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.014+0000 7f130be00640 1 -- 172.21.15.5:0/586893432 wait complete. 2024-08-18T22:33:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130be00640 1 Processor -- start 2024-08-18T22:33:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130be00640 1 -- start start 2024-08-18T22:33:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130c0b46a0 0x7f130c13c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f130c15f120 0x7f130c06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130be00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130c15f500 0x7f130c06e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130be00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f130c141090 con 0x7f130c15f500 2024-08-18T22:33:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130be00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f130c140f10 con 0x7f130c15f120 2024-08-18T22:33:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130be00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f130c141210 con 0x7f130c0b46a0 2024-08-18T22:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130c15f500 0x7f130c06e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130c15f500 0x7f130c06e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51272/0 (socket says 172.21.15.5:51272) 2024-08-18T22:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130b400640 1 -- 172.21.15.5:0/433865390 learned_addr learned my addr 172.21.15.5:0/433865390 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130a000640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f130c15f120 0x7f130c06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130aa00640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130c0b46a0 0x7f130c13c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130b400640 1 -- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130c0b46a0 msgr2=0x7f130c13c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130b400640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130c0b46a0 0x7f130c13c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130b400640 1 -- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f130c15f120 msgr2=0x7f130c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130b400640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f130c15f120 0x7f130c06e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130b400640 1 -- 172.21.15.5:0/433865390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c158660 con 0x7f130c15f500 2024-08-18T22:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130b400640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130c15f500 0x7f130c06e5f0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f1304009e50 tx=0x7f130400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f1302a00640 1 -- 172.21.15.5:0/433865390 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304018030 con 0x7f130c15f500 2024-08-18T22:33:42.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130be00640 1 -- 172.21.15.5:0/433865390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130c158940 con 0x7f130c15f500 2024-08-18T22:33:42.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f1302a00640 1 -- 172.21.15.5:0/433865390 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f130400cd90 con 0x7f130c15f500 2024-08-18T22:33:42.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f1302a00640 1 -- 172.21.15.5:0/433865390 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304003bc0 con 0x7f130c15f500 2024-08-18T22:33:42.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.018+0000 7f130be00640 1 -- 172.21.15.5:0/433865390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130c158f00 con 0x7f130c15f500 2024-08-18T22:33:42.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f1302a00640 1 -- 172.21.15.5:0/433865390 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f130401b070 con 0x7f130c15f500 2024-08-18T22:33:42.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f1302a00640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f12ec0678c0 0x7f12ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f1302a00640 1 -- 172.21.15.5:0/433865390 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f1304086850 con 0x7f130c15f500 2024-08-18T22:33:42.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130aa00640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f12ec0678c0 0x7f12ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f1314edd000 1 Processor -- start 2024-08-18T22:33:42.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f1314edd000 1 -- start start 2024-08-18T22:33:42.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130aa00640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f12ec0678c0 0x7f12ec069d80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f12fc007a10 tx=0x7f12fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f1314edd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec96882d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f1314edd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec968361e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f1314edd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec96836b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f1314edd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ec966865f0 con 0x55ec96836720 2024-08-18T22:33:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f1314edd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ec96640c50 con 0x55ec968832a0 2024-08-18T22:33:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f1314edd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ec966825b0 con 0x55ec96882980 2024-08-18T22:33:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec96836b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec96836b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51278/0 (socket says 172.21.15.5:51278) 2024-08-18T22:33:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130b400640 1 -- 172.21.15.5:0/3173773892 learned_addr learned my addr 172.21.15.5:0/3173773892 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130aa00640 1 --2- 172.21.15.5:0/3173773892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec96882d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130a000640 1 --2- 172.21.15.5:0/3173773892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec968361e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130b400640 1 -- 172.21.15.5:0/3173773892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 msgr2=0x55ec96882d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130b400640 1 --2- 172.21.15.5:0/3173773892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec96882d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130b400640 1 -- 172.21.15.5:0/3173773892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 msgr2=0x55ec968361e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130b400640 1 --2- 172.21.15.5:0/3173773892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec968361e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130b400640 1 -- 172.21.15.5:0/3173773892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec96626b90 con 0x55ec96836720 2024-08-18T22:33:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.022+0000 7f130aa00640 1 --2- 172.21.15.5:0/3173773892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec96882d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f130b400640 1 --2- 172.21.15.5:0/3173773892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec96836b00 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f1304056970 tx=0x7f1304057210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd6e5e3a3c3951f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f12f7400640 1 -- 172.21.15.5:0/3173773892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304054ce0 con 0x55ec96836720 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f12f7400640 1 -- 172.21.15.5:0/3173773892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1304053050 con 0x55ec96836720 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f12f7400640 1 -- 172.21.15.5:0/3173773892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304055e30 con 0x55ec96836720 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 -- 172.21.15.5:0/3173773892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 msgr2=0x55ec96836b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 --2- 172.21.15.5:0/3173773892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec96836b00 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f1304056970 tx=0x7f1304057210 comp rx=0 tx=0).stop 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 -- 172.21.15.5:0/3173773892 shutdown_connections 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 --2- 172.21.15.5:0/3173773892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec96836b00 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 --2- 172.21.15.5:0/3173773892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec968361e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 --2- 172.21.15.5:0/3173773892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec96882d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 -- 172.21.15.5:0/3173773892 >> 172.21.15.5:0/3173773892 conn(0x55ec96863830 msgr2=0x55ec96865c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 -- 172.21.15.5:0/3173773892 shutdown_connections 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 -- 172.21.15.5:0/3173773892 wait complete. 2024-08-18T22:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 -- start start 2024-08-18T22:33:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 Processor -- start 2024-08-18T22:33:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec9683df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec9683e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec96864c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ec966518f0 con 0x55ec96836720 2024-08-18T22:33:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ec96627e00 con 0x55ec968832a0 2024-08-18T22:33:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ec96707f20 con 0x55ec96882980 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f1314edd000 10 client.0 _ll_register_callbacks cb 0x55ec96824170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f130aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec9683df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f130aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec9683df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51290/0 (socket says 172.21.15.5:51290) 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f130aa00640 1 -- 172.21.15.5:0/1991116878 learned_addr learned my addr 172.21.15.5:0/1991116878 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f130a000640 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec9683e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f130b400640 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec96864c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f130aa00640 1 -- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 msgr2=0x55ec9683e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f130aa00640 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec9683e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f130aa00640 1 -- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 msgr2=0x55ec96864c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f130aa00640 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec96864c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.026+0000 7f130aa00640 1 -- 172.21.15.5:0/1991116878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec9663f160 con 0x55ec96836720 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f130aa00640 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec9683df20 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f12fc001de0 tx=0x7f12fc001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419512dd3dbfd4c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f12ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f12ebe00640 1 -- 172.21.15.5:0/1991116878 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc027060 con 0x55ec96836720 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f12ebe00640 1 -- 172.21.15.5:0/1991116878 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f12fc010040 con 0x55ec96836720 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 -- 172.21.15.5:0/1991116878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1304053050 con 0x55ec96836720 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f12ebe00640 1 -- 172.21.15.5:0/1991116878 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7f12fc00ee90 con 0x55ec96836720 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 10 client.10905 fetch_fsmap learned FSMap version 160 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 -- 172.21.15.5:0/1991116878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x55ec96653050 con 0x55ec96836720 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f12ebe00640 1 -- 172.21.15.5:0/1991116878 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1304053050 con 0x55ec96836720 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f12ebe00640 1 -- 172.21.15.5:0/1991116878 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7f12fc013420 con 0x55ec96836720 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 10 client.10905 fetch_fsmap finished waiting for FSMap version 160 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 10 client.10905 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.d 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 20 client.10905 populate_metadata read hostname 'smithi005' 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ec96865670 0x55ec96894a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 4 client.10905 mds_command: new command op to 10740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:33:42.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 -- 172.21.15.5:0/1991116878 --> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec96620f10 con 0x55ec96865670 2024-08-18T22:33:42.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f130a000640 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ec96865670 0x55ec96894a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f130a000640 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ec96865670 0x55ec96894a30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d71f2eb323ecc78a server_cookie=ac55e099c2c436d5 in_seq=0 out_seq=0 2024-08-18T22:33:42.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f12ebe00640 10 client.10905 ms_handle_connect on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:42.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f12ebe00640 1 -- 172.21.15.5:0/1991116878 <== mds.0 v2:172.21.15.117:6834/3939158605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec96620f10 con 0x55ec96865670 2024-08-18T22:33:42.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f12ebe00640 10 client.10905 handle_command_reply: tid=0 2024-08-18T22:33:42.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 client.10905 shutdown 2024-08-18T22:33:42.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 -- 172.21.15.5:0/1991116878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 msgr2=0x55ec9683df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec9683df20 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f12fc001de0 tx=0x7f12fc001b10 comp rx=0 tx=0).stop 2024-08-18T22:33:42.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 -- 172.21.15.5:0/1991116878 shutdown_connections 2024-08-18T22:33:42.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ec96865670 0x55ec96894a30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec96864c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec9683e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f12ebe00640 0 client.10905 ms_handle_reset on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:42.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 --2- 172.21.15.5:0/1991116878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec9683df20 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 -- 172.21.15.5:0/1991116878 >> 172.21.15.5:0/1991116878 conn(0x55ec96863830 msgr2=0x55ec968358e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 -- 172.21.15.5:0/1991116878 shutdown_connections 2024-08-18T22:33:42.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 1 -- 172.21.15.5:0/1991116878 wait complete. 2024-08-18T22:33:42.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.030+0000 7f1314edd000 20 client.10905 trim_cache size 0 max 16384 2024-08-18T22:33:42.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 Processor -- start 2024-08-18T22:33:42.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 -- start start 2024-08-18T22:33:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec96836720 0x55ec96898090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96882980 0x55ec968349b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec968832a0 0x55ec96834ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f130c202af0 con 0x55ec96882980 2024-08-18T22:33:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f130c164fd0 con 0x55ec96836720 2024-08-18T22:33:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f130c202520 con 0x55ec968832a0 2024-08-18T22:33:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f130a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96882980 0x55ec968349b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f130a000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96882980 0x55ec968349b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51298/0 (socket says 172.21.15.5:51298) 2024-08-18T22:33:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f130a000640 1 -- 172.21.15.5:0/1230734581 learned_addr learned my addr 172.21.15.5:0/1230734581 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:42.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f130a000640 1 -- 172.21.15.5:0/1230734581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec968832a0 msgr2=0x55ec96834ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f130a000640 1 --2- 172.21.15.5:0/1230734581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec968832a0 0x55ec96834ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f130a000640 1 -- 172.21.15.5:0/1230734581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec96836720 msgr2=0x55ec96898090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f130aa00640 1 --2- 172.21.15.5:0/1230734581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec96836720 0x55ec96898090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f130a000640 1 --2- 172.21.15.5:0/1230734581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec96836720 0x55ec96898090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f130a000640 1 -- 172.21.15.5:0/1230734581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec967083b0 con 0x55ec96882980 2024-08-18T22:33:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f130aa00640 1 --2- 172.21.15.5:0/1230734581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec96836720 0x55ec96898090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:42.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f130a000640 1 --2- 172.21.15.5:0/1230734581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96882980 0x55ec968349b0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f12f801c1f0 tx=0x7f12f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d392f47d5b9a4e4a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f12f6a00640 1 -- 172.21.15.5:0/1230734581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f80b0040 con 0x55ec96882980 2024-08-18T22:33:42.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f12f6a00640 1 -- 172.21.15.5:0/1230734581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f80b1040 con 0x55ec96882980 2024-08-18T22:33:42.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f12f6a00640 1 -- 172.21.15.5:0/1230734581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f80b7b30 con 0x55ec96882980 2024-08-18T22:33:42.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 -- 172.21.15.5:0/1230734581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96882980 msgr2=0x55ec968349b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 --2- 172.21.15.5:0/1230734581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96882980 0x55ec968349b0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f12f801c1f0 tx=0x7f12f8008040 comp rx=0 tx=0).stop 2024-08-18T22:33:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 -- 172.21.15.5:0/1230734581 shutdown_connections 2024-08-18T22:33:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 --2- 172.21.15.5:0/1230734581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec968832a0 0x55ec96834ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 --2- 172.21.15.5:0/1230734581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96882980 0x55ec968349b0 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 --2- 172.21.15.5:0/1230734581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec96836720 0x55ec96898090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 -- 172.21.15.5:0/1230734581 >> 172.21.15.5:0/1230734581 conn(0x55ec96863830 msgr2=0x55ec9688ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 -- 172.21.15.5:0/1230734581 shutdown_connections 2024-08-18T22:33:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.050+0000 7f1314edd000 1 -- 172.21.15.5:0/1230734581 wait complete. 2024-08-18T22:33:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 -- start start 2024-08-18T22:33:42.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 Processor -- start 2024-08-18T22:33:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec968f6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec968f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec968f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ec9662db90 con 0x55ec96836720 2024-08-18T22:33:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ec967434d0 con 0x55ec968832a0 2024-08-18T22:33:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ec96685900 con 0x55ec96882980 2024-08-18T22:33:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 10 client.0 _ll_register_callbacks cb 0x7f12fc0058e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:33:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec968f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130aa00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec968f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51302/0 (socket says 172.21.15.5:51302) 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130aa00640 1 -- 172.21.15.5:0/647285247 learned_addr learned my addr 172.21.15.5:0/647285247 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130b400640 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec968f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130a000640 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec968f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130aa00640 1 -- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 msgr2=0x55ec968f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130aa00640 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec968f6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130aa00640 1 -- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 msgr2=0x55ec968f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130aa00640 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec968f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130aa00640 1 -- 172.21.15.5:0/647285247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec96619dd0 con 0x55ec96836720 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130aa00640 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec968f6560 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0136d0 tx=0x7f12fc007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921ec3697ae5da6c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f12ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f12ebe00640 1 -- 172.21.15.5:0/647285247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc00ee90 con 0x55ec96836720 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f12ebe00640 1 -- 172.21.15.5:0/647285247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7f12fc010040 con 0x55ec96836720 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 -- 172.21.15.5:0/647285247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12f80b1040 con 0x55ec96836720 2024-08-18T22:33:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f12ebe00640 1 -- 172.21.15.5:0/647285247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7f12fc03c050 con 0x55ec96836720 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 10 client.10911 fetch_fsmap learned FSMap version 160 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 -- 172.21.15.5:0/647285247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x55ec9662c420 con 0x55ec96836720 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f12ebe00640 1 -- 172.21.15.5:0/647285247 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f80b1040 con 0x55ec96836720 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f12ebe00640 1 -- 172.21.15.5:0/647285247 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7f12fc03f020 con 0x55ec96836720 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 10 client.10911 fetch_fsmap finished waiting for FSMap version 160 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 10 client.10911 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.d 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 20 client.10911 populate_metadata read hostname 'smithi005' 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ec96896400 0x55ec96896810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 4 client.10911 mds_command: new command op to 10740 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f1314edd000 1 -- 172.21.15.5:0/647285247 --> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x55ec96693d20 con 0x55ec96896400 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.054+0000 7f130a000640 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ec96896400 0x55ec96896810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130a000640 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ec96896400 0x55ec96896810 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e68a0f0549c050d server_cookie=aa836b7209fb210c in_seq=0 out_seq=0 2024-08-18T22:33:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f12ebe00640 10 client.10911 ms_handle_connect on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:42.057 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-08-18T22:33:42.052+0000 7f89e0400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-08-18T22:33:40.834133+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={10878=0-12582912@1} caps={10878=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=10878 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x56070e33f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(30)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:33:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f12ebe00640 1 -- 172.21.15.5:0/647285247 <== mds.0 v2:172.21.15.117:6834/3939158605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ec96693d20 con 0x55ec96896400 2024-08-18T22:33:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f12ebe00640 10 client.10911 handle_command_reply: tid=0 2024-08-18T22:33:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 1 client.10911 shutdown 2024-08-18T22:33:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 1 -- 172.21.15.5:0/647285247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 msgr2=0x55ec968f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec968f6560 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0136d0 tx=0x7f12fc007000 comp rx=0 tx=0).stop 2024-08-18T22:33:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 1 -- 172.21.15.5:0/647285247 shutdown_connections 2024-08-18T22:33:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ec96896400 0x55ec96896810 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec968832a0 0x55ec968f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec96882980 0x55ec968f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 1 --2- 172.21.15.5:0/647285247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec96836720 0x55ec968f6560 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 1 -- 172.21.15.5:0/647285247 >> 172.21.15.5:0/647285247 conn(0x55ec96863830 msgr2=0x55ec96863c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f12ebe00640 0 client.10911 ms_handle_reset on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 1 -- 172.21.15.5:0/647285247 shutdown_connections 2024-08-18T22:33:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 1 -- 172.21.15.5:0/647285247 wait complete. 2024-08-18T22:33:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f1314edd000 20 client.10911 trim_cache size 0 max 16384 2024-08-18T22:33:42.059 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:33:42.059 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-18T22:33:42.059 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "c29f3654-12ea-4091-8aa0-fb589861dc35", 2024-08-18T22:33:42.059 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-18T22:33:42.059 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:33:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 -- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f12ec0678c0 msgr2=0x7f12ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f12ec0678c0 0x7f12ec069d80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f12fc007a10 tx=0x7f12fc009040 comp rx=0 tx=0).stop 2024-08-18T22:33:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 -- 172.21.15.5:0/433865390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130c15f500 msgr2=0x7f130c06e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130c15f500 0x7f130c06e5f0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f1304009e50 tx=0x7f130400c490 comp rx=0 tx=0).stop 2024-08-18T22:33:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 -- 172.21.15.5:0/433865390 shutdown_connections 2024-08-18T22:33:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f12ec0678c0 0x7f12ec069d80 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f130c15f500 0x7f130c06e5f0 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f130c15f120 0x7f130c06e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 --2- 172.21.15.5:0/433865390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130c0b46a0 0x7f130c13c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 -- 172.21.15.5:0/433865390 >> 172.21.15.5:0/433865390 conn(0x7f130c067840 msgr2=0x7f130c15acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 -- 172.21.15.5:0/433865390 shutdown_connections 2024-08-18T22:33:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.058+0000 7f130be00640 1 -- 172.21.15.5:0/433865390 wait complete. 2024-08-18T22:33:42.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:33:42.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-08-18T22:33:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff45b800640 1 Processor -- start 2024-08-18T22:33:42.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff45b800640 1 -- start start 2024-08-18T22:33:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff45b800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b1300 0x7ff454162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff45b800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45406e8a0 con 0x7ff45409aca0 2024-08-18T22:33:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff45b800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45409bb80 con 0x7ff45409b080 2024-08-18T22:33:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff45b800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff4540d2e40 con 0x7ff4540b1300 2024-08-18T22:33:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff458e00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff45409aca0 0x7ff4540afa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37306/0 (socket says 172.21.15.5:37306) 2024-08-18T22:33:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff458e00640 1 -- 172.21.15.5:0/2872753522 learned_addr learned my addr 172.21.15.5:0/2872753522 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:33:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff453e00640 1 --2- 172.21.15.5:0/2872753522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b1300 0x7ff454162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff453400640 1 -- 172.21.15.5:0/2872753522 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063617099 0 0) 0x7ff45406e8a0 con 0x7ff45409aca0 2024-08-18T22:33:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff453400640 1 -- 172.21.15.5:0/2872753522 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff438003530 con 0x7ff45409aca0 2024-08-18T22:33:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff453400640 1 -- 172.21.15.5:0/2872753522 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845023583 0 0) 0x7ff45409bb80 con 0x7ff45409b080 2024-08-18T22:33:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.222+0000 7ff453400640 1 -- 172.21.15.5:0/2872753522 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff45406e8a0 con 0x7ff45409b080 2024-08-18T22:33:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.226+0000 7ff453e00640 1 -- 172.21.15.5:0/2872753522 >> v1:172.21.15.117:6789/0 conn(0x7ff45409b080 legacy=0x7ff4540b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.226+0000 7ff453e00640 1 -- 172.21.15.5:0/2872753522 >> v1:172.21.15.5:6789/0 conn(0x7ff45409aca0 legacy=0x7ff4540afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.226+0000 7ff453e00640 1 -- 172.21.15.5:0/2872753522 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45406cbd0 con 0x7ff4540b1300 2024-08-18T22:33:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.226+0000 7ff453e00640 1 --2- 172.21.15.5:0/2872753522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b1300 0x7ff454162950 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff4400097f0 tx=0x7ff44001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe8d15ba46ea8ea7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.226+0000 7ff453400640 1 -- 172.21.15.5:0/2872753522 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4400ab5f0 con 0x7ff4540b1300 2024-08-18T22:33:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.226+0000 7ff453400640 1 -- 172.21.15.5:0/2872753522 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4400b0070 con 0x7ff4540b1300 2024-08-18T22:33:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.226+0000 7ff453400640 1 -- 172.21.15.5:0/2872753522 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4400ab990 con 0x7ff4540b1300 2024-08-18T22:33:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 -- 172.21.15.5:0/2872753522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b1300 msgr2=0x7ff454162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 --2- 172.21.15.5:0/2872753522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b1300 0x7ff454162950 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff4400097f0 tx=0x7ff44001c4e0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 -- 172.21.15.5:0/2872753522 shutdown_connections 2024-08-18T22:33:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 --2- 172.21.15.5:0/2872753522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b1300 0x7ff454162950 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 -- 172.21.15.5:0/2872753522 >> 172.21.15.5:0/2872753522 conn(0x7ff4540d2180 msgr2=0x7ff4540d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 -- 172.21.15.5:0/2872753522 shutdown_connections 2024-08-18T22:33:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 -- 172.21.15.5:0/2872753522 wait complete. 2024-08-18T22:33:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 Processor -- start 2024-08-18T22:33:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 -- start start 2024-08-18T22:33:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff45409aca0 0x7ff4541542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff45409b080 0x7ff45414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b1300 0x7ff45415f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff45416ced0 con 0x7ff45409b080 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff45416cd50 con 0x7ff45409aca0 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff45b800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff45416d050 con 0x7ff4540b1300 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff453e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff45409b080 0x7ff45414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff453e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff45409b080 0x7ff45414f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51304/0 (socket says 172.21.15.5:51304) 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff453e00640 1 -- 172.21.15.5:0/619525885 learned_addr learned my addr 172.21.15.5:0/619525885 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff458e00640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff45409aca0 0x7ff4541542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff459800640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b1300 0x7ff45415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff453e00640 1 -- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b1300 msgr2=0x7ff45415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff453e00640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b1300 0x7ff45415f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff453e00640 1 -- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff45409aca0 msgr2=0x7ff4541542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff453e00640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff45409aca0 0x7ff4541542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff453e00640 1 -- 172.21.15.5:0/619525885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45415ffe0 con 0x7ff45409b080 2024-08-18T22:33:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.230+0000 7ff453e00640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff45409b080 0x7ff45414f740 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7ff44001ab90 tx=0x7ff440019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff450c00640 1 -- 172.21.15.5:0/619525885 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440003a30 con 0x7ff45409b080 2024-08-18T22:33:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff450c00640 1 -- 172.21.15.5:0/619525885 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff440003bd0 con 0x7ff45409b080 2024-08-18T22:33:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff450c00640 1 -- 172.21.15.5:0/619525885 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4400c0480 con 0x7ff45409b080 2024-08-18T22:33:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff45b800640 1 -- 172.21.15.5:0/619525885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4541602c0 con 0x7ff45409b080 2024-08-18T22:33:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff45b800640 1 -- 172.21.15.5:0/619525885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff454160880 con 0x7ff45409b080 2024-08-18T22:33:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff450c00640 1 -- 172.21.15.5:0/619525885 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff4400b5400 con 0x7ff45409b080 2024-08-18T22:33:42.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff450c00640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4340678c0 0x7ff434069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff450c00640 1 -- 172.21.15.5:0/619525885 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7ff4401207e0 con 0x7ff45409b080 2024-08-18T22:33:42.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff458e00640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4340678c0 0x7ff434069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff45ebf3000 1 Processor -- start 2024-08-18T22:33:42.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff458e00640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4340678c0 0x7ff434069d80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff4440012f0 tx=0x7ff444009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.234+0000 7ff45ebf3000 1 -- start start 2024-08-18T22:33:42.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d39a0 0x5589dd3d3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd3d42c0 0x5589dd386fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd3878e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5589dd270ae0 con 0x5589dd387500 2024-08-18T22:33:42.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5589dd25cba0 con 0x5589dd3d42c0 2024-08-18T22:33:42.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5589dd1d74f0 con 0x5589dd3d39a0 2024-08-18T22:33:42.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff459800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd3878e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff459800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd3878e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51320/0 (socket says 172.21.15.5:51320) 2024-08-18T22:33:42.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff459800640 1 -- 172.21.15.5:0/1670145649 learned_addr learned my addr 172.21.15.5:0/1670145649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:42.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff453e00640 1 --2- 172.21.15.5:0/1670145649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd3d42c0 0x5589dd386fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff458e00640 1 --2- 172.21.15.5:0/1670145649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d39a0 0x5589dd3d3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff459800640 1 -- 172.21.15.5:0/1670145649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d39a0 msgr2=0x5589dd3d3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff459800640 1 --2- 172.21.15.5:0/1670145649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d39a0 0x5589dd3d3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff459800640 1 -- 172.21.15.5:0/1670145649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd3d42c0 msgr2=0x5589dd386fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff459800640 1 --2- 172.21.15.5:0/1670145649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd3d42c0 0x5589dd386fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff459800640 1 -- 172.21.15.5:0/1670145649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589dd177a90 con 0x5589dd387500 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff453e00640 1 --2- 172.21.15.5:0/1670145649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd3d42c0 0x5589dd386fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff458e00640 1 --2- 172.21.15.5:0/1670145649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d39a0 0x5589dd3d3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff459800640 1 --2- 172.21.15.5:0/1670145649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd3878e0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0015a0 tx=0x7ff44c001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f298eeac626f924 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff449600640 1 -- 172.21.15.5:0/1670145649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c019070 con 0x5589dd387500 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff449600640 1 -- 172.21.15.5:0/1670145649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c0050d0 con 0x5589dd387500 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff449600640 1 -- 172.21.15.5:0/1670145649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c00e740 con 0x5589dd387500 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1670145649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 msgr2=0x5589dd3878e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1670145649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd3878e0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0015a0 tx=0x7ff44c001a60 comp rx=0 tx=0).stop 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1670145649 shutdown_connections 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1670145649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd3878e0 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1670145649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd3d42c0 0x5589dd386fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1670145649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d39a0 0x5589dd3d3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1670145649 >> 172.21.15.5:0/1670145649 conn(0x5589dd381010 msgr2=0x5589dd3b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1670145649 shutdown_connections 2024-08-18T22:33:42.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1670145649 wait complete. 2024-08-18T22:33:42.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 -- start start 2024-08-18T22:33:42.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.238+0000 7ff45ebf3000 1 Processor -- start 2024-08-18T22:33:42.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd387500 0x5589dd3b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d39a0 0x5589dd38f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d42c0 0x5589dd38f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5589dd1d34b0 con 0x5589dd3d39a0 2024-08-18T22:33:42.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5589dd191b50 con 0x5589dd387500 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5589dd178d00 con 0x5589dd3d42c0 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 10 client.0 _ll_register_callbacks cb 0x5589dd374f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff453e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d39a0 0x5589dd38f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff453e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d39a0 0x5589dd38f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51326/0 (socket says 172.21.15.5:51326) 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff453e00640 1 -- 172.21.15.5:0/1782085563 learned_addr learned my addr 172.21.15.5:0/1782085563 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff458e00640 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd387500 0x5589dd3b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff459800640 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d42c0 0x5589dd38f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff453e00640 1 -- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d42c0 msgr2=0x5589dd38f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff453e00640 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d42c0 0x5589dd38f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff453e00640 1 -- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd387500 msgr2=0x5589dd3b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff453e00640 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd387500 0x5589dd3b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff453e00640 1 -- 172.21.15.5:0/1782085563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589dd190060 con 0x5589dd3d39a0 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff453e00640 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d39a0 0x5589dd38f030 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7ff44001a110 tx=0x7ff4400f0500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81559abe3125ddb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff43e000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:33:42.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff43e000640 1 -- 172.21.15.5:0/1782085563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4400c5070 con 0x5589dd3d39a0 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff43e000640 1 -- 172.21.15.5:0/1782085563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7ff4400f9470 con 0x5589dd3d39a0 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1782085563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff44c0050d0 con 0x5589dd3d39a0 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff43e000640 1 -- 172.21.15.5:0/1782085563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7ff4400f4ed0 con 0x5589dd3d39a0 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 10 client.10923 fetch_fsmap learned FSMap version 160 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1782085563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x5589dd1a3f50 con 0x5589dd3d39a0 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff43e000640 1 -- 172.21.15.5:0/1782085563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c0050d0 con 0x5589dd3d39a0 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff43e000640 1 -- 172.21.15.5:0/1782085563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7ff4400eff70 con 0x5589dd3d39a0 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 10 client.10923 fetch_fsmap finished waiting for FSMap version 160 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 10 client.10923 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.d 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 20 client.10923 populate_metadata read hostname 'smithi005' 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5589dd3b5d30 0x5589dd3b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 4 client.10923 mds_command: new command op to 10740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1782085563 --> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589dd171e10 con 0x5589dd3b5d30 2024-08-18T22:33:42.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff458e00640 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5589dd3b5d30 0x5589dd3b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff458e00640 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5589dd3b5d30 0x5589dd3b6110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc2c4f4e9167280c server_cookie=67ca9dc1af4d5124 in_seq=0 out_seq=0 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff43e000640 10 client.10923 ms_handle_connect on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff43e000640 1 -- 172.21.15.5:0/1782085563 <== mds.0 v2:172.21.15.117:6834/3939158605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5589dd171e10 con 0x5589dd3b5d30 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff43e000640 10 client.10923 handle_command_reply: tid=0 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 client.10923 shutdown 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1782085563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d39a0 msgr2=0x5589dd38f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d39a0 0x5589dd38f030 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7ff44001a110 tx=0x7ff4400f0500 comp rx=0 tx=0).stop 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1782085563 shutdown_connections 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5589dd3b5d30 0x5589dd3b6110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d42c0 0x5589dd38f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d39a0 0x5589dd38f030 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1782085563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd387500 0x5589dd3b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff43e000640 0 client.10923 ms_handle_reset on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:42.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.242+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1782085563 >> 172.21.15.5:0/1782085563 conn(0x5589dd381010 msgr2=0x5589dd3866c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.246+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1782085563 shutdown_connections 2024-08-18T22:33:42.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.246+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1782085563 wait complete. 2024-08-18T22:33:42.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.246+0000 7ff45ebf3000 20 client.10923 trim_cache size 0 max 16384 2024-08-18T22:33:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff45ebf3000 1 Processor -- start 2024-08-18T22:33:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff45ebf3000 1 -- start start 2024-08-18T22:33:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd387500 0x5589dd442de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d39a0 0x5589dd443320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d42c0 0x5589dd443860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff454204370 con 0x5589dd3d42c0 2024-08-18T22:33:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff45415d2c0 con 0x5589dd387500 2024-08-18T22:33:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff4541fbf70 con 0x5589dd3d39a0 2024-08-18T22:33:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff459800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d42c0 0x5589dd443860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff459800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d42c0 0x5589dd443860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51342/0 (socket says 172.21.15.5:51342) 2024-08-18T22:33:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff459800640 1 -- 172.21.15.5:0/1595400443 learned_addr learned my addr 172.21.15.5:0/1595400443 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff458e00640 1 --2- 172.21.15.5:0/1595400443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd387500 0x5589dd442de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff453e00640 1 --2- 172.21.15.5:0/1595400443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d39a0 0x5589dd443320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff459800640 1 -- 172.21.15.5:0/1595400443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d39a0 msgr2=0x5589dd443320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff459800640 1 --2- 172.21.15.5:0/1595400443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d39a0 0x5589dd443320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff459800640 1 -- 172.21.15.5:0/1595400443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd387500 msgr2=0x5589dd442de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff459800640 1 --2- 172.21.15.5:0/1595400443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd387500 0x5589dd442de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.262+0000 7ff459800640 1 -- 172.21.15.5:0/1595400443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589dd259dd0 con 0x5589dd3d42c0 2024-08-18T22:33:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff459800640 1 --2- 172.21.15.5:0/1595400443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d42c0 0x5589dd443860 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7ff44c017040 tx=0x7ff44c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b9a312681dfce5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff448c00640 1 -- 172.21.15.5:0/1595400443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c019040 con 0x5589dd3d42c0 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff448c00640 1 -- 172.21.15.5:0/1595400443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c005410 con 0x5589dd3d42c0 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff448c00640 1 -- 172.21.15.5:0/1595400443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c00e960 con 0x5589dd3d42c0 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1595400443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d42c0 msgr2=0x5589dd443860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1595400443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d42c0 0x5589dd443860 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7ff44c017040 tx=0x7ff44c00a000 comp rx=0 tx=0).stop 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1595400443 shutdown_connections 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1595400443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd3d42c0 0x5589dd443860 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1595400443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d39a0 0x5589dd443320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/1595400443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd387500 0x5589dd442de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1595400443 >> 172.21.15.5:0/1595400443 conn(0x5589dd381010 msgr2=0x5589dd3b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1595400443 shutdown_connections 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 -- 172.21.15.5:0/1595400443 wait complete. 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 -- start start 2024-08-18T22:33:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 Processor -- start 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd446c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd3d39a0 0x5589dd4471c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d42c0 0x5589dd447700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5589dd191b50 con 0x5589dd387500 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff45415cc70 con 0x5589dd3d39a0 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x5589dd294240 con 0x5589dd3d42c0 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff45ebf3000 10 client.0 _ll_register_callbacks cb 0x7ff440006ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff458e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd446c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff458e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd446c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51346/0 (socket says 172.21.15.5:51346) 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff458e00640 1 -- 172.21.15.5:0/396509734 learned_addr learned my addr 172.21.15.5:0/396509734 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff453e00640 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd3d39a0 0x5589dd4471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff459800640 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d42c0 0x5589dd447700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff458e00640 1 -- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d42c0 msgr2=0x5589dd447700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff458e00640 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d42c0 0x5589dd447700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff458e00640 1 -- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd3d39a0 msgr2=0x5589dd4471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff458e00640 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd3d39a0 0x5589dd4471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff458e00640 1 -- 172.21.15.5:0/396509734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589dd16acd0 con 0x5589dd387500 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff459800640 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d42c0 0x5589dd447700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff458e00640 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd446c80 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7ff45415bbd0 tx=0x7ff444001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc5469a8229d72d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.266+0000 7ff43e000640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff43e000640 1 -- 172.21.15.5:0/396509734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44402f020 con 0x5589dd387500 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff43e000640 1 -- 172.21.15.5:0/396509734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6101+0+0 (secure 0 0 0) 0x7ff444010040 con 0x5589dd387500 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 -- 172.21.15.5:0/396509734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff44c005410 con 0x5589dd387500 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff43e000640 1 -- 172.21.15.5:0/396509734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7ff444039050 con 0x5589dd387500 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 10 client.10929 fetch_fsmap learned FSMap version 160 2024-08-18T22:33:42.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 -- 172.21.15.5:0/396509734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x5589dd17d320 con 0x5589dd387500 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff43e000640 1 -- 172.21.15.5:0/396509734 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c005410 con 0x5589dd387500 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff43e000640 1 -- 172.21.15.5:0/396509734 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7ff44403c020 con 0x5589dd387500 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 10 client.10929 fetch_fsmap finished waiting for FSMap version 160 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 10 client.10929 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.d 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 20 client.10929 populate_metadata read hostname 'smithi005' 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5589dd3e60b0 0x5589dd3e64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 4 client.10929 mds_command: new command op to 10740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 -- 172.21.15.5:0/396509734 --> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5589dd1e4c20 con 0x5589dd3e60b0 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff453e00640 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5589dd3e60b0 0x5589dd3e64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff453e00640 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5589dd3e60b0 0x5589dd3e64c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4850a3822b25222 server_cookie=7248514a0a821adc in_seq=0 out_seq=0 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff43e000640 10 client.10929 ms_handle_connect on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff43e000640 1 -- 172.21.15.5:0/396509734 <== mds.0 v2:172.21.15.117:6834/3939158605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x5589dd1e4c20 con 0x5589dd3e60b0 2024-08-18T22:33:42.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff43e000640 10 client.10929 handle_command_reply: tid=0 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 client.10929 shutdown 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 -- 172.21.15.5:0/396509734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 msgr2=0x5589dd446c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd446c80 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7ff45415bbd0 tx=0x7ff444001260 comp rx=0 tx=0).stop 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 -- 172.21.15.5:0/396509734 shutdown_connections 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x5589dd3e60b0 0x5589dd3e64c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5589dd3d42c0 0x5589dd447700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5589dd3d39a0 0x5589dd4471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 --2- 172.21.15.5:0/396509734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589dd387500 0x5589dd446c80 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff43e000640 0 client.10929 ms_handle_reset on v2:172.21.15.117:6834/3939158605 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 -- 172.21.15.5:0/396509734 >> 172.21.15.5:0/396509734 conn(0x5589dd381010 msgr2=0x5589dd3d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 -- 172.21.15.5:0/396509734 shutdown_connections 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 1 -- 172.21.15.5:0/396509734 wait complete. 2024-08-18T22:33:42.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45ebf3000 20 client.10929 trim_cache size 0 max 16384 2024-08-18T22:33:42.272 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:33:42.272 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-18T22:33:42.272 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-18T22:33:42.272 INFO:teuthology.orchestra.run.smithi005.stdout: "c29f3654-12ea-4091-8aa0-fb589861dc35": { 2024-08-18T22:33:42.272 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-18T22:33:42.272 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c29f3654-12ea-4091-8aa0-fb589861dc35", 2024-08-18T22:33:42.272 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,repair" 2024-08-18T22:33:42.272 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:42.272 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-18T22:33:42.272 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:33:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 -- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4340678c0 msgr2=0x7ff434069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4340678c0 0x7ff434069d80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff4440012f0 tx=0x7ff444009040 comp rx=0 tx=0).stop 2024-08-18T22:33:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 -- 172.21.15.5:0/619525885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff45409b080 msgr2=0x7ff45414f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff45409b080 0x7ff45414f740 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7ff44001ab90 tx=0x7ff440019280 comp rx=0 tx=0).stop 2024-08-18T22:33:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 -- 172.21.15.5:0/619525885 shutdown_connections 2024-08-18T22:33:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff4340678c0 0x7ff434069d80 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b1300 0x7ff45415f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff45409b080 0x7ff45414f740 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 --2- 172.21.15.5:0/619525885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff45409aca0 0x7ff4541542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 -- 172.21.15.5:0/619525885 >> 172.21.15.5:0/619525885 conn(0x7ff4540d2180 msgr2=0x7ff4540af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 -- 172.21.15.5:0/619525885 shutdown_connections 2024-08-18T22:33:42.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:33:42.270+0000 7ff45b800640 1 -- 172.21.15.5:0/619525885 wait complete. 2024-08-18T22:33:42.287 INFO:tasks.cephfs.filesystem:scrub status for tag:c29f3654-12ea-4091-8aa0-fb589861dc35 - {'path': '/', 'tag': 'c29f3654-12ea-4091-8aa0-fb589861dc35', 'options': 'recursive,repair'} 2024-08-18T22:33:54.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:33:54.635 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:34:12.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:12.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-08-18T22:34:12.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.445+0000 7f5b40a00640 1 Processor -- start 2024-08-18T22:34:12.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.445+0000 7f5b40a00640 1 -- start start 2024-08-18T22:34:12.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.449+0000 7f5b40a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b3c15b0c0 0x7f5b3c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.449+0000 7f5b40a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b3c0b31f0 con 0x7f5b3c0cf290 2024-08-18T22:34:12.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.449+0000 7f5b40a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b3c0b34d0 con 0x7f5b3c0b40c0 2024-08-18T22:34:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.449+0000 7f5b40a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5b3c0b3d70 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.449+0000 7f5b39e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b3c15b0c0 0x7f5b3c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.449+0000 7f5b3a800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5b3c0cf290 0x7f5b3c073140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32936/0 (socket says 172.21.15.5:32936) 2024-08-18T22:34:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.449+0000 7f5b3a800640 1 -- 172.21.15.5:0/3407566881 learned_addr learned my addr 172.21.15.5:0/3407566881 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.449+0000 7f5b39e00640 1 -- 172.21.15.5:0/3407566881 >> v1:172.21.15.117:6789/0 conn(0x7f5b3c0b40c0 legacy=0x7f5b3c072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.449+0000 7f5b39e00640 1 -- 172.21.15.5:0/3407566881 >> v1:172.21.15.5:6789/0 conn(0x7f5b3c0cf290 legacy=0x7f5b3c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.449+0000 7f5b39e00640 1 -- 172.21.15.5:0/3407566881 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3c0b37b0 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.449+0000 7f5b39e00640 1 --2- 172.21.15.5:0/3407566881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b3c15b0c0 0x7f5b3c06db80 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0097c0 tx=0x7f5b2c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d2cd7b961863ff server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b39400640 1 -- 172.21.15.5:0/3407566881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0b0070 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b39400640 1 -- 172.21.15.5:0/3407566881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2c0ab600 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b39400640 1 -- 172.21.15.5:0/3407566881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0ab9d0 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 -- 172.21.15.5:0/3407566881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b3c15b0c0 msgr2=0x7f5b3c06db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 --2- 172.21.15.5:0/3407566881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b3c15b0c0 0x7f5b3c06db80 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0097c0 tx=0x7f5b2c01c350 comp rx=0 tx=0).stop 2024-08-18T22:34:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 -- 172.21.15.5:0/3407566881 shutdown_connections 2024-08-18T22:34:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 --2- 172.21.15.5:0/3407566881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b3c15b0c0 0x7f5b3c06db80 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 -- 172.21.15.5:0/3407566881 >> 172.21.15.5:0/3407566881 conn(0x7f5b3c0b1dc0 msgr2=0x7f5b3c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 -- 172.21.15.5:0/3407566881 shutdown_connections 2024-08-18T22:34:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 -- 172.21.15.5:0/3407566881 wait complete. 2024-08-18T22:34:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 Processor -- start 2024-08-18T22:34:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 -- start start 2024-08-18T22:34:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b3c0b40c0 0x7f5b3c151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b3c0cf290 0x7f5b3c147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b3c15b0c0 0x7f5b3c147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c0b48e0 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c15b4a0 con 0x7f5b3c0cf290 2024-08-18T22:34:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b40a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3c148620 con 0x7f5b3c0b40c0 2024-08-18T22:34:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b3a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b3c15b0c0 0x7f5b3c147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b3a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b3c15b0c0 0x7f5b3c147840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43662/0 (socket says 172.21.15.5:43662) 2024-08-18T22:34:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b3a800640 1 -- 172.21.15.5:0/1995966426 learned_addr learned my addr 172.21.15.5:0/1995966426 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b39e00640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b3c0b40c0 0x7f5b3c151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.453+0000 7f5b31400640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b3c0cf290 0x7f5b3c147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b3a800640 1 -- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b3c0b40c0 msgr2=0x7f5b3c151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b3a800640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b3c0b40c0 0x7f5b3c151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b3a800640 1 -- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b3c0cf290 msgr2=0x7f5b3c147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b3a800640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b3c0cf290 0x7f5b3c147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b3a800640 1 -- 172.21.15.5:0/1995966426 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3c148060 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b3a800640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b3c15b0c0 0x7f5b3c147840 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400cbf0 tx=0x7f5b3400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b32a00640 1 -- 172.21.15.5:0/1995966426 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34017070 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b32a00640 1 -- 172.21.15.5:0/1995966426 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b3400ad40 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b32a00640 1 -- 172.21.15.5:0/1995966426 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34012600 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b40a00640 1 -- 172.21.15.5:0/1995966426 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3c148340 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b40a00640 1 -- 172.21.15.5:0/1995966426 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b3c14f0e0 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b32a00640 1 -- 172.21.15.5:0/1995966426 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b3401a070 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b32a00640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b180678c0 0x7f5b18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.457+0000 7f5b32a00640 1 -- 172.21.15.5:0/1995966426 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f5b34085b40 con 0x7f5b3c15b0c0 2024-08-18T22:34:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 Processor -- start 2024-08-18T22:34:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b39e00640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b180678c0 0x7f5b18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 -- start start 2024-08-18T22:34:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b39e00640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b180678c0 0x7f5b18069d80 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0ad000 tx=0x7f5b2c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d2e00 0x55ab3b6d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b6863d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 0x55ab3b686cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ab3b56bae0 con 0x55ab3b6d2e00 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ab3b557ba0 con 0x55ab3b686910 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ab3b4d24f0 con 0x55ab3b6d3720 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b39e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d2e00 0x55ab3b6d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b39e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d2e00 0x55ab3b6d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43666/0 (socket says 172.21.15.5:43666) 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b39e00640 1 -- 172.21.15.5:0/3755869529 learned_addr learned my addr 172.21.15.5:0/3755869529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b31400640 1 --2- 172.21.15.5:0/3755869529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b6863d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b39e00640 1 -- 172.21.15.5:0/3755869529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 msgr2=0x55ab3b6863d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b39e00640 1 --2- 172.21.15.5:0/3755869529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b6863d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b39e00640 1 -- 172.21.15.5:0/3755869529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 msgr2=0x55ab3b686cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b3a800640 1 --2- 172.21.15.5:0/3755869529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 0x55ab3b686cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b39e00640 1 --2- 172.21.15.5:0/3755869529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 0x55ab3b686cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b39e00640 1 -- 172.21.15.5:0/3755869529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab3b472a90 con 0x55ab3b6d2e00 2024-08-18T22:34:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b31400640 1 --2- 172.21.15.5:0/3755869529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b6863d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:34:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b3a800640 1 --2- 172.21.15.5:0/3755869529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 0x55ab3b686cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:34:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b39e00640 1 --2- 172.21.15.5:0/3755869529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d2e00 0x55ab3b6d31e0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0ae040 tx=0x7f5b2c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9275db82a5a528a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b2aa00640 1 -- 172.21.15.5:0/3755869529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0b0040 con 0x55ab3b6d2e00 2024-08-18T22:34:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b2aa00640 1 -- 172.21.15.5:0/3755869529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2c0c8070 con 0x55ab3b6d2e00 2024-08-18T22:34:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b2aa00640 1 -- 172.21.15.5:0/3755869529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0c3810 con 0x55ab3b6d2e00 2024-08-18T22:34:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 -- 172.21.15.5:0/3755869529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d2e00 msgr2=0x55ab3b6d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/3755869529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d2e00 0x55ab3b6d31e0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0ae040 tx=0x7f5b2c004740 comp rx=0 tx=0).stop 2024-08-18T22:34:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 -- 172.21.15.5:0/3755869529 shutdown_connections 2024-08-18T22:34:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/3755869529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 0x55ab3b686cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/3755869529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b6863d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/3755869529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d2e00 0x55ab3b6d31e0 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 -- 172.21.15.5:0/3755869529 >> 172.21.15.5:0/3755869529 conn(0x55ab3b67c010 msgr2=0x55ab3b6b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 -- 172.21.15.5:0/3755869529 shutdown_connections 2024-08-18T22:34:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.461+0000 7f5b43fbf000 1 -- 172.21.15.5:0/3755869529 wait complete. 2024-08-18T22:34:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 -- start start 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 Processor -- start 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b6b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b6d2e00 0x55ab3b6b8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b6b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ab3b4ce4b0 con 0x55ab3b686910 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ab3b48cb50 con 0x55ab3b6d2e00 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ab3b473d00 con 0x55ab3b6d3720 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 10 client.0 _ll_register_callbacks cb 0x55ab3b66ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b39e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b6b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b39e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b6b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43680/0 (socket says 172.21.15.5:43680) 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b39e00640 1 -- 172.21.15.5:0/2681075066 learned_addr learned my addr 172.21.15.5:0/2681075066 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b31400640 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b6d2e00 0x55ab3b6b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b3a800640 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b6b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b39e00640 1 -- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 msgr2=0x55ab3b6b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b39e00640 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b6b8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b39e00640 1 -- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b6d2e00 msgr2=0x55ab3b6b8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b39e00640 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b6d2e00 0x55ab3b6b8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b39e00640 1 -- 172.21.15.5:0/2681075066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab3b48b060 con 0x55ab3b686910 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b3a800640 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b6b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b39e00640 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b6b34a0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0ae040 tx=0x7f5b2c01ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d96fca3d0ee5a01 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b1f400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b1f400640 1 -- 172.21.15.5:0/2681075066 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0b0040 con 0x55ab3b686910 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b1f400640 1 -- 172.21.15.5:0/2681075066 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f5b2c0d7cc0 con 0x55ab3b686910 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 -- 172.21.15.5:0/2681075066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b2c0c8070 con 0x55ab3b686910 2024-08-18T22:34:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b1f400640 1 -- 172.21.15.5:0/2681075066 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7f5b2c0c39a0 con 0x55ab3b686910 2024-08-18T22:34:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 10 client.10944 fetch_fsmap learned FSMap version 160 2024-08-18T22:34:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 -- 172.21.15.5:0/2681075066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x55ab3b49ef50 con 0x55ab3b686910 2024-08-18T22:34:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b1f400640 1 -- 172.21.15.5:0/2681075066 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2c0c8070 con 0x55ab3b686910 2024-08-18T22:34:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b1f400640 1 -- 172.21.15.5:0/2681075066 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7f5b2c0c3b40 con 0x55ab3b686910 2024-08-18T22:34:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 10 client.10944 fetch_fsmap finished waiting for FSMap version 160 2024-08-18T22:34:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 10 client.10944 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.d 2024-08-18T22:34:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 20 client.10944 populate_metadata read hostname 'smithi005' 2024-08-18T22:34:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ab3b6b9be0 0x55ab3b6e50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 4 client.10944 mds_command: new command op to 10740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T22:34:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b43fbf000 1 -- 172.21.15.5:0/2681075066 --> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab3b46ce10 con 0x55ab3b6b9be0 2024-08-18T22:34:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.465+0000 7f5b31400640 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ab3b6b9be0 0x55ab3b6e50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b31400640 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ab3b6b9be0 0x55ab3b6e50c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf16ef63f95b943 server_cookie=19f60a88e88382e2 in_seq=0 out_seq=0 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b1f400640 10 client.10944 ms_handle_connect on v2:172.21.15.117:6834/3939158605 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b1f400640 1 -- 172.21.15.5:0/2681075066 <== mds.0 v2:172.21.15.117:6834/3939158605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab3b46ce10 con 0x55ab3b6b9be0 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b1f400640 10 client.10944 handle_command_reply: tid=0 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 1 client.10944 shutdown 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 1 -- 172.21.15.5:0/2681075066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 msgr2=0x55ab3b6b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b6b34a0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0ae040 tx=0x7f5b2c01ab90 comp rx=0 tx=0).stop 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 1 -- 172.21.15.5:0/2681075066 shutdown_connections 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ab3b6b9be0 0x55ab3b6e50c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b6b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b6d2e00 0x55ab3b6b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/2681075066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b6b34a0 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b1f400640 0 client.10944 ms_handle_reset on v2:172.21.15.117:6834/3939158605 2024-08-18T22:34:12.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 1 -- 172.21.15.5:0/2681075066 >> 172.21.15.5:0/2681075066 conn(0x55ab3b67c010 msgr2=0x55ab3b6b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:12.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 1 -- 172.21.15.5:0/2681075066 shutdown_connections 2024-08-18T22:34:12.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 1 -- 172.21.15.5:0/2681075066 wait complete. 2024-08-18T22:34:12.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.469+0000 7f5b43fbf000 20 client.10944 trim_cache size 0 max 16384 2024-08-18T22:34:12.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.485+0000 7f5b43fbf000 1 Processor -- start 2024-08-18T22:34:12.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.485+0000 7f5b43fbf000 1 -- start start 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 0x55ab3b7427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d2e00 0x55ab3b742ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d3720 0x55ab3b743220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c1ffe30 con 0x55ab3b6d3720 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c1fee80 con 0x55ab3b686910 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3c14e0e0 con 0x55ab3b6d2e00 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b3a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d3720 0x55ab3b743220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b3a800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d3720 0x55ab3b743220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43690/0 (socket says 172.21.15.5:43690) 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b3a800640 1 -- 172.21.15.5:0/1588966415 learned_addr learned my addr 172.21.15.5:0/1588966415 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b31400640 1 --2- 172.21.15.5:0/1588966415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d2e00 0x55ab3b742ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b3a800640 1 -- 172.21.15.5:0/1588966415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d2e00 msgr2=0x55ab3b742ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b39e00640 1 --2- 172.21.15.5:0/1588966415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 0x55ab3b7427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b3a800640 1 --2- 172.21.15.5:0/1588966415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d2e00 0x55ab3b742ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b3a800640 1 -- 172.21.15.5:0/1588966415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 msgr2=0x55ab3b7427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b3a800640 1 --2- 172.21.15.5:0/1588966415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 0x55ab3b7427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b3a800640 1 -- 172.21.15.5:0/1588966415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab3b554dd0 con 0x55ab3b6d3720 2024-08-18T22:34:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b31400640 1 --2- 172.21.15.5:0/1588966415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d2e00 0x55ab3b742ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:34:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b39e00640 1 --2- 172.21.15.5:0/1588966415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 0x55ab3b7427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:34:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b3a800640 1 --2- 172.21.15.5:0/1588966415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d3720 0x55ab3b743220 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f5b34005c30 tx=0x7f5b34055f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefc31e962744ecd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b2a000640 1 -- 172.21.15.5:0/1588966415 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34053ec0 con 0x55ab3b6d3720 2024-08-18T22:34:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b2a000640 1 -- 172.21.15.5:0/1588966415 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b34054120 con 0x55ab3b6d3720 2024-08-18T22:34:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b2a000640 1 -- 172.21.15.5:0/1588966415 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3405e4c0 con 0x55ab3b6d3720 2024-08-18T22:34:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1588966415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d3720 msgr2=0x55ab3b743220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/1588966415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d3720 0x55ab3b743220 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f5b34005c30 tx=0x7f5b34055f60 comp rx=0 tx=0).stop 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1588966415 shutdown_connections 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/1588966415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b6d3720 0x55ab3b743220 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/1588966415 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d2e00 0x55ab3b742ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/1588966415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b686910 0x55ab3b7427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1588966415 >> 172.21.15.5:0/1588966415 conn(0x55ab3b67c010 msgr2=0x55ab3b6e0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1588966415 shutdown_connections 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1588966415 wait complete. 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 -- start start 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.489+0000 7f5b43fbf000 1 Processor -- start 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b746640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b6d2e00 0x55ab3b746b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b7470c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ab3b4d1800 con 0x55ab3b686910 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ab3b49d7f0 con 0x55ab3b6d2e00 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x55ab3b58f240 con 0x55ab3b6d3720 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 10 client.0 _ll_register_callbacks cb 0x7f5b2c0ab7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b39e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b746640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b39e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b746640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43704/0 (socket says 172.21.15.5:43704) 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b39e00640 1 -- 172.21.15.5:0/1399092757 learned_addr learned my addr 172.21.15.5:0/1399092757 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b31400640 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b6d2e00 0x55ab3b746b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b3a800640 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b7470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b39e00640 1 -- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 msgr2=0x55ab3b7470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b39e00640 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b7470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b39e00640 1 -- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b6d2e00 msgr2=0x55ab3b746b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b39e00640 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b6d2e00 0x55ab3b746b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b39e00640 1 -- 172.21.15.5:0/1399092757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab3b465cd0 con 0x55ab3b686910 2024-08-18T22:34:12.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b31400640 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b6d2e00 0x55ab3b746b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b39e00640 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b746640 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c01c180 tx=0x7f5b2c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997cc7fab869a88a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b1f400640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b1f400640 1 -- 172.21.15.5:0/1399092757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0b0040 con 0x55ab3b686910 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1399092757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b34054120 con 0x55ab3b686910 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b1f400640 1 -- 172.21.15.5:0/1399092757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f5b2c0e0630 con 0x55ab3b686910 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b1f400640 1 -- 172.21.15.5:0/1399092757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=160) ==== 24+0+0 (secure 0 0 0) 0x7f5b2c0f0050 con 0x55ab3b686910 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 10 client.10950 fetch_fsmap learned FSMap version 160 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1399092757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=160,monmap=2+}) -- 0x55ab3b478320 con 0x55ab3b686910 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b1f400640 1 -- 172.21.15.5:0/1399092757 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b34054120 con 0x55ab3b686910 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b1f400640 1 -- 172.21.15.5:0/1399092757 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 160) ==== 3502+0+0 (secure 0 0 0) 0x7f5b2c0e0830 con 0x55ab3b686910 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 10 client.10950 fetch_fsmap finished waiting for FSMap version 160 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 10 client.10950 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.d 2024-08-18T22:34:12.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 20 client.10950 populate_metadata read hostname 'smithi005' 2024-08-18T22:34:12.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ab3b6e7850 0x55ab3b6e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 4 client.10950 mds_command: new command op to 10740 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-18T22:34:12.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1399092757 --> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ab3b4dfc20 con 0x55ab3b6e7850 2024-08-18T22:34:12.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b31400640 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ab3b6e7850 0x55ab3b6e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b31400640 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ab3b6e7850 0x55ab3b6e7c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce483230129075f5 server_cookie=7c8b9942efc95e5d in_seq=0 out_seq=0 2024-08-18T22:34:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b1f400640 10 client.10950 ms_handle_connect on v2:172.21.15.117:6834/3939158605 2024-08-18T22:34:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b1f400640 1 -- 172.21.15.5:0/1399092757 <== mds.0 v2:172.21.15.117:6834/3939158605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ab3b4dfc20 con 0x55ab3b6e7850 2024-08-18T22:34:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b1f400640 10 client.10950 handle_command_reply: tid=0 2024-08-18T22:34:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 client.10950 shutdown 2024-08-18T22:34:12.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1399092757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 msgr2=0x55ab3b746640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.493+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b746640 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c01c180 tx=0x7f5b2c009190 comp rx=0 tx=0).stop 2024-08-18T22:34:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1399092757 shutdown_connections 2024-08-18T22:34:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:6834/3939158605,v1:172.21.15.117:6836/3939158605] conn(0x55ab3b6e7850 0x55ab3b6e7c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ab3b6d3720 0x55ab3b7470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ab3b6d2e00 0x55ab3b746b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b43fbf000 1 --2- 172.21.15.5:0/1399092757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ab3b686910 0x55ab3b746640 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b1f400640 0 client.10950 ms_handle_reset on v2:172.21.15.117:6834/3939158605 2024-08-18T22:34:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1399092757 >> 172.21.15.5:0/1399092757 conn(0x55ab3b67c010 msgr2=0x55ab3b6853c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1399092757 shutdown_connections 2024-08-18T22:34:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b43fbf000 1 -- 172.21.15.5:0/1399092757 wait complete. 2024-08-18T22:34:12.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b43fbf000 20 client.10950 trim_cache size 0 max 16384 2024-08-18T22:34:12.498 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:34:12.498 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-18T22:34:12.498 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {} 2024-08-18T22:34:12.498 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:34:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 -- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b180678c0 msgr2=0x7f5b18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b180678c0 0x7f5b18069d80 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0ad000 tx=0x7f5b2c0a6000 comp rx=0 tx=0).stop 2024-08-18T22:34:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 -- 172.21.15.5:0/1995966426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b3c15b0c0 msgr2=0x7f5b3c147840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b3c15b0c0 0x7f5b3c147840 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400cbf0 tx=0x7f5b3400a430 comp rx=0 tx=0).stop 2024-08-18T22:34:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 -- 172.21.15.5:0/1995966426 shutdown_connections 2024-08-18T22:34:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f5b180678c0 0x7f5b18069d80 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b3c15b0c0 0x7f5b3c147840 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b3c0cf290 0x7f5b3c147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 --2- 172.21.15.5:0/1995966426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b3c0b40c0 0x7f5b3c151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 -- 172.21.15.5:0/1995966426 >> 172.21.15.5:0/1995966426 conn(0x7f5b3c0b1dc0 msgr2=0x7f5b3c0afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:12.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 -- 172.21.15.5:0/1995966426 shutdown_connections 2024-08-18T22:34:12.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.497+0000 7f5b40a00640 1 -- 172.21.15.5:0/1995966426 wait complete. 2024-08-18T22:34:12.513 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-18T22:34:12.514 DEBUG:teuthology.orchestra.run.smithi005:> stdin-killer -- python3 -c ' 2024-08-18T22:34:12.514 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-18T22:34:12.514 DEBUG:teuthology.orchestra.run.smithi005:> import stat 2024-08-18T22:34:12.514 DEBUG:teuthology.orchestra.run.smithi005:> import json 2024-08-18T22:34:12.514 DEBUG:teuthology.orchestra.run.smithi005:> import sys 2024-08-18T22:34:12.514 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:34:12.514 DEBUG:teuthology.orchestra.run.smithi005:> try: 2024-08-18T22:34:12.514 DEBUG:teuthology.orchestra.run.smithi005:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-08-18T22:34:12.514 DEBUG:teuthology.orchestra.run.smithi005:> except OSError as e: 2024-08-18T22:34:12.514 DEBUG:teuthology.orchestra.run.smithi005:> sys.exit(e.errno) 2024-08-18T22:34:12.515 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-18T22:34:12.515 DEBUG:teuthology.orchestra.run.smithi005:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-08-18T22:34:12.515 DEBUG:teuthology.orchestra.run.smithi005:> print(json.dumps( 2024-08-18T22:34:12.515 DEBUG:teuthology.orchestra.run.smithi005:> dict([(a, getattr(s, a)) for a in attrs]), 2024-08-18T22:34:12.515 DEBUG:teuthology.orchestra.run.smithi005:> indent=2)) 2024-08-18T22:34:12.515 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-18T22:34:12.587 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:34:12.588 INFO:teuthology.orchestra.run.smithi005.stdout: "st_mode": 33204, 2024-08-18T22:34:12.588 INFO:teuthology.orchestra.run.smithi005.stdout: "st_ino": 1099511627777, 2024-08-18T22:34:12.588 INFO:teuthology.orchestra.run.smithi005.stdout: "st_dev": 44, 2024-08-18T22:34:12.588 INFO:teuthology.orchestra.run.smithi005.stdout: "st_nlink": 1, 2024-08-18T22:34:12.588 INFO:teuthology.orchestra.run.smithi005.stdout: "st_uid": 1000, 2024-08-18T22:34:12.588 INFO:teuthology.orchestra.run.smithi005.stdout: "st_gid": 1271, 2024-08-18T22:34:12.588 INFO:teuthology.orchestra.run.smithi005.stdout: "st_size": 6291456, 2024-08-18T22:34:12.588 INFO:teuthology.orchestra.run.smithi005.stdout: "st_atime": 1724020420.8061342, 2024-08-18T22:34:12.588 INFO:teuthology.orchestra.run.smithi005.stdout: "st_mtime": 1724020420.8381338, 2024-08-18T22:34:12.588 INFO:teuthology.orchestra.run.smithi005.stdout: "st_ctime": 1724020420.8381338 2024-08-18T22:34:12.588 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:34:12.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:34:12.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:34:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd00f200640 1 Processor -- start 2024-08-18T22:34:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd00f200640 1 -- start start 2024-08-18T22:34:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd00f200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0080b54c0 0x7fd008071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd00f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080cbed0 0x7fd0080cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd00f200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd008071c80 con 0x7fd00806dd80 2024-08-18T22:34:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd00f200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd0080cba40 con 0x7fd0080b54c0 2024-08-18T22:34:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd00f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd008071f60 con 0x7fd0080cbed0 2024-08-18T22:34:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd007e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0080b54c0 0x7fd008071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd007e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0080b54c0 0x7fd008071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43712/0 (socket says 172.21.15.5:43712) 2024-08-18T22:34:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd007e00640 1 -- 172.21.15.5:0/3084460203 learned_addr learned my addr 172.21.15.5:0/3084460203 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd00d200640 1 --2- 172.21.15.5:0/3084460203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080cbed0 0x7fd0080cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd007e00640 1 -- 172.21.15.5:0/3084460203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080cbed0 msgr2=0x7fd0080cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd007e00640 1 --2- 172.21.15.5:0/3084460203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080cbed0 0x7fd0080cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd007e00640 1 -- 172.21.15.5:0/3084460203 >> v1:172.21.15.117:6789/0 conn(0x7fd00806dd80 legacy=0x7fd0080b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.789+0000 7fd007e00640 1 -- 172.21.15.5:0/3084460203 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0080cb6d0 con 0x7fd0080b54c0 2024-08-18T22:34:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd007e00640 1 --2- 172.21.15.5:0/3084460203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0080b54c0 0x7fd008071580 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009870 tx=0x7fcff801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798121cf33a2b95c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd006a00640 1 -- 172.21.15.5:0/3084460203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff80b5070 con 0x7fd0080b54c0 2024-08-18T22:34:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd006a00640 1 -- 172.21.15.5:0/3084460203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff80a8a50 con 0x7fd0080b54c0 2024-08-18T22:34:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd006a00640 1 -- 172.21.15.5:0/3084460203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff80a8e20 con 0x7fd0080b54c0 2024-08-18T22:34:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd00f200640 1 -- 172.21.15.5:0/3084460203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0080b54c0 msgr2=0x7fd008071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd00f200640 1 --2- 172.21.15.5:0/3084460203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0080b54c0 0x7fd008071580 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009870 tx=0x7fcff801ed50 comp rx=0 tx=0).stop 2024-08-18T22:34:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd00f200640 1 -- 172.21.15.5:0/3084460203 shutdown_connections 2024-08-18T22:34:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd00f200640 1 --2- 172.21.15.5:0/3084460203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080cbed0 0x7fd0080cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd00f200640 1 --2- 172.21.15.5:0/3084460203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0080b54c0 0x7fd008071580 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd00f200640 1 -- 172.21.15.5:0/3084460203 >> 172.21.15.5:0/3084460203 conn(0x7fd0080b3eb0 msgr2=0x7fd0080b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd00f200640 1 -- 172.21.15.5:0/3084460203 shutdown_connections 2024-08-18T22:34:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.793+0000 7fd00f200640 1 -- 172.21.15.5:0/3084460203 wait complete. 2024-08-18T22:34:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00f200640 1 Processor -- start 2024-08-18T22:34:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00f200640 1 -- start start 2024-08-18T22:34:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd00806dd80 0x7fd0081f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00f200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0080b54c0 0x7fd00815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080cbed0 0x7fd0080d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00f200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd0081481a0 con 0x7fd0080b54c0 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd008148020 con 0x7fd00806dd80 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd0080cc8a0 con 0x7fd0080cbed0 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd007400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0080b54c0 0x7fd00815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd007400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0080b54c0 0x7fd00815dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43720/0 (socket says 172.21.15.5:43720) 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd007400640 1 -- 172.21.15.5:0/4191760651 learned_addr learned my addr 172.21.15.5:0/4191760651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00d200640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080cbed0 0x7fd0080d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd007e00640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd00806dd80 0x7fd0081f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd007400640 1 -- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080cbed0 msgr2=0x7fd0080d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd007400640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080cbed0 0x7fd0080d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd007400640 1 -- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd00806dd80 msgr2=0x7fd0081f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd007400640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd00806dd80 0x7fd0081f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:12.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd007400640 1 -- 172.21.15.5:0/4191760651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0080cf8a0 con 0x7fd0080b54c0 2024-08-18T22:34:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd007e00640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd00806dd80 0x7fd0081f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd007400640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0080b54c0 0x7fd00815dee0 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c420 tx=0x7fcff400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fcfffe00640 1 -- 172.21.15.5:0/4191760651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff40052d0 con 0x7fd0080b54c0 2024-08-18T22:34:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fcfffe00640 1 -- 172.21.15.5:0/4191760651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff4005470 con 0x7fd0080b54c0 2024-08-18T22:34:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00f200640 1 -- 172.21.15.5:0/4191760651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0081e7310 con 0x7fd0080b54c0 2024-08-18T22:34:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fcfffe00640 1 -- 172.21.15.5:0/4191760651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4007260 con 0x7fd0080b54c0 2024-08-18T22:34:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00f200640 1 -- 172.21.15.5:0/4191760651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0081e78d0 con 0x7fd0080b54c0 2024-08-18T22:34:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.797+0000 7fd00f200640 1 -- 172.21.15.5:0/4191760651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0080cc360 con 0x7fd0080b54c0 2024-08-18T22:34:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.801+0000 7fcfffe00640 1 -- 172.21.15.5:0/4191760651 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcff4007400 con 0x7fd0080b54c0 2024-08-18T22:34:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.801+0000 7fcfffe00640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe80678c0 0x7fcfe8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.801+0000 7fcfffe00640 1 -- 172.21.15.5:0/4191760651 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7fcff40853c0 con 0x7fd0080b54c0 2024-08-18T22:34:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.801+0000 7fd007e00640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe80678c0 0x7fcfe8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.801+0000 7fd007e00640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe80678c0 0x7fcfe8069d80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fcff80b2000 tx=0x7fcff8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:12.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:12.805+0000 7fcfffe00640 1 -- 172.21.15.5:0/4191760651 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fcff4055610 con 0x7fd0080b54c0 2024-08-18T22:34:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.005+0000 7fd00f200640 1 -- 172.21.15.5:0/4191760651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0080ce410 con 0x7fd0080b54c0 2024-08-18T22:34:13.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.005+0000 7fcfffe00640 1 -- 172.21.15.5:0/4191760651 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5234 (secure 0 0 0) 0x7fcff4059910 con 0x7fd0080b54c0 2024-08-18T22:34:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:13.004 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":160,"btime":"2024-08-18T22:33:36:585978+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1931701065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1931701065},{"type":"v1","addr":"172.21.15.117:6837","nonce":1931701065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10731,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/83313921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":83313921},{"type":"v1","addr":"172.21.15.5:6833","nonce":83313921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2593956905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2593956905},{"type":"v1","addr":"172.21.15.5:6835","nonce":2593956905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:33:32.949657+0000","modified":"2024-08-18T22:33:35.978872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10740":{"gid":10740,"name":"d","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6836/3939158605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3939158605},{"type":"v1","addr":"172.21.15.117:6836","nonce":3939158605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10740,"qdb_cluster":[10740]},"id":14}]} 2024-08-18T22:34:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 160 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 -- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe80678c0 msgr2=0x7fcfe8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe80678c0 0x7fcfe8069d80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fcff80b2000 tx=0x7fcff8008040 comp rx=0 tx=0).stop 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 -- 172.21.15.5:0/4191760651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0080b54c0 msgr2=0x7fd00815dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0080b54c0 0x7fd00815dee0 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c420 tx=0x7fcff400c8e0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 -- 172.21.15.5:0/4191760651 shutdown_connections 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fcfe80678c0 0x7fcfe8069d80 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0080cbed0 0x7fd0080d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0080b54c0 0x7fd00815dee0 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 --2- 172.21.15.5:0/4191760651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd00806dd80 0x7fd0081f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 -- 172.21.15.5:0/4191760651 >> 172.21.15.5:0/4191760651 conn(0x7fd0080b3eb0 msgr2=0x7fd0080b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 -- 172.21.15.5:0/4191760651 shutdown_connections 2024-08-18T22:34:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.009+0000 7fd00f200640 1 -- 172.21.15.5:0/4191760651 wait complete. 2024-08-18T22:34:13.027 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-08-18T22:34:13.204 INFO:teuthology.orchestra.run.smithi117.stdout:{"message":"","return_code":0} 2024-08-18T22:34:13.205 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-08-18T22:34:13.205 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-08-18T22:34:13.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.253+0000 7f2479249080 1 Processor -- start 2024-08-18T22:34:13.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.253+0000 7f2479249080 1 -- start start 2024-08-18T22:34:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8af0 0x557d7ced02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557d7cdf8ed0 0x557d7ced0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d7ce43a30 0x557d7ced2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557d7ce42b10 con 0x557d7cdf8af0 2024-08-18T22:34:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557d7cd4aaa0 con 0x557d7ce43a30 2024-08-18T22:34:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x557d7ce42db0 con 0x557d7cdf8ed0 2024-08-18T22:34:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2475800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8af0 0x557d7ced02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2475800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8af0 0x557d7ced02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43736/0 (socket says 172.21.15.5:43736) 2024-08-18T22:34:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2475800640 1 -- 172.21.15.5:0/479391253 learned_addr learned my addr 172.21.15.5:0/479391253 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2476200640 1 --2- 172.21.15.5:0/479391253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d7ce43a30 0x557d7ced2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2474e00640 1 --2- 172.21.15.5:0/479391253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557d7cdf8ed0 0x557d7ced0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2475800640 1 -- 172.21.15.5:0/479391253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557d7cdf8ed0 msgr2=0x557d7ced0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2475800640 1 --2- 172.21.15.5:0/479391253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557d7cdf8ed0 0x557d7ced0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2475800640 1 -- 172.21.15.5:0/479391253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d7ce43a30 msgr2=0x557d7ced2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2475800640 1 --2- 172.21.15.5:0/479391253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d7ce43a30 0x557d7ced2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2475800640 1 -- 172.21.15.5:0/479391253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7cd25950 con 0x557d7cdf8af0 2024-08-18T22:34:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2475800640 1 --2- 172.21.15.5:0/479391253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8af0 0x557d7ced02f0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f2468001e40 tx=0x7f246800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336aff481d905ada server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f246f400640 1 -- 172.21.15.5:0/479391253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468012020 con 0x557d7cdf8af0 2024-08-18T22:34:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f246f400640 1 -- 172.21.15.5:0/479391253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246800e690 con 0x557d7cdf8af0 2024-08-18T22:34:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f246f400640 1 -- 172.21.15.5:0/479391253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246800eae0 con 0x557d7cdf8af0 2024-08-18T22:34:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- 172.21.15.5:0/479391253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8af0 msgr2=0x557d7ced02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 --2- 172.21.15.5:0/479391253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8af0 0x557d7ced02f0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f2468001e40 tx=0x7f246800b790 comp rx=0 tx=0).stop 2024-08-18T22:34:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- 172.21.15.5:0/479391253 shutdown_connections 2024-08-18T22:34:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 --2- 172.21.15.5:0/479391253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d7ce43a30 0x557d7ced2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 --2- 172.21.15.5:0/479391253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557d7cdf8ed0 0x557d7ced0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 --2- 172.21.15.5:0/479391253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8af0 0x557d7ced02f0 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- 172.21.15.5:0/479391253 >> 172.21.15.5:0/479391253 conn(0x557d7cdfa720 msgr2=0x557d7ced1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- 172.21.15.5:0/479391253 shutdown_connections 2024-08-18T22:34:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- 172.21.15.5:0/479391253 wait complete. 2024-08-18T22:34:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 Processor -- start 2024-08-18T22:34:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- start start 2024-08-18T22:34:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d7cdf8af0 0x557d7cecf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8ed0 0x557d7ce28680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557d7ce43a30 0x557d7cec3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557d7ceb6b70 con 0x557d7cdf8ed0 2024-08-18T22:34:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557d7ce402d0 con 0x557d7cdf8af0 2024-08-18T22:34:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.257+0000 7f2479249080 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x557d7ceb6e10 con 0x557d7ce43a30 2024-08-18T22:34:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2474e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8ed0 0x557d7ce28680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2474e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8ed0 0x557d7ce28680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43752/0 (socket says 172.21.15.5:43752) 2024-08-18T22:34:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2474e00640 1 -- 172.21.15.5:0/3488571012 learned_addr learned my addr 172.21.15.5:0/3488571012 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2475800640 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d7cdf8af0 0x557d7cecf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2476200640 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557d7ce43a30 0x557d7cec3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2474e00640 1 -- 172.21.15.5:0/3488571012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557d7ce43a30 msgr2=0x557d7cec3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2474e00640 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557d7ce43a30 0x557d7cec3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2474e00640 1 -- 172.21.15.5:0/3488571012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d7cdf8af0 msgr2=0x557d7cecf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2474e00640 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557d7cdf8af0 0x557d7cecf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2474e00640 1 -- 172.21.15.5:0/3488571012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7ce28cb0 con 0x557d7cdf8ed0 2024-08-18T22:34:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2474e00640 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8ed0 0x557d7ce28680 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f246400a500 tx=0x7f246401a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f246e000640 1 -- 172.21.15.5:0/3488571012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24640b4040 con 0x557d7cdf8ed0 2024-08-18T22:34:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f246e000640 1 -- 172.21.15.5:0/3488571012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24640c0070 con 0x557d7cdf8ed0 2024-08-18T22:34:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f246e000640 1 -- 172.21.15.5:0/3488571012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24640bb660 con 0x557d7cdf8ed0 2024-08-18T22:34:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2479249080 1 -- 172.21.15.5:0/3488571012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d7ce28f50 con 0x557d7cdf8ed0 2024-08-18T22:34:13.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f2479249080 1 -- 172.21.15.5:0/3488571012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7ce29490 con 0x557d7cdf8ed0 2024-08-18T22:34:13.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f246e000640 1 -- 172.21.15.5:0/3488571012 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24640bb800 con 0x557d7cdf8ed0 2024-08-18T22:34:13.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f246e000640 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24580662a0 0x7f2458068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.261+0000 7f246e000640 1 -- 172.21.15.5:0/3488571012 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f24641231d0 con 0x557d7cdf8ed0 2024-08-18T22:34:13.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x557d7ced37b0 0x557d7ced3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 -- 172.21.15.5:0/3488571012 --> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] -- osd_op(unknown.0.0:1 30.7 30:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e206) -- 0x557d7ce29bd0 con 0x557d7ced37b0 2024-08-18T22:34:13.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2475800640 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24580662a0 0x7f2458068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2476200640 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x557d7ced37b0 0x557d7ced3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2476200640 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x557d7ced37b0 0x557d7ced3b90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:13.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2475800640 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24580662a0 0x7f2458068760 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f2468001e40 tx=0x7f2468009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:13.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2476200640 1 -- 172.21.15.5:0/3488571012 <== osd.2 v2:172.21.15.5:6800/3144131686 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f247000ab80 con 0x557d7ced37b0 2024-08-18T22:34:13.263 INFO:teuthology.orchestra.run.smithi005.stdout:Ysixmegssubdir 2024-08-18T22:34:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 -- 172.21.15.5:0/3488571012 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x557d7ced37b0 msgr2=0x557d7ced3b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x557d7ced37b0 0x557d7ced3b90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 -- 172.21.15.5:0/3488571012 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24580662a0 msgr2=0x7f2458068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f24580662a0 0x7f2458068760 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f2468001e40 tx=0x7f2468009000 comp rx=0 tx=0).stop 2024-08-18T22:34:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 -- 172.21.15.5:0/3488571012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8ed0 msgr2=0x557d7ce28680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 --2- 172.21.15.5:0/3488571012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d7cdf8ed0 0x557d7ce28680 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f246400a500 tx=0x7f246401a940 comp rx=0 tx=0).stop 2024-08-18T22:34:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2476200640 1 -- 172.21.15.5:0/3488571012 reap_dead start 2024-08-18T22:34:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 -- 172.21.15.5:0/3488571012 shutdown_connections 2024-08-18T22:34:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 -- 172.21.15.5:0/3488571012 >> 172.21.15.5:0/3488571012 conn(0x557d7cdfa720 msgr2=0x557d7ced00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 -- 172.21.15.5:0/3488571012 shutdown_connections 2024-08-18T22:34:13.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.265+0000 7f2479249080 1 -- 172.21.15.5:0/3488571012 wait complete. 2024-08-18T22:34:13.267 DEBUG:teuthology.orchestra.run.smithi005:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-08-18T22:34:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:error: stray data at end of buffer, offset 95 2024-08-18T22:34:13.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:34:13.371 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T22:34:13.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:34:13.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T22:34:13.578 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T22:34:13.578 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:34:13.578 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:34:13.578 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:34:13.587 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:34:13.587 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:34:13.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T22:34:13.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee9600640 1 Processor -- start 2024-08-18T22:34:13.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee9600640 1 -- start start 2024-08-18T22:34:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee9600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4ee415c360 0x7f4ee4160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee9600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ee415d290 0x7f4ee415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee9600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee415d9e0 con 0x7f4ee415c740 2024-08-18T22:34:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee9600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee415dcc0 con 0x7f4ee415d290 2024-08-18T22:34:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee9600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee415dfa0 con 0x7f4ee415c360 2024-08-18T22:34:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ee415d290 0x7f4ee415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee3400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4ee415d290 0x7f4ee415e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51040/0 (socket says 172.21.15.5:51040) 2024-08-18T22:34:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee3400640 1 -- 172.21.15.5:0/1073027316 learned_addr learned my addr 172.21.15.5:0/1073027316 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee2a00640 1 --2- 172.21.15.5:0/1073027316 >> v2:172.21.15.117:3300/0 conn(0x7f4ee415c360 0x7f4ee4160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee3400640 1 -- 172.21.15.5:0/1073027316 >> v2:172.21.15.117:3300/0 conn(0x7f4ee415c360 msgr2=0x7f4ee4160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee3400640 1 --2- 172.21.15.5:0/1073027316 >> v2:172.21.15.117:3300/0 conn(0x7f4ee415c360 0x7f4ee4160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee3400640 1 -- 172.21.15.5:0/1073027316 >> v1:172.21.15.117:6789/0 conn(0x7f4ee415c740 legacy=0x7f4ee415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee3400640 1 -- 172.21.15.5:0/1073027316 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee415e280 con 0x7f4ee415d290 2024-08-18T22:34:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.825+0000 7f4ee2a00640 1 --2- 172.21.15.5:0/1073027316 >> v2:172.21.15.117:3300/0 conn(0x7f4ee415c360 0x7f4ee4160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:13.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee3400640 1 --2- 172.21.15.5:0/1073027316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee415d290 0x7f4ee415e7a0 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40b3e60 tx=0x7f4edc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50717090cd661607 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:13.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee1600640 1 -- 172.21.15.5:0/1073027316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc0a56c0 con 0x7f4ee415d290 2024-08-18T22:34:13.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee1600640 1 -- 172.21.15.5:0/1073027316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc0a5860 con 0x7f4ee415d290 2024-08-18T22:34:13.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee1600640 1 -- 172.21.15.5:0/1073027316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc0a5c30 con 0x7f4ee415d290 2024-08-18T22:34:13.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee9600640 1 -- 172.21.15.5:0/1073027316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee415d290 msgr2=0x7f4ee415e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee9600640 1 --2- 172.21.15.5:0/1073027316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee415d290 0x7f4ee415e7a0 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40b3e60 tx=0x7f4edc01c9f0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee9600640 1 -- 172.21.15.5:0/1073027316 shutdown_connections 2024-08-18T22:34:13.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee9600640 1 --2- 172.21.15.5:0/1073027316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee415d290 0x7f4ee415e7a0 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee9600640 1 --2- 172.21.15.5:0/1073027316 >> v2:172.21.15.117:3300/0 conn(0x7f4ee415c360 0x7f4ee4160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee9600640 1 -- 172.21.15.5:0/1073027316 >> 172.21.15.5:0/1073027316 conn(0x7f4ee40b65f0 msgr2=0x7f4ee40b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:13.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee9600640 1 -- 172.21.15.5:0/1073027316 shutdown_connections 2024-08-18T22:34:13.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.829+0000 7f4ee9600640 1 -- 172.21.15.5:0/1073027316 wait complete. 2024-08-18T22:34:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee9600640 1 Processor -- start 2024-08-18T22:34:13.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee9600640 1 -- start start 2024-08-18T22:34:13.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee9600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee415c360 0x7f4ee4140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee9600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ee415c740 0x7f4ee40b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee9600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee415d290 0x7f4ee414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee9600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee415f8c0 con 0x7f4ee415c360 2024-08-18T22:34:13.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee9600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee415f740 con 0x7f4ee415d290 2024-08-18T22:34:13.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee9600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee415fa40 con 0x7f4ee415c740 2024-08-18T22:34:13.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee415c360 0x7f4ee4140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee415c360 0x7f4ee4140bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51042/0 (socket says 172.21.15.5:51042) 2024-08-18T22:34:13.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee2a00640 1 -- 172.21.15.5:0/636986179 learned_addr learned my addr 172.21.15.5:0/636986179 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:13.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee3400640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee415d290 0x7f4ee414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee2000640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ee415c740 0x7f4ee40b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee2a00640 1 -- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ee415c740 msgr2=0x7f4ee40b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee2a00640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ee415c740 0x7f4ee40b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee2a00640 1 -- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee415d290 msgr2=0x7f4ee414f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee2a00640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee415d290 0x7f4ee414f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee2a00640 1 -- 172.21.15.5:0/636986179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee40b1450 con 0x7f4ee415c360 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee2000640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ee415c740 0x7f4ee40b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee2a00640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee415c360 0x7f4ee4140bf0 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400e840 tx=0x7f4ed400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4edaa00640 1 -- 172.21.15.5:0/636986179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4017070 con 0x7f4ee415c360 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4edaa00640 1 -- 172.21.15.5:0/636986179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ed400c8d0 con 0x7f4ee415c360 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee9600640 1 -- 172.21.15.5:0/636986179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee40b1730 con 0x7f4ee415c360 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4edaa00640 1 -- 172.21.15.5:0/636986179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed400f040 con 0x7f4ee415c360 2024-08-18T22:34:13.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.833+0000 7f4ee9600640 1 -- 172.21.15.5:0/636986179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee414e880 con 0x7f4ee415c360 2024-08-18T22:34:13.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.837+0000 7f4ee9600640 1 -- 172.21.15.5:0/636986179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee4160680 con 0x7f4ee415c360 2024-08-18T22:34:13.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.837+0000 7f4edaa00640 1 -- 172.21.15.5:0/636986179 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ed401a070 con 0x7f4ee415c360 2024-08-18T22:34:13.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.837+0000 7f4edaa00640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4ec40678c0 0x7f4ec4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.837+0000 7f4edaa00640 1 -- 172.21.15.5:0/636986179 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f4ed4085c20 con 0x7f4ee415c360 2024-08-18T22:34:13.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.837+0000 7f4ee2000640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4ec40678c0 0x7f4ec4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.837+0000 7f4ee2000640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4ec40678c0 0x7f4ec4069d80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4ee41537b0 tx=0x7f4ed0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:13.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:13.841+0000 7f4edaa00640 1 -- 172.21.15.5:0/636986179 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f4ed4056430 con 0x7f4ee415c360 2024-08-18T22:34:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.021+0000 7f4ee9600640 1 -- 172.21.15.5:0/636986179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4ee40cd890 con 0x7f4ee415c360 2024-08-18T22:34:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.021+0000 7f4edaa00640 1 -- 172.21.15.5:0/636986179 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v206) ==== 80+0+0 (secure 0 0 0) 0x7f4ed4055d30 con 0x7f4ee415c360 2024-08-18T22:34:14.020 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-08-18T22:34:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 -- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4ec40678c0 msgr2=0x7f4ec4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4ec40678c0 0x7f4ec4069d80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4ee41537b0 tx=0x7f4ed0009040 comp rx=0 tx=0).stop 2024-08-18T22:34:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 -- 172.21.15.5:0/636986179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee415c360 msgr2=0x7f4ee4140bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee415c360 0x7f4ee4140bf0 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400e840 tx=0x7f4ed400ed00 comp rx=0 tx=0).stop 2024-08-18T22:34:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 -- 172.21.15.5:0/636986179 shutdown_connections 2024-08-18T22:34:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f4ec40678c0 0x7f4ec4069d80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ee415d290 0x7f4ee414f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ee415c740 0x7f4ee40b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 --2- 172.21.15.5:0/636986179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee415c360 0x7f4ee4140bf0 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 -- 172.21.15.5:0/636986179 >> 172.21.15.5:0/636986179 conn(0x7f4ee40b65f0 msgr2=0x7f4ee40b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 -- 172.21.15.5:0/636986179 shutdown_connections 2024-08-18T22:34:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.025+0000 7f4ee9600640 1 -- 172.21.15.5:0/636986179 wait complete. 2024-08-18T22:34:14.041 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-18T22:34:14.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:14.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-18T22:34:14.092 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:34:14.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:14.092 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T22:34:14.142 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:34:14.142 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:34:14.142 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:34:14.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:34:14.151 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:34:14.151 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:34:14.151 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:34:14.197 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:34:14.197 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T22:34:14.197 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:34:14.197 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:34:14.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:34:14.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:34:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe286800640 1 Processor -- start 2024-08-18T22:34:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe286800640 1 -- start start 2024-08-18T22:34:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe286800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe28015c180 0x7fe2800b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe286800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe280071c90 0x7fe28015c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe286800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2800b5e30 con 0x7fe28006fad0 2024-08-18T22:34:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe286800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe28015caa0 con 0x7fe28015c180 2024-08-18T22:34:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe286800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fe2800b6110 con 0x7fe280071c90 2024-08-18T22:34:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe27f400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe28015c180 0x7fe2800b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe27ea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe28006fad0 0x7fe280071580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52620/0 (socket says 172.21.15.5:52620) 2024-08-18T22:34:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe27ea00640 1 -- 172.21.15.5:0/349700199 learned_addr learned my addr 172.21.15.5:0/349700199 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe27fe00640 1 --2- 172.21.15.5:0/349700199 >> v2:172.21.15.117:3300/0 conn(0x7fe280071c90 0x7fe28015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe27f400640 1 -- 172.21.15.5:0/349700199 >> v2:172.21.15.117:3300/0 conn(0x7fe280071c90 msgr2=0x7fe28015c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe27f400640 1 --2- 172.21.15.5:0/349700199 >> v2:172.21.15.117:3300/0 conn(0x7fe280071c90 0x7fe28015c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe27f400640 1 -- 172.21.15.5:0/349700199 >> v1:172.21.15.5:6789/0 conn(0x7fe28006fad0 legacy=0x7fe280071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe27f400640 1 -- 172.21.15.5:0/349700199 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2800b63f0 con 0x7fe28015c180 2024-08-18T22:34:14.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.385+0000 7fe27e000640 1 -- 172.21.15.5:0/349700199 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045409077 0 0) 0x7fe2800b5e30 con 0x7fe28006fad0 2024-08-18T22:34:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe27f400640 1 --2- 172.21.15.5:0/349700199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28015c180 0x7fe2800b57c0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7fe2800b7650 tx=0x7fe27001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee1e1e163e5d96 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe27e000640 1 -- 172.21.15.5:0/349700199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2700b0070 con 0x7fe28015c180 2024-08-18T22:34:14.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe27e000640 1 -- 172.21.15.5:0/349700199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2700ab600 con 0x7fe28015c180 2024-08-18T22:34:14.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe27e000640 1 -- 172.21.15.5:0/349700199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2700ab9d0 con 0x7fe28015c180 2024-08-18T22:34:14.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe286800640 1 -- 172.21.15.5:0/349700199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28015c180 msgr2=0x7fe2800b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe286800640 1 --2- 172.21.15.5:0/349700199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28015c180 0x7fe2800b57c0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7fe2800b7650 tx=0x7fe27001c330 comp rx=0 tx=0).stop 2024-08-18T22:34:14.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe286800640 1 -- 172.21.15.5:0/349700199 shutdown_connections 2024-08-18T22:34:14.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe286800640 1 --2- 172.21.15.5:0/349700199 >> v2:172.21.15.117:3300/0 conn(0x7fe280071c90 0x7fe28015c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe286800640 1 --2- 172.21.15.5:0/349700199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28015c180 0x7fe2800b57c0 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe286800640 1 -- 172.21.15.5:0/349700199 >> 172.21.15.5:0/349700199 conn(0x7fe2800b3eb0 msgr2=0x7fe2800b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe286800640 1 -- 172.21.15.5:0/349700199 shutdown_connections 2024-08-18T22:34:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe286800640 1 -- 172.21.15.5:0/349700199 wait complete. 2024-08-18T22:34:14.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.389+0000 7fe286800640 1 Processor -- start 2024-08-18T22:34:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe286800640 1 -- start start 2024-08-18T22:34:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe286800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28006fad0 0x7fe28014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe286800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe280071c90 0x7fe280157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe286800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28015c180 0x7fe280153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe286800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe2800d1c30 con 0x7fe28006fad0 2024-08-18T22:34:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe286800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2800d1ab0 con 0x7fe28015c180 2024-08-18T22:34:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe286800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2800d1db0 con 0x7fe280071c90 2024-08-18T22:34:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28006fad0 0x7fe28014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27f400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28006fad0 0x7fe28014ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51060/0 (socket says 172.21.15.5:51060) 2024-08-18T22:34:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27f400640 1 -- 172.21.15.5:0/1630016595 learned_addr learned my addr 172.21.15.5:0/1630016595 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27ea00640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe280071c90 0x7fe280157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27fe00640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28015c180 0x7fe280153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27f400640 1 -- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe280071c90 msgr2=0x7fe280157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27f400640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe280071c90 0x7fe280157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27f400640 1 -- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28015c180 msgr2=0x7fe280153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27f400640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28015c180 0x7fe280153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27f400640 1 -- 172.21.15.5:0/1630016595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe280156160 con 0x7fe28006fad0 2024-08-18T22:34:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27ea00640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe280071c90 0x7fe280157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe27f400640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28006fad0 0x7fe28014ece0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7fe2700ae040 tx=0x7fe27001ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe277400640 1 -- 172.21.15.5:0/1630016595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2700b0050 con 0x7fe28006fad0 2024-08-18T22:34:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe277400640 1 -- 172.21.15.5:0/1630016595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2700bc070 con 0x7fe28006fad0 2024-08-18T22:34:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe277400640 1 -- 172.21.15.5:0/1630016595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe270006e20 con 0x7fe28006fad0 2024-08-18T22:34:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe286800640 1 -- 172.21.15.5:0/1630016595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe280156440 con 0x7fe28006fad0 2024-08-18T22:34:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe286800640 1 -- 172.21.15.5:0/1630016595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe280156a00 con 0x7fe28006fad0 2024-08-18T22:34:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.393+0000 7fe286800640 1 -- 172.21.15.5:0/1630016595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28015c560 con 0x7fe28006fad0 2024-08-18T22:34:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.397+0000 7fe277400640 1 -- 172.21.15.5:0/1630016595 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe2700b5870 con 0x7fe28006fad0 2024-08-18T22:34:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.397+0000 7fe277400640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2600678c0 0x7fe260069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.397+0000 7fe277400640 1 -- 172.21.15.5:0/1630016595 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7fe2701205a0 con 0x7fe28006fad0 2024-08-18T22:34:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.397+0000 7fe27ea00640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2600678c0 0x7fe260069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.397+0000 7fe27ea00640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2600678c0 0x7fe260069d80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fe26c007fd0 tx=0x7fe26c007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.401+0000 7fe277400640 1 -- 172.21.15.5:0/1630016595 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fe270016070 con 0x7fe28006fad0 2024-08-18T22:34:14.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.601+0000 7fe286800640 1 -- 172.21.15.5:0/1630016595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe280071830 con 0x7fe28006fad0 2024-08-18T22:34:14.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.601+0000 7fe277400640 1 -- 172.21.15.5:0/1630016595 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5234 (secure 0 0 0) 0x7fe2700f0ed0 con 0x7fe28006fad0 2024-08-18T22:34:14.600 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:14.600 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":160,"btime":"2024-08-18T22:33:36:585978+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1931701065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1931701065},{"type":"v1","addr":"172.21.15.117:6837","nonce":1931701065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10731,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/83313921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":83313921},{"type":"v1","addr":"172.21.15.5:6833","nonce":83313921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2593956905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2593956905},{"type":"v1","addr":"172.21.15.5:6835","nonce":2593956905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:33:32.949657+0000","modified":"2024-08-18T22:33:35.978872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10740":{"gid":10740,"name":"d","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6836/3939158605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3939158605},{"type":"v1","addr":"172.21.15.117:6836","nonce":3939158605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10740,"qdb_cluster":[10740]},"id":14}]} 2024-08-18T22:34:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 160 2024-08-18T22:34:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 -- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2600678c0 msgr2=0x7fe260069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2600678c0 0x7fe260069d80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fe26c007fd0 tx=0x7fe26c007c20 comp rx=0 tx=0).stop 2024-08-18T22:34:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 -- 172.21.15.5:0/1630016595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28006fad0 msgr2=0x7fe28014ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28006fad0 0x7fe28014ece0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7fe2700ae040 tx=0x7fe27001ab70 comp rx=0 tx=0).stop 2024-08-18T22:34:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 -- 172.21.15.5:0/1630016595 shutdown_connections 2024-08-18T22:34:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe2600678c0 0x7fe260069d80 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28015c180 0x7fe280153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe280071c90 0x7fe280157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 --2- 172.21.15.5:0/1630016595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe28006fad0 0x7fe28014ece0 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 -- 172.21.15.5:0/1630016595 >> 172.21.15.5:0/1630016595 conn(0x7fe2800b3eb0 msgr2=0x7fe28015cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 -- 172.21.15.5:0/1630016595 shutdown_connections 2024-08-18T22:34:14.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.605+0000 7fe286800640 1 -- 172.21.15.5:0/1630016595 wait complete. 2024-08-18T22:34:14.622 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:34:14.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.765+0000 7f49c9000640 1 Processor -- start 2024-08-18T22:34:14.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.765+0000 7f49c9000640 1 -- start start 2024-08-18T22:34:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.765+0000 7f49c9000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f49c406f290 0x7f49c40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.765+0000 7f49c9000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c40cd850 con 0x7f49c40cd3a0 2024-08-18T22:34:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.765+0000 7f49c9000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c40cee20 con 0x7f49c415b010 2024-08-18T22:34:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.765+0000 7f49c9000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f49c40cfa30 con 0x7f49c406f290 2024-08-18T22:34:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.765+0000 7f49c2800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f49c40cd3a0 0x7f49c4072620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52624/0 (socket says 172.21.15.5:52624) 2024-08-18T22:34:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.765+0000 7f49c2800640 1 -- 172.21.15.5:0/3865020807 learned_addr learned my addr 172.21.15.5:0/3865020807 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.765+0000 7f49b9400640 1 --2- 172.21.15.5:0/3865020807 >> v2:172.21.15.117:3300/0 conn(0x7f49c406f290 0x7f49c40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.769+0000 7f49c1400640 1 -- 172.21.15.5:0/3865020807 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3304651639 0 0) 0x7f49c40cd850 con 0x7f49c40cd3a0 2024-08-18T22:34:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.769+0000 7f49c1400640 1 -- 172.21.15.5:0/3865020807 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49a8003530 con 0x7f49c40cd3a0 2024-08-18T22:34:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.769+0000 7f49c1400640 1 -- 172.21.15.5:0/3865020807 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453853951 0 0) 0x7f49c40cee20 con 0x7f49c415b010 2024-08-18T22:34:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.769+0000 7f49c1400640 1 -- 172.21.15.5:0/3865020807 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49c40cd850 con 0x7f49c415b010 2024-08-18T22:34:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.769+0000 7f49b9400640 1 -- 172.21.15.5:0/3865020807 >> v1:172.21.15.117:6789/0 conn(0x7f49c415b010 legacy=0x7f49c406eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.769+0000 7f49b9400640 1 -- 172.21.15.5:0/3865020807 >> v1:172.21.15.5:6789/0 conn(0x7f49c40cd3a0 legacy=0x7f49c4072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.769+0000 7f49b9400640 1 -- 172.21.15.5:0/3865020807 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c40cf100 con 0x7f49c406f290 2024-08-18T22:34:14.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.769+0000 7f49b9400640 1 --2- 172.21.15.5:0/3865020807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49c406f290 0x7f49c40ce840 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0097c0 tx=0x7f49ac01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4460779021128c5c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:14.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.769+0000 7f49c1400640 1 -- 172.21.15.5:0/3865020807 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac0a7070 con 0x7f49c406f290 2024-08-18T22:34:14.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.769+0000 7f49c1400640 1 -- 172.21.15.5:0/3865020807 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac0b0070 con 0x7f49c406f290 2024-08-18T22:34:14.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.769+0000 7f49c1400640 1 -- 172.21.15.5:0/3865020807 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac0ab890 con 0x7f49c406f290 2024-08-18T22:34:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 -- 172.21.15.5:0/3865020807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49c406f290 msgr2=0x7f49c40ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 --2- 172.21.15.5:0/3865020807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49c406f290 0x7f49c40ce840 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0097c0 tx=0x7f49ac01c470 comp rx=0 tx=0).stop 2024-08-18T22:34:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 -- 172.21.15.5:0/3865020807 shutdown_connections 2024-08-18T22:34:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 --2- 172.21.15.5:0/3865020807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49c406f290 0x7f49c40ce840 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 -- 172.21.15.5:0/3865020807 >> 172.21.15.5:0/3865020807 conn(0x7f49c40b1c50 msgr2=0x7f49c40b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 -- 172.21.15.5:0/3865020807 shutdown_connections 2024-08-18T22:34:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 -- 172.21.15.5:0/3865020807 wait complete. 2024-08-18T22:34:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 Processor -- start 2024-08-18T22:34:14.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 -- start start 2024-08-18T22:34:14.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49c406f290 0x7f49c41535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:14.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c40cd3a0 0x7f49c41544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49c415b010 0x7f49c4152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49c40736c0 con 0x7f49c40cd3a0 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f49c4073540 con 0x7f49c415b010 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c9000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f49c4073840 con 0x7f49c406f290 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49b9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c40cd3a0 0x7f49c41544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49b9400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c40cd3a0 0x7f49c41544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51074/0 (socket says 172.21.15.5:51074) 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49b9400640 1 -- 172.21.15.5:0/1829836018 learned_addr learned my addr 172.21.15.5:0/1829836018 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c1e00640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49c406f290 0x7f49c41535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c2800640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49c415b010 0x7f49c4152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49b9400640 1 -- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49c406f290 msgr2=0x7f49c41535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49b9400640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49c406f290 0x7f49c41535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49b9400640 1 -- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49c415b010 msgr2=0x7f49c4152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49b9400640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49c415b010 0x7f49c4152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49b9400640 1 -- 172.21.15.5:0/1829836018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c40ae520 con 0x7f49c40cd3a0 2024-08-18T22:34:14.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49c2800640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49c415b010 0x7f49c4152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:14.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.773+0000 7f49b9400640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c40cd3a0 0x7f49c41544b0 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0ad040 tx=0x7f49ac01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.777+0000 7f49baa00640 1 -- 172.21.15.5:0/1829836018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac0bf410 con 0x7f49c40cd3a0 2024-08-18T22:34:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.777+0000 7f49baa00640 1 -- 172.21.15.5:0/1829836018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac0bf5b0 con 0x7f49c40cd3a0 2024-08-18T22:34:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.777+0000 7f49c9000640 1 -- 172.21.15.5:0/1829836018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c40ad050 con 0x7f49c40cd3a0 2024-08-18T22:34:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.777+0000 7f49baa00640 1 -- 172.21.15.5:0/1829836018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac0bf980 con 0x7f49c40cd3a0 2024-08-18T22:34:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.777+0000 7f49c9000640 1 -- 172.21.15.5:0/1829836018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c40ad610 con 0x7f49c40cd3a0 2024-08-18T22:34:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.777+0000 7f49c9000640 1 -- 172.21.15.5:0/1829836018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c40ce840 con 0x7f49c40cd3a0 2024-08-18T22:34:14.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.777+0000 7f49baa00640 1 -- 172.21.15.5:0/1829836018 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f49ac0bd020 con 0x7f49c40cd3a0 2024-08-18T22:34:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.777+0000 7f49baa00640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49a00678c0 0x7f49a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.777+0000 7f49baa00640 1 -- 172.21.15.5:0/1829836018 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f49ac1203b0 con 0x7f49c40cd3a0 2024-08-18T22:34:14.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.777+0000 7f49c1e00640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49a00678c0 0x7f49a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:14.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.781+0000 7f49c1e00640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49a00678c0 0x7f49a0069d80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f49b40011f0 tx=0x7f49b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:14.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.781+0000 7f49baa00640 1 -- 172.21.15.5:0/1829836018 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f49ac016090 con 0x7f49c40cd3a0 2024-08-18T22:34:14.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.981+0000 7f49c9000640 1 -- 172.21.15.5:0/1829836018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49c406ee30 con 0x7f49c40cd3a0 2024-08-18T22:34:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.981+0000 7f49baa00640 1 -- 172.21.15.5:0/1829836018 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5234 (secure 0 0 0) 0x7f49ac0f0680 con 0x7f49c40cd3a0 2024-08-18T22:34:14.980 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:14.980 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":160,"btime":"2024-08-18T22:33:36:585978+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1931701065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1931701065},{"type":"v1","addr":"172.21.15.117:6837","nonce":1931701065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10731,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/83313921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":83313921},{"type":"v1","addr":"172.21.15.5:6833","nonce":83313921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2593956905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2593956905},{"type":"v1","addr":"172.21.15.5:6835","nonce":2593956905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:33:32.949657+0000","modified":"2024-08-18T22:33:35.978872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10740":{"gid":10740,"name":"d","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6836/3939158605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3939158605},{"type":"v1","addr":"172.21.15.117:6836","nonce":3939158605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10740,"qdb_cluster":[10740]},"id":14}]} 2024-08-18T22:34:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 160 2024-08-18T22:34:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 -- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49a00678c0 msgr2=0x7f49a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49a00678c0 0x7f49a0069d80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f49b40011f0 tx=0x7f49b4009040 comp rx=0 tx=0).stop 2024-08-18T22:34:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 -- 172.21.15.5:0/1829836018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c40cd3a0 msgr2=0x7f49c41544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:14.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c40cd3a0 0x7f49c41544b0 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0ad040 tx=0x7f49ac01acb0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 -- 172.21.15.5:0/1829836018 shutdown_connections 2024-08-18T22:34:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f49a00678c0 0x7f49a0069d80 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49c415b010 0x7f49c4152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c40cd3a0 0x7f49c41544b0 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 --2- 172.21.15.5:0/1829836018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49c406f290 0x7f49c41535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 -- 172.21.15.5:0/1829836018 >> 172.21.15.5:0/1829836018 conn(0x7f49c40b1c50 msgr2=0x7f49c40aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 -- 172.21.15.5:0/1829836018 shutdown_connections 2024-08-18T22:34:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:14.985+0000 7f49c9000640 1 -- 172.21.15.5:0/1829836018 wait complete. 2024-08-18T22:34:15.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:34:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffad6800640 1 Processor -- start 2024-08-18T22:34:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffad6800640 1 -- start start 2024-08-18T22:34:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffad6800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffad00700b0 0x7ffad006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffad6800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffad015c3c0 0x7ffad0070490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffad6800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffad00c78a0 0x7ffad006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffad6800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ffad006c900 con 0x7ffad015c3c0 2024-08-18T22:34:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffad6800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ffad0072bb0 con 0x7ffad00c78a0 2024-08-18T22:34:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffad6800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffad00d1df0 con 0x7ffad00700b0 2024-08-18T22:34:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffacea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffad015c3c0 0x7ffad0070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffacea00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffad015c3c0 0x7ffad0070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51082/0 (socket says 172.21.15.5:51082) 2024-08-18T22:34:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffacea00640 1 -- 172.21.15.5:0/3805633406 learned_addr learned my addr 172.21.15.5:0/3805633406 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffacf400640 1 --2- 172.21.15.5:0/3805633406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffad00700b0 0x7ffad006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffacfe00640 1 --2- 172.21.15.5:0/3805633406 >> v2:172.21.15.117:3300/0 conn(0x7ffad00c78a0 0x7ffad006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffacea00640 1 -- 172.21.15.5:0/3805633406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffad00700b0 msgr2=0x7ffad006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffacea00640 1 --2- 172.21.15.5:0/3805633406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffad00700b0 0x7ffad006c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffacea00640 1 -- 172.21.15.5:0/3805633406 >> v2:172.21.15.117:3300/0 conn(0x7ffad00c78a0 msgr2=0x7ffad006ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffacea00640 1 --2- 172.21.15.5:0/3805633406 >> v2:172.21.15.117:3300/0 conn(0x7ffad00c78a0 0x7ffad006ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.145+0000 7ffacea00640 1 -- 172.21.15.5:0/3805633406 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad00709d0 con 0x7ffad015c3c0 2024-08-18T22:34:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7ffacea00640 1 --2- 172.21.15.5:0/3805633406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad015c3c0 0x7ffad0070490 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7ffad00b2bf0 tx=0x7ffabc01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845cbfe9b906494f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7fface000640 1 -- 172.21.15.5:0/3805633406 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0b0070 con 0x7ffad015c3c0 2024-08-18T22:34:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7fface000640 1 -- 172.21.15.5:0/3805633406 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc0ab600 con 0x7ffad015c3c0 2024-08-18T22:34:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7fface000640 1 -- 172.21.15.5:0/3805633406 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0ab9d0 con 0x7ffad015c3c0 2024-08-18T22:34:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7ffad6800640 1 -- 172.21.15.5:0/3805633406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad015c3c0 msgr2=0x7ffad0070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7ffad6800640 1 --2- 172.21.15.5:0/3805633406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad015c3c0 0x7ffad0070490 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7ffad00b2bf0 tx=0x7ffabc01c230 comp rx=0 tx=0).stop 2024-08-18T22:34:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7ffad6800640 1 -- 172.21.15.5:0/3805633406 shutdown_connections 2024-08-18T22:34:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7ffad6800640 1 --2- 172.21.15.5:0/3805633406 >> v2:172.21.15.117:3300/0 conn(0x7ffad00c78a0 0x7ffad006ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7ffad6800640 1 --2- 172.21.15.5:0/3805633406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad015c3c0 0x7ffad0070490 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7ffad6800640 1 --2- 172.21.15.5:0/3805633406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffad00700b0 0x7ffad006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7ffad6800640 1 -- 172.21.15.5:0/3805633406 >> 172.21.15.5:0/3805633406 conn(0x7ffad00d1010 msgr2=0x7ffad00d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7ffad6800640 1 -- 172.21.15.5:0/3805633406 shutdown_connections 2024-08-18T22:34:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.149+0000 7ffad6800640 1 -- 172.21.15.5:0/3805633406 wait complete. 2024-08-18T22:34:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffad6800640 1 Processor -- start 2024-08-18T22:34:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffad6800640 1 -- start start 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffad6800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffad00700b0 0x7ffad014bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffad6800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffad00c78a0 0x7ffad00cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffad6800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad015c3c0 0x7ffad00cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffad6800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffad0073900 con 0x7ffad015c3c0 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffad6800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffad00c7e10 con 0x7ffad00700b0 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffad6800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ffad0073a80 con 0x7ffad00c78a0 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffacfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad015c3c0 0x7ffad00cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffacfe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad015c3c0 0x7ffad00cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51086/0 (socket says 172.21.15.5:51086) 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffacfe00640 1 -- 172.21.15.5:0/3130267881 learned_addr learned my addr 172.21.15.5:0/3130267881 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffacf400640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffad00700b0 0x7ffad014bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffacea00640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffad00c78a0 0x7ffad00cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffacfe00640 1 -- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffad00c78a0 msgr2=0x7ffad00cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffacfe00640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffad00c78a0 0x7ffad00cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffacfe00640 1 -- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffad00700b0 msgr2=0x7ffad014bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffacfe00640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffad00700b0 0x7ffad014bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffacfe00640 1 -- 172.21.15.5:0/3130267881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad014c070 con 0x7ffad015c3c0 2024-08-18T22:34:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffacfe00640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad015c3c0 0x7ffad00cc5b0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7ffac800d560 tx=0x7ffac800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffac7400640 1 -- 172.21.15.5:0/3130267881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac80125f0 con 0x7ffad015c3c0 2024-08-18T22:34:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffac7400640 1 -- 172.21.15.5:0/3130267881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac8019070 con 0x7ffad015c3c0 2024-08-18T22:34:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffac7400640 1 -- 172.21.15.5:0/3130267881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac80129f0 con 0x7ffad015c3c0 2024-08-18T22:34:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffad6800640 1 -- 172.21.15.5:0/3130267881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad015d7b0 con 0x7ffad015c3c0 2024-08-18T22:34:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.153+0000 7ffad6800640 1 -- 172.21.15.5:0/3130267881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad015ccd0 con 0x7ffad015c3c0 2024-08-18T22:34:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.157+0000 7ffad6800640 1 -- 172.21.15.5:0/3130267881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad006ead0 con 0x7ffad015c3c0 2024-08-18T22:34:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.157+0000 7ffac7400640 1 -- 172.21.15.5:0/3130267881 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffac8012b90 con 0x7ffad015c3c0 2024-08-18T22:34:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.157+0000 7ffac7400640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffab00678f0 0x7ffab0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.157+0000 7ffac7400640 1 -- 172.21.15.5:0/3130267881 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7ffac8086140 con 0x7ffad015c3c0 2024-08-18T22:34:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.157+0000 7ffacf400640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffab00678f0 0x7ffab0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.157+0000 7ffacf400640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffab00678f0 0x7ffab0069db0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ffac00039f0 tx=0x7ffac0009790 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.161+0000 7ffac7400640 1 -- 172.21.15.5:0/3130267881 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7ffac8056420 con 0x7ffad015c3c0 2024-08-18T22:34:15.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.329+0000 7ffad6800640 1 -- 172.21.15.5:0/3130267881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffad00b1b80 con 0x7ffad015c3c0 2024-08-18T22:34:15.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.329+0000 7ffac7400640 1 -- 172.21.15.5:0/3130267881 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) ==== 74+0+17007 (secure 0 0 0) 0x7ffac805a720 con 0x7ffad015c3c0 2024-08-18T22:34:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:15.327 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":206,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:34:06.660965+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:33:30.682845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-08-18T22:33:31.952993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.0","mappings":[{"from":6,"to":0}]},{"pgid":"29.3","mappings":[{"from":6,"to":0}]},{"pgid":"29.c","mappings":[{"from":6,"to":0}]},{"pgid":"29.16","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:34:15.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 -- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffab00678f0 msgr2=0x7ffab0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffab00678f0 0x7ffab0069db0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ffac00039f0 tx=0x7ffac0009790 comp rx=0 tx=0).stop 2024-08-18T22:34:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 -- 172.21.15.5:0/3130267881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad015c3c0 msgr2=0x7ffad00cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad015c3c0 0x7ffad00cc5b0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7ffac800d560 tx=0x7ffac800da20 comp rx=0 tx=0).stop 2024-08-18T22:34:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 -- 172.21.15.5:0/3130267881 shutdown_connections 2024-08-18T22:34:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ffab00678f0 0x7ffab0069db0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffad015c3c0 0x7ffad00cc5b0 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffad00c78a0 0x7ffad00cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 --2- 172.21.15.5:0/3130267881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffad00700b0 0x7ffad014bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 -- 172.21.15.5:0/3130267881 >> 172.21.15.5:0/3130267881 conn(0x7ffad00d1010 msgr2=0x7ffad00d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 -- 172.21.15.5:0/3130267881 shutdown_connections 2024-08-18T22:34:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.333+0000 7ffad6800640 1 -- 172.21.15.5:0/3130267881 wait complete. 2024-08-18T22:34:15.348 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:34:15.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:34:15.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17fae00640 1 Processor -- start 2024-08-18T22:34:15.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17fae00640 1 -- start start 2024-08-18T22:34:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17fae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f40cf9a0 0x7f17f40cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17fae00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17f40cdd70 0x7f17f40cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17fae00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f40b35a0 con 0x7f17f415b280 2024-08-18T22:34:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17fae00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f17f40cbdd0 con 0x7f17f40cdd70 2024-08-18T22:34:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17fae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f17f40b3880 con 0x7f17f40cf9a0 2024-08-18T22:34:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17f8e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17f40cdd70 0x7f17f40cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17f8e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17f40cdd70 0x7f17f40cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51088/0 (socket says 172.21.15.5:51088) 2024-08-18T22:34:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17f8e00640 1 -- 172.21.15.5:0/1643000 learned_addr learned my addr 172.21.15.5:0/1643000 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17f3400640 1 --2- 172.21.15.5:0/1643000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f40cf9a0 0x7f17f40cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17f8e00640 1 -- 172.21.15.5:0/1643000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f40cf9a0 msgr2=0x7f17f40cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17f8e00640 1 --2- 172.21.15.5:0/1643000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f40cf9a0 0x7f17f40cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17f8e00640 1 -- 172.21.15.5:0/1643000 >> v1:172.21.15.117:6789/0 conn(0x7f17f415b280 legacy=0x7f17f40b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.493+0000 7f17f8e00640 1 -- 172.21.15.5:0/1643000 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f40b3b60 con 0x7f17f40cdd70 2024-08-18T22:34:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17f8e00640 1 --2- 172.21.15.5:0/1643000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40cdd70 0x7f17f40cc260 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009e50 tx=0x7f17ec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f31d34383bc6ef server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17f2a00640 1 -- 172.21.15.5:0/1643000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0a5660 con 0x7f17f40cdd70 2024-08-18T22:34:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17f2a00640 1 -- 172.21.15.5:0/1643000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec0a5800 con 0x7f17f40cdd70 2024-08-18T22:34:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17f2a00640 1 -- 172.21.15.5:0/1643000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0a5bd0 con 0x7f17f40cdd70 2024-08-18T22:34:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17fae00640 1 -- 172.21.15.5:0/1643000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40cdd70 msgr2=0x7f17f40cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17fae00640 1 --2- 172.21.15.5:0/1643000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40cdd70 0x7f17f40cc260 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009e50 tx=0x7f17ec01c9a0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17fae00640 1 -- 172.21.15.5:0/1643000 shutdown_connections 2024-08-18T22:34:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17fae00640 1 --2- 172.21.15.5:0/1643000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f40cdd70 0x7f17f40cc260 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17fae00640 1 --2- 172.21.15.5:0/1643000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f40cf9a0 0x7f17f40cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17fae00640 1 -- 172.21.15.5:0/1643000 >> 172.21.15.5:0/1643000 conn(0x7f17f409aa40 msgr2=0x7f17f40b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17fae00640 1 -- 172.21.15.5:0/1643000 shutdown_connections 2024-08-18T22:34:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.497+0000 7f17fae00640 1 -- 172.21.15.5:0/1643000 wait complete. 2024-08-18T22:34:15.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17fae00640 1 Processor -- start 2024-08-18T22:34:15.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17fae00640 1 -- start start 2024-08-18T22:34:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17fae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f40cdd70 0x7f17f415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17fae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17f40cf9a0 0x7f17f415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17fae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f415b280 0x7f17f406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17fae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40cd380 con 0x7f17f415b280 2024-08-18T22:34:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17fae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40cd200 con 0x7f17f40cf9a0 2024-08-18T22:34:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17fae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f17f40cd500 con 0x7f17f40cdd70 2024-08-18T22:34:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17f8e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f415b280 0x7f17f406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17f8e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f415b280 0x7f17f406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51100/0 (socket says 172.21.15.5:51100) 2024-08-18T22:34:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17f8e00640 1 -- 172.21.15.5:0/1645702251 learned_addr learned my addr 172.21.15.5:0/1645702251 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17f3400640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17f40cf9a0 0x7f17f415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17f3e00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f40cdd70 0x7f17f415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17f8e00640 1 -- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f40cdd70 msgr2=0x7f17f415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17f8e00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f40cdd70 0x7f17f415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17f8e00640 1 -- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17f40cf9a0 msgr2=0x7f17f415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17f8e00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17f40cf9a0 0x7f17f415d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17f8e00640 1 -- 172.21.15.5:0/1645702251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f415dab0 con 0x7f17f415b280 2024-08-18T22:34:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17f8e00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f415b280 0x7f17f406bc10 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0af040 tx=0x7f17ec019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17ebe00640 1 -- 172.21.15.5:0/1645702251 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0bc020 con 0x7f17f415b280 2024-08-18T22:34:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17ebe00640 1 -- 172.21.15.5:0/1645702251 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec0b8690 con 0x7f17f415b280 2024-08-18T22:34:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17ebe00640 1 -- 172.21.15.5:0/1645702251 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec009510 con 0x7f17f415b280 2024-08-18T22:34:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17fae00640 1 -- 172.21.15.5:0/1645702251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f415dd90 con 0x7f17f415b280 2024-08-18T22:34:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17fae00640 1 -- 172.21.15.5:0/1645702251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f415e350 con 0x7f17f415b280 2024-08-18T22:34:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.501+0000 7f17fae00640 1 -- 172.21.15.5:0/1645702251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f40cc260 con 0x7f17f415b280 2024-08-18T22:34:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.505+0000 7f17ebe00640 1 -- 172.21.15.5:0/1645702251 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17ec0bf020 con 0x7f17f415b280 2024-08-18T22:34:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.505+0000 7f17ebe00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17d40678c0 0x7f17d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.505+0000 7f17ebe00640 1 -- 172.21.15.5:0/1645702251 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f17ec1210b0 con 0x7f17f415b280 2024-08-18T22:34:15.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.505+0000 7f17f3e00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17d40678c0 0x7f17d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.505+0000 7f17f3e00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17d40678c0 0x7f17d4069d80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f17e4007fd0 tx=0x7f17e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.509+0000 7f17ebe00640 1 -- 172.21.15.5:0/1645702251 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f17ec016620 con 0x7f17f415b280 2024-08-18T22:34:15.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.709+0000 7f17fae00640 1 -- 172.21.15.5:0/1645702251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17f406f6a0 con 0x7f17f415b280 2024-08-18T22:34:15.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.709+0000 7f17ebe00640 1 -- 172.21.15.5:0/1645702251 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5234 (secure 0 0 0) 0x7f17ec0f14b0 con 0x7f17f415b280 2024-08-18T22:34:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:15.709 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":160,"btime":"2024-08-18T22:33:36:585978+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1931701065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1931701065},{"type":"v1","addr":"172.21.15.117:6837","nonce":1931701065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10731,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/83313921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":83313921},{"type":"v1","addr":"172.21.15.5:6833","nonce":83313921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2593956905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2593956905},{"type":"v1","addr":"172.21.15.5:6835","nonce":2593956905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:33:32.949657+0000","modified":"2024-08-18T22:33:35.978872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10740":{"gid":10740,"name":"d","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6836/3939158605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3939158605},{"type":"v1","addr":"172.21.15.117:6836","nonce":3939158605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10740,"qdb_cluster":[10740]},"id":14}]} 2024-08-18T22:34:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 160 2024-08-18T22:34:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 -- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17d40678c0 msgr2=0x7f17d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17d40678c0 0x7f17d4069d80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f17e4007fd0 tx=0x7f17e4009040 comp rx=0 tx=0).stop 2024-08-18T22:34:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 -- 172.21.15.5:0/1645702251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f415b280 msgr2=0x7f17f406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f415b280 0x7f17f406bc10 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0af040 tx=0x7f17ec019740 comp rx=0 tx=0).stop 2024-08-18T22:34:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 -- 172.21.15.5:0/1645702251 shutdown_connections 2024-08-18T22:34:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f17d40678c0 0x7f17d4069d80 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17f415b280 0x7f17f406bc10 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17f40cf9a0 0x7f17f415d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 --2- 172.21.15.5:0/1645702251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f40cdd70 0x7f17f415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 -- 172.21.15.5:0/1645702251 >> 172.21.15.5:0/1645702251 conn(0x7f17f409aa40 msgr2=0x7f17f40b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 -- 172.21.15.5:0/1645702251 shutdown_connections 2024-08-18T22:34:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.713+0000 7f17fae00640 1 -- 172.21.15.5:0/1645702251 wait complete. 2024-08-18T22:34:15.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:34:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.873+0000 7f3d93000640 1 Processor -- start 2024-08-18T22:34:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.873+0000 7f3d93000640 1 -- start start 2024-08-18T22:34:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.873+0000 7f3d93000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3d8c070730 0x7f3d8c070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.873+0000 7f3d93000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8c070430 con 0x7f3d8c161960 2024-08-18T22:34:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.873+0000 7f3d93000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8c15eb60 con 0x7f3d8c15dda0 2024-08-18T22:34:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.873+0000 7f3d93000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3d8c0710e0 con 0x7f3d8c070730 2024-08-18T22:34:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.873+0000 7f3d8be00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3d8c161960 0x7f3d8c06fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52628/0 (socket says 172.21.15.5:52628) 2024-08-18T22:34:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.873+0000 7f3d8be00640 1 -- 172.21.15.5:0/1903828541 learned_addr learned my addr 172.21.15.5:0/1903828541 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.873+0000 7f3d8b400640 1 --2- 172.21.15.5:0/1903828541 >> v2:172.21.15.5:3300/0 conn(0x7f3d8c070730 0x7f3d8c070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.877+0000 7f3d8b400640 1 -- 172.21.15.5:0/1903828541 >> v1:172.21.15.117:6789/0 conn(0x7f3d8c15dda0 legacy=0x7f3d8c15e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.877+0000 7f3d8b400640 1 -- 172.21.15.5:0/1903828541 >> v1:172.21.15.5:6789/0 conn(0x7f3d8c161960 legacy=0x7f3d8c06fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.877+0000 7f3d8b400640 1 -- 172.21.15.5:0/1903828541 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c15ee40 con 0x7f3d8c070730 2024-08-18T22:34:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.877+0000 7f3d8aa00640 1 -- 172.21.15.5:0/1903828541 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402161197 0 0) 0x7f3d8c070430 con 0x7f3d8c161960 2024-08-18T22:34:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.877+0000 7f3d8b400640 1 --2- 172.21.15.5:0/1903828541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c070730 0x7f3d8c070ba0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f3d780097c0 tx=0x7f3d7801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f1a804fed5cdbe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.877+0000 7f3d8aa00640 1 -- 172.21.15.5:0/1903828541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780b0070 con 0x7f3d8c070730 2024-08-18T22:34:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.877+0000 7f3d8aa00640 1 -- 172.21.15.5:0/1903828541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d780ab600 con 0x7f3d8c070730 2024-08-18T22:34:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.877+0000 7f3d8aa00640 1 -- 172.21.15.5:0/1903828541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780ab9d0 con 0x7f3d8c070730 2024-08-18T22:34:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.877+0000 7f3d93000640 1 -- 172.21.15.5:0/1903828541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c070730 msgr2=0x7f3d8c070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.877+0000 7f3d93000640 1 --2- 172.21.15.5:0/1903828541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c070730 0x7f3d8c070ba0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f3d780097c0 tx=0x7f3d7801c4a0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 -- 172.21.15.5:0/1903828541 shutdown_connections 2024-08-18T22:34:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 --2- 172.21.15.5:0/1903828541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c070730 0x7f3d8c070ba0 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 -- 172.21.15.5:0/1903828541 >> 172.21.15.5:0/1903828541 conn(0x7f3d8c0d2130 msgr2=0x7f3d8c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 -- 172.21.15.5:0/1903828541 shutdown_connections 2024-08-18T22:34:15.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 -- 172.21.15.5:0/1903828541 wait complete. 2024-08-18T22:34:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 Processor -- start 2024-08-18T22:34:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 -- start start 2024-08-18T22:34:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d8c070730 0x7f3d8c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c15dda0 0x7f3d8c15ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d8c161960 0x7f3d8c0b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c09ba30 con 0x7f3d8c15dda0 2024-08-18T22:34:15.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c15e940 con 0x7f3d8c161960 2024-08-18T22:34:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d93000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8c0cd810 con 0x7f3d8c070730 2024-08-18T22:34:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d8b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c15dda0 0x7f3d8c15ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d8b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c15dda0 0x7f3d8c15ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51114/0 (socket says 172.21.15.5:51114) 2024-08-18T22:34:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d8b400640 1 -- 172.21.15.5:0/1845953463 learned_addr learned my addr 172.21.15.5:0/1845953463 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d8be00640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d8c070730 0x7f3d8c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d91000640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d8c161960 0x7f3d8c0b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d8b400640 1 -- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d8c070730 msgr2=0x7f3d8c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d8b400640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d8c070730 0x7f3d8c15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d8b400640 1 -- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d8c161960 msgr2=0x7f3d8c0b79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d8b400640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d8c161960 0x7f3d8c0b79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d8b400640 1 -- 172.21.15.5:0/1845953463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c0ccf70 con 0x7f3d8c15dda0 2024-08-18T22:34:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.881+0000 7f3d8b400640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c15dda0 0x7f3d8c15ce80 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f3d780ae040 tx=0x7f3d7801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.885+0000 7f3d83e00640 1 -- 172.21.15.5:0/1845953463 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780b0040 con 0x7f3d8c15dda0 2024-08-18T22:34:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.885+0000 7f3d83e00640 1 -- 172.21.15.5:0/1845953463 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d78004020 con 0x7f3d8c15dda0 2024-08-18T22:34:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.885+0000 7f3d93000640 1 -- 172.21.15.5:0/1845953463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c0cd250 con 0x7f3d8c15dda0 2024-08-18T22:34:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.885+0000 7f3d83e00640 1 -- 172.21.15.5:0/1845953463 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780043d0 con 0x7f3d8c15dda0 2024-08-18T22:34:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.885+0000 7f3d93000640 1 -- 172.21.15.5:0/1845953463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c0cdd00 con 0x7f3d8c15dda0 2024-08-18T22:34:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.885+0000 7f3d93000640 1 -- 172.21.15.5:0/1845953463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8c070ba0 con 0x7f3d8c15dda0 2024-08-18T22:34:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.885+0000 7f3d83e00640 1 -- 172.21.15.5:0/1845953463 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d780bf060 con 0x7f3d8c15dda0 2024-08-18T22:34:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.885+0000 7f3d83e00640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d6c0678c0 0x7f3d6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.885+0000 7f3d83e00640 1 -- 172.21.15.5:0/1845953463 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f3d7811fa00 con 0x7f3d8c15dda0 2024-08-18T22:34:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.885+0000 7f3d8be00640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d6c0678c0 0x7f3d6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.885+0000 7f3d8be00640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d6c0678c0 0x7f3d6c069d80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000f70 tx=0x7f3d7c007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:15.889+0000 7f3d83e00640 1 -- 172.21.15.5:0/1845953463 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f3d78016090 con 0x7f3d8c15dda0 2024-08-18T22:34:16.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 -- 172.21.15.5:0/1845953463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d8c09bbb0 con 0x7f3d8c15dda0 2024-08-18T22:34:16.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d83e00640 1 -- 172.21.15.5:0/1845953463 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 160 v160) ==== 95+0+5234 (secure 0 0 0) 0x7f3d780efc50 con 0x7f3d8c15dda0 2024-08-18T22:34:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:16.087 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":160,"btime":"2024-08-18T22:33:36:585978+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1931701065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1931701065},{"type":"v1","addr":"172.21.15.117:6837","nonce":1931701065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10731,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/83313921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":83313921},{"type":"v1","addr":"172.21.15.5:6833","nonce":83313921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2593956905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2593956905},{"type":"v1","addr":"172.21.15.5:6835","nonce":2593956905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[{"mdsmap":{"epoch":160,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:33:32.949657+0000","modified":"2024-08-18T22:33:35.978872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10740":{"gid":10740,"name":"d","rank":0,"incarnation":156,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6836/3939158605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3939158605},{"type":"v1","addr":"172.21.15.117:6836","nonce":3939158605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10740,"qdb_cluster":[10740]},"id":14}]} 2024-08-18T22:34:16.087 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 160 2024-08-18T22:34:16.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 -- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d6c0678c0 msgr2=0x7f3d6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d6c0678c0 0x7f3d6c069d80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000f70 tx=0x7f3d7c007240 comp rx=0 tx=0).stop 2024-08-18T22:34:16.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 -- 172.21.15.5:0/1845953463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c15dda0 msgr2=0x7f3d8c15ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c15dda0 0x7f3d8c15ce80 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f3d780ae040 tx=0x7f3d7801ace0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 -- 172.21.15.5:0/1845953463 shutdown_connections 2024-08-18T22:34:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3d6c0678c0 0x7f3d6c069d80 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d8c161960 0x7f3d8c0b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8c15dda0 0x7f3d8c15ce80 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 --2- 172.21.15.5:0/1845953463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d8c070730 0x7f3d8c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 -- 172.21.15.5:0/1845953463 >> 172.21.15.5:0/1845953463 conn(0x7f3d8c0d2130 msgr2=0x7f3d8c0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 -- 172.21.15.5:0/1845953463 shutdown_connections 2024-08-18T22:34:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.089+0000 7f3d93000640 1 -- 172.21.15.5:0/1845953463 wait complete. 2024-08-18T22:34:16.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:34:16.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2079e00640 1 Processor -- start 2024-08-18T22:34:16.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2079e00640 1 -- start start 2024-08-18T22:34:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2079e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f207415bed0 0x7f20740735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2079e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207406da70 0x7f207406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2079e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2074073c80 con 0x7f20740cb390 2024-08-18T22:34:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2079e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f207406e420 con 0x7f207415bed0 2024-08-18T22:34:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2079e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f20740ca5d0 con 0x7f207406da70 2024-08-18T22:34:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f206a000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f20740cb390 0x7f2074071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52642/0 (socket says 172.21.15.5:52642) 2024-08-18T22:34:16.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f206a000640 1 -- 172.21.15.5:0/4138637085 learned_addr learned my addr 172.21.15.5:0/4138637085 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072a00640 1 --2- 172.21.15.5:0/4138637085 >> v2:172.21.15.117:3300/0 conn(0x7f207415bed0 0x7f20740735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2073400640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207406da70 0x7f207406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2226807225 0 0) 0x7f2074073c80 con 0x7f20740cb390 2024-08-18T22:34:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2058003530 con 0x7f20740cb390 2024-08-18T22:34:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3877200864 0 0) 0x7f2058003530 con 0x7f20740cb390 2024-08-18T22:34:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207406da70 msgr2=0x7f207406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207406da70 0x7f207406dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 >> v2:172.21.15.117:3300/0 conn(0x7f207415bed0 msgr2=0x7f20740735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:16.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 --2- 172.21.15.5:0/4138637085 >> v2:172.21.15.117:3300/0 conn(0x7f207415bed0 0x7f20740735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20740ca8b0 con 0x7f20740cb390 2024-08-18T22:34:16.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7f205c001680 con 0x7f20740cb390 2024-08-18T22:34:16.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 >> v1:172.21.15.5:6789/0 conn(0x7f20740cb390 legacy=0x7f2074071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20580039c0 0x7f2058003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207406da70 0x7f2058004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2058004d50 0x7f20580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f207406e420 con 0x7f2058004d50 2024-08-18T22:34:16.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f20740ca5d0 con 0x7f20580039c0 2024-08-18T22:34:16.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f205800b9d0 con 0x7f207406da70 2024-08-18T22:34:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2073400640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2058004d50 0x7f20580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2072a00640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20580039c0 0x7f2058003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f206a000640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207406da70 0x7f2058004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2073400640 1 -- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207406da70 msgr2=0x7f2058004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2073400640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207406da70 0x7f2058004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2073400640 1 -- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20580039c0 msgr2=0x7f2058003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.253+0000 7f2073400640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20580039c0 0x7f2058003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2073400640 1 -- 172.21.15.5:0/4138637085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2058003530 con 0x7f2058004d50 2024-08-18T22:34:16.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f206a000640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207406da70 0x7f2058004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2073400640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2058004d50 0x7f20580051d0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f206c009fc0 tx=0x7f206c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcbb35e85abf573 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c0b2070 con 0x7f2058004d50 2024-08-18T22:34:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c0a5c90 con 0x7f2058004d50 2024-08-18T22:34:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2072000640 1 -- 172.21.15.5:0/4138637085 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c009c10 con 0x7f2058004d50 2024-08-18T22:34:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2079e00640 1 -- 172.21.15.5:0/4138637085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2058004d50 msgr2=0x7f20580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2079e00640 1 --2- 172.21.15.5:0/4138637085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2058004d50 0x7f20580051d0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f206c009fc0 tx=0x7f206c01cc80 comp rx=0 tx=0).stop 2024-08-18T22:34:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2073400640 1 -- 172.21.15.5:0/4138637085 reap_dead start 2024-08-18T22:34:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2079e00640 1 -- 172.21.15.5:0/4138637085 shutdown_connections 2024-08-18T22:34:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2079e00640 1 -- 172.21.15.5:0/4138637085 >> 172.21.15.5:0/4138637085 conn(0x7f20740b1c50 msgr2=0x7f20740b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2079e00640 1 -- 172.21.15.5:0/4138637085 shutdown_connections 2024-08-18T22:34:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.257+0000 7f2079e00640 1 -- 172.21.15.5:0/4138637085 wait complete. 2024-08-18T22:34:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2079e00640 1 Processor -- start 2024-08-18T22:34:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2079e00640 1 -- start start 2024-08-18T22:34:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2079e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2058004d50 0x7f20741f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2079e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207415f3d0 0x7f2074154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2079e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20740b41d0 0x7f20740b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2079e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f207415c2b0 con 0x7f20740b41d0 2024-08-18T22:34:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2079e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f20740cae70 con 0x7f2058004d50 2024-08-18T22:34:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2079e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f207415c430 con 0x7f207415f3d0 2024-08-18T22:34:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2073400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20740b41d0 0x7f20740b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2073400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20740b41d0 0x7f20740b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51128/0 (socket says 172.21.15.5:51128) 2024-08-18T22:34:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2073400640 1 -- 172.21.15.5:0/373083950 learned_addr learned my addr 172.21.15.5:0/373083950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f206a000640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207415f3d0 0x7f2074154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2072a00640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2058004d50 0x7f20741f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2073400640 1 -- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207415f3d0 msgr2=0x7f2074154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2073400640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207415f3d0 0x7f2074154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2073400640 1 -- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2058004d50 msgr2=0x7f20741f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2073400640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2058004d50 0x7f20741f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2073400640 1 -- 172.21.15.5:0/373083950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2074155330 con 0x7f20740b41d0 2024-08-18T22:34:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2073400640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20740b41d0 0x7f20740b4660 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f206c002240 tx=0x7f206c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f206be00640 1 -- 172.21.15.5:0/373083950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c0bd070 con 0x7f20740b41d0 2024-08-18T22:34:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f206be00640 1 -- 172.21.15.5:0/373083950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c0a5a90 con 0x7f20740b41d0 2024-08-18T22:34:16.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f206be00640 1 -- 172.21.15.5:0/373083950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c0b2040 con 0x7f20740b41d0 2024-08-18T22:34:16.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2079e00640 1 -- 172.21.15.5:0/373083950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20741f52d0 con 0x7f20740b41d0 2024-08-18T22:34:16.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.261+0000 7f2079e00640 1 -- 172.21.15.5:0/373083950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20741f5890 con 0x7f20740b41d0 2024-08-18T22:34:16.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.265+0000 7f2079e00640 1 -- 172.21.15.5:0/373083950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f207415b700 con 0x7f20740b41d0 2024-08-18T22:34:16.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.265+0000 7f206be00640 1 -- 172.21.15.5:0/373083950 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f206c0aecf0 con 0x7f20740b41d0 2024-08-18T22:34:16.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.265+0000 7f206be00640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20500678c0 0x7f2050069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.265+0000 7f206be00640 1 -- 172.21.15.5:0/373083950 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f206c11fd40 con 0x7f20740b41d0 2024-08-18T22:34:16.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.265+0000 7f2072a00640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20500678c0 0x7f2050069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.269+0000 7f2072a00640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20500678c0 0x7f2050069d80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f20740b4e20 tx=0x7f2064009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:16.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.269+0000 7f206be00640 1 -- 172.21.15.5:0/373083950 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f206c016990 con 0x7f20740b41d0 2024-08-18T22:34:16.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.437+0000 7f2079e00640 1 -- 172.21.15.5:0/373083950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20740aeae0 con 0x7f20740b41d0 2024-08-18T22:34:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f206be00640 1 -- 172.21.15.5:0/373083950 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) ==== 74+0+17007 (secure 0 0 0) 0x7f206c0f0050 con 0x7f20740b41d0 2024-08-18T22:34:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:16.438 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":206,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:34:06.660965+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-08-18T22:33:30.682845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-08-18T22:33:31.952993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.0","mappings":[{"from":6,"to":0}]},{"pgid":"29.3","mappings":[{"from":6,"to":0}]},{"pgid":"29.c","mappings":[{"from":6,"to":0}]},{"pgid":"29.16","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:34:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 -- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20500678c0 msgr2=0x7f2050069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20500678c0 0x7f2050069d80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f20740b4e20 tx=0x7f2064009190 comp rx=0 tx=0).stop 2024-08-18T22:34:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 -- 172.21.15.5:0/373083950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20740b41d0 msgr2=0x7f20740b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20740b41d0 0x7f20740b4660 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f206c002240 tx=0x7f206c009750 comp rx=0 tx=0).stop 2024-08-18T22:34:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 -- 172.21.15.5:0/373083950 shutdown_connections 2024-08-18T22:34:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f20500678c0 0x7f2050069d80 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20740b41d0 0x7f20740b4660 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f207415f3d0 0x7f2074154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 --2- 172.21.15.5:0/373083950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2058004d50 0x7f20741f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 -- 172.21.15.5:0/373083950 >> 172.21.15.5:0/373083950 conn(0x7f20740b1c50 msgr2=0x7f20740cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:16.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 -- 172.21.15.5:0/373083950 shutdown_connections 2024-08-18T22:34:16.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.441+0000 7f2079e00640 1 -- 172.21.15.5:0/373083950 wait complete. 2024-08-18T22:34:16.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T22:34:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.601+0000 7f3f63c00640 1 Processor -- start 2024-08-18T22:34:16.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.601+0000 7f3f63c00640 1 -- start start 2024-08-18T22:34:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f63c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f5c15b0c0 0x7f3f5c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f63c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f5c0b40c0 0x7f3f5c0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f63c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3f5c072a30 0x7f3f5c072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f63c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3f5c0b3d70 con 0x7f3f5c0b40c0 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f63c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3f5c0b4a40 con 0x7f3f5c072a30 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f63c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3f5c0b31f0 con 0x7f3f5c15b0c0 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f5be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f5c0b40c0 0x7f3f5c0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f5be00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3f5c0b40c0 0x7f3f5c0b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51134/0 (socket says 172.21.15.5:51134) 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f5be00640 1 -- 172.21.15.5:0/1805348087 learned_addr learned my addr 172.21.15.5:0/1805348087 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f61200640 1 --2- 172.21.15.5:0/1805348087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f5c15b0c0 0x7f3f5c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f61c00640 1 --2- 172.21.15.5:0/1805348087 >> v2:172.21.15.117:3300/0 conn(0x7f3f5c072a30 0x7f3f5c072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f5be00640 1 -- 172.21.15.5:0/1805348087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f5c15b0c0 msgr2=0x7f3f5c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f5be00640 1 --2- 172.21.15.5:0/1805348087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f5c15b0c0 0x7f3f5c06db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f5be00640 1 -- 172.21.15.5:0/1805348087 >> v2:172.21.15.117:3300/0 conn(0x7f3f5c072a30 msgr2=0x7f3f5c072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:16.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f5be00640 1 --2- 172.21.15.5:0/1805348087 >> v2:172.21.15.117:3300/0 conn(0x7f3f5c072a30 0x7f3f5c072ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.605+0000 7f3f5be00640 1 -- 172.21.15.5:0/1805348087 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5c0b34d0 con 0x7f3f5c0b40c0 2024-08-18T22:34:16.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f5be00640 1 --2- 172.21.15.5:0/1805348087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5c0b40c0 0x7f3f5c0b4500 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c15ec00 tx=0x7f3f4801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c096413493274 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f5b400640 1 -- 172.21.15.5:0/1805348087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f480b0070 con 0x7f3f5c0b40c0 2024-08-18T22:34:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f5b400640 1 -- 172.21.15.5:0/1805348087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f480ab600 con 0x7f3f5c0b40c0 2024-08-18T22:34:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f5b400640 1 -- 172.21.15.5:0/1805348087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f480ab9d0 con 0x7f3f5c0b40c0 2024-08-18T22:34:16.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 -- 172.21.15.5:0/1805348087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5c0b40c0 msgr2=0x7f3f5c0b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 --2- 172.21.15.5:0/1805348087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5c0b40c0 0x7f3f5c0b4500 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c15ec00 tx=0x7f3f4801c3d0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 -- 172.21.15.5:0/1805348087 shutdown_connections 2024-08-18T22:34:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 --2- 172.21.15.5:0/1805348087 >> v2:172.21.15.117:3300/0 conn(0x7f3f5c072a30 0x7f3f5c072ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 --2- 172.21.15.5:0/1805348087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5c0b40c0 0x7f3f5c0b4500 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 --2- 172.21.15.5:0/1805348087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f5c15b0c0 0x7f3f5c06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 -- 172.21.15.5:0/1805348087 >> 172.21.15.5:0/1805348087 conn(0x7f3f5c0b1dc0 msgr2=0x7f3f5c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 -- 172.21.15.5:0/1805348087 shutdown_connections 2024-08-18T22:34:16.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 -- 172.21.15.5:0/1805348087 wait complete. 2024-08-18T22:34:16.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 Processor -- start 2024-08-18T22:34:16.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 -- start start 2024-08-18T22:34:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.609+0000 7f3f63c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5c072a30 0x7f3f5c0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f63c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5c0b40c0 0x7f3f5c0aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f63c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f5c15b0c0 0x7f3f5c155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f63c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c15b620 con 0x7f3f5c072a30 2024-08-18T22:34:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f63c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c15b4a0 con 0x7f3f5c0b40c0 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f63c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3f5c0737f0 con 0x7f3f5c15b0c0 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f61200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5c072a30 0x7f3f5c0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f61200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5c072a30 0x7f3f5c0999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51150/0 (socket says 172.21.15.5:51150) 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f61200640 1 -- 172.21.15.5:0/1904444282 learned_addr learned my addr 172.21.15.5:0/1904444282 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f5be00640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5c0b40c0 0x7f3f5c0aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f61c00640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f5c15b0c0 0x7f3f5c155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f61200640 1 -- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f5c15b0c0 msgr2=0x7f3f5c155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f61200640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f5c15b0c0 0x7f3f5c155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f61200640 1 -- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5c0b40c0 msgr2=0x7f3f5c0aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f61200640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5c0b40c0 0x7f3f5c0aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f61200640 1 -- 172.21.15.5:0/1904444282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5c0ad4a0 con 0x7f3f5c072a30 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f61200640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5c072a30 0x7f3f5c0999f0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00d5f0 tx=0x7f3f4c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:16.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f58c00640 1 -- 172.21.15.5:0/1904444282 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0125f0 con 0x7f3f5c072a30 2024-08-18T22:34:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f58c00640 1 -- 172.21.15.5:0/1904444282 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f4c019070 con 0x7f3f5c072a30 2024-08-18T22:34:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f58c00640 1 -- 172.21.15.5:0/1904444282 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0129b0 con 0x7f3f5c072a30 2024-08-18T22:34:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f63c00640 1 -- 172.21.15.5:0/1904444282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f5c0ad780 con 0x7f3f5c072a30 2024-08-18T22:34:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f63c00640 1 -- 172.21.15.5:0/1904444282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f5c0add40 con 0x7f3f5c072a30 2024-08-18T22:34:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f63c00640 1 -- 172.21.15.5:0/1904444282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f5c06f670 con 0x7f3f5c072a30 2024-08-18T22:34:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.613+0000 7f3f58c00640 1 -- 172.21.15.5:0/1904444282 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3f4c012b50 con 0x7f3f5c072a30 2024-08-18T22:34:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.617+0000 7f3f58c00640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f3c0678c0 0x7f3f3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.617+0000 7f3f58c00640 1 -- 172.21.15.5:0/1904444282 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 6217+0+0 (secure 0 0 0) 0x7f3f4c086370 con 0x7f3f5c072a30 2024-08-18T22:34:16.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.617+0000 7f3f5be00640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f3c0678c0 0x7f3f3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.617+0000 7f3f5be00640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f3c0678c0 0x7f3f3c069d80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3f480ad000 tx=0x7f3f48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:16.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.621+0000 7f3f58c00640 1 -- 172.21.15.5:0/1904444282 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f3f4c056c10 con 0x7f3f5c072a30 2024-08-18T22:34:16.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.821+0000 7f3f63c00640 1 -- 172.21.15.5:0/1904444282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3f5c0ceb70 con 0x7f3f5c072a30 2024-08-18T22:34:16.820 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-08-18T22:34:16.821+0000 7fc7f2200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:34:16.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f58c00640 1 -- 172.21.15.5:0/1904444282 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v161) ==== 161+0+0 (secure 0 0 0) 0x7f3f4c056510 con 0x7f3f5c072a30 2024-08-18T22:34:16.822 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T22:34:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 -- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f3c0678c0 msgr2=0x7f3f3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f3c0678c0 0x7f3f3c069d80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3f480ad000 tx=0x7f3f48008040 comp rx=0 tx=0).stop 2024-08-18T22:34:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 -- 172.21.15.5:0/1904444282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5c072a30 msgr2=0x7f3f5c0999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5c072a30 0x7f3f5c0999f0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00d5f0 tx=0x7f3f4c00dab0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 -- 172.21.15.5:0/1904444282 shutdown_connections 2024-08-18T22:34:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3f3c0678c0 0x7f3f3c069d80 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f5c15b0c0 0x7f3f5c155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f5c0b40c0 0x7f3f5c0aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 --2- 172.21.15.5:0/1904444282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f5c072a30 0x7f3f5c0999f0 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 -- 172.21.15.5:0/1904444282 >> 172.21.15.5:0/1904444282 conn(0x7f3f5c0b1dc0 msgr2=0x7f3f5c0cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 -- 172.21.15.5:0/1904444282 shutdown_connections 2024-08-18T22:34:16.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.825+0000 7f3f63c00640 1 -- 172.21.15.5:0/1904444282 wait complete. 2024-08-18T22:34:16.837 INFO:tasks.ceph.mds.d.smithi117.stderr: -6402> 2024-08-18T22:33:35.529+0000 7f89e5400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T22:34:16.842 INFO:tasks.ceph.mds.d.smithi117.stderr: -3183> 2024-08-18T22:33:42.052+0000 7f89e0400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-08-18T22:33:40.834133+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={10878=0-12582912@1} caps={10878=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=10878 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x56070e33f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(30)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-18T22:34:16.843 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T22:34:16.887 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-08-18T22:34:16.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.989+0000 7fbd63000640 1 Processor -- start 2024-08-18T22:34:16.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.989+0000 7fbd63000640 1 -- start start 2024-08-18T22:34:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd63000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd5c15b0c0 0x7fbd5c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd63000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd5c0cf290 0x7fbd5c0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd63000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd5c0b31f0 con 0x7fbd5c0b40c0 2024-08-18T22:34:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd63000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbd5c0b3d70 con 0x7fbd5c0cf290 2024-08-18T22:34:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd63000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5c0b4a40 con 0x7fbd5c15b0c0 2024-08-18T22:34:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd61000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd5c0cf290 0x7fbd5c0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd61000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd5c0cf290 0x7fbd5c0b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51156/0 (socket says 172.21.15.5:51156) 2024-08-18T22:34:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd61000640 1 -- 172.21.15.5:0/649547437 learned_addr learned my addr 172.21.15.5:0/649547437 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd5be00640 1 --2- 172.21.15.5:0/649547437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd5c15b0c0 0x7fbd5c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd61000640 1 -- 172.21.15.5:0/649547437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd5c15b0c0 msgr2=0x7fbd5c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd61000640 1 --2- 172.21.15.5:0/649547437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd5c15b0c0 0x7fbd5c06db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd61000640 1 -- 172.21.15.5:0/649547437 >> v1:172.21.15.5:6789/0 conn(0x7fbd5c0b40c0 legacy=0x7fbd5c072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.993+0000 7fbd61000640 1 -- 172.21.15.5:0/649547437 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c0b34d0 con 0x7fbd5c0cf290 2024-08-18T22:34:16.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd61000640 1 --2- 172.21.15.5:0/649547437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd5c0cf290 0x7fbd5c0b4500 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009e50 tx=0x7fbd5401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9e6b7a2ccd3c7e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd5aa00640 1 -- 172.21.15.5:0/649547437 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd540a57a0 con 0x7fbd5c0cf290 2024-08-18T22:34:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd5aa00640 1 -- 172.21.15.5:0/649547437 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd540a5940 con 0x7fbd5c0cf290 2024-08-18T22:34:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd5aa00640 1 -- 172.21.15.5:0/649547437 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd540a5d10 con 0x7fbd5c0cf290 2024-08-18T22:34:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd63000640 1 -- 172.21.15.5:0/649547437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd5c0cf290 msgr2=0x7fbd5c0b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd63000640 1 --2- 172.21.15.5:0/649547437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd5c0cf290 0x7fbd5c0b4500 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009e50 tx=0x7fbd5401c8e0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd63000640 1 -- 172.21.15.5:0/649547437 shutdown_connections 2024-08-18T22:34:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd63000640 1 --2- 172.21.15.5:0/649547437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd5c0cf290 0x7fbd5c0b4500 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd63000640 1 --2- 172.21.15.5:0/649547437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd5c15b0c0 0x7fbd5c06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd63000640 1 -- 172.21.15.5:0/649547437 >> 172.21.15.5:0/649547437 conn(0x7fbd5c0b1dc0 msgr2=0x7fbd5c0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd63000640 1 -- 172.21.15.5:0/649547437 shutdown_connections 2024-08-18T22:34:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd63000640 1 -- 172.21.15.5:0/649547437 wait complete. 2024-08-18T22:34:16.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd63000640 1 Processor -- start 2024-08-18T22:34:16.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd63000640 1 -- start start 2024-08-18T22:34:16.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:16.997+0000 7fbd63000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd5c0b40c0 0x7fbd5c147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd63000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd5c0cf290 0x7fbd5c14eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd63000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd5c15b0c0 0x7fbd5c14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd63000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c15b620 con 0x7fbd5c0cf290 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd63000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c15b4a0 con 0x7fbd5c0b40c0 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd63000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5c06f670 con 0x7fbd5c15b0c0 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd5b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd5c0cf290 0x7fbd5c14eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd5b400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd5c0cf290 0x7fbd5c14eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51160/0 (socket says 172.21.15.5:51160) 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd5b400640 1 -- 172.21.15.5:0/1416775989 learned_addr learned my addr 172.21.15.5:0/1416775989 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd61000640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd5c15b0c0 0x7fbd5c14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd5be00640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd5c0b40c0 0x7fbd5c147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd5b400640 1 -- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd5c15b0c0 msgr2=0x7fbd5c14c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd5b400640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd5c15b0c0 0x7fbd5c14c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd5b400640 1 -- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd5c0b40c0 msgr2=0x7fbd5c147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd5b400640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd5c0b40c0 0x7fbd5c147820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd5b400640 1 -- 172.21.15.5:0/1416775989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c14de00 con 0x7fbd5c0cf290 2024-08-18T22:34:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd61000640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd5c15b0c0 0x7fbd5c14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd5b400640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd5c0cf290 0x7fbd5c14eea0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800c460 tx=0x7fbd4800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd53e00640 1 -- 172.21.15.5:0/1416775989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48016020 con 0x7fbd5c0cf290 2024-08-18T22:34:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd53e00640 1 -- 172.21.15.5:0/1416775989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd480052d0 con 0x7fbd5c0cf290 2024-08-18T22:34:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd63000640 1 -- 172.21.15.5:0/1416775989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5c14e0e0 con 0x7fbd5c0cf290 2024-08-18T22:34:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd53e00640 1 -- 172.21.15.5:0/1416775989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48007260 con 0x7fbd5c0cf290 2024-08-18T22:34:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd63000640 1 -- 172.21.15.5:0/1416775989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5c14e6a0 con 0x7fbd5c0cf290 2024-08-18T22:34:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd63000640 1 -- 172.21.15.5:0/1416775989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd5c0b4500 con 0x7fbd5c0cf290 2024-08-18T22:34:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.001+0000 7fbd53e00640 1 -- 172.21.15.5:0/1416775989 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbd48007400 con 0x7fbd5c0cf290 2024-08-18T22:34:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.005+0000 7fbd53e00640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd3c0678c0 0x7fbd3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.005+0000 7fbd53e00640 1 -- 172.21.15.5:0/1416775989 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6303+0+0 (secure 0 0 0) 0x7fbd48085870 con 0x7fbd5c0cf290 2024-08-18T22:34:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.005+0000 7fbd5be00640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd3c0678c0 0x7fbd3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.005+0000 7fbd5be00640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd3c0678c0 0x7fbd3c069d80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0b2830 tx=0x7fbd4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:17.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.009+0000 7fbd53e00640 1 -- 172.21.15.5:0/1416775989 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbd48020020 con 0x7fbd5c0cf290 2024-08-18T22:34:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.209+0000 7fbd63000640 1 -- 172.21.15.5:0/1416775989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbd5c06f1f0 con 0x7fbd5c0cf290 2024-08-18T22:34:17.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.825+0000 7fbd53e00640 1 -- 172.21.15.5:0/1416775989 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v162) ==== 104+0+0 (secure 0 0 0) 0x7fbd48005480 con 0x7fbd5c0cf290 2024-08-18T22:34:17.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 -- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd3c0678c0 msgr2=0x7fbd3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:17.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd3c0678c0 0x7fbd3c069d80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0b2830 tx=0x7fbd4c008040 comp rx=0 tx=0).stop 2024-08-18T22:34:17.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 -- 172.21.15.5:0/1416775989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd5c0cf290 msgr2=0x7fbd5c14eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:17.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd5c0cf290 0x7fbd5c14eea0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800c460 tx=0x7fbd4800c920 comp rx=0 tx=0).stop 2024-08-18T22:34:17.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 -- 172.21.15.5:0/1416775989 shutdown_connections 2024-08-18T22:34:17.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbd3c0678c0 0x7fbd3c069d80 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:17.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd5c15b0c0 0x7fbd5c14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:17.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd5c0cf290 0x7fbd5c14eea0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:17.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 --2- 172.21.15.5:0/1416775989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd5c0b40c0 0x7fbd5c147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:17.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 -- 172.21.15.5:0/1416775989 >> 172.21.15.5:0/1416775989 conn(0x7fbd5c0b1dc0 msgr2=0x7fbd5c158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:17.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 -- 172.21.15.5:0/1416775989 shutdown_connections 2024-08-18T22:34:17.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.829+0000 7fbd63000640 1 -- 172.21.15.5:0/1416775989 wait complete. 2024-08-18T22:34:17.848 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T22:34:17.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f3350000640 1 Processor -- start 2024-08-18T22:34:17.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f3350000640 1 -- start start 2024-08-18T22:34:17.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f3350000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f334815e470 0x7f334806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:17.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f3350000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33480b2800 0x7f33480b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:17.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f3350000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33480b4210 con 0x7f33480b6160 2024-08-18T22:34:17.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f3350000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f334806c900 con 0x7f334815e470 2024-08-18T22:34:17.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f3350000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f334809ac70 con 0x7f33480b2800 2024-08-18T22:34:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f334cc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33480b2800 0x7f33480b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f334d600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f334815e470 0x7f334806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f334cc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33480b2800 0x7f33480b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:49676/0 (socket says 172.21.15.5:49676) 2024-08-18T22:34:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f334cc00640 1 -- 172.21.15.5:0/567308022 learned_addr learned my addr 172.21.15.5:0/567308022 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f334e000640 1 --1- 172.21.15.5:0/567308022 >> v1:172.21.15.117:6789/0 conn(0x7f33480b6160 0x7f3348161fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:50150/0 (socket says 172.21.15.5:50150) 2024-08-18T22:34:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f334cc00640 1 -- 172.21.15.5:0/567308022 >> v2:172.21.15.117:3300/0 conn(0x7f334815e470 msgr2=0x7f334806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f334cc00640 1 --2- 172.21.15.5:0/567308022 >> v2:172.21.15.117:3300/0 conn(0x7f334815e470 0x7f334806c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:17.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:17.997+0000 7f334cc00640 1 -- 172.21.15.5:0/567308022 >> v1:172.21.15.117:6789/0 conn(0x7f33480b6160 legacy=0x7f3348161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:17.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f334cc00640 1 -- 172.21.15.5:0/567308022 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33480b44f0 con 0x7f33480b2800 2024-08-18T22:34:17.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f334cc00640 1 --2- 172.21.15.5:0/567308022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33480b2800 0x7f33480b5c20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3334009870 tx=0x7f333401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cab14af350a17f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:18.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f3347e00640 1 -- 172.21.15.5:0/567308022 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33340b5070 con 0x7f33480b2800 2024-08-18T22:34:18.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f3347e00640 1 -- 172.21.15.5:0/567308022 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33340a8a50 con 0x7f33480b2800 2024-08-18T22:34:18.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f3347e00640 1 -- 172.21.15.5:0/567308022 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33340a8e20 con 0x7f33480b2800 2024-08-18T22:34:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f3350000640 1 -- 172.21.15.5:0/567308022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33480b2800 msgr2=0x7f33480b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f3350000640 1 --2- 172.21.15.5:0/567308022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33480b2800 0x7f33480b5c20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3334009870 tx=0x7f333401ed50 comp rx=0 tx=0).stop 2024-08-18T22:34:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f3350000640 1 -- 172.21.15.5:0/567308022 shutdown_connections 2024-08-18T22:34:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f3350000640 1 --2- 172.21.15.5:0/567308022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33480b2800 0x7f33480b5c20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f3350000640 1 --2- 172.21.15.5:0/567308022 >> v2:172.21.15.117:3300/0 conn(0x7f334815e470 0x7f334806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f3350000640 1 -- 172.21.15.5:0/567308022 >> 172.21.15.5:0/567308022 conn(0x7f33480732a0 msgr2=0x7f33480b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f3350000640 1 -- 172.21.15.5:0/567308022 shutdown_connections 2024-08-18T22:34:18.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.001+0000 7f3350000640 1 -- 172.21.15.5:0/567308022 wait complete. 2024-08-18T22:34:18.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3350000640 1 Processor -- start 2024-08-18T22:34:18.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3350000640 1 -- start start 2024-08-18T22:34:18.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3350000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33480b2800 0x7f3348156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:18.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3350000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33480b6160 0x7f3348152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:18.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3350000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334815e470 0x7f33481529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:18.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3350000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f33480b65f0 con 0x7f33480b6160 2024-08-18T22:34:18.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3350000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f334815ef60 con 0x7f33480b2800 2024-08-18T22:34:18.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3350000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f334815e850 con 0x7f334815e470 2024-08-18T22:34:18.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f334cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33480b6160 0x7f3348152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:18.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f334cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33480b6160 0x7f3348152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51162/0 (socket says 172.21.15.5:51162) 2024-08-18T22:34:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f334cc00640 1 -- 172.21.15.5:0/4132333670 learned_addr learned my addr 172.21.15.5:0/4132333670 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f334d600640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33480b2800 0x7f3348156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f334e000640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334815e470 0x7f33481529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f334cc00640 1 -- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334815e470 msgr2=0x7f33481529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f334cc00640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334815e470 0x7f33481529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f334cc00640 1 -- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33480b2800 msgr2=0x7f3348156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f334cc00640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33480b2800 0x7f3348156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f334cc00640 1 -- 172.21.15.5:0/4132333670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3348153ab0 con 0x7f33480b6160 2024-08-18T22:34:18.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f334cc00640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33480b6160 0x7f3348152480 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f33340b3040 tx=0x7f333401baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:18.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3345600640 1 -- 172.21.15.5:0/4132333670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33340c0070 con 0x7f33480b6160 2024-08-18T22:34:18.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3345600640 1 -- 172.21.15.5:0/4132333670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33340b0b90 con 0x7f33480b6160 2024-08-18T22:34:18.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3345600640 1 -- 172.21.15.5:0/4132333670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33340b5040 con 0x7f33480b6160 2024-08-18T22:34:18.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3350000640 1 -- 172.21.15.5:0/4132333670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3348153d90 con 0x7f33480b6160 2024-08-18T22:34:18.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.005+0000 7f3350000640 1 -- 172.21.15.5:0/4132333670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3348154350 con 0x7f33480b6160 2024-08-18T22:34:18.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.009+0000 7f3350000640 1 -- 172.21.15.5:0/4132333670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33480b5c20 con 0x7f33480b6160 2024-08-18T22:34:18.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.009+0000 7f3345600640 1 -- 172.21.15.5:0/4132333670 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33340ba3d0 con 0x7f33480b6160 2024-08-18T22:34:18.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.009+0000 7f3345600640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33280678c0 0x7f3328069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:18.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.009+0000 7f3345600640 1 -- 172.21.15.5:0/4132333670 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 6303+0+0 (secure 0 0 0) 0x7f3334123280 con 0x7f33480b6160 2024-08-18T22:34:18.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.009+0000 7f334d600640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33280678c0 0x7f3328069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:18.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.009+0000 7f334d600640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33280678c0 0x7f3328069d80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f33481f8860 tx=0x7f333c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:18.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.013+0000 7f3345600640 1 -- 172.21.15.5:0/4132333670 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f33340188b0 con 0x7f33480b6160 2024-08-18T22:34:18.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.181+0000 7f3350000640 1 -- 172.21.15.5:0/4132333670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f33480b38b0 con 0x7f33480b6160 2024-08-18T22:34:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.833+0000 7f3345600640 1 -- 172.21.15.5:0/4132333670 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v208) ==== 181+0+0 (secure 0 0 0) 0x7f33340f3510 con 0x7f33480b6160 2024-08-18T22:34:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-18T22:34:18.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.833+0000 7f3350000640 1 -- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33280678c0 msgr2=0x7f3328069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:18.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.833+0000 7f3350000640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33280678c0 0x7f3328069d80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f33481f8860 tx=0x7f333c009190 comp rx=0 tx=0).stop 2024-08-18T22:34:18.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.833+0000 7f3350000640 1 -- 172.21.15.5:0/4132333670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33480b6160 msgr2=0x7f3348152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:18.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.833+0000 7f3350000640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33480b6160 0x7f3348152480 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f33340b3040 tx=0x7f333401baf0 comp rx=0 tx=0).stop 2024-08-18T22:34:18.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.833+0000 7f3350000640 1 -- 172.21.15.5:0/4132333670 shutdown_connections 2024-08-18T22:34:18.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.833+0000 7f3350000640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f33280678c0 0x7f3328069d80 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:18.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.833+0000 7f3350000640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f334815e470 0x7f33481529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:18.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.833+0000 7f3350000640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33480b6160 0x7f3348152480 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:18.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.833+0000 7f3350000640 1 --2- 172.21.15.5:0/4132333670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33480b2800 0x7f3348156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:18.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.837+0000 7f3350000640 1 -- 172.21.15.5:0/4132333670 >> 172.21.15.5:0/4132333670 conn(0x7f33480732a0 msgr2=0x7f334806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:18.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.837+0000 7f3350000640 1 -- 172.21.15.5:0/4132333670 shutdown_connections 2024-08-18T22:34:18.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:18.837+0000 7f3350000640 1 -- 172.21.15.5:0/4132333670 wait complete. 2024-08-18T22:34:18.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T22:34:19.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ed3a00640 1 Processor -- start 2024-08-18T22:34:19.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ed3a00640 1 -- start start 2024-08-18T22:34:19.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ed3a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0ecc15e350 0x7f0ecc0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ed3a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ecc0b3950 0x7f0ecc0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ed3a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ecc0ccf90 0x7f0ecc143c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ed3a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0ecc0cd420 con 0x7f0ecc0b3950 2024-08-18T22:34:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ed3a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0ecc161f70 con 0x7f0ecc15e350 2024-08-18T22:34:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ed3a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0ecc162250 con 0x7f0ecc0ccf90 2024-08-18T22:34:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ec3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ecc0b3950 0x7f0ecc0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ec3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ecc0b3950 0x7f0ecc0cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51178/0 (socket says 172.21.15.5:51178) 2024-08-18T22:34:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ec3e00640 1 -- 172.21.15.5:0/4252580260 learned_addr learned my addr 172.21.15.5:0/4252580260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ed1a00640 1 --2- 172.21.15.5:0/4252580260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ecc0ccf90 0x7f0ecc143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ed1000640 1 --2- 172.21.15.5:0/4252580260 >> v2:172.21.15.117:3300/0 conn(0x7f0ecc15e350 0x7f0ecc0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ec3e00640 1 -- 172.21.15.5:0/4252580260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ecc0ccf90 msgr2=0x7f0ecc143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ec3e00640 1 --2- 172.21.15.5:0/4252580260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ecc0ccf90 0x7f0ecc143c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ec3e00640 1 -- 172.21.15.5:0/4252580260 >> v2:172.21.15.117:3300/0 conn(0x7f0ecc15e350 msgr2=0x7f0ecc0b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ec3e00640 1 --2- 172.21.15.5:0/4252580260 >> v2:172.21.15.117:3300/0 conn(0x7f0ecc15e350 0x7f0ecc0b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.017+0000 7f0ec3e00640 1 -- 172.21.15.5:0/4252580260 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc162530 con 0x7f0ecc0b3950 2024-08-18T22:34:19.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ec3e00640 1 --2- 172.21.15.5:0/4252580260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ecc0b3950 0x7f0ecc0cca50 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc071080 tx=0x7f0eb401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121adf09fbe6eb1d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ecbe00640 1 -- 172.21.15.5:0/4252580260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40b0070 con 0x7f0ecc0b3950 2024-08-18T22:34:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ecbe00640 1 -- 172.21.15.5:0/4252580260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb40ab600 con 0x7f0ecc0b3950 2024-08-18T22:34:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ecbe00640 1 -- 172.21.15.5:0/4252580260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40ab9d0 con 0x7f0ecc0b3950 2024-08-18T22:34:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ed3a00640 1 -- 172.21.15.5:0/4252580260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ecc0b3950 msgr2=0x7f0ecc0cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ed3a00640 1 --2- 172.21.15.5:0/4252580260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ecc0b3950 0x7f0ecc0cca50 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc071080 tx=0x7f0eb401c260 comp rx=0 tx=0).stop 2024-08-18T22:34:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ed3a00640 1 -- 172.21.15.5:0/4252580260 shutdown_connections 2024-08-18T22:34:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ed3a00640 1 --2- 172.21.15.5:0/4252580260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ecc0ccf90 0x7f0ecc143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ed3a00640 1 --2- 172.21.15.5:0/4252580260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ecc0b3950 0x7f0ecc0cca50 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ed3a00640 1 --2- 172.21.15.5:0/4252580260 >> v2:172.21.15.117:3300/0 conn(0x7f0ecc15e350 0x7f0ecc0b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ed3a00640 1 -- 172.21.15.5:0/4252580260 >> 172.21.15.5:0/4252580260 conn(0x7f0ecc06b9b0 msgr2=0x7f0ecc06bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ed3a00640 1 -- 172.21.15.5:0/4252580260 shutdown_connections 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.021+0000 7f0ed3a00640 1 -- 172.21.15.5:0/4252580260 wait complete. 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed3a00640 1 Processor -- start 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed3a00640 1 -- start start 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed3a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ecc0b3950 0x7f0ecc1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed3a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc0ccf90 0x7f0ecc099880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed3a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ecc15e350 0x7f0ecc155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed3a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc0cfd90 con 0x7f0ecc0b3950 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed3a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc0cfc10 con 0x7f0ecc0ccf90 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed3a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f0ecc0cdf10 con 0x7f0ecc15e350 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed1000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ecc0b3950 0x7f0ecc1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:19.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed1000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ecc0b3950 0x7f0ecc1591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51182/0 (socket says 172.21.15.5:51182) 2024-08-18T22:34:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed1000640 1 -- 172.21.15.5:0/1008133017 learned_addr learned my addr 172.21.15.5:0/1008133017 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ec3e00640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc0ccf90 0x7f0ecc099880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed1a00640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ecc15e350 0x7f0ecc155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed1000640 1 -- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ecc15e350 msgr2=0x7f0ecc155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed1000640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ecc15e350 0x7f0ecc155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed1000640 1 -- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc0ccf90 msgr2=0x7f0ecc099880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed1000640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc0ccf90 0x7f0ecc099880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed1000640 1 -- 172.21.15.5:0/1008133017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc159710 con 0x7f0ecc0b3950 2024-08-18T22:34:19.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed1000640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ecc0b3950 0x7f0ecc1591d0 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00e870 tx=0x7f0ebc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:19.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ec9600640 1 -- 172.21.15.5:0/1008133017 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc017070 con 0x7f0ecc0b3950 2024-08-18T22:34:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ec9600640 1 -- 172.21.15.5:0/1008133017 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ebc00c940 con 0x7f0ecc0b3950 2024-08-18T22:34:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ec9600640 1 -- 172.21.15.5:0/1008133017 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc00ccf0 con 0x7f0ecc0b3950 2024-08-18T22:34:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed3a00640 1 -- 172.21.15.5:0/1008133017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ecc156150 con 0x7f0ecc0b3950 2024-08-18T22:34:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed3a00640 1 -- 172.21.15.5:0/1008133017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ecc1586f0 con 0x7f0ecc0b3950 2024-08-18T22:34:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.025+0000 7f0ed3a00640 1 -- 172.21.15.5:0/1008133017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ecc143c40 con 0x7f0ecc0b3950 2024-08-18T22:34:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.029+0000 7f0ec9600640 1 -- 172.21.15.5:0/1008133017 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ebc01a070 con 0x7f0ecc0b3950 2024-08-18T22:34:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.029+0000 7f0ec9600640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ea8067910 0x7f0ea8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.029+0000 7f0ec9600640 1 -- 172.21.15.5:0/1008133017 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(208..208 src has 1..208) ==== 5749+0+0 (secure 0 0 0) 0x7f0ebc085b50 con 0x7f0ecc0b3950 2024-08-18T22:34:19.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.029+0000 7f0ec3e00640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ea8067910 0x7f0ea8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:19.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.029+0000 7f0ec3e00640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ea8067910 0x7f0ea8069dd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40ad000 tx=0x7f0eb4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:19.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.033+0000 7f0ec9600640 1 -- 172.21.15.5:0/1008133017 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f0ebc055ff0 con 0x7f0ecc0b3950 2024-08-18T22:34:19.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.197+0000 7f0ed3a00640 1 -- 172.21.15.5:0/1008133017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0ecc0cc850 con 0x7f0ecc0b3950 2024-08-18T22:34:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.833+0000 7f0ec9600640 1 -- 172.21.15.5:0/1008133017 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v209) ==== 169+0+0 (secure 0 0 0) 0x7f0ebc05a2f0 con 0x7f0ecc0b3950 2024-08-18T22:34:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-18T22:34:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.837+0000 7f0ed3a00640 1 -- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ea8067910 msgr2=0x7f0ea8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.837+0000 7f0ed3a00640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ea8067910 0x7f0ea8069dd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40ad000 tx=0x7f0eb4008040 comp rx=0 tx=0).stop 2024-08-18T22:34:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.837+0000 7f0ed3a00640 1 -- 172.21.15.5:0/1008133017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ecc0b3950 msgr2=0x7f0ecc1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.837+0000 7f0ed3a00640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ecc0b3950 0x7f0ecc1591d0 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00e870 tx=0x7f0ebc00ec70 comp rx=0 tx=0).stop 2024-08-18T22:34:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.837+0000 7f0ed3a00640 1 -- 172.21.15.5:0/1008133017 shutdown_connections 2024-08-18T22:34:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.837+0000 7f0ed3a00640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f0ea8067910 0x7f0ea8069dd0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.837+0000 7f0ed3a00640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ecc15e350 0x7f0ecc155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.837+0000 7f0ed3a00640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc0ccf90 0x7f0ecc099880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.841+0000 7f0ed3a00640 1 --2- 172.21.15.5:0/1008133017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ecc0b3950 0x7f0ecc1591d0 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.841+0000 7f0ed3a00640 1 -- 172.21.15.5:0/1008133017 >> 172.21.15.5:0/1008133017 conn(0x7f0ecc06b9b0 msgr2=0x7f0ecc160920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.841+0000 7f0ed3a00640 1 -- 172.21.15.5:0/1008133017 shutdown_connections 2024-08-18T22:34:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:19.841+0000 7f0ed3a00640 1 -- 172.21.15.5:0/1008133017 wait complete. 2024-08-18T22:34:19.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T22:34:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f8000640 1 Processor -- start 2024-08-18T22:34:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f8000640 1 -- start start 2024-08-18T22:34:20.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f8000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16f015c180 0x7f16f00cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f8000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f00cfb00 con 0x7f16f015d4d0 2024-08-18T22:34:20.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f8000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f015c9f0 con 0x7f16f015c560 2024-08-18T22:34:20.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f8000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f16f015d040 con 0x7f16f015c180 2024-08-18T22:34:20.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f6000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f16f015d4d0 0x7f16f006db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52666/0 (socket says 172.21.15.5:52666) 2024-08-18T22:34:20.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f6000640 1 -- 172.21.15.5:0/3257339824 learned_addr learned my addr 172.21.15.5:0/3257339824 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:20.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f5600640 1 --2- 172.21.15.5:0/3257339824 >> v2:172.21.15.117:3300/0 conn(0x7f16f015c180 0x7f16f00cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16efe00640 1 -- 172.21.15.5:0/3257339824 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315623280 0 0) 0x7f16f00cfb00 con 0x7f16f015d4d0 2024-08-18T22:34:20.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16efe00640 1 -- 172.21.15.5:0/3257339824 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16d8003530 con 0x7f16f015d4d0 2024-08-18T22:34:20.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f5600640 1 -- 172.21.15.5:0/3257339824 >> v1:172.21.15.117:6789/0 conn(0x7f16f015c560 legacy=0x7f16f00ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16efe00640 1 -- 172.21.15.5:0/3257339824 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439119554 0 0) 0x7f16f015c9f0 con 0x7f16f015c560 2024-08-18T22:34:20.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f5600640 1 -- 172.21.15.5:0/3257339824 >> v1:172.21.15.5:6789/0 conn(0x7f16f015d4d0 legacy=0x7f16f006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.013+0000 7f16f5600640 1 -- 172.21.15.5:0/3257339824 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f015ccd0 con 0x7f16f015c180 2024-08-18T22:34:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.017+0000 7f16f5600640 1 --2- 172.21.15.5:0/3257339824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f015c180 0x7f16f00cdf10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f16e40097c0 tx=0x7f16e401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=861b6f0ecdc7eea server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.017+0000 7f16efe00640 1 -- 172.21.15.5:0/3257339824 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e40ab430 con 0x7f16f015c180 2024-08-18T22:34:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.017+0000 7f16efe00640 1 -- 172.21.15.5:0/3257339824 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e40b0070 con 0x7f16f015c180 2024-08-18T22:34:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.017+0000 7f16efe00640 1 -- 172.21.15.5:0/3257339824 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e40ab7f0 con 0x7f16f015c180 2024-08-18T22:34:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.017+0000 7f16f8000640 1 -- 172.21.15.5:0/3257339824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f015c180 msgr2=0x7f16f00cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.017+0000 7f16f8000640 1 --2- 172.21.15.5:0/3257339824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f015c180 0x7f16f00cdf10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f16e40097c0 tx=0x7f16e401c410 comp rx=0 tx=0).stop 2024-08-18T22:34:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.017+0000 7f16f8000640 1 -- 172.21.15.5:0/3257339824 shutdown_connections 2024-08-18T22:34:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.017+0000 7f16f8000640 1 --2- 172.21.15.5:0/3257339824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f015c180 0x7f16f00cdf10 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.017+0000 7f16f8000640 1 -- 172.21.15.5:0/3257339824 >> 172.21.15.5:0/3257339824 conn(0x7f16f00b1dc0 msgr2=0x7f16f00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.017+0000 7f16f8000640 1 -- 172.21.15.5:0/3257339824 shutdown_connections 2024-08-18T22:34:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.017+0000 7f16f8000640 1 -- 172.21.15.5:0/3257339824 wait complete. 2024-08-18T22:34:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f8000640 1 Processor -- start 2024-08-18T22:34:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f8000640 1 -- start start 2024-08-18T22:34:20.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f8000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f015c180 0x7f16f015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f8000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16f015d4d0 0x7f16f0148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f8000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f00ccb50 0x7f16f00b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f8000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f16f016a2c0 con 0x7f16f015c180 2024-08-18T22:34:20.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f8000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16f016a140 con 0x7f16f00ccb50 2024-08-18T22:34:20.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f8000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f16f016a440 con 0x7f16f015d4d0 2024-08-18T22:34:20.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f015c180 0x7f16f015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f5600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f015c180 0x7f16f015afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51196/0 (socket says 172.21.15.5:51196) 2024-08-18T22:34:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f5600640 1 -- 172.21.15.5:0/2030267247 learned_addr learned my addr 172.21.15.5:0/2030267247 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f4c00640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16f015d4d0 0x7f16f0148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f6000640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f00ccb50 0x7f16f00b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f5600640 1 -- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16f015d4d0 msgr2=0x7f16f0148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f5600640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16f015d4d0 0x7f16f0148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f5600640 1 -- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f00ccb50 msgr2=0x7f16f00b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f5600640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f00ccb50 0x7f16f00b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f5600640 1 -- 172.21.15.5:0/2030267247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f00b0450 con 0x7f16f015c180 2024-08-18T22:34:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f5600640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f015c180 0x7f16f015afe0 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f16e40097c0 tx=0x7f16e401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16ed600640 1 -- 172.21.15.5:0/2030267247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e40abe60 con 0x7f16f015c180 2024-08-18T22:34:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16ed600640 1 -- 172.21.15.5:0/2030267247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f00ced70 con 0x7f16f015c180 2024-08-18T22:34:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16ed600640 1 -- 172.21.15.5:0/2030267247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4004460 con 0x7f16f015c180 2024-08-18T22:34:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f8000640 1 -- 172.21.15.5:0/2030267247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f00b0730 con 0x7f16f015c180 2024-08-18T22:34:20.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.021+0000 7f16f8000640 1 -- 172.21.15.5:0/2030267247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f014e4e0 con 0x7f16f015c180 2024-08-18T22:34:20.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.025+0000 7f16f8000640 1 -- 172.21.15.5:0/2030267247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f014e2d0 con 0x7f16f015c180 2024-08-18T22:34:20.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.025+0000 7f16ed600640 1 -- 172.21.15.5:0/2030267247 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16e4003620 con 0x7f16f015c180 2024-08-18T22:34:20.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.025+0000 7f16ed600640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16d00678f0 0x7f16d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.025+0000 7f16ed600640 1 -- 172.21.15.5:0/2030267247 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f16e40a8020 con 0x7f16f015c180 2024-08-18T22:34:20.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.025+0000 7f16f4c00640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16d00678f0 0x7f16d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.025+0000 7f16f4c00640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16d00678f0 0x7f16d0069db0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f16f0073750 tx=0x7f16dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:20.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.029+0000 7f16ed600640 1 -- 172.21.15.5:0/2030267247 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f16e40c4020 con 0x7f16f015c180 2024-08-18T22:34:20.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.197+0000 7f16f8000640 1 -- 172.21.15.5:0/2030267247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f16f006eee0 con 0x7f16f015c180 2024-08-18T22:34:20.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.197+0000 7f16ed600640 1 -- 172.21.15.5:0/2030267247 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7f16e4016090 con 0x7f16f015c180 2024-08-18T22:34:20.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 -- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16d00678f0 msgr2=0x7f16d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16d00678f0 0x7f16d0069db0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f16f0073750 tx=0x7f16dc009040 comp rx=0 tx=0).stop 2024-08-18T22:34:20.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 -- 172.21.15.5:0/2030267247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f015c180 msgr2=0x7f16f015afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f015c180 0x7f16f015afe0 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f16e40097c0 tx=0x7f16e401ac50 comp rx=0 tx=0).stop 2024-08-18T22:34:20.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 -- 172.21.15.5:0/2030267247 shutdown_connections 2024-08-18T22:34:20.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f16d00678f0 0x7f16d0069db0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f00ccb50 0x7f16f00b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16f015d4d0 0x7f16f0148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 --2- 172.21.15.5:0/2030267247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f015c180 0x7f16f015afe0 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 -- 172.21.15.5:0/2030267247 >> 172.21.15.5:0/2030267247 conn(0x7f16f00b1dc0 msgr2=0x7f16f0157ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 -- 172.21.15.5:0/2030267247 shutdown_connections 2024-08-18T22:34:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.201+0000 7f16f8000640 1 -- 172.21.15.5:0/2030267247 wait complete. 2024-08-18T22:34:20.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-08-18T22:34:20.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.361+0000 7fabe2a00640 1 Processor -- start 2024-08-18T22:34:20.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.361+0000 7fabe2a00640 1 -- start start 2024-08-18T22:34:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.361+0000 7fabe2a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fabdc06b9b0 0x7fabdc0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.361+0000 7fabe2a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabdc0b0bd0 con 0x7fabdc0b1c50 2024-08-18T22:34:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.361+0000 7fabe2a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabdc0b0e90 con 0x7fabdc06bd90 2024-08-18T22:34:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.361+0000 7fabe2a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fabdc0b1170 con 0x7fabdc06b9b0 2024-08-18T22:34:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.361+0000 7fabe0a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fabdc0b1c50 0x7fabdc0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52676/0 (socket says 172.21.15.5:52676) 2024-08-18T22:34:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.361+0000 7fabe0a00640 1 -- 172.21.15.5:0/3589952984 learned_addr learned my addr 172.21.15.5:0/3589952984 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.361+0000 7fabdbe00640 1 --2- 172.21.15.5:0/3589952984 >> v2:172.21.15.117:3300/0 conn(0x7fabdc06b9b0 0x7fabdc0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.365+0000 7fabdaa00640 1 -- 172.21.15.5:0/3589952984 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446699393 0 0) 0x7fabdc0b0bd0 con 0x7fabdc0b1c50 2024-08-18T22:34:20.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.365+0000 7fabdaa00640 1 -- 172.21.15.5:0/3589952984 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabc0003530 con 0x7fabdc0b1c50 2024-08-18T22:34:20.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.365+0000 7fabdaa00640 1 -- 172.21.15.5:0/3589952984 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 554966831 0 0) 0x7fabdc0b0e90 con 0x7fabdc06bd90 2024-08-18T22:34:20.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.365+0000 7fabdaa00640 1 -- 172.21.15.5:0/3589952984 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabdc0b0bd0 con 0x7fabdc06bd90 2024-08-18T22:34:20.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.365+0000 7fabdbe00640 1 -- 172.21.15.5:0/3589952984 >> v1:172.21.15.117:6789/0 conn(0x7fabdc06bd90 legacy=0x7fabdc1453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.365+0000 7fabdbe00640 1 -- 172.21.15.5:0/3589952984 >> v1:172.21.15.5:6789/0 conn(0x7fabdc0b1c50 legacy=0x7fabdc0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.365+0000 7fabdbe00640 1 -- 172.21.15.5:0/3589952984 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc0b1450 con 0x7fabdc06b9b0 2024-08-18T22:34:20.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.365+0000 7fabdbe00640 1 --2- 172.21.15.5:0/3589952984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc06b9b0 0x7fabdc0ce520 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0097c0 tx=0x7fabcc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3af9a0bec98bc8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:20.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.365+0000 7fabdaa00640 1 -- 172.21.15.5:0/3589952984 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0b1070 con 0x7fabdc06b9b0 2024-08-18T22:34:20.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.365+0000 7fabdaa00640 1 -- 172.21.15.5:0/3589952984 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabcc0ac410 con 0x7fabdc06b9b0 2024-08-18T22:34:20.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.365+0000 7fabdaa00640 1 -- 172.21.15.5:0/3589952984 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0ac7e0 con 0x7fabdc06b9b0 2024-08-18T22:34:20.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 -- 172.21.15.5:0/3589952984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc06b9b0 msgr2=0x7fabdc0ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 --2- 172.21.15.5:0/3589952984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc06b9b0 0x7fabdc0ce520 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0097c0 tx=0x7fabcc01c4a0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 -- 172.21.15.5:0/3589952984 shutdown_connections 2024-08-18T22:34:20.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 --2- 172.21.15.5:0/3589952984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc06b9b0 0x7fabdc0ce520 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 -- 172.21.15.5:0/3589952984 >> 172.21.15.5:0/3589952984 conn(0x7fabdc09aa40 msgr2=0x7fabdc0b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:20.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 -- 172.21.15.5:0/3589952984 shutdown_connections 2024-08-18T22:34:20.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 -- 172.21.15.5:0/3589952984 wait complete. 2024-08-18T22:34:20.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 Processor -- start 2024-08-18T22:34:20.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 -- start start 2024-08-18T22:34:20.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc06b9b0 0x7fabdc0b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc06bd90 0x7fabdc158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc0b1c50 0x7fabdc138af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc0ae1c0 con 0x7fabdc06bd90 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc0ae040 con 0x7fabdc0b1c50 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe2a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc16a6e0 con 0x7fabdc06b9b0 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabdb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc06bd90 0x7fabdc158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabdb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc06bd90 0x7fabdc158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51200/0 (socket says 172.21.15.5:51200) 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabdb400640 1 -- 172.21.15.5:0/2304415529 learned_addr learned my addr 172.21.15.5:0/2304415529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabdbe00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc06b9b0 0x7fabdc0b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabe0a00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc0b1c50 0x7fabdc138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabdb400640 1 -- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc06b9b0 msgr2=0x7fabdc0b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabdb400640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc06b9b0 0x7fabdc0b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabdb400640 1 -- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc0b1c50 msgr2=0x7fabdc138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabdb400640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc0b1c50 0x7fabdc138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabdb400640 1 -- 172.21.15.5:0/2304415529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc139440 con 0x7fabdc06bd90 2024-08-18T22:34:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.369+0000 7fabdbe00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc06b9b0 0x7fabdc0b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:20.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.373+0000 7fabdb400640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc06bd90 0x7fabdc158700 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7fabc800c530 tx=0x7fabc800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.373+0000 7fabd3e00640 1 -- 172.21.15.5:0/2304415529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc80052d0 con 0x7fabdc06bd90 2024-08-18T22:34:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.373+0000 7fabd3e00640 1 -- 172.21.15.5:0/2304415529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc8005490 con 0x7fabdc06bd90 2024-08-18T22:34:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.373+0000 7fabd3e00640 1 -- 172.21.15.5:0/2304415529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8012850 con 0x7fabdc06bd90 2024-08-18T22:34:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.373+0000 7fabe2a00640 1 -- 172.21.15.5:0/2304415529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabdc139720 con 0x7fabdc06bd90 2024-08-18T22:34:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.373+0000 7fabe2a00640 1 -- 172.21.15.5:0/2304415529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabdc139fc0 con 0x7fabdc06bd90 2024-08-18T22:34:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.373+0000 7fabe2a00640 1 -- 172.21.15.5:0/2304415529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabdc0ce520 con 0x7fabdc06bd90 2024-08-18T22:34:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.373+0000 7fabd3e00640 1 -- 172.21.15.5:0/2304415529 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fabc80129f0 con 0x7fabdc06bd90 2024-08-18T22:34:20.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.373+0000 7fabd3e00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabbc0678c0 0x7fabbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.373+0000 7fabd3e00640 1 -- 172.21.15.5:0/2304415529 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7fabc8085860 con 0x7fabdc06bd90 2024-08-18T22:34:20.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.373+0000 7fabdbe00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabbc0678c0 0x7fabbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.377+0000 7fabdbe00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabbc0678c0 0x7fabbc069d80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0ae000 tx=0x7fabcc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:20.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.377+0000 7fabd3e00640 1 -- 172.21.15.5:0/2304415529 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fabc8056480 con 0x7fabdc06bd90 2024-08-18T22:34:20.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.605+0000 7fabe2a00640 1 -- 172.21.15.5:0/2304415529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7fabdc13a190 con 0x7fabdc06bd90 2024-08-18T22:34:20.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabd3e00640 1 -- 172.21.15.5:0/2304415529 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v704) ==== 133+0+0 (secure 0 0 0) 0x7fabc8055d80 con 0x7fabdc06bd90 2024-08-18T22:34:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 -- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabbc0678c0 msgr2=0x7fabbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabbc0678c0 0x7fabbc069d80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0ae000 tx=0x7fabcc008040 comp rx=0 tx=0).stop 2024-08-18T22:34:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 -- 172.21.15.5:0/2304415529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc06bd90 msgr2=0x7fabdc158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc06bd90 0x7fabdc158700 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7fabc800c530 tx=0x7fabc800c9f0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 -- 172.21.15.5:0/2304415529 shutdown_connections 2024-08-18T22:34:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fabbc0678c0 0x7fabbc069d80 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabdc0b1c50 0x7fabdc138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabdc06bd90 0x7fabdc158700 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 --2- 172.21.15.5:0/2304415529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabdc06b9b0 0x7fabdc0b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 -- 172.21.15.5:0/2304415529 >> 172.21.15.5:0/2304415529 conn(0x7fabdc09aa40 msgr2=0x7fabdc0cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:20.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 -- 172.21.15.5:0/2304415529 shutdown_connections 2024-08-18T22:34:20.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:20.841+0000 7fabe2a00640 1 -- 172.21.15.5:0/2304415529 wait complete. 2024-08-18T22:34:20.866 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ERROR 2024-08-18T22:34:20.867 INFO:tasks.cephfs_test_runner: 2024-08-18T22:34:20.867 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-18T22:34:20.867 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-08-18T22:34:20.867 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-18T22:34:20.867 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-18T22:34:20.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-08-18T22:34:20.867 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-08-18T22:34:20.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-08-18T22:34:20.867 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-18T22:34:20.868 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi005 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner: 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner:Ran 13 tests in 861.067s 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner: 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner: 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-08-18T22:34:20.869 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-18T22:34:20.870 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-18T22:34:20.871 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi005 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-08-18T22:34:20.871 INFO:tasks.cephfs_test_runner: 2024-08-18T22:34:20.871 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-08-18T22:34:21.045 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=fd549e3bb5bb4363bdf099e576af145a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-08-18T22:34:21.047 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-18T22:34:21.056 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-18T22:34:21.071 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-18T22:34:21.071 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:34:21.071 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:34:21.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:34:21.086 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-18T22:34:21.086 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:34:21.136 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6564 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T22:34:21.137 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:34:21.137 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:34:21.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:34:21.146 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-08-18T22:34:21.146 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:34:21.195 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3164 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T22:34:21.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:21.196 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:34:21.204 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T22:34:21.205 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T22:34:21.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:21.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:34:21.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:21.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T22:34:21.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:21.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-18T22:34:21.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:21.864 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-18T22:34:21.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:21.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-18T22:34:22.371 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-08-18T22:34:22.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:34:22.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:22.373 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-08-18T22:34:22.383 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-18T22:34:22.383 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-18T22:34:22.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:22.383 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T22:34:22.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:22.450 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-18T22:34:22.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:22.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-08-18T22:34:23.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:23.086 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-08-18T22:34:23.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:34:23.096 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-08-18T22:34:23.568 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2024-08-18T22:34:23.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:34:23.570 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-18T22:34:23.579 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T22:34:23.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:34:23.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.733+0000 7f85e5000640 1 Processor -- start 2024-08-18T22:34:23.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.733+0000 7f85e5000640 1 -- start start 2024-08-18T22:34:23.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85e5000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85e00cb390 0x7f85e00735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:23.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85e5000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f85e006da70 0x7f85e006df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:23.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85e5000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e0073c80 con 0x7f85e015bed0 2024-08-18T22:34:23.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85e5000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f85e00ca5d0 con 0x7f85e006da70 2024-08-18T22:34:23.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85e5000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f85e00ca8b0 con 0x7f85e00cb390 2024-08-18T22:34:23.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85dde00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f85e015bed0 0x7f85e0071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43414/0 (socket says 172.21.15.5:43414) 2024-08-18T22:34:23.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85dde00640 1 -- 172.21.15.5:0/4198507598 learned_addr learned my addr 172.21.15.5:0/4198507598 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:23.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85d5400640 1 --2- 172.21.15.5:0/4198507598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85e00cb390 0x7f85e00735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:23.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85de800640 1 --2- 172.21.15.5:0/4198507598 >> v2:172.21.15.117:3300/0 conn(0x7f85e006da70 0x7f85e006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:23.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85dd400640 1 -- 172.21.15.5:0/4198507598 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4278758529 0 0) 0x7f85e0073c80 con 0x7f85e015bed0 2024-08-18T22:34:23.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85dd400640 1 -- 172.21.15.5:0/4198507598 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85c4003530 con 0x7f85e015bed0 2024-08-18T22:34:23.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85d5400640 1 -- 172.21.15.5:0/4198507598 >> v2:172.21.15.117:3300/0 conn(0x7f85e006da70 msgr2=0x7f85e006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:23.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85d5400640 1 --2- 172.21.15.5:0/4198507598 >> v2:172.21.15.117:3300/0 conn(0x7f85e006da70 0x7f85e006df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85d5400640 1 -- 172.21.15.5:0/4198507598 >> v1:172.21.15.5:6789/0 conn(0x7f85e015bed0 legacy=0x7f85e0071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85dd400640 1 -- 172.21.15.5:0/4198507598 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1021229307 0 0) 0x7f85c4003530 con 0x7f85e015bed0 2024-08-18T22:34:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.737+0000 7f85d5400640 1 -- 172.21.15.5:0/4198507598 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e00cab90 con 0x7f85e00cb390 2024-08-18T22:34:23.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85d5400640 1 --2- 172.21.15.5:0/4198507598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85e00cb390 0x7f85e00735a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f85c80097c0 tx=0x7f85c801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66be7d712d7652b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:23.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85dd400640 1 -- 172.21.15.5:0/4198507598 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c80b0070 con 0x7f85e00cb390 2024-08-18T22:34:23.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85dd400640 1 -- 172.21.15.5:0/4198507598 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c80ab400 con 0x7f85e00cb390 2024-08-18T22:34:23.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85dd400640 1 -- 172.21.15.5:0/4198507598 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0001680 con 0x7f85e00cb390 2024-08-18T22:34:23.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85e5000640 1 -- 172.21.15.5:0/4198507598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85e00cb390 msgr2=0x7f85e00735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:23.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85e5000640 1 --2- 172.21.15.5:0/4198507598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85e00cb390 0x7f85e00735a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f85c80097c0 tx=0x7f85c801c3c0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85e5000640 1 -- 172.21.15.5:0/4198507598 shutdown_connections 2024-08-18T22:34:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85e5000640 1 --2- 172.21.15.5:0/4198507598 >> v2:172.21.15.117:3300/0 conn(0x7f85e006da70 0x7f85e006df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85e5000640 1 --2- 172.21.15.5:0/4198507598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85e00cb390 0x7f85e00735a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85e5000640 1 -- 172.21.15.5:0/4198507598 >> 172.21.15.5:0/4198507598 conn(0x7f85e00b1c50 msgr2=0x7f85e00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85e5000640 1 -- 172.21.15.5:0/4198507598 shutdown_connections 2024-08-18T22:34:23.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85e5000640 1 -- 172.21.15.5:0/4198507598 wait complete. 2024-08-18T22:34:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85e5000640 1 Processor -- start 2024-08-18T22:34:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.741+0000 7f85e5000640 1 -- start start 2024-08-18T22:34:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85e5000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85e006da70 0x7f85e014ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85e5000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e00cb390 0x7f85e00b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85e5000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85e015bed0 0x7f85e00acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:23.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85e5000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f85e0168730 con 0x7f85e00cb390 2024-08-18T22:34:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85e5000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f85e01685b0 con 0x7f85e015bed0 2024-08-18T22:34:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85e5000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f85e01688b0 con 0x7f85e006da70 2024-08-18T22:34:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e00cb390 0x7f85e00b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d5400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e00cb390 0x7f85e00b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50926/0 (socket says 172.21.15.5:50926) 2024-08-18T22:34:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d5400640 1 -- 172.21.15.5:0/234920506 learned_addr learned my addr 172.21.15.5:0/234920506 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85dde00640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85e006da70 0x7f85e014ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85de800640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85e015bed0 0x7f85e00acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:23.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d5400640 1 -- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85e006da70 msgr2=0x7f85e014ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:23.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d5400640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85e006da70 0x7f85e014ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d5400640 1 -- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85e015bed0 msgr2=0x7f85e00acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:23.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d5400640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85e015bed0 0x7f85e00acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d5400640 1 -- 172.21.15.5:0/234920506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e0155e20 con 0x7f85e00cb390 2024-08-18T22:34:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d5400640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e00cb390 0x7f85e00b0db0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f85c80ae040 tx=0x7f85c801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d6a00640 1 -- 172.21.15.5:0/234920506 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c80b0050 con 0x7f85e00cb390 2024-08-18T22:34:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d6a00640 1 -- 172.21.15.5:0/234920506 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c80bc070 con 0x7f85e00cb390 2024-08-18T22:34:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d6a00640 1 -- 172.21.15.5:0/234920506 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c80b78b0 con 0x7f85e00cb390 2024-08-18T22:34:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85e5000640 1 -- 172.21.15.5:0/234920506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e0156100 con 0x7f85e00cb390 2024-08-18T22:34:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85e5000640 1 -- 172.21.15.5:0/234920506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e01566c0 con 0x7f85e00cb390 2024-08-18T22:34:23.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85e5000640 1 -- 172.21.15.5:0/234920506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e006df00 con 0x7f85e00cb390 2024-08-18T22:34:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.745+0000 7f85d6a00640 1 -- 172.21.15.5:0/234920506 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85c80b7a50 con 0x7f85e00cb390 2024-08-18T22:34:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.749+0000 7f85d6a00640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85bc0678f0 0x7f85bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.749+0000 7f85d6a00640 1 -- 172.21.15.5:0/234920506 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f85c811fad0 con 0x7f85e00cb390 2024-08-18T22:34:23.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.749+0000 7f85dde00640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85bc0678f0 0x7f85bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:23.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.749+0000 7f85dde00640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85bc0678f0 0x7f85bc069db0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f85d00013d0 tx=0x7f85d0001360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:23.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.753+0000 7f85d6a00640 1 -- 172.21.15.5:0/234920506 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f85c80c5020 con 0x7f85e00cb390 2024-08-18T22:34:23.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.913+0000 7f85e5000640 1 -- 172.21.15.5:0/234920506 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85e00b2400 con 0x7f85bc0678f0 2024-08-18T22:34:23.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85d6a00640 1 -- 172.21.15.5:0/234920506 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13514 (secure 0 0 0) 0x7f85e00b2400 con 0x7f85bc0678f0 2024-08-18T22:34:23.913 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:34:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 -- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85bc0678f0 msgr2=0x7f85bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85bc0678f0 0x7f85bc069db0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f85d00013d0 tx=0x7f85d0001360 comp rx=0 tx=0).stop 2024-08-18T22:34:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 -- 172.21.15.5:0/234920506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e00cb390 msgr2=0x7f85e00b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e00cb390 0x7f85e00b0db0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f85c80ae040 tx=0x7f85c801ac00 comp rx=0 tx=0).stop 2024-08-18T22:34:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 -- 172.21.15.5:0/234920506 shutdown_connections 2024-08-18T22:34:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f85bc0678f0 0x7f85bc069db0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85e015bed0 0x7f85e00acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85e00cb390 0x7f85e00b0db0 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 --2- 172.21.15.5:0/234920506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85e006da70 0x7f85e014ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 -- 172.21.15.5:0/234920506 >> 172.21.15.5:0/234920506 conn(0x7f85e00b1c50 msgr2=0x7f85e00cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 -- 172.21.15.5:0/234920506 shutdown_connections 2024-08-18T22:34:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:23.917+0000 7f85e5000640 1 -- 172.21.15.5:0/234920506 wait complete. 2024-08-18T22:34:23.935 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":661,"stamp":"2024-08-18T22:34:23.844531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":436328,"kb_used_data":25848,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754538392,"statfs":{"total":773094113280,"available":772647313408,"internally_reserved":0,"allocated":26468352,"data_stored":15352467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6305957,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-84,"num_write_kb":-6186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.010902"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":553,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-08-18T22:34:19.844219+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:34:19.844219+0000","last_peered":"2024-08-18T22:34:19.844219+0000","last_clean":"2024-08-18T22:34:19.844219+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:34:19.844219+0000","last_undegraded":"2024-08-18T22:34:19.844219+0000","last_fullsized":"2024-08-18T22:34:19.844219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509626,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52388,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319452,"statfs":{"total":96636764160,"available":96583118848,"internally_reserved":0,"allocated":3231744,"data_stored":1838291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509628,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51804,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320036,"statfs":{"total":96636764160,"available":96583716864,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509626,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51804,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320036,"statfs":{"total":96636764160,"available":96583716864,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509627,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47648,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509626,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47648,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509627,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60708,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311132,"statfs":{"total":96636764160,"available":96574599168,"internally_reserved":0,"allocated":3231744,"data_stored":1838291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60124,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311716,"statfs":{"total":96636764160,"available":96575197184,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64204,"kb_used_data":6656,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94307636,"statfs":{"total":96636764160,"available":96571019264,"internally_reserved":0,"allocated":6815744,"data_stored":5436270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:34:23.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:34:24.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.077+0000 7eff20200640 1 Processor -- start 2024-08-18T22:34:24.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.077+0000 7eff20200640 1 -- start start 2024-08-18T22:34:24.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.077+0000 7eff20200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff180cb390 0x7eff180735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.077+0000 7eff20200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff18073c80 con 0x7eff1806da70 2024-08-18T22:34:24.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.077+0000 7eff20200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff180ca5d0 con 0x7eff1815bed0 2024-08-18T22:34:24.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.077+0000 7eff20200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7eff180ca8b0 con 0x7eff180cb390 2024-08-18T22:34:24.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.081+0000 7eff1e200640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7eff1806da70 0x7eff18165b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43430/0 (socket says 172.21.15.5:43430) 2024-08-18T22:34:24.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.081+0000 7eff1e200640 1 -- 172.21.15.5:0/4164534524 learned_addr learned my addr 172.21.15.5:0/4164534524 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:24.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.081+0000 7eff1ce00640 1 --2- 172.21.15.5:0/4164534524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff180cb390 0x7eff180735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.081+0000 7eff17e00640 1 -- 172.21.15.5:0/4164534524 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459038709 0 0) 0x7eff18073c80 con 0x7eff1806da70 2024-08-18T22:34:24.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.081+0000 7eff17e00640 1 -- 172.21.15.5:0/4164534524 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff00003530 con 0x7eff1806da70 2024-08-18T22:34:24.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.081+0000 7eff1ce00640 1 -- 172.21.15.5:0/4164534524 >> v1:172.21.15.117:6789/0 conn(0x7eff1815bed0 legacy=0x7eff18071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.081+0000 7eff17e00640 1 -- 172.21.15.5:0/4164534524 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835574002 0 0) 0x7eff180ca5d0 con 0x7eff1815bed0 2024-08-18T22:34:24.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.081+0000 7eff1ce00640 1 -- 172.21.15.5:0/4164534524 >> v1:172.21.15.5:6789/0 conn(0x7eff1806da70 legacy=0x7eff18165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.081+0000 7eff1ce00640 1 -- 172.21.15.5:0/4164534524 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff180cab90 con 0x7eff180cb390 2024-08-18T22:34:24.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.081+0000 7eff1ce00640 1 --2- 172.21.15.5:0/4164534524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff180cb390 0x7eff180735a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7eff040097f0 tx=0x7eff0401c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8176b07328d9749 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:24.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff17e00640 1 -- 172.21.15.5:0/4164534524 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff040b0070 con 0x7eff180cb390 2024-08-18T22:34:24.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff17e00640 1 -- 172.21.15.5:0/4164534524 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff040ab400 con 0x7eff180cb390 2024-08-18T22:34:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff17e00640 1 -- 172.21.15.5:0/4164534524 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10001680 con 0x7eff180cb390 2024-08-18T22:34:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 -- 172.21.15.5:0/4164534524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff180cb390 msgr2=0x7eff180735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 --2- 172.21.15.5:0/4164534524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff180cb390 0x7eff180735a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7eff040097f0 tx=0x7eff0401c2f0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 -- 172.21.15.5:0/4164534524 shutdown_connections 2024-08-18T22:34:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 --2- 172.21.15.5:0/4164534524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff180cb390 0x7eff180735a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 -- 172.21.15.5:0/4164534524 >> 172.21.15.5:0/4164534524 conn(0x7eff180b1c50 msgr2=0x7eff180b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:24.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 -- 172.21.15.5:0/4164534524 shutdown_connections 2024-08-18T22:34:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 -- 172.21.15.5:0/4164534524 wait complete. 2024-08-18T22:34:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 Processor -- start 2024-08-18T22:34:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 -- start start 2024-08-18T22:34:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1806da70 0x7eff180b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff180cb390 0x7eff18157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1815bed0 0x7eff18151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7eff18169c40 con 0x7eff1815bed0 2024-08-18T22:34:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7eff18169ac0 con 0x7eff1806da70 2024-08-18T22:34:24.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff20200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7eff18169dc0 con 0x7eff180cb390 2024-08-18T22:34:24.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff1e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1815bed0 0x7eff18151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff1e200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1815bed0 0x7eff18151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50930/0 (socket says 172.21.15.5:50930) 2024-08-18T22:34:24.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff1e200640 1 -- 172.21.15.5:0/1524013704 learned_addr learned my addr 172.21.15.5:0/1524013704 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:24.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff1ce00640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff180cb390 0x7eff18157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.085+0000 7eff1d800640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1806da70 0x7eff180b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff1e200640 1 -- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff180cb390 msgr2=0x7eff18157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff1e200640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff180cb390 0x7eff18157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff1e200640 1 -- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1806da70 msgr2=0x7eff180b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff1e200640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1806da70 0x7eff180b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff1e200640 1 -- 172.21.15.5:0/1524013704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1806f150 con 0x7eff1815bed0 2024-08-18T22:34:24.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff1d800640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1806da70 0x7eff180b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:34:24.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff1e200640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1815bed0 0x7eff18151a40 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7eff1000c750 tx=0x7eff1000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:24.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff15600640 1 -- 172.21.15.5:0/1524013704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10018070 con 0x7eff1815bed0 2024-08-18T22:34:24.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff15600640 1 -- 172.21.15.5:0/1524013704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff100074e0 con 0x7eff1815bed0 2024-08-18T22:34:24.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff20200640 1 -- 172.21.15.5:0/1524013704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1815a6e0 con 0x7eff1815bed0 2024-08-18T22:34:24.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff15600640 1 -- 172.21.15.5:0/1524013704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1000ce60 con 0x7eff1815bed0 2024-08-18T22:34:24.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff20200640 1 -- 172.21.15.5:0/1524013704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1815af80 con 0x7eff1815bed0 2024-08-18T22:34:24.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff20200640 1 -- 172.21.15.5:0/1524013704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1815aad0 con 0x7eff1815bed0 2024-08-18T22:34:24.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.089+0000 7eff15600640 1 -- 172.21.15.5:0/1524013704 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff1001b070 con 0x7eff1815bed0 2024-08-18T22:34:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.093+0000 7eff15600640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efef80678c0 0x7efef8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.093+0000 7eff15600640 1 -- 172.21.15.5:0/1524013704 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7eff100851d0 con 0x7eff1815bed0 2024-08-18T22:34:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.093+0000 7eff1d800640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efef80678c0 0x7efef8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.093+0000 7eff1d800640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efef80678c0 0x7efef8069d80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7eff0c007fd0 tx=0x7eff0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:24.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.097+0000 7eff15600640 1 -- 172.21.15.5:0/1524013704 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7eff10055e70 con 0x7eff1815bed0 2024-08-18T22:34:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.257+0000 7eff20200640 1 -- 172.21.15.5:0/1524013704 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff180735a0 con 0x7efef80678c0 2024-08-18T22:34:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.257+0000 7eff15600640 1 -- 172.21.15.5:0/1524013704 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13514 (secure 0 0 0) 0x7eff180735a0 con 0x7efef80678c0 2024-08-18T22:34:24.257 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:34:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 -- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efef80678c0 msgr2=0x7efef8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efef80678c0 0x7efef8069d80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7eff0c007fd0 tx=0x7eff0c009040 comp rx=0 tx=0).stop 2024-08-18T22:34:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 -- 172.21.15.5:0/1524013704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1815bed0 msgr2=0x7eff18151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1815bed0 0x7eff18151a40 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7eff1000c750 tx=0x7eff1000cc10 comp rx=0 tx=0).stop 2024-08-18T22:34:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 -- 172.21.15.5:0/1524013704 shutdown_connections 2024-08-18T22:34:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7efef80678c0 0x7efef8069d80 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff1815bed0 0x7eff18151a40 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff180cb390 0x7eff18157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 --2- 172.21.15.5:0/1524013704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1806da70 0x7eff180b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 -- 172.21.15.5:0/1524013704 >> 172.21.15.5:0/1524013704 conn(0x7eff180b1c50 msgr2=0x7eff18071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:24.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 -- 172.21.15.5:0/1524013704 shutdown_connections 2024-08-18T22:34:24.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.261+0000 7eff20200640 1 -- 172.21.15.5:0/1524013704 wait complete. 2024-08-18T22:34:24.278 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":661,"stamp":"2024-08-18T22:34:23.844531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":436328,"kb_used_data":25848,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754538392,"statfs":{"total":773094113280,"available":772647313408,"internally_reserved":0,"allocated":26468352,"data_stored":15352467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6305957,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-84,"num_write_kb":-6186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.010902"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":553,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-08-18T22:34:19.844219+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:34:19.844219+0000","last_peered":"2024-08-18T22:34:19.844219+0000","last_clean":"2024-08-18T22:34:19.844219+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:34:19.844219+0000","last_undegraded":"2024-08-18T22:34:19.844219+0000","last_fullsized":"2024-08-18T22:34:19.844219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509626,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52388,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319452,"statfs":{"total":96636764160,"available":96583118848,"internally_reserved":0,"allocated":3231744,"data_stored":1838291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509628,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51804,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320036,"statfs":{"total":96636764160,"available":96583716864,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509626,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51804,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320036,"statfs":{"total":96636764160,"available":96583716864,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509627,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47648,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509626,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47648,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509627,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60708,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311132,"statfs":{"total":96636764160,"available":96574599168,"internally_reserved":0,"allocated":3231744,"data_stored":1838291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60124,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311716,"statfs":{"total":96636764160,"available":96575197184,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64204,"kb_used_data":6656,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94307636,"statfs":{"total":96636764160,"available":96571019264,"internally_reserved":0,"allocated":6815744,"data_stored":5436270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:34:24.278 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T22:34:24.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:34:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff00a600640 1 Processor -- start 2024-08-18T22:34:24.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff00a600640 1 -- start start 2024-08-18T22:34:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff00a600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0040700b0 0x7ff00406c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff00a600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0040c78a0 0x7ff0040cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff00a600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff004072bb0 con 0x7ff00415c3c0 2024-08-18T22:34:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff00a600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff00406c900 con 0x7ff0040c78a0 2024-08-18T22:34:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff00a600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff0040d1df0 con 0x7ff0040700b0 2024-08-18T22:34:24.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff003e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0040c78a0 0x7ff0040cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff003e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0040c78a0 0x7ff0040cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50932/0 (socket says 172.21.15.5:50932) 2024-08-18T22:34:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff003e00640 1 -- 172.21.15.5:0/1594300426 learned_addr learned my addr 172.21.15.5:0/1594300426 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff003400640 1 --2- 172.21.15.5:0/1594300426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0040700b0 0x7ff00406c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff003e00640 1 -- 172.21.15.5:0/1594300426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0040700b0 msgr2=0x7ff00406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:24.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff003e00640 1 --2- 172.21.15.5:0/1594300426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0040700b0 0x7ff00406c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff003e00640 1 -- 172.21.15.5:0/1594300426 >> v1:172.21.15.117:6789/0 conn(0x7ff00415c3c0 legacy=0x7ff004070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.421+0000 7ff003e00640 1 -- 172.21.15.5:0/1594300426 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff004072e20 con 0x7ff0040c78a0 2024-08-18T22:34:24.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff003e00640 1 --2- 172.21.15.5:0/1594300426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0040c78a0 0x7ff0040cb660 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7feffc009e50 tx=0x7feffc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7a90451343c10e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:24.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff002000640 1 -- 172.21.15.5:0/1594300426 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc0a58d0 con 0x7ff0040c78a0 2024-08-18T22:34:24.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff002000640 1 -- 172.21.15.5:0/1594300426 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc0a5a70 con 0x7ff0040c78a0 2024-08-18T22:34:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff002000640 1 -- 172.21.15.5:0/1594300426 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc0a5e40 con 0x7ff0040c78a0 2024-08-18T22:34:24.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff00a600640 1 -- 172.21.15.5:0/1594300426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0040c78a0 msgr2=0x7ff0040cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff00a600640 1 --2- 172.21.15.5:0/1594300426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0040c78a0 0x7ff0040cb660 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7feffc009e50 tx=0x7feffc01ca00 comp rx=0 tx=0).stop 2024-08-18T22:34:24.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff00a600640 1 -- 172.21.15.5:0/1594300426 shutdown_connections 2024-08-18T22:34:24.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff00a600640 1 --2- 172.21.15.5:0/1594300426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0040c78a0 0x7ff0040cb660 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff00a600640 1 --2- 172.21.15.5:0/1594300426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0040700b0 0x7ff00406c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff00a600640 1 -- 172.21.15.5:0/1594300426 >> 172.21.15.5:0/1594300426 conn(0x7ff0040d1010 msgr2=0x7ff0040d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:24.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff00a600640 1 -- 172.21.15.5:0/1594300426 shutdown_connections 2024-08-18T22:34:24.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.425+0000 7ff00a600640 1 -- 172.21.15.5:0/1594300426 wait complete. 2024-08-18T22:34:24.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff00a600640 1 Processor -- start 2024-08-18T22:34:24.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff00a600640 1 -- start start 2024-08-18T22:34:24.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff00a600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0040700b0 0x7ff00414e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff00a600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0040c78a0 0x7ff004159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff00a600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff00415c3c0 0x7ff0040b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff00a600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff004073a80 con 0x7ff00415c3c0 2024-08-18T22:34:24.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff00a600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff004073900 con 0x7ff0040c78a0 2024-08-18T22:34:24.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff00a600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff0040cc3b0 con 0x7ff0040700b0 2024-08-18T22:34:24.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff003e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff00415c3c0 0x7ff0040b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff003e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff00415c3c0 0x7ff0040b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50946/0 (socket says 172.21.15.5:50946) 2024-08-18T22:34:24.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff003e00640 1 -- 172.21.15.5:0/3188871966 learned_addr learned my addr 172.21.15.5:0/3188871966 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:24.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff003400640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0040700b0 0x7ff00414e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff002a00640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0040c78a0 0x7ff004159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff003e00640 1 -- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0040700b0 msgr2=0x7ff00414e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff003e00640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0040700b0 0x7ff00414e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff003e00640 1 -- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0040c78a0 msgr2=0x7ff004159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff003e00640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0040c78a0 0x7ff004159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff003e00640 1 -- 172.21.15.5:0/3188871966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00414f410 con 0x7ff00415c3c0 2024-08-18T22:34:24.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff003e00640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff00415c3c0 0x7ff0040b3f60 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7feffc0af040 tx=0x7feffc0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:24.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7feffb400640 1 -- 172.21.15.5:0/3188871966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc0bc070 con 0x7ff00415c3c0 2024-08-18T22:34:24.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7feffb400640 1 -- 172.21.15.5:0/3188871966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc0b8440 con 0x7ff00415c3c0 2024-08-18T22:34:24.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff00a600640 1 -- 172.21.15.5:0/3188871966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00414f6f0 con 0x7ff00415c3c0 2024-08-18T22:34:24.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7feffb400640 1 -- 172.21.15.5:0/3188871966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc0a58d0 con 0x7ff00415c3c0 2024-08-18T22:34:24.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.429+0000 7ff00a600640 1 -- 172.21.15.5:0/3188871966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00414fcb0 con 0x7ff00415c3c0 2024-08-18T22:34:24.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.433+0000 7ff00a600640 1 -- 172.21.15.5:0/3188871966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff00406c3c0 con 0x7ff00415c3c0 2024-08-18T22:34:24.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.433+0000 7feffb400640 1 -- 172.21.15.5:0/3188871966 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feffc0b8830 con 0x7ff00415c3c0 2024-08-18T22:34:24.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.433+0000 7feffb400640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fefe40678c0 0x7fefe4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.433+0000 7feffb400640 1 -- 172.21.15.5:0/3188871966 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7feffc1209a0 con 0x7ff00415c3c0 2024-08-18T22:34:24.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.433+0000 7ff003400640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fefe40678c0 0x7fefe4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.433+0000 7ff003400640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fefe40678c0 0x7fefe4069d80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff0040cb320 tx=0x7feff4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:24.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.437+0000 7feffb400640 1 -- 172.21.15.5:0/3188871966 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7feffc016620 con 0x7ff00415c3c0 2024-08-18T22:34:24.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.597+0000 7ff00a600640 1 -- 172.21.15.5:0/3188871966 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff00415b330 con 0x7fefe40678c0 2024-08-18T22:34:24.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7feffb400640 1 -- 172.21.15.5:0/3188871966 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13514 (secure 0 0 0) 0x7ff00415b330 con 0x7fefe40678c0 2024-08-18T22:34:24.598 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:24.598 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:34:24.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 -- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fefe40678c0 msgr2=0x7fefe4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fefe40678c0 0x7fefe4069d80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff0040cb320 tx=0x7feff4008040 comp rx=0 tx=0).stop 2024-08-18T22:34:24.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 -- 172.21.15.5:0/3188871966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff00415c3c0 msgr2=0x7ff0040b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff00415c3c0 0x7ff0040b3f60 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7feffc0af040 tx=0x7feffc0197a0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 -- 172.21.15.5:0/3188871966 shutdown_connections 2024-08-18T22:34:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fefe40678c0 0x7fefe4069d80 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff00415c3c0 0x7ff0040b3f60 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0040c78a0 0x7ff004159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 --2- 172.21.15.5:0/3188871966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0040700b0 0x7ff00414e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 -- 172.21.15.5:0/3188871966 >> 172.21.15.5:0/3188871966 conn(0x7ff0040d1010 msgr2=0x7ff0040ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:24.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 -- 172.21.15.5:0/3188871966 shutdown_connections 2024-08-18T22:34:24.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.601+0000 7ff00a600640 1 -- 172.21.15.5:0/3188871966 wait complete. 2024-08-18T22:34:24.619 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":661,"stamp":"2024-08-18T22:34:23.844531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":436328,"kb_used_data":25848,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754538392,"statfs":{"total":773094113280,"available":772647313408,"internally_reserved":0,"allocated":26468352,"data_stored":15352467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6305957,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-84,"num_write_kb":-6186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.010902"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":553,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-08-18T22:34:19.844219+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:34:19.844219+0000","last_peered":"2024-08-18T22:34:19.844219+0000","last_clean":"2024-08-18T22:34:19.844219+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:34:19.844219+0000","last_undegraded":"2024-08-18T22:34:19.844219+0000","last_fullsized":"2024-08-18T22:34:19.844219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509626,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52388,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319452,"statfs":{"total":96636764160,"available":96583118848,"internally_reserved":0,"allocated":3231744,"data_stored":1838291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509628,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51804,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320036,"statfs":{"total":96636764160,"available":96583716864,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509626,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51804,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320036,"statfs":{"total":96636764160,"available":96583716864,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509627,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47648,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509626,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47648,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509627,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60708,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311132,"statfs":{"total":96636764160,"available":96574599168,"internally_reserved":0,"allocated":3231744,"data_stored":1838291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60124,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311716,"statfs":{"total":96636764160,"available":96575197184,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64204,"kb_used_data":6656,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94307636,"statfs":{"total":96636764160,"available":96571019264,"internally_reserved":0,"allocated":6815744,"data_stored":5436270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:34:24.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T22:34:24.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:34:24.692 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:34:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.761+0000 7f22ff800640 1 Processor -- start 2024-08-18T22:34:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.761+0000 7f22ff800640 1 -- start start 2024-08-18T22:34:24.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22ff800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f806f290 0x7f22f80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22ff800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22f80cd3a0 0x7f22f8072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22ff800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f80cee20 con 0x7f22f815b010 2024-08-18T22:34:24.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22ff800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f22f80cfa30 con 0x7f22f80cd3a0 2024-08-18T22:34:24.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22ff800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22f80cf100 con 0x7f22f806f290 2024-08-18T22:34:24.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22fd800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22f80cd3a0 0x7f22f8072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22fd800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22f80cd3a0 0x7f22f8072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50954/0 (socket says 172.21.15.5:50954) 2024-08-18T22:34:24.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22fd800640 1 -- 172.21.15.5:0/3911723416 learned_addr learned my addr 172.21.15.5:0/3911723416 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:24.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22f7e00640 1 --2- 172.21.15.5:0/3911723416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f806f290 0x7f22f80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22fd800640 1 -- 172.21.15.5:0/3911723416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f806f290 msgr2=0x7f22f80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:24.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22fd800640 1 --2- 172.21.15.5:0/3911723416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f806f290 0x7f22f80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22fd800640 1 -- 172.21.15.5:0/3911723416 >> v1:172.21.15.117:6789/0 conn(0x7f22f815b010 legacy=0x7f22f806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:24.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22fd800640 1 -- 172.21.15.5:0/3911723416 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f80cf3e0 con 0x7f22f80cd3a0 2024-08-18T22:34:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.765+0000 7f22f7e00640 1 --2- 172.21.15.5:0/3911723416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f806f290 0x7f22f80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:34:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22fd800640 1 --2- 172.21.15.5:0/3911723416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f80cd3a0 0x7f22f8072620 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009e50 tx=0x7f22f001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfb91353c08d6f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22f7400640 1 -- 172.21.15.5:0/3911723416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f00a5820 con 0x7f22f80cd3a0 2024-08-18T22:34:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22f7400640 1 -- 172.21.15.5:0/3911723416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f00a59c0 con 0x7f22f80cd3a0 2024-08-18T22:34:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22f7400640 1 -- 172.21.15.5:0/3911723416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f00a5d90 con 0x7f22f80cd3a0 2024-08-18T22:34:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22ff800640 1 -- 172.21.15.5:0/3911723416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f80cd3a0 msgr2=0x7f22f8072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22ff800640 1 --2- 172.21.15.5:0/3911723416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f80cd3a0 0x7f22f8072620 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009e50 tx=0x7f22f001c9c0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22ff800640 1 -- 172.21.15.5:0/3911723416 shutdown_connections 2024-08-18T22:34:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22ff800640 1 --2- 172.21.15.5:0/3911723416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f80cd3a0 0x7f22f8072620 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22ff800640 1 --2- 172.21.15.5:0/3911723416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f806f290 0x7f22f80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22ff800640 1 -- 172.21.15.5:0/3911723416 >> 172.21.15.5:0/3911723416 conn(0x7f22f80b1c50 msgr2=0x7f22f80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22ff800640 1 -- 172.21.15.5:0/3911723416 shutdown_connections 2024-08-18T22:34:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22ff800640 1 -- 172.21.15.5:0/3911723416 wait complete. 2024-08-18T22:34:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22ff800640 1 Processor -- start 2024-08-18T22:34:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.769+0000 7f22ff800640 1 -- start start 2024-08-18T22:34:24.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22ff800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22f806f290 0x7f22f814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22ff800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f80cd3a0 0x7f22f80b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22ff800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f815b010 0x7f22f80b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22ff800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f22f80734f0 con 0x7f22f80cd3a0 2024-08-18T22:34:24.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22ff800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f22f8073370 con 0x7f22f806f290 2024-08-18T22:34:24.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22ff800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f22f8073670 con 0x7f22f815b010 2024-08-18T22:34:24.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f80cd3a0 0x7f22f80b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f80cd3a0 0x7f22f80b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50960/0 (socket says 172.21.15.5:50960) 2024-08-18T22:34:24.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f7e00640 1 -- 172.21.15.5:0/2184575260 learned_addr learned my addr 172.21.15.5:0/2184575260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:24.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22fce00640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22f806f290 0x7f22f814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22fd800640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f815b010 0x7f22f80b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f7e00640 1 -- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f815b010 msgr2=0x7f22f80b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f7e00640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f815b010 0x7f22f80b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f7e00640 1 -- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22f806f290 msgr2=0x7f22f814dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f7e00640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22f806f290 0x7f22f814dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f7e00640 1 -- 172.21.15.5:0/2184575260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f80af5c0 con 0x7f22f80cd3a0 2024-08-18T22:34:24.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f7e00640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f80cd3a0 0x7f22f80b5380 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c820 tx=0x7f22e400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:24.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f4c00640 1 -- 172.21.15.5:0/2184575260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4015070 con 0x7f22f80cd3a0 2024-08-18T22:34:24.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f4c00640 1 -- 172.21.15.5:0/2184575260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e4007a30 con 0x7f22f80cd3a0 2024-08-18T22:34:24.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f4c00640 1 -- 172.21.15.5:0/2184575260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4007de0 con 0x7f22f80cd3a0 2024-08-18T22:34:24.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22ff800640 1 -- 172.21.15.5:0/2184575260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f809d150 con 0x7f22f80cd3a0 2024-08-18T22:34:24.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22ff800640 1 -- 172.21.15.5:0/2184575260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f809d710 con 0x7f22f80cd3a0 2024-08-18T22:34:24.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22ff800640 1 -- 172.21.15.5:0/2184575260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f80ce840 con 0x7f22f80cd3a0 2024-08-18T22:34:24.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.773+0000 7f22f4c00640 1 -- 172.21.15.5:0/2184575260 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f22e4018070 con 0x7f22f80cd3a0 2024-08-18T22:34:24.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.777+0000 7f22f4c00640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22d80678f0 0x7f22d8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:24.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.777+0000 7f22f4c00640 1 -- 172.21.15.5:0/2184575260 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f22e4085910 con 0x7f22f80cd3a0 2024-08-18T22:34:24.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.777+0000 7f22fce00640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22d80678f0 0x7f22d8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:24.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.777+0000 7f22fce00640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22d80678f0 0x7f22d8069db0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f22f80b6170 tx=0x7f22e8009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:24.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.781+0000 7f22f4c00640 1 -- 172.21.15.5:0/2184575260 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f22e4055f70 con 0x7f22f80cd3a0 2024-08-18T22:34:24.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.945+0000 7f22ff800640 1 -- 172.21.15.5:0/2184575260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22f80ca360 con 0x7f22f80cd3a0 2024-08-18T22:34:24.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.945+0000 7f22f4c00640 1 -- 172.21.15.5:0/2184575260 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) ==== 74+0+13233 (secure 0 0 0) 0x7f22e405a270 con 0x7f22f80cd3a0 2024-08-18T22:34:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:24.945 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":209,"fsid":"f2affb9c-c71f-418c-b271-e1d1f0126ce6","created":"2024-08-18T22:18:56.532408+0000","modified":"2024-08-18T22:34:19.835273+0000","last_up_change":"2024-08-18T22:19:08.036621+0000","last_in_change":"2024-08-18T22:18:59.047526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:19:07.674256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"708d328f-f3eb-496e-a877-30f10b8329cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6817","nonce":1731152634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6819","nonce":1731152634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6823","nonce":1731152634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1731152634},{"type":"v1","addr":"172.21.15.5:6821","nonce":1731152634}]},"public_addr":"172.21.15.5:6817/1731152634","cluster_addr":"172.21.15.5:6819/1731152634","heartbeat_back_addr":"172.21.15.5:6823/1731152634","heartbeat_front_addr":"172.21.15.5:6821/1731152634","state":["exists","up"]},{"osd":1,"uuid":"20e893d5-0c8f-4279-b071-ecbbfbc29fc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6809","nonce":1222447850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6811","nonce":1222447850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6815","nonce":1222447850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1222447850},{"type":"v1","addr":"172.21.15.5:6813","nonce":1222447850}]},"public_addr":"172.21.15.5:6809/1222447850","cluster_addr":"172.21.15.5:6811/1222447850","heartbeat_back_addr":"172.21.15.5:6815/1222447850","heartbeat_front_addr":"172.21.15.5:6813/1222447850","state":["exists","up"]},{"osd":2,"uuid":"cba182a0-c800-42a4-bd59-4bc2ce934664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6801","nonce":3144131686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6803","nonce":3144131686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6807","nonce":3144131686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3144131686},{"type":"v1","addr":"172.21.15.5:6805","nonce":3144131686}]},"public_addr":"172.21.15.5:6801/3144131686","cluster_addr":"172.21.15.5:6803/3144131686","heartbeat_back_addr":"172.21.15.5:6807/3144131686","heartbeat_front_addr":"172.21.15.5:6805/3144131686","state":["exists","up"]},{"osd":3,"uuid":"1f50a6c9-c25c-4aeb-8223-99d3e72109e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6825","nonce":493498667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6827","nonce":493498667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6831","nonce":493498667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":493498667},{"type":"v1","addr":"172.21.15.5:6829","nonce":493498667}]},"public_addr":"172.21.15.5:6825/493498667","cluster_addr":"172.21.15.5:6827/493498667","heartbeat_back_addr":"172.21.15.5:6831/493498667","heartbeat_front_addr":"172.21.15.5:6829/493498667","state":["exists","up"]},{"osd":4,"uuid":"4ec5efef-c389-4ce1-b35b-5eb1f849b2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6801","nonce":79447292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6803","nonce":79447292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6807","nonce":79447292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":79447292},{"type":"v1","addr":"172.21.15.117:6805","nonce":79447292}]},"public_addr":"172.21.15.117:6801/79447292","cluster_addr":"172.21.15.117:6803/79447292","heartbeat_back_addr":"172.21.15.117:6807/79447292","heartbeat_front_addr":"172.21.15.117:6805/79447292","state":["exists","up"]},{"osd":5,"uuid":"968481cc-7b86-4f1d-b75b-d26d7a16f6d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6809","nonce":3793560082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6813","nonce":3793560082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6820","nonce":3793560082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":3793560082},{"type":"v1","addr":"172.21.15.117:6817","nonce":3793560082}]},"public_addr":"172.21.15.117:6809/3793560082","cluster_addr":"172.21.15.117:6813/3793560082","heartbeat_back_addr":"172.21.15.117:6820/3793560082","heartbeat_front_addr":"172.21.15.117:6817/3793560082","state":["exists","up"]},{"osd":6,"uuid":"cbe8d5b9-094d-4440-9ad0-c91f3bdb191a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6825","nonce":3026847861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6827","nonce":3026847861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6831","nonce":3026847861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3026847861},{"type":"v1","addr":"172.21.15.117:6829","nonce":3026847861}]},"public_addr":"172.21.15.117:6825/3026847861","cluster_addr":"172.21.15.117:6827/3026847861","heartbeat_back_addr":"172.21.15.117:6831/3026847861","heartbeat_front_addr":"172.21.15.117:6829/3026847861","state":["exists","up"]},{"osd":7,"uuid":"bb964935-4b9c-4fdf-a348-0ccd0de5abd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":202,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6812","nonce":2024227284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6816","nonce":2024227284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6823","nonce":2024227284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6819","nonce":2024227284},{"type":"v1","addr":"172.21.15.117:6821","nonce":2024227284}]},"public_addr":"172.21.15.117:6812/2024227284","cluster_addr":"172.21.15.117:6816/2024227284","heartbeat_back_addr":"172.21.15.117:6823/2024227284","heartbeat_front_addr":"172.21.15.117:6821/2024227284","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.775571+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.795546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.571347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.780334+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.614789+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.962628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.743150+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:19:04.888501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6836/3939158605":"2024-08-19T22:34:16.825351+0000","172.21.15.117:6834/3939158605":"2024-08-19T22:34:16.825351+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:34:24.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 -- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22d80678f0 msgr2=0x7f22d8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22d80678f0 0x7f22d8069db0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f22f80b6170 tx=0x7f22e8009060 comp rx=0 tx=0).stop 2024-08-18T22:34:24.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 -- 172.21.15.5:0/2184575260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f80cd3a0 msgr2=0x7f22f80b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:24.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f80cd3a0 0x7f22f80b5380 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c820 tx=0x7f22e400cce0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 -- 172.21.15.5:0/2184575260 shutdown_connections 2024-08-18T22:34:24.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f22d80678f0 0x7f22d8069db0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22f815b010 0x7f22f80b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f80cd3a0 0x7f22f80b5380 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 --2- 172.21.15.5:0/2184575260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22f806f290 0x7f22f814dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:24.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 -- 172.21.15.5:0/2184575260 >> 172.21.15.5:0/2184575260 conn(0x7f22f80b1c50 msgr2=0x7f22f806da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:24.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 -- 172.21.15.5:0/2184575260 shutdown_connections 2024-08-18T22:34:24.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:24.949+0000 7f22ff800640 1 -- 172.21.15.5:0/2184575260 wait complete. 2024-08-18T22:34:25.967 INFO:tasks.ceph:Scrubbing osd.0 2024-08-18T22:34:25.968 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-18T22:34:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.125+0000 7fb79a400640 1 Processor -- start 2024-08-18T22:34:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.125+0000 7fb79a400640 1 -- start start 2024-08-18T22:34:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb79a400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb794155290 0x7fb7940ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb79a400640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb79415f690 con 0x7fb7940b4c60 2024-08-18T22:34:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb79a400640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb79415ea80 con 0x7fb7940b5080 2024-08-18T22:34:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb79a400640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb79415ed60 con 0x7fb794155290 2024-08-18T22:34:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb793400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb794155290 0x7fb7940ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb792a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb7940b4c60 0x7fb794072280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43442/0 (socket says 172.21.15.5:43442) 2024-08-18T22:34:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb793400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb794155290 0x7fb7940ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50968/0 (socket says 172.21.15.5:50968) 2024-08-18T22:34:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb792a00640 1 -- 172.21.15.5:0/2120802850 learned_addr learned my addr 172.21.15.5:0/2120802850 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb793400640 1 -- 172.21.15.5:0/2120802850 >> v1:172.21.15.117:6789/0 conn(0x7fb7940b5080 legacy=0x7fb7940b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb793400640 1 -- 172.21.15.5:0/2120802850 >> v1:172.21.15.5:6789/0 conn(0x7fb7940b4c60 legacy=0x7fb794072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb793400640 1 -- 172.21.15.5:0/2120802850 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79415f040 con 0x7fb794155290 2024-08-18T22:34:26.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.129+0000 7fb793400640 1 --2- 172.21.15.5:0/2120802850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb794155290 0x7fb7940ad8b0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fb7840097c0 tx=0x7fb78401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbef27225431c26 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb792000640 1 -- 172.21.15.5:0/2120802850 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7840b0070 con 0x7fb794155290 2024-08-18T22:34:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb792000640 1 -- 172.21.15.5:0/2120802850 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7840ab600 con 0x7fb794155290 2024-08-18T22:34:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb792000640 1 -- 172.21.15.5:0/2120802850 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7840ab9d0 con 0x7fb794155290 2024-08-18T22:34:26.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 -- 172.21.15.5:0/2120802850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb794155290 msgr2=0x7fb7940ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 --2- 172.21.15.5:0/2120802850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb794155290 0x7fb7940ad8b0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fb7840097c0 tx=0x7fb78401c460 comp rx=0 tx=0).stop 2024-08-18T22:34:26.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 -- 172.21.15.5:0/2120802850 shutdown_connections 2024-08-18T22:34:26.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 --2- 172.21.15.5:0/2120802850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb794155290 0x7fb7940ad8b0 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 -- 172.21.15.5:0/2120802850 >> 172.21.15.5:0/2120802850 conn(0x7fb79406bb80 msgr2=0x7fb79406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 -- 172.21.15.5:0/2120802850 shutdown_connections 2024-08-18T22:34:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 -- 172.21.15.5:0/2120802850 wait complete. 2024-08-18T22:34:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 Processor -- start 2024-08-18T22:34:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 -- start start 2024-08-18T22:34:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7940b4c60 0x7fb794168a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7940b5080 0x7fb794146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb794155290 0x7fb7941481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb794072b10 con 0x7fb794155290 2024-08-18T22:34:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb794072990 con 0x7fb7940b4c60 2024-08-18T22:34:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb79a400640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb7940b3f60 con 0x7fb7940b5080 2024-08-18T22:34:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb793e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb794155290 0x7fb7941481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb793e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb794155290 0x7fb7941481e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50984/0 (socket says 172.21.15.5:50984) 2024-08-18T22:34:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb793e00640 1 -- 172.21.15.5:0/3263270536 learned_addr learned my addr 172.21.15.5:0/3263270536 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb793400640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7940b4c60 0x7fb794168a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.133+0000 7fb792a00640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7940b5080 0x7fb794146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb793e00640 1 -- 172.21.15.5:0/3263270536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7940b5080 msgr2=0x7fb794146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb793e00640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7940b5080 0x7fb794146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb793e00640 1 -- 172.21.15.5:0/3263270536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7940b4c60 msgr2=0x7fb794168a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb793e00640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7940b4c60 0x7fb794168a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb793e00640 1 -- 172.21.15.5:0/3263270536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79415d720 con 0x7fb794155290 2024-08-18T22:34:26.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb793e00640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb794155290 0x7fb7941481e0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00c780 tx=0x7fb78c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb78b400640 1 -- 172.21.15.5:0/3263270536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c004b70 con 0x7fb794155290 2024-08-18T22:34:26.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb78b400640 1 -- 172.21.15.5:0/3263270536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb78c004d10 con 0x7fb794155290 2024-08-18T22:34:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb78b400640 1 -- 172.21.15.5:0/3263270536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c00aa90 con 0x7fb794155290 2024-08-18T22:34:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb79a400640 1 -- 172.21.15.5:0/3263270536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79415da00 con 0x7fb794155290 2024-08-18T22:34:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb79a400640 1 -- 172.21.15.5:0/3263270536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb794168f70 con 0x7fb794155290 2024-08-18T22:34:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb79a400640 1 -- 172.21.15.5:0/3263270536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7940b0760 con 0x7fb794155290 2024-08-18T22:34:26.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb78b400640 1 -- 172.21.15.5:0/3263270536 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb78c00ac30 con 0x7fb794155290 2024-08-18T22:34:26.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb78b400640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb7740678c0 0x7fb774069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.137+0000 7fb78b400640 1 -- 172.21.15.5:0/3263270536 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7fb78c085f10 con 0x7fb794155290 2024-08-18T22:34:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.141+0000 7fb78b400640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x7fb77406dd60 0x7fb7740701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.141+0000 7fb78b400640 1 -- 172.21.15.5:0/3263270536 --> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb78c0020c0 con 0x7fb77406dd60 2024-08-18T22:34:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.141+0000 7fb78b400640 1 -- 172.21.15.5:0/3263270536 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7fb78c0862c0 con 0x7fb794155290 2024-08-18T22:34:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.141+0000 7fb793400640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb7740678c0 0x7fb774069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.141+0000 7fb792a00640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x7fb77406dd60 0x7fb7740701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.141+0000 7fb792a00640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x7fb77406dd60 0x7fb7740701a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.141+0000 7fb793400640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb7740678c0 0x7fb774069d80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb7840ad000 tx=0x7fb7840a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.141+0000 7fb78b400640 1 -- 172.21.15.5:0/3263270536 <== osd.0 v2:172.21.15.5:6816/1731152634 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb78c0020c0 con 0x7fb77406dd60 2024-08-18T22:34:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb79a400640 1 -- 172.21.15.5:0/3263270536 --> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb7940b4320 con 0x7fb77406dd60 2024-08-18T22:34:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb78b400640 1 -- 172.21.15.5:0/3263270536 <== osd.0 v2:172.21.15.5:6816/1731152634 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb7940b4320 con 0x7fb77406dd60 2024-08-18T22:34:26.152 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:34:26.153 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T22:34:26.153 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:34:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb79a400640 1 -- 172.21.15.5:0/3263270536 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x7fb77406dd60 msgr2=0x7fb7740701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb79a400640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.5:6816/1731152634,v1:172.21.15.5:6817/1731152634] conn(0x7fb77406dd60 0x7fb7740701a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb79a400640 1 -- 172.21.15.5:0/3263270536 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb7740678c0 msgr2=0x7fb774069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb79a400640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb7740678c0 0x7fb774069d80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb7840ad000 tx=0x7fb7840a6000 comp rx=0 tx=0).stop 2024-08-18T22:34:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb79a400640 1 -- 172.21.15.5:0/3263270536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb794155290 msgr2=0x7fb7941481e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb79a400640 1 --2- 172.21.15.5:0/3263270536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb794155290 0x7fb7941481e0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00c780 tx=0x7fb78c00cc40 comp rx=0 tx=0).stop 2024-08-18T22:34:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb793e00640 1 -- 172.21.15.5:0/3263270536 reap_dead start 2024-08-18T22:34:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb79a400640 1 -- 172.21.15.5:0/3263270536 shutdown_connections 2024-08-18T22:34:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb79a400640 1 -- 172.21.15.5:0/3263270536 >> 172.21.15.5:0/3263270536 conn(0x7fb79406bb80 msgr2=0x7fb794070470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.153+0000 7fb79a400640 1 -- 172.21.15.5:0/3263270536 shutdown_connections 2024-08-18T22:34:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.157+0000 7fb79a400640 1 -- 172.21.15.5:0/3263270536 wait complete. 2024-08-18T22:34:26.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-18T22:34:26.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.313+0000 7fd890000640 1 Processor -- start 2024-08-18T22:34:26.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.313+0000 7fd890000640 1 -- start start 2024-08-18T22:34:26.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.313+0000 7fd890000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8880b1300 0x7fd888162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.313+0000 7fd890000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88806e8a0 con 0x7fd88809b080 2024-08-18T22:34:26.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.313+0000 7fd890000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88809bb80 con 0x7fd88809aca0 2024-08-18T22:34:26.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.313+0000 7fd890000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd8880d2e40 con 0x7fd8880b1300 2024-08-18T22:34:26.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd88e000640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd88809b080 0x7fd8880b01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43452/0 (socket says 172.21.15.5:43452) 2024-08-18T22:34:26.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd88e000640 1 -- 172.21.15.5:0/629753707 learned_addr learned my addr 172.21.15.5:0/629753707 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:26.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd88cc00640 1 --2- 172.21.15.5:0/629753707 >> v2:172.21.15.5:3300/0 conn(0x7fd8880b1300 0x7fd888162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd887e00640 1 -- 172.21.15.5:0/629753707 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733837897 0 0) 0x7fd88806e8a0 con 0x7fd88809b080 2024-08-18T22:34:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd887e00640 1 -- 172.21.15.5:0/629753707 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd870003530 con 0x7fd88809b080 2024-08-18T22:34:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd88cc00640 1 -- 172.21.15.5:0/629753707 >> v1:172.21.15.117:6789/0 conn(0x7fd88809aca0 legacy=0x7fd8880afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd88cc00640 1 -- 172.21.15.5:0/629753707 >> v1:172.21.15.5:6789/0 conn(0x7fd88809b080 legacy=0x7fd8880b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd88cc00640 1 -- 172.21.15.5:0/629753707 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88806cbd0 con 0x7fd8880b1300 2024-08-18T22:34:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd88cc00640 1 --2- 172.21.15.5:0/629753707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880b1300 0x7fd888162950 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7fd8740097c0 tx=0x7fd87401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5188c98710abb041 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd887e00640 1 -- 172.21.15.5:0/629753707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8740b1070 con 0x7fd8880b1300 2024-08-18T22:34:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd887e00640 1 -- 172.21.15.5:0/629753707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8740ac410 con 0x7fd8880b1300 2024-08-18T22:34:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.317+0000 7fd887e00640 1 -- 172.21.15.5:0/629753707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8740ac7c0 con 0x7fd8880b1300 2024-08-18T22:34:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 -- 172.21.15.5:0/629753707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880b1300 msgr2=0x7fd888162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 --2- 172.21.15.5:0/629753707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880b1300 0x7fd888162950 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7fd8740097c0 tx=0x7fd87401c4a0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 -- 172.21.15.5:0/629753707 shutdown_connections 2024-08-18T22:34:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 --2- 172.21.15.5:0/629753707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880b1300 0x7fd888162950 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 -- 172.21.15.5:0/629753707 >> 172.21.15.5:0/629753707 conn(0x7fd8880d2180 msgr2=0x7fd8880d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 -- 172.21.15.5:0/629753707 shutdown_connections 2024-08-18T22:34:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 -- 172.21.15.5:0/629753707 wait complete. 2024-08-18T22:34:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 Processor -- start 2024-08-18T22:34:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 -- start start 2024-08-18T22:34:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88809aca0 0x7fd888153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88809b080 0x7fd88815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8880b1300 0x7fd8880ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd88816ced0 con 0x7fd88809b080 2024-08-18T22:34:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd88816cd50 con 0x7fd8880b1300 2024-08-18T22:34:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd890000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fd88816d050 con 0x7fd88809aca0 2024-08-18T22:34:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd88cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88809b080 0x7fd88815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd88cc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88809b080 0x7fd88815c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51000/0 (socket says 172.21.15.5:51000) 2024-08-18T22:34:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd88cc00640 1 -- 172.21.15.5:0/2464494379 learned_addr learned my addr 172.21.15.5:0/2464494379 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd88d600640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88809aca0 0x7fd888153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd88e000640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8880b1300 0x7fd8880ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd88cc00640 1 -- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88809aca0 msgr2=0x7fd888153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd88cc00640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88809aca0 0x7fd888153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd88cc00640 1 -- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8880b1300 msgr2=0x7fd8880ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd88cc00640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8880b1300 0x7fd8880ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.321+0000 7fd88cc00640 1 -- 172.21.15.5:0/2464494379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88815ff90 con 0x7fd88809b080 2024-08-18T22:34:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.325+0000 7fd88cc00640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88809b080 0x7fd88815c580 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fd8740097c0 tx=0x7fd874019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.325+0000 7fd885600640 1 -- 172.21.15.5:0/2464494379 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8740bc070 con 0x7fd88809b080 2024-08-18T22:34:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.325+0000 7fd885600640 1 -- 172.21.15.5:0/2464494379 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8740acd70 con 0x7fd88809b080 2024-08-18T22:34:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.325+0000 7fd885600640 1 -- 172.21.15.5:0/2464494379 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8740b1040 con 0x7fd88809b080 2024-08-18T22:34:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.325+0000 7fd890000640 1 -- 172.21.15.5:0/2464494379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd888160270 con 0x7fd88809b080 2024-08-18T22:34:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.325+0000 7fd890000640 1 -- 172.21.15.5:0/2464494379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd888160830 con 0x7fd88809b080 2024-08-18T22:34:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.325+0000 7fd890000640 1 -- 172.21.15.5:0/2464494379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8880afa90 con 0x7fd88809b080 2024-08-18T22:34:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.325+0000 7fd885600640 1 -- 172.21.15.5:0/2464494379 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd874004230 con 0x7fd88809b080 2024-08-18T22:34:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.325+0000 7fd885600640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8680678c0 0x7fd868069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.325+0000 7fd885600640 1 -- 172.21.15.5:0/2464494379 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7fd87411e980 con 0x7fd88809b080 2024-08-18T22:34:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.329+0000 7fd88d600640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8680678c0 0x7fd868069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.329+0000 7fd88d600640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8680678c0 0x7fd868069d80 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd88809b5d0 tx=0x7fd87c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.329+0000 7fd885600640 1 -- 172.21.15.5:0/2464494379 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fd874016090 con 0x7fd88809b080 2024-08-18T22:34:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.497+0000 7fd890000640 1 -- 172.21.15.5:0/2464494379 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd8880715c0 con 0x7fd8680678c0 2024-08-18T22:34:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.497+0000 7fd885600640 1 -- 172.21.15.5:0/2464494379 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd8880715c0 con 0x7fd8680678c0 2024-08-18T22:34:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2024-08-18T22:34:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 -- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8680678c0 msgr2=0x7fd868069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8680678c0 0x7fd868069d80 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd88809b5d0 tx=0x7fd87c009040 comp rx=0 tx=0).stop 2024-08-18T22:34:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 -- 172.21.15.5:0/2464494379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88809b080 msgr2=0x7fd88815c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88809b080 0x7fd88815c580 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fd8740097c0 tx=0x7fd874019240 comp rx=0 tx=0).stop 2024-08-18T22:34:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 -- 172.21.15.5:0/2464494379 shutdown_connections 2024-08-18T22:34:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fd8680678c0 0x7fd868069d80 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8880b1300 0x7fd8880ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88809b080 0x7fd88815c580 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 --2- 172.21.15.5:0/2464494379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd88809aca0 0x7fd888153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 -- 172.21.15.5:0/2464494379 >> 172.21.15.5:0/2464494379 conn(0x7fd8880d2180 msgr2=0x7fd88806fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 -- 172.21.15.5:0/2464494379 shutdown_connections 2024-08-18T22:34:26.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.501+0000 7fd890000640 1 -- 172.21.15.5:0/2464494379 wait complete. 2024-08-18T22:34:26.517 INFO:tasks.ceph:Scrubbing osd.1 2024-08-18T22:34:26.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-18T22:34:26.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e52e00640 1 Processor -- start 2024-08-18T22:34:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e52e00640 1 -- start start 2024-08-18T22:34:26.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e52e00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e4c147ce0 0x7f9e4c0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e52e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e4c070ab0 0x7f9e4c0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e52e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e4c1486b0 con 0x7f9e4c0afee0 2024-08-18T22:34:26.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e52e00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f9e4c0b3c60 con 0x7f9e4c070ab0 2024-08-18T22:34:26.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e52e00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9e4c0b3f40 con 0x7f9e4c147ce0 2024-08-18T22:34:26.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e50e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e4c070ab0 0x7f9e4c0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e50e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e4c070ab0 0x7f9e4c0b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51010/0 (socket says 172.21.15.5:51010) 2024-08-18T22:34:26.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e50e00640 1 -- 172.21.15.5:0/4031140445 learned_addr learned my addr 172.21.15.5:0/4031140445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:26.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e4be00640 1 --2- 172.21.15.5:0/4031140445 >> v2:172.21.15.117:3300/0 conn(0x7f9e4c147ce0 0x7f9e4c0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e50e00640 1 -- 172.21.15.5:0/4031140445 >> v2:172.21.15.117:3300/0 conn(0x7f9e4c147ce0 msgr2=0x7f9e4c0af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:26.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e50e00640 1 --2- 172.21.15.5:0/4031140445 >> v2:172.21.15.117:3300/0 conn(0x7f9e4c147ce0 0x7f9e4c0af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e50e00640 1 -- 172.21.15.5:0/4031140445 >> v1:172.21.15.117:6789/0 conn(0x7f9e4c0afee0 legacy=0x7f9e4c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:26.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.665+0000 7f9e50e00640 1 -- 172.21.15.5:0/4031140445 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4c0b4220 con 0x7f9e4c070ab0 2024-08-18T22:34:26.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e50e00640 1 --2- 172.21.15.5:0/4031140445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e4c070ab0 0x7f9e4c0b4a20 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c072090 tx=0x7f9e4401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0e9aeceb83d2c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e4b400640 1 -- 172.21.15.5:0/4031140445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e440a5890 con 0x7f9e4c070ab0 2024-08-18T22:34:26.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e4b400640 1 -- 172.21.15.5:0/4031140445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e440a5a30 con 0x7f9e4c070ab0 2024-08-18T22:34:26.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e4b400640 1 -- 172.21.15.5:0/4031140445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e440a5e00 con 0x7f9e4c070ab0 2024-08-18T22:34:26.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e52e00640 1 -- 172.21.15.5:0/4031140445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e4c070ab0 msgr2=0x7f9e4c0b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e52e00640 1 --2- 172.21.15.5:0/4031140445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e4c070ab0 0x7f9e4c0b4a20 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c072090 tx=0x7f9e4401c9b0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e52e00640 1 -- 172.21.15.5:0/4031140445 shutdown_connections 2024-08-18T22:34:26.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e52e00640 1 --2- 172.21.15.5:0/4031140445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e4c070ab0 0x7f9e4c0b4a20 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e52e00640 1 --2- 172.21.15.5:0/4031140445 >> v2:172.21.15.117:3300/0 conn(0x7f9e4c147ce0 0x7f9e4c0af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e52e00640 1 -- 172.21.15.5:0/4031140445 >> 172.21.15.5:0/4031140445 conn(0x7f9e4c0732f0 msgr2=0x7f9e4c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:26.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e52e00640 1 -- 172.21.15.5:0/4031140445 shutdown_connections 2024-08-18T22:34:26.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.669+0000 7f9e52e00640 1 -- 172.21.15.5:0/4031140445 wait complete. 2024-08-18T22:34:26.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e52e00640 1 Processor -- start 2024-08-18T22:34:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e52e00640 1 -- start start 2024-08-18T22:34:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e52e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e4c070ab0 0x7f9e4c144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e52e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e4c0afee0 0x7f9e4c13f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e52e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e4c147ce0 0x7f9e4c140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e52e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c0b5b00 con 0x7f9e4c0afee0 2024-08-18T22:34:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e52e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c0b5980 con 0x7f9e4c147ce0 2024-08-18T22:34:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e52e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f9e4c0b5c80 con 0x7f9e4c070ab0 2024-08-18T22:34:26.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e43400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e4c0afee0 0x7f9e4c13f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e4be00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e4c070ab0 0x7f9e4c144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e43400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e4c0afee0 0x7f9e4c13f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51020/0 (socket says 172.21.15.5:51020) 2024-08-18T22:34:26.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e43400640 1 -- 172.21.15.5:0/909619939 learned_addr learned my addr 172.21.15.5:0/909619939 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:26.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e50e00640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e4c147ce0 0x7f9e4c140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e43400640 1 -- 172.21.15.5:0/909619939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e4c070ab0 msgr2=0x7f9e4c144140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e43400640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e4c070ab0 0x7f9e4c144140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e43400640 1 -- 172.21.15.5:0/909619939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e4c147ce0 msgr2=0x7f9e4c140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e43400640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e4c147ce0 0x7f9e4c140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e43400640 1 -- 172.21.15.5:0/909619939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4c160670 con 0x7f9e4c0afee0 2024-08-18T22:34:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e43400640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e4c0afee0 0x7f9e4c13f570 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400b410 tx=0x7f9e3400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e48c00640 1 -- 172.21.15.5:0/909619939 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34015030 con 0x7f9e4c0afee0 2024-08-18T22:34:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e48c00640 1 -- 172.21.15.5:0/909619939 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e34004020 con 0x7f9e4c0afee0 2024-08-18T22:34:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e48c00640 1 -- 172.21.15.5:0/909619939 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34004450 con 0x7f9e4c0afee0 2024-08-18T22:34:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e52e00640 1 -- 172.21.15.5:0/909619939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e4c160950 con 0x7f9e4c0afee0 2024-08-18T22:34:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e52e00640 1 -- 172.21.15.5:0/909619939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e4c160f10 con 0x7f9e4c0afee0 2024-08-18T22:34:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.673+0000 7f9e52e00640 1 -- 172.21.15.5:0/909619939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e4c068f50 con 0x7f9e4c0afee0 2024-08-18T22:34:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.677+0000 7f9e48c00640 1 -- 172.21.15.5:0/909619939 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e34018070 con 0x7f9e4c0afee0 2024-08-18T22:34:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.677+0000 7f9e48c00640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9e280678c0 0x7f9e28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.677+0000 7f9e48c00640 1 -- 172.21.15.5:0/909619939 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f9e34085e50 con 0x7f9e4c0afee0 2024-08-18T22:34:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.677+0000 7f9e48c00640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] conn(0x7f9e2806dd60 0x7f9e280701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.677+0000 7f9e48c00640 1 -- 172.21.15.5:0/909619939 --> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e3401fec0 con 0x7f9e2806dd60 2024-08-18T22:34:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.677+0000 7f9e48c00640 1 -- 172.21.15.5:0/909619939 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7f9e34086200 con 0x7f9e4c0afee0 2024-08-18T22:34:26.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.677+0000 7f9e4be00640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9e280678c0 0x7f9e28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.677+0000 7f9e50e00640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] conn(0x7f9e2806dd60 0x7f9e280701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.677+0000 7f9e4be00640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9e280678c0 0x7f9e28069d80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c007a60 tx=0x7f9e3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.677+0000 7f9e50e00640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] conn(0x7f9e2806dd60 0x7f9e280701a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.677+0000 7f9e48c00640 1 -- 172.21.15.5:0/909619939 <== osd.1 v2:172.21.15.5:6808/1222447850 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e3401fec0 con 0x7f9e2806dd60 2024-08-18T22:34:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e52e00640 1 -- 172.21.15.5:0/909619939 --> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9e4c0b4a20 con 0x7f9e2806dd60 2024-08-18T22:34:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e48c00640 1 -- 172.21.15.5:0/909619939 <== osd.1 v2:172.21.15.5:6808/1222447850 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9e4c0b4a20 con 0x7f9e2806dd60 2024-08-18T22:34:26.702 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:34:26.702 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T22:34:26.702 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:34:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e52e00640 1 -- 172.21.15.5:0/909619939 >> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] conn(0x7f9e2806dd60 msgr2=0x7f9e280701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e52e00640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.5:6808/1222447850,v1:172.21.15.5:6809/1222447850] conn(0x7f9e2806dd60 0x7f9e280701a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e52e00640 1 -- 172.21.15.5:0/909619939 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9e280678c0 msgr2=0x7f9e28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e52e00640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f9e280678c0 0x7f9e28069d80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c007a60 tx=0x7f9e3c008040 comp rx=0 tx=0).stop 2024-08-18T22:34:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e52e00640 1 -- 172.21.15.5:0/909619939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e4c0afee0 msgr2=0x7f9e4c13f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e52e00640 1 --2- 172.21.15.5:0/909619939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e4c0afee0 0x7f9e4c13f570 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400b410 tx=0x7f9e3400b8d0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e50e00640 1 -- 172.21.15.5:0/909619939 reap_dead start 2024-08-18T22:34:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e52e00640 1 -- 172.21.15.5:0/909619939 shutdown_connections 2024-08-18T22:34:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e52e00640 1 -- 172.21.15.5:0/909619939 >> 172.21.15.5:0/909619939 conn(0x7f9e4c0732f0 msgr2=0x7f9e4c06c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e52e00640 1 -- 172.21.15.5:0/909619939 shutdown_connections 2024-08-18T22:34:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.693+0000 7f9e52e00640 1 -- 172.21.15.5:0/909619939 wait complete. 2024-08-18T22:34:26.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-18T22:34:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.853+0000 7f6a74a00640 1 Processor -- start 2024-08-18T22:34:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.853+0000 7f6a74a00640 1 -- start start 2024-08-18T22:34:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.853+0000 7f6a74a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6a7015b0c0 0x7f6a7006db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.853+0000 7f6a74a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a700b31f0 con 0x7f6a700b40c0 2024-08-18T22:34:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.853+0000 7f6a74a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a700b34d0 con 0x7f6a700cf290 2024-08-18T22:34:26.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.853+0000 7f6a74a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6a700b3d70 con 0x7f6a7015b0c0 2024-08-18T22:34:26.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.853+0000 7f6a65400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6a700b40c0 0x7f6a70072a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43464/0 (socket says 172.21.15.5:43464) 2024-08-18T22:34:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.853+0000 7f6a65400640 1 -- 172.21.15.5:0/537870453 learned_addr learned my addr 172.21.15.5:0/537870453 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.857+0000 7f6a6de00640 1 --2- 172.21.15.5:0/537870453 >> v2:172.21.15.117:3300/0 conn(0x7f6a7015b0c0 0x7f6a7006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.857+0000 7f6a6d400640 1 -- 172.21.15.5:0/537870453 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3105901947 0 0) 0x7f6a700b31f0 con 0x7f6a700b40c0 2024-08-18T22:34:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.857+0000 7f6a6d400640 1 -- 172.21.15.5:0/537870453 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a54003530 con 0x7f6a700b40c0 2024-08-18T22:34:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.857+0000 7f6a6de00640 1 -- 172.21.15.5:0/537870453 >> v1:172.21.15.117:6789/0 conn(0x7f6a700cf290 legacy=0x7f6a70073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.857+0000 7f6a6de00640 1 -- 172.21.15.5:0/537870453 >> v1:172.21.15.5:6789/0 conn(0x7f6a700b40c0 legacy=0x7f6a70072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.857+0000 7f6a6de00640 1 -- 172.21.15.5:0/537870453 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a700b37b0 con 0x7f6a7015b0c0 2024-08-18T22:34:26.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.857+0000 7f6a6de00640 1 --2- 172.21.15.5:0/537870453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a7015b0c0 0x7f6a7006db80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6a600097c0 tx=0x7f6a6001c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ca532a1d0abf50d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.861+0000 7f6a6d400640 1 -- 172.21.15.5:0/537870453 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a600b0070 con 0x7f6a7015b0c0 2024-08-18T22:34:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.861+0000 7f6a6d400640 1 -- 172.21.15.5:0/537870453 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a600ab600 con 0x7f6a7015b0c0 2024-08-18T22:34:26.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.861+0000 7f6a6d400640 1 -- 172.21.15.5:0/537870453 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a600ab9d0 con 0x7f6a7015b0c0 2024-08-18T22:34:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.861+0000 7f6a74a00640 1 -- 172.21.15.5:0/537870453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a7015b0c0 msgr2=0x7f6a7006db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.861+0000 7f6a74a00640 1 --2- 172.21.15.5:0/537870453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a7015b0c0 0x7f6a7006db80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6a600097c0 tx=0x7f6a6001c350 comp rx=0 tx=0).stop 2024-08-18T22:34:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.861+0000 7f6a74a00640 1 -- 172.21.15.5:0/537870453 shutdown_connections 2024-08-18T22:34:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.861+0000 7f6a74a00640 1 --2- 172.21.15.5:0/537870453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a7015b0c0 0x7f6a7006db80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.861+0000 7f6a74a00640 1 -- 172.21.15.5:0/537870453 >> 172.21.15.5:0/537870453 conn(0x7f6a700b1dc0 msgr2=0x7f6a700b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:26.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.861+0000 7f6a74a00640 1 -- 172.21.15.5:0/537870453 shutdown_connections 2024-08-18T22:34:26.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.861+0000 7f6a74a00640 1 -- 172.21.15.5:0/537870453 wait complete. 2024-08-18T22:34:26.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a74a00640 1 Processor -- start 2024-08-18T22:34:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a74a00640 1 -- start start 2024-08-18T22:34:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a74a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a700b40c0 0x7f6a70151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a74a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a700cf290 0x7f6a70149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a74a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a7015b0c0 0x7f6a7014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a74a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6a700b48e0 con 0x7f6a700b40c0 2024-08-18T22:34:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a74a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7015b4a0 con 0x7f6a700cf290 2024-08-18T22:34:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a74a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f6a70150c80 con 0x7f6a7015b0c0 2024-08-18T22:34:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a6de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a700b40c0 0x7f6a70151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a6de00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a700b40c0 0x7f6a70151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51028/0 (socket says 172.21.15.5:51028) 2024-08-18T22:34:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a65400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a700cf290 0x7f6a70149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a6de00640 1 -- 172.21.15.5:0/2443418880 learned_addr learned my addr 172.21.15.5:0/2443418880 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:26.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a6e800640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a7015b0c0 0x7f6a7014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a6de00640 1 -- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a7015b0c0 msgr2=0x7f6a7014f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a6de00640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a7015b0c0 0x7f6a7014f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a6de00640 1 -- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a700cf290 msgr2=0x7f6a70149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a6de00640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a700cf290 0x7f6a70149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a6de00640 1 -- 172.21.15.5:0/2443418880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a70150070 con 0x7f6a700b40c0 2024-08-18T22:34:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a65400640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a700cf290 0x7f6a70149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:34:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a6de00640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a700b40c0 0x7f6a70151110 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f6a600ae040 tx=0x7f6a6001ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a66a00640 1 -- 172.21.15.5:0/2443418880 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a600b0050 con 0x7f6a700b40c0 2024-08-18T22:34:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a66a00640 1 -- 172.21.15.5:0/2443418880 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a600bc070 con 0x7f6a700b40c0 2024-08-18T22:34:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a66a00640 1 -- 172.21.15.5:0/2443418880 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a600b5870 con 0x7f6a700b40c0 2024-08-18T22:34:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.865+0000 7f6a74a00640 1 -- 172.21.15.5:0/2443418880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a70150350 con 0x7f6a700b40c0 2024-08-18T22:34:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.869+0000 7f6a74a00640 1 -- 172.21.15.5:0/2443418880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a70150910 con 0x7f6a700b40c0 2024-08-18T22:34:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.869+0000 7f6a74a00640 1 -- 172.21.15.5:0/2443418880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a7006f670 con 0x7f6a700b40c0 2024-08-18T22:34:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.869+0000 7f6a66a00640 1 -- 172.21.15.5:0/2443418880 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a600b5a10 con 0x7f6a700b40c0 2024-08-18T22:34:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.869+0000 7f6a66a00640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a4c0678c0 0x7f6a4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.869+0000 7f6a66a00640 1 -- 172.21.15.5:0/2443418880 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f6a60120130 con 0x7f6a700b40c0 2024-08-18T22:34:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.869+0000 7f6a65400640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a4c0678c0 0x7f6a4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.869+0000 7f6a65400640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a4c0678c0 0x7f6a4c069d80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6a701f8880 tx=0x7f6a58007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:26.873+0000 7f6a66a00640 1 -- 172.21.15.5:0/2443418880 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f6a60016090 con 0x7f6a700b40c0 2024-08-18T22:34:27.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 -- 172.21.15.5:0/2443418880 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f6a700cda20 con 0x7f6a4c0678c0 2024-08-18T22:34:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a66a00640 1 -- 172.21.15.5:0/2443418880 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6a700cda20 con 0x7f6a4c0678c0 2024-08-18T22:34:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2024-08-18T22:34:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 -- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a4c0678c0 msgr2=0x7f6a4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a4c0678c0 0x7f6a4c069d80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6a701f8880 tx=0x7f6a58007d40 comp rx=0 tx=0).stop 2024-08-18T22:34:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 -- 172.21.15.5:0/2443418880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a700b40c0 msgr2=0x7f6a70151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a700b40c0 0x7f6a70151110 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f6a600ae040 tx=0x7f6a6001ab90 comp rx=0 tx=0).stop 2024-08-18T22:34:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 -- 172.21.15.5:0/2443418880 shutdown_connections 2024-08-18T22:34:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f6a4c0678c0 0x7f6a4c069d80 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a7015b0c0 0x7f6a7014f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a700cf290 0x7f6a70149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 --2- 172.21.15.5:0/2443418880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a700b40c0 0x7f6a70151110 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 -- 172.21.15.5:0/2443418880 >> 172.21.15.5:0/2443418880 conn(0x7f6a700b1dc0 msgr2=0x7f6a700b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 -- 172.21.15.5:0/2443418880 shutdown_connections 2024-08-18T22:34:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.041+0000 7f6a74a00640 1 -- 172.21.15.5:0/2443418880 wait complete. 2024-08-18T22:34:27.059 INFO:tasks.ceph:Scrubbing osd.2 2024-08-18T22:34:27.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-18T22:34:27.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.205+0000 7f03b6200640 1 Processor -- start 2024-08-18T22:34:27.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.205+0000 7f03b6200640 1 -- start start 2024-08-18T22:34:27.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03b6200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b006db50 0x7f03b00af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03b6200640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b006ff20 con 0x7f03b00b71c0 2024-08-18T22:34:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03b6200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b00701c0 con 0x7f03b015e560 2024-08-18T22:34:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03b6200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03b0070dd0 con 0x7f03b006db50 2024-08-18T22:34:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03aea00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f03b00b71c0 0x7f03b006d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43470/0 (socket says 172.21.15.5:43470) 2024-08-18T22:34:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03aea00640 1 -- 172.21.15.5:0/61723359 learned_addr learned my addr 172.21.15.5:0/61723359 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:27.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03afe00640 1 --2- 172.21.15.5:0/61723359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b006db50 0x7f03b00af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03ae000640 1 -- 172.21.15.5:0/61723359 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3318580310 0 0) 0x7f03b006ff20 con 0x7f03b00b71c0 2024-08-18T22:34:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03ae000640 1 -- 172.21.15.5:0/61723359 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0394003530 con 0x7f03b00b71c0 2024-08-18T22:34:27.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03ae000640 1 -- 172.21.15.5:0/61723359 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118999075 0 0) 0x7f03b00701c0 con 0x7f03b015e560 2024-08-18T22:34:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03ae000640 1 -- 172.21.15.5:0/61723359 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b006ff20 con 0x7f03b015e560 2024-08-18T22:34:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03afe00640 1 -- 172.21.15.5:0/61723359 >> v1:172.21.15.117:6789/0 conn(0x7f03b015e560 legacy=0x7f03b00b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03ae000640 1 -- 172.21.15.5:0/61723359 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3595994941 0 0) 0x7f0394003530 con 0x7f03b00b71c0 2024-08-18T22:34:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03afe00640 1 -- 172.21.15.5:0/61723359 >> v1:172.21.15.5:6789/0 conn(0x7f03b00b71c0 legacy=0x7f03b006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.209+0000 7f03afe00640 1 -- 172.21.15.5:0/61723359 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b00704a0 con 0x7f03b006db50 2024-08-18T22:34:27.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03afe00640 1 --2- 172.21.15.5:0/61723359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b006db50 0x7f03b00af040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097f0 tx=0x7f03a801c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59ca6f738b8db496 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03ae000640 1 -- 172.21.15.5:0/61723359 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a80b0070 con 0x7f03b006db50 2024-08-18T22:34:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03ae000640 1 -- 172.21.15.5:0/61723359 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a8004030 con 0x7f03b006db50 2024-08-18T22:34:27.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03ae000640 1 -- 172.21.15.5:0/61723359 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c001680 con 0x7f03b006db50 2024-08-18T22:34:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03b6200640 1 -- 172.21.15.5:0/61723359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b006db50 msgr2=0x7f03b00af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03b6200640 1 --2- 172.21.15.5:0/61723359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b006db50 0x7f03b00af040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097f0 tx=0x7f03a801c3d0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03b6200640 1 -- 172.21.15.5:0/61723359 shutdown_connections 2024-08-18T22:34:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03b6200640 1 --2- 172.21.15.5:0/61723359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b006db50 0x7f03b00af040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03b6200640 1 -- 172.21.15.5:0/61723359 >> 172.21.15.5:0/61723359 conn(0x7f03b00b3dd0 msgr2=0x7f03b00b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03b6200640 1 -- 172.21.15.5:0/61723359 shutdown_connections 2024-08-18T22:34:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03b6200640 1 -- 172.21.15.5:0/61723359 wait complete. 2024-08-18T22:34:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03b6200640 1 Processor -- start 2024-08-18T22:34:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.213+0000 7f03b6200640 1 -- start start 2024-08-18T22:34:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03b6200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b006db50 0x7f03b0155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03b6200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b00b71c0 0x7f03b00b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03b6200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b015e560 0x7f03b00b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03b6200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0071de0 con 0x7f03b015e560 2024-08-18T22:34:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03b6200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0071c60 con 0x7f03b006db50 2024-08-18T22:34:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03b6200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f03b0071f60 con 0x7f03b00b71c0 2024-08-18T22:34:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b015e560 0x7f03b00b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03afe00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b015e560 0x7f03b00b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51036/0 (socket says 172.21.15.5:51036) 2024-08-18T22:34:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03afe00640 1 -- 172.21.15.5:0/3970878673 learned_addr learned my addr 172.21.15.5:0/3970878673 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03aea00640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b00b71c0 0x7f03b00b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03af400640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b006db50 0x7f03b0155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03afe00640 1 -- 172.21.15.5:0/3970878673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b00b71c0 msgr2=0x7f03b00b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03afe00640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03b00b71c0 0x7f03b00b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03afe00640 1 -- 172.21.15.5:0/3970878673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b006db50 msgr2=0x7f03b0155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03afe00640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03b006db50 0x7f03b0155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03afe00640 1 -- 172.21.15.5:0/3970878673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b01543f0 con 0x7f03b015e560 2024-08-18T22:34:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03afe00640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b015e560 0x7f03b00b3280 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097f0 tx=0x7f03a8019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03a7400640 1 -- 172.21.15.5:0/3970878673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a80b0040 con 0x7f03b015e560 2024-08-18T22:34:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03a7400640 1 -- 172.21.15.5:0/3970878673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a80bc070 con 0x7f03b015e560 2024-08-18T22:34:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03b6200640 1 -- 172.21.15.5:0/3970878673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b01546d0 con 0x7f03b015e560 2024-08-18T22:34:27.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03a7400640 1 -- 172.21.15.5:0/3970878673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8003be0 con 0x7f03b015e560 2024-08-18T22:34:27.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03b6200640 1 -- 172.21.15.5:0/3970878673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b0154c90 con 0x7f03b015e560 2024-08-18T22:34:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03b6200640 1 -- 172.21.15.5:0/3970878673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f03b0155070 con 0x7f03b015e560 2024-08-18T22:34:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.217+0000 7f03a7400640 1 -- 172.21.15.5:0/3970878673 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f03a80b3070 con 0x7f03b015e560 2024-08-18T22:34:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.221+0000 7f03a7400640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03900678f0 0x7f0390069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.221+0000 7f03a7400640 1 -- 172.21.15.5:0/3970878673 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f03a811f7d0 con 0x7f03b015e560 2024-08-18T22:34:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.221+0000 7f03a7400640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x7f039006dd90 0x7f03900701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.221+0000 7f03a7400640 1 -- 172.21.15.5:0/3970878673 --> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03a80aaec0 con 0x7f039006dd90 2024-08-18T22:34:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.221+0000 7f03a7400640 1 -- 172.21.15.5:0/3970878673 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7f03a81242c0 con 0x7f03b015e560 2024-08-18T22:34:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.221+0000 7f03af400640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03900678f0 0x7f0390069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.221+0000 7f03aea00640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x7f039006dd90 0x7f03900701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.221+0000 7f03af400640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03900678f0 0x7f0390069db0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f03a0007fd0 tx=0x7f03a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.221+0000 7f03aea00640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x7f039006dd90 0x7f03900701d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.221+0000 7f03a7400640 1 -- 172.21.15.5:0/3970878673 <== osd.2 v2:172.21.15.5:6800/3144131686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f03a80aaec0 con 0x7f039006dd90 2024-08-18T22:34:27.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.233+0000 7f03b6200640 1 -- 172.21.15.5:0/3970878673 --> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f03b00af040 con 0x7f039006dd90 2024-08-18T22:34:27.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03a7400640 1 -- 172.21.15.5:0/3970878673 <== osd.2 v2:172.21.15.5:6800/3144131686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f03b00af040 con 0x7f039006dd90 2024-08-18T22:34:27.233 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:34:27.234 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T22:34:27.234 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:34:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03b6200640 1 -- 172.21.15.5:0/3970878673 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x7f039006dd90 msgr2=0x7f03900701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03b6200640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.5:6800/3144131686,v1:172.21.15.5:6801/3144131686] conn(0x7f039006dd90 0x7f03900701d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03b6200640 1 -- 172.21.15.5:0/3970878673 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03900678f0 msgr2=0x7f0390069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03b6200640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f03900678f0 0x7f0390069db0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f03a0007fd0 tx=0x7f03a0009040 comp rx=0 tx=0).stop 2024-08-18T22:34:27.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03b6200640 1 -- 172.21.15.5:0/3970878673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b015e560 msgr2=0x7f03b00b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03b6200640 1 --2- 172.21.15.5:0/3970878673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03b015e560 0x7f03b00b3280 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097f0 tx=0x7f03a8019170 comp rx=0 tx=0).stop 2024-08-18T22:34:27.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03afe00640 1 -- 172.21.15.5:0/3970878673 reap_dead start 2024-08-18T22:34:27.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03b6200640 1 -- 172.21.15.5:0/3970878673 shutdown_connections 2024-08-18T22:34:27.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03b6200640 1 -- 172.21.15.5:0/3970878673 >> 172.21.15.5:0/3970878673 conn(0x7f03b00b3dd0 msgr2=0x7f03b00b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:27.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03b6200640 1 -- 172.21.15.5:0/3970878673 shutdown_connections 2024-08-18T22:34:27.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.237+0000 7f03b6200640 1 -- 172.21.15.5:0/3970878673 wait complete. 2024-08-18T22:34:27.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-18T22:34:27.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f3e00640 1 Processor -- start 2024-08-18T22:34:27.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f3e00640 1 -- start start 2024-08-18T22:34:27.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f40d2420 0x7f10f4071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f3e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f40d1980 con 0x7f10f40719d0 2024-08-18T22:34:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f3e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f40b5480 con 0x7f10f415bd70 2024-08-18T22:34:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f3e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10f40722f0 con 0x7f10f40d2420 2024-08-18T22:34:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f3400640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f10f40719d0 0x7f10f40b6c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43478/0 (socket says 172.21.15.5:43478) 2024-08-18T22:34:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f3400640 1 -- 172.21.15.5:0/518711480 learned_addr learned my addr 172.21.15.5:0/518711480 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f2000640 1 --2- 172.21.15.5:0/518711480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f40d2420 0x7f10f4071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f1600640 1 -- 172.21.15.5:0/518711480 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136980021 0 0) 0x7f10f40d1980 con 0x7f10f40719d0 2024-08-18T22:34:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f1600640 1 -- 172.21.15.5:0/518711480 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10d8003530 con 0x7f10f40719d0 2024-08-18T22:34:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f2000640 1 -- 172.21.15.5:0/518711480 >> v1:172.21.15.117:6789/0 conn(0x7f10f415bd70 legacy=0x7f10f40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f2000640 1 -- 172.21.15.5:0/518711480 >> v1:172.21.15.5:6789/0 conn(0x7f10f40719d0 legacy=0x7f10f40b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.397+0000 7f10f2000640 1 -- 172.21.15.5:0/518711480 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f40d1c20 con 0x7f10f40d2420 2024-08-18T22:34:27.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.401+0000 7f10f2000640 1 --2- 172.21.15.5:0/518711480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f40d2420 0x7f10f4071490 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097f0 tx=0x7f10e001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78d023276e292416 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.401+0000 7f10f1600640 1 -- 172.21.15.5:0/518711480 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00b0070 con 0x7f10f40d2420 2024-08-18T22:34:27.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.401+0000 7f10f1600640 1 -- 172.21.15.5:0/518711480 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e00ab600 con 0x7f10f40d2420 2024-08-18T22:34:27.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.401+0000 7f10f1600640 1 -- 172.21.15.5:0/518711480 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00ab9d0 con 0x7f10f40d2420 2024-08-18T22:34:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.401+0000 7f10f3e00640 1 -- 172.21.15.5:0/518711480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f40d2420 msgr2=0x7f10f4071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.401+0000 7f10f3e00640 1 --2- 172.21.15.5:0/518711480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f40d2420 0x7f10f4071490 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097f0 tx=0x7f10e001c450 comp rx=0 tx=0).stop 2024-08-18T22:34:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.401+0000 7f10f3e00640 1 -- 172.21.15.5:0/518711480 shutdown_connections 2024-08-18T22:34:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.401+0000 7f10f3e00640 1 --2- 172.21.15.5:0/518711480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f40d2420 0x7f10f4071490 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.401+0000 7f10f3e00640 1 -- 172.21.15.5:0/518711480 >> 172.21.15.5:0/518711480 conn(0x7f10f40b3da0 msgr2=0x7f10f40b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.401+0000 7f10f3e00640 1 -- 172.21.15.5:0/518711480 shutdown_connections 2024-08-18T22:34:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.401+0000 7f10f3e00640 1 -- 172.21.15.5:0/518711480 wait complete. 2024-08-18T22:34:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3e00640 1 Processor -- start 2024-08-18T22:34:27.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3e00640 1 -- start start 2024-08-18T22:34:27.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f40719d0 0x7f10f415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10f40d2420 0x7f10f415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f415bd70 0x7f10f415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f10f40b5220 con 0x7f10f40719d0 2024-08-18T22:34:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f10f40b50a0 con 0x7f10f40d2420 2024-08-18T22:34:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f10f40d2860 con 0x7f10f415bd70 2024-08-18T22:34:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f40719d0 0x7f10f415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f2a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f40719d0 0x7f10f415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51044/0 (socket says 172.21.15.5:51044) 2024-08-18T22:34:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f2a00640 1 -- 172.21.15.5:0/2183935569 learned_addr learned my addr 172.21.15.5:0/2183935569 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f2000640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10f40d2420 0x7f10f415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3400640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f415bd70 0x7f10f415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f2a00640 1 -- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f415bd70 msgr2=0x7f10f415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f2a00640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f415bd70 0x7f10f415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f2a00640 1 -- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10f40d2420 msgr2=0x7f10f415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f2a00640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10f40d2420 0x7f10f415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f2a00640 1 -- 172.21.15.5:0/2183935569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f406dc00 con 0x7f10f40719d0 2024-08-18T22:34:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f2a00640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f40719d0 0x7f10f415a5e0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c420 tx=0x7f10e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10eaa00640 1 -- 172.21.15.5:0/2183935569 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e40052d0 con 0x7f10f40719d0 2024-08-18T22:34:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10eaa00640 1 -- 172.21.15.5:0/2183935569 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e4005470 con 0x7f10f40719d0 2024-08-18T22:34:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3e00640 1 -- 172.21.15.5:0/2183935569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f406cb60 con 0x7f10f40719d0 2024-08-18T22:34:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10eaa00640 1 -- 172.21.15.5:0/2183935569 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4007260 con 0x7f10f40719d0 2024-08-18T22:34:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3e00640 1 -- 172.21.15.5:0/2183935569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f406d120 con 0x7f10f40719d0 2024-08-18T22:34:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.405+0000 7f10f3e00640 1 -- 172.21.15.5:0/2183935569 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f4071490 con 0x7f10f40719d0 2024-08-18T22:34:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.409+0000 7f10eaa00640 1 -- 172.21.15.5:0/2183935569 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10e4007400 con 0x7f10f40719d0 2024-08-18T22:34:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.409+0000 7f10eaa00640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10d40678c0 0x7f10d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.409+0000 7f10eaa00640 1 -- 172.21.15.5:0/2183935569 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f10e4084ff0 con 0x7f10f40719d0 2024-08-18T22:34:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.409+0000 7f10f2000640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10d40678c0 0x7f10d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.409+0000 7f10f2000640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10d40678c0 0x7f10d4069d80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f10e00ad000 tx=0x7f10e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.413+0000 7f10eaa00640 1 -- 172.21.15.5:0/2183935569 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f10e40555d0 con 0x7f10f40719d0 2024-08-18T22:34:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10f3e00640 1 -- 172.21.15.5:0/2183935569 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f10f40ce770 con 0x7f10d40678c0 2024-08-18T22:34:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10eaa00640 1 -- 172.21.15.5:0/2183935569 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f10f40ce770 con 0x7f10d40678c0 2024-08-18T22:34:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2024-08-18T22:34:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10f3e00640 1 -- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10d40678c0 msgr2=0x7f10d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10f3e00640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10d40678c0 0x7f10d4069d80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f10e00ad000 tx=0x7f10e0008040 comp rx=0 tx=0).stop 2024-08-18T22:34:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10f3e00640 1 -- 172.21.15.5:0/2183935569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f40719d0 msgr2=0x7f10f415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10f3e00640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f40719d0 0x7f10f415a5e0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c420 tx=0x7f10e400c8e0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10f3e00640 1 -- 172.21.15.5:0/2183935569 shutdown_connections 2024-08-18T22:34:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10f3e00640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f10d40678c0 0x7f10d4069d80 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10f3e00640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10f415bd70 0x7f10f415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10f3e00640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10f40d2420 0x7f10f415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10f3e00640 1 --2- 172.21.15.5:0/2183935569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f40719d0 0x7f10f415a5e0 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.577+0000 7f10f3e00640 1 -- 172.21.15.5:0/2183935569 >> 172.21.15.5:0/2183935569 conn(0x7f10f40b3da0 msgr2=0x7f10f40b7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.581+0000 7f10f3e00640 1 -- 172.21.15.5:0/2183935569 shutdown_connections 2024-08-18T22:34:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.581+0000 7f10f3e00640 1 -- 172.21.15.5:0/2183935569 wait complete. 2024-08-18T22:34:27.596 INFO:tasks.ceph:Scrubbing osd.3 2024-08-18T22:34:27.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-18T22:34:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2b6000640 1 Processor -- start 2024-08-18T22:34:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2b6000640 1 -- start start 2024-08-18T22:34:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2b6000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2b00d0580 0x7fe2b00d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2b6000640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b015bf80 con 0x7fe2b01555d0 2024-08-18T22:34:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2b6000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b00cfaa0 con 0x7fe2b00cda40 2024-08-18T22:34:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2b6000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b006f9f0 con 0x7fe2b00d0580 2024-08-18T22:34:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2a7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2b00d0580 0x7fe2b00d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2a7e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2b00d0580 0x7fe2b00d09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51050/0 (socket says 172.21.15.5:51050) 2024-08-18T22:34:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2a7e00640 1 -- 172.21.15.5:0/373185032 learned_addr learned my addr 172.21.15.5:0/373185032 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2a7e00640 1 -- 172.21.15.5:0/373185032 >> v1:172.21.15.117:6789/0 conn(0x7fe2b00cda40 legacy=0x7fe2b015b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2a7e00640 1 -- 172.21.15.5:0/373185032 >> v1:172.21.15.5:6789/0 conn(0x7fe2b01555d0 legacy=0x7fe2b015c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.745+0000 7fe2a7e00640 1 -- 172.21.15.5:0/373185032 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b00cfd80 con 0x7fe2b00d0580 2024-08-18T22:34:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.749+0000 7fe2a7e00640 1 --2- 172.21.15.5:0/373185032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2b00d0580 0x7fe2b00d09e0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7fe298009870 tx=0x7fe29801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b420ef22ebfcdce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.749+0000 7fe2afe00640 1 -- 172.21.15.5:0/373185032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2980b1070 con 0x7fe2b00d0580 2024-08-18T22:34:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.749+0000 7fe2afe00640 1 -- 172.21.15.5:0/373185032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2980ac630 con 0x7fe2b00d0580 2024-08-18T22:34:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.749+0000 7fe2afe00640 1 -- 172.21.15.5:0/373185032 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2980a8050 con 0x7fe2b00d0580 2024-08-18T22:34:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.749+0000 7fe2b6000640 1 -- 172.21.15.5:0/373185032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2b00d0580 msgr2=0x7fe2b00d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.749+0000 7fe2b6000640 1 --2- 172.21.15.5:0/373185032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2b00d0580 0x7fe2b00d09e0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7fe298009870 tx=0x7fe29801c520 comp rx=0 tx=0).stop 2024-08-18T22:34:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.749+0000 7fe2b6000640 1 -- 172.21.15.5:0/373185032 shutdown_connections 2024-08-18T22:34:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.749+0000 7fe2b6000640 1 --2- 172.21.15.5:0/373185032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2b00d0580 0x7fe2b00d09e0 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.749+0000 7fe2b6000640 1 -- 172.21.15.5:0/373185032 >> 172.21.15.5:0/373185032 conn(0x7fe2b006e970 msgr2=0x7fe2b006ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.749+0000 7fe2b6000640 1 -- 172.21.15.5:0/373185032 shutdown_connections 2024-08-18T22:34:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.749+0000 7fe2b6000640 1 -- 172.21.15.5:0/373185032 wait complete. 2024-08-18T22:34:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b6000640 1 Processor -- start 2024-08-18T22:34:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b6000640 1 -- start start 2024-08-18T22:34:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b6000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2b00cda40 0x7fe2b0154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b6000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2b00d0580 0x7fe2b0159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b6000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b01555d0 0x7fe2b0161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b6000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b015cd80 con 0x7fe2b00d0580 2024-08-18T22:34:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b6000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b015cc00 con 0x7fe2b01555d0 2024-08-18T22:34:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b6000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b01692b0 con 0x7fe2b00cda40 2024-08-18T22:34:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2b00d0580 0x7fe2b0159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2a7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2b00d0580 0x7fe2b0159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51054/0 (socket says 172.21.15.5:51054) 2024-08-18T22:34:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2a7e00640 1 -- 172.21.15.5:0/1212677949 learned_addr learned my addr 172.21.15.5:0/1212677949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b5600640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b01555d0 0x7fe2b0161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b4c00640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2b00cda40 0x7fe2b0154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2a7e00640 1 -- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2b00cda40 msgr2=0x7fe2b0154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2a7e00640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2b00cda40 0x7fe2b0154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2a7e00640 1 -- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b01555d0 msgr2=0x7fe2b0161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2a7e00640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b01555d0 0x7fe2b0161b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2a7e00640 1 -- 172.21.15.5:0/1212677949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b0160d70 con 0x7fe2b00d0580 2024-08-18T22:34:27.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b5600640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2b01555d0 0x7fe2b0161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2a7e00640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2b00d0580 0x7fe2b0159e70 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7fe2980af040 tx=0x7fe2980192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2ad600640 1 -- 172.21.15.5:0/1212677949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2980bc070 con 0x7fe2b00d0580 2024-08-18T22:34:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2ad600640 1 -- 172.21.15.5:0/1212677949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2980b7630 con 0x7fe2b00d0580 2024-08-18T22:34:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2ad600640 1 -- 172.21.15.5:0/1212677949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2980b1040 con 0x7fe2b00d0580 2024-08-18T22:34:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b6000640 1 -- 172.21.15.5:0/1212677949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b0161050 con 0x7fe2b00d0580 2024-08-18T22:34:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b6000640 1 -- 172.21.15.5:0/1212677949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b0152a10 con 0x7fe2b00d0580 2024-08-18T22:34:27.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.753+0000 7fe2b6000640 1 -- 172.21.15.5:0/1212677949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe2b0161710 con 0x7fe2b00d0580 2024-08-18T22:34:27.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.757+0000 7fe2ad600640 1 -- 172.21.15.5:0/1212677949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe2980ac4f0 con 0x7fe2b00d0580 2024-08-18T22:34:27.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.757+0000 7fe2ad600640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe28c0678c0 0x7fe28c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.757+0000 7fe2ad600640 1 -- 172.21.15.5:0/1212677949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7fe29811f960 con 0x7fe2b00d0580 2024-08-18T22:34:27.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.757+0000 7fe2ad600640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] conn(0x7fe28c06dd60 0x7fe28c0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.757+0000 7fe2ad600640 1 -- 172.21.15.5:0/1212677949 --> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe298001d40 con 0x7fe28c06dd60 2024-08-18T22:34:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.757+0000 7fe2ad600640 1 -- 172.21.15.5:0/1212677949 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7fe29811fd10 con 0x7fe2b00d0580 2024-08-18T22:34:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.757+0000 7fe2b5600640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] conn(0x7fe28c06dd60 0x7fe28c0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.757+0000 7fe2b4c00640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe28c0678c0 0x7fe28c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.757+0000 7fe2b5600640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] conn(0x7fe28c06dd60 0x7fe28c0701a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.757+0000 7fe2b4c00640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe28c0678c0 0x7fe28c069d80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0165ba0 tx=0x7fe2a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.757+0000 7fe2ad600640 1 -- 172.21.15.5:0/1212677949 <== osd.3 v2:172.21.15.5:6824/493498667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe298001d40 con 0x7fe28c06dd60 2024-08-18T22:34:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b6000640 1 -- 172.21.15.5:0/1212677949 --> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe2b00d09e0 con 0x7fe28c06dd60 2024-08-18T22:34:27.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2ad600640 1 -- 172.21.15.5:0/1212677949 <== osd.3 v2:172.21.15.5:6824/493498667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe2b00d09e0 con 0x7fe28c06dd60 2024-08-18T22:34:27.770 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:34:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T22:34:27.770 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:34:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b6000640 1 -- 172.21.15.5:0/1212677949 >> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] conn(0x7fe28c06dd60 msgr2=0x7fe28c0701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b6000640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.5:6824/493498667,v1:172.21.15.5:6825/493498667] conn(0x7fe28c06dd60 0x7fe28c0701a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b6000640 1 -- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe28c0678c0 msgr2=0x7fe28c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b6000640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fe28c0678c0 0x7fe28c069d80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0165ba0 tx=0x7fe2a0009040 comp rx=0 tx=0).stop 2024-08-18T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b6000640 1 -- 172.21.15.5:0/1212677949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2b00d0580 msgr2=0x7fe2b0159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b6000640 1 --2- 172.21.15.5:0/1212677949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2b00d0580 0x7fe2b0159e70 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7fe2980af040 tx=0x7fe2980192c0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b5600640 1 -- 172.21.15.5:0/1212677949 reap_dead start 2024-08-18T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b6000640 1 -- 172.21.15.5:0/1212677949 shutdown_connections 2024-08-18T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b6000640 1 -- 172.21.15.5:0/1212677949 >> 172.21.15.5:0/1212677949 conn(0x7fe2b006e970 msgr2=0x7fe2b006ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b6000640 1 -- 172.21.15.5:0/1212677949 shutdown_connections 2024-08-18T22:34:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.773+0000 7fe2b6000640 1 -- 172.21.15.5:0/1212677949 wait complete. 2024-08-18T22:34:27.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-18T22:34:27.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8760a00640 1 Processor -- start 2024-08-18T22:34:27.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8760a00640 1 -- start start 2024-08-18T22:34:27.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8760a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f875c0b4390 0x7f875c0b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8760a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f875c15e600 0x7f875c15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8760a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f875c070990 con 0x7f875c0b2c60 2024-08-18T22:34:27.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8760a00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f875c15f7c0 con 0x7f875c0b4390 2024-08-18T22:34:27.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8760a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f875c0b61a0 con 0x7f875c15e600 2024-08-18T22:34:27.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8759e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f875c0b4390 0x7f875c0b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8759e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f875c0b4390 0x7f875c0b5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51068/0 (socket says 172.21.15.5:51068) 2024-08-18T22:34:27.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8759e00640 1 -- 172.21.15.5:0/4148683471 learned_addr learned my addr 172.21.15.5:0/4148683471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:27.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f875b200640 1 --2- 172.21.15.5:0/4148683471 >> v2:172.21.15.117:3300/0 conn(0x7f875c15e600 0x7f875c15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8759e00640 1 -- 172.21.15.5:0/4148683471 >> v2:172.21.15.117:3300/0 conn(0x7f875c15e600 msgr2=0x7f875c15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:27.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8759e00640 1 --2- 172.21.15.5:0/4148683471 >> v2:172.21.15.117:3300/0 conn(0x7f875c15e600 0x7f875c15ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8759e00640 1 -- 172.21.15.5:0/4148683471 >> v1:172.21.15.117:6789/0 conn(0x7f875c0b2c60 legacy=0x7f875c0b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:27.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f8759e00640 1 -- 172.21.15.5:0/4148683471 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f875c0b4800 con 0x7f875c0b4390 2024-08-18T22:34:27.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.933+0000 7f875b200640 1 --2- 172.21.15.5:0/4148683471 >> v2:172.21.15.117:3300/0 conn(0x7f875c15e600 0x7f875c15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:34:27.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8759e00640 1 --2- 172.21.15.5:0/4148683471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f875c0b4390 0x7f875c0b5c60 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f875c09f000 tx=0x7f874801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d72f367b5cdc2e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8759400640 1 -- 172.21.15.5:0/4148683471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87480b0070 con 0x7f875c0b4390 2024-08-18T22:34:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8759400640 1 -- 172.21.15.5:0/4148683471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87480ab600 con 0x7f875c0b4390 2024-08-18T22:34:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8759400640 1 -- 172.21.15.5:0/4148683471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87480ab9d0 con 0x7f875c0b4390 2024-08-18T22:34:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8760a00640 1 -- 172.21.15.5:0/4148683471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f875c0b4390 msgr2=0x7f875c0b5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8760a00640 1 --2- 172.21.15.5:0/4148683471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f875c0b4390 0x7f875c0b5c60 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f875c09f000 tx=0x7f874801c300 comp rx=0 tx=0).stop 2024-08-18T22:34:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8760a00640 1 -- 172.21.15.5:0/4148683471 shutdown_connections 2024-08-18T22:34:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8760a00640 1 --2- 172.21.15.5:0/4148683471 >> v2:172.21.15.117:3300/0 conn(0x7f875c15e600 0x7f875c15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8760a00640 1 --2- 172.21.15.5:0/4148683471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f875c0b4390 0x7f875c0b5c60 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8760a00640 1 -- 172.21.15.5:0/4148683471 >> 172.21.15.5:0/4148683471 conn(0x7f875c06cac0 msgr2=0x7f875c06ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8760a00640 1 -- 172.21.15.5:0/4148683471 shutdown_connections 2024-08-18T22:34:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.937+0000 7f8760a00640 1 -- 172.21.15.5:0/4148683471 wait complete. 2024-08-18T22:34:27.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8760a00640 1 Processor -- start 2024-08-18T22:34:27.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8760a00640 1 -- start start 2024-08-18T22:34:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8760a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f875c0b2c60 0x7f875c1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8760a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f875c0b4390 0x7f875c159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8760a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f875c15e600 0x7f875c0b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8760a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f875c06c230 con 0x7f875c0b4390 2024-08-18T22:34:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8760a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f875c06bcd0 con 0x7f875c15e600 2024-08-18T22:34:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8760a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f875c06c750 con 0x7f875c0b2c60 2024-08-18T22:34:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8759e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f875c0b4390 0x7f875c159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8759e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f875c0b4390 0x7f875c159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51084/0 (socket says 172.21.15.5:51084) 2024-08-18T22:34:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8759e00640 1 -- 172.21.15.5:0/4157234839 learned_addr learned my addr 172.21.15.5:0/4157234839 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f875a800640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f875c0b2c60 0x7f875c1597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f875b200640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f875c15e600 0x7f875c0b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8759e00640 1 -- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f875c0b2c60 msgr2=0x7f875c1597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8759e00640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f875c0b2c60 0x7f875c1597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8759e00640 1 -- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f875c15e600 msgr2=0x7f875c0b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8759e00640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f875c15e600 0x7f875c0b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8759e00640 1 -- 172.21.15.5:0/4157234839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f875c15a520 con 0x7f875c0b4390 2024-08-18T22:34:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8759e00640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f875c0b4390 0x7f875c159fe0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f87480ae040 tx=0x7f87480190a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8752a00640 1 -- 172.21.15.5:0/4157234839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87480b0040 con 0x7f875c0b4390 2024-08-18T22:34:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8752a00640 1 -- 172.21.15.5:0/4157234839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87480b9070 con 0x7f875c0b4390 2024-08-18T22:34:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8752a00640 1 -- 172.21.15.5:0/4157234839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87480b4880 con 0x7f875c0b4390 2024-08-18T22:34:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8760a00640 1 -- 172.21.15.5:0/4157234839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f875c15a7c0 con 0x7f875c0b4390 2024-08-18T22:34:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.941+0000 7f8760a00640 1 -- 172.21.15.5:0/4157234839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f875c158ff0 con 0x7f875c0b4390 2024-08-18T22:34:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.945+0000 7f8760a00640 1 -- 172.21.15.5:0/4157234839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f875c1589d0 con 0x7f875c0b4390 2024-08-18T22:34:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.945+0000 7f8752a00640 1 -- 172.21.15.5:0/4157234839 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87480b4a20 con 0x7f875c0b4390 2024-08-18T22:34:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.945+0000 7f8752a00640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f873c0678c0 0x7f873c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.945+0000 7f8752a00640 1 -- 172.21.15.5:0/4157234839 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f874811faf0 con 0x7f875c0b4390 2024-08-18T22:34:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.945+0000 7f875a800640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f873c0678c0 0x7f873c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.945+0000 7f875a800640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f873c0678c0 0x7f873c069d80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f874c004e30 tx=0x7f874c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:27.949+0000 7f8752a00640 1 -- 172.21.15.5:0/4157234839 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f875c0b4800 con 0x7f875c0b4390 2024-08-18T22:34:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.113+0000 7f8760a00640 1 -- 172.21.15.5:0/4157234839 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f875c159dc0 con 0x7f873c0678c0 2024-08-18T22:34:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.113+0000 7f8752a00640 1 -- 172.21.15.5:0/4157234839 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f875c159dc0 con 0x7f873c0678c0 2024-08-18T22:34:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2024-08-18T22:34:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 -- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f873c0678c0 msgr2=0x7f873c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f873c0678c0 0x7f873c069d80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f874c004e30 tx=0x7f874c009040 comp rx=0 tx=0).stop 2024-08-18T22:34:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 -- 172.21.15.5:0/4157234839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f875c0b4390 msgr2=0x7f875c159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f875c0b4390 0x7f875c159fe0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f87480ae040 tx=0x7f87480190a0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 -- 172.21.15.5:0/4157234839 shutdown_connections 2024-08-18T22:34:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f873c0678c0 0x7f873c069d80 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f875c15e600 0x7f875c0b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f875c0b4390 0x7f875c159fe0 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 --2- 172.21.15.5:0/4157234839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f875c0b2c60 0x7f875c1597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 -- 172.21.15.5:0/4157234839 >> 172.21.15.5:0/4157234839 conn(0x7f875c06cac0 msgr2=0x7f875c0d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 -- 172.21.15.5:0/4157234839 shutdown_connections 2024-08-18T22:34:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.117+0000 7f8760a00640 1 -- 172.21.15.5:0/4157234839 wait complete. 2024-08-18T22:34:28.133 INFO:tasks.ceph:Scrubbing osd.4 2024-08-18T22:34:28.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-18T22:34:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9ed600640 1 Processor -- start 2024-08-18T22:34:28.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9ed600640 1 -- start start 2024-08-18T22:34:28.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9ed600640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9e815f7d0 0x7ff9e80b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9ed600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff9e809ba50 0x7ff9e80b5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9ed600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e80d2e00 con 0x7ff9e80af9e0 2024-08-18T22:34:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9ed600640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e80b1700 con 0x7ff9e815f7d0 2024-08-18T22:34:28.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9ed600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e80b1420 con 0x7ff9e809ba50 2024-08-18T22:34:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9e6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9e815f7d0 0x7ff9e80b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9e6a00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9e815f7d0 0x7ff9e80b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51098/0 (socket says 172.21.15.5:51098) 2024-08-18T22:34:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9e6a00640 1 -- 172.21.15.5:0/4284307350 learned_addr learned my addr 172.21.15.5:0/4284307350 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9e6000640 1 --2- 172.21.15.5:0/4284307350 >> v2:172.21.15.117:3300/0 conn(0x7ff9e809ba50 0x7ff9e80b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9e6a00640 1 -- 172.21.15.5:0/4284307350 >> v2:172.21.15.117:3300/0 conn(0x7ff9e809ba50 msgr2=0x7ff9e80b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9e6a00640 1 --2- 172.21.15.5:0/4284307350 >> v2:172.21.15.117:3300/0 conn(0x7ff9e809ba50 0x7ff9e80b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9e6a00640 1 -- 172.21.15.5:0/4284307350 >> v1:172.21.15.117:6789/0 conn(0x7ff9e80af9e0 legacy=0x7ff9e80afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9e6a00640 1 -- 172.21.15.5:0/4284307350 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e80b0b20 con 0x7ff9e815f7d0 2024-08-18T22:34:28.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.281+0000 7ff9e6000640 1 --2- 172.21.15.5:0/4284307350 >> v2:172.21.15.117:3300/0 conn(0x7ff9e809ba50 0x7ff9e80b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9e6a00640 1 --2- 172.21.15.5:0/4284307350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9e815f7d0 0x7ff9e80b50f0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7ff9e806c780 tx=0x7ff9d801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967adb72ddd1ae24 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:28.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9e5600640 1 -- 172.21.15.5:0/4284307350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80ab600 con 0x7ff9e815f7d0 2024-08-18T22:34:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9e5600640 1 -- 172.21.15.5:0/4284307350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d80b0070 con 0x7ff9e815f7d0 2024-08-18T22:34:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9e5600640 1 -- 172.21.15.5:0/4284307350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80ab9c0 con 0x7ff9e815f7d0 2024-08-18T22:34:28.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9ed600640 1 -- 172.21.15.5:0/4284307350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9e815f7d0 msgr2=0x7ff9e80b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9ed600640 1 --2- 172.21.15.5:0/4284307350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9e815f7d0 0x7ff9e80b50f0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7ff9e806c780 tx=0x7ff9d801c4f0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9ed600640 1 -- 172.21.15.5:0/4284307350 shutdown_connections 2024-08-18T22:34:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9ed600640 1 --2- 172.21.15.5:0/4284307350 >> v2:172.21.15.117:3300/0 conn(0x7ff9e809ba50 0x7ff9e80b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9ed600640 1 --2- 172.21.15.5:0/4284307350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9e815f7d0 0x7ff9e80b50f0 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9ed600640 1 -- 172.21.15.5:0/4284307350 >> 172.21.15.5:0/4284307350 conn(0x7ff9e80d2160 msgr2=0x7ff9e80d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9ed600640 1 -- 172.21.15.5:0/4284307350 shutdown_connections 2024-08-18T22:34:28.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.285+0000 7ff9ed600640 1 -- 172.21.15.5:0/4284307350 wait complete. 2024-08-18T22:34:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9ed600640 1 Processor -- start 2024-08-18T22:34:28.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9ed600640 1 -- start start 2024-08-18T22:34:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9ed600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9e809ba50 0x7ff9e8165690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9ed600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80af9e0 0x7ff9e806d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9ed600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9e815f7d0 0x7ff9e8152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9ed600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e80b1af0 con 0x7ff9e815f7d0 2024-08-18T22:34:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9ed600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e80b1970 con 0x7ff9e809ba50 2024-08-18T22:34:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9ed600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e8070ae0 con 0x7ff9e80af9e0 2024-08-18T22:34:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9e7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9e815f7d0 0x7ff9e8152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9e7400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9e815f7d0 0x7ff9e8152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51104/0 (socket says 172.21.15.5:51104) 2024-08-18T22:34:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9e7400640 1 -- 172.21.15.5:0/574753491 learned_addr learned my addr 172.21.15.5:0/574753491 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9e6a00640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9e809ba50 0x7ff9e8165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9e6000640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80af9e0 0x7ff9e806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9e7400640 1 -- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80af9e0 msgr2=0x7ff9e806d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9e7400640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9e80af9e0 0x7ff9e806d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9e7400640 1 -- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9e809ba50 msgr2=0x7ff9e8165690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9e7400640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9e809ba50 0x7ff9e8165690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9e7400640 1 -- 172.21.15.5:0/574753491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e806d5d0 con 0x7ff9e815f7d0 2024-08-18T22:34:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9e7400640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9e815f7d0 0x7ff9e8152e00 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c770 tx=0x7ff9e000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:28.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9dea00640 1 -- 172.21.15.5:0/574753491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0003b80 con 0x7ff9e815f7d0 2024-08-18T22:34:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9dea00640 1 -- 172.21.15.5:0/574753491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e0003d20 con 0x7ff9e815f7d0 2024-08-18T22:34:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9dea00640 1 -- 172.21.15.5:0/574753491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e000aa90 con 0x7ff9e815f7d0 2024-08-18T22:34:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9ed600640 1 -- 172.21.15.5:0/574753491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e8153340 con 0x7ff9e815f7d0 2024-08-18T22:34:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.289+0000 7ff9ed600640 1 -- 172.21.15.5:0/574753491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e806de30 con 0x7ff9e815f7d0 2024-08-18T22:34:28.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.293+0000 7ff9ed600640 1 -- 172.21.15.5:0/574753491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9e80afdf0 con 0x7ff9e815f7d0 2024-08-18T22:34:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.293+0000 7ff9dea00640 1 -- 172.21.15.5:0/574753491 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff9e000ac30 con 0x7ff9e815f7d0 2024-08-18T22:34:28.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.293+0000 7ff9dea00640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9c80678c0 0x7ff9c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.293+0000 7ff9dea00640 1 -- 172.21.15.5:0/574753491 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7ff9e0086400 con 0x7ff9e815f7d0 2024-08-18T22:34:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.293+0000 7ff9dea00640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] conn(0x7ff9c806dd60 0x7ff9c80701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.293+0000 7ff9dea00640 1 -- 172.21.15.5:0/574753491 --> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9c8070870 con 0x7ff9c806dd60 2024-08-18T22:34:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.293+0000 7ff9dea00640 1 -- 172.21.15.5:0/574753491 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7ff9e00867b0 con 0x7ff9e815f7d0 2024-08-18T22:34:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.293+0000 7ff9e6a00640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9c80678c0 0x7ff9c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.293+0000 7ff9e6000640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] conn(0x7ff9c806dd60 0x7ff9c80701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.293+0000 7ff9e6a00640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9c80678c0 0x7ff9c8069d80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80af000 tx=0x7ff9d80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:28.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.293+0000 7ff9e6000640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] conn(0x7ff9c806dd60 0x7ff9c80701a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:28.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.297+0000 7ff9dea00640 1 -- 172.21.15.5:0/574753491 <== osd.4 v2:172.21.15.117:6800/79447292 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9c8070870 con 0x7ff9c806dd60 2024-08-18T22:34:28.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9ed600640 1 -- 172.21.15.5:0/574753491 --> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff9e806e000 con 0x7ff9c806dd60 2024-08-18T22:34:28.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9dea00640 1 -- 172.21.15.5:0/574753491 <== osd.4 v2:172.21.15.117:6800/79447292 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff9e806e000 con 0x7ff9c806dd60 2024-08-18T22:34:28.308 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:34:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T22:34:28.308 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:34:28.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9ed600640 1 -- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] conn(0x7ff9c806dd60 msgr2=0x7ff9c80701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9ed600640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:6800/79447292,v1:172.21.15.117:6801/79447292] conn(0x7ff9c806dd60 0x7ff9c80701a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9ed600640 1 -- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9c80678c0 msgr2=0x7ff9c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9ed600640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7ff9c80678c0 0x7ff9c8069d80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80af000 tx=0x7ff9d80a7000 comp rx=0 tx=0).stop 2024-08-18T22:34:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9ed600640 1 -- 172.21.15.5:0/574753491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9e815f7d0 msgr2=0x7ff9e8152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9ed600640 1 --2- 172.21.15.5:0/574753491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9e815f7d0 0x7ff9e8152e00 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c770 tx=0x7ff9e000cc30 comp rx=0 tx=0).stop 2024-08-18T22:34:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9e7400640 1 -- 172.21.15.5:0/574753491 reap_dead start 2024-08-18T22:34:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9ed600640 1 -- 172.21.15.5:0/574753491 shutdown_connections 2024-08-18T22:34:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9ed600640 1 -- 172.21.15.5:0/574753491 >> 172.21.15.5:0/574753491 conn(0x7ff9e80d2160 msgr2=0x7ff9e80b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:28.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9ed600640 1 -- 172.21.15.5:0/574753491 shutdown_connections 2024-08-18T22:34:28.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.309+0000 7ff9ed600640 1 -- 172.21.15.5:0/574753491 wait complete. 2024-08-18T22:34:28.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-18T22:34:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.469+0000 7f8fcae00640 1 Processor -- start 2024-08-18T22:34:28.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.469+0000 7f8fcae00640 1 -- start start 2024-08-18T22:34:28.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fcae00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8fc415fb80 0x7f8fc40d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fcae00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8fc40b5ad0 0x7f8fc406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fcae00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fc40d30b0 con 0x7f8fc4071550 2024-08-18T22:34:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fcae00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8fc40d1eb0 con 0x7f8fc415fb80 2024-08-18T22:34:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fcae00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8fc40d1bd0 con 0x7f8fc40b5ad0 2024-08-18T22:34:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fc3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8fc415fb80 0x7f8fc40d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fc3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8fc415fb80 0x7f8fc40d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51122/0 (socket says 172.21.15.5:51122) 2024-08-18T22:34:28.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fc3e00640 1 -- 172.21.15.5:0/2145720818 learned_addr learned my addr 172.21.15.5:0/2145720818 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:28.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fc3400640 1 --2- 172.21.15.5:0/2145720818 >> v2:172.21.15.117:3300/0 conn(0x7f8fc40b5ad0 0x7f8fc406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fc3e00640 1 -- 172.21.15.5:0/2145720818 >> v2:172.21.15.117:3300/0 conn(0x7f8fc40b5ad0 msgr2=0x7f8fc406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:28.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fc3e00640 1 --2- 172.21.15.5:0/2145720818 >> v2:172.21.15.117:3300/0 conn(0x7f8fc40b5ad0 0x7f8fc406fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fc3e00640 1 -- 172.21.15.5:0/2145720818 >> v1:172.21.15.117:6789/0 conn(0x7f8fc4071550 legacy=0x7f8fc409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fc3e00640 1 -- 172.21.15.5:0/2145720818 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc40d2dd0 con 0x7f8fc415fb80 2024-08-18T22:34:28.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.473+0000 7f8fc3400640 1 --2- 172.21.15.5:0/2145720818 >> v2:172.21.15.117:3300/0 conn(0x7f8fc40b5ad0 0x7f8fc406fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fc3e00640 1 --2- 172.21.15.5:0/2145720818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc415fb80 0x7f8fc40d15e0 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4074220 tx=0x7f8fb401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9727cf3b10ccc8a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fc2a00640 1 -- 172.21.15.5:0/2145720818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40b0070 con 0x7f8fc415fb80 2024-08-18T22:34:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fc2a00640 1 -- 172.21.15.5:0/2145720818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb40ab600 con 0x7f8fc415fb80 2024-08-18T22:34:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fc2a00640 1 -- 172.21.15.5:0/2145720818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40ab9d0 con 0x7f8fc415fb80 2024-08-18T22:34:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 -- 172.21.15.5:0/2145720818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc415fb80 msgr2=0x7f8fc40d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 --2- 172.21.15.5:0/2145720818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc415fb80 0x7f8fc40d15e0 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4074220 tx=0x7f8fb401c400 comp rx=0 tx=0).stop 2024-08-18T22:34:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 -- 172.21.15.5:0/2145720818 shutdown_connections 2024-08-18T22:34:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 --2- 172.21.15.5:0/2145720818 >> v2:172.21.15.117:3300/0 conn(0x7f8fc40b5ad0 0x7f8fc406fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 --2- 172.21.15.5:0/2145720818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc415fb80 0x7f8fc40d15e0 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 -- 172.21.15.5:0/2145720818 >> 172.21.15.5:0/2145720818 conn(0x7f8fc40d2180 msgr2=0x7f8fc40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 -- 172.21.15.5:0/2145720818 shutdown_connections 2024-08-18T22:34:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 -- 172.21.15.5:0/2145720818 wait complete. 2024-08-18T22:34:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 Processor -- start 2024-08-18T22:34:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 -- start start 2024-08-18T22:34:28.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc4071550 0x7f8fc414fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc40b5ad0 0x7f8fc41f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fc415fb80 0x7f8fc41506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc409b2d0 con 0x7f8fc4071550 2024-08-18T22:34:28.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc409b150 con 0x7f8fc415fb80 2024-08-18T22:34:28.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.477+0000 7f8fcae00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc4071960 con 0x7f8fc40b5ad0 2024-08-18T22:34:28.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fc3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc4071550 0x7f8fc414fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fc3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc4071550 0x7f8fc414fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51126/0 (socket says 172.21.15.5:51126) 2024-08-18T22:34:28.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fc3e00640 1 -- 172.21.15.5:0/3632254743 learned_addr learned my addr 172.21.15.5:0/3632254743 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:28.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fc3400640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc40b5ad0 0x7f8fc41f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fc8e00640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fc415fb80 0x7f8fc41506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fc3e00640 1 -- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc40b5ad0 msgr2=0x7f8fc41f7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fc3e00640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc40b5ad0 0x7f8fc41f7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fc3e00640 1 -- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fc415fb80 msgr2=0x7f8fc41506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fc3e00640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fc415fb80 0x7f8fc41506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fc3e00640 1 -- 172.21.15.5:0/3632254743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc406e830 con 0x7f8fc4071550 2024-08-18T22:34:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fc3e00640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc4071550 0x7f8fc414fbf0 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40ae040 tx=0x7f8fb401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fbbe00640 1 -- 172.21.15.5:0/3632254743 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40ba020 con 0x7f8fc4071550 2024-08-18T22:34:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fbbe00640 1 -- 172.21.15.5:0/3632254743 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb40b6640 con 0x7f8fc4071550 2024-08-18T22:34:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fbbe00640 1 -- 172.21.15.5:0/3632254743 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40b0040 con 0x7f8fc4071550 2024-08-18T22:34:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fcae00640 1 -- 172.21.15.5:0/3632254743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc41fa790 con 0x7f8fc4071550 2024-08-18T22:34:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fcae00640 1 -- 172.21.15.5:0/3632254743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc41fad50 con 0x7f8fc4071550 2024-08-18T22:34:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fcae00640 1 -- 172.21.15.5:0/3632254743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc406fad0 con 0x7f8fc4071550 2024-08-18T22:34:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.481+0000 7f8fbbe00640 1 -- 172.21.15.5:0/3632254743 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8fb40bd020 con 0x7f8fc4071550 2024-08-18T22:34:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.485+0000 7f8fbbe00640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8fa40678c0 0x7f8fa4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.485+0000 7f8fbbe00640 1 -- 172.21.15.5:0/3632254743 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f8fb411fb90 con 0x7f8fc4071550 2024-08-18T22:34:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.485+0000 7f8fc3400640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8fa40678c0 0x7f8fa4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.485+0000 7f8fc3400640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8fa40678c0 0x7f8fa4069d80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8fc406d630 tx=0x7f8fb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.489+0000 7f8fbbe00640 1 -- 172.21.15.5:0/3632254743 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f8fb40c4030 con 0x7f8fc4071550 2024-08-18T22:34:28.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.649+0000 7f8fcae00640 1 -- 172.21.15.5:0/3632254743 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f8fc406de50 con 0x7f8fa40678c0 2024-08-18T22:34:28.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fbbe00640 1 -- 172.21.15.5:0/3632254743 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8fc406de50 con 0x7f8fa40678c0 2024-08-18T22:34:28.650 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2024-08-18T22:34:28.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 -- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8fa40678c0 msgr2=0x7f8fa4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8fa40678c0 0x7f8fa4069d80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8fc406d630 tx=0x7f8fb0008040 comp rx=0 tx=0).stop 2024-08-18T22:34:28.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 -- 172.21.15.5:0/3632254743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc4071550 msgr2=0x7f8fc414fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc4071550 0x7f8fc414fbf0 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40ae040 tx=0x7f8fb401ac40 comp rx=0 tx=0).stop 2024-08-18T22:34:28.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 -- 172.21.15.5:0/3632254743 shutdown_connections 2024-08-18T22:34:28.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f8fa40678c0 0x7f8fa4069d80 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fc415fb80 0x7f8fc41506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fc40b5ad0 0x7f8fc41f7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 --2- 172.21.15.5:0/3632254743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fc4071550 0x7f8fc414fbf0 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 -- 172.21.15.5:0/3632254743 >> 172.21.15.5:0/3632254743 conn(0x7f8fc40d2180 msgr2=0x7f8fc41543d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:28.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 -- 172.21.15.5:0/3632254743 shutdown_connections 2024-08-18T22:34:28.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.653+0000 7f8fcae00640 1 -- 172.21.15.5:0/3632254743 wait complete. 2024-08-18T22:34:28.671 INFO:tasks.ceph:Scrubbing osd.5 2024-08-18T22:34:28.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-18T22:34:28.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.817+0000 7fb2c2e00640 1 Processor -- start 2024-08-18T22:34:28.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.817+0000 7fb2c2e00640 1 -- start start 2024-08-18T22:34:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.817+0000 7fb2c2e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0cf760 0x7fb2bc15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.817+0000 7fb2c2e00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc0b3260 con 0x7fb2bc0ccaa0 2024-08-18T22:34:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.817+0000 7fb2c2e00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc0cfbc0 con 0x7fb2bc06dc60 2024-08-18T22:34:28.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.817+0000 7fb2c2e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb2bc0cfe90 con 0x7fb2bc0cf760 2024-08-18T22:34:28.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.817+0000 7fb2bbe00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb2bc0ccaa0 0x7fb2bc0cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43498/0 (socket says 172.21.15.5:43498) 2024-08-18T22:34:28.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.817+0000 7fb2bbe00640 1 -- 172.21.15.5:0/1594018675 learned_addr learned my addr 172.21.15.5:0/1594018675 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:28.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.817+0000 7fb2bb400640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0cf760 0x7fb2bc15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 750045191 0 0) 0x7fb2bc0b3260 con 0x7fb2bc0ccaa0 2024-08-18T22:34:28.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a0003530 con 0x7fb2bc0ccaa0 2024-08-18T22:34:28.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3850720633 0 0) 0x7fb2a0003530 con 0x7fb2bc0ccaa0 2024-08-18T22:34:28.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0cf760 msgr2=0x7fb2bc15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:28.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0cf760 0x7fb2bc15d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 >> v1:172.21.15.117:6789/0 conn(0x7fb2bc06dc60 legacy=0x7fb2bc06e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc0b3500 con 0x7fb2bc0ccaa0 2024-08-18T22:34:28.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3545935068 0 0) 0x7fb2ac001680 con 0x7fb2bc0ccaa0 2024-08-18T22:34:28.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 >> v1:172.21.15.5:6789/0 conn(0x7fb2bc0ccaa0 legacy=0x7fb2bc0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0cf760 0x7fb2a00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2a0003f30 0x7fb2a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a0004d50 0x7fb2a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc0cfe90 con 0x7fb2a0004d50 2024-08-18T22:34:28.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a000bae0 con 0x7fb2a0003f30 2024-08-18T22:34:28.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a000bce0 con 0x7fb2bc0cf760 2024-08-18T22:34:28.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2c0e00640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a0004d50 0x7fb2a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2bbe00640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0cf760 0x7fb2a00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2bb400640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2a0003f30 0x7fb2a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2c0e00640 1 -- 172.21.15.5:0/1594018675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0cf760 msgr2=0x7fb2a00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:28.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2c0e00640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0cf760 0x7fb2a00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2c0e00640 1 -- 172.21.15.5:0/1594018675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2a0003f30 msgr2=0x7fb2a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:28.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2c0e00640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2a0003f30 0x7fb2a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.821+0000 7fb2c0e00640 1 -- 172.21.15.5:0/1594018675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a0003530 con 0x7fb2a0004d50 2024-08-18T22:34:28.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c0e00640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a0004d50 0x7fb2a00051d0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4002010 tx=0x7fb2b401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37379489e71449d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:28.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4001c10 con 0x7fb2a0004d50 2024-08-18T22:34:28.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b40a8640 con 0x7fb2a0004d50 2024-08-18T22:34:28.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2baa00640 1 -- 172.21.15.5:0/1594018675 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40a8a30 con 0x7fb2a0004d50 2024-08-18T22:34:28.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1594018675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a0004d50 msgr2=0x7fb2a00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 --2- 172.21.15.5:0/1594018675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2a0004d50 0x7fb2a00051d0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4002010 tx=0x7fb2b401c8e0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c0e00640 1 -- 172.21.15.5:0/1594018675 reap_dead start 2024-08-18T22:34:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1594018675 shutdown_connections 2024-08-18T22:34:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1594018675 >> 172.21.15.5:0/1594018675 conn(0x7fb2bc06b9b0 msgr2=0x7fb2bc06bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1594018675 shutdown_connections 2024-08-18T22:34:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1594018675 wait complete. 2024-08-18T22:34:28.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 Processor -- start 2024-08-18T22:34:28.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 -- start start 2024-08-18T22:34:28.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2a0004d50 0x7fb2bc15fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc0735a0 0x7fb2bc152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2bc15b120 0x7fb2bc15b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc156a10 con 0x7fb2bc0735a0 2024-08-18T22:34:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc0af5c0 con 0x7fb2bc15b120 2024-08-18T22:34:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.825+0000 7fb2c2e00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb2bc156b90 con 0x7fb2a0004d50 2024-08-18T22:34:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2bb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc0735a0 0x7fb2bc152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2bb400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc0735a0 0x7fb2bc152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51140/0 (socket says 172.21.15.5:51140) 2024-08-18T22:34:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2bb400640 1 -- 172.21.15.5:0/1520047032 learned_addr learned my addr 172.21.15.5:0/1520047032 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2bbe00640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2a0004d50 0x7fb2bc15fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2c0e00640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2bc15b120 0x7fb2bc15b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2bb400640 1 -- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2a0004d50 msgr2=0x7fb2bc15fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2bb400640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2a0004d50 0x7fb2bc15fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2bb400640 1 -- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2bc15b120 msgr2=0x7fb2bc15b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2bb400640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2bc15b120 0x7fb2bc15b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2bb400640 1 -- 172.21.15.5:0/1520047032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc160180 con 0x7fb2bc0735a0 2024-08-18T22:34:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2bb400640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc0735a0 0x7fb2bc152c60 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8011990 tx=0x7fb2a8011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2b3e00640 1 -- 172.21.15.5:0/1520047032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800fa30 con 0x7fb2bc0735a0 2024-08-18T22:34:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2b3e00640 1 -- 172.21.15.5:0/1520047032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a800fbd0 con 0x7fb2bc0735a0 2024-08-18T22:34:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2b3e00640 1 -- 172.21.15.5:0/1520047032 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8014440 con 0x7fb2bc0735a0 2024-08-18T22:34:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1520047032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc165d30 con 0x7fb2bc0735a0 2024-08-18T22:34:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1520047032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2bc165ff0 con 0x7fb2bc0735a0 2024-08-18T22:34:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1520047032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2bc0cfb40 con 0x7fb2bc0735a0 2024-08-18T22:34:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.829+0000 7fb2b3e00640 1 -- 172.21.15.5:0/1520047032 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb2a8012040 con 0x7fb2bc0735a0 2024-08-18T22:34:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.833+0000 7fb2b3e00640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb29c0678c0 0x7fb29c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.833+0000 7fb2b3e00640 1 -- 172.21.15.5:0/1520047032 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7fb2a8086130 con 0x7fb2bc0735a0 2024-08-18T22:34:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.833+0000 7fb2b3e00640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] conn(0x7fb29c06dd60 0x7fb29c0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.833+0000 7fb2b3e00640 1 -- 172.21.15.5:0/1520047032 --> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb29c070870 con 0x7fb29c06dd60 2024-08-18T22:34:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.833+0000 7fb2b3e00640 1 -- 172.21.15.5:0/1520047032 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7fb2a808d050 con 0x7fb2bc0735a0 2024-08-18T22:34:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.833+0000 7fb2bbe00640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb29c0678c0 0x7fb29c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.833+0000 7fb2c0e00640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] conn(0x7fb29c06dd60 0x7fb29c0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:28.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.833+0000 7fb2c0e00640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] conn(0x7fb29c06dd60 0x7fb29c0701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:28.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.833+0000 7fb2bbe00640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb29c0678c0 0x7fb29c069d80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac001c80 tx=0x7fb2ac001b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:28.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.833+0000 7fb2b3e00640 1 -- 172.21.15.5:0/1520047032 <== osd.5 v2:172.21.15.117:6808/3793560082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb29c070870 con 0x7fb29c06dd60 2024-08-18T22:34:28.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.845+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1520047032 --> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb2bc166890 con 0x7fb29c06dd60 2024-08-18T22:34:28.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2b3e00640 1 -- 172.21.15.5:0/1520047032 <== osd.5 v2:172.21.15.117:6808/3793560082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb2bc166890 con 0x7fb29c06dd60 2024-08-18T22:34:28.845 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:34:28.845 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T22:34:28.845 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:34:28.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] conn(0x7fb29c06dd60 msgr2=0x7fb29c0701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2c2e00640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:6808/3793560082,v1:172.21.15.117:6809/3793560082] conn(0x7fb29c06dd60 0x7fb29c0701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:28.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb29c0678c0 msgr2=0x7fb29c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2c2e00640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb29c0678c0 0x7fb29c069d80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac001c80 tx=0x7fb2ac001b10 comp rx=0 tx=0).stop 2024-08-18T22:34:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1520047032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc0735a0 msgr2=0x7fb2bc152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2c2e00640 1 --2- 172.21.15.5:0/1520047032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2bc0735a0 0x7fb2bc152c60 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8011990 tx=0x7fb2a8011d90 comp rx=0 tx=0).stop 2024-08-18T22:34:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2c0e00640 1 -- 172.21.15.5:0/1520047032 reap_dead start 2024-08-18T22:34:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1520047032 shutdown_connections 2024-08-18T22:34:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1520047032 >> 172.21.15.5:0/1520047032 conn(0x7fb2bc06b9b0 msgr2=0x7fb2bc0ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1520047032 shutdown_connections 2024-08-18T22:34:28.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:28.849+0000 7fb2c2e00640 1 -- 172.21.15.5:0/1520047032 wait complete. 2024-08-18T22:34:28.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-18T22:34:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.009+0000 7f77e5c00640 1 Processor -- start 2024-08-18T22:34:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.009+0000 7f77e5c00640 1 -- start start 2024-08-18T22:34:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.009+0000 7f77e5c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77e00d1090 0x7f77e00d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.009+0000 7f77e5c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77e00b5ad0 0x7f77e0071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.009+0000 7f77e5c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e00d30b0 con 0x7f77e015fb80 2024-08-18T22:34:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.009+0000 7f77e5c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f77e00d1eb0 con 0x7f77e00b5ad0 2024-08-18T22:34:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.009+0000 7f77e5c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f77e00d1bd0 con 0x7f77e00d1090 2024-08-18T22:34:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.009+0000 7f77df400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77e00b5ad0 0x7f77e0071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.009+0000 7f77df400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77e00b5ad0 0x7f77e0071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51164/0 (socket says 172.21.15.5:51164) 2024-08-18T22:34:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.009+0000 7f77df400640 1 -- 172.21.15.5:0/1017797330 learned_addr learned my addr 172.21.15.5:0/1017797330 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.009+0000 7f77d7e00640 1 --2- 172.21.15.5:0/1017797330 >> v2:172.21.15.117:3300/0 conn(0x7f77e00d1090 0x7f77e00d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77df400640 1 -- 172.21.15.5:0/1017797330 >> v2:172.21.15.117:3300/0 conn(0x7f77e00d1090 msgr2=0x7f77e00d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77df400640 1 --2- 172.21.15.5:0/1017797330 >> v2:172.21.15.117:3300/0 conn(0x7f77e00d1090 0x7f77e00d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77df400640 1 -- 172.21.15.5:0/1017797330 >> v1:172.21.15.117:6789/0 conn(0x7f77e015fb80 legacy=0x7f77e006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77df400640 1 -- 172.21.15.5:0/1017797330 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e00d2dd0 con 0x7f77e00b5ad0 2024-08-18T22:34:29.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77df400640 1 --2- 172.21.15.5:0/1017797330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e00b5ad0 0x7f77e0071550 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f77e0074220 tx=0x7f77d801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4787b9772124d15e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77de000640 1 -- 172.21.15.5:0/1017797330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d80a56a0 con 0x7f77e00b5ad0 2024-08-18T22:34:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77de000640 1 -- 172.21.15.5:0/1017797330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d80a5840 con 0x7f77e00b5ad0 2024-08-18T22:34:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77de000640 1 -- 172.21.15.5:0/1017797330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d80a5c10 con 0x7f77e00b5ad0 2024-08-18T22:34:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77e5c00640 1 -- 172.21.15.5:0/1017797330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e00b5ad0 msgr2=0x7f77e0071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77e5c00640 1 --2- 172.21.15.5:0/1017797330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e00b5ad0 0x7f77e0071550 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f77e0074220 tx=0x7f77d801c8d0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77e5c00640 1 -- 172.21.15.5:0/1017797330 shutdown_connections 2024-08-18T22:34:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77e5c00640 1 --2- 172.21.15.5:0/1017797330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e00b5ad0 0x7f77e0071550 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77e5c00640 1 --2- 172.21.15.5:0/1017797330 >> v2:172.21.15.117:3300/0 conn(0x7f77e00d1090 0x7f77e00d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77e5c00640 1 -- 172.21.15.5:0/1017797330 >> 172.21.15.5:0/1017797330 conn(0x7f77e00d2180 msgr2=0x7f77e00d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:29.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77e5c00640 1 -- 172.21.15.5:0/1017797330 shutdown_connections 2024-08-18T22:34:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.013+0000 7f77e5c00640 1 -- 172.21.15.5:0/1017797330 wait complete. 2024-08-18T22:34:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77e5c00640 1 Processor -- start 2024-08-18T22:34:29.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77e5c00640 1 -- start start 2024-08-18T22:34:29.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77e5c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e00b5ad0 0x7f77e00cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77e5c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e00d1090 0x7f77e00af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77e5c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e015fb80 0x7f77e006dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77e5c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77e0169270 con 0x7f77e00b5ad0 2024-08-18T22:34:29.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77e5c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f77e01690f0 con 0x7f77e00d1090 2024-08-18T22:34:29.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77e5c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f77e01693f0 con 0x7f77e015fb80 2024-08-18T22:34:29.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77dea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e00b5ad0 0x7f77e00cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77dea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e00b5ad0 0x7f77e00cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51168/0 (socket says 172.21.15.5:51168) 2024-08-18T22:34:29.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77dea00640 1 -- 172.21.15.5:0/1901425075 learned_addr learned my addr 172.21.15.5:0/1901425075 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:29.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77d7e00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e00d1090 0x7f77e00af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77df400640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e015fb80 0x7f77e006dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77dea00640 1 -- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e015fb80 msgr2=0x7f77e006dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77dea00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e015fb80 0x7f77e006dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77dea00640 1 -- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e00d1090 msgr2=0x7f77e00af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77dea00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e00d1090 0x7f77e00af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77dea00640 1 -- 172.21.15.5:0/1901425075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e00cbcc0 con 0x7f77e00b5ad0 2024-08-18T22:34:29.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77dea00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e00b5ad0 0x7f77e00cb470 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f77d000c370 tx=0x7f77d000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77d6a00640 1 -- 172.21.15.5:0/1901425075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d00052d0 con 0x7f77e00b5ad0 2024-08-18T22:34:29.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77d6a00640 1 -- 172.21.15.5:0/1901425075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d0005470 con 0x7f77e00b5ad0 2024-08-18T22:34:29.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77d6a00640 1 -- 172.21.15.5:0/1901425075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d0007260 con 0x7f77e00b5ad0 2024-08-18T22:34:29.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.017+0000 7f77e5c00640 1 -- 172.21.15.5:0/1901425075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e00cbfa0 con 0x7f77e00b5ad0 2024-08-18T22:34:29.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.021+0000 7f77e5c00640 1 -- 172.21.15.5:0/1901425075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e00cb9b0 con 0x7f77e00b5ad0 2024-08-18T22:34:29.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.021+0000 7f77e5c00640 1 -- 172.21.15.5:0/1901425075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e0071550 con 0x7f77e00b5ad0 2024-08-18T22:34:29.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.021+0000 7f77d6a00640 1 -- 172.21.15.5:0/1901425075 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77d0007400 con 0x7f77e00b5ad0 2024-08-18T22:34:29.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.021+0000 7f77d6a00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77bc0678c0 0x7f77bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.021+0000 7f77d6a00640 1 -- 172.21.15.5:0/1901425075 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f77d0084fb0 con 0x7f77e00b5ad0 2024-08-18T22:34:29.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.021+0000 7f77d7e00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77bc0678c0 0x7f77bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.025+0000 7f77d7e00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77bc0678c0 0x7f77bc069d80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f77e01fa8e0 tx=0x7f77c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.025+0000 7f77d6a00640 1 -- 172.21.15.5:0/1901425075 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f77d0055570 con 0x7f77e00b5ad0 2024-08-18T22:34:29.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.189+0000 7f77e5c00640 1 -- 172.21.15.5:0/1901425075 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f77e00ce0d0 con 0x7f77bc0678c0 2024-08-18T22:34:29.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77d6a00640 1 -- 172.21.15.5:0/1901425075 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f77e00ce0d0 con 0x7f77bc0678c0 2024-08-18T22:34:29.189 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2024-08-18T22:34:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 -- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77bc0678c0 msgr2=0x7f77bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77bc0678c0 0x7f77bc069d80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f77e01fa8e0 tx=0x7f77c8008040 comp rx=0 tx=0).stop 2024-08-18T22:34:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 -- 172.21.15.5:0/1901425075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e00b5ad0 msgr2=0x7f77e00cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e00b5ad0 0x7f77e00cb470 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f77d000c370 tx=0x7f77d000c830 comp rx=0 tx=0).stop 2024-08-18T22:34:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 -- 172.21.15.5:0/1901425075 shutdown_connections 2024-08-18T22:34:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f77bc0678c0 0x7f77bc069d80 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e015fb80 0x7f77e006dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e00d1090 0x7f77e00af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 --2- 172.21.15.5:0/1901425075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e00b5ad0 0x7f77e00cb470 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 -- 172.21.15.5:0/1901425075 >> 172.21.15.5:0/1901425075 conn(0x7f77e00d2180 msgr2=0x7f77e00b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 -- 172.21.15.5:0/1901425075 shutdown_connections 2024-08-18T22:34:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.193+0000 7f77e5c00640 1 -- 172.21.15.5:0/1901425075 wait complete. 2024-08-18T22:34:29.211 INFO:tasks.ceph:Scrubbing osd.6 2024-08-18T22:34:29.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-18T22:34:29.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb861200640 1 Processor -- start 2024-08-18T22:34:29.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb861200640 1 -- start start 2024-08-18T22:34:29.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb861200640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb85c0cf760 0x7fb85c15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb861200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb85c06dc60 0x7fb85c06e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb861200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85c0b3260 con 0x7fb85c0ccaa0 2024-08-18T22:34:29.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb861200640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fb85c0cfe90 con 0x7fb85c0cf760 2024-08-18T22:34:29.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb861200640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb85c0b37e0 con 0x7fb85c06dc60 2024-08-18T22:34:29.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb859400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb85c0cf760 0x7fb85c15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb859400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb85c0cf760 0x7fb85c15d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51176/0 (socket says 172.21.15.5:51176) 2024-08-18T22:34:29.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb859400640 1 -- 172.21.15.5:0/2994212529 learned_addr learned my addr 172.21.15.5:0/2994212529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb85a800640 1 --2- 172.21.15.5:0/2994212529 >> v2:172.21.15.117:3300/0 conn(0x7fb85c06dc60 0x7fb85c06e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb859400640 1 -- 172.21.15.5:0/2994212529 >> v2:172.21.15.117:3300/0 conn(0x7fb85c06dc60 msgr2=0x7fb85c06e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.357+0000 7fb859400640 1 --2- 172.21.15.5:0/2994212529 >> v2:172.21.15.117:3300/0 conn(0x7fb85c06dc60 0x7fb85c06e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb859400640 1 -- 172.21.15.5:0/2994212529 >> v1:172.21.15.117:6789/0 conn(0x7fb85c0ccaa0 legacy=0x7fb85c0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb859400640 1 -- 172.21.15.5:0/2994212529 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c0cfbc0 con 0x7fb85c0cf760 2024-08-18T22:34:29.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb859400640 1 --2- 172.21.15.5:0/2994212529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c0cf760 0x7fb85c15d1d0 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0719f0 tx=0x7fb84801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25316a4189a8e4e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb858a00640 1 -- 172.21.15.5:0/2994212529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480b0070 con 0x7fb85c0cf760 2024-08-18T22:34:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb858a00640 1 -- 172.21.15.5:0/2994212529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8480ab600 con 0x7fb85c0cf760 2024-08-18T22:34:29.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb858a00640 1 -- 172.21.15.5:0/2994212529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480ab9d0 con 0x7fb85c0cf760 2024-08-18T22:34:29.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb861200640 1 -- 172.21.15.5:0/2994212529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c0cf760 msgr2=0x7fb85c15d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb861200640 1 --2- 172.21.15.5:0/2994212529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c0cf760 0x7fb85c15d1d0 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0719f0 tx=0x7fb84801c460 comp rx=0 tx=0).stop 2024-08-18T22:34:29.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb861200640 1 -- 172.21.15.5:0/2994212529 shutdown_connections 2024-08-18T22:34:29.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb861200640 1 --2- 172.21.15.5:0/2994212529 >> v2:172.21.15.117:3300/0 conn(0x7fb85c06dc60 0x7fb85c06e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb861200640 1 --2- 172.21.15.5:0/2994212529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c0cf760 0x7fb85c15d1d0 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb861200640 1 -- 172.21.15.5:0/2994212529 >> 172.21.15.5:0/2994212529 conn(0x7fb85c06b9b0 msgr2=0x7fb85c06bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:29.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb861200640 1 -- 172.21.15.5:0/2994212529 shutdown_connections 2024-08-18T22:34:29.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.361+0000 7fb861200640 1 -- 172.21.15.5:0/2994212529 wait complete. 2024-08-18T22:34:29.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb861200640 1 Processor -- start 2024-08-18T22:34:29.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb861200640 1 -- start start 2024-08-18T22:34:29.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb861200640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c06dc60 0x7fb85c14c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb861200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c0ccaa0 0x7fb85c14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb861200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb85c0cf760 0x7fb85c099830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb861200640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c168e80 con 0x7fb85c06dc60 2024-08-18T22:34:29.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb861200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c168d00 con 0x7fb85c0cf760 2024-08-18T22:34:29.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb861200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fb85c169000 con 0x7fb85c0ccaa0 2024-08-18T22:34:29.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb859e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c06dc60 0x7fb85c14c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb859e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c06dc60 0x7fb85c14c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51198/0 (socket says 172.21.15.5:51198) 2024-08-18T22:34:29.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb859e00640 1 -- 172.21.15.5:0/4095310962 learned_addr learned my addr 172.21.15.5:0/4095310962 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:29.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb859400640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c0ccaa0 0x7fb85c14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb85a800640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb85c0cf760 0x7fb85c099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb859e00640 1 -- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c0ccaa0 msgr2=0x7fb85c14e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb859e00640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c0ccaa0 0x7fb85c14e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb859e00640 1 -- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb85c0cf760 msgr2=0x7fb85c099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb859e00640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb85c0cf760 0x7fb85c099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb859e00640 1 -- 172.21.15.5:0/4095310962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c14a9b0 con 0x7fb85c06dc60 2024-08-18T22:34:29.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb859e00640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c06dc60 0x7fb85c14c6c0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00c3a0 tx=0x7fb84c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb852000640 1 -- 172.21.15.5:0/4095310962 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c0052d0 con 0x7fb85c06dc60 2024-08-18T22:34:29.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb852000640 1 -- 172.21.15.5:0/4095310962 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c005470 con 0x7fb85c06dc60 2024-08-18T22:34:29.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb852000640 1 -- 172.21.15.5:0/4095310962 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c007260 con 0x7fb85c06dc60 2024-08-18T22:34:29.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb861200640 1 -- 172.21.15.5:0/4095310962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85c14cca0 con 0x7fb85c06dc60 2024-08-18T22:34:29.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.365+0000 7fb861200640 1 -- 172.21.15.5:0/4095310962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85c0725c0 con 0x7fb85c06dc60 2024-08-18T22:34:29.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.369+0000 7fb861200640 1 -- 172.21.15.5:0/4095310962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb85c0723b0 con 0x7fb85c06dc60 2024-08-18T22:34:29.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.369+0000 7fb852000640 1 -- 172.21.15.5:0/4095310962 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb84c007400 con 0x7fb85c06dc60 2024-08-18T22:34:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.369+0000 7fb852000640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb83c0678c0 0x7fb83c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.369+0000 7fb852000640 1 -- 172.21.15.5:0/4095310962 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7fb84c084f90 con 0x7fb85c06dc60 2024-08-18T22:34:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.369+0000 7fb852000640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x7fb83c06dd60 0x7fb83c0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.369+0000 7fb852000640 1 -- 172.21.15.5:0/4095310962 --> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb84c014e50 con 0x7fb83c06dd60 2024-08-18T22:34:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.369+0000 7fb852000640 1 -- 172.21.15.5:0/4095310962 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7fb84c0875b0 con 0x7fb85c06dc60 2024-08-18T22:34:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.369+0000 7fb859400640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb83c0678c0 0x7fb83c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.369+0000 7fb85a800640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x7fb83c06dd60 0x7fb83c0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.369+0000 7fb859400640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb83c0678c0 0x7fb83c069d80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb8480ad000 tx=0x7fb8480a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.369+0000 7fb85a800640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x7fb83c06dd60 0x7fb83c0701a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.373+0000 7fb852000640 1 -- 172.21.15.5:0/4095310962 <== osd.6 v2:172.21.15.117:6824/3026847861 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb84c014e50 con 0x7fb83c06dd60 2024-08-18T22:34:29.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb861200640 1 -- 172.21.15.5:0/4095310962 --> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb85c06e0d0 con 0x7fb83c06dd60 2024-08-18T22:34:29.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb852000640 1 -- 172.21.15.5:0/4095310962 <== osd.6 v2:172.21.15.117:6824/3026847861 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb85c06e0d0 con 0x7fb83c06dd60 2024-08-18T22:34:29.383 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:34:29.383 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T22:34:29.383 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:34:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb861200640 1 -- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x7fb83c06dd60 msgr2=0x7fb83c0701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb861200640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:6824/3026847861,v1:172.21.15.117:6825/3026847861] conn(0x7fb83c06dd60 0x7fb83c0701a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb861200640 1 -- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb83c0678c0 msgr2=0x7fb83c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb861200640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fb83c0678c0 0x7fb83c069d80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb8480ad000 tx=0x7fb8480a6000 comp rx=0 tx=0).stop 2024-08-18T22:34:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb861200640 1 -- 172.21.15.5:0/4095310962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c06dc60 msgr2=0x7fb85c14c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb861200640 1 --2- 172.21.15.5:0/4095310962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb85c06dc60 0x7fb85c14c6c0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00c3a0 tx=0x7fb84c00c860 comp rx=0 tx=0).stop 2024-08-18T22:34:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb85a800640 1 -- 172.21.15.5:0/4095310962 reap_dead start 2024-08-18T22:34:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb861200640 1 -- 172.21.15.5:0/4095310962 shutdown_connections 2024-08-18T22:34:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb861200640 1 -- 172.21.15.5:0/4095310962 >> 172.21.15.5:0/4095310962 conn(0x7fb85c06b9b0 msgr2=0x7fb85c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb861200640 1 -- 172.21.15.5:0/4095310962 shutdown_connections 2024-08-18T22:34:29.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.385+0000 7fb861200640 1 -- 172.21.15.5:0/4095310962 wait complete. 2024-08-18T22:34:29.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-18T22:34:29.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1929c00640 1 Processor -- start 2024-08-18T22:34:29.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1929c00640 1 -- start start 2024-08-18T22:34:29.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1929c00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f192409aca0 0x7f19240afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1929c00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19240b1300 0x7f19240affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1929c00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192406e8a0 con 0x7f192409b080 2024-08-18T22:34:29.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1929c00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f192409bb80 con 0x7f19240b1300 2024-08-18T22:34:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1929c00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f19240d2e40 con 0x7f192409aca0 2024-08-18T22:34:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1922000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19240b1300 0x7f19240affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1922000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19240b1300 0x7f19240affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51202/0 (socket says 172.21.15.5:51202) 2024-08-18T22:34:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1922000640 1 -- 172.21.15.5:0/3228626332 learned_addr learned my addr 172.21.15.5:0/3228626332 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1922a00640 1 --2- 172.21.15.5:0/3228626332 >> v2:172.21.15.117:3300/0 conn(0x7f192409aca0 0x7f19240afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1922000640 1 -- 172.21.15.5:0/3228626332 >> v2:172.21.15.117:3300/0 conn(0x7f192409aca0 msgr2=0x7f19240afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1922000640 1 --2- 172.21.15.5:0/3228626332 >> v2:172.21.15.117:3300/0 conn(0x7f192409aca0 0x7f19240afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1922000640 1 -- 172.21.15.5:0/3228626332 >> v1:172.21.15.117:6789/0 conn(0x7f192409b080 legacy=0x7f19240b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.545+0000 7f1922000640 1 -- 172.21.15.5:0/3228626332 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192406cbd0 con 0x7f19240b1300 2024-08-18T22:34:29.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1922000640 1 --2- 172.21.15.5:0/3228626332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19240b1300 0x7f19240affd0 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f192406f260 tx=0x7f191001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f6c609e8af186c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1921600640 1 -- 172.21.15.5:0/3228626332 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19100b1070 con 0x7f19240b1300 2024-08-18T22:34:29.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1921600640 1 -- 172.21.15.5:0/3228626332 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19100ac630 con 0x7f19240b1300 2024-08-18T22:34:29.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1921600640 1 -- 172.21.15.5:0/3228626332 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19100a8050 con 0x7f19240b1300 2024-08-18T22:34:29.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1929c00640 1 -- 172.21.15.5:0/3228626332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19240b1300 msgr2=0x7f19240affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1929c00640 1 --2- 172.21.15.5:0/3228626332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19240b1300 0x7f19240affd0 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f192406f260 tx=0x7f191001c520 comp rx=0 tx=0).stop 2024-08-18T22:34:29.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1929c00640 1 -- 172.21.15.5:0/3228626332 shutdown_connections 2024-08-18T22:34:29.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1929c00640 1 --2- 172.21.15.5:0/3228626332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19240b1300 0x7f19240affd0 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1929c00640 1 --2- 172.21.15.5:0/3228626332 >> v2:172.21.15.117:3300/0 conn(0x7f192409aca0 0x7f19240afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1929c00640 1 -- 172.21.15.5:0/3228626332 >> 172.21.15.5:0/3228626332 conn(0x7f19240d2180 msgr2=0x7f19240d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:29.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1929c00640 1 -- 172.21.15.5:0/3228626332 shutdown_connections 2024-08-18T22:34:29.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.549+0000 7f1929c00640 1 -- 172.21.15.5:0/3228626332 wait complete. 2024-08-18T22:34:29.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1929c00640 1 Processor -- start 2024-08-18T22:34:29.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1929c00640 1 -- start start 2024-08-18T22:34:29.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1929c00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f192409aca0 0x7f1924155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1929c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f192409b080 0x7f19241555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1929c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19240b1300 0x7f1924155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1929c00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f192416b6b0 con 0x7f192409b080 2024-08-18T22:34:29.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1929c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f192416b530 con 0x7f19240b1300 2024-08-18T22:34:29.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1929c00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f192416b830 con 0x7f192409aca0 2024-08-18T22:34:29.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1922000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f192409b080 0x7f19241555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1922000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f192409b080 0x7f19241555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51204/0 (socket says 172.21.15.5:51204) 2024-08-18T22:34:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1922000640 1 -- 172.21.15.5:0/2172285552 learned_addr learned my addr 172.21.15.5:0/2172285552 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1923400640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19240b1300 0x7f1924155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1922a00640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f192409aca0 0x7f1924155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1922000640 1 -- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f192409aca0 msgr2=0x7f1924155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1922000640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f192409aca0 0x7f1924155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1922000640 1 -- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19240b1300 msgr2=0x7f1924155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1922000640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19240b1300 0x7f1924155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1922000640 1 -- 172.21.15.5:0/2172285552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1924150dc0 con 0x7f192409b080 2024-08-18T22:34:29.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1923400640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19240b1300 0x7f1924155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:34:29.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1922000640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f192409b080 0x7f19241555c0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f191001a150 tx=0x7f191001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f191aa00640 1 -- 172.21.15.5:0/2172285552 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19100b1040 con 0x7f192409b080 2024-08-18T22:34:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f191aa00640 1 -- 172.21.15.5:0/2172285552 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19100bd070 con 0x7f192409b080 2024-08-18T22:34:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1929c00640 1 -- 172.21.15.5:0/2172285552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19240b27a0 con 0x7f192409b080 2024-08-18T22:34:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f191aa00640 1 -- 172.21.15.5:0/2172285552 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19100b7880 con 0x7f192409b080 2024-08-18T22:34:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.553+0000 7f1929c00640 1 -- 172.21.15.5:0/2172285552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19241508c0 con 0x7f192409b080 2024-08-18T22:34:29.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.557+0000 7f1929c00640 1 -- 172.21.15.5:0/2172285552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1924150b50 con 0x7f192409b080 2024-08-18T22:34:29.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.557+0000 7f191aa00640 1 -- 172.21.15.5:0/2172285552 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f19100b7a20 con 0x7f192409b080 2024-08-18T22:34:29.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.557+0000 7f191aa00640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19040678f0 0x7f1904069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.557+0000 7f191aa00640 1 -- 172.21.15.5:0/2172285552 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f191011fae0 con 0x7f192409b080 2024-08-18T22:34:29.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.557+0000 7f1922a00640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19040678f0 0x7f1904069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.557+0000 7f1922a00640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19040678f0 0x7f1904069db0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1914003b90 tx=0x7f19140098d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.561+0000 7f191aa00640 1 -- 172.21.15.5:0/2172285552 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f1910016110 con 0x7f192409b080 2024-08-18T22:34:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.725+0000 7f1929c00640 1 -- 172.21.15.5:0/2172285552 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f192404fcf0 con 0x7f19040678f0 2024-08-18T22:34:29.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f191aa00640 1 -- 172.21.15.5:0/2172285552 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f192404fcf0 con 0x7f19040678f0 2024-08-18T22:34:29.725 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2024-08-18T22:34:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 -- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19040678f0 msgr2=0x7f1904069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19040678f0 0x7f1904069db0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1914003b90 tx=0x7f19140098d0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 -- 172.21.15.5:0/2172285552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f192409b080 msgr2=0x7f19241555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f192409b080 0x7f19241555c0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f191001a150 tx=0x7f191001ad60 comp rx=0 tx=0).stop 2024-08-18T22:34:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 -- 172.21.15.5:0/2172285552 shutdown_connections 2024-08-18T22:34:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f19040678f0 0x7f1904069db0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19240b1300 0x7f1924155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f192409b080 0x7f19241555c0 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 --2- 172.21.15.5:0/2172285552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f192409aca0 0x7f1924155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 -- 172.21.15.5:0/2172285552 >> 172.21.15.5:0/2172285552 conn(0x7f19240d2180 msgr2=0x7f192406fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 -- 172.21.15.5:0/2172285552 shutdown_connections 2024-08-18T22:34:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.729+0000 7f1929c00640 1 -- 172.21.15.5:0/2172285552 wait complete. 2024-08-18T22:34:29.746 INFO:tasks.ceph:Scrubbing osd.7 2024-08-18T22:34:29.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-18T22:34:29.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.893+0000 7fc9b0800640 1 Processor -- start 2024-08-18T22:34:29.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.893+0000 7fc9b0800640 1 -- start start 2024-08-18T22:34:29.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9b0800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a815e470 0x7fc9a806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9b0800640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9a80b2800 0x7fc9a80b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9b0800640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a80b4210 con 0x7fc9a80b6160 2024-08-18T22:34:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9b0800640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a806c900 con 0x7fc9a80b2800 2024-08-18T22:34:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9b0800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a809ac70 con 0x7fc9a815e470 2024-08-18T22:34:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9ad400640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9a80b2800 0x7fc9a80b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9ae800640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc9a80b6160 0x7fc9a8161fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43514/0 (socket says 172.21.15.5:43514) 2024-08-18T22:34:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9ae800640 1 -- 172.21.15.5:0/3743097764 learned_addr learned my addr 172.21.15.5:0/3743097764 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9ade00640 1 --2- 172.21.15.5:0/3743097764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a815e470 0x7fc9a806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9ad400640 1 -- 172.21.15.5:0/3743097764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a815e470 msgr2=0x7fc9a806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9ad400640 1 --2- 172.21.15.5:0/3743097764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a815e470 0x7fc9a806c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9ad400640 1 -- 172.21.15.5:0/3743097764 >> v1:172.21.15.5:6789/0 conn(0x7fc9a80b6160 legacy=0x7fc9a8161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.897+0000 7fc9ad400640 1 -- 172.21.15.5:0/3743097764 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a80b44f0 con 0x7fc9a80b2800 2024-08-18T22:34:29.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9ad400640 1 --2- 172.21.15.5:0/3743097764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a80b2800 0x7fc9a80b5c20 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7fc9980097c0 tx=0x7fc99801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d319cb8b3afb86 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9aca00640 1 -- 172.21.15.5:0/3743097764 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9980b5070 con 0x7fc9a80b2800 2024-08-18T22:34:29.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9aca00640 1 -- 172.21.15.5:0/3743097764 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9980a8990 con 0x7fc9a80b2800 2024-08-18T22:34:29.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9aca00640 1 -- 172.21.15.5:0/3743097764 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9980a8d60 con 0x7fc9a80b2800 2024-08-18T22:34:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9b0800640 1 -- 172.21.15.5:0/3743097764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a80b2800 msgr2=0x7fc9a80b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9b0800640 1 --2- 172.21.15.5:0/3743097764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a80b2800 0x7fc9a80b5c20 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7fc9980097c0 tx=0x7fc99801ec90 comp rx=0 tx=0).stop 2024-08-18T22:34:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9b0800640 1 -- 172.21.15.5:0/3743097764 shutdown_connections 2024-08-18T22:34:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9b0800640 1 --2- 172.21.15.5:0/3743097764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a80b2800 0x7fc9a80b5c20 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9b0800640 1 --2- 172.21.15.5:0/3743097764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a815e470 0x7fc9a806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9b0800640 1 -- 172.21.15.5:0/3743097764 >> 172.21.15.5:0/3743097764 conn(0x7fc9a80732a0 msgr2=0x7fc9a80b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9b0800640 1 -- 172.21.15.5:0/3743097764 shutdown_connections 2024-08-18T22:34:29.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9b0800640 1 -- 172.21.15.5:0/3743097764 wait complete. 2024-08-18T22:34:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9b0800640 1 Processor -- start 2024-08-18T22:34:29.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9b0800640 1 -- start start 2024-08-18T22:34:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.901+0000 7fc9b0800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a80b2800 0x7fc9a814e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9b0800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9a80b6160 0x7fc9a8156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9b0800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a815e470 0x7fc9a815b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9b0800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80b6610 con 0x7fc9a80b2800 2024-08-18T22:34:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9b0800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a815ef60 con 0x7fc9a80b6160 2024-08-18T22:34:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9b0800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a815e850 con 0x7fc9a815e470 2024-08-18T22:34:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9ade00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a80b2800 0x7fc9a814e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9ade00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a80b2800 0x7fc9a814e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51224/0 (socket says 172.21.15.5:51224) 2024-08-18T22:34:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9ade00640 1 -- 172.21.15.5:0/3523266070 learned_addr learned my addr 172.21.15.5:0/3523266070 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9ad400640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9a80b6160 0x7fc9a8156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9ae800640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a815e470 0x7fc9a815b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9ade00640 1 -- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a815e470 msgr2=0x7fc9a815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9ade00640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9a815e470 0x7fc9a815b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9ade00640 1 -- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9a80b6160 msgr2=0x7fc9a8156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9ade00640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9a80b6160 0x7fc9a8156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9ade00640 1 -- 172.21.15.5:0/3523266070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a8153e60 con 0x7fc9a80b2800 2024-08-18T22:34:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9ade00640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a80b2800 0x7fc9a814e750 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00e870 tx=0x7fc99c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9a2000640 1 -- 172.21.15.5:0/3523266070 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c017070 con 0x7fc9a80b2800 2024-08-18T22:34:29.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9a2000640 1 -- 172.21.15.5:0/3523266070 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99c00c8e0 con 0x7fc9a80b2800 2024-08-18T22:34:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9b0800640 1 -- 172.21.15.5:0/3523266070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a8154140 con 0x7fc9a80b2800 2024-08-18T22:34:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9a2000640 1 -- 172.21.15.5:0/3523266070 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00cc90 con 0x7fc9a80b2800 2024-08-18T22:34:29.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9b0800640 1 -- 172.21.15.5:0/3523266070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a8154700 con 0x7fc9a80b2800 2024-08-18T22:34:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9b0800640 1 -- 172.21.15.5:0/3523266070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9a8068f60 con 0x7fc9a80b2800 2024-08-18T22:34:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9a2000640 1 -- 172.21.15.5:0/3523266070 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc99c01a070 con 0x7fc9a80b2800 2024-08-18T22:34:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.905+0000 7fc9a2000640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc98c0678c0 0x7fc98c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.909+0000 7fc9a2000640 1 -- 172.21.15.5:0/3523266070 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7fc99c085e00 con 0x7fc9a80b2800 2024-08-18T22:34:29.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.909+0000 7fc9a2000640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] conn(0x7fc98c06dd60 0x7fc98c0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.909+0000 7fc9a2000640 1 -- 172.21.15.5:0/3523266070 --> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc99c00e020 con 0x7fc98c06dd60 2024-08-18T22:34:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.909+0000 7fc9a2000640 1 -- 172.21.15.5:0/3523266070 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7fc99c088420 con 0x7fc9a80b2800 2024-08-18T22:34:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.909+0000 7fc9ad400640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc98c0678c0 0x7fc98c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.909+0000 7fc9ae800640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] conn(0x7fc98c06dd60 0x7fc98c0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.909+0000 7fc9ae800640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] conn(0x7fc98c06dd60 0x7fc98c0701a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.909+0000 7fc9ad400640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc98c0678c0 0x7fc98c069d80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc9980b2000 tx=0x7fc998008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:29.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.909+0000 7fc9a2000640 1 -- 172.21.15.5:0/3523266070 <== osd.7 v2:172.21.15.117:6810/2024227284 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc99c00e020 con 0x7fc98c06dd60 2024-08-18T22:34:29.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.921+0000 7fc9b0800640 1 -- 172.21.15.5:0/3523266070 --> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc9a80b5c20 con 0x7fc98c06dd60 2024-08-18T22:34:29.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9a2000640 1 -- 172.21.15.5:0/3523266070 <== osd.7 v2:172.21.15.117:6810/2024227284 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc9a80b5c20 con 0x7fc98c06dd60 2024-08-18T22:34:29.921 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-18T22:34:29.922 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T22:34:29.922 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-18T22:34:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9b0800640 1 -- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] conn(0x7fc98c06dd60 msgr2=0x7fc98c0701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9b0800640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:6810/2024227284,v1:172.21.15.117:6812/2024227284] conn(0x7fc98c06dd60 0x7fc98c0701a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9b0800640 1 -- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc98c0678c0 msgr2=0x7fc98c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9b0800640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fc98c0678c0 0x7fc98c069d80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc9980b2000 tx=0x7fc998008040 comp rx=0 tx=0).stop 2024-08-18T22:34:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9b0800640 1 -- 172.21.15.5:0/3523266070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a80b2800 msgr2=0x7fc9a814e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9b0800640 1 --2- 172.21.15.5:0/3523266070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9a80b2800 0x7fc9a814e750 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00e870 tx=0x7fc99c00ec70 comp rx=0 tx=0).stop 2024-08-18T22:34:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9ae800640 1 -- 172.21.15.5:0/3523266070 reap_dead start 2024-08-18T22:34:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9b0800640 1 -- 172.21.15.5:0/3523266070 shutdown_connections 2024-08-18T22:34:29.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9b0800640 1 -- 172.21.15.5:0/3523266070 >> 172.21.15.5:0/3523266070 conn(0x7fc9a80732a0 msgr2=0x7fc9a815ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9b0800640 1 -- 172.21.15.5:0/3523266070 shutdown_connections 2024-08-18T22:34:29.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:29.925+0000 7fc9b0800640 1 -- 172.21.15.5:0/3523266070 wait complete. 2024-08-18T22:34:29.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-18T22:34:30.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c9800640 1 Processor -- start 2024-08-18T22:34:30.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c9800640 1 -- start start 2024-08-18T22:34:30.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c9800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c41473a0 0x7f32c406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c9800640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32c406bef0 0x7f32c4161f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c9800640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32c4072cf0 con 0x7f32c41624d0 2024-08-18T22:34:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c9800640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f32c406c330 con 0x7f32c406bef0 2024-08-18T22:34:30.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c9800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f32c4072fd0 con 0x7f32c41473a0 2024-08-18T22:34:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c41473a0 0x7f32c406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c3400640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32c406bef0 0x7f32c4161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c41473a0 0x7f32c406b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:56806/0 (socket says 172.21.15.5:56806) 2024-08-18T22:34:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c3e00640 1 -- 172.21.15.5:0/2479593279 learned_addr learned my addr 172.21.15.5:0/2479593279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:30.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c3e00640 1 -- 172.21.15.5:0/2479593279 >> v2:172.21.15.117:3300/0 conn(0x7f32c406bef0 msgr2=0x7f32c4161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:30.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c3e00640 1 --2- 172.21.15.5:0/2479593279 >> v2:172.21.15.117:3300/0 conn(0x7f32c406bef0 0x7f32c4161f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c3e00640 1 -- 172.21.15.5:0/2479593279 >> v1:172.21.15.117:6789/0 conn(0x7f32c41624d0 legacy=0x7f32c406e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.085+0000 7f32c3e00640 1 -- 172.21.15.5:0/2479593279 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c40732b0 con 0x7f32c41473a0 2024-08-18T22:34:30.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c3e00640 1 --2- 172.21.15.5:0/2479593279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c41473a0 0x7f32c406b9b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009870 tx=0x7f32b401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36c0d4148045cf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:30.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c2a00640 1 -- 172.21.15.5:0/2479593279 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b40b0070 con 0x7f32c41473a0 2024-08-18T22:34:30.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c2a00640 1 -- 172.21.15.5:0/2479593279 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b40ab600 con 0x7f32c41473a0 2024-08-18T22:34:30.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c2a00640 1 -- 172.21.15.5:0/2479593279 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b40ab9d0 con 0x7f32c41473a0 2024-08-18T22:34:30.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c9800640 1 -- 172.21.15.5:0/2479593279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c41473a0 msgr2=0x7f32c406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c9800640 1 --2- 172.21.15.5:0/2479593279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c41473a0 0x7f32c406b9b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009870 tx=0x7f32b401c4d0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c9800640 1 -- 172.21.15.5:0/2479593279 shutdown_connections 2024-08-18T22:34:30.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c9800640 1 --2- 172.21.15.5:0/2479593279 >> v2:172.21.15.117:3300/0 conn(0x7f32c406bef0 0x7f32c4161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c9800640 1 --2- 172.21.15.5:0/2479593279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c41473a0 0x7f32c406b9b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c9800640 1 -- 172.21.15.5:0/2479593279 >> 172.21.15.5:0/2479593279 conn(0x7f32c40d1000 msgr2=0x7f32c40d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c9800640 1 -- 172.21.15.5:0/2479593279 shutdown_connections 2024-08-18T22:34:30.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.089+0000 7f32c9800640 1 -- 172.21.15.5:0/2479593279 wait complete. 2024-08-18T22:34:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c9800640 1 Processor -- start 2024-08-18T22:34:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c9800640 1 -- start start 2024-08-18T22:34:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c9800640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c406bef0 0x7f32c4137f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c9800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c41473a0 0x7f32c415fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c9800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c41624d0 0x7f32c4139b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c9800640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4147900 con 0x7f32c41473a0 2024-08-18T22:34:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c9800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4147780 con 0x7f32c41624d0 2024-08-18T22:34:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c9800640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f32c416b020 con 0x7f32c406bef0 2024-08-18T22:34:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c3e00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c406bef0 0x7f32c4137f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c41473a0 0x7f32c415fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c8e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c41624d0 0x7f32c4139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c3400640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c41473a0 0x7f32c415fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51236/0 (socket says 172.21.15.5:51236) 2024-08-18T22:34:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c3400640 1 -- 172.21.15.5:0/199882803 learned_addr learned my addr 172.21.15.5:0/199882803 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c3400640 1 -- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c406bef0 msgr2=0x7f32c4137f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c3400640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c406bef0 0x7f32c4137f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c3400640 1 -- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c41624d0 msgr2=0x7f32c4139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c3400640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c41624d0 0x7f32c4139b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c3400640 1 -- 172.21.15.5:0/199882803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c4140300 con 0x7f32c41473a0 2024-08-18T22:34:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c8e00640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c41624d0 0x7f32c4139b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:34:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c3400640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c41473a0 0x7f32c415fce0 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f32b000e840 tx=0x7f32b000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32bbe00640 1 -- 172.21.15.5:0/199882803 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b0017070 con 0x7f32c41473a0 2024-08-18T22:34:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32bbe00640 1 -- 172.21.15.5:0/199882803 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b000ee90 con 0x7f32c41473a0 2024-08-18T22:34:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c9800640 1 -- 172.21.15.5:0/199882803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c41405e0 con 0x7f32c41473a0 2024-08-18T22:34:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32bbe00640 1 -- 172.21.15.5:0/199882803 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b000cb60 con 0x7f32c41473a0 2024-08-18T22:34:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c9800640 1 -- 172.21.15.5:0/199882803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c4138630 con 0x7f32c41473a0 2024-08-18T22:34:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.093+0000 7f32c9800640 1 -- 172.21.15.5:0/199882803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c40cd870 con 0x7f32c41473a0 2024-08-18T22:34:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.097+0000 7f32bbe00640 1 -- 172.21.15.5:0/199882803 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32b001a070 con 0x7f32c41473a0 2024-08-18T22:34:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.097+0000 7f32bbe00640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a40678c0 0x7f32a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.097+0000 7f32bbe00640 1 -- 172.21.15.5:0/199882803 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f32b0085cf0 con 0x7f32c41473a0 2024-08-18T22:34:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.097+0000 7f32c3e00640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a40678c0 0x7f32a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.097+0000 7f32c3e00640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a40678c0 0x7f32a4069d80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f32b40ad000 tx=0x7f32b40a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:30.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.101+0000 7f32bbe00640 1 -- 172.21.15.5:0/199882803 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f32b0056340 con 0x7f32c41473a0 2024-08-18T22:34:30.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.265+0000 7f32c9800640 1 -- 172.21.15.5:0/199882803 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f32c4140970 con 0x7f32a40678c0 2024-08-18T22:34:30.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.265+0000 7f32bbe00640 1 -- 172.21.15.5:0/199882803 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f32c4140970 con 0x7f32a40678c0 2024-08-18T22:34:30.264 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2024-08-18T22:34:30.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 -- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a40678c0 msgr2=0x7f32a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a40678c0 0x7f32a4069d80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f32b40ad000 tx=0x7f32b40a4f90 comp rx=0 tx=0).stop 2024-08-18T22:34:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 -- 172.21.15.5:0/199882803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c41473a0 msgr2=0x7f32c415fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c41473a0 0x7f32c415fce0 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f32b000e840 tx=0x7f32b000ec40 comp rx=0 tx=0).stop 2024-08-18T22:34:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 -- 172.21.15.5:0/199882803 shutdown_connections 2024-08-18T22:34:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f32a40678c0 0x7f32a4069d80 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c41624d0 0x7f32c4139b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c41473a0 0x7f32c415fce0 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 --2- 172.21.15.5:0/199882803 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c406bef0 0x7f32c4137f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 -- 172.21.15.5:0/199882803 >> 172.21.15.5:0/199882803 conn(0x7f32c40d1000 msgr2=0x7f32c413cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:30.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 -- 172.21.15.5:0/199882803 shutdown_connections 2024-08-18T22:34:30.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.269+0000 7f32c9800640 1 -- 172.21.15.5:0/199882803 wait complete. 2024-08-18T22:34:30.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:34:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.425+0000 7fbee2000640 1 Processor -- start 2024-08-18T22:34:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbee2000640 1 -- start start 2024-08-18T22:34:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbee2000640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbedc0707e0 0x7fbedc06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbee2000640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbedc06bef0 0x7fbedc0ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbee2000640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc070ce0 con 0x7fbedc15c0d0 2024-08-18T22:34:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbee2000640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbedc0d0dc0 con 0x7fbedc0707e0 2024-08-18T22:34:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbee2000640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbedc0cdda0 con 0x7fbedc06bef0 2024-08-18T22:34:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbed3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbedc0707e0 0x7fbedc06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbed3e00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbedc0707e0 0x7fbedc06b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51252/0 (socket says 172.21.15.5:51252) 2024-08-18T22:34:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbed3e00640 1 -- 172.21.15.5:0/3961977222 learned_addr learned my addr 172.21.15.5:0/3961977222 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbee1600640 1 --2- 172.21.15.5:0/3961977222 >> v2:172.21.15.117:3300/0 conn(0x7fbedc06bef0 0x7fbedc0ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbed3e00640 1 -- 172.21.15.5:0/3961977222 >> v2:172.21.15.117:3300/0 conn(0x7fbedc06bef0 msgr2=0x7fbedc0ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbed3e00640 1 --2- 172.21.15.5:0/3961977222 >> v2:172.21.15.117:3300/0 conn(0x7fbedc06bef0 0x7fbedc0ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbed3e00640 1 -- 172.21.15.5:0/3961977222 >> v1:172.21.15.117:6789/0 conn(0x7fbedc15c0d0 legacy=0x7fbedc06f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.429+0000 7fbed3e00640 1 -- 172.21.15.5:0/3961977222 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc070fc0 con 0x7fbedc0707e0 2024-08-18T22:34:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbed3e00640 1 --2- 172.21.15.5:0/3961977222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbedc0707e0 0x7fbedc06b9b0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7fbedc072930 tx=0x7fbec401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26086ce74e2a5a15 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbedbe00640 1 -- 172.21.15.5:0/3961977222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec40b0070 con 0x7fbedc0707e0 2024-08-18T22:34:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbedbe00640 1 -- 172.21.15.5:0/3961977222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec40ab600 con 0x7fbedc0707e0 2024-08-18T22:34:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbedbe00640 1 -- 172.21.15.5:0/3961977222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec40ab9d0 con 0x7fbedc0707e0 2024-08-18T22:34:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbee2000640 1 -- 172.21.15.5:0/3961977222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbedc0707e0 msgr2=0x7fbedc06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbee2000640 1 --2- 172.21.15.5:0/3961977222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbedc0707e0 0x7fbedc06b9b0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7fbedc072930 tx=0x7fbec401c520 comp rx=0 tx=0).stop 2024-08-18T22:34:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbee2000640 1 -- 172.21.15.5:0/3961977222 shutdown_connections 2024-08-18T22:34:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbee2000640 1 --2- 172.21.15.5:0/3961977222 >> v2:172.21.15.117:3300/0 conn(0x7fbedc06bef0 0x7fbedc0ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbee2000640 1 --2- 172.21.15.5:0/3961977222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbedc0707e0 0x7fbedc06b9b0 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbee2000640 1 -- 172.21.15.5:0/3961977222 >> 172.21.15.5:0/3961977222 conn(0x7fbedc06e890 msgr2=0x7fbedc06eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbee2000640 1 -- 172.21.15.5:0/3961977222 shutdown_connections 2024-08-18T22:34:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbee2000640 1 -- 172.21.15.5:0/3961977222 wait complete. 2024-08-18T22:34:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbee2000640 1 Processor -- start 2024-08-18T22:34:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.433+0000 7fbee2000640 1 -- start start 2024-08-18T22:34:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee2000640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbedc06bef0 0x7fbedc13d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee2000640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbedc0707e0 0x7fbedc1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee2000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbedc15c0d0 0x7fbedc151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee2000640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc0cf310 con 0x7fbedc06bef0 2024-08-18T22:34:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee2000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc0cf190 con 0x7fbedc15c0d0 2024-08-18T22:34:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee2000640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7fbedc0cf490 con 0x7fbedc0707e0 2024-08-18T22:34:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee0c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbedc06bef0 0x7fbedc13d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee0c00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbedc06bef0 0x7fbedc13d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51258/0 (socket says 172.21.15.5:51258) 2024-08-18T22:34:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee0c00640 1 -- 172.21.15.5:0/2773322282 learned_addr learned my addr 172.21.15.5:0/2773322282 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee1600640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbedc15c0d0 0x7fbedc151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbed3e00640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbedc0707e0 0x7fbedc1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee0c00640 1 -- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbedc0707e0 msgr2=0x7fbedc1593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee0c00640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbedc0707e0 0x7fbedc1593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee0c00640 1 -- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbedc15c0d0 msgr2=0x7fbedc151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee0c00640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbedc15c0d0 0x7fbedc151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee0c00640 1 -- 172.21.15.5:0/2773322282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc13da50 con 0x7fbedc06bef0 2024-08-18T22:34:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbed3e00640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbedc0707e0 0x7fbedc1593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:34:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee0c00640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbedc06bef0 0x7fbedc13d510 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c3a0 tx=0x7fbecc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbed9600640 1 -- 172.21.15.5:0/2773322282 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc0052d0 con 0x7fbedc06bef0 2024-08-18T22:34:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbed9600640 1 -- 172.21.15.5:0/2773322282 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc005470 con 0x7fbedc06bef0 2024-08-18T22:34:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee2000640 1 -- 172.21.15.5:0/2773322282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc13ade0 con 0x7fbedc06bef0 2024-08-18T22:34:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbed9600640 1 -- 172.21.15.5:0/2773322282 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc007260 con 0x7fbedc06bef0 2024-08-18T22:34:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee2000640 1 -- 172.21.15.5:0/2773322282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc13b3a0 con 0x7fbedc06bef0 2024-08-18T22:34:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbee2000640 1 -- 172.21.15.5:0/2773322282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbedc06b9b0 con 0x7fbedc06bef0 2024-08-18T22:34:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.437+0000 7fbed9600640 1 -- 172.21.15.5:0/2773322282 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbecc007400 con 0x7fbedc06bef0 2024-08-18T22:34:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.441+0000 7fbed9600640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb80678c0 0x7fbeb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.441+0000 7fbed9600640 1 -- 172.21.15.5:0/2773322282 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7fbecc084ef0 con 0x7fbedc06bef0 2024-08-18T22:34:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.441+0000 7fbed3e00640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb80678c0 0x7fbeb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.441+0000 7fbed3e00640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb80678c0 0x7fbeb8069d80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fbec40ad000 tx=0x7fbec40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.445+0000 7fbed9600640 1 -- 172.21.15.5:0/2773322282 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7fbedc13da50 con 0x7fbedc06bef0 2024-08-18T22:34:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.605+0000 7fbee2000640 1 -- 172.21.15.5:0/2773322282 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbedc0aeab0 con 0x7fbeb80678c0 2024-08-18T22:34:30.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.605+0000 7fbed9600640 1 -- 172.21.15.5:0/2773322282 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13401 (secure 0 0 0) 0x7fbedc0aeab0 con 0x7fbeb80678c0 2024-08-18T22:34:30.605 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:30.605 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:34:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 -- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb80678c0 msgr2=0x7fbeb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb80678c0 0x7fbeb8069d80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fbec40ad000 tx=0x7fbec40a6000 comp rx=0 tx=0).stop 2024-08-18T22:34:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 -- 172.21.15.5:0/2773322282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbedc06bef0 msgr2=0x7fbedc13d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbedc06bef0 0x7fbedc13d510 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c3a0 tx=0x7fbecc00c860 comp rx=0 tx=0).stop 2024-08-18T22:34:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 -- 172.21.15.5:0/2773322282 shutdown_connections 2024-08-18T22:34:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7fbeb80678c0 0x7fbeb8069d80 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbedc15c0d0 0x7fbedc151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbedc0707e0 0x7fbedc1593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 --2- 172.21.15.5:0/2773322282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbedc06bef0 0x7fbedc13d510 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 -- 172.21.15.5:0/2773322282 >> 172.21.15.5:0/2773322282 conn(0x7fbedc06e890 msgr2=0x7fbedc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:30.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 -- 172.21.15.5:0/2773322282 shutdown_connections 2024-08-18T22:34:30.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:30.609+0000 7fbee2000640 1 -- 172.21.15.5:0/2773322282 wait complete. 2024-08-18T22:34:30.625 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":664,"stamp":"2024-08-18T22:34:29.845903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":432252,"kb_used_data":21768,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754542468,"statfs":{"total":773094113280,"available":772651487232,"internally_reserved":0,"allocated":22290432,"data_stored":11164120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003857"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":553,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-08-18T22:34:19.844219+0000","last_change":"2024-08-18T22:19:09.831178+0000","last_active":"2024-08-18T22:34:19.844219+0000","last_peered":"2024-08-18T22:34:19.844219+0000","last_clean":"2024-08-18T22:34:19.844219+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:34:19.844219+0000","last_undegraded":"2024-08-18T22:34:19.844219+0000","last_fullsized":"2024-08-18T22:34:19.844219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:19:08.036621+0000","last_clean_scrub_stamp":"2024-08-18T22:19:08.036621+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:47:47.980515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509627,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52388,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319452,"statfs":{"total":96636764160,"available":96583118848,"internally_reserved":0,"allocated":3231744,"data_stored":1838291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509629,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51804,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320036,"statfs":{"total":96636764160,"available":96583716864,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509627,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51804,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320036,"statfs":{"total":96636764160,"available":96583716864,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509628,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47648,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509627,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47648,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509628,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60708,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311132,"statfs":{"total":96636764160,"available":96574599168,"internally_reserved":0,"allocated":3231744,"data_stored":1838291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60124,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311716,"statfs":{"total":96636764160,"available":96575197184,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60128,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311712,"statfs":{"total":96636764160,"available":96575193088,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:34:30.628 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-18T22:19:08.036621+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=22, tm_min=19, tm_sec=8, tm_wday=6, tm_yday=231, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=22, tm_min=34, tm_sec=24, tm_wday=6, tm_yday=231, tm_isdst=0) 2024-08-18T22:34:30.628 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-18T22:34:50.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T22:34:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a25600640 1 Processor -- start 2024-08-18T22:34:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a25600640 1 -- start start 2024-08-18T22:34:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a25600640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2a2006b9b0 0x7f2a200ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a25600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a200b1c50 0x7f2a200b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a25600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a200b0bd0 con 0x7f2a2006bd90 2024-08-18T22:34:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a25600640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2a200b0e90 con 0x7f2a2006b9b0 2024-08-18T22:34:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a25600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2a200b1170 con 0x7f2a200b1c50 2024-08-18T22:34:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a1ea00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2a2006b9b0 0x7f2a200ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a1f400640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a200b1c50 0x7f2a200b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a16000640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2a2006bd90 0x7f2a201453d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.5:57828/0 (socket says 172.21.15.5:57828) 2024-08-18T22:34:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a16000640 1 -- 172.21.15.5:0/2942210665 learned_addr learned my addr 172.21.15.5:0/2942210665 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a1ea00640 1 -- 172.21.15.5:0/2942210665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a200b1c50 msgr2=0x7f2a200b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a1ea00640 1 --2- 172.21.15.5:0/2942210665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a200b1c50 0x7f2a200b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a1ea00640 1 -- 172.21.15.5:0/2942210665 >> v1:172.21.15.117:6789/0 conn(0x7f2a2006bd90 legacy=0x7f2a201453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.785+0000 7f2a1ea00640 1 -- 172.21.15.5:0/2942210665 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a200b1450 con 0x7f2a2006b9b0 2024-08-18T22:34:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a1ea00640 1 --2- 172.21.15.5:0/2942210665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a2006b9b0 0x7f2a200ce520 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2a100097c0 tx=0x7f2a1001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e51a0ef28f384e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a1e000640 1 -- 172.21.15.5:0/2942210665 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a100b1070 con 0x7f2a2006b9b0 2024-08-18T22:34:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a1e000640 1 -- 172.21.15.5:0/2942210665 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a100ac630 con 0x7f2a2006b9b0 2024-08-18T22:34:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a1e000640 1 -- 172.21.15.5:0/2942210665 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a100a8050 con 0x7f2a2006b9b0 2024-08-18T22:34:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a25600640 1 -- 172.21.15.5:0/2942210665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a2006b9b0 msgr2=0x7f2a200ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a25600640 1 --2- 172.21.15.5:0/2942210665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a2006b9b0 0x7f2a200ce520 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2a100097c0 tx=0x7f2a1001c4a0 comp rx=0 tx=0).stop 2024-08-18T22:34:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a25600640 1 -- 172.21.15.5:0/2942210665 shutdown_connections 2024-08-18T22:34:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a25600640 1 --2- 172.21.15.5:0/2942210665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a200b1c50 0x7f2a200b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a25600640 1 --2- 172.21.15.5:0/2942210665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a2006b9b0 0x7f2a200ce520 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a25600640 1 -- 172.21.15.5:0/2942210665 >> 172.21.15.5:0/2942210665 conn(0x7f2a2009aa40 msgr2=0x7f2a200b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:50.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a25600640 1 -- 172.21.15.5:0/2942210665 shutdown_connections 2024-08-18T22:34:50.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.789+0000 7f2a25600640 1 -- 172.21.15.5:0/2942210665 wait complete. 2024-08-18T22:34:50.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a25600640 1 Processor -- start 2024-08-18T22:34:50.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a25600640 1 -- start start 2024-08-18T22:34:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a25600640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a2006b9b0 0x7f2a2015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a25600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a2006bd90 0x7f2a2013a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a25600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a200b1c50 0x7f2a2013acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a25600640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2006c2f0 con 0x7f2a2006b9b0 2024-08-18T22:34:50.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a25600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2006c170 con 0x7f2a2006bd90 2024-08-18T22:34:50.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a25600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f2a200ae040 con 0x7f2a200b1c50 2024-08-18T22:34:50.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a1ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a2006b9b0 0x7f2a2015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:50.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a1ea00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a2006b9b0 0x7f2a2015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48744/0 (socket says 172.21.15.5:48744) 2024-08-18T22:34:50.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a1ea00640 1 -- 172.21.15.5:0/1900872481 learned_addr learned my addr 172.21.15.5:0/1900872481 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:50.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a16000640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a2006bd90 0x7f2a2013a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:50.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a1f400640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a200b1c50 0x7f2a2013acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:50.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a1ea00640 1 -- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a200b1c50 msgr2=0x7f2a2013acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a1ea00640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a200b1c50 0x7f2a2013acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a1ea00640 1 -- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a2006bd90 msgr2=0x7f2a2013a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a1ea00640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a2006bd90 0x7f2a2013a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a1ea00640 1 -- 172.21.15.5:0/1900872481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a200b5f60 con 0x7f2a2006b9b0 2024-08-18T22:34:50.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a1ea00640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a2006b9b0 0x7f2a2015b6a0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f2a1001a0d0 tx=0x7f2a10019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:50.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.793+0000 7f2a17400640 1 -- 172.21.15.5:0/1900872481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a100b1040 con 0x7f2a2006b9b0 2024-08-18T22:34:50.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.797+0000 7f2a17400640 1 -- 172.21.15.5:0/1900872481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a100bc070 con 0x7f2a2006b9b0 2024-08-18T22:34:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.797+0000 7f2a17400640 1 -- 172.21.15.5:0/1900872481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a100a8040 con 0x7f2a2006b9b0 2024-08-18T22:34:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.797+0000 7f2a25600640 1 -- 172.21.15.5:0/1900872481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a200b61e0 con 0x7f2a2006b9b0 2024-08-18T22:34:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.797+0000 7f2a25600640 1 -- 172.21.15.5:0/1900872481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a200b67a0 con 0x7f2a2006b9b0 2024-08-18T22:34:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.797+0000 7f2a25600640 1 -- 172.21.15.5:0/1900872481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a200ce520 con 0x7f2a2006b9b0 2024-08-18T22:34:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.797+0000 7f2a17400640 1 -- 172.21.15.5:0/1900872481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2a100b5650 con 0x7f2a2006b9b0 2024-08-18T22:34:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.797+0000 7f2a17400640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29fc0678c0 0x7f29fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:50.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.797+0000 7f2a17400640 1 -- 172.21.15.5:0/1900872481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f2a1011f590 con 0x7f2a2006b9b0 2024-08-18T22:34:50.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.797+0000 7f2a16000640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29fc0678c0 0x7f29fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:50.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.797+0000 7f2a16000640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29fc0678c0 0x7f29fc069d80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2a2013b990 tx=0x7f2a08007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:50.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.801+0000 7f2a17400640 1 -- 172.21.15.5:0/1900872481 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f2a200b5f60 con 0x7f2a2006b9b0 2024-08-18T22:34:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.965+0000 7f2a25600640 1 -- 172.21.15.5:0/1900872481 --> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a200ae370 con 0x7f29fc0678c0 2024-08-18T22:34:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.965+0000 7f2a17400640 1 -- 172.21.15.5:0/1900872481 <== mgr.4103 v2:172.21.15.117:6832/2733333912 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13386 (secure 0 0 0) 0x7f2a200ae370 con 0x7f29fc0678c0 2024-08-18T22:34:50.964 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:50.964 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-18T22:34:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 -- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29fc0678c0 msgr2=0x7f29fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29fc0678c0 0x7f29fc069d80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2a2013b990 tx=0x7f2a08007e90 comp rx=0 tx=0).stop 2024-08-18T22:34:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 -- 172.21.15.5:0/1900872481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a2006b9b0 msgr2=0x7f2a2015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:50.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a2006b9b0 0x7f2a2015b6a0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f2a1001a0d0 tx=0x7f2a10019240 comp rx=0 tx=0).stop 2024-08-18T22:34:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 -- 172.21.15.5:0/1900872481 shutdown_connections 2024-08-18T22:34:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f29fc0678c0 0x7f29fc069d80 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a200b1c50 0x7f2a2013acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a2006bd90 0x7f2a2013a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:50.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 --2- 172.21.15.5:0/1900872481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a2006b9b0 0x7f2a2015b6a0 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 -- 172.21.15.5:0/1900872481 >> 172.21.15.5:0/1900872481 conn(0x7f2a2009aa40 msgr2=0x7f2a200ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 -- 172.21.15.5:0/1900872481 shutdown_connections 2024-08-18T22:34:50.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:50.969+0000 7f2a25600640 1 -- 172.21.15.5:0/1900872481 wait complete. 2024-08-18T22:34:50.985 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":674,"stamp":"2024-08-18T22:34:49.850507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":432236,"kb_used_data":21768,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754542484,"statfs":{"total":773094113280,"available":772651503616,"internally_reserved":0,"allocated":22290432,"data_stored":11164120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002873"},"pg_stats":[{"pgid":"1.0","version":"209'119","reported_seq":564,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-08-18T22:34:31.132464+0000","last_change":"2024-08-18T22:34:31.132500+0000","last_active":"2024-08-18T22:34:31.132464+0000","last_peered":"2024-08-18T22:34:31.132464+0000","last_clean":"2024-08-18T22:34:31.132464+0000","last_became_active":"2024-08-18T22:19:09.829933+0000","last_became_peered":"2024-08-18T22:19:09.829933+0000","last_unstale":"2024-08-18T22:34:31.132464+0000","last_undegraded":"2024-08-18T22:34:31.132464+0000","last_fullsized":"2024-08-18T22:34:31.132464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"209'119","last_scrub_stamp":"2024-08-18T22:34:31.132370+0000","last_deep_scrub":"209'119","last_deep_scrub_stamp":"2024-08-18T22:34:31.132370+0000","last_clean_scrub_stamp":"2024-08-18T22:34:31.132370+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:19:31.923403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509631,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52380,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319460,"statfs":{"total":96636764160,"available":96583127040,"internally_reserved":0,"allocated":3231744,"data_stored":1838291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509633,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51804,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320036,"statfs":{"total":96636764160,"available":96583716864,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51804,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320036,"statfs":{"total":96636764160,"available":96583716864,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509632,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47648,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47648,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509632,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60700,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311140,"statfs":{"total":96636764160,"available":96574607360,"internally_reserved":0,"allocated":3231744,"data_stored":1838291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60124,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311716,"statfs":{"total":96636764160,"available":96575197184,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60128,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311712,"statfs":{"total":96636764160,"available":96575193088,"internally_reserved":0,"allocated":2637824,"data_stored":1247923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:34:50.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-18T22:34:51.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7f0003a00640 1 Processor -- start 2024-08-18T22:34:51.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7f0003a00640 1 -- start start 2024-08-18T22:34:51.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7f0003a00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efffc15c560 0x7efffc0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:51.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7f0003a00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efffc0cfb00 con 0x7efffc15d4d0 2024-08-18T22:34:51.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7f0003a00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efffc15c9f0 con 0x7efffc15c180 2024-08-18T22:34:51.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7f0003a00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7efffc15d040 con 0x7efffc15c560 2024-08-18T22:34:51.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7f0001a00640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efffc15d4d0 0x7efffc06db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60194/0 (socket says 172.21.15.5:60194) 2024-08-18T22:34:51.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7f0001a00640 1 -- 172.21.15.5:0/2895377841 learned_addr learned my addr 172.21.15.5:0/2895377841 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-08-18T22:34:51.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7efff3e00640 1 --2- 172.21.15.5:0/2895377841 >> v2:172.21.15.117:3300/0 conn(0x7efffc15c560 0x7efffc0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:51.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7efffbe00640 1 -- 172.21.15.5:0/2895377841 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103664436 0 0) 0x7efffc0cfb00 con 0x7efffc15d4d0 2024-08-18T22:34:51.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7efffbe00640 1 -- 172.21.15.5:0/2895377841 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effe0003530 con 0x7efffc15d4d0 2024-08-18T22:34:51.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7efffbe00640 1 -- 172.21.15.5:0/2895377841 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258186656 0 0) 0x7efffc15c9f0 con 0x7efffc15c180 2024-08-18T22:34:51.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7efffbe00640 1 -- 172.21.15.5:0/2895377841 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efffc0cfb00 con 0x7efffc15c180 2024-08-18T22:34:51.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7efff3e00640 1 -- 172.21.15.5:0/2895377841 >> v1:172.21.15.117:6789/0 conn(0x7efffc15c180 legacy=0x7efffc0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7efff3e00640 1 -- 172.21.15.5:0/2895377841 >> v1:172.21.15.5:6789/0 conn(0x7efffc15d4d0 legacy=0x7efffc06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7efffbe00640 1 -- 172.21.15.5:0/2895377841 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 353622692 0 0) 0x7effe0003530 con 0x7efffc15d4d0 2024-08-18T22:34:51.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.129+0000 7efff3e00640 1 -- 172.21.15.5:0/2895377841 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efffc15ccd0 con 0x7efffc15c560 2024-08-18T22:34:51.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7efff3e00640 1 --2- 172.21.15.5:0/2895377841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc15c560 0x7efffc0ce620 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7effe40097c0 tx=0x7effe401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5716e132e1db91ac server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:51.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7efffbe00640 1 -- 172.21.15.5:0/2895377841 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe40b0070 con 0x7efffc15c560 2024-08-18T22:34:51.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7efffbe00640 1 -- 172.21.15.5:0/2895377841 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efffc0ced70 con 0x7efffc15c560 2024-08-18T22:34:51.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7efffbe00640 1 -- 172.21.15.5:0/2895377841 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4001a00 con 0x7efffc15c560 2024-08-18T22:34:51.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7f0003a00640 1 -- 172.21.15.5:0/2895377841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc15c560 msgr2=0x7efffc0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7f0003a00640 1 --2- 172.21.15.5:0/2895377841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc15c560 0x7efffc0ce620 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7effe40097c0 tx=0x7effe401c330 comp rx=0 tx=0).stop 2024-08-18T22:34:51.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7f0003a00640 1 -- 172.21.15.5:0/2895377841 shutdown_connections 2024-08-18T22:34:51.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7f0003a00640 1 --2- 172.21.15.5:0/2895377841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc15c560 0x7efffc0ce620 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7f0003a00640 1 -- 172.21.15.5:0/2895377841 >> 172.21.15.5:0/2895377841 conn(0x7efffc0b1dc0 msgr2=0x7efffc0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:51.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7f0003a00640 1 -- 172.21.15.5:0/2895377841 shutdown_connections 2024-08-18T22:34:51.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7f0003a00640 1 -- 172.21.15.5:0/2895377841 wait complete. 2024-08-18T22:34:51.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.133+0000 7f0003a00640 1 Processor -- start 2024-08-18T22:34:51.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0003a00640 1 -- start start 2024-08-18T22:34:51.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0003a00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc15c180 0x7efffc1508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:51.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0003a00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc15d4d0 0x7efffc0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:51.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0003a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc158eb0 0x7efffc0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:51.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0003a00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efffc16a2c0 con 0x7efffc15d4d0 2024-08-18T22:34:51.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0003a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efffc16a140 con 0x7efffc158eb0 2024-08-18T22:34:51.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0003a00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7efffc16a440 con 0x7efffc15c180 2024-08-18T22:34:51.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc15d4d0 0x7efffc0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:51.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff3e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc15d4d0 0x7efffc0cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48750/0 (socket says 172.21.15.5:48750) 2024-08-18T22:34:51.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff3e00640 1 -- 172.21.15.5:0/2391236237 learned_addr learned my addr 172.21.15.5:0/2391236237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:51.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0001000640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc15c180 0x7efffc1508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:51.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0001a00640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc158eb0 0x7efffc0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:51.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff3e00640 1 -- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc15c180 msgr2=0x7efffc1508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff3e00640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc15c180 0x7efffc1508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff3e00640 1 -- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc158eb0 msgr2=0x7efffc0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff3e00640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc158eb0 0x7efffc0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff3e00640 1 -- 172.21.15.5:0/2391236237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efffc0af5e0 con 0x7efffc15d4d0 2024-08-18T22:34:51.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff3e00640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc15d4d0 0x7efffc0cdf10 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7effe4018f40 tx=0x7effe40190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:51.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff9600640 1 -- 172.21.15.5:0/2391236237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe40b0040 con 0x7efffc15d4d0 2024-08-18T22:34:51.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff9600640 1 -- 172.21.15.5:0/2391236237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe40036a0 con 0x7efffc15d4d0 2024-08-18T22:34:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0003a00640 1 -- 172.21.15.5:0/2391236237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efffc159340 con 0x7efffc15d4d0 2024-08-18T22:34:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7efff9600640 1 -- 172.21.15.5:0/2391236237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe4003a50 con 0x7efffc15d4d0 2024-08-18T22:34:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0003a00640 1 -- 172.21.15.5:0/2391236237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efffc071f10 con 0x7efffc15d4d0 2024-08-18T22:34:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.137+0000 7f0003a00640 1 -- 172.21.15.5:0/2391236237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efffc0cd4f0 con 0x7efffc15d4d0 2024-08-18T22:34:51.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.141+0000 7efff9600640 1 -- 172.21.15.5:0/2391236237 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7effe40bb030 con 0x7efffc15d4d0 2024-08-18T22:34:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.141+0000 7efff9600640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effd80678c0 0x7effd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.141+0000 7efff9600640 1 -- 172.21.15.5:0/2391236237 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7effe411ef00 con 0x7efffc15d4d0 2024-08-18T22:34:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.141+0000 7f0001000640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effd80678c0 0x7effd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.141+0000 7f0001000640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effd80678c0 0x7effd8069d80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7effec0011f0 tx=0x7effec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:51.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.145+0000 7efff9600640 1 -- 172.21.15.5:0/2391236237 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7effe40c2020 con 0x7efffc15d4d0 2024-08-18T22:34:51.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.309+0000 7f0003a00640 1 -- 172.21.15.5:0/2391236237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7efffc159620 con 0x7efffc15d4d0 2024-08-18T22:34:51.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.313+0000 7efff9600640 1 -- 172.21.15.5:0/2391236237 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v50)=0 v50) ==== 123+0+0 (secure 0 0 0) 0x7effe4015fb0 con 0x7efffc15d4d0 2024-08-18T22:34:51.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7efff9600640 1 -- 172.21.15.5:0/2391236237 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7effe40ef4d0 con 0x7efffc15d4d0 2024-08-18T22:34:51.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 -- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effd80678c0 msgr2=0x7effd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effd80678c0 0x7effd8069d80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7effec0011f0 tx=0x7effec009040 comp rx=0 tx=0).stop 2024-08-18T22:34:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 -- 172.21.15.5:0/2391236237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc15d4d0 msgr2=0x7efffc0cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc15d4d0 0x7efffc0cdf10 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7effe4018f40 tx=0x7effe40190d0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 -- 172.21.15.5:0/2391236237 shutdown_connections 2024-08-18T22:34:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7effd80678c0 0x7effd8069d80 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efffc158eb0 0x7efffc0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efffc15d4d0 0x7efffc0cdf10 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 --2- 172.21.15.5:0/2391236237 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efffc15c180 0x7efffc1508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 -- 172.21.15.5:0/2391236237 >> 172.21.15.5:0/2391236237 conn(0x7efffc0b1dc0 msgr2=0x7efffc0b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:51.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 -- 172.21.15.5:0/2391236237 shutdown_connections 2024-08-18T22:34:51.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.317+0000 7f0003a00640 1 -- 172.21.15.5:0/2391236237 wait complete. 2024-08-18T22:34:51.334 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T22:34:51.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T22:34:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.477+0000 7f3cafc00640 1 Processor -- start 2024-08-18T22:34:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.477+0000 7f3cafc00640 1 -- start start 2024-08-18T22:34:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cafc00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3ca815b010 0x7f3ca80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cafc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca806f290 0x7f3ca8072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cafc00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ca80cee20 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cafc00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3ca80cfa30 con 0x7f3ca815b010 2024-08-18T22:34:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cafc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca80cf100 con 0x7f3ca806f290 2024-08-18T22:34:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cadc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca806f290 0x7f3ca8072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cad200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3ca815b010 0x7f3ca80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cadc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca806f290 0x7f3ca8072620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.5:51106/0 (socket says 172.21.15.5:51106) 2024-08-18T22:34:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cad200640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3ca815b010 0x7f3ca80ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.5:56860/0 (socket says 172.21.15.5:56860) 2024-08-18T22:34:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cadc00640 1 -- 172.21.15.5:0/1854162574 learned_addr learned my addr 172.21.15.5:0/1854162574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cadc00640 1 -- 172.21.15.5:0/1854162574 >> v2:172.21.15.117:3300/0 conn(0x7f3ca815b010 msgr2=0x7f3ca80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T22:34:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cadc00640 1 --2- 172.21.15.5:0/1854162574 >> v2:172.21.15.117:3300/0 conn(0x7f3ca815b010 0x7f3ca80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cadc00640 1 -- 172.21.15.5:0/1854162574 >> v1:172.21.15.117:6789/0 conn(0x7f3ca80cd3a0 legacy=0x7f3ca806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.481+0000 7f3cadc00640 1 -- 172.21.15.5:0/1854162574 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca80cf3e0 con 0x7f3ca806f290 2024-08-18T22:34:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3cadc00640 1 --2- 172.21.15.5:0/1854162574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca806f290 0x7f3ca8072620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009870 tx=0x7f3ca001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f540b9af03d03c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3ca7400640 1 -- 172.21.15.5:0/1854162574 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00ab660 con 0x7f3ca806f290 2024-08-18T22:34:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3ca7400640 1 -- 172.21.15.5:0/1854162574 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3ca00b0070 con 0x7f3ca806f290 2024-08-18T22:34:51.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3ca7400640 1 -- 172.21.15.5:0/1854162574 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00aba40 con 0x7f3ca806f290 2024-08-18T22:34:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3cafc00640 1 -- 172.21.15.5:0/1854162574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca806f290 msgr2=0x7f3ca8072620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3cafc00640 1 --2- 172.21.15.5:0/1854162574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca806f290 0x7f3ca8072620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009870 tx=0x7f3ca001c530 comp rx=0 tx=0).stop 2024-08-18T22:34:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3cafc00640 1 -- 172.21.15.5:0/1854162574 shutdown_connections 2024-08-18T22:34:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3cafc00640 1 --2- 172.21.15.5:0/1854162574 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca806f290 0x7f3ca8072620 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3cafc00640 1 --2- 172.21.15.5:0/1854162574 >> v2:172.21.15.117:3300/0 conn(0x7f3ca815b010 0x7f3ca80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3cafc00640 1 -- 172.21.15.5:0/1854162574 >> 172.21.15.5:0/1854162574 conn(0x7f3ca80b1c50 msgr2=0x7f3ca80b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3cafc00640 1 -- 172.21.15.5:0/1854162574 shutdown_connections 2024-08-18T22:34:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3cafc00640 1 -- 172.21.15.5:0/1854162574 wait complete. 2024-08-18T22:34:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3cafc00640 1 Processor -- start 2024-08-18T22:34:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.485+0000 7f3cafc00640 1 -- start start 2024-08-18T22:34:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3cafc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ca806f290 0x7f3ca809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3cafc00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ca80cd3a0 0x7f3ca814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3cafc00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca815b010 0x7f3ca80b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3cafc00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca80734f0 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3cafc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca8073370 con 0x7f3ca806f290 2024-08-18T22:34:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3cafc00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca8073670 con 0x7f3ca815b010 2024-08-18T22:34:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ca80cd3a0 0x7f3ca814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3cad200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ca806f290 0x7f3ca809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca7e00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ca80cd3a0 0x7f3ca814ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48762/0 (socket says 172.21.15.5:48762) 2024-08-18T22:34:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca7e00640 1 -- 172.21.15.5:0/3378397483 learned_addr learned my addr 172.21.15.5:0/3378397483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-18T22:34:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3cadc00640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca815b010 0x7f3ca80b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca7e00640 1 -- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca815b010 msgr2=0x7f3ca80b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca7e00640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca815b010 0x7f3ca80b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca7e00640 1 -- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ca806f290 msgr2=0x7f3ca809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca7e00640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ca806f290 0x7f3ca809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca7e00640 1 -- 172.21.15.5:0/3378397483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca80b00e0 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca7e00640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ca80cd3a0 0x7f3ca814ee00 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400c420 tx=0x7f3c9400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca4c00640 1 -- 172.21.15.5:0/3378397483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c940052d0 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca4c00640 1 -- 172.21.15.5:0/3378397483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3c94005470 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3ca4c00640 1 -- 172.21.15.5:0/3378397483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94007280 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3cafc00640 1 -- 172.21.15.5:0/3378397483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca80b03c0 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3cafc00640 1 -- 172.21.15.5:0/3378397483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca814f340 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.489+0000 7f3cafc00640 1 -- 172.21.15.5:0/3378397483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca8072620 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.493+0000 7f3ca4c00640 1 -- 172.21.15.5:0/3378397483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c94007420 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.493+0000 7f3ca4c00640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c880678c0 0x7f3c88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.493+0000 7f3ca4c00640 1 -- 172.21.15.5:0/3378397483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5335+0+0 (secure 0 0 0) 0x7f3c94084ff0 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.493+0000 7f3cad200640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c880678c0 0x7f3c88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:51.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.493+0000 7f3cad200640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c880678c0 0x7f3c88069d80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f3c98011340 tx=0x7f3c9800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:51.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.497+0000 7f3ca4c00640 1 -- 172.21.15.5:0/3378397483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179300 (secure 0 0 0) 0x7f3c940555d0 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 -- 172.21.15.5:0/3378397483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ca80b23c0 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3ca4c00640 1 -- 172.21.15.5:0/3378397483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 162 v162) ==== 95+0+3912 (secure 0 0 0) 0x7f3c940598d0 con 0x7f3ca80cd3a0 2024-08-18T22:34:51.694 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-18T22:34:51.695 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":162,"btime":"2024-08-18T22:34:17:827224+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8984,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3790539137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3790539137},{"type":"v1","addr":"172.21.15.117:6836","nonce":3790539137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":162},{"gid":9862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1931701065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1931701065},{"type":"v1","addr":"172.21.15.117:6837","nonce":1931701065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":10731,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/83313921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":83313921},{"type":"v1","addr":"172.21.15.5:6833","nonce":83313921}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2593956905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2593956905},{"type":"v1","addr":"172.21.15.5:6835","nonce":2593956905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155}],"filesystems":[]} 2024-08-18T22:34:51.695 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 162 2024-08-18T22:34:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 -- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c880678c0 msgr2=0x7f3c88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c880678c0 0x7f3c88069d80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f3c98011340 tx=0x7f3c9800b040 comp rx=0 tx=0).stop 2024-08-18T22:34:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 -- 172.21.15.5:0/3378397483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ca80cd3a0 msgr2=0x7f3ca814ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ca80cd3a0 0x7f3ca814ee00 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400c420 tx=0x7f3c9400c8e0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 -- 172.21.15.5:0/3378397483 shutdown_connections 2024-08-18T22:34:51.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:6832/2733333912,v1:172.21.15.117:6833/2733333912] conn(0x7f3c880678c0 0x7f3c88069d80 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ca815b010 0x7f3ca80b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ca80cd3a0 0x7f3ca814ee00 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 --2- 172.21.15.5:0/3378397483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ca806f290 0x7f3ca809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:51.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 -- 172.21.15.5:0/3378397483 >> 172.21.15.5:0/3378397483 conn(0x7f3ca80b1c50 msgr2=0x7f3ca80cbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:51.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 -- 172.21.15.5:0/3378397483 shutdown_connections 2024-08-18T22:34:51.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-18T22:34:51.697+0000 7f3cafc00640 1 -- 172.21.15.5:0/3378397483 wait complete. 2024-08-18T22:34:51.716 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-18T22:34:51.717 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-18T22:34:51.717 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T22:34:51.717 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:34:51.729 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T22:34:51.729 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T22:34:51.729 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:34:51.783 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T22:34:51.784 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T22:34:51.784 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:34:51.799 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T22:34:51.799 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T22:34:51.799 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:34:51.857 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T22:34:51.857 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-18T22:34:51.858 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-18T22:34:51.858 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:34:54.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:34:54.757 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:34:56.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-08-18T22:34:57.960 INFO:tasks.ceph.osd.0:Stopped 2024-08-18T22:34:57.961 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-18T22:34:57.961 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:02.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-08-18T22:35:02.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-08-18T22:35:04.063 INFO:tasks.ceph.osd.1:Stopped 2024-08-18T22:35:04.064 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-18T22:35:04.064 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:04.154 INFO:tasks.ceph.osd.2:Stopped 2024-08-18T22:35:04.154 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-18T22:35:04.154 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:04.254 INFO:tasks.ceph.osd.3:Stopped 2024-08-18T22:35:04.254 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-18T22:35:04.255 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:04.336 INFO:tasks.ceph.osd.4:Stopped 2024-08-18T22:35:04.336 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-18T22:35:04.336 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:08.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-08-18T22:35:08.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-08-18T22:35:10.438 INFO:tasks.ceph.osd.5:Stopped 2024-08-18T22:35:10.439 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-18T22:35:10.439 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:10.525 INFO:tasks.ceph.osd.6:Stopped 2024-08-18T22:35:10.526 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-18T22:35:10.526 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:10.618 INFO:tasks.ceph.osd.7:Stopped 2024-08-18T22:35:10.618 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-18T22:35:10.618 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-18T22:35:10.619 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:10.677 INFO:tasks.ceph.mgr.y:Stopped 2024-08-18T22:35:10.677 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-18T22:35:10.677 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:10.736 INFO:tasks.ceph.mgr.x:Stopped 2024-08-18T22:35:10.736 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-18T22:35:10.737 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-18T22:35:10.737 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:10.759 INFO:tasks.ceph.mon.a:Stopped 2024-08-18T22:35:10.759 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-18T22:35:10.760 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:10.776 INFO:tasks.ceph.mon.b:Stopped 2024-08-18T22:35:10.776 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-18T22:35:10.777 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:35:10.839 INFO:tasks.ceph.mon.c:Stopped 2024-08-18T22:35:10.839 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-18T22:35:10.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-08-18T22:35:10.878 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:35:10.879 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-18T22:35:11.144 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:35:11.145 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-18T22:35:11.300 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:35:11.300 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-18T22:35:11.482 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:35:11.482 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-18T22:35:11.634 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:35:11.634 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-18T22:35:11.972 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:35:11.972 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-18T22:35:12.174 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:35:12.174 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-18T22:35:12.357 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:35:12.357 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-18T22:35:12.557 INFO:tasks.ceph:Archiving mon data... 2024-08-18T22:35:12.558 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915/data/mon.a.tgz 2024-08-18T22:35:12.558 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-08-18T22:35:12.568 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.GDnJCZeh7p 2024-08-18T22:35:12.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GDnJCZeh7p 2024-08-18T22:35:12.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.GDnJCZeh7p 2024-08-18T22:35:12.856 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.GDnJCZeh7p is 606KB 2024-08-18T22:35:13.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-08-18T22:35:13.347 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.GDnJCZeh7p 2024-08-18T22:35:13.356 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915/data/mon.b.tgz 2024-08-18T22:35:13.356 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-08-18T22:35:13.365 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.B3YFJ73qJY 2024-08-18T22:35:13.366 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.B3YFJ73qJY 2024-08-18T22:35:13.553 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.B3YFJ73qJY 2024-08-18T22:35:13.626 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.B3YFJ73qJY is 633KB 2024-08-18T22:35:13.825 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.B3YFJ73qJY 2024-08-18T22:35:13.834 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915/data/mon.c.tgz 2024-08-18T22:35:13.834 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-08-18T22:35:13.882 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.g97SS6B4DY 2024-08-18T22:35:13.882 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.g97SS6B4DY 2024-08-18T22:35:14.069 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.g97SS6B4DY 2024-08-18T22:35:14.143 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.g97SS6B4DY is 633KB 2024-08-18T22:35:14.517 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.g97SS6B4DY 2024-08-18T22:35:14.525 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-18T22:35:14.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-18T22:35:14.529 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-18T22:35:14.601 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-18T22:35:14.635 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-18T22:35:14.635 INFO:tasks.ceph:Archiving crash dumps... 2024-08-18T22:35:14.662 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915/remote/smithi005/crash 2024-08-18T22:35:14.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-18T22:35:14.685 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915/remote/smithi117/crash 2024-08-18T22:35:14.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-18T22:35:14.704 INFO:tasks.ceph:Shutting down logrotate 2024-08-18T22:35:14.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:35:14.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T22:35:14.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-18T22:35:14.822 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-18T22:35:14.841 INFO:tasks.ceph:Compressing logs... 2024-08-18T22:35:14.841 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-18T22:35:14.871 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-18T22:35:14.898 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49515.log 2024-08-18T22:35:14.899 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85130.log 2024-08-18T22:35:14.900 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73274.log 2024-08-18T22:35:14.900 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49515.log.gz 2024-08-18T22:35:14.901 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57991.log 2024-08-18T22:35:14.901 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.85130.log.gz 2024-08-18T22:35:14.902 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73248.log 2024-08-18T22:35:14.902 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73274.log.gz 2024-08-18T22:35:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73007.log 2024-08-18T22:35:14.903 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57991.log.gz 2024-08-18T22:35:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35974.log 2024-08-18T22:35:14.904 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73248.log.gz 2024-08-18T22:35:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87938.log 2024-08-18T22:35:14.905 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.73007.log.gz 2024-08-18T22:35:14.905 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85299.log 2024-08-18T22:35:14.906 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35974.log.gz 2024-08-18T22:35:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88302.log 2024-08-18T22:35:14.906 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87938.log.gz 2024-08-18T22:35:14.907 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32910.log 2024-08-18T22:35:14.907 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85299.log.gz 2024-08-18T22:35:14.908 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86520.log 2024-08-18T22:35:14.908 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88302.log.gz 2024-08-18T22:35:14.909 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49963.log 2024-08-18T22:35:14.909 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32910.log.gz 2024-08-18T22:35:14.911 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28910.log 2024-08-18T22:35:14.911 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-18T22:35:14.911 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.28910.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-18T22:35:14.911 INFO:teuthology.orchestra.run.smithi117.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28910.log.gz 2024-08-18T22:35:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79490.log 2024-08-18T22:35:14.913 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.86520.log.gz 2024-08-18T22:35:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76829.log 2024-08-18T22:35:14.913 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49963.log.gz 2024-08-18T22:35:14.914 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75917.log 2024-08-18T22:35:14.914 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.79490.log.gz 2024-08-18T22:35:14.914 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50312.log 2024-08-18T22:35:14.914 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76829.log.gz 2024-08-18T22:35:14.921 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34520.log 2024-08-18T22:35:14.921 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28838.log 2024-08-18T22:35:14.921 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.34520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34520.log.gz 2024-08-18T22:35:14.921 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28958.log 2024-08-18T22:35:14.921 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.28838.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-18T22:35:14.921 INFO:teuthology.orchestra.run.smithi117.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28838.log.gz 2024-08-18T22:35:14.921 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.28958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28814.log 2024-08-18T22:35:14.922 INFO:teuthology.orchestra.run.smithi117.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28958.log.gz 2024-08-18T22:35:14.922 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34604.log 2024-08-18T22:35:14.922 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.28814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34502.log 2024-08-18T22:35:14.922 INFO:teuthology.orchestra.run.smithi117.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28814.log.gz 2024-08-18T22:35:14.922 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.3.34604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.34604.log.gz 2024-08-18T22:35:14.922 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-18T22:35:14.923 INFO:teuthology.orchestra.run.smithi117.stderr:gzip/var/log/ceph/ceph-client.1.34502.log: -5 --verbose -- /var/log/ceph/ceph.log 2024-08-18T22:35:14.923 INFO:teuthology.orchestra.run.smithi117.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34502.log.gz 2024-08-18T22:35:14.923 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28862.log 2024-08-18T22:35:14.925 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.75917.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53277.log 2024-08-18T22:35:14.926 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75917.log.gz 2024-08-18T22:35:14.926 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86044.log 2024-08-18T22:35:14.926 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50312.log.gz 2024-08-18T22:35:14.926 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79177.log 2024-08-18T22:35:14.926 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53277.log.gz 2024-08-18T22:35:14.926 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85961.log 2024-08-18T22:35:14.926 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86044.log.gz 2024-08-18T22:35:14.927 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86986.log 2024-08-18T22:35:14.927 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.79177.log.gz 2024-08-18T22:35:14.927 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51945.log 2024-08-18T22:35:14.927 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.85961.log.gz 2024-08-18T22:35:14.927 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48853.log 2024-08-18T22:35:14.928 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86986.log.gz 2024-08-18T22:35:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57835.log 2024-08-18T22:35:14.928 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51945.log.gz 2024-08-18T22:35:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32828.log 2024-08-18T22:35:14.928 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48853.log.gz 2024-08-18T22:35:14.928 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86882.log 2024-08-18T22:35:14.928 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57835.log.gz 2024-08-18T22:35:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55496.log 2024-08-18T22:35:14.929 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32828.log.gz 2024-08-18T22:35:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86908.log 2024-08-18T22:35:14.929 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86882.log.gz 2024-08-18T22:35:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74101.log 2024-08-18T22:35:14.930 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55496.log.gz 2024-08-18T22:35:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85808.log 2024-08-18T22:35:14.930 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.86908.log.gz 2024-08-18T22:35:14.930 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71452.log 2024-08-18T22:35:14.930 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74101.log.gz 2024-08-18T22:35:14.935 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28886.log 2024-08-18T22:35:14.935 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.28862.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-18T22:35:14.935 INFO:teuthology.orchestra.run.smithi117.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28862.log.gz 2024-08-18T22:35:14.936 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.28886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34609.log 2024-08-18T22:35:14.936 INFO:teuthology.orchestra.run.smithi117.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28886.log.gz 2024-08-18T22:35:14.936 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28934.log 2024-08-18T22:35:14.936 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.3.34609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.34609.log.gz 2024-08-18T22:35:14.936 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.28934.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-18T22:35:14.936 INFO:teuthology.orchestra.run.smithi117.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28934.log.gz 2024-08-18T22:35:14.936 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-18T22:35:14.936 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-18T22:35:14.937 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-18T22:35:14.937 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-18T22:35:14.939 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-18T22:35:14.939 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.b.log: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-18T22:35:14.942 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85808.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-18T22:35:14.942 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.85808.log.gz 2024-08-18T22:35:14.943 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50871.log 2024-08-18T22:35:14.943 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71452.log.gz 2024-08-18T22:35:14.943 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81498.log 2024-08-18T22:35:14.943 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76451.log 2024-08-18T22:35:14.943 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50871.log.gz 2024-08-18T22:35:14.943 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33057.log 2024-08-18T22:35:14.943 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81498.log.gz 2024-08-18T22:35:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76630.log 2024-08-18T22:35:14.944 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76451.log.gz 2024-08-18T22:35:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35498.log 2024-08-18T22:35:14.944 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33057.log.gz 2024-08-18T22:35:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86206.log 2024-08-18T22:35:14.944 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76630.log.gz 2024-08-18T22:35:14.944 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34494.log 2024-08-18T22:35:14.944 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35498.log.gz 2024-08-18T22:35:14.945 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53552.log 2024-08-18T22:35:14.945 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.86206.log.gz 2024-08-18T22:35:14.945 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52640.log 2024-08-18T22:35:14.945 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34494.log.gz 2024-08-18T22:35:14.945 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82651.log 2024-08-18T22:35:14.945 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53552.log.gz 2024-08-18T22:35:14.945 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88250.log 2024-08-18T22:35:14.945 INFO:teuthology.orchestra.run.smithi005.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-18T22:35:14.945 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52640.log.gz 2024-08-18T22:35:14.946 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84373.log 2024-08-18T22:35:14.946 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82651.log.gz 2024-08-18T22:35:14.946 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52075.log 2024-08-18T22:35:14.946 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88250.log.gz 2024-08-18T22:35:14.946 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51919.log 2024-08-18T22:35:14.946 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.84373.log.gz 2024-08-18T22:35:14.946 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73613.log 2024-08-18T22:35:14.946 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52075.log.gz 2024-08-18T22:35:14.947 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71322.log 2024-08-18T22:35:14.947 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51919.log.gz 2024-08-18T22:35:14.947 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84919.log 2024-08-18T22:35:14.947 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73613.log.gz 2024-08-18T22:35:14.947 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85329.log 2024-08-18T22:35:14.947 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71322.log.gz 2024-08-18T22:35:14.949 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28982.log 2024-08-18T22:35:14.949 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.28982.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28982.log.gz 2024-08-18T22:35:14.955 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84666.log 2024-08-18T22:35:14.955 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84919.log.gz 2024-08-18T22:35:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55626.log 2024-08-18T22:35:14.956 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85329.log.gz 2024-08-18T22:35:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49054.log 2024-08-18T22:35:14.956 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.84666.log.gz 2024-08-18T22:35:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34182.log 2024-08-18T22:35:14.956 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55626.log.gz 2024-08-18T22:35:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36420.log 2024-08-18T22:35:14.956 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49054.log.gz 2024-08-18T22:35:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49341.log 2024-08-18T22:35:14.957 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34182.log.gz 2024-08-18T22:35:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.36420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36420.log.gz 2024-08-18T22:35:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81472.log 2024-08-18T22:35:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33782.log 2024-08-18T22:35:14.957 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49341.log.gz 2024-08-18T22:35:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86552.log 2024-08-18T22:35:14.957 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81472.log.gz 2024-08-18T22:35:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85212.log 2024-08-18T22:35:14.958 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33782.log.gz 2024-08-18T22:35:14.958 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54858.log 2024-08-18T22:35:14.958 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86552.log.gz 2024-08-18T22:35:14.958 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78980.log 2024-08-18T22:35:14.958 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85212.log.gz 2024-08-18T22:35:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85104.log 2024-08-18T22:35:14.959 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54858.log.gz 2024-08-18T22:35:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79099.log 2024-08-18T22:35:14.959 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78980.log.gz 2024-08-18T22:35:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56565.log 2024-08-18T22:35:14.959 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.85104.log.gz 2024-08-18T22:35:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50817.log 2024-08-18T22:35:14.959 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79099.log.gz 2024-08-18T22:35:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56417.log 2024-08-18T22:35:14.963 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56565.log.gz 2024-08-18T22:35:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55808.log 2024-08-18T22:35:14.963 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50817.log.gz 2024-08-18T22:35:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.56417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56417.log.gz 2024-08-18T22:35:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86258.log 2024-08-18T22:35:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79893.log 2024-08-18T22:35:14.964 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55808.log.gz 2024-08-18T22:35:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55711.log 2024-08-18T22:35:14.964 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86258.log.gz 2024-08-18T22:35:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85184.log 2024-08-18T22:35:14.965 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79893.log.gz 2024-08-18T22:35:14.965 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55711.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-18T22:35:14.965 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55711.log.gz 2024-08-18T22:35:14.965 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35913.log 2024-08-18T22:35:14.965 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.85184.log.gz 2024-08-18T22:35:14.966 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55126.log 2024-08-18T22:35:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71400.log 2024-08-18T22:35:14.969 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35913.log.gz 2024-08-18T22:35:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53883.log 2024-08-18T22:35:14.969 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.55126.log.gz 2024-08-18T22:35:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87445.log 2024-08-18T22:35:14.969 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71400.log.gz 2024-08-18T22:35:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52820.log 2024-08-18T22:35:14.970 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53883.log.gz 2024-08-18T22:35:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58318.log 2024-08-18T22:35:14.970 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87445.log.gz 2024-08-18T22:35:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.52820.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.52820.log.gz 2024-08-18T22:35:14.970 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33998.log 2024-08-18T22:35:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79639.log 2024-08-18T22:35:14.972 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58318.log.gz 2024-08-18T22:35:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73300.log 2024-08-18T22:35:14.972 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33998.log.gz 2024-08-18T22:35:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85381.log 2024-08-18T22:35:14.973 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79639.log.gz 2024-08-18T22:35:14.973 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35551.log 2024-08-18T22:35:14.973 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73300.log.gz 2024-08-18T22:35:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71374.log 2024-08-18T22:35:14.976 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.85381.log.gz 2024-08-18T22:35:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57635.log 2024-08-18T22:35:14.976 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35551.log.gz 2024-08-18T22:35:14.976 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83013.log 2024-08-18T22:35:14.976 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71374.log.gz 2024-08-18T22:35:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76339.log 2024-08-18T22:35:14.977 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57635.log.gz 2024-08-18T22:35:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.83013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.83013.log.gz 2024-08-18T22:35:14.977 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71185.log 2024-08-18T22:35:14.979 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35017.log 2024-08-18T22:35:14.979 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76339.log.gz 2024-08-18T22:35:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52588.log 2024-08-18T22:35:14.980 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71185.log.gz 2024-08-18T22:35:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52510.log 2024-08-18T22:35:14.980 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35017.log.gz 2024-08-18T22:35:14.980 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53409.log 2024-08-18T22:35:14.981 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52588.log.gz 2024-08-18T22:35:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52614.log 2024-08-18T22:35:14.981 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52510.log.gz 2024-08-18T22:35:14.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34756.log 2024-08-18T22:35:14.983 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53409.log.gz 2024-08-18T22:35:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48686.log 2024-08-18T22:35:14.983 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52614.log.gz 2024-08-18T22:35:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.34756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34756.log.gz 2024-08-18T22:35:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87357.log 2024-08-18T22:35:14.984 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52562.log 2024-08-18T22:35:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87357.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48686.log.gz 2024-08-18T22:35:14.985 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85004.log 2024-08-18T22:35:14.985 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87357.log.gz 2024-08-18T22:35:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34913.log 2024-08-18T22:35:14.986 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52562.log.gz 2024-08-18T22:35:14.986 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49619.log 2024-08-18T22:35:14.986 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.85004.log.gz 2024-08-18T22:35:14.987 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79274.log 2024-08-18T22:35:14.987 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34913.log.gz 2024-08-18T22:35:14.988 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73183.log 2024-08-18T22:35:14.988 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49619.log.gz 2024-08-18T22:35:14.989 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79274.log: gzip -5 88.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.79274.log.gz /var/log/ceph/ceph-client.admin.33740.log 2024-08-18T22:35:14.989 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T22:35:14.989 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53251.log 2024-08-18T22:35:14.990 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73183.log.gz 2024-08-18T22:35:14.991 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33792.log 2024-08-18T22:35:14.991 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33740.log.gz 2024-08-18T22:35:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85433.log 2024-08-18T22:35:14.992 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53251.log.gz 2024-08-18T22:35:14.992 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33005.log 2024-08-18T22:35:14.992 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33792.log.gz 2024-08-18T22:35:14.993 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86076.log 2024-08-18T22:35:14.993 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85433.log.gz 2024-08-18T22:35:14.994 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80140.log 2024-08-18T22:35:14.994 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33005.log.gz 2024-08-18T22:35:14.995 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71266.log 2024-08-18T22:35:14.995 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.86076.log.gz 2024-08-18T22:35:14.996 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.80140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51449.log 2024-08-18T22:35:14.996 INFO:teuthology.orchestra.run.smithi005.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.80140.log.gz 2024-08-18T22:35:14.996 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86726.log 2024-08-18T22:35:14.997 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71266.log.gz 2024-08-18T22:35:14.997 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58122.log 2024-08-18T22:35:14.998 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86726.log: 90.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.51449.log.gz -5 2024-08-18T22:35:14.998 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35349.log 2024-08-18T22:35:14.999 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86726.log.gz 2024-08-18T22:35:14.999 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81422.log 2024-08-18T22:35:14.999 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58122.log.gz 2024-08-18T22:35:15.000 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87062.log 2024-08-18T22:35:15.000 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35349.log.gz 2024-08-18T22:35:15.001 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79073.log 2024-08-18T22:35:15.002 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87062.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.81422.log.gz 2024-08-18T22:35:15.002 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80114.log 2024-08-18T22:35:15.002 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87062.log.gz 2024-08-18T22:35:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84561.log 2024-08-18T22:35:15.003 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79073.log.gz 2024-08-18T22:35:15.003 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.80114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35297.log 2024-08-18T22:35:15.004 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80114.log.gz 2024-08-18T22:35:15.004 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36188.log 2024-08-18T22:35:15.005 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35297.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.84561.log.gz 2024-08-18T22:35:15.006 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35297.log.gz 2024-08-18T22:35:15.006 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85717.log 2024-08-18T22:35:15.006 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58148.log 2024-08-18T22:35:15.007 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36188.log.gz 2024-08-18T22:35:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.85717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.85717.log.gz 2024-08-18T22:35:15.007 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50417.log 2024-08-18T22:35:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36084.log 2024-08-18T22:35:15.008 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58148.log.gz 2024-08-18T22:35:15.008 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57107.log 2024-08-18T22:35:15.009 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50417.log.gz 2024-08-18T22:35:15.009 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54436.log 2024-08-18T22:35:15.010 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36084.log.gz 2024-08-18T22:35:15.010 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78800.log 2024-08-18T22:35:15.010 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57107.log.gz 2024-08-18T22:35:15.013 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33237.log 2024-08-18T22:35:15.013 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54436.log.gz 2024-08-18T22:35:15.014 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87114.log 2024-08-18T22:35:15.014 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.78800.log.gz 2024-08-18T22:35:15.014 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84640.log 2024-08-18T22:35:15.015 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33237.log.gz 2024-08-18T22:35:15.015 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.87114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.87114.log.gz 2024-08-18T22:35:15.015 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34939.log 2024-08-18T22:35:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86804.log 2024-08-18T22:35:15.018 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84640.log.gz 2024-08-18T22:35:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80047.log 2024-08-18T22:35:15.018 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34939.log.gz 2024-08-18T22:35:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86409.log 2024-08-18T22:35:15.018 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86804.log.gz 2024-08-18T22:35:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.80047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57464.log 2024-08-18T22:35:15.019 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80047.log.gz 2024-08-18T22:35:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87497.log 2024-08-18T22:35:15.019 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86409.log.gz 2024-08-18T22:35:15.021 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48905.log 2024-08-18T22:35:15.021 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57464.log.gz 2024-08-18T22:35:15.021 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34468.log 2024-08-18T22:35:15.021 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.87497.log.gz 2024-08-18T22:35:15.021 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76060.log 2024-08-18T22:35:15.022 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48905.log.gz 2024-08-18T22:35:15.022 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54169.log 2024-08-18T22:35:15.023 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34468.log.gz 2024-08-18T22:35:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88042.log 2024-08-18T22:35:15.023 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76060.log.gz 2024-08-18T22:35:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82159.log 2024-08-18T22:35:15.024 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54169.log.gz 2024-08-18T22:35:15.024 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78520.log 2024-08-18T22:35:15.025 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88042.log.gz 2024-08-18T22:35:15.025 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55023.log 2024-08-18T22:35:15.025 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.82159.log.gz 2024-08-18T22:35:15.025 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50012.log 2024-08-18T22:35:15.026 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78520.log.gz 2024-08-18T22:35:15.027 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54013.log 2024-08-18T22:35:15.027 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55023.log.gz 2024-08-18T22:35:15.027 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54078.log 2024-08-18T22:35:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54013.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50012.log.gz 2024-08-18T22:35:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33610.log 2024-08-18T22:35:15.028 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54013.log.gz 2024-08-18T22:35:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81630.log 2024-08-18T22:35:15.029 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54078.log.gz 2024-08-18T22:35:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85273.log 2024-08-18T22:35:15.030 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33610.log.gz 2024-08-18T22:35:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79867.log 2024-08-18T22:35:15.030 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81630.log.gz 2024-08-18T22:35:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75607.log 2024-08-18T22:35:15.031 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85273.log.gz 2024-08-18T22:35:15.032 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55288.log 2024-08-18T22:35:15.032 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75607.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79867.log.gz 2024-08-18T22:35:15.034 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35069.log 2024-08-18T22:35:15.034 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75607.log.gz 2024-08-18T22:35:15.034 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55743.log 2024-08-18T22:35:15.035 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55288.log.gz 2024-08-18T22:35:15.035 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52108.log 2024-08-18T22:35:15.036 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35069.log.gz 2024-08-18T22:35:15.036 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35121.log 2024-08-18T22:35:15.036 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55743.log.gz 2024-08-18T22:35:15.036 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87601.log 2024-08-18T22:35:15.037 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52108.log.gz 2024-08-18T22:35:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79668.log 2024-08-18T22:35:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87601.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35121.log.gz 2024-08-18T22:35:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75557.log 2024-08-18T22:35:15.038 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.87601.log.gz 2024-08-18T22:35:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48827.log 2024-08-18T22:35:15.039 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79668.log.gz 2024-08-18T22:35:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34201.log 2024-08-18T22:35:15.040 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.75557.log.gz 2024-08-18T22:35:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80099.log 2024-08-18T22:35:15.041 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48827.log.gz 2024-08-18T22:35:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85058.log 2024-08-18T22:35:15.042 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34201.log.gz 2024-08-18T22:35:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.80099.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.0.80099.log.gz --verbose 2024-08-18T22:35:15.042 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.87780.log 2024-08-18T22:35:15.042 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70821.log 2024-08-18T22:35:15.043 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85058.log.gz 2024-08-18T22:35:15.043 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33988.log 2024-08-18T22:35:15.043 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87780.log.gz 2024-08-18T22:35:15.044 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54741.log 2024-08-18T22:35:15.044 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70821.log.gz 2024-08-18T22:35:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79839.log 2024-08-18T22:35:15.045 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.54741.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33988.log.gz 2024-08-18T22:35:15.046 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54741.log.gz 2024-08-18T22:35:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79379.log 2024-08-18T22:35:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75813.log 2024-08-18T22:35:15.047 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.79839.log.gz 2024-08-18T22:35:15.047 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79379.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-18T22:35:15.048 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79379.log.gz 2024-08-18T22:35:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48879.log 2024-08-18T22:35:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75813.log.gz 2024-08-18T22:35:15.049 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58174.log 2024-08-18T22:35:15.050 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57542.log 2024-08-18T22:35:15.050 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48879.log.gz 2024-08-18T22:35:15.051 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58174.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23789.log 2024-08-18T22:35:15.052 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58174.log.gz 2024-08-18T22:35:15.052 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57542.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57542.log.gz 2024-08-18T22:35:15.052 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53459.log 2024-08-18T22:35:15.053 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.23789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76907.log 2024-08-18T22:35:15.053 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23789.log.gz 2024-08-18T22:35:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33532.log 2024-08-18T22:35:15.054 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53459.log.gz 2024-08-18T22:35:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55366.log 2024-08-18T22:35:15.056 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76907.log.gz 2024-08-18T22:35:15.056 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35753.log 2024-08-18T22:35:15.056 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33532.log.gz 2024-08-18T22:35:15.057 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81322.log 2024-08-18T22:35:15.057 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55366.log.gz 2024-08-18T22:35:15.058 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57159.log 2024-08-18T22:35:15.058 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35753.log.gz 2024-08-18T22:35:15.060 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58043.log 2024-08-18T22:35:15.060 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57159.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.81322.log.gz 2024-08-18T22:35:15.060 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55076.log 2024-08-18T22:35:15.060 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57159.log.gz 2024-08-18T22:35:15.061 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76417.log 2024-08-18T22:35:15.061 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58043.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58043.log.gz 2024-08-18T22:35:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55418.log 2024-08-18T22:35:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76417.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55076.log.gz 2024-08-18T22:35:15.063 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76417.log.gz 2024-08-18T22:35:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84893.log 2024-08-18T22:35:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82001.log 2024-08-18T22:35:15.064 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55418.log: /var/log/ceph/ceph-client.admin.84893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50741.log 2024-08-18T22:35:15.064 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.55418.log.gz 2024-08-18T22:35:15.065 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.84893.log.gz 2024-08-18T22:35:15.066 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56112.log 2024-08-18T22:35:15.066 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82001.log.gz 2024-08-18T22:35:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50741.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50741.log.gz 2024-08-18T22:35:15.067 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84718.log 2024-08-18T22:35:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35524.log 2024-08-18T22:35:15.068 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56112.log.gz 2024-08-18T22:35:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84718.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.84718.log.gz 2024-08-18T22:35:15.068 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85537.log 2024-08-18T22:35:15.069 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49315.log 2024-08-18T22:35:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35524.log: /var/log/ceph/ceph-client.admin.85537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78494.log 2024-08-18T22:35:15.070 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85537.log.gz 2024-08-18T22:35:15.070 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35524.log.gz 2024-08-18T22:35:15.071 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71660.log 2024-08-18T22:35:15.072 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49315.log.gz 2024-08-18T22:35:15.072 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87705.log 2024-08-18T22:35:15.072 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78494.log.gz 2024-08-18T22:35:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54822.log 2024-08-18T22:35:15.073 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71660.log.gz 2024-08-18T22:35:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82230.log 2024-08-18T22:35:15.073 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87705.log.gz 2024-08-18T22:35:15.074 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71055.log 2024-08-18T22:35:15.074 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54822.log.gz 2024-08-18T22:35:15.075 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33789.log 2024-08-18T22:35:15.075 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82230.log.gz 2024-08-18T22:35:15.076 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71055.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71055.log.gz 2024-08-18T22:35:15.076 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49775.log 2024-08-18T22:35:15.077 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74049.log 2024-08-18T22:35:15.077 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33789.log.gz 2024-08-18T22:35:15.078 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49775.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-18T22:35:15.078 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49775.log.gz 2024-08-18T22:35:15.079 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75763.log 2024-08-18T22:35:15.079 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74049.log.gz 2024-08-18T22:35:15.080 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36136.log 2024-08-18T22:35:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56242.log 2024-08-18T22:35:15.081 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.75763.log.gz 2024-08-18T22:35:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54046.log 2024-08-18T22:35:15.082 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36136.log.gz 2024-08-18T22:35:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35453.log 2024-08-18T22:35:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56242.log: /var/log/ceph/ceph-client.admin.54046.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56242.log.gz 2024-08-18T22:35:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79997.log 2024-08-18T22:35:15.084 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54046.log.gz 2024-08-18T22:35:15.085 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76008.log 2024-08-18T22:35:15.085 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35453.log.gz 2024-08-18T22:35:15.086 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32736.log 2024-08-18T22:35:15.087 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.79997.log.gz 2024-08-18T22:35:15.087 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70664.log 2024-08-18T22:35:15.088 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76008.log.gz 2024-08-18T22:35:15.088 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33506.log 2024-08-18T22:35:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32736.log: /var/log/ceph/ceph-client.admin.70664.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32736.log.gz 2024-08-18T22:35:15.089 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54769.log 2024-08-18T22:35:15.089 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70664.log.gz 2024-08-18T22:35:15.090 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35699.log 2024-08-18T22:35:15.091 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33506.log.gz 2024-08-18T22:35:15.092 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86960.log 2024-08-18T22:35:15.092 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54769.log.gz 2024-08-18T22:35:15.093 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76391.log 2024-08-18T22:35:15.093 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35699.log.gz 2024-08-18T22:35:15.093 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33480.log 2024-08-18T22:35:15.094 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86960.log.gz 2024-08-18T22:35:15.094 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53175.log 2024-08-18T22:35:15.096 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76391.log.gz 2024-08-18T22:35:15.096 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75457.log 2024-08-18T22:35:15.096 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33480.log.gz 2024-08-18T22:35:15.096 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34001.log 2024-08-18T22:35:15.097 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53175.log.gz 2024-08-18T22:35:15.098 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54694.log 2024-08-18T22:35:15.098 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.75457.log.gz 2024-08-18T22:35:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54254.log 2024-08-18T22:35:15.099 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34001.log.gz 2024-08-18T22:35:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82677.log 2024-08-18T22:35:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54694.log: /var/log/ceph/ceph-client.admin.54254.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54694.log.gz 2024-08-18T22:35:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73913.log 2024-08-18T22:35:15.101 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54254.log.gz 2024-08-18T22:35:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73157.log 2024-08-18T22:35:15.103 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.82677.log.gz 2024-08-18T22:35:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84472.log 2024-08-18T22:35:15.103 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73913.log.gz 2024-08-18T22:35:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79151.log 2024-08-18T22:35:15.104 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73157.log.gz 2024-08-18T22:35:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70899.log 2024-08-18T22:35:15.106 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.84472.log.gz 2024-08-18T22:35:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36266.log 2024-08-18T22:35:15.106 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79151.log.gz 2024-08-18T22:35:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81975.log 2024-08-18T22:35:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70899.log: /var/log/ceph/ceph-client.admin.36266.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70899.log.gz 2024-08-18T22:35:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78850.log 2024-08-18T22:35:15.108 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36266.log.gz 2024-08-18T22:35:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54592.log 2024-08-18T22:35:15.109 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.81975.log.gz 2024-08-18T22:35:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52206.log 2024-08-18T22:35:15.110 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78850.log.gz 2024-08-18T22:35:15.111 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54746.log 2024-08-18T22:35:15.111 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54592.log.gz 2024-08-18T22:35:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86102.log 2024-08-18T22:35:15.112 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52206.log.gz 2024-08-18T22:35:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.54746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86752.log 2024-08-18T22:35:15.113 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54746.log.gz 2024-08-18T22:35:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84248.log 2024-08-18T22:35:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86102.log: /var/log/ceph/ceph-client.admin.86752.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86102.log.gz 2024-08-18T22:35:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86232.log 2024-08-18T22:35:15.115 INFO:teuthology.orchestra.run.smithi005.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.86752.log.gz 2024-08-18T22:35:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76881.log 2024-08-18T22:35:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86232.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.84248.log.gz 2024-08-18T22:35:15.118 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79945.log 2024-08-18T22:35:15.118 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86232.log.gz 2024-08-18T22:35:15.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50920.log 2024-08-18T22:35:15.119 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76881.log.gz 2024-08-18T22:35:15.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71348.log 2024-08-18T22:35:15.119 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79945.log.gz 2024-08-18T22:35:15.120 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32977.log 2024-08-18T22:35:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71348.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50920.log.gz 2024-08-18T22:35:15.122 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48801.log 2024-08-18T22:35:15.122 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71348.log.gz 2024-08-18T22:35:15.122 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71608.log 2024-08-18T22:35:15.123 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32977.log.gz 2024-08-18T22:35:15.124 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57752.log 2024-08-18T22:35:15.124 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48801.log.gz 2024-08-18T22:35:15.124 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5/var/log/ceph/ceph-client.admin.71608.log: --verbose -- /var/log/ceph/ceph-client.admin.49801.log 2024-08-18T22:35:15.125 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71608.log.gz 2024-08-18T22:35:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52954.log 2024-08-18T22:35:15.126 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57752.log.gz 2024-08-18T22:35:15.126 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86856.log 2024-08-18T22:35:15.127 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49801.log.gz 2024-08-18T22:35:15.128 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86128.log 2024-08-18T22:35:15.128 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52954.log.gz 2024-08-18T22:35:15.129 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84274.log 2024-08-18T22:35:15.129 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86856.log.gz 2024-08-18T22:35:15.130 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54226.log 2024-08-18T22:35:15.130 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86128.log.gz 2024-08-18T22:35:15.131 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79696.log 2024-08-18T22:35:15.132 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54226.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.84274.log.gz 2024-08-18T22:35:15.132 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71783.log 2024-08-18T22:35:15.132 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54226.log.gz 2024-08-18T22:35:15.133 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76365.log 2024-08-18T22:35:15.133 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79696.log.gz 2024-08-18T22:35:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.71783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71783.log.gz 2024-08-18T22:35:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87575.log 2024-08-18T22:35:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73704.log 2024-08-18T22:35:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76365.log: /var/log/ceph/ceph-client.admin.87575.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76365.log.gz 2024-08-18T22:35:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76086.log 2024-08-18T22:35:15.137 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.87575.log.gz 2024-08-18T22:35:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50364.log 2024-08-18T22:35:15.139 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73704.log.gz 2024-08-18T22:35:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49926.log 2024-08-18T22:35:15.139 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76086.log.gz 2024-08-18T22:35:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84587.log 2024-08-18T22:35:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.49926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49926.log.gz 2024-08-18T22:35:15.140 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50364.log.gz 2024-08-18T22:35:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52401.log 2024-08-18T22:35:15.142 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.4.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-18T22:35:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74153.log 2024-08-18T22:35:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84587.log: /var/log/ceph/ceph-client.admin.52401.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84587.log.gz 2024-08-18T22:35:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73535.log 2024-08-18T22:35:15.143 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52401.log.gz 2024-08-18T22:35:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71237.log 2024-08-18T22:35:15.144 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74153.log.gz 2024-08-18T22:35:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56294.log 2024-08-18T22:35:15.145 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73535.log.gz 2024-08-18T22:35:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87252.log 2024-08-18T22:35:15.146 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71237.log.gz 2024-08-18T22:35:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56422.log 2024-08-18T22:35:15.147 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56294.log.gz 2024-08-18T22:35:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87832.log 2024-08-18T22:35:15.148 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.56422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56422.log.gz 2024-08-18T22:35:15.149 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.87252.log.gz 2024-08-18T22:35:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78598.log 2024-08-18T22:35:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55652.log 2024-08-18T22:35:15.150 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87832.log: /var/log/ceph/ceph-client.admin.78598.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87832.log.gz 2024-08-18T22:35:15.151 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71686.log 2024-08-18T22:35:15.152 INFO:teuthology.orchestra.run.smithi005.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.78598.log.gz 2024-08-18T22:35:15.152 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85459.log 2024-08-18T22:35:15.152 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55652.log.gz 2024-08-18T22:35:15.153 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53046.log 2024-08-18T22:35:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71686.log: /var/log/ceph/ceph-client.admin.85459.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85459.log.gz 2024-08-18T22:35:15.154 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55548.log 2024-08-18T22:35:15.154 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71686.log.gz 2024-08-18T22:35:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35323.log 2024-08-18T22:35:15.157 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53046.log.gz 2024-08-18T22:35:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55548.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55548.log.gz 2024-08-18T22:35:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53909.log 2024-08-18T22:35:15.157 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55392.log 2024-08-18T22:35:15.158 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35323.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35323.log.gz 2024-08-18T22:35:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86617.log 2024-08-18T22:35:15.159 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53909.log.gz 2024-08-18T22:35:15.159 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86487.log 2024-08-18T22:35:15.160 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55392.log.gz 2024-08-18T22:35:15.160 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86303.log 2024-08-18T22:35:15.160 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86617.log.gz 2024-08-18T22:35:15.161 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85485.log 2024-08-18T22:35:15.162 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86487.log.gz 2024-08-18T22:35:15.162 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74281.log 2024-08-18T22:35:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86303.log: /var/log/ceph/ceph-client.admin.85485.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86303.log.gz 2024-08-18T22:35:15.163 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76855.log 2024-08-18T22:35:15.163 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85485.log.gz 2024-08-18T22:35:15.164 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.74281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73456.log 2024-08-18T22:35:15.164 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74281.log.gz 2024-08-18T22:35:15.165 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76855.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76855.log.gz 2024-08-18T22:35:15.165 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73430.log 2024-08-18T22:35:15.166 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87964.log 2024-08-18T22:35:15.166 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73456.log.gz 2024-08-18T22:35:15.167 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86830.log 2024-08-18T22:35:15.167 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73430.log.gz 2024-08-18T22:35:15.168 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57386.log 2024-08-18T22:35:15.168 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87964.log.gz 2024-08-18T22:35:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33423.log 2024-08-18T22:35:15.169 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86830.log: /var/log/ceph/ceph-client.admin.57386.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86830.log.gz 2024-08-18T22:35:15.170 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76959.log 2024-08-18T22:35:15.170 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57386.log.gz 2024-08-18T22:35:15.171 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73404.log 2024-08-18T22:35:15.171 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33423.log.gz 2024-08-18T22:35:15.172 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53935.log 2024-08-18T22:35:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76959.log: /var/log/ceph/ceph-client.admin.73404.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73404.log.gz 2024-08-18T22:35:15.173 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33714.log 2024-08-18T22:35:15.173 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.76959.log.gz 2024-08-18T22:35:15.174 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56164.log 2024-08-18T22:35:15.175 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53935.log: /var/log/ceph/ceph-client.admin.33714.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53935.log.gz 2024-08-18T22:35:15.175 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54306.log 2024-08-18T22:35:15.175 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33714.log.gz 2024-08-18T22:35:15.176 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73997.log 2024-08-18T22:35:15.177 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56164.log.gz 2024-08-18T22:35:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71582.log 2024-08-18T22:35:15.179 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54306.log.gz 2024-08-18T22:35:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79731.log 2024-08-18T22:35:15.179 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73997.log.gz 2024-08-18T22:35:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55574.log 2024-08-18T22:35:15.182 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71582.log.gz 2024-08-18T22:35:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85511.log 2024-08-18T22:35:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79731.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79731.log.gz 2024-08-18T22:35:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85407.log 2024-08-18T22:35:15.183 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55574.log.gz 2024-08-18T22:35:15.185 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51399.log 2024-08-18T22:35:15.185 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85511.log.gz 2024-08-18T22:35:15.186 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.85407.log: /var/log/ceph/ceph-client.admin.76719.log 2024-08-18T22:35:15.186 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85407.log.gz 2024-08-18T22:35:15.186 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85589.log 2024-08-18T22:35:15.187 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.51399.log.gz 2024-08-18T22:35:15.189 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56086.log 2024-08-18T22:35:15.189 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76719.log.gz 2024-08-18T22:35:15.189 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73483.log 2024-08-18T22:35:15.190 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85589.log.gz 2024-08-18T22:35:15.190 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85911.log 2024-08-18T22:35:15.190 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56086.log.gz 2024-08-18T22:35:15.190 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35647.log 2024-08-18T22:35:15.190 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73483.log.gz 2024-08-18T22:35:15.191 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32882.log 2024-08-18T22:35:15.192 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35647.log: gzip 91.0% -- replaced with /var/log/ceph/ceph-client.admin.85911.log.gz -5 2024-08-18T22:35:15.192 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35857.log 2024-08-18T22:35:15.192 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35647.log.gz 2024-08-18T22:35:15.193 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82961.log 2024-08-18T22:35:15.193 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32882.log.gz 2024-08-18T22:35:15.193 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34965.log 2024-08-18T22:35:15.194 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35857.log.gz 2024-08-18T22:35:15.195 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78288.log 2024-08-18T22:35:15.195 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82961.log.gz 2024-08-18T22:35:15.196 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33776.log 2024-08-18T22:35:15.196 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34965.log.gz 2024-08-18T22:35:15.196 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73561.log 2024-08-18T22:35:15.198 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78288.log: /var/log/ceph/ceph-client.admin.33776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28711.log 2024-08-18T22:35:15.198 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.78288.log.gz 2024-08-18T22:35:15.199 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33776.log.gz 2024-08-18T22:35:15.199 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87886.log 2024-08-18T22:35:15.199 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73561.log.gz 2024-08-18T22:35:15.200 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84211.log 2024-08-18T22:35:15.200 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28711.log.gz 2024-08-18T22:35:15.201 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79327.log 2024-08-18T22:35:15.201 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87886.log.gz 2024-08-18T22:35:15.202 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48481.log 2024-08-18T22:35:15.202 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84211.log.gz 2024-08-18T22:35:15.203 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35805.log 2024-08-18T22:35:15.203 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79327.log: /var/log/ceph/ceph-client.admin.48481.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.79327.log.gz 2024-08-18T22:35:15.204 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84528.log 2024-08-18T22:35:15.204 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48481.log.gz 2024-08-18T22:35:15.205 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76164.log 2024-08-18T22:35:15.205 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35805.log.gz 2024-08-18T22:35:15.206 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76190.log 2024-08-18T22:35:15.206 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84528.log.gz 2024-08-18T22:35:15.207 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58302.log 2024-08-18T22:35:15.207 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76164.log.gz 2024-08-18T22:35:15.208 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76190.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-18T22:35:15.209 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76190.log.gz 2024-08-18T22:35:15.209 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.58302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57726.log 2024-08-18T22:35:15.209 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58302.log.gz 2024-08-18T22:35:15.210 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78238.log 2024-08-18T22:35:15.211 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33794.log 2024-08-18T22:35:15.212 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57726.log.gz 2024-08-18T22:35:15.212 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73352.log 2024-08-18T22:35:15.213 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33794.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.78238.log.gz 2024-08-18T22:35:15.214 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52432.log 2024-08-18T22:35:15.214 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33794.log.gz 2024-08-18T22:35:15.215 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79431.log 2024-08-18T22:35:15.215 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73352.log.gz 2024-08-18T22:35:15.216 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71634.log 2024-08-18T22:35:15.216 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52432.log.gz 2024-08-18T22:35:15.217 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33031.log 2024-08-18T22:35:15.217 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79431.log.gz 2024-08-18T22:35:15.218 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36030.log 2024-08-18T22:35:15.218 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71634.log.gz 2024-08-18T22:35:15.219 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49829.log 2024-08-18T22:35:15.220 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33031.log.gz 2024-08-18T22:35:15.220 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34572.log 2024-08-18T22:35:15.221 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36030.log.gz 2024-08-18T22:35:15.221 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32945.log 2024-08-18T22:35:15.222 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34572.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49829.log.gz 2024-08-18T22:35:15.223 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74179.log 2024-08-18T22:35:15.223 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32945.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.34572.log.gz 2024-08-18T22:35:15.224 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81884.log 2024-08-18T22:35:15.224 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32945.log.gz 2024-08-18T22:35:15.225 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76803.log 2024-08-18T22:35:15.225 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.74179.log.gz 2024-08-18T22:35:15.226 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85563.log 2024-08-18T22:35:15.226 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81884.log.gz 2024-08-18T22:35:15.227 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71530.log 2024-08-18T22:35:15.227 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76803.log.gz 2024-08-18T22:35:15.228 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74229.log 2024-08-18T22:35:15.228 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85563.log.gz 2024-08-18T22:35:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86154.log 2024-08-18T22:35:15.230 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71530.log.gz 2024-08-18T22:35:15.231 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35215.log 2024-08-18T22:35:15.231 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74229.log.gz 2024-08-18T22:35:15.231 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48957.log 2024-08-18T22:35:15.232 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86154.log.gz 2024-08-18T22:35:15.232 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33688.log 2024-08-18T22:35:15.233 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35215.log.gz 2024-08-18T22:35:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35948.log 2024-08-18T22:35:15.235 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48957.log.gz 2024-08-18T22:35:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84744.log 2024-08-18T22:35:15.235 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33688.log.gz 2024-08-18T22:35:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53831.log 2024-08-18T22:35:15.236 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35948.log.gz 2024-08-18T22:35:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51274.log 2024-08-18T22:35:15.237 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.84744.log.gz 2024-08-18T22:35:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84971.log 2024-08-18T22:35:15.238 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53831.log.gz 2024-08-18T22:35:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34002.log 2024-08-18T22:35:15.240 INFO:teuthology.orchestra.run.smithi005.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51274.log.gz 2024-08-18T22:35:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87177.log 2024-08-18T22:35:15.241 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84971.log.gz 2024-08-18T22:35:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51299.log 2024-08-18T22:35:15.242 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34002.log.gz 2024-08-18T22:35:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34194.log 2024-08-18T22:35:15.243 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.87177.log.gz 2024-08-18T22:35:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78648.log 2024-08-18T22:35:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34194.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51299.log.gz 2024-08-18T22:35:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70925.log 2024-08-18T22:35:15.245 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34194.log.gz 2024-08-18T22:35:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85712.log 2024-08-18T22:35:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70925.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.78648.log.gz 2024-08-18T22:35:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87653.log 2024-08-18T22:35:15.248 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70925.log.gz 2024-08-18T22:35:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.85712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70847.log 2024-08-18T22:35:15.248 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.85712.log.gz 2024-08-18T22:35:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56216.log 2024-08-18T22:35:15.249 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87653.log.gz 2024-08-18T22:35:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79300.log 2024-08-18T22:35:15.251 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.70847.log.gz 2024-08-18T22:35:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.34884.log 2024-08-18T22:35:15.252 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56216.log.gz 2024-08-18T22:35:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57360.log 2024-08-18T22:35:15.253 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79300.log.gz 2024-08-18T22:35:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.2.34884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77061.log 2024-08-18T22:35:15.254 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.34884.log.gz 2024-08-18T22:35:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56804.log 2024-08-18T22:35:15.255 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57360.log.gz 2024-08-18T22:35:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.77061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86180.log 2024-08-18T22:35:15.256 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.77061.log.gz 2024-08-18T22:35:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35095.log 2024-08-18T22:35:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86180.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56804.log.gz 2024-08-18T22:35:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56682.log 2024-08-18T22:35:15.258 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86180.log.gz 2024-08-18T22:35:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78698.log 2024-08-18T22:35:15.259 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35095.log.gz 2024-08-18T22:35:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55314.log 2024-08-18T22:35:15.261 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56682.log.gz 2024-08-18T22:35:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58297.log 2024-08-18T22:35:15.262 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78698.log.gz 2024-08-18T22:35:15.262 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55470.log 2024-08-18T22:35:15.263 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55314.log.gz 2024-08-18T22:35:15.264 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.58297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49749.log 2024-08-18T22:35:15.264 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58297.log.gz 2024-08-18T22:35:15.264 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.55470.log: -- /var/log/ceph/ceph-client.admin.77009.log 2024-08-18T22:35:15.265 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55470.log.gz 2024-08-18T22:35:15.266 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36318.log 2024-08-18T22:35:15.266 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49749.log.gz 2024-08-18T22:35:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.77009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55952.log 2024-08-18T22:35:15.267 INFO:teuthology.orchestra.run.smithi005.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.77009.log.gz 2024-08-18T22:35:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81604.log 2024-08-18T22:35:15.269 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.36318.log.gz 2024-08-18T22:35:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82807.log 2024-08-18T22:35:15.269 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55952.log.gz 2024-08-18T22:35:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88172.log 2024-08-18T22:35:15.271 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81604.log.gz 2024-08-18T22:35:15.271 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50767.log 2024-08-18T22:35:15.271 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.82807.log.gz 2024-08-18T22:35:15.272 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82027.log 2024-08-18T22:35:15.272 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88172.log.gz 2024-08-18T22:35:15.273 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55978.log 2024-08-18T22:35:15.274 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82027.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50767.log.gz 2024-08-18T22:35:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34416.log 2024-08-18T22:35:15.275 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82027.log.gz 2024-08-18T22:35:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73587.log 2024-08-18T22:35:15.276 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55978.log.gz 2024-08-18T22:35:15.277 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57308.log 2024-08-18T22:35:15.277 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34416.log.gz 2024-08-18T22:35:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33558.log 2024-08-18T22:35:15.278 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73587.log.gz 2024-08-18T22:35:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87109.log 2024-08-18T22:35:15.279 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57308.log.gz 2024-08-18T22:35:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70951.log 2024-08-18T22:35:15.280 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33558.log.gz 2024-08-18T22:35:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.87109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.87109.log.gz 2024-08-18T22:35:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33788.log 2024-08-18T22:35:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70951.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-18T22:35:15.283 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70951.log.gz 2024-08-18T22:35:15.284 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33187.log 2024-08-18T22:35:15.284 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33788.log.gz 2024-08-18T22:35:15.285 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50162.log 2024-08-18T22:35:15.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57809.log 2024-08-18T22:35:15.287 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50162.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.33187.log.gz 2024-08-18T22:35:15.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57809.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.50162.log.gz 2024-08-18T22:35:15.289 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70873.log 2024-08-18T22:35:15.289 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57809.log.gz 2024-08-18T22:35:15.289 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57781.log 2024-08-18T22:35:15.291 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82833.log 2024-08-18T22:35:15.291 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70873.log.gz 2024-08-18T22:35:15.292 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82334.log 2024-08-18T22:35:15.292 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57781.log.gz 2024-08-18T22:35:15.294 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82833.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82833.log.gz 2024-08-18T22:35:15.294 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82334.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.82334.log.gz 2024-08-18T22:35:15.295 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56778.log 2024-08-18T22:35:15.296 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82755.log 2024-08-18T22:35:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51499.log 2024-08-18T22:35:15.298 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56778.log.gz 2024-08-18T22:35:15.298 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82755.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82755.log.gz 2024-08-18T22:35:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33636.log 2024-08-18T22:35:15.299 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51499.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51499.log.gz 2024-08-18T22:35:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33793.log 2024-08-18T22:35:15.301 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49158.log 2024-08-18T22:35:15.302 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33636.log.gz 2024-08-18T22:35:15.303 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85665.log 2024-08-18T22:35:15.303 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33793.log.gz 2024-08-18T22:35:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49158.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49158.log.gz 2024-08-18T22:35:15.305 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56560.log 2024-08-18T22:35:15.305 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85665.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.85665.log.gz 2024-08-18T22:35:15.306 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81682.log 2024-08-18T22:35:15.307 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57700.log 2024-08-18T22:35:15.307 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56560.log.gz 2024-08-18T22:35:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81682.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.81682.log.gz 2024-08-18T22:35:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56004.log 2024-08-18T22:35:15.309 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57700.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.57700.log.gz 2024-08-18T22:35:15.309 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81943.log 2024-08-18T22:35:15.311 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51716.log 2024-08-18T22:35:15.311 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56004.log.gz 2024-08-18T22:35:15.312 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82107.log 2024-08-18T22:35:15.312 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81943.log.gz 2024-08-18T22:35:15.313 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51716.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51716.log.gz 2024-08-18T22:35:15.314 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53753.log 2024-08-18T22:35:15.315 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.82107.log.gz 2024-08-18T22:35:15.315 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53353.log 2024-08-18T22:35:15.316 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79783.log 2024-08-18T22:35:15.317 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53753.log.gz 2024-08-18T22:35:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57133.log 2024-08-18T22:35:15.318 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53353.log.gz 2024-08-18T22:35:15.319 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79783.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79783.log.gz 2024-08-18T22:35:15.319 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82419.log 2024-08-18T22:35:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57133.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57133.log.gz 2024-08-18T22:35:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57334.log 2024-08-18T22:35:15.321 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80094.log 2024-08-18T22:35:15.322 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.82419.log.gz 2024-08-18T22:35:15.323 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52666.log 2024-08-18T22:35:15.323 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57334.log.gz 2024-08-18T22:35:15.324 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.80094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.80094.log.gz 2024-08-18T22:35:15.325 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52666.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52666.log.gz 2024-08-18T22:35:15.325 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35401.log 2024-08-18T22:35:15.327 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36435.log 2024-08-18T22:35:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55834.log 2024-08-18T22:35:15.328 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35401.log.gz 2024-08-18T22:35:15.329 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36435.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36435.log.gz 2024-08-18T22:35:15.330 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55834.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55834.log.gz 2024-08-18T22:35:15.331 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76933.log 2024-08-18T22:35:15.332 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56566.log 2024-08-18T22:35:15.334 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55050.log 2024-08-18T22:35:15.334 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.76933.log.gz 2024-08-18T22:35:15.335 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56566.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56566.log.gz 2024-08-18T22:35:15.335 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55050.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55050.log.gz 2024-08-18T22:35:15.336 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70716.log 2024-08-18T22:35:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51971.log 2024-08-18T22:35:15.339 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79919.log 2024-08-18T22:35:15.339 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70716.log.gz 2024-08-18T22:35:15.339 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51971.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51971.log.gz 2024-08-18T22:35:15.340 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79919.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79919.log.gz 2024-08-18T22:35:15.341 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56880.log 2024-08-18T22:35:15.342 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49217.log 2024-08-18T22:35:15.344 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52861.log 2024-08-18T22:35:15.344 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56880.log.gz 2024-08-18T22:35:15.345 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50970.log 2024-08-18T22:35:15.345 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49217.log.gz 2024-08-18T22:35:15.346 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57043.log 2024-08-18T22:35:15.346 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52861.log.gz 2024-08-18T22:35:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50970.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50970.log.gz 2024-08-18T22:35:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57043.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57043.log.gz 2024-08-18T22:35:15.348 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49459.log 2024-08-18T22:35:15.350 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88094.log 2024-08-18T22:35:15.351 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73326.log 2024-08-18T22:35:15.351 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49459.log.gz 2024-08-18T22:35:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57913.log 2024-08-18T22:35:15.352 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88094.log.gz 2024-08-18T22:35:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81817.log 2024-08-18T22:35:15.354 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73326.log.gz 2024-08-18T22:35:15.354 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57913.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57913.log.gz 2024-08-18T22:35:15.355 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36415.log 2024-08-18T22:35:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81817.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81817.log.gz 2024-08-18T22:35:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50691.log 2024-08-18T22:35:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.36415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53379.log 2024-08-18T22:35:15.357 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36415.log.gz 2024-08-18T22:35:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33994.log 2024-08-18T22:35:15.359 INFO:teuthology.orchestra.run.smithi005.stderr: 91.4%/var/log/ceph/ceph-client.admin.53379.log: -- replaced with /var/log/ceph/ceph-client.admin.50691.log.gz 2024-08-18T22:35:15.359 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53379.log.gz 2024-08-18T22:35:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33994.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33994.log.gz 2024-08-18T22:35:15.361 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87627.log 2024-08-18T22:35:15.362 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87990.log 2024-08-18T22:35:15.364 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78876.log 2024-08-18T22:35:15.364 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87627.log.gz 2024-08-18T22:35:15.365 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84613.log 2024-08-18T22:35:15.366 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87990.log.gz 2024-08-18T22:35:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78876.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78876.log.gz 2024-08-18T22:35:15.366 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71211.log 2024-08-18T22:35:15.367 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84613.log: gzip 87.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.84613.log.gz -- 2024-08-18T22:35:15.368 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.78414.log 2024-08-18T22:35:15.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55173.log 2024-08-18T22:35:15.369 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71211.log.gz 2024-08-18T22:35:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78414.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78414.log.gz 2024-08-18T22:35:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.55173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55173.log.gz 2024-08-18T22:35:15.371 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86011.log 2024-08-18T22:35:15.372 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71478.log 2024-08-18T22:35:15.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88353.log 2024-08-18T22:35:15.374 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86011.log.gz 2024-08-18T22:35:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71478.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71478.log.gz 2024-08-18T22:35:15.375 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58017.log 2024-08-18T22:35:15.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88353.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88353.log.gz 2024-08-18T22:35:15.377 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51349.log 2024-08-18T22:35:15.378 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51632.log 2024-08-18T22:35:15.379 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58017.log.gz 2024-08-18T22:35:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88329.log 2024-08-18T22:35:15.381 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2%/var/log/ceph/ceph-client.admin.51632.log: -- replaced with /var/log/ceph/ceph-client.admin.51349.log.gz 2024-08-18T22:35:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54514.log 2024-08-18T22:35:15.381 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51632.log.gz 2024-08-18T22:35:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88329.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88329.log.gz 2024-08-18T22:35:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54514.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54514.log.gz 2024-08-18T22:35:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86934.log 2024-08-18T22:35:15.384 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52375.log 2024-08-18T22:35:15.386 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53327.log 2024-08-18T22:35:15.386 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.86934.log.gz 2024-08-18T22:35:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52375.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52375.log.gz 2024-08-18T22:35:15.387 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57211.log 2024-08-18T22:35:15.389 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53327.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53327.log.gz 2024-08-18T22:35:15.389 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49723.log 2024-08-18T22:35:15.390 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52349.log 2024-08-18T22:35:15.391 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57211.log.gz 2024-08-18T22:35:15.392 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57861.log 2024-08-18T22:35:15.392 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49723.log.gz 2024-08-18T22:35:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52349.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52349.log.gz 2024-08-18T22:35:15.393 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53578.log 2024-08-18T22:35:15.394 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35245.log 2024-08-18T22:35:15.394 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57861.log.gz 2024-08-18T22:35:15.395 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56190.log 2024-08-18T22:35:15.395 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53578.log.gz 2024-08-18T22:35:15.396 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35245.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35245.log.gz 2024-08-18T22:35:15.396 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82597.log 2024-08-18T22:35:15.397 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82386.log 2024-08-18T22:35:15.398 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56190.log.gz 2024-08-18T22:35:15.399 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57438.log 2024-08-18T22:35:15.399 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82597.log.gz 2024-08-18T22:35:15.400 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82386.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82386.log.gz 2024-08-18T22:35:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71003.log 2024-08-18T22:35:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57438.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57438.log.gz 2024-08-18T22:35:15.401 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49593.log 2024-08-18T22:35:15.403 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54618.log 2024-08-18T22:35:15.404 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71003.log.gz 2024-08-18T22:35:15.404 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49593.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49593.log.gz 2024-08-18T22:35:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86383.log 2024-08-18T22:35:15.407 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54618.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54618.log.gz 2024-08-18T22:35:15.407 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71029.log 2024-08-18T22:35:15.407 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75891.log 2024-08-18T22:35:15.408 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86383.log.gz 2024-08-18T22:35:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71029.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71029.log.gz 2024-08-18T22:35:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36368.log 2024-08-18T22:35:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75891.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75891.log.gz 2024-08-18T22:35:15.410 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53526.log 2024-08-18T22:35:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52023.log 2024-08-18T22:35:15.412 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36368.log.gz 2024-08-18T22:35:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53526.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53526.log.gz 2024-08-18T22:35:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52023.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52023.log.gz 2024-08-18T22:35:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56906.log 2024-08-18T22:35:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-18T22:35:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52887.log 2024-08-18T22:35:15.417 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56906.log.gz/var/log/ceph/ceph.log: 2024-08-18T22:35:15.418 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52887.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52887.log.gz 2024-08-18T22:35:15.419 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56138.log 2024-08-18T22:35:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76138.log 2024-08-18T22:35:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56138.log: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-18T22:35:15.422 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56138.log.gz 2024-08-18T22:35:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76138.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76138.log.gz 2024-08-18T22:35:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33986.log 2024-08-18T22:35:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81372.log 2024-08-18T22:35:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33977.log 2024-08-18T22:35:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33986.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33986.log.gz/var/log/ceph/ceph-client.admin.81372.log: 2024-08-18T22:35:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33977.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.81372.log.gz 2024-08-18T22:35:15.428 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33977.log.gz 2024-08-18T22:35:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33450.log 2024-08-18T22:35:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49367.log 2024-08-18T22:35:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81910.log 2024-08-18T22:35:15.431 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33450.log.gz 2024-08-18T22:35:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52314.log 2024-08-18T22:35:15.432 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49367.log.gz 2024-08-18T22:35:15.433 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81910.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81910.log.gz 2024-08-18T22:35:15.434 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82625.log 2024-08-18T22:35:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52314.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52314.log.gz 2024-08-18T22:35:15.435 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82517.log 2024-08-18T22:35:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82625.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82625.log.gz 2024-08-18T22:35:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49249.log 2024-08-18T22:35:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82517.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82517.log.gz 2024-08-18T22:35:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87012.log 2024-08-18T22:35:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49249.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49249.log.gz 2024-08-18T22:35:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70632.log 2024-08-18T22:35:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76745.log 2024-08-18T22:35:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70632.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.87012.log.gz 2024-08-18T22:35:15.441 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.70632.log.gz 2024-08-18T22:35:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76745.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76745.log.gz 2024-08-18T22:35:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34991.log 2024-08-18T22:35:15.444 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51768.log 2024-08-18T22:35:15.445 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78338.log 2024-08-18T22:35:15.446 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34991.log.gz 2024-08-18T22:35:15.447 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51768.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51768.log.gz 2024-08-18T22:35:15.448 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78338.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.78338.log.gz 2024-08-18T22:35:15.449 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53961.log 2024-08-18T22:35:15.450 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74075.log 2024-08-18T22:35:15.452 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53708.log 2024-08-18T22:35:15.452 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53961.log.gz 2024-08-18T22:35:15.453 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54859.log 2024-08-18T22:35:15.453 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.74075.log.gz 2024-08-18T22:35:15.454 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54488.log 2024-08-18T22:35:15.454 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53708.log.gz 2024-08-18T22:35:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58200.log 2024-08-18T22:35:15.455 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54859.log.gz 2024-08-18T22:35:15.456 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54488.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54488.log.gz 2024-08-18T22:35:15.458 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58200.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58200.log.gz 2024-08-18T22:35:15.459 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87380.log 2024-08-18T22:35:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78442.log 2024-08-18T22:35:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52718.log 2024-08-18T22:35:15.463 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.87380.log.gz 2024-08-18T22:35:15.464 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78442.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78442.log.gz 2024-08-18T22:35:15.464 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52718.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.52718.log.gz 2024-08-18T22:35:15.465 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53987.log 2024-08-18T22:35:15.465 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87731.log 2024-08-18T22:35:15.467 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76112.log 2024-08-18T22:35:15.467 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53987.log.gz 2024-08-18T22:35:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87731.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87731.log.gz 2024-08-18T22:35:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76112.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76112.log.gz 2024-08-18T22:35:15.469 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75713.log 2024-08-18T22:35:15.471 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71736.log 2024-08-18T22:35:15.473 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35727.log 2024-08-18T22:35:15.473 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71736.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.75713.log.gz 2024-08-18T22:35:15.474 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35727.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35727.log.gz 2024-08-18T22:35:15.475 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70690.log 2024-08-18T22:35:15.475 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71736.log.gz 2024-08-18T22:35:15.476 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49485.log 2024-08-18T22:35:15.477 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51846.log 2024-08-18T22:35:15.478 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70690.log.gz 2024-08-18T22:35:15.478 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81790.log 2024-08-18T22:35:15.479 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49485.log.gz 2024-08-18T22:35:15.479 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51846.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51846.log.gz 2024-08-18T22:35:15.480 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78388.log 2024-08-18T22:35:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81790.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81790.log.gz 2024-08-18T22:35:15.481 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71296.log 2024-08-18T22:35:15.482 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36058.log 2024-08-18T22:35:15.483 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78388.log.gz 2024-08-18T22:35:15.483 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71296.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71296.log.gz 2024-08-18T22:35:15.484 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36058.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36058.log.gz 2024-08-18T22:35:15.485 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82703.log 2024-08-18T22:35:15.486 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76313.log 2024-08-18T22:35:15.488 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86698.log 2024-08-18T22:35:15.488 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.82703.log.gz 2024-08-18T22:35:15.489 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73822.log 2024-08-18T22:35:15.489 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76313.log.gz 2024-08-18T22:35:15.490 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86698.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86698.log.gz 2024-08-18T22:35:15.490 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32802.log 2024-08-18T22:35:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73822.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.73822.log.gz 2024-08-18T22:35:15.491 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55600.log 2024-08-18T22:35:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83008.log 2024-08-18T22:35:15.493 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32802.log.gz 2024-08-18T22:35:15.495 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-18T22:35:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55600.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55600.log.gz 2024-08-18T22:35:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49541.log 2024-08-18T22:35:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.83008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.83008.log.gz 2024-08-18T22:35:15.496 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70742.log 2024-08-18T22:35:15.497 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82282.log 2024-08-18T22:35:15.497 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49541.log.gz 2024-08-18T22:35:15.498 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70742.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70742.log.gz 2024-08-18T22:35:15.499 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82282.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.82282.log.gz 2024-08-18T22:35:15.500 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82133.log 2024-08-18T22:35:15.501 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36000.log 2024-08-18T22:35:15.502 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36214.log 2024-08-18T22:35:15.502 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82133.log.gz 2024-08-18T22:35:15.503 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36000.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36000.log.gz 2024-08-18T22:35:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81858.log 2024-08-18T22:35:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36214.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36214.log.gz 2024-08-18T22:35:15.505 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79203.log 2024-08-18T22:35:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54358.log 2024-08-18T22:35:15.506 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.81858.log.gz 2024-08-18T22:35:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58069.log 2024-08-18T22:35:15.507 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79203.log.gz 2024-08-18T22:35:15.509 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54358.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54358.log.gz 2024-08-18T22:35:15.509 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73939.log 2024-08-18T22:35:15.510 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58069.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58069.log.gz 2024-08-18T22:35:15.510 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56441.log 2024-08-18T22:35:15.512 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73939.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.73939.log.gz 2024-08-18T22:35:15.512 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55256.log 2024-08-18T22:35:15.513 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79757.log 2024-08-18T22:35:15.513 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56441.log.gz 2024-08-18T22:35:15.514 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55256.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55256.log.gz 2024-08-18T22:35:15.515 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84815.log 2024-08-18T22:35:15.515 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79757.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79757.log.gz 2024-08-18T22:35:15.516 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35186.log 2024-08-18T22:35:15.517 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35885.log 2024-08-18T22:35:15.518 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.84815.log.gz 2024-08-18T22:35:15.518 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35186.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35186.log.gz 2024-08-18T22:35:15.519 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52049.log 2024-08-18T22:35:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35885.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35885.log.gz 2024-08-18T22:35:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87202.log 2024-08-18T22:35:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52049.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52049.log.gz 2024-08-18T22:35:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53221.log 2024-08-18T22:35:15.523 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87202.log: /var/log/ceph/ceph-client.admin.53221.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.87202.log.gz 2024-08-18T22:35:15.524 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53221.log.gz 2024-08-18T22:35:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54566.log 2024-08-18T22:35:15.525 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-18T22:35:15.526 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54856.log 2024-08-18T22:35:15.527 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82781.log 2024-08-18T22:35:15.528 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54566.log.gz 2024-08-18T22:35:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54856.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54856.log.gz 2024-08-18T22:35:15.529 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82781.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82781.log.gz 2024-08-18T22:35:15.529 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32854.log 2024-08-18T22:35:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53857.log 2024-08-18T22:35:15.532 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54855.log 2024-08-18T22:35:15.532 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32854.log.gz 2024-08-18T22:35:15.533 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78750.log 2024-08-18T22:35:15.533 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53857.log.gz 2024-08-18T22:35:15.534 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54855.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54855.log.gz 2024-08-18T22:35:15.535 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57570.log 2024-08-18T22:35:15.536 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73057.log 2024-08-18T22:35:15.536 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.78750.log.gz 2024-08-18T22:35:15.537 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57570.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57570.log.gz 2024-08-18T22:35:15.538 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54410.log 2024-08-18T22:35:15.539 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57237.log 2024-08-18T22:35:15.539 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.73057.log.gz 2024-08-18T22:35:15.540 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51891.log 2024-08-18T22:35:15.540 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54410.log.gz 2024-08-18T22:35:15.541 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86461.log 2024-08-18T22:35:15.542 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57237.log.gz 2024-08-18T22:35:15.542 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51891.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51891.log.gz 2024-08-18T22:35:15.542 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34638.log 2024-08-18T22:35:15.544 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58095.log 2024-08-18T22:35:15.544 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86461.log.gz 2024-08-18T22:35:15.545 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54462.log 2024-08-18T22:35:15.546 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34638.log.gz 2024-08-18T22:35:15.546 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58095.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58095.log.gz 2024-08-18T22:35:15.547 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87154.log 2024-08-18T22:35:15.547 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54462.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54462.log.gz 2024-08-18T22:35:15.548 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49423.log 2024-08-18T22:35:15.549 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35427.log 2024-08-18T22:35:15.550 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87154.log.gz 2024-08-18T22:35:15.550 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49423.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49423.log.gz 2024-08-18T22:35:15.551 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55340.log 2024-08-18T22:35:15.552 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35427.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35427.log.gz 2024-08-18T22:35:15.552 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48581.log 2024-08-18T22:35:15.553 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70575.log 2024-08-18T22:35:15.553 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55340.log.gz 2024-08-18T22:35:15.555 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48581.log: /var/log/ceph/ceph-client.admin.70575.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48581.log.gz 2024-08-18T22:35:15.556 INFO:teuthology.orchestra.run.smithi005.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.70575.log.gz 2024-08-18T22:35:15.556 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84867.log 2024-08-18T22:35:15.557 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85156.log 2024-08-18T22:35:15.559 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76261.log 2024-08-18T22:35:15.559 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84867.log.gz 2024-08-18T22:35:15.560 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85156.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85156.log.gz 2024-08-18T22:35:15.561 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76261.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76261.log.gz 2024-08-18T22:35:15.561 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33365.log 2024-08-18T22:35:15.563 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79405.log 2024-08-18T22:35:15.565 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70977.log 2024-08-18T22:35:15.566 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79405.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79405.log.gz 2024-08-18T22:35:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70977.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70977.log.gz 2024-08-18T22:35:15.567 INFO:teuthology.orchestra.run.smithi005.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.33365.log.gz 2024-08-18T22:35:15.567 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75865.log 2024-08-18T22:35:15.568 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35583.log 2024-08-18T22:35:15.570 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78724.log 2024-08-18T22:35:15.570 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75865.log.gz 2024-08-18T22:35:15.570 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35583.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35583.log.gz 2024-08-18T22:35:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78724.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78724.log.gz 2024-08-18T22:35:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77056.log 2024-08-18T22:35:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34774.log 2024-08-18T22:35:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.77056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55860.log 2024-08-18T22:35:15.574 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.77056.log.gz 2024-08-18T22:35:15.575 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.34774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34774.log.gz 2024-08-18T22:35:15.577 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55860.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55860.log.gz 2024-08-18T22:35:15.577 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52768.log 2024-08-18T22:35:15.578 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76602.log 2024-08-18T22:35:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32703.log 2024-08-18T22:35:15.580 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52768.log.gz 2024-08-18T22:35:15.582 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50469.log 2024-08-18T22:35:15.582 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76602.log.gz 2024-08-18T22:35:15.582 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32703.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32703.log.gz 2024-08-18T22:35:15.584 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48636.log 2024-08-18T22:35:15.584 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73796.log 2024-08-18T22:35:15.584 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50469.log.gz 2024-08-18T22:35:15.584 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50541.log 2024-08-18T22:35:15.585 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48636.log.gz/var/log/ceph/ceph-client.admin.73796.log: 2024-08-18T22:35:15.586 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73796.log.gz 2024-08-18T22:35:15.586 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34520.log 2024-08-18T22:35:15.587 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34196.log 2024-08-18T22:35:15.587 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50541.log.gz 2024-08-18T22:35:15.589 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34000.log 2024-08-18T22:35:15.589 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34520.log.gz 2024-08-18T22:35:15.590 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34196.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34196.log.gz 2024-08-18T22:35:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76658.log 2024-08-18T22:35:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34000.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34000.log.gz 2024-08-18T22:35:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35155.log 2024-08-18T22:35:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86778.log 2024-08-18T22:35:15.593 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76658.log.gz 2024-08-18T22:35:15.594 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35155.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35155.log.gz 2024-08-18T22:35:15.595 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86778.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86778.log.gz 2024-08-18T22:35:15.596 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50641.log 2024-08-18T22:35:15.597 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88379.log 2024-08-18T22:35:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52232.log 2024-08-18T22:35:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88379.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.50641.log.gz 2024-08-18T22:35:15.600 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88379.log.gz 2024-08-18T22:35:15.600 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87549.log 2024-08-18T22:35:15.601 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52232.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52232.log.gz 2024-08-18T22:35:15.601 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48531.log 2024-08-18T22:35:15.603 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51575.log 2024-08-18T22:35:15.603 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87549.log.gz 2024-08-18T22:35:15.604 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49106.log 2024-08-18T22:35:15.604 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51575.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48531.log.gz 2024-08-18T22:35:15.606 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51575.log.gz 2024-08-18T22:35:15.606 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2024-08-18T22:35:15.606 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49106.log.gz 2024-08-18T22:35:15.607 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55522.log 2024-08-18T22:35:15.608 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85615.log 2024-08-18T22:35:15.609 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55522.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz 2024-08-18T22:35:15.610 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55522.log.gz 2024-08-18T22:35:15.611 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85615.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.85615.log.gz 2024-08-18T22:35:15.612 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54280.log 2024-08-18T22:35:15.613 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33161.log 2024-08-18T22:35:15.614 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56932.log 2024-08-18T22:35:15.615 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54280.log.gz 2024-08-18T22:35:15.615 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33161.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33161.log.gz 2024-08-18T22:35:15.617 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56932.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56932.log.gz 2024-08-18T22:35:15.617 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87858.log 2024-08-18T22:35:15.618 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81578.log 2024-08-18T22:35:15.620 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53682.log 2024-08-18T22:35:15.620 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87858.log.gz 2024-08-18T22:35:15.621 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81708.log 2024-08-18T22:35:15.621 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81578.log.gz 2024-08-18T22:35:15.622 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53682.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53682.log.gz 2024-08-18T22:35:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56748.log 2024-08-18T22:35:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81708.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.81708.log.gz 2024-08-18T22:35:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51794.log 2024-08-18T22:35:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34210.log 2024-08-18T22:35:15.626 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56748.log.gz 2024-08-18T22:35:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51794.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51794.log.gz 2024-08-18T22:35:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34210.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34210.log.gz 2024-08-18T22:35:15.628 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52919.log 2024-08-18T22:35:15.629 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34798.log 2024-08-18T22:35:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52919.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-18T22:35:15.631 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52919.log.gz 2024-08-18T22:35:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34798.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34798.log.gz 2024-08-18T22:35:15.636 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57516.log 2024-08-18T22:35:15.637 INFO:teuthology.orchestra.run.smithi005.stderr: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-18T22:35:15.638 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52536.log 2024-08-18T22:35:15.639 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57516.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-18T22:35:15.639 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57516.log.gz 2024-08-18T22:35:15.640 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52536.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52536.log.gz 2024-08-18T22:35:15.644 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34546.log 2024-08-18T22:35:15.646 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51997.log 2024-08-18T22:35:15.647 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34546.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34546.log.gz 2024-08-18T22:35:15.648 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79587.log 2024-08-18T22:35:15.649 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51997.log.gz 2024-08-18T22:35:15.650 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79587.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79587.log.gz 2024-08-18T22:35:15.651 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86355.log 2024-08-18T22:35:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54143.log 2024-08-18T22:35:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86355.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86355.log.gz 2024-08-18T22:35:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54143.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54143.log.gz 2024-08-18T22:35:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76576.log 2024-08-18T22:35:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57081.log 2024-08-18T22:35:15.658 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76576.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76576.log.gz 2024-08-18T22:35:15.658 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57081.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57081.log.gz 2024-08-18T22:35:15.659 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51690.log 2024-08-18T22:35:15.660 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54799.log 2024-08-18T22:35:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51690.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51690.log.gz 2024-08-18T22:35:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54799.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54799.log.gz 2024-08-18T22:35:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36240.log 2024-08-18T22:35:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82308.log 2024-08-18T22:35:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36240.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36240.log.gz 2024-08-18T22:35:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82308.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.82308.log.gz 2024-08-18T22:35:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78902.log 2024-08-18T22:35:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71120.log 2024-08-18T22:35:15.670 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78902.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78902.log.gz 2024-08-18T22:35:15.671 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71120.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71120.log.gz 2024-08-18T22:35:15.672 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-18T22:35:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74276.log 2024-08-18T22:35:15.681 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.0.74276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74276.log.gz 2024-08-18T22:35:15.681 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35673.log 2024-08-18T22:35:15.681 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35673.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35673.log.gz 2024-08-18T22:35:15.681 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78572.log 2024-08-18T22:35:15.681 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81524.log 2024-08-18T22:35:15.683 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81524.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81524.log.gz 2024-08-18T22:35:15.683 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81550.log 2024-08-18T22:35:15.685 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78572.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.78572.log.gz 2024-08-18T22:35:15.687 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34202.log 2024-08-18T22:35:15.688 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81550.log.gz 2024-08-18T22:35:15.689 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34390.log 2024-08-18T22:35:15.694 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34202.log: /var/log/ceph/ceph-client.admin.34390.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84692.log 2024-08-18T22:35:15.694 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34202.log.gz 2024-08-18T22:35:15.695 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34390.log.gz 2024-08-18T22:35:15.696 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53042.log 2024-08-18T22:35:15.701 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84692.log: /var/log/ceph/ceph-client.admin.53042.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81656.log 2024-08-18T22:35:15.701 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84692.log.gz 2024-08-18T22:35:15.702 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53042.log.gz 2024-08-18T22:35:15.705 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49002.log 2024-08-18T22:35:15.707 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49002.log.gz 2024-08-18T22:35:15.709 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76034.log 2024-08-18T22:35:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76034.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76034.log.gz 2024-08-18T22:35:15.712 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81656.log.gz 2024-08-18T22:35:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50212.log 2024-08-18T22:35:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50212.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50212.log.gz 2024-08-18T22:35:15.716 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54332.log 2024-08-18T22:35:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54332.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54332.log.gz 2024-08-18T22:35:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55889.log 2024-08-18T22:35:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86329.log 2024-08-18T22:35:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55889.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55889.log.gz 2024-08-18T22:35:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87523.log 2024-08-18T22:35:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87523.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87523.log.gz 2024-08-18T22:35:15.728 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86329.log.gz 2024-08-18T22:35:15.728 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78468.log 2024-08-18T22:35:15.730 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78468.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.78468.log.gz 2024-08-18T22:35:15.731 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51020.log 2024-08-18T22:35:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5/var/log/ceph/ceph-client.admin.51020.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51020.log.gz 2024-08-18T22:35:15.735 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53045.log 2024-08-18T22:35:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53045.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53045.log.gz 2024-08-18T22:35:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49567.log 2024-08-18T22:35:15.741 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82859.log 2024-08-18T22:35:15.741 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49567.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49567.log.gz 2024-08-18T22:35:15.744 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82859.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82859.log.gz 2024-08-18T22:35:15.744 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88146.log 2024-08-18T22:35:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88146.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88146.log.gz 2024-08-18T22:35:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82911.log 2024-08-18T22:35:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82911.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.82911.log.gz 2024-08-18T22:35:15.751 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82256.log 2024-08-18T22:35:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82256.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.82256.log.gz 2024-08-18T22:35:15.754 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73639.log 2024-08-18T22:35:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55917.log 2024-08-18T22:35:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73639.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73639.log.gz 2024-08-18T22:35:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84324.log 2024-08-18T22:35:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55917.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55917.log.gz 2024-08-18T22:35:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82453.log 2024-08-18T22:35:15.761 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.84324.log.gz 2024-08-18T22:35:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52160.log 2024-08-18T22:35:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82453.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.82453.log.gz 2024-08-18T22:35:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54540.log 2024-08-18T22:35:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52160.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52160.log.gz 2024-08-18T22:35:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54540.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54540.log.gz 2024-08-18T22:35:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79971.log 2024-08-18T22:35:15.773 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79971.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.79971.log.gz 2024-08-18T22:35:15.773 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81738.log 2024-08-18T22:35:15.775 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81738.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81738.log.gz 2024-08-18T22:35:15.776 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50516.log 2024-08-18T22:35:15.779 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50516.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50516.log.gz 2024-08-18T22:35:15.779 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51820.log 2024-08-18T22:35:15.781 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53489.log 2024-08-18T22:35:15.782 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51820.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51820.log.gz 2024-08-18T22:35:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53489.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53489.log.gz 2024-08-18T22:35:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56320.log 2024-08-18T22:35:15.789 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56320.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56320.log.gz 2024-08-18T22:35:15.789 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54644.log 2024-08-18T22:35:15.790 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58250.log 2024-08-18T22:35:15.792 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54644.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54644.log.gz 2024-08-18T22:35:15.794 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85858.log 2024-08-18T22:35:15.795 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58250.log.gz 2024-08-18T22:35:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57939.log 2024-08-18T22:35:15.799 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.85858.log.gz 2024-08-18T22:35:15.802 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70370.log 2024-08-18T22:35:15.803 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57939.log.gz 2024-08-18T22:35:15.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70370.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.70370.log.gz 2024-08-18T22:35:15.807 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82204.log 2024-08-18T22:35:15.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49132.log 2024-08-18T22:35:15.812 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.82204.log.gz 2024-08-18T22:35:15.812 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51664.log 2024-08-18T22:35:15.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49132.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49132.log.gz 2024-08-18T22:35:15.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51664.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51664.log.gz 2024-08-18T22:35:15.816 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78928.log 2024-08-18T22:35:15.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78928.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78928.log.gz 2024-08-18T22:35:15.819 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76287.log 2024-08-18T22:35:15.821 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76287.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76287.log.gz 2024-08-18T22:35:15.822 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36162.log 2024-08-18T22:35:15.825 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36162.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36162.log.gz 2024-08-18T22:35:15.825 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55678.log 2024-08-18T22:35:15.828 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55678.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55678.log.gz 2024-08-18T22:35:15.828 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88276.log 2024-08-18T22:35:15.831 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88276.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88276.log.gz 2024-08-18T22:35:15.831 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75839.log 2024-08-18T22:35:15.833 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53041.log 2024-08-18T22:35:15.834 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75839.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75839.log.gz 2024-08-18T22:35:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53041.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53041.log.gz 2024-08-18T22:35:15.838 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49028.log 2024-08-18T22:35:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49028.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49028.log.gz 2024-08-18T22:35:15.840 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54384.log 2024-08-18T22:35:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54384.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54384.log.gz 2024-08-18T22:35:15.844 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82569.log 2024-08-18T22:35:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82569.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.82569.log.gz 2024-08-18T22:35:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33780.log 2024-08-18T22:35:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54195.log 2024-08-18T22:35:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33780.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33780.log.gz 2024-08-18T22:35:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56719.log 2024-08-18T22:35:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54195.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54195.log.gz 2024-08-18T22:35:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56719.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56719.log.gz 2024-08-18T22:35:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50262.log 2024-08-18T22:35:15.859 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50262.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50262.log.gz 2024-08-18T22:35:15.859 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85732.log 2024-08-18T22:35:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85732.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.85732.log.gz 2024-08-18T22:35:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48775.log 2024-08-18T22:35:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71504.log 2024-08-18T22:35:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48775.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48775.log.gz 2024-08-18T22:35:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87679.log 2024-08-18T22:35:15.871 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71504.log.gz 2024-08-18T22:35:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87679.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.87679.log.gz 2024-08-18T22:35:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70525.log 2024-08-18T22:35:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70525.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.70525.log.gz 2024-08-18T22:35:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36110.log 2024-08-18T22:35:15.874 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82055.log 2024-08-18T22:35:15.876 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36110.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36110.log.gz 2024-08-18T22:35:15.878 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56478.log 2024-08-18T22:35:15.879 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.82055.log.gz 2024-08-18T22:35:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53604.log 2024-08-18T22:35:15.882 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56478.log.gz 2024-08-18T22:35:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35043.log 2024-08-18T22:35:15.885 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53604.log.gz 2024-08-18T22:35:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32646.log 2024-08-18T22:35:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.32646.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32646.log.gz 2024-08-18T22:35:15.892 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35043.log.gz 2024-08-18T22:35:15.892 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71788.log 2024-08-18T22:35:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.71788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71788.log.gz 2024-08-18T22:35:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50591.log 2024-08-18T22:35:15.897 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57887.log 2024-08-18T22:35:15.898 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50591.log.gz 2024-08-18T22:35:15.899 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55178.log 2024-08-18T22:35:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.55178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55178.log.gz 2024-08-18T22:35:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57887.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57887.log.gz 2024-08-18T22:35:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76504.log 2024-08-18T22:35:15.907 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76504.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76504.log.gz 2024-08-18T22:35:15.907 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81764.log 2024-08-18T22:35:15.910 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.81764.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81764.log.gz 2024-08-18T22:35:15.910 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54957.log 2024-08-18T22:35:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73770.log 2024-08-18T22:35:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54957.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54957.log.gz 2024-08-18T22:35:15.915 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79613.log 2024-08-18T22:35:15.916 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.73770.log.gz 2024-08-18T22:35:15.918 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86669.log 2024-08-18T22:35:15.922 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86669.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86669.log.gz 2024-08-18T22:35:15.922 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79613.log.gz 2024-08-18T22:35:15.922 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57185.log 2024-08-18T22:35:15.925 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57185.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57185.log.gz 2024-08-18T22:35:15.925 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49395.log 2024-08-18T22:35:15.928 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49395.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49395.log.gz 2024-08-18T22:35:15.928 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49697.log 2024-08-18T22:35:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57603.log 2024-08-18T22:35:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49697.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49697.log.gz 2024-08-18T22:35:15.934 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57603.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57603.log.gz 2024-08-18T22:35:15.934 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78954.log 2024-08-18T22:35:15.937 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72957.log 2024-08-18T22:35:15.937 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78954.log.gz 2024-08-18T22:35:15.939 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87806.log 2024-08-18T22:35:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.72957.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.72957.log.gz 2024-08-18T22:35:15.942 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79013.log 2024-08-18T22:35:15.948 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87806.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87806.log.gz 2024-08-18T22:35:15.948 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79013.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79013.log.gz 2024-08-18T22:35:15.949 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52692.log 2024-08-18T22:35:15.949 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52692.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52692.log.gz 2024-08-18T22:35:15.949 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73378.log 2024-08-18T22:35:15.951 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73378.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73378.log.gz 2024-08-18T22:35:15.951 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55444.log 2024-08-18T22:35:15.952 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79813.log 2024-08-18T22:35:15.955 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55444.log: /var/log/ceph/ceph-client.admin.79813.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55444.log.gz 2024-08-18T22:35:15.955 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.79813.log.gz -5 2024-08-18T22:35:15.955 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48931.log 2024-08-18T22:35:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48931.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48931.log.gz 2024-08-18T22:35:15.958 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79522.log 2024-08-18T22:35:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78546.log 2024-08-18T22:35:15.963 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79522.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79522.log.gz 2024-08-18T22:35:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.78546.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78546.log.gz 2024-08-18T22:35:15.964 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52835.log 2024-08-18T22:35:15.966 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52835.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52835.log.gz 2024-08-18T22:35:15.967 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49184.log 2024-08-18T22:35:15.969 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84841.log 2024-08-18T22:35:15.969 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49184.log.gz 2024-08-18T22:35:15.970 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52815.log 2024-08-18T22:35:15.972 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84841.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84841.log.gz 2024-08-18T22:35:15.973 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52258.log 2024-08-18T22:35:15.977 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.52815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52815.log.gz 2024-08-18T22:35:15.977 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52286.log 2024-08-18T22:35:15.977 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52258.log.gz 2024-08-18T22:35:15.978 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82729.log 2024-08-18T22:35:15.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76235.log 2024-08-18T22:35:15.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82729.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82729.log.gz 2024-08-18T22:35:15.982 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52286.log.gz 2024-08-18T22:35:15.984 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76550.log 2024-08-18T22:35:15.985 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76235.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76235.log.gz 2024-08-18T22:35:15.988 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76550.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.76550.log.gz 2024-08-18T22:35:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71088.log 2024-08-18T22:35:15.991 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71088.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71088.log.gz 2024-08-18T22:35:15.992 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34195.log 2024-08-18T22:35:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34195.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34195.log.gz 2024-08-18T22:35:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73878.log 2024-08-18T22:35:15.997 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53805.log 2024-08-18T22:35:15.998 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73878.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73878.log.gz 2024-08-18T22:35:16.001 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.53805.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.86435.log 2024-08-18T22:35:16.001 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53805.log.gz 2024-08-18T22:35:16.002 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84185.log 2024-08-18T22:35:16.004 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.86435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82885.log 2024-08-18T22:35:16.009 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86435.log.gz 2024-08-18T22:35:16.009 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84185.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84185.log.gz 2024-08-18T22:35:16.009 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84945.log 2024-08-18T22:35:16.010 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82885.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82885.log.gz 2024-08-18T22:35:16.010 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.34889.log 2024-08-18T22:35:16.016 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84945.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84945.log.gz 2024-08-18T22:35:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.2.34889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.34889.log.gz 2024-08-18T22:35:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33135.log 2024-08-18T22:35:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33135.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33135.log.gz 2024-08-18T22:35:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52984.log 2024-08-18T22:35:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51227.log 2024-08-18T22:35:16.020 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51227.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51227.log.gz 2024-08-18T22:35:16.021 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70420.log 2024-08-18T22:35:16.022 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52984.log.gz 2024-08-18T22:35:16.025 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71426.log 2024-08-18T22:35:16.026 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.70420.log.gz 2024-08-18T22:35:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73216.log 2024-08-18T22:35:16.030 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71426.log: gzip -5/var/log/ceph/ceph-client.admin.73216.log: --verbose -- /var/log/ceph/ceph-client.admin.87305.log 2024-08-18T22:35:16.032 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71426.log.gz 2024-08-18T22:35:16.032 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73216.log.gz 2024-08-18T22:35:16.034 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56962.log 2024-08-18T22:35:16.038 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87305.log: /var/log/ceph/ceph-client.admin.56962.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70470.log 2024-08-18T22:35:16.040 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.87305.log.gz 2024-08-18T22:35:16.040 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56962.log.gz 2024-08-18T22:35:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88016.log 2024-08-18T22:35:16.045 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88016.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88016.log.gz 2024-08-18T22:35:16.047 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87413.log 2024-08-18T22:35:16.047 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70470.log.gz 2024-08-18T22:35:16.049 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70795.log 2024-08-18T22:35:16.054 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87413.log: /var/log/ceph/ceph-client.admin.70795.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70795.log.gz 2024-08-18T22:35:16.054 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87413.log.gz 2024-08-18T22:35:16.054 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85247.log 2024-08-18T22:35:16.057 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85247.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85247.log.gz 2024-08-18T22:35:16.058 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70769.log 2024-08-18T22:35:16.060 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70769.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70769.log.gz 2024-08-18T22:35:16.061 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49931.log 2024-08-18T22:35:16.063 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.49931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49931.log.gz 2024-08-18T22:35:16.064 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79353.log 2024-08-18T22:35:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75943.log 2024-08-18T22:35:16.066 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79353.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79353.log.gz 2024-08-18T22:35:16.069 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75943.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75943.log.gz 2024-08-18T22:35:16.070 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73509.log 2024-08-18T22:35:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73509.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73509.log.gz 2024-08-18T22:35:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48743.log 2024-08-18T22:35:16.075 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48743.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48743.log.gz 2024-08-18T22:35:16.075 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51070.log 2024-08-18T22:35:16.079 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51070.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51070.log.gz 2024-08-18T22:35:16.079 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73965.log 2024-08-18T22:35:16.080 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71556.log 2024-08-18T22:35:16.082 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73965.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73965.log.gz 2024-08-18T22:35:16.085 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71556.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.71556.log.gz 2024-08-18T22:35:16.085 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56268.log 2024-08-18T22:35:16.091 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56268.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56268.log.gz 2024-08-18T22:35:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79229.log 2024-08-18T22:35:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79229.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79229.log.gz 2024-08-18T22:35:16.092 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55195.log 2024-08-18T22:35:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55195.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.55195.log.gz 2024-08-18T22:35:16.095 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75687.log 2024-08-18T22:35:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49671.log 2024-08-18T22:35:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75687.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75687.log.gz 2024-08-18T22:35:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49671.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49671.log.gz 2024-08-18T22:35:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33584.log 2024-08-18T22:35:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33584.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33584.log.gz 2024-08-18T22:35:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35271.log 2024-08-18T22:35:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85355.log 2024-08-18T22:35:16.108 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35271.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35271.log.gz 2024-08-18T22:35:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85355.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85355.log.gz 2024-08-18T22:35:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57012.log 2024-08-18T22:35:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75659.log 2024-08-18T22:35:16.113 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57012.log.gz 2024-08-18T22:35:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49080.log 2024-08-18T22:35:16.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75659.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75659.log.gz 2024-08-18T22:35:16.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49080.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49080.log.gz 2024-08-18T22:35:16.119 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56060.log 2024-08-18T22:35:16.122 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56060.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56060.log.gz 2024-08-18T22:35:16.122 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88224.log 2024-08-18T22:35:16.125 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88224.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88224.log.gz 2024-08-18T22:35:16.125 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76693.log 2024-08-18T22:35:16.130 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82360.log 2024-08-18T22:35:16.130 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76693.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76693.log.gz 2024-08-18T22:35:16.131 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82360.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82360.log.gz 2024-08-18T22:35:16.131 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57490.log 2024-08-18T22:35:16.134 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57490.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57490.log.gz 2024-08-18T22:35:16.134 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85782.log 2024-08-18T22:35:16.137 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49645.log 2024-08-18T22:35:16.138 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.85782.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85782.log.gz 2024-08-18T22:35:16.138 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56034.log 2024-08-18T22:35:16.141 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56034.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56034.log.gz 2024-08-18T22:35:16.141 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53656.log 2024-08-18T22:35:16.142 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49645.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49645.log.gz 2024-08-18T22:35:16.145 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33083.log 2024-08-18T22:35:16.145 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53656.log.gz 2024-08-18T22:35:16.147 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28598.log 2024-08-18T22:35:16.147 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33083.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33083.log.gz 2024-08-18T22:35:16.148 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51525.log 2024-08-18T22:35:16.151 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28598.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28598.log.gz 2024-08-18T22:35:16.153 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34209.log 2024-08-18T22:35:16.154 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51525.log.gz 2024-08-18T22:35:16.154 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33662.log 2024-08-18T22:35:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34209.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34209.log.gz 2024-08-18T22:35:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57965.log 2024-08-18T22:35:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33662.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33662.log.gz 2024-08-18T22:35:16.162 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57965.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57965.log.gz 2024-08-18T22:35:16.162 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88198.log 2024-08-18T22:35:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88198.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88198.log.gz 2024-08-18T22:35:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75507.log 2024-08-18T22:35:16.168 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75507.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.75507.log.gz 2024-08-18T22:35:16.169 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50112.log 2024-08-18T22:35:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53779.log 2024-08-18T22:35:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50112.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50112.log.gz 2024-08-18T22:35:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53779.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53779.log.gz 2024-08-18T22:35:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36292.log 2024-08-18T22:35:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.36292.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36292.log.gz 2024-08-18T22:35:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84789.log 2024-08-18T22:35:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35375.log 2024-08-18T22:35:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84789.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.84789.log.gz 2024-08-18T22:35:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88068.log 2024-08-18T22:35:16.183 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35375.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35375.log.gz 2024-08-18T22:35:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88068.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88068.log.gz 2024-08-18T22:35:16.186 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28817.log 2024-08-18T22:35:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75633.log 2024-08-18T22:35:16.189 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28817.log.gz 2024-08-18T22:35:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79125.log 2024-08-18T22:35:16.193 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75633.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75633.log.gz 2024-08-18T22:35:16.195 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79125.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79125.log.gz 2024-08-18T22:35:16.195 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82081.log 2024-08-18T22:35:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82081.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.82081.log.gz 2024-08-18T22:35:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74127.log 2024-08-18T22:35:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49879.log 2024-08-18T22:35:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74127.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74127.log.gz 2024-08-18T22:35:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49879.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49879.log.gz 2024-08-18T22:35:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56508.log 2024-08-18T22:35:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56508.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56508.log.gz 2024-08-18T22:35:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57412.log 2024-08-18T22:35:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57412.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57412.log.gz 2024-08-18T22:35:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82543.log 2024-08-18T22:35:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.82543.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82543.log.gz 2024-08-18T22:35:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84422.log 2024-08-18T22:35:16.217 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.84422.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.84422.log.gz 2024-08-18T22:35:16.218 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56370.log 2024-08-18T22:35:16.220 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56854.log 2024-08-18T22:35:16.221 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56370.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56370.log.gz 2024-08-18T22:35:16.223 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56854.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56854.log.gz 2024-08-18T22:35:16.223 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87471.log 2024-08-18T22:35:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87471.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87471.log.gz 2024-08-18T22:35:16.226 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50062.log 2024-08-18T22:35:16.230 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86643.log 2024-08-18T22:35:16.231 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50062.log: /var/log/ceph/ceph-client.admin.86643.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50062.log.gz 2024-08-18T22:35:16.231 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.86643.log.gz 2024-08-18T22:35:16.231 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51122.log 2024-08-18T22:35:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51122.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51122.log.gz 2024-08-18T22:35:16.234 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53630.log 2024-08-18T22:35:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51742.log 2024-08-18T22:35:16.237 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53630.log.gz 2024-08-18T22:35:16.239 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57263.log 2024-08-18T22:35:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51742.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51742.log.gz 2024-08-18T22:35:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88120.log 2024-08-18T22:35:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57263.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57263.log.gz 2024-08-18T22:35:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.88120.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88120.log.gz 2024-08-18T22:35:16.245 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75976.log 2024-08-18T22:35:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75976.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75976.log.gz 2024-08-18T22:35:16.248 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52458.log 2024-08-18T22:35:16.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52458.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52458.log.gz 2024-08-18T22:35:16.251 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34442.log 2024-08-18T22:35:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.34442.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34442.log.gz 2024-08-18T22:35:16.254 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52484.log 2024-08-18T22:35:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52484.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52484.log.gz 2024-08-18T22:35:16.257 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35831.log 2024-08-18T22:35:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87912.log 2024-08-18T22:35:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35831.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35831.log.gz 2024-08-18T22:35:16.262 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.87912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76777.log 2024-08-18T22:35:16.264 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76777.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76777.log.gz 2024-08-18T22:35:16.264 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79457.log 2024-08-18T22:35:16.265 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87912.log.gz 2024-08-18T22:35:16.267 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79457.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79457.log.gz 2024-08-18T22:35:16.268 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74023.log 2024-08-18T22:35:16.270 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79047.log 2024-08-18T22:35:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74023.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74023.log.gz 2024-08-18T22:35:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.79047.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79047.log.gz 2024-08-18T22:35:16.274 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33109.log 2024-08-18T22:35:16.276 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33109.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33109.log.gz 2024-08-18T22:35:16.276 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73850.log 2024-08-18T22:35:16.279 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73850.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73850.log.gz 2024-08-18T22:35:16.280 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2024-08-18T22:35:16.282 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.35779.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2024-08-18T22:35:16.283 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73107.log 2024-08-18T22:35:16.284 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73672.log 2024-08-18T22:35:16.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73107.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.73107.log.gz 2024-08-18T22:35:16.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73672.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73672.log.gz 2024-08-18T22:35:16.370 INFO:teuthology.orchestra.run.smithi005.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-18T22:35:16.408 INFO:teuthology.orchestra.run.smithi117.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-18T22:35:19.309 INFO:teuthology.orchestra.run.smithi005.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-18T22:35:19.391 INFO:teuthology.orchestra.run.smithi117.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-18T22:35:19.705 INFO:teuthology.orchestra.run.smithi117.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-18T22:35:20.234 INFO:teuthology.orchestra.run.smithi117.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-18T22:35:20.283 INFO:teuthology.orchestra.run.smithi005.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-18T22:35:20.711 INFO:teuthology.orchestra.run.smithi117.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-18T22:35:20.887 INFO:teuthology.orchestra.run.smithi005.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-18T22:35:22.147 INFO:teuthology.orchestra.run.smithi005.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-18T22:35:22.400 INFO:teuthology.orchestra.run.smithi005.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-18T22:35:37.927 INFO:teuthology.orchestra.run.smithi117.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-18T22:35:37.929 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-08-18T22:35:37.929 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m23.041s 2024-08-18T22:35:37.929 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m42.763s 2024-08-18T22:35:37.930 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m3.317s 2024-08-18T22:35:42.457 INFO:teuthology.orchestra.run.smithi005.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-18T22:35:42.460 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-18T22:35:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m27.585s 2024-08-18T22:35:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m53.994s 2024-08-18T22:35:42.460 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m5.332s 2024-08-18T22:35:42.461 INFO:tasks.ceph:Archiving logs... 2024-08-18T22:35:42.462 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915/remote/smithi005/log 2024-08-18T22:35:42.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-18T22:35:50.609 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915/remote/smithi117/log 2024-08-18T22:35:50.611 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-18T22:35:55.381 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-18T22:35:55.390 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-18T22:35:55.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-18T22:35:55.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-18T22:35:55.476 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-18T22:35:55.485 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-18T22:35:55.485 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T22:35:55.488 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T22:35:55.501 INFO:teuthology.orchestra.run.smithi005.stdout: remote refid st t when poll reach delay offset jitter 2024-08-18T22:35:55.501 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================== 2024-08-18T22:35:55.501 INFO:teuthology.orchestra.run.smithi005.stdout:*hv01.front.sepi 67.205.162.81 3 u 25 64 377 0.084 -4.932 0.660 2024-08-18T22:35:55.501 INFO:teuthology.orchestra.run.smithi005.stdout:+hv02.front.sepi 96.245.170.99 3 u 36 64 377 0.069 -3.778 0.655 2024-08-18T22:35:55.502 INFO:teuthology.orchestra.run.smithi005.stdout:+hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.094 -5.509 0.806 2024-08-18T22:35:55.502 INFO:teuthology.orchestra.run.smithi005.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-08-18T22:35:55.504 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2024-08-18T22:35:55.504 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2024-08-18T22:35:55.505 INFO:teuthology.orchestra.run.smithi117.stdout:*hv01.front.sepi 67.205.162.81 3 u 35 64 377 0.067 -3.566 1.200 2024-08-18T22:35:55.505 INFO:teuthology.orchestra.run.smithi117.stdout:+hv02.front.sepi 96.245.170.99 3 u 37 64 377 0.069 -2.464 1.218 2024-08-18T22:35:55.505 INFO:teuthology.orchestra.run.smithi117.stdout:+hv03.front.sepi 74.6.168.72 3 u 31 64 377 0.085 -4.152 0.804 2024-08-18T22:35:55.505 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-08-18T22:35:55.506 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-18T22:35:55.515 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-18T22:35:55.516 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-18T22:35:55.526 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-18T22:35:55.535 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-18T22:35:55.544 INFO:teuthology.task.internal:Duration was 1716.694922 seconds 2024-08-18T22:35:55.544 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-18T22:35:55.553 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-18T22:35:55.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-18T22:35:55.557 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-18T22:35:55.628 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-18T22:35:55.628 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-08-18T22:35:55.628 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-18T22:35:55.649 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-08-18T22:35:55.649 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-18T22:35:55.671 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-18T22:35:55.671 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-18T22:35:55.698 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-18T22:35:55.753 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-18T22:35:55.753 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-18T22:35:55.756 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-18T22:35:55.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-18T22:35:55.875 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-18T22:35:55.876 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-18T22:35:55.896 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-18T22:35:55.916 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-18T22:35:55.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-18T22:35:55.943 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-18T22:35:55.957 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-08-18T22:35:55.978 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-08-18T22:35:55.996 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-18T22:35:56.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:35:56.023 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-18T22:35:56.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:35:56.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-18T22:35:56.055 INFO:teuthology.task.internal:Transferring archived files... 2024-08-18T22:35:56.055 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915/remote/smithi005 2024-08-18T22:35:56.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-18T22:35:56.091 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859915/remote/smithi117 2024-08-18T22:35:56.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-18T22:35:56.117 INFO:teuthology.task.internal:Removing archive directory... 2024-08-18T22:35:56.117 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-18T22:35:56.134 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-18T22:35:56.162 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-18T22:35:56.173 INFO:teuthology.task.internal:Not uploading archives. 2024-08-18T22:35:56.173 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-18T22:35:56.184 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-18T22:35:56.184 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-18T22:35:56.187 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-18T22:35:56.192 INFO:teuthology.orchestra.run.smithi005.stdout: 658135 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 18 22:35 /home/ubuntu/cephtest 2024-08-18T22:35:56.214 INFO:teuthology.orchestra.run.smithi117.stdout: 658135 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 18 22:35 /home/ubuntu/cephtest 2024-08-18T22:35:56.215 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-18T22:35:56.225 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-18T22:35:56.312 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub} duration: 1716.6949217319489 failure_reason: 'Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=fd549e3bb5bb4363bdf099e576af145a status: fail success: false 2024-08-18T22:35:56.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-18T22:35:56.403 INFO:teuthology.run:FAIL